2025-10-01T14:06:14.964289Z :BasicWriteSession INFO: Random seed for debugging is 1759327574964282
2025-10-01T14:06:15.114932Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556254401834736560:2154];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:15.114990Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:15.118884Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:15.119513Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556254398675576331:2087];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:15.119862Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/004791/r3tmp/tmpI3e0Gn/pdisk_1.dat
2025-10-01T14:06:15.121975Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:15.170422Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:15.179869Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.182899Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 27221, node 1
2025-10-01T14:06:15.201781Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/004791/r3tmp/yandexxrj9e5.tmp
2025-10-01T14:06:15.201793Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/004791/r3tmp/yandexxrj9e5.tmp
2025-10-01T14:06:15.201856Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/004791/r3tmp/yandexxrj9e5.tmp
2025-10-01T14:06:15.201896Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:15.205298Z INFO: TTestServer started on Port 26247 GrpcPort 27221
TClient is connected to server localhost:26247
PQClient connected to localhost:27221
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-10-01T14:06:15.218656Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.218693Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:15.220602Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient::Ls response: 2025-10-01T14:06:15.235045Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.235071Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:15.238493Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-01T14:06:15.238692Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-01T14:06:15.239157Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-10-01T14:06:15.461263Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.514929Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254401834737411:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.514962Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254401834737403:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.514987Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.515349Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254401834737422:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.515374Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.515535Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254401834737442:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.515558Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.515967Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:15.521036Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556254401834737417:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:15.571637Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.578854Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556254398675576636:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.578949Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=Mjc2Mzk1NTEtY2ExOTM3MzktODJlY2I0ZDQtMTk2Y2E3NzE=, ActorId: [2:7556254398675576595:2294], ActorState: ExecuteState, TraceId: 01k6g1gqgb2xkae8p94w92wne4, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.579445Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.579705Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556254401834737555:2696] txid# 281474976720663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.584354Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556254401834737578:2342], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.584452Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=YzViZDdkOGQtNmY5Mzk0NTgtNTI4MjI4ZWUtMzFkODJjNzY=, ActorId: [1:7556254401834737399:2322], ActorState: ExecuteState, TraceId: 01k6g1gqep6b77ap5swxh0316y, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.584609Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.605364Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.627180Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:27221", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:15.672671Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6g1gqjx9pv67yyeft0z1ye0, Database: , SessionId: ydb://session/3?node_id=1&id=ZjUyNGQ5MzctYTYwYWY2ZmUtMzgzYTI0ZTYtZTBmNTY0MWQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556254401834737897:2950] 
2025-10-01T14:06:16.116418Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:16.121860Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:20.115365Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556254401834736560:2154];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:20.115403Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:06:20.119686Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556254398675576331:2087];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:20.120323Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:20.798263Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:27221
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:27221
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
2025-10-01T14:06:20.835965Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:20.842307Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556254423309574903:3266] connected; active server actors: 1
2025-10-01T14:06:20.843541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:20.843726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:20.845614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:20.853034Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6g1gwn8bgwrhc06pezfat6d, Database: , SessionId: ydb://session/3?node_id=1&id=Zjk1MGQ1MTYtODNhZjkzNDctYWY5Zjc4ZDAtMmMwOGMwN2M=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:20.859263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:20.866528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:20.866614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:20.866625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.866643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:20.868013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254423309574923:2452], now have 1 active actors on pipe
2025-10-01T14:06:20.868028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254423309574901:3264], now have 1 active actors on pipe
2025-10-01T14:06:20.868145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.867343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-01T14:06:20.873967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-10-01T14:06:20.880167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254423309574989:3322], now have 1 active actors on pipe
2025-10-01T14:06:20.880252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.889833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.890045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.890062Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.890128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.890192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254420150413671:2394]
2025-10-01T14:06:20.890867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.890871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:20.890876Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556254420150413671:2394]
2025-10-01T14:06:20.890880Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.891139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.891145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.891167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.891170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:20.891173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.891175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.891176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.891177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.891183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.891246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.891264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.892489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.892521Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327580920, TxId 281474976720679
2025-10-01T14:06:20.892528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.892530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.892549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.892581Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.893136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.893184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.893188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.893190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.893192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.893196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.893274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:20.893286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.893318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.894650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.894676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.895578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.991427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.991442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.991444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.093467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.093491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.093496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.194433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.194453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.194456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.294598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.294610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.294613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327580920
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759327580920
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:27221
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.382016Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:21.394954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.394972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.394975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.495307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.495323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.495342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.595693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.595712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.595714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.696029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.696045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.696047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.798477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.798491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.798493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:27221
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.895622Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:21.901806Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:21.902015Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:21.902023Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:27221
2025-10-01T14:06:21.902799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:21.902813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:21.902728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.902744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.902747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.904281Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.904485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.904531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:33580
2025-10-01T14:06:21.904536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33580 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:21.904540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:21.904907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:21.904947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:21.904959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:21.904961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:21.904965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254427604542431:2486] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:21.905406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254427604542431:2486] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:21.935642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254427604542431:2486] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:21.935773Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427604542463:2486] connected; active server actors: 1
2025-10-01T14:06:21.935783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254427604542431:2486] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:21.935786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254427604542431:2486] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:21.935841Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427604542463:2486] disconnected; active server actors: 1
2025-10-01T14:06:21.935844Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427604542463:2486] disconnected no session
2025-10-01T14:06:21.967310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254427604542431:2486] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:21.967323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254427604542431:2486] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:21.967327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254427604542431:2486] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:21.967337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:21.968527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:21.971584Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327581971 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:21.971637Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|5d7416b4-41dde272-66a270a-c8ee3fa9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:21.971753Z :INFO: [] MessageGroupId [src] SessionId [src|5d7416b4-41dde272-66a270a-c8ee3fa9_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:21.971759Z :INFO: [] MessageGroupId [src] SessionId [src|5d7416b4-41dde272-66a270a-c8ee3fa9_0] Write session will now close
2025-10-01T14:06:21.971764Z :DEBUG: [] MessageGroupId [src] SessionId [src|5d7416b4-41dde272-66a270a-c8ee3fa9_0] Write session: aborting
2025-10-01T14:06:21.971873Z :INFO: [] MessageGroupId [src] SessionId [src|5d7416b4-41dde272-66a270a-c8ee3fa9_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:21.971878Z :DEBUG: [] MessageGroupId [src] SessionId [src|5d7416b4-41dde272-66a270a-c8ee3fa9_0] Write session: destroy
2025-10-01T14:06:21.971187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|5d7416b4-41dde272-66a270a-c8ee3fa9_0
2025-10-01T14:06:21.970479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254427604542485:2486], now have 1 active actors on pipe
2025-10-01T14:06:21.970521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.970530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.970564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|5d7416b4-41dde272-66a270a-c8ee3fa9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:21.970576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.970583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.970586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:21.970608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.970626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:21.970646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.971009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.971014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.971031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.972280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|5d7416b4-41dde272-66a270a-c8ee3fa9_0 grpc read done: success: 0 data: 
2025-10-01T14:06:21.972286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|5d7416b4-41dde272-66a270a-c8ee3fa9_0 grpc read failed
2025-10-01T14:06:21.972293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|5d7416b4-41dde272-66a270a-c8ee3fa9_0 grpc closed
2025-10-01T14:06:21.972299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|5d7416b4-41dde272-66a270a-c8ee3fa9_0 is DEAD
2025-10-01T14:06:21.972502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
Session was created
Got new write session event: ReadyToAcceptEvent
Got new write session event: ReadyToAcceptEvent
2025-10-01T14:06:21.972907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254427604542485:2486] destroyed
2025-10-01T14:06:21.972923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:21.972931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.972935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.972936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.006520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.006537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.006541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:06:22.028287Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:27221" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:27221" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:27221" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-01T14:06:22.030900Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:22.031069Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-01T14:06:22.090321Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-10-01T14:06:22.092145Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.092289Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-10-01T14:06:22.090536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:22.090550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-01T14:06:22.093673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.093719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:35342
2025-10-01T14:06:22.093725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:35342 proto=topic  topic=test-topic durationSec=0
2025-10-01T14:06:22.093730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:22.094451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-01T14:06:22.094488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:22.094490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:22.094493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:22.094499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254431899509794:2500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:22.095077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254431899509794:2500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:22.099744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254431899509794:2500] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:22.099856Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254431899509813:2500] connected; active server actors: 1
2025-10-01T14:06:22.099868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254431899509794:2500] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-01T14:06:22.099871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254431899509794:2500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:22.099936Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254431899509813:2500] disconnected; active server actors: 1
2025-10-01T14:06:22.099943Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254431899509813:2500] disconnected no session
2025-10-01T14:06:22.107268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254431899509794:2500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:22.107285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254431899509794:2500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:22.107289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254431899509794:2500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:22.107299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:22.108117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254431899509830:2500], now have 1 active actors on pipe
2025-10-01T14:06:22.108332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:22.108509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.108525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.108554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:22.108568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.108578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.108581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.108593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.108609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:22.108631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.109012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.109024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.109042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.109174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.109182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.109184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.109257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0
2025-10-01T14:06:22.109577Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:22.109589Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327582109 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:22.109620Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-10-01T14:06:22.109692Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-10-01T14:06:22.109908Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:06:22.109930Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-10-01T14:06:22.110125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.110237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.110420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.110430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.110450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:22.110626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.110825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.110832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.110933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 96 offset: -1
2025-10-01T14:06:22.110941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.110954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.110960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.110963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.110989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-01T14:06:22.111047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 170 count 1 nextOffset 1 batches 1
2025-10-01T14:06:22.111052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.111097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 158 WTime 1759327582109
2025-10-01T14:06:22.111116Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.111127Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 158
2025-10-01T14:06:22.114457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 158 actorID [2:7556254420150413649:2394]
2025-10-01T14:06:22.114486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.114506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 103 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.114524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.114536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-01T14:06:22.114567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:22.114573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:22.114577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.114579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.114581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.114600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-10-01T14:06:22.114603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 158 bytes (158)
2025-10-01T14:06:22.114607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 158 (8388608)
2025-10-01T14:06:22.114618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-01T14:06:22.114651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-01T14:06:22.114666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 158 count 1 last offset 0, current partition end offset: 1
2025-10-01T14:06:22.114670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:22.114679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 158 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.114683Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-01T14:06:22.114695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:22.114709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 138 from pos 0 cbcount 1
2025-10-01T14:06:22.114723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582109 queuesize 0 startOffset 0
2025-10-01T14:06:22.115084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 158
2025-10-01T14:06:22.115097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-10-01T14:06:22.115255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.115641Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-10-01T14:06:22.115773Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 4000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-10-01T14:06:22.115779Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-10-01T14:06:22.115783Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session: acknoledged message 1
Got new write session event: AcksEvent: { seqNo : 1, State : EES_WRITTEN, offset : 0, partitionId : 0 } write stat: Write time 0.004000s minimal time in partition queue 0.000000s maximal time in partition queue 0.000000s partition quoted time 0.000000s topic quoted time 0.000000s
2025-10-01T14:06:22.115927Z :INFO: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-01T14:06:22.115935Z :INFO: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session will now close
2025-10-01T14:06:22.115943Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session: aborting
2025-10-01T14:06:22.116137Z :INFO: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:22.116212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0 grpc read done: success: 0 data: 
2025-10-01T14:06:22.116223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0 grpc read failed
2025-10-01T14:06:22.116229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0 grpc closed
2025-10-01T14:06:22.116233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0 is DEAD
2025-10-01T14:06:22.116464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:22.116639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254431899509830:2500] destroyed
2025-10-01T14:06:22.116653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:22.116659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.116661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.116663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.116939Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: CANCELLED, Details: , InternalError: 0
2025-10-01T14:06:22.116949Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session is aborting and will not restart
2025-10-01T14:06:22.116971Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|89871e42-fa5b14cf-a0807b6e-3d2d0197_0]  MessageGroupId [src_id] Write session: destroy
2025-10-01T14:06:22.209536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.209556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.209559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.675061Z :CloseWriteSessionImmediately INFO: Random seed for debugging is 1759327582675052
2025-10-01T14:06:22.791113Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556254429255111524:2251];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:22.791677Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:22.792090Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:22.792122Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-01T14:06:22.792189Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:22.795362Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:123: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, got undelivered to scheme cache: ActorUnknown
2025-10-01T14:06:22.795446Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/004791/r3tmp/tmp8delh7/pdisk_1.dat
2025-10-01T14:06:22.831329Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:06:22.833671Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:22.833692Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:22.835815Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-01T14:06:22.836141Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 13090, node 3
2025-10-01T14:06:22.845268Z INFO: TTestServer started on Port 29170 GrpcPort 13090
2025-10-01T14:06:22.847003Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/004791/r3tmp/yandextyLCum.tmp
2025-10-01T14:06:22.847017Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/004791/r3tmp/yandextyLCum.tmp
2025-10-01T14:06:22.847069Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/004791/r3tmp/yandextyLCum.tmp
2025-10-01T14:06:22.847091Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
TClient is connected to server localhost:29170
PQClient connected to localhost:13090
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:22.894824Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:22.894861Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:22.899289Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:22.899576Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-10-01T14:06:22.899095Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
waiting...
waiting...
waiting...
2025-10-01T14:06:23.035904Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:23.190997Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254433550078944:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:23.191017Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254433550078976:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:23.191044Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:23.191269Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254433550078982:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:23.191295Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:23.192281Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254433427519364:2323], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:23.192310Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:23.192341Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7556254433427519401:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:23.193080Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:23.198650Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556254433550078983:2128] txid# 281474976710657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:23.200885Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:23.201102Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7556254433427519403:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:23.201131Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556254433550078981:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-10-01T14:06:23.214996Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:23.249404Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:23.262089Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556254433550079074:2173] txid# 281474976710658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:13090", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:23.280020Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7556254433427519895:2965] txid# 281474976720665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:23.287095Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6g1gz12ar3nv3gacd2z1v5d, Database: , SessionId: ydb://session/3?node_id=3&id=MTAxMjhlMzktYjU5M2FkYzAtZGE4NDZjYWMtZGUzMWM4NjY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556254433427519951:2998] 
2025-10-01T14:06:23.787824Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:23.790089Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:27.791292Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556254429255111524:2251];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:27.791328Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:28.572037Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:13090
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:28.586953Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:13090
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:28.592442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:28.593802Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556254454902357046:3339] connected; active server actors: 1
2025-10-01T14:06:28.594127Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:28.594298Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:28.594967Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-10-01T14:06:28.595054Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:28.593215Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:28.593289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:28.593297Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:28.593306Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:28.593519Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254454902357045:3338], now have 1 active actors on pipe
2025-10-01T14:06:28.593597Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:28.595559Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7556254455024915983:2392], now have 1 active actors on pipe
2025-10-01T14:06:28.595613Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:28.597036Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254454902357116:3393], now have 1 active actors on pipe
2025-10-01T14:06:28.597097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:28.597718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:28.597860Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:28.597870Z node 3 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:28.597914Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:28.597945Z node 3 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7556254454902357128:2477]
2025-10-01T14:06:28.598625Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:28.598636Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:28.598641Z node 3 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7556254454902357128:2477]
2025-10-01T14:06:28.598647Z node 3 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:28.598959Z node 3 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:28.598965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.598982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.598984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.598988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:28.598990Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.598992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.598993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:28.598999Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:28.599063Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:28.599088Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:28.606722Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720683. Ctx: { TraceId: 01k6g1h47fehty9v2jk7bmjvez, Database: , SessionId: ydb://session/3?node_id=3&id=YTJhZmY1Zi02Y2ZmYjY0ZC1iNjk1MGZkOC0zODA3YjNkZA==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:28.606764Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:28.606804Z node 3 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327588641, TxId 281474976720682
2025-10-01T14:06:28.606816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.606818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.606846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.606891Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:28.610775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:28.610848Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:28.610862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.610864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.610866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.610873Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:28.610973Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:28.610999Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:28.611046Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-10-01T14:06:28.612656Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:28.612682Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:28.613146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759327588641
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720682
    CreateStep: 1759327588641
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:13090
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:28.613962Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:28.699167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.699183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.699186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.799495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.799516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.799519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.902481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.902508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.902511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.003319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.003340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.003342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.103630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.103650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.103653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13090
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:29.115371Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:29.206625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.206643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.206647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.306926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.306945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.306948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.407257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.407273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.407275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.507613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.507627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.507629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.607930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.607944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.607947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:13090
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:29.617434Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:29.618439Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:29.618624Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:29.618629Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:13090
2025-10-01T14:06:29.618887Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:29.618984Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:29.618995Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:29.619133Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:29.619179Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:39848
2025-10-01T14:06:29.619190Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39848 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:29.619200Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:29.619566Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:29.619593Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:29.619599Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:29.619601Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:29.619605Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254459197324630:2515] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:29.620097Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254459197324630:2515] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:29.641576Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556254459197324630:2515] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:29.641668Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254459197324661:2515] connected; active server actors: 1
2025-10-01T14:06:29.641725Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556254459197324630:2515] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:29.641733Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254459197324630:2515] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:29.641833Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254459197324661:2515] disconnected; active server actors: 1
2025-10-01T14:06:29.641851Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254459197324661:2515] disconnected no session
2025-10-01T14:06:29.665446Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254459197324630:2515] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:29.665464Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254459197324630:2515] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:29.665468Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254459197324630:2515] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:29.665477Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:29.665630Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-10-01T14:06:29.665648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254459197324682:2515], now have 1 active actors on pipe
2025-10-01T14:06:29.665659Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.665665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.665692Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|7fd18e6e-553c2999-a7744fda-5a4f7569_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:29.665707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.665716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.665719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:29.665729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.665743Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:29.665764Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.665804Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.665811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.665823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.665854Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|7fd18e6e-553c2999-a7744fda-5a4f7569_0
2025-10-01T14:06:29.666163Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327589666 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:29.666201Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|7fd18e6e-553c2999-a7744fda-5a4f7569_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:29.666320Z :INFO: [] MessageGroupId [src] SessionId [src|7fd18e6e-553c2999-a7744fda-5a4f7569_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:29.666331Z :INFO: [] MessageGroupId [src] SessionId [src|7fd18e6e-553c2999-a7744fda-5a4f7569_0] Write session will now close
2025-10-01T14:06:29.666337Z :DEBUG: [] MessageGroupId [src] SessionId [src|7fd18e6e-553c2999-a7744fda-5a4f7569_0] Write session: aborting
2025-10-01T14:06:29.666489Z :INFO: [] MessageGroupId [src] SessionId [src|7fd18e6e-553c2999-a7744fda-5a4f7569_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:29.666495Z :DEBUG: [] MessageGroupId [src] SessionId [src|7fd18e6e-553c2999-a7744fda-5a4f7569_0] Write session: destroy
2025-10-01T14:06:29.666831Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|7fd18e6e-553c2999-a7744fda-5a4f7569_0 grpc read done: success: 0 data: 
2025-10-01T14:06:29.666839Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|7fd18e6e-553c2999-a7744fda-5a4f7569_0 grpc read failed
2025-10-01T14:06:29.666846Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|7fd18e6e-553c2999-a7744fda-5a4f7569_0 grpc closed
2025-10-01T14:06:29.666850Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|7fd18e6e-553c2999-a7744fda-5a4f7569_0 is DEAD
2025-10-01T14:06:29.667097Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:29.668480Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254459197324682:2515] destroyed
2025-10-01T14:06:29.668498Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:29.668506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.668509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.668511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-01T14:06:29.708327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.708341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.708344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.808742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.808760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.808763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.909005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.909019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.909022Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.009392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.009412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.009415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:14.176851Z :FallbackToSingleDb INFO: Random seed for debugging is 1759327574176844
2025-10-01T14:06:14.296941Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556254394838560718:2088];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:14.297634Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:14.300272Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:14.301172Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556254397558805962:2099];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:14.301188Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:14.303788Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/0047c3/r3tmp/tmpONxptr/pdisk_1.dat
2025-10-01T14:06:14.350278Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:14.348824Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:14.366670Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:14.366694Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:14.367559Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-01T14:06:14.367806Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:14.373289Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 62224, node 1
2025-10-01T14:06:14.389785Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/0047c3/r3tmp/yandex9P5F8T.tmp
2025-10-01T14:06:14.389800Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/0047c3/r3tmp/yandex9P5F8T.tmp
2025-10-01T14:06:14.390482Z INFO: TTestServer started on Port 27112 GrpcPort 62224
2025-10-01T14:06:14.389877Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/0047c3/r3tmp/yandex9P5F8T.tmp
2025-10-01T14:06:14.389911Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
TClient is connected to server localhost:27112
PQClient connected to localhost:62224
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-10-01T14:06:14.409393Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:14.409426Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
TClient::Ls response: 2025-10-01T14:06:14.410613Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:14.420892Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-01T14:06:14.534127Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:14.627827Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:14.734308Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254394838561622:2324], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.734522Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.734696Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254394838561650:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.735165Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254397558806241:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.735192Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254397558806216:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.735226Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.735603Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:14.739336Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254397558806246:2127] txid# 281474976720657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:14.739405Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254397558806272:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.739451Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.739533Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254397558806275:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.739563Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:14.743223Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__notify.cpp:122: NotifyTxCompletion, unknown transaction, txId: 281474976715661, at schemeshard: 72057594046644480
2025-10-01T14:06:14.743830Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556254394838561652:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-10-01T14:06:14.743933Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556254397558806245:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-10-01T14:06:14.787197Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:14.820014Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254397558806277:2135] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:14.821084Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:14.829970Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556254394838561948:2830] txid# 281474976715664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:14.841922Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556254397558806284:2306], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:14.842008Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=ZTgyYzg2YmItZTE3Mjc0NmQtZGE1ZWJmOWQtYTc5YWNjOWY=, ActorId: [2:7556254397558806213:2294], ActorState: ExecuteState, TraceId: 01k6g1gppd9vsmx9sxqz8ggbp1, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:14.842467Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:14.842737Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556254394838561959:2347], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:14.843000Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=NjljYWJkM2QtMmU1NTNlYmEtMTk0ODA5YzgtZDM3NDgwZTU=, ActorId: [1:7556254394838561619:2322], ActorState: ExecuteState, TraceId: 01k6g1gppb4fphdzyc5qbf8xvt, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:14.843076Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:14.849133Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:62224", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:14.891326Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k6g1gptn4amrdgq506k1fe0e, Database: , SessionId: ydb://session/3?node_id=1&id=MjMzYmI5YmUtMTA1ZDc2ZWMtNTE4NDBmNTYtYzU0ZTQ4MTc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556254394838562198:3013] 
2025-10-01T14:06:15.298797Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:15.303331Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:19.297379Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556254394838560718:2088];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:19.297419Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:06:19.301457Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556254397558805962:2099];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:19.301499Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:20.069633Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:62224
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.114977Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:62224
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:20.130681Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:20.131268Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:20.131321Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:20.131333Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.131339Z node 1 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:20.131377Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254420608366534:3331], now have 1 active actors on pipe
2025-10-01T14:06:20.131615Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.132896Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.133109Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556254420608366535:3332] connected; active server actors: 1
2025-10-01T14:06:20.133352Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:20.133482Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:20.133719Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7556254423328610500:2386], now have 1 active actors on pipe
2025-10-01T14:06:20.133759Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1
2025-10-01T14:06:20.133789Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:20.134960Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254420608366598:3381], now have 1 active actors on pipe
2025-10-01T14:06:20.135014Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.136187Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.136353Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.136373Z node 1 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.136426Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.136494Z node 1 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7556254420608366608:2469]
2025-10-01T14:06:20.136994Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.137001Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:20.137004Z node 1 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [1:7556254420608366608:2469]
2025-10-01T14:06:20.137008Z node 1 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.137188Z node 1 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.137195Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.137211Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.137212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:20.137214Z node 1 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.137215Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.137217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.137217Z node 1 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.137221Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.137265Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.137287Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.137958Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.137988Z node 1 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327580178, TxId 281474976715679
2025-10-01T14:06:20.137991Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.137993Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.138013Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.138043Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.138417Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.138468Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.138477Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.138479Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.138480Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.138485Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.138566Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:20.138586Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.138617Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.139731Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.139751Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.140309Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.141326Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k6g1gvyt5afbx983tm9njscz, Database: , SessionId: ydb://session/3?node_id=1&id=ZmExMjc4ZTctNmMxMmY0OGEtOTA4MGIyZGEtZjYyNWQwOTc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759327580178
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759327580178
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:62224
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.148075Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:20.237406Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.237436Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.237440Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.340927Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.340946Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.340950Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.441161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.441177Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.441180Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.541536Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.541561Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.541564Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.641881Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.641897Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.641899Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:62224
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.648928Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:20.742832Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.742848Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.742852Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.843111Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.843129Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.843133Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.943718Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.943734Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.943736Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.047464Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.047484Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.047486Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.147949Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.147967Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.147971Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:62224
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.163914Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:21.171482Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:21.171681Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:21.171686Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:62224
2025-10-01T14:06:21.173230Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.173621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:21.173640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:21.173990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.174024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:39272
2025-10-01T14:06:21.174033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:39272 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:21.174035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:21.174438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:21.174481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:21.174482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:21.174484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:21.174489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254424903334113:2505] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:21.174984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254424903334113:2505] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:21.214359Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254424903334144:2505] connected; active server actors: 1
2025-10-01T14:06:21.213785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254424903334113:2505] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:21.214695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254424903334113:2505] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:21.214703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254424903334113:2505] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:21.218492Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254424903334144:2505] disconnected; active server actors: 1
2025-10-01T14:06:21.218503Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254424903334144:2505] disconnected no session
2025-10-01T14:06:21.239459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254424903334113:2505] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:21.239475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254424903334113:2505] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:21.239479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254424903334113:2505] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:21.239488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:21.239893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-10-01T14:06:21.239911Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254424903334165:2505], now have 1 active actors on pipe
2025-10-01T14:06:21.239980Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.239990Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.240030Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|47c82a25-a6a70665-56ea1b42-2c4e198a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:21.240039Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.240044Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.240046Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:21.240057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.240072Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:21.240088Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.240197Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.240202Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.240214Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.240239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|47c82a25-a6a70665-56ea1b42-2c4e198a_0
2025-10-01T14:06:21.242474Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327581242 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:21.242515Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|47c82a25-a6a70665-56ea1b42-2c4e198a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:21.242642Z :INFO: [] MessageGroupId [src] SessionId [src|47c82a25-a6a70665-56ea1b42-2c4e198a_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:21.242653Z :INFO: [] MessageGroupId [src] SessionId [src|47c82a25-a6a70665-56ea1b42-2c4e198a_0] Write session will now close
2025-10-01T14:06:21.242659Z :DEBUG: [] MessageGroupId [src] SessionId [src|47c82a25-a6a70665-56ea1b42-2c4e198a_0] Write session: aborting
2025-10-01T14:06:21.242796Z :INFO: [] MessageGroupId [src] SessionId [src|47c82a25-a6a70665-56ea1b42-2c4e198a_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:21.242802Z :DEBUG: [] MessageGroupId [src] SessionId [src|47c82a25-a6a70665-56ea1b42-2c4e198a_0] Write session: destroy
2025-10-01T14:06:21.242999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|47c82a25-a6a70665-56ea1b42-2c4e198a_0 grpc read done: success: 0 data: 
2025-10-01T14:06:21.243008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|47c82a25-a6a70665-56ea1b42-2c4e198a_0 grpc read failed
2025-10-01T14:06:21.243016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|47c82a25-a6a70665-56ea1b42-2c4e198a_0 grpc closed
2025-10-01T14:06:21.243021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|47c82a25-a6a70665-56ea1b42-2c4e198a_0 is DEAD
2025-10-01T14:06:21.243209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:21.246474Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254424903334165:2505] destroyed
2025-10-01T14:06:21.246491Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:21.246499Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.246501Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.246503Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-01T14:06:21.250003Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-01T14:06:21.250031Z :INFO: [/Root] [] [fc08031-bbb6d357-f29101e2-d98b54db] Open read subsessions to databases: { name: , endpoint: localhost:62224, path: /Root }
2025-10-01T14:06:21.250108Z :INFO: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] Starting read session
2025-10-01T14:06:21.250112Z :DEBUG: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] Starting single session
2025-10-01T14:06:21.250337Z :DEBUG: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:21.250342Z :DEBUG: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:21.250346Z :DEBUG: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:06:21.250682Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.250699Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.250703Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.253185Z :DEBUG: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] [] Successfully connected. Initializing session
2025-10-01T14:06:21.254011Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:06:21.254030Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-01T14:06:21.256334Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:21.256448Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 read init: from# ipv6:[::1]:54882, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:21.256556Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 auth for : user
2025-10-01T14:06:21.256901Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 Handle describe topics response
2025-10-01T14:06:21.256927Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 auth is DEAD
2025-10-01T14:06:21.256947Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:06:21.257309Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:06:21.257571Z :INFO: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] [] Got InitResponse. ReadSessionId: shared/user_1_1_9820186533717120831_v1
2025-10-01T14:06:21.257585Z :DEBUG: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:21.257631Z :DEBUG: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:06:21.257646Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254424903334175:2519] connected; active server actors: 1
2025-10-01T14:06:21.258080Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:06:21.258142Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 got read request: guid# 128e371c-9d0bee77-7cd351f2-bf3abb69
2025-10-01T14:06:21.258280Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556254424903334175:2519] session shared/user_1_1_9820186533717120831_v1
2025-10-01T14:06:21.258301Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:06:21.258326Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:06:21.258341Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_9820186533717120831_v1" (Sender=[1:7556254424903334172:2519], Pipe=[1:7556254424903334175:2519], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:21.258346Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:06:21.258360Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:06:21.258382Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_9820186533717120831_v1" (Sender=[1:7556254424903334172:2519], Pipe=[1:7556254424903334175:2519], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:21.258395Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_9820186533717120831_v1" sender [1:7556254424903334172:2519] lock partition 0 for ReadingSession "shared/user_1_1_9820186533717120831_v1" (Sender=[1:7556254424903334172:2519], Pipe=[1:7556254424903334175:2519], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-01T14:06:21.258411Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:06:21.258416Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000053s
2025-10-01T14:06:21.258983Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_9820186533717120831_v1" ClientId: "user" PipeClient { RawX1: 7556254424903334175 RawX2: 4503603922340311 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:21.259017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:06:21.259088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556254424903334177:2522]
2025-10-01T14:06:21.259109Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254424903334177:2522], now have 1 active actors on pipe
2025-10-01T14:06:21.259117Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.259125Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.259140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_9820186533717120831_v1 on pipe: [1:7556254424903334177:2522]
2025-10-01T14:06:21.259161Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.259168Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.259170Z node 1 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:21.259198Z node 1 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_9820186533717120831_v1
2025-10-01T14:06:21.259200Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.259235Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:21.259436Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_9820186533717120831_v1:1 with generation 1
2025-10-01T14:06:21.260287Z node 1 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:21.262529Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:490: [72075186224037892][Partition][0][StateIdle] Received TPartition::Handle TEvHandleWriteResponse.
2025-10-01T14:06:21.262573Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:21.262582Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.262586Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.262589Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.262598Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:21.262622Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:06:21.262689Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759327581250 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:06:21.262701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-01T14:06:21.262725Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name:  Database path: /Root Database id:  CommittedOffset: 0 EndOffset: 0 }
2025-10-01T14:06:21.266425Z :INFO: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-01T14:06:21.266532Z :INFO: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] Closing read session. Close timeout: 0.010000s
2025-10-01T14:06:21.266546Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-01T14:06:21.266553Z :INFO: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] Counters: { Errors: 0 CurrentSessionLifetimeMs: 16 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:21.266673Z :INFO: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] Closing read session. Close timeout: 0.000000s
2025-10-01T14:06:21.266680Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-01T14:06:21.266683Z :INFO: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] Counters: { Errors: 0 CurrentSessionLifetimeMs: 16 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:21.266702Z :INFO: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] Closing read session. Close timeout: 0.000000s
2025-10-01T14:06:21.266705Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-10-01T14:06:21.266707Z :INFO: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] Counters: { Errors: 0 CurrentSessionLifetimeMs: 16 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:21.266721Z :NOTICE: [/Root] [/Root] [f1eae2eb-f53d9c0d-fbe62cbb-85ba9b12] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:06:21.267021Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-01T14:06:21.267055Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 grpc closed
2025-10-01T14:06:21.267072Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_9820186533717120831_v1 is DEAD
2025-10-01T14:06:21.267243Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_9820186533717120831_v1
2025-10-01T14:06:21.267256Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254424903334177:2522] destroyed
2025-10-01T14:06:21.267273Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_9820186533717120831_v1
2025-10-01T14:06:21.267550Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254424903334175:2519] disconnected; active server actors: 1
2025-10-01T14:06:21.267566Z node 2 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254424903334175:2519] client user disconnected session shared/user_1_1_9820186533717120831_v1
2025-10-01T14:06:21.351021Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.351038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.351042Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.451350Z node 1 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.451369Z node 1 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.451371Z node 1 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.671472Z :FallbackToSingleDbAfterBadRequest INFO: Random seed for debugging is 1759327581671466
2025-10-01T14:06:21.778608Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556254426483048235:2080];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:21.778627Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:21.788424Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556254423882880985:2144];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:21.788504Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:21.794910Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/0047c3/r3tmp/tmp2ratOs/pdisk_1.dat
2025-10-01T14:06:21.798420Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:21.800159Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:21.810448Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:21.838819Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 3176, node 3
2025-10-01T14:06:21.868900Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/0047c3/r3tmp/yandexcMz6aL.tmp
2025-10-01T14:06:21.868911Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/0047c3/r3tmp/yandexcMz6aL.tmp
2025-10-01T14:06:21.868972Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/0047c3/r3tmp/yandexcMz6aL.tmp
2025-10-01T14:06:21.869022Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:21.870770Z INFO: TTestServer started on Port 18762 GrpcPort 3176
2025-10-01T14:06:21.893676Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:21.893710Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
TClient is connected to server localhost:18762
PQClient connected to localhost:3176
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-10-01T14:06:21.899044Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:21.899609Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:21.899628Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:21.906754Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-01T14:06:21.907106Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:21.919749Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
2025-10-01T14:06:21.985298Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
waiting...
2025-10-01T14:06:22.000897Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:22.187947Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254428177848517:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.187972Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254428177848500:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.188010Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.189610Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:22.190794Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254428177848554:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.190824Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.190874Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254428177848556:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.190885Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:22.195570Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556254428177848527:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-01T14:06:22.227833Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556254430778016518:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:22.228473Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=YzliMTViZWQtZTQ1NjRjMDQtNTBlMGM2MDUtMTA2ZWUyYzE=, ActorId: [3:7556254430778016467:2321], ActorState: ExecuteState, TraceId: 01k6g1gy0ffawz83q93fhvcnbd, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:22.228590Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:22.231753Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:22.249572Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:22.271255Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:22.286091Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556254428177848655:2196] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3176", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:22.321048Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6g1gy2w3vzczpmf5g95b7hm, Database: , SessionId: ydb://session/3?node_id=3&id=ZDgwYTc3YTUtMzAxODU2ZDktYjY3MWMzMTktYmE5ODMzZWI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556254430778016902:2933] 
2025-10-01T14:06:22.786240Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:22.790480Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:26.778691Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556254426483048235:2080];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:26.778724Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:06:26.786902Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556254423882880985:2144];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:26.786940Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:27.470733Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3176
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:27.513471Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3176
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:27.528328Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556254452252853911:3250] connected; active server actors: 1
2025-10-01T14:06:27.528400Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:27.529559Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:27.534444Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:27.534951Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:27.541053Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:27.541167Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:27.541176Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:27.541191Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:27.541318Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254452252853910:3249], now have 1 active actors on pipe
2025-10-01T14:06:27.541332Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254452252853931:2448], now have 1 active actors on pipe
2025-10-01T14:06:27.541479Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-01T14:06:27.541716Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.543006Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:27.544790Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254452252853967:3294], now have 1 active actors on pipe
2025-10-01T14:06:27.544966Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.546268Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:27.546521Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:27.546536Z node 4 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:27.546593Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:27.546628Z node 4 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7556254449652685636:2405]
2025-10-01T14:06:27.547344Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:27.547349Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:27.547355Z node 4 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7556254449652685636:2405]
2025-10-01T14:06:27.547362Z node 4 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:27.547622Z node 4 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:27.547630Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.547649Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.547652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:27.547655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:27.547657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.547659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.547660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:27.547667Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:27.547748Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.547774Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:27.549696Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:27.549736Z node 4 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327587591, TxId 281474976720677
2025-10-01T14:06:27.549742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.549745Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.549769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.549811Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:27.550346Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6g1h36b4ypsythzpdtrbvmr, Database: , SessionId: ydb://session/3?node_id=3&id=MWJmZTE5YzYtN2JhMWJjNmItM2Q1ZDZjYTUtM2JjNjBkMjY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:27.550767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:27.550823Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:27.550829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.550832Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.550834Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.550840Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:27.550943Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:27.550962Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:27.551008Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.553158Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:27.553182Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:27.554428Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327587591
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327587591
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3176
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:27.571951Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:27.647100Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.647120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.647124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.747428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.747447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.747450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.847753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.847770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.847773Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.948147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.948168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.948171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.048488Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.048507Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.048510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3176
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:28.073202Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:28.148833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.148862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.148866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.249151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.249168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.249171Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.349536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.349552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.349563Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.449992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.450013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.450017Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.550240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.550258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.550262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3176
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:28.574754Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:28.575941Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:28.576189Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:28.576194Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3176
2025-10-01T14:06:28.576534Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:28.576678Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:28.576693Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:28.576805Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:28.576832Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:33356
2025-10-01T14:06:28.576842Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33356 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:28.576855Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:28.577233Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:28.577277Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:28.577283Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:28.577285Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:28.577291Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254456547821438:2483] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:28.577844Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254456547821438:2483] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:28.604211Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556254456547821438:2483] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:28.604292Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254456547821470:2483] connected; active server actors: 1
2025-10-01T14:06:28.604319Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556254456547821438:2483] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:28.604325Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254456547821438:2483] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:28.604384Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254456547821470:2483] disconnected; active server actors: 1
2025-10-01T14:06:28.604391Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254456547821470:2483] disconnected no session
2025-10-01T14:06:28.620180Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254456547821438:2483] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:28.620196Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254456547821438:2483] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:28.620199Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254456547821438:2483] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:28.620205Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:28.620661Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254456547821492:2483], now have 1 active actors on pipe
2025-10-01T14:06:28.620686Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-01T14:06:28.620777Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.620792Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.620814Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|748ccb72-8be04b2a-539c0c88-abb8a9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:28.620825Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.620830Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.620837Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.620862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.620876Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:28.620888Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.621067Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.621074Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.621082Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.621154Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|748ccb72-8be04b2a-539c0c88-abb8a9e_0
2025-10-01T14:06:28.621462Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327588621 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:28.621497Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|748ccb72-8be04b2a-539c0c88-abb8a9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:28.621585Z :INFO: [] MessageGroupId [src] SessionId [src|748ccb72-8be04b2a-539c0c88-abb8a9e_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:28.621592Z :INFO: [] MessageGroupId [src] SessionId [src|748ccb72-8be04b2a-539c0c88-abb8a9e_0] Write session will now close
2025-10-01T14:06:28.621600Z :DEBUG: [] MessageGroupId [src] SessionId [src|748ccb72-8be04b2a-539c0c88-abb8a9e_0] Write session: aborting
2025-10-01T14:06:28.621725Z :INFO: [] MessageGroupId [src] SessionId [src|748ccb72-8be04b2a-539c0c88-abb8a9e_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:28.621731Z :DEBUG: [] MessageGroupId [src] SessionId [src|748ccb72-8be04b2a-539c0c88-abb8a9e_0] Write session: destroy
2025-10-01T14:06:28.621863Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|748ccb72-8be04b2a-539c0c88-abb8a9e_0 grpc read done: success: 0 data: 
2025-10-01T14:06:28.621870Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|748ccb72-8be04b2a-539c0c88-abb8a9e_0 grpc read failed
2025-10-01T14:06:28.621876Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|748ccb72-8be04b2a-539c0c88-abb8a9e_0 grpc closed
2025-10-01T14:06:28.621880Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|748ccb72-8be04b2a-539c0c88-abb8a9e_0 is DEAD
PORTS 3176 18345
2025-10-01T14:06:28.622119Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:28.622229Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254456547821492:2483] destroyed
2025-10-01T14:06:28.622244Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:28.622249Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.622251Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.622253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-01T14:06:28.650613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.650634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.650638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.750946Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.750964Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.750967Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.851321Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.851340Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.851344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.951783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.951798Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.951803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.052241Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.052257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.052260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.154840Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.154863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.154866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.255273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.255293Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.255296Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.355631Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.355652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.355655Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.455970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.455986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.455989Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.556298Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.556312Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.556314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:06:29.625003Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-10-01T14:06:29.625035Z :INFO: [/Root] [] [f23f8a28-b6e269b6-f0d77956-2655fc1a] Open read subsessions to databases: { name: , endpoint: localhost:18345, path: /Root }
2025-10-01T14:06:29.625073Z :INFO: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Starting read session
2025-10-01T14:06:29.625077Z :DEBUG: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Starting single session
2025-10-01T14:06:29.625303Z :DEBUG: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:29.625307Z :DEBUG: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:29.625312Z :DEBUG: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:06:29.625343Z :ERROR: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] [] Got error. Status: CLIENT_CALL_UNIMPLEMENTED. Description: <main>: Error: GRpc error: (12):  <main>: Error: Grpc error response on endpoint localhost:18345 <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:18345. 
2025-10-01T14:06:29.625349Z :DEBUG: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:29.625352Z :DEBUG: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:29.625376Z :INFO: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] [] Closing session to cluster: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:18345" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:18345     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:18345. " }
2025-10-01T14:06:29.625449Z :NOTICE: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:06:29.625460Z :DEBUG: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] [] Abort session to cluster
Got new read session event: SessionClosed { Status: CLIENT_CALL_UNIMPLEMENTED Issues: "<main>: Error: Failed to establish connection to server "localhost:18345" ( cluster ). Attempts done: 1     <main>: Error: GRpc error: (12):      <main>: Error: Grpc error response on endpoint localhost:18345     <main>: Error: Endpoint list is empty for database /Root, cluster endpoint localhost:18345. " }
2025-10-01T14:06:29.625478Z :INFO: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Closing read session. Close timeout: 0.010000s
2025-10-01T14:06:29.625485Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:06:29.625490Z :INFO: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:29.625495Z :INFO: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Closing read session. Close timeout: 0.000000s
2025-10-01T14:06:29.625497Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:06:29.625511Z :INFO: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:29.625516Z :INFO: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Closing read session. Close timeout: 0.000000s
2025-10-01T14:06:29.625521Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-10-01T14:06:29.625523Z :INFO: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Counters: { Errors: 1 CurrentSessionLifetimeMs: 0 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:29.625527Z :NOTICE: [/Root] [/Root] [9c3d8e22-2e21fb07-870ed077-a510c3a7] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:06:29.656667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.656682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.656684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.757033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.757055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.757059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:15.126153Z :GetAllStartPartitionSessions INFO: Random seed for debugging is 1759327575126145
2025-10-01T14:06:15.224818Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556254400175874353:2089];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:15.225138Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:15.232111Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/004774/r3tmp/tmpDqnesm/pdisk_1.dat
2025-10-01T14:06:15.229141Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:15.271318Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:15.273240Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:15.273278Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-10-01T14:06:15.280733Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 3977, node 1
2025-10-01T14:06:15.302658Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/004774/r3tmp/yandex4msfJW.tmp
2025-10-01T14:06:15.302677Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/004774/r3tmp/yandex4msfJW.tmp
2025-10-01T14:06:15.302731Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/004774/r3tmp/yandex4msfJW.tmp
2025-10-01T14:06:15.302779Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:15.306316Z INFO: TTestServer started on Port 62923 GrpcPort 3977
TClient is connected to server localhost:62923
PQClient connected to localhost:3977
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: 2025-10-01T14:06:15.326341Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.326388Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:15.327989Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:15.332471Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.332494Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:15.333680Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-01T14:06:15.333958Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:15.334452Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-01T14:06:15.515958Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.564880Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.637736Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254400175875262:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.637776Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.637886Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254400175875274:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.638506Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254400175875303:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.638522Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.638553Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7556254400175875307:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.638563Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.638712Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:15.643737Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7556254400175875276:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-10-01T14:06:15.685538Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.685560Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556254398289057334:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.685694Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=NGQ5OWZiMi1kNDYzNGVkNy0xZDc2NzQ0Mi1iMTJjYTIyZg==, ActorId: [2:7556254398289057293:2294], ActorState: ExecuteState, TraceId: 01k6g1gqkh2ksrb5tr83zapa9c, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.686269Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.697378Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7556254400175875419:2711] txid# 281474976715663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.702503Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556254400175875442:2341], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.702593Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=Mjg5NzZhMGUtNTUwODkxZmUtYjY2YTgzZjMtYWIxZjE2OWY=, ActorId: [1:7556254400175875259:2323], ActorState: ExecuteState, TraceId: 01k6g1gqjj4vydppj6852wn528, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.702746Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.707743Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.734112Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3977", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:15.774243Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k6g1gqp7ca2mb37e56rr01p5, Database: , SessionId: ydb://session/3?node_id=1&id=YmMyOGRjMjgtYWI4NjI4ZmEtZjVjY2M0NWUtNjBmOThjNTk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556254400175875762:2964] 
2025-10-01T14:06:16.228865Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:16.230529Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:20.225000Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556254400175874353:2089];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:20.225037Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
waiting...
2025-10-01T14:06:20.930785Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
PQ Client: create topic: rt3.dc1--test-topic with 5 partitions
CallPersQueueGRPC request to localhost:3977
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.965677Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3977
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 5
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:20.978066Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556254421650712761:3273] connected; active server actors: 1
2025-10-01T14:06:20.978273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [1, 2, 3, 4, 0]
2025-10-01T14:06:20.978563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:20.981122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) (1, 72075186224037892) (2, 72075186224037892) (3, 72075186224037892) (4, 72075186224037892) 
2025-10-01T14:06:20.982731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:20.983317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:20.983370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:20.983385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.983396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:20.983468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254421650712780:2449], now have 1 active actors on pipe
2025-10-01T14:06:20.983479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254421650712760:3272], now have 1 active actors on pipe
2025-10-01T14:06:20.983667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-01T14:06:20.983735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.984454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.985919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254421650712811:3312], now have 1 active actors on pipe
2025-10-01T14:06:20.986331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.987306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.987762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.987775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.987778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.987780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.987783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.987803Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.987807Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][2][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.987809Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][3][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.987811Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][1][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.987813Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][4][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.987943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.988016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][1][StateInit] bootstrapping 1 [2:7556254419763894360:2394]
2025-10-01T14:06:20.988663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:1:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.988675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:1:Initializer] Initializing completed.
2025-10-01T14:06:20.988681Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][1][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 1 generation 1 [2:7556254419763894360:2394]
2025-10-01T14:06:20.988688Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][1][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 1 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.988989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][1][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.989005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.989036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.989043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-01T14:06:20.989047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-01T14:06:20.989049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.989051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.989053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][1][StateIdle] Still pending for come commits
2025-10-01T14:06:20.989060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.989100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.989162Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][2][StateInit] bootstrapping 2 [2:7556254419763894361:2394]
2025-10-01T14:06:20.989610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:2:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.989623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:2:Initializer] Initializing completed.
2025-10-01T14:06:20.989626Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][2][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 2 generation 1 [2:7556254419763894361:2394]
2025-10-01T14:06:20.989631Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][2][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 2 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.989845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][2][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.989856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.989872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.989880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-01T14:06:20.989882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-01T14:06:20.989884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.989885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.989886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][2][StateIdle] Still pending for come commits
2025-10-01T14:06:20.989890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.989921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.989949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][3][StateInit] bootstrapping 3 [2:7556254419763894362:2394]
2025-10-01T14:06:20.992885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:3:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.992902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:3:Initializer] Initializing completed.
2025-10-01T14:06:20.992907Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][3][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 3 generation 1 [2:7556254419763894362:2394]
2025-10-01T14:06:20.992913Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][3][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 3 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.993181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][3][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.993193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.993212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.993227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-01T14:06:20.993236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-01T14:06:20.993238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.993239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.993241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][3][StateIdle] Still pending for come commits
2025-10-01T14:06:20.993247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.993287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.993339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][4][StateInit] bootstrapping 4 [2:7556254419763894363:2394]
2025-10-01T14:06:20.993843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:4:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.993854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:4:Initializer] Initializing completed.
2025-10-01T14:06:20.993857Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][4][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 4 generation 1 [2:7556254419763894363:2394]
2025-10-01T14:06:20.993861Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][4][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 4 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.994015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][4][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.994023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.994031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.994032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-01T14:06:20.994034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-01T14:06:20.994036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.994038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.994039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][4][StateIdle] Still pending for come commits
2025-10-01T14:06:20.994042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.994065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.994097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254419763894364:2394]
2025-10-01T14:06:20.994529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.994537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:20.994538Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556254419763894364:2394]
2025-10-01T14:06:20.994540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.994652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.994660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.994667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.994668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:20.994670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.994671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.994673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.994673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.994680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.994733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.994771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.994796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.994814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.994938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.994960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.995661Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k6g1gwsh9xy7q369knp3jq60, Database: , SessionId: ydb://session/3?node_id=1&id=NzE4NDg5YmYtOWNkZTc2YTQtZDE5ZTAxNWQtMWZlMjUxZmI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:20.996087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.996131Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327581032, TxId 281474976715679
2025-10-01T14:06:20.996142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.996211Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][1][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327581032, TxId 281474976715679
2025-10-01T14:06:20.996219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:20.996256Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][2][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327581032, TxId 281474976715679
2025-10-01T14:06:20.996266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:20.996295Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][3][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327581032, TxId 281474976715679
2025-10-01T14:06:20.996306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:20.996333Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][4][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327581032, TxId 281474976715679
2025-10-01T14:06:20.996335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.996351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:20.996368Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.996377Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.996381Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.996384Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.996386Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.997726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.997795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.997800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.997802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.997803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.997810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.997814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.997843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.997845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.997846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.997848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:20.997849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.997852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.997878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.997880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.997881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.997883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:20.997884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.997887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.997911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.997912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.997914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.997915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:20.997917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.997920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.997944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.997946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.997948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.997949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:20.997951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.998105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 5 SourceIdMaxCounts: 6000000 } PartitionIds: 1 PartitionIds: 2 PartitionIds: 3 PartitionIds: 4 PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 1 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 2 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 3 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 4 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:20.998125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.998177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:21.000169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:21.000192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:21.001489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759327581032
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759327581032
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 5
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 1
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 2
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 3
      TabletId: 72075186224037892
      Status: Active
    }
    Partitions {
      PartitionId: 4
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 5
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 5
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3977
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.010441Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:21.087730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.087741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.087743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:21.087759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.087760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.087761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:21.091834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.091845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.091847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:21.091862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.091865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.091867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:21.094885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.094903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.094906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.188077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.188097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.188100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:21.188120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.188123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.188124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:21.192161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.192171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.192173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:21.192193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.192195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.192196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:21.195694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.195704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.195707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.288942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.288953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.288956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:21.288977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.288980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.288982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:21.295018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.295031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.295034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:21.295057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.295060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.295062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:21.298457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.298470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.298473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.389590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.389605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.389609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:21.389630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.389633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.389635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:21.395895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.395909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.395913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:21.395927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.395929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.395930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:21.399739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.399754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.399757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.490140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.490153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.490157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:21.490178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.490181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.490182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:21.496319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.496331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.496333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:21.496346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.496348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.496349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:21.499891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.499905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.499908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3977
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.511728Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:21.591543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.591559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.591563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:21.591582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.591584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.591586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:21.596646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.596661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.596663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:21.596681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.596683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.596684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:21.600223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.600234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.600236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.691869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.691884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.691887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:21.691917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.691920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.691922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:21.697258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.697271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.697273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:21.697288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.697290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.697292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:21.700622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.700636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.700638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.792950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.792965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.792967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:21.792983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.792985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.792986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:21.801194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.801209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.801211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:21.801226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.801228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.801230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:21.801238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.801240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.801242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.894780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.894804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.894808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:21.894832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.894834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.894835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:21.902528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.902541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.902544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:21.902560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.902562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.902565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:21.902581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.902584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.902585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.013629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.013641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.013644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.013664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.013666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.013667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.013675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.013678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.013679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.013687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.013689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.013690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.013697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.013699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.013700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3977
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:22.016373Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 5
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:22.022343Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:22.022933Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:22.022943Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3977
2025-10-01T14:06:22.025464Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:22.025895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:22.025912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:22.026073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:22.026110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:53088
2025-10-01T14:06:22.026116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:53088 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:22.026124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:22.026621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:22.026668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:22.026674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:22.026676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:22.026682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254430240647579:2488] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:22.027227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254430240647579:2488] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:22.057805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254430240647579:2488] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:22.057896Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254430240647611:2488] connected; active server actors: 1
2025-10-01T14:06:22.057923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254430240647579:2488] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:22.057926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254430240647579:2488] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:22.057980Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254430240647611:2488] disconnected; active server actors: 1
2025-10-01T14:06:22.057988Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254430240647611:2488] disconnected no session
2025-10-01T14:06:22.078521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254430240647579:2488] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:22.078540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254430240647579:2488] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:22.078544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254430240647579:2488] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:22.078554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:22.083081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254430240647633:2488], now have 1 active actors on pipe
2025-10-01T14:06:22.083238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:22.083413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.083428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.083457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|9652d270-9714a53e-d7584591-f18f46b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:22.083469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.083475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.083477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.083491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.083506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:22.083524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.083905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.083910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.083923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.084053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|9652d270-9714a53e-d7584591-f18f46b7_0
2025-10-01T14:06:22.085290Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327582085 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:22.085335Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|9652d270-9714a53e-d7584591-f18f46b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:22.086435Z :INFO: [] MessageGroupId [src] SessionId [src|9652d270-9714a53e-d7584591-f18f46b7_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:22.086446Z :INFO: [] MessageGroupId [src] SessionId [src|9652d270-9714a53e-d7584591-f18f46b7_0] Write session will now close
2025-10-01T14:06:22.086452Z :DEBUG: [] MessageGroupId [src] SessionId [src|9652d270-9714a53e-d7584591-f18f46b7_0] Write session: aborting
2025-10-01T14:06:22.086618Z :INFO: [] MessageGroupId [src] SessionId [src|9652d270-9714a53e-d7584591-f18f46b7_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:22.086625Z :DEBUG: [] MessageGroupId [src] SessionId [src|9652d270-9714a53e-d7584591-f18f46b7_0] Write session: destroy
2025-10-01T14:06:22.087022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|9652d270-9714a53e-d7584591-f18f46b7_0 grpc read done: success: 0 data: 
2025-10-01T14:06:22.087030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|9652d270-9714a53e-d7584591-f18f46b7_0 grpc read failed
2025-10-01T14:06:22.087038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|9652d270-9714a53e-d7584591-f18f46b7_0 grpc closed
2025-10-01T14:06:22.087044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|9652d270-9714a53e-d7584591-f18f46b7_0 is DEAD
2025-10-01T14:06:22.087297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:22.087568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254430240647633:2488] destroyed
2025-10-01T14:06:22.087586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:22.087594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.087598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.087599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-10-01T14:06:22.107850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.107874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.107882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.107900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.107920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.107923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.107933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.107936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.107938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.107946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.107948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.107950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.107973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.107976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.107977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.207986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.208006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.208008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.208027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.208029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.208032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.208039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.208042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.208043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.208050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.208052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.208054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.208059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.208064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.208066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.308326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.308338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.308341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.308359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.308361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.308362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.308369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.308371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.308380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.308387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.308389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.308391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.308399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.308400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.308402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.408695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.408714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.408716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.408730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.408732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.408733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.408740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.408745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.408747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.408753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.408755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.408756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.408761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.408763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.408764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.509042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.509057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.509059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.509073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.509075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.509079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.509088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.509090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.509091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.509097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.509099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.509101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.509108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.509110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.509111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.609397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.609412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.609414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.609426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.609428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.609429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.609435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.609437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.609439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.609444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.609446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.609448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.609454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.609456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.609457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.709713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.709727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.709730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.709745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.709747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.709749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.709758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.709760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.709762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.709769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.709778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.709781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.709788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.709789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.709790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.810077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.810096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.810097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.810108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.810109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.810110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.810116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.810118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.810119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.810125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.810126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.810128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.810134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.810136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.810137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.914458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.914470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.914475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:22.914490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.914493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.914495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:22.914501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.914502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.914503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:22.914508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.914509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.914510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:22.914514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.914516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.914517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.018535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.018549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.018552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:23.018570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.018572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.018574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:23.018580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.018582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.018583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:23.018589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.018592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.018593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:23.018599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.018601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.018602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-10-01T14:06:23.098200Z :INFO: [/Root] [] [1b0db011-55a048d8-2d875eca-40d0ffe7] Open read subsessions to databases: { name: dc1, endpoint: localhost:3977, path: /Root }, { name: dc2, endpoint: localhost:3977, path: /Root }
2025-10-01T14:06:23.100024Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] Starting read session
2025-10-01T14:06:23.100035Z :DEBUG: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] Starting single session
2025-10-01T14:06:23.100284Z :DEBUG: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:23.100292Z :DEBUG: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:23.100297Z :DEBUG: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:06:23.100942Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] Starting read session
2025-10-01T14:06:23.100950Z :DEBUG: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] Starting single session
2025-10-01T14:06:23.100968Z :DEBUG: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:23.100972Z :DEBUG: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:23.100976Z :DEBUG: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:06:23.118849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.118865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.118867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:23.118883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.118886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.118887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:23.118892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.118893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.118894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:23.118899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.118900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.118901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:23.118906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.118907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.118908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.175054Z :DEBUG: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] Successfully connected. Initializing session
2025-10-01T14:06:23.175053Z :DEBUG: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] [] Successfully connected. Initializing session
2025-10-01T14:06:23.175475Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:06:23.175488Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-01T14:06:23.175543Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:06:23.175546Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-01T14:06:23.177547Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:23.177551Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:23.177650Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 read init: from# ipv6:[::1]:59952, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:23.177650Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 read init: from# ipv6:[::1]:59952, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:23.177870Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 auth for : user
2025-10-01T14:06:23.178076Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 Handle describe topics response
2025-10-01T14:06:23.178101Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 auth is DEAD
2025-10-01T14:06:23.178120Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:06:23.178418Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:06:23.178552Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] [] Got InitResponse. ReadSessionId: shared/user_1_1_4722061938012238053_v1
2025-10-01T14:06:23.178566Z :DEBUG: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:23.178653Z :DEBUG: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:06:23.179064Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] Got InitResponse. ReadSessionId: shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.179070Z :DEBUG: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:23.179136Z :DEBUG: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:06:23.178593Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 auth for : user
2025-10-01T14:06:23.178597Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254434535615003:2511] connected; active server actors: 1
2025-10-01T14:06:23.178607Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556254434535615003:2511] session shared/user_1_1_4722061938012238053_v1
2025-10-01T14:06:23.178615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:06:23.178623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:06:23.178625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 1
2025-10-01T14:06:23.178628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=2 (Status=Free, Partitions=[1])
2025-10-01T14:06:23.178631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 2
2025-10-01T14:06:23.178635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=3 (Status=Free, Partitions=[2])
2025-10-01T14:06:23.178637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 3
2025-10-01T14:06:23.178640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=4 (Status=Free, Partitions=[3])
2025-10-01T14:06:23.178642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 4
2025-10-01T14:06:23.178645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=5 (Status=Free, Partitions=[4])
2025-10-01T14:06:23.178651Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:23.178654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:06:23.179232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254434535615014:2518], now have 1 active actors on pipe
2025-10-01T14:06:23.178666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=5, UnradableFamilies=5 [5 (4), 4 (3), 3 (2), 2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-01T14:06:23.178672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=5 (Status=Free, Partitions=[4]) for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:23.178683Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 5 status Active partitions [4] session "shared/user_1_1_4722061938012238053_v1" sender [1:7556254434535614999:2511] lock partition 4 for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-01T14:06:23.179249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254434535615013:2517], now have 1 active actors on pipe
2025-10-01T14:06:23.178691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=4 (Status=Free, Partitions=[3]) for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=1)
2025-10-01T14:06:23.179253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254434535615016:2520], now have 1 active actors on pipe
2025-10-01T14:06:23.178695Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 4 status Active partitions [3] session "shared/user_1_1_4722061938012238053_v1" sender [1:7556254434535614999:2511] lock partition 3 for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=2) generation 1 step 2
2025-10-01T14:06:23.179256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254434535615015:2519], now have 1 active actors on pipe
2025-10-01T14:06:23.178701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=3 (Status=Free, Partitions=[2]) for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=2)
2025-10-01T14:06:23.178705Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_1_4722061938012238053_v1" sender [1:7556254434535614999:2511] lock partition 2 for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=3) generation 1 step 3
2025-10-01T14:06:23.178710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=3)
2025-10-01T14:06:23.178714Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_4722061938012238053_v1" sender [1:7556254434535614999:2511] lock partition 1 for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=4) generation 1 step 4
2025-10-01T14:06:23.179260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254434535615017:2521], now have 1 active actors on pipe
2025-10-01T14:06:23.178720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=4)
2025-10-01T14:06:23.178724Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_4722061938012238053_v1" sender [1:7556254434535614999:2511] lock partition 0 for ReadingSession "shared/user_1_1_4722061938012238053_v1" (Sender=[1:7556254434535614999:2511], Pipe=[1:7556254434535615003:2511], Partitions=[], ActiveFamilyCount=5) generation 1 step 5
2025-10-01T14:06:23.178729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=1, desiredFamilyCount=5, allowPlusOne=0
2025-10-01T14:06:23.178733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000064s
2025-10-01T14:06:23.178737Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 Handle describe topics response
2025-10-01T14:06:23.178751Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 auth is DEAD
2025-10-01T14:06:23.178765Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:06:23.178919Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 assign: record# { Partition: 4 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_4722061938012238053_v1" ClientId: "user" PipeClient { RawX1: 7556254434535615003 RawX2: 4503603922340303 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:23.178941Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 assign: record# { Partition: 3 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_1_4722061938012238053_v1" ClientId: "user" PipeClient { RawX1: 7556254434535615003 RawX2: 4503603922340303 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:23.178958Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:06:23.178959Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 assign: record# { Partition: 2 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_1_4722061938012238053_v1" ClientId: "user" PipeClient { RawX1: 7556254434535615003 RawX2: 4503603922340303 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:23.178974Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_1_4722061938012238053_v1" ClientId: "user" PipeClient { RawX1: 7556254434535615003 RawX2: 4503603922340303 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:23.178989Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_1_4722061938012238053_v1" ClientId: "user" PipeClient { RawX1: 7556254434535615003 RawX2: 4503603922340303 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:23.178994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1)
2025-10-01T14:06:23.178999Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:06:23.179006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2)
2025-10-01T14:06:23.179014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-01T14:06:23.179022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-01T14:06:23.179030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-01T14:06:23.179035Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 got read request: guid# 8b3c211c-36bea9d0-d046e4ce-626d46f6
2025-10-01T14:06:23.179054Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254434535615010:2512] connected; active server actors: 1
2025-10-01T14:06:23.179085Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556254434535615010:2512] session shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.179091Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_10511174059367467264_v1" (Sender=[1:7556254434535615000:2512], Pipe=[1:7556254434535615010:2512], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:23.179094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:06:23.179100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=0 [], RequireBalancing=0 []
2025-10-01T14:06:23.179104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-01T14:06:23.179110Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_4722061938012238053_v1" sender [1:7556254434535614999:2511]  release partitions [0]. Target status Free
2025-10-01T14:06:23.179123Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_1_4722061938012238053_v1" sender [1:7556254434535614999:2511]  release partitions [1]. Target status Free
2025-10-01T14:06:23.179127Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:175: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_1_4722061938012238053_v1" sender [1:7556254434535614999:2511]  release partitions [2]. Target status Free
2025-10-01T14:06:23.179131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000029s
2025-10-01T14:06:23.179149Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 gone release: partition# 0
2025-10-01T14:06:23.179156Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-01T14:06:23.179162Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-01T14:06:23.179166Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:5)
2025-10-01T14:06:23.179187Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 gone release: partition# 1
2025-10-01T14:06:23.179190Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-01T14:06:23.179196Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-01T14:06:23.179199Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:4)
2025-10-01T14:06:23.179204Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1576: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 gone release: partition# 2
2025-10-01T14:06:23.179206Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1561: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-01T14:06:23.179209Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1721: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 got all from client, actual releasing: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-01T14:06:23.179212Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1639: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 released: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:3)
2025-10-01T14:06:23.179266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556254434535615014:2518]
2025-10-01T14:06:23.179275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556254434535615013:2517]
2025-10-01T14:06:23.179276Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7556254434535615003:2511] session shared/user_1_1_4722061938012238053_v1 partition 0
2025-10-01T14:06:23.179285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:06:23.179294Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7556254434535615003:2511] session shared/user_1_1_4722061938012238053_v1 partition 1
2025-10-01T14:06:23.179299Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1606: [72075186224037893][rt3.dc1--test-topic] client user released partition from pipe [1:7556254434535615003:2511] session shared/user_1_1_4722061938012238053_v1 partition 2
2025-10-01T14:06:23.179306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=5, UnradableFamilies=3 [3 (2), 2 (1), 1 (0), ], RequireBalancing=0 []
2025-10-01T14:06:23.179315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=3 (Status=Free, Partitions=[2]) for ReadingSession "shared/user_1_2_10511174059367467264_v1" (Sender=[1:7556254434535615000:2512], Pipe=[1:7556254434535615010:2512], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:23.179321Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 3 status Active partitions [2] session "shared/user_1_2_10511174059367467264_v1" sender [1:7556254434535615000:2512] lock partition 2 for ReadingSession "shared/user_1_2_10511174059367467264_v1" (Sender=[1:7556254434535615000:2512], Pipe=[1:7556254434535615010:2512], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-01T14:06:23.179327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=2 (Status=Free, Partitions=[1]) for ReadingSession "shared/user_1_2_10511174059367467264_v1" (Sender=[1:7556254434535615000:2512], Pipe=[1:7556254434535615010:2512], Partitions=[], ActiveFamilyCount=1)
2025-10-01T14:06:23.179332Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 2 status Active partitions [1] session "shared/user_1_2_10511174059367467264_v1" sender [1:7556254434535615000:2512] lock partition 1 for ReadingSession "shared/user_1_2_10511174059367467264_v1" (Sender=[1:7556254434535615000:2512], Pipe=[1:7556254434535615010:2512], Partitions=[], ActiveFamilyCount=2) generation 1 step 7
2025-10-01T14:06:23.179337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_10511174059367467264_v1" (Sender=[1:7556254434535615000:2512], Pipe=[1:7556254434535615010:2512], Partitions=[], ActiveFamilyCount=2)
2025-10-01T14:06:23.179342Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_10511174059367467264_v1" sender [1:7556254434535615000:2512] lock partition 0 for ReadingSession "shared/user_1_2_10511174059367467264_v1" (Sender=[1:7556254434535615000:2512], Pipe=[1:7556254434535615010:2512], Partitions=[], ActiveFamilyCount=3) generation 1 step 8
2025-10-01T14:06:23.179345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=5, sessionCount=2, desiredFamilyCount=2, allowPlusOne=1
2025-10-01T14:06:23.179349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000040s
2025-10-01T14:06:23.179525Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 assign: record# { Partition: 2 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_2_10511174059367467264_v1" ClientId: "user" PipeClient { RawX1: 7556254434535615010 RawX2: 4503603922340304 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:23.179536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1)
2025-10-01T14:06:23.179543Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 assign: record# { Partition: 1 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_2_10511174059367467264_v1" ClientId: "user" PipeClient { RawX1: 7556254434535615010 RawX2: 4503603922340304 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:23.179550Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:06:23.179557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2)
2025-10-01T14:06:23.179568Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 8 Session: "shared/user_1_2_10511174059367467264_v1" ClientId: "user" PipeClient { RawX1: 7556254434535615010 RawX2: 4503603922340304 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:23.179584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3)
2025-10-01T14:06:23.179622Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 got read request: guid# 5bce5f45-1f1cc3aa-70df5a27-2e24f346
2025-10-01T14:06:23.179799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556254434535615022:2523]
2025-10-01T14:06:23.179805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556254434535615020:2522]
2025-10-01T14:06:23.179813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556254434535615024:2524]
2025-10-01T14:06:23.179380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254434535615016:2520] destroyed
2025-10-01T14:06:23.179388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254434535615015:2519] destroyed
2025-10-01T14:06:23.179391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254434535615017:2521] destroyed
2025-10-01T14:06:23.179411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.179419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 4
2025-10-01T14:06:23.179435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_4722061938012238053_v1 on pipe: [1:7556254434535615013:2517]
2025-10-01T14:06:23.179451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.179454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 3
2025-10-01T14:06:23.179457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_4722061938012238053_v1 on pipe: [1:7556254434535615014:2518]
2025-10-01T14:06:23.179474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.179479Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_4722061938012238053_v1:1 with generation 1
2025-10-01T14:06:23.179481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.179483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][4][StateIdle] Batch completed (1)
2025-10-01T14:06:23.179491Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_4722061938012238053_v1:2 with generation 1
2025-10-01T14:06:23.179520Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][4][StateIdle] Topic 'rt3.dc1--test-topic' partition 4 user user session is set to 0 (startOffset 0) session shared/user_1_1_4722061938012238053_v1
2025-10-01T14:06:23.179523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:23.179560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.179564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.179566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][3][StateIdle] Batch completed (1)
2025-10-01T14:06:23.179575Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][3][StateIdle] Topic 'rt3.dc1--test-topic' partition 3 user user session is set to 0 (startOffset 0) session shared/user_1_1_4722061938012238053_v1
2025-10-01T14:06:23.179578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:23.179592Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:23.179604Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:23.179889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254434535615020:2522], now have 1 active actors on pipe
2025-10-01T14:06:23.179894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254434535615022:2523], now have 1 active actors on pipe
2025-10-01T14:06:23.179898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254434535615024:2524], now have 1 active actors on pipe
2025-10-01T14:06:23.179908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.179911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 1
2025-10-01T14:06:23.179918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_10511174059367467264_v1 on pipe: [1:7556254434535615022:2523]
2025-10-01T14:06:23.179936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.179939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 2
2025-10-01T14:06:23.179940Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_10511174059367467264_v1:2 with generation 1
2025-10-01T14:06:23.179943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_10511174059367467264_v1 on pipe: [1:7556254434535615020:2522]
2025-10-01T14:06:23.179947Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_10511174059367467264_v1:1 with generation 1
2025-10-01T14:06:23.179951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.179953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.179957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_10511174059367467264_v1 on pipe: [1:7556254434535615024:2524]
2025-10-01T14:06:23.179962Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_10511174059367467264_v1:3 with generation 1
2025-10-01T14:06:23.179966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.179970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.179973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][1][StateIdle] Batch completed (1)
2025-10-01T14:06:23.179983Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][1][StateIdle] Topic 'rt3.dc1--test-topic' partition 1 user user session is set to 0 (startOffset 0) session shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.179986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:23.180004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.180006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.180008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][2][StateIdle] Batch completed (1)
2025-10-01T14:06:23.180014Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][2][StateIdle] Topic 'rt3.dc1--test-topic' partition 2 user user session is set to 0 (startOffset 0) session shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.180016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:23.180030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.180036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.180037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:23.180044Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.180047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.180057Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:23.180061Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:23.180064Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:23.183818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][4][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:23.183857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][4][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:23.183865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.183867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.183869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:23.183876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][4][StateIdle] No data for blobs compaction
2025-10-01T14:06:23.183880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][3][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:23.183895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][3][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:23.183898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.183899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.183901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:23.183903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][3][StateIdle] No data for blobs compaction
2025-10-01T14:06:23.183906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][1][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:23.183923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][1][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:23.183925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.183929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.183930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:23.183932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][1][StateIdle] No data for blobs compaction
2025-10-01T14:06:23.183936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][2][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:23.183951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][2][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:23.183954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.183955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.183956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:23.183958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][2][StateIdle] No data for blobs compaction
2025-10-01T14:06:23.183962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:23.183978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:23.183981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.183983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.183984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.183986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:23.183999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 4 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:06:23.184025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 3 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:06:23.184030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 1 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:06:23.184046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 2 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:06:23.184055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:06:23.184266Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759327583118 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:06:23.184282Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759327583118 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:06:23.184286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-01T14:06:23.184292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 3(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-01T14:06:23.184303Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759327583118 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:06:23.184306Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759327583118 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:06:23.184307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0
2025-10-01T14:06:23.184310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-01T14:06:23.184319Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759327583118 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:06:23.184323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:3) EndOffset 0 readOffset 0 committedOffset 0
2025-10-01T14:06:23.184336Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 sending to client partition status
2025-10-01T14:06:23.184340Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 sending to client partition status
2025-10-01T14:06:23.184412Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 sending to client partition status
2025-10-01T14:06:23.184423Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 sending to client partition status
2025-10-01T14:06:23.184429Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 sending to client partition status
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 4 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-01T14:06:23.184748Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 4. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 1 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-01T14:06:23.184774Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 1. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 3 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-01T14:06:23.184883Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 3. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 2 Topic: "test-topic" Partition: 2 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-01T14:06:23.184901Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] Confirm partition stream create. Partition stream id: 2. Cluster: "-". Topic: "test-topic". Partition: 2. Read offset: (NULL)
Got new read session event: StartPartitionSession { Partition session id: 3 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 CommittedOffset: 0 EndOffset: 0 }
2025-10-01T14:06:23.184912Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] [] Confirm partition stream create. Partition stream id: 3. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-01T14:06:23.184917Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] Closing read session. Close timeout: 0.010000s
2025-10-01T14:06:23.184927Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:4:1:0:0
2025-10-01T14:06:23.184934Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 84 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:23.185002Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] Closing read session. Close timeout: 0.010000s
2025-10-01T14:06:23.185010Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:3:0:0 -:test-topic:2:2:0:0 -:test-topic:1:1:0:0
2025-10-01T14:06:23.185029Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 84 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:23.185087Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] Closing read session. Close timeout: 0.000000s
2025-10-01T14:06:23.185092Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:4:1:0:0
2025-10-01T14:06:23.185095Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 85 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:23.185098Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] Closing read session. Close timeout: 0.000000s
2025-10-01T14:06:23.185101Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:3:0:0 -:test-topic:2:2:0:0 -:test-topic:1:1:0:0
2025-10-01T14:06:23.185103Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 84 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:23.185108Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] Closing read session. Close timeout: 0.000000s
2025-10-01T14:06:23.185110Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:3:0:0 -:test-topic:2:2:0:0 -:test-topic:1:1:0:0
2025-10-01T14:06:23.185112Z :INFO: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 84 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:23.185127Z :NOTICE: [/Root] [/Root] [7421cc60-d5e83316-4307f31b-b8a84ed0] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:06:23.185149Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] Closing read session. Close timeout: 0.000000s
2025-10-01T14:06:23.185151Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:3:2:0:0 -:test-topic:4:1:0:0
2025-10-01T14:06:23.185153Z :INFO: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] Counters: { Errors: 0 CurrentSessionLifetimeMs: 85 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:23.185157Z :NOTICE: [/Root] [/Root] [f515cb31-f6f1501d-4b3c4c44-9f8f74e4] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:06:23.185042Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 2 } }
2025-10-01T14:06:23.185095Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2), readOffset# 0, commitOffset# (empty maybe)
2025-10-01T14:06:23.185103Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-01T14:06:23.185151Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-01T14:06:23.185158Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-01T14:06:23.185170Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-01T14:06:23.185177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-01T14:06:23.185192Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 1(assignId:2) wait data in partition inited, cookie 1 from offset 0
2025-10-01T14:06:23.185226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-01T14:06:23.185229Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 2(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-01T14:06:23.185238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-01T14:06:23.185242Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 4(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-01T14:06:23.186099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_4722061938012238053_v1
2025-10-01T14:06:23.186122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254434535615013:2517] destroyed
2025-10-01T14:06:23.186129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.185595Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 grpc closed
2025-10-01T14:06:23.185596Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 grpc read done: success# 0, data# {  }
2025-10-01T14:06:23.185600Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 grpc read failed
2025-10-01T14:06:23.186131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254434535615024:2524] destroyed
2025-10-01T14:06:23.186135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.186138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254434535615022:2523] destroyed
2025-10-01T14:06:23.186141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.186143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254434535615020:2522] destroyed
2025-10-01T14:06:23.186146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_4722061938012238053_v1
2025-10-01T14:06:23.186148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254434535615014:2518] destroyed
2025-10-01T14:06:23.186153Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_4722061938012238053_v1
2025-10-01T14:06:23.186160Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.186163Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.186166Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.186170Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_4722061938012238053_v1
2025-10-01T14:06:23.185607Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 grpc closed
2025-10-01T14:06:23.185622Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_4722061938012238053_v1 is DEAD
2025-10-01T14:06:23.185625Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_10511174059367467264_v1 is DEAD
2025-10-01T14:06:23.185904Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254434535615003:2511] disconnected; active server actors: 1
2025-10-01T14:06:23.185908Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254434535615003:2511] client user disconnected session shared/user_1_1_4722061938012238053_v1
2025-10-01T14:06:23.185929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:06:23.185938Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254434535615010:2512] disconnected; active server actors: 1
2025-10-01T14:06:23.185941Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254434535615010:2512] client user disconnected session shared/user_1_2_10511174059367467264_v1
2025-10-01T14:06:23.222439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][1][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.222455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][1][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.222458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][1][StateIdle] Try persist
2025-10-01T14:06:23.222477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][2][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.222480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][2][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.222481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][2][StateIdle] Try persist
2025-10-01T14:06:23.222489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][3][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.222492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][3][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.222493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][3][StateIdle] Try persist
2025-10-01T14:06:23.222499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][4][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.222501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][4][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.222503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][4][StateIdle] Try persist
2025-10-01T14:06:23.222514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.222516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.222517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.638419Z :PreferredDatabaseNoFallback INFO: Random seed for debugging is 1759327583638410
2025-10-01T14:06:23.853668Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7556254434023882423:2088];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:23.853689Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:23.855323Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7556254433607867066:2147];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:23.855974Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:23.857380Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:23.857632Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:23.857819Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/004774/r3tmp/tmpS779Y8/pdisk_1.dat
2025-10-01T14:06:23.858177Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:23.876015Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:06:23.881530Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:23.881548Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:23.881572Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:23.881577Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:23.887729Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-10-01T14:06:23.887772Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-10-01T14:06:23.888083Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 3126, node 3
2025-10-01T14:06:23.897339Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/004774/r3tmp/yandexEYkKv9.tmp
2025-10-01T14:06:23.897353Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/004774/r3tmp/yandexEYkKv9.tmp
2025-10-01T14:06:23.897416Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/004774/r3tmp/yandexEYkKv9.tmp
2025-10-01T14:06:23.897461Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:23.900232Z INFO: TTestServer started on Port 17551 GrpcPort 3126
TClient is connected to server localhost:17551
PQClient connected to localhost:3126
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
waiting...
2025-10-01T14:06:23.916222Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
2025-10-01T14:06:24.063424Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:24.158866Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:24.272283Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254437902834584:2295], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:24.272320Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:24.272534Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254437902834620:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:24.274157Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:24.275621Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254437902834649:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:24.275648Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:24.275722Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7556254437902834651:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:24.275732Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:24.279257Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7556254437902834622:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-01T14:06:24.287021Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:24.290834Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7556254438318850683:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:24.290920Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=3&id=OTlmNjdjY2MtNDA0MzhjZmUtMjg3YzRlMy1jNmFiZWQ4NQ==, ActorId: [3:7556254438318850641:2322], ActorState: ExecuteState, TraceId: 01k6g1h00rc7r7b65z2bpc2b2c, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:24.291061Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:24.313636Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:24.348708Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:24.363601Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7556254437902834752:2199] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3126", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:24.390207Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6g1h03h1fn759qw9n5jes90, Database: , SessionId: ydb://session/3?node_id=3&id=Zjk0OTFkNTktNzQ1ODc1MzktNjFmNmZhYmMtOWI4OTE3OTg=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7556254438318851076:2923] 
2025-10-01T14:06:24.855549Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:24.857080Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:28.854246Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7556254434023882423:2088];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:28.854286Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:06:28.855274Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7556254433607867066:2147];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:28.855316Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:29.541782Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3126
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:29.554679Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3126
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:29.563430Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7556254459793688090:3243] connected; active server actors: 1
2025-10-01T14:06:29.563488Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:29.563577Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:29.564242Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:29.564813Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:29.565349Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:29.565399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:29.565409Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:29.565421Z node 4 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:29.565511Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254459793688088:3241], now have 1 active actors on pipe
2025-10-01T14:06:29.565519Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254459793688108:2449], now have 1 active actors on pipe
2025-10-01T14:06:29.565572Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 4, Generation 1
2025-10-01T14:06:29.565681Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:29.566399Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:29.567624Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254459793688143:3286], now have 1 active actors on pipe
2025-10-01T14:06:29.567701Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:29.568820Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:29.568990Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:29.569003Z node 4 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:29.569049Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:29.569081Z node 4 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [4:7556254459377671721:2399]
2025-10-01T14:06:29.569779Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:29.569787Z node 4 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:29.569791Z node 4 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [4:7556254459377671721:2399]
2025-10-01T14:06:29.569796Z node 4 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:29.570053Z node 4 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:29.570065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.570080Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.570083Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:29.570087Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:29.570089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.570090Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.570092Z node 4 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:29.570098Z node 4 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:29.570197Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:29.570231Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:29.572438Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:29.572468Z node 4 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327589614, TxId 281474976720677
2025-10-01T14:06:29.572473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.572475Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.572497Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.572531Z node 4 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:29.572962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:29.573014Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:29.573021Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.573024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.573025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.573031Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:29.573141Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:29.573161Z node 4 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:29.573202Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:29.574339Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:29.574364Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:29.574446Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6g1h55sbbd6g3jjbe7mf4v7, Database: , SessionId: ydb://session/3?node_id=3&id=MjVlMGQ5NWYtZDY3ZGI1MTMtZGI5NTVmMmMtY2ZjYzA4Y2E=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:29.575210Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327589614
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327589614
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3126
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:29.580171Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:29.670433Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.670455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.670458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.770760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.770781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.770784Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.871108Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.871126Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.871130Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.971545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.971561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.971564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.071829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.071859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.071862Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3126
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:30.081358Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:30.172137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.172154Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.172158Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.272485Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.272506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.272510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.372873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.372891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.372894Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.473173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.473186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.473188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.573986Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.574008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.574011Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3126
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:30.583731Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:30.585196Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:30.585456Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:30.585463Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3126
2025-10-01T14:06:30.585784Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:30.587990Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:30.588008Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:30.588877Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:30.588911Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:41480
2025-10-01T14:06:30.588916Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:41480 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:30.588919Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:30.589298Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:30.589324Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:30.589326Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:30.589328Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:30.589333Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7556254464088655615:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:30.589834Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7556254464088655615:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:30.610752Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7556254464088655615:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:30.610997Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254464088655646:2481] connected; active server actors: 1
2025-10-01T14:06:30.611073Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7556254464088655615:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:30.611078Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7556254464088655615:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:30.611368Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254464088655646:2481] disconnected; active server actors: 1
2025-10-01T14:06:30.611370Z node 3 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7556254464088655646:2481] disconnected no session
2025-10-01T14:06:30.626273Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7556254464088655615:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:30.626298Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7556254464088655615:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:30.626301Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7556254464088655615:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:30.626311Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:30.627141Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 4, Generation: 1
2025-10-01T14:06:30.630501Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7556254464088655668:2481], now have 1 active actors on pipe
2025-10-01T14:06:30.630544Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.630552Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.630584Z node 4 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|677a2803-e8b56bd8-5be37610-56bcee43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:30.630598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.630603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.630606Z node 4 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:30.630621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.630637Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:30.630659Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.631172Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.631191Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.631221Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.631389Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|677a2803-e8b56bd8-5be37610-56bcee43_0
2025-10-01T14:06:30.631814Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327590631 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:30.631855Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|677a2803-e8b56bd8-5be37610-56bcee43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:30.632663Z :INFO: [] MessageGroupId [src] SessionId [src|677a2803-e8b56bd8-5be37610-56bcee43_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:30.632674Z :INFO: [] MessageGroupId [src] SessionId [src|677a2803-e8b56bd8-5be37610-56bcee43_0] Write session will now close
2025-10-01T14:06:30.632681Z :DEBUG: [] MessageGroupId [src] SessionId [src|677a2803-e8b56bd8-5be37610-56bcee43_0] Write session: aborting
2025-10-01T14:06:30.632831Z :INFO: [] MessageGroupId [src] SessionId [src|677a2803-e8b56bd8-5be37610-56bcee43_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:30.632837Z :DEBUG: [] MessageGroupId [src] SessionId [src|677a2803-e8b56bd8-5be37610-56bcee43_0] Write session: destroy
2025-10-01T14:06:30.633035Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|677a2803-e8b56bd8-5be37610-56bcee43_0 grpc read done: success: 0 data: 
2025-10-01T14:06:30.633045Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|677a2803-e8b56bd8-5be37610-56bcee43_0 grpc read failed
2025-10-01T14:06:30.633053Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|677a2803-e8b56bd8-5be37610-56bcee43_0 grpc closed
2025-10-01T14:06:30.633059Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|677a2803-e8b56bd8-5be37610-56bcee43_0 is DEAD
2025-10-01T14:06:30.633263Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-10-01T14:06:30.633625Z node 4 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7556254464088655668:2481] destroyed
2025-10-01T14:06:30.633644Z node 4 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:30.633654Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.633657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.633660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
====TYdbPqTestRetryPolicy()
====ExpectBreakDown
2025-10-01T14:06:30.675966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.675983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.675988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
=== Session was created, waiting for retries
>>> Ready to answer: ok
====CreateRetryState
====CreateRetryState Initialized
Test retry state: get retry delay
2025-10-01T14:06:30.687442Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:30.776304Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.776326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.776330Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.876657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.876679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.876682Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.977032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.977069Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.977073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.077357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.077373Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.077376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.177720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.177734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.177737Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.278071Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.278089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.278091Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.378459Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.378489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.378492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.478783Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.478800Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.478803Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.579163Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.579181Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.579185Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.679499Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.679515Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.679518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.779878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.779897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.779900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.881756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.881774Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.881777Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.981576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.981592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.981594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.081942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.081966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.081969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.182282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.182300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.182302Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.282634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.282650Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.282653Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.382932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.382948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.382951Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.483322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.483339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.483342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.583672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.583687Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.583690Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.684226Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.684240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.684243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:32.691681Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:32.784789Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.784807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.784810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.885254Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.885271Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.885274Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.994243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.994265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.994268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.094166Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.094186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.094189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.194511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.194527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.194530Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.296019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.296036Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.296038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.396753Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.396767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.396769Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.497089Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.497104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.497106Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.597445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.597461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.597465Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.697799Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.697818Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.697820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.798137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.798153Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.798165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.898463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.898482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.898486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.998833Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.998852Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.998855Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.099201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.099229Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.099232Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.199551Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.199574Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.199577Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.300239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.300255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.300258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.400243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.400264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.400267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1001 14:06:34.446304579  117062 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:65053: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-01T14:06:34.500671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.500689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.500692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.570274Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:34.601508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.601523Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.601527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:34.692553Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
=== In the next federation discovery response dc2 will be available
2025-10-01T14:06:34.702236Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.702257Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.702260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.802686Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.802709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.802712Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.903038Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.903057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.903061Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.006445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.006464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.006467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.106518Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.106533Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.106536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.210482Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.210503Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.210506Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.313238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.313256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.313260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.413454Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.413468Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.413471Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.518455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.518474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.518477Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.617802Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.617820Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.617823Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.718148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.718167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.718170Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.818440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.818453Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.818455Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.922114Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.922135Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.922137Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.021781Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.021801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.021804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.123588Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.123604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.123607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.224056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.224073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.224077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.324444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.324463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.324466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.429224Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.429243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.429246Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.529240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.529261Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.529264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.629529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.629558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.629561Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:36.693548Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:36.729864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.729883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.729886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.830689Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.830709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.830713Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.931078Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.931097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.931099Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.031553Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.031570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.031573Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.131788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.131807Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.131810Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.244627Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.244648Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.244651Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.344581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.344604Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.344607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.444592Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.444610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.444612Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.544949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.544968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.544971Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.645316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.645332Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.645335Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.745658Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.745671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.745673Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.845995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.846010Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.846012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.946398Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.946435Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.946438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.046681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.046700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.046704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.147045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.147064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.147068Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.247440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.247454Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.247457Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.347972Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.347992Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.347995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.453461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.453476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.453479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.554514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.554532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.554536Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.654748Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.654767Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.654770Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:38.695334Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:38.754864Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.754879Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.754882Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.855172Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.855189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.855191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.871023Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-01T14:06:38.871062Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:06:38.955511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.955529Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.955532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.055891Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.055908Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.055911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.156223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.156240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.156244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.256568Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.256583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.256586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.356916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.356930Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.356932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.457262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.457278Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.457281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.557628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.557642Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.557645Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.571584Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:39.657985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.658012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.658015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.758341Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.758361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.758365Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.858688Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.858703Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.858705Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.962656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.962674Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.962677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.066570Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.066623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.066625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.166917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.166937Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.166940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.267253Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.267267Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.267270Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.367593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.367610Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.367613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.467979Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.467994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.467997Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.568308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.568322Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.568324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1001 14:06:40.645596393  122701 chttp2_transport.cc:1143]             ipv4:127.0.0.1:65053: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-01T14:06:40.668664Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.668677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.668680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:40.695560Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:40.769025Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.769042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.769046Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.869358Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.869374Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.869377Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.969717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.969742Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.969746Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.070052Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.070073Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.070076Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.173385Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.173400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.173403Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.273359Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.273375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.273378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.373680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.373706Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.373709Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.474730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.474749Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.474752Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.574917Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.574933Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.574936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.675260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.675287Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.675291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.775680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.775698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.775701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.875959Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.875977Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.875980Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.976324Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.976339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.976342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.076714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.076730Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.076733Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.177033Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.177045Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.177048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.277390Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.277404Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.277407Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.377677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.377698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.377701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.478517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.478540Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.478542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.578461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.578486Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.578489Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.678801Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.678816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.678819Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:42.696587Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:42.779147Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.779162Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.779165Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.879491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.879505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.879508Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.979854Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.979869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.979871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.081152Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.081173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.081176Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.181628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.181644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.181647Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.281932Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.281945Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.281947Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.382282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.382299Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.382303Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.482639Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.482656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.482659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.583019Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.583034Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.583037Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.684309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.684323Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.684326Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.784184Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.784201Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.784205Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.884531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.884546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.884549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.985528Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.985546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.985549Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.085704Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.085717Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.085720Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.186097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.186112Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.186115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.286461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.286476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.286479Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.387760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.387775Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.387778Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.488168Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.488186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.488188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.571763Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:44.588557Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.588586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.588589Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.688906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.688924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.688937Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:44.698556Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:44.789221Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.789235Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.789239Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.889578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.889596Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.889600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.989934Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.989949Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.989953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.090327Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.090348Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.090351Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.193859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.193874Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.193877Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.293569Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.293587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.293590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.393900Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.393916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.393919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.494265Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.494282Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.494284Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.594618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.594635Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.594638Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.697244Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.697260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.697263Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.797364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.797386Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.797389Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.897740Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.897757Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.897761Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.998077Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.998094Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.998097Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.098520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.098535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.098538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.198829Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.198846Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.198849Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.302498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.302516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.302519Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.402936Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.402953Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.402956Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.502909Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.502923Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.502926Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.604836Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.604866Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.604869Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:46.699589Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:46.704652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.704667Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.704671Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.804985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.805002Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.805004Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.905325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.905342Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.905345Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.005691Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.005714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.005719Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.106039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.106059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.106062Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.206412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.206437Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.206440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.306735Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.306752Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.306756Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.407104Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.407124Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.407127Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.507444Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.507463Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.507466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.607795Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.607813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.607816Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.708160Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.708175Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.708178Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.808500Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.808514Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.808516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.908852Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.908870Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.908873Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.009199Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.009230Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.009233Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.109558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.109572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.109575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.209906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.209919Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.209921Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.310229Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.310240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.310243Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.410618Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.410634Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.410636Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.510966Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.510981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.510984Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.611315Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.611333Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.611344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:48.700554Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:48.711681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.711698Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.711701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.812102Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.812120Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.812123Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.912378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.912393Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.912396Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.012679Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.012692Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.012695Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.113041Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.113056Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.113059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.215288Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.215308Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.215311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.314798Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.314811Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.314813Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.415173Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.415189Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.415192Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.515527Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.515546Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.515548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.571884Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:49.615883Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.615903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.615906Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.716297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.716316Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.716319Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.816684Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.816699Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.816702Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.918478Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.918494Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.918498Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.019558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.019578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.019581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.119680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.119696Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.119700Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.220024Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.220039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.220042Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.323167Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.323188Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.323191Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.423292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.423311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.423313Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.523681Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.523697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.523701Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.624003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.624031Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.624035Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:50.701599Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:50.724344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.724360Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.724363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.825787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.825804Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.825808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.926264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.926291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.926294Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.026473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.026490Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.026493Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.126771Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.126787Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.126790Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.227164Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.227183Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.227186Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.327511Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.327531Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.327534Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.427843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.427858Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.427859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.528204Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.528218Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.528220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.628559Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.628578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.628581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.728924Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.728939Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.728942Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.829262Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.829281Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.829283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.929555Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.929583Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.929586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.029970Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.029991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.029994Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.130277Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.130297Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.130300Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.230660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.230675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.230678Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.331050Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.331065Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.331067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.431378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.431395Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.431399Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.531697Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.531714Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.531718Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.632060Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.632075Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.632086Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:52.704062Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:52.732454Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.732473Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.732476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.832843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.832865Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.832868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.936831Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.936859Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.936868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.037048Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.037064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.037067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.137428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.137445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.137448Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.237793Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.237809Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.237812Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.338510Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.338532Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.338535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.439223Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.439238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.439240Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.540885Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.540903Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.540905Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.642129Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.642148Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.642151Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.742565Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.742581Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.742586Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.842962Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.842981Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.842985Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.948505Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.948521Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.948524Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.048851Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.048868Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.048871Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.153237Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.153256Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.153260Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.253542Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.253560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.253564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.353922Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.353937Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.353940Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.454264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.454280Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.454283Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.554614Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.554629Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.554632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.572075Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:54.654969Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.654988Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.654991Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:54.704538Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:54.755325Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.755357Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.755361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.855806Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.855824Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.855826Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.956405Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.956420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.956423Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.056911Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.056927Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.056929Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.157245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.157268Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.157273Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.257598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.257622Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.257625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.357948Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.357965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.357968Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.458292Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.458306Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.458309Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.558652Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.558677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.558680Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
E1001 14:06:55.647118862  116979 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:65053: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-01T14:06:55.659095Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.659113Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.659116Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.759344Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.759361Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.759364Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.862438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.862458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.862461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.962587Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.962621Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.962625Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.062987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.063003Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.063008Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.163311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.163336Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.163339Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.265220Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.265242Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.265245Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.365037Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.365055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.365059Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.465420Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.465436Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.465438Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.565760Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.565776Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.565779Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.666115Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.666131Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.666133Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:56.706509Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:56.768036Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.768054Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.768057Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.868580Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.868603Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.868607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.968902Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.968916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.968918Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.069039Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.069064Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.069067Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.169412Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.169431Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.169434Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.269867Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.269886Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.269889Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.370093Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.370122Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.370125Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.470552Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.470572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.470576Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.574445Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.574464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.574467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.677590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.677607Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.677611Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.776594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.776623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.776626Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.877584Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.877600Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.877601Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.980036Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.980055Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.980058Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.082462Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.082481Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.082484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.186447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.186466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.186470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.286579Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.286594Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.286597Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.386965Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.386983Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.386987Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.487329Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.487346Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.487350Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.587623Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.587640Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.587643Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.688070Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.688085Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.688088Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:06:58.710648Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
2025-10-01T14:06:58.790613Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.790628Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.790632Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.897363Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.897376Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.897378Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.997234Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.997264Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.997266Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.097637Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.097657Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.097660Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.198897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.198913Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.198916Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.299517Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.299535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.299538Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.404179Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.404196Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.404199Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.504291Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.504311Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.504314Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.565813Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:06:59.565858Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-01T14:06:59.566211Z node 4 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:06:59.566727Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-10-01T14:06:59.566911Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:06:59.567084Z node 3 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-10-01T14:06:59.572279Z node 4 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:59.606572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.606590Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.606593Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.706881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.706897Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.706901Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.809520Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.809545Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.809548Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.913187Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.913208Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.913211Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.014659Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.014675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.014677Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.114458Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.114484Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.114487Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.214814Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.214843Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.214847Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.315354Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.315372Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.315375Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.418543Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.418560Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.418564Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.522535Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.522550Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.522554Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.622863Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.622878Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.622881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
Test retry state: get retry delay
2025-10-01T14:07:00.717570Z :NOTICE: [/Root] [] [] Retry to update federation state in 2.000000s
=== Waiting for repair
>>> Ready to answer: ok
2025-10-01T14:07:00.728428Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.728446Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.728450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.830558Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.830575Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.830578Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.930440Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.930464Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.930467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.030400Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.030415Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.030418Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.130857Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.130881Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.130884Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.234447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.234467Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.234470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.334496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.334513Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.334516Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.438707Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.438727Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.438731Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.542461Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.542491Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.542495Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.642238Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.642255Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.642258Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.742572Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.742598Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.742602Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.844656Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.844672Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.844675Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.945708Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.945729Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.945732Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.046200Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.046215Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.046217Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.149995Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.150012Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.150015Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.254447Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.254466Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.254470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.354476Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.354492Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.354496Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.454788Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.454805Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.454808Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.555450Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.555470Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.555474Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.657013Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.657029Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.657032Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
=== Closing the session
2025-10-01T14:07:02.721348Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:3126" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:3126" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:3126" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-10-01T14:07:02.724899Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-10-01T14:07:02.725131Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-10-01T14:07:02.726117Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-10-01T14:07:02.726130Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session will now close
2025-10-01T14:07:02.726141Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: aborting
2025-10-01T14:07:02.726259Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-10-01T14:07:02.726276Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: destroy
2025-10-01T14:07:02.757644Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.757662Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.757665Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.857734Z node 4 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.857751Z node 4 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.857754Z node 4 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:14.962855Z :PropagateSessionClosed INFO: Random seed for debugging is 1759327574962848
2025-10-01T14:06:15.063415Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7556254401652748553:2084];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:15.063437Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:15.067194Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-10-01T14:06:15.067687Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7556254399275891129:2157];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:15.067702Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-10-01T14:06:15.069437Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/hgvb/004789/r3tmp/tmpLrG0c2/pdisk_1.dat
2025-10-01T14:06:15.101597Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:15.112229Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-10-01T14:06:15.125286Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 21386, node 1
2025-10-01T14:06:15.142852Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/hgvb/004789/r3tmp/yandexjSUZ08.tmp
2025-10-01T14:06:15.142867Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/hgvb/004789/r3tmp/yandexjSUZ08.tmp
2025-10-01T14:06:15.142932Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/hgvb/004789/r3tmp/yandexjSUZ08.tmp
2025-10-01T14:06:15.143000Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-10-01T14:06:15.145275Z INFO: TTestServer started on Port 16612 GrpcPort 21386
TClient is connected to server localhost:16612
PQClient connected to localhost:21386
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-10-01T14:06:15.165137Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.165174Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:15.166795Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient::Ls response: 2025-10-01T14:06:15.172525Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-10-01T14:06:15.172549Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-10-01T14:06:15.173212Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-10-01T14:06:15.173468Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-10-01T14:06:15.176482Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-10-01T14:06:15.291327Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.306031Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-10-01T14:06:15.432867Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399275891339:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.432890Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399275891317:2294], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.432904Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.434508Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-10-01T14:06:15.435542Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399275891383:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.435565Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.435627Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7556254399275891385:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.435641Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-10-01T14:06:15.440394Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7556254399275891356:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-10-01T14:06:15.535079Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7556254401652749542:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.535334Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.535774Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=1&id=OGNlNzQwMjgtNWJmNjNiODUtYTU3ZjRhNTQtOWE0ZDcxOWQ=, ActorId: [1:7556254401652749500:2322], ActorState: ExecuteState, TraceId: 01k6g1gqds99ma89pd142f7m2w, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.536206Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.538709Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7556254399275891388:2135] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-10-01T14:06:15.543644Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7556254399275891403:2306], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-10-01T14:06:15.543757Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2408: SessionId: ydb://session/3?node_id=2&id=ZmE1MTg1ZDMtNjFiMjVlMTctZWM4MzkyYmMtZGQ5NGM0Y2I=, ActorId: [2:7556254399275891315:2293], ActorState: ExecuteState, TraceId: 01k6g1gqc7br92ms8etmn3dp3t, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-10-01T14:06:15.543925Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-10-01T14:06:15.575234Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-10-01T14:06:15.599458Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:21386", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-10-01T14:06:15.641489Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6g1gqj2ejvbqbk04v87p0pt, Database: , SessionId: ydb://session/3?node_id=1&id=NjhjZmYyMzctMzhjZDJjMzgtMWZlMWZkM2EtNmFmNzJiYWI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7556254401652749929:2945] 
2025-10-01T14:06:16.065556Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:16.069291Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-10-01T14:06:20.065816Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7556254401652748553:2084];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:20.065957Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-10-01T14:06:20.067870Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7556254399275891129:2157];send_to=[0:7307199536658146131:7762515];
2025-10-01T14:06:20.067897Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-10-01T14:06:20.747042Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:21386
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.766983Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:21386
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-10-01T14:06:20.774237Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7556254423127586930:3256] connected; active server actors: 1
2025-10-01T14:06:20.774501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-10-01T14:06:20.774618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-10-01T14:06:20.774924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-10-01T14:06:20.777596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:20.778119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:20.778174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-10-01T14:06:20.778185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.778196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-10-01T14:06:20.778295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254423127586950:2446], now have 1 active actors on pipe
2025-10-01T14:06:20.778304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254423127586929:3255], now have 1 active actors on pipe
2025-10-01T14:06:20.778349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-10-01T14:06:20.778485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.779657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.781225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254423127586984:3299], now have 1 active actors on pipe
2025-10-01T14:06:20.781365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.782222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.782425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:20.782451Z node 2 :PERSQUEUE DEBUG: partition.cpp:1273: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-10-01T14:06:20.782501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:20.782592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254420750728441:2401]
2025-10-01T14:06:20.783316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:20.783324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:20.783329Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7556254420750728441:2401]
2025-10-01T14:06:20.783335Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-10-01T14:06:20.783630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-10-01T14:06:20.783641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.783664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.783670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:20.783674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.783677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.783679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.783680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2295: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-10-01T14:06:20.783687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:20.783752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.783777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.785756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.785800Z node 2 :PERSQUEUE DEBUG: partition.cpp:1377: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759327580829, TxId 281474976720677
2025-10-01T14:06:20.785810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.785812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.785835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.785886Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:20.787115Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6g1gwk47f8edwkd38jg4bwv, Database: , SessionId: ydb://session/3?node_id=1&id=MzIyZmU5MzgtMmU3NzU5ZDEtMzU1MzQ0Zi1kNTVhMTI0, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-10-01T14:06:20.786360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:20.786437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:20.786444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.786446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.786448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.786453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:20.786554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-10-01T14:06:20.786570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:20.786623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.788866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-10-01T14:06:20.788885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-10-01T14:06:20.789491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327580829
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759327580829
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:21386
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:20.797810Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:20.886506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.886522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.886525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:20.988026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:20.988044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:20.988047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.088292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.088306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.088309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.190484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.190498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.190500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.291045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.291060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.291063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:21386
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.298945Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-10-01T14:06:21.391370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.391387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.391390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.491765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.491781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.491784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.592096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.592110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.592112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.692408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.692433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.692436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.794416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.794436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.794438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:21386
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-10-01T14:06:21.812561Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-10-01T14:06:21.819930Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-10-01T14:06:21.820190Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-10-01T14:06:21.820198Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:21.821272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:21.821284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-10-01T14:06:21.822350Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.822838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-10-01T14:06:21.822895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:45444
2025-10-01T14:06:21.822900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:45444 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:21.822904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:21.823635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-10-01T14:06:21.823686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:21.823693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:21.823695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:21.823700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254427422554458:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:21.824210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254427422554458:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:21.860561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254427422554458:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:21.861045Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427422554490:2481] connected; active server actors: 1
2025-10-01T14:06:21.861144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254427422554458:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-10-01T14:06:21.861149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254427422554458:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:21.866685Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427422554490:2481] disconnected; active server actors: 1
2025-10-01T14:06:21.866693Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254427422554490:2481] disconnected no session
2025-10-01T14:06:21.896445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254427422554458:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:21.896466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254427422554458:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:21.896469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254427422554458:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:21.896478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:21.897341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:21.897824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.897840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.897843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.897879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254427422554512:2481], now have 1 active actors on pipe
2025-10-01T14:06:21.897912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.897922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.897950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|79ae491f-a0b417a7-8adba4cd-28449fb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-10-01T14:06:21.897958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.897963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.897966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:21.897978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.897988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:21.898008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.898639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:21.898648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:21.898668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:21.898807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|79ae491f-a0b417a7-8adba4cd-28449fb4_0
2025-10-01T14:06:21.899587Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327581899 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:21.899624Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|79ae491f-a0b417a7-8adba4cd-28449fb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:21.899777Z :INFO: [] MessageGroupId [src] SessionId [src|79ae491f-a0b417a7-8adba4cd-28449fb4_0] Write session: close. Timeout = 0 ms
2025-10-01T14:06:21.899783Z :INFO: [] MessageGroupId [src] SessionId [src|79ae491f-a0b417a7-8adba4cd-28449fb4_0] Write session will now close
2025-10-01T14:06:21.899788Z :DEBUG: [] MessageGroupId [src] SessionId [src|79ae491f-a0b417a7-8adba4cd-28449fb4_0] Write session: aborting
2025-10-01T14:06:21.899899Z :INFO: [] MessageGroupId [src] SessionId [src|79ae491f-a0b417a7-8adba4cd-28449fb4_0] Write session: gracefully shut down, all writes complete
2025-10-01T14:06:21.899904Z :DEBUG: [] MessageGroupId [src] SessionId [src|79ae491f-a0b417a7-8adba4cd-28449fb4_0] Write session: destroy
2025-10-01T14:06:21.904054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7556254427422554512:2481] destroyed
2025-10-01T14:06:21.904074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-10-01T14:06:21.904081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:21.904085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:21.904087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:21.902488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|79ae491f-a0b417a7-8adba4cd-28449fb4_0 grpc read done: success: 0 data: 
2025-10-01T14:06:21.902506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|79ae491f-a0b417a7-8adba4cd-28449fb4_0 grpc read failed
2025-10-01T14:06:21.902518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|79ae491f-a0b417a7-8adba4cd-28449fb4_0 grpc closed
2025-10-01T14:06:21.902524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|79ae491f-a0b417a7-8adba4cd-28449fb4_0 is DEAD
2025-10-01T14:06:21.902822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
Session was created
>>> Ready to answer: ok
2025-10-01T14:06:21.978500Z :INFO: [/Root] [] [cdc7c4d5-477cc0c2-a7b7d751-3670398d] Open read subsessions to databases: { name: dc1, endpoint: localhost:21386, path: /Root }, { name: dc2, endpoint: localhost:21386, path: /Invalid }
2025-10-01T14:06:21.981838Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Starting read session
2025-10-01T14:06:21.981850Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Starting single session
2025-10-01T14:06:21.982076Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:21.982083Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:21.982088Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:06:21.986458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-10-01T14:06:21.986586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-10-01T14:06:21.986606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:21.990678Z :INFO: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Starting read session
2025-10-01T14:06:21.990691Z :DEBUG: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Starting single session
2025-10-01T14:06:21.990719Z :DEBUG: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:21.990723Z :DEBUG: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:21.990727Z :DEBUG: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] [] Reconnecting session to cluster  in 0.000000s
2025-10-01T14:06:21.990754Z :ERROR: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] [] Got error. Status: NOT_FOUND. Description: <main>: Error: Database Invalid does not exist, code: 200202 <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. 
2025-10-01T14:06:21.990761Z :DEBUG: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:21.990763Z :DEBUG: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:21.990793Z :INFO: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] [] Closing session to cluster: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.013932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.013946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.013949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.043398Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:06:22.043431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.046224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:22.046239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-10-01T14:06:22.046316Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:06:22.046318Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-10-01T14:06:22.050632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.050677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:22.050681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:22.050686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:22.052548Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:22.052627Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:22.052728Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 auth for : user
2025-10-01T14:06:22.054764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-10-01T14:06:22.054798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:22.054799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:22.054801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:22.054808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254431717521832:2500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:22.055352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254431717521832:2500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:22.055631Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 Handle describe topics response
2025-10-01T14:06:22.055651Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 auth is DEAD
2025-10-01T14:06:22.055665Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:06:22.055994Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:06:22.056218Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_1_2649111627664798049_v1
2025-10-01T14:06:22.056229Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:22.056275Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:06:22.056550Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254431717521839:2501] connected; active server actors: 1
2025-10-01T14:06:22.056574Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556254431717521839:2501] session shared/user_1_1_2649111627664798049_v1
2025-10-01T14:06:22.056583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:06:22.056593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:06:22.056602Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_1_2649111627664798049_v1" (Sender=[1:7556254431717521829:2501], Pipe=[1:7556254431717521839:2501], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:22.056606Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:06:22.056616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:06:22.056628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_1_2649111627664798049_v1" (Sender=[1:7556254431717521829:2501], Pipe=[1:7556254431717521839:2501], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:22.056651Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_1_2649111627664798049_v1" sender [1:7556254431717521829:2501] lock partition 0 for ReadingSession "shared/user_1_1_2649111627664798049_v1" (Sender=[1:7556254431717521829:2501], Pipe=[1:7556254431717521839:2501], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-10-01T14:06:22.056675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:06:22.056679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000057s
2025-10-01T14:06:22.056947Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_1_1_2649111627664798049_v1" ClientId: "user" PipeClient { RawX1: 7556254431717521839 RawX2: 4503603922340293 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:22.056985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:06:22.057253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254431717521842:2506], now have 1 active actors on pipe
2025-10-01T14:06:22.057384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [1:7556254431717521842:2506]
2025-10-01T14:06:22.057730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.057744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.057762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_1_2649111627664798049_v1 on pipe: [1:7556254431717521842:2506]
2025-10-01T14:06:22.057789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.057796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.057799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.057831Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_1_2649111627664798049_v1
2025-10-01T14:06:22.057830Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_1_2649111627664798049_v1:1 with generation 1
2025-10-01T14:06:22.057835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.057872Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.058342Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-10-01T14:06:22.058391Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 got read request: guid# 609e1ca1-34fcdb44-c4a5dc63-2d02a826
2025-10-01T14:06:22.059152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7556254431717521832:2500] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-10-01T14:06:22.059838Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254431717521854:2500] connected; active server actors: 1
2025-10-01T14:06:22.059903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7556254431717521832:2500] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-10-01T14:06:22.059909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254431717521832:2500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:22.060286Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254431717521854:2500] disconnected; active server actors: 1
2025-10-01T14:06:22.060290Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254431717521854:2500] disconnected no session
2025-10-01T14:06:22.063904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.063961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.063973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.063976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.063977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.063988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-10-01T14:06:22.064004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:06:22.065022Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759327582013 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:06:22.065050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-10-01T14:06:22.065128Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 sending to client partition status
2025-10-01T14:06:22.071152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254431717521832:2500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:22.071170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254431717521832:2500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-10-01T14:06:22.071174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254431717521832:2500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:22.071184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:22.071798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254431717521875:2500], now have 1 active actors on pipe
2025-10-01T14:06:22.073494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-10-01T14:06:22.073679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.073696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.073728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2654c09-fa204983-f8e5039f-2277e534_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:22.073737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.073741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.073743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.073753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.073766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:22.073784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.074013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.074016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.074026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.074138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0
2025-10-01T14:06:22.074708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759327582074 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-10-01T14:06:22.074741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|f2654c09-fa204983-f8e5039f-2277e534_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:22.076567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 1 to 1
2025-10-01T14:06:22.078105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.078120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 1
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 CommittedOffset: 0 EndOffset: 0 }
2025-10-01T14:06:22.080377Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-10-01T14:06:22.084200Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-10-01T14:06:22.084242Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-10-01T14:06:22.084268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-10-01T14:06:22.084287Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-10-01T14:06:22.084797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 2 to 2
2025-10-01T14:06:22.086136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.086565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.086578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 2
2025-10-01T14:06:22.087953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.088371Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:06:22.088384Z :DEBUG: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] [] Abort session to cluster
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.090529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.090548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.090591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:22.090751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.093174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 3 to 3
2025-10-01T14:06:22.094809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.094822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 3
2025-10-01T14:06:22.096016Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:06:22.094766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.096522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.097109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.097130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.097610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:22.097667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:22.097720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:22.097770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:22.097816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size: 205039
2025-10-01T14:06:22.097821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 4 messageNo: 1 size 205039 offset: -1
2025-10-01T14:06:22.097851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.097878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.097896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.097899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-10-01T14:06:22.097938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-01T14:06:22.097951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-01T14:06:22.097954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-01T14:06:22.097957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-01T14:06:22.097961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-01T14:06:22.099798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 4 to 4
2025-10-01T14:06:22.100048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.100056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 4
2025-10-01T14:06:22.101663Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.102438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.100219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-01T14:06:22.100247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.100397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00004? size 2253219 WTime 1759327582099
2025-10-01T14:06:22.102125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.102133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.102152Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.102166Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 2253219
2025-10-01T14:06:22.102234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-10-01T14:06:22.108795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 5 to 5
2025-10-01T14:06:22.110641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.110657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 5
2025-10-01T14:06:22.110180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.111899Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.111987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.113680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.113697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.114017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size: 511959
2025-10-01T14:06:22.114310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 1 messageNo: 3 size: 511959
2025-10-01T14:06:22.114622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 2 messageNo: 3 size: 511959
2025-10-01T14:06:22.114933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 3 messageNo: 3 size: 511959
2025-10-01T14:06:22.114969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size: 205039
2025-10-01T14:06:22.114973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 4 messageNo: 3 size 205039 offset: -1
2025-10-01T14:06:22.114997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.115000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.115013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.115016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.115034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.115045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-10-01T14:06:22.116494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.118044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 6 to 6
2025-10-01T14:06:22.119455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.119871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.119886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 6
2025-10-01T14:06:22.120346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.120362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.120436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 5 size: 511959
2025-10-01T14:06:22.120484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 1 messageNo: 5 size: 511959
2025-10-01T14:06:22.120864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 2 messageNo: 5 size: 511959
2025-10-01T14:06:22.120908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.121152Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.121197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 3 messageNo: 5 size: 511959
2025-10-01T14:06:22.121260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size: 205039
2025-10-01T14:06:22.121269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 4 messageNo: 5 size 205039 offset: -1
2025-10-01T14:06:22.121300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.121307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.121379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.121405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.121426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 2253219 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.121449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-10-01T14:06:22.121463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.121470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-01T14:06:22.121493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2252910 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.121501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.121508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-10-01T14:06:22.121515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.121528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.121850Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-10-01T14:06:22.121858Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-10-01T14:06:22.121881Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 2253219
2025-10-01T14:06:22.121884Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:06:22.121900Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 performing read request: guid# 6590b3c0-36636bcb-dcef0e85-866aee6c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:06:22.121921Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 6590b3c0-36636bcb-dcef0e85-866aee6c
2025-10-01T14:06:22.121519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 1, Offset: 0 is stored on disk
2025-10-01T14:06:22.121526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.121530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 2, Offset: 0 is stored on disk
2025-10-01T14:06:22.121532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.121536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 3, Offset: 0 is stored on disk
2025-10-01T14:06:22.121540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.121543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 4, Offset: 0 is stored on disk
2025-10-01T14:06:22.121589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:22.121594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:22.121598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.121609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.121611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-01T14:06:22.121631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-01T14:06:22.121642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-01T14:06:22.121646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-01T14:06:22.121650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-01T14:06:22.121653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-01T14:06:22.122049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2253229 count 1 nextOffset 2 batches 5
2025-10-01T14:06:22.122066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-01T14:06:22.122073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-01T14:06:22.122077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-01T14:06:22.122080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-01T14:06:22.122083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-01T14:06:22.122714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 4506426 count 2 nextOffset 3 batches 9
2025-10-01T14:06:22.122736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.123567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,2 HeadOffset 1 endOffset 1 curOffset 3 d0000000000_00000000000000000001_00000_0000000002_00008? size 4506416 WTime 1759327582123
2025-10-01T14:06:22.123339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.124829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.125411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 7 to 7
2025-10-01T14:06:22.126849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-01T14:06:22.126867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 2253219 bytes (2253219)
2025-10-01T14:06:22.126871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 2253219 (8388608)
2025-10-01T14:06:22.126920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-10-01T14:06:22.126978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.126991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.127084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.127095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 7
2025-10-01T14:06:22.127195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.128642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.128661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.128843Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.128982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 23 }
2025-10-01T14:06:22.128996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 1
2025-10-01T14:06:22.129028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 7 size: 511959
2025-10-01T14:06:22.129391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 1 messageNo: 7 size: 511959
2025-10-01T14:06:22.129449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 2 messageNo: 7 size: 511959
2025-10-01T14:06:22.129497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 3 messageNo: 7 size: 511959
2025-10-01T14:06:22.129549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size: 205039
2025-10-01T14:06:22.129557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 4 messageNo: 7 size 205039 offset: -1
2025-10-01T14:06:22.129597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.129604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.129617Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.129637Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 2 size 4506416
2025-10-01T14:06:22.129671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.129692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.129752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-10-01T14:06:22.129766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-01T14:06:22.129777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:22.129790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 5
2025-10-01T14:06:22.129834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.129844Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-10-01T14:06:22.129857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 524288 endOffset 1 max time lag 0ms effective offset 0
2025-10-01T14:06:22.129868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 2253219 count 1 last offset 0, current partition end offset: 1
2025-10-01T14:06:22.129870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-10-01T14:06:22.129875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-01T14:06:22.129878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:22.129909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.130035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:22.131737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.132031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.130499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.131000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.131459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.131530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-01T14:06:22.131554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 1 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.131565Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-10-01T14:06:22.131588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-01T14:06:22.132246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.132253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.132390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 9 size: 511959
2025-10-01T14:06:22.132436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 1 messageNo: 9 size: 511959
2025-10-01T14:06:22.132494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 2 messageNo: 9 size: 511959
2025-10-01T14:06:22.132547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 3 messageNo: 9 size: 511959
2025-10-01T14:06:22.132587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size: 205039
2025-10-01T14:06:22.132590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 4 messageNo: 9 size 205039 offset: -1
2025-10-01T14:06:22.132611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:22.132638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:22.132795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:22.132939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.132988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 8 to 8
2025-10-01T14:06:22.133143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.133246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.133257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 8
2025-10-01T14:06:22.133275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.133362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 1 count 1 size 205085 from pos 0 cbcount 1
2025-10-01T14:06:22.133399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.133406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.133418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.133440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.133458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.134322Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.134991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 6
2025-10-01T14:06:22.135763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.136708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 2 size 4506416 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.136730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.136715Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 1 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582097 CreateTimestampMS: 1759327582074 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 110 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-10-01T14:06:22.136750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-01T14:06:22.136761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.136768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-10-01T14:06:22.136786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 1, Offset: 1 is stored on disk
2025-10-01T14:06:22.136792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 2, Offset: 1 is stored on disk
2025-10-01T14:06:22.136798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 3, Offset: 1 is stored on disk
2025-10-01T14:06:22.136806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 4, Offset: 1 is stored on disk
2025-10-01T14:06:22.136813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-10-01T14:06:22.136819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 1, Offset: 2 is stored on disk
2025-10-01T14:06:22.136825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 2, Offset: 2 is stored on disk
2025-10-01T14:06:22.136830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 3, Offset: 2 is stored on disk
2025-10-01T14:06:22.136836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.136838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 4, Offset: 2 is stored on disk
2025-10-01T14:06:22.136894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.136910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.136913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-01T14:06:22.136930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-01T14:06:22.136939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-01T14:06:22.136947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-01T14:06:22.136950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-01T14:06:22.136954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-01T14:06:22.137351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 2253229 count 1 nextOffset 4 batches 5
2025-10-01T14:06:22.137373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-01T14:06:22.137380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-01T14:06:22.137387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-01T14:06:22.137390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-01T14:06:22.137394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-01T14:06:22.137629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 9 to 9
2025-10-01T14:06:22.137793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.137887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.137897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 9
2025-10-01T14:06:22.138918Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.139013Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-10-01T14:06:22.139033Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 6590b3c0-36636bcb-dcef0e85-866aee6c has messages 1
2025-10-01T14:06:22.139095Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 read done: guid# 6590b3c0-36636bcb-dcef0e85-866aee6c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252974
2025-10-01T14:06:22.139109Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 response to read: guid# 6590b3c0-36636bcb-dcef0e85-866aee6c
2025-10-01T14:06:22.139967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.142115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 10 to 10
2025-10-01T14:06:22.142162Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 Process answer. Aval parts: 0
2025-10-01T14:06:22.142220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.142248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.137996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 0 PackedSize 4506426 count 2 nextOffset 5 batches 9
2025-10-01T14:06:22.138019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.138117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,2 HeadOffset 3 endOffset 3 curOffset 5 d0000000000_00000000000000000003_00000_0000000002_00008? size 4506416 WTime 1759327582137
2025-10-01T14:06:22.142059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-01T14:06:22.142063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000002_00008?
2025-10-01T14:06:22.142066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 6759635 bytes (6759635)
2025-10-01T14:06:22.142072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 6759635 (8388608)
2025-10-01T14:06:22.142504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.142536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 10
2025-10-01T14:06:22.142592Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.142113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-10-01T14:06:22.142150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-10-01T14:06:22.143155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.143164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.143243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 11 size: 511959
2025-10-01T14:06:22.143292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 1 messageNo: 11 size: 511959
2025-10-01T14:06:22.143344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 2 messageNo: 11 size: 511959
2025-10-01T14:06:22.143395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 3 messageNo: 11 size: 511959
2025-10-01T14:06:22.143436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size: 205039
2025-10-01T14:06:22.143440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 4 messageNo: 11 size 205039 offset: -1
2025-10-01T14:06:22.143493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.143495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.143504Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.143528Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 0 count 2 size 4506416
2025-10-01T14:06:22.143538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.143557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.143615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 7
2025-10-01T14:06:22.145427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 11 to 11
2025-10-01T14:06:22.143885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.143890Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 3 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-10-01T14:06:22.143894Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 3
2025-10-01T14:06:22.143907Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 3, WTime# 1759327582097, sizeLag# 4506416
2025-10-01T14:06:22.143910Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1TEvPartitionReady. Aval parts: 1
2025-10-01T14:06:22.145720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.145727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 11
2025-10-01T14:06:22.145733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528011[B] reached maximum (20971520[B])
2025-10-01T14:06:22.145760Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.147049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.146667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.146683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.146938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 13 size: 511959
2025-10-01T14:06:22.146998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 1 messageNo: 13 size: 511959
2025-10-01T14:06:22.147058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 2 messageNo: 13 size: 511959
2025-10-01T14:06:22.147729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 12 queued_in_partition_duration_ms: 6 }
2025-10-01T14:06:22.147743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 2
2025-10-01T14:06:22.147748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275210[B]
2025-10-01T14:06:22.148663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 12 to 12
2025-10-01T14:06:22.149175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.149445Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got ReadResponse, serverBytesSize = 2252974, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728686
2025-10-01T14:06:22.149522Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-10-01T14:06:22.149536Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 2252974 to budget
2025-10-01T14:06:22.149622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 3 messageNo: 13 size: 511959
2025-10-01T14:06:22.149809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size: 205039
2025-10-01T14:06:22.149819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 4 messageNo: 13 size 205039 offset: -1
2025-10-01T14:06:22.149868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.149879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.149893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.149916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.150083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 8
2025-10-01T14:06:22.150175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.150486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.150499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 12
2025-10-01T14:06:22.151376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 2 size 4506416 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.151400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.151416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-01T14:06:22.151417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.151424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-10-01T14:06:22.151438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 1, Offset: 3 is stored on disk
2025-10-01T14:06:22.151445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 2, Offset: 3 is stored on disk
2025-10-01T14:06:22.151452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 3, Offset: 3 is stored on disk
2025-10-01T14:06:22.151461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 4, Offset: 3 is stored on disk
2025-10-01T14:06:22.151469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-10-01T14:06:22.151475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 1, Offset: 4 is stored on disk
2025-10-01T14:06:22.151480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 2, Offset: 4 is stored on disk
2025-10-01T14:06:22.151486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 3, Offset: 4 is stored on disk
2025-10-01T14:06:22.151493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.151498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 4, Offset: 4 is stored on disk
2025-10-01T14:06:22.151887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528012[B] reached maximum (20971520[B])
2025-10-01T14:06:22.152031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 12 }
2025-10-01T14:06:22.152044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 3
2025-10-01T14:06:22.152048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275211[B]
2025-10-01T14:06:22.152721Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-10-01T14:06:22.152738Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.152748Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252974, ReadSizeServerDelta = -1728686
2025-10-01T14:06:22.152818Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:06:22.152826Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-10-01T14:06:22.074000Z WriteTime: 2025-10-01T14:06:22.097000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:51196", "logtype": "unknown", "_ip": "ipv6:[::1]:51196" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.151539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.151558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.151560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-01T14:06:22.151582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-01T14:06:22.151593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-01T14:06:22.151596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-01T14:06:22.151599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-01T14:06:22.151602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-01T14:06:22.152027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-10-01T14:06:22.152043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-01T14:06:22.152048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-01T14:06:22.152051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-01T14:06:22.152054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-01T14:06:22.152058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-01T14:06:22.153980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 4506426 count 2 nextOffset 7 batches 9
2025-10-01T14:06:22.153993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.154102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 5,2 HeadOffset 5 endOffset 5 curOffset 7 d0000000000_00000000000000000005_00000_0000000002_00008? size 4506416 WTime 1759327582153
2025-10-01T14:06:22.155139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.155418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.156252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 13 to 13
2025-10-01T14:06:22.156514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.156526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 13
2025-10-01T14:06:22.156533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528013[B] reached maximum (20971520[B])
2025-10-01T14:06:22.156571Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.157027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-01T14:06:22.157041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000002_00008?
2025-10-01T14:06:22.157045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000003_00000_0000000002_00008?
2025-10-01T14:06:22.157048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 11266051 bytes (11266051)
2025-10-01T14:06:22.157051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:22.157094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-10-01T14:06:22.157128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 5
2025-10-01T14:06:22.157901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.157919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.158000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 15 size: 511959
2025-10-01T14:06:22.158059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 1 messageNo: 15 size: 511959
2025-10-01T14:06:22.158113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 2 messageNo: 15 size: 511959
2025-10-01T14:06:22.158160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 3 messageNo: 15 size: 511959
2025-10-01T14:06:22.158198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size: 205039
2025-10-01T14:06:22.158213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 4 messageNo: 15 size 205039 offset: -1
2025-10-01T14:06:22.158241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.158250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.158260Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.158277Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 5 partNo 0 count 2 size 4506416
2025-10-01T14:06:22.158294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:22.158303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-01T14:06:22.158314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000001_00000_0000000002_00008?
2025-10-01T14:06:22.158331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000003_00000_0000000002_00008?
2025-10-01T14:06:22.158352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:22.158360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.158397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.158460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 4 source 1 size 2253219 accessed 2 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.158463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.158467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.158478Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 3 blobs are from cache.
2025-10-01T14:06:22.158502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 9
2025-10-01T14:06:22.158527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:22.158533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000000_00000_0000000001_00004?
2025-10-01T14:06:22.158535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.158542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63'
2025-10-01T14:06:22.158547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 2 parts 8 suffix '63'
2025-10-01T14:06:22.158550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63'
2025-10-01T14:06:22.158661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-10-01T14:06:22.158818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 1
2025-10-01T14:06:22.159285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 2
2025-10-01T14:06:22.159426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 3
2025-10-01T14:06:22.159493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 4
2025-10-01T14:06:22.159900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 1 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2253229 count 1 nextOffset 1 batches 5
2025-10-01T14:06:22.159920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000001_00000_0000000002_00008?
2025-10-01T14:06:22.159922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.160046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-10-01T14:06:22.160490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 1
2025-10-01T14:06:22.160607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 2
2025-10-01T14:06:22.160729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 3
2025-10-01T14:06:22.158910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.158937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.158943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.161660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.162936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 16 queued_in_partition_duration_ms: 5 }
2025-10-01T14:06:22.162948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 4
2025-10-01T14:06:22.162953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275212[B]
2025-10-01T14:06:22.163024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 13 queued_in_partition_duration_ms: 3 }
2025-10-01T14:06:22.163027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 5
2025-10-01T14:06:22.162994Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252974 } }
2025-10-01T14:06:22.163030Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 got read request: guid# 521ff64a-6a1ad54a-6e82e0b7-e38cb7bb
2025-10-01T14:06:22.163049Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 performing read request: guid# cc29260c-da5cd5f0-1acb108b-c87b717, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:06:22.163065Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 3 ClientCommitOffset 0 committedOffset 0 Guid cc29260c-da5cd5f0-1acb108b-c87b717
2025-10-01T14:06:22.163295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.164600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 14 to 14
2025-10-01T14:06:22.166119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.166129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 14
2025-10-01T14:06:22.166831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 4
2025-10-01T14:06:22.167074Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.167649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 2 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 4506426 count 2 nextOffset 2 batches 9
2025-10-01T14:06:22.167668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-10-01T14:06:22.167864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 1
2025-10-01T14:06:22.167983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 2
2025-10-01T14:06:22.168119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 3
2025-10-01T14:06:22.168168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 4
2025-10-01T14:06:22.169265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 3 partNo 4 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 6759623 count 3 nextOffset 3 batches 13
2025-10-01T14:06:22.169276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000003_00000_0000000002_00008?
2025-10-01T14:06:22.169279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.169405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-10-01T14:06:22.169541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 1
2025-10-01T14:06:22.169676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 2
2025-10-01T14:06:22.170108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 3
2025-10-01T14:06:22.170555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 15 to 15
2025-10-01T14:06:22.172105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.172119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 15
2025-10-01T14:06:22.172127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528015[B] reached maximum (20971520[B])
2025-10-01T14:06:22.172171Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.174768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 4 partNo 3 result is x0000000000_00000000000000000000_00000_0000000003_00015 size 8295635
2025-10-01T14:06:22.174981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 4
2025-10-01T14:06:22.174995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000000_00000_0000000003_00015 new key d0000000000_00000000000000000000_00000_0000000003_00015 size 8295635 WTime 1759327582174
2025-10-01T14:06:22.175109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 4 partNo 4 FormedBlobsCount 1 NewHead: Offset 3 PartNo 3 PackedSize 717144 count 1 nextOffset 4 batches 2
2025-10-01T14:06:22.175118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-10-01T14:06:22.175239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 1
2025-10-01T14:06:22.175378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 2
2025-10-01T14:06:22.175517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 3
2025-10-01T14:06:22.175582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 4
2025-10-01T14:06:22.176029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 5 partNo 4 FormedBlobsCount 0 NewHead: Offset 3 PartNo 3 PackedSize 2970341 count 2 nextOffset 5 batches 6
2025-10-01T14:06:22.176116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 3,2 HeadOffset 0 endOffset 0 curOffset 5 d0000000000_00000000000000000003_00003_0000000002_00005| size 2970331 WTime 1759327582174
2025-10-01T14:06:22.177676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.177687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.177764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 17 size: 511959
2025-10-01T14:06:22.177815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 1 messageNo: 17 size: 511959
2025-10-01T14:06:22.177866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 2 messageNo: 17 size: 511959
2025-10-01T14:06:22.177920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 3 messageNo: 17 size: 511959
2025-10-01T14:06:22.177947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size: 205039
2025-10-01T14:06:22.177952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 4 messageNo: 17 size 205039 offset: -1
2025-10-01T14:06:22.177992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.177995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.178009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.178434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.178011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.178038Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.178051Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 3 size 8295635
2025-10-01T14:06:22.178057Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 2 size 2970331
2025-10-01T14:06:22.178069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.178092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.178300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 10
2025-10-01T14:06:22.178324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 2 size 524288 endOffset 5 max time lag 0ms effective offset 1
2025-10-01T14:06:22.178340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 4506416 count 2 last offset 1, current partition end offset: 5
2025-10-01T14:06:22.178344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-10-01T14:06:22.178354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 1 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.178359Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-10-01T14:06:22.178454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 2 parts 8 suffix '63'
2025-10-01T14:06:22.178522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:22.178681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 2 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:22.179019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.179148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.179283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.179457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 1 totakecount 2 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:22.179596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.179895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.180079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.180341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 2 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.180425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 2 totakecount 2 count 1 size 205085 from pos 0 cbcount 1
2025-10-01T14:06:22.181698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.182188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.182206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.182276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 19 size: 511959
2025-10-01T14:06:22.182667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 1 messageNo: 19 size: 511959
2025-10-01T14:06:22.183043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 2 messageNo: 19 size: 511959
2025-10-01T14:06:22.183415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 3 messageNo: 19 size: 511959
2025-10-01T14:06:22.183454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size: 205039
2025-10-01T14:06:22.183463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 4 messageNo: 19 size 205039 offset: -1
2025-10-01T14:06:22.183506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:22.183547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 5 count 2 size 4506416 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.183578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.183585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.183596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-01T14:06:22.183598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.183620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.188551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.188583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505820 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.188590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-10-01T14:06:22.188611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 1, Offset: 5 is stored on disk
2025-10-01T14:06:22.188619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 2, Offset: 5 is stored on disk
2025-10-01T14:06:22.188625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 3, Offset: 5 is stored on disk
2025-10-01T14:06:22.188635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 4, Offset: 5 is stored on disk
2025-10-01T14:06:22.188643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-10-01T14:06:22.188654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 1, Offset: 6 is stored on disk
2025-10-01T14:06:22.188659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 2, Offset: 6 is stored on disk
2025-10-01T14:06:22.188664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 3, Offset: 6 is stored on disk
2025-10-01T14:06:22.188669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.188672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 4, Offset: 6 is stored on disk
2025-10-01T14:06:22.188711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.188732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.188738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-01T14:06:22.188761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-01T14:06:22.188775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-01T14:06:22.188783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-01T14:06:22.188786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-01T14:06:22.188790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-01T14:06:22.189279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 2253229 count 1 nextOffset 8 batches 5
2025-10-01T14:06:22.189302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-01T14:06:22.189312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-01T14:06:22.189317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-01T14:06:22.189326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-01T14:06:22.189329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-01T14:06:22.189824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 4506426 count 2 nextOffset 9 batches 9
2025-10-01T14:06:22.189846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-01T14:06:22.189852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-01T14:06:22.189859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-01T14:06:22.189862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-01T14:06:22.189865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-01T14:06:22.190311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 0 PackedSize 6759623 count 3 nextOffset 10 batches 13
2025-10-01T14:06:22.190350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.190472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,3 HeadOffset 7 endOffset 7 curOffset 10 d0000000000_00000000000000000007_00000_0000000003_00012? size 6759613 WTime 1759327582190
2025-10-01T14:06:22.192082Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 5 Result { Offset: 1 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 2 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582121 CreateTimestampMS: 1759327582083 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 3 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582121 CreateTimestampMS: 1759327582091 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 4506614 RealReadOffset: 2 WaitQuotaTimeMs: 0 EndOffset: 5 StartOffset: 0 } Cookie: 1 }
2025-10-01T14:06:22.193873Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 3 endOffset 5
2025-10-01T14:06:22.193900Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 5 ReadOffset 3 ReadGuid cc29260c-da5cd5f0-1acb108b-c87b717 has messages 1
2025-10-01T14:06:22.193925Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 3, endOffset# 5, WTime# 1759327582121, sizeLag# 4506614
2025-10-01T14:06:22.193930Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1TEvPartitionReady. Aval parts: 0
2025-10-01T14:06:22.193955Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 read done: guid# cc29260c-da5cd5f0-1acb108b-c87b717, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 4505817
2025-10-01T14:06:22.193969Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 response to read: guid# cc29260c-da5cd5f0-1acb108b-c87b717
2025-10-01T14:06:22.195276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:06:22.195356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 6
2025-10-01T14:06:22.195388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 7
2025-10-01T14:06:22.195407Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.195424Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 0 count 3 size 6759613
2025-10-01T14:06:22.195437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 11
2025-10-01T14:06:22.195664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.195688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.195695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.195864Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 Process answer. Aval parts: 1
2025-10-01T14:06:22.196410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.196422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 2 size 2970331 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.196439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.196443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-01T14:06:22.196449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:22.196459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 2 parts 5 suffix '124' size 2970331
2025-10-01T14:06:22.196933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.196945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-01T14:06:22.196948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 4506416 bytes (4506416)
2025-10-01T14:06:22.196953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 4506416 (8388608)
2025-10-01T14:06:22.197319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.197378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 9 }
2025-10-01T14:06:22.197394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 6
2025-10-01T14:06:22.197403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275214[B]
2025-10-01T14:06:22.197621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.198115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.198137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.198209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 21 size: 511959
2025-10-01T14:06:22.198266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 1 messageNo: 21 size: 511959
2025-10-01T14:06:22.198330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 2 messageNo: 21 size: 511959
2025-10-01T14:06:22.198404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 3 messageNo: 21 size: 511959
2025-10-01T14:06:22.198441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size: 205040
2025-10-01T14:06:22.198448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 4 messageNo: 21 size 205040 offset: -1
2025-10-01T14:06:22.198473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.198478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.198487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.198504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.198518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 12
2025-10-01T14:06:22.198590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.199007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 16 to 16
2025-10-01T14:06:22.199254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.199263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 16
2025-10-01T14:06:22.199268Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got ReadResponse, serverBytesSize = 4505817, now ReadSizeBudget = 0, ReadSizeServerDelta = -3981529
2025-10-01T14:06:22.199374Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-1)
2025-10-01T14:06:22.199391Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 4505817 to budget
2025-10-01T14:06:22.200227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.200545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.200725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528016[B] reached maximum (20971520[B])
2025-10-01T14:06:22.200955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.200972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.201033Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-10-01T14:06:22.201047Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.201081Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (2-2)
2025-10-01T14:06:22.201092Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:06:22.201811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 36 queued_in_partition_duration_ms: 2 }
2025-10-01T14:06:22.201822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 7
2025-10-01T14:06:22.201064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 23 size: 511959
2025-10-01T14:06:22.201126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 1 messageNo: 23 size: 511959
2025-10-01T14:06:22.201502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 2 messageNo: 23 size: 511959
2025-10-01T14:06:22.201826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275215[B]
2025-10-01T14:06:22.201620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 3 messageNo: 23 size: 511959
2025-10-01T14:06:22.201659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size: 205040
2025-10-01T14:06:22.201664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 4 messageNo: 23 size 205040 offset: -1
2025-10-01T14:06:22.201689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.201692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.201703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.201727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.201742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 13
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-10-01T14:06:22.083000Z WriteTime: 2025-10-01T14:06:22.121000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:51196", "_ip": "ipv6:[::1]:51196" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.201903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.203395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.203658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.203924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.203943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.204019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size: 511959
2025-10-01T14:06:22.204046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 17 to 17
2025-10-01T14:06:22.204073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 1 messageNo: 25 size: 511959
2025-10-01T14:06:22.204125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 2 messageNo: 25 size: 511959
2025-10-01T14:06:22.204179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 3 messageNo: 25 size: 511959
2025-10-01T14:06:22.204225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size: 205040
2025-10-01T14:06:22.204233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 4 messageNo: 25 size 205040 offset: -1
2025-10-01T14:06:22.204258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.204268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.204278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.204302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.204314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.204322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 17
2025-10-01T14:06:22.204320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-10-01T14:06:22.204432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.205325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528017[B] reached maximum (20971520[B])
2025-10-01T14:06:22.205360Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.205878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.206335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.206458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.206473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.206537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 27 size: 511959
2025-10-01T14:06:22.206735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 1 messageNo: 27 size: 511959
2025-10-01T14:06:22.206785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 2 messageNo: 27 size: 511959
2025-10-01T14:06:22.206834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 3 messageNo: 27 size: 511959
2025-10-01T14:06:22.206863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size: 205040
2025-10-01T14:06:22.206867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 4 messageNo: 27 size 205040 offset: -1
2025-10-01T14:06:22.206900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.206904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.206912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.206932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.207182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.207089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 15
2025-10-01T14:06:22.208110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 6759613 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.208132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.208142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 4 suffix '63' size 2253219
2025-10-01T14:06:22.208147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-01T14:06:22.208150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758730 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.208155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-10-01T14:06:22.208170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 1, Offset: 7 is stored on disk
2025-10-01T14:06:22.208180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 2, Offset: 7 is stored on disk
2025-10-01T14:06:22.208187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 3, Offset: 7 is stored on disk
2025-10-01T14:06:22.208195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 4, Offset: 7 is stored on disk
2025-10-01T14:06:22.208201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-10-01T14:06:22.208208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 1, Offset: 8 is stored on disk
2025-10-01T14:06:22.208212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 2, Offset: 8 is stored on disk
2025-10-01T14:06:22.208217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 3, Offset: 8 is stored on disk
2025-10-01T14:06:22.208222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 4, Offset: 8 is stored on disk
2025-10-01T14:06:22.208227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-10-01T14:06:22.208232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 1, Offset: 9 is stored on disk
2025-10-01T14:06:22.208238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 2, Offset: 9 is stored on disk
2025-10-01T14:06:22.208243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 3, Offset: 9 is stored on disk
2025-10-01T14:06:22.208251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.208255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 4, Offset: 9 is stored on disk
2025-10-01T14:06:22.208308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.208326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.208332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (20)
2025-10-01T14:06:22.208354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-01T14:06:22.208368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-01T14:06:22.208375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-01T14:06:22.208378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-01T14:06:22.208389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-01T14:06:22.208684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.208857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 2253230 count 1 nextOffset 11 batches 5
2025-10-01T14:06:22.208883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-01T14:06:22.208890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-01T14:06:22.208899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-01T14:06:22.208902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-01T14:06:22.208905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-01T14:06:22.208960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.209480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 4506428 count 2 nextOffset 12 batches 9
2025-10-01T14:06:22.209507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-01T14:06:22.209513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-01T14:06:22.209518Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-01T14:06:22.209521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-01T14:06:22.209524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-01T14:06:22.210015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 0 PackedSize 6759626 count 3 nextOffset 13 batches 13
2025-10-01T14:06:22.210040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-01T14:06:22.210050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-01T14:06:22.210054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-01T14:06:22.210060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-01T14:06:22.216757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 14 partNo 3 result is x0000000000_00000000000000000010_00000_0000000003_00015? size 8295638
2025-10-01T14:06:22.216787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-01T14:06:22.216806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00000_0000000003_00015? new key d0000000000_00000000000000000010_00000_0000000003_00015? size 8295638 WTime 1759327582216
2025-10-01T14:06:22.217482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.217530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.217540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.217846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 19 queued_in_partition_duration_ms: 30 }
2025-10-01T14:06:22.217860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 8
2025-10-01T14:06:22.217866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275216[B]
2025-10-01T14:06:22.218258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 18 to 18
2025-10-01T14:06:22.216949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 4 FormedBlobsCount 1 NewHead: Offset 13 PartNo 3 PackedSize 717145 count 1 nextOffset 14 batches 2
2025-10-01T14:06:22.216969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.217080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 13,1 HeadOffset 10 endOffset 10 curOffset 14 d0000000000_00000000000000000013_00003_0000000001_00001? size 717135 WTime 1759327582216
2025-10-01T14:06:22.217253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-01T14:06:22.217257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000007_00000_0000000003_00012?
2025-10-01T14:06:22.217260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11266029 bytes (11266029)
2025-10-01T14:06:22.217262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-01T14:06:22.217292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 2253219 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.217297Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.217338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 8
2025-10-01T14:06:22.217370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 9
2025-10-01T14:06:22.217383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 10
2025-10-01T14:06:22.218148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.218157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.218230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 29 size: 511959
2025-10-01T14:06:22.218279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 1 messageNo: 29 size: 511959
2025-10-01T14:06:22.218328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 2 messageNo: 29 size: 511959
2025-10-01T14:06:22.218536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.218548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 18
2025-10-01T14:06:22.219684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528018[B] reached maximum (20971520[B])
2025-10-01T14:06:22.219984Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (2-2)
2025-10-01T14:06:22.220002Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.220014Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In ContinueReadingDataImpl, ReadSizeBudget = 4505817, ReadSizeServerDelta = -3981529
2025-10-01T14:06:22.220039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 11 }
2025-10-01T14:06:22.220051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 9
2025-10-01T14:06:22.220055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275217[B]
2025-10-01T14:06:22.220098Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:06:22.220105Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:06:22.220178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 18 queued_in_partition_duration_ms: 6 }
2025-10-01T14:06:22.220183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 10
2025-10-01T14:06:22.220240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 3 messageNo: 29 size: 511959
2025-10-01T14:06:22.220282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size: 205040
2025-10-01T14:06:22.220291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 4 messageNo: 29 size 205040 offset: -1
2025-10-01T14:06:22.220312Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 grpc read done: success# 1, data# { read_request { bytes_size: 4505817 } }
2025-10-01T14:06:22.220345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.220355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.220373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.220382Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.220396Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 got read request: guid# bdbc4-d74dda7-7dd154bb-1fdfbe6
2025-10-01T14:06:22.220402Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 0 count 3 size 8295638
2025-10-01T14:06:22.220416Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 13 partNo 3 count 1 size 717135
2025-10-01T14:06:22.220424Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000000_00000_0000000001_00004?(+) to d0000000000_00000000000000000000_00000_0000000001_00004?(+)
2025-10-01T14:06:22.220430Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000001_00000_0000000002_00008?(+) to d0000000000_00000000000000000001_00000_0000000002_00008?(+)
2025-10-01T14:06:22.220422Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 performing read request: guid# 7d38fbe1-96790129-a65e24b-64f3e350, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 2, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:06:22.220433Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00000_0000000002_00008?(+) to d0000000000_00000000000000000003_00000_0000000002_00008?(+)
2025-10-01T14:06:22.220455Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 2 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 3 EndOffset 5 ClientCommitOffset 0 committedOffset 0 Guid 7d38fbe1-96790129-a65e24b-64f3e350
2025-10-01T14:06:22.220442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-01T14:06:22.220445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-01T14:06:22.220454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000007_00000_0000000003_00012?
2025-10-01T14:06:22.220464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-01T14:06:22.220468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.220488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.220564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 5 partno 0 count 2 parts_count 8 source 1 size 4506416 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.220572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 7 partno 0 count 3 parts_count 12 source 1 size 6759613 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.220577Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-01T14:06:22.220599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63'
2025-10-01T14:06:22.220606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 16
2025-10-01T14:06:22.220610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 12 suffix '63'
2025-10-01T14:06:22.220651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.220657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.220668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:22.220677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000005_00000_0000000002_00008?
2025-10-01T14:06:22.220679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.220683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-10-01T14:06:22.091000Z WriteTime: 2025-10-01T14:06:22.121000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:51196", "_ip": "ipv6:[::1]:51196" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.220920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-10-01T14:06:22.221072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 1
2025-10-01T14:06:22.221221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 2
2025-10-01T14:06:22.221373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 3
2025-10-01T14:06:22.221586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 4
2025-10-01T14:06:22.221963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 6 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 2253229 count 1 nextOffset 6 batches 5
2025-10-01T14:06:22.221981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-10-01T14:06:22.222115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 1
2025-10-01T14:06:22.222254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 2
2025-10-01T14:06:22.222408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 3
2025-10-01T14:06:22.222559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 4
2025-10-01T14:06:22.222303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.222646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.224393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 19 to 19
2025-10-01T14:06:22.224702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.224715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 19
2025-10-01T14:06:22.225978Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.222993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 7 partNo 4 FormedBlobsCount 0 NewHead: Offset 5 PartNo 0 PackedSize 4506426 count 2 nextOffset 7 batches 9
2025-10-01T14:06:22.223007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000007_00000_0000000003_00012?
2025-10-01T14:06:22.223009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.223120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-10-01T14:06:22.223244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 1
2025-10-01T14:06:22.227866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 8 partNo 1 result is x0000000000_00000000000000000003_00003_0000000004_00014 size 7988778
2025-10-01T14:06:22.228001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 2
2025-10-01T14:06:22.228140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 3
2025-10-01T14:06:22.228322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 4
2025-10-01T14:06:22.228347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000003_00003_0000000004_00014 new key d0000000000_00000000000000000003_00003_0000000004_00014 size 7988778 WTime 1759327582227
2025-10-01T14:06:22.228652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 8 partNo 4 FormedBlobsCount 1 NewHead: Offset 7 PartNo 1 PackedSize 1741198 count 1 nextOffset 8 batches 4
2025-10-01T14:06:22.228675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-10-01T14:06:22.229218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 20 to 20
2025-10-01T14:06:22.229557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.229569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 20
2025-10-01T14:06:22.228801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 1
2025-10-01T14:06:22.228958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 2
2025-10-01T14:06:22.229095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 3
2025-10-01T14:06:22.229279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 4
2025-10-01T14:06:22.229797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 9 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 3994395 count 2 nextOffset 9 batches 8
2025-10-01T14:06:22.229807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-10-01T14:06:22.229937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 1
2025-10-01T14:06:22.230078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 2
2025-10-01T14:06:22.230214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 3
2025-10-01T14:06:22.230269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 4
2025-10-01T14:06:22.230727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.230770Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.230947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 10 partNo 4 FormedBlobsCount 0 NewHead: Offset 7 PartNo 1 PackedSize 6247592 count 3 nextOffset 10 batches 12
2025-10-01T14:06:22.231037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 7,3 HeadOffset 3 endOffset 5 curOffset 10 d0000000000_00000000000000000007_00001_0000000003_00011| size 6247582 WTime 1759327582231
2025-10-01T14:06:22.233819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.233836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.233925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 31 size: 511959
2025-10-01T14:06:22.233979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 1 messageNo: 31 size: 511959
2025-10-01T14:06:22.234033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 2 messageNo: 31 size: 511959
2025-10-01T14:06:22.234092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 3 messageNo: 31 size: 511959
2025-10-01T14:06:22.234123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size: 205040
2025-10-01T14:06:22.234131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 4 messageNo: 31 size 205040 offset: -1
2025-10-01T14:06:22.234164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.234171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.234202Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.234220Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 3 partNo 3 count 4 size 7988778
2025-10-01T14:06:22.234230Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 6247582
2025-10-01T14:06:22.234249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.234275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.234517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 2 size 524288 endOffset 10 max time lag 0ms effective offset 3
2025-10-01T14:06:22.234539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 0 count 0 last offset 0, current partition end offset: 10
2025-10-01T14:06:22.235021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-10-01T14:06:22.235044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 17
2025-10-01T14:06:22.235094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 3 parts_count 15 source 1 size 8295635 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.235106Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-10-01T14:06:22.235132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:22.235135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0'
2025-10-01T14:06:22.235163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.236789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.237101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.237827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 3 count 0 size 1536000 from pos 0 cbcount 3
2025-10-01T14:06:22.238614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.238633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.238706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 33 size: 511959
2025-10-01T14:06:22.238754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 1 messageNo: 33 size: 511959
2025-10-01T14:06:22.238803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 2 messageNo: 33 size: 511959
2025-10-01T14:06:22.238858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 3 messageNo: 33 size: 511959
2025-10-01T14:06:22.238895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size: 205040
2025-10-01T14:06:22.238899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 4 messageNo: 33 size 205040 offset: -1
2025-10-01T14:06:22.238926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.238929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.238948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 3
2025-10-01T14:06:22.238981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 1 count 2 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.238986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:371: Deleting head blob in L1. Partition 0 offset 3 count 2 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.238992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 3 size 8295638 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.238996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 13 count 1 size 717135 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.239016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.239037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.239061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-01T14:06:22.239074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:155: PQ Cache (L2). Removed. Tablet '72075186224037892' partition 0 offset 3 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-01T14:06:22.239083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-01T14:06:22.239086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 13 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-01T14:06:22.239426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.239447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 9011644 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.239454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-10-01T14:06:22.239467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 1, Offset: 10 is stored on disk
2025-10-01T14:06:22.239474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 2, Offset: 10 is stored on disk
2025-10-01T14:06:22.239481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 3, Offset: 10 is stored on disk
2025-10-01T14:06:22.239490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 4, Offset: 10 is stored on disk
2025-10-01T14:06:22.239496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-10-01T14:06:22.239501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 1, Offset: 11 is stored on disk
2025-10-01T14:06:22.239506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 2, Offset: 11 is stored on disk
2025-10-01T14:06:22.239517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 3, Offset: 11 is stored on disk
2025-10-01T14:06:22.239522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 4, Offset: 11 is stored on disk
2025-10-01T14:06:22.239527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-10-01T14:06:22.239534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 1, Offset: 12 is stored on disk
2025-10-01T14:06:22.239541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 2, Offset: 12 is stored on disk
2025-10-01T14:06:22.239546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 3, Offset: 12 is stored on disk
2025-10-01T14:06:22.239552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 4, Offset: 12 is stored on disk
2025-10-01T14:06:22.239557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-10-01T14:06:22.239562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 1, Offset: 13 is stored on disk
2025-10-01T14:06:22.239567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 2, Offset: 13 is stored on disk
2025-10-01T14:06:22.239573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 3, Offset: 13 is stored on disk
2025-10-01T14:06:22.239578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.239582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 4, Offset: 13 is stored on disk
2025-10-01T14:06:22.239609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.239623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.239625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-01T14:06:22.239647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-01T14:06:22.239658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-01T14:06:22.239661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-01T14:06:22.239664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-01T14:06:22.239667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-01T14:06:22.240170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 2253230 count 1 nextOffset 15 batches 5
2025-10-01T14:06:22.240182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-01T14:06:22.240186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-01T14:06:22.240189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-01T14:06:22.240192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-01T14:06:22.240193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-01T14:06:22.240675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 4506428 count 2 nextOffset 16 batches 9
2025-10-01T14:06:22.240688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-01T14:06:22.240694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-01T14:06:22.240697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-01T14:06:22.240699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-01T14:06:22.240702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-01T14:06:22.241333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 0 PackedSize 6759626 count 3 nextOffset 17 batches 13
2025-10-01T14:06:22.241345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.241442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 14,3 HeadOffset 14 endOffset 14 curOffset 17 d0000000000_00000000000000000014_00000_0000000003_00012? size 6759616 WTime 1759327582241
2025-10-01T14:06:22.244079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:06:22.244121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 18
2025-10-01T14:06:22.244144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: __TMP__REQUEST__MARKER__
2025-10-01T14:06:22.244155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.244616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.244647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.244657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.244662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.244667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.244186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 11
2025-10-01T14:06:22.244203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 12
2025-10-01T14:06:22.244215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-10-01T14:06:22.244229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 14
2025-10-01T14:06:22.244249Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.244262Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 0 count 3 size 6759616
2025-10-01T14:06:22.244335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 3 count 1 size 26214400 endOffset 14 max time lag 0ms effective offset 3
2025-10-01T14:06:22.244340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 0 blobs, size 0 count 0 last offset 3, current partition end offset: 14
2025-10-01T14:06:22.245006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1092: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. All data is from uncompacted head.
2025-10-01T14:06:22.245013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 0 blobs
2025-10-01T14:06:22.245052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: __TMP__REQUEST__MARKER__ cookie: 3
2025-10-01T14:06:22.246109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 31 queued_in_partition_duration_ms: 9 }
2025-10-01T14:06:22.246125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 11
2025-10-01T14:06:22.246130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275218[B]
2025-10-01T14:06:22.246210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 30 queued_in_partition_duration_ms: 6 }
2025-10-01T14:06:22.246212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 12
2025-10-01T14:06:22.246550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 21 to 21
2025-10-01T14:06:22.246721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.246876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.246891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 21
2025-10-01T14:06:22.247007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.247310Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 14 Result { Offset: 3 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 4 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582134 CreateTimestampMS: 1759327582098 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23350993 RealReadOffset: 3 WaitQuotaTimeMs: 0 EndOffset: 14 StartOffset: 0 } Cookie: 3 }
2025-10-01T14:06:22.247600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.247625Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 4 endOffset 14
2025-10-01T14:06:22.247620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.247656Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 14 ReadOffset 4 ReadGuid 7d38fbe1-96790129-a65e24b-64f3e350 has messages 1
2025-10-01T14:06:22.247687Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 4, endOffset# 14, WTime# 1759327582134, sizeLag# 23350993
2025-10-01T14:06:22.247698Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1TEvPartitionReady. Aval parts: 0
2025-10-01T14:06:22.247698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size: 511959
2025-10-01T14:06:22.247715Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 read done: guid# 7d38fbe1-96790129-a65e24b-64f3e350, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 2252976
2025-10-01T14:06:22.247731Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 response to read: guid# 7d38fbe1-96790129-a65e24b-64f3e350
2025-10-01T14:06:22.247754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 1 messageNo: 35 size: 511959
2025-10-01T14:06:22.248251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 2 messageNo: 35 size: 511959
2025-10-01T14:06:22.248672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 3 messageNo: 35 size: 511959
2025-10-01T14:06:22.248709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size: 205040
2025-10-01T14:06:22.248713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 4 messageNo: 35 size 205040 offset: -1
2025-10-01T14:06:22.248741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.248752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.248764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.248980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.249642Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.249898Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 Process answer. Aval parts: 1
2025-10-01T14:06:22.248803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.248820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-10-01T14:06:22.250968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.251178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 5 }
2025-10-01T14:06:22.251191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 13
2025-10-01T14:06:22.251261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.251315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 29 queued_in_partition_duration_ms: 4 }
2025-10-01T14:06:22.251320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 14
2025-10-01T14:06:22.251385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.251403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.251442Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got ReadResponse, serverBytesSize = 2252976, now ReadSizeBudget = 0, ReadSizeServerDelta = -1728688
2025-10-01T14:06:22.251475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 37 size: 511959
2025-10-01T14:06:22.251525Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (3-3)
2025-10-01T14:06:22.251538Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 2252976 to budget
2025-10-01T14:06:22.251530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 1 messageNo: 37 size: 511959
2025-10-01T14:06:22.251675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 2 messageNo: 37 size: 511959
2025-10-01T14:06:22.251725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 3 messageNo: 37 size: 511959
2025-10-01T14:06:22.251764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size: 205040
2025-10-01T14:06:22.251773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 4 messageNo: 37 size 205040 offset: -1
2025-10-01T14:06:22.251791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.251811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.252383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 22 to 22
2025-10-01T14:06:22.252680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.252691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 22
2025-10-01T14:06:22.252805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.252820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.252844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 20
2025-10-01T14:06:22.252958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.253058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.253069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 6247582 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.253094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.253098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 2 parts 5 suffix '124' size 2970331
2025-10-01T14:06:22.253102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-01T14:06:22.253103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 5 partno 0 count 2 parts 8 suffix '63' size 4506416
2025-10-01T14:06:22.253107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-01T14:06:22.253111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 0 count 3 parts 12 suffix '63' size 6759613
2025-10-01T14:06:22.253114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-01T14:06:22.253960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.253974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000010_00000_0000000003_00015?
2025-10-01T14:06:22.253978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000013_00003_0000000001_00001?
2025-10-01T14:06:22.253981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 9012773 bytes (9012773)
2025-10-01T14:06:22.253984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-01T14:06:22.253998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 5 size 4506416 cause it's been evicted from L2. Actual L1 size: 7
2025-10-01T14:06:22.254007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 2970331 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.254009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 6759613 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.254014Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.254031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-01T14:06:22.254034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000010_00000_0000000003_00015?
2025-10-01T14:06:22.254046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000013_00003_0000000001_00001?
2025-10-01T14:06:22.254058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-01T14:06:22.254066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 10 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.254070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 13 partno 3 count 1 parts_count 1 source 1 size 717135 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.254080Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-01T14:06:22.254100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:22.254122Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (3-3)
2025-10-01T14:06:22.254110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000010_00000_0000000003_00015?
2025-10-01T14:06:22.254148Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.254112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.254158Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In ContinueReadingDataImpl, ReadSizeBudget = 2252976, ReadSizeServerDelta = -1728688
2025-10-01T14:06:22.254241Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:06:22.254251Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:06:22.254234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-10-01T14:06:22.254323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 3 parts 15 suffix '63'
2025-10-01T14:06:22.254333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 13 partno 3 count 1 parts 1 suffix '63'
2025-10-01T14:06:22.254351Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 grpc read done: success# 1, data# { read_request { bytes_size: 2252976 } }
2025-10-01T14:06:22.254444Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 got read request: guid# ffe5cc1a-abbe1f75-6678041a-7916166f
2025-10-01T14:06:22.254469Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 performing read request: guid# b0b73f40-184bf876-99248eb5-484318ff, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 12, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:06:22.254497Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 12 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 4 EndOffset 14 ClientCommitOffset 0 committedOffset 0 Guid b0b73f40-184bf876-99248eb5-484318ff
2025-10-01T14:06:22.254757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.255034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-10-01T14:06:22.098000Z WriteTime: 2025-10-01T14:06:22.134000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:51196", "_ip": "ipv6:[::1]:51196" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.257697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 23 to 23
2025-10-01T14:06:22.254424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 1
2025-10-01T14:06:22.254716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 2
2025-10-01T14:06:22.254897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 3
2025-10-01T14:06:22.255074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 4
2025-10-01T14:06:22.257988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.257999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 23
2025-10-01T14:06:22.258948Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.261297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 24 to 24
2025-10-01T14:06:22.261603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.261613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 24
2025-10-01T14:06:22.262627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.262669Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.263573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 11 partNo 4 result is x0000000000_00000000000000000007_00001_0000000003_00015 size 8295579
2025-10-01T14:06:22.263595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000007_00001_0000000003_00015 new key d0000000000_00000000000000000007_00001_0000000003_00015 size 8295579 WTime 1759327582263
2025-10-01T14:06:22.263620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 11 partNo 4 FormedBlobsCount 1 NewHead: Offset 10 PartNo 4 PackedSize 205118 count 1 nextOffset 11 batches 1
2025-10-01T14:06:22.263630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-10-01T14:06:22.263743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 1
2025-10-01T14:06:22.263865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 2
2025-10-01T14:06:22.263986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 3
2025-10-01T14:06:22.264174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 4
2025-10-01T14:06:22.264934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 12 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 2458316 count 2 nextOffset 12 batches 5
2025-10-01T14:06:22.264958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-10-01T14:06:22.265073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 1
2025-10-01T14:06:22.265199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 2
2025-10-01T14:06:22.265328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 3
2025-10-01T14:06:22.265472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 4
2025-10-01T14:06:22.265937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 13 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 4711514 count 3 nextOffset 13 batches 9
2025-10-01T14:06:22.266274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-10-01T14:06:22.266278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 1
2025-10-01T14:06:22.266283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 2
2025-10-01T14:06:22.266291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000013_00003_0000000001_00001?
2025-10-01T14:06:22.266293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.266424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 3
2025-10-01T14:06:22.266478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 4
2025-10-01T14:06:22.267686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 14 partNo 4 FormedBlobsCount 0 NewHead: Offset 10 PartNo 4 PackedSize 6964712 count 4 nextOffset 14 batches 13
2025-10-01T14:06:22.267773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 10,4 HeadOffset 7 endOffset 10 curOffset 14 d0000000000_00000000000000000010_00004_0000000004_00012| size 6964702 WTime 1759327582267
2025-10-01T14:06:22.272237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.272252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.273111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.273125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.273197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 39 size: 511959
2025-10-01T14:06:22.273256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 1 messageNo: 39 size: 511959
2025-10-01T14:06:22.273315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 2 messageNo: 39 size: 511959
2025-10-01T14:06:22.273374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 3 messageNo: 39 size: 511959
2025-10-01T14:06:22.273409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size: 205040
2025-10-01T14:06:22.273419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 4 messageNo: 39 size 205040 offset: -1
2025-10-01T14:06:22.273444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.273451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.273478Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.273497Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 7 partNo 1 count 3 size 8295579
2025-10-01T14:06:22.273504Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 6964702
2025-10-01T14:06:22.273548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.273576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.273715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 21
2025-10-01T14:06:22.273742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 4 count 12 size 524288 endOffset 14 max time lag 0ms effective offset 4
2025-10-01T14:06:22.273762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 0 count 3 last offset 3, current partition end offset: 14
2025-10-01T14:06:22.273833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.274762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-10-01T14:06:22.274831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 3 partno 3 count 4 parts_count 14 source 1 size 7988778 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.274850Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-10-01T14:06:22.274877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 3 size 6759616 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.274889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:22.274925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0'
2025-10-01T14:06:22.274935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:22.274940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:22.275569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.275857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.276292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 3 totakecount 4 count 1 size 717094 from pos 1 cbcount 2
2025-10-01T14:06:22.276430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.276562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.276691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.276751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 4 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-01T14:06:22.276885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:22.277014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.277138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.277261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.277423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 5 totakecount 4 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:22.277561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.277682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.277805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.277869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 6 totakecount 4 count 1 size 205085 from pos 0 cbcount 1
2025-10-01T14:06:22.277986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:22.278024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.278044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.278049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-10-01T14:06:22.278063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 1, Offset: 14 is stored on disk
2025-10-01T14:06:22.278069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 2, Offset: 14 is stored on disk
2025-10-01T14:06:22.278078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 3, Offset: 14 is stored on disk
2025-10-01T14:06:22.278087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 4, Offset: 14 is stored on disk
2025-10-01T14:06:22.278094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-10-01T14:06:22.278100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 1, Offset: 15 is stored on disk
2025-10-01T14:06:22.278107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 2, Offset: 15 is stored on disk
2025-10-01T14:06:22.278119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 3, Offset: 15 is stored on disk
2025-10-01T14:06:22.278125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 4, Offset: 15 is stored on disk
2025-10-01T14:06:22.278130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-10-01T14:06:22.278139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 1, Offset: 16 is stored on disk
2025-10-01T14:06:22.278146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 2, Offset: 16 is stored on disk
2025-10-01T14:06:22.278151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 3, Offset: 16 is stored on disk
2025-10-01T14:06:22.278157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.278161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 4, Offset: 16 is stored on disk
2025-10-01T14:06:22.278200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.278215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.278217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-01T14:06:22.278237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-01T14:06:22.278249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-01T14:06:22.278252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-01T14:06:22.278256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-01T14:06:22.278260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-01T14:06:22.278676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 2253230 count 1 nextOffset 18 batches 5
2025-10-01T14:06:22.278692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-01T14:06:22.278699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-01T14:06:22.278703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-01T14:06:22.278706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-01T14:06:22.278710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-01T14:06:22.279212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 4506428 count 2 nextOffset 19 batches 9
2025-10-01T14:06:22.279223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-01T14:06:22.279228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-01T14:06:22.279231Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-01T14:06:22.279234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-01T14:06:22.279238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-01T14:06:22.279710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 17 PartNo 0 PackedSize 6759626 count 3 nextOffset 20 batches 13
2025-10-01T14:06:22.279721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.279824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 17,3 HeadOffset 17 endOffset 17 curOffset 20 d0000000000_00000000000000000017_00000_0000000003_00012? size 6759616 WTime 1759327582279
2025-10-01T14:06:22.285639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:06:22.287056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.287097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.287104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.287478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 38 queued_in_partition_duration_ms: 18 }
2025-10-01T14:06:22.287492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 15
2025-10-01T14:06:22.287497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275218[B]
2025-10-01T14:06:22.287850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 25 to 25
2025-10-01T14:06:22.288159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.288172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 25
2025-10-01T14:06:22.285683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 0 size 8295635 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.285691Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.286529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.286538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.286613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 41 size: 511959
2025-10-01T14:06:22.286662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 1 messageNo: 41 size: 511959
2025-10-01T14:06:22.286713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 2 messageNo: 41 size: 511959
2025-10-01T14:06:22.286767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 3 messageNo: 41 size: 511959
2025-10-01T14:06:22.286799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size: 205040
2025-10-01T14:06:22.286803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 4 messageNo: 41 size 205040 offset: -1
2025-10-01T14:06:22.286828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.286833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.286870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 4
2025-10-01T14:06:22.286911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 15
2025-10-01T14:06:22.286939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 16
2025-10-01T14:06:22.286951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 17
2025-10-01T14:06:22.286973Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.286987Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 17 partNo 0 count 3 size 6759616
2025-10-01T14:06:22.286994Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000005_00000_0000000002_00008?(+) to d0000000000_00000000000000000005_00000_0000000002_00008?(+)
2025-10-01T14:06:22.286996Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00000_0000000003_00012?(+) to d0000000000_00000000000000000007_00000_0000000003_00012?(+)
2025-10-01T14:06:22.286999Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000003_00003_0000000002_00005|(+) to d0000000000_00000000000000000003_00003_0000000002_00005|(+)
2025-10-01T14:06:22.287012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.287033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.289596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 22
2025-10-01T14:06:22.289979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.290026Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.290424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 5 }
2025-10-01T14:06:22.290436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 16
2025-10-01T14:06:22.290441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275218[B]
2025-10-01T14:06:22.290531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 37 queued_in_partition_duration_ms: 1 }
2025-10-01T14:06:22.290535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 17
2025-10-01T14:06:22.291522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.292583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.292595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 6964702 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.292619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.292630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 11 suffix '124' size 6247582
2025-10-01T14:06:22.292632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-01T14:06:22.292640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-01T14:06:22.292646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-01T14:06:22.292650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-01T14:06:22.293405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 26 to 26
2025-10-01T14:06:22.293403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.293689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.293704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 26
2025-10-01T14:06:22.293755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.293944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.293960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-01T14:06:22.293963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 6759616 bytes (6759616)
2025-10-01T14:06:22.293971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 6759616 (8388608)
2025-10-01T14:06:22.293986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 6247582 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.293990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.293995Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.294232Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 14 Result { Offset: 4 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 5 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582137 CreateTimestampMS: 1759327582107 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 6 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582151 CreateTimestampMS: 1759327582115 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 7 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582151 CreateTimestampMS: 1759327582123 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 9319940 RealReadOffset: 6 WaitQuotaTimeMs: 0 EndOffset: 14 StartOffset: 0 } Cookie: 4 }
2025-10-01T14:06:22.295144Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 7 endOffset 14
2025-10-01T14:06:22.295171Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 14 ReadOffset 7 ReadGuid b0b73f40-184bf876-99248eb5-484318ff has messages 1
2025-10-01T14:06:22.295189Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.295196Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 7, endOffset# 14, WTime# 1759327582151, sizeLag# 9319940
2025-10-01T14:06:22.295205Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1TEvPartitionReady. Aval parts: 0
2025-10-01T14:06:22.295220Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 read done: guid# b0b73f40-184bf876-99248eb5-484318ff, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6758777
2025-10-01T14:06:22.295230Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 response to read: guid# b0b73f40-184bf876-99248eb5-484318ff
2025-10-01T14:06:22.295361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.296299Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 Process answer. Aval parts: 1
2025-10-01T14:06:22.296951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.297329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.297754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 27 to 27
2025-10-01T14:06:22.298056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.298065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 27
2025-10-01T14:06:22.298558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.299435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.299476Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.294866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.294884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.294971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 43 size: 511959
2025-10-01T14:06:22.295026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 1 messageNo: 43 size: 511959
2025-10-01T14:06:22.295084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 2 messageNo: 43 size: 511959
2025-10-01T14:06:22.295139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 3 messageNo: 43 size: 511959
2025-10-01T14:06:22.295176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size: 205040
2025-10-01T14:06:22.295180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 4 messageNo: 43 size 205040 offset: -1
2025-10-01T14:06:22.295217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.295220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.295230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.295249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.295263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 23
2025-10-01T14:06:22.297857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.297868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.297937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size: 511959
2025-10-01T14:06:22.298184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 1 messageNo: 45 size: 511959
2025-10-01T14:06:22.298234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 2 messageNo: 45 size: 511959
2025-10-01T14:06:22.298284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 3 messageNo: 45 size: 511959
2025-10-01T14:06:22.298318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size: 205040
2025-10-01T14:06:22.298322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 4 messageNo: 45 size 205040 offset: -1
2025-10-01T14:06:22.298348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.298351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.298360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.298398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.298410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-10-01T14:06:22.303308Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got ReadResponse, serverBytesSize = 6758777, now ReadSizeBudget = 0, ReadSizeServerDelta = -6234489
2025-10-01T14:06:22.303392Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (4-4)
2025-10-01T14:06:22.303406Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 6758777 to budget
2025-10-01T14:06:22.302495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.302807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.303210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.304819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.305113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.306265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.302276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.302294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.302364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 47 size: 511959
2025-10-01T14:06:22.302434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 1 messageNo: 47 size: 511959
2025-10-01T14:06:22.302487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 2 messageNo: 47 size: 511959
2025-10-01T14:06:22.302536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 3 messageNo: 47 size: 511959
2025-10-01T14:06:22.302577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size: 205040
2025-10-01T14:06:22.302582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 4 messageNo: 47 size 205040 offset: -1
2025-10-01T14:06:22.302603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.302620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.303023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.303027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.303042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 25
2025-10-01T14:06:22.305611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.305617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.305731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 49 size: 511959
2025-10-01T14:06:22.305785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 1 messageNo: 49 size: 511959
2025-10-01T14:06:22.305838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 2 messageNo: 49 size: 511959
2025-10-01T14:06:22.305896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 3 messageNo: 49 size: 511959
2025-10-01T14:06:22.305928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size: 205040
2025-10-01T14:06:22.305933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 4 messageNo: 49 size 205040 offset: -1
2025-10-01T14:06:22.305955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.305958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.306037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.306051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.306107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 17 count 3 size 6759616 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.306126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 26
2025-10-01T14:06:22.306133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.306151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.306156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 13 partno 3 count 1 parts 1 suffix '63' size 717135
2025-10-01T14:06:22.306165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-10-01T14:06:22.306167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-01T14:06:22.306171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:22.306170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 1, Offset: 17 is stored on disk
2025-10-01T14:06:22.306177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 2, Offset: 17 is stored on disk
2025-10-01T14:06:22.306184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 3, Offset: 17 is stored on disk
2025-10-01T14:06:22.306192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 4, Offset: 17 is stored on disk
2025-10-01T14:06:22.306199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-10-01T14:06:22.306204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 1, Offset: 18 is stored on disk
2025-10-01T14:06:22.306208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 2, Offset: 18 is stored on disk
2025-10-01T14:06:22.306214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 3, Offset: 18 is stored on disk
2025-10-01T14:06:22.306219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 4, Offset: 18 is stored on disk
2025-10-01T14:06:22.306225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-10-01T14:06:22.306232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 1, Offset: 19 is stored on disk
2025-10-01T14:06:22.306240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 2, Offset: 19 is stored on disk
2025-10-01T14:06:22.306248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 3, Offset: 19 is stored on disk
2025-10-01T14:06:22.306253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.306256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 4, Offset: 19 is stored on disk
2025-10-01T14:06:22.306295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.306311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.306313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-10-01T14:06:22.306333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-01T14:06:22.306344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-01T14:06:22.306348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-01T14:06:22.306351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-01T14:06:22.306354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-01T14:06:22.306763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2253230 count 1 nextOffset 21 batches 5
2025-10-01T14:06:22.306792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-01T14:06:22.306798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-01T14:06:22.306801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-01T14:06:22.306805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-01T14:06:22.307923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.306809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-01T14:06:22.307278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 4506428 count 2 nextOffset 22 batches 9
2025-10-01T14:06:22.307290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-01T14:06:22.307295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-01T14:06:22.307299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-01T14:06:22.307302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-01T14:06:22.307306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-01T14:06:22.307758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 6759626 count 3 nextOffset 23 batches 13
2025-10-01T14:06:22.307776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-01T14:06:22.307781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-01T14:06:22.307784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-01T14:06:22.307788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-01T14:06:22.308175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.310177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 24 partNo 3 result is x0000000000_00000000000000000020_00000_0000000003_00015? size 8295638
2025-10-01T14:06:22.310200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-01T14:06:22.310213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000020_00000_0000000003_00015? new key d0000000000_00000000000000000020_00000_0000000003_00015? size 8295638 WTime 1759327582309
2025-10-01T14:06:22.310331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 4 FormedBlobsCount 1 NewHead: Offset 23 PartNo 3 PackedSize 717145 count 1 nextOffset 24 batches 2
2025-10-01T14:06:22.310347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-01T14:06:22.310354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-01T14:06:22.310358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-01T14:06:22.310361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-01T14:06:22.310364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-01T14:06:22.311583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.311624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.311633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.312122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 29 }
2025-10-01T14:06:22.312139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 18
2025-10-01T14:06:22.312145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275218[B]
2025-10-01T14:06:22.312257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 27 queued_in_partition_duration_ms: 27 }
2025-10-01T14:06:22.312270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 19
2025-10-01T14:06:22.312546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 28 to 28
2025-10-01T14:06:22.312842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.312867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 28
2025-10-01T14:06:22.313426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.314319Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (4-4)
2025-10-01T14:06:22.314338Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.314389Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (5-5)
2025-10-01T14:06:22.314403Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:06:22.310889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 23 PartNo 3 PackedSize 2970343 count 2 nextOffset 25 batches 6
2025-10-01T14:06:22.310910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.311022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 23,2 HeadOffset 20 endOffset 20 curOffset 25 d0000000000_00000000000000000023_00003_0000000002_00005? size 2970333 WTime 1759327582310
2025-10-01T14:06:22.311377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-01T14:06:22.311380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000017_00000_0000000003_00012?
2025-10-01T14:06:22.311383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 13519232 bytes (13519232)
2025-10-01T14:06:22.311386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-01T14:06:22.311433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.311437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 13 size 717135 cause it's been evicted from L2. Actual L1 size: 4
2025-10-01T14:06:22.311441Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.311460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-10-01T14:06:22.311498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 19
2025-10-01T14:06:22.311513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 20
2025-10-01T14:06:22.312768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.312775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.312864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 51 size: 511959
2025-10-01T14:06:22.312914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 1 messageNo: 51 size: 511959
2025-10-01T14:06:22.312966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 2 messageNo: 51 size: 511959
2025-10-01T14:06:22.313017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 3 messageNo: 51 size: 511959
2025-10-01T14:06:22.313048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size: 205040
2025-10-01T14:06:22.313053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 4 messageNo: 51 size 205040 offset: -1
2025-10-01T14:06:22.313080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.313084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.313092Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.313107Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 20 partNo 0 count 3 size 8295638
2025-10-01T14:06:22.313115Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 23 partNo 3 count 2 size 2970333
2025-10-01T14:06:22.313121Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00000_0000000003_00015?(+) to d0000000000_00000000000000000010_00000_0000000003_00015?(+)
2025-10-01T14:06:22.313123Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000013_00003_0000000001_00001?(+) to d0000000000_00000000000000000013_00003_0000000001_00001?(+)
2025-10-01T14:06:22.313125Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000007_00001_0000000003_00011|(+) to d0000000000_00000000000000000007_00001_0000000003_00011|(+)
2025-10-01T14:06:22.313135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-01T14:06:22.313138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-01T14:06:22.313148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000017_00000_0000000003_00012?
2025-10-01T14:06:22.313159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-01T14:06:22.313189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.313203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.313260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 14 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.313265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 17 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.313282Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-01T14:06:22.313309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 27
2025-10-01T14:06:22.313309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63'
2025-10-01T14:06:22.313314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 3 parts 12 suffix '63'
2025-10-01T14:06:22.313336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:22.313340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000014_00000_0000000003_00012?
2025-10-01T14:06:22.313342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.313453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-10-01T14:06:22.313573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 1
2025-10-01T14:06:22.313697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 2
2025-10-01T14:06:22.315105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 15 partNo 2 result is x0000000000_00000000000000000010_00004_0000000004_00014 size 7988738
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-10-01T14:06:22.107000Z WriteTime: 2025-10-01T14:06:22.137000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:51196", "logtype": "unknown", "_ip": "ipv6:[::1]:51196" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.315233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 3
2025-10-01T14:06:22.315296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.315434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 4
2025-10-01T14:06:22.315452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000010_00004_0000000004_00014 new key d0000000000_00000000000000000010_00004_0000000004_00014 size 7988738 WTime 1759327582315
2025-10-01T14:06:22.315563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.315702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 15 partNo 4 FormedBlobsCount 1 NewHead: Offset 14 PartNo 2 PackedSize 1229172 count 1 nextOffset 15 batches 3
2025-10-01T14:06:22.315717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-10-01T14:06:22.315857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 1
2025-10-01T14:06:22.315881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 5 }
2025-10-01T14:06:22.315904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 20
2025-10-01T14:06:22.315998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 2
2025-10-01T14:06:22.316171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 3
2025-10-01T14:06:22.316350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 4
2025-10-01T14:06:22.316926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 16 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 3482370 count 2 nextOffset 16 batches 7
2025-10-01T14:06:22.316942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-10-01T14:06:22.317059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 1
2025-10-01T14:06:22.317199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 2
2025-10-01T14:06:22.317334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 3
2025-10-01T14:06:22.317401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 4
2025-10-01T14:06:22.317855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 17 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 5735568 count 3 nextOffset 17 batches 11
2025-10-01T14:06:22.317874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000017_00000_0000000003_00012?
2025-10-01T14:06:22.317879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.318001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-10-01T14:06:22.318142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 1
2025-10-01T14:06:22.318289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 2
2025-10-01T14:06:22.318445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 3
2025-10-01T14:06:22.318643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 4
2025-10-01T14:06:22.319152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 29 to 29
2025-10-01T14:06:22.319167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 18 partNo 4 FormedBlobsCount 0 NewHead: Offset 14 PartNo 2 PackedSize 7988766 count 4 nextOffset 18 batches 15
2025-10-01T14:06:22.319187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-10-01T14:06:22.319413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.319424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 29
2025-10-01T14:06:22.320592Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.323759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 30 to 30
2025-10-01T14:06:22.324038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.324049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 30
2025-10-01T14:06:22.324701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 19 partNo 0 result is x0000000000_00000000000000000014_00002_0000000004_00014 size 7988756
2025-10-01T14:06:22.324971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.325435Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (5-5)
2025-10-01T14:06:22.325451Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.325500Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (6-6)
2025-10-01T14:06:22.325516Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-10-01T14:06:22.115000Z WriteTime: 2025-10-01T14:06:22.151000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:51196", "_ip": "ipv6:[::1]:51196", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.324848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 1
2025-10-01T14:06:22.325003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 2
2025-10-01T14:06:22.325139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 3
2025-10-01T14:06:22.325465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 4
2025-10-01T14:06:22.325487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000014_00002_0000000004_00014 new key d0000000000_00000000000000000014_00002_0000000004_00014 size 7988756 WTime 1759327582325
2025-10-01T14:06:22.325859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 19 partNo 4 FormedBlobsCount 1 NewHead: Offset 18 PartNo 0 PackedSize 2253230 count 1 nextOffset 19 batches 5
2025-10-01T14:06:22.325870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-10-01T14:06:22.325992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 1
2025-10-01T14:06:22.326132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 2
2025-10-01T14:06:22.326271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 3
2025-10-01T14:06:22.326335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 4
2025-10-01T14:06:22.326896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 20 partNo 4 FormedBlobsCount 0 NewHead: Offset 18 PartNo 0 PackedSize 4506428 count 2 nextOffset 20 batches 9
2025-10-01T14:06:22.326999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 18,2 HeadOffset 10 endOffset 14 curOffset 20 d0000000000_00000000000000000018_00000_0000000002_00008| size 4506418 WTime 1759327582326
2025-10-01T14:06:22.331462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.331482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.331562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 53 size: 511959
2025-10-01T14:06:22.331626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 1 messageNo: 53 size: 511959
2025-10-01T14:06:22.331687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 2 messageNo: 53 size: 511959
2025-10-01T14:06:22.331744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 3 messageNo: 53 size: 511959
2025-10-01T14:06:22.331779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size: 205040
2025-10-01T14:06:22.331791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 4 messageNo: 53 size 205040 offset: -1
2025-10-01T14:06:22.331824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.331832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.331849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.331878Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.331898Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 10 partNo 4 count 4 size 7988738
2025-10-01T14:06:22.331911Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 14 partNo 2 count 4 size 7988756
2025-10-01T14:06:22.331923Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 2 size 4506418
2025-10-01T14:06:22.331936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.331955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.331964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:194: [72075186224037892][Partition][0][StateIdle] Reserve processing: maxWriteInflightSize riched. Partition: 0
2025-10-01T14:06:22.333077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 20 count 3 size 8295638 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.333086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 23 count 2 size 2970333 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.333105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.333125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 11264555 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.333135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-01T14:06:22.333146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-10-01T14:06:22.333146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-01T14:06:22.333150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 23 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-01T14:06:22.333152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 1, Offset: 20 is stored on disk
2025-10-01T14:06:22.333159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 2, Offset: 20 is stored on disk
2025-10-01T14:06:22.333165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 3, Offset: 20 is stored on disk
2025-10-01T14:06:22.333179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 4, Offset: 20 is stored on disk
2025-10-01T14:06:22.333189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-10-01T14:06:22.333195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 1, Offset: 21 is stored on disk
2025-10-01T14:06:22.333200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 2, Offset: 21 is stored on disk
2025-10-01T14:06:22.333206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 3, Offset: 21 is stored on disk
2025-10-01T14:06:22.333221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 4, Offset: 21 is stored on disk
2025-10-01T14:06:22.333229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-10-01T14:06:22.333234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 1, Offset: 22 is stored on disk
2025-10-01T14:06:22.333240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 2, Offset: 22 is stored on disk
2025-10-01T14:06:22.333245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 3, Offset: 22 is stored on disk
2025-10-01T14:06:22.333250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 4, Offset: 22 is stored on disk
2025-10-01T14:06:22.333255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-10-01T14:06:22.333260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 1, Offset: 23 is stored on disk
2025-10-01T14:06:22.333264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 2, Offset: 23 is stored on disk
2025-10-01T14:06:22.333280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 3, Offset: 23 is stored on disk
2025-10-01T14:06:22.333285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 4, Offset: 23 is stored on disk
2025-10-01T14:06:22.333290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-10-01T14:06:22.333294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 1, Offset: 24 is stored on disk
2025-10-01T14:06:22.333300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 2, Offset: 24 is stored on disk
2025-10-01T14:06:22.333306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 3, Offset: 24 is stored on disk
2025-10-01T14:06:22.333317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.333320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 4, Offset: 24 is stored on disk
2025-10-01T14:06:22.333368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.333385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.333387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-01T14:06:22.333406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-01T14:06:22.333416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-01T14:06:22.333419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-01T14:06:22.333422Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-01T14:06:22.333433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-01T14:06:22.333843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 2253230 count 1 nextOffset 26 batches 5
2025-10-01T14:06:22.333865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-01T14:06:22.333869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-01T14:06:22.333871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-01T14:06:22.333873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-01T14:06:22.333875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-01T14:06:22.334354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 4506428 count 2 nextOffset 27 batches 9
2025-10-01T14:06:22.334385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.334478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,2 HeadOffset 25 endOffset 25 curOffset 27 d0000000000_00000000000000000025_00000_0000000002_00008? size 4506418 WTime 1759327582334
2025-10-01T14:06:22.338280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:06:22.338335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295579 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.338348Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.338366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 21
2025-10-01T14:06:22.338461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 22
2025-10-01T14:06:22.338478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-10-01T14:06:22.338499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 24
2025-10-01T14:06:22.338514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 25
2025-10-01T14:06:22.338527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 28
2025-10-01T14:06:22.338570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.338611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.338617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.338622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.338628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.338624Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.338634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.338640Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 2 size 4506418
2025-10-01T14:06:22.340835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 19 }
2025-10-01T14:06:22.340860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 21
2025-10-01T14:06:22.340865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275218[B]
2025-10-01T14:06:22.340544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.340943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 11 }
2025-10-01T14:06:22.340947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 22
2025-10-01T14:06:22.340828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.340968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 26 queued_in_partition_duration_ms: 10 }
2025-10-01T14:06:22.340971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 23
2025-10-01T14:06:22.340988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 25 queued_in_partition_duration_ms: 5 }
2025-10-01T14:06:22.340991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 24
2025-10-01T14:06:22.341008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 4 }
2025-10-01T14:06:22.341011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 25
2025-10-01T14:06:22.341215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.341239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.341323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size: 511959
2025-10-01T14:06:22.341339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 31 to 31
2025-10-01T14:06:22.341387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 1 messageNo: 55 size: 511959
2025-10-01T14:06:22.341458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 2 messageNo: 55 size: 511959
2025-10-01T14:06:22.341522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 3 messageNo: 55 size: 511959
2025-10-01T14:06:22.341577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size: 205040
2025-10-01T14:06:22.341590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 4 messageNo: 55 size 205040 offset: -1
2025-10-01T14:06:22.341622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.341630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.341642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.341665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.341666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.341678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 31
2025-10-01T14:06:22.341685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-10-01T14:06:22.341786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.342775Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.343552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.343856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.344229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.344247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.344323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 57 size: 511959
2025-10-01T14:06:22.344381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 1 messageNo: 57 size: 511959
2025-10-01T14:06:22.344451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 2 messageNo: 57 size: 511959
2025-10-01T14:06:22.344505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 3 messageNo: 57 size: 511959
2025-10-01T14:06:22.344546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size: 205040
2025-10-01T14:06:22.344554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 4 messageNo: 57 size 205040 offset: -1
2025-10-01T14:06:22.344577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.344584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.344598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.344625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.344641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 30
2025-10-01T14:06:22.344766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.345930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 32 to 32
2025-10-01T14:06:22.346249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.346260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 32
2025-10-01T14:06:22.346643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.346832Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (6-6)
2025-10-01T14:06:22.346852Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.346862Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In ContinueReadingDataImpl, ReadSizeBudget = 6758777, ReadSizeServerDelta = -6234489
2025-10-01T14:06:22.346983Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:06:22.346995Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:06:22.346985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.347111Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 grpc read done: success# 1, data# { read_request { bytes_size: 6758777 } }
2025-10-01T14:06:22.347171Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 got read request: guid# 41416fa7-8ae24ad4-3030fefe-55967dad
2025-10-01T14:06:22.347194Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 performing read request: guid# ca10db97-fab4c7d9-11105967-c4c72422, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:06:22.347223Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 7 EndOffset 14 ClientCommitOffset 0 committedOffset 0 Guid ca10db97-fab4c7d9-11105967-c4c72422
2025-10-01T14:06:22.347194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.347208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.347279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 59 size: 511959
2025-10-01T14:06:22.347397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 1 messageNo: 59 size: 511959
2025-10-01T14:06:22.347464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 2 messageNo: 59 size: 511959
2025-10-01T14:06:22.347525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 3 messageNo: 59 size: 511959
2025-10-01T14:06:22.347571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size: 205040
2025-10-01T14:06:22.347579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 4 messageNo: 59 size 205040 offset: -1
2025-10-01T14:06:22.347603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.347609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.347628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.347634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.347649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.347674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.347695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 31
2025-10-01T14:06:22.347729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 7 count 8 size 524288 endOffset 25 max time lag 0ms effective offset 7
2025-10-01T14:06:22.347771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 2 blobs, size 8295579 count 3 last offset 7, current partition end offset: 25
2025-10-01T14:06:22.347809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.347911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-10-01T14:06:22.347926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 3 partno 3 count 4 parts_count 14 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.347929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 1 count 3 parts_count 15 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.347941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 9. Have to read 2 of 2 from KV
2025-10-01T14:06:22.347959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 3 partno 3 count 4 parts_count 14
2025-10-01T14:06:22.347966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 1 count 3 parts_count 15
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-10-01T14:06:22.123000Z WriteTime: 2025-10-01T14:06:22.151000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:51196", "_ip": "ipv6:[::1]:51196", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.349382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.349654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.349919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.349934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.349989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 61 size: 511959
2025-10-01T14:06:22.350053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 1 messageNo: 61 size: 511959
2025-10-01T14:06:22.350107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 2 messageNo: 61 size: 511959
2025-10-01T14:06:22.350161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 3 messageNo: 61 size: 511959
2025-10-01T14:06:22.350196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size: 205040
2025-10-01T14:06:22.350203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 4 messageNo: 61 size 205040 offset: -1
2025-10-01T14:06:22.350223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.350230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.350240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.350264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.350282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 32
2025-10-01T14:06:22.350334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.350548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.350559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 14 count 4 size 7988756 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.350571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 2 size 4506418 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.350586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.350593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-01T14:06:22.350603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 12 suffix '124' size 6964702
2025-10-01T14:06:22.350608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-01T14:06:22.350615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:22.350620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 17 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:22.350627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-01T14:06:22.350631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-01T14:06:22.351293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 33 to 33
2025-10-01T14:06:22.351320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.351337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000020_00000_0000000003_00015?
2025-10-01T14:06:22.351342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000023_00003_0000000002_00005?
2025-10-01T14:06:22.351345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 11265971 bytes (11265971)
2025-10-01T14:06:22.351348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-01T14:06:22.351362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 17 size 6759616 cause it's been evicted from L2. Actual L1 size: 7
2025-10-01T14:06:22.351365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 6759616 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.351367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 6964702 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.351371Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.351385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-01T14:06:22.351387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000020_00000_0000000003_00015?
2025-10-01T14:06:22.351398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000023_00003_0000000002_00005?
2025-10-01T14:06:22.351416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-01T14:06:22.351428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 20 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.351435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 23 partno 3 count 2 parts_count 5 source 1 size 2970333 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.351447Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 0. All 2 blobs are from cache.
2025-10-01T14:06:22.351472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:22.351480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000020_00000_0000000003_00015?
2025-10-01T14:06:22.351482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.351490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 3 parts 15 suffix '63'
2025-10-01T14:06:22.351501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 23 partno 3 count 2 parts 5 suffix '63'
2025-10-01T14:06:22.351608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.351618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 33
2025-10-01T14:06:22.351615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-10-01T14:06:22.351758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 1
2025-10-01T14:06:22.351904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 2
2025-10-01T14:06:22.352050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 3
2025-10-01T14:06:22.352250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 4
2025-10-01T14:06:22.352667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 21 partNo 4 FormedBlobsCount 0 NewHead: Offset 20 PartNo 0 PackedSize 2253230 count 1 nextOffset 21 batches 5
2025-10-01T14:06:22.352688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-10-01T14:06:22.352751Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.352824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 1
2025-10-01T14:06:22.352993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 2
2025-10-01T14:06:22.353153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 3
2025-10-01T14:06:22.355276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 34 to 34
2025-10-01T14:06:22.355402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 22 partNo 3 result is x0000000000_00000000000000000018_00000_0000000003_00015 size 8295660
2025-10-01T14:06:22.355576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.355543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.355585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 34
2025-10-01T14:06:22.355633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 4
2025-10-01T14:06:22.355664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000018_00000_0000000003_00015 new key d0000000000_00000000000000000018_00000_0000000003_00015 size 8295660 WTime 1759327582355
2025-10-01T14:06:22.355796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 22 partNo 4 FormedBlobsCount 1 NewHead: Offset 21 PartNo 3 PackedSize 717145 count 1 nextOffset 22 batches 2
2025-10-01T14:06:22.355811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-10-01T14:06:22.355909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.355942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 1
2025-10-01T14:06:22.356088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 2
2025-10-01T14:06:22.356244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 3
2025-10-01T14:06:22.356332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 4
2025-10-01T14:06:22.356733Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.356864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 23 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 2970343 count 2 nextOffset 23 batches 6
2025-10-01T14:06:22.357310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-10-01T14:06:22.357327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 1
2025-10-01T14:06:22.357330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 2
2025-10-01T14:06:22.357339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000023_00003_0000000002_00005?
2025-10-01T14:06:22.357342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.357496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 3
2025-10-01T14:06:22.357691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 4
2025-10-01T14:06:22.358272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 24 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 5223541 count 3 nextOffset 24 batches 10
2025-10-01T14:06:22.358293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-10-01T14:06:22.358662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 1
2025-10-01T14:06:22.358823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 2
2025-10-01T14:06:22.358988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 3
2025-10-01T14:06:22.359061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 4
2025-10-01T14:06:22.359340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 35 to 35
2025-10-01T14:06:22.359589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 25 partNo 4 FormedBlobsCount 0 NewHead: Offset 21 PartNo 3 PackedSize 7476739 count 4 nextOffset 25 batches 14
2025-10-01T14:06:22.359687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.359698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 35
2025-10-01T14:06:22.359689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 21,4 HeadOffset 18 endOffset 20 curOffset 25 d0000000000_00000000000000000021_00003_0000000004_00013| size 7476729 WTime 1759327582359
2025-10-01T14:06:22.362267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.362300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.362294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.362353Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.362411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size: 511959
2025-10-01T14:06:22.362469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 1 messageNo: 63 size: 511959
2025-10-01T14:06:22.362539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 2 messageNo: 63 size: 511959
2025-10-01T14:06:22.362606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 3 messageNo: 63 size: 511959
2025-10-01T14:06:22.362646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size: 205040
2025-10-01T14:06:22.362655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 4 messageNo: 63 size 205040 offset: -1
2025-10-01T14:06:22.362686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.362699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.362731Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.362744Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 18 partNo 0 count 3 size 8295660
2025-10-01T14:06:22.362751Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7476729
2025-10-01T14:06:22.362761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.362785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.362978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-10-01T14:06:22.363086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.364837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.365274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.365391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.365410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.365862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size: 511959
2025-10-01T14:06:22.365924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 1 messageNo: 65 size: 511959
2025-10-01T14:06:22.365981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 2 messageNo: 65 size: 511959
2025-10-01T14:06:22.366451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 3 messageNo: 65 size: 511959
2025-10-01T14:06:22.366500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size: 205040
2025-10-01T14:06:22.366511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 4 messageNo: 65 size 205040 offset: -1
2025-10-01T14:06:22.366541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.366551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.366561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.366590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.366609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-10-01T14:06:22.366701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.367672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 2 size 4506418 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.367701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.367718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.367723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-01T14:06:22.367730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-10-01T14:06:22.367731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:22.367733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 1, Offset: 25 is stored on disk
2025-10-01T14:06:22.367738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 2, Offset: 25 is stored on disk
2025-10-01T14:06:22.367742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 3, Offset: 25 is stored on disk
2025-10-01T14:06:22.367749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 4, Offset: 25 is stored on disk
2025-10-01T14:06:22.367753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-10-01T14:06:22.367758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 1, Offset: 26 is stored on disk
2025-10-01T14:06:22.367764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 2, Offset: 26 is stored on disk
2025-10-01T14:06:22.367768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 3, Offset: 26 is stored on disk
2025-10-01T14:06:22.367773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.367775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 4, Offset: 26 is stored on disk
2025-10-01T14:06:22.367808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.367827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.367832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (30)
2025-10-01T14:06:22.367847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-01T14:06:22.367858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-01T14:06:22.367864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-01T14:06:22.367866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-01T14:06:22.367868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-01T14:06:22.368258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.368315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 2253230 count 1 nextOffset 28 batches 5
2025-10-01T14:06:22.368340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-01T14:06:22.368346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-01T14:06:22.368350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-01T14:06:22.368353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-01T14:06:22.368358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-01T14:06:22.368521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.368965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 4506428 count 2 nextOffset 29 batches 9
2025-10-01T14:06:22.368986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-01T14:06:22.368992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-01T14:06:22.368995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-01T14:06:22.368997Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-01T14:06:22.369000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-01T14:06:22.369490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 27 PartNo 0 PackedSize 6759626 count 3 nextOffset 30 batches 13
2025-10-01T14:06:22.369515Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-01T14:06:22.369520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-01T14:06:22.369524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-01T14:06:22.369527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-01T14:06:22.377301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 31 partNo 3 result is x0000000000_00000000000000000027_00000_0000000003_00015? size 8295638
2025-10-01T14:06:22.377328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-01T14:06:22.377346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000027_00000_0000000003_00015? new key d0000000000_00000000000000000027_00000_0000000003_00015? size 8295638 WTime 1759327582376
2025-10-01T14:06:22.377459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 4 FormedBlobsCount 1 NewHead: Offset 30 PartNo 3 PackedSize 717145 count 1 nextOffset 31 batches 2
2025-10-01T14:06:22.377478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-10-01T14:06:22.377489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 1
2025-10-01T14:06:22.377492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 2
2025-10-01T14:06:22.377495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 3
2025-10-01T14:06:22.377499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 4
2025-10-01T14:06:22.377942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 3 PackedSize 2970343 count 2 nextOffset 32 batches 6
2025-10-01T14:06:22.377969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-10-01T14:06:22.377975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 1
2025-10-01T14:06:22.377979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 2
2025-10-01T14:06:22.377982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 3
2025-10-01T14:06:22.377986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 4
2025-10-01T14:06:22.378828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 3 PackedSize 5223541 count 3 nextOffset 33 batches 10
2025-10-01T14:06:22.378852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.378940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 30,3 HeadOffset 27 endOffset 27 curOffset 33 d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531 WTime 1759327582378
2025-10-01T14:06:22.380658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:06:22.380723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988738 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.380732Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.380753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 26
2025-10-01T14:06:22.380783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 27
2025-10-01T14:06:22.380860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.380888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.381158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 34 queued_in_partition_duration_ms: 19 }
2025-10-01T14:06:22.381170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 26
2025-10-01T14:06:22.381174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275218[B]
2025-10-01T14:06:22.382024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.382041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.382111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 67 size: 511959
2025-10-01T14:06:22.382165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 1 messageNo: 67 size: 511959
2025-10-01T14:06:22.382232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 2 messageNo: 67 size: 511959
2025-10-01T14:06:22.382289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 3 messageNo: 67 size: 511959
2025-10-01T14:06:22.382327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size: 205040
2025-10-01T14:06:22.382334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 4 messageNo: 67 size 205040 offset: -1
2025-10-01T14:06:22.382361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.382382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.382422Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.382442Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 27 partNo 0 count 3 size 8295638
2025-10-01T14:06:22.382453Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 30 partNo 3 count 3 size 5223531
2025-10-01T14:06:22.382458Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000014_00000_0000000003_00012?(+) to d0000000000_00000000000000000014_00000_0000000003_00012?(+)
2025-10-01T14:06:22.382468Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000017_00000_0000000003_00012?(+) to d0000000000_00000000000000000017_00000_0000000003_00012?(+)
2025-10-01T14:06:22.382472Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000010_00004_0000000004_00012|(+) to d0000000000_00000000000000000010_00004_0000000004_00012|(+)
2025-10-01T14:06:22.382480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.382503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.383165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 36 to 36
2025-10-01T14:06:22.383458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.383471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 36
2025-10-01T14:06:22.384532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.384579Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.385853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 1 }
2025-10-01T14:06:22.385865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 27
2025-10-01T14:06:22.385871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275218[B]
2025-10-01T14:06:22.387760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 37 to 37
2025-10-01T14:06:22.387991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.388001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 37
2025-10-01T14:06:22.388969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.389015Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.389293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 35
2025-10-01T14:06:22.389317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-01T14:06:22.389320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:22.389325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:22.389333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 3 count 4 size 7988778 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.389335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.389363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 14 partno 2 count 4 parts 14 suffix '0' size 7988756
2025-10-01T14:06:22.389376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-01T14:06:22.389382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 2 parts 8 suffix '124' size 4506418
2025-10-01T14:06:22.389385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-01T14:06:22.389386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-01T14:06:22.389418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.391143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.391448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.391591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 4 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:22.391778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.391919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.392058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.392242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 7 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:22.392383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.392520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.392659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.392948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 8 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:22.393087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.393224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.393365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.393427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 9 totakecount 3 count 1 size 205085 from pos 0 cbcount 1
2025-10-01T14:06:22.393937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-01T14:06:22.394008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.394014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 14 size 7988756 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.394018Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.394867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.394883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.395082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 69 size: 511959
2025-10-01T14:06:22.395135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 1 messageNo: 69 size: 511959
2025-10-01T14:06:22.395187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 2 messageNo: 69 size: 511959
2025-10-01T14:06:22.395570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 3 messageNo: 69 size: 511959
2025-10-01T14:06:22.395605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size: 205040
2025-10-01T14:06:22.395613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 4 messageNo: 69 size 205040 offset: -1
2025-10-01T14:06:22.395640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.395646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.395686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 7
2025-10-01T14:06:22.395719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 18 count 3 size 8295660 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.395726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7476729 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.395744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.395768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.395770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 20 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-01T14:06:22.395776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295660
2025-10-01T14:06:22.395782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 23 partno 3 count 2 parts 5 suffix '63' size 2970333
2025-10-01T14:06:22.395786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:22.395789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 13 suffix '124' size 7476729
2025-10-01T14:06:22.398993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.399007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-01T14:06:22.399951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.399965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-01T14:06:22.399968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 4506418 bytes (4506418)
2025-10-01T14:06:22.399971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 4506418 (8388608)
2025-10-01T14:06:22.399989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 36
2025-10-01T14:06:22.400011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 4506418 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.400014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 20 size 8295638 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.400017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 23 size 2970333 cause it's been evicted from L2. Actual L1 size: 4
2025-10-01T14:06:22.400020Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.401180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.401712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 27 count 3 size 8295638 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.401724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.401752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.401754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 3 partno 3 count 4 parts 14 suffix '0' size 7988778
2025-10-01T14:06:22.401760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-01T14:06:22.401766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-01T14:06:22.401770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:22.401773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 13517466 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.401782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-10-01T14:06:22.401801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 1, Offset: 27 is stored on disk
2025-10-01T14:06:22.401807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 2, Offset: 27 is stored on disk
2025-10-01T14:06:22.401813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 3, Offset: 27 is stored on disk
2025-10-01T14:06:22.401823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 4, Offset: 27 is stored on disk
2025-10-01T14:06:22.401835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-10-01T14:06:22.401845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 1, Offset: 28 is stored on disk
2025-10-01T14:06:22.401851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 2, Offset: 28 is stored on disk
2025-10-01T14:06:22.401857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 3, Offset: 28 is stored on disk
2025-10-01T14:06:22.401863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 4, Offset: 28 is stored on disk
2025-10-01T14:06:22.401869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-10-01T14:06:22.401874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 1, Offset: 29 is stored on disk
2025-10-01T14:06:22.401879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 2, Offset: 29 is stored on disk
2025-10-01T14:06:22.401885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 3, Offset: 29 is stored on disk
2025-10-01T14:06:22.401899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 4, Offset: 29 is stored on disk
2025-10-01T14:06:22.401905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-10-01T14:06:22.401909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 1, Offset: 30 is stored on disk
2025-10-01T14:06:22.401914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401917Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 2, Offset: 30 is stored on disk
2025-10-01T14:06:22.401919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 3, Offset: 30 is stored on disk
2025-10-01T14:06:22.401924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 4, Offset: 30 is stored on disk
2025-10-01T14:06:22.401931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-10-01T14:06:22.401939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 1, Offset: 31 is stored on disk
2025-10-01T14:06:22.401944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 2, Offset: 31 is stored on disk
2025-10-01T14:06:22.401948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 3, Offset: 31 is stored on disk
2025-10-01T14:06:22.401954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 4, Offset: 31 is stored on disk
2025-10-01T14:06:22.401960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-10-01T14:06:22.401968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 1, Offset: 32 is stored on disk
2025-10-01T14:06:22.401973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 2, Offset: 32 is stored on disk
2025-10-01T14:06:22.401978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401982Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 3, Offset: 32 is stored on disk
2025-10-01T14:06:22.401984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.401989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 4, Offset: 32 is stored on disk
2025-10-01T14:06:22.402031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.402050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.402052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (10)
2025-10-01T14:06:22.402075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-10-01T14:06:22.402099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 1
2025-10-01T14:06:22.402107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 2
2025-10-01T14:06:22.402110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 3
2025-10-01T14:06:22.402113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 4
2025-10-01T14:06:22.402513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 2253230 count 1 nextOffset 34 batches 5
2025-10-01T14:06:22.402537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-10-01T14:06:22.402543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 1
2025-10-01T14:06:22.402547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 2
2025-10-01T14:06:22.402551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 3
2025-10-01T14:06:22.402553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 4
2025-10-01T14:06:22.403094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 4 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 4506428 count 2 nextOffset 35 batches 9
2025-10-01T14:06:22.403112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.403138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.403186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 33,2 HeadOffset 33 endOffset 33 curOffset 35 d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418 WTime 1759327582403
2025-10-01T14:06:22.403493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.403705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-01T14:06:22.403717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000027_00000_0000000003_00015?
2025-10-01T14:06:22.403720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 12802056 bytes (12802056)
2025-10-01T14:06:22.403722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 2 blobs
2025-10-01T14:06:22.403743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295579 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.403746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 3 size 7988778 cause it's been evicted from L2. Actual L1 size: 4
2025-10-01T14:06:22.403749Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.403739Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 27 Result { Offset: 7 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 8 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582188 CreateTimestampMS: 1759327582131 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 9 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582189 CreateTimestampMS: 1759327582137 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 2252875 bytes ..." SourceId: "\000src_id" SeqNo: 10 PartNo: 4 TotalParts: 5 TotalSize: 2252875 WriteTimestampMS: 1759327582189 CreateTimestampMS: 1759327582141 UncompressedSize: 2252801 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 10754258 RealReadOffset: 9 WaitQuotaTimeMs: 0 EndOffset: 27 StartOffset: 0 } Cookie: 7 }
2025-10-01T14:06:22.403778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-10-01T14:06:22.403813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 29
2025-10-01T14:06:22.403831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 30
2025-10-01T14:06:22.403845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 31
2025-10-01T14:06:22.403858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-10-01T14:06:22.403870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-10-01T14:06:22.403864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.403885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.403893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.404138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 26 }
2025-10-01T14:06:22.404100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.404152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 28
2025-10-01T14:06:22.404115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.404157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275218[B]
2025-10-01T14:06:22.404120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.404252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 33 queued_in_partition_duration_ms: 24 }
2025-10-01T14:06:22.404261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 29
2025-10-01T14:06:22.404545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 38 to 38
2025-10-01T14:06:22.404526Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 10 endOffset 27
2025-10-01T14:06:22.404551Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 27 ReadOffset 10 ReadGuid ca10db97-fab4c7d9-11105967-c4c72422 has messages 1
2025-10-01T14:06:22.404565Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 10, endOffset# 27, WTime# 1759327582189, sizeLag# 10754258
2025-10-01T14:06:22.404574Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1TEvPartitionReady. Aval parts: 0
2025-10-01T14:06:22.404589Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 read done: guid# ca10db97-fab4c7d9-11105967-c4c72422, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 6758777
2025-10-01T14:06:22.404602Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 response to read: guid# ca10db97-fab4c7d9-11105967-c4c72422
2025-10-01T14:06:22.404677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.404690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.404753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 71 size: 511959
2025-10-01T14:06:22.404813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 1 messageNo: 71 size: 511959
2025-10-01T14:06:22.404829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.404841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 38
2025-10-01T14:06:22.404878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 2 messageNo: 71 size: 511959
2025-10-01T14:06:22.404983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 3 messageNo: 71 size: 511959
2025-10-01T14:06:22.405023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size: 205040
2025-10-01T14:06:22.405031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 4 messageNo: 71 size 205040 offset: -1
2025-10-01T14:06:22.405054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.405057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.405064Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.405085Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 33 partNo 0 count 2 size 4506418
2025-10-01T14:06:22.405095Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000020_00000_0000000003_00015?(+) to d0000000000_00000000000000000020_00000_0000000003_00015?(+)
2025-10-01T14:06:22.405098Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000023_00003_0000000002_00005?(+) to d0000000000_00000000000000000023_00003_0000000002_00005?(+)
2025-10-01T14:06:22.405101Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000018_00000_0000000002_00008|(+) to d0000000000_00000000000000000018_00000_0000000002_00008|(+)
2025-10-01T14:06:22.405109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 2 blobs
2025-10-01T14:06:22.405112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-01T14:06:22.405121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000027_00000_0000000003_00015?
2025-10-01T14:06:22.405129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 2 blobs for compaction
2025-10-01T14:06:22.405151Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.405166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.405208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 25 partno 0 count 2 parts_count 8 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.405215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 27 partno 0 count 3 parts_count 15 source 1 size 8295638 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.405223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 1 of 2 from KV
2025-10-01T14:06:22.405228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 37
2025-10-01T14:06:22.405242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 15 suffix '63'
2025-10-01T14:06:22.405254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 25 partno 0 count 2 parts_count 8
2025-10-01T14:06:22.405313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.406680Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.407129Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 Process answer. Aval parts: 1
2025-10-01T14:06:22.407217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 32 queued_in_partition_duration_ms: 21 }
2025-10-01T14:06:22.407226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 30
2025-10-01T14:06:22.407841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 32 queued_in_partition_duration_ms: 19 }
2025-10-01T14:06:22.407849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 31
2025-10-01T14:06:22.407991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.408013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.408132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 24 queued_in_partition_duration_ms: 14 }
2025-10-01T14:06:22.408136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 32
2025-10-01T14:06:22.408233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 23 queued_in_partition_duration_ms: 11 }
2025-10-01T14:06:22.408241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 33
2025-10-01T14:06:22.408161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 73 size: 511959
2025-10-01T14:06:22.408312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 1 messageNo: 73 size: 511959
2025-10-01T14:06:22.408432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 2 messageNo: 73 size: 511959
2025-10-01T14:06:22.408463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.408499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 3 messageNo: 73 size: 511959
2025-10-01T14:06:22.408539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size: 205040
2025-10-01T14:06:22.408548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 4 messageNo: 73 size 205040 offset: -1
2025-10-01T14:06:22.408566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.408587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.408758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.408898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.408905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.408918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 38
2025-10-01T14:06:22.408965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.411344Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got ReadResponse, serverBytesSize = 6758777, now ReadSizeBudget = 0, ReadSizeServerDelta = -6234489
2025-10-01T14:06:22.411321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.411345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 39 to 39
2025-10-01T14:06:22.411336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.411408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 75 size: 511959
2025-10-01T14:06:22.411438Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (7-7)
2025-10-01T14:06:22.411451Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 6758777 to budget
2025-10-01T14:06:22.411461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 1 messageNo: 75 size: 511959
2025-10-01T14:06:22.411528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 2 messageNo: 75 size: 511959
2025-10-01T14:06:22.411612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 3 messageNo: 75 size: 511959
2025-10-01T14:06:22.411641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.411655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:22.411656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size: 205040
2025-10-01T14:06:22.411664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 4 messageNo: 75 size 205040 offset: -1
2025-10-01T14:06:22.411679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.411697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.413220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.413304Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (7-7)
2025-10-01T14:06:22.413322Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.413442Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (8-8)
2025-10-01T14:06:22.413456Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:06:22.413546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.413744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.413758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-10-01T14:06:22.131000Z WriteTime: 2025-10-01T14:06:22.188000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:51196", "_ip": "ipv6:[::1]:51196" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.414368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 39
2025-10-01T14:06:22.414458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.414475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 2 from KV. Status 1
2025-10-01T14:06:22.414484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:22.414495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 25 count 2 size 4506418 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.414531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 18 partno 0 count 3 parts 15 suffix '0' size 8295660
2025-10-01T14:06:22.414541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:22.414558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.414566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:22.414568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:22.414576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-01T14:06:22.414579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.414706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-10-01T14:06:22.414844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 1
2025-10-01T14:06:22.416209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 26 partNo 1 result is x0000000000_00000000000000000021_00003_0000000004_00014 size 7988760
2025-10-01T14:06:22.416342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 2
2025-10-01T14:06:22.416487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 3
2025-10-01T14:06:22.416687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 4
2025-10-01T14:06:22.416707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000021_00003_0000000004_00014 new key d0000000000_00000000000000000021_00003_0000000004_00014 size 7988760 WTime 1759327582416
2025-10-01T14:06:22.417056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 26 partNo 4 FormedBlobsCount 1 NewHead: Offset 25 PartNo 1 PackedSize 1741199 count 1 nextOffset 26 batches 4
2025-10-01T14:06:22.417077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-10-01T14:06:22.417217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 1
2025-10-01T14:06:22.417371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 2
2025-10-01T14:06:22.417460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 40 to 40
2025-10-01T14:06:22.417522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 3
2025-10-01T14:06:22.417605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 4
2025-10-01T14:06:22.417760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.417773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 40
2025-10-01T14:06:22.418156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 27 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 3994397 count 2 nextOffset 27 batches 8
2025-10-01T14:06:22.418177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000027_00000_0000000003_00015?
2025-10-01T14:06:22.418184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.418310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-10-01T14:06:22.418465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 1
2025-10-01T14:06:22.418605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 2
2025-10-01T14:06:22.418741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 3
2025-10-01T14:06:22.418948Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.419266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.419376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 4
2025-10-01T14:06:22.419526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.420181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 28 partNo 4 FormedBlobsCount 0 NewHead: Offset 25 PartNo 1 PackedSize 6247595 count 3 nextOffset 28 batches 12
2025-10-01T14:06:22.420204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-10-01T14:06:22.420331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 1
2025-10-01T14:06:22.420475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 2
2025-10-01T14:06:22.420615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 3
2025-10-01T14:06:22.420811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 4
2025-10-01T14:06:22.422230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:91: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '' seqNo 29 partNo 4 result is x0000000000_00000000000000000025_00001_0000000003_00015 size 8295582
2025-10-01T14:06:22.422254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000025_00001_0000000003_00015 new key d0000000000_00000000000000000025_00001_0000000003_00015 size 8295582 WTime 1759327582421
2025-10-01T14:06:22.422279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 29 partNo 4 FormedBlobsCount 1 NewHead: Offset 28 PartNo 4 PackedSize 205118 count 1 nextOffset 29 batches 1
2025-10-01T14:06:22.422292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 41 to 41
2025-10-01T14:06:22.422285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-10-01T14:06:22.422435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 1
2025-10-01T14:06:22.422596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.422605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 41
2025-10-01T14:06:22.422587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 2
2025-10-01T14:06:22.422739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 3
2025-10-01T14:06:22.422802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 4
2025-10-01T14:06:22.423325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 30 partNo 4 FormedBlobsCount 0 NewHead: Offset 28 PartNo 4 PackedSize 2458316 count 2 nextOffset 30 batches 5
2025-10-01T14:06:22.423808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-10-01T14:06:22.423825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 1
2025-10-01T14:06:22.423828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 2
2025-10-01T14:06:22.423937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:550: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 28,2 HeadOffset 21 endOffset 25 curOffset 30 d0000000000_00000000000000000028_00004_0000000002_00004| size 2458306 WTime 1759327582423
2025-10-01T14:06:22.424067Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (8-8)
2025-10-01T14:06:22.424084Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.424127Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (9-9)
2025-10-01T14:06:22.424143Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:06:22.424344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 18 size 8295660 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.424355Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.424369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.424395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4505822 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.424406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-10-01T14:06:22.424427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 1, Offset: 33 is stored on disk
2025-10-01T14:06:22.424439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 2, Offset: 33 is stored on disk
2025-10-01T14:06:22.424446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 3, Offset: 33 is stored on disk
2025-10-01T14:06:22.424456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424461Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 4, Offset: 33 is stored on disk
2025-10-01T14:06:22.424463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-10-01T14:06:22.424475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 1, Offset: 34 is stored on disk
2025-10-01T14:06:22.424482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 2, Offset: 34 is stored on disk
2025-10-01T14:06:22.424488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 3, Offset: 34 is stored on disk
2025-10-01T14:06:22.424495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.424500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 4, Offset: 34 is stored on disk
2025-10-01T14:06:22.424535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.424559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.424568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-10-01T14:06:22.424587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-10-01T14:06:22.424596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 1
2025-10-01T14:06:22.424600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 2
2025-10-01T14:06:22.424603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 3
2025-10-01T14:06:22.424607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 4
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-10-01T14:06:22.137000Z WriteTime: 2025-10-01T14:06:22.189000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:51196", "server": "ipv6:[::1]:51196", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.425065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 2253230 count 1 nextOffset 36 batches 5
2025-10-01T14:06:22.425090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-10-01T14:06:22.425097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 1
2025-10-01T14:06:22.425100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 2
2025-10-01T14:06:22.425104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 3
2025-10-01T14:06:22.425108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 4
2025-10-01T14:06:22.425631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 4506428 count 2 nextOffset 37 batches 9
2025-10-01T14:06:22.425656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-10-01T14:06:22.425662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 1
2025-10-01T14:06:22.425665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 2
2025-10-01T14:06:22.425668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 3
2025-10-01T14:06:22.425672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 4
2025-10-01T14:06:22.426165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 4 FormedBlobsCount 0 NewHead: Offset 35 PartNo 0 PackedSize 6759626 count 3 nextOffset 38 batches 13
2025-10-01T14:06:22.426188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.426295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 35,3 HeadOffset 35 endOffset 35 curOffset 38 d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616 WTime 1759327582426
2025-10-01T14:06:22.427464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 42 to 42
2025-10-01T14:06:22.427770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.427783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 42
2025-10-01T14:06:22.428748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.428775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.427127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:06:22.428259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.428269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.428339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 77 size: 511959
2025-10-01T14:06:22.428388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 77 size: 511959
2025-10-01T14:06:22.428868Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-10-01T14:06:22.428440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 77 size: 511959
2025-10-01T14:06:22.428497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 77 size: 511959
>>> Got event: 2025-10-01T14:06:22.428538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size: 205040
2025-10-01T14:06:22.428543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 77 size 205040 offset: -1
2025-10-01T14:06:22.428570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.428574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.428586Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.428600Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 21 partNo 3 count 4 size 7988760
2025-10-01T14:06:22.428605Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 1 count 3 size 8295582
2025-10-01T14:06:22.428610Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 28 partNo 4 count 2 size 2458306
2025-10-01T14:06:22.428635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 34
2025-10-01T14:06:22.428662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 35
2025-10-01T14:06:22.428668Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.428675Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 35 partNo 0 count 3 size 6759616
2025-10-01T14:06:22.428709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.428729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.428776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 40
2025-10-01T14:06:22.428969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.428995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 22 queued_in_partition_duration_ms: 19 }
2025-10-01T14:06:22.429006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 34
2025-10-01T14:06:22.429076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 21 queued_in_partition_duration_ms: 7 }
2025-10-01T14:06:22.429081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 35
2025-10-01T14:06:22.430635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.430951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.430976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.430994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.431056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 79 size: 511959
2025-10-01T14:06:22.431110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 79 size: 511959
2025-10-01T14:06:22.431171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 79 size: 511959
2025-10-01T14:06:22.431219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 79 size: 511959
2025-10-01T14:06:22.431265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size: 205040
2025-10-01T14:06:22.431272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 79 size 205040 offset: -1
2025-10-01T14:06:22.431294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.431301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.431311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.431326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 43 to 43
2025-10-01T14:06:22.431330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.431343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 41
2025-10-01T14:06:22.431424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.431599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.431607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 43
2025-10-01T14:06:22.431757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.432973Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (9-9)
2025-10-01T14:06:22.432990Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252801 bytes
2025-10-01T14:06:22.432999Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In ContinueReadingDataImpl, ReadSizeBudget = 6758777, ReadSizeServerDelta = -6234489
2025-10-01T14:06:22.433073Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-10-01T14:06:22.433083Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
2025-10-01T14:06:22.433176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.433214Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 grpc read done: success# 1, data# { read_request { bytes_size: 6758777 } }
2025-10-01T14:06:22.433268Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 got read request: guid# d3db9091-1e8bee6e-587af0b7-a6fc2515
2025-10-01T14:06:22.433288Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 performing read request: guid# 176ee3ae-a18f2fc0-6e7de7d1-209c96d3, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 20, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-10-01T14:06:22.433303Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 20 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 10 EndOffset 27 ClientCommitOffset 0 committedOffset 0 Guid 176ee3ae-a18f2fc0-6e7de7d1-209c96d3
2025-10-01T14:06:22.433347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.433362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.433416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 81 size: 511959
2025-10-01T14:06:22.433439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.433459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 81 size: 511959
2025-10-01T14:06:22.433498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 81 size: 511959
2025-10-01T14:06:22.433538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 81 size: 511959
2025-10-01T14:06:22.433575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size: 205040
2025-10-01T14:06:22.433581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 81 size 205040 offset: -1
2025-10-01T14:06:22.433612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.433620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.433642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.433646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.433650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.433662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.433686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 42
2025-10-01T14:06:22.433703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 10 count 20 size 524288 endOffset 35 max time lag 0ms effective offset 10
2025-10-01T14:06:22.433729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 2 blobs, size 7988738 count 4 last offset 10, current partition end offset: 35
2025-10-01T14:06:22.433746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-10-01T14:06:22.433757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 7 partno 1 count 3 parts_count 15 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.433762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 10 partno 4 count 4 parts_count 14 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.433773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 10. Have to read 2 of 2 from KV
2025-10-01T14:06:22.433747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.433799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 7 partno 1 count 3 parts_count 15
2025-10-01T14:06:22.433807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 10 partno 4 count 4 parts_count 14
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252801 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-10-01T14:06:22.141000Z WriteTime: 2025-10-01T14:06:22.189000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:51196", "server": "ipv6:[::1]:51196", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.435189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.435451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.435465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.435479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.435525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 83 size: 511959
2025-10-01T14:06:22.435584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 83 size: 511959
2025-10-01T14:06:22.435641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 83 size: 511959
2025-10-01T14:06:22.435692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 83 size: 511959
2025-10-01T14:06:22.435729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size: 205040
2025-10-01T14:06:22.435736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 83 size 205040 offset: -1
2025-10-01T14:06:22.435759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.435766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.435775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.435793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.435806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 43
2025-10-01T14:06:22.435867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.437702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.437717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.437771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size: 511959
2025-10-01T14:06:22.437889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 85 size: 511959
2025-10-01T14:06:22.437914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 44 to 44
2025-10-01T14:06:22.437965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 85 size: 511959
2025-10-01T14:06:22.438178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 85 size: 511959
2025-10-01T14:06:22.438210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.438219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 44
2025-10-01T14:06:22.438224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size: 205040
2025-10-01T14:06:22.438229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 85 size 205040 offset: -1
2025-10-01T14:06:22.438243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.438257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.439306Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.439809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.440087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.440235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.440249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.440267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-10-01T14:06:22.440335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.442057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.442071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.442293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 87 size: 511959
2025-10-01T14:06:22.442336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 87 size: 511959
2025-10-01T14:06:22.442396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 87 size: 511959
2025-10-01T14:06:22.442444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 87 size: 511959
2025-10-01T14:06:22.442478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size: 205040
2025-10-01T14:06:22.442486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 87 size 205040 offset: -1
2025-10-01T14:06:22.442505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.442527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.442604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 45 to 45
2025-10-01T14:06:22.442927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.442935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 45
2025-10-01T14:06:22.443944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.443981Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.444445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.445078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.445200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.445211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.445227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 45
2025-10-01T14:06:22.445289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.447162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.447180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.447240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 89 size: 511959
2025-10-01T14:06:22.447306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 89 size: 511959
2025-10-01T14:06:22.447361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 89 size: 511959
2025-10-01T14:06:22.447410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 89 size: 511959
2025-10-01T14:06:22.447450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size: 205040
2025-10-01T14:06:22.447455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 89 size 205040 offset: -1
2025-10-01T14:06:22.447479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.447495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.461330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 2 from KV. Status 1
2025-10-01T14:06:22.461355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:22.461357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:22.461368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 7 count 3 size 8295579 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.461372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 10 count 4 size 7988738 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.461492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 13 suffix '124' size 7476729
2025-10-01T14:06:22.461509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-01T14:06:22.461516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:22.461524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 27 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-01T14:06:22.461527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-01T14:06:22.461551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 2 blobs
2025-10-01T14:06:22.464001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 3 count 0 size 2047975 from pos 0 cbcount 4
2025-10-01T14:06:22.464283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 10 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-01T14:06:22.464436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.464581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.464722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.464923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 11 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-01T14:06:22.465060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.465197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.465338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.465535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 12 totakecount 4 count 1 size 717095 from pos 0 cbcount 2
2025-10-01T14:06:22.465683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.465824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.466306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:22.466491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 13 totakecount 4 count 1 size 205086 from pos 0 cbcount 1
2025-10-01T14:06:22.466769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 14 totakecount 4 count 0 size 1024014 from pos 0 cbcount 2
2025-10-01T14:06:22.466825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 30 size 5223531 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.466830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7476729 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.466832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 27 size 8295638 cause it's been evicted from L2. Actual L1 size: 4
2025-10-01T14:06:22.466838Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.466964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 10
2025-10-01T14:06:22.467117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.467176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:22.471405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.471440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 6758733 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.471448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471459Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-10-01T14:06:22.471465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 1, Offset: 35 is stored on disk
2025-10-01T14:06:22.471469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 2, Offset: 35 is stored on disk
2025-10-01T14:06:22.471475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 3, Offset: 35 is stored on disk
2025-10-01T14:06:22.471485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 4, Offset: 35 is stored on disk
2025-10-01T14:06:22.471491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-10-01T14:06:22.471496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 1, Offset: 36 is stored on disk
2025-10-01T14:06:22.471502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 2, Offset: 36 is stored on disk
2025-10-01T14:06:22.471507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 3, Offset: 36 is stored on disk
2025-10-01T14:06:22.471513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 4, Offset: 36 is stored on disk
2025-10-01T14:06:22.471517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-10-01T14:06:22.471524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 1, Offset: 37 is stored on disk
2025-10-01T14:06:22.471529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 2, Offset: 37 is stored on disk
2025-10-01T14:06:22.471533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 3, Offset: 37 is stored on disk
2025-10-01T14:06:22.471538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-10-01T14:06:22.471541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 4, Offset: 37 is stored on disk
2025-10-01T14:06:22.472089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.472116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.472118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (35)
2025-10-01T14:06:22.472140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-10-01T14:06:22.472155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 1
2025-10-01T14:06:22.472165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 2
2025-10-01T14:06:22.472169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 3
2025-10-01T14:06:22.472172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 4
2025-10-01T14:06:22.472618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 2253230 count 1 nextOffset 39 batches 5
2025-10-01T14:06:22.472650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-10-01T14:06:22.472656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 1
2025-10-01T14:06:22.472660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 2
2025-10-01T14:06:22.472663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 3
2025-10-01T14:06:22.472669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 4
2025-10-01T14:06:22.473160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 4506428 count 2 nextOffset 40 batches 9
2025-10-01T14:06:22.473185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-10-01T14:06:22.473190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 1
2025-10-01T14:06:22.473193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 2
2025-10-01T14:06:22.473197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 3
2025-10-01T14:06:22.473200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 4
2025-10-01T14:06:22.474342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 4 FormedBlobsCount 0 NewHead: Offset 38 PartNo 0 PackedSize 6759626 count 3 nextOffset 41 batches 13
2025-10-01T14:06:22.474366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-10-01T14:06:22.474392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 1
2025-10-01T14:06:22.474397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 2
2025-10-01T14:06:22.474401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 3
2025-10-01T14:06:22.475882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1380: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob sourceId '\0src_id' seqNo 42 partNo 3 result is x0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
2025-10-01T14:06:22.475902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 4
2025-10-01T14:06:22.475916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1098: [72075186224037892][Partition][0][StateIdle] writing blob: topic 'rt3.dc1--test-topic' partition 0 old key x0000000000_00000000000000000038_00000_0000000003_00015? new key d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638 WTime 1759327582475
2025-10-01T14:06:22.476310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 4 FormedBlobsCount 1 NewHead: Offset 41 PartNo 3 PackedSize 717145 count 1 nextOffset 42 batches 2
2025-10-01T14:06:22.476329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-10-01T14:06:22.476335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 1
2025-10-01T14:06:22.476339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 2
2025-10-01T14:06:22.476343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 3
2025-10-01T14:06:22.476348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 4
2025-10-01T14:06:22.476871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 4 FormedBlobsCount 0 NewHead: Offset 41 PartNo 3 PackedSize 2970343 count 2 nextOffset 43 batches 6
2025-10-01T14:06:22.476891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-10-01T14:06:22.476898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 1
2025-10-01T14:06:22.476901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 2
2025-10-01T14:06:22.476905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 3
2025-10-01T14:06:22.476908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 4
2025-10-01T14:06:22.477435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 4 FormedBlobsCount 0 NewHead: Offset 41 PartNo 3 PackedSize 5223541 count 3 nextOffset 44 batches 10
2025-10-01T14:06:22.477457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-10-01T14:06:22.477463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 1
2025-10-01T14:06:22.477467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 2
2025-10-01T14:06:22.477471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 3
2025-10-01T14:06:22.477474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 4
2025-10-01T14:06:22.478007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 4 FormedBlobsCount 0 NewHead: Offset 41 PartNo 3 PackedSize 7476739 count 4 nextOffset 45 batches 14
2025-10-01T14:06:22.478027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.478136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 41,4 HeadOffset 38 endOffset 38 curOffset 45 d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729 WTime 1759327582477
2025-10-01T14:06:22.478343Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 35 Result { Offset: 10 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 11 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759327582207 CreateTimestampMS: 1759327582145 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 12 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759327582208 CreateTimestampMS: 1759327582148 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 13 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759327582208 CreateTimestampMS: 1759327582156 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 2252876 bytes ..." SourceId: "\000src_id" SeqNo: 14 PartNo: 4 TotalParts: 5 TotalSize: 2252876 WriteTimestampMS: 1759327582209 CreateTimestampMS: 1759327582163 UncompressedSize: 2252802 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 2 BlobsFromCache: 0 SizeLag: 12495551 RealReadOffset: 13 WaitQuotaTimeMs: 0 EndOffset: 35 StartOffset: 0 } Cookie: 10 }
2025-10-01T14:06:22.479144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:06:22.479270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 36
2025-10-01T14:06:22.479312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 37
2025-10-01T14:06:22.479340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 38
2025-10-01T14:06:22.479356Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.479367Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 38 partNo 0 count 3 size 8295638
2025-10-01T14:06:22.479373Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 41 partNo 3 count 4 size 7476729
2025-10-01T14:06:22.479388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 21 count 4 size 7988760 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.479391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 3 size 8295582 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.479395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 28 count 2 size 2458306 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.479442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.479448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:471: [72075186224037892][Partition][0][StateIdle] Blobs compaction is completed
2025-10-01T14:06:22.479470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:22.479433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.479477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:22.479480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.479481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-01T14:06:22.479486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.479487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 7 partno 1 count 3 parts 15 suffix '0' size 8295579
2025-10-01T14:06:22.479491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295582
2025-10-01T14:06:22.479494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 2 parts 4 suffix '124' size 2458306
2025-10-01T14:06:22.479820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.479834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.479846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 46 queued_in_partition_duration_ms: 19 }
2025-10-01T14:06:22.479837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.479861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 36
2025-10-01T14:06:22.479840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.479870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage got back to normal 20275218[B]
2025-10-01T14:06:22.479843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:22.479846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:22.479884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 4506418 cause it's been evicted from L2. Actual L1 size: 7
2025-10-01T14:06:22.479891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 7 size 8295579 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.479894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 33 size 4506418 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.479897Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.479913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:22.479920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.479931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.479940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.479954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:22.479960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.479962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.479967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 35 partno 0 count 3 parts_count 12 source 1 size 6759616 accessed 0 times before, last time 2025-10-01T14:06:22.000000Z
2025-10-01T14:06:22.479978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 46 queued_in_partition_duration_ms: 16 }
2025-10-01T14:06:22.479982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 37
2025-10-01T14:06:22.479975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 2 of 3 from KV
2025-10-01T14:06:22.480024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63'
2025-10-01T14:06:22.480034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:22.480036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:22.480267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 46 to 46
2025-10-01T14:06:22.480548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.480559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 46
2025-10-01T14:06:22.481025Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 14 endOffset 35
2025-10-01T14:06:22.481051Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 35 ReadOffset 14 ReadGuid 176ee3ae-a18f2fc0-6e7de7d1-209c96d3 has messages 1
2025-10-01T14:06:22.481076Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 14, endOffset# 35, WTime# 1759327582209, sizeLag# 12495551
2025-10-01T14:06:22.481090Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1TEvPartitionReady. Aval parts: 0
2025-10-01T14:06:22.481114Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 read done: guid# 176ee3ae-a18f2fc0-6e7de7d1-209c96d3, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 9011741
2025-10-01T14:06:22.481131Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 response to read: guid# 176ee3ae-a18f2fc0-6e7de7d1-209c96d3
2025-10-01T14:06:22.481629Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.482317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.482502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 45 queued_in_partition_duration_ms: 14 }
2025-10-01T14:06:22.482516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: acknoledged message 38
2025-10-01T14:06:22.482791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.483020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.483038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.483068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 46
2025-10-01T14:06:22.483182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.483596Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 Process answer. Aval parts: 1
2025-10-01T14:06:22.484745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 47 to 47
2025-10-01T14:06:22.485034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.485043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 47
2025-10-01T14:06:22.485787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.485808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.485946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 91 size: 511959
2025-10-01T14:06:22.486014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 91 size: 511959
2025-10-01T14:06:22.486079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 91 size: 511959
2025-10-01T14:06:22.486147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 91 size: 511959
2025-10-01T14:06:22.486174Z :NOTICE: [/Invalid] [/Invalid] [d4e50cb7-ade8d768-8dfe3690-f9494c07] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to establish connection to server "localhost:21386" ( cluster ). Attempts done: 1     <main>: Error: Database Invalid does not exist, code: 200202     <main>: Error: Endpoint list is empty for database /Invalid, cluster endpoint localhost:21386. " }
2025-10-01T14:06:22.486204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size: 205040
2025-10-01T14:06:22.486212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 91 size 205040 offset: -1
2025-10-01T14:06:22.486237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.486268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.487561Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got ReadResponse, serverBytesSize = 9011741, now ReadSizeBudget = 0, ReadSizeServerDelta = -8487453
2025-10-01T14:06:22.487652Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (10-10)
2025-10-01T14:06:22.487667Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 9011741 to budget
2025-10-01T14:06:22.489499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write 1 messages with Id from 48 to 48
2025-10-01T14:06:22.489582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.489786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: try to update token
2025-10-01T14:06:22.489795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Send 1 message(s) (0 left), first sequence number is 48
2025-10-01T14:06:22.490072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.490239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.490256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.490295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 47
2025-10-01T14:06:22.490402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.490815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Estimated memory usage 22528020[B] reached maximum (20971520[B])
2025-10-01T14:06:22.491099Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (10-10)
2025-10-01T14:06:22.491115Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] The application data is transferred to the client. Number of messages 1, size 2252802 bytes
2025-10-01T14:06:22.491153Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (11-11)
2025-10-01T14:06:22.491165Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Returning serverBytesSize = 0 to budget
>>> Got event: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 Message { Data: ..2252802 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-10-01T14:06:22.145000Z WriteTime: 2025-10-01T14:06:22.207000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:51196", "_ip": "ipv6:[::1]:51196", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc1 Database path: /Root Database id: account-dc1 } }
2025-10-01T14:06:22.492103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.492414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.492830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.492858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.492924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size: 511959
2025-10-01T14:06:22.492984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 93 size: 511959
2025-10-01T14:06:22.493043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 93 size: 511959
2025-10-01T14:06:22.493101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 93 size: 511959
2025-10-01T14:06:22.493151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size: 205040
2025-10-01T14:06:22.493161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 93 size 205040 offset: -1
2025-10-01T14:06:22.493185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.493194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.493214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.493240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.493253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-10-01T14:06:22.493337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:22.495544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.495563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.495623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 95 size: 511959
2025-10-01T14:06:22.495675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 95 size: 511959
2025-10-01T14:06:22.495734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 95 size: 511959
2025-10-01T14:06:22.495786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 95 size: 511959
2025-10-01T14:06:22.495834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size: 205040
2025-10-01T14:06:22.495843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 95 size 205040 offset: -1
2025-10-01T14:06:22.495860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:22.495893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.501844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 2 of 3 from KV. Status 1
2025-10-01T14:06:22.501861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:22.501864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:22.501875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.501879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.501934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 10 partno 4 count 4 parts 14 suffix '0' size 7988738
2025-10-01T14:06:22.501941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:22.501947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 21 partno 3 count 4 parts 14 suffix '0' size 7988760
2025-10-01T14:06:22.501950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:22.502052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:22.502063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.502066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.502196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 3
2025-10-01T14:06:22.502424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:57: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 4
2025-10-01T14:06:22.502798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:130: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '' seqNo 31 partNo 4 FormedBlobsCount 0 NewHead: Offset 30 PartNo 3 PackedSize 2253230 count 1 nextOffset 31 batches 5
2025-10-01T14:06:22.502832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:22.677267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::ExecRequestForCompaction(NKikimr::NPQ::TWriteMsg&, NKikimr::NPQ::TPartition::TProcessParametersBase&, NKikimr::TEvKeyValue::TEvRequest*, TInstant)+1759 (0x241B9EDF)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+981 (0x241BF815)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:22.678131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 21 size 7988760 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.678134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 10 size 7988738 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.678142Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.678256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 38 count 3 size 8295638 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.678260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 41 count 4 size 7476729 actorID [2:7556254420750728425:2401]
2025-10-01T14:06:22.678344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 25 partno 1 count 3 parts 15 suffix '0' size 8295582
2025-10-01T14:06:22.678350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-01T14:06:22.678356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 28 partno 4 count 2 parts 4 suffix '124' size 2458306
2025-10-01T14:06:22.678359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 41 partno 3 count 4 parts 13 suffix '63' size 7476729
2025-10-01T14:06:22.678949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:22.678994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:22.678997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:22.679038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2 reason: error at write: Disconnected sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0
2025-10-01T14:06:22.678557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_1_2649111627664798049_v1
2025-10-01T14:06:22.678571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.678577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.678580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.678587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.678590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.678593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.678596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.678599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.678603Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.678606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.679121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 25 size 8295582 cause it's been evicted from L2. Actual L1 size: 6
2025-10-01T14:06:22.679124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:438: Erasing blob in L1. Partition 0 offset 28 size 2458306 cause it's been evicted from L2. Actual L1 size: 5
2025-10-01T14:06:22.679127Z node 2 :PERSQUEUE NOTICE: read.h:372: [72075186224037892][PQCacheProxy]Have to remove new data from cache. Topic rt3.dc1--test-topic, tablet id72075186224037892, cookie 0
2025-10-01T14:06:22.679157Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_1_2649111627664798049_v1
2025-10-01T14:06:22.679352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:22.679362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session will restart in 0.007164s
2025-10-01T14:06:22.679390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: Do CDS request
2025-10-01T14:06:22.679398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:22.679197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|f2654c09-fa204983-f8e5039f-2277e534_0 is DEAD
2025-10-01T14:06:22.679395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254431717521842:2506]
2025-10-01T14:06:22.687919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.687944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:22.687959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-10-01T14:06:22.688158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.688190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:22.688201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:22.688205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:22.688625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-10-01T14:06:22.688669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:22.688671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:22.688673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:22.688678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254431717521992:2511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:22.689191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254431717521992:2511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:22.692051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254431717521992:2511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:22.699320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254431717521992:2511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:22.699336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254431717521992:2511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:22.699340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254431717521992:2511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:22.699350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:22.700105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:22.701181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:22.701419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:22.701430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:22.701443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:22.701502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:22.701553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254429340663358:2434]
2025-10-01T14:06:22.702180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:22.702810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:22.702866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:22.703228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:22.703304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:22.703310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:22.703311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:22.703312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:22.703314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:22.703315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:22.703317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00013|
2025-10-01T14:06:22.703318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:22.703319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:22.703321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:22.703322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-01T14:06:22.703323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000027_00000_0000000003_00015?
2025-10-01T14:06:22.703325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.703326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.703327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.703328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[15]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:22.703330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[16]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:22.703335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:22.703347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:22.703351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:22.703356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:22.703360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:22.703364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:22.703368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00013|
2025-10-01T14:06:22.703373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:579: replace key d0000000000_00000000000000000021_00003_0000000004_00013| to d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:22.703377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:22.703381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:22.703386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:602: ignore key d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-01T14:06:22.703390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:602: ignore key d0000000000_00000000000000000027_00000_0000000003_00015?
2025-10-01T14:06:22.703394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.703398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.703406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.703411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:22.703414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:22.703422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:22.703434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:22.703444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:22.703451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:22.703460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:22.703466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:22.703475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:22.703481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:22.703498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:22.703504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:22.703508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:22.703515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:22.703520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00013|
2025-10-01T14:06:22.703530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000021_00003_0000000004_00013| will be deleted
2025-10-01T14:06:22.703533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:22.703539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:22.703544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00000_0000000002_00008?
2025-10-01T14:06:22.703553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000025_00000_0000000002_00008? will be deleted
2025-10-01T14:06:22.703555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:22.703561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:22.703568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000027_00000_0000000003_00015?
2025-10-01T14:06:22.703573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:664: [rt3.dc1--test-topic:0:TInitDataRangeStep] unknown key d0000000000_00000000000000000027_00000_0000000003_00015? will be deleted
2025-10-01T14:06:22.703578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:22.703584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:22.703588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.703594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.703602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.703607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.703612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.703632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.703640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:22.703645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:22.703649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:22.703654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:22.703698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:22.711774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:22.713356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:22.713374Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:22.713377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:22.713380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:22.713387Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2 [2:7556254429340663358:2434]
2025-10-01T14:06:22.713404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:22.713421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:22.713424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.713428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.713430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.713460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:22.713467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:22.713473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:22.713515Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:22.713526Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000027_00000_0000000003_00015?(+) to d0000000000_00000000000000000027_00000_0000000003_00015?(+)
2025-10-01T14:06:22.713528Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000025_00000_0000000002_00008?(+) to d0000000000_00000000000000000025_00000_0000000002_00008?(+)
2025-10-01T14:06:22.713530Z node 2 :PERSQUEUE DEBUG: read.h:350: [72075186224037892][PQCacheProxy]CacheProxy. Delete blobs from d0000000000_00000000000000000021_00003_0000000004_00013|(+) to d0000000000_00000000000000000021_00003_0000000004_00013|(+)
2025-10-01T14:06:22.713562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.713564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.713566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.713569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:22.713571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:22.713681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:22.713683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.713695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.713707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.713723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:22.713750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254431717522033:2511], now have 1 active actors on pipe
2025-10-01T14:06:22.713754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254431717521983:2446], now have 1 active actors on pipe
2025-10-01T14:06:22.713761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254429340663353:2434]
2025-10-01T14:06:22.713763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254429340663353:2434]
2025-10-01T14:06:22.713765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254429340663353:2434]
2025-10-01T14:06:22.713779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:22.713791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:22.713793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:22.713795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:22.713796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:22.713807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:22.713811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:22.713968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254429340663353:2434]
2025-10-01T14:06:22.713971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:22.713978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:22.714810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2
2025-10-01T14:06:22.714827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2
2025-10-01T14:06:22.715073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.715091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.715121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:22.715130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:06:22.717027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:22.717053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:22.717061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.717069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.717082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.717096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.717109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:22.717120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:06:22.717135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.718967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.718980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.719007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.719130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 45 sessionId: src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0
2025-10-01T14:06:22.719458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2654c09-fa204983-f8e5039f-2277e534_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:22.738046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0] Write session: try to update token
2025-10-01T14:06:22.738064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:22.761727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:22.761742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:22.761745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:22.761747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:22.761755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254429340663353:2434]
2025-10-01T14:06:22.761759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254429340663353:2434]
2025-10-01T14:06:22.761762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254429340663353:2434]
2025-10-01T14:06:22.761802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:22.761807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.761809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.761815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:22.761830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:22.761834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:22.762385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:22.779461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254431717522049:2506]
2025-10-01T14:06:22.780211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2, pipe: [1:7556254431717522049:2506]
2025-10-01T14:06:22.813028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:22.830021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:22.921646Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:22.921885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254431717522049:2506], now have 1 active actors on pipe
2025-10-01T14:06:22.921912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.921922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.923401Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:22.923627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:22.923637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:22.923689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3 reason: error at write: Disconnected sessionId: src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0
2025-10-01T14:06:22.923852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0 is DEAD
2025-10-01T14:06:22.923974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254431717522049:2506]
2025-10-01T14:06:22.923987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:22.924199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:22.924208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0] Write session will restart in 0.007446s
2025-10-01T14:06:22.924233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0] Write session: Do CDS request
2025-10-01T14:06:22.924238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:22.934601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:22.934976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:22.935160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:22.935171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:22.935183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:22.935242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:22.935284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254429340663457:2449]
2025-10-01T14:06:22.936932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.937033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:22.937043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-10-01T14:06:22.937263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:22.937289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:22.937295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:22.937299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:22.938160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:22.937714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-10-01T14:06:22.937746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:22.937748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:22.937749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:22.937754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254431717522095:2522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:22.938252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254431717522095:2522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:22.938736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:22.938774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:22.939073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:22.939156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:22.939163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:22.939165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:22.939166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:22.939167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:22.939168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:22.939169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:22.939170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:22.939171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:22.939172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.939173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.939174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.939176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:22.939177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:22.939184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:22.939193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:22.939197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:22.939200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:22.939204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:22.939208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:22.939213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:22.939216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:22.939220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:22.939224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.939227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.939230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.939234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:22.939238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:22.939245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:22.939252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:22.939258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:22.939263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:22.939266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:22.939271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:22.939283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:22.939288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:22.939293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:22.939298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:22.939301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:22.939307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:22.939312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:22.939316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:22.939321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:22.939327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:22.939331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:22.939336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:22.939340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.939346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.939354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.939360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.939367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.939373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.939378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:22.939382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:22.939386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:22.939391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:22.939435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:22.940686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254431717522095:2522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:22.944657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:22.944977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254431717522095:2522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:22.944989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254431717522095:2522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:22.944993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254431717522095:2522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:22.945001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:22.945714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:22.945727Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:22.945729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:22.945733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:22.945740Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3 [2:7556254429340663457:2449]
2025-10-01T14:06:22.945755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:22.945769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:22.945772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.945776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.945778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.945794Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:22.945800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:22.945805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:22.945858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.945860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.945862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.945865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:22.945867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:22.945942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:22.945945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.945957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:22.945968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:22.945983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:22.946008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254431717522130:2522], now have 1 active actors on pipe
2025-10-01T14:06:22.946012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254431717522076:2446], now have 1 active actors on pipe
2025-10-01T14:06:22.946019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254429340663451:2449]
2025-10-01T14:06:22.946021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254429340663451:2449]
2025-10-01T14:06:22.946023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254429340663451:2449]
2025-10-01T14:06:22.946035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:22.946052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:22.946070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:22.946077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:22.946101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254429340663451:2449]
2025-10-01T14:06:22.946107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:22.946095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3
2025-10-01T14:06:22.946104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3
2025-10-01T14:06:22.946159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:22.946165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:22.946167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:22.946172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:22.946251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.946264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.946289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:22.946301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:22.946311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:22.946316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:22.946325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:22.946341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:22.946366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.947979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:22.947990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:22.948019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:22.950002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0
2025-10-01T14:06:22.951117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8af0144c-11ee2ed4-e1b504d8-5989748c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:22.954009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0] Write session: try to update token
2025-10-01T14:06:22.954028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:22.982722Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:13:0
2025-10-01T14:06:22.982753Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1000 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:06:22.989627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:22.989647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:22.989650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:22.989652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:22.989662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254429340663451:2449]
2025-10-01T14:06:22.989666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254429340663451:2449]
2025-10-01T14:06:22.989670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254429340663451:2449]
2025-10-01T14:06:22.989717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:22.989726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:22.989728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:22.989954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:22.994444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:22.994452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:22.994456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:22.999615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:23.003300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:23.022925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254436012489433:2506]
2025-10-01T14:06:23.023668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3, pipe: [1:7556254436012489433:2506]
2025-10-01T14:06:23.143000Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:23.143306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.143315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.143353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489433:2506], now have 1 active actors on pipe
2025-10-01T14:06:23.143549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254436012489433:2506]
2025-10-01T14:06:23.143581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:23.143582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:23.143585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:23.143657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 4 reason: error at write: Disconnected sessionId: src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0
2025-10-01T14:06:23.143849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0 is DEAD
2025-10-01T14:06:23.144043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:23.144055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0] Write session will restart in 0.009487s
2025-10-01T14:06:23.144082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0] Write session: Do CDS request
2025-10-01T14:06:23.144091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:23.143582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:23.151120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:23.151774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:23.151954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:23.151958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:23.151967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:23.152002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:23.152048Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254433635630817:2453]
2025-10-01T14:06:23.152446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:23.152697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:23.152730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:23.153033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:23.153095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.153096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.153097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.153098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.153099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.153100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.153101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.153102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.153103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.153104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.153105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.153106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.153107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.153108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.153114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.153123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.153127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.153130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.153134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.153138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.153142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.153158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.153162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.153166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.153170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.153174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.153178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.153182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.153189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.153196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.153202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.153206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.153210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.153216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.153220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.153226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.153232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.153237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.153242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.153248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.153253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.153259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.153264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.153268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.153273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.153279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.153283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.153288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.153292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.153299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.153304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.153307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.153311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.153316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.153320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.153324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.153361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:23.154842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:23.155182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:23.155197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 5
2025-10-01T14:06:23.155308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:23.155346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 5 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:23.155356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=5 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:23.155359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:23.155795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 5 sessionId:  describe result for acl check
2025-10-01T14:06:23.155828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:23.155833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:23.155835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:23.155840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254436012489469:2527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:23.156336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254436012489469:2527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:23.157521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:23.157912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254436012489469:2527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:23.158363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:23.158388Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:23.158390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:23.158394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:23.158400Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 4 [2:7556254433635630817:2453]
2025-10-01T14:06:23.158417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:23.158433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:23.158436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.158440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.158442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.158460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:23.158475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:23.158481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:23.158541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.158549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.158551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.158554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:23.158560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:23.158626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:23.158634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.158645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.158655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.158675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:23.158698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489441:2446], now have 1 active actors on pipe
2025-10-01T14:06:23.158712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254433635630812:2453]
2025-10-01T14:06:23.158713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254433635630812:2453]
2025-10-01T14:06:23.158716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254433635630812:2453]
2025-10-01T14:06:23.158729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:23.158740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:23.158744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:23.158746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:23.158748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:23.158761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:23.158770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:23.158801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254433635630812:2453]
2025-10-01T14:06:23.158817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:23.158822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:23.158846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 4
2025-10-01T14:06:23.163683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254436012489469:2527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:23.163697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254436012489469:2527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:23.163700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254436012489469:2527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:23.163708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 5 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:23.163967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489507:2527], now have 1 active actors on pipe
2025-10-01T14:06:23.164003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 4
2025-10-01T14:06:23.164060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.164073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.164110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:23.164125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.164135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.164137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:23.164151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.164171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:23.164204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:23.164330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.164336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.164350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:23.164414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 5 partition: 0 MaxSeqNo: 45 sessionId: src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0
2025-10-01T14:06:23.164772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9fa8ccb-63eba9c-3bb1bfaa-495c9254_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:23.167761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0] Write session: try to update token
2025-10-01T14:06:23.167781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:23.170773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:23.170787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:23.170799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254433635630812:2453]
2025-10-01T14:06:23.170845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:23.170865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:23.170883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:23.170888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:23.171095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:23.171349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:23.171523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:23.171721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:23.171906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:23.171938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:23.188726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 5 sessionId: src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:23.190363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:23.190402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:23.190408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:23.190410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:23.190421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254433635630812:2453]
2025-10-01T14:06:23.190426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254433635630812:2453]
2025-10-01T14:06:23.190429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254433635630812:2453]
2025-10-01T14:06:23.190473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:23.190480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.190483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:23.190482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:23.190489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:23.190495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:123: PQ Cache (L2). Evicting blob. Tablet '72075186224037892' partition 0 offset 38 partno 0 count 3 parts 15 suffix '63' size 8295638
2025-10-01T14:06:23.190499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:23.190503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:23.190670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:23.193249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:23.243881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254436012489511:2506]
2025-10-01T14:06:23.244169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 4, pipe: [1:7556254436012489511:2506]
2025-10-01T14:06:23.336310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:23.336609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.336625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.336650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489511:2506], now have 1 active actors on pipe
2025-10-01T14:06:23.336864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:23.337372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:23.337383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0] Write session will restart in 0.005281s
2025-10-01T14:06:23.337410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0] Write session: Do CDS request
2025-10-01T14:06:23.337417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:23.336900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254436012489511:2506]
2025-10-01T14:06:23.336900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:23.336906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:23.336929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:23.336994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 5 reason: error at write: Disconnected sessionId: src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0
2025-10-01T14:06:23.337182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 5 sessionId: src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0 is DEAD
2025-10-01T14:06:23.343967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:23.344074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:23.344091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 6
2025-10-01T14:06:23.344274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:23.344321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 6 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:23.344331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=6 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:23.344337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:23.344507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:23.344799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 6 sessionId:  describe result for acl check
2025-10-01T14:06:23.344835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:23.344841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:23.344842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:23.344857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254436012489534:2531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:23.344944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:23.345100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:23.345109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:23.345120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:23.345182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:23.345418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254436012489534:2531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:23.345218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254433635630878:2455]
2025-10-01T14:06:23.345843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:23.346152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:23.346211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:23.346578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:23.346639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.346645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.346646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.346648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.346649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.346650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.346651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.346652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.346653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.346655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.346656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.346657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.346658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.346660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.346666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.346677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.346682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.346686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.346690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.346695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.346699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.346703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.346719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.346724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.346728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.346733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.346737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.346741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.346748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.346757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.346764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.346770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.346778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.346789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.346794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.346799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.346804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.346810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.346814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.346820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.346825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.346836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.346841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.346847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.346852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.346858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.346863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.346869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.346874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.346880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.346885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.346890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.346902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.346907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.346912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.346918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.346960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:23.347599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254436012489534:2531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:23.350401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254436012489534:2531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:23.350415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254436012489534:2531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:23.350419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254436012489534:2531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:23.350427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 6 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:23.350701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:23.351615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:23.351630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:23.351633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:23.351637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:23.351647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 5 [2:7556254433635630878:2455]
2025-10-01T14:06:23.351664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:23.351685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:23.351692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.351696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.351698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.351714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:23.351723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:23.351729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:23.351791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.351798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.351800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.351806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:23.351809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:23.351999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 5
2025-10-01T14:06:23.352040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 5
2025-10-01T14:06:23.351882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:23.351891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.351904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.351917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.351935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:23.351952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489513:2446], now have 1 active actors on pipe
2025-10-01T14:06:23.351956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489572:2531], now have 1 active actors on pipe
2025-10-01T14:06:23.351963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254433635630873:2455]
2025-10-01T14:06:23.351966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254433635630873:2455]
2025-10-01T14:06:23.351968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254433635630873:2455]
2025-10-01T14:06:23.351980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:23.351994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:23.352011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:23.352014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:23.352049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254433635630873:2455]
2025-10-01T14:06:23.352051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:23.352087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:23.352091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:23.352093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:23.352100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:23.352199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.352205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.352233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:23.352241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.352245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.352248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:23.352258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.352276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:23.352303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:23.352491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.352505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.352527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:23.352647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 6 partition: 0 MaxSeqNo: 45 sessionId: src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0
2025-10-01T14:06:23.353052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c636e9ee-aa61f786-62918f84-54b8f02c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:23.356114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0] Write session: try to update token
2025-10-01T14:06:23.356139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:23.378093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 6 sessionId: src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:23.389405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:23.400365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.400388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.400419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:23.400423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:23.400425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:23.400427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:23.400437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254433635630873:2455]
2025-10-01T14:06:23.400441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254433635630873:2455]
2025-10-01T14:06:23.400445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254433635630873:2455]
2025-10-01T14:06:23.400495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:23.400506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:23.400508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:23.400509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:23.400515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.400517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:23.401185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:23.438514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254436012489580:2506]
2025-10-01T14:06:23.439330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 5, pipe: [1:7556254436012489580:2506]
2025-10-01T14:06:23.575285Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:23.575558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:23.575619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489580:2506], now have 1 active actors on pipe
2025-10-01T14:06:23.576413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:23.576523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:23.576526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:23.576599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 6 reason: error at write: Disconnected sessionId: src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0
2025-10-01T14:06:23.576728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 6 sessionId: src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0 is DEAD
2025-10-01T14:06:23.576884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254436012489580:2506]
2025-10-01T14:06:23.576901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:23.578495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:23.578509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0] Write session will restart in 0.008086s
2025-10-01T14:06:23.578540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0] Write session: Do CDS request
2025-10-01T14:06:23.578550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:23.590867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:23.594391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:23.594406Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 7
2025-10-01T14:06:23.596771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:23.597493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:23.597674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:23.597678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:23.597688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:23.597742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:23.597781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254433635630941:2458]
2025-10-01T14:06:23.598432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:23.598501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:23.598548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 7 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:23.598553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=7 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:23.598558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:23.601226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:23.601290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:23.601622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:23.601688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.601689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.601690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.601691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.601692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.601693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.601694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.601695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.601696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.601697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.601698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.601699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.601700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.601701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.601706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.601715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.601718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.601722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.601725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.601729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.601732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.601735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.601738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.601742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.601745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.601748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.601751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.601755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.601761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.601768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.601773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.601778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.601781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.601786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.601790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.601794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.601799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.601803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.601808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.601812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.601816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.601821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.601825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.601829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.601834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.601838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.601841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.601845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.601849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.601853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.601857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.601862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.601869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.601875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.601878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.601884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.601939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:23.599019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 7 sessionId:  describe result for acl check
2025-10-01T14:06:23.599051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:23.599053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:23.599055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:23.599060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254436012489608:2536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:23.599574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254436012489608:2536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:23.606187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254436012489608:2536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:23.610815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:23.611600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:23.611615Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:23.611618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:23.611621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:23.611626Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 6 [2:7556254433635630941:2458]
2025-10-01T14:06:23.611642Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:23.611654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:23.611656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.611659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.611661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.611673Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:23.611676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:23.611681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:23.611728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.611735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.611736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.611738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:23.611741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:23.611803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:23.611808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.611815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.611821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.611830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:23.611843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254433635630935:2458]
2025-10-01T14:06:23.611844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254433635630935:2458]
2025-10-01T14:06:23.611846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254433635630935:2458]
2025-10-01T14:06:23.611851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:23.611861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:23.611869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:23.611871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:23.611871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:23.611873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:23.611875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:23.611904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489585:2446], now have 1 active actors on pipe
2025-10-01T14:06:23.611906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254433635630935:2458]
2025-10-01T14:06:23.611911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:23.612009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:23.612357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 6
2025-10-01T14:06:23.618521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254436012489608:2536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:23.618537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254436012489608:2536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:23.618541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254436012489608:2536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:23.618550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 7 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:23.618984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489649:2536], now have 1 active actors on pipe
2025-10-01T14:06:23.619103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 6
2025-10-01T14:06:23.619246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.619256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.619284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:23.619295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.619301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.619304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:23.619316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.619333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:23.619351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:23.619861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.619870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.619888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:23.620066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 7 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0
2025-10-01T14:06:23.626555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3de4cae9-4ec72aee-c2e17fd0-b7214f7e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:23.629426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0] Write session: try to update token
2025-10-01T14:06:23.629450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:23.641168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:23.641184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:23.641187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:23.641191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:23.641199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254433635630935:2458]
2025-10-01T14:06:23.641203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254433635630935:2458]
2025-10-01T14:06:23.641207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254433635630935:2458]
2025-10-01T14:06:23.641246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:23.641251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.641254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:23.641320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:23.641326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:23.641329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:23.641495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:23.664294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 7 sessionId: src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:23.667053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:23.676964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254436012489665:2506]
2025-10-01T14:06:23.677254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 6, pipe: [1:7556254436012489665:2506]
2025-10-01T14:06:23.810361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:23.811098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.811114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.811137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489665:2506], now have 1 active actors on pipe
2025-10-01T14:06:23.811626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:23.812785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254436012489665:2506]
2025-10-01T14:06:23.812799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:23.812817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:23.812910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 7 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0
2025-10-01T14:06:23.813085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 7 sessionId: src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0 is DEAD
2025-10-01T14:06:23.814679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:23.814711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0] Write session will restart in 0.008957s
2025-10-01T14:06:23.814773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0] Write session: Do CDS request
2025-10-01T14:06:23.814780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:23.825797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:23.826256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:23.826490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:23.826504Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:23.826516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:23.826565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:23.826620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254433635631017:2461]
2025-10-01T14:06:23.827023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:23.827223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:23.827483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:23.827527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:23.827647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:23.827659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 8
2025-10-01T14:06:23.827843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:23.827891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.827895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.827896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.827897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.827897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.827898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.827899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.827910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.827911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.827912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.827915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.827916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.827918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.827919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.827923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.827932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.827936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.827939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.827941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.827945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.827948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.827953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.827956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.827960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.827963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.827966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.827969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.827972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.827980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.827989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:23.827995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.827998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:23.828000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.828003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:23.828006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.828011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:23.828015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.828022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:23.828024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.828028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:23.828032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.828036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:23.828039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.828044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:23.828052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.828057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:23.828061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.828069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.828073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.828081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.828085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.828090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.828098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.828104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:23.828111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.828117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:23.828154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:23.828688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:23.828753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 8 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:23.828758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=8 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:23.828763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:23.829344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 8 sessionId:  describe result for acl check
2025-10-01T14:06:23.829380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:23.829382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:23.829386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:23.829391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254436012489696:2541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:23.829942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254436012489696:2541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:23.833359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254436012489696:2541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:23.834752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:23.835741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:23.835747Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:23.835750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:23.835754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:23.835761Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 7 [2:7556254433635631017:2461]
2025-10-01T14:06:23.835780Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:23.835798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:23.835803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.835807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.835809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.835827Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:23.835832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:23.835838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:23.835914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.835916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.835920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.835923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:23.835926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:23.836000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:23.836002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.836013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:23.836022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:23.836035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:23.836052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254433635631012:2461]
2025-10-01T14:06:23.836056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254433635631012:2461]
2025-10-01T14:06:23.836058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254433635631012:2461]
2025-10-01T14:06:23.836074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:23.836090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:23.836104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:23.836106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:23.836137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:23.836140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:23.836143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:23.836143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254433635631012:2461]
2025-10-01T14:06:23.836146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:23.836149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:23.836362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489668:2446], now have 1 active actors on pipe
2025-10-01T14:06:23.836620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 7
2025-10-01T14:06:23.845198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254436012489696:2541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:23.845213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254436012489696:2541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:23.845216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254436012489696:2541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:23.845226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 8 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:23.845786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489733:2541], now have 1 active actors on pipe
2025-10-01T14:06:23.845832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 7
2025-10-01T14:06:23.846011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.846027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.846057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:23.846067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:23.846074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:23.846076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:23.846096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:23.846115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:23.846136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:23.846387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:23.846393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:23.846403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:23.846541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 8 partition: 0 MaxSeqNo: 45 sessionId: src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0
2025-10-01T14:06:23.848807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17b8a1-1d5de003-c5eb5c4e-7655da2c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:23.854778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0] Write session: try to update token
2025-10-01T14:06:23.854802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:23.874154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:23.874173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:23.874175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:23.874177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:23.874186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254433635631012:2461]
2025-10-01T14:06:23.874193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254433635631012:2461]
2025-10-01T14:06:23.874196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254433635631012:2461]
2025-10-01T14:06:23.874246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:23.874253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:23.874255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:23.874414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:23.886433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:23.886450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:23.886455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:23.887067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 8 sessionId: src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:23.889856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:23.913339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254436012489751:2506]
2025-10-01T14:06:23.913772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 7, pipe: [1:7556254436012489751:2506]
2025-10-01T14:06:24.039221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:24.039501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.039519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.039559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254436012489751:2506], now have 1 active actors on pipe
2025-10-01T14:06:24.039834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:24.040396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:24.040438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:24.040514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 8 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0
2025-10-01T14:06:24.040666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 8 sessionId: src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0 is DEAD
2025-10-01T14:06:24.040816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:24.040828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0] Write session will restart in 0.007568s
2025-10-01T14:06:24.040865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0] Write session: Do CDS request
2025-10-01T14:06:24.040819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254436012489751:2506]
2025-10-01T14:06:24.040872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:24.047763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:24.048217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:24.048412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:24.048422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:24.048431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:24.048478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:24.048516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254437930598410:2475]
2025-10-01T14:06:24.049115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:24.049379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:24.049422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:24.049724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:24.049781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.049787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.049788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.049789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.049790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.049791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.049792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.049793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.049794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.049795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.049796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.049797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.049798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.049799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.049804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.049813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.049816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.049820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.049838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.049842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.049846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.049850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.049853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.049857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.049861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.049869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.049864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.049868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.049871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.049878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.049885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.049891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.049897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.049900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.049906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.049912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.049925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.049931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.049939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.049943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.049948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.049956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.049961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.049965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.049974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.049981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.049990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.049954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:24.049995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.049969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 9
2025-10-01T14:06:24.050003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.050007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.050011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.050017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.050022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.050026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.050031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.050040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.050044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.050081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:24.050138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.050176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 9 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:24.050186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=9 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:24.050190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:24.050566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 9 sessionId:  describe result for acl check
2025-10-01T14:06:24.050608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:24.050609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:24.050611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:24.050616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254440307457089:2552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:24.051237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254440307457089:2552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:24.052967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254440307457089:2552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:24.054729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:24.055473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:24.055489Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:24.055493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:24.055498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:24.055504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 8 [2:7556254437930598410:2475]
2025-10-01T14:06:24.055517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:24.055534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:24.055540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.055544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.055546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.055564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:24.055570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:24.055580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:24.055573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254440307457089:2552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:24.055587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254440307457089:2552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:24.055591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254440307457089:2552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:24.055598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 9 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:24.055633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.055642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.055645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.055648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:24.055650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:24.055714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:24.055723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.055734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.055744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.055757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:24.055777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457060:2446], now have 1 active actors on pipe
2025-10-01T14:06:24.055784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457121:2552], now have 1 active actors on pipe
2025-10-01T14:06:24.055791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254437930598405:2475]
2025-10-01T14:06:24.055796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254437930598405:2475]
2025-10-01T14:06:24.055798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254437930598405:2475]
2025-10-01T14:06:24.055809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:24.055822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:24.055824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:24.055830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:24.055836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:24.055839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:24.055844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:24.055827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 8
2025-10-01T14:06:24.055842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 8
2025-10-01T14:06:24.056283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 9 partition: 0 MaxSeqNo: 45 sessionId: src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0
2025-10-01T14:06:24.055869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254437930598405:2475]
2025-10-01T14:06:24.055888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:24.055910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.055915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.055917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:24.055957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:24.055962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.055965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.055966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:24.055974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.055983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:24.055996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.056187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.056193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.056215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.056631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e7545c-521b8f85-92437e60-aa6cf69f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:24.059613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0] Write session: try to update token
2025-10-01T14:06:24.059632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:24.079934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 9 sessionId: src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:24.082689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:24.084486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.084514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.084534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:24.084537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:24.084539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:24.084541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:24.084549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254437930598405:2475]
2025-10-01T14:06:24.084556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254437930598405:2475]
2025-10-01T14:06:24.084560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254437930598405:2475]
2025-10-01T14:06:24.084603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:24.084615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:24.084620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:24.084622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:24.084629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.084631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:24.084760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:24.142438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254440307457134:2506]
2025-10-01T14:06:24.146712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 8, pipe: [1:7556254440307457134:2506]
2025-10-01T14:06:24.225917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:24.226226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:24.226282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457134:2506], now have 1 active actors on pipe
2025-10-01T14:06:24.226927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:24.226938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0] Write session will restart in 0.007978s
2025-10-01T14:06:24.226960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0] Write session: Do CDS request
2025-10-01T14:06:24.226966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:24.226421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:24.226533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:24.226536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:24.226626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 9 reason: error at write: Disconnected sessionId: src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0
2025-10-01T14:06:24.226780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 9 sessionId: src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0 is DEAD
2025-10-01T14:06:24.226935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254440307457134:2506]
2025-10-01T14:06:24.226956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:24.234159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:24.234706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:24.234927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:24.234931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:24.234941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:24.234994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:24.235050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254437930598477:2479]
2025-10-01T14:06:24.235653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:24.236175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:24.236226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:24.236557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:24.236616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.236621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.236622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.236623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.236624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.236624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.236625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.236626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.236627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.236628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.236629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.236630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.236630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.236631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.236636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.236647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.236651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.236654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.236657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.236660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.236663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.236667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.236671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.236675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.236679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.236683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.236686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.236690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.236697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.236705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.236711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.236717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.236721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.236727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.236731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.236737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.236742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.236747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.236751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.236756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.236761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.236766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.236771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.236776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.236781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.236786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.236790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.236795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.236802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.236807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.236814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.236819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.236824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.236832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.236836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.236844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.236905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:24.242517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:24.242802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.243155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:24.243170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 10
2025-10-01T14:06:24.243359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.243386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 10 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:24.243390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=10 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:24.243394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:24.243342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:24.243356Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:24.243359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:24.243363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:24.243369Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 9 [2:7556254437930598477:2479]
2025-10-01T14:06:24.243387Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:24.243406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:24.243408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.243411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.243413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.243427Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:24.243433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:24.243439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:24.243514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.243516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.243518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.243521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:24.243523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:24.243575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:24.243577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.243585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.243591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.243599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:24.243611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254437930598472:2479]
2025-10-01T14:06:24.243618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254437930598472:2479]
2025-10-01T14:06:24.243619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254437930598472:2479]
2025-10-01T14:06:24.243628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:24.243637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:24.243646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:24.243648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:24.243672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254437930598472:2479]
2025-10-01T14:06:24.243673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:24.243807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:24.243811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:24.243812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:24.243816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:24.244017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457139:2446], now have 1 active actors on pipe
2025-10-01T14:06:24.243857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 10 sessionId:  describe result for acl check
2025-10-01T14:06:24.243884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:24.243885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:24.243887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:24.243893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254440307457169:2557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:24.244031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 9
2025-10-01T14:06:24.244405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254440307457169:2557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:24.248036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254440307457169:2557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:24.257802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254440307457169:2557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:24.257816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254440307457169:2557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:24.257820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254440307457169:2557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:24.257829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 10 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:24.258590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 9
2025-10-01T14:06:24.260464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457206:2557], now have 1 active actors on pipe
2025-10-01T14:06:24.260498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.260504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.260528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:24.260538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.260542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.260544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:24.260556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.260570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:24.260583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.261654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.261667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.261692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.261826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 10 partition: 0 MaxSeqNo: 45 sessionId: src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0
2025-10-01T14:06:24.262562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cb909-465d1a97-39f22ebe-4fc3e370_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:24.266146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0] Write session: try to update token
2025-10-01T14:06:24.266167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:24.280260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:24.280278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:24.280281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:24.280283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:24.280292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254437930598472:2479]
2025-10-01T14:06:24.280296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254437930598472:2479]
2025-10-01T14:06:24.280300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254437930598472:2479]
2025-10-01T14:06:24.280346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:24.280353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.280356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:24.280407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:24.280413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:24.280416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:24.280549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:24.298759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 10 sessionId: src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:24.301817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:24.326700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254440307457210:2506]
2025-10-01T14:06:24.326956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 9, pipe: [1:7556254440307457210:2506]
2025-10-01T14:06:24.421897Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:24.422197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.422212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.422250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457210:2506], now have 1 active actors on pipe
2025-10-01T14:06:24.422611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:24.422624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254440307457210:2506]
2025-10-01T14:06:24.422656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:24.422658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:24.422517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:24.422730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 10 reason: error at write: Disconnected sessionId: src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0
2025-10-01T14:06:24.422932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 10 sessionId: src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0 is DEAD
2025-10-01T14:06:24.423343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:24.423357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0] Write session will restart in 0.006628s
2025-10-01T14:06:24.423387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0] Write session: Do CDS request
2025-10-01T14:06:24.423394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:24.430904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.431319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:24.431333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 11
2025-10-01T14:06:24.431496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.431519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 11 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:24.431523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=11 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:24.431526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:24.431848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 11 sessionId:  describe result for acl check
2025-10-01T14:06:24.431884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:24.431891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:24.431893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:24.431898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254440307457225:2561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:24.432318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254440307457225:2561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:24.435335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254440307457225:2561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:24.436483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:24.442085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:24.442388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:24.442404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:24.442418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:24.442476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:24.442532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254437930598542:2481]
2025-10-01T14:06:24.442566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254440307457225:2561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:24.442583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254440307457225:2561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:24.442586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254440307457225:2561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:24.442596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 11 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:24.450423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:24.451029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:24.451100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:24.451574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:24.451662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.451664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.451665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.451666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.451667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.451674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.451676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.451677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.451678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.451679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.451680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.451682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.451683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.451684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.451692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.451702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.451706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.451709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.451713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.451717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.451720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.451783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.451788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.451792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.451796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.451800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.451803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.451806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.451818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.451827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.451837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.451842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.451848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.451853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.451858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.451863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.451872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.451877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.451882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.451887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.451891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.451897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.451901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.451906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.451911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.451916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.451921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.451926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.451931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.451936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.451940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.451945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.451953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.451958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.451965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.451970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.452002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:24.456396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:24.458045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:24.458062Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:24.458065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:24.458069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:24.458077Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 10 [2:7556254437930598542:2481]
2025-10-01T14:06:24.458101Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:24.458117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:24.458121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.458124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.458128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.458145Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:24.458157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:24.458163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:24.458223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.458232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.458235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.458238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:24.458241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:24.458312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:24.458322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.458336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.458348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.458365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:24.458400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457273:2561], now have 1 active actors on pipe
2025-10-01T14:06:24.458403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457213:2446], now have 1 active actors on pipe
2025-10-01T14:06:24.458411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254437930598537:2481]
2025-10-01T14:06:24.458413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254437930598537:2481]
2025-10-01T14:06:24.458416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254437930598537:2481]
2025-10-01T14:06:24.458428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:24.458441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:24.458441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:24.458445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:24.458447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:24.458455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:24.458458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:24.458493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254437930598537:2481]
2025-10-01T14:06:24.458499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:24.458506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:24.458558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 10
2025-10-01T14:06:24.458588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 10
2025-10-01T14:06:24.459215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.459229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.459262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|545a7f28-b564b364-40b76eed-eb074ae9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:24.459274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.459282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.459285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:24.459294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.459320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:24.459341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.459666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.459676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.459694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.459846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 11 partition: 0 MaxSeqNo: 45 sessionId: src_id|545a7f28-b564b364-40b76eed-eb074ae9_0
2025-10-01T14:06:24.460268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b342d4de-5ae3fa3-876bf8c2-a7285992_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|545a7f28-b564b364-40b76eed-eb074ae9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:24.463083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545a7f28-b564b364-40b76eed-eb074ae9_0] Write session: try to update token
2025-10-01T14:06:24.463101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545a7f28-b564b364-40b76eed-eb074ae9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:24.483799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 11 sessionId: src_id|545a7f28-b564b364-40b76eed-eb074ae9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:24.486470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:24.487694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.487726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.487762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:24.487892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:24.494020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:24.494043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:24.494045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:24.494047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:24.494057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254437930598537:2481]
2025-10-01T14:06:24.494061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254437930598537:2481]
2025-10-01T14:06:24.494065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254437930598537:2481]
2025-10-01T14:06:24.494124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:24.494131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.494133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:24.494324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:24.494426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:24.494438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:24.494441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:24.522846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254440307457287:2506]
2025-10-01T14:06:24.523430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 10, pipe: [1:7556254440307457287:2506]
2025-10-01T14:06:24.636663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:24.654233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.654259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.654465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.654545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.654618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.654737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.654787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.654791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.654917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.654981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.655059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.655119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.655174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.655176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.655255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.655339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.655419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.655503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.655600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.655601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.655661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.655714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.655766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.655820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.655932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.655936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.655996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.656047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.656098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.656147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.656245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.656248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.656301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.656347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.656398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.656455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.656556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.656558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.656627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.656695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.656761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.656824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.656902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.656904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.656982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.657041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.657101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.657159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.657270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.657272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.657344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.657399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.657464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.657533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.657621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.657623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.657693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:24.657753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:24.657810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:24.657874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:24.657935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:24.657943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:24.658018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457287:2506], now have 1 active actors on pipe
2025-10-01T14:06:24.659588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545a7f28-b564b364-40b76eed-eb074ae9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:24.659607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545a7f28-b564b364-40b76eed-eb074ae9_0] Write session will restart in 0.007889s
2025-10-01T14:06:24.659630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545a7f28-b564b364-40b76eed-eb074ae9_0] Write session: Do CDS request
2025-10-01T14:06:24.659637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545a7f28-b564b364-40b76eed-eb074ae9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:24.659149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:24.659161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:24.659703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:24.659168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:24.659189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 11 reason: error at write: Disconnected sessionId: src_id|545a7f28-b564b364-40b76eed-eb074ae9_0
2025-10-01T14:06:24.659211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254440307457287:2506]
2025-10-01T14:06:24.659399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 11 sessionId: src_id|545a7f28-b564b364-40b76eed-eb074ae9_0 is DEAD
2025-10-01T14:06:24.669039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|545a7f28-b564b364-40b76eed-eb074ae9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.671297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:24.671309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 12
2025-10-01T14:06:24.671687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.671719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 12 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:24.671724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=12 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:24.671727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:24.672230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 12 sessionId:  describe result for acl check
2025-10-01T14:06:24.672261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:24.672262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:24.672263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:24.672268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254440307457329:2567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:24.672775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254440307457329:2567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:24.670905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:24.671992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:24.672213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:24.672217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:24.672229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:24.672278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:24.672333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254437930598621:2485]
2025-10-01T14:06:24.672894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:24.673233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:24.673264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:24.673553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:24.673605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.673606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.673607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.673608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.673609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.673610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.673611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.673612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.673613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.673614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.673615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.673616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.673618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.673619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.673623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.673631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.673634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.673637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.673640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.673643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.673646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.673652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.673655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.673659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.673662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.673665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.673668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.673671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.673677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.673683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.673689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.673693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.673696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.673701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.673704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.673709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.673712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.673716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.673720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.673724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.673727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.673731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.673737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.673741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.673745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.673749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.673752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.673756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.673760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.673764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.673768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.673772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.673779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.673783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.673786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.673790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.673825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:24.676484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254440307457329:2567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:24.680788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254440307457329:2567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:24.680803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254440307457329:2567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:24.680806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254440307457329:2567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:24.680815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 12 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:24.682456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:24.683123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:24.683141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:24.683144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:24.683147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:24.683152Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 11 [2:7556254437930598621:2485]
2025-10-01T14:06:24.683163Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:24.683177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:24.683178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.683181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.683182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.683195Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:24.683199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:24.683203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:24.683249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.683262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.683264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.683267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:24.683271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:24.683347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:24.683356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.683366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.683376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.683390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:24.683411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254437930598614:2485]
2025-10-01T14:06:24.683413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254437930598614:2485]
2025-10-01T14:06:24.683414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254437930598614:2485]
2025-10-01T14:06:24.683429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:24.683443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:24.683457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:24.683460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:24.683509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254437930598614:2485]
2025-10-01T14:06:24.683511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:24.683628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:24.683629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:24.683635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:24.683640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:24.684514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 11
2025-10-01T14:06:24.684535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 11
2025-10-01T14:06:24.684720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457366:2567], now have 1 active actors on pipe
2025-10-01T14:06:24.684728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457302:2446], now have 1 active actors on pipe
2025-10-01T14:06:24.684738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.684742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.684767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:24.684773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.684776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.684778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:24.684785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.684795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:24.684808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.685278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.685285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.685299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.685422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 12 partition: 0 MaxSeqNo: 45 sessionId: src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0
2025-10-01T14:06:24.685865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|545a7f28-b564b364-40b76eed-eb074ae9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:24.700355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0] Write session: try to update token
2025-10-01T14:06:24.700380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:24.715626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:24.715650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:24.715652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:24.715653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:24.715667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254437930598614:2485]
2025-10-01T14:06:24.715670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254437930598614:2485]
2025-10-01T14:06:24.715674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254437930598614:2485]
2025-10-01T14:06:24.715724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:24.715731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:24.715735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.715738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:24.715738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:24.715742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:24.715916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:24.716070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 12 sessionId: src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:24.718798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:24.759346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254440307457375:2506]
2025-10-01T14:06:24.759777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 11, pipe: [1:7556254440307457375:2506]
2025-10-01T14:06:24.851727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:24.852050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.852068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.852109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457375:2506], now have 1 active actors on pipe
2025-10-01T14:06:24.852353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:24.852402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:24.852413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:24.852483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 12 reason: error at write: Disconnected sessionId: src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0
2025-10-01T14:06:24.852651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:24.852659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 12 sessionId: src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0 is DEAD
2025-10-01T14:06:24.852704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254440307457375:2506]
2025-10-01T14:06:24.852821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:24.852833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0] Write session will restart in 0.008012s
2025-10-01T14:06:24.852873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0] Write session: Do CDS request
2025-10-01T14:06:24.852880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:24.862126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.862249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:24.862264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 13
2025-10-01T14:06:24.862867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:24.862904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 13 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:24.862909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=13 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:24.862913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:24.863694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 13 sessionId:  describe result for acl check
2025-10-01T14:06:24.863737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:24.863739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:24.863740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:24.863745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254440307457402:2571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:24.864225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254440307457402:2571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:24.865922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:24.867105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254440307457402:2571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:24.869144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:24.869390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:24.869405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:24.869419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:24.869483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:24.869529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254437930598687:2487]
2025-10-01T14:06:24.870131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:24.872870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254440307457402:2571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:24.872886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254440307457402:2571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:24.872890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254440307457402:2571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:24.872899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 13 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:24.874486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:24.874565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:24.874919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:24.875010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.875017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.875019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.875020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.875021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.875023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.875024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.875026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.875027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.875028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.875032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.875033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.875034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.875035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.875042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.875052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.875055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.875058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.875062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.875066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.875069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.875072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.875076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.875080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.875083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.875086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.875090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.875093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.875103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.875110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:24.875117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.875122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:24.875126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.875131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:24.875136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.875141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:24.875146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.875151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:24.875156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.875160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:24.875175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.875181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:24.875185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.875190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:24.875194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.875198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:24.875202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.875206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.875212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.875216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.875219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.875224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.875228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.875233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:24.875237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.875242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:24.875282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:24.881402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:24.882240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:24.882259Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:24.882261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:24.882265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:24.882272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 12 [2:7556254437930598687:2487]
2025-10-01T14:06:24.882288Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:24.882308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:24.882311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.882315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.882317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.882338Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:24.882354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:24.882364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:24.882451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.882458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.882460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.882462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:24.882465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:24.882547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:24.882554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.882566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:24.882582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:24.882601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:24.882625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457377:2446], now have 1 active actors on pipe
2025-10-01T14:06:24.882628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457442:2571], now have 1 active actors on pipe
2025-10-01T14:06:24.882637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254437930598681:2487]
2025-10-01T14:06:24.882639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254437930598681:2487]
2025-10-01T14:06:24.882641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254437930598681:2487]
2025-10-01T14:06:24.882654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:24.882668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:24.882671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:24.882678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:24.882680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:24.882684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:24.882687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:24.882725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254437930598681:2487]
2025-10-01T14:06:24.882732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:24.882735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:24.882703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 12
2025-10-01T14:06:24.882750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 12
2025-10-01T14:06:24.882924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.882936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.882962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:24.882973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:24.882978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:24.882982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:24.882991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:24.883003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:24.883024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.883220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:24.883228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:24.883244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:24.883336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 13 partition: 0 MaxSeqNo: 45 sessionId: src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0
2025-10-01T14:06:24.883724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8564d340-a67e743a-8f25c9c8-4f3df492_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:24.899495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0] Write session: try to update token
2025-10-01T14:06:24.899521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:24.913146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:24.913166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:24.913169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:24.913171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:24.913182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254437930598681:2487]
2025-10-01T14:06:24.913186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254437930598681:2487]
2025-10-01T14:06:24.913191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254437930598681:2487]
2025-10-01T14:06:24.913247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:24.913252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:24.913258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:24.913260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:24.913260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:24.913264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:24.913469Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:24.923030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 13 sessionId: src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:24.947574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:24.952864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254440307457456:2506]
2025-10-01T14:06:24.953068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 12, pipe: [1:7556254440307457456:2506]
2025-10-01T14:06:25.059275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:25.059591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.059606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.059628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254440307457456:2506], now have 1 active actors on pipe
2025-10-01T14:06:25.059808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:25.059863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:25.059915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254440307457456:2506]
2025-10-01T14:06:25.059945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:25.060024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 13 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0
2025-10-01T14:06:25.060203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 13 sessionId: src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0 is DEAD
2025-10-01T14:06:25.060388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:25.060399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0] Write session will restart in 0.006977s
2025-10-01T14:06:25.060437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0] Write session: Do CDS request
2025-10-01T14:06:25.060444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:25.068935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.069018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:25.069034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 14
2025-10-01T14:06:25.069306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.069333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 14 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:25.069337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=14 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:25.069342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:25.069786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 14 sessionId:  describe result for acl check
2025-10-01T14:06:25.069812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:25.069814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:25.069815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:25.069821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254444602424795:2582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:25.070346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254444602424795:2582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:25.072740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254444602424795:2582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:25.075433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:25.076441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:25.076624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:25.076636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:25.076646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:25.076697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:25.076744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254442225566090:2501]
2025-10-01T14:06:25.077416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:25.077691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:25.077738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:25.078082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:25.078154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.078164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.078165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.078166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.078167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.078169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.078170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.078171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.078172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.078174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.078175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.078176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.078177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.078178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.078184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.078194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.078198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.078202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.078206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.078211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.078215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.078219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.078223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.078228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.078232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.078236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.078240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.078245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.078252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.078260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.078269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.078275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.078280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.078286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.078291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.078297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.078303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.078309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.078313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.078319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.078326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.078332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.078337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.078343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.078348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.078353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.078360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.078366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.078390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.078395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.078410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.078415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.078421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.078427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.078438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.078443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.078489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:25.078896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254444602424795:2582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:25.078911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254444602424795:2582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:25.078915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254444602424795:2582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:25.078924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 14 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:25.082743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:25.083448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:25.083472Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:25.083475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:25.083480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:25.083491Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 13 [2:7556254442225566090:2501]
2025-10-01T14:06:25.083511Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:25.083529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:25.083538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.083541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.083544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.083561Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:25.083567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:25.083574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:25.083636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.083645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.083648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.083650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:25.083653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:25.083734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:25.083742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.083753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.083765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.083785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:25.083809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254442225566082:2501]
2025-10-01T14:06:25.083817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254442225566082:2501]
2025-10-01T14:06:25.083819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254442225566082:2501]
2025-10-01T14:06:25.083836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:25.083843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:25.083847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:25.083849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:25.083856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602424777:2446], now have 1 active actors on pipe
2025-10-01T14:06:25.083861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602424848:2582], now have 1 active actors on pipe
2025-10-01T14:06:25.083868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:25.083881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:25.083892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:25.083923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254442225566082:2501]
2025-10-01T14:06:25.083935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:25.083970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:25.083941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 13
2025-10-01T14:06:25.083977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 13
2025-10-01T14:06:25.084184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.084194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.084218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acbe627c-c63f6e27-4af605ce-52273691_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:25.084231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.084235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.084237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:25.084247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.084262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:25.084280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.085597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.085613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.085633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.086203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dd074c4-31cc40cb-90bef1e8-40d6f7c5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|acbe627c-c63f6e27-4af605ce-52273691_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:25.089292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acbe627c-c63f6e27-4af605ce-52273691_0] Write session: try to update token
2025-10-01T14:06:25.089311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acbe627c-c63f6e27-4af605ce-52273691_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:25.085814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 14 partition: 0 MaxSeqNo: 45 sessionId: src_id|acbe627c-c63f6e27-4af605ce-52273691_0
2025-10-01T14:06:25.110426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:25.110453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:25.110456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:25.110458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:25.110473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254442225566082:2501]
2025-10-01T14:06:25.110478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254442225566082:2501]
2025-10-01T14:06:25.110483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254442225566082:2501]
2025-10-01T14:06:25.110539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:25.110552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.110554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:25.110706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:25.112315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:25.112321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:25.112325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:25.117843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 14 sessionId: src_id|acbe627c-c63f6e27-4af605ce-52273691_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:25.120698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:25.160237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254444602424862:2506]
2025-10-01T14:06:25.160594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 13, pipe: [1:7556254444602424862:2506]
2025-10-01T14:06:25.252225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:25.252541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.252550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.252589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602424862:2506], now have 1 active actors on pipe
2025-10-01T14:06:25.252835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:25.252900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:25.253345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbe627c-c63f6e27-4af605ce-52273691_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:25.252950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254444602424862:2506]
2025-10-01T14:06:25.252965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:25.253355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbe627c-c63f6e27-4af605ce-52273691_0] Write session will restart in 0.009158s
2025-10-01T14:06:25.253039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 14 reason: status is not ok: tablet will be restarted right now sessionId: src_id|acbe627c-c63f6e27-4af605ce-52273691_0
2025-10-01T14:06:25.253187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 14 sessionId: src_id|acbe627c-c63f6e27-4af605ce-52273691_0 is DEAD
2025-10-01T14:06:25.253379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbe627c-c63f6e27-4af605ce-52273691_0] Write session: Do CDS request
2025-10-01T14:06:25.253385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbe627c-c63f6e27-4af605ce-52273691_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:25.265744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acbe627c-c63f6e27-4af605ce-52273691_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.266602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:25.266620Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 15
2025-10-01T14:06:25.267275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.267322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 15 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:25.267333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=15 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:25.267337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:25.268210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:25.269083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 15 sessionId:  describe result for acl check
2025-10-01T14:06:25.269127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:25.269128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:25.269130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:25.269136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254444602424895:2587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:25.269657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254444602424895:2587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:25.270611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:25.270878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:25.270882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:25.270897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:25.270954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:25.270991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254442225566160:2505]
2025-10-01T14:06:25.271621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:25.272286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:25.272343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:25.272698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:25.272761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.272762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.272764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.272765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.272766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.272768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.272769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.272770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.272771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.272772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.272774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.272775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.272776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.272777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.272783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.272794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.272797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.272801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.272807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.272811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.272814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.272818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.272821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.272826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.272829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.272832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.272835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.272838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.272845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.272868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.272874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.272881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.272886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.272891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.272898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.272903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.272907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.272912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.272916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.272921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.272927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.272932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.272936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.272941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.272945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.272949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.272953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.272957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.272961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.272967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.272974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.272980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.272985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.272990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.272994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.272999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.273045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:25.275549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254444602424895:2587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:25.280627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254444602424895:2587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:25.280648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254444602424895:2587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:25.280652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254444602424895:2587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:25.280661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 15 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:25.281545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:25.282241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:25.282259Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:25.282263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:25.282266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:25.282273Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 14 [2:7556254442225566160:2505]
2025-10-01T14:06:25.282290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:25.282308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:25.282316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.282319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.282321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.282339Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:25.282348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:25.282354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:25.282464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.282475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.282478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.282481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:25.282484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:25.282558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:25.282565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.282582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.282592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.282613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:25.282635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254442225566154:2505]
2025-10-01T14:06:25.282641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254442225566154:2505]
2025-10-01T14:06:25.282642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254442225566154:2505]
2025-10-01T14:06:25.282653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:25.282787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 14
2025-10-01T14:06:25.282835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 14
2025-10-01T14:06:25.282661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:25.282671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:25.282671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:25.282677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:25.282685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:25.282688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:25.282699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602424865:2446], now have 1 active actors on pipe
2025-10-01T14:06:25.282703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602424933:2587], now have 1 active actors on pipe
2025-10-01T14:06:25.282739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254442225566154:2505]
2025-10-01T14:06:25.282748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:25.282761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:25.282930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.282937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.282963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:25.282977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.282983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.282985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:25.282995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.283005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:25.283028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.283221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.283230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.283246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.283381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 15 partition: 0 MaxSeqNo: 45 sessionId: src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0
2025-10-01T14:06:25.283799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbe627c-c63f6e27-4af605ce-52273691_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:25.286816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0] Write session: try to update token
2025-10-01T14:06:25.286834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:25.303918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:25.303942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:25.303957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254442225566154:2505]
2025-10-01T14:06:25.304010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:25.304032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:25.304190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:25.304342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:25.304488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:25.304634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:25.304875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:25.304940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:25.305632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 15 sessionId: src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:25.308649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:25.313637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.313665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.313708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:25.313865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:25.356325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254444602424940:2506]
2025-10-01T14:06:25.356553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.356585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.356787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.356868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.356932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.356998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.357050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.357055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.357141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.357204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.357266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.357332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.357385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.357389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.357464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.357532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.357603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.357666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.357789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.357797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.357870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.357936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.358002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.358071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.358115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.358118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.358193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.358256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.358322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.358819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 14, pipe: [1:7556254444602424940:2506]
2025-10-01T14:06:25.358806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.358868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.358871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.358958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.359025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.359094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.359169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.359227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.359230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.359314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.359378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.359451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.359522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.359578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.359582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.359663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.359735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.359806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.359875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.360184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.360190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.360270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.360340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.360409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.360485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.360619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.360624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.360827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.360907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.360980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.361054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.361138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.361142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.361245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602424940:2506], now have 1 active actors on pipe
2025-10-01T14:06:25.361254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:25.361316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.361336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.361339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:06:25.361359Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361369Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361374Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361378Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361382Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361386Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361390Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361394Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361399Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361403Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361406Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361410Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361414Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361418Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361421Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361428Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361435Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361439Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361443Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361446Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361449Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361453Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361456Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361461Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361464Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361468Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361471Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361475Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361478Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361481Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361484Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361489Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361495Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361498Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361502Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:25.361829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:06:25.361842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:06:25.361846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:06:25.361849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:06:25.361852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:06:25.362295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:06:25.362314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:06:25.362325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:06:25.362331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:06:25.362334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:06:25.362337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:06:25.368145Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:06:25.368192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:06:25.368205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:06:25.368209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:06:25.368213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:06:25.368217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:06:25.368811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:06:25.368824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.368972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327585368
2025-10-01T14:06:25.372377Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:25.372400Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:06:25.372414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:25.372417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:25.372420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:25.372423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:25.372432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254442225566154:2505]
2025-10-01T14:06:25.372437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254442225566154:2505]
2025-10-01T14:06:25.372442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254442225566154:2505]
2025-10-01T14:06:25.372526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:25.372531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.372533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:25.372823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:25.378461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:25.378482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:25.378486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:25.512448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:25.515134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:25.515147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0] Write session will restart in 0.005273s
2025-10-01T14:06:25.514654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254444602424940:2506]
2025-10-01T14:06:25.514685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:25.514723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:25.515173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0] Write session: Do CDS request
2025-10-01T14:06:25.514726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:25.514754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 15 reason: error at write: Disconnected sessionId: src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0
2025-10-01T14:06:25.515182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:25.514942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 15 sessionId: src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0 is DEAD
2025-10-01T14:06:25.514887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:25.521908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.522106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:25.522121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 16
2025-10-01T14:06:25.522310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.522338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 16 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:25.522342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=16 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:25.522346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:25.522807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 16 sessionId:  describe result for acl check
2025-10-01T14:06:25.522834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:25.522836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:25.522837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:25.522841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254444602424953:2592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:25.523325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254444602424953:2592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:25.526557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254444602424953:2592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:25.531497Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [e273d4a9e607e188] Result# TEvPutResult {Id# [72075186224037892:14:1:2:1:6759616:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-01T14:06:25.531966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254444602424953:2592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:25.531987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254444602424953:2592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:25.531991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254444602424953:2592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:25.531998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 16 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:25.540255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:25.541028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:25.541291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:25.541295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:25.541306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:25.541375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:25.541420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254442225566237:2508]
2025-10-01T14:06:25.542164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:25.542994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:25.543044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:25.543466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:25.543527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.543530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.543532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.543533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.543534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.543535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.543536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.543537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.543538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.543540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.543541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.543542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.543543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.543544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.543550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.543561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.543566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.543570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.543574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.543579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.543583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.543587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.543592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.543596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.543600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.543604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.543609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.543613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.543621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.543629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.543637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.543642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.543648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.543654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.543658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.543664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.543669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.543674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.543678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.543684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.543690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.543696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.543701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.543706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.543712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.543718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.543722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.543727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.543732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.543738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.543742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.543749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.543754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.543759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.543764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.543770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.543817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:25.549354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:25.549968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:25.549974Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:25.549977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:25.549982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:25.549990Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 15 [2:7556254442225566237:2508]
2025-10-01T14:06:25.550005Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:25.550027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:25.550030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.550034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.550037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.550053Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:25.550058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:25.550216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:25.550302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.550307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.550310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.550313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:25.550316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:25.550919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 15
2025-10-01T14:06:25.550957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 15
2025-10-01T14:06:25.551223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:25.551233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.551249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.551263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.551282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:25.551307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602424945:2446], now have 1 active actors on pipe
2025-10-01T14:06:25.551310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602424989:2592], now have 1 active actors on pipe
2025-10-01T14:06:25.551325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.551331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.551345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254442225566231:2508]
2025-10-01T14:06:25.551348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254442225566231:2508]
2025-10-01T14:06:25.551350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254442225566231:2508]
2025-10-01T14:06:25.551362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:25.551379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:25.551396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:25.551402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:25.551419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:25.551427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.551431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.551433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:25.551442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.551455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:25.551495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254442225566231:2508]
2025-10-01T14:06:25.551498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:25.551509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.551661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:25.551675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:25.551677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:25.551683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:25.552296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.552306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.552325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.552422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 16 partition: 0 MaxSeqNo: 45 sessionId: src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0
2025-10-01T14:06:25.552858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbbceaac-20dc6813-4cd14c56-1fd06a28_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:25.555763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0] Write session: try to update token
2025-10-01T14:06:25.555783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:25.577107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:25.577127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:25.577129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:25.577132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:25.577142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254442225566231:2508]
2025-10-01T14:06:25.577152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254442225566231:2508]
2025-10-01T14:06:25.577155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254442225566231:2508]
2025-10-01T14:06:25.577206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:25.577217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.577219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:25.577397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:25.578532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:25.578545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:25.578549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:25.579541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 16 sessionId: src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:25.584546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:25.614978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254444602425028:2506]
2025-10-01T14:06:25.615677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 15, pipe: [1:7556254444602425028:2506]
2025-10-01T14:06:25.721475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:25.721772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.721788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.721806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602425028:2506], now have 1 active actors on pipe
2025-10-01T14:06:25.721983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:25.722315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:25.722338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:25.722408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254444602425028:2506]
2025-10-01T14:06:25.722410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 16 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0
2025-10-01T14:06:25.722757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:25.722771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0] Write session will restart in 0.006340s
2025-10-01T14:06:25.722798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0] Write session: Do CDS request
2025-10-01T14:06:25.722804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:25.722568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 16 sessionId: src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0 is DEAD
2025-10-01T14:06:25.729438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:25.729894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:25.730123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:25.730133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:25.730146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:25.730213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:25.730258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254442225566320:2513]
2025-10-01T14:06:25.730824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.730859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:25.731175Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:25.731188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 17
2025-10-01T14:06:25.731318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.731347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 17 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:25.731356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=17 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:25.731361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
E1001 14:06:25.731533245  117478 chttp2_transport.cc:1143]             ipv4:127.0.0.1:28606: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-01T14:06:25.731546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:25.731599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:25.731821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 17 sessionId:  describe result for acl check
2025-10-01T14:06:25.731855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:25.731857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:25.731859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:25.731864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254444602425077:2598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:25.731920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:25.731993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.731998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.731999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.732000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.732001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.732002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.732003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.732005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.732006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.732007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.732008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.732010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.732010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.732011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.732017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.732026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.732029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.732034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.732037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.732040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.732042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.732045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.732048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.732051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.732053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.732056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.732060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.732063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.732070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.732077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.732081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.732086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.732090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.732094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.732098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.732102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.732106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.732111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.732115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.732121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.732125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.732130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.732133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.732138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.732150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.732155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.732158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.732164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.732169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.732173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.732176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.732180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.732183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.732188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.732191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.732195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.732232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:25.732365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254444602425077:2598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:25.736136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:25.736694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254444602425077:2598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:25.736772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:25.736789Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:25.736791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:25.736795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:25.736801Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 16 [2:7556254442225566320:2513]
2025-10-01T14:06:25.736816Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:25.736833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:25.736839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.736843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.736845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.736871Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:25.736880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:25.736886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:25.736960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.736967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.736969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.736971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:25.736974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:25.737034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:25.737041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.737052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.737062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.737078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:25.737099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602425043:2446], now have 1 active actors on pipe
2025-10-01T14:06:25.737110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254442225566315:2513]
2025-10-01T14:06:25.737112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254442225566315:2513]
2025-10-01T14:06:25.737113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254442225566315:2513]
2025-10-01T14:06:25.737124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:25.737138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:25.737139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:25.737147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:25.737149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:25.737134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 16
2025-10-01T14:06:25.737154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:25.737157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:25.737192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254442225566315:2513]
2025-10-01T14:06:25.737209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:25.737236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:25.742030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254444602425077:2598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:25.742045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254444602425077:2598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:25.742049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254444602425077:2598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:25.742059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 17 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:25.742385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602425118:2598], now have 1 active actors on pipe
2025-10-01T14:06:25.742549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 16
2025-10-01T14:06:25.742642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.742663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.742694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:25.742712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.742724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.742727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:25.742745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.742769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:25.742813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.743209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.743221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.743239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.743363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 17 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0
2025-10-01T14:06:25.743754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c51ca51-1d2f1806-204ae21a-c77192ef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:25.746342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0] Write session: try to update token
2025-10-01T14:06:25.746359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:25.747625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:25.747640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:25.747652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254442225566315:2513]
2025-10-01T14:06:25.747694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:25.747703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:25.747871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:25.748085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:25.748239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:25.748428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:25.748652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:25.748696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:25.762892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 17 sessionId: src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:25.766009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:25.766240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.766267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.766310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:25.766433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:25.774010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:25.774028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:25.774030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:25.774032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:25.774040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254442225566315:2513]
2025-10-01T14:06:25.774043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254442225566315:2513]
2025-10-01T14:06:25.774046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254442225566315:2513]
2025-10-01T14:06:25.774101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:25.774101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:25.774107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:25.774107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.774109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:25.774111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:25.774241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:25.824090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254444602425122:2506]
2025-10-01T14:06:25.824379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 16, pipe: [1:7556254444602425122:2506]
2025-10-01T14:06:25.925953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:25.939179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.939204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.939392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.939452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.939520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.939579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.939628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.939633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.939705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.939768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.939828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.939894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.939941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.939944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.940047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.940121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.940191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.940297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.940349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.940352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.940469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.940559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.940626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.940694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.940739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.940742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.940819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.940897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.940962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.941027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.941078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.941081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.941162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.941228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.941299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.941372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.941425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.941428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.941513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.941577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.941646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.941710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.941758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.941761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.941836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.941943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.942013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.942079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.942130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.942132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.942211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.942297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.942612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.942686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.942737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.942739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.942817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:25.942903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:25.942974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:25.943041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:25.943091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:25.943094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:25.943161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602425122:2506], now have 1 active actors on pipe
2025-10-01T14:06:25.944552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254444602425122:2506]
2025-10-01T14:06:25.944583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:25.944619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:25.944623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:25.944652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 17 reason: error at write: Disconnected sessionId: src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0
2025-10-01T14:06:25.944834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 17 sessionId: src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0 is DEAD
2025-10-01T14:06:25.945014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:25.946551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:25.946562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0] Write session will restart in 0.009466s
2025-10-01T14:06:25.946584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0] Write session: Do CDS request
2025-10-01T14:06:25.946590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:25.956158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:25.958633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:25.958839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.958853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:25.958866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:25.958878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:25.958938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:25.958995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254442225566393:2515]
2025-10-01T14:06:25.959051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:25.959065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 18
2025-10-01T14:06:25.959237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:25.959634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:25.959997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:25.960045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:25.960404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:25.960470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.960475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.960476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.960477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.960479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.960479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.960481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.960482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.960483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.960484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.960485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.960486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.960487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.960488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.960494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.960504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.960510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.960515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.960518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.960522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.960525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.960529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.960533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.960537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.960541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.960545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.960548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.960552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.960559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.960567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:25.959270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 18 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:25.960573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.959280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=18 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:25.960578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:25.959284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:25.960583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.959682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 18 sessionId:  describe result for acl check
2025-10-01T14:06:25.960589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:25.960593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.959711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:25.960598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:25.959713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:25.960603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.960608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:25.959715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:25.960612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.959720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254444602425162:2602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:25.960617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:25.960285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254444602425162:2602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:25.960622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.960627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:25.960631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.960637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:25.960644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.960653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:25.960658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.960669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.960674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.960681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.960685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.960693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.960698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.960708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:25.960713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.960718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:25.960779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:25.963307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254444602425162:2602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:25.966623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254444602425162:2602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:25.966636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254444602425162:2602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:25.966640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254444602425162:2602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:25.966648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 18 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:25.967970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:25.968695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:25.968710Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:25.968713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:25.968718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:25.968725Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 17 [2:7556254442225566393:2515]
2025-10-01T14:06:25.968745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:25.968766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:25.968773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.968777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.968780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.968796Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:25.968806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:25.968818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:25.968897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.968906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.968908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.968911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:25.968913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:25.968987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:25.968993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.969005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:25.969017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:25.969035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:25.969052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254442225566387:2515]
2025-10-01T14:06:25.969059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254442225566387:2515]
2025-10-01T14:06:25.969061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254442225566387:2515]
2025-10-01T14:06:25.969074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:25.969090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602425196:2602], now have 1 active actors on pipe
2025-10-01T14:06:25.969098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254444602425125:2446], now have 1 active actors on pipe
2025-10-01T14:06:25.969107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:25.969123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:25.969130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:25.969164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254442225566387:2515]
2025-10-01T14:06:25.969165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:25.969166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:25.969168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:25.969170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:25.969177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:25.969309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 17
2025-10-01T14:06:25.969335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 17
2025-10-01T14:06:25.969611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.969623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.969664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:25.969676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:25.969684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:25.969690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:25.969701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:25.969726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:25.969743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.969947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:25.969962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:25.969985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:25.970078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 18 partition: 0 MaxSeqNo: 45 sessionId: src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0
2025-10-01T14:06:25.970493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c963b87-fc33f4a1-385b4afd-543b279f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:25.973346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0] Write session: try to update token
2025-10-01T14:06:25.973366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:25.990297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 18 sessionId: src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:25.993610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:25.993629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:25.993632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:25.993634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:25.993644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254442225566387:2515]
2025-10-01T14:06:25.993648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254442225566387:2515]
2025-10-01T14:06:25.993652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254442225566387:2515]
2025-10-01T14:06:25.993705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:25.993713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:25.993715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:25.993853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:25.994747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:25.994758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:25.994768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:25.993751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:26.044572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254448897392513:2506]
2025-10-01T14:06:26.045346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 17, pipe: [1:7556254448897392513:2506]
2025-10-01T14:06:26.139744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:26.140026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.140039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.140075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392513:2506], now have 1 active actors on pipe
2025-10-01T14:06:26.140302Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:26.140767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:26.140861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 18 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0
2025-10-01T14:06:26.140994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 18 sessionId: src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0 is DEAD
2025-10-01T14:06:26.141176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254448897392513:2506]
2025-10-01T14:06:26.141195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:26.141216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0] Write session will restart in 0.005000s
2025-10-01T14:06:26.141193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:26.141242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0] Write session: Do CDS request
2025-10-01T14:06:26.141249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:26.147878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.148023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:26.148039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 19
2025-10-01T14:06:26.148221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.148254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 19 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:26.148264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=19 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:26.148268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:26.148745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 19 sessionId:  describe result for acl check
2025-10-01T14:06:26.148775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:26.148776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:26.148778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:26.148782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254448897392546:2614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:26.149308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254448897392546:2614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:26.151660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254448897392546:2614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:26.155369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254448897392546:2614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:26.155381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254448897392546:2614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:26.155384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254448897392546:2614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:26.155393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 19 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:26.156687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:26.157319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:26.157453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:26.157455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:26.157463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:26.157493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:26.157518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254446520533803:2531]
2025-10-01T14:06:26.157932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:26.158170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:26.158194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:26.158425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:26.158472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.158473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.158474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.158475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.158475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.158476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.158477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.158478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.158479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.158479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.158480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.158481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.158482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.158483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.158488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.158498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.158501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.158505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.158509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.158512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.158516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.158519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.158523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.158526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.158528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.158530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.158532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.158534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.158538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.158543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.158547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.158551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.158554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.158557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.158559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.158562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.158564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.158567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.158569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.158572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.158575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.158578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.158580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.158583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.158586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.158590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.158594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.158598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.158605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.158610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.158613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.158617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.158623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.158628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.158632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.158636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.158671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:26.168065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:26.168824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:26.168840Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:26.168843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:26.168858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:26.168865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 18 [2:7556254446520533803:2531]
2025-10-01T14:06:26.168882Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:26.168905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:26.168910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.168913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.168918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.168933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:26.168947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:26.168953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:26.169015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.169017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.169020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.169023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:26.169025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:26.169086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:26.169089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.169102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.169113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.169130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:26.169146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254446520533798:2531]
2025-10-01T14:06:26.169149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254446520533798:2531]
2025-10-01T14:06:26.169151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254446520533798:2531]
2025-10-01T14:06:26.169158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:26.169170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:26.169185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:26.169191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:26.169225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254446520533798:2531]
2025-10-01T14:06:26.169228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:26.169303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:26.169305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:26.169307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:26.169313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:26.169941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 18
2025-10-01T14:06:26.169967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 18
2025-10-01T14:06:26.170440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392603:2614], now have 1 active actors on pipe
2025-10-01T14:06:26.170453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392534:2446], now have 1 active actors on pipe
2025-10-01T14:06:26.170468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.170473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.170500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:26.170507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.170512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.170514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:26.170526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.170538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:26.170552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.175803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.175822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.175854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.179123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 19 partition: 0 MaxSeqNo: 45 sessionId: src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0
2025-10-01T14:06:26.179494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ed744-e93a70ae-696e2dbc-5e6f34f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:26.182483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0] Write session: try to update token
2025-10-01T14:06:26.182506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:26.196316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:26.196337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:26.196339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:26.196341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:26.196350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254446520533798:2531]
2025-10-01T14:06:26.196355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254446520533798:2531]
2025-10-01T14:06:26.196359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254446520533798:2531]
2025-10-01T14:06:26.196410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:26.196418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.196421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:26.196591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:26.198335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:26.198346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:26.198350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:26.205312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 19 sessionId: src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:26.207931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:26.239533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254448897392619:2506]
2025-10-01T14:06:26.239877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 18, pipe: [1:7556254448897392619:2506]
2025-10-01T14:06:26.352934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:26.353287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.353296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.353315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392619:2506], now have 1 active actors on pipe
2025-10-01T14:06:26.353569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:26.353694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:26.353707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:26.353784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 19 reason: error at write: Disconnected sessionId: src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0
2025-10-01T14:06:26.353977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 19 sessionId: src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0 is DEAD
2025-10-01T14:06:26.354182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:26.354583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:26.354596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0] Write session will restart in 0.009450s
2025-10-01T14:06:26.354623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0] Write session: Do CDS request
2025-10-01T14:06:26.354629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:26.355167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254448897392619:2506]
2025-10-01T14:06:26.364901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.365242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:26.365257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 20
2025-10-01T14:06:26.365418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.365449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 20 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:26.365459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=20 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:26.365462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:26.364297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:26.364992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:26.365157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:26.365161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:26.365172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:26.365218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:26.365255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254446520533877:2533]
2025-10-01T14:06:26.365910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:26.365922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 20 sessionId:  describe result for acl check
2025-10-01T14:06:26.365962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:26.365964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:26.365967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:26.365972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254448897392656:2618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:26.366383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:26.366443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:26.366816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:26.366913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.366920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.366921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.366922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.366923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.366924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.366925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.366926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.366927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.366928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.366929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.366930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.366931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.366932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.366938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.366948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.366951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.366955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.366958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.366599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254448897392656:2618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:26.366961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.366964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.366968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.366973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.366977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.366980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.366983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.366986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.366989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.366997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.367005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.367010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.367015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.367019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.367023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.367027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.367032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.367036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.367041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.367045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.367049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.367055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.367059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.367063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.367067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.367072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.367077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.367081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.367086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.367090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.367095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.367099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.367103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.367110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.367190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.367203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.367209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.367243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:26.369102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254448897392656:2618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:26.372321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:26.373069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:26.373091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:26.373093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:26.373097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:26.373104Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 19 [2:7556254446520533877:2533]
2025-10-01T14:06:26.373123Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:26.373141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:26.373150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.373155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.373157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.373177Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:26.373191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:26.373198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:26.373266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.373276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.373278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.373281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:26.373284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:26.373368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:26.373379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.373392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.373402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.373418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:26.373445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254446520533871:2533]
2025-10-01T14:06:26.373453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254446520533871:2533]
2025-10-01T14:06:26.373455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254446520533871:2533]
2025-10-01T14:06:26.373464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:26.373478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:26.373499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:26.373501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:26.373505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:26.373507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:26.373508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:26.373555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392621:2446], now have 1 active actors on pipe
2025-10-01T14:06:26.373565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254446520533871:2533]
2025-10-01T14:06:26.373574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:26.373594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:26.374243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 19
2025-10-01T14:06:26.374994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254448897392656:2618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:26.375014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254448897392656:2618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:26.375019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254448897392656:2618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:26.375027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 20 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:26.375446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 19
2025-10-01T14:06:26.376016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392697:2618], now have 1 active actors on pipe
2025-10-01T14:06:26.376044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.376052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.376079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|297a32f9-dc952c09-9934d42a-92a680a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:26.376095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.376101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.376109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:26.376121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.376140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:26.376161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.376430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.376449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.376474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.376580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 20 partition: 0 MaxSeqNo: 45 sessionId: src_id|297a32f9-dc952c09-9934d42a-92a680a_0
2025-10-01T14:06:26.376950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7a92a72-6736e7be-60d7c45f-4dee91b2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|297a32f9-dc952c09-9934d42a-92a680a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:26.379799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|297a32f9-dc952c09-9934d42a-92a680a_0] Write session: try to update token
2025-10-01T14:06:26.379820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|297a32f9-dc952c09-9934d42a-92a680a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:26.399754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:26.399780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:26.399783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:26.399786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:26.399799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254446520533871:2533]
2025-10-01T14:06:26.399803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254446520533871:2533]
2025-10-01T14:06:26.399807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254446520533871:2533]
2025-10-01T14:06:26.399863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:26.399871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.399876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:26.399882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:26.399900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:26.399905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:26.400047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:26.409338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 20 sessionId: src_id|297a32f9-dc952c09-9934d42a-92a680a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:26.411920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:26.456147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254448897392703:2506]
2025-10-01T14:06:26.456456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 19, pipe: [1:7556254448897392703:2506]
2025-10-01T14:06:26.562093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:26.562419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.562433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.562453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392703:2506], now have 1 active actors on pipe
2025-10-01T14:06:26.562661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:26.562776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:26.562845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:26.562857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 20 reason: status is not ok: tablet will be restarted right now sessionId: src_id|297a32f9-dc952c09-9934d42a-92a680a_0
2025-10-01T14:06:26.562897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254448897392703:2506]
2025-10-01T14:06:26.563191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 20 sessionId: src_id|297a32f9-dc952c09-9934d42a-92a680a_0 is DEAD
2025-10-01T14:06:26.563332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297a32f9-dc952c09-9934d42a-92a680a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:26.563346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297a32f9-dc952c09-9934d42a-92a680a_0] Write session will restart in 0.005627s
2025-10-01T14:06:26.563386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297a32f9-dc952c09-9934d42a-92a680a_0] Write session: Do CDS request
2025-10-01T14:06:26.563394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297a32f9-dc952c09-9934d42a-92a680a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:26.570068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|297a32f9-dc952c09-9934d42a-92a680a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.570115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:26.570128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 21
2025-10-01T14:06:26.570368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.570421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 21 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:26.570432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=21 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:26.570437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:26.570615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:26.570866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 21 sessionId:  describe result for acl check
2025-10-01T14:06:26.570898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:26.570900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:26.570902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:26.570908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254448897392743:2623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:26.571210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:26.571385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:26.571395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:26.571404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:26.571427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254448897392743:2623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:26.571442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:26.571472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254446520533954:2536]
2025-10-01T14:06:26.571895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:26.572128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:26.572157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:26.572410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:26.572456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.572469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.572470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.572474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.572475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.572475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.572476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.572477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.572477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.572478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.572479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.572479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.572480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.572481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.572484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.572490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.572493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.572495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.572497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.572500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.572502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.572504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.572506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.572509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.572511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.572513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.572516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.572518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.572523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.572527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.572531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.572535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.572537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.572540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.572544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.572547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.572550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.572553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.572555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.572560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.572565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.572570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.572573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.572578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.572583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.572588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.572593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.572598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.572603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.572607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.572610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.572612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.572615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.572618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.572620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.572623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.572647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:26.572991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254448897392743:2623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:26.576354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254448897392743:2623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:26.576367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254448897392743:2623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:26.576371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254448897392743:2623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:26.576380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 21 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:26.576582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:26.577308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:26.577325Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:26.577328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:26.577332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:26.577340Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 20 [2:7556254446520533954:2536]
2025-10-01T14:06:26.577356Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:26.577373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:26.577376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.577382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.577384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.577400Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:26.577404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:26.577411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:26.577474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.577484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.577486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.577489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:26.577491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:26.577554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:26.577560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.577568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.577573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.577582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:26.577600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392708:2446], now have 1 active actors on pipe
2025-10-01T14:06:26.577606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392783:2623], now have 1 active actors on pipe
2025-10-01T14:06:26.577612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254446520533949:2536]
2025-10-01T14:06:26.577613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254446520533949:2536]
2025-10-01T14:06:26.577614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254446520533949:2536]
2025-10-01T14:06:26.577623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:26.577634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:26.577636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:26.577640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:26.577642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:26.577646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:26.577648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:26.577675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254446520533949:2536]
2025-10-01T14:06:26.577684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:26.577698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:26.577684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 20
2025-10-01T14:06:26.577689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 20
2025-10-01T14:06:26.577768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.577778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.577802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26977010-f8292a5-4fc5f96d-72a48605_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:26.577814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.577819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.577821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:26.577830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.577843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:26.577858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.577996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.578005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.578017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.578090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 21 partition: 0 MaxSeqNo: 45 sessionId: src_id|26977010-f8292a5-4fc5f96d-72a48605_0
2025-10-01T14:06:26.578458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|297a32f9-dc952c09-9934d42a-92a680a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|26977010-f8292a5-4fc5f96d-72a48605_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:26.581062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26977010-f8292a5-4fc5f96d-72a48605_0] Write session: try to update token
2025-10-01T14:06:26.581081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26977010-f8292a5-4fc5f96d-72a48605_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:26.596154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 21 sessionId: src_id|26977010-f8292a5-4fc5f96d-72a48605_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:26.598795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:26.600827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.600857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.600894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:26.601017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:26.603110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:26.603128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:26.603130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:26.603132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:26.603141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254446520533949:2536]
2025-10-01T14:06:26.603146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254446520533949:2536]
2025-10-01T14:06:26.603150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254446520533949:2536]
2025-10-01T14:06:26.603196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:26.603204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.603207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:26.603208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:26.603214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:26.603218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:26.603353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:26.662942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254448897392802:2506]
2025-10-01T14:06:26.663180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 20, pipe: [1:7556254448897392802:2506]
2025-10-01T14:06:26.777917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:26.787084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.787126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.787382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.787472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.787562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.787650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.787711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.787724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.787816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.787903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.787985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.788075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.788136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.788147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.788237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.788322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.788412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.788583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.788640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.788652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.788737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.788826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.788925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.789012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.789076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.789086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.789173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.789257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.789352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.789444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.789515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.789526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.789639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.789736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.789837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.789919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.789981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.789990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.790065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.790133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.790209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.790286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.790338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.790351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.790454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.790527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.790604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.790677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.790744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.790757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.790838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.790908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.790978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.791044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.791267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.791275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.791339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:26.791398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:26.791462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:26.791519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:26.791566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:26.791573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:26.791638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392802:2506], now have 1 active actors on pipe
2025-10-01T14:06:26.791954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254448897392802:2506]
2025-10-01T14:06:26.791998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:26.792003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:26.792005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:26.792033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 21 reason: error at write: Disconnected sessionId: src_id|26977010-f8292a5-4fc5f96d-72a48605_0
2025-10-01T14:06:26.792189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 21 sessionId: src_id|26977010-f8292a5-4fc5f96d-72a48605_0 is DEAD
2025-10-01T14:06:26.792347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26977010-f8292a5-4fc5f96d-72a48605_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:26.792360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26977010-f8292a5-4fc5f96d-72a48605_0] Write session will restart in 0.008117s
2025-10-01T14:06:26.792349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:26.792399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26977010-f8292a5-4fc5f96d-72a48605_0] Write session: Do CDS request
2025-10-01T14:06:26.792406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26977010-f8292a5-4fc5f96d-72a48605_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:26.801856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26977010-f8292a5-4fc5f96d-72a48605_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.802011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:26.800777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:26.802027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 22
2025-10-01T14:06:26.801881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:26.802093Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:26.802105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:26.802115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:26.802165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:26.802199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.802220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254446520534043:2539]
2025-10-01T14:06:26.802306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 22 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:26.802318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=22 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:26.802321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:26.802776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 22 sessionId:  describe result for acl check
2025-10-01T14:06:26.802820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:26.802822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:26.802823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:26.802830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254448897392842:2628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:26.802900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:26.803344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254448897392842:2628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:26.803408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:26.803471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:26.803816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:26.803909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.803922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.803923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.803924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.803925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.803926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.803928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.803929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.803930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.803931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.803933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.803934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.803938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.803939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.803945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.803954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.803957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.803961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.803964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.803967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.803970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.803974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.803977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.803982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.803985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.803989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.803992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.803996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.804004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.804012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.804019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.804024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.804028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.804033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.804036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.804042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.804047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.804051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.804055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.804060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.804083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.804096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.804100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.804106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.804115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.804120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.804124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.804134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.804139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.804149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.804153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.804157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.804168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.804173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.804182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.804186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.804223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:26.805025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254448897392842:2628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:26.807695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254448897392842:2628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:26.807708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254448897392842:2628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:26.807714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254448897392842:2628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:26.807798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 22 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:26.807980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:26.808640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:26.808655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:26.808658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:26.808662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:26.808669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 21 [2:7556254446520534043:2539]
2025-10-01T14:06:26.808684Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:26.808707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:26.808710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.808713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.808715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.808731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:26.808743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:26.808749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:26.808902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.808914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.808916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.808918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:26.808920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:26.809003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:26.809011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.809026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.809037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.809055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:26.809107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 21
2025-10-01T14:06:26.809080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392881:2628], now have 1 active actors on pipe
2025-10-01T14:06:26.809095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392805:2446], now have 1 active actors on pipe
2025-10-01T14:06:26.809118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 21
2025-10-01T14:06:26.809103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254446520534038:2539]
2025-10-01T14:06:26.809104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254446520534038:2539]
2025-10-01T14:06:26.809108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254446520534038:2539]
2025-10-01T14:06:26.809124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:26.809142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:26.809151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:26.809154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:26.809157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:26.809157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:26.809160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:26.809236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.809246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.809261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254446520534038:2539]
2025-10-01T14:06:26.809273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:26.809291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:26.809314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|896466-3ecef225-9ca4f85a-96f21618_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:26.809330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.809335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.809337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:26.809348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.809361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:26.809390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.809517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.809525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.809539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.809607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 22 partition: 0 MaxSeqNo: 45 sessionId: src_id|896466-3ecef225-9ca4f85a-96f21618_0
2025-10-01T14:06:26.809961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26977010-f8292a5-4fc5f96d-72a48605_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|896466-3ecef225-9ca4f85a-96f21618_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:26.812978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|896466-3ecef225-9ca4f85a-96f21618_0] Write session: try to update token
2025-10-01T14:06:26.812996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|896466-3ecef225-9ca4f85a-96f21618_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:26.830165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 22 sessionId: src_id|896466-3ecef225-9ca4f85a-96f21618_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:26.830336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:26.830358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:26.830360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:26.830366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:26.830392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254446520534038:2539]
2025-10-01T14:06:26.830396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254446520534038:2539]
2025-10-01T14:06:26.830401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254446520534038:2539]
2025-10-01T14:06:26.830453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:26.830458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:26.830460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:26.830465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.830465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:26.830467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:26.830634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:26.833310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:26.892344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254448897392889:2506]
2025-10-01T14:06:26.892676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 21, pipe: [1:7556254448897392889:2506]
E1001 14:06:26.922548116  115369 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:28606: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-10-01T14:06:26.973745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:26.974001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.974014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.974050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392889:2506], now have 1 active actors on pipe
2025-10-01T14:06:26.974276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:26.974366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254448897392889:2506]
2025-10-01T14:06:26.974407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:26.975179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:26.975257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 22 reason: status is not ok: tablet will be restarted right now sessionId: src_id|896466-3ecef225-9ca4f85a-96f21618_0
2025-10-01T14:06:26.975437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 22 sessionId: src_id|896466-3ecef225-9ca4f85a-96f21618_0 is DEAD
2025-10-01T14:06:26.975632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896466-3ecef225-9ca4f85a-96f21618_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:26.975640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896466-3ecef225-9ca4f85a-96f21618_0] Write session will restart in 0.007979s
2025-10-01T14:06:26.975664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896466-3ecef225-9ca4f85a-96f21618_0] Write session: Do CDS request
2025-10-01T14:06:26.975672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896466-3ecef225-9ca4f85a-96f21618_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:26.982067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:26.982639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:26.982834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:26.982844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:26.982855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:26.982909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:26.982959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254446520534120:2541]
2025-10-01T14:06:26.983564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:26.983898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:26.983945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:26.984230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:26.984287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.984293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.984294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.984295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.984296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.984297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.984299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.984300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.984301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.984303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.984304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.984306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.984307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.984309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.984314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.984334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.984338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.984342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.984345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.984350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.984353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.984357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.984360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.984365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.984372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.984375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.984379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.984385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.984392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.984402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:26.984410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.984418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:26.984423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.984431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:26.984436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.984444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:26.984449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.984457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:26.984461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.984469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:26.984474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.984481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:26.984485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.984489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:26.984493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.984499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:26.984503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.984508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.984512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.984517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.984523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.984531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.984536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.984544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:26.984549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.984557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:26.984601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:26.984710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|896466-3ecef225-9ca4f85a-96f21618_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.985155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:26.985170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 23
2025-10-01T14:06:26.985266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:26.985294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 23 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:26.985304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=23 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:26.985307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:26.985708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 23 sessionId:  describe result for acl check
2025-10-01T14:06:26.985744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:26.985746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:26.985747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:26.985752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254448897392938:2634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:26.986229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254448897392938:2634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:26.988287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254448897392938:2634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:26.988545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:26.989180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:26.989191Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:26.989192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:26.989195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:26.989201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 22 [2:7556254446520534120:2541]
2025-10-01T14:06:26.989212Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:26.989224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:26.989227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.989230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.989231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.989245Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:26.989252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:26.989256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:26.989314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.989325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.989327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.989331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:26.989333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:26.989398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:26.989404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:26.989411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:26.989416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:26.989425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:26.989438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254446520534115:2541]
2025-10-01T14:06:26.989443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254446520534115:2541]
2025-10-01T14:06:26.989444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254446520534115:2541]
2025-10-01T14:06:26.989452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:26.989460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:26.989463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:26.989464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392893:2446], now have 1 active actors on pipe
2025-10-01T14:06:26.989465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:26.989470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:26.989478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:26.989480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:26.989504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254446520534115:2541]
2025-10-01T14:06:26.989516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:26.989503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 22
2025-10-01T14:06:26.989517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:26.994140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254448897392938:2634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:26.994152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254448897392938:2634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:26.994155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254448897392938:2634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:26.994161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 23 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:26.994410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254448897392974:2634], now have 1 active actors on pipe
2025-10-01T14:06:26.994523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 22
2025-10-01T14:06:26.994593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.994609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.994641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:26.994656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:26.994665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:26.994668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:26.994680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:26.994704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:26.994723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.994888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:26.994900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:26.994920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:26.995025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 23 partition: 0 MaxSeqNo: 45 sessionId: src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0
2025-10-01T14:06:26.995346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896466-3ecef225-9ca4f85a-96f21618_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:26.998076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0] Write session: try to update token
2025-10-01T14:06:26.998094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:27.000143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:27.000169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:27.000179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254446520534115:2541]
2025-10-01T14:06:27.000228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:27.000228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:27.000429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:27.000596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:27.000756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:27.001098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:27.001302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:27.001357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:27.015519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 23 sessionId: src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:27.018105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:27.019778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.019814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.019837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:27.019844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:27.019847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:27.019852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:27.019863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254446520534115:2541]
2025-10-01T14:06:27.019867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254446520534115:2541]
2025-10-01T14:06:27.019871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254446520534115:2541]
2025-10-01T14:06:27.019930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:27.019938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:27.019942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:27.019947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:27.019955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.019958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:27.020235Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:27.078610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254453192360290:2506]
2025-10-01T14:06:27.082538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 22, pipe: [1:7556254453192360290:2506]
2025-10-01T14:06:27.186148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:27.186462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:27.186505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360290:2506], now have 1 active actors on pipe
2025-10-01T14:06:27.186791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:27.187324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254453192360290:2506]
2025-10-01T14:06:27.187353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:27.198628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:27.198644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:27.198670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 23 reason: error at write: Disconnected sessionId: src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0
2025-10-01T14:06:27.198907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 23 sessionId: src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0 is DEAD
2025-10-01T14:06:27.199033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:27.199045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0] Write session will restart in 0.008703s
2025-10-01T14:06:27.199071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0] Write session: Do CDS request
2025-10-01T14:06:27.199082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:27.205367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:27.206997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:27.207246Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:27.207256Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:27.207268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:27.207339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:27.207376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254450815501535:2556]
2025-10-01T14:06:27.208012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:27.208344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:27.208390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:27.208675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:27.208764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.208771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.208772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.208773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.208774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.208775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.208776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.208777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.208945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.208778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.208780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.208781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.208782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.208783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.208784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.208789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.208800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.208804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.208808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.208812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.208816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.208820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.208825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.208829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.208833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.208837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.208840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.208844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.208860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.208866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.208874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.208880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.208886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.208891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.208896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.208901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.208907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.208912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.208917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.208922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.208927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.208932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.208939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.208943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.208948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.208953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.208959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.208963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.208968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.208973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.208978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.208982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.208987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.208993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.208997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.209001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.209006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.209047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:27.210535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:27.210559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 24
2025-10-01T14:06:27.211127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.211166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 24 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:27.211178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=24 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:27.211188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:27.211699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 24 sessionId:  describe result for acl check
2025-10-01T14:06:27.211736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:27.211738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:27.211740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:27.211745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254453192360352:2646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:27.212272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254453192360352:2646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:27.213204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:27.213873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:27.213890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:27.213893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:27.213896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:27.213903Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 23 [2:7556254450815501535:2556]
2025-10-01T14:06:27.213921Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:27.213934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:27.213936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.213939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.213940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.213953Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:27.213957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:27.213961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:27.214012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.214019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.214022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.214024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:27.214027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:27.214080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:27.214085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.214093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.214103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.214112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:27.214132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360308:2446], now have 1 active actors on pipe
2025-10-01T14:06:27.214143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254450815501530:2556]
2025-10-01T14:06:27.214149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254450815501530:2556]
2025-10-01T14:06:27.214151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254450815501530:2556]
2025-10-01T14:06:27.214174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:27.214193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:27.214199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:27.214203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:27.214205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:27.214213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:27.214220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:27.214253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254450815501530:2556]
2025-10-01T14:06:27.214261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:27.214286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:27.214165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 23
2025-10-01T14:06:27.214678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254453192360352:2646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:27.223112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254453192360352:2646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:27.223126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254453192360352:2646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:27.223128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254453192360352:2646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:27.223136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 24 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:27.223385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360387:2646], now have 1 active actors on pipe
2025-10-01T14:06:27.223488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 23
2025-10-01T14:06:27.223547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.223556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.223579Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:27.223587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.223591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.223593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:27.223604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.223622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:27.223638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.223796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.223806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.223822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.224132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 24 partition: 0 MaxSeqNo: 45 sessionId: src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0
2025-10-01T14:06:27.224491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fd4d72-e4f6b63b-7a9c94b1-9805f385_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:27.225209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:27.225224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:27.225234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254450815501530:2556]
2025-10-01T14:06:27.225288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:27.225291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:27.225513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:27.225657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:27.225801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:27.225951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:27.226164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:27.226214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:27.227393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0] Write session: try to update token
2025-10-01T14:06:27.227415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:27.246072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:27.246097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:27.246099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:27.246102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:27.246116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254450815501530:2556]
2025-10-01T14:06:27.246120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254450815501530:2556]
2025-10-01T14:06:27.246123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254450815501530:2556]
2025-10-01T14:06:27.246169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:27.246175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:27.246183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:27.246183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.246186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:27.246189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:27.246334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:27.250928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 24 sessionId: src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:27.253620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:27.287586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254453192360392:2506]
2025-10-01T14:06:27.287863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 23, pipe: [1:7556254453192360392:2506]
2025-10-01T14:06:27.404082Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:27.404390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.404406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.404434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360392:2506], now have 1 active actors on pipe
2025-10-01T14:06:27.404657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:27.404660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:27.404665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:27.404711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254453192360392:2506]
2025-10-01T14:06:27.404730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 24 reason: error at write: Disconnected sessionId: src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0
2025-10-01T14:06:27.404916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 24 sessionId: src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0 is DEAD
2025-10-01T14:06:27.404656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:27.405061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:27.405069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0] Write session will restart in 0.009803s
2025-10-01T14:06:27.405090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0] Write session: Do CDS request
2025-10-01T14:06:27.405095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:27.412078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:27.412474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:27.412675Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:27.412684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:27.412695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:27.412736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:27.412765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254450815501613:2558]
2025-10-01T14:06:27.413200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:27.413516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:27.413563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:27.413820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:27.413862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.413867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.413867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.413868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.413869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.413870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.413871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.413872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.413873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.413873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.413874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.413875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.413875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.413876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.413880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.413886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.413889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.413891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.413894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.413897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.413899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.413901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.413903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.413906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.413908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.413910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.413912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.413914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.413920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.413924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.413928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.413931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.413934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.413937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.413940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.413943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.413946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.413949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.413952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.413955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.413957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.413960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.413963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.413965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.413968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.413971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.413974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.413977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.413979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.413983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.413985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.413988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.413990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.413993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.413996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.413999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.414022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:27.415927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.416073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:27.416099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 25
2025-10-01T14:06:27.416226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.416262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 25 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:27.416272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=25 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:27.416275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:27.416687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 25 sessionId:  describe result for acl check
2025-10-01T14:06:27.416717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:27.416722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:27.416724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:27.416729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254453192360439:2650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:27.417228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254453192360439:2650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:27.417974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:27.418710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:27.418724Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:27.418727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:27.418731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:27.418738Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 24 [2:7556254450815501613:2558]
2025-10-01T14:06:27.418755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:27.418770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:27.418781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.418785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.418788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.418806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:27.418811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:27.418816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:27.418876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.418884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.418886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.418889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:27.418892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:27.418975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:27.418987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.418997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.419007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.419021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:27.419044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360394:2446], now have 1 active actors on pipe
2025-10-01T14:06:27.419055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254450815501608:2558]
2025-10-01T14:06:27.419059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254450815501608:2558]
2025-10-01T14:06:27.419061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254450815501608:2558]
2025-10-01T14:06:27.419070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:27.419081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:27.419085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:27.419091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:27.419093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:27.419099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:27.419101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:27.419148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254450815501608:2558]
2025-10-01T14:06:27.419159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:27.419191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:27.418979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254453192360439:2650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:27.419030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 24
2025-10-01T14:06:27.424384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254453192360439:2650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:27.424398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254453192360439:2650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:27.424402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254453192360439:2650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:27.424409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 25 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:27.424672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360477:2650], now have 1 active actors on pipe
2025-10-01T14:06:27.424925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 24
2025-10-01T14:06:27.425047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.425064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.425094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:27.425114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.425120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.425123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:27.425135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.425154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:27.425184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.425427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.425437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.425462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.425545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 25 partition: 0 MaxSeqNo: 45 sessionId: src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0
2025-10-01T14:06:27.425890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d23a8f-b29bbb53-1ad52cb-46a93a90_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:27.428810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0] Write session: try to update token
2025-10-01T14:06:27.428829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:27.430869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:27.430887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:27.430900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254450815501608:2558]
2025-10-01T14:06:27.430943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:27.430960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:27.431110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:27.431260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:27.431400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:27.431538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:27.431743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:27.431786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:27.444204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 25 sessionId: src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:27.446619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:27.446826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.446852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.446890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:27.446996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:27.451338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:27.451359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:27.451364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:27.451366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:27.451375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254450815501608:2558]
2025-10-01T14:06:27.451379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254450815501608:2558]
2025-10-01T14:06:27.451382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254450815501608:2558]
2025-10-01T14:06:27.451431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:27.451443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.451445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:27.451466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:27.451474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:27.451479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:27.451635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:27.507700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254453192360482:2506]
2025-10-01T14:06:27.508114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 24, pipe: [1:7556254453192360482:2506]
2025-10-01T14:06:27.604399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:27.612627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.612658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.612830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.612897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.612962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.613021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.613075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.613089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.613152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.613208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.613263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.613321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.613361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.613364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.613430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.613506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.613562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.613622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.613658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.613661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.613726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.613781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.613830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.613883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.613921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.613923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.613984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.614034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.614130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.614189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.614226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.614229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.614294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.614341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.614516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.614584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.614680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.614687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.614756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.614814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.614873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.614937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.614983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.614988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.615053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.615112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.615175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.615234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.615287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.615295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.615407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.615473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.615533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.615592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.615658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.615665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.615734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:27.615793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:27.615853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:27.615912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:27.615982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:27.615989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:27.616045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360482:2506], now have 1 active actors on pipe
2025-10-01T14:06:27.616985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:27.617376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254453192360482:2506]
2025-10-01T14:06:27.617415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:27.617431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:27.617479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 25 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0
2025-10-01T14:06:27.617659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 25 sessionId: src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0 is DEAD
2025-10-01T14:06:27.617828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:27.617839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0] Write session will restart in 0.005991s
2025-10-01T14:06:27.617865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0] Write session: Do CDS request
2025-10-01T14:06:27.617871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:27.624878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.624974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:27.624832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:27.624986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 26
2025-10-01T14:06:27.625114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.625149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 26 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:27.625156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=26 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:27.625160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:27.625441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:27.625555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 26 sessionId:  describe result for acl check
2025-10-01T14:06:27.625587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:27.625592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:27.625594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:27.625600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254453192360526:2655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:27.625674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:27.625687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:27.625699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:27.625756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:27.625794Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254450815501696:2561]
2025-10-01T14:06:27.626078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254453192360526:2655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:27.627858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254453192360526:2655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:27.626414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:27.626866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:27.626911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:27.627362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:27.627425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.627426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.627427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.627428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.627429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.627430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.627431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.627433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.627434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.627436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.627437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.627438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.627438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.627439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.627445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.627454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.627457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.627460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.627463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.627466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.627469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.627472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.627476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.627479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.627482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.627485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.627489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.627492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.627498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.627506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.627512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.627516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.627520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.627525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.627528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.627534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.627539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.627544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.627549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.627554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.627561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.627565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.627570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.627574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.627579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.627597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.627600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.627604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.627608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.627612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.627616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.627619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.627623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.627628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.627631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.627634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.627670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:27.632316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:27.633044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:27.633062Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:27.633064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:27.633069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:27.633077Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 25 [2:7556254450815501696:2561]
2025-10-01T14:06:27.633094Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:27.633111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:27.633119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.633124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.633126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.633144Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:27.633155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:27.633164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:27.633228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.633235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.633237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.633240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:27.633243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:27.633313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:27.633323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.633336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.633348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.633364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:27.633387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360485:2446], now have 1 active actors on pipe
2025-10-01T14:06:27.633401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254450815501691:2561]
2025-10-01T14:06:27.633406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254450815501691:2561]
2025-10-01T14:06:27.633408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254450815501691:2561]
2025-10-01T14:06:27.633420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:27.633433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:27.633437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:27.633450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 25
2025-10-01T14:06:27.633440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:27.633442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:27.633451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:27.633454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:27.633491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254450815501691:2561]
2025-10-01T14:06:27.633501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:27.633521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:27.633811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360565:2655], now have 1 active actors on pipe
2025-10-01T14:06:27.633599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254453192360526:2655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:27.633613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254453192360526:2655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:27.633922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.633934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.633617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254453192360526:2655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:27.633624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 26 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:27.633958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63515965-e73c564e-5db59f9b-49b2c530_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:27.633868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 25
2025-10-01T14:06:27.633969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.633978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.633985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:27.633995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.634009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:27.634031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.634288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.634297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.634315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.634412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 26 partition: 0 MaxSeqNo: 45 sessionId: src_id|63515965-e73c564e-5db59f9b-49b2c530_0
2025-10-01T14:06:27.634772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ff36405-b159c905-d980bbfc-51e50ecd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|63515965-e73c564e-5db59f9b-49b2c530_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:27.637545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63515965-e73c564e-5db59f9b-49b2c530_0] Write session: try to update token
2025-10-01T14:06:27.637566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63515965-e73c564e-5db59f9b-49b2c530_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:27.658103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 26 sessionId: src_id|63515965-e73c564e-5db59f9b-49b2c530_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:27.659328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:27.660688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:27.659911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:27.659919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:27.659921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:27.659930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254450815501691:2561]
2025-10-01T14:06:27.659934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254450815501691:2561]
2025-10-01T14:06:27.659938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254450815501691:2561]
2025-10-01T14:06:27.659989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:27.659995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.659998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:27.660121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:27.660128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:27.660133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:27.660135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:27.717646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254453192360583:2506]
2025-10-01T14:06:27.718049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 25, pipe: [1:7556254453192360583:2506]
2025-10-01T14:06:27.809514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:27.809843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.809855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.809888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360583:2506], now have 1 active actors on pipe
2025-10-01T14:06:27.810126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:27.810176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254453192360583:2506]
2025-10-01T14:06:27.810182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:27.810185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:27.810210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:27.810240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 26 reason: error at write: Disconnected sessionId: src_id|63515965-e73c564e-5db59f9b-49b2c530_0
2025-10-01T14:06:27.810392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 26 sessionId: src_id|63515965-e73c564e-5db59f9b-49b2c530_0 is DEAD
2025-10-01T14:06:27.810540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63515965-e73c564e-5db59f9b-49b2c530_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:27.810553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63515965-e73c564e-5db59f9b-49b2c530_0] Write session will restart in 0.005622s
2025-10-01T14:06:27.810581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63515965-e73c564e-5db59f9b-49b2c530_0] Write session: Do CDS request
2025-10-01T14:06:27.810588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63515965-e73c564e-5db59f9b-49b2c530_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:27.816814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63515965-e73c564e-5db59f9b-49b2c530_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.817054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:27.817070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 27
2025-10-01T14:06:27.817265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.817309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 27 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:27.817319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=27 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:27.817324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:27.817753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 27 sessionId:  describe result for acl check
2025-10-01T14:06:27.817796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:27.817805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:27.817808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:27.817813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254453192360625:2660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:27.818327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254453192360625:2660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:27.818728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:27.819128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:27.819292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:27.819302Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:27.819314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:27.819360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:27.819398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254450815501788:2564]
2025-10-01T14:06:27.819910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:27.820145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:27.820183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:27.820251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254453192360625:2660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:27.820488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:27.820541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.820546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.820547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.820548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.820549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.820550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.820551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.820552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.820554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.820555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.820556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.820557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.820558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.820559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.820564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.820573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.820576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.820580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.820583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.820586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.820590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.820593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.820597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.820601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.820604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.820608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.820611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.820615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.820622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.820629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.820634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.820639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.820643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.820649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.820653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.820658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.820662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.820667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.820671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.820677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.820681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.820687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.820696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.820701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.820705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.820710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.820719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.820723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.820732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.820737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.820744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.820749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.820757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.820762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.820768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.820771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.820792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:27.824350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254453192360625:2660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:27.824367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254453192360625:2660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:27.824370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254453192360625:2660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:27.824380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 27 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:27.824580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:27.825256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:27.825273Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:27.825276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:27.825279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:27.825286Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 26 [2:7556254450815501788:2564]
2025-10-01T14:06:27.825302Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:27.825318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:27.825323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.825327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.825329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.825345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:27.825356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:27.825362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:27.825425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.825437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.825439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.825442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:27.825445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:27.825514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:27.825522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.825535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.825549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.825569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:27.825591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360586:2446], now have 1 active actors on pipe
2025-10-01T14:06:27.825599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360667:2660], now have 1 active actors on pipe
2025-10-01T14:06:27.825606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254450815501783:2564]
2025-10-01T14:06:27.825609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254450815501783:2564]
2025-10-01T14:06:27.825611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254450815501783:2564]
2025-10-01T14:06:27.825600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 26
2025-10-01T14:06:27.825640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 26
2025-10-01T14:06:27.825624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:27.825647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:27.825649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:27.825652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:27.825654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:27.825661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:27.825664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:27.825708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.825717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.825730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254450815501783:2564]
2025-10-01T14:06:27.825741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:27.825759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:27.825773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:27.825783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.825787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.825793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:27.825803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.825816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:27.825842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.825997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.826005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.826019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.826073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 27 partition: 0 MaxSeqNo: 45 sessionId: src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0
2025-10-01T14:06:27.826551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63515965-e73c564e-5db59f9b-49b2c530_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:27.829638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0] Write session: try to update token
2025-10-01T14:06:27.829660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:27.847862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 27 sessionId: src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:27.848976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:27.848996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:27.848999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:27.849001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:27.849010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254450815501783:2564]
2025-10-01T14:06:27.849015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254450815501783:2564]
2025-10-01T14:06:27.849019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254450815501783:2564]
2025-10-01T14:06:27.849070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:27.849072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:27.849078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:27.849080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.849083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:27.849083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:27.849244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:27.850211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:27.910173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254453192360675:2506]
2025-10-01T14:06:27.910495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 26, pipe: [1:7556254453192360675:2506]
2025-10-01T14:06:27.983350Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:27.983658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.983674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.983711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360675:2506], now have 1 active actors on pipe
2025-10-01T14:06:27.983975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:27.983952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:27.983952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254453192360675:2506]
2025-10-01T14:06:27.983978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:27.983980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:27.984051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 27 reason: error at write: Disconnected sessionId: src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0
2025-10-01T14:06:27.984232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 27 sessionId: src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0 is DEAD
2025-10-01T14:06:27.984427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:27.984439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0] Write session will restart in 0.008475s
2025-10-01T14:06:27.984467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0] Write session: Do CDS request
2025-10-01T14:06:27.984482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:27.992281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:27.992773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:27.992911Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:27.992919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:27.992927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:27.992958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:27.993010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254450815501870:2566]
2025-10-01T14:06:27.993443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:27.993736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:27.993770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:27.993877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.993925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:27.993939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 28
2025-10-01T14:06:27.994037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:27.994073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:27.994098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.994104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.994103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 28 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:27.994114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=28 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:27.994117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:27.994105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.994106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.994107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.994108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.994109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.994110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.994111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.994112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.994113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.994114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.994115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.994116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.994120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.994129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.994134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.994137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.994140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.994144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.994147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.994150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.994153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.994156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.994160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.994163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.994166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.994169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.994175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.994182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:27.994188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.994193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:27.994197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.994202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:27.994206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.994210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:27.994215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.994219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:27.994223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.994235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:27.994241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.994247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:27.994256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.994260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:27.994264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.994268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:27.994277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.994282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.994288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.994298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.994302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.994307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.994311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.994316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:27.994319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.994324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:27.994364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:27.994518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 28 sessionId:  describe result for acl check
2025-10-01T14:06:27.994548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:27.994554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:27.994556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:27.994560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254453192360724:2664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:27.995021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254453192360724:2664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:27.996870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254453192360724:2664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:27.998054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:27.998837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:27.998854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:27.998856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:27.998859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:27.998863Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 27 [2:7556254450815501870:2566]
2025-10-01T14:06:27.998875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:27.998888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:27.998890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.998893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.998894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.998904Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:27.998908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:27.998913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:27.998953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.998960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.998961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.998964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:27.998965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:27.999025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:27.999031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:27.999039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:27.999045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:27.999054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:27.999065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254450815501865:2566]
2025-10-01T14:06:27.999067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254450815501865:2566]
2025-10-01T14:06:27.999068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254450815501865:2566]
2025-10-01T14:06:27.999074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:27.999084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360679:2446], now have 1 active actors on pipe
2025-10-01T14:06:27.999087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:27.999090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:27.999092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:27.999094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:27.999104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:27.999106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:27.999126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254450815501865:2566]
2025-10-01T14:06:27.999135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:27.999142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:27.999146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 27
2025-10-01T14:06:27.999330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254453192360724:2664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:27.999343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254453192360724:2664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:27.999347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254453192360724:2664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:27.999355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 28 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:27.999551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254453192360760:2664], now have 1 active actors on pipe
2025-10-01T14:06:27.999599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 27
2025-10-01T14:06:27.999632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.999643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.999664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:27.999679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:27.999682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:27.999685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:27.999693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:27.999704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:27.999716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.999848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:27.999856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:27.999867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:27.999938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 28 partition: 0 MaxSeqNo: 45 sessionId: src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0
2025-10-01T14:06:28.000270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6c01044-60d8a548-4d5f5892-dc24dc36_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:28.003374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0] Write session: try to update token
2025-10-01T14:06:28.003390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:28.020900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:28.020921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:28.020925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:28.020927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:28.020936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254450815501865:2566]
2025-10-01T14:06:28.020942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254450815501865:2566]
2025-10-01T14:06:28.020948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254450815501865:2566]
2025-10-01T14:06:28.021002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:28.021004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:28.021014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:28.021015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.021017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:28.021019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:28.021176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:28.024901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 28 sessionId: src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:28.028724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:28.084236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254457487328067:2506]
2025-10-01T14:06:28.084528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 27, pipe: [1:7556254457487328067:2506]
2025-10-01T14:06:28.182989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:28.183278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.183293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.183313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328067:2506], now have 1 active actors on pipe
2025-10-01T14:06:28.183652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:28.183669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254457487328067:2506]
2025-10-01T14:06:28.183693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:28.183696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:28.183780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 28 reason: error at write: Disconnected sessionId: src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0
2025-10-01T14:06:28.183814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:28.183998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 28 sessionId: src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0 is DEAD
2025-10-01T14:06:28.184169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:28.184178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0] Write session will restart in 0.009237s
2025-10-01T14:06:28.184203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0] Write session: Do CDS request
2025-10-01T14:06:28.184209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:28.194924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.194992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:28.197660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:28.197866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:28.197878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:28.197889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:28.197934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:28.197967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254455110469274:2577]
2025-10-01T14:06:28.198654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:28.198973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:28.199012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:28.199326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:28.199373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.199374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.199375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.199376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.199378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.199379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.199380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.199381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.199382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.199384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.199385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.199386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.199387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.199388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.199407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.199417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.199420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.199425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.199430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.199433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.199437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.199441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.199445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.199449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.199453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.199457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.199461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.199466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.199472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.199480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.199486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.199492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.199497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.199502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.199507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.199513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.199518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.199523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.199528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.199534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.199539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.199545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.199549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.199554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.199559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.199565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.199571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.199577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.199583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.199588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.199592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.199597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.199602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.199607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.199612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.199617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.199660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:28.202557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:28.202575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 29
2025-10-01T14:06:28.202803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.202834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 29 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:28.202840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=29 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:28.202844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:28.203396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 29 sessionId:  describe result for acl check
2025-10-01T14:06:28.203434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:28.203436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:28.203438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:28.203443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254457487328145:2676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:28.203993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254457487328145:2676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:28.206847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:28.207525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:28.207547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:28.207551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:28.207555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:28.207563Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 28 [2:7556254455110469274:2577]
2025-10-01T14:06:28.207581Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:28.207599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:28.207607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.207611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.207614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.207630Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:28.207641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:28.207651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:28.207723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.207730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.207732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.207735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:28.207739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:28.207812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:28.207819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.207832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.207844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.207867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:28.207888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254455110469268:2577]
2025-10-01T14:06:28.207896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254455110469268:2577]
2025-10-01T14:06:28.207898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254455110469268:2577]
2025-10-01T14:06:28.207908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:28.207916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:28.207921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:28.207924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:28.207927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:28.207935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:28.207938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:28.207950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328096:2446], now have 1 active actors on pipe
2025-10-01T14:06:28.207985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254455110469268:2577]
2025-10-01T14:06:28.207996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:28.208003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:28.208088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 28
2025-10-01T14:06:28.208698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254457487328145:2676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:28.227134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254457487328145:2676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:28.227155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254457487328145:2676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:28.227161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254457487328145:2676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:28.227174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 29 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:28.227439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328180:2676], now have 1 active actors on pipe
2025-10-01T14:06:28.227467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 28
2025-10-01T14:06:28.227670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.227686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.227715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:28.227731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.227738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.227740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.227752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.227769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:28.227794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.228248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.228265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.228287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.228376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 29 partition: 0 MaxSeqNo: 45 sessionId: src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0
2025-10-01T14:06:28.228749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd1f7f-61e5bfe1-bbfd153e-5132adfc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:28.231571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0] Write session: try to update token
2025-10-01T14:06:28.231592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:28.239088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:28.239111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:28.239114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:28.239116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:28.239126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254455110469268:2577]
2025-10-01T14:06:28.239131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254455110469268:2577]
2025-10-01T14:06:28.239136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254455110469268:2577]
2025-10-01T14:06:28.239191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:28.239195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:28.239201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:28.239202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.239205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:28.239206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:28.239348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:28.269450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 29 sessionId: src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:28.272559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:28.286650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254457487328184:2506]
2025-10-01T14:06:28.289284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 28, pipe: [1:7556254457487328184:2506]
2025-10-01T14:06:28.392975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:28.393314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.393334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.393358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328184:2506], now have 1 active actors on pipe
2025-10-01T14:06:28.395185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:28.395203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0] Write session will restart in 0.007048s
2025-10-01T14:06:28.395229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0] Write session: Do CDS request
2025-10-01T14:06:28.395236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:28.394482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:28.394546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254457487328184:2506]
2025-10-01T14:06:28.394567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:28.394569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:28.394626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 29 reason: error at write: Disconnected sessionId: src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0
2025-10-01T14:06:28.394802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 29 sessionId: src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0 is DEAD
2025-10-01T14:06:28.399016Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:28.403993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.404039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:28.404054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 30
2025-10-01T14:06:28.404320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.404358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 30 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:28.404367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=30 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:28.404371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:28.404772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 30 sessionId:  describe result for acl check
2025-10-01T14:06:28.404805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:28.404807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:28.404809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:28.404814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254457487328202:2680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:28.405393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254457487328202:2680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:28.408507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254457487328202:2680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:28.409652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:28.410612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:28.410848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:28.410866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:28.410878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:28.410943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:28.410988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254455110469373:2583]
2025-10-01T14:06:28.411654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:28.412257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254457487328202:2680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:28.412275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254457487328202:2680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:28.412278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254457487328202:2680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:28.412288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 30 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:28.412861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:28.412916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:28.413273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:28.413328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.413334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.413335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.413336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.413338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.413339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.413340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.413342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.413343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.413344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.413345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.413347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.413348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.413349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.413356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.413366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.413370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.413375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.413379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.413383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.413388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.413392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.413398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.413403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.413407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.413411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.413415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.413419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.413426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.413434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.413441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.413447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.413453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.413459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.413467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.413471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.413476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.413480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.413484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.413488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.413493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.413497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.413506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.413512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.413519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.413525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.413530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.413541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.413546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.413551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.413556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.413566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.413570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.413580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.413585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.413597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.413642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:28.417987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:28.418738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:28.418768Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:28.418771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:28.418776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:28.418784Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 29 [2:7556254455110469373:2583]
2025-10-01T14:06:28.418803Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:28.418824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:28.418834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.418837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.418840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.418858Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:28.418865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:28.418878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:28.418950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.418960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.418962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.418965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:28.418968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:28.419040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:28.419049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.419061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.419077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.419092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:28.419112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328268:2680], now have 1 active actors on pipe
2025-10-01T14:06:28.419115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328186:2446], now have 1 active actors on pipe
2025-10-01T14:06:28.419121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254455110469368:2583]
2025-10-01T14:06:28.419123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254455110469368:2583]
2025-10-01T14:06:28.419126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254455110469368:2583]
2025-10-01T14:06:28.419142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:28.419157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:28.419164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:28.419172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:28.419176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:28.419178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:28.419180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:28.419214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254455110469368:2583]
2025-10-01T14:06:28.419227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:28.419239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:28.419464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 29
2025-10-01T14:06:28.419494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 29
2025-10-01T14:06:28.419722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.419740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.419775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:28.419790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.419795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.419798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.419810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.419827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:28.419848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.420074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.420085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.420100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.420569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 30 partition: 0 MaxSeqNo: 45 sessionId: src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0
2025-10-01T14:06:28.420997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3854c4-65667bc8-9d5dba0e-3614f40b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:28.424282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0] Write session: try to update token
2025-10-01T14:06:28.424305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:28.450036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 30 sessionId: src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:28.453173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:28.455800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.455828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.455848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:28.455851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:28.455854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:28.455859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:28.455866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254455110469368:2583]
2025-10-01T14:06:28.455871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254455110469368:2583]
2025-10-01T14:06:28.455875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254455110469368:2583]
2025-10-01T14:06:28.455936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:28.455942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.455945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:28.455990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:28.455997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:28.456001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:28.456105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:28.494397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254457487328280:2506]
2025-10-01T14:06:28.494639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 29, pipe: [1:7556254457487328280:2506]
2025-10-01T14:06:28.603275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:28.603521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:28.603564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328280:2506], now have 1 active actors on pipe
2025-10-01T14:06:28.603692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:28.603787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:28.603794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:28.603842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 30 reason: error at write: Disconnected sessionId: src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0
2025-10-01T14:06:28.603855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254457487328280:2506]
2025-10-01T14:06:28.603874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:28.603960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 30 sessionId: src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0 is DEAD
2025-10-01T14:06:28.604113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:28.604125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0] Write session will restart in 0.007718s
2025-10-01T14:06:28.604149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0] Write session: Do CDS request
2025-10-01T14:06:28.604157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:28.611581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:28.611940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:28.612091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:28.612101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:28.612110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:28.612153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:28.612186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254455110469459:2586]
2025-10-01T14:06:28.612814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:28.612835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.612878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:28.612890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 31
2025-10-01T14:06:28.613113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:28.613151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:28.613229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.613284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 31 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:28.613290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=31 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:28.613302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:28.613467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:28.613521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.613528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.613529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.613531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.613532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.613533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.613534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.613535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.613536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.613538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.613539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.613540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.613541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.613542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.613548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.613558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.613562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.613565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.613569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.613573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.613577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.613581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.613584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.613589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.613593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.613598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.613603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.613607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.613614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.613621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.613627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.613632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.613636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.613641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.613645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.613656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.613661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.613670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.613675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.613680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.613670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 31 sessionId:  describe result for acl check
2025-10-01T14:06:28.613685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.613691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.613695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.613697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:28.613700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.613705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.613698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:28.613710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.613715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.613720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.613726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.613732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.613699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:28.613702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254457487328331:2685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:28.613736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.613742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.613747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.613752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.613757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.613762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.613802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:28.614087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254457487328331:2685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:28.615897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254457487328331:2685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:28.617599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:28.618282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:28.618297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:28.618300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:28.618303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:28.618310Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 30 [2:7556254455110469459:2586]
2025-10-01T14:06:28.618325Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:28.618340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:28.618350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.618354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.618357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.618394Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:28.618402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:28.618412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:28.618465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.618472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.618474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.618477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:28.618480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:28.618520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254457487328331:2685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:28.618545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:28.618552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.618534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254457487328331:2685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:28.618563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.618537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254457487328331:2685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:28.618575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.618596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:28.618548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 31 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:28.618614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328283:2446], now have 1 active actors on pipe
2025-10-01T14:06:28.618625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254455110469454:2586]
2025-10-01T14:06:28.618632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254455110469454:2586]
2025-10-01T14:06:28.618634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254455110469454:2586]
2025-10-01T14:06:28.618646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:28.618658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:28.618659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:28.618668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:28.618670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:28.618673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:28.618676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:28.618698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254455110469454:2586]
2025-10-01T14:06:28.618698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 30
2025-10-01T14:06:28.618705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:28.618712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:28.618734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328367:2685], now have 1 active actors on pipe
2025-10-01T14:06:28.618774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 30
2025-10-01T14:06:28.618814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.618824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.618845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:28.618857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.618861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.618863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.618871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.618878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:28.618891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.619057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.619064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.619075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.619154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 31 partition: 0 MaxSeqNo: 45 sessionId: src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0
2025-10-01T14:06:28.619516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35c4557-1bc6079f-5ec55eec-6ee217ec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:28.622976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0] Write session: try to update token
2025-10-01T14:06:28.622993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:28.629599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:28.629616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:28.629624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254455110469454:2586]
2025-10-01T14:06:28.629661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:28.629669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:28.629817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:28.629970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:28.630121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:28.630286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:28.630521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:28.630564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:28.640885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 31 sessionId: src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:28.643566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:28.643762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.643788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.643823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:28.643888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:28.650947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:28.650968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:28.650971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:28.650973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:28.650982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254455110469454:2586]
2025-10-01T14:06:28.650986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254455110469454:2586]
2025-10-01T14:06:28.650989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254455110469454:2586]
2025-10-01T14:06:28.651032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:28.651045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.651044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:28.651047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:28.651051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:28.651055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:28.651187Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:28.703793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254457487328386:2506]
2025-10-01T14:06:28.704035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 30, pipe: [1:7556254457487328386:2506]
2025-10-01T14:06:28.800728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:28.809363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.809397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.809590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.809678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.809759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.809825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.809880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.809895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.809968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.810039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.810105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.810186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.810242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.810251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.810331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.810429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.810504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.810580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.810636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.810650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.810730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.810803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.810880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.810952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.811009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.811020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.811100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.811171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.811250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.811315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.811362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.811365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.811440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.811507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.811570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.811635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.811700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.811706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.811775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.811833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.811896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.811966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.812031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.812036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.812094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.812148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.812204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.812265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.812310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.812315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.812384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.812452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.812516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.812573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.812620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.812625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.812682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:28.812739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:28.812796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:28.813326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254457487328386:2506]
2025-10-01T14:06:28.813356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:28.813917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:28.813929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0] Write session will restart in 0.008074s
2025-10-01T14:06:28.813956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0] Write session: Do CDS request
2025-10-01T14:06:28.813962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:28.813524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:28.813533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:28.813560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 31 reason: error at write: Disconnected sessionId: src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0
2025-10-01T14:06:28.813793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 31 sessionId: src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0 is DEAD
2025-10-01T14:06:28.812881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:28.812957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:28.812960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:28.813037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328386:2506], now have 1 active actors on pipe
2025-10-01T14:06:28.814107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:28.822908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.822996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:28.823011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 32
2025-10-01T14:06:28.823132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:28.823171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 32 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:28.823176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=32 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:28.823180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:28.823585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 32 sessionId:  describe result for acl check
2025-10-01T14:06:28.823619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:28.823625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:28.823626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:28.823632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254457487328436:2690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:28.824146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254457487328436:2690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:28.825941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254457487328436:2690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:28.822949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:28.827554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:28.827895Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:28.827913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:28.827952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:28.828077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:28.828160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254455110469556:2589]
2025-10-01T14:06:28.828388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254457487328436:2690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:28.828401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254457487328436:2690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:28.828404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254457487328436:2690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:28.828413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 32 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:28.828813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:28.829110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:28.829163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:28.829504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:28.829568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.829574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.829575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.829577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.829578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.829580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.829581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.829582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.829584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.829585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.829587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.829588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.829589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.829591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.829597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.829608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.829613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.829618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.829621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.829626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.829630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.829634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.829638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.829642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.829646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.829649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.829654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.829658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.829671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.829684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:28.829694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.829704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:28.829709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.829717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:28.829722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.829732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:28.829737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.829747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:28.829758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.829766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:28.829776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.829782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:28.829786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.829794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:28.829798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.829807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:28.829812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.829817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.829825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.829830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.829835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.829842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.829846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.829855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:28.829859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.829868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:28.829908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:28.833925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:28.834666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:28.834686Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:28.834689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:28.834693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:28.834700Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 31 [2:7556254455110469556:2589]
2025-10-01T14:06:28.834720Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:28.834743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:28.834750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.834755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.834757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.834778Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:28.834788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:28.834796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:28.834865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.834872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.834875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.834878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:28.834881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:28.834964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:28.834972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.834984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:28.834995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:28.835011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:28.835034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328389:2446], now have 1 active actors on pipe
2025-10-01T14:06:28.835042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328471:2690], now have 1 active actors on pipe
2025-10-01T14:06:28.835050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254455110469550:2589]
2025-10-01T14:06:28.835053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254455110469550:2589]
2025-10-01T14:06:28.835055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254455110469550:2589]
2025-10-01T14:06:28.835067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:28.835078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:28.835081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:28.835086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:28.835088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:28.835093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:28.835096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:28.835119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 31
2025-10-01T14:06:28.835135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254455110469550:2589]
2025-10-01T14:06:28.835122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 31
2025-10-01T14:06:28.835145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:28.835147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:28.835178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.835189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.835227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:28.835238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:28.835242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:28.835245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:28.835254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:28.835264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:28.835281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.835423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.835431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.835444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:28.835515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 32 partition: 0 MaxSeqNo: 45 sessionId: src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0
2025-10-01T14:06:28.835875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721d5328-2e4d44f4-77d67d37-ef63e46a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:28.838657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0] Write session: try to update token
2025-10-01T14:06:28.838675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:28.853683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 32 sessionId: src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:28.856344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:28.856956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:28.856983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:28.857003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:28.857006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:28.857009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:28.857011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:28.857020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254455110469550:2589]
2025-10-01T14:06:28.857024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254455110469550:2589]
2025-10-01T14:06:28.857029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254455110469550:2589]
2025-10-01T14:06:28.857084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:28.857095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:28.857097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:28.857100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:28.857102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:28.857104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:28.857256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:28.914484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254457487328482:2506]
2025-10-01T14:06:28.918592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 31, pipe: [1:7556254457487328482:2506]
2025-10-01T14:06:29.011365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:29.011622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:29.011680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254457487328482:2506], now have 1 active actors on pipe
2025-10-01T14:06:29.013623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:29.013637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0] Write session will restart in 0.006142s
2025-10-01T14:06:29.013671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0] Write session: Do CDS request
2025-10-01T14:06:29.013679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:29.013155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:29.013261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:29.013264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:29.013334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 32 reason: error at write: Disconnected sessionId: src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0
2025-10-01T14:06:29.013421Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:29.013468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 32 sessionId: src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0 is DEAD
2025-10-01T14:06:29.013473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254457487328482:2506]
2025-10-01T14:06:29.020925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.021017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:29.021030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 33
2025-10-01T14:06:29.021311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.021354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 33 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:29.021360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=33 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:29.021363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:29.021883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 33 sessionId:  describe result for acl check
2025-10-01T14:06:29.021920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:29.021926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:29.021928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:29.021934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254461782295830:2694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:29.021823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:29.022280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:29.022518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254461782295830:2694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:29.022499Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:29.022510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:29.022522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:29.022579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:29.022610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254459405436938:2591]
2025-10-01T14:06:29.023258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:29.023530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:29.023566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:29.023888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:29.023974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.023975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.023976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.023978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.023979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.023979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.023981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.023982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.023984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.023985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.023986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.023988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.023989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.023990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.023996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.024006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.024010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.024014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.024018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.024022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.024026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.024030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.024033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.024038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.024042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.024046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.024049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.024053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.024062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.024069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.024075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.024080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.024085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.024090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.024094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.024099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.024103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.024108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.024113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.024118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.024125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.024129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.024133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.024138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.024144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.024149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.024153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.024157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.024162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.024166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.024171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.024175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.024180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.024184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.024188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.024193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.024229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:29.024568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254461782295830:2694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:29.028118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254461782295830:2694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:29.028137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254461782295830:2694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:29.028141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254461782295830:2694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:29.028150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 33 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:29.028345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:29.029074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:29.029093Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:29.029096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:29.029100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:29.029107Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 32 [2:7556254459405436938:2591]
2025-10-01T14:06:29.029125Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:29.029141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:29.029149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.029154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.029156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.029173Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:29.029181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:29.029189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:29.029456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 32
2025-10-01T14:06:29.029474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 32
2025-10-01T14:06:29.029251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.029259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.029261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.029264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:29.029267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:29.029338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:29.029341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.029351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.029361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.029376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:29.029393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782295867:2694], now have 1 active actors on pipe
2025-10-01T14:06:29.029397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782295783:2446], now have 1 active actors on pipe
2025-10-01T14:06:29.029893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 33 partition: 0 MaxSeqNo: 45 sessionId: src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0
2025-10-01T14:06:29.029404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254459405436933:2591]
2025-10-01T14:06:29.029407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254459405436933:2591]
2025-10-01T14:06:29.029409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254459405436933:2591]
2025-10-01T14:06:29.029422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:29.029435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:29.029448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:29.029449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:29.029451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:29.029452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:29.029453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:29.029486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254459405436933:2591]
2025-10-01T14:06:29.029488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:29.029491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:29.029506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.029511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.029558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:29.029565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.029575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.029580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:29.029589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.029597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:29.029621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.029781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.029787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.029811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.030391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a359b681-3806c908-4da5b1aa-9cc753e1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:29.033279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0] Write session: try to update token
2025-10-01T14:06:29.033293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:29.054598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:29.054621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:29.054624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:29.054626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:29.054636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254459405436933:2591]
2025-10-01T14:06:29.054641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254459405436933:2591]
2025-10-01T14:06:29.054646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254459405436933:2591]
2025-10-01T14:06:29.054692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:29.054697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:29.054698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:29.054701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:29.054718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.054721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:29.054874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:29.057757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 33 sessionId: src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:29.060567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:29.114657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254461782295880:2506]
2025-10-01T14:06:29.115067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 32, pipe: [1:7556254461782295880:2506]
2025-10-01T14:06:29.226181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:29.226554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.226573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.226619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782295880:2506], now have 1 active actors on pipe
2025-10-01T14:06:29.227315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:29.227390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 33 reason: status is not ok: tablet will be restarted right now sessionId: src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0
2025-10-01T14:06:29.227607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 33 sessionId: src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0 is DEAD
2025-10-01T14:06:29.226913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:29.228021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:29.228031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0] Write session will restart in 0.008836s
2025-10-01T14:06:29.228057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0] Write session: Do CDS request
2025-10-01T14:06:29.228064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:29.227788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:29.227834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254461782295880:2506]
2025-10-01T14:06:29.237898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.238253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:29.238270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 34
2025-10-01T14:06:29.238395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.238429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 34 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:29.238434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=34 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:29.238436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:29.238909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 34 sessionId:  describe result for acl check
2025-10-01T14:06:29.238942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:29.238947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:29.238949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:29.238954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254461782295916:2706] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:29.239375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254461782295916:2706] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:29.241171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254461782295916:2706] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:29.243961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254461782295916:2706] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:29.243975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254461782295916:2706] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:29.243978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254461782295916:2706] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:29.243988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 34 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:29.249219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:29.249950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:29.250122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:29.250129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:29.250137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:29.250170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:29.250201Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254459405437051:2600]
2025-10-01T14:06:29.250696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:29.250973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:29.251001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:29.251209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:29.251259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.251265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.251267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.251267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.251268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.251269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.251270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.251271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.251271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.251272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.251273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.251274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.251274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.251275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.251279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.251285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.251287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.251289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.251291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.251293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.251295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.251297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.251299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.251301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.251303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.251305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.251307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.251309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.251315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.251319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.251324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.251327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.251330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.251333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.251335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.251339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.251343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.251348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.251352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.251357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.251362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.251366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.251370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.251376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.251382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.251387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.251390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.251393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.251395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.251398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.251401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.251404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.251407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.251411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.251415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.251420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.251455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:29.259638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 33
2025-10-01T14:06:29.259679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 33
2025-10-01T14:06:29.260173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 34 partition: 0 MaxSeqNo: 45 sessionId: src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0
2025-10-01T14:06:29.260497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79bab5cb-64c96cad-7fe2b09a-39270b1f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:29.258357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:29.259199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:29.259205Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:29.259213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:29.259216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:29.259226Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 33 [2:7556254459405437051:2600]
2025-10-01T14:06:29.259245Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:29.259262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:29.259265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.259268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.259271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.259288Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:29.259293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:29.259300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:29.259373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.259375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.259377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.259380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:29.259383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:29.259487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:29.259489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.259500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.259512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.259528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:29.259547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782295898:2446], now have 1 active actors on pipe
2025-10-01T14:06:29.259550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782295969:2706], now have 1 active actors on pipe
2025-10-01T14:06:29.259558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254459405437045:2600]
2025-10-01T14:06:29.259560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254459405437045:2600]
2025-10-01T14:06:29.259562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254459405437045:2600]
2025-10-01T14:06:29.259581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:29.259597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:29.259611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:29.259616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:29.259622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:29.259625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:29.259628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:29.259653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254459405437045:2600]
2025-10-01T14:06:29.259656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:29.259661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:29.259783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.259788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.259813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:29.259822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.259827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.259829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:29.259837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.259846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:29.259861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.260034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.260037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.260052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.263209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0] Write session: try to update token
2025-10-01T14:06:29.263229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:29.284792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 34 sessionId: src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:29.288200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:29.288222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:29.288225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:29.288228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:29.288238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254459405437045:2600]
2025-10-01T14:06:29.288243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254459405437045:2600]
2025-10-01T14:06:29.288247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254459405437045:2600]
2025-10-01T14:06:29.288296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:29.288309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.288311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:29.288321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:29.288333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:29.288337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:29.288490Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:29.287437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:29.328450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254461782296003:2506]
2025-10-01T14:06:29.328705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 33, pipe: [1:7556254461782296003:2506]
2025-10-01T14:06:29.443460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:29.443760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.443777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.443820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296003:2506], now have 1 active actors on pipe
2025-10-01T14:06:29.444075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:29.444075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:29.444089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:29.444104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:29.444153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254461782296003:2506]
2025-10-01T14:06:29.444169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 34 reason: error at write: Disconnected sessionId: src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0
2025-10-01T14:06:29.444348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 34 sessionId: src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0 is DEAD
2025-10-01T14:06:29.444544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:29.444557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0] Write session will restart in 0.007328s
2025-10-01T14:06:29.444584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0] Write session: Do CDS request
2025-10-01T14:06:29.444590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:29.452384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:29.452752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:29.452897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:29.452905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:29.452917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.452912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:29.452942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:29.452970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254459405437154:2608]
2025-10-01T14:06:29.453181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:29.453197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 35
2025-10-01T14:06:29.453301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.453332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 35 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:29.453356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=35 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:29.453365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:29.453363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:29.453620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:29.453669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:29.453942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 35 sessionId:  describe result for acl check
2025-10-01T14:06:29.453982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:29.453984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:29.453986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:29.453970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:29.453990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254461782296058:2710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:29.454024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.454029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.454030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.454031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.454033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.454034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.454035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.454036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.454037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.454038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.454039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.454040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.454041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.454042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.454047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.454056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.454059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.454063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.454067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.454070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.454074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.454077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.454081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.454085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.454089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.454092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.454095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.454099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.454105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.454112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.454119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.454124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.454128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.454133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.454138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.454143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.454147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.454152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.454156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.454161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.454165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.454172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.454177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.454181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.454190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.454196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.454201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.454205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.454213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.454218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.454222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.454230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.454234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.454239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.454243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.454251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.454289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:29.454531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254461782296058:2710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:29.456048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254461782296058:2710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:29.457857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:29.458453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254461782296058:2710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:29.458465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254461782296058:2710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:29.458469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254461782296058:2710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:29.458477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 35 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:29.458536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:29.458547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:29.458550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:29.458553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:29.458559Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 34 [2:7556254459405437154:2608]
2025-10-01T14:06:29.458575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:29.458595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:29.458601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.458604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.458606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.458621Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:29.458630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:29.458637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:29.458689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.458695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.458697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.458700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:29.458703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:29.458765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:29.458771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.458781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.458796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.458816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:29.458836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296095:2710], now have 1 active actors on pipe
2025-10-01T14:06:29.458830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 34
2025-10-01T14:06:29.458842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296006:2446], now have 1 active actors on pipe
2025-10-01T14:06:29.458838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 34
2025-10-01T14:06:29.458849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254459405437149:2608]
2025-10-01T14:06:29.458851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254459405437149:2608]
2025-10-01T14:06:29.458853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254459405437149:2608]
2025-10-01T14:06:29.458862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:29.458868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:29.458870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:29.458872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:29.458875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:29.458889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:29.458896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:29.458911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.458918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.458959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254459405437149:2608]
2025-10-01T14:06:29.458969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:29.458975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:29.458986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:29.458996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.459004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.459009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:29.459017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.459029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:29.459065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.459174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.459180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.459192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.459251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 35 partition: 0 MaxSeqNo: 45 sessionId: src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0
2025-10-01T14:06:29.459563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c065a86f-e7d76595-4fbb9ceb-120ea267_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:29.462599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0] Write session: try to update token
2025-10-01T14:06:29.462617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:29.479209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:29.479232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:29.479234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 35 sessionId: src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:29.479234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:29.479236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:29.479246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254459405437149:2608]
2025-10-01T14:06:29.479251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254459405437149:2608]
2025-10-01T14:06:29.479255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254459405437149:2608]
2025-10-01T14:06:29.479304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:29.479309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:29.479315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:29.479317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.479319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:29.479320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:29.479493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:29.481764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:29.544491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254461782296104:2506]
2025-10-01T14:06:29.544729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 34, pipe: [1:7556254461782296104:2506]
2025-10-01T14:06:29.625833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:29.626118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.626132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.626173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296104:2506], now have 1 active actors on pipe
2025-10-01T14:06:29.626591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:29.628796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:29.628900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 35 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0
2025-10-01T14:06:29.629078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 35 sessionId: src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0 is DEAD
2025-10-01T14:06:29.629230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254461782296104:2506]
2025-10-01T14:06:29.629244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:29.634670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:29.634684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0] Write session will restart in 0.005150s
2025-10-01T14:06:29.634722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0] Write session: Do CDS request
2025-10-01T14:06:29.634728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:29.640874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.640952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:29.640964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 36
2025-10-01T14:06:29.641070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.641097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 36 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:29.641105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=36 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:29.641109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:29.641508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 36 sessionId:  describe result for acl check
2025-10-01T14:06:29.641537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:29.641542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:29.641544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:29.641549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254461782296156:2715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:29.642067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254461782296156:2715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:29.642551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:29.642988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:29.643167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:29.643177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:29.643189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:29.643243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:29.643298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254459405437247:2611]
2025-10-01T14:06:29.643844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:29.643913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254461782296156:2715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:29.644092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:29.644140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:29.644417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:29.644479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.644485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.644486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.644487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.644487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.644488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.644490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.644491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.644491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.644493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.644494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.644495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.644496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.644497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.644502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.644511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.644515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.644518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.644522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.644525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.644528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.644532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.644535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.644539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.644542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.644545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.644549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.644552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.644559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.644567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.644573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.644578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.644582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.644593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.644597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.644602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.644607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.644616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.644625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.644629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.644638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.644643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.644649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.644657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.644662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.644671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.644674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.644680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.644684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.644692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.644696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.644701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.644710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.644715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.644723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.644728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.644759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:29.648266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254461782296156:2715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:29.648280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254461782296156:2715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:29.648283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254461782296156:2715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:29.648290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 36 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:29.648482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:29.649209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:29.649228Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:29.649230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:29.649234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:29.649240Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 35 [2:7556254459405437247:2611]
2025-10-01T14:06:29.649256Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:29.649274Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:29.649280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.649283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.649285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.649303Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:29.649312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:29.649321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:29.649372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.649378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.649380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.649383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:29.649385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:29.649454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:29.649461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.649471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.649483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.649499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:29.649519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254459405437242:2611]
2025-10-01T14:06:29.649525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254459405437242:2611]
2025-10-01T14:06:29.649527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254459405437242:2611]
2025-10-01T14:06:29.649535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:29.649547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:29.649551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:29.649559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:29.649561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:29.649564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:29.649567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:29.649577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296197:2715], now have 1 active actors on pipe
2025-10-01T14:06:29.649585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296107:2446], now have 1 active actors on pipe
2025-10-01T14:06:29.649609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254459405437242:2611]
2025-10-01T14:06:29.649625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:29.649637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:29.649623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 35
2025-10-01T14:06:29.649632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 35
2025-10-01T14:06:29.649680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.649688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.649712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:29.649723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.649731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.649733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:29.649743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.649753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:29.649770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.649904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.649913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.649928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.650014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 36 partition: 0 MaxSeqNo: 45 sessionId: src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0
2025-10-01T14:06:29.650360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16d85e4f-5e6e1b7d-d107dcf3-3e37c9b2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:29.653282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0] Write session: try to update token
2025-10-01T14:06:29.653299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:29.664672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:29.664699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:29.664710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254459405437242:2611]
2025-10-01T14:06:29.664759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:29.664760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:29.664961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:29.665127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:29.665284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:29.665442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:29.665669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:29.665712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:29.667975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 36 sessionId: src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:29.670448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:29.670686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.670712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.670751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:29.670845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:29.683663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:29.683684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:29.683687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:29.683689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:29.683699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254459405437242:2611]
2025-10-01T14:06:29.683703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254459405437242:2611]
2025-10-01T14:06:29.683707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254459405437242:2611]
2025-10-01T14:06:29.683761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:29.683769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:29.683774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.683777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:29.683779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:29.683783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:29.683918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:29.726261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254461782296216:2506]
2025-10-01T14:06:29.726604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 35, pipe: [1:7556254461782296216:2506]
2025-10-01T14:06:29.830282Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:29.838979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.839017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.839196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.839265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.839330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.839396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.839456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.839465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.839539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.839606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.839676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.839744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.839799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.839806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.839889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.839963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.840045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.840120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.840179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.840187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.840259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.840324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.840394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.840458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.840507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.840515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.840585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.840649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.840713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.840775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.840825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.840834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.840921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.840987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.841056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.841123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.841177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.841189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.841256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.841314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.841377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.841447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.841494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.841503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.841561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.841622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.841687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.841746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.841826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.841833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.841893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.841950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.842003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.842062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.842124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.842126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.842195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:29.842252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:29.842315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:29.842399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:29.842446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:29.842456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:29.842533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296216:2506], now have 1 active actors on pipe
2025-10-01T14:06:29.842821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254461782296216:2506]
2025-10-01T14:06:29.842852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:29.842937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:29.842946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:29.842972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 36 reason: error at write: Disconnected sessionId: src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0
2025-10-01T14:06:29.843174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 36 sessionId: src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0 is DEAD
2025-10-01T14:06:29.843318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:29.843327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0] Write session will restart in 0.007224s
2025-10-01T14:06:29.843362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0] Write session: Do CDS request
2025-10-01T14:06:29.843368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:29.844005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:29.852173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.852554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:29.852566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 37
2025-10-01T14:06:29.852662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:29.852698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 37 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:29.852703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=37 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:29.852707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:29.853149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 37 sessionId:  describe result for acl check
2025-10-01T14:06:29.853188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:29.853193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:29.853195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:29.853199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254461782296231:2720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:29.853754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254461782296231:2720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:29.855549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254461782296231:2720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:29.860078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254461782296231:2720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:29.860095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254461782296231:2720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:29.860099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254461782296231:2720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:29.860109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 37 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:29.861922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:29.862644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:29.862891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:29.862903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:29.862914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:29.862972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:29.863025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254459405437352:2614]
2025-10-01T14:06:29.863697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:29.865731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:29.865795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:29.866180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:29.866256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.866265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.866266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.866268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.866269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.866271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.866272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.866273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.866275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.866276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.866278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.866280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.866281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.866283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.866289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.866300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.866304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.866308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.866312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.866316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.866320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.866324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.866328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.866331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.866335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.866338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.866341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.866345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.866353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.866361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:29.866367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.866396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:29.866402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.866406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:29.866411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.866417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:29.866421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.866427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:29.866433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.866437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:29.866442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.866449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:29.866453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.866459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:29.866463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.866468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:29.866473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.866478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.866483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.866496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.866502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.866507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.866517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.866521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:29.866525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.866531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:29.866574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:29.872533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:29.874207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 36
2025-10-01T14:06:29.874266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 36
2025-10-01T14:06:29.873325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:29.873340Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:29.873342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:29.873347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:29.873352Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 36 [2:7556254459405437352:2614]
2025-10-01T14:06:29.873370Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:29.873387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:29.873391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.873395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.873398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.873413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:29.873418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:29.873424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:29.873488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.873491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.873493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.873496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:29.873500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:29.873568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:29.873571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.873582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:29.873592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:29.873606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:29.873621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254459405437347:2614]
2025-10-01T14:06:29.873624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254459405437347:2614]
2025-10-01T14:06:29.873626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254459405437347:2614]
2025-10-01T14:06:29.873638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:29.873650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:29.873663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:29.873666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:29.873698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254459405437347:2614]
2025-10-01T14:06:29.873700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:29.873824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:29.873827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:29.873829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:29.873836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:29.874840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296219:2446], now have 1 active actors on pipe
2025-10-01T14:06:29.874855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296303:2720], now have 1 active actors on pipe
2025-10-01T14:06:29.874879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.874884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.874914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:29.874923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:29.874927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:29.874929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:29.874939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:29.874951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:29.874969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.877437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.877464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.877507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:29.877640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 37 partition: 0 MaxSeqNo: 45 sessionId: src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0
2025-10-01T14:06:29.878030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5237ad1a-e53a8e88-24798f2c-d209886c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:29.881001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0] Write session: try to update token
2025-10-01T14:06:29.881020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:29.897321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 37 sessionId: src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:29.900364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:29.901156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:29.901187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:29.901208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:29.901211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:29.901214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:29.901216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:29.901225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254459405437347:2614]
2025-10-01T14:06:29.901229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254459405437347:2614]
2025-10-01T14:06:29.901234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254459405437347:2614]
2025-10-01T14:06:29.901292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:29.901308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:29.901312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:29.901371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:29.901384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:29.901388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:29.901467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:29.946273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254461782296318:2506]
2025-10-01T14:06:29.946785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 36, pipe: [1:7556254461782296318:2506]
2025-10-01T14:06:30.043595Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:30.043995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:30.044043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254461782296318:2506], now have 1 active actors on pipe
2025-10-01T14:06:30.044143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:30.044215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254461782296318:2506]
2025-10-01T14:06:30.044243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:30.044244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:30.044251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:30.044322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 37 reason: error at write: Disconnected sessionId: src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0
2025-10-01T14:06:30.044468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 37 sessionId: src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0 is DEAD
2025-10-01T14:06:30.044602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:30.044615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0] Write session will restart in 0.006845s
2025-10-01T14:06:30.044641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0] Write session: Do CDS request
2025-10-01T14:06:30.044651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:30.053004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.053889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:30.054202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:30.054217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 38
2025-10-01T14:06:30.054351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.054394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 38 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:30.054405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=38 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:30.054409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:30.054497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:30.054677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:30.054687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:30.054696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:30.054740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:30.054785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254463700404738:2616]
2025-10-01T14:06:30.054877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 38 sessionId:  describe result for acl check
2025-10-01T14:06:30.054908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:30.054913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:30.054916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:30.054920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254466077263669:2724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:30.055402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:30.055463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254466077263669:2724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:30.055762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:30.055805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:30.056252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:30.056300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.056301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.056301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.056302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.056303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.056303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.056304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.056305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.056305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.056306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.056307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.056308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.056308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.056309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.056313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.056319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.056321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.056323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.056325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.056327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.056329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.056331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.056333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.056335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.056337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.056339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.056341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.056343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.056348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.056353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.056356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.056360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.056362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.056365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.056368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.056370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.056373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.056376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.056379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.056382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.056384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.056388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.056390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.056393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.056396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.056400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.056402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.056408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.056411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.056414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.056416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.056419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.056421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.056423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.056427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.056432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.056469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:30.057210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254466077263669:2724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:30.060203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254466077263669:2724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:30.060217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254466077263669:2724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:30.060221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254466077263669:2724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:30.060230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 38 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:30.060486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:30.061103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:30.061117Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:30.061120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:30.061123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:30.061128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 37 [2:7556254463700404738:2616]
2025-10-01T14:06:30.061139Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:30.061151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:30.061156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.061159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.061160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.061170Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:30.061174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:30.061179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:30.061226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.061230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.061232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.061234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:30.061236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:30.061292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:30.061298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.061305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.061311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.061320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:30.061334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254463700404733:2616]
2025-10-01T14:06:30.061339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254463700404733:2616]
2025-10-01T14:06:30.061340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254463700404733:2616]
2025-10-01T14:06:30.061349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:30.061360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:30.061361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:30.061371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:30.061373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:30.061376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:30.061379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:30.061388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263708:2724], now have 1 active actors on pipe
2025-10-01T14:06:30.061391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263616:2446], now have 1 active actors on pipe
2025-10-01T14:06:30.061418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254463700404733:2616]
2025-10-01T14:06:30.061431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:30.061434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 37
2025-10-01T14:06:30.061450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 37
2025-10-01T14:06:30.061462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:30.061564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.061576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.061602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e56f8d7a-e014db68-4384989a-3f702d56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:30.061613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.061617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.061623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:30.061631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.061645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:30.061662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.061809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.061818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.061830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.061917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 38 partition: 0 MaxSeqNo: 45 sessionId: src_id|e56f8d7a-e014db68-4384989a-3f702d56_0
2025-10-01T14:06:30.062252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48a3f6f0-137d2d14-fa15969e-f4eb648b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e56f8d7a-e014db68-4384989a-3f702d56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:30.065194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56f8d7a-e014db68-4384989a-3f702d56_0] Write session: try to update token
2025-10-01T14:06:30.065212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56f8d7a-e014db68-4384989a-3f702d56_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:30.072510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:30.072534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:30.072546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254463700404733:2616]
2025-10-01T14:06:30.072586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:30.072589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:30.072752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:30.072946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.073096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.073230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.073422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:30.073465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:30.081593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 38 sessionId: src_id|e56f8d7a-e014db68-4384989a-3f702d56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:30.084340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:30.084529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.084553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.084600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:30.084683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:30.092776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:30.092798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:30.092800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:30.092801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:30.092811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254463700404733:2616]
2025-10-01T14:06:30.092813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254463700404733:2616]
2025-10-01T14:06:30.092816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254463700404733:2616]
2025-10-01T14:06:30.092866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:30.092873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.092875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:30.092884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:30.092890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:30.092896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:30.093003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:30.097913Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-10-01T14:06:30.097925Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-10-01T14:06:30.144556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254466077263727:2506]
2025-10-01T14:06:30.144810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 37, pipe: [1:7556254466077263727:2506]
2025-10-01T14:06:30.235756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:30.242506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.242534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.242699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.242763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.242828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.242892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.242945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.242955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.243024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.243089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.243154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.243221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.243272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.243280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.243342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.243402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.243493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.243555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.243593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.243602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.243656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.243708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.243763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.243813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.243860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.243866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.243920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.243968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.244021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.244080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.244125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.244130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.244199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.244262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.244329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.244389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.244440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.244445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.244505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.244557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.244613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.244669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.244714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.244718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.244776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.244834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.244902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.244957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.244999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.245004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.245062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.245117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.245173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.245230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.245277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.245282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.245338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.245388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.245444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.245499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.245541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.245546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.245588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263727:2506], now have 1 active actors on pipe
2025-10-01T14:06:30.245724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:30.245738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:30.245765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 38 reason: error at write: Disconnected sessionId: src_id|e56f8d7a-e014db68-4384989a-3f702d56_0
2025-10-01T14:06:30.245922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 38 sessionId: src_id|e56f8d7a-e014db68-4384989a-3f702d56_0 is DEAD
2025-10-01T14:06:30.246064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56f8d7a-e014db68-4384989a-3f702d56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:30.246074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56f8d7a-e014db68-4384989a-3f702d56_0] Write session will restart in 0.008568s
2025-10-01T14:06:30.246076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:30.246097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56f8d7a-e014db68-4384989a-3f702d56_0] Write session: Do CDS request
2025-10-01T14:06:30.246103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56f8d7a-e014db68-4384989a-3f702d56_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:30.246117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254466077263727:2506]
2025-10-01T14:06:30.246221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:30.251969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:30.252358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:30.252545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:30.252556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:30.252563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:30.252613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:30.252649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254463700404835:2619]
2025-10-01T14:06:30.253102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:30.253370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:30.253411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:30.253681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:30.253728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.253733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.253734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.253734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.253735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.253736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.253737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.253737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.253738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.253739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.253739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.253740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.253740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.253741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.253744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.253750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.253753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.253755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.253757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.253759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.253761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.253763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.253765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.253767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.253769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.253771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.253773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.253775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.253780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.253785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.253789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.253792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.253798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.253803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.253808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.253811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.253814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.253816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.253820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.253822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.253825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.253827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.253829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.253832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.253834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.253850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.253856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.253859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.253862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.253865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.253870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.253873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.253875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.253878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.253880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.253886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.253907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:30.255817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e56f8d7a-e014db68-4384989a-3f702d56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.255928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:30.255941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 39
2025-10-01T14:06:30.256062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.256094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 39 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:30.256105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=39 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:30.256109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:30.256391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 39 sessionId:  describe result for acl check
2025-10-01T14:06:30.256416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:30.256417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:30.256418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:30.256422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254466077263804:2735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:30.256809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254466077263804:2735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:30.257722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:30.258112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254466077263804:2735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:30.258336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:30.258351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:30.258353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:30.258356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:30.258362Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 38 [2:7556254463700404835:2619]
2025-10-01T14:06:30.258393Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:30.258412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:30.258419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.258424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.258426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.258438Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:30.258444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:30.258449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:30.258498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.258504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.258505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.258507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:30.258509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:30.258565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:30.258577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.258586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.258595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.258609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:30.258630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263745:2446], now have 1 active actors on pipe
2025-10-01T14:06:30.258642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254463700404830:2619]
2025-10-01T14:06:30.258644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254463700404830:2619]
2025-10-01T14:06:30.258646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254463700404830:2619]
2025-10-01T14:06:30.258658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:30.258673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:30.258674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:30.258684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:30.258686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:30.258688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:30.258691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:30.258717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254463700404830:2619]
2025-10-01T14:06:30.258727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:30.258732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:30.258762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 38
2025-10-01T14:06:30.263764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254466077263804:2735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:30.263791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254466077263804:2735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:30.263795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254466077263804:2735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:30.263804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 39 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:30.266567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263841:2735], now have 1 active actors on pipe
2025-10-01T14:06:30.266628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 38
2025-10-01T14:06:30.266729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.266745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.266781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:30.266796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.266807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.266810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:30.266822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.266839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:30.266874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.267026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.267035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.267048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.267128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 39 partition: 0 MaxSeqNo: 45 sessionId: src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0
2025-10-01T14:06:30.267538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e56f8d7a-e014db68-4384989a-3f702d56_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:30.270731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0] Write session: try to update token
2025-10-01T14:06:30.270750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:30.270350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:30.270386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:30.270399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254463700404830:2619]
2025-10-01T14:06:30.270453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:30.270580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:30.270687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:30.270872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.271046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.271233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.271453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:30.271494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:30.287447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 39 sessionId: src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:30.290251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:30.290545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.290575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.290614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:30.290698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:30.292818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:30.292838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:30.292840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:30.292842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:30.292863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254463700404830:2619]
2025-10-01T14:06:30.292867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254463700404830:2619]
2025-10-01T14:06:30.292874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254463700404830:2619]
2025-10-01T14:06:30.292919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:30.292923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:30.292931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.292934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:30.292936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:30.292944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:30.293075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:30.346282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254466077263854:2506]
2025-10-01T14:06:30.346755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 38, pipe: [1:7556254466077263854:2506]
2025-10-01T14:06:30.444472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:30.453321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.453353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.453521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.453584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.453648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.453704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.453753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.453762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.453822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.453878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.453933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.453995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.454040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.454048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.454106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.454160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.454215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.454285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.454332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.454339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.454414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.454479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.454536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.454592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.454639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.454646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.454703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.454761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.454817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.454876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.454925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.454932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.455005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.455076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.455160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.455243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.455296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.455303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.455370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.455427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.455493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.455557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.455893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.455903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.455967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.456027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.456087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.456150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.456197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.456200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.456266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.456327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.456391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.456449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.456492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.456499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.456562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.456622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.456683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.456746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.456790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.456797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.456872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263854:2506], now have 1 active actors on pipe
2025-10-01T14:06:30.457098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:30.457115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254466077263854:2506]
2025-10-01T14:06:30.457141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:30.457144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:30.457170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 39 reason: error at write: Disconnected sessionId: src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0
2025-10-01T14:06:30.457316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 39 sessionId: src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0 is DEAD
2025-10-01T14:06:30.457480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:30.457491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0] Write session will restart in 0.008894s
2025-10-01T14:06:30.457523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0] Write session: Do CDS request
2025-10-01T14:06:30.457527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:30.457622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:30.465655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:30.466204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:30.466426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:30.466436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:30.466448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:30.466493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:30.466531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254463700404966:2634]
2025-10-01T14:06:30.467012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:30.467237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:30.467281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:30.467570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:30.467631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.467639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.467640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.467641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.467642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.467643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.467645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.467646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.467647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.467648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.467649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.467651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.467652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.467653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.467658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.467669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.467674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.467678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.467682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.467686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.467690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.467694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.467697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.467701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.467705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.467709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.467713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.467717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.467724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.467733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.467738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.467744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.467749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.467754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.467764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.467770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.467775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.467780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.467785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.467791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.467796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.467801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.467806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.467811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.467817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.467822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.467827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.467832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.467837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.467842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.467847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.467852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.467861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.467866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.467871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.467880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.467920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:30.468012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.468105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:30.468125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 40
2025-10-01T14:06:30.468392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.468424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 40 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:30.468429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=40 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:30.468433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:30.468881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 40 sessionId:  describe result for acl check
2025-10-01T14:06:30.468911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:30.468913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:30.468915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:30.468920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254466077263917:2740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:30.469440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254466077263917:2740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:30.471413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254466077263917:2740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:30.471982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:30.472639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:30.472652Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:30.472654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:30.472656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:30.472661Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 39 [2:7556254463700404966:2634]
2025-10-01T14:06:30.472673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:30.472685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:30.472687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.472690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.472691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.472703Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:30.472706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:30.472710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:30.472748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.472757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.472759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.472762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:30.472765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:30.472837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:30.472854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.472865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.472875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.472890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:30.472908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263857:2446], now have 1 active actors on pipe
2025-10-01T14:06:30.472919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254463700404961:2634]
2025-10-01T14:06:30.472920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254463700404961:2634]
2025-10-01T14:06:30.472922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254463700404961:2634]
2025-10-01T14:06:30.472931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:30.472941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:30.472944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:30.472947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:30.472949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:30.472953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:30.472955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:30.472977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254463700404961:2634]
2025-10-01T14:06:30.472987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:30.473008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:30.472996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 39
2025-10-01T14:06:30.477979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254466077263917:2740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:30.478005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254466077263917:2740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:30.478012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254466077263917:2740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:30.478020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 40 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:30.478262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263954:2740], now have 1 active actors on pipe
2025-10-01T14:06:30.478326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 39
2025-10-01T14:06:30.478491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.478502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.478525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:30.478537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.478541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.478543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:30.478552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.478565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:30.478583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.478761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.478769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.478781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.478859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 40 partition: 0 MaxSeqNo: 45 sessionId: src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0
2025-10-01T14:06:30.479241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f065348-c17a97b8-3de28eaa-e0d33f5f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:30.482368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0] Write session: try to update token
2025-10-01T14:06:30.482481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:30.483910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:30.483922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:30.483931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254463700404961:2634]
2025-10-01T14:06:30.483977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:30.483996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:30.484148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:30.484279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.484402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.484535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.484741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:30.484775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:30.498210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 40 sessionId: src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:30.501001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:30.501203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.501224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.501259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:30.501342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:30.503998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:30.504016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:30.504018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:30.504020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:30.504030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254463700404961:2634]
2025-10-01T14:06:30.504035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254463700404961:2634]
2025-10-01T14:06:30.504038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254463700404961:2634]
2025-10-01T14:06:30.504078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:30.504082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:30.504087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:30.504089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:30.504094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.504097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:30.504240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:30.559653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254466077263961:2506]
2025-10-01T14:06:30.560249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 39, pipe: [1:7556254466077263961:2506]
2025-10-01T14:06:30.665215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:30.676320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.676354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.676564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.676643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.676719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.676788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.676862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.676868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.676947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.677018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.677089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.677164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.677220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.677224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.677308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.677379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.677450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.677525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.677591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.677603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.677684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.677765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.677846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.677934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.677991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.677995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.678076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.678144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.678215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.678286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.678336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.678340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.678535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.678614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.678692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.678772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.678828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.678837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.678923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.679002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.679086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.679166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.679231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.679234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.679322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.679395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.679470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.679545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.679597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.679601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.679685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.679757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.679831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.679914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.679969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.679973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.680058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:30.680132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:30.680206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:30.680288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:30.680344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:30.680348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:30.680434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263961:2506], now have 1 active actors on pipe
2025-10-01T14:06:30.681073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:30.681090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:30.681136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 40 reason: error at write: Disconnected sessionId: src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0
2025-10-01T14:06:30.681373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 40 sessionId: src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0 is DEAD
2025-10-01T14:06:30.681544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254466077263961:2506]
2025-10-01T14:06:30.681559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:30.682665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:30.682674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0] Write session will restart in 0.006381s
2025-10-01T14:06:30.682704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0] Write session: Do CDS request
2025-10-01T14:06:30.682710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:30.686877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:30.694826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.698067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:30.698594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:30.698609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 41
2025-10-01T14:06:30.698802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.698829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 41 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:30.698835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=41 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:30.698839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:30.698624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:30.698821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:30.698824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:30.698833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:30.698886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:30.698914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254463700405077:2637]
2025-10-01T14:06:30.699348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:30.699250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 41 sessionId:  describe result for acl check
2025-10-01T14:06:30.699282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:30.699283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:30.699284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:30.699288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254466077264036:2746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:30.699791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254466077264036:2746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:30.699688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:30.699750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:30.700107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:30.700173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.700181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.700182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.700183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.700184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.700185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.700187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.700189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.700190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.700191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.700193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.700194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.700196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.700197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.700204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.700213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.700217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.700222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.700227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.700231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.700235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.700238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.700243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.700247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.700252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.700256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.700260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.700264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.700270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.700277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.700283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.700288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.700292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.700296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.700300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.700305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.700309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.700313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.700317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.700321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.700325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.700330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.700334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.700340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.700344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.700348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.700352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.700356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.700360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.700364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.700368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.700372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.700376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.700381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.700385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.700389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.700425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:30.701417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254466077264036:2746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:30.703886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254466077264036:2746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:30.703897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254466077264036:2746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:30.703899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254466077264036:2746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:30.703905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 41 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:30.704095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:30.704793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:30.704809Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:30.704812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:30.704815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:30.704822Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 40 [2:7556254463700405077:2637]
2025-10-01T14:06:30.704837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:30.704865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:30.704874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.704877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.704879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.704896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:30.704906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:30.704913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:30.704975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.704983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.704985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.704988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:30.704991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:30.705066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:30.705076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.705088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.705106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.705122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:30.705152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077264074:2746], now have 1 active actors on pipe
2025-10-01T14:06:30.705155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077263980:2446], now have 1 active actors on pipe
2025-10-01T14:06:30.705163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254463700405072:2637]
2025-10-01T14:06:30.705166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254463700405072:2637]
2025-10-01T14:06:30.705168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254463700405072:2637]
2025-10-01T14:06:30.705184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:30.705200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:30.705199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:30.705202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:30.705225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 40
2025-10-01T14:06:30.705204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:30.705224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:30.705227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:30.705262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254463700405072:2637]
2025-10-01T14:06:30.705269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:30.705264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 40
2025-10-01T14:06:30.705274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:30.705480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.705491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.705519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:30.705532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.705538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.705542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:30.705552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.705566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:30.705584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.705814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.705823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.705838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.705961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 41 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0
2025-10-01T14:06:30.706361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2bc932c-e9472df9-bb0b8194-41cdeb02_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:30.709241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0] Write session: try to update token
2025-10-01T14:06:30.709262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:30.724858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 41 sessionId: src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:30.728470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:30.730091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.730117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.730136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:30.730139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:30.730141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:30.730142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:30.730149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254463700405072:2637]
2025-10-01T14:06:30.730153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254463700405072:2637]
2025-10-01T14:06:30.730155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254463700405072:2637]
2025-10-01T14:06:30.730203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:30.730214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.730203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:30.730215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:30.730220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:30.730224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:30.730342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:30.781482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254466077264084:2506]
2025-10-01T14:06:30.781826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 40, pipe: [1:7556254466077264084:2506]
2025-10-01T14:06:30.872218Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:30.872463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:30.872520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077264084:2506], now have 1 active actors on pipe
2025-10-01T14:06:30.872617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:30.872739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254466077264084:2506]
2025-10-01T14:06:30.872766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:30.881286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:30.881657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:30.881789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:30.881799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:30.881810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:30.881849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:30.881880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254463700405172:2639]
2025-10-01T14:06:30.882257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:30.882512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:30.882540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:30.882751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:30.882791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.882794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.882795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.882796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.882796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.882797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.882798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.882799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.882799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.882800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.882800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.882801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.882802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.882802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.882805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.882811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.882813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.882815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.882817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.882819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.882821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.882823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.882825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.882828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.882829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.882831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.882834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.882835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.882840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.882844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:30.882848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.882850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:30.882854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.882857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:30.882859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.882862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:30.882864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.882867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:30.882869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.882872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:30.882874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.882877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:30.882879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.882881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:30.882884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.882887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:30.882889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.882891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.882894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.882896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.882899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.882902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.882904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.882907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:30.882909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.882911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:30.882932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:30.883521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:30.883534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:30.883557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 41 reason: error at write: Disconnected sessionId: src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0
2025-10-01T14:06:30.883691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 41 sessionId: src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0 is DEAD
2025-10-01T14:06:30.883860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:30.883871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0] Write session will restart in 0.007041s
2025-10-01T14:06:30.883900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0] Write session: Do CDS request
2025-10-01T14:06:30.883906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:30.888405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:30.889201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:30.889216Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:30.889219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:30.889223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:30.889231Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 41 [2:7556254463700405172:2639]
2025-10-01T14:06:30.889248Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:30.889267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:30.889279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.889287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.889290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.889308Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:30.889318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:30.889325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:30.889389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.889398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.889400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.889404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:30.889407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:30.889481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:30.889488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.889499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:30.889509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:30.889529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:30.889549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077264086:2446], now have 1 active actors on pipe
2025-10-01T14:06:30.889556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254463700405167:2639]
2025-10-01T14:06:30.889564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254463700405167:2639]
2025-10-01T14:06:30.889566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254463700405167:2639]
2025-10-01T14:06:30.889580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:30.889593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:30.889593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:30.889596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:30.889597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:30.889610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:30.889613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:30.889648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254463700405167:2639]
2025-10-01T14:06:30.889661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:30.889678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:30.891962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.889650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 41
2025-10-01T14:06:30.892092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:30.892099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 42
2025-10-01T14:06:30.892259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:30.892280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 42 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:30.892284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=42 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:30.892288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:30.892812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 42 sessionId:  describe result for acl check
2025-10-01T14:06:30.892857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:30.892859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:30.892861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:30.892868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254466077264152:2751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:30.893397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254466077264152:2751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:30.899867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254466077264152:2751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:30.916336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:30.916349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:30.916358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254463700405167:2639]
2025-10-01T14:06:30.916407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:30.916409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:30.916573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:30.916723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.916875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.917007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:30.917206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:30.917247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:30.917302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254466077264152:2751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:30.917319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254466077264152:2751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:30.917323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254466077264152:2751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:30.917332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 42 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:30.917593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077264188:2751], now have 1 active actors on pipe
2025-10-01T14:06:30.917663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 41
2025-10-01T14:06:30.917753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.917768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.917796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:30.917811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:30.917821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:30.917825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:30.917837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:30.917857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:30.917878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.918077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:30.918085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:30.918098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:30.918207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 42 partition: 0 MaxSeqNo: 45 sessionId: src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0
2025-10-01T14:06:30.918567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1ecaa99-66916317-31a12684-86ff5b5a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:30.921507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0] Write session: try to update token
2025-10-01T14:06:30.921526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:30.928814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:30.928835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:30.928839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:30.928840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:30.928864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254463700405167:2639]
2025-10-01T14:06:30.928868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254463700405167:2639]
2025-10-01T14:06:30.928872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254463700405167:2639]
2025-10-01T14:06:30.928918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:30.928924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:30.928931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:30.928930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:30.928933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:30.928935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:30.929062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:30.937922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 42 sessionId: src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:30.940825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:30.973019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254466077264190:2506]
2025-10-01T14:06:30.973322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 41, pipe: [1:7556254466077264190:2506]
2025-10-01T14:06:31.081020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:31.081231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.081243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.081260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254466077264190:2506], now have 1 active actors on pipe
2025-10-01T14:06:31.081420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:31.081508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:31.081520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254466077264190:2506]
2025-10-01T14:06:31.081538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:31.081620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 42 reason: status is not ok: tablet will be restarted right now sessionId: src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0
2025-10-01T14:06:31.081807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 42 sessionId: src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0 is DEAD
2025-10-01T14:06:31.081954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:31.081964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0] Write session will restart in 0.007578s
2025-10-01T14:06:31.081984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0] Write session: Do CDS request
2025-10-01T14:06:31.082000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:31.090484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:31.090826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.090914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:31.090931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 43
2025-10-01T14:06:31.091011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:31.091030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.091056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 43 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:31.091064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=43 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:31.091068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:31.091202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:31.091211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:31.091222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:31.091268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:31.091309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254467995372566:2641]
2025-10-01T14:06:31.091471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 43 sessionId:  describe result for acl check
2025-10-01T14:06:31.091503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:31.091504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:31.091505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:31.091509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254470372231552:2756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:31.091913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:31.091955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254470372231552:2756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:31.092261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:31.092303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:31.092604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:31.092654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.092659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.092660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.092661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.092662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.092663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.092664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.092666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.092667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.092668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.092669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.092670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.092671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.092672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.092677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.092686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.092690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.092694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.092697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.092701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.092705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.092708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.092712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.092715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.092719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.092722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.092725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.092728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.092735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.092742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.092748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.092753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.092757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.092762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.092765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.092770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.092775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.092780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.092784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.092788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.092793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.092797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.092801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.092805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.092811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.092815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.092818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.092823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.092832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.092837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.092841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.092854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.092862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.092867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.092871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.092877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.092919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:31.094093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254470372231552:2756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:31.096502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254470372231552:2756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:31.096528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254470372231552:2756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:31.096532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254470372231552:2756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:31.096540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 43 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:31.096657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:31.097522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:31.097543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:31.097546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:31.097550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:31.097557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 42 [2:7556254467995372566:2641]
2025-10-01T14:06:31.097573Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:31.097593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:31.097601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.097605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.097607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.097621Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:31.097631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:31.097638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:31.097708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.097717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.097719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.097722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:31.097725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:31.097806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:31.097813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.097823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.097833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.097853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:31.097878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231591:2756], now have 1 active actors on pipe
2025-10-01T14:06:31.097887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231493:2446], now have 1 active actors on pipe
2025-10-01T14:06:31.097895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254467995372561:2641]
2025-10-01T14:06:31.097898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254467995372561:2641]
2025-10-01T14:06:31.097900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254467995372561:2641]
2025-10-01T14:06:31.097918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:31.097939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:31.097937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:31.097940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:31.097942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:31.097930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 42
2025-10-01T14:06:31.097936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 42
2025-10-01T14:06:31.097959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:31.097967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:31.098005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254467995372561:2641]
2025-10-01T14:06:31.098018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:31.098023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:31.098039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.098045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.098095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:31.098107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.098117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.098119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:31.098128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.098143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:31.098168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.098352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.098363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.098392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.098496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 43 partition: 0 MaxSeqNo: 45 sessionId: src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0
2025-10-01T14:06:31.098798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|830b991b-d30cfbd1-c078487e-d5a39e89_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:31.101365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0] Write session: try to update token
2025-10-01T14:06:31.101376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:31.118317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:31.118336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:31.118338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:31.118340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:31.118351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254467995372561:2641]
2025-10-01T14:06:31.118355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254467995372561:2641]
2025-10-01T14:06:31.118359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254467995372561:2641]
2025-10-01T14:06:31.118417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:31.118424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:31.118426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:31.118428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:31.118434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.118436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:31.118572Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:31.119777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 43 sessionId: src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:31.122681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:31.181816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254470372231601:2506]
2025-10-01T14:06:31.182173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 42, pipe: [1:7556254470372231601:2506]
2025-10-01T14:06:31.263513Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:31.263733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.263744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.263779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231601:2506], now have 1 active actors on pipe
2025-10-01T14:06:31.263964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:31.264035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:31.264047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:31.264081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254470372231601:2506]
2025-10-01T14:06:31.264107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 43 reason: error at write: Disconnected sessionId: src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0
2025-10-01T14:06:31.264116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:31.264260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 43 sessionId: src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0 is DEAD
2025-10-01T14:06:31.264421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:31.264432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0] Write session will restart in 0.008520s
2025-10-01T14:06:31.264463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0] Write session: Do CDS request
2025-10-01T14:06:31.264470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:31.273916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.273869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:31.273974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:31.273990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 44
2025-10-01T14:06:31.274175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.274219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 44 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:31.274228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=44 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:31.274232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:31.274594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:31.274662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 44 sessionId:  describe result for acl check
2025-10-01T14:06:31.274699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:31.274701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:31.274704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:31.274710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254470372231663:2760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:31.274762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:31.274771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:31.274779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:31.274816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:31.274848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254467995372666:2644]
2025-10-01T14:06:31.275286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254470372231663:2760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:31.275359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:31.275656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:31.275697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:31.276008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:31.276063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.276068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.276069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.276071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.276072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.276073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.276074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.276076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.276077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.276078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.276079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.276081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.276082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.276084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.276089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.276099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.276103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.276108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.276112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.276116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.276121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.276125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.276130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.276134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.276138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.276142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.276146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.276150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.276157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.276169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.276178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.276184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.276191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.276196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.276200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.276204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.276209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.276213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.276218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.276223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.276228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.276234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.276239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.276244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.276249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.276254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.276263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.276268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.276276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.276282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.276289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.276295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.276303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.276307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.276315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.276321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.276365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:31.277250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254470372231663:2760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:31.280044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:31.280132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254470372231663:2760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:31.280144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254470372231663:2760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:31.280148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254470372231663:2760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:31.280159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 44 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:31.280684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:31.280693Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:31.280695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:31.280699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:31.280705Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 43 [2:7556254467995372666:2644]
2025-10-01T14:06:31.280720Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:31.280736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:31.280745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.280748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.280754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.280767Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:31.280775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:31.280782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:31.280857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.280862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.280865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.280868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:31.280871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:31.280936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:31.280943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.280955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.280970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.280990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:31.281011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231703:2760], now have 1 active actors on pipe
2025-10-01T14:06:31.281018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231604:2446], now have 1 active actors on pipe
2025-10-01T14:06:31.281024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254467995372661:2644]
2025-10-01T14:06:31.281028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254467995372661:2644]
2025-10-01T14:06:31.281030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254467995372661:2644]
2025-10-01T14:06:31.281041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:31.281056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:31.281057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:31.281064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:31.281067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:31.281071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:31.281075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:31.281100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254467995372661:2644]
2025-10-01T14:06:31.281093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 43
2025-10-01T14:06:31.281111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:31.281113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:31.281123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 43
2025-10-01T14:06:31.281143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.281150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.281179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:31.281188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.281191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.281196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:31.281204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.281216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:31.281231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.281381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.281388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.281400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.281471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 44 partition: 0 MaxSeqNo: 45 sessionId: src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0
2025-10-01T14:06:31.281809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533bd161-d6e9febb-ac82fb6e-6dbbf7f9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:31.284541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0] Write session: try to update token
2025-10-01T14:06:31.284558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:31.300863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 44 sessionId: src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:31.302991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:31.303006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:31.303009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:31.303011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:31.303019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254467995372661:2644]
2025-10-01T14:06:31.303024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254467995372661:2644]
2025-10-01T14:06:31.303028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254467995372661:2644]
2025-10-01T14:06:31.303069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:31.303076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:31.303079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:31.303083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.303085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:31.303085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:31.303230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:31.303257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:31.364140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254470372231731:2506]
2025-10-01T14:06:31.364422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 43, pipe: [1:7556254470372231731:2506]
2025-10-01T14:06:31.442150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:31.442468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.442484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.442527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231731:2506], now have 1 active actors on pipe
2025-10-01T14:06:31.442891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254470372231731:2506]
2025-10-01T14:06:31.442931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:31.442934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:31.442963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:31.442995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 44 reason: error at write: Disconnected sessionId: src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0
2025-10-01T14:06:31.443193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:31.443204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 44 sessionId: src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0 is DEAD
2025-10-01T14:06:31.443373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:31.443381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0] Write session will restart in 0.009198s
2025-10-01T14:06:31.443410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0] Write session: Do CDS request
2025-10-01T14:06:31.443417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:31.451821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:31.452373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:31.452563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:31.452573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:31.452584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:31.452630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:31.452659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254467995372802:2658]
2025-10-01T14:06:31.453138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:31.453394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:31.453425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:31.453668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:31.453714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.453719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.453720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.453721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.453722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.453722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.453723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.453723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.453724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.453725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.453725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.453726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.453727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.453727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.453730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.453737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.453739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.453741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.453743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.453746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.453748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.453751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.453755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.453758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.453762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.453764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.453767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.453771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.453777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.453784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.453790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.453795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.453799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.453804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.453808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.453814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.453818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.453823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.453827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.453832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.453835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.453838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.453841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.453844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.453847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.453850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.453852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.453856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.453859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.453862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.453864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.453867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.453869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.453873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.453875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.453878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.453916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.453900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:31.454017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:31.454032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 45
2025-10-01T14:06:31.454198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.454228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 45 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:31.454239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=45 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:31.454243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:31.454632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 45 sessionId:  describe result for acl check
2025-10-01T14:06:31.454666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:31.454672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:31.454673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:31.454678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254470372231798:2771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:31.455146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254470372231798:2771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:31.457502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:31.457873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254470372231798:2771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:31.458158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:31.458168Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:31.458170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:31.458174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:31.458180Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 44 [2:7556254467995372802:2658]
2025-10-01T14:06:31.458194Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:31.458213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:31.458220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.458222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.458224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.458237Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:31.458251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:31.458258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:31.458310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.458316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.458318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.458321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:31.458324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:31.458417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:31.458426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.458437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.458446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.458460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:31.458477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231733:2446], now have 1 active actors on pipe
2025-10-01T14:06:31.458489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254467995372797:2658]
2025-10-01T14:06:31.458494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254467995372797:2658]
2025-10-01T14:06:31.458496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254467995372797:2658]
2025-10-01T14:06:31.458486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 44
2025-10-01T14:06:31.458511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:31.458522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:31.458528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:31.458531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:31.458533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:31.458540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:31.458542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:31.458565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254467995372797:2658]
2025-10-01T14:06:31.458575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:31.458582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:31.463089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254470372231798:2771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:31.463101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254470372231798:2771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:31.463104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254470372231798:2771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:31.463111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 45 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:31.463355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 44
2025-10-01T14:06:31.463322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231837:2771], now have 1 active actors on pipe
2025-10-01T14:06:31.463428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.463444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.463471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b82865-d13cc8c0-156af941-b408ed7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:31.463485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.463490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.463497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:31.463509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.463525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:31.463546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.463682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.463692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.463707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.463781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 45 partition: 0 MaxSeqNo: 45 sessionId: src_id|10b82865-d13cc8c0-156af941-b408ed7e_0
2025-10-01T14:06:31.464101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5c71a8a-95ee46a9-7276ce7d-b003c47f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|10b82865-d13cc8c0-156af941-b408ed7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:31.466939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b82865-d13cc8c0-156af941-b408ed7e_0] Write session: try to update token
2025-10-01T14:06:31.466959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b82865-d13cc8c0-156af941-b408ed7e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:31.468571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:31.468586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:31.468593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254467995372797:2658]
2025-10-01T14:06:31.468624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:31.468627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:31.468778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:31.468924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:31.469067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:31.469201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:31.469400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:31.469432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:31.483905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 45 sessionId: src_id|10b82865-d13cc8c0-156af941-b408ed7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:31.486514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:31.487683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.487709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.487728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:31.487731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:31.487732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:31.487734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:31.487742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254467995372797:2658]
2025-10-01T14:06:31.487745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254467995372797:2658]
2025-10-01T14:06:31.487750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254467995372797:2658]
2025-10-01T14:06:31.487787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:31.487797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:31.487797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:31.487799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:31.487802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.487804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:31.487931Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:31.542860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254470372231842:2506]
2025-10-01T14:06:31.543161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 44, pipe: [1:7556254470372231842:2506]
2025-10-01T14:06:31.634502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:31.634808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:31.634850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231842:2506], now have 1 active actors on pipe
2025-10-01T14:06:31.634939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:31.634990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:31.635033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:31.635040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:31.635040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254470372231842:2506]
2025-10-01T14:06:31.635108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 45 reason: error at write: Disconnected sessionId: src_id|10b82865-d13cc8c0-156af941-b408ed7e_0
2025-10-01T14:06:31.635259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 45 sessionId: src_id|10b82865-d13cc8c0-156af941-b408ed7e_0 is DEAD
2025-10-01T14:06:31.635447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b82865-d13cc8c0-156af941-b408ed7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:31.635462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b82865-d13cc8c0-156af941-b408ed7e_0] Write session will restart in 0.005439s
2025-10-01T14:06:31.635491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b82865-d13cc8c0-156af941-b408ed7e_0] Write session: Do CDS request
2025-10-01T14:06:31.635500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b82865-d13cc8c0-156af941-b408ed7e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:31.641882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b82865-d13cc8c0-156af941-b408ed7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.642024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:31.642038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 46
2025-10-01T14:06:31.642207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.642262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 46 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:31.642274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=46 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:31.642278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:31.642730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 46 sessionId:  describe result for acl check
2025-10-01T14:06:31.642759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:31.642761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:31.642762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:31.642767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254470372231877:2776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:31.643212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254470372231877:2776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:31.644533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:31.645068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:31.645101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254470372231877:2776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:31.645231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:31.645240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:31.645252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:31.645296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:31.645339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254467995372905:2661]
2025-10-01T14:06:31.645985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:31.646220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:31.646257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:31.646563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:31.646623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.646624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.646625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.646626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.646627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.646628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.646629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.646631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.646632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.646634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.646635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.646636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.646638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.646639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.646644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.646654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.646658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.646662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.646666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.646670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.646674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.646677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.646682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.646686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.646690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.646693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.646697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.646701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.646707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.646715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.646721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.646726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.646730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.646737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.646741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.646746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.646751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.646756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.646760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.646765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.646769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.646774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.646778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.646783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.646788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.646793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.646797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.646802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.646807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.646812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.646816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.646820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.646824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.646830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.646834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.646840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.646881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:31.650527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254470372231877:2776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:31.650543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254470372231877:2776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:31.650547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254470372231877:2776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:31.650557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 46 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:31.654043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:31.654763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:31.654779Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:31.654783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:31.654787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:31.654795Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 45 [2:7556254467995372905:2661]
2025-10-01T14:06:31.654814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:31.654844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:31.654847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.654851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.654854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.654873Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:31.654883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:31.654889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:31.654963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.654970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.654973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.654976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:31.654979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:31.655064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:31.655078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.655092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.655104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.655122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:31.655149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254467995372900:2661]
2025-10-01T14:06:31.655152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254467995372900:2661]
2025-10-01T14:06:31.655154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254467995372900:2661]
2025-10-01T14:06:31.655169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:31.655184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:31.655200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:31.655207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:31.655246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254467995372900:2661]
2025-10-01T14:06:31.655248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:31.655339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:31.655345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:31.655347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:31.655353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:31.655555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231845:2446], now have 1 active actors on pipe
2025-10-01T14:06:31.655569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231945:2776], now have 1 active actors on pipe
2025-10-01T14:06:31.655665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 45
2025-10-01T14:06:31.655709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 45
2025-10-01T14:06:31.655845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.655859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.655889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8351556-1e4783d-f983bc4c-d32833e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:31.655902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.655910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.655912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:31.655923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.655933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:31.655954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.656124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.656130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.656143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.656235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 46 partition: 0 MaxSeqNo: 45 sessionId: src_id|c8351556-1e4783d-f983bc4c-d32833e1_0
2025-10-01T14:06:31.656638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b82865-d13cc8c0-156af941-b408ed7e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c8351556-1e4783d-f983bc4c-d32833e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:31.659663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8351556-1e4783d-f983bc4c-d32833e1_0] Write session: try to update token
2025-10-01T14:06:31.659682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8351556-1e4783d-f983bc4c-d32833e1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:31.678710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:31.678733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:31.678736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:31.678738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:31.678748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254467995372900:2661]
2025-10-01T14:06:31.678753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254467995372900:2661]
2025-10-01T14:06:31.678757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254467995372900:2661]
2025-10-01T14:06:31.678810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:31.678816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.678819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:31.678988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:31.682463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:31.682483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:31.682488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:31.681465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 46 sessionId: src_id|c8351556-1e4783d-f983bc4c-d32833e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:31.684281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:31.735359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254470372231964:2506]
2025-10-01T14:06:31.735602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 45, pipe: [1:7556254470372231964:2506]
2025-10-01T14:06:31.822864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:31.823196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.823207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.823248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231964:2506], now have 1 active actors on pipe
2025-10-01T14:06:31.823748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:31.823817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254470372231964:2506]
2025-10-01T14:06:31.823851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:31.823854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:31.823942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 46 reason: error at write: Disconnected sessionId: src_id|c8351556-1e4783d-f983bc4c-d32833e1_0
2025-10-01T14:06:31.824265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8351556-1e4783d-f983bc4c-d32833e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:31.824284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8351556-1e4783d-f983bc4c-d32833e1_0] Write session will restart in 0.008820s
2025-10-01T14:06:31.824311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8351556-1e4783d-f983bc4c-d32833e1_0] Write session: Do CDS request
2025-10-01T14:06:31.824318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8351556-1e4783d-f983bc4c-d32833e1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:31.824151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 46 sessionId: src_id|c8351556-1e4783d-f983bc4c-d32833e1_0 is DEAD
2025-10-01T14:06:31.824253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:31.833976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8351556-1e4783d-f983bc4c-d32833e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.834119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:31.834133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 47
2025-10-01T14:06:31.835963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:31.836002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 47 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:31.836009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=47 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:31.836013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:31.836434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 47 sessionId:  describe result for acl check
2025-10-01T14:06:31.836472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:31.836473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:31.836475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:31.836481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254470372231992:2781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:31.837127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254470372231992:2781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:31.839912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254470372231992:2781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:31.843059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:31.843109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254470372231992:2781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:31.843124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254470372231992:2781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:31.843127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254470372231992:2781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:31.843137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 47 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:31.844520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:31.844697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:31.844700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:31.844710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:31.844756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:31.844798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254467995373020:2664]
2025-10-01T14:06:31.845393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:31.845802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:31.845844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:31.846155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:31.846212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.846213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.846214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.846214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.846215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.846216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.846217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.846218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.846219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.846220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.846221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.846223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.846224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.846225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.846230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.846239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.846243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.846246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.846250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.846254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.846257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.846260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.846263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.846268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.846271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.846274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.846277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.846280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.846288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.846295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:31.846301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.846306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:31.846310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.846315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:31.846319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.846323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:31.846327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.846332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:31.846337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.846341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:31.846347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.846352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:31.846356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.846361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:31.846365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.846390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:31.846395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.846400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.846404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.846409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.846413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.846417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.846422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.846426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:31.846430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.846433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:31.846471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:31.852097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:31.852932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:31.852955Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:31.852958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:31.852962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:31.852984Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 46 [2:7556254467995373020:2664]
2025-10-01T14:06:31.853005Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:31.853025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:31.853029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.853033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.853035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.853066Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:31.853072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:31.853078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:31.853163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.853172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.853175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.853178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:31.853181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:31.853255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:31.853258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.853274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:31.853285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:31.853301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:31.853317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254467995373013:2664]
2025-10-01T14:06:31.853320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254467995373013:2664]
2025-10-01T14:06:31.853323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254467995373013:2664]
2025-10-01T14:06:31.853341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:31.853355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:31.853370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:31.853373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:31.853414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254467995373013:2664]
2025-10-01T14:06:31.853424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:31.853603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:31.853614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:31.853616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:31.853621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:31.853933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372232063:2781], now have 1 active actors on pipe
2025-10-01T14:06:31.853944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372231968:2446], now have 1 active actors on pipe
2025-10-01T14:06:31.854153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 46
2025-10-01T14:06:31.854182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 46
2025-10-01T14:06:31.854343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.854356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.854422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:31.854439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:31.854445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:31.854448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:31.854459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:31.854473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:31.854496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.854870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:31.854882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:31.854902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:31.855044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 47 partition: 0 MaxSeqNo: 45 sessionId: src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0
2025-10-01T14:06:31.855459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8351556-1e4783d-f983bc4c-d32833e1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:31.858555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0] Write session: try to update token
2025-10-01T14:06:31.858577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:31.882223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:31.882243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:31.882247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:31.882249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:31.882259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254467995373013:2664]
2025-10-01T14:06:31.882263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254467995373013:2664]
2025-10-01T14:06:31.882268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254467995373013:2664]
2025-10-01T14:06:31.882325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:31.882338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:31.882341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:31.882341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:31.882350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:31.882355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:31.882571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:31.899102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 47 sessionId: src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:31.901997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:31.923799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254470372232076:2506]
2025-10-01T14:06:31.927020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 46, pipe: [1:7556254470372232076:2506]
2025-10-01T14:06:32.044535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:32.044908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.044925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.044948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254470372232076:2506], now have 1 active actors on pipe
2025-10-01T14:06:32.045175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:32.045294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254470372232076:2506]
2025-10-01T14:06:32.045322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:32.045324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:32.045384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 47 reason: error at write: Disconnected sessionId: src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0
2025-10-01T14:06:32.045434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:32.045565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 47 sessionId: src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0 is DEAD
2025-10-01T14:06:32.045690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:32.045699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0] Write session will restart in 0.005511s
2025-10-01T14:06:32.045727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0] Write session: Do CDS request
2025-10-01T14:06:32.045733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:32.052906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.052990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:32.053008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 48
2025-10-01T14:06:32.053176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.053220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 48 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:32.053225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=48 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:32.053229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:32.053686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 48 sessionId:  describe result for acl check
2025-10-01T14:06:32.053717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:32.053719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:32.053720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:32.053724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254474667199385:2787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:32.054234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254474667199385:2787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:32.056445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254474667199385:2787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:32.059552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254474667199385:2787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:32.059574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254474667199385:2787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:32.059577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254474667199385:2787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:32.059666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 48 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:32.062141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:32.062931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:32.063099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:32.063103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:32.063115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:32.063161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:32.063280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254472290340418:2666]
2025-10-01T14:06:32.063927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:32.064219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:32.064266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:32.064609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:32.064663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.064665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.064666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.064667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.064669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.064670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.064671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.064672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.064673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.064675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.064676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.064677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.064678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.064679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.064684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.064694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.064698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.064702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.064706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.064710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.064713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.064716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.064720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.064724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.064727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.064731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.064736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.064739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.064746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.064754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.064760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.064765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.064770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.064775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.064780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.064785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.064790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.064796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.064800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.064804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.064812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.064817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.064822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.064828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.064834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.064839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.064857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.064863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.064868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.064874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.064879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.064884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.064891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.064896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.064901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.064906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.064951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:32.069510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:32.070529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 47
2025-10-01T14:06:32.070581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 47
2025-10-01T14:06:32.070121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:32.070137Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:32.070140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:32.070144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:32.070151Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 47 [2:7556254472290340418:2666]
2025-10-01T14:06:32.070167Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:32.070185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:32.070188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.070192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.070194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.070209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:32.070215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:32.070221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:32.070278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.070281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.070283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.070286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:32.070290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:32.070359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:32.070363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.070399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.070410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.070425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:32.070443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199436:2787], now have 1 active actors on pipe
2025-10-01T14:06:32.070447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199378:2446], now have 1 active actors on pipe
2025-10-01T14:06:32.070454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254472290340413:2666]
2025-10-01T14:06:32.070456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254472290340413:2666]
2025-10-01T14:06:32.070458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254472290340413:2666]
2025-10-01T14:06:32.070471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:32.070486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:32.070488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:32.070491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:32.070493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:32.070501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:32.070504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:32.070533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254472290340413:2666]
2025-10-01T14:06:32.070541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:32.070551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:32.070764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.070775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.070798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:32.070806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.070810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.070813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:32.070822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.070837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:32.070855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.071143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.071153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.071166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.071522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 48 partition: 0 MaxSeqNo: 45 sessionId: src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0
2025-10-01T14:06:32.071907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d703a2c6-cdb4c6b6-ce0e8b39-e18a12c2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:32.074782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0] Write session: try to update token
2025-10-01T14:06:32.074804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:32.082521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:32.082537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:32.082548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254472290340413:2666]
2025-10-01T14:06:32.082592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:32.082596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:32.082772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:32.082918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:32.083058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:32.083197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:32.083410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:32.083452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:32.090138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 48 sessionId: src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:32.094311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:32.094515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.094536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.094572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:32.095326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:32.108979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:32.108995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:32.108997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:32.108999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:32.109006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254472290340413:2666]
2025-10-01T14:06:32.109010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254472290340413:2666]
2025-10-01T14:06:32.109013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254472290340413:2666]
2025-10-01T14:06:32.109058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:32.109062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.109064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:32.109072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:32.109079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:32.109083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:32.109192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:32.145476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254474667199497:2506]
2025-10-01T14:06:32.145730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 47, pipe: [1:7556254474667199497:2506]
2025-10-01T14:06:32.254206Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:32.263731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.263765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.263960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.264040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.264119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.264197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.264256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.264265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.264356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.264431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.264507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.264586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.264653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.264662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.264739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.264801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.264878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.264948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.264998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.265005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.265083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.265149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.265212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.265280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.265329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.265336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.265410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.265480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.265550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.265614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.265655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.265662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.265723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.265778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.265841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.265899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.265954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.265965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.266038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.266109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.266189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.266262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.266318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.266325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.266420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.266496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.266563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.266636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.266688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.266691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.266780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.266848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.266919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.266997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.267048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.267066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.267149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.267230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.267312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.267389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.267457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.267466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.267537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199497:2506], now have 1 active actors on pipe
2025-10-01T14:06:32.267846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:32.267906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:32.267911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254474667199497:2506]
2025-10-01T14:06:32.267913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:32.267954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 48 reason: error at write: Disconnected sessionId: src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0
2025-10-01T14:06:32.268159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 48 sessionId: src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0 is DEAD
2025-10-01T14:06:32.268312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:32.268324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0] Write session will restart in 0.007605s
2025-10-01T14:06:32.268350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0] Write session: Do CDS request
2025-10-01T14:06:32.268357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:32.268516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:32.276985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.277028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:32.277046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 49
2025-10-01T14:06:32.277313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.277355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 49 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:32.277365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=49 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:32.277369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:32.277381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:32.277779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 49 sessionId:  describe result for acl check
2025-10-01T14:06:32.277816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:32.277823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:32.277824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:32.277829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254474667199567:2792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:32.278222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:32.278366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254474667199567:2792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:32.278403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:32.278414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:32.278424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:32.278483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:32.278533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254472290340522:2669]
2025-10-01T14:06:32.279096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:32.279581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:32.279634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:32.279964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:32.280029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.280030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.280031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.280032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.280033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.280034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.280035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.280036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.280037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.280038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.280040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.280041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.280042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.280043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.280048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.280058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.280062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.280065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.280069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.280073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.280078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.280081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.280085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.280090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.280093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.280096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.280099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.280102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.280109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.280115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.280121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.280126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.280130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.280134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.280138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.280143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.280146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.280151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.280154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.280158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.280162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.280167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.280170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.280175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.280181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.280446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254474667199567:2792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:32.280186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.280190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.280195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.280200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.280205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.280211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.280218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.280223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.280229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.280232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.280236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.280293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:32.284081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254474667199567:2792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:32.284100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254474667199567:2792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:32.284104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254474667199567:2792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:32.284117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 49 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:32.284251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:32.284884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:32.284897Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:32.284900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:32.284905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:32.284912Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 48 [2:7556254472290340522:2669]
2025-10-01T14:06:32.284934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:32.284955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:32.284959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.284962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.284965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.284979Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:32.284985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:32.284998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:32.285055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.285065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.285067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.285072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:32.285074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:32.285144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:32.285153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.285165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.285175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.285188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:32.285210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199606:2792], now have 1 active actors on pipe
2025-10-01T14:06:32.285217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199503:2446], now have 1 active actors on pipe
2025-10-01T14:06:32.285224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254472290340517:2669]
2025-10-01T14:06:32.285226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254472290340517:2669]
2025-10-01T14:06:32.285228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254472290340517:2669]
2025-10-01T14:06:32.285239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:32.285253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:32.285259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:32.285259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:32.285261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:32.285271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:32.285278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:32.285285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 48
2025-10-01T14:06:32.285288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 48
2025-10-01T14:06:32.285314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254472290340517:2669]
2025-10-01T14:06:32.285323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:32.285325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:32.285338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.285343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.285389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:32.285399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.285403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.285405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:32.285414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.285424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:32.285439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.285625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.285634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.285649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.285752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 49 partition: 0 MaxSeqNo: 45 sessionId: src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0
2025-10-01T14:06:32.286089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16bf37f6-ac47d0e0-cad0c790-703e37b7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:32.288690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0] Write session: try to update token
2025-10-01T14:06:32.288710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:32.296141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:32.296160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:32.296172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254472290340517:2669]
2025-10-01T14:06:32.296216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:32.296237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:32.296388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:32.296533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:32.296666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:32.296799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:32.297033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:32.297075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:32.303765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 49 sessionId: src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:32.306258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:32.306484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.306501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.306530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:32.306608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:32.315520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:32.315536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:32.315539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:32.315541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:32.315551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254472290340517:2669]
2025-10-01T14:06:32.315555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254472290340517:2669]
2025-10-01T14:06:32.315563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254472290340517:2669]
2025-10-01T14:06:32.315611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:32.315612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:32.315619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.315621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:32.315623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:32.315627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:32.315775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:32.368164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254474667199626:2506]
2025-10-01T14:06:32.368490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 48, pipe: [1:7556254474667199626:2506]
2025-10-01T14:06:32.467774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:32.475498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.475528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.475700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.475755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.475822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.475881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.475928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.475937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.476011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.476066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.476127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.476202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.476262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.476272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.476328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.476382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.476445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.476502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.476548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.476557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.476615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.476677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.476730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.476792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.476859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.476868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.476930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.477011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.477073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.477135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.477200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.477209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.477285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.477350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.477430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.477494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.477554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.477562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.477620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.477678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.477735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.477810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.477910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.477917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.477980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.478038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.478103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.478169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.478215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.478221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.478288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.478349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.478428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.478491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.478537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.478543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.478609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:32.478674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:32.478738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:32.478805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:32.478850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:32.478856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:32.478926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199626:2506], now have 1 active actors on pipe
2025-10-01T14:06:32.479217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:32.479229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:32.479235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254474667199626:2506]
2025-10-01T14:06:32.479256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:32.479258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 49 reason: error at write: Disconnected sessionId: src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0
2025-10-01T14:06:32.479617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:32.479637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0] Write session will restart in 0.007017s
2025-10-01T14:06:32.479664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0] Write session: Do CDS request
2025-10-01T14:06:32.479670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:32.479485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 49 sessionId: src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0 is DEAD
2025-10-01T14:06:32.479958Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:32.487889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.488010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:32.488028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 50
2025-10-01T14:06:32.488168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.488204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 50 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:32.488214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=50 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:32.488217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:32.488615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 50 sessionId:  describe result for acl check
2025-10-01T14:06:32.488646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:32.488652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:32.488654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:32.488659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254474667199702:2803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:32.489201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254474667199702:2803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:32.490166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:32.490974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:32.491155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:32.491162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:32.491169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:32.491202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:32.491235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254472290340664:2684]
2025-10-01T14:06:32.491681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:32.491717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254474667199702:2803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:32.491957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:32.491984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:32.492204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:32.492262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.492269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.492270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.492271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.492272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.492273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.492274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.492276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.492277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.492278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.492279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.492280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.492281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.492282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.492287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.492295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.492298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.492301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.492304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.492307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.492310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.492314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.492317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.492320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.492324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.492328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.492330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.492334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.492340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.492347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.492352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.492357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.492362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.492366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.492370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.492377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.492381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.492386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.492390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.492395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.492401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.492406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.492410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.492415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.492421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.492432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.492436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.492441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.492449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.492454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.492461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.492466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.492471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.492475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.492482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.492486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.492521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:32.500183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254474667199702:2803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:32.500199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254474667199702:2803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:32.500202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254474667199702:2803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:32.500210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 50 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:32.501036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 49
2025-10-01T14:06:32.501074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 49
2025-10-01T14:06:32.500013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:32.500650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:32.500655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:32.500658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:32.500664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:32.500671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 49 [2:7556254472290340664:2684]
2025-10-01T14:06:32.500687Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:32.500706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:32.500709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.500712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.500715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.500731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:32.500737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:32.500744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:32.500808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.500810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.500812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.500815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:32.500818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:32.500899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:32.500902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.500916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.500926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.500941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:32.500960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199640:2446], now have 1 active actors on pipe
2025-10-01T14:06:32.500967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254472290340659:2684]
2025-10-01T14:06:32.500969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254472290340659:2684]
2025-10-01T14:06:32.500971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254472290340659:2684]
2025-10-01T14:06:32.500981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:32.500993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:32.500994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:32.500996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:32.500998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:32.501007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:32.501011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:32.501016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199743:2803], now have 1 active actors on pipe
2025-10-01T14:06:32.501049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254472290340659:2684]
2025-10-01T14:06:32.501052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:32.501062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:32.501205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.501214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.501242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:32.501250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.501254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.501256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:32.501266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.501278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:32.501298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.501914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 50 partition: 0 MaxSeqNo: 45 sessionId: src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0
2025-10-01T14:06:32.502334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b246f6da-ff3c6cf7-137f9efb-f81ccc9e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:32.501753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.501764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.501788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.505250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0] Write session: try to update token
2025-10-01T14:06:32.505273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:32.525784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 50 sessionId: src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:32.527245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:32.527262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:32.527265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:32.527267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:32.527276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254472290340659:2684]
2025-10-01T14:06:32.527281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254472290340659:2684]
2025-10-01T14:06:32.527286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254472290340659:2684]
2025-10-01T14:06:32.527337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:32.527345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.527348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:32.527485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:32.528609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:32.528736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:32.528753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:32.528757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:32.579976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254474667199751:2506]
2025-10-01T14:06:32.580224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 49, pipe: [1:7556254474667199751:2506]
2025-10-01T14:06:32.687645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:32.688001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.688023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.688086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199751:2506], now have 1 active actors on pipe
2025-10-01T14:06:32.688312Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:32.689448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:32.689459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0] Write session will restart in 0.008776s
2025-10-01T14:06:32.689487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0] Write session: Do CDS request
2025-10-01T14:06:32.689493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:32.689010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254474667199751:2506]
2025-10-01T14:06:32.689017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:32.689021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:32.689035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:32.689084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 50 reason: error at write: Disconnected sessionId: src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0
2025-10-01T14:06:32.689288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 50 sessionId: src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0 is DEAD
2025-10-01T14:06:32.699901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.700227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:32.700242Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 51
2025-10-01T14:06:32.700365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.700392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 51 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:32.700398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=51 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:32.700402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:32.700807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 51 sessionId:  describe result for acl check
2025-10-01T14:06:32.700833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:32.700835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:32.700838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:32.700854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254474667199785:2809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:32.701382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254474667199785:2809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:32.703641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254474667199785:2809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:32.714727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254474667199785:2809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:32.714741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254474667199785:2809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:32.714746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254474667199785:2809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:32.714755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 51 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:32.716442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:32.716856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:32.717028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:32.717037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:32.717070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:32.717109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:32.717140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254472290340782:2687]
2025-10-01T14:06:32.717545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:32.717815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:32.717844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:32.718053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:32.718091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.718095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.718096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.718097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.718097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.718098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.718099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.718100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.718100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.718101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.718102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.718103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.718103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.718104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.718107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.718114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.718116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.718118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.718120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.718122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.718125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.718127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.718129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.718131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.718133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.718135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.718137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.718139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.718160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.718165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.718169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.718172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.718175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.718178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.718180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.718183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.718186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.718189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.718191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.718194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.718197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.718200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.718202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.718205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.718209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.718212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.718215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.718218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.718220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.718222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.718225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.718228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.718230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.718234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.718236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.718238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.718258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:32.722416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:32.723087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:32.723108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:32.723111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:32.723115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:32.723122Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 50 [2:7556254472290340782:2687]
2025-10-01T14:06:32.723137Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:32.723151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:32.723154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.723157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.723158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.723171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:32.723176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:32.723187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:32.723236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.723241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.723242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.723245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:32.723246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:32.723323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:32.723332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.723345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.723355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.723370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:32.723389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199864:2809], now have 1 active actors on pipe
2025-10-01T14:06:32.723398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199765:2446], now have 1 active actors on pipe
2025-10-01T14:06:32.723406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254472290340776:2687]
2025-10-01T14:06:32.723417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254472290340776:2687]
2025-10-01T14:06:32.723419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254472290340776:2687]
2025-10-01T14:06:32.723434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:32.723450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:32.723464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:32.723467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:32.723501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254472290340776:2687]
2025-10-01T14:06:32.723504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:32.723543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:32.723546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:32.723548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:32.723553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:32.723600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 50
2025-10-01T14:06:32.723644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 50
2025-10-01T14:06:32.723724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.723735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.723762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f24de38-4b78a025-65d89764-2a80c134_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:32.723774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.723778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.723784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:32.723793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.723807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:32.723829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.724057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.724066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.724080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.725585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 51 partition: 0 MaxSeqNo: 45 sessionId: src_id|9f24de38-4b78a025-65d89764-2a80c134_0
2025-10-01T14:06:32.725958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a862d0fd-7f5ef9bf-4192556e-560e83c6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9f24de38-4b78a025-65d89764-2a80c134_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:32.728743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f24de38-4b78a025-65d89764-2a80c134_0] Write session: try to update token
2025-10-01T14:06:32.728758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f24de38-4b78a025-65d89764-2a80c134_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:32.745923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 51 sessionId: src_id|9f24de38-4b78a025-65d89764-2a80c134_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:32.748561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:32.748948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.748977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.749001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:32.749004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:32.749007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:32.749009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:32.749019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254472290340776:2687]
2025-10-01T14:06:32.749024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254472290340776:2687]
2025-10-01T14:06:32.749033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254472290340776:2687]
2025-10-01T14:06:32.749077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:32.749090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:32.749094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:32.749100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:32.749109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.749112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:32.749283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:32.789058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254474667199878:2506]
2025-10-01T14:06:32.789464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 50, pipe: [1:7556254474667199878:2506]
2025-10-01T14:06:32.907305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:32.907598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:32.907657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199878:2506], now have 1 active actors on pipe
2025-10-01T14:06:32.908254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:32.908288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254474667199878:2506]
2025-10-01T14:06:32.908308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:32.908359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:32.908368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:32.908448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 51 reason: error at write: Disconnected sessionId: src_id|9f24de38-4b78a025-65d89764-2a80c134_0
2025-10-01T14:06:32.908607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 51 sessionId: src_id|9f24de38-4b78a025-65d89764-2a80c134_0 is DEAD
2025-10-01T14:06:32.908745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f24de38-4b78a025-65d89764-2a80c134_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:32.908756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f24de38-4b78a025-65d89764-2a80c134_0] Write session will restart in 0.005423s
2025-10-01T14:06:32.908787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f24de38-4b78a025-65d89764-2a80c134_0] Write session: Do CDS request
2025-10-01T14:06:32.908797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f24de38-4b78a025-65d89764-2a80c134_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:32.915913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f24de38-4b78a025-65d89764-2a80c134_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.916025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:32.916039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 52
2025-10-01T14:06:32.916174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:32.916208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 52 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:32.916217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=52 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:32.916221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:32.918554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 52 sessionId:  describe result for acl check
2025-10-01T14:06:32.918608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:32.918615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:32.918617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:32.918622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254474667199894:2813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:32.919182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254474667199894:2813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:32.922454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254474667199894:2813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:32.926538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:32.933074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254474667199894:2813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:32.933086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254474667199894:2813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:32.933089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254474667199894:2813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:32.933099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 52 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:32.933050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:32.933309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:32.933313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:32.933324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:32.933377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:32.933413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254472290340886:2689]
2025-10-01T14:06:32.934032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:32.934424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:32.934462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:32.934766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:32.934823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.934824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.934825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.934826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.934828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.934829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.934830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.934831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.934832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.934834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.934835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.934836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.934837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.934839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.934844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.934854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.934858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.934862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.934866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.934870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.934874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.934878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.934882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.934886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.934890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.934893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.934897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.934901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.934907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.934914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:32.934921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.934927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:32.934931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.934937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:32.934941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.934946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:32.934951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.934957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:32.934961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.934966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:32.934971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.934979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:32.934983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.934988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:32.934993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.934998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:32.935003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.935008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.935015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.935019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.935023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.935028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.935032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.935038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:32.935042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.935048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:32.935088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:32.946810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:32.947474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:32.947481Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:32.947484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:32.947488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:32.947497Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 51 [2:7556254472290340886:2689]
2025-10-01T14:06:32.947518Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:32.947539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:32.947543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.947547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.947550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.947570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:32.947576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:32.947583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:32.947656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.947659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.947662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.947666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:32.947669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:32.947763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:32.947766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.947780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:32.947792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:32.947810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:32.947827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254472290340881:2689]
2025-10-01T14:06:32.947830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254472290340881:2689]
2025-10-01T14:06:32.947833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254472290340881:2689]
2025-10-01T14:06:32.947845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:32.947862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:32.947876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:32.947880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:32.947881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:32.947884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:32.947884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:32.947925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254472290340881:2689]
2025-10-01T14:06:32.947936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:32.947948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199980:2813], now have 1 active actors on pipe
2025-10-01T14:06:32.947952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254474667199880:2446], now have 1 active actors on pipe
2025-10-01T14:06:32.948094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 51
2025-10-01T14:06:32.948130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 51
2025-10-01T14:06:32.948039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:32.948293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.948304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.948334Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e46fc23c-d936189f-244205c6-55f7ca56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:32.948342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:32.948346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:32.948349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:32.948359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:32.948369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:32.948388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.949197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:32.949207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:32.949224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:32.949368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 52 partition: 0 MaxSeqNo: 45 sessionId: src_id|e46fc23c-d936189f-244205c6-55f7ca56_0
2025-10-01T14:06:32.949831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f24de38-4b78a025-65d89764-2a80c134_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e46fc23c-d936189f-244205c6-55f7ca56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:32.952955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46fc23c-d936189f-244205c6-55f7ca56_0] Write session: try to update token
2025-10-01T14:06:32.952978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46fc23c-d936189f-244205c6-55f7ca56_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:32.973476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 52 sessionId: src_id|e46fc23c-d936189f-244205c6-55f7ca56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:32.972285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:32.972304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:32.972308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:32.972310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:32.972321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254472290340881:2689]
2025-10-01T14:06:32.972326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254472290340881:2689]
2025-10-01T14:06:32.972330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254472290340881:2689]
2025-10-01T14:06:32.972379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:32.972385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:32.972388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:32.972523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:32.973379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:32.973387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:32.973392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:32.977560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:33.008802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254478962167289:2506]
2025-10-01T14:06:33.009101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 51, pipe: [1:7556254478962167289:2506]
2025-10-01T14:06:33.123124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:33.123453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.123470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.123515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167289:2506], now have 1 active actors on pipe
2025-10-01T14:06:33.123747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:33.124240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:33.124244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254478962167289:2506]
2025-10-01T14:06:33.124249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:33.124264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:33.124319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 52 reason: error at write: Disconnected sessionId: src_id|e46fc23c-d936189f-244205c6-55f7ca56_0
2025-10-01T14:06:33.124509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 52 sessionId: src_id|e46fc23c-d936189f-244205c6-55f7ca56_0 is DEAD
2025-10-01T14:06:33.124740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46fc23c-d936189f-244205c6-55f7ca56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:33.124754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46fc23c-d936189f-244205c6-55f7ca56_0] Write session will restart in 0.007794s
2025-10-01T14:06:33.124783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46fc23c-d936189f-244205c6-55f7ca56_0] Write session: Do CDS request
2025-10-01T14:06:33.124788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46fc23c-d936189f-244205c6-55f7ca56_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:33.133416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:33.133895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46fc23c-d936189f-244205c6-55f7ca56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.133899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:33.134003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:33.134016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 53
2025-10-01T14:06:33.134065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:33.134075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:33.134085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:33.134128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:33.134166Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254476585308290:2692]
2025-10-01T14:06:33.134178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.134208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 53 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:33.134218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=53 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:33.134221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:33.134631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 53 sessionId:  describe result for acl check
2025-10-01T14:06:33.134659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:33.134664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:33.134665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:33.134669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254478962167365:2818] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:33.134789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:33.135046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:33.135084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254478962167365:2818] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:33.135086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:33.135394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:33.135442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.135448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.135450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.135451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.135452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.135453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.135454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.135455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.135456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.135457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.135459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.135460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.135461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.135462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.135467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.135477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.135481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.135485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.135490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.135494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.135498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.135502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.135506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.135510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.135514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.135518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.135521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.135526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.135534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.135542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.135548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.135559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.135564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.135568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.135579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.135584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.135589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.135599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.135603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.135611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.135616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.135625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.135629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.135634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.135643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.135648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.135656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.135661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.135665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.135675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.135680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.135689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.135696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.135704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.135709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.135718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.135758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:33.137033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254478962167365:2818] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:33.144472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254478962167365:2818] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:33.144488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254478962167365:2818] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:33.144491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254478962167365:2818] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:33.144507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 53 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:33.144985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:33.145673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:33.145689Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:33.145692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:33.145697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:33.145705Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 52 [2:7556254476585308290:2692]
2025-10-01T14:06:33.145727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:33.145762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:33.145770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.145774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.145777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.145794Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:33.145800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:33.145807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:33.145867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.145874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.145876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.145881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:33.145883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:33.145955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:33.145962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.145976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.145993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.146011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:33.146035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167404:2818], now have 1 active actors on pipe
2025-10-01T14:06:33.146044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167297:2446], now have 1 active actors on pipe
2025-10-01T14:06:33.146054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254476585308285:2692]
2025-10-01T14:06:33.146061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254476585308285:2692]
2025-10-01T14:06:33.146063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254476585308285:2692]
2025-10-01T14:06:33.146075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:33.146086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:33.146089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:33.146091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:33.146093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:33.146308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 52
2025-10-01T14:06:33.146335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 52
2025-10-01T14:06:33.146813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 53 partition: 0 MaxSeqNo: 45 sessionId: src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0
2025-10-01T14:06:33.147182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46fc23c-d936189f-244205c6-55f7ca56_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:33.146109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:33.146122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:33.146159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254476585308285:2692]
2025-10-01T14:06:33.146167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:33.146182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:33.146406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.146411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.146439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:33.146447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.146452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.146453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:33.146463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.146472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:33.146490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:33.146701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.146708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.146730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:33.150464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0] Write session: try to update token
2025-10-01T14:06:33.150482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:33.161161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:33.161181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:33.161192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254476585308285:2692]
2025-10-01T14:06:33.161246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:33.161518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:33.161687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:33.161878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:33.162043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:33.162254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:33.162297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:33.162496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:33.175858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.175881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.175922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:33.172762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 53 sessionId: src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:33.175632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:33.176033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:33.181296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:33.181309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:33.181312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:33.181314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:33.181326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254476585308285:2692]
2025-10-01T14:06:33.181330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254476585308285:2692]
2025-10-01T14:06:33.181334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254476585308285:2692]
2025-10-01T14:06:33.181384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:33.181395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.181394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:33.181397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:33.181401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:33.181406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:33.181531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:33.224209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254478962167414:2506]
2025-10-01T14:06:33.224950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 52, pipe: [1:7556254478962167414:2506]
2025-10-01T14:06:33.340859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:33.348775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.348809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.349031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.349108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.349178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.349252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.349310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.349318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.349390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.349456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.349524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.349593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.349638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.349645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.349715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.349776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.349843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.349903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.349950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.349955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.350017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.350078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.350135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.350199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.350242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.350247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.350305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.350358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.350436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.350510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.350571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.350580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.350664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.350738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.350815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.350894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.350951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.350957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.353911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:33.353924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:33.353954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 53 reason: error at write: Disconnected sessionId: src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0
2025-10-01T14:06:33.354182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 53 sessionId: src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0 is DEAD
2025-10-01T14:06:33.351033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.351105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.351173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.351240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.351290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.351294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.354320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:33.351368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.354335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0] Write session will restart in 0.008953s
2025-10-01T14:06:33.351430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.351494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.351561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.351611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.351614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.354340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254478962167414:2506]
2025-10-01T14:06:33.354361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0] Write session: Do CDS request
2025-10-01T14:06:33.354378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:33.354360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:33.351682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.351745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.351804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.351860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.351900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.351901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.351967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.352025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.352100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.352169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.352308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.352312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.352395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167414:2506], now have 1 active actors on pipe
2025-10-01T14:06:33.353933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:33.364936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.366526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:33.366540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 54
2025-10-01T14:06:33.370232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.370289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 54 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:33.370296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=54 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:33.370300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:33.371146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 54 sessionId:  describe result for acl check
2025-10-01T14:06:33.371198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:33.371200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:33.371202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:33.371210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254478962167484:2822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:33.371783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254478962167484:2822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:33.376315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254478962167484:2822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:33.378482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:33.380039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254478962167484:2822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:33.380053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254478962167484:2822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:33.380056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254478962167484:2822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:33.380066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 54 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:33.380407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:33.380591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:33.380595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:33.380604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:33.380640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:33.380669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254476585308398:2694]
2025-10-01T14:06:33.381099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:33.381409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:33.381441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:33.381679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:33.381714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.381715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.381716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.381717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.381718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.381718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.381719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.381720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.381721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.381722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.381722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.381723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.381724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.381724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.381728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.381733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.381736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.381738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.381740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.381743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.381745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.381747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.381749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.381751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.381753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.381755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.381757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.381760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.381764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.381769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.381773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.381777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.381779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.381782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.381785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.381787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.381790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.381793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.381795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.381798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.381802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.381804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.381807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.381810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.381813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.381815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.381818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.381821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.381823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.381826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.381828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.381832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.381835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.381838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.381841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.381844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.381877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:33.385914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:33.386581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:33.386587Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:33.386588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:33.386591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:33.386598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 53 [2:7556254476585308398:2694]
2025-10-01T14:06:33.386611Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:33.386627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:33.386630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.386633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.386634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.386648Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:33.386653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:33.386658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:33.386707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.386708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.386710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.386712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:33.386714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:33.386788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:33.386790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.386801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.386809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.386823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:33.386840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254476585308392:2694]
2025-10-01T14:06:33.386842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254476585308392:2694]
2025-10-01T14:06:33.386845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254476585308392:2694]
2025-10-01T14:06:33.386854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:33.386858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:33.386861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:33.386863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:33.386868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:33.386881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:33.386886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:33.386906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167417:2446], now have 1 active actors on pipe
2025-10-01T14:06:33.386909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167519:2822], now have 1 active actors on pipe
2025-10-01T14:06:33.386948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254476585308392:2694]
2025-10-01T14:06:33.386955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:33.387151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:33.387374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 53
2025-10-01T14:06:33.387459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 53
2025-10-01T14:06:33.387695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.387705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.387732Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b03b677-d10f38de-11776be8-dd6d7399_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:33.387740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.387744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.387746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:33.387757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.387768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:33.387783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:33.388078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.388083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.388099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:33.388243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 54 partition: 0 MaxSeqNo: 45 sessionId: src_id|5b03b677-d10f38de-11776be8-dd6d7399_0
2025-10-01T14:06:33.388624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2cf715-4c2079fd-aa099d75-b0e03247_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5b03b677-d10f38de-11776be8-dd6d7399_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:33.391844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03b677-d10f38de-11776be8-dd6d7399_0] Write session: try to update token
2025-10-01T14:06:33.391866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03b677-d10f38de-11776be8-dd6d7399_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:33.408140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:33.408159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:33.408169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254476585308392:2694]
2025-10-01T14:06:33.408222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:33.408426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:33.408580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:33.408726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:33.408881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:33.409076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:33.409119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:33.409332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:33.413984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 54 sessionId: src_id|5b03b677-d10f38de-11776be8-dd6d7399_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:33.416734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:33.418462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.418485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.418521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:33.420564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:33.433920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:33.433940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:33.433943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:33.433946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:33.433956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254476585308392:2694]
2025-10-01T14:06:33.433961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254476585308392:2694]
2025-10-01T14:06:33.433966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254476585308392:2694]
2025-10-01T14:06:33.434020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:33.434027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.434030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:33.434160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:33.434286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:33.434290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:33.434294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:33.454099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254478962167554:2506]
2025-10-01T14:06:33.454289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 53, pipe: [1:7556254478962167554:2506]
2025-10-01T14:06:33.592416Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:33.600957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.600987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.601145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.601208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.601269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.601331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.601380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.601388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.601454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.601510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.601572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.601643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.601702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.601704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.601780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.601842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.601917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.602009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.602063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.602065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.602149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.602609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.602674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.602734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.602776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.602782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.602848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.602907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.602966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.603027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.603077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.603082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.603149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.603215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.603275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.603334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.603398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.603405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.603466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.603522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.603599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.603666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.603721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.603728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.603795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.603861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.603924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.603989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.604255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.604263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.604333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.604393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.604461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.604534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.604591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.604598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.605358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254478962167554:2506]
2025-10-01T14:06:33.605396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:33.605399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:33.605428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 54 reason: error at write: Disconnected sessionId: src_id|5b03b677-d10f38de-11776be8-dd6d7399_0
2025-10-01T14:06:33.605771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03b677-d10f38de-11776be8-dd6d7399_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:33.605779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03b677-d10f38de-11776be8-dd6d7399_0] Write session will restart in 0.006630s
2025-10-01T14:06:33.605806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03b677-d10f38de-11776be8-dd6d7399_0] Write session: Do CDS request
2025-10-01T14:06:33.605815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03b677-d10f38de-11776be8-dd6d7399_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:33.604671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:33.604744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:33.604817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:33.604896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:33.604947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:33.604950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:33.605031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167554:2506], now have 1 active actors on pipe
2025-10-01T14:06:33.605553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:33.605628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 54 sessionId: src_id|5b03b677-d10f38de-11776be8-dd6d7399_0 is DEAD
2025-10-01T14:06:33.605773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:33.613897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03b677-d10f38de-11776be8-dd6d7399_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.613988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:33.614004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 55
2025-10-01T14:06:33.614192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.614230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 55 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:33.614240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=55 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:33.614244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:33.614950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 55 sessionId:  describe result for acl check
2025-10-01T14:06:33.614997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:33.615008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:33.615010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:33.615016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254478962167573:2834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:33.615573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254478962167573:2834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:33.619243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254478962167573:2834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:33.622688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:33.623725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254478962167573:2834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:33.623744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254478962167573:2834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:33.623747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254478962167573:2834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:33.623758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 55 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:33.624452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:33.624662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:33.624667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:33.624677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:33.624729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:33.624781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254476585308548:2709]
2025-10-01T14:06:33.625448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:33.626165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:33.626217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:33.626545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:33.626619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.626620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.626621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.626622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.626623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.626624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.626625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.626627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.626628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.626628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.626630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.626631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.626632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.626633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.626637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.626647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.626651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.626654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.626658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.626662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.626665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.626669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.626672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.626676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.626679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.626682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.626685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.626688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.626695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.626703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.626709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.626714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.626720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.626725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.626730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.626735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.626741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.626746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.626750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.626755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.626761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.626766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.626770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.626776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.626780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.626786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.626791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.626795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.626800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.626805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.626810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.626816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.626820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.626825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.626830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.626834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.626875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:33.634192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:33.634837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:33.634852Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:33.634854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:33.634857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:33.634863Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 54 [2:7556254476585308548:2709]
2025-10-01T14:06:33.634878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:33.634893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:33.634896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.634899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.634901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.634916Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:33.634924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:33.634929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:33.634973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.634978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.634980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.634983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:33.634985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:33.635060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:33.635068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.635081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.635096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.635114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:33.635134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167663:2834], now have 1 active actors on pipe
2025-10-01T14:06:33.635142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167558:2446], now have 1 active actors on pipe
2025-10-01T14:06:33.635150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254476585308540:2709]
2025-10-01T14:06:33.635159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254476585308540:2709]
2025-10-01T14:06:33.635161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254476585308540:2709]
2025-10-01T14:06:33.635174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:33.635188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:33.635195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:33.635198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:33.635200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:33.635201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:33.635204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:33.635182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 54
2025-10-01T14:06:33.635201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 54
2025-10-01T14:06:33.635240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254476585308540:2709]
2025-10-01T14:06:33.635249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:33.635250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:33.635279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.635288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.635328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:33.635339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.635345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.635347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:33.635356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.635365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:33.635385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:33.635527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.635550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.635591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:33.635755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 55 partition: 0 MaxSeqNo: 45 sessionId: src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0
2025-10-01T14:06:33.636123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03b677-d10f38de-11776be8-dd6d7399_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:33.638686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0] Write session: try to update token
2025-10-01T14:06:33.638705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:33.657960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:33.657981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:33.657985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:33.657988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:33.658000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254476585308540:2709]
2025-10-01T14:06:33.658005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254476585308540:2709]
2025-10-01T14:06:33.658010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254476585308540:2709]
2025-10-01T14:06:33.658076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:33.658083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:33.658091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.658092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:33.658094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:33.658096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:33.658282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:33.669703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 55 sessionId: src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:33.672570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:33.705547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254478962167687:2506]
2025-10-01T14:06:33.705867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 54, pipe: [1:7556254478962167687:2506]
2025-10-01T14:06:33.808619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:33.808697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:33.808704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:33.808788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 55 reason: error at write: Disconnected sessionId: src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0
2025-10-01T14:06:33.807951Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:33.808303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.808314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.808335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167687:2506], now have 1 active actors on pipe
2025-10-01T14:06:33.808808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:33.809158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:33.809168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0] Write session will restart in 0.006676s
2025-10-01T14:06:33.809194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0] Write session: Do CDS request
2025-10-01T14:06:33.809200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:33.809001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 55 sessionId: src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0 is DEAD
2025-10-01T14:06:33.809205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254478962167687:2506]
2025-10-01T14:06:33.816949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.817343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:33.817357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 56
2025-10-01T14:06:33.817495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.817528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 56 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:33.817534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=56 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:33.817542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:33.817951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 56 sessionId:  describe result for acl check
2025-10-01T14:06:33.817995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:33.818000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:33.818001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:33.818007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254478962167758:2839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:33.818554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254478962167758:2839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:33.818876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:33.820255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254478962167758:2839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:33.819545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:33.819720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:33.819724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:33.819732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:33.819783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:33.819833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254476585308668:2712]
2025-10-01T14:06:33.820522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:33.820720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:33.820759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:33.821026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:33.821074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.821081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.821081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.821082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.821083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.821083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.821084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.821084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.821085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.821086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.821086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.821087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.821088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.821088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.821091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.821097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.821099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.821102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.821106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.821109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.821112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.821115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.821119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.821123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.821127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.821130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.821134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.821137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.821142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.821147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.821152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.821154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.821157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.821160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.821162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.821165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.821169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.821174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.821178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.821182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.821186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.821191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.821195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.821200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.821204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.821209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.821213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.821218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.821221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.821223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.821226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.821229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.821232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.821234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.821236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.821239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.821267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:33.824532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254478962167758:2839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:33.824546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254478962167758:2839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:33.824550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254478962167758:2839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:33.824558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 56 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:33.824713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:33.825451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:33.825471Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:33.825474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:33.825478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:33.825486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 55 [2:7556254476585308668:2712]
2025-10-01T14:06:33.825504Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:33.825521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:33.825524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.825528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.825530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.825547Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:33.825561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:33.825567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:33.825638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.825647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.825650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.825653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:33.825656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:33.825733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:33.825745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.825761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.825771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.825787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:33.825805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167800:2839], now have 1 active actors on pipe
2025-10-01T14:06:33.825815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167690:2446], now have 1 active actors on pipe
2025-10-01T14:06:33.825823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254476585308663:2712]
2025-10-01T14:06:33.825825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254476585308663:2712]
2025-10-01T14:06:33.825828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254476585308663:2712]
2025-10-01T14:06:33.825844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:33.825862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:33.825863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:33.825871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:33.825873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:33.825889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:33.825898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:33.825877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 55
2025-10-01T14:06:33.825883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 55
2025-10-01T14:06:33.825934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254476585308663:2712]
2025-10-01T14:06:33.825949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:33.825965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:33.825967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.825972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.826019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|839bead-86470b41-b42be1f0-7a437d3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:33.826033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:33.826037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:33.826039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:33.826049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:33.826058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:33.826080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:33.826227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.826236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.826246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:33.826332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 56 partition: 0 MaxSeqNo: 45 sessionId: src_id|839bead-86470b41-b42be1f0-7a437d3d_0
2025-10-01T14:06:33.826708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f091ada-f99b57bd-e7bc1880-ac1e037e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|839bead-86470b41-b42be1f0-7a437d3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:33.829409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839bead-86470b41-b42be1f0-7a437d3d_0] Write session: try to update token
2025-10-01T14:06:33.829429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839bead-86470b41-b42be1f0-7a437d3d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:33.845316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 56 sessionId: src_id|839bead-86470b41-b42be1f0-7a437d3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:33.848593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:33.847345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:33.847369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:33.847371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:33.847373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:33.847383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254476585308663:2712]
2025-10-01T14:06:33.847387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254476585308663:2712]
2025-10-01T14:06:33.847392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254476585308663:2712]
2025-10-01T14:06:33.847447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:33.847451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:33.847456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:33.847458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.847460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:33.847461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:33.847634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:33.909307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254478962167807:2506]
2025-10-01T14:06:33.909665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 55, pipe: [1:7556254478962167807:2506]
2025-10-01T14:06:33.984294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:33.985321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:33.985335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:33.985373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167807:2506], now have 1 active actors on pipe
2025-10-01T14:06:33.985586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:33.985667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254478962167807:2506]
2025-10-01T14:06:33.985678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:33.985682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:33.985694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:33.985768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 56 reason: error at write: Disconnected sessionId: src_id|839bead-86470b41-b42be1f0-7a437d3d_0
2025-10-01T14:06:33.985945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 56 sessionId: src_id|839bead-86470b41-b42be1f0-7a437d3d_0 is DEAD
2025-10-01T14:06:33.986080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839bead-86470b41-b42be1f0-7a437d3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:33.986092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839bead-86470b41-b42be1f0-7a437d3d_0] Write session will restart in 0.006991s
2025-10-01T14:06:33.986121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839bead-86470b41-b42be1f0-7a437d3d_0] Write session: Do CDS request
2025-10-01T14:06:33.986128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839bead-86470b41-b42be1f0-7a437d3d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:33.993821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|839bead-86470b41-b42be1f0-7a437d3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.994260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:33.994273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 57
2025-10-01T14:06:33.995506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:33.994390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:33.994420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 57 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:33.994425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=57 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:33.994429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:33.994817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 57 sessionId:  describe result for acl check
2025-10-01T14:06:33.994842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:33.994844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:33.994845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:33.994850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254478962167881:2843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:33.995368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254478962167881:2843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:33.996945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254478962167881:2843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:33.997068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:33.997254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:33.997262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:33.997272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:33.997320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:33.997370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254476585308779:2714]
2025-10-01T14:06:33.998009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:33.998232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:33.998269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:33.998588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:33.998641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.998647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.998648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.998649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.998650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.998652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.998653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.998654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.998655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.998656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.998657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.998658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.998659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.998660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.998664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.998674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.998678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.998682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.998686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.998689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.998693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.998696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.998699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.998703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.998706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.998709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.998712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.998715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.998721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.998727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:33.998732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.998737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:33.998742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.998746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:33.998750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.998757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:33.998766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.998771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:33.998775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.998780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:33.998785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.998794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:33.998799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.998805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:33.998812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.998817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:33.998822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.998831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:33.998835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.998844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:33.998849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.998854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:33.998865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.998873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:33.998878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.998882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:33.998927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:33.999538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254478962167881:2843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:33.999550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254478962167881:2843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:33.999553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254478962167881:2843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:33.999561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 57 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:34.002499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:34.003122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:34.003136Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:34.003138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:34.003142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:34.003148Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 56 [2:7556254476585308779:2714]
2025-10-01T14:06:34.003166Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:34.003182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:34.003188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.003192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.003194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.003209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:34.003218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:34.003224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:34.003278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.003284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.003287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.003290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:34.003292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:34.003352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:34.003358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.003371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.003384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.003404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:34.003424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167920:2843], now have 1 active actors on pipe
2025-10-01T14:06:34.003430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254478962167812:2446], now have 1 active actors on pipe
2025-10-01T14:06:34.003436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254476585308774:2714]
2025-10-01T14:06:34.003438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254476585308774:2714]
2025-10-01T14:06:34.003440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254476585308774:2714]
2025-10-01T14:06:34.003454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:34.003470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:34.003477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:34.003481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:34.003481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:34.003484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:34.003484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:34.003481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 56
2025-10-01T14:06:34.003506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254476585308774:2714]
2025-10-01T14:06:34.003487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 56
2025-10-01T14:06:34.003513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:34.003517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:34.003532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.003535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.003566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:34.003577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.003582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.003584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:34.003591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.003602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:34.003621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.003760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.003767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.003779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.003850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 57 partition: 0 MaxSeqNo: 45 sessionId: src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0
2025-10-01T14:06:34.004158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|839bead-86470b41-b42be1f0-7a437d3d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:34.007031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0] Write session: try to update token
2025-10-01T14:06:34.007050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:34.025183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:34.025203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:34.025206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:34.025209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:34.025220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254476585308774:2714]
2025-10-01T14:06:34.025225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254476585308774:2714]
2025-10-01T14:06:34.025229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254476585308774:2714]
2025-10-01T14:06:34.025286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:34.025295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.025299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:34.025302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:34.025305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:34.025309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:34.025461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:34.026137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 57 sessionId: src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:34.029236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:34.085926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254483257135228:2506]
2025-10-01T14:06:34.086239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 56, pipe: [1:7556254483257135228:2506]
2025-10-01T14:06:34.170217Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:34.170622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.170641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.170684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135228:2506], now have 1 active actors on pipe
2025-10-01T14:06:34.170913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:34.171286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:34.171355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254483257135228:2506]
2025-10-01T14:06:34.171374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:34.171446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 57 reason: status is not ok: tablet will be restarted right now sessionId: src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0
2025-10-01T14:06:34.171601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 57 sessionId: src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0 is DEAD
2025-10-01T14:06:34.171737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:34.171747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0] Write session will restart in 0.005633s
2025-10-01T14:06:34.171772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0] Write session: Do CDS request
2025-10-01T14:06:34.171778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:34.182972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:34.183019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:34.183036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 58
2025-10-01T14:06:34.183274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:34.183308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 58 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:34.183318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=58 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:34.183325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:34.183713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 58 sessionId:  describe result for acl check
2025-10-01T14:06:34.183744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:34.183750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:34.183752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:34.183759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254483257135307:2848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:34.183750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:34.184281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254483257135307:2848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:34.184728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:34.184853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:34.184861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:34.184868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:34.184899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:34.184932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254480880276190:2717]
2025-10-01T14:06:34.185327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:34.185675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:34.185701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:34.185910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:34.185948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.185952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.185953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.185954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.185954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.185955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.185956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.185956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.185957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.185958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.185958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.185959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.185959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.185960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.185963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.185969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.185971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.185973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.185975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.185977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.185979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.185981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.185984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.185986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.185988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.185990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.185993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.185995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.185999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.186003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.186006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.186018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.186021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.186024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.186026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.186029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.186032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.186035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.186037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.186040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.186043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.186046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.186048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.186051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.186054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.186057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.186060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.186063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.186065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.186069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.186071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.186074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.186079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.186081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.186085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.186088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.186107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:34.186100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254483257135307:2848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:34.189895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254483257135307:2848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:34.189916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254483257135307:2848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:34.189919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254483257135307:2848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:34.189933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 58 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:34.191970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:34.192764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:34.192792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:34.192794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:34.192799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:34.192807Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 57 [2:7556254480880276190:2717]
2025-10-01T14:06:34.192826Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:34.192859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:34.192869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.192873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.192875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.192893Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:34.192899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:34.192906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:34.192979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.192989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.192992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.192995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:34.192998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:34.193081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:34.193090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.193106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.193125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.193150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:34.193172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254480880276184:2717]
2025-10-01T14:06:34.193180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254480880276184:2717]
2025-10-01T14:06:34.193183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254480880276184:2717]
2025-10-01T14:06:34.193200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:34.193214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:34.193236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:34.193244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:34.193249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:34.193252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:34.193257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:34.193285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254480880276184:2717]
2025-10-01T14:06:34.193295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:34.193327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:34.193399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135346:2848], now have 1 active actors on pipe
2025-10-01T14:06:34.193410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135234:2446], now have 1 active actors on pipe
2025-10-01T14:06:34.193740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 57
2025-10-01T14:06:34.193770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 57
2025-10-01T14:06:34.194032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.194044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.194077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:34.194091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.194097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.194099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:34.194113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.194122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:34.194147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.194346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.194362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.194397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.194529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 58 partition: 0 MaxSeqNo: 45 sessionId: src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0
2025-10-01T14:06:34.194805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32dff334-9b5cedeb-c17f471f-c08f1ba3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:34.197516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0] Write session: try to update token
2025-10-01T14:06:34.197530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:34.217654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:34.217686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:34.217691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:34.217694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:34.217704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254480880276184:2717]
2025-10-01T14:06:34.217712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254480880276184:2717]
2025-10-01T14:06:34.217724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254480880276184:2717]
2025-10-01T14:06:34.217775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:34.217786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:34.217790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:34.217796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:34.217806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.217810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:34.218127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:34.221903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 58 sessionId: src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:34.224896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:34.276037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254483257135353:2506]
2025-10-01T14:06:34.276314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 57, pipe: [1:7556254483257135353:2506]
2025-10-01T14:06:34.369291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254483257135353:2506]
2025-10-01T14:06:34.369326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:34.369329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:34.369391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 58 reason: error at write: Disconnected sessionId: src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0
2025-10-01T14:06:34.369553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 58 sessionId: src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0 is DEAD
2025-10-01T14:06:34.369687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:34.368214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:34.368565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.368581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.368631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135353:2506], now have 1 active actors on pipe
2025-10-01T14:06:34.369495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:34.371069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:34.371077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0] Write session will restart in 0.007391s
2025-10-01T14:06:34.371097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0] Write session: Do CDS request
2025-10-01T14:06:34.371111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:34.382830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:34.388037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:34.388053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 59
2025-10-01T14:06:34.389252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:34.388332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:34.388374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 59 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:34.388379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=59 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:34.388383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:34.388698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 59 sessionId:  describe result for acl check
2025-10-01T14:06:34.388728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:34.388729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:34.388730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:34.388734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254483257135429:2852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:34.389208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254483257135429:2852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:34.390065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:34.390235Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:34.390239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:34.390249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:34.390292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:34.390328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254480880276302:2719]
2025-10-01T14:06:34.390979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:34.391270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:34.391310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:34.391619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:34.391668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.391669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.391670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.391671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.391672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.391673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.391674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.391675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.391676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.391677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.391679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.391680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.391681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.391682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.391687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.391695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.391699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.391703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.391706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.391710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.391713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.391717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.391720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.391724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.391728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.391731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.391734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.391738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.391745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.391752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.391758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.391763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.391767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.391772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.391776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.391781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.391786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.391791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.391795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.391800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.391805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.391810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.391814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.391819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.391823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.391829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.391833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.391837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.391843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.391849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.391853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.391858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.391862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.391866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.391870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.391875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.391914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:34.392409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254483257135429:2852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:34.396481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254483257135429:2852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:34.396494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254483257135429:2852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:34.396497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254483257135429:2852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:34.396504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 59 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:34.398108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 58
2025-10-01T14:06:34.398132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 58
2025-10-01T14:06:34.398699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 59 partition: 0 MaxSeqNo: 45 sessionId: src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0
2025-10-01T14:06:34.399436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c1d0c0-419efa20-11b7e2aa-a8e5c866_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:34.402356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0] Write session: try to update token
2025-10-01T14:06:34.397053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:34.397694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:34.397698Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:34.397700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:34.397703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:34.397708Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 58 [2:7556254480880276302:2719]
2025-10-01T14:06:34.397720Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:34.397735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:34.397737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.397739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.397741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.397754Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:34.397757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:34.397761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:34.397806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.397808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.397809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.397811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:34.397813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:34.397867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:34.397869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.397876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.397882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.398037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:34.398053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135356:2446], now have 1 active actors on pipe
2025-10-01T14:06:34.398055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135467:2852], now have 1 active actors on pipe
2025-10-01T14:06:34.398061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254480880276296:2719]
2025-10-01T14:06:34.398064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254480880276296:2719]
2025-10-01T14:06:34.398066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254480880276296:2719]
2025-10-01T14:06:34.398078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:34.398091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:34.398094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:34.398094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:34.398095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:34.398109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:34.398111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:34.398138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254480880276296:2719]
2025-10-01T14:06:34.398144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:34.398149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:34.398288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.398294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.398320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:34.398327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.398330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.398332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:34.398339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.398349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:34.398360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.398570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.398574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.398597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.405496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:34.428935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 59 sessionId: src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:34.428239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:34.428258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:34.428260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:34.428262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:34.428272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254480880276296:2719]
2025-10-01T14:06:34.428277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254480880276296:2719]
2025-10-01T14:06:34.428285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254480880276296:2719]
2025-10-01T14:06:34.428337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:34.428343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.428346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:34.428579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:34.428584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:34.428588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:34.431911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:34.432184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:34.470206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254483257135489:2506]
2025-10-01T14:06:34.478527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 58, pipe: [1:7556254483257135489:2506]
2025-10-01T14:06:34.608412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:34.608886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.608903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.608944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135489:2506], now have 1 active actors on pipe
2025-10-01T14:06:34.609383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254483257135489:2506]
2025-10-01T14:06:34.609416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:34.609451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:34.609459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:34.609528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 59 reason: error at write: Disconnected sessionId: src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0
2025-10-01T14:06:34.609744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 59 sessionId: src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0 is DEAD
2025-10-01T14:06:34.609895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:34.609907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0] Write session will restart in 0.009955s
2025-10-01T14:06:34.609934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0] Write session: Do CDS request
2025-10-01T14:06:34.609943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:34.609739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:34.622839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:34.622921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:34.622935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 60
2025-10-01T14:06:34.623128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:34.623185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 60 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:34.623196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=60 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:34.623203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:34.623707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 60 sessionId:  describe result for acl check
2025-10-01T14:06:34.623757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:34.623763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:34.623764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:34.623768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254483257135580:2864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:34.624183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254483257135580:2864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:34.624808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:34.628555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:34.628775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:34.628779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:34.628791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:34.628835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:34.628880Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254480880276456:2734]
2025-10-01T14:06:34.629492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:34.629843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:34.629878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:34.630164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:34.630210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.630211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.630212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.630213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.630214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.630215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.630216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.630217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.630218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.630219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.630221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.630221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.630223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.630223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.630229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.630237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.630240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.630243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.630246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.630250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.630253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.630257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.630260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.630264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.630267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.630270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.630273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.630277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.630284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.630290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.630296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.630301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.630304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.630309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.630313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.630318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.630324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.630328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.630331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.630336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.630340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.630345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.630349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.630353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.630357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.630362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.630365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.630388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.630392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.630397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.630401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.630406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.630410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.630415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.630419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.630423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.630462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:34.632673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254483257135580:2864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:34.635634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:34.635814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254483257135580:2864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:34.635827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254483257135580:2864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:34.635830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254483257135580:2864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:34.635839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 60 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:34.636312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:34.636330Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:34.636333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:34.636336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:34.636343Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 59 [2:7556254480880276456:2734]
2025-10-01T14:06:34.636359Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:34.636381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:34.636388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.636390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.636393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.636405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:34.636415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:34.636422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:34.636480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.636487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.636489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.636492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:34.636495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:34.636566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:34.636572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.636584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.636594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.636609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:34.636627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135616:2864], now have 1 active actors on pipe
2025-10-01T14:06:34.636630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135504:2446], now have 1 active actors on pipe
2025-10-01T14:06:34.636637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254480880276451:2734]
2025-10-01T14:06:34.636639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254480880276451:2734]
2025-10-01T14:06:34.636641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254480880276451:2734]
2025-10-01T14:06:34.636655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:34.636668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:34.636681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:34.636687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:34.636688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:34.636690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:34.636693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:34.636718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254480880276451:2734]
2025-10-01T14:06:34.636723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:34.636748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:34.637008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 59
2025-10-01T14:06:34.637031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 59
2025-10-01T14:06:34.637132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.637144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.637176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|135d23a1-20626205-bec62110-ddd37266_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:34.637189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.637194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.637200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:34.637208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.637222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:34.637241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.637459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.637467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.637484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.637577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 60 partition: 0 MaxSeqNo: 45 sessionId: src_id|135d23a1-20626205-bec62110-ddd37266_0
2025-10-01T14:06:34.637930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23097f5f-73aebb20-b474f1d6-4cbde928_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|135d23a1-20626205-bec62110-ddd37266_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:34.640991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|135d23a1-20626205-bec62110-ddd37266_0] Write session: try to update token
2025-10-01T14:06:34.641010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|135d23a1-20626205-bec62110-ddd37266_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:34.662431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:34.662450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:34.662454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:34.662455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:34.662467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254480880276451:2734]
2025-10-01T14:06:34.662472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254480880276451:2734]
2025-10-01T14:06:34.662476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254480880276451:2734]
2025-10-01T14:06:34.662525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:34.662531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.662534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:34.662682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:34.665027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:34.665038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:34.665042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:34.667692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 60 sessionId: src_id|135d23a1-20626205-bec62110-ddd37266_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:34.670543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:34.709536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254483257135636:2506]
2025-10-01T14:06:34.709889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 59, pipe: [1:7556254483257135636:2506]
2025-10-01T14:06:34.820255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:34.820516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.820526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.820548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135636:2506], now have 1 active actors on pipe
2025-10-01T14:06:34.821385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:34.821398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:34.821464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 60 reason: error at write: Disconnected sessionId: src_id|135d23a1-20626205-bec62110-ddd37266_0
2025-10-01T14:06:34.821667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 60 sessionId: src_id|135d23a1-20626205-bec62110-ddd37266_0 is DEAD
2025-10-01T14:06:34.821811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:34.821846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254483257135636:2506]
2025-10-01T14:06:34.821765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:34.824832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135d23a1-20626205-bec62110-ddd37266_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:34.824859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135d23a1-20626205-bec62110-ddd37266_0] Write session will restart in 0.005519s
2025-10-01T14:06:34.824890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135d23a1-20626205-bec62110-ddd37266_0] Write session: Do CDS request
2025-10-01T14:06:34.824896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135d23a1-20626205-bec62110-ddd37266_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:34.834816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|135d23a1-20626205-bec62110-ddd37266_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:34.835365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:34.835379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 61
2025-10-01T14:06:34.838675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:34.838729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 61 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:34.838735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=61 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:34.838741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:34.839145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 61 sessionId:  describe result for acl check
2025-10-01T14:06:34.839179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:34.839185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:34.839186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:34.839191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254483257135714:2869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:34.839699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254483257135714:2869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:34.840169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:34.840859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:34.841070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:34.841079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:34.841090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:34.841136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:34.841193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254480880276583:2737]
2025-10-01T14:06:34.842058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:34.842652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254483257135714:2869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:34.842609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:34.842659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:34.843086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:34.843135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.843136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.843137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.843139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.843140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.843141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.843143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.843144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.843145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.843146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.843147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.843149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.843150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.843152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.843158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.843168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.843173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.843177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.843181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.843185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.843189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.843193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.843197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.843201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.843205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.843209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.843213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.843216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.843224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.843232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:34.843239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.843244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:34.843249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.843255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:34.843260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.843265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:34.843270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.843274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:34.843278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.843283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:34.843288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.843293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:34.843297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.843302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:34.843309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.843319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:34.843330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.843342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.843354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.843365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.843375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.843387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.843393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.843401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:34.843407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.843418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:34.843463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:34.849132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254483257135714:2869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:34.849147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254483257135714:2869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:34.849150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254483257135714:2869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:34.849159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 61 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:34.848752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:34.849527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:34.849534Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:34.849536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:34.849541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:34.849549Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 60 [2:7556254480880276583:2737]
2025-10-01T14:06:34.849567Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:34.849587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:34.849590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.849595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.849597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.849616Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:34.849622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:34.849628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:34.849696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.849698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.849701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.849704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:34.849707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:34.849783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:34.849786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.849799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:34.849810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:34.849827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:34.849848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135753:2869], now have 1 active actors on pipe
2025-10-01T14:06:34.849852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135638:2446], now have 1 active actors on pipe
2025-10-01T14:06:34.849860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254480880276577:2737]
2025-10-01T14:06:34.849862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254480880276577:2737]
2025-10-01T14:06:34.849864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254480880276577:2737]
2025-10-01T14:06:34.849880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:34.849896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:34.849911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:34.849915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:34.849928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:34.849933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:34.849936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:34.849956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254480880276577:2737]
2025-10-01T14:06:34.850092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 60
2025-10-01T14:06:34.849959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:34.849961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:34.850116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 60
2025-10-01T14:06:34.850567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.850580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.850611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:34.850620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:34.850625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:34.850628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:34.850638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:34.850649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:34.850668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.857826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:34.857848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:34.857889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:34.858150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 61 partition: 0 MaxSeqNo: 45 sessionId: src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0
2025-10-01T14:06:34.862484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|135d23a1-20626205-bec62110-ddd37266_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:34.865306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0] Write session: try to update token
2025-10-01T14:06:34.865327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:34.875597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:34.875614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:34.875617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:34.875619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:34.875629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254480880276577:2737]
2025-10-01T14:06:34.875635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254480880276577:2737]
2025-10-01T14:06:34.875639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254480880276577:2737]
2025-10-01T14:06:34.875685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:34.875693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:34.875695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:34.875844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:34.878774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:34.878786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:34.878794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:34.890361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 61 sessionId: src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:34.892980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:34.922049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254483257135760:2506]
2025-10-01T14:06:34.922572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 60, pipe: [1:7556254483257135760:2506]
2025-10-01T14:06:35.035581Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:35.036321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.036338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.036387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254483257135760:2506], now have 1 active actors on pipe
2025-10-01T14:06:35.036880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254483257135760:2506]
2025-10-01T14:06:35.036918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:35.036921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:35.036983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 61 reason: error at write: Disconnected sessionId: src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0
2025-10-01T14:06:35.037175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:35.037226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 61 sessionId: src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0 is DEAD
2025-10-01T14:06:35.036933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:35.037619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:35.037631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0] Write session will restart in 0.009374s
2025-10-01T14:06:35.037661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0] Write session: Do CDS request
2025-10-01T14:06:35.037668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:35.050527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.051237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:35.051250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 62
2025-10-01T14:06:35.051690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.051724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 62 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:35.051729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=62 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:35.051733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:35.052530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:35.052340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 62 sessionId:  describe result for acl check
2025-10-01T14:06:35.052376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:35.052378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:35.052379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:35.052385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254487552103137:2873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:35.052945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254487552103137:2873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:35.055609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254487552103137:2873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:35.054872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:35.055105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:35.055109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:35.055122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:35.055195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:35.055233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254485175243995:2739]
2025-10-01T14:06:35.055817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:35.056609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:35.056671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:35.057042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:35.057131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.057139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.057140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.057141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.057142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.057143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.057145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.057146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.057147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.057148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.057150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.057151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.057152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.057153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.057160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.057170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.057174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.057178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.057182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.057186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.057189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.057193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.057197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.057201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.057204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.057208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.057211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.057215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.057223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.057231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.057238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.057243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.057247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.057252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.057257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.057262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.057268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.057274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.057279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.057284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.057289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.057294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.057298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.057303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.057310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.057315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.057319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.057323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.057328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.057332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.057336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.057341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.057346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.057351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.057354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.057359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.057398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:35.062073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254487552103137:2873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:35.062088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254487552103137:2873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:35.062091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254487552103137:2873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:35.062101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 62 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:35.062721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:35.063421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:35.063437Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:35.063440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:35.063445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:35.063452Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 61 [2:7556254485175243995:2739]
2025-10-01T14:06:35.063474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:35.063494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:35.063498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.063501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.063504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.063522Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:35.063528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:35.063535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:35.063603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.063605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.063608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.063611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:35.063613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:35.063703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:35.063711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.063724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.063739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.063759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:35.063782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103176:2873], now have 1 active actors on pipe
2025-10-01T14:06:35.063789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103059:2446], now have 1 active actors on pipe
2025-10-01T14:06:35.063796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254485175243989:2739]
2025-10-01T14:06:35.063801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254485175243989:2739]
2025-10-01T14:06:35.063803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254485175243989:2739]
2025-10-01T14:06:35.063820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:35.063836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:35.063854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:35.063858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:35.063897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254485175243989:2739]
2025-10-01T14:06:35.063903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:35.063939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:35.063950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:35.063954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:35.063960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:35.063918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 61
2025-10-01T14:06:35.063947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 61
2025-10-01T14:06:35.064098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.064114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.064151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:35.064168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.064189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.064191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:35.064201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.064220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:35.064241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.064660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.064683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.064705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.065298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 62 partition: 0 MaxSeqNo: 45 sessionId: src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0
2025-10-01T14:06:35.065648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8e3ca9b-a8820555-e04ad2fe-e6caf1c6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:35.068522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0] Write session: try to update token
2025-10-01T14:06:35.068540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:35.088559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:35.088579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:35.088581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:35.088583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:35.088592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254485175243989:2739]
2025-10-01T14:06:35.088597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254485175243989:2739]
2025-10-01T14:06:35.088604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254485175243989:2739]
2025-10-01T14:06:35.088651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:35.088661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.088663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:35.088802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:35.090445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:35.090457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:35.090461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:35.091905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 62 sessionId: src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:35.094294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:35.137477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254487552103192:2506]
2025-10-01T14:06:35.137743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 61, pipe: [1:7556254487552103192:2506]
2025-10-01T14:06:35.265962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:35.266441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.266459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.266506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103192:2506], now have 1 active actors on pipe
2025-10-01T14:06:35.267288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:35.267352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:35.267357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:35.267431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 62 reason: error at write: Disconnected sessionId: src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0
2025-10-01T14:06:35.267785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:35.267794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0] Write session will restart in 0.008623s
2025-10-01T14:06:35.267820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0] Write session: Do CDS request
2025-10-01T14:06:35.267827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:35.267607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 62 sessionId: src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0 is DEAD
2025-10-01T14:06:35.267788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254487552103192:2506]
2025-10-01T14:06:35.270588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:35.278397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.279056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:35.279069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 63
2025-10-01T14:06:35.279291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.279324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 63 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:35.279331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=63 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:35.279334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:35.279842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 63 sessionId:  describe result for acl check
2025-10-01T14:06:35.279881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:35.279883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:35.279886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:35.279892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254487552103273:2878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:35.281327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:35.280531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254487552103273:2878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:35.282344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:35.282592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:35.282598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:35.282611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:35.282669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:35.282708Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254485175244115:2742]
2025-10-01T14:06:35.283315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:35.284180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:35.284232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:35.284572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:35.284646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.284647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.284649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.284650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.284652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.284653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.284655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.284656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.284657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.284659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.284660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.284662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.284663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.284664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.284670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.284680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.284684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.284689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.284692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.284697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.284701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.284705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.284708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.284712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.284716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.284720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.284724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.284727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.284735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.284742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.284749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.284753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.284755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.284759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.284761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.284765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.284767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.284771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.284774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.284777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.284782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.284786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.284789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.284792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.284794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.284798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.284800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.284803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.284806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.284809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.284814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.284817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.284819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.284822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.284825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.284828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.284871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:35.286069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254487552103273:2878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:35.289568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:35.290346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:35.290353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:35.290355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:35.290359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:35.290366Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 62 [2:7556254485175244115:2742]
2025-10-01T14:06:35.290659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:35.290691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:35.290695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.290698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.290700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.290718Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:35.290725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:35.290732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:35.290800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.290803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.290805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.290809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:35.290812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:35.290892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:35.290895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.290910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.290921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.290938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:35.290958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103198:2446], now have 1 active actors on pipe
2025-10-01T14:06:35.290967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254485175244110:2742]
2025-10-01T14:06:35.290969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254485175244110:2742]
2025-10-01T14:06:35.290971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254485175244110:2742]
2025-10-01T14:06:35.290987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:35.291001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:35.291005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:35.291010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:35.291013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:35.291017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:35.291020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:35.291064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254485175244110:2742]
2025-10-01T14:06:35.291074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:35.291548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 62
2025-10-01T14:06:35.291254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:35.293216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254487552103273:2878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:35.293235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254487552103273:2878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:35.293239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254487552103273:2878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:35.293248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 63 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:35.293740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103316:2878], now have 1 active actors on pipe
2025-10-01T14:06:35.293833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 62
2025-10-01T14:06:35.293975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.293989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.294019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2080864-1946ce15-10ff191a-3541b0dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:35.294030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.294036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.294039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:35.294053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.294071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:35.294088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.294557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.294571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.294606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.294761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 63 partition: 0 MaxSeqNo: 45 sessionId: src_id|e2080864-1946ce15-10ff191a-3541b0dc_0
2025-10-01T14:06:35.295164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8cd201c-641a18d1-1ef1b302-a7536980_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e2080864-1946ce15-10ff191a-3541b0dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:35.298053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2080864-1946ce15-10ff191a-3541b0dc_0] Write session: try to update token
2025-10-01T14:06:35.298074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2080864-1946ce15-10ff191a-3541b0dc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:35.317107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:35.317123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:35.317126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:35.317128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:35.317140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254485175244110:2742]
2025-10-01T14:06:35.317146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254485175244110:2742]
2025-10-01T14:06:35.317150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254485175244110:2742]
2025-10-01T14:06:35.317203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:35.317212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.317215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:35.317376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:35.317823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 63 sessionId: src_id|e2080864-1946ce15-10ff191a-3541b0dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:35.319805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:35.319822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:35.319826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:35.320430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:35.370595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254487552103322:2506]
2025-10-01T14:06:35.371626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 62, pipe: [1:7556254487552103322:2506]
2025-10-01T14:06:35.475877Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:35.476362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.476380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.476429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103322:2506], now have 1 active actors on pipe
2025-10-01T14:06:35.476784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:35.478783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2080864-1946ce15-10ff191a-3541b0dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:35.478793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2080864-1946ce15-10ff191a-3541b0dc_0] Write session will restart in 0.006169s
2025-10-01T14:06:35.478819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2080864-1946ce15-10ff191a-3541b0dc_0] Write session: Do CDS request
2025-10-01T14:06:35.478827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2080864-1946ce15-10ff191a-3541b0dc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:35.476774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254487552103322:2506]
2025-10-01T14:06:35.476807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:35.476854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:35.476857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:35.476917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 63 reason: error at write: Disconnected sessionId: src_id|e2080864-1946ce15-10ff191a-3541b0dc_0
2025-10-01T14:06:35.477142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 63 sessionId: src_id|e2080864-1946ce15-10ff191a-3541b0dc_0 is DEAD
2025-10-01T14:06:35.486910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2080864-1946ce15-10ff191a-3541b0dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.491977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:35.491993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 64
2025-10-01T14:06:35.495687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.495741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 64 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:35.495746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=64 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:35.495752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:35.496209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 64 sessionId:  describe result for acl check
2025-10-01T14:06:35.496246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:35.496247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:35.496249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:35.496255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254487552103404:2882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:35.496763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254487552103404:2882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:35.497903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:35.499182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:35.499398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:35.499402Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:35.499415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:35.499467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:35.499517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254485175244237:2745]
2025-10-01T14:06:35.500138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:35.500258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254487552103404:2882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:35.500832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:35.500900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:35.501253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:35.501319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.501320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.501321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.501322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.501323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.501324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.501325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.501326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.501327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.501328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.501330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.501330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.501331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.501333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.501339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.501348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.501351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.501356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.501359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.501362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.501367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.501370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.501374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.501378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.501381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.501384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.501387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.501391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.501397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.501405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.501412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.501416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.501421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.501425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.501430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.501434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.501439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.501444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.501449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.501455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.501460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.501465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.501469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.501473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.501477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.501483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.501486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.501491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.501495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.501501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.501504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.501509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.501514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.501519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.501523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.501528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.501567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:35.504173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254487552103404:2882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:35.504188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254487552103404:2882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:35.504192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254487552103404:2882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:35.504200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 64 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:35.510801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:35.511497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:35.511513Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:35.511516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:35.511520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:35.511528Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 63 [2:7556254485175244237:2745]
2025-10-01T14:06:35.511545Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:35.511568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:35.511575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.511579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.511581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.511599Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:35.511605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:35.511612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:35.511678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.511686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.511688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.511692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:35.511695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:35.511774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:35.511781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.511793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.511805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.511820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:35.511841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254485175244232:2745]
2025-10-01T14:06:35.511847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254485175244232:2745]
2025-10-01T14:06:35.511851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254485175244232:2745]
2025-10-01T14:06:35.511865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:35.511884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:35.511901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:35.511908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:35.511950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254485175244232:2745]
2025-10-01T14:06:35.511956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:35.512055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:35.512062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:35.512064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:35.512069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:35.512353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103444:2882], now have 1 active actors on pipe
2025-10-01T14:06:35.512362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103325:2446], now have 1 active actors on pipe
2025-10-01T14:06:35.512408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 63
2025-10-01T14:06:35.512434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 63
2025-10-01T14:06:35.512670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.512683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.512713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:35.512725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.512730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.512732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:35.512744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.512758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:35.512779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.513053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.513061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.513084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.513233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 64 partition: 0 MaxSeqNo: 45 sessionId: src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0
2025-10-01T14:06:35.513596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2080864-1946ce15-10ff191a-3541b0dc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:35.516467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0] Write session: try to update token
2025-10-01T14:06:35.516489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:35.553901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 64 sessionId: src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:35.557053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:35.557451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.557474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.557497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:35.557499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:35.557501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:35.557503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:35.557512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254485175244232:2745]
2025-10-01T14:06:35.557517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254485175244232:2745]
2025-10-01T14:06:35.557520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254485175244232:2745]
2025-10-01T14:06:35.557562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:35.557567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:35.557570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:35.557580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:35.557586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.557588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:35.557722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:35.576909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254487552103467:2506]
2025-10-01T14:06:35.577506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 63, pipe: [1:7556254487552103467:2506]
2025-10-01T14:06:35.721395Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:35.722320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:35.722401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103467:2506], now have 1 active actors on pipe
2025-10-01T14:06:35.722596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:35.722649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:35.722693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254487552103467:2506]
2025-10-01T14:06:35.722703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:35.722706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:35.722780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 64 reason: error at write: Disconnected sessionId: src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0
2025-10-01T14:06:35.722926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 64 sessionId: src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0 is DEAD
2025-10-01T14:06:35.723143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:35.723154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0] Write session will restart in 0.009489s
2025-10-01T14:06:35.723180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0] Write session: Do CDS request
2025-10-01T14:06:35.723190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:35.731972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:35.732402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:35.732575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:35.732585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:35.732595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:35.732631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:35.732669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254485175244403:2760]
2025-10-01T14:06:35.733226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:35.733472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:35.733509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:35.733801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:35.733851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.733857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.733859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.733859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.733860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.733861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.733863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.733863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.733864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.733865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.733866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.733867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.733868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.733869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.733873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.733881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.733884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.733887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.733890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.733894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.733900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.733903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.733906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.733909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.733915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.733912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.733916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.733919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.733922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.733928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.733935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.733941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.733945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.733949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.733954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.733957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.733961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.733966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.733970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.733974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.733978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.733982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.733987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.733990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.733994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.733998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.734002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.734006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.734010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.734014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.734019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.734022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.734027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.734031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.734035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.734043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.734048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.734055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:35.734067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 65
2025-10-01T14:06:35.734082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:35.734194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.734222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 65 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:35.734231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=65 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:35.734234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:35.734545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 65 sessionId:  describe result for acl check
2025-10-01T14:06:35.734576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:35.734581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:35.734583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:35.734588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254487552103575:2895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:35.735065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254487552103575:2895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:35.737010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254487552103575:2895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:35.737751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:35.739527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254487552103575:2895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:35.739540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254487552103575:2895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:35.739544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254487552103575:2895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:35.739552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 65 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:35.740558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:35.740574Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:35.740577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:35.740580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:35.740588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 64 [2:7556254485175244403:2760]
2025-10-01T14:06:35.740603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:35.740618Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:35.740625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.740629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.740631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.740649Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:35.740658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:35.740663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:35.740990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.740997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.740999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.741003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:35.741005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:35.741080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:35.741086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.741097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.741111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.741132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:35.741196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 64
2025-10-01T14:06:35.741223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 64
2025-10-01T14:06:35.741154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103609:2895], now have 1 active actors on pipe
2025-10-01T14:06:35.741164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103491:2446], now have 1 active actors on pipe
2025-10-01T14:06:35.741172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254485175244398:2760]
2025-10-01T14:06:35.741174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254485175244398:2760]
2025-10-01T14:06:35.741175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254485175244398:2760]
2025-10-01T14:06:35.741190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:35.741203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:35.741212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:35.741215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:35.741216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:35.741217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:35.741219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:35.741255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254485175244398:2760]
2025-10-01T14:06:35.741258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:35.741260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:35.741276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.741280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.741327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:35.741337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.741341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.741343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:35.741352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.741360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:35.741379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.741516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.741528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.741547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.741612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 65 partition: 0 MaxSeqNo: 45 sessionId: src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0
2025-10-01T14:06:35.741966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f7bbf54-940dfd9c-8114bf51-b1cc0b65_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:35.760496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0] Write session: try to update token
2025-10-01T14:06:35.760518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:35.763040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:35.763059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:35.763061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:35.763063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:35.763074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254485175244398:2760]
2025-10-01T14:06:35.763078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254485175244398:2760]
2025-10-01T14:06:35.763082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254485175244398:2760]
2025-10-01T14:06:35.763135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:35.763134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:35.763140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:35.763144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:35.763146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.763148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:35.763618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:35.793910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 65 sessionId: src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:35.796623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:35.822639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254487552103620:2506]
2025-10-01T14:06:35.822960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 64, pipe: [1:7556254487552103620:2506]
2025-10-01T14:06:35.912433Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:35.913068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.913088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.913111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103620:2506], now have 1 active actors on pipe
2025-10-01T14:06:35.913351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:35.913858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:35.913872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0] Write session will restart in 0.009020s
2025-10-01T14:06:35.913915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0] Write session: Do CDS request
2025-10-01T14:06:35.913922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:35.913431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:35.913442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:35.913501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 65 reason: error at write: Disconnected sessionId: src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0
2025-10-01T14:06:35.913691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 65 sessionId: src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0 is DEAD
2025-10-01T14:06:35.913865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254487552103620:2506]
2025-10-01T14:06:35.913879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:35.927442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.928864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:35.928880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 66
2025-10-01T14:06:35.929075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:35.929109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 66 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:35.929119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=66 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:35.929123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:35.929610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 66 sessionId:  describe result for acl check
2025-10-01T14:06:35.929651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:35.929653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:35.929655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:35.929660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254487552103648:2899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:35.930214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254487552103648:2899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:35.934578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254487552103648:2899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:35.937814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254487552103648:2899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:35.937834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254487552103648:2899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:35.937838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254487552103648:2899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:35.937848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 66 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:35.947798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:35.951667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:35.951935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:35.951950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:35.951975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:35.952045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:35.952086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254485175244525:2762]
2025-10-01T14:06:35.952707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:35.954551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:35.954632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:35.955080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:35.955150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.955152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.955154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.955155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.955157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.955159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.955160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.955161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.955162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.955163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.955168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.955170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.955171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.955172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.955178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.955189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.955193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.955196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.955199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.955203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.955206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.955210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.955213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.955217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.955220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.955223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.955227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.955230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.955238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.955247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:35.955254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.955260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:35.955265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.955270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:35.955273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.955282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:35.955286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.955291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:35.955296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.955300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:35.955305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.955314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:35.955318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.955322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:35.955326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.955331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:35.955335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.955340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.955345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.955350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.955353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.955358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.955363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.955368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:35.955373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.955379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:35.955424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:35.963155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 65
2025-10-01T14:06:35.963202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 65
2025-10-01T14:06:35.964581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 66 partition: 0 MaxSeqNo: 45 sessionId: src_id|50ece936-1defe7dc-803925b3-37122867_0
2025-10-01T14:06:35.965500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a2660-89cfabc4-8cb0caeb-6c1b502e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50ece936-1defe7dc-803925b3-37122867_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:35.960657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:35.962149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:35.962159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:35.962162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:35.962169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:35.962178Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 65 [2:7556254485175244525:2762]
2025-10-01T14:06:35.962201Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:35.962224Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:35.962228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.962231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.962234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.962255Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:35.962261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:35.962269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:35.962348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.962350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.962352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.962355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:35.962358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:35.962456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:35.962460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.962478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:35.962489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:35.962506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:35.962524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254485175244520:2762]
2025-10-01T14:06:35.962527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254485175244520:2762]
2025-10-01T14:06:35.962529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254485175244520:2762]
2025-10-01T14:06:35.962544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:35.962558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:35.962577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:35.962579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:35.962627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254485175244520:2762]
2025-10-01T14:06:35.962629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:35.962710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:35.962713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:35.962715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:35.962720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:35.963476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103736:2899], now have 1 active actors on pipe
2025-10-01T14:06:35.963481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254487552103622:2446], now have 1 active actors on pipe
2025-10-01T14:06:35.963848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.963854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.963885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50ece936-1defe7dc-803925b3-37122867_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:35.963894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:35.963900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:35.963902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:35.963914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:35.963927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:35.963947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.964436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:35.964440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:35.964458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:35.968106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ece936-1defe7dc-803925b3-37122867_0] Write session: try to update token
2025-10-01T14:06:35.968127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ece936-1defe7dc-803925b3-37122867_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:35.987719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:35.987739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:35.987741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:35.987743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:35.987753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254485175244520:2762]
2025-10-01T14:06:35.987756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254485175244520:2762]
2025-10-01T14:06:35.987759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254485175244520:2762]
2025-10-01T14:06:35.987799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:35.987805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:35.987807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:35.988011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:35.990731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:35.990741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:35.990746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:36.001553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 66 sessionId: src_id|50ece936-1defe7dc-803925b3-37122867_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:36.004403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:36.014144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254491847071046:2506]
2025-10-01T14:06:36.014549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 65, pipe: [1:7556254491847071046:2506]
2025-10-01T14:06:36.137627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:36.139705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.139735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.139761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071046:2506], now have 1 active actors on pipe
2025-10-01T14:06:36.141771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:36.141784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:36.141880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 66 reason: error at write: Disconnected sessionId: src_id|50ece936-1defe7dc-803925b3-37122867_0
2025-10-01T14:06:36.142121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 66 sessionId: src_id|50ece936-1defe7dc-803925b3-37122867_0 is DEAD
2025-10-01T14:06:36.142462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254491847071046:2506]
2025-10-01T14:06:36.142484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:36.141524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:36.143018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ece936-1defe7dc-803925b3-37122867_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:36.143034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ece936-1defe7dc-803925b3-37122867_0] Write session will restart in 0.008483s
2025-10-01T14:06:36.143098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ece936-1defe7dc-803925b3-37122867_0] Write session: Do CDS request
2025-10-01T14:06:36.143105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ece936-1defe7dc-803925b3-37122867_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:36.154909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ece936-1defe7dc-803925b3-37122867_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:36.155026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:36.155039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 67
2025-10-01T14:06:36.155273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:36.155309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 67 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:36.155319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=67 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:36.155322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:36.156088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 67 sessionId:  describe result for acl check
2025-10-01T14:06:36.156133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:36.156139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:36.156140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:36.156146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254491847071068:2904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:36.156786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254491847071068:2904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:36.161401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254491847071068:2904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:36.173386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254491847071068:2904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:36.173402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254491847071068:2904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:36.173406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254491847071068:2904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:36.173416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 67 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:36.173458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:36.176881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:36.177233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:36.177238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:36.177252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:36.177313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:36.177357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254489470211946:2765]
2025-10-01T14:06:36.178105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:36.183465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:36.183532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:36.183986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:36.184064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.184066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.184067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.184068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.184070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.184071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.184073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.184074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.184075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.184077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.184078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.184079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.184080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.184081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.184088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.184097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.184101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.184104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.184108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.184111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.184114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.184116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.184120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.184124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.184127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.184130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.184134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.184137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.184145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.184153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.184158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.184163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.184170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.184175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.184179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.184183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.184189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.184194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.184198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.184203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.184207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.184212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.184216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.184220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.184224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.184228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.184232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.184236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.184243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.184247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.184251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.184255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.184259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.184263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.184267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.184271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.184305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:36.190885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:36.192074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:36.192096Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:36.192099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:36.192104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:36.192116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 66 [2:7556254489470211946:2765]
2025-10-01T14:06:36.192134Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:36.192151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:36.192153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.192155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.192156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.192171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:36.192175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:36.192180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:36.192237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.192246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.192248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.192252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:36.192254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:36.192313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:36.192320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.192329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.192335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.192344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:36.192360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254489470211939:2765]
2025-10-01T14:06:36.192367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254489470211939:2765]
2025-10-01T14:06:36.192368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254489470211939:2765]
2025-10-01T14:06:36.192392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:36.192407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:36.192421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:36.192425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:36.192428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:36.192430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:36.192432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:36.192460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254489470211939:2765]
2025-10-01T14:06:36.192466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:36.192504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:36.192571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071172:2904], now have 1 active actors on pipe
2025-10-01T14:06:36.192578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071054:2446], now have 1 active actors on pipe
2025-10-01T14:06:36.192797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 66
2025-10-01T14:06:36.192819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 66
2025-10-01T14:06:36.193069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.193086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.193116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:36.193131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.193136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.193139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:36.193149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.193165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:36.193183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:36.193674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.193686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.193703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:36.193829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 67 partition: 0 MaxSeqNo: 45 sessionId: src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0
2025-10-01T14:06:36.196225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ece936-1defe7dc-803925b3-37122867_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:36.199707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0] Write session: try to update token
2025-10-01T14:06:36.199724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:36.245274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254491847071182:2506]
2025-10-01T14:06:36.246544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071182:2506], now have 1 active actors on pipe
2025-10-01T14:06:36.246870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 66, pipe: [1:7556254491847071182:2506]
2025-10-01T14:06:36.250269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 67 sessionId: src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:36.252912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:36.254132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.254155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.254191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:36.255271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:36.258952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:36.258970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:36.258973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:36.258975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:36.258986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254489470211939:2765]
2025-10-01T14:06:36.258991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254489470211939:2765]
2025-10-01T14:06:36.258995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254489470211939:2765]
2025-10-01T14:06:36.259048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:36.259056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.259059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:36.259225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:36.259237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:36.259241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:36.259380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:36.444599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:36.454827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.454858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.455050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.455119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.455206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.455279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.455332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.455345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.455449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.455515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.455620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.455692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.455739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.455750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.455847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.455932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.456002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.456064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.456105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.456109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.456210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.456272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.456399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.456459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.456526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.456529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.456595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.456754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.456875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.456981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.457043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.457046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.457130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.457305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.457379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.457550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.457599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.457602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.457726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.457832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.457939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.458039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.458088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.458091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.458192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.458295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.458361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.458679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.458826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.458836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.458910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.458975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.459040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.459111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.459437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.459441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.459513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.459575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.459638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.459706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.459799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.459802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.461471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:36.461820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254491847071182:2506]
2025-10-01T14:06:36.461858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:36.461894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 67 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0
2025-10-01T14:06:36.462122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 67 sessionId: src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0 is DEAD
2025-10-01T14:06:36.462467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:36.462831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:36.462839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0] Write session will restart in 0.006695s
2025-10-01T14:06:36.462880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0] Write session: Do CDS request
2025-10-01T14:06:36.462887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:36.476111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:36.477428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:36.477441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 68
2025-10-01T14:06:36.477720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:36.477753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 68 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:36.477760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=68 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:36.477763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:36.478170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 68 sessionId:  describe result for acl check
2025-10-01T14:06:36.478197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:36.478198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:36.478200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:36.478205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254491847071253:2908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:36.478697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254491847071253:2908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:36.481842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254491847071253:2908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:36.484314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254491847071253:2908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:36.484327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254491847071253:2908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:36.484331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254491847071253:2908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:36.484339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 68 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:36.485412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:36.486706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:36.486920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:36.486924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:36.486935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:36.486977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:36.487011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254489470212072:2768]
2025-10-01T14:06:36.487550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:36.488026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:36.488065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:36.488342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:36.488391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.488391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.488392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.488393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.488395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.488396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.488396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.488398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.488399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.488400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.488401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.488402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.488403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.488404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.488408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.488416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.488419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.488422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.488425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.488428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.488431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.488433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.488437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.488440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.488443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.488446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.488449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.488452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.488459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.488466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.488472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.488476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.488480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.488484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.488489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.488493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.488497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.488501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.488504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.488508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.488512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.488516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.488520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.488523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.488527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.488531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.488535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.488539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.488542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.488546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.488549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.488553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.488557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.488560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.488564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.488568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.488602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:36.495869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:36.496641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:36.496648Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:36.496651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:36.496655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:36.496663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 67 [2:7556254489470212072:2768]
2025-10-01T14:06:36.496679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:36.496700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:36.496703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.496707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.496709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.496728Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:36.496733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:36.496739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:36.496797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.496799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.496801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.496804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:36.496807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:36.496900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:36.496902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.496916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.496925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.496940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:36.496958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254489470212066:2768]
2025-10-01T14:06:36.496960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254489470212066:2768]
2025-10-01T14:06:36.496962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254489470212066:2768]
2025-10-01T14:06:36.496972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:36.496987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:36.497000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:36.497003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:36.497025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:36.497029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:36.497031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:36.497041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254489470212066:2768]
2025-10-01T14:06:36.497044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:36.497054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:36.497075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071189:2446], now have 1 active actors on pipe
2025-10-01T14:06:36.497078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071303:2908], now have 1 active actors on pipe
2025-10-01T14:06:36.497314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 67
2025-10-01T14:06:36.497352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 67
2025-10-01T14:06:36.497550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.497561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.497589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:36.497597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.497602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.497605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:36.497614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.497626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:36.497643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:36.497828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.497838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.497863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:36.497993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 68 partition: 0 MaxSeqNo: 45 sessionId: src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0
2025-10-01T14:06:36.498343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bf746f2-2a10b3c0-c1bbf697-28848cf6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:36.500979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0] Write session: try to update token
2025-10-01T14:06:36.500998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:36.518240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 68 sessionId: src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:36.521070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:36.521864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.521890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.521928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:36.522215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:36.538162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:36.538178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:36.538180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:36.538182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:36.538191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254489470212066:2768]
2025-10-01T14:06:36.538195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254489470212066:2768]
2025-10-01T14:06:36.538199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254489470212066:2768]
2025-10-01T14:06:36.538244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:36.538252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.538259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:36.538440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:36.538572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:36.538584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:36.538588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:36.561971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254491847071320:2506]
2025-10-01T14:06:36.562345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 67, pipe: [1:7556254491847071320:2506]
2025-10-01T14:06:36.691192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:36.697930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.697954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.698103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.698190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.698248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.698307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.698347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.698354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.698432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.698487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.698543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.698609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.698660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.698666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.698741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.698833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.698900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.698964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.699007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.699012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.699075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.699135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.699194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.699282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.699325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.699330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.699390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.699440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.699496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.699550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.699588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.699593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.699657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.699713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.699769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.699829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.699888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.699893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.699968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.700022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.700096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.700178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.700229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.700235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.700299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.700354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.700411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.700466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.700507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.700512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.700572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.700624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.700686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.700742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.701087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.701094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.701155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.701211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.701267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.701323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.701384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.701391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.701459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071320:2506], now have 1 active actors on pipe
2025-10-01T14:06:36.701742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:36.701772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254491847071320:2506]
2025-10-01T14:06:36.701787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:36.701790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:36.701815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 68 reason: error at write: Disconnected sessionId: src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0
2025-10-01T14:06:36.701968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 68 sessionId: src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0 is DEAD
2025-10-01T14:06:36.702094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:36.702104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0] Write session will restart in 0.009944s
2025-10-01T14:06:36.702159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0] Write session: Do CDS request
2025-10-01T14:06:36.702165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:36.702281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:36.711571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:36.712221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:36.712386Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:36.712395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:36.712406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:36.712457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:36.712496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254489470212242:2783]
2025-10-01T14:06:36.712877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:36.713005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:36.713018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 69
2025-10-01T14:06:36.713057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:36.713136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:36.713165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 69 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:36.713170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=69 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:36.713177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:36.713298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:36.713339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:36.713500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 69 sessionId:  describe result for acl check
2025-10-01T14:06:36.713531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:36.713538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:36.713540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:36.713544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254491847071446:2921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:36.713616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:36.713680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.713685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.713687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.713687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.713688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.713689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.713690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.713691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.713692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.713693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.713694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.713694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.713695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.713696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.713701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.713709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.713712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.713715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.713718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.713721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.713725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.713728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.713731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.713734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.713737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.713741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.713743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.713747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.713755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.713762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.713767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.713771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.713775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.713779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.713783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.713789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.713793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.713798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.713802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.713806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.713811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.713815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.713819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.713828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.713832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.713841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.713845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.713849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.713857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.713862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.713869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.713874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.713881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.713886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.713890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.713894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.713934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:36.713994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254491847071446:2921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:36.715692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254491847071446:2921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:36.720655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254491847071446:2921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:36.720669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254491847071446:2921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:36.720673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254491847071446:2921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:36.720681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 69 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:36.720960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:36.721574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:36.721587Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:36.721590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:36.721593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:36.721599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 68 [2:7556254489470212242:2783]
2025-10-01T14:06:36.721616Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:36.721634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:36.721641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.721644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.721647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.721661Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:36.721667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:36.721678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:36.721728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.721734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.721736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.721739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:36.721742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:36.721804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:36.721811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.721823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.721841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.721858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:36.721875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071359:2446], now have 1 active actors on pipe
2025-10-01T14:06:36.721882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071479:2921], now have 1 active actors on pipe
2025-10-01T14:06:36.721889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254489470212237:2783]
2025-10-01T14:06:36.721892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254489470212237:2783]
2025-10-01T14:06:36.721894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254489470212237:2783]
2025-10-01T14:06:36.721909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:36.721925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:36.721933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:36.721936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:36.721937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:36.721943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:36.721946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:36.721918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 68
2025-10-01T14:06:36.721937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 68
2025-10-01T14:06:36.721976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254489470212237:2783]
2025-10-01T14:06:36.721983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:36.721985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:36.722003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.722012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.722076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d962dcb-68728d70-2078f7b-1c883de1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:36.722087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.722090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.722093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:36.722101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.722109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:36.722126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:36.722265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.722278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.722301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:36.722420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 69 partition: 0 MaxSeqNo: 45 sessionId: src_id|2d962dcb-68728d70-2078f7b-1c883de1_0
2025-10-01T14:06:36.722786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12e3a6a5-8b585a45-1e00fde4-cca864f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2d962dcb-68728d70-2078f7b-1c883de1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:36.725393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d962dcb-68728d70-2078f7b-1c883de1_0] Write session: try to update token
2025-10-01T14:06:36.725410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d962dcb-68728d70-2078f7b-1c883de1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:36.743798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 69 sessionId: src_id|2d962dcb-68728d70-2078f7b-1c883de1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:36.749032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:36.749547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.749586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.749637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:36.749765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:36.763098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:36.763119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:36.763121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:36.763123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:36.763136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254489470212237:2783]
2025-10-01T14:06:36.763140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254489470212237:2783]
2025-10-01T14:06:36.763145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254489470212237:2783]
2025-10-01T14:06:36.763191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:36.763194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:36.763198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:36.763200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.763201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:36.763203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:36.763507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:36.803322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254491847071488:2506]
2025-10-01T14:06:36.803801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 68, pipe: [1:7556254491847071488:2506]
2025-10-01T14:06:36.921166Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:36.929828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.929851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.930066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.930148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.930207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.930272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.930322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.930332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.930413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.930479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.930533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.930591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.930637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.930643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.930710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.930770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.930853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.930924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.930971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.930977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.931070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.931161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.931235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.931308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.931359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.931365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.931489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.931558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.931628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.931691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.931734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.931739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.931805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.931864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.931926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.931990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.932040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.932046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.932113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.932172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.932234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.932304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.932355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.932361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.932420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.932478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.932542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.932597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.932727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.932733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.932797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.932862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.932920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.932975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.933018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.933023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.933089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:36.933145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:36.933205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:36.933267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:36.933392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:36.933398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:36.933483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071488:2506], now have 1 active actors on pipe
2025-10-01T14:06:36.933748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:36.933774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254491847071488:2506]
2025-10-01T14:06:36.933806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:36.933813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:36.933834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 69 reason: error at write: Disconnected sessionId: src_id|2d962dcb-68728d70-2078f7b-1c883de1_0
2025-10-01T14:06:36.934050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 69 sessionId: src_id|2d962dcb-68728d70-2078f7b-1c883de1_0 is DEAD
2025-10-01T14:06:36.934173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d962dcb-68728d70-2078f7b-1c883de1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:36.934183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d962dcb-68728d70-2078f7b-1c883de1_0] Write session will restart in 0.005190s
2025-10-01T14:06:36.934207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d962dcb-68728d70-2078f7b-1c883de1_0] Write session: Do CDS request
2025-10-01T14:06:36.934214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d962dcb-68728d70-2078f7b-1c883de1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:36.934562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:36.940898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d962dcb-68728d70-2078f7b-1c883de1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:36.941028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:36.941045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 70
2025-10-01T14:06:36.941149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:36.941179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 70 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:36.941190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=70 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:36.941195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:36.941530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 70 sessionId:  describe result for acl check
2025-10-01T14:06:36.941560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:36.941565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:36.941566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:36.941569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254491847071517:2925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:36.942058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254491847071517:2925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:36.944442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254491847071517:2925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:36.944925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:36.945338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:36.945502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:36.945514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:36.945523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:36.945564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:36.945600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254489470212366:2785]
2025-10-01T14:06:36.946105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:36.946355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:36.946402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:36.946698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:36.946748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.946753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.946754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.946755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.946756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.946757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.946758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.946759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.946760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.946760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.946761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.946762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.946763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.946764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.946767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.946775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.946779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.946782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.946785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.946788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.946791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.946794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.946797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.946801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.946804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.946807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.946809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.946812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.946819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.946826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:36.946831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.946835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:36.946839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.946844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:36.946848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.946852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:36.946856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.946861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:36.946864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.946868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:36.946872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.946876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:36.946880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.946884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:36.946888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.946892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:36.946895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.946899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.946903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.946907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.946911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.946915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.946919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.946929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:36.946932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.946937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:36.946973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:36.947085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254491847071517:2925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:36.947098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254491847071517:2925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:36.947101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254491847071517:2925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:36.947109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 70 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:36.952617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:36.953238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:36.953251Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:36.953252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:36.953255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:36.953265Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 69 [2:7556254489470212366:2785]
2025-10-01T14:06:36.953279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:36.953295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:36.953300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.953303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.953304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.953317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:36.953324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:36.953328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:36.953369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.953374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.953375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.953377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:36.953379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:36.953446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:36.953451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.953458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:36.953464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:36.953476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:36.953492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071489:2446], now have 1 active actors on pipe
2025-10-01T14:06:36.953498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254491847071614:2925], now have 1 active actors on pipe
2025-10-01T14:06:36.953506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254489470212361:2785]
2025-10-01T14:06:36.953508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254489470212361:2785]
2025-10-01T14:06:36.953510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254489470212361:2785]
2025-10-01T14:06:36.953520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:36.953533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:36.953535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:36.953542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:36.953544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:36.953545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:36.953546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:36.953571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254489470212361:2785]
2025-10-01T14:06:36.953584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:36.953583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 69
2025-10-01T14:06:36.953603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 69
2025-10-01T14:06:36.953617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:36.953668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.953676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.953701Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|547b6c07-a301bba5-8413d62d-e8c213_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:36.953710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:36.953718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:36.953720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:36.953730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:36.953741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:36.953757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:36.953951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.953959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.953974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:36.954059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 70 partition: 0 MaxSeqNo: 45 sessionId: src_id|547b6c07-a301bba5-8413d62d-e8c213_0
2025-10-01T14:06:36.954405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d962dcb-68728d70-2078f7b-1c883de1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|547b6c07-a301bba5-8413d62d-e8c213_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:36.956766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547b6c07-a301bba5-8413d62d-e8c213_0] Write session: try to update token
2025-10-01T14:06:36.956783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547b6c07-a301bba5-8413d62d-e8c213_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:36.971533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 70 sessionId: src_id|547b6c07-a301bba5-8413d62d-e8c213_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:36.974094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:36.974309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:36.974330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:36.974380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:36.974855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:36.979824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:36.979842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:36.979845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:36.979846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:36.979856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254489470212361:2785]
2025-10-01T14:06:36.979862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254489470212361:2785]
2025-10-01T14:06:36.979866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254489470212361:2785]
2025-10-01T14:06:36.979910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:36.979918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:36.979923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:36.979924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:36.979926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:36.979928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:36.980077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:37.034323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254496142038920:2506]
2025-10-01T14:06:37.034703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 69, pipe: [1:7556254496142038920:2506]
2025-10-01T14:06:37.136166Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:37.144757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.144791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.144988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.145047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.145110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.145174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.145224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.145232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.145306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.145372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.145432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.145493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.145534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.145537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.145600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.145653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.145715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.145769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.145808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.145811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.145873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.145927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.145983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.146036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.146075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.146078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.146169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.146225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.146280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.146343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.146645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.146657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.146732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.146805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.146879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.146950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.147001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.147009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.147086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.147160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.147238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.147310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.147608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.147617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.147697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.147773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.147841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.147905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.148262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.148272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.148344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.148407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.148474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.148539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.148585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.148593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.148659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.148719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.148781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.148865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.148930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.148939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.149038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142038920:2506], now have 1 active actors on pipe
2025-10-01T14:06:37.149528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:37.149587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254496142038920:2506]
2025-10-01T14:06:37.150070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:37.150081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:37.150104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 70 reason: error at write: Disconnected sessionId: src_id|547b6c07-a301bba5-8413d62d-e8c213_0
2025-10-01T14:06:37.150288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 70 sessionId: src_id|547b6c07-a301bba5-8413d62d-e8c213_0 is DEAD
2025-10-01T14:06:37.150167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:37.150783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547b6c07-a301bba5-8413d62d-e8c213_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:37.150793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547b6c07-a301bba5-8413d62d-e8c213_0] Write session will restart in 0.006392s
2025-10-01T14:06:37.150820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547b6c07-a301bba5-8413d62d-e8c213_0] Write session: Do CDS request
2025-10-01T14:06:37.150826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547b6c07-a301bba5-8413d62d-e8c213_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:37.157915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547b6c07-a301bba5-8413d62d-e8c213_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:37.158427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:37.158447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 71
2025-10-01T14:06:37.158660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:37.158692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 71 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:37.158699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=71 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:37.158707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:37.159329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 71 sessionId:  describe result for acl check
2025-10-01T14:06:37.159368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:37.159376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:37.159380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:37.159386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254496142038935:2932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:37.159956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254496142038935:2932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:37.162343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254496142038935:2932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:37.168110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254496142038935:2932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:37.168127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254496142038935:2932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:37.168131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254496142038935:2932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:37.168140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 71 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:37.177883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:37.180823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:37.181092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:37.181103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:37.181115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:37.181173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:37.181217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254493765179793:2788]
2025-10-01T14:06:37.181810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:37.182178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:37.182237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:37.182573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:37.182652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.182653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.182654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.182655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.182656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.182658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.182659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.182660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.182661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.182663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.182664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.182665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.182666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.182667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.182672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.182682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.182685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.182688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.182692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.182695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.182700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.182703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.182707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.182712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.182715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.182719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.182723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.182727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.182735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.182744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.182750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.182755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.182759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.182764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.182767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.182772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.182777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.182782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.182787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.182792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.182797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.182802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.182807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.182812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.182816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.182821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.182825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.182830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.182834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.182839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.182843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.182856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.182861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.182866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.182870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.182875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.182912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:37.191855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:37.192539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:37.192553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:37.192556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:37.192560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:37.192570Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 70 [2:7556254493765179793:2788]
2025-10-01T14:06:37.192586Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:37.192603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:37.192606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.192610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.192618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.192634Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:37.192639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:37.192645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:37.192696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.192701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.192704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.192707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:37.192709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:37.192780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:37.192782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.192793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.192801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.192815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:37.192831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254493765179787:2788]
2025-10-01T14:06:37.192833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254493765179787:2788]
2025-10-01T14:06:37.192834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254493765179787:2788]
2025-10-01T14:06:37.192876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:37.192878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:37.192878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:37.192881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:37.192894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:37.192908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:37.192911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:37.192922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039008:2932], now have 1 active actors on pipe
2025-10-01T14:06:37.192926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142038928:2446], now have 1 active actors on pipe
2025-10-01T14:06:37.192963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254493765179787:2788]
2025-10-01T14:06:37.192978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:37.193053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 70
2025-10-01T14:06:37.193057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 70
2025-10-01T14:06:37.193004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:37.193143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.193147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.193170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cde022f-ace689a9-3723a83d-86c23657_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:37.193181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.193185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.193187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:37.193195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.193207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:37.193225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:37.193351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.193359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.193372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:37.193471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 71 partition: 0 MaxSeqNo: 45 sessionId: src_id|1cde022f-ace689a9-3723a83d-86c23657_0
2025-10-01T14:06:37.194573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547b6c07-a301bba5-8413d62d-e8c213_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1cde022f-ace689a9-3723a83d-86c23657_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:37.197454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cde022f-ace689a9-3723a83d-86c23657_0] Write session: try to update token
2025-10-01T14:06:37.197474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cde022f-ace689a9-3723a83d-86c23657_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:37.220468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:37.220490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:37.220502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254493765179787:2788]
2025-10-01T14:06:37.220554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:37.220651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:37.220897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:37.221055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:37.221203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:37.221345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:37.221557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:37.221595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:37.229773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 71 sessionId: src_id|1cde022f-ace689a9-3723a83d-86c23657_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:37.240158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:37.240869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.240887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.240928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:37.241638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:37.249590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254496142039063:2506]
2025-10-01T14:06:37.249785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039063:2506], now have 1 active actors on pipe
2025-10-01T14:06:37.249869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 70, pipe: [1:7556254496142039063:2506]
2025-10-01T14:06:37.257218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:37.257236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:37.257239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:37.257241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:37.257251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254493765179787:2788]
2025-10-01T14:06:37.257255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254493765179787:2788]
2025-10-01T14:06:37.257259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254493765179787:2788]
2025-10-01T14:06:37.257306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:37.257312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:37.257318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:37.257319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.257321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:37.257322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:37.257475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:37.416598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:37.426235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.426269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.426524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.426600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.426667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.426731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.427240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.427256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.427344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.427403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.427471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.427542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.427586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.427596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.427672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.427744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.427817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.427887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.427933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.427940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.428012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.428088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.428156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.428232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.428471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.428481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.428555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.428623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.428694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.428759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.428922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.428930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.429000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.429059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.429120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.429182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.429225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.429232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.429300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.429361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.429424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.429497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.429547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.429558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.429621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.429683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.429746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.429812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.429863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.429870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.429933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.429993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.430058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.430122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.430165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.430171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.430235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.430290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.430411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.430473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.430514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.430521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.431520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:37.431524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:37.431528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:37.431556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 71 reason: error at write: Disconnected sessionId: src_id|1cde022f-ace689a9-3723a83d-86c23657_0
2025-10-01T14:06:37.431689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254496142039063:2506]
2025-10-01T14:06:37.431746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 71 sessionId: src_id|1cde022f-ace689a9-3723a83d-86c23657_0 is DEAD
2025-10-01T14:06:37.431885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cde022f-ace689a9-3723a83d-86c23657_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:37.431896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cde022f-ace689a9-3723a83d-86c23657_0] Write session will restart in 0.008984s
2025-10-01T14:06:37.431920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cde022f-ace689a9-3723a83d-86c23657_0] Write session: Do CDS request
2025-10-01T14:06:37.431927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cde022f-ace689a9-3723a83d-86c23657_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:37.431665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:37.441906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cde022f-ace689a9-3723a83d-86c23657_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:37.441981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:37.441996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 72
2025-10-01T14:06:37.442218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:37.442257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 72 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:37.442267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=72 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:37.442271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:37.442682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 72 sessionId:  describe result for acl check
2025-10-01T14:06:37.442725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:37.442730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:37.442731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:37.442736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254496142039082:2936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:37.443299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254496142039082:2936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:37.446152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254496142039082:2936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:37.447418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:37.448136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:37.448394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:37.448409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:37.448419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:37.448470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:37.448519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254493765179918:2790]
2025-10-01T14:06:37.449118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254496142039082:2936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:37.449131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254496142039082:2936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:37.449143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254496142039082:2936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:37.449129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:37.449150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 72 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:37.449410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:37.449464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:37.449775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:37.449856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.449863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.449864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.449865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.449866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.449867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.449868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.449868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.449870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.449871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.449872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.449873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.449875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.449876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.449882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.449891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.449895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.449898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.449901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.449905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.449909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.449913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.449916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.449920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.449923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.449927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.449930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.449933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.449941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.449948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.449954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.449959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.449963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.449968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.449972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.449976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.449980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.449985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.449989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.449994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.449998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.450003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.450008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.450013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.450018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.450022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.450026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.450030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.450034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.450039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.450043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.450048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.450052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.450056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.450061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.450066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.450101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:37.454050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:37.454684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:37.454699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:37.454702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:37.454706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:37.454713Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 71 [2:7556254493765179918:2790]
2025-10-01T14:06:37.454729Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:37.454744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:37.454751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.454754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.454756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.454770Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:37.454776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:37.454782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:37.454838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.454848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.454851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.454854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:37.454857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:37.454914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:37.454921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.454932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.454943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.454961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:37.454982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039189:2936], now have 1 active actors on pipe
2025-10-01T14:06:37.454985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039066:2446], now have 1 active actors on pipe
2025-10-01T14:06:37.454992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254493765179913:2790]
2025-10-01T14:06:37.454994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254493765179913:2790]
2025-10-01T14:06:37.454997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254493765179913:2790]
2025-10-01T14:06:37.455009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:37.455023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:37.455024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:37.455027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:37.455029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:37.455043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:37.455045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:37.455060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 71
2025-10-01T14:06:37.455098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 71
2025-10-01T14:06:37.455083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254493765179913:2790]
2025-10-01T14:06:37.455096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:37.455146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:37.455216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.455226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.455248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:37.455258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.455261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.455262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:37.455269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.455278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:37.455299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:37.455432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.455521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 72 partition: 0 MaxSeqNo: 45 sessionId: src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0
2025-10-01T14:06:37.455443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.455457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:37.455882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cde022f-ace689a9-3723a83d-86c23657_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:37.458443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0] Write session: try to update token
2025-10-01T14:06:37.458458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:37.473355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 72 sessionId: src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:37.475773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:37.476041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.476065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.481753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:37.481792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:37.481795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:37.481797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:37.481798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:37.481806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254493765179913:2790]
2025-10-01T14:06:37.481809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254493765179913:2790]
2025-10-01T14:06:37.481813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254493765179913:2790]
2025-10-01T14:06:37.481851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:37.481854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:37.481858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:37.481862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.481863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:37.481865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:37.481897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:37.481996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:37.531657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254496142039202:2506]
2025-10-01T14:06:37.531889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 71, pipe: [1:7556254496142039202:2506]
2025-10-01T14:06:37.625279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:37.632594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.632623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.632786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.632867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.632926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.632982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.633029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.633039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.633107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.633169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.633228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.633292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.633340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.633346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.633400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.633460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.633516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.633578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.633625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.633632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.633694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.633748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.633802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.633864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.633904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.633910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.633967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.634016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.634066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.634115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.634158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.634167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.634233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.634291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.634355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.634436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.634480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.634485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.634553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.634625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.634701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.634764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.634810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.634813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.634887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.634947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.635003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.635061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.635200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.635205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.635267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.635319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.635380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.635443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.635486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.635489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.635560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:37.635615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:37.635674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:37.636142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:37.636195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:37.636197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:37.636295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039202:2506], now have 1 active actors on pipe
2025-10-01T14:06:37.637247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:37.638980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:37.639030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254496142039202:2506]
2025-10-01T14:06:37.639050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:37.639089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 72 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0
2025-10-01T14:06:37.639280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 72 sessionId: src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0 is DEAD
2025-10-01T14:06:37.639403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:37.639411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0] Write session will restart in 0.008596s
2025-10-01T14:06:37.639433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0] Write session: Do CDS request
2025-10-01T14:06:37.639439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:37.648897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:37.649019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:37.649030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 73
2025-10-01T14:06:37.649136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:37.649166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 73 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:37.649174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=73 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:37.649177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:37.649922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 73 sessionId:  describe result for acl check
2025-10-01T14:06:37.649953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:37.649956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:37.649957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:37.649961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254496142039294:2947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:37.650443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254496142039294:2947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:37.652157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254496142039294:2947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:37.652189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:37.653226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:37.653393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:37.653402Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:37.653412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:37.653463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:37.653497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254493765180061:2799]
2025-10-01T14:06:37.654041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:37.654348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:37.654439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:37.654805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:37.654871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.654878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.654856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254496142039294:2947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:37.654879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.654881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254496142039294:2947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:37.654880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.654885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254496142039294:2947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:37.654881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.654891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 73 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:37.654882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.654883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.654885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.654886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.654887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.654888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.654889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.654890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.654891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.654896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.654906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.654909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.654912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.654916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.654919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.654922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.654925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.654929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.654932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.654935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.654938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.654942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.654945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.654951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.654958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.654965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.654969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.654973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.654977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.654981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.654985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.654989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.654994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.654997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.655002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.655005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.655010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.655014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.655019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.655023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.655027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.655030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.655035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.655039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.655044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.655048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.655052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.655057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.655061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.655066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.655071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.655110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:37.659595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:37.660206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:37.660218Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:37.660220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:37.660224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:37.660230Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 72 [2:7556254493765180061:2799]
2025-10-01T14:06:37.660262Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:37.660280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:37.660286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.660290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.660292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.660308Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:37.660316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:37.660326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:37.660378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.660387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.660389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.660392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:37.660394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:37.660455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:37.660462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.660471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.660480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.660499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:37.660519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039342:2947], now have 1 active actors on pipe
2025-10-01T14:06:37.660528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039218:2446], now have 1 active actors on pipe
2025-10-01T14:06:37.660535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254493765180055:2799]
2025-10-01T14:06:37.660537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254493765180055:2799]
2025-10-01T14:06:37.660539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254493765180055:2799]
2025-10-01T14:06:37.660550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:37.660564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:37.660563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:37.660566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:37.660569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:37.660576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:37.660578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:37.660607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254493765180055:2799]
2025-10-01T14:06:37.660598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 72
2025-10-01T14:06:37.660615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:37.660617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:37.660638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.660643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.660636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 72
2025-10-01T14:06:37.660671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:37.660682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.660686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.660688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:37.660696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.660708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:37.660732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:37.660883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.660890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.660903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:37.660989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 73 partition: 0 MaxSeqNo: 45 sessionId: src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0
2025-10-01T14:06:37.661371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10aca320-9f8b32b1-9e52b434-59e8fbd5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:37.664017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0] Write session: try to update token
2025-10-01T14:06:37.664032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:37.682622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 73 sessionId: src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:37.682653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:37.682674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:37.682677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:37.682679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:37.682689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254493765180055:2799]
2025-10-01T14:06:37.682693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254493765180055:2799]
2025-10-01T14:06:37.682697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254493765180055:2799]
2025-10-01T14:06:37.682756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:37.682757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:37.682764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:37.682765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.682768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:37.682768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:37.682941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:37.685127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:37.739000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254496142039373:2506]
2025-10-01T14:06:37.739229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 72, pipe: [1:7556254496142039373:2506]
2025-10-01T14:06:37.824637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:37.825528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.825542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.825576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039373:2506], now have 1 active actors on pipe
2025-10-01T14:06:37.825789Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:37.825973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:37.826106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 73 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0
2025-10-01T14:06:37.826107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254496142039373:2506]
2025-10-01T14:06:37.826126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:37.826296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 73 sessionId: src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0 is DEAD
2025-10-01T14:06:37.826424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:37.826433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0] Write session will restart in 0.008204s
2025-10-01T14:06:37.826460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0] Write session: Do CDS request
2025-10-01T14:06:37.826484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:37.835903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:37.835988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:37.836003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 74
2025-10-01T14:06:37.836021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:37.836256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:37.836293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 74 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:37.836303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=74 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:37.836307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:37.836601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:37.836722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 74 sessionId:  describe result for acl check
2025-10-01T14:06:37.836752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:37.836757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:37.836758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:37.836764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254496142039465:2953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:37.836770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:37.836781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:37.836792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:37.836825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:37.836894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254493765180222:2808]
2025-10-01T14:06:37.837259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:37.837268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254496142039465:2953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:37.837553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:37.837587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:37.837800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:37.837847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.837853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.837854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.837855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.837855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.837856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.837857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.837858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.837858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.837859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.837859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.837860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.837860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.837861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.837864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.837869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.837871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.837874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.837876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.837878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.837880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.837882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.837884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.837886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.837888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.837890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.837892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.837894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.837898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.837903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:37.837906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.837910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:37.837912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.837915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:37.837917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.837920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:37.837922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.837925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:37.837927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.837930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:37.837933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.837936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:37.837938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.837941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:37.837943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.837946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:37.837949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.837951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.837954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.837957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.837959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.837961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.837967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.837969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:37.837972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.837975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:37.838013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:37.839386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254496142039465:2953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:37.841817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:37.841827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254496142039465:2953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:37.841840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254496142039465:2953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:37.841844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254496142039465:2953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:37.841850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 74 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:37.842669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:37.842683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:37.842685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:37.842688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:37.842695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 73 [2:7556254493765180222:2808]
2025-10-01T14:06:37.842710Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:37.842725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:37.842728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.842731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.842733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.842749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:37.842754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:37.842759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:37.842807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.842813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.842815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.842818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:37.842820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:37.842881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:37.842889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.842900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:37.842909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:37.842923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:37.842946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039504:2953], now have 1 active actors on pipe
2025-10-01T14:06:37.842953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039376:2446], now have 1 active actors on pipe
2025-10-01T14:06:37.842961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254493765180217:2808]
2025-10-01T14:06:37.842967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254493765180217:2808]
2025-10-01T14:06:37.842969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254493765180217:2808]
2025-10-01T14:06:37.843045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 73
2025-10-01T14:06:37.843071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 73
2025-10-01T14:06:37.842981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:37.842989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:37.842991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:37.842994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:37.842997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:37.843008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:37.843011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:37.843037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254493765180217:2808]
2025-10-01T14:06:37.843043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:37.843047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:37.843081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.843084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.843114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:37.843121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:37.843124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:37.843126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:37.843134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:37.843142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:37.843156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:37.843329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.843341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.843364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:37.843492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 74 partition: 0 MaxSeqNo: 45 sessionId: src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0
2025-10-01T14:06:37.843812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eda16e90-f890f863-2c4e363d-6bb9ac42_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:37.846169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0] Write session: try to update token
2025-10-01T14:06:37.846184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:37.854277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:37.854295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:37.854306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254493765180217:2808]
2025-10-01T14:06:37.854353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:37.854352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:37.854614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:37.854756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:37.854898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:37.855034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:37.855222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:37.855255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:37.861690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 74 sessionId: src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:37.864192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:37.865057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:37.864475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:37.864492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:37.864523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:37.875442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:37.875470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:37.875473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:37.875476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:37.875486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254493765180217:2808]
2025-10-01T14:06:37.875491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254493765180217:2808]
2025-10-01T14:06:37.875496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254493765180217:2808]
2025-10-01T14:06:37.875550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:37.875564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:37.875567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:37.875732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:37.875748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:37.875752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:37.875801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:37.926461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254496142039511:2506]
2025-10-01T14:06:37.926737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 73, pipe: [1:7556254496142039511:2506]
2025-10-01T14:06:38.021108Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:38.028279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.028305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.028454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.028517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.028579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.028638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.028678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.028686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.028747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.028801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.028884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.028948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.028995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.029003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.029061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.029113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.029165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.029222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.029268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.029273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.029330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.029384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.029435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.029490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.029531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.029537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.029594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.029646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.029700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.029753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.029794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.029800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.029873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.029941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.030014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.030080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.030127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.030133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.030204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.030275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.030345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.030436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.030486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.030493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.030572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.030638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.030701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.030762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.030823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.030831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.030917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.030976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.031036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.031189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.031241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.031247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.031311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.031373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.031561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.031632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.031703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.031715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.031781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254496142039511:2506], now have 1 active actors on pipe
2025-10-01T14:06:38.032089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254496142039511:2506]
2025-10-01T14:06:38.032101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:38.032105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:38.032123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:38.032142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 74 reason: error at write: Disconnected sessionId: src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0
2025-10-01T14:06:38.032441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 74 sessionId: src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0 is DEAD
2025-10-01T14:06:38.032504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:38.032512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0] Write session will restart in 0.005358s
2025-10-01T14:06:38.032538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0] Write session: Do CDS request
2025-10-01T14:06:38.032545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:38.032638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:38.038857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.038984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:38.039000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 75
2025-10-01T14:06:38.039208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.039242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 75 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:38.039253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=75 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:38.039257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:38.039702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 75 sessionId:  describe result for acl check
2025-10-01T14:06:38.039732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:38.039738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:38.039740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:38.039747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254500437006824:2957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:38.040278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254500437006824:2957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:38.043190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254500437006824:2957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:38.043955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:38.044435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:38.044591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:38.044598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:38.044606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:38.044635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:38.044712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254498060147647:2810]
2025-10-01T14:06:38.045090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:38.045370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:38.045400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:38.045592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:38.045625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.045629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.045630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.045631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.045631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.045632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.045633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.045633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.045634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.045634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.045635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.045635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.045636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.045636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.045640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.045646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.045648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.045650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.045652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.045654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.045655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.045657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.045659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.045661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.045663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.045665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.045667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.045669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.045683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.045690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.045695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.045701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.045705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.045707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.045709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.045712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.045714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.045717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.045719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.045721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.045725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.045729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.045733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.045737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.045741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.045745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.045749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.045754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.045757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.045761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.045763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.045766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.045768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.045770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.045772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.045775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.045793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:38.045835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254500437006824:2957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:38.045868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254500437006824:2957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:38.045871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254500437006824:2957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:38.045879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 75 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:38.049980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:38.050646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:38.050657Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:38.050660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:38.050664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:38.050670Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 74 [2:7556254498060147647:2810]
2025-10-01T14:06:38.050685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:38.050701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:38.050703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.050707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.050710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.050727Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:38.050741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:38.050747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:38.050801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.050807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.050811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.050813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:38.050816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:38.050884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:38.050893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.050901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.050910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.050922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:38.050937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254498060147642:2810]
2025-10-01T14:06:38.050939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254498060147642:2810]
2025-10-01T14:06:38.050941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254498060147642:2810]
2025-10-01T14:06:38.050950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:38.050959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:38.050963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:38.050967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:38.050970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:38.050974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:38.050977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:38.050987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437006937:2957], now have 1 active actors on pipe
2025-10-01T14:06:38.050996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437006810:2446], now have 1 active actors on pipe
2025-10-01T14:06:38.051016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254498060147642:2810]
2025-10-01T14:06:38.051026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:38.051032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:38.051045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 74
2025-10-01T14:06:38.051046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 74
2025-10-01T14:06:38.051150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.051159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.051183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:38.051193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.051197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.051203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:38.051211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.051219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:38.051235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.051389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.051398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.051412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.051497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 75 partition: 0 MaxSeqNo: 45 sessionId: src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0
2025-10-01T14:06:38.051861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86669cce-be6aafc9-86ddb5b9-3c9904eb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:38.054410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0] Write session: try to update token
2025-10-01T14:06:38.054429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:38.080565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 75 sessionId: src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:38.077383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:38.077405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:38.077407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:38.077409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:38.077420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254498060147642:2810]
2025-10-01T14:06:38.077425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254498060147642:2810]
2025-10-01T14:06:38.077430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254498060147642:2810]
2025-10-01T14:06:38.077486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:38.077494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.077496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:38.077500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:38.077509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:38.077514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:38.077657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:38.083339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:38.132296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254500437006956:2506]
2025-10-01T14:06:38.132609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 74, pipe: [1:7556254500437006956:2506]
2025-10-01T14:06:38.229136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:38.229589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.229599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.229643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437006956:2506], now have 1 active actors on pipe
2025-10-01T14:06:38.230090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:38.230433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254500437006956:2506]
2025-10-01T14:06:38.230465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:38.230468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:38.230524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 75 reason: error at write: Disconnected sessionId: src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0
2025-10-01T14:06:38.230707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 75 sessionId: src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0 is DEAD
2025-10-01T14:06:38.231054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:38.231328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:38.231342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0] Write session will restart in 0.008763s
2025-10-01T14:06:38.231369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0] Write session: Do CDS request
2025-10-01T14:06:38.231376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:38.240908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.241682Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:38.241697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 76
2025-10-01T14:06:38.242045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.242078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 76 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:38.242084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=76 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:38.242088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:38.242435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 76 sessionId:  describe result for acl check
2025-10-01T14:06:38.242475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:38.242477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:38.242478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:38.242483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254500437006984:2962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:38.243011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254500437006984:2962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:38.246842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254500437006984:2962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:38.252440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:38.254800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254500437006984:2962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:38.254814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254500437006984:2962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:38.254818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254500437006984:2962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:38.254825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 76 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:38.254991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:38.255226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:38.255236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:38.255249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:38.255298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:38.255339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254498060147778:2813]
2025-10-01T14:06:38.255902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:38.256254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:38.256301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:38.256611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:38.256679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.256680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.256681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.256682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.256682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.256683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.256684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.256685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.256686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.256687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.256688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.256689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.256690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.256691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.256696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.256705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.256708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.256711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.256714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.256717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.256720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.256723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.256727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.256730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.256733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.256736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.256739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.256742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.256749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.256756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.256761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.256765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.256770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.256773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.256778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.256783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.256787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.256792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.256795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.256800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.256805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.256810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.256814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.256818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.256823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.256828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.256832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.256857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.256862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.256866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.256870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.256874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.256877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.256882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.256885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.256889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.256922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:38.261822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:38.262565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:38.262584Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:38.262586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:38.262591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:38.262598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 75 [2:7556254498060147778:2813]
2025-10-01T14:06:38.262621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:38.262640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:38.262648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.262652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.262654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.262672Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:38.262683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:38.262689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:38.262750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.262758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.262760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.262763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:38.262766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:38.262836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:38.262843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.262856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.262867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.262888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:38.262910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254498060147772:2813]
2025-10-01T14:06:38.262916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254498060147772:2813]
2025-10-01T14:06:38.262919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254498060147772:2813]
2025-10-01T14:06:38.262933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:38.262954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:38.262966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:38.262978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:38.263015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254498060147772:2813]
2025-10-01T14:06:38.263021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:38.263109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:38.263115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:38.263118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:38.263123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:38.263318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007087:2962], now have 1 active actors on pipe
2025-10-01T14:06:38.263326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437006961:2446], now have 1 active actors on pipe
2025-10-01T14:06:38.263682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.263688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.263720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a04a75ad-979125d-f98299dc-591eb6f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:38.263728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.263733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.263736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:38.263747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.263759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:38.263794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.263994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.264001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.264016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.264500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52b0ca24-6c5aa9bc-d81d3362-20293dc0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a04a75ad-979125d-f98299dc-591eb6f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:38.263477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 75
2025-10-01T14:06:38.263509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 75
2025-10-01T14:06:38.264123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 76 partition: 0 MaxSeqNo: 45 sessionId: src_id|a04a75ad-979125d-f98299dc-591eb6f3_0
2025-10-01T14:06:38.267267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04a75ad-979125d-f98299dc-591eb6f3_0] Write session: try to update token
2025-10-01T14:06:38.267285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04a75ad-979125d-f98299dc-591eb6f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:38.288801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 76 sessionId: src_id|a04a75ad-979125d-f98299dc-591eb6f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:38.291485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:38.292700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.292729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.292752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:38.292755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:38.292758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:38.292760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:38.292773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254498060147772:2813]
2025-10-01T14:06:38.292778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254498060147772:2813]
2025-10-01T14:06:38.292781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254498060147772:2813]
2025-10-01T14:06:38.292834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:38.292852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:38.292856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:38.292861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:38.292869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.292872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:38.293016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:38.329917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254500437007099:2506]
2025-10-01T14:06:38.330363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 75, pipe: [1:7556254500437007099:2506]
2025-10-01T14:06:38.465237Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:38.465518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:38.465570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007099:2506], now have 1 active actors on pipe
2025-10-01T14:06:38.465891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:38.465978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:38.465981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:38.466056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 76 reason: error at write: Disconnected sessionId: src_id|a04a75ad-979125d-f98299dc-591eb6f3_0
2025-10-01T14:06:38.466217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 76 sessionId: src_id|a04a75ad-979125d-f98299dc-591eb6f3_0 is DEAD
2025-10-01T14:06:38.466356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254500437007099:2506]
2025-10-01T14:06:38.466391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:38.466748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04a75ad-979125d-f98299dc-591eb6f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:38.466757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04a75ad-979125d-f98299dc-591eb6f3_0] Write session will restart in 0.009208s
2025-10-01T14:06:38.466780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04a75ad-979125d-f98299dc-591eb6f3_0] Write session: Do CDS request
2025-10-01T14:06:38.466790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04a75ad-979125d-f98299dc-591eb6f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:38.477761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04a75ad-979125d-f98299dc-591eb6f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.482581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:38.482597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 77
2025-10-01T14:06:38.483083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.483117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 77 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:38.483123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=77 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:38.483127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:38.483515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 77 sessionId:  describe result for acl check
2025-10-01T14:06:38.483544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:38.483546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:38.483548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:38.483554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254500437007110:2966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:38.484175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254500437007110:2966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:38.489533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254500437007110:2966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:38.494923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254500437007110:2966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:38.494937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254500437007110:2966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:38.494942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254500437007110:2966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:38.494951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 77 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:38.495922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:38.496729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:38.496961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:38.496966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:38.496977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:38.497025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:38.497057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254498060147911:2816]
2025-10-01T14:06:38.497664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:38.497969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:38.498049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:38.499285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:38.499372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.499373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.499374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.499375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.499376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.499377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.499378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.499379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.499380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.499381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.499382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.499383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.499384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.499385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.499391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.499402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.499406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.499409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.499413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.499416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.499420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.499423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.499427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.499431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.499435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.499439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.499443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.499446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.499454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.499459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.499463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.499466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.499469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.499472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.499474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.499477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.499480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.499483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.499486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.499489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.499491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.499494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.499498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.499501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.499504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.499507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.499509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.499512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.499515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.499517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.499520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.499523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.499525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.499528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.499530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.499533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.499557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:38.504690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:38.505433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:38.505438Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:38.505441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:38.505444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:38.505451Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 76 [2:7556254498060147911:2816]
2025-10-01T14:06:38.505469Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:38.505488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:38.505491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.505495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.505497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.505513Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:38.505519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:38.505526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:38.505585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.505587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.505589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.505592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:38.505595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:38.505671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:38.505683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.505695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.505706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.505722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:38.505740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007225:2966], now have 1 active actors on pipe
2025-10-01T14:06:38.505749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254498060147906:2816]
2025-10-01T14:06:38.505751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254498060147906:2816]
2025-10-01T14:06:38.505753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254498060147906:2816]
2025-10-01T14:06:38.505767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:38.505780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:38.505788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:38.505791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:38.505793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:38.505793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:38.505796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:38.505801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007102:2446], now have 1 active actors on pipe
2025-10-01T14:06:38.505835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254498060147906:2816]
2025-10-01T14:06:38.505840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:38.505898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 76
2025-10-01T14:06:38.505923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 76
2025-10-01T14:06:38.505966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:38.506076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.506085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.506108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f67333-bb34506c-5aa21a72-38826d8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:38.506115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.506119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.506121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:38.506129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.506138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:38.506154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.506354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.506360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.506387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.506543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 77 partition: 0 MaxSeqNo: 45 sessionId: src_id|9f67333-bb34506c-5aa21a72-38826d8a_0
2025-10-01T14:06:38.507283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04a75ad-979125d-f98299dc-591eb6f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9f67333-bb34506c-5aa21a72-38826d8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:38.510057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f67333-bb34506c-5aa21a72-38826d8a_0] Write session: try to update token
2025-10-01T14:06:38.510074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f67333-bb34506c-5aa21a72-38826d8a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:38.522477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:38.522497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:38.522507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254498060147906:2816]
2025-10-01T14:06:38.522556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:38.522743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:38.522934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:38.523088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:38.523245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:38.523492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:38.523528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:38.524081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:38.553325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 77 sessionId: src_id|9f67333-bb34506c-5aa21a72-38826d8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:38.555859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:38.557379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.557419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.557450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:38.557459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:38.557462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:38.557465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:38.557479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254498060147906:2816]
2025-10-01T14:06:38.557482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254498060147906:2816]
2025-10-01T14:06:38.557485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254498060147906:2816]
2025-10-01T14:06:38.557533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:38.557549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:38.557550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:38.557554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:38.557554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.557556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:38.557759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:38.566462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254500437007243:2506]
2025-10-01T14:06:38.567065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 76, pipe: [1:7556254500437007243:2506]
2025-10-01T14:06:38.712695Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:38.713172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:38.717789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:38.719415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007243:2506], now have 1 active actors on pipe
2025-10-01T14:06:38.731078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:38.731122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254500437007243:2506]
2025-10-01T14:06:38.732146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:38.732156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:38.732180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 77 reason: error at write: Disconnected sessionId: src_id|9f67333-bb34506c-5aa21a72-38826d8a_0
2025-10-01T14:06:38.732329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 77 sessionId: src_id|9f67333-bb34506c-5aa21a72-38826d8a_0 is DEAD
2025-10-01T14:06:38.735542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f67333-bb34506c-5aa21a72-38826d8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:38.735555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f67333-bb34506c-5aa21a72-38826d8a_0] Write session will restart in 0.006064s
2025-10-01T14:06:38.735581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f67333-bb34506c-5aa21a72-38826d8a_0] Write session: Do CDS request
2025-10-01T14:06:38.735590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f67333-bb34506c-5aa21a72-38826d8a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:38.744905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f67333-bb34506c-5aa21a72-38826d8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.746802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:38.746819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 78
2025-10-01T14:06:38.750495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.750548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 78 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:38.750560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=78 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:38.750565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:38.752581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 78 sessionId:  describe result for acl check
2025-10-01T14:06:38.752621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:38.752623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:38.752624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:38.752629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254500437007347:2979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:38.753145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254500437007347:2979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:38.756395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:38.756424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254500437007347:2979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:38.757779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:38.757928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:38.757935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:38.757942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:38.757973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:38.757998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254498060148091:2829]
2025-10-01T14:06:38.758363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:38.758674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:38.758706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:38.758948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:38.758990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.758994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.758995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.758995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.758996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.758997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.758998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.758998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.758999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.759000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.759000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.759001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.759001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.759002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.759005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.759012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.759016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.759019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.759022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.759025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.759028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.759031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.759035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.759038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.759041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.759044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.759046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.759049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.759054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.759060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.759066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.759071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.759074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.759078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.759081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.759085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.759089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.759093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.759097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.759101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.759105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.759109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.759113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.759117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.759121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.759125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.759129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.759133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.759138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.759143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.759146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.759149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.759151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.759154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.759156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.759159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.759178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:38.760356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254500437007347:2979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:38.760365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254500437007347:2979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:38.760367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254500437007347:2979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:38.760375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 78 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:38.764077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:38.764751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:38.764764Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:38.764766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:38.764769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:38.764776Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 77 [2:7556254498060148091:2829]
2025-10-01T14:06:38.764791Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:38.764809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:38.764812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.764815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.764817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.764834Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:38.764839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:38.764857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:38.764916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.764918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.764920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.764923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:38.764926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:38.764990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:38.764993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.765004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.765014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.765028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:38.765044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254498060148086:2829]
2025-10-01T14:06:38.765046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254498060148086:2829]
2025-10-01T14:06:38.765048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254498060148086:2829]
2025-10-01T14:06:38.765060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:38.765074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:38.765086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:38.765089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:38.765126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254498060148086:2829]
2025-10-01T14:06:38.765128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:38.765200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:38.765201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:38.765203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:38.765207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:38.765577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007411:2979], now have 1 active actors on pipe
2025-10-01T14:06:38.765584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007275:2446], now have 1 active actors on pipe
2025-10-01T14:06:38.765642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 77
2025-10-01T14:06:38.765667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 77
2025-10-01T14:06:38.765867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.765876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.765904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2a644a-246e61c-9628f61a-79c9df43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:38.765922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.765927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.765929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:38.765939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.765949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:38.765965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.766211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.766217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.766230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.766769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f67333-bb34506c-5aa21a72-38826d8a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f2a644a-246e61c-9628f61a-79c9df43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:38.766382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 78 partition: 0 MaxSeqNo: 45 sessionId: src_id|f2a644a-246e61c-9628f61a-79c9df43_0
2025-10-01T14:06:38.769248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a644a-246e61c-9628f61a-79c9df43_0] Write session: try to update token
2025-10-01T14:06:38.769265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a644a-246e61c-9628f61a-79c9df43_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:38.792392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 78 sessionId: src_id|f2a644a-246e61c-9628f61a-79c9df43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:38.795459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:38.796500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.796525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.796570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:38.796991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:38.800005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:38.800025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:38.800028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:38.800030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:38.800039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254498060148086:2829]
2025-10-01T14:06:38.800044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254498060148086:2829]
2025-10-01T14:06:38.800049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254498060148086:2829]
2025-10-01T14:06:38.800099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:38.800106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.800108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:38.800337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:38.802555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:38.802568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:38.802576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:38.831551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254500437007420:2506]
2025-10-01T14:06:38.831794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 77, pipe: [1:7556254500437007420:2506]
2025-10-01T14:06:38.953968Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:38.961213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.961242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.961396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.961465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.961536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.961597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.961642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.961650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.961722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.961781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.961840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.961902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.962140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.962148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.962208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.962268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.962327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.962403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.962452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.962462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.962521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.962577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.962634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.962693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.962738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.962745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.962808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.962865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.962927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.962988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.963029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.963036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.963107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.963172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.963241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.963309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.963447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.963456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.963530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.963630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.963703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.963779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.963830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.963838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.963911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.963977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.964082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.964144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.964264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.964271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.964337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.964400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.964463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.964526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.964569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.964576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.964639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:38.964701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:38.964765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:38.964975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:38.965028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:38.965049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:38.965119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007420:2506], now have 1 active actors on pipe
2025-10-01T14:06:38.965427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254500437007420:2506]
2025-10-01T14:06:38.965431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:38.965457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:38.965459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:38.965485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 78 reason: error at write: Disconnected sessionId: src_id|f2a644a-246e61c-9628f61a-79c9df43_0
2025-10-01T14:06:38.965660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 78 sessionId: src_id|f2a644a-246e61c-9628f61a-79c9df43_0 is DEAD
2025-10-01T14:06:38.965846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a644a-246e61c-9628f61a-79c9df43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:38.965856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a644a-246e61c-9628f61a-79c9df43_0] Write session will restart in 0.008634s
2025-10-01T14:06:38.965874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a644a-246e61c-9628f61a-79c9df43_0] Write session: Do CDS request
2025-10-01T14:06:38.965879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a644a-246e61c-9628f61a-79c9df43_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:38.966260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:38.975611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:38.975904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a644a-246e61c-9628f61a-79c9df43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.976093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:38.976110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 79
2025-10-01T14:06:38.976240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:38.976269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 79 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:38.976278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=79 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:38.976282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:38.976408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:38.976609Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:38.976618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:38.976628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:38.976670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:38.976700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254498060148223:2833]
2025-10-01T14:06:38.976720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 79 sessionId:  describe result for acl check
2025-10-01T14:06:38.976759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:38.976764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:38.976766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:38.976771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254500437007520:2983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:38.977143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:38.977305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254500437007520:2983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:38.977339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:38.977379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:38.977633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:38.977678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.977685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.977686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.977687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.977688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.977689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.977690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.977691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.977692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.977693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.977694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.977695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.977696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.977697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.977701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.977710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.977713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.977716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.977719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.977723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.977726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.977729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.977733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.977737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.977740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.977744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.977747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.977750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.977756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.977769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:38.977790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.977803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:38.977807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.977813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:38.977816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.977821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:38.977825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.977830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:38.977834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.977839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:38.977843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.977848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:38.977852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.977857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:38.977861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.977866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:38.977870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.977881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.977886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.977891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.977895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.977906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.977910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.977915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:38.977919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.977924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:38.977965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:38.979556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254500437007520:2983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:38.981589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:38.982365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:38.982393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:38.982394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:38.982397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:38.982402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 78 [2:7556254498060148223:2833]
2025-10-01T14:06:38.982411Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:38.982423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:38.982418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254500437007520:2983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:38.982426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.982434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254500437007520:2983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:38.982427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.982429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.982439Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:38.982437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254500437007520:2983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:38.982443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:38.982449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 79 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:38.982447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:38.982483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.982485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.982488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.982490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:38.982493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:38.982549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:38.982558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:38.982569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:38.982578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:38.982600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:38.982619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007426:2446], now have 1 active actors on pipe
2025-10-01T14:06:38.982629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254498060148218:2833]
2025-10-01T14:06:38.982630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254498060148218:2833]
2025-10-01T14:06:38.982622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 78
2025-10-01T14:06:38.982632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254498060148218:2833]
2025-10-01T14:06:38.982640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:38.982653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:38.982657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:38.982660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:38.982661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:38.982667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:38.982669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:38.982697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254500437007556:2983], now have 1 active actors on pipe
2025-10-01T14:06:38.982699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254498060148218:2833]
2025-10-01T14:06:38.982701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:38.982703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:38.982759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 78
2025-10-01T14:06:38.982814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.982830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.982851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:38.982862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:38.982866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:38.982868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:38.982875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:38.982881Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:38.982895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.983034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:38.983041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:38.983051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:38.983130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 79 partition: 0 MaxSeqNo: 45 sessionId: src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0
2025-10-01T14:06:38.983442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a644a-246e61c-9628f61a-79c9df43_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:38.985647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0] Write session: try to update token
2025-10-01T14:06:38.985662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:38.998307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:38.998342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:38.998353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254498060148218:2833]
2025-10-01T14:06:38.998429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:38.998476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:38.998663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:38.998815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:38.998960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:38.999133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:38.999171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 79 sessionId: src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:38.999344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:38.999391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:39.001545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:39.001758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.001780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.001817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:39.001940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:39.011280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:39.011299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:39.011302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:39.011304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:39.011314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254498060148218:2833]
2025-10-01T14:06:39.011319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254498060148218:2833]
2025-10-01T14:06:39.011323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254498060148218:2833]
2025-10-01T14:06:39.011371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:39.011373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:39.011378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:39.011381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.011382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:39.011383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:39.011520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:39.065631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254504731974859:2506]
2025-10-01T14:06:39.065796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 78, pipe: [1:7556254504731974859:2506]
2025-10-01T14:06:39.154353Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:39.161933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.161962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.162110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.162175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.162245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.162311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.162359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.162385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.162456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.162520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.162582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.162646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.162694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.162700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.162761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.162815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.162873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.162931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.162976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.162982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.163040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.163095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.163152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.163242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.163289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.163297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.163356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.163410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.163469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.163524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.163572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.163578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.163651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.163714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.163786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.163858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.163966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.163974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.164046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.164114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.164181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.164250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.164296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.164301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.164374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.164433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.164490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.164555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.164600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.164605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.164663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.164724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.164781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.164838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.164890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.164896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.164959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.165020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.165092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.165163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.165212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.165218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.165278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731974859:2506], now have 1 active actors on pipe
2025-10-01T14:06:39.165627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:39.165645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:39.165645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254504731974859:2506]
2025-10-01T14:06:39.165682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 79 reason: error at write: Disconnected sessionId: src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0
2025-10-01T14:06:39.165689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:39.165887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 79 sessionId: src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0 is DEAD
2025-10-01T14:06:39.166047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:39.166063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0] Write session will restart in 0.006725s
2025-10-01T14:06:39.166093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0] Write session: Do CDS request
2025-10-01T14:06:39.166121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:39.166202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:39.173886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:39.174046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:39.174062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 80
2025-10-01T14:06:39.174209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:39.174258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 80 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:39.174266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=80 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:39.174269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:39.174756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 80 sessionId:  describe result for acl check
2025-10-01T14:06:39.174787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:39.174792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:39.174794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:39.174799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254504731974913:2988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:39.175256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254504731974913:2988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:39.178400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254504731974913:2988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:39.178458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:39.179269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:39.179469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:39.179478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:39.179489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:39.179542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:39.179587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254502355115657:2836]
2025-10-01T14:06:39.180075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:39.180340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:39.180384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:39.180599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:39.180640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.180648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.180649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.180650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.180651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.180653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.180654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.180654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.180656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.180657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.180658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.180659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.180661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.180662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.180667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.180676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.180679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.180683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.180687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.180691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.180695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.180698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.180700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.180703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.180705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.180706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.180709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.180711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.180715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.180720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.180724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.180727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.180730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.180733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.180736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.180739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.180742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.180745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.180747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.180750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.180752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.180756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.180758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.180761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.180764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.180767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.180769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.180772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.180775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.180781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.180786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.180790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.180795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.180800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.180804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.180810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.180852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:39.181003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254504731974913:2988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:39.181017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254504731974913:2988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:39.181020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254504731974913:2988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:39.181028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 80 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:39.184763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:39.185521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:39.185536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:39.185540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:39.185544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:39.185551Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 79 [2:7556254502355115657:2836]
2025-10-01T14:06:39.185567Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:39.185585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:39.185589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.185592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.185595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.185611Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:39.185620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:39.185627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:39.185692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.185699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.185701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.185705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:39.185708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:39.185776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:39.185783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.185795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.185809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.185830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:39.185854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731974870:2446], now have 1 active actors on pipe
2025-10-01T14:06:39.185864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975004:2988], now have 1 active actors on pipe
2025-10-01T14:06:39.185871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254502355115652:2836]
2025-10-01T14:06:39.185873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254502355115652:2836]
2025-10-01T14:06:39.185875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254502355115652:2836]
2025-10-01T14:06:39.185889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:39.185902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:39.185916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:39.185917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:39.185920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:39.185921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:39.185923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:39.185937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 79
2025-10-01T14:06:39.185957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254502355115652:2836]
2025-10-01T14:06:39.185970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 79
2025-10-01T14:06:39.185965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:39.185974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:39.186004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.186012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.186040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:39.186050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.186055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.186061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:39.186069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.186079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:39.186097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:39.186245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.186252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.186264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:39.186341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 80 partition: 0 MaxSeqNo: 45 sessionId: src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0
2025-10-01T14:06:39.186751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fd60bc1-aa198112-7dca164-aa1bf9ee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:39.189154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0] Write session: try to update token
2025-10-01T14:06:39.189170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:39.208720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:39.208741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:39.208743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:39.208745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:39.208756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254502355115652:2836]
2025-10-01T14:06:39.208766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254502355115652:2836]
2025-10-01T14:06:39.208770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254502355115652:2836]
2025-10-01T14:06:39.208824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:39.208826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:39.208833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:39.208835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.208838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:39.208852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:39.209013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:39.211999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 80 sessionId: src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:39.214951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:39.265842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254504731975011:2506]
2025-10-01T14:06:39.266137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 79, pipe: [1:7556254504731975011:2506]
2025-10-01T14:06:39.353639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:39.353944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.353954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.353996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975011:2506], now have 1 active actors on pipe
2025-10-01T14:06:39.354363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:39.354385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254504731975011:2506]
2025-10-01T14:06:39.354416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:39.354419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:39.354487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 80 reason: error at write: Disconnected sessionId: src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0
2025-10-01T14:06:39.354671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 80 sessionId: src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0 is DEAD
2025-10-01T14:06:39.354852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:39.354863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0] Write session will restart in 0.009510s
2025-10-01T14:06:39.354891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0] Write session: Do CDS request
2025-10-01T14:06:39.354899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:39.354497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:39.365880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:39.366315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:39.366334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 81
2025-10-01T14:06:39.366496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:39.366534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 81 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:39.366546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=81 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:39.366551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:39.366995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 81 sessionId:  describe result for acl check
2025-10-01T14:06:39.367034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:39.367035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:39.367037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:39.367042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254504731975037:2992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:39.367542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254504731975037:2992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:39.371197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254504731975037:2992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:39.374025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:39.375239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254504731975037:2992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:39.375254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254504731975037:2992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:39.375258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254504731975037:2992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:39.375266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 81 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:39.375042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:39.375236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:39.375241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:39.375252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:39.375291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:39.375325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254502355115792:2838]
2025-10-01T14:06:39.375947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:39.376279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:39.376313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:39.376616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:39.376661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.376662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.376663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.376665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.376667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.376668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.376669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.376670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.376672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.376673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.376674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.376675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.376677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.376678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.376683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.376695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.376699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.376703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.376708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.376712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.376716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.376720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.376724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.376728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.376733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.376738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.376742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.376746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.376752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.376760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.376766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.376772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.376777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.376782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.376787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.376792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.376797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.376803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.376807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.376813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.376818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.376823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.376829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.376834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.376853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.376859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.376863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.376869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.376874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.376879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.376883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.376889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.376893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.376898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.376902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.376908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.376949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:39.393156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:39.393851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:39.393871Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:39.393874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:39.393879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:39.393887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 80 [2:7556254502355115792:2838]
2025-10-01T14:06:39.393904Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:39.393927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:39.393934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.393938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.393941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.393957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:39.393968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:39.393975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:39.394045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.394052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.394054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.394058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:39.394061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:39.394138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:39.394145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.394156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.394167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.394184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:39.394200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254502355115786:2838]
2025-10-01T14:06:39.394203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254502355115786:2838]
2025-10-01T14:06:39.394205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254502355115786:2838]
2025-10-01T14:06:39.394214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:39.394228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:39.394242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:39.394245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:39.394289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254502355115786:2838]
2025-10-01T14:06:39.394292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:39.394392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:39.394395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:39.394396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:39.394401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:39.394641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975014:2446], now have 1 active actors on pipe
2025-10-01T14:06:39.394651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975145:2992], now have 1 active actors on pipe
2025-10-01T14:06:39.394987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 80
2025-10-01T14:06:39.395031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 80
2025-10-01T14:06:39.395155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.395168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.395197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5198f36-6103137a-9208003a-1097b4e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:39.395210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.395219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.395222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:39.395236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.395252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:39.395272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:39.395804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.395813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.395834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:39.395956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 81 partition: 0 MaxSeqNo: 45 sessionId: src_id|5198f36-6103137a-9208003a-1097b4e7_0
2025-10-01T14:06:39.396338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|658add15-c4e1eaf8-ecb06ddd-6bfe1dc5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5198f36-6103137a-9208003a-1097b4e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:39.398893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5198f36-6103137a-9208003a-1097b4e7_0] Write session: try to update token
2025-10-01T14:06:39.398914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5198f36-6103137a-9208003a-1097b4e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:39.412675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:39.412699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:39.412709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254502355115786:2838]
2025-10-01T14:06:39.412758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:39.412764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:39.412955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:39.413095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:39.413254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:39.413405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:39.413727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:39.413813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:39.424674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 81 sessionId: src_id|5198f36-6103137a-9208003a-1097b4e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:39.427209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:39.427613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.427647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.427693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:39.428145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:39.439098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:39.439119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:39.439122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:39.439124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:39.439135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254502355115786:2838]
2025-10-01T14:06:39.439140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254502355115786:2838]
2025-10-01T14:06:39.439146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254502355115786:2838]
2025-10-01T14:06:39.439194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:39.439197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:39.439201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:39.439205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:39.439205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.439208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:39.439370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:39.454645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254504731975157:2506]
2025-10-01T14:06:39.454998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 80, pipe: [1:7556254504731975157:2506]
2025-10-01T14:06:39.589894Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:39.598729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.598755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.598930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.599005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.599082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.599155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.599210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.599222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.599294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.602356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:39.602436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254504731975157:2506]
2025-10-01T14:06:39.602477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:39.602483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:39.602515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 81 reason: error at write: Disconnected sessionId: src_id|5198f36-6103137a-9208003a-1097b4e7_0
2025-10-01T14:06:39.602703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 81 sessionId: src_id|5198f36-6103137a-9208003a-1097b4e7_0 is DEAD
2025-10-01T14:06:39.602965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198f36-6103137a-9208003a-1097b4e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:39.602982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198f36-6103137a-9208003a-1097b4e7_0] Write session will restart in 0.007546s
2025-10-01T14:06:39.603016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198f36-6103137a-9208003a-1097b4e7_0] Write session: Do CDS request
2025-10-01T14:06:39.603023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198f36-6103137a-9208003a-1097b4e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:39.599356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.599426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.599489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.599531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.599534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.599598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.599649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.599705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.599762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.599802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.599805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.599864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.599922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.599976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.600026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.600060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.600066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.600127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.600176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.600221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.600285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.600326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.600329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.600408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.600474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.600549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.600618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.600666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.600668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.600748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.600818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.600942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.601009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.601068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.601071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.601149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.601207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.601263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.601327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.601374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.601377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.601450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.601510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.601572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.601638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.601686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.601689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.601756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.601816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.601878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.601948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.601993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.601995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.602068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975157:2506], now have 1 active actors on pipe
2025-10-01T14:06:39.603331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:39.611852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5198f36-6103137a-9208003a-1097b4e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:39.612077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:39.612092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 82
2025-10-01T14:06:39.612240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:39.612287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 82 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:39.612298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=82 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:39.612306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:39.612753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 82 sessionId:  describe result for acl check
2025-10-01T14:06:39.612792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:39.612798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:39.612800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:39.612806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254504731975176:2997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:39.613372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254504731975176:2997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:39.617709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254504731975176:2997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:39.620937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254504731975176:2997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:39.620950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254504731975176:2997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:39.620953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254504731975176:2997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:39.620960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 82 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:39.621021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:39.622037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:39.622249Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:39.622260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:39.622273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:39.622332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:39.622482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254502355115932:2841]
2025-10-01T14:06:39.623081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:39.623526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:39.623612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:39.623999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:39.624081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.624089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.624091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.624092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.624093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.624095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.624096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.624097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.624099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.624101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.624102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.624104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.624105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.624107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.624113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.624124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.624129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.624133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.624137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.624141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.624145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.624149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.624153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.624159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.624163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.624166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.624170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.624174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.624182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.624191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.624197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.624205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.624210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.624214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.624219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.624225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.624229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.624233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.624238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.624246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.624251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.624256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.624267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.624271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.624279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.624284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.624288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.624294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.624299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.624304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.624314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.624319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.624326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.624336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.624340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.624345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.624385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:39.630799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:39.631503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:39.631510Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:39.631514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:39.631519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:39.631527Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 81 [2:7556254502355115932:2841]
2025-10-01T14:06:39.631548Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:39.631567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:39.631571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.631575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.631578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.631595Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:39.631601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:39.631609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:39.631675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.631677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.631684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.631687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:39.631693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:39.631773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:39.631775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.631786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.631798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.631814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:39.631833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254502355115925:2841]
2025-10-01T14:06:39.631836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254502355115925:2841]
2025-10-01T14:06:39.631838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254502355115925:2841]
2025-10-01T14:06:39.631856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:39.631870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:39.631886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:39.631890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:39.631920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:39.631926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254502355115925:2841]
2025-10-01T14:06:39.631929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:39.631929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:39.631931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:39.631938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:39.632212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975161:2446], now have 1 active actors on pipe
2025-10-01T14:06:39.632224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975292:2997], now have 1 active actors on pipe
2025-10-01T14:06:39.632528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 81
2025-10-01T14:06:39.632528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 81
2025-10-01T14:06:39.632863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.632877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.632909Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:39.632918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.632923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.632925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:39.632936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.632949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:39.632964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:39.633177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.633185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.633200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:39.633327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 82 partition: 0 MaxSeqNo: 45 sessionId: src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0
2025-10-01T14:06:39.633743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5198f36-6103137a-9208003a-1097b4e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:39.636355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0] Write session: try to update token
2025-10-01T14:06:39.636374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:39.644483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:39.644500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:39.644512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254502355115925:2841]
2025-10-01T14:06:39.644566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:39.644570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:39.644756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:39.644910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:39.645045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:39.645173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:39.645369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:39.645408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:39.653662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 82 sessionId: src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:39.656377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:39.656604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.656627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.656664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:39.656801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:39.668206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:39.668228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:39.668231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:39.668233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:39.668245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254502355115925:2841]
2025-10-01T14:06:39.668250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254502355115925:2841]
2025-10-01T14:06:39.668254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254502355115925:2841]
2025-10-01T14:06:39.668308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:39.668315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.668318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:39.668480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:39.668583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:39.668593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:39.668598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:39.702660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254504731975305:2506]
2025-10-01T14:06:39.703453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 81, pipe: [1:7556254504731975305:2506]
2025-10-01T14:06:39.822001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:39.830092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.830125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.830298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.830390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.830458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.830534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.830690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.830705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.830778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.830853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.830928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.830997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.831042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.831051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.831119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.831180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.831239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.831296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.831342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.831350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.831413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.831473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.831544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.831610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.831656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.831663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.831730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.831788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.831851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.831910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.831955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.831963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.832039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.832109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.832190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.832269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.832326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.832334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.832414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.832494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.832580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.832658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.832734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.832742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.832825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.832913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.832989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.833060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.833125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.833132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.833203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.833268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.833335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.833407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.833457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.833466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.833536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:39.833603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:39.833679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:39.833760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:39.833821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:39.833829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:39.833901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975305:2506], now have 1 active actors on pipe
2025-10-01T14:06:39.834230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254504731975305:2506]
2025-10-01T14:06:39.834237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:39.834268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:39.834271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:39.834298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 82 reason: error at write: Disconnected sessionId: src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0
2025-10-01T14:06:39.834650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:39.834662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0] Write session will restart in 0.009704s
2025-10-01T14:06:39.834687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0] Write session: Do CDS request
2025-10-01T14:06:39.834693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:39.834505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 82 sessionId: src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0 is DEAD
2025-10-01T14:06:39.835081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:39.845838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:39.845926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:39.845941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 83
2025-10-01T14:06:39.846071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:39.846102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 83 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:39.846111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=83 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:39.846114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:39.846623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 83 sessionId:  describe result for acl check
2025-10-01T14:06:39.846661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:39.846664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:39.846666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:39.846671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254504731975441:3009] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:39.847177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254504731975441:3009] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:39.847942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:39.848707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:39.848937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:39.848948Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:39.848960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:39.849016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:39.849055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254502355116117:2856]
2025-10-01T14:06:39.849560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:39.849832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:39.849875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:39.850166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:39.850232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.850237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.850238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.850239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.850240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.850241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.850242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.850243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.850244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.850245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.850247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.850247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.850249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.850249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.850255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.850264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.850268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.850272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.850275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.850278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.850281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.850284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.850288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.850292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.850296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.850299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.850303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.850307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.850312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.850319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:39.850325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.850329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:39.850333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.850337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:39.850340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.850345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:39.850348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.850353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:39.850356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.850360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:39.850364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.850380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:39.850384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.850389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:39.850393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.850403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:39.850407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.850412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.850419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.850424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.850428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.850433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.850437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.850447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:39.850451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.850461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:39.850496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:39.850943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254504731975441:3009] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:39.855704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:39.855591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254504731975441:3009] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:39.855609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254504731975441:3009] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:39.855612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254504731975441:3009] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:39.855620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 83 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:39.856524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:39.856541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:39.856544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:39.856547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:39.856554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 82 [2:7556254502355116117:2856]
2025-10-01T14:06:39.856570Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:39.856591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:39.856599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.856603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.856605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.856620Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:39.856630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:39.856636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:39.856698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.856706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.856708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.856711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:39.856714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:39.856863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 82
2025-10-01T14:06:39.856894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 82
2025-10-01T14:06:39.857324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 83 partition: 0 MaxSeqNo: 45 sessionId: src_id|42783c2a-ae95b503-27a69203-5eea5d77_0
2025-10-01T14:06:39.856777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:39.856786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.856798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:39.856809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:39.856824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:39.856855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975345:2446], now have 1 active actors on pipe
2025-10-01T14:06:39.856859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975479:3009], now have 1 active actors on pipe
2025-10-01T14:06:39.856866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254502355116112:2856]
2025-10-01T14:06:39.856868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254502355116112:2856]
2025-10-01T14:06:39.856871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254502355116112:2856]
2025-10-01T14:06:39.856884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:39.856899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:39.856915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:39.856918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:39.856920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:39.856923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:39.856925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:39.856952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254502355116112:2856]
2025-10-01T14:06:39.856956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:39.856964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:39.856976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.856980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.857024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42783c2a-ae95b503-27a69203-5eea5d77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:39.857030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:39.857034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:39.857036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:39.857044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:39.857052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:39.857067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:39.857240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:39.857244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:39.857260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:39.857663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6155f8e9-71e4ba1a-20e1e630-c95d6fc8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|42783c2a-ae95b503-27a69203-5eea5d77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:39.860155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42783c2a-ae95b503-27a69203-5eea5d77_0] Write session: try to update token
2025-10-01T14:06:39.860173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42783c2a-ae95b503-27a69203-5eea5d77_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:39.875254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 83 sessionId: src_id|42783c2a-ae95b503-27a69203-5eea5d77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:39.877984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:39.878667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:39.878686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:39.878688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:39.878689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:39.878698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254502355116112:2856]
2025-10-01T14:06:39.878702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254502355116112:2856]
2025-10-01T14:06:39.878705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254502355116112:2856]
2025-10-01T14:06:39.878757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:39.878759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:39.878766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:39.878770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:39.878772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:39.878774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:39.878942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:39.934539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254504731975486:2506]
2025-10-01T14:06:39.934922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 82, pipe: [1:7556254504731975486:2506]
2025-10-01T14:06:40.026590Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:40.026973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.026982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.027019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254504731975486:2506], now have 1 active actors on pipe
2025-10-01T14:06:40.027252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:40.027250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:40.027279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254504731975486:2506]
2025-10-01T14:06:40.027309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:40.027384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 83 reason: status is not ok: tablet will be restarted right now sessionId: src_id|42783c2a-ae95b503-27a69203-5eea5d77_0
2025-10-01T14:06:40.027597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 83 sessionId: src_id|42783c2a-ae95b503-27a69203-5eea5d77_0 is DEAD
2025-10-01T14:06:40.027723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42783c2a-ae95b503-27a69203-5eea5d77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:40.027734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42783c2a-ae95b503-27a69203-5eea5d77_0] Write session will restart in 0.007952s
2025-10-01T14:06:40.027761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42783c2a-ae95b503-27a69203-5eea5d77_0] Write session: Do CDS request
2025-10-01T14:06:40.027767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42783c2a-ae95b503-27a69203-5eea5d77_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:40.037880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42783c2a-ae95b503-27a69203-5eea5d77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.037966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:40.037980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 84
2025-10-01T14:06:40.038123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.038155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 84 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:40.038160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=84 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:40.038163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:40.038699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 84 sessionId:  describe result for acl check
2025-10-01T14:06:40.038738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:40.038745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:40.038746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:40.038752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254509026942886:3013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:40.039111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:40.039285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254509026942886:3013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:40.041347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:40.041585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:40.041590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:40.041601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:40.041380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254509026942886:3013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:40.041658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:40.041699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254506650083551:2858]
2025-10-01T14:06:40.042499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:40.042823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:40.042873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:40.043193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:40.043237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.043239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.043239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.043240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.043242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.043243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.043244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.043246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.043247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.043248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.043261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.043262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.043263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.043264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.043271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.043282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.043287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.043291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.043295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.043300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.043304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.043308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.043312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.043316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.043320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.043324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.043328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.043332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.043339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.043348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.043354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.043361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.043366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.043371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.043378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.043383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.043389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.043394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.043398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.043404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.043409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.043416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.043420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.043425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.043429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.043435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.043439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.043445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.043449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.043454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.043459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.043464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.043468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.043473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.043478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.043483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.043524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:40.047717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:40.048503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254509026942886:3013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:40.048519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254509026942886:3013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:40.048522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254509026942886:3013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:40.048531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 84 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:40.048408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:40.048423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:40.048425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:40.048428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:40.048435Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 83 [2:7556254506650083551:2858]
2025-10-01T14:06:40.048452Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:40.049016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 83
2025-10-01T14:06:40.049050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 83
2025-10-01T14:06:40.048468Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:40.048471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.048475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.048477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.048494Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:40.048499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:40.048505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:40.048558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.048560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.048563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.048566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:40.048568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:40.048637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:40.048640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.048650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.048659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.048672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:40.048688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254506650083546:2858]
2025-10-01T14:06:40.048690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254506650083546:2858]
2025-10-01T14:06:40.048692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254506650083546:2858]
2025-10-01T14:06:40.048701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:40.048714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:40.048729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:40.048731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:40.048743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:40.048747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:40.048749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:40.048764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254506650083546:2858]
2025-10-01T14:06:40.048766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:40.048775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:40.048792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026942787:2446], now have 1 active actors on pipe
2025-10-01T14:06:40.048935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026942922:3013], now have 1 active actors on pipe
2025-10-01T14:06:40.049170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.049175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.049197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:40.049211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.049215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.049221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:40.049230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.049240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:40.049259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.051844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.051868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.051901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.052009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 84 partition: 0 MaxSeqNo: 45 sessionId: src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0
2025-10-01T14:06:40.052509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42783c2a-ae95b503-27a69203-5eea5d77_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:40.055158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0] Write session: try to update token
2025-10-01T14:06:40.055181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:40.061183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:40.061201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:40.061210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254506650083546:2858]
2025-10-01T14:06:40.061249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:40.061580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:40.061712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:40.061833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:40.061962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:40.062133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:40.062171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:40.062465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:40.074161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 84 sessionId: src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:40.077101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:40.079686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.079712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.079752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:40.079897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:40.103402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.103430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.103610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.103662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.103717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.103772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.103809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.103813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.103877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.103951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.104006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.104073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.104128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.104132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.104195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.104253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.104311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.104368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.104411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.104414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.104478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.104535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.104593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.104648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.104686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.104688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.104755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.104816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.104891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.104953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.104992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.104996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.105069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.105132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.105195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.105258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.105300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.105303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.105372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.105434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.105496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.105554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.105593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.105597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.105660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.105722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.105785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.105848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.105896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.105899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.105973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.106031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.106083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.106141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.106189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.106193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.106256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.106312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.106389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.106450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.106490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.106492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.106596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:06:40.106659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.106679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.106682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:06:40.106701Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106710Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106714Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106718Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106725Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106728Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106732Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106735Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106739Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106743Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106746Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106750Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106754Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106757Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.106760Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107075Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107080Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107083Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107087Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107090Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107361Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107366Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107368Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107371Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107374Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107376Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107378Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107380Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107384Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107387Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107489Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107492Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107495Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107497Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107499Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:06:40.107583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:06:40.107594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:06:40.107597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:06:40.107601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:06:40.107604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:06:40.107986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:06:40.108000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:06:40.108005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:06:40.108007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:06:40.108013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:06:40.108016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:06:40.108522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:06:40.108538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:06:40.108544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:06:40.108547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:06:40.108550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:06:40.108553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:06:40.109034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:06:40.109046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.109204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327600108
2025-10-01T14:06:40.112077Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:40.112114Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:06:40.112126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:40.112130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:40.112132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:40.112134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:40.112144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254506650083546:2858]
2025-10-01T14:06:40.112148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254506650083546:2858]
2025-10-01T14:06:40.112152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254506650083546:2858]
2025-10-01T14:06:40.112203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:40.112218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:40.112221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:40.112235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:40.112240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.112242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:40.112386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:40.126506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254509026942936:2506]
2025-10-01T14:06:40.126764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 83, pipe: [1:7556254509026942936:2506]
2025-10-01T14:06:40.259162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:40.259595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026942936:2506], now have 1 active actors on pipe
2025-10-01T14:06:40.260007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:40.260694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:40.260708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0] Write session will restart in 0.008084s
2025-10-01T14:06:40.260735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0] Write session: Do CDS request
2025-10-01T14:06:40.260243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:40.260744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:40.260290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254509026942936:2506]
2025-10-01T14:06:40.260308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:40.260323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:40.260346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 84 reason: error at write: Disconnected sessionId: src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0
2025-10-01T14:06:40.260529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 84 sessionId: src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0 is DEAD
2025-10-01T14:06:40.269901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.270250Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [6fe0e47966180fbf] Result# TEvPutResult {Id# [72075186224037892:83:1:2:1:6759616:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-01T14:06:40.270311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:40.270321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 85
2025-10-01T14:06:40.270431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.270465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 85 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:40.270469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=85 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:40.270471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:40.270741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 85 sessionId:  describe result for acl check
2025-10-01T14:06:40.270759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:40.270760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:40.270762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:40.270765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254509026942952:3018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:40.271358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254509026942952:3018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:40.273921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254509026942952:3018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:40.276633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254509026942952:3018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:40.276653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254509026942952:3018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:40.276656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254509026942952:3018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:40.276664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 85 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:40.285501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:40.286346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:40.286567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:40.286578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:40.286589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:40.286652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:40.286694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254506650083696:2861]
2025-10-01T14:06:40.287212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:40.287536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:40.287596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:40.287947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:40.288034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.288042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.288043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.288044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.288045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.288046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.288047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.288049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.288050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.288051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.288052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.288053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.288055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.288056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.288062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.288073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.288077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.288081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.288084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.288089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.288092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.288096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.288100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.288105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.288108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.288112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.288116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.288120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.288128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.288136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.288143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.288149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.288154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.288160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.288164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.288172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.288177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.288182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.288186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.288191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.288195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.288200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.288205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.288210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.288215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.288219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.288224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.288230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.288235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.288240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.288252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.288258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.288264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.288269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.288279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.288284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.288336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:40.292769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:40.293453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:40.293474Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:40.293477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:40.293482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:40.293489Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 84 [2:7556254506650083696:2861]
2025-10-01T14:06:40.293506Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:40.293524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:40.293527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.293530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.293533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.293549Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:40.293554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:40.293561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:40.293617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.293627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.293629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.293633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:40.293635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:40.293704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:40.293717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.293731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.293744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.293761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:40.293781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026942989:3018], now have 1 active actors on pipe
2025-10-01T14:06:40.293791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026942941:2446], now have 1 active actors on pipe
2025-10-01T14:06:40.293798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254506650083691:2861]
2025-10-01T14:06:40.293801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254506650083691:2861]
2025-10-01T14:06:40.293803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254506650083691:2861]
2025-10-01T14:06:40.293818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:40.293832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:40.293853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:40.293862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:40.293884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 84
2025-10-01T14:06:40.293898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254506650083691:2861]
2025-10-01T14:06:40.293885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 84
2025-10-01T14:06:40.293908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:40.293954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:40.293969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:40.293971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:40.293979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:40.294145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.294163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.294196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:40.294210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.294215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.294218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:40.294230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.294247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:40.294265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.294429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.294443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.294462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.294582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 85 partition: 0 MaxSeqNo: 45 sessionId: src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0
2025-10-01T14:06:40.294949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe728d7d-97c12daf-d902566a-1f8099e6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:40.297519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0] Write session: try to update token
2025-10-01T14:06:40.297540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:40.312223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 85 sessionId: src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:40.314907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:40.315135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.315163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.315205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:40.315328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:40.319562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:40.319587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:40.319590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:40.319592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:40.319602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254506650083691:2861]
2025-10-01T14:06:40.319608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254506650083691:2861]
2025-10-01T14:06:40.319612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254506650083691:2861]
2025-10-01T14:06:40.319659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:40.319668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.319671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:40.319805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:40.322616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:40.322627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:40.322632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:40.359988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254509026943088:2506]
2025-10-01T14:06:40.360286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 84, pipe: [1:7556254509026943088:2506]
2025-10-01T14:06:40.491974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:40.500104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.500131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.500293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.500348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.500405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.500458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.500703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.500708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.500770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.500823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.500891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.500947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.500984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.500986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.501043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.501093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.501142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.501193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.501228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.501231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.501284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.501336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.501382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.501429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.501469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.501471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.501528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.501577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.501626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.501675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.501714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.501716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.501785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.501847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.501911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.501970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.502011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.502014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.502081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.502141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.502209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.502272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.502316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.502318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.502575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.502642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.502699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.502757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.503165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.503168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.503230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.503279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.503335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.503389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.503425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.503428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.503491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.503540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.503595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.503659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.503703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.503705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.503772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026943088:2506], now have 1 active actors on pipe
2025-10-01T14:06:40.505173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:40.505184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0] Write session will restart in 0.008870s
2025-10-01T14:06:40.505207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0] Write session: Do CDS request
2025-10-01T14:06:40.505213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:40.505234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:40.504783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:40.504788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254509026943088:2506]
2025-10-01T14:06:40.504794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:40.504804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:40.504830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 85 reason: error at write: Disconnected sessionId: src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0
2025-10-01T14:06:40.505042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 85 sessionId: src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0 is DEAD
2025-10-01T14:06:40.514904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.515006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:40.515021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 86
2025-10-01T14:06:40.515161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.515197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 86 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:40.515203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=86 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:40.515207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:40.515960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 86 sessionId:  describe result for acl check
2025-10-01T14:06:40.516005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:40.516009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:40.516010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:40.516016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254509026943107:3023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:40.516553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254509026943107:3023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:40.518834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254509026943107:3023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:40.521531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254509026943107:3023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:40.521543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254509026943107:3023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:40.521546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254509026943107:3023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:40.521553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 86 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:40.523947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:40.525021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:40.525206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:40.525215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:40.525222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:40.525265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:40.525323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254506650083839:2864]
2025-10-01T14:06:40.525927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:40.526202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:40.526246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:40.526577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:40.526652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.526653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.526654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.526656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.526657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.526659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.526660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.526662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.526664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.526665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.526666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.526667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.526669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.526670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.526674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.526684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.526688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.526692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.526696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.526700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.526704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.526708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.526711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.526715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.526718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.526722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.526725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.526729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.526736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.526743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.526748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.526754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.526758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.526763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.526768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.526773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.526778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.526783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.526787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.526792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.526797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.526802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.526806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.526811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.526816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.526821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.526825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.526833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.526838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.526843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.526847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.526852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.526857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.526862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.526866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.526871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.526909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:40.530935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:40.532017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 85
2025-10-01T14:06:40.532017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 85
2025-10-01T14:06:40.531599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:40.531605Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:40.531608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:40.531612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:40.531619Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 85 [2:7556254506650083839:2864]
2025-10-01T14:06:40.531636Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:40.531653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:40.531656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.531660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.531662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.531676Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:40.531682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:40.531689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:40.531752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.531755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.531757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.531761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:40.531763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:40.531839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:40.531842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.531853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.531861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.531874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:40.531892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026943093:2446], now have 1 active actors on pipe
2025-10-01T14:06:40.531896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026943212:3023], now have 1 active actors on pipe
2025-10-01T14:06:40.531902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254506650083834:2864]
2025-10-01T14:06:40.531904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254506650083834:2864]
2025-10-01T14:06:40.531907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254506650083834:2864]
2025-10-01T14:06:40.531921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:40.531934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:40.531948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:40.531951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:40.531978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254506650083834:2864]
2025-10-01T14:06:40.531980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:40.532026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:40.532031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:40.532034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:40.532047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:40.532151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.532157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.532178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:40.532184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.532188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.532190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:40.532197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.532212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:40.532229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.532356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.532361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.532370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.532423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 86 partition: 0 MaxSeqNo: 45 sessionId: src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0
2025-10-01T14:06:40.532769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b9c0cd58-59945d74-8e3b866-ca3db04d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:40.535148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0] Write session: try to update token
2025-10-01T14:06:40.535166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:40.548500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 86 sessionId: src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:40.550950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:40.551161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.551185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.551223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:40.551306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:40.554973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:40.554990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:40.554992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:40.554994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:40.555005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254506650083834:2864]
2025-10-01T14:06:40.555010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254506650083834:2864]
2025-10-01T14:06:40.555013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254506650083834:2864]
2025-10-01T14:06:40.555062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:40.555069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.555066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:40.555071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:40.555089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:40.555105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:40.555230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:40.604904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254509026943240:2506]
2025-10-01T14:06:40.605328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 85, pipe: [1:7556254509026943240:2506]
2025-10-01T14:06:40.692497Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:40.701813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.701839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.702004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.702063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.702126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.702193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.702247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.702254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.702328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.702400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.702463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.702530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.702584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.702589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.702652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.702708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.702767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.702825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.702868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.702873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.702939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.702999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.703053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.703108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.703156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.703162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.703223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.703281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.703345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.703400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.703448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.703453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.703508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.703558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.703611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.703663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.703707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.703712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.703764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.703814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.703869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.703923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.703970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.703976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.704033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.704085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.704145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.704204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.704349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.704375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.704462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.704518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.704577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.704642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.704685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.704693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.704752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.704807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.704879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.704945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.704992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.704999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.705068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026943240:2506], now have 1 active actors on pipe
2025-10-01T14:06:40.705310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:40.705322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254509026943240:2506]
2025-10-01T14:06:40.705355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:40.705358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:40.705385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 86 reason: error at write: Disconnected sessionId: src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0
2025-10-01T14:06:40.705569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 86 sessionId: src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0 is DEAD
2025-10-01T14:06:40.705702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:40.705714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0] Write session will restart in 0.009134s
2025-10-01T14:06:40.705740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0] Write session: Do CDS request
2025-10-01T14:06:40.705745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:40.705947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:40.715880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.715954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:40.715966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 87
2025-10-01T14:06:40.716076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.716100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 87 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:40.716105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=87 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:40.716108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:40.716504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 87 sessionId:  describe result for acl check
2025-10-01T14:06:40.716540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:40.716545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:40.716547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:40.716551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254509026943342:3027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:40.717016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254509026943342:3027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:40.717593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:40.718271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:40.718450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:40.718459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:40.718469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:40.718519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:40.718547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254506650083979:2866]
2025-10-01T14:06:40.718989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:40.719217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:40.719252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:40.719485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:40.719536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.719541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.719542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.719543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.719544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.719545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.719546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.719547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.719548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.719550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.719551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.719552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.719554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.719555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.719559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.719569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.719573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.719577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.719581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.719584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.719588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.719592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.719611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.719619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.719622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.719626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.719630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.719634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.719640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.719650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.719660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.719668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.719672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.719649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254509026943342:3027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:40.719678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.719685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.719690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.719697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.719703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.719710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.719715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.719722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.719727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.719734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.719739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.719748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.719753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.719760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.719765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.719772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.719777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.719784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.719789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.719794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.719803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.719810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.719815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.719856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:40.723182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254509026943342:3027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:40.723193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254509026943342:3027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:40.723196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254509026943342:3027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:40.723254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 87 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:40.723395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:40.724035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:40.724046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:40.724047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:40.724050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:40.724054Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 86 [2:7556254506650083979:2866]
2025-10-01T14:06:40.724066Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:40.724079Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:40.724081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.724083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.724085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.724096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:40.724098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:40.724103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:40.724145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.724151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.724152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.724154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:40.724156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:40.724212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:40.724218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.724224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.724230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.724238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:40.724250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254506650083974:2866]
2025-10-01T14:06:40.724254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254506650083974:2866]
2025-10-01T14:06:40.724255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254506650083974:2866]
2025-10-01T14:06:40.724261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:40.724271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026943384:3027], now have 1 active actors on pipe
2025-10-01T14:06:40.724275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:40.724279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026943243:2446], now have 1 active actors on pipe
2025-10-01T14:06:40.724281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:40.724283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:40.724285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:40.724290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:40.724292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:40.724315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254506650083974:2866]
2025-10-01T14:06:40.724324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:40.724333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:40.724347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 86
2025-10-01T14:06:40.724354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 86
2025-10-01T14:06:40.724424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.724430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.724448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:40.724455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.724458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.724460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:40.724466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.724474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:40.724484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.724617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.724622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.724632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.724717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 87 partition: 0 MaxSeqNo: 45 sessionId: src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0
2025-10-01T14:06:40.724987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|783b27b9-a7906844-5ed2c781-aabf92f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:40.727271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0] Write session: try to update token
2025-10-01T14:06:40.727286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:40.740263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 87 sessionId: src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:40.743356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:40.743713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.743735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.745729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:40.745766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:40.745769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:40.745770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:40.745772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:40.745780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254506650083974:2866]
2025-10-01T14:06:40.745783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254506650083974:2866]
2025-10-01T14:06:40.745788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254506650083974:2866]
2025-10-01T14:06:40.745817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:40.745824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:40.745828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:40.745828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:40.745837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.745840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:40.745882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:40.745960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:40.805417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254509026943417:2506]
2025-10-01T14:06:40.805717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 86, pipe: [1:7556254509026943417:2506]
2025-10-01T14:06:40.896355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:40.903845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.903874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.904033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.904094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.904153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.904217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.904427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.904436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.904499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.904555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.904619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.904672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.904716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.904725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.904780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.904831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.904893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.904945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.904988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.904996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.905049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.905110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.905167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.905295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.905333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.905339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.905390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.905438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.905491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.905540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.905580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.905586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.905655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.905738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.905807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.905877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.905925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.905934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.906004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.906068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.906141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.906206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.906258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.906267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.906341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.906418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.906473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.906527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.906567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.906572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.906631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.906693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.906760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.906830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.906880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.906886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.906944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:40.906996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:40.907049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:40.907110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:40.907161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:40.907168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:40.907222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026943417:2506], now have 1 active actors on pipe
2025-10-01T14:06:40.907395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254509026943417:2506]
2025-10-01T14:06:40.907415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:40.907418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:40.907422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:40.907449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 87 reason: error at write: Disconnected sessionId: src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0
2025-10-01T14:06:40.907626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 87 sessionId: src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0 is DEAD
2025-10-01T14:06:40.907723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:40.907794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:40.907804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0] Write session will restart in 0.007333s
2025-10-01T14:06:40.907825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0] Write session: Do CDS request
2025-10-01T14:06:40.907831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:40.915761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.916253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:40.916265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 88
2025-10-01T14:06:40.916475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:40.916532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 88 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:40.916540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=88 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:40.916545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:40.916923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 88 sessionId:  describe result for acl check
2025-10-01T14:06:40.916949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:40.916950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:40.916952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:40.916956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254509026943530:3039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:40.917058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:40.917422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254509026943530:3039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:40.917492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:40.917619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:40.917628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:40.917636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:40.917665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:40.917693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254506650084169:2881]
2025-10-01T14:06:40.918078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:40.918319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:40.918344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:40.918563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:40.918605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.918610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.918611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.918611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.918612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.918613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.918613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.918614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.918614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.918615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.918616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.918616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.918617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.918617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.918620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.918626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.918628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.918630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.918632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.918634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.918636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.918637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.918639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.918641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.918643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.918645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.918646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.918648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.918653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.918657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:40.918661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.918664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:40.918667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.918669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:40.918671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.918674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:40.918677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.918680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:40.918682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.918685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:40.918687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.918690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:40.918692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.918695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:40.918697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.918700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:40.918702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.918705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.918707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.918710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.918712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.918715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.918717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.918719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:40.918722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.918724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:40.918744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:40.919499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254509026943530:3039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:40.921909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254509026943530:3039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:40.921923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254509026943530:3039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:40.921927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254509026943530:3039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:40.921950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 88 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:40.922232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:40.923129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:40.923143Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:40.923145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:40.923149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:40.923155Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 87 [2:7556254506650084169:2881]
2025-10-01T14:06:40.923169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:40.923183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:40.923190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.923193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.923196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.923211Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:40.923220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:40.923225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:40.923271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.923277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.923279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.923282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:40.923284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:40.923346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:40.923353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.923363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:40.923378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:40.923397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:40.923422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026943570:3039], now have 1 active actors on pipe
2025-10-01T14:06:40.923425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254509026943428:2446], now have 1 active actors on pipe
2025-10-01T14:06:40.923432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254506650084164:2881]
2025-10-01T14:06:40.923433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254506650084164:2881]
2025-10-01T14:06:40.923436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254506650084164:2881]
2025-10-01T14:06:40.923448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:40.923458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:40.923460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:40.923461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:40.923465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:40.923449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 87
2025-10-01T14:06:40.923480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:40.923487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:40.923455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 87
2025-10-01T14:06:40.923518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.923526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.923538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254506650084164:2881]
2025-10-01T14:06:40.923549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:40.923552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:40.923578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:40.923588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:40.923595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:40.923597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:40.923608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:40.923619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:40.923641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.923778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:40.923786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:40.923797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:40.923896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 88 partition: 0 MaxSeqNo: 45 sessionId: src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0
2025-10-01T14:06:40.924310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f042d60-ad4a6208-5ccaa0a3-35ea845a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:40.926559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0] Write session: try to update token
2025-10-01T14:06:40.926572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:40.940540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 88 sessionId: src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:40.942775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:40.942794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:40.942795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:40.942797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:40.942805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254506650084164:2881]
2025-10-01T14:06:40.942808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254506650084164:2881]
2025-10-01T14:06:40.942812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254506650084164:2881]
2025-10-01T14:06:40.942859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:40.942863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:40.942871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:40.942873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:40.942875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:40.942878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:40.943021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:40.943276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:41.007663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254513321910874:2506]
2025-10-01T14:06:41.007946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 87, pipe: [1:7556254513321910874:2506]
2025-10-01T14:06:41.089382Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:41.089802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.089816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.089854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321910874:2506], now have 1 active actors on pipe
2025-10-01T14:06:41.090017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:41.090093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254513321910874:2506]
2025-10-01T14:06:41.090119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:41.090257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:41.090327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 88 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0
2025-10-01T14:06:41.090539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 88 sessionId: src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0 is DEAD
2025-10-01T14:06:41.090698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:41.090709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0] Write session will restart in 0.005317s
2025-10-01T14:06:41.090742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0] Write session: Do CDS request
2025-10-01T14:06:41.090748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:41.096876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.097064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:41.097082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 89
2025-10-01T14:06:41.097248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.097279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 89 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:41.097290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=89 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:41.097295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:41.097755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 89 sessionId:  describe result for acl check
2025-10-01T14:06:41.097802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:41.097807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:41.097808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:41.097813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254513321910899:3044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:41.098383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254513321910899:3044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:41.100607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254513321910899:3044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:41.102244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:41.103086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:41.103177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254513321910899:3044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:41.103192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254513321910899:3044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:41.103195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254513321910899:3044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:41.103202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 89 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:41.103253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:41.103261Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:41.103270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:41.103317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:41.103375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254510945051609:2883]
2025-10-01T14:06:41.103910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:41.104186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:41.104217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:41.104491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:41.104545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.104549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.104550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.104551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.104552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.104553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.104553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.104554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.104555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.104555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.104556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.104557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.104557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.104558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.104561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.104568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.104570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.104572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.104574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.104576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.104578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.104581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.104583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.104585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.104587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.104589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.104591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.104594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.104599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.104603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.104607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.104610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.104612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.104616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.104619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.104624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.104628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.104633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.104638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.104643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.104648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.104653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.104657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.104662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.104667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.104672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.104677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.104682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.104687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.104692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.104696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.104703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.104713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.104723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.104728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.104736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.104777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:41.108701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:41.109432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:41.109451Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:41.109454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:41.109458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:41.109466Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 88 [2:7556254510945051609:2883]
2025-10-01T14:06:41.109483Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:41.109500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:41.109504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.109508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.109511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.109527Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:41.109533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:41.109542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:41.109608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.109618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.109619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.109623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:41.109626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:41.109701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:41.109710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.109721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.109734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.109754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:41.109783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911023:3044], now have 1 active actors on pipe
2025-10-01T14:06:41.109792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321910879:2446], now have 1 active actors on pipe
2025-10-01T14:06:41.109799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254510945051604:2883]
2025-10-01T14:06:41.109801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254510945051604:2883]
2025-10-01T14:06:41.109803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254510945051604:2883]
2025-10-01T14:06:41.109815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:41.109829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:41.109830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:41.109843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:41.109845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:41.109846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:41.109848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:41.109885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254510945051604:2883]
2025-10-01T14:06:41.109898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:41.109902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:41.109904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 88
2025-10-01T14:06:41.109909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 88
2025-10-01T14:06:41.110030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.110041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.110067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:41.110079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.110084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.110086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:41.110096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.110109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:41.110125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.110298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.110305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.110319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.110440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 89 partition: 0 MaxSeqNo: 45 sessionId: src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0
2025-10-01T14:06:41.110829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58f388cf-4080f2d1-45638dde-87cd7d1f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:41.113305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0] Write session: try to update token
2025-10-01T14:06:41.113323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:41.130119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 89 sessionId: src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:41.130229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:41.130252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:41.130255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:41.130257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:41.130267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254510945051604:2883]
2025-10-01T14:06:41.130271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254510945051604:2883]
2025-10-01T14:06:41.130276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254510945051604:2883]
2025-10-01T14:06:41.130326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:41.130329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:41.130336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.130339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:41.130340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:41.130345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:41.130512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:41.133058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:41.190449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254513321911038:2506]
2025-10-01T14:06:41.190837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 88, pipe: [1:7556254513321911038:2506]
2025-10-01T14:06:41.265534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:41.266008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.266021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.266053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911038:2506], now have 1 active actors on pipe
2025-10-01T14:06:41.266354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254513321911038:2506]
2025-10-01T14:06:41.266253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:41.266543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:41.266922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:41.266623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 89 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0
2025-10-01T14:06:41.266792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 89 sessionId: src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0 is DEAD
2025-10-01T14:06:41.266931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0] Write session will restart in 0.009417s
2025-10-01T14:06:41.266968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0] Write session: Do CDS request
2025-10-01T14:06:41.266974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:41.267093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:41.281640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:41.281688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.281830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:41.281848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 90
2025-10-01T14:06:41.281994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.282028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 90 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:41.282039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=90 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:41.282044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:41.282485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 90 sessionId:  describe result for acl check
2025-10-01T14:06:41.282520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:41.282526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:41.282528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:41.282536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254513321911146:3048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:41.283126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254513321911146:3048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:41.282405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:41.282599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:41.282603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:41.282612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:41.282656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:41.282695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254510945051755:2886]
2025-10-01T14:06:41.283341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:41.283564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:41.283606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:41.283925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:41.283979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.283987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.283988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.283989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.283991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.283992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.283993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.283995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.283996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.283998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.283999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.284001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.284002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.284003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.284009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.284019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.284023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.284027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.284031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.284035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.284039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.284043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.284047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.284052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.284056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.284060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.284063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.284067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.284074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.284082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.284088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.284094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.284099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.284103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.284108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.284113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.284119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.284124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.284129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.284135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.284139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.284145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.284152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.284158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.284163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.284168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.284172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.284178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.284183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.284188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.284193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.284199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.284204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.284210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.284216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.284221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.284266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:41.285726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254513321911146:3048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:41.288901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254513321911146:3048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:41.288914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254513321911146:3048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:41.288917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254513321911146:3048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:41.288927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 90 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:41.289307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:41.290134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:41.290162Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:41.290165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:41.290169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:41.290177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 89 [2:7556254510945051755:2886]
2025-10-01T14:06:41.290194Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:41.290226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:41.290236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.290240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.290243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.290273Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:41.290286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:41.290292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:41.290361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.290403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.290411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.290415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:41.290418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:41.290507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:41.290518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.290535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.290546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.290563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:41.290588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911184:3048], now have 1 active actors on pipe
2025-10-01T14:06:41.290592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911040:2446], now have 1 active actors on pipe
2025-10-01T14:06:41.290601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254510945051750:2886]
2025-10-01T14:06:41.290603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254510945051750:2886]
2025-10-01T14:06:41.290605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254510945051750:2886]
2025-10-01T14:06:41.290622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:41.290637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:41.290641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:41.290644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:41.290647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:41.290660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:41.290663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:41.290699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254510945051750:2886]
2025-10-01T14:06:41.290711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:41.290728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:41.290729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.290733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.290666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 89
2025-10-01T14:06:41.290709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 89
2025-10-01T14:06:41.290791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:41.290805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.290810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.290812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:41.290824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.290839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:41.290862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.291066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.291080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.291098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.291191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 90 partition: 0 MaxSeqNo: 45 sessionId: src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0
2025-10-01T14:06:41.291680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ff3a421-3aa5cab9-ac2eaff2-2d43143d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:41.294589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0] Write session: try to update token
2025-10-01T14:06:41.294609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:41.312624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 90 sessionId: src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:41.314826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:41.314850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:41.314852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:41.314854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:41.314864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254510945051750:2886]
2025-10-01T14:06:41.314870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254510945051750:2886]
2025-10-01T14:06:41.314874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254510945051750:2886]
2025-10-01T14:06:41.314926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:41.314933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.314936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:41.315065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:41.317401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:41.317458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:41.317470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:41.317473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:41.372063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254513321911192:2506]
2025-10-01T14:06:41.372363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 89, pipe: [1:7556254513321911192:2506]
2025-10-01T14:06:41.476020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:41.476506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.476517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.476562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911192:2506], now have 1 active actors on pipe
2025-10-01T14:06:41.477286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:41.477339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254513321911192:2506]
2025-10-01T14:06:41.477358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:41.477367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:41.477426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 90 reason: error at write: Disconnected sessionId: src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0
2025-10-01T14:06:41.478053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:41.478065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0] Write session will restart in 0.008325s
2025-10-01T14:06:41.478091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0] Write session: Do CDS request
2025-10-01T14:06:41.478098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:41.477630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 90 sessionId: src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0 is DEAD
2025-10-01T14:06:41.478496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:41.490981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.492493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:41.492507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 91
2025-10-01T14:06:41.492710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.492738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 91 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:41.492744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=91 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:41.492748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:41.493841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 91 sessionId:  describe result for acl check
2025-10-01T14:06:41.493886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:41.493888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:41.493893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:41.493898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254513321911209:3052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:41.494480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254513321911209:3052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:41.496941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254513321911209:3052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:41.500201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254513321911209:3052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:41.500220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254513321911209:3052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:41.500224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254513321911209:3052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:41.500243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 91 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:41.505772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:41.506718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:41.506924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:41.506933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:41.506944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:41.506988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:41.507030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254510945051904:2889]
2025-10-01T14:06:41.507531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:41.507866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:41.507900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:41.508161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:41.508235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.508242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.508243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.508244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.508245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.508246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.508248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.508250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.508251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.508252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.508253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.508254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.508255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.508257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.508262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.508272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.508276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.508279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.508282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.508284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.508286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.508288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.508290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.508292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.508294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.508296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.508298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.508300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.508305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.508310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.508313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.508319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.508324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.508329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.508333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.508339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.508343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.508348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.508352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.508357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.508361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.508366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.508371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.508377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.508382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.508387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.508392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.508397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.508404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.508409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.508413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.508418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.508424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.508429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.508434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.508439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.508479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:41.513210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:41.513848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:41.513861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:41.513864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:41.513868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:41.513875Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 90 [2:7556254510945051904:2889]
2025-10-01T14:06:41.513892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:41.513909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:41.513913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.513917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.513919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.513937Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:41.513948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:41.513954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:41.514012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.514019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.514022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.514025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:41.514028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:41.514096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:41.514104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.514115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.514127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.514148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:41.514171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911251:3052], now have 1 active actors on pipe
2025-10-01T14:06:41.514182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254510945051899:2889]
2025-10-01T14:06:41.514185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254510945051899:2889]
2025-10-01T14:06:41.514187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254510945051899:2889]
2025-10-01T14:06:41.514202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:41.514216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911195:2446], now have 1 active actors on pipe
2025-10-01T14:06:41.514225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:41.514232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:41.514239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:41.514242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:41.514248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:41.514251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:41.514278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254510945051899:2889]
2025-10-01T14:06:41.514291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:41.514300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:41.514338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 90
2025-10-01T14:06:41.514393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 90
2025-10-01T14:06:41.514510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.514531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.514589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:41.514608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.514617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.514620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:41.514635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.514658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:41.514689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.514865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.514880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.514897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.515001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 91 partition: 0 MaxSeqNo: 45 sessionId: src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0
2025-10-01T14:06:41.515513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a5367ba-fd5f210d-c0f2f723-e6fbf93e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:41.518600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0] Write session: try to update token
2025-10-01T14:06:41.518620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:41.544211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 91 sessionId: src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:41.547317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:41.549150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.549179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.549205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:41.549209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:41.549213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:41.549215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:41.549231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254510945051899:2889]
2025-10-01T14:06:41.549237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254510945051899:2889]
2025-10-01T14:06:41.549242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254510945051899:2889]
2025-10-01T14:06:41.549301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:41.549308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.549310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:41.549458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:41.550141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:41.550152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:41.550155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:41.573984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254513321911349:2506]
2025-10-01T14:06:41.574742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 90, pipe: [1:7556254513321911349:2506]
2025-10-01T14:06:41.731048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:41.731328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:41.731382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911349:2506], now have 1 active actors on pipe
2025-10-01T14:06:41.731678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:41.731840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:41.731895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254513321911349:2506]
2025-10-01T14:06:41.745926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:41.745945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:41.745969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 91 reason: error at write: Disconnected sessionId: src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0
2025-10-01T14:06:41.746138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 91 sessionId: src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0 is DEAD
2025-10-01T14:06:41.748934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:41.748945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0] Write session will restart in 0.007699s
2025-10-01T14:06:41.748971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0] Write session: Do CDS request
2025-10-01T14:06:41.748980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:41.758305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.758713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:41.758732Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 92
2025-10-01T14:06:41.758907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.758969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 92 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:41.758985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=92 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:41.758989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:41.759444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 92 sessionId:  describe result for acl check
2025-10-01T14:06:41.759482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:41.759490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:41.759492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:41.759498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254513321911471:3058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:41.759986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254513321911471:3058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:41.760004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:41.761145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:41.761287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:41.761296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:41.761304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:41.761333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:41.761372Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254510945052062:2892]
2025-10-01T14:06:41.761808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:41.762100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:41.762155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:41.762259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254513321911471:3058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:41.762476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:41.762539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.762546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.762548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.762549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.762550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.762551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.762552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.762553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.762554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.762555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.762557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.762558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.762558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.762559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.762564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.762574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.762578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.762581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.762584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.762588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.762591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.762593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.762596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.762600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.762603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.762606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.762609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.762612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.762620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.762627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.762632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.762637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.762640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.762644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.762648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.762652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.762656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.762661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.762665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.762669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.762672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.762682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.762685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.762690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.762693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.762698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.762705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.762709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.762714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.762722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.762725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.762729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.762736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.762741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.762744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.762749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.762785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:41.766664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:41.766441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254513321911471:3058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:41.766457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254513321911471:3058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:41.766460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254513321911471:3058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:41.766468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 92 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:41.767354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:41.767369Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:41.767371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:41.767375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:41.767381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 91 [2:7556254510945052062:2892]
2025-10-01T14:06:41.767396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:41.767416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:41.767419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.767422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.767429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.767445Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:41.767455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:41.767461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:41.767515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.767522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.767524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.767526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:41.767528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:41.767590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:41.767598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.767608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.767618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.767632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:41.767648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911352:2446], now have 1 active actors on pipe
2025-10-01T14:06:41.767655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911509:3058], now have 1 active actors on pipe
2025-10-01T14:06:41.767662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254510945052057:2892]
2025-10-01T14:06:41.767664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254510945052057:2892]
2025-10-01T14:06:41.767667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254510945052057:2892]
2025-10-01T14:06:41.767677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:41.767689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:41.767694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:41.767696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:41.767698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:41.767707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:41.767710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:41.767689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 91
2025-10-01T14:06:41.767735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254510945052057:2892]
2025-10-01T14:06:41.767745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:41.767748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:41.767728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 91
2025-10-01T14:06:41.767802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.767810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.767832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:41.767841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.767845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.767852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:41.767859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.767871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:41.767887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.768027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.768035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.768048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.768120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 92 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0
2025-10-01T14:06:41.769346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6aad5b-69f2d134-cc6f47e1-da0f5889_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:41.772147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0] Write session: try to update token
2025-10-01T14:06:41.772169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:41.778844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:41.778862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:41.778873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254510945052057:2892]
2025-10-01T14:06:41.778917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:41.779049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:41.779095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:41.779232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:41.779387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:41.779531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:41.779736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:41.779774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:41.792455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 92 sessionId: src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:41.795998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:41.796623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.796649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.796682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:41.796829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:41.800232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:41.800254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:41.800257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:41.800259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:41.800271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254510945052057:2892]
2025-10-01T14:06:41.800276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254510945052057:2892]
2025-10-01T14:06:41.800280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254510945052057:2892]
2025-10-01T14:06:41.800337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:41.800344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:41.800350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.800351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:41.800354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:41.800355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:41.800601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:41.834424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254513321911522:2506]
2025-10-01T14:06:41.835007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 91, pipe: [1:7556254513321911522:2506]
2025-10-01T14:06:41.965357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:41.972314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.972340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.972482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.972539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.972593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.972648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.972689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.972696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.972754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.972942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.972997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.973055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.973093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.973098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.973151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.973198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.973244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.973292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.973330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.973335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.973389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.973440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.973489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.973537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.973574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.973579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.973630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.973678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.973725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.973771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.973807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.973812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.973877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.973935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.974001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.974061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.974103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.974110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.974183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.974252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.974314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.974388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.974438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.974446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.974514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.974573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.974629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.974677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.974717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.974724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.974779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.974830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.974882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.974933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.974970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.974975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.975028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:41.975076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:41.975127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:41.975189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:41.975304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:41.975309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:41.975349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911522:2506], now have 1 active actors on pipe
2025-10-01T14:06:41.975580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:41.975589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:41.975590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:41.975621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 92 reason: error at write: Disconnected sessionId: src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0
2025-10-01T14:06:41.975628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254513321911522:2506]
2025-10-01T14:06:41.975753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 92 sessionId: src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0 is DEAD
2025-10-01T14:06:41.975878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:41.975889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0] Write session will restart in 0.006911s
2025-10-01T14:06:41.975911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0] Write session: Do CDS request
2025-10-01T14:06:41.975917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:41.976076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:41.983769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.983860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:41.983876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 93
2025-10-01T14:06:41.983969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:41.983999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 93 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:41.984010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=93 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:41.984013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:41.984361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 93 sessionId:  describe result for acl check
2025-10-01T14:06:41.984398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:41.984406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:41.984407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:41.984413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254513321911653:3069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:41.984718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:41.984898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254513321911653:3069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:41.985199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:41.985314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:41.985321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:41.985329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:41.985369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:41.985403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254510945052245:2906]
2025-10-01T14:06:41.985855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:41.986056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:41.986093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:41.986342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:41.986402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.986409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.986410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.986411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.986412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.986413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.986414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.986414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.986415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.986416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.986416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.986417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.986417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.986418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.986421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.986426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.986428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.986430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.986432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.986433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.986436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.986437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.986439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.986441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.986443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.986445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.986448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.986452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.986457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.986463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:41.986470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.986475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:41.986479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.986483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:41.986487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.986491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:41.986495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.986500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:41.986503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.986508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:41.986512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.986516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:41.986519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.986523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:41.986527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.986531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:41.986534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.986537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.986541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.986545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.986547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.986552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.986555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.986560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:41.986563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.986567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:41.986600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:41.986633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254513321911653:3069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:41.989758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254513321911653:3069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:41.989770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254513321911653:3069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:41.989774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254513321911653:3069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:41.989781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 93 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:41.989923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:41.990547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:41.990559Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:41.990561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:41.990563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:41.990568Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 92 [2:7556254510945052245:2906]
2025-10-01T14:06:41.990577Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:41.990587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:41.990589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.990591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.990592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.990602Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:41.990609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:41.990613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:41.990645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.990650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.990652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.990654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:41.990656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:41.990698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:41.990705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:41.990711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:41.990716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:41.990724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:41.990744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911546:2446], now have 1 active actors on pipe
2025-10-01T14:06:41.990747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254513321911693:3069], now have 1 active actors on pipe
2025-10-01T14:06:41.990752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254510945052240:2906]
2025-10-01T14:06:41.990753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254510945052240:2906]
2025-10-01T14:06:41.990754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254510945052240:2906]
2025-10-01T14:06:41.990762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:41.990770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:41.990771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:41.990778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:41.990780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:41.990782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:41.990783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:41.990795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254510945052240:2906]
2025-10-01T14:06:41.990796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:41.990798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:41.990802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 92
2025-10-01T14:06:41.990821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 92
2025-10-01T14:06:41.990877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.990882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.990898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:41.990905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:41.990908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:41.990909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:41.990914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:41.990920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:41.990928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.991033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:41.991037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:41.991046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:41.991116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 93 partition: 0 MaxSeqNo: 45 sessionId: src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0
2025-10-01T14:06:41.991345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b7fa87a-5628aaf3-e1952b11-c0e62e80_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:41.993825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0] Write session: try to update token
2025-10-01T14:06:41.993840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:42.008997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 93 sessionId: src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:42.011493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:42.014452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.014482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.016774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:42.016819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:42.016822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:42.016825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:42.016827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:42.016835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254510945052240:2906]
2025-10-01T14:06:42.016855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254510945052240:2906]
2025-10-01T14:06:42.016860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254510945052240:2906]
2025-10-01T14:06:42.016896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:42.016911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:42.016911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:42.016917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:42.016918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.016921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:42.016931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:42.017089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:42.075901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254517616878996:2506]
2025-10-01T14:06:42.076288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 92, pipe: [1:7556254517616878996:2506]
2025-10-01T14:06:42.160592Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:42.167998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.168025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.168177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.168235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.168292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.168346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.168400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.168411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.168471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.168528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.168600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.168667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.168724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.168732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.168789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.168837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.168897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.168948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.168986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.168991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.169043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.169092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.169146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.169200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.169237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.169242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.169294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.169342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.169392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.169442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.169483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.169490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.169554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.169613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.169683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.169743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.169791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.169797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.169863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.169934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.169998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.170060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.170108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.170113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.170181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.170266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.170323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.170395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.170437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.170442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.170500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.170557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.170614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.170665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.170703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.170708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.170765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:42.170819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:42.170878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:42.170946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:42.170996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:42.171000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:42.171055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616878996:2506], now have 1 active actors on pipe
2025-10-01T14:06:42.171329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254517616878996:2506]
2025-10-01T14:06:42.171375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:42.171381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:42.171405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 93 reason: error at write: Disconnected sessionId: src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0
2025-10-01T14:06:42.171580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:42.171613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 93 sessionId: src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0 is DEAD
2025-10-01T14:06:42.171733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:42.171743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0] Write session will restart in 0.009036s
2025-10-01T14:06:42.171766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0] Write session: Do CDS request
2025-10-01T14:06:42.171771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:42.172010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:42.181241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:42.181782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.181859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:42.181872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 94
2025-10-01T14:06:42.181959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.181982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 94 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:42.181991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=94 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:42.181995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:42.182023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:42.182265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 94 sessionId:  describe result for acl check
2025-10-01T14:06:42.182291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:42.182295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:42.182297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:42.182300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254517616879116:3076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:42.182334Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:42.182349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:42.182364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:42.182469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:42.182525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254515240019692:2909]
2025-10-01T14:06:42.182771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254517616879116:3076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:42.183160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:42.183581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:42.183650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:42.183985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:42.184052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.184058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.184060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.184061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.184062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.184063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.184064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.184065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.184066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.184067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.184068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.184069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.184071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.184072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.184078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.184087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.184091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.184095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.184098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.184102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.184105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.184108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.184111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.184116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.184119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.184123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.184126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.184129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.184135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.184144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.184150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.184155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.184160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.184164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.184168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.184173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.184178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.184183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.184187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.184192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.184196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.184207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.184212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.184221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.184225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.184235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.184239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.184248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.184251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.184256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.184260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.184269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.184274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.184280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.184288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.184292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.184326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:42.184829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254517616879116:3076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:42.187651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254517616879116:3076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:42.187665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254517616879116:3076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:42.187669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254517616879116:3076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:42.187676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 94 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:42.187876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:42.188489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:42.188503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:42.188505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:42.188509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:42.188515Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 93 [2:7556254515240019692:2909]
2025-10-01T14:06:42.188530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:42.188546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:42.188552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.188556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.188559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.188577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:42.188586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:42.188592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:42.188645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.188651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.188654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.188658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:42.188660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:42.188722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:42.188728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.188738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.188753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.188772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:42.188792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879155:3076], now have 1 active actors on pipe
2025-10-01T14:06:42.188799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879007:2446], now have 1 active actors on pipe
2025-10-01T14:06:42.188807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254515240019687:2909]
2025-10-01T14:06:42.188812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254515240019687:2909]
2025-10-01T14:06:42.188814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254515240019687:2909]
2025-10-01T14:06:42.188829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:42.188814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 93
2025-10-01T14:06:42.188835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 93
2025-10-01T14:06:42.188850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:42.188853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:42.188856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:42.188857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:42.188866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:42.188868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:42.188906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.188915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.188931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254515240019687:2909]
2025-10-01T14:06:42.188940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:42.188946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:42.188963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e898b45-b95543b-b29bcf0c-d760a074_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:42.188973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.188981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.188983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:42.188992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.189003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:42.189026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:42.189147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.189156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.189168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:42.189228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 94 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e898b45-b95543b-b29bcf0c-d760a074_0
2025-10-01T14:06:42.189551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7640bf50-f74cfebe-53053a5b-940d2d39_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e898b45-b95543b-b29bcf0c-d760a074_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:42.192016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e898b45-b95543b-b29bcf0c-d760a074_0] Write session: try to update token
2025-10-01T14:06:42.192033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e898b45-b95543b-b29bcf0c-d760a074_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:42.205241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 94 sessionId: src_id|5e898b45-b95543b-b29bcf0c-d760a074_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:42.207746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:42.209211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.209240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.209261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:42.209264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:42.209267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:42.209269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:42.209278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254515240019687:2909]
2025-10-01T14:06:42.209283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254515240019687:2909]
2025-10-01T14:06:42.209288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254515240019687:2909]
2025-10-01T14:06:42.209341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:42.209348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:42.209354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.209357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:42.209357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:42.209361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:42.209510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:42.271264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254517616879162:2506]
2025-10-01T14:06:42.271514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 93, pipe: [1:7556254517616879162:2506]
2025-10-01T14:06:42.357552Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:42.357916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:42.357973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879162:2506], now have 1 active actors on pipe
2025-10-01T14:06:42.358041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:42.358203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254517616879162:2506]
2025-10-01T14:06:42.358234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:42.367706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:42.367723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:42.367750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 94 reason: error at write: Disconnected sessionId: src_id|5e898b45-b95543b-b29bcf0c-d760a074_0
2025-10-01T14:06:42.367886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 94 sessionId: src_id|5e898b45-b95543b-b29bcf0c-d760a074_0 is DEAD
2025-10-01T14:06:42.368041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e898b45-b95543b-b29bcf0c-d760a074_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:42.368054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e898b45-b95543b-b29bcf0c-d760a074_0] Write session will restart in 0.009710s
2025-10-01T14:06:42.368080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e898b45-b95543b-b29bcf0c-d760a074_0] Write session: Do CDS request
2025-10-01T14:06:42.368089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e898b45-b95543b-b29bcf0c-d760a074_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:42.378398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:42.378952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e898b45-b95543b-b29bcf0c-d760a074_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.379360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:42.379543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:42.379554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:42.379565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:42.379609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:42.379650Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254515240019841:2911]
2025-10-01T14:06:42.379714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:42.379729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 95
2025-10-01T14:06:42.379923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.379954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 95 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:42.379965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=95 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:42.379969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:42.380275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:42.380377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 95 sessionId:  describe result for acl check
2025-10-01T14:06:42.380416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:42.380424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:42.380426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:42.380430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254517616879275:3080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:42.380695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:42.380738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:42.380983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254517616879275:3080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:42.381039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:42.381101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.381107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.381108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.381109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.381110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.381111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.381113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.381114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.381115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.381116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.381117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.381118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.381119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.381120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.381126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.381135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.381139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.381142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.381145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.381148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.381151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.381154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.381158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.381161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.381164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.381167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.381170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.381174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.381180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.381187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.381192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.381197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.381202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.381207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.381211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.381215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.381219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.381224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.381228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.381232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.381237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.381242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.381246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.381251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.381255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.381259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.381269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.381274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.381279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.381285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.381288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.381292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.381300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.381305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.381314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.381318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.381353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:42.383821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254517616879275:3080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:42.386481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:42.387335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:42.387357Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:42.387360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:42.387363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:42.387371Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 94 [2:7556254515240019841:2911]
2025-10-01T14:06:42.387392Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:42.387412Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:42.387417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.387421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.387423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.387444Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:42.387459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:42.387466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:42.387534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.387542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.387544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.387548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:42.387550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:42.387789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 94
2025-10-01T14:06:42.387625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:42.387636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.387651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.387661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.387673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:42.387693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879165:2446], now have 1 active actors on pipe
2025-10-01T14:06:42.387701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254515240019836:2911]
2025-10-01T14:06:42.387704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254515240019836:2911]
2025-10-01T14:06:42.387706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254515240019836:2911]
2025-10-01T14:06:42.387723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:42.387741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:42.387748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:42.387752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:42.387754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:42.387754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:42.387757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:42.387799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254515240019836:2911]
2025-10-01T14:06:42.387804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:42.387811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:42.394179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254517616879275:3080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:42.394196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254517616879275:3080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:42.394200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254517616879275:3080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:42.394210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 95 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:42.395009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879316:3080], now have 1 active actors on pipe
2025-10-01T14:06:42.395111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 94
2025-10-01T14:06:42.395306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.395320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.395354Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc931e87-8fdef659-61804b93-4db9a58d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:42.395366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.395373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.395376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:42.395397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.395413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:42.395436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:42.395776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.395788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.395807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:42.395952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 95 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc931e87-8fdef659-61804b93-4db9a58d_0
2025-10-01T14:06:42.398673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e898b45-b95543b-b29bcf0c-d760a074_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc931e87-8fdef659-61804b93-4db9a58d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:42.401540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc931e87-8fdef659-61804b93-4db9a58d_0] Write session: try to update token
2025-10-01T14:06:42.401561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc931e87-8fdef659-61804b93-4db9a58d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:42.400991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:42.401012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:42.401021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254515240019836:2911]
2025-10-01T14:06:42.401069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:42.401252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:42.401403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:42.401546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:42.401692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:42.401913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:42.401951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:42.402116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:42.435097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 95 sessionId: src_id|dc931e87-8fdef659-61804b93-4db9a58d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:42.434907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:42.434921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:42.434924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:42.434927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:42.434938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254515240019836:2911]
2025-10-01T14:06:42.434942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254515240019836:2911]
2025-10-01T14:06:42.434948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254515240019836:2911]
2025-10-01T14:06:42.434986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:42.434992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:42.434995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:42.434999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:42.435006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.435009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:42.435157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:42.438289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:42.458170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254517616879320:2506]
2025-10-01T14:06:42.458597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 94, pipe: [1:7556254517616879320:2506]
2025-10-01T14:06:42.590259Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:42.591527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.591548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.591577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879320:2506], now have 1 active actors on pipe
2025-10-01T14:06:42.591875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254517616879320:2506]
2025-10-01T14:06:42.591888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:42.591891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:42.591949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:42.591956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:42.592053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 95 reason: error at write: Disconnected sessionId: src_id|dc931e87-8fdef659-61804b93-4db9a58d_0
2025-10-01T14:06:42.592230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 95 sessionId: src_id|dc931e87-8fdef659-61804b93-4db9a58d_0 is DEAD
2025-10-01T14:06:42.592363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc931e87-8fdef659-61804b93-4db9a58d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:42.592371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc931e87-8fdef659-61804b93-4db9a58d_0] Write session will restart in 0.007776s
2025-10-01T14:06:42.592396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc931e87-8fdef659-61804b93-4db9a58d_0] Write session: Do CDS request
2025-10-01T14:06:42.592404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc931e87-8fdef659-61804b93-4db9a58d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:42.600955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc931e87-8fdef659-61804b93-4db9a58d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.601105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:42.601119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 96
2025-10-01T14:06:42.601254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.601286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 96 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:42.601297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=96 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:42.601300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:42.601815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 96 sessionId:  describe result for acl check
2025-10-01T14:06:42.601858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:42.601864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:42.601866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:42.601871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254517616879356:3085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:42.602560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254517616879356:3085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:42.604985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254517616879356:3085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:42.605739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:42.607059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:42.607326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254517616879356:3085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:42.607338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254517616879356:3085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:42.607341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254517616879356:3085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:42.607348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 96 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:42.607394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:42.607406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:42.607416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:42.607467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:42.607501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254515240019994:2914]
2025-10-01T14:06:42.608053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:42.608305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:42.608346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:42.608619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:42.608682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.608689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.608690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.608691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.608692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.608693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.608694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.608695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.608696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.608697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.608698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.608700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.608701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.608702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.608708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.608717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.608721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.608724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.608727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.608731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.608735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.608739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.608742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.608746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.608750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.608753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.608757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.608760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.608767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.608774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.608779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.608784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.608788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.608794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.608798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.608802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.608811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.608815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.608818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.608820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.608823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.608826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.608828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.608831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.608833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.608836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.608848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.608852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.608857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.608863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.608866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.608868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.608871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.608873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.608876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.608878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.608898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:42.613382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:42.615575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:42.615589Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:42.615591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:42.615594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:42.615599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 95 [2:7556254515240019994:2914]
2025-10-01T14:06:42.615615Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:42.615632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:42.615635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.615639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.615642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.615660Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:42.615665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:42.615672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:42.615727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.615735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.615738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.615741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:42.615744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:42.615807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:42.615816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.615826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.615839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.615857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:42.615878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879325:2446], now have 1 active actors on pipe
2025-10-01T14:06:42.615885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879471:3085], now have 1 active actors on pipe
2025-10-01T14:06:42.615892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254515240019989:2914]
2025-10-01T14:06:42.615895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254515240019989:2914]
2025-10-01T14:06:42.615897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254515240019989:2914]
2025-10-01T14:06:42.615908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:42.615920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:42.615921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:42.615928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:42.615931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:42.615934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:42.615936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:42.615931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 95
2025-10-01T14:06:42.615961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 95
2025-10-01T14:06:42.615971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254515240019989:2914]
2025-10-01T14:06:42.615979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:42.615980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:42.616004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.616011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.616054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:42.616064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.616067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.616069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:42.616077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.616090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:42.616114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:42.616281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.616291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.616307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:42.616363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 96 partition: 0 MaxSeqNo: 45 sessionId: src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0
2025-10-01T14:06:42.616689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc931e87-8fdef659-61804b93-4db9a58d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:42.624061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0] Write session: try to update token
2025-10-01T14:06:42.624079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:42.637547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:42.637571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:42.637573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:42.637575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:42.637584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254515240019989:2914]
2025-10-01T14:06:42.637589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254515240019989:2914]
2025-10-01T14:06:42.637592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254515240019989:2914]
2025-10-01T14:06:42.637640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:42.637643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:42.637648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.637648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:42.637650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:42.637650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:42.638012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:42.653204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 96 sessionId: src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:42.655686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:42.692143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254517616879483:2506]
2025-10-01T14:06:42.692487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 95, pipe: [1:7556254517616879483:2506]
2025-10-01T14:06:42.787830Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:42.788299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.788315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.788336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879483:2506], now have 1 active actors on pipe
2025-10-01T14:06:42.788585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:42.788595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:42.788600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:42.788641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254517616879483:2506]
2025-10-01T14:06:42.788663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 96 reason: error at write: Disconnected sessionId: src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0
2025-10-01T14:06:42.788577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:42.788834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 96 sessionId: src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0 is DEAD
2025-10-01T14:06:42.789015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:42.789026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0] Write session will restart in 0.009896s
2025-10-01T14:06:42.789053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0] Write session: Do CDS request
2025-10-01T14:06:42.789059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:42.799940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.800143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:42.800156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 97
2025-10-01T14:06:42.800267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.800297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 97 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:42.800306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=97 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:42.800309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:42.800629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:42.800716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 97 sessionId:  describe result for acl check
2025-10-01T14:06:42.800747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:42.800753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:42.800755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:42.800760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254517616879610:3090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:42.801266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254517616879610:3090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:42.801333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:42.801498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:42.801509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:42.801520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:42.801564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:42.801600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254515240020157:2917]
2025-10-01T14:06:42.802108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:42.802325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:42.802365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:42.802655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:42.802714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.802720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.802720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.802721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.802723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.802724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.802725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.802726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.802727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.802728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.802729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.802730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.802731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.802732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.802736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.802745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.802749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.802752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.802756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.802759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.802762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.802765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.802768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.802772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.802775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.802778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.802781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.802784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.802791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.802798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.802804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.802809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.802813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.802817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.802821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.802826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.802830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.802835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.802838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.802843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.802847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.802851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.802855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.802861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.802865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.802870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.802874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.802878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.802899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254517616879610:3090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:42.802882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.802887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.802890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.802895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.802900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.802904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.802908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.802912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.802947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:42.806347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254517616879610:3090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:42.806363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254517616879610:3090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:42.806367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254517616879610:3090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:42.806388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 97 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:42.806569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:42.807345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:42.807361Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:42.807363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:42.807367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:42.807374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 96 [2:7556254515240020157:2917]
2025-10-01T14:06:42.807388Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:42.807404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:42.807407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.807410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.807413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.807428Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:42.807439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:42.807445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:42.807493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.807502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.807504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.807507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:42.807510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:42.807574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:42.807583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.807594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.807603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.807622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:42.807645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879648:3090], now have 1 active actors on pipe
2025-10-01T14:06:42.807654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879497:2446], now have 1 active actors on pipe
2025-10-01T14:06:42.807660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254515240020152:2917]
2025-10-01T14:06:42.807663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254515240020152:2917]
2025-10-01T14:06:42.807665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254515240020152:2917]
2025-10-01T14:06:42.807678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:42.807683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 96
2025-10-01T14:06:42.807686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 96
2025-10-01T14:06:42.807695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:42.807696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:42.807704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:42.807706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:42.807711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:42.807714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:42.807741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254515240020152:2917]
2025-10-01T14:06:42.807754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:42.807760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:42.807769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.807779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.807824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b94a7159-409cd50e-8177459e-db4c24b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:42.807835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.807839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.807842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:42.807850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.807859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:42.807882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:42.808173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.808185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.808203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:42.808306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 97 partition: 0 MaxSeqNo: 45 sessionId: src_id|b94a7159-409cd50e-8177459e-db4c24b3_0
2025-10-01T14:06:42.808639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84b2bb47-cb6b5667-2f70edfb-7ba92c44_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b94a7159-409cd50e-8177459e-db4c24b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:42.810915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b94a7159-409cd50e-8177459e-db4c24b3_0] Write session: try to update token
2025-10-01T14:06:42.810932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b94a7159-409cd50e-8177459e-db4c24b3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:42.831865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:42.831897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:42.831902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:42.831915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:42.831933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254515240020152:2917]
2025-10-01T14:06:42.831940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254515240020152:2917]
2025-10-01T14:06:42.832033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254515240020152:2917]
2025-10-01T14:06:42.832101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:42.832111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:42.832118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:42.832123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.832125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:42.832126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:42.833073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:42.837561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 97 sessionId: src_id|b94a7159-409cd50e-8177459e-db4c24b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:42.843037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:42.888728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254517616879669:2506]
2025-10-01T14:06:42.889079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 96, pipe: [1:7556254517616879669:2506]
2025-10-01T14:06:42.980072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:42.980537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.980559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.980582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879669:2506], now have 1 active actors on pipe
2025-10-01T14:06:42.980818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254517616879669:2506]
2025-10-01T14:06:42.980825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:42.980829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:42.980863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:42.980908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 97 reason: error at write: Disconnected sessionId: src_id|b94a7159-409cd50e-8177459e-db4c24b3_0
2025-10-01T14:06:42.981010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:42.981067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 97 sessionId: src_id|b94a7159-409cd50e-8177459e-db4c24b3_0 is DEAD
2025-10-01T14:06:42.981236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94a7159-409cd50e-8177459e-db4c24b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:42.981247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94a7159-409cd50e-8177459e-db4c24b3_0] Write session will restart in 0.008962s
2025-10-01T14:06:42.981299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94a7159-409cd50e-8177459e-db4c24b3_0] Write session: Do CDS request
2025-10-01T14:06:42.981305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94a7159-409cd50e-8177459e-db4c24b3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:42.991604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:42.991906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b94a7159-409cd50e-8177459e-db4c24b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.991990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:42.992002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 98
2025-10-01T14:06:42.992140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:42.992167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 98 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:42.992171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=98 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:42.992173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:42.992524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 98 sessionId:  describe result for acl check
2025-10-01T14:06:42.992531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:42.992561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:42.992567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:42.992569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:42.992574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254517616879796:3101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:42.992805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:42.992817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:42.992829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:42.992898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:42.992952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254515240020345:2931]
2025-10-01T14:06:42.993068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254517616879796:3101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:42.993598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:42.993915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:42.993963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:42.994293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:42.994354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.994360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.994361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.994362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.994364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.994365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.994366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.994425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.994431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.994432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.994433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.994434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.994435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.994436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.994441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.994450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.994453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.994457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.994460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.994464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.994467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.994471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.994475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.994479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.994482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.994486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.994489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.994492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.994499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.994506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:42.994511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.994517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:42.994525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.994530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:42.994539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.994544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:42.994548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.994553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:42.994558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.994564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:42.994570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.994577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:42.994586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.994590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:42.994595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.994603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:42.994609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.994614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.994622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.994627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.994631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.994636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.994645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.994651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:42.994655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.994662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:42.994699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:42.995167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254517616879796:3101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:42.998331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254517616879796:3101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:42.998344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254517616879796:3101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:42.998348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254517616879796:3101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:42.998356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 98 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:42.998577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:42.999330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:42.999344Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:42.999346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:42.999350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:42.999355Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 97 [2:7556254515240020345:2931]
2025-10-01T14:06:42.999367Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:42.999382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:42.999384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.999386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.999387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.999399Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:42.999403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:42.999407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:42.999464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.999471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.999474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.999477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:42.999479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:42.999537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:42.999543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:42.999550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:42.999556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:42.999568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:42.999586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879683:2446], now have 1 active actors on pipe
2025-10-01T14:06:42.999593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254517616879832:3101], now have 1 active actors on pipe
2025-10-01T14:06:42.999598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254515240020339:2931]
2025-10-01T14:06:42.999600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254515240020339:2931]
2025-10-01T14:06:42.999601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254515240020339:2931]
2025-10-01T14:06:42.999612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:42.999624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:42.999627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:42.999631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:42.999633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:42.999636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:42.999639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:42.999647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 97
2025-10-01T14:06:42.999657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 97
2025-10-01T14:06:42.999667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254515240020339:2931]
2025-10-01T14:06:42.999675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:42.999678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:42.999709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.999715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.999762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:42.999772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:42.999779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:42.999781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:42.999790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:42.999802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:42.999822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:42.999954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:42.999959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:42.999968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:43.000079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 98 partition: 0 MaxSeqNo: 45 sessionId: src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0
2025-10-01T14:06:43.000431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94a7159-409cd50e-8177459e-db4c24b3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:43.003647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0] Write session: try to update token
2025-10-01T14:06:43.003669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:43.020276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 98 sessionId: src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:43.023093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:43.023337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.023362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.023393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:43.023464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:43.025784Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:43.025803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:43.025806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:43.025808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:43.025816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254515240020339:2931]
2025-10-01T14:06:43.025821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254515240020339:2931]
2025-10-01T14:06:43.025826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254515240020339:2931]
2025-10-01T14:06:43.025881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:43.025891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.025894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:43.025905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:43.025928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:43.025933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:43.026036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:43.081169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254521911847135:2506]
2025-10-01T14:06:43.081475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 97, pipe: [1:7556254521911847135:2506]
2025-10-01T14:06:43.173924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:43.183007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.183039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.183234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.183299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.183368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.183433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.183477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.183484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.183563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.183629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.183722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.183793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.183923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.183927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.184008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.184072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.184159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.184425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.184466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.184469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.184695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.184799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.184881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.184975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.185099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.185103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.185200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.185288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.185390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.185490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.185545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.185548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.185633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.185735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.185838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.185912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.185975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.185979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.186069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.186147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.186230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.186308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.188391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254521911847135:2506]
2025-10-01T14:06:43.188423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:43.188469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:43.188475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:43.188510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 98 reason: error at write: Disconnected sessionId: src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0
2025-10-01T14:06:43.188690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 98 sessionId: src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0 is DEAD
2025-10-01T14:06:43.186742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.186756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.186854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.186929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.186999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.187067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.187366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.187369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.187439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.187501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.187564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.187635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.187686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.187689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.187764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:43.187826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:43.187891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:43.187964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:43.188031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:43.188035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:43.188111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847135:2506], now have 1 active actors on pipe
2025-10-01T14:06:43.189335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:43.194472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:43.194486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0] Write session will restart in 0.006724s
2025-10-01T14:06:43.194513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0] Write session: Do CDS request
2025-10-01T14:06:43.194521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:43.202927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:43.202969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:43.202983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 99
2025-10-01T14:06:43.203120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:43.203162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 99 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:43.203171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=99 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:43.203175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:43.203567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 99 sessionId:  describe result for acl check
2025-10-01T14:06:43.203606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:43.203608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:43.203609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:43.203614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254521911847254:3106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:43.204137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254521911847254:3106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:43.205033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:43.205744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:43.205930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:43.205943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:43.205954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:43.206004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:43.206043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254519534987797:2934]
2025-10-01T14:06:43.206128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254521911847254:3106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:43.206634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:43.206924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:43.206968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:43.207257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:43.207315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.207320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.207321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.207322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.207323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.207323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.207325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.207326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.207326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.207327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.207328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.207329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.207330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.207331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.207335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.207344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.207347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.207350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.207353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.207356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.207359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.207362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.207365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.207369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.207371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.207374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.207378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.207381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.207387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.207394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.207400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.207404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.207409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.207414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.207418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.207423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.207428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.207433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.207437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.207441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.207446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.207452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.207457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.207462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.207466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.207471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.207476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.207481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.207485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.207490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.207494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.207499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.207503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.207513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.207517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.207526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.207564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:43.212299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254521911847254:3106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:43.212315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254521911847254:3106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:43.212318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254521911847254:3106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:43.212330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 99 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:43.212443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:43.213172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:43.213192Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:43.213195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:43.213198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:43.213206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 98 [2:7556254519534987797:2934]
2025-10-01T14:06:43.213223Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:43.213239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:43.213243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.213247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.213249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.213267Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:43.213272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:43.213279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:43.213334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.213344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.213346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.213349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:43.213352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:43.213422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:43.213429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.213441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.213450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.213470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:43.213492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847299:3106], now have 1 active actors on pipe
2025-10-01T14:06:43.213495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847146:2446], now have 1 active actors on pipe
2025-10-01T14:06:43.213502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254519534987792:2934]
2025-10-01T14:06:43.213504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254519534987792:2934]
2025-10-01T14:06:43.213507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254519534987792:2934]
2025-10-01T14:06:43.213521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:43.213538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:43.213540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:43.213544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:43.213546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:43.213555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:43.213559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:43.213558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 98
2025-10-01T14:06:43.213593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 98
2025-10-01T14:06:43.213594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254519534987792:2934]
2025-10-01T14:06:43.213601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:43.213603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:43.213618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.213627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.213674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2144888a-95411d98-cc474389-3d3dfa43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:43.213685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.213690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.213696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:43.213706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.213715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:43.213734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:43.213889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.213913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.213938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:43.214028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 99 partition: 0 MaxSeqNo: 45 sessionId: src_id|2144888a-95411d98-cc474389-3d3dfa43_0
2025-10-01T14:06:43.214415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ea19ef-2eb428a3-31a99840-c1eeb6c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2144888a-95411d98-cc474389-3d3dfa43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:43.216948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2144888a-95411d98-cc474389-3d3dfa43_0] Write session: try to update token
2025-10-01T14:06:43.216964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2144888a-95411d98-cc474389-3d3dfa43_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:43.242042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 99 sessionId: src_id|2144888a-95411d98-cc474389-3d3dfa43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:43.243090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:43.243113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:43.243116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:43.243118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:43.243127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254519534987792:2934]
2025-10-01T14:06:43.243130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254519534987792:2934]
2025-10-01T14:06:43.243134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254519534987792:2934]
2025-10-01T14:06:43.243188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:43.243199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.243205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:43.243214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:43.243238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:43.243242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:43.243382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:43.244445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:43.286601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254521911847306:2506]
2025-10-01T14:06:43.286910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 98, pipe: [1:7556254521911847306:2506]
2025-10-01T14:06:43.381813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:43.382238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.382254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.382288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847306:2506], now have 1 active actors on pipe
2025-10-01T14:06:43.382478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:43.382586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:43.382625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254521911847306:2506]
2025-10-01T14:06:43.382652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:43.382681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 99 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2144888a-95411d98-cc474389-3d3dfa43_0
2025-10-01T14:06:43.382912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 99 sessionId: src_id|2144888a-95411d98-cc474389-3d3dfa43_0 is DEAD
2025-10-01T14:06:43.383068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2144888a-95411d98-cc474389-3d3dfa43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:43.383078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2144888a-95411d98-cc474389-3d3dfa43_0] Write session will restart in 0.009387s
2025-10-01T14:06:43.383105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2144888a-95411d98-cc474389-3d3dfa43_0] Write session: Do CDS request
2025-10-01T14:06:43.383111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2144888a-95411d98-cc474389-3d3dfa43_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:43.393800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2144888a-95411d98-cc474389-3d3dfa43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:43.393902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:43.393915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 100
2025-10-01T14:06:43.394000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:43.394028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:43.394037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:43.394042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:43.394134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:43.394451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 100 sessionId:  describe result for acl check
2025-10-01T14:06:43.394502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:43.394507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:43.394509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:43.394514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254521911847425:3110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:43.394850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:43.394984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:43.394994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:43.395005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:43.395033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254521911847425:3110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:43.395048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:43.395101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254519534987951:2936]
2025-10-01T14:06:43.395528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:43.395830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:43.395872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:43.396149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:43.396218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.396225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.396226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.396227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.396228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.396229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.396233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.396234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.396235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.396236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.396237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.396238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.396239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.396240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.396244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.396252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.396255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.396258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.396261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.396264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.396268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.396270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.396273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.396278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.396281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.396284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.396287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.396290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.396296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.396302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.396307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.396311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.396315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.396319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.396322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.396327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.396331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.396335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.396339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.396344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.396348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.396353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.396357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.396361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.396366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.396371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.396374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.396379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.396388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.396392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.396402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.396406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.396410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.396415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.396423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.396428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.396468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:43.396761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254521911847425:3110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:43.399705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254521911847425:3110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:43.399717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254521911847425:3110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:43.399721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254521911847425:3110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:43.399728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:43.401191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:43.401966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:43.401981Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:43.401982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:43.401985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:43.401990Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 99 [2:7556254519534987951:2936]
2025-10-01T14:06:43.402000Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:43.402011Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:43.402013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.402016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.402017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.402030Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:43.402033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:43.402038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:43.402075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.402081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.402082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.402086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:43.402088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:43.402141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:43.402147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.402153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.402159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.402167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:43.402184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254519534987945:2936]
2025-10-01T14:06:43.402190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254519534987945:2936]
2025-10-01T14:06:43.402191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254519534987945:2936]
2025-10-01T14:06:43.402197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:43.402207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:43.402210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:43.402214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:43.402217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:43.402219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:43.402221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:43.402228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847309:2446], now have 1 active actors on pipe
2025-10-01T14:06:43.402231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847463:3110], now have 1 active actors on pipe
2025-10-01T14:06:43.402249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254519534987945:2936]
2025-10-01T14:06:43.402256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:43.402268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:43.402312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 99
2025-10-01T14:06:43.402319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 99
2025-10-01T14:06:43.402457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.402477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.402529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:43.402546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.402552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.402555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:43.402569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.402588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:43.402614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:43.402787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.402802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.402823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:43.402921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 100 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0
2025-10-01T14:06:43.403350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2144888a-95411d98-cc474389-3d3dfa43_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:43.406940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0] Write session: try to update token
2025-10-01T14:06:43.406959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:43.424260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 100 sessionId: src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:43.428999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:43.430278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.430305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.430323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:43.430325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:43.430327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:43.430328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:43.430336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254519534987945:2936]
2025-10-01T14:06:43.430339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254519534987945:2936]
2025-10-01T14:06:43.430343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254519534987945:2936]
2025-10-01T14:06:43.430401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:43.430415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:43.430417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:43.430419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:43.430423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.430425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:43.430826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:43.482666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254521911847471:2506]
2025-10-01T14:06:43.483056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 99, pipe: [1:7556254521911847471:2506]
2025-10-01T14:06:43.580975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:43.581384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:43.581444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847471:2506], now have 1 active actors on pipe
2025-10-01T14:06:43.582418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:43.582529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:43.582537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:43.582606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 100 reason: error at write: Disconnected sessionId: src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0
2025-10-01T14:06:43.582755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 100 sessionId: src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0 is DEAD
2025-10-01T14:06:43.582898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:43.582942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254521911847471:2506]
2025-10-01T14:06:43.586593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:43.586616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0] Write session will restart in 0.009725s
2025-10-01T14:06:43.586647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0] Write session: Do CDS request
2025-10-01T14:06:43.586656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:43.597894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:43.598126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:43.598144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 101
2025-10-01T14:06:43.598283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:43.598330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:43.598337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:43.598342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:43.598854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 101 sessionId:  describe result for acl check
2025-10-01T14:06:43.598896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:43.598903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:43.598908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:43.598913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254521911847571:3115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:43.599467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254521911847571:3115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:43.602288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254521911847571:3115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:43.603400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:43.607229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254521911847571:3115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:43.607240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254521911847571:3115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:43.607243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254521911847571:3115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:43.607254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:43.607103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:43.607366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:43.607371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:43.607382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:43.607433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:43.607471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254519534988109:2939]
2025-10-01T14:06:43.608086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:43.608403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:43.608446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:43.608780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:43.608824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.608825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.608827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.608828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.608829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.608830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.608831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.608832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.608833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.608834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.608835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.608837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.608851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.608852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.608858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.608867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.608871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.608874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.608878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.608881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.608885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.608889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.608892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.608896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.608900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.608904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.608907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.608910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.608916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.608923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.608929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.608936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.608941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.608946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.608950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.608955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.608960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.608965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.608969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.608974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.608981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.608986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.608991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.608996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.609001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.609006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.609011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.609016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.609021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.609026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.609033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.609038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.609042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.609047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.609051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.609056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.609095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:43.617349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f70bdeb-22fdfe6c-b6be02fc-52fa15b5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|536b0e0d-73399d09-47672253-138ae3f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:43.616260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 100
2025-10-01T14:06:43.616290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 100
2025-10-01T14:06:43.616925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 101 partition: 0 MaxSeqNo: 45 sessionId: src_id|536b0e0d-73399d09-47672253-138ae3f7_0
2025-10-01T14:06:43.614619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:43.615407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:43.615414Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:43.615417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:43.615420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:43.615428Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 100 [2:7556254519534988109:2939]
2025-10-01T14:06:43.615446Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:43.615464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:43.615468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.615473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.615475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.615493Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:43.615499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:43.615506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:43.615575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.615577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.615579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.615582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:43.615585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:43.615663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:43.615667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.615680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.615691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.615708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:43.615726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254519534988104:2939]
2025-10-01T14:06:43.615728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254519534988104:2939]
2025-10-01T14:06:43.615731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254519534988104:2939]
2025-10-01T14:06:43.615748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:43.615768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:43.615783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:43.615786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:43.615799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:43.615803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:43.615805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:43.615825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254519534988104:2939]
2025-10-01T14:06:43.615829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:43.615863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:43.615883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847625:3115], now have 1 active actors on pipe
2025-10-01T14:06:43.615888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847475:2446], now have 1 active actors on pipe
2025-10-01T14:06:43.616546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.616553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.616584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|536b0e0d-73399d09-47672253-138ae3f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:43.616592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.616597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.616599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:43.616609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.616620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:43.616640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:43.616811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.616816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.616836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:43.620182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|536b0e0d-73399d09-47672253-138ae3f7_0] Write session: try to update token
2025-10-01T14:06:43.620199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|536b0e0d-73399d09-47672253-138ae3f7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:43.641823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 101 sessionId: src_id|536b0e0d-73399d09-47672253-138ae3f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:43.643918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:43.643946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:43.643949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:43.643951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:43.643961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254519534988104:2939]
2025-10-01T14:06:43.643966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254519534988104:2939]
2025-10-01T14:06:43.643971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254519534988104:2939]
2025-10-01T14:06:43.644030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:43.644047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.644055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:43.644239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:43.644243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:43.644253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:43.644258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:43.644610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:43.689514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 14 EndOffset 35 InitDone 1 WaitForData 0, pipe: [1:7556254521911847638:2506]
2025-10-01T14:06:43.690153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 100, pipe: [1:7556254521911847638:2506]
2025-10-01T14:06:43.785887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:43.786297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.786310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.786344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847638:2506], now have 1 active actors on pipe
2025-10-01T14:06:43.786579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:43.786673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254521911847638:2506]
2025-10-01T14:06:43.786811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:43.786885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 101 reason: status is not ok: tablet will be restarted right now sessionId: src_id|536b0e0d-73399d09-47672253-138ae3f7_0
2025-10-01T14:06:43.787073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 101 sessionId: src_id|536b0e0d-73399d09-47672253-138ae3f7_0 is DEAD
2025-10-01T14:06:43.787235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|536b0e0d-73399d09-47672253-138ae3f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:43.787245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|536b0e0d-73399d09-47672253-138ae3f7_0] Write session will restart in 0.005806s
2025-10-01T14:06:43.787264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|536b0e0d-73399d09-47672253-138ae3f7_0] Write session: Do CDS request
2025-10-01T14:06:43.787270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|536b0e0d-73399d09-47672253-138ae3f7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:43.787256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:43.787285Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:06:43.787541Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_1_1_2649111627664798049_v1 is DEAD
2025-10-01T14:06:43.787668Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:06:43.787707Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254431717521839:2501] disconnected; active server actors: 1
2025-10-01T14:06:43.787715Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254431717521839:2501] client user disconnected session shared/user_1_1_2649111627664798049_v1
2025-10-01T14:06:43.787834Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 9011741, ReadSizeServerDelta = -8487453
2025-10-01T14:06:43.787839Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:06:43.787863Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.008111s
2025-10-01T14:06:43.793878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|536b0e0d-73399d09-47672253-138ae3f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:43.794012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:43.794028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 102
2025-10-01T14:06:43.794168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:43.794199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:43.794213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:43.794217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:43.794605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 102 sessionId:  describe result for acl check
2025-10-01T14:06:43.794634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:43.794639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:43.794640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:43.794645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254521911847675:3120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:43.795214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254521911847675:3120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:43.799657Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:06:43.799282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254521911847675:3120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:43.800491Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:06:43.800495Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-10-01T14:06:43.801282Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:43.801348Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:06:43.801456Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 auth for : user
2025-10-01T14:06:43.803839Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 Handle describe topics response
2025-10-01T14:06:43.803871Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 auth is DEAD
2025-10-01T14:06:43.803893Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:06:43.804358Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:06:43.806833Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254521911847727:3124] connected; active server actors: 1
2025-10-01T14:06:43.806848Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556254521911847727:3124] session shared/user_1_2_13227607149598433976_v1
2025-10-01T14:06:43.806871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:06:43.806884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:06:43.806892Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_2_13227607149598433976_v1" (Sender=[1:7556254521911847724:3124], Pipe=[1:7556254521911847727:3124], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:43.806898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:06:43.806911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:06:43.806922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_2_13227607149598433976_v1" (Sender=[1:7556254521911847724:3124], Pipe=[1:7556254521911847727:3124], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:06:43.806934Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_2_13227607149598433976_v1" sender [1:7556254521911847724:3124] lock partition 0 for ReadingSession "shared/user_1_2_13227607149598433976_v1" (Sender=[1:7556254521911847724:3124], Pipe=[1:7556254521911847727:3124], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-10-01T14:06:43.806951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:06:43.806958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000042s
2025-10-01T14:06:43.807283Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 2 Session: "shared/user_1_2_13227607149598433976_v1" ClientId: "user" PipeClient { RawX1: 7556254521911847727 RawX2: 4503603922340916 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:06:43.807303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:06:43.811219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254521911847675:3120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:43.811237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254521911847675:3120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:43.811244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254521911847675:3120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:43.811255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:43.818457Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_2_13227607149598433976_v1
2025-10-01T14:06:43.834589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:43.842688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:43.843005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:43.843010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:43.843024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:43.843093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:43.843137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254519534988279:2942]
2025-10-01T14:06:43.843889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:43.850560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:43.850667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:43.851128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:43.851215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.851217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.851218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.851220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.851221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.851224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.851225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.851227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.851228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.851229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.851231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.851233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.851234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.851236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.851244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.851256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.851262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.851267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.851272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.851276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.851281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.851285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.851290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.851295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.851299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.851303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.851308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.851312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.851322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.851332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:43.851340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.851348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:43.851354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.851361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:43.851366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.851373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:43.851382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.851389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:43.851394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.851400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:43.851406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.851413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:43.851418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.851424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:43.851431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.851435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:43.851440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.851445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.851451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.851458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.851463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.851470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.851476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.851482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:43.851487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.851493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:43.851538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:43.872351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:43.873038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:43.873043Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:43.873049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:43.873053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:43.873059Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 101 [2:7556254519534988279:2942]
2025-10-01T14:06:43.873073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:43.873091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:43.873094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.873097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.873099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.873114Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:43.873119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:43.873125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:43.873301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.873303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.873304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.873306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:43.873308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:43.873376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:43.873379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.873386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:43.873392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:43.873403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:43.873416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254519534988273:2942]
2025-10-01T14:06:43.873417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254519534988273:2942]
2025-10-01T14:06:43.873419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254519534988273:2942]
2025-10-01T14:06:43.873426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:43.873439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:43.873447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:43.873449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:43.873482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254519534988273:2942]
2025-10-01T14:06:43.873483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:43.874462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:43.874484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:43.874488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:43.874496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:43.874789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847736:3120], now have 1 active actors on pipe
2025-10-01T14:06:43.874815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847733:3127], now have 1 active actors on pipe
2025-10-01T14:06:43.874824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254521911847652:2446], now have 1 active actors on pipe
2025-10-01T14:06:43.878622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 101
2025-10-01T14:06:43.878691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 101, pipe: [1:7556254521911847733:3127]
2025-10-01T14:06:43.878722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 101
2025-10-01T14:06:43.880680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.880703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.880723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.880725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.880733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_2_13227607149598433976_v1 on pipe: [1:7556254521911847733:3127]
2025-10-01T14:06:43.880764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:43.880773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.880772Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_2_13227607149598433976_v1:1 with generation 101
2025-10-01T14:06:43.880777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.880780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:43.880789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.880804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:43.880816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.880819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.880820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:43.880849Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_2_13227607149598433976_v1
2025-10-01T14:06:43.880853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.880889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:43.880906Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:06:43.881586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.881595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.881610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:43.881726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 102 partition: 0 MaxSeqNo: 45 sessionId: src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0
2025-10-01T14:06:43.882132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|536b0e0d-73399d09-47672253-138ae3f7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:43.884140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:06:43.884171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:06:43.884177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:43.884179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:43.884181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:43.884189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:06:43.884197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:06:43.884407Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327603880 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:06:43.884426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:06:43.884455Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 sending to client partition status
2025-10-01T14:06:43.884987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0] Write session: try to update token
2025-10-01T14:06:43.885006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:43.891027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:43.891044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:43.891054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254519534988273:2942]
2025-10-01T14:06:43.891105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:43.891104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:43.891293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:43.891450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:43.891577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:43.891713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:43.891875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:43.891903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:43.909407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:43.909432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:43.909468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:43.906425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 102 sessionId: src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:43.909181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:43.909563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:43.915366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:43.915386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:43.915388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:43.915390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:43.915402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254519534988273:2942]
2025-10-01T14:06:43.915406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254519534988273:2942]
2025-10-01T14:06:43.915410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254519534988273:2942]
2025-10-01T14:06:43.915459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:43.915463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:43.915467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:43.915470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:43.915471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:43.915475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:43.915735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:44.074754Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:44.082852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.082882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.083025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.083080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.083146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.083206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.083251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.083261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.083320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.083377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.083430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.083522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.083565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.083573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.083639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.083698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.083780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.083849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.083892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.083894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.083963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.084027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.084090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.084157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.084207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.084214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.084280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.084337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.084437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.084497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.084551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.084558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.084619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.084712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.084774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.084831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.084885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.084892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.084981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.085036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.085161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.085252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.085388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.085396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.085454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.085509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.085568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.085625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.085682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.085688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.085748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.085809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.085866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.085921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.085976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.085983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.086040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:44.086091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:44.086146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:44.086198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:44.086236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:44.086242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:44.086526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:44.086541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:44.086568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 102 reason: error at write: Disconnected sessionId: src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0
2025-10-01T14:06:44.086781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 102 sessionId: src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0 is DEAD
2025-10-01T14:06:44.086922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:44.086932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0] Write session will restart in 0.008938s
2025-10-01T14:06:44.086959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0] Write session: Do CDS request
2025-10-01T14:06:44.086965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:44.087207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254521911847733:3127]
2025-10-01T14:06:44.087235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:44.087297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_2_13227607149598433976_v1
2025-10-01T14:06:44.087313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:44.087324Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_2_13227607149598433976_v1
2025-10-01T14:06:44.096924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.097053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:44.097067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 103
2025-10-01T14:06:44.097225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.097258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:44.097267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:44.097270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:44.097887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 103 sessionId:  describe result for acl check
2025-10-01T14:06:44.097922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:44.097924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:44.097926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:44.097931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254526206815268:3136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:44.098461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254526206815268:3136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:44.101524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254526206815268:3136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:44.104957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254526206815268:3136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:44.104971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254526206815268:3136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:44.104975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254526206815268:3136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:44.104983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:44.102884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:44.104289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:44.104495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:44.104499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:44.104511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:44.104567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:44.104605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254523829955770:2956]
2025-10-01T14:06:44.105233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:44.105481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:44.105528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:44.105852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:44.105921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.105923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.105924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.105925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.105926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.105927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.105929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.105930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.105931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.105932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.105933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.105934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.105935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.105937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.105943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.105954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.105959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.105964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.105968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.105972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.105976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.105980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.105983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.105987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.105991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.105994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.105998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.106001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.106009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.106017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.106024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.106029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.106034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.106039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.106044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.106050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.106054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.106060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.106064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.106069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.106074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.106079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.106084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.106089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.106093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.106098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.106103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.106108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.106112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.106117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.106121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.106127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.106131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.106136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.106140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.106146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.106185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:44.110725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:44.111398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:44.111422Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:44.111425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:44.111428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:44.111434Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 102 [2:7556254523829955770:2956]
2025-10-01T14:06:44.111450Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:44.111468Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:44.111471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.111474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.111477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.111494Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:44.111500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:44.111505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:44.111565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.111577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.111579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.111583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:44.111585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:44.111659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:44.111667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.111680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.111694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.111714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:44.111738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815305:3136], now have 1 active actors on pipe
2025-10-01T14:06:44.111746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815144:2446], now have 1 active actors on pipe
2025-10-01T14:06:44.111754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254523829955765:2956]
2025-10-01T14:06:44.111762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254523829955765:2956]
2025-10-01T14:06:44.111764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254523829955765:2956]
2025-10-01T14:06:44.111777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:44.111796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:44.111794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:44.111799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:44.111801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:44.111776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 102
2025-10-01T14:06:44.111776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 102
2025-10-01T14:06:44.111816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:44.111822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:44.111872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.111882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.111895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254523829955765:2956]
2025-10-01T14:06:44.111906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:44.111914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:44.111938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2aea501d-4d7ea01-1568f995-9393847e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:44.111950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.111953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.111956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:44.111965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.111978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:44.112004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.112140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.112150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.112165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.112224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 103 partition: 0 MaxSeqNo: 45 sessionId: src_id|2aea501d-4d7ea01-1568f995-9393847e_0
2025-10-01T14:06:44.112620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2e721bc-35aa2739-4b43b88e-7a42d0fe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2aea501d-4d7ea01-1568f995-9393847e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:44.115641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501d-4d7ea01-1568f995-9393847e_0] Write session: try to update token
2025-10-01T14:06:44.115665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501d-4d7ea01-1568f995-9393847e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:44.131579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 103 sessionId: src_id|2aea501d-4d7ea01-1568f995-9393847e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:44.133186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:44.133209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:44.133211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:44.133213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:44.133222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254523829955765:2956]
2025-10-01T14:06:44.133226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254523829955765:2956]
2025-10-01T14:06:44.133229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254523829955765:2956]
2025-10-01T14:06:44.133279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:44.133286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:44.133290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.133292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:44.133306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:44.133309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:44.133423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:44.133934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:44.187200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254526206815320:3127]
2025-10-01T14:06:44.187505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 102, pipe: [1:7556254526206815320:3127]
2025-10-01T14:06:44.293686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:44.294024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.294038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.294073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815320:3127], now have 1 active actors on pipe
2025-10-01T14:06:44.294329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:44.294872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:44.294975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 103 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2aea501d-4d7ea01-1568f995-9393847e_0
2025-10-01T14:06:44.295175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 103 sessionId: src_id|2aea501d-4d7ea01-1568f995-9393847e_0 is DEAD
2025-10-01T14:06:44.295383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254526206815320:3127]
2025-10-01T14:06:44.295404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:44.296412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501d-4d7ea01-1568f995-9393847e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:44.296424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501d-4d7ea01-1568f995-9393847e_0] Write session will restart in 0.009509s
2025-10-01T14:06:44.296457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501d-4d7ea01-1568f995-9393847e_0] Write session: Do CDS request
2025-10-01T14:06:44.296463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501d-4d7ea01-1568f995-9393847e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:44.306904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501d-4d7ea01-1568f995-9393847e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.306773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:44.307622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:44.307635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 104
2025-10-01T14:06:44.307759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.307783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:44.307788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:44.307792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:44.308186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:44.308391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:44.308395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:44.308406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:44.308470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:44.308504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254523829955930:2959]
2025-10-01T14:06:44.308231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 104 sessionId:  describe result for acl check
2025-10-01T14:06:44.308266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:44.308268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:44.308271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:44.308277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254526206815442:3140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:44.308754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254526206815442:3140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:44.309075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:44.309405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:44.309450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:44.309761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:44.309828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.309834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.309836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.309837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.309838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.309839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.309840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.309841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.309842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.309843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.309844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.309845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.309846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.309847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.309852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.309861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.309865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.309868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.309872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.309876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.309879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.309882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.309885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.309891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.309894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.309897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.309900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.309903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.309909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.309917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.309923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.309929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.309933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.309938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.309942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.309947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.309952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.309956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.309960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.309965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.309971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.309976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.309979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.309984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.309988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.309993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.309997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.310001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.310006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.310010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.310015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.310019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.310022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.310026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.310030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.310034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.310068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:44.310450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254526206815442:3140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:44.313958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254526206815442:3140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:44.313966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254526206815442:3140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:44.313969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254526206815442:3140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:44.313978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:44.315721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:44.316408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:44.316421Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:44.316423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:44.316426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:44.316431Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 103 [2:7556254523829955930:2959]
2025-10-01T14:06:44.316443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:44.316457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:44.316459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.316461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.316462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.316475Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:44.316478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:44.316482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:44.316533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.316542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.316544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.316546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:44.316548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:44.316596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:44.316601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.316608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.316614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.316623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:44.316635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254523829955924:2959]
2025-10-01T14:06:44.316637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254523829955924:2959]
2025-10-01T14:06:44.316638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254523829955924:2959]
2025-10-01T14:06:44.316645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:44.316658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815479:3140], now have 1 active actors on pipe
2025-10-01T14:06:44.316665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:44.316676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:44.316679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:44.316684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:44.316687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:44.316689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:44.316713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254523829955924:2959]
2025-10-01T14:06:44.316715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:44.316717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:44.316719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815322:2446], now have 1 active actors on pipe
2025-10-01T14:06:44.318633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 103
2025-10-01T14:06:44.318697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 103
2025-10-01T14:06:44.319550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.319565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.319590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f5babd3-47b51641-7dc71eff-734d113c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:44.319597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.319601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.319603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:44.319612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.319623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:44.319639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.321603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.321622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.321647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.323228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 104 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f5babd3-47b51641-7dc71eff-734d113c_0
2025-10-01T14:06:44.326063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aea501d-4d7ea01-1568f995-9393847e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f5babd3-47b51641-7dc71eff-734d113c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:44.328750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5babd3-47b51641-7dc71eff-734d113c_0] Write session: try to update token
2025-10-01T14:06:44.328768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5babd3-47b51641-7dc71eff-734d113c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:44.340583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:44.340610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:44.340613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:44.340615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:44.340626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254523829955924:2959]
2025-10-01T14:06:44.340631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254523829955924:2959]
2025-10-01T14:06:44.340635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254523829955924:2959]
2025-10-01T14:06:44.340688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:44.340692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:44.340701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.340701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:44.340703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:44.340705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:44.340862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:44.355937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 104 sessionId: src_id|2f5babd3-47b51641-7dc71eff-734d113c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:44.358697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:44.395594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254526206815487:3127]
2025-10-01T14:06:44.395893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 103, pipe: [1:7556254526206815487:3127]
2025-10-01T14:06:44.513018Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:44.513475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.513492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.513516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815487:3127], now have 1 active actors on pipe
2025-10-01T14:06:44.513726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:44.513730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254526206815487:3127]
2025-10-01T14:06:44.513755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:44.513758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:44.513822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 104 reason: error at write: Disconnected sessionId: src_id|2f5babd3-47b51641-7dc71eff-734d113c_0
2025-10-01T14:06:44.513831Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:44.513997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 104 sessionId: src_id|2f5babd3-47b51641-7dc71eff-734d113c_0 is DEAD
2025-10-01T14:06:44.514170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5babd3-47b51641-7dc71eff-734d113c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:44.514184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5babd3-47b51641-7dc71eff-734d113c_0] Write session will restart in 0.007346s
2025-10-01T14:06:44.514212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5babd3-47b51641-7dc71eff-734d113c_0] Write session: Do CDS request
2025-10-01T14:06:44.514219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5babd3-47b51641-7dc71eff-734d113c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:44.522836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5babd3-47b51641-7dc71eff-734d113c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.523028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:44.523042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 105
2025-10-01T14:06:44.523181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.523213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:44.523222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:44.523226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:44.523620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 105 sessionId:  describe result for acl check
2025-10-01T14:06:44.523651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:44.523655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:44.523657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:44.523662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254526206815609:3145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:44.524157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254526206815609:3145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:44.525052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:44.525854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254526206815609:3145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:44.526092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:44.526280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:44.526290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:44.526302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:44.526354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:44.526405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254523829956092:2962]
2025-10-01T14:06:44.526950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:44.527267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:44.527310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:44.527601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:44.527663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.527673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.527674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.527675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.527676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.527677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.527678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.527679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.527680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.527681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.527682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.527683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.527684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.527685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.527690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.527700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.527703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.527707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.527710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.527714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.527718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.527721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.527725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.527729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.527732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.527735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.527738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.527742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.527748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.527761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.527785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.527796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.527800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.527805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.527812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.527816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.527824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.527832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.527836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.527840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.527844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.527852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.527860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.527864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.527872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.527877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.527881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.527888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.527892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.527901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.527906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.527910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.527918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.527926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.527933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.527941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.527978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:44.528326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254526206815609:3145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:44.528337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254526206815609:3145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:44.528340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254526206815609:3145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:44.528346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:44.531941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:44.532692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:44.532705Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:44.532708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:44.532712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:44.532722Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 104 [2:7556254523829956092:2962]
2025-10-01T14:06:44.532739Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:44.532756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:44.532766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.532769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.532771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.532788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:44.532793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:44.532799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:44.532877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.532884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.532886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.532889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:44.532892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:44.532962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:44.532969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.532981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.532996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.533018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:44.533039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815492:2446], now have 1 active actors on pipe
2025-10-01T14:06:44.533047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815651:3145], now have 1 active actors on pipe
2025-10-01T14:06:44.533055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254523829956086:2962]
2025-10-01T14:06:44.533061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254523829956086:2962]
2025-10-01T14:06:44.533064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254523829956086:2962]
2025-10-01T14:06:44.533077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:44.533094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:44.533096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:44.533101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:44.533104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:44.533112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:44.533115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:44.533146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254523829956086:2962]
2025-10-01T14:06:44.533117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 104
2025-10-01T14:06:44.533153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:44.533137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 104
2025-10-01T14:06:44.533157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:44.533186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.533195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.533223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:44.533233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.533237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.533244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:44.533252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.533265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:44.533285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.533422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.533430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.533445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.533562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 105 partition: 0 MaxSeqNo: 45 sessionId: src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0
2025-10-01T14:06:44.533903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5babd3-47b51641-7dc71eff-734d113c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:44.537089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0] Write session: try to update token
2025-10-01T14:06:44.537109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:44.556368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 105 sessionId: src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:44.556796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:44.556821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:44.556824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:44.556826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:44.556848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254523829956086:2962]
2025-10-01T14:06:44.556853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254523829956086:2962]
2025-10-01T14:06:44.556858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254523829956086:2962]
2025-10-01T14:06:44.556916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:44.556917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:44.556924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:44.556924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.556927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:44.556929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:44.557072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:44.559299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:44.613723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254526206815658:3127]
2025-10-01T14:06:44.614237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 104, pipe: [1:7556254526206815658:3127]
2025-10-01T14:06:44.716423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:44.716952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.716963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.717007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815658:3127], now have 1 active actors on pipe
2025-10-01T14:06:44.718137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:44.718018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254526206815658:3127]
2025-10-01T14:06:44.718051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:44.718054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:44.718113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 105 reason: error at write: Disconnected sessionId: src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0
2025-10-01T14:06:44.718290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:44.718325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 105 sessionId: src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0 is DEAD
2025-10-01T14:06:44.720987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:44.721001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0] Write session will restart in 0.009439s
2025-10-01T14:06:44.721031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0] Write session: Do CDS request
2025-10-01T14:06:44.721037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:44.732041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.732408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:44.732423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 106
2025-10-01T14:06:44.732613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.732643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:44.732648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:44.732652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:44.733132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 106 sessionId:  describe result for acl check
2025-10-01T14:06:44.733156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:44.733158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:44.733160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:44.733166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254526206815676:3149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:44.733707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254526206815676:3149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:44.737864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254526206815676:3149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:44.742872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254526206815676:3149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:44.742891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254526206815676:3149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:44.742895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254526206815676:3149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:44.742904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:44.747623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:44.748569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:44.748767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:44.748779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:44.748789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:44.748846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:44.748893Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254523829956264:2964]
2025-10-01T14:06:44.749455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:44.749725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:44.749767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:44.750157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:44.750200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.750204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.750205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.750205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.750206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.750207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.750208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.750209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.750209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.750210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.750211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.750211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.750212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.750212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.750216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.750222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.750224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.750226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.750229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.750231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.750233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.750235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.750237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.750239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.750241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.750243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.750245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.750247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.750251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.750256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.750260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.750263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.750265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.750268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.750270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.750273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.750276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.750279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.750281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.750283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.750286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.750289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.750291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.750294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.750296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.750299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.750301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.750304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.750307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.750310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.750312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.750315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.750318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.750320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.750323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.750326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.750347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:44.754026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:44.754714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:44.754735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:44.754738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:44.754741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:44.754748Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 105 [2:7556254523829956264:2964]
2025-10-01T14:06:44.754764Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:44.754781Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:44.754789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.754793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.754800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.754816Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:44.754826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:44.754837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:44.754903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.754910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.754912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.754915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:44.754917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:44.754985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:44.754993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.755003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.755012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.755024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:44.755042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815816:3149], now have 1 active actors on pipe
2025-10-01T14:06:44.755049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815661:2446], now have 1 active actors on pipe
2025-10-01T14:06:44.755057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254523829956248:2964]
2025-10-01T14:06:44.755062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254523829956248:2964]
2025-10-01T14:06:44.755064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254523829956248:2964]
2025-10-01T14:06:44.755077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:44.755094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:44.755093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:44.755096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:44.755098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:44.755111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:44.755113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:44.755148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254523829956248:2964]
2025-10-01T14:06:44.755155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:44.755168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:44.755141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 105
2025-10-01T14:06:44.755164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 105
2025-10-01T14:06:44.755195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.755204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.755239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:44.755249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.755257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.755259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:44.755268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.755280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:44.755300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.755454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.755462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.755478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.755581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 106 partition: 0 MaxSeqNo: 45 sessionId: src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0
2025-10-01T14:06:44.755949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c518c7-f6b358dc-c11c7aea-70280039_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:44.758803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0] Write session: try to update token
2025-10-01T14:06:44.758820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:44.780996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 106 sessionId: src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:44.781131Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:44.781154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:44.781157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:44.781158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:44.781168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254523829956248:2964]
2025-10-01T14:06:44.781171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254523829956248:2964]
2025-10-01T14:06:44.781174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254523829956248:2964]
2025-10-01T14:06:44.781229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:44.781240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.781243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:44.781372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:44.781387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:44.781404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:44.781408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:44.783496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:44.816385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254526206815841:3127]
2025-10-01T14:06:44.816667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 105, pipe: [1:7556254526206815841:3127]
2025-10-01T14:06:44.936044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:44.936393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.936408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.936449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815841:3127], now have 1 active actors on pipe
2025-10-01T14:06:44.936688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:44.936703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:44.936718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:44.936800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 106 reason: error at write: Disconnected sessionId: src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0
2025-10-01T14:06:44.936806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:44.936861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254526206815841:3127]
2025-10-01T14:06:44.936973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 106 sessionId: src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0 is DEAD
2025-10-01T14:06:44.937131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:44.937143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0] Write session will restart in 0.005657s
2025-10-01T14:06:44.937170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0] Write session: Do CDS request
2025-10-01T14:06:44.937176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:44.943854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.943941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:44.943958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 107
2025-10-01T14:06:44.944175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:44.944208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:44.944213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:44.944217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:44.944586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 107 sessionId:  describe result for acl check
2025-10-01T14:06:44.944621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:44.944625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:44.944627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:44.944632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254526206815865:3154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:44.945108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254526206815865:3154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:44.947362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254526206815865:3154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:44.950069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:44.952511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:44.952780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:44.952792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:44.952803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:44.952870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:44.952915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254523829956427:2967]
2025-10-01T14:06:44.953528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:44.953829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:44.953869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:44.954160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:44.954218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.954226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.954227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.954228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.954229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.954230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.954232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.954233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.954234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.954235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.954236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.954238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.954239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.954240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.954246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.954256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.954260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.954264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.954268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.954271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.954275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.954279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.954283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.954287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.954290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.954294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.954298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.954301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.954307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.954315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:44.954321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.954326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:44.954331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.954336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:44.954341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.954351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:44.954356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.954365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:44.954392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.954403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:44.954408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.954417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:44.954422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.954428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:44.954437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.954442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:44.954452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.954457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.954466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.954471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.954479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.954484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.954494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.954503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:44.954508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.954516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:44.954556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:44.950254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254526206815865:3154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:44.950279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254526206815865:3154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:44.950282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254526206815865:3154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:44.950292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:44.958494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:44.959242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:44.959261Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:44.959263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:44.959267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:44.959275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 106 [2:7556254523829956427:2967]
2025-10-01T14:06:44.959299Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:44.959316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:44.959324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.959327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.959330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.959347Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:44.959357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:44.959363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:44.959425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.959431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.959433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.959437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:44.959440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:44.959509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:44.959516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.959528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:44.959539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:44.959558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:44.959579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815843:2446], now have 1 active actors on pipe
2025-10-01T14:06:44.959590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254526206815999:3154], now have 1 active actors on pipe
2025-10-01T14:06:44.959598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254523829956421:2967]
2025-10-01T14:06:44.959605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254523829956421:2967]
2025-10-01T14:06:44.959607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254523829956421:2967]
2025-10-01T14:06:44.959621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:44.959639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:44.959656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:44.959663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:44.959648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 106
2025-10-01T14:06:44.959662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 106
2025-10-01T14:06:44.959697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254523829956421:2967]
2025-10-01T14:06:44.959704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:44.959724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:44.959733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:44.959736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:44.959743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:44.959794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.959804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.959834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:44.959847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:44.959851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:44.959853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:44.959862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:44.959872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:44.959887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.959998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.960007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.960020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:44.960088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 107 partition: 0 MaxSeqNo: 45 sessionId: src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0
2025-10-01T14:06:44.960497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73175c17-c193c854-e0e8eb25-f5cbfab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:44.963378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0] Write session: try to update token
2025-10-01T14:06:44.963399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:44.972718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:44.972743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:44.972753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254523829956421:2967]
2025-10-01T14:06:44.972799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:44.972805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:44.973114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:44.973304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:44.973481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:44.973648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:44.973859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:44.973900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:44.983308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 107 sessionId: src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:44.985736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:44.985945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:44.985979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:44.986017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:44.986094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:44.994526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:44.994549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:44.994552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:44.994555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:44.994576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254523829956421:2967]
2025-10-01T14:06:44.994581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254523829956421:2967]
2025-10-01T14:06:44.994586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254523829956421:2967]
2025-10-01T14:06:44.994640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:44.994646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:44.994648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:44.994848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:44.997439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:44.997447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:44.997449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:45.037099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254530501783330:3127]
2025-10-01T14:06:45.037326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 106, pipe: [1:7556254530501783330:3127]
2025-10-01T14:06:45.146103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:45.155043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.155076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.155250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.155313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.155382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.155450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.155497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.155509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.155583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.155646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.155716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.156070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.156124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.156132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.156191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.156249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.156306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.156367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.156411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.156418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.156479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.156542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.156605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.156671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.156707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.156710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.156770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.156817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.156882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.156936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.156993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.156996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.157068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.157126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.157188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.157260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.157304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.157307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.157382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.157450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.157518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.157586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.157636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.157638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.157721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.157786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.157846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.157932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.157991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.157994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.158061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.158120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.158178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.158237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.158296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.158299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.158362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.158595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.158660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.158732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.159705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254530501783330:3127]
2025-10-01T14:06:45.159752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:45.159789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:45.159791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:45.159819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 107 reason: error at write: Disconnected sessionId: src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0
2025-10-01T14:06:45.160012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 107 sessionId: src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0 is DEAD
2025-10-01T14:06:45.158797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.158805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.158870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783330:3127], now have 1 active actors on pipe
2025-10-01T14:06:45.159804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:45.160167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:45.160177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0] Write session will restart in 0.007261s
2025-10-01T14:06:45.160204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0] Write session: Do CDS request
2025-10-01T14:06:45.160211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:45.170694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:45.170785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:45.170804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 108
2025-10-01T14:06:45.170947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:45.170980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:45.170984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:45.170989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:45.171356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 108 sessionId:  describe result for acl check
2025-10-01T14:06:45.171391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:45.171398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:45.171399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:45.171405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254530501783446:3166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:45.171932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254530501783446:3166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:45.173831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:45.174341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254530501783446:3166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:45.174619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:45.174811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:45.174823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:45.174836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:45.174895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:45.174935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254528124923924:2982]
2025-10-01T14:06:45.175523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:45.175862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:45.175906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:45.176207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:45.176264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.176271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.176271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.176272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.176273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.176274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.176276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.176277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.176278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.176279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.176280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.176281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.176282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.176283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.176289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.176299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.176303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.176307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.176311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.176314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.176318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.176321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.176325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.176329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.176333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.176337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.176340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.176344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.176350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.176358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.176364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.176369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.176374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.176379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.176383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.176388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.176392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.176397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.176400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.176405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.176409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.176419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.176423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.176428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.176437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.176442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.176450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.176455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.176459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.176468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.176473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.176478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.176487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.176492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.176500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.176505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.176544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:45.181636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:45.182256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254530501783446:3166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:45.182276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254530501783446:3166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:45.182281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254530501783446:3166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:45.182290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:45.182647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:45.182662Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:45.182664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:45.182668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:45.182675Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 107 [2:7556254528124923924:2982]
2025-10-01T14:06:45.182690Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:45.182705Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:45.182716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.182720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.182723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.182739Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:45.182749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:45.182755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:45.182812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.182820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.182822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.182826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:45.182828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:45.182895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:45.182902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.182917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.182934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.182957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:45.182978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254528124923919:2982]
2025-10-01T14:06:45.182985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254528124923919:2982]
2025-10-01T14:06:45.182988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254528124923919:2982]
2025-10-01T14:06:45.183001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:45.183012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:45.183019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783345:2446], now have 1 active actors on pipe
2025-10-01T14:06:45.183023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783510:3166], now have 1 active actors on pipe
2025-10-01T14:06:45.183024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:45.183026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:45.183032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:45.183047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:45.183049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:45.183082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254528124923919:2982]
2025-10-01T14:06:45.183090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:45.183049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 107
2025-10-01T14:06:45.183084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 107
2025-10-01T14:06:45.183130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:45.183192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.183203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.183227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:45.183239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.183248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.183250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:45.183260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.183273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:45.183293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:45.183456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.183463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.183488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:45.183571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 108 partition: 0 MaxSeqNo: 45 sessionId: src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0
2025-10-01T14:06:45.184221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|463d48b5-afd0f06d-e1daa2fd-65ddbf04_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:45.186603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0] Write session: try to update token
2025-10-01T14:06:45.186620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:45.203954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 108 sessionId: src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:45.206726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:45.208203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:45.207433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.207463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.207504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:45.220883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:45.220909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:45.220912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:45.220915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:45.220924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254528124923919:2982]
2025-10-01T14:06:45.220930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254528124923919:2982]
2025-10-01T14:06:45.220936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254528124923919:2982]
2025-10-01T14:06:45.220999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:45.221011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:45.221018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:45.221019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.221022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:45.221023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:45.221183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:45.259821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254530501783517:3127]
2025-10-01T14:06:45.261015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 107, pipe: [1:7556254530501783517:3127]
2025-10-01T14:06:45.357794Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:45.366682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.366710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.366907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.366985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.367061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.367136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.367188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.367192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.367274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.367338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.367404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.367565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.367633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.367641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.367718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.367775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.367846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.367923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.367966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.367974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.368029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.368086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.368139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.368201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.368242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.368250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.368307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.368361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.368417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.368474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.368515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.368522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.368605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.368677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.368756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.368824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.368893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.368904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.368976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.369044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.369113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.369185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.369254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.369262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.369337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.369411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.369476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.369544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.369607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.369615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.369678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.369737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.369799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.369860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.369905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.369912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.369979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:45.370038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:45.370099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:45.370172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:45.370235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:45.370242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:45.370306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783517:3127], now have 1 active actors on pipe
2025-10-01T14:06:45.370555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:45.370616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254530501783517:3127]
2025-10-01T14:06:45.370678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:45.370687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:45.370712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 108 reason: error at write: Disconnected sessionId: src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0
2025-10-01T14:06:45.370948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 108 sessionId: src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0 is DEAD
2025-10-01T14:06:45.371088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:45.371100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0] Write session will restart in 0.009306s
2025-10-01T14:06:45.371127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0] Write session: Do CDS request
2025-10-01T14:06:45.371134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:45.371544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:45.382851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:45.382911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:45.382925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 109
2025-10-01T14:06:45.387561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:45.391277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:45.391527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:45.391543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:45.391555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:45.391609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:45.391648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254528124924088:2984]
2025-10-01T14:06:45.392261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:45.392636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:45.392706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:45.393073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:45.393157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.393165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.393167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.393168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.393170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.393171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.393172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.393174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.393175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.393176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.393178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.393179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.393181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.393182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.393187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.393197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.393201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.393206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.393210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.393214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.393218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.393221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.393225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.393229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.393233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.393236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.393240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.393244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.393251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.393265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.393276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.393286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.393295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.393304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.393312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.393317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.393325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.393331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.393335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.393341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.393349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.393358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.393366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.393376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.393381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.393390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.393394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.393399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.393407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.393413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.393421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.393429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.393434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.393442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.393449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.393455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.393497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:45.394265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:45.394326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:45.394337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:45.394341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:45.394754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 109 sessionId:  describe result for acl check
2025-10-01T14:06:45.394792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:45.394803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:45.394805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:45.394809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254530501783649:3170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:45.395327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254530501783649:3170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:45.397504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:45.398259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254530501783649:3170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:45.398347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:45.398385Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:45.398388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:45.398391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:45.398400Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 108 [2:7556254528124924088:2984]
2025-10-01T14:06:45.398416Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:45.398433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:45.398442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.398445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.398447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.398465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:45.398475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:45.398482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:45.398542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.398553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.398554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.398558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:45.398561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:45.398626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:45.398633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.398644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.398658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.398673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:45.398697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783520:2446], now have 1 active actors on pipe
2025-10-01T14:06:45.398709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254528124924082:2984]
2025-10-01T14:06:45.398712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254528124924082:2984]
2025-10-01T14:06:45.398714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254528124924082:2984]
2025-10-01T14:06:45.398727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:45.398738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:45.398741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:45.398744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:45.398746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:45.398738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 108
2025-10-01T14:06:45.398762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:45.398769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:45.398812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254528124924082:2984]
2025-10-01T14:06:45.398824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:45.398830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:45.404152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254530501783649:3170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:45.404169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254530501783649:3170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:45.404173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254530501783649:3170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:45.404181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:45.404502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783687:3170], now have 1 active actors on pipe
2025-10-01T14:06:45.404548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 108
2025-10-01T14:06:45.404636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.404650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.404676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10a2a078-f0645429-a08630c0-10a8cb82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:45.404693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.404700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.404707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:45.404718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.404738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:45.404765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:45.404972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.404979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.404992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:45.405098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 109 partition: 0 MaxSeqNo: 45 sessionId: src_id|10a2a078-f0645429-a08630c0-10a8cb82_0
2025-10-01T14:06:45.405525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aadc374-51fc9597-bb5c95a6-b5d531ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|10a2a078-f0645429-a08630c0-10a8cb82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:45.408048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a2a078-f0645429-a08630c0-10a8cb82_0] Write session: try to update token
2025-10-01T14:06:45.408070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a2a078-f0645429-a08630c0-10a8cb82_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:45.419633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:45.419655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:45.419658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:45.419660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:45.419670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254528124924082:2984]
2025-10-01T14:06:45.419675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254528124924082:2984]
2025-10-01T14:06:45.419680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254528124924082:2984]
2025-10-01T14:06:45.419729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:45.419741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.419745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:45.419744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:45.419756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:45.419761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:45.419952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:45.423989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 109 sessionId: src_id|10a2a078-f0645429-a08630c0-10a8cb82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:45.426578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:45.470720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254530501783690:3127]
2025-10-01T14:06:45.470989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 108, pipe: [1:7556254530501783690:3127]
2025-10-01T14:06:45.563416Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:45.563916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.563927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.563964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783690:3127], now have 1 active actors on pipe
2025-10-01T14:06:45.564184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:45.566445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:45.566449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:45.566534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10a2a078-f0645429-a08630c0-10a8cb82_0
2025-10-01T14:06:45.566618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254530501783690:3127]
2025-10-01T14:06:45.566727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 109 sessionId: src_id|10a2a078-f0645429-a08630c0-10a8cb82_0 is DEAD
2025-10-01T14:06:45.566873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a2a078-f0645429-a08630c0-10a8cb82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:45.566884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a2a078-f0645429-a08630c0-10a8cb82_0] Write session will restart in 0.008703s
2025-10-01T14:06:45.566912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a2a078-f0645429-a08630c0-10a8cb82_0] Write session: Do CDS request
2025-10-01T14:06:45.566918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a2a078-f0645429-a08630c0-10a8cb82_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:45.576987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a2a078-f0645429-a08630c0-10a8cb82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:45.577122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:45.577139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 110
2025-10-01T14:06:45.577272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:45.577309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:45.577320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:45.577324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:45.577948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 110 sessionId:  describe result for acl check
2025-10-01T14:06:45.577989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:45.577990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:45.577991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:45.577997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254530501783741:3175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:45.578456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254530501783741:3175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:45.583419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254530501783741:3175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:45.586804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254530501783741:3175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:45.586822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254530501783741:3175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:45.586826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254530501783741:3175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:45.586834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:45.587105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:45.588190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:45.588390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:45.588394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:45.588403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:45.588453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:45.588495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254528124924257:2987]
2025-10-01T14:06:45.589157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:45.589542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:45.589588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:45.589926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:45.589980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.589981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.589983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.589984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.589985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.589987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.589989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.589990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.589991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.589993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.589994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.589995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.589997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.589998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.590003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.590014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.590019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.590023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.590027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.590032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.590036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.590040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.590045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.590049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.590053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.590057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.590061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.590065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.590073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.590081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.590087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.590093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.590097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.590102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.590107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.590113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.590117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.590123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.590128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.590133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.590138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.590144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.590148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.590153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.590160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.590165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.590169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.590175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.590180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.590185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.590189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.590195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.590200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.590204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.590209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.590215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.590256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:45.595442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:45.596272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:45.596291Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:45.596293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:45.596298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:45.596306Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 109 [2:7556254528124924257:2987]
2025-10-01T14:06:45.596328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:45.596354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:45.596357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.596359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.596361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.596376Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:45.596381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:45.596392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:45.596458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.596466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.596468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.596471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:45.596474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:45.596547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:45.596555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.596567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.596730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 109
2025-10-01T14:06:45.596578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.596598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:45.596650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783698:2446], now have 1 active actors on pipe
2025-10-01T14:06:45.596654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783856:3175], now have 1 active actors on pipe
2025-10-01T14:06:45.596661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254528124924250:2987]
2025-10-01T14:06:45.596664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254528124924250:2987]
2025-10-01T14:06:45.596666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254528124924250:2987]
2025-10-01T14:06:45.596680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:45.596735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 109
2025-10-01T14:06:45.596698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:45.596709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:45.596715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:45.596715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:45.596717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:45.596718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:45.596754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254528124924250:2987]
2025-10-01T14:06:45.596756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:45.596767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:45.596785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.596789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.596820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba8769b1-fa57d060-350582d-149e024_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:45.596827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.596831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.596833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:45.596854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.596864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:45.596885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:45.597082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.597095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.597118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:45.597223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 110 partition: 0 MaxSeqNo: 45 sessionId: src_id|ba8769b1-fa57d060-350582d-149e024_0
2025-10-01T14:06:45.597611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a2a078-f0645429-a08630c0-10a8cb82_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ba8769b1-fa57d060-350582d-149e024_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:45.600905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8769b1-fa57d060-350582d-149e024_0] Write session: try to update token
2025-10-01T14:06:45.600922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8769b1-fa57d060-350582d-149e024_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:45.619574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:45.619599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:45.619602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:45.619604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:45.619614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254528124924250:2987]
2025-10-01T14:06:45.619619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254528124924250:2987]
2025-10-01T14:06:45.619625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254528124924250:2987]
2025-10-01T14:06:45.619683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:45.619689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:45.619692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:45.619692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:45.619700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.619703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:45.619874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:45.626913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 110 sessionId: src_id|ba8769b1-fa57d060-350582d-149e024_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:45.629465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:45.670325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254530501783871:3127]
2025-10-01T14:06:45.670755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 109, pipe: [1:7556254530501783871:3127]
2025-10-01T14:06:45.769574Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:45.769833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.769842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.769858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783871:3127], now have 1 active actors on pipe
2025-10-01T14:06:45.770046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:45.771876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254530501783871:3127]
2025-10-01T14:06:45.771903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:45.771932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:45.771998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 110 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba8769b1-fa57d060-350582d-149e024_0
2025-10-01T14:06:45.772187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 110 sessionId: src_id|ba8769b1-fa57d060-350582d-149e024_0 is DEAD
2025-10-01T14:06:45.772364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8769b1-fa57d060-350582d-149e024_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:45.772378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8769b1-fa57d060-350582d-149e024_0] Write session will restart in 0.008244s
2025-10-01T14:06:45.772404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8769b1-fa57d060-350582d-149e024_0] Write session: Do CDS request
2025-10-01T14:06:45.772413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8769b1-fa57d060-350582d-149e024_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:45.781899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8769b1-fa57d060-350582d-149e024_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:45.782964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:45.782979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 111
2025-10-01T14:06:45.783491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:45.783540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:45.783546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:45.783550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:45.784013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 111 sessionId:  describe result for acl check
2025-10-01T14:06:45.784061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:45.784066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:45.784068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:45.784074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254530501783897:3180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:45.784643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254530501783897:3180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:45.786891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254530501783897:3180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:45.789969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254530501783897:3180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:45.789987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254530501783897:3180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:45.789990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254530501783897:3180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:45.790000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:45.810775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:45.812135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:45.812370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:45.812380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:45.812391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:45.812446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:45.812507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254528124924436:2990]
2025-10-01T14:06:45.813217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:45.813535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:45.813610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:45.813966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:45.814044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.814050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.814051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.814053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.814054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.814055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.814057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.814059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.814060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.814061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.814063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.814064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.814065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.814067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.814073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.814083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.814087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.814091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.814095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.814099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.814102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.814105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.814109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.814114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.814117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.814121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.814125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.814129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.814135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.814143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:45.814148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.814156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:45.814166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.814171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:45.814175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.814184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:45.814190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.814199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:45.814204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.814209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:45.814215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.814222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:45.814230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.814236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:45.814241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.814247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:45.814251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.814256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.814261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.814266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.814270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.814283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.814288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.814293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:45.814297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.814303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:45.814345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:45.818556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:45.819196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:45.819213Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:45.819217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:45.819221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:45.819228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 110 [2:7556254528124924436:2990]
2025-10-01T14:06:45.819246Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:45.819263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:45.819272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.819276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.819279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.819295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:45.819307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:45.819313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:45.819383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.819391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.819398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.819402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:45.819405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:45.819633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 110
2025-10-01T14:06:45.819692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 110
2025-10-01T14:06:45.819487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:45.819500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.819512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:45.819523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:45.819539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:45.819561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783885:2446], now have 1 active actors on pipe
2025-10-01T14:06:45.819564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501783941:3180], now have 1 active actors on pipe
2025-10-01T14:06:45.819570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254528124924431:2990]
2025-10-01T14:06:45.819572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254528124924431:2990]
2025-10-01T14:06:45.819575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254528124924431:2990]
2025-10-01T14:06:45.819588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:45.819602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:45.819612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:45.819615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:45.819616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:45.819618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:45.819619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:45.819653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254528124924431:2990]
2025-10-01T14:06:45.819656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:45.819658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:45.820044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.820054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.820077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:45.820084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:45.820089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:45.820091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:45.820100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:45.820111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:45.820123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:45.820293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.820307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.820330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:45.820479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 111 partition: 0 MaxSeqNo: 45 sessionId: src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0
2025-10-01T14:06:45.820757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba8769b1-fa57d060-350582d-149e024_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:45.823719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0] Write session: try to update token
2025-10-01T14:06:45.823735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:45.837200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:45.837224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:45.837235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254528124924431:2990]
2025-10-01T14:06:45.837284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:45.837296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:45.837455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:45.837595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:45.837721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:45.837853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:45.838063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:45.838106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:45.842965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 111 sessionId: src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:45.845327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:45.845574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:45.845599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:45.845634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:45.845721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:45.862949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:45.862972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:45.862974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:45.862977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:45.862988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254528124924431:2990]
2025-10-01T14:06:45.862992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254528124924431:2990]
2025-10-01T14:06:45.862996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254528124924431:2990]
2025-10-01T14:06:45.863046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:45.863054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:45.863057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:45.863059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:45.863069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:45.863073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:45.863244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:45.864438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254530501784058:3127]
2025-10-01T14:06:45.864696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 110, pipe: [1:7556254530501784058:3127]
2025-10-01T14:06:46.019745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:46.020194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254530501784058:3127], now have 1 active actors on pipe
2025-10-01T14:06:46.029531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.029559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.029743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.029814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.029886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.029965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.030032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.030046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.030127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.030321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.030460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.030546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.030697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.030710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.030795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.030873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.030956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.031075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.031137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.031140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.031232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.031314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.031401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.031489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.031545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.031548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.031647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.031731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.031807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.031978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.032031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.032034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.032136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.032205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.032274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.032345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.032390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.032393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.032474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.032543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.032626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.032710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.032763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.032766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.032857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.032922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.032994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.033064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.033122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.033125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.033206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.033280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.033353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.033432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.033481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.033484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.033561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.033626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.033699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.033773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.033819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.033822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.035671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:46.036822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:46.036847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0] Write session will restart in 0.006763s
2025-10-01T14:06:46.036872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0] Write session: Do CDS request
2025-10-01T14:06:46.036878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:46.036034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:46.036097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254530501784058:3127]
2025-10-01T14:06:46.036114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:46.036116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:46.036139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 111 reason: error at write: Disconnected sessionId: src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0
2025-10-01T14:06:46.036388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 111 sessionId: src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0 is DEAD
2025-10-01T14:06:46.044908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:46.045264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:46.045279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 112
2025-10-01T14:06:46.045465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:46.045491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:46.045496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:46.045499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:46.045910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 112 sessionId:  describe result for acl check
2025-10-01T14:06:46.045941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:46.045947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:46.045949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:46.045954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254534796751448:3190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:46.046505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254534796751448:3190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:46.048726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:46.048709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254534796751448:3190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:46.057411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254534796751448:3190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:46.057427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254534796751448:3190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:46.057430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254534796751448:3190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:46.057439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:46.058649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:46.059157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:46.059184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:46.059200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:46.059280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:46.059334Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254532419891911:2998]
2025-10-01T14:06:46.060057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:46.062432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:46.062509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:46.062947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:46.063018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.063020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.063021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.063023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.063024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.063026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.063027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.063029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.063030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.063032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.063034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.063035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.063036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.063038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.063044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.063054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.063058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.063063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.063068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.063071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.063075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.063079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.063083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.063088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.063092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.063096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.063100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.063105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.063114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.063124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.063130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.063139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.063144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.063150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.063157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.063163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.063169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.063175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.063180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.063185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.063191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.063196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.063201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.063207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.063212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.063218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.063223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.063228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.063234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.063239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.063244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.063250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.063255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.063261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.063265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.063270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.063316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:46.069730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:46.070614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:46.070634Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:46.070636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:46.070639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:46.070645Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 111 [2:7556254532419891911:2998]
2025-10-01T14:06:46.070659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:46.070677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:46.070685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.070688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.070690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.070702Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:46.070712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:46.070719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:46.070778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.070784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.070786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.070789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:46.070792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:46.070861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:46.070868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.070881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.070896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.070917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:46.070939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254532419891905:2998]
2025-10-01T14:06:46.070945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254532419891905:2998]
2025-10-01T14:06:46.070947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254532419891905:2998]
2025-10-01T14:06:46.070956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:46.070968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:46.070974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:46.070978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:46.070980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:46.070987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:46.070990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:46.071001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751529:3190], now have 1 active actors on pipe
2025-10-01T14:06:46.071005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751374:2446], now have 1 active actors on pipe
2025-10-01T14:06:46.071038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254532419891905:2998]
2025-10-01T14:06:46.071045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:46.071070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:46.071076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 111
2025-10-01T14:06:46.071107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 111
2025-10-01T14:06:46.071251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.071264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.071293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:46.071300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.071306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.071308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:46.071317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.071326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:46.071342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:46.071643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.071654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.071670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:46.071805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 112 partition: 0 MaxSeqNo: 45 sessionId: src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0
2025-10-01T14:06:46.072191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90e8dcae-7572d0be-1c857680-1bb4735a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:46.075044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0] Write session: try to update token
2025-10-01T14:06:46.075063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:46.104422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 112 sessionId: src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:46.107127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:46.110752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.110781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.110820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:46.113992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:46.122555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:46.122581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:46.122584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:46.122586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:46.122596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254532419891905:2998]
2025-10-01T14:06:46.122600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254532419891905:2998]
2025-10-01T14:06:46.122606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254532419891905:2998]
2025-10-01T14:06:46.122660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:46.122675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.122678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:46.122840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:46.123241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:46.123249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:46.123253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:46.136340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254534796751558:3127]
2025-10-01T14:06:46.136621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 111, pipe: [1:7556254534796751558:3127]
2025-10-01T14:06:46.376124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:46.385148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.385183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.385392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.385455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.385516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.385576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.385618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.385624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.385693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.385756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.385824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.385904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.385950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.385953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.386017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.386074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.386134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.386191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.386232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.386235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.386302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.387608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.387728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.387783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.387822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.387828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.387925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.387994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.388047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.388102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.388143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.388146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.388219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.388282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.388354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.388425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.388471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.388474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.388572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.388641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.388709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.388776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.388856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.388859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.388944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.389020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.389086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.389148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.389189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.389192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.389264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.389324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.389382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.389446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.389565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.389571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.389642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.389704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.389771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.389844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.389894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.389897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.389967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751558:3127], now have 1 active actors on pipe
2025-10-01T14:06:46.391642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:46.391704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:46.391722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:46.391767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 112 reason: error at write: Disconnected sessionId: src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0
2025-10-01T14:06:46.391793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:46.391846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254534796751558:3127]
2025-10-01T14:06:46.391977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 112 sessionId: src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0 is DEAD
2025-10-01T14:06:46.392339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:46.392348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0] Write session will restart in 0.005578s
2025-10-01T14:06:46.392374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0] Write session: Do CDS request
2025-10-01T14:06:46.392382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:46.399910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:46.400104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:46.400122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 113
2025-10-01T14:06:46.402191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:46.402245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:46.402251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:46.402255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:46.402839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 113 sessionId:  describe result for acl check
2025-10-01T14:06:46.402874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:46.402876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:46.402878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:46.402886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254534796751574:3196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:46.403505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254534796751574:3196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:46.408190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254534796751574:3196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:46.417519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254534796751574:3196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:46.417542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254534796751574:3196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:46.417545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254534796751574:3196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:46.417556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:46.424703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:46.425742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:46.425941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:46.425951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:46.425961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:46.426013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:46.426058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254532419892106:3007]
2025-10-01T14:06:46.426759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:46.427554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:46.427610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:46.427929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:46.428003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.428010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.428011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.428012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.428013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.428015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.428016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.428018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.428019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.428020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.428021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.428022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.428023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.428025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.428030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.428040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.428044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.428047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.428052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.428056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.428059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.428063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.428067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.428071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.428075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.428079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.428082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.428086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.428093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.428101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.428110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.428121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.428126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.428133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.428137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.428142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.428147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.428152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.428159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.428163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.428172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.428177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.428182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.428192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.428197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.428207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.428212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.428221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.428227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.428235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.428240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.428249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.428254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.428262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.428270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.428279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.428318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:46.437909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:46.438896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:46.438915Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:46.438919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:46.438925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:46.438933Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 112 [2:7556254532419892106:3007]
2025-10-01T14:06:46.438955Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:46.438979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:46.438982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.438986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.438989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.439008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:46.439015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:46.439024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:46.439100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.439474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 112
2025-10-01T14:06:46.439103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.439511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 112
2025-10-01T14:06:46.439106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.439109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:46.439111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:46.439201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:46.439204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.439217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.439228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.439257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:46.439277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751662:3196], now have 1 active actors on pipe
2025-10-01T14:06:46.439285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254532419892101:3007]
2025-10-01T14:06:46.439290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254532419892101:3007]
2025-10-01T14:06:46.439292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254532419892101:3007]
2025-10-01T14:06:46.439302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:46.439315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:46.439317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:46.439319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:46.439321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:46.439332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:46.439335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:46.439342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751566:2446], now have 1 active actors on pipe
2025-10-01T14:06:46.439380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254532419892101:3007]
2025-10-01T14:06:46.439388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:46.439399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:46.439611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.439620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.439650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:46.439666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.439670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.439674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:46.439683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.439697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:46.439713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:46.439852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.439864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.439885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:46.440003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 113 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0
2025-10-01T14:06:46.440474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72839a5d-dedccf2a-62bf2e00-4e26f4e3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:46.443640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0] Write session: try to update token
2025-10-01T14:06:46.443663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:46.465387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 113 sessionId: src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:46.467947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:46.468319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.468347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.468385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:46.468524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:46.471942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:46.471970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:46.471972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:46.471974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:46.471984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254532419892101:3007]
2025-10-01T14:06:46.471989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254532419892101:3007]
2025-10-01T14:06:46.471992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254532419892101:3007]
2025-10-01T14:06:46.472045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:46.472054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.472057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:46.472212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:46.474527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:46.474536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:46.474541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:46.493817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254534796751741:3127]
2025-10-01T14:06:46.494258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 112, pipe: [1:7556254534796751741:3127]
2025-10-01T14:06:46.647314Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:46.656283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.656326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.656520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.656593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.656660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.656726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.656770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.656775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.656868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.656933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.657051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.657128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.657171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.657177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.657246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.657318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.657376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.657437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.657476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.657480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.657570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.657632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.657688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.657750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.657793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.657796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.657866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.657921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.657980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.658044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.658091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.658094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.658173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.658245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.658352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.658615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.658680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.658689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.658771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.658851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.658931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.659005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.659070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.659074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.659163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.659242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.659307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.659375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.659434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.659437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.659516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.659580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.659645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.659712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.659780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.659783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.659850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.659910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.659972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.660044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.660113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.660116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.660196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751741:3127], now have 1 active actors on pipe
2025-10-01T14:06:46.662111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:46.662119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254534796751741:3127]
2025-10-01T14:06:46.662154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:46.662156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:46.662181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 113 reason: error at write: Disconnected sessionId: src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0
2025-10-01T14:06:46.662595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:46.662606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0] Write session will restart in 0.009250s
2025-10-01T14:06:46.661919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:46.662430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 113 sessionId: src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0 is DEAD
2025-10-01T14:06:46.662641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0] Write session: Do CDS request
2025-10-01T14:06:46.662648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:46.672942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:46.673180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:46.673197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 114
2025-10-01T14:06:46.674259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:46.674298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:46.674304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:46.674308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:46.674773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 114 sessionId:  describe result for acl check
2025-10-01T14:06:46.674807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:46.674813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:46.674815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:46.674820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254534796751790:3201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:46.675366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254534796751790:3201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:46.678139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254534796751790:3201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:46.682351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:46.682635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254534796751790:3201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:46.682652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254534796751790:3201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:46.682655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254534796751790:3201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:46.682669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:46.683566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:46.683765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:46.683769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:46.683779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:46.683826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:46.683869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254532419892277:3010]
2025-10-01T14:06:46.684454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:46.684855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:46.684899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:46.685200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:46.685251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.685252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.685254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.685255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.685256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.685257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.685258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.685259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.685260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.685261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.685262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.685263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.685264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.685265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.685269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.685279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.685283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.685286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.685289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.685293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.685297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.685300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.685304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.685308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.685311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.685314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.685318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.685321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.685328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.685335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.685341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.685346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.685350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.685355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.685360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.685364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.685368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.685374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.685378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.685383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.685387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.685392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.685395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.685400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.685405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.685409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.685413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.685417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.685421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.685425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.685429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.685434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.685439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.685443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.685447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.685452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.685488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:46.689866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:46.690609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:46.690623Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:46.690625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:46.690628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:46.690633Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 113 [2:7556254532419892277:3010]
2025-10-01T14:06:46.690645Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:46.690659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:46.690664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.690667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.690669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.690681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:46.690688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:46.690693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:46.690732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.690738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.690739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.690742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:46.690744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:46.690798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:46.690806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.690813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.690819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.690829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:46.690841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254532419892270:3010]
2025-10-01T14:06:46.690844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254532419892270:3010]
2025-10-01T14:06:46.690846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254532419892270:3010]
2025-10-01T14:06:46.690852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:46.690862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:46.690862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:46.690867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:46.690868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:46.690870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:46.690872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:46.690880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751909:3201], now have 1 active actors on pipe
2025-10-01T14:06:46.690883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751746:2446], now have 1 active actors on pipe
2025-10-01T14:06:46.690969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 113
2025-10-01T14:06:46.690985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 113
2025-10-01T14:06:46.690912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254532419892270:3010]
2025-10-01T14:06:46.690922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:46.690930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:46.691028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.691038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.691065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:46.691078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.691082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.691084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:46.691092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.691105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:46.691125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:46.691250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.691261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.691275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:46.691359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 114 partition: 0 MaxSeqNo: 45 sessionId: src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0
2025-10-01T14:06:46.691720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4c88d8-f486bdaa-c734ea4-3390111e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:46.694565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0] Write session: try to update token
2025-10-01T14:06:46.694582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:46.709609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 114 sessionId: src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:46.712204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:46.712430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.712457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.712489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:46.712611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:46.716617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:46.716640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:46.716643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:46.716645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:46.716655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254532419892270:3010]
2025-10-01T14:06:46.716660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254532419892270:3010]
2025-10-01T14:06:46.716664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254532419892270:3010]
2025-10-01T14:06:46.716707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:46.716713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:46.716715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:46.716719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:46.716719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.716722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:46.716906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:46.764438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254534796751933:3127]
2025-10-01T14:06:46.764743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 113, pipe: [1:7556254534796751933:3127]
2025-10-01T14:06:46.868830Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:46.877453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.877483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.877629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.877688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.877749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.877816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.877861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.877869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.877934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.877989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.878046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.878103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.878148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.878154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.878222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.878280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.878358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.878433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.878477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.878483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.878541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.878596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.878651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.878714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.878761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.878768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.878832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.878900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.878959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.879014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.879053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.879058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.879126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.879188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.879270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.879342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.879407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.879413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.879493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.879562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.879636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.879710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.879764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.879769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.879853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.879924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.879993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.880060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.880110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.880117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.880184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.880245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.880310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.880376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.880422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.880429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.880495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:46.880555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:46.880617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:46.880691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:46.880747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:46.880753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:46.880852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751933:3127], now have 1 active actors on pipe
2025-10-01T14:06:46.881377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:46.881403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254534796751933:3127]
2025-10-01T14:06:46.881426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:46.881429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:46.881454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 114 reason: error at write: Disconnected sessionId: src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0
2025-10-01T14:06:46.881642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 114 sessionId: src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0 is DEAD
2025-10-01T14:06:46.881783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:46.881792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0] Write session will restart in 0.007821s
2025-10-01T14:06:46.881815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0] Write session: Do CDS request
2025-10-01T14:06:46.881820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:46.881934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:46.890921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:46.893519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:46.891008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:46.891023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 115
2025-10-01T14:06:46.891177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:46.891215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:46.891220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:46.891224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:46.891615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 115 sessionId:  describe result for acl check
2025-10-01T14:06:46.891641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:46.891644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:46.891645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:46.891651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254534796752040:3206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:46.892132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254534796752040:3206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:46.894078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254534796752040:3206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:46.895622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:46.895829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:46.895840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:46.895851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:46.895896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:46.895932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254532419892458:3013]
2025-10-01T14:06:46.896545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:46.896864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:46.896923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:46.896943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254534796752040:3206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:46.896959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254534796752040:3206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:46.896963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254534796752040:3206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:46.896970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:46.897292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:46.897351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.897357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.897358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.897359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.897360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.897361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.897362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.897363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.897364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.897366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.897367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.897368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.897369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.897370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.897375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.897385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.897389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.897392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.897396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.897399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.897403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.897406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.897410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.897414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.897417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.897421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.897424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.897427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.897434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.897442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:46.897448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.897453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:46.897457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.897461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:46.897465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.897469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:46.897479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.897483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:46.897487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.897496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:46.897501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.897506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:46.897514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.897519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:46.897522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.897528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:46.897532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.897541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.897545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.897553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.897557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.897562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.897570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.897575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:46.897579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.897588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:46.897621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:46.901859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:46.902535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:46.902553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:46.902556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:46.902560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:46.902569Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 114 [2:7556254532419892458:3013]
2025-10-01T14:06:46.902585Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:46.902605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:46.902613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.902617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.902619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.902635Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:46.902646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:46.902652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:46.902715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.902723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.902725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.902728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:46.902731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:46.902800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:46.902806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.902819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:46.902830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:46.902846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:46.902869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796752103:3206], now have 1 active actors on pipe
2025-10-01T14:06:46.902878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796751936:2446], now have 1 active actors on pipe
2025-10-01T14:06:46.902885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254532419892453:3013]
2025-10-01T14:06:46.902890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254532419892453:3013]
2025-10-01T14:06:46.902892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254532419892453:3013]
2025-10-01T14:06:46.902907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:46.902926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:46.902927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:46.902931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:46.902917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 114
2025-10-01T14:06:46.902934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:46.902945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:46.902948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:46.902929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 114
2025-10-01T14:06:46.902988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254532419892453:3013]
2025-10-01T14:06:46.902999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:46.903024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:46.903024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.903029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.903068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:46.903079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:46.903088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:46.903091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:46.903100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:46.903112Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:46.903133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:46.903254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.903261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.903274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:46.903360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 115 partition: 0 MaxSeqNo: 45 sessionId: src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0
2025-10-01T14:06:46.903700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c02b69b9-d8936352-b4754b45-dd8822bd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:46.906099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0] Write session: try to update token
2025-10-01T14:06:46.906116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:46.919515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 115 sessionId: src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:46.922074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:46.924170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:46.924201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:46.924220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:46.924222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:46.924224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:46.924225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:46.924231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254532419892453:3013]
2025-10-01T14:06:46.924235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254532419892453:3013]
2025-10-01T14:06:46.924238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254532419892453:3013]
2025-10-01T14:06:46.924287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:46.924290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:46.924293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:46.924295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:46.924296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:46.924297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:46.924417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:46.981655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254534796752112:3127]
2025-10-01T14:06:46.981917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 114, pipe: [1:7556254534796752112:3127]
2025-10-01T14:06:47.069011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:47.069293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:47.069348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254534796752112:3127], now have 1 active actors on pipe
2025-10-01T14:06:47.069444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:47.069483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254534796752112:3127]
2025-10-01T14:06:47.069522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:47.069538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:47.069546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:47.069613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 115 reason: error at write: Disconnected sessionId: src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0
2025-10-01T14:06:47.069789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 115 sessionId: src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0 is DEAD
2025-10-01T14:06:47.069928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:47.069938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0] Write session will restart in 0.007375s
2025-10-01T14:06:47.069963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0] Write session: Do CDS request
2025-10-01T14:06:47.069972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:47.082891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.083831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:47.083827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:47.083841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 116
2025-10-01T14:06:47.083971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.083998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:47.084002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:47.084006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:47.084326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 116 sessionId:  describe result for acl check
2025-10-01T14:06:47.084357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:47.084365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:47.084366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:47.084371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254539091719559:3218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:47.084822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:47.084855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254539091719559:3218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:47.085094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:47.085112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:47.085137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:47.085273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:47.085320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254536714859938:3017]
2025-10-01T14:06:47.085915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:47.086159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:47.086208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:47.086528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:47.086595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.086601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.086602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.086603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.086604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.086605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.086606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.086608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.086609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.086610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.086612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.086613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.086614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.086615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.086622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.086631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.086635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.086639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.086642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.086646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.086650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.086654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.086658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.086662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.086666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.086670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.086673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.086677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.086684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.086692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.086698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.086703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.086707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.086712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.086722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.086727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.086731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.086740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.086744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.086753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.086758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.086762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.086766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.086771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.086778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.086787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.086792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.086769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254539091719559:3218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:47.086797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.086805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.086810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.086814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.086819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.086823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.086832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.086837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.086846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.086886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:47.090616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254539091719559:3218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:47.090632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254539091719559:3218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:47.090636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254539091719559:3218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:47.090644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:47.091076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:47.091760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:47.091776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:47.091779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:47.091782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:47.091788Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 115 [2:7556254536714859938:3017]
2025-10-01T14:06:47.091804Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:47.091825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:47.091832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.091836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.091838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.091855Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:47.091864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:47.091875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:47.091933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.091939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.091941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.091944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:47.091947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:47.092025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:47.092032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.092044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.092057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.092072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:47.092092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719596:3218], now have 1 active actors on pipe
2025-10-01T14:06:47.092100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719414:2446], now have 1 active actors on pipe
2025-10-01T14:06:47.092107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254536714859932:3017]
2025-10-01T14:06:47.092113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254536714859932:3017]
2025-10-01T14:06:47.092116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254536714859932:3017]
2025-10-01T14:06:47.092130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:47.092142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:47.092146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:47.092142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 115
2025-10-01T14:06:47.092147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:47.092170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 115
2025-10-01T14:06:47.092149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:47.092162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:47.092165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:47.092206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.092216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.092229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254536714859932:3017]
2025-10-01T14:06:47.092240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:47.092246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:47.092270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:47.092281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.092285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.092292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:47.092300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.092314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:47.092337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.092477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.092487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.092501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.092577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 116 partition: 0 MaxSeqNo: 45 sessionId: src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0
2025-10-01T14:06:47.092927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcefe604-1be9ac05-c4afcd94-bfb758ad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:47.095495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0] Write session: try to update token
2025-10-01T14:06:47.095515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:47.110051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 116 sessionId: src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:47.112598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:47.114874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.114908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.114930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:47.114933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:47.114936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:47.114938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:47.114947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254536714859932:3017]
2025-10-01T14:06:47.114953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254536714859932:3017]
2025-10-01T14:06:47.114958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254536714859932:3017]
2025-10-01T14:06:47.115000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:47.115018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:47.115021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:47.115026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:47.115034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.115036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:47.115207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:47.169568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254539091719622:3127]
2025-10-01T14:06:47.169833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 115, pipe: [1:7556254539091719622:3127]
2025-10-01T14:06:47.263777Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:47.264312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:47.264391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719622:3127], now have 1 active actors on pipe
2025-10-01T14:06:47.266504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:47.266586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:47.266588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:47.266647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254539091719622:3127]
2025-10-01T14:06:47.266653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 116 reason: error at write: Disconnected sessionId: src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0
2025-10-01T14:06:47.266664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:47.266781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 116 sessionId: src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0 is DEAD
2025-10-01T14:06:47.274457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:47.274470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0] Write session will restart in 0.009410s
2025-10-01T14:06:47.274495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0] Write session: Do CDS request
2025-10-01T14:06:47.274505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:47.281784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:47.282485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:47.282689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:47.282698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:47.282709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:47.282754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:47.282803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254536714860134:3030]
2025-10-01T14:06:47.283453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:47.283679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:47.283729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:47.284035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:47.284088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.284089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.284090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.284091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.284093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.284094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.284095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.284097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.284098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.284099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.284100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.284101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.284102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.284103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.284108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.284118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.284122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.284126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.284130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.284134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.284138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.284142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.284145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.284149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.284153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.284156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.284160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.284164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.284170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.284177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.284183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.284204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.284210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.284214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.284219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.284224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.284229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.284234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.284241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.284246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.284251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.284255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.284260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.284265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.284270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.284274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.284278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.284284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.284288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.284293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.284297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.284302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.284307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.284312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.284317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.284322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.284361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:47.284820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.285186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:47.285196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 117
2025-10-01T14:06:47.285292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.285315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:47.285321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:47.285324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:47.285780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 117 sessionId:  describe result for acl check
2025-10-01T14:06:47.285810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:47.285814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:47.285816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:47.285819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254539091719761:3224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:47.286193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254539091719761:3224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:47.287927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254539091719761:3224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:47.288016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:47.288633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:47.288645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:47.288647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:47.288650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:47.288654Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 116 [2:7556254536714860134:3030]
2025-10-01T14:06:47.288665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:47.288677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:47.288678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.288680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.288681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.288692Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:47.288696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:47.288699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:47.288737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.288744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.288745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.288747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:47.288749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:47.288796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:47.288808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.288814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.288819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.288828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:47.288854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719624:2446], now have 1 active actors on pipe
2025-10-01T14:06:47.288864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254536714860129:3030]
2025-10-01T14:06:47.288867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254536714860129:3030]
2025-10-01T14:06:47.288868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254536714860129:3030]
2025-10-01T14:06:47.288881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:47.288893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:47.288896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:47.288874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 116
2025-10-01T14:06:47.288898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:47.288898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:47.288909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:47.288912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:47.288946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254536714860129:3030]
2025-10-01T14:06:47.288955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:47.288959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:47.293457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254539091719761:3224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:47.293469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254539091719761:3224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:47.293472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254539091719761:3224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:47.293480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:47.293699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719799:3224], now have 1 active actors on pipe
2025-10-01T14:06:47.293725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 116
2025-10-01T14:06:47.293766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.293788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.293812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:47.293824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.293833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.293839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:47.293850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.293867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:47.293888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.294023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.294036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.294061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.294138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 117 partition: 0 MaxSeqNo: 45 sessionId: src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0
2025-10-01T14:06:47.294464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17158a16-1b828235-cda2bf2f-e02f7dc3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:47.296971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0] Write session: try to update token
2025-10-01T14:06:47.296988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:47.299309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:47.299324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:47.299331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254536714860129:3030]
2025-10-01T14:06:47.299357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:47.299364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:47.299511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:47.299644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:47.299767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:47.299889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:47.300050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:47.300077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:47.312931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 117 sessionId: src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:47.315425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:47.315619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.315645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.315678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:47.315755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:47.318504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:47.318524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:47.318527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:47.318529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:47.318540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254536714860129:3030]
2025-10-01T14:06:47.318544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254536714860129:3030]
2025-10-01T14:06:47.318547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254536714860129:3030]
2025-10-01T14:06:47.318594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:47.318594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:47.318601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.318602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:47.318603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:47.318606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:47.318736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:47.366704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254539091719803:3127]
2025-10-01T14:06:47.366971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 116, pipe: [1:7556254539091719803:3127]
2025-10-01T14:06:47.458146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:47.465382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.465410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.465562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.465620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.465681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.465735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.465782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.465789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.465858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.465924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.465986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.466051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.466093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.466101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.466166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.466235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.466303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.466389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.466435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.466442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.466518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.466576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.466636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.466694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.466740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.466745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.466805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.466862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.466923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.466983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.467031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.467039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.467108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.467169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.467230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.467293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.467331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.467336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.467397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.467456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.467516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.467586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.467632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.467639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.467701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.467767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.467828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.467903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.467949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.467955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.468018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.468099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.468164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.468221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.468278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.468283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.468350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.468416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.468480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.468538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.468605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.468611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.468676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719803:3127], now have 1 active actors on pipe
2025-10-01T14:06:47.468902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254539091719803:3127]
2025-10-01T14:06:47.468916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:47.468934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:47.468936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:47.468959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 117 reason: error at write: Disconnected sessionId: src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0
2025-10-01T14:06:47.469180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 117 sessionId: src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0 is DEAD
2025-10-01T14:06:47.469309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:47.469318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0] Write session will restart in 0.007819s
2025-10-01T14:06:47.469340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0] Write session: Do CDS request
2025-10-01T14:06:47.469345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:47.469783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:47.477959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.477985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:47.478000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 118
2025-10-01T14:06:47.478168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.478198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:47.478207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:47.478211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:47.478587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 118 sessionId:  describe result for acl check
2025-10-01T14:06:47.478637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:47.478642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:47.478644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:47.478649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254539091719903:3228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:47.479101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254539091719903:3228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:47.480396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:47.481096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:47.481269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:47.481278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:47.481285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:47.481320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:47.481368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254536714860309:3033]
2025-10-01T14:06:47.481543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254539091719903:3228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:47.481778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:47.481991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:47.482023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:47.482238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:47.482278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.482282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.482283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.482284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.482284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.482285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.482285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.482286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.482287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.482287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.482288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.482288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.482289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.482290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.482293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.482298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.482303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.482305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.482307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.482310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.482311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.482313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.482315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.482318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.482320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.482322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.482324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.482326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.482330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.482334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.482338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.482345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.482361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.482366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.482390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.482394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.482399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.482403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.482406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.482410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.482414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.482419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.482427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.482432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.482448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.482459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.482462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.482465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.482467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.482470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.482472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.482475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.482477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.482480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.482482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.482484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.482504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:47.485921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254539091719903:3228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:47.485944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254539091719903:3228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:47.485948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254539091719903:3228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:47.485958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:47.486097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:47.486842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:47.486856Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:47.486858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:47.486860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:47.486865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 117 [2:7556254536714860309:3033]
2025-10-01T14:06:47.486875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:47.486887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:47.486888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.486890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.486892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.486904Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:47.486911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:47.486915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:47.486958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.486963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.486965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.486967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:47.486969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:47.487025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:47.487033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.487042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.487052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.487068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:47.487085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719977:3228], now have 1 active actors on pipe
2025-10-01T14:06:47.487091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719805:2446], now have 1 active actors on pipe
2025-10-01T14:06:47.487096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254536714860303:3033]
2025-10-01T14:06:47.487097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254536714860303:3033]
2025-10-01T14:06:47.487099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254536714860303:3033]
2025-10-01T14:06:47.487108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:47.487118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:47.487124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:47.487127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:47.487130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:47.487132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:47.487132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:47.487160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254536714860303:3033]
2025-10-01T14:06:47.487170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:47.487166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 117
2025-10-01T14:06:47.487175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 117
2025-10-01T14:06:47.487187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:47.487215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.487222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.487238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|476aebf3-9b6bdce4-5497af76-be290176_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:47.487246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.487249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.487250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:47.487257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.487265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:47.487278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.487445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.487456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.487475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.487560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 118 partition: 0 MaxSeqNo: 45 sessionId: src_id|476aebf3-9b6bdce4-5497af76-be290176_0
2025-10-01T14:06:47.487914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927ac8d7-3cc8c773-69b3b067-5f5da489_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|476aebf3-9b6bdce4-5497af76-be290176_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:47.490322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476aebf3-9b6bdce4-5497af76-be290176_0] Write session: try to update token
2025-10-01T14:06:47.490339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476aebf3-9b6bdce4-5497af76-be290176_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:47.498692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:47.498711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:47.498720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254536714860303:3033]
2025-10-01T14:06:47.498769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:47.498768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:47.498942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:47.499106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:47.499252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:47.499396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:47.499576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:47.499617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:47.504236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 118 sessionId: src_id|476aebf3-9b6bdce4-5497af76-be290176_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:47.506881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:47.507111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.507154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.507194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:47.507297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:47.518213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:47.518234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:47.518236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:47.518237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:47.518244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254536714860303:3033]
2025-10-01T14:06:47.518247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254536714860303:3033]
2025-10-01T14:06:47.518251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254536714860303:3033]
2025-10-01T14:06:47.518291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:47.518293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:47.518297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:47.518298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.518300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:47.518300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:47.518455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:47.568885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254539091719987:3127]
2025-10-01T14:06:47.569086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 117, pipe: [1:7556254539091719987:3127]
2025-10-01T14:06:47.653216Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:47.660060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.660089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.660261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.660346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.660428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.660497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.660547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.660556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.660641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.660703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.660765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.660829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.660894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.660900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.660959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.661010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.661070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.661127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.661168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.661173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.661227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.661279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.661332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.661383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.661428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.661433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.661488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.661540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.661602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.661655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.661693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.661698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.661751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.661800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.661851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.661907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.661945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.661950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.662003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.662051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.662114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.662171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.662214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.662220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.662274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.662323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.662389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.662444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.662489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.662497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.662560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.662657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.662725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.662774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.662815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.662821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.662874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.662922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.662970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.663022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.663073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.663079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.663129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719987:3127], now have 1 active actors on pipe
2025-10-01T14:06:47.663324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:47.663336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:47.663356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254539091719987:3127]
2025-10-01T14:06:47.663367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 118 reason: error at write: Disconnected sessionId: src_id|476aebf3-9b6bdce4-5497af76-be290176_0
2025-10-01T14:06:47.663376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:47.663506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 118 sessionId: src_id|476aebf3-9b6bdce4-5497af76-be290176_0 is DEAD
2025-10-01T14:06:47.663633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476aebf3-9b6bdce4-5497af76-be290176_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:47.663649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476aebf3-9b6bdce4-5497af76-be290176_0] Write session will restart in 0.006560s
2025-10-01T14:06:47.663667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476aebf3-9b6bdce4-5497af76-be290176_0] Write session: Do CDS request
2025-10-01T14:06:47.663672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476aebf3-9b6bdce4-5497af76-be290176_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:47.663929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:47.670770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476aebf3-9b6bdce4-5497af76-be290176_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.670890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:47.670901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 119
2025-10-01T14:06:47.670987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.671007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:47.671014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:47.671016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:47.671391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 119 sessionId:  describe result for acl check
2025-10-01T14:06:47.671425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:47.671431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:47.671432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:47.671438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254539091720037:3233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:47.671952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254539091720037:3233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:47.673905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254539091720037:3233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:47.674855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:47.675934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:47.676231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:47.676242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:47.676254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:47.676322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:47.676369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254536714860482:3035]
2025-10-01T14:06:47.676435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254539091720037:3233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:47.676446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254539091720037:3233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:47.676451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254539091720037:3233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:47.676458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:47.676977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:47.677265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:47.677318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:47.677634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:47.677733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.677740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.677741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.677743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.677744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.677745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.677746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.677748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.677749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.677750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.677751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.677753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.677754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.677756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.677761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.677771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.677775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.677779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.677782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.677785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.677788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.677792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.677795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.677799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.677803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.677806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.677809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.677813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.677821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.677829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.677842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.677851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.677856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.677865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.677870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.677876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.677881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.677885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.677889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.677894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.677899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.677909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.677917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.677923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.677931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.677936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.677944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.677948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.677953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.677962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.677966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.677976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.677981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.677990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.677994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.677999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.678036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:47.682150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:47.682885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:47.682904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:47.682908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:47.682912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:47.682918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 118 [2:7556254536714860482:3035]
2025-10-01T14:06:47.682934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:47.682955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:47.682959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.682962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.682970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.682985Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:47.682994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:47.683001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:47.683064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.683074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.683076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.683079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:47.683082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:47.683155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:47.683164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.683176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.683191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.683210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:47.683233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091719990:2446], now have 1 active actors on pipe
2025-10-01T14:06:47.683242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091720159:3233], now have 1 active actors on pipe
2025-10-01T14:06:47.683248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254536714860476:3035]
2025-10-01T14:06:47.683250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254536714860476:3035]
2025-10-01T14:06:47.683252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254536714860476:3035]
2025-10-01T14:06:47.683268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:47.683282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:47.683295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:47.683300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:47.683303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:47.683305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:47.683306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:47.683292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 118
2025-10-01T14:06:47.683325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 118
2025-10-01T14:06:47.683333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254536714860476:3035]
2025-10-01T14:06:47.683342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:47.683344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:47.683373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.683383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.683416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:47.683427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.683431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.683433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:47.683442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.683452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:47.683474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.683617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.683630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.683648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.683724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 119 partition: 0 MaxSeqNo: 45 sessionId: src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0
2025-10-01T14:06:47.684051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476aebf3-9b6bdce4-5497af76-be290176_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:47.686225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0] Write session: try to update token
2025-10-01T14:06:47.686240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:47.698448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 119 sessionId: src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:47.700583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:47.700829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.700871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.700908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:47.701005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:47.703774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:47.703792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:47.703795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:47.703798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:47.703806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254536714860476:3035]
2025-10-01T14:06:47.703812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254536714860476:3035]
2025-10-01T14:06:47.703816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254536714860476:3035]
2025-10-01T14:06:47.703867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:47.703870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:47.703877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.703880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:47.703883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:47.703888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:47.704022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:47.763495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254539091720182:3127]
2025-10-01T14:06:47.763753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 118, pipe: [1:7556254539091720182:3127]
2025-10-01T14:06:47.849598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:47.858075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.858110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.858275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.858336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.858424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.858515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.858566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.858578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.858656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.858717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.858778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.858843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.858889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.858897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.858952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.859002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.859055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.859108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.859145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.859155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.859211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.859269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.859323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.859374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.859419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.859426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.859492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.859545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.859599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.859656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.859696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.859702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.859788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.859859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.859930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.859991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.860037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.860046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.860112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.860180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.860265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.860345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.860401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.860408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.860485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.860548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.860609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.860668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.860713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.860724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.860782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.860865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.860926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.860981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.861041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.861049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.861115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:47.861170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:47.861233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:47.861309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:47.861365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:47.861373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:47.861438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091720182:3127], now have 1 active actors on pipe
2025-10-01T14:06:47.861672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:47.861695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254539091720182:3127]
2025-10-01T14:06:47.861720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:47.861725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:47.861759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 119 reason: error at write: Disconnected sessionId: src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0
2025-10-01T14:06:47.861963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 119 sessionId: src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0 is DEAD
2025-10-01T14:06:47.862081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:47.862089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0] Write session will restart in 0.006306s
2025-10-01T14:06:47.862108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0] Write session: Do CDS request
2025-10-01T14:06:47.862113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:47.862365Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:47.869908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.870012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:47.870027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 120
2025-10-01T14:06:47.870127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:47.870155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:47.870164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:47.870168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:47.870553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 120 sessionId:  describe result for acl check
2025-10-01T14:06:47.870582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:47.870589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:47.870590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:47.870596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254539091720235:3238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:47.871090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254539091720235:3238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:47.872887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254539091720235:3238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:47.874897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:47.875299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254539091720235:3238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:47.875314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254539091720235:3238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:47.875318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254539091720235:3238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:47.875325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:47.875686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:47.875919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:47.875928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:47.875938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:47.875980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:47.876007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254536714860669:3038]
2025-10-01T14:06:47.876421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:47.876701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:47.876740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:47.876972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:47.877008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.877015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.877015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.877016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.877017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.877017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.877018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.877019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.877020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.877020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.877021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.877021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.877022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.877023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.877026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.877032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.877034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.877036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.877038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.877040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.877042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.877044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.877047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.877049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.877051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.877053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.877055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.877057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.877062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.877066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:47.877072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.877074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:47.877077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.877080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:47.877083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.877085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:47.877088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.877091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:47.877093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.877096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:47.877100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.877105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:47.877109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.877114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:47.877117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.877122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:47.877127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.877130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.877133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.877135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.877138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.877140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.877143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.877146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:47.877148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.877151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:47.877180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:47.880920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:47.881545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:47.881559Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:47.881561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:47.881565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:47.881572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 119 [2:7556254536714860669:3038]
2025-10-01T14:06:47.881584Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:47.881600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:47.881605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.881607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.881608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.881622Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:47.881625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:47.881630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:47.881671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.881675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.881677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.881679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:47.881681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:47.881733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:47.881737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.881744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:47.881750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:47.881758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:47.881776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254536714860663:3038]
2025-10-01T14:06:47.881778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254536714860663:3038]
2025-10-01T14:06:47.881780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254536714860663:3038]
2025-10-01T14:06:47.881786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:47.881794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:47.881796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:47.881803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:47.881804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:47.881805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:47.881806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:47.881834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091720355:3238], now have 1 active actors on pipe
2025-10-01T14:06:47.881837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091720185:2446], now have 1 active actors on pipe
2025-10-01T14:06:47.881838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254536714860663:3038]
2025-10-01T14:06:47.881843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:47.881856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:47.881908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 119
2025-10-01T14:06:47.881912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 119
2025-10-01T14:06:47.881972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.881989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.882015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:47.882027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:47.882036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:47.882042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:47.882051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:47.882065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:47.882084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.882240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.882247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.882258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:47.882323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 120 partition: 0 MaxSeqNo: 45 sessionId: src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0
2025-10-01T14:06:47.882668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98be56ad-881f2c77-94f50c8-c56ce76d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:47.885247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0] Write session: try to update token
2025-10-01T14:06:47.885265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:47.892619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:47.892637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:47.892645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254536714860663:3038]
2025-10-01T14:06:47.892680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:47.892685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:47.892829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:47.892968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:47.893103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:47.893223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:47.893393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:47.893427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:47.899396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 120 sessionId: src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:47.901935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:47.902087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:47.902107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:47.902137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:47.902207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:47.912315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:47.912335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:47.912337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:47.912338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:47.912347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254536714860663:3038]
2025-10-01T14:06:47.912350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254536714860663:3038]
2025-10-01T14:06:47.912352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254536714860663:3038]
2025-10-01T14:06:47.912387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:47.912388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:47.912392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:47.912393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:47.912393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:47.912396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:47.912508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:47.961668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254539091720366:3127]
2025-10-01T14:06:47.961957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 119, pipe: [1:7556254539091720366:3127]
2025-10-01T14:06:48.065792Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:48.072871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.072900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.073042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.073095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.073148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.073199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.073250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.073266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.073337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.073387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.073436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.073505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.073551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.073561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.073624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.073681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.073739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.073796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.073845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.073851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.073915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.073972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.074032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.074093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.074141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.074147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.074207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.074261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.074323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.074397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.074446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.074452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.074513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.074571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.074630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.074687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.074727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.074733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.074802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.074856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.074911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.074964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.075007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.075012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.075065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.075144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.075196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.075254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.075299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.075305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.075378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.075433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.075501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.075588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.075636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.075642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.075702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.075757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.075830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.075886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.075927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.075933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.075983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254539091720366:3127], now have 1 active actors on pipe
2025-10-01T14:06:48.076247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254539091720366:3127]
2025-10-01T14:06:48.076280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:48.076292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:48.076298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:48.076322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 120 reason: error at write: Disconnected sessionId: src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0
2025-10-01T14:06:48.076524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 120 sessionId: src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0 is DEAD
2025-10-01T14:06:48.076650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:48.076661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0] Write session will restart in 0.005493s
2025-10-01T14:06:48.076688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0] Write session: Do CDS request
2025-10-01T14:06:48.076695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:48.076901Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:48.082897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.087454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:48.087468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 121
2025-10-01T14:06:48.090338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:48.090474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.090521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:48.090526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:48.090530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:48.090944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 121 sessionId:  describe result for acl check
2025-10-01T14:06:48.090972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:48.090974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:48.090977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:48.090983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254543386687802:3242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:48.091466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254543386687802:3242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:48.093714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254543386687802:3242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:48.095358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:48.095578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:48.095589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:48.095601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:48.095646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:48.095686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254541009828140:3040]
2025-10-01T14:06:48.096308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:48.096397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254543386687802:3242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:48.096409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254543386687802:3242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:48.096412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254543386687802:3242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:48.096418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:48.096579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:48.096638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:48.096958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:48.097012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.097018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.097019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.097020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.097021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.097023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.097024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.097025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.097027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.097028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.097029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.097030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.097031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.097033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.097038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.097047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.097051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.097055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.097059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.097062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.097066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.097070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.097073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.097078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.097081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.097085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.097089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.097092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.097098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.097105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.097112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.097117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.097121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.097126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.097130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.097135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.097140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.097150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.097154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.097159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.097165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.097171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.097175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.097180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.097186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.097191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.097196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.097205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.097210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.097215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.097219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.097224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.097230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.097235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.097239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.097246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.097285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:48.101208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:48.101875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:48.101890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:48.101892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:48.101897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:48.101904Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 120 [2:7556254541009828140:3040]
2025-10-01T14:06:48.101920Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:48.101936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:48.101948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.101951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.101953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.101970Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:48.101977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:48.101984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:48.102044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.102051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.102053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.102057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:48.102059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:48.102125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:48.102133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.102144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.102154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.102174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:48.102197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386687665:2446], now have 1 active actors on pipe
2025-10-01T14:06:48.102205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386687843:3242], now have 1 active actors on pipe
2025-10-01T14:06:48.102212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254541009828135:3040]
2025-10-01T14:06:48.102215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254541009828135:3040]
2025-10-01T14:06:48.102217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254541009828135:3040]
2025-10-01T14:06:48.102230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:48.102246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:48.102246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:48.102249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:48.102252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:48.102263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:48.102266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:48.102246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 120
2025-10-01T14:06:48.102261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 120
2025-10-01T14:06:48.102297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254541009828135:3040]
2025-10-01T14:06:48.102307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:48.102315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:48.102328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.102332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.102400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:48.102411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.102415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.102417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:48.102426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.102438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:48.102461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.102632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.102642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.102658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.102743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 121 partition: 0 MaxSeqNo: 45 sessionId: src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0
2025-10-01T14:06:48.103135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a2884b3-c8ee012f-235d26e0-ede64edc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:48.105439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0] Write session: try to update token
2025-10-01T14:06:48.105455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:48.121074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 121 sessionId: src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:48.123364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:48.123560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.123587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.123626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:48.123712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:48.128968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:48.128990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:48.128992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:48.128993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:48.129004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254541009828135:3040]
2025-10-01T14:06:48.129008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254541009828135:3040]
2025-10-01T14:06:48.129012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254541009828135:3040]
2025-10-01T14:06:48.129061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:48.129067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:48.129073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:48.129073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.129076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:48.129076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:48.129218Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:48.176195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254543386687878:3127]
2025-10-01T14:06:48.176447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 120, pipe: [1:7556254543386687878:3127]
2025-10-01T14:06:48.279645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:48.287224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.287257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.287412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.287467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.287527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.287588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.287631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.287640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.287707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.287764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.287821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.287878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.287923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.287928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.287984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.288038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.288091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.288151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.288200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.288207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.288272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.288336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.288400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.288454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.288497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.288504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.288559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.288608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.288659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.288712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.288756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.288761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.288826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.288900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.288965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.289027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.289073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.289079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.289148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.289210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.289273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.289333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.289386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.289391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.289463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.289524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.289582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.289641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.289694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.289700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.289773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.289839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.289911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.289979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.290024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.290031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.290094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.290152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.290206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.290269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.290313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.290318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.291079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:48.291141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254543386687878:3127]
2025-10-01T14:06:48.291166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:48.291173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:48.291200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 121 reason: error at write: Disconnected sessionId: src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0
2025-10-01T14:06:48.291429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 121 sessionId: src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0 is DEAD
2025-10-01T14:06:48.290403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386687878:3127], now have 1 active actors on pipe
2025-10-01T14:06:48.290890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:48.291614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:48.291625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0] Write session will restart in 0.005396s
2025-10-01T14:06:48.291652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0] Write session: Do CDS request
2025-10-01T14:06:48.291658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:48.297880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.297975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:48.297988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 122
2025-10-01T14:06:48.298099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.298128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:48.298138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:48.298146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:48.298606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 122 sessionId:  describe result for acl check
2025-10-01T14:06:48.298645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:48.298647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:48.298648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:48.298653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254543386687921:3254] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:48.299172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254543386687921:3254] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:48.301792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254543386687921:3254] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:48.302534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:48.303514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:48.303690Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:48.303700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:48.303709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:48.303749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:48.303786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254541009828355:3055]
2025-10-01T14:06:48.304259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254543386687921:3254] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:48.304273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254543386687921:3254] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:48.304277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254543386687921:3254] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:48.304284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:48.304408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:48.304604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:48.304642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:48.304966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:48.305019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.305025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.305026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.305027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.305028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.305028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.305029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.305030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.305031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.305032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.305033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.305034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.305036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.305037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.305041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.305052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.305056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.305060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.305063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.305067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.305071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.305074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.305078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.305082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.305086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.305089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.305093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.305097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.305102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.305110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.305115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.305121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.305130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.305135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.305140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.305149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.305153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.305162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.305166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.305172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.305180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.305185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.305194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.305198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.305203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.305216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.305224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.305228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.305232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.305237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.305241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.305249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.305253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.305258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.305266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.305270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.305312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:48.309025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:48.309610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:48.309623Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:48.309624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:48.309627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:48.309632Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 121 [2:7556254541009828355:3055]
2025-10-01T14:06:48.309642Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:48.309656Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:48.309661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.309664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.309665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.309676Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:48.309694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:48.309702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:48.309745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.309750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.309752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.309754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:48.309755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:48.309804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:48.309809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.309816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.309821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.309830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:48.309847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386687880:2446], now have 1 active actors on pipe
2025-10-01T14:06:48.309853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688052:3254], now have 1 active actors on pipe
2025-10-01T14:06:48.309859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254541009828349:3055]
2025-10-01T14:06:48.309864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254541009828349:3055]
2025-10-01T14:06:48.309865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254541009828349:3055]
2025-10-01T14:06:48.309873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:48.309886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:48.309885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:48.309888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:48.309889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:48.309897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:48.309899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:48.309918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254541009828349:3055]
2025-10-01T14:06:48.309926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:48.309930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:48.309991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 121
2025-10-01T14:06:48.310026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 121
2025-10-01T14:06:48.310062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.310070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.310087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2102cb2-afb0b275-3160fdec-662fa877_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:48.310095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.310102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.310104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:48.310111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.310120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:48.310132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.310294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.310300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.310309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.310394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 122 partition: 0 MaxSeqNo: 45 sessionId: src_id|a2102cb2-afb0b275-3160fdec-662fa877_0
2025-10-01T14:06:48.310863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a49cbd-1cf59065-d81fc926-26dc30cb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a2102cb2-afb0b275-3160fdec-662fa877_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:48.313074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2102cb2-afb0b275-3160fdec-662fa877_0] Write session: try to update token
2025-10-01T14:06:48.313085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2102cb2-afb0b275-3160fdec-662fa877_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:48.320085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:48.320106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:48.320113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254541009828349:3055]
2025-10-01T14:06:48.320149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:48.320152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:48.320355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:48.320499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:48.320623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:48.320743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:48.320934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:48.320965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:48.328231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 122 sessionId: src_id|a2102cb2-afb0b275-3160fdec-662fa877_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:48.330865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:48.331102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.331129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.331166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:48.331266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:48.338117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:48.338136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:48.338138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:48.338139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:48.338149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254541009828349:3055]
2025-10-01T14:06:48.338152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254541009828349:3055]
2025-10-01T14:06:48.338154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254541009828349:3055]
2025-10-01T14:06:48.338192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:48.338193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:48.338198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.338198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:48.338200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:48.338201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:48.338334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:48.391228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254543386688064:3127]
2025-10-01T14:06:48.391461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 121, pipe: [1:7556254543386688064:3127]
2025-10-01T14:06:48.472360Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:48.480598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.480630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.480784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.480855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.480919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.480976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.481019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.481028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.481089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.481146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.481206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.481266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.481308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.481316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.481382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.481443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.481509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.481569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.481614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.481621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.481687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.481745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.481803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.481861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.481910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.481917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.481978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.482036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.482095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.482153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.482200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.482207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.482269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.482326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.482399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.482461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.482509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.482516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.482581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.482636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.482699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.482759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.482801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.482808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.482867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.482926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.482988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.483044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.483086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.483093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.483157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.483216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.483274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.483332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.483374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.483380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.483440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.483497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.483555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.483614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.483822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.483831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.483898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688064:3127], now have 1 active actors on pipe
2025-10-01T14:06:48.484186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:48.484252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254543386688064:3127]
2025-10-01T14:06:48.484534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:48.484544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:48.484567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 122 reason: error at write: Disconnected sessionId: src_id|a2102cb2-afb0b275-3160fdec-662fa877_0
2025-10-01T14:06:48.484767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 122 sessionId: src_id|a2102cb2-afb0b275-3160fdec-662fa877_0 is DEAD
2025-10-01T14:06:48.484921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2102cb2-afb0b275-3160fdec-662fa877_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:48.484931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2102cb2-afb0b275-3160fdec-662fa877_0] Write session will restart in 0.007054s
2025-10-01T14:06:48.484956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2102cb2-afb0b275-3160fdec-662fa877_0] Write session: Do CDS request
2025-10-01T14:06:48.484962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2102cb2-afb0b275-3160fdec-662fa877_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:48.485236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:48.492870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2102cb2-afb0b275-3160fdec-662fa877_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.492973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:48.492986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 123
2025-10-01T14:06:48.493216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.493253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:48.493262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:48.493266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:48.493601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 123 sessionId:  describe result for acl check
2025-10-01T14:06:48.493629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:48.493634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:48.493636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:48.493641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254543386688202:3258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:48.494078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254543386688202:3258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:48.494645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:48.495535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:48.495725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:48.495734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:48.495745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:48.495784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:48.495818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254541009828533:3058]
2025-10-01T14:06:48.496204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254543386688202:3258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:48.496315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:48.496553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:48.496595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:48.496866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:48.496923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.496928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.496929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.496930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.496931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.496932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.496932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.496933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.496934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.496935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.496936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.496937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.496938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.496939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.496943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.496951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.496954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.496957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.496960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.496963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.496966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.496969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.496972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.496975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.496978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.496981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.496985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.496987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.496992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.496999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.497005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.497009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.497013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.497017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.497021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.497026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.497030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.497035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.497038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.497042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.497046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.497056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.497060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.497064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.497068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.497076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.497080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.497086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.497089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.497097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.497100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.497104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.497108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.497112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.497115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.497119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.497150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:48.500590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254543386688202:3258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:48.500606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254543386688202:3258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:48.500609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254543386688202:3258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:48.500619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:48.500763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:48.501422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:48.501437Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:48.501440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:48.501443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:48.501449Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 122 [2:7556254541009828533:3058]
2025-10-01T14:06:48.501464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:48.501480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:48.501483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.501486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.501488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.501503Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:48.501514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:48.501520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:48.501566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.501572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.501574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.501576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:48.501578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:48.501623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:48.501629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.501636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.501641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.501650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:48.501664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254541009828528:3058]
2025-10-01T14:06:48.501666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254541009828528:3058]
2025-10-01T14:06:48.501668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254541009828528:3058]
2025-10-01T14:06:48.501676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:48.501684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:48.501687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:48.501689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:48.501691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688066:2446], now have 1 active actors on pipe
2025-10-01T14:06:48.501697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:48.501709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:48.501716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:48.501721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688244:3258], now have 1 active actors on pipe
2025-10-01T14:06:48.501744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254541009828528:3058]
2025-10-01T14:06:48.501756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:48.501738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 122
2025-10-01T14:06:48.501760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 122
2025-10-01T14:06:48.501766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:48.501883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.501892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.501917Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:48.501927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.501931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.501933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:48.501940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.501953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:48.501970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.502251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.502260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.502276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.502378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 123 partition: 0 MaxSeqNo: 45 sessionId: src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0
2025-10-01T14:06:48.502710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2102cb2-afb0b275-3160fdec-662fa877_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:48.505029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0] Write session: try to update token
2025-10-01T14:06:48.505044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:48.512783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:48.512797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:48.512805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254541009828528:3058]
2025-10-01T14:06:48.512855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:48.512872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:48.513023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:48.513219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:48.513359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:48.513486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:48.513678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:48.513712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:48.518965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 123 sessionId: src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:48.521406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:48.521601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.521618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.521650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:48.521728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:48.534171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:48.534188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:48.534189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:48.534191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:48.534199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254541009828528:3058]
2025-10-01T14:06:48.534202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254541009828528:3058]
2025-10-01T14:06:48.534205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254541009828528:3058]
2025-10-01T14:06:48.534241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:48.534246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.534248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:48.534250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:48.534255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:48.534259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:48.534399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:48.584246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254543386688253:3127]
2025-10-01T14:06:48.584482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 122, pipe: [1:7556254543386688253:3127]
2025-10-01T14:06:48.672734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:48.679903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.679926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.680072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.680124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.680177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.680229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.680272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.680280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.680337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.680389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.680443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.680497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.680542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.680547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.680602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.680656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.680712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.680771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.680814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.680819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.680884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.680938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.680993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.681045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.681085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.681089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.681142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.681193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.681243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.681294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.681337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.681341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.681395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.681448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.681501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.681552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.681596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.681601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.681655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.681707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.681758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.681811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.681852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.681857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.681915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.681968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.682024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.682082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.682125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.682131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.682185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.682238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.682294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.682355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.682418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.682423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.682477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.682777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.683063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.683366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.683409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.683415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.683470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688253:3127], now have 1 active actors on pipe
2025-10-01T14:06:48.683685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:48.683697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:48.683723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 123 reason: error at write: Disconnected sessionId: src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0
2025-10-01T14:06:48.683724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254543386688253:3127]
2025-10-01T14:06:48.683747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:48.683896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 123 sessionId: src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0 is DEAD
2025-10-01T14:06:48.684084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:48.684095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0] Write session will restart in 0.005145s
2025-10-01T14:06:48.684119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0] Write session: Do CDS request
2025-10-01T14:06:48.684125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:48.684370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:48.690820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.690897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:48.690909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 124
2025-10-01T14:06:48.691020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.691050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:48.691057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:48.691060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:48.691385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 124 sessionId:  describe result for acl check
2025-10-01T14:06:48.691406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:48.691407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:48.691408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:48.691412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254543386688271:3263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:48.691858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254543386688271:3263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:48.694917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254543386688271:3263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:48.698076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:48.698181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254543386688271:3263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:48.698193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254543386688271:3263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:48.698195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254543386688271:3263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:48.698203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:48.699167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:48.699311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:48.699320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:48.699328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:48.699367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:48.699403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254541009828713:3060]
2025-10-01T14:06:48.699791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:48.700372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:48.700409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:48.700611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:48.700646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.700650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.700651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.700652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.700652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.700653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.700654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.700655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.700655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.700656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.700657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.700657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.700658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.700658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.700662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.700667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.700669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.700672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.700674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.700676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.700678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.700680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.700682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.700684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.700686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.700688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.700690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.700692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.700697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.700702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.700705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.700708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.700711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.700714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.700716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.700718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.700721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.700723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.700727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.700730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.700732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.700735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.700737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.700740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.700743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.700745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.700748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.700751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.700753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.700756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.700758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.700761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.700763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.700766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.700769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.700771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.700792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:48.704761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:48.705390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:48.705406Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:48.705410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:48.705415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:48.705424Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 123 [2:7556254541009828713:3060]
2025-10-01T14:06:48.705442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:48.705462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:48.705471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.705475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.705478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.705495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:48.705505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:48.705510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:48.705556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.705563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.705565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.705567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:48.705569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:48.705629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:48.705640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.705649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.705655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.705664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:48.705679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688429:3263], now have 1 active actors on pipe
2025-10-01T14:06:48.705687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688256:2446], now have 1 active actors on pipe
2025-10-01T14:06:48.705692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254541009828707:3060]
2025-10-01T14:06:48.705693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254541009828707:3060]
2025-10-01T14:06:48.705695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254541009828707:3060]
2025-10-01T14:06:48.705708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:48.705725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:48.705729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:48.705732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:48.705734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:48.705744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:48.705748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:48.705784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254541009828707:3060]
2025-10-01T14:06:48.705776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 123
2025-10-01T14:06:48.705799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:48.705776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 123
2025-10-01T14:06:48.705820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:48.705835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.705839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.705863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:48.705876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.705880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.705887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:48.705897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.705912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:48.705929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.706056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.706064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.706076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.706171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 124 partition: 0 MaxSeqNo: 45 sessionId: src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0
2025-10-01T14:06:48.706534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436ba5b-65f66f93-29c4f48f-fb7fd61d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:48.708925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0] Write session: try to update token
2025-10-01T14:06:48.708943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:48.721408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:48.721423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:48.721430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254541009828707:3060]
2025-10-01T14:06:48.721468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:48.721482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:48.721635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:48.721775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:48.721920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:48.722071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:48.722270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:48.722303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:48.723616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 124 sessionId: src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:48.726219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:48.726418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.726438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.726464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:48.726560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:48.738084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:48.738101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:48.738104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:48.738106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:48.738116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254541009828707:3060]
2025-10-01T14:06:48.738120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254541009828707:3060]
2025-10-01T14:06:48.738124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254541009828707:3060]
2025-10-01T14:06:48.738172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:48.738183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.738190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:48.738190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:48.738197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:48.738202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:48.738363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:48.783912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254543386688453:3127]
2025-10-01T14:06:48.784250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 123, pipe: [1:7556254543386688453:3127]
2025-10-01T14:06:48.885470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:48.894700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.894727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.894898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.894964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.895027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.895084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.895132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.895142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.895221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.895281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.895342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.895411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.895455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.895457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.895524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.895582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.895640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.895701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.895744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.895747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.895815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.895878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.895943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.896007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.896054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.896058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.896134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.896195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.896262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.896326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.896370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.896372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.896445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.896505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.896566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.896627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.896673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.896676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.896740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.896802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.896884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.896946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.896987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.896990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.897071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.897136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.897197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.897258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.897310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.897313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.897382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.897444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.897504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.897563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.897611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.897614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.897681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:48.897738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:48.897809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:48.897874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:48.897920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:48.897923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:48.897990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688453:3127], now have 1 active actors on pipe
2025-10-01T14:06:48.898657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:48.898749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:48.898753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:48.898793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 124 reason: error at write: Disconnected sessionId: src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0
2025-10-01T14:06:48.899041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 124 sessionId: src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0 is DEAD
2025-10-01T14:06:48.899502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254543386688453:3127]
2025-10-01T14:06:48.899790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:48.899803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0] Write session will restart in 0.005351s
2025-10-01T14:06:48.899830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0] Write session: Do CDS request
2025-10-01T14:06:48.899837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:48.900075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:48.906795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.907204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:48.907215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 125
2025-10-01T14:06:48.907329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:48.907360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:48.907371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:48.907376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:48.907756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 125 sessionId:  describe result for acl check
2025-10-01T14:06:48.907779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:48.907781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:48.907782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:48.907786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254543386688478:3268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:48.908186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254543386688478:3268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:48.911373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254543386688478:3268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:48.917522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254543386688478:3268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:48.917533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254543386688478:3268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:48.917535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254543386688478:3268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:48.917542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:48.923798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:48.924999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:48.925168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:48.925176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:48.925185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:48.925221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:48.925249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254541009828905:3063]
2025-10-01T14:06:48.925646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:48.925968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:48.926000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:48.926242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:48.926286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.926290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.926291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.926292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.926293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.926294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.926294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.926295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.926295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.926296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.926297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.926297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.926298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.926299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.926302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.926308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.926310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.926312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.926315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.926317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.926319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.926321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.926323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.926326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.926328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.926330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.926332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.926334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.926339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.926343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:48.926347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.926351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:48.926353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.926356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:48.926359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.926362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:48.926364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.926368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:48.926387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.926392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:48.926396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.926400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:48.926405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.926410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:48.926414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.926419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:48.926424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.926430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.926435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.926442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.926446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.926453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.926457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.926463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:48.926473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.926479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:48.926527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:48.931917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:48.932544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:48.932556Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:48.932559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:48.932562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:48.932567Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 124 [2:7556254541009828905:3063]
2025-10-01T14:06:48.932580Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:48.932595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:48.932596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.932599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.932600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.932614Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:48.932618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:48.932624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:48.932677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.932678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.932679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.932682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:48.932684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:48.932743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:48.932745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.932755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:48.932764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:48.932778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:48.932796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254541009828900:3063]
2025-10-01T14:06:48.932798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254541009828900:3063]
2025-10-01T14:06:48.932800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254541009828900:3063]
2025-10-01T14:06:48.932809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:48.932824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688574:3268], now have 1 active actors on pipe
2025-10-01T14:06:48.932825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:48.932829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:48.932832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:48.932832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:48.932857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:48.932861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:48.932868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688456:2446], now have 1 active actors on pipe
2025-10-01T14:06:48.932899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254541009828900:3063]
2025-10-01T14:06:48.932916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:48.932947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:48.933184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 124
2025-10-01T14:06:48.933219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 124
2025-10-01T14:06:48.933354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.933364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.933394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:48.933402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:48.933406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:48.933414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:48.933423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:48.933432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:48.933448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.937949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:48.937973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:48.938011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:48.942019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 125 partition: 0 MaxSeqNo: 45 sessionId: src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0
2025-10-01T14:06:48.942645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe97d45-1f5b84f4-581a59e9-e4f331cb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:48.945417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0] Write session: try to update token
2025-10-01T14:06:48.945462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:48.962724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:48.962748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:48.962752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:48.962755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:48.962766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254541009828900:3063]
2025-10-01T14:06:48.962771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254541009828900:3063]
2025-10-01T14:06:48.962775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254541009828900:3063]
2025-10-01T14:06:48.962848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:48.962857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:48.962867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:48.963062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:48.966438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:48.966460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:48.966466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:48.979548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 125 sessionId: src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:48.982139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:48.999945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254543386688643:3127]
2025-10-01T14:06:49.000534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 124, pipe: [1:7556254543386688643:3127]
2025-10-01T14:06:49.118523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:49.118952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.118963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.119003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254543386688643:3127], now have 1 active actors on pipe
2025-10-01T14:06:49.119766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:49.119389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:49.119841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 125 reason: status is not ok: tablet will be restarted right now sessionId: src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0
2025-10-01T14:06:49.120009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 125 sessionId: src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0 is DEAD
2025-10-01T14:06:49.120161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:49.120192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254543386688643:3127]
2025-10-01T14:06:49.122460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:49.122473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0] Write session will restart in 0.008587s
2025-10-01T14:06:49.122502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0] Write session: Do CDS request
2025-10-01T14:06:49.122508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:49.134786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:49.135120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:49.135133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 126
2025-10-01T14:06:49.135288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:49.135318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:49.135324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:49.135327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:49.135681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 126 sessionId:  describe result for acl check
2025-10-01T14:06:49.135710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:49.135711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:49.135713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:49.135720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254547681656056:3273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:49.136252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254547681656056:3273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:49.138963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254547681656056:3273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:49.140522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:49.149709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:49.149967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:49.149981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:49.149993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:49.150055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:49.150097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254545304796383:3065]
2025-10-01T14:06:49.150815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254547681656056:3273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:49.150830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254547681656056:3273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:49.150834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254547681656056:3273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:49.150842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:49.150859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:49.151677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:49.151742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:49.152085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:49.152143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.152144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.152145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.152147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.152148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.152149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.152150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.152152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.152153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.152154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.152156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.152157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.152158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.152159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.152165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.152176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.152180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.152184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.152187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.152191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.152194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.152198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.152201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.152205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.152209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.152212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.152216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.152219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.152226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.152233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.152239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.152244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.152248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.152252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.152256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.152260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.152265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.152269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.152273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.152277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.152282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.152287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.152292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.152296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.152300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.152304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.152307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.152311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.152315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.152319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.152323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.152327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.152331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.152334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.152338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.152343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.152376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:49.157328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:49.157975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:49.157979Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:49.157982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:49.157986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:49.157993Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 125 [2:7556254545304796383:3065]
2025-10-01T14:06:49.158009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:49.158026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:49.158030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.158034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.158036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.158052Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:49.158058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:49.158064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:49.158121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.158123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.158125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.158129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:49.158132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:49.158205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:49.158207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.158220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.158231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.158248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:49.158267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656121:3273], now have 1 active actors on pipe
2025-10-01T14:06:49.158272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681655946:2446], now have 1 active actors on pipe
2025-10-01T14:06:49.158279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254545304796378:3065]
2025-10-01T14:06:49.158282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254545304796378:3065]
2025-10-01T14:06:49.158284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254545304796378:3065]
2025-10-01T14:06:49.158302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:49.158317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:49.158332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:49.158335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:49.158366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254545304796378:3065]
2025-10-01T14:06:49.158384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:49.158435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:49.158438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:49.158442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:49.158447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:49.158852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.158862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.158892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:49.158901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.158907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.158910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:49.158920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.158931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:49.158947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:49.159140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.159144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.159168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:49.158566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 125
2025-10-01T14:06:49.158591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 125
2025-10-01T14:06:49.159260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 126 partition: 0 MaxSeqNo: 45 sessionId: src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0
2025-10-01T14:06:49.159633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|496cdef4-cf99e03d-7a85d48f-93a7289e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:49.162240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0] Write session: try to update token
2025-10-01T14:06:49.162262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:49.171348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:49.171370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:49.171380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254545304796378:3065]
2025-10-01T14:06:49.171433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:49.171597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:49.171744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:49.171885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:49.172028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:49.172229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:49.172274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:49.172471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:49.186349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 126 sessionId: src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:49.189219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:49.190471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.190497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.190535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:49.195555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:49.208683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:49.208701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:49.208704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:49.208706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:49.208716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254545304796378:3065]
2025-10-01T14:06:49.208720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254545304796378:3065]
2025-10-01T14:06:49.208723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254545304796378:3065]
2025-10-01T14:06:49.208767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:49.208775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.208777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:49.208924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:49.209294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:49.209300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:49.209369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:49.223768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254547681656153:3127]
2025-10-01T14:06:49.226753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 125, pipe: [1:7556254547681656153:3127]
2025-10-01T14:06:49.381890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:49.390073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.390101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.390262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.390325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.390407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.390472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.390638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.390648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.390716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.390776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.390843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.390909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.390957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.390963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.391021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.391080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.391138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.391197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.391246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.391253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.391307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.391711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.391767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.391826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.391869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.391876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.391934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.391987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.392041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.392097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.392142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.392148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.392218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.392277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.392342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.392410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.392462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.392468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.392536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.392601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.392672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.392743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.392790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.392796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.392883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.392948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.393011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.393070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.393116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.393122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.393184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.393241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.393300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.393361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.393404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.393411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.393474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.393531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.393591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.393656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.393705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.393712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.393776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656153:3127], now have 1 active actors on pipe
2025-10-01T14:06:49.393956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254547681656153:3127]
2025-10-01T14:06:49.393984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:49.393986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:49.394007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 126 reason: error at write: Disconnected sessionId: src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0
2025-10-01T14:06:49.394022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:49.394168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 126 sessionId: src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0 is DEAD
2025-10-01T14:06:49.394309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:49.394316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0] Write session will restart in 0.007899s
2025-10-01T14:06:49.394338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0] Write session: Do CDS request
2025-10-01T14:06:49.394343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:49.394420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:49.403874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:49.403998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:49.404011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 127
2025-10-01T14:06:49.404148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:49.404180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:49.404189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:49.404192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:49.404594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 127 sessionId:  describe result for acl check
2025-10-01T14:06:49.404634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:49.404639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:49.404641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:49.404646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254547681656240:3284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:49.405280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254547681656240:3284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:49.407524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:49.407677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254547681656240:3284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:49.408420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:49.408577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:49.408585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:49.408596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:49.408634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:49.408672Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254545304796601:3080]
2025-10-01T14:06:49.409099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:49.409368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:49.409403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:49.409635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:49.409681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.409687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.409688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.409689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.409690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.409691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.409692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.409693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.409694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.409696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.409697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.409698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.409699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.409700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.409704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.409709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.409711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.409713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.409715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.409717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.409719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.409720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.409722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.409724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.409726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.409728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.409729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.409731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.409735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.409740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.409744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.409746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.409749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.409752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.409754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.409757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.409759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.409762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.409765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.409767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.409770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.409772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.409774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.409782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.409785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.409788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.409793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.409797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.409799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.409804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.409806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.409809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.409812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.409815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.409817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.409821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.409840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:49.410261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254547681656240:3284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:49.410274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254547681656240:3284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:49.410277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254547681656240:3284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:49.410285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:49.413269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:49.414115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:49.414126Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:49.414129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:49.414132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:49.414139Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 126 [2:7556254545304796601:3080]
2025-10-01T14:06:49.414153Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:49.414170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:49.414175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.414178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.414179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.414191Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:49.414200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:49.414205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:49.414242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.414247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.414248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.414250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:49.414252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:49.414310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:49.414317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.414327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.414340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.414358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:49.414394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656342:3284], now have 1 active actors on pipe
2025-10-01T14:06:49.414401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656161:2446], now have 1 active actors on pipe
2025-10-01T14:06:49.414408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254545304796596:3080]
2025-10-01T14:06:49.414409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254545304796596:3080]
2025-10-01T14:06:49.414410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254545304796596:3080]
2025-10-01T14:06:49.414420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:49.414435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:49.414437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:49.414440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:49.414442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:49.414449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:49.414452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:49.414448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 126
2025-10-01T14:06:49.414474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254545304796596:3080]
2025-10-01T14:06:49.414480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:49.414457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 126
2025-10-01T14:06:49.414482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:49.414493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.414499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.414532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:49.414541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.414543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.414545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:49.414550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.414556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:49.414570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:49.414720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.414727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.414740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:49.414812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 127 partition: 0 MaxSeqNo: 45 sessionId: src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0
2025-10-01T14:06:49.415168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ad00acf-fca5ead9-ebc12d25-64425bd0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:49.417372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0] Write session: try to update token
2025-10-01T14:06:49.417384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:49.430627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 127 sessionId: src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:49.433170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:49.433405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.433429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.433472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:49.433572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:49.436239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:49.436262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:49.436264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:49.436266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:49.436275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254545304796596:3080]
2025-10-01T14:06:49.436280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254545304796596:3080]
2025-10-01T14:06:49.436283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254545304796596:3080]
2025-10-01T14:06:49.436334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:49.436335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:49.436341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:49.436346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.436347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:49.436349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:49.436484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:49.494081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254547681656349:3127]
2025-10-01T14:06:49.494360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 126, pipe: [1:7556254547681656349:3127]
2025-10-01T14:06:49.579443Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:49.587641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.587672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.587859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.587937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.588014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.588088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.588143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.588156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.588234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.588306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.588385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.588472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.588521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.588528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.588590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.588650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.588713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.588773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.588821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.588828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.588904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.588966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.589028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.589090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.589138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.589145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.589213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.589278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.589341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.589412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.589460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.589466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.589550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.589621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.589704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.589779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.589831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.589838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.589919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.589991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.590069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.590154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.590229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.590238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.590325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.590418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.590500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.590568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.590622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.590629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.590699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.590771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.590839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.590909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.590961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.590969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.591044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.591109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.591179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.591258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.591313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.591320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.591398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656349:3127], now have 1 active actors on pipe
2025-10-01T14:06:49.591664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:49.591666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:49.591678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:49.591707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 127 reason: error at write: Disconnected sessionId: src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0
2025-10-01T14:06:49.591718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254547681656349:3127]
2025-10-01T14:06:49.591880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 127 sessionId: src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0 is DEAD
2025-10-01T14:06:49.592019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:49.592029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0] Write session will restart in 0.006584s
2025-10-01T14:06:49.592063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0] Write session: Do CDS request
2025-10-01T14:06:49.592069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:49.592675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:49.599934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:49.600031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:49.600043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 128
2025-10-01T14:06:49.600215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:49.600257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:49.600267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:49.600271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:49.600870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 128 sessionId:  describe result for acl check
2025-10-01T14:06:49.600903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:49.600909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:49.600911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:49.600916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254547681656369:3289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:49.601422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254547681656369:3289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:49.604321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254547681656369:3289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:49.606805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:49.607236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254547681656369:3289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:49.607253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254547681656369:3289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:49.607256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254547681656369:3289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:49.607263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:49.607684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:49.607813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:49.607820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:49.607827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:49.607883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:49.607915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254545304796786:3083]
2025-10-01T14:06:49.608399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:49.608666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:49.608693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:49.608905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:49.608941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.608947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.608948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.608949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.608951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.608952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.608953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.608954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.608955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.608956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.608958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.608959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.608960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.608961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.608966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.608975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.608977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.608979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.608981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.608983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.608984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.608986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.608988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.608990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.608992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.608994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.608996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.608998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.609003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.609008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.609011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.609014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.609018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.609021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.609023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.609025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.609028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.609031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.609033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.609036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.609039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.609042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.609044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.609046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.609050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.609053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.609056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.609059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.609061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.609064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.609066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.609069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.609071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.609074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.609076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.609079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.609099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:49.612861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:49.613436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:49.613447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:49.613449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:49.613452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:49.613457Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 127 [2:7556254545304796786:3083]
2025-10-01T14:06:49.613467Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:49.613481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:49.613488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.613491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.613492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.613503Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:49.613506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:49.613511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:49.613550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.613551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.613553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.613558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:49.613560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:49.613611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:49.613616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.613622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.613628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.613636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:49.613652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254545304796780:3083]
2025-10-01T14:06:49.613654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254545304796780:3083]
2025-10-01T14:06:49.613655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254545304796780:3083]
2025-10-01T14:06:49.613667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:49.613677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656354:2446], now have 1 active actors on pipe
2025-10-01T14:06:49.613679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:49.613681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:49.613683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:49.613683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656532:3289], now have 1 active actors on pipe
2025-10-01T14:06:49.613688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:49.613696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:49.613698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:49.613719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254545304796780:3083]
2025-10-01T14:06:49.613730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:49.613736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:49.613745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 127
2025-10-01T14:06:49.613766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 127
2025-10-01T14:06:49.613826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.613833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.613849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a330214c-751178f5-e9eb880f-7888545c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:49.613857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.613860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.613861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:49.613867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.613874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:49.613885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:49.613996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.614005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.614013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:49.614085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 128 partition: 0 MaxSeqNo: 45 sessionId: src_id|a330214c-751178f5-e9eb880f-7888545c_0
2025-10-01T14:06:49.614430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8eeafd-693c41b1-51249bea-4ad24d35_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a330214c-751178f5-e9eb880f-7888545c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:49.617250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a330214c-751178f5-e9eb880f-7888545c_0] Write session: try to update token
2025-10-01T14:06:49.617263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a330214c-751178f5-e9eb880f-7888545c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:49.632644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 128 sessionId: src_id|a330214c-751178f5-e9eb880f-7888545c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:49.634509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:49.634524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:49.634527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:49.634529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:49.634540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254545304796780:3083]
2025-10-01T14:06:49.634545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254545304796780:3083]
2025-10-01T14:06:49.634549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254545304796780:3083]
2025-10-01T14:06:49.634595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:49.634602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.634604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:49.634723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:49.634733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:49.634736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:49.634760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:49.635482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:49.691719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254547681656544:3127]
2025-10-01T14:06:49.694737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 127, pipe: [1:7556254547681656544:3127]
2025-10-01T14:06:49.772709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:49.773197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.773208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.773238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656544:3127], now have 1 active actors on pipe
2025-10-01T14:06:49.773435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:49.773528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:49.773659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:49.773667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:49.773701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254547681656544:3127]
2025-10-01T14:06:49.773734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 128 reason: error at write: Disconnected sessionId: src_id|a330214c-751178f5-e9eb880f-7888545c_0
2025-10-01T14:06:49.773937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 128 sessionId: src_id|a330214c-751178f5-e9eb880f-7888545c_0 is DEAD
2025-10-01T14:06:49.774096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a330214c-751178f5-e9eb880f-7888545c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:49.774107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a330214c-751178f5-e9eb880f-7888545c_0] Write session will restart in 0.006557s
2025-10-01T14:06:49.774134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a330214c-751178f5-e9eb880f-7888545c_0] Write session: Do CDS request
2025-10-01T14:06:49.774140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a330214c-751178f5-e9eb880f-7888545c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:49.781918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a330214c-751178f5-e9eb880f-7888545c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:49.781995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:49.782012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 129
2025-10-01T14:06:49.782216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:49.782270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:49.782280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:49.782284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:49.782877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 129 sessionId:  describe result for acl check
2025-10-01T14:06:49.782912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:49.782919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:49.782921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:49.782929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254547681656587:3294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:49.783440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254547681656587:3294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:49.785612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254547681656587:3294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:49.788043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:49.788133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254547681656587:3294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:49.788147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254547681656587:3294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:49.788151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254547681656587:3294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:49.788158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:49.789117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:49.789320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:49.789330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:49.789345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:49.789405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:49.789451Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254545304796982:3086]
2025-10-01T14:06:49.790051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:49.790388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:49.790437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:49.790770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:49.790839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.790845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.790847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.790848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.790850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.790851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.790852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.790854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.790855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.790856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.790858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.790859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.790860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.790862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.790868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.790878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.790883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.790887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.790891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.790895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.790898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.790902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.790906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.790911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.790915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.790918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.790923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.790927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.790936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.790943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:49.790949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.790954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:49.790958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.790964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:49.790968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.790974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:49.790984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.790990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:49.791000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.791005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:49.791015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.791020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:49.791029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.791034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:49.791043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.791049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:49.791058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.791063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.791072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.791077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.791085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.791090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.791098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.791103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:49.791111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.791116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:49.791160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:49.795089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:49.795805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:49.795819Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:49.795821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:49.795825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:49.795833Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 128 [2:7556254545304796982:3086]
2025-10-01T14:06:49.795852Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:49.795873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:49.795889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.795897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.795900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.795915Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:49.795925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:49.795932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:49.795995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.796002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.796004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.796007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:49.796009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:49.796088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:49.796096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.796109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:49.796126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:49.796148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:49.796173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656737:3294], now have 1 active actors on pipe
2025-10-01T14:06:49.796181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656558:2446], now have 1 active actors on pipe
2025-10-01T14:06:49.796187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254545304796975:3086]
2025-10-01T14:06:49.796194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254545304796975:3086]
2025-10-01T14:06:49.796197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254545304796975:3086]
2025-10-01T14:06:49.796225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:49.796234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:49.796239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:49.796241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:49.796242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:49.796214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 128
2025-10-01T14:06:49.796256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:49.796263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:49.796279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.796282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.796315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254545304796975:3086]
2025-10-01T14:06:49.796326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:49.796349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:49.796350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:49.796356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:49.796360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:49.796362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:49.796372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:49.796252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 128
2025-10-01T14:06:49.796381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:49.796426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:49.796549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.796556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.796567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:49.796626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 129 partition: 0 MaxSeqNo: 45 sessionId: src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0
2025-10-01T14:06:49.796981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a330214c-751178f5-e9eb880f-7888545c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:49.800062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0] Write session: try to update token
2025-10-01T14:06:49.800083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:49.807382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:49.807400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:49.807411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254545304796975:3086]
2025-10-01T14:06:49.807456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:49.807636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:49.807780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:49.807924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:49.808069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:49.808355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:49.808391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:49.808538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:49.815048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 129 sessionId: src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:49.817655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:49.817890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.817921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.817956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:49.818131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:49.826468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:49.826483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:49.826485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:49.826487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:49.826497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254545304796975:3086]
2025-10-01T14:06:49.826499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254545304796975:3086]
2025-10-01T14:06:49.826502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254545304796975:3086]
2025-10-01T14:06:49.826534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:49.826539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:49.826541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:49.826542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:49.826546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:49.826548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:49.826665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:49.874316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254547681656749:3127]
2025-10-01T14:06:49.876785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 128, pipe: [1:7556254547681656749:3127]
2025-10-01T14:06:49.987040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:49.995307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:49.995338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:49.995513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.995581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.995647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.995712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.995756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.995761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.995832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.995897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.995959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.996024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.996072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.996075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.996158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.996229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.996297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.996371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.996421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.996425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.996509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.996581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.996650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.996718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.996769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.996773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.996866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.996935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.997005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.997080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.997125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.997128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.997209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.997275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.997350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.997426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.997480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.997483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.997568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.997643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.997724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.997805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.997855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.997858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.997934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.997999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.998070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.998140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.998181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.998184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.998258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.998319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.998626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.999640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:49.999660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:49.999702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 129 reason: error at write: Disconnected sessionId: src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0
2025-10-01T14:06:49.999811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:49.999866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254547681656749:3127]
2025-10-01T14:06:49.999894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 129 sessionId: src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0 is DEAD
2025-10-01T14:06:50.000491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:50.000503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0] Write session will restart in 0.009643s
2025-10-01T14:06:50.000527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0] Write session: Do CDS request
2025-10-01T14:06:50.000533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:49.998704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.998770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.998773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.998835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:49.998886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:49.998949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:49.999009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:49.999052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:49.999055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:49.999123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656749:3127], now have 1 active actors on pipe
2025-10-01T14:06:50.000195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:50.011210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.011506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:50.011527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 130
2025-10-01T14:06:50.011753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.011783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:50.011788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:50.011792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:50.012209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 130 sessionId:  describe result for acl check
2025-10-01T14:06:50.012237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:50.012239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:50.012242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:50.012247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254551976624064:3298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:50.012767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254551976624064:3298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:50.015203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254551976624064:3298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:50.019263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254551976624064:3298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:50.019282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254551976624064:3298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:50.019287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254551976624064:3298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:50.019295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:50.021205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:50.022054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:50.022232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:50.022242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:50.022253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:50.022300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:50.022338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254549599764462:3088]
2025-10-01T14:06:50.023052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:50.023347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:50.023394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:50.023740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:50.023796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.023801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.023802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.023804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.023805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.023806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.023808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.023809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.023810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.023812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.023813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.023814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.023816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.023817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.023823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.023833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.023837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.023841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.023845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.023849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.023851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.023853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.023855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.023857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.023859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.023861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.023863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.023865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.023871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.023877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.023881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.023885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.023887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.023890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.023893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.023895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.023899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.023902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.023905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.023907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.023910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.023913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.023915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.023918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.023921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.023923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.023926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.023929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.023931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.023934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.023936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.023939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.023941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.023946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.023950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.023954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.023983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:50.028193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:50.028785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:50.028798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:50.028800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:50.028803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:50.028809Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 129 [2:7556254549599764462:3088]
2025-10-01T14:06:50.028821Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:50.028845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:50.028849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.028853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.028855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.028869Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:50.028876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:50.028882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:50.028931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.028936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.028938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.028941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:50.028944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:50.029006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:50.029014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.029026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.029036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.029051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:50.029072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624204:3298], now have 1 active actors on pipe
2025-10-01T14:06:50.029079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254547681656753:2446], now have 1 active actors on pipe
2025-10-01T14:06:50.029086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254549599764457:3088]
2025-10-01T14:06:50.029088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254549599764457:3088]
2025-10-01T14:06:50.029090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254549599764457:3088]
2025-10-01T14:06:50.029102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:50.029120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:50.029135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:50.029141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:50.029150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:50.029161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:50.029163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:50.029173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254549599764457:3088]
2025-10-01T14:06:50.029179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:50.029140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 129
2025-10-01T14:06:50.029148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 129
2025-10-01T14:06:50.029191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:50.029203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.029208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.029242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:50.029252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.029256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.029261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:50.029267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.029274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:50.029290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.029451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.029464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.029486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.029570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 130 partition: 0 MaxSeqNo: 45 sessionId: src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0
2025-10-01T14:06:50.029936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36da54a5-1c51295b-1af55ddf-9c66a34e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:50.032340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0] Write session: try to update token
2025-10-01T14:06:50.032360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:50.050646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:50.050663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:50.050666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:50.050667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:50.050677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254549599764457:3088]
2025-10-01T14:06:50.050681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254549599764457:3088]
2025-10-01T14:06:50.050685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254549599764457:3088]
2025-10-01T14:06:50.050733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:50.050741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.050740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:50.050746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:50.050749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:50.050752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:50.050878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:50.052701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 130 sessionId: src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:50.055324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:50.100244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254551976624247:3127]
2025-10-01T14:06:50.101111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 129, pipe: [1:7556254551976624247:3127]
2025-10-01T14:06:50.197805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:50.198138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.198155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.198197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624247:3127], now have 1 active actors on pipe
2025-10-01T14:06:50.198745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:50.198814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 130 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0
2025-10-01T14:06:50.198968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 130 sessionId: src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0 is DEAD
2025-10-01T14:06:50.199086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:50.199137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254551976624247:3127]
2025-10-01T14:06:50.198442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:50.199717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:50.199731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0] Write session will restart in 0.006713s
2025-10-01T14:06:50.199761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0] Write session: Do CDS request
2025-10-01T14:06:50.199767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:50.208116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.208132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:50.208148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 131
2025-10-01T14:06:50.208463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.208497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:50.208520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:50.208523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:50.209049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 131 sessionId:  describe result for acl check
2025-10-01T14:06:50.209086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:50.209092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:50.209097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:50.209103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254551976624260:3303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:50.209645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254551976624260:3303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:50.214211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254551976624260:3303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:50.222220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254551976624260:3303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:50.222240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254551976624260:3303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:50.222244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254551976624260:3303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:50.222252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:50.225925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:50.228007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:50.228259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:50.228272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:50.228284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:50.228336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:50.228375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254549599764649:3091]
2025-10-01T14:06:50.228970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:50.229478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:50.229513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:50.229825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:50.229862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.229867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.229868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.229868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.229869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.229870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.229870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.229871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.229872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.229872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.229873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.229874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.229875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.229875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.229879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.229885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.229887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.229890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.229892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.229894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.229896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.229899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.229901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.229904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.229906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.229908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.229910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.229912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.229916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.229921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.229925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.229928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.229930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.229933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.229935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.229938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.229941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.229944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.229946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.229949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.229952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.229954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.229957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.229960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.229962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.229965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.229967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.229970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.229972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.229975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.229977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.229980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.229983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.229985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.229988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.229990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.230012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:50.241252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:50.241937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:50.241943Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:50.241946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:50.241949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:50.241958Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 130 [2:7556254549599764649:3091]
2025-10-01T14:06:50.241974Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:50.241988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:50.241991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.241995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.241997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.242015Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:50.242021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:50.242027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:50.242081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.242083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.242084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.242088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:50.242090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:50.242161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:50.242163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.242173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.242181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.242193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:50.242210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254549599764644:3091]
2025-10-01T14:06:50.242212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254549599764644:3091]
2025-10-01T14:06:50.242213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254549599764644:3091]
2025-10-01T14:06:50.242231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:50.242244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:50.242255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:50.242257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:50.242297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254549599764644:3091]
2025-10-01T14:06:50.242299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:50.242316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:50.242318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:50.242319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624373:3303], now have 1 active actors on pipe
2025-10-01T14:06:50.242320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:50.242322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624253:2446], now have 1 active actors on pipe
2025-10-01T14:06:50.242326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:50.242756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 130
2025-10-01T14:06:50.242785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 130
2025-10-01T14:06:50.248972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.248999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.249039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:50.249051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.249058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.249061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:50.249073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.249088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:50.249108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.252446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.252469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.252509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.252651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 131 partition: 0 MaxSeqNo: 45 sessionId: src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0
2025-10-01T14:06:50.253071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dc5812a-b861ab7e-14a1b2d9-dd6b613_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:50.255574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0] Write session: try to update token
2025-10-01T14:06:50.255591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:50.276709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 131 sessionId: src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:50.276521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:50.276543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:50.276545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:50.276547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:50.276556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254549599764644:3091]
2025-10-01T14:06:50.276560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254549599764644:3091]
2025-10-01T14:06:50.276564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254549599764644:3091]
2025-10-01T14:06:50.276611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:50.276618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.276620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:50.276683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:50.276689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:50.276693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:50.276799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:50.279195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:50.298247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254551976624467:3127]
2025-10-01T14:06:50.299706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 130, pipe: [1:7556254551976624467:3127]
2025-10-01T14:06:50.442250Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:50.442540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.442558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.442602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624467:3127], now have 1 active actors on pipe
2025-10-01T14:06:50.442828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:50.442891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254551976624467:3127]
2025-10-01T14:06:50.442901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:50.442906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:50.442931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:50.442963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 131 reason: error at write: Disconnected sessionId: src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0
2025-10-01T14:06:50.443163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 131 sessionId: src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0 is DEAD
2025-10-01T14:06:50.443369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:50.443382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0] Write session will restart in 0.007320s
2025-10-01T14:06:50.443411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0] Write session: Do CDS request
2025-10-01T14:06:50.443419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:50.452629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.452698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:50.452713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 132
2025-10-01T14:06:50.452851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.452888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:50.452897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:50.452901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:50.454050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 132 sessionId:  describe result for acl check
2025-10-01T14:06:50.454089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:50.454091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:50.454093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:50.454098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254551976624586:3314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:50.454621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254551976624586:3314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:50.456227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:50.456374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254551976624586:3314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:50.457175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:50.457339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:50.457350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:50.457362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:50.457408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:50.457445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254549599764870:3105]
2025-10-01T14:06:50.458108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:50.458410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:50.458453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:50.458777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:50.458840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.458830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254551976624586:3314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:50.458842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254551976624586:3314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:50.458846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.458846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254551976624586:3314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:50.458853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:50.458847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.458848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.458849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.458850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.458851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.458852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.458853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.458854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.458855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.458856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.458857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.458858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.458864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.458874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.458879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.458883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.458888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.458892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.458896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.458900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.458905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.458909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.458913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.458917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.458921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.458926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.458932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.458940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.458946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.458952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.458956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.458962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.458971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.458977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.458982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.458992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.458998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.459007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.459012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.459018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.459026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.459031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.459037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.459046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.459053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.459058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.459067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.459073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.459079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.459084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.459093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.459098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.459103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.459113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.459156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:50.463361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:50.464014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:50.464028Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:50.464031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:50.464034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:50.464041Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 131 [2:7556254549599764870:3105]
2025-10-01T14:06:50.464057Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:50.464075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:50.464083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.464087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.464090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.464105Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:50.464115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:50.464122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:50.464178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.464185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.464187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.464190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:50.464193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:50.464264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:50.464273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.464286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.464302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.464323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:50.464350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624654:3314], now have 1 active actors on pipe
2025-10-01T14:06:50.464358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624470:2446], now have 1 active actors on pipe
2025-10-01T14:06:50.464368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254549599764865:3105]
2025-10-01T14:06:50.464374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254549599764865:3105]
2025-10-01T14:06:50.464377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254549599764865:3105]
2025-10-01T14:06:50.464389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:50.464406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:50.464407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:50.464410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:50.464412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:50.464425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:50.464429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:50.464463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254549599764865:3105]
2025-10-01T14:06:50.464474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:50.464486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:50.464465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 131
2025-10-01T14:06:50.464475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 131
2025-10-01T14:06:50.464551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.464561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.464590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:50.464601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.464605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.464612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:50.464621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.464634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:50.464657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.464821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.464830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.464855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.464951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 132 partition: 0 MaxSeqNo: 45 sessionId: src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0
2025-10-01T14:06:50.465310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb8040b0-3938747-4d2c13b1-d72bc59e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:50.467796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0] Write session: try to update token
2025-10-01T14:06:50.467815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:50.476504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:50.476525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:50.476535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254549599764865:3105]
2025-10-01T14:06:50.476581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:50.476602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:50.476761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:50.476930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:50.477080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:50.477229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:50.477442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:50.477482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:50.483572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 132 sessionId: src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:50.486258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:50.486510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.486533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.486569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:50.486694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:50.498003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:50.498020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:50.498022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:50.498024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:50.498032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254549599764865:3105]
2025-10-01T14:06:50.498035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254549599764865:3105]
2025-10-01T14:06:50.498039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254549599764865:3105]
2025-10-01T14:06:50.498078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:50.498084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.498086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:50.498089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:50.498106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:50.498110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:50.498230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:50.543146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254551976624666:3127]
2025-10-01T14:06:50.543421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 131, pipe: [1:7556254551976624666:3127]
2025-10-01T14:06:50.636111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:50.643867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.643893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.644060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.644129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.644204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.644275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.644330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.644340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.644411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.644465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.644530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.644594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.644637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.644642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.644703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.644758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.644814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.644895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.644947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.644950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.645021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.645082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.645140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.645200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.645246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.645248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.645313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.645370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.645435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.645496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.645540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.645547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.645617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.645681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.645742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.645798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.645843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.645846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.645910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.645966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.646034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.646090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.646131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.646133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.646194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.646239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.646288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.646335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.646403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.646406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.646468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.646523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.646578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.646644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.646700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.646711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.646772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:50.646822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:50.646876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:50.646925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:50.646968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:50.646970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:50.647037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624666:3127], now have 1 active actors on pipe
2025-10-01T14:06:50.650599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:50.650671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:50.650683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:50.650694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254551976624666:3127]
2025-10-01T14:06:50.650711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 132 reason: error at write: Disconnected sessionId: src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0
2025-10-01T14:06:50.650717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:50.651234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:50.651245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0] Write session will restart in 0.006091s
2025-10-01T14:06:50.651269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0] Write session: Do CDS request
2025-10-01T14:06:50.651276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:50.650909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 132 sessionId: src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0 is DEAD
2025-10-01T14:06:50.661408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.661454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:50.661468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 133
2025-10-01T14:06:50.661618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.661644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:50.661650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:50.661654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:50.662029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 133 sessionId:  describe result for acl check
2025-10-01T14:06:50.662071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:50.662072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:50.662074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:50.662081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254551976624690:3319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:50.662615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254551976624690:3319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:50.665191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254551976624690:3319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:50.668363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254551976624690:3319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:50.668374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254551976624690:3319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:50.668377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254551976624690:3319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:50.668383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:50.677119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:50.679332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:50.679543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:50.679554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:50.679566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:50.679612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:50.679649Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254549599765059:3108]
2025-10-01T14:06:50.680299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:50.680670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:50.680712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:50.681034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:50.681086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.681091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.681092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.681094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.681095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.681097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.681098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.681099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.681101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.681102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.681103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.681104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.681106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.681107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.681112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.681124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.681128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.681132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.681137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.681141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.681145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.681149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.681157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.681161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.681165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.681169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.681173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.681177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.681183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.681191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.681201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.681211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.681219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.681224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.681229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.681241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.681246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.681251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.681255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.681261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.681266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.681272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.681276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.681281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.681286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.681291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.681295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.681301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.681305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.681310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.681314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.681319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.681324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.681329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.681333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.681339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.681380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:50.685377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:50.686194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:50.686209Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:50.686211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:50.686214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:50.686224Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 132 [2:7556254549599765059:3108]
2025-10-01T14:06:50.686239Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:50.686254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:50.686257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.686261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.686264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.686280Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:50.686286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:50.686293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:50.686348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.686349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.686351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.686356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:50.686358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:50.686457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:50.686459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.686471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.686483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.686499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:50.686515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254549599765053:3108]
2025-10-01T14:06:50.686517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254549599765053:3108]
2025-10-01T14:06:50.686519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254549599765053:3108]
2025-10-01T14:06:50.686528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:50.686541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:50.686542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:50.686546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:50.686548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:50.686559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:50.686561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:50.686572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624668:2446], now have 1 active actors on pipe
2025-10-01T14:06:50.686575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624777:3319], now have 1 active actors on pipe
2025-10-01T14:06:50.686602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254549599765053:3108]
2025-10-01T14:06:50.686610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:50.686664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:50.688880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 132
2025-10-01T14:06:50.688929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 132
2025-10-01T14:06:50.689049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.689062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.689091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:50.689101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.689106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.689109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:50.689117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.689128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:50.689141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.689344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.689351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.689363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.689449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 133 partition: 0 MaxSeqNo: 45 sessionId: src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0
2025-10-01T14:06:50.689811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcd7a074-6bf4d04b-6e9e2084-9b4906bd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:50.692209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0] Write session: try to update token
2025-10-01T14:06:50.692227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:50.718629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 133 sessionId: src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:50.721112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:50.720776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:50.720792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:50.720795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:50.720797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:50.720807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254549599765053:3108]
2025-10-01T14:06:50.720812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254549599765053:3108]
2025-10-01T14:06:50.720816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254549599765053:3108]
2025-10-01T14:06:50.720883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:50.720890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.720892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:50.721045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:50.721220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:50.721226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:50.721230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:50.751302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254551976624863:3127]
2025-10-01T14:06:50.753574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 132, pipe: [1:7556254551976624863:3127]
2025-10-01T14:06:50.775005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:06:50.775031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-01T14:06:50.887590Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:50.888092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.888102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.888148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624863:3127], now have 1 active actors on pipe
2025-10-01T14:06:50.888657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:50.888675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-10-01T14:06:50.888707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254551976624863:3127]
2025-10-01T14:06:50.888722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:50.888728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:50.888772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 133 reason: error at write: Disconnected sessionId: src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0
2025-10-01T14:06:50.888943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 133 sessionId: src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0 is DEAD
2025-10-01T14:06:50.888642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:50.890627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:50.890642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0] Write session will restart in 0.009251s
2025-10-01T14:06:50.890669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0] Write session: Do CDS request
2025-10-01T14:06:50.890675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:50.902845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.903520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:50.903531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 134
2025-10-01T14:06:50.903703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:50.903729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:50.903734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:50.903739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:50.904434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 134 sessionId:  describe result for acl check
2025-10-01T14:06:50.904464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:50.904466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:50.904468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:50.904472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254551976624963:3324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:50.904900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254551976624963:3324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:50.907851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254551976624963:3324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:50.910643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:50.911223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254551976624963:3324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:50.911239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254551976624963:3324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:50.911242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254551976624963:3324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:50.911251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:50.911817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:50.912028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:50.912036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:50.912048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:50.912103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:50.912155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254549599765259:3112]
2025-10-01T14:06:50.912664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:50.913010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:50.913055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:50.913287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:50.913354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.913359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.913360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.913361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.913362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.913363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.913364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.913365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.913367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.913368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.913369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.913370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.913372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.913373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.913378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.913388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.913393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.913396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.913400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.913404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.913408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.913412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.913416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.913420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.913424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.913429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.913433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.913437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.913445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.913456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:50.913465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.913470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:50.913478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.913484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:50.913491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.913496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:50.913504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.913509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:50.913517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.913523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:50.913531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.913536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:50.913545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.913554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:50.913560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.913568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:50.913572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.913580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.913586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.913594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.913598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.913606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.913611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.913619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:50.913623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.913629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:50.913661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:50.917686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:50.918397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:50.918411Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:50.918414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:50.918418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:50.918425Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 133 [2:7556254549599765259:3112]
2025-10-01T14:06:50.918442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:50.918461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:50.918464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.918468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.918470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.918486Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:50.918496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:50.918502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:50.918559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.918566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.918568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.918572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:50.918575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:50.918646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:50.918654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.918666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:50.918679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:50.918701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:50.918722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254549599765253:3112]
2025-10-01T14:06:50.918728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254549599765253:3112]
2025-10-01T14:06:50.918730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254549599765253:3112]
2025-10-01T14:06:50.918743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:50.918762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:50.918783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:50.918791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:50.918820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254549599765253:3112]
2025-10-01T14:06:50.918828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:50.919054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 133
2025-10-01T14:06:50.918929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:50.918936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:50.918938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:50.918943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:50.918946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976625063:3324], now have 1 active actors on pipe
2025-10-01T14:06:50.919104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976624880:2446], now have 1 active actors on pipe
2025-10-01T14:06:50.919216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 133
2025-10-01T14:06:50.919688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:06:50.919783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:06:50.919966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-10-01T14:06:50.920021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 134 partition: 0 MaxSeqNo: 45 sessionId: src_id|4dbe930a-d88571ee-552923a0-e86400e2_0
2025-10-01T14:06:50.919288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.919303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.919366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dbe930a-d88571ee-552923a0-e86400e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:50.919376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:50.919381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:50.919384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:50.919396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:50.919408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:50.919480Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:06:50.919512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.919670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:50.919675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:50.919698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:50.922625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79b538a-3ddef2eb-20b3bdff-2900ee8d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4dbe930a-d88571ee-552923a0-e86400e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:50.925662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbe930a-d88571ee-552923a0-e86400e2_0] Write session: try to update token
2025-10-01T14:06:50.925682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbe930a-d88571ee-552923a0-e86400e2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:50.949084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:50.949106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:50.949109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:50.949112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:50.949123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254549599765253:3112]
2025-10-01T14:06:50.949128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254549599765253:3112]
2025-10-01T14:06:50.949132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254549599765253:3112]
2025-10-01T14:06:50.949186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:50.949194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:50.949197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:50.949372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:50.949742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:50.949754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:50.949757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:50.956759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 134 sessionId: src_id|4dbe930a-d88571ee-552923a0-e86400e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:50.959564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:50.990479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254551976625085:3127]
2025-10-01T14:06:50.990727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 133, pipe: [1:7556254551976625085:3127]
2025-10-01T14:06:51.107891Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:51.108589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.108607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.108628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254551976625085:3127], now have 1 active actors on pipe
2025-10-01T14:06:51.108941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:51.108941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:51.108959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:51.109385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbe930a-d88571ee-552923a0-e86400e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:51.109395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbe930a-d88571ee-552923a0-e86400e2_0] Write session will restart in 0.006055s
2025-10-01T14:06:51.109026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 134 reason: error at write: Disconnected sessionId: src_id|4dbe930a-d88571ee-552923a0-e86400e2_0
2025-10-01T14:06:51.109185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 134 sessionId: src_id|4dbe930a-d88571ee-552923a0-e86400e2_0 is DEAD
2025-10-01T14:06:51.109419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbe930a-d88571ee-552923a0-e86400e2_0] Write session: Do CDS request
2025-10-01T14:06:51.109322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:51.109339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254551976625085:3127]
2025-10-01T14:06:51.109428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbe930a-d88571ee-552923a0-e86400e2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:51.116870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbe930a-d88571ee-552923a0-e86400e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.116927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:51.116943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 135
2025-10-01T14:06:51.117067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.117104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:51.117113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:51.117118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:51.117548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 135 sessionId:  describe result for acl check
2025-10-01T14:06:51.117586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:51.117592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:51.117594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:51.117599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254556271592408:3329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:51.118138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254556271592408:3329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:51.124354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254556271592408:3329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:51.126161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:51.127379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:51.127592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:51.127602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:51.127612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:51.127660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:51.127701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254553894732746:3115]
2025-10-01T14:06:51.127858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254556271592408:3329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:51.127875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254556271592408:3329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:51.127879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254556271592408:3329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:51.127889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:51.128327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:51.128668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:51.128712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:51.129047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:51.129109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.129115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.129116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.129117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.129118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.129120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.129121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.129122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.129124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.129125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.129126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.129127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.129129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.129130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.129136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.129146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.129150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.129155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.129158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.129162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.129166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.129171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.129174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.129178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.129182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.129185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.129188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.129191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.129199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.129206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.129212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.129218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.129224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.129230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.129234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.129240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.129249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.129254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.129261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.129266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.129275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.129280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.129287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.129292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.129302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.129307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.129312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.129317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.129322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.129327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.129333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.129342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.129346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.129351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.129360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.129366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.129410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:51.135672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:51.136301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:51.136312Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:51.136313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:51.136317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:51.136323Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 134 [2:7556254553894732746:3115]
2025-10-01T14:06:51.136337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:51.136352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:51.136353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.136356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.136357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.136370Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:51.136378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:51.136383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:51.136432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.136438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.136441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.136444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:51.136447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:51.136522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:51.136530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.136541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.136550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.136564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:51.136588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271592392:2446], now have 1 active actors on pipe
2025-10-01T14:06:51.136594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271592578:3329], now have 1 active actors on pipe
2025-10-01T14:06:51.136600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254553894732741:3115]
2025-10-01T14:06:51.136602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254553894732741:3115]
2025-10-01T14:06:51.136605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254553894732741:3115]
2025-10-01T14:06:51.136620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:51.136636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:51.136645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:51.136653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:51.136619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 134
2025-10-01T14:06:51.136655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:51.136656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:51.136669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 134
2025-10-01T14:06:51.136658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:51.136694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254553894732741:3115]
2025-10-01T14:06:51.136703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:51.136710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:51.136733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.136741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.136768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:51.136779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.136786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.136788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:51.136795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.136808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:51.136830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.136995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.137017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.137041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.137137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 135 partition: 0 MaxSeqNo: 45 sessionId: src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0
2025-10-01T14:06:51.137472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dbe930a-d88571ee-552923a0-e86400e2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:51.140409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0] Write session: try to update token
2025-10-01T14:06:51.140426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:51.156324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 135 sessionId: src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:51.158156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:51.158178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:51.158181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:51.158184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:51.158193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254553894732741:3115]
2025-10-01T14:06:51.158197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254553894732741:3115]
2025-10-01T14:06:51.158201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254553894732741:3115]
2025-10-01T14:06:51.158252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:51.158254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:51.158260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:51.158262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.158263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:51.158265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:51.158447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:51.159151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:51.209256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254556271592592:3127]
2025-10-01T14:06:51.209544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 134, pipe: [1:7556254556271592592:3127]
2025-10-01T14:06:51.302172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:51.302884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.302906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.302947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271592592:3127], now have 1 active actors on pipe
2025-10-01T14:06:51.303159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:51.303196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:51.303249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254556271592592:3127]
2025-10-01T14:06:51.303270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:51.303371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 135 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0
2025-10-01T14:06:51.303586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 135 sessionId: src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0 is DEAD
2025-10-01T14:06:51.303727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:51.303740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0] Write session will restart in 0.009291s
2025-10-01T14:06:51.303767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0] Write session: Do CDS request
2025-10-01T14:06:51.303773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:51.313917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.314048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:51.314060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 136
2025-10-01T14:06:51.314185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.314218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:51.314226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:51.314229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:51.314604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 136 sessionId:  describe result for acl check
2025-10-01T14:06:51.314642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:51.314648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:51.314650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:51.314655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254556271592756:3339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:51.315117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254556271592756:3339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:51.316281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:51.316699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254556271592756:3339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:51.317335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:51.317530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:51.317541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:51.317550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:51.317588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:51.317625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254553894732950:3124]
2025-10-01T14:06:51.318100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:51.318333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:51.318389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:51.318687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:51.318739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.318746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.318746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.318747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.318748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.318748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.318749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.318750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.318750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.318751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.318752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.318752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.318753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.318753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.318757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.318801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254556271592756:3339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:51.318811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254556271592756:3339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:51.318812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254556271592756:3339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:51.318762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.318764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.318818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:51.318766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.318768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.318771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.318773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.318775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.318777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.318779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.318781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.318784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.318786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.318788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.318799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.318806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.318813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.318819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.318823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.318829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.318831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.318834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.318837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.318839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.318841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.318844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.318846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.318849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.318852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.318857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.318861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.318864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.318868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.318872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.318876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.318881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.318884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.318889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.318893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.318898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.318902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.318906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.318929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:51.322528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:51.323392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:51.323405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:51.323406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:51.323409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:51.323413Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 135 [2:7556254553894732950:3124]
2025-10-01T14:06:51.323421Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:51.323432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:51.323434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.323435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.323437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.323448Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:51.323451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:51.323455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:51.323492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.323493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.323494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.323496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:51.323498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:51.323543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:51.323550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.323558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.323563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.323572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:51.323590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271592795:3339], now have 1 active actors on pipe
2025-10-01T14:06:51.323592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271592608:2446], now have 1 active actors on pipe
2025-10-01T14:06:51.323597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254553894732944:3124]
2025-10-01T14:06:51.323599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254553894732944:3124]
2025-10-01T14:06:51.323600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254553894732944:3124]
2025-10-01T14:06:51.323608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:51.323616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:51.323619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:51.323622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:51.323624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:51.323681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 135
2025-10-01T14:06:51.323624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:51.323626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:51.323644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254553894732944:3124]
2025-10-01T14:06:51.323646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:51.323648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:51.323683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 135
2025-10-01T14:06:51.323750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.323760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.323779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7161da55-2d3f6527-d8609e99-950eef4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:51.323788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.323791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.323792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:51.323798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.323804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:51.323815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.323948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.323956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.323966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.324041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 136 partition: 0 MaxSeqNo: 45 sessionId: src_id|7161da55-2d3f6527-d8609e99-950eef4d_0
2025-10-01T14:06:51.324368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b94489dc-96d2bb09-10df76c4-fe530c13_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7161da55-2d3f6527-d8609e99-950eef4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:51.327189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7161da55-2d3f6527-d8609e99-950eef4d_0] Write session: try to update token
2025-10-01T14:06:51.327204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7161da55-2d3f6527-d8609e99-950eef4d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:51.335139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:51.335156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:51.335163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254553894732944:3124]
2025-10-01T14:06:51.335198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:51.335204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:51.335347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:51.335478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:51.335599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:51.335723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:51.335915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:51.335948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:51.341015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 136 sessionId: src_id|7161da55-2d3f6527-d8609e99-950eef4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:51.343471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:51.343687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.343719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.343755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:51.343838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:51.354282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:51.354299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:51.354300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:51.354302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:51.354310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254553894732944:3124]
2025-10-01T14:06:51.354313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254553894732944:3124]
2025-10-01T14:06:51.354315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254553894732944:3124]
2025-10-01T14:06:51.354349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:51.354353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.354355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:51.354356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:51.354361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:51.354365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:51.354510Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:51.403328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254556271592814:3127]
2025-10-01T14:06:51.403711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 135, pipe: [1:7556254556271592814:3127]
2025-10-01T14:06:51.500037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:51.509378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.509403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.509629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.509692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.509755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.509812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.509855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.509867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.509930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.509986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.510039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.510095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.510143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.510150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.510216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.510272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.510329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.510400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.510443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.510453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.510517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.510576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.510632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.510690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.510731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.510738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.510796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.510851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.510908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.510965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.511006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.511013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.511072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.511126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.511192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.511249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.511293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.511299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.511358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.511416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.511478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.511536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.511580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.511586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.511644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.511701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.511757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.511812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.511853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.511860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.511923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.511980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.512037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.512094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.512138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.512145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.512202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.512254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.512309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.512366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.512410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.512416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.512472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271592814:3127], now have 1 active actors on pipe
2025-10-01T14:06:51.512674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:51.512709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:51.512713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:51.512744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254556271592814:3127]
2025-10-01T14:06:51.512745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 136 reason: error at write: Disconnected sessionId: src_id|7161da55-2d3f6527-d8609e99-950eef4d_0
2025-10-01T14:06:51.512964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 136 sessionId: src_id|7161da55-2d3f6527-d8609e99-950eef4d_0 is DEAD
2025-10-01T14:06:51.513068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161da55-2d3f6527-d8609e99-950eef4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:51.513077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161da55-2d3f6527-d8609e99-950eef4d_0] Write session will restart in 0.008481s
2025-10-01T14:06:51.513096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161da55-2d3f6527-d8609e99-950eef4d_0] Write session: Do CDS request
2025-10-01T14:06:51.513101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161da55-2d3f6527-d8609e99-950eef4d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:51.513723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:51.522941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7161da55-2d3f6527-d8609e99-950eef4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.523034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:51.523047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 137
2025-10-01T14:06:51.523158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.523195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:51.523203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:51.523206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:51.523664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 137 sessionId:  describe result for acl check
2025-10-01T14:06:51.523705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:51.523711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:51.523713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:51.523717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254556271592904:3345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:51.524327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254556271592904:3345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:51.526299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:51.527112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254556271592904:3345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:51.528552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:51.528760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:51.528768Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:51.528779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:51.528827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:51.528874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254553894733166:3133]
2025-10-01T14:06:51.529326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254556271592904:3345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:51.529339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254556271592904:3345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:51.529342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254556271592904:3345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:51.529350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:51.529423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:51.529885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:51.529927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:51.530233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:51.530282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.530288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.530289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.530290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.530291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.530292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.530293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.530294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.530295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.530296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.530298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.530299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.530300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.530301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.530306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.530314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.530318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.530321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.530325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.530329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.530332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.530336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.530339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.530343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.530346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.530349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.530353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.530356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.530363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.530383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.530389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.530393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.530396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.530406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.530410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.530415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.530423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.530428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.530432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.530436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.530442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.530450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.530455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.530459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.530468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.530472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.530480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.530485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.530489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.530499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.530503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.530511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.530516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.530523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.530527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.530532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.530568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:51.538240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:51.539056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:51.539072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:51.539075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:51.539078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:51.539085Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 136 [2:7556254553894733166:3133]
2025-10-01T14:06:51.539101Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:51.539117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:51.539120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.539124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.539126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.539144Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:51.539153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:51.539159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:51.539230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.539235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.539236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.539238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:51.539239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:51.539292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:51.539298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.539305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.539316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.539339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:51.539364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271593006:3345], now have 1 active actors on pipe
2025-10-01T14:06:51.539369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271592819:2446], now have 1 active actors on pipe
2025-10-01T14:06:51.539377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254553894733161:3133]
2025-10-01T14:06:51.539380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254553894733161:3133]
2025-10-01T14:06:51.539382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254553894733161:3133]
2025-10-01T14:06:51.539400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:51.539411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:51.539414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:51.539414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 136
2025-10-01T14:06:51.539414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:51.539414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 136
2025-10-01T14:06:51.539416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:51.539427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:51.539429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:51.539473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.539482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.539496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254553894733161:3133]
2025-10-01T14:06:51.539507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:51.539516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:51.539538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:51.539549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.539552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.539553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:51.539560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.539571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:51.539590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.539709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.539717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.539732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.539809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 137 partition: 0 MaxSeqNo: 45 sessionId: src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0
2025-10-01T14:06:51.540156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7161da55-2d3f6527-d8609e99-950eef4d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:51.545822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0] Write session: try to update token
2025-10-01T14:06:51.545844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:51.559473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 137 sessionId: src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:51.561667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:51.562190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.562215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.562255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:51.562384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:51.568943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:51.568961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:51.568963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:51.568966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:51.568975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254553894733161:3133]
2025-10-01T14:06:51.568979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254553894733161:3133]
2025-10-01T14:06:51.568983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254553894733161:3133]
2025-10-01T14:06:51.569029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:51.569040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.569042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:51.569045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:51.569057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:51.569061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:51.569170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:51.612705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254556271593018:3127]
2025-10-01T14:06:51.612930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 136, pipe: [1:7556254556271593018:3127]
2025-10-01T14:06:51.708071Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:51.715298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.715331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.715516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.715594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.715679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.715754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.715806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.715817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.715895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.715964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.716035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.716111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.716168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.716177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.716244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.716309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.716375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.716444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.716493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.716501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.716570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.716638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.716705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.716773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.716820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.716829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.716905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.716965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.717029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.717097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.717143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.717151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.717236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.717315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.717389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.717458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.717507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.717517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.717598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.717669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.717747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.717826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.717886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.717895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.717986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.718063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.718140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.718222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.718276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.718284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.718400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.718468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.718530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.718592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.718637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.718640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.718719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.718785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.718842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.718917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.718972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.718980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.719047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271593018:3127], now have 1 active actors on pipe
2025-10-01T14:06:51.719262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:51.719271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254556271593018:3127]
2025-10-01T14:06:51.719274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:51.719301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:51.719311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 137 reason: error at write: Disconnected sessionId: src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0
2025-10-01T14:06:51.719524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 137 sessionId: src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0 is DEAD
2025-10-01T14:06:51.719656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:51.719665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0] Write session will restart in 0.008444s
2025-10-01T14:06:51.719691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0] Write session: Do CDS request
2025-10-01T14:06:51.719708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:51.720068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:51.728922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.728920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:51.728933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 138
2025-10-01T14:06:51.729113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.729146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:51.729155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:51.729159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:51.729525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 138 sessionId:  describe result for acl check
2025-10-01T14:06:51.729551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:51.729557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:51.729560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:51.729565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254556271593148:3349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:51.729961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254556271593148:3349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:51.731354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:51.731914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254556271593148:3349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:51.732141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:51.732357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:51.732365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:51.732374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:51.732411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:51.732437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254553894733358:3135]
2025-10-01T14:06:51.732796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:51.733008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:51.733032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:51.733239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:51.733275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.733279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.733280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.733281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.733281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.733282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.733283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.733283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.733284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.733284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.733285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.733286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.733286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.733287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.733290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.733296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.733298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.733300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.733302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.733304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.733307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.733308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.733311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.733313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.733315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.733317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.733319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.733321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.733325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.733330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.733334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.733338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.733340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.733343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.733346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.733349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.733351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.733354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.733356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.733359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.733361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.733364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.733366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.733369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.733371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.733374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.733376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.733379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.733381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.733384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.733386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.733389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.733391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.733394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.733396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.733399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.733417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:51.734059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254556271593148:3349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:51.734068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254556271593148:3349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:51.734070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254556271593148:3349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:51.734075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:51.737116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:51.737680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:51.737690Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:51.737691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:51.737694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:51.737700Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 137 [2:7556254553894733358:3135]
2025-10-01T14:06:51.737709Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:51.737724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:51.737729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.737730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.737732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.737742Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:51.737745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:51.737749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:51.737783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.737788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.737789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.737792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:51.737793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:51.737836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:51.737840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.737847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.737852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.737860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:51.737875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254553894733353:3135]
2025-10-01T14:06:51.737880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254553894733353:3135]
2025-10-01T14:06:51.737882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254553894733353:3135]
2025-10-01T14:06:51.737889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:51.737897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:51.737902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271593212:3349], now have 1 active actors on pipe
2025-10-01T14:06:51.737905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271593020:2446], now have 1 active actors on pipe
2025-10-01T14:06:51.737906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:51.737907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:51.737912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:51.737924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:51.737926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:51.737925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 137
2025-10-01T14:06:51.737936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 137
2025-10-01T14:06:51.737943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254553894733353:3135]
2025-10-01T14:06:51.737952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:51.737954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:51.737970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.737973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.737995Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:51.738003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.738006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.738011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:51.738016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.738022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:51.738037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.738153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.738159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.738171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.738252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 138 partition: 0 MaxSeqNo: 45 sessionId: src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0
2025-10-01T14:06:51.738681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90cb2423-c4a71bc6-e5e1bca3-844a0a90_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:51.740937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0] Write session: try to update token
2025-10-01T14:06:51.740950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:51.753701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 138 sessionId: src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:51.755810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:51.756046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.756071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.756103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:51.756190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:51.759435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:51.759452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:51.759455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:51.759456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:51.759466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254553894733353:3135]
2025-10-01T14:06:51.759471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254553894733353:3135]
2025-10-01T14:06:51.759474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254553894733353:3135]
2025-10-01T14:06:51.759522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:51.759522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:51.759527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:51.759528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.759531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:51.759531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:51.759662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:51.819541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254556271593233:3127]
2025-10-01T14:06:51.819896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 137, pipe: [1:7556254556271593233:3127]
2025-10-01T14:06:51.902197Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:51.909352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.909376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.909523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.909575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.909629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.909680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.909723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.909730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.909788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.909837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.909887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.909940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.909979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.909984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.910037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.910092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.910144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.910191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.910227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.910236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.910293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.910347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.910417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.910476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.910515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.910521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.910581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.910639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.910697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.910758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.910807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.910810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.910883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.910954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.911013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.911069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.911116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.911123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.911187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.911240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.911303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.911370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.911434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.911441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.911513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.911578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.911635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.911686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.911732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.911739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.911800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.911851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.911902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.911958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.911999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.912005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.912060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:51.912111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:51.912162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:51.912223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:51.912269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:51.912276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:51.912324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271593233:3127], now have 1 active actors on pipe
2025-10-01T14:06:51.912589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254556271593233:3127]
2025-10-01T14:06:51.912596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:51.912598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:51.912621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:51.912623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 138 reason: error at write: Disconnected sessionId: src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0
2025-10-01T14:06:51.912794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 138 sessionId: src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0 is DEAD
2025-10-01T14:06:51.912940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:51.912951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0] Write session will restart in 0.005937s
2025-10-01T14:06:51.912979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0] Write session: Do CDS request
2025-10-01T14:06:51.912985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:51.913132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:51.919929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.920309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:51.920324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 139
2025-10-01T14:06:51.920436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:51.920470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:51.920479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:51.920482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:51.920890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 139 sessionId:  describe result for acl check
2025-10-01T14:06:51.920943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:51.920950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:51.920952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:51.920957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254556271593250:3354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:51.921485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254556271593250:3354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
E1001 14:06:51.923719116  110001 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:28606: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-01T14:06:51.924345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254556271593250:3354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:51.927322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254556271593250:3354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:51.927336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254556271593250:3354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:51.927339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254556271593250:3354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:51.927347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:51.927725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:51.928759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:51.928968Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:51.928976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:51.928986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:51.929033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:51.929072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254553894733564:3138]
2025-10-01T14:06:51.929691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:51.930020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:51.930068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:51.930418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:51.930484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.930489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.930491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.930491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.930493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.930494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.930495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.930496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.930497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.930498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.930500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.930501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.930502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.930503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.930508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.930518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.930522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.930525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.930529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.930532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.930536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.930540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.930544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.930548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.930552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.930555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.930559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.930562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.930569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.930577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:51.930582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.930588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:51.930592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.930598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:51.930602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.930607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:51.930611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.930616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:51.930620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.930627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:51.930632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.930642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:51.930646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.930656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:51.930660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.930665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:51.930669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.930674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.930680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.930684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.930693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.930698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.930707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.930712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:51.930719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.930725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:51.930768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:51.934909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:51.935818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:51.935830Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:51.935832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:51.935835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:51.935842Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 138 [2:7556254553894733564:3138]
2025-10-01T14:06:51.935853Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:51.935867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:51.935870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.935872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.935873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.935887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:51.935891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:51.935895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:51.935936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.935941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.935943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.935946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:51.935948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:51.936005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:51.936011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.936019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:51.936024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:51.936032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:51.936046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254553894733559:3138]
2025-10-01T14:06:51.936047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254553894733559:3138]
2025-10-01T14:06:51.936048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254553894733559:3138]
2025-10-01T14:06:51.936053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:51.936062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:51.936062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:51.936064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:51.936066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:51.936071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:51.936072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:51.936081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271593235:2446], now have 1 active actors on pipe
2025-10-01T14:06:51.936084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254556271593424:3354], now have 1 active actors on pipe
2025-10-01T14:06:51.936108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254553894733559:3138]
2025-10-01T14:06:51.936117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:51.936135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:51.936154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 138
2025-10-01T14:06:51.936168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 138
2025-10-01T14:06:51.936192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.936201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.936229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:51.936238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:51.936241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:51.936243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:51.936251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:51.936260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:51.936274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.936418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:51.936429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:51.936454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:51.936544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 139 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0
2025-10-01T14:06:51.936982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|844fe94b-35aba057-1308e5fe-df61ad1d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:51.940010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0] Write session: try to update token
2025-10-01T14:06:51.940033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:51.957849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 139 sessionId: src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:51.958063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:51.958087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:51.958089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:51.958091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:51.958101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254553894733559:3138]
2025-10-01T14:06:51.958106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254553894733559:3138]
2025-10-01T14:06:51.958110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254553894733559:3138]
2025-10-01T14:06:51.958156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:51.958164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:51.958167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:51.958170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:51.958171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:51.958173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:51.958334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:51.960474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:52.012577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254560566560735:3127]
2025-10-01T14:06:52.012809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 138, pipe: [1:7556254560566560735:3127]
2025-10-01T14:06:52.106922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:52.107276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.107289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.107327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566560735:3127], now have 1 active actors on pipe
2025-10-01T14:06:52.107510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:52.107510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:52.107521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:52.107578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 139 reason: error at write: Disconnected sessionId: src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0
2025-10-01T14:06:52.107580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254560566560735:3127]
2025-10-01T14:06:52.107599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:52.107782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 139 sessionId: src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0 is DEAD
2025-10-01T14:06:52.107956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:52.107981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0] Write session will restart in 0.005188s
2025-10-01T14:06:52.108011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0] Write session: Do CDS request
2025-10-01T14:06:52.108018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:52.114965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:52.115140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:52.115151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 140
2025-10-01T14:06:52.115275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:52.115310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:52.115315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:52.115319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:52.115769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 140 sessionId:  describe result for acl check
2025-10-01T14:06:52.115815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:52.115822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:52.115824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:52.115829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254560566560780:3361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:52.116393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254560566560780:3361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:52.118664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254560566560780:3361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:52.121464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:52.121496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254560566560780:3361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:52.121520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254560566560780:3361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:52.121526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254560566560780:3361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:52.121549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:52.123139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:52.123351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:52.123364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:52.123376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:52.123433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:52.123469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254558189701054:3140]
2025-10-01T14:06:52.124213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:52.124622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:52.124666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:52.124998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:52.125053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.125058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.125059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.125060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.125061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.125062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.125063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.125064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.125065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.125066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.125067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.125068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.125069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.125071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.125076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.125086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.125091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.125095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.125098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.125102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.125106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.125110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.125114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.125118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.125122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.125125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.125129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.125133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.125140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.125148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.125155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.125161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.125165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.125170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.125174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.125180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.125185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.125189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.125194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.125207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.125211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.125216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.125220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.125227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.125231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.125236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.125241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.125246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.125251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.125256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.125260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.125265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.125270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.125275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.125283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.125288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.125328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:52.130514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:52.131213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:52.131231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:52.131235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:52.131240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:52.131248Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 139 [2:7556254558189701054:3140]
2025-10-01T14:06:52.131270Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:52.131294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:52.131304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.131307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.131311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.131327Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:52.131338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:52.131344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:52.131410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.131419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.131421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.131424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:52.131427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:52.131498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:52.131508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.131522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.131534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.131557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:52.131576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566560931:3361], now have 1 active actors on pipe
2025-10-01T14:06:52.131580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566560743:2446], now have 1 active actors on pipe
2025-10-01T14:06:52.131585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254558189701047:3140]
2025-10-01T14:06:52.131587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254558189701047:3140]
2025-10-01T14:06:52.131590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254558189701047:3140]
2025-10-01T14:06:52.131604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:52.131627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:52.131628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:52.131633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:52.131636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:52.131649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:52.131654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:52.131696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254558189701047:3140]
2025-10-01T14:06:52.131680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 139
2025-10-01T14:06:52.131711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:52.131717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:52.131685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 139
2025-10-01T14:06:52.131748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.131760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.131793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dff62973-2dc81306-33be476b-305b541d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:52.131806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.131811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.131813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:52.131824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.131840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:52.131860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:52.132110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.132121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.132138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:52.132228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 140 partition: 0 MaxSeqNo: 45 sessionId: src_id|dff62973-2dc81306-33be476b-305b541d_0
2025-10-01T14:06:52.132661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e71b4e7-91e22d71-28c1ffb2-12b15f2c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dff62973-2dc81306-33be476b-305b541d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:52.135733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff62973-2dc81306-33be476b-305b541d_0] Write session: try to update token
2025-10-01T14:06:52.135755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff62973-2dc81306-33be476b-305b541d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:52.155072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 140 sessionId: src_id|dff62973-2dc81306-33be476b-305b541d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:52.157003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:52.157023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:52.157026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:52.157029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:52.157038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254558189701047:3140]
2025-10-01T14:06:52.157043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254558189701047:3140]
2025-10-01T14:06:52.157046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254558189701047:3140]
2025-10-01T14:06:52.157090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:52.157097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.157098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:52.157100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:52.157105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:52.157111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:52.157257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:52.157553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:52.207609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254560566560949:3127]
2025-10-01T14:06:52.207905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 139, pipe: [1:7556254560566560949:3127]
2025-10-01T14:06:52.320351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:52.320642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.320660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.320705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566560949:3127], now have 1 active actors on pipe
2025-10-01T14:06:52.322488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:52.323548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff62973-2dc81306-33be476b-305b541d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:52.323558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff62973-2dc81306-33be476b-305b541d_0] Write session will restart in 0.007994s
2025-10-01T14:06:52.323588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff62973-2dc81306-33be476b-305b541d_0] Write session: Do CDS request
2025-10-01T14:06:52.323595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff62973-2dc81306-33be476b-305b541d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:52.323005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254560566560949:3127]
2025-10-01T14:06:52.323044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:52.323134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 140 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dff62973-2dc81306-33be476b-305b541d_0
2025-10-01T14:06:52.323415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 140 sessionId: src_id|dff62973-2dc81306-33be476b-305b541d_0 is DEAD
2025-10-01T14:06:52.323630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:52.333106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff62973-2dc81306-33be476b-305b541d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:52.333254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:52.333269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 141
2025-10-01T14:06:52.333400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:52.333437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:52.333447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:52.333450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:52.333813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 141 sessionId:  describe result for acl check
2025-10-01T14:06:52.333847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:52.333848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:52.333852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:52.333858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254560566560974:3371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:52.334396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254560566560974:3371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:52.337174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254560566560974:3371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:52.341268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254560566560974:3371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:52.341285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254560566560974:3371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:52.341287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254560566560974:3371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:52.341296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:52.354104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:52.355093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:52.355363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:52.355376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:52.355389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:52.355446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:52.355481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254558189701266:3149]
2025-10-01T14:06:52.355996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:52.356391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:52.356431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:52.356722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:52.356787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.356793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.356794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.356795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.356796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.356797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.356797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.356798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.356800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.356801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.356801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.356802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.356803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.356804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.356808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.356816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.356819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.356821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.356824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.356827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.356830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.356832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.356848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.356852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.356855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.356858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.356861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.356864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.356871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.356878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.356884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.356889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.356893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.356897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.356900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.356905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.356908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.356912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.356915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.356919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.356922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.356926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.356929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.356933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.356937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.356942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.356944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.356957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.356961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.356964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.356968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.356972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.356975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.356979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.356982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.356985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.357022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:52.362049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:52.364734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 140
2025-10-01T14:06:52.364760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 140
2025-10-01T14:06:52.364010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:52.364022Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:52.364024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:52.364027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:52.364034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 140 [2:7556254558189701266:3149]
2025-10-01T14:06:52.364054Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:52.364069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:52.364072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.364075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.364078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.364091Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:52.364094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:52.364098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:52.364136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.364137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.364140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.364142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:52.364145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:52.364200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:52.364202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.364213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.364222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.364236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:52.364252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254558189701261:3149]
2025-10-01T14:06:52.364254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254558189701261:3149]
2025-10-01T14:06:52.364256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254558189701261:3149]
2025-10-01T14:06:52.364264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:52.364276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:52.364279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:52.364282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:52.364284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:52.364288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:52.364290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:52.364300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566561042:3371], now have 1 active actors on pipe
2025-10-01T14:06:52.364303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566560956:2446], now have 1 active actors on pipe
2025-10-01T14:06:52.364329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254558189701261:3149]
2025-10-01T14:06:52.364338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:52.364472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:52.365128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.365135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.365161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|449aad82-bf3333f5-e826ec15-f2346c65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:52.365169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.365173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.365175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:52.365184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.365194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:52.365210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:52.365603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.365613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.365630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:52.365774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 141 partition: 0 MaxSeqNo: 45 sessionId: src_id|449aad82-bf3333f5-e826ec15-f2346c65_0
2025-10-01T14:06:52.366170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff62973-2dc81306-33be476b-305b541d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|449aad82-bf3333f5-e826ec15-f2346c65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:52.369101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|449aad82-bf3333f5-e826ec15-f2346c65_0] Write session: try to update token
2025-10-01T14:06:52.369119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|449aad82-bf3333f5-e826ec15-f2346c65_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:52.389691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:52.389712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:52.389716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:52.389719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:52.389729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254558189701261:3149]
2025-10-01T14:06:52.389735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254558189701261:3149]
2025-10-01T14:06:52.389739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254558189701261:3149]
2025-10-01T14:06:52.389787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:52.389791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:52.389795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:52.389797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.389799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:52.389800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:52.389963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:52.391636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 141 sessionId: src_id|449aad82-bf3333f5-e826ec15-f2346c65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:52.394323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:52.427942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254560566561175:3127]
2025-10-01T14:06:52.428189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 140, pipe: [1:7556254560566561175:3127]
2025-10-01T14:06:52.545085Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:52.546130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.546142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.546186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566561175:3127], now have 1 active actors on pipe
2025-10-01T14:06:52.547000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:52.547092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 141 reason: status is not ok: tablet will be restarted right now sessionId: src_id|449aad82-bf3333f5-e826ec15-f2346c65_0
2025-10-01T14:06:52.547301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 141 sessionId: src_id|449aad82-bf3333f5-e826ec15-f2346c65_0 is DEAD
2025-10-01T14:06:52.547448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254560566561175:3127]
2025-10-01T14:06:52.547470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:52.546502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:52.554702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449aad82-bf3333f5-e826ec15-f2346c65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:52.554719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449aad82-bf3333f5-e826ec15-f2346c65_0] Write session will restart in 0.006687s
2025-10-01T14:06:52.554752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449aad82-bf3333f5-e826ec15-f2346c65_0] Write session: Do CDS request
2025-10-01T14:06:52.554759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449aad82-bf3333f5-e826ec15-f2346c65_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:52.562926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|449aad82-bf3333f5-e826ec15-f2346c65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:52.563008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:52.563023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 142
2025-10-01T14:06:52.563134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:52.563165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:52.563174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:52.563177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:52.563614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 142 sessionId:  describe result for acl check
2025-10-01T14:06:52.563656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:52.563665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:52.563666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:52.563671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254560566561212:3377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:52.564201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254560566561212:3377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:52.566268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254560566561212:3377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:52.570958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254560566561212:3377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:52.570969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254560566561212:3377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:52.570973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254560566561212:3377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:52.570980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:52.571128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:52.572361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:52.572557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:52.572570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:52.572583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:52.572632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:52.572663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254558189701487:3158]
2025-10-01T14:06:52.573247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:52.573536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:52.573584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:52.573877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:52.573944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.573952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.573953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.573954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.573955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.573956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.573957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.573958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.573959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.573960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.573961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.573962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.573963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.573964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.573970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.573979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.573983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.573986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.573990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.573994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.573997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.574001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.574005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.574009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.574012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.574015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.574019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.574022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.574029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.574036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.574041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.574046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.574051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.574056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.574060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.574065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.574070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.574075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.574079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.574089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.574093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.574098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.574101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.574106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.574110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.574116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.574120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.574129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.574133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.574139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.574147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.574151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.574155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.574163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.574166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.574171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.574203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:52.579032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:52.580150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 141
2025-10-01T14:06:52.580207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 141
2025-10-01T14:06:52.580863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 142 partition: 0 MaxSeqNo: 45 sessionId: src_id|1bdf68be-1856c6-17a028a8-a58a9542_0
2025-10-01T14:06:52.579742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:52.579758Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:52.579761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:52.579764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:52.579771Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 141 [2:7556254558189701487:3158]
2025-10-01T14:06:52.579788Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:52.579804Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:52.579808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.579811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.579813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.579830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:52.579836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:52.579841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:52.579899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.579900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.579903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.579906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:52.579909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:52.580160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:52.580163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.580174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.580185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.580201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:52.580223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566561180:2446], now have 1 active actors on pipe
2025-10-01T14:06:52.580226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566561371:3377], now have 1 active actors on pipe
2025-10-01T14:06:52.580241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254558189701480:3158]
2025-10-01T14:06:52.580242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254558189701480:3158]
2025-10-01T14:06:52.580244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254558189701480:3158]
2025-10-01T14:06:52.580260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:52.580272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:52.580274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:52.580275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:52.580277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:52.580288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:52.580290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:52.580306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.580310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.580357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254558189701480:3158]
2025-10-01T14:06:52.580367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:52.580376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:52.580381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bdf68be-1856c6-17a028a8-a58a9542_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:52.580388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.580393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.580395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:52.580404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.580412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:52.580447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:52.580686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.580703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.580725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:52.581242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|449aad82-bf3333f5-e826ec15-f2346c65_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1bdf68be-1856c6-17a028a8-a58a9542_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:52.584014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bdf68be-1856c6-17a028a8-a58a9542_0] Write session: try to update token
2025-10-01T14:06:52.584034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bdf68be-1856c6-17a028a8-a58a9542_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:52.604266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 142 sessionId: src_id|1bdf68be-1856c6-17a028a8-a58a9542_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:52.606707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:52.606963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.606996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.607041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:52.607162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:52.618697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:52.618716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:52.618718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:52.618720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:52.618729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254558189701480:3158]
2025-10-01T14:06:52.618733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254558189701480:3158]
2025-10-01T14:06:52.618739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254558189701480:3158]
2025-10-01T14:06:52.618784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:52.618793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.618799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:52.618921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:52.619316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:52.619327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:52.619331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:52.646957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254560566561384:3127]
2025-10-01T14:06:52.647214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 141, pipe: [1:7556254560566561384:3127]
2025-10-01T14:06:52.771924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:52.783471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.783497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.783669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.783730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.783794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.783854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.783896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.783905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.783971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.784036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.784091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.784152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.784193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.784200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.784281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.784352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.784412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.784470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.784520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.784526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.784594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.784656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.784717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.784785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.784849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.784858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.784964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.785037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.785106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.785167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.785217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.785224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.785287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.785349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.785423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.785491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.785538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.785545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.785611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.785668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.785733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.785810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.785940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.785951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.786017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.786085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.786151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.786219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.786269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.786280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.786342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.786418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.786481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.786541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.786586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.786593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.786654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:52.786712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:52.786769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:52.786831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:52.786873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:52.786878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:52.786967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566561384:3127], now have 1 active actors on pipe
2025-10-01T14:06:52.787814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:52.787843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:52.787876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 142 reason: error at write: Disconnected sessionId: src_id|1bdf68be-1856c6-17a028a8-a58a9542_0
2025-10-01T14:06:52.788095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 142 sessionId: src_id|1bdf68be-1856c6-17a028a8-a58a9542_0 is DEAD
2025-10-01T14:06:52.788163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:52.788364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:52.788425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254560566561384:3127]
2025-10-01T14:06:52.790668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bdf68be-1856c6-17a028a8-a58a9542_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:52.790682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bdf68be-1856c6-17a028a8-a58a9542_0] Write session will restart in 0.006136s
2025-10-01T14:06:52.790710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bdf68be-1856c6-17a028a8-a58a9542_0] Write session: Do CDS request
2025-10-01T14:06:52.790716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bdf68be-1856c6-17a028a8-a58a9542_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:52.798776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bdf68be-1856c6-17a028a8-a58a9542_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:52.802196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:52.802218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 143
2025-10-01T14:06:52.802870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:52.802931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:52.802940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:52.802945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:52.803442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 143 sessionId:  describe result for acl check
2025-10-01T14:06:52.803494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:52.803586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:52.803590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:52.803596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254560566561552:3382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:52.804211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254560566561552:3382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:52.805853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:52.806062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254560566561552:3382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:52.807268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:52.807527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:52.807538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:52.807550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:52.807620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:52.807668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254558189701696:3161]
2025-10-01T14:06:52.808292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:52.808600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:52.808640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:52.808970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:52.809035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.809045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.809046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.809047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.809048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.809050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.809051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.809052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.809054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.809055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.809056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.809058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.809059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.809060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.809066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.809076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.809081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.809084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.809088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.809092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.809096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.809099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.809103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.809109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.809113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.809117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.809120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.809124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.809131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.809139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:52.809144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.809152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:52.809156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.809161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:52.809172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.809177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:52.809182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.809187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:52.809198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.809204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:52.809213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.809219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:52.809223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.809229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:52.809237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.809242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:52.809246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.809255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.809259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.809268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.809272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.809278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.809286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.809292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:52.809296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.809301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:52.809341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:52.809620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254560566561552:3382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:52.809636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254560566561552:3382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:52.809639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254560566561552:3382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:52.809648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:52.813656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:52.814337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:52.814353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:52.814356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:52.814361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:52.814388Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 142 [2:7556254558189701696:3161]
2025-10-01T14:06:52.814406Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:52.814423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:52.814431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.814435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.814437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.814780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 142
2025-10-01T14:06:52.814812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 142
2025-10-01T14:06:52.814453Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:52.814467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:52.814473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:52.814535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.814538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.814543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.814546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:52.814549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:52.814624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:52.814627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.814641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:52.814653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:52.814671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:52.814690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566561401:2446], now have 1 active actors on pipe
2025-10-01T14:06:52.814694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566561594:3382], now have 1 active actors on pipe
2025-10-01T14:06:52.814701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254558189701691:3161]
2025-10-01T14:06:52.814704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254558189701691:3161]
2025-10-01T14:06:52.814707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254558189701691:3161]
2025-10-01T14:06:52.814721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:52.814732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:52.814733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:52.814735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:52.814737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:52.814748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:52.814752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:52.814786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254558189701691:3161]
2025-10-01T14:06:52.814795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:52.814972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:52.815233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.815242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.815270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b580130e-c33d280d-e569abb1-8413aa36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:52.815281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:52.815286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:52.815293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:52.815303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:52.815318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:52.815337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:52.815784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.815792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.815809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:52.815955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 143 partition: 0 MaxSeqNo: 45 sessionId: src_id|b580130e-c33d280d-e569abb1-8413aa36_0
2025-10-01T14:06:52.819480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bdf68be-1856c6-17a028a8-a58a9542_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b580130e-c33d280d-e569abb1-8413aa36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:52.824855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b580130e-c33d280d-e569abb1-8413aa36_0] Write session: try to update token
2025-10-01T14:06:52.824872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b580130e-c33d280d-e569abb1-8413aa36_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:52.839250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:52.839271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:52.839274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:52.839276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:52.839286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254558189701691:3161]
2025-10-01T14:06:52.839291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254558189701691:3161]
2025-10-01T14:06:52.839295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254558189701691:3161]
2025-10-01T14:06:52.839352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:52.839354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:52.839359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:52.839362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:52.839368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:52.839370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:52.839521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:52.847453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 143 sessionId: src_id|b580130e-c33d280d-e569abb1-8413aa36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:52.853135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:52.888615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254560566561602:3127]
2025-10-01T14:06:52.888932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 142, pipe: [1:7556254560566561602:3127]
2025-10-01T14:06:52.988316Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:52.988658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:52.988674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:52.988699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566561602:3127], now have 1 active actors on pipe
2025-10-01T14:06:52.989013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:52.989023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254560566561602:3127]
2025-10-01T14:06:52.989056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:52.989064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:52.989133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 143 reason: error at write: Disconnected sessionId: src_id|b580130e-c33d280d-e569abb1-8413aa36_0
2025-10-01T14:06:52.989328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 143 sessionId: src_id|b580130e-c33d280d-e569abb1-8413aa36_0 is DEAD
2025-10-01T14:06:52.989479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b580130e-c33d280d-e569abb1-8413aa36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:52.989489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b580130e-c33d280d-e569abb1-8413aa36_0] Write session will restart in 0.009896s
2025-10-01T14:06:52.989508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b580130e-c33d280d-e569abb1-8413aa36_0] Write session: Do CDS request
2025-10-01T14:06:52.989516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b580130e-c33d280d-e569abb1-8413aa36_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:52.989787Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:53.000976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b580130e-c33d280d-e569abb1-8413aa36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.001159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:53.001173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 144
2025-10-01T14:06:53.001283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.001315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:53.001325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:53.001328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:53.001733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 144 sessionId:  describe result for acl check
2025-10-01T14:06:53.001766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:53.001772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:53.001774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:53.001779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254564861529018:3386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:53.002302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254564861529018:3386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:53.004136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:53.004980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254564861529018:3386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:53.005162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:53.005310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:53.005318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:53.005325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:53.005364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:53.005388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254562484669191:3163]
2025-10-01T14:06:53.005865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:53.006155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:53.006201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:53.006514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:53.006580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.006585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.006586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.006587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.006588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.006589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.006590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.006592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.006592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.006593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.006594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.006595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.006596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.006597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.006601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.006611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.006614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.006618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.006621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.006625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.006628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.006631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.006635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.006639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.006642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.006646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.006649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.006652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.006658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.006665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.006673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.006678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.006682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.006687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.006691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.006695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.006700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.006705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.006708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.006713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.006718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.006722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.006726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.006739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.006744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.006749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.006753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.006759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.006767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.006771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.006776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.006780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.006784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.006789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.006793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.006798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.006840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:53.007442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254564861529018:3386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:53.007455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254564861529018:3386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:53.007459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254564861529018:3386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:53.007467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:53.019159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:53.019841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:53.019858Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:53.019861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:53.019865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:53.019874Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 143 [2:7556254562484669191:3163]
2025-10-01T14:06:53.019893Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:53.019914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:53.019925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.019930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.019933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.019952Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:53.019958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:53.019965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:53.020033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.020036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.020038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.020041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:53.020045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:53.020129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:53.020132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.020146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.020157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.020174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:53.020191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254562484669186:3163]
2025-10-01T14:06:53.020195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254562484669186:3163]
2025-10-01T14:06:53.020197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254562484669186:3163]
2025-10-01T14:06:53.020208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:53.020221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:53.020236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:53.020237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:53.020240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:53.020242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:53.020244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:53.020281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254562484669186:3163]
2025-10-01T14:06:53.020291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:53.020301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:53.020304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529098:3386], now have 1 active actors on pipe
2025-10-01T14:06:53.020309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254560566561607:2446], now have 1 active actors on pipe
2025-10-01T14:06:53.020386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 143
2025-10-01T14:06:53.020394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 143
2025-10-01T14:06:53.020656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.020669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.020699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:53.020711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.020716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.020718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:53.020730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.020750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:53.020769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.023539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.023577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.023612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.024447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 144 partition: 0 MaxSeqNo: 45 sessionId: src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0
2025-10-01T14:06:53.024937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b580130e-c33d280d-e569abb1-8413aa36_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:53.027548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0] Write session: try to update token
2025-10-01T14:06:53.027566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:53.033158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:53.033177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:53.033188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254562484669186:3163]
2025-10-01T14:06:53.033236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:53.033240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:53.033438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:53.033600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:53.033764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:53.033940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:53.034203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:53.034249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:53.043631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 144 sessionId: src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:53.046229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:53.046460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.046483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.046525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:53.049774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:53.061274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:53.061294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:53.061298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:53.061300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:53.061310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254562484669186:3163]
2025-10-01T14:06:53.061313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254562484669186:3163]
2025-10-01T14:06:53.061316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254562484669186:3163]
2025-10-01T14:06:53.061365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:53.061374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:53.061376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.061378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:53.061380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:53.061384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:53.061511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:53.089469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254564861529105:3127]
2025-10-01T14:06:53.089736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 143, pipe: [1:7556254564861529105:3127]
2025-10-01T14:06:53.217165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:53.225449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.225482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.225663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.225745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.225826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.225905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.225953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.225964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.226033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.226098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.226167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.226234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.226283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.226292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.226367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.226454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.226531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.226611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.226662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.226670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.226746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.226821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.226894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.226972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.227016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.227023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.227124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.227190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.227255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.227316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.227357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.227364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.227430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.227491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.227554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.227615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.227658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.227665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.227728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.227793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.227861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.227925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.227971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.227979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.228046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.228106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.228170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.229741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:53.229753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:53.229779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 144 reason: error at write: Disconnected sessionId: src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0
2025-10-01T14:06:53.230114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:53.230126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0] Write session will restart in 0.006957s
2025-10-01T14:06:53.230154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0] Write session: Do CDS request
2025-10-01T14:06:53.230162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:53.229976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 144 sessionId: src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0 is DEAD
2025-10-01T14:06:53.230147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:53.230179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254564861529105:3127]
2025-10-01T14:06:53.228237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.228290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.228293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.228356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.228410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.228467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.228537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.228578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.228581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.228647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.228701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.228759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.228822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.228876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.228879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.228950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529105:3127], now have 1 active actors on pipe
2025-10-01T14:06:53.230185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:53.237921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.238060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:53.238074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 145
2025-10-01T14:06:53.238216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.238261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:53.238272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:53.238275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:53.238868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 145 sessionId:  describe result for acl check
2025-10-01T14:06:53.238906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:53.238912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:53.238914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:53.238919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254564861529143:3391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:53.239504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254564861529143:3391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:53.242223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254564861529143:3391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:53.244244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:53.244472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254564861529143:3391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:53.244484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254564861529143:3391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:53.244488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254564861529143:3391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:53.244496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:53.245352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:53.245557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:53.245565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:53.245576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:53.245622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:53.245658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254562484669393:3166]
2025-10-01T14:06:53.246216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:53.246546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:53.246598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:53.246893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:53.246949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.246955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.246956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.246956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.246958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.246959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.246960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.246961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.246962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.246963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.246964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.246965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.246966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.246967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.246972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.246980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.246984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.246988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.246991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.246995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.246998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.247001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.247004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.247010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.247013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.247016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.247018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.247021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.247028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.247035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.247041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.247050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.247054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.247058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.247062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.247066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.247070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.247080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.247083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.247088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.247095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.247100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.247108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.247112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.247116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.247134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.247141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.247146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.247150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.247157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.247160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.247166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.247173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.247178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.247182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.247187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.247228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:53.251399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:53.252152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:53.252166Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:53.252168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:53.252171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:53.252180Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 144 [2:7556254562484669393:3166]
2025-10-01T14:06:53.252193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:53.252208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:53.252215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.252219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.252220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.252236Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:53.252245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:53.252251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:53.252304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.252310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.252312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.252314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:53.252317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:53.252378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:53.252384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.252395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.252408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.252425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:53.252446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529116:2446], now have 1 active actors on pipe
2025-10-01T14:06:53.252453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529309:3391], now have 1 active actors on pipe
2025-10-01T14:06:53.252460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254562484669387:3166]
2025-10-01T14:06:53.252466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254562484669387:3166]
2025-10-01T14:06:53.252468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254562484669387:3166]
2025-10-01T14:06:53.252482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:53.252495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:53.252499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:53.252503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:53.252505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:53.252512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:53.252514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:53.252495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 144
2025-10-01T14:06:53.252542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254562484669387:3166]
2025-10-01T14:06:53.252535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 144
2025-10-01T14:06:53.252549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:53.252558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:53.252576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.252584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.252616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:53.252626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.252630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.252636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:53.252644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.252656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:53.252676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.252813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.252823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.252847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.252912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 145 partition: 0 MaxSeqNo: 45 sessionId: src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0
2025-10-01T14:06:53.253180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1848ba28-79cf2e0e-59999bd6-eb1f4a5a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:53.255616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0] Write session: try to update token
2025-10-01T14:06:53.255634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:53.278261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 145 sessionId: src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:53.280942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:53.281244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.281268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.281301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:53.281517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:53.290020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:53.290039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:53.290041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:53.290042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:53.290051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254562484669387:3166]
2025-10-01T14:06:53.290055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254562484669387:3166]
2025-10-01T14:06:53.290059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254562484669387:3166]
2025-10-01T14:06:53.290108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:53.290114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.290115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:53.290238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:53.290453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:53.290463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:53.290469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:53.330485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254564861529322:3127]
2025-10-01T14:06:53.333136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 144, pipe: [1:7556254564861529322:3127]
2025-10-01T14:06:53.445454Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:53.454133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.454162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.454334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.454414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.454492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.454557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.455136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.455148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.455216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.455274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.455340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.455403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.455448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.455455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.455511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.455563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.455619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.455675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.455714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.455720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.455777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.455835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.455891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.455951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.455992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.455999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.456056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.456112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.456165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.456222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.456262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.456269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.456336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.456402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.456460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.456523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.456572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.456578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.456644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.456700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.456760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.456825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.456891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.456898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.456979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.457052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.457109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.457164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.457215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.457221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.457286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.457344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.457406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.457467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.457512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.457519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.457586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.457643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.457704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.457775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.457831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.457837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.457901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529322:3127], now have 1 active actors on pipe
2025-10-01T14:06:53.458193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:53.458222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:53.458258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 145 reason: error at write: Disconnected sessionId: src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0
2025-10-01T14:06:53.458313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:53.458610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:53.458622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0] Write session will restart in 0.009722s
2025-10-01T14:06:53.458648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0] Write session: Do CDS request
2025-10-01T14:06:53.458655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:53.458449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 145 sessionId: src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0 is DEAD
2025-10-01T14:06:53.458659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:53.458714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254564861529322:3127]
2025-10-01T14:06:53.469925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.470011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:53.470025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 146
2025-10-01T14:06:53.470167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.470205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:53.470210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:53.470214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:53.470803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 146 sessionId:  describe result for acl check
2025-10-01T14:06:53.470842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:53.470844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:53.470847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:53.470852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254564861529381:3402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:53.471396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254564861529381:3402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:53.478518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254564861529381:3402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:53.484814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254564861529381:3402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:53.484856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254564861529381:3402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:53.484862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254564861529381:3402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:53.484876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:53.494245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:53.496619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:53.496881Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:53.496896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:53.496908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:53.496974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:53.497027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254562484669633:3180]
2025-10-01T14:06:53.497696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:53.498062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:53.498123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:53.498493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:53.498583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.498592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.498593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.498595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.498596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.498598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.498599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.498600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.498602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.498603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.498605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.498606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.498607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.498608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.498615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.498627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.498631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.498636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.498641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.498646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.498650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.498655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.498660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.498665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.498669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.498673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.498677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.498682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.498690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.498699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.498706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.498713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.498719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.498725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.498731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.498738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.498743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.498749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.498755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.498761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.498769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.498775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.498780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.498786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.498792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.498799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.498804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.498810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.498815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.498831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.498836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.498841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.498847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.498853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.498858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.498864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.498910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:53.503752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:53.505378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 145
2025-10-01T14:06:53.505433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 145
2025-10-01T14:06:53.504892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:53.504911Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:53.504914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:53.504919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:53.504927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 145 [2:7556254562484669633:3180]
2025-10-01T14:06:53.504944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:53.504963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:53.504967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.504971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.504973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.504992Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:53.504998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:53.505004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:53.505070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.505072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.505074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.505078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:53.505080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:53.505154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:53.505157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.505170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.505179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.505192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:53.505210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254562484669626:3180]
2025-10-01T14:06:53.505212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254562484669626:3180]
2025-10-01T14:06:53.505214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254562484669626:3180]
2025-10-01T14:06:53.505222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:53.505230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:53.505233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:53.505235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:53.505235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:53.505249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:53.505252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:53.505261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529350:2446], now have 1 active actors on pipe
2025-10-01T14:06:53.505264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529542:3402], now have 1 active actors on pipe
2025-10-01T14:06:53.505299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254562484669626:3180]
2025-10-01T14:06:53.505308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:53.505379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:53.505665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.505675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.505713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67ee1cd-fbbffced-2699aba4-a520009c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:53.505722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.505727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.505729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:53.505739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.505749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:53.505768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.505976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.505984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.506000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.506114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 146 partition: 0 MaxSeqNo: 45 sessionId: src_id|67ee1cd-fbbffced-2699aba4-a520009c_0
2025-10-01T14:06:53.506586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7538b424-a5279b02-9e82fa1c-bfd4288b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67ee1cd-fbbffced-2699aba4-a520009c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:53.509512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ee1cd-fbbffced-2699aba4-a520009c_0] Write session: try to update token
2025-10-01T14:06:53.509532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ee1cd-fbbffced-2699aba4-a520009c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:53.533867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 146 sessionId: src_id|67ee1cd-fbbffced-2699aba4-a520009c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:53.537545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.537583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.537646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:53.537127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:53.537949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:53.540003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:53.540023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:53.540026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:53.540029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:53.540039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254562484669626:3180]
2025-10-01T14:06:53.540045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254562484669626:3180]
2025-10-01T14:06:53.540050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254562484669626:3180]
2025-10-01T14:06:53.540104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:53.540112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.540115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:53.540269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:53.542343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:53.542355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:53.542360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:53.558816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254564861529556:3127]
2025-10-01T14:06:53.566835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 145, pipe: [1:7556254564861529556:3127]
2025-10-01T14:06:53.707933Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:53.708522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529556:3127], now have 1 active actors on pipe
2025-10-01T14:06:53.717031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.717063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.717242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.717305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.717372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.717436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.717482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.717491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.717560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.717621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.717685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.717749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.717802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.717810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.717873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.717935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.717997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.718055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.718102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.718105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.718164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.718223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.718282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.718340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.718456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.718467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.718526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.718586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.718647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.718709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.718759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.718767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.718840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.718906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.718976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.719043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.719094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.719097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.719168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.719226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.719288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.719352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.719405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.719408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.719487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.719550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.719614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.719671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.719715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.719718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.719783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.719841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.719899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.719956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.719999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.720002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.720068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:53.720125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:53.720185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:53.720259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:53.720314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:53.720317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:53.721732Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:53.722153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ee1cd-fbbffced-2699aba4-a520009c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:53.722169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ee1cd-fbbffced-2699aba4-a520009c_0] Write session will restart in 0.008431s
2025-10-01T14:06:53.722193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ee1cd-fbbffced-2699aba4-a520009c_0] Write session: Do CDS request
2025-10-01T14:06:53.722200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ee1cd-fbbffced-2699aba4-a520009c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:53.721775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:53.721791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:53.721791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:53.721821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 146 reason: error at write: Disconnected sessionId: src_id|67ee1cd-fbbffced-2699aba4-a520009c_0
2025-10-01T14:06:53.721846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254564861529556:3127]
2025-10-01T14:06:53.722000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 146 sessionId: src_id|67ee1cd-fbbffced-2699aba4-a520009c_0 is DEAD
2025-10-01T14:06:53.734837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ee1cd-fbbffced-2699aba4-a520009c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.735392Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:53.735410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 147
2025-10-01T14:06:53.735594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.735641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:53.735652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:53.735658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:53.736089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 147 sessionId:  describe result for acl check
2025-10-01T14:06:53.736131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:53.736141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:53.736143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:53.736149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254564861529657:3407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:53.736724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254564861529657:3407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:53.750173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:53.751594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:53.751829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:53.751834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:53.751846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:53.751909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:53.751943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254562484669833:3183]
2025-10-01T14:06:53.751826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254564861529657:3407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:53.752568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:53.752812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:53.752854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:53.753090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:53.753126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.753127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.753128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.753129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.753129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.753130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.753131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.753132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.753132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.753133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.753134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.753134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.753135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.753135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.753139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.753145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.753148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.753150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.753153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.753155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.753157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.753160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.753162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.753164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.753166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.753168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.753170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.753172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.753177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.753182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.753186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.753189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.753192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.753195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.753198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.753201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.753204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.753207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.753209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.753212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.753215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.753218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.753220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.753223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.753226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.753229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.753232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.753234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.753237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.753240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.753243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.753246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.753249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.753252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.753255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.753257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.753280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:53.759971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254564861529657:3407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:53.759988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254564861529657:3407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:53.759991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254564861529657:3407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:53.760000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:53.760990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:53.761859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:53.761878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:53.761882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:53.761886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:53.761894Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 146 [2:7556254562484669833:3183]
2025-10-01T14:06:53.761914Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:53.761938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:53.761947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.761952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.761954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.761971Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:53.761982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:53.761990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:53.762061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.762069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.762072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.762075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:53.762078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:53.762148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:53.762157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.762169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.762180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.762202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:53.762225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254562484669828:3183]
2025-10-01T14:06:53.762234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254562484669828:3183]
2025-10-01T14:06:53.762236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254562484669828:3183]
2025-10-01T14:06:53.762253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:53.762274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:53.762275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529559:2446], now have 1 active actors on pipe
2025-10-01T14:06:53.762281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529759:3407], now have 1 active actors on pipe
2025-10-01T14:06:53.762284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:53.762286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:53.762288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:53.762300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:53.762304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:53.762347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254562484669828:3183]
2025-10-01T14:06:53.762362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:53.762431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 146
2025-10-01T14:06:53.762475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 146
2025-10-01T14:06:53.762651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:53.762686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.762699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.762726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:53.762739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.762744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.762753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:53.762763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.762779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:53.762799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.763344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.763357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.763373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.763481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 147 partition: 0 MaxSeqNo: 45 sessionId: src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0
2025-10-01T14:06:53.766692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ee1cd-fbbffced-2699aba4-a520009c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:53.769568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0] Write session: try to update token
2025-10-01T14:06:53.769589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:53.791667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:53.791689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:53.791692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:53.791694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:53.791705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254562484669828:3183]
2025-10-01T14:06:53.791710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254562484669828:3183]
2025-10-01T14:06:53.791714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254562484669828:3183]
2025-10-01T14:06:53.791782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:53.791789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.791791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:53.791970Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:53.792350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:53.792356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:53.792361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:53.796590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 147 sessionId: src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:53.799626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:53.822006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254564861529780:3127]
2025-10-01T14:06:53.822298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 146, pipe: [1:7556254564861529780:3127]
2025-10-01T14:06:53.950339Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:53.951513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.951531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.951571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529780:3127], now have 1 active actors on pipe
2025-10-01T14:06:53.952032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:53.952151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:53.952203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254564861529780:3127]
2025-10-01T14:06:53.952223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:53.952225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:53.952297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 147 reason: error at write: Disconnected sessionId: src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0
2025-10-01T14:06:53.952468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 147 sessionId: src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0 is DEAD
2025-10-01T14:06:53.952627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:53.952640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0] Write session will restart in 0.008806s
2025-10-01T14:06:53.952670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0] Write session: Do CDS request
2025-10-01T14:06:53.952690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:53.964313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.964648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:53.964665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 148
2025-10-01T14:06:53.965511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:53.965564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:53.965576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:53.965581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:53.966093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 148 sessionId:  describe result for acl check
2025-10-01T14:06:53.966127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:53.966129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:53.966131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:53.966138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254564861529843:3412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:53.966666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254564861529843:3412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:53.970160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254564861529843:3412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:53.974291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254564861529843:3412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:53.974314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254564861529843:3412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:53.974318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254564861529843:3412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:53.974328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:53.976034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:53.977081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:53.977332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:53.977344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:53.977356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:53.977414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:53.977454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254562484670048:3186]
2025-10-01T14:06:53.978211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:53.978500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:53.978555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:53.978888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:53.978982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.978983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.978985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.978986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.978988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.978990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.978991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.978992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.978993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.978994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.978996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.978997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.978998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.978999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.979005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.979016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.979020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.979025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.979029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.979034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.979038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.979041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.979045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.979050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.979053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.979057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.979060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.979063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.979073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.979081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:53.979088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.979095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:53.979101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.979107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:53.979112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.979120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:53.979126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.979133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:53.979138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.979145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:53.979150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.979156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:53.979161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.979167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:53.979173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.979179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:53.979184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.979190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.979197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.979204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.979209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.979215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.979221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.979227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:53.979232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.979238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:53.979290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:53.984637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:53.985499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:53.985504Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:53.985507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:53.985511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:53.985516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 147 [2:7556254562484670048:3186]
2025-10-01T14:06:53.985528Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:53.985543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:53.985545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.985548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.985549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.985562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:53.985568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:53.985575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:53.985625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.985627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.985629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.985632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:53.985634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:53.985692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:53.985694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:53.985702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:53.985708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:53.985717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:53.985731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254562484670043:3186]
2025-10-01T14:06:53.985733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254562484670043:3186]
2025-10-01T14:06:53.985734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254562484670043:3186]
2025-10-01T14:06:53.985748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:53.985758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:53.985767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:53.985769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:53.985798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254562484670043:3186]
2025-10-01T14:06:53.985801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:53.985903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529786:2446], now have 1 active actors on pipe
2025-10-01T14:06:53.985908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254564861529977:3412], now have 1 active actors on pipe
2025-10-01T14:06:53.985926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:53.985929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:53.985931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:53.985935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:53.986137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 147
2025-10-01T14:06:53.986184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 147
2025-10-01T14:06:53.986273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.986284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.986306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:53.986315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:53.986319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:53.986321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:53.986330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:53.986342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:53.986357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.986886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:53.986893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:53.986910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:53.987029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 148 partition: 0 MaxSeqNo: 45 sessionId: src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0
2025-10-01T14:06:53.987671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe5d75-840f184c-a439b712-4b2b3e6a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:53.990151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0] Write session: try to update token
2025-10-01T14:06:53.990170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:54.008577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:54.008598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:54.008602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:54.008605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:54.008616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254562484670043:3186]
2025-10-01T14:06:54.008622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254562484670043:3186]
2025-10-01T14:06:54.008627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254562484670043:3186]
2025-10-01T14:06:54.008683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:54.008685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:54.008692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:54.008696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:54.008697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.008700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:54.008883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:54.009998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 148 sessionId: src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:54.013495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:54.052709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254569156497288:3127]
2025-10-01T14:06:54.053266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 147, pipe: [1:7556254569156497288:3127]
2025-10-01T14:06:54.161926Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:54.162229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.162239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.162283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497288:3127], now have 1 active actors on pipe
2025-10-01T14:06:54.162981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254569156497288:3127]
2025-10-01T14:06:54.163014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:54.163050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:54.163053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:54.163118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 148 reason: error at write: Disconnected sessionId: src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0
2025-10-01T14:06:54.163283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 148 sessionId: src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0 is DEAD
2025-10-01T14:06:54.163764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:54.163772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0] Write session will restart in 0.008344s
2025-10-01T14:06:54.163795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0] Write session: Do CDS request
2025-10-01T14:06:54.163805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:54.163357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:54.172972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:54.173843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:54.173861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 149
2025-10-01T14:06:54.174063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:54.174094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:54.174099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:54.174103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:54.174617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 149 sessionId:  describe result for acl check
2025-10-01T14:06:54.174651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:54.174654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:54.174656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:54.174661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254569156497307:3417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:54.175216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254569156497307:3417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:54.178764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254569156497307:3417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:54.191130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254569156497307:3417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:54.191147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254569156497307:3417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:54.191151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254569156497307:3417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:54.191159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:54.220390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:54.228204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:54.228465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:54.228469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:54.228482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:54.228541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:54.228603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254566779637551:3189]
2025-10-01T14:06:54.229309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:54.229984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:54.230045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:54.230439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:54.230525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.230536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.230537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.230539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.230540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.230542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.230543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.230544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.230546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.230547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.230548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.230550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.230551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.230553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.230559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.230570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.230574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.230579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.230582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.230587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.230591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.230595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.230598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.230603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.230607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.230610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.230614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.230618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.230625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.230634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.230641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.230647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.230655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.230660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.230665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.230671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.230676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.230682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.230687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.230692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.230697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.230703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.230708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.230713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.230718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.230724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.230729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.230734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.230739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.230745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.230751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.230756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.230762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.230767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.230772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.230777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.230819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:54.236558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:54.237297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:54.237304Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:54.237307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:54.237312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:54.237319Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 148 [2:7556254566779637551:3189]
2025-10-01T14:06:54.237340Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:54.237361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:54.237365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.237369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.237371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.237388Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:54.237394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:54.237401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:54.237465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.237467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.237469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.237473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:54.237476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:54.237551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:54.237554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.237565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.237579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.237597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:54.237614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254566779637545:3189]
2025-10-01T14:06:54.237616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254566779637545:3189]
2025-10-01T14:06:54.237619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254566779637545:3189]
2025-10-01T14:06:54.237633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:54.237648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:54.237663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:54.237666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:54.237702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254566779637545:3189]
2025-10-01T14:06:54.237705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:54.238315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 148
2025-10-01T14:06:54.238356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 148
2025-10-01T14:06:54.237938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:54.237947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:54.237950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:54.237957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:54.238678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497296:2446], now have 1 active actors on pipe
2025-10-01T14:06:54.238685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497385:3417], now have 1 active actors on pipe
2025-10-01T14:06:54.238701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.238705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.238727Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:54.238733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.238736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.238738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:54.238746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.238760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:54.238775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:54.239047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.239057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.239078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:54.239197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 149 partition: 0 MaxSeqNo: 45 sessionId: src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0
2025-10-01T14:06:54.240438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95496e78-9b11fd8-2c8f5e61-fc15ff1b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:54.243393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0] Write session: try to update token
2025-10-01T14:06:54.243413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:54.263356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254569156497507:3127]
2025-10-01T14:06:54.263869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:54.263893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:54.263895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:54.263898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:54.263910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254566779637545:3189]
2025-10-01T14:06:54.263915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254566779637545:3189]
2025-10-01T14:06:54.263920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254566779637545:3189]
2025-10-01T14:06:54.263978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:54.263993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.264000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:54.264186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:54.266498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:54.266518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:54.266524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:54.270790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 148, pipe: [1:7556254569156497507:3127]
2025-10-01T14:06:54.273576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 149 sessionId: src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:54.276428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:54.411651Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:54.411986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497507:3127], now have 1 active actors on pipe
2025-10-01T14:06:54.412021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.412034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.412768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:54.413336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:54.413344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254569156497507:3127]
2025-10-01T14:06:54.413370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:54.413443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 149 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0
2025-10-01T14:06:54.413621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 149 sessionId: src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0 is DEAD
2025-10-01T14:06:54.413879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:54.413890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0] Write session will restart in 0.009160s
2025-10-01T14:06:54.413915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0] Write session: Do CDS request
2025-10-01T14:06:54.413921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:54.427098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:54.427663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:54.427680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 150
2025-10-01T14:06:54.427841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:54.427887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:54.427898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:54.427903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:54.428325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 150 sessionId:  describe result for acl check
2025-10-01T14:06:54.428357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:54.428359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:54.428361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:54.428367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254569156497602:3427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:54.428870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254569156497602:3427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:54.433898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254569156497602:3427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:54.441769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254569156497602:3427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:54.441789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254569156497602:3427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:54.441792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254569156497602:3427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:54.441801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:54.444979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:54.446866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:54.447208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:54.447229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:54.447261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:54.447405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:54.447467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254566779637767:3191]
2025-10-01T14:06:54.448097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:54.448443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:54.448487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:54.448732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:54.448779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.448784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.448784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.448785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.448786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.448787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.448788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.448788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.448789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.448790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.448791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.448792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.448792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.448793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.448797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.448803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.448805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.448807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.448810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.448812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.448814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.448817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.448819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.448821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.448823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.448825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.448828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.448830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.448845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.448852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.448858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.448864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.448869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.448872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.448875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.448878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.448881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.448891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.448897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.448902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.448910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.448919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.448926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.448930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.448939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.448948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.448955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.448960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.448965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.448974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.448980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.448983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.448986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.448994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.448996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.449002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.449023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:54.453498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:54.454350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:54.454363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:54.454366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:54.454392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:54.454399Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 149 [2:7556254566779637767:3191]
2025-10-01T14:06:54.454419Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:54.454440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:54.454446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.454450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.454453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.454469Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:54.454481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:54.454488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:54.454548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.454556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.454558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.454560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:54.454562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:54.454759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:54.454772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.454784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.454794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.454807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:54.454829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497722:3427], now have 1 active actors on pipe
2025-10-01T14:06:54.454838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497512:2446], now have 1 active actors on pipe
2025-10-01T14:06:54.454846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254566779637761:3191]
2025-10-01T14:06:54.454848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254566779637761:3191]
2025-10-01T14:06:54.454850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254566779637761:3191]
2025-10-01T14:06:54.454871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:54.454891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:54.454902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:54.454909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:54.454912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:54.454916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:54.454919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:54.454923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 149
2025-10-01T14:06:54.454949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254566779637761:3191]
2025-10-01T14:06:54.454970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 149
2025-10-01T14:06:54.454959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:54.454962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:54.454993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.455003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.455045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:54.455059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.455064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.455066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:54.455075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.455089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:54.455116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:54.455256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.455275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.455303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:54.455400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 150 partition: 0 MaxSeqNo: 45 sessionId: src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0
2025-10-01T14:06:54.455769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d27fe7-9e8e7ea2-7041c738-4c53f83b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:54.458326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0] Write session: try to update token
2025-10-01T14:06:54.458342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:54.475140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 150 sessionId: src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:54.477400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:54.477673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.477701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.477741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:54.477852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:54.481062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:54.481078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:54.481081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:54.481084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:54.481093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254566779637761:3191]
2025-10-01T14:06:54.481098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254566779637761:3191]
2025-10-01T14:06:54.481102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254566779637761:3191]
2025-10-01T14:06:54.481160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:54.481167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:54.481176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.481179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:54.481181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:54.481186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:54.481325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:54.513707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254569156497745:3127]
2025-10-01T14:06:54.514032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 149, pipe: [1:7556254569156497745:3127]
2025-10-01T14:06:54.621326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:54.631039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.631063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.631232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.631298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.631369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.631442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.631495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.631502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.631577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.631638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.631702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.631768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.631820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.631826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.631891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.631959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.632022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.632089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.632141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.632149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.632213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.632271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.632330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.632388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.632438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.632445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.632506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.632563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.632622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.632681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.632731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.632741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.632803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.632870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.632935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.632999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.633048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.633054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.633123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.633187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.633254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.633317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.633366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.633373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.633439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.633495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.633560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.633626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.633681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.633686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.633754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.633816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.633913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.633989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.634040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.634047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.634117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.634177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.634249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.634310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.634357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.634362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.634439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497745:3127], now have 1 active actors on pipe
2025-10-01T14:06:54.634755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254569156497745:3127]
2025-10-01T14:06:54.634766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:54.634771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:54.634791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:54.634800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 150 reason: error at write: Disconnected sessionId: src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0
2025-10-01T14:06:54.634998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 150 sessionId: src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0 is DEAD
2025-10-01T14:06:54.635242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:54.635249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0] Write session will restart in 0.006349s
2025-10-01T14:06:54.635268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0] Write session: Do CDS request
2025-10-01T14:06:54.635272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:54.636965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:54.643187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:54.643306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:54.643325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 151
2025-10-01T14:06:54.643479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:54.643517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:54.643529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:54.643536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:54.643886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 151 sessionId:  describe result for acl check
2025-10-01T14:06:54.643924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:54.643930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:54.643931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:54.643935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254569156497765:3433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:54.644327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254569156497765:3433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:54.647893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254569156497765:3433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:54.651467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:54.651806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254569156497765:3433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:54.651820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254569156497765:3433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:54.651824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254569156497765:3433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:54.651830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:54.652707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:54.652887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:54.652896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:54.652904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:54.652957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:54.653000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254566779637999:3206]
2025-10-01T14:06:54.653503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:54.653911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:54.653975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:54.654346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:54.654435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.654442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.654443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.654444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.654446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.654447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.654448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.654449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.654450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.654451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.654452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.654454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.654455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.654456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.654462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.654473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.654478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.654482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.654485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.654489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.654493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.654496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.654500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.654506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.654509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.654513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.654517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.654521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.654529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.654537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.654543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.654549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.654555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.654561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.654566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.654571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.654576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.654580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.654584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.654599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.654604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.654615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.654620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.654630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.654635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.654645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.654649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.654654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.654663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.654668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.654678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.654683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.654692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.654698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.654702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.654708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.654746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:54.658912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:54.659647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:54.659663Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:54.659666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:54.659671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:54.659678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 150 [2:7556254566779637999:3206]
2025-10-01T14:06:54.659699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:54.659715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:54.659717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.659720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.659721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.659734Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:54.659744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:54.659749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:54.659810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.659819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.659821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.659825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:54.659828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:54.659904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:54.659912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.659924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.659939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.659960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:54.659982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254566779637992:3206]
2025-10-01T14:06:54.659988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254566779637992:3206]
2025-10-01T14:06:54.659990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254566779637992:3206]
2025-10-01T14:06:54.660002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:54.660017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497950:3433], now have 1 active actors on pipe
2025-10-01T14:06:54.660016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:54.660019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:54.660022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:54.660025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497750:2446], now have 1 active actors on pipe
2025-10-01T14:06:54.660033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:54.660045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:54.660048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:54.660083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254566779637992:3206]
2025-10-01T14:06:54.660099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:54.660115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:54.660083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 150
2025-10-01T14:06:54.660132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.660095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 150
2025-10-01T14:06:54.660136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.660165Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:54.660176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.660180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.660183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:54.660192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.660201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:54.660215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:54.660374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.660396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.660419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:54.660651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 151 partition: 0 MaxSeqNo: 45 sessionId: src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0
2025-10-01T14:06:54.661051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|beead4f-4dee991e-abf7b3f3-3f2213b1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:54.664278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0] Write session: try to update token
2025-10-01T14:06:54.664297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:54.672155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:54.672174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:54.672184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254566779637992:3206]
2025-10-01T14:06:54.672231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:54.672237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:54.672433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:54.672578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:54.672729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:54.672887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:54.673104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:54.673147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:54.684280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 151 sessionId: src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:54.686988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:54.687207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.687231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.687269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:54.687375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:54.694717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:54.694733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:54.694735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:54.694736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:54.694745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254566779637992:3206]
2025-10-01T14:06:54.694749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254566779637992:3206]
2025-10-01T14:06:54.694752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254566779637992:3206]
2025-10-01T14:06:54.694799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:54.694809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.694814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:54.694834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:54.694855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:54.694859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:54.694942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:54.734907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254569156497961:3127]
2025-10-01T14:06:54.735201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 150, pipe: [1:7556254569156497961:3127]
2025-10-01T14:06:54.842684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:54.852237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.852266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.852454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.852525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.852594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.852660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.852712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.852724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.852802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.852884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.852947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.853016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.853073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.853081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.853165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.853243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.853316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.853392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.853445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.853452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.853534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.853605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.853674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.853749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.853805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.853813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.853890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.853957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.854026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.854097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.854154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.854161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.854238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.854306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.854429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.854501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.854555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.854562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.854641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.856794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:54.856807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0] Write session will restart in 0.005502s
2025-10-01T14:06:54.856848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0] Write session: Do CDS request
2025-10-01T14:06:54.856855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:54.856349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:54.856364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:54.856400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 151 reason: error at write: Disconnected sessionId: src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0
2025-10-01T14:06:54.856609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 151 sessionId: src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0 is DEAD
2025-10-01T14:06:54.856666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254569156497961:3127]
2025-10-01T14:06:54.856684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:54.854709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.854782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.854851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.854896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.854899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.854975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.855033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.855099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.855164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.855210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.855213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.855290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.855353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.855424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.855486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.855535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.855538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.855610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:54.855671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:54.855737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:54.855901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:54.856003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:54.856006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:54.856071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497961:3127], now have 1 active actors on pipe
2025-10-01T14:06:54.857432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:54.863782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:54.866588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:54.866605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 152
2025-10-01T14:06:54.869331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:54.869386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:54.869398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:54.869403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:54.869878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 152 sessionId:  describe result for acl check
2025-10-01T14:06:54.869917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:54.869919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:54.869927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:54.869932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254569156498009:3438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:54.870451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254569156498009:3438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:54.876161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254569156498009:3438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:54.880438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:54.881768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:54.881935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:54.881938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:54.881947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:54.882001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:54.882028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254566779638216:3209]
2025-10-01T14:06:54.882620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:54.883016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:54.883066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:54.883514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:54.883583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.883584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.883585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.883586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.883588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.883589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.883590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.883591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.883593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.883594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.883595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.883596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.883597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.883598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.883602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.883609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.883611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.883614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.883616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.883618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.883620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.883623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.883625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.883628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.883630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.883632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.883634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.883636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.883642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.883647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:54.883651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.883654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:54.883657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.883660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:54.883663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.883666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:54.883671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.883674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:54.883677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.883680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:54.883683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.883686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:54.883690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.883693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:54.883696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.883700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:54.883702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.883705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.883708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.883711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.883714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.883719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.883723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.883728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:54.883732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.883737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:54.883766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:54.889725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:54.890423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:54.890440Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:54.890444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:54.890448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:54.890456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 151 [2:7556254566779638216:3209]
2025-10-01T14:06:54.890473Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:54.890496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:54.890499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.890503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.890506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.890522Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:54.890527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:54.890535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:54.890603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.890612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.890615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.890618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:54.890621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:54.890689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:54.890697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.890710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:54.890725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:54.890745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:54.890767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254566779638211:3209]
2025-10-01T14:06:54.890774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254566779638211:3209]
2025-10-01T14:06:54.890776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254566779638211:3209]
2025-10-01T14:06:54.890786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:54.890796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:54.890800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:54.890804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:54.890805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:54.890823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:54.890842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:54.890856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156497976:2446], now have 1 active actors on pipe
2025-10-01T14:06:54.890893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254566779638211:3209]
2025-10-01T14:06:54.890906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:54.891049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:54.890856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254569156498009:3438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:54.890877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254569156498009:3438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:54.890881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254569156498009:3438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:54.890891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:54.891079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 151
2025-10-01T14:06:54.891599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 151
2025-10-01T14:06:54.898423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156498180:3438], now have 1 active actors on pipe
2025-10-01T14:06:54.898469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.898479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.898513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:54.898530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:54.898536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:54.898539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:54.898554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:54.898572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:54.898593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:54.900248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:54.900265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:54.900293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:54.900459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 152 partition: 0 MaxSeqNo: 45 sessionId: src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0
2025-10-01T14:06:54.900900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|707da0b5-c9c81336-ba8789c5-6004cd36_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:54.903646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0] Write session: try to update token
2025-10-01T14:06:54.903668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:54.920308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:54.920332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:54.920337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:54.920340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:54.920351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254566779638211:3209]
2025-10-01T14:06:54.920357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254566779638211:3209]
2025-10-01T14:06:54.920361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254566779638211:3209]
2025-10-01T14:06:54.920423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:54.920438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:54.920446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:54.920644Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:54.922461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:54.922487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:54.922491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:54.929536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 152 sessionId: src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:54.932520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:54.956580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254569156498189:3127]
2025-10-01T14:06:54.956950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 151, pipe: [1:7556254569156498189:3127]
2025-10-01T14:06:55.068802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:55.069065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.069079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.069100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254569156498189:3127], now have 1 active actors on pipe
2025-10-01T14:06:55.069226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:55.069294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:55.069337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:55.069340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:55.069345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254569156498189:3127]
2025-10-01T14:06:55.069397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 152 reason: error at write: Disconnected sessionId: src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0
2025-10-01T14:06:55.069596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 152 sessionId: src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0 is DEAD
2025-10-01T14:06:55.069712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:55.069720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0] Write session will restart in 0.006249s
2025-10-01T14:06:55.069749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0] Write session: Do CDS request
2025-10-01T14:06:55.069755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:55.076862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:55.077251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:55.077273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 153
2025-10-01T14:06:55.077424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:55.077461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:55.077466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:55.077472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:55.078058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 153 sessionId:  describe result for acl check
2025-10-01T14:06:55.078113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:55.078252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:55.078263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:55.078269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254573451465516:3442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:55.078973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254573451465516:3442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:55.082197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254573451465516:3442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:55.084255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:55.084952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254573451465516:3442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:55.084968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254573451465516:3442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:55.084972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254573451465516:3442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:55.084981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:55.085676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:55.085879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:55.085896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:55.085908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:55.085961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:55.086000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254571074605721:3211]
2025-10-01T14:06:55.086745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:55.087034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:55.087077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:55.087377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:55.087434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.087443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.087444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.087446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.087447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.087448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.087449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.087450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.087451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.087452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.087454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.087455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.087456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.087457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.087463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.087473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.087477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.087481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.087485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.087489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.087493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.087497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.087501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.087505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.087508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.087512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.087516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.087520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.087527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.087535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.087542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.087548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.087552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.087557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.087562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.087568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.087572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.087577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.087582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.087587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.087592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.087597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.087602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.087607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.087611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.087616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.087621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.087626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.087631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.087636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.087642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.087647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.087652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.087657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.087661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.087666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.087705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:55.091832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:55.092528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:55.092547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:55.092550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:55.092554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:55.092561Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 152 [2:7556254571074605721:3211]
2025-10-01T14:06:55.092578Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:55.092595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:55.092598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.092602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.092605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.092623Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:55.092637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:55.092645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:55.092703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.092713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.092715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.092719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:55.092722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:55.092795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:55.092805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.092816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.092826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.092861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:55.092889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451465489:2446], now have 1 active actors on pipe
2025-10-01T14:06:55.092901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451465692:3442], now have 1 active actors on pipe
2025-10-01T14:06:55.092909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254571074605714:3211]
2025-10-01T14:06:55.092912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254571074605714:3211]
2025-10-01T14:06:55.092913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254571074605714:3211]
2025-10-01T14:06:55.092930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:55.092945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 152
2025-10-01T14:06:55.092945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:55.092960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:55.092963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:55.092967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:55.092971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:55.092974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:55.092990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 152
2025-10-01T14:06:55.093006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254571074605714:3211]
2025-10-01T14:06:55.093016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:55.093040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:55.093051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.093057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.093083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:55.093090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.093094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.093097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:55.093107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.093123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:55.093138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:55.093293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.093307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.093325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:55.093465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 153 partition: 0 MaxSeqNo: 45 sessionId: src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0
2025-10-01T14:06:55.093856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62c9b499-aabb9c88-b2b85b83-3f4f3393_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:55.096242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0] Write session: try to update token
2025-10-01T14:06:55.096261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:55.113543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 153 sessionId: src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:55.116186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:55.117169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.117196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.117215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:55.117219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:55.117222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:55.117224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:55.117233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254571074605714:3211]
2025-10-01T14:06:55.117239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254571074605714:3211]
2025-10-01T14:06:55.117242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254571074605714:3211]
2025-10-01T14:06:55.117286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:55.117293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:55.117300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:55.117302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:55.117313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.117316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:55.117471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:55.169599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254573451465714:3127]
2025-10-01T14:06:55.169981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 152, pipe: [1:7556254573451465714:3127]
2025-10-01T14:06:55.267513Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:55.268217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:55.268287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451465714:3127], now have 1 active actors on pipe
2025-10-01T14:06:55.268429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:55.269596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:55.269651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254573451465714:3127]
2025-10-01T14:06:55.284430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:55.284445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:55.284475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 153 reason: error at write: Disconnected sessionId: src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0
2025-10-01T14:06:55.284638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 153 sessionId: src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0 is DEAD
2025-10-01T14:06:55.286685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:55.286701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0] Write session will restart in 0.006862s
2025-10-01T14:06:55.286729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0] Write session: Do CDS request
2025-10-01T14:06:55.286739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:55.295011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:55.298786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:55.298803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 154
2025-10-01T14:06:55.299404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:55.299445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:55.299457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:55.299460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:55.299896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 154 sessionId:  describe result for acl check
2025-10-01T14:06:55.299923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:55.299931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:55.299933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:55.299938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254573451465887:3447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:55.300422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254573451465887:3447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:55.301883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:55.303250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:55.303505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:55.303523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:55.303535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:55.303596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:55.303645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254571074605930:3214]
2025-10-01T14:06:55.303077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254573451465887:3447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:55.304325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:55.304680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:55.304749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:55.305134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:55.305235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.305243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.305245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.305246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.305248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.305249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.305251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.305252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.305254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.305255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.305257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.305258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.305259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.305261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.305269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.305281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.305285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.305290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.305294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.305299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.305303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.305307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.305311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.305316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.305320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.305324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.305328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.305332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.305344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.305354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.305361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.305369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.305374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.305379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.305384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.305390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.305397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.305414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.305422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.305429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.305436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.305442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.305448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.305454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.305460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.305466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.305472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.305478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.305484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.305491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.305496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.305503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.305509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.305515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.305522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.305528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.305576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:55.306396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254573451465887:3447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:55.306412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254573451465887:3447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:55.306418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254573451465887:3447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:55.306426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:55.311362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 153
2025-10-01T14:06:55.311364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 153
2025-10-01T14:06:55.310228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:55.310936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:55.310943Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:55.310947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:55.310951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:55.310961Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 153 [2:7556254571074605930:3214]
2025-10-01T14:06:55.310977Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:55.310996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:55.310999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.311003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.311005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.311023Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:55.311029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:55.311036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:55.311102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.311106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.311108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.311111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:55.311114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:55.311327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:55.311330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.311343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.311356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.311374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:55.311394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451465928:3447], now have 1 active actors on pipe
2025-10-01T14:06:55.311398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451465721:2446], now have 1 active actors on pipe
2025-10-01T14:06:55.311405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254571074605925:3214]
2025-10-01T14:06:55.311408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254571074605925:3214]
2025-10-01T14:06:55.311410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254571074605925:3214]
2025-10-01T14:06:55.311423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:55.311436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:55.311443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:55.311447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:55.311450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:55.311451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:55.311455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:55.311474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.311478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.311527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254571074605925:3214]
2025-10-01T14:06:55.311539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:55.311549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:55.311556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c70991-a4b0a2da-9389e883-60a5baf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:55.311564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.311568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.311570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:55.311580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.311589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:55.311630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:55.311804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.311808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.311825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:55.311927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 154 partition: 0 MaxSeqNo: 45 sessionId: src_id|c70991-a4b0a2da-9389e883-60a5baf_0
2025-10-01T14:06:55.312336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0109c8-240a9b4d-1a75e707-2ca5c4bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c70991-a4b0a2da-9389e883-60a5baf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:55.315958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70991-a4b0a2da-9389e883-60a5baf_0] Write session: try to update token
2025-10-01T14:06:55.315982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70991-a4b0a2da-9389e883-60a5baf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:55.332505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:55.332520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:55.332530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254571074605925:3214]
2025-10-01T14:06:55.332575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:55.332751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:55.332929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:55.333080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:55.333213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:55.333413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:55.333449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:55.333611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:55.344348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:55.344366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:55.344368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:55.344369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:55.344378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254571074605925:3214]
2025-10-01T14:06:55.344382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254571074605925:3214]
2025-10-01T14:06:55.344385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254571074605925:3214]
2025-10-01T14:06:55.344433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:55.344438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.344439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:55.344470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:55.344482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:55.344487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:55.344583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:55.361887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 154 sessionId: src_id|c70991-a4b0a2da-9389e883-60a5baf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:55.364531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:55.370436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254573451465935:3127]
2025-10-01T14:06:55.374510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 153, pipe: [1:7556254573451465935:3127]
2025-10-01T14:06:55.525583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254573451465935:3127]
2025-10-01T14:06:55.525610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:55.525613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:55.525672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 154 reason: error at write: Disconnected sessionId: src_id|c70991-a4b0a2da-9389e883-60a5baf_0
2025-10-01T14:06:55.525738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:55.525868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 154 sessionId: src_id|c70991-a4b0a2da-9389e883-60a5baf_0 is DEAD
2025-10-01T14:06:55.525106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:55.525411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.525420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.525442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451465935:3127], now have 1 active actors on pipe
2025-10-01T14:06:55.526034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:55.526674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70991-a4b0a2da-9389e883-60a5baf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:55.526712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70991-a4b0a2da-9389e883-60a5baf_0] Write session will restart in 0.006851s
2025-10-01T14:06:55.526753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70991-a4b0a2da-9389e883-60a5baf_0] Write session: Do CDS request
2025-10-01T14:06:55.526761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70991-a4b0a2da-9389e883-60a5baf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:55.534959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70991-a4b0a2da-9389e883-60a5baf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:55.538711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:55.538727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 155
2025-10-01T14:06:55.545003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:55.545062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:55.545072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:55.545077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:55.545436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 155 sessionId:  describe result for acl check
2025-10-01T14:06:55.545467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:55.545470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:55.545471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:55.545477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254573451465980:3459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:55.546144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254573451465980:3459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:55.548642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254573451465980:3459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:55.555167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254573451465980:3459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:55.555186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254573451465980:3459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:55.555192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254573451465980:3459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:55.555203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:55.560576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:55.561827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:55.562096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:55.562104Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:55.562113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:55.562155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:55.562194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254571074606179:3229]
2025-10-01T14:06:55.562825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:55.564218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:55.564282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:55.564793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:55.564896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.564904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.564905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.564906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.564907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.564908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.564910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.564911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.564912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.564914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.564915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.564916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.564917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.564918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.564925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.564935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.564939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.564942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.564946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.564950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.564954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.564957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.564961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.564965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.564968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.564971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.564974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.564977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.564985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.564993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.565001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.565006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.565012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.565017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.565022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.565027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.565033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.565037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.565040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.565044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.565049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.565053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.565058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.565063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.565067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.565071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.565075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.565079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.565083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.565088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.565092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.565106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.565111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.565115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.565120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.565127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.565166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:55.571449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:55.572417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:55.572433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:55.572436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:55.572440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:55.572447Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 154 [2:7556254571074606179:3229]
2025-10-01T14:06:55.572466Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:55.572483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:55.572492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.572496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.572499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.572519Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:55.572529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:55.572535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:55.572594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.572601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.572603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.572606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:55.572609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:55.572683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:55.572692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.572704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.572722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.572744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:55.572767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451465964:2446], now have 1 active actors on pipe
2025-10-01T14:06:55.572776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451466067:3459], now have 1 active actors on pipe
2025-10-01T14:06:55.572785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254571074606174:3229]
2025-10-01T14:06:55.572792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254571074606174:3229]
2025-10-01T14:06:55.572794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254571074606174:3229]
2025-10-01T14:06:55.572808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:55.572826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:55.572805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 154
2025-10-01T14:06:55.572846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:55.572853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:55.572856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:55.572858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:55.572861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:55.572869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 154
2025-10-01T14:06:55.572902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254571074606174:3229]
2025-10-01T14:06:55.572914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:55.572931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:55.573012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.573021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.573046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:55.573052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.573060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.573063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:55.573072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.573084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:55.573102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:55.573314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.573327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.573361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:55.573455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 155 partition: 0 MaxSeqNo: 45 sessionId: src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0
2025-10-01T14:06:55.573880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70991-a4b0a2da-9389e883-60a5baf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:55.576877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0] Write session: try to update token
2025-10-01T14:06:55.576898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:55.604464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:55.604487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:55.604490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:55.604492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:55.604503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254571074606174:3229]
2025-10-01T14:06:55.604508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254571074606174:3229]
2025-10-01T14:06:55.604512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254571074606174:3229]
2025-10-01T14:06:55.604565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:55.604577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.604576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:55.604580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:55.604583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:55.604588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:55.604738Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:55.610499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 155 sessionId: src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:55.613092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:55.625791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254573451466179:3127]
2025-10-01T14:06:55.626083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 154, pipe: [1:7556254573451466179:3127]
2025-10-01T14:06:55.766540Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:55.766815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.766832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.766880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451466179:3127], now have 1 active actors on pipe
2025-10-01T14:06:55.767090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:55.767218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:55.767225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:55.767308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 155 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0
2025-10-01T14:06:55.767548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 155 sessionId: src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0 is DEAD
2025-10-01T14:06:55.767794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:55.767804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0] Write session will restart in 0.007500s
2025-10-01T14:06:55.767828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0] Write session: Do CDS request
2025-10-01T14:06:55.767834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:55.767896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254573451466179:3127]
2025-10-01T14:06:55.776926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:55.778896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:55.778911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 156
2025-10-01T14:06:55.779081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:55.779113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:55.779123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:55.779127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:55.780148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 156 sessionId:  describe result for acl check
2025-10-01T14:06:55.780194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:55.780200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:55.780201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:55.780206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254573451466298:3463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:55.781092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254573451466298:3463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:55.787256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:55.787791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254573451466298:3463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:55.788540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:55.788749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:55.788758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:55.788770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:55.788825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:55.788876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254571074606399:3231]
2025-10-01T14:06:55.789490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:55.789810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:55.789857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:55.790158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:55.790222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.790229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.790230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.790232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.790233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.790234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.790235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.790236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.790247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.790248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.790249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.790250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.790251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.790252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.790258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.790267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.790271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.790274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.790278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.790282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.790285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.790289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.790293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.790297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.790300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.790304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.790308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.790311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.790318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.790331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:55.790340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.790345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:55.790353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.790358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:55.790363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.790389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:55.790396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.790401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:55.790405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.790414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:55.790418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.790423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:55.790431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.790436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:55.790439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.790444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:55.790450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.790454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.790463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.790468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.790472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.790480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.790484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.790494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:55.790498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.790502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:55.790542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:55.791243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254573451466298:3463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:55.791257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254573451466298:3463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:55.791260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254573451466298:3463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:55.791270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:55.794644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:55.795281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:55.795295Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:55.795297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:55.795301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:55.795308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 155 [2:7556254571074606399:3231]
2025-10-01T14:06:55.795325Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:55.795342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:55.795346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.795350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.795354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.795372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:55.795386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:55.795392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:55.795455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.795463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.795465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.795469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:55.795472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:55.795541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:55.795549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.795562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:55.795579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:55.795597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:55.795616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451466181:2446], now have 1 active actors on pipe
2025-10-01T14:06:55.795619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451466404:3463], now have 1 active actors on pipe
2025-10-01T14:06:55.795626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254571074606394:3231]
2025-10-01T14:06:55.795629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254571074606394:3231]
2025-10-01T14:06:55.795631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254571074606394:3231]
2025-10-01T14:06:55.795645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:55.795657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:55.795659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:55.795660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:55.795662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:55.795674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:55.795677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:55.795713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254571074606394:3231]
2025-10-01T14:06:55.795720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:55.795726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:55.800033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 155
2025-10-01T14:06:55.800091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 155
2025-10-01T14:06:55.800470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.800490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.800526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:55.800550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:55.800561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:55.800568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:55.800582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:55.800601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:55.800629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:55.801333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.801345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.801374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:55.801490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 156 partition: 0 MaxSeqNo: 45 sessionId: src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0
2025-10-01T14:06:55.801976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6e2d2e2-7d702fa6-2cc09529-343e68e8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:55.804995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0] Write session: try to update token
2025-10-01T14:06:55.805017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:55.838601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:55.838619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:55.838622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:55.838625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:55.838636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254571074606394:3231]
2025-10-01T14:06:55.838643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254571074606394:3231]
2025-10-01T14:06:55.838647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254571074606394:3231]
2025-10-01T14:06:55.838693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:55.838699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:55.838700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:55.838703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:55.838708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:55.838710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:55.838861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:55.846896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 156 sessionId: src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:55.849426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:55.867942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254573451466411:3127]
2025-10-01T14:06:55.868265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 155, pipe: [1:7556254573451466411:3127]
2025-10-01T14:06:55.997364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:55.997905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:55.997915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:55.997960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451466411:3127], now have 1 active actors on pipe
2025-10-01T14:06:55.998315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254573451466411:3127]
2025-10-01T14:06:55.998344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:55.998386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:55.998390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:55.998444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 156 reason: error at write: Disconnected sessionId: src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0
2025-10-01T14:06:55.998294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:55.998644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 156 sessionId: src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0 is DEAD
2025-10-01T14:06:56.000242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:56.000255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0] Write session will restart in 0.008688s
2025-10-01T14:06:56.000293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0] Write session: Do CDS request
2025-10-01T14:06:56.000299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:56.010107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.010216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:56.010234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 157
2025-10-01T14:06:56.010441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.010478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:56.010489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:56.010495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:56.010942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 157 sessionId:  describe result for acl check
2025-10-01T14:06:56.010985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:56.010991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:56.010992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:56.010997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254577746433727:3468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:56.011484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254577746433727:3468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:56.014802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254577746433727:3468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:56.019226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254577746433727:3468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:56.019246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254577746433727:3468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:56.019249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254577746433727:3468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:56.019259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:56.024612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:56.025500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:56.025703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:56.025714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:56.025726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:56.025790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:56.025830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254575369573907:3234]
2025-10-01T14:06:56.026358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:56.026654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:56.026695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:56.027007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:56.027058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.027063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.027064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.027065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.027066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.027067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.027068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.027069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.027070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.027072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.027073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.027074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.027075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.027076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.027081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.027091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.027094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.027098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.027102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.027105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.027109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.027112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.027116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.027120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.027124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.027127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.027131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.027134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.027141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.027149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.027155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.027160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.027164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.027169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.027177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.027181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.027188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.027196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.027200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.027205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.027210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.027213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.027215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.027218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.027222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.027227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.027232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.027236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.027241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.027245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.027253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.027257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.027267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.027272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.027279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.027284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.027322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:56.031311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:56.032112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:56.032126Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:56.032128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:56.032132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:56.032138Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 156 [2:7556254575369573907:3234]
2025-10-01T14:06:56.032153Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:56.032172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:56.032179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.032182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.032185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.032202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:56.032211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:56.032217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:56.032278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.032284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.032286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.032288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:56.032291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:56.032354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:56.032362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.032376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.032386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.032400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:56.032419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254573451466416:2446], now have 1 active actors on pipe
2025-10-01T14:06:56.032426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746433869:3468], now have 1 active actors on pipe
2025-10-01T14:06:56.032433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254575369573901:3234]
2025-10-01T14:06:56.032436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254575369573901:3234]
2025-10-01T14:06:56.032439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254575369573901:3234]
2025-10-01T14:06:56.032453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:56.032466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:56.032473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:56.032477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:56.032479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:56.032484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:56.032486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:56.032521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254575369573901:3234]
2025-10-01T14:06:56.032529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:56.032531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:56.032516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 156
2025-10-01T14:06:56.032561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 156
2025-10-01T14:06:56.032669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.032679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.032703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:56.032715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.032719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.032721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:56.032740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.032753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:56.032771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.032925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.032932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.032944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.033044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 157 partition: 0 MaxSeqNo: 45 sessionId: src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0
2025-10-01T14:06:56.033461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15f8f84d-8661d33e-6c08b5c0-e668febc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:56.036028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0] Write session: try to update token
2025-10-01T14:06:56.036047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:56.045612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:06:56.045632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:56.045644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254575369573901:3234]
2025-10-01T14:06:56.045693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:06:56.045697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:06:56.046005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:06:56.046215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:56.046456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:56.046685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:06:56.046935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:06:56.046983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:06:56.059756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 157 sessionId: src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:56.062244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:56.062466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.062491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.062632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:56.062531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:56.071791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:56.071814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:56.071816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:56.071818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:56.071829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254575369573901:3234]
2025-10-01T14:06:56.071833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254575369573901:3234]
2025-10-01T14:06:56.071837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254575369573901:3234]
2025-10-01T14:06:56.071889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:56.071901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.071904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:56.072034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:56.074546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:56.074560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:56.074564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:56.098335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254577746433927:3127]
2025-10-01T14:06:56.098610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 156, pipe: [1:7556254577746433927:3127]
2025-10-01T14:06:56.230560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:56.237993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.238020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.238157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.238209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.238266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.238319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.241639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254577746433927:3127]
2025-10-01T14:06:56.241647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:56.241676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:56.241681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:56.241709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 157 reason: error at write: Disconnected sessionId: src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0
2025-10-01T14:06:56.241904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 157 sessionId: src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0 is DEAD
2025-10-01T14:06:56.238661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.238676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.238752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.238812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.238874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.239072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.239114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.239117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.239182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.239235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.239290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.239347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.239386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.239389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.239471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.239532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.239588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.239645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.239747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.239751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.239810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.239862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.239909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.239956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.239996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.239998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.240063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.240122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.240174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.240223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.240258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.240260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.240321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.240370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.240423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.240478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.240535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.240538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.240619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.240685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.240736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.240785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.240823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.240825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.240900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.240947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.240995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.241044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.241084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.241085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.241149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:56.241196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:56.241247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:56.241308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:56.241353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:56.241355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:56.241415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746433927:3127], now have 1 active actors on pipe
2025-10-01T14:06:56.241815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:56.242601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:56.242611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0] Write session will restart in 0.005213s
2025-10-01T14:06:56.242639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0] Write session: Do CDS request
2025-10-01T14:06:56.242646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:56.248952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.249087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:56.249101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 158
2025-10-01T14:06:56.249230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.249259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:56.249269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:56.249273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:56.249678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 158 sessionId:  describe result for acl check
2025-10-01T14:06:56.249712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:56.249717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:56.249719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:56.249724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254577746433956:3473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:56.250250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254577746433956:3473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:56.254692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254577746433956:3473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:56.257524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:56.257783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254577746433956:3473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:56.257795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254577746433956:3473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:56.257798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254577746433956:3473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:56.257809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:56.258753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:56.258957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:56.258968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:56.258980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:56.259030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:56.259079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254575369574121:3237]
2025-10-01T14:06:56.259696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:56.260037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:56.260090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:56.260405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:56.260469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.260475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.260477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.260477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.260479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.260480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.260481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.260482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.260482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.260484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.260485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.260486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.260487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.260488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.260494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.260503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.260506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.260510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.260513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.260516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.260520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.260523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.260526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.260530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.260533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.260536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.260539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.260542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.260551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.260558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.260564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.260571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.260574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.260579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.260583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.260588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.260592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.260596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.260600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.260604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.260608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.260612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.260615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.260619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.260623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.260627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.260630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.260634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.260638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.260641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.260645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.260649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.260652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.260656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.260659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.260664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.260698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:56.264792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:56.265799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:56.265814Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:56.265816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:56.265820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:56.265827Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 157 [2:7556254575369574121:3237]
2025-10-01T14:06:56.265845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:56.265863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:56.265871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.265874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.265876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.265892Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:56.265898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:56.265905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:56.265972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.265979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.265981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.265984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:56.265986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:56.266055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:56.266062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.266074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.266086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.266104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:56.266125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746433941:2446], now have 1 active actors on pipe
2025-10-01T14:06:56.266132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434149:3473], now have 1 active actors on pipe
2025-10-01T14:06:56.266140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254575369574115:3237]
2025-10-01T14:06:56.266142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254575369574115:3237]
2025-10-01T14:06:56.266143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254575369574115:3237]
2025-10-01T14:06:56.266156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:56.266168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:56.266181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:56.266184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:56.266169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 157
2025-10-01T14:06:56.266185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:56.266181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 157
2025-10-01T14:06:56.266187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:56.266187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:56.266223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254575369574115:3237]
2025-10-01T14:06:56.266229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:56.266234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:56.266249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.266257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.266309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:56.266319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.266324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.266327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:56.266335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.266348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:56.266385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.266561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.266569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.266585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.266689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 158 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0
2025-10-01T14:06:56.267086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db64e2a6-bbcaff4e-3c74122e-31d0ed8d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:56.269451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0] Write session: try to update token
2025-10-01T14:06:56.269471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:56.293120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:56.293138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:56.293140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:56.293142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:56.293152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254575369574115:3237]
2025-10-01T14:06:56.293157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254575369574115:3237]
2025-10-01T14:06:56.293161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254575369574115:3237]
2025-10-01T14:06:56.293217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:56.293227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.293230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:56.293380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:56.294738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:56.294755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:56.294758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:56.300865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 158 sessionId: src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:56.304042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:56.342044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254577746434161:3127]
2025-10-01T14:06:56.343726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 157, pipe: [1:7556254577746434161:3127]
2025-10-01T14:06:56.449336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:56.449805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.449822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.449845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434161:3127], now have 1 active actors on pipe
2025-10-01T14:06:56.450047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:56.450577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:56.450603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0] Write session will restart in 0.009329s
2025-10-01T14:06:56.450627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0] Write session: Do CDS request
2025-10-01T14:06:56.450634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:56.450095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254577746434161:3127]
2025-10-01T14:06:56.450113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:56.450125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:56.450202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 158 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0
2025-10-01T14:06:56.450416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 158 sessionId: src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0 is DEAD
2025-10-01T14:06:56.460960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.461100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:56.461118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 159
2025-10-01T14:06:56.461302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.461337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:56.461343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:56.461348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:56.461857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 159 sessionId:  describe result for acl check
2025-10-01T14:06:56.461905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:56.461911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:56.461912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:56.461918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254577746434222:3477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:56.462443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254577746434222:3477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:56.465260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254577746434222:3477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:56.468046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254577746434222:3477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:56.468059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254577746434222:3477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:56.468063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254577746434222:3477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:56.468071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:56.468064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:56.469215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:56.469438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:56.469450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:56.469462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:56.469509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:56.469543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254575369574333:3239]
2025-10-01T14:06:56.470103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:56.470346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:56.470400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:56.470732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:56.470784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.470789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.470790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.470791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.470792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.470793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.470794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.470795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.470796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.470797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.470798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.470799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.470799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.470800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.470805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.470815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.470821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.470826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.470829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.470834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.470837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.470842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.470846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.470852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.470856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.470860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.470864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.470869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.470874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.470887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.470897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.470904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.470912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.470918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.470924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.470930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.470941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.470952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.470961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.470967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.470976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.470981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.470990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.470995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.471001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.471007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.471015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.471021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.471029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.471035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.471043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.471048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.471056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.471062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.471068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.471074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.471123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:56.474981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:56.475700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:56.475713Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:56.475716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:56.475719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:56.475727Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 158 [2:7556254575369574333:3239]
2025-10-01T14:06:56.475741Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:56.475757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:56.475760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.475764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.475765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.475781Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:56.475786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:56.475794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:56.475855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.475862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.475864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.475867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:56.475869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:56.475938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:56.475947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.475958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.475966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.475978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:56.475996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434163:2446], now have 1 active actors on pipe
2025-10-01T14:06:56.476003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434383:3477], now have 1 active actors on pipe
2025-10-01T14:06:56.476010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254575369574327:3239]
2025-10-01T14:06:56.476016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254575369574327:3239]
2025-10-01T14:06:56.476017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254575369574327:3239]
2025-10-01T14:06:56.476032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:56.476044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:56.476050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 158
2025-10-01T14:06:56.476047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:56.476051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 158
2025-10-01T14:06:56.476053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:56.476055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:56.476059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:56.476061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:56.476089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254575369574327:3239]
2025-10-01T14:06:56.476092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:56.476102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:56.476340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.476356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.476390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:56.476403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.476407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.476409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:56.476418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.476427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:56.476441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.476849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.476861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.476892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.476976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 159 partition: 0 MaxSeqNo: 45 sessionId: src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0
2025-10-01T14:06:56.477346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b6910bf-aa5882cc-fff79083-bc6badd1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:56.479927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0] Write session: try to update token
2025-10-01T14:06:56.479944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:56.497097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 159 sessionId: src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:56.498538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:56.498555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:56.498558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:56.498560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:56.498569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254575369574327:3239]
2025-10-01T14:06:56.498574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254575369574327:3239]
2025-10-01T14:06:56.498577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254575369574327:3239]
2025-10-01T14:06:56.498625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:56.498630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:56.498636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:56.498636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.498639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:56.498640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:56.498761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:56.499677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:56.550453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254577746434410:3127]
2025-10-01T14:06:56.550763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 158, pipe: [1:7556254577746434410:3127]
2025-10-01T14:06:56.646720Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:56.647077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.647086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.647122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434410:3127], now have 1 active actors on pipe
2025-10-01T14:06:56.647378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:56.647362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:56.647372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:56.647419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 159 reason: error at write: Disconnected sessionId: src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0
2025-10-01T14:06:56.647623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 159 sessionId: src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0 is DEAD
2025-10-01T14:06:56.647738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:56.647781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254577746434410:3127]
2025-10-01T14:06:56.647816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:56.647828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0] Write session will restart in 0.009031s
2025-10-01T14:06:56.647857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0] Write session: Do CDS request
2025-10-01T14:06:56.647864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:56.657941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.658046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:56.658059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 160
2025-10-01T14:06:56.658189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.658222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:56.658232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:56.658235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:56.658662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 160 sessionId:  describe result for acl check
2025-10-01T14:06:56.658711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:56.658713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:56.658715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:56.658722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254577746434436:3489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:56.659279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254577746434436:3489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:56.662488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254577746434436:3489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:56.665964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254577746434436:3489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:56.665977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254577746434436:3489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:56.665981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254577746434436:3489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:56.665995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:56.667878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:56.669109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:56.669308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:56.669316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:56.669326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:56.669367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:56.669403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254575369574585:3254]
2025-10-01T14:06:56.669967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:56.670259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:56.670296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:56.670616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:56.670671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.670677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.670678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.670680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.670681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.670682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.670683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.670684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.670685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.670686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.670688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.670689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.670690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.670690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.670695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.670705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.670709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.670713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.670716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.670720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.670724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.670728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.670732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.670736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.670740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.670744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.670747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.670750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.670757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.670764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.670770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.670775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.670779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.670783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.670787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.670792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.670796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.670801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.670805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.670810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.670822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.670827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.670831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.670836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.670840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.670846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.670851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.670856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.670860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.670865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.670869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.670874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.670878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.670883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.670886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.670891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.670929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:56.675068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:56.675705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:56.675716Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:56.675718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:56.675720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:56.675725Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 159 [2:7556254575369574585:3254]
2025-10-01T14:06:56.675737Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:56.675751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:56.675756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.675758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.675760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.675772Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:56.675779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:56.675783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:56.675833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.675840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.675841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.675845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:56.675848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:56.676194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 159
2025-10-01T14:06:56.676380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 159
2025-10-01T14:06:56.676130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:56.676141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.676152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.676161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.676175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:56.676195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434422:2446], now have 1 active actors on pipe
2025-10-01T14:06:56.676198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434606:3489], now have 1 active actors on pipe
2025-10-01T14:06:56.676206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254575369574579:3254]
2025-10-01T14:06:56.676208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254575369574579:3254]
2025-10-01T14:06:56.676210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254575369574579:3254]
2025-10-01T14:06:56.676695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 160 partition: 0 MaxSeqNo: 45 sessionId: src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0
2025-10-01T14:06:56.676224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:56.676239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:56.676240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:56.676244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:56.676245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:56.676252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:56.676255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:56.676281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254575369574579:3254]
2025-10-01T14:06:56.676283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:56.676288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:56.676307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.676313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.676343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:56.676351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.676355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.676358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:56.676366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.676375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:56.676392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.676603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.676605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.676620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.677175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dee6456-47b55ad3-b388cac9-d33bc20e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:56.680036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0] Write session: try to update token
2025-10-01T14:06:56.680053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:56.700454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:56.700476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:56.700478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:56.700481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:56.700490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254575369574579:3254]
2025-10-01T14:06:56.700495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254575369574579:3254]
2025-10-01T14:06:56.700499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254575369574579:3254]
2025-10-01T14:06:56.700537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:56.700543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:56.700547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:56.700547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:56.700554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.700557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:56.700678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 160 sessionId: src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:56.700685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:56.703386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:56.748449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254577746434643:3127]
2025-10-01T14:06:56.751902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 159, pipe: [1:7556254577746434643:3127]
2025-10-01T14:06:56.853721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:56.854149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.854168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.854213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434643:3127], now have 1 active actors on pipe
2025-10-01T14:06:56.854398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:56.854968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:56.854979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0] Write session will restart in 0.009335s
2025-10-01T14:06:56.855019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0] Write session: Do CDS request
2025-10-01T14:06:56.855027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:56.854461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254577746434643:3127]
2025-10-01T14:06:56.854487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:56.854517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:56.854594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 160 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0
2025-10-01T14:06:56.854790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 160 sessionId: src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0 is DEAD
2025-10-01T14:06:56.865989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.866061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:56.866075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 161
2025-10-01T14:06:56.870230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:56.870288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:56.870298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:56.870303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:56.870742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 161 sessionId:  describe result for acl check
2025-10-01T14:06:56.870778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:56.870784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:56.870786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:56.870791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254577746434808:3494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:56.871304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254577746434808:3494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:56.873247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:56.873374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254577746434808:3494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:56.874799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:56.875024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:56.875035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:56.875046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:56.875098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:56.875135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254575369574812:3257]
2025-10-01T14:06:56.875666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:56.875947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:56.875989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:56.876268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:56.876324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.876329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.876330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.876331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.876332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.876333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.876334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.876336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.876337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.876338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.876339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.876340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.876341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.876343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.876347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.876356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.876360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.876363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.876367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.876370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.876373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.876376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.876379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.876383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.876386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.876389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.876392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.876396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.876402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.876409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:56.876414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.876419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:56.876422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.876427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:56.876430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.876435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:56.876439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.876443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:56.876447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.876451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:56.876455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.876460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:56.876464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.876469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:56.876474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.876478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:56.876483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.876487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.876492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.876497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.876502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.876507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.876511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.876516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:56.876520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.876525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:56.876559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:56.879364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254577746434808:3494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:56.879382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254577746434808:3494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:56.879386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254577746434808:3494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:56.879395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:56.889991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:56.890957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:56.890977Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:56.890979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:56.890983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:56.890991Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 160 [2:7556254575369574812:3257]
2025-10-01T14:06:56.891013Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:56.891033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:56.891037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.891041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.891043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.891062Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:56.891075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:56.891082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:56.891160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.891167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.891169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.891172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:56.891175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:56.891262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:56.891265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.891280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:56.891298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:56.891314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:56.891338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254575369574807:3257]
2025-10-01T14:06:56.891346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254575369574807:3257]
2025-10-01T14:06:56.891348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254575369574807:3257]
2025-10-01T14:06:56.891359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:56.891374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:56.891397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:56.891401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:56.891449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254575369574807:3257]
2025-10-01T14:06:56.891456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:56.891772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 160
2025-10-01T14:06:56.891815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 160
2025-10-01T14:06:56.891621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:56.891628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:56.891630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:56.891635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:56.891889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434658:2446], now have 1 active actors on pipe
2025-10-01T14:06:56.891893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434873:3494], now have 1 active actors on pipe
2025-10-01T14:06:56.892188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.892199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.892230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:56.892244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:56.892250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:56.892253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:56.892263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:56.892274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:56.892309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.892506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.892514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.892531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:56.892697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 161 partition: 0 MaxSeqNo: 45 sessionId: src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0
2025-10-01T14:06:56.893134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88a7e29e-ad9b25ce-aec294ff-5511ed7f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:56.895545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0] Write session: try to update token
2025-10-01T14:06:56.895565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:56.914735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 161 sessionId: src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:56.917240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:56.918185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:56.918216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:56.918238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:56.918242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:56.918245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:56.918247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:56.918257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254575369574807:3257]
2025-10-01T14:06:56.918260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254575369574807:3257]
2025-10-01T14:06:56.918267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254575369574807:3257]
2025-10-01T14:06:56.918303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:56.918309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:56.918313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:56.918326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:56.918333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:56.918335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:56.918503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:56.954444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254577746434880:3127]
2025-10-01T14:06:56.961997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 160, pipe: [1:7556254577746434880:3127]
2025-10-01T14:06:57.082398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:57.082693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:57.082749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254577746434880:3127], now have 1 active actors on pipe
2025-10-01T14:06:57.083017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:57.083055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:57.083101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254577746434880:3127]
2025-10-01T14:06:57.083106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:57.083108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:57.083177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 161 reason: error at write: Disconnected sessionId: src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0
2025-10-01T14:06:57.083338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 161 sessionId: src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0 is DEAD
2025-10-01T14:06:57.083548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:57.083562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0] Write session will restart in 0.008223s
2025-10-01T14:06:57.083589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0] Write session: Do CDS request
2025-10-01T14:06:57.083599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:57.092940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:57.093075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:57.093092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 162
2025-10-01T14:06:57.093273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:57.093306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:57.093312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:57.093315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:57.093749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 162 sessionId:  describe result for acl check
2025-10-01T14:06:57.093784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:57.093786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:57.093788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:57.093793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254582041402246:3500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:57.094291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254582041402246:3500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:57.098054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254582041402246:3500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:57.100606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254582041402246:3500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:57.100618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254582041402246:3500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:57.100621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254582041402246:3500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:57.100635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:57.100766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:57.101854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:57.102039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:57.102049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:57.102059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:57.102111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:57.102148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254579664542326:3259]
2025-10-01T14:06:57.102670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:57.102938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:57.102974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:57.103246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:57.103299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.103304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.103305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.103306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.103308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.103309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.103309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.103311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.103311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.103312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.103313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.103314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.103315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.103316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.103321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.103330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.103333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.103337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.103340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.103343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.103346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.103350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.103353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.103356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.103359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.103362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.103365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.103369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.103375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.103381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.103386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.103391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.103394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.103399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.103402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.103407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.103410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.103417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.103424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.103429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.103433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.103437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.103441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.103445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.103453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.103457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.103461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.103468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.103472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.103476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.103479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.103483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.103489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.103493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.103498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.103502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.103533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:57.109848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 161
2025-10-01T14:06:57.109873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 161
2025-10-01T14:06:57.110394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 162 partition: 0 MaxSeqNo: 45 sessionId: src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0
2025-10-01T14:06:57.110781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0de403-6c45a1e-b2ad6ab6-954a41a0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:57.108767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:57.109504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:57.109508Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:57.109510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:57.109514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:57.109520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 161 [2:7556254579664542326:3259]
2025-10-01T14:06:57.109535Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:57.109550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:57.109554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.109557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.109559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.109574Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:57.109580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:57.109585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:57.109635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.109637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.109639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.109642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:57.109644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:57.109711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:57.109714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.109723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.109733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.109747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:57.109764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402182:2446], now have 1 active actors on pipe
2025-10-01T14:06:57.109767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402393:3500], now have 1 active actors on pipe
2025-10-01T14:06:57.109774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254579664542320:3259]
2025-10-01T14:06:57.109776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254579664542320:3259]
2025-10-01T14:06:57.109778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254579664542320:3259]
2025-10-01T14:06:57.109794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:57.109806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:57.109807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:57.109809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:57.109811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:57.109821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:57.109824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:57.109852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254579664542320:3259]
2025-10-01T14:06:57.109861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:57.109896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.109900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.109913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:57.109929Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:57.109935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.109940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.109942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:57.109951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.109959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:57.109972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:57.110273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.110277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.110290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:57.114066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0] Write session: try to update token
2025-10-01T14:06:57.114084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:57.134059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:57.134078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:57.134081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:57.134083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:57.134093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254579664542320:3259]
2025-10-01T14:06:57.134098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254579664542320:3259]
2025-10-01T14:06:57.134103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254579664542320:3259]
2025-10-01T14:06:57.134154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:57.134169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.134172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:57.134309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:57.136239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:57.136254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:57.136258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:57.135920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 162 sessionId: src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:57.138593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:57.182770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254582041402414:3127]
2025-10-01T14:06:57.183216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 161, pipe: [1:7556254582041402414:3127]
2025-10-01T14:06:57.297915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:57.299041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.299058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.299106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402414:3127], now have 1 active actors on pipe
2025-10-01T14:06:57.299657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:57.299660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254582041402414:3127]
2025-10-01T14:06:57.299673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:57.299677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:57.299726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 162 reason: error at write: Disconnected sessionId: src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0
2025-10-01T14:06:57.299917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 162 sessionId: src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0 is DEAD
2025-10-01T14:06:57.300081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:57.300384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:57.300394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0] Write session will restart in 0.009697s
2025-10-01T14:06:57.300417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0] Write session: Do CDS request
2025-10-01T14:06:57.300422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:57.310840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:57.311195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:57.311213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 163
2025-10-01T14:06:57.311365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:57.311397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:57.311406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:57.311409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:57.311822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 163 sessionId:  describe result for acl check
2025-10-01T14:06:57.311853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:57.311854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:57.311856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:57.311862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254582041402424:3505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:57.312300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254582041402424:3505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:57.317964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254582041402424:3505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:57.327441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254582041402424:3505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:57.327461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254582041402424:3505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:57.327464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254582041402424:3505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:57.327474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:57.338049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:57.347835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:57.348123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:57.348135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:57.348147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:57.348209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:57.348252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254579664542545:3262]
2025-10-01T14:06:57.348884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:57.349243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:57.349300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:57.349625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:57.349765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.349767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.349768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.349769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.349771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.349772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.349773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.349775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.349776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.349777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.349778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.349780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.349781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.349782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.349788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.349799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.349803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.349807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.349811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.349815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.349819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.349823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.349827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.349831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.349835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.349838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.349842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.349846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.349854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.349862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.349868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.349875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.349880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.349885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.349890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.349894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.349900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.349906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.349911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.349916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.349922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.349927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.349932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.349937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.349942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.349948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.349952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.349957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.349962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.349967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.349971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.349977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.349981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.349987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.349991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.349996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.350037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:57.365176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:57.366335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:57.366342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:57.366345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:57.366350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:57.366360Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 162 [2:7556254579664542545:3262]
2025-10-01T14:06:57.366391Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:57.366410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:57.366414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.366418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.366420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.366435Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:57.366442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:57.366448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:57.366515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.366517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.366519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.366522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:57.366525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:57.366604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:57.366606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.366620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.366641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.366657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:57.366674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254579664542540:3262]
2025-10-01T14:06:57.366676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254579664542540:3262]
2025-10-01T14:06:57.366678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254579664542540:3262]
2025-10-01T14:06:57.366700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:57.366715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:57.366729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:57.366733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:57.366758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:57.366763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:57.366765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:57.366770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254579664542540:3262]
2025-10-01T14:06:57.366774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:57.366846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:57.367144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 162
2025-10-01T14:06:57.367196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 162
2025-10-01T14:06:57.367383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402523:3505], now have 1 active actors on pipe
2025-10-01T14:06:57.367399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402417:2446], now have 1 active actors on pipe
2025-10-01T14:06:57.367423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.367429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.367467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b61a685-878bf379-44693f42-25b5c870_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:57.367483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.367488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.367496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:57.367510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.367531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:57.367552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:57.367849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.367861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.367888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:57.368579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|951c7014-dd94f5d8-202a3d41-edf7b82a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2b61a685-878bf379-44693f42-25b5c870_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:57.368066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 163 partition: 0 MaxSeqNo: 45 sessionId: src_id|2b61a685-878bf379-44693f42-25b5c870_0
2025-10-01T14:06:57.371494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b61a685-878bf379-44693f42-25b5c870_0] Write session: try to update token
2025-10-01T14:06:57.371511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b61a685-878bf379-44693f42-25b5c870_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:57.399040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402639:3127], now have 1 active actors on pipe
2025-10-01T14:06:57.398805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254582041402639:3127]
2025-10-01T14:06:57.399440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 162, pipe: [1:7556254582041402639:3127]
2025-10-01T14:06:57.401610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:57.401631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:57.401634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:57.401637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:57.401647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254579664542540:3262]
2025-10-01T14:06:57.401652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254579664542540:3262]
2025-10-01T14:06:57.401656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254579664542540:3262]
2025-10-01T14:06:57.401710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:57.401718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.401720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:57.401893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:57.402853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:57.402874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:57.402879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:57.405148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 163 sessionId: src_id|2b61a685-878bf379-44693f42-25b5c870_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:57.407954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:57.566451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:57.566939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.566949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.568078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254582041402639:3127]
2025-10-01T14:06:57.568122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:57.568192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 163 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b61a685-878bf379-44693f42-25b5c870_0
2025-10-01T14:06:57.568359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 163 sessionId: src_id|2b61a685-878bf379-44693f42-25b5c870_0 is DEAD
2025-10-01T14:06:57.568534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:57.568817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b61a685-878bf379-44693f42-25b5c870_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:57.568826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b61a685-878bf379-44693f42-25b5c870_0] Write session will restart in 0.005646s
2025-10-01T14:06:57.568865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b61a685-878bf379-44693f42-25b5c870_0] Write session: Do CDS request
2025-10-01T14:06:57.568872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b61a685-878bf379-44693f42-25b5c870_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:57.567373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:57.577352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b61a685-878bf379-44693f42-25b5c870_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:57.578626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:57.578642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 164
2025-10-01T14:06:57.578817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:57.578841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:57.578851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:57.578854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:57.579342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 164 sessionId:  describe result for acl check
2025-10-01T14:06:57.579390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:57.579393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:57.579394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:57.579400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254582041402666:3516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:57.579960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254582041402666:3516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:57.587338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254582041402666:3516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:57.590986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254582041402666:3516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:57.590993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254582041402666:3516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:57.590996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254582041402666:3516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:57.591005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:57.619101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:57.621453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:57.621932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:57.621937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:57.621951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:57.622019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:57.622061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254579664542780:3269]
2025-10-01T14:06:57.622725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:57.623711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:57.623768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:57.624138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:57.624201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.624202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.624203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.624205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.624206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.624207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.624208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.624209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.624211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.624212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.624213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.624215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.624216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.624217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.624223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.624234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.624239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.624243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.624247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.624252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.624256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.624261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.624265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.624270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.624274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.624279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.624283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.624287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.624294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.624304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.624310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.624317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.624323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.624329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.624334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.624340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.624345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.624351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.624356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.624362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.624368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.624374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.624379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.624384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.624390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.624396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.624400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.624405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.624410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.624416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.624420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.624426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.624430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.624435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.624439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.624444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.624485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:57.632247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:57.634171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:57.634190Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:57.634193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:57.634196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:57.634203Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 163 [2:7556254579664542780:3269]
2025-10-01T14:06:57.634224Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:57.634246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:57.634254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.634258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.634260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.634278Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:57.634284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:57.634290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:57.634439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.634449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.634451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.634454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:57.634456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:57.634537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:57.634539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.634553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.634565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.634583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:57.634600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254579664542774:3269]
2025-10-01T14:06:57.634603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254579664542774:3269]
2025-10-01T14:06:57.634605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254579664542774:3269]
2025-10-01T14:06:57.634620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:57.634637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:57.634652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:57.634655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:57.634696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254579664542774:3269]
2025-10-01T14:06:57.634699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:57.634699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:57.634702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:57.634704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:57.634710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:57.635077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402707:3516], now have 1 active actors on pipe
2025-10-01T14:06:57.635089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402646:2446], now have 1 active actors on pipe
2025-10-01T14:06:57.635134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 163
2025-10-01T14:06:57.635187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 163
2025-10-01T14:06:57.635255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.635266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.635299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:57.635308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.635313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.635315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:57.635324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.635337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:57.635357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:57.635594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.635601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.635615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:57.636206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b61a685-878bf379-44693f42-25b5c870_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:57.635735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 164 partition: 0 MaxSeqNo: 45 sessionId: src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0
2025-10-01T14:06:57.648046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0] Write session: try to update token
2025-10-01T14:06:57.648068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:57.662304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:57.662323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:57.662326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:57.662328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:57.662338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254579664542774:3269]
2025-10-01T14:06:57.662343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254579664542774:3269]
2025-10-01T14:06:57.662346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254579664542774:3269]
2025-10-01T14:06:57.662535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:57.662547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.662550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:57.662981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:57.664270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:57.664275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:57.664279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:57.668145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254582041402894:3127]
2025-10-01T14:06:57.668397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 163, pipe: [1:7556254582041402894:3127]
2025-10-01T14:06:57.689480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 164 sessionId: src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:57.692173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:57.831212Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:57.831633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402894:3127], now have 1 active actors on pipe
2025-10-01T14:06:57.831684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.831692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.831938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:57.831946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:57.831954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254582041402894:3127]
2025-10-01T14:06:57.831958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:57.831977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:57.832026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 164 reason: error at write: Disconnected sessionId: src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0
2025-10-01T14:06:57.832257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 164 sessionId: src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0 is DEAD
2025-10-01T14:06:57.834828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:57.834841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0] Write session will restart in 0.009601s
2025-10-01T14:06:57.834872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0] Write session: Do CDS request
2025-10-01T14:06:57.834879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:57.846076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:57.846518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:57.846534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 165
2025-10-01T14:06:57.846775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:57.846816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:57.846826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:57.846830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:57.847328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 165 sessionId:  describe result for acl check
2025-10-01T14:06:57.847368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:57.847371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:57.847373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:57.847379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254582041402931:3522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:57.847892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254582041402931:3522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:57.850201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254582041402931:3522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:57.859210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254582041402931:3522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:57.859227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254582041402931:3522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:57.859231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254582041402931:3522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:57.859240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:57.863495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:57.865977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:57.866221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:57.866231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:57.866241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:57.866301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:57.866346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254579664543035:3280]
2025-10-01T14:06:57.866905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:57.867363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:57.867420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:57.867812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:57.867938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.867940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.867941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.867942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.867943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.867945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.867947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.867948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.867950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.867951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.867952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.867954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.867955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.867957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.867966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.867978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.867982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.867986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.867990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.867995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.867999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.868003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.868009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.868013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.868017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.868020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.868024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.868028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.868040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.868052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:57.868060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.868067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:57.868075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.868081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:57.868091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.868098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:57.868105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.868111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:57.868116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.868123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:57.868133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.868142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:57.868148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.868154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:57.868162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.868169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:57.868175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.868182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.868189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.868195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.868202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.868208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.868216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.868222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:57.868228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.868235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:57.868279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:57.873173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:57.874918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:57.874939Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:57.874942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:57.874945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:57.874956Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 164 [2:7556254579664543035:3280]
2025-10-01T14:06:57.874985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:57.875004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:57.875007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.875010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.875012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.875029Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:57.875034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:57.875041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:57.875126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.875128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.875130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.875133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:57.875136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:57.875205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:57.875208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.875222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:57.875232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:57.875248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:57.875270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254579664543030:3280]
2025-10-01T14:06:57.875272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254579664543030:3280]
2025-10-01T14:06:57.875274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254579664543030:3280]
2025-10-01T14:06:57.875293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:57.875306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:57.875321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:57.875324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:57.875364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254579664543030:3280]
2025-10-01T14:06:57.875366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:57.875366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:57.875370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:57.875373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:57.875380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:57.875645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 164
2025-10-01T14:06:57.875664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041402909:2446], now have 1 active actors on pipe
2025-10-01T14:06:57.875673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041403096:3522], now have 1 active actors on pipe
2025-10-01T14:06:57.875691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 164
2025-10-01T14:06:57.875823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.875830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.875855Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:57.875863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:57.875866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:57.875869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:57.875879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:57.875889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:57.875906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:57.876286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.876293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.876307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:57.876479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 165 partition: 0 MaxSeqNo: 45 sessionId: src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0
2025-10-01T14:06:57.876840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd01ea9c-781c1e41-50dd55ac-e5644264_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:57.879094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0] Write session: try to update token
2025-10-01T14:06:57.879110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:57.898427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 165 sessionId: src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:57.900828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:57.901140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:57.901163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:57.901199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:57.901372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:57.923896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:57.923918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:57.923921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:57.923923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:57.923933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254579664543030:3280]
2025-10-01T14:06:57.923938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254579664543030:3280]
2025-10-01T14:06:57.923942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254579664543030:3280]
2025-10-01T14:06:57.923993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:57.924001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:57.924004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:57.924143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:57.926486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:57.926499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:57.926502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:57.931941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254582041403135:3127]
2025-10-01T14:06:57.932199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 164, pipe: [1:7556254582041403135:3127]
2025-10-01T14:06:58.087152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:58.087712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254582041403135:3127], now have 1 active actors on pipe
2025-10-01T14:06:58.097483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.097509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.097668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.097727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.097781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.097836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.097894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.097902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.097982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.098075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.098155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.098246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.098288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.098293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.098393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.098495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.098601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.098703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.098836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.098843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.098933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.099007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.099074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.099140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.099182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.099187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.099246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.099327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.099404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.099463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.099537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.099544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.099604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.099686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.099766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.099854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.099904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.099909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.099994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.100084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.100322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.100578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.100705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.100710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.100778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.100852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.100908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.100964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.101066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.101074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.101136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.101189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.101250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.101322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.101458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.101464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.101538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.101605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.101663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.101724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.101832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.101837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.102153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:58.102201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:58.102203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:58.102231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 165 reason: error at write: Disconnected sessionId: src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0
2025-10-01T14:06:58.102455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 165 sessionId: src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0 is DEAD
2025-10-01T14:06:58.102657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254582041403135:3127]
2025-10-01T14:06:58.102685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:58.102697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0] Write session will restart in 0.009491s
2025-10-01T14:06:58.102723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0] Write session: Do CDS request
2025-10-01T14:06:58.102729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:58.102955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:58.113971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:58.114291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:58.114305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 166
2025-10-01T14:06:58.114427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:58.114454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:58.114460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:58.114463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:58.115238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 166 sessionId:  describe result for acl check
2025-10-01T14:06:58.115275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:58.115277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:58.115279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:58.115284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254586336370473:3527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:58.115815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254586336370473:3527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:58.123316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254586336370473:3527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:58.133269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254586336370473:3527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:58.133288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254586336370473:3527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:58.133292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254586336370473:3527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:58.133302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:58.141130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:58.143061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:58.143280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:58.143293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:58.143307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:58.143358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:58.143388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254583959510554:3282]
2025-10-01T14:06:58.143927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:58.144331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:58.144390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:58.144799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:58.144866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.144872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.144874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.144875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.144876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.144878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.144879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.144880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.144881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.144882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.144884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.144885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.144886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.144887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.144892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.144902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.144906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.144910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.144914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.144918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.144922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.144925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.144933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.144938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.144945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.144949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.144957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.144960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.144972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.144979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.144985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.144990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.144994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.144999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.145003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.145008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.145016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.145025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.145034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.145041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.145049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.145057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.145066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.145073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.145080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.145085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.145093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.145098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.145102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.145105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.145108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.145111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.145114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.145116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.145119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.145123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.145144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:58.149960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:58.150744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:58.150758Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:58.150761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:58.150765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:58.150773Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 165 [2:7556254583959510554:3282]
2025-10-01T14:06:58.151047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:58.151072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:58.151079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.151083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.151085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.151101Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:58.151111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:58.151116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:58.151170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.151177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.151178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.151182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:58.151185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:58.151252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:58.151259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.151272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.151287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.151307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:58.151328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254583959510548:3282]
2025-10-01T14:06:58.151334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254583959510548:3282]
2025-10-01T14:06:58.151336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254583959510548:3282]
2025-10-01T14:06:58.151344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:58.151352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:58.151362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:58.151365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:58.151367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:58.151377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:58.151383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:58.151394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336370434:2446], now have 1 active actors on pipe
2025-10-01T14:06:58.151401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336370617:3527], now have 1 active actors on pipe
2025-10-01T14:06:58.151434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254583959510548:3282]
2025-10-01T14:06:58.151447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:58.151726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 165
2025-10-01T14:06:58.151769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 165
2025-10-01T14:06:58.151939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:58.152414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.152429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.152461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46202cdc-65287c7b-87121d82-1ec7473_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:58.152474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.152478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.152481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:58.152491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.152503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:58.152523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:58.152787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.152792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.152803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:58.152979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 166 partition: 0 MaxSeqNo: 45 sessionId: src_id|46202cdc-65287c7b-87121d82-1ec7473_0
2025-10-01T14:06:58.153303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d83e3e-afcff31b-1652157f-3dea50ee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|46202cdc-65287c7b-87121d82-1ec7473_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:58.155708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46202cdc-65287c7b-87121d82-1ec7473_0] Write session: try to update token
2025-10-01T14:06:58.155725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46202cdc-65287c7b-87121d82-1ec7473_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:58.176037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 166 sessionId: src_id|46202cdc-65287c7b-87121d82-1ec7473_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:58.179556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:58.179855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:58.179874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:58.179876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:58.179877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:58.179885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254583959510548:3282]
2025-10-01T14:06:58.179889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254583959510548:3282]
2025-10-01T14:06:58.179891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254583959510548:3282]
2025-10-01T14:06:58.179930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:58.179936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.179937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:58.179977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:58.179992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:58.179996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:58.180078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:58.204449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254586336370671:3127]
2025-10-01T14:06:58.204917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 165, pipe: [1:7556254586336370671:3127]
2025-10-01T14:06:58.340400Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:58.340938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.340950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.340995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336370671:3127], now have 1 active actors on pipe
2025-10-01T14:06:58.341237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:58.341560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:58.341611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254586336370671:3127]
2025-10-01T14:06:58.341628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:58.341631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:58.341679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 166 reason: error at write: Disconnected sessionId: src_id|46202cdc-65287c7b-87121d82-1ec7473_0
2025-10-01T14:06:58.341869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 166 sessionId: src_id|46202cdc-65287c7b-87121d82-1ec7473_0 is DEAD
2025-10-01T14:06:58.342045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46202cdc-65287c7b-87121d82-1ec7473_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:58.342057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46202cdc-65287c7b-87121d82-1ec7473_0] Write session will restart in 0.007357s
2025-10-01T14:06:58.342085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46202cdc-65287c7b-87121d82-1ec7473_0] Write session: Do CDS request
2025-10-01T14:06:58.342092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46202cdc-65287c7b-87121d82-1ec7473_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:58.350882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46202cdc-65287c7b-87121d82-1ec7473_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:58.351004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:58.351018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 167
2025-10-01T14:06:58.352485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:58.352527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:58.352532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:58.352536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:58.353267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 167 sessionId:  describe result for acl check
2025-10-01T14:06:58.353297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:58.353298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:58.353300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:58.353305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254586336370724:3531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:58.353725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254586336370724:3531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:58.356919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254586336370724:3531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:58.362178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254586336370724:3531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:58.362192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254586336370724:3531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:58.362198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254586336370724:3531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:58.362208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:58.377659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:58.379661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:58.380163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:58.380169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:58.380188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:58.380270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:58.380318Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254583959510776:3285]
2025-10-01T14:06:58.381058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:58.381455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:58.381520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:58.381867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:58.381925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.381926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.381927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.381928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.381929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.381930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.381931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.381932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.381933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.381934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.381935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.381936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.381937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.381938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.381944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.381955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.381959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.381963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.381967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.381971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.381975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.381979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.381982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.381987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.381990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.381994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.381997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.382001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.382012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.382021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.382028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.382034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.382038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.382044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.382048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.382053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.382057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.382065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.382070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.382075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.382080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.382084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.382088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.382094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.382098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.382103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.382108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.382112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.382117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.382122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.382126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.382131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.382136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.382140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.382144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.382149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.382215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:58.388940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 166
2025-10-01T14:06:58.388973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 166
2025-10-01T14:06:58.389963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 167 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0
2025-10-01T14:06:58.387108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:58.388012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:58.388017Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:58.388020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:58.388024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:58.388031Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 166 [2:7556254583959510776:3285]
2025-10-01T14:06:58.388049Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:58.388069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:58.388072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.388075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.388077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.388093Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:58.388099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:58.388105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:58.388170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.388172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.388174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.388177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:58.388179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:58.388261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:58.388264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.388275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.388283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.388297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:58.388315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254583959510771:3285]
2025-10-01T14:06:58.388319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254583959510771:3285]
2025-10-01T14:06:58.388321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254583959510771:3285]
2025-10-01T14:06:58.388333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:58.388347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:58.388360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:58.388362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:58.388371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:58.388374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:58.388376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:58.388402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254583959510771:3285]
2025-10-01T14:06:58.388405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:58.388408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:58.388415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336370848:3531], now have 1 active actors on pipe
2025-10-01T14:06:58.388419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336370674:2446], now have 1 active actors on pipe
2025-10-01T14:06:58.389415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.389424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.389457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:58.389466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.389471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.389474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:58.389484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.389497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:58.389517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:58.389808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.389813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.389830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:58.394241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46202cdc-65287c7b-87121d82-1ec7473_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:58.396929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0] Write session: try to update token
2025-10-01T14:06:58.396952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:58.419498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:58.419522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:58.419524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:58.419527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:58.419538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254583959510771:3285]
2025-10-01T14:06:58.419543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254583959510771:3285]
2025-10-01T14:06:58.419547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254583959510771:3285]
2025-10-01T14:06:58.419604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:58.419622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.419625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:58.419751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:58.419761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:58.419767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:58.419778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:58.428717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 167 sessionId: src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:58.431329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:58.441248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254586336370902:3127]
2025-10-01T14:06:58.441616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 166, pipe: [1:7556254586336370902:3127]
2025-10-01T14:06:58.580123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:58.580414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.580427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.580461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336370902:3127], now have 1 active actors on pipe
2025-10-01T14:06:58.580655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:58.580713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:58.580801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 167 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0
2025-10-01T14:06:58.580810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:58.580871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254586336370902:3127]
2025-10-01T14:06:58.580983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 167 sessionId: src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0 is DEAD
2025-10-01T14:06:58.581192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:58.581201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0] Write session will restart in 0.005691s
2025-10-01T14:06:58.581221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0] Write session: Do CDS request
2025-10-01T14:06:58.581226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:58.587923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:58.588013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:58.588027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 168
2025-10-01T14:06:58.588156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:58.588189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:58.588199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:58.588203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:58.588621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 168 sessionId:  describe result for acl check
2025-10-01T14:06:58.588657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:58.588663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:58.588664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:58.588677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254586336370921:3536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:58.589201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254586336370921:3536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:58.591252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254586336370921:3536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:58.598804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254586336370921:3536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:58.598818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254586336370921:3536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:58.598821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254586336370921:3536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:58.598830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:58.604140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:58.605739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:58.605993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:58.606005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:58.606018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:58.606078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:58.606125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254583959511001:3288]
2025-10-01T14:06:58.608064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:58.608460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:58.608519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:58.608922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:58.608993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.608994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.608995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.608997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.608999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.609000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.609002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.609003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.609004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.609005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.609007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.609008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.609008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.609009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.609016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.609027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.609030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.609035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.609038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.609042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.609047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.609051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.609054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.609059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.609063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.609067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.609071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.609074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.609082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.609111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.609119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.609125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.609130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.609135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.609140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.609146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.609151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.609156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.609161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.609165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.609171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.609176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.609180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.609185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.609190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.609196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.609200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.609206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.609211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.609216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.609220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.609226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.609233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.609238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.609243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.609248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.609292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:58.616168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:58.617442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:58.617461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:58.617463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:58.617467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:58.617474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 167 [2:7556254583959511001:3288]
2025-10-01T14:06:58.617491Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:58.617508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:58.617512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.617515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.617517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.617534Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:58.617540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:58.617546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:58.617605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.617613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.617615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.617618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:58.617621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:58.617698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:58.617706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.617719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.617734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.617752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:58.617773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254583959510996:3288]
2025-10-01T14:06:58.617780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254583959510996:3288]
2025-10-01T14:06:58.617783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254583959510996:3288]
2025-10-01T14:06:58.617793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:58.617808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:58.617807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:58.617814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:58.617817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:58.617827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:58.617830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:58.617842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336370907:2446], now have 1 active actors on pipe
2025-10-01T14:06:58.617851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336371101:3536], now have 1 active actors on pipe
2025-10-01T14:06:58.617886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254583959510996:3288]
2025-10-01T14:06:58.617899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:58.617933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:58.617949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 167
2025-10-01T14:06:58.617996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 167
2025-10-01T14:06:58.618488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.618506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.618538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:58.618555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.618567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.618570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:58.618584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.618601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:58.618625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:58.618907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.618920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.618935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:58.619346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 168 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0
2025-10-01T14:06:58.619931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f156a74-1b961857-bcd059c0-7f831fdb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:58.623101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0] Write session: try to update token
2025-10-01T14:06:58.623125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:58.646411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 168 sessionId: src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:58.648921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:58.649276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.649299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.649336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:58.655831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:58.655853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:58.655855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:58.655857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:58.655866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254583959510996:3288]
2025-10-01T14:06:58.655871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254583959510996:3288]
2025-10-01T14:06:58.655874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254583959510996:3288]
2025-10-01T14:06:58.655924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:58.655942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.655946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:58.656074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:58.653470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:58.659724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:58.659742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:58.659746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:58.680877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254586336371158:3127]
2025-10-01T14:06:58.684736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 167, pipe: [1:7556254586336371158:3127]
2025-10-01T14:06:58.813036Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:58.813567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336371158:3127], now have 1 active actors on pipe
2025-10-01T14:06:58.821869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.821902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.822084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.822150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.822209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.822264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.822715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.822728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.822835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.822891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.822945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.822996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.823036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.823040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.823111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.823169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.823244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.823306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.823347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.823350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.823409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.823468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.823644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.823705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.823749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.823751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.823825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.823876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.823940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.824003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.824044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.824047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.824125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.824185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.824242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.824300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.824344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.824347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.824425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.824485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.824554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.824619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.824733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.824736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.824813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.824895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.824977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.825049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.825202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.825205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.825285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.825353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.825426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.825492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.825623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.825626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.825701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:58.825763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:58.825828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:58.825891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:58.825936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:58.825939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:58.826345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254586336371158:3127]
2025-10-01T14:06:58.826347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:58.826403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:58.826406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:58.826433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 168 reason: error at write: Disconnected sessionId: src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0
2025-10-01T14:06:58.826637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 168 sessionId: src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0 is DEAD
2025-10-01T14:06:58.827506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:58.830851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:58.830866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0] Write session will restart in 0.007243s
2025-10-01T14:06:58.830893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0] Write session: Do CDS request
2025-10-01T14:06:58.830900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:58.840225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:58.840268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:58.840284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 169
2025-10-01T14:06:58.840626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:58.840670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:58.840675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:58.840679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:58.841126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 169 sessionId:  describe result for acl check
2025-10-01T14:06:58.841162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:58.841169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:58.841170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:58.841177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254586336371188:3548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:58.841662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254586336371188:3548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:58.846298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254586336371188:3548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:58.851254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254586336371188:3548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:58.851268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254586336371188:3548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:58.851272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254586336371188:3548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:58.851281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:58.859794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:58.861563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:58.861935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:58.861947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:58.861961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:58.862029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:58.862087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254583959511272:3303]
2025-10-01T14:06:58.862698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:58.863047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:58.863143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:58.863530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:58.863613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.863620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.863621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.863622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.863623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.863624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.863625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.863627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.863628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.863629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.863630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.863631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.863632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.863633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.863640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.863650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.863654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.863658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.863662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.863665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.863669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.863673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.863677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.863681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.863685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.863688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.863692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.863695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.863704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.863713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:58.863720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.863726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:58.863730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.863736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:58.863740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.863745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:58.863750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.863755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:58.863758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.863763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:58.863768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.863773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:58.863777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.863782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:58.863787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.863791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:58.863804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.863810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.863817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.863823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.863828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.863833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.863838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.863844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:58.863848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.863858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:58.863893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:58.869253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:58.869905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:58.869920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:58.869922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:58.869926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:58.869933Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 168 [2:7556254583959511272:3303]
2025-10-01T14:06:58.870227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:58.870249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:58.870253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.870256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.870259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.870275Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:58.870281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:58.870287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:58.870348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.870355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.870357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.870360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:58.870362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:58.870451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:58.870454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.870466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:58.870477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:58.870493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:58.870528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254583959511267:3303]
2025-10-01T14:06:58.870534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254583959511267:3303]
2025-10-01T14:06:58.870536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254583959511267:3303]
2025-10-01T14:06:58.870549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:58.870563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:58.870581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:58.870588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:58.870631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254583959511267:3303]
2025-10-01T14:06:58.870633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:58.870804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:58.870807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:58.870808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:58.870814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:58.871124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336371309:3548], now have 1 active actors on pipe
2025-10-01T14:06:58.871133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336371174:2446], now have 1 active actors on pipe
2025-10-01T14:06:58.871031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 168
2025-10-01T14:06:58.871064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 168
2025-10-01T14:06:58.871676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.871699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.871730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de956094-de714d4-5915bead-40074c6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:58.871740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:58.871745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:58.871747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:58.871758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:58.871771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:58.871802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:58.875154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:58.875172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:58.875209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:58.875382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 169 partition: 0 MaxSeqNo: 45 sessionId: src_id|de956094-de714d4-5915bead-40074c6b_0
2025-10-01T14:06:58.878668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e1eac84-b5c5bb4f-9cf751a4-4aed36a5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|de956094-de714d4-5915bead-40074c6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:58.881589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de956094-de714d4-5915bead-40074c6b_0] Write session: try to update token
2025-10-01T14:06:58.881605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de956094-de714d4-5915bead-40074c6b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:58.900664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:58.900683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:58.900686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:58.900687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:58.900700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254583959511267:3303]
2025-10-01T14:06:58.900703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254583959511267:3303]
2025-10-01T14:06:58.900707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254583959511267:3303]
2025-10-01T14:06:58.900746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:58.900754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:58.900759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:58.900761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:58.900762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:58.900763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:58.900910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:58.912390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 169 sessionId: src_id|de956094-de714d4-5915bead-40074c6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:58.914808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:58.927120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254586336371403:3127]
2025-10-01T14:06:58.928002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 168, pipe: [1:7556254586336371403:3127]
2025-10-01T14:06:59.065984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:59.066418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.066435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.066460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254586336371403:3127], now have 1 active actors on pipe
2025-10-01T14:06:59.066796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:59.066810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:59.066895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:59.067258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de956094-de714d4-5915bead-40074c6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:59.067272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de956094-de714d4-5915bead-40074c6b_0] Write session will restart in 0.008913s
2025-10-01T14:06:59.067297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de956094-de714d4-5915bead-40074c6b_0] Write session: Do CDS request
2025-10-01T14:06:59.067304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de956094-de714d4-5915bead-40074c6b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:59.066866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 169 reason: error at write: Disconnected sessionId: src_id|de956094-de714d4-5915bead-40074c6b_0
2025-10-01T14:06:59.067053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 169 sessionId: src_id|de956094-de714d4-5915bead-40074c6b_0 is DEAD
2025-10-01T14:06:59.067168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:59.067201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254586336371403:3127]
2025-10-01T14:06:59.078785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de956094-de714d4-5915bead-40074c6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.079327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:59.079342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 170
2025-10-01T14:06:59.079491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.079534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:59.079543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:59.079548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:59.079997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 170 sessionId:  describe result for acl check
2025-10-01T14:06:59.080040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:59.080056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:59.080062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:59.080068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254590631338777:3552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:59.080507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254590631338777:3552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:59.082707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254590631338777:3552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:59.085700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254590631338777:3552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:59.085714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254590631338777:3552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:59.085717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254590631338777:3552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:59.085727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:59.093651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:59.095672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:59.095897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:59.095908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:59.095920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:59.095975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:59.096017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254588254478794:3305]
2025-10-01T14:06:59.096723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:59.097162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:59.097223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:59.097559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:59.097638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.097644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.097646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.097648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.097649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.097650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.097651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.097652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.097654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.097655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.097656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.097657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.097658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.097659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.097666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.097675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.097679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.097683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.097687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.097690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.097694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.097698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.097701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.097706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.097709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.097713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.097717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.097720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.097728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.097737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.097744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.097749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.097753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.097758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.097766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.097771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.097782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.097787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.097791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.097795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.097799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.097803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.097807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.097812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.097817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.097822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.097826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.097831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.097836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.097840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.097843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.097847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.097852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.097856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.097860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.097866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.097904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:59.102410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:59.103327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:59.103332Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:59.103334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:59.103338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:59.103346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 169 [2:7556254588254478794:3305]
2025-10-01T14:06:59.103361Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:59.103377Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:59.103381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.103385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.103387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.103402Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:59.103408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:59.103414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:59.103470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.103474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.103476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.103479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:59.103482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:59.103555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:59.103557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.103569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.103581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.103599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:59.103615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254588254478789:3305]
2025-10-01T14:06:59.103617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254588254478789:3305]
2025-10-01T14:06:59.103619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254588254478789:3305]
2025-10-01T14:06:59.103628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:59.103636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:59.103639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:59.103641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:59.103641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:59.103656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:59.103658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:59.103669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631338890:3552], now have 1 active actors on pipe
2025-10-01T14:06:59.103672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631338702:2446], now have 1 active actors on pipe
2025-10-01T14:06:59.103706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254588254478789:3305]
2025-10-01T14:06:59.103714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:59.103725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:59.104629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 169
2025-10-01T14:06:59.104671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 169
2025-10-01T14:06:59.104860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.104877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.104908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:59.104923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.104928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.104931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:59.104941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.104956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:59.104973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:59.105333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.105340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.105364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:59.105563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 170 partition: 0 MaxSeqNo: 45 sessionId: src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0
2025-10-01T14:06:59.106554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de956094-de714d4-5915bead-40074c6b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:59.109821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0] Write session: try to update token
2025-10-01T14:06:59.109841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:59.127210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 170 sessionId: src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:59.129791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:59.129979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.130003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.130042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:06:59.130133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:59.134940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:59.134960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:59.134963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:59.134966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:59.134975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254588254478789:3305]
2025-10-01T14:06:59.134979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254588254478789:3305]
2025-10-01T14:06:59.134983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254588254478789:3305]
2025-10-01T14:06:59.135024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:59.135031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:59.135032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:59.135035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:59.135040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.135043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:59.135189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:59.167268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254590631338939:3127]
2025-10-01T14:06:59.167545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 169, pipe: [1:7556254590631338939:3127]
2025-10-01T14:06:59.280931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:59.288894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.288921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.289093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.289153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.289216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.289285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.289680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.289699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.289773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.289829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.289888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.289948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.289988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.289994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.290065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.290122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.290180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.290235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.290279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.290285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.290351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.290517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.290583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.290648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.290695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.290705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.290768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.290824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.290883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.290939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.290977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.290981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.291059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.291132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.291197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.291264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.291316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.291319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.291395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.291456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.291517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.291588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.291649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.291652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.291742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.291817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.291885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.291953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.292082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.292087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.292167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.292239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.292309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.292374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.292475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.292478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.292549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:06:59.292609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:06:59.292671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:06:59.292755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:06:59.292828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:06:59.292845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:06:59.292921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631338939:3127], now have 1 active actors on pipe
2025-10-01T14:06:59.293727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:59.294620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254590631338939:3127]
2025-10-01T14:06:59.294656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:59.294695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 170 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0
2025-10-01T14:06:59.294886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 170 sessionId: src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0 is DEAD
2025-10-01T14:06:59.295016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:59.298477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:59.298491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0] Write session will restart in 0.005986s
2025-10-01T14:06:59.298517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0] Write session: Do CDS request
2025-10-01T14:06:59.298524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:59.305939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.305991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:59.306007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 171
2025-10-01T14:06:59.306202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.306236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:59.306246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:59.306249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:59.306688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 171 sessionId:  describe result for acl check
2025-10-01T14:06:59.306724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:59.306730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:59.306732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:59.306737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254590631338954:3557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:59.307220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254590631338954:3557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:59.310513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254590631338954:3557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:59.316582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254590631338954:3557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:59.316598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254590631338954:3557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:59.316602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254590631338954:3557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:59.316611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:59.326563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:59.328289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:59.328563Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:59.328572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:59.328580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:59.328629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:59.328659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254588254479021:3308]
2025-10-01T14:06:59.329151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:59.329612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:59.329652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:59.329959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:59.330019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.330025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.330026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.330027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.330028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.330029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.330030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.330031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.330033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.330033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.330035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.330036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.330037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.330038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.330043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.330053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.330056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.330060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.330063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.330067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.330070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.330073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.330076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.330080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.330083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.330086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.330090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.330094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.330101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.330108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.330114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.330119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.330123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.330128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.330133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.330138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.330143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.330147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.330150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.330155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.330160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.330165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.330169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.330174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.330179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.330183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.330187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.330191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.330196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.330201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.330205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.330210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.330215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.330219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.330223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.330228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.330276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:59.335324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:59.335989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:59.336005Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:59.336008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:59.336012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:59.336018Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 170 [2:7556254588254479021:3308]
2025-10-01T14:06:59.336036Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:59.336053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:59.336056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.336059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.336060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.336072Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:59.336078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:59.336084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:59.336142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.336145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.336147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.336150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:59.336153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:59.336221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:59.336224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.336235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.336246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.336260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:59.336279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254588254479015:3308]
2025-10-01T14:06:59.336281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254588254479015:3308]
2025-10-01T14:06:59.336283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254588254479015:3308]
2025-10-01T14:06:59.336296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:59.336312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:59.336326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:59.336328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:59.336365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254588254479015:3308]
2025-10-01T14:06:59.336367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:59.336558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:59.336568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:59.336570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:59.336575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:59.336707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631339004:3557], now have 1 active actors on pipe
2025-10-01T14:06:59.336719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631338944:2446], now have 1 active actors on pipe
2025-10-01T14:06:59.336782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 170
2025-10-01T14:06:59.336793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 170
2025-10-01T14:06:59.336822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.336854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.336886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:59.336897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.336906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.336910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:59.336920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.336934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:59.336954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:59.337111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.337127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.337142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:59.337268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 171 partition: 0 MaxSeqNo: 45 sessionId: src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0
2025-10-01T14:06:59.338483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fb9d284-a05ac235-4e055ad0-d48fb892_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:59.341201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0] Write session: try to update token
2025-10-01T14:06:59.341220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:59.369631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:59.369651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:59.369653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:59.369655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:59.369667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254588254479015:3308]
2025-10-01T14:06:59.369672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254588254479015:3308]
2025-10-01T14:06:59.369676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254588254479015:3308]
2025-10-01T14:06:59.369712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:59.369722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:59.369725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:59.369727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:59.369734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.369736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:59.369897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:59.380744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 171 sessionId: src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:59.383354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:59.394550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254590631339177:3127]
2025-10-01T14:06:59.394861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 170, pipe: [1:7556254590631339177:3127]
2025-10-01T14:06:59.534635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:59.535161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.535176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.535199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631339177:3127], now have 1 active actors on pipe
2025-10-01T14:06:59.535386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:59.535405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254590631339177:3127]
2025-10-01T14:06:59.535415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:59.535418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:59.535430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:59.535475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 171 reason: error at write: Disconnected sessionId: src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0
2025-10-01T14:06:59.535664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 171 sessionId: src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0 is DEAD
2025-10-01T14:06:59.535863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:59.535874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0] Write session will restart in 0.008081s
2025-10-01T14:06:59.535903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0] Write session: Do CDS request
2025-10-01T14:06:59.535910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:59.544903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.545015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:59.545027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 172
2025-10-01T14:06:59.545159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.545208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:59.545215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:59.545219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:59.545611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 172 sessionId:  describe result for acl check
2025-10-01T14:06:59.545640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:59.545642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:59.545644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:59.545649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254590631339258:3562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:59.546148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254590631339258:3562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:59.548339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254590631339258:3562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:59.550336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:59.552146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254590631339258:3562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:59.552162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254590631339258:3562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:59.552164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254590631339258:3562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:59.552330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:59.552546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:59.552795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:59.552804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:59.552816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:59.552879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:59.552919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254588254479250:3311]
2025-10-01T14:06:59.553521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:59.553832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:59.553874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:59.554169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:59.554227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.554232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.554233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.554234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.554235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.554236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.554237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.554238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.554239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.554240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.554241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.554241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.554242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.554243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.554248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.554258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.554261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.554264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.554267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.554270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.554274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.554277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.554280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.554284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.554287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.554290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.554293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.554295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.554302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.554309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.554315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.554319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.554323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.554328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.554331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.554335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.554339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.554344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.554348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.554352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.554356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.554363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.554366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.554398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.554408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.554413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.554417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.554421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.554426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.554430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.554434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.554440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.554449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.554454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.554458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.554462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.554495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:59.558560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:59.559250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:59.559270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:59.559274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:59.559278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:59.559285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 171 [2:7556254588254479250:3311]
2025-10-01T14:06:59.559301Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:59.559317Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:59.559327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.559331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.559333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.559349Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:59.559359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:59.559365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:59.559425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.559432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.559434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.559437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:59.559440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:59.559508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:59.559516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.559529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.559540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.559556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:59.559575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631339404:3562], now have 1 active actors on pipe
2025-10-01T14:06:59.559583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631339182:2446], now have 1 active actors on pipe
2025-10-01T14:06:59.559591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254588254479244:3311]
2025-10-01T14:06:59.559597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254588254479244:3311]
2025-10-01T14:06:59.559600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254588254479244:3311]
2025-10-01T14:06:59.559615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:59.559678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 171
2025-10-01T14:06:59.559680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 171
2025-10-01T14:06:59.559629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:59.559636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:59.559640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:59.559642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:59.559649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:59.559652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:59.559686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254588254479244:3311]
2025-10-01T14:06:59.559696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:59.559698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:59.559732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.559737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.559768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:59.559775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.559779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.559782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:59.559791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.559804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:59.559820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:59.561759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.561774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.561798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:59.561908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 172 partition: 0 MaxSeqNo: 45 sessionId: src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0
2025-10-01T14:06:59.562278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14288c4b-855d6352-9afbd6d9-a4c7378c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:59.564914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0] Write session: try to update token
2025-10-01T14:06:59.564931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:59.582479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 172 sessionId: src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:59.582897Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:59.582916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:59.582919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:59.582921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:59.582930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254588254479244:3311]
2025-10-01T14:06:59.582934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254588254479244:3311]
2025-10-01T14:06:59.582937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254588254479244:3311]
2025-10-01T14:06:59.582981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:59.582988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:59.582994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.582997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:59.582997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:59.583001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:59.583127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:59.584955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:59.635764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254590631339416:3127]
2025-10-01T14:06:59.636032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 171, pipe: [1:7556254590631339416:3127]
2025-10-01T14:06:59.739114Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:59.739354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.739370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.739410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631339416:3127], now have 1 active actors on pipe
2025-10-01T14:06:59.739574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:59.739574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:59.739586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:06:59.739591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:06:59.739624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254590631339416:3127]
2025-10-01T14:06:59.739651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 172 reason: error at write: Disconnected sessionId: src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0
2025-10-01T14:06:59.739858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 172 sessionId: src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0 is DEAD
2025-10-01T14:06:59.740022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:06:59.740032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0] Write session will restart in 0.009091s
2025-10-01T14:06:59.740061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0] Write session: Do CDS request
2025-10-01T14:06:59.740068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:59.749936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.750039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:59.750055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 173
2025-10-01T14:06:59.750207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.750243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:59.750253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:59.750257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:59.750682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 173 sessionId:  describe result for acl check
2025-10-01T14:06:59.750726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:59.750729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:59.750730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:59.750736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254590631339457:3573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:59.751231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254590631339457:3573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:06:59.754258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254590631339457:3573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:06:59.759216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254590631339457:3573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:06:59.759230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254590631339457:3573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:06:59.759233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254590631339457:3573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:06:59.759240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:06:59.771152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:06:59.773190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:06:59.773432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:06:59.773442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:06:59.773453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:06:59.773500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:06:59.773539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254588254479514:3325]
2025-10-01T14:06:59.774102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:06:59.774492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:06:59.774550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:06:59.774879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:06:59.774950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.774960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.774961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.774963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.774964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.774965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.774966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.774967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.774969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.774970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.774971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.774972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.774973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.774974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.774980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.774989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.774992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.774996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.774999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.775002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.775005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.775008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.775011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.775015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.775018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.775022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.775026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.775029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.775037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.775045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:06:59.775051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.775056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:06:59.775063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.775067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:06:59.775071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.775076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:06:59.775081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.775086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:06:59.775092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.775097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:06:59.775102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.775108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:06:59.775112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.775118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:06:59.775122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.775127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:06:59.775131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.775137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.775141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.775146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.775150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.775157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.775162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.775167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:06:59.775172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.775177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:06:59.775219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:06:59.780269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:06:59.781293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:06:59.781304Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:06:59.781306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:06:59.781309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:06:59.781316Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 172 [2:7556254588254479514:3325]
2025-10-01T14:06:59.781331Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:06:59.781349Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:06:59.781353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.781357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.781360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.781375Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:06:59.781386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:06:59.781393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:06:59.781450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.781456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.781458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.781461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:06:59.781463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:06:59.781539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:06:59.781548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.781559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:06:59.781568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:06:59.781580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:06:59.781598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631339443:2446], now have 1 active actors on pipe
2025-10-01T14:06:59.781606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631339647:3573], now have 1 active actors on pipe
2025-10-01T14:06:59.781615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254588254479509:3325]
2025-10-01T14:06:59.781616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254588254479509:3325]
2025-10-01T14:06:59.781618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254588254479509:3325]
2025-10-01T14:06:59.781629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:06:59.781642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:06:59.781646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:06:59.781648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:06:59.781649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:06:59.781658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:06:59.781661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:06:59.781701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254588254479509:3325]
2025-10-01T14:06:59.781713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:06:59.781706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 172
2025-10-01T14:06:59.781745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:06:59.781764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 172
2025-10-01T14:06:59.781908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.781921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.781950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:06:59.781964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:06:59.781972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:06:59.781975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:06:59.781985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:06:59.782001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:06:59.782022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:59.782202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.782214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.782248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:06:59.782729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 173 partition: 0 MaxSeqNo: 45 sessionId: src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0
2025-10-01T14:06:59.783119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acd9fd3c-7fbd4f12-16764fb2-98aeefa1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:06:59.785600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0] Write session: try to update token
2025-10-01T14:06:59.785620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:06:59.802625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 173 sessionId: src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:06:59.803950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:06:59.803971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:06:59.803974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:06:59.803977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:06:59.803987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254588254479509:3325]
2025-10-01T14:06:59.803992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254588254479509:3325]
2025-10-01T14:06:59.803995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254588254479509:3325]
2025-10-01T14:06:59.804047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:06:59.804041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:06:59.804054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:06:59.804056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:06:59.804057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:06:59.804059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:06:59.804203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:06:59.805010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:06:59.839516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254590631339687:3127]
2025-10-01T14:06:59.839763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 172, pipe: [1:7556254590631339687:3127]
2025-10-01T14:06:59.963906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:06:59.964487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:06:59.964499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:06:59.964544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631339687:3127], now have 1 active actors on pipe
2025-10-01T14:06:59.966598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:06:59.966887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:06:59.966951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:06:59.966999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254590631339687:3127]
2025-10-01T14:06:59.967001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 173 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0
2025-10-01T14:06:59.967213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 173 sessionId: src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0 is DEAD
2025-10-01T14:06:59.970511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:06:59.970526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0] Write session will restart in 0.005132s
2025-10-01T14:06:59.970558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0] Write session: Do CDS request
2025-10-01T14:06:59.970566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:06:59.977949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.982474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:06:59.982491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 174
2025-10-01T14:06:59.983316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:06:59.983352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:06:59.983357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:06:59.983362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:06:59.983851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 174 sessionId:  describe result for acl check
2025-10-01T14:06:59.983878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:06:59.983881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:06:59.983883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:06:59.983889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254590631339701:3578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:06:59.984420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254590631339701:3578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:00.002613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254590631339701:3578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:00.015401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254590631339701:3578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:00.015420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254590631339701:3578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:00.015424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254590631339701:3578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:00.015433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:00.055737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:00.062220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:00.062533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:00.062544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:00.062560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:00.062632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:00.062678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254592549447050:3328]
2025-10-01T14:07:00.063278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:00.063702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:00.063764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:00.064140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:00.064209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.064215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.064217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.064218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.064219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.064221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.064222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.064223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.064225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.064226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.064228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.064229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.064231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.064232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.064238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.064249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.064253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.064258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.064262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.064266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.064270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.064274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.064278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.064282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.064286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.064290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.064294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.064298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.064306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.064314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.064322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.064327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.064334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.064339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.064344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.064349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.064355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.064361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.064365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.064372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.064377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.064382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.064387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.064392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.064397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.064403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.064407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.064413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.064417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.064423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.064427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.064433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.064437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.064443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.064447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.064453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.064498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:00.067342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254594926307215:3127]
2025-10-01T14:07:00.074245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:00.075040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:00.075047Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:00.075050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:00.075054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:00.075064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 173 [2:7556254592549447050:3328]
2025-10-01T14:07:00.075084Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:00.075107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:00.075110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.075114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.075117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.075134Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:00.075141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:00.075148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:00.075221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.075224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.075230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.075234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:00.075237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:00.075477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:00.075481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.075496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.075510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.075527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:00.075553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254592549447044:3328]
2025-10-01T14:07:00.075556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254592549447044:3328]
2025-10-01T14:07:00.075558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254592549447044:3328]
2025-10-01T14:07:00.075569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:00.075584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:00.075600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:00.075604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:00.075653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254592549447044:3328]
2025-10-01T14:07:00.075655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:00.075949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:00.075955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:00.075957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:00.075962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:00.077040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307089:3578], now have 1 active actors on pipe
2025-10-01T14:07:00.077051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254590631339693:2446], now have 1 active actors on pipe
2025-10-01T14:07:00.077054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307215:3127], now have 1 active actors on pipe
2025-10-01T14:07:00.077069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.077075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.077106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e3135b7-f37ec419-bc6fe195-36677785_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:00.077116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.077121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.077124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:00.077136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.077149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:00.077169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:00.077770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.077778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.077796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:00.076728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 173
2025-10-01T14:07:00.076756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 173
2025-10-01T14:07:00.076776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 173, pipe: [1:7556254594926307215:3127]
2025-10-01T14:07:00.077923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 174 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e3135b7-f37ec419-bc6fe195-36677785_0
2025-10-01T14:07:00.082345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bb7500d-1f345a93-94f37122-c7dca56a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e3135b7-f37ec419-bc6fe195-36677785_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:00.085240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3135b7-f37ec419-bc6fe195-36677785_0] Write session: try to update token
2025-10-01T14:07:00.085261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3135b7-f37ec419-bc6fe195-36677785_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:00.112008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 174 sessionId: src_id|6e3135b7-f37ec419-bc6fe195-36677785_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:00.114599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:00.114935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.114955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.114990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:00.115152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:00.120726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:00.120749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:00.120752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:00.120754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:00.120765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254592549447044:3328]
2025-10-01T14:07:00.120771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254592549447044:3328]
2025-10-01T14:07:00.120776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254592549447044:3328]
2025-10-01T14:07:00.120848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:00.120856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.120859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:00.121017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:00.122911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:00.122921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:00.122926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:00.322075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:00.332120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.332159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.332346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.332416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.332483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.332549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.332783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.332795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.332887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.332968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.333045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.333154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.333195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.333198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.333263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.333322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.333390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.333451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.333500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.333505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.333573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.333633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.333689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.333747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.333896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.333899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.333961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.334014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.334071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.334130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.334168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.334171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.334257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.334324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.334528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.334603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.334660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.334667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.334739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.334801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.334881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.334964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.335029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.335032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.335124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.335203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.335278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.335344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.335497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.335500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.335572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.335632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.335696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.335756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.335803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.335806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.335875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.335932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.335993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.336067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.336133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.336142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.336456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:00.336522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254594926307215:3127]
2025-10-01T14:07:00.336543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:00.336546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:00.336582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 174 reason: error at write: Disconnected sessionId: src_id|6e3135b7-f37ec419-bc6fe195-36677785_0
2025-10-01T14:07:00.336812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 174 sessionId: src_id|6e3135b7-f37ec419-bc6fe195-36677785_0 is DEAD
2025-10-01T14:07:00.337334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:00.341291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3135b7-f37ec419-bc6fe195-36677785_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:00.341305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3135b7-f37ec419-bc6fe195-36677785_0] Write session will restart in 0.005408s
2025-10-01T14:07:00.341334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3135b7-f37ec419-bc6fe195-36677785_0] Write session: Do CDS request
2025-10-01T14:07:00.341341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3135b7-f37ec419-bc6fe195-36677785_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:00.347961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3135b7-f37ec419-bc6fe195-36677785_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:00.354752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:00.354766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 175
2025-10-01T14:07:00.354974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:00.355006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:00.355011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:00.355015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:00.358803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 175 sessionId:  describe result for acl check
2025-10-01T14:07:00.358846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:00.358848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:00.358852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:00.358858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254594926307298:3583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:00.359378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254594926307298:3583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:00.365099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254594926307298:3583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:00.369343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254594926307298:3583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:00.369360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254594926307298:3583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:00.369363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254594926307298:3583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:00.369372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:00.371660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:00.373384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:00.373657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:00.373679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:00.373698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:00.373766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:00.373811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254592549447282:3331]
2025-10-01T14:07:00.374613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:00.375037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:00.375080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:00.375413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:00.375465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.375471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.375473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.375474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.375475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.375477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.375478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.375479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.375480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.375481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.375482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.375484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.375485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.375486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.375491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.375501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.375505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.375509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.375513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.375517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.375521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.375524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.375528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.375532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.375535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.375539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.375543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.375547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.375553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.375561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.375567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.375577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.375582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.375592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.375596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.375601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.375609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.375614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.375619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.375629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.375637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.375646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.375650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.375660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.375664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.375669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.375674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.375683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.375687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.375693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.375702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.375706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.375716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.375721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.375729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.375733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.375772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:00.382326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:00.383410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:00.383428Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:00.383431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:00.383434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:00.383442Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 174 [2:7556254592549447282:3331]
2025-10-01T14:07:00.383461Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:00.383480Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:00.383483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.383487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.383492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.383510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:00.383516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:00.383523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:00.383590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.383593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.383595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.383598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:00.383602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:00.383677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:00.383684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.383697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.383710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.383735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:00.383757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254592549447276:3331]
2025-10-01T14:07:00.383763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254592549447276:3331]
2025-10-01T14:07:00.383765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254592549447276:3331]
2025-10-01T14:07:00.383778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:00.383795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:00.383809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:00.383813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:00.383819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:00.383822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:00.383824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:00.383860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254592549447276:3331]
2025-10-01T14:07:00.383863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:00.383905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:00.384234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307458:3583], now have 1 active actors on pipe
2025-10-01T14:07:00.384239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307236:2446], now have 1 active actors on pipe
2025-10-01T14:07:00.385597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 174
2025-10-01T14:07:00.385627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 174
2025-10-01T14:07:00.386287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 175 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0
2025-10-01T14:07:00.388286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e3135b7-f37ec419-bc6fe195-36677785_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:00.385795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.385811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.385845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:00.385856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.385862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.385865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:00.385877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.385891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:00.385911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:00.386149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.386152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.386166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:00.390727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0] Write session: try to update token
2025-10-01T14:07:00.390742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:00.419583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 175 sessionId: src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:00.422118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:00.422590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.422616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.422671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:00.422807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:00.435971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254594926307469:3127]
2025-10-01T14:07:00.442560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:00.442583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:00.442586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:00.442588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:00.442599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254592549447276:3331]
2025-10-01T14:07:00.442604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254592549447276:3331]
2025-10-01T14:07:00.442608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254592549447276:3331]
2025-10-01T14:07:00.442666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:00.442674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.442677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:00.442832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:00.446601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:00.446619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:00.446622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:00.450691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 174, pipe: [1:7556254594926307469:3127]
2025-10-01T14:07:00.618524Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:00.626945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.626975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.627140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.627201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.627273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.627370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.627414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.627420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.627493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.627545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.627601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.627676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.627722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.627725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.627883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.627946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.628007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.628068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.628107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.628112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.628182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.628237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.628293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.628358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.628418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.628421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.628503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.628569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.628631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.628697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.628775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.628778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.628865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.628923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.628982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.629038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.629157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.629160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.629226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.629279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.629341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.629421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.629493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.629496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.629562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.629617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.629672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.629732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.629773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.629775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.629840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.629900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.629953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.630015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.630071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.630074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.630133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.630181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.630231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.630288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.630332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.630335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.631355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307469:3127], now have 1 active actors on pipe
2025-10-01T14:07:00.632067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254594926307469:3127]
2025-10-01T14:07:00.632066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:00.632070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:00.632094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:00.632098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 175 reason: error at write: Disconnected sessionId: src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0
2025-10-01T14:07:00.632431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:00.632841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 175 sessionId: src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0 is DEAD
2025-10-01T14:07:00.634755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:00.634767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0] Write session will restart in 0.005304s
2025-10-01T14:07:00.634793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0] Write session: Do CDS request
2025-10-01T14:07:00.634798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:00.642934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:00.643095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:00.643112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 176
2025-10-01T14:07:00.643275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:00.643328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:00.643338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:00.643342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:00.643855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 176 sessionId:  describe result for acl check
2025-10-01T14:07:00.643895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:00.643901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:00.643903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:00.643910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254594926307495:3588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:00.644456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254594926307495:3588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:00.646186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254594926307495:3588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:00.650054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254594926307495:3588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:00.650069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254594926307495:3588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:00.650072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254594926307495:3588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:00.650081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:00.660257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:00.662527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:00.662739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:00.662743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:00.662753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:00.662809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:00.662844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254592549447519:3334]
2025-10-01T14:07:00.663411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:00.666837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:00.666914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:00.667329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:00.667396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.667403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.667404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.667405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.667407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.667408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.667409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.667410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.667412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.667413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.667414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.667416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.667417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.667418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.667426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.667437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.667441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.667445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.667449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.667454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.667458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.667462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.667465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.667470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.667473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.667477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.667480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.667484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.667492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.667501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.667508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.667514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.667519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.667529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.667545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.667552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.667559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.667565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.667571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.667579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.667584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.667589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.667593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.667598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.667603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.667608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.667612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.667617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.667622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.667628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.667633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.667641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.667646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.667651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.667655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.667661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.667701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:00.677429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 175
2025-10-01T14:07:00.677467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 175
2025-10-01T14:07:00.676074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:00.676931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:00.676938Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:00.676941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:00.676945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:00.676953Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 175 [2:7556254592549447519:3334]
2025-10-01T14:07:00.676972Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:00.676990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:00.676995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.676999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.677002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.677020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:00.677026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:00.677033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:00.677101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.677104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.677106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.677110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:00.677113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:00.677272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:00.677276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.677292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.677305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.677324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:00.677345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307565:3588], now have 1 active actors on pipe
2025-10-01T14:07:00.677349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307481:2446], now have 1 active actors on pipe
2025-10-01T14:07:00.677357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254592549447514:3334]
2025-10-01T14:07:00.677361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254592549447514:3334]
2025-10-01T14:07:00.677364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254592549447514:3334]
2025-10-01T14:07:00.677380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:00.677394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:00.677397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:00.677400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:00.677402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:00.677411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:00.677414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:00.677458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254592549447514:3334]
2025-10-01T14:07:00.677465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:00.677523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:00.677760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.677767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.677796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:00.677804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:00.677808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:00.677810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:00.677820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:00.677830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:00.677848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:00.678155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.678158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.678173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:00.679127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 176 partition: 0 MaxSeqNo: 45 sessionId: src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0
2025-10-01T14:07:00.679798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b0d59e2-c6f4f016-ddcf0763-8c69c061_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:00.682729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0] Write session: try to update token
2025-10-01T14:07:00.682748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:00.721549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 176 sessionId: src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:00.724187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:00.726637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.726661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.726705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:00.726885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:00.734116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:00.734138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:00.734141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:00.734143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:00.734154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254592549447514:3334]
2025-10-01T14:07:00.734159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254592549447514:3334]
2025-10-01T14:07:00.734163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254592549447514:3334]
2025-10-01T14:07:00.734215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:00.734222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.734224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:00.734363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:00.734434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254594926307719:3127]
2025-10-01T14:07:00.734562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:00.734571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:00.734575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:00.754666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 175, pipe: [1:7556254594926307719:3127]
2025-10-01T14:07:00.928380Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:00.928955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307719:3127], now have 1 active actors on pipe
2025-10-01T14:07:00.937166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:00.937193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:00.937379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.937453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.937524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.937594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.937646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.937655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.937732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.937796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.937864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.937934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.937992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.937999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.938061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.938117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.938178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.938241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.938287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.938294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.938355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.938482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.938540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.938602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.938649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.938669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.938740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.938803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.938872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.938933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.938993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.939002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.939087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.939151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.939212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.939282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.939333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.939336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.939410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.939472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.939533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.939599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.939647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.939649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.939736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.939804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.939861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.939923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.939967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.939969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.940036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.940088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.940143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.940208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.940249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.940251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.940319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:00.940378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:00.940439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:00.940507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:00.940559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:00.940561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:00.943007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254594926307719:3127]
2025-10-01T14:07:00.943048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:00.943051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:00.943081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 176 reason: error at write: Disconnected sessionId: src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0
2025-10-01T14:07:00.943310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 176 sessionId: src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0 is DEAD
2025-10-01T14:07:00.943586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:00.943750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:00.946606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:00.946620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0] Write session will restart in 0.007809s
2025-10-01T14:07:00.946648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0] Write session: Do CDS request
2025-10-01T14:07:00.946656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:00.957646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:00.963634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:00.963648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 177
2025-10-01T14:07:00.963936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:00.963977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:00.963982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:00.963986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:00.965475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 177 sessionId:  describe result for acl check
2025-10-01T14:07:00.965524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:00.965526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:00.965528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:00.965535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254594926307785:3600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:00.966052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254594926307785:3600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:00.973303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254594926307785:3600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:00.989824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254594926307785:3600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:00.989842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254594926307785:3600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:00.989847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254594926307785:3600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:00.989889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:00.994255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:00.996140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:00.996363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:00.996368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:00.996380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:00.996432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:00.996466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254592549447799:3349]
2025-10-01T14:07:00.997134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:00.997554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:00.997598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:00.997907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:00.997959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.997960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.997962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.997963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.997964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.997965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.997966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.997967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.997968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.997969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.997970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.997971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.997972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.997974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.997979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.997989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.997994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.997998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.998001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.998005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.998009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.998013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.998017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.998021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.998025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.998029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.998033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.998036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.998044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.998052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:00.998059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.998065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:00.998069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.998075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:00.998079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.998086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:00.998091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.998097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:00.998101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.998106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:00.998111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.998117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:00.998121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.998126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:00.998130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.998135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:00.998139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.998145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:00.998152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.998161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:00.998165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.998170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:00.998175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.998180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:00.998184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.998189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:00.998221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:01.003368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:01.004002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:01.004008Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:01.004011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:01.004015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:01.004024Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 176 [2:7556254592549447799:3349]
2025-10-01T14:07:01.004042Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:01.004060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:01.004064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.004068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.004071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.004092Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:01.004098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:01.004105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:01.004170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.004172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.004174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.004177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:01.004180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:01.004258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:01.004261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.004273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.004284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.004298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:01.004316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254592549447793:3349]
2025-10-01T14:07:01.004318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254592549447793:3349]
2025-10-01T14:07:01.004321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254592549447793:3349]
2025-10-01T14:07:01.004335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:01.004348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:01.004361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:01.004364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:01.004402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254592549447793:3349]
2025-10-01T14:07:01.004405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:01.004660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:01.004667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:01.004670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:01.004674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:01.005565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 176
2025-10-01T14:07:01.005596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 176
2025-10-01T14:07:01.005889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307977:3600], now have 1 active actors on pipe
2025-10-01T14:07:01.005900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254594926307758:2446], now have 1 active actors on pipe
2025-10-01T14:07:01.005915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.005922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.005953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:01.005963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.005968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.005971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:01.005982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.005996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:01.006014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:01.006325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.006332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.006350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:01.006504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 177 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0
2025-10-01T14:07:01.010093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e232ff-771eb516-cd1568fd-2f9f5913_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:01.014026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0] Write session: try to update token
2025-10-01T14:07:01.014056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:01.040793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:01.040812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:01.040814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:01.040816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:01.040827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254592549447793:3349]
2025-10-01T14:07:01.040844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254592549447793:3349]
2025-10-01T14:07:01.040848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254592549447793:3349]
2025-10-01T14:07:01.040901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:01.040909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.040912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:01.041063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:01.042583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:01.042594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:01.042598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:01.043484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254599221275292:3127]
2025-10-01T14:07:01.047255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 176, pipe: [1:7556254599221275292:3127]
2025-10-01T14:07:01.063114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 177 sessionId: src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:01.065820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:01.296869Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:01.298183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221275292:3127], now have 1 active actors on pipe
2025-10-01T14:07:01.298248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.298259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.300319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:01.303509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:01.303523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:01.303615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 177 reason: error at write: Disconnected sessionId: src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0
2025-10-01T14:07:01.303839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 177 sessionId: src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0 is DEAD
2025-10-01T14:07:01.304046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:01.304102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254599221275292:3127]
2025-10-01T14:07:01.304663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:01.304677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0] Write session will restart in 0.009988s
2025-10-01T14:07:01.304716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0] Write session: Do CDS request
2025-10-01T14:07:01.304723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:01.318180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:01.318683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:01.318697Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 178
2025-10-01T14:07:01.318936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:01.318982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:01.318988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:01.318994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:01.323202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 178 sessionId:  describe result for acl check
2025-10-01T14:07:01.323244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:01.323245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:01.323247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:01.323254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254599221275322:3605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:01.323792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254599221275322:3605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:01.338666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254599221275322:3605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:01.357872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:01.358871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254599221275322:3605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:01.358888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254599221275322:3605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:01.358892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254599221275322:3605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:01.358901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:01.360582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:01.360888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:01.360892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:01.360907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:01.360991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:01.361037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254596844415330:3352]
2025-10-01T14:07:01.361609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:01.362093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:01.362156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:01.362528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:01.362597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.362598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.362600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.362600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.362601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.362603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.362604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.362605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.362607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.362608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.362609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.362610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.362611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.362612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.362617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.362626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.362629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.362633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.362636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.362640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.362644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.362648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.362652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.362655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.362658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.362661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.362664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.362667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.362673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.362679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.362685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.362690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.362694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.362699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.362703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.362708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.362712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.362717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.362721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.362725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.362730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.362736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.362740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.362744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.362748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.362753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.362756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.362760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.362771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.362790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.362795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.362800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.362804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.362809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.362812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.362817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.362852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:01.377982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:01.380027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 177
2025-10-01T14:07:01.380073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 177
2025-10-01T14:07:01.379040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:01.379057Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:01.379060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:01.379063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:01.379071Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 177 [2:7556254596844415330:3352]
2025-10-01T14:07:01.379090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:01.379110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:01.379114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.379118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.379120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.379139Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:01.379145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:01.379152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:01.379229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.379231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.379233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.379237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:01.379239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:01.379341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:01.379345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.379357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.379367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.379383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:01.379402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254596844415323:3352]
2025-10-01T14:07:01.379405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254596844415323:3352]
2025-10-01T14:07:01.379407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254596844415323:3352]
2025-10-01T14:07:01.379423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:01.379440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:01.379456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:01.379459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:01.379503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254596844415323:3352]
2025-10-01T14:07:01.379506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:01.379626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:01.379628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:01.379630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:01.379634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:01.382332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221275306:2446], now have 1 active actors on pipe
2025-10-01T14:07:01.382346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221275533:3605], now have 1 active actors on pipe
2025-10-01T14:07:01.382388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.382395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.382434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77d244f-65b881fe-db6ade57-400a0379_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:01.382447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.382454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.382457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:01.382469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.382485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:01.382518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:01.386435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.386461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.386504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:01.388319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 178 partition: 0 MaxSeqNo: 45 sessionId: src_id|77d244f-65b881fe-db6ade57-400a0379_0
2025-10-01T14:07:01.388749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b04ca5a-a175eb6d-b7151d84-242d4981_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|77d244f-65b881fe-db6ade57-400a0379_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:01.392342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d244f-65b881fe-db6ade57-400a0379_0] Write session: try to update token
2025-10-01T14:07:01.392364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d244f-65b881fe-db6ade57-400a0379_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:01.403156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254599221275543:3127]
2025-10-01T14:07:01.406771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 177, pipe: [1:7556254599221275543:3127]
2025-10-01T14:07:01.411091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 178 sessionId: src_id|77d244f-65b881fe-db6ade57-400a0379_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:01.413836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:01.410430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221275543:3127], now have 1 active actors on pipe
2025-10-01T14:07:01.414629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.414646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.414800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:01.414685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:01.424623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:01.424641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:01.424644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:01.424646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:01.424656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254596844415323:3352]
2025-10-01T14:07:01.424660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254596844415323:3352]
2025-10-01T14:07:01.424663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254596844415323:3352]
2025-10-01T14:07:01.424712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:01.424720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.424722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:01.424868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:01.426566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:01.426576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:01.426580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:01.591359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:01.599937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.599970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.600148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.600212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.600275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.600340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.600391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.600401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.600465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.600530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.600589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.600670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.600714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.600727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.600786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.600847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.600904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.600961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.601089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.601098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.601153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.601204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.601259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.601318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.601368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.601375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.601433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.601490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.601558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.601615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.601667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.601679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.601795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.601890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.601954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.602016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.602064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.602072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.602141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.602198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.602263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.602334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.602413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.602423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.602506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.602592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.602660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.602725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.602780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.602788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.602863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.602923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.602983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.603041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.603163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.603172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.603237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.603300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.603364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.603441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.603505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.603513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.603944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:01.603969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254599221275543:3127]
2025-10-01T14:07:01.604030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:01.604041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:01.604071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 178 reason: error at write: Disconnected sessionId: src_id|77d244f-65b881fe-db6ade57-400a0379_0
2025-10-01T14:07:01.604237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 178 sessionId: src_id|77d244f-65b881fe-db6ade57-400a0379_0 is DEAD
2025-10-01T14:07:01.604413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d244f-65b881fe-db6ade57-400a0379_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:01.604423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d244f-65b881fe-db6ade57-400a0379_0] Write session will restart in 0.009430s
2025-10-01T14:07:01.604450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d244f-65b881fe-db6ade57-400a0379_0] Write session: Do CDS request
2025-10-01T14:07:01.604457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d244f-65b881fe-db6ade57-400a0379_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:01.604753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:01.614930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d244f-65b881fe-db6ade57-400a0379_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:01.615067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:01.615083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 179
2025-10-01T14:07:01.615191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:01.615222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:01.615232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:01.615235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:01.615855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 179 sessionId:  describe result for acl check
2025-10-01T14:07:01.615913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:01.615923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:01.615926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:01.615932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254599221275574:3610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:01.616518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254599221275574:3610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:01.620978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254599221275574:3610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:01.624524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254599221275574:3610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:01.624539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254599221275574:3610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:01.624543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254599221275574:3610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:01.624552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:01.628707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:01.629978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:01.630242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:01.630256Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:01.630271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:01.630342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:01.630399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254596844415567:3355]
2025-10-01T14:07:01.630958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:01.631259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:01.631303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:01.631624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:01.631684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.631694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.631695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.631696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.631697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.631699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.631700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.631701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.631702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.631703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.631705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.631706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.631708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.631709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.631715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.631724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.631728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.631733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.631737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.631741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.631746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.631750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.631754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.631759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.631763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.631767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.631771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.631775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.631783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.631789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.631795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.631800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.631804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.631809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.631813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.631824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.631828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.631832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.631837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.631842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.631846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.631851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.631855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.631859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.631863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.631873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.631878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.631887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.631891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.631896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.631905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.631910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.631913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.631918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.631922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.631927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.631969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:01.637575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:01.638347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:01.638358Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:01.638360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:01.638362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:01.638368Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 178 [2:7556254596844415567:3355]
2025-10-01T14:07:01.638399Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:01.638416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:01.638420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.638422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.638424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.638436Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:01.638441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:01.638446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:01.638509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.638517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.638519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.638522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:01.638524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:01.638607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:01.638616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.638628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.638637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.638651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:01.638674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221275760:3610], now have 1 active actors on pipe
2025-10-01T14:07:01.638678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221275551:2446], now have 1 active actors on pipe
2025-10-01T14:07:01.638686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254596844415562:3355]
2025-10-01T14:07:01.638692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254596844415562:3355]
2025-10-01T14:07:01.638694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254596844415562:3355]
2025-10-01T14:07:01.638709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:01.638721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:01.638728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:01.638732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:01.638735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:01.638738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:01.638741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:01.638775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254596844415562:3355]
2025-10-01T14:07:01.638788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:01.638817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:01.638772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 178
2025-10-01T14:07:01.638778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 178
2025-10-01T14:07:01.638888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.638902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.638927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:01.638938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.638942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.638949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:01.638959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.638972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:01.638991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:01.639180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.639194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.639220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:01.639326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 179 partition: 0 MaxSeqNo: 45 sessionId: src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0
2025-10-01T14:07:01.639726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d244f-65b881fe-db6ade57-400a0379_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:01.642177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0] Write session: try to update token
2025-10-01T14:07:01.642195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:01.658470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 179 sessionId: src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:01.661059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:01.661631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.661657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.661681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:01.661685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:01.661695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254596844415562:3355]
2025-10-01T14:07:01.661757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:01.661915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:01.661954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:01.662151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:01.662321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:01.662535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:01.662756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:01.662811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:01.662839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:01.662959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:01.687641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:01.687662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:01.687665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:01.687667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:01.687677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254596844415562:3355]
2025-10-01T14:07:01.687681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254596844415562:3355]
2025-10-01T14:07:01.687685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254596844415562:3355]
2025-10-01T14:07:01.687748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:01.687758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.687761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:01.687759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:01.687779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:01.687784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:01.687905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:01.704726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254599221275792:3127]
2025-10-01T14:07:01.705141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 178, pipe: [1:7556254599221275792:3127]
2025-10-01T14:07:01.840063Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:01.849418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.849452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.849649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.849727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.849795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.849863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.849907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.849912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.849992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.850054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.850117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.850185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.850233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.850236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.850307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.850366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.850583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.853297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:01.853311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:01.853343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 179 reason: error at write: Disconnected sessionId: src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0
2025-10-01T14:07:01.853540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 179 sessionId: src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0 is DEAD
2025-10-01T14:07:01.853732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:01.853775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254599221275792:3127]
2025-10-01T14:07:01.853983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:01.853993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0] Write session will restart in 0.005438s
2025-10-01T14:07:01.854018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0] Write session: Do CDS request
2025-10-01T14:07:01.854024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:01.850673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.850742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.850746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.850855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.850918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.850996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.851068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.851113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.851117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.851189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.851254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.851318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.851383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.851424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.851427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.851503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.851561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.851619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.851683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.851750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.851754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.851824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.851878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.851951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.852018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.852067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.852070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.852136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.852194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.852257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.852319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.852361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.852363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.852432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.852489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.852550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.852610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.852650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.852653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.852724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:01.852776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:01.852849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:01.852907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:01.853000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:01.853002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:01.853072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221275792:3127], now have 1 active actors on pipe
2025-10-01T14:07:01.854498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:01.860916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:01.861034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:01.861048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 180
2025-10-01T14:07:01.861161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:01.861200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:01.861209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:01.861212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:01.861564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 180 sessionId:  describe result for acl check
2025-10-01T14:07:01.861596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:01.861599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:01.861601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:01.861605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254599221275824:3615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:01.862099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254599221275824:3615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:01.864426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254599221275824:3615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:01.868047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254599221275824:3615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:01.868061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254599221275824:3615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:01.868063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254599221275824:3615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:01.868072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:01.874592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:01.875722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:01.875912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:01.875921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:01.875932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:01.875991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:01.876029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254596844415843:3368]
2025-10-01T14:07:01.876571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:01.876844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:01.876892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:01.877200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:01.877251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.877257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.877258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.877260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.877261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.877262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.877263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.877264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.877265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.877267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.877268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.877269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.877270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.877271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.877276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.877285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.877289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.877293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.877297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.877300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.877304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.877308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.877311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.877316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.877320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.877323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.877327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.877330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.877336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.877343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:01.877348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.877353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:01.877357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.877362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:01.877366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.877371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:01.877375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.877380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:01.877384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.877388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:01.877393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.877397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:01.877401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.877406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:01.877411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.877415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:01.877419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.877424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.877428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.877432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.877436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.877441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.877445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.877449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:01.877456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.877467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:01.877504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:01.882924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:01.883618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:01.883631Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:01.883633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:01.883637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:01.883646Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 179 [2:7556254596844415843:3368]
2025-10-01T14:07:01.883661Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:01.883677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:01.883683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.883687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.883690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.883706Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:01.883715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:01.883720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:01.883776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.883785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.883786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.883790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:01.883792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:01.883859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:01.883867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.883877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:01.883887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:01.883904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:01.883924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254596844415838:3368]
2025-10-01T14:07:01.883927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254596844415838:3368]
2025-10-01T14:07:01.883929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254596844415838:3368]
2025-10-01T14:07:01.883940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:01.883951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:01.883954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:01.883956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:01.883956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:01.883969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:01.883972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:01.884005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254596844415838:3368]
2025-10-01T14:07:01.884007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:01.884134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 179
2025-10-01T14:07:01.884023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:01.884166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 179
2025-10-01T14:07:01.884036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221275810:2446], now have 1 active actors on pipe
2025-10-01T14:07:01.884039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221275935:3615], now have 1 active actors on pipe
2025-10-01T14:07:01.884293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.884303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.884326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7088787-8d3e98d8-cfb04681-448829fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:01.884339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:01.884343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:01.884345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:01.884354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:01.884363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:01.884383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:01.884571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.884577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.884590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:01.884672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 180 partition: 0 MaxSeqNo: 45 sessionId: src_id|e7088787-8d3e98d8-cfb04681-448829fe_0
2025-10-01T14:07:01.886778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2e7a5-74afbb35-533893f9-52232c9d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e7088787-8d3e98d8-cfb04681-448829fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:01.889295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7088787-8d3e98d8-cfb04681-448829fe_0] Write session: try to update token
2025-10-01T14:07:01.889316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7088787-8d3e98d8-cfb04681-448829fe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:01.910033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 180 sessionId: src_id|e7088787-8d3e98d8-cfb04681-448829fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:01.912464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:01.913095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:01.913130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:01.913151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:01.913154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:01.913157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:01.913159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:01.913167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254596844415838:3368]
2025-10-01T14:07:01.913172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254596844415838:3368]
2025-10-01T14:07:01.913177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254596844415838:3368]
2025-10-01T14:07:01.913226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:01.913235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:01.913239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:01.913242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:01.913243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:01.913245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:01.913406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:01.954077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254599221276070:3127]
2025-10-01T14:07:01.954315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 179, pipe: [1:7556254599221276070:3127]
2025-10-01T14:07:02.072964Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:02.073236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:02.073297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254599221276070:3127], now have 1 active actors on pipe
2025-10-01T14:07:02.074973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:02.075064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:02.075066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:02.075136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 180 reason: error at write: Disconnected sessionId: src_id|e7088787-8d3e98d8-cfb04681-448829fe_0
2025-10-01T14:07:02.075292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 180 sessionId: src_id|e7088787-8d3e98d8-cfb04681-448829fe_0 is DEAD
2025-10-01T14:07:02.075451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254599221276070:3127]
2025-10-01T14:07:02.075465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:02.075664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7088787-8d3e98d8-cfb04681-448829fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:02.075675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7088787-8d3e98d8-cfb04681-448829fe_0] Write session will restart in 0.006448s
2025-10-01T14:07:02.075701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7088787-8d3e98d8-cfb04681-448829fe_0] Write session: Do CDS request
2025-10-01T14:07:02.075712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7088787-8d3e98d8-cfb04681-448829fe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:02.087025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7088787-8d3e98d8-cfb04681-448829fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:02.087465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:02.087480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 181
2025-10-01T14:07:02.087662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:02.087685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:02.087688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:02.087692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:02.088223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 181 sessionId:  describe result for acl check
2025-10-01T14:07:02.088250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:02.088251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:02.088253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:02.088257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254603516243380:3628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:02.088869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254603516243380:3628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:02.093787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254603516243380:3628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:02.108541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254603516243380:3628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:02.108562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254603516243380:3628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:02.108566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254603516243380:3628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:02.108575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:02.121856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:02.128031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:02.128293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:02.128320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:02.128332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:02.128393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:02.128450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254601139383381:3372]
2025-10-01T14:07:02.129153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:02.129553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:02.129609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:02.129941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:02.130024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.130026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.130028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.130029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.130031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.130032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.130034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.130035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.130036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.130038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.130039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.130041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.130042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.130044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.130049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.130059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.130063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.130068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.130072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.130076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.130079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.130083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.130087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.130093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.130097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.130100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.130103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.130107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.130115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.130123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.130129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.130136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.130141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.130147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.130152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.130157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.130162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.130168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.130173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.130179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.130186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.130190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.130195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.130201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.130209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.130214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.130220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.130225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.130230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.130236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.130240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.130246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.130252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.130257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.130261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.130267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.130328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:02.136502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:02.137408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:02.137427Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:02.137431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:02.137436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:02.137443Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 180 [2:7556254601139383381:3372]
2025-10-01T14:07:02.137464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:02.137483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:02.137492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.137496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.137498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.137515Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:02.137525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:02.137533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:02.137832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 180
2025-10-01T14:07:02.137610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.137622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.137624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.137627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:02.137630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:02.137700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:02.137703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.137718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.137730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.137747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:02.137766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516243464:3628], now have 1 active actors on pipe
2025-10-01T14:07:02.137770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516243372:2446], now have 1 active actors on pipe
2025-10-01T14:07:02.137776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254601139383376:3372]
2025-10-01T14:07:02.137779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254601139383376:3372]
2025-10-01T14:07:02.137781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254601139383376:3372]
2025-10-01T14:07:02.137796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:02.137810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:02.137828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:02.137832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:02.137871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254601139383376:3372]
2025-10-01T14:07:02.137873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:02.138183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:02.138195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:02.138197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:02.138205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:02.138301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.138309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.138339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:02.138352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.138358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.138365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:02.138394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.138411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:02.138431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:02.138784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.138799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.138820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:02.137896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 180
2025-10-01T14:07:02.138934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 181 partition: 0 MaxSeqNo: 45 sessionId: src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0
2025-10-01T14:07:02.139380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7088787-8d3e98d8-cfb04681-448829fe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:02.142062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0] Write session: try to update token
2025-10-01T14:07:02.142085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:02.163768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 181 sessionId: src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:02.166940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:02.170950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.170976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.173276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:02.173315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:02.173319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:02.173321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:02.173323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:02.173334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254601139383376:3372]
2025-10-01T14:07:02.173338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254601139383376:3372]
2025-10-01T14:07:02.173343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254601139383376:3372]
2025-10-01T14:07:02.173381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:02.173388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:02.173388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:02.173394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:02.173396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.173399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:02.173545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:02.173587Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:02.182478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254603516243624:3127]
2025-10-01T14:07:02.182814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 180, pipe: [1:7556254603516243624:3127]
2025-10-01T14:07:02.388091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:02.388694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516243624:3127], now have 1 active actors on pipe
2025-10-01T14:07:02.397750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.397783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.397963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.398021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.398086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.398145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.398193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.398198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.398270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.398357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.401477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254603516243624:3127]
2025-10-01T14:07:02.401502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:02.401555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:02.401560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:02.401596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 181 reason: error at write: Disconnected sessionId: src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0
2025-10-01T14:07:02.401800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 181 sessionId: src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0 is DEAD
2025-10-01T14:07:02.398512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.398580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.398637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.398642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.398704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.398776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.398834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.398889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.398931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.398934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.399002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.399058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.399114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.399168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.399213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.399216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.399275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.399331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.399384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.399465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.399504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.399507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.399581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.399645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.399702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.399757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.399820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.399823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.399897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.399955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.400018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.400102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.400158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.400161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.400252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.400322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.400387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.400448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.400519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.400523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.400588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.400652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.400726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.400792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.400866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.400869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.400936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:02.400994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:02.401052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:02.401123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:02.401180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:02.401185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:02.402782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:02.402793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0] Write session will restart in 0.005517s
2025-10-01T14:07:02.402820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0] Write session: Do CDS request
2025-10-01T14:07:02.402826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:02.402979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:02.410403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:02.410758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:02.410775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 182
2025-10-01T14:07:02.410947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:02.410983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:02.410994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:02.411007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:02.411558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 182 sessionId:  describe result for acl check
2025-10-01T14:07:02.411613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:02.411614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:02.411616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:02.411622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254603516243634:3633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:02.412181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254603516243634:3633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:02.416285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254603516243634:3633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:02.426622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254603516243634:3633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:02.426644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254603516243634:3633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:02.426648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254603516243634:3633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:02.426657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:02.432945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:02.433708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:02.433904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:02.433912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:02.433923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:02.433971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:02.434006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254601139383621:3375]
2025-10-01T14:07:02.434613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:02.434963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:02.435002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:02.435292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:02.435361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.435367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.435368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.435369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.435370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.435371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.435372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.435374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.435375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.435376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.435377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.435378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.435379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.435380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.435385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.435395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.435398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.435402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.435406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.435409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.435412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.435416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.435419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.435425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.435429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.435432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.435436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.435440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.435447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.435453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.435459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.435464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.435469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.435478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.435482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.435491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.435496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.435504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.435508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.435518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.435522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.435530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.435535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.435545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.435549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.435558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.435562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.435568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.435576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.435580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.435586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.435591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.435596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.435600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.435604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.435612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.435652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:02.443228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:02.443844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:02.443859Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:02.443862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:02.443866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:02.443873Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 181 [2:7556254601139383621:3375]
2025-10-01T14:07:02.443892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:02.443911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:02.443915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.443920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.443922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.443940Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:02.443952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:02.443964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:02.444023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.444029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.444031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.444036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:02.444039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:02.444111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:02.444119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.444131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.444141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.444157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:02.444180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516243627:2446], now have 1 active actors on pipe
2025-10-01T14:07:02.444187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516243792:3633], now have 1 active actors on pipe
2025-10-01T14:07:02.444196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254601139383615:3375]
2025-10-01T14:07:02.444198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254601139383615:3375]
2025-10-01T14:07:02.444201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254601139383615:3375]
2025-10-01T14:07:02.444215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:02.444233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:02.444252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:02.444259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:02.444296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254601139383615:3375]
2025-10-01T14:07:02.444304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:02.444282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 181
2025-10-01T14:07:02.444320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 181
2025-10-01T14:07:02.444399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:02.444410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:02.444415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:02.444421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:02.444724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.444737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.444779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db9b9029-474b6025-435aae87-88fee2c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:02.444788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.444793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.444795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:02.444805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.444817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:02.444845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:02.445721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.445735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.445756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:02.446538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 182 partition: 0 MaxSeqNo: 45 sessionId: src_id|db9b9029-474b6025-435aae87-88fee2c7_0
2025-10-01T14:07:02.447006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecdf0f9d-50c14158-e205939a-650b8a3f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db9b9029-474b6025-435aae87-88fee2c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:02.450471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db9b9029-474b6025-435aae87-88fee2c7_0] Write session: try to update token
2025-10-01T14:07:02.450494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db9b9029-474b6025-435aae87-88fee2c7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:02.467702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:02.467726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:02.467729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:02.467731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:02.467742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254601139383615:3375]
2025-10-01T14:07:02.467748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254601139383615:3375]
2025-10-01T14:07:02.467753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254601139383615:3375]
2025-10-01T14:07:02.467797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:02.467806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:02.467809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:02.467813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:02.467814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.467817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:02.467966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:02.472963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 182 sessionId: src_id|db9b9029-474b6025-435aae87-88fee2c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:02.475577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:02.501413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254603516243871:3127]
2025-10-01T14:07:02.510700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 181, pipe: [1:7556254603516243871:3127]
2025-10-01T14:07:02.670253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:02.670657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.670673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.670717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516243871:3127], now have 1 active actors on pipe
2025-10-01T14:07:02.670961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:02.672297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9b9029-474b6025-435aae87-88fee2c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:02.672308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9b9029-474b6025-435aae87-88fee2c7_0] Write session will restart in 0.007067s
2025-10-01T14:07:02.672330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9b9029-474b6025-435aae87-88fee2c7_0] Write session: Do CDS request
2025-10-01T14:07:02.672334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9b9029-474b6025-435aae87-88fee2c7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:02.671067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:02.671081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:02.671142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 182 reason: error at write: Disconnected sessionId: src_id|db9b9029-474b6025-435aae87-88fee2c7_0
2025-10-01T14:07:02.671334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 182 sessionId: src_id|db9b9029-474b6025-435aae87-88fee2c7_0 is DEAD
2025-10-01T14:07:02.671794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:02.671821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254603516243871:3127]
2025-10-01T14:07:02.681372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db9b9029-474b6025-435aae87-88fee2c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:02.683922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:02.683937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 183
2025-10-01T14:07:02.684110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:02.684140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:02.684146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:02.684150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:02.684559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 183 sessionId:  describe result for acl check
2025-10-01T14:07:02.684588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:02.684590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:02.684592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:02.684598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254603516243932:3638] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:02.685140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254603516243932:3638] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:02.690160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254603516243932:3638] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:02.700560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254603516243932:3638] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:02.700576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254603516243932:3638] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:02.700579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254603516243932:3638] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:02.700589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:02.705505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:02.707596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:02.707797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:02.707801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:02.707810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:02.707851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:02.707884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254601139383860:3378]
2025-10-01T14:07:02.708469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:02.708752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:02.708791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:02.709097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:02.709149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.709154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.709156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.709157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.709157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.709159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.709160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.709161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.709162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.709163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.709165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.709166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.709167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.709168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.709173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.709182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.709186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.709190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.709193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.709197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.709200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.709202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.709206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.709209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.709213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.709216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.709220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.709223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.709229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.709236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.709242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.709247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.709251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.709256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.709259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.709264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.709269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.709273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.709277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.709281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.709286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.709290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.709294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.709298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.709302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.709307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.709310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.709315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.709318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.709323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.709328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.709340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.709345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.709355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.709361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.709365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.709405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:02.713768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:02.714498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:02.714512Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:02.714514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:02.714518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:02.714525Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 182 [2:7556254601139383860:3378]
2025-10-01T14:07:02.714542Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:02.714558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:02.714561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.714565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.714569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.714585Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:02.714594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:02.714600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:02.714653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.714659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.714661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.714665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:02.714667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:02.714741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:02.714750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.714762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.714772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.714789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:02.714811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516243876:2446], now have 1 active actors on pipe
2025-10-01T14:07:02.714819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516244093:3638], now have 1 active actors on pipe
2025-10-01T14:07:02.714827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254601139383854:3378]
2025-10-01T14:07:02.714829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254601139383854:3378]
2025-10-01T14:07:02.714830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254601139383854:3378]
2025-10-01T14:07:02.714844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:02.714859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:02.714872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:02.714875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:02.714901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254601139383854:3378]
2025-10-01T14:07:02.714903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:02.715006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:02.715015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:02.715018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:02.715023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:02.715689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.715702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.715729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:02.715741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.715746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.715748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:02.715758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.715775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:02.715797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:02.715980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.715988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.716001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:02.716508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db9b9029-474b6025-435aae87-88fee2c7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:02.714880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 182
2025-10-01T14:07:02.714936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 182
2025-10-01T14:07:02.716092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 183 partition: 0 MaxSeqNo: 45 sessionId: src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0
2025-10-01T14:07:02.722833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0] Write session: try to update token
2025-10-01T14:07:02.722854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:02.745688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:02.745709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:02.745712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:02.745714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:02.745725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254601139383854:3378]
2025-10-01T14:07:02.745730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254601139383854:3378]
2025-10-01T14:07:02.745734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254601139383854:3378]
2025-10-01T14:07:02.745791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:02.745801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.745809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:02.745807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:02.745819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:02.745824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:02.745979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:02.746849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 183 sessionId: src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:02.749566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:02.774757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254603516244118:3127]
2025-10-01T14:07:02.775205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 182, pipe: [1:7556254603516244118:3127]
2025-10-01T14:07:02.906970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:02.907752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.907773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.907816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516244118:3127], now have 1 active actors on pipe
2025-10-01T14:07:02.914644Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:02.914801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:02.914839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:02.914901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 183 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0
2025-10-01T14:07:02.915056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 183 sessionId: src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0 is DEAD
2025-10-01T14:07:02.915285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254603516244118:3127]
2025-10-01T14:07:02.922495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:02.922512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0] Write session will restart in 0.006635s
2025-10-01T14:07:02.922543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0] Write session: Do CDS request
2025-10-01T14:07:02.922549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:02.930063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:02.930353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:02.930385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 184
2025-10-01T14:07:02.930599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:02.930638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:02.930652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:02.930658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:02.931242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 184 sessionId:  describe result for acl check
2025-10-01T14:07:02.931293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:02.931295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:02.931297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:02.931302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254603516244167:3649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:02.931881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254603516244167:3649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:02.946498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254603516244167:3649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:02.953606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254603516244167:3649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:02.953622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254603516244167:3649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:02.953626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254603516244167:3649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:02.953635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:02.955343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:02.959269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:02.959557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:02.959570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:02.959584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:02.959646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:02.959685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254601139384147:3391]
2025-10-01T14:07:02.960159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:02.960596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:02.960653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:02.960981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:02.961042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.961049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.961051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.961052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.961053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.961054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.961055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.961056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.961057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.961058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.961060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.961061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.961062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.961063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.961068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.961076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.961079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.961082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.961086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.961089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.961092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.961096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.961100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.961106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.961109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.961113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.961116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.961120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.961128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.961135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:02.961141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.961146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:02.961151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.961155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:02.961160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.961164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:02.961169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.961174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:02.961179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.961184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:02.961190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.961195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:02.961199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.961203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:02.961208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.961214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:02.961218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.961223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.961228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.961232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.961236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.961241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.961245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.961250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:02.961254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.961259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:02.961296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:02.967270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:02.967969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:02.967987Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:02.967990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:02.967994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:02.968002Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 183 [2:7556254601139384147:3391]
2025-10-01T14:07:02.968021Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:02.968038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:02.968046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.968050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.968053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.968071Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:02.968081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:02.968088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:02.968153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.968160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.968162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.968168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:02.968171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:02.968248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:02.968256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:02.968268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:02.968278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:02.968294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:02.968312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254601139384142:3391]
2025-10-01T14:07:02.968318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254601139384142:3391]
2025-10-01T14:07:02.968320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254601139384142:3391]
2025-10-01T14:07:02.968332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:02.968354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:02.968357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:02.968360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:02.968363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:02.968373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:02.968375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:02.968421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516244388:3649], now have 1 active actors on pipe
2025-10-01T14:07:02.968429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254603516244146:2446], now have 1 active actors on pipe
2025-10-01T14:07:02.968432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254601139384142:3391]
2025-10-01T14:07:02.968438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:02.968448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:02.968485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 183
2025-10-01T14:07:02.968485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 183
2025-10-01T14:07:02.968722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.968738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.968773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:02.968787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:02.968800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:02.968802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:02.968812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:02.968824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:02.968864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:02.969202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.969214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.969234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:02.969379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 184 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0
2025-10-01T14:07:02.970522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7aa2162-c2908d44-1bdd9122-f54bb34_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:02.973839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0] Write session: try to update token
2025-10-01T14:07:02.973862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:02.983430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:02.983451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:02.983463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254601139384142:3391]
2025-10-01T14:07:02.983518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:02.983516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:02.983704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:02.983851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:02.984118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:02.984260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:02.984477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:02.984521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:02.996150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 184 sessionId: src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:02.998891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:02.999240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:02.999262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:02.999300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:02.999426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:03.015460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254607811211697:3127]
2025-10-01T14:07:03.017017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 183, pipe: [1:7556254607811211697:3127]
2025-10-01T14:07:03.018186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811211697:3127], now have 1 active actors on pipe
2025-10-01T14:07:03.018213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:03.018217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:03.018219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:03.018221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:03.018229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254601139384142:3391]
2025-10-01T14:07:03.018233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254601139384142:3391]
2025-10-01T14:07:03.018236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254601139384142:3391]
2025-10-01T14:07:03.018273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:03.018278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:03.018281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:03.018286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:03.018293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.018296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:03.018471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:03.243932Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:03.253140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.253171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.253349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.253417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.253490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.253559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.253609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.253620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.253692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.253763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.253826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.253898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.253956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.253964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.254030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.254090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.254153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.254250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.254289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.254292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.254358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.254510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.254582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.254645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.254697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.254706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.254770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.254836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.254901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.254963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.255027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.255039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.255129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.255191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.255242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.255299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.255349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.255352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.255417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.255470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.255535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.255594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.255649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.255652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.255722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.255781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.255843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.255904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.255944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.255947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.256028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.256086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.256143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.256205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.256257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.256260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.256326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.256379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.256437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.256490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.256527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.256529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.257216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:03.257263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254607811211697:3127]
2025-10-01T14:07:03.257368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:03.257372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:03.257398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 184 reason: error at write: Disconnected sessionId: src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0
2025-10-01T14:07:03.257610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 184 sessionId: src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0 is DEAD
2025-10-01T14:07:03.257963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:03.257986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0] Write session will restart in 0.005170s
2025-10-01T14:07:03.257942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:03.258019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0] Write session: Do CDS request
2025-10-01T14:07:03.258027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:03.264179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:03.264575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:03.264594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 185
2025-10-01T14:07:03.264742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:03.264772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:03.264777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:03.264781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:03.265431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 185 sessionId:  describe result for acl check
2025-10-01T14:07:03.265467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:03.265471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:03.265473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:03.265479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254607811211723:3655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:03.266022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254607811211723:3655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:03.271174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254607811211723:3655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:03.276629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254607811211723:3655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:03.276648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254607811211723:3655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:03.276652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254607811211723:3655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:03.276661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:03.307640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:03.309276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:03.309510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:03.309523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:03.309536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:03.309594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:03.309646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254605434351686:3396]
2025-10-01T14:07:03.310297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:03.310732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:03.310793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:03.311151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:03.311222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.311228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.311229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.311230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.311232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.311233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.311234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.311235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.311237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.311238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.311239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.311240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.311242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.311243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.311250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.311261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.311266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.311270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.311274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.311280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.311284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.311288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.311292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.311296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.311300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.311304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.311309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.311313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.311320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.311329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.311336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.311351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.311357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.311362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.311367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.311373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.311378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.311383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.311387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.311393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.311397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.311403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.311408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.311413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.311419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.311426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.311430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.311436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.311440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.311445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.311450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.311463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.311468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.311475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.311479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.311484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.311525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:03.319938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:03.320971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:03.320987Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:03.320990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:03.320993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:03.321000Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 184 [2:7556254605434351686:3396]
2025-10-01T14:07:03.321019Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:03.321041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:03.321050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.321054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.321056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.321074Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:03.321080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:03.321085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:03.321144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.321150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.321154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.321157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:03.321160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:03.321233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:03.321241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.321254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.321264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.321280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:03.321299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254605434351680:3396]
2025-10-01T14:07:03.321301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254605434351680:3396]
2025-10-01T14:07:03.321303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254605434351680:3396]
2025-10-01T14:07:03.321311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:03.321325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:03.321336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:03.321339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:03.321340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:03.321342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:03.321345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:03.321424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 184
2025-10-01T14:07:03.321466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 184
2025-10-01T14:07:03.321392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811211709:2446], now have 1 active actors on pipe
2025-10-01T14:07:03.321400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811211773:3655], now have 1 active actors on pipe
2025-10-01T14:07:03.321402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254605434351680:3396]
2025-10-01T14:07:03.321409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:03.321451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:03.321703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.321717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.321745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:03.321765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.321771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.321777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:03.321788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.321802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:03.321825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:03.322267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.322277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.322297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:03.322409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 185 partition: 0 MaxSeqNo: 45 sessionId: src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0
2025-10-01T14:07:03.325316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca253177-7a0d20b0-58bfbc5c-6bd1012d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:03.328507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0] Write session: try to update token
2025-10-01T14:07:03.328528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:03.349060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:03.349083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:03.349087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:03.349089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:03.349099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254605434351680:3396]
2025-10-01T14:07:03.349104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254605434351680:3396]
2025-10-01T14:07:03.349109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254605434351680:3396]
2025-10-01T14:07:03.349165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:03.349172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.349174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:03.349330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:03.350843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:03.350856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:03.350862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:03.353243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 185 sessionId: src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:03.357453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254607811211956:3127]
2025-10-01T14:07:03.357814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 184, pipe: [1:7556254607811211956:3127]
2025-10-01T14:07:03.358045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:03.517625Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:03.518065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811211956:3127], now have 1 active actors on pipe
2025-10-01T14:07:03.518092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.518103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.518357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:03.518405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254607811211956:3127]
2025-10-01T14:07:03.518415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:03.518422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:03.518488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 185 reason: error at write: Disconnected sessionId: src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0
2025-10-01T14:07:03.518366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:03.518621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 185 sessionId: src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0 is DEAD
2025-10-01T14:07:03.518957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:03.518975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0] Write session will restart in 0.009497s
2025-10-01T14:07:03.519005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0] Write session: Do CDS request
2025-10-01T14:07:03.519012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:03.530022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:03.530026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:03.530038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 186
2025-10-01T14:07:03.530217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:03.530250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:03.530259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:03.530262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:03.530669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 186 sessionId:  describe result for acl check
2025-10-01T14:07:03.530711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:03.530717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:03.530719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:03.530725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254607811212049:3659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:03.531223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254607811212049:3659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:03.533654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254607811212049:3659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:03.536226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:03.536329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254607811212049:3659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:03.536342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254607811212049:3659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:03.536345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254607811212049:3659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:03.536353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:03.537940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:03.538155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:03.538165Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:03.538178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:03.538230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:03.538272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254605434351929:3398]
2025-10-01T14:07:03.538823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:03.539162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:03.539218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:03.539578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:03.539640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.539647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.539648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.539649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.539650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.539651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.539652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.539653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.539654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.539655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.539656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.539657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.539658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.539659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.539664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.539679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.539682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.539686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.539688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.539691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.539694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.539697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.539700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.539704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.539707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.539710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.539713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.539716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.539724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.539730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.539736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.539740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.539743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.539747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.539751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.539755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.539758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.539763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.539767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.539771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.539775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.539779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.539782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.539786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.539790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.539794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.539798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.539803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.539806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.539810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.539813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.539817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.539821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.539825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.539828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.539832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.539865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:03.544275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:03.545099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:03.545117Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:03.545120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:03.545123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:03.545131Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 185 [2:7556254605434351929:3398]
2025-10-01T14:07:03.545152Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:03.545171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:03.545180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.545184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.545187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.545205Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:03.545216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:03.545223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:03.545285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.545293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.545297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.545300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:03.545303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:03.545378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:03.545386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.545400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.545412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.545434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:03.545458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811211959:2446], now have 1 active actors on pipe
2025-10-01T14:07:03.545467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811212196:3659], now have 1 active actors on pipe
2025-10-01T14:07:03.545476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254605434351923:3398]
2025-10-01T14:07:03.545487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254605434351923:3398]
2025-10-01T14:07:03.545490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254605434351923:3398]
2025-10-01T14:07:03.545504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:03.545518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:03.545522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:03.545528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:03.545530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:03.545538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:03.545542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:03.545581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254605434351923:3398]
2025-10-01T14:07:03.545590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:03.545600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:03.545664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.545673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.545698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:03.545569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 185
2025-10-01T14:07:03.545710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.545629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 185
2025-10-01T14:07:03.545715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.545718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:03.545727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.545735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:03.545764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:03.545998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.546008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.546024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:03.546143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 186 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0
2025-10-01T14:07:03.546596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3b6f423-62f6f3f4-d5318eb2-b9fa2eb5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:03.549607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0] Write session: try to update token
2025-10-01T14:07:03.549628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:03.557498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:03.557522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:03.557536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254605434351923:3398]
2025-10-01T14:07:03.557584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:03.557596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:03.557766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:03.557900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:03.558031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:03.558163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:03.558366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:03.558427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:03.571428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 186 sessionId: src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:03.575095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:03.575641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.575669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.575726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:03.575873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:03.581539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:03.581563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:03.581566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:03.581568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:03.581580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254605434351923:3398]
2025-10-01T14:07:03.581583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254605434351923:3398]
2025-10-01T14:07:03.581587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254605434351923:3398]
2025-10-01T14:07:03.581625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:03.581630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:03.581636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:03.581641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:03.581662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.581665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:03.581810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:03.619412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254607811212208:3127]
2025-10-01T14:07:03.619846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 185, pipe: [1:7556254607811212208:3127]
2025-10-01T14:07:03.739467Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:03.748070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.748099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.748247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.748307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.748365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.748425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.748468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.748472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.748534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.748583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.748637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.748693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.748739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.748741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.748842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.748897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.748952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.749018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.749057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.749059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.749122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.749178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.749230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.749284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.749323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.749325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.749389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.749456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.749510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.749564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.749601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.749603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.749668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.749726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.749780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.749835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.749888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.749890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.749966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.750017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.750071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.750129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.750172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.750174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.750231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.750281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.750338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.750448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.750503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.750509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.750585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.750646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.750723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.750783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.750964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.750977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.751043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.751098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.751166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.751226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.751273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.751279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.751339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811212208:3127], now have 1 active actors on pipe
2025-10-01T14:07:03.751645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:03.751707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:03.751710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:03.751741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 186 reason: error at write: Disconnected sessionId: src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0
2025-10-01T14:07:03.751935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254607811212208:3127]
2025-10-01T14:07:03.751939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 186 sessionId: src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0 is DEAD
2025-10-01T14:07:03.752281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:03.752307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:03.752330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0] Write session will restart in 0.009853s
2025-10-01T14:07:03.752356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0] Write session: Do CDS request
2025-10-01T14:07:03.752362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:03.763945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:03.764150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:03.764166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 187
2025-10-01T14:07:03.764325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:03.764356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:03.764361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:03.764364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:03.764781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 187 sessionId:  describe result for acl check
2025-10-01T14:07:03.764824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:03.764844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:03.764846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:03.764852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254607811212228:3664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:03.765371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254607811212228:3664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:03.768191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254607811212228:3664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:03.771608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254607811212228:3664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:03.771623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254607811212228:3664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:03.771626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254607811212228:3664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:03.771634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:03.776382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:03.777761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:03.777996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:03.778007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:03.778018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:03.778064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:03.778103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254605434352171:3401]
2025-10-01T14:07:03.778733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:03.779016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:03.779057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:03.779363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:03.779422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.779427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.779428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.779430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.779431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.779432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.779433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.779434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.779435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.779436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.779437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.779438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.779439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.779440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.779445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.779455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.779459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.779463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.779467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.779471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.779475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.779479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.779484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.779488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.779492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.779496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.779499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.779503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.779510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.779518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:03.779524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.779530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:03.779534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.779540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:03.779545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.779550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:03.779555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.779562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:03.779572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.779577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:03.779582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.779588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:03.779592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.779602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:03.779606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.779615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:03.779620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.779625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.779634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.779639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.779642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.779648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.779656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.779662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:03.779665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.779670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:03.779712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:03.783903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:03.784846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:03.784860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:03.784862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:03.784865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:03.784872Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 186 [2:7556254605434352171:3401]
2025-10-01T14:07:03.784887Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:03.784904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:03.784907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.784911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.784913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.784927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:03.784951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:03.784958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:03.785012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.785019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.785021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.785025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:03.785027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:03.785095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:03.785103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.785114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:03.785125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:03.785142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:03.785164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811212339:3664], now have 1 active actors on pipe
2025-10-01T14:07:03.785168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811212211:2446], now have 1 active actors on pipe
2025-10-01T14:07:03.785175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254605434352166:3401]
2025-10-01T14:07:03.785178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254605434352166:3401]
2025-10-01T14:07:03.785180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254605434352166:3401]
2025-10-01T14:07:03.785192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:03.785203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:03.785206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:03.785207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:03.785207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:03.785220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:03.785223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:03.785246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254605434352166:3401]
2025-10-01T14:07:03.785252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:03.785257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:03.786392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 186
2025-10-01T14:07:03.786425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 186
2025-10-01T14:07:03.786453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.786467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.786497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54c49a56-27549b55-3f8e096d-5743fec9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:03.786507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:03.786516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:03.786527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:03.786543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:03.786561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:03.786577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:03.788418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.788429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.788452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:03.788804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 187 partition: 0 MaxSeqNo: 45 sessionId: src_id|54c49a56-27549b55-3f8e096d-5743fec9_0
2025-10-01T14:07:03.789511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a2d3d21-da0602d0-b1700ad0-a99dd4ec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54c49a56-27549b55-3f8e096d-5743fec9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:03.791957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c49a56-27549b55-3f8e096d-5743fec9_0] Write session: try to update token
2025-10-01T14:07:03.791976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c49a56-27549b55-3f8e096d-5743fec9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:03.807346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 187 sessionId: src_id|54c49a56-27549b55-3f8e096d-5743fec9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:03.809766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:03.810032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.810056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.810088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:03.810188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:03.814589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:03.814615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:03.814617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:03.814620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:03.814632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254605434352166:3401]
2025-10-01T14:07:03.814638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254605434352166:3401]
2025-10-01T14:07:03.814642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254605434352166:3401]
2025-10-01T14:07:03.814690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:03.814705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:03.814707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:03.814744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:03.814770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:03.814776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:03.814843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:03.852426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254607811212472:3127]
2025-10-01T14:07:03.852636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 186, pipe: [1:7556254607811212472:3127]
2025-10-01T14:07:03.973222Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:03.981845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:03.981880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:03.982038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.982104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.982167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.982233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.982278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.982292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.982385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.982446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.982508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.982571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.982623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.982631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.982691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.982746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.982808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.983230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.983276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.983284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.983345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.983402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.983459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.983524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.983567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.983575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.983637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.983697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.983758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.983819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.983863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.983871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.983942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.984007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.984071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.984130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.984174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.984182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.984247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.984310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.984375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.984442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.984500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.984507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.984588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.984659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.984734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.984797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.984864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.984870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.984937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.984995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.985060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.985127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.985175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.985184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.985252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:03.985320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:03.985392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:03.985472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:03.985524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:03.985532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:03.985593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811212472:3127], now have 1 active actors on pipe
2025-10-01T14:07:03.985839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254607811212472:3127]
2025-10-01T14:07:03.985878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:03.985880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:03.985905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 187 reason: error at write: Disconnected sessionId: src_id|54c49a56-27549b55-3f8e096d-5743fec9_0
2025-10-01T14:07:03.986154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 187 sessionId: src_id|54c49a56-27549b55-3f8e096d-5743fec9_0 is DEAD
2025-10-01T14:07:03.986333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c49a56-27549b55-3f8e096d-5743fec9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:03.986348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c49a56-27549b55-3f8e096d-5743fec9_0] Write session will restart in 0.006714s
2025-10-01T14:07:03.986395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c49a56-27549b55-3f8e096d-5743fec9_0] Write session: Do CDS request
2025-10-01T14:07:03.986403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c49a56-27549b55-3f8e096d-5743fec9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:03.986341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:03.986785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:03.994361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54c49a56-27549b55-3f8e096d-5743fec9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:03.994469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:03.994483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 188
2025-10-01T14:07:03.994764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:03.994800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:03.994810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:03.994813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:03.995151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 188 sessionId:  describe result for acl check
2025-10-01T14:07:03.995182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:03.995185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:03.995186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:03.995190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254607811212517:3676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:03.995629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254607811212517:3676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:03.999482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254607811212517:3676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:04.003189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254607811212517:3676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:04.003204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254607811212517:3676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:04.003207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254607811212517:3676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:04.003215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:04.004283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:04.005945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:04.006150Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:04.006162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:04.006172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:04.006222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:04.006274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254609729319758:3414]
2025-10-01T14:07:04.006872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:04.007189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:04.007234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:04.007532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:04.007596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.007602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.007603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.007604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.007605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.007607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.007608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.007609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.007610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.007611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.007612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.007613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.007614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.007615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.007620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.007630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.007643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.007650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.007653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.007657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.007660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.007663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.007666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.007670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.007677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.007680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.007683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.007686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.007697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.007708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.007714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.007722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.007726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.007730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.007734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.007738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.007746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.007750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.007758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.007766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.007772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.007781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.007785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.007793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.007798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.007803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.007806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.007811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.007814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.007819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.007822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.007828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.007837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.007845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.007849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.007856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.007888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:04.011926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:04.012579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:04.012594Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:04.012596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:04.012600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:04.012608Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 187 [2:7556254609729319758:3414]
2025-10-01T14:07:04.012624Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:04.012642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:04.012646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.012649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.012651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.012665Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:04.012671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:04.012676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:04.012740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.012753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.012755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.012758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:04.012760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:04.012821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:04.012837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.012848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.012864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.012885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:04.012908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180028:3676], now have 1 active actors on pipe
2025-10-01T14:07:04.012916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254607811212490:2446], now have 1 active actors on pipe
2025-10-01T14:07:04.012923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254609729319753:3414]
2025-10-01T14:07:04.012926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254609729319753:3414]
2025-10-01T14:07:04.012928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254609729319753:3414]
2025-10-01T14:07:04.012940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:04.012952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:04.012954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:04.012955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:04.012957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:04.012969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:04.012977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:04.013009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254609729319753:3414]
2025-10-01T14:07:04.013021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:04.013046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:04.013023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 187
2025-10-01T14:07:04.013068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 187
2025-10-01T14:07:04.013102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.013111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.013140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:04.013152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.013156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.013158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:04.013168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.013177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:04.013191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.013379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.013386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.013398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.013556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 188 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0
2025-10-01T14:07:04.013947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54c49a56-27549b55-3f8e096d-5743fec9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:04.016755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0] Write session: try to update token
2025-10-01T14:07:04.016777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:04.031801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 188 sessionId: src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.034274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.034579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.034603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.034624Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:04.034632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:04.034634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:04.034636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:04.034645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254609729319753:3414]
2025-10-01T14:07:04.034653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254609729319753:3414]
2025-10-01T14:07:04.034657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254609729319753:3414]
2025-10-01T14:07:04.034688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:04.034708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:04.034712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:04.034715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:04.034721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.034729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:04.034866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:04.086080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254612106180042:3127]
2025-10-01T14:07:04.086395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 187, pipe: [1:7556254612106180042:3127]
2025-10-01T14:07:04.190847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:04.191280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:04.191334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180042:3127], now have 1 active actors on pipe
2025-10-01T14:07:04.191423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.191553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254612106180042:3127]
2025-10-01T14:07:04.191576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:04.202907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:04.202921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:04.202946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 188 reason: error at write: Disconnected sessionId: src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0
2025-10-01T14:07:04.203141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 188 sessionId: src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0 is DEAD
2025-10-01T14:07:04.203249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:04.203275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0] Write session will restart in 0.006174s
2025-10-01T14:07:04.203300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0] Write session: Do CDS request
2025-10-01T14:07:04.203319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:04.210901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.211605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:04.211624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 189
2025-10-01T14:07:04.211926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.211970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:04.211981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:04.211985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:04.212586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 189 sessionId:  describe result for acl check
2025-10-01T14:07:04.212637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:04.212643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:04.212645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:04.212652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254612106180080:3681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:04.213296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254612106180080:3681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:04.220663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254612106180080:3681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:04.226892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254612106180080:3681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:04.226913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254612106180080:3681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:04.226920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254612106180080:3681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:04.226930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:04.242276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:04.245584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:04.245868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:04.245874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:04.245886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:04.245946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:04.245992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254609729320003:3419]
2025-10-01T14:07:04.246840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:04.248100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:04.248170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:04.248546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:04.248643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.248644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.248646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.248647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.248649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.248650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.248651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.248652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.248654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.248655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.248657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.248658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.248660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.248661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.248668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.248678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.248683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.248688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.248691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.248694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.248698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.248702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.248706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.248710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.248713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.248719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.248722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.248725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.248733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.248741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.248748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.248753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.248758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.248763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.248768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.248774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.248778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.248787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.248791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.248796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.248805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.248810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.248815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.248819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.248824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.248846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.248850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.248855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.248860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.248865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.248869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.248873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.248877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.248883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.248887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.248892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.248930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:04.257066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:04.258054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:04.258073Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:04.258076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:04.258081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:04.258089Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 188 [2:7556254609729320003:3419]
2025-10-01T14:07:04.258108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:04.258127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:04.258131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.258135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.258138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.258155Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:04.258161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:04.258168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:04.258237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.258239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.258242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.258245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:04.258249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:04.258326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:04.258329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.258342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.258352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.258386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:04.258406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254609729319997:3419]
2025-10-01T14:07:04.258411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254609729319997:3419]
2025-10-01T14:07:04.258413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254609729319997:3419]
2025-10-01T14:07:04.258429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:04.258442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:04.258456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:04.258459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:04.258501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254609729319997:3419]
2025-10-01T14:07:04.258504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:04.258804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:04.258811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:04.258814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:04.258820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:04.259096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180228:3681], now have 1 active actors on pipe
2025-10-01T14:07:04.259105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180055:2446], now have 1 active actors on pipe
2025-10-01T14:07:04.260661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.260674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.260701Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:04.260709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.260713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.260716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:04.260727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.260741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:04.260754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.260344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 188
2025-10-01T14:07:04.260382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 188
2025-10-01T14:07:04.261697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 189 partition: 0 MaxSeqNo: 45 sessionId: src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0
2025-10-01T14:07:04.261518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.261531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.261554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.262146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e002431-b91f2f9a-a60dfd56-5d9390b8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:04.265311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0] Write session: try to update token
2025-10-01T14:07:04.265331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:04.292880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254612106180303:3127]
2025-10-01T14:07:04.294136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180303:3127], now have 1 active actors on pipe
2025-10-01T14:07:04.294315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 188, pipe: [1:7556254612106180303:3127]
2025-10-01T14:07:04.298234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 189 sessionId: src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.300629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.302761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.302790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.302814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:04.302818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:04.302820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:04.302823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:04.302833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254609729319997:3419]
2025-10-01T14:07:04.302838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254609729319997:3419]
2025-10-01T14:07:04.302843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254609729319997:3419]
2025-10-01T14:07:04.302910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:04.302917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.302920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:04.303094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:04.303747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:04.303754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:04.303758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:04.462015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:04.462655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:04.462801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.463286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254612106180303:3127]
2025-10-01T14:07:04.463307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:04.476724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:04.476738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0] Write session will restart in 0.008754s
2025-10-01T14:07:04.476765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0] Write session: Do CDS request
2025-10-01T14:07:04.476771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:04.476382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:04.476396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:04.476420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 189 reason: error at write: Disconnected sessionId: src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0
2025-10-01T14:07:04.476592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 189 sessionId: src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0 is DEAD
2025-10-01T14:07:04.491355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:04.493948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:04.494141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:04.494151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:04.494162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:04.494206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:04.494255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254609729320248:3421]
2025-10-01T14:07:04.494804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:04.495153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:04.495224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:04.495549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:04.495615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.495622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.495623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.495625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.495626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.495627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.495628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.495629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.495630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.495631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.495632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.495633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.495635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.495636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.495641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.495651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.495655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.495659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.495662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.495666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.495670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.495673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.495677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.495681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.495685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.495688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.495692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.495695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.495702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.495710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.495716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.495721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.495725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.495731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.495737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.495741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.495747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.495752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.495756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.495761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.495765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.495770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.495774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.495778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.495782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.495788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.495795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.495799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.495808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.495812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.495816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.495821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.495825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.495834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.495850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.495859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.495896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:04.496850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.497027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:04.497049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 190
2025-10-01T14:07:04.497175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.497195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:04.497201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:04.497204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:04.497623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 190 sessionId:  describe result for acl check
2025-10-01T14:07:04.497649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:04.497652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:04.497653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:04.497659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254612106180519:3685] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:04.498133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254612106180519:3685] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:04.502304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:04.503090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:04.503095Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:04.503097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:04.503100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:04.503107Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 189 [2:7556254609729320248:3421]
2025-10-01T14:07:04.503126Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:04.503142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:04.503145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.503149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.503151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.503169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:04.503174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:04.503180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:04.503236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.503238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.503240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.503243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:04.503246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:04.503319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:04.503322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.503334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.503344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.503359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:04.503377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254609729320243:3421]
2025-10-01T14:07:04.503380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254609729320243:3421]
2025-10-01T14:07:04.503382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254609729320243:3421]
2025-10-01T14:07:04.503399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:04.503417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:04.503430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:04.503433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:04.503457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:04.503460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:04.503462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:04.503467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254609729320243:3421]
2025-10-01T14:07:04.503470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:04.503525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:04.503740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180308:2446], now have 1 active actors on pipe
2025-10-01T14:07:04.503750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 189
2025-10-01T14:07:04.505079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254612106180519:3685] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:04.514261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254612106180519:3685] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:04.514280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254612106180519:3685] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:04.514283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254612106180519:3685] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:04.514291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:04.514590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180557:3685], now have 1 active actors on pipe
2025-10-01T14:07:04.514723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.514742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.514772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:04.514800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.514810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.514813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:04.514825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.514848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:04.514875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.515074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.515084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.515111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.514653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 189
2025-10-01T14:07:04.515193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 190 partition: 0 MaxSeqNo: 45 sessionId: src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0
2025-10-01T14:07:04.515580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da93031a-6ee35c9b-de8f33b3-7320af0a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:04.518315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0] Write session: try to update token
2025-10-01T14:07:04.518333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:04.532539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 190 sessionId: src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.533917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:04.533940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:04.533942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:04.533945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:04.533953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254609729320243:3421]
2025-10-01T14:07:04.533958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254609729320243:3421]
2025-10-01T14:07:04.533961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254609729320243:3421]
2025-10-01T14:07:04.534016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:04.534024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.534026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:04.534027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:04.534038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:04.534041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:04.534149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:04.534886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.563218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254612106180562:3127]
2025-10-01T14:07:04.563675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 189, pipe: [1:7556254612106180562:3127]
2025-10-01T14:07:04.688967Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:04.689199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.689215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.689258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180562:3127], now have 1 active actors on pipe
2025-10-01T14:07:04.689532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:04.689536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:04.689567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:04.689601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254612106180562:3127]
2025-10-01T14:07:04.689655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 190 reason: error at write: Disconnected sessionId: src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0
2025-10-01T14:07:04.689840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 190 sessionId: src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0 is DEAD
2025-10-01T14:07:04.690002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:04.690012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0] Write session will restart in 0.005211s
2025-10-01T14:07:04.690037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0] Write session: Do CDS request
2025-10-01T14:07:04.690046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:04.690336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:04.697197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.697310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:04.697323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 191
2025-10-01T14:07:04.698105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.698149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:04.698159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:04.698163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:04.698618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 191 sessionId:  describe result for acl check
2025-10-01T14:07:04.698659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:04.698665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:04.698667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:04.698672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254612106180579:3690] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:04.699222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254612106180579:3690] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:04.703918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254612106180579:3690] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:04.706923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254612106180579:3690] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:04.706937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254612106180579:3690] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:04.706953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254612106180579:3690] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:04.706961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:04.710314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:04.715657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:04.715883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:04.715894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:04.715905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:04.715953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:04.715989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254609729320496:3424]
2025-10-01T14:07:04.716584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:04.716864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:04.716906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:04.717212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:04.717263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.717269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.717270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.717271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.717272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.717273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.717274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.717275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.717276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.717278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.717279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.717280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.717281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.717282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.717287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.717296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.717300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.717304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.717308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.717313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.717317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.717321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.717325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.717330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.717334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.717338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.717341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.717346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.717352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.717361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.717366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.717372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.717380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.717385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.717389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.717394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.717403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.717408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.717412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.717417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.717422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.717427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.717431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.717437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.717442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.717452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.717456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.717461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.717469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.717474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.717483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.717488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.717498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.717504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.717512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.717518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.717561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:04.721708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:04.722344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:04.722360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:04.722362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:04.722366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:04.722390Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 190 [2:7556254609729320496:3424]
2025-10-01T14:07:04.722407Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:04.722424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:04.722432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.722436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.722438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.722454Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:04.722465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:04.722471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:04.722534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.722541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.722544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.722547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:04.722550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:04.722757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 190
2025-10-01T14:07:04.722764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 190
2025-10-01T14:07:04.722911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:04.722921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.722933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.722946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.722970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:04.722994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180719:3690], now have 1 active actors on pipe
2025-10-01T14:07:04.723006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180565:2446], now have 1 active actors on pipe
2025-10-01T14:07:04.723025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.723029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.723050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254609729320491:3424]
2025-10-01T14:07:04.723058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254609729320491:3424]
2025-10-01T14:07:04.723060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254609729320491:3424]
2025-10-01T14:07:04.723072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:04.723085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:04.723085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:04.723087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:04.723089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:04.723100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:04.723102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:04.723119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:04.723132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.723135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.723138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:04.723147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.723159Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:04.723199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254609729320491:3424]
2025-10-01T14:07:04.723211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:04.723218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:04.723222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.723361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.723364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.723377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.723460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 191 partition: 0 MaxSeqNo: 45 sessionId: src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0
2025-10-01T14:07:04.723827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d376bac9-6e12af3f-915a2697-5abb7d0c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:04.726393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0] Write session: try to update token
2025-10-01T14:07:04.726412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:04.737167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:04.737193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:04.737217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254609729320491:3424]
2025-10-01T14:07:04.737265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:04.737514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:04.737648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:04.737781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:04.737912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:04.738107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:04.738145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:04.738419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:04.744882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 191 sessionId: src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:04.747442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:04.747659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.747692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.747730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:04.747821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:04.771984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.772012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.772188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.772256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.772321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.772386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.772429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.772439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.772505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.772562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.772628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.772687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.772736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.772743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.772800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.772872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.772933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.772989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.773031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.773038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.773096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.773158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.773218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.773273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.773319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.773326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.773383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.773512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.773649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.773708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.773756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.773763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.773829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.773890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.773943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.773996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.774035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.774038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.774100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.774151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.774207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.774261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.774309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.774313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.774455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.774519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.774580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.774639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.774689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.774696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.774758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.774809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.774861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.774917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.774963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.774973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.775031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:04.775085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:04.775149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:04.775211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:04.775253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:04.775261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:04.775345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:04.775407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.775432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.775439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:04.775458Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775471Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775481Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775486Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775494Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775498Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775502Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775510Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775514Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775518Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775522Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775644Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775653Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775657Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.775661Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776058Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776068Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776072Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776075Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776079Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776082Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776086Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776094Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776097Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776101Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776263Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776272Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776278Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776286Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776290Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776385Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776395Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776400Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776407Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776411Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:04.776433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:04.776452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:07:04.776456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:07:04.776460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:07:04.776464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:07:04.776905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:07:04.776922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:04.776928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:07:04.776932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:07:04.776935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:07:04.776939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:07:04.777398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:07:04.777411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:04.777417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:07:04.777420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:07:04.777423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:07:04.777427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:07:04.777941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:07:04.777951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.778056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327624777
2025-10-01T14:07:04.780790Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:04.780823Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:07:04.780846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:04.780853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:04.780855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:04.780856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:04.780864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254609729320491:3424]
2025-10-01T14:07:04.780874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254609729320491:3424]
2025-10-01T14:07:04.780881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254609729320491:3424]
2025-10-01T14:07:04.780928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:04.780943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:04.780946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:04.780961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:04.780966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.780968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:04.781082Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:04.789546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254612106180817:3127]
2025-10-01T14:07:04.790025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 190, pipe: [1:7556254612106180817:3127]
2025-10-01T14:07:04.938358Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:04.942845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180817:3127], now have 1 active actors on pipe
2025-10-01T14:07:04.943144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:04.943159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:04.943184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 191 reason: error at write: Disconnected sessionId: src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0
2025-10-01T14:07:04.943188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254612106180817:3127]
2025-10-01T14:07:04.943207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:04.943539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:04.943551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0] Write session will restart in 0.006113s
2025-10-01T14:07:04.943574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0] Write session: Do CDS request
2025-10-01T14:07:04.943579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:04.943384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 191 sessionId: src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0 is DEAD
2025-10-01T14:07:04.944017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:04.954871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.955503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:04.955518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 192
2025-10-01T14:07:04.955628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:04.955659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:04.955663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:04.955667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:04.956040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 192 sessionId:  describe result for acl check
2025-10-01T14:07:04.956076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:04.956078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:04.956079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:04.956084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254612106180850:3695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:04.956609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254612106180850:3695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:04.960718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254612106180850:3695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:04.965780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254612106180850:3695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:04.965795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254612106180850:3695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:04.965798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254612106180850:3695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:04.965803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:04.981606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:04.983017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:04.983229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:04.983240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:04.983250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:04.983299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:04.983331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254609729320770:3427]
2025-10-01T14:07:04.983852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:04.984146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:04.984183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:04.984460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:04.984514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.984519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.984520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.984521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.984522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.984523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.984524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.984525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.984526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.984527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.984528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.984529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.984529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.984530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.984534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.984542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.984545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.984548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.984551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.984554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.984558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.984561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.984563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.984579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.984582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.984585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.984588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.984591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.984597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.984603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:04.984612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.984617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:04.984621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.984625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:04.984629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.984633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:04.984636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.984642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:04.984645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.984650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:04.984654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.984659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:04.984662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.984666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:04.984675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.984679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:04.984682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.984685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.984689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.984693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.984697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.984701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.984704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.984708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:04.984711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.984715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:04.984744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:04.989236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:04.989983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:04.989995Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:04.989997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:04.990000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:04.990006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 191 [2:7556254609729320770:3427]
2025-10-01T14:07:04.990515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 191
2025-10-01T14:07:04.990550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 191
2025-10-01T14:07:04.990190Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:04.990214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:04.990216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.990219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.990221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.990237Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:04.990243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:04.990248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:04.990310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.990312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.990314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.990317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:04.990319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:04.990393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:04.990396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:04.990407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:04.990416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:04.990429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:04.990444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180968:3695], now have 1 active actors on pipe
2025-10-01T14:07:04.990447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254612106180833:2446], now have 1 active actors on pipe
2025-10-01T14:07:04.990453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254609729320765:3427]
2025-10-01T14:07:04.990455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254609729320765:3427]
2025-10-01T14:07:04.990457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254609729320765:3427]
2025-10-01T14:07:04.990471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:04.990482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:04.990495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:04.990498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:04.990525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:04.990528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:04.990530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254609729320765:3427]
2025-10-01T14:07:04.990530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:04.990532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:04.990536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:04.990600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:04.990633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:04.990637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:04.990639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:04.990649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:04.990660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:04.990672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.990875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:04.990890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:04.990911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:04.990996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 192 partition: 0 MaxSeqNo: 45 sessionId: src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0
2025-10-01T14:07:04.991279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a848ed84-4468e7f6-b9aaf3f0-57643bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:04.993708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0] Write session: try to update token
2025-10-01T14:07:04.993724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:05.009273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 192 sessionId: src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.011635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.011798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.011819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.011846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:05.011918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.019092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:05.019111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:05.019113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:05.019115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:05.019123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254609729320765:3427]
2025-10-01T14:07:05.019128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254609729320765:3427]
2025-10-01T14:07:05.019131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254609729320765:3427]
2025-10-01T14:07:05.019170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:05.019176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:05.019177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:05.019179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:05.019184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.019186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:05.019332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:05.043492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254616401148405:3127]
2025-10-01T14:07:05.044197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 191, pipe: [1:7556254616401148405:3127]
2025-10-01T14:07:05.165289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:05.173654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.173688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.173861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.173917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.173976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.174040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.174238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.174244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.174316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.174477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.174617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.174689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.174748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.174752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.174814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.174875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.174938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.175007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.175053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.175060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.175123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.177689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:05.177704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:05.177741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 192 reason: error at write: Disconnected sessionId: src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0
2025-10-01T14:07:05.178125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:05.178139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0] Write session will restart in 0.008464s
2025-10-01T14:07:05.178165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0] Write session: Do CDS request
2025-10-01T14:07:05.177944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 192 sessionId: src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0 is DEAD
2025-10-01T14:07:05.177980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254616401148405:3127]
2025-10-01T14:07:05.177995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:05.178171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:05.175188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.175253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.175310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.175347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.175350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.175417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.175475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.175533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.175589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.175633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.175636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.175715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.175782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.175848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.175907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.175959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.175962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.176037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.176094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.176159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.176243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.176308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.176311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.176402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.176478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.176545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.176604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.176655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.176658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.176729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.176791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.176866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.176931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.176976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.176979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.177049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.177105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.177166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.177246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.177304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.177307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.177391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401148405:3127], now have 1 active actors on pipe
2025-10-01T14:07:05.178600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:05.187868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:05.190072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:05.190089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 193
2025-10-01T14:07:05.190290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:05.190333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:05.190342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:05.190346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:05.190766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 193 sessionId:  describe result for acl check
2025-10-01T14:07:05.190802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:05.190804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:05.190805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:05.190810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254616401148461:3707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:05.191312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254616401148461:3707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:05.194168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254616401148461:3707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:05.196933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254616401148461:3707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:05.196943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254616401148461:3707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:05.196947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254616401148461:3707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:05.196955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:05.198528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:05.200316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:05.200517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:05.200527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:05.200538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:05.200591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:05.200655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254614024288340:3442]
2025-10-01T14:07:05.201292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:05.201597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:05.201649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:05.201913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:05.201975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.201981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.201982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.201983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.201984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.201985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.201986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.201987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.201988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.201989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.201989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.201991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.201992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.201993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.202010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.202020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.202023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.202026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.202029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.202032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.202035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.202038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.202042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.202045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.202048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.202051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.202054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.202057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.202066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.202077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.202087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.202092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.202096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.202100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.202104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.202109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.202113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.202118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.202130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.202135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.202139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.202143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.202147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.202151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.202155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.202160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.202163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.202177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.202181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.202186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.202190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.202194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.202198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.202202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.202206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.202211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.202256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:05.206045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:05.206864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:05.206879Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:05.206881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:05.206884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:05.206890Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 192 [2:7556254614024288340:3442]
2025-10-01T14:07:05.206906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:05.206921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:05.206928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.206932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.206934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.206949Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:05.206960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:05.206965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:05.207020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.207026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.207029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.207031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:05.207050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:05.207114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:05.207120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.207130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.207139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.207157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:05.207177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401148657:3707], now have 1 active actors on pipe
2025-10-01T14:07:05.207185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401148418:2446], now have 1 active actors on pipe
2025-10-01T14:07:05.207193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254614024288334:3442]
2025-10-01T14:07:05.207195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254614024288334:3442]
2025-10-01T14:07:05.207197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254614024288334:3442]
2025-10-01T14:07:05.207210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:05.207223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:05.207240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:05.207243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:05.207246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:05.207247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:05.207248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:05.207279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254614024288334:3442]
2025-10-01T14:07:05.207286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:05.207289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:05.207311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.207320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.207352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a940952e-3947987a-4957b6e1-1a823c81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:05.207363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.207369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.207371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:05.207379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.207391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:05.207409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:05.207552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.207561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.207575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:05.208012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|832ec59b-eba54a-6980fd3a-a3d667fd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a940952e-3947987a-4957b6e1-1a823c81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:05.207253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 192
2025-10-01T14:07:05.207265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 192
2025-10-01T14:07:05.207645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 193 partition: 0 MaxSeqNo: 45 sessionId: src_id|a940952e-3947987a-4957b6e1-1a823c81_0
2025-10-01T14:07:05.210840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a940952e-3947987a-4957b6e1-1a823c81_0] Write session: try to update token
2025-10-01T14:07:05.210858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a940952e-3947987a-4957b6e1-1a823c81_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:05.223980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 193 sessionId: src_id|a940952e-3947987a-4957b6e1-1a823c81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.226344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.226561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.226586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.226627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:05.226758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.229508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:05.229528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:05.229531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:05.229533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:05.229544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254614024288334:3442]
2025-10-01T14:07:05.229549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254614024288334:3442]
2025-10-01T14:07:05.229553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254614024288334:3442]
2025-10-01T14:07:05.229606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:05.229606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:05.229611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:05.229615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:05.229618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.229620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:05.229770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:05.277988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254616401148674:3127]
2025-10-01T14:07:05.278218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 192, pipe: [1:7556254616401148674:3127]
2025-10-01T14:07:05.375687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:05.385117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.385148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.385336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.385415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.385499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.385577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.385629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.385640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.385719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.385790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.385869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.385946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.386013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.386022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.386089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.386161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.386229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.386300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.386353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.386361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.386442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.386511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.386581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.386658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.386715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.386724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.386803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.386875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.386950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.387021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.387076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.387084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.387172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.387252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.387330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.387411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.387469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.387479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.387562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.387641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.387722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.387812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.387873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.387881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.387980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.388070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.388155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.388246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.388299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.388307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.388389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.388464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.388541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.388619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.388670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.388677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.388757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.388824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.388913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.388993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.389053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.389061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.389135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401148674:3127], now have 1 active actors on pipe
2025-10-01T14:07:05.389439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:05.389461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:05.389487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 193 reason: error at write: Disconnected sessionId: src_id|a940952e-3947987a-4957b6e1-1a823c81_0
2025-10-01T14:07:05.389745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 193 sessionId: src_id|a940952e-3947987a-4957b6e1-1a823c81_0 is DEAD
2025-10-01T14:07:05.389848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940952e-3947987a-4957b6e1-1a823c81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:05.389860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940952e-3947987a-4957b6e1-1a823c81_0] Write session will restart in 0.009510s
2025-10-01T14:07:05.389886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940952e-3947987a-4957b6e1-1a823c81_0] Write session: Do CDS request
2025-10-01T14:07:05.389892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940952e-3947987a-4957b6e1-1a823c81_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:05.389951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:05.389996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254616401148674:3127]
2025-10-01T14:07:05.390429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:05.402235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a940952e-3947987a-4957b6e1-1a823c81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:05.402629Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:05.402648Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 194
2025-10-01T14:07:05.402782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:05.402827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:05.402836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:05.402840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:05.403259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 194 sessionId:  describe result for acl check
2025-10-01T14:07:05.403292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:05.403297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:05.403303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:05.403308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254616401148685:3711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:05.403728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254616401148685:3711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:05.406924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254616401148685:3711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:05.423342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254616401148685:3711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:05.423359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254616401148685:3711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:05.423362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254616401148685:3711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:05.423373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:05.439870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:05.447114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:05.447417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:05.447429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:05.447442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:05.447511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:05.447554Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254614024288589:3444]
2025-10-01T14:07:05.448170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:05.454913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:05.455014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:05.455468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:05.455553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.455561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.455563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.455564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.455565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.455567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.455568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.455573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.455574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.455576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.455577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.455578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.455579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.455581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.455588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.455597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.455602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.455606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.455609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.455613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.455616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.455619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.455623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.455626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.455630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.455633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.455638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.455641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.455652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.455660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.455666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.455672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.455677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.455683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.455688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.455692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.455698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.455704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.455708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.455713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.455718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.455723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.455728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.455733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.455739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.455744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.455748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.455753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.455758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.455764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.455769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.455776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.455782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.455787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.455791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.455796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.455838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:05.463335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 193
2025-10-01T14:07:05.463480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 193
2025-10-01T14:07:05.461474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:05.462427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:05.462433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:05.462437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:05.462441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:05.462450Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 193 [2:7556254614024288589:3444]
2025-10-01T14:07:05.462469Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:05.462489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:05.462492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.462496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.462498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.462514Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:05.462521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:05.462529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:05.462598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.462600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.462602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.462605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:05.462608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:05.462687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:05.462690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.462702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.462711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.462727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:05.462747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254614024288584:3444]
2025-10-01T14:07:05.462750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254614024288584:3444]
2025-10-01T14:07:05.462753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254614024288584:3444]
2025-10-01T14:07:05.462767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:05.462781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:05.462795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:05.462798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:05.462838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254614024288584:3444]
2025-10-01T14:07:05.462841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:05.462950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:05.462952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:05.462955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:05.462960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:05.466411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401148879:3711], now have 1 active actors on pipe
2025-10-01T14:07:05.466432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401148677:2446], now have 1 active actors on pipe
2025-10-01T14:07:05.466454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.466460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.466502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:05.466515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.466519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.466521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:05.466530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.466548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:05.466572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:05.468816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.468855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.468888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:05.469031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 194 partition: 0 MaxSeqNo: 45 sessionId: src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0
2025-10-01T14:07:05.469421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a940952e-3947987a-4957b6e1-1a823c81_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:05.475161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0] Write session: try to update token
2025-10-01T14:07:05.475185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:05.487117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:05.487194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:05.487209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254614024288584:3444]
2025-10-01T14:07:05.487258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:05.487263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:05.487429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:05.487578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:05.487711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:05.487856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:05.488048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:05.488094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:05.490004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254616401148932:3127]
2025-10-01T14:07:05.490239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401148932:3127], now have 1 active actors on pipe
2025-10-01T14:07:05.490292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 193, pipe: [1:7556254616401148932:3127]
2025-10-01T14:07:05.496047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 194 sessionId: src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.498774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.499050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.499076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.499118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:05.499242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.516639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:05.516667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:05.516670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:05.516672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:05.516684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254614024288584:3444]
2025-10-01T14:07:05.516694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254614024288584:3444]
2025-10-01T14:07:05.516698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254614024288584:3444]
2025-10-01T14:07:05.516747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:05.516749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:05.516760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:05.516763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:05.516771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.516774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:05.516928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:05.699376Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:05.708509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.708544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.708808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.708893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.708960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.709027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.709079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.709084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.709167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.709234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.709306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.709372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.709420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.709422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.709495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.709554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.709617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.709686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.709727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.709730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.709796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.709861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.709922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.709985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.710029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.710033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.710100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.710157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.710216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.710282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.710329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.710331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.710663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.710745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.710811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.710876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.710935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.710937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.711010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.711071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.711137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.711203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.711253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.711255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.711330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.711393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.711458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.711522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.711572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.711574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.711640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.711693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.711748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.711802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.711854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.711857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.711921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.711972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.712028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.712082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.712119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.712121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.713405Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:05.713349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254616401148932:3127]
2025-10-01T14:07:05.713378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:05.713380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:05.713380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:05.713413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 194 reason: error at write: Disconnected sessionId: src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0
2025-10-01T14:07:05.713627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 194 sessionId: src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0 is DEAD
2025-10-01T14:07:05.716981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:05.716995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0] Write session will restart in 0.005698s
2025-10-01T14:07:05.717048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0] Write session: Do CDS request
2025-10-01T14:07:05.717055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:05.724759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:05.725698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:05.725717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 195
2025-10-01T14:07:05.725920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:05.725964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:05.725979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:05.725987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:05.727422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 195 sessionId:  describe result for acl check
2025-10-01T14:07:05.727466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:05.727469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:05.727471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:05.727477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254616401148947:3716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:05.728297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254616401148947:3716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:05.732535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254616401148947:3716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:05.737123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254616401148947:3716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:05.737138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254616401148947:3716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:05.737142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254616401148947:3716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:05.737150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:05.755189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:05.756790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:05.757063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:05.757076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:05.757091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:05.757161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:05.757203Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254614024288841:3447]
2025-10-01T14:07:05.757809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:05.758155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:05.758212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:05.759115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:05.759210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.759218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.759219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.759220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.759221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.759223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.759224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.759225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.759226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.759227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.759228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.759229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.759231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.759232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.759239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.759249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.759252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.759256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.759259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.759263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.759266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.759269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.759272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.759276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.759279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.759283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.759286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.759290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.759299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.759306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:05.759312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.759317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:05.759322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.759326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:05.759331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.759336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:05.759341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.759346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:05.759351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.759357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:05.759362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.759368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:05.759373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.759378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:05.759382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.759387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:05.759392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.759397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.759403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.759407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.759412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.759417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.759421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.759426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:05.759431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.759436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:05.759472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:05.766049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:05.767054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:05.767071Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:05.767074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:05.767077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:05.767087Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 194 [2:7556254614024288841:3447]
2025-10-01T14:07:05.767103Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:05.767122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:05.767125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.767129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.767131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.767147Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:05.767158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:05.767164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:05.767229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.767236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.767238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.767243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:05.767245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:05.767318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:05.767325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.767338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:05.767354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:05.767375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:05.767400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401148938:2446], now have 1 active actors on pipe
2025-10-01T14:07:05.767408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401148988:3716], now have 1 active actors on pipe
2025-10-01T14:07:05.767416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254614024288836:3447]
2025-10-01T14:07:05.767420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254614024288836:3447]
2025-10-01T14:07:05.767442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254614024288836:3447]
2025-10-01T14:07:05.767457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:05.767471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:05.767475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:05.767479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:05.767481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:05.767486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:05.767489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:05.767526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254614024288836:3447]
2025-10-01T14:07:05.767538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:05.767544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:05.767677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 194
2025-10-01T14:07:05.767720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 194
2025-10-01T14:07:05.767953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.767969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.767999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfab5487-e01c49fd-64e66e36-9313a073_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:05.768019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.768024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.768027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:05.768037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.768049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:05.768067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:05.768227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.768237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.768253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:05.768323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 195 partition: 0 MaxSeqNo: 45 sessionId: src_id|cfab5487-e01c49fd-64e66e36-9313a073_0
2025-10-01T14:07:05.768722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6db7124-ba5942f9-9e111cdf-19bc95ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cfab5487-e01c49fd-64e66e36-9313a073_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:05.771751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfab5487-e01c49fd-64e66e36-9313a073_0] Write session: try to update token
2025-10-01T14:07:05.771770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfab5487-e01c49fd-64e66e36-9313a073_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:05.786323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:05.786349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:05.786362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254614024288836:3447]
2025-10-01T14:07:05.786437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:05.786612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:05.786757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:05.786894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:05.787029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:05.787225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:05.787277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:05.787355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:05.789305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 195 sessionId: src_id|cfab5487-e01c49fd-64e66e36-9313a073_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:05.792814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:05.793071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.793094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.793145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:05.793266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.813548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254616401149197:3127]
2025-10-01T14:07:05.813793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 194, pipe: [1:7556254616401149197:3127]
2025-10-01T14:07:05.816819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:05.816853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:05.816997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.817051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.817104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.817162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.817216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.817226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.817292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.817353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.817412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.817486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.817538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.817548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.817609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.817690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.817748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.817831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.817868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.817877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.817943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.818001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.818077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.818134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.818184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.818191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.818252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.818309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.818384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.818450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.818593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.818601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.818668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.818720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.818781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.818847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.818895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.818901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.818964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.819022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.819093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.819155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.819205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.819211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.819276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.819346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.819404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.819462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.819511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.819514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.819609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.819683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.819743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.819804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.819856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.819865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.819934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:05.819993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:05.820049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:05.820107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:05.820163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:05.820169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:05.820234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401149197:3127], now have 1 active actors on pipe
2025-10-01T14:07:05.820272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:05.820337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:05.820361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:05.820367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:05.820386Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820401Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820406Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820410Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820418Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820422Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820425Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820429Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820432Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820436Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820442Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820447Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820450Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820454Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820457Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820746Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820758Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820761Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820764Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820766Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820771Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820775Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820778Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820782Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820786Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820790Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820794Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820797Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820801Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.820807Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.821064Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.821072Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.821075Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.821078Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.821082Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:05.821104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:05.821119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:07:05.821126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:07:05.821128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:07:05.821131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:07:05.821506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:07:05.821529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:05.821537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:07:05.821540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:07:05.821542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:07:05.821545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:07:05.822168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:07:05.822191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:05.822198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:07:05.822201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:07:05.822205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:07:05.822208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:07:05.822690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:07:05.822708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:05.822891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327625822
2025-10-01T14:07:05.825717Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:05.825755Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:07:05.825768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:05.825773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:05.825780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:05.825782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:05.825793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254614024288836:3447]
2025-10-01T14:07:05.825801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254614024288836:3447]
2025-10-01T14:07:05.825804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254614024288836:3447]
2025-10-01T14:07:05.825871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:05.825886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:05.825890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:05.825893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:05.825893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:05.825902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:05.826022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:05.992359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:05.993137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:05.995341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfab5487-e01c49fd-64e66e36-9313a073_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:05.995353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfab5487-e01c49fd-64e66e36-9313a073_0] Write session will restart in 0.006184s
2025-10-01T14:07:05.995376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfab5487-e01c49fd-64e66e36-9313a073_0] Write session: Do CDS request
2025-10-01T14:07:05.994881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254616401149197:3127]
2025-10-01T14:07:05.995382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfab5487-e01c49fd-64e66e36-9313a073_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:05.994918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:05.994961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 195 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfab5487-e01c49fd-64e66e36-9313a073_0
2025-10-01T14:07:05.995174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 195 sessionId: src_id|cfab5487-e01c49fd-64e66e36-9313a073_0 is DEAD
2025-10-01T14:07:05.995314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:06.002908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfab5487-e01c49fd-64e66e36-9313a073_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:06.006068Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [bf4e4b6f8020ee0b] Result# TEvPutResult {Id# [72075186224037892:194:1:2:1:6759616:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-01T14:07:06.006690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:06.006704Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 196
2025-10-01T14:07:06.006877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:06.006909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:06.006914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:06.006918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:06.010756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 196 sessionId:  describe result for acl check
2025-10-01T14:07:06.010800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:06.010802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:06.010803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:06.010810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254620696116568:3721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:06.011262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254620696116568:3721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:06.016198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254620696116568:3721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:06.023110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254620696116568:3721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:06.023127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254620696116568:3721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:06.023131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254620696116568:3721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:06.023140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:06.027002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:06.028708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:06.028957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:06.028969Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:06.028981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:06.029046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:06.029087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254618319256407:3450]
2025-10-01T14:07:06.029652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:06.030015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:06.030062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:06.030367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:06.030449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.030455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.030456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.030457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.030458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.030459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.030460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.030461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.030462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.030464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.030465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.030466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.030467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.030468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.030475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.030484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.030488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.030491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.030494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.030497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.030501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.030504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.030507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.030512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.030515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.030518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.030521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.030524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.030531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.030538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.030543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.030549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.030554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.030560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.030569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.030575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.030579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.030589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.030592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.030597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.030606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.030627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.030635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.030640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.030645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.030650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.030668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.030677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.030681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.030690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.030694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.030699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.030707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.030712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.030716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.030725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.030768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:06.036058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:06.036771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:06.036788Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:06.036790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:06.036794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:06.036802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 195 [2:7556254618319256407:3450]
2025-10-01T14:07:06.036818Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:06.036849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:06.036857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.036860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.036862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.036883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:06.036892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:06.036899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:06.036962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.036968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.036970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.036973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:06.036976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:06.037221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 195
2025-10-01T14:07:06.037267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 195
2025-10-01T14:07:06.037051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:06.037059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.037070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.037079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.037093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:06.037111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254616401149218:2446], now have 1 active actors on pipe
2025-10-01T14:07:06.037114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696116751:3721], now have 1 active actors on pipe
2025-10-01T14:07:06.037122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254618319256402:3450]
2025-10-01T14:07:06.037125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254618319256402:3450]
2025-10-01T14:07:06.037127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254618319256402:3450]
2025-10-01T14:07:06.037141Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:06.037155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:06.037158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:06.037162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:06.037164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:06.037171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:06.037174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:06.037214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254618319256402:3450]
2025-10-01T14:07:06.037221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:06.037226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:06.037533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.037546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.037572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:06.037580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.037584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.037586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:06.037598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.037609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:06.037622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:06.037778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.037786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.037801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:06.038526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfab5487-e01c49fd-64e66e36-9313a073_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:06.041158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0] Write session: try to update token
2025-10-01T14:07:06.041178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:06.037890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 196 partition: 0 MaxSeqNo: 45 sessionId: src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0
2025-10-01T14:07:06.072753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:06.072778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:06.072780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:06.072782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:06.072792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254618319256402:3450]
2025-10-01T14:07:06.072797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254618319256402:3450]
2025-10-01T14:07:06.072800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254618319256402:3450]
2025-10-01T14:07:06.072844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:06.072855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:06.072858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:06.072858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:06.072864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.072866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:06.073006Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:06.086873Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 196 sessionId: src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:06.089519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:06.094604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254620696116782:3127]
2025-10-01T14:07:06.095120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 195, pipe: [1:7556254620696116782:3127]
2025-10-01T14:07:06.235776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:06.237317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:06.237364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254620696116782:3127]
2025-10-01T14:07:06.237384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:06.237391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:06.237448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 196 reason: error at write: Disconnected sessionId: src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0
2025-10-01T14:07:06.237635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 196 sessionId: src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0 is DEAD
2025-10-01T14:07:06.237772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:06.237783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0] Write session will restart in 0.005340s
2025-10-01T14:07:06.237810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0] Write session: Do CDS request
2025-10-01T14:07:06.237817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:06.236625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.236645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.236670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696116782:3127], now have 1 active actors on pipe
2025-10-01T14:07:06.236955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:06.243864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:06.244229Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:06.244245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 197
2025-10-01T14:07:06.244369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:06.244425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:06.244436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:06.244439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:06.244914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 197 sessionId:  describe result for acl check
2025-10-01T14:07:06.244946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:06.244951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:06.244953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:06.244958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254620696116814:3733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:06.245482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254620696116814:3733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:06.248098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254620696116814:3733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:06.255699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254620696116814:3733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:06.255717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254620696116814:3733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:06.255719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254620696116814:3733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:06.255727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:06.265794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:06.276113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:06.276397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:06.276411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:06.276425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:06.276494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:06.276568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254618319256692:3465]
2025-10-01T14:07:06.277180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:06.277542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:06.277606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:06.277986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:06.278061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.278067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.278068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.278070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.278071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.278073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.278074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.278076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.278077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.278078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.278080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.278081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.278083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.278084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.278092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.278103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.278108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.278112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.278117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.278121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.278126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.278130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.278135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.278139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.278144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.278147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.278152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.278156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.278164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.278172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.278179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.278185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.278190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.278196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.278201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.278207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.278215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.278220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.278230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.278236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.278245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.278252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.278262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.278267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.278278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.278283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.278286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.278291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.278295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.278299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.278303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.278308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.278315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.278319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.278323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.278329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.278389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:06.287763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:06.288466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:06.288484Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:06.288487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:06.288490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:06.288498Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 196 [2:7556254618319256692:3465]
2025-10-01T14:07:06.288515Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:06.288534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:06.288543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.288547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.288550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.288568Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:06.288577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:06.288585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:06.288653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.288661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.288663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.288666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:06.288669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:06.288744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:06.288752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.288764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.288775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.288794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:06.288819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696116906:3733], now have 1 active actors on pipe
2025-10-01T14:07:06.288844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696116801:2446], now have 1 active actors on pipe
2025-10-01T14:07:06.288864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254618319256687:3465]
2025-10-01T14:07:06.288871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254618319256687:3465]
2025-10-01T14:07:06.288874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254618319256687:3465]
2025-10-01T14:07:06.288890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:06.288910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:06.288932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 196
2025-10-01T14:07:06.288932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:06.288934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:06.288937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:06.288947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:06.288952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:06.288979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254618319256687:3465]
2025-10-01T14:07:06.288988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:06.288994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:06.289037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 196
2025-10-01T14:07:06.289125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.289136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.289162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:06.289175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.289180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.289182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:06.289192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.289202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:06.289221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:06.289375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.289386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.289407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:06.289518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 197 partition: 0 MaxSeqNo: 45 sessionId: src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0
2025-10-01T14:07:06.289889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d713f0d2-c5aa9e71-b2446346-497bbc10_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:06.292548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0] Write session: try to update token
2025-10-01T14:07:06.292569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:06.307830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 197 sessionId: src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:06.309953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:06.309982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:06.309993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254618319256687:3465]
2025-10-01T14:07:06.310047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:06.310307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:06.310515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:06.310706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:06.310893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:06.311154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:06.311199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:06.311381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:06.311533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:06.311756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.311772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.311808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:06.318423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:06.331480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:06.331503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:06.331506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:06.331509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:06.331519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254618319256687:3465]
2025-10-01T14:07:06.331523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254618319256687:3465]
2025-10-01T14:07:06.331526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254618319256687:3465]
2025-10-01T14:07:06.331573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:06.331577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:06.331580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.331582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:06.331583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:06.331585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:06.331709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:06.337334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254620696117060:3127]
2025-10-01T14:07:06.337642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 196, pipe: [1:7556254620696117060:3127]
2025-10-01T14:07:06.501206Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:06.509962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.509993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.510151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.510211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.510273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.510340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.510633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.510644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.510710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.510769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.510829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.510887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.510929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.510931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.510994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.511051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.511133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.511189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.511236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.511238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.511308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.511367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.511427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.511480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.511849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.511853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.511913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.511963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.512016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.512065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.512105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.512107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.512167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.512233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.512303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.512357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.512421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.512423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.512482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.512536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.512594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.512648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.512685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.512687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.512742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.512798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.512867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.512917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.512964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.512967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.513035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.513092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.513146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.513200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.513242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.513244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.513313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:06.513371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:06.513424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:06.513481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:06.513518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:06.513520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:06.513610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696117060:3127], now have 1 active actors on pipe
2025-10-01T14:07:06.514081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:06.514178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254620696117060:3127]
2025-10-01T14:07:06.514423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:06.514491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:06.514536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 197 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0
2025-10-01T14:07:06.514815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 197 sessionId: src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0 is DEAD
2025-10-01T14:07:06.514980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:06.514995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0] Write session will restart in 0.005300s
2025-10-01T14:07:06.515031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0] Write session: Do CDS request
2025-10-01T14:07:06.515039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:06.521959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:06.522435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:06.522451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 198
2025-10-01T14:07:06.522623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:06.522656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:06.522666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:06.522679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:06.523194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 198 sessionId:  describe result for acl check
2025-10-01T14:07:06.523227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:06.523233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:06.523235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:06.523240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254620696117070:3737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:06.523710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254620696117070:3737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:06.526908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254620696117070:3737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:06.534141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254620696117070:3737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:06.534158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254620696117070:3737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:06.534162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254620696117070:3737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:06.534171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:06.563733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:06.565796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:06.566012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:06.566028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:06.566042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:06.566100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:06.566148Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254618319256949:3467]
2025-10-01T14:07:06.566786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:06.567296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:06.567352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:06.567685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:06.567748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.567749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.567751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.567752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.567753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.567754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.567755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.567756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.567757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.567758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.567759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.567760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.567760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.567762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.567767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.567777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.567780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.567784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.567788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.567791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.567794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.567797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.567801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.567807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.567810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.567813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.567817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.567820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.567828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.567836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.567842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.567847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.567851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.567858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.567862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.567867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.567872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.567877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.567881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.567885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.567893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.567897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.567901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.567906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.567910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.567914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.567918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.567922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.567927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.567933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.567938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.567944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.567950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.567956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.567960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.567983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.568027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:06.574595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:06.575453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:06.575459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:06.575462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:06.575466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:06.575474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 197 [2:7556254618319256949:3467]
2025-10-01T14:07:06.575495Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:06.575515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:06.575518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.575523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.575525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.575543Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:06.575567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:06.575575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:06.575645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.575647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.575649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.575653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:06.575656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:06.575730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:06.575733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.575746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.575758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.575774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:06.575791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254618319256943:3467]
2025-10-01T14:07:06.575793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254618319256943:3467]
2025-10-01T14:07:06.575795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254618319256943:3467]
2025-10-01T14:07:06.575805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:06.575820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:06.575820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:06.575823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:06.575825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:06.575837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:06.575840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:06.575851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696117063:2446], now have 1 active actors on pipe
2025-10-01T14:07:06.575855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696117110:3737], now have 1 active actors on pipe
2025-10-01T14:07:06.575897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254618319256943:3467]
2025-10-01T14:07:06.575906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:06.576204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:06.576537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.576548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.576578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:06.576587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.576592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.576595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:06.576606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.576616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:06.576636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:06.578230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.578243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.578268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:06.576202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 197
2025-10-01T14:07:06.576250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 197
2025-10-01T14:07:06.578458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 198 partition: 0 MaxSeqNo: 45 sessionId: src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0
2025-10-01T14:07:06.578949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada7acfb-79d7e32-f7985aae-ff58027d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:06.581725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0] Write session: try to update token
2025-10-01T14:07:06.581752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:06.611192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254620696117325:3127]
2025-10-01T14:07:06.612218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 197, pipe: [1:7556254620696117325:3127]
2025-10-01T14:07:06.607537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:06.607563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:06.607565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:06.607568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:06.607580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254618319256943:3467]
2025-10-01T14:07:06.607586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254618319256943:3467]
2025-10-01T14:07:06.607589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254618319256943:3467]
2025-10-01T14:07:06.607643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:06.607651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.607653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:06.607828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:06.608343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:06.608350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:06.608354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:06.625650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 198 sessionId: src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:06.628428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:06.772820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:06.773179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696117325:3127], now have 1 active actors on pipe
2025-10-01T14:07:06.773237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.773249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.773757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:06.773831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:06.773838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:06.773924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 198 reason: error at write: Disconnected sessionId: src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0
2025-10-01T14:07:06.774062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254620696117325:3127]
2025-10-01T14:07:06.774125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 198 sessionId: src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0 is DEAD
2025-10-01T14:07:06.774434Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:06.774693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:06.774705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0] Write session will restart in 0.009152s
2025-10-01T14:07:06.774738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0] Write session: Do CDS request
2025-10-01T14:07:06.774745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:06.785404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:06.785455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:06.785470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 199
2025-10-01T14:07:06.785638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:06.785669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:06.785676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:06.785681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:06.786408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 199 sessionId:  describe result for acl check
2025-10-01T14:07:06.786450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:06.786452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:06.786453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:06.786459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254620696117351:3742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:06.787011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254620696117351:3742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:06.791285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254620696117351:3742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:06.794577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254620696117351:3742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:06.794593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254620696117351:3742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:06.794597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254620696117351:3742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:06.794605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:06.804798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:06.806931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:06.807200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:06.807214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:06.807226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:06.807287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:06.807330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254618319257203:3470]
2025-10-01T14:07:06.807918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:06.808249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:06.808317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:06.808652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:06.808738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.808745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.808747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.808748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.808749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.808750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.808752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.808753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.808755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.808757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.808758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.808759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.808760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.808762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.808767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.808778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.808782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.808785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.808789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.808793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.808796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.808800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.808804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.808807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.808811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.808814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.808818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.808821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.808840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.808848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:06.808855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.808860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:06.808865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.808871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:06.808874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.808879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:06.808889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.808895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:06.808900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.808909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:06.808914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.808918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:06.808929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.808943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:06.808952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.808957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:06.808961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.808966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.808975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.808980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.808984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.808989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.808994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.809000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:06.809004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.809008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:06.809043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:06.814206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:06.815356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:06.815379Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:06.815382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:06.815386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:06.815393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 198 [2:7556254618319257203:3470]
2025-10-01T14:07:06.815409Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:06.815436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:06.815448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.815453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.815456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.815478Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:06.815502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:06.815510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:06.815597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.815606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.815608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.815612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:06.815615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:06.815716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:06.815728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.815746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:06.815763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:06.815783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:06.815812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696117328:2446], now have 1 active actors on pipe
2025-10-01T14:07:06.815801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 198
2025-10-01T14:07:06.815822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696117445:3742], now have 1 active actors on pipe
2025-10-01T14:07:06.815832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254618319257198:3470]
2025-10-01T14:07:06.815835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254618319257198:3470]
2025-10-01T14:07:06.815816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 198
2025-10-01T14:07:06.815838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254618319257198:3470]
2025-10-01T14:07:06.815851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:06.815856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:06.815859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:06.815861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:06.815869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:06.815886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:06.815889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:06.815918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.815930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.815979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254618319257198:3470]
2025-10-01T14:07:06.815992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:06.816001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:06.816010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0403c02-2b060b9d-906453b-e4665d2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:06.816018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:06.816027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:06.816029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:06.816037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:06.816045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:06.816078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:06.816366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.816374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.816387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:06.816503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 199 partition: 0 MaxSeqNo: 45 sessionId: src_id|c0403c02-2b060b9d-906453b-e4665d2f_0
2025-10-01T14:07:06.816910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3894a0ba-cf3218c4-1078dd20-6616d981_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c0403c02-2b060b9d-906453b-e4665d2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:06.819470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0403c02-2b060b9d-906453b-e4665d2f_0] Write session: try to update token
2025-10-01T14:07:06.819490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0403c02-2b060b9d-906453b-e4665d2f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:06.834232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 199 sessionId: src_id|c0403c02-2b060b9d-906453b-e4665d2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:06.836705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:06.836895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:06.836918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:06.836954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:06.837021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:06.846047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:06.846067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:06.846069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:06.846072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:06.846082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254618319257198:3470]
2025-10-01T14:07:06.846086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254618319257198:3470]
2025-10-01T14:07:06.846090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254618319257198:3470]
2025-10-01T14:07:06.846130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:06.846135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:06.846138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:06.846138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:06.846145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:06.846148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:06.846286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:06.874426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254620696117600:3127]
2025-10-01T14:07:06.874731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 198, pipe: [1:7556254620696117600:3127]
2025-10-01T14:07:07.014264Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:07.022969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.023000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.023166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.023227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.023290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.023357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.023397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.023401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.023468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.023521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.023575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.023632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.023833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.023836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.023894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.023940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.023994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.024045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.024080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.024082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.024141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.024193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.026429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254620696117600:3127]
2025-10-01T14:07:07.024245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.026460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:07.026495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:07.026498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:07.024295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.024336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.024338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.026524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 199 reason: error at write: Disconnected sessionId: src_id|c0403c02-2b060b9d-906453b-e4665d2f_0
2025-10-01T14:07:07.024394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.024439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.024489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.024540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.024581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.024583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.024664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.024728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.024784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.024854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.024898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.024901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.024976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.025035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.025102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.025166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.025216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.025219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.025297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.025358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.025419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.025479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.025528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.025533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.025600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.025657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.025717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.025773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.025812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.025815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.025880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:07.025931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:07.025989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:07.026043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:07.026081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:07.026083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:07.026173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254620696117600:3127], now have 1 active actors on pipe
2025-10-01T14:07:07.026741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 199 sessionId: src_id|c0403c02-2b060b9d-906453b-e4665d2f_0 is DEAD
2025-10-01T14:07:07.026880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0403c02-2b060b9d-906453b-e4665d2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:07.026901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0403c02-2b060b9d-906453b-e4665d2f_0] Write session will restart in 0.008212s
2025-10-01T14:07:07.026927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0403c02-2b060b9d-906453b-e4665d2f_0] Write session: Do CDS request
2025-10-01T14:07:07.026933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0403c02-2b060b9d-906453b-e4665d2f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:07.027414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:07.035973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0403c02-2b060b9d-906453b-e4665d2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.038696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:07.038714Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 200
2025-10-01T14:07:07.038845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.038879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:07.038890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:07.038894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:07.039365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 200 sessionId:  describe result for acl check
2025-10-01T14:07:07.039398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:07.039403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:07.039405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:07.039410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254624991084919:3749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:07.039999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254624991084919:3749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:07.042262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254624991084919:3749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:07.045730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254624991084919:3749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:07.045745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254624991084919:3749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:07.045749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254624991084919:3749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:07.045758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:07.059371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:07.064147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:07.064434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:07.064452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:07.064466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:07.064533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:07.064579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254622614224766:3473]
2025-10-01T14:07:07.065215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:07.066030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:07.066112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:07.066516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:07.066596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.066602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.066603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.066605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.066606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.066608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.066609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.066610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.066612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.066613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.066615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.066616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.066618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.066619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.066626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.066637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.066641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.066645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.066649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.066653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.066657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.066661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.066664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.066669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.066672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.066676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.066680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.066683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.066690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.066698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.066705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.066709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.066712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.066717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.066721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.066725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.066729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.066733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.066737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.066741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.066746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.066751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.066755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.066759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.066764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.066779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.066784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.066788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.066792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.066796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.066800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.066804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.066808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.066814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.066818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.066823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.066868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:07.074405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:07.075188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:07.075208Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:07.075211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:07.075215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:07.075222Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 199 [2:7556254622614224766:3473]
2025-10-01T14:07:07.075240Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:07.075256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:07.075260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.075263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.075266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.075283Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:07.075308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:07.075319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:07.075382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.075389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.075390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.075394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:07.075396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:07.075466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:07.075473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.075486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.075502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.075523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:07.075545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254622614224760:3473]
2025-10-01T14:07:07.075551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254622614224760:3473]
2025-10-01T14:07:07.075553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254622614224760:3473]
2025-10-01T14:07:07.075563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:07.075571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:07.075574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:07.075576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:07.075584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991084982:3749], now have 1 active actors on pipe
2025-10-01T14:07:07.075588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991084904:2446], now have 1 active actors on pipe
2025-10-01T14:07:07.075594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:07.075614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:07.075624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:07.075662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254622614224760:3473]
2025-10-01T14:07:07.075665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:07.075648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 199
2025-10-01T14:07:07.075688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 199
2025-10-01T14:07:07.076926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:07.077038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.077057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.077091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:07.077105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.077115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.077117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:07.077129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.077148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:07.077174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:07.077378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.077392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.077425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:07.077509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 200 partition: 0 MaxSeqNo: 45 sessionId: src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0
2025-10-01T14:07:07.077966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0403c02-2b060b9d-906453b-e4665d2f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:07.083715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0] Write session: try to update token
2025-10-01T14:07:07.083737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:07.105027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 200 sessionId: src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:07.108966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:07.108985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:07.108987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:07.108989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:07.108999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254622614224760:3473]
2025-10-01T14:07:07.109004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254622614224760:3473]
2025-10-01T14:07:07.109007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254622614224760:3473]
2025-10-01T14:07:07.109061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:07.109074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.109077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:07.109212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:07.110507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:07.110523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:07.110528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:07.110874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:07.126808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254624991085187:3127]
2025-10-01T14:07:07.127089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 199, pipe: [1:7556254624991085187:3127]
2025-10-01T14:07:07.266245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:07.266933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.266953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.267001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991085187:3127], now have 1 active actors on pipe
2025-10-01T14:07:07.267197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:07.268069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:07.268120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254624991085187:3127]
2025-10-01T14:07:07.268143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:07.268205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 200 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0
2025-10-01T14:07:07.268370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 200 sessionId: src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0 is DEAD
2025-10-01T14:07:07.268530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:07.268540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0] Write session will restart in 0.006529s
2025-10-01T14:07:07.268569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0] Write session: Do CDS request
2025-10-01T14:07:07.268576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:07.275980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.277883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:07.277900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 201
2025-10-01T14:07:07.278090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.278128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:07.278139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:07.278143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:07.278556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 201 sessionId:  describe result for acl check
2025-10-01T14:07:07.278594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:07.278600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:07.278602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:07.278608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254624991085208:3761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:07.279151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254624991085208:3761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:07.281363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254624991085208:3761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:07.284582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254624991085208:3761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:07.284597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254624991085208:3761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:07.284600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254624991085208:3761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:07.284608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:07.297834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:07.299315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:07.299533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:07.299543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:07.299552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:07.299587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:07.299620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254622614225058:3488]
2025-10-01T14:07:07.300031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:07.300267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:07.300310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:07.300552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:07.300601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.300605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.300606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.300607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.300608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.300609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.300609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.300610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.300611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.300611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.300612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.300612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.300614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.300614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.300618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.300624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.300626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.300628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.300631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.300633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.300635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.300637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.300639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.300641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.300643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.300645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.300647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.300649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.300654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.300660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.300663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.300666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.300669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.300671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.300674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.300677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.300679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.300693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.300698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.300702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.300706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.300712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.300716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.300721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.300726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.300731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.300736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.300740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.300745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.300750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.300754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.300756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.300759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.300762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.300764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.300767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.300788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:07.307912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:07.308599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:07.308613Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:07.308616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:07.308620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:07.308627Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 200 [2:7556254622614225058:3488]
2025-10-01T14:07:07.308645Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:07.308665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:07.308668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.308672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.308674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.308692Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:07.308703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:07.308711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:07.308780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.308787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.308789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.308792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:07.308794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:07.308872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:07.308879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.308891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.308907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.308927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:07.308951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991085248:3761], now have 1 active actors on pipe
2025-10-01T14:07:07.308959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991085200:2446], now have 1 active actors on pipe
2025-10-01T14:07:07.308967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254622614225053:3488]
2025-10-01T14:07:07.308973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254622614225053:3488]
2025-10-01T14:07:07.308975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254622614225053:3488]
2025-10-01T14:07:07.308989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:07.309005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:07.309022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:07.309025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:07.309032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:07.309035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:07.309037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:07.309003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 200
2025-10-01T14:07:07.309064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254622614225053:3488]
2025-10-01T14:07:07.309071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:07.309004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 200
2025-10-01T14:07:07.309074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:07.309087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.309093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.309145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2422423a-8f61e212-fad0075e-90fb211a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:07.309155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.309161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.309167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:07.309178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.309190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:07.309213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:07.309406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.309413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.309428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:07.309513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 201 partition: 0 MaxSeqNo: 45 sessionId: src_id|2422423a-8f61e212-fad0075e-90fb211a_0
2025-10-01T14:07:07.309949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c98c56f-1760323a-bd248bc6-3cf407d3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2422423a-8f61e212-fad0075e-90fb211a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:07.312328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2422423a-8f61e212-fad0075e-90fb211a_0] Write session: try to update token
2025-10-01T14:07:07.312347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2422423a-8f61e212-fad0075e-90fb211a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:07.331256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:07.331276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:07.331278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:07.331280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:07.331291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254622614225053:3488]
2025-10-01T14:07:07.331296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254622614225053:3488]
2025-10-01T14:07:07.331302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254622614225053:3488]
2025-10-01T14:07:07.331351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:07.331353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:07.331360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:07.331363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.331364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:07.331365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:07.331503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:07.333850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 201 sessionId: src_id|2422423a-8f61e212-fad0075e-90fb211a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:07.336857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:07.368471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254624991085463:3127]
2025-10-01T14:07:07.368713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 200, pipe: [1:7556254624991085463:3127]
2025-10-01T14:07:07.484630Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:07.485431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.485449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.485494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991085463:3127], now have 1 active actors on pipe
2025-10-01T14:07:07.485708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:07.485755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:07.485824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 201 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2422423a-8f61e212-fad0075e-90fb211a_0
2025-10-01T14:07:07.485685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:07.486021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 201 sessionId: src_id|2422423a-8f61e212-fad0075e-90fb211a_0 is DEAD
2025-10-01T14:07:07.486145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254624991085463:3127]
2025-10-01T14:07:07.486172Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:07:07.486201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2422423a-8f61e212-fad0075e-90fb211a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:07.486216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2422423a-8f61e212-fad0075e-90fb211a_0] Write session will restart in 0.007039s
2025-10-01T14:07:07.486243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2422423a-8f61e212-fad0075e-90fb211a_0] Write session: Do CDS request
2025-10-01T14:07:07.486250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2422423a-8f61e212-fad0075e-90fb211a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:07.486268Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_1_2_13227607149598433976_v1 is DEAD
2025-10-01T14:07:07.486439Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:07:07.486493Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254521911847727:3124] disconnected; active server actors: 1
2025-10-01T14:07:07.486504Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254521911847727:3124] client user disconnected session shared/user_1_2_13227607149598433976_v1
2025-10-01T14:07:07.486542Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:07.486547Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:07.486555Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.009551s
2025-10-01T14:07:07.493943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2422423a-8f61e212-fad0075e-90fb211a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.494307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:07.494318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 202
2025-10-01T14:07:07.494620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.494661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:07.494667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:07.494671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:07.495271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 202 sessionId:  describe result for acl check
2025-10-01T14:07:07.495304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:07.495310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:07.495312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:07.495318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254624991085482:3765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:07.495839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254624991085482:3765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:07.496741Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:07:07.496944Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:07:07.496953Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-10-01T14:07:07.497233Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:07.497275Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:07.497362Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 auth for : user
2025-10-01T14:07:07.498572Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 Handle describe topics response
2025-10-01T14:07:07.498599Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 auth is DEAD
2025-10-01T14:07:07.498615Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:07:07.498878Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:07:07.498994Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254624991085554:3769] connected; active server actors: 1
2025-10-01T14:07:07.499019Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_3_9516708466741600635_v1
2025-10-01T14:07:07.499012Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556254624991085554:3769] session shared/user_1_3_9516708466741600635_v1
2025-10-01T14:07:07.499021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:07:07.499031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:07:07.499036Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_3_9516708466741600635_v1" (Sender=[1:7556254624991085516:3769], Pipe=[1:7556254624991085554:3769], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:07.499039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:07.499050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:07:07.499057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_3_9516708466741600635_v1" (Sender=[1:7556254624991085516:3769], Pipe=[1:7556254624991085554:3769], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:07.499067Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_3_9516708466741600635_v1" sender [1:7556254624991085516:3769] lock partition 0 for ReadingSession "shared/user_1_3_9516708466741600635_v1" (Sender=[1:7556254624991085516:3769], Pipe=[1:7556254624991085554:3769], Partitions=[], ActiveFamilyCount=1) generation 1 step 3
2025-10-01T14:07:07.499079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:07:07.499087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-10-01T14:07:07.499311Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 3 Session: "shared/user_1_3_9516708466741600635_v1" ClientId: "user" PipeClient { RawX1: 7556254624991085554 RawX2: 4503603922341561 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:07:07.499330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:07:07.499529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254624991085482:3765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:07.503431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254624991085482:3765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:07.503448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254624991085482:3765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:07.503451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254624991085482:3765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:07.503461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:07.507524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:07.509880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:07.510105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:07.510116Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:07.510126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:07.510186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:07.510237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254622614225315:3490]
2025-10-01T14:07:07.510837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:07.511159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:07.511222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:07.511566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:07.511637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.511643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.511644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.511645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.511646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.511647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.511648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.511649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.511650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.511651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.511652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.511653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.511654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.511656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.511660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.511669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.511673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.511676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.511679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.511682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.511685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.511688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.511691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.511695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.511698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.511701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.511705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.511707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.511715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.511722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.511727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.511732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.511736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.511741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.511745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.511749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.511753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.511763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.511767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.511771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.511780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.511785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.511789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.511794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.511798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.511802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.511810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.511814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.511818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.511826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.511830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.511834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.511838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.511843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.511847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.511851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.511887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:07.516225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:07.517353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:07.517370Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:07.517372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:07.517376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:07.517381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 201 [2:7556254622614225315:3490]
2025-10-01T14:07:07.517398Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:07.517414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:07.517417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.517421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.517422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.517440Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:07.517445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:07.517450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:07.517524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.517526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.517528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.518066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 201
2025-10-01T14:07:07.518074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 201, pipe: [1:7556254624991085557:3772]
2025-10-01T14:07:07.518094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 201
2025-10-01T14:07:07.517531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:07.517534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:07.517599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:07.517602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.517614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.517623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.517636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:07.517651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254622614225310:3490]
2025-10-01T14:07:07.517654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254622614225310:3490]
2025-10-01T14:07:07.517655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254622614225310:3490]
2025-10-01T14:07:07.517670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:07.517684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:07.517697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:07.517696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:07.517699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:07.517708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:07.517710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:07.517741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254622614225310:3490]
2025-10-01T14:07:07.517743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:07.517800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:07.517980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991085466:2446], now have 1 active actors on pipe
2025-10-01T14:07:07.517984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991085557:3772], now have 1 active actors on pipe
2025-10-01T14:07:07.517986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991085658:3765], now have 1 active actors on pipe
2025-10-01T14:07:07.518561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.518575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.518588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_3_9516708466741600635_v1 on pipe: [1:7556254624991085557:3772]
2025-10-01T14:07:07.518608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.518614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.518629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.518639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.518641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:07.518666Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_3_9516708466741600635_v1
2025-10-01T14:07:07.518673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.518685Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_3_9516708466741600635_v1:1 with generation 201
2025-10-01T14:07:07.518708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31889408-318a8391-eeb3e653-d1c74ccc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:07.518718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:07.518723Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:07.523134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:07.523180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:07.523190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.523197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.523201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:07.523223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.523238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:07.523246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:07:07.523261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:07:07.523282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:07.523424Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327627516 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:07:07.523446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:07:07.523488Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 sending to client partition status
2025-10-01T14:07:07.525583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.525602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.525639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:07.525773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 202 partition: 0 MaxSeqNo: 45 sessionId: src_id|31889408-318a8391-eeb3e653-d1c74ccc_0
2025-10-01T14:07:07.526106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2422423a-8f61e212-fad0075e-90fb211a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31889408-318a8391-eeb3e653-d1c74ccc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:07.528428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31889408-318a8391-eeb3e653-d1c74ccc_0] Write session: try to update token
2025-10-01T14:07:07.528445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31889408-318a8391-eeb3e653-d1c74ccc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:07.543986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 202 sessionId: src_id|31889408-318a8391-eeb3e653-d1c74ccc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:07.548437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:07.548450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:07.548452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:07.548454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:07.548461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254622614225310:3490]
2025-10-01T14:07:07.548464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254622614225310:3490]
2025-10-01T14:07:07.548467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254622614225310:3490]
2025-10-01T14:07:07.548514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:07.548518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:07.548522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:07.548526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:07.548534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.548537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:07.548671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:07.549189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:07.711033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:07.711310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.711337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.711571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_3_9516708466741600635_v1
2025-10-01T14:07:07.711592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:07.711555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:07.711579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254624991085557:3772]
2025-10-01T14:07:07.711607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:07.711610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:07.711621Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_3_9516708466741600635_v1
2025-10-01T14:07:07.711669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 202 reason: error at write: Disconnected sessionId: src_id|31889408-318a8391-eeb3e653-d1c74ccc_0
2025-10-01T14:07:07.711867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 202 sessionId: src_id|31889408-318a8391-eeb3e653-d1c74ccc_0 is DEAD
2025-10-01T14:07:07.712009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31889408-318a8391-eeb3e653-d1c74ccc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:07.712023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31889408-318a8391-eeb3e653-d1c74ccc_0] Write session will restart in 0.008384s
2025-10-01T14:07:07.712046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31889408-318a8391-eeb3e653-d1c74ccc_0] Write session: Do CDS request
2025-10-01T14:07:07.712052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31889408-318a8391-eeb3e653-d1c74ccc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:07.721921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31889408-318a8391-eeb3e653-d1c74ccc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.722080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:07.722097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 203
2025-10-01T14:07:07.722599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.722637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:07.722647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:07.722650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:07.723732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 203 sessionId:  describe result for acl check
2025-10-01T14:07:07.723773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:07.723783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:07.723786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:07.723791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254624991085754:3774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:07.724746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254624991085754:3774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:07.736140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254624991085754:3774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:07.741834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254624991085754:3774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:07.741851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254624991085754:3774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:07.741861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254624991085754:3774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:07.741870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:07.750677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:07.752978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:07.753239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:07.753248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:07.753259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:07.753309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:07.753345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254622614225575:3493]
2025-10-01T14:07:07.753994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:07.754338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:07.754402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:07.754728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:07.754780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.754787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.754788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.754790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.754791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.754792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.754793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.754795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.754796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.754797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.754799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.754800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.754801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.754802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.754808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.754818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.754822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.754826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.754838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.754842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.754846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.754850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.754854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.754858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.754862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.754865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.754869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.754873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.754880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.754887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:07.754893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.754898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:07.754903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.754908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:07.754913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.754917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:07.754922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.754926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:07.754930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.754935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:07.754940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.754945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:07.754949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.754953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:07.754957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.754961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:07.754965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.754969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.754973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.754978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.754984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.754996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.755000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.755005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:07.755009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.755014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:07.755049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:07.759792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:07.760541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:07.760556Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:07.760559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:07.760562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:07.760569Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 202 [2:7556254622614225575:3493]
2025-10-01T14:07:07.760586Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:07.760603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:07.760613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.760616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.760618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.760633Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:07.760639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:07.760645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:07.760713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.760715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.760717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.760721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:07.760724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:07.761045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 202
2025-10-01T14:07:07.761101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 202
2025-10-01T14:07:07.761143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:07.761153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.761168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:07.761181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:07.761199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:07.761220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991085741:2446], now have 1 active actors on pipe
2025-10-01T14:07:07.761224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991085870:3774], now have 1 active actors on pipe
2025-10-01T14:07:07.761232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254622614225570:3493]
2025-10-01T14:07:07.761234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254622614225570:3493]
2025-10-01T14:07:07.761236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254622614225570:3493]
2025-10-01T14:07:07.761251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:07.761265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:07.761274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:07.761278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:07.761280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:07.761281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:07.761285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:07.761324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254622614225570:3493]
2025-10-01T14:07:07.761334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:07.761350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:07.761360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.761364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.761413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acc8431e-d0742445-c84d166e-1d3bef8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:07.761420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:07.761425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:07.761427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:07.761436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:07.761445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:07.761474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:07.761787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.761796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.761811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:07.761962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 203 partition: 0 MaxSeqNo: 45 sessionId: src_id|acc8431e-d0742445-c84d166e-1d3bef8_0
2025-10-01T14:07:07.764966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31889408-318a8391-eeb3e653-d1c74ccc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|acc8431e-d0742445-c84d166e-1d3bef8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:07.767412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc8431e-d0742445-c84d166e-1d3bef8_0] Write session: try to update token
2025-10-01T14:07:07.767434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc8431e-d0742445-c84d166e-1d3bef8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:07.795446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:07.795465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:07.795468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:07.795469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:07.795478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254622614225570:3493]
2025-10-01T14:07:07.795482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254622614225570:3493]
2025-10-01T14:07:07.795486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254622614225570:3493]
2025-10-01T14:07:07.795531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:07.795537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:07.795540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:07.795691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:07.797105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:07.797111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:07.797115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:07.802468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 203 sessionId: src_id|acc8431e-d0742445-c84d166e-1d3bef8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:07.805724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:07.811902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254624991086006:3772]
2025-10-01T14:07:07.812469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 202, pipe: [1:7556254624991086006:3772]
2025-10-01T14:07:07.958386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:07.958766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:07.958784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:07.958824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991086006:3772], now have 1 active actors on pipe
2025-10-01T14:07:07.959104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:07.960398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc8431e-d0742445-c84d166e-1d3bef8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:07.960413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc8431e-d0742445-c84d166e-1d3bef8_0] Write session will restart in 0.005409s
2025-10-01T14:07:07.960442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc8431e-d0742445-c84d166e-1d3bef8_0] Write session: Do CDS request
2025-10-01T14:07:07.960449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc8431e-d0742445-c84d166e-1d3bef8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:07.959903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:07.960020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 203 reason: status is not ok: tablet will be restarted right now sessionId: src_id|acc8431e-d0742445-c84d166e-1d3bef8_0
2025-10-01T14:07:07.960191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 203 sessionId: src_id|acc8431e-d0742445-c84d166e-1d3bef8_0 is DEAD
2025-10-01T14:07:07.960335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254624991086006:3772]
2025-10-01T14:07:07.960350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:07.969008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc8431e-d0742445-c84d166e-1d3bef8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.969111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:07.969129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 204
2025-10-01T14:07:07.969489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:07.969526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:07.969531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:07.969535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:07.970212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 204 sessionId:  describe result for acl check
2025-10-01T14:07:07.970263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:07.970265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:07.970271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:07.970276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254624991086033:3779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:07.971181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254624991086033:3779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:07.974204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254624991086033:3779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:07.988808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254624991086033:3779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:07.988843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254624991086033:3779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:07.988849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254624991086033:3779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:07.988859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:08.018329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:08.020756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:08.021034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:08.021039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:08.021051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:08.021111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:08.021150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254626909193141:3496]
2025-10-01T14:07:08.021811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:08.024690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:08.024764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:08.025175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:08.025259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.025265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.025266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.025268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.025269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.025271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.025272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.025274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.025275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.025276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.025277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.025279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.025280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.025282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.025289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.025299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.025302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.025306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.025309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.025313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.025316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.025323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.025327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.025331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.025335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.025338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.025341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.025345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.025355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.025363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.025368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.025374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.025379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.025385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.025390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.025400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.025408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.025417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.025422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.025431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.025437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.025447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.025453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.025463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.025468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.025473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.025477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.025482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.025490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.025496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.025501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.025508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.025513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.025521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.025526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.025535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.025582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:08.031266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:08.032034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:08.032052Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:08.032055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:08.032061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:08.032069Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 203 [2:7556254626909193141:3496]
2025-10-01T14:07:08.032089Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:08.032115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:08.032122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.032126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.032128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.032146Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:08.032157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:08.032170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:08.032238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.032245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.032247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.032250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:08.032252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:08.032329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:08.032336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.032355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.032366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.032383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:08.032402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254626909193136:3496]
2025-10-01T14:07:08.032404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254626909193136:3496]
2025-10-01T14:07:08.032407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254626909193136:3496]
2025-10-01T14:07:08.032425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:08.032438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:08.032453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:08.032456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:08.032502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254626909193136:3496]
2025-10-01T14:07:08.032505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:08.032704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:08.032707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:08.032711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:08.032717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:08.033258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 203
2025-10-01T14:07:08.033294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 203
2025-10-01T14:07:08.033548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991086095:3779], now have 1 active actors on pipe
2025-10-01T14:07:08.033560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254624991086024:2446], now have 1 active actors on pipe
2025-10-01T14:07:08.033727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.033735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.033767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e70d6cf-4455825b-66b40d37-124918eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:08.033777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.033781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.033784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:08.033796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.033810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:08.033829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.034032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.034038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.034055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.034199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 204 partition: 0 MaxSeqNo: 45 sessionId: src_id|7e70d6cf-4455825b-66b40d37-124918eb_0
2025-10-01T14:07:08.034666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc8431e-d0742445-c84d166e-1d3bef8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7e70d6cf-4455825b-66b40d37-124918eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:08.037809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e70d6cf-4455825b-66b40d37-124918eb_0] Write session: try to update token
2025-10-01T14:07:08.037828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e70d6cf-4455825b-66b40d37-124918eb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:08.060214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254629286053580:3772]
2025-10-01T14:07:08.060563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 203, pipe: [1:7556254629286053580:3772]
2025-10-01T14:07:08.062632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286053580:3772], now have 1 active actors on pipe
2025-10-01T14:07:08.078044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 204 sessionId: src_id|7e70d6cf-4455825b-66b40d37-124918eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:08.081223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:08.081451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.081473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.081510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:08.081799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:08.084820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:08.084851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:08.084854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:08.084856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:08.084866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254626909193136:3496]
2025-10-01T14:07:08.084871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254626909193136:3496]
2025-10-01T14:07:08.084877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254626909193136:3496]
2025-10-01T14:07:08.084933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:08.084948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.084951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:08.085079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:08.085089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:08.085096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:08.085100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:08.240136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:08.249396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.249422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.249598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.249662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.249727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.249800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.249852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.249860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.249935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.249997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.250072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.250133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.250180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.250183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.250248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.250304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.250362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.250435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.250481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.250490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.250556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.250888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.250952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.251061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.251107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.251113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.251224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.251285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.251347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.251408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.251474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.251485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.251561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.251632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.251698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.251764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.251812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.251821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.251893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.251979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.252052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.252123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.252190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.252196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.252276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.252345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.252415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.252484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.252536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.252542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.252611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.252671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.252738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.252799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.252876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.252883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.252952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:08.253010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:08.253075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:08.253142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:08.253188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:08.253195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:08.253975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:08.254054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254629286053580:3772]
2025-10-01T14:07:08.254086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:08.254093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:08.254121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 204 reason: error at write: Disconnected sessionId: src_id|7e70d6cf-4455825b-66b40d37-124918eb_0
2025-10-01T14:07:08.254177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:08.254531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e70d6cf-4455825b-66b40d37-124918eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:08.254544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e70d6cf-4455825b-66b40d37-124918eb_0] Write session will restart in 0.008030s
2025-10-01T14:07:08.254567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e70d6cf-4455825b-66b40d37-124918eb_0] Write session: Do CDS request
2025-10-01T14:07:08.254574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e70d6cf-4455825b-66b40d37-124918eb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:08.254284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 204 sessionId: src_id|7e70d6cf-4455825b-66b40d37-124918eb_0 is DEAD
2025-10-01T14:07:08.264280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e70d6cf-4455825b-66b40d37-124918eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:08.266203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:08.266219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 205
2025-10-01T14:07:08.268408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:08.268461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:08.268468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:08.268473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:08.273282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 205 sessionId:  describe result for acl check
2025-10-01T14:07:08.273325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:08.273326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:08.273331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:08.273337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254629286053636:3791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:08.273873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254629286053636:3791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:08.282185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254629286053636:3791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:08.288672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254629286053636:3791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:08.288697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254629286053636:3791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:08.288701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254629286053636:3791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:08.288710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:08.293321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:08.295086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:08.295302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:08.295313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:08.295323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:08.295374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:08.295426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254626909193438:3511]
2025-10-01T14:07:08.296093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:08.296668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:08.296720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:08.297082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:08.297144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.297145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.297146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.297148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.297149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.297150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.297151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.297153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.297154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.297156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.297157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.297158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.297159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.297160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.297167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.297177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.297181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.297184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.297188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.297191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.297195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.297200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.297203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.297208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.297212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.297215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.297235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.297239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.297249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.297257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.297264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.297270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.297274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.297288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.297292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.297297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.297303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.297308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.297313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.297319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.297324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.297329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.297333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.297338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.297344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.297349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.297353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.297358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.297363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.297368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.297375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.297380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.297385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.297390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.297395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.297400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.297442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:08.305536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:08.306535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:08.306543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:08.306547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:08.306551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:08.306559Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 204 [2:7556254626909193438:3511]
2025-10-01T14:07:08.306579Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:08.306600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:08.306604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.306608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.306610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.306636Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:08.306642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:08.306649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:08.306717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.306719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.306721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.306725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:08.306728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:08.306807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:08.306810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.306825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.306836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.306854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:08.306872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254626909193433:3511]
2025-10-01T14:07:08.306875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254626909193433:3511]
2025-10-01T14:07:08.306878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254626909193433:3511]
2025-10-01T14:07:08.306891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:08.306906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:08.306920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:08.306923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:08.306962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254626909193433:3511]
2025-10-01T14:07:08.306965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:08.307975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:08.307992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:08.307994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:08.308003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:08.308227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286053809:3791], now have 1 active actors on pipe
2025-10-01T14:07:08.308240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286053620:2446], now have 1 active actors on pipe
2025-10-01T14:07:08.308566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.308579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.308608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|734a7097-ce722de1-d589948c-11e0b9ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:08.308617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.308625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.308628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:08.308640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.308656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:08.308672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.308885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.308892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.308908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.309507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e70d6cf-4455825b-66b40d37-124918eb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|734a7097-ce722de1-d589948c-11e0b9ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:08.308335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 204
2025-10-01T14:07:08.308631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 204
2025-10-01T14:07:08.309014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 205 partition: 0 MaxSeqNo: 45 sessionId: src_id|734a7097-ce722de1-d589948c-11e0b9ab_0
2025-10-01T14:07:08.312935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734a7097-ce722de1-d589948c-11e0b9ab_0] Write session: try to update token
2025-10-01T14:07:08.312952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734a7097-ce722de1-d589948c-11e0b9ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:08.337069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:08.337087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:08.337090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:08.337093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:08.337103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254626909193433:3511]
2025-10-01T14:07:08.337109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254626909193433:3511]
2025-10-01T14:07:08.337114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254626909193433:3511]
2025-10-01T14:07:08.337170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:08.337177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.337180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:08.337343Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:08.338427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:08.338440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:08.338444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:08.340663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 205 sessionId: src_id|734a7097-ce722de1-d589948c-11e0b9ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:08.343540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:08.354105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254629286053884:3772]
2025-10-01T14:07:08.354544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 204, pipe: [1:7556254629286053884:3772]
2025-10-01T14:07:08.487947Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:08.488602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.488627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.488673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286053884:3772], now have 1 active actors on pipe
2025-10-01T14:07:08.488928Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:08.489814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734a7097-ce722de1-d589948c-11e0b9ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:08.489825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734a7097-ce722de1-d589948c-11e0b9ab_0] Write session will restart in 0.008819s
2025-10-01T14:07:08.489862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734a7097-ce722de1-d589948c-11e0b9ab_0] Write session: Do CDS request
2025-10-01T14:07:08.489871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734a7097-ce722de1-d589948c-11e0b9ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:08.489326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:08.489402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 205 reason: status is not ok: tablet will be restarted right now sessionId: src_id|734a7097-ce722de1-d589948c-11e0b9ab_0
2025-10-01T14:07:08.489630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 205 sessionId: src_id|734a7097-ce722de1-d589948c-11e0b9ab_0 is DEAD
2025-10-01T14:07:08.489930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254629286053884:3772]
2025-10-01T14:07:08.489946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:08.502779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|734a7097-ce722de1-d589948c-11e0b9ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:08.507599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:08.507618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 206
2025-10-01T14:07:08.509680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:08.509726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:08.509731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:08.509736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:08.514797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 206 sessionId:  describe result for acl check
2025-10-01T14:07:08.514845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:08.514847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:08.514849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:08.514856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254629286053962:3795] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:08.515417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254629286053962:3795] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:08.538493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254629286053962:3795] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:08.543145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254629286053962:3795] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:08.543163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254629286053962:3795] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:08.543166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254629286053962:3795] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:08.543176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:08.546561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:08.548890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:08.549189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:08.549208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:08.549237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:08.549389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:08.549441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254626909193701:3513]
2025-10-01T14:07:08.550097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:08.550509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:08.550564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:08.550910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:08.550973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.550979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.550980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.550981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.550983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.550985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.550986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.550987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.550989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.550990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.550991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.551000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.551002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.551003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.551010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.551020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.551023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.551027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.551032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.551036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.551040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.551044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.551047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.551052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.551055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.551059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.551063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.551067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.551074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.551081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.551088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.551094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.551098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.551105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.551109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.551114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.551119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.551124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.551129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.551134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.551139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.551144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.551148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.551153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.551164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.551169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.551173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.551178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.551183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.551188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.551192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.551197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.551202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.551207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.551211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.551216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.551255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:08.559322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:08.560316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:08.560331Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:08.560334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:08.560338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:08.560345Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 205 [2:7556254626909193701:3513]
2025-10-01T14:07:08.560362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:08.560382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:08.560390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.560394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.560398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.560418Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:08.560428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:08.560439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:08.560504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.560511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.560513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.560517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:08.560520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:08.560594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:08.560603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.560617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.560633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.560655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:08.560673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254626909193695:3513]
2025-10-01T14:07:08.560676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254626909193695:3513]
2025-10-01T14:07:08.560678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254626909193695:3513]
2025-10-01T14:07:08.560693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:08.560711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:08.560726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:08.560733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:08.560745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:08.560755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:08.560757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:08.560778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254626909193695:3513]
2025-10-01T14:07:08.560786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:08.560876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:08.560980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286053889:2446], now have 1 active actors on pipe
2025-10-01T14:07:08.560988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286054140:3795], now have 1 active actors on pipe
2025-10-01T14:07:08.561081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.561090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.561117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:08.561130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.561135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.561141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:08.561151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.561162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:08.561183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.561408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.561416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.561433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.562569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|734a7097-ce722de1-d589948c-11e0b9ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:08.560990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 205
2025-10-01T14:07:08.561006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 205
2025-10-01T14:07:08.561528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 206 partition: 0 MaxSeqNo: 45 sessionId: src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0
2025-10-01T14:07:08.565701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0] Write session: try to update token
2025-10-01T14:07:08.565722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:08.582138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:08.582157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:08.582169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254626909193695:3513]
2025-10-01T14:07:08.582224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:08.582431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:08.582432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:08.582586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:08.582737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:08.582872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:08.583055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:08.583087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:08.590451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254629286054154:3772]
2025-10-01T14:07:08.594684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286054154:3772], now have 1 active actors on pipe
2025-10-01T14:07:08.594959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 205, pipe: [1:7556254629286054154:3772]
2025-10-01T14:07:08.601539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:08.601558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:08.601561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:08.601563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:08.601575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254626909193695:3513]
2025-10-01T14:07:08.601581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254626909193695:3513]
2025-10-01T14:07:08.601585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254626909193695:3513]
2025-10-01T14:07:08.601643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:08.601651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.601654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:08.601655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:08.601661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:08.601664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:08.601811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:08.615169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 206 sessionId: src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:08.618094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:08.763557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:08.764846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.764861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.765177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:08.765222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:08.765266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254629286054154:3772]
2025-10-01T14:07:08.765288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:08.765291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:08.765371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 206 reason: error at write: Disconnected sessionId: src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0
2025-10-01T14:07:08.765541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 206 sessionId: src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0 is DEAD
2025-10-01T14:07:08.765706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:08.765719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0] Write session will restart in 0.009153s
2025-10-01T14:07:08.765746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0] Write session: Do CDS request
2025-10-01T14:07:08.765756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:08.776049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:08.778644Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:08.778664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 207
2025-10-01T14:07:08.778904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:08.778949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:08.778962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:08.778967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:08.779577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 207 sessionId:  describe result for acl check
2025-10-01T14:07:08.779617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:08.779620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:08.779622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:08.779627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254629286054182:3800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:08.780217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254629286054182:3800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:08.784185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254629286054182:3800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:08.790244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254629286054182:3800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:08.790266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254629286054182:3800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:08.790271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254629286054182:3800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:08.790281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:08.792649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:08.794319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:08.794566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:08.794579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:08.794593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:08.794650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:08.794709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254626909193963:3516]
2025-10-01T14:07:08.795333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:08.795650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:08.795696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:08.796039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:08.796107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.796109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.796110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.796111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.796113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.796114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.796115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.796116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.796118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.796118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.796120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.796121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.796122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.796123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.796129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.796140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.796144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.796149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.796153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.796156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.796161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.796165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.796169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.796173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.796178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.796181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.796185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.796189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.796197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.796205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:08.796212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.796218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:08.796230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.796237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:08.796245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.796250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:08.796256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.796261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:08.796266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.796271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:08.796276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.796282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:08.796285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.796291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:08.796296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.796301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:08.796307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.796312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.796317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.796322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.796326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.796331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.796336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.796341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:08.796351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.796357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:08.796408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:08.802338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:08.803519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:08.803541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:08.803543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:08.803547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:08.803555Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 206 [2:7556254626909193963:3516]
2025-10-01T14:07:08.803575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:08.803595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:08.803603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.803607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.803609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.803628Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:08.803638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:08.803645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:08.803718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.803726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.803728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.803731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:08.803734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:08.803808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:08.803816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.803831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:08.803847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:08.803869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:08.803894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286054403:3800], now have 1 active actors on pipe
2025-10-01T14:07:08.803902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286054157:2446], now have 1 active actors on pipe
2025-10-01T14:07:08.803910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254626909193957:3516]
2025-10-01T14:07:08.803916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254626909193957:3516]
2025-10-01T14:07:08.803918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254626909193957:3516]
2025-10-01T14:07:08.803934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:08.803953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:08.803973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:08.803981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:08.803984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:08.803994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:08.803997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:08.804022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254626909193957:3516]
2025-10-01T14:07:08.804033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:08.804040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:08.804228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 206
2025-10-01T14:07:08.804279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 206
2025-10-01T14:07:08.804636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.804647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.804674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88297073-f02b7792-6efa1a10-49d3f42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:08.804686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:08.804695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:08.804698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:08.804709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:08.804726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:08.804747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.805002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.805011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.805028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:08.805139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 207 partition: 0 MaxSeqNo: 45 sessionId: src_id|88297073-f02b7792-6efa1a10-49d3f42_0
2025-10-01T14:07:08.806489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca231d8-c781e51e-76ca85bf-1bac9cb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|88297073-f02b7792-6efa1a10-49d3f42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:08.809733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88297073-f02b7792-6efa1a10-49d3f42_0] Write session: try to update token
2025-10-01T14:07:08.809758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88297073-f02b7792-6efa1a10-49d3f42_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:08.816497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:08.816511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:08.816521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254626909193957:3516]
2025-10-01T14:07:08.816567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:08.816570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:08.816735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:08.816895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:08.817037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:08.817172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:08.817377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:08.817418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:08.834519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 207 sessionId: src_id|88297073-f02b7792-6efa1a10-49d3f42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:08.837598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:08.843505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:08.843532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:08.843557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:08.843561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:08.843564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:08.843566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:08.843577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254626909193957:3516]
2025-10-01T14:07:08.843582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254626909193957:3516]
2025-10-01T14:07:08.843585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254626909193957:3516]
2025-10-01T14:07:08.843640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:08.843649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:08.843652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:08.843656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:08.843656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:08.843659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:08.843815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:08.865528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254629286054436:3772]
2025-10-01T14:07:08.867846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 206, pipe: [1:7556254629286054436:3772]
2025-10-01T14:07:09.036478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:09.036911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:09.036944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254629286054436:3772], now have 1 active actors on pipe
2025-10-01T14:07:09.037164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:09.037227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254629286054436:3772]
2025-10-01T14:07:09.037244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:09.037319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:09.037322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:09.037398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 207 reason: error at write: Disconnected sessionId: src_id|88297073-f02b7792-6efa1a10-49d3f42_0
2025-10-01T14:07:09.037786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88297073-f02b7792-6efa1a10-49d3f42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:09.037797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88297073-f02b7792-6efa1a10-49d3f42_0] Write session will restart in 0.009963s
2025-10-01T14:07:09.037821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88297073-f02b7792-6efa1a10-49d3f42_0] Write session: Do CDS request
2025-10-01T14:07:09.037826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88297073-f02b7792-6efa1a10-49d3f42_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:09.037781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 207 sessionId: src_id|88297073-f02b7792-6efa1a10-49d3f42_0 is DEAD
2025-10-01T14:07:09.050392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88297073-f02b7792-6efa1a10-49d3f42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:09.050446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:09.050459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 208
2025-10-01T14:07:09.050667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:09.050714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:09.050721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:09.050725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:09.051133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 208 sessionId:  describe result for acl check
2025-10-01T14:07:09.051160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:09.051162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:09.051163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:09.051169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254633581021754:3805] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:09.051689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254633581021754:3805] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:09.057669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254633581021754:3805] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:09.064766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254633581021754:3805] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:09.064786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254633581021754:3805] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:09.064789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254633581021754:3805] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:09.064798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:09.065386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:09.066976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:09.067170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:09.067178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:09.067191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:09.067239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:09.067271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254631204161535:3519]
2025-10-01T14:07:09.067864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:09.068241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:09.068292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:09.068645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:09.068711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.068717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.068718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.068719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.068720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.068722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.068723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.068724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.068725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.068726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.068727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.068728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.068729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.068730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.068736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.068746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.068750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.068754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.068758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.068762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.068766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.068770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.068773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.068778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.068781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.068785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.068789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.068793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.068800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.068809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.068815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.068820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.068824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.068838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.068842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.068847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.068852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.068857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.068862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.068866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.068871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.068875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.068879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.068884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.068894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.068900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.068904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.068913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.068918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.068923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.068933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.068938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.068947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.068952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.068956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.068961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.069012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:09.075141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:09.075780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:09.075793Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:09.075796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:09.075800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:09.075807Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 207 [2:7556254631204161535:3519]
2025-10-01T14:07:09.075825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:09.075848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:09.075855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.075859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.075862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.075879Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:09.075889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:09.075895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:09.075954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.075961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.075963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.075966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:09.075968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:09.076038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:09.076044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.076056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.076067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.076087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:09.076108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254631204161530:3519]
2025-10-01T14:07:09.076114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254631204161530:3519]
2025-10-01T14:07:09.076117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254631204161530:3519]
2025-10-01T14:07:09.076130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:09.076147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:09.076160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:09.076165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:09.076201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:09.076203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254631204161530:3519]
2025-10-01T14:07:09.076205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:09.076208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:09.076209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:09.076215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581021992:3805], now have 1 active actors on pipe
2025-10-01T14:07:09.076226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:09.076374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 207
2025-10-01T14:07:09.076433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581021739:2446], now have 1 active actors on pipe
2025-10-01T14:07:09.076464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.076469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.076491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:09.076499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.076503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.076506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:09.076516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.076526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:09.076542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:09.076734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 207
2025-10-01T14:07:09.076873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.076886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.076910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:09.077050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 208 partition: 0 MaxSeqNo: 45 sessionId: src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0
2025-10-01T14:07:09.077614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88297073-f02b7792-6efa1a10-49d3f42_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:09.080521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0] Write session: try to update token
2025-10-01T14:07:09.080542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:09.100387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 208 sessionId: src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:09.103521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:09.103988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.104016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.104058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:09.104173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:09.112487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:09.112507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:09.112510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:09.112512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:09.112522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254631204161530:3519]
2025-10-01T14:07:09.112527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254631204161530:3519]
2025-10-01T14:07:09.112532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254631204161530:3519]
2025-10-01T14:07:09.112588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:09.112601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.112604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:09.112682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:09.112700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:09.112704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:09.112740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:09.136941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254633581022012:3772]
2025-10-01T14:07:09.137222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 207, pipe: [1:7556254633581022012:3772]
2025-10-01T14:07:09.312353Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:09.321464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.321491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.321665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.321730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.321796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.321868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.321914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.321919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.321989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.322049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.322112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.322179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.322222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.322238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.322301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.322362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.322430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.322491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.322534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.322537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.322603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.322661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.322718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.322773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.322825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.322832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.322898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.322957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.323015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.323072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.323116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.323119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.323198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.323266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.323335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.323401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.323447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.323450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.323534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.323601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.323675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.323751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.323989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.323992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.324076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.324147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.324216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.324285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.324331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.324333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.324411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.324476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.324546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.324614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.324668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.324671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.324745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:09.324812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:09.324895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:09.324961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:09.325006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:09.325012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:09.325084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022012:3772], now have 1 active actors on pipe
2025-10-01T14:07:09.325733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:09.325743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0] Write session will restart in 0.006761s
2025-10-01T14:07:09.325767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0] Write session: Do CDS request
2025-10-01T14:07:09.325772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:09.326259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:09.325321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254633581022012:3772]
2025-10-01T14:07:09.325349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:09.325392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:09.325394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:09.325419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 208 reason: error at write: Disconnected sessionId: src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0
2025-10-01T14:07:09.325598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 208 sessionId: src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0 is DEAD
2025-10-01T14:07:09.333865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:09.333965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:09.333978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 209
2025-10-01T14:07:09.334072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:09.334110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:09.334116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:09.334119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:09.334529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 209 sessionId:  describe result for acl check
2025-10-01T14:07:09.334565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:09.334568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:09.334569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:09.334574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254633581022049:3817] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:09.335418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254633581022049:3817] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:09.337155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254633581022049:3817] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:09.339739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254633581022049:3817] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:09.339751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254633581022049:3817] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:09.339755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254633581022049:3817] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:09.339761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:09.365652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:09.367556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:09.367779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:09.367793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:09.367805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:09.367861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:09.367903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254631204161837:3534]
2025-10-01T14:07:09.368551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:09.368908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:09.368957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:09.369384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:09.369444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.369445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.369446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.369447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.369448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.369448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.369450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.369451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.369452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.369453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.369453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.369454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.369455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.369456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.369461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.369469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.369472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.369477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.369480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.369483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.369486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.369489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.369492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.369495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.369498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.369501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.369505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.369508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.369516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.369523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.369529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.369534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.369538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.369545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.369550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.369555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.369559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.369564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.369567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.369573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.369577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.369582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.369586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.369590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.369594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.369600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.369604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.369609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.369614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.369619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.369623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.369628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.369633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.369637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.369641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.369646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.369698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:09.374516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:09.375172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:09.375178Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:09.375181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:09.375185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:09.375194Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 208 [2:7556254631204161837:3534]
2025-10-01T14:07:09.375211Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:09.375232Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:09.375235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.375239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.375242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.375258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:09.375264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:09.375270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:09.375330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.375332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.375335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.375338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:09.375341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:09.375416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:09.375421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.375433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.375445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.375463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:09.375481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254631204161832:3534]
2025-10-01T14:07:09.375484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254631204161832:3534]
2025-10-01T14:07:09.375486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254631204161832:3534]
2025-10-01T14:07:09.375495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:09.375506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:09.375509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:09.375509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:09.375512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:09.375523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:09.375526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:09.375537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022083:3817], now have 1 active actors on pipe
2025-10-01T14:07:09.375541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022042:2446], now have 1 active actors on pipe
2025-10-01T14:07:09.375573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254631204161832:3534]
2025-10-01T14:07:09.375585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:09.375806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:09.377118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 208
2025-10-01T14:07:09.377154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 208
2025-10-01T14:07:09.377295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.377316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.377349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:09.377363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.377369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.377376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:09.377387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.377402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:09.377425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:09.377564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.377573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.377597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:09.377690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 209 partition: 0 MaxSeqNo: 45 sessionId: src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0
2025-10-01T14:07:09.378070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c61f72e-3801aaef-60d8b4e-eb8c542b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:09.380561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0] Write session: try to update token
2025-10-01T14:07:09.380581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:09.400564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 209 sessionId: src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:09.403218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:09.404561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.404597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.404619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:09.404623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:09.404626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:09.404628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:09.404638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254631204161832:3534]
2025-10-01T14:07:09.404643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254631204161832:3534]
2025-10-01T14:07:09.404647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254631204161832:3534]
2025-10-01T14:07:09.404711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:09.404724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.404727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:09.404888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:09.406498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:09.406509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:09.406516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:09.425716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254633581022310:3772]
2025-10-01T14:07:09.426022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 208, pipe: [1:7556254633581022310:3772]
2025-10-01T14:07:09.560091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:09.560603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:09.560659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022310:3772], now have 1 active actors on pipe
2025-10-01T14:07:09.560903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:09.562479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:09.562537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254633581022310:3772]
2025-10-01T14:07:09.574856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:09.574874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:09.574899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 209 reason: error at write: Disconnected sessionId: src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0
2025-10-01T14:07:09.575063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 209 sessionId: src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0 is DEAD
2025-10-01T14:07:09.584846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:09.584863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0] Write session will restart in 0.006087s
2025-10-01T14:07:09.584890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0] Write session: Do CDS request
2025-10-01T14:07:09.584900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:09.592312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:09.593427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:09.593442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 210
2025-10-01T14:07:09.593640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:09.593677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:09.593687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:09.593691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:09.594020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 210 sessionId:  describe result for acl check
2025-10-01T14:07:09.594057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:09.594063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:09.594065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:09.594070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254633581022479:3822] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:09.594590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254633581022479:3822] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:09.598857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254633581022479:3822] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:09.600990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:09.603131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:09.603240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254633581022479:3822] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:09.603256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254633581022479:3822] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:09.603260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254633581022479:3822] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:09.603267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:09.603377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:09.603388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:09.603402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:09.603459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:09.603486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254631204162103:3537]
2025-10-01T14:07:09.604087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:09.604446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:09.604505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:09.604863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:09.604930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.604935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.604936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.604937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.604939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.604940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.604941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.604943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.604944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.604945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.604946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.604948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.604949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.604951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.604957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.604967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.604971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.604975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.604979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.604982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.604985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.604988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.604992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.604996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.604999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.605003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.605006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.605010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.605022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.605030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.605040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.605045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.605054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.605059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.605063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.605072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.605076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.605084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.605089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.605094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.605103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.605107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.605111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.605116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.605124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.605129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.605133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.605142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.605146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.605150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.605154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.605159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.605163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.605167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.605171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.605179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.605215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:09.609689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:09.611310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:09.611330Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:09.611332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:09.611336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:09.611343Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 209 [2:7556254631204162103:3537]
2025-10-01T14:07:09.611362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:09.611379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:09.611383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.611387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.611389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.611406Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:09.611411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:09.611418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:09.611486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.611493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.611495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.611498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:09.611501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:09.611572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:09.611580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.611595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.611611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.611631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:09.611653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022574:3822], now have 1 active actors on pipe
2025-10-01T14:07:09.611661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022314:2446], now have 1 active actors on pipe
2025-10-01T14:07:09.611669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254631204162098:3537]
2025-10-01T14:07:09.611675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254631204162098:3537]
2025-10-01T14:07:09.611677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254631204162098:3537]
2025-10-01T14:07:09.611691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:09.611712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:09.611727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:09.611729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:09.611732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:09.611737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:09.611739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:09.611722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 209
2025-10-01T14:07:09.611731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 209
2025-10-01T14:07:09.611770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254631204162098:3537]
2025-10-01T14:07:09.611778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:09.611780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:09.611807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.611820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.611850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:09.611857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.611862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.611864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:09.611874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.611883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:09.611902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:09.612070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.612083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.612107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:09.612214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 210 partition: 0 MaxSeqNo: 45 sessionId: src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0
2025-10-01T14:07:09.612586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbad8702-d7e32e33-a29167ba-3907ba96_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:09.615054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0] Write session: try to update token
2025-10-01T14:07:09.615076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:09.634586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:09.634609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:09.634613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:09.634616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:09.634628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254631204162098:3537]
2025-10-01T14:07:09.634636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254631204162098:3537]
2025-10-01T14:07:09.634642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254631204162098:3537]
2025-10-01T14:07:09.634702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:09.634713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.634716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:09.635737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:09.642818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:09.642837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:09.642842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:09.657441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 210 sessionId: src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:09.660189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:09.662748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254633581022586:3772]
2025-10-01T14:07:09.663021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 209, pipe: [1:7556254633581022586:3772]
2025-10-01T14:07:09.803556Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:09.804069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.804085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.804104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022586:3772], now have 1 active actors on pipe
2025-10-01T14:07:09.804579Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:09.805774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:09.805789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0] Write session will restart in 0.008775s
2025-10-01T14:07:09.805826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0] Write session: Do CDS request
2025-10-01T14:07:09.805832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:09.804643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254633581022586:3772]
2025-10-01T14:07:09.804647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:09.804651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:09.804674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:09.804715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 210 reason: error at write: Disconnected sessionId: src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0
2025-10-01T14:07:09.804906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 210 sessionId: src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0 is DEAD
2025-10-01T14:07:09.821912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:09.822256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:09.822271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 211
2025-10-01T14:07:09.822474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:09.822519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:09.822530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:09.822534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:09.822969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 211 sessionId:  describe result for acl check
2025-10-01T14:07:09.823006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:09.823008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:09.823009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:09.823015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254633581022775:3826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:09.823517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254633581022775:3826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:09.826230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254633581022775:3826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:09.827528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:09.829396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254633581022775:3826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:09.829411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254633581022775:3826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:09.829414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254633581022775:3826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:09.829423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:09.829135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:09.829381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:09.829385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:09.829397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:09.829451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:09.829486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254631204162368:3539]
2025-10-01T14:07:09.830066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:09.830359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:09.830429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:09.830759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:09.830825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.830833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.830834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.830835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.830836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.830836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.830837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.830838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.830839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.830840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.830841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.830842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.830843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.830844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.830850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.830858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.830862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.830864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.830867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.830871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.830874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.830877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.830880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.830883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.830886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.830890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.830892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.830895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.830902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.830909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:09.830914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.830919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:09.830923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.830928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:09.830931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.830935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:09.830940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.830944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:09.830948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.830952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:09.830957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.830961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:09.830964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.830968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:09.830972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.830976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:09.830979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.830983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.830987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.830991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.830994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.830997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.831001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.831005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:09.831008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.831012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:09.831044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:09.835543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:09.836244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:09.836262Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:09.836265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:09.836268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:09.836275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 210 [2:7556254631204162368:3539]
2025-10-01T14:07:09.836290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:09.836307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:09.836310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.836313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.836315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.836332Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:09.836343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:09.836353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:09.836409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.836417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.836419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.836422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:09.836424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:09.836494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:09.836500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.836513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:09.836525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:09.836543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:09.836565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022589:2446], now have 1 active actors on pipe
2025-10-01T14:07:09.836572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022850:3826], now have 1 active actors on pipe
2025-10-01T14:07:09.836579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254631204162363:3539]
2025-10-01T14:07:09.836582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254631204162363:3539]
2025-10-01T14:07:09.836584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254631204162363:3539]
2025-10-01T14:07:09.836595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:09.836608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:09.836609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:09.836615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:09.836618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:09.836622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:09.836625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:09.836642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 210
2025-10-01T14:07:09.836667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 210
2025-10-01T14:07:09.837012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254631204162363:3539]
2025-10-01T14:07:09.837027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:09.837038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:09.837062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.837071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.837109Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d5d2b02-1425614b-cc2244e0-2495137_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:09.837120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:09.837125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:09.837131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:09.837140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:09.837154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:09.837175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:09.837378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:09.837384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:09.837398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:09.837557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 211 partition: 0 MaxSeqNo: 45 sessionId: src_id|3d5d2b02-1425614b-cc2244e0-2495137_0
2025-10-01T14:07:09.838923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17c448b3-4d046db6-b9c712ff-28bd9881_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3d5d2b02-1425614b-cc2244e0-2495137_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:09.842011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5d2b02-1425614b-cc2244e0-2495137_0] Write session: try to update token
2025-10-01T14:07:09.842031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5d2b02-1425614b-cc2244e0-2495137_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:09.868400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:09.868416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:09.868418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:09.868420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:09.868429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254631204162363:3539]
2025-10-01T14:07:09.868433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254631204162363:3539]
2025-10-01T14:07:09.868436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254631204162363:3539]
2025-10-01T14:07:09.868482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:09.868486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:09.868491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:09.868491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:09.868500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:09.868526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:09.868612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:09.869313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 211 sessionId: src_id|3d5d2b02-1425614b-cc2244e0-2495137_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:09.871880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:09.906560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254633581022873:3772]
2025-10-01T14:07:09.907054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 210, pipe: [1:7556254633581022873:3772]
2025-10-01T14:07:10.017190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:10.017757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.017773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.017818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254633581022873:3772], now have 1 active actors on pipe
2025-10-01T14:07:10.020838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:10.021101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254633581022873:3772]
2025-10-01T14:07:10.021137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:10.021178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:10.021180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:10.021274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 211 reason: error at write: Disconnected sessionId: src_id|3d5d2b02-1425614b-cc2244e0-2495137_0
2025-10-01T14:07:10.021468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 211 sessionId: src_id|3d5d2b02-1425614b-cc2244e0-2495137_0 is DEAD
2025-10-01T14:07:10.025794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5d2b02-1425614b-cc2244e0-2495137_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:10.025816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5d2b02-1425614b-cc2244e0-2495137_0] Write session will restart in 0.009934s
2025-10-01T14:07:10.025848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5d2b02-1425614b-cc2244e0-2495137_0] Write session: Do CDS request
2025-10-01T14:07:10.025855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5d2b02-1425614b-cc2244e0-2495137_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:10.037700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5d2b02-1425614b-cc2244e0-2495137_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:10.038330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:10.038346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 212
2025-10-01T14:07:10.042512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:10.042566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:10.042572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:10.042578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:10.043454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 212 sessionId:  describe result for acl check
2025-10-01T14:07:10.043493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:10.043499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:10.043500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:10.043506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254637875990239:3831] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:10.044031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254637875990239:3831] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:10.052472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254637875990239:3831] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:10.067727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254637875990239:3831] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:10.067744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254637875990239:3831] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:10.067747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254637875990239:3831] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:10.067756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:10.073248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:10.074903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:10.075120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:10.075125Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:10.075137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:10.075185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:10.075218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254635499129945:3542]
2025-10-01T14:07:10.075836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:10.076355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:10.076396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:10.076728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:10.076780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.076781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.076782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.076783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.076785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.076786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.076787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.076788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.076790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.076791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.076792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.076793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.076794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.076795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.076801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.076812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.076816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.076819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.076822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.076839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.076843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.076846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.076850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.076855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.076858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.076862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.076866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.076870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.076878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.076885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.076891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.076896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.076900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.076906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.076911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.076916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.076922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.076927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.076931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.076937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.076942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.076947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.076950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.076955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.076964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.076969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.076973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.076978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.076983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.076989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.076993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.076998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.077003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.077008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.077013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.077018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.077059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:10.082504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:10.083420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:10.083426Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:10.083428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:10.083431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:10.083438Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 211 [2:7556254635499129945:3542]
2025-10-01T14:07:10.083457Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:10.083473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:10.083476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.083479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.083481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.083497Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:10.083503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:10.083510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:10.083567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.083569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.083572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.083575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:10.083579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:10.083651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:10.083653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.083664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.083675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.083688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:10.083704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254635499129939:3542]
2025-10-01T14:07:10.083706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254635499129939:3542]
2025-10-01T14:07:10.083709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254635499129939:3542]
2025-10-01T14:07:10.083723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:10.083737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:10.083753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:10.083757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:10.083792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254635499129939:3542]
2025-10-01T14:07:10.083795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:10.088387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:10.088400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:10.088402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:10.088409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:10.088568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875990174:2446], now have 1 active actors on pipe
2025-10-01T14:07:10.088578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875990385:3831], now have 1 active actors on pipe
2025-10-01T14:07:10.088914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.088931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.088961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:10.088976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.088986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.088990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:10.089002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.089022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:10.089041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:10.089327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.089337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.089373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:10.089887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d5d2b02-1425614b-cc2244e0-2495137_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:10.088713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 211
2025-10-01T14:07:10.088754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 211
2025-10-01T14:07:10.089475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 212 partition: 0 MaxSeqNo: 45 sessionId: src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0
2025-10-01T14:07:10.093174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0] Write session: try to update token
2025-10-01T14:07:10.093197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:10.118329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:10.118347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:10.118350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:10.118352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:10.118361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254635499129939:3542]
2025-10-01T14:07:10.118366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254635499129939:3542]
2025-10-01T14:07:10.118391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254635499129939:3542]
2025-10-01T14:07:10.118440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:10.118448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.118450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:10.118584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:10.121901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:10.121916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:10.121920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:10.121601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254637875990450:3772]
2025-10-01T14:07:10.124152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 212 sessionId: src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:10.124215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 211, pipe: [1:7556254637875990450:3772]
2025-10-01T14:07:10.126921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:10.276035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:10.276503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875990450:3772], now have 1 active actors on pipe
2025-10-01T14:07:10.276987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:10.277034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:10.276538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.276551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.276739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:10.277109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 212 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0
2025-10-01T14:07:10.277288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 212 sessionId: src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0 is DEAD
2025-10-01T14:07:10.277408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254637875990450:3772]
2025-10-01T14:07:10.278459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:10.278470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0] Write session will restart in 0.005372s
2025-10-01T14:07:10.278498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0] Write session: Do CDS request
2025-10-01T14:07:10.278504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:10.285161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:10.286909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:10.286923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 213
2025-10-01T14:07:10.294792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:10.294840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:10.294845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:10.294849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:10.295396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 213 sessionId:  describe result for acl check
2025-10-01T14:07:10.295429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:10.295431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:10.295432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:10.295437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254637875990489:3842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:10.295988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254637875990489:3842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:10.301818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254637875990489:3842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:10.311763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254637875990489:3842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:10.311779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254637875990489:3842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:10.311781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254637875990489:3842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:10.311788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:10.327797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:10.332598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:10.332907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:10.332921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:10.332934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:10.332998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:10.333040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254635499130250:3551]
2025-10-01T14:07:10.333629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:10.334022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:10.334083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:10.334482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:10.334550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.334557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.334559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.334560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.334561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.334563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.334564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.334566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.334567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.334569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.334570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.334572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.334573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.334575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.334581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.334592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.334597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.334601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.334606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.334610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.334614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.334619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.334623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.334628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.334632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.334636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.334640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.334645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.334653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.334662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.334668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.334679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.334684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.334690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.334695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.334700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.334708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.334713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.334718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.334723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.334728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.334735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.334744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.334749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.334754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.334758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.334763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.334769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.334773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.334779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.334783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.334788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.334797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.334802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.334806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.334816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.334859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:10.347543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:10.348602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:10.348615Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:10.348617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:10.348620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:10.348627Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 212 [2:7556254635499130250:3551]
2025-10-01T14:07:10.348643Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:10.348662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:10.348665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.348668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.348670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.348689Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:10.348695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:10.348701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:10.348762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.348764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.348767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.348770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:10.348773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:10.348878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:10.348880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.348895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.348904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.348920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:10.348937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254635499130244:3551]
2025-10-01T14:07:10.348939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254635499130244:3551]
2025-10-01T14:07:10.348941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254635499130244:3551]
2025-10-01T14:07:10.348955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:10.348970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:10.348983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:10.348986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:10.349029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254635499130244:3551]
2025-10-01T14:07:10.349032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:10.349156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:10.349158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:10.349161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:10.349165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:10.350453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 212
2025-10-01T14:07:10.350485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 212
2025-10-01T14:07:10.355812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875990645:3842], now have 1 active actors on pipe
2025-10-01T14:07:10.355832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875990470:2446], now have 1 active actors on pipe
2025-10-01T14:07:10.355856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.355864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.355905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7f0e267-ba83a587-687afd6f-e5528850_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:10.355921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.355931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.355933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:10.355948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.355970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:10.355996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:10.356481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 213 partition: 0 MaxSeqNo: 45 sessionId: src_id|c7f0e267-ba83a587-687afd6f-e5528850_0
2025-10-01T14:07:10.356951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df65d7c4-62b42f7d-eba28705-402c10c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c7f0e267-ba83a587-687afd6f-e5528850_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:10.359774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f0e267-ba83a587-687afd6f-e5528850_0] Write session: try to update token
2025-10-01T14:07:10.359792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f0e267-ba83a587-687afd6f-e5528850_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:10.356341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.356349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.356365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:10.376963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254637875990753:3772]
2025-10-01T14:07:10.377370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875990753:3772], now have 1 active actors on pipe
2025-10-01T14:07:10.377509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 212, pipe: [1:7556254637875990753:3772]
2025-10-01T14:07:10.391541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 213 sessionId: src_id|c7f0e267-ba83a587-687afd6f-e5528850_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:10.394060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:10.393080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:10.393097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:10.393099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:10.393101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:10.393110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254635499130244:3551]
2025-10-01T14:07:10.393115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254635499130244:3551]
2025-10-01T14:07:10.393120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254635499130244:3551]
2025-10-01T14:07:10.393165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:10.393168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:10.393172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:10.393176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.393176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:10.393178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:10.393338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:10.549103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:10.549554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.549565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.554507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:10.556744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f0e267-ba83a587-687afd6f-e5528850_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:10.556758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f0e267-ba83a587-687afd6f-e5528850_0] Write session will restart in 0.007178s
2025-10-01T14:07:10.556783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f0e267-ba83a587-687afd6f-e5528850_0] Write session: Do CDS request
2025-10-01T14:07:10.556789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f0e267-ba83a587-687afd6f-e5528850_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:10.555019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:10.555030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:10.555087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 213 reason: error at write: Disconnected sessionId: src_id|c7f0e267-ba83a587-687afd6f-e5528850_0
2025-10-01T14:07:10.555249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 213 sessionId: src_id|c7f0e267-ba83a587-687afd6f-e5528850_0 is DEAD
2025-10-01T14:07:10.555361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:10.555391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254637875990753:3772]
2025-10-01T14:07:10.564880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f0e267-ba83a587-687afd6f-e5528850_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:10.565171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:10.565187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 214
2025-10-01T14:07:10.565311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:10.565342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:10.565347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:10.565351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:10.566554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 214 sessionId:  describe result for acl check
2025-10-01T14:07:10.566585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:10.566587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:10.566588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:10.566594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254637875990768:3848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:10.567015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254637875990768:3848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:10.577846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254637875990768:3848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:10.589414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254637875990768:3848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:10.589434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254637875990768:3848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:10.589437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254637875990768:3848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:10.589448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:10.631951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:10.635245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:10.635506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:10.635517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:10.635532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:10.635596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:10.635636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254635499130521:3560]
2025-10-01T14:07:10.636228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:10.636545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:10.636603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:10.636971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:10.637034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.637040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.637042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.637043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.637044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.637046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.637047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.637049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.637050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.637052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.637053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.637054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.637056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.637057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.637063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.637074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.637078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.637083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.637087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.637091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.637094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.637099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.637103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.637107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.637112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.637116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.637120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.637123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.637131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.637139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.637145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.637151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.637155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.637161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.637166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.637171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.637176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.637186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.637190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.637195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.637205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.637210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.637215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.637224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.637230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.637237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.637241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.637247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.637252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.637263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.637268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.637274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.637281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.637286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.637290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.637295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.637336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:10.643210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:10.643888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:10.643900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:10.643903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:10.643906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:10.643914Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 213 [2:7556254635499130521:3560]
2025-10-01T14:07:10.643931Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:10.643954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:10.643961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.643965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.643974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.643991Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:10.643997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:10.644003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:10.644060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.644069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.644071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.644075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:10.644079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:10.644148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:10.644157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.644168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.644178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.644195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:10.644213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254635499130515:3560]
2025-10-01T14:07:10.644215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254635499130515:3560]
2025-10-01T14:07:10.644218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254635499130515:3560]
2025-10-01T14:07:10.644228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:10.644239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:10.644241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:10.644243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:10.644245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875990760:2446], now have 1 active actors on pipe
2025-10-01T14:07:10.644249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875990810:3848], now have 1 active actors on pipe
2025-10-01T14:07:10.644256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:10.644273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:10.644275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:10.644312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254635499130515:3560]
2025-10-01T14:07:10.644320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:10.644329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:10.646395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.646416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.646260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 213
2025-10-01T14:07:10.646317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 213
2025-10-01T14:07:10.646466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82b388-f184a732-db1f295f-d2525338_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:10.646481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.646491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.646495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:10.646507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.646525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:10.646550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:10.647104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.647113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.647131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:10.649048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 214 partition: 0 MaxSeqNo: 45 sessionId: src_id|82b388-f184a732-db1f295f-d2525338_0
2025-10-01T14:07:10.649615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7f0e267-ba83a587-687afd6f-e5528850_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82b388-f184a732-db1f295f-d2525338_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:10.652217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82b388-f184a732-db1f295f-d2525338_0] Write session: try to update token
2025-10-01T14:07:10.652237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82b388-f184a732-db1f295f-d2525338_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:10.655830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254637875991033:3772]
2025-10-01T14:07:10.661199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875991033:3772], now have 1 active actors on pipe
2025-10-01T14:07:10.661246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 213, pipe: [1:7556254637875991033:3772]
2025-10-01T14:07:10.681473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 214 sessionId: src_id|82b388-f184a732-db1f295f-d2525338_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:10.684662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:10.685313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.685340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.685384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:10.692548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:10.699381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:10.699402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:10.699405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:10.699408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:10.699419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254635499130515:3560]
2025-10-01T14:07:10.699424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254635499130515:3560]
2025-10-01T14:07:10.699429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254635499130515:3560]
2025-10-01T14:07:10.699482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:10.699489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.699492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:10.699658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:10.700483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:10.700493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:10.700497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:10.860727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:10.870155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.870187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.870388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.870452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.870513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.870579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.870621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.870626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.870718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.870779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.870839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.870902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.870943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.870946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.871011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.871071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.871135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.871206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.871244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.871247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.871311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.871369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.871425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.871481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.871521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.871525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.871588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.871648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.871708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.871771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.871817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.871820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.872019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.872087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.872258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.872324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.872367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.872373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.872485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.872551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.872629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.872703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.872772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.872776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.872871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.872937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.873028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.873098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.873142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.873145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.873217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.873282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.873346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.873414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.873458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.873461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.873529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:10.873604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:10.873663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:10.873724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:10.873780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:10.873783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:10.881899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:10.882855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:10.882921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 214 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82b388-f184a732-db1f295f-d2525338_0
2025-10-01T14:07:10.883121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 214 sessionId: src_id|82b388-f184a732-db1f295f-d2525338_0 is DEAD
2025-10-01T14:07:10.883253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:10.883287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254637875991033:3772]
2025-10-01T14:07:10.886945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b388-f184a732-db1f295f-d2525338_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:10.886956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b388-f184a732-db1f295f-d2525338_0] Write session will restart in 0.006851s
2025-10-01T14:07:10.886988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b388-f184a732-db1f295f-d2525338_0] Write session: Do CDS request
2025-10-01T14:07:10.886995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b388-f184a732-db1f295f-d2525338_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:10.895340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82b388-f184a732-db1f295f-d2525338_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:10.902490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:10.902510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 215
2025-10-01T14:07:10.905340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:10.905400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:10.905406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:10.905410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:10.906328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 215 sessionId:  describe result for acl check
2025-10-01T14:07:10.906384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:10.906386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:10.906394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:10.906398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254637875991060:3853] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:10.906927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254637875991060:3853] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:10.912724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254637875991060:3853] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:10.923966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254637875991060:3853] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:10.923984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254637875991060:3853] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:10.923987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254637875991060:3853] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:10.923996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:10.960579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:10.966687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:10.966960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:10.966964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:10.966976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:10.967032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:10.967071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254635499130804:3563]
2025-10-01T14:07:10.967733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:10.968189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:10.968234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:10.968562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:10.968618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.968619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.968620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.968621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.968622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.968624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.968625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.968627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.968628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.968629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.968631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.968632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.968633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.968635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.968641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.968651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.968655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.968659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.968663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.968667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.968671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.968675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.968679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.968684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.968687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.968691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.968695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.968699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.968708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.968716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:10.968723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.968729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:10.968734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.968739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:10.968743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.968749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:10.968754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.968759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:10.968764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.968769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:10.968774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.968780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:10.968785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.968792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:10.968797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.968802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:10.968806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.968811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.968816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.968822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.968844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.968849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.968854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.968859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:10.968864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.968869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:10.968914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:10.979212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:10.980305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:10.980313Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:10.980315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:10.980320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:10.980327Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 214 [2:7556254635499130804:3563]
2025-10-01T14:07:10.980345Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:10.980366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:10.980370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.980374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.980378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.980394Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:10.980400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:10.980407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:10.980474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.980476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.980478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.980482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:10.980485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:10.980566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:10.980569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:10.980584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:10.980594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:10.980611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:10.980627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254635499130798:3563]
2025-10-01T14:07:10.980630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254635499130798:3563]
2025-10-01T14:07:10.980632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254635499130798:3563]
2025-10-01T14:07:10.980645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:10.980662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:10.980676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:10.980679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:10.980729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254635499130798:3563]
2025-10-01T14:07:10.980731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:10.981372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:10.981378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:10.981381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:10.981387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:10.981743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875991049:2446], now have 1 active actors on pipe
2025-10-01T14:07:10.981749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875991125:3853], now have 1 active actors on pipe
2025-10-01T14:07:10.982551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 214
2025-10-01T14:07:10.982593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 214
2025-10-01T14:07:10.983378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254637875991325:3772]
2025-10-01T14:07:10.983918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 214, pipe: [1:7556254637875991325:3772]
2025-10-01T14:07:10.986296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.986316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.986338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254637875991325:3772], now have 1 active actors on pipe
2025-10-01T14:07:10.986361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a7a2082-ca768642-84861ab4-1ecac22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:10.986388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:10.986394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:10.986397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:10.986409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:10.986428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:10.986451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:10.987941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:10.987956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:10.987990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:10.988185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 215 partition: 0 MaxSeqNo: 45 sessionId: src_id|9a7a2082-ca768642-84861ab4-1ecac22_0
2025-10-01T14:07:10.988616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82b388-f184a732-db1f295f-d2525338_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9a7a2082-ca768642-84861ab4-1ecac22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:10.992156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a2082-ca768642-84861ab4-1ecac22_0] Write session: try to update token
2025-10-01T14:07:10.992180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a2082-ca768642-84861ab4-1ecac22_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:11.025037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:11.025056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:11.025059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:11.025062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:11.025072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254635499130798:3563]
2025-10-01T14:07:11.025077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254635499130798:3563]
2025-10-01T14:07:11.025082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254635499130798:3563]
2025-10-01T14:07:11.025134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:11.025143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.025145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:11.025288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:11.025819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:11.025824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:11.025828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:11.035901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 215 sessionId: src_id|9a7a2082-ca768642-84861ab4-1ecac22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:11.038929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:11.184884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:11.185388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.185404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.185638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:11.186709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:11.186789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254637875991325:3772]
2025-10-01T14:07:11.186814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:11.186920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 215 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a7a2082-ca768642-84861ab4-1ecac22_0
2025-10-01T14:07:11.187290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a2082-ca768642-84861ab4-1ecac22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:11.187302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a2082-ca768642-84861ab4-1ecac22_0] Write session will restart in 0.007132s
2025-10-01T14:07:11.187327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a2082-ca768642-84861ab4-1ecac22_0] Write session: Do CDS request
2025-10-01T14:07:11.187334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a2082-ca768642-84861ab4-1ecac22_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:11.187159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 215 sessionId: src_id|9a7a2082-ca768642-84861ab4-1ecac22_0 is DEAD
2025-10-01T14:07:11.196257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a2082-ca768642-84861ab4-1ecac22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:11.196798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:11.196815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 216
2025-10-01T14:07:11.196991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:11.197034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:11.197044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:11.197049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:11.197451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 216 sessionId:  describe result for acl check
2025-10-01T14:07:11.197489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:11.197491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:11.197494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:11.197500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254642170958667:3858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:11.198255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254642170958667:3858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:11.201062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254642170958667:3858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:11.208090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254642170958667:3858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:11.208107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254642170958667:3858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:11.208110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254642170958667:3858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:11.208121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:11.219553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:11.221423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:11.221605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:11.221615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:11.221626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:11.221674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:11.221715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254639794098373:3565]
2025-10-01T14:07:11.222177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:11.222510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:11.222559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:11.222871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:11.222942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.222948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.222949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.222950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.222951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.222952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.222953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.222955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.222956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.222957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.222958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.222959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.222961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.222962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.222966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.222978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.222981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.222985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.222990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.222994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.222998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.223001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.223006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.223010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.223014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.223019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.223023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.223027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.223034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.223041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.223050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.223057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.223061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.223067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.223071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.223076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.223080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.223089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.223093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.223098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.223103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.223111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.223116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.223124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.223128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.223133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.223136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.223141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.223146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.223152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.223160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.223165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.223170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.223176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.223182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.223187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.224492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:11.229372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:11.230167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:11.230181Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:11.230184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:11.230188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:11.230196Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 215 [2:7556254639794098373:3565]
2025-10-01T14:07:11.230213Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:11.230236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:11.230245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.230248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.230251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.230269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:11.230275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:11.230281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:11.230331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.230340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.230343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.230346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:11.230349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:11.230436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:11.230443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.230455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.230471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.230489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:11.230507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254639794098367:3565]
2025-10-01T14:07:11.230509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254639794098367:3565]
2025-10-01T14:07:11.230511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254639794098367:3565]
2025-10-01T14:07:11.230525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:11.230539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:11.230553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:11.230556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:11.230592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254639794098367:3565]
2025-10-01T14:07:11.230595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:11.230758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:11.230760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:11.230762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:11.230767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:11.230994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170958634:2446], now have 1 active actors on pipe
2025-10-01T14:07:11.230997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170958796:3858], now have 1 active actors on pipe
2025-10-01T14:07:11.232885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.232896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.232926Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:11.232939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.232944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.232947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:11.232957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.232972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:11.232988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:11.233248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.233253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.233267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:11.232036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 215
2025-10-01T14:07:11.232073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 215
2025-10-01T14:07:11.233399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 216 partition: 0 MaxSeqNo: 45 sessionId: src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0
2025-10-01T14:07:11.234443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a2082-ca768642-84861ab4-1ecac22_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:11.236745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0] Write session: try to update token
2025-10-01T14:07:11.236762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:11.258071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:11.258087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:11.258090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:11.258093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:11.258102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254639794098367:3565]
2025-10-01T14:07:11.258106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254639794098367:3565]
2025-10-01T14:07:11.258110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254639794098367:3565]
2025-10-01T14:07:11.258158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:11.258167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.258169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:11.258309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:11.262514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:11.262529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:11.262534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:11.266631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 216 sessionId: src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:11.269305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:11.286849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254642170958914:3772]
2025-10-01T14:07:11.294253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 215, pipe: [1:7556254642170958914:3772]
2025-10-01T14:07:11.413040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:11.413369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.413379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.413426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170958914:3772], now have 1 active actors on pipe
2025-10-01T14:07:11.413744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:11.413802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:11.413867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:11.413870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:11.413937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 216 reason: error at write: Disconnected sessionId: src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0
2025-10-01T14:07:11.414139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 216 sessionId: src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0 is DEAD
2025-10-01T14:07:11.414289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254642170958914:3772]
2025-10-01T14:07:11.414666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:11.414680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0] Write session will restart in 0.007198s
2025-10-01T14:07:11.414709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0] Write session: Do CDS request
2025-10-01T14:07:11.414716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:11.426863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:11.427021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:11.427039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 217
2025-10-01T14:07:11.427847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:11.427881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:11.427886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:11.427889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:11.428389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 217 sessionId:  describe result for acl check
2025-10-01T14:07:11.428417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:11.428420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:11.428422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:11.428427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254642170958956:3869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:11.429103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254642170958956:3869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:11.435432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254642170958956:3869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:11.443368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254642170958956:3869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:11.443389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254642170958956:3869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:11.443392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254642170958956:3869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:11.443402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:11.468913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:11.471044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:11.471328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:11.471338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:11.471353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:11.471423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:11.471481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254639794098682:3580]
2025-10-01T14:07:11.472086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:11.472423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:11.472473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:11.472818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:11.472894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.472895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.472897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.472898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.472899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.472900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.472901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.472903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.472904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.472905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.472906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.472907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.472909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.472910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.472916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.472925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.472929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.472933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.472936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.472940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.472944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.472947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.472950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.472963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.472966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.472969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.472972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.472974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.472982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.472989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.472996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.473001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.473007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.473012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.473016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.473020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.473025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.473030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.473034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.473039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.473043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.473048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.473052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.473056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.473060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.473065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.473071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.473076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.473080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.473085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.473088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.473093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.473097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.473102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.473106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.473111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.473147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:11.477312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:11.478027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:11.478045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:11.478048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:11.478051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:11.478059Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 216 [2:7556254639794098682:3580]
2025-10-01T14:07:11.478082Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:11.478104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:11.478111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.478114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.478117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.478135Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:11.478140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:11.478147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:11.478213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.478221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.478223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.478226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:11.478229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:11.478294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:11.478303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.478316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.478325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.478339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:11.478360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170959069:3869], now have 1 active actors on pipe
2025-10-01T14:07:11.478389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170958941:2446], now have 1 active actors on pipe
2025-10-01T14:07:11.478402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254639794098677:3580]
2025-10-01T14:07:11.478409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254639794098677:3580]
2025-10-01T14:07:11.478411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254639794098677:3580]
2025-10-01T14:07:11.478415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 216
2025-10-01T14:07:11.478448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 216
2025-10-01T14:07:11.478426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:11.478447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:11.478451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:11.478454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:11.478457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:11.478461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:11.478464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:11.478514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.478519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.478536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254639794098677:3580]
2025-10-01T14:07:11.478546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:11.478556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:11.478576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:11.478586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.478591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.478598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:11.478608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.478620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:11.478648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:11.479025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.479039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.479071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:11.480229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 217 partition: 0 MaxSeqNo: 45 sessionId: src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0
2025-10-01T14:07:11.480855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d699d6-a2026353-6c00e660-6b6b9ee5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:11.483565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0] Write session: try to update token
2025-10-01T14:07:11.483589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:11.501916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 217 sessionId: src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:11.504411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:11.505118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.505138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.505191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:11.505315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:11.508257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:11.508278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:11.508281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:11.508283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:11.508293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254639794098677:3580]
2025-10-01T14:07:11.508297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254639794098677:3580]
2025-10-01T14:07:11.508301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254639794098677:3580]
2025-10-01T14:07:11.508339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:11.508345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:11.508347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:11.508348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:11.508353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.508355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:11.508492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:11.510243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254642170959218:3772]
2025-10-01T14:07:11.510706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 216, pipe: [1:7556254642170959218:3772]
2025-10-01T14:07:11.657725Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:11.657992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170959218:3772], now have 1 active actors on pipe
2025-10-01T14:07:11.666126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.666153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.666320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.666438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.666505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.666573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.666990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.667005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.667074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.667138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.667204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.667277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.667379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.667387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.667450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.667508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.667566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.667626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.667671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.667678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.667738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.667801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.667857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.667917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.667960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.667967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.668023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.668082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.668142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.668206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.668247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.668260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.668332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.668398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.668454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.668514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.668551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.668554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.668627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.668688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.668758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.668839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.668891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.668894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.668975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.669039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.669106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.669169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.669225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.669228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.669301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.669358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.669425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.669494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.669541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.669543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.669607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:11.669667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:11.669732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:11.669792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:11.669830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:11.669833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:11.670683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254642170959218:3772]
2025-10-01T14:07:11.670701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:11.670705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:11.670710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:11.670731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 217 reason: error at write: Disconnected sessionId: src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0
2025-10-01T14:07:11.671091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:11.671102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0] Write session will restart in 0.007273s
2025-10-01T14:07:11.671120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0] Write session: Do CDS request
2025-10-01T14:07:11.671124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:11.670931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 217 sessionId: src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0 is DEAD
2025-10-01T14:07:11.670979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:11.679988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:11.680123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:11.680142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 218
2025-10-01T14:07:11.680362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:11.680395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:11.680403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:11.680411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:11.680804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 218 sessionId:  describe result for acl check
2025-10-01T14:07:11.680851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:11.680859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:11.680861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:11.680865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254642170959238:3874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:11.681449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254642170959238:3874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:11.685797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254642170959238:3874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:11.690725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254642170959238:3874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:11.690745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254642170959238:3874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:11.690748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254642170959238:3874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:11.690894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:11.707562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:11.712074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:11.712532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:11.712544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:11.712557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:11.712619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:11.712664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254639794098957:3583]
2025-10-01T14:07:11.713292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:11.715275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:11.715338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:11.715707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:11.715764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.715765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.715766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.715767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.715768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.715769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.715771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.715772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.715773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.715775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.715776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.715777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.715778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.715780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.715786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.715794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.715798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.715802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.715806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.715809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.715812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.715816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.715819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.715823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.715826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.715830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.715833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.715837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.715846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.715853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.715859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.715864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.715868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.715874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.715878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.715884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.715888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.715893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.715897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.715902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.715906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.715911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.715914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.715918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.715922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.715927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.715931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.715935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.715942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.715950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.715955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.715959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.715962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.715967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.715970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.715974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.716006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:11.723813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 217
2025-10-01T14:07:11.723819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 217
2025-10-01T14:07:11.722119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:11.722828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:11.722835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:11.722839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:11.722845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:11.722853Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 217 [2:7556254639794098957:3583]
2025-10-01T14:07:11.722871Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:11.722891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:11.722896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.722900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.722902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.722922Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:11.722928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:11.722938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:11.723011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.723014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.723017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.723021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:11.723024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:11.723103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:11.723107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.723122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.723136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.723155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:11.723172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254639794098951:3583]
2025-10-01T14:07:11.723174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254639794098951:3583]
2025-10-01T14:07:11.723177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254639794098951:3583]
2025-10-01T14:07:11.723192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:11.723214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:11.723231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:11.723234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:11.723273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254639794098951:3583]
2025-10-01T14:07:11.723275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:11.723377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:11.723379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:11.723381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:11.723388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:11.726341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170959222:2446], now have 1 active actors on pipe
2025-10-01T14:07:11.726367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170959360:3874], now have 1 active actors on pipe
2025-10-01T14:07:11.726396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.726404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.726446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:11.726462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.726469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.726476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:11.726488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.726509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:11.726542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:11.728151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.728180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.728208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:11.728407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 218 partition: 0 MaxSeqNo: 45 sessionId: src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0
2025-10-01T14:07:11.729058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fe91b5-cd870d17-b2f240ab-a734cbd0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:11.731798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0] Write session: try to update token
2025-10-01T14:07:11.731821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:11.751496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:11.751518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:11.751520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:11.751523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:11.751534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254639794098951:3583]
2025-10-01T14:07:11.751538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254639794098951:3583]
2025-10-01T14:07:11.751546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254639794098951:3583]
2025-10-01T14:07:11.751603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:11.751610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.751613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:11.751659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:11.751667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:11.751672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:11.751799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:11.759000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 218 sessionId: src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:11.761971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:11.771026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254642170959501:3772]
2025-10-01T14:07:11.777686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 217, pipe: [1:7556254642170959501:3772]
2025-10-01T14:07:11.916342Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:11.916878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.916888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.916912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170959501:3772], now have 1 active actors on pipe
2025-10-01T14:07:11.917208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:11.917202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254642170959501:3772]
2025-10-01T14:07:11.917235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:11.917260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:11.917261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:11.917307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 218 reason: error at write: Disconnected sessionId: src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0
2025-10-01T14:07:11.917452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 218 sessionId: src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0 is DEAD
2025-10-01T14:07:11.918624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:11.918635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0] Write session will restart in 0.007449s
2025-10-01T14:07:11.918664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0] Write session: Do CDS request
2025-10-01T14:07:11.918669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:11.927067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:11.929443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:11.929464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 219
2025-10-01T14:07:11.929676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:11.929706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:11.929711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:11.929715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:11.930285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 219 sessionId:  describe result for acl check
2025-10-01T14:07:11.930327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:11.930329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:11.930331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:11.930337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254642170959548:3879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:11.930861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254642170959548:3879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:11.934236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254642170959548:3879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:11.937875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254642170959548:3879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:11.937889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254642170959548:3879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:11.937892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254642170959548:3879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:11.937902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:11.946782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:11.952027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:11.952267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:11.952278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:11.952292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:11.952364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:11.952407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254639794099243:3586]
2025-10-01T14:07:11.953021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:11.953690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:11.953753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:11.954230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:11.954314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.954316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.954317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.954319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.954320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.954321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.954322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.954324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.954325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.954326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.954327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.954328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.954330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.954331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.954338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.954348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.954351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.954355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.954359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.954362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.954366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.954389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.954392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.954396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.954400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.954404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.954408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.954411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.954421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.954429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:11.954436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.954441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:11.954445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.954450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:11.954456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.954461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:11.954469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.954475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:11.954479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.954484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:11.954489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.954494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:11.954499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.954504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:11.954508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.954513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:11.954517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.954522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.954527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.954532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.954536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.954540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.954545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.954550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:11.954554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.954558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:11.954596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:11.959046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:11.959700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:11.959716Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:11.959720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:11.959723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:11.959730Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 218 [2:7556254639794099243:3586]
2025-10-01T14:07:11.959753Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:11.959777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:11.959784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.959787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.959790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.959809Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:11.959819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:11.959826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:11.959890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.959897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.959899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.959902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:11.959905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:11.959971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:11.959980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.959991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:11.960002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:11.960018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:11.960038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170959707:3879], now have 1 active actors on pipe
2025-10-01T14:07:11.960042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254642170959516:2446], now have 1 active actors on pipe
2025-10-01T14:07:11.960050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254639794099237:3586]
2025-10-01T14:07:11.960051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254639794099237:3586]
2025-10-01T14:07:11.960053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254639794099237:3586]
2025-10-01T14:07:11.960068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:11.960080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:11.960083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:11.960086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:11.960086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:11.960099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:11.960103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:11.960141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254639794099237:3586]
2025-10-01T14:07:11.960148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:11.960424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 218
2025-10-01T14:07:11.960433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 218
2025-10-01T14:07:11.960735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:11.960755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.960762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.960789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:11.960805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:11.960815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:11.960823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:11.960845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:11.960857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:11.960877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:11.961546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:11.961557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:11.961579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:11.961891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 219 partition: 0 MaxSeqNo: 45 sessionId: src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0
2025-10-01T14:07:11.962312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e155684-2dad619f-b6ca5a7b-1d711e4e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:11.965297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0] Write session: try to update token
2025-10-01T14:07:11.965318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:11.985412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:11.985429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:11.985432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:11.985434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:11.985458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254639794099237:3586]
2025-10-01T14:07:11.985463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254639794099237:3586]
2025-10-01T14:07:11.985467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254639794099237:3586]
2025-10-01T14:07:11.985522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:11.985534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:11.985538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:11.985679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:11.985689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:11.985692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:11.985802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:11.996957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 219 sessionId: src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:11.999896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:12.017831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254646465927096:3772]
2025-10-01T14:07:12.018167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 218, pipe: [1:7556254646465927096:3772]
2025-10-01T14:07:12.147366Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:12.148037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.148050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.148069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927096:3772], now have 1 active actors on pipe
2025-10-01T14:07:12.148289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:12.148334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254646465927096:3772]
2025-10-01T14:07:12.148360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:12.148377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:12.148380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:12.148436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 219 reason: error at write: Disconnected sessionId: src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0
2025-10-01T14:07:12.148772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:12.148782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0] Write session will restart in 0.009649s
2025-10-01T14:07:12.148813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0] Write session: Do CDS request
2025-10-01T14:07:12.148835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:12.148618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 219 sessionId: src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0 is DEAD
2025-10-01T14:07:12.162946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:12.163100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:12.163115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 220
2025-10-01T14:07:12.163268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:12.163298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:12.163303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:12.163307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:12.163730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 220 sessionId:  describe result for acl check
2025-10-01T14:07:12.163779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:12.163781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:12.163783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:12.163789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254646465927137:3886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:12.167579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254646465927137:3886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:12.173377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254646465927137:3886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:12.183792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254646465927137:3886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:12.183809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254646465927137:3886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:12.183813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254646465927137:3886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:12.183822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:12.185822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:12.190419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:12.190683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:12.190696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:12.190708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:12.190762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:12.190808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254644089066812:3588]
2025-10-01T14:07:12.191420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:12.191740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:12.191787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:12.192093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:12.192160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.192165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.192166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.192168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.192169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.192171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.192172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.192173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.192174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.192175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.192176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.192177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.192179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.192191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.192196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.192207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.192212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.192216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.192220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.192224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.192228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.192230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.192232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.192235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.192237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.192239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.192241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.192243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.192249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.192254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.192269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.192277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.192279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.192283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.192285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.192289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.192291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.192295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.192298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.192301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.192304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.192307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.192311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.192314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.192317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.192320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.192323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.192326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.192329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.192331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.192334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.192337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.192340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.192343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.192346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.192348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.192371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:12.196720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:12.197671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:12.197693Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:12.197696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:12.197700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:12.197708Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 219 [2:7556254644089066812:3588]
2025-10-01T14:07:12.197725Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:12.197745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:12.197749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.197753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.197756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.197772Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:12.197777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:12.197784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:12.197840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.197841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.197842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.197846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:12.197849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:12.197927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:12.197930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.197942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.197952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.197967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:12.197987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254644089066806:3588]
2025-10-01T14:07:12.197990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254644089066806:3588]
2025-10-01T14:07:12.197991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254644089066806:3588]
2025-10-01T14:07:12.198008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:12.198023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:12.198038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:12.198041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:12.198080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254644089066806:3588]
2025-10-01T14:07:12.198082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:12.198087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:12.198092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:12.198094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:12.198101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:12.198163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927104:2446], now have 1 active actors on pipe
2025-10-01T14:07:12.198170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927370:3886], now have 1 active actors on pipe
2025-10-01T14:07:12.198254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 219
2025-10-01T14:07:12.198255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 219
2025-10-01T14:07:12.198311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.198325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.198361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:12.198386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.198391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.198394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:12.198405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.198419Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:12.198447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:12.198916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.198927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.198948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:12.201368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 220 partition: 0 MaxSeqNo: 45 sessionId: src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0
2025-10-01T14:07:12.201757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|585795cb-342a2c4d-c4d342f4-dc0b00da_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:12.204671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0] Write session: try to update token
2025-10-01T14:07:12.204689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:12.213445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:12.213460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:12.213470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254644089066806:3588]
2025-10-01T14:07:12.213518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:12.213520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:12.213718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:12.213900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:12.214059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:12.214207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:12.214434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:12.214479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:12.227768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 220 sessionId: src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:12.230471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:12.236287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:12.233861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.233892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.233934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:12.248354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254646465927387:3772]
2025-10-01T14:07:12.247754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:12.247776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:12.247780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:12.247783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:12.247794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254644089066806:3588]
2025-10-01T14:07:12.247799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254644089066806:3588]
2025-10-01T14:07:12.247803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254644089066806:3588]
2025-10-01T14:07:12.247856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:12.247863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.247866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:12.248026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:12.253864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:12.253874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:12.253879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:12.258587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 219, pipe: [1:7556254646465927387:3772]
2025-10-01T14:07:12.410573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:12.411110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927387:3772], now have 1 active actors on pipe
2025-10-01T14:07:12.419939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.419966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.420137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.420188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.420248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.420310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.420362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.420367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.420429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.420479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.420535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.420596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.420637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.420640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.420712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.420775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.420896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.420956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.420994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.420997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.421070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.421130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.421190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.421250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.421376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.421380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.421448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.421503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.421559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.421618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.421656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.421659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.421728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.421783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.421840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.421898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.421945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.421947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.422018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.422070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.422126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.422182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.422220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.422223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.422286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.422343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.422687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.422756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.423853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254646465927387:3772]
2025-10-01T14:07:12.423885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:12.423896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:12.423899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:12.423926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 220 reason: error at write: Disconnected sessionId: src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0
2025-10-01T14:07:12.424279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:12.424293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0] Write session will restart in 0.007370s
2025-10-01T14:07:12.424326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0] Write session: Do CDS request
2025-10-01T14:07:12.424332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:12.424144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 220 sessionId: src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0 is DEAD
2025-10-01T14:07:12.422803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.422813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.422876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.422929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.422989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.423046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.423105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.423109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.423173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.423229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.423287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.423347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.423395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.423398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.424744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:12.434843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:12.434912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:12.434926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 221
2025-10-01T14:07:12.435163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:12.435200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:12.435206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:12.435209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:12.435671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 221 sessionId:  describe result for acl check
2025-10-01T14:07:12.435708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:12.435710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:12.435712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:12.435716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254646465927430:3897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:12.436229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254646465927430:3897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:12.443072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254646465927430:3897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:12.455597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254646465927430:3897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:12.455615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254646465927430:3897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:12.455618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254646465927430:3897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:12.455627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:12.460030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:12.463401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:12.463656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:12.463666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:12.463679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:12.463735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:12.463776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254644089067127:3603]
2025-10-01T14:07:12.464366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:12.465914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:12.465978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:12.466346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:12.466421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.466423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.466424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.466425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.466426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.466427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.466428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.466429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.466430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.466431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.466433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.466434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.466435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.466436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.466443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.466454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.466457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.466462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.466465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.466469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.466472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.466476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.466479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.466483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.466487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.466490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.466493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.466496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.466503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.466511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.466518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.466523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.466527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.466532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.466536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.466541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.466546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.466551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.466556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.466561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.466565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.466569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.466573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.466577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.466580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.466585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.466588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.466594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.466598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.466603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.466607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.466611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.466615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.466619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.466622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.466627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.466667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:12.471588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:12.472249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:12.472264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:12.472268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:12.472271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:12.472278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 220 [2:7556254644089067127:3603]
2025-10-01T14:07:12.472295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:12.472314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:12.472321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.472325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.472328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.472344Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:12.472354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:12.472360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:12.472421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.472427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.472429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.472432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:12.472435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:12.472504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:12.472510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.472522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.472535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.472551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:12.472572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254644089067121:3603]
2025-10-01T14:07:12.472579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254644089067121:3603]
2025-10-01T14:07:12.472581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254644089067121:3603]
2025-10-01T14:07:12.472590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:12.472599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:12.472603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:12.472605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:12.472607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927415:2446], now have 1 active actors on pipe
2025-10-01T14:07:12.472616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:12.472627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:12.472631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:12.472640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927675:3897], now have 1 active actors on pipe
2025-10-01T14:07:12.472675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254644089067121:3603]
2025-10-01T14:07:12.472689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:12.472706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:12.472750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 220
2025-10-01T14:07:12.472883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 220
2025-10-01T14:07:12.472948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.472959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.472983Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:12.472994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.472999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.473005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:12.473014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.473023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:12.473038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:12.478520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.478558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.478603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:12.478833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 221 partition: 0 MaxSeqNo: 45 sessionId: src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0
2025-10-01T14:07:12.479322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df74df71-e55e3c15-d0c629ff-89ff8dd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:12.481973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0] Write session: try to update token
2025-10-01T14:07:12.481998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:12.495570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:12.495595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:12.495606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254644089067121:3603]
2025-10-01T14:07:12.495656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:12.496230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:12.496382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:12.496529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:12.496664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:12.496885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:12.496942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:12.497105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:12.501771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 221 sessionId: src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:12.504424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:12.505331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.505363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.505401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:12.505592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:12.523812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254646465927695:3772]
2025-10-01T14:07:12.525135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:12.525158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:12.525161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:12.525163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:12.525174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254644089067121:3603]
2025-10-01T14:07:12.525180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254644089067121:3603]
2025-10-01T14:07:12.525184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254644089067121:3603]
2025-10-01T14:07:12.525236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:12.525253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.525255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:12.525400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:12.526503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:12.526518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:12.526523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:12.534475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 220, pipe: [1:7556254646465927695:3772]
2025-10-01T14:07:12.767701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:12.768267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927695:3772], now have 1 active actors on pipe
2025-10-01T14:07:12.778068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.778094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.778275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.778334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.778698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.778768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.778819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.778827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.778903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.778961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.779024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.779090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.779143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.779147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.779226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.779298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.779357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.779415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.779457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.779460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.779571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.779642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.779725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.779797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.779848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.779851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.779944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.780018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.780090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.780160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.780205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.780208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.780289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.780347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.780406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.780468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.780541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.780544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.780615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.780681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.780748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.780811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.780886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.780890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.780962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.781077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.781147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.781217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.781262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.781265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.781333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.781391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.781450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.781519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.781569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.781572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.781643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:12.781701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:12.781760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:12.781819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:12.781862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:12.781865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:12.783502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:12.783513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0] Write session will restart in 0.009952s
2025-10-01T14:07:12.783535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0] Write session: Do CDS request
2025-10-01T14:07:12.783541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:12.782998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254646465927695:3772]
2025-10-01T14:07:12.783044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:12.783086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:12.783089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:12.783119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 221 reason: error at write: Disconnected sessionId: src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0
2025-10-01T14:07:12.783338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 221 sessionId: src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0 is DEAD
2025-10-01T14:07:12.784202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:12.795730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:12.798723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:12.798738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 222
2025-10-01T14:07:12.798879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:12.798907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:12.798913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:12.798918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:12.802743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 222 sessionId:  describe result for acl check
2025-10-01T14:07:12.802788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:12.802790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:12.802792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:12.802799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254646465927723:3902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:12.803332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254646465927723:3902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:12.806703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254646465927723:3902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:12.824006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254646465927723:3902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:12.824026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254646465927723:3902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:12.824030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254646465927723:3902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:12.824040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:12.859943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:12.864486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:12.864768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:12.864780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:12.864794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:12.864875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:12.864925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254644089067407:3606]
2025-10-01T14:07:12.865579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:12.865919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:12.865986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:12.866329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:12.866409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.866415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.866416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.866417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.866418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.866419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.866420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.866421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.866423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.866424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.866425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.866426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.866427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.866428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.866435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.866444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.866448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.866452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.866456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.866460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.866464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.866467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.866471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.866474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.866478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.866482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.866486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.866490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.866497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.866506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:12.866512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.866518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:12.866523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.866529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:12.866533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.866539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:12.866543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.866549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:12.866553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.866558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:12.866563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.866568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:12.866572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.866576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:12.866580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.866586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:12.866590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.866595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.866600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.866604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.866608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.866613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.866619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.866624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:12.866628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.866633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:12.866673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:12.878904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:12.879571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:12.879588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:12.879591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:12.879595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:12.879602Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 221 [2:7556254644089067407:3606]
2025-10-01T14:07:12.879621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:12.879642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:12.879650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.879653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.879656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.879674Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:12.879679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:12.879689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:12.879762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.879769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.879771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.879777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:12.879779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:12.879856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:12.879863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.879876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:12.879887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:12.879902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:12.879926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254644089067401:3606]
2025-10-01T14:07:12.879928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254644089067401:3606]
2025-10-01T14:07:12.879930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254644089067401:3606]
2025-10-01T14:07:12.879946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:12.879959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:12.879973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:12.879977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:12.880021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254644089067401:3606]
2025-10-01T14:07:12.880024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:12.880109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:12.880111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:12.880113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:12.880118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:12.880779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927701:2446], now have 1 active actors on pipe
2025-10-01T14:07:12.880784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927811:3902], now have 1 active actors on pipe
2025-10-01T14:07:12.882464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 221
2025-10-01T14:07:12.882509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 221
2025-10-01T14:07:12.883525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254646465927983:3772]
2025-10-01T14:07:12.888123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.888143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.888468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254646465927983:3772], now have 1 active actors on pipe
2025-10-01T14:07:12.888485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7910608-19ccf2da-b62c785f-13489623_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:12.888497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:12.888502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:12.888504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:12.888516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:12.888531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:12.888553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:12.890602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 221, pipe: [1:7556254646465927983:3772]
2025-10-01T14:07:12.891287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:12.891302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:12.891341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:12.892542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 222 partition: 0 MaxSeqNo: 45 sessionId: src_id|7910608-19ccf2da-b62c785f-13489623_0
2025-10-01T14:07:12.892996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a294d4e6-51f6a0b6-f0481592-7f87665f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7910608-19ccf2da-b62c785f-13489623_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:12.895451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7910608-19ccf2da-b62c785f-13489623_0] Write session: try to update token
2025-10-01T14:07:12.895470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7910608-19ccf2da-b62c785f-13489623_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:12.912878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:12.912897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:12.912900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:12.912902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:12.912911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254644089067401:3606]
2025-10-01T14:07:12.912916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254644089067401:3606]
2025-10-01T14:07:12.912920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254644089067401:3606]
2025-10-01T14:07:12.912970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:12.912978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:12.912981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:12.913128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:12.914894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:12.914902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:12.914905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:12.928247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 222 sessionId: src_id|7910608-19ccf2da-b62c785f-13489623_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:12.930652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:13.123951Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:13.124458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.124468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.125615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:13.125679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254646465927983:3772]
2025-10-01T14:07:13.125704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:13.125708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:13.125787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 222 reason: error at write: Disconnected sessionId: src_id|7910608-19ccf2da-b62c785f-13489623_0
2025-10-01T14:07:13.125984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 222 sessionId: src_id|7910608-19ccf2da-b62c785f-13489623_0 is DEAD
2025-10-01T14:07:13.126527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7910608-19ccf2da-b62c785f-13489623_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:13.126541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7910608-19ccf2da-b62c785f-13489623_0] Write session will restart in 0.007502s
2025-10-01T14:07:13.126576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7910608-19ccf2da-b62c785f-13489623_0] Write session: Do CDS request
2025-10-01T14:07:13.126582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7910608-19ccf2da-b62c785f-13489623_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:13.126567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:13.134880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7910608-19ccf2da-b62c785f-13489623_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:13.135340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:13.135353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 223
2025-10-01T14:07:13.135622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:13.135644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:13.135648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:13.135651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:13.136042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 223 sessionId:  describe result for acl check
2025-10-01T14:07:13.136067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:13.136069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:13.136070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:13.136073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254650760895313:3908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:13.136562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254650760895313:3908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:13.153086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254650760895313:3908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:13.161410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254650760895313:3908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:13.161429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254650760895313:3908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:13.161433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254650760895313:3908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:13.161444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:13.181766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:13.183406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:13.183613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:13.183618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:13.183630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:13.183678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:13.183712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254648384034993:3609]
2025-10-01T14:07:13.184309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:13.184751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:13.184790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:13.185160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:13.185211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.185212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.185214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.185215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.185216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.185217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.185218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.185219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.185221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.185222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.185223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.185224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.185225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.185226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.185231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.185241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.185244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.185248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.185251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.185254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.185257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.185260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.185263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.185266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.185270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.185273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.185277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.185280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.185287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.185294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.185299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.185304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.185310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.185315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.185319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.185323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.185327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.185332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.185336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.185340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.185344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.185350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.185354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.185358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.185361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.185383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.185387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.185391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.185395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.185399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.185403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.185407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.185411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.185415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.185419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.185423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.185460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:13.195481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:13.196115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:13.196122Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:13.196125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:13.196130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:13.196139Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 222 [2:7556254648384034993:3609]
2025-10-01T14:07:13.196155Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:13.196176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:13.196179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.196183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.196185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.196205Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:13.196211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:13.196217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:13.196281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.196283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.196286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.196289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:13.196292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:13.196369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:13.196372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.196385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.196394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.196408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:13.196425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254648384034987:3609]
2025-10-01T14:07:13.196427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254648384034987:3609]
2025-10-01T14:07:13.196429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254648384034987:3609]
2025-10-01T14:07:13.196438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:13.196452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:13.196465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:13.196469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:13.196506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254648384034987:3609]
2025-10-01T14:07:13.196509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:13.197129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:13.197133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:13.197134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:13.197138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:13.197720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 222
2025-10-01T14:07:13.197742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 222
2025-10-01T14:07:13.198095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254650760895400:3908], now have 1 active actors on pipe
2025-10-01T14:07:13.198101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254650760895304:2446], now have 1 active actors on pipe
2025-10-01T14:07:13.198113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.198118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.198150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:13.198157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.198161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.198162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:13.198169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.198179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:13.198195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:13.198480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.198486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.198501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:13.198874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 223 partition: 0 MaxSeqNo: 45 sessionId: src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0
2025-10-01T14:07:13.199329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7910608-19ccf2da-b62c785f-13489623_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:13.201834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0] Write session: try to update token
2025-10-01T14:07:13.201853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:13.225757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254650760895591:3772]
2025-10-01T14:07:13.226037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254650760895591:3772], now have 1 active actors on pipe
2025-10-01T14:07:13.226128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 222, pipe: [1:7556254650760895591:3772]
2025-10-01T14:07:13.232628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 223 sessionId: src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:13.235098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:13.235730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.235750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.235835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:13.235964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:13.244483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:13.244501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:13.244504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:13.244506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:13.244521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254648384034987:3609]
2025-10-01T14:07:13.244530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254648384034987:3609]
2025-10-01T14:07:13.244538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254648384034987:3609]
2025-10-01T14:07:13.244610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:13.244618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.244620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:13.244775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:13.248503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:13.248515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:13.248518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:13.477109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:13.496508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.502615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.502842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.502906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.502978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.503047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.503095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.503100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.503177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.503244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.503311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.503384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.503427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.503430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.503498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.503556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.503634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.503698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.503740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.503744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.503817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.503878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.503937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.503995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.504035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.504038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.504104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.504164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.504222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.504284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.504328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.504331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.504409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.504476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.504542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.504610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.504659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.504662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.504740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.504810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.504899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.504973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.505023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.505025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.505108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.505175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.505246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.505319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.505367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.505369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.505442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.505727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.505791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.505854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.505897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.505900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.505974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:13.506046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:13.506119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:13.506185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:13.506227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:13.506230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:13.507008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:13.507027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:13.507063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 223 reason: error at write: Disconnected sessionId: src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0
2025-10-01T14:07:13.507242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 223 sessionId: src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0 is DEAD
2025-10-01T14:07:13.507434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:13.507437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254650760895591:3772]
2025-10-01T14:07:13.509938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:13.509949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0] Write session will restart in 0.008570s
2025-10-01T14:07:13.509976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0] Write session: Do CDS request
2025-10-01T14:07:13.509982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:13.519744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:13.523098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:13.527142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:13.527165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 224
2025-10-01T14:07:13.527629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:13.527681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:13.527688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:13.527695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:13.529072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 224 sessionId:  describe result for acl check
2025-10-01T14:07:13.529121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:13.529123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:13.529125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:13.529131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254650760895679:3919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:13.529703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254650760895679:3919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:13.542465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254650760895679:3919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:13.551454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254650760895679:3919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:13.551469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254650760895679:3919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:13.551473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254650760895679:3919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:13.551483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:13.570444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:13.576744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:13.577054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:13.577060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:13.577072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:13.577133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:13.577176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254648384035312:3624]
2025-10-01T14:07:13.577820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:13.578513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:13.578565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:13.578914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:13.578973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.578974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.578976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.578977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.578978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.578979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.578981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.578982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.578983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.578985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.578986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.578987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.578988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.578989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.578996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.579006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.579010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.579014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.579018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.579022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.579025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.579029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.579032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.579036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.579039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.579042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.579046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.579049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.579057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.579065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.579071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.579076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.579083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.579087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.579092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.579096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.579100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.579105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.579109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.579113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.579118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.579122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.579126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.579130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.579135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.579139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.579143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.579147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.579152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.579157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.579161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.579165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.579169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.579174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.579177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.579182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.579222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:13.587902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:13.588636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:13.588644Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:13.588647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:13.588651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:13.588659Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 223 [2:7556254648384035312:3624]
2025-10-01T14:07:13.588678Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:13.588699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:13.588702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.588706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.588709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.588726Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:13.588732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:13.588738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:13.588807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.588809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.588812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.588815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:13.588819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:13.588910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:13.588913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.588926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.588937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.588951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:13.588973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254650760895623:2446], now have 1 active actors on pipe
2025-10-01T14:07:13.588981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254648384035306:3624]
2025-10-01T14:07:13.588984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254648384035306:3624]
2025-10-01T14:07:13.588987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254648384035306:3624]
2025-10-01T14:07:13.588996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:13.589003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:13.589005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:13.589007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:13.589011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:13.589028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:13.589031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:13.589076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254650760895845:3919], now have 1 active actors on pipe
2025-10-01T14:07:13.589079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254648384035306:3624]
2025-10-01T14:07:13.589088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:13.589332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 223
2025-10-01T14:07:13.589373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 223
2025-10-01T14:07:13.589428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:13.589904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.589914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.589944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:13.589953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.589957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.589960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:13.589970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.589983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:13.589999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:13.594431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.594449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.594487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:13.594683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 224 partition: 0 MaxSeqNo: 45 sessionId: src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0
2025-10-01T14:07:13.595905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd7b5a5-1915033d-eee60bc7-d47a3307_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:13.598794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0] Write session: try to update token
2025-10-01T14:07:13.598817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:13.610263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254650760895903:3772]
2025-10-01T14:07:13.610736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254650760895903:3772], now have 1 active actors on pipe
2025-10-01T14:07:13.610867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 223, pipe: [1:7556254650760895903:3772]
2025-10-01T14:07:13.623531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:13.623549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:13.623553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:13.623555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:13.623566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254648384035306:3624]
2025-10-01T14:07:13.623572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254648384035306:3624]
2025-10-01T14:07:13.623576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254648384035306:3624]
2025-10-01T14:07:13.623633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:13.623641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.623643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:13.623824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:13.627107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:13.627120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:13.627125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:13.647641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 224 sessionId: src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:13.650451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:13.798042Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:13.798362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.798460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.798877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:13.803257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:13.803271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0] Write session will restart in 0.007305s
2025-10-01T14:07:13.803300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0] Write session: Do CDS request
2025-10-01T14:07:13.803307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:13.802517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:13.802543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:13.802609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 224 reason: error at write: Disconnected sessionId: src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0
2025-10-01T14:07:13.802802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 224 sessionId: src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0 is DEAD
2025-10-01T14:07:13.802951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:13.802989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254650760895903:3772]
2025-10-01T14:07:13.811865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:13.814689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:13.814710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 225
2025-10-01T14:07:13.815720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:13.815771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:13.815777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:13.815781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:13.816612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 225 sessionId:  describe result for acl check
2025-10-01T14:07:13.816660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:13.816667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:13.816669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:13.816674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254650760895921:3924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:13.817236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254650760895921:3924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:13.831596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254650760895921:3924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:13.850938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254650760895921:3924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:13.850958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254650760895921:3924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:13.850962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254650760895921:3924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:13.850973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:13.872811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:13.873454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:13.873651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:13.873662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:13.873674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:13.873731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:13.873772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254648384035593:3627]
2025-10-01T14:07:13.874330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:13.874702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:13.874747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:13.875047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:13.875105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.875110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.875111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.875112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.875114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.875114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.875116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.875117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.875118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.875119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.875120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.875122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.875123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.875124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.875128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.875137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.875140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.875144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.875147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.875151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.875154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.875158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.875161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.875164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.875179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.875187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.875190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.875194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.875201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.875212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:13.875221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.875226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:13.875234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.875241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:13.875247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.875256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:13.875261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.875269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:13.875274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.875282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:13.875290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.875299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:13.875303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.875311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:13.875317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.875326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:13.875334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.875343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.875348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.875352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.875359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.875363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.875370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.875375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:13.875382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.875387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:13.875423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:13.888399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:13.889166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:13.889178Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:13.889182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:13.889185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:13.889193Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 224 [2:7556254648384035593:3627]
2025-10-01T14:07:13.889212Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:13.889231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:13.889234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.889238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.889240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.889259Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:13.889264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:13.889271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:13.889336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.889339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.889340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.889343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:13.889346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:13.889423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:13.889426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.889439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:13.889450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:13.889464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:13.889480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254648384035587:3627]
2025-10-01T14:07:13.889483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254648384035587:3627]
2025-10-01T14:07:13.889485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254648384035587:3627]
2025-10-01T14:07:13.889497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:13.889505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:13.889508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:13.889510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:13.889511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:13.889524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:13.889527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:13.889572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254650760896058:3924], now have 1 active actors on pipe
2025-10-01T14:07:13.889582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254650760895908:2446], now have 1 active actors on pipe
2025-10-01T14:07:13.889585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254648384035587:3627]
2025-10-01T14:07:13.889592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:13.889699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 224
2025-10-01T14:07:13.889732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 224
2025-10-01T14:07:13.889792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:13.889950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.889959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.889988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55629d58-f976b324-dd4094f9-aa802ba6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:13.889996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:13.889999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:13.890002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:13.890012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:13.890024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:13.890043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:13.890795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:13.890811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:13.890833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:13.890957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 225 partition: 0 MaxSeqNo: 45 sessionId: src_id|55629d58-f976b324-dd4094f9-aa802ba6_0
2025-10-01T14:07:13.891393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9956b0fa-31fb315b-a5d121f5-79d0e285_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|55629d58-f976b324-dd4094f9-aa802ba6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:13.893985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55629d58-f976b324-dd4094f9-aa802ba6_0] Write session: try to update token
2025-10-01T14:07:13.894004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55629d58-f976b324-dd4094f9-aa802ba6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:13.903143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254650760896206:3772]
2025-10-01T14:07:13.903378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254650760896206:3772], now have 1 active actors on pipe
2025-10-01T14:07:13.903453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 224, pipe: [1:7556254650760896206:3772]
2025-10-01T14:07:13.917725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:13.917747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:13.917750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:13.917753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:13.917764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254648384035587:3627]
2025-10-01T14:07:13.917769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254648384035587:3627]
2025-10-01T14:07:13.917774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254648384035587:3627]
2025-10-01T14:07:13.917832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:13.917845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:13.917847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:13.918399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 225 sessionId: src_id|55629d58-f976b324-dd4094f9-aa802ba6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:13.917998Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:13.918627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:13.918638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:13.918643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:13.920985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:14.072483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:14.072761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.072774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.073054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254650760896206:3772]
2025-10-01T14:07:14.073100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:14.073102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:14.073108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:14.073176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 225 reason: error at write: Disconnected sessionId: src_id|55629d58-f976b324-dd4094f9-aa802ba6_0
2025-10-01T14:07:14.073352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 225 sessionId: src_id|55629d58-f976b324-dd4094f9-aa802ba6_0 is DEAD
2025-10-01T14:07:14.073510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55629d58-f976b324-dd4094f9-aa802ba6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:14.073518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55629d58-f976b324-dd4094f9-aa802ba6_0] Write session will restart in 0.006302s
2025-10-01T14:07:14.073556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55629d58-f976b324-dd4094f9-aa802ba6_0] Write session: Do CDS request
2025-10-01T14:07:14.073563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55629d58-f976b324-dd4094f9-aa802ba6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:14.073633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:14.080946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55629d58-f976b324-dd4094f9-aa802ba6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:14.081027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:14.081043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 226
2025-10-01T14:07:14.081181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:14.081211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:14.081216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:14.081220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:14.081592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 226 sessionId:  describe result for acl check
2025-10-01T14:07:14.081623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:14.081624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:14.081626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:14.081631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254655055863524:3929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:14.082110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254655055863524:3929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:14.086226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254655055863524:3929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:14.091277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254655055863524:3929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:14.091293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254655055863524:3929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:14.091297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254655055863524:3929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:14.091304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:14.097305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:14.100904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:14.101136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:14.101155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:14.101167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:14.101220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:14.101260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254652679003182:3630]
2025-10-01T14:07:14.101967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:14.102234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:14.102288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:14.102616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:14.102669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.102675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.102676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.102677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.102678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.102690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.102692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.102693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.102694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.102696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.102697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.102698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.102700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.102701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.102707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.102717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.102721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.102725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.102729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.102732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.102737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.102740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.102744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.102749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.102753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.102757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.102761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.102765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.102772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.102783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.102793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.102800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.102808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.102815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.102822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.102829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.102836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.102842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.102850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.102856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.102864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.102869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.102876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.102881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.102892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.102901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.102906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.102913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.102918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.102926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.102931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.102939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.102944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.102952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.102957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.102965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.103004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:14.106973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:14.107624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:14.107637Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:14.107639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:14.107643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:14.107651Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 225 [2:7556254652679003182:3630]
2025-10-01T14:07:14.107668Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:14.107688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:14.107694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.107698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.107700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.107715Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:14.107723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:14.107731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:14.107789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.107797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.107799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.107802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:14.107804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:14.107867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:14.107874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.107885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.107896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.107912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:14.107932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254655055863509:2446], now have 1 active actors on pipe
2025-10-01T14:07:14.107939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254655055863671:3929], now have 1 active actors on pipe
2025-10-01T14:07:14.107947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254652679003177:3630]
2025-10-01T14:07:14.107953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254652679003177:3630]
2025-10-01T14:07:14.107955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254652679003177:3630]
2025-10-01T14:07:14.107967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:14.107983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:14.107978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:14.107995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:14.107997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:14.108003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:14.108006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:14.108036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254652679003177:3630]
2025-10-01T14:07:14.108046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:14.108020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 225
2025-10-01T14:07:14.108060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:14.108022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 225
2025-10-01T14:07:14.108103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.108111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.108138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:14.108148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.108151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.108154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:14.108162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.108174Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:14.108191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:14.108343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.108353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.108370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:14.108487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 226 partition: 0 MaxSeqNo: 45 sessionId: src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0
2025-10-01T14:07:14.108856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55629d58-f976b324-dd4094f9-aa802ba6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:14.111291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0] Write session: try to update token
2025-10-01T14:07:14.111311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:14.126532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 226 sessionId: src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:14.128903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:14.129124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.129143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.129187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:14.129266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:14.147398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:14.147414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:14.147417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:14.147418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:14.147427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254652679003177:3630]
2025-10-01T14:07:14.147432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254652679003177:3630]
2025-10-01T14:07:14.147436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254652679003177:3630]
2025-10-01T14:07:14.147483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:14.147490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.147493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:14.147495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:14.147501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:14.147505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:14.147617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:14.173519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254655055863804:3772]
2025-10-01T14:07:14.174024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 225, pipe: [1:7556254655055863804:3772]
2025-10-01T14:07:14.309255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:14.333408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.333440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.333644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.333714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.333922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.334355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.334601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.334612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.334802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.334981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.335173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.335345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.335471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.335479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.335638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.335704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.335998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.336209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.336326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.336334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.336506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.336744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.336991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.337202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.337251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.337259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.337507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.337708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.337780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.337848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.337903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.337910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.338134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.338350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.339343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.339982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.340119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.340123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.340371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.340624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.340853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.341075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.341198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.341202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.341386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.341577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.341641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.341702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.341826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.341830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.341912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.341973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.342032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.342092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.342221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.342224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.342290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:14.342347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:14.342550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:14.342621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:14.342733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:14.342740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:14.342826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254655055863804:3772], now have 1 active actors on pipe
2025-10-01T14:07:14.347000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:14.351067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:14.351131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:14.351181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 226 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0
2025-10-01T14:07:14.351388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 226 sessionId: src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0 is DEAD
2025-10-01T14:07:14.351541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:14.351554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0] Write session will restart in 0.008353s
2025-10-01T14:07:14.351586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0] Write session: Do CDS request
2025-10-01T14:07:14.351594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:14.351587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254655055863804:3772]
2025-10-01T14:07:14.361021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:14.365305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:14.365324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 227
2025-10-01T14:07:14.365540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:14.365574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:14.365583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:14.365588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:14.366091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 227 sessionId:  describe result for acl check
2025-10-01T14:07:14.366137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:14.366145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:14.366149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:14.366155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254655055863818:3934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:14.366800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254655055863818:3934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:14.370073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254655055863818:3934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:14.383386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254655055863818:3934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:14.383401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254655055863818:3934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:14.383405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254655055863818:3934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:14.383413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:14.421022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:14.426525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:14.426853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:14.426858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:14.426870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:14.426925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:14.427015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254652679003466:3633]
2025-10-01T14:07:14.427680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:14.429020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:14.429072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:14.429508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:14.429559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.429560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.429562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.429563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.429564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.429566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.429567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.429568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.429569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.429570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.429572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.429573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.429574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.429575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.429581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.429591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.429595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.429599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.429603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.429607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.429612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.429615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.429618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.429623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.429627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.429630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.429634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.429637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.429643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.429652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.429658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.429664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.429669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.429674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.429679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.429684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.429689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.429693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.429698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.429704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.429708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.429714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.429718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.429723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.429728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.429734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.429738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.429743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.429748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.429753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.429757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.429762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.429766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.429772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.429776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.429781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.429825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:14.435875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:14.437191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:14.437207Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:14.437210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:14.437213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:14.437221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 226 [2:7556254652679003466:3633]
2025-10-01T14:07:14.437238Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:14.437255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:14.437259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.437263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.437265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.437285Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:14.437292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:14.437301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:14.437364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.437365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.437367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.437370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:14.437373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:14.437444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:14.437446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.437459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.437470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.437485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:14.437504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254652679003460:3633]
2025-10-01T14:07:14.437506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254652679003460:3633]
2025-10-01T14:07:14.437509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254652679003460:3633]
2025-10-01T14:07:14.437522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:14.437536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:14.437551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:14.437555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:14.437594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254652679003460:3633]
2025-10-01T14:07:14.437595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:14.437683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:14.437685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:14.437686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:14.437691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:14.438619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 226
2025-10-01T14:07:14.438661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 226
2025-10-01T14:07:14.438232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254655055863810:2446], now have 1 active actors on pipe
2025-10-01T14:07:14.438245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254655055863929:3934], now have 1 active actors on pipe
2025-10-01T14:07:14.438901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.438912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.438943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:14.438951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.438957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.438960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:14.438970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.438981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:14.438997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:14.439288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.439293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.439309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:14.439444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 227 partition: 0 MaxSeqNo: 45 sessionId: src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0
2025-10-01T14:07:14.439853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d93165-a0afd014-8637cd29-fb9ec223_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:14.452943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254655055864095:3772]
2025-10-01T14:07:14.453420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 226, pipe: [1:7556254655055864095:3772]
2025-10-01T14:07:14.454158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254655055864095:3772], now have 1 active actors on pipe
2025-10-01T14:07:14.455873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0] Write session: try to update token
2025-10-01T14:07:14.455894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:14.501128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:14.501147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:14.501150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:14.501152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:14.501162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254652679003460:3633]
2025-10-01T14:07:14.501167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254652679003460:3633]
2025-10-01T14:07:14.501173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254652679003460:3633]
2025-10-01T14:07:14.501224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:14.501231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.501233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:14.501390Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:14.502485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:14.502493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:14.502497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:14.518305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 227 sessionId: src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:14.521566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:14.680087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:14.680629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.680639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.681088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254655055864095:3772]
2025-10-01T14:07:14.681119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:14.681152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:14.681154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:14.681205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 227 reason: error at write: Disconnected sessionId: src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0
2025-10-01T14:07:14.681405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 227 sessionId: src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0 is DEAD
2025-10-01T14:07:14.681569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:14.682547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:14.682560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0] Write session will restart in 0.006708s
2025-10-01T14:07:14.682588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0] Write session: Do CDS request
2025-10-01T14:07:14.682594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:14.694882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:14.695326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:14.695340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 228
2025-10-01T14:07:14.695474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:14.695504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:14.695510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:14.695513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:14.698948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 228 sessionId:  describe result for acl check
2025-10-01T14:07:14.698996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:14.698998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:14.699007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:14.699014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254655055864137:3946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:14.699568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254655055864137:3946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:14.704610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254655055864137:3946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:14.715855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254655055864137:3946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:14.715874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254655055864137:3946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:14.715877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254655055864137:3946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:14.715887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:14.764896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:14.781279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:14.781557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:14.781569Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:14.781584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:14.781652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:14.781687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254652679003788:3648]
2025-10-01T14:07:14.782288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:14.783337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:14.783405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:14.783800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:14.783875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.783877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.783878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.783879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.783881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.783882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.783883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.783885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.783886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.783888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.783890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.783891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.783892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.783894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.783901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.783911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.783915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.783919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.783923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.783928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.783931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.783935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.783938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.783942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.783945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.783948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.783951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.783955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.783963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.783971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:14.783978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.783984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:14.783990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.783996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:14.784002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.784007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:14.784012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.784018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:14.784023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.784028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:14.784034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.784039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:14.784043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.784048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:14.784054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.784059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:14.784063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.784071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.784076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.784080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.784085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.784090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.784095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.784100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:14.784105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.784110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:14.784153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:14.782434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254655055864407:3772]
2025-10-01T14:07:14.798922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:14.799730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:14.799736Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:14.799738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:14.799741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:14.799747Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 227 [2:7556254652679003788:3648]
2025-10-01T14:07:14.799761Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:14.799776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:14.799779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.799781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.799783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.799797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:14.799802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:14.799807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:14.799857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.799858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.799861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.799864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:14.799866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:14.799938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:14.799939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.799948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:14.799954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:14.799963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:14.799976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254652679003782:3648]
2025-10-01T14:07:14.799978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254652679003782:3648]
2025-10-01T14:07:14.799980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254652679003782:3648]
2025-10-01T14:07:14.799987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:14.800001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:14.800010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:14.800012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:14.800018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:14.800021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:14.800026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:14.800047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254652679003782:3648]
2025-10-01T14:07:14.800049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:14.800051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:14.800058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254655055864128:2446], now have 1 active actors on pipe
2025-10-01T14:07:14.800061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254655055864407:3772], now have 1 active actors on pipe
2025-10-01T14:07:14.800072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254655055864185:3946], now have 1 active actors on pipe
2025-10-01T14:07:14.802753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 227, pipe: [1:7556254655055864407:3772]
2025-10-01T14:07:14.802796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 227
2025-10-01T14:07:14.802822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 227
2025-10-01T14:07:14.806493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.806516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.806564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:14.806577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:14.806583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:14.806587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:14.806601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:14.806620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:14.806643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:14.811008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 228 partition: 0 MaxSeqNo: 45 sessionId: src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0
2025-10-01T14:07:14.810794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:14.810816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:14.810858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:14.814735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a10c60b-65d80cbf-e7b2ebe4-e703587e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:14.817787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0] Write session: try to update token
2025-10-01T14:07:14.817812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:14.840889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:14.840909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:14.840912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:14.840914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:14.840925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254652679003782:3648]
2025-10-01T14:07:14.840930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254652679003782:3648]
2025-10-01T14:07:14.840935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254652679003782:3648]
2025-10-01T14:07:14.840991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:14.841000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:14.841003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:14.841174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:14.845272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:14.845280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:14.845284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:14.861124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 228 sessionId: src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:14.864027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:15.029665Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:15.030128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.030143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.030631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254655055864407:3772]
2025-10-01T14:07:15.030665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:15.030667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:15.030725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 228 reason: error at write: Disconnected sessionId: src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0
2025-10-01T14:07:15.030868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:15.030914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 228 sessionId: src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0 is DEAD
2025-10-01T14:07:15.031212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:15.031997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:15.032008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0] Write session will restart in 0.005507s
2025-10-01T14:07:15.032035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0] Write session: Do CDS request
2025-10-01T14:07:15.032044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:15.038848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:15.040368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:15.040382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 229
2025-10-01T14:07:15.040542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:15.040579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:15.040592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:15.040596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:15.041005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 229 sessionId:  describe result for acl check
2025-10-01T14:07:15.041043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:15.041049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:15.041051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:15.041055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254659350831746:3951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:15.041560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254659350831746:3951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:15.043859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254659350831746:3951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:15.051566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254659350831746:3951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:15.051582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254659350831746:3951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:15.051585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254659350831746:3951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:15.051593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:15.055659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:15.057548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:15.057741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:15.057750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:15.057763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:15.057809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:15.057846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254656973971380:3651]
2025-10-01T14:07:15.058413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:15.058767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:15.058812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:15.059880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:15.060096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.060105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.060106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.060107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.060109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.060110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.060111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.060112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.060113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.060114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.060116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.060117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.060118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.060120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.060127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.060138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.060142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.060146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.060149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.060153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.060156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.060160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.060163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.060167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.060170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.060173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.060177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.060181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.060189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.060198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.060206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.060212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.060217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.060222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.060227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.060233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.060243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.060249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.060253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.060258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.060264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.060269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.060273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.060278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.060285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.060294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.060299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.060313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.060323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.060328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.060332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.060340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.060344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.060349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.060353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.060358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.060402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:15.068063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:15.068696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:15.068712Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:15.068715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:15.068719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:15.068727Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 228 [2:7556254656973971380:3651]
2025-10-01T14:07:15.068745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:15.068767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:15.068775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.068779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.068782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.068800Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:15.068810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:15.068816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:15.068894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.068904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.068906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.068910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:15.068913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:15.068986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:15.068994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.069007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.069021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.069044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:15.069068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254659350831938:3951], now have 1 active actors on pipe
2025-10-01T14:07:15.069076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254659350831732:2446], now have 1 active actors on pipe
2025-10-01T14:07:15.069083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254656973971375:3651]
2025-10-01T14:07:15.069090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254656973971375:3651]
2025-10-01T14:07:15.069092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254656973971375:3651]
2025-10-01T14:07:15.069103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:15.069117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:15.069122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:15.069124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:15.069126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:15.069135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:15.069138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:15.069094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 228
2025-10-01T14:07:15.069132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 228
2025-10-01T14:07:15.069186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254656973971375:3651]
2025-10-01T14:07:15.069198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:15.069213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.069226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.069244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:15.069277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:15.069289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.069298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.069301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:15.069311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.069319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:15.069342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:15.069500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.069508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.069524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:15.069647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 229 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0
2025-10-01T14:07:15.070064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb075e2e-a4e32b67-71c734ad-5f913b5b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:15.072909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0] Write session: try to update token
2025-10-01T14:07:15.072930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:15.092113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 229 sessionId: src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:15.094725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:15.096027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.096052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.096090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:15.096204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:15.099732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:15.099752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:15.099754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:15.099756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:15.099765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254656973971375:3651]
2025-10-01T14:07:15.099773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254656973971375:3651]
2025-10-01T14:07:15.099777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254656973971375:3651]
2025-10-01T14:07:15.099825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:15.099832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.099840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:15.100015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:15.102352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:15.102382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:15.102386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:15.130901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254659350832029:3772]
2025-10-01T14:07:15.132247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 228, pipe: [1:7556254659350832029:3772]
2025-10-01T14:07:15.261678Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:15.270852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.270886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.271067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.271135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.271206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.271271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.271321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.271335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.271406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.271466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.271530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.271600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.271717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.271728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.271788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.271881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.271945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.272006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.272049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.272058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.272123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.272183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.272245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.272301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.272347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.272350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.272413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.272475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.272535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.272597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.272643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.272651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.272724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.272793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.272876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.272940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.272988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.272996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.273074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.273149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.273222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.273300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.273431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.273440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.273523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.273598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.273665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.273733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.273791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.273802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.273871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.273937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.274004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.274074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.274204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.274214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.274285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.274347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.274431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.274493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.274628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.274636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.274710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254659350832029:3772], now have 1 active actors on pipe
2025-10-01T14:07:15.278742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:15.279954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:15.279966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0] Write session will restart in 0.006942s
2025-10-01T14:07:15.280002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0] Write session: Do CDS request
2025-10-01T14:07:15.280009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:15.279333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:15.279420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 229 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0
2025-10-01T14:07:15.279610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 229 sessionId: src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0 is DEAD
2025-10-01T14:07:15.279698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254659350832029:3772]
2025-10-01T14:07:15.279717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:15.287944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:15.288022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:15.288039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 230
2025-10-01T14:07:15.288180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:15.288235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:15.288247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:15.288252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:15.288730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 230 sessionId:  describe result for acl check
2025-10-01T14:07:15.288769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:15.288771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:15.288774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:15.288779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254659350832045:3956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:15.289326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254659350832045:3956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:15.293946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254659350832045:3956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:15.299390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254659350832045:3956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:15.299407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254659350832045:3956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:15.299410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254659350832045:3956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:15.299420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:15.316393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:15.318799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:15.319051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:15.319064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:15.319076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:15.319135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:15.319182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254656973971668:3654]
2025-10-01T14:07:15.319843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:15.320171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:15.320235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:15.320578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:15.320637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.320639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.320640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.320641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.320642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.320643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.320645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.320647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.320649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.320650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.320651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.320652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.320654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.320655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.320661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.320672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.320676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.320680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.320684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.320688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.320692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.320697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.320701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.320705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.320709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.320713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.320717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.320721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.320739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.320754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.320761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.320770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.320774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.320779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.320786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.320790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.320797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.320803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.320807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.320812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.320817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.320833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.320842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.320847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.320852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.320858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.320863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.320870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.320875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.320885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.320889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.320894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.320903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.320908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.320912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.320920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.320961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:15.325750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:15.326458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:15.326476Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:15.326480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:15.326484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:15.326491Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 229 [2:7556254656973971668:3654]
2025-10-01T14:07:15.326513Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:15.326536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:15.326546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.326550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.326553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.326569Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:15.326580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:15.326586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:15.326652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.326659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.326661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.326665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:15.326668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:15.326740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:15.326747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.326760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.326772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.326786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:15.326807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254659350832037:2446], now have 1 active actors on pipe
2025-10-01T14:07:15.326810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254659350832087:3956], now have 1 active actors on pipe
2025-10-01T14:07:15.326818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254656973971662:3654]
2025-10-01T14:07:15.326820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254656973971662:3654]
2025-10-01T14:07:15.326822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254656973971662:3654]
2025-10-01T14:07:15.326837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:15.326850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:15.326870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:15.326878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:15.326920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254656973971662:3654]
2025-10-01T14:07:15.326927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:15.327082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 229
2025-10-01T14:07:15.327123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 229
2025-10-01T14:07:15.326963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:15.326969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:15.326972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:15.326979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:15.327332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.327356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.327387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:15.327402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.327415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.327421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:15.327432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.327448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:15.327468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:15.328895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.328908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.328936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:15.329042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 230 partition: 0 MaxSeqNo: 45 sessionId: src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0
2025-10-01T14:07:15.329420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1bd45-dfb9e6ed-b9f152b9-c7c3cabd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:15.332413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0] Write session: try to update token
2025-10-01T14:07:15.332432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:15.339554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:15.339574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:15.339585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254656973971662:3654]
2025-10-01T14:07:15.339635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:15.339640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:15.339905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:15.340109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:15.340304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:15.340501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:15.340767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:15.340836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:15.355250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 230 sessionId: src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:15.357865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:15.358082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.358104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.358143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:15.358239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:15.366458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:15.366475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:15.366478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:15.366480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:15.366491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254656973971662:3654]
2025-10-01T14:07:15.366495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254656973971662:3654]
2025-10-01T14:07:15.366499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254656973971662:3654]
2025-10-01T14:07:15.366550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:15.366552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:15.366559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.366559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:15.366561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:15.366562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:15.366702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:15.379738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254659350832330:3772]
2025-10-01T14:07:15.380066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 229, pipe: [1:7556254659350832330:3772]
2025-10-01T14:07:15.551572Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:15.570255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.570292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.574646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.574727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.574798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.574891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.574939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.574947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.575028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.575093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.575176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.575248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.575291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.575294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.575399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.575465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.575528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.575591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.575631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.575635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.575702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.575763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.575822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.575910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.575960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.575963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.576028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.576084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.576176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.576270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.576312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.576315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.576398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.576494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.576586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.576655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.576715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.576718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.576817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.576912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.576992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.577069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.577119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.577121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.577214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.577287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.577369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.577444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.577496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.577500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.577588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.577651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.577735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.577803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.577852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.577867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.577952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.578015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.578082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.578147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.578284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.578288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.578358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254659350832330:3772], now have 1 active actors on pipe
2025-10-01T14:07:15.585732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254659350832330:3772]
2025-10-01T14:07:15.585732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:15.585737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:15.585767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:15.585768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 230 reason: error at write: Disconnected sessionId: src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0
2025-10-01T14:07:15.586205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:15.586218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0] Write session will restart in 0.007946s
2025-10-01T14:07:15.586243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0] Write session: Do CDS request
2025-10-01T14:07:15.586251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:15.585980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 230 sessionId: src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0 is DEAD
2025-10-01T14:07:15.584221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:15.598858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:15.600771Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:15.600786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 231
2025-10-01T14:07:15.600998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:15.601028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:15.601034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:15.601038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:15.601533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 231 sessionId:  describe result for acl check
2025-10-01T14:07:15.601566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:15.601568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:15.601569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:15.601575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254659350832359:3967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:15.602118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254659350832359:3967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:15.619432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254659350832359:3967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:15.648548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254659350832359:3967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:15.648566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254659350832359:3967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:15.648569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254659350832359:3967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:15.648579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:15.686064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254659350832641:3772]
2025-10-01T14:07:15.696587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:15.711113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:15.711399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:15.711404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:15.711417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:15.711480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:15.711517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254656973971987:3657]
2025-10-01T14:07:15.712100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:15.713203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:15.713253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:15.713599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:15.713659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.713660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.713661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.713662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.713663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.713664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.713665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.713666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.713667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.713668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.713670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.713671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.713672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.713673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.713679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.713687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.713691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.713694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.713697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.713700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.713703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.713706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.713710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.713713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.713716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.713720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.713723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.713726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.713734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.713741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:15.713747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.713752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:15.713756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.713760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:15.713764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.713768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:15.713772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.713779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:15.713782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.713786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:15.713793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.713797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:15.713800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.713804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:15.713808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.713813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:15.713816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.713821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.713824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.713828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.713832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.713836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.713839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.713844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:15.713849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.713853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:15.713886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:15.731094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:15.731997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:15.732002Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:15.732004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:15.732009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:15.732017Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 230 [2:7556254656973971987:3657]
2025-10-01T14:07:15.732035Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:15.732054Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:15.732057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.732061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.732063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.732082Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:15.732088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:15.732094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:15.732161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.732163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.732165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.732168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:15.732171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:15.732254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:15.732257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.732271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:15.732282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:15.732298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:15.732317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254656973971976:3657]
2025-10-01T14:07:15.732319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254656973971976:3657]
2025-10-01T14:07:15.732321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254656973971976:3657]
2025-10-01T14:07:15.732335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:15.732354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:15.732368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:15.732371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:15.732416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254656973971976:3657]
2025-10-01T14:07:15.732419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:15.732967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:15.732970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:15.732972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:15.732977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:15.733660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254659350832336:2446], now have 1 active actors on pipe
2025-10-01T14:07:15.733665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254659350832433:3967], now have 1 active actors on pipe
2025-10-01T14:07:15.733669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254659350832641:3772], now have 1 active actors on pipe
2025-10-01T14:07:15.738122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f3c6f28-8fe03510-1e1a204-7ea44dec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:15.735061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.735076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.735109Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:15.735119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.735125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.735127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:15.735140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.735157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:15.735179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:15.735430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.735433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.735448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:15.740800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0] Write session: try to update token
2025-10-01T14:07:15.740820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:15.734790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 230
2025-10-01T14:07:15.734838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 230
2025-10-01T14:07:15.734856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 230, pipe: [1:7556254659350832641:3772]
2025-10-01T14:07:15.735561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 231 partition: 0 MaxSeqNo: 45 sessionId: src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0
2025-10-01T14:07:15.764707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:15.764727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:15.764738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254656973971976:3657]
2025-10-01T14:07:15.764789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:15.764991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:15.765128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:15.765260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:15.765393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:15.765578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:15.765610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:15.766420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:15.787830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 231 sessionId: src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:15.790235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:15.790501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.790521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.790563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:15.790745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:15.831430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.831446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.831449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.843969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:15.844001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:15.844222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.844290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.844357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.844421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.844460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.844465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.844536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.844591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.844647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.844704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.844755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.844757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.844838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.844893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.844974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.845035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.845080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.845083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.845144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.845199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.845257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.845339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.845380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.845385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.845455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.845514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.845579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.845638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.845697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.845701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.845770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.845829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.845905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.845969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.846029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.846032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.846102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.846160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.846231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.846297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.846356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.846358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.846824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.846899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.846968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.847035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.847083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.847086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.847166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.847233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.847303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.847373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.847445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.847465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.847544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:15.847611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:15.847679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:15.847749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:15.847922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:15.847926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:15.848001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:15.848069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:15.848093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:15.848096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:15.848117Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848128Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848132Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848136Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848141Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848145Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848150Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848153Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848157Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848162Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848166Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848170Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848174Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848181Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848185Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848713Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848720Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848724Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848729Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848733Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848737Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848742Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848746Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848750Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.848754Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849273Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849280Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849285Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849289Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849294Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849299Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849304Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849308Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849312Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849317Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:15.849343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:15.849353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:07:15.849356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:07:15.849360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:07:15.849364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:07:15.850266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:07:15.850292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:15.850306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:07:15.850309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:07:15.850313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:07:15.850316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:07:15.851227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:07:15.851245Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:15.851252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:07:15.851257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:07:15.851260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:07:15.851266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:07:15.851783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:07:15.851794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:15.851926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327635850
2025-10-01T14:07:15.852767Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:15.852784Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:07:15.865528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:15.865549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:15.865552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:15.865553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:15.865565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254656973971976:3657]
2025-10-01T14:07:15.865570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254656973971976:3657]
2025-10-01T14:07:15.865573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254656973971976:3657]
2025-10-01T14:07:15.865624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:15.865632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:15.865635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:15.865778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:15.866556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:15.866565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:15.866569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:16.066300Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:16.067523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:16.072290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:16.072341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:16.072703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:16.072713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0] Write session will restart in 0.008375s
2025-10-01T14:07:16.072738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0] Write session: Do CDS request
2025-10-01T14:07:16.072744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:16.072391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 231 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0
2025-10-01T14:07:16.072594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 231 sessionId: src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0 is DEAD
2025-10-01T14:07:16.072722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254659350832641:3772]
2025-10-01T14:07:16.076896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:16.079062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:16.079321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:16.079335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:16.079348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:16.079401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:16.079490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254661268939377:3672]
2025-10-01T14:07:16.080130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:16.080467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:16.080530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:16.080890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:16.080954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.080961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.080962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.080963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.080964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.080966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.080967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.080968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.080969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.080970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.080971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.080974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.080975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.080976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.080981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.080990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.080993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.080997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.081000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.081004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.081007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.081011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.081014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.081018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.081022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.081025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.081029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.081032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.081040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.081056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.081062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.081069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.081074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.081078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.081082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.081087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.081092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.081097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.081101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.081106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.081110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.081115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.081121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.081126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.081130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.081135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.081138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.081143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.081147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.081152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.081157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.081162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.081166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.081170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.081174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.081180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.081219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:16.081956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:16.082067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:16.082084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 232
2025-10-01T14:07:16.082216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:16.082242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:16.082247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:16.082251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:16.082677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 232 sessionId:  describe result for acl check
2025-10-01T14:07:16.082717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:16.082725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:16.082727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:16.082733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254663645799999:3973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:16.083247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254663645799999:3973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:16.085163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254663645799999:3973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:16.087161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:16.087934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:16.087940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:16.087943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:16.087948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:16.087957Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 231 [2:7556254661268939377:3672]
2025-10-01T14:07:16.088431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 231
2025-10-01T14:07:16.087973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:16.087992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:16.087995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.087999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.088001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.088019Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:16.088025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:16.088031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:16.088094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.088096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.088097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.088100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:16.088103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:16.088182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:16.088186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.088197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.088207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.088222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:16.088241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645799984:2446], now have 1 active actors on pipe
2025-10-01T14:07:16.088251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254661268939372:3672]
2025-10-01T14:07:16.088253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254661268939372:3672]
2025-10-01T14:07:16.088255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254661268939372:3672]
2025-10-01T14:07:16.088275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:16.088291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:16.088299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:16.088303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:16.088305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:16.088305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:16.088309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:16.088347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254661268939372:3672]
2025-10-01T14:07:16.088355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:16.088366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:16.100209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254663645799999:3973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:16.100231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254663645799999:3973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:16.100235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254663645799999:3973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:16.100245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:16.100544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800037:3973], now have 1 active actors on pipe
2025-10-01T14:07:16.100588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 231
2025-10-01T14:07:16.100680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.100697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.100730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eacbefc8-738529e-b4877206-19b8eb49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:16.100749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.100755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.100761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:16.100773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.100803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:16.100841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:16.101043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.101058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.101083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:16.101163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 232 partition: 0 MaxSeqNo: 45 sessionId: src_id|eacbefc8-738529e-b4877206-19b8eb49_0
2025-10-01T14:07:16.101611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ae799f1-d3cf3232-f98dade0-1dd055cd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eacbefc8-738529e-b4877206-19b8eb49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:16.104128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eacbefc8-738529e-b4877206-19b8eb49_0] Write session: try to update token
2025-10-01T14:07:16.104147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eacbefc8-738529e-b4877206-19b8eb49_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:16.107612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:16.107630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:16.107640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254661268939372:3672]
2025-10-01T14:07:16.107688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:16.107893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:16.108045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:16.108178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:16.108310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:16.108502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:16.108545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:16.108631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:16.121838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 232 sessionId: src_id|eacbefc8-738529e-b4877206-19b8eb49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:16.124665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:16.124873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.124896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.124938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:16.125036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:16.156099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:16.156118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:16.156121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:16.156122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:16.156135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254661268939372:3672]
2025-10-01T14:07:16.156139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254661268939372:3672]
2025-10-01T14:07:16.156143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254661268939372:3672]
2025-10-01T14:07:16.156195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:16.156200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:16.156201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:16.156205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:16.156207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.156209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:16.156344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:16.172902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254663645800047:3772]
2025-10-01T14:07:16.173208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 231, pipe: [1:7556254663645800047:3772]
2025-10-01T14:07:16.315381Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:16.322898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.322921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.323092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.323141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.323198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.323259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.323305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.323309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.323372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.323431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.323489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.323551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.323593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.323597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.323672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.323767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.323837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.323897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.323939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.323946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.324023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.324087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.324158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.324226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.324269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.324280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.324348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.324411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.324479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.324581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.324621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.324626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.324693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.324778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.324850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.324907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.324946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.324949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.325015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.325073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.325133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.325191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.325246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.325249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.325316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.325373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.325434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.325492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.325546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.325563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.325630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.325691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.325754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.325816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.325874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.325880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.325942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.326002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.326064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.326121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.326165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.326172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.326239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800047:3772], now have 1 active actors on pipe
2025-10-01T14:07:16.327306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:16.327149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:16.327213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:16.327215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:16.327218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254663645800047:3772]
2025-10-01T14:07:16.327243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 232 reason: error at write: Disconnected sessionId: src_id|eacbefc8-738529e-b4877206-19b8eb49_0
2025-10-01T14:07:16.327446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 232 sessionId: src_id|eacbefc8-738529e-b4877206-19b8eb49_0 is DEAD
2025-10-01T14:07:16.327837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacbefc8-738529e-b4877206-19b8eb49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:16.327846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacbefc8-738529e-b4877206-19b8eb49_0] Write session will restart in 0.007609s
2025-10-01T14:07:16.327871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacbefc8-738529e-b4877206-19b8eb49_0] Write session: Do CDS request
2025-10-01T14:07:16.327877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacbefc8-738529e-b4877206-19b8eb49_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:16.344527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eacbefc8-738529e-b4877206-19b8eb49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:16.345220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:16.345238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 233
2025-10-01T14:07:16.345838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:16.345878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:16.345884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:16.345888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:16.351002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 233 sessionId:  describe result for acl check
2025-10-01T14:07:16.351049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:16.351051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:16.351053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:16.351059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254663645800071:3978] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:16.351666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254663645800071:3978] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:16.355881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:16.356862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254663645800071:3978] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:16.358317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:16.358590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:16.358604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:16.358617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:16.358681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:16.358727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254661268939438:3675]
2025-10-01T14:07:16.359324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:16.359706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:16.359752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:16.360045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:16.360107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.360113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.360114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.360116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.360117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.360119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.360121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.360122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.360123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.360124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.360125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.360126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.360127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.360128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.360133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.360142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.360145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.360149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.360152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.360155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.360158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.360162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.360165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.360169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.360172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.360175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.360179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.360183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.360193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.360201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.360208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.360212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.360216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.360221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.360225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.360230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.360237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.360247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.360251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.360259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.360263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.360268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.360275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.360278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.360282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.360286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.360289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.360295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.360304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.360309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.360314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.360318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.360322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.360325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.360327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.360330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.360363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:16.365439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254663645800071:3978] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:16.365456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254663645800071:3978] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:16.365459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254663645800071:3978] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:16.365468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:16.369947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:16.370634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:16.370640Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:16.370643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:16.370650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:16.370656Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 232 [2:7556254661268939438:3675]
2025-10-01T14:07:16.370672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:16.370691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:16.370696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.370699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.370701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.370717Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:16.370723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:16.370728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:16.370787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.370789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.370790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.370793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:16.370795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:16.370870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:16.370873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.370886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.370895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.370909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:16.370925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254661268939432:3675]
2025-10-01T14:07:16.370927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254661268939432:3675]
2025-10-01T14:07:16.370928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254661268939432:3675]
2025-10-01T14:07:16.370942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:16.370957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:16.370969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:16.370971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:16.371011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254661268939432:3675]
2025-10-01T14:07:16.371013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:16.371239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:16.371240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:16.371242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:16.371247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:16.371388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800111:3978], now have 1 active actors on pipe
2025-10-01T14:07:16.371395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800053:2446], now have 1 active actors on pipe
2025-10-01T14:07:16.374556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 232
2025-10-01T14:07:16.374600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 232
2025-10-01T14:07:16.378113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.378135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.378178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:16.378194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.378204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.378207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:16.378221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.378241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:16.378268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:16.378525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.378539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.378561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:16.379211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 233 partition: 0 MaxSeqNo: 45 sessionId: src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0
2025-10-01T14:07:16.379629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eacbefc8-738529e-b4877206-19b8eb49_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:16.382037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0] Write session: try to update token
2025-10-01T14:07:16.382054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:16.420645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:16.420664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:16.420667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:16.420669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:16.420681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254661268939432:3675]
2025-10-01T14:07:16.420686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254661268939432:3675]
2025-10-01T14:07:16.420690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254661268939432:3675]
2025-10-01T14:07:16.420744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:16.420750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.420750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:16.420753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:16.420757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:16.420761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:16.420905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:16.426777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254663645800119:3772]
2025-10-01T14:07:16.428298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 232, pipe: [1:7556254663645800119:3772]
2025-10-01T14:07:16.436718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 233 sessionId: src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:16.439486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:16.593136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:16.593428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800119:3772], now have 1 active actors on pipe
2025-10-01T14:07:16.593464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.593478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.593762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:16.594205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:16.594953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:16.594965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0] Write session will restart in 0.005419s
2025-10-01T14:07:16.594992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0] Write session: Do CDS request
2025-10-01T14:07:16.594999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:16.594262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254663645800119:3772]
2025-10-01T14:07:16.594285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:16.594348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 233 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0
2025-10-01T14:07:16.594557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 233 sessionId: src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0 is DEAD
2025-10-01T14:07:16.601951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:16.602447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:16.602465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 234
2025-10-01T14:07:16.602642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:16.602677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:16.602683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:16.602687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:16.603097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 234 sessionId:  describe result for acl check
2025-10-01T14:07:16.603126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:16.603129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:16.603131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:16.603137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254663645800131:3983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:16.603689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254663645800131:3983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:16.612105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254663645800131:3983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:16.619815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254663645800131:3983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:16.619831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254663645800131:3983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:16.619834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254663645800131:3983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:16.619843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:16.624637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:16.626946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:16.627181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:16.627186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:16.627199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:16.627255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:16.627291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254661268939502:3678]
2025-10-01T14:07:16.627933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:16.628943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:16.629000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:16.629350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:16.629427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.629428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.629429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.629431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.629432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.629433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.629434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.629436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.629437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.629438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.629439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.629440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.629441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.629442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.629448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.629458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.629462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.629465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.629469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.629472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.629476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.629480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.629483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.629487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.629491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.629494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.629498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.629501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.629511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.629519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.629524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.629529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.629538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.629542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.629546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.629551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.629555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.629560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.629564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.629569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.629574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.629579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.629583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.629588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.629592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.629597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.629601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.629605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.629609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.629614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.629618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.629623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.629627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.629632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.629638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.629642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.629679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:16.635300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:16.636228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:16.636241Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:16.636244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:16.636247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:16.636254Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 233 [2:7556254661268939502:3678]
2025-10-01T14:07:16.636269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:16.636286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:16.636293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.636297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.636299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.636317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:16.636328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:16.636335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:16.636395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.636401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.636403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.636406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:16.636409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:16.636683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 233
2025-10-01T14:07:16.636719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 233
2025-10-01T14:07:16.636476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:16.636485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.636495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.636504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.636517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:16.636534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800124:2446], now have 1 active actors on pipe
2025-10-01T14:07:16.636537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800172:3983], now have 1 active actors on pipe
2025-10-01T14:07:16.636544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254661268939497:3678]
2025-10-01T14:07:16.636546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254661268939497:3678]
2025-10-01T14:07:16.636548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254661268939497:3678]
2025-10-01T14:07:16.636560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:16.636572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:16.636584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:16.636584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:16.636587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:16.636588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:16.636590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:16.636629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254661268939497:3678]
2025-10-01T14:07:16.636635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:16.636930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:16.637001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.637012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.637043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:16.637051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.637056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.637058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:16.637068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.637079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:16.637096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:16.639213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.639229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.639263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:16.639955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72d94a0e-d48030b6-2c5fbb27-8a72806e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:16.642631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0] Write session: try to update token
2025-10-01T14:07:16.642652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:16.639456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 234 partition: 0 MaxSeqNo: 45 sessionId: src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0
2025-10-01T14:07:16.666414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 234 sessionId: src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:16.669191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:16.669700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.669716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.672243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:16.672277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:16.672280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:16.672282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:16.672284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:16.672293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254661268939497:3678]
2025-10-01T14:07:16.672297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254661268939497:3678]
2025-10-01T14:07:16.672301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254661268939497:3678]
2025-10-01T14:07:16.672353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:16.672360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.672363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:16.672521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:16.673891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:16.673896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:16.673899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:16.674418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:16.699597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254663645800203:3772]
2025-10-01T14:07:16.718316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 233, pipe: [1:7556254663645800203:3772]
2025-10-01T14:07:16.861739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:16.870753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.870775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.870937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.870993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.871053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.871117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.871160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.871165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.871238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.871324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.871518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.871581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.871623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.871627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.871712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.871760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.871817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.871873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.871918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.871919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.871975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.872043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.872097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.872158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.872194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.872196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.872254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.872302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.872359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.872418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.872457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.872459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.872524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.872584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.872650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.872707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.872749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.872751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.872820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.872896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.872981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.873058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.873106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.873108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.873194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.873264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.873324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.873390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.873504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.873507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.873580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.873639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.873700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.873758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.873797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.873800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.873865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:16.873923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:16.874017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:16.874075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:16.874117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:16.874120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:16.874186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800203:3772], now have 1 active actors on pipe
2025-10-01T14:07:16.875646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:16.876934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:16.876992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254663645800203:3772]
2025-10-01T14:07:16.877014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:16.877052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 234 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0
2025-10-01T14:07:16.877246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 234 sessionId: src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0 is DEAD
2025-10-01T14:07:16.880789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:16.880801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0] Write session will restart in 0.006040s
2025-10-01T14:07:16.880839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0] Write session: Do CDS request
2025-10-01T14:07:16.880846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:16.888458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:16.888819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:16.888850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 235
2025-10-01T14:07:16.889050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:16.889083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:16.889089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:16.889093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:16.889468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 235 sessionId:  describe result for acl check
2025-10-01T14:07:16.889499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:16.889501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:16.889503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:16.889508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254663645800227:3994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:16.890031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254663645800227:3994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:16.894962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254663645800227:3994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:16.900035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254663645800227:3994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:16.900050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254663645800227:3994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:16.900054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254663645800227:3994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:16.900063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:16.900905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:16.908225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:16.908463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:16.908468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:16.908481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:16.908538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:16.908572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254661268939610:3692]
2025-10-01T14:07:16.909156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:16.909902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:16.909957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:16.910270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:16.910315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.910316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.910317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.910319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.910320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.910321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.910322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.910323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.910324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.910325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.910327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.910328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.910329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.910330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.910335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.910347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.910350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.910354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.910359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.910363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.910367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.910532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.910540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.910544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.910547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.910550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.910553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.910556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.910564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.910571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:16.910577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.910582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:16.910586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.910590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:16.910594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.910598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:16.910602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.910606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:16.910610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.910615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:16.910619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.910624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:16.910628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.910632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:16.910636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.910641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:16.910645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.910650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.910655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.910661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.910665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.910669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.910674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.910678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:16.910682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.910687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:16.910723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:16.918444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:16.919138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:16.919157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:16.919159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:16.919163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:16.919170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 234 [2:7556254661268939610:3692]
2025-10-01T14:07:16.919187Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:16.919207Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:16.919210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.919214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.919216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.919235Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:16.919241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:16.919247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:16.919309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.919310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.919313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.919317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:16.919319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:16.919393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:16.919397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.919409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:16.919420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:16.919436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:16.919454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254661268939593:3692]
2025-10-01T14:07:16.919456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254661268939593:3692]
2025-10-01T14:07:16.919458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254661268939593:3692]
2025-10-01T14:07:16.919466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:16.919477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:16.919479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:16.919482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:16.919484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:16.919489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:16.919491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:16.919503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800271:3994], now have 1 active actors on pipe
2025-10-01T14:07:16.919506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800222:2446], now have 1 active actors on pipe
2025-10-01T14:07:16.919543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254661268939593:3692]
2025-10-01T14:07:16.919550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:16.919557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:16.920853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 234
2025-10-01T14:07:16.920889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 234
2025-10-01T14:07:16.921585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 235 partition: 0 MaxSeqNo: 45 sessionId: src_id|74a3d931-6942d503-2cff96e9-6adde94b_0
2025-10-01T14:07:16.921017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.921031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.921060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74a3d931-6942d503-2cff96e9-6adde94b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:16.921068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:16.921073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:16.921076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:16.921088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:16.921102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:16.921122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:16.921407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.921414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.921441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:16.922155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f010ede8-afff9f8-cd88a72f-d3dc84c8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|74a3d931-6942d503-2cff96e9-6adde94b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:16.924866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a3d931-6942d503-2cff96e9-6adde94b_0] Write session: try to update token
2025-10-01T14:07:16.924885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a3d931-6942d503-2cff96e9-6adde94b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:16.944651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:16.944664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:16.944675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254661268939593:3692]
2025-10-01T14:07:16.944710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:16.944721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:16.944890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:16.945029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:16.945164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:16.945306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:16.945482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:16.945518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:16.957868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 235 sessionId: src_id|74a3d931-6942d503-2cff96e9-6adde94b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:16.960730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:16.962439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:16.962476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:16.962521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:16.962658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:16.977203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254663645800296:3772]
2025-10-01T14:07:16.987625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 234, pipe: [1:7556254663645800296:3772]
2025-10-01T14:07:16.987730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254663645800296:3772], now have 1 active actors on pipe
2025-10-01T14:07:16.990041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:16.990049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:16.990051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:16.990053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:16.990069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254661268939593:3692]
2025-10-01T14:07:16.990075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254661268939593:3692]
2025-10-01T14:07:16.990078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254661268939593:3692]
2025-10-01T14:07:16.990134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:16.990141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:16.990143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:16.990286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:16.997994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:16.998010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:16.998015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:17.194077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:17.203357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.203387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.203590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.203650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.203720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.203789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.203833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.203838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.203914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.203980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.204047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.204119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.204164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.204167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.204248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.204315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.204381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.204445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.204558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.204561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.204641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.204711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.204782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.204883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.204937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.204942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.205030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.205103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.205174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.205248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.205294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.205297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.205374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.205433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.205494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.205557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.205606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.205612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.205681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.205743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.205808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.205868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.205913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.205916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.205988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.206048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.206115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.206177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.206725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.206738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.206812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.206871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.206941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.207025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.207085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.207087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.207156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.207214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.207277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.207338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.207441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.207445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.210875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:17.212027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a3d931-6942d503-2cff96e9-6adde94b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:17.212039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a3d931-6942d503-2cff96e9-6adde94b_0] Write session will restart in 0.006218s
2025-10-01T14:07:17.212066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a3d931-6942d503-2cff96e9-6adde94b_0] Write session: Do CDS request
2025-10-01T14:07:17.212072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a3d931-6942d503-2cff96e9-6adde94b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:17.211377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:17.211421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:17.211466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 235 reason: status is not ok: tablet will be restarted right now sessionId: src_id|74a3d931-6942d503-2cff96e9-6adde94b_0
2025-10-01T14:07:17.211652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 235 sessionId: src_id|74a3d931-6942d503-2cff96e9-6adde94b_0 is DEAD
2025-10-01T14:07:17.211774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254663645800296:3772]
2025-10-01T14:07:17.221037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a3d931-6942d503-2cff96e9-6adde94b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:17.222552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:17.222568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 236
2025-10-01T14:07:17.222766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:17.222797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:17.222802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:17.222806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:17.223298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 236 sessionId:  describe result for acl check
2025-10-01T14:07:17.223333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:17.223336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:17.223338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:17.223344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254667940767615:4002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:17.223860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254667940767615:4002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:17.227035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254667940767615:4002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:17.237688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:17.239828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254667940767615:4002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:17.239847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254667940767615:4002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:17.239852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254667940767615:4002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:17.239860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:17.240344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:17.240571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:17.240575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:17.240588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:17.240639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:17.240675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254665563906972:3696]
2025-10-01T14:07:17.241221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:17.241706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:17.241766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:17.242113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:17.242191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.242192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.242194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.242195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.242196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.242198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.242199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.242200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.242202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.242203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.242204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.242206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.242208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.242209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.242215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.242226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.242230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.242234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.242237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.242241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.242245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.242250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.242254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.242258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.242261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.242266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.242270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.242273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.242280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.242288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.242294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.242300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.242304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.242309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.242313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.242325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.242344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.242354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.242359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.242364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.242387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.242396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.242401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.242406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.242415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.242419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.242423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.242432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.242436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.242441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.242445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.242450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.242453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.242459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.242463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.242468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.242511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:17.247551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:17.248215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:17.248231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:17.248234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:17.248238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:17.248245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 235 [2:7556254665563906972:3696]
2025-10-01T14:07:17.248261Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:17.248280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:17.248288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.248292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.248294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.248312Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:17.248318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:17.248330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:17.248401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.248409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.248412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.248415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:17.248418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:17.248492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:17.248500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.248512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.248523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.248542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:17.248566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767608:2446], now have 1 active actors on pipe
2025-10-01T14:07:17.248574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767664:4002], now have 1 active actors on pipe
2025-10-01T14:07:17.248582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254665563906966:3696]
2025-10-01T14:07:17.248584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254665563906966:3696]
2025-10-01T14:07:17.248588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254665563906966:3696]
2025-10-01T14:07:17.248602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:17.248616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:17.248633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:17.248634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:17.248636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:17.248638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:17.248640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:17.248675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254665563906966:3696]
2025-10-01T14:07:17.248686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:17.248699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 235
2025-10-01T14:07:17.248745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 235
2025-10-01T14:07:17.248911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:17.249037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.249048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.249074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:17.249082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.249086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.249088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:17.249098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.249107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:17.249123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:17.249442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.249449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.249463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:17.249724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 236 partition: 0 MaxSeqNo: 45 sessionId: src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0
2025-10-01T14:07:17.250116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a3d931-6942d503-2cff96e9-6adde94b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:17.252932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0] Write session: try to update token
2025-10-01T14:07:17.252955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:17.274610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 236 sessionId: src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:17.277236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:17.277969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:17.277656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.277677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.277715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:17.287585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:17.287605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:17.287607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:17.287609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:17.287620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254665563906966:3696]
2025-10-01T14:07:17.287625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254665563906966:3696]
2025-10-01T14:07:17.287630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254665563906966:3696]
2025-10-01T14:07:17.287677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:17.287684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:17.287685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:17.287688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:17.287693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.287695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:17.287834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:17.312175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254667940767676:3772]
2025-10-01T14:07:17.312837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 235, pipe: [1:7556254667940767676:3772]
2025-10-01T14:07:17.439681Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:17.448224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.448255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.448458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.448519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.448589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.448661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.448721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.448730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.448806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.448886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.448952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.449022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.449068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.449075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.449147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.449223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.449285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.449347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.449393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.449400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.449466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.449526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.449588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.449649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.449691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.449697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.449764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.449821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.449885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.449952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.449994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.450000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.450080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.450147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.450215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.450278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.450329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.450336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.450424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.450500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.450577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.450651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.450705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.450714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.450796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.450866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.450941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.451013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.451085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.451094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.451163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.451246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.451314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.451394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.451469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.451476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.451552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.451615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.451682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.451766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.451814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.451821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.451916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767676:3772], now have 1 active actors on pipe
2025-10-01T14:07:17.452270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254667940767676:3772]
2025-10-01T14:07:17.452308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:17.452311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:17.452349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 236 reason: error at write: Disconnected sessionId: src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0
2025-10-01T14:07:17.452551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 236 sessionId: src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0 is DEAD
2025-10-01T14:07:17.452677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:17.452896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:17.452908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0] Write session will restart in 0.007493s
2025-10-01T14:07:17.452933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0] Write session: Do CDS request
2025-10-01T14:07:17.452939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:17.453073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:17.461931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:17.462021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:17.462038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 237
2025-10-01T14:07:17.462309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:17.462364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:17.462386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:17.462390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:17.462820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 237 sessionId:  describe result for acl check
2025-10-01T14:07:17.462850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:17.462852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:17.462854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:17.462859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254667940767699:4006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:17.463388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254667940767699:4006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:17.466193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254667940767699:4006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:17.467300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:17.470349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:17.470597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:17.470608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:17.470620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:17.470675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:17.470720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254665563907035:3698]
2025-10-01T14:07:17.471289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:17.471724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:17.471779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:17.472138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:17.472211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.472212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.472213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.472215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.472216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.472218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.472219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.472220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.472221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.472222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.472224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.472225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.472226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.472228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.472234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.472245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.472249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.472253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.472256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.472260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.472263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.472266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.472269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.472274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.472277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.472281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.472285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.472290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.472301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.472309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.472315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.472321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.472326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.472331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.472336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.472341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.472347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.472352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.472356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.472360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.472364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.472369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.472375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.472380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.472385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.472390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.472394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.472399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.472403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.472407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.472412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.472417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.472421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.472426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.472430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.472435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.472470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:17.470879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254667940767699:4006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:17.470897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254667940767699:4006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:17.470900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254667940767699:4006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:17.470909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:17.478800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:17.479560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:17.479577Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:17.479580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:17.479584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:17.479592Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 236 [2:7556254665563907035:3698]
2025-10-01T14:07:17.479609Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:17.479634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:17.479644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.479648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.479650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.479668Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:17.479674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:17.479682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:17.479743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.479750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.479752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.479756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:17.479759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:17.479835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:17.479842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.479856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.479872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.479892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:17.479916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767679:2446], now have 1 active actors on pipe
2025-10-01T14:07:17.479924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767736:4006], now have 1 active actors on pipe
2025-10-01T14:07:17.479933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254665563907030:3698]
2025-10-01T14:07:17.479939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254665563907030:3698]
2025-10-01T14:07:17.479940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254665563907030:3698]
2025-10-01T14:07:17.479956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:17.479971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:17.479975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:17.479977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:17.479977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:17.479953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 236
2025-10-01T14:07:17.479991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:17.479994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:17.480009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 236
2025-10-01T14:07:17.480048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254665563907030:3698]
2025-10-01T14:07:17.480062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:17.480089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:17.480122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.480132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.480159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f51bdadc-d0949611-2414027-1a6682b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:17.480172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.480177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.480184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:17.480194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.480207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:17.480227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:17.480375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.480385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.480400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:17.480473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 237 partition: 0 MaxSeqNo: 45 sessionId: src_id|f51bdadc-d0949611-2414027-1a6682b5_0
2025-10-01T14:07:17.480899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8a832d6-afc9c9b8-bc310d5b-1322b0b8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f51bdadc-d0949611-2414027-1a6682b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:17.483440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51bdadc-d0949611-2414027-1a6682b5_0] Write session: try to update token
2025-10-01T14:07:17.483457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51bdadc-d0949611-2414027-1a6682b5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:17.504814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:17.504842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:17.504844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:17.504846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:17.504857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254665563907030:3698]
2025-10-01T14:07:17.504862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254665563907030:3698]
2025-10-01T14:07:17.504869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254665563907030:3698]
2025-10-01T14:07:17.506120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 237 sessionId: src_id|f51bdadc-d0949611-2414027-1a6682b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:17.504926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:17.504939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.504942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:17.505107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:17.506433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:17.506439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:17.506444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:17.508574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:17.552676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254667940767749:3772]
2025-10-01T14:07:17.552957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 236, pipe: [1:7556254667940767749:3772]
2025-10-01T14:07:17.659438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:17.659785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.659796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.659840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767749:3772], now have 1 active actors on pipe
2025-10-01T14:07:17.660125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:17.660598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:17.660602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:17.660607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:17.660652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254667940767749:3772]
2025-10-01T14:07:17.660664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 237 reason: error at write: Disconnected sessionId: src_id|f51bdadc-d0949611-2414027-1a6682b5_0
2025-10-01T14:07:17.660871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 237 sessionId: src_id|f51bdadc-d0949611-2414027-1a6682b5_0 is DEAD
2025-10-01T14:07:17.661175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51bdadc-d0949611-2414027-1a6682b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:17.661186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51bdadc-d0949611-2414027-1a6682b5_0] Write session will restart in 0.006706s
2025-10-01T14:07:17.661213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51bdadc-d0949611-2414027-1a6682b5_0] Write session: Do CDS request
2025-10-01T14:07:17.661219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51bdadc-d0949611-2414027-1a6682b5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:17.669098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51bdadc-d0949611-2414027-1a6682b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:17.669598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:17.669613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 238
2025-10-01T14:07:17.669756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:17.669789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:17.669795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:17.669799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:17.673199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 238 sessionId:  describe result for acl check
2025-10-01T14:07:17.673248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:17.673250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:17.673253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:17.673259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254667940767760:4011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:17.673859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254667940767760:4011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:17.685754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254667940767760:4011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:17.687121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:17.689154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:17.689377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:17.689399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:17.689410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:17.689464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:17.689512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254665563907100:3701]
2025-10-01T14:07:17.690138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:17.690831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254667940767760:4011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:17.690849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254667940767760:4011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:17.690852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254667940767760:4011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:17.690860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:17.690932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:17.690985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:17.691305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:17.691355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.691361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.691361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.691363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.691364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.691365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.691365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.691366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.691367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.691367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.691368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.691369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.691370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.691371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.691374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.691381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.691383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.691385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.691389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.691392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.691394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.691396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.691398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.691401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.691403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.691405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.691407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.691409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.691414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.691419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.691424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.691427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.691429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.691433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.691435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.691439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.691441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.691444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.691446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.691449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.691452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.691455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.691457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.691460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.691462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.691465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.691467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.691472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.691478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.691484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.691489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.691494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.691499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.691503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.691507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.691510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.691532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:17.696347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:17.697066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:17.697079Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:17.697080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:17.697083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:17.697089Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 237 [2:7556254665563907100:3701]
2025-10-01T14:07:17.697102Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:17.697117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:17.697119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.697121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.697123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.697136Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:17.697140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:17.697144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:17.697201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.697210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.697214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.697217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:17.697220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:17.697286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:17.697292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.697300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.697305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.697321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:17.697336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767813:4011], now have 1 active actors on pipe
2025-10-01T14:07:17.697338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767753:2446], now have 1 active actors on pipe
2025-10-01T14:07:17.697345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254665563907095:3701]
2025-10-01T14:07:17.697347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254665563907095:3701]
2025-10-01T14:07:17.697349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254665563907095:3701]
2025-10-01T14:07:17.697363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:17.697378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:17.697390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:17.697390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:17.697393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:17.697394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:17.697396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:17.697430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254665563907095:3701]
2025-10-01T14:07:17.697436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:17.697457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:17.697595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 237
2025-10-01T14:07:17.697624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 237
2025-10-01T14:07:17.697678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.697688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.697719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:17.697730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.697739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.697741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:17.697753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.697765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:17.697780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:17.697901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.697910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.697925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:17.698011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 238 partition: 0 MaxSeqNo: 45 sessionId: src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0
2025-10-01T14:07:17.698364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51bdadc-d0949611-2414027-1a6682b5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:17.701148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0] Write session: try to update token
2025-10-01T14:07:17.701165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:17.724229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 238 sessionId: src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:17.727286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:17.727540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.727562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.727612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:17.727727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:17.734253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:17.734387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:17.734400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254665563907095:3701]
2025-10-01T14:07:17.734450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:17.734650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:17.734803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:17.734954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:17.735137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:17.735344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:17.735379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:17.742778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:17.765898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:17.765931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:17.766118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.766192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.766267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.766336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.762485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254667940767838:3772]
2025-10-01T14:07:17.766584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 237, pipe: [1:7556254667940767838:3772]
2025-10-01T14:07:17.766468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.766477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.766547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.766627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.766693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.766757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.766799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.766804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.766876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.766936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.766998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.767062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.767109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.767111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.767179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.767244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.767308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.767377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.767420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.767422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.767493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.767554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.767642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.767704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.767756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.767759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.767831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.767890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.767950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.768044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.768089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.768094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.768162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.768221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.768282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.768341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.768380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.768382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.768450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.768506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.768560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.768617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.768659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.768661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.768728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.768783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.768858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.768919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.768977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.768980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.769055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:17.769148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:17.769204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:17.769267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:17.769306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:17.769308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:17.769381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767838:3772], now have 1 active actors on pipe
2025-10-01T14:07:17.769390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:17.769453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.769473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.769476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:17.769495Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769504Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769509Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769513Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769518Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769702Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769706Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769711Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769716Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769719Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769807Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769811Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769816Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769819Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769824Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769829Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769833Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769836Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769840Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769844Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769848Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769851Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769855Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769859Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769862Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769906Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769910Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769913Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769917Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769921Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769925Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769930Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769933Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769938Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769942Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:17.769962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:17.769974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:07:17.769977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:07:17.769980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:07:17.770003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:07:17.770440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:07:17.770457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:17.770463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:07:17.770467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:07:17.770471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:07:17.770474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:07:17.771017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:07:17.771032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:17.771037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:07:17.771041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:07:17.771045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:07:17.771048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:07:17.771603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:07:17.771613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.771728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327637771
2025-10-01T14:07:17.772632Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:17.772649Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:07:17.797776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:17.809006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:17.809024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:17.809027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:17.809029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:17.809039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254665563907095:3701]
2025-10-01T14:07:17.809043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254665563907095:3701]
2025-10-01T14:07:17.809047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254665563907095:3701]
2025-10-01T14:07:17.809094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:17.809102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.809104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:17.809238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:17.809911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:17.809918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:17.809922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:17.977576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:17.978616Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:17.979146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:17.979157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0] Write session will restart in 0.008334s
2025-10-01T14:07:17.978676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254667940767838:3772]
2025-10-01T14:07:17.978716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:17.978753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:17.978793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 238 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0
2025-10-01T14:07:17.978998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 238 sessionId: src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0 is DEAD
2025-10-01T14:07:17.979183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0] Write session: Do CDS request
2025-10-01T14:07:17.979190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:17.989163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:17.990255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:17.990926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:17.991144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:17.991154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:17.991165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:17.991211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:17.991249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254665563907216:3716]
2025-10-01T14:07:17.991853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:17.992088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:17.992128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:17.992431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:17.992484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.992490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.992491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.992492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.992493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.992494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.992495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.992496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.992497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.992498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.992499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.992500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.992501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.992503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.992508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.992517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.992521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.992525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.992528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.992532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.992535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.992538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.992542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.992545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.992549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.992552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.992556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.992559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.992567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.992574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:17.992580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.992588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:17.992592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.992597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:17.992601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.992606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:17.992610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.992615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:17.992619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.992624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:17.992629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.992635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:17.992639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.992643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:17.992648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.992652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:17.992657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.992662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.992666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.992670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.992674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.992680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.992685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.992689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:17.992693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.992698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:17.992736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:17.993498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:17.993515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 239
2025-10-01T14:07:17.993788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:17.993820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:17.993826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:17.993831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:17.994268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 239 sessionId:  describe result for acl check
2025-10-01T14:07:17.994297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:17.994299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:17.994301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:17.994306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254667940767896:4023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:17.994875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254667940767896:4023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:17.998681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:17.999363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:17.999380Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:17.999383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:17.999386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:17.999393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 238 [2:7556254665563907216:3716]
2025-10-01T14:07:17.999409Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:17.999428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:17.999430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:17.999433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:17.999435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:17.999451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:17.999465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:17.999471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:17.999531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.999538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.999540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.999542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:17.999545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:17.999613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:17.999620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:17.999631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:17.999642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:17.999658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:17.999678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254665563907210:3716]
2025-10-01T14:07:17.999684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254665563907210:3716]
2025-10-01T14:07:17.999686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254665563907210:3716]
2025-10-01T14:07:17.999699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:17.999712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:17.999726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:17.999730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:17.999734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:17.999734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:17.999736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:17.999773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254665563907210:3716]
2025-10-01T14:07:17.999780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:17.999846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:17.999919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254667940767866:2446], now have 1 active actors on pipe
2025-10-01T14:07:18.002555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 238
2025-10-01T14:07:18.010063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254667940767896:4023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:18.027268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254667940767896:4023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:18.027287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254667940767896:4023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:18.027291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254667940767896:4023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:18.027300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:18.028779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 238
2025-10-01T14:07:18.029316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735226:4023], now have 1 active actors on pipe
2025-10-01T14:07:18.029344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.029353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.029385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:18.029397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.029402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.029406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:18.029419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.029438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:18.029458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:18.033387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.033410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.033444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:18.033972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 239 partition: 0 MaxSeqNo: 45 sessionId: src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0
2025-10-01T14:07:18.034348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4ce5647-86e0088b-405f6fbc-7d40aa33_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:18.036945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0] Write session: try to update token
2025-10-01T14:07:18.036969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:18.041008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:18.041031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:18.041033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:18.041036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:18.041050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254665563907210:3716]
2025-10-01T14:07:18.041055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254665563907210:3716]
2025-10-01T14:07:18.041059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254665563907210:3716]
2025-10-01T14:07:18.041111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:18.041118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.041121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:18.041282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:18.042729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:18.042739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:18.042743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:18.076104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 239 sessionId: src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:18.079201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:18.079279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254672235735232:3772]
2025-10-01T14:07:18.079755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 238, pipe: [1:7556254672235735232:3772]
2025-10-01T14:07:18.231162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:18.231721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.231731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.231752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735232:3772], now have 1 active actors on pipe
2025-10-01T14:07:18.232015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:18.236755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:18.236855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254672235735232:3772]
2025-10-01T14:07:18.236882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:18.236991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 239 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0
2025-10-01T14:07:18.237159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 239 sessionId: src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0 is DEAD
2025-10-01T14:07:18.237666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:18.237679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0] Write session will restart in 0.008791s
2025-10-01T14:07:18.237708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0] Write session: Do CDS request
2025-10-01T14:07:18.237714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:18.248549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:18.252942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:18.252961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 240
2025-10-01T14:07:18.253189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:18.253221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:18.253227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:18.253231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:18.253921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 240 sessionId:  describe result for acl check
2025-10-01T14:07:18.253955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:18.253957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:18.253959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:18.253966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254672235735265:4028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:18.254539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254672235735265:4028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:18.260708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:18.265091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254672235735265:4028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:18.263693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:18.263974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:18.263979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:18.263991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:18.264058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:18.264093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254669858874580:3719]
2025-10-01T14:07:18.264661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:18.265795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:18.265863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:18.266252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:18.266308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.266310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.266311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.266312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.266314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.266315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.266317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.266318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.266319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.266321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.266322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.266323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.266324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.266326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.266332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.266342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.266346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.266350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.266354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.266358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.266364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.266368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.266392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.266397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.266401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.266404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.266408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.266412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.266420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.266428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.266434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.266440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.266444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.266450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.266454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.266459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.266464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.266469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.266474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.266479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.266484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.266488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.266494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.266499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.266504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.266509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.266513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.266518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.266522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.266527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.266531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.266536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.266542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.266549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.266554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.266558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.266601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:18.280085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:18.280760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:18.280766Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:18.280769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:18.280773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:18.280781Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 239 [2:7556254669858874580:3719]
2025-10-01T14:07:18.280802Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:18.280833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:18.280837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.280841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.280844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.280863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:18.280868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:18.280875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:18.280939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.280942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.280943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.280947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:18.280951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:18.281033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:18.281036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.281049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.281060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.281075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:18.281092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254669858874574:3719]
2025-10-01T14:07:18.281094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254669858874574:3719]
2025-10-01T14:07:18.281096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254669858874574:3719]
2025-10-01T14:07:18.281105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:18.281120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:18.281133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:18.281136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:18.281176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254669858874574:3719]
2025-10-01T14:07:18.281178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:18.282459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:18.282464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:18.282467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:18.282475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:18.283351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 239
2025-10-01T14:07:18.282672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735244:2446], now have 1 active actors on pipe
2025-10-01T14:07:18.286809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254672235735265:4028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:18.286827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254672235735265:4028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:18.286831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254672235735265:4028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:18.286840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:18.288334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 239
2025-10-01T14:07:18.290462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 240 partition: 0 MaxSeqNo: 45 sessionId: src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0
2025-10-01T14:07:18.290845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1f2837-dfd75dbc-778c730c-87099b6a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:18.289865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735309:4028], now have 1 active actors on pipe
2025-10-01T14:07:18.289910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.289919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.289952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:18.289965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.289972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.289975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:18.289992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.290027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:18.290050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:18.290285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.290291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.290311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:18.293210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0] Write session: try to update token
2025-10-01T14:07:18.293226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:18.321757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:18.321784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:18.321787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:18.321790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:18.321801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254669858874574:3719]
2025-10-01T14:07:18.321808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254669858874574:3719]
2025-10-01T14:07:18.321811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254669858874574:3719]
2025-10-01T14:07:18.321862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:18.321873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.316718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 240 sessionId: src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:18.321876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:18.319961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:18.322023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:18.324000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:18.324007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:18.324012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:18.338461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254672235735313:3772]
2025-10-01T14:07:18.343816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 239, pipe: [1:7556254672235735313:3772]
2025-10-01T14:07:18.475459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:18.475774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.475785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.475808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735313:3772], now have 1 active actors on pipe
2025-10-01T14:07:18.477363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:18.478991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254672235735313:3772]
2025-10-01T14:07:18.479031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:18.479069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:18.479156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 240 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0
2025-10-01T14:07:18.479344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 240 sessionId: src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0 is DEAD
2025-10-01T14:07:18.479574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:18.479594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0] Write session will restart in 0.007022s
2025-10-01T14:07:18.479642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0] Write session: Do CDS request
2025-10-01T14:07:18.479651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:18.487924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:18.488070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:18.488089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 241
2025-10-01T14:07:18.488521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:18.488568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:18.488575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:18.488587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:18.488978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 241 sessionId:  describe result for acl check
2025-10-01T14:07:18.489018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:18.489020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:18.489024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:18.489028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254672235735328:4032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:18.489514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254672235735328:4032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:18.491518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254672235735328:4032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:18.495481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254672235735328:4032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:18.495502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254672235735328:4032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:18.495507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254672235735328:4032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:18.495517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:18.495445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:18.498263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:18.498510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:18.498527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:18.498540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:18.498598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:18.498635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254669858874648:3721]
2025-10-01T14:07:18.499239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:18.499619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:18.499681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:18.500068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:18.500130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.500137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.500138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.500139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.500141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.500142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.500143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.500144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.500145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.500147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.500148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.500149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.500151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.500152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.500159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.500170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.500174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.500178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.500181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.500185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.500189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.500192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.500197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.500201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.500205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.500209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.500212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.500216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.500224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.500232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.500238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.500243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.500248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.500253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.500256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.500261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.500266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.500272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.500276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.500281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.500285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.500289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.500293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.500299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.500303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.500311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.500325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.500336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.500340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.500344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.500347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.500351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.500356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.500361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.500366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.500376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.500415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:18.512142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:18.514503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:18.514522Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:18.514525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:18.514530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:18.514538Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 240 [2:7556254669858874648:3721]
2025-10-01T14:07:18.514556Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:18.514579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:18.514582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.514585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.514588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.514604Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:18.514610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:18.514618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:18.514702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.514705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.514707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.514710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:18.514713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:18.514794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:18.514797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.514814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.514826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.514840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:18.514856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254669858874641:3721]
2025-10-01T14:07:18.514858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254669858874641:3721]
2025-10-01T14:07:18.514861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254669858874641:3721]
2025-10-01T14:07:18.514875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:18.514891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:18.514905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:18.514908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:18.515108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:18.515117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:18.515120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:18.515600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 240
2025-10-01T14:07:18.515632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 240
2025-10-01T14:07:18.520623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254669858874641:3721]
2025-10-01T14:07:18.520649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:18.520669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735375:4032], now have 1 active actors on pipe
2025-10-01T14:07:18.520677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735316:2446], now have 1 active actors on pipe
2025-10-01T14:07:18.520699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.520707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.520778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:18.520787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.520791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.520794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:18.520806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.520836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:18.520862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:18.521002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:18.524601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.524618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.524660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:18.524885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 241 partition: 0 MaxSeqNo: 45 sessionId: src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0
2025-10-01T14:07:18.525280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccdd7bf1-bfac4a6d-9c1e6dba-711b93a4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:18.528214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0] Write session: try to update token
2025-10-01T14:07:18.528233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:18.554125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:18.554143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:18.554146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:18.554148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:18.554157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254669858874641:3721]
2025-10-01T14:07:18.554162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254669858874641:3721]
2025-10-01T14:07:18.554168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254669858874641:3721]
2025-10-01T14:07:18.554219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:18.554226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.554229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:18.554401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:18.554416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:18.554419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:18.554421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:18.552121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 241 sessionId: src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:18.554471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:18.582489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254672235735392:3772]
2025-10-01T14:07:18.586322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 240, pipe: [1:7556254672235735392:3772]
2025-10-01T14:07:18.711553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:18.711568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0] Write session will restart in 0.006256s
2025-10-01T14:07:18.711594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0] Write session: Do CDS request
2025-10-01T14:07:18.711601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:18.709637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:18.709942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.709953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.710003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735392:3772], now have 1 active actors on pipe
2025-10-01T14:07:18.710719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:18.711140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:18.711226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 241 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0
2025-10-01T14:07:18.711422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 241 sessionId: src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0 is DEAD
2025-10-01T14:07:18.711858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:18.711891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254672235735392:3772]
2025-10-01T14:07:18.722857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:18.723493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:18.725070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:18.725273Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:18.725282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:18.725293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:18.725339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:18.725374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254669858874717:3724]
2025-10-01T14:07:18.725976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:18.726416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:18.726457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:18.726518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:18.726536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 242
2025-10-01T14:07:18.726778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:18.726832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.726838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.726840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.726841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.726846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.726848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.726849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.726850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.726851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.726852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.726854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.726855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.726856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.726857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.726862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.726870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.726874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.726878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.726882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.726886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.726890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.726894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.726897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.726902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.726905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.726909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.726914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.726918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.726925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.726933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.726941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.726752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:18.726946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.726780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:18.726795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:18.726799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:18.726950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.726955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.726960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.726967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.726971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.726976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.726979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.726984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.726989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.726995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.727000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.727005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.727009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.727015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.727024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.727029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.727033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.727043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.727047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.727052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.727056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.727061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.727065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.727070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.727110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:18.727368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 242 sessionId:  describe result for acl check
2025-10-01T14:07:18.727398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:18.727400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:18.727401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:18.727408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254672235735425:4037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:18.727945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254672235735425:4037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:18.734403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 241
2025-10-01T14:07:18.732774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:18.733476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:18.733483Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:18.733486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:18.733491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:18.733499Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 241 [2:7556254669858874717:3724]
2025-10-01T14:07:18.733514Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:18.733535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:18.733538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.733542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.733547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.733563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:18.733569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:18.733575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:18.733634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.733639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.733641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.733644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:18.733646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:18.733716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:18.733719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.733732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.733744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.733761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:18.733778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254669858874710:3724]
2025-10-01T14:07:18.733782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254669858874710:3724]
2025-10-01T14:07:18.733784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254669858874710:3724]
2025-10-01T14:07:18.733795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:18.733809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:18.733820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:18.733823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:18.733857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254669858874710:3724]
2025-10-01T14:07:18.733859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:18.733942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:18.733944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:18.733946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:18.733951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:18.735712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254672235735425:4037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:18.735389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735394:2446], now have 1 active actors on pipe
2025-10-01T14:07:18.750846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254672235735425:4037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:18.750876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254672235735425:4037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:18.750881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254672235735425:4037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:18.750896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:18.751201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735464:4037], now have 1 active actors on pipe
2025-10-01T14:07:18.751412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 241
2025-10-01T14:07:18.751616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.751633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.751664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:18.751676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:18.751684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:18.751687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:18.751699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:18.751716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:18.751735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:18.752182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 242 partition: 0 MaxSeqNo: 45 sessionId: src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0
2025-10-01T14:07:18.752022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.752032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.752047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:18.752559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2747f789-4ce8caf4-90e42e28-cd7c93f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:18.755425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0] Write session: try to update token
2025-10-01T14:07:18.755446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:18.764701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:18.764723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:18.764726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:18.764728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:18.764738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254669858874710:3724]
2025-10-01T14:07:18.764743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254669858874710:3724]
2025-10-01T14:07:18.764748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254669858874710:3724]
2025-10-01T14:07:18.764804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:18.764811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.764813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:18.764846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:18.764872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:18.764879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:18.764967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:18.790972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 242 sessionId: src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:18.793835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:18.818499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254672235735481:3772]
2025-10-01T14:07:18.818996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 241, pipe: [1:7556254672235735481:3772]
2025-10-01T14:07:18.949487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:18.950170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:18.950180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:18.950200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735481:3772], now have 1 active actors on pipe
2025-10-01T14:07:18.951536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:18.952053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254672235735481:3772]
2025-10-01T14:07:18.952086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:18.952089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:18.952146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 242 reason: error at write: Disconnected sessionId: src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0
2025-10-01T14:07:18.952339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 242 sessionId: src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0 is DEAD
2025-10-01T14:07:18.952468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:18.954863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:18.954872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0] Write session will restart in 0.009363s
2025-10-01T14:07:18.954900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0] Write session: Do CDS request
2025-10-01T14:07:18.954907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:18.967666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:18.970584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:18.970602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 243
2025-10-01T14:07:18.970859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:18.970887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:18.970892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:18.970896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:18.971645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 243 sessionId:  describe result for acl check
2025-10-01T14:07:18.971709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:18.971712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:18.971715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:18.971721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254672235735532:4049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:18.972455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254672235735532:4049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:18.979580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:18.983617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:18.983890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:18.983899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:18.983911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:18.983974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:18.984019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254669858874835:3735]
2025-10-01T14:07:18.984751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:18.985255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:18.985306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:18.985649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:18.985706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.985707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.985709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.985710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.985711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.985712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.985714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.985715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.985717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.985718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.985719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.985721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.985722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.985724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.985730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.985742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.985746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.985751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.985756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.985759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.985763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.985768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.985772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.985777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.985781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.985786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.985790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.985795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.985804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.985813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:18.985821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.985828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:18.985833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.985840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:18.985845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.985851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:18.985856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.985863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:18.985867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.985874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:18.985880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.985887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:18.985891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.985898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:18.985904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.985910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:18.985914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.985921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:18.985927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.985934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:18.985939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.985945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:18.985951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.985957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:18.985962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.985968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:18.986013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:18.999129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254672235735532:4049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:19.000519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:19.001302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:19.001308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:19.001310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:19.001314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:19.001322Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 242 [2:7556254669858874835:3735]
2025-10-01T14:07:19.001339Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:19.001357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:19.001360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.001364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.001366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.001382Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:19.001388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:19.001395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:19.001453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.001455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.001457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.001460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:19.001462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:19.001535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:19.001537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.001548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.001557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.001571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:19.001588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254669858874829:3735]
2025-10-01T14:07:19.001589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254669858874829:3735]
2025-10-01T14:07:19.001591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254669858874829:3735]
2025-10-01T14:07:19.001605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:19.001618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:19.001631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:19.001634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:19.001688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254669858874829:3735]
2025-10-01T14:07:19.001690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:19.006397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 242
2025-10-01T14:07:19.004445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:19.004456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:19.004459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:19.004465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:19.005716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254672235735508:2446], now have 1 active actors on pipe
2025-10-01T14:07:19.015344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254672235735532:4049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:19.015364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254672235735532:4049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:19.015368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254672235735532:4049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:19.015379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:19.015853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530702872:4049], now have 1 active actors on pipe
2025-10-01T14:07:19.015983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 242
2025-10-01T14:07:19.016089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.016100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.016129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:19.016141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.016147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.016151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:19.016163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.016180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:19.016202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:19.016494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.016500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.016513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:19.016644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 243 partition: 0 MaxSeqNo: 45 sessionId: src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0
2025-10-01T14:07:19.017019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b27efa-69811e84-ebfe8cfe-657fc87f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:19.019629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0] Write session: try to update token
2025-10-01T14:07:19.019650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:19.043551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 243 sessionId: src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:19.046249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:19.046743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.046766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.046823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:19.047446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:19.052275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254676530702874:3772]
2025-10-01T14:07:19.053098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 242, pipe: [1:7556254676530702874:3772]
2025-10-01T14:07:19.055118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530702874:3772], now have 1 active actors on pipe
2025-10-01T14:07:19.055144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:19.055147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:19.055151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:19.055152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:19.055161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254669858874829:3735]
2025-10-01T14:07:19.055165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254669858874829:3735]
2025-10-01T14:07:19.055168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254669858874829:3735]
2025-10-01T14:07:19.055216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:19.055223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.055225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:19.055367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:19.058502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:19.058509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:19.058513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:19.209130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:19.216871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.216896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.217051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.217108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.217181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.217243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.217283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.217292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.217362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.217426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.217490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.217548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.217590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.217599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.217655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.217706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.217771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.217834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.217882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.217890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.217951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.218011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.218071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.218128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.218172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.218180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.218238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.218294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.218361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.218439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.218482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.218490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.218562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.218636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.218705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.218777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.218831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.218838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.218933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.219002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.219081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.219157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.219216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.219222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.219306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.219381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.219447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.219510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.219553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.219556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.219628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.219694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.219757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.219836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.219881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.219884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.219961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.220021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.220082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.220147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.220205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.220208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.221371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:19.222687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:19.222741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 243 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0
2025-10-01T14:07:19.222915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 243 sessionId: src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0 is DEAD
2025-10-01T14:07:19.223065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:19.223116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254676530702874:3772]
2025-10-01T14:07:19.224730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:19.224745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0] Write session will restart in 0.007127s
2025-10-01T14:07:19.224777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0] Write session: Do CDS request
2025-10-01T14:07:19.224783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:19.232950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:19.233294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:19.233311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 244
2025-10-01T14:07:19.233471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:19.233517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:19.233528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:19.233531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:19.233970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 244 sessionId:  describe result for acl check
2025-10-01T14:07:19.233996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:19.233998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:19.234000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:19.234005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254676530702903:4054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:19.234512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254676530702903:4054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:19.238971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254676530702903:4054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:19.242389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254676530702903:4054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:19.242407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254676530702903:4054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:19.242410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254676530702903:4054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:19.242420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:19.244271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:19.245919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:19.246162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:19.246167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:19.246180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:19.246238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:19.246278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254674153842203:3742]
2025-10-01T14:07:19.246953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:19.247361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:19.247425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:19.247843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:19.247923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.247930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.247932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.247933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.247935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.247938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.247940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.247941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.247942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.247944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.247945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.247946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.247947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.247948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.247955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.247967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.247971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.247976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.247981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.247985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.247989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.247993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.247997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.248001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.248005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.248010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.248014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.248018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.248026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.248035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.248042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.248048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.248053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.248059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.248063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.248068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.248073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.248079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.248091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.248096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.248101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.248107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.248112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.248117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.248127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.248132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.248137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.248147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.248151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.248157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.248167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.248172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.248181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.248186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.248192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.248202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.248247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:19.255341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:19.255985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:19.256007Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:19.256011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:19.256015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:19.256023Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 243 [2:7556254674153842203:3742]
2025-10-01T14:07:19.256041Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:19.256066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:19.256074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.256078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.256081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.256102Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:19.256112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:19.256119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:19.256188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.256197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.256198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.256202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:19.256206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:19.256284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:19.256291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.256304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.256318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.256340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:19.256520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 243
2025-10-01T14:07:19.256565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 243
2025-10-01T14:07:19.256364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530702889:2446], now have 1 active actors on pipe
2025-10-01T14:07:19.256381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254674153842198:3742]
2025-10-01T14:07:19.256383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254674153842198:3742]
2025-10-01T14:07:19.256386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254674153842198:3742]
2025-10-01T14:07:19.256400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:19.256410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530702951:4054], now have 1 active actors on pipe
2025-10-01T14:07:19.256417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:19.256419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:19.256420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:19.256423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:19.256434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:19.256437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:19.256479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254674153842198:3742]
2025-10-01T14:07:19.256486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:19.256492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:19.256755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.256769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.256806Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:19.256818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.256839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.256843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:19.256857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.256888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:19.256907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:19.257150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.257166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.257197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:19.257285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 244 partition: 0 MaxSeqNo: 45 sessionId: src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0
2025-10-01T14:07:19.257677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1766e6-1f1ec683-b94e84da-bf960b0e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:19.260504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0] Write session: try to update token
2025-10-01T14:07:19.260526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:19.298163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:19.298188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:19.298200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254674153842198:3742]
2025-10-01T14:07:19.298255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:19.307464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 244 sessionId: src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:19.307584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:19.307903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:19.308070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:19.308229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:19.308375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:19.309054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:19.309103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:19.311094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.311115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.311151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:19.310347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:19.311265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:19.313053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:19.313071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:19.313073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:19.313075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:19.313085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254674153842198:3742]
2025-10-01T14:07:19.313089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254674153842198:3742]
2025-10-01T14:07:19.313093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254674153842198:3742]
2025-10-01T14:07:19.313138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:19.313140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:19.313147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.313149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:19.313150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:19.313152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:19.313286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:19.322445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254676530702966:3772]
2025-10-01T14:07:19.325365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 243, pipe: [1:7556254676530702966:3772]
2025-10-01T14:07:19.469454Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:19.469879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530702966:3772], now have 1 active actors on pipe
2025-10-01T14:07:19.479108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.479134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.479298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.479356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.479424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.479493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.479536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.479544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.479611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.479673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.479734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.479798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.479838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.479841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.479934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.479995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.480055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.480118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.480161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.480165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.480238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.480301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.480364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.480428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.480480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.480483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.480553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.480609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.480667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.480725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.480763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.480766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.480856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.480913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.480972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.481034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.481078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.481083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.481153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.481208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.481271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.481335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.481385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.481387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.481455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.481512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.481573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.481633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.481674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.481677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.481745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.481812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.481877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.481939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.481986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.481989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.482056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.482115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.482178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.482248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.482295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.482298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.482912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:19.486463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:19.486518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 244 reason: status is not ok: tablet will be restarted right now sessionId: src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0
2025-10-01T14:07:19.486739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254676530702966:3772]
2025-10-01T14:07:19.486767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:19.486983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 244 sessionId: src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0 is DEAD
2025-10-01T14:07:19.487050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:19.487064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0] Write session will restart in 0.009512s
2025-10-01T14:07:19.487091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0] Write session: Do CDS request
2025-10-01T14:07:19.487099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:19.497910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:19.497997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:19.498014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 245
2025-10-01T14:07:19.498121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:19.498152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:19.498162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:19.498165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:19.498559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 245 sessionId:  describe result for acl check
2025-10-01T14:07:19.498596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:19.498600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:19.498603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:19.498609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254676530702999:4058] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:19.499134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254676530702999:4058] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:19.501449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254676530702999:4058] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:19.502161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:19.508073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254676530702999:4058] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:19.508095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254676530702999:4058] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:19.508098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254676530702999:4058] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:19.508109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:19.507498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:19.507789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:19.507795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:19.507810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:19.507888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:19.507931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254674153842274:3744]
2025-10-01T14:07:19.508578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:19.508966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:19.509020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:19.509395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:19.509456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.509457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.509458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.509461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.509462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.509463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.509464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.509465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.509466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.509467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.509468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.509470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.509471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.509472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.509479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.509489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.509493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.509497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.509501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.509506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.509510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.509514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.509518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.509522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.509525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.509529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.509532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.509536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.509544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.509552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.509559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.509564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.509568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.509575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.509580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.509585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.509590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.509595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.509599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.509604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.509610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.509616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.509620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.509625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.509632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.509637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.509642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.509647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.509652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.509657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.509661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.509666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.509671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.509676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.509680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.509687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.509730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:19.515479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:19.516470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:19.516490Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:19.516492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:19.516496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:19.516504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 244 [2:7556254674153842274:3744]
2025-10-01T14:07:19.516521Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:19.516538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:19.516542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.516545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.516548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.516564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:19.516570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:19.516577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:19.516634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.516641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.516644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.516647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:19.516649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:19.516723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:19.516732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.516746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.516756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.516771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:19.516790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530703033:4058], now have 1 active actors on pipe
2025-10-01T14:07:19.516793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530702971:2446], now have 1 active actors on pipe
2025-10-01T14:07:19.516801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254674153842269:3744]
2025-10-01T14:07:19.516803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254674153842269:3744]
2025-10-01T14:07:19.516806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254674153842269:3744]
2025-10-01T14:07:19.516831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:19.516845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:19.516859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:19.516862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:19.516904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254674153842269:3744]
2025-10-01T14:07:19.516906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:19.516945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:19.516949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:19.516952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:19.516959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:19.516959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 244
2025-10-01T14:07:19.516993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 244
2025-10-01T14:07:19.520455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.520486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.520531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:19.520544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.520549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.520554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:19.520579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.520596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:19.520620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:19.520987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.520998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.521038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:19.521236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 245 partition: 0 MaxSeqNo: 45 sessionId: src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0
2025-10-01T14:07:19.522608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|988cf65d-35b1a8b7-a5469fd4-9691957c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:19.526928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0] Write session: try to update token
2025-10-01T14:07:19.526953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:19.544559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 245 sessionId: src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:19.547215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:19.547691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:19.547505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.547528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.547566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:19.565941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:19.565967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:19.565969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:19.565971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:19.565981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254674153842269:3744]
2025-10-01T14:07:19.565986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254674153842269:3744]
2025-10-01T14:07:19.565990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254674153842269:3744]
2025-10-01T14:07:19.566044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:19.566060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.566067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:19.566197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:19.567258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:19.567269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:19.567273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:19.586989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254676530703048:3772]
2025-10-01T14:07:19.587469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 244, pipe: [1:7556254676530703048:3772]
2025-10-01T14:07:19.721759Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:19.730437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.730462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.730633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.730694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.730759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.730831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.730881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.730890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.730961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.731023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.731095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.731163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.731212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.731219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.731295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.731374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.731444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.731521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.731571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.731579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.731659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.731728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.731802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.731878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.731936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.731942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.732031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.732105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.732177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.732249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.732299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.732306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.732373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.732432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.732492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.732558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.732603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.732609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.732676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.732735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.732798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.732878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.732922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.732929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.732990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.733047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.733108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.733172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.733219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.733227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.733287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.733346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.733405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.733466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.733513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.733519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.733581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:19.733638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:19.733696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:19.733754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:19.733794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:19.733800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:19.733893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530703048:3772], now have 1 active actors on pipe
2025-10-01T14:07:19.734132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:19.734140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:19.734150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:19.734179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 245 reason: error at write: Disconnected sessionId: src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0
2025-10-01T14:07:19.734185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254676530703048:3772]
2025-10-01T14:07:19.734352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 245 sessionId: src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0 is DEAD
2025-10-01T14:07:19.734495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:19.734506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0] Write session will restart in 0.006586s
2025-10-01T14:07:19.734532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0] Write session: Do CDS request
2025-10-01T14:07:19.734538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:19.735002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:19.741942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:19.741997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:19.742014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 246
2025-10-01T14:07:19.742160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:19.742194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:19.742200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:19.742207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:19.742624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 246 sessionId:  describe result for acl check
2025-10-01T14:07:19.742665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:19.742666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:19.742668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:19.742674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254676530703058:4063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:19.743236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254676530703058:4063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:19.745769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254676530703058:4063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:19.753094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254676530703058:4063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:19.753120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254676530703058:4063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:19.753125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254676530703058:4063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:19.753135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:19.763154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:19.774911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:19.775176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:19.775181Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:19.775192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:19.775260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:19.775307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254674153842349:3747]
2025-10-01T14:07:19.775977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:19.776512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:19.776559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:19.776913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:19.776968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.776969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.776971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.776972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.776973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.776977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.776978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.776979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.776980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.776981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.776982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.776984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.776985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.776986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.776991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.777000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.777003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.777007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.777010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.777014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.777017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.777020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.777024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.777027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.777030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.777033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.777037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.777040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.777046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.777053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:19.777058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.777063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:19.777067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.777073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:19.777076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.777081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:19.777088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.777093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:19.777097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.777102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:19.777106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.777111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:19.777115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.777121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:19.777125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.777130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:19.777134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.777138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.777142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.777146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.777150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.777155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.777173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.777178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:19.777184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.777189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:19.777225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:19.788225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:19.789020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:19.789057Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:19.789061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:19.789065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:19.789076Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 245 [2:7556254674153842349:3747]
2025-10-01T14:07:19.789095Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:19.789126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:19.789130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.789134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.789137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.789161Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:19.789178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:19.789185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:19.789604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.789606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.789608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.789612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:19.789615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:19.789701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:19.789705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.789731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:19.789742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:19.789756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:19.789774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254674153842341:3747]
2025-10-01T14:07:19.789777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254674153842341:3747]
2025-10-01T14:07:19.789779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254674153842341:3747]
2025-10-01T14:07:19.789795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:19.789813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:19.789828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:19.789830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:19.789872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254674153842341:3747]
2025-10-01T14:07:19.789874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:19.793409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 245
2025-10-01T14:07:19.793452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 245
2025-10-01T14:07:19.792434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:19.792444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:19.792447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:19.792456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:19.793298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530703114:4063], now have 1 active actors on pipe
2025-10-01T14:07:19.793305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530703051:2446], now have 1 active actors on pipe
2025-10-01T14:07:19.793712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.793725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.793758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:19.793769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:19.793774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:19.793777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:19.793788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:19.793806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:19.793827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:19.797083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.797100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.797138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:19.797365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 246 partition: 0 MaxSeqNo: 45 sessionId: src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0
2025-10-01T14:07:19.797774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7841c5b3-c6ab1431-8bc276b0-a5d2bb54_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:19.800497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0] Write session: try to update token
2025-10-01T14:07:19.800518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:19.832327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 246 sessionId: src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:19.835595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:19.835758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254676530703127:3772]
2025-10-01T14:07:19.836442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:19.836466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:19.836507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:19.837919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:19.841553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 245, pipe: [1:7556254676530703127:3772]
2025-10-01T14:07:19.842717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254676530703127:3772], now have 1 active actors on pipe
2025-10-01T14:07:19.849325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:19.849347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:19.849350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:19.849354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:19.849363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254674153842341:3747]
2025-10-01T14:07:19.849367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254674153842341:3747]
2025-10-01T14:07:19.849371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254674153842341:3747]
2025-10-01T14:07:19.849421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:19.849433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:19.849441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:19.849582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:19.850830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:19.850839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:19.850842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:20.035352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:20.046659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.046689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.046874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.046929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.046990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.047057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.047107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.047113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.047180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.047234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.047296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.047356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.047402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.047405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.047467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.047522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.047581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.047640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.047681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.047684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.047747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.047808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.047870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.047929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.047966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.047969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.048039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.048096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.048154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.048212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.048262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.048265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.048334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.048391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.048456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.048515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.048556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.048560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.048633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.048690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.048755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.048816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.049023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.049027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.049095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.049150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.049210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.049266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.049309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.049312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.049391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.049452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.049512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.049572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.049622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.049624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.049694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.049752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.049813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.049873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.050001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.050004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.050519Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:20.050667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:20.050679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:20.050681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:20.050709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 246 reason: error at write: Disconnected sessionId: src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0
2025-10-01T14:07:20.050719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254676530703127:3772]
2025-10-01T14:07:20.050948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 246 sessionId: src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0 is DEAD
2025-10-01T14:07:20.058524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:20.058539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0] Write session will restart in 0.008838s
2025-10-01T14:07:20.058560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0] Write session: Do CDS request
2025-10-01T14:07:20.058565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:20.070776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:20.071152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:20.071173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 247
2025-10-01T14:07:20.071350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:20.071379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:20.071384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:20.071389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:20.071874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 247 sessionId:  describe result for acl check
2025-10-01T14:07:20.071906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:20.071908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:20.071910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:20.071915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254680825670492:4075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:20.072457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254680825670492:4075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:20.078597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:20.080434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254680825670492:4075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:20.081215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:20.081506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:20.081516Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:20.081531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:20.081606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:20.081652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254678448809765:3762]
2025-10-01T14:07:20.082262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:20.082751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:20.082809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:20.083180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:20.083234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.083239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.083240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.083241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.083242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.083244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.083244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.083246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.083247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.083248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.083249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.083250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.083251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.083252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.083258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.083268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.083272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.083276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.083279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.083283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.083286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.083290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.083294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.083298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.083302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.083307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.083310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.083313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.083323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.083330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.083338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.083342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.083348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.083357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.083361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.083365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.083369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.083374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.083382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.083387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.083391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.083396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.083403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.083408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.083415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.083424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.083428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.083432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.083436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.083445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.083449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.083453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.083457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.083461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.083467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.083471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.083511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:20.089020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254680825670492:4075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:20.089039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254680825670492:4075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:20.089046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254680825670492:4075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:20.089064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:20.095288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:20.096296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:20.096306Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:20.096310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:20.096314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:20.096322Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 246 [2:7556254678448809765:3762]
2025-10-01T14:07:20.096340Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:20.096360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:20.096364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.096368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.096370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.096387Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:20.096393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:20.096400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:20.096472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.096478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.096479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.096483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:20.096485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:20.096568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:20.096570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.096582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.096594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.096610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:20.096645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254678448809760:3762]
2025-10-01T14:07:20.096647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254678448809760:3762]
2025-10-01T14:07:20.096650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254678448809760:3762]
2025-10-01T14:07:20.096660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:20.096676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:20.096682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:20.096687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:20.096690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:20.096690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:20.096693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:20.096704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670537:4075], now have 1 active actors on pipe
2025-10-01T14:07:20.096708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670467:2446], now have 1 active actors on pipe
2025-10-01T14:07:20.096746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254678448809760:3762]
2025-10-01T14:07:20.096756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:20.096767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:20.096964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 246
2025-10-01T14:07:20.096965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 246
2025-10-01T14:07:20.097083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.097105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.097142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:20.097153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.097162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.097165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:20.097178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.097193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:20.097221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:20.097407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.097415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.097452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:20.097614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 247 partition: 0 MaxSeqNo: 45 sessionId: src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0
2025-10-01T14:07:20.098058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb39747e-a7ac0f41-6db4c6c1-c52c648_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:20.100746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0] Write session: try to update token
2025-10-01T14:07:20.100770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:20.128223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 247 sessionId: src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:20.130645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:20.134447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.134474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.134513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:20.134679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:20.140480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:20.140499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:20.140502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:20.140505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:20.140520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254678448809760:3762]
2025-10-01T14:07:20.140524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254678448809760:3762]
2025-10-01T14:07:20.140528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254678448809760:3762]
2025-10-01T14:07:20.140585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:20.140592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.140595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:20.140753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:20.140947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:20.140957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:20.140966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:20.151064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254680825670551:3772]
2025-10-01T14:07:20.159860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 246, pipe: [1:7556254680825670551:3772]
2025-10-01T14:07:20.325918Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:20.326641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670551:3772], now have 1 active actors on pipe
2025-10-01T14:07:20.336267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.336301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.336529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.336604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.336680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.336756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.336809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.336814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.336918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.336990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.337068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.337144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.337197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.337200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.337278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.337349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.337543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.337615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.337653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.337672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.337750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.337809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.337864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.337918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.338107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.338113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.338171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.338220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.338275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.338331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.338368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.338397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.338482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.338562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.338629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.338696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.338740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.338744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.338824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.338891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.338966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.339044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.339105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.339108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.339197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.339267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.339341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.339418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.339466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.339469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.339547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.339610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.339678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.339740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.339786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.339789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.339862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.339931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.339998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.340058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.340103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.340106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.347995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:20.348007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0] Write session will restart in 0.008824s
2025-10-01T14:07:20.348029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0] Write session: Do CDS request
2025-10-01T14:07:20.348035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:20.347557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254680825670551:3772]
2025-10-01T14:07:20.347594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:20.347629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 247 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0
2025-10-01T14:07:20.347806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 247 sessionId: src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0 is DEAD
2025-10-01T14:07:20.347974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:20.345890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:20.357987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:20.358617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:20.358633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 248
2025-10-01T14:07:20.359053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:20.359085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:20.359090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:20.359094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:20.363199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 248 sessionId:  describe result for acl check
2025-10-01T14:07:20.363240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:20.363242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:20.363244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:20.363249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254680825670569:4080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:20.363799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254680825670569:4080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:20.372982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254680825670569:4080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:20.374875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:20.377324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254680825670569:4080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:20.377346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254680825670569:4080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:20.377349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254680825670569:4080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:20.377358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:20.378152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:20.378364Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:20.378385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:20.378396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:20.378454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:20.378498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254678448809843:3765]
2025-10-01T14:07:20.379135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:20.382511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:20.382583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:20.382999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:20.383062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.383063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.383064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.383066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.383067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.383069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.383071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.383073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.383074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.383076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.383078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.383079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.383081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.383083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.383090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.383102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.383107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.383112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.383116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.383121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.383125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.383133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.383138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.383142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.383147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.383151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.383155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.383160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.383168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.383178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.383184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.383191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.383196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.383202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.383207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.383213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.383224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.383229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.383235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.383241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.383247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.383252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.383260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.383265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.383271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.383277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.383283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.383289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.383293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.383299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.383305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.383310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.383316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.383322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.383326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.383331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.383376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:20.394189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:20.395172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:20.395317Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:20.395327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:20.395331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:20.395342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 247 [2:7556254678448809843:3765]
2025-10-01T14:07:20.395360Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:20.395378Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:20.395384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.395387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.395389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.395406Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:20.395418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:20.395429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:20.395496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.395503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.395505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.395509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:20.395511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:20.396393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 247
2025-10-01T14:07:20.396435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 247
2025-10-01T14:07:20.395585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:20.395592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.395604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.395613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.395626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:20.395643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254678448809836:3765]
2025-10-01T14:07:20.395646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254678448809836:3765]
2025-10-01T14:07:20.395648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254678448809836:3765]
2025-10-01T14:07:20.395660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:20.395673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:20.395685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:20.395689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:20.395729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254678448809836:3765]
2025-10-01T14:07:20.395731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:20.395820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:20.395822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:20.395824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:20.395829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:20.396699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670626:4080], now have 1 active actors on pipe
2025-10-01T14:07:20.396712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670557:2446], now have 1 active actors on pipe
2025-10-01T14:07:20.396724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.396730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.396768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:20.396780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.396784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.396788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:20.396799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.396812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:20.396843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:20.397288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.397295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.397312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:20.397462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 248 partition: 0 MaxSeqNo: 45 sessionId: src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0
2025-10-01T14:07:20.397842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f9ba3-a9dae97f-78f977b1-a9d6204f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:20.400610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0] Write session: try to update token
2025-10-01T14:07:20.400637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:20.426489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 248 sessionId: src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:20.429574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:20.430991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.431013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.431053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:20.434816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:20.447540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254680825670636:3772]
2025-10-01T14:07:20.450989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 247, pipe: [1:7556254680825670636:3772]
2025-10-01T14:07:20.452336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670636:3772], now have 1 active actors on pipe
2025-10-01T14:07:20.454493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:20.454498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:20.454501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:20.454503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:20.454512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254678448809836:3765]
2025-10-01T14:07:20.454517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254678448809836:3765]
2025-10-01T14:07:20.454521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254678448809836:3765]
2025-10-01T14:07:20.454571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:20.454578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.454581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:20.454732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:20.456280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:20.456287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:20.456291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:20.612845Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:20.623276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.623310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.623524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.623597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.623671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.623743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.623799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.623805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.623891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.623960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.624033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.624115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.624168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.624171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.624246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.624310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.624377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.624441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.624491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.624494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.624575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.624641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.624708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.624778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.624840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.624843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.624925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.624988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.625050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.625117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.625170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.625173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.625246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.625303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.625376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.625447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.625504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.625507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.625577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.625638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.625698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.625763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.625827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.625834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.625905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.625963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.626021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.626078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.626121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.626124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.626198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.626272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.626350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.627654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.627720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.627723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.627806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.627874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.627943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.628011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.628062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.628065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.630772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:20.630787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0] Write session will restart in 0.009297s
2025-10-01T14:07:20.629952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:20.630815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0] Write session: Do CDS request
2025-10-01T14:07:20.630117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:20.630822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:20.630130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:20.630153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 248 reason: error at write: Disconnected sessionId: src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0
2025-10-01T14:07:20.630306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 248 sessionId: src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0 is DEAD
2025-10-01T14:07:20.630400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:20.630451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254680825670636:3772]
2025-10-01T14:07:20.640953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:20.641428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:20.641445Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 249
2025-10-01T14:07:20.641626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:20.641660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:20.641666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:20.641669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:20.642119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 249 sessionId:  describe result for acl check
2025-10-01T14:07:20.642150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:20.642152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:20.642154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:20.642159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254680825670658:4085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:20.642996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254680825670658:4085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:20.651389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:20.653459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254680825670658:4085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:20.655390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:20.655647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:20.655661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:20.655674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:20.655743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:20.655787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254678448809925:3768]
2025-10-01T14:07:20.656431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:20.656777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:20.656846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:20.657175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:20.657228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.657235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.657236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.657237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.657238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.657240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.657241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.657242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.657244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.657245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.657246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.657247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.657247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.657249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.657254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.657263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.657266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.657270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.657264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254680825670658:4085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:20.657274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.657281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254680825670658:4085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:20.657297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254680825670658:4085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:20.657277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.657280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.657283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.657307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:20.657287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.657290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.657294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.657297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.657300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.657305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.657312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.657319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.657325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.657329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.657332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.657337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.657341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.657345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.657349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.657353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.657357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.657361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.657366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.657369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.657373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.657377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.657381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.657385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.657400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.657405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.657408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.657412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.657415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.657420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.657424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.657433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.657437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.657441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.657474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:20.662361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:20.663212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:20.663231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:20.663234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:20.663238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:20.663245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 248 [2:7556254678448809925:3768]
2025-10-01T14:07:20.663263Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:20.663285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:20.663294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.663299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.663302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.663320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:20.663326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:20.663332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:20.663400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.663408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.663410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.663414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:20.663417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:20.663494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:20.663502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.663517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.663529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.663547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:20.663567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670716:4085], now have 1 active actors on pipe
2025-10-01T14:07:20.663571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670645:2446], now have 1 active actors on pipe
2025-10-01T14:07:20.663579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254678448809919:3768]
2025-10-01T14:07:20.663581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254678448809919:3768]
2025-10-01T14:07:20.663586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254678448809919:3768]
2025-10-01T14:07:20.663599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:20.663613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:20.663640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:20.663643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:20.663658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:20.663661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:20.663666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:20.663683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254678448809919:3768]
2025-10-01T14:07:20.663686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:20.663688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:20.663717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.663722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.663753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:20.663761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:20.663766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:20.663768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:20.663777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:20.663786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:20.663805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:20.664032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.664040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.664063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:20.664547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffd78b43-e026f4c6-eeefae9-ce9eabe4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:20.663612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 248
2025-10-01T14:07:20.663679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 248
2025-10-01T14:07:20.664164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 249 partition: 0 MaxSeqNo: 45 sessionId: src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0
2025-10-01T14:07:20.667656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0] Write session: try to update token
2025-10-01T14:07:20.667676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:20.703875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 249 sessionId: src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:20.706779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:20.706990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.707008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.707042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:20.707355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:20.720979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:20.720998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:20.721001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:20.721003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:20.721014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254678448809919:3768]
2025-10-01T14:07:20.721022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254678448809919:3768]
2025-10-01T14:07:20.721027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254678448809919:3768]
2025-10-01T14:07:20.721077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:20.721085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.721088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:20.721237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:20.722917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:20.722927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:20.722931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:20.730655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254680825670726:3772]
2025-10-01T14:07:20.733087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 248, pipe: [1:7556254680825670726:3772]
2025-10-01T14:07:20.775201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:07:20.775234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-01T14:07:20.944047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:20.944487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670726:3772], now have 1 active actors on pipe
2025-10-01T14:07:20.953363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:20.953390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:20.953572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.953768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.954019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.954092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.954145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.954156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.958532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:20.958546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:20.958551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:20.958565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-10-01T14:07:20.958574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 249 reason: error at write: Disconnected sessionId: src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0
2025-10-01T14:07:20.958625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254680825670726:3772]
2025-10-01T14:07:20.954221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.954288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.954349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.954455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.954566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.954570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.954636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.954690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.954748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.954811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.954864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.954866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.954928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.954984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.955043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.955242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.955352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.955357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.955547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.955604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.955661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.955717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.955761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.955764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.955833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.955895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.955955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.956017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.956064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.956067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.956137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.956339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.956538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.956605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.956658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.956661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.956728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.956785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.956862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.956922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.956983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.956986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.957190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.957400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.957463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.957524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.957568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.957570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.957637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:20.957690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:20.957748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:20.957808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:20.957850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:20.957853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:20.958916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 249 sessionId: src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0 is DEAD
2025-10-01T14:07:20.959954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:20.962488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:20.962502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0] Write session will restart in 0.007150s
2025-10-01T14:07:20.962532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0] Write session: Do CDS request
2025-10-01T14:07:20.962538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:20.974511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:20.975252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:20.975271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 250
2025-10-01T14:07:20.982459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:20.982519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:20.982525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:20.982531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:20.983203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 250 sessionId:  describe result for acl check
2025-10-01T14:07:20.983250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:20.983252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:20.983254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:20.983260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254680825670809:4097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:20.983796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254680825670809:4097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:20.984273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:20.990884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:20.991190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:20.991196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:20.991211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:20.991288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:20.991331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254678448810022:3774]
2025-10-01T14:07:20.991994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:20.995201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:20.995274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:20.995705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:20.995774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.995775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.995777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.995778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.995780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.995781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.995782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.995784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.995785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.995787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.995788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.995789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.995790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.995792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.995799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.995809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.995815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.995819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.995824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.995827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.995832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.995836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.995839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.995844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.995848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.995852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.995856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.995859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.995867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.995875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:20.995882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.995887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:20.995892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.995896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:20.995902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.995908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:20.995913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.995918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:20.995923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.995927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:20.995935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.995940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:20.995944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.995949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:20.995953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.995958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:20.995962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.995969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:20.995974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.995979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:20.995984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.995989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:20.995994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.996000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:20.996004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.996009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:20.996046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:20.993606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254680825670809:4097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:21.002333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254680825670809:4097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:21.002358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254680825670809:4097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:21.002362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254680825670809:4097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:21.002399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:21.003325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:21.003979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:21.003984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:21.003987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:21.003991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:21.004000Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 249 [2:7556254678448810022:3774]
2025-10-01T14:07:21.004019Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:21.004037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:21.004039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.004043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.004045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.004063Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:21.004068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:21.004075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:21.004137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.004139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.004141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.004144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:21.004147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:21.004222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:21.004224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.004240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.004251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.004265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:21.004282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254678448810017:3774]
2025-10-01T14:07:21.004285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254678448810017:3774]
2025-10-01T14:07:21.004286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254678448810017:3774]
2025-10-01T14:07:21.004301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:21.004315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:21.004330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:21.004333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:21.004373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254678448810017:3774]
2025-10-01T14:07:21.004375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:21.005007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:21.005013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:21.005016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:21.005021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:21.005469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 249
2025-10-01T14:07:21.005682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254680825670761:2446], now have 1 active actors on pipe
2025-10-01T14:07:21.005716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638141:4097], now have 1 active actors on pipe
2025-10-01T14:07:21.005781Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:07:21.006265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 249
2025-10-01T14:07:21.006493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.006505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.006530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:21.006540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.006548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.006550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:21.006561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.006576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:21.006595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.007167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.007176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.007196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.006477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:07:21.006513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:07:21.007359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 250 partition: 0 MaxSeqNo: 45 sessionId: src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0
2025-10-01T14:07:21.010484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e248c1-c6683d85-6d8e428d-85c60c8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:21.013545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0] Write session: try to update token
2025-10-01T14:07:21.013565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:21.035556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 250 sessionId: src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:21.038086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:21.037684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:21.037706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:21.037709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:21.037711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:21.037721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254678448810017:3774]
2025-10-01T14:07:21.037727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254678448810017:3774]
2025-10-01T14:07:21.037731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254678448810017:3774]
2025-10-01T14:07:21.037785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:21.037793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.037798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:21.037848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:21.037857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:21.037860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:21.037936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:21.062992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254685120638152:3772]
2025-10-01T14:07:21.063625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 249, pipe: [1:7556254685120638152:3772]
2025-10-01T14:07:21.197008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:21.197055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:21.197058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:21.197119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 250 reason: error at write: Disconnected sessionId: src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0
2025-10-01T14:07:21.197290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 250 sessionId: src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0 is DEAD
2025-10-01T14:07:21.197429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254685120638152:3772]
2025-10-01T14:07:21.197721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:21.197729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0] Write session will restart in 0.007128s
2025-10-01T14:07:21.197757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0] Write session: Do CDS request
2025-10-01T14:07:21.197763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:21.196133Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:21.196588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.196598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.196641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638152:3772], now have 1 active actors on pipe
2025-10-01T14:07:21.197052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:21.205915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:21.205996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:21.206009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 251
2025-10-01T14:07:21.206197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:21.206223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:21.206227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:21.206230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:21.206664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 251 sessionId:  describe result for acl check
2025-10-01T14:07:21.206695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:21.206697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:21.206698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:21.206703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254685120638193:4102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:21.207228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254685120638193:4102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:21.208887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:21.209240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254685120638193:4102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:21.210727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:21.210955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:21.210966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:21.210975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:21.211017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:21.211046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254682743777426:3787]
2025-10-01T14:07:21.211516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:21.211846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:21.211925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:21.212271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:21.212349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.212356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.212358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.212359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.212360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.212361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.212362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.212364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.212365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.212366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.212368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.212369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.212370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.212372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.212377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.212389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.212393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.212398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.212403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.212408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.212412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.212416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.212420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.212425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.212428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.212431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.212435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.212438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.212447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.212456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.212463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.212473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.212478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.212484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.212496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.212501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.212506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.212511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.212515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.212519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.212525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.212530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.212536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.212542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.212548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.212554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.212558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.212564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.212570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.212576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.212581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.212586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.212593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.212603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.212608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.212613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.212652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:21.213221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254685120638193:4102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:21.213235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254685120638193:4102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:21.213238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254685120638193:4102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:21.213247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:21.217046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:21.217685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:21.217696Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:21.217697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:21.217700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:21.217706Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 250 [2:7556254682743777426:3787]
2025-10-01T14:07:21.217720Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:21.217738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:21.217741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.217746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.217748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.217765Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:21.217771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:21.217777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:21.217849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.217856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.217858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.217861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:21.217863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:21.217922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:21.217935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.217947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.217961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.217977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:21.217999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638167:2446], now have 1 active actors on pipe
2025-10-01T14:07:21.218005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638243:4102], now have 1 active actors on pipe
2025-10-01T14:07:21.218013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254682743777419:3787]
2025-10-01T14:07:21.218020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254682743777419:3787]
2025-10-01T14:07:21.218022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254682743777419:3787]
2025-10-01T14:07:21.218040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:21.218058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:21.218057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:21.218061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:21.218063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:21.218076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:21.218080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:21.218085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 250
2025-10-01T14:07:21.218113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254682743777419:3787]
2025-10-01T14:07:21.218130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 250
2025-10-01T14:07:21.218120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:21.218123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:21.218168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.218176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.218199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80f67e27-42d29180-95ddc695-a1e0831e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:21.218210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.218214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.218217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:21.218226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.218234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:21.218255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.218414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.218423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.218438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.218583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 251 partition: 0 MaxSeqNo: 45 sessionId: src_id|80f67e27-42d29180-95ddc695-a1e0831e_0
2025-10-01T14:07:21.218941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38b7728b-2d5a819a-21fcbf85-4939f88f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|80f67e27-42d29180-95ddc695-a1e0831e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:21.221595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80f67e27-42d29180-95ddc695-a1e0831e_0] Write session: try to update token
2025-10-01T14:07:21.221615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80f67e27-42d29180-95ddc695-a1e0831e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:21.236136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:21.236159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:21.236171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254682743777419:3787]
2025-10-01T14:07:21.236222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:21.236413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:21.236597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:21.236740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:21.236895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:21.237094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:21.237133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:21.238457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:21.241618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 251 sessionId: src_id|80f67e27-42d29180-95ddc695-a1e0831e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:21.244231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:21.246304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.246328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.246388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:21.247518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:21.273424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:21.273445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:21.273448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:21.273450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:21.273463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254682743777419:3787]
2025-10-01T14:07:21.273467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254682743777419:3787]
2025-10-01T14:07:21.273470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254682743777419:3787]
2025-10-01T14:07:21.273523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:21.273530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.273533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:21.273539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:21.273550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:21.273553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:21.273667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:21.297972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254685120638252:3772]
2025-10-01T14:07:21.298465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 250, pipe: [1:7556254685120638252:3772]
2025-10-01T14:07:21.442634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:21.451057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.451092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.451268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.451331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.451395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.451459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.451511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.451517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.451584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.451648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.451709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.451772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.451823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.451829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.451901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.451973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.452035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.452101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.452143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.452150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.452225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.452294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.452363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.452437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.452489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.452496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.452575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.452645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.452718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.452789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.452853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.452856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.452927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.452981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.453036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.453092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.453133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.453136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.453201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.453256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.453314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.453368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.453407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.453410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.453475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.453529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.453585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.453639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.453687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.453689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.453751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.453803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.453856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.453918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.453957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.453959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.454016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:21.454066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:21.454123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:21.454178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:21.454214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:21.454217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:21.454286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638252:3772], now have 1 active actors on pipe
2025-10-01T14:07:21.455281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f67e27-42d29180-95ddc695-a1e0831e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:21.455295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f67e27-42d29180-95ddc695-a1e0831e_0] Write session will restart in 0.005282s
2025-10-01T14:07:21.455320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f67e27-42d29180-95ddc695-a1e0831e_0] Write session: Do CDS request
2025-10-01T14:07:21.455327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f67e27-42d29180-95ddc695-a1e0831e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:21.454856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254685120638252:3772]
2025-10-01T14:07:21.454890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:21.454893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:21.454918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 251 reason: error at write: Disconnected sessionId: src_id|80f67e27-42d29180-95ddc695-a1e0831e_0
2025-10-01T14:07:21.455133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 251 sessionId: src_id|80f67e27-42d29180-95ddc695-a1e0831e_0 is DEAD
2025-10-01T14:07:21.455286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:21.455463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:21.461971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80f67e27-42d29180-95ddc695-a1e0831e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:21.465914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:21.465930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 252
2025-10-01T14:07:21.466142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:21.466194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:21.466200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:21.466209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:21.466639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 252 sessionId:  describe result for acl check
2025-10-01T14:07:21.466673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:21.466679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:21.466681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:21.466685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254685120638268:4106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:21.467223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254685120638268:4106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:21.469422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254685120638268:4106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:21.477005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254685120638268:4106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:21.477022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254685120638268:4106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:21.477026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254685120638268:4106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:21.477034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:21.488706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:21.490960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:21.491225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:21.491230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:21.491244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:21.491307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:21.491345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254682743777507:3790]
2025-10-01T14:07:21.491995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:21.492613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:21.492681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:21.493060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:21.493149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.493150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.493151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.493152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.493154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.493155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.493156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.493158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.493159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.493160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.493161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.493165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.493166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.493167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.493174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.493185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.493189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.493193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.493197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.493201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.493205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.493209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.493214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.493218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.493222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.493226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.493230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.493234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.493242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.493250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.493256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.493262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.493267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.493272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.493277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.493282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.493286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.493293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.493298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.493302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.493307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.493312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.493320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.493325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.493330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.493335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.493339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.493344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.493348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.493353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.493359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.493364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.493368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.493373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.493377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.493382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.493421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:21.501958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:21.502635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:21.502651Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:21.502654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:21.502657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:21.502665Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 251 [2:7556254682743777507:3790]
2025-10-01T14:07:21.502682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:21.502700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:21.502709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.502713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.502716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.502734Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:21.502744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:21.502751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:21.502818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.502825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.502827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.502830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:21.502833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:21.502908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:21.502919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.502933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.502945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.502961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:21.502979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254682743777501:3790]
2025-10-01T14:07:21.502984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254682743777501:3790]
2025-10-01T14:07:21.502986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254682743777501:3790]
2025-10-01T14:07:21.502999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:21.503012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:21.503027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:21.503030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:21.503068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254682743777501:3790]
2025-10-01T14:07:21.503070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:21.503221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:21.503230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:21.503232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:21.503237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:21.503748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 251
2025-10-01T14:07:21.503781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 251
2025-10-01T14:07:21.509399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638254:2446], now have 1 active actors on pipe
2025-10-01T14:07:21.509420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638312:4106], now have 1 active actors on pipe
2025-10-01T14:07:21.509452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.509464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.509513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:21.509528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.509545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.509552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:21.509565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.509584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:21.509608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.509959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.509970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.509997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.510187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 252 partition: 0 MaxSeqNo: 45 sessionId: src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0
2025-10-01T14:07:21.510596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80f67e27-42d29180-95ddc695-a1e0831e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:21.513151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0] Write session: try to update token
2025-10-01T14:07:21.513168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:21.535842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 252 sessionId: src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:21.538411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:21.540701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.540732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.540755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:21.540759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:21.540761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:21.540767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:21.540776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254682743777501:3790]
2025-10-01T14:07:21.540780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254682743777501:3790]
2025-10-01T14:07:21.540786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254682743777501:3790]
2025-10-01T14:07:21.540844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:21.540850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:21.540853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:21.540868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:21.540875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.540878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:21.541026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:21.555071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254685120638339:3772]
2025-10-01T14:07:21.555805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 251, pipe: [1:7556254685120638339:3772]
2025-10-01T14:07:21.712217Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:21.712604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:21.712673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638339:3772], now have 1 active actors on pipe
2025-10-01T14:07:21.712774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:21.712898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:21.712947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254685120638339:3772]
2025-10-01T14:07:21.722768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:21.724458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:21.724683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:21.724692Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:21.724704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:21.724753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:21.724791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254682743777586:3793]
2025-10-01T14:07:21.724912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:21.724927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0] Write session will restart in 0.006575s
2025-10-01T14:07:21.724963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0] Write session: Do CDS request
2025-10-01T14:07:21.724969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:21.724586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:21.724603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:21.724623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 252 reason: error at write: Disconnected sessionId: src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0
2025-10-01T14:07:21.724776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 252 sessionId: src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0 is DEAD
2025-10-01T14:07:21.725329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:21.732081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:21.732171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:21.732511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:21.732565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.732566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.732567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.732568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.732569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.732570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.732571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.732572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.732573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.732574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.732575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.732576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.732577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.732578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.732585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.732592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.732595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.732598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.732601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.732604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.732607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.732610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.732613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.732616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.732619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.732622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.732625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.732628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.732634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.732642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.732649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.732654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.732660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.732665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.732668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.732672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.732677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.732681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.732684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.732688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.732692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.732696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.732699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.732703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.732709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.732713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.732716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.732720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.732724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.732728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.732731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.732735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.732738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.732742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.732746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.732751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.732782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:21.734956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:21.735396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:21.735410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 253
2025-10-01T14:07:21.735705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:21.735746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:21.735757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:21.735761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:21.736171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 253 sessionId:  describe result for acl check
2025-10-01T14:07:21.736206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:21.736214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:21.736215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:21.736220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254685120638389:4111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:21.736752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254685120638389:4111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:21.738271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:21.739164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254685120638389:4111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:21.738950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:21.738969Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:21.738971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:21.738977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:21.738984Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 252 [2:7556254682743777586:3793]
2025-10-01T14:07:21.739004Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:21.739020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:21.739023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.739027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.739029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.739045Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:21.739050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:21.739056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:21.739107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.739109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.739111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.739114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:21.739116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:21.739188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:21.739190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.739200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.739210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.739223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:21.739239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254682743777581:3793]
2025-10-01T14:07:21.739241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254682743777581:3793]
2025-10-01T14:07:21.739242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254682743777581:3793]
2025-10-01T14:07:21.739250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:21.739257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:21.739262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:21.739263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:21.739265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:21.739280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:21.739282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:21.739292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638345:2446], now have 1 active actors on pipe
2025-10-01T14:07:21.739327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254682743777581:3793]
2025-10-01T14:07:21.739333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:21.739338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:21.739366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 252
2025-10-01T14:07:21.750771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638426:4111], now have 1 active actors on pipe
2025-10-01T14:07:21.750932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.750946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.750979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:21.750991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.750997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.751001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:21.751013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.751030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:21.751050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.751262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.751270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.751286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.751770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2fe148c-8d2e0538-3e10f44e-4e490fcb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:21.754580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0] Write session: try to update token
2025-10-01T14:07:21.754605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:21.750053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254685120638389:4111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:21.750072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254685120638389:4111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:21.750076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254685120638389:4111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:21.750086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:21.750813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 252
2025-10-01T14:07:21.751383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 253 partition: 0 MaxSeqNo: 45 sessionId: src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0
2025-10-01T14:07:21.791120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:21.791140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:21.791143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:21.791145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:21.791155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254682743777581:3793]
2025-10-01T14:07:21.791161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254682743777581:3793]
2025-10-01T14:07:21.791164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254682743777581:3793]
2025-10-01T14:07:21.791204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:21.791211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:21.791214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:21.791217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.791218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:21.791222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:21.791353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:21.799669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 253 sessionId: src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:21.802196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:21.813048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254685120638431:3772]
2025-10-01T14:07:21.813325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 252, pipe: [1:7556254685120638431:3772]
E1001 14:07:21.941048523  115396 chttp2_transport.cc:1143]             ipv4:127.0.0.1:28606: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-10-01T14:07:21.942130Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): Too many pings } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:07:21.946972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:21.947338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.947349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.947396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638431:3772], now have 1 active actors on pipe
2025-10-01T14:07:21.947657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:21.949028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:21.949040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0] Write session will restart in 0.007012s
2025-10-01T14:07:21.949067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0] Write session: Do CDS request
2025-10-01T14:07:21.949074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:21.948625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:21.948716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 253 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0
2025-10-01T14:07:21.948897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 253 sessionId: src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0 is DEAD
2025-10-01T14:07:21.949017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:21.949053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254685120638431:3772]
2025-10-01T14:07:21.956883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:21.961036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:21.961054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 254
2025-10-01T14:07:21.961245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:21.961279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:21.961286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:21.961289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:21.961654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 254 sessionId:  describe result for acl check
2025-10-01T14:07:21.961679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:21.961681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:21.961682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:21.961687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254685120638477:4115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:21.962176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254685120638477:4115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:21.962242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:21.964046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:21.964264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:21.964275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:21.964288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:21.964345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:21.964385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254682743777679:3796]
2025-10-01T14:07:21.964946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:21.965253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:21.965297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:21.965609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:21.965668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.965674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.965675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.965676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.965677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.965678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.965679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.965680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.965681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.965682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.965683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.965685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.965686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.965687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.965692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.965702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.965706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.965711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.965715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.965719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.965723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.965727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.965731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.965736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.965740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.965743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.965747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.965751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.965757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.965766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:21.965772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.965778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:21.965787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.965792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:21.965796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.965802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:21.965807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.965816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:21.965821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.965831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:21.965836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.965844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:21.965849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.965854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:21.965865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.965870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:21.965879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.965885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.965893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.965898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.965903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.965908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.965912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.965918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:21.965926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.965931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:21.965971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:21.970545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:21.970615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254685120638477:4115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:21.971183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:21.971198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:21.971201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:21.971204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:21.971214Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 253 [2:7556254682743777679:3796]
2025-10-01T14:07:21.971232Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:21.971249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:21.971259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.971264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.971266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.971281Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:21.971287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:21.971294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:21.971347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.971349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.971351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.971354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:21.971356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:21.971426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:21.971428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:21.971440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:21.971451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:21.971467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:21.971483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254682743777674:3796]
2025-10-01T14:07:21.971485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254682743777674:3796]
2025-10-01T14:07:21.971486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254682743777674:3796]
2025-10-01T14:07:21.971500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:21.971513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:21.971526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:21.971529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:21.971542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:21.971545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:21.971547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:21.971558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254682743777674:3796]
2025-10-01T14:07:21.971560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:21.971617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:21.971839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 253
2025-10-01T14:07:21.971893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638434:2446], now have 1 active actors on pipe
2025-10-01T14:07:21.979286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254685120638477:4115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:21.979302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254685120638477:4115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:21.979304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254685120638477:4115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:21.979313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:21.980194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 253
2025-10-01T14:07:21.980994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 254 partition: 0 MaxSeqNo: 45 sessionId: src_id|32d25b99-d616f235-bfc5431f-302a8218_0
2025-10-01T14:07:21.980025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254685120638531:4115], now have 1 active actors on pipe
2025-10-01T14:07:21.980295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.980303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.980331Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32d25b99-d616f235-bfc5431f-302a8218_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:21.980342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:21.980348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:21.980350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:21.980362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:21.980377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:21.980399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.980577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:21.980584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:21.980605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:21.981347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d31e61d-7fc1f9ee-39094071-cd5c1ccc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|32d25b99-d616f235-bfc5431f-302a8218_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:21.983839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32d25b99-d616f235-bfc5431f-302a8218_0] Write session: try to update token
2025-10-01T14:07:21.983857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32d25b99-d616f235-bfc5431f-302a8218_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:22.001109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:22.001128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:22.001130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:22.001132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:22.001142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254682743777674:3796]
2025-10-01T14:07:22.001146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254682743777674:3796]
2025-10-01T14:07:22.001151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254682743777674:3796]
2025-10-01T14:07:22.001190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:22.001194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:22.001197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:22.001198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:22.001206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.001209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:22.001349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:22.015753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 254 sessionId: src_id|32d25b99-d616f235-bfc5431f-302a8218_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:22.018519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:22.054721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254689415605862:3772]
2025-10-01T14:07:22.055775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 253, pipe: [1:7556254689415605862:3772]
2025-10-01T14:07:22.169505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:22.170149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.170166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.170209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415605862:3772], now have 1 active actors on pipe
2025-10-01T14:07:22.173919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:22.173788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:22.173806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:22.173868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 254 reason: error at write: Disconnected sessionId: src_id|32d25b99-d616f235-bfc5431f-302a8218_0
2025-10-01T14:07:22.174070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 254 sessionId: src_id|32d25b99-d616f235-bfc5431f-302a8218_0 is DEAD
2025-10-01T14:07:22.174199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:22.174327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254689415605862:3772]
2025-10-01T14:07:22.175558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d25b99-d616f235-bfc5431f-302a8218_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 194 BytesWritten: 85606466 MessagesWritten: 38 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-01T14:07:22.175590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d25b99-d616f235-bfc5431f-302a8218_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:22.175594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d25b99-d616f235-bfc5431f-302a8218_0] Write session will restart in 0.005240s
2025-10-01T14:07:22.175620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d25b99-d616f235-bfc5431f-302a8218_0] Write session: Do CDS request
2025-10-01T14:07:22.175627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d25b99-d616f235-bfc5431f-302a8218_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:22.182601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32d25b99-d616f235-bfc5431f-302a8218_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:22.186739Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:22.186757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 255
2025-10-01T14:07:22.190088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:22.190148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:22.190157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:22.190163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:22.191416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 255 sessionId:  describe result for acl check
2025-10-01T14:07:22.191460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:22.191461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:22.191463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:22.191468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254689415605914:4136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:22.191958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254689415605914:4136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:22.200173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:22.205521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:22.205795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:22.205799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:22.205814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:22.205875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:22.205909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254687038745091:3806]
2025-10-01T14:07:22.206534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:22.207116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254689415605914:4136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:22.206968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:22.207017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:22.207350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:22.207413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.207415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.207416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.207417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.207418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.207420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.207421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.207422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.207424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.207425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.207426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.207428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.207429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.207430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.207438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.207449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.207453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.207458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.207462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.207467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.207471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.207475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.207480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.207484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.207488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.207492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.207496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.207500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.207507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.207515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.207522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.207527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.207532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.207537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.207541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.207546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.207552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.207558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.207564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.207569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.207574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.207580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.207585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.207591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.207595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.207601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.207605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.207610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.207614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.207619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.207622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.207626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.207629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.207634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.207638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.207642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.207677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:22.213666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:22.214299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:22.214306Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:22.214308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:22.214312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:22.214320Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 254 [2:7556254687038745091:3806]
2025-10-01T14:07:22.214339Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:22.214355Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:22.214358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.214362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.214364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.214399Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:22.214405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:22.214410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:22.214467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.214469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.214470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.214473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:22.214475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:22.214545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:22.214547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.214557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.214566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.214580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:22.214596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254687038745085:3806]
2025-10-01T14:07:22.214598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254687038745085:3806]
2025-10-01T14:07:22.214600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254687038745085:3806]
2025-10-01T14:07:22.214613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:22.214626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:22.214642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:22.214644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:22.214682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254687038745085:3806]
2025-10-01T14:07:22.214684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:22.214985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:22.214990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:22.214991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:22.214997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:22.215795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 254
2025-10-01T14:07:22.216146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415605872:2446], now have 1 active actors on pipe
2025-10-01T14:07:22.225735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254689415605914:4136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:22.225751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254689415605914:4136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:22.225755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254689415605914:4136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:22.225763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:22.228871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415605959:4136], now have 1 active actors on pipe
2025-10-01T14:07:22.229475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 254
2025-10-01T14:07:22.232061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.232089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.232124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc41defb-5262862f-c05d892e-d295ec1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:22.232136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.232142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.232144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:22.232158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.232176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:22.232200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:22.236024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.236044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.236079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:22.238636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 255 partition: 0 MaxSeqNo: 45 sessionId: src_id|bc41defb-5262862f-c05d892e-d295ec1f_0
2025-10-01T14:07:22.242730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32d25b99-d616f235-bfc5431f-302a8218_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bc41defb-5262862f-c05d892e-d295ec1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:22.245155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc41defb-5262862f-c05d892e-d295ec1f_0] Write session: try to update token
2025-10-01T14:07:22.245178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc41defb-5262862f-c05d892e-d295ec1f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:22.267395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:22.267416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:22.267420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:22.267422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:22.267434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254687038745085:3806]
2025-10-01T14:07:22.267439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254687038745085:3806]
2025-10-01T14:07:22.267444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254687038745085:3806]
2025-10-01T14:07:22.267496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:22.267505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.267509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:22.267671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:22.273234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:22.273256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:22.273260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:22.270257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 255 sessionId: src_id|bc41defb-5262862f-c05d892e-d295ec1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:22.273006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:22.274471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254689415605963:3772]
2025-10-01T14:07:22.278079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 254, pipe: [1:7556254689415605963:3772]
2025-10-01T14:07:22.493878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:22.494266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.494280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.494302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415605963:3772], now have 1 active actors on pipe
2025-10-01T14:07:22.494572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:22.494617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:22.494621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:22.494628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254689415605963:3772]
2025-10-01T14:07:22.494687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 255 reason: error at write: Disconnected sessionId: src_id|bc41defb-5262862f-c05d892e-d295ec1f_0
2025-10-01T14:07:22.494906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 255 sessionId: src_id|bc41defb-5262862f-c05d892e-d295ec1f_0 is DEAD
2025-10-01T14:07:22.494550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:22.495253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc41defb-5262862f-c05d892e-d295ec1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:22.495265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc41defb-5262862f-c05d892e-d295ec1f_0] Write session will restart in 0.006114s
2025-10-01T14:07:22.495293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc41defb-5262862f-c05d892e-d295ec1f_0] Write session: Do CDS request
2025-10-01T14:07:22.495299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc41defb-5262862f-c05d892e-d295ec1f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:22.502890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc41defb-5262862f-c05d892e-d295ec1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:22.503228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:22.503244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 256
2025-10-01T14:07:22.503191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:22.503542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:22.503598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:22.503607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:22.503611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:22.504023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 256 sessionId:  describe result for acl check
2025-10-01T14:07:22.504059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:22.504065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:22.504074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:22.504080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254689415606007:4140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:22.504590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254689415606007:4140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:22.504732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:22.504967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:22.504971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:22.504982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:22.505036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:22.505080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254687038745175:3813]
2025-10-01T14:07:22.505709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:22.506459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:22.506513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:22.506875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:22.506933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.506934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.506935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.506936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.506937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.506938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.506940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.506941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.506944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.506945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.506946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.506947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.506948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.506950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.506956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.506964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.506967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.506971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.506975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.506979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.506983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.506987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.506990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.506995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.506999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.507003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.507007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.507012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.507019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.507027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.507033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.507039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.507045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.507050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.507053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.507058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.507062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.507068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.507082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.507089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.507094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.507099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.507106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.507110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.507115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.507120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.507124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.507129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.507135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.507140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.507144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.507149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.507154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.507159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.507163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.507168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.507203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:22.507462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254689415606007:4140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:22.511404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254689415606007:4140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:22.511421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254689415606007:4140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:22.511427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254689415606007:4140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:22.511437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:22.511795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:22.512456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:22.512469Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:22.512471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:22.512474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:22.512480Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 255 [2:7556254687038745175:3813]
2025-10-01T14:07:22.512491Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:22.512506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:22.512511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.512513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.512515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.512529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:22.512541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:22.512547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:22.512608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.512618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.512620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.512623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:22.512626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:22.512679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:22.512684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.512693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.512702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.512714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:22.512731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415606046:4140], now have 1 active actors on pipe
2025-10-01T14:07:22.512734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415605966:2446], now have 1 active actors on pipe
2025-10-01T14:07:22.512739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254687038745170:3813]
2025-10-01T14:07:22.512745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254687038745170:3813]
2025-10-01T14:07:22.512746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254687038745170:3813]
2025-10-01T14:07:22.512755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:22.512765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:22.512787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 255
2025-10-01T14:07:22.512816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 255
2025-10-01T14:07:22.512773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:22.512774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:22.512776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:22.512780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:22.512782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:22.512836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254687038745170:3813]
2025-10-01T14:07:22.512844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:22.512851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:22.512987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.513001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.513041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|793a76c2-e1271338-fdd74202-176c7ef9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:22.513055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.513059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.513061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:22.513070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.513088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:22.513104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:22.513257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.513265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.513287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:22.513393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 256 partition: 0 MaxSeqNo: 45 sessionId: src_id|793a76c2-e1271338-fdd74202-176c7ef9_0
2025-10-01T14:07:22.513784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc41defb-5262862f-c05d892e-d295ec1f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|793a76c2-e1271338-fdd74202-176c7ef9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:22.516296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793a76c2-e1271338-fdd74202-176c7ef9_0] Write session: try to update token
2025-10-01T14:07:22.516316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793a76c2-e1271338-fdd74202-176c7ef9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:22.546485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 256 sessionId: src_id|793a76c2-e1271338-fdd74202-176c7ef9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:22.549116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:22.546629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:22.546649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:22.546651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:22.546653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:22.546663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254687038745170:3813]
2025-10-01T14:07:22.546668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254687038745170:3813]
2025-10-01T14:07:22.546672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254687038745170:3813]
2025-10-01T14:07:22.546731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:22.546734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:22.546738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:22.546741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.546742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:22.546746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:22.546906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:22.594360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254689415606056:3772]
2025-10-01T14:07:22.595187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 255, pipe: [1:7556254689415606056:3772]
2025-10-01T14:07:22.719905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:22.720210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.720220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.720265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415606056:3772], now have 1 active actors on pipe
2025-10-01T14:07:22.720547Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:22.721311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793a76c2-e1271338-fdd74202-176c7ef9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:22.721319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793a76c2-e1271338-fdd74202-176c7ef9_0] Write session will restart in 0.008977s
2025-10-01T14:07:22.721346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793a76c2-e1271338-fdd74202-176c7ef9_0] Write session: Do CDS request
2025-10-01T14:07:22.721352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793a76c2-e1271338-fdd74202-176c7ef9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:22.720928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:22.721005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 256 reason: status is not ok: tablet will be restarted right now sessionId: src_id|793a76c2-e1271338-fdd74202-176c7ef9_0
2025-10-01T14:07:22.721168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 256 sessionId: src_id|793a76c2-e1271338-fdd74202-176c7ef9_0 is DEAD
2025-10-01T14:07:22.721382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254689415606056:3772]
2025-10-01T14:07:22.721396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:22.734925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|793a76c2-e1271338-fdd74202-176c7ef9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:22.736803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:22.736817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 257
2025-10-01T14:07:22.736948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:22.736988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:22.736997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:22.737000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:22.737407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 257 sessionId:  describe result for acl check
2025-10-01T14:07:22.737441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:22.737447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:22.737448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:22.737455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254689415606099:4145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:22.737911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254689415606099:4145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:22.739891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254689415606099:4145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:22.745114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:22.744782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254689415606099:4145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:22.744808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254689415606099:4145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:22.744812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254689415606099:4145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:22.744829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:22.747660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:22.747922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:22.747927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:22.747940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:22.748000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:22.748035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254687038745262:3816]
2025-10-01T14:07:22.748669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:22.749008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:22.749065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:22.749359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:22.749419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.749420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.749421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.749422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.749423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.749424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.749425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.749426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.749427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.749428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.749429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.749430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.749432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.749433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.749440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.749449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.749453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.749456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.749459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.749462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.749464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.749468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.749471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.749476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.749479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.749482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.749485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.749489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.749495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.749502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.749508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.749512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.749516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.749521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.749524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.749530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.749534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.749538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.749542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.749547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.749552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.749556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.749560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.749564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.749569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.749577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.749580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.749585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.749589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.749593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.749597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.749602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.749606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.749610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.749614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.749618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.749655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:22.754199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:22.756554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 256
2025-10-01T14:07:22.756588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 256
2025-10-01T14:07:22.757053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 257 partition: 0 MaxSeqNo: 45 sessionId: src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0
2025-10-01T14:07:22.757460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|793a76c2-e1271338-fdd74202-176c7ef9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:22.754895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:22.754910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:22.754916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:22.754921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:22.754928Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 256 [2:7556254687038745262:3816]
2025-10-01T14:07:22.754946Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:22.754965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:22.754968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.754972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.754974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.754993Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:22.755000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:22.755007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:22.755072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.755073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.755075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.755079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:22.755081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:22.755153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:22.755155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.755166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.755177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.755193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:22.755210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254687038745255:3816]
2025-10-01T14:07:22.755212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254687038745255:3816]
2025-10-01T14:07:22.755214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254687038745255:3816]
2025-10-01T14:07:22.755230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:22.755243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:22.755257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:22.755260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:22.755295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254687038745255:3816]
2025-10-01T14:07:22.755297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:22.756395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:22.756398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:22.756400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:22.756406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:22.756418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415606134:4145], now have 1 active actors on pipe
2025-10-01T14:07:22.756425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415606059:2446], now have 1 active actors on pipe
2025-10-01T14:07:22.756634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.756641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.756673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:22.756682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.756686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.756689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:22.756700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.756715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:22.756736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:22.756929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.756934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.756954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:22.759970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0] Write session: try to update token
2025-10-01T14:07:22.759990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:22.780356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 257 sessionId: src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:22.780955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:22.780977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:22.780980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:22.780982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:22.780991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254687038745255:3816]
2025-10-01T14:07:22.780995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254687038745255:3816]
2025-10-01T14:07:22.780999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254687038745255:3816]
2025-10-01T14:07:22.781052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:22.781051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:22.781058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:22.781065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.781067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:22.781070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:22.781207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:22.783053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:22.821623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254689415606148:3772]
2025-10-01T14:07:22.822085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 256, pipe: [1:7556254689415606148:3772]
2025-10-01T14:07:22.942472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:22.942853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.942869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.942911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415606148:3772], now have 1 active actors on pipe
2025-10-01T14:07:22.943582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254689415606148:3772]
2025-10-01T14:07:22.943607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:22.943638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:22.943642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:22.943695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 257 reason: error at write: Disconnected sessionId: src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0
2025-10-01T14:07:22.943874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 257 sessionId: src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0 is DEAD
2025-10-01T14:07:22.944981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:22.944992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0] Write session will restart in 0.008686s
2025-10-01T14:07:22.945018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0] Write session: Do CDS request
2025-10-01T14:07:22.945027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:22.944786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:22.954881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:22.955257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:22.955270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 258
2025-10-01T14:07:22.955565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:22.955606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:22.955612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:22.955615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:22.956013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 258 sessionId:  describe result for acl check
2025-10-01T14:07:22.956048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:22.956054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:22.956056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:22.956062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254689415606187:4149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:22.956593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254689415606187:4149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:22.964544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:22.964951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254689415606187:4149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:22.966986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:22.967223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:22.967234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:22.967246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:22.967307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:22.967346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254687038745357:3819]
2025-10-01T14:07:22.968052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:22.969111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:22.969174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:22.969521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:22.969597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.969604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.969605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.969606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.969607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.969608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.969609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.969610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.969611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.969612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.969613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.969614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.969615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.969616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.969622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.969632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.969636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.969639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.969643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.969647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.969650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.969654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.969657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.969661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.969664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.969667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.969671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.969674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.969681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.969688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:22.969696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.969702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:22.969706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.969710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:22.969715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.969720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:22.969725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.969730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:22.969737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.969742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:22.969747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.969751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:22.969755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.969759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:22.969763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.969768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:22.969771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.969775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.969779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.969784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.969789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.969795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.969804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.969808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:22.969812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.969815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:22.969857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:22.970844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254689415606187:4149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:22.970861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254689415606187:4149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:22.970865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254689415606187:4149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:22.970875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:22.976519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 257
2025-10-01T14:07:22.976557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 257
2025-10-01T14:07:22.975519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:22.976148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:22.976153Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:22.976155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:22.976159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:22.976166Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 257 [2:7556254687038745357:3819]
2025-10-01T14:07:22.976182Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:22.976204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:22.976207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.976211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.976213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.976229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:22.976234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:22.976240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:22.976298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.976300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.976302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.976305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:22.976310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:22.976385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:22.976387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:22.976399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:22.976408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:22.976423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:22.976442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415606151:2446], now have 1 active actors on pipe
2025-10-01T14:07:22.976450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254687038745351:3819]
2025-10-01T14:07:22.976452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254687038745351:3819]
2025-10-01T14:07:22.976453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254687038745351:3819]
2025-10-01T14:07:22.976467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:22.976477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254689415606233:4149], now have 1 active actors on pipe
2025-10-01T14:07:22.976480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:22.976484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:22.976485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:22.976486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:22.976496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:22.976502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:22.976544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254687038745351:3819]
2025-10-01T14:07:22.976553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:22.976618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:22.976858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.976872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.976900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f30483c-38a23311-cf06e914-a132239f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:22.976915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:22.976923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:22.976926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:22.976936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:22.976947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:22.976966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:22.977171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:22.977186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:22.977206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:22.977291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 258 partition: 0 MaxSeqNo: 45 sessionId: src_id|6f30483c-38a23311-cf06e914-a132239f_0
2025-10-01T14:07:22.977696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d90f04-9681d4ef-f8af87f1-4628a3d0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6f30483c-38a23311-cf06e914-a132239f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:22.980233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f30483c-38a23311-cf06e914-a132239f_0] Write session: try to update token
2025-10-01T14:07:22.980252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f30483c-38a23311-cf06e914-a132239f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:23.008603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:23.008624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:23.008627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:23.008629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:23.008641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254687038745351:3819]
2025-10-01T14:07:23.008646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254687038745351:3819]
2025-10-01T14:07:23.008657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254687038745351:3819]
2025-10-01T14:07:23.008709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:23.008712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:23.008719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.008721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:23.008722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:23.008726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:23.008884Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:23.020564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 258 sessionId: src_id|6f30483c-38a23311-cf06e914-a132239f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:23.023162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:23.047021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254693710573562:3772]
2025-10-01T14:07:23.050486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 257, pipe: [1:7556254693710573562:3772]
2025-10-01T14:07:23.070754Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 2 CurrentSessionLifetimeMs: 61088 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:07:23.179462Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:23.179747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.179763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.179803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573562:3772], now have 1 active actors on pipe
2025-10-01T14:07:23.180319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:23.180334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:23.180392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 258 reason: error at write: Disconnected sessionId: src_id|6f30483c-38a23311-cf06e914-a132239f_0
2025-10-01T14:07:23.180551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:23.180553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 258 sessionId: src_id|6f30483c-38a23311-cf06e914-a132239f_0 is DEAD
2025-10-01T14:07:23.180742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f30483c-38a23311-cf06e914-a132239f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:23.180753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f30483c-38a23311-cf06e914-a132239f_0] Write session will restart in 0.005262s
2025-10-01T14:07:23.180778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f30483c-38a23311-cf06e914-a132239f_0] Write session: Do CDS request
2025-10-01T14:07:23.180784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f30483c-38a23311-cf06e914-a132239f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:23.180956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:23.180597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254693710573562:3772]
2025-10-01T14:07:23.186968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f30483c-38a23311-cf06e914-a132239f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:23.187309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:23.187326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 259
2025-10-01T14:07:23.190536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:23.190589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:23.190595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:23.190600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:23.191463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 259 sessionId:  describe result for acl check
2025-10-01T14:07:23.191501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:23.191503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:23.191505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:23.191510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254693710573594:4162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:23.192073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254693710573594:4162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:23.195481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254693710573594:4162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:23.207860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254693710573594:4162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:23.207877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254693710573594:4162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:23.207881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254693710573594:4162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:23.207892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:23.209287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:23.211604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:23.211933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:23.211937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:23.211951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:23.212013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:23.212052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254691333712757:3823]
2025-10-01T14:07:23.212635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:23.212952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:23.212999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:23.213400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:23.213465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.213470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.213471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.213472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.213474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.213475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.213476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.213477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.213478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.213479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.213481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.213482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.213483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.213484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.213490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.213501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.213506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.213511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.213515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.213519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.213523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.213527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.213532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.213536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.213540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.213545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.213549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.213552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.213560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.213568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.213579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.213586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.213594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.213600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.213608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.213613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.213631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.213642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.213647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.213652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.213657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.213662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.213666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.213670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.213673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.213676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.213680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.213683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.213687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.213690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.213692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.213695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.213698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.213701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.213703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.213706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.213727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:23.217634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:23.218256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:23.218270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:23.218273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:23.218276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:23.218282Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 258 [2:7556254691333712757:3823]
2025-10-01T14:07:23.218297Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:23.218313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:23.218316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.218320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.218323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.218338Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:23.218348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:23.218353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:23.218432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.218439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.218440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.218443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:23.218445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:23.218516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:23.218518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.218529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.218537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.218550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:23.218567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254691333712752:3823]
2025-10-01T14:07:23.218569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254691333712752:3823]
2025-10-01T14:07:23.218571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254691333712752:3823]
2025-10-01T14:07:23.218583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:23.218598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:23.218612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:23.218614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:23.218643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254691333712752:3823]
2025-10-01T14:07:23.218644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:23.218746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:23.218748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:23.218749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:23.218754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:23.219086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573656:4162], now have 1 active actors on pipe
2025-10-01T14:07:23.219095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573581:2446], now have 1 active actors on pipe
2025-10-01T14:07:23.219352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 258
2025-10-01T14:07:23.219378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 258
2025-10-01T14:07:23.219465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.219478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.219509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:23.219525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.219531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.219534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:23.219544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.219554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:23.219569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:23.219740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.219749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.219764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:23.219839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 259 partition: 0 MaxSeqNo: 45 sessionId: src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0
2025-10-01T14:07:23.220275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f30483c-38a23311-cf06e914-a132239f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:23.222809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0] Write session: try to update token
2025-10-01T14:07:23.222829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:23.243200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:23.243222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:23.243224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:23.243225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:23.243233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254691333712752:3823]
2025-10-01T14:07:23.243237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254691333712752:3823]
2025-10-01T14:07:23.243243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254691333712752:3823]
2025-10-01T14:07:23.243289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:23.243295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:23.243296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:23.243298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:23.243304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.243306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:23.245899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 259 sessionId: src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:23.243461Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:23.249329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:23.280802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254693710573674:3772]
2025-10-01T14:07:23.284353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 258, pipe: [1:7556254693710573674:3772]
2025-10-01T14:07:23.397329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:23.397668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.397750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.397796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573674:3772], now have 1 active actors on pipe
2025-10-01T14:07:23.398289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:23.398789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:23.398799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0] Write session will restart in 0.005470s
2025-10-01T14:07:23.398826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0] Write session: Do CDS request
2025-10-01T14:07:23.398833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:23.398338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:23.398350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:23.398425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 259 reason: error at write: Disconnected sessionId: src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0
2025-10-01T14:07:23.398616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 259 sessionId: src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0 is DEAD
2025-10-01T14:07:23.398761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:23.398794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254693710573674:3772]
2025-10-01T14:07:23.405993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:23.406119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:23.406135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 260
2025-10-01T14:07:23.406260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:23.406299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:23.406309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:23.406313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:23.406960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 260 sessionId:  describe result for acl check
2025-10-01T14:07:23.406996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:23.407002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:23.407004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:23.407008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254693710573683:4166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:23.407518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254693710573683:4166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:23.409719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254693710573683:4166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:23.413458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254693710573683:4166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:23.413484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254693710573683:4166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:23.413487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254693710573683:4166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:23.413495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:23.420369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:23.422550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:23.422787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:23.422792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:23.422805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:23.422859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:23.422895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254691333712861:3836]
2025-10-01T14:07:23.423479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:23.423783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:23.423816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:23.424109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:23.424148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.424153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.424153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.424154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.424155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.424156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.424156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.424157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.424158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.424158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.424159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.424160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.424160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.424161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.424164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.424171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.424173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.424175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.424177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.424179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.424181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.424183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.424186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.424188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.424190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.424193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.424195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.424197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.424202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.424207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.424211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.424214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.424216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.424219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.424222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.424225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.424227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.424230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.424233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.424236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.424238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.424241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.424244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.424247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.424249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.424252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.424255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.424258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.424260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.424263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.424266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.424269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.424272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.424275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.424278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.424281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.424304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:23.429939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:23.431063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:23.431068Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:23.431070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:23.431073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:23.431079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 259 [2:7556254691333712861:3836]
2025-10-01T14:07:23.431095Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:23.431110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:23.431113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.431117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.431119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.431136Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:23.431141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:23.431147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:23.431202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.431204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.431206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.431209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:23.431211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:23.431274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:23.431276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.431288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.431298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.431313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:23.431329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254691333712856:3836]
2025-10-01T14:07:23.431331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254691333712856:3836]
2025-10-01T14:07:23.431332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254691333712856:3836]
2025-10-01T14:07:23.431348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:23.431360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:23.431373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:23.431375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:23.431392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:23.431396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:23.431398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:23.431406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254691333712856:3836]
2025-10-01T14:07:23.431409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:23.431470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:23.431767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 259
2025-10-01T14:07:23.431809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 259
2025-10-01T14:07:23.433022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573753:4166], now have 1 active actors on pipe
2025-10-01T14:07:23.433045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573675:2446], now have 1 active actors on pipe
2025-10-01T14:07:23.433061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.433066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.433096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|573df784-4119d95d-c99a0451-a9ca590d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:23.433105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.433111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.433114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:23.433124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.433136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:23.433153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:23.434292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.434301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.434322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:23.436212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 260 partition: 0 MaxSeqNo: 45 sessionId: src_id|573df784-4119d95d-c99a0451-a9ca590d_0
2025-10-01T14:07:23.436620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f55a5cf-5fb52363-57f08bd0-fe6eb0a7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|573df784-4119d95d-c99a0451-a9ca590d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:23.439131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|573df784-4119d95d-c99a0451-a9ca590d_0] Write session: try to update token
2025-10-01T14:07:23.439152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|573df784-4119d95d-c99a0451-a9ca590d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:23.462978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 260 sessionId: src_id|573df784-4119d95d-c99a0451-a9ca590d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:23.465390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:23.466950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.466971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.469034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:23.469052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:23.469058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:23.469061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:23.469062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:23.469070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254691333712856:3836]
2025-10-01T14:07:23.469077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254691333712856:3836]
2025-10-01T14:07:23.469080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254691333712856:3836]
2025-10-01T14:07:23.469117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:23.469123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.469125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:23.469287Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:23.470548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:23.470554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:23.470558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:23.474424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:23.499066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254693710573769:3772]
2025-10-01T14:07:23.502601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 259, pipe: [1:7556254693710573769:3772]
2025-10-01T14:07:23.636107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:23.644346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.644373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.644538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.644601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.644661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.644729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.644775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.644785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.644867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.644925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.644986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.645048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.645387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.645399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.645465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.645520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.645580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.645642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.645685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.645694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.645758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.645815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.645873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.645930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.645976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.645986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.646046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.646099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.646155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.646212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.646253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.646259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.646329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.648217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:23.648231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:23.648254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 260 reason: error at write: Disconnected sessionId: src_id|573df784-4119d95d-c99a0451-a9ca590d_0
2025-10-01T14:07:23.648418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 260 sessionId: src_id|573df784-4119d95d-c99a0451-a9ca590d_0 is DEAD
2025-10-01T14:07:23.648524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254693710573769:3772]
2025-10-01T14:07:23.648540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:23.646410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.646481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.646546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.646590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.646592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.646665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.646729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.646824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.646896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.646943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.646946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.647022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.647090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.647153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.647217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.647266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.647268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.647335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.647390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.647448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.647505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.647545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.647547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.647614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:23.647667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:23.647725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:23.647783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:23.647820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:23.647823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:23.647889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573769:3772], now have 1 active actors on pipe
2025-10-01T14:07:23.648734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:23.650484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573df784-4119d95d-c99a0451-a9ca590d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:23.650495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573df784-4119d95d-c99a0451-a9ca590d_0] Write session will restart in 0.008452s
2025-10-01T14:07:23.650519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573df784-4119d95d-c99a0451-a9ca590d_0] Write session: Do CDS request
2025-10-01T14:07:23.650525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573df784-4119d95d-c99a0451-a9ca590d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:23.656150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:23.657830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:23.658063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:23.658077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:23.658090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:23.658158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:23.658212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254691333712949:3839]
2025-10-01T14:07:23.658879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:23.659227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:23.659282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:23.659628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:23.659716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.659725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.659726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.659727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.659728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.659728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.659729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.659730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.659731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.659732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.659734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.659735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.659736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.659737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.659743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.659752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.659756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.659759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.659762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.659765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.659768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.659771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.659775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.659779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.659782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.659785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.659788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.659791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.659801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.659809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.659816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.659821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.659827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.659831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.659835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.659839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.659843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.659847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.659851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.659855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.659860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.659864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.659868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.659880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.659880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|573df784-4119d95d-c99a0451-a9ca590d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:23.659884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.659895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.659899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.659903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.659912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.659917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.659921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.659930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.659934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.659942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.659946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.659956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.659990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:23.659952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:23.659968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 261
2025-10-01T14:07:23.660108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:23.660151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:23.660165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:23.660170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:23.660541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 261 sessionId:  describe result for acl check
2025-10-01T14:07:23.660585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:23.660595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:23.660598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:23.660603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254693710573825:4171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:23.661180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254693710573825:4171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:23.663794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254693710573825:4171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:23.664346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:23.665099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:23.665117Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:23.665120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:23.665123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:23.665130Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 260 [2:7556254691333712949:3839]
2025-10-01T14:07:23.665146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:23.665161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:23.665171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.665175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.665177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.665194Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:23.665199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:23.665205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:23.665269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.665275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.665278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.665282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:23.665284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:23.665343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:23.665350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.665362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.665378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.665394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:23.665410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254691333712944:3839]
2025-10-01T14:07:23.665412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254691333712944:3839]
2025-10-01T14:07:23.665414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254691333712944:3839]
2025-10-01T14:07:23.665425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:23.665439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:23.665454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:23.665457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:23.665489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254691333712944:3839]
2025-10-01T14:07:23.665496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:23.665595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:23.665602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:23.665604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:23.665609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:23.665712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573774:2446], now have 1 active actors on pipe
2025-10-01T14:07:23.665762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 260
2025-10-01T14:07:23.669914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573862:4171], now have 1 active actors on pipe
2025-10-01T14:07:23.670064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.670075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.670102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49c63221-3a45b10-c0693108-25574245_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:23.670112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.670117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.670121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:23.670133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.670148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:23.670165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:23.670439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.670449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.670465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:23.670947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|573df784-4119d95d-c99a0451-a9ca590d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|49c63221-3a45b10-c0693108-25574245_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:23.669302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254693710573825:4171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:23.669317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254693710573825:4171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:23.669320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254693710573825:4171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:23.669329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:23.669925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 260
2025-10-01T14:07:23.670617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 261 partition: 0 MaxSeqNo: 45 sessionId: src_id|49c63221-3a45b10-c0693108-25574245_0
2025-10-01T14:07:23.673436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49c63221-3a45b10-c0693108-25574245_0] Write session: try to update token
2025-10-01T14:07:23.673452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49c63221-3a45b10-c0693108-25574245_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:23.689051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:23.689074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:23.689077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:23.689079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:23.689090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254691333712944:3839]
2025-10-01T14:07:23.689094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254691333712944:3839]
2025-10-01T14:07:23.689108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254691333712944:3839]
2025-10-01T14:07:23.689163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:23.689175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.689180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:23.689319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:23.690426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:23.690434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:23.690439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:23.698426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 261 sessionId: src_id|49c63221-3a45b10-c0693108-25574245_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:23.700925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:23.748844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254693710573866:3772]
2025-10-01T14:07:23.750783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 260, pipe: [1:7556254693710573866:3772]
2025-10-01T14:07:23.872190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:23.872554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.872570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.872593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573866:3772], now have 1 active actors on pipe
2025-10-01T14:07:23.873158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254693710573866:3772]
2025-10-01T14:07:23.873194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:23.873202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:23.873263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 261 reason: error at write: Disconnected sessionId: src_id|49c63221-3a45b10-c0693108-25574245_0
2025-10-01T14:07:23.873314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:23.873447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 261 sessionId: src_id|49c63221-3a45b10-c0693108-25574245_0 is DEAD
2025-10-01T14:07:23.873909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c63221-3a45b10-c0693108-25574245_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:23.873918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c63221-3a45b10-c0693108-25574245_0] Write session will restart in 0.005241s
2025-10-01T14:07:23.873946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c63221-3a45b10-c0693108-25574245_0] Write session: Do CDS request
2025-10-01T14:07:23.873958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c63221-3a45b10-c0693108-25574245_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:23.873779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:23.880115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49c63221-3a45b10-c0693108-25574245_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:23.882733Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:23.882748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 262
2025-10-01T14:07:23.882950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:23.882982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:23.882988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:23.882992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:23.883437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 262 sessionId:  describe result for acl check
2025-10-01T14:07:23.883472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:23.883474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:23.883476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:23.883482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254693710573876:4175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:23.884024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254693710573876:4175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:23.889774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254693710573876:4175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:23.897354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254693710573876:4175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:23.897370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254693710573876:4175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:23.897373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254693710573876:4175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:23.897382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:23.902283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:23.905686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:23.905943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:23.905947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:23.905960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:23.906017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:23.906056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254691333713038:3841]
2025-10-01T14:07:23.906813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:23.907379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:23.907445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:23.907829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:23.907891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.907897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.907898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.907899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.907901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.907902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.907904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.907905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.907906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.907908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.907909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.907910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.907911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.907912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.907918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.907929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.907933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.907937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.907941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.907945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.907949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.907953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.907957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.907962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.907966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.907971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.907975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.907979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.907986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.907994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:23.908002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.908009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:23.908014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.908020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:23.908024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.908030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:23.908035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.908041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:23.908046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.908052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:23.908057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.908062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:23.908067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.908072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:23.908077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.908082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:23.908087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.908093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.908098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.908103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.908108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.908114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.908118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.908123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:23.908129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.908135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:23.908179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:23.917649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:23.918309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:23.918315Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:23.918318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:23.918322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:23.918331Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 261 [2:7556254691333713038:3841]
2025-10-01T14:07:23.918348Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:23.918390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:23.918394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.918397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.918400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.918416Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:23.918425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:23.918431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:23.918491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.918493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.918495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.918498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:23.918501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:23.918583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:23.918586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.918599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:23.918611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:23.918629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:23.918647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254691333713032:3841]
2025-10-01T14:07:23.918649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254691333713032:3841]
2025-10-01T14:07:23.918651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254691333713032:3841]
2025-10-01T14:07:23.918665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:23.918680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:23.918696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:23.918702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:23.918753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254691333713032:3841]
2025-10-01T14:07:23.918756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:23.919014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:23.919021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:23.919024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:23.919030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:23.919758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 261
2025-10-01T14:07:23.919798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 261
2025-10-01T14:07:23.920605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573869:2446], now have 1 active actors on pipe
2025-10-01T14:07:23.920624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573951:4175], now have 1 active actors on pipe
2025-10-01T14:07:23.920647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.920653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.920687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:23.920701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:23.920710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:23.920714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:23.920730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:23.920748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:23.920768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:23.920978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:23.920988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:23.921004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:23.921126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 262 partition: 0 MaxSeqNo: 45 sessionId: src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0
2025-10-01T14:07:23.921508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49c63221-3a45b10-c0693108-25574245_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:23.923991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0] Write session: try to update token
2025-10-01T14:07:23.924008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:23.945785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:23.945808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:23.945811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:23.945813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:23.945823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254691333713032:3841]
2025-10-01T14:07:23.945828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254691333713032:3841]
2025-10-01T14:07:23.945834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254691333713032:3841]
2025-10-01T14:07:23.945886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:23.945889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:23.945897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:23.945898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:23.945899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:23.945903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:23.946059Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:23.955427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 262 sessionId: src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:23.958116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:23.974328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254693710573964:3772]
2025-10-01T14:07:23.974723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 261, pipe: [1:7556254693710573964:3772]
2025-10-01T14:07:24.120297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:24.120753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.120763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.120784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254693710573964:3772], now have 1 active actors on pipe
2025-10-01T14:07:24.121057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:24.121453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:24.121463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0] Write session will restart in 0.005866s
2025-10-01T14:07:24.121487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0] Write session: Do CDS request
2025-10-01T14:07:24.121494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:24.121032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254693710573964:3772]
2025-10-01T14:07:24.121067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:24.121069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:24.121128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 262 reason: error at write: Disconnected sessionId: src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0
2025-10-01T14:07:24.121312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 262 sessionId: src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0 is DEAD
2025-10-01T14:07:24.121464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:24.128941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:24.129027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:24.129038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 263
2025-10-01T14:07:24.129191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:24.129228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:24.129237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:24.129240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:24.129774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 263 sessionId:  describe result for acl check
2025-10-01T14:07:24.129804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:24.129809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:24.129810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:24.129814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254698005541346:4187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:24.130239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254698005541346:4187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:24.130517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:24.131619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254698005541346:4187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:24.132368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:24.132542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:24.132552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:24.132564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:24.132629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:24.132667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254695628680440:3844]
2025-10-01T14:07:24.133265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:24.133535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:24.133585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:24.133903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:24.133962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.133957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254698005541346:4187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:24.133968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.133970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254698005541346:4187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:24.133969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.133973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254698005541346:4187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:24.133970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.133980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:24.133973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.133974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.133975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.133976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.133977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.133977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.133978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.133979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.133980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.133981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.133986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.133996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.133999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.134003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.134007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.134011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.134014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.134018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.134021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.134025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.134029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.134032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.134036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.134039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.134045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.134052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.134057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.134064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.134067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.134072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.134077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.134083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.134088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.134099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.134102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.134108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.134111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.134117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.134121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.134131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.134136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.134141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.134149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.134153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.134158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.134162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.134166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.134171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.134177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.134182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.134185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.134190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.134229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:24.137764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:24.138365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:24.138410Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:24.138412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:24.138415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:24.138421Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 262 [2:7556254695628680440:3844]
2025-10-01T14:07:24.138436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:24.138451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:24.138456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.138459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.138464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.138478Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:24.138485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:24.138491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:24.138539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.138547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.138549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.138552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:24.138554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:24.138615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:24.138623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.138633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.138644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.138659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:24.138682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541386:4187], now have 1 active actors on pipe
2025-10-01T14:07:24.138690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541288:2446], now have 1 active actors on pipe
2025-10-01T14:07:24.138698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254695628680434:3844]
2025-10-01T14:07:24.138700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254695628680434:3844]
2025-10-01T14:07:24.138702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254695628680434:3844]
2025-10-01T14:07:24.138714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:24.138729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:24.138730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:24.138732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:24.138735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:24.138749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:24.138752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:24.138746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 262
2025-10-01T14:07:24.138773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254695628680434:3844]
2025-10-01T14:07:24.138780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:24.138782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:24.138799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.138808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.138793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 262
2025-10-01T14:07:24.138852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:24.138864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.138869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.138870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:24.138878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.138886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:24.138906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:24.139032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.139039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.139053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:24.139124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 263 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0
2025-10-01T14:07:24.139457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950aa17-4024fd26-33a54b3c-4d21b13f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:24.141884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0] Write session: try to update token
2025-10-01T14:07:24.141902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:24.171951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:24.171989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:24.171992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:24.171994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:24.172004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254695628680434:3844]
2025-10-01T14:07:24.172010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254695628680434:3844]
2025-10-01T14:07:24.172015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254695628680434:3844]
2025-10-01T14:07:24.172071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:24.172085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:24.172089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:24.172100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:24.172115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.172122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:24.172268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:24.176044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 263 sessionId: src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:24.178492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:24.222599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254698005541400:3772]
2025-10-01T14:07:24.223122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 262, pipe: [1:7556254698005541400:3772]
2025-10-01T14:07:24.338626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:24.339094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.339112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.339156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541400:3772], now have 1 active actors on pipe
2025-10-01T14:07:24.339466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:24.339492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254698005541400:3772]
2025-10-01T14:07:24.339518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:24.339520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:24.339567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:24.339584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 263 reason: error at write: Disconnected sessionId: src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0
2025-10-01T14:07:24.339816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 263 sessionId: src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0 is DEAD
2025-10-01T14:07:24.340275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:24.340288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0] Write session will restart in 0.007310s
2025-10-01T14:07:24.340395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0] Write session: Do CDS request
2025-10-01T14:07:24.340408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:24.350388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:24.350504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:24.350520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 264
2025-10-01T14:07:24.350742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:24.350788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:24.350798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:24.350803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:24.351254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 264 sessionId:  describe result for acl check
2025-10-01T14:07:24.351286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:24.351288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:24.351291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:24.351306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254698005541454:4192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:24.351890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254698005541454:4192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:24.352747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:24.354007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254698005541454:4192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:24.356442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:24.356650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:24.356660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:24.356672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:24.356719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:24.356774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254695628680561:3859]
2025-10-01T14:07:24.357389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:24.357690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:24.357728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:24.358040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:24.358087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.358092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.358095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.358096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.358097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.358098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.358099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.358101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.358102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.358103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.358104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.358105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.358106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.358107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.358112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.358122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.358126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.358129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.358133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.358137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.358140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.358144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.358148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.358152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.358156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.358159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.358163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.358167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.358174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.358190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.358200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.358205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.358216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.358222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.358226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.358231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.358235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.358240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.358243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.358247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.358252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.358257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.358261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.358266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.358270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.358275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.358279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.358284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.358288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.358293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.358298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.358302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.358306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.358311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.358315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.358320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.358366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:24.358461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254698005541454:4192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:24.358477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254698005541454:4192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:24.358480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254698005541454:4192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:24.358489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:24.363213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:24.363845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:24.363861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:24.363864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:24.363871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:24.363878Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 263 [2:7556254695628680561:3859]
2025-10-01T14:07:24.363896Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:24.363915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:24.363927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.363931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.363933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.363950Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:24.363961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:24.363967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:24.364032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.364039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.364041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.364044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:24.364047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:24.364121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:24.364128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.364141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.364157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.364179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:24.364204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541490:4192], now have 1 active actors on pipe
2025-10-01T14:07:24.364207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541406:2446], now have 1 active actors on pipe
2025-10-01T14:07:24.364215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254695628680556:3859]
2025-10-01T14:07:24.364217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254695628680556:3859]
2025-10-01T14:07:24.364220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254695628680556:3859]
2025-10-01T14:07:24.364233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:24.364247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:24.364247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:24.364251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:24.364253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:24.364262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:24.364265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:24.364307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254695628680556:3859]
2025-10-01T14:07:24.364316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:24.364331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:24.365154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 263
2025-10-01T14:07:24.365201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 263
2025-10-01T14:07:24.365501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.365516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.365547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:24.365556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.365561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.365563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:24.365575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.365587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:24.365615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:24.366977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.366991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.367013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:24.367793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 264 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0
2025-10-01T14:07:24.368807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad0a1210-98250e41-9e1d3d41-f37c3118_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:24.372020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0] Write session: try to update token
2025-10-01T14:07:24.372041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:24.391938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 264 sessionId: src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:24.393010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:24.393028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:24.393031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:24.393034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:24.393043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254695628680556:3859]
2025-10-01T14:07:24.393048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254695628680556:3859]
2025-10-01T14:07:24.393052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254695628680556:3859]
2025-10-01T14:07:24.393104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:24.393108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:24.393115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:24.393117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.393119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:24.393120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:24.393267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:24.394555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:24.439653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254698005541499:3772]
2025-10-01T14:07:24.439962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 263, pipe: [1:7556254698005541499:3772]
2025-10-01T14:07:24.552653Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:24.553075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.553085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.553128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541499:3772], now have 1 active actors on pipe
2025-10-01T14:07:24.553346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:24.553359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:24.553423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254698005541499:3772]
2025-10-01T14:07:24.553433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 264 reason: error at write: Disconnected sessionId: src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0
2025-10-01T14:07:24.553464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:24.553625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 264 sessionId: src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0 is DEAD
2025-10-01T14:07:24.553413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:24.553789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:24.553800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0] Write session will restart in 0.005673s
2025-10-01T14:07:24.553829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0] Write session: Do CDS request
2025-10-01T14:07:24.553835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:24.560957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:24.561012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:24.561026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 265
2025-10-01T14:07:24.561216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:24.561247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:24.561255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:24.561259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:24.562246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:24.561690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 265 sessionId:  describe result for acl check
2025-10-01T14:07:24.561724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:24.561725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:24.561727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:24.561732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254698005541552:4196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:24.562279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254698005541552:4196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:24.564452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:24.564648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:24.564652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:24.564664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:24.564715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:24.564750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254695628680650:3861]
2025-10-01T14:07:24.565193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:24.565251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254698005541552:4196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:24.565649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:24.565690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:24.565976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:24.566013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.566014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.566014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.566015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.566015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.566016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.566017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.566017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.566018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.566018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.566019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.566020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.566020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.566021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.566024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.566030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.566032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.566034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.566036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.566038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.566040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.566042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.566044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.566046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.566048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.566050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.566052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.566054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.566058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.566065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.566071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.566077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.566081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.566086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.566090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.566095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.566099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.566103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.566107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.566112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.566116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.566121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.566125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.566130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.566134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.566139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.566142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.566147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.566151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.566156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.566159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.566164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.566168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.566173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.566177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.566181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.566218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:24.569466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254698005541552:4196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:24.569478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254698005541552:4196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:24.569483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254698005541552:4196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:24.569492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:24.570754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:24.571378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:24.571384Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:24.571387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:24.571390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:24.571417Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 264 [2:7556254695628680650:3861]
2025-10-01T14:07:24.571431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:24.571449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:24.571451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.571454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.571456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.571472Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:24.571476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:24.571483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:24.571534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.571536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.571537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.571541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:24.571543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:24.571611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:24.571613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.571622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.571630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.571643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:24.571658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254695628680645:3861]
2025-10-01T14:07:24.571661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254695628680645:3861]
2025-10-01T14:07:24.571662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254695628680645:3861]
2025-10-01T14:07:24.571675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:24.571688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:24.571700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:24.571704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:24.571725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:24.571728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:24.571729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254695628680645:3861]
2025-10-01T14:07:24.571730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:24.571731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:24.571735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:24.571981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541502:2446], now have 1 active actors on pipe
2025-10-01T14:07:24.571989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541591:4196], now have 1 active actors on pipe
2025-10-01T14:07:24.572169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 264
2025-10-01T14:07:24.572199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 264
2025-10-01T14:07:24.572370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.572378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.572403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:24.572411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.572416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.572418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:24.572427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.572436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:24.572449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:24.572669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.572675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.572689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:24.573111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 265 partition: 0 MaxSeqNo: 45 sessionId: src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0
2025-10-01T14:07:24.573446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a984750-d74bc2d0-8d91c210-6b89d88a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:24.575668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0] Write session: try to update token
2025-10-01T14:07:24.575682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:24.595342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 265 sessionId: src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:24.597016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:24.597035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:24.597038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:24.597039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:24.597049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254695628680645:3861]
2025-10-01T14:07:24.597053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254695628680645:3861]
2025-10-01T14:07:24.597057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254695628680645:3861]
2025-10-01T14:07:24.597102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:24.597105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:24.597108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:24.597111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:24.597112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.597114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:24.597271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:24.597875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:24.653587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254698005541602:3772]
2025-10-01T14:07:24.653826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 264, pipe: [1:7556254698005541602:3772]
2025-10-01T14:07:24.746475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:24.746753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.746765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.746809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541602:3772], now have 1 active actors on pipe
2025-10-01T14:07:24.747051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:24.747106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254698005541602:3772]
2025-10-01T14:07:24.747041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:24.747128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:24.747136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:24.747193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 265 reason: error at write: Disconnected sessionId: src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0
2025-10-01T14:07:24.747622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:24.747380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 265 sessionId: src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0 is DEAD
2025-10-01T14:07:24.747634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0] Write session will restart in 0.005828s
2025-10-01T14:07:24.747660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0] Write session: Do CDS request
2025-10-01T14:07:24.747666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:24.758094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:24.758872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:24.759029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:24.759042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 266
2025-10-01T14:07:24.759162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:24.759193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:24.759201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:24.759205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:24.759826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 266 sessionId:  describe result for acl check
2025-10-01T14:07:24.759841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:24.759862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:24.759868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:24.759870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:24.759876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254698005541657:4201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:24.760039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:24.760049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:24.760061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:24.760113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:24.760167Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254695628680745:3864]
2025-10-01T14:07:24.760446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254698005541657:4201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:24.760739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:24.761015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:24.761058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:24.761374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:24.761431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.761437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.761438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.761439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.761440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.761441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.761442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.761443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.761444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.761445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.761447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.761448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.761449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.761450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.761455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.761465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.761468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.761472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.761476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.761480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.761483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.761487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.761491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.761495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.761498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.761502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.761505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.761509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.761516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.761524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:24.761530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.761534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:24.761538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.761542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:24.761546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.761550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:24.761555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.761559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:24.761562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.761568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:24.761572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.761577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:24.761590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.761595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:24.761600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.761605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:24.761610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.761614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.761619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.761624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.761627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.761632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.761636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.761641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:24.761645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.761650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:24.761685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:24.762771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254698005541657:4201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:24.765408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254698005541657:4201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:24.765419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254698005541657:4201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:24.765423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254698005541657:4201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:24.765430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:24.765768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:24.766427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:24.766441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:24.766443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:24.766446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:24.766454Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 265 [2:7556254695628680745:3864]
2025-10-01T14:07:24.766470Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:24.766484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:24.766491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.766495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.766498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.766514Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:24.766523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:24.766529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:24.766584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.766593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.766595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.766599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:24.766601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:24.766664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:24.766674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.766684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:24.766696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:24.766711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:24.766733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541604:2446], now have 1 active actors on pipe
2025-10-01T14:07:24.766740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541695:4201], now have 1 active actors on pipe
2025-10-01T14:07:24.766748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254695628680739:3864]
2025-10-01T14:07:24.766752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254695628680739:3864]
2025-10-01T14:07:24.766754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254695628680739:3864]
2025-10-01T14:07:24.766768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:24.766778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:24.766783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:24.766784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:24.766786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:24.766800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:24.766807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:24.766848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254695628680739:3864]
2025-10-01T14:07:24.766855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:24.766867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:24.766828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 265
2025-10-01T14:07:24.766903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 265
2025-10-01T14:07:24.766960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.766975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.767001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22228263-16335c0f-acda61af-d13fefc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:24.767014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.767019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.767025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:24.767034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.767045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:24.767064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:24.767248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.767260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.767279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:24.767368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 266 partition: 0 MaxSeqNo: 45 sessionId: src_id|22228263-16335c0f-acda61af-d13fefc7_0
2025-10-01T14:07:24.767751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03d20b0-1c5dfd43-308c9d62-3e83b87d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|22228263-16335c0f-acda61af-d13fefc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:24.770399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22228263-16335c0f-acda61af-d13fefc7_0] Write session: try to update token
2025-10-01T14:07:24.770416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22228263-16335c0f-acda61af-d13fefc7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:24.792912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 266 sessionId: src_id|22228263-16335c0f-acda61af-d13fefc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:24.795474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:24.795106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:24.795131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:24.795142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254695628680739:3864]
2025-10-01T14:07:24.795198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:24.795377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:24.795532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:24.795674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:24.795834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:24.796036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:24.796075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:24.796441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:24.796553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.796569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.796606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:24.796702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:24.822930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:24.822963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:24.823144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.823209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.823271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.823331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.823377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.823387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.823476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.823533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.823594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.823672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.823719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.823726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.823791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.823848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.823906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.823971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.824016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.824023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.824085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.824148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.824213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.824274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.824319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.824323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.824384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.824444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.824500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.824557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.824630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.824641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.824709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.824770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.824851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.824920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.825041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.825050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.825119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.825186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.825252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.825320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.825384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.825396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.825462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.825531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.825603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.825669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.825717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.825725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.825795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.825857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.825928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.825999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.826045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.826048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.826153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:24.826210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:24.826270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:24.826451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:24.826505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:24.826508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:24.826594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:24.826654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:24.826672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:24.826675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:24.826695Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826704Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826708Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826712Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826716Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826720Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826727Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826731Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826735Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826739Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826798Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826803Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826806Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826809Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.826812Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827173Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827180Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827184Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827188Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827193Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827196Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827200Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827224Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827229Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827233Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827388Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827394Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827398Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827402Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827405Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827408Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827412Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827416Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827420Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827424Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:24.827552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:24.827563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:07:24.827567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:07:24.827570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:07:24.827573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:07:24.828013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:07:24.828032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:24.828038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:07:24.828041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:07:24.828045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:07:24.828049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:07:24.828628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:07:24.828659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:24.828669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:07:24.828672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:07:24.828679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:07:24.828682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:07:24.829169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:07:24.829193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:24.829291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327644826
2025-10-01T14:07:24.832123Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:24.832157Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:07:24.832170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:24.832185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:24.832188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:24.832189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:24.832197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254695628680739:3864]
2025-10-01T14:07:24.832206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254695628680739:3864]
2025-10-01T14:07:24.832210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254695628680739:3864]
2025-10-01T14:07:24.832259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:24.832271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:24.832276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:24.832307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:24.832316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:24.832319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:24.832458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:24.847121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254698005541703:3772]
2025-10-01T14:07:24.849526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 265, pipe: [1:7556254698005541703:3772]
2025-10-01T14:07:24.994728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:24.995122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541703:3772], now have 1 active actors on pipe
2025-10-01T14:07:24.998982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:24.999181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:24.999245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 266 reason: status is not ok: tablet will be restarted right now sessionId: src_id|22228263-16335c0f-acda61af-d13fefc7_0
2025-10-01T14:07:24.999467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 266 sessionId: src_id|22228263-16335c0f-acda61af-d13fefc7_0 is DEAD
2025-10-01T14:07:24.999584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22228263-16335c0f-acda61af-d13fefc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:24.999595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22228263-16335c0f-acda61af-d13fefc7_0] Write session will restart in 0.005707s
2025-10-01T14:07:24.999621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22228263-16335c0f-acda61af-d13fefc7_0] Write session: Do CDS request
2025-10-01T14:07:24.999628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22228263-16335c0f-acda61af-d13fefc7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:24.999705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254698005541703:3772]
2025-10-01T14:07:24.999725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:25.005553Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [73670541172509f5] Result# TEvPutResult {Id# [72075186224037892:265:1:2:1:6759616:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-01T14:07:25.006882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22228263-16335c0f-acda61af-d13fefc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.010567Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:25.010582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 267
2025-10-01T14:07:25.010776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.010829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:25.010834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:25.010838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:25.011248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 267 sessionId:  describe result for acl check
2025-10-01T14:07:25.011281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:25.011282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:25.011284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:25.011290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254702300509069:4206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:25.011840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254702300509069:4206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:25.012901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:25.014945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:25.015190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:25.015199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:25.015211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:25.015262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:25.015302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254699923648148:3867]
2025-10-01T14:07:25.015943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:25.015951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254702300509069:4206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:25.016556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:25.016611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:25.016962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:25.017035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.017041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.017043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.017043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.017044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.017046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.017047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.017048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.017048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.017049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.017051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.017052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.017053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.017054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.017059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.017068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.017072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.017075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.017079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.017083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.017086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.017089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.017092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.017097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.017100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.017104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.017107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.017110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.017117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.017124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.017129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.017134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.017139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.017143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.017158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.017164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.017169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.017173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.017177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.017182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.017186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.017191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.017195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.017199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.017204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.017209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.017213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.017218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.017223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.017227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.017236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.017242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.017248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.017259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.017264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.017269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.017306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:25.018501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254702300509069:4206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:25.018515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254702300509069:4206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:25.018520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254702300509069:4206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:25.018529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:25.022087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:25.022731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:25.022744Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:25.022747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:25.022751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:25.022757Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 266 [2:7556254699923648148:3867]
2025-10-01T14:07:25.022771Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:25.022789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:25.022792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.022795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.022797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.022817Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:25.022823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:25.022829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:25.022878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.022884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.022885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.022888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:25.022890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:25.022961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:25.022964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.022975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.022989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.023004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:25.023023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254698005541720:2446], now have 1 active actors on pipe
2025-10-01T14:07:25.023026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509107:4206], now have 1 active actors on pipe
2025-10-01T14:07:25.023033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254699923648143:3867]
2025-10-01T14:07:25.023035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254699923648143:3867]
2025-10-01T14:07:25.023037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254699923648143:3867]
2025-10-01T14:07:25.023051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:25.023066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:25.023067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:25.023070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:25.023072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:25.023080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:25.023083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:25.023123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254699923648143:3867]
2025-10-01T14:07:25.023130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:25.023135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:25.023350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.023363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.023393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:25.023271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 266
2025-10-01T14:07:25.023406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.023425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.023428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:25.023438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.023308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 266
2025-10-01T14:07:25.023449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:25.023464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.023671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.023678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.023694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.023801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 267 partition: 0 MaxSeqNo: 45 sessionId: src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0
2025-10-01T14:07:25.024143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22228263-16335c0f-acda61af-d13fefc7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:25.026911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0] Write session: try to update token
2025-10-01T14:07:25.026933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:25.046207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 267 sessionId: src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:25.048571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:25.050440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.050466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.050489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:25.050492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:25.050496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:25.050498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:25.050599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254699923648143:3867]
2025-10-01T14:07:25.050603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254699923648143:3867]
2025-10-01T14:07:25.050607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254699923648143:3867]
2025-10-01T14:07:25.050666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:25.050672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.050675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:25.050808Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:25.054470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:25.054476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:25.054480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:25.100044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254702300509117:3772]
2025-10-01T14:07:25.100347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 266, pipe: [1:7556254702300509117:3772]
2025-10-01T14:07:25.198894Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:25.199252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:25.199310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509117:3772], now have 1 active actors on pipe
2025-10-01T14:07:25.199992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:25.200003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0] Write session will restart in 0.005665s
2025-10-01T14:07:25.200027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0] Write session: Do CDS request
2025-10-01T14:07:25.200032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:25.199443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:25.199534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:25.199538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:25.199605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 267 reason: error at write: Disconnected sessionId: src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0
2025-10-01T14:07:25.199735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 267 sessionId: src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0 is DEAD
2025-10-01T14:07:25.199742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254702300509117:3772]
2025-10-01T14:07:25.199758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:25.207270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.207364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:25.207378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 268
2025-10-01T14:07:25.207565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.207595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:25.207604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:25.207607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:25.207981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 268 sessionId:  describe result for acl check
2025-10-01T14:07:25.208013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:25.208019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:25.208020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:25.208025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254702300509210:4218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:25.208463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254702300509210:4218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:25.208513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:25.210110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:25.210308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:25.210320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:25.210331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:25.210406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:25.210443Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254699923648248:3871]
2025-10-01T14:07:25.210519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254702300509210:4218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:25.211015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:25.211342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:25.211386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:25.211688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:25.211743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.211748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.211749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.211750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.211752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.211753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.211754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.211755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.211756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.211759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.211760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.211761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.211761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.211762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.211767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.211776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.211780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.211783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.211787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.211790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.211793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.211796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.211800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.211804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.211808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.211811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.211815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.211819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.211825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.211832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.211838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.211843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.211847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.211859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.211863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.211868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.211872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.211876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.211880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.211885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.211891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.211896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.211901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.211906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.211911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.211915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.211920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.211929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.211933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.211937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.211941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.211945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.211953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.211957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.211961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.211969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.212005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:25.215937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:25.216577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:25.216592Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:25.216594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:25.216597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:25.216603Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 267 [2:7556254699923648248:3871]
2025-10-01T14:07:25.216617Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:25.216633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:25.216636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.216640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.216642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.216658Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:25.216669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:25.216677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:25.216726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.216733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.216735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.216738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:25.216741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:25.216805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:25.216812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.216835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.216848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.216862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:25.216887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254699923648243:3871]
2025-10-01T14:07:25.216889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254699923648243:3871]
2025-10-01T14:07:25.216890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254699923648243:3871]
2025-10-01T14:07:25.216901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:25.216953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:25.216968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:25.216970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:25.216996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254699923648243:3871]
2025-10-01T14:07:25.216999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:25.217060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:25.217071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:25.217073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:25.217079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:25.217242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509155:2446], now have 1 active actors on pipe
2025-10-01T14:07:25.217380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509247:4218], now have 1 active actors on pipe
2025-10-01T14:07:25.217478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.217492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.217514Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66ae5a60-d07489ce-267a0647-2d329830_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:25.217526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.217535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.217538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:25.217544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.217554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:25.217569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.217694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.217704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.217725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.218158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67221f6c-91dc3cb0-37745b7f-5636213a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|66ae5a60-d07489ce-267a0647-2d329830_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:25.216486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254702300509210:4218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:25.216507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254702300509210:4218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:25.216512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254702300509210:4218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:25.216523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:25.217333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 267
2025-10-01T14:07:25.217446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 267
2025-10-01T14:07:25.217814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 268 partition: 0 MaxSeqNo: 45 sessionId: src_id|66ae5a60-d07489ce-267a0647-2d329830_0
2025-10-01T14:07:25.220599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae5a60-d07489ce-267a0647-2d329830_0] Write session: try to update token
2025-10-01T14:07:25.220615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae5a60-d07489ce-267a0647-2d329830_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:25.238011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 268 sessionId: src_id|66ae5a60-d07489ce-267a0647-2d329830_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:25.240509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:25.240695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.240715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.240763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:25.240849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:25.245302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:25.245318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:25.245321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:25.245323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:25.245334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254699923648243:3871]
2025-10-01T14:07:25.245339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254699923648243:3871]
2025-10-01T14:07:25.245344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254699923648243:3871]
2025-10-01T14:07:25.245387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:25.245392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:25.245401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:25.245401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.245404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:25.245404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:25.245536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:25.299752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254702300509256:3772]
2025-10-01T14:07:25.300006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 267, pipe: [1:7556254702300509256:3772]
2025-10-01T14:07:25.395906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:25.404947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.404980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.405166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.405238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.405304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.405373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.405416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.405425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.405506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.405566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.405626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.405700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.405742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.405745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.405810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.405863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.405918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.405972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.406011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.406013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.406081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.406144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.406197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.406250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.406989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.407004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.407071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.409070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:25.409078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254702300509256:3772]
2025-10-01T14:07:25.409103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:25.409106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:25.409131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 268 reason: error at write: Disconnected sessionId: src_id|66ae5a60-d07489ce-267a0647-2d329830_0
2025-10-01T14:07:25.409502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae5a60-d07489ce-267a0647-2d329830_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:25.409512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae5a60-d07489ce-267a0647-2d329830_0] Write session will restart in 0.007371s
2025-10-01T14:07:25.409537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae5a60-d07489ce-267a0647-2d329830_0] Write session: Do CDS request
2025-10-01T14:07:25.409544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae5a60-d07489ce-267a0647-2d329830_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:25.409393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 268 sessionId: src_id|66ae5a60-d07489ce-267a0647-2d329830_0 is DEAD
2025-10-01T14:07:25.407133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.407198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.407252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.407293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.407296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.407359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.407410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.407472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.407535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.407576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.407578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.407644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.407698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.407762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.407825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.407866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.407869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.407932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.408022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.408078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.408134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.408172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.408174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.408243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.408301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.408363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.408422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.408461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.408464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.408532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.408589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.408650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.408708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.408749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.408752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.408831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509256:3772], now have 1 active actors on pipe
2025-10-01T14:07:25.410288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:25.420514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae5a60-d07489ce-267a0647-2d329830_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.420976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:25.420992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 269
2025-10-01T14:07:25.421096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.421126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:25.421136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:25.421140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:25.421564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 269 sessionId:  describe result for acl check
2025-10-01T14:07:25.421597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:25.421599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:25.421600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:25.421605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254702300509284:4222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:25.422095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254702300509284:4222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:25.426131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254702300509284:4222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:25.426592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:25.427667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:25.427857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:25.427870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:25.427881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:25.427928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:25.427968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254699923648375:3884]
2025-10-01T14:07:25.428649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:25.430439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:25.430504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:25.430872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:25.430958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.430959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.430959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.430960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.430961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.430962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.430963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.430964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.430966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.430966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.430967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.430968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.430969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.430971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.430977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.430986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.430989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.430992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.430996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.430999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.431003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.431006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.431009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.431013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.431016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.431019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.431022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.431025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.431033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.431040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.431045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.431050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.431054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.431058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.431062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.431066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.431070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.431075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.431079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.431083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.431088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.431092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.431095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.431100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.431106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.431110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.431113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.431117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.431121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.431125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.431129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.431133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.431137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.431142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.431146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.431149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.431185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:25.431831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254702300509284:4222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:25.431846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254702300509284:4222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:25.431849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254702300509284:4222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:25.431859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:25.436213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:25.436878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:25.436894Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:25.436897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:25.436901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:25.436907Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 268 [2:7556254699923648375:3884]
2025-10-01T14:07:25.436923Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:25.436941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:25.436943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.436946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.436948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.436962Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:25.436970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:25.436975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:25.437040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.437048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.437050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.437053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:25.437055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:25.437118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:25.437125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.437136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.437151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.437248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 268
2025-10-01T14:07:25.437281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 268
2025-10-01T14:07:25.437171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:25.437193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509348:4222], now have 1 active actors on pipe
2025-10-01T14:07:25.437197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509261:2446], now have 1 active actors on pipe
2025-10-01T14:07:25.437204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254699923648370:3884]
2025-10-01T14:07:25.437206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254699923648370:3884]
2025-10-01T14:07:25.437208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254699923648370:3884]
2025-10-01T14:07:25.437220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:25.437227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:25.437229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:25.437231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:25.437233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:25.437247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:25.437249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:25.437283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254699923648370:3884]
2025-10-01T14:07:25.437289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:25.437294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:25.437306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.437310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.437351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:25.437358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.437363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.437365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:25.437373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.437383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:25.437404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.437826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.437830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.437848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.437961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 269 partition: 0 MaxSeqNo: 45 sessionId: src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0
2025-10-01T14:07:25.438343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ae5a60-d07489ce-267a0647-2d329830_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:25.440881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0] Write session: try to update token
2025-10-01T14:07:25.440902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:25.462900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 269 sessionId: src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:25.465420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:25.465795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.465819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.465857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:25.465969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:25.469355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:25.469374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:25.469376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:25.469378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:25.469389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254699923648370:3884]
2025-10-01T14:07:25.469394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254699923648370:3884]
2025-10-01T14:07:25.469400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254699923648370:3884]
2025-10-01T14:07:25.469448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:25.469460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.469462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:25.469596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:25.470416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:25.470422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:25.470427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:25.509148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254702300509359:3772]
2025-10-01T14:07:25.509388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 268, pipe: [1:7556254702300509359:3772]
2025-10-01T14:07:25.638518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:25.653525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.653555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.653728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.653791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.653856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.653928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.653985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.653994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.654060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.654124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.654187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.654254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.654297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.654304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.654364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.654730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.654803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.654864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.654903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.654909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.654976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.655032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.655087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.655173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.655214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.655216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.655281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.655332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.655387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.655451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.655499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.655508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.655572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.655626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.655687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.655748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.655796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.655800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.655860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.655911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.655970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.656036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.656081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.656089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.656149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.656210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.656280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.656347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.656397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.656400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.656668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.656728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.656800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.656873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.656924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.656932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.657000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:25.657061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:25.657125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:25.657200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:25.657252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:25.657264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:25.657330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509359:3772], now have 1 active actors on pipe
2025-10-01T14:07:25.658873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:25.659403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:25.659462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:25.659520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 269 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0
2025-10-01T14:07:25.659716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 269 sessionId: src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0 is DEAD
2025-10-01T14:07:25.659879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254702300509359:3772]
2025-10-01T14:07:25.666077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:25.666092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0] Write session will restart in 0.007871s
2025-10-01T14:07:25.666120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0] Write session: Do CDS request
2025-10-01T14:07:25.666127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:25.678897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.683064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:25.683079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 270
2025-10-01T14:07:25.686981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.687043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:25.687049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:25.687054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:25.687703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 270 sessionId:  describe result for acl check
2025-10-01T14:07:25.687742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:25.687744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:25.687746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:25.687753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254702300509407:4227] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:25.688321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254702300509407:4227] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:25.694624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254702300509407:4227] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:25.698284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254702300509407:4227] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:25.698298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254702300509407:4227] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:25.698301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254702300509407:4227] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:25.698310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:25.698914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:25.701313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:25.701569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:25.701580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:25.701593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:25.701650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:25.701688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254699923648474:3887]
2025-10-01T14:07:25.702336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:25.702873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:25.702929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:25.703286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:25.703347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.703348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.703349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.703350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.703352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.703353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.703354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.703356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.703357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.703357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.703358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.703359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.703360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.703361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.703366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.703374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.703377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.703381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.703384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.703388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.703392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.703396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.703400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.703406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.703410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.703414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.703418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.703422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.703430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.703437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.703453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.703458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.703464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.703469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.703473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.703478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.703482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.703487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.703491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.703495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.703500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.703504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.703509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.703514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.703518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.703532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.703536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.703541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.703545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.703549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.703553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.703557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.703562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.703569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.703575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.703589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.703627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:25.710384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:25.711046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:25.711052Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:25.711055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:25.711059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:25.711066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 269 [2:7556254699923648474:3887]
2025-10-01T14:07:25.711084Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:25.711102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:25.711105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.711110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.711112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.711130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:25.711136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:25.711144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:25.711207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.711209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.711211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.711216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:25.711219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:25.711297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:25.711299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.711310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.711320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.711336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:25.711353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254699923648468:3887]
2025-10-01T14:07:25.711356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254699923648468:3887]
2025-10-01T14:07:25.711358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254699923648468:3887]
2025-10-01T14:07:25.711372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:25.711386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:25.711400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:25.711403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:25.711441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254699923648468:3887]
2025-10-01T14:07:25.711444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:25.711715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:25.711719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:25.711721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:25.711727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:25.712205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 269
2025-10-01T14:07:25.712241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 269
2025-10-01T14:07:25.721336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509364:2446], now have 1 active actors on pipe
2025-10-01T14:07:25.721360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509454:4227], now have 1 active actors on pipe
2025-10-01T14:07:25.721397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.721405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.721452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:25.721465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.721471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.721474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:25.721488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.721507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:25.721529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.722798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.722811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.722837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.723132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 270 partition: 0 MaxSeqNo: 45 sessionId: src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0
2025-10-01T14:07:25.726486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd75d15d-4c94d48f-784af4df-efd0591e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:25.729050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0] Write session: try to update token
2025-10-01T14:07:25.729071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:25.763290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254702300509465:3772]
2025-10-01T14:07:25.763275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:25.763299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:25.763302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:25.763304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:25.763314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254699923648468:3887]
2025-10-01T14:07:25.763318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254699923648468:3887]
2025-10-01T14:07:25.763325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254699923648468:3887]
2025-10-01T14:07:25.763375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:25.763383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.763385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:25.763524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:25.764565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 270 sessionId: src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:25.767053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:25.767357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:25.767368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:25.767372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:25.771851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 269, pipe: [1:7556254702300509465:3772]
2025-10-01T14:07:25.951563Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:25.951918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.951929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.951953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509465:3772], now have 1 active actors on pipe
2025-10-01T14:07:25.952542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254702300509465:3772]
2025-10-01T14:07:25.952570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:25.952253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:25.952598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:25.952604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:25.952652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 270 reason: error at write: Disconnected sessionId: src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0
2025-10-01T14:07:25.952854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 270 sessionId: src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0 is DEAD
2025-10-01T14:07:25.957036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:25.957049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0] Write session will restart in 0.006307s
2025-10-01T14:07:25.957077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0] Write session: Do CDS request
2025-10-01T14:07:25.957085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:25.965468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.966507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:25.966521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 271
2025-10-01T14:07:25.967754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:25.969619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:25.969669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:25.969675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:25.969680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:25.970148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 271 sessionId:  describe result for acl check
2025-10-01T14:07:25.970185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:25.970187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:25.970189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:25.970195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254702300509534:4231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:25.970737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254702300509534:4231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:25.970465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:25.970684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:25.970688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:25.970700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:25.970752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:25.970786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254699923648582:3890]
2025-10-01T14:07:25.971430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:25.971837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:25.971885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:25.972190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:25.972246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.972247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.972248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.972249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.972250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.972252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.972253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.972255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.972256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.972257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.972258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.972259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.972260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.972262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.972267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.972275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.972279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.972282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.972286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.972290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.972293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.972297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.972300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.972304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.972308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.972311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.972315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.972318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.972326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.972333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:25.972339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.972345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:25.972349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.972354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:25.972358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.972363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:25.972367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.972372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:25.972376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.972381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:25.972385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.972390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:25.972394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.972400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:25.972404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.972410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:25.972414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.972419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.972423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.972428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.972432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.972439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.972444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.972449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:25.972453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.972458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:25.972496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:25.973134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254702300509534:4231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:25.979426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254702300509534:4231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:25.979449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254702300509534:4231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:25.979455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254702300509534:4231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:25.979464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:25.979919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:25.980550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:25.980567Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:25.980572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:25.980576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:25.980582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 270 [2:7556254699923648582:3890]
2025-10-01T14:07:25.980596Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:25.980613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:25.980623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.980627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.980630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.980647Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:25.980652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:25.980658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:25.980714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.980716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.980718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.980722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:25.980724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:25.980796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:25.980799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:25.980810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:25.980834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:25.980852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:25.980870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254699923648577:3890]
2025-10-01T14:07:25.980872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254699923648577:3890]
2025-10-01T14:07:25.980874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254699923648577:3890]
2025-10-01T14:07:25.980884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:25.980900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:25.980915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:25.980918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:25.980952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254699923648577:3890]
2025-10-01T14:07:25.980955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:25.981211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:25.981213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:25.981216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:25.981222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:25.981647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 270
2025-10-01T14:07:25.981680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 270
2025-10-01T14:07:25.981875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509568:4231], now have 1 active actors on pipe
2025-10-01T14:07:25.981887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254702300509475:2446], now have 1 active actors on pipe
2025-10-01T14:07:25.981910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.981915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.981941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3cc0671-36158986-282fb33f-20ab445d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:25.981950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:25.981955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:25.981957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:25.981966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:25.981979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:25.981998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.984589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:25.984604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:25.984642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:25.985319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 271 partition: 0 MaxSeqNo: 45 sessionId: src_id|b3cc0671-36158986-282fb33f-20ab445d_0
2025-10-01T14:07:25.985691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5df9f40-b3c5c7e6-c3136d60-5ce0e676_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b3cc0671-36158986-282fb33f-20ab445d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:25.988167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cc0671-36158986-282fb33f-20ab445d_0] Write session: try to update token
2025-10-01T14:07:25.988190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cc0671-36158986-282fb33f-20ab445d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:26.008390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:26.008407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:26.008409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:26.008411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:26.008421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254699923648577:3890]
2025-10-01T14:07:26.008425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254699923648577:3890]
2025-10-01T14:07:26.008428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254699923648577:3890]
2025-10-01T14:07:26.008476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:26.008482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.008488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:26.008558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:26.008570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:26.008574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:26.008627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:26.013079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 271 sessionId: src_id|b3cc0671-36158986-282fb33f-20ab445d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:26.015685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:26.051898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254706595476884:3772]
2025-10-01T14:07:26.052180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 270, pipe: [1:7556254706595476884:3772]
2025-10-01T14:07:26.161486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:26.161803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.161814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.161858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595476884:3772], now have 1 active actors on pipe
2025-10-01T14:07:26.162115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:26.162430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254706595476884:3772]
2025-10-01T14:07:26.162464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:26.162495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:26.162561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 271 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3cc0671-36158986-282fb33f-20ab445d_0
2025-10-01T14:07:26.162745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 271 sessionId: src_id|b3cc0671-36158986-282fb33f-20ab445d_0 is DEAD
2025-10-01T14:07:26.162901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cc0671-36158986-282fb33f-20ab445d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:26.162917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cc0671-36158986-282fb33f-20ab445d_0] Write session will restart in 0.005521s
2025-10-01T14:07:26.162945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cc0671-36158986-282fb33f-20ab445d_0] Write session: Do CDS request
2025-10-01T14:07:26.162951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cc0671-36158986-282fb33f-20ab445d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:26.169901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cc0671-36158986-282fb33f-20ab445d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:26.173321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:26.175268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:26.175508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:26.175519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:26.175531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:26.175579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:26.175618Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254704218615975:3892]
2025-10-01T14:07:26.176212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:26.176589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:26.176603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 272
2025-10-01T14:07:26.176559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:26.176625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:26.176812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:26.176975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:26.177034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:26.177045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:26.177048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:26.177052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.177061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.177062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.177063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.177065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.177066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.177067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.177068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.177069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.177070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.177071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.177072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.177073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.177075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.177081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.177090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.177093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.177097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.177100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.177104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.177107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.177110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.177115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.177119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.177121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.177125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.177128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.177131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.177138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.177145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.177151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.177156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.177160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.177165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.177168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.177173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.177177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.177182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.177187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.177192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.177196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.177201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.177205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.177210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.177214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.177219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.177231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.177235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.177239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.177244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.177248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.177253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.177265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.177270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.177278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.177282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.177317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:26.177456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 272 sessionId:  describe result for acl check
2025-10-01T14:07:26.177488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:26.177489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:26.177491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:26.177496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254706595476966:4241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:26.178006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254706595476966:4241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:26.182159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:26.179798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254706595476966:4241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:26.182866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:26.182882Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:26.182884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:26.182888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:26.182894Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 271 [2:7556254704218615975:3892]
2025-10-01T14:07:26.182910Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:26.182927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:26.182930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.182934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.182936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.182954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:26.182961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:26.182966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:26.183028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.183030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.183032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.183034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:26.183037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:26.183118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:26.183130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.183141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.183149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.183163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:26.183182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595476892:2446], now have 1 active actors on pipe
2025-10-01T14:07:26.183195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254704218615970:3892]
2025-10-01T14:07:26.183199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254704218615970:3892]
2025-10-01T14:07:26.183200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254704218615970:3892]
2025-10-01T14:07:26.183213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:26.183228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:26.183230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:26.183232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:26.183232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:26.183244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:26.183218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 271
2025-10-01T14:07:26.183251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:26.183297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254704218615970:3892]
2025-10-01T14:07:26.183307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:26.183320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:26.183918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254706595476966:4241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:26.183933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254706595476966:4241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:26.183936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254706595476966:4241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:26.183945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:26.186786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595477003:4241], now have 1 active actors on pipe
2025-10-01T14:07:26.186987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.186997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.187028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|567fd379-93b25184-c464ccbf-a4ea295a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:26.187038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.187044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.187046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:26.187061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.187076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:26.187095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:26.187274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.187283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.187309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:26.187786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3cc0671-36158986-282fb33f-20ab445d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|567fd379-93b25184-c464ccbf-a4ea295a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:26.190299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|567fd379-93b25184-c464ccbf-a4ea295a_0] Write session: try to update token
2025-10-01T14:07:26.190319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|567fd379-93b25184-c464ccbf-a4ea295a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:26.186820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 271
2025-10-01T14:07:26.187420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 272 partition: 0 MaxSeqNo: 45 sessionId: src_id|567fd379-93b25184-c464ccbf-a4ea295a_0
2025-10-01T14:07:26.208230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 272 sessionId: src_id|567fd379-93b25184-c464ccbf-a4ea295a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:26.210982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:26.217999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.218020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.218043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:26.218047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:26.218057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254704218615970:3892]
2025-10-01T14:07:26.218093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:26.218110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:26.218295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:26.221708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:26.221873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:26.222036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:26.222229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:26.222284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:26.222317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:26.222406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:26.252708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.252739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.252920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.252976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.253033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.253088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.253127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.253133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.253203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.253257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.253314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.253377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.253422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.253424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.253489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.253545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.253599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.253654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.253699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.253702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.253763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.253817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.253877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.253936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.253972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.253975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.254036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.254093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.254158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.254220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.254263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.254266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.254340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.254574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.254649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.254718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.254773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.254780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.254849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.254915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.254984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.255048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.255099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.255108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.255176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.255235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.255787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.255935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.255982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.255984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.256129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.256191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.256250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.256310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.256360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.256363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.256445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:26.256587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:26.256724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:26.256883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:26.256926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:26.256928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:26.257024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:26.257082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.257099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.257103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:26.257123Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257133Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257137Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257140Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257144Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257147Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257150Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257154Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257159Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257164Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257167Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257169Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257173Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257176Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257178Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257181Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257185Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257188Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257191Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257194Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257670Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257675Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257679Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257683Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257686Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257690Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257693Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257696Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257701Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257704Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257708Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257713Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257716Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257719Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257723Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:26.257745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:26.257758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:07:26.257761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:07:26.257764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:07:26.257767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:07:26.258264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:07:26.258280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:26.258286Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:07:26.258291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:07:26.258294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:07:26.258298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:07:26.259040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:07:26.259066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:26.259072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:07:26.259075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:07:26.259079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:07:26.259082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:07:26.259687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:07:26.259708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.259835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327646259
2025-10-01T14:07:26.262313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254706595477021:3772]
2025-10-01T14:07:26.262622Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:26.262645Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:07:26.262656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:26.262657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:26.262661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:26.262662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:26.262669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254704218615970:3892]
2025-10-01T14:07:26.262671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254704218615970:3892]
2025-10-01T14:07:26.262674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254704218615970:3892]
2025-10-01T14:07:26.262741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:26.262749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.262750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:26.262873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:26.263001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:26.263016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:26.263020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:26.263140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 271, pipe: [1:7556254706595477021:3772]
2025-10-01T14:07:26.418861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:26.419311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595477021:3772], now have 1 active actors on pipe
2025-10-01T14:07:26.419565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:26.421682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:26.421746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254706595477021:3772]
2025-10-01T14:07:26.422090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:26.422162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 272 reason: status is not ok: tablet will be restarted right now sessionId: src_id|567fd379-93b25184-c464ccbf-a4ea295a_0
2025-10-01T14:07:26.422383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 272 sessionId: src_id|567fd379-93b25184-c464ccbf-a4ea295a_0 is DEAD
2025-10-01T14:07:26.425254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567fd379-93b25184-c464ccbf-a4ea295a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:26.425268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567fd379-93b25184-c464ccbf-a4ea295a_0] Write session will restart in 0.008079s
2025-10-01T14:07:26.425296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567fd379-93b25184-c464ccbf-a4ea295a_0] Write session: Do CDS request
2025-10-01T14:07:26.425303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567fd379-93b25184-c464ccbf-a4ea295a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:26.435033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|567fd379-93b25184-c464ccbf-a4ea295a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:26.436679Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [f7de522076e5b096] Result# TEvPutResult {Id# [72075186224037892:271:1:2:1:6759616:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-01T14:07:26.437893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:26.437918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 273
2025-10-01T14:07:26.438189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:26.438229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:26.438240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:26.438244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:26.438692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 273 sessionId:  describe result for acl check
2025-10-01T14:07:26.438725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:26.438727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:26.438728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:26.438732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254706595477040:4248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:26.439601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254706595477040:4248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:26.443877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254706595477040:4248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:26.451013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254706595477040:4248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:26.451037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254706595477040:4248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:26.451041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254706595477040:4248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:26.451387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:26.451050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:26.453533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:26.453798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:26.453809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:26.453822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:26.453875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:26.453917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254704218616117:3907]
2025-10-01T14:07:26.454585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:26.454844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:26.454885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:26.455202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:26.455248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.455249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.455250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.455251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.455252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.455254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.455255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.455256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.455257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.455258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.455259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.455260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.455261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.455262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.455267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.455278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.455281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.455285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.455289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.455293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.455296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.455300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.455303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.455307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.455312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.455315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.455318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.455321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.455330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.455337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.455343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.455348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.455351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.455356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.455360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.455364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.455369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.455374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.455378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.455383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.455387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.455392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.455396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.455401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.455405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.455409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.455413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.455417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.455424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.455428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.455432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.455437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.455441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.455445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.455449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.455455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.455491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:26.460300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:26.460961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:26.460979Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:26.460982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:26.460986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:26.460992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 272 [2:7556254704218616117:3907]
2025-10-01T14:07:26.461009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:26.461028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:26.461032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.461035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.461038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.461055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:26.461060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:26.461066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:26.461126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.461128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.461130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.461133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:26.461136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:26.461205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:26.461208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.461219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.461230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.461248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:26.461264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254704218616110:3907]
2025-10-01T14:07:26.461267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254704218616110:3907]
2025-10-01T14:07:26.461269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254704218616110:3907]
2025-10-01T14:07:26.461282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:26.461294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:26.461309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:26.461312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:26.461342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254704218616110:3907]
2025-10-01T14:07:26.461344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:26.461770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:26.461777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:26.461780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:26.461784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:26.462245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595477117:4248], now have 1 active actors on pipe
2025-10-01T14:07:26.462253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595477030:2446], now have 1 active actors on pipe
2025-10-01T14:07:26.462275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 272
2025-10-01T14:07:26.462313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 272
2025-10-01T14:07:26.463391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 273 partition: 0 MaxSeqNo: 45 sessionId: src_id|cb513af-983f54c6-55bd6459-15c846f9_0
2025-10-01T14:07:26.462858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.462879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.462910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb513af-983f54c6-55bd6459-15c846f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:26.462921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.462926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.462929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:26.462939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.462953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:26.462972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:26.463253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.463257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.463271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:26.464098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|567fd379-93b25184-c464ccbf-a4ea295a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cb513af-983f54c6-55bd6459-15c846f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:26.466698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513af-983f54c6-55bd6459-15c846f9_0] Write session: try to update token
2025-10-01T14:07:26.466718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513af-983f54c6-55bd6459-15c846f9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:26.508600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:26.508618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:26.508621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:26.508623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:26.508633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254704218616110:3907]
2025-10-01T14:07:26.508639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254704218616110:3907]
2025-10-01T14:07:26.508643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254704218616110:3907]
2025-10-01T14:07:26.508694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:26.508701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.508703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:26.508867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:26.508909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:26.508914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:26.508918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:26.511511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 273 sessionId: src_id|cb513af-983f54c6-55bd6459-15c846f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:26.513987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:26.522026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254706595477131:3772]
2025-10-01T14:07:26.529244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 272, pipe: [1:7556254706595477131:3772]
2025-10-01T14:07:26.676810Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:26.677391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.677402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.677446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595477131:3772], now have 1 active actors on pipe
2025-10-01T14:07:26.681097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:26.681118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:26.681188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 273 reason: error at write: Disconnected sessionId: src_id|cb513af-983f54c6-55bd6459-15c846f9_0
2025-10-01T14:07:26.681386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 273 sessionId: src_id|cb513af-983f54c6-55bd6459-15c846f9_0 is DEAD
2025-10-01T14:07:26.681516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254706595477131:3772]
2025-10-01T14:07:26.681529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:26.682599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513af-983f54c6-55bd6459-15c846f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:26.682613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513af-983f54c6-55bd6459-15c846f9_0] Write session will restart in 0.009333s
2025-10-01T14:07:26.682641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513af-983f54c6-55bd6459-15c846f9_0] Write session: Do CDS request
2025-10-01T14:07:26.682653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513af-983f54c6-55bd6459-15c846f9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:26.681866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:26.698842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513af-983f54c6-55bd6459-15c846f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:26.699740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:26.699755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 274
2025-10-01T14:07:26.699952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:26.699983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:26.699990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:26.699993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:26.701062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:26.700667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 274 sessionId:  describe result for acl check
2025-10-01T14:07:26.700703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:26.700706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:26.700708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:26.700715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254706595477202:4253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:26.701244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254706595477202:4253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:26.703616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:26.703944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:26.703949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:26.703960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:26.704011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:26.704046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254704218616218:3910]
2025-10-01T14:07:26.704744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:26.705347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:26.705393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:26.705746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:26.705794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.705795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.705797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.705798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.705799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.705801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.705802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.705804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.705805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.705806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.705807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.705808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.705809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.705810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.705819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.705828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.705832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.705837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.705840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.705844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.705848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.705866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.705870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.705874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.705878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.705881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.705885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.705890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.705897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.705905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:26.705910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.705918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:26.705922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.705927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:26.705931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.705936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:26.705940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.705945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:26.705949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.705953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:26.705959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.705964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:26.705969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.705974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:26.705979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.705985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:26.705989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.705995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.706000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.706004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.706008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.706013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.706017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.706022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:26.706026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.706030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:26.706067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:26.708756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254706595477202:4253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:26.711682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:26.712338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:26.712343Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:26.712346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:26.712349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:26.712356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 273 [2:7556254704218616218:3910]
2025-10-01T14:07:26.712373Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:26.712390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:26.712393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.712397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.712399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.712417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:26.712422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:26.712427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:26.712483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.712486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.712488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.712491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:26.712494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:26.712569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:26.712572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.712584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:26.712595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:26.712611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:26.712630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254704218616212:3910]
2025-10-01T14:07:26.712633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254704218616212:3910]
2025-10-01T14:07:26.712636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254704218616212:3910]
2025-10-01T14:07:26.712645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:26.712659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:26.712672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:26.712675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:26.712713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254704218616212:3910]
2025-10-01T14:07:26.712715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:26.713664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 273
2025-10-01T14:07:26.712964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:26.712972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:26.712974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:26.712979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:26.714252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595477141:2446], now have 1 active actors on pipe
2025-10-01T14:07:26.729050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254706595477202:4253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:26.729066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254706595477202:4253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:26.729070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254706595477202:4253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:26.729080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:26.734913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595477245:4253], now have 1 active actors on pipe
2025-10-01T14:07:26.738531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 273
2025-10-01T14:07:26.741973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.741995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.742030Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:26.742044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:26.742051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:26.742054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:26.742068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:26.742087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:26.742111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:26.742541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:26.742548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:26.742564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:26.743085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb513af-983f54c6-55bd6459-15c846f9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:26.745755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0] Write session: try to update token
2025-10-01T14:07:26.745774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:26.742700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 274 partition: 0 MaxSeqNo: 45 sessionId: src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0
2025-10-01T14:07:26.768912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:26.768930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:26.768932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:26.768934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:26.768944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254704218616212:3910]
2025-10-01T14:07:26.768949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254704218616212:3910]
2025-10-01T14:07:26.768952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254704218616212:3910]
2025-10-01T14:07:26.769003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:26.769011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:26.769014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:26.769147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:26.770897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:26.770908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:26.770912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:26.780674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254706595477249:3772]
2025-10-01T14:07:26.781137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 273, pipe: [1:7556254706595477249:3772]
2025-10-01T14:07:26.790821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 274 sessionId: src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:26.793693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:27.082883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:27.083156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254706595477249:3772], now have 1 active actors on pipe
2025-10-01T14:07:27.083190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.083198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.085599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:27.087173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254706595477249:3772]
2025-10-01T14:07:27.087208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:27.087263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:27.087359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 274 reason: status is not ok: tablet will be restarted right now sessionId: src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0
2025-10-01T14:07:27.087556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 274 sessionId: src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0 is DEAD
2025-10-01T14:07:27.090506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:27.090519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0] Write session will restart in 0.008872s
2025-10-01T14:07:27.090551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0] Write session: Do CDS request
2025-10-01T14:07:27.090557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:27.102870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:27.103186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:27.103201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 275
2025-10-01T14:07:27.103377Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:27.103407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:27.103412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:27.103415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:27.107278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 275 sessionId:  describe result for acl check
2025-10-01T14:07:27.107321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:27.107324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:27.107326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:27.107332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254710890444582:4260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:27.107861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254710890444582:4260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:27.115230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254710890444582:4260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:27.118557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254710890444582:4260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:27.118575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254710890444582:4260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:27.118578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254710890444582:4260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:27.118587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:27.118806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:27.121006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:27.121262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:27.121273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:27.121287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:27.121350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:27.121389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254708513583630:3913]
2025-10-01T14:07:27.121954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:27.122305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:27.122358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:27.122681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:27.122727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.122728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.122729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.122730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.122731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.122732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.122732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.122733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.122734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.122734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.122735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.122736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.122737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.122737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.122741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.122747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.122750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.122752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.122754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.122757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.122759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.122761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.122764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.122768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.122772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.122776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.122779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.122782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.122789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.122796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.122802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.122808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.122813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.122820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.122825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.122830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.122834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.122839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.122843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.122848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.122857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.122861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.122866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.122870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.122874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.122879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.122883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.122886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.122890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.122895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.122899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.122903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.122907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.122911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.122915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.122919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.122962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:27.129497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:27.130177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:27.130193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:27.130196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:27.130201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:27.130208Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 274 [2:7556254708513583630:3913]
2025-10-01T14:07:27.130225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:27.130248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:27.130257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.130261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.130262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.130278Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:27.130290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:27.130296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:27.130350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.130357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.130359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.130362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:27.130365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:27.130642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 274
2025-10-01T14:07:27.130687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 274
2025-10-01T14:07:27.130468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:27.130476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.130488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.130499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.130514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:27.130536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444567:2446], now have 1 active actors on pipe
2025-10-01T14:07:27.130540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444662:4260], now have 1 active actors on pipe
2025-10-01T14:07:27.130547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254708513583623:3913]
2025-10-01T14:07:27.130549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254708513583623:3913]
2025-10-01T14:07:27.130553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254708513583623:3913]
2025-10-01T14:07:27.130566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:27.130580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:27.130582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:27.130582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:27.130584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:27.130607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:27.130610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:27.130650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254708513583623:3913]
2025-10-01T14:07:27.130660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:27.130673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:27.130952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.130964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.130991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6be3177-9c9247f9-7994c474-da4791c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:27.131003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.131007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.131009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:27.131018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.131029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:27.131048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:27.131384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.131390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.131406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:27.132050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85389437-72b39615-fdfd8f2e-2e7a5b0f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b6be3177-9c9247f9-7994c474-da4791c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:27.131537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 275 partition: 0 MaxSeqNo: 45 sessionId: src_id|b6be3177-9c9247f9-7994c474-da4791c3_0
2025-10-01T14:07:27.134768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be3177-9c9247f9-7994c474-da4791c3_0] Write session: try to update token
2025-10-01T14:07:27.134787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be3177-9c9247f9-7994c474-da4791c3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:27.164120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 275 sessionId: src_id|b6be3177-9c9247f9-7994c474-da4791c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:27.166740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:27.169605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.169623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.171681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:27.171720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:27.171723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:27.173670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:27.171726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:27.171728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:27.171739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254708513583623:3913]
2025-10-01T14:07:27.171745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254708513583623:3913]
2025-10-01T14:07:27.171749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254708513583623:3913]
2025-10-01T14:07:27.171795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:27.171802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.171807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:27.171945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:27.173591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:27.173605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:27.173609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:27.186977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254710890444680:3772]
2025-10-01T14:07:27.190797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 274, pipe: [1:7556254710890444680:3772]
2025-10-01T14:07:27.377858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:27.378399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444680:3772], now have 1 active actors on pipe
2025-10-01T14:07:27.386362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.386402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.386582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.386641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.386703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.386762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.386804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.386809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.386891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.387309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.387373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.387440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.387479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.387484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.387544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.387593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.387645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.387697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.387768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.387770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.387831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.387884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.387937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.387989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.388026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.388028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.388086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.388212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.388329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.388443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.388485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.388487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.388548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.388596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.388653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.388710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.388755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.388758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.388831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.388884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.388966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.389017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.389055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.389059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.389119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.389173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.389228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.389281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.389321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.389324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.389394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.389454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.389515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.389572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.389619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.389622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.389687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.389744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.389823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.389883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.389921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.389924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.390589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254710890444680:3772]
2025-10-01T14:07:27.390614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:27.390649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:27.390652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:27.390674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 275 reason: error at write: Disconnected sessionId: src_id|b6be3177-9c9247f9-7994c474-da4791c3_0
2025-10-01T14:07:27.390864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 275 sessionId: src_id|b6be3177-9c9247f9-7994c474-da4791c3_0 is DEAD
2025-10-01T14:07:27.391089Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:27.394622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be3177-9c9247f9-7994c474-da4791c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:27.394634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be3177-9c9247f9-7994c474-da4791c3_0] Write session will restart in 0.006257s
2025-10-01T14:07:27.394660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be3177-9c9247f9-7994c474-da4791c3_0] Write session: Do CDS request
2025-10-01T14:07:27.394667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be3177-9c9247f9-7994c474-da4791c3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:27.406981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be3177-9c9247f9-7994c474-da4791c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:27.414643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:27.414659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 276
2025-10-01T14:07:27.415061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:27.415100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:27.415105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:27.415110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:27.415617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 276 sessionId:  describe result for acl check
2025-10-01T14:07:27.415646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:27.415648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:27.415650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:27.415656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254710890444725:4272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:27.416217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254710890444725:4272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:27.425421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254710890444725:4272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:27.432399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254710890444725:4272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:27.432416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254710890444725:4272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:27.432420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254710890444725:4272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:27.432430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:27.447940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:27.453627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:27.453904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:27.453909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:27.453922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:27.453982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:27.454019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254708513583755:3918]
2025-10-01T14:07:27.454702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:27.458928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:27.459007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:27.459412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:27.459465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.459466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.459468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.459469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.459470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.459471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.459473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.459475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.459476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.459477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.459478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.459479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.459481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.459483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.459490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.459499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.459504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.459507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.459526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.459530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.459534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.459538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.459542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.459546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.459550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.459554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.459557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.459561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.459569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.459577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.459584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.459591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.459598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.459604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.459608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.459614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.459619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.459624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.459629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.459634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.459639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.459644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.459648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.459653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.459658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.459663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.459668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.459673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.459678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.459684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.459688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.459694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.459699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.459704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.459708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.459713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.459755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:27.478940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:27.479601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:27.479607Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:27.479609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:27.479613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:27.479621Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 275 [2:7556254708513583755:3918]
2025-10-01T14:07:27.479639Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:27.479661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:27.479677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.479681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.479683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.479702Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:27.479707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:27.479713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:27.479782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.479783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.479785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.479790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:27.479793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:27.479879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:27.479882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.479895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.479906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.479923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:27.479943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254708513583749:3918]
2025-10-01T14:07:27.479945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254708513583749:3918]
2025-10-01T14:07:27.479947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254708513583749:3918]
2025-10-01T14:07:27.479963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:27.479980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:27.479996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:27.479999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:27.480041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254708513583749:3918]
2025-10-01T14:07:27.480052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:27.480283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:27.480291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:27.480293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:27.480300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:27.481424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444710:2446], now have 1 active actors on pipe
2025-10-01T14:07:27.481435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444785:4272], now have 1 active actors on pipe
2025-10-01T14:07:27.481456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.481462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.481492Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5858284-f4068a19-83914ca9-9ae9a785_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:27.481501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.481506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.481509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:27.481521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.481534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:27.481552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:27.481860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.481866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.481882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:27.481122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 275
2025-10-01T14:07:27.481167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 275
2025-10-01T14:07:27.482020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 276 partition: 0 MaxSeqNo: 45 sessionId: src_id|f5858284-f4068a19-83914ca9-9ae9a785_0
2025-10-01T14:07:27.488350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6be3177-9c9247f9-7994c474-da4791c3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f5858284-f4068a19-83914ca9-9ae9a785_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:27.490659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254710890444817:3772]
2025-10-01T14:07:27.491797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5858284-f4068a19-83914ca9-9ae9a785_0] Write session: try to update token
2025-10-01T14:07:27.491820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5858284-f4068a19-83914ca9-9ae9a785_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:27.497717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 275, pipe: [1:7556254710890444817:3772]
2025-10-01T14:07:27.497864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444817:3772], now have 1 active actors on pipe
2025-10-01T14:07:27.542064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 276 sessionId: src_id|f5858284-f4068a19-83914ca9-9ae9a785_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:27.544833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:27.545247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.545269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.545310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:27.545543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:27.554039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:27.554072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:27.554075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:27.554077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:27.554091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254708513583749:3918]
2025-10-01T14:07:27.554096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254708513583749:3918]
2025-10-01T14:07:27.554100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254708513583749:3918]
2025-10-01T14:07:27.554157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:27.554170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.554173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:27.554339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:27.558025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:27.558033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:27.558037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:27.724000Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:27.732807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.732849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.733025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.733094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.733169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.733228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.733270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.733275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.733348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.733405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.733466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.733529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.733576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.733578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.733644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.733697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.733756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.733812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.733864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.733867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.733931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.733988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.734043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.734102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.734142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.734146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.734204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.734325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.734593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.734657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.734706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.734717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.734781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.734841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.734909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.734979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.735050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.735059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.737194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:27.737268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:27.737278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:27.737306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 276 reason: error at write: Disconnected sessionId: src_id|f5858284-f4068a19-83914ca9-9ae9a785_0
2025-10-01T14:07:27.737509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254710890444817:3772]
2025-10-01T14:07:27.737548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 276 sessionId: src_id|f5858284-f4068a19-83914ca9-9ae9a785_0 is DEAD
2025-10-01T14:07:27.737944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5858284-f4068a19-83914ca9-9ae9a785_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:27.737971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5858284-f4068a19-83914ca9-9ae9a785_0] Write session will restart in 0.008302s
2025-10-01T14:07:27.737996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5858284-f4068a19-83914ca9-9ae9a785_0] Write session: Do CDS request
2025-10-01T14:07:27.738002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5858284-f4068a19-83914ca9-9ae9a785_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:27.735123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.735192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.735252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.735311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.735356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.735360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.735512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.735635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.735748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.735802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.735847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.735850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.735920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.735980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.736039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.736098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.736137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.736140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.736210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:27.736265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:27.736326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:27.736384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:27.736489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:27.736494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:27.737941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:27.747884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5858284-f4068a19-83914ca9-9ae9a785_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:27.748159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:27.748173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 277
2025-10-01T14:07:27.748279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:27.748305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:27.748310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:27.748313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:27.748681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 277 sessionId:  describe result for acl check
2025-10-01T14:07:27.748706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:27.748708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:27.748709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:27.748714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254710890444887:4277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:27.749221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254710890444887:4277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:27.751194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254710890444887:4277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:27.752977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:27.755018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:27.755265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:27.755285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:27.755297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:27.755367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:27.755406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254708513583875:3931]
2025-10-01T14:07:27.755995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:27.756318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:27.756368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:27.756563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254710890444887:4277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:27.756578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254710890444887:4277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:27.756582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254710890444887:4277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:27.756590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:27.756697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:27.756776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.756782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.756783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.756784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.756785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.756787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.756788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.756789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.756790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.756791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.756792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.756793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.756794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.756795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.756800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.756811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.756815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.756830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.756834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.756838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.756841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.756845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.756848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.756851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.756855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.756859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.756862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.756866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.756873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.756881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.756886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.756892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.756896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.756901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.756905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.756910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.756915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.756920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.756924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.756929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.756935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.756940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.756944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.756949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.756954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.756964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.756968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.756973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.756977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.756981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.756985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.756990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.756995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.757000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.757003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.757008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.757046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:27.761149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:27.761777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:27.761792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:27.761794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:27.761798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:27.761807Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 276 [2:7556254708513583875:3931]
2025-10-01T14:07:27.761823Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:27.761840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:27.761853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.761857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.761859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.761875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:27.761881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:27.761888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:27.761939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.761947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.761948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.761951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:27.761954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:27.762018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:27.762025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.762035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.762049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.762100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 276
2025-10-01T14:07:27.762122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 276
2025-10-01T14:07:27.762068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:27.762094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444824:2446], now have 1 active actors on pipe
2025-10-01T14:07:27.762097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444924:4277], now have 1 active actors on pipe
2025-10-01T14:07:27.762104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254708513583870:3931]
2025-10-01T14:07:27.762106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254708513583870:3931]
2025-10-01T14:07:27.762108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254708513583870:3931]
2025-10-01T14:07:27.762121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:27.762133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:27.762147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:27.762150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:27.762177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254708513583870:3931]
2025-10-01T14:07:27.762179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:27.762220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:27.762224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:27.762226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:27.762232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:27.762339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.762352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.763848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71da2905-5fc68b24-e83d8e9-3999a697_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:27.763868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.763875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.763877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:27.763888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.763900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:27.763921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:27.764164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.764177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.764197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:27.764299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 277 partition: 0 MaxSeqNo: 45 sessionId: src_id|71da2905-5fc68b24-e83d8e9-3999a697_0
2025-10-01T14:07:27.764676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5858284-f4068a19-83914ca9-9ae9a785_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|71da2905-5fc68b24-e83d8e9-3999a697_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:27.769858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71da2905-5fc68b24-e83d8e9-3999a697_0] Write session: try to update token
2025-10-01T14:07:27.769876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71da2905-5fc68b24-e83d8e9-3999a697_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:27.785071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:27.785091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:27.785094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:27.785096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:27.785106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254708513583870:3931]
2025-10-01T14:07:27.785111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254708513583870:3931]
2025-10-01T14:07:27.785115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254708513583870:3931]
2025-10-01T14:07:27.785160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:27.785166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:27.785174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.785176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:27.785176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:27.785181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:27.785314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:27.798440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 277 sessionId: src_id|71da2905-5fc68b24-e83d8e9-3999a697_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:27.804395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:27.837709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254710890444934:3772]
2025-10-01T14:07:27.837994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 276, pipe: [1:7556254710890444934:3772]
2025-10-01T14:07:27.933093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:27.933440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.933455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.933478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444934:3772], now have 1 active actors on pipe
2025-10-01T14:07:27.933700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:27.933774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254710890444934:3772]
2025-10-01T14:07:27.933804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:27.933811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:27.933946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:27.933894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 277 reason: error at write: Disconnected sessionId: src_id|71da2905-5fc68b24-e83d8e9-3999a697_0
2025-10-01T14:07:27.934082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 277 sessionId: src_id|71da2905-5fc68b24-e83d8e9-3999a697_0 is DEAD
2025-10-01T14:07:27.934293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da2905-5fc68b24-e83d8e9-3999a697_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:27.934301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da2905-5fc68b24-e83d8e9-3999a697_0] Write session will restart in 0.006634s
2025-10-01T14:07:27.934339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da2905-5fc68b24-e83d8e9-3999a697_0] Write session: Do CDS request
2025-10-01T14:07:27.934346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da2905-5fc68b24-e83d8e9-3999a697_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:27.942206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71da2905-5fc68b24-e83d8e9-3999a697_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:27.942507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:27.942522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 278
2025-10-01T14:07:27.942646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:27.942684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:27.942689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:27.942693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:27.943329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 278 sessionId:  describe result for acl check
2025-10-01T14:07:27.943367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:27.943369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:27.943371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:27.943376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254710890444948:4281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:27.943876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254710890444948:4281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:27.946381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254710890444948:4281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:27.949251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254710890444948:4281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:27.949264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254710890444948:4281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:27.949267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254710890444948:4281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:27.949286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:27.965904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:27.967576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:27.967834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:27.967843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:27.967855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:27.967906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:27.967943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254708513583992:3933]
2025-10-01T14:07:27.968481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:27.968737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:27.968776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:27.969081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:27.969150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.969155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.969156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.969158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.969159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.969160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.969161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.969162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.969163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.969165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.969166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.969167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.969168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.969169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.969175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.969185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.969189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.969193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.969197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.969200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.969204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.969208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.969212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.969215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.969218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.969221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.969225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.969229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.969236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.969243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:27.969249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.969255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:27.969259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.969265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:27.969269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.969274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:27.969278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.969289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:27.969293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.969298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:27.969302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.969306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:27.969313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.969318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:27.969323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.969342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:27.969351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.969355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.969358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.969363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.969367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.969372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.969376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.969384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:27.969388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.969392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:27.969445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:27.977597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:27.978288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:27.978304Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:27.978307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:27.978311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:27.978318Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 277 [2:7556254708513583992:3933]
2025-10-01T14:07:27.978337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:27.978357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:27.978365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.978382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.978384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.978404Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:27.978410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:27.978417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:27.978482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.978490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.978492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.978495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:27.978498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:27.978570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:27.978577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:27.978590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:27.978603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:27.978622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:27.978642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254708513583987:3933]
2025-10-01T14:07:27.978650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254708513583987:3933]
2025-10-01T14:07:27.978652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254708513583987:3933]
2025-10-01T14:07:27.978660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:27.978668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:27.978671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:27.978676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:27.978679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:27.978692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:27.978700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:27.978711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444936:2446], now have 1 active actors on pipe
2025-10-01T14:07:27.978718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254710890444983:4281], now have 1 active actors on pipe
2025-10-01T14:07:27.978758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254708513583987:3933]
2025-10-01T14:07:27.978770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:27.978820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:27.979019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.979030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.979057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:27.979068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:27.979077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:27.979079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:27.979089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:27.979103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:27.979117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:27.979567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:27.979576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:27.979596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:27.980171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da2905-5fc68b24-e83d8e9-3999a697_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:27.978742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 277
2025-10-01T14:07:27.978789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 277
2025-10-01T14:07:27.979760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 278 partition: 0 MaxSeqNo: 45 sessionId: src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0
2025-10-01T14:07:27.982770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0] Write session: try to update token
2025-10-01T14:07:27.982792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:28.003397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 278 sessionId: src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:28.006200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:28.011293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.011321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.011345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:28.011349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:28.011358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254708513583987:3933]
2025-10-01T14:07:28.011391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:28.011411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:28.011579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:28.011729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:28.011878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:28.012024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:28.012334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:28.012216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:28.012261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:28.012282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:28.028338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:28.028364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:28.028366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:28.028368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:28.028379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254708513583987:3933]
2025-10-01T14:07:28.028383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254708513583987:3933]
2025-10-01T14:07:28.028387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254708513583987:3933]
2025-10-01T14:07:28.028433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:28.028435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:28.028439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:28.028443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:28.028443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.028446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:28.028576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:28.038773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254715185412355:3772]
2025-10-01T14:07:28.039540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 277, pipe: [1:7556254715185412355:3772]
2025-10-01T14:07:28.187479Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:28.196100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.196137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.196316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.196390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.196454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.196519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.196561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.196570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.196637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.196697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.196754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.196813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.196866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.196869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.196933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.196988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.197043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.197101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.197141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.197146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.197207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.197262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.197318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.197376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.197417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.197420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.197483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.197536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.197589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.197641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.197684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.197686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.197757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.197810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.197868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.197927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.197969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.197972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.198036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.198090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.198146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.198207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.198247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.198250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.198316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.200105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:28.200162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254715185412355:3772]
2025-10-01T14:07:28.200183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:28.200185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:28.200212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 278 reason: error at write: Disconnected sessionId: src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0
2025-10-01T14:07:28.198588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.198655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.198712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.198768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.198771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.198842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.198900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.198965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.199024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.199064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.199067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.199131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.199184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.199243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.199304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.199347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.199349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.199422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412355:3772], now have 1 active actors on pipe
2025-10-01T14:07:28.200525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:28.201296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 278 sessionId: src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0 is DEAD
2025-10-01T14:07:28.202615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:28.202640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0] Write session will restart in 0.006204s
2025-10-01T14:07:28.202669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0] Write session: Do CDS request
2025-10-01T14:07:28.202676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:28.210004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:28.210009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:28.210025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 279
2025-10-01T14:07:28.210229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:28.210259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:28.210264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:28.210268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:28.210435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:28.210659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 279 sessionId:  describe result for acl check
2025-10-01T14:07:28.210690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:28.210711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:28.210713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:28.210718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254715185412433:4287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:28.211498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254715185412433:4287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:28.212188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:28.212394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:28.212405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:28.212423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:28.212482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:28.212520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254712808551392:3936]
2025-10-01T14:07:28.213153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:28.213454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:28.213504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:28.213860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:28.213929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.213937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.213938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.213939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.213940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.213941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.213942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.213951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.213952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.213953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.213954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.213955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.213957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.213958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.213963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.213706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254715185412433:4287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:28.213971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.213974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.213977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.213980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.213984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.213987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.213990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.213994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.213998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.214001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.214004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.214007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.214010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.214017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.214024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.214029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.214034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.214038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.214042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.214046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.214050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.214054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.214059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.214063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.214068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.214072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.214077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.214082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.214087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.214091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.214095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.214099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.214103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.214109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.214113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.214117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.214122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.214126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.214131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.214135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.214140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.214178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:28.217885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254715185412433:4287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:28.217901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254715185412433:4287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:28.217905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254715185412433:4287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:28.217922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:28.218111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:28.218802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:28.218815Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:28.218818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:28.218822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:28.218831Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 278 [2:7556254712808551392:3936]
2025-10-01T14:07:28.218847Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:28.218864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:28.218873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.218879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.218881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.218897Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:28.218902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:28.218908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:28.218965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.218971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.218973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.218976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:28.218980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:28.219048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:28.219055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.219068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.219083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.219105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:28.219127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254712808551386:3936]
2025-10-01T14:07:28.219130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254712808551386:3936]
2025-10-01T14:07:28.219132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254712808551386:3936]
2025-10-01T14:07:28.219144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:28.219158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:28.219176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:28.219183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:28.219192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:28.219203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:28.219206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:28.219216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254712808551386:3936]
2025-10-01T14:07:28.219224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:28.219285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:28.219336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412472:4287], now have 1 active actors on pipe
2025-10-01T14:07:28.219345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412365:2446], now have 1 active actors on pipe
2025-10-01T14:07:28.219414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 278
2025-10-01T14:07:28.219456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.219431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 278
2025-10-01T14:07:28.219465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.219491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:28.219502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.219506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.219513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:28.219521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.219529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:28.219543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:28.219663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.219670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.219683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:28.219771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 279 partition: 0 MaxSeqNo: 45 sessionId: src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0
2025-10-01T14:07:28.226490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98417ab5-184cc387-d302ea71-31c7cc6e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:28.229163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0] Write session: try to update token
2025-10-01T14:07:28.229183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:28.244726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:28.244748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:28.244751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:28.244753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:28.244762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254712808551386:3936]
2025-10-01T14:07:28.244767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254712808551386:3936]
2025-10-01T14:07:28.244771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254712808551386:3936]
2025-10-01T14:07:28.244838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:28.244837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:28.244843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:28.244847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:28.244854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.244857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:28.245000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:28.251812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 279 sessionId: src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:28.254449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:28.300555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254715185412493:3772]
2025-10-01T14:07:28.306614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 278, pipe: [1:7556254715185412493:3772]
2025-10-01T14:07:28.400156Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:28.400605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.400623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.400668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412493:3772], now have 1 active actors on pipe
2025-10-01T14:07:28.400889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:28.400902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:28.400867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:28.400963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 279 reason: error at write: Disconnected sessionId: src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0
2025-10-01T14:07:28.401161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 279 sessionId: src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0 is DEAD
2025-10-01T14:07:28.401310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254715185412493:3772]
2025-10-01T14:07:28.401325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:28.401557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:28.401566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0] Write session will restart in 0.005204s
2025-10-01T14:07:28.401601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0] Write session: Do CDS request
2025-10-01T14:07:28.401606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:28.407978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:28.408072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:28.408092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 280
2025-10-01T14:07:28.408473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:28.408508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:28.408517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:28.408521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:28.408940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 280 sessionId:  describe result for acl check
2025-10-01T14:07:28.408984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:28.408991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:28.408992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:28.408997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254715185412515:4298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:28.409523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254715185412515:4298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:28.411492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254715185412515:4298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:28.414756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254715185412515:4298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:28.414772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254715185412515:4298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:28.414775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254715185412515:4298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:28.414784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:28.417979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:28.419953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:28.420251Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:28.420263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:28.420277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:28.420343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:28.420389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254712808551507:3941]
2025-10-01T14:07:28.421008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:28.421350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:28.421409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:28.421774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:28.421835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.421841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.421842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.421843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.421844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.421845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.421846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.421847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.421848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.421850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.421851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.421852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.421853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.421854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.421861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.421873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.421877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.421881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.421885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.421889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.421895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.421899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.421903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.421909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.421912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.421916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.421920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.421923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.421930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.421937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.421943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.421949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.421953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.421963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.421968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.421974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.421979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.421984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.421988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.421992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.421999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.422004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.422009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.422016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.422021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.422027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.422032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.422037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.422043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.422050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.422058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.422063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.422067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.422074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.422078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.422083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.422125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:28.426141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:28.426788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:28.426806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:28.426809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:28.426812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:28.426819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 279 [2:7556254712808551507:3941]
2025-10-01T14:07:28.426836Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:28.426860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:28.426863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.426868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.426870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.426890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:28.426896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:28.426902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:28.426962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.426968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.426971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.426974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:28.426977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:28.427043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:28.427049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.427057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.427063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.427072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:28.427086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254712808551502:3941]
2025-10-01T14:07:28.427092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254712808551502:3941]
2025-10-01T14:07:28.427095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254712808551502:3941]
2025-10-01T14:07:28.427109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:28.427127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:28.427143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:28.427148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:28.427176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254712808551502:3941]
2025-10-01T14:07:28.427182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:28.427330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:28.427336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:28.427337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:28.427341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:28.427344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412504:2446], now have 1 active actors on pipe
2025-10-01T14:07:28.427350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412571:4298], now have 1 active actors on pipe
2025-10-01T14:07:28.427432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 279
2025-10-01T14:07:28.427436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 279
2025-10-01T14:07:28.427514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.427523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.427544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:28.427553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.427557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.427558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:28.427565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.427576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:28.427588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:28.428515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.428531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.428554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:28.428674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 280 partition: 0 MaxSeqNo: 45 sessionId: src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0
2025-10-01T14:07:28.429120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b1c8c4-74e334d2-c0321b6a-41376895_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:28.431718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0] Write session: try to update token
2025-10-01T14:07:28.431737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:28.451807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:28.451826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:28.451829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:28.451831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:28.451842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254712808551502:3941]
2025-10-01T14:07:28.451847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254712808551502:3941]
2025-10-01T14:07:28.451852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254712808551502:3941]
2025-10-01T14:07:28.451902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:28.451915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:28.451920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:28.451923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.451923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:28.451925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:28.452073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:28.453274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 280 sessionId: src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:28.456089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:28.501248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254715185412617:3772]
2025-10-01T14:07:28.501713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 279, pipe: [1:7556254715185412617:3772]
2025-10-01T14:07:28.608725Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:28.609053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.609069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.609112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412617:3772], now have 1 active actors on pipe
2025-10-01T14:07:28.609530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:28.615019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:28.615090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254715185412617:3772]
2025-10-01T14:07:28.615115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:28.615193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 280 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0
2025-10-01T14:07:28.615385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 280 sessionId: src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0 is DEAD
2025-10-01T14:07:28.615943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:28.615959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0] Write session will restart in 0.006282s
2025-10-01T14:07:28.615989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0] Write session: Do CDS request
2025-10-01T14:07:28.615997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:28.623893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:28.624090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:28.624105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 281
2025-10-01T14:07:28.624214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:28.624249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:28.624254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:28.624258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:28.624661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 281 sessionId:  describe result for acl check
2025-10-01T14:07:28.624712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:28.624717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:28.624719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:28.624725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254715185412637:4303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:28.625223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254715185412637:4303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:28.628380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254715185412637:4303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:28.628936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:28.630603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:28.630787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:28.630799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:28.630809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:28.630865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:28.630900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254712808551644:3954]
2025-10-01T14:07:28.631303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254715185412637:4303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:28.631315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254715185412637:4303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:28.631319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254715185412637:4303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:28.631326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:28.631440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:28.631703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:28.631748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:28.632035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:28.632099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.632104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.632105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.632106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.632107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.632109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.632110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.632111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.632112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.632113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.632114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.632115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.632116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.632117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.632123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.632133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.632137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.632141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.632145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.632149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.632153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.632157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.632161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.632166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.632169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.632173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.632180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.632184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.632195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.632206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.632214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.632222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.632230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.632236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.632243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.632249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.632258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.632263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.632270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.632276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.632280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.632285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.632292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.632298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.632305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.632310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.632318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.632323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.632333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.632342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.632346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.632354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.632358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.632366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.632370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.632375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.632416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:28.636502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:28.637168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:28.637180Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:28.637181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:28.637184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:28.637189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 280 [2:7556254712808551644:3954]
2025-10-01T14:07:28.637204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:28.637220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:28.637225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.637228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.637230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.637242Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:28.637246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:28.637251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:28.637295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.637300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.637301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.637303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:28.637305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:28.637354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:28.637359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.637366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.637372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.637382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:28.637397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254712808551638:3954]
2025-10-01T14:07:28.637401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254712808551638:3954]
2025-10-01T14:07:28.637403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254712808551638:3954]
2025-10-01T14:07:28.637410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:28.637417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:28.637420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:28.637422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:28.637429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412722:4303], now have 1 active actors on pipe
2025-10-01T14:07:28.637432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412623:2446], now have 1 active actors on pipe
2025-10-01T14:07:28.637437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:28.637450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:28.637456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:28.637485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254712808551638:3954]
2025-10-01T14:07:28.637489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:28.637510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:28.637495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 280
2025-10-01T14:07:28.637510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 280
2025-10-01T14:07:28.637580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.637592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.637620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5945600e-493cdf9e-e4258281-7bcfd670_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:28.637631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.637634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.637637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:28.637643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.637651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:28.637666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:28.637794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.637804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.637819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:28.637885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 281 partition: 0 MaxSeqNo: 45 sessionId: src_id|5945600e-493cdf9e-e4258281-7bcfd670_0
2025-10-01T14:07:28.638581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dc2306b-7169b79f-863ac5ac-efeb8039_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5945600e-493cdf9e-e4258281-7bcfd670_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:28.641174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5945600e-493cdf9e-e4258281-7bcfd670_0] Write session: try to update token
2025-10-01T14:07:28.641193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5945600e-493cdf9e-e4258281-7bcfd670_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:28.648854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:28.648873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:28.648883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254712808551638:3954]
2025-10-01T14:07:28.648935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:28.649111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:28.649256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:28.649454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:28.649666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:28.649856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:28.649902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:28.651039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:28.655489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 281 sessionId: src_id|5945600e-493cdf9e-e4258281-7bcfd670_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:28.658148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:28.658358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.658398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.658439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:28.658518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:28.674423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:28.674444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:28.674446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:28.674449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:28.674458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254712808551638:3954]
2025-10-01T14:07:28.674463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254712808551638:3954]
2025-10-01T14:07:28.674466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254712808551638:3954]
2025-10-01T14:07:28.674515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:28.674518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:28.674527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:28.674528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.674530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:28.674533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:28.674666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:28.715309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254715185412735:3772]
2025-10-01T14:07:28.715620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 280, pipe: [1:7556254715185412735:3772]
2025-10-01T14:07:28.836367Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:28.844362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.844390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.844552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.844612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.844680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.844739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.844779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.844784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.844865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.844924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.845007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.845063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.845108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.845118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.845176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.845231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.845296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.845349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.845393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.845402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.845458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.845515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.845571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.845628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.845667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.845673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.845730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.845785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.845838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.845895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.845942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.845949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.846017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.846076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.846137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.846196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.846246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.846254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.846320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.846400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.846476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.846547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.846596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.846602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.846665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.846720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.846781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.846837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.846881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.846887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.846951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.847012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.847076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.847138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.847185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.847191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.847251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:28.847308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:28.847366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:28.847425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:28.847467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:28.847473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:28.847537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412735:3772], now have 1 active actors on pipe
2025-10-01T14:07:28.848487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:28.847794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:28.847801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:28.847807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:28.847843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 281 reason: error at write: Disconnected sessionId: src_id|5945600e-493cdf9e-e4258281-7bcfd670_0
2025-10-01T14:07:28.847851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254715185412735:3772]
2025-10-01T14:07:28.848072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 281 sessionId: src_id|5945600e-493cdf9e-e4258281-7bcfd670_0 is DEAD
2025-10-01T14:07:28.850461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945600e-493cdf9e-e4258281-7bcfd670_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:28.850479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945600e-493cdf9e-e4258281-7bcfd670_0] Write session will restart in 0.008919s
2025-10-01T14:07:28.850506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945600e-493cdf9e-e4258281-7bcfd670_0] Write session: Do CDS request
2025-10-01T14:07:28.850513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945600e-493cdf9e-e4258281-7bcfd670_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:28.858669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:28.860752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:28.860986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5945600e-493cdf9e-e4258281-7bcfd670_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:28.860973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:28.860983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:28.860992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:28.861000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:28.861016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 282
2025-10-01T14:07:28.861038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:28.861081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254712808551751:3956]
2025-10-01T14:07:28.861214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:28.861242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:28.861251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:28.861255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:28.861639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:28.861666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 282 sessionId:  describe result for acl check
2025-10-01T14:07:28.861697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:28.861703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:28.861706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:28.861712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254715185412806:4307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:28.861905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:28.861939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:28.862178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:28.862190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254715185412806:4307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:28.862222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.862227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.862227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.862228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.862229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.862230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.862230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.862231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.862232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.862232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.862233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.862233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.862234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.862235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.862238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.862243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.862245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.862248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.862250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.862252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.862254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.862256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.862258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.862260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.862262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.862264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.862266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.862268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.862272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.862276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:28.862280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.862283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:28.862285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.862289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:28.862291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.862294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:28.862297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.862300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:28.862302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.862304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:28.862306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.862309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:28.862311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.862314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:28.862317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.862319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:28.862322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.862324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.862327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.862329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.862332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.862334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.862337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.862339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:28.862341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.862344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:28.862387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:28.864261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254715185412806:4307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:28.866177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:28.866796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:28.866811Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:28.866814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:28.866817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:28.866824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 281 [2:7556254712808551751:3956]
2025-10-01T14:07:28.866838Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:28.866853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:28.866863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.866866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.866868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.866884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:28.866889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:28.866896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:28.866947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.866956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.866958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.866962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:28.866965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:28.867022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254715185412806:4307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:28.867036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254715185412806:4307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:28.867030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:28.867040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254715185412806:4307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:28.867041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.867052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:28.867047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:28.867062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:28.867077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:28.867100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412737:2446], now have 1 active actors on pipe
2025-10-01T14:07:28.867113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254712808551745:3956]
2025-10-01T14:07:28.867115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254712808551745:3956]
2025-10-01T14:07:28.867117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254712808551745:3956]
2025-10-01T14:07:28.867134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:28.867151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:28.867171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 281
2025-10-01T14:07:28.867170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:28.867178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:28.867207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254712808551745:3956]
2025-10-01T14:07:28.867211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:28.867214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:28.867214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:28.867215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:28.867222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:28.867334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412844:4307], now have 1 active actors on pipe
2025-10-01T14:07:28.867364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 281
2025-10-01T14:07:28.867426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.867437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.867463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:28.867475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:28.867481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:28.867503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:28.867513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:28.867528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:28.867545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:28.867792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.867803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.867827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:28.867894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 282 partition: 0 MaxSeqNo: 45 sessionId: src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0
2025-10-01T14:07:28.868228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5945600e-493cdf9e-e4258281-7bcfd670_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:28.870820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0] Write session: try to update token
2025-10-01T14:07:28.870837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:28.879716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:28.879742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:28.879752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254712808551745:3956]
2025-10-01T14:07:28.879798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:28.879806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:28.879985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:28.880141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:28.880299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:28.880459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:28.880662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:28.880723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:28.888870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 282 sessionId: src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:28.891513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:28.891677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:28.891698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:28.891733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:28.891794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:28.905406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:28.905427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:28.905430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:28.905432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:28.905443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254712808551745:3956]
2025-10-01T14:07:28.905448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254712808551745:3956]
2025-10-01T14:07:28.905452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254712808551745:3956]
2025-10-01T14:07:28.905511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:28.905516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:28.905522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:28.905523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:28.905525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:28.905527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:28.905660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:28.949824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254715185412851:3772]
2025-10-01T14:07:28.950265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 281, pipe: [1:7556254715185412851:3772]
2025-10-01T14:07:29.067348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:29.075430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.075458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.075623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.075694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.075763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.075835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.076258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.076263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.076342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.076403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.076459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.076522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.076560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.076565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.076628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.076685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.076745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.076896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.076948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.076955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.077017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.077071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.077126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.077177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.077218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.077223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.077288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.077354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.077420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.077490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.077542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.077551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.077620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.077683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.077759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.077826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.077876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.077884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.077953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.078024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.078098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.078163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.078205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.078212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.078280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.078341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.078424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.078493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.078579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.078587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.078648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.080069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:29.080081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0] Write session will restart in 0.006591s
2025-10-01T14:07:29.080106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0] Write session: Do CDS request
2025-10-01T14:07:29.080111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:29.078705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.078766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.078823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.078871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.078873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.079013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.079153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.079215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.079273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.079312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.079316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.079390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254715185412851:3772], now have 1 active actors on pipe
2025-10-01T14:07:29.080167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:29.079648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:29.079662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:29.079666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254715185412851:3772]
2025-10-01T14:07:29.079691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 282 reason: error at write: Disconnected sessionId: src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0
2025-10-01T14:07:29.079693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:29.079905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 282 sessionId: src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0 is DEAD
2025-10-01T14:07:29.088045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:29.088128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:29.088143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 283
2025-10-01T14:07:29.090830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:29.090879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:29.090886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:29.090891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:29.091274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 283 sessionId:  describe result for acl check
2025-10-01T14:07:29.091302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:29.091303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:29.091305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:29.091311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254719480380228:4312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:29.091829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254719480380228:4312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:29.094035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254719480380228:4312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:29.094042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:29.096478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:29.096700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:29.096711Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:29.096723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:29.097219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254719480380228:4312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:29.097233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254719480380228:4312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:29.097236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254719480380228:4312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:29.097245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:29.096778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:29.096829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254717103519168:3959]
2025-10-01T14:07:29.097427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:29.097682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:29.097732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:29.097969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:29.098023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.098029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.098030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.098031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.098032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.098033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.098035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.098036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.098037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.098038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.098039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.098040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.098041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.098042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.098046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.098056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.098060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.098064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.098067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.098071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.098074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.098077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.098081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.098084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.098088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.098092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.098096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.098100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.098107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.098115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.098121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.098127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.098132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.098137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.098141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.098147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.098152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.098157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.098161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.098167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.098173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.098178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.098183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.098188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.098193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.098199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.098203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.098209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.098214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.098219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.098224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.098229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.098238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.098243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.098246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.098251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.098287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:29.103233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:29.103844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:29.103859Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:29.103861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:29.103865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:29.103871Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 282 [2:7556254717103519168:3959]
2025-10-01T14:07:29.103891Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:29.103913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:29.103924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.103927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.103930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.103946Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:29.103952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:29.103958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:29.104013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.104022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.104024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.104027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:29.104030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:29.104096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:29.104105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.104116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.104128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.104145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:29.104169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380162:2446], now have 1 active actors on pipe
2025-10-01T14:07:29.104177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380266:4312], now have 1 active actors on pipe
2025-10-01T14:07:29.104185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254717103519163:3959]
2025-10-01T14:07:29.104193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254717103519163:3959]
2025-10-01T14:07:29.104195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254717103519163:3959]
2025-10-01T14:07:29.104213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:29.104231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:29.104236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:29.104241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:29.104243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:29.104246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:29.104249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:29.104215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 282
2025-10-01T14:07:29.104230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 282
2025-10-01T14:07:29.104293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.104302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.104315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254717103519163:3959]
2025-10-01T14:07:29.104322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:29.104339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:29.104355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:29.104367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.104376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.104383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:29.104392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.104404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:29.104428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:29.104560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.104568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.104580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:29.104651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 283 partition: 0 MaxSeqNo: 45 sessionId: src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0
2025-10-01T14:07:29.105045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75394683-ff6ba4a-ba93f6b5-4c467c71_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:29.107453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0] Write session: try to update token
2025-10-01T14:07:29.107491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:29.121014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 283 sessionId: src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:29.123428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:29.125249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.125272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.125292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:29.125296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:29.125298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:29.125300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:29.125309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254717103519163:3959]
2025-10-01T14:07:29.125314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254717103519163:3959]
2025-10-01T14:07:29.125317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254717103519163:3959]
2025-10-01T14:07:29.125358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:29.125372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:29.125373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:29.125376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:29.125379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.125381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:29.125515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:29.179946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254719480380283:3772]
2025-10-01T14:07:29.180243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 282, pipe: [1:7556254719480380283:3772]
2025-10-01T14:07:29.276059Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:29.276299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:29.276354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380283:3772], now have 1 active actors on pipe
2025-10-01T14:07:29.276439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:29.276482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:29.276519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:29.276522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:29.276543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254719480380283:3772]
2025-10-01T14:07:29.276594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 283 reason: error at write: Disconnected sessionId: src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0
2025-10-01T14:07:29.276730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 283 sessionId: src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0 is DEAD
2025-10-01T14:07:29.276904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:29.276925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0] Write session will restart in 0.006374s
2025-10-01T14:07:29.276967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0] Write session: Do CDS request
2025-10-01T14:07:29.276976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:29.284923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:29.285347Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:29.285365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 284
2025-10-01T14:07:29.285632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:29.285665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:29.285671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:29.285686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:29.286282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 284 sessionId:  describe result for acl check
2025-10-01T14:07:29.286316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:29.286318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:29.286320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:29.286324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254719480380295:4317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:29.286897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254719480380295:4317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:29.294920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254719480380295:4317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:29.307321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254719480380295:4317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:29.307339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254719480380295:4317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:29.307343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254719480380295:4317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:29.307353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:29.308764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:29.310856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:29.311065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:29.311077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:29.311089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:29.311152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:29.311193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254717103519281:3962]
2025-10-01T14:07:29.311801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:29.312061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:29.312115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:29.312463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:29.312532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.312537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.312539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.312540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.312541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.312543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.312544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.312546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.312547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.312548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.312549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.312551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.312552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.312553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.312558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.312569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.312573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.312577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.312582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.312586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.312589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.312593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.312596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.312600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.312604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.312620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.312624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.312627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.312634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.312645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.312655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.312659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.312669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.312674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.312683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.312688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.312698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.312703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.312707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.312713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.312717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.312722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.312727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.312732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.312743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.312748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.312756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.312761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.312769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.312774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.312780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.312788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.312793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.312798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.312806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.312810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.312858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:29.316929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:29.317529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:29.317546Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:29.317550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:29.317553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:29.317561Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 283 [2:7556254717103519281:3962]
2025-10-01T14:07:29.317576Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:29.317598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:29.317605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.317609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.317611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.317628Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:29.317637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:29.317644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:29.317697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.317704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.317706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.317709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:29.317711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:29.317769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:29.317779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.317790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.317801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.317818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:29.317836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380391:4317], now have 1 active actors on pipe
2025-10-01T14:07:29.317848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380288:2446], now have 1 active actors on pipe
2025-10-01T14:07:29.317856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254717103519275:3962]
2025-10-01T14:07:29.317860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254717103519275:3962]
2025-10-01T14:07:29.317862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254717103519275:3962]
2025-10-01T14:07:29.317875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:29.317887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:29.317887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:29.317890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:29.317892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:29.317906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:29.317909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:29.317906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 283
2025-10-01T14:07:29.317950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.317959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.317972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254717103519275:3962]
2025-10-01T14:07:29.317950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 283
2025-10-01T14:07:29.317979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:29.317984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:29.318003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:29.318015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.318020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.318022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:29.318030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.318039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:29.318061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:29.318290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.318299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.318313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:29.318448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 284 partition: 0 MaxSeqNo: 45 sessionId: src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0
2025-10-01T14:07:29.318830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17665d3a-19f5bf4c-e5410cbf-d1bea52_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:29.321248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0] Write session: try to update token
2025-10-01T14:07:29.321264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:29.355985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 284 sessionId: src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:29.358466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:29.358694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.358717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.358765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:29.362513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:29.367949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:29.367972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:29.367974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:29.367976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:29.367986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254717103519275:3962]
2025-10-01T14:07:29.367992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254717103519275:3962]
2025-10-01T14:07:29.367996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254717103519275:3962]
2025-10-01T14:07:29.368044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:29.368055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:29.368058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.368061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:29.368061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:29.368065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:29.368194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:29.379518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254719480380418:3772]
2025-10-01T14:07:29.389061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 283, pipe: [1:7556254719480380418:3772]
2025-10-01T14:07:29.518400Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:29.518772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380418:3772], now have 1 active actors on pipe
2025-10-01T14:07:29.525850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.525882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.526053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.526119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.526186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.526255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.526305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.526311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.526408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.529256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:29.529279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:29.529309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 284 reason: error at write: Disconnected sessionId: src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0
2025-10-01T14:07:29.529499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 284 sessionId: src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0 is DEAD
2025-10-01T14:07:29.529611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254719480380418:3772]
2025-10-01T14:07:29.529626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:29.529858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:29.529872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0] Write session will restart in 0.007571s
2025-10-01T14:07:29.529899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0] Write session: Do CDS request
2025-10-01T14:07:29.529905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:29.526481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.526552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.526621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.526670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.526673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.526748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.526802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.526860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.526917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.526956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.526959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.527028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.527086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.527141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.527202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.527243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.527246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.527309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.527363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.527418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.527477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.527527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.527530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.527592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.527645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.527701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.527764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.527803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.527806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.527869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.527920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.527972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.528024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.528065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.528066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.528127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.528177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.528232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.528286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.528325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.528327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.528387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.528437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.528502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.528558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.528597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.528599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.528668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:29.528723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:29.528775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:29.528852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:29.528894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:29.528897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:29.529856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:29.543453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:29.545646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:29.545662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 285
2025-10-01T14:07:29.545841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:29.545868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:29.545873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:29.545877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:29.546593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 285 sessionId:  describe result for acl check
2025-10-01T14:07:29.546631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:29.546633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:29.546635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:29.546640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254719480380453:4328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:29.547107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254719480380453:4328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:29.550680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254719480380453:4328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:29.559816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254719480380453:4328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:29.559839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254719480380453:4328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:29.559843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254719480380453:4328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:29.559854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:29.560672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:29.563422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:29.563676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:29.563681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:29.563702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:29.563772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:29.563809Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254717103519412:3966]
2025-10-01T14:07:29.564417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:29.570949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:29.571052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:29.571505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:29.571582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.571584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.571585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.571587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.571588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.571595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.571597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.571599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.571600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.571602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.571603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.571604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.571606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.571607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.571614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.571624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.571628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.571632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.571635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.571638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.571642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.571646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.571650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.571655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.571660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.571664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.571667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.571671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.571681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.571689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.571696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.571702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.571706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.571711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.571715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.571720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.571728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.571734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.571739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.571743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.571749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.571756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.571760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.571769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.571774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.571780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.571785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.571791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.571796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.571801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.571806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.571812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.571817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.571822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.571827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.571832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.571875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:29.586575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:29.587575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:29.587581Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:29.587584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:29.587589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:29.587597Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 284 [2:7556254717103519412:3966]
2025-10-01T14:07:29.587623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:29.587642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:29.587646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.587650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.587653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.587674Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:29.587680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:29.587686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:29.587785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.587789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.587793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.587797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:29.587801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:29.587930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:29.587936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.587951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.587962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.587977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:29.587996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254717103519405:3966]
2025-10-01T14:07:29.587998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254717103519405:3966]
2025-10-01T14:07:29.588001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254717103519405:3966]
2025-10-01T14:07:29.588021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:29.588036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:29.588049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:29.588053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:29.588083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:29.588087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:29.588092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:29.588094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254717103519405:3966]
2025-10-01T14:07:29.588097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:29.588099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:29.588349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 284
2025-10-01T14:07:29.588385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 284
2025-10-01T14:07:29.588609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380534:4328], now have 1 active actors on pipe
2025-10-01T14:07:29.588621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380430:2446], now have 1 active actors on pipe
2025-10-01T14:07:29.588635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.588641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.588671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:29.588679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.588684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.588686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:29.588699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.588711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:29.588725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:29.589023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.589029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.589042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:29.589172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 285 partition: 0 MaxSeqNo: 45 sessionId: src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0
2025-10-01T14:07:29.589610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c9b18ef-48381e4d-5679ba84-e3384d85_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:29.592944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0] Write session: try to update token
2025-10-01T14:07:29.592967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:29.613071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:29.613093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:29.613095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:29.613096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:29.613108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254717103519405:3966]
2025-10-01T14:07:29.613113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254717103519405:3966]
2025-10-01T14:07:29.613117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254717103519405:3966]
2025-10-01T14:07:29.613167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:29.613174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.613176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:29.613316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:29.613351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:29.613360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:29.613366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:29.615703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 285 sessionId: src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:29.618416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:29.629695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254719480380549:3772]
2025-10-01T14:07:29.630099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 284, pipe: [1:7556254719480380549:3772]
2025-10-01T14:07:29.780783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:29.780799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0] Write session will restart in 0.008338s
2025-10-01T14:07:29.780848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0] Write session: Do CDS request
2025-10-01T14:07:29.780854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:29.780326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254719480380549:3772]
2025-10-01T14:07:29.780360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:29.780378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:29.780446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 285 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0
2025-10-01T14:07:29.780636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 285 sessionId: src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0 is DEAD
2025-10-01T14:07:29.778856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:29.779638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.779649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.779691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380549:3772], now have 1 active actors on pipe
2025-10-01T14:07:29.779948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:29.790161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:29.790585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:29.790601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 286
2025-10-01T14:07:29.790735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:29.790762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:29.790767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:29.790771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:29.792210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 286 sessionId:  describe result for acl check
2025-10-01T14:07:29.792245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:29.792248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:29.792249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:29.792255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254719480380575:4333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:29.792807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254719480380575:4333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:29.798549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254719480380575:4333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:29.802465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:29.805361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:29.805580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:29.805591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:29.805602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:29.805651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:29.805690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254717103519541:3979]
2025-10-01T14:07:29.806306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:29.804875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254719480380575:4333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:29.804892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254719480380575:4333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:29.804896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254719480380575:4333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:29.804904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:29.806624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:29.806699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:29.807027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:29.807100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.807105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.807107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.807108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.807109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.807110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.807111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.807112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.807113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.807115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.807116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.807118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.807119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.807120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.807135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.807144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.807148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.807152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.807155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.807158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.807161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.807165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.807168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.807171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.807174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.807178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.807181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.807185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.807192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.807200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:29.807206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.807211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:29.807216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.807221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:29.807225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.807230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:29.807235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.807240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:29.807245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.807250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:29.807255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.807260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:29.807264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.807269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:29.807274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.807279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:29.807283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.807289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.807294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.807299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.807303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.807308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.807312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.807317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:29.807322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.807327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:29.807367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:29.816689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 285
2025-10-01T14:07:29.816718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 285
2025-10-01T14:07:29.814648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:29.815403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:29.815409Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:29.815412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:29.815416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:29.815424Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 285 [2:7556254717103519541:3979]
2025-10-01T14:07:29.815443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:29.815462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:29.815466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.815470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.815473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.815491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:29.815497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:29.815504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:29.815572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.815574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.815577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.815581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:29.815584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:29.815660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:29.815663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.815676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:29.815689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:29.815707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:29.815725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254717103519536:3979]
2025-10-01T14:07:29.815728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254717103519536:3979]
2025-10-01T14:07:29.815730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254717103519536:3979]
2025-10-01T14:07:29.815745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:29.815761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:29.815776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:29.815780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:29.815817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254717103519536:3979]
2025-10-01T14:07:29.815820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:29.815966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:29.815968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:29.815970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:29.815975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:29.821617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380658:4333], now have 1 active actors on pipe
2025-10-01T14:07:29.821635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380552:2446], now have 1 active actors on pipe
2025-10-01T14:07:29.821655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.821663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.821699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3231a284-897de2f7-63227b3f-18a73e85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:29.821710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:29.821716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:29.821720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:29.821732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:29.821749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:29.821773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:29.823538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:29.823552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:29.823585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:29.823760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 286 partition: 0 MaxSeqNo: 45 sessionId: src_id|3231a284-897de2f7-63227b3f-18a73e85_0
2025-10-01T14:07:29.824338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9449347-78ab7642-f8bbbf47-6805eb77_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3231a284-897de2f7-63227b3f-18a73e85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:29.827362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3231a284-897de2f7-63227b3f-18a73e85_0] Write session: try to update token
2025-10-01T14:07:29.827384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3231a284-897de2f7-63227b3f-18a73e85_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:29.846401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:29.846420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:29.846423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:29.846425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:29.846435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254717103519536:3979]
2025-10-01T14:07:29.846444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254717103519536:3979]
2025-10-01T14:07:29.846447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254717103519536:3979]
2025-10-01T14:07:29.846496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:29.846503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:29.846507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:29.846656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:29.852993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:29.853025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:29.853030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:29.869835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 286 sessionId: src_id|3231a284-897de2f7-63227b3f-18a73e85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:29.872389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:29.886631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254719480380671:3772]
2025-10-01T14:07:29.887071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 285, pipe: [1:7556254719480380671:3772]
2025-10-01T14:07:30.044662Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:30.045064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.045082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.045103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254719480380671:3772], now have 1 active actors on pipe
2025-10-01T14:07:30.045274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:30.046208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3231a284-897de2f7-63227b3f-18a73e85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:30.046218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3231a284-897de2f7-63227b3f-18a73e85_0] Write session will restart in 0.005907s
2025-10-01T14:07:30.046236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3231a284-897de2f7-63227b3f-18a73e85_0] Write session: Do CDS request
2025-10-01T14:07:30.046241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3231a284-897de2f7-63227b3f-18a73e85_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:30.045726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:30.045783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254719480380671:3772]
2025-10-01T14:07:30.045800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:30.045867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 286 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3231a284-897de2f7-63227b3f-18a73e85_0
2025-10-01T14:07:30.046086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 286 sessionId: src_id|3231a284-897de2f7-63227b3f-18a73e85_0 is DEAD
2025-10-01T14:07:30.053646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3231a284-897de2f7-63227b3f-18a73e85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:30.054527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:30.054542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 287
2025-10-01T14:07:30.055945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:30.055985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:30.055991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:30.055996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:30.056481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 287 sessionId:  describe result for acl check
2025-10-01T14:07:30.056512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:30.056516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:30.056518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:30.056524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254723775348020:4338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:30.057080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254723775348020:4338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:30.060000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254723775348020:4338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:30.061381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:30.076805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254723775348020:4338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:30.076837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254723775348020:4338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:30.076840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254723775348020:4338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:30.076850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:30.078928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:30.079206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:30.079220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:30.079233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:30.079295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:30.079344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254721398486963:3982]
2025-10-01T14:07:30.079945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:30.080357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:30.080418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:30.080751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:30.080807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.080808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.080809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.080810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.080811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.080812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.080826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.080827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.080828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.080830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.080831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.080832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.080833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.080837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.080844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.080853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.080857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.080860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.080863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.080881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.080884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.080887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.080891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.080895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.080898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.080901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.080905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.080908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.080916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.080924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.080931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.080936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.080940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.080945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.080951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.080956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.080960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.080965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.080969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.080975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.080980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.080986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.080991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.080996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.081004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.081009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.081014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.081019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.081024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.081029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.081032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.081035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.081038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.081041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.081045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.081048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.081074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:30.086202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:30.086891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:30.086916Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:30.086919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:30.086922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:30.086931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 286 [2:7556254721398486963:3982]
2025-10-01T14:07:30.086948Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:30.086965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:30.086974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.086978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.086980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.086998Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:30.087009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:30.087015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:30.087081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.087088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.087090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.087093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:30.087096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:30.087171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:30.087179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.087190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.087204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.087223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:30.087248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775347984:2446], now have 1 active actors on pipe
2025-10-01T14:07:30.087256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348088:4338], now have 1 active actors on pipe
2025-10-01T14:07:30.087264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254721398486956:3982]
2025-10-01T14:07:30.087272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254721398486956:3982]
2025-10-01T14:07:30.087274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254721398486956:3982]
2025-10-01T14:07:30.087288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:30.087303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:30.087305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:30.087309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:30.087311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:30.087321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:30.087324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:30.087366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254721398486956:3982]
2025-10-01T14:07:30.087384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:30.087392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:30.087426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.087434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.087287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 286
2025-10-01T14:07:30.087332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 286
2025-10-01T14:07:30.087461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:30.087473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.087481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.087483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:30.087492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.087502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:30.087516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:30.087675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.087684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.087699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:30.087784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 287 partition: 0 MaxSeqNo: 45 sessionId: src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0
2025-10-01T14:07:30.088136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3231a284-897de2f7-63227b3f-18a73e85_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:30.090584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0] Write session: try to update token
2025-10-01T14:07:30.090601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:30.116415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:30.116439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:30.116442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:30.116444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:30.116455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254721398486956:3982]
2025-10-01T14:07:30.116460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254721398486956:3982]
2025-10-01T14:07:30.116464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254721398486956:3982]
2025-10-01T14:07:30.116523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:30.116530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.116533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:30.116691Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:30.117612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 287 sessionId: src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:30.118556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:30.118573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:30.118578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:30.120312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:30.146109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254723775348106:3772]
2025-10-01T14:07:30.146380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 286, pipe: [1:7556254723775348106:3772]
2025-10-01T14:07:30.273773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:30.274206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.274216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.274257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348106:3772], now have 1 active actors on pipe
2025-10-01T14:07:30.274966Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:30.275380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:30.275461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 287 reason: status is not ok: tablet will be restarted right now sessionId: src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0
2025-10-01T14:07:30.275685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 287 sessionId: src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0 is DEAD
2025-10-01T14:07:30.275870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254723775348106:3772]
2025-10-01T14:07:30.275884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:30.277093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:30.277100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0] Write session will restart in 0.008458s
2025-10-01T14:07:30.277122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0] Write session: Do CDS request
2025-10-01T14:07:30.277126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:30.286947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:30.287014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:30.287025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 288
2025-10-01T14:07:30.287221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:30.287245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:30.287249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:30.287252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:30.287887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 288 sessionId:  describe result for acl check
2025-10-01T14:07:30.287912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:30.287914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:30.287916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:30.287920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254723775348186:4343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:30.288335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254723775348186:4343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:30.289551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:30.291651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:30.291899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:30.291904Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:30.291915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:30.291978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:30.292015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254721398487078:3985]
2025-10-01T14:07:30.292581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:30.292697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254723775348186:4343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:30.292853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:30.292894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:30.293206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:30.293254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.293259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.293259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.293260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.293261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.293261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.293262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.293263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.293263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.293264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.293265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.293265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.293266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.293267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.293270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.293277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.293280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.293282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.293284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.293286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.293289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.293292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.293296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.293301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.293304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.293307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.293311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.293315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.293321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.293329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.293335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.293338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.293341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.293344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.293346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.293349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.293352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.293355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.293358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.293361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.293364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.293366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.293369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.293371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.293374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.293377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.293379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.293382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.293385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.293388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.293390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.293393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.293396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.293398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.293402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.293404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.293426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:30.298360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254723775348186:4343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:30.298388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254723775348186:4343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:30.298391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254723775348186:4343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:30.298400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:30.299733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 287
2025-10-01T14:07:30.299758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 287
2025-10-01T14:07:30.298221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:30.299135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:30.299142Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:30.299145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:30.299150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:30.299158Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 287 [2:7556254721398487078:3985]
2025-10-01T14:07:30.299174Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:30.299191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:30.299195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.299198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.299200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.299216Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:30.299221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:30.299229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:30.299288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.299290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.299292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.299295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:30.299297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:30.299374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:30.299376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.299388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.299398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.299415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:30.299432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254721398487073:3985]
2025-10-01T14:07:30.299434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254721398487073:3985]
2025-10-01T14:07:30.299438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254721398487073:3985]
2025-10-01T14:07:30.299456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:30.299469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:30.299485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:30.299487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:30.299502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:30.299506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:30.299508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:30.299526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254721398487073:3985]
2025-10-01T14:07:30.299530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:30.299580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:30.299602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348226:4343], now have 1 active actors on pipe
2025-10-01T14:07:30.300129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348113:2446], now have 1 active actors on pipe
2025-10-01T14:07:30.300151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.300158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.300187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|283cff3f-69224c32-90105650-ca6b4c01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:30.300196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.300201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.300203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:30.300214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.300227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:30.300254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:30.303209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.303228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.303268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:30.304229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 288 partition: 0 MaxSeqNo: 45 sessionId: src_id|283cff3f-69224c32-90105650-ca6b4c01_0
2025-10-01T14:07:30.305756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34045c92-d296af41-f1a2201c-cd5d3e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|283cff3f-69224c32-90105650-ca6b4c01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:30.308487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|283cff3f-69224c32-90105650-ca6b4c01_0] Write session: try to update token
2025-10-01T14:07:30.308506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|283cff3f-69224c32-90105650-ca6b4c01_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:30.324599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 288 sessionId: src_id|283cff3f-69224c32-90105650-ca6b4c01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:30.327286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:30.328765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.328792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.328834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:30.328837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:30.328840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:30.328842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:30.328851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254721398487073:3985]
2025-10-01T14:07:30.328856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254721398487073:3985]
2025-10-01T14:07:30.328860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254721398487073:3985]
2025-10-01T14:07:30.328911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:30.328919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:30.328924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:30.328926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:30.328933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.328936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:30.329074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:30.375220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254723775348235:3772]
2025-10-01T14:07:30.378589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 287, pipe: [1:7556254723775348235:3772]
2025-10-01T14:07:30.543381Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:30.543831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:30.543898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348235:3772], now have 1 active actors on pipe
2025-10-01T14:07:30.543985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:30.544132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254723775348235:3772]
2025-10-01T14:07:30.544158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:30.553414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:30.555692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:30.555947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:30.555960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:30.555973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:30.556034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:30.556087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254721398487199:3989]
2025-10-01T14:07:30.556703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:30.557108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:30.557157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:30.557487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:30.557542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.557548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.557549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.557550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.557551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.557552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.557554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.557555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.557556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.557557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.557558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.557559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.557560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.557561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.557567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.557576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.557580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.557584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.557587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.557591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.557595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.557599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.557603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.557607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.557611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.557615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.557618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.557622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.557630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.557637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.557643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.557649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.557653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.557664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.557678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.557687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.557692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.557702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.557706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.557715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.557720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.557729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.557734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.557743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.557748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.557753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.557762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.557767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.557771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.557775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.557780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.557785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.557789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.557794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.557798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.557809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.557847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:30.560467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:30.560480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:30.560501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 288 reason: error at write: Disconnected sessionId: src_id|283cff3f-69224c32-90105650-ca6b4c01_0
2025-10-01T14:07:30.560649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 288 sessionId: src_id|283cff3f-69224c32-90105650-ca6b4c01_0 is DEAD
2025-10-01T14:07:30.562596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283cff3f-69224c32-90105650-ca6b4c01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:30.562608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283cff3f-69224c32-90105650-ca6b4c01_0] Write session will restart in 0.009877s
2025-10-01T14:07:30.562633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283cff3f-69224c32-90105650-ca6b4c01_0] Write session: Do CDS request
2025-10-01T14:07:30.562640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283cff3f-69224c32-90105650-ca6b4c01_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:30.566921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:30.568261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:30.568276Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:30.568279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:30.568283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:30.568291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 288 [2:7556254721398487199:3989]
2025-10-01T14:07:30.568308Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:30.568325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:30.568328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.568333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.568336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.568353Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:30.568366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:30.568373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:30.568434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.568442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.568444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.568447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:30.568450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:30.568521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:30.568528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.568541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.568557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.568573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:30.568593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348262:2446], now have 1 active actors on pipe
2025-10-01T14:07:30.568618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254721398487194:3989]
2025-10-01T14:07:30.568624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254721398487194:3989]
2025-10-01T14:07:30.568626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254721398487194:3989]
2025-10-01T14:07:30.568639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:30.568654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:30.568665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:30.568666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:30.568667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:30.568683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:30.568690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:30.568727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254721398487194:3989]
2025-10-01T14:07:30.568708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 288
2025-10-01T14:07:30.568739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:30.568748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:30.573922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|283cff3f-69224c32-90105650-ca6b4c01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:30.574015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:30.574043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 289
2025-10-01T14:07:30.574179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:30.574216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:30.574226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:30.574229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:30.574720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 289 sessionId:  describe result for acl check
2025-10-01T14:07:30.574767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:30.574775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:30.574777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:30.574783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254723775348349:4354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:30.575314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254723775348349:4354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:30.581367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254723775348349:4354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:30.587919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254723775348349:4354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:30.588270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348383:4354], now have 1 active actors on pipe
2025-10-01T14:07:30.587941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254723775348349:4354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:30.587945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254723775348349:4354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:30.587954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:30.588363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 288
2025-10-01T14:07:30.588457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.588477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.588512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:30.588526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.588532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.588535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:30.588549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.588567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:30.588590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:30.589007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 289 partition: 0 MaxSeqNo: 45 sessionId: src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0
2025-10-01T14:07:30.588902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.588912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.588928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:30.589419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|283cff3f-69224c32-90105650-ca6b4c01_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:30.592566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0] Write session: try to update token
2025-10-01T14:07:30.592586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:30.599448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:30.599471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:30.599474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:30.599476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:30.599487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254721398487194:3989]
2025-10-01T14:07:30.599492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254721398487194:3989]
2025-10-01T14:07:30.599497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254721398487194:3989]
2025-10-01T14:07:30.599552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:30.599561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.599564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:30.599701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:30.602521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:30.602538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:30.602545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:30.619650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 289 sessionId: src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:30.622164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:30.644525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254723775348390:3772]
2025-10-01T14:07:30.644847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 288, pipe: [1:7556254723775348390:3772]
2025-10-01T14:07:30.764345Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:30.764703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.764713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.764737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348390:3772], now have 1 active actors on pipe
2025-10-01T14:07:30.765454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:30.766225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254723775348390:3772]
2025-10-01T14:07:30.766254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:30.766319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 289 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0
2025-10-01T14:07:30.766535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 289 sessionId: src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0 is DEAD
2025-10-01T14:07:30.766683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:30.766984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:30.766995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0] Write session will restart in 0.006013s
2025-10-01T14:07:30.767023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0] Write session: Do CDS request
2025-10-01T14:07:30.767030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:30.773947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:30.779592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:30.779609Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 290
2025-10-01T14:07:30.780161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:30.780195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:30.780200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:30.780204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:30.780660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 290 sessionId:  describe result for acl check
2025-10-01T14:07:30.780693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:30.780695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:30.780697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:30.780702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254723775348407:4359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:30.781206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254723775348407:4359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:30.788038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254723775348407:4359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:30.795397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254723775348407:4359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:30.795413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254723775348407:4359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:30.795416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254723775348407:4359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:30.795425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:30.799089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:30.805347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:30.805581Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:30.805585Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:30.805595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:30.805637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:30.805674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254721398487359:4002]
2025-10-01T14:07:30.806226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:30.806845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:30.806899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:30.807224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:30.807292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.807293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.807294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.807295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.807297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.807298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.807299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.807301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.807302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.807303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.807304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.807305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.807306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.807307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.807313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.807322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.807325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.807329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.807332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.807336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.807339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.807342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.807345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.807349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.807352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.807356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.807359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.807362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.807370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.807377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:30.807382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.807387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:30.807392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.807397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:30.807401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.807406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:30.807410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.807415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:30.807419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.807424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:30.807429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.807434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:30.807439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.807444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:30.807448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.807453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:30.807457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.807461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.807466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.807470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.807474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.807478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.807483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.807489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:30.807492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.807497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:30.807535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:30.811567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:30.812197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:30.812212Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:30.812215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:30.812218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:30.812225Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 289 [2:7556254721398487359:4002]
2025-10-01T14:07:30.812242Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:30.812266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:30.812272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.812280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.812283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.812299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:30.812311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:30.812317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:30.812376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.812383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.812385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.812387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:30.812390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:30.812635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 289
2025-10-01T14:07:30.812678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 289
2025-10-01T14:07:30.812452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:30.812460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.812471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:30.812481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:30.812496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:30.812514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348506:4359], now have 1 active actors on pipe
2025-10-01T14:07:30.812521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254721398487353:4002]
2025-10-01T14:07:30.812523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254721398487353:4002]
2025-10-01T14:07:30.812525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254721398487353:4002]
2025-10-01T14:07:30.812536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:30.812544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348395:2446], now have 1 active actors on pipe
2025-10-01T14:07:30.812552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:30.812565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:30.812567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:30.812591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254721398487353:4002]
2025-10-01T14:07:30.812594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:30.812903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:30.812905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:30.812907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:30.812914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:30.813138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.813144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.813174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be013159-1aa97b66-6830b067-ca170991_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:30.813182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:30.813187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:30.813189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:30.813196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:30.813206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:30.813220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:30.813536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:30.813540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:30.813554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:30.813673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 290 partition: 0 MaxSeqNo: 45 sessionId: src_id|be013159-1aa97b66-6830b067-ca170991_0
2025-10-01T14:07:30.814312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f97c56a-9e957bf9-5028f5a-eb08a72b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be013159-1aa97b66-6830b067-ca170991_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:30.816745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be013159-1aa97b66-6830b067-ca170991_0] Write session: try to update token
2025-10-01T14:07:30.816764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be013159-1aa97b66-6830b067-ca170991_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:30.847835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 290 sessionId: src_id|be013159-1aa97b66-6830b067-ca170991_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:30.850488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:30.849667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:30.849688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:30.849691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:30.849693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:30.849705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254721398487353:4002]
2025-10-01T14:07:30.849710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254721398487353:4002]
2025-10-01T14:07:30.849713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254721398487353:4002]
2025-10-01T14:07:30.849761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:30.849768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:30.849771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:30.849919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:30.852397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:30.852407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:30.852410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:30.870497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254723775348521:3772]
2025-10-01T14:07:30.870763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 289, pipe: [1:7556254723775348521:3772]
2025-10-01T14:07:31.026187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:31.026429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.026445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.026466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254723775348521:3772], now have 1 active actors on pipe
2025-10-01T14:07:31.026660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:31.027017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:31.027038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254723775348521:3772]
2025-10-01T14:07:31.027054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:31.027100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 290 reason: status is not ok: tablet will be restarted right now sessionId: src_id|be013159-1aa97b66-6830b067-ca170991_0
2025-10-01T14:07:31.027280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 290 sessionId: src_id|be013159-1aa97b66-6830b067-ca170991_0 is DEAD
2025-10-01T14:07:31.027694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be013159-1aa97b66-6830b067-ca170991_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:31.027703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be013159-1aa97b66-6830b067-ca170991_0] Write session will restart in 0.007099s
2025-10-01T14:07:31.027731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be013159-1aa97b66-6830b067-ca170991_0] Write session: Do CDS request
2025-10-01T14:07:31.027738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be013159-1aa97b66-6830b067-ca170991_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:31.037299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be013159-1aa97b66-6830b067-ca170991_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.038036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:31.038057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 291
2025-10-01T14:07:31.038185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.038210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:31.038216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:31.038219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:31.038680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:31.041136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:31.041382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:31.041386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:31.041399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:31.041451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:31.041484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254725693454783:4005]
2025-10-01T14:07:31.042029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:31.038585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 291 sessionId:  describe result for acl check
2025-10-01T14:07:31.038617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:31.038618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:31.038621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:31.038627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254728070315910:4364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:31.039133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254728070315910:4364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:31.041083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254728070315910:4364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:31.042868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:31.042926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:31.043280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:31.043341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.043347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.043348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.043349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.043350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.043351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.043353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.043354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.043355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.043356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.043357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.043358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.043359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.043359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.043365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.043375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.043379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.043383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.043387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.043391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.043396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.043400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.043404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.043409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.043413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.043417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.043421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.043424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.043431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.043439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.043445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.043451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.043461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.043467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.043476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.043480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.043485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.043490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.043505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.043510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.043515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.043520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.043524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.043529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.043533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.043538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.043543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.043548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.043553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.043558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.043562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.043567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.043571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.043576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.043581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.043585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.043627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:31.044434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254728070315910:4364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:31.044448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254728070315910:4364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:31.044452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254728070315910:4364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:31.044460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:31.047950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:31.048608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:31.048626Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:31.048628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:31.048631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:31.048638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 290 [2:7556254725693454783:4005]
2025-10-01T14:07:31.048657Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:31.048674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:31.048677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.048681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.048683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.048702Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:31.048708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:31.048714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:31.048781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.048787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.048789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.048793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:31.048795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:31.048873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:31.048881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.048894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.048903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.048921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:31.048943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070315946:4364], now have 1 active actors on pipe
2025-10-01T14:07:31.048946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070315834:2446], now have 1 active actors on pipe
2025-10-01T14:07:31.048953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254725693454778:4005]
2025-10-01T14:07:31.048955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254725693454778:4005]
2025-10-01T14:07:31.048957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254725693454778:4005]
2025-10-01T14:07:31.048970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:31.048984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:31.048987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:31.048995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:31.048999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:31.049001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:31.049004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:31.049041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254725693454778:4005]
2025-10-01T14:07:31.049050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:31.049058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:31.049411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 290
2025-10-01T14:07:31.049411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 290
2025-10-01T14:07:31.050029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.050042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.050073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:31.050094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.050103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.050106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:31.050119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.050136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:31.050161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.050551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.050561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.050577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.051458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 291 partition: 0 MaxSeqNo: 45 sessionId: src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0
2025-10-01T14:07:31.051912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be013159-1aa97b66-6830b067-ca170991_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:31.054601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0] Write session: try to update token
2025-10-01T14:07:31.054621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:31.073565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:31.073590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:31.073601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254725693454778:4005]
2025-10-01T14:07:31.073658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:31.073677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:31.073867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:31.074037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:31.074204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:31.075518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:31.075818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:31.075882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:31.075859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 291 sessionId: src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:31.078543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:31.079985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.080009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.080051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:31.080495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:31.104980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.105012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.105187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.105253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.105322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.105384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.105439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.105449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.105518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.105580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.105638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.105698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.105747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.105756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.105816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.105874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.105937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.106005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.106052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.106059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.106122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.106185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.106244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.106305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.106349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.106356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.106443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.106514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.106584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.106651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.106698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.106705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.106778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.106852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.106920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.106989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.107039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.107047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.107117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.107183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.107266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.107332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.107376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.107383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.107455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.107532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.107602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.107673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.107721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.107728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.107801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.107866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.107936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.108009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.108060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.108067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.108133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.108201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.108266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.108332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.108379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.108385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.108483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:31.108552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.108578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.108584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:31.108605Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.108619Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.108623Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.108627Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.108637Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.108641Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.108644Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.108648Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.108651Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.108655Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109205Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109221Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109225Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109229Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109234Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109239Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109243Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109246Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109250Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109254Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109257Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109266Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109270Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109276Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109283Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109438Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109443Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109446Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109448Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109451Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109454Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109458Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109462Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109466Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109470Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:31.109572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:31.109587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:07:31.109590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:07:31.109593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:07:31.109600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:07:31.109995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:07:31.110024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:31.110030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:07:31.110032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:07:31.110035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:07:31.110039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:07:31.110571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:07:31.110593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:31.110599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:07:31.110602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:07:31.110605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:07:31.110610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:07:31.111147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:07:31.111169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.111276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327651110
2025-10-01T14:07:31.113964Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:31.113996Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:07:31.114010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:31.114016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:31.114018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:31.114019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:31.114027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254725693454778:4005]
2025-10-01T14:07:31.114030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254725693454778:4005]
2025-10-01T14:07:31.114033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254725693454778:4005]
2025-10-01T14:07:31.114066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:31.114076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:31.114079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:31.114112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:31.114122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.114124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:31.114245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:31.128303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254728070315956:3772]
2025-10-01T14:07:31.129378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 290, pipe: [1:7556254728070315956:3772]
2025-10-01T14:07:31.270080Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:31.270425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070315956:3772], now have 1 active actors on pipe
2025-10-01T14:07:31.270728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:31.274761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:31.274794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:31.274826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 291 reason: error at write: Disconnected sessionId: src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0
2025-10-01T14:07:31.275002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:31.275046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 291 sessionId: src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0 is DEAD
2025-10-01T14:07:31.275076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254728070315956:3772]
2025-10-01T14:07:31.275300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:31.275309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0] Write session will restart in 0.005477s
2025-10-01T14:07:31.275332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0] Write session: Do CDS request
2025-10-01T14:07:31.275339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:31.278688Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [4855e840beeafd31] Result# TEvPutResult {Id# [72075186224037892:290:1:2:1:6759616:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-01T14:07:31.281900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.281976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:31.281992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 292
2025-10-01T14:07:31.282119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.282150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:31.282158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:31.282162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:31.282555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 292 sessionId:  describe result for acl check
2025-10-01T14:07:31.282587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:31.282593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:31.282594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:31.282599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254728070315984:4369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:31.283158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254728070315984:4369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:31.285911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254728070315984:4369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:31.286778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:31.288571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:31.288832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:31.288845Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:31.288859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:31.288919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:31.288938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254728070315984:4369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:31.288956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254728070315984:4369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:31.288959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254728070315984:4369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:31.288967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:31.288965Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254725693454905:4008]
2025-10-01T14:07:31.289580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:31.290016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:31.290064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:31.290392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:31.290457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.290464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.290465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.290466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.290467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.290468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.290469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.290470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.290471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.290471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.290472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.290473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.290474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.290475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.290482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.290491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.290494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.290497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.290500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.290503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.290506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.290509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.290512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.290515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.290518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.290521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.290524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.290527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.290533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.290541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.290546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.290551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.290554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.290558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.290562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.290565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.290569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.290574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.290577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.290581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.290586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.290589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.290593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.290597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.290601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.290605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.290608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.290612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.290616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.290620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.290623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.290627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.290630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.290634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.290638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.290642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.290675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:31.294732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:31.295350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:31.295368Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:31.295371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:31.295375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:31.295381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 291 [2:7556254725693454905:4008]
2025-10-01T14:07:31.295400Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:31.295417Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:31.295426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.295430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.295433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.295449Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:31.295454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:31.295461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:31.295521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.295528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.295530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.295533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:31.295536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:31.295590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:31.295598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.295605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.295611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.295620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:31.295634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254725693454900:4008]
2025-10-01T14:07:31.295637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254725693454900:4008]
2025-10-01T14:07:31.295639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254725693454900:4008]
2025-10-01T14:07:31.295644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:31.295765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 291
2025-10-01T14:07:31.295765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 291
2025-10-01T14:07:31.295655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:31.295660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:31.295663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:31.295665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:31.295669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:31.295671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:31.295680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070315970:2446], now have 1 active actors on pipe
2025-10-01T14:07:31.295682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316083:4369], now have 1 active actors on pipe
2025-10-01T14:07:31.295707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254725693454900:4008]
2025-10-01T14:07:31.295715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:31.295739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:31.295861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.295866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.295890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:31.295897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.295901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.295903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:31.295912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.295920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:31.295932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.296074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.296086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.296119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.301477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 292 partition: 0 MaxSeqNo: 45 sessionId: src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0
2025-10-01T14:07:31.301911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d5ba74-c4e66167-77cae6ae-db9eb1ba_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:31.304350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0] Write session: try to update token
2025-10-01T14:07:31.304374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:31.317926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:31.317947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:31.317950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:31.317952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:31.317962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254725693454900:4008]
2025-10-01T14:07:31.317967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254725693454900:4008]
2025-10-01T14:07:31.317970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254725693454900:4008]
2025-10-01T14:07:31.318024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:31.318039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.318041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:31.318055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:31.318061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:31.318065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:31.318974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 292 sessionId: src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:31.321588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:31.318182Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:31.376232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254728070316095:3772]
2025-10-01T14:07:31.376523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 291, pipe: [1:7556254728070316095:3772]
2025-10-01T14:07:31.474136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:31.474197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254728070316095:3772]
2025-10-01T14:07:31.474219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:31.474225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:31.474309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 292 reason: error at write: Disconnected sessionId: src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0
2025-10-01T14:07:31.473514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:31.473879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.473891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.473940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316095:3772], now have 1 active actors on pipe
2025-10-01T14:07:31.474507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 292 sessionId: src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0 is DEAD
2025-10-01T14:07:31.476580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:31.478485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:31.478496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0] Write session will restart in 0.005991s
2025-10-01T14:07:31.478523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0] Write session: Do CDS request
2025-10-01T14:07:31.478529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:31.485915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.485949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:31.486086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:31.486100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 293
2025-10-01T14:07:31.489157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.489209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:31.489215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:31.489219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:31.489631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 293 sessionId:  describe result for acl check
2025-10-01T14:07:31.489661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:31.489667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:31.489669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:31.489674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254728070316191:4379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:31.490141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254728070316191:4379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:31.489633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:31.489864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:31.489868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:31.489880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:31.489929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:31.489966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254725693455023:4010]
2025-10-01T14:07:31.490569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:31.491013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:31.491059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:31.491399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:31.491459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.491460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.491462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.491463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.491464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.491465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.491467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.491468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.491468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.491469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.491471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.491472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.491473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.491474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.491479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.491488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.491492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.491496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.491499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.491503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.491507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.491511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.491515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.491519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.491523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.491527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.491530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.491534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.491541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.491549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.491555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.491560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.491563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.491567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.491571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.491575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.491578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.491582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.491586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.491591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.491595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.491600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.491603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.491608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.491612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.491617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.491621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.491625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.491629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.491634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.491639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.491643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.491647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.491652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.491656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.491661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.491711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:31.492732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254728070316191:4379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:31.495620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:31.495702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254728070316191:4379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:31.495718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254728070316191:4379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:31.495722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254728070316191:4379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:31.495729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:31.496228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:31.496248Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:31.496251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:31.496254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:31.496261Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 292 [2:7556254725693455023:4010]
2025-10-01T14:07:31.496275Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:31.496295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:31.496301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.496305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.496307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.496323Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:31.496335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:31.496342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:31.496394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.496401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.496403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.496406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:31.496409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:31.496473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:31.496479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.496492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.496509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.496534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:31.496552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316228:4379], now have 1 active actors on pipe
2025-10-01T14:07:31.496556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316111:2446], now have 1 active actors on pipe
2025-10-01T14:07:31.496564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254725693455018:4010]
2025-10-01T14:07:31.496566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254725693455018:4010]
2025-10-01T14:07:31.496568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254725693455018:4010]
2025-10-01T14:07:31.496580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:31.496590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:31.496593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:31.496594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:31.496595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:31.496608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:31.496610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:31.496641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254725693455018:4010]
2025-10-01T14:07:31.496648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:31.496662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:31.496768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 292
2025-10-01T14:07:31.496794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 292
2025-10-01T14:07:31.496862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.496876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.496900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:31.496907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.496915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.496917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:31.496927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.496936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:31.496953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.497110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.497123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.497144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.497235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 293 partition: 0 MaxSeqNo: 45 sessionId: src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0
2025-10-01T14:07:31.497597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fac2bb50-157810c6-3fd805a9-8261fa5e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:31.500046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0] Write session: try to update token
2025-10-01T14:07:31.500063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:31.509456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:31.509476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:31.509485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254725693455018:4010]
2025-10-01T14:07:31.509520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:31.509530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:31.509694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:31.509848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:31.509989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:31.510125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:31.510479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:31.510523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:31.519484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 293 sessionId: src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:31.522034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:31.522235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.522255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.522285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:31.522368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:31.534000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:31.534018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:31.534020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:31.534022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:31.534034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254725693455018:4010]
2025-10-01T14:07:31.534037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254725693455018:4010]
2025-10-01T14:07:31.534043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254725693455018:4010]
2025-10-01T14:07:31.534090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:31.534090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:31.534096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.534097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:31.534098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:31.534101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:31.534229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:31.574475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254728070316245:3772]
2025-10-01T14:07:31.574785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 292, pipe: [1:7556254728070316245:3772]
2025-10-01T14:07:31.687321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:31.695262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.695289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.695471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.695530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.695597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.695664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.696077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.696083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.696159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.696222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.696290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.696357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.696398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.696403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.696482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.696584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.696834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.697040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.697080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.697083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.697150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.697212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.697271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.697336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.697378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.697381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.697450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.697506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.697562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.697623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.697670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.697673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.697746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.697808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.697866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.697925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.697974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.697977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.698051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.698111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.698178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.698238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.698285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.698288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.698361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.698623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.698688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.698741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.698862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.698865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.698933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.698986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.699046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.699102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.699141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.699144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.699215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:31.699271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:31.699334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:31.699392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:31.699439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:31.699442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:31.699518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316245:3772], now have 1 active actors on pipe
2025-10-01T14:07:31.700191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:31.700595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:31.700633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:31.700634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:31.700655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 293 reason: error at write: Disconnected sessionId: src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0
2025-10-01T14:07:31.700855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 293 sessionId: src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0 is DEAD
2025-10-01T14:07:31.701017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254728070316245:3772]
2025-10-01T14:07:31.702602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:31.702614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0] Write session will restart in 0.005277s
2025-10-01T14:07:31.702642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0] Write session: Do CDS request
2025-10-01T14:07:31.702649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:31.710837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.711756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:31.714339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:31.710889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:31.710905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 294
2025-10-01T14:07:31.711075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.711102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:31.711109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:31.711113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:31.711517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 294 sessionId:  describe result for acl check
2025-10-01T14:07:31.711542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:31.711543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:31.711544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:31.711549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254728070316329:4385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:31.712040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254728070316329:4385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:31.714019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254728070316329:4385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:31.714601Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:31.714620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:31.714634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:31.714693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:31.714731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254725693455166:4021]
2025-10-01T14:07:31.715318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:31.715590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:31.715632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:31.715956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:31.716012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.716019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.716020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.716021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.716022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.716023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.716024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.716025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.716027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.716028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.716029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.716030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.716031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.716032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.716037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.716056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.716060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.716064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.716067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.716071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.716075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.716078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.716082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.716086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.716089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.716093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.716096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.716100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.716106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.716113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.716119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.716124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.716128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.716133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.716137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.716142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.716151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.716156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.716164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.716169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.716177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.716182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.716191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.716196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.716205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.716210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.716218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.716222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.716227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.716232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.716239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.716244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.716251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.716259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.716263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.716268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.716306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:31.720597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:31.721343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:31.721359Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:31.721361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:31.721365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:31.721373Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 293 [2:7556254725693455166:4021]
2025-10-01T14:07:31.721388Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:31.721403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:31.721412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.721415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.721418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.721435Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:31.721444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:31.721450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:31.721505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.721513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.721515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.721519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:31.721522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:31.721592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:31.721599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.721611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.721628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.721650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:31.721673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316250:2446], now have 1 active actors on pipe
2025-10-01T14:07:31.721677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316369:4385], now have 1 active actors on pipe
2025-10-01T14:07:31.721684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254725693455160:4021]
2025-10-01T14:07:31.721686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254725693455160:4021]
2025-10-01T14:07:31.721688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254725693455160:4021]
2025-10-01T14:07:31.721701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:31.721719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:31.721726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:31.721730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:31.721732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:31.721737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:31.721740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:31.721770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254725693455160:4021]
2025-10-01T14:07:31.721782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:31.721787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:31.721821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.721830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.721853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:31.721864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.721869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.721872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:31.721880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.721892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:31.721910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.720583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254728070316329:4385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:31.720602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254728070316329:4385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:31.722338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.722346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.720606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254728070316329:4385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:31.720614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:31.722360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.721728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 293
2025-10-01T14:07:31.721762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 293
2025-10-01T14:07:31.722550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 294 partition: 0 MaxSeqNo: 45 sessionId: src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0
2025-10-01T14:07:31.726493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c743d38d-74814532-f48624ca-dfbe3d8f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:31.729034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0] Write session: try to update token
2025-10-01T14:07:31.729055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:31.746687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:31.746711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:31.746714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:31.746716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:31.746726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254725693455160:4021]
2025-10-01T14:07:31.746731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254725693455160:4021]
2025-10-01T14:07:31.746736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254725693455160:4021]
2025-10-01T14:07:31.746791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:31.746799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.746802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:31.746964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:31.748452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:31.748472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:31.748476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:31.765293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 294 sessionId: src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:31.767877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:31.801149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254728070316377:3772]
2025-10-01T14:07:31.801558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 293, pipe: [1:7556254728070316377:3772]
2025-10-01T14:07:31.906042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254728070316377:3772]
2025-10-01T14:07:31.906623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:31.906671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:31.906740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 294 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0
2025-10-01T14:07:31.906950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 294 sessionId: src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0 is DEAD
2025-10-01T14:07:31.907151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:31.907164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0] Write session will restart in 0.009120s
2025-10-01T14:07:31.907202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0] Write session: Do CDS request
2025-10-01T14:07:31.907210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:31.905073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:31.905761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.905770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.905790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316377:3772], now have 1 active actors on pipe
2025-10-01T14:07:31.906102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:31.918279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:31.918504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.918584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:31.918598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 295
2025-10-01T14:07:31.918802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:31.918839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:31.918845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:31.918849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:31.919249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 295 sessionId:  describe result for acl check
2025-10-01T14:07:31.919290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:31.919296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:31.919298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:31.919304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254728070316460:4389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:31.919836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254728070316460:4389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:31.920055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:31.920426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:31.920435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:31.920447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:31.920506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:31.920551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254725693455303:4027]
2025-10-01T14:07:31.921139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:31.921389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:31.921439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:31.921758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:31.921758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254728070316460:4389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:31.921828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.921834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.921835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.921836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.921837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.921838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.921840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.921841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.921842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.921842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.921844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.921845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.921846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.921847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.921852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.921863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.921866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.921869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.921872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.921876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.921880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.921882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.921885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.921889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.921892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.921896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.921899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.921902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.921908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.921916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:31.921921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.921927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:31.921930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.921935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:31.921940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.921945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:31.921949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.921954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:31.921958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.921963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:31.921968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.921972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:31.921977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.921982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:31.921987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.921992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:31.921996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.922000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.922005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.922010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.922014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.922018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.922028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.922032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:31.922036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.922046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:31.922086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:31.925976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254728070316460:4389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:31.925992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254728070316460:4389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:31.925996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254728070316460:4389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:31.926030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:31.926198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:31.926842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:31.926857Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:31.926860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:31.926864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:31.926871Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 294 [2:7556254725693455303:4027]
2025-10-01T14:07:31.926886Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:31.926902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:31.926909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.926913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.926915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.926932Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:31.926942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:31.926947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:31.927001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.927008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.927011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.927014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:31.927017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:31.927086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:31.927092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.927103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:31.927113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:31.927129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:31.927152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316379:2446], now have 1 active actors on pipe
2025-10-01T14:07:31.927160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254728070316498:4389], now have 1 active actors on pipe
2025-10-01T14:07:31.927167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254725693455298:4027]
2025-10-01T14:07:31.927174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254725693455298:4027]
2025-10-01T14:07:31.927175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254725693455298:4027]
2025-10-01T14:07:31.927188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:31.927186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 294
2025-10-01T14:07:31.927205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:31.927206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:31.927189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 294
2025-10-01T14:07:31.927210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:31.927212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:31.927224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:31.927227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:31.927270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.927279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.927296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254725693455298:4027]
2025-10-01T14:07:31.927307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:31.927313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:31.927334Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68811611-f26f7066-2ccfee36-71988f22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:31.927344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:31.927348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:31.927354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:31.927362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:31.927371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:31.927396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.927519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:31.927526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:31.927540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:31.927682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 295 partition: 0 MaxSeqNo: 45 sessionId: src_id|68811611-f26f7066-2ccfee36-71988f22_0
2025-10-01T14:07:31.934522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96b73d53-15c663cb-7fc0d0eb-70a5fbad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|68811611-f26f7066-2ccfee36-71988f22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:31.937173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68811611-f26f7066-2ccfee36-71988f22_0] Write session: try to update token
2025-10-01T14:07:31.937192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68811611-f26f7066-2ccfee36-71988f22_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:31.949912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:31.949935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:31.949939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:31.949941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:31.949951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254725693455298:4027]
2025-10-01T14:07:31.949957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254725693455298:4027]
2025-10-01T14:07:31.949961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254725693455298:4027]
2025-10-01T14:07:31.950012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:31.950017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:31.950023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:31.950024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:31.950027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:31.950027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:31.950176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:31.955521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 295 sessionId: src_id|68811611-f26f7066-2ccfee36-71988f22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:31.958282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:32.005966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254732365283806:3772]
2025-10-01T14:07:32.006265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 294, pipe: [1:7556254732365283806:3772]
2025-10-01T14:07:32.112777Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:32.113386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.113398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.113443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365283806:3772], now have 1 active actors on pipe
2025-10-01T14:07:32.113707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:32.113722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:32.113793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 295 reason: error at write: Disconnected sessionId: src_id|68811611-f26f7066-2ccfee36-71988f22_0
2025-10-01T14:07:32.114024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 295 sessionId: src_id|68811611-f26f7066-2ccfee36-71988f22_0 is DEAD
2025-10-01T14:07:32.113808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:32.114168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:32.114178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68811611-f26f7066-2ccfee36-71988f22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:32.114190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68811611-f26f7066-2ccfee36-71988f22_0] Write session will restart in 0.009085s
2025-10-01T14:07:32.114216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68811611-f26f7066-2ccfee36-71988f22_0] Write session: Do CDS request
2025-10-01T14:07:32.114223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68811611-f26f7066-2ccfee36-71988f22_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:32.114218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254732365283806:3772]
2025-10-01T14:07:32.124943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68811611-f26f7066-2ccfee36-71988f22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:32.124974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:32.124990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 296
2025-10-01T14:07:32.125173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:32.125203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:32.125208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:32.125240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:32.125666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 296 sessionId:  describe result for acl check
2025-10-01T14:07:32.125701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:32.125707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:32.125708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:32.125713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254732365283901:4396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:32.125908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:32.126231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254732365283901:4396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:32.127934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:32.128032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254732365283901:4396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:32.128153Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:32.128165Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:32.128176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:32.128228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:32.128281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254729988422732:4030]
2025-10-01T14:07:32.128857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:32.129112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:32.129155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:32.129453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:32.129513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.129519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.129520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.129521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.129522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.129523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.129524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.129525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.129526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.129527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.129528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.129529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.129530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.129531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.129536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.129546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.129550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.129554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.129557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.129561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.129564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.129568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.129571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.129575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.129578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.129581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.129585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.129588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.129595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.129602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.129608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.129613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.129622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.129626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.129630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.129635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.129640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.129649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.129653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.129657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.129666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.129671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.129675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.129684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.129689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.129697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.129702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.129710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.129715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.129723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.129727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.129732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.129740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.129745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.129753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.129757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.129795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:32.130488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254732365283901:4396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:32.130499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254732365283901:4396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:32.130502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254732365283901:4396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:32.130510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:32.133656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:32.134399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:32.134413Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:32.134416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:32.134421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:32.134428Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 295 [2:7556254729988422732:4030]
2025-10-01T14:07:32.134445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:32.134462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:32.134471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.134474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.134477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.134503Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:32.134509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:32.134516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:32.134574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.134581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.134583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.134587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:32.134589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:32.134659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:32.134667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.134679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.134694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.134713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:32.134737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365283942:4396], now have 1 active actors on pipe
2025-10-01T14:07:32.134745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365283820:2446], now have 1 active actors on pipe
2025-10-01T14:07:32.134753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254729988422726:4030]
2025-10-01T14:07:32.134759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254729988422726:4030]
2025-10-01T14:07:32.134761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254729988422726:4030]
2025-10-01T14:07:32.134774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:32.134785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:32.134792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:32.134794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:32.134796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:32.134806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:32.134814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:32.134853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254729988422726:4030]
2025-10-01T14:07:32.134865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:32.134870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:32.135901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 295
2025-10-01T14:07:32.135995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 295
2025-10-01T14:07:32.136208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.136230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.136257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:32.136278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.136289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.136292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:32.136303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.136319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:32.136335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:32.136611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.136619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.136635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:32.136718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 296 partition: 0 MaxSeqNo: 45 sessionId: src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0
2025-10-01T14:07:32.137135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68811611-f26f7066-2ccfee36-71988f22_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:32.139853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0] Write session: try to update token
2025-10-01T14:07:32.139873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:32.155130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:32.155153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:32.155166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254729988422726:4030]
2025-10-01T14:07:32.155228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:32.155231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:32.155492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:32.155678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:32.155876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:32.156061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:32.156319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:32.156379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:32.161635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 296 sessionId: src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:32.164244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:32.164742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.164765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.164825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:32.164929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:32.171569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:32.171593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:32.171595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:32.171598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:32.171608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254729988422726:4030]
2025-10-01T14:07:32.171613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254729988422726:4030]
2025-10-01T14:07:32.171619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254729988422726:4030]
2025-10-01T14:07:32.171675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:32.171685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:32.171689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.171692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:32.171693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:32.171698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:32.171837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:32.214305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254732365283957:3772]
2025-10-01T14:07:32.214662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 295, pipe: [1:7556254732365283957:3772]
2025-10-01T14:07:32.337828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:32.346565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.346598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.346796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.346864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.346932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.346999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.347280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.347287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.347372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.347435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.347520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.347593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.347727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.347736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.347801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.347861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.347931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.347997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.348042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.348049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.348121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.348189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.348250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.348310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.348803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.348834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.348910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.348978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.349049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.349122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.349177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.349189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.349270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.349333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.349402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.349474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.349604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.349607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.349682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.349745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.349812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.349880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.349924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.349938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.350018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.350087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.350209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.350288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.350346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.350356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.350453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.350526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.350604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.350679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.350731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.350739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.350808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.350875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.350947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.351019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.351066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.351076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.351159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365283957:3772], now have 1 active actors on pipe
2025-10-01T14:07:32.352431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:32.353028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254732365283957:3772]
2025-10-01T14:07:32.353075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:32.353534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:32.353548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0] Write session will restart in 0.008530s
2025-10-01T14:07:32.353577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0] Write session: Do CDS request
2025-10-01T14:07:32.353585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:32.353119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 296 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0
2025-10-01T14:07:32.353402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 296 sessionId: src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0 is DEAD
2025-10-01T14:07:32.353508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:32.366909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:32.367405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:32.367426Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 297
2025-10-01T14:07:32.370753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:32.370827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:32.370838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:32.370843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:32.371506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 297 sessionId:  describe result for acl check
2025-10-01T14:07:32.371553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:32.371556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:32.371557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:32.371566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254732365283974:4401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:32.372116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254732365283974:4401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:32.385946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254732365283974:4401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:32.390314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:32.391121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254732365283974:4401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:32.391144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254732365283974:4401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:32.391148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254732365283974:4401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:32.391157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:32.392978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:32.393296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:32.393312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:32.393327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:32.393404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:32.393447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254729988422858:4033]
2025-10-01T14:07:32.394056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:32.394429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:32.394485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:32.394823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:32.394897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.394903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.394905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.394906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.394908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.394909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.394910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.394911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.394912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.394913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.394915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.394916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.394917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.394918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.394925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.394935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.394938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.394942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.394945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.394949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.394952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.394956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.394959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.394962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.394966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.394969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.394972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.394976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.394984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.394992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.394998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.395003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.395007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.395012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.395016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.395021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.395027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.395032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.395037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.395042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.395047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.395052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.395056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.395073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.395086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.395090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.395094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.395099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.395103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.395109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.395112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.395117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.395121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.395126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.395130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.395135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.395172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:32.401549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:32.402203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:32.402209Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:32.402212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:32.402217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:32.402229Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 296 [2:7556254729988422858:4033]
2025-10-01T14:07:32.402247Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:32.402268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:32.402271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.402275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.402278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.402295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:32.402301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:32.402307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:32.402391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.402393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.402395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.402399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:32.402402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:32.402488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:32.402490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.402502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.402513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.402528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:32.402547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365283960:2446], now have 1 active actors on pipe
2025-10-01T14:07:32.402550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365284078:4401], now have 1 active actors on pipe
2025-10-01T14:07:32.402558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254729988422852:4033]
2025-10-01T14:07:32.402560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254729988422852:4033]
2025-10-01T14:07:32.402562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254729988422852:4033]
2025-10-01T14:07:32.402575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:32.402589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:32.402604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:32.402607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:32.402641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:32.402645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:32.402647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:32.402648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254729988422852:4033]
2025-10-01T14:07:32.402651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:32.402654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:32.403478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.403494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.403521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a847bc8a-42495b42-4db3271-e569a75f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:32.403534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.403544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.403546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:32.403557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.403573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:32.403593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:32.403873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.403885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.403903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:32.404360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a910fcb-2d58d4fa-4c681672-1982393f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a847bc8a-42495b42-4db3271-e569a75f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:32.403283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 296
2025-10-01T14:07:32.403324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 296
2025-10-01T14:07:32.403986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 297 partition: 0 MaxSeqNo: 45 sessionId: src_id|a847bc8a-42495b42-4db3271-e569a75f_0
2025-10-01T14:07:32.407010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a847bc8a-42495b42-4db3271-e569a75f_0] Write session: try to update token
2025-10-01T14:07:32.407030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a847bc8a-42495b42-4db3271-e569a75f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:32.443591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 297 sessionId: src_id|a847bc8a-42495b42-4db3271-e569a75f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:32.446531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:32.447289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.447313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.447351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:32.449618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:32.453420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254732365284087:3772]
2025-10-01T14:07:32.458669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365284087:3772], now have 1 active actors on pipe
2025-10-01T14:07:32.458791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 296, pipe: [1:7556254732365284087:3772]
2025-10-01T14:07:32.471348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:32.471368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:32.471371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:32.471373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:32.471384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254729988422852:4033]
2025-10-01T14:07:32.471388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254729988422852:4033]
2025-10-01T14:07:32.471392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254729988422852:4033]
2025-10-01T14:07:32.471440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:32.471447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.471450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:32.471581Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:32.474271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:32.474287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:32.474291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:32.630489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:32.639016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.639047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.639227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.639284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.639344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.639404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.639900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.639907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.639982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.640042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.640101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.640164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.640203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.640207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.640286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.640351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.640412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.640473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.640515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.640518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.640595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.640657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.640718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.640781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.640841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.640845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.640919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.640977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.641042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.641106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.641153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.641156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.641231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.641292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.641352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.641415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.641460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.641466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.641536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.641596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.641664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.641921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.641964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.641969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.642042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.642101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.642167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.642232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.642277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.642281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.642417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.642524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.642624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.642689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.642732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.642756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.642823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.642888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.642956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.643025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.643073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.643081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.644013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:32.643820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:32.643881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:32.643884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:32.643913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 297 reason: error at write: Disconnected sessionId: src_id|a847bc8a-42495b42-4db3271-e569a75f_0
2025-10-01T14:07:32.644144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254732365284087:3772]
2025-10-01T14:07:32.644768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 297 sessionId: src_id|a847bc8a-42495b42-4db3271-e569a75f_0 is DEAD
2025-10-01T14:07:32.645141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a847bc8a-42495b42-4db3271-e569a75f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:32.645153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a847bc8a-42495b42-4db3271-e569a75f_0] Write session will restart in 0.007760s
2025-10-01T14:07:32.645180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a847bc8a-42495b42-4db3271-e569a75f_0] Write session: Do CDS request
2025-10-01T14:07:32.645187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a847bc8a-42495b42-4db3271-e569a75f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:32.654030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a847bc8a-42495b42-4db3271-e569a75f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:32.654449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:32.654468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 298
2025-10-01T14:07:32.654626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:32.654661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:32.654672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:32.654677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:32.655115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 298 sessionId:  describe result for acl check
2025-10-01T14:07:32.655155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:32.655162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:32.655164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:32.655169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254732365284134:4413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:32.655722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254732365284134:4413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:32.660722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:32.661617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254732365284134:4413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:32.663116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:32.663343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:32.663354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:32.663366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:32.663436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:32.663480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254729988422990:4038]
2025-10-01T14:07:32.664051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:32.664464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:32.664526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:32.664801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:32.664867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.664872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.664874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.664875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.664876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.664877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.664878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.664879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.664880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.664881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.664882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.664883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.664885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.664886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.664891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.664901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.664905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.664921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.664924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.664928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.664932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.664936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.664939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.664943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.664947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.664951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.664955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.664958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.664965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.664974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.664980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.664986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.664989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.664994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.664998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.665003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.665007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.665013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.665016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.665021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.665025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.665030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.665034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.665039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.665044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.665049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.665053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.665067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.665072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.665077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.665081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.665057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254732365284134:4413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:32.665075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254732365284134:4413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:32.665078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254732365284134:4413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:32.665087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:32.665087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.665099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.665104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.665109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.665113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.665146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:32.669983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:32.670705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:32.670725Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:32.670728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:32.670732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:32.670739Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 297 [2:7556254729988422990:4038]
2025-10-01T14:07:32.670757Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:32.670775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:32.670779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.670783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.670786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.670805Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:32.670811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:32.670818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:32.670877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.670888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.670891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.670894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:32.670897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:32.670976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:32.670983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.670997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.671013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.671037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:32.671063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365284120:2446], now have 1 active actors on pipe
2025-10-01T14:07:32.671071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365284237:4413], now have 1 active actors on pipe
2025-10-01T14:07:32.671080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254729988422985:4038]
2025-10-01T14:07:32.671086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254729988422985:4038]
2025-10-01T14:07:32.671091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254729988422985:4038]
2025-10-01T14:07:32.671106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:32.671126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:32.671146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:32.671147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:32.671151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:32.671155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:32.671160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:32.671160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 297
2025-10-01T14:07:32.671209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 297
2025-10-01T14:07:32.671697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254729988422985:4038]
2025-10-01T14:07:32.671714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:32.671738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.671742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:32.671748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.671801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:32.671814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.671819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.671825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:32.671836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.671850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:32.671875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:32.672134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.672147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.672167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:32.673457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a847bc8a-42495b42-4db3271-e569a75f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:32.673032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 298 partition: 0 MaxSeqNo: 45 sessionId: src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0
2025-10-01T14:07:32.676094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0] Write session: try to update token
2025-10-01T14:07:32.676114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:32.690648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 298 sessionId: src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:32.693179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:32.696554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.696583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.696649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:32.696884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:32.698698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:32.698721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:32.698724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:32.698726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:32.698736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254729988422985:4038]
2025-10-01T14:07:32.698741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254729988422985:4038]
2025-10-01T14:07:32.698749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254729988422985:4038]
2025-10-01T14:07:32.698807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:32.698820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.698823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:32.698955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:32.703476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:32.703499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:32.703504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:32.743718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254732365284248:3772]
2025-10-01T14:07:32.743990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 297, pipe: [1:7556254732365284248:3772]
2025-10-01T14:07:32.852378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:32.860596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.860626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.860806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.860890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.860959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.861026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.861074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.861078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.861157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.861224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.861289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.861352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.861396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.861398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.861466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.861533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.861590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.861645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.861684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.861690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.861754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.861809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.861863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.861920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.862286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.862297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.862362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.862437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.862488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.862552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.862595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.862602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.862665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.862726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.862792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.862857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.862905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.862912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.862979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.865383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254732365284248:3772]
2025-10-01T14:07:32.865413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:32.865447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:32.865452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:32.865478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 298 reason: error at write: Disconnected sessionId: src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0
2025-10-01T14:07:32.865717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 298 sessionId: src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0 is DEAD
2025-10-01T14:07:32.866522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:32.866537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0] Write session will restart in 0.009375s
2025-10-01T14:07:32.866569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0] Write session: Do CDS request
2025-10-01T14:07:32.866576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:32.863039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.863107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.863171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.863214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.863217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.863287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.863346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.863408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.863475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.863619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.863622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.863703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.863768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.863833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.863897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.863943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.863945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.864022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:32.864085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:32.864148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:32.864209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:32.864256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:32.864259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:32.864340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365284248:3772], now have 1 active actors on pipe
2025-10-01T14:07:32.865440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:32.876978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:32.877388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:32.877407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 299
2025-10-01T14:07:32.877516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:32.877549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:32.877560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:32.877564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:32.878029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 299 sessionId:  describe result for acl check
2025-10-01T14:07:32.878062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:32.878069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:32.878072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:32.878078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254732365284261:4417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:32.878653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254732365284261:4417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:32.890388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254732365284261:4417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:32.896020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:32.899590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:32.899838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:32.899843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:32.899854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:32.899905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:32.899939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254729988423144:4050]
2025-10-01T14:07:32.900554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:32.901085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:32.901133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:32.901455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:32.901503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.901504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.901506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.901507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.901508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.901509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.901510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.901511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.901512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.901514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.901515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.901517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.901518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.901519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.901526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.901536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.901539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.901543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.901547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.901551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.901555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.901559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.901562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.901566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.901570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.901574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.901577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.901581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.901588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.901595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:32.901602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.901608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:32.901612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.901617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:32.901621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.901626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:32.901631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.901635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:32.901639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.901644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:32.901648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.901653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:32.901657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.901662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:32.901667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.901672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:32.901677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.901681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.901686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.901692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.901695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.901701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.901705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.901709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:32.901713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.901718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:32.901757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:32.907465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254732365284261:4417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:32.907486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254732365284261:4417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:32.907490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254732365284261:4417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:32.907499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:32.907226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:32.908386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:32.908397Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:32.908399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:32.908402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:32.908409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 298 [2:7556254729988423144:4050]
2025-10-01T14:07:32.908426Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:32.908443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:32.908445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.908449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.908451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.908469Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:32.908474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:32.908480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:32.908538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.908540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.908542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.908546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:32.908549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:32.908615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:32.908618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.908630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:32.908639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:32.908652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:32.908669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254729988423138:4050]
2025-10-01T14:07:32.908671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254729988423138:4050]
2025-10-01T14:07:32.908673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254729988423138:4050]
2025-10-01T14:07:32.908684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:32.908698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:32.908712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:32.908715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:32.908762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254729988423138:4050]
2025-10-01T14:07:32.908764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:32.909659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 298
2025-10-01T14:07:32.909687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 298
2025-10-01T14:07:32.909054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:32.909060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:32.909061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:32.909066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:32.909889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365284373:4417], now have 1 active actors on pipe
2025-10-01T14:07:32.909897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365284253:2446], now have 1 active actors on pipe
2025-10-01T14:07:32.909911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.909917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.909946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|796139d-fda712e0-892e8fc7-751689eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:32.909956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:32.909960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:32.909963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:32.909975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:32.909988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:32.910007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:32.910546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.910555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.910572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:32.910703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 299 partition: 0 MaxSeqNo: 45 sessionId: src_id|796139d-fda712e0-892e8fc7-751689eb_0
2025-10-01T14:07:32.911163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899b0b45-2fd22d51-4c24a6be-ba991fdf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|796139d-fda712e0-892e8fc7-751689eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:32.913813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796139d-fda712e0-892e8fc7-751689eb_0] Write session: try to update token
2025-10-01T14:07:32.913834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796139d-fda712e0-892e8fc7-751689eb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:32.933935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 299 sessionId: src_id|796139d-fda712e0-892e8fc7-751689eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:32.936644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:32.938097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:32.938125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:32.940280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:32.940298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:32.940305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:32.940307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:32.940317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254729988423138:4050]
2025-10-01T14:07:32.940321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254729988423138:4050]
2025-10-01T14:07:32.940328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254729988423138:4050]
2025-10-01T14:07:32.940381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:32.940405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:32.940411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:32.940413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:32.940559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:32.940927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:32.940791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:32.940806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:32.940812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:32.967208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254732365284385:3772]
2025-10-01T14:07:32.970802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 298, pipe: [1:7556254732365284385:3772]
2025-10-01T14:07:33.114426Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:33.121549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.121581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.121751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.121815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.121881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.121952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.121998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.122006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.122078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.122137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.122200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.122262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.122307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.122313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.122401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.122458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.122516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.122571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.122614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.122622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.122683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.122746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.122808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.122874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.122925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.122931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.123018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.123084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.123143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.123200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.123243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.123250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.123311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.123364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.123467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.123550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.123596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.123602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.123662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.123718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.123780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.123838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.123880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.123889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.123947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.124004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.124059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.124116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.124156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.124161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.124219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.124278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.124333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.124389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.124429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.124437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.124506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.124566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.124636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.124696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.124761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.124768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.124838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254732365284385:3772], now have 1 active actors on pipe
2025-10-01T14:07:33.125253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254732365284385:3772]
2025-10-01T14:07:33.125285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:33.125325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:33.125333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:33.125360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 299 reason: error at write: Disconnected sessionId: src_id|796139d-fda712e0-892e8fc7-751689eb_0
2025-10-01T14:07:33.125542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 299 sessionId: src_id|796139d-fda712e0-892e8fc7-751689eb_0 is DEAD
2025-10-01T14:07:33.125778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:33.125888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796139d-fda712e0-892e8fc7-751689eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:33.125897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796139d-fda712e0-892e8fc7-751689eb_0] Write session will restart in 0.008199s
2025-10-01T14:07:33.125924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796139d-fda712e0-892e8fc7-751689eb_0] Write session: Do CDS request
2025-10-01T14:07:33.125931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796139d-fda712e0-892e8fc7-751689eb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:33.134867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|796139d-fda712e0-892e8fc7-751689eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:33.134958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:33.134978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 300
2025-10-01T14:07:33.135088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:33.135132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:33.135142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:33.135146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:33.135541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 300 sessionId:  describe result for acl check
2025-10-01T14:07:33.135577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:33.135584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:33.135588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:33.135594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254736660251780:4422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:33.136099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254736660251780:4422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:33.136404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:33.138344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254736660251780:4422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:33.138334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:33.138606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:33.138620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:33.138633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:33.138705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:33.138746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254734283390578:4053]
2025-10-01T14:07:33.139333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:33.139713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:33.139771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:33.140091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:33.140167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.140173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.140175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.140176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.140177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.140178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.140179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.140180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.140182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.140183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.140184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.140185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.140186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.140187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.140193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.140204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.140208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.140212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.140216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.140220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.140224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.140228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.140231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.140235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.140239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.140243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.140246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.140250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.140258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.140266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.140276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.140282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.140287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.140292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.140299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.140304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.140314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.140320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.140325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.140330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.140337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.140342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.140350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.140355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.140360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.140364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.140368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.140372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.140375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.140378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.140380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.140383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.140385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.140388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.140391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.140394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.140414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:33.144452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254736660251780:4422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:33.144470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254736660251780:4422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:33.144473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254736660251780:4422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:33.144482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:33.144662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:33.145368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:33.145385Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:33.145388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:33.145391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:33.145399Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 299 [2:7556254734283390578:4053]
2025-10-01T14:07:33.145417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:33.145436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:33.145439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.145444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.145446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.145465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:33.145479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:33.145485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:33.145550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.145565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.145567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.145571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:33.145573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:33.145649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:33.145658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.145673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.145683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.145703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:33.145728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660251825:4422], now have 1 active actors on pipe
2025-10-01T14:07:33.145736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660251696:2446], now have 1 active actors on pipe
2025-10-01T14:07:33.145744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254734283390572:4053]
2025-10-01T14:07:33.145746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254734283390572:4053]
2025-10-01T14:07:33.145748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254734283390572:4053]
2025-10-01T14:07:33.145761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:33.145775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:33.145789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:33.145792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:33.145827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:33.145811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 299
2025-10-01T14:07:33.145832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254734283390572:4053]
2025-10-01T14:07:33.145835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:33.145838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:33.145841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:33.145847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:33.145852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 299
2025-10-01T14:07:33.145898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.145909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.145938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:33.145950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.145959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.145966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:33.145975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.145989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:33.146013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:33.146237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.146246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.146263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:33.146396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 300 partition: 0 MaxSeqNo: 45 sessionId: src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0
2025-10-01T14:07:33.146818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|796139d-fda712e0-892e8fc7-751689eb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:33.149238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0] Write session: try to update token
2025-10-01T14:07:33.149257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:33.160476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:33.160499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:33.160509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254734283390572:4053]
2025-10-01T14:07:33.160556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:33.160558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:33.160730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:33.160880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:33.161014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:33.161146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:33.161340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:33.161376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:33.164694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 300 sessionId: src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:33.167929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.167953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.167993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:33.167311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:33.169799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:33.205057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.205092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.205265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.205326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.205399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.205462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.205502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.205508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.205574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.205630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.205693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.205751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.205792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.205795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.205857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.205912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.205975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.206030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.206072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.206074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.206137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.206195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.206244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.206300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.206337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.206339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.206426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.206485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.206535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.206599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.206642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.206644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.206711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.206763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.206819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.206871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.206908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.206910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.206981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.207033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.207109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.207177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.207243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.207250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.207318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.207375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.207431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.207494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.207539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.207545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.207604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.207663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.207728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.207785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.207843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.207851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.207919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:33.207985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:33.208048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:33.208111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:33.208153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:33.208160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:33.208229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:33.208237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:33.208240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:33.208242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:33.208251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254734283390572:4053]
2025-10-01T14:07:33.208255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254734283390572:4053]
2025-10-01T14:07:33.208258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254734283390572:4053]
2025-10-01T14:07:33.208320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:33.208387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.208403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.208405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:33.208420Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208429Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208432Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208435Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208438Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208443Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208447Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208451Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208455Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208459Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208804Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208811Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208826Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208830Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208835Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208839Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208842Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208845Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208848Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208852Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.208930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:33.208937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:33.208940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:33.209082Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209085Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209087Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209088Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209091Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209094Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209096Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209098Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209101Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209103Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209105Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209108Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209110Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209112Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209115Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:33.209288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:33.209295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:07:33.209298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:07:33.209300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:07:33.209302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:07:33.209660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:07:33.209672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:33.209681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:07:33.209684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:07:33.209687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:07:33.209690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:07:33.210208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:07:33.210221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:33.210226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:07:33.210230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:07:33.210233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:07:33.210236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:07:33.210952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:07:33.210975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.211059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327653210
2025-10-01T14:07:33.211782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:33.211800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.211803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:33.211936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:33.225504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254736660251837:3772]
2025-10-01T14:07:33.225756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 299, pipe: [1:7556254736660251837:3772]
2025-10-01T14:07:33.367074Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:33.367489Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:33.367520Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:07:33.367545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660251837:3772], now have 1 active actors on pipe
2025-10-01T14:07:33.367801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:33.367817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:33.367845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 300 reason: error at write: Disconnected sessionId: src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0
2025-10-01T14:07:33.367872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:33.367922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254736660251837:3772]
2025-10-01T14:07:33.368038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:33.368095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 300 sessionId: src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0 is DEAD
2025-10-01T14:07:33.370637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:33.370652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0] Write session will restart in 0.009470s
2025-10-01T14:07:33.370680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0] Write session: Do CDS request
2025-10-01T14:07:33.370687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:33.379682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:33.381760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:33.381991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:33.382001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:33.382012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:33.382078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:33.382119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254734283390706:4056]
2025-10-01T14:07:33.382992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:33.382707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:33.383004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:33.383041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:33.383367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:33.383445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.383452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.383454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.383455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.383456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.383457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.383458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.383460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.383461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.383463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.383463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.383465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.383466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.383467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.383472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.383481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.383364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:33.383386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 301
2025-10-01T14:07:33.383485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.383488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.383491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.383494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.383497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.383500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.383503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.383507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.383510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.383513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.383516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.383520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.383527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.383534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.383540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.383545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.383549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.383553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.383557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.383562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.383566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.383571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.383575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.383579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.383586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.383590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.383594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.383598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.383602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.383689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:33.383724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:33.383731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:33.383735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:33.383606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.383609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.383613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.383618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.383622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.383625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.383629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.383633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.383638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.383641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.383645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.383682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:33.384341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 301 sessionId:  describe result for acl check
2025-10-01T14:07:33.384381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:33.384383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:33.384385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:33.384390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254736660251932:4427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:33.384972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254736660251932:4427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:33.391052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:33.391668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:33.391691Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:33.391694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:33.391698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:33.391705Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 300 [2:7556254734283390706:4056]
2025-10-01T14:07:33.391721Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:33.391743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:33.391746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.391750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.391753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.391770Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:33.391776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:33.391782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:33.391844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.391846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.391848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.391851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:33.391854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:33.391922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:33.391926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.391937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.391947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.391962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:33.391980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660251840:2446], now have 1 active actors on pipe
2025-10-01T14:07:33.391988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254734283390700:4056]
2025-10-01T14:07:33.391990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254734283390700:4056]
2025-10-01T14:07:33.391993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254734283390700:4056]
2025-10-01T14:07:33.392007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:33.392023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:33.392038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:33.392041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:33.392045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:33.392050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:33.392052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:33.392075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254734283390700:4056]
2025-10-01T14:07:33.392078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:33.392082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:33.393063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 300
2025-10-01T14:07:33.393869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254736660251932:4427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:33.406010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254736660251932:4427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:33.406032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254736660251932:4427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:33.406040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254736660251932:4427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:33.406050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:33.408711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 300
2025-10-01T14:07:33.408708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660251969:4427], now have 1 active actors on pipe
2025-10-01T14:07:33.408866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.408886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.408921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:33.408933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.408940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.408944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:33.408965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.408983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:33.409004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:33.410191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.410212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.410229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:33.410233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:33.410242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254734283390700:4056]
2025-10-01T14:07:33.410285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:33.410512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:33.410669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:33.410823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:33.410982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:33.411206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:33.411246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:33.411273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:33.411421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:33.413432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 301 partition: 0 MaxSeqNo: 45 sessionId: src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0
2025-10-01T14:07:33.413807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3af5fcab-b4631b9f-1d3ce100-f6100470_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:33.416849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0] Write session: try to update token
2025-10-01T14:07:33.416873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:33.441535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 301 sessionId: src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:33.440269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:33.440293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:33.440295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:33.440297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:33.440313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254734283390700:4056]
2025-10-01T14:07:33.440318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254734283390700:4056]
2025-10-01T14:07:33.440321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254734283390700:4056]
2025-10-01T14:07:33.440368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:33.440373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.440375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:33.440390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:33.440399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:33.440403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:33.440525Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:33.444656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:33.468247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254736660251973:3772]
2025-10-01T14:07:33.468745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 300, pipe: [1:7556254736660251973:3772]
2025-10-01T14:07:33.616673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:33.617350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.617364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.617388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660251973:3772], now have 1 active actors on pipe
2025-10-01T14:07:33.617671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:33.617744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254736660251973:3772]
2025-10-01T14:07:33.617758Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:07:33.617693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:33.618080Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_1_3_9516708466741600635_v1 is DEAD
2025-10-01T14:07:33.618244Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254624991085554:3769] disconnected; active server actors: 1
2025-10-01T14:07:33.618258Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254624991085554:3769] client user disconnected session shared/user_1_3_9516708466741600635_v1
2025-10-01T14:07:33.618346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:33.618449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 301 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0
2025-10-01T14:07:33.618548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 301 sessionId: src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0 is DEAD
2025-10-01T14:07:33.619790Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:07:33.619816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:33.619830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0] Write session will restart in 0.008279s
2025-10-01T14:07:33.619857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0] Write session: Do CDS request
2025-10-01T14:07:33.619864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:33.619979Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:33.619985Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:33.620026Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.008810s
2025-10-01T14:07:33.630881Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:07:33.631012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:33.635068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:33.635085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 302
2025-10-01T14:07:33.635119Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:07:33.635121Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 4
2025-10-01T14:07:33.638944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:33.639006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:33.639013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:33.639020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:33.639080Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 4 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:33.639132Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:33.639331Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 auth for : user
2025-10-01T14:07:33.641104Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_4_9200912150680924553_v1
2025-10-01T14:07:33.639760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 302 sessionId:  describe result for acl check
2025-10-01T14:07:33.639798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:33.639801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:33.639803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:33.639810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254736660252058:4439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:33.640360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254736660252058:4439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:33.640449Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 Handle describe topics response
2025-10-01T14:07:33.640467Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 auth is DEAD
2025-10-01T14:07:33.640479Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:07:33.640831Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:07:33.641364Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254736660252070:4440] connected; active server actors: 1
2025-10-01T14:07:33.641473Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556254736660252070:4440] session shared/user_1_4_9200912150680924553_v1
2025-10-01T14:07:33.641493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:07:33.641505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:07:33.641520Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_4_9200912150680924553_v1" (Sender=[1:7556254736660252026:4440], Pipe=[1:7556254736660252070:4440], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:33.641529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:33.641541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:07:33.641556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_4_9200912150680924553_v1" (Sender=[1:7556254736660252026:4440], Pipe=[1:7556254736660252070:4440], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:33.641573Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_4_9200912150680924553_v1" sender [1:7556254736660252026:4440] lock partition 0 for ReadingSession "shared/user_1_4_9200912150680924553_v1" (Sender=[1:7556254736660252026:4440], Pipe=[1:7556254736660252070:4440], Partitions=[], ActiveFamilyCount=1) generation 1 step 4
2025-10-01T14:07:33.641585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:07:33.641590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000041s
2025-10-01T14:07:33.641901Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 4 Session: "shared/user_1_4_9200912150680924553_v1" ClientId: "user" PipeClient { RawX1: 7556254736660252070 RawX2: 4503603922342232 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:07:33.641942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:07:33.646065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254736660252058:4439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:33.651674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:33.653022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:33.653230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:33.653235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:33.653246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:33.653299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:33.653346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254734283390845:4059]
2025-10-01T14:07:33.654020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:33.654428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:33.654482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:33.654821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:33.654879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.654880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.654882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.654884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.654885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.654887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.654888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.654890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.654891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.654893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.654894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.654895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.654897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.654898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.654904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.654914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.654919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.654923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.654927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.654931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.654935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.654939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.654942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.654947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.654951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.654955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.654959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.654963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.654970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.654978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.654984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.654990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.654996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.655001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.655006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.655013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.655018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.655024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.655029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.655034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.655039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.655045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.655051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.655057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.655062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.655068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.655072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.655077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.655085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.655090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.655095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.655100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.655105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.655110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.655115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.655120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.655165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:33.659072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254736660252058:4439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:33.659091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254736660252058:4439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:33.659095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254736660252058:4439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:33.659105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:33.662773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:33.663523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:33.663542Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:33.663546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:33.663551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:33.663558Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 301 [2:7556254734283390845:4059]
2025-10-01T14:07:33.663575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:33.663593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:33.663602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.663606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.663608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.663625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:33.663634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:33.663641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:33.663923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.663938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.663940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.663943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:33.663946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:33.664029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:33.664042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.664058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.664072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.664092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:33.664115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254734283390840:4059]
2025-10-01T14:07:33.664125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254734283390840:4059]
2025-10-01T14:07:33.664127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254734283390840:4059]
2025-10-01T14:07:33.664144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:33.664162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:33.664167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:33.664178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:33.664180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:33.664180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:33.664183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:33.664220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254734283390840:4059]
2025-10-01T14:07:33.664223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:33.664267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:33.664486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660251991:2446], now have 1 active actors on pipe
2025-10-01T14:07:33.664491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660252087:4446], now have 1 active actors on pipe
2025-10-01T14:07:33.664493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660252134:4439], now have 1 active actors on pipe
2025-10-01T14:07:33.665178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 301
2025-10-01T14:07:33.665236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 301, pipe: [1:7556254736660252087:4446]
2025-10-01T14:07:33.665256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 301
2025-10-01T14:07:33.665479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.665492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.665504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_4_9200912150680924553_v1 on pipe: [1:7556254736660252087:4446]
2025-10-01T14:07:33.665543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.665546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.665561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.665567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.665569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:33.665580Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_4_9200912150680924553_v1:1 with generation 301
2025-10-01T14:07:33.665587Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_4_9200912150680924553_v1
2025-10-01T14:07:33.665590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.665626Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60104d2-106e34fe-7287652e-47f67919_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:33.665632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:07:33.665637Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:33.671226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:33.671277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:33.671289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.671295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.671298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:33.671312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.671329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:33.671348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:07:33.671363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:07:33.671381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:33.673359Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327653663 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:07:33.673391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:07:33.673422Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 sending to client partition status
2025-10-01T14:07:33.674193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.674214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.674244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:33.678852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 302 partition: 0 MaxSeqNo: 45 sessionId: src_id|60104d2-106e34fe-7287652e-47f67919_0
2025-10-01T14:07:33.679355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12997f2a-ab201b37-b8125831-b0f2c4b4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|60104d2-106e34fe-7287652e-47f67919_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:33.682631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60104d2-106e34fe-7287652e-47f67919_0] Write session: try to update token
2025-10-01T14:07:33.682656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60104d2-106e34fe-7287652e-47f67919_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:33.709243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:33.709269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:33.709273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:33.709275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:33.709286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254734283390840:4059]
2025-10-01T14:07:33.709296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254734283390840:4059]
2025-10-01T14:07:33.709307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254734283390840:4059]
2025-10-01T14:07:33.709364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:33.709372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.709376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:33.709540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:33.710539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:33.710553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:33.710559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:33.710818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 302 sessionId: src_id|60104d2-106e34fe-7287652e-47f67919_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:33.713384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:33.859910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:33.860205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.860212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.862101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:33.862109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254736660252087:4446]
2025-10-01T14:07:33.862130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:33.862132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:33.862207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 302 reason: error at write: Disconnected sessionId: src_id|60104d2-106e34fe-7287652e-47f67919_0
2025-10-01T14:07:33.862383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 302 sessionId: src_id|60104d2-106e34fe-7287652e-47f67919_0 is DEAD
2025-10-01T14:07:33.862304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_4_9200912150680924553_v1
2025-10-01T14:07:33.862319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:33.862492Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_4_9200912150680924553_v1
2025-10-01T14:07:33.863724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60104d2-106e34fe-7287652e-47f67919_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:33.863740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60104d2-106e34fe-7287652e-47f67919_0] Write session will restart in 0.009147s
2025-10-01T14:07:33.863766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60104d2-106e34fe-7287652e-47f67919_0] Write session: Do CDS request
2025-10-01T14:07:33.863775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60104d2-106e34fe-7287652e-47f67919_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:33.873936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60104d2-106e34fe-7287652e-47f67919_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:33.874112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:33.874132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 303
2025-10-01T14:07:33.874307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:33.874336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:33.874341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:33.874346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:33.874899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 303 sessionId:  describe result for acl check
2025-10-01T14:07:33.874934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:33.874936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:33.874938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:33.874943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254736660252211:4447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:33.875477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254736660252211:4447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:33.877976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:33.878821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254736660252211:4447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:33.880701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:33.880916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:33.880927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:33.880938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:33.880988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:33.881034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254734283391004:4073]
2025-10-01T14:07:33.881706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:33.881962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254736660252211:4447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:33.881979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254736660252211:4447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:33.881982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254736660252211:4447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:33.881991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:33.882268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:33.882311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:33.882653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:33.882714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.882720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.882721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.882722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.882724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.882725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.882726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.882727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.882728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.882729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.882731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.882731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.882733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.882734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.882739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.882749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.882754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.882758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.882762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.882766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.882770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.882774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.882777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.882782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.882785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.882789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.882793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.882797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.882804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.882811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:33.882816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.882822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:33.882827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.882832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:33.882837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.882842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:33.882847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.882852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:33.882862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.882867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:33.882873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.882882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:33.882889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.882898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:33.882903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.882908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:33.882919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.882924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.882928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.882933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.882938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.882943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.882948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.882952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:33.882964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.882969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:33.883010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:33.886921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:33.887633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:33.887649Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:33.887653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:33.887656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:33.887663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 302 [2:7556254734283391004:4073]
2025-10-01T14:07:33.887677Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:33.887691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:33.887697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.887700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.887702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.887714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:33.887722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:33.887727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:33.887774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.887779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.887781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.887784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:33.887785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:33.887843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:33.887851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.887861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:33.887871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:33.887885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:33.887906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660252271:4447], now have 1 active actors on pipe
2025-10-01T14:07:33.887909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660252148:2446], now have 1 active actors on pipe
2025-10-01T14:07:33.887924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254734283390999:4073]
2025-10-01T14:07:33.887927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254734283390999:4073]
2025-10-01T14:07:33.887929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254734283390999:4073]
2025-10-01T14:07:33.887940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:33.887952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:33.887974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:33.887981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:33.888017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254734283390999:4073]
2025-10-01T14:07:33.888024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:33.888089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:33.888091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:33.888047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 302
2025-10-01T14:07:33.888093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:33.888048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 302
2025-10-01T14:07:33.888098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:33.888217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.888229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.888258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|216087ab-9169e703-89174ce7-5176c3f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:33.888268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:33.888272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:33.888277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:33.888284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:33.888297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:33.888314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:33.888567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:33.888578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:33.888597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:33.888725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 303 partition: 0 MaxSeqNo: 45 sessionId: src_id|216087ab-9169e703-89174ce7-5176c3f3_0
2025-10-01T14:07:33.889148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60104d2-106e34fe-7287652e-47f67919_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|216087ab-9169e703-89174ce7-5176c3f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:33.891669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|216087ab-9169e703-89174ce7-5176c3f3_0] Write session: try to update token
2025-10-01T14:07:33.891691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|216087ab-9169e703-89174ce7-5176c3f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:33.916831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:33.916858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:33.916860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:33.916862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:33.916872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254734283390999:4073]
2025-10-01T14:07:33.916877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254734283390999:4073]
2025-10-01T14:07:33.916885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254734283390999:4073]
2025-10-01T14:07:33.916942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:33.916949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:33.916951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:33.917093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:33.917107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:33.917112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:33.917123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:33.917384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 303 sessionId: src_id|216087ab-9169e703-89174ce7-5176c3f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:33.920209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:33.962445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254736660252280:4446]
2025-10-01T14:07:33.973367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 302, pipe: [1:7556254736660252280:4446]
2025-10-01T14:07:34.076420Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:34.076976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.076986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.077028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254736660252280:4446], now have 1 active actors on pipe
2025-10-01T14:07:34.082002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254736660252280:4446]
2025-10-01T14:07:34.082026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:34.082046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:34.082047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:34.082113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:34.082144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 303 reason: error at write: Disconnected sessionId: src_id|216087ab-9169e703-89174ce7-5176c3f3_0
2025-10-01T14:07:34.082340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 303 sessionId: src_id|216087ab-9169e703-89174ce7-5176c3f3_0 is DEAD
2025-10-01T14:07:34.086472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|216087ab-9169e703-89174ce7-5176c3f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:34.086488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|216087ab-9169e703-89174ce7-5176c3f3_0] Write session will restart in 0.005914s
2025-10-01T14:07:34.086519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|216087ab-9169e703-89174ce7-5176c3f3_0] Write session: Do CDS request
2025-10-01T14:07:34.086526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|216087ab-9169e703-89174ce7-5176c3f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:34.094801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|216087ab-9169e703-89174ce7-5176c3f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:34.096576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:34.096602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 304
2025-10-01T14:07:34.096763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:34.096790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:34.096806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:34.096811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:34.100863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:34.102335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:34.097249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 304 sessionId:  describe result for acl check
2025-10-01T14:07:34.097288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:34.097293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:34.097295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:34.097300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254740955219668:4452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:34.097802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254740955219668:4452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:34.099919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254740955219668:4452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:34.102652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:34.102675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:34.102693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:34.102779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:34.102879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254738578358443:4076]
2025-10-01T14:07:34.102888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254740955219668:4452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:34.102908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254740955219668:4452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:34.102912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254740955219668:4452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:34.102923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:34.103622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:34.103973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:34.104029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:34.104378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:34.104453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.104459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.104460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.104462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.104463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.104464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.104465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.104466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.104467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.104469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.104470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.104471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.104473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.104474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.104479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.104490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.104494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.104498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.104502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.104506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.104510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.104513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.104517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.104520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.104524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.104528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.104531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.104535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.104543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.104551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.104556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.104562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.104567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.104572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.104577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.104582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.104588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.104594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.104598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.104603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.104607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.104615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.104620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.104625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.104630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.104635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.104640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.104645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.104650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.104656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.104660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.104675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.104680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.104685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.104689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.104695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.104734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:34.110807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:34.111514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:34.111532Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:34.111536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:34.111542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:34.111550Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 303 [2:7556254738578358443:4076]
2025-10-01T14:07:34.111571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:34.111589Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:34.111593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.111597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.111600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.111618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:34.111623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:34.111633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:34.111694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.111703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.111706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.111709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:34.111712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:34.111781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:34.111789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.111803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.111820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.111842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:34.111864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254738578358438:4076]
2025-10-01T14:07:34.111871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254738578358438:4076]
2025-10-01T14:07:34.111875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254738578358438:4076]
2025-10-01T14:07:34.111890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:34.111912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:34.111926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:34.111929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:34.111932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:34.111934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:34.111936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:34.111969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254738578358438:4076]
2025-10-01T14:07:34.111977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:34.112020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:34.112160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955219716:4452], now have 1 active actors on pipe
2025-10-01T14:07:34.112169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955219591:2446], now have 1 active actors on pipe
2025-10-01T14:07:34.112401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 303
2025-10-01T14:07:34.112437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 303
2025-10-01T14:07:34.113100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.113118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.113155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:34.113167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.113172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.113175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:34.113187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.113201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:34.113217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:34.118468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.118491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.118539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:34.123175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 304 partition: 0 MaxSeqNo: 45 sessionId: src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0
2025-10-01T14:07:34.123569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|216087ab-9169e703-89174ce7-5176c3f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:34.127165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0] Write session: try to update token
2025-10-01T14:07:34.127279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:34.131837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:34.131875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:34.131887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254738578358438:4076]
2025-10-01T14:07:34.131944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:34.132154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:34.132331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:34.132504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:34.132696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:34.132937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:34.132983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:34.133082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:34.154254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 304 sessionId: src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:34.156946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:34.157757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.157786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.157828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:34.158137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:34.163243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:34.163272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:34.163275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:34.163278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:34.163290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254738578358438:4076]
2025-10-01T14:07:34.163296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254738578358438:4076]
2025-10-01T14:07:34.163301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254738578358438:4076]
2025-10-01T14:07:34.163361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:34.163370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.163372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:34.163451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:34.163460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:34.163465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:34.163549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:34.181936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254740955219735:4446]
2025-10-01T14:07:34.182418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 303, pipe: [1:7556254740955219735:4446]
2025-10-01T14:07:34.320292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:34.320898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955219735:4446], now have 1 active actors on pipe
2025-10-01T14:07:34.330986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.331021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.331228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.331298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.331373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.331437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.331494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.331499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.331573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.331633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.331706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.331774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.331820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.331828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.331898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.331962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.332025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.332089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.332135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.332138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.332214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.332277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.332347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.332409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.332458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.332459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.332537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.332612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.332681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.332755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.332828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.332831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.332930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.333009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.333087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.333169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.333241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.333244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.333331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.333402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.333491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.333574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.333638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.333641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.333728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.333808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.333883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.333959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.334012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.334015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.334111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.334182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.334254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.334325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.335614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:34.335632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:34.335665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 304 reason: error at write: Disconnected sessionId: src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0
2025-10-01T14:07:34.335876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 304 sessionId: src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0 is DEAD
2025-10-01T14:07:34.336056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254740955219735:4446]
2025-10-01T14:07:34.336086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:34.334642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.334658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.334743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.334807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.334871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.334943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.334994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.334997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.336683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:34.338500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:34.338511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0] Write session will restart in 0.009938s
2025-10-01T14:07:34.338538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0] Write session: Do CDS request
2025-10-01T14:07:34.338545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:34.350024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:34.351179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:34.351194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 305
2025-10-01T14:07:34.351456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:34.351494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:34.351501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:34.351529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:34.352179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 305 sessionId:  describe result for acl check
2025-10-01T14:07:34.352207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:34.352208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:34.352209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:34.352215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254740955219793:4457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:34.352745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254740955219793:4457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:34.359226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254740955219793:4457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:34.366423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:34.373779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:34.374032Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:34.374037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:34.374049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:34.374112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:34.374161Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254738578358575:4079]
2025-10-01T14:07:34.373084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254740955219793:4457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:34.373109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254740955219793:4457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:34.373116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254740955219793:4457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:34.373126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:34.374904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:34.377764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:34.377848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:34.378278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:34.378352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.378354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.378356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.378358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.378360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.378362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.378363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.378365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.378390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.378392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.378394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.378395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.378397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.378398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.378407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.378418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.378422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.378427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.378431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.378435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.378440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.378445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.378449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.378454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.378459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.378463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.378468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.378471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.378480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.378488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.378495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.378501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.378506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.378511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.378516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.378525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.378530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.378535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.378541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.378546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.378551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.378556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.378561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.378566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.378571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.378576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.378581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.378587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.378592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.378598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.378602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.378608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.378612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.378618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.378623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.378628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.378673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:34.384860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:34.385779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:34.385785Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:34.385790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:34.385795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:34.385804Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 304 [2:7556254738578358575:4079]
2025-10-01T14:07:34.385827Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:34.385847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:34.385851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.385855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.385858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.385875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:34.385882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:34.385889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:34.385962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.385964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.385966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.385970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:34.385972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:34.386049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:34.386053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.386065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.386076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.386093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:34.386110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254738578358569:4079]
2025-10-01T14:07:34.386113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254738578358569:4079]
2025-10-01T14:07:34.386116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254738578358569:4079]
2025-10-01T14:07:34.386129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:34.386145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:34.386162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:34.386166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:34.386208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254738578358569:4079]
2025-10-01T14:07:34.386210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:34.386659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:34.386669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:34.386671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:34.386677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:34.386689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955219741:2446], now have 1 active actors on pipe
2025-10-01T14:07:34.386700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955219866:4457], now have 1 active actors on pipe
2025-10-01T14:07:34.390527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.390557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.390597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:34.390610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.390617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.390631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:34.390644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.390667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:34.390688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:34.389810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 304
2025-10-01T14:07:34.389857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 304
2025-10-01T14:07:34.391755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.391778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.391811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:34.391975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 305 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0
2025-10-01T14:07:34.394717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505f9e83-a6f2acc5-dc2c35f5-394bccaf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:34.397940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0] Write session: try to update token
2025-10-01T14:07:34.397964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:34.416919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:34.416950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:34.416954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:34.416957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:34.416967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254738578358569:4079]
2025-10-01T14:07:34.416973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254738578358569:4079]
2025-10-01T14:07:34.416980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254738578358569:4079]
2025-10-01T14:07:34.417042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:34.417050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.417054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:34.417193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:34.417202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:34.417206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:34.417249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:34.416272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 305 sessionId: src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:34.418924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:34.438421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254740955219878:4446]
2025-10-01T14:07:34.438937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 304, pipe: [1:7556254740955219878:4446]
2025-10-01T14:07:34.576639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:34.577137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.577146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.577178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955219878:4446], now have 1 active actors on pipe
2025-10-01T14:07:34.577501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:34.577528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254740955219878:4446]
2025-10-01T14:07:34.577547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:34.577550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:34.577609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 305 reason: error at write: Disconnected sessionId: src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0
2025-10-01T14:07:34.577802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 305 sessionId: src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0 is DEAD
2025-10-01T14:07:34.577894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:34.578444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:34.578460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0] Write session will restart in 0.006709s
2025-10-01T14:07:34.578491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0] Write session: Do CDS request
2025-10-01T14:07:34.578498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:34.585959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:34.586357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:34.586423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 306
2025-10-01T14:07:34.586604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:34.586634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:34.586641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:34.586645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:34.587376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 306 sessionId:  describe result for acl check
2025-10-01T14:07:34.587411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:34.587413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:34.587415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:34.587421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254740955219891:4462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:34.587930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254740955219891:4462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:34.597147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254740955219891:4462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:34.605945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254740955219891:4462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:34.605968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254740955219891:4462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:34.605971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254740955219891:4462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:34.605983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:34.608236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:34.611704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:34.611997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:34.612006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:34.612018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:34.612081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:34.612123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254738578358709:4081]
2025-10-01T14:07:34.613013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:34.613414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:34.613467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:34.613815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:34.613879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.613881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.613882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.613884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.613885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.613887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.613888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.613889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.613892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.613893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.613894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.613896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.613897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.613899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.613906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.613917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.613921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.613926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.613930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.613935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.613940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.613944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.613948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.613953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.613957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.613963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.613967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.613970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.613978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.613987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.613994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.613999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.614005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.614012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.614017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.614023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.614030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.614036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.614041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.614047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.614053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.614059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.614064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.614070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.614076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.614082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.614088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.614093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.614098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.614103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.614107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.614112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.614120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.614125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.614129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.614135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.614177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:34.618668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:34.619592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:34.619606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:34.619610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:34.619614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:34.619622Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 305 [2:7556254738578358709:4081]
2025-10-01T14:07:34.619640Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:34.619660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:34.619667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.619671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.619674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.619690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:34.619696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:34.619703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:34.619769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.619772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.619775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.619778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:34.619781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:34.619854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:34.619858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.619870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.619880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.619895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:34.619913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254738578358703:4081]
2025-10-01T14:07:34.619915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254738578358703:4081]
2025-10-01T14:07:34.619918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254738578358703:4081]
2025-10-01T14:07:34.619930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:34.619944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:34.619958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:34.619961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:34.619998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254738578358703:4081]
2025-10-01T14:07:34.620004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:34.620255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:34.620262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:34.620265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:34.620270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:34.620991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955220006:4462], now have 1 active actors on pipe
2025-10-01T14:07:34.621002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955219883:2446], now have 1 active actors on pipe
2025-10-01T14:07:34.620645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 305
2025-10-01T14:07:34.620686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 305
2025-10-01T14:07:34.621438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.621461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.621498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|244f5525-773acf2-d2a8b5a7-de01e553_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:34.621508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.621514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.621517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:34.621528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.621545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:34.621567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:34.622181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.622189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.622206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:34.622342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 306 partition: 0 MaxSeqNo: 45 sessionId: src_id|244f5525-773acf2-d2a8b5a7-de01e553_0
2025-10-01T14:07:34.622800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e53d645-3c156f3-33e53fe2-aeec051b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|244f5525-773acf2-d2a8b5a7-de01e553_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:34.625228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244f5525-773acf2-d2a8b5a7-de01e553_0] Write session: try to update token
2025-10-01T14:07:34.625247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244f5525-773acf2-d2a8b5a7-de01e553_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:34.668258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 306 sessionId: src_id|244f5525-773acf2-d2a8b5a7-de01e553_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:34.670962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.670984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.671026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:34.670697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:34.671170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:34.681766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:34.681791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:34.681794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:34.681795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:34.681805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254738578358703:4081]
2025-10-01T14:07:34.681809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254738578358703:4081]
2025-10-01T14:07:34.681813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254738578358703:4081]
2025-10-01T14:07:34.681862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:34.681874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.681881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:34.682008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:34.683403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254740955220035:4446]
2025-10-01T14:07:34.686420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:34.686436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:34.686440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:34.691161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 305, pipe: [1:7556254740955220035:4446]
2025-10-01T14:07:34.845699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:34.846125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955220035:4446], now have 1 active actors on pipe
2025-10-01T14:07:34.853904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.853930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.854072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.854129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.854187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.854245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.854295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.854303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.854388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.854464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.854536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.854611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.854661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.854671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.854739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.854803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.854873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.854929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.854978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.854989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.855054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.855112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.855168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.855228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.855283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.855291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.855358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.855423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.855490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.855553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.855599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.855602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.855671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.855736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.855808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.855879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.855936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.855942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.856014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.856075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.856134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.856203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.856241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.856244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.856312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.856374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.856432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.856496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.856540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.856544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.856613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.856663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.856721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.856780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.856844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.856847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.856918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:34.856975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:34.857034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:34.857096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:34.857136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:34.857138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:34.858913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:34.858937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:34.858973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 306 reason: error at write: Disconnected sessionId: src_id|244f5525-773acf2-d2a8b5a7-de01e553_0
2025-10-01T14:07:34.859153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 306 sessionId: src_id|244f5525-773acf2-d2a8b5a7-de01e553_0 is DEAD
2025-10-01T14:07:34.859135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:34.859357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:34.859399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254740955220035:4446]
2025-10-01T14:07:34.862633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244f5525-773acf2-d2a8b5a7-de01e553_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:34.862646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244f5525-773acf2-d2a8b5a7-de01e553_0] Write session will restart in 0.006498s
2025-10-01T14:07:34.862672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244f5525-773acf2-d2a8b5a7-de01e553_0] Write session: Do CDS request
2025-10-01T14:07:34.862679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244f5525-773acf2-d2a8b5a7-de01e553_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:34.869856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|244f5525-773acf2-d2a8b5a7-de01e553_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:34.870766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:34.870784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 307
2025-10-01T14:07:34.870946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:34.870970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:34.870974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:34.870978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:34.871446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 307 sessionId:  describe result for acl check
2025-10-01T14:07:34.871487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:34.871489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:34.871490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:34.871496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254740955220115:4473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:34.872322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254740955220115:4473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:34.874504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254740955220115:4473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:34.875809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:34.878125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:34.878354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:34.878385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:34.878399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:34.878458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:34.878498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254738578358862:4092]
2025-10-01T14:07:34.878613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254740955220115:4473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:34.878633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254740955220115:4473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:34.878637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254740955220115:4473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:34.878645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:34.879108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:34.879530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:34.879582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:34.879925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:34.879996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.880003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.880004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.880005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.880006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.880007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.880008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.880009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.880011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.880012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.880013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.880015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.880016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.880017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.880022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.880032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.880036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.880040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.880044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.880048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.880052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.880055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.880059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.880064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.880068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.880072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.880076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.880080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.880087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.880095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:34.880102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.880107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:34.880111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.880116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:34.880121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.880126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:34.880130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.880135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:34.880143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.880149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:34.880159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.880164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:34.880169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.880174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:34.880180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.880185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:34.880190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.880200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.880205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.880213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.880218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.880227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.880232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.880241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:34.880245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.880252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:34.880300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:34.884371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:34.884996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:34.885013Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:34.885016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:34.885019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:34.885027Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 306 [2:7556254738578358862:4092]
2025-10-01T14:07:34.885045Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:34.885062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:34.885065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.885070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.885073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.885089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:34.885094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:34.885101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:34.885165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.885177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.885179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.885182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:34.885185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:34.885260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:34.885269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.885283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:34.885295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:34.885312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:34.885332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955220175:4473], now have 1 active actors on pipe
2025-10-01T14:07:34.885341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955220047:2446], now have 1 active actors on pipe
2025-10-01T14:07:34.885349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254738578358857:4092]
2025-10-01T14:07:34.885356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254738578358857:4092]
2025-10-01T14:07:34.885358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254738578358857:4092]
2025-10-01T14:07:34.885374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:34.885388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:34.885406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:34.885409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:34.885412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:34.885414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:34.885416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:34.885445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254738578358857:4092]
2025-10-01T14:07:34.885455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:34.885428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 306
2025-10-01T14:07:34.885465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 306
2025-10-01T14:07:34.885492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:34.885690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.885701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.885733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:34.885745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:34.885756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:34.885759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:34.885768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:34.885780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:34.885807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:34.885991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:34.885999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:34.886013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:34.886112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 307 partition: 0 MaxSeqNo: 45 sessionId: src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0
2025-10-01T14:07:34.886545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|244f5525-773acf2-d2a8b5a7-de01e553_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:34.889110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0] Write session: try to update token
2025-10-01T14:07:34.889127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:34.910424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:34.910440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:34.910443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:34.910445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:34.910455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254738578358857:4092]
2025-10-01T14:07:34.910463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254738578358857:4092]
2025-10-01T14:07:34.910466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254738578358857:4092]
2025-10-01T14:07:34.910514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:34.910521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:34.910524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:34.910528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:34.910528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:34.910530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:34.910669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:34.911419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 307 sessionId: src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:34.914073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:34.959151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254740955220186:4446]
2025-10-01T14:07:34.959502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 306, pipe: [1:7556254740955220186:4446]
2025-10-01T14:07:35.078494Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:35.078915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.078932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.078975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254740955220186:4446], now have 1 active actors on pipe
2025-10-01T14:07:35.079280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:35.079342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254740955220186:4446]
2025-10-01T14:07:35.079366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:35.079368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:35.079426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 307 reason: error at write: Disconnected sessionId: src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0
2025-10-01T14:07:35.079632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 307 sessionId: src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0 is DEAD
2025-10-01T14:07:35.079795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:35.079330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:35.079806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0] Write session will restart in 0.005867s
2025-10-01T14:07:35.079851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0] Write session: Do CDS request
2025-10-01T14:07:35.079858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:35.086922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.087022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:35.087039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 308
2025-10-01T14:07:35.087231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.087269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:35.087275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:35.087282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:35.088052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 308 sessionId:  describe result for acl check
2025-10-01T14:07:35.088081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:35.088083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:35.088084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:35.088090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254745250187543:4478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:35.088584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254745250187543:4478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:35.091957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254745250187543:4478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:35.094439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:35.096074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:35.096311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:35.096326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:35.096338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:35.096394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:35.096437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254742873326321:4099]
2025-10-01T14:07:35.097028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:35.096255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254745250187543:4478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:35.096271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254745250187543:4478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:35.096275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254745250187543:4478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:35.096285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:35.097277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:35.097319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:35.097628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:35.097682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.097688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.097689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.097690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.097691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.097693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.097694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.097695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.097696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.097697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.097698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.097700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.097700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.097701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.097706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.097715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.097719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.097723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.097725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.097729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.097733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.097737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.097740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.097744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.097748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.097750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.097754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.097758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.097765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.097771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.097776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.097781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.097785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.097789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.097792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.097797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.097801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.097805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.097809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.097813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.097817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.097822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.097834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.097840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.097844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.097849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.097854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.097859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.097864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.097870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.097875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.097881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.097886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.097891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.097901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.097906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.097945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:35.103825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:35.104583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:35.104598Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:35.104601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:35.104605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:35.104612Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 307 [2:7556254742873326321:4099]
2025-10-01T14:07:35.104633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:35.104654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:35.104660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.104664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.104667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.104683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:35.104694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:35.104701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:35.104773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.104779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.104781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.104785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:35.104788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:35.104875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:35.104882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.104897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.104913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.104934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:35.104954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254742873326316:4099]
2025-10-01T14:07:35.104960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254742873326316:4099]
2025-10-01T14:07:35.104962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254742873326316:4099]
2025-10-01T14:07:35.104976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:35.104995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:35.105015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:35.105022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:35.105064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254742873326316:4099]
2025-10-01T14:07:35.105065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:35.105068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:35.105070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:35.105071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:35.105077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:35.105101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187499:2446], now have 1 active actors on pipe
2025-10-01T14:07:35.105162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187627:4478], now have 1 active actors on pipe
2025-10-01T14:07:35.105618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 307
2025-10-01T14:07:35.105663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 307
2025-10-01T14:07:35.105724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.105734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.105762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64af57e8-eaffce55-701d0212-79dab1c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:35.105772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.105781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.105784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:35.105795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.105811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:35.105832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.106059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.106073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.106097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.106203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 308 partition: 0 MaxSeqNo: 45 sessionId: src_id|64af57e8-eaffce55-701d0212-79dab1c7_0
2025-10-01T14:07:35.106638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f2fb21-728256a9-2e588a68-a9d12e41_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64af57e8-eaffce55-701d0212-79dab1c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:35.109248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64af57e8-eaffce55-701d0212-79dab1c7_0] Write session: try to update token
2025-10-01T14:07:35.109268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64af57e8-eaffce55-701d0212-79dab1c7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:35.131915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:35.131932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:35.131934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:35.131937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:35.131948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254742873326316:4099]
2025-10-01T14:07:35.131955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254742873326316:4099]
2025-10-01T14:07:35.131958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254742873326316:4099]
2025-10-01T14:07:35.132010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:35.132010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:35.132016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:35.132022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.132025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:35.132020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:35.132170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:35.136956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 308 sessionId: src_id|64af57e8-eaffce55-701d0212-79dab1c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:35.139433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:35.182435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254745250187648:4446]
2025-10-01T14:07:35.189715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 307, pipe: [1:7556254745250187648:4446]
2025-10-01T14:07:35.296971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:35.297440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.297456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.297499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187648:4446], now have 1 active actors on pipe
2025-10-01T14:07:35.297721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:35.298039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:35.298110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 308 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64af57e8-eaffce55-701d0212-79dab1c7_0
2025-10-01T14:07:35.298294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 308 sessionId: src_id|64af57e8-eaffce55-701d0212-79dab1c7_0 is DEAD
2025-10-01T14:07:35.298590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64af57e8-eaffce55-701d0212-79dab1c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:35.298603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64af57e8-eaffce55-701d0212-79dab1c7_0] Write session will restart in 0.005898s
2025-10-01T14:07:35.298627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64af57e8-eaffce55-701d0212-79dab1c7_0] Write session: Do CDS request
2025-10-01T14:07:35.298634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64af57e8-eaffce55-701d0212-79dab1c7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:35.298486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254745250187648:4446]
2025-10-01T14:07:35.298505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:35.306861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64af57e8-eaffce55-701d0212-79dab1c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.307124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:35.307142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 309
2025-10-01T14:07:35.307301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.307345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:35.307354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:35.307357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:35.307871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 309 sessionId:  describe result for acl check
2025-10-01T14:07:35.307910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:35.307917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:35.307919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:35.307925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254745250187680:4483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:35.308470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254745250187680:4483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:35.311533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254745250187680:4483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:35.312302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:35.314218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:35.314642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254745250187680:4483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:35.314658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254745250187680:4483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:35.314663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254745250187680:4483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:35.314671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:35.314448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:35.314459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:35.314472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:35.314526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:35.314571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254742873326458:4102]
2025-10-01T14:07:35.315153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:35.316357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:35.316415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:35.316782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:35.316864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.316870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.316871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.316872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.316874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.316875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.316876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.316878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.316879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.316880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.316882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.316883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.316884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.316885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.316892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.316903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.316907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.316911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.316915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.316919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.316923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.316927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.316931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.316935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.316939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.316943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.316948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.316951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.316959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.316967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.316974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.316979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.316984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.316989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.316994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.316999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.317004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.317009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.317013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.317019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.317024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.317030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.317035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.317040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.317047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.317052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.317056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.317062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.317067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.317072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.317076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.317081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.317092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.317097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.317101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.317106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.317151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:35.321958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:35.322661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:35.322676Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:35.322679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:35.322682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:35.322690Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 308 [2:7556254742873326458:4102]
2025-10-01T14:07:35.322707Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:35.322724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:35.322727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.322731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.322733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.322750Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:35.322755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:35.322762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:35.322820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.322835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.322837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.322840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:35.322843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:35.322908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:35.322917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.322928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.322938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.322954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:35.322972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187655:2446], now have 1 active actors on pipe
2025-10-01T14:07:35.322977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187782:4483], now have 1 active actors on pipe
2025-10-01T14:07:35.322985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254742873326453:4102]
2025-10-01T14:07:35.322987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254742873326453:4102]
2025-10-01T14:07:35.322989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254742873326453:4102]
2025-10-01T14:07:35.323000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:35.323009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:35.323012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:35.323013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:35.323014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:35.323029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:35.323031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:35.323072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254742873326453:4102]
2025-10-01T14:07:35.323081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:35.323200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:35.323702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.323714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.323740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:35.323753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.323763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.323765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:35.323786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.323801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:35.323820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.324129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.324139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.324161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.324623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64af57e8-eaffce55-701d0212-79dab1c7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:35.323144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 308
2025-10-01T14:07:35.323161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 308
2025-10-01T14:07:35.324248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 309 partition: 0 MaxSeqNo: 45 sessionId: src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0
2025-10-01T14:07:35.327271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0] Write session: try to update token
2025-10-01T14:07:35.327287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:35.347641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:35.347660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:35.347663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:35.347665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:35.347676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254742873326453:4102]
2025-10-01T14:07:35.347681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254742873326453:4102]
2025-10-01T14:07:35.347685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254742873326453:4102]
2025-10-01T14:07:35.347744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:35.347753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.347753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:35.347756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:35.347760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:35.347764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:35.347905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:35.351695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 309 sessionId: src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:35.355670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:35.398505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254745250187794:4446]
2025-10-01T14:07:35.398811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 308, pipe: [1:7556254745250187794:4446]
2025-10-01T14:07:35.508943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:35.509212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.509225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.509262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187794:4446], now have 1 active actors on pipe
2025-10-01T14:07:35.509499Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:35.509507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:35.509535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:35.509539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:35.509577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254745250187794:4446]
2025-10-01T14:07:35.509601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 309 reason: error at write: Disconnected sessionId: src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0
2025-10-01T14:07:35.509809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 309 sessionId: src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0 is DEAD
2025-10-01T14:07:35.509953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:35.509965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0] Write session will restart in 0.006442s
2025-10-01T14:07:35.509995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0] Write session: Do CDS request
2025-10-01T14:07:35.510001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:35.517996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.518090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:35.518111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 310
2025-10-01T14:07:35.518407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.518446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:35.518460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:35.518465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:35.518972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 310 sessionId:  describe result for acl check
2025-10-01T14:07:35.519019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:35.519027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:35.519029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:35.519034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254745250187810:4487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:35.519577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254745250187810:4487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:35.522668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254745250187810:4487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:35.526095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:35.526226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254745250187810:4487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:35.526246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254745250187810:4487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:35.526250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254745250187810:4487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:35.526262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:35.528736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:35.529046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:35.529058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:35.529073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:35.529142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:35.529190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254742873326594:4104]
2025-10-01T14:07:35.529804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:35.530144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:35.530198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:35.530536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:35.530638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.530645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.530646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.530647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.530648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.530649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.530650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.530651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.530652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.530653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.530654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.530655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.530656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.530657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.530663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.530673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.530678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.530681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.530685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.530689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.530693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.530696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.530700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.530704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.530708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.530711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.530715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.530718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.530726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.530734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.530740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.530745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.530749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.530753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.530757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.530762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.530767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.530772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.530776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.530781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.530791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.530795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.530800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.530805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.530814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.530819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.530823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.530832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.530838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.530847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.530852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.530857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.530868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.530876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.530881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.530889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.530925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:35.537311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:35.537953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:35.537959Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:35.537962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:35.537966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:35.537973Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 309 [2:7556254742873326594:4104]
2025-10-01T14:07:35.537990Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:35.538008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:35.538011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.538014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.538017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.538035Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:35.538041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:35.538048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:35.538109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.538111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.538113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.538117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:35.538120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:35.538196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:35.538199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.538210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.538222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.538237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:35.538256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187797:2446], now have 1 active actors on pipe
2025-10-01T14:07:35.538260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187926:4487], now have 1 active actors on pipe
2025-10-01T14:07:35.538267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254742873326588:4104]
2025-10-01T14:07:35.538269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254742873326588:4104]
2025-10-01T14:07:35.538272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254742873326588:4104]
2025-10-01T14:07:35.538287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:35.538301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:35.538315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:35.538317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:35.538356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254742873326588:4104]
2025-10-01T14:07:35.538358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:35.538454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:35.538463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:35.538466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:35.538472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:35.538400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 309
2025-10-01T14:07:35.538457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 309
2025-10-01T14:07:35.538621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.538639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.538674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:35.538683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.538689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.538691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:35.538702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.538714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:35.538733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.539487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.539498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.539520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.539715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 310 partition: 0 MaxSeqNo: 45 sessionId: src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0
2025-10-01T14:07:35.540136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e338c653-c6efc6ef-a0908bef-916ff1eb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:35.543209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0] Write session: try to update token
2025-10-01T14:07:35.543233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:35.562898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:35.562915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:35.562917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:35.562919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:35.562930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254742873326588:4104]
2025-10-01T14:07:35.562938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254742873326588:4104]
2025-10-01T14:07:35.562942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254742873326588:4104]
2025-10-01T14:07:35.562993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:35.563001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.563003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:35.563143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:35.566442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:35.566451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:35.566455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:35.585235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 310 sessionId: src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:35.588592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:35.609984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254745250187950:4446]
2025-10-01T14:07:35.611870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 309, pipe: [1:7556254745250187950:4446]
2025-10-01T14:07:35.729210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:35.729755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.729775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.729799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187950:4446], now have 1 active actors on pipe
2025-10-01T14:07:35.730258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254745250187950:4446]
2025-10-01T14:07:35.730305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:35.730344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:35.730349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:35.730451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 310 reason: error at write: Disconnected sessionId: src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0
2025-10-01T14:07:35.730632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 310 sessionId: src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0 is DEAD
2025-10-01T14:07:35.731112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:35.731126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0] Write session will restart in 0.009042s
2025-10-01T14:07:35.731151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0] Write session: Do CDS request
2025-10-01T14:07:35.731159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:35.730860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:35.740982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.741368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:35.741386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 311
2025-10-01T14:07:35.741573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.741615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:35.741625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:35.741629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:35.742075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 311 sessionId:  describe result for acl check
2025-10-01T14:07:35.742105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:35.742107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:35.742109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:35.742122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254745250188060:4498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:35.742690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254745250188060:4498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:35.743756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:35.745121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254745250188060:4498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:35.746112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:35.746327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:35.746340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:35.746351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:35.746424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:35.746464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254742873326732:4107]
2025-10-01T14:07:35.747126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:35.747453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:35.747509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:35.747861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:35.747913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.747918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.747919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.747920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.747921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.747922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.747923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.747925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.747926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.747927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.747929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.747930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.747931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.747932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.747937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.747946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.747951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.747955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.747959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.747962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.747966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.747970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.747973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.747977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.747974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254745250188060:4498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:35.747989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254745250188060:4498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:35.747981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.747984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.747992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254745250188060:4498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:35.747988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.748001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:35.747992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.747999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.748006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.748012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.748018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.748022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.748027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.748032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.748037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.748042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.748047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.748050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.748056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.748061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.748067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.748071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.748076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.748082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.748092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.748097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.748102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.748111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.748116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.748121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.748130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.748135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.748145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.748149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.748155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.748200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:35.752451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:35.753329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:35.753344Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:35.753347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:35.753351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:35.753359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 310 [2:7556254742873326732:4107]
2025-10-01T14:07:35.753379Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:35.753405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:35.753408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.753411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.753413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.753432Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:35.753439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:35.753445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:35.753512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.753519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.753521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.753524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:35.753527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:35.753598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:35.753608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.753623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.753634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.753654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:35.753729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 310
2025-10-01T14:07:35.753771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 310
2025-10-01T14:07:35.753678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250187966:2446], now have 1 active actors on pipe
2025-10-01T14:07:35.753687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250188099:4498], now have 1 active actors on pipe
2025-10-01T14:07:35.753694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254742873326727:4107]
2025-10-01T14:07:35.753696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254742873326727:4107]
2025-10-01T14:07:35.753698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254742873326727:4107]
2025-10-01T14:07:35.753713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:35.753726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:35.753740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:35.753743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:35.753777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254742873326727:4107]
2025-10-01T14:07:35.753779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:35.753944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:35.753952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:35.753954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:35.753959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:35.753963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.753970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.754000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|271b1d9f-15c1d964-6060807-9882d421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:35.754022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.754033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.754036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:35.754052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.754063Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:35.754090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.754235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.754244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.754261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.754351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 311 partition: 0 MaxSeqNo: 45 sessionId: src_id|271b1d9f-15c1d964-6060807-9882d421_0
2025-10-01T14:07:35.760231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67acd863-2c6fe851-dd000cc2-6a4ac117_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|271b1d9f-15c1d964-6060807-9882d421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:35.763394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|271b1d9f-15c1d964-6060807-9882d421_0] Write session: try to update token
2025-10-01T14:07:35.763416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|271b1d9f-15c1d964-6060807-9882d421_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:35.787837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:35.787856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:35.787859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:35.787861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:35.787872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254742873326727:4107]
2025-10-01T14:07:35.787877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254742873326727:4107]
2025-10-01T14:07:35.787882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254742873326727:4107]
2025-10-01T14:07:35.787927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:35.787932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:35.787940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.787942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:35.787944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:35.787947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:35.788093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:35.793740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 311 sessionId: src_id|271b1d9f-15c1d964-6060807-9882d421_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:35.796853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:35.830592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254745250188121:4446]
2025-10-01T14:07:35.831092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 310, pipe: [1:7556254745250188121:4446]
2025-10-01T14:07:35.958594Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:35.958946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.958962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.959809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271b1d9f-15c1d964-6060807-9882d421_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:35.959821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271b1d9f-15c1d964-6060807-9882d421_0] Write session will restart in 0.008147s
2025-10-01T14:07:35.959850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271b1d9f-15c1d964-6060807-9882d421_0] Write session: Do CDS request
2025-10-01T14:07:35.959858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271b1d9f-15c1d964-6060807-9882d421_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:35.959000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250188121:4446], now have 1 active actors on pipe
2025-10-01T14:07:35.959987Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:35.959341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:35.959357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:35.959424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 311 reason: error at write: Disconnected sessionId: src_id|271b1d9f-15c1d964-6060807-9882d421_0
2025-10-01T14:07:35.959594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254745250188121:4446]
2025-10-01T14:07:35.959631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:35.959649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 311 sessionId: src_id|271b1d9f-15c1d964-6060807-9882d421_0 is DEAD
2025-10-01T14:07:35.970659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|271b1d9f-15c1d964-6060807-9882d421_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.974702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:35.974724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 312
2025-10-01T14:07:35.974943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:35.974999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:35.975010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:35.975015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:35.975573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 312 sessionId:  describe result for acl check
2025-10-01T14:07:35.975624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:35.975633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:35.975637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:35.975642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254745250188136:4503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:35.976236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254745250188136:4503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:35.978889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254745250188136:4503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:35.984363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254745250188136:4503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:35.984385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254745250188136:4503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:35.984389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254745250188136:4503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:35.984398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:35.986040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:35.988162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:35.988405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:35.988417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:35.988430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:35.988485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:35.988527Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254742873326906:4121]
2025-10-01T14:07:35.989190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:35.989519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:35.989596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:35.989963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:35.990023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.990030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.990031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.990033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.990034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.990036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.990037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.990038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.990040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.990041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.990042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.990044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.990045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.990046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.990052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.990062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.990066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.990069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.990072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.990076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.990079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.990083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.990086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.990089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.990093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.990097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.990100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.990104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.990111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.990118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:35.990124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.990129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:35.990133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.990138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:35.990145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.990150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:35.990155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.990160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:35.990165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.990171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:35.990183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.990189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:35.990193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.990197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:35.990202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.990208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:35.990212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.990216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.990220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.990225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.990229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.990233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.990239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.990243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:35.990247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.990251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:35.990288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:35.994635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:35.995656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:35.995675Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:35.995679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:35.995684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:35.995692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 311 [2:7556254742873326906:4121]
2025-10-01T14:07:35.995709Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:35.995727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:35.995742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.995747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.995749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.995770Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:35.995776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:35.995782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:35.995847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.995855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.995857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.995861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:35.995863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:35.995939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:35.995948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:35.995962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:35.995975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:35.995997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:35.996020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250188254:4503], now have 1 active actors on pipe
2025-10-01T14:07:35.996034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254745250188127:2446], now have 1 active actors on pipe
2025-10-01T14:07:35.996042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254742873326901:4121]
2025-10-01T14:07:35.996044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254742873326901:4121]
2025-10-01T14:07:35.996046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254742873326901:4121]
2025-10-01T14:07:35.996061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:35.996076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:35.996092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:35.996095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:35.996112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:35.996115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:35.996118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:35.996135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254742873326901:4121]
2025-10-01T14:07:35.996138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:35.996140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:35.996288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 311
2025-10-01T14:07:35.996317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 311
2025-10-01T14:07:35.996376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.996388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.996419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b57d5883-ac1dab69-c43d3952-90892db9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:35.996432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:35.996441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:35.996444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:35.996457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:35.996472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:35.996495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.996874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:35.996883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:35.996903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:35.997242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 312 partition: 0 MaxSeqNo: 45 sessionId: src_id|b57d5883-ac1dab69-c43d3952-90892db9_0
2025-10-01T14:07:35.997677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|271b1d9f-15c1d964-6060807-9882d421_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b57d5883-ac1dab69-c43d3952-90892db9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:36.001034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b57d5883-ac1dab69-c43d3952-90892db9_0] Write session: try to update token
2025-10-01T14:07:36.001058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b57d5883-ac1dab69-c43d3952-90892db9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:36.027003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:36.027024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:36.027026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:36.027029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:36.027044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254742873326901:4121]
2025-10-01T14:07:36.027049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254742873326901:4121]
2025-10-01T14:07:36.027054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254742873326901:4121]
2025-10-01T14:07:36.027112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:36.027111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:36.027118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:36.027119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.027122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:36.027123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:36.027281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:36.037111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 312 sessionId: src_id|b57d5883-ac1dab69-c43d3952-90892db9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:36.041626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:36.061535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254749545155577:4446]
2025-10-01T14:07:36.062898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 311, pipe: [1:7556254749545155577:4446]
2025-10-01T14:07:36.180985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:36.181321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.181338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.181372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545155577:4446], now have 1 active actors on pipe
2025-10-01T14:07:36.181587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:36.181676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254749545155577:4446]
2025-10-01T14:07:36.181710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:36.181713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:36.181771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 312 reason: error at write: Disconnected sessionId: src_id|b57d5883-ac1dab69-c43d3952-90892db9_0
2025-10-01T14:07:36.181920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:36.181935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 312 sessionId: src_id|b57d5883-ac1dab69-c43d3952-90892db9_0 is DEAD
2025-10-01T14:07:36.182099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57d5883-ac1dab69-c43d3952-90892db9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:36.182107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57d5883-ac1dab69-c43d3952-90892db9_0] Write session will restart in 0.006977s
2025-10-01T14:07:36.182138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57d5883-ac1dab69-c43d3952-90892db9_0] Write session: Do CDS request
2025-10-01T14:07:36.182145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57d5883-ac1dab69-c43d3952-90892db9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:36.193158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b57d5883-ac1dab69-c43d3952-90892db9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:36.193516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:36.193541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 313
2025-10-01T14:07:36.193686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:36.193721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:36.193732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:36.193737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:36.194220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 313 sessionId:  describe result for acl check
2025-10-01T14:07:36.194262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:36.194269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:36.194271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:36.194276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254749545155683:4509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:36.194868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254749545155683:4509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:36.199548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254749545155683:4509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:36.203263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:36.203458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254749545155683:4509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:36.203477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254749545155683:4509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:36.203484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254749545155683:4509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:36.203676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:36.212729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:36.213009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:36.213019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:36.213031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:36.213085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:36.213126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254747168294353:4124]
2025-10-01T14:07:36.213737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:36.214112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:36.214175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:36.214514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:36.214574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.214575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.214576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.214577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.214578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.214580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.214581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.214582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.214583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.214584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.214585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.214586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.214587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.214589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.214595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.214606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.214610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.214613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.214617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.214620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.214624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.214627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.214631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.214636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.214639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.214643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.214646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.214649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.214657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.214665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.214672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.214676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.214681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.214687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.214691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.214697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.214701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.214707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.214711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.214716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.214721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.214726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.214730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.214736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.214740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.214745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.214749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.214754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.214759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.214764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.214768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.214775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.214780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.214785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.214789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.214795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.214834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:36.219013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:36.219624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:36.219641Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:36.219644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:36.219648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:36.219654Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 312 [2:7556254747168294353:4124]
2025-10-01T14:07:36.219673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:36.219691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:36.219695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.219699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.219702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.219719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:36.219731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:36.219738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:36.219804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.219812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.219814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.219817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:36.219820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:36.219899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:36.219907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.219919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.219933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.219954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:36.219977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545155720:4509], now have 1 active actors on pipe
2025-10-01T14:07:36.219988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545155587:2446], now have 1 active actors on pipe
2025-10-01T14:07:36.219996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254747168294347:4124]
2025-10-01T14:07:36.219999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254747168294347:4124]
2025-10-01T14:07:36.220001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254747168294347:4124]
2025-10-01T14:07:36.220014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:36.220025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:36.220027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:36.220028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:36.220029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:36.220043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:36.220046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:36.220084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254747168294347:4124]
2025-10-01T14:07:36.220093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:36.220097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:36.220071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 312
2025-10-01T14:07:36.220095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 312
2025-10-01T14:07:36.220132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.220141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.220176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:36.220189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.220194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.220196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:36.220206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.220220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:36.220234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:36.220471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.220482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.220503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:36.220613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 313 partition: 0 MaxSeqNo: 45 sessionId: src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0
2025-10-01T14:07:36.222540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b57d5883-ac1dab69-c43d3952-90892db9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:36.225671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0] Write session: try to update token
2025-10-01T14:07:36.225694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:36.251521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:36.251542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:36.251546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:36.251548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:36.251559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254747168294347:4124]
2025-10-01T14:07:36.251565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254747168294347:4124]
2025-10-01T14:07:36.251569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254747168294347:4124]
2025-10-01T14:07:36.251629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:36.251631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:36.251637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.251639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:36.251640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:36.251647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:36.251784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:36.254921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 313 sessionId: src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:36.257997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:36.281825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254749545155735:4446]
2025-10-01T14:07:36.282129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 312, pipe: [1:7556254749545155735:4446]
2025-10-01T14:07:36.426250Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:36.426744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.426760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.426805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545155735:4446], now have 1 active actors on pipe
2025-10-01T14:07:36.428153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:36.428167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:36.428222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:36.428234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 313 reason: error at write: Disconnected sessionId: src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0
2025-10-01T14:07:36.428271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254749545155735:4446]
2025-10-01T14:07:36.428447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 313 sessionId: src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0 is DEAD
2025-10-01T14:07:36.428787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:36.428796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0] Write session will restart in 0.007757s
2025-10-01T14:07:36.428826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0] Write session: Do CDS request
2025-10-01T14:07:36.428833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:36.428335Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:36.438158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:36.438633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:36.438650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 314
2025-10-01T14:07:36.438796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:36.438832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:36.438837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:36.438841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:36.440146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 314 sessionId:  describe result for acl check
2025-10-01T14:07:36.440182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:36.440184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:36.440186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:36.440192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254749545155772:4513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:36.440775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254749545155772:4513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:36.444849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254749545155772:4513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:36.447560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:36.449618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:36.449855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:36.449868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:36.449881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:36.449936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:36.449979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254747168294494:4127]
2025-10-01T14:07:36.450684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:36.451218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:36.451263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:36.451575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:36.451639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.451640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.451641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.451642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.451643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.451644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.451645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.451646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.451647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.451648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.451649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.451650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.451651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.451652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.451672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.451683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.451686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.451690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.451693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.451696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.451699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.451702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.451706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.451709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.451712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.451716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.451719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.451722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.451730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.451737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.451742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.451748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.451753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.451757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.451762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.451767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.451771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.451776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.451779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.451783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.451787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.451791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.451795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.451800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.451804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.451808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.451812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.451816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.451820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.451824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.451829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.451833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.451837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.451842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.451847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.451852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.451888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:36.452424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254749545155772:4513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:36.452438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254749545155772:4513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:36.452441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254749545155772:4513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:36.452450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:36.457712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:36.458431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:36.458437Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:36.458439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:36.458442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:36.458450Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 313 [2:7556254747168294494:4127]
2025-10-01T14:07:36.458469Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:36.458487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:36.458491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.458494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.458496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.458513Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:36.458518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:36.458524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:36.458600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.458602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.458604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.458607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:36.458610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:36.458678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:36.458680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.458691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.458701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.458715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:36.458734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254747168294489:4127]
2025-10-01T14:07:36.458736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254747168294489:4127]
2025-10-01T14:07:36.458738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254747168294489:4127]
2025-10-01T14:07:36.458752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:36.458765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:36.458778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:36.458781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:36.458818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254747168294489:4127]
2025-10-01T14:07:36.458820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:36.459020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:36.459024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:36.459025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:36.459028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:36.459331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 313
2025-10-01T14:07:36.459351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 313
2025-10-01T14:07:36.459643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545155738:2446], now have 1 active actors on pipe
2025-10-01T14:07:36.459647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545155877:4513], now have 1 active actors on pipe
2025-10-01T14:07:36.459663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.459667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.459689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:36.459695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.459698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.459701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:36.459709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.459719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:36.459734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:36.466788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.466810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.466850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:36.466992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 314 partition: 0 MaxSeqNo: 45 sessionId: src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0
2025-10-01T14:07:36.467365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceea6cd1-2fe31d28-a67fa3e5-acda2d1a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:36.470285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0] Write session: try to update token
2025-10-01T14:07:36.470304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:36.485541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:36.485558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:36.485561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:36.485563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:36.485573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254747168294489:4127]
2025-10-01T14:07:36.485578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254747168294489:4127]
2025-10-01T14:07:36.485582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254747168294489:4127]
2025-10-01T14:07:36.485642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:36.485645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:36.485651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:36.485655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.485655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:36.485658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:36.485806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:36.490992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 314 sessionId: src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:36.493895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:36.528427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254749545155885:4446]
2025-10-01T14:07:36.528768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 313, pipe: [1:7556254749545155885:4446]
2025-10-01T14:07:36.642176Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:36.642708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.642727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.642774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545155885:4446], now have 1 active actors on pipe
2025-10-01T14:07:36.643479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:36.643537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254749545155885:4446]
2025-10-01T14:07:36.643555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:36.643581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:36.643634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 314 reason: error at write: Disconnected sessionId: src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0
2025-10-01T14:07:36.643830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 314 sessionId: src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0 is DEAD
2025-10-01T14:07:36.643968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:36.643977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0] Write session will restart in 0.008709s
2025-10-01T14:07:36.644002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0] Write session: Do CDS request
2025-10-01T14:07:36.644008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:36.643125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:36.653898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:36.654145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:36.654162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 315
2025-10-01T14:07:36.655133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:36.655177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:36.655182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:36.655186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:36.656533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 315 sessionId:  describe result for acl check
2025-10-01T14:07:36.656562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:36.656564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:36.656565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:36.656570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254749545155932:4518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:36.657004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254749545155932:4518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:36.660050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254749545155932:4518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:36.664766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254749545155932:4518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:36.664783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254749545155932:4518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:36.664788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254749545155932:4518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:36.664796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:36.666059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:36.668042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:36.668267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:36.668277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:36.668289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:36.668361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:36.668402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254747168294638:4130]
2025-10-01T14:07:36.669024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:36.669381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:36.669435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:36.669758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:36.669832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.669838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.669839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.669840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.669841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.669842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.669843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.669845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.669846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.669847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.669848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.669849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.669850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.669851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.669856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.669866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.669871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.669875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.669880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.669885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.669889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.669893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.669898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.669902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.669907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.669911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.669915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.669920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.669927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.669935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.669942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.669952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.669957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.669966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.669972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.669981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.669986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.669995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.670000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.670008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.670013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.670023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.670027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.670037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.670042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.670048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.670057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.670062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.670072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.670078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.670083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.670088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.670093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.670098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.670109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.670114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.670162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:36.675075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:36.675836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:36.675854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:36.675857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:36.675861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:36.675870Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 314 [2:7556254747168294638:4130]
2025-10-01T14:07:36.675886Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:36.675904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:36.675913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.675917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.675919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.675937Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:36.675946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:36.675952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:36.676019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.676025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.676028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.676031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:36.676034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:36.676110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:36.676121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.676136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.676162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.676178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:36.676198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545156023:4518], now have 1 active actors on pipe
2025-10-01T14:07:36.676202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545155890:2446], now have 1 active actors on pipe
2025-10-01T14:07:36.676209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254747168294633:4130]
2025-10-01T14:07:36.676211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254747168294633:4130]
2025-10-01T14:07:36.676213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254747168294633:4130]
2025-10-01T14:07:36.676227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:36.676242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:36.676258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:36.676261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:36.676306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254747168294633:4130]
2025-10-01T14:07:36.676309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:36.676350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:36.676353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:36.676355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:36.676361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:36.677397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.677412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.677443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:36.677458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.677466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.677469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:36.677482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.677501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:36.677523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:36.677857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.677866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.677884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:36.677103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 314
2025-10-01T14:07:36.677137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 314
2025-10-01T14:07:36.677980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 315 partition: 0 MaxSeqNo: 45 sessionId: src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0
2025-10-01T14:07:36.683326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5dec85-b6d64b8f-ea6af665-41142d60_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:36.686926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0] Write session: try to update token
2025-10-01T14:07:36.686954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:36.702013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:36.702032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:36.702035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:36.702037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:36.702048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254747168294633:4130]
2025-10-01T14:07:36.702053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254747168294633:4130]
2025-10-01T14:07:36.702056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254747168294633:4130]
2025-10-01T14:07:36.702107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:36.702119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.702121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:36.702267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:36.705050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:36.705067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:36.705071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:36.715476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 315 sessionId: src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:36.717933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:36.743464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254749545156037:4446]
2025-10-01T14:07:36.744178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 314, pipe: [1:7556254749545156037:4446]
2025-10-01T14:07:36.866655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:36.867002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.867018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.867038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545156037:4446], now have 1 active actors on pipe
2025-10-01T14:07:36.870636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:36.871800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:36.871817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0] Write session will restart in 0.008934s
2025-10-01T14:07:36.871845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0] Write session: Do CDS request
2025-10-01T14:07:36.871853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:36.871075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:36.871112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:36.871137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254749545156037:4446]
2025-10-01T14:07:36.871190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 315 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0
2025-10-01T14:07:36.871393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 315 sessionId: src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0 is DEAD
2025-10-01T14:07:36.883374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:36.883835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:36.883852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 316
2025-10-01T14:07:36.884137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:36.884173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:36.884179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:36.884183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:36.889046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 316 sessionId:  describe result for acl check
2025-10-01T14:07:36.889093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:36.889095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:36.889097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:36.889102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254749545156149:4529] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:36.889675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254749545156149:4529] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:36.894529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:36.897000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254749545156149:4529] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:36.897140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:36.897414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:36.897419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:36.897432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:36.897494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:36.897534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254747168294785:4134]
2025-10-01T14:07:36.898176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:36.898714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:36.898777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:36.899096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:36.899310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.899311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.899312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.899314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.899315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.899316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.899317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.899318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.899320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.899321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.899322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.899323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.899325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.899326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.899333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.899344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.899348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.899352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.899356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.899360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.899365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.899368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.899372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.899376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.899380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.899384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.899389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.899393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.899401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.899411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:36.899418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.899424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:36.899429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.899436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:36.899440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.899446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:36.899452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.899457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:36.899461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.899466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:36.899471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.899477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:36.899481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.899487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:36.899495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.899500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:36.899505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.899509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.899513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.899518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.899522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.899526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.899530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.899534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:36.899538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.899543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:36.899579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:36.904680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:36.905402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:36.905409Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:36.905413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:36.905417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:36.905425Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 315 [2:7556254747168294785:4134]
2025-10-01T14:07:36.905444Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:36.905464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:36.905467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.905472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.905476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.905494Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:36.905500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:36.905507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:36.905577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.905579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.905581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.905584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:36.905587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:36.905667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:36.905670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.905684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:36.905696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:36.905713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:36.905730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254747168294780:4134]
2025-10-01T14:07:36.905733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254747168294780:4134]
2025-10-01T14:07:36.905735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254747168294780:4134]
2025-10-01T14:07:36.905747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:36.905764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:36.905781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:36.905784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:36.905822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254747168294780:4134]
2025-10-01T14:07:36.905824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:36.905915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:36.905918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:36.905920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:36.905926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:36.907020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 315
2025-10-01T14:07:36.907888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545156064:2446], now have 1 active actors on pipe
2025-10-01T14:07:36.915384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254749545156149:4529] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:36.915406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254749545156149:4529] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:36.915409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254749545156149:4529] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:36.915420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:36.918637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545156205:4529], now have 1 active actors on pipe
2025-10-01T14:07:36.921973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 315
2025-10-01T14:07:36.923552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.923577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.923600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:36.923603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:36.923612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254747168294780:4134]
2025-10-01T14:07:36.923664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:36.923676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:36.923682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:36.923684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:36.923697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:36.923714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:36.923729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:36.923934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:36.924102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:36.924129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:36.924256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:36.924449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:36.924691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:36.924735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:36.924762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:36.926809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:36.926820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:36.926850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:36.928610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca459d9-fdf8ff62-7c09c180-e59bffb5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:36.926981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 316 partition: 0 MaxSeqNo: 45 sessionId: src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0
2025-10-01T14:07:36.931901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0] Write session: try to update token
2025-10-01T14:07:36.931926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:36.947421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:36.947441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:36.947443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:36.947445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:36.947456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254747168294780:4134]
2025-10-01T14:07:36.947463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254747168294780:4134]
2025-10-01T14:07:36.947469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254747168294780:4134]
2025-10-01T14:07:36.947521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:36.947533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:36.947541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:36.947703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:36.948016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:36.948022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:36.948026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:36.958623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 316 sessionId: src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:36.961338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:36.972160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254749545156213:4446]
2025-10-01T14:07:36.972553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 315, pipe: [1:7556254749545156213:4446]
2025-10-01T14:07:37.122804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:37.123157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.123175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.123200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254749545156213:4446], now have 1 active actors on pipe
2025-10-01T14:07:37.123415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:37.124365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:37.124376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0] Write session will restart in 0.009027s
2025-10-01T14:07:37.124403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0] Write session: Do CDS request
2025-10-01T14:07:37.124410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:37.123912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:37.123961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:37.124039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 316 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0
2025-10-01T14:07:37.124220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 316 sessionId: src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0 is DEAD
2025-10-01T14:07:37.124366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254749545156213:4446]
2025-10-01T14:07:37.134878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:37.135071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:37.135086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 317
2025-10-01T14:07:37.135299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:37.135340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:37.135349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:37.135353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:37.135852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 317 sessionId:  describe result for acl check
2025-10-01T14:07:37.135883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:37.135884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:37.135885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:37.135888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254753840123605:4536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:37.136422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254753840123605:4536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:37.137860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:37.138486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254753840123605:4536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:37.139931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:37.140129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:37.140139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:37.140148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:37.140189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:37.140223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254751463262266:4147]
2025-10-01T14:07:37.140683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:37.140960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:37.140999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:37.141260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:37.141313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.141319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.141320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.141321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.141322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.141309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254753840123605:4536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:37.141323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.141319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254753840123605:4536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:37.141324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.141322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254753840123605:4536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:37.141325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.141331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:37.141326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.141327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.141328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.141329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.141330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.141331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.141336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.141345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.141348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.141351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.141354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.141357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.141360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.141363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.141367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.141372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.141375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.141378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.141381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.141384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.141390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.141397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.141402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.141406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.141411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.141415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.141419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.141424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.141428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.141434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.141438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.141443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.141449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.141462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.141467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.141471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.141481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.141486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.141490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.141494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.141502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.141507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.141511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.141515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.141524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.141529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.141532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.141540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.141577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:37.145296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:37.146005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:37.146021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:37.146023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:37.146027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:37.146034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 316 [2:7556254751463262266:4147]
2025-10-01T14:07:37.146050Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:37.146065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:37.146072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.146076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.146077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.146096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:37.146104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:37.146109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:37.146162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.146166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.146168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.146170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:37.146172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:37.146239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:37.146247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.146256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.146265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.146283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:37.146301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840123527:2446], now have 1 active actors on pipe
2025-10-01T14:07:37.146310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840123669:4536], now have 1 active actors on pipe
2025-10-01T14:07:37.146317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254751463262261:4147]
2025-10-01T14:07:37.146322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254751463262261:4147]
2025-10-01T14:07:37.146324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254751463262261:4147]
2025-10-01T14:07:37.146336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:37.146349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:37.146356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:37.146359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:37.146361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:37.146365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:37.146383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:37.146355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 316
2025-10-01T14:07:37.146356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 316
2025-10-01T14:07:37.146421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254751463262261:4147]
2025-10-01T14:07:37.146434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:37.146441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:37.146448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.146452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.146499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:37.146509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.146513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.146515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:37.146523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.146536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:37.146554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:37.146691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.146698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.146713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:37.146779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 317 partition: 0 MaxSeqNo: 45 sessionId: src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0
2025-10-01T14:07:37.147191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccbd273-a4bbc1f3-d49f130a-fcd0defd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:37.153297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0] Write session: try to update token
2025-10-01T14:07:37.153325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:37.167666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:37.167686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:37.167689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:37.167691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:37.167703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254751463262261:4147]
2025-10-01T14:07:37.167709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254751463262261:4147]
2025-10-01T14:07:37.167714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254751463262261:4147]
2025-10-01T14:07:37.167776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:37.167789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.167792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:37.167814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:37.167827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:37.167830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:37.167967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:37.175928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 317 sessionId: src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:37.178545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:37.220395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254753840123686:4446]
2025-10-01T14:07:37.224627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 316, pipe: [1:7556254753840123686:4446]
2025-10-01T14:07:37.329943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:37.330311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.330327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.330351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840123686:4446], now have 1 active actors on pipe
2025-10-01T14:07:37.332959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:37.332962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254753840123686:4446]
2025-10-01T14:07:37.332974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:37.332984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:37.333044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 317 reason: error at write: Disconnected sessionId: src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0
2025-10-01T14:07:37.333039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:37.333243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 317 sessionId: src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0 is DEAD
2025-10-01T14:07:37.333374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:37.333386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0] Write session will restart in 0.008311s
2025-10-01T14:07:37.333415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0] Write session: Do CDS request
2025-10-01T14:07:37.333422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:37.346850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:37.347223Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:37.347243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 318
2025-10-01T14:07:37.347367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:37.347403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:37.347414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:37.347418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:37.348030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 318 sessionId:  describe result for acl check
2025-10-01T14:07:37.348073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:37.348079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:37.348081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:37.348088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254753840123793:4541] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:37.348632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254753840123793:4541] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:37.350758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:37.350725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254753840123793:4541] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:37.353542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:37.353818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:37.353830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:37.353854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:37.353918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:37.353957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254751463262412:4150]
2025-10-01T14:07:37.354588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:37.355266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:37.355324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:37.355844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:37.355932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.355938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.355940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.355941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.355942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.355943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.355944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.355945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.355947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.355948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.355949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.355950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.355952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.355953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.355960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.355971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.355974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.355978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.355981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.355985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.355989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.355992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.355996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.356000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.356003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.356007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.356010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.356014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.356023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.356031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.356038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.356047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.356052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.356062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.356070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.356075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.356079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.356088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.356091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.356096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.356104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.356109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.356113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.356122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.356126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.356131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.356135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.356139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.356144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.356148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.356156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.356161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.356169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.356173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.356188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.356197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.356236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:37.356577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254753840123793:4541] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:37.356596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254753840123793:4541] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:37.356600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254753840123793:4541] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:37.356610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:37.364780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:37.365557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:37.365563Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:37.365565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:37.365570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:37.365578Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 317 [2:7556254751463262412:4150]
2025-10-01T14:07:37.365595Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:37.365612Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:37.365615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.365619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.365622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.365639Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:37.365644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:37.365652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:37.365714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.365717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.365719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.365722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:37.365724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:37.365802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:37.365806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.365817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.365827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.365839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:37.365856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254751463262407:4150]
2025-10-01T14:07:37.365858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254751463262407:4150]
2025-10-01T14:07:37.365860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254751463262407:4150]
2025-10-01T14:07:37.365869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:37.365883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:37.365897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:37.365900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:37.365928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:37.365932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:37.365934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:37.365941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254751463262407:4150]
2025-10-01T14:07:37.365944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:37.365965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:37.365983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840123831:4541], now have 1 active actors on pipe
2025-10-01T14:07:37.365987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840123689:2446], now have 1 active actors on pipe
2025-10-01T14:07:37.366164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 317
2025-10-01T14:07:37.366211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 317
2025-10-01T14:07:37.366273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.366285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.366314Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|448c7105-af9f876f-3947a987-5bc3cf51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:37.366324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.366328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.366330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:37.366340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.366349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:37.366366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:37.366620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.366626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.366639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:37.366764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 318 partition: 0 MaxSeqNo: 45 sessionId: src_id|448c7105-af9f876f-3947a987-5bc3cf51_0
2025-10-01T14:07:37.368271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a003f13-7be1f5ab-9e522398-867cc3d8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|448c7105-af9f876f-3947a987-5bc3cf51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:37.371250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448c7105-af9f876f-3947a987-5bc3cf51_0] Write session: try to update token
2025-10-01T14:07:37.371272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448c7105-af9f876f-3947a987-5bc3cf51_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:37.393563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 318 sessionId: src_id|448c7105-af9f876f-3947a987-5bc3cf51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:37.392448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:37.392467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:37.392470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:37.392473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:37.392483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254751463262407:4150]
2025-10-01T14:07:37.392488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254751463262407:4150]
2025-10-01T14:07:37.392494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254751463262407:4150]
2025-10-01T14:07:37.392545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:37.392552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.392555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:37.392702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:37.394519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:37.394532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:37.394539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:37.396306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:37.433132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254753840123839:4446]
2025-10-01T14:07:37.438458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 317, pipe: [1:7556254753840123839:4446]
2025-10-01T14:07:37.568638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:37.569846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:37.569863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:37.569919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 318 reason: error at write: Disconnected sessionId: src_id|448c7105-af9f876f-3947a987-5bc3cf51_0
2025-10-01T14:07:37.569045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.569061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.569098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840123839:4446], now have 1 active actors on pipe
2025-10-01T14:07:37.570186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:37.570307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448c7105-af9f876f-3947a987-5bc3cf51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:37.570318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448c7105-af9f876f-3947a987-5bc3cf51_0] Write session will restart in 0.008139s
2025-10-01T14:07:37.570345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448c7105-af9f876f-3947a987-5bc3cf51_0] Write session: Do CDS request
2025-10-01T14:07:37.570351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448c7105-af9f876f-3947a987-5bc3cf51_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:37.570111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 318 sessionId: src_id|448c7105-af9f876f-3947a987-5bc3cf51_0 is DEAD
2025-10-01T14:07:37.570359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:37.570401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254753840123839:4446]
2025-10-01T14:07:37.580991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448c7105-af9f876f-3947a987-5bc3cf51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:37.581525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:37.581542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 319
2025-10-01T14:07:37.581666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:37.581712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:37.581723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:37.581727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:37.582454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 319 sessionId:  describe result for acl check
2025-10-01T14:07:37.582491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:37.582492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:37.582498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:37.582503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254753840123885:4546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:37.583106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254753840123885:4546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:37.588174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254753840123885:4546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:37.590994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254753840123885:4546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:37.591011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254753840123885:4546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:37.591014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254753840123885:4546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:37.591023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:37.591152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:37.593729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:37.593987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:37.593992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:37.594004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:37.594060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:37.594096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254751463262558:4152]
2025-10-01T14:07:37.594696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:37.595267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:37.595339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:37.595676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:37.595757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.595970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.595972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.595973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.595974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.595975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.595977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.595978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.595979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.595980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.595981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.595983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.595984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.595985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.595994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.596004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.596008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.596012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.596016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.596019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.596023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.596026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.596030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.596034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.596037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.596040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.596043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.596047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.596056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.596063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.596080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.596084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.596088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.596093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.596096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.596101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.596105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.596109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.596113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.596117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.596123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.596127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.596131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.596135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.596140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.596143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.596154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.596159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.596163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.596167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.596171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.596177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.596181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.596185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.596189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.596192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.596226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:37.601859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:37.602567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:37.602583Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:37.602587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:37.602591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:37.602599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 318 [2:7556254751463262558:4152]
2025-10-01T14:07:37.602619Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:37.602638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:37.602642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.602645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.602648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.602666Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:37.602672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:37.602678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:37.602737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.602740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.602742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.602745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:37.602748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:37.602970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:37.602973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.602984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.602995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.603009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:37.603026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254751463262551:4152]
2025-10-01T14:07:37.603028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254751463262551:4152]
2025-10-01T14:07:37.603030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254751463262551:4152]
2025-10-01T14:07:37.603047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:37.603062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:37.603076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:37.603079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:37.603117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254751463262551:4152]
2025-10-01T14:07:37.603120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:37.603778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 318
2025-10-01T14:07:37.603831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 318
2025-10-01T14:07:37.603504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:37.603512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:37.603514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:37.603521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:37.603670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840123842:2446], now have 1 active actors on pipe
2025-10-01T14:07:37.603673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840123983:4546], now have 1 active actors on pipe
2025-10-01T14:07:37.607578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.607605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.607649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:37.607667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.607674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.607677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:37.607695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.607717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:37.607747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:37.608501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.608516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.608546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:37.608719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 319 partition: 0 MaxSeqNo: 45 sessionId: src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0
2025-10-01T14:07:37.609160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448c7105-af9f876f-3947a987-5bc3cf51_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:37.611785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0] Write session: try to update token
2025-10-01T14:07:37.611807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:37.623442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:37.623461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:37.623471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254751463262551:4152]
2025-10-01T14:07:37.623523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:37.623530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:37.623714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:37.623872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:37.624019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:37.624169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:37.624444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:37.624486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:37.639243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 319 sessionId: src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:37.641825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:37.642082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.642117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.642158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:37.642250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:37.652188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:37.652211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:37.652213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:37.652215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:37.652226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254751463262551:4152]
2025-10-01T14:07:37.652230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254751463262551:4152]
2025-10-01T14:07:37.652234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254751463262551:4152]
2025-10-01T14:07:37.652289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:37.652295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.652294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:37.652297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:37.652302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:37.652305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:37.652442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:37.670189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254753840123996:4446]
2025-10-01T14:07:37.670357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 318, pipe: [1:7556254753840123996:4446]
2025-10-01T14:07:37.826536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:37.835419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.835451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.835612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.835678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.835750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.835817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.835931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.835941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.836013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.836081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.836143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.836215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.836264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.836267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.836349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.836420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.836514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.836589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.836643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.836647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.836721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.836795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.836871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.836941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.837000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.837008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.837078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.837143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.837227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.837295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.837342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.837350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.837419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.837483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.837550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.837618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.837665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.837673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.837747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.837812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.837887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.837958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.838005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.838016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.838083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.838147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.838213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.838280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.838333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.838341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.839663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.839740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.839808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.839876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.839923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.839932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.840006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:37.840082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:37.840151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:37.840216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:37.840265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:37.840273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:37.840343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840123996:4446], now have 1 active actors on pipe
2025-10-01T14:07:37.841507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:37.842475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:37.842533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254753840123996:4446]
2025-10-01T14:07:37.842564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:37.842601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 319 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0
2025-10-01T14:07:37.842776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 319 sessionId: src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0 is DEAD
2025-10-01T14:07:37.842907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:37.842915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0] Write session will restart in 0.008852s
2025-10-01T14:07:37.842941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0] Write session: Do CDS request
2025-10-01T14:07:37.842947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:37.852977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:37.853049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:37.853065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 320
2025-10-01T14:07:37.853223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:37.853256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:37.853265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:37.853268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:37.853611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 320 sessionId:  describe result for acl check
2025-10-01T14:07:37.853642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:37.853650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:37.853651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:37.853656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254753840124024:4556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:37.854093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254753840124024:4556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:37.863366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254753840124024:4556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:37.871310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254753840124024:4556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:37.871329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254753840124024:4556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:37.871334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254753840124024:4556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:37.871343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:37.871156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:37.873752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:37.874000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:37.874005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:37.874016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:37.874064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:37.874097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254751463262706:4155]
2025-10-01T14:07:37.874702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:37.874987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:37.875040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:37.875346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:37.875416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.875422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.875423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.875424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.875425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.875426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.875427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.875428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.875429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.875430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.875431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.875432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.875433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.875434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.875439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.875449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.875452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.875455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.875459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.875463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.875466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.875470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.875473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.875477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.875481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.875484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.875488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.875491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.875497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.875504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:37.875510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.875519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:37.875524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.875529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:37.875537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.875542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:37.875551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.875555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:37.875563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.875568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:37.875576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.875585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:37.875593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.875602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:37.875606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.875611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:37.875615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.875621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.875626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.875630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.875639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.875643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.875651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.875656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:37.875664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.875668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:37.875711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:37.879833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:37.880514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:37.880526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:37.880528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:37.880531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:37.880536Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 319 [2:7556254751463262706:4155]
2025-10-01T14:07:37.880552Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:37.880569Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:37.880572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.880576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.880579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.880592Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:37.880596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:37.880601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:37.880649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.880657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.880659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.880662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:37.880664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:37.880727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:37.880733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.880744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:37.880758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:37.880776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:37.880796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840124150:4556], now have 1 active actors on pipe
2025-10-01T14:07:37.880803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840124014:2446], now have 1 active actors on pipe
2025-10-01T14:07:37.880820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254751463262700:4155]
2025-10-01T14:07:37.880822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254751463262700:4155]
2025-10-01T14:07:37.880826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254751463262700:4155]
2025-10-01T14:07:37.880837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:37.880845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:37.880847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:37.880849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:37.880854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:37.880868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:37.880874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:37.880906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254751463262700:4155]
2025-10-01T14:07:37.880915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:37.880923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:37.881016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 319
2025-10-01T14:07:37.881044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 319
2025-10-01T14:07:37.881340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.881352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.881382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:37.881393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:37.881397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:37.881401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:37.881411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:37.881421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:37.881451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:37.881894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:37.881903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:37.881920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:37.882002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 320 partition: 0 MaxSeqNo: 45 sessionId: src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0
2025-10-01T14:07:37.882396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6efbe8f-9765b841-1c6dad5a-c111cfb2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:37.884922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0] Write session: try to update token
2025-10-01T14:07:37.884941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:37.913258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:37.913279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:37.913281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:37.913282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:37.913290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254751463262700:4155]
2025-10-01T14:07:37.913294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254751463262700:4155]
2025-10-01T14:07:37.913300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254751463262700:4155]
2025-10-01T14:07:37.913343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:37.913348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:37.913349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:37.913349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:37.913355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:37.913359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:37.913479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:37.940521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 320 sessionId: src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:37.942836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254753840124172:4446]
2025-10-01T14:07:37.943218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:37.943219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 319, pipe: [1:7556254753840124172:4446]
2025-10-01T14:07:38.085838Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:38.086136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254753840124172:4446], now have 1 active actors on pipe
2025-10-01T14:07:38.086167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.086178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.086453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:38.086513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254753840124172:4446]
2025-10-01T14:07:38.086532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:38.086535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:38.086589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 320 reason: error at write: Disconnected sessionId: src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0
2025-10-01T14:07:38.086778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 320 sessionId: src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0 is DEAD
2025-10-01T14:07:38.086646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:38.090462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:38.090474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0] Write session will restart in 0.006242s
2025-10-01T14:07:38.090502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0] Write session: Do CDS request
2025-10-01T14:07:38.090508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:38.098232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:38.098738Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:38.098752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 321
2025-10-01T14:07:38.098875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:38.098899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:38.098906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:38.098910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:38.099260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 321 sessionId:  describe result for acl check
2025-10-01T14:07:38.099285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:38.099286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:38.099288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:38.099292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254758135091576:4562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:38.099775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254758135091576:4562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:38.102053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254758135091576:4562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:38.102417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:38.104160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:38.104357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:38.104368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:38.104379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:38.104422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:38.104457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254755758230196:4170]
2025-10-01T14:07:38.104993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:38.105232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:38.105266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:38.105240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254758135091576:4562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:38.105259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254758135091576:4562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:38.105262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254758135091576:4562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:38.105271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:38.105549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:38.105614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.105621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.105622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.105623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.105624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.105626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.105627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.105628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.105629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.105630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.105631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.105633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.105634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.105635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.105640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.105650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.105653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.105657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.105661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.105665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.105669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.105673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.105676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.105680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.105684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.105687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.105691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.105694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.105701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.105708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.105715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.105721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.105726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.105731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.105735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.105740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.105744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.105750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.105755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.105760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.105767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.105777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.105781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.105786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.105791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.105796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.105806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.105819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.105827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.105833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.105841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.105846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.105855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.105859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.105867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.105872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.105916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:38.113834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:38.114757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:38.114772Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:38.114774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:38.114778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:38.114785Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 320 [2:7556254755758230196:4170]
2025-10-01T14:07:38.114803Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:38.114821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:38.114825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.114829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.114831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.114849Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:38.114856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:38.114862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:38.114925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.114928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.114930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.114934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:38.114936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:38.115008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:38.115011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.115025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.115038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.115056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:38.115074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254755758230191:4170]
2025-10-01T14:07:38.115076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254755758230191:4170]
2025-10-01T14:07:38.115078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254755758230191:4170]
2025-10-01T14:07:38.115093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:38.115108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:38.115124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:38.115127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:38.115167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254755758230191:4170]
2025-10-01T14:07:38.115169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:38.115172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:38.115175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:38.115177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:38.115179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091486:2446], now have 1 active actors on pipe
2025-10-01T14:07:38.115182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091627:4562], now have 1 active actors on pipe
2025-10-01T14:07:38.115183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:38.115423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.115437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.115250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 320
2025-10-01T14:07:38.115259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 320
2025-10-01T14:07:38.115477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:38.115491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.115497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.115499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:38.115510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.115520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:38.115538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:38.115849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.115861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.115885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:38.116400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40d17f4a-2ba0e802-8073e117-561f43a0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:38.116015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 321 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0
2025-10-01T14:07:38.119165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0] Write session: try to update token
2025-10-01T14:07:38.119184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:38.137948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:38.137971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:38.137974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:38.137976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:38.137987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254755758230191:4170]
2025-10-01T14:07:38.137991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254755758230191:4170]
2025-10-01T14:07:38.137995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254755758230191:4170]
2025-10-01T14:07:38.138047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:38.138055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.138065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:38.138202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:38.135779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 321 sessionId: src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:38.138594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:38.138774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:38.138785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:38.138789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:38.190499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254758135091642:4446]
2025-10-01T14:07:38.192593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 320, pipe: [1:7556254758135091642:4446]
2025-10-01T14:07:38.290792Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:38.291287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.291298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.291344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091642:4446], now have 1 active actors on pipe
2025-10-01T14:07:38.291582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:38.291646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:38.291668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254758135091642:4446]
2025-10-01T14:07:38.291699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:38.291799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 321 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0
2025-10-01T14:07:38.291978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 321 sessionId: src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0 is DEAD
2025-10-01T14:07:38.292123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:38.292136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0] Write session will restart in 0.006970s
2025-10-01T14:07:38.292175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0] Write session: Do CDS request
2025-10-01T14:07:38.292181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:38.299943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:38.300008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:38.300035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 322
2025-10-01T14:07:38.300143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:38.300175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:38.300185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:38.300189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:38.300638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 322 sessionId:  describe result for acl check
2025-10-01T14:07:38.300680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:38.300687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:38.300688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:38.300693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254758135091671:4567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:38.301229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254758135091671:4567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:38.304805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254758135091671:4567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:38.309066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:38.309339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:38.309533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:38.309544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:38.309557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:38.309617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:38.309622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254758135091671:4567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:38.309638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254758135091671:4567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:38.309642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254758135091671:4567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:38.309661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254755758230345:4173]
2025-10-01T14:07:38.309654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:38.310247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:38.310553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:38.310618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:38.310964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:38.311029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.311030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.311031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.311032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.311033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.311034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.311036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.311037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.311038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.311039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.311040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.311041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.311042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.311043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.311049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.311059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.311063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.311067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.311070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.311074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.311078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.311081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.311085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.311092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.311096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.311099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.311103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.311107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.311116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.311125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.311131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.311136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.311141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.311146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.311151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.311156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.311161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.311166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.311170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.311175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.311179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.311184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.311189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.311195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.311199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.311205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.311210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.311215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.311219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.311226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.311230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.311235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.311240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.311244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.311249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.311254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.311294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:38.315825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:38.316519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:38.316530Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:38.316532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:38.316535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:38.316542Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 321 [2:7556254755758230345:4173]
2025-10-01T14:07:38.316554Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:38.316629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:38.316635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.316637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.316638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.316652Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:38.316656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:38.316661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:38.316720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.316732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.316734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.316737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:38.316739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:38.316807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:38.316823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.316832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.316844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.316864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:38.316884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254755758230340:4173]
2025-10-01T14:07:38.316892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254755758230340:4173]
2025-10-01T14:07:38.316893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254755758230340:4173]
2025-10-01T14:07:38.316908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:38.316923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:38.316941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:38.316944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:38.316947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:38.316956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:38.316958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:38.316985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254755758230340:4173]
2025-10-01T14:07:38.316990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:38.317038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:38.317617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091648:2446], now have 1 active actors on pipe
2025-10-01T14:07:38.317627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091791:4567], now have 1 active actors on pipe
2025-10-01T14:07:38.317648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.317653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.317681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:38.317691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.317696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.317698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:38.317708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.317720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:38.317736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:38.317918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.317924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.317941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:38.318409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4f7924-5904dcf9-f8f00291-f52efb43_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:38.317317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 321
2025-10-01T14:07:38.317334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 321
2025-10-01T14:07:38.318030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 322 partition: 0 MaxSeqNo: 45 sessionId: src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0
2025-10-01T14:07:38.321004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0] Write session: try to update token
2025-10-01T14:07:38.321023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:38.332619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:38.332643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:38.332659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254755758230340:4173]
2025-10-01T14:07:38.332706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:38.332908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:38.333063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:38.333208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:38.333353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:38.333554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:38.333596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:38.333676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:38.342592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 322 sessionId: src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:38.345378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:38.345861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.345888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.345929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:38.346172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:38.365698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:38.365717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:38.365720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:38.365722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:38.365733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254755758230340:4173]
2025-10-01T14:07:38.365737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254755758230340:4173]
2025-10-01T14:07:38.365741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254755758230340:4173]
2025-10-01T14:07:38.365793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:38.365796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:38.365804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.365806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:38.365807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:38.365810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:38.365967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:38.391605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254758135091802:4446]
2025-10-01T14:07:38.391960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 321, pipe: [1:7556254758135091802:4446]
2025-10-01T14:07:38.519606Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:38.527397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.527427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.527602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.527669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.527742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.527812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.527868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.527877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.527951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.528018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.528084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.528158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.528198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.528202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.528268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.528323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.528376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.528435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.528480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.528483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.528542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.528600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.528667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.528733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.528774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.528779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.528862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.528917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.528970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.529021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.529068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.529071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.529140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.529203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.529264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.529323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.529365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.529368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.529433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.529492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.529559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.529626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.529667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.529670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.529738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.529798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.529863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.529927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.529966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.529969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.530034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.530094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.530153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.530217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.530257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.530259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.530325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:38.530610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:38.530689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:38.530760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:38.530803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:38.530806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:38.530892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091802:4446], now have 1 active actors on pipe
2025-10-01T14:07:38.532607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:38.534489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:38.534553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:38.534589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254758135091802:4446]
2025-10-01T14:07:38.534602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 322 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0
2025-10-01T14:07:38.534801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 322 sessionId: src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0 is DEAD
2025-10-01T14:07:38.538623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:38.538638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0] Write session will restart in 0.008667s
2025-10-01T14:07:38.538671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0] Write session: Do CDS request
2025-10-01T14:07:38.538678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:38.549118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:38.550452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:38.550469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 323
2025-10-01T14:07:38.550717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:38.550754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:38.550761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:38.550766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:38.551363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 323 sessionId:  describe result for acl check
2025-10-01T14:07:38.551406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:38.551408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:38.551410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:38.551418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254758135091812:4571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:38.551932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254758135091812:4571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:38.558192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254758135091812:4571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:38.564388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254758135091812:4571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:38.564410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254758135091812:4571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:38.564414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254758135091812:4571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:38.564424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:38.568886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:38.573535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:38.573811Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:38.573820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:38.573833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:38.573892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:38.573946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254755758230495:4175]
2025-10-01T14:07:38.574579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:38.575031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:38.575098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:38.575452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:38.575527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.575536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.575537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.575538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.575540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.575541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.575542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.575544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.575545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.575547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.575548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.575549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.575551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.575552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.575558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.575570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.575574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.575578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.575582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.575587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.575591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.575595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.575599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.575603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.575607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.575611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.575616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.575620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.575627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.575636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.575643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.575650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.575653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.575659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.575663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.575667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.575672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.575677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.575680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.575685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.575690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.575694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.575698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.575702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.575707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.575712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.575718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.575723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.575728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.575735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.575747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.575752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.575768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.575777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.575780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.575785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.575831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:38.580281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:38.581022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:38.581038Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:38.581041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:38.581045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:38.581052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 322 [2:7556254755758230495:4175]
2025-10-01T14:07:38.581069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:38.581088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:38.581092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.581096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.581098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.581117Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:38.581127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:38.581134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:38.581201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.581208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.581211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.581214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:38.581217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:38.581286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:38.581297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.581309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.581320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.581335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:38.581354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091805:2446], now have 1 active actors on pipe
2025-10-01T14:07:38.581358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091883:4571], now have 1 active actors on pipe
2025-10-01T14:07:38.581366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254755758230490:4175]
2025-10-01T14:07:38.581369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254755758230490:4175]
2025-10-01T14:07:38.581371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254755758230490:4175]
2025-10-01T14:07:38.581383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:38.581391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:38.581393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:38.581399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:38.581404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:38.581414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:38.581417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:38.581456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254755758230490:4175]
2025-10-01T14:07:38.581463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:38.581475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:38.581561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 322
2025-10-01T14:07:38.581607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 322
2025-10-01T14:07:38.581674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.581690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.581721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:38.581734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.581743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.581745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:38.581759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.581775Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:38.581794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:38.582146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.582164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.582201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:38.582325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 323 partition: 0 MaxSeqNo: 45 sessionId: src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0
2025-10-01T14:07:38.586499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccd85144-c9f7216b-2b4d25db-ba655731_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:38.589060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0] Write session: try to update token
2025-10-01T14:07:38.589082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:38.603889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:38.603917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:38.603925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:38.603927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:38.603940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254755758230490:4175]
2025-10-01T14:07:38.603945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254755758230490:4175]
2025-10-01T14:07:38.603948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254755758230490:4175]
2025-10-01T14:07:38.604007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:38.604008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:38.604015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:38.604019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:38.604024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.604027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:38.604191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:38.606211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 323 sessionId: src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:38.608936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:38.634290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254758135091963:4446]
2025-10-01T14:07:38.634600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 322, pipe: [1:7556254758135091963:4446]
2025-10-01T14:07:38.782023Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:38.782309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.782339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.782408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091963:4446], now have 1 active actors on pipe
2025-10-01T14:07:38.782657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:38.782679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:38.782747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254758135091963:4446]
2025-10-01T14:07:38.783196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:38.783213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0] Write session will restart in 0.009381s
2025-10-01T14:07:38.782763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:38.782765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:38.782825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 323 reason: error at write: Disconnected sessionId: src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0
2025-10-01T14:07:38.783042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 323 sessionId: src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0 is DEAD
2025-10-01T14:07:38.783244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0] Write session: Do CDS request
2025-10-01T14:07:38.783251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:38.793971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:38.794115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:38.794132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 324
2025-10-01T14:07:38.798549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:38.798633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:38.798639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:38.798644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:38.799152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 324 sessionId:  describe result for acl check
2025-10-01T14:07:38.799189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:38.799191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:38.799193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:38.799199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254758135092074:4576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:38.799787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254758135092074:4576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:38.802351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:38.804509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:38.804697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:38.804708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:38.804718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:38.804759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:38.804792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254755758230646:4178]
2025-10-01T14:07:38.802575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254758135092074:4576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:38.805311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:38.805602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:38.805644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:38.805881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254758135092074:4576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:38.805896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254758135092074:4576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:38.805900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254758135092074:4576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:38.805908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:38.805938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:38.805994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.805999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.806000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.806000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.806001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.806002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.806002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.806003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.806004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.806005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.806005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.806006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.806006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.806007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.806010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.806016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.806020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.806024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.806028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.806031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.806034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.806037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.806040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.806044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.806047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.806051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.806054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.806058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.806065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.806072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:38.806078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.806083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:38.806087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.806092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:38.806096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.806102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:38.806106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.806111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:38.806115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.806120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:38.806124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.806134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:38.806138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.806144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:38.806148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.806157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:38.806161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.806170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.806173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.806183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.806187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.806191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.806196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.806205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:38.806211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.806219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:38.806258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:38.810762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:38.811446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:38.811464Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:38.811467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:38.811471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:38.811479Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 323 [2:7556254755758230646:4178]
2025-10-01T14:07:38.811499Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:38.811524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:38.811527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.811531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.811539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.811557Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:38.811562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:38.811568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:38.811628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.811637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.811639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.811642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:38.811645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:38.811718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:38.811725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.811740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:38.811759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:38.811780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:38.811806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135091965:2446], now have 1 active actors on pipe
2025-10-01T14:07:38.811815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135092113:4576], now have 1 active actors on pipe
2025-10-01T14:07:38.811822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254755758230641:4178]
2025-10-01T14:07:38.811825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254755758230641:4178]
2025-10-01T14:07:38.811827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254755758230641:4178]
2025-10-01T14:07:38.811839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:38.811852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:38.811857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:38.811861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:38.811863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:38.811872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:38.811875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:38.811912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254755758230641:4178]
2025-10-01T14:07:38.811923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:38.811930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:38.812654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 323
2025-10-01T14:07:38.812692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 323
2025-10-01T14:07:38.813039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.813063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.813096Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:38.813111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:38.813117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:38.813120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:38.813131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:38.813149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:38.813184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:38.813340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.813363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.813384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:38.813508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 324 partition: 0 MaxSeqNo: 45 sessionId: src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0
2025-10-01T14:07:38.813883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb436ca-68b842cb-6a7fb5c3-7b9d69d8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:38.816400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0] Write session: try to update token
2025-10-01T14:07:38.816420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:38.827481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:38.827495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:38.827507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254755758230641:4178]
2025-10-01T14:07:38.827548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:38.827552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:38.827748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:38.827931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:38.828086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:38.828252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:38.828462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:38.828508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:38.846785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 324 sessionId: src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:38.849918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:38.851016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:38.851042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:38.851066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:38.851069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:38.851071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:38.851074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:38.851083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254755758230641:4178]
2025-10-01T14:07:38.851088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254755758230641:4178]
2025-10-01T14:07:38.851092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254755758230641:4178]
2025-10-01T14:07:38.851134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:38.851147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:38.851150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:38.851153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:38.851157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:38.851160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:38.851298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:38.883164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254758135092133:4446]
2025-10-01T14:07:38.887545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 323, pipe: [1:7556254758135092133:4446]
2025-10-01T14:07:39.019245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:39.019565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:39.019610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254758135092133:4446], now have 1 active actors on pipe
2025-10-01T14:07:39.019743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:39.020386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:39.020443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254758135092133:4446]
2025-10-01T14:07:39.030868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:39.030883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:39.030906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 324 reason: error at write: Disconnected sessionId: src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0
2025-10-01T14:07:39.031164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 324 sessionId: src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0 is DEAD
2025-10-01T14:07:39.031230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:39.031243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0] Write session will restart in 0.008565s
2025-10-01T14:07:39.031269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0] Write session: Do CDS request
2025-10-01T14:07:39.031279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:39.040950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:39.045241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:39.045260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 325
2025-10-01T14:07:39.045434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:39.045462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:39.045466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:39.045471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:39.045876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 325 sessionId:  describe result for acl check
2025-10-01T14:07:39.045908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:39.045910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:39.045911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:39.045917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254762430059565:4587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:39.047433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:39.046545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254762430059565:4587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:39.049599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254762430059565:4587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:39.052520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:39.052789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:39.052799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:39.052821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:39.052882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:39.052928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254760053198112:4183]
2025-10-01T14:07:39.053538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:39.053836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:39.053881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:39.054130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:39.054171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.054175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.054176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.054177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.054177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.054178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.054179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.054179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.054180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.054181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.054181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.054182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.054183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.054183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.054186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.054193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.054196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.054200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.054204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.054208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.054211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.054214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.054218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.054223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.054227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.054230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.054234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.054245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.054252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.054259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.054265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.054270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.054275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.054280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.054285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.054290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.054295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.054300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.054304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.054308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.054311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.054313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.054317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.054319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.054322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.054325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.054327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.054330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.054333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.054336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.054338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.054341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.054343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.054345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.054347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.054350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.054407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:39.053046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254762430059565:4587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:39.053064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254762430059565:4587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:39.053067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254762430059565:4587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:39.053075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:39.059758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 324
2025-10-01T14:07:39.059793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 324
2025-10-01T14:07:39.058573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:39.059357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:39.059363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:39.059367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:39.059371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:39.059377Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 324 [2:7556254760053198112:4183]
2025-10-01T14:07:39.059393Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:39.059411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:39.059415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.059418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.059420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.059438Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:39.059443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:39.059451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:39.059505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.059507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.059509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.059512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:39.059514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:39.059635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:39.059637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.059650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.059662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.059680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:39.059699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059597:4587], now have 1 active actors on pipe
2025-10-01T14:07:39.059702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059454:2446], now have 1 active actors on pipe
2025-10-01T14:07:39.059710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254760053198106:4183]
2025-10-01T14:07:39.059712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254760053198106:4183]
2025-10-01T14:07:39.059714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254760053198106:4183]
2025-10-01T14:07:39.059730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:39.059743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:39.059750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:39.059753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:39.059755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:39.059756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:39.059759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:39.059792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254760053198106:4183]
2025-10-01T14:07:39.059800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:39.059860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:39.059909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.059914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.059941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:39.059948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.059952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.059954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:39.059963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.059975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:39.059994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:39.060262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.060269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.060295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:39.060403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 325 partition: 0 MaxSeqNo: 45 sessionId: src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0
2025-10-01T14:07:39.060762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|652e55aa-c8995936-6b74c28b-5e5bd335_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:39.063379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0] Write session: try to update token
2025-10-01T14:07:39.063397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:39.078075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:39.078090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:39.078101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254760053198106:4183]
2025-10-01T14:07:39.078148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:39.078151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:39.078338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:39.078527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:39.078686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:39.078831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:39.079205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:39.079244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:39.082344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 325 sessionId: src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:39.084961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:39.086513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.086538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.086580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:39.086707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:39.099354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:39.099378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:39.099382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:39.099383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:39.099394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254760053198106:4183]
2025-10-01T14:07:39.099398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254760053198106:4183]
2025-10-01T14:07:39.099402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254760053198106:4183]
2025-10-01T14:07:39.099451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:39.099452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:39.099458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:39.099463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:39.099463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.099465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:39.099612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:39.123174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254762430059624:4446]
2025-10-01T14:07:39.123476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 324, pipe: [1:7556254762430059624:4446]
2025-10-01T14:07:39.254051Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:39.262474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.262503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.262698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.262766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.262838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.262915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.263150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.263156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.263248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.263321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.263401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.263480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.263529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.263532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.263623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.263697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.263774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.263853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.263901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.263904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.263991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.264379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.264446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.264514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.264553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.264556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.264626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.264686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.264745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.264805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.264862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.264865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.264927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.264990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.265052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.265112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.265152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.265154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.265227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.265282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.265342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.265402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.265453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.265456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.265520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.265575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.265646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.265719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.265763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.265765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.265831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.265887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.265939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.265996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.266036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.266039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.266103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.266163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.266222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.266283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.266324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.266329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.266659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059624:4446], now have 1 active actors on pipe
2025-10-01T14:07:39.267270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:39.268131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254762430059624:4446]
2025-10-01T14:07:39.268135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:39.268139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:39.268161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:39.268166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 325 reason: error at write: Disconnected sessionId: src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0
2025-10-01T14:07:39.268389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 325 sessionId: src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0 is DEAD
2025-10-01T14:07:39.268592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:39.268604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0] Write session will restart in 0.009835s
2025-10-01T14:07:39.268631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0] Write session: Do CDS request
2025-10-01T14:07:39.268638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:39.280187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:39.280332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:39.280364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 326
2025-10-01T14:07:39.280540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:39.280579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:39.280591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:39.280596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:39.281076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 326 sessionId:  describe result for acl check
2025-10-01T14:07:39.281120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:39.281127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:39.281129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:39.281135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254762430059643:4593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:39.281637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254762430059643:4593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:39.284874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254762430059643:4593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:39.289166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254762430059643:4593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:39.289183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254762430059643:4593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:39.289186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254762430059643:4593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:39.289195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:39.293496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:39.295914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:39.296141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:39.296154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:39.296181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:39.296245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:39.296290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254760053198296:4196]
2025-10-01T14:07:39.296947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:39.297278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:39.297331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:39.297650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:39.297739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.297746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.297747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.297749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.297750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.297751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.297752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.297754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.297755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.297756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.297757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.297758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.297759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.297760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.297767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.297777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.297781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.297785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.297789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.297793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.297797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.297800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.297804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.297808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.297812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.297815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.297819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.297822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.297830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.297839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.297845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.297850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.297854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.297860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.297869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.297874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.297884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.297889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.297897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.297902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.297906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.297916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.297922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.297931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.297936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.297946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.297950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.297956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.297960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.297970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.297974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.297984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.297989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.297998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.298003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.298008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.298056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:39.302402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:39.303042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:39.303049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:39.303052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:39.303056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:39.303063Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 325 [2:7556254760053198296:4196]
2025-10-01T14:07:39.303089Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:39.303107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:39.303111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.303115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.303118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.303134Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:39.303140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:39.303146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:39.303211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.303213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.303215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.303219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:39.303221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:39.303309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:39.303312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.303325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.303340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.303363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:39.303382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059719:4593], now have 1 active actors on pipe
2025-10-01T14:07:39.303387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059634:2446], now have 1 active actors on pipe
2025-10-01T14:07:39.303395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254760053198291:4196]
2025-10-01T14:07:39.303397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254760053198291:4196]
2025-10-01T14:07:39.303400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254760053198291:4196]
2025-10-01T14:07:39.303416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:39.303433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:39.303451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:39.303454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:39.303492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254760053198291:4196]
2025-10-01T14:07:39.303494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:39.303623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:39.303627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:39.303629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:39.303635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:39.303852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 325
2025-10-01T14:07:39.303885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 325
2025-10-01T14:07:39.304095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.304112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.304145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:39.304158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.304163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.304170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:39.304180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.304196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:39.304219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:39.304571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.304584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.304603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:39.304687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 326 partition: 0 MaxSeqNo: 45 sessionId: src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0
2025-10-01T14:07:39.305087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57e6f52b-9505984e-789ccc51-7aa7c529_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:39.307547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0] Write session: try to update token
2025-10-01T14:07:39.307568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:39.322429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 326 sessionId: src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:39.325183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:39.325425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.325452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.325493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:39.325595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:39.329522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:39.329538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:39.329539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:39.329541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:39.329548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254760053198291:4196]
2025-10-01T14:07:39.329552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254760053198291:4196]
2025-10-01T14:07:39.329555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254760053198291:4196]
2025-10-01T14:07:39.329596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:39.329602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.329608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:39.329609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:39.329616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:39.329620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:39.329735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:39.368481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254762430059794:4446]
2025-10-01T14:07:39.370409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 325, pipe: [1:7556254762430059794:4446]
2025-10-01T14:07:39.479485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:39.488350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.488384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.488592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.488677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.488765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.488863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.489392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.489412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.489503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.489585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.489671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.489762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.489817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.489829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.489905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.489970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.490036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.490105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.490155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.490158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.490226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.490292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.490357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.490487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.490554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.490562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.490630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.490694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.490762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.490821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.490863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.490866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.490933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.490995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.491057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.491126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.491171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.491175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.491245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.491307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.491370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.491433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.491476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.491480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.491547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.491606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.491671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.491736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.491781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.491785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.491860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.491922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.491985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.492048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.492091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.492094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.492170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:39.492232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:39.492299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:39.492370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:39.492418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:39.492421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:39.492496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059794:4446], now have 1 active actors on pipe
2025-10-01T14:07:39.494254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:39.494265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0] Write session will restart in 0.009714s
2025-10-01T14:07:39.493849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:39.493505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:39.493909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 326 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0
2025-10-01T14:07:39.494288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0] Write session: Do CDS request
2025-10-01T14:07:39.494096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:39.494296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:39.494108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 326 sessionId: src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0 is DEAD
2025-10-01T14:07:39.494141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254762430059794:4446]
2025-10-01T14:07:39.504933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:39.505615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:39.505643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 327
2025-10-01T14:07:39.513522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:39.514630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:39.514689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:39.514701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:39.514706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:39.515165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 327 sessionId:  describe result for acl check
2025-10-01T14:07:39.515203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:39.515213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:39.515214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:39.515220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254762430059910:4597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:39.515767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254762430059910:4597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:39.517539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:39.517759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:39.517770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:39.517782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:39.517833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:39.517875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254760053198448:4198]
2025-10-01T14:07:39.518554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:39.518609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254762430059910:4597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:39.518896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:39.518965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:39.519316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:39.519385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.519386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.519387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.519388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.519389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.519391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.519392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.519393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.519394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.519395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.519396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.519397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.519398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.519399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.519405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.519416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.519420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.519425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.519428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.519431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.519435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.519438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.519442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.519446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.519449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.519452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.519455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.519458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.519466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.519473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.519479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.519484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.519489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.519493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.519497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.519502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.519507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.519512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.519515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.519520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.519525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.519531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.519536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.519541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.519546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.519551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.519555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.519559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.519563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.519568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.519573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.519578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.519582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.519586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.519590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.519594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.519646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:39.525060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254762430059910:4597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:39.525080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254762430059910:4597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:39.525083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254762430059910:4597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:39.525090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:39.525672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:39.526554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:39.526569Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:39.526571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:39.526575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:39.526582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 326 [2:7556254760053198448:4198]
2025-10-01T14:07:39.526598Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:39.526614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:39.526617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.526621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.526624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.526641Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:39.526647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:39.526653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:39.526710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.526712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.526714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.526717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:39.526720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:39.526792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:39.526795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.526807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.526816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.526842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:39.526861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254760053198443:4198]
2025-10-01T14:07:39.526864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254760053198443:4198]
2025-10-01T14:07:39.526867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254760053198443:4198]
2025-10-01T14:07:39.526882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:39.526896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:39.526910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:39.526913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:39.526946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254760053198443:4198]
2025-10-01T14:07:39.526948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:39.527350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:39.527356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:39.527358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:39.527363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:39.527584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059947:4597], now have 1 active actors on pipe
2025-10-01T14:07:39.527606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059797:2446], now have 1 active actors on pipe
2025-10-01T14:07:39.532127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 326
2025-10-01T14:07:39.532160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 326
2025-10-01T14:07:39.533576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.533599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.533637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:39.533664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.533674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.533677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:39.533688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.533706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:39.533740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:39.533923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.533931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.533946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:39.534040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 327 partition: 0 MaxSeqNo: 45 sessionId: src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0
2025-10-01T14:07:39.534460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7bffe9-4f89bace-ea8fa296-52d7c862_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:39.537076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0] Write session: try to update token
2025-10-01T14:07:39.537094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:39.560955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:39.560976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:39.560978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:39.560981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:39.560989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254760053198443:4198]
2025-10-01T14:07:39.560995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254760053198443:4198]
2025-10-01T14:07:39.560999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254760053198443:4198]
2025-10-01T14:07:39.561048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:39.561055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.561058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:39.561194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:39.560704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 327 sessionId: src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:39.563117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:39.563434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:39.563450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:39.563456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:39.598321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254762430059957:4446]
2025-10-01T14:07:39.601694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 326, pipe: [1:7556254762430059957:4446]
2025-10-01T14:07:39.713003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:39.713326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.713341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.713381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059957:4446], now have 1 active actors on pipe
2025-10-01T14:07:39.713543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:39.714020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:39.714118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 327 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0
2025-10-01T14:07:39.714303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 327 sessionId: src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0 is DEAD
2025-10-01T14:07:39.714331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254762430059957:4446]
2025-10-01T14:07:39.714355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:39.714476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:39.714486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0] Write session will restart in 0.006251s
2025-10-01T14:07:39.714514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0] Write session: Do CDS request
2025-10-01T14:07:39.714519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:39.721902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:39.722499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:39.722515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 328
2025-10-01T14:07:39.722651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:39.722687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:39.722697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:39.722711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:39.723314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 328 sessionId:  describe result for acl check
2025-10-01T14:07:39.723349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:39.723351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:39.723352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:39.723357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254762430059968:4602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:39.723815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254762430059968:4602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:39.725365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254762430059968:4602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:39.731320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254762430059968:4602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:39.731340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254762430059968:4602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:39.731344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254762430059968:4602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:39.731353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:39.740290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:39.744955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:39.745209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:39.745215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:39.745229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:39.745297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:39.745335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254760053198604:4201]
2025-10-01T14:07:39.745930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:39.746798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:39.746855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:39.747213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:39.747287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.747288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.747289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.747290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.747292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.747293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.747295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.747297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.747298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.747299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.747301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.747302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.747303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.747305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.747311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.747321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.747324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.747328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.747331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.747334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.747338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.747342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.747346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.747350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.747354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.747357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.747361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.747364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.747372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.747380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:39.747386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.747391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:39.747396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.747402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:39.747407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.747411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:39.747417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.747422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:39.747426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.747431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:39.747436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.747441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:39.747445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.747451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:39.747455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.747460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:39.747465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.747469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.747473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.747478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.747482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.747489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.747493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.747498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:39.747503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.747508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:39.747550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:39.754539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:39.755159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:39.755179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:39.755181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:39.755185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:39.755192Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 327 [2:7556254760053198604:4201]
2025-10-01T14:07:39.755213Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:39.755230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:39.755236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.755240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.755242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.755261Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:39.755270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:39.755276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:39.755337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.755344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.755346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.755349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:39.755352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:39.755425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:39.755432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.755443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:39.755455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:39.755473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:39.755493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254760053198598:4201]
2025-10-01T14:07:39.755498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254760053198598:4201]
2025-10-01T14:07:39.755501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254760053198598:4201]
2025-10-01T14:07:39.755515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:39.755533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:39.755550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:39.755559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:39.755574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:39.755577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:39.755579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:39.755597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254760053198598:4201]
2025-10-01T14:07:39.755600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:39.755663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:39.755719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430059960:2446], now have 1 active actors on pipe
2025-10-01T14:07:39.755727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430060044:4602], now have 1 active actors on pipe
2025-10-01T14:07:39.756725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 327
2025-10-01T14:07:39.756771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 327
2025-10-01T14:07:39.757050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.757064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.757092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a11eb017-5db5597-cbd176e0-7eec7979_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:39.757109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:39.757114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:39.757117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:39.757128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:39.757143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:39.757164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:39.758120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.758128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.758148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:39.759145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 328 partition: 0 MaxSeqNo: 45 sessionId: src_id|a11eb017-5db5597-cbd176e0-7eec7979_0
2025-10-01T14:07:39.759652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b409f9b8-2f9bf9da-b945aadf-17cd27c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a11eb017-5db5597-cbd176e0-7eec7979_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:39.762141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a11eb017-5db5597-cbd176e0-7eec7979_0] Write session: try to update token
2025-10-01T14:07:39.762158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a11eb017-5db5597-cbd176e0-7eec7979_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:39.782007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 328 sessionId: src_id|a11eb017-5db5597-cbd176e0-7eec7979_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:39.784384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:39.784919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:39.784942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:39.784979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:39.786495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:39.816575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:39.816594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:39.816597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:39.816600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:39.816611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254760053198598:4201]
2025-10-01T14:07:39.816617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254760053198598:4201]
2025-10-01T14:07:39.816623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254760053198598:4201]
2025-10-01T14:07:39.816672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:39.816680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:39.816682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:39.816825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:39.818423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:39.818439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:39.818443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:39.818599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254762430060120:4446]
2025-10-01T14:07:39.822593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 327, pipe: [1:7556254762430060120:4446]
2025-10-01T14:07:39.992003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:39.992309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254762430060120:4446], now have 1 active actors on pipe
2025-10-01T14:07:40.000373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.000400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.000619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.000724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.000787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.000864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.001104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.001111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.001189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.001246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.001302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.001360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.001404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.001407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.001470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.001521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.001580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.001642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.001683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.001685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.001749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.001803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.001858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.001915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.001956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.001958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.002016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.002069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.002122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.002179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.002217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.002220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.002284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.002344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.004716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254762430060120:4446]
2025-10-01T14:07:40.004748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:40.004790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:40.004792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:40.004831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 328 reason: error at write: Disconnected sessionId: src_id|a11eb017-5db5597-cbd176e0-7eec7979_0
2025-10-01T14:07:40.005059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 328 sessionId: src_id|a11eb017-5db5597-cbd176e0-7eec7979_0 is DEAD
2025-10-01T14:07:40.005244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11eb017-5db5597-cbd176e0-7eec7979_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:40.005256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11eb017-5db5597-cbd176e0-7eec7979_0] Write session will restart in 0.006531s
2025-10-01T14:07:40.005283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11eb017-5db5597-cbd176e0-7eec7979_0] Write session: Do CDS request
2025-10-01T14:07:40.005289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11eb017-5db5597-cbd176e0-7eec7979_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:40.002584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.002658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.002802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.002806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.002878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.002939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.003009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.003077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.003120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.003123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.003195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.003254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.003311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.003374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.003416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.003420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.003484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.003541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.003605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.003665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.003705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.003708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.003773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:40.003827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:40.003887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:40.003944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:40.003981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:40.003984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:40.005078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:40.013092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a11eb017-5db5597-cbd176e0-7eec7979_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.018545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:40.018561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 329
2025-10-01T14:07:40.019588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.019629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:40.019634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:40.019638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:40.020631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 329 sessionId:  describe result for acl check
2025-10-01T14:07:40.020663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:40.020665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:40.020667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:40.020672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254766725027506:4613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:40.021193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254766725027506:4613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:40.025718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254766725027506:4613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:40.029491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254766725027506:4613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:40.029507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254766725027506:4613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:40.029511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254766725027506:4613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:40.029519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:40.030664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:40.032242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:40.032452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:40.032457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:40.032468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:40.032515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:40.032550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254764348166075:4205]
2025-10-01T14:07:40.033198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:40.033529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:40.033570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:40.033871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:40.033918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.033919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.033920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.033921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.033922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.033924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.033925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.033927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.033928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.033929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.033931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.033932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.033934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.033935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.033940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.033950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.033954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.033957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.033960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.033963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.033967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.033970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.033974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.033979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.033983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.033987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.033991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.033994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.034001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.034010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.034015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.034020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.034025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.034031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.034035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.034041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.034046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.034051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.034056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.034061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.034065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.034069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.034073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.034077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.034081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.034085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.034088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.034092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.034096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.034101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.034104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.034108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.034112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.034116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.034120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.034124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.034177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:40.040978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:40.041650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:40.041655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:40.041657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:40.041660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:40.041666Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 328 [2:7556254764348166075:4205]
2025-10-01T14:07:40.041679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:40.041693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:40.041695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.041697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.041698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.041711Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:40.041715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:40.041720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:40.041763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.041764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.041766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.041768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:40.041770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:40.041825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:40.041827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.041834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.041840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.041849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:40.041861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254764348166068:4205]
2025-10-01T14:07:40.041863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254764348166068:4205]
2025-10-01T14:07:40.041865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254764348166068:4205]
2025-10-01T14:07:40.041874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:40.041885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:40.041893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:40.041896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:40.041925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254764348166068:4205]
2025-10-01T14:07:40.041927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:40.042092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:40.042097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:40.042098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:40.042101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:40.042330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027590:4613], now have 1 active actors on pipe
2025-10-01T14:07:40.042334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027445:2446], now have 1 active actors on pipe
2025-10-01T14:07:40.042553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.042563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.042589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:40.042598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.042602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.042605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:40.042614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.042625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:40.042640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.043085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.043091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.043106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.042483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 328
2025-10-01T14:07:40.042521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 328
2025-10-01T14:07:40.043244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 329 partition: 0 MaxSeqNo: 45 sessionId: src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0
2025-10-01T14:07:40.046497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a11eb017-5db5597-cbd176e0-7eec7979_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:40.049270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0] Write session: try to update token
2025-10-01T14:07:40.049290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:40.069787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:40.069805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:40.069808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:40.069810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:40.070076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254764348166068:4205]
2025-10-01T14:07:40.070087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254764348166068:4205]
2025-10-01T14:07:40.070091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254764348166068:4205]
2025-10-01T14:07:40.070139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:40.070146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:40.070149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:40.070153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.070154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:40.070157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:40.070300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:40.073627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 329 sessionId: src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:40.077744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:40.102472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254766725027615:4446]
2025-10-01T14:07:40.104060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 328, pipe: [1:7556254766725027615:4446]
2025-10-01T14:07:40.275286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:40.275794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.275805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.275848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027615:4446], now have 1 active actors on pipe
2025-10-01T14:07:40.279574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:40.283078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:40.283137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:40.283170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 329 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0
2025-10-01T14:07:40.283187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254766725027615:4446]
2025-10-01T14:07:40.283400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 329 sessionId: src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0 is DEAD
2025-10-01T14:07:40.283622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:40.283932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0] Write session will restart in 0.009701s
2025-10-01T14:07:40.283962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0] Write session: Do CDS request
2025-10-01T14:07:40.283969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:40.296093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.296362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:40.296377Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 330
2025-10-01T14:07:40.296625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.296656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:40.296662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:40.296668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:40.299391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 330 sessionId:  describe result for acl check
2025-10-01T14:07:40.299435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:40.299438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:40.299440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:40.299444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254766725027638:4619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:40.300001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254766725027638:4619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:40.310248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254766725027638:4619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:40.321040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254766725027638:4619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:40.321058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254766725027638:4619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:40.321062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254766725027638:4619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:40.321070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:40.325389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:40.327363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:40.327573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:40.327584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:40.327594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:40.327642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:40.327685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254764348166262:4219]
2025-10-01T14:07:40.328188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:40.328524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:40.328568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:40.328909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:40.328993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.329000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.329001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.329002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.329004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.329005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.329006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.329007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.329009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.329009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.329011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.329011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.329012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.329014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.329018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.329027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.329031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.329034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.329037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.329040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.329043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.329046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.329050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.329053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.329057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.329060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.329064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.329067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.329075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.329082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.329088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.329093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.329097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.329101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.329106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.329111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.329115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.329119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.329123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.329127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.329131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.329135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.329139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.329143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.329148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.329152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.329156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.329160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.329164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.329175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.329178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.329183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.329187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.329191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.329195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.329199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.329230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:40.333398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:40.334273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:40.334278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:40.334281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:40.334284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:40.334294Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 329 [2:7556254764348166262:4219]
2025-10-01T14:07:40.334307Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:40.334323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:40.334326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.334330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.334332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.334348Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:40.334352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:40.334359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:40.334441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.334443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.334445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.334448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:40.334452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:40.334519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:40.334521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.334535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.334544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.334558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:40.334575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254764348166256:4219]
2025-10-01T14:07:40.334577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254764348166256:4219]
2025-10-01T14:07:40.334579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254764348166256:4219]
2025-10-01T14:07:40.334596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:40.334612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:40.335382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 329
2025-10-01T14:07:40.335413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 329
2025-10-01T14:07:40.334625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:40.334636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:40.334665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:40.334668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:40.334670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:40.334673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254764348166256:4219]
2025-10-01T14:07:40.334676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:40.334726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:40.334919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027778:4619], now have 1 active actors on pipe
2025-10-01T14:07:40.334923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027631:2446], now have 1 active actors on pipe
2025-10-01T14:07:40.335525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.335532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.335563Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:40.335572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.335579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.335582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:40.335593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.335605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:40.335624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.340010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 330 partition: 0 MaxSeqNo: 45 sessionId: src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0
2025-10-01T14:07:40.339218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.339237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.339269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.341087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf3afb3f-49fd7a67-cf67f7b8-e4f106d1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:40.343497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0] Write session: try to update token
2025-10-01T14:07:40.343519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:40.356753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:40.356769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:40.356771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:40.356772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:40.356781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254764348166256:4219]
2025-10-01T14:07:40.356786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254764348166256:4219]
2025-10-01T14:07:40.356788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254764348166256:4219]
2025-10-01T14:07:40.356841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:40.356846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.356848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:40.357039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:40.359918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:40.359940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:40.359944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:40.362234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 330 sessionId: src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:40.364712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:40.383340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254766725027794:4446]
2025-10-01T14:07:40.387079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 329, pipe: [1:7556254766725027794:4446]
2025-10-01T14:07:40.518994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:40.519586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254766725027794:4446]
2025-10-01T14:07:40.519618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:40.519620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:40.519673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 330 reason: error at write: Disconnected sessionId: src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0
2025-10-01T14:07:40.519877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 330 sessionId: src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0 is DEAD
2025-10-01T14:07:40.520092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:40.519263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.519281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.519322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027794:4446], now have 1 active actors on pipe
2025-10-01T14:07:40.520465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:40.520476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0] Write session will restart in 0.006014s
2025-10-01T14:07:40.520502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0] Write session: Do CDS request
2025-10-01T14:07:40.520510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:40.520947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:40.527882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.528966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:40.528981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 331
2025-10-01T14:07:40.529217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.529259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:40.529276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:40.529280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:40.529829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 331 sessionId:  describe result for acl check
2025-10-01T14:07:40.529860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:40.529866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:40.529870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:40.529875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254766725027839:4623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:40.530324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254766725027839:4623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:40.532766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254766725027839:4623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:40.536908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254766725027839:4623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:40.536925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254766725027839:4623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:40.536930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254766725027839:4623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:40.536939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:40.538527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:40.539756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:40.539984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:40.539988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:40.540001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:40.540061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:40.540094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254764348166419:4221]
2025-10-01T14:07:40.540674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:40.540996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:40.541060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:40.541351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:40.541407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.541408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.541409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.541410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.541411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.541412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.541414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.541415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.541416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.541418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.541418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.541420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.541421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.541422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.541428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.541438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.541442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.541446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.541449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.541453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.541456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.541460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.541463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.541467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.541470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.541474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.541477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.541480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.541488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.541495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.541502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.541507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.541511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.541516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.541519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.541524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.541530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.541534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.541538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.541543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.541548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.541553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.541558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.541563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.541567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.541571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.541575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.541580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.541587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.541591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.541595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.541600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.541605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.541609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.541613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.541617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.541652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:40.547185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:40.548542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 330
2025-10-01T14:07:40.548575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 330
2025-10-01T14:07:40.547897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:40.547911Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:40.547914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:40.547918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:40.547925Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 330 [2:7556254764348166419:4221]
2025-10-01T14:07:40.547945Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:40.547965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:40.547969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.547972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.547975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.547993Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:40.547998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:40.548004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:40.548067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.548070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.548071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.548075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:40.548077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:40.548148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:40.548150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.548162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.548174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.548189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:40.548206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254764348166414:4221]
2025-10-01T14:07:40.548209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254764348166414:4221]
2025-10-01T14:07:40.548211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254764348166414:4221]
2025-10-01T14:07:40.548220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:40.548234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:40.548242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:40.548245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:40.548247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:40.548247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:40.548250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:40.548262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027949:4623], now have 1 active actors on pipe
2025-10-01T14:07:40.548300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027797:2446], now have 1 active actors on pipe
2025-10-01T14:07:40.548303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254764348166414:4221]
2025-10-01T14:07:40.548311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:40.548337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:40.548644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.548651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.548676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16f339af-82989aa8-c982463c-a97812f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:40.548683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.548687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.548690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:40.548699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.548708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:40.548724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.549187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.549207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.549226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.549812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e271e5-a6d6f736-7cf667db-1da32dbc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|16f339af-82989aa8-c982463c-a97812f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:40.549362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 331 partition: 0 MaxSeqNo: 45 sessionId: src_id|16f339af-82989aa8-c982463c-a97812f_0
2025-10-01T14:07:40.552119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f339af-82989aa8-c982463c-a97812f_0] Write session: try to update token
2025-10-01T14:07:40.552136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f339af-82989aa8-c982463c-a97812f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:40.568248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 331 sessionId: src_id|16f339af-82989aa8-c982463c-a97812f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:40.570659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:40.571877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.571904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.571927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:40.571930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:40.571933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:40.571935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:40.571944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254764348166414:4221]
2025-10-01T14:07:40.571955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254764348166414:4221]
2025-10-01T14:07:40.571960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254764348166414:4221]
2025-10-01T14:07:40.572022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:40.572034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.572036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:40.572172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:40.573097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:40.573110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:40.573114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:40.619761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254766725027963:4446]
2025-10-01T14:07:40.620105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 330, pipe: [1:7556254766725027963:4446]
2025-10-01T14:07:40.734099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:40.737241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:40.736993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:40.737056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027963:4446], now have 1 active actors on pipe
2025-10-01T14:07:40.738936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:40.738996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254766725027963:4446]
2025-10-01T14:07:40.747863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:40.747875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:40.747896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 331 reason: error at write: Disconnected sessionId: src_id|16f339af-82989aa8-c982463c-a97812f_0
2025-10-01T14:07:40.748047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 331 sessionId: src_id|16f339af-82989aa8-c982463c-a97812f_0 is DEAD
2025-10-01T14:07:40.748166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f339af-82989aa8-c982463c-a97812f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:40.748176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f339af-82989aa8-c982463c-a97812f_0] Write session will restart in 0.007810s
2025-10-01T14:07:40.748204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f339af-82989aa8-c982463c-a97812f_0] Write session: Do CDS request
2025-10-01T14:07:40.748216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f339af-82989aa8-c982463c-a97812f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:40.756977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f339af-82989aa8-c982463c-a97812f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.757841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:40.757856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 332
2025-10-01T14:07:40.757973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.758006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:40.758012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:40.758015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:40.758556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 332 sessionId:  describe result for acl check
2025-10-01T14:07:40.758591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:40.758593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:40.758596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:40.758601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254766725028006:4628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:40.759287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254766725028006:4628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:40.763266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:40.764097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254766725028006:4628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:40.766158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254766725028006:4628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:40.766169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254766725028006:4628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:40.766182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254766725028006:4628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:40.765503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:40.765671Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:40.765675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:40.765683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:40.765716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:40.765741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254764348166578:4224]
2025-10-01T14:07:40.766142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:40.766260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:40.766409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:40.766460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:40.766668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:40.766719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.766724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.766725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.766726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.766727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.766729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.766730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.766730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.766731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.766732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.766733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.766734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.766735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.766736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.766740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.766749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.766752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.766755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.766758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.766762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.766766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.766769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.766772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.766776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.766779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.766783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.766786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.766789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.766797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.766803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.766809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.766815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.766819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.766823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.766827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.766831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.766834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.766840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.766848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.766852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.766856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.766863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.766867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.766872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.766879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.766884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.766888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.766892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.766900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.766904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.766909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.766915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.766919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.766928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.766932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.766934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.766954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:40.771368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:40.772426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:40.772451Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:40.772456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:40.772461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:40.772472Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 331 [2:7556254764348166578:4224]
2025-10-01T14:07:40.772488Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:40.772517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:40.772526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.772530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.772535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.772562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:40.772575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:40.772590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:40.772665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.772673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.772674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.772678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:40.772681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:40.772788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:40.772801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.772830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.772840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.772858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:40.772888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725028120:4628], now have 1 active actors on pipe
2025-10-01T14:07:40.772900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725027966:2446], now have 1 active actors on pipe
2025-10-01T14:07:40.772910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254764348166573:4224]
2025-10-01T14:07:40.772919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254764348166573:4224]
2025-10-01T14:07:40.772922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254764348166573:4224]
2025-10-01T14:07:40.772942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:40.772933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 331
2025-10-01T14:07:40.772966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:40.772969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:40.772938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 331
2025-10-01T14:07:40.772972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:40.772974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:40.772987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:40.772991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:40.773048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254764348166573:4224]
2025-10-01T14:07:40.773064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:40.773071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:40.773388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.773412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.773460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:40.773476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.773490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.773499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:40.773514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.773532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:40.773560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.773748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.773760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.773783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.773875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 332 partition: 0 MaxSeqNo: 45 sessionId: src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0
2025-10-01T14:07:40.774286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f339af-82989aa8-c982463c-a97812f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:40.776711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0] Write session: try to update token
2025-10-01T14:07:40.776725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:40.796665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:40.796691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:40.796694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:40.796697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:40.796706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254764348166573:4224]
2025-10-01T14:07:40.796711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254764348166573:4224]
2025-10-01T14:07:40.796716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254764348166573:4224]
2025-10-01T14:07:40.796770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:40.796778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.796785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:40.796797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:40.796821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:40.796825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:40.796938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:40.799163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 332 sessionId: src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:40.801757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:40.837396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254766725028131:4446]
2025-10-01T14:07:40.837696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 331, pipe: [1:7556254766725028131:4446]
2025-10-01T14:07:40.957857Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:40.958142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.958152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.958197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725028131:4446], now have 1 active actors on pipe
2025-10-01T14:07:40.958436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:40.958965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:40.958978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0] Write session will restart in 0.006518s
2025-10-01T14:07:40.959003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0] Write session: Do CDS request
2025-10-01T14:07:40.959010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:40.958532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:40.958547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:40.958601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 332 reason: error at write: Disconnected sessionId: src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0
2025-10-01T14:07:40.958798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 332 sessionId: src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0 is DEAD
2025-10-01T14:07:40.958935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254766725028131:4446]
2025-10-01T14:07:40.958949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:40.967847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.968069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:40.968086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 333
2025-10-01T14:07:40.970664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:40.970707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:40.970713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:40.970718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:40.971347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 333 sessionId:  describe result for acl check
2025-10-01T14:07:40.971375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:40.971377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:40.971378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:40.971384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254766725028217:4632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:40.971905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254766725028217:4632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:40.974892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254766725028217:4632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:40.979716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254766725028217:4632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:40.979735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254766725028217:4632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:40.979739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254766725028217:4632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:40.979749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:40.981395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:40.984111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:40.984510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:40.984515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:40.984530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:40.984598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:40.984636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254764348166738:4226]
2025-10-01T14:07:40.985249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:40.985655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:40.985713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:40.986045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:40.986108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.986110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.986111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.986112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.986113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.986114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.986116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.986117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.986118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.986119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.986120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.986121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.986123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.986124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.986130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.986140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.986143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.986147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.986151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.986155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.986159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.986162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.986166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.986169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.986173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.986176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.986179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.986183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.986190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.986198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:40.986204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.986209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:40.986213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.986219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:40.986223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.986227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:40.986232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.986237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:40.986241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.986246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:40.986251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.986256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:40.986261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.986266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:40.986270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.986274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:40.986278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.986283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.986288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.986293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.986298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.986303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.986307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.986312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:40.986317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.986321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:40.986358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:40.990842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:40.991480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:40.991486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:40.991489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:40.991493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:40.991500Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 332 [2:7556254764348166738:4226]
2025-10-01T14:07:40.991518Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:40.991535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:40.991538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.991543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.991545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.991564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:40.991570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:40.991576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:40.991637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.991640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.991642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.991645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:40.991648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:40.991724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:40.991727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:40.991742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:40.991754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:40.991770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:40.991788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254764348166732:4226]
2025-10-01T14:07:40.991790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254764348166732:4226]
2025-10-01T14:07:40.991792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254764348166732:4226]
2025-10-01T14:07:40.991815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:40.991831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:40.991847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:40.991851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:40.991859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:40.991863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:40.991866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:40.991889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254764348166732:4226]
2025-10-01T14:07:40.991892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:40.991937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:40.992204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725028136:2446], now have 1 active actors on pipe
2025-10-01T14:07:40.992213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254766725028284:4632], now have 1 active actors on pipe
2025-10-01T14:07:40.994529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 332
2025-10-01T14:07:40.994574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 332
2025-10-01T14:07:40.995782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.995800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.995838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:40.995850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:40.995856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:40.995869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:40.995882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:40.995899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:40.995922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.996316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:40.996332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:40.996355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:40.996536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 333 partition: 0 MaxSeqNo: 45 sessionId: src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0
2025-10-01T14:07:40.997592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d029927d-ba11bfa2-5907c61f-9e2dda77_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:41.001406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0] Write session: try to update token
2025-10-01T14:07:41.001428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:41.029871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 333 sessionId: src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:41.035226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:41.035247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:41.035249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:41.035252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:41.035263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254764348166732:4226]
2025-10-01T14:07:41.035273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254764348166732:4226]
2025-10-01T14:07:41.035277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254764348166732:4226]
2025-10-01T14:07:41.035318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:41.035324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.035327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:41.035473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:41.038119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:41.038130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:41.038133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:41.032716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:41.059551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254771019995607:4446]
2025-10-01T14:07:41.063489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 332, pipe: [1:7556254771019995607:4446]
2025-10-01T14:07:41.220604Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:41.221193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.221204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.221247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019995607:4446], now have 1 active actors on pipe
2025-10-01T14:07:41.221522Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:41.224710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254771019995607:4446]
2025-10-01T14:07:41.224751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:41.224788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:41.225276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:41.225287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0] Write session will restart in 0.006290s
2025-10-01T14:07:41.225314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0] Write session: Do CDS request
2025-10-01T14:07:41.225319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:41.224887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 333 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0
2025-10-01T14:07:41.225091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 333 sessionId: src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0 is DEAD
2025-10-01T14:07:41.233023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:41.238469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:41.238488Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 334
2025-10-01T14:07:41.239130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:41.239171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:41.239177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:41.239182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:41.240524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 334 sessionId:  describe result for acl check
2025-10-01T14:07:41.240577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:41.240579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:41.240584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:41.240591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254771019995649:4645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:41.241093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254771019995649:4645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:41.257790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254771019995649:4645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:41.262723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254771019995649:4645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:41.262742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254771019995649:4645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:41.262745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254771019995649:4645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:41.262753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:41.264312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:41.269868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:41.270309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:41.270327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:41.270343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:41.270439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:41.270496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254768643134244:4237]
2025-10-01T14:07:41.271131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:41.274997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:41.275075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:41.275495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:41.275559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.275560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.275561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.275562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.275564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.275565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.275566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.275567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.275569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.275569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.275571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.275571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.275572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.275574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.275580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.275589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.275593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.275596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.275599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.275606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.275609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.275612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.275615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.275619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.275622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.275625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.275638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.275640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.275651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.275659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.275664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.275668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.275674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.275679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.275683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.275690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.275695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.275699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.275703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.275707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.275712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.275716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.275721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.275726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.275730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.275735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.275738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.275742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.275747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.275751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.275756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.275761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.275765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.275769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.275773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.275777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.275818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:41.281376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:41.282114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:41.282121Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:41.282125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:41.282130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:41.282138Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 333 [2:7556254768643134244:4237]
2025-10-01T14:07:41.282158Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:41.282181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:41.282184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.282188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.282191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.282209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:41.282215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:41.282223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:41.282294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.282296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.282301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.282304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:41.282306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:41.282398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:41.282401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.282416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.282426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.282441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:41.282458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254768643134237:4237]
2025-10-01T14:07:41.282460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254768643134237:4237]
2025-10-01T14:07:41.282462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254768643134237:4237]
2025-10-01T14:07:41.282476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:41.282493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:41.282506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:41.282510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:41.282547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254768643134237:4237]
2025-10-01T14:07:41.282549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:41.282830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:41.282838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:41.282840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:41.282846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:41.283689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 333
2025-10-01T14:07:41.283724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 333
2025-10-01T14:07:41.284954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019995794:4645], now have 1 active actors on pipe
2025-10-01T14:07:41.284973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019995638:2446], now have 1 active actors on pipe
2025-10-01T14:07:41.284998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.285004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.285034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56a26742-23c463c2-f37a230-b661f7f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:41.285044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.285050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.285053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:41.285065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.285082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:41.285100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:41.285424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.285432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.285450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:41.285593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 334 partition: 0 MaxSeqNo: 45 sessionId: src_id|56a26742-23c463c2-f37a230-b661f7f1_0
2025-10-01T14:07:41.286016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf02ee77-51d27eec-33d17450-6ea82d90_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|56a26742-23c463c2-f37a230-b661f7f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:41.289214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56a26742-23c463c2-f37a230-b661f7f1_0] Write session: try to update token
2025-10-01T14:07:41.289237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56a26742-23c463c2-f37a230-b661f7f1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:41.319520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:41.319545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:41.319548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:41.319555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:41.319566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254768643134237:4237]
2025-10-01T14:07:41.319571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254768643134237:4237]
2025-10-01T14:07:41.319575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254768643134237:4237]
2025-10-01T14:07:41.319628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:41.319636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.319639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:41.319889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:41.319967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:41.319978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:41.319981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:41.321343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 334 sessionId: src_id|56a26742-23c463c2-f37a230-b661f7f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:41.324337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:41.324875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254771019995808:4446]
2025-10-01T14:07:41.329438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 333, pipe: [1:7556254771019995808:4446]
2025-10-01T14:07:41.471340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:41.471764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.471780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.471805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019995808:4446], now have 1 active actors on pipe
2025-10-01T14:07:41.472098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254771019995808:4446]
2025-10-01T14:07:41.472129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:41.472132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:41.472161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:41.472200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 334 reason: error at write: Disconnected sessionId: src_id|56a26742-23c463c2-f37a230-b661f7f1_0
2025-10-01T14:07:41.472407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 334 sessionId: src_id|56a26742-23c463c2-f37a230-b661f7f1_0 is DEAD
2025-10-01T14:07:41.472557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:41.474649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a26742-23c463c2-f37a230-b661f7f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:41.474664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a26742-23c463c2-f37a230-b661f7f1_0] Write session will restart in 0.006092s
2025-10-01T14:07:41.474692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a26742-23c463c2-f37a230-b661f7f1_0] Write session: Do CDS request
2025-10-01T14:07:41.474698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a26742-23c463c2-f37a230-b661f7f1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:41.484228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56a26742-23c463c2-f37a230-b661f7f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:41.486566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:41.486590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 335
2025-10-01T14:07:41.486782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:41.486816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:41.486828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:41.486833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:41.487711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 335 sessionId:  describe result for acl check
2025-10-01T14:07:41.487749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:41.487756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:41.487758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:41.487764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254771019995932:4649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:41.488305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254771019995932:4649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:41.489408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:41.492344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:41.492632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:41.492637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:41.492652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:41.492729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:41.492771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254768643134404:4244]
2025-10-01T14:07:41.493430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:41.493742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:41.493793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:41.494143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:41.494154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254771019995932:4649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:41.494214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.494220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.494222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.494223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.494224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.494226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.494227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.494229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.494231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.494232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.494233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.494234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.494236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.494237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.494243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.494254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.494258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.494262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.494267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.494271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.494275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.494279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.494283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.494287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.494291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.494295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.494299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.494304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.494311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.494319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.494325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.494331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.494336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.494349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.494353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.494359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.494382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.494392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.494395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.494400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.494409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.494413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.494417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.494422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.494428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.494439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.494443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.494448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.494452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.494456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.494460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.494464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.494473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.494478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.494482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.494490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.494532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:41.499330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254771019995932:4649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:41.499348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254771019995932:4649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:41.499351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254771019995932:4649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:41.499367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:41.505246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:41.506140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:41.506155Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:41.506158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:41.506162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:41.506169Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 334 [2:7556254768643134404:4244]
2025-10-01T14:07:41.506186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:41.506204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:41.506211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.506216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.506218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.506238Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:41.506248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:41.506256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:41.506321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.506327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.506329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.506332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:41.506335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:41.506430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:41.506436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.506451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.506466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.506484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:41.506505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254768643134399:4244]
2025-10-01T14:07:41.506510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254768643134399:4244]
2025-10-01T14:07:41.506513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254768643134399:4244]
2025-10-01T14:07:41.506528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:41.506546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019995971:4649], now have 1 active actors on pipe
2025-10-01T14:07:41.506557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019995810:2446], now have 1 active actors on pipe
2025-10-01T14:07:41.506563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:41.506569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:41.506572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:41.506574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:41.506575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:41.506578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:41.506622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254768643134399:4244]
2025-10-01T14:07:41.506629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:41.506616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 334
2025-10-01T14:07:41.506630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 334
2025-10-01T14:07:41.506662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:41.506721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.506731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.506762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8f5bd14-286af94a-257cafe6-df06a668_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:41.506774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.506783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.506785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:41.506793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.506803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:41.506824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:41.507022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.507032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.507047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:41.507105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 335 partition: 0 MaxSeqNo: 45 sessionId: src_id|e8f5bd14-286af94a-257cafe6-df06a668_0
2025-10-01T14:07:41.507529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56a26742-23c463c2-f37a230-b661f7f1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e8f5bd14-286af94a-257cafe6-df06a668_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:41.510456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f5bd14-286af94a-257cafe6-df06a668_0] Write session: try to update token
2025-10-01T14:07:41.510480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f5bd14-286af94a-257cafe6-df06a668_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:41.525509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 335 sessionId: src_id|e8f5bd14-286af94a-257cafe6-df06a668_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:41.528113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:41.528353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.528375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.528425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:41.528557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:41.531207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:41.531233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:41.531236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:41.531238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:41.531248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254768643134399:4244]
2025-10-01T14:07:41.531253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254768643134399:4244]
2025-10-01T14:07:41.531257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254768643134399:4244]
2025-10-01T14:07:41.531313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:41.531323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:41.531330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:41.531331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.531334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:41.531334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:41.531475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:41.572143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254771019995978:4446]
2025-10-01T14:07:41.572465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 334, pipe: [1:7556254771019995978:4446]
2025-10-01T14:07:41.686335Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:41.694849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.694877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.695072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.695147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.695221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.695301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.695570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.695584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.695663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.695734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.695805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.695875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.695922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.695929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.695999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.696061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.696130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.696194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.696249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.696256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.696324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.696389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.696458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.696521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.696566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.696573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.696641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.696704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.696771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.696854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.696899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.696910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.696983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.697044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.697115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.697182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.697227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.697230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.697297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.697356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.697420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.697485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.697529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.697532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.697596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.697655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.697717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.697781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.697830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.697833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.697910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.697978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.698042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.698106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.698151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.698154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.698224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:41.698288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:41.698350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:41.698559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:41.698615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:41.698622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:41.698683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019995978:4446], now have 1 active actors on pipe
2025-10-01T14:07:41.699043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:41.699046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254771019995978:4446]
2025-10-01T14:07:41.699061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:41.699067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:41.699102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 335 reason: error at write: Disconnected sessionId: src_id|e8f5bd14-286af94a-257cafe6-df06a668_0
2025-10-01T14:07:41.699428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f5bd14-286af94a-257cafe6-df06a668_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:41.699438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f5bd14-286af94a-257cafe6-df06a668_0] Write session will restart in 0.009817s
2025-10-01T14:07:41.699326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 335 sessionId: src_id|e8f5bd14-286af94a-257cafe6-df06a668_0 is DEAD
2025-10-01T14:07:41.699462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f5bd14-286af94a-257cafe6-df06a668_0] Write session: Do CDS request
2025-10-01T14:07:41.699469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f5bd14-286af94a-257cafe6-df06a668_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:41.699808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:41.711484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f5bd14-286af94a-257cafe6-df06a668_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:41.711586Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:41.711602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 336
2025-10-01T14:07:41.711727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:41.711770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:41.711780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:41.711785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:41.712343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 336 sessionId:  describe result for acl check
2025-10-01T14:07:41.712378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:41.712385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:41.712387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:41.712392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254771019996094:4654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:41.712958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254771019996094:4654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:41.715084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:41.716026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254771019996094:4654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:41.717117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:41.717354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:41.717367Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:41.717379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:41.717440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:41.717481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254768643134568:4247]
2025-10-01T14:07:41.718086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:41.718171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254771019996094:4654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:41.718185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254771019996094:4654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:41.718188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254771019996094:4654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:41.718196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:41.724344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 335
2025-10-01T14:07:41.724385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 335
2025-10-01T14:07:41.724911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 336 partition: 0 MaxSeqNo: 45 sessionId: src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0
2025-10-01T14:07:41.718391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:41.718442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:41.718750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:41.718817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.718818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.718820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.718821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.718822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.718823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.718824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.718825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.718825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.718826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.718827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.718828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.718829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.718830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.718836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.718845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.718850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.718853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.718856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.718861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.718864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.718868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.718872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.718876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.718880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.718884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.718887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.718891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.718899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.718907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.718913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.718919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.718923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.718928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.718932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.725569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8f5bd14-286af94a-257cafe6-df06a668_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:41.718936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.718942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.718947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.718951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.718956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.718961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.718965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.718969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.718975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.718979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.718984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.718988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.718994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.718999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.719003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.719008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.719012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.719017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.719021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.719025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.719030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.719068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:41.723003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:41.723913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:41.723922Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:41.723924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:41.723928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:41.723936Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 335 [2:7556254768643134568:4247]
2025-10-01T14:07:41.723953Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:41.723970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:41.723974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.723978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.723981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.723997Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:41.724002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:41.724008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:41.724065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.724067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.724069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.724072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:41.724075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:41.724154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:41.724158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.724169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.724177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.724192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:41.724208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254768643134563:4247]
2025-10-01T14:07:41.724211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254768643134563:4247]
2025-10-01T14:07:41.724213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254768643134563:4247]
2025-10-01T14:07:41.724222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:41.724234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:41.724237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:41.724237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:41.724239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:41.724253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:41.724259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:41.724273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019996142:4654], now have 1 active actors on pipe
2025-10-01T14:07:41.724276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019995983:2446], now have 1 active actors on pipe
2025-10-01T14:07:41.724309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254768643134563:4247]
2025-10-01T14:07:41.724320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:41.724338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:41.724536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.724545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.724597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:41.724606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.724610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.724612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:41.724622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.724633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:41.724649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:41.724804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.724819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.724833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:41.728068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0] Write session: try to update token
2025-10-01T14:07:41.728084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:41.745545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 336 sessionId: src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:41.746638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:41.746658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:41.746661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:41.746664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:41.746674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254768643134563:4247]
2025-10-01T14:07:41.746678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254768643134563:4247]
2025-10-01T14:07:41.746683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254768643134563:4247]
2025-10-01T14:07:41.748168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:41.746735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:41.746749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.746752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:41.746898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:41.748300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:41.748306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:41.748310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:41.799876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254771019996151:4446]
2025-10-01T14:07:41.800302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 335, pipe: [1:7556254771019996151:4446]
2025-10-01T14:07:41.904176Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:41.904700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.904710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.904751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019996151:4446], now have 1 active actors on pipe
2025-10-01T14:07:41.905312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:41.905362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254771019996151:4446]
2025-10-01T14:07:41.905396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:41.905024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:41.905402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:41.905454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 336 reason: error at write: Disconnected sessionId: src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0
2025-10-01T14:07:41.905841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:41.905852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0] Write session will restart in 0.009991s
2025-10-01T14:07:41.905879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0] Write session: Do CDS request
2025-10-01T14:07:41.905897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:41.905651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 336 sessionId: src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0 is DEAD
2025-10-01T14:07:41.918961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:41.919362Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:41.919378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 337
2025-10-01T14:07:41.919531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:41.919576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:41.919586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:41.919590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:41.920364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 337 sessionId:  describe result for acl check
2025-10-01T14:07:41.920410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:41.920428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:41.920430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:41.920436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254771019996203:4658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:41.921105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254771019996203:4658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:41.924598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254771019996203:4658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:41.942619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254771019996203:4658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:41.942640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254771019996203:4658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:41.942643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254771019996203:4658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:41.942653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:41.942729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:41.944591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:41.944841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:41.944849Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:41.944858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:41.944900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:41.944951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254768643134732:4249]
2025-10-01T14:07:41.945451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:41.945789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:41.945849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:41.946192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:41.946254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.946260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.946262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.946263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.946265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.946266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.946268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.946269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.946270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.946272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.946273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.946275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.946276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.946278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.946283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.946293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.946297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.946300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.946303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.946306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.946310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.946314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.946318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.946323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.946327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.946331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.946335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.946339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.946347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.946354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:41.946362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.946368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:41.946388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.946393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:41.946405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.946411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:41.946419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.946425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:41.946429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.946434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:41.946439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.946444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:41.946448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.946460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:41.946464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.946469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:41.946473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.946477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.946481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.946486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.946490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.946494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.946498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.946503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:41.946506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.946510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:41.946548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:41.955875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:41.956494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:41.956511Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:41.956514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:41.956518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:41.956526Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 336 [2:7556254768643134732:4249]
2025-10-01T14:07:41.956543Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:41.956561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:41.956565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.956569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.956571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.956590Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:41.956596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:41.956603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:41.956669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.956672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.956674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.956677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:41.956679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:41.956770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:41.956773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.956788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:41.956799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:41.956832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:41.956851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254768643134726:4249]
2025-10-01T14:07:41.956854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254768643134726:4249]
2025-10-01T14:07:41.956856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254768643134726:4249]
2025-10-01T14:07:41.956872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:41.956887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:41.956902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:41.956905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:41.956947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254768643134726:4249]
2025-10-01T14:07:41.956950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:41.957178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:41.957181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:41.957183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:41.957187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:41.957188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019996311:4658], now have 1 active actors on pipe
2025-10-01T14:07:41.957193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254771019996155:2446], now have 1 active actors on pipe
2025-10-01T14:07:41.957509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 336
2025-10-01T14:07:41.957530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 336
2025-10-01T14:07:41.957643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.957655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.957683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:41.957696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:41.957700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:41.957703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:41.957714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:41.957726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:41.957748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:41.957911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.957919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.957933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:41.958021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 337 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0
2025-10-01T14:07:41.958455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5997aa2-cf6e6939-e06d49bc-d7a45221_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:41.960946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0] Write session: try to update token
2025-10-01T14:07:41.960967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:41.981677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 337 sessionId: src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:41.984082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:41.984305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:41.984326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:41.984365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:41.984451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:41.994537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:41.994552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:41.994555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:41.994557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:41.994566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254768643134726:4249]
2025-10-01T14:07:41.994570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254768643134726:4249]
2025-10-01T14:07:41.994574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254768643134726:4249]
2025-10-01T14:07:41.994619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:41.994627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:41.994629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:41.994750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:41.995406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:41.995412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:41.995415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:42.005461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254775314963621:4446]
2025-10-01T14:07:42.005696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 336, pipe: [1:7556254775314963621:4446]
2025-10-01T14:07:42.153966Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:42.161661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.161688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.161842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.161904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.161966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.162029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.162132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.162142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.162209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.162272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.162335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.162734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.162788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.162795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.162866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.162930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.162996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.163071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.163124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.163131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.163198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.163265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.163324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.163397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.163443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.163451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.163525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.163590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.163657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.163723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.163769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.163775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.163842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.163897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.163955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.164014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.164062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.164073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.164132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.164182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.164243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.164299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.164336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.164341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.164394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.164508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.164617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.164721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.164765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.164770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.164843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.164901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.164961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.165018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.165070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.165077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.165139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.165190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.165244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.165296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.165343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.165349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.165415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314963621:4446], now have 1 active actors on pipe
2025-10-01T14:07:42.165586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:42.165590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254775314963621:4446]
2025-10-01T14:07:42.165602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:42.165608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:42.165628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 337 reason: error at write: Disconnected sessionId: src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0
2025-10-01T14:07:42.165827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 337 sessionId: src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0 is DEAD
2025-10-01T14:07:42.165924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:42.165945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0] Write session will restart in 0.006169s
2025-10-01T14:07:42.165968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0] Write session: Do CDS request
2025-10-01T14:07:42.165973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:42.166020Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:42.172950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:42.174565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:42.174589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 338
2025-10-01T14:07:42.174838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:42.174871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:42.174876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:42.174881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:42.175806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 338 sessionId:  describe result for acl check
2025-10-01T14:07:42.175840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:42.175842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:42.175844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:42.175850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254775314963757:4673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:42.176401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254775314963757:4673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:42.178733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254775314963757:4673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:42.183356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:42.185064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254775314963757:4673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:42.185080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254775314963757:4673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:42.185084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254775314963757:4673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:42.185092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:42.185171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:42.185408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:42.185418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:42.185430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:42.185485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:42.185539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254772938102211:4254]
2025-10-01T14:07:42.186173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:42.186530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:42.186595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:42.186917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:42.186974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.186980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.186982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.186983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.186984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.186985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.186986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.186987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.186989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.186990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.186991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.186993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.186994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.186995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.186999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.187009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.187014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.187017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.187021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.187036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.187040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.187043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.187047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.187051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.187054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.187058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.187061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.187065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.187072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.187079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.187084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.187094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.187098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.187103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.187111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.187116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.187121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.187131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.187135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.187141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.187145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.187150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.187154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.187164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.187168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.187174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.187182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.187188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.187195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.187201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.187205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.187210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.187219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.187224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.187229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.187237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.187278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:42.191927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:42.192567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:42.192584Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:42.192587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:42.192591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:42.192598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 337 [2:7556254772938102211:4254]
2025-10-01T14:07:42.192615Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:42.192634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:42.192642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.192646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.192649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.192667Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:42.192677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:42.192683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:42.192740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.192748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.192750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.192753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:42.192756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:42.192839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:42.192846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.192859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.192874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.192894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:42.192919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314963671:2446], now have 1 active actors on pipe
2025-10-01T14:07:42.192927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314963826:4673], now have 1 active actors on pipe
2025-10-01T14:07:42.192935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254772938102205:4254]
2025-10-01T14:07:42.192941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254772938102205:4254]
2025-10-01T14:07:42.192944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254772938102205:4254]
2025-10-01T14:07:42.192957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:42.192987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 337
2025-10-01T14:07:42.192990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 337
2025-10-01T14:07:42.192971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:42.192976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:42.192989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:42.192989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:42.192991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:42.192992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:42.193028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254772938102205:4254]
2025-10-01T14:07:42.193031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:42.193046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:42.193063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.193068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.193099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0dffed-b2be7049-d2a90803-2559992_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:42.193110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.193115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.193117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:42.193125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.193132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:42.193151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:42.193346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.193355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.193371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:42.193471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 338 partition: 0 MaxSeqNo: 45 sessionId: src_id|b0dffed-b2be7049-d2a90803-2559992_0
2025-10-01T14:07:42.193887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc89a002-c66b455b-5b851c29-84a4bf2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b0dffed-b2be7049-d2a90803-2559992_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:42.196560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0dffed-b2be7049-d2a90803-2559992_0] Write session: try to update token
2025-10-01T14:07:42.196580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0dffed-b2be7049-d2a90803-2559992_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:42.214803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 338 sessionId: src_id|b0dffed-b2be7049-d2a90803-2559992_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:42.217781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:42.218548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.218571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.218595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:42.218599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:42.218602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:42.218604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:42.218616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254772938102205:4254]
2025-10-01T14:07:42.218622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254772938102205:4254]
2025-10-01T14:07:42.218626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254772938102205:4254]
2025-10-01T14:07:42.218678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:42.218685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:42.218689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:42.218700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:42.218707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.218710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:42.218869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:42.265924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254775314963841:4446]
2025-10-01T14:07:42.269245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 337, pipe: [1:7556254775314963841:4446]
2025-10-01T14:07:42.379953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:42.380249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:42.380311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314963841:4446], now have 1 active actors on pipe
2025-10-01T14:07:42.381198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:42.381280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:42.381284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:42.381359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 338 reason: error at write: Disconnected sessionId: src_id|b0dffed-b2be7049-d2a90803-2559992_0
2025-10-01T14:07:42.381515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 338 sessionId: src_id|b0dffed-b2be7049-d2a90803-2559992_0 is DEAD
2025-10-01T14:07:42.381640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254775314963841:4446]
2025-10-01T14:07:42.381654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:42.382649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0dffed-b2be7049-d2a90803-2559992_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:42.382661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0dffed-b2be7049-d2a90803-2559992_0] Write session will restart in 0.006868s
2025-10-01T14:07:42.382686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0dffed-b2be7049-d2a90803-2559992_0] Write session: Do CDS request
2025-10-01T14:07:42.382694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0dffed-b2be7049-d2a90803-2559992_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:42.390923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0dffed-b2be7049-d2a90803-2559992_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:42.398541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:42.398564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 339
2025-10-01T14:07:42.398807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:42.398839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:42.398845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:42.398849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:42.399205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 339 sessionId:  describe result for acl check
2025-10-01T14:07:42.399231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:42.399232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:42.399233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:42.399239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254775314963933:4677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:42.399738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254775314963933:4677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:42.404024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254775314963933:4677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:42.405005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:42.409923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:42.410199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:42.410216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:42.410228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:42.410295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:42.410337Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254772938102406:4267]
2025-10-01T14:07:42.410445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254775314963933:4677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:42.410466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254775314963933:4677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:42.410469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254775314963933:4677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:42.410479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:42.410983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:42.412528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:42.412597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:42.412979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:42.413039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.413040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.413042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.413043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.413044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.413045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.413046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.413048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.413049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.413061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.413062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.413063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.413064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.413065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.413072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.413081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.413085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.413088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.413092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.413096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.413100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.413103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.413107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.413111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.413115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.413118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.413122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.413125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.413133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.413141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.413148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.413153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.413158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.413164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.413168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.413173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.413179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.413184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.413189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.413194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.413199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.413204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.413208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.413212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.413217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.413222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.413227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.413232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.413236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.413241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.413246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.413251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.413256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.413261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.413265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.413270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.413310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:42.417745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:42.418529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:42.418546Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:42.418549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:42.418554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:42.418561Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 338 [2:7556254772938102406:4267]
2025-10-01T14:07:42.418580Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:42.418598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:42.418606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.418610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.418613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.418628Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:42.418649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:42.418661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:42.418719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.418725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.418727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.418729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:42.418731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:42.418792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:42.418798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.418807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.418817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.418830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:42.418847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254772938102400:4267]
2025-10-01T14:07:42.418854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254772938102400:4267]
2025-10-01T14:07:42.418857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254772938102400:4267]
2025-10-01T14:07:42.418870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:42.418882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:42.418897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:42.418903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:42.418938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254772938102400:4267]
2025-10-01T14:07:42.418944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:42.419343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:42.419358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:42.419360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:42.419367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:42.419508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314964002:4677], now have 1 active actors on pipe
2025-10-01T14:07:42.419518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314963846:2446], now have 1 active actors on pipe
2025-10-01T14:07:42.419999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 338
2025-10-01T14:07:42.420034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 338
2025-10-01T14:07:42.420847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.420861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.420888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4a5e97-8580bc41-d560cc17-18093281_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:42.420898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.420905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.420908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:42.420919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.420932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:42.420947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:42.422049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.422055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.422068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:42.422386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 339 partition: 0 MaxSeqNo: 45 sessionId: src_id|a4a5e97-8580bc41-d560cc17-18093281_0
2025-10-01T14:07:42.422790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0dffed-b2be7049-d2a90803-2559992_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a4a5e97-8580bc41-d560cc17-18093281_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:42.425878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a5e97-8580bc41-d560cc17-18093281_0] Write session: try to update token
2025-10-01T14:07:42.425896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a5e97-8580bc41-d560cc17-18093281_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:42.449905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:42.449923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:42.449926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:42.449928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:42.449940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254772938102400:4267]
2025-10-01T14:07:42.449945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254772938102400:4267]
2025-10-01T14:07:42.449950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254772938102400:4267]
2025-10-01T14:07:42.449997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:42.450005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.450007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:42.450181Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:42.454899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:42.454913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:42.454917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:42.464907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 339 sessionId: src_id|a4a5e97-8580bc41-d560cc17-18093281_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:42.467938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:42.481441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254775314964016:4446]
2025-10-01T14:07:42.481709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 338, pipe: [1:7556254775314964016:4446]
2025-10-01T14:07:42.622709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:42.623018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.623035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.623079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314964016:4446], now have 1 active actors on pipe
2025-10-01T14:07:42.626888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:42.627076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254775314964016:4446]
2025-10-01T14:07:42.627110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:42.627113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:42.627176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 339 reason: error at write: Disconnected sessionId: src_id|a4a5e97-8580bc41-d560cc17-18093281_0
2025-10-01T14:07:42.627362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 339 sessionId: src_id|a4a5e97-8580bc41-d560cc17-18093281_0 is DEAD
2025-10-01T14:07:42.627482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:42.627762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a5e97-8580bc41-d560cc17-18093281_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:42.627771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a5e97-8580bc41-d560cc17-18093281_0] Write session will restart in 0.008419s
2025-10-01T14:07:42.627801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a5e97-8580bc41-d560cc17-18093281_0] Write session: Do CDS request
2025-10-01T14:07:42.627809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a5e97-8580bc41-d560cc17-18093281_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:42.637909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a5e97-8580bc41-d560cc17-18093281_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:42.638669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:42.638688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 340
2025-10-01T14:07:42.639348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:42.639386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:42.639401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:42.639404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:42.639950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 340 sessionId:  describe result for acl check
2025-10-01T14:07:42.639985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:42.639987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:42.639989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:42.639994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254775314964033:4682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:42.640501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254775314964033:4682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:42.645072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254775314964033:4682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:42.655959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254775314964033:4682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:42.655976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254775314964033:4682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:42.655983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254775314964033:4682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:42.655995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:42.667478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:42.681356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:42.681568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:42.681576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:42.681585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:42.681632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:42.681661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254772938102575:4269]
2025-10-01T14:07:42.682060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:42.682401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:42.682446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:42.682775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:42.682833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.682834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.682835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.682836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.682838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.682839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.682840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.682841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.682842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.682843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.682844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.682846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.682847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.682848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.682852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.682862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.682865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.682869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.682873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.682877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.682880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.682884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.682887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.682891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.682895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.682898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.682902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.682905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.682912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.682920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.682925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.682930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.682934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.682939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.682944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.682949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.682953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.682958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.682963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.682968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.682972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.682977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.682981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.682986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.682990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.682995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.682999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.683004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.683008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.683013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.683018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.683023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.683027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.683032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.683036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.683041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.683078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:42.690729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:42.691386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:42.691393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:42.691396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:42.691399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:42.691406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 339 [2:7556254772938102575:4269]
2025-10-01T14:07:42.691418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:42.691434Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:42.691436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.691439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.691440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.691453Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:42.691457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:42.691835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 339
2025-10-01T14:07:42.691878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 339
2025-10-01T14:07:42.691462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:42.691509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.691510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.691512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.691515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:42.691517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:42.691593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:42.691596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.691607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.691617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.691629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:42.691649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314964019:2446], now have 1 active actors on pipe
2025-10-01T14:07:42.691652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314964177:4682], now have 1 active actors on pipe
2025-10-01T14:07:42.691660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254772938102569:4269]
2025-10-01T14:07:42.691662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254772938102569:4269]
2025-10-01T14:07:42.691664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254772938102569:4269]
2025-10-01T14:07:42.691672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:42.691677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:42.691679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:42.691681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:42.691687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:42.691699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:42.691702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:42.691742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254772938102569:4269]
2025-10-01T14:07:42.691749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:42.691994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:42.692154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.692163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.692190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:42.692198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.692202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.692204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:42.692213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.692224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:42.692238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:42.692513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.692520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.692534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:42.692661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 340 partition: 0 MaxSeqNo: 45 sessionId: src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0
2025-10-01T14:07:42.693134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4a5e97-8580bc41-d560cc17-18093281_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:42.695721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0] Write session: try to update token
2025-10-01T14:07:42.695739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:42.726897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254775314964192:4446]
2025-10-01T14:07:42.730993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 339, pipe: [1:7556254775314964192:4446]
2025-10-01T14:07:42.732435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 340 sessionId: src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:42.734879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:42.732538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314964192:4446], now have 1 active actors on pipe
2025-10-01T14:07:42.732564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:42.732568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:42.732575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254772938102569:4269]
2025-10-01T14:07:42.732624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:42.732627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:42.732792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:42.732940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:42.733074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:42.733202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:42.733397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:42.733430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:42.737177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.737200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.737238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:42.737393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:42.753474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:42.753493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:42.753495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:42.753496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:42.753504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254772938102569:4269]
2025-10-01T14:07:42.753507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254772938102569:4269]
2025-10-01T14:07:42.753510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254772938102569:4269]
2025-10-01T14:07:42.753549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:42.753550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:42.753555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:42.753556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.753557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:42.753559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:42.753679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:42.904835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:42.920151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.920183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.920470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.920738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.920834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.920903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.920973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.920989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.921218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.921457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.921675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.921908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.922057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.922068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.922137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.922365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.922656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.922728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.922846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.922850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.922917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.923132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.923353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.923563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.923608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.923613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.923814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.923871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.923937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.924139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.924190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.924196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.924400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.924629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.924852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.925056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.925122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.925126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.925203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.925265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.925340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.925403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.925457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.925460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.925526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.925593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.925661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.925725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.925781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.925785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.926040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.926265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.926654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.926864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.926913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.926917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.927133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:42.927339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:42.927412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:42.927482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:42.927527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:42.927530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:42.929248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:42.929843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:42.929854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0] Write session will restart in 0.005677s
2025-10-01T14:07:42.929891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0] Write session: Do CDS request
2025-10-01T14:07:42.929899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:42.928413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254775314964192:4446]
2025-10-01T14:07:42.928464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:42.928504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:42.928506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:42.928533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 340 reason: error at write: Disconnected sessionId: src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0
2025-10-01T14:07:42.928730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 340 sessionId: src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0 is DEAD
2025-10-01T14:07:42.938943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:42.939657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:42.939676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 341
2025-10-01T14:07:42.939846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:42.939878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:42.939888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:42.939895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:42.940513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 341 sessionId:  describe result for acl check
2025-10-01T14:07:42.940542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:42.940546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:42.940549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:42.940552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254775314964207:4686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:42.941028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254775314964207:4686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:42.945990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254775314964207:4686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:42.957311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254775314964207:4686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:42.957330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254775314964207:4686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:42.957333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254775314964207:4686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:42.957341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:42.961447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:42.967787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:42.968036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:42.968040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:42.968050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:42.968091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:42.968123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254772938102742:4272]
2025-10-01T14:07:42.968580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:42.968877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:42.968914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:42.969140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:42.969175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.969175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.969176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.969177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.969177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.969178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.969179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.969180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.969181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.969182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.969182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.969183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.969184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.969184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.969188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.969194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.969197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.969199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.969201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.969204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.969206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.969208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.969210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.969213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.969215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.969217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.969219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.969222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.969227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.969232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:42.969236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.969239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:42.969242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.969245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:42.969248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.969251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:42.969253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.969256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:42.969259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.969262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:42.969265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.969268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:42.969270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.969273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:42.969276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.969280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:42.969282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.969285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.969288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.969291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.969294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.969297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.969299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.969302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:42.969306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.969309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:42.969329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:42.973426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:42.974004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:42.974009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:42.974011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:42.974014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:42.974019Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 340 [2:7556254772938102742:4272]
2025-10-01T14:07:42.974037Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:42.974060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:42.974062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.974065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.974067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.974082Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:42.974086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:42.974091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:42.974138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.974139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.974141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.974143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:42.974146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:42.974218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:42.974221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.974233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:42.974243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:42.974257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:42.974274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254772938102737:4272]
2025-10-01T14:07:42.974278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254772938102737:4272]
2025-10-01T14:07:42.974280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254772938102737:4272]
2025-10-01T14:07:42.974289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:42.974294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:42.974296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:42.974298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:42.974302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:42.974315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:42.974318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:42.974330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314964341:4686], now have 1 active actors on pipe
2025-10-01T14:07:42.974333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254775314964195:2446], now have 1 active actors on pipe
2025-10-01T14:07:42.974366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254772938102737:4272]
2025-10-01T14:07:42.974390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:42.974610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 340
2025-10-01T14:07:42.974643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 340
2025-10-01T14:07:42.974766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:42.975978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.975992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.976027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efed62ec-aeec849-76264981-d882a5eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:42.976037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:42.976043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:42.976046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:42.976057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:42.976071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:42.976099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:42.980033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:42.980050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:42.980086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:42.981017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 341 partition: 0 MaxSeqNo: 45 sessionId: src_id|efed62ec-aeec849-76264981-d882a5eb_0
2025-10-01T14:07:42.981414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72fe1a79-179cdbdc-445d133f-eeea69bb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|efed62ec-aeec849-76264981-d882a5eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:42.990059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efed62ec-aeec849-76264981-d882a5eb_0] Write session: try to update token
2025-10-01T14:07:42.990085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efed62ec-aeec849-76264981-d882a5eb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:42.999464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:42.999481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:42.999483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:42.999484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:42.999493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254772938102737:4272]
2025-10-01T14:07:42.999496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254772938102737:4272]
2025-10-01T14:07:42.999499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254772938102737:4272]
2025-10-01T14:07:42.999537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:42.999543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:42.999545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:42.999673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:43.006811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:43.006831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:43.006836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:43.028930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 341 sessionId: src_id|efed62ec-aeec849-76264981-d882a5eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:43.031345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:43.031432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254779609931665:4446]
2025-10-01T14:07:43.035012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 340, pipe: [1:7556254779609931665:4446]
2025-10-01T14:07:43.198925Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:43.199283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.199299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.199323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609931665:4446], now have 1 active actors on pipe
2025-10-01T14:07:43.199715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:43.199727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:43.199772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 341 reason: error at write: Disconnected sessionId: src_id|efed62ec-aeec849-76264981-d882a5eb_0
2025-10-01T14:07:43.200215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efed62ec-aeec849-76264981-d882a5eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:43.200224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efed62ec-aeec849-76264981-d882a5eb_0] Write session will restart in 0.009733s
2025-10-01T14:07:43.200248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efed62ec-aeec849-76264981-d882a5eb_0] Write session: Do CDS request
2025-10-01T14:07:43.200254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efed62ec-aeec849-76264981-d882a5eb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:43.200297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:43.199957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 341 sessionId: src_id|efed62ec-aeec849-76264981-d882a5eb_0 is DEAD
2025-10-01T14:07:43.200093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254779609931665:4446]
2025-10-01T14:07:43.200111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:43.211518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efed62ec-aeec849-76264981-d882a5eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:43.211868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:43.211884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 342
2025-10-01T14:07:43.212017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:43.212045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:43.212050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:43.212055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:43.212729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 342 sessionId:  describe result for acl check
2025-10-01T14:07:43.212760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:43.212762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:43.212764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:43.212769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254779609931772:4699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:43.213287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254779609931772:4699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:43.217513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254779609931772:4699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:43.226618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254779609931772:4699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:43.226634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254779609931772:4699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:43.226637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254779609931772:4699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:43.226648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:43.227598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:43.230209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:43.230484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:43.230489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:43.230500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:43.230555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:43.230596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254777233070225:4277]
2025-10-01T14:07:43.231166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:43.231866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:43.231912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:43.232241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:43.232301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.232302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.232303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.232304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.232305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.232307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.232308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.232309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.232310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.232311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.232312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.232313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.232314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.232315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.232321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.232330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.232334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.232338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.232342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.232345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.232361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.232365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.232368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.232371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.232375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.232378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.232381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.232384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.232391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.232398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.232406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.232411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.232415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.232420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.232424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.232428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.232434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.232438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.232441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.232446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.232451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.232456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.232460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.232464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.232469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.232473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.232477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.232482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.232486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.232490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.232494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.232499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.232502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.232506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.232509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.232514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.232549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:43.246024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 341
2025-10-01T14:07:43.246064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 341
2025-10-01T14:07:43.243784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:43.244667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:43.244674Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:43.244678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:43.244682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:43.244691Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 341 [2:7556254777233070225:4277]
2025-10-01T14:07:43.244711Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:43.244732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:43.244735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.244739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.244741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.244760Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:43.244766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:43.244774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:43.244856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.244859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.244861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.244865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:43.244867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:43.244950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:43.244953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.244966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.244976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.244990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:43.245007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254777233070220:4277]
2025-10-01T14:07:43.245010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254777233070220:4277]
2025-10-01T14:07:43.245012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254777233070220:4277]
2025-10-01T14:07:43.245026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:43.245040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:43.245054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:43.245056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:43.245099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254777233070220:4277]
2025-10-01T14:07:43.245102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:43.245297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:43.245299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:43.245302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:43.245308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:43.247837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609931705:2446], now have 1 active actors on pipe
2025-10-01T14:07:43.247853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609931870:4699], now have 1 active actors on pipe
2025-10-01T14:07:43.247878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.247884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.247917Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:43.247927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.247935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.247938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:43.247953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.247969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:43.247988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:43.252825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.252846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.252887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:43.253322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 342 partition: 0 MaxSeqNo: 45 sessionId: src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0
2025-10-01T14:07:43.253772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efed62ec-aeec849-76264981-d882a5eb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:43.256393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0] Write session: try to update token
2025-10-01T14:07:43.256413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:43.296158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 342 sessionId: src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:43.298866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:43.298650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:43.298671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:43.298673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:43.298676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:43.298685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254777233070220:4277]
2025-10-01T14:07:43.298689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254777233070220:4277]
2025-10-01T14:07:43.298694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254777233070220:4277]
2025-10-01T14:07:43.298743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:43.298750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.298753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:43.298892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:43.299085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:43.299090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:43.299094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:43.306441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254779609931886:4446]
2025-10-01T14:07:43.306913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 341, pipe: [1:7556254779609931886:4446]
2025-10-01T14:07:43.469181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:43.469708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.469719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.469744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609931886:4446], now have 1 active actors on pipe
2025-10-01T14:07:43.470293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:43.470585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254779609931886:4446]
2025-10-01T14:07:43.470617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:43.470684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 342 reason: status is not ok: tablet will be restarted right now sessionId: src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0
2025-10-01T14:07:43.470866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 342 sessionId: src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0 is DEAD
2025-10-01T14:07:43.471008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:43.471438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:43.471447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0] Write session will restart in 0.009736s
2025-10-01T14:07:43.471473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0] Write session: Do CDS request
2025-10-01T14:07:43.471480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:43.482002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:43.482687Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:43.482703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 343
2025-10-01T14:07:43.482884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:43.482917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:43.482923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:43.482927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:43.487510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 343 sessionId:  describe result for acl check
2025-10-01T14:07:43.487558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:43.487567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:43.487569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:43.487575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254779609931907:4703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:43.488117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254779609931907:4703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:43.493529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254779609931907:4703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:43.497019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254779609931907:4703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:43.497038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254779609931907:4703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:43.497041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254779609931907:4703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:43.497050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:43.519817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:43.522788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:43.523026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:43.523037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:43.523049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:43.523095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:43.523140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254777233070426:4290]
2025-10-01T14:07:43.523848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:43.524230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:43.524268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:43.524591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:43.524646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.524647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.524648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.524649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.524650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.524652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.524653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.524654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.524655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.524656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.524658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.524659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.524660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.524661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.524667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.524677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.524681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.524685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.524689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.524692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.524696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.524700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.524704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.524710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.524713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.524717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.524721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.524725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.524733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.524741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.524747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.524752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.524757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.524762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.524767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.524772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.524777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.524783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.524787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.524792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.524797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.524802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.524821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.524826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.524831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.524836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.524842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.524847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.524852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.524857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.524861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.524866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.524873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.524878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.524885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.524890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.524930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:43.533196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:43.533807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:43.533823Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:43.533827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:43.533830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:43.533837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 342 [2:7556254777233070426:4290]
2025-10-01T14:07:43.533854Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:43.533872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:43.533875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.533879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.533881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.533898Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:43.533910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:43.533916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:43.533970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.533978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.533980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.533983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:43.533986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:43.534055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:43.534061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.534073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.534084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.534102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:43.534122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254777233070420:4290]
2025-10-01T14:07:43.534129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254777233070420:4290]
2025-10-01T14:07:43.534131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254777233070420:4290]
2025-10-01T14:07:43.534145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:43.534162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:43.534182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:43.534189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:43.534191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:43.534205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:43.534208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:43.534225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254777233070420:4290]
2025-10-01T14:07:43.534228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:43.534285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:43.534475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609931956:4703], now have 1 active actors on pipe
2025-10-01T14:07:43.534486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609931892:2446], now have 1 active actors on pipe
2025-10-01T14:07:43.534692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 342
2025-10-01T14:07:43.534692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 342
2025-10-01T14:07:43.538433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.538455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.538497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:43.538507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.538512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.538516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:43.538527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.538541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:43.538563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:43.548957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 343 partition: 0 MaxSeqNo: 45 sessionId: src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0
2025-10-01T14:07:43.549407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84deb8b2-6c044d42-6c92746b-f0759ec4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:43.546501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.546525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.546568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:43.552142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0] Write session: try to update token
2025-10-01T14:07:43.552164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:43.574771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254779609932063:4446]
2025-10-01T14:07:43.579934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609932063:4446], now have 1 active actors on pipe
2025-10-01T14:07:43.580123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 342, pipe: [1:7556254779609932063:4446]
2025-10-01T14:07:43.588375Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:43.588395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:43.588397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:43.588400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:43.588411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254777233070420:4290]
2025-10-01T14:07:43.588417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254777233070420:4290]
2025-10-01T14:07:43.588420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254777233070420:4290]
2025-10-01T14:07:43.588470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:43.588477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.588480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:43.588640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:43.592690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:43.592705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:43.592709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:43.594056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 343 sessionId: src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:43.596533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:43.754648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:43.755129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.755139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.755582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:43.755605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:43.755620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:43.755681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 343 reason: error at write: Disconnected sessionId: src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0
2025-10-01T14:07:43.755870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 343 sessionId: src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0 is DEAD
2025-10-01T14:07:43.755960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:43.756002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254779609932063:4446]
2025-10-01T14:07:43.756308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:43.756316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0] Write session will restart in 0.008280s
2025-10-01T14:07:43.756341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0] Write session: Do CDS request
2025-10-01T14:07:43.756351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:43.765969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:43.766260Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:43.766280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 344
2025-10-01T14:07:43.766427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:43.766471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:43.766483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:43.766494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:43.766926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 344 sessionId:  describe result for acl check
2025-10-01T14:07:43.766981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:43.766988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:43.766990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:43.766998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254779609932111:4708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:43.767562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254779609932111:4708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:43.772298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254779609932111:4708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:43.774356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:43.777501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:43.777745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:43.777755Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:43.777765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:43.777816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:43.777855Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254777233070597:4293]
2025-10-01T14:07:43.777904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254779609932111:4708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:43.777921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254779609932111:4708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:43.777925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254779609932111:4708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:43.777933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:43.778492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:43.778810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:43.778854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:43.779197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:43.779246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.779252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.779253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.779254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.779256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.779258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.779271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.779273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.779274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.779275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.779276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.779277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.779278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.779279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.779287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.779297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.779301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.779303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.779305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.779308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.779310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.779312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.779314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.779316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.779318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.779320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.779321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.779324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.779329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.779334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:43.779338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.779341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:43.779344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.779347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:43.779349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.779352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:43.779354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.779358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:43.779361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.779364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:43.779367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.779369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:43.779372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.779375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:43.779377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.779380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:43.779384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.779387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.779389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.779392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.779394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.779398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.779400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.779403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:43.779406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.779410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:43.779455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:43.784289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:43.785137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:43.785156Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:43.785159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:43.785163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:43.785172Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 343 [2:7556254777233070597:4293]
2025-10-01T14:07:43.785214Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:43.785237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:43.785244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.785249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.785252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.785270Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:43.785276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:43.785283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:43.785339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.785347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.785350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.785354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:43.785357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:43.785433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:43.785440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.785454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:43.785466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:43.785486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:43.785509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609932070:2446], now have 1 active actors on pipe
2025-10-01T14:07:43.785521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609932234:4708], now have 1 active actors on pipe
2025-10-01T14:07:43.785528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254777233070592:4293]
2025-10-01T14:07:43.785531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254777233070592:4293]
2025-10-01T14:07:43.785533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254777233070592:4293]
2025-10-01T14:07:43.785542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:43.785550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:43.785554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:43.785556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:43.785556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:43.785571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:43.785579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:43.785617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254777233070592:4293]
2025-10-01T14:07:43.785627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:43.785629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:43.785590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 343
2025-10-01T14:07:43.785591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 343
2025-10-01T14:07:43.785661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.785670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.785703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:43.785715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:43.785719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:43.785722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:43.785731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:43.785742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:43.785761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:43.785954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.785963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.785980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:43.786088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 344 partition: 0 MaxSeqNo: 45 sessionId: src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0
2025-10-01T14:07:43.787858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|483b148b-30e04d8e-487a28da-3bb84bc6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:43.790510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0] Write session: try to update token
2025-10-01T14:07:43.790531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:43.811458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 344 sessionId: src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:43.812318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:43.812336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:43.812339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:43.812341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:43.812350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254777233070592:4293]
2025-10-01T14:07:43.812355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254777233070592:4293]
2025-10-01T14:07:43.812359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254777233070592:4293]
2025-10-01T14:07:43.812407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:43.812414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:43.812416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:43.812415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:43.812421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:43.812433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:43.812544Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:43.814091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:43.856203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254779609932246:4446]
2025-10-01T14:07:43.856706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 343, pipe: [1:7556254779609932246:4446]
2025-10-01T14:07:43.976069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:43.976559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:43.976574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:43.976616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609932246:4446], now have 1 active actors on pipe
2025-10-01T14:07:43.976798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:43.976868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:43.976915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254779609932246:4446]
2025-10-01T14:07:43.976929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:43.976931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:43.976988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 344 reason: error at write: Disconnected sessionId: src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0
2025-10-01T14:07:43.977155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 344 sessionId: src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0 is DEAD
2025-10-01T14:07:43.977302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:43.977326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0] Write session will restart in 0.006699s
2025-10-01T14:07:43.977347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0] Write session: Do CDS request
2025-10-01T14:07:43.977352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:43.985072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:43.985180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:43.985209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 345
2025-10-01T14:07:43.986833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:43.986882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:43.986887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:43.986892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:43.987380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 345 sessionId:  describe result for acl check
2025-10-01T14:07:43.987410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:43.987412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:43.987413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:43.987419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254779609932264:4712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:43.987849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254779609932264:4712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:43.989836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254779609932264:4712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:43.999438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254779609932264:4712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:43.999456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254779609932264:4712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:43.999460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254779609932264:4712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:43.999470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:43.999315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:44.003979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:44.004250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:44.004259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:44.004273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:44.004330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:44.004379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254781528038065:4295]
2025-10-01T14:07:44.005016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:44.005376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:44.005424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:44.005727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:44.005800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.005807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.005808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.005809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.005811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.005812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.005814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.005815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.005816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.005817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.005818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.005819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.005821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.005822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.005828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.005838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.005842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.005846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.005850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.005855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.005859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.005862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.005866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.005870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.005874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.005877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.005881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.005886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.005893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.005901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.005908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.005913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.005918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.005923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.005928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.005934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.005940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.005946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.005950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.005956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.005961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.005967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.005971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.005977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.005981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.005987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.006000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.006005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.006016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.006021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.006032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.006037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.006047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.006052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.006060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.006065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.006106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:44.014317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:44.015073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:44.015092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:44.015096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:44.015100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:44.015107Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 344 [2:7556254781528038065:4295]
2025-10-01T14:07:44.015126Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:44.015145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:44.015148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.015153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.015155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.015172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:44.015184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:44.015191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:44.015253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.015261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.015263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.015266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:44.015269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:44.015340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:44.015348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.015361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.015376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.015396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:44.015419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254777233070762:4295]
2025-10-01T14:07:44.015427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254777233070762:4295]
2025-10-01T14:07:44.015429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254777233070762:4295]
2025-10-01T14:07:44.015448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:44.015468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:44.015486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:44.015493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:44.015505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:44.015526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:44.015533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254777233070762:4295]
2025-10-01T14:07:44.015535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:44.015536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:44.015541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:44.015576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609932251:2446], now have 1 active actors on pipe
2025-10-01T14:07:44.015580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254779609932413:4712], now have 1 active actors on pipe
2025-10-01T14:07:44.019486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 344
2025-10-01T14:07:44.019534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 344
2025-10-01T14:07:44.019650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.019671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.019699Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:44.019711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.019717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.019721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:44.019735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.020576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 345 partition: 0 MaxSeqNo: 45 sessionId: src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0
2025-10-01T14:07:44.021071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0057e1e-1520ce77-e7a6f6e5-dbb4888d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:44.023473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0] Write session: try to update token
2025-10-01T14:07:44.023490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:44.019753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:44.019775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:44.020381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.020387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.020407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:44.035277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:44.035325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:44.035335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254777233070762:4295]
2025-10-01T14:07:44.035382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:44.035392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:44.035574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:44.035728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:44.035882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:44.036054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:44.036255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:44.036299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:44.043321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 345 sessionId: src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:44.045916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:44.046250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.046274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.046313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:44.047526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:44.057829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:44.057850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:44.057853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:44.057855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:44.057865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254777233070762:4295]
2025-10-01T14:07:44.057870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254777233070762:4295]
2025-10-01T14:07:44.057873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254777233070762:4295]
2025-10-01T14:07:44.057920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:44.057921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:44.057926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:44.057927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.057929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:44.057929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:44.058063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:44.076801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254783904899722:4446]
2025-10-01T14:07:44.077063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 344, pipe: [1:7556254783904899722:4446]
2025-10-01T14:07:44.219483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:44.227534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.227563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.227720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.227781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.227849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.227910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.227965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.227969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.228033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.228107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.228160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.228222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.228261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.228267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.228355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.228413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.228466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.228516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.228557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.228559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.228620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.228703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.228756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.228824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.228861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.228865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.228920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.228970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.229022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.229082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.229223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.229227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.229291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.229340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.229391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.229462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.229498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.229501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.229562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.229612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.229699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.229784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.229841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.229843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.229930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.229987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.230039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.230093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.230131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.230134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.230197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.230246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.230293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.230344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.230405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.230408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.230465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.230514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.230566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.230624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.230728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.230731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.230797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904899722:4446], now have 1 active actors on pipe
2025-10-01T14:07:44.232125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:44.232139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:44.232164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 345 reason: error at write: Disconnected sessionId: src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0
2025-10-01T14:07:44.232492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:44.232503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0] Write session will restart in 0.007240s
2025-10-01T14:07:44.232532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0] Write session: Do CDS request
2025-10-01T14:07:44.232540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:44.232354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 345 sessionId: src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0 is DEAD
2025-10-01T14:07:44.232487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254783904899722:4446]
2025-10-01T14:07:44.232501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:44.231872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:44.240927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:44.240999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:44.241015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 346
2025-10-01T14:07:44.241314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:44.241353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:44.241365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:44.241369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:44.241814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 346 sessionId:  describe result for acl check
2025-10-01T14:07:44.241856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:44.241862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:44.241864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:44.241869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254783904899793:4724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:44.242402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254783904899793:4724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:44.245109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254783904899793:4724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:44.251018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254783904899793:4724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:44.251036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254783904899793:4724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:44.251039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254783904899793:4724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:44.251048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:44.251106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:44.256747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:44.257311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:44.257317Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:44.257332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:44.257402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:44.257438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254781528038257:4298]
2025-10-01T14:07:44.258009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:44.258338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:44.258401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:44.258719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:44.258785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.258792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.258793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.258794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.258795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.258796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.258798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.258799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.258800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.258801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.258803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.258804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.258805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.258806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.258812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.258821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.258824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.258827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.258830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.258834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.258837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.258841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.258845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.258848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.258851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.258855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.258858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.258861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.258868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.258875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.258880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.258884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.258888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.258893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.258897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.258902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.258907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.258911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.258915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.258919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.258924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.258929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.258935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.258939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.258944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.258949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.258954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.258959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.258963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.258967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.258970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.258975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.258979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.258983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.258986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.258990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.259024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:44.263267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:44.263914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:44.263930Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:44.263933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:44.263936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:44.263944Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 345 [2:7556254781528038257:4298]
2025-10-01T14:07:44.263960Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:44.263976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:44.263979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.264613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 345
2025-10-01T14:07:44.263983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.263993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.264009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:44.264015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:44.264021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:44.264081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.264083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.264086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.264091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:44.264093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:44.264164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:44.264167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.264179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.264189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.264206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:44.264223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254781528038249:4298]
2025-10-01T14:07:44.264226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254781528038249:4298]
2025-10-01T14:07:44.264231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254781528038249:4298]
2025-10-01T14:07:44.264244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:44.264259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:44.264271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:44.264274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:44.264309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254781528038249:4298]
2025-10-01T14:07:44.264311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:44.264387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:44.264389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:44.264390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:44.264395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:44.264523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904899758:2446], now have 1 active actors on pipe
2025-10-01T14:07:44.264530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904899932:4724], now have 1 active actors on pipe
2025-10-01T14:07:44.264629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 345
2025-10-01T14:07:44.264774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.264789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.264833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b58c89e-cc3211ee-e9028164-506709bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:44.264847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.264852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.264855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:44.264882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.264898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:44.264919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:44.265092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.265105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.265128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:44.265213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 346 partition: 0 MaxSeqNo: 45 sessionId: src_id|7b58c89e-cc3211ee-e9028164-506709bf_0
2025-10-01T14:07:44.265619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38ba3e13-9a386224-c68f75cc-be1fc82e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7b58c89e-cc3211ee-e9028164-506709bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:44.268010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b58c89e-cc3211ee-e9028164-506709bf_0] Write session: try to update token
2025-10-01T14:07:44.268026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b58c89e-cc3211ee-e9028164-506709bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:44.284662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 346 sessionId: src_id|7b58c89e-cc3211ee-e9028164-506709bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:44.286973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:44.287157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.287177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.287214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:44.287298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:44.290579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:44.290599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:44.290601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:44.290603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:44.290613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254781528038249:4298]
2025-10-01T14:07:44.290621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254781528038249:4298]
2025-10-01T14:07:44.290624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254781528038249:4298]
2025-10-01T14:07:44.290669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:44.290672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:44.290676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:44.290678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.290680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:44.290681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:44.290826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:44.331886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254783904899946:4446]
2025-10-01T14:07:44.332182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 345, pipe: [1:7556254783904899946:4446]
2025-10-01T14:07:44.448324Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:44.457499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.457532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.457714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.457789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.457861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.457932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.458229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.458242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.458319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.458404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.458493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.458568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.458614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.458627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.458694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.458757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.458855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.458918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.458967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.458970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.459035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.459091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.459150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.459208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.459248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.459251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.459314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.459377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.459436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.459495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.459543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.459546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.459611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.459669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.459731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.459791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.459859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.459862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.459934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.459994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.460056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.460114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.460236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.460239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.460306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.460371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.460430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.460491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.460556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.460559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.460630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.460693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.460763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.460847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.460893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.460896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.460968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.461027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.461089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.461149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.461196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.461199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.461277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904899946:4446], now have 1 active actors on pipe
2025-10-01T14:07:44.462008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:44.462572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b58c89e-cc3211ee-e9028164-506709bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:44.462582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b58c89e-cc3211ee-e9028164-506709bf_0] Write session will restart in 0.006410s
2025-10-01T14:07:44.462608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b58c89e-cc3211ee-e9028164-506709bf_0] Write session: Do CDS request
2025-10-01T14:07:44.462614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b58c89e-cc3211ee-e9028164-506709bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:44.462014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:44.462066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:44.462115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 346 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b58c89e-cc3211ee-e9028164-506709bf_0
2025-10-01T14:07:44.462306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 346 sessionId: src_id|7b58c89e-cc3211ee-e9028164-506709bf_0 is DEAD
2025-10-01T14:07:44.462446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254783904899946:4446]
2025-10-01T14:07:44.469885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b58c89e-cc3211ee-e9028164-506709bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:44.470023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:44.470041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 347
2025-10-01T14:07:44.470153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:44.470199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:44.470210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:44.470214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:44.470828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 347 sessionId:  describe result for acl check
2025-10-01T14:07:44.470868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:44.470875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:44.470877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:44.470882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254783904899971:4729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:44.471376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254783904899971:4729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:44.474821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254783904899971:4729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:44.479466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254783904899971:4729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:44.479485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254783904899971:4729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:44.479488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254783904899971:4729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:44.479509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:44.480739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:44.484364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:44.484745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:44.484759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:44.484776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:44.484860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:44.484909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254781528038438:4303]
2025-10-01T14:07:44.485533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:44.487680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:44.487758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:44.488132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:44.488206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.488208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.488209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.488210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.488212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.488213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.488214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.488215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.488217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.488218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.488219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.488222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.488223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.488224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.488231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.488241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.488245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.488249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.488253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.488256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.488260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.488264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.488268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.488271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.488276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.488280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.488284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.488287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.488295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.488304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.488311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.488316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.488320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.488326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.488330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.488335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.488339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.488344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.488348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.488354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.488359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.488365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.488369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.488377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.488382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.488387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.488391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.488396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.488400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.488405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.488409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.488414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.488418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.488424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.488428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.488433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.488478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:44.497152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:44.498055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:44.498076Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:44.498078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:44.498083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:44.498090Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 346 [2:7556254781528038438:4303]
2025-10-01T14:07:44.498106Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:44.498123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:44.498131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.498135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.498138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.498154Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:44.498163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:44.498169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:44.498221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.498232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.498234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.498237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:44.498240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:44.498306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:44.498312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.498327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.498339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.498365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:44.498407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904900114:4729], now have 1 active actors on pipe
2025-10-01T14:07:44.498416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904899948:2446], now have 1 active actors on pipe
2025-10-01T14:07:44.498423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254781528038429:4303]
2025-10-01T14:07:44.498497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 346
2025-10-01T14:07:44.498425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254781528038429:4303]
2025-10-01T14:07:44.498500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 346
2025-10-01T14:07:44.498427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254781528038429:4303]
2025-10-01T14:07:44.498441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:44.498454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:44.498454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:44.498457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:44.498461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:44.498467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:44.498470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:44.498509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254781528038429:4303]
2025-10-01T14:07:44.498516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:44.498534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:44.498551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.498556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.498587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:44.498594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.498598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.498601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:44.498609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.498618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:44.498640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:44.499648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.499668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.499694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:44.499825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 347 partition: 0 MaxSeqNo: 45 sessionId: src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0
2025-10-01T14:07:44.500283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b58c89e-cc3211ee-e9028164-506709bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:44.503023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0] Write session: try to update token
2025-10-01T14:07:44.503042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:44.512492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:44.512516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:44.512525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254781528038429:4303]
2025-10-01T14:07:44.512574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:44.512581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:44.512785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:44.512961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:44.513113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:44.513255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:44.513455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:44.513498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:44.525925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 347 sessionId: src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:44.528451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:44.528671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.528694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.528745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:44.528838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:44.562710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254783904900128:4446]
2025-10-01T14:07:44.562872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.562900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.563076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.563154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.563227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.563295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.563345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.563355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.563461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.563598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.563690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.563760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.563814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.563822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.563889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.563949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.564015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.564079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.564128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.564131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.564159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 346, pipe: [1:7556254783904900128:4446]
2025-10-01T14:07:44.564194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.564262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.564363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.564426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.564474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.564481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.564547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.564607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.564668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.564732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.564776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.564783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.564863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.564945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.565040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.565181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.565262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.565276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.565400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.565523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.565671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.565824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.565894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.565911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.566051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.566183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.566322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.566521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.566612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.566629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.566770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.566917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.567064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.567195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.567276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.567279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.567408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:44.567524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:44.567658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:44.567794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:44.567891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:44.567896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:44.568042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904900128:4446], now have 1 active actors on pipe
2025-10-01T14:07:44.568055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:07:44.568170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.568198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.568202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:07:44.568231Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568249Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568254Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568263Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568269Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568273Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568279Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568289Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568297Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568302Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568306Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568310Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568314Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568322Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568331Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568716Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568729Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568734Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568739Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.568744Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569113Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569129Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569143Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569153Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569159Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569167Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569172Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569181Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569188Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569194Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569374Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569383Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569397Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569409Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569418Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:07:44.569448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:07:44.569467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:07:44.569473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:07:44.569478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:07:44.569486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:07:44.570818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:07:44.570848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:07:44.570858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:07:44.570862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:07:44.570865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:07:44.570868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:07:44.571428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:07:44.571456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:07:44.571462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:07:44.571465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:07:44.571468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:07:44.571472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:07:44.572069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:07:44.572093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.572202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327664570
2025-10-01T14:07:44.575425Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:44.575455Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:07:44.575469Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:44.575472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:44.575475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:44.575477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:44.575486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254781528038429:4303]
2025-10-01T14:07:44.575492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254781528038429:4303]
2025-10-01T14:07:44.575496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254781528038429:4303]
2025-10-01T14:07:44.575587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:44.575592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.575594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:44.575733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:44.578885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:44.578896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:44.578900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:44.773784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:44.774921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:44.774937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:44.774959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 347 reason: error at write: Disconnected sessionId: src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0
2025-10-01T14:07:44.775124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 347 sessionId: src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0 is DEAD
2025-10-01T14:07:44.775224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:44.775257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254783904900128:4446]
2025-10-01T14:07:44.775268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:44.775278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0] Write session will restart in 0.005727s
2025-10-01T14:07:44.775321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0] Write session: Do CDS request
2025-10-01T14:07:44.775328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:44.774792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:44.781909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:44.786442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:44.786459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 348
2025-10-01T14:07:44.786822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:44.786857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:44.786868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:44.786872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:44.794389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 348 sessionId:  describe result for acl check
2025-10-01T14:07:44.794437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:44.794439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:44.794440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:44.794445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254783904900158:4734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:44.794939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254783904900158:4734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:44.795046Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [18a6fdda23650fc9] Result# TEvPutResult {Id# [72075186224037892:346:1:2:1:6759616:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-01T14:07:44.801107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254783904900158:4734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:44.804309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254783904900158:4734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:44.804329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254783904900158:4734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:44.804333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254783904900158:4734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:44.804341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:44.819369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:44.821959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:44.822201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:44.822209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:44.822220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:44.822283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:44.822325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254781528038639:4316]
2025-10-01T14:07:44.822934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:44.824362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:44.824428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:44.824792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:44.824884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.824891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.824892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.824894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.824895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.824896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.824897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.824899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.824900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.824901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.824902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.824903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.824904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.824905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.824912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.824921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.824924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.824928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.824931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.824935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.824939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.824942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.824945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.824949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.824953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.824956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.824960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.824963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.824972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.824981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:44.824988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.824994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:44.824999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.825004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:44.825008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.825012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:44.825016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.825021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:44.825025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.825032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:44.825039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.825050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:44.825055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.825060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:44.825064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.825068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:44.825073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.825077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.825082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.825087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.825091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.825096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.825101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.825106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:44.825110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.825115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:44.825155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:44.829138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:44.829801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:44.829807Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:44.829810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:44.829814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:44.829822Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 347 [2:7556254781528038639:4316]
2025-10-01T14:07:44.829838Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:44.829856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:44.829859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.829863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.829865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.829883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:44.829888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:44.829895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:44.829954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.829956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.829958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.829961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:44.829963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:44.830037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:44.830040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.830051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:44.830061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:44.830076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:44.830092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254781528038632:4316]
2025-10-01T14:07:44.830095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254781528038632:4316]
2025-10-01T14:07:44.830097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254781528038632:4316]
2025-10-01T14:07:44.830113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:44.830126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:44.830144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:44.830147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:44.830168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:44.830171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:44.830173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:44.830181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254781528038632:4316]
2025-10-01T14:07:44.830184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:44.830230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:44.830523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 347
2025-10-01T14:07:44.830549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 347
2025-10-01T14:07:44.830691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904900134:2446], now have 1 active actors on pipe
2025-10-01T14:07:44.830700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904900236:4734], now have 1 active actors on pipe
2025-10-01T14:07:44.830717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.830723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.830750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:44.830758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:44.830763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:44.830766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:44.830775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:44.830787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:44.830801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:44.831076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:44.831089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:44.831105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:44.831215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 348 partition: 0 MaxSeqNo: 45 sessionId: src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0
2025-10-01T14:07:44.831562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f85b99d-d0377443-82a9f76b-5892f66c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:44.834130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0] Write session: try to update token
2025-10-01T14:07:44.834149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:44.855053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:44.855069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:44.855072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:44.855073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:44.855082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254781528038632:4316]
2025-10-01T14:07:44.855087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254781528038632:4316]
2025-10-01T14:07:44.855091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254781528038632:4316]
2025-10-01T14:07:44.855128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:44.855132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:44.855135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:44.855141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:44.855149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:44.855151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:44.855291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:44.859945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 348 sessionId: src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:44.862577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:44.875114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254783904900315:4446]
2025-10-01T14:07:44.876038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 347, pipe: [1:7556254783904900315:4446]
2025-10-01T14:07:45.010056Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:45.010413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.010429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.010475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254783904900315:4446], now have 1 active actors on pipe
2025-10-01T14:07:45.013583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:45.014293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:45.014351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254783904900315:4446]
2025-10-01T14:07:45.014386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:45.014456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 348 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0
2025-10-01T14:07:45.015018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:45.015028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0] Write session will restart in 0.007818s
2025-10-01T14:07:45.015054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0] Write session: Do CDS request
2025-10-01T14:07:45.015061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:45.014657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 348 sessionId: src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0 is DEAD
2025-10-01T14:07:45.024000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.026741Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:45.026761Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 349
2025-10-01T14:07:45.030494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.030546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:45.030552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:45.030556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:45.034736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 349 sessionId:  describe result for acl check
2025-10-01T14:07:45.034782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:45.034784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:45.034785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:45.034791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254788199867705:4738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:45.035286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254788199867705:4738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:45.043687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:45.046312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:45.046561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:45.046582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:45.046595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:45.046650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:45.046687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254785823006108:4318]
2025-10-01T14:07:45.047334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:45.048462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:45.048525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:45.048869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:45.048923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.048925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.048926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.048928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.048929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.048930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.048932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.048933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.048935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.048936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.048938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.048939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.048940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.048942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.048948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.048958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.048962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.048966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.048970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.048974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.048978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.048982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.048986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.048991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.048994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.048998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.049003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.049008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.049015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.049022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.049038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.049044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.049049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.049059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.049068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.049079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.049084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.049094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.049102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.049112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.049121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.049131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.049140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.049149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.049158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.049164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.049173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.049178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.049188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.049194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.049200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.049206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.049212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.049217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.049222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.049227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.049269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:45.052032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254788199867705:4738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:45.055837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:45.056740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:45.056757Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:45.056760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:45.056764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:45.056770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 348 [2:7556254785823006108:4318]
2025-10-01T14:07:45.056786Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:45.056818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:45.056826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.056830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.056833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.056848Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:45.056859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:45.056869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:45.056931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.056937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.056939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.056943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:45.056945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:45.057013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:45.057021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.057033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.057048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.057068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:45.057089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254785823006103:4318]
2025-10-01T14:07:45.057095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254785823006103:4318]
2025-10-01T14:07:45.057097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254785823006103:4318]
2025-10-01T14:07:45.057108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:45.057125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:45.057142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:45.057150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:45.057186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254785823006103:4318]
2025-10-01T14:07:45.057193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:45.057255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:45.057262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:45.057264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:45.057268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:45.057425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199867616:2446], now have 1 active actors on pipe
2025-10-01T14:07:45.057518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 348
2025-10-01T14:07:45.062853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254788199867705:4738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:45.062869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254788199867705:4738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:45.062872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254788199867705:4738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:45.062883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:45.063599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199867791:4738], now have 1 active actors on pipe
2025-10-01T14:07:45.066463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 348
2025-10-01T14:07:45.066660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.066680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.066712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be01044f-b545e900-3dd03f0e-188ccd12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:45.066723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.066730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.066733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:45.066747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.066765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:45.066786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:45.067058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.067066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.067184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 349 partition: 0 MaxSeqNo: 45 sessionId: src_id|be01044f-b545e900-3dd03f0e-188ccd12_0
2025-10-01T14:07:45.067094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:45.067601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9949b8-45fe9fe3-5e2fe9ab-d44dc38_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be01044f-b545e900-3dd03f0e-188ccd12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:45.070230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be01044f-b545e900-3dd03f0e-188ccd12_0] Write session: try to update token
2025-10-01T14:07:45.070246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be01044f-b545e900-3dd03f0e-188ccd12_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:45.081691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:45.081719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:45.081721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:45.081723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:45.081734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254785823006103:4318]
2025-10-01T14:07:45.081738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254785823006103:4318]
2025-10-01T14:07:45.081742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254785823006103:4318]
2025-10-01T14:07:45.081792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:45.081803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:45.081805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.081808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:45.081819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:45.081824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:45.081943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:45.092573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 349 sessionId: src_id|be01044f-b545e900-3dd03f0e-188ccd12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:45.094785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:45.118533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254788199867810:4446]
2025-10-01T14:07:45.122503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 348, pipe: [1:7556254788199867810:4446]
2025-10-01T14:07:45.235991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:45.236295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.236304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.236328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199867810:4446], now have 1 active actors on pipe
2025-10-01T14:07:45.236734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:45.237549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01044f-b545e900-3dd03f0e-188ccd12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:45.237560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01044f-b545e900-3dd03f0e-188ccd12_0] Write session will restart in 0.009607s
2025-10-01T14:07:45.237585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01044f-b545e900-3dd03f0e-188ccd12_0] Write session: Do CDS request
2025-10-01T14:07:45.237591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01044f-b545e900-3dd03f0e-188ccd12_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:45.237053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254788199867810:4446]
2025-10-01T14:07:45.237081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:45.237108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:45.237111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:45.237166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 349 reason: error at write: Disconnected sessionId: src_id|be01044f-b545e900-3dd03f0e-188ccd12_0
2025-10-01T14:07:45.237363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 349 sessionId: src_id|be01044f-b545e900-3dd03f0e-188ccd12_0 is DEAD
2025-10-01T14:07:45.248068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be01044f-b545e900-3dd03f0e-188ccd12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.249091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:45.249109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 350
2025-10-01T14:07:45.249237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.249270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:45.249275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:45.249278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:45.251517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 350 sessionId:  describe result for acl check
2025-10-01T14:07:45.251556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:45.251558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:45.251560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:45.251566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254788199867836:4745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:45.252017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254788199867836:4745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:45.261979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254788199867836:4745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:45.276857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254788199867836:4745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:45.276879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254788199867836:4745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:45.276882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254788199867836:4745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:45.276893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:45.287423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:45.290600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:45.290848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:45.290858Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:45.290870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:45.290928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:45.290968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254785823006300:4321]
2025-10-01T14:07:45.291612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:45.291920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:45.291965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:45.292306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:45.292376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.292381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.292382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.292384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.292385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.292386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.292387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.292388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.292390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.292391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.292392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.292393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.292394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.292395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.292401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.292411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.292416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.292420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.292424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.292428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.292432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.292435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.292439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.292443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.292447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.292450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.292454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.292458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.292464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.292473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.292479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.292486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.292491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.292496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.292506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.292512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.292520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.292526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.292535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.292540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.292546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.292556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.292564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.292569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.292576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.292582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.292586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.292597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.292602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.292607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.292612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.292617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.292626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.292631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.292640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.292645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.292686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:45.297366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:45.297956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:45.297962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:45.297965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:45.297969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:45.297976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 349 [2:7556254785823006300:4321]
2025-10-01T14:07:45.297994Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:45.298012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:45.298015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.298019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.298021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.298037Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:45.298449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 349
2025-10-01T14:07:45.298503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 349
2025-10-01T14:07:45.298043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:45.298048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:45.298106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.298108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.298110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.298113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:45.298116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:45.298188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:45.298190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.298203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.298215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.298233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:45.298251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199867824:2446], now have 1 active actors on pipe
2025-10-01T14:07:45.298255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199867986:4745], now have 1 active actors on pipe
2025-10-01T14:07:45.298262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254785823006295:4321]
2025-10-01T14:07:45.298264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254785823006295:4321]
2025-10-01T14:07:45.298266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254785823006295:4321]
2025-10-01T14:07:45.298283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:45.298296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:45.298303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:45.298307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:45.298309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:45.298311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:45.298315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:45.298347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254785823006295:4321]
2025-10-01T14:07:45.298355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:45.298360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:45.298544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.298549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.298572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:45.298579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.298582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.298585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:45.298593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.298602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:45.298617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:45.302707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.302725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.302757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:45.302886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 350 partition: 0 MaxSeqNo: 45 sessionId: src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0
2025-10-01T14:07:45.303285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01044f-b545e900-3dd03f0e-188ccd12_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:45.305768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0] Write session: try to update token
2025-10-01T14:07:45.305787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:45.327564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:45.327581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:45.327583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:45.327584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:45.327591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254785823006295:4321]
2025-10-01T14:07:45.327596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254785823006295:4321]
2025-10-01T14:07:45.327599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254785823006295:4321]
2025-10-01T14:07:45.327641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:45.327648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.327650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:45.327783Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:45.330328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:45.330339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:45.330342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:45.337366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254788199868029:4446]
2025-10-01T14:07:45.341595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 349, pipe: [1:7556254788199868029:4446]
2025-10-01T14:07:45.354415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 350 sessionId: src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:45.356974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:45.480968Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:45.481232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199868029:4446], now have 1 active actors on pipe
2025-10-01T14:07:45.481274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.481281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.481495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:45.481599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254788199868029:4446]
2025-10-01T14:07:45.481625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:45.481659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:45.481662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:45.481724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 350 reason: error at write: Disconnected sessionId: src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0
2025-10-01T14:07:45.481962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 350 sessionId: src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0 is DEAD
2025-10-01T14:07:45.482077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:45.482088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0] Write session will restart in 0.005319s
2025-10-01T14:07:45.482128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0] Write session: Do CDS request
2025-10-01T14:07:45.482134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:45.488929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.488965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:45.488981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 351
2025-10-01T14:07:45.489133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.489165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:45.489175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:45.489179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:45.489624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 351 sessionId:  describe result for acl check
2025-10-01T14:07:45.489658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:45.489662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:45.489664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:45.489669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254788199868055:4757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:45.490171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254788199868055:4757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:45.495758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254788199868055:4757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:45.500641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254788199868055:4757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:45.500662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254788199868055:4757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:45.500665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254788199868055:4757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:45.500673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:45.504497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:45.504726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:45.504962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:45.504974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:45.504987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:45.505048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:45.505095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254785823006484:4326]
2025-10-01T14:07:45.505705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:45.506116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:45.506168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:45.506520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:45.506578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.506579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.506581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.506581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.506582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.506584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.506585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.506586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.506587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.506588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.506589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.506590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.506591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.506592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.506596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.506605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.506609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.506613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.506616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.506620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.506623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.506626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.506629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.506633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.506636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.506639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.506642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.506645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.506652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.506660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.506667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.506672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.506676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.506680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.506684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.506689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.506693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.506698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.506702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.506710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.506713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.506718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.506721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.506727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.506731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.506735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.506738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.506742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.506747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.506752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.506755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.506759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.506764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.506767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.506771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.506775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.506811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:45.514143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:45.514858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:45.514881Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:45.514884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:45.514888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:45.514897Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 350 [2:7556254785823006484:4326]
2025-10-01T14:07:45.514918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:45.514937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:45.514941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.514945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.514948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.514968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:45.514985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:45.514992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:45.515056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.515064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.515067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.515071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:45.515074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:45.515147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:45.515155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.515168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.515179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.515195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:45.515215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254785823006479:4326]
2025-10-01T14:07:45.515218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254785823006479:4326]
2025-10-01T14:07:45.515221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254785823006479:4326]
2025-10-01T14:07:45.515231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:45.515238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:45.515241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:45.515243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:45.515247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199868031:2446], now have 1 active actors on pipe
2025-10-01T14:07:45.515253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199868203:4757], now have 1 active actors on pipe
2025-10-01T14:07:45.515260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:45.515275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:45.515278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:45.515322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254785823006479:4326]
2025-10-01T14:07:45.515331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:45.515348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:45.515884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 350
2025-10-01T14:07:45.515920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 350
2025-10-01T14:07:45.516259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.516277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.516307Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:45.516321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.516332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.516339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:45.516351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.516368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:45.516393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:45.516590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.516600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.516618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:45.516692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 351 partition: 0 MaxSeqNo: 45 sessionId: src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0
2025-10-01T14:07:45.517128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb8822-5dedd048-ca9e9364-6a0cc857_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:45.519485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0] Write session: try to update token
2025-10-01T14:07:45.519502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:45.542330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 351 sessionId: src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:45.545012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:45.545282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.545307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.545348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:45.545541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:45.556552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:45.556572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:45.556575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:45.556576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:45.556586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254785823006479:4326]
2025-10-01T14:07:45.556591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254785823006479:4326]
2025-10-01T14:07:45.556595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254785823006479:4326]
2025-10-01T14:07:45.556645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:45.556651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.556655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:45.556674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:45.556680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:45.556684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:45.556799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:45.581559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254788199868219:4446]
2025-10-01T14:07:45.586450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 350, pipe: [1:7556254788199868219:4446]
2025-10-01T14:07:45.713003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:45.721890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.721926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.722109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.722203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.722269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.722337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.722745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.722761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.722835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.722897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.722966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.723072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.723121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.723125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.723195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.723251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.723312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.723379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.723425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.723428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.723495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.723559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.723630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.723735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.723786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.723789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.723858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.723918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.723979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.724047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.724112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.724115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.724184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.724245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.724305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.724367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.724408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.724410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.724478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.724538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.724607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.724669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.724828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.724833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.724892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.724948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.725009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.725075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.725115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.725118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.725185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.725243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.725298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.725361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.725410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.725412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.725491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.725553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.725614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.725679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.725724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.725727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.725834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199868219:4446], now have 1 active actors on pipe
2025-10-01T14:07:45.727090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:45.727101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0] Write session will restart in 0.007587s
2025-10-01T14:07:45.727126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0] Write session: Do CDS request
2025-10-01T14:07:45.727132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:45.726630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:45.726689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254788199868219:4446]
2025-10-01T14:07:45.726709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:45.726712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:45.726738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 351 reason: error at write: Disconnected sessionId: src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0
2025-10-01T14:07:45.726966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 351 sessionId: src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0 is DEAD
2025-10-01T14:07:45.727575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:45.736062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.736141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:45.736156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 352
2025-10-01T14:07:45.736264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.736295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:45.736301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:45.736309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:45.736741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 352 sessionId:  describe result for acl check
2025-10-01T14:07:45.736777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:45.736778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:45.736780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:45.736785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254788199868282:4762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:45.737297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254788199868282:4762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:45.739616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254788199868282:4762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:45.740871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:45.742823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:45.743101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:45.743113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:45.743128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:45.743181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254788199868282:4762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:45.743197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:45.743195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254788199868282:4762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:45.743198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254788199868282:4762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:45.743207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:45.743235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254785823006696:4341]
2025-10-01T14:07:45.743803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:45.744152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:45.744208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:45.744560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:45.744614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.744620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.744621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.744622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.744624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.744625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.744626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.744628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.744629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.744630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.744631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.744632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.744633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.744635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.744640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.744650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.744654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.744656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.744658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.744660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.744662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.744664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.744666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.744668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.744670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.744672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.744674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.744676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.744682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.744687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:45.744691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.744694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:45.744697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.744700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:45.744703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.744705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:45.744708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.744711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:45.744713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.744716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:45.744719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.744722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:45.744724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.744728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:45.744730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.744733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:45.744735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.744738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.744742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.744744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.744747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.744750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.744752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.744755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:45.744757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.744760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:45.744781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:45.748676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:45.749577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:45.749593Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:45.749596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:45.749599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:45.749606Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 351 [2:7556254785823006696:4341]
2025-10-01T14:07:45.749621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:45.749639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:45.749642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.749646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.749648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.749665Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:45.749670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:45.749676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:45.749730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.749737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.749738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.749742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:45.749744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:45.749807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:45.749814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.749824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:45.749834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:45.749851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:45.749872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199868402:4762], now have 1 active actors on pipe
2025-10-01T14:07:45.749879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199868229:2446], now have 1 active actors on pipe
2025-10-01T14:07:45.749887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254785823006691:4341]
2025-10-01T14:07:45.749889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254785823006691:4341]
2025-10-01T14:07:45.749891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254785823006691:4341]
2025-10-01T14:07:45.749905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:45.749918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:45.749932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:45.749941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:45.749974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254785823006691:4341]
2025-10-01T14:07:45.749981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:45.749973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 351
2025-10-01T14:07:45.749987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 351
2025-10-01T14:07:45.750002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:45.750013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:45.750015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:45.750021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:45.750111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.750120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.750148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:45.750157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:45.750161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:45.750163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:45.750174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:45.750188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:45.750203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:45.750363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.750386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.750409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:45.751113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 352 partition: 0 MaxSeqNo: 45 sessionId: src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0
2025-10-01T14:07:45.751508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8dc4460-51e4a587-b423e34b-c3dd836b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:45.753966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0] Write session: try to update token
2025-10-01T14:07:45.753984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:45.761329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:45.761344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:45.761353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254785823006691:4341]
2025-10-01T14:07:45.761392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:45.761399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:45.761566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:45.761712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:45.761995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:45.762145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:45.762352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:45.762409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:45.779771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 352 sessionId: src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:45.782566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:45.782863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.782883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.782922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:45.783055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:45.793328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:45.793351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:45.793354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:45.793356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:45.793367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254785823006691:4341]
2025-10-01T14:07:45.793370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254785823006691:4341]
2025-10-01T14:07:45.793374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254785823006691:4341]
2025-10-01T14:07:45.793416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:45.793423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:45.793430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:45.793430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:45.793432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:45.793434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:45.793568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:45.826866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254788199868413:4446]
2025-10-01T14:07:45.827161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 351, pipe: [1:7556254788199868413:4446]
2025-10-01T14:07:45.951353Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:45.962218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:45.962254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:45.962502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.962566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.962639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.962702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.962748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.962758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.962836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.962901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.962965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.963033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.963079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.963082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.963147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.963202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.963305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.963368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.963416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.963419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.963490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.963549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.963608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.963668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.963712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.963715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.963788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.963848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.963910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.963969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.964017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.964025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.964093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.964150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.964214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.964285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.964329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.964333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.964402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.964463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.964538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.964601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.964647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.964649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.964720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.964778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.964852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.964915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.964973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.964976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.965047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.965105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.965167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.965602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.965672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.965676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.965741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:45.965808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:45.965878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:45.965941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:45.965994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:45.965997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:45.966070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199868413:4446], now have 1 active actors on pipe
2025-10-01T14:07:45.968099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:45.968111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:45.968152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 352 reason: error at write: Disconnected sessionId: src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0
2025-10-01T14:07:45.968352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 352 sessionId: src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0 is DEAD
2025-10-01T14:07:45.968496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:45.968533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254788199868413:4446]
2025-10-01T14:07:45.970611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:45.970623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0] Write session will restart in 0.006585s
2025-10-01T14:07:45.970648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0] Write session: Do CDS request
2025-10-01T14:07:45.970654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:45.969210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:45.981316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.981755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:45.981769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 353
2025-10-01T14:07:45.982164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:45.982196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:45.982201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:45.982208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:45.988235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 353 sessionId:  describe result for acl check
2025-10-01T14:07:45.988280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:45.988284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:45.988289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:45.988296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254788199868434:4766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:45.988902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254788199868434:4766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:45.994111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254788199868434:4766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:46.006621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254788199868434:4766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:46.006639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254788199868434:4766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:46.006642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254788199868434:4766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:46.006652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:46.018277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:46.021696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:46.021941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:46.021946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:46.021958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:46.022008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:46.022047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254790117974173:4343]
2025-10-01T14:07:46.022635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:46.027306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:46.027395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:46.027801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:46.027854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.027855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.027857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.027859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.027860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.027861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.027863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.027864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.027865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.027866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.027868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.027869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.027870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.027871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.027878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.027889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.027893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.027897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.027900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.027904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.027908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.027911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.027915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.027919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.027923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.027926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.027930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.027933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.027941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.027950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.027956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.027961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.027966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.027971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.027976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.027981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.027986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.027992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.027996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.028001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.028005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.028011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.028015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.028021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.028025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.028033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.028037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.028042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.028046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.028052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.028056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.028061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.028066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.028070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.028074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.028079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.028121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:46.036246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:46.036989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:46.036995Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:46.036998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:46.037002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:46.037011Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 352 [2:7556254790117974173:4343]
2025-10-01T14:07:46.037030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:46.037051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:46.037054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.037058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.037061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.037081Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:46.037087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:46.037094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:46.037164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.037166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.037168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.037172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:46.037175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:46.037254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:46.037258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.037271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.037280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.037295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:46.037313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254790117974167:4343]
2025-10-01T14:07:46.037317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254790117974167:4343]
2025-10-01T14:07:46.037320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254790117974167:4343]
2025-10-01T14:07:46.037334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:46.037353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:46.037367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:46.037370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:46.037415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254790117974167:4343]
2025-10-01T14:07:46.037417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:46.037687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:46.037697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:46.037699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:46.037705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:46.038023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494835841:4766], now have 1 active actors on pipe
2025-10-01T14:07:46.038028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254788199868419:2446], now have 1 active actors on pipe
2025-10-01T14:07:46.038655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 352
2025-10-01T14:07:46.038687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 352
2025-10-01T14:07:46.042915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.042935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.042976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30153513-1278000-b0a88584-ce37e80e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:46.042989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.042995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.042999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:46.043013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.043031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:46.043053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:46.043638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.043650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.043671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:46.043823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 353 partition: 0 MaxSeqNo: 45 sessionId: src_id|30153513-1278000-b0a88584-ce37e80e_0
2025-10-01T14:07:46.046077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|991a85b9-e2e47555-59ee96fb-f5e9d874_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|30153513-1278000-b0a88584-ce37e80e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:46.049088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30153513-1278000-b0a88584-ce37e80e_0] Write session: try to update token
2025-10-01T14:07:46.049109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30153513-1278000-b0a88584-ce37e80e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:46.071108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254792494835896:4446]
2025-10-01T14:07:46.074005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494835896:4446], now have 1 active actors on pipe
2025-10-01T14:07:46.074173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 352, pipe: [1:7556254792494835896:4446]
2025-10-01T14:07:46.077700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 353 sessionId: src_id|30153513-1278000-b0a88584-ce37e80e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:46.080347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:46.086296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.086320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.086362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:46.086666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:46.132948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:46.132975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:46.132979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:46.132981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:46.132992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254790117974167:4343]
2025-10-01T14:07:46.132997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254790117974167:4343]
2025-10-01T14:07:46.133001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254790117974167:4343]
2025-10-01T14:07:46.133050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:46.133058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.133061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:46.133212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:46.134708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:46.134728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:46.134746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:46.380915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:46.390955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.390988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.391177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.391242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.391321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.391386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.391443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.391448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.391529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.391602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.391677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.391745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.391794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.391797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.391866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.391926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.391989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.392056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.392099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.392102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.392172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.392238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.392304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.392396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.392441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.392444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.392516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.392602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.392667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.392735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.392778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.392781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.392880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.392979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.393045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.393115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.393179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.393182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.393261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.393336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.393412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.393484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.393533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.393537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.393610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.393675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.393743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.393813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.393860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.393866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.393939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.394005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.394068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.394135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.394195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.394199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.394265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.394326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.394661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.394738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.394785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.394788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.398470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30153513-1278000-b0a88584-ce37e80e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:46.398483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30153513-1278000-b0a88584-ce37e80e_0] Write session will restart in 0.007948s
2025-10-01T14:07:46.398510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30153513-1278000-b0a88584-ce37e80e_0] Write session: Do CDS request
2025-10-01T14:07:46.398515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30153513-1278000-b0a88584-ce37e80e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:46.398710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:46.397007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254792494835896:4446]
2025-10-01T14:07:46.397037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:46.397039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:46.397066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 353 reason: error at write: Disconnected sessionId: src_id|30153513-1278000-b0a88584-ce37e80e_0
2025-10-01T14:07:46.397261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 353 sessionId: src_id|30153513-1278000-b0a88584-ce37e80e_0 is DEAD
2025-10-01T14:07:46.397398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:46.410868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30153513-1278000-b0a88584-ce37e80e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:46.411204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:46.411216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 354
2025-10-01T14:07:46.411381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:46.411410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:46.411415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:46.411418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:46.411811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 354 sessionId:  describe result for acl check
2025-10-01T14:07:46.411843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:46.411845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:46.411847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:46.411852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254792494835958:4779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:46.413707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254792494835958:4779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:46.422690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254792494835958:4779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:46.426643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254792494835958:4779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:46.426658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254792494835958:4779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:46.426661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254792494835958:4779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:46.426671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:46.429150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:46.429483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:46.429699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:46.429703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:46.429715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:46.429766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:46.429800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254790117974377:4349]
2025-10-01T14:07:46.430436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:46.431360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:46.431401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:46.431676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:46.431710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.431713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.431714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.431715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.431716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.431716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.431717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.431717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.431718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.431719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.431720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.431720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.431721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.431722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.431725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.431731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.431733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.431735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.431737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.431739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.431741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.431744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.431746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.431748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.431750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.431752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.431754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.431757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.431762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.431767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.431772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.431775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.431778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.431781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.431783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.431786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.431789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.431791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.431793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.431796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.431799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.431802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.431804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.431807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.431809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.431812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.431815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.431818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.431820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.431823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.431825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.431828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.431830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.431833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.431836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.431838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.431858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:46.435344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:46.435983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:46.436004Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:46.436006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:46.436009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:46.436015Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 353 [2:7556254790117974377:4349]
2025-10-01T14:07:46.436029Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:46.436047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:46.436054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.436058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.436060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.436076Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:46.436088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:46.436099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:46.436152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.436161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.436163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.436166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:46.436169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:46.436237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:46.436244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.436256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.436269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.436288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:46.436313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494836118:4779], now have 1 active actors on pipe
2025-10-01T14:07:46.436321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494835950:2446], now have 1 active actors on pipe
2025-10-01T14:07:46.436329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254790117974371:4349]
2025-10-01T14:07:46.436331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254790117974371:4349]
2025-10-01T14:07:46.436333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254790117974371:4349]
2025-10-01T14:07:46.436350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:46.436365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:46.436369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:46.436370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:46.436371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:46.436384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:46.436386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:46.436418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254790117974371:4349]
2025-10-01T14:07:46.436432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:46.436446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:46.436463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.436468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.436498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:46.436505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.436510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.436512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:46.436521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.436531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:46.436545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:46.436402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 353
2025-10-01T14:07:46.436430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 353
2025-10-01T14:07:46.436703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.436714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.436730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:46.436871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 354 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0
2025-10-01T14:07:46.437246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30153513-1278000-b0a88584-ce37e80e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:46.439785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0] Write session: try to update token
2025-10-01T14:07:46.439806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:46.447914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:46.447935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:46.447945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254790117974371:4349]
2025-10-01T14:07:46.447995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:46.448180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:46.448323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:46.448484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:46.448632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:46.448869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:46.448912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:46.448989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:46.457162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 354 sessionId: src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:46.459725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:46.459969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.459992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.460038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:46.460154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:46.475912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:46.475936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:46.475938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:46.475941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:46.475953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254790117974371:4349]
2025-10-01T14:07:46.475957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254790117974371:4349]
2025-10-01T14:07:46.475961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254790117974371:4349]
2025-10-01T14:07:46.476013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:46.476021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.476023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:46.476028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:46.476034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:46.476037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:46.476161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:46.497552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254792494836133:4446]
2025-10-01T14:07:46.498002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 353, pipe: [1:7556254792494836133:4446]
2025-10-01T14:07:46.703813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:46.712354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.712383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.712557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.712616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.712681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.712741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.712783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.712787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.712871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.712929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.712988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.713050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.713089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.713092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.713153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.713203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.713256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.713309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.713350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.713352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.713479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.713537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.713592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.713643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.713680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.713682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.713745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.713798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.713860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.713918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.713956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.713959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.714021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.714072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.714131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.714187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.714228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.714232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.714297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.714350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.714601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.714666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.714795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.714798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.714862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.714915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.714971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.715028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.715085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.715087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.715149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.715200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.715256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.715309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.715350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.715355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.715502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:46.715552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:46.715604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:46.715656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:46.715697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:46.715700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:46.715771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494836133:4446], now have 1 active actors on pipe
2025-10-01T14:07:46.717223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254792494836133:4446]
2025-10-01T14:07:46.717258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:46.717260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:46.717288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 354 reason: error at write: Disconnected sessionId: src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0
2025-10-01T14:07:46.717466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 354 sessionId: src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0 is DEAD
2025-10-01T14:07:46.717539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:46.717158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:46.717813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:46.717826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0] Write session will restart in 0.007868s
2025-10-01T14:07:46.717851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0] Write session: Do CDS request
2025-10-01T14:07:46.717868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:46.727297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:46.730606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:46.730621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 355
2025-10-01T14:07:46.730807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:46.730837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:46.730843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:46.730846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:46.731971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 355 sessionId:  describe result for acl check
2025-10-01T14:07:46.732004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:46.732006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:46.732008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:46.732013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254792494836166:4784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:46.732503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254792494836166:4784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:46.740900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:46.743208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:46.748610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254792494836166:4784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:46.743470Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:46.743482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:46.743499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:46.743559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:46.743655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254790117974588:4362]
2025-10-01T14:07:46.744280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:46.744667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:46.744721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:46.745217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:46.745285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.745286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.745287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.745289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.745290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.745291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.745293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.745294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.745295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.745296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.745297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.745298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.745300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.745301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.745308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.745319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.745323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.745327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.745332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.745336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.745340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.745344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.745348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.745353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.745356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.745360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.745364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.745368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.745377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.745388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.745395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.745402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.745406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.745413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.745417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.745423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.745428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.745433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.745438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.745444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.745450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.745455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.745459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.745464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.745470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.745475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.745480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.745486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.745490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.745496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.745500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.745506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.745510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.745516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.745522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.745526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.745567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:46.753037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 354
2025-10-01T14:07:46.750351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:46.751543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:46.751549Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:46.751551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:46.751555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:46.751562Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 354 [2:7556254790117974588:4362]
2025-10-01T14:07:46.751580Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:46.751598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:46.751601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.751605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.751607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.751624Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:46.751629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:46.751638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:46.751696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.751698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.751700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.751703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:46.751706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:46.751781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:46.751783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.751796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.751807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.751821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:46.751838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254790117974583:4362]
2025-10-01T14:07:46.751841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254790117974583:4362]
2025-10-01T14:07:46.751843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254790117974583:4362]
2025-10-01T14:07:46.751852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:46.751864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:46.751878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:46.751880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:46.751920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254790117974583:4362]
2025-10-01T14:07:46.751923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:46.752511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:46.752513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:46.752515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:46.752520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:46.752796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494836142:2446], now have 1 active actors on pipe
2025-10-01T14:07:46.759560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494836322:4784], now have 1 active actors on pipe
2025-10-01T14:07:46.759681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.759692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.759735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81377501-325224e2-776eed35-3e24c23a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:46.759746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.759752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.759755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:46.759768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.759786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:46.759820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:46.760078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.760100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.760125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:46.760853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e7cab8e-d5d52d90-a9f2be01-91b1c4f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|81377501-325224e2-776eed35-3e24c23a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:46.759203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254792494836166:4784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:46.759229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254792494836166:4784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:46.759232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254792494836166:4784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:46.759241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:46.759612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 354
2025-10-01T14:07:46.760492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 355 partition: 0 MaxSeqNo: 45 sessionId: src_id|81377501-325224e2-776eed35-3e24c23a_0
2025-10-01T14:07:46.763450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81377501-325224e2-776eed35-3e24c23a_0] Write session: try to update token
2025-10-01T14:07:46.763467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81377501-325224e2-776eed35-3e24c23a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:46.776510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:46.776533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:46.776536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:46.776538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:46.776547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254790117974583:4362]
2025-10-01T14:07:46.776553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254790117974583:4362]
2025-10-01T14:07:46.776557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254790117974583:4362]
2025-10-01T14:07:46.776610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:46.776620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.776623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:46.776762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:46.777625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:46.777654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:46.777659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:46.792164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 355 sessionId: src_id|81377501-325224e2-776eed35-3e24c23a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:46.795249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:46.817602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254792494836327:4446]
2025-10-01T14:07:46.818154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 354, pipe: [1:7556254792494836327:4446]
2025-10-01T14:07:46.936069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:46.936405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.936415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.936438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494836327:4446], now have 1 active actors on pipe
2025-10-01T14:07:46.936779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:46.936834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254792494836327:4446]
2025-10-01T14:07:46.936867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:46.936901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:46.936970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 355 reason: status is not ok: tablet will be restarted right now sessionId: src_id|81377501-325224e2-776eed35-3e24c23a_0
2025-10-01T14:07:46.937314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81377501-325224e2-776eed35-3e24c23a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:46.937325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81377501-325224e2-776eed35-3e24c23a_0] Write session will restart in 0.008031s
2025-10-01T14:07:46.937349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81377501-325224e2-776eed35-3e24c23a_0] Write session: Do CDS request
2025-10-01T14:07:46.937355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81377501-325224e2-776eed35-3e24c23a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:46.937181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 355 sessionId: src_id|81377501-325224e2-776eed35-3e24c23a_0 is DEAD
2025-10-01T14:07:46.946829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81377501-325224e2-776eed35-3e24c23a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:46.946900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:46.946913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 356
2025-10-01T14:07:46.947085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:46.947136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:46.947146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:46.947149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:46.947477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 356 sessionId:  describe result for acl check
2025-10-01T14:07:46.947522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:46.947529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:46.947530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:46.947536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254792494836428:4788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:46.948031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254792494836428:4788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:46.949988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254792494836428:4788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:46.953493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:46.954027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:46.954237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:46.954248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:46.954259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:46.954327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:46.954397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254790117974770:4364]
2025-10-01T14:07:46.954962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254792494836428:4788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:46.954976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254792494836428:4788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:46.954980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254792494836428:4788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:46.954989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:46.955058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:46.955370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:46.955418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:46.955712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:46.955756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.955757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.955759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.955760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.955761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.955762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.955763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.955764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.955765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.955766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.955767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.955768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.955769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.955770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.955775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.955784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.955788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.955792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.955795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.955798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.955802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.955805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.955808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.955812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.955816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.955819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.955822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.955826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.955833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.955840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:46.955845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.955852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:46.955858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.955863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:46.955867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.955871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:46.955875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.955879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:46.955883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.955888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:46.955891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.955896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:46.955899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.955904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:46.955907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.955912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:46.955915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.955920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.955924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.955928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.955931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.955936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.955939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.955944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:46.955948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.955952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:46.955985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:46.961115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 355
2025-10-01T14:07:46.961142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 355
2025-10-01T14:07:46.960129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:46.960721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:46.960726Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:46.960728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:46.960732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:46.960739Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 355 [2:7556254790117974770:4364]
2025-10-01T14:07:46.960755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:46.960771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:46.960774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.960777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.960779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.960794Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:46.960799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:46.960817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:46.960867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.960869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.960873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.960877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:46.960879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:46.960950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:46.960953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.960963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:46.960973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:46.960987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:46.961003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254790117974765:4364]
2025-10-01T14:07:46.961005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254790117974765:4364]
2025-10-01T14:07:46.961007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254790117974765:4364]
2025-10-01T14:07:46.961016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:46.961025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:46.961028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:46.961029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:46.961031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:46.961041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:46.961044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:46.961053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494836506:4788], now have 1 active actors on pipe
2025-10-01T14:07:46.961056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254792494836329:2446], now have 1 active actors on pipe
2025-10-01T14:07:46.961085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254790117974765:4364]
2025-10-01T14:07:46.961093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:46.961103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:46.961318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.961328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.961374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:46.961382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:46.961386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:46.961389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:46.961398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:46.961409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:46.961439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:46.961785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.961798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.961815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:46.961928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 356 partition: 0 MaxSeqNo: 45 sessionId: src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0
2025-10-01T14:07:46.962282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81377501-325224e2-776eed35-3e24c23a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:46.964776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0] Write session: try to update token
2025-10-01T14:07:46.964795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:46.978878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 356 sessionId: src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:46.981405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:46.981635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:46.981658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:46.981702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:46.981801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:46.993724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:46.993747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:46.993750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:46.993752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:46.993762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254790117974765:4364]
2025-10-01T14:07:46.993766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254790117974765:4364]
2025-10-01T14:07:46.993770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254790117974765:4364]
2025-10-01T14:07:46.993824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:46.993823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:46.993830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:46.993831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:46.993833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:46.993834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:46.993964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:47.038522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254796789803818:4446]
2025-10-01T14:07:47.038958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 355, pipe: [1:7556254796789803818:4446]
2025-10-01T14:07:47.157571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:47.166663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.166695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.166907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.166978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.167045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.167107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.167152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.167157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.167248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.167307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.167367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.167430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.167522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.167525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.167590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.167655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.167712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.167764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.167806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.167808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.167866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.167918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.167966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.168018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.168112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.168114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.168185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.168250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.168303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.168352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.168391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.168392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.168481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.168531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.168582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.168634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.168671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.168673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.168740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.168795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.168862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.168916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.168961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.168963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.169025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.169079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.169135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.169191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.169240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.169243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.169310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.170252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:47.170265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:47.170293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 356 reason: error at write: Disconnected sessionId: src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0
2025-10-01T14:07:47.170496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 356 sessionId: src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0 is DEAD
2025-10-01T14:07:47.170605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:47.170642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254796789803818:4446]
2025-10-01T14:07:47.173410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:47.173424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0] Write session will restart in 0.006404s
2025-10-01T14:07:47.173451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0] Write session: Do CDS request
2025-10-01T14:07:47.173457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:47.169370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.169427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.169479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.169517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.169519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.169584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.169638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.169696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.169766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.169813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.169816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.169906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789803818:4446], now have 1 active actors on pipe
2025-10-01T14:07:47.170189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:47.181341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:47.181449Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:47.181461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 357
2025-10-01T14:07:47.181703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:47.181759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:47.181769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:47.181773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:47.182626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 357 sessionId:  describe result for acl check
2025-10-01T14:07:47.182663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:47.182669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:47.182672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:47.182677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254796789803862:4796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:47.183211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254796789803862:4796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:47.188222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254796789803862:4796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:47.190657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254796789803862:4796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:47.190666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254796789803862:4796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:47.190668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254796789803862:4796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:47.190674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:47.193821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:47.195806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:47.195974Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:47.195978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:47.195986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:47.196026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:47.196052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254794412942262:4367]
2025-10-01T14:07:47.196467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:47.196779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:47.196821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:47.197054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:47.197087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.197088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.197089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.197090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.197090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.197091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.197092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.197093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.197094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.197095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.197095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.197096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.197097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.197097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.197102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.197108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.197110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.197112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.197114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.197116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.197119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.197121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.197123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.197125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.197127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.197129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.197132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.197134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.197140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.197145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.197149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.197152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.197155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.197158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.197160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.197163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.197166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.197169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.197171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.197174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.197177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.197181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.197185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.197189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.197194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.197199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.197205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.197210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.197214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.197219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.197223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.197226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.197228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.197231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.197234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.197237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.197259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:47.202235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 356
2025-10-01T14:07:47.202280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 356
2025-10-01T14:07:47.201302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:47.201898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:47.201902Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:47.201905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:47.201908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:47.201914Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 356 [2:7556254794412942262:4367]
2025-10-01T14:07:47.201926Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:47.201941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:47.201943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.201945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.201946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.201960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:47.201964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:47.201971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:47.202014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.202015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.202017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.202020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:47.202022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:47.202096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:47.202099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.202110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.202120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.202133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:47.202155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789803835:2446], now have 1 active actors on pipe
2025-10-01T14:07:47.202157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804000:4796], now have 1 active actors on pipe
2025-10-01T14:07:47.202165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254794412942257:4367]
2025-10-01T14:07:47.202167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254794412942257:4367]
2025-10-01T14:07:47.202169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254794412942257:4367]
2025-10-01T14:07:47.202177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:47.202182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:47.202184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:47.202186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:47.202190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:47.202203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:47.202206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:47.202237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254794412942257:4367]
2025-10-01T14:07:47.202245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:47.202314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:47.202496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.202508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.202535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:47.202542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.202546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.202548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:47.202555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.202564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:47.202579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:47.203052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.203061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.203080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:47.203216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 357 partition: 0 MaxSeqNo: 45 sessionId: src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0
2025-10-01T14:07:47.203609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|700aa154-b3bab7e9-7a25b1e9-e9a37b56_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:47.206213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0] Write session: try to update token
2025-10-01T14:07:47.206231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:47.225479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 357 sessionId: src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:47.224053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:47.224075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:47.224078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:47.224080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:47.224090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254794412942257:4367]
2025-10-01T14:07:47.224094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254794412942257:4367]
2025-10-01T14:07:47.224098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254794412942257:4367]
2025-10-01T14:07:47.224148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:47.224151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:47.224155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:47.224158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.224158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:47.224161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:47.224303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:47.228179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:47.270699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254796789804030:4446]
2025-10-01T14:07:47.270950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 356, pipe: [1:7556254796789804030:4446]
2025-10-01T14:07:47.379458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:47.380329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.380668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:47.380678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254796789804030:4446]
2025-10-01T14:07:47.380703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:47.380705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:47.380760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 357 reason: error at write: Disconnected sessionId: src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0
2025-10-01T14:07:47.380952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 357 sessionId: src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0 is DEAD
2025-10-01T14:07:47.380351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.380392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804030:4446], now have 1 active actors on pipe
2025-10-01T14:07:47.380747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:47.381273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:47.381292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0] Write session will restart in 0.007646s
2025-10-01T14:07:47.381325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0] Write session: Do CDS request
2025-10-01T14:07:47.381330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:47.390741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:47.391084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:47.391098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 358
2025-10-01T14:07:47.392383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:47.392420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:47.392424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:47.392427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:47.392977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 358 sessionId:  describe result for acl check
2025-10-01T14:07:47.393008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:47.393009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:47.393011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:47.393018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254796789804078:4806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:47.393477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254796789804078:4806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:47.396334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254796789804078:4806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:47.402012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:47.402474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:47.402642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:47.402646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:47.402656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:47.402694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:47.402728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254794412942446:4370]
2025-10-01T14:07:47.403339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:47.405045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254796789804078:4806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:47.405059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254796789804078:4806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:47.405064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254796789804078:4806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:47.405073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:47.404960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:47.405007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:47.405331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:47.405374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.405375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.405377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.405378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.405379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.405380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.405381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.405383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.405384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.405385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.405386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.405388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.405389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.405390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.405396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.405406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.405410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.405414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.405418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.405422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.405426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.405430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.405433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.405438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.405442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.405446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.405450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.405454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.405460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.405467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.405474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.405479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.405484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.405489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.405492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.405498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.405502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.405507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.405511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.405516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.405522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.405527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.405531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.405537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.405542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.405547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.405551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.405556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.405561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.405566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.405570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.405575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.405579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.405585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.405589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.405594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.405635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:47.412184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 357
2025-10-01T14:07:47.412211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 357
2025-10-01T14:07:47.410803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:47.411506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:47.411511Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:47.411513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:47.411516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:47.411522Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 357 [2:7556254794412942446:4370]
2025-10-01T14:07:47.411536Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:47.411550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:47.411551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.411554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.411555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.411568Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:47.411571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:47.411576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:47.411618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.411619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.411620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.411623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:47.411624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:47.411681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:47.411682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.411690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.411695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.411704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:47.411716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254794412942440:4370]
2025-10-01T14:07:47.411719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254794412942440:4370]
2025-10-01T14:07:47.411720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254794412942440:4370]
2025-10-01T14:07:47.411733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:47.411744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:47.411752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:47.411754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:47.411765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:47.411768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:47.411769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:47.412001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254794412942440:4370]
2025-10-01T14:07:47.412007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:47.412014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:47.412024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804226:4806], now have 1 active actors on pipe
2025-10-01T14:07:47.412027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804033:2446], now have 1 active actors on pipe
2025-10-01T14:07:47.412406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.412413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.412435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:47.412441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.412446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.412448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:47.412455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.412465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:47.412477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:47.412634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.412643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.412652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:47.412738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 358 partition: 0 MaxSeqNo: 45 sessionId: src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0
2025-10-01T14:07:47.414558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|772c96-6c1816f0-b0cd1ff3-53a289be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:47.417183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0] Write session: try to update token
2025-10-01T14:07:47.417204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:47.443008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 358 sessionId: src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:47.445397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:47.450446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.450473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.450517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:47.450830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:47.458542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:47.458568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:47.458571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:47.458573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:47.458588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254794412942440:4370]
2025-10-01T14:07:47.458594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254794412942440:4370]
2025-10-01T14:07:47.458599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254794412942440:4370]
2025-10-01T14:07:47.458659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:47.458662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:47.458667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:47.458671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:47.458671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.458674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:47.458859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:47.479080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254796789804245:4446]
2025-10-01T14:07:47.483107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 357, pipe: [1:7556254796789804245:4446]
2025-10-01T14:07:47.638954Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:47.639246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804245:4446], now have 1 active actors on pipe
2025-10-01T14:07:47.646927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.646957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.647109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.647181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.647251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.647321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.647373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.647383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.647453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.647518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.647585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.647657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.647700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.647708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.647773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.647827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.647889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.647945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.647989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.647992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.648049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.648110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.648160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.648215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.648258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.648261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.648319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.648369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.648432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.648490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.648531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.648539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.648595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.648648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.648711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.648771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.648829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.648837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.648898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.648955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.649012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.649069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.649188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.649196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.649256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.649315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.649372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.649432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.649478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.649485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.649547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.649611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.649671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.649734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.649780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.649787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.649851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.649911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.649974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.650033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.650079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.650086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.650307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:47.650314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254796789804245:4446]
2025-10-01T14:07:47.650316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:47.650337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 358 reason: error at write: Disconnected sessionId: src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0
2025-10-01T14:07:47.650348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:47.650527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 358 sessionId: src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0 is DEAD
2025-10-01T14:07:47.650645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:47.650655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0] Write session will restart in 0.008125s
2025-10-01T14:07:47.650679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0] Write session: Do CDS request
2025-10-01T14:07:47.650685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:47.651188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:47.659949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:47.660066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:47.660079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 359
2025-10-01T14:07:47.660246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:47.660281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:47.660287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:47.660291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:47.660972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 359 sessionId:  describe result for acl check
2025-10-01T14:07:47.661011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:47.661013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:47.661014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:47.661020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254796789804283:4812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:47.661503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254796789804283:4812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:47.664650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254796789804283:4812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:47.668692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254796789804283:4812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:47.668708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254796789804283:4812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:47.668712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254796789804283:4812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:47.668721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:47.668599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:47.671347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:47.671605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:47.671619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:47.671632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:47.671699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:47.671743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254794412942655:4381]
2025-10-01T14:07:47.672348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:47.672783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:47.672851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:47.673191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:47.673263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.673269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.673271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.673272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.673273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.673274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.673275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.673276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.673277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.673279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.673280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.673281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.673282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.673283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.673289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.673299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.673303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.673307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.673310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.673314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.673318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.673321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.673325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.673329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.673333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.673336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.673340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.673343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.673351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.673359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.673366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.673371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.673376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.673382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.673387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.673391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.673396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.673401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.673405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.673411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.673421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.673426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.673430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.673435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.673439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.673444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.673453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.673458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.673463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.673468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.673472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.673481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.673486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.673491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.673498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.673503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.673543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:47.678149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:47.678811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:47.678831Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:47.678833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:47.678836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:47.678845Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 358 [2:7556254794412942655:4381]
2025-10-01T14:07:47.678862Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:47.678880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:47.678889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.678892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.678894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.678910Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:47.678915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:47.678922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:47.678982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.678990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.678992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.678995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:47.678998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:47.679079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:47.679091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.679102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.679113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.679130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:47.679152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804428:4812], now have 1 active actors on pipe
2025-10-01T14:07:47.679162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804250:2446], now have 1 active actors on pipe
2025-10-01T14:07:47.679170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254794412942649:4381]
2025-10-01T14:07:47.679172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254794412942649:4381]
2025-10-01T14:07:47.679174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254794412942649:4381]
2025-10-01T14:07:47.679189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:47.679205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:47.679205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:47.679207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:47.679210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:47.679220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:47.679223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:47.679231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 358
2025-10-01T14:07:47.679263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 358
2025-10-01T14:07:47.679261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254794412942649:4381]
2025-10-01T14:07:47.679277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:47.679297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:47.679445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.679457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.679485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:47.679498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.679503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.679505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:47.679515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.679526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:47.679547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:47.679748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.679757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.679775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:47.679873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 359 partition: 0 MaxSeqNo: 45 sessionId: src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0
2025-10-01T14:07:47.680227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c293600-f04f94b9-b49e53d2-375ad5c3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:47.682857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0] Write session: try to update token
2025-10-01T14:07:47.682873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:47.700354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 359 sessionId: src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:47.703554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:47.704917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.704945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.704970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:47.704973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:47.704981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254794412942649:4381]
2025-10-01T14:07:47.705024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:47.705036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:47.705208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:47.705343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:47.705480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:47.705621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:47.705822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:47.705864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:47.705890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:47.706023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:47.718179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:47.718202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:47.718205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:47.718207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:47.718218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254794412942649:4381]
2025-10-01T14:07:47.718222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254794412942649:4381]
2025-10-01T14:07:47.718226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254794412942649:4381]
2025-10-01T14:07:47.718277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:47.718282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:47.718291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.718293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:47.718294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:47.718297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:47.718447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:47.750449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254796789804442:4446]
2025-10-01T14:07:47.750765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 358, pipe: [1:7556254796789804442:4446]
2025-10-01T14:07:47.883599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:47.891812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.891845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.892029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.892092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.892158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.892223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.892270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.892274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.892349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.892408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.892470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.892543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.892584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.892587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.892651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.892705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.892770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.892844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.892886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.892889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.892954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.893011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.893072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.893130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.893177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.893180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.893257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.893318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.893381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.893481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.893530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.893533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.893606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.893663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.893723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.893787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.893835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.893838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.893907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.893969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.894038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.894104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.894198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.894204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.894277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.894337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.894629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.894708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.894759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.894762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.894833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.894897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.894967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.895034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.895079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.895082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.895158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:47.895220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:47.895280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:47.895353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:47.895396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:47.895399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:47.895472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804442:4446], now have 1 active actors on pipe
2025-10-01T14:07:47.896833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:47.897488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:47.897544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254796789804442:4446]
2025-10-01T14:07:47.897567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:47.897609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 359 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0
2025-10-01T14:07:47.897842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 359 sessionId: src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0 is DEAD
2025-10-01T14:07:47.898480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:47.898491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0] Write session will restart in 0.008049s
2025-10-01T14:07:47.898516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0] Write session: Do CDS request
2025-10-01T14:07:47.898522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:47.907922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:47.910587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:47.910600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 360
2025-10-01T14:07:47.910759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:47.910786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:47.910792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:47.910796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:47.911156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 360 sessionId:  describe result for acl check
2025-10-01T14:07:47.911192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:47.911193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:47.911195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:47.911200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254796789804579:4816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:47.911690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254796789804579:4816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:47.914682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254796789804579:4816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:47.919256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:47.922037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:47.922361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:47.922386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:47.922404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:47.922477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:47.922520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254794412942855:4387]
2025-10-01T14:07:47.923159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:47.923505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:47.923575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:47.923931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:47.923989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.923997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.923999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.924000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.924001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.924002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.924003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.924005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.924006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.924008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.924009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.924010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.924011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.924012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.924019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.924028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.924033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.924037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.924041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.924046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.924049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.924053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.924058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.924063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.924067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.924071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.924075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.924080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.924089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.924097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:47.924105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.924117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:47.924123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.924128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:47.924133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.924138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:47.924143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.924148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:47.924152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.924158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:47.924163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.924168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:47.924172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.924177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:47.924182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.924187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:47.924192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.924197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.924202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.924207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.924211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.924217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.924221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.924226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:47.924236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.924241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:47.924288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:47.931897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:47.932506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:47.932525Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:47.932527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:47.932530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:47.932536Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 359 [2:7556254794412942855:4387]
2025-10-01T14:07:47.932550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:47.932567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:47.932569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.932572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.932573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.932586Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:47.932590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:47.932595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:47.932640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.932647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.932649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.932654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:47.932656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:47.932723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:47.932734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.932746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:47.932755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:47.932769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:47.932788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254794412942850:4387]
2025-10-01T14:07:47.932791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254794412942850:4387]
2025-10-01T14:07:47.932793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254794412942850:4387]
2025-10-01T14:07:47.932801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:47.932820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:47.932822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:47.932824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:47.932827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:47.932841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:47.932844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:47.932857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804445:2446], now have 1 active actors on pipe
2025-10-01T14:07:47.932897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254794412942850:4387]
2025-10-01T14:07:47.932904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:47.932934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:47.932967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 359
2025-10-01T14:07:47.940104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254796789804579:4816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:47.940120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254796789804579:4816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:47.940124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254796789804579:4816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:47.940134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:47.940679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804633:4816], now have 1 active actors on pipe
2025-10-01T14:07:47.940752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 359
2025-10-01T14:07:47.940832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.940844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.940871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59f32f7b-e65a775e-738189ef-a1542787_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:47.940886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:47.940896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:47.940899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:47.940911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:47.940928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:47.940953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:47.941194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:47.941207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:47.941228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:47.941355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 360 partition: 0 MaxSeqNo: 45 sessionId: src_id|59f32f7b-e65a775e-738189ef-a1542787_0
2025-10-01T14:07:47.941720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e9fa511-a3c152c6-29a8d6c7-443986a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|59f32f7b-e65a775e-738189ef-a1542787_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:47.944139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f32f7b-e65a775e-738189ef-a1542787_0] Write session: try to update token
2025-10-01T14:07:47.944157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f32f7b-e65a775e-738189ef-a1542787_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:47.960596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 360 sessionId: src_id|59f32f7b-e65a775e-738189ef-a1542787_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:47.960944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:47.960969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:47.960972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:47.960973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:47.960983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254794412942850:4387]
2025-10-01T14:07:47.960988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254794412942850:4387]
2025-10-01T14:07:47.960991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254794412942850:4387]
2025-10-01T14:07:47.961029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:47.961041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:47.961042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:47.961046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:47.961048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:47.961050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:47.961186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:47.963399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:47.997744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254796789804637:4446]
2025-10-01T14:07:47.998003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 359, pipe: [1:7556254796789804637:4446]
2025-10-01T14:07:48.112633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:48.113158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.113175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.113219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254796789804637:4446], now have 1 active actors on pipe
2025-10-01T14:07:48.113425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:48.113500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254796789804637:4446]
2025-10-01T14:07:48.113530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:48.113575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:48.113647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 360 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59f32f7b-e65a775e-738189ef-a1542787_0
2025-10-01T14:07:48.113880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 360 sessionId: src_id|59f32f7b-e65a775e-738189ef-a1542787_0 is DEAD
2025-10-01T14:07:48.114563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f32f7b-e65a775e-738189ef-a1542787_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:48.114576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f32f7b-e65a775e-738189ef-a1542787_0] Write session will restart in 0.009140s
2025-10-01T14:07:48.114612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f32f7b-e65a775e-738189ef-a1542787_0] Write session: Do CDS request
2025-10-01T14:07:48.114619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f32f7b-e65a775e-738189ef-a1542787_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:48.124931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59f32f7b-e65a775e-738189ef-a1542787_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:48.125033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:48.125047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 361
2025-10-01T14:07:48.125420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:48.125461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:48.125466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:48.125471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:48.125878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 361 sessionId:  describe result for acl check
2025-10-01T14:07:48.125912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:48.125919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:48.125921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:48.125926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254801084771961:4821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:48.126409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254801084771961:4821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:48.129126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254801084771961:4821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:48.131663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254801084771961:4821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:48.131674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254801084771961:4821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:48.131676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254801084771961:4821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:48.131685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:48.138854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:48.140745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:48.140956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:48.140975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:48.140987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:48.141033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:48.141072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254798707910351:4390]
2025-10-01T14:07:48.141713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:48.141990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:48.142035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:48.142307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:48.142359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.142366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.142367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.142379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.142381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.142382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.142383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.142385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.142386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.142387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.142388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.142390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.142391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.142392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.142397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.142406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.142409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.142413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.142416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.142420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.142424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.142427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.142430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.142435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.142438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.142442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.142445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.142449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.142455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.142464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.142469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.142472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.142475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.142484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.142486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.142489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.142492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.142495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.142498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.142501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.142505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.142510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.142514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.142517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.142523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.142532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.142537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.142541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.142550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.142555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.142564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.142568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.142572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.142578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.142582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.142586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.142622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:48.146882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:48.147600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:48.147617Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:48.147621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:48.147625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:48.147632Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 360 [2:7556254798707910351:4390]
2025-10-01T14:07:48.147647Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:48.147662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:48.147664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.147667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.147668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.147683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:48.147691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:48.147696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:48.147737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.147747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.147749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.147752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:48.147755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:48.147825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:48.147834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.147845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.147856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.147874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:48.147899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772050:4821], now have 1 active actors on pipe
2025-10-01T14:07:48.147902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084771936:2446], now have 1 active actors on pipe
2025-10-01T14:07:48.147911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254798707910346:4390]
2025-10-01T14:07:48.147913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254798707910346:4390]
2025-10-01T14:07:48.147915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254798707910346:4390]
2025-10-01T14:07:48.147929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:48.147943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:48.147943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:48.147947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:48.147949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:48.147960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:48.147963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:48.148003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254798707910346:4390]
2025-10-01T14:07:48.148013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:48.148019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:48.148388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 360
2025-10-01T14:07:48.148414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 360
2025-10-01T14:07:48.148475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.148486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.148519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:48.148532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.148540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.148542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:48.148552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.148566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:48.148587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:48.148837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.148859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.148883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:48.149494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59f32f7b-e65a775e-738189ef-a1542787_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:48.149080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 361 partition: 0 MaxSeqNo: 45 sessionId: src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0
2025-10-01T14:07:48.152124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0] Write session: try to update token
2025-10-01T14:07:48.152142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:48.166818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 361 sessionId: src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:48.169420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:48.171337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.171361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.171380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:48.171383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:48.171384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:48.171385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:48.171391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254798707910346:4390]
2025-10-01T14:07:48.171395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254798707910346:4390]
2025-10-01T14:07:48.171398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254798707910346:4390]
2025-10-01T14:07:48.171432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:48.171448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:48.171451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:48.171454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:48.171461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.171464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:48.171599Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:48.214611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254801084772149:4446]
2025-10-01T14:07:48.215465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 360, pipe: [1:7556254801084772149:4446]
2025-10-01T14:07:48.338158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:48.338479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:48.338542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772149:4446], now have 1 active actors on pipe
2025-10-01T14:07:48.346810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:48.346928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:48.346931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:48.347009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 361 reason: error at write: Disconnected sessionId: src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0
2025-10-01T14:07:48.347049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:48.347109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254801084772149:4446]
2025-10-01T14:07:48.347153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 361 sessionId: src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0 is DEAD
2025-10-01T14:07:48.347646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:48.347654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0] Write session will restart in 0.009729s
2025-10-01T14:07:48.347678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0] Write session: Do CDS request
2025-10-01T14:07:48.347687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:48.360500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:48.361137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:48.361157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 362
2025-10-01T14:07:48.361293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:48.361325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:48.361334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:48.361339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:48.362365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 362 sessionId:  describe result for acl check
2025-10-01T14:07:48.362424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:48.362426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:48.362428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:48.362435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254801084772179:4826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:48.362932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254801084772179:4826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:48.374486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254801084772179:4826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:48.401464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254801084772179:4826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:48.401482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254801084772179:4826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:48.401486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254801084772179:4826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:48.401494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:48.403246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:48.407154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:48.407441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:48.407446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:48.407458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:48.407514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:48.407556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254798707910541:4393]
2025-10-01T14:07:48.408268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:48.409297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:48.409360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:48.409925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:48.409979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.409981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.409982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.409984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.409985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.409986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.409988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.409989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.409990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.409991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.409993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.409994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.409995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.409997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.410003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.410013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.410018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.410022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.410025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.410029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.410033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.410037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.410041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.410045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.410049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.410053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.410057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.410061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.410069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.410077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.410083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.410089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.410094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.410100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.410104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.410109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.410114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.410119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.410124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.410130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.410135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.410141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.410146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.410151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.410157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.410162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.410167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.410173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.410178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.410183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.410189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.410196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.410201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.410207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.410212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.410217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.410259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:48.419085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:48.419751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:48.419757Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:48.419760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:48.419765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:48.419773Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 361 [2:7556254798707910541:4393]
2025-10-01T14:07:48.419791Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:48.419810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:48.419814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.419819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.419822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.419841Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:48.419847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:48.419854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:48.419921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.419924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.419926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.419930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:48.419934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:48.420009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:48.420012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.420025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.420037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.420054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:48.420072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254798707910535:4393]
2025-10-01T14:07:48.420074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254798707910535:4393]
2025-10-01T14:07:48.420076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254798707910535:4393]
2025-10-01T14:07:48.420090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:48.420106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:48.420121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:48.420124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:48.420165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254798707910535:4393]
2025-10-01T14:07:48.420168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:48.422444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:48.422460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:48.422462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:48.422469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:48.423130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 361
2025-10-01T14:07:48.423167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 361
2025-10-01T14:07:48.422778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772154:2446], now have 1 active actors on pipe
2025-10-01T14:07:48.422787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772336:4826], now have 1 active actors on pipe
2025-10-01T14:07:48.426406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.426427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.426461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:48.426471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.426476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.426479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:48.426493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.426511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:48.426531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:48.430537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.430557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.430601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:48.434824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 362 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0
2025-10-01T14:07:48.435307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ed8af2-da227eef-b8dd3153-670a3cb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:48.438221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0] Write session: try to update token
2025-10-01T14:07:48.438244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:48.446996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254801084772353:4446]
2025-10-01T14:07:48.448351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772353:4446], now have 1 active actors on pipe
2025-10-01T14:07:48.447993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 361, pipe: [1:7556254801084772353:4446]
2025-10-01T14:07:48.468889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:48.468912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:48.468914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:48.468917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:48.468927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254798707910535:4393]
2025-10-01T14:07:48.468932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254798707910535:4393]
2025-10-01T14:07:48.468936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254798707910535:4393]
2025-10-01T14:07:48.468988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:48.468997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.468999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:48.469140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:48.470930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:48.470943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:48.470947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:48.468651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 362 sessionId: src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:48.471256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:48.657386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:48.657717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.657728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.658434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254801084772353:4446]
2025-10-01T14:07:48.658450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:48.658465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:48.658467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:48.658523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 362 reason: error at write: Disconnected sessionId: src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0
2025-10-01T14:07:48.658690Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:48.658705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 362 sessionId: src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0 is DEAD
2025-10-01T14:07:48.662671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:48.662679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0] Write session will restart in 0.005400s
2025-10-01T14:07:48.662707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0] Write session: Do CDS request
2025-10-01T14:07:48.662716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:48.670841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:48.672726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:48.672743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 363
2025-10-01T14:07:48.673910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:48.673955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:48.673962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:48.673966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:48.677030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 363 sessionId:  describe result for acl check
2025-10-01T14:07:48.677074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:48.677076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:48.677078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:48.677084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254801084772429:4838] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:48.677625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254801084772429:4838] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:48.683908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254801084772429:4838] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:48.690267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:48.691924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254801084772429:4838] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:48.691941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254801084772429:4838] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:48.691945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254801084772429:4838] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:48.691955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:48.694241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:48.694469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:48.694473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:48.694482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:48.694527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:48.694558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254798707910740:4398]
2025-10-01T14:07:48.695050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:48.695405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:48.695439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:48.695674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:48.695723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.695724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.695725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.695727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.695729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.695730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.695732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.695734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.695735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.695736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.695738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.695739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.695740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.695741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.695744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.695751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.695753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.695756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.695758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.695760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.695763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.695765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.695768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.695770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.695772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.695774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.695776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.695779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.695784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.695789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.695793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.695797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.695800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.695803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.695806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.695809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.695813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.695817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.695819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.695823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.695825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.695828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.695831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.695834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.695837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.695841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.695844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.695848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.695850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.695854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.695857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.695861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.695863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.695867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.695870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.695873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.695897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:48.708885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:48.709693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:48.709699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:48.709701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:48.709705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:48.709713Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 362 [2:7556254798707910740:4398]
2025-10-01T14:07:48.709729Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:48.709747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:48.709751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.710364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 362
2025-10-01T14:07:48.709755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.710418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 362
2025-10-01T14:07:48.709759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.709776Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:48.709781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:48.709787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:48.709868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.709870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.709872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.709877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:48.709880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:48.709959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:48.709961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.709972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.709984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.710001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:48.710018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254798707910734:4398]
2025-10-01T14:07:48.710020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254798707910734:4398]
2025-10-01T14:07:48.710022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254798707910734:4398]
2025-10-01T14:07:48.710039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:48.710045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:48.710048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:48.710050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:48.710054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772378:2446], now have 1 active actors on pipe
2025-10-01T14:07:48.710058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772561:4838], now have 1 active actors on pipe
2025-10-01T14:07:48.710066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:48.710079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:48.710083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:48.710121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254798707910734:4398]
2025-10-01T14:07:48.710128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:48.711948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:48.712148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.712155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.712186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:48.712195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.712200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.712204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:48.712226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.712241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:48.712257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:48.714424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.714447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.714481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:48.714653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 363 partition: 0 MaxSeqNo: 45 sessionId: src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0
2025-10-01T14:07:48.716282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b892ffe-22d47f23-c7c3dfbb-26a545c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:48.718965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0] Write session: try to update token
2025-10-01T14:07:48.718985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:48.758504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254801084772571:4446]
2025-10-01T14:07:48.758670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 363 sessionId: src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:48.758852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 362, pipe: [1:7556254801084772571:4446]
2025-10-01T14:07:48.760117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772571:4446], now have 1 active actors on pipe
2025-10-01T14:07:48.761387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:48.761603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.761627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.761667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:48.761826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:48.767089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:48.767111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:48.767115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:48.767117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:48.767126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254798707910734:4398]
2025-10-01T14:07:48.767130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254798707910734:4398]
2025-10-01T14:07:48.767133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254798707910734:4398]
2025-10-01T14:07:48.767169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:48.767173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:48.767176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:48.767179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:48.767186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.767189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:48.767348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:48.919374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:48.927554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.927581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.927754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.927819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.927884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.927945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.927994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.928003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.928072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.928130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.928195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.928269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.928320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.928330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.928394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.928450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.928506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.928560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.928601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.928607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.928666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.928725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.928781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.928853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.928898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.928905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.928968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.929024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.929077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.929140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.929185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.929192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.929254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.929312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.929375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.929446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.929493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.929499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.929557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.929612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.929677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.929738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.929785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.929792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.929855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.929909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.929964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.930019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.930060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.930067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.930126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.930180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.930235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.930288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.930327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.930332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.930414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:48.930474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:48.930543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:48.930605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:48.930656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:48.930663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:48.931631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:48.931642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0] Write session will restart in 0.005209s
2025-10-01T14:07:48.931674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0] Write session: Do CDS request
2025-10-01T14:07:48.931680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:48.931816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:48.930911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:48.930968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254801084772571:4446]
2025-10-01T14:07:48.931256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:48.931260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:48.931288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 363 reason: error at write: Disconnected sessionId: src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0
2025-10-01T14:07:48.931500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 363 sessionId: src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0 is DEAD
2025-10-01T14:07:48.937866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:48.937952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:48.937966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 364
2025-10-01T14:07:48.938069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:48.938100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:48.938111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:48.938115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:48.938555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 364 sessionId:  describe result for acl check
2025-10-01T14:07:48.938594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:48.938600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:48.938602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:48.938608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254801084772590:4842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:48.939130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254801084772590:4842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:48.942691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254801084772590:4842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:48.949190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254801084772590:4842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:48.949204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254801084772590:4842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:48.949206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254801084772590:4842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:48.949213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:48.950152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:48.952497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:48.952761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:48.952771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:48.952783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:48.952846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:48.952884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254798707910959:4410]
2025-10-01T14:07:48.953487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:48.953747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:48.953793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:48.954092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:48.954148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.954149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.954150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.954159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.954161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.954162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.954163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.954164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.954165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.954166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.954168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.954169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.954170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.954172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.954176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.954186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.954189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.954193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.954197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.954201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.954204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.954207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.954211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.954214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.954217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.954220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.954222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.954225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.954231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.954238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:48.954244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.954248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:48.954252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.954257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:48.954261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.954266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:48.954270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.954275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:48.954278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.954283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:48.954287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.954292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:48.954296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.954300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:48.954305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.954310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:48.954314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.954318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.954323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.954328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.954332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.954337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.954341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.954345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:48.954349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.954354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:48.954416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:48.962721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:48.963372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:48.963378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:48.963380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:48.963384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:48.963393Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 363 [2:7556254798707910959:4410]
2025-10-01T14:07:48.963414Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:48.963433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:48.963436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.963440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.963442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.963460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:48.963466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:48.963473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:48.963531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.963533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.963536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.963539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:48.963542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:48.963616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:48.963627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:48.963640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:48.963652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:48.963834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 363
2025-10-01T14:07:48.963859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 363
2025-10-01T14:07:48.963674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:48.963693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772759:4842], now have 1 active actors on pipe
2025-10-01T14:07:48.963696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254801084772576:2446], now have 1 active actors on pipe
2025-10-01T14:07:48.963704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254798707910954:4410]
2025-10-01T14:07:48.963706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254798707910954:4410]
2025-10-01T14:07:48.963708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254798707910954:4410]
2025-10-01T14:07:48.963723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:48.963736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:48.963751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:48.963754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:48.963794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254798707910954:4410]
2025-10-01T14:07:48.963796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:48.963864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:48.963866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:48.963868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:48.963873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:48.964101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.964116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.964144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:48.964157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:48.964162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:48.964166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:48.964175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:48.964188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:48.964209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:48.964520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.964527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.964541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:48.964649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 364 partition: 0 MaxSeqNo: 45 sessionId: src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0
2025-10-01T14:07:48.965115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92ea79e-b1bc3d14-fb28a366-3e5b6276_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:48.967815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0] Write session: try to update token
2025-10-01T14:07:48.967837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:48.984306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 364 sessionId: src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:48.986910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:48.987609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:48.987638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:48.987676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:48.987812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:49.008102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:49.008123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:49.008125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:49.008127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:49.008137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254798707910954:4410]
2025-10-01T14:07:49.008142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254798707910954:4410]
2025-10-01T14:07:49.008146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254798707910954:4410]
2025-10-01T14:07:49.008193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:49.008197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:49.008204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.008207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:49.008210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:49.008214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:49.008347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:49.030942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254805379740069:4446]
2025-10-01T14:07:49.031264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 363, pipe: [1:7556254805379740069:4446]
2025-10-01T14:07:49.160283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:49.168261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.168287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.168436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.168505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.168570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.168635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.168688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.168701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.168773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.168844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.168907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.168971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.169016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.169023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.169083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.169138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.169198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.169266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.169313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.169321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.169416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.169475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.169531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.169592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.169657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.169667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.169729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.169810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.169869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.169932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.169976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.169986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.170071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.170141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.170203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.170267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.170313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.170318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.170399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.170462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.170536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.170597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.170638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.170641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.170709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.170767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.170825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.170886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.170973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.170976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.171039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.171095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.171154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.171216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.171263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.171266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.171329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:49.171380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:49.171432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:49.171487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:49.171544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:49.171553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:49.171638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740069:4446], now have 1 active actors on pipe
2025-10-01T14:07:49.171907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:49.171961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:49.171963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:49.171971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254805379740069:4446]
2025-10-01T14:07:49.171989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 364 reason: error at write: Disconnected sessionId: src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0
2025-10-01T14:07:49.172217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 364 sessionId: src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0 is DEAD
2025-10-01T14:07:49.172515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:49.172529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0] Write session will restart in 0.008750s
2025-10-01T14:07:49.172557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0] Write session: Do CDS request
2025-10-01T14:07:49.172565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:49.172639Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:49.183296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:49.183412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:49.183442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 365
2025-10-01T14:07:49.183771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:49.183820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:49.183838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:49.183842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:49.184317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 365 sessionId:  describe result for acl check
2025-10-01T14:07:49.184358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:49.184360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:49.184362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:49.184367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254805379740239:4848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:49.184937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254805379740239:4848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:49.185698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:49.187447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254805379740239:4848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:49.188570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:49.188795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:49.188803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:49.188824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:49.188870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:49.188901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254803002878457:4413]
2025-10-01T14:07:49.189306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:49.189646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:49.189719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:49.190067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:49.190124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.190125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.190126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.190127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.190128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.190129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.190130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.190131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.190132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.190133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.190134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.190135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.190137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.190138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.190144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.190154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.190158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.190162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.190166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.190169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.190172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.190175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.190178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.190182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.190185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.190188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.190191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.190195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.190202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.190210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.190216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.190221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.190225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.190231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.190235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.190241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.190246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.190251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.190255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.190260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.190264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.190269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.190273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.190278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.190282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.190287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.190290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.190295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.190299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.190304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.190308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.190313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.190317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.190322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.190326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.190331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.190381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:49.191197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254805379740239:4848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:49.191209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254805379740239:4848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:49.191212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254805379740239:4848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:49.191221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:49.199758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:49.200370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:49.200386Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:49.200389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:49.200393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:49.200400Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 364 [2:7556254803002878457:4413]
2025-10-01T14:07:49.200418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:49.200438Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:49.200446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.200450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.200453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.200469Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:49.200479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:49.200485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:49.200541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.200548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.200551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.200554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:49.200556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:49.200627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:49.200634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.200647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.200661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.200679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:49.200702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740279:4848], now have 1 active actors on pipe
2025-10-01T14:07:49.200710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740090:2446], now have 1 active actors on pipe
2025-10-01T14:07:49.200715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254803002878452:4413]
2025-10-01T14:07:49.200717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254803002878452:4413]
2025-10-01T14:07:49.200718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254803002878452:4413]
2025-10-01T14:07:49.200728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:49.200738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:49.200744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:49.200746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:49.200747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:49.200748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:49.200749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:49.200784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254803002878452:4413]
2025-10-01T14:07:49.200795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:49.200811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:49.200937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.200945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.200871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 364
2025-10-01T14:07:49.200969Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:49.200914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 364
2025-10-01T14:07:49.200979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.200982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.200987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:49.200994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.201002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:49.201014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:49.201208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.201216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.201229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:49.201330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 365 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0
2025-10-01T14:07:49.201711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8139ced7-9f1c7a30-f8f833d-85ba1b41_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:49.204563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0] Write session: try to update token
2025-10-01T14:07:49.204583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:49.217931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:49.217952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:49.217963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254803002878452:4413]
2025-10-01T14:07:49.218010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:49.218013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:49.218192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:49.218340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:49.218497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:49.218643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:49.218839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:49.218883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:49.228191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 365 sessionId: src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:49.233763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.233794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.233817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:49.233821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:49.233824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:49.233826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:49.233837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254803002878452:4413]
2025-10-01T14:07:49.233841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254803002878452:4413]
2025-10-01T14:07:49.233845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254803002878452:4413]
2025-10-01T14:07:49.233887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:49.233903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:49.233907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:49.233907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:49.233914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.233917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:49.234053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:49.232751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:49.272074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254805379740291:4446]
2025-10-01T14:07:49.272325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 364, pipe: [1:7556254805379740291:4446]
2025-10-01T14:07:49.389752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:49.390671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:49.390712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740291:4446], now have 1 active actors on pipe
2025-10-01T14:07:49.390825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:49.390950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:49.390953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:49.391051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 365 reason: error at write: Disconnected sessionId: src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0
2025-10-01T14:07:49.391217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 365 sessionId: src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0 is DEAD
2025-10-01T14:07:49.394479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:49.394499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0] Write session will restart in 0.007234s
2025-10-01T14:07:49.394527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0] Write session: Do CDS request
2025-10-01T14:07:49.394535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:49.391376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:49.391430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254805379740291:4446]
2025-10-01T14:07:49.403859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:49.408362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:49.406396Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:49.406413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 366
2025-10-01T14:07:49.407080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:49.407126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:49.407132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:49.407138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:49.407565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 366 sessionId:  describe result for acl check
2025-10-01T14:07:49.407595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:49.407597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:49.407599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:49.407605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254805379740445:4852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:49.408143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254805379740445:4852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:49.410457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254805379740445:4852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:49.410215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:49.410481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:49.410486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:49.410498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:49.410555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:49.410603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254803002878650:4416]
2025-10-01T14:07:49.411206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:49.411591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:49.411660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:49.412005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:49.412084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.412092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.412093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.412095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.412096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.412097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.412099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.412100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.412101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.412103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.412104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.412105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.412106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.412108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.412113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.412122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.412125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.412130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.412133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.412137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.412140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.412143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.412146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.412149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.412153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.412156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.412159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.412162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.412170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.412176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.412182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.412187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.412191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.412196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.412200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.412205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.412216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.412221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.412225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.412230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.412237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.412246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.412252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.412261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.412266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.412270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.412274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.412278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.412283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.412287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.412292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.412296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.412302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.412311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.412315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.412319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.412376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:49.418343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:49.417870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254805379740445:4852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:49.417885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254805379740445:4852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:49.417887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254805379740445:4852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:49.417895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:49.419014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:49.419028Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:49.419030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:49.419033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:49.419040Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 365 [2:7556254803002878650:4416]
2025-10-01T14:07:49.419053Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:49.419077Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:49.419079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.419082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.419083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.419098Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:49.419101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:49.419106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:49.419147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.419153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.419155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.419158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:49.419160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:49.419215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:49.419220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.419228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.419234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.419247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:49.419264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254803002878645:4416]
2025-10-01T14:07:49.419270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254803002878645:4416]
2025-10-01T14:07:49.419271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254803002878645:4416]
2025-10-01T14:07:49.419279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:49.419289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:49.419291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740484:4852], now have 1 active actors on pipe
2025-10-01T14:07:49.419294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740294:2446], now have 1 active actors on pipe
2025-10-01T14:07:49.419300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:49.419307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:49.419309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:49.419310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:49.419311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:49.419343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254803002878645:4416]
2025-10-01T14:07:49.419360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:49.419366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:49.419451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.419466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.419498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6b4c564-df2343-9888598f-a097e972_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:49.419510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.419514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.419517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:49.419526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.419541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:49.419561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:49.419701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.419709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.419722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:49.419376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 365
2025-10-01T14:07:49.419396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 365
2025-10-01T14:07:49.419793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 366 partition: 0 MaxSeqNo: 45 sessionId: src_id|d6b4c564-df2343-9888598f-a097e972_0
2025-10-01T14:07:49.424637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae88c10e-8c1d7f8d-cf612e33-8356c4ea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d6b4c564-df2343-9888598f-a097e972_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:49.427730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b4c564-df2343-9888598f-a097e972_0] Write session: try to update token
2025-10-01T14:07:49.427754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b4c564-df2343-9888598f-a097e972_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:49.430397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:49.430413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:49.430421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254803002878645:4416]
2025-10-01T14:07:49.430459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:49.430611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:49.430743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:49.430877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:49.431008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:49.431187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:49.431226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:49.432280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:49.453182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 366 sessionId: src_id|d6b4c564-df2343-9888598f-a097e972_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:49.454710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:49.454732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:49.454735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:49.454737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:49.454748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254803002878645:4416]
2025-10-01T14:07:49.454754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254803002878645:4416]
2025-10-01T14:07:49.454759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254803002878645:4416]
2025-10-01T14:07:49.454813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:49.454816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:49.454822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:49.454825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.454826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:49.454828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:49.454972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:49.456248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:49.492429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254805379740492:4446]
2025-10-01T14:07:49.492826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 365, pipe: [1:7556254805379740492:4446]
2025-10-01T14:07:49.610712Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:49.611407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.611431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.611458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740492:4446], now have 1 active actors on pipe
2025-10-01T14:07:49.611669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:49.612042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254805379740492:4446]
2025-10-01T14:07:49.612073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:49.612074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:49.612142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 366 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6b4c564-df2343-9888598f-a097e972_0
2025-10-01T14:07:49.612334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 366 sessionId: src_id|d6b4c564-df2343-9888598f-a097e972_0 is DEAD
2025-10-01T14:07:49.618667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b4c564-df2343-9888598f-a097e972_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:49.618682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b4c564-df2343-9888598f-a097e972_0] Write session will restart in 0.007023s
2025-10-01T14:07:49.618708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b4c564-df2343-9888598f-a097e972_0] Write session: Do CDS request
2025-10-01T14:07:49.618718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b4c564-df2343-9888598f-a097e972_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:49.629404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:49.630914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b4c564-df2343-9888598f-a097e972_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:49.632339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:49.632355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 367
2025-10-01T14:07:49.632625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:49.632662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:49.632671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:49.632676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:49.633054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 367 sessionId:  describe result for acl check
2025-10-01T14:07:49.633092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:49.633099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:49.633103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:49.633107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254805379740675:4864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:49.632284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:49.632517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:49.632522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:49.632534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:49.632589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:49.632624Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254803002878850:4420]
2025-10-01T14:07:49.633161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:49.633559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254805379740675:4864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:49.633502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:49.633541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:49.633816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:49.633858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.633859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.633860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.633861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.633862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.633863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.633864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.633865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.633866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.633867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.633868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.633869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.633870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.633870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.633874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.633883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.633886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.633890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.633893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.633896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.633900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.633903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.633906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.633909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.633912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.633916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.633919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.633922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.633928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.633934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.633939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.633944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.633947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.633951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.633954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.633959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.633963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.633967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.633970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.633974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.633977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.633981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.633985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.633988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.633992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.633996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.633999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.634003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.634007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.634011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.634015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.634019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.634022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.634026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.634030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.634034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.634066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:49.635457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254805379740675:4864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:49.638586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254805379740675:4864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:49.638598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254805379740675:4864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:49.638601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254805379740675:4864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:49.638607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:49.638136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:49.638763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:49.638768Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:49.638770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:49.638773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:49.638780Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 366 [2:7556254803002878850:4420]
2025-10-01T14:07:49.638794Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:49.638820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:49.638823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.638826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.638828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.638843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:49.638847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:49.638852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:49.638900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.638902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.638904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.638907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:49.638909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:49.638966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:49.639358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 366
2025-10-01T14:07:49.639391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 366
2025-10-01T14:07:49.638969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.638980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.638988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.639002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:49.639016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254803002878845:4420]
2025-10-01T14:07:49.639018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254803002878845:4420]
2025-10-01T14:07:49.639019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254803002878845:4420]
2025-10-01T14:07:49.639032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:49.639043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:49.639058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:49.639061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:49.639080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:49.639082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254803002878845:4420]
2025-10-01T14:07:49.639083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:49.639084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:49.639086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:49.639091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:49.639312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740521:2446], now have 1 active actors on pipe
2025-10-01T14:07:49.639317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740710:4864], now have 1 active actors on pipe
2025-10-01T14:07:49.639486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.639502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.639536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f25997b4-98443f51-f2f24b52-134d6938_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:49.639549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.639554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.639556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:49.639567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.639577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:49.639597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:49.650578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.650604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.650653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:49.650790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 367 partition: 0 MaxSeqNo: 45 sessionId: src_id|f25997b4-98443f51-f2f24b52-134d6938_0
2025-10-01T14:07:49.651251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6b4c564-df2343-9888598f-a097e972_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f25997b4-98443f51-f2f24b52-134d6938_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:49.654082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f25997b4-98443f51-f2f24b52-134d6938_0] Write session: try to update token
2025-10-01T14:07:49.654100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f25997b4-98443f51-f2f24b52-134d6938_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:49.664661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:49.664688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:49.664691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:49.664694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:49.664704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254803002878845:4420]
2025-10-01T14:07:49.664712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254803002878845:4420]
2025-10-01T14:07:49.664715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254803002878845:4420]
2025-10-01T14:07:49.664773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:49.664783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.664787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:49.664958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:49.670209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:49.670226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:49.670230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:49.679672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 367 sessionId: src_id|f25997b4-98443f51-f2f24b52-134d6938_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:49.682493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:49.712433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254805379740718:4446]
2025-10-01T14:07:49.712780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 366, pipe: [1:7556254805379740718:4446]
2025-10-01T14:07:49.855806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:49.856441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.856453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.856475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740718:4446], now have 1 active actors on pipe
2025-10-01T14:07:49.856975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:49.858056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:49.858123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254805379740718:4446]
2025-10-01T14:07:49.858145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:49.858217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 367 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f25997b4-98443f51-f2f24b52-134d6938_0
2025-10-01T14:07:49.858436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 367 sessionId: src_id|f25997b4-98443f51-f2f24b52-134d6938_0 is DEAD
2025-10-01T14:07:49.862266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25997b4-98443f51-f2f24b52-134d6938_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:49.862281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25997b4-98443f51-f2f24b52-134d6938_0] Write session will restart in 0.005778s
2025-10-01T14:07:49.862311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25997b4-98443f51-f2f24b52-134d6938_0] Write session: Do CDS request
2025-10-01T14:07:49.862318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25997b4-98443f51-f2f24b52-134d6938_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:49.870470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f25997b4-98443f51-f2f24b52-134d6938_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:49.870606Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:49.870624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 368
2025-10-01T14:07:49.870903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:49.870936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:49.870943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:49.870947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:49.871388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 368 sessionId:  describe result for acl check
2025-10-01T14:07:49.871419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:49.871421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:49.871423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:49.871429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254805379740733:4868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:49.871979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254805379740733:4868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:49.875134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254805379740733:4868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:49.880217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254805379740733:4868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:49.880235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254805379740733:4868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:49.880239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254805379740733:4868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:49.880247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:49.886718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:49.889205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:49.889429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:49.889433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:49.889444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:49.889500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:49.889535Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254803002879076:4433]
2025-10-01T14:07:49.890145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:49.890451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:49.890500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:49.890832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:49.890909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.890922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.890923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.890925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.890926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.890927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.890928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.890929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.890931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.890932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.890933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.890934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.890936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.890937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.890943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.890954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.890958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.890962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.890966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.890970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.890974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.890977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.890981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.890985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.890989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.890992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.890996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.891000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.891008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.891015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:49.891022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.891028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:49.891032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.891037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:49.891041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.891046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:49.891052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.891057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:49.891061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.891066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:49.891071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.891084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:49.891089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.891094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:49.891099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.891104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:49.891108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.891114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.891118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.891123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.891126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.891132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.891136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.891141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:49.891151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.891155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:49.891207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:49.895402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:49.896364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:49.896381Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:49.896384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:49.896387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:49.896394Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 367 [2:7556254803002879076:4433]
2025-10-01T14:07:49.896412Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:49.896429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:49.896436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.896441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.896443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.896459Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:49.896464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:49.896470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:49.896534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.896542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.896544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.896548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:49.896550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:49.896619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:49.896628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.896640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:49.896650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:49.896666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:49.896683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254803002879071:4433]
2025-10-01T14:07:49.896685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254803002879071:4433]
2025-10-01T14:07:49.896688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254803002879071:4433]
2025-10-01T14:07:49.896701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:49.896716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:49.896730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:49.896733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:49.896755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:49.896758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:49.896760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:49.896770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254803002879071:4433]
2025-10-01T14:07:49.896772Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:49.896843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:49.896958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740723:2446], now have 1 active actors on pipe
2025-10-01T14:07:49.896965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740789:4868], now have 1 active actors on pipe
2025-10-01T14:07:49.897152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 367
2025-10-01T14:07:49.897157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 367
2025-10-01T14:07:49.897406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.897418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.897446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:49.897458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:49.897463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:49.897465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:49.897475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:49.897497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:49.897517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:49.897843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:49.897853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:49.897871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:49.897972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 368 partition: 0 MaxSeqNo: 45 sessionId: src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0
2025-10-01T14:07:49.898422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25997b4-98443f51-f2f24b52-134d6938_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:49.901543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0] Write session: try to update token
2025-10-01T14:07:49.901564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:49.919310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:49.919332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:49.919334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:49.919336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:49.919347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254803002879071:4433]
2025-10-01T14:07:49.919352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254803002879071:4433]
2025-10-01T14:07:49.919356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254803002879071:4433]
2025-10-01T14:07:49.919404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:49.919416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:49.919418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:49.919419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:49.919426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:49.919429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:49.919573Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:49.923774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 368 sessionId: src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:49.926316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:49.958196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254805379740924:4446]
2025-10-01T14:07:49.958510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 367, pipe: [1:7556254805379740924:4446]
2025-10-01T14:07:50.068745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:50.069001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.069016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.069057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254805379740924:4446], now have 1 active actors on pipe
2025-10-01T14:07:50.069215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:50.069276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:50.069311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254805379740924:4446]
2025-10-01T14:07:50.069323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:50.069389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 368 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0
2025-10-01T14:07:50.069575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 368 sessionId: src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0 is DEAD
2025-10-01T14:07:50.069728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:50.069743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0] Write session will restart in 0.007534s
2025-10-01T14:07:50.069770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0] Write session: Do CDS request
2025-10-01T14:07:50.069775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:50.078830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.078961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:50.078980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 369
2025-10-01T14:07:50.079088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.079119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:50.079127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:50.079132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:50.079776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 369 sessionId:  describe result for acl check
2025-10-01T14:07:50.079820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:50.079821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:50.079823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:50.079829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254809674708325:4872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:50.080386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254809674708325:4872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:50.082464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254809674708325:4872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:50.084861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:50.085262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254809674708325:4872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:50.085279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254809674708325:4872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:50.085283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254809674708325:4872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:50.085291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:50.087226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:50.087431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:50.087441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:50.087459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:50.087500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:50.087541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254807297846578:4436]
2025-10-01T14:07:50.088063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:50.088353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:50.088409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:50.088731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:50.088798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.088813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.088814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.088815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.088816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.088817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.088819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.088820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.088821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.088822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.088823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.088824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.088825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.088826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.088832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.088841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.088845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.088849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.088853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.088856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.088860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.088863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.088867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.088871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.088875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.088879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.088882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.088886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.088893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.088902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.088908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.088914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.088919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.088924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.088928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.088933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.088939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.088948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.088952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.088957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.088963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.088972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.088976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.088986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.088991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.088999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.089004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.089012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.089016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.089020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.089023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.089028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.089032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.089037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.089041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.089046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.089081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:50.092932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:50.093526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:50.093539Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:50.093541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:50.093545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:50.093554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 368 [2:7556254807297846578:4436]
2025-10-01T14:07:50.093569Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:50.093591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:50.093596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.093600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.093603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.093620Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:50.093625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:50.093631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:50.093698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.093700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.093702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.093706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:50.093708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:50.093769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:50.093779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.093789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.093799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.093819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:50.093839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708411:4872], now have 1 active actors on pipe
2025-10-01T14:07:50.093847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708222:2446], now have 1 active actors on pipe
2025-10-01T14:07:50.093854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254807297846572:4436]
2025-10-01T14:07:50.093859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254807297846572:4436]
2025-10-01T14:07:50.093861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254807297846572:4436]
2025-10-01T14:07:50.093874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:50.093893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:50.093908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:50.093911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:50.093943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:50.093946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254807297846572:4436]
2025-10-01T14:07:50.093948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:50.093955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:50.093957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:50.093964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:50.094032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.094042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.094068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:50.094079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.094084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.094090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:50.094100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.094111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:50.094129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:50.093914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 368
2025-10-01T14:07:50.093953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 368
2025-10-01T14:07:50.094350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 369 partition: 0 MaxSeqNo: 45 sessionId: src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0
2025-10-01T14:07:50.094263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.094269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.094282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:50.094787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2cdeb16c-88a37ca6-cd3350d5-fc995f9e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:50.097743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0] Write session: try to update token
2025-10-01T14:07:50.097762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:50.104710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:50.104730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:50.104741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254807297846572:4436]
2025-10-01T14:07:50.104784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:50.104788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:50.104959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:50.105097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:50.105256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:50.105413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:50.105598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:50.105638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:50.114607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 369 sessionId: src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:50.117142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:50.117405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.117433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.117473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:50.117569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:50.125495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:50.125514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:50.125517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:50.125519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:50.125531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254807297846572:4436]
2025-10-01T14:07:50.125535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254807297846572:4436]
2025-10-01T14:07:50.125540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254807297846572:4436]
2025-10-01T14:07:50.125580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:50.125585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:50.125589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.125591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:50.125592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:50.125596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:50.125732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:50.169634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254809674708438:4446]
2025-10-01T14:07:50.169942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 368, pipe: [1:7556254809674708438:4446]
2025-10-01T14:07:50.279542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:50.287533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.287560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.287723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.287785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.287849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.287909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.287959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.287968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.288029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.288088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.288145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.288208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.288259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.288266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.288334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.288390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.288450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.288511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.288631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.288639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.288705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.288769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.288842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.288907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.288952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.288959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.289021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.289083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.289146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.289208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.289253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.289259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.289360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.289453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.289520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.289582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.289630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.289637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.289735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.289793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.289863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.289924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.289968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.289975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.290033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.290087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.290146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.290203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.290249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.290256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.290322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.290399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.290458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.290516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.290564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.290574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.290637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:50.290698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:50.290778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:50.290836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:50.290895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:50.290902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:50.290964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708438:4446], now have 1 active actors on pipe
2025-10-01T14:07:50.291223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254809674708438:4446]
2025-10-01T14:07:50.291237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:50.291260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:50.291262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:50.291296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 369 reason: error at write: Disconnected sessionId: src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0
2025-10-01T14:07:50.291521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 369 sessionId: src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0 is DEAD
2025-10-01T14:07:50.291702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:50.291719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0] Write session will restart in 0.009780s
2025-10-01T14:07:50.291747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0] Write session: Do CDS request
2025-10-01T14:07:50.291754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:50.292071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:50.304560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:50.306736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:50.306942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:50.306955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.306954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:50.306966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:50.307014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:50.307054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254807297846775:4439]
2025-10-01T14:07:50.307640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:50.307910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:50.307964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:50.308204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:50.308213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 370
2025-10-01T14:07:50.308276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:50.308337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.308342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.308343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.308343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.308344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.308345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.308346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.308347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.308348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.308349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.308350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.308351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.308352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.308353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.308358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.308367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.308370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.308373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.308376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.308379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.308382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.308386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.308354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.308389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.308376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:50.308392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.308396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.308399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.308380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:50.308402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.308383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:50.308405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.308411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.308419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.308425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.308430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.308434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.308439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.308444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.308448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.308452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.308456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.308459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.308463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.308467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.308471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.308475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.308480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.308484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.308489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.308492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.308497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.308501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.308516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.308521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.308526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.308530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.308535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.308538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.308542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.308573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:50.308754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 370 sessionId:  describe result for acl check
2025-10-01T14:07:50.308786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:50.308792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:50.308793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:50.308818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254809674708605:4878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:50.309300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254809674708605:4878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:50.311493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254809674708605:4878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:50.312650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:50.313372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:50.313388Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:50.313390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:50.313393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:50.313399Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 369 [2:7556254807297846775:4439]
2025-10-01T14:07:50.313414Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:50.313430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:50.313433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.313437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.313438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.313455Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:50.313460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:50.313465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:50.313514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.313521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.313524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.313526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:50.313528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:50.313591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:50.313599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.313609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.313617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.313634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:50.313650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708446:2446], now have 1 active actors on pipe
2025-10-01T14:07:50.313662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254807297846770:4439]
2025-10-01T14:07:50.313664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254807297846770:4439]
2025-10-01T14:07:50.313666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254807297846770:4439]
2025-10-01T14:07:50.313677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:50.313690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:50.313692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:50.313699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:50.313701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:50.313704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:50.313706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:50.313696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 369
2025-10-01T14:07:50.313736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254807297846770:4439]
2025-10-01T14:07:50.313746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:50.313749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:50.315082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254809674708605:4878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:50.315093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254809674708605:4878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:50.315095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254809674708605:4878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:50.315101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:50.315286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708645:4878], now have 1 active actors on pipe
2025-10-01T14:07:50.315317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 369
2025-10-01T14:07:50.315362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.315371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.315395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2aa77f3-e95b0751-717aa233-a6907375_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:50.315407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.315412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.315414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:50.315425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.315441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:50.315460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:50.315643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.315651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.315664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:50.315741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 370 partition: 0 MaxSeqNo: 45 sessionId: src_id|e2aa77f3-e95b0751-717aa233-a6907375_0
2025-10-01T14:07:50.316135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a38fa8c0-15f1c6d3-c3230951-8f08b80_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e2aa77f3-e95b0751-717aa233-a6907375_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:50.319120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2aa77f3-e95b0751-717aa233-a6907375_0] Write session: try to update token
2025-10-01T14:07:50.319141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2aa77f3-e95b0751-717aa233-a6907375_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:50.336103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 370 sessionId: src_id|e2aa77f3-e95b0751-717aa233-a6907375_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:50.336419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:50.336440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:50.336443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:50.336445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:50.336454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254807297846770:4439]
2025-10-01T14:07:50.336459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254807297846770:4439]
2025-10-01T14:07:50.336466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254807297846770:4439]
2025-10-01T14:07:50.336516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:50.336525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:50.336527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.336529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:50.336532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:50.336535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:50.336662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:50.338648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:50.391369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254809674708649:4446]
2025-10-01T14:07:50.391762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 369, pipe: [1:7556254809674708649:4446]
2025-10-01T14:07:50.495627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:50.496054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.496070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.496110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708649:4446], now have 1 active actors on pipe
2025-10-01T14:07:50.496313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254809674708649:4446]
2025-10-01T14:07:50.496357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:50.496361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:50.496509Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:50.496604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:50.496867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 370 reason: error at write: Disconnected sessionId: src_id|e2aa77f3-e95b0751-717aa233-a6907375_0
2025-10-01T14:07:50.497043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 370 sessionId: src_id|e2aa77f3-e95b0751-717aa233-a6907375_0 is DEAD
2025-10-01T14:07:50.497270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2aa77f3-e95b0751-717aa233-a6907375_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:50.497280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2aa77f3-e95b0751-717aa233-a6907375_0] Write session will restart in 0.008527s
2025-10-01T14:07:50.497303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2aa77f3-e95b0751-717aa233-a6907375_0] Write session: Do CDS request
2025-10-01T14:07:50.497308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2aa77f3-e95b0751-717aa233-a6907375_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:50.506902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2aa77f3-e95b0751-717aa233-a6907375_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.507119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:50.507136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 371
2025-10-01T14:07:50.507239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.507265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:50.507273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:50.507278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:50.507774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 371 sessionId:  describe result for acl check
2025-10-01T14:07:50.507816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:50.507823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:50.507826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:50.507844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254809674708665:4882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:50.508433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254809674708665:4882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:50.510633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254809674708665:4882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:50.514030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254809674708665:4882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:50.514044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254809674708665:4882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:50.514048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254809674708665:4882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:50.514058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:50.516780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:50.520025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:50.520281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:50.520292Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:50.520305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:50.520357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:50.520404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254807297846973:4441]
2025-10-01T14:07:50.521011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:50.521392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:50.521491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:50.521866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:50.521968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.521978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.521980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.521981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.521983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.521985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.521986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.521988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.521990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.521991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.521993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.521994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.521996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.521997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.522004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.522014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.522018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.522022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.522025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.522029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.522032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.522037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.522041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.522045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.522049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.522052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.522055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.522058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.522066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.522071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.522074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.522078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.522081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.522085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.522087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.522091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.522094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.522097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.522101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.522104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.522107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.522111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.522114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.522118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.522121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.522124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.522127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.522132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.522138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.522143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.522148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.522162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.522168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.522173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.522178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.522183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.522223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:50.526524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:50.527259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:50.527280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:50.527283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:50.527289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:50.527297Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 370 [2:7556254807297846973:4441]
2025-10-01T14:07:50.527319Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:50.527346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:50.527357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.527361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.527364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.527381Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:50.527393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:50.527400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:50.527476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.527485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.527487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.527490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:50.527493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:50.527567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:50.527576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.527589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.527600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.527622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:50.527646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708651:2446], now have 1 active actors on pipe
2025-10-01T14:07:50.527666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708825:4882], now have 1 active actors on pipe
2025-10-01T14:07:50.527672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254807297846968:4441]
2025-10-01T14:07:50.527674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254807297846968:4441]
2025-10-01T14:07:50.527677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254807297846968:4441]
2025-10-01T14:07:50.527692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:50.527706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:50.527714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:50.527718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:50.527720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:50.527721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:50.527725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:50.527764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254807297846968:4441]
2025-10-01T14:07:50.527777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:50.527783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:50.527937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.527949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.527973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a2d5384-b18d773a-cafc61df-5017450a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:50.527987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.527992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.527995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:50.528005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.528021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:50.528041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:50.528211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.528227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.528250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:50.528737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2aa77f3-e95b0751-717aa233-a6907375_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a2d5384-b18d773a-cafc61df-5017450a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:50.527714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 370
2025-10-01T14:07:50.527762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 370
2025-10-01T14:07:50.528341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 371 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a2d5384-b18d773a-cafc61df-5017450a_0
2025-10-01T14:07:50.531861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2d5384-b18d773a-cafc61df-5017450a_0] Write session: try to update token
2025-10-01T14:07:50.531877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2d5384-b18d773a-cafc61df-5017450a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:50.539165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:50.539192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:50.539204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254807297846968:4441]
2025-10-01T14:07:50.539259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:50.539376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:50.539451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:50.539597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:50.539741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:50.539883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:50.540089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:50.540133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:50.556403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 371 sessionId: src_id|2a2d5384-b18d773a-cafc61df-5017450a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:50.559442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:50.559463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:50.559465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:50.559467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:50.559479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254807297846968:4441]
2025-10-01T14:07:50.559483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254807297846968:4441]
2025-10-01T14:07:50.559487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254807297846968:4441]
2025-10-01T14:07:50.559530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:50.559535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:50.559536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:50.559539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:50.559543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.559546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:50.559695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:50.559974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:50.596717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254809674708868:4446]
2025-10-01T14:07:50.597079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 370, pipe: [1:7556254809674708868:4446]
2025-10-01T14:07:50.734322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:50.735040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.735057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.735080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708868:4446], now have 1 active actors on pipe
2025-10-01T14:07:50.735380Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:50.736284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2d5384-b18d773a-cafc61df-5017450a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:50.736297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2d5384-b18d773a-cafc61df-5017450a_0] Write session will restart in 0.007387s
2025-10-01T14:07:50.736319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2d5384-b18d773a-cafc61df-5017450a_0] Write session: Do CDS request
2025-10-01T14:07:50.736325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2d5384-b18d773a-cafc61df-5017450a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:50.735765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254809674708868:4446]
2025-10-01T14:07:50.735818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:50.735866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:50.735955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 371 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a2d5384-b18d773a-cafc61df-5017450a_0
2025-10-01T14:07:50.736131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 371 sessionId: src_id|2a2d5384-b18d773a-cafc61df-5017450a_0 is DEAD
2025-10-01T14:07:50.744866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2d5384-b18d773a-cafc61df-5017450a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.745296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:50.745311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 372
2025-10-01T14:07:50.745817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.745858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:50.745865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:50.745869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:50.746350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 372 sessionId:  describe result for acl check
2025-10-01T14:07:50.746397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:50.746399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:50.746401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:50.746407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254809674708897:4894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:50.746950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254809674708897:4894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:50.751282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254809674708897:4894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:50.755960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254809674708897:4894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:50.755994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254809674708897:4894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:50.755999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254809674708897:4894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:50.756009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:50.764451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:50.768071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:50.768344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:50.768349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:50.768361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:50.768420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:50.768462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254807297847179:4446]
2025-10-01T14:07:50.769229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:50.771856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:50.771938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:50.772343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:50.772427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.772428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.772430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.772431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.772433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.772434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.772436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.772437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.772439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.772441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.772454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.772456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.772458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.772459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.772467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.772477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.772482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.772486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.772490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.772494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.772499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.772503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.772507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.772520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.772523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.772526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.772529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.772533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.772541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.772549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:50.772555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.772561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:50.772566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.772572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:50.772577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.772583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:50.772588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.772593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:50.772600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.772605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:50.772611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.772616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:50.772620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.772624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:50.772629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.772634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:50.772638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.772643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.772647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.772652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.772658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.772663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.772668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.772673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:50.772679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.772685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:50.772730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:50.775325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:07:50.775350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-10-01T14:07:50.783455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:50.784229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:50.784246Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:50.784249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:50.784253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:50.784261Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 371 [2:7556254807297847179:4446]
2025-10-01T14:07:50.784279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:50.784296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:50.784305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.784309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.784312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.784329Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:50.784335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:50.784342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:50.784405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.784415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.784417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.784420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:50.784422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:50.784509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:50.784518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.784531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:50.784541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:50.784555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:50.784572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254807297847174:4446]
2025-10-01T14:07:50.784575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254807297847174:4446]
2025-10-01T14:07:50.784579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254807297847174:4446]
2025-10-01T14:07:50.784590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:50.784605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:50.784619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:50.784622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:50.784646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:50.784649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:50.784652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:50.784774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 371
2025-10-01T14:07:50.784834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 371
2025-10-01T14:07:50.784903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254807297847174:4446]
2025-10-01T14:07:50.784920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:50.784932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708967:4894], now have 1 active actors on pipe
2025-10-01T14:07:50.784936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674708884:2446], now have 1 active actors on pipe
2025-10-01T14:07:50.784968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:50.785106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.785111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.785136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:50.785144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:50.785148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:50.785150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:50.785160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:50.785169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:50.785212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:50.785276Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:07:50.785472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.785475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.785490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:50.785619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 3 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:07:50.785647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 372 partition: 0 MaxSeqNo: 45 sessionId: src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0
2025-10-01T14:07:50.785655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:07:50.786001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2d5384-b18d773a-cafc61df-5017450a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:50.788946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0] Write session: try to update token
2025-10-01T14:07:50.788968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:50.809929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:50.809955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:50.809959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:50.809974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:50.809985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254807297847174:4446]
2025-10-01T14:07:50.809991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254807297847174:4446]
2025-10-01T14:07:50.809998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254807297847174:4446]
2025-10-01T14:07:50.810051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:50.810059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:50.810062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:50.810077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:50.810086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:50.810091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:50.810232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:50.814139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 372 sessionId: src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:50.818305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:50.834695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254809674709092:4446]
2025-10-01T14:07:50.835185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 371, pipe: [1:7556254809674709092:4446]
2025-10-01T14:07:50.976647Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:50.977377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:50.977398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:50.977450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674709092:4446], now have 1 active actors on pipe
2025-10-01T14:07:50.977821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:50.977837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:50.977913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 372 reason: error at write: Disconnected sessionId: src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0
2025-10-01T14:07:50.977939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254809674709092:4446]
2025-10-01T14:07:50.977969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:50.978149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 372 sessionId: src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0 is DEAD
2025-10-01T14:07:50.977783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:50.978332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:50.978342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0] Write session will restart in 0.005259s
2025-10-01T14:07:50.978408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0] Write session: Do CDS request
2025-10-01T14:07:50.978418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:50.985130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.985214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:50.985228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 373
2025-10-01T14:07:50.985414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:50.985441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:50.985447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:50.985451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:50.986051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 373 sessionId:  describe result for acl check
2025-10-01T14:07:50.986082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:50.986091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:50.986092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:50.986097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254809674709110:4898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:50.986643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254809674709110:4898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:50.988763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254809674709110:4898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:50.995700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254809674709110:4898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:50.995717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254809674709110:4898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:50.995723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254809674709110:4898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:50.995733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:51.012074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:51.019218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:51.019606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:51.019611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:51.019625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:51.019698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:51.019744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254811592814705:4459]
2025-10-01T14:07:51.020458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:51.024853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:51.024945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:51.025369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:51.025448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.025449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.025450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.025452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.025453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.025454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.025456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.025457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.025458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.025459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.025460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.025461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.025462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.025464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.025471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.025480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.025484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.025487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.025490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.025494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.025497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.025501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.025504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.025509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.025512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.025515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.025518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.025521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.025531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.025539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.025545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.025550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.025555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.025560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.025564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.025569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.025573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.025578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.025582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.025588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.025594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.025598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.025602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.025606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.025611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.025616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.025623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.025628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.025631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.025636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.025640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.025646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.025650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.025655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.025658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.025663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.025698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:51.039510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:51.040626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:51.040632Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:51.040635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:51.040639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:51.040647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 372 [2:7556254811592814705:4459]
2025-10-01T14:07:51.040666Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:51.040688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:51.040693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.040697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.040700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.040719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:51.040726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:51.040733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:51.040802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.040819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.040824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.040828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:51.040831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:51.040915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:51.040917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.040931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.040944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.040962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:51.040981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254811592814700:4459]
2025-10-01T14:07:51.040984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254811592814700:4459]
2025-10-01T14:07:51.040986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254811592814700:4459]
2025-10-01T14:07:51.041007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:51.041025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:51.041042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:51.041046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:51.041091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254811592814700:4459]
2025-10-01T14:07:51.041094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:51.041503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:51.041514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:51.041516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:51.041522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:51.042413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 372
2025-10-01T14:07:51.042459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 372
2025-10-01T14:07:51.046511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674709163:4898], now have 1 active actors on pipe
2025-10-01T14:07:51.046530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254809674709100:2446], now have 1 active actors on pipe
2025-10-01T14:07:51.046556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.046564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.046606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:51.046618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.046625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.046628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:51.046642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.046660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:51.046691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.050034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.050056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.050097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.050319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 373 partition: 0 MaxSeqNo: 45 sessionId: src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0
2025-10-01T14:07:51.050888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|352e69c-b96efc2e-ea48e45b-ba8255f9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:51.055020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0] Write session: try to update token
2025-10-01T14:07:51.055047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:51.077926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254813969676597:4446]
2025-10-01T14:07:51.078154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 373 sessionId: src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:51.078671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969676597:4446], now have 1 active actors on pipe
2025-10-01T14:07:51.078581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 372, pipe: [1:7556254813969676597:4446]
2025-10-01T14:07:51.080982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:51.081274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.081296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.081325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:51.082211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:51.085737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:51.085764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:51.085766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:51.085768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:51.085776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254811592814700:4459]
2025-10-01T14:07:51.085779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254811592814700:4459]
2025-10-01T14:07:51.085783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254811592814700:4459]
2025-10-01T14:07:51.085834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:51.085837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:51.085839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:51.085842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:51.085844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.085847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:51.085997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:51.242561Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:51.251293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.251320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.251500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.251568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.251635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.251701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.251753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.251763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.251870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.251935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.251995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.252062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.252107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.252114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.252173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.252225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.252279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.252331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.252369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.252375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.252433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.252491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.252545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.252593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.252642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.252649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.252705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.252758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.252832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.252896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.252941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.252947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.253011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.253071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.253131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.253192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.253240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.253247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.253309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.253363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.253422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.253476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.253598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.253606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.253664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.253717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.253773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.253829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.253892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.253900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.253971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.254033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.254129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.255098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:51.255111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:51.255139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 373 reason: error at write: Disconnected sessionId: src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0
2025-10-01T14:07:51.255358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 373 sessionId: src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0 is DEAD
2025-10-01T14:07:51.255405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254813969676597:4446]
2025-10-01T14:07:51.255430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:51.255711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:51.255719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0] Write session will restart in 0.008220s
2025-10-01T14:07:51.255744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0] Write session: Do CDS request
2025-10-01T14:07:51.255749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:51.254193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.254257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.254260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.254322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.254394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.254455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.254620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.254665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.254668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.255724Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:51.264943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:51.265046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:51.265059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 374
2025-10-01T14:07:51.265328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:51.265363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:51.265371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:51.265375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:51.265808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 374 sessionId:  describe result for acl check
2025-10-01T14:07:51.265852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:51.265858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:51.265860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:51.265866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254813969676695:4904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:51.266406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254813969676695:4904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:51.269427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254813969676695:4904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:51.270883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:51.272969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:51.273136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254813969676695:4904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:51.273151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254813969676695:4904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:51.273155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254813969676695:4904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:51.273163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:51.273218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:51.273236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:51.273249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:51.273322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:51.273362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254811592814917:4462]
2025-10-01T14:07:51.273955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:51.274261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:51.274303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:51.274618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:51.274693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.274698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.274700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.274701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.274702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.274703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.274704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.274705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.274706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.274707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.274709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.274709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.274711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.274712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.274718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.274728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.274732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.274755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.274762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.274766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.274769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.274773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.274776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.274780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.274784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.274787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.274791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.274794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.274802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.274810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.274824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.274829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.274833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.274838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.274842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.274848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.274852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.274857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.274861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.274867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.274871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.274876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.274885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.274890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.274895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.274899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.274908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.274913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.274918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.274923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.274927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.274932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.274939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.274944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.274952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.274957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.274994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:51.280724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:51.281375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:51.281392Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:51.281394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:51.281398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:51.281406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 373 [2:7556254811592814917:4462]
2025-10-01T14:07:51.281422Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:51.281442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:51.281450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.281454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.281457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.281476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:51.281489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:51.281495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:51.281560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.281567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.281570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.281573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:51.281576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:51.281862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:51.281871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.281882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.281898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.281906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 373
2025-10-01T14:07:51.281920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:51.281931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 373
2025-10-01T14:07:51.281943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969676622:2446], now have 1 active actors on pipe
2025-10-01T14:07:51.281946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969676818:4904], now have 1 active actors on pipe
2025-10-01T14:07:51.281954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254811592814912:4462]
2025-10-01T14:07:51.281956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254811592814912:4462]
2025-10-01T14:07:51.281958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254811592814912:4462]
2025-10-01T14:07:51.281973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:51.281992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:51.282011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:51.282014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:51.282037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:51.282047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:51.282049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:51.282064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.282073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.282085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254811592814912:4462]
2025-10-01T14:07:51.282096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:51.282103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:51.282128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:51.282138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.282142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.282148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:51.282158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.282171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:51.282195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.282359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.282367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.282391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.282505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 374 partition: 0 MaxSeqNo: 45 sessionId: src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0
2025-10-01T14:07:51.282869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0e39b7-94bd398b-7abfaae2-3df51032_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:51.285311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0] Write session: try to update token
2025-10-01T14:07:51.285332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:51.310155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 374 sessionId: src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:51.312505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:51.314576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.314613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.314653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:51.314789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:51.319810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:51.319831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:51.319833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:51.319835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:51.319844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254811592814912:4462]
2025-10-01T14:07:51.319850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254811592814912:4462]
2025-10-01T14:07:51.319853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254811592814912:4462]
2025-10-01T14:07:51.319898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:51.319904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:51.319912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.319914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:51.319925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:51.319928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:51.320048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:51.355445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254813969676829:4446]
2025-10-01T14:07:51.355773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 373, pipe: [1:7556254813969676829:4446]
2025-10-01T14:07:51.469498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:51.477493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.477522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.477697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.477759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.477825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.477891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.477943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.477952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.478020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.478080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.478139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.478203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.478250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.478257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.478319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.478431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.478521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.478607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.478648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.478655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.478717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.478783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.478848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.478910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.478958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.478966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.479028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.479085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.479146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.479203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.479248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.479260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.479360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.481131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254813969676829:4446]
2025-10-01T14:07:51.481158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:51.481174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:51.481176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:51.481202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 374 reason: error at write: Disconnected sessionId: src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0
2025-10-01T14:07:51.481458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 374 sessionId: src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0 is DEAD
2025-10-01T14:07:51.481596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:51.481607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0] Write session will restart in 0.008669s
2025-10-01T14:07:51.481631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0] Write session: Do CDS request
2025-10-01T14:07:51.481637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:51.479452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.479523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.479579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.479623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.479626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.479687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.479743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.479806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.479863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.479905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.479908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.479968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.480020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.480071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.480132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.480175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.480178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.480241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.480297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.480358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.480413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.480528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.480531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.480599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.480656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.480724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.480787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.480847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.480850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.480921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969676829:4446], now have 1 active actors on pipe
2025-10-01T14:07:51.482038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:51.492034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:51.492171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:51.492183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 375
2025-10-01T14:07:51.492357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:51.492399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:51.492409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:51.492412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:51.492820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 375 sessionId:  describe result for acl check
2025-10-01T14:07:51.492859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:51.492867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:51.492869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:51.492877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254813969676868:4908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:51.493396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254813969676868:4908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:51.497716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254813969676868:4908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:51.505307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254813969676868:4908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:51.505330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254813969676868:4908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:51.505334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254813969676868:4908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:51.505342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:51.505445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:51.508298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:51.508559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:51.508571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:51.508583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:51.508638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:51.508676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254811592815120:4465]
2025-10-01T14:07:51.509306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:51.509645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:51.509712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:51.510049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:51.510112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.510113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.510114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.510115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.510116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.510118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.510119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.510120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.510121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.510122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.510123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.510125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.510126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.510128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.510133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.510143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.510147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.510151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.510155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.510159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.510163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.510167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.510171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.510175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.510178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.510182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.510186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.510189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.510196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.510203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.510210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.510216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.510220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.510225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.510229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.510234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.510238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.510242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.510246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.510250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.510255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.510259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.510262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.510268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.510272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.510278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.510283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.510288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.510292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.510297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.510301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.510306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.510310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.510315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.510319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.510324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.510365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:51.514814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:51.515436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:51.515453Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:51.515456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:51.515460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:51.515467Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 374 [2:7556254811592815120:4465]
2025-10-01T14:07:51.515485Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:51.515503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:51.515511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.515515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.515518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.515536Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:51.515546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:51.515552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:51.515611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.515618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.515620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.515623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:51.515627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:51.515694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:51.515704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.515717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.515730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.515747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:51.515771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969677027:4908], now have 1 active actors on pipe
2025-10-01T14:07:51.515780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969676832:2446], now have 1 active actors on pipe
2025-10-01T14:07:51.515789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254811592815113:4465]
2025-10-01T14:07:51.515792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254811592815113:4465]
2025-10-01T14:07:51.515794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254811592815113:4465]
2025-10-01T14:07:51.515809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:51.515880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 374
2025-10-01T14:07:51.515915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 374
2025-10-01T14:07:51.515824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:51.515825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:51.515837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:51.515839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:51.515842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:51.515845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:51.515882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254811592815113:4465]
2025-10-01T14:07:51.515892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:51.515911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:51.515940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.515945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.515968Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95a30f6-210327bd-e8b83e12-50622618_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:51.515976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.515981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.515983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:51.515993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.516001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:51.516015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.516189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.516198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.516211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.516297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 375 partition: 0 MaxSeqNo: 45 sessionId: src_id|95a30f6-210327bd-e8b83e12-50622618_0
2025-10-01T14:07:51.516731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cc4dfc5-c53010fc-bb1b3f5f-d6693e36_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|95a30f6-210327bd-e8b83e12-50622618_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:51.519736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95a30f6-210327bd-e8b83e12-50622618_0] Write session: try to update token
2025-10-01T14:07:51.519761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95a30f6-210327bd-e8b83e12-50622618_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:51.542636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:51.542660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:51.542671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254811592815113:4465]
2025-10-01T14:07:51.542722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:51.542720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:51.542918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:51.543071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:51.543213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:51.543357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:51.543543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:51.543578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:51.548297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 375 sessionId: src_id|95a30f6-210327bd-e8b83e12-50622618_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:51.551382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:51.551681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.551704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.551744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:51.551853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:51.561109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:51.561131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:51.561133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:51.561135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:51.561146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254811592815113:4465]
2025-10-01T14:07:51.561150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254811592815113:4465]
2025-10-01T14:07:51.561154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254811592815113:4465]
2025-10-01T14:07:51.561201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:51.561204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:51.561210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.561213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:51.561215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:51.561219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:51.561339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:51.581929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254813969677039:4446]
2025-10-01T14:07:51.582318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 374, pipe: [1:7556254813969677039:4446]
2025-10-01T14:07:51.738917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:51.747156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.747183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.747348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.747411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.747473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.747540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.747586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.747595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.747661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.747726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.747793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.747857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.747901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.747908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.747966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.748018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.748086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.748158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.748206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.748214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.748287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.748372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.748445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.748513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.748743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.748753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.748830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.748887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.748946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.749007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.749049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.749055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.749124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.749183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.749245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.749309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.749351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.749358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.749422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.749482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.749541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.749604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.749651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.749657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.749718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.749773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.749836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.749896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.749940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.749947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.750011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.750150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.750265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.750402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.750447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.750454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.750612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.750667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.750723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.750791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.750838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.750848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.750911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969677039:4446], now have 1 active actors on pipe
2025-10-01T14:07:51.751941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:51.754500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:51.754503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254813969677039:4446]
2025-10-01T14:07:51.754525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:51.754527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:51.754556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 375 reason: error at write: Disconnected sessionId: src_id|95a30f6-210327bd-e8b83e12-50622618_0
2025-10-01T14:07:51.754759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 375 sessionId: src_id|95a30f6-210327bd-e8b83e12-50622618_0 is DEAD
2025-10-01T14:07:51.754868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a30f6-210327bd-e8b83e12-50622618_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:51.754879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a30f6-210327bd-e8b83e12-50622618_0] Write session will restart in 0.005856s
2025-10-01T14:07:51.754904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a30f6-210327bd-e8b83e12-50622618_0] Write session: Do CDS request
2025-10-01T14:07:51.754912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a30f6-210327bd-e8b83e12-50622618_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:51.761943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95a30f6-210327bd-e8b83e12-50622618_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:51.762031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:51.762046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 376
2025-10-01T14:07:51.762163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:51.762190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:51.762196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:51.762199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:51.762674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 376 sessionId:  describe result for acl check
2025-10-01T14:07:51.762703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:51.762705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:51.762707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:51.762712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254813969677094:4920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:51.763246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254813969677094:4920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:51.768036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254813969677094:4920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:51.770963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:51.772229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254813969677094:4920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:51.772244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254813969677094:4920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:51.772247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254813969677094:4920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:51.772256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:51.773846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:51.774175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:51.774187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:51.774200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:51.774262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:51.774301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254811592815330:4470]
2025-10-01T14:07:51.774938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:51.775282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:51.775324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:51.775676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:51.775748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.775749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.775750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.775751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.775752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.775753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.775755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.775756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.775757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.775758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.775759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.775760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.775761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.775763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.775768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.775779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.775783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.775788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.775792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.775796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.775800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.775804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.775809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.775813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.775818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.775822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.775826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.775830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.775836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.775845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:51.775851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.775857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:51.775863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.775869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:51.775874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.775879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:51.775884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.775889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:51.775894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.775900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:51.775905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.775910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:51.775914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.775921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:51.775926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.775931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:51.775935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.775942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.775947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.775952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.775957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.775962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.775967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.775972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:51.775977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.775983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:51.776027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:51.780736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:51.781394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:51.781411Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:51.781414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:51.781417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:51.781425Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 375 [2:7556254811592815330:4470]
2025-10-01T14:07:51.781442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:51.781465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:51.781468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.781473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.781475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.781494Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:51.781499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:51.781505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:51.781562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.781572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.781574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.781577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:51.781580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:51.781649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:51.781657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.781669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:51.781681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:51.781704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:51.781782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 375
2025-10-01T14:07:51.781806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 375
2025-10-01T14:07:51.781728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969677069:2446], now have 1 active actors on pipe
2025-10-01T14:07:51.781737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969677263:4920], now have 1 active actors on pipe
2025-10-01T14:07:51.781744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254811592815324:4470]
2025-10-01T14:07:51.781746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254811592815324:4470]
2025-10-01T14:07:51.781749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254811592815324:4470]
2025-10-01T14:07:51.781765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:51.781779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:51.781782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:51.781785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:51.781788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:51.781793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:51.781796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:51.781834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254811592815324:4470]
2025-10-01T14:07:51.781842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:51.781855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:51.781863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.781868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.781916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89bf45d2-ee8a238d-a418e936-c8004037_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:51.781930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:51.781935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:51.781937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:51.781946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:51.781955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:51.781977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.782148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.782157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.782172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:51.782251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 376 partition: 0 MaxSeqNo: 45 sessionId: src_id|89bf45d2-ee8a238d-a418e936-c8004037_0
2025-10-01T14:07:51.782655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95a30f6-210327bd-e8b83e12-50622618_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|89bf45d2-ee8a238d-a418e936-c8004037_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:51.785344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89bf45d2-ee8a238d-a418e936-c8004037_0] Write session: try to update token
2025-10-01T14:07:51.785364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89bf45d2-ee8a238d-a418e936-c8004037_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:51.807224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 376 sessionId: src_id|89bf45d2-ee8a238d-a418e936-c8004037_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:51.809788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:51.810024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.810052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.810101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:51.810175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:51.817846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:51.817868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:51.817871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:51.817873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:51.817881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254811592815324:4470]
2025-10-01T14:07:51.817886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254811592815324:4470]
2025-10-01T14:07:51.817890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254811592815324:4470]
2025-10-01T14:07:51.817940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:51.817947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:51.817946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:51.817951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:51.817953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:51.817956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:51.818077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:51.854802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254813969677277:4446]
2025-10-01T14:07:51.855112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 375, pipe: [1:7556254813969677277:4446]
2025-10-01T14:07:51.971290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:51.979440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:51.979473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:51.979649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.979714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.979781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.979850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.979901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.979911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.979982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.980046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.980115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.980188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.980239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.980247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.980309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.980366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.980427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.980483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.980526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.980534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.980595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.980656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.980718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.980781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.980838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.980850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.980908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.980968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.981026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.981083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.981131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.981140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.981200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.981260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.981328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.981395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.981445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.981454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.981519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.981577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.981640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.981704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.981751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.981758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.981824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.981883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.981948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.982014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.982063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.982070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.982143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.982211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.982275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.982343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.982414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.982421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.982495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:51.982560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:51.982626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:51.982692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:51.982739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:51.982746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:51.982842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969677277:4446], now have 1 active actors on pipe
2025-10-01T14:07:51.983085Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:51.983106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:51.983111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:51.983140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254813969677277:4446]
2025-10-01T14:07:51.983141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 376 reason: error at write: Disconnected sessionId: src_id|89bf45d2-ee8a238d-a418e936-c8004037_0
2025-10-01T14:07:51.983337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 376 sessionId: src_id|89bf45d2-ee8a238d-a418e936-c8004037_0 is DEAD
2025-10-01T14:07:51.983522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89bf45d2-ee8a238d-a418e936-c8004037_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:51.983538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89bf45d2-ee8a238d-a418e936-c8004037_0] Write session will restart in 0.009043s
2025-10-01T14:07:51.983570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89bf45d2-ee8a238d-a418e936-c8004037_0] Write session: Do CDS request
2025-10-01T14:07:51.983578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89bf45d2-ee8a238d-a418e936-c8004037_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:51.983855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:51.993872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89bf45d2-ee8a238d-a418e936-c8004037_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:51.994146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:51.994167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 377
2025-10-01T14:07:51.994385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:51.994437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:51.994443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:51.994447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:51.995262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 377 sessionId:  describe result for acl check
2025-10-01T14:07:51.995307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:51.995309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:51.995311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:51.995317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254813969677402:4924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:51.998737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:51.998112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254813969677402:4924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:52.001128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:52.001350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:52.001363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:52.001375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:52.001425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:52.001478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254815887782859:4482]
2025-10-01T14:07:52.002077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:52.002488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:52.002540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:52.002848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:52.002912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.002920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.002922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.002923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.002924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.002925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.002926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.002928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.002929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.002930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.002931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.002932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.002934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.002935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.002940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.002950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.002953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.002957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.002961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.002965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.002968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.002972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.002975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.002979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.002982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.002986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.002990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.002994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.003001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.003009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.003014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.003019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.003024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.003029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.003033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.003040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.003044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.003048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.003051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.003055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.003059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.003064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.003069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.003074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.003078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.003090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.003095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.003102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.003106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.003110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.003114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.003119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.003123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.003128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.003132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.003141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.003180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:52.003974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254813969677402:4924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:52.008010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:52.007713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254813969677402:4924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:52.007727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254813969677402:4924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:52.007730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254813969677402:4924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:52.007736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:52.008638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:52.008655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:52.008657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:52.008662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:52.008669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 376 [2:7556254815887782859:4482]
2025-10-01T14:07:52.008685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:52.008700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:52.008708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.008712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.008714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.008731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:52.008742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:52.008748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:52.008801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.008822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.008824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.008827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:52.008830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:52.008901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:52.008908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.008921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.008936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.008954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:52.008975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254811592815558:4482]
2025-10-01T14:07:52.008981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254811592815558:4482]
2025-10-01T14:07:52.008983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254811592815558:4482]
2025-10-01T14:07:52.008996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:52.009013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:52.009019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254813969677282:2446], now have 1 active actors on pipe
2025-10-01T14:07:52.009022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264644777:4924], now have 1 active actors on pipe
2025-10-01T14:07:52.009023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:52.009030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:52.009041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:52.009043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:52.009045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:52.009078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254811592815558:4482]
2025-10-01T14:07:52.009086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:52.009088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:52.009116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.009124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.009156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|263bee4e-10c50c48-336bbe47-bbc4288_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:52.009170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.009174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.009177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:52.009186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.009195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:52.009216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.009479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.009488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.009504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.009056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 376
2025-10-01T14:07:52.009064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 376
2025-10-01T14:07:52.010269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89bf45d2-ee8a238d-a418e936-c8004037_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|263bee4e-10c50c48-336bbe47-bbc4288_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:52.009905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 377 partition: 0 MaxSeqNo: 45 sessionId: src_id|263bee4e-10c50c48-336bbe47-bbc4288_0
2025-10-01T14:07:52.012785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|263bee4e-10c50c48-336bbe47-bbc4288_0] Write session: try to update token
2025-10-01T14:07:52.012841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|263bee4e-10c50c48-336bbe47-bbc4288_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:52.033016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:52.033038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:52.033041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:52.033043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:52.033053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254811592815558:4482]
2025-10-01T14:07:52.033059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254811592815558:4482]
2025-10-01T14:07:52.033062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254811592815558:4482]
2025-10-01T14:07:52.033114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:52.033126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.033129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:52.033133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:52.033162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:52.033173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:52.033271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:52.041543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 377 sessionId: src_id|263bee4e-10c50c48-336bbe47-bbc4288_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:52.044663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:52.083547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254818264644787:4446]
2025-10-01T14:07:52.083904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 376, pipe: [1:7556254818264644787:4446]
2025-10-01T14:07:52.183584Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:52.183915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.183932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.183975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264644787:4446], now have 1 active actors on pipe
2025-10-01T14:07:52.184175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254818264644787:4446]
2025-10-01T14:07:52.184183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:52.184215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:52.184217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:52.184289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 377 reason: error at write: Disconnected sessionId: src_id|263bee4e-10c50c48-336bbe47-bbc4288_0
2025-10-01T14:07:52.184338Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:52.184496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 377 sessionId: src_id|263bee4e-10c50c48-336bbe47-bbc4288_0 is DEAD
2025-10-01T14:07:52.184624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263bee4e-10c50c48-336bbe47-bbc4288_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:52.184636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263bee4e-10c50c48-336bbe47-bbc4288_0] Write session will restart in 0.009857s
2025-10-01T14:07:52.184664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263bee4e-10c50c48-336bbe47-bbc4288_0] Write session: Do CDS request
2025-10-01T14:07:52.184670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263bee4e-10c50c48-336bbe47-bbc4288_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:52.196002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|263bee4e-10c50c48-336bbe47-bbc4288_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:52.197053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:52.197071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 378
2025-10-01T14:07:52.197211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:52.197246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:52.197259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:52.197262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:52.197684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 378 sessionId:  describe result for acl check
2025-10-01T14:07:52.197716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:52.197717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:52.197719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:52.197722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254818264644860:4932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:52.198137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254818264644860:4932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:52.203565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254818264644860:4932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:52.206796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254818264644860:4932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:52.206813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254818264644860:4932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:52.206817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254818264644860:4932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:52.206828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:52.208246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:52.212146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:52.212394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:52.212403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:52.212416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:52.212480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:52.212517Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254815887783075:4485]
2025-10-01T14:07:52.213117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:52.213469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:52.213512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:52.213807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:52.213857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.213863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.213864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.213865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.213867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.213868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.213869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.213870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.213872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.213873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.213874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.213875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.213876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.213877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.213883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.213892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.213896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.213900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.213904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.213907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.213911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.213915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.213919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.213921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.213923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.213924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.213926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.213928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.213933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.213937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.213941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.213944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.213946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.213949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.213952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.213955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.213957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.213960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.213963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.213966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.213970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.213975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.213979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.213984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.213988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.213994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.213998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.214002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.214005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.214009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.214011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.214013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.214016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.214018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.214021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.214024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.214045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:52.224936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:52.225541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:52.225559Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:52.225562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:52.225566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:52.225573Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 377 [2:7556254815887783075:4485]
2025-10-01T14:07:52.225590Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:52.225609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:52.225613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.225618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.225621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.225641Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:52.225654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:52.225661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:52.225717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.225724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.225726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.225728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:52.225732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:52.225803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:52.225811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.225821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.225831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.225850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:52.225874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254815887783070:4485]
2025-10-01T14:07:52.225876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254815887783070:4485]
2025-10-01T14:07:52.225878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254815887783070:4485]
2025-10-01T14:07:52.225894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:52.225910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645006:4932], now have 1 active actors on pipe
2025-10-01T14:07:52.225918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264644807:2446], now have 1 active actors on pipe
2025-10-01T14:07:52.225927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:52.225943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:52.225950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:52.225990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254815887783070:4485]
2025-10-01T14:07:52.225997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:52.225993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 377
2025-10-01T14:07:52.226036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 377
2025-10-01T14:07:52.226107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:52.226124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:52.226127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:52.226136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:52.226180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.226192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.226222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b90315fa-1f625697-128a01dc-fe994f84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:52.226234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.226239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.226241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:52.226249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.226259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:52.226273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.226452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.226460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.226473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.226599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 378 partition: 0 MaxSeqNo: 45 sessionId: src_id|b90315fa-1f625697-128a01dc-fe994f84_0
2025-10-01T14:07:52.227125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|263bee4e-10c50c48-336bbe47-bbc4288_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b90315fa-1f625697-128a01dc-fe994f84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:52.229547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b90315fa-1f625697-128a01dc-fe994f84_0] Write session: try to update token
2025-10-01T14:07:52.229566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b90315fa-1f625697-128a01dc-fe994f84_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:52.238527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:52.238550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:52.238561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254815887783070:4485]
2025-10-01T14:07:52.238610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:52.238817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:52.238985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:52.239145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:52.239295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:52.239516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:52.239547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:52.241966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:52.257822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 378 sessionId: src_id|b90315fa-1f625697-128a01dc-fe994f84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:52.260762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:52.262344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.262390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.262413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:52.262416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:52.262418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:52.262420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:52.262432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254815887783070:4485]
2025-10-01T14:07:52.262436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254815887783070:4485]
2025-10-01T14:07:52.262444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254815887783070:4485]
2025-10-01T14:07:52.262510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:52.262511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:52.262518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.262518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:52.262520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:52.262525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:52.262684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:52.284212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254818264645023:4446]
2025-10-01T14:07:52.284978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 377, pipe: [1:7556254818264645023:4446]
2025-10-01T14:07:52.406344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:52.406947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:52.406991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645023:4446], now have 1 active actors on pipe
2025-10-01T14:07:52.407100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:52.407130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:52.407176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254818264645023:4446]
2025-10-01T14:07:52.407189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:52.407191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:52.407257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 378 reason: error at write: Disconnected sessionId: src_id|b90315fa-1f625697-128a01dc-fe994f84_0
2025-10-01T14:07:52.407414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 378 sessionId: src_id|b90315fa-1f625697-128a01dc-fe994f84_0 is DEAD
2025-10-01T14:07:52.407552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90315fa-1f625697-128a01dc-fe994f84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:52.407564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90315fa-1f625697-128a01dc-fe994f84_0] Write session will restart in 0.008631s
2025-10-01T14:07:52.407588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90315fa-1f625697-128a01dc-fe994f84_0] Write session: Do CDS request
2025-10-01T14:07:52.407598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90315fa-1f625697-128a01dc-fe994f84_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:52.417922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b90315fa-1f625697-128a01dc-fe994f84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:52.418195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:52.418209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 379
2025-10-01T14:07:52.418354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:52.418409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:52.418423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:52.418427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:52.418888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 379 sessionId:  describe result for acl check
2025-10-01T14:07:52.418927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:52.419060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:52.419077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:52.419083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254818264645128:4936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:52.419590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254818264645128:4936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:52.421698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254818264645128:4936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:52.422239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:52.424970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254818264645128:4936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:52.424984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254818264645128:4936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:52.424988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254818264645128:4936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:52.425013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:52.425216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:52.425432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:52.425447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:52.425459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:52.425502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:52.425531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254815887783280:4488]
2025-10-01T14:07:52.425928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:52.426166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:52.426192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:52.426491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:52.426532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.426537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.426537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.426538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.426539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.426539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.426540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.426541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.426541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.426542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.426543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.426544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.426544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.426545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.426549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.426554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.426556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.426559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.426561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.426563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.426565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.426568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.426570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.426572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.426574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.426576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.426578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.426580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.426586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.426593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.426598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.426602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.426606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.426610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.426613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.426618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.426622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.426627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.426630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.426635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.426639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.426644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.426650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.426654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.426658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.426662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.426665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.426670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.426675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.426679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.426683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.426687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.426692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.426696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.426701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.426705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.426732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:52.430703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:52.431245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:52.431258Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:52.431260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:52.431263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:52.431269Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 378 [2:7556254815887783280:4488]
2025-10-01T14:07:52.431279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:52.431292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:52.431294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.431296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.431302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.431314Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:52.431320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:52.431325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:52.431369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.431374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.431375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.431378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:52.431380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:52.431430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:52.431436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.431443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.431452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.431463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:52.431477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645225:4936], now have 1 active actors on pipe
2025-10-01T14:07:52.431482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645025:2446], now have 1 active actors on pipe
2025-10-01T14:07:52.431488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254815887783275:4488]
2025-10-01T14:07:52.431490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254815887783275:4488]
2025-10-01T14:07:52.431491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254815887783275:4488]
2025-10-01T14:07:52.431501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:52.431509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:52.431518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:52.431518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:52.431521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:52.431530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:52.431537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:52.431562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254815887783275:4488]
2025-10-01T14:07:52.431558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 378
2025-10-01T14:07:52.431576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:52.431562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 378
2025-10-01T14:07:52.431585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:52.431614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.431622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.431644Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:52.431652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.431659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.431660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:52.431667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.431676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:52.431688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.431815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.431827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.431846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.431908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 379 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0
2025-10-01T14:07:52.432257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b90315fa-1f625697-128a01dc-fe994f84_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:52.434763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0] Write session: try to update token
2025-10-01T14:07:52.434782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:52.448698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:52.448720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:52.448730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254815887783275:4488]
2025-10-01T14:07:52.448781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:52.448784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:52.448976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:52.449133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:52.449277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:52.449423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:52.449618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:52.449659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:52.450343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 379 sessionId: src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:52.452843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:52.453090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.453109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.453142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:52.453252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:52.464532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:52.464552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:52.464555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:52.464557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:52.464567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254815887783275:4488]
2025-10-01T14:07:52.464571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254815887783275:4488]
2025-10-01T14:07:52.464574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254815887783275:4488]
2025-10-01T14:07:52.464619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:52.464623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:52.464633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.464636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:52.464637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:52.464641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:52.464764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:52.507447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254818264645237:4446]
2025-10-01T14:07:52.507787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 378, pipe: [1:7556254818264645237:4446]
2025-10-01T14:07:52.621806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:52.629295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.629319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.629461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.629510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.629560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.629615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.629655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.629661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.629720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.629774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.629825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.629895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.629937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.629946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.630015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.630070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.630129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.630187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.630233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.630241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.630300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.630358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.630430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.630485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.630523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.630530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.630591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.630647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.630695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.630751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.630794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.630799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.630859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.630913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.630973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.631028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.631069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.631074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.631132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.631184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.631239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.631297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.631342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.631348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.631408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.631462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.631513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.631567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.631607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.631615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.631670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.631721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.631772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.631825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.631866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.631872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.631930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.631985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.632042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.632097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.632141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.632147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.632208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645237:4446], now have 1 active actors on pipe
2025-10-01T14:07:52.632510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:52.632529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254818264645237:4446]
2025-10-01T14:07:52.632559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:52.632568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:52.632593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 379 reason: error at write: Disconnected sessionId: src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0
2025-10-01T14:07:52.632799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 379 sessionId: src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0 is DEAD
2025-10-01T14:07:52.632960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:52.632972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0] Write session will restart in 0.009400s
2025-10-01T14:07:52.633009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0] Write session: Do CDS request
2025-10-01T14:07:52.633016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:52.633145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:52.643933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:52.644553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:52.644572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 380
2025-10-01T14:07:52.644723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:52.644754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:52.644759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:52.644763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:52.646053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 380 sessionId:  describe result for acl check
2025-10-01T14:07:52.646096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:52.646098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:52.646099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:52.646104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254818264645319:4941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:52.646677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254818264645319:4941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:52.650608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254818264645319:4941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:52.654342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254818264645319:4941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:52.654361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254818264645319:4941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:52.654364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254818264645319:4941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:52.654387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:52.656162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:52.660987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:52.661264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:52.661284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:52.661297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:52.661363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:52.661423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254815887783489:4490]
2025-10-01T14:07:52.662168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:52.662612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:52.662670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:52.663037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:52.663116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.663124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.663126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.663127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.663129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.663131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.663133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.663134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.663136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.663137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.663139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.663140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.663141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.663143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.663150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.663161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.663165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.663169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.663172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.663176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.663180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.663184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.663188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.663193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.663196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.663200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.663204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.663208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.663216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.663225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.663231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.663237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.663243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.663249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.663254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.663260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.663275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.663286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.663297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.663303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.663314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.663324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.663328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.663333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.663338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.663348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.663357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.663367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.663376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.663383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.663393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.663399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.663409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.663420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.663426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.663432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.663476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:52.667756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:52.668486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:52.668505Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:52.668508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:52.668513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:52.668520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 379 [2:7556254815887783489:4490]
2025-10-01T14:07:52.668539Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:52.668564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:52.668567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.668571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.668574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.668591Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:52.668597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:52.668605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:52.668668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.668671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.668674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.668678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:52.668681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:52.668751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:52.668760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.668773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.668784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.668800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:52.668835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645242:2446], now have 1 active actors on pipe
2025-10-01T14:07:52.668844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645442:4941], now have 1 active actors on pipe
2025-10-01T14:07:52.668851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254815887783483:4490]
2025-10-01T14:07:52.668854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254815887783483:4490]
2025-10-01T14:07:52.668857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254815887783483:4490]
2025-10-01T14:07:52.668872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:52.668890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:52.668895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:52.668899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:52.668901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:52.668909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:52.668912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:52.668915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 379
2025-10-01T14:07:52.668960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 379
2025-10-01T14:07:52.668950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254815887783483:4490]
2025-10-01T14:07:52.668959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:52.668966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:52.668996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.669005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.669031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:52.669041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.669046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.669052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:52.669063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.669077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:52.669094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.669312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.669323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.669348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.669445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 380 partition: 0 MaxSeqNo: 45 sessionId: src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0
2025-10-01T14:07:52.669839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca1c5f6-d67e1ec4-528eb093-c98aece4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:52.672773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0] Write session: try to update token
2025-10-01T14:07:52.672789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:52.694703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 380 sessionId: src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:52.697564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:52.697800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.697822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.697855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:52.698284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:52.703109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:52.703137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:52.703140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:52.703143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:52.703154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254815887783483:4490]
2025-10-01T14:07:52.703159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254815887783483:4490]
2025-10-01T14:07:52.703165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254815887783483:4490]
2025-10-01T14:07:52.703218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:52.703232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.703234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:52.703402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:52.707102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:52.707126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:52.707129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:52.732678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254818264645467:4446]
2025-10-01T14:07:52.733094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 379, pipe: [1:7556254818264645467:4446]
2025-10-01T14:07:52.845399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:52.853498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.853528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.853693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.853759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.853824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.853882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.854107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.854112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.854176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.854233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.854295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.854361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.854427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.854431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.854492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.854542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.854594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.854643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.854685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.854687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.854745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.854797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.854847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.854908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.854949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.854955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.855014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.855068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.855122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.855187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.855230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.855238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.855297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.855349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.855411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.855477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.855526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.855535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.855595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.855654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.855717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.855780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.855826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.855834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.855892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.855950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.856004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.856071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.856114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.856122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.856188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.856251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.856311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.856372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.856419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.856431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.856499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:52.856562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:52.856625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:52.856685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:52.856730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:52.856742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:52.856837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645467:4446], now have 1 active actors on pipe
2025-10-01T14:07:52.857174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:52.857202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254818264645467:4446]
2025-10-01T14:07:52.857219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:52.857221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:52.857242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 380 reason: error at write: Disconnected sessionId: src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0
2025-10-01T14:07:52.857396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 380 sessionId: src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0 is DEAD
2025-10-01T14:07:52.857533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:52.857541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0] Write session will restart in 0.006648s
2025-10-01T14:07:52.857569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0] Write session: Do CDS request
2025-10-01T14:07:52.857575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:52.857660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:52.865985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:52.866068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:52.866085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 381
2025-10-01T14:07:52.866303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:52.866337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:52.866346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:52.866351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:52.866816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 381 sessionId:  describe result for acl check
2025-10-01T14:07:52.866863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:52.867052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:52.867060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:52.867067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254818264645526:4952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:52.867595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254818264645526:4952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:52.870652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254818264645526:4952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:52.874446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254818264645526:4952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:52.874463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254818264645526:4952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:52.874466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254818264645526:4952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:52.874475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:52.880825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:52.883763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:52.883996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:52.884007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:52.884019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:52.884065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:52.884104Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254815887783703:4495]
2025-10-01T14:07:52.884643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:52.885008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:52.885074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:52.885373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:52.885468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.885479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.885480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.885481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.885483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.885484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.885485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.885486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.885487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.885489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.885490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.885491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.885492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.885493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.885500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.885510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.885515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.885518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.885522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.885526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.885529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.885533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.885536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.885540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.885543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.885547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.885551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.885555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.885564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.885572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:52.885578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.885583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:52.885588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.885592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:52.885597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.885602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:52.885606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.885611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:52.885617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.885622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:52.885626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.885637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:52.885641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.885650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:52.885654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.885664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:52.885668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.885676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.885681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.885690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.885694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.885699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.885707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.885713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:52.885721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.885726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:52.885764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:52.889849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:52.890441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:52.890452Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:52.890453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:52.890456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:52.890462Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 380 [2:7556254815887783703:4495]
2025-10-01T14:07:52.890473Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:52.890488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:52.890490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.890492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.890494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.890506Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:52.890510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:52.890515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:52.890554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.890559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.890560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.890562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:52.890565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:52.890623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:52.890630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.890640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:52.890650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:52.890668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:52.890690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645479:2446], now have 1 active actors on pipe
2025-10-01T14:07:52.890700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254815887783698:4495]
2025-10-01T14:07:52.890704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254815887783698:4495]
2025-10-01T14:07:52.890706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254815887783698:4495]
2025-10-01T14:07:52.890717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:52.890728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645639:4952], now have 1 active actors on pipe
2025-10-01T14:07:52.890734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:52.890738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:52.890743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:52.890745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:52.890746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:52.890747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:52.890774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254815887783698:4495]
2025-10-01T14:07:52.890782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:52.890789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:52.890770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 380
2025-10-01T14:07:52.890800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 380
2025-10-01T14:07:52.890839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.890846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.890864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:52.890873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:52.890875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:52.890877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:52.890883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:52.890890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:52.890903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.891070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.891078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.891091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:52.891182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 381 partition: 0 MaxSeqNo: 45 sessionId: src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0
2025-10-01T14:07:52.891551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2efc4c7-a4527ba4-7931eddc-75a01e62_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:52.894325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0] Write session: try to update token
2025-10-01T14:07:52.894347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:52.902477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:52.902494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:52.902505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254815887783698:4495]
2025-10-01T14:07:52.902555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:52.902567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:52.902740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:52.902884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:52.903023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:52.903175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:52.903390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:52.903436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:52.912424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 381 sessionId: src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:52.915463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:52.915921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:52.915944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:52.915984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:52.916125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:52.936371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:52.936398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:52.936401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:52.936404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:52.936416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254815887783698:4495]
2025-10-01T14:07:52.936421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254815887783698:4495]
2025-10-01T14:07:52.936425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254815887783698:4495]
2025-10-01T14:07:52.936480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:52.936496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:52.936499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:52.936541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:52.936559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:52.936563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:52.936670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:52.957483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254818264645693:4446]
2025-10-01T14:07:52.957785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 380, pipe: [1:7556254818264645693:4446]
2025-10-01T14:07:53.082910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:53.090092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.090115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.090270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.090330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.090411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.090469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.090514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.090524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.090591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.090650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.090711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.090770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.090811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.090819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.090879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.090934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.090989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.091043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.091083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.091090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.091144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.091196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.091274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.091329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.091374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.091380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.091438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.091488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.091549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.091607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.091647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.091654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.091710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.091768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.091823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.091881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.091924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.091931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.092004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.092060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.092122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.092183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.092226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.092234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.092296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.092352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.092411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.092472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.092518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.092524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.092589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.092644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.092701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.092761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.092817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.092824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.092882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.092937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.092996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.093052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.093101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.093109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.093159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254818264645693:4446], now have 1 active actors on pipe
2025-10-01T14:07:53.093451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:53.093453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254818264645693:4446]
2025-10-01T14:07:53.093467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:53.093474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:53.093495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 381 reason: error at write: Disconnected sessionId: src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0
2025-10-01T14:07:53.093694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 381 sessionId: src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0 is DEAD
2025-10-01T14:07:53.093807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:53.093818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0] Write session will restart in 0.007289s
2025-10-01T14:07:53.093842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0] Write session: Do CDS request
2025-10-01T14:07:53.093855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:53.094146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:53.101907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.102241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:53.102261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 382
2025-10-01T14:07:53.104960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.105016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:53.105026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:53.105030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:53.105583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 382 sessionId:  describe result for acl check
2025-10-01T14:07:53.105617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:53.105623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:53.105625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:53.105630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254822559613053:4956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:53.106132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254822559613053:4956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:53.109813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254822559613053:4956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:53.111390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:53.114242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:53.114482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:53.114495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:53.114507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:53.114568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:53.114643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254820182751246:4508]
2025-10-01T14:07:53.115021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254822559613053:4956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:53.115036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254822559613053:4956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:53.115040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254822559613053:4956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:53.115048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:53.115221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:53.115606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:53.115683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:53.116069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:53.116152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.116161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.116162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.116163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.116164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.116165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.116167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.116169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.116170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.116171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.116173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.116174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.116176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.116177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.116184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.116195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.116199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.116204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.116207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.116212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.116216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.116220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.116223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.116227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.116231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.116235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.116238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.116242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.116252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.116260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.116267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.116273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.116278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.116284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.116289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.116295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.116299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.116311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.116318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.116334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.116344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.116350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.116355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.116366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.116371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.116377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.116386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.116391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.116396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.116401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.116411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.116417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.116427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.116432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.116436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.116442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.116483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:53.121367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:53.122022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:53.122040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:53.122044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:53.122048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:53.122056Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 381 [2:7556254820182751246:4508]
2025-10-01T14:07:53.122074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:53.122095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:53.122108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.122112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.122114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.122132Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:53.122137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:53.122144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:53.122215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.122223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.122226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.122229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:53.122232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:53.122305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:53.122313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.122327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.122339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.122363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:53.122406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559612993:2446], now have 1 active actors on pipe
2025-10-01T14:07:53.122415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613194:4956], now have 1 active actors on pipe
2025-10-01T14:07:53.122422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254820182751241:4508]
2025-10-01T14:07:53.122424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254820182751241:4508]
2025-10-01T14:07:53.122427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254820182751241:4508]
2025-10-01T14:07:53.122444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:53.122461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:53.122469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:53.122473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:53.122476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:53.122481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:53.122485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:53.122470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 381
2025-10-01T14:07:53.122473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 381
2025-10-01T14:07:53.122525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254820182751241:4508]
2025-10-01T14:07:53.122536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:53.122537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:53.122556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.122561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.122609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:53.122620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.122624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.122631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:53.122642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.122656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:53.122679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.122943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.122956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.122979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.123082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 382 partition: 0 MaxSeqNo: 45 sessionId: src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0
2025-10-01T14:07:53.123480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|574267a7-6bb53bd0-870df6ee-60843d1e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:53.126342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0] Write session: try to update token
2025-10-01T14:07:53.126359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:53.145292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:53.145316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:53.145318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:53.145320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:53.145329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254820182751241:4508]
2025-10-01T14:07:53.145342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254820182751241:4508]
2025-10-01T14:07:53.145349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254820182751241:4508]
2025-10-01T14:07:53.145393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:53.145396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:53.145403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.145405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:53.145407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:53.145411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:53.145567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:53.148055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 382 sessionId: src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:53.150616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:53.194027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254822559613223:4446]
2025-10-01T14:07:53.194405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 381, pipe: [1:7556254822559613223:4446]
2025-10-01T14:07:53.289157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:53.289697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.289714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.289747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613223:4446], now have 1 active actors on pipe
2025-10-01T14:07:53.289974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:53.290018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:53.290055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254822559613223:4446]
2025-10-01T14:07:53.290075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:53.290157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 382 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0
2025-10-01T14:07:53.290360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 382 sessionId: src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0 is DEAD
2025-10-01T14:07:53.290520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:53.290532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0] Write session will restart in 0.005218s
2025-10-01T14:07:53.290561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0] Write session: Do CDS request
2025-10-01T14:07:53.290567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:53.296928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.297023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:53.297035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 383
2025-10-01T14:07:53.297200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.297233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:53.297238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:53.297241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:53.297584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 383 sessionId:  describe result for acl check
2025-10-01T14:07:53.297622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:53.297628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:53.297630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:53.297635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254822559613243:4962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:53.298175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254822559613243:4962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:53.300740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254822559613243:4962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:53.304246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254822559613243:4962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:53.304259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254822559613243:4962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:53.304262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254822559613243:4962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:53.304269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:53.305980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:53.309322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:53.309543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:53.309560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:53.309572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:53.309654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:53.309705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254820182751458:4511]
2025-10-01T14:07:53.310399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:53.310733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:53.310802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:53.311170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:53.311266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.311274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.311276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.311277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.311279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.311280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.311282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.311283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.311284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.311287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.311288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.311290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.311292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.311293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.311299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.311309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.311313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.311317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.311321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.311324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.311328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.311332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.311335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.311339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.311343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.311347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.311350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.311354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.311362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.311370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.311376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.311382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.311395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.311401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.311411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.311416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.311426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.311432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.311441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.311449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.311459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.311464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.311472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.311478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.311487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.311492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.311501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.311507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.311518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.311523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.311529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.311535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.311541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.311546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.311555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.311560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.311600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:53.315644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:53.316382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:53.316402Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:53.316406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:53.316410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:53.316417Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 382 [2:7556254820182751458:4511]
2025-10-01T14:07:53.316434Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:53.316454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:53.316457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.316461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.316463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.316480Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:53.316486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:53.316493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:53.316555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.316934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 382
2025-10-01T14:07:53.316936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 382
2025-10-01T14:07:53.316557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.316559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.316563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:53.316566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:53.316641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:53.316644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.316658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.316668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.316684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:53.316702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254820182751453:4511]
2025-10-01T14:07:53.316705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254820182751453:4511]
2025-10-01T14:07:53.316708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254820182751453:4511]
2025-10-01T14:07:53.316718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:53.316730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:53.316733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:53.316736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:53.316736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:53.316751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:53.316755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:53.316766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613228:2446], now have 1 active actors on pipe
2025-10-01T14:07:53.316770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613429:4962], now have 1 active actors on pipe
2025-10-01T14:07:53.316814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254820182751453:4511]
2025-10-01T14:07:53.316825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:53.317102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:53.317217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.317229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.317256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:53.317264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.317268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.317271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:53.317282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.317294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:53.317320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.317599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.317607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.317622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.317786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 383 partition: 0 MaxSeqNo: 45 sessionId: src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0
2025-10-01T14:07:53.318149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbb0238-8e254d56-db3ffc44-8a87418e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:53.320860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0] Write session: try to update token
2025-10-01T14:07:53.320880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:53.339025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:53.339046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:53.339049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:53.339051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:53.339062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254820182751453:4511]
2025-10-01T14:07:53.339067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254820182751453:4511]
2025-10-01T14:07:53.339071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254820182751453:4511]
2025-10-01T14:07:53.339104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:53.339108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:53.339111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:53.339119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:53.339126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.339128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:53.339272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:53.340575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 383 sessionId: src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:53.343598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:53.390155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254822559613443:4446]
2025-10-01T14:07:53.390677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 382, pipe: [1:7556254822559613443:4446]
2025-10-01T14:07:53.476888Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:53.477250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.477268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.477305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613443:4446], now have 1 active actors on pipe
2025-10-01T14:07:53.477507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:53.477540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:53.477568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254822559613443:4446]
2025-10-01T14:07:53.477594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:53.477687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 383 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0
2025-10-01T14:07:53.477874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 383 sessionId: src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0 is DEAD
2025-10-01T14:07:53.478048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:53.478062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0] Write session will restart in 0.009760s
2025-10-01T14:07:53.478089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0] Write session: Do CDS request
2025-10-01T14:07:53.478095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:53.488996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.489070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:53.489087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 384
2025-10-01T14:07:53.489251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.489284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:53.489293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:53.489298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:53.489664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 384 sessionId:  describe result for acl check
2025-10-01T14:07:53.489693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:53.489700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:53.489704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:53.489709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254822559613549:4966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:53.490152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254822559613549:4966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:53.492772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254822559613549:4966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:53.493724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:53.496691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254822559613549:4966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:53.496707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254822559613549:4966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:53.496710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254822559613549:4966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:53.496719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:53.496275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:53.496493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:53.496496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:53.496507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:53.496557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:53.496592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254820182751666:4513]
2025-10-01T14:07:53.497180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:53.497428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:53.497460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:53.497693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:53.497748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.497758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.497759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.497759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.497760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.497761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.497762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.497762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.497763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.497763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.497764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.497765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.497765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.497766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.497769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.497775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.497778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.497780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.497782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.497785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.497787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.497789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.497791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.497795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.497797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.497799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.497801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.497803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.497809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.497814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.497817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.497820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.497823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.497826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.497828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.497831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.497834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.497838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.497842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.497846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.497851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.497855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.497860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.497864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.497868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.497873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.497877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.497881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.497885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.497890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.497894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.497901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.497905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.497909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.497913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.497918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.497953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:53.501636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:53.502584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:53.502604Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:53.502607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:53.502610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:53.502617Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 383 [2:7556254820182751666:4513]
2025-10-01T14:07:53.502634Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:53.502651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:53.502654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.502658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.502660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.502679Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:53.502685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:53.502690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:53.502751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.502761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.502763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.502766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:53.502769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:53.502842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:53.502853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.502864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.502876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.502891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:53.502918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613446:2446], now have 1 active actors on pipe
2025-10-01T14:07:53.502934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254820182751661:4513]
2025-10-01T14:07:53.502940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254820182751661:4513]
2025-10-01T14:07:53.502943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254820182751661:4513]
2025-10-01T14:07:53.502960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:53.502973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:53.502976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:53.502979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:53.502980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:53.502995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:53.503004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:53.503011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613651:4966], now have 1 active actors on pipe
2025-10-01T14:07:53.503048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254820182751661:4513]
2025-10-01T14:07:53.503057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:53.502979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 383
2025-10-01T14:07:53.503026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 383
2025-10-01T14:07:53.503060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:53.503078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.503083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.503144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:53.503162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.503166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.503168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:53.503178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.503187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:53.503204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.503342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.503354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.503370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.503440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 384 partition: 0 MaxSeqNo: 45 sessionId: src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0
2025-10-01T14:07:53.503813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94474bba-a1b84cc2-b019c815-3f8a238c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:53.506337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0] Write session: try to update token
2025-10-01T14:07:53.506358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:53.520045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 384 sessionId: src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:53.522457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:53.523871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.523898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.523919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:53.523922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:53.523924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:53.523927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:53.523935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254820182751661:4513]
2025-10-01T14:07:53.523939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254820182751661:4513]
2025-10-01T14:07:53.523943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254820182751661:4513]
2025-10-01T14:07:53.523979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:53.523985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:53.523988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:53.523994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:53.524000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.524003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:53.524132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:53.577514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254822559613662:4446]
2025-10-01T14:07:53.577756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 383, pipe: [1:7556254822559613662:4446]
2025-10-01T14:07:53.671283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:53.671565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:53.671612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613662:4446], now have 1 active actors on pipe
2025-10-01T14:07:53.671730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:53.671757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:53.671806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254822559613662:4446]
2025-10-01T14:07:53.671857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:53.671865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:53.671912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 384 reason: error at write: Disconnected sessionId: src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0
2025-10-01T14:07:53.672027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 384 sessionId: src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0 is DEAD
2025-10-01T14:07:53.672150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:53.672156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0] Write session will restart in 0.008874s
2025-10-01T14:07:53.672181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0] Write session: Do CDS request
2025-10-01T14:07:53.672186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:53.681833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.681910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:53.681922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 385
2025-10-01T14:07:53.682039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.682063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:53.682070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:53.682073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:53.682549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 385 sessionId:  describe result for acl check
2025-10-01T14:07:53.682582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:53.682587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:53.682588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:53.682594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254822559613714:4971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:53.683108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254822559613714:4971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:53.685959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254822559613714:4971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:53.688967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254822559613714:4971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:53.688981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254822559613714:4971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:53.688985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254822559613714:4971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:53.688994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:53.689236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:53.692677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:53.692913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:53.692924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:53.692936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:53.693010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:53.693057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254820182751880:4516]
2025-10-01T14:07:53.693760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:53.694098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:53.694151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:53.694481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:53.694548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.694550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.694551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.694552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.694553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.694554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.694556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.694557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.694558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.694559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.694560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.694561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.694563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.694564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.694569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.694578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.694582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.694586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.694589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.694594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.694598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.694602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.694606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.694610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.694614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.694618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.694622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.694626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.694633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.694641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.694647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.694653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.694657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.694662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.694667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.694673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.694679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.694684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.694688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.694694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.694698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.694704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.694708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.694713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.694718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.694724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.694729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.694735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.694740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.694749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.694753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.694760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.694765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.694771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.694777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.694782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.694825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:53.699076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:53.699810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:53.699827Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:53.699830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:53.699835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:53.699842Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 384 [2:7556254820182751880:4516]
2025-10-01T14:07:53.699860Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:53.699878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:53.699881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.699885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.699888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.699905Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:53.699916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:53.699925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:53.699992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.700000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.700003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.700007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:53.700010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:53.700091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:53.700100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.700111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.700125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.700145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:53.700172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613872:4971], now have 1 active actors on pipe
2025-10-01T14:07:53.700176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613667:2446], now have 1 active actors on pipe
2025-10-01T14:07:53.700183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254820182751874:4516]
2025-10-01T14:07:53.700186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254820182751874:4516]
2025-10-01T14:07:53.700189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254820182751874:4516]
2025-10-01T14:07:53.700203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:53.700302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 384
2025-10-01T14:07:53.700303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 384
2025-10-01T14:07:53.700219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:53.700223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:53.700226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:53.700229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:53.700243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:53.700246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:53.700285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254820182751874:4516]
2025-10-01T14:07:53.700294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:53.700320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:53.700431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.700442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.700472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:53.700483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.700488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.700495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:53.700506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.700516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:53.700535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.700706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.700720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.700743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.700857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 385 partition: 0 MaxSeqNo: 45 sessionId: src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0
2025-10-01T14:07:53.701279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d098e4-20b9d4bb-c9594c76-7b1ce537_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:53.703871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0] Write session: try to update token
2025-10-01T14:07:53.703892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:53.717793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 385 sessionId: src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:53.718524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:53.718547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:53.718559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254820182751874:4516]
2025-10-01T14:07:53.718619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:53.718636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:53.718828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:53.718991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:53.719147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:53.719308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:53.719575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:53.719618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:53.720232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:53.720442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.720461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.720491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:53.720574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:53.736640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:53.736665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:53.736667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:53.736670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:53.736682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254820182751874:4516]
2025-10-01T14:07:53.736688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254820182751874:4516]
2025-10-01T14:07:53.736695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254820182751874:4516]
2025-10-01T14:07:53.736766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:53.736782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:53.736787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:53.745949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.745982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.746171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.746238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.746303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.746385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.746437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.746444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.746514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.746574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.746635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.746699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.746751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.746755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.746825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.746886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.746949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.747014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.747062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.747065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.747138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.747206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.747269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.747332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.747382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.747386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.747452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.747512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.747579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.747643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.747692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.747696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.747768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.747830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.747893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.747953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.748000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.748003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.748068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.748125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.748189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.748250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.748297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.748300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.748378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.748441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.748505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.748571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.748616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.748619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.748690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.748751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.748830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.748896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.748944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.748948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.749016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:53.749078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:53.749145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:53.749209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:53.749256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:53.749259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:53.749335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:53.749346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.749349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:53.749516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:53.772042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254822559613897:4446]
2025-10-01T14:07:53.772407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 384, pipe: [1:7556254822559613897:4446]
2025-10-01T14:07:53.889964Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:53.891273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613897:4446], now have 1 active actors on pipe
2025-10-01T14:07:53.891520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:53.891852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:53.891868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:53.891901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 385 reason: error at write: Disconnected sessionId: src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0
2025-10-01T14:07:53.892130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 385 sessionId: src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0 is DEAD
2025-10-01T14:07:53.892328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:53.892344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0] Write session will restart in 0.007913s
2025-10-01T14:07:53.892377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0] Write session: Do CDS request
2025-10-01T14:07:53.892386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:53.892799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254822559613897:4446]
2025-10-01T14:07:53.892844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:53.901976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.902106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:53.902122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 386
2025-10-01T14:07:53.902294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:53.902332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:53.902343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:53.902349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:53.902836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 386 sessionId:  describe result for acl check
2025-10-01T14:07:53.902880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:53.902887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:53.902889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:53.902895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254822559613952:4982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:53.903392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254822559613952:4982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:53.906240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254822559613952:4982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:53.909227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:53.909474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254822559613952:4982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:53.909495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254822559613952:4982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:53.909498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254822559613952:4982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:53.909507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:53.912019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:53.912237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:53.912241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:53.912251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:53.912298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:53.912339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254820182752098:4520]
2025-10-01T14:07:53.912947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:53.913326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:53.913381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:53.913720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:53.913813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.913814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.913815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.913816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.913818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.913819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.913820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.913821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.913822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.913823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.913825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.913826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.913827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.913829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.913835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.913845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.913849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.913852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.913856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.913860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.913864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.913868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.913872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.913876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.913879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.913882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.913886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.913890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.913897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.913904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:53.913912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.913917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:53.913922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.913927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:53.913931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.913937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:53.913941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.913946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:53.913950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.913955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:53.913960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.913965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:53.913969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.913974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:53.913977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.913980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:53.913985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.913989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.913994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.913998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.914004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.914009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.914013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.914017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:53.914022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.914026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:53.914066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:53.923873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:53.924895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:53.924915Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:53.924918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:53.924922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:53.924931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 385 [2:7556254820182752098:4520]
2025-10-01T14:07:53.924950Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:53.924971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:53.924980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.924985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.924987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.925006Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:53.925012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:53.925024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:53.925096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.925105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.925107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.925112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:53.925114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:53.925191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:53.925199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.925215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:53.925231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:53.925250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:53.925273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559614114:4982], now have 1 active actors on pipe
2025-10-01T14:07:53.925281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559613911:2446], now have 1 active actors on pipe
2025-10-01T14:07:53.925290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254820182752092:4520]
2025-10-01T14:07:53.925297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254820182752092:4520]
2025-10-01T14:07:53.925299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254820182752092:4520]
2025-10-01T14:07:53.925312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:53.925333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:53.925335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:53.925338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:53.925341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:53.925354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:53.925358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:53.925385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 385
2025-10-01T14:07:53.925422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 385
2025-10-01T14:07:53.925395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254820182752092:4520]
2025-10-01T14:07:53.925408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:53.925422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:53.925443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.925449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.925479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:53.925488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:53.925492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:53.925494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:53.925506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:53.925516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:53.925534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.925741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.925750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.925769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:53.925866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 386 partition: 0 MaxSeqNo: 45 sessionId: src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0
2025-10-01T14:07:53.926270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|916a1c97-58e063ac-ae0bd77f-62c45228_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:53.928743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0] Write session: try to update token
2025-10-01T14:07:53.928767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:53.943841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 386 sessionId: src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:53.946653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:53.947052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:53.947080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:53.947126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:53.947256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:53.953700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:53.953722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:53.953724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:53.953726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:53.953734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254820182752092:4520]
2025-10-01T14:07:53.953738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254820182752092:4520]
2025-10-01T14:07:53.953741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254820182752092:4520]
2025-10-01T14:07:53.953782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:53.953791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:53.953793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:53.953864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:53.953878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:53.953882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:53.953945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:53.992765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254822559614128:4446]
2025-10-01T14:07:53.993090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 385, pipe: [1:7556254822559614128:4446]
2025-10-01T14:07:54.091791Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:54.101992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.102032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.102246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.102333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.102436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.102516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.102580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.102590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.102681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.102758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.102841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.102923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.102985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.102993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.103070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.103143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.103216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.103289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.103343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.103351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.103427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.103495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.103560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.103636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.103699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.103706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.103785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.103854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.103922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.103991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.104046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.104054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.104130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.104204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.104305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.104387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.104446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.104454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.104532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.104604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.104676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.104747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.104823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.104832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.104906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.104977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.105050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.105123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.105182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.105189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.105271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.105352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.105433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.105521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.105590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.105599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.105680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.105756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.105833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.105912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.105971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.105980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.106058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254822559614128:4446], now have 1 active actors on pipe
2025-10-01T14:07:54.106353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:54.106355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254822559614128:4446]
2025-10-01T14:07:54.106367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:54.106400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:54.106411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 386 reason: error at write: Disconnected sessionId: src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0
2025-10-01T14:07:54.106581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 386 sessionId: src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0 is DEAD
2025-10-01T14:07:54.106699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:54.106707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0] Write session will restart in 0.009719s
2025-10-01T14:07:54.106729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0] Write session: Do CDS request
2025-10-01T14:07:54.106735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:54.107470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:54.117920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.118102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:54.118114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 387
2025-10-01T14:07:54.118229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.118260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:54.118276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:54.118280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:54.118829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 387 sessionId:  describe result for acl check
2025-10-01T14:07:54.118885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:54.118893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:54.118894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:54.118901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254826854581489:4986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:54.119585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254826854581489:4986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:54.122844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254826854581489:4986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:54.127193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254826854581489:4986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:54.127212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254826854581489:4986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:54.127216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254826854581489:4986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:54.127226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:54.130603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:54.133423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:54.133838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:54.133852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:54.133865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:54.133933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:54.133981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254824477719648:4533]
2025-10-01T14:07:54.134674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:54.135568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:54.135638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:54.135987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:54.136054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.136062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.136064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.136065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.136066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.136067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.136069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.136070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.136071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.136072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.136074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.136075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.136076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.136077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.136084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.136095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.136099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.136103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.136107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.136111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.136116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.136120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.136123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.136128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.136132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.136136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.136140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.136143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.136151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.136159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.136168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.136180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.136187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.136193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.136199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.136209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.136214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.136224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.136236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.136244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.136250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.136258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.136263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.136272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.136280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.136285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.136293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.136298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.136303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.136313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.136317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.136327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.136332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.136336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.136342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.136347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.136390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:54.141114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:54.141870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:54.141876Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:54.141881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:54.141886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:54.141894Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 386 [2:7556254824477719648:4533]
2025-10-01T14:07:54.141913Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:54.141935Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:54.141938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.141942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.141944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.141960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:54.141967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:54.141974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:54.142041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.142044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.142047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.142050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:54.142053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:54.142137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:54.142140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.142153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.142165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.142182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:54.142201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854581630:4986], now have 1 active actors on pipe
2025-10-01T14:07:54.142205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854581428:2446], now have 1 active actors on pipe
2025-10-01T14:07:54.142214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254824477719643:4533]
2025-10-01T14:07:54.142216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254824477719643:4533]
2025-10-01T14:07:54.142218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254824477719643:4533]
2025-10-01T14:07:54.142231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:54.142247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:54.142247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:54.142251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:54.142254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:54.142262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:54.142264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:54.142298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254824477719643:4533]
2025-10-01T14:07:54.142304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:54.142312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:54.142490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 386
2025-10-01T14:07:54.142524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 386
2025-10-01T14:07:54.142563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.142583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.142617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|860f4bd9-140b3a6a-24872519-ff64217d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:54.142631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.142636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.142643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:54.142654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.142683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:54.142699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.142863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.142876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.142897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.143214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 387 partition: 0 MaxSeqNo: 45 sessionId: src_id|860f4bd9-140b3a6a-24872519-ff64217d_0
2025-10-01T14:07:54.143679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afbca567-3dde0b07-61eb503c-b2065b4c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|860f4bd9-140b3a6a-24872519-ff64217d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:54.146089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860f4bd9-140b3a6a-24872519-ff64217d_0] Write session: try to update token
2025-10-01T14:07:54.146110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860f4bd9-140b3a6a-24872519-ff64217d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:54.153741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:54.153760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:54.153769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254824477719643:4533]
2025-10-01T14:07:54.153810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:54.153816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:54.154042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:54.154203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:54.154351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:54.154528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:54.154807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:54.154861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:54.160194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 387 sessionId: src_id|860f4bd9-140b3a6a-24872519-ff64217d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:54.163312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:54.163650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.163675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.163714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:54.163818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:54.175458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:54.175484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:54.175487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:54.175490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:54.175500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254824477719643:4533]
2025-10-01T14:07:54.175506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254824477719643:4533]
2025-10-01T14:07:54.175510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254824477719643:4533]
2025-10-01T14:07:54.175560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:54.175564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:54.175566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:54.175571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.175573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:54.175573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:54.175731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:54.206754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254826854581664:4446]
2025-10-01T14:07:54.207422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 386, pipe: [1:7556254826854581664:4446]
2025-10-01T14:07:54.317050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:54.325950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.325976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.326150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.326213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.326279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.326340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.326429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.326442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.326508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.326569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.326632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.326711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.326772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.326780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.326854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.326916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.326989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.327065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.327121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.327127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.330158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860f4bd9-140b3a6a-24872519-ff64217d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:54.330172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860f4bd9-140b3a6a-24872519-ff64217d_0] Write session will restart in 0.007424s
2025-10-01T14:07:54.330198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860f4bd9-140b3a6a-24872519-ff64217d_0] Write session: Do CDS request
2025-10-01T14:07:54.330205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860f4bd9-140b3a6a-24872519-ff64217d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:54.327200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.327271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.327333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.327394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.327440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.327442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.327522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.327582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.327652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.327718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.327772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.327775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.327852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.327916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.327986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.328054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.328107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.328110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.328190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.328252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.328320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.328392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.328436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.328439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.328518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.328581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.328651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.328722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.328772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.328775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.328865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.328932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.328997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.329067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.329114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.329117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.329195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.329259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.329331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.329418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.329463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.329466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.329535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854581664:4446], now have 1 active actors on pipe
2025-10-01T14:07:54.329808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:54.329822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:54.329825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254826854581664:4446]
2025-10-01T14:07:54.329843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:54.329847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 387 reason: error at write: Disconnected sessionId: src_id|860f4bd9-140b3a6a-24872519-ff64217d_0
2025-10-01T14:07:54.329987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 387 sessionId: src_id|860f4bd9-140b3a6a-24872519-ff64217d_0 is DEAD
2025-10-01T14:07:54.331243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:54.338863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|860f4bd9-140b3a6a-24872519-ff64217d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.338927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:54.338944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 388
2025-10-01T14:07:54.339066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.339099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:54.339109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:54.339113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:54.339557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 388 sessionId:  describe result for acl check
2025-10-01T14:07:54.339583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:54.339587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:54.339589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:54.339593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254826854581716:4992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:54.339993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254826854581716:4992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:54.343883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254826854581716:4992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:54.346692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:54.347784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254826854581716:4992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:54.347803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254826854581716:4992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:54.347806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254826854581716:4992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:54.347815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:54.349765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:54.349982Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:54.349996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:54.350007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:54.350066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:54.350128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254824477719863:4536]
2025-10-01T14:07:54.350804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:54.351118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:54.351169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:54.351528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:54.351606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.351612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.351613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.351615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.351616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.351618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.351619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.351620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.351622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.351623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.351624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.351625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.351626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.351628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.351634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.351644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.351648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.351651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.351654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.351658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.351662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.351666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.351670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.351674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.351678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.351681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.351685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.351689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.351699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.351706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.351718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.351724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.351733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.351738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.351748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.351754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.351763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.351769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.351776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.351782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.351786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.351796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.351800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.351810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.351815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.351825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.351830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.351839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.351844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.351853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.351861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.351866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.351875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.351880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.351891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.351901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.351943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:54.356058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:54.356754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:54.356771Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:54.356776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:54.356782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:54.356792Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 387 [2:7556254824477719863:4536]
2025-10-01T14:07:54.356826Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:54.356857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:54.356868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.356872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.356874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.356890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:54.356895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:54.356903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:54.356979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.356986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.356989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.356992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:54.356995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:54.357065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:54.357069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.357082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.357094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.357113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:54.357138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854581670:2446], now have 1 active actors on pipe
2025-10-01T14:07:54.357142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854581879:4992], now have 1 active actors on pipe
2025-10-01T14:07:54.357149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254824477719857:4536]
2025-10-01T14:07:54.357152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254824477719857:4536]
2025-10-01T14:07:54.357154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254824477719857:4536]
2025-10-01T14:07:54.357170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:54.357186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:54.357187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:54.357190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:54.357192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:54.357199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:54.357203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:54.357240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254824477719857:4536]
2025-10-01T14:07:54.357244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:54.357251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:54.357230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 387
2025-10-01T14:07:54.357295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 387
2025-10-01T14:07:54.357416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.357431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.357468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:54.357480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.357489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.357491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:54.357501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.357516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:54.357545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.357715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.357729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.357749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.357862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 388 partition: 0 MaxSeqNo: 45 sessionId: src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0
2025-10-01T14:07:54.358221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|860f4bd9-140b3a6a-24872519-ff64217d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:54.360772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0] Write session: try to update token
2025-10-01T14:07:54.360794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:54.379380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:54.379411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:54.379415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:54.379417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:54.379430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254824477719857:4536]
2025-10-01T14:07:54.379435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254824477719857:4536]
2025-10-01T14:07:54.379440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254824477719857:4536]
2025-10-01T14:07:54.379502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:54.379511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:54.379516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:54.379520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:54.379522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.379526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:54.379722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:54.378076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 388 sessionId: src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:54.381102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:54.429969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254826854581890:4446]
2025-10-01T14:07:54.430268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 387, pipe: [1:7556254826854581890:4446]
2025-10-01T14:07:54.515742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:54.516149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.516168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.516207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854581890:4446], now have 1 active actors on pipe
2025-10-01T14:07:54.516402Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:54.516445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:54.516451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:54.516460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:54.516500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254826854581890:4446]
2025-10-01T14:07:54.516538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 388 reason: error at write: Disconnected sessionId: src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0
2025-10-01T14:07:54.516688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 388 sessionId: src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0 is DEAD
2025-10-01T14:07:54.516851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:54.516863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0] Write session will restart in 0.008581s
2025-10-01T14:07:54.516891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0] Write session: Do CDS request
2025-10-01T14:07:54.516897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:54.526833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.526946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:54.526961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 389
2025-10-01T14:07:54.527117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.527158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:54.527168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:54.527172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:54.527812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 389 sessionId:  describe result for acl check
2025-10-01T14:07:54.527845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:54.527851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:54.527855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:54.527861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254826854581955:4996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:54.528359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254826854581955:4996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:54.530805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254826854581955:4996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:54.533622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254826854581955:4996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:54.533637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254826854581955:4996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:54.533641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254826854581955:4996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:54.533648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:54.533786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:54.536844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:54.537049Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:54.537059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:54.537066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:54.537107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:54.537140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254824477720077:4538]
2025-10-01T14:07:54.537602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:54.537935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:54.537969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:54.538185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:54.538225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.538230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.538230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.538231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.538232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.538233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.538234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.538235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.538236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.538236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.538237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.538238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.538239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.538240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.538243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.538249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.538252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.538254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.538256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.538258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.538261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.538263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.538266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.538268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.538270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.538273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.538275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.538278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.538282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.538287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.538291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.538294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.538297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.538300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.538303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.538306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.538310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.538313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.538317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.538320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.538323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.538325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.538328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.538331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.538334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.538336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.538339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.538342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.538344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.538347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.538350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.538353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.538355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.538358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.538361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.538364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.538409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:54.542492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:54.543130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:54.543147Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:54.543150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:54.543154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:54.543161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 388 [2:7556254824477720077:4538]
2025-10-01T14:07:54.543177Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:54.543194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:54.543197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.543200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.543202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.543218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:54.543223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:54.543235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:54.543290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.543297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.543300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.543303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:54.543305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:54.543374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:54.543382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.543394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.543406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.543427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:54.543452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854581893:2446], now have 1 active actors on pipe
2025-10-01T14:07:54.543456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854582102:4996], now have 1 active actors on pipe
2025-10-01T14:07:54.543463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254824477720071:4538]
2025-10-01T14:07:54.543466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254824477720071:4538]
2025-10-01T14:07:54.543468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254824477720071:4538]
2025-10-01T14:07:54.543482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:54.543521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 388
2025-10-01T14:07:54.543498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:54.543509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:54.543535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 388
2025-10-01T14:07:54.543512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:54.543513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:54.543515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:54.543516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:54.543543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254824477720071:4538]
2025-10-01T14:07:54.543546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:54.543557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:54.543579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.543582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.543604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:54.543610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.543615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.543622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:54.543631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.543643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:54.543658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.543807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.543813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.543826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.543909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 389 partition: 0 MaxSeqNo: 45 sessionId: src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0
2025-10-01T14:07:54.544271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c837ab8-9e29dd4f-ba89bbe9-9ffb9c5a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:54.546619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0] Write session: try to update token
2025-10-01T14:07:54.546638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:54.560080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 389 sessionId: src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:54.560664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:54.560689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:54.560699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254824477720071:4538]
2025-10-01T14:07:54.560749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:54.560764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:54.560999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:54.561181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:54.561348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:54.561518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:54.561742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:54.561790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:54.562412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:54.562627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.562646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.562690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:54.562774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:54.575199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:54.575224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:54.575226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:54.575229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:54.575240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254824477720071:4538]
2025-10-01T14:07:54.575244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254824477720071:4538]
2025-10-01T14:07:54.575248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254824477720071:4538]
2025-10-01T14:07:54.575287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:54.575292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.575294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:54.575302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:54.575308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:54.575313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:54.575437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:54.616911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254826854582117:4446]
2025-10-01T14:07:54.617267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 388, pipe: [1:7556254826854582117:4446]
2025-10-01T14:07:54.722220Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:54.730590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.730618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.730793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.730858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.730940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.731008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.731056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.731068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.731137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.731207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.731267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.731333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.731380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.731392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.731465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.731543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.731607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.731668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.731752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.731762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.731822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.731887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.731954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.732016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.732117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.732127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.732191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.732251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.732318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.732383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.732431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.732440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.732506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.732575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.732643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.732712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.732764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.732772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.732852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.732923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.732990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.733065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.733114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.733123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.733189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.733258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.733327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.733393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.733447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.733453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.733514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.733573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.733637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.733701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.733753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.733759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.733818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.733879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.733947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.734009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.734053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.734060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.734121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854582117:4446], now have 1 active actors on pipe
2025-10-01T14:07:54.734419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:54.734441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254826854582117:4446]
2025-10-01T14:07:54.734473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:54.734475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:54.734504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 389 reason: error at write: Disconnected sessionId: src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0
2025-10-01T14:07:54.734728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 389 sessionId: src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0 is DEAD
2025-10-01T14:07:54.734854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:54.734862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0] Write session will restart in 0.006895s
2025-10-01T14:07:54.734890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0] Write session: Do CDS request
2025-10-01T14:07:54.734896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:54.735346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:54.742944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.743058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:54.743072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 390
2025-10-01T14:07:54.743191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.743222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:54.743231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:54.743235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:54.743636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 390 sessionId:  describe result for acl check
2025-10-01T14:07:54.743675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:54.743676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:54.743679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:54.743683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254826854582163:5001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:54.744219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254826854582163:5001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:54.747430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254826854582163:5001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:54.750326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254826854582163:5001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:54.750339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254826854582163:5001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:54.750343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254826854582163:5001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:54.750351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:54.750467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:54.753796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:54.754054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:54.754070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:54.754083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:54.754142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:54.754193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254824477720295:4541]
2025-10-01T14:07:54.754827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:54.755204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:54.755261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:54.755603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:54.755665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.755673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.755675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.755676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.755677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.755679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.755680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.755681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.755682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.755684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.755686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.755687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.755688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.755689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.755695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.755706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.755710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.755715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.755719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.755724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.755728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.755732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.755736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.755740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.755744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.755748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.755752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.755756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.755766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.755774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.755781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.755787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.755792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.755798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.755802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.755808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.755812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.755818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.755823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.755828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.755833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.755839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.755843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.755848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.755853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.755859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.755864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.755870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.755875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.755881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.755889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.755896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.755900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.755906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.755917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.755923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.755960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:54.760234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:54.760830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:54.760845Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:54.760848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:54.760853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:54.760861Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 389 [2:7556254824477720295:4541]
2025-10-01T14:07:54.760878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:54.760895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:54.760898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.760901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.760903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.760921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:54.760934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:54.760941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:54.760995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.761003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.761005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.761008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:54.761011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:54.761077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:54.761084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.761096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.761111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.761127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:54.761148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254824477720289:4541]
2025-10-01T14:07:54.761155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254824477720289:4541]
2025-10-01T14:07:54.761157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254824477720289:4541]
2025-10-01T14:07:54.761170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:54.761189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854582329:5001], now have 1 active actors on pipe
2025-10-01T14:07:54.761201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854582119:2446], now have 1 active actors on pipe
2025-10-01T14:07:54.761209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:54.761209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:54.761214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:54.761217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:54.761223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:54.761226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:54.761260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254824477720289:4541]
2025-10-01T14:07:54.761272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:54.761255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 389
2025-10-01T14:07:54.761298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:54.761269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 389
2025-10-01T14:07:54.761353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.761363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.761391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:54.761401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.761405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.761408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:54.761416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.761428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:54.761445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.761640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.761651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.761666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.761740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 390 partition: 0 MaxSeqNo: 45 sessionId: src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0
2025-10-01T14:07:54.762104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbae92ec-8e36c845-fe923c04-fdb58a02_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:54.764396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0] Write session: try to update token
2025-10-01T14:07:54.764410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:54.778755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 390 sessionId: src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:54.780950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:54.781132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.781154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.781189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:54.781290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:54.783345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:54.783363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:54.783366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:54.783368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:54.783376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254824477720289:4541]
2025-10-01T14:07:54.783381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254824477720289:4541]
2025-10-01T14:07:54.783385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254824477720289:4541]
2025-10-01T14:07:54.783425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:54.783430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:54.783437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.783438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:54.783439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:54.783440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:54.783566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:54.834483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254826854582364:4446]
2025-10-01T14:07:54.834807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 389, pipe: [1:7556254826854582364:4446]
2025-10-01T14:07:54.936194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:54.943964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.943994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.944158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.944219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.944280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.944346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.944389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.944398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.944460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.944515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.944584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.944647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.944690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.944699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.944775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.944839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.944898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.944953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.944996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.945003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.945062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.945116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.945167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.945219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.945259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.945265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.945320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.945376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.945431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.945488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.945532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.945539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.945597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.945650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.945712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.945776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.945824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.945831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.945891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.945946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.946003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.946067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.946113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.946120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.946180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.946236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.946294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.946362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.946422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.946429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.946501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.946570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.946639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.946706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.946755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.946762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.946835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:54.946901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:54.946973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:54.947029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:54.947077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:54.947082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:54.947137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854582364:4446], now have 1 active actors on pipe
2025-10-01T14:07:54.947411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:54.947417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254826854582364:4446]
2025-10-01T14:07:54.947444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:54.947449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:54.947471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 390 reason: error at write: Disconnected sessionId: src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0
2025-10-01T14:07:54.948128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:54.948133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 390 sessionId: src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0 is DEAD
2025-10-01T14:07:54.948306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:54.948315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0] Write session will restart in 0.006659s
2025-10-01T14:07:54.948343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0] Write session: Do CDS request
2025-10-01T14:07:54.948348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:54.955902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.956054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:54.956071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 391
2025-10-01T14:07:54.956242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:54.956273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:54.956284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:54.956289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:54.956761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 391 sessionId:  describe result for acl check
2025-10-01T14:07:54.956799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:54.956817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:54.956820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:54.956826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254826854582399:5012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:54.957370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254826854582399:5012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:54.959651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254826854582399:5012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:54.964038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254826854582399:5012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:54.964054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254826854582399:5012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:54.964058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254826854582399:5012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:54.964067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:54.965314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:54.967675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:54.967868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:54.967877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:54.967888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:54.967933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:54.967962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254824477720519:4545]
2025-10-01T14:07:54.968515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:54.968763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:54.968798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:54.969023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:54.969062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.969067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.969068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.969069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.969070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.969071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.969071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.969072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.969073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.969073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.969074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.969074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.969075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.969076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.969079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.969085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.969088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.969090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.969092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.969095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.969097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.969099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.969101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.969103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.969106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.969108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.969110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.969112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.969119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.969123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:54.969127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.969131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:54.969137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.969142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:54.969151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.969158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:54.969161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.969164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:54.969170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.969173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:54.969175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.969178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:54.969183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.969187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:54.969189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.969192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:54.969194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.969197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.969199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.969202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.969208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.969210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.969213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.969219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:54.969222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.969225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:54.969247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:54.973098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:54.973681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:54.973697Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:54.973700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:54.973703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:54.973710Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 390 [2:7556254824477720519:4545]
2025-10-01T14:07:54.973723Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:54.973744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:54.973751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.973755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.973761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.973778Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:54.973787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:54.973799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:54.973851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.973858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.973860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.973865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:54.973867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:54.973931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:54.973937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:54.973948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:54.973964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:54.973985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:54.974009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854582576:5012], now have 1 active actors on pipe
2025-10-01T14:07:54.974017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254826854582367:2446], now have 1 active actors on pipe
2025-10-01T14:07:54.974024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254824477720514:4545]
2025-10-01T14:07:54.974026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254824477720514:4545]
2025-10-01T14:07:54.974028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254824477720514:4545]
2025-10-01T14:07:54.974040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:54.974057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:54.974061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:54.974069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:54.974071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:54.974074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:54.974078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:54.974101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254824477720514:4545]
2025-10-01T14:07:54.974111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:54.974117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:54.974107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 390
2025-10-01T14:07:54.974111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 390
2025-10-01T14:07:54.974244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.974255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.974280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|436e5322-41adcb6-22ec8491-55abccb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:54.974290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:54.974294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:54.974296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:54.974306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:54.974318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:54.974335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.975357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.975365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.975380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:54.975496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 391 partition: 0 MaxSeqNo: 45 sessionId: src_id|436e5322-41adcb6-22ec8491-55abccb6_0
2025-10-01T14:07:54.975914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da9e9f2-956461f4-2d1bc399-2b1e6c94_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|436e5322-41adcb6-22ec8491-55abccb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:54.978199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436e5322-41adcb6-22ec8491-55abccb6_0] Write session: try to update token
2025-10-01T14:07:54.978214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436e5322-41adcb6-22ec8491-55abccb6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:54.990318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:54.990336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:54.990346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254824477720514:4545]
2025-10-01T14:07:54.990411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:54.990415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:54.990576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:54.990721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:54.990858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:54.990988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:54.991177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:54.991223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:54.991560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 391 sessionId: src_id|436e5322-41adcb6-22ec8491-55abccb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:54.994592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:54.994796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:54.994816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:54.994852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:54.994964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:55.004663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:55.004681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:55.004683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:55.004684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:55.004692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254824477720514:4545]
2025-10-01T14:07:55.004694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254824477720514:4545]
2025-10-01T14:07:55.004697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254824477720514:4545]
2025-10-01T14:07:55.004737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:55.004750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.004754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:55.004756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:55.004759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:55.004763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:55.004880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:55.047482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254831149549886:4446]
2025-10-01T14:07:55.047870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 390, pipe: [1:7556254831149549886:4446]
2025-10-01T14:07:55.159622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:55.167203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.167233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.167383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.167444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.167506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.167560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.167609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.167616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.167678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.167737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.167789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.167851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.167887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.167889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.167953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.168011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.168066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.168122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.168159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.168162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.168231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.168283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.168342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.168394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.168430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.168432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.168500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.168551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.168605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.168658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.168702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.168704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.168766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.168838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.168897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.168949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.168997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.169000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.169060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.169107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.169161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.169219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.169258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.169262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.169316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.169373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.169424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.169477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.169516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.169519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.169577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.169627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.169682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.169743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.169787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.169788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.169845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.169898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.169948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.170000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.170035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.170037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.170098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149549886:4446], now have 1 active actors on pipe
2025-10-01T14:07:55.170691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254831149549886:4446]
2025-10-01T14:07:55.170728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:55.170731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:55.170758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 391 reason: error at write: Disconnected sessionId: src_id|436e5322-41adcb6-22ec8491-55abccb6_0
2025-10-01T14:07:55.170958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:55.171141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:55.172063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 391 sessionId: src_id|436e5322-41adcb6-22ec8491-55abccb6_0 is DEAD
2025-10-01T14:07:55.174447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e5322-41adcb6-22ec8491-55abccb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:55.174459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e5322-41adcb6-22ec8491-55abccb6_0] Write session will restart in 0.006980s
2025-10-01T14:07:55.174484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e5322-41adcb6-22ec8491-55abccb6_0] Write session: Do CDS request
2025-10-01T14:07:55.174491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e5322-41adcb6-22ec8491-55abccb6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:55.186901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436e5322-41adcb6-22ec8491-55abccb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:55.190534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:55.190549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 392
2025-10-01T14:07:55.190770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:55.190800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:55.190805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:55.190809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:55.194580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 392 sessionId:  describe result for acl check
2025-10-01T14:07:55.194624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:55.194629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:55.194631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:55.194638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254831149550044:5018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:55.195352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254831149550044:5018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:55.206761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:55.210399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:55.210646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:55.210658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:55.210670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:55.210726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:55.210768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254828772688073:4558]
2025-10-01T14:07:55.211371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:55.211277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254831149550044:5018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:55.218534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:55.218621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:55.218994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:55.219053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.219054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.219056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.219057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.219059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.219060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.219061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.219063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.219064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.219065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.219066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.219067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.219068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.219069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.219076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.219086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.219090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.219093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.219097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.219101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.219105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.219109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.219112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.219117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.219120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.219124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.219128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.219131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.219139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.219148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.219154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.219159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.219164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.219169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.219174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.219179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.219184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.219189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.219196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.219200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.219205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.219210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.219214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.219220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.219225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.219230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.219235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.219240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.219244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.219250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.219254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.219259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.219264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.219269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.219272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.219277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.219315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:55.219078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254831149550044:5018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:55.219095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254831149550044:5018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:55.219100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254831149550044:5018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:55.219110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:55.224280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:55.224949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:55.224955Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:55.224957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:55.224961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:55.224970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 391 [2:7556254828772688073:4558]
2025-10-01T14:07:55.224991Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:55.225013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:55.225016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.225020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.225022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.225041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:55.225046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:55.225053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:55.225114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.225116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.225118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.225122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:55.225125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:55.225200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:55.225202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.225215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.225224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.225240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:55.225256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254828772688067:4558]
2025-10-01T14:07:55.225258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254828772688067:4558]
2025-10-01T14:07:55.225260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254828772688067:4558]
2025-10-01T14:07:55.225270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:55.225285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:55.225295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:55.225298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:55.225299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:55.225301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:55.225301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:55.225339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254828772688067:4558]
2025-10-01T14:07:55.225342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:55.225346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:55.225353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149549913:2446], now have 1 active actors on pipe
2025-10-01T14:07:55.225356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550127:5018], now have 1 active actors on pipe
2025-10-01T14:07:55.225417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 391
2025-10-01T14:07:55.225455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 391
2025-10-01T14:07:55.230546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.230569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.230604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:55.230615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.230620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.230623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:55.230637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.230652Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:55.230670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:55.233858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.233888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.233933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:55.234112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 392 partition: 0 MaxSeqNo: 45 sessionId: src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0
2025-10-01T14:07:55.234526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436e5322-41adcb6-22ec8491-55abccb6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:55.237215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0] Write session: try to update token
2025-10-01T14:07:55.237236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:55.256053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 392 sessionId: src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:55.258674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:55.259277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:55.259300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:55.259302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:55.259304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:55.259314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254828772688067:4558]
2025-10-01T14:07:55.259320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254828772688067:4558]
2025-10-01T14:07:55.259323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254828772688067:4558]
2025-10-01T14:07:55.259373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:55.259380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.259383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:55.259520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:55.260913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:55.260918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:55.260922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:55.266486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254831149550140:4446]
2025-10-01T14:07:55.266965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 391, pipe: [1:7556254831149550140:4446]
2025-10-01T14:07:55.416361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:55.416962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.416977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.417000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550140:4446], now have 1 active actors on pipe
2025-10-01T14:07:55.417218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:55.417232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254831149550140:4446]
2025-10-01T14:07:55.417265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:55.417268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:55.417321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 392 reason: error at write: Disconnected sessionId: src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0
2025-10-01T14:07:55.417357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:55.417520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 392 sessionId: src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0 is DEAD
2025-10-01T14:07:55.417669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:55.417680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0] Write session will restart in 0.007746s
2025-10-01T14:07:55.417705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0] Write session: Do CDS request
2025-10-01T14:07:55.417712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:55.426863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:55.427102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:55.427120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 393
2025-10-01T14:07:55.429023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:55.429068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:55.429077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:55.429082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:55.429580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 393 sessionId:  describe result for acl check
2025-10-01T14:07:55.429628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:55.429633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:55.429636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:55.429641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254831149550245:5022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:55.430199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254831149550245:5022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:55.432843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254831149550245:5022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:55.433771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:55.436266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:55.436519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:55.436530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:55.436543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:55.436622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:55.436665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254828772688294:4561]
2025-10-01T14:07:55.436702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254831149550245:5022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:55.436720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254831149550245:5022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:55.436723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254831149550245:5022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:55.436732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:55.437272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:55.437521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:55.437570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:55.437872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:55.437920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.437926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.437927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.437928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.437929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.437930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.437932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.437933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.437934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.437935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.437936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.437937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.437939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.437940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.437945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.437954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.437959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.437964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.437968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.437972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.437975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.437984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.437988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.437992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.438002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.438006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.438010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.438014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.438020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.438028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.438035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.438040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.438045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.438050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.438055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.438060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.438065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.438075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.438079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.438085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.438091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.438100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.438104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.438109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.438117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.438122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.438131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.438136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.438144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.438149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.438158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.438163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.438172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.438177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.438181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.438187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.438232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:55.442044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:55.442692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:55.442709Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:55.442712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:55.442715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:55.442726Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 392 [2:7556254828772688294:4561]
2025-10-01T14:07:55.442742Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:55.442763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:55.442771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.442775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.442777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.442792Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:55.442798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:55.442804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:55.442862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.442869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.442871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.442874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:55.442878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:55.442945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:55.442953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.442965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.442982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.443001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:55.443023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550357:5022], now have 1 active actors on pipe
2025-10-01T14:07:55.443031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550142:2446], now have 1 active actors on pipe
2025-10-01T14:07:55.443038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254828772688289:4561]
2025-10-01T14:07:55.443044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254828772688289:4561]
2025-10-01T14:07:55.443048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254828772688289:4561]
2025-10-01T14:07:55.443061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:55.443079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:55.443083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:55.443082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 392
2025-10-01T14:07:55.443087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:55.443089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 392
2025-10-01T14:07:55.443089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:55.443097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:55.443101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:55.443132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254828772688289:4561]
2025-10-01T14:07:55.443135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:55.443138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:55.443151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.443161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.443209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74f9a63c-561a6996-7a9338e-1901b31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:55.443220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.443229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.443231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:55.443239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.443251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:55.443275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:55.443439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.443453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.443476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:55.443559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 393 partition: 0 MaxSeqNo: 45 sessionId: src_id|74f9a63c-561a6996-7a9338e-1901b31_0
2025-10-01T14:07:55.443895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dcf3b55-be3e40a5-62e11ff3-84845f15_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|74f9a63c-561a6996-7a9338e-1901b31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:55.446240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f9a63c-561a6996-7a9338e-1901b31_0] Write session: try to update token
2025-10-01T14:07:55.446258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f9a63c-561a6996-7a9338e-1901b31_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:55.463839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 393 sessionId: src_id|74f9a63c-561a6996-7a9338e-1901b31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:55.466246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:55.466470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.466507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.466548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:55.466646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:55.471078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:55.471101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:55.471104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:55.471106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:55.471116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254828772688289:4561]
2025-10-01T14:07:55.471121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254828772688289:4561]
2025-10-01T14:07:55.471124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254828772688289:4561]
2025-10-01T14:07:55.471179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:55.471183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:55.471190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.471193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:55.471195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:55.471203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:55.471339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:55.517481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254831149550369:4446]
2025-10-01T14:07:55.517745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 392, pipe: [1:7556254831149550369:4446]
2025-10-01T14:07:55.622900Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:55.631242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.631274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.631445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.631513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.631576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.631648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.631697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.631706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.631777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.631836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.631899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.631963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.632009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.632016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.632076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.632135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.632192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.632252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.632296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.632304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.632366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.632427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.632485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.632545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.632587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.632595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.632651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.632707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.632766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.632836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.632878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.632884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.632952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.633008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.633069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.633134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.633196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.633203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.633263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.633321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.633382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.633440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.633486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.633493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.633551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.633606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.633671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.633730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.633775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.633783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.633847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.633906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.633966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.634026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.634070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.634077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.634144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.634202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.634264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.634325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.634386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.634395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.634454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550369:4446], now have 1 active actors on pipe
2025-10-01T14:07:55.634699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:55.634727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254831149550369:4446]
2025-10-01T14:07:55.634754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:55.634756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:55.634782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 393 reason: error at write: Disconnected sessionId: src_id|74f9a63c-561a6996-7a9338e-1901b31_0
2025-10-01T14:07:55.634977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 393 sessionId: src_id|74f9a63c-561a6996-7a9338e-1901b31_0 is DEAD
2025-10-01T14:07:55.635624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:55.638593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f9a63c-561a6996-7a9338e-1901b31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:55.638605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f9a63c-561a6996-7a9338e-1901b31_0] Write session will restart in 0.006910s
2025-10-01T14:07:55.638632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f9a63c-561a6996-7a9338e-1901b31_0] Write session: Do CDS request
2025-10-01T14:07:55.638638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f9a63c-561a6996-7a9338e-1901b31_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:55.646904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74f9a63c-561a6996-7a9338e-1901b31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:55.647000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:55.647019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 394
2025-10-01T14:07:55.647880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:55.647931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:55.647939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:55.647947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:55.648373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 394 sessionId:  describe result for acl check
2025-10-01T14:07:55.648411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:55.648419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:55.648420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:55.648426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254831149550527:5027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:55.648945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254831149550527:5027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:55.650403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:55.651320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254831149550527:5027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:55.652993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:55.653358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:55.653369Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:55.653381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:55.653436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:55.653472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254828772688514:4563]
2025-10-01T14:07:55.654071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:55.654310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:55.654352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:55.654672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:55.654709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.654714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.654715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.654716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.654717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.654718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.654719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.654720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.654516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254831149550527:5027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:55.654531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254831149550527:5027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:55.654534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254831149550527:5027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:55.654543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:55.654722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.654723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.654724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.654725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.654726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.654727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.654732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.654740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.654742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.654744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.654746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.654748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.654750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.654751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.654753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.654755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.654757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.654759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.654760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.654762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.654767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.654774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.654779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.654784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.654788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.654792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.654797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.654802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.654806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.654812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.654814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.654817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.654820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.654823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.654825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.654828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.654830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.654833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.654836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.654838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.654841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.654844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.654847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.654849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.654852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.654854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.654856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.654859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.654887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:55.659169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:55.660170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 393
2025-10-01T14:07:55.660208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 393
2025-10-01T14:07:55.659793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:55.659807Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:55.659809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:55.659812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:55.659817Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 393 [2:7556254828772688514:4563]
2025-10-01T14:07:55.659828Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:55.659842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:55.659844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.659847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.659848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.659860Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:55.659863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:55.659869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:55.660645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 394 partition: 0 MaxSeqNo: 45 sessionId: src_id|130c786b-cd5020ac-819378af-34315d2c_0
2025-10-01T14:07:55.659918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.659920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.659923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.659926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:55.659928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:55.659978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:55.659980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.659987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.659994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.660002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:55.660014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254828772688509:4563]
2025-10-01T14:07:55.660016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254828772688509:4563]
2025-10-01T14:07:55.660017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254828772688509:4563]
2025-10-01T14:07:55.660024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:55.660032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:55.660034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:55.660035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:55.660037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:55.660042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:55.660044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:55.660051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550591:5027], now have 1 active actors on pipe
2025-10-01T14:07:55.660054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550374:2446], now have 1 active actors on pipe
2025-10-01T14:07:55.660074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254828772688509:4563]
2025-10-01T14:07:55.660080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:55.660095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:55.660235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.660240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.660266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|130c786b-cd5020ac-819378af-34315d2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:55.660271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.660273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.660275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:55.660281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.660288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:55.660298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:55.660527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.660531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.660544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:55.661001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74f9a63c-561a6996-7a9338e-1901b31_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|130c786b-cd5020ac-819378af-34315d2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:55.663417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|130c786b-cd5020ac-819378af-34315d2c_0] Write session: try to update token
2025-10-01T14:07:55.663436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|130c786b-cd5020ac-819378af-34315d2c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:55.674449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:55.674470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:55.674481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254828772688509:4563]
2025-10-01T14:07:55.674527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:55.674717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:55.674861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:55.675012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:55.675153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:55.675648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:55.675913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:55.675965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:55.687773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 394 sessionId: src_id|130c786b-cd5020ac-819378af-34315d2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:55.690163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:55.690507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.690525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.690554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:55.691517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:55.702725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:55.702745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:55.702748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:55.702749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:55.702761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254828772688509:4563]
2025-10-01T14:07:55.702765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254828772688509:4563]
2025-10-01T14:07:55.702769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254828772688509:4563]
2025-10-01T14:07:55.702818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:55.702819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:55.702826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.702826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:55.702828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:55.702830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:55.702962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:55.736051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254831149550600:4446]
2025-10-01T14:07:55.738630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 393, pipe: [1:7556254831149550600:4446]
2025-10-01T14:07:55.853172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:55.860931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.860959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.861115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.861169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.861237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.861298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.861345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.861350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.861414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.861471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.861525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.861621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.861660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.861663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.861728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.861783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.861842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.861901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.861943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.861946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.862008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.862061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.862113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.862180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.862229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.862235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.862289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.862336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.862414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.862469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.862506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.862507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.862565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.862615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.862667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.862731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.862769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.862771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.862828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.862878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.862932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.862991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.863029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.863031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.863087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.863147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.863201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.863259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.863312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.863315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.863415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.863481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.863543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.863595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.863647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.863649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.863712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:55.863801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:55.863859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:55.863917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:55.863957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:55.863959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:55.864024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550600:4446], now have 1 active actors on pipe
2025-10-01T14:07:55.866911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:55.867592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254831149550600:4446]
2025-10-01T14:07:55.867622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:55.867655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 394 reason: status is not ok: tablet will be restarted right now sessionId: src_id|130c786b-cd5020ac-819378af-34315d2c_0
2025-10-01T14:07:55.867837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 394 sessionId: src_id|130c786b-cd5020ac-819378af-34315d2c_0 is DEAD
2025-10-01T14:07:55.868003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c786b-cd5020ac-819378af-34315d2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:55.868010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c786b-cd5020ac-819378af-34315d2c_0] Write session will restart in 0.006776s
2025-10-01T14:07:55.868036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c786b-cd5020ac-819378af-34315d2c_0] Write session: Do CDS request
2025-10-01T14:07:55.868042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c786b-cd5020ac-819378af-34315d2c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:55.867962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:55.875888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|130c786b-cd5020ac-819378af-34315d2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:55.876232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:55.876249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 395
2025-10-01T14:07:55.876371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:55.876398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:55.876404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:55.876409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:55.876898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 395 sessionId:  describe result for acl check
2025-10-01T14:07:55.876934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:55.876936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:55.876937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:55.876943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254831149550637:5038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:55.877540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254831149550637:5038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:55.880031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254831149550637:5038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:55.888718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254831149550637:5038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:55.888740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254831149550637:5038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:55.888744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254831149550637:5038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:55.888753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:55.897463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:55.900414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:55.900706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:55.900717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:55.900730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:55.900789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:55.900851Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254828772688745:4568]
2025-10-01T14:07:55.901520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:55.901882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:55.901947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:55.902459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:55.902534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.902542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.902543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.902545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.902546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.902548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.902549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.902551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.902553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.902554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.902555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.902557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.902558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.902559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.902566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.902576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.902580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.902584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.902588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.902592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.902596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.902600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.902604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.902608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.902613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.902617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.902621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.902624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.902632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.902640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:55.902646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.902652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:55.902657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.902662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:55.902669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.902675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:55.902681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.902688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:55.902693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.902698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:55.902705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.902710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:55.902715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.902721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:55.902727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.902732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:55.902737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.902742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.902747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.902753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.902758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.902764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.902770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.902775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:55.902780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.902785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:55.902833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:55.915880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:55.916713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:55.916732Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:55.916735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:55.916740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:55.916748Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 394 [2:7556254828772688745:4568]
2025-10-01T14:07:55.916768Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:55.916787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:55.916796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.916799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.916814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.916832Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:55.916844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:55.916852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:55.916919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.916927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.916929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.916933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:55.916937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:55.917017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:55.917026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.917040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:55.917058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:55.917076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:55.917099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254828772688740:4568]
2025-10-01T14:07:55.917107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254828772688740:4568]
2025-10-01T14:07:55.917110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254828772688740:4568]
2025-10-01T14:07:55.917126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:55.917144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:55.917165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:55.917174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:55.917179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:55.917193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:55.917195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:55.917216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254828772688740:4568]
2025-10-01T14:07:55.917224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:55.917278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:55.917465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550629:2446], now have 1 active actors on pipe
2025-10-01T14:07:55.917476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550738:5038], now have 1 active actors on pipe
2025-10-01T14:07:55.917482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 394
2025-10-01T14:07:55.917534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 394
2025-10-01T14:07:55.917747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.917758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.917789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:55.917801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:55.917810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:55.917813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:55.917824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:55.917840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:55.917859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:55.918084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.918091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.918105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:55.918223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 395 partition: 0 MaxSeqNo: 45 sessionId: src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0
2025-10-01T14:07:55.918665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|130c786b-cd5020ac-819378af-34315d2c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:55.921079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0] Write session: try to update token
2025-10-01T14:07:55.921098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:55.933920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:55.933939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:55.933949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254828772688740:4568]
2025-10-01T14:07:55.933994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:55.934000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:55.934208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:55.934362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:55.934538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:55.934687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:55.934889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:55.934934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:55.943738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 395 sessionId: src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:55.946478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:55.951335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:55.950809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:55.950839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:55.950879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:55.969982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254831149550853:4446]
2025-10-01T14:07:55.988875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 394, pipe: [1:7556254831149550853:4446]
2025-10-01T14:07:55.989088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254831149550853:4446], now have 1 active actors on pipe
2025-10-01T14:07:55.991767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:55.991774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:55.991776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:55.991779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:55.991791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254828772688740:4568]
2025-10-01T14:07:55.991796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254828772688740:4568]
2025-10-01T14:07:55.991802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254828772688740:4568]
2025-10-01T14:07:55.991863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:55.991872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:55.991875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:55.992061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:55.994483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:55.994497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:55.994508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:56.159169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:56.167707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.167739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.167912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.167976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.168035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.168098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.168146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.168160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.168221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.168277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.168342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.168410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.168456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.168459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.168521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.168580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.168637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.168700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.168739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.168742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.168810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.168867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.168925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.168990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.169032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.169040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.169099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.169156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.169214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.169278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.169329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.169338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.169404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.169461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.169517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.169573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.169620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.169628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.169684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.169740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.169796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.169862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.169906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.169915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.169978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.170032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.170086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.170144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.170183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.170198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.170263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.170329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.170414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.170486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.170541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.170549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.170614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.170673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.170735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.170796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.170839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.170848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.171703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:56.171717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0] Write session will restart in 0.005141s
2025-10-01T14:07:56.171756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0] Write session: Do CDS request
2025-10-01T14:07:56.171763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:56.171285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:56.171300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:56.171329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 395 reason: error at write: Disconnected sessionId: src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0
2025-10-01T14:07:56.171527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 395 sessionId: src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0 is DEAD
2025-10-01T14:07:56.171701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:56.171890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254831149550853:4446]
2025-10-01T14:07:56.172906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:56.178879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:56.178998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:56.179017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 396
2025-10-01T14:07:56.179154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:56.179191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:56.179196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:56.179201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:56.180721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 396 sessionId:  describe result for acl check
2025-10-01T14:07:56.180752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:56.180890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:56.180893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:56.180899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254835444518197:5044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:56.181424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254835444518197:5044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:56.189653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254835444518197:5044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:56.195597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254835444518197:5044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:56.195615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254835444518197:5044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:56.195618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254835444518197:5044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:56.195628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:56.195996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:56.199178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:56.199435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:56.199439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:56.199453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:56.199513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:56.199551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254833067656304:4581]
2025-10-01T14:07:56.200192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:56.200656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:56.200701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:56.201069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:56.201136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.201137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.201139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.201141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.201142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.201143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.201145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.201146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.201147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.201149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.201150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.201151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.201152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.201153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.201160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.201170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.201175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.201179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.201183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.201188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.201192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.201196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.201200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.201205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.201209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.201213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.201217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.201220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.201229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.201238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.201245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.201250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.201254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.201259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.201263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.201270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.201275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.201279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.201284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.201288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.201293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.201300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.201305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.201310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.201314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.201339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.201344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.201349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.201357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.201364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.201368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.201373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.201378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.201383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.201388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.201393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.201429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:56.207742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 395
2025-10-01T14:07:56.207742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 395
2025-10-01T14:07:56.206476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:56.207174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:56.207180Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:56.207183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:56.207187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:56.207194Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 395 [2:7556254833067656304:4581]
2025-10-01T14:07:56.207211Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:56.207231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:56.207234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.207238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.207240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.207260Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:56.207267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:56.207275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:56.207338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.207340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.207342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.207346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:56.207349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:56.207435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:56.207438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.207452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.207462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.207478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:56.207496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254833067656297:4581]
2025-10-01T14:07:56.207499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254833067656297:4581]
2025-10-01T14:07:56.207501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254833067656297:4581]
2025-10-01T14:07:56.207514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:56.207527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:56.207530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:56.207531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:56.207534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:56.207545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:56.207548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:56.207559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518384:5044], now have 1 active actors on pipe
2025-10-01T14:07:56.207563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518170:2446], now have 1 active actors on pipe
2025-10-01T14:07:56.207600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254833067656297:4581]
2025-10-01T14:07:56.207620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:56.207689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:56.208216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.208225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.208260Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e627cf8e-71f654f-ff76e898-27f8411c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:56.211513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 396 partition: 0 MaxSeqNo: 45 sessionId: src_id|e627cf8e-71f654f-ff76e898-27f8411c_0
2025-10-01T14:07:56.208270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.208276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.208279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:56.208292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.208304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:56.208324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:56.211267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.211277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.211313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:56.211914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea55a71f-3ba6573c-49ce2e83-9e6cac3a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e627cf8e-71f654f-ff76e898-27f8411c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:56.214778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e627cf8e-71f654f-ff76e898-27f8411c_0] Write session: try to update token
2025-10-01T14:07:56.214796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e627cf8e-71f654f-ff76e898-27f8411c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:56.231094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:56.231117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:56.231120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:56.231122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:56.231131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254833067656297:4581]
2025-10-01T14:07:56.231137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254833067656297:4581]
2025-10-01T14:07:56.231142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254833067656297:4581]
2025-10-01T14:07:56.231192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:56.231199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.231198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:56.231201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:56.231205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:56.231210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:56.231344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:56.239985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 396 sessionId: src_id|e627cf8e-71f654f-ff76e898-27f8411c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:56.242792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:56.272155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254835444518400:4446]
2025-10-01T14:07:56.272560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 395, pipe: [1:7556254835444518400:4446]
2025-10-01T14:07:56.390043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:56.390350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.390359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.390400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518400:4446], now have 1 active actors on pipe
2025-10-01T14:07:56.393278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:56.393871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e627cf8e-71f654f-ff76e898-27f8411c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:56.393883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e627cf8e-71f654f-ff76e898-27f8411c_0] Write session will restart in 0.009141s
2025-10-01T14:07:56.393909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e627cf8e-71f654f-ff76e898-27f8411c_0] Write session: Do CDS request
2025-10-01T14:07:56.393916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e627cf8e-71f654f-ff76e898-27f8411c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:56.393370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254835444518400:4446]
2025-10-01T14:07:56.393420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:56.393423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:56.393509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 396 reason: error at write: Disconnected sessionId: src_id|e627cf8e-71f654f-ff76e898-27f8411c_0
2025-10-01T14:07:56.393704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 396 sessionId: src_id|e627cf8e-71f654f-ff76e898-27f8411c_0 is DEAD
2025-10-01T14:07:56.393922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:56.404232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e627cf8e-71f654f-ff76e898-27f8411c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:56.404779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:56.404799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 397
2025-10-01T14:07:56.405026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:56.405059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:56.405065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:56.405070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:56.405584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 397 sessionId:  describe result for acl check
2025-10-01T14:07:56.405622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:56.405624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:56.405626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:56.405631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254835444518428:5048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:56.406229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254835444518428:5048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:56.417865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254835444518428:5048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:56.421653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:56.422063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254835444518428:5048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:56.422095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254835444518428:5048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:56.422099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254835444518428:5048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:56.422109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:56.424387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:56.424619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:56.424632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:56.424644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:56.424696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:56.424734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254833067656529:4584]
2025-10-01T14:07:56.425405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:56.425699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:56.425739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:56.426042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:56.426093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.426099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.426101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.426102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.426103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.426105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.426106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.426107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.426114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.426115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.426117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.426118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.426120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.426121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.426127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.426137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.426142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.426146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.426151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.426155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.426159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.426163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.426168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.426172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.426176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.426181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.426185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.426189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.426197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.426206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.426213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.426218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.426227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.426241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.426245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.426251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.426255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.426261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.426266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.426272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.426278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.426283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.426310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.426316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.426321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.426327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.426332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.426337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.426342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.426347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.426352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.426357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.426361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.426367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.426388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.426393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.426436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:56.431809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:56.432450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:56.432455Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:56.432458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:56.432462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:56.432470Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 396 [2:7556254833067656529:4584]
2025-10-01T14:07:56.433154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 396
2025-10-01T14:07:56.433199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 396
2025-10-01T14:07:56.432488Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:56.432508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:56.432513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.432517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.432519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.432537Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:56.432543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:56.432550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:56.432611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.432613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.432616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.432622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:56.432625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:56.432700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:56.432703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.432717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.432729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.432746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:56.432764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254833067656523:4584]
2025-10-01T14:07:56.432766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254833067656523:4584]
2025-10-01T14:07:56.432768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254833067656523:4584]
2025-10-01T14:07:56.432786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:56.432825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:56.432840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:56.432843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:56.432851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:56.432856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:56.432858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:56.432882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254833067656523:4584]
2025-10-01T14:07:56.432885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:56.432943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:56.432982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518404:2446], now have 1 active actors on pipe
2025-10-01T14:07:56.432986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518622:5048], now have 1 active actors on pipe
2025-10-01T14:07:56.433251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.433255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.433280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f401896-6ca52426-8bf88490-ff5564d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:56.433288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.433292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.433294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:56.433303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.433314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:56.433329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:56.433655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 397 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f401896-6ca52426-8bf88490-ff5564d0_0
2025-10-01T14:07:56.434123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e627cf8e-71f654f-ff76e898-27f8411c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f401896-6ca52426-8bf88490-ff5564d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:56.433528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.433538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.433554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:56.437098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f401896-6ca52426-8bf88490-ff5564d0_0] Write session: try to update token
2025-10-01T14:07:56.437119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f401896-6ca52426-8bf88490-ff5564d0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:56.445946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:56.445968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:56.445979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254833067656523:4584]
2025-10-01T14:07:56.446022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:56.446027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:56.446185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:56.446326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:56.446486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:56.446617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:56.446800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:56.446833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:56.461948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 397 sessionId: src_id|7f401896-6ca52426-8bf88490-ff5564d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:56.464535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:56.464790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.464827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.464868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:56.464959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:56.473493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:56.473514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:56.473516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:56.473518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:56.473527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254833067656523:4584]
2025-10-01T14:07:56.473530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254833067656523:4584]
2025-10-01T14:07:56.473533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254833067656523:4584]
2025-10-01T14:07:56.473577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:56.473583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.473584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:56.473722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:56.475601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:56.475615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:56.475618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:56.494576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254835444518634:4446]
2025-10-01T14:07:56.495057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 396, pipe: [1:7556254835444518634:4446]
2025-10-01T14:07:56.629276Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:56.638876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.638911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.639099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.642603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:56.642624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:56.642628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:56.642658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 397 reason: error at write: Disconnected sessionId: src_id|7f401896-6ca52426-8bf88490-ff5564d0_0
2025-10-01T14:07:56.642678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254835444518634:4446]
2025-10-01T14:07:56.642854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 397 sessionId: src_id|7f401896-6ca52426-8bf88490-ff5564d0_0 is DEAD
2025-10-01T14:07:56.642994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f401896-6ca52426-8bf88490-ff5564d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:56.643006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f401896-6ca52426-8bf88490-ff5564d0_0] Write session will restart in 0.008213s
2025-10-01T14:07:56.643032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f401896-6ca52426-8bf88490-ff5564d0_0] Write session: Do CDS request
2025-10-01T14:07:56.643043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f401896-6ca52426-8bf88490-ff5564d0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:56.639171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.639246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.639310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.639353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.639358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.639433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.639503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.639572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.639642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.639683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.639686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.639755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.639812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.639868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.639926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.639981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.639984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.640047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.640110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.640172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.640231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.640271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.640274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.640338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.640398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.640457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.640516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.640620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.640622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.640693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.640754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.640834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.640912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.640960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.640963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.641035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.641094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.641167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.641229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.641272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.641275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.641346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.641409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.641473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.641541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.641587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.641595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.641670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.641735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.641803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.641872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.641926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.641930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.642009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.642076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.642147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.642212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.642259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.642262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.642336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518634:4446], now have 1 active actors on pipe
2025-10-01T14:07:56.643578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:56.653048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f401896-6ca52426-8bf88490-ff5564d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:56.653061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:56.653085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 398
2025-10-01T14:07:56.653321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:56.653355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:56.653365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:56.653369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:56.653848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 398 sessionId:  describe result for acl check
2025-10-01T14:07:56.653887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:56.653893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:56.653895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:56.653900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254835444518662:5053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:56.654446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254835444518662:5053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:56.658742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254835444518662:5053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:56.662492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254835444518662:5053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:56.662509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254835444518662:5053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:56.662512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254835444518662:5053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:56.662521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:56.664147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:56.666746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:56.666990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:56.667005Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:56.667019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:56.667084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:56.667129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254833067656755:4586]
2025-10-01T14:07:56.667714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:56.668041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:56.668087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:56.668405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:56.668452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.668467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.668472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.668473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.668475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.668476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.668477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.668479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.668480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.668481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.668482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.668483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.668485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.668486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.668493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.668503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.668507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.668511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.668514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.668518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.668521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.668525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.668530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.668534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.668538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.668541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.668545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.668549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.668556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.668564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.668570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.668580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.668587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.668597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.668601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.668605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.668616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.668620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.668624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.668634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.668638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.668648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.668652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.668661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.668667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.668673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.668677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.668682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.668686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.668695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.668700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.668709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.668714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.668718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.668727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.668731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.668772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:56.673184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:56.673917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:56.673936Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:56.673940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:56.673944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:56.673952Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 397 [2:7556254833067656755:4586]
2025-10-01T14:07:56.673973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:56.673996Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:56.674004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.674008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.674010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.674029Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:56.674040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:56.674048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:56.674114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.674121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.674124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.674127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:56.674130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:56.674209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:56.674219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.674237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.674263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.674309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:56.674346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518855:5053], now have 1 active actors on pipe
2025-10-01T14:07:56.674359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518639:2446], now have 1 active actors on pipe
2025-10-01T14:07:56.674413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 397
2025-10-01T14:07:56.674421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 397
2025-10-01T14:07:56.674969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 398 partition: 0 MaxSeqNo: 45 sessionId: src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0
2025-10-01T14:07:56.675329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f401896-6ca52426-8bf88490-ff5564d0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:56.678090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0] Write session: try to update token
2025-10-01T14:07:56.678113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:56.674368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254833067656750:4586]
2025-10-01T14:07:56.674409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254833067656750:4586]
2025-10-01T14:07:56.674411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254833067656750:4586]
2025-10-01T14:07:56.674429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:56.674445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:56.674465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:56.674468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:56.674482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:56.674485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:56.674487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:56.674513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254833067656750:4586]
2025-10-01T14:07:56.674517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:56.674519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:56.674535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.674541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.674597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:56.674604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.674609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.674611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:56.674622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.674631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:56.674652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:56.674831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.674839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.674878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:56.698923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 398 sessionId: src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:56.701670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:56.701889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.701914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.701956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:56.702042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:56.706653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:56.706674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:56.706676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:56.706678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:56.706687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254833067656750:4586]
2025-10-01T14:07:56.706693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254833067656750:4586]
2025-10-01T14:07:56.706697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254833067656750:4586]
2025-10-01T14:07:56.706736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:56.706742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:56.706745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:56.706744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:56.706751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.706754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:56.706900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:56.742704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254835444518869:4446]
2025-10-01T14:07:56.743469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 397, pipe: [1:7556254835444518869:4446]
2025-10-01T14:07:56.860824Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:56.869087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.869111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.869275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.869333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.869398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.869458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.869701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.869714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.869777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.869831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.869889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.869962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.870010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.870019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.870084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.870136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.870196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.870252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.870297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.870302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.870360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.870435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.870503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.870571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.870612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.870619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.870691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.870752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.870812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.870877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.870924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.870931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.870995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.871058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.871122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.871192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.871240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.871246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.871316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.871379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.871445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.871513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.871559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.871567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.871633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.871698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.871759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.871827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.871873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.871879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.871956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.872025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.872091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.872155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.872201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.872207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.872280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:56.872342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:56.872406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:56.872470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:56.872514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:56.872520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:56.872587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518869:4446], now have 1 active actors on pipe
2025-10-01T14:07:56.872882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254835444518869:4446]
2025-10-01T14:07:56.872913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:56.872915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:56.872939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 398 reason: error at write: Disconnected sessionId: src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0
2025-10-01T14:07:56.873129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 398 sessionId: src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0 is DEAD
2025-10-01T14:07:56.873213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:56.873256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:56.873265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0] Write session will restart in 0.006925s
2025-10-01T14:07:56.873265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:56.873306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0] Write session: Do CDS request
2025-10-01T14:07:56.873313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:56.881862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:56.881922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:56.881934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 399
2025-10-01T14:07:56.882070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:56.882101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:56.882110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:56.882115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:56.882530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 399 sessionId:  describe result for acl check
2025-10-01T14:07:56.882557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:56.882563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:56.882564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:56.882569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254835444518951:5063] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:56.883052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254835444518951:5063] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:56.885379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254835444518951:5063] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:56.888027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254835444518951:5063] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:56.888041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254835444518951:5063] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:56.888044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254835444518951:5063] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:56.888052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:56.888073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:56.890439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:56.890649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:56.890664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:56.890677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:56.890744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:56.890783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254833067656981:4589]
2025-10-01T14:07:56.891356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:56.891670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:56.891719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:56.892025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:56.892098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.892105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.892106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.892107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.892108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.892109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.892110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.892111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.892112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.892113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.892114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.892116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.892116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.892118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.892123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.892132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.892136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.892140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.892143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.892147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.892150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.892153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.892156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.892160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.892163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.892167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.892170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.892173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.892180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.892187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:56.892194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.892199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:56.892206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.892211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:56.892214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.892219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:56.892225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.892235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:56.892239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.892245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:56.892254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.892259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:56.892263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.892268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:56.892272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.892277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:56.892281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.892285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.892294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.892299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.892309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.892314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.892322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.892327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:56.892335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.892340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:56.892380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:56.896166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:56.896830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:56.896846Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:56.896848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:56.896852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:56.896858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 398 [2:7556254833067656981:4589]
2025-10-01T14:07:56.896873Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:56.896888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:56.896895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.896898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.896900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.896915Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:56.896923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:56.896931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:56.896988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.896995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.896997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.897000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:56.897003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:56.897072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:56.897081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.897093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:56.897116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:56.897134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:56.897157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444518878:2446], now have 1 active actors on pipe
2025-10-01T14:07:56.897165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444519102:5063], now have 1 active actors on pipe
2025-10-01T14:07:56.897172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254833067656975:4589]
2025-10-01T14:07:56.897178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254833067656975:4589]
2025-10-01T14:07:56.897180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254833067656975:4589]
2025-10-01T14:07:56.897167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 398
2025-10-01T14:07:56.897189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:56.897200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:56.897205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:56.897209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:56.897218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:56.897219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:56.897223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:56.897212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 398
2025-10-01T14:07:56.897257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254833067656975:4589]
2025-10-01T14:07:56.897268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:56.897273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:56.897288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.897296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.897335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:56.897346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:56.897354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:56.897356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:56.897364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:56.897377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:56.897397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:56.897537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.897547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.897562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:56.897630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 399 partition: 0 MaxSeqNo: 45 sessionId: src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0
2025-10-01T14:07:56.898005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cce4e9e8-88483bd3-5f49c2b5-c9f10293_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:56.900663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0] Write session: try to update token
2025-10-01T14:07:56.900681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:56.915911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 399 sessionId: src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:56.918434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:56.919731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:56.919758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:56.919779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:56.919782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:56.919784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:56.919786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:56.919794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254833067656975:4589]
2025-10-01T14:07:56.919798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254833067656975:4589]
2025-10-01T14:07:56.919802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254833067656975:4589]
2025-10-01T14:07:56.919860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:56.919867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:56.919872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:56.919874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:56.919876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:56.919880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:56.920016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:56.973105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254835444519125:4446]
2025-10-01T14:07:56.973419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 398, pipe: [1:7556254835444519125:4446]
2025-10-01T14:07:57.073719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:57.074006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:57.074071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254835444519125:4446], now have 1 active actors on pipe
2025-10-01T14:07:57.074165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:57.074255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:57.074260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:57.074323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 399 reason: error at write: Disconnected sessionId: src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0
2025-10-01T14:07:57.074459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 399 sessionId: src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0 is DEAD
2025-10-01T14:07:57.074533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254835444519125:4446]
2025-10-01T14:07:57.074564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:57.075177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:57.075187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0] Write session will restart in 0.008447s
2025-10-01T14:07:57.075217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0] Write session: Do CDS request
2025-10-01T14:07:57.075225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:57.086951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:57.087084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:57.087106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 400
2025-10-01T14:07:57.087353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:57.087385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:57.087390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:57.087395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:57.087904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 400 sessionId:  describe result for acl check
2025-10-01T14:07:57.087951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:57.087960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:57.087962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:57.087968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254839739486574:5070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:57.088640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254839739486574:5070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:57.090771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:57.093364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:57.093605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:57.093618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:57.093631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:57.093690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:57.093732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254837362624520:4593]
2025-10-01T14:07:57.094356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:57.094708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:57.094764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:57.095099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:57.095175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.095185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.095186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.095187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.095188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.095189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.095190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.095192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.095193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.095194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.095196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.095197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.095198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.095200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.095206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.095217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.095221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.095225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.095229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.095233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.095237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.095241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.095244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.095249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.095252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.095256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.095261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.095264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.095273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.095281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.095287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.095292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.095303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.095307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.095312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.095318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.095327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.095336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.095345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.095354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.095360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.095365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.095370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.095375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.095385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.095396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.095400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.095405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.095414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.095419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.095427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.095432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.095442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.095452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.095460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.095469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.095510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:57.097029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254839739486574:5070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:57.100519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:57.101456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:57.101471Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:57.101473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:57.101476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:57.101481Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 399 [2:7556254837362624520:4593]
2025-10-01T14:07:57.101495Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:57.101509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:57.101511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.101514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.101516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.101529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:57.101534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:57.101540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:57.101592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.101601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.101603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.101607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:57.101610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:57.101669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:57.101675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.101683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.101690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.101700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:57.101718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254837362624515:4593]
2025-10-01T14:07:57.101720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254837362624515:4593]
2025-10-01T14:07:57.101723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254837362624515:4593]
2025-10-01T14:07:57.101731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:57.101745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:57.101755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:57.101757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:57.101781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:57.101784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:57.101786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:57.101789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254837362624515:4593]
2025-10-01T14:07:57.101790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:57.101793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:57.101815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739486426:2446], now have 1 active actors on pipe
2025-10-01T14:07:57.101818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739486650:5070], now have 1 active actors on pipe
2025-10-01T14:07:57.105610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.105639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.105674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:57.105690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.105696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.105700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:57.105712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.105734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:57.105759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:57.106094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.106107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.106128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:57.100879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254839739486574:5070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:57.100903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254839739486574:5070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:57.100907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254839739486574:5070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:57.100917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:57.102253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 399
2025-10-01T14:07:57.102282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 399
2025-10-01T14:07:57.106278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 400 partition: 0 MaxSeqNo: 45 sessionId: src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0
2025-10-01T14:07:57.106698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa96941-25cd9aa-1c5f4951-b72af6ff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:57.110327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0] Write session: try to update token
2025-10-01T14:07:57.110351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:57.120908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:57.120930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:57.120944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254837362624515:4593]
2025-10-01T14:07:57.120993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:57.120997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:57.121180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:57.121336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:57.121498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:57.121644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:57.121864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:57.121907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:57.135770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 400 sessionId: src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:57.139075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:57.139296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.139320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.139358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:57.139474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:57.147560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:57.147578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:57.147583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:57.147585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:57.147594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254837362624515:4593]
2025-10-01T14:07:57.147598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254837362624515:4593]
2025-10-01T14:07:57.147601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254837362624515:4593]
2025-10-01T14:07:57.147653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:57.147655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:57.147660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:57.147663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.147664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:57.147665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:57.147782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:57.174290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254839739486674:4446]
2025-10-01T14:07:57.174529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 399, pipe: [1:7556254839739486674:4446]
2025-10-01T14:07:57.300342Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:57.308885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.308918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.309100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.309171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.309243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.309319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.309761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.309776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.309850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.309911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.309982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.310053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.310106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.310114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.310176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.310235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.310298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.310362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.310425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.310435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.310498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.310561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.310623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.310681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.310723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.310731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.310792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.310850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.310910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.310971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.311018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.311026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.311092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.311151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.311217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.311279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.311321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.311323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.311393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.311445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.311515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.311579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.311629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.311636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.311699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.311757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.311820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.311887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.311937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.311945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.312009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.312063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.312122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.312187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.312231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.312238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.312298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.312362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.312421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.312480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.312527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.312534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.312597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739486674:4446], now have 1 active actors on pipe
2025-10-01T14:07:57.314600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:57.314600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:57.314611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:57.314623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:57.314638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 400 reason: error at write: Disconnected sessionId: src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0
2025-10-01T14:07:57.314671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254839739486674:4446]
2025-10-01T14:07:57.314845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 400 sessionId: src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0 is DEAD
2025-10-01T14:07:57.315006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:57.315031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0] Write session will restart in 0.008822s
2025-10-01T14:07:57.315056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0] Write session: Do CDS request
2025-10-01T14:07:57.315060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:57.324870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:57.325235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:57.325267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 401
2025-10-01T14:07:57.325380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:57.325413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:57.325422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:57.325430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:57.325869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 401 sessionId:  describe result for acl check
2025-10-01T14:07:57.325901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:57.325906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:57.325908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:57.325913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254839739486695:5076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:57.326450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254839739486695:5076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:57.334328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254839739486695:5076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:57.339101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254839739486695:5076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:57.339119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254839739486695:5076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:57.339123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254839739486695:5076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:57.339133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:57.344146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:57.346461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:57.346697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:57.346706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:57.346720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:57.346775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:57.346817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254837362624779:4607]
2025-10-01T14:07:57.347436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:57.347809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:57.347873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:57.348209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:57.348272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.348278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.348280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.348281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.348283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.348284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.348286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.348287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.348288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.348289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.348291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.348292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.348293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.348294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.348300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.348309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.348313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.348317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.348320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.348324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.348327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.348330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.348334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.348338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.348341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.348345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.348348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.348351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.348360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.348369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.348375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.348381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.348386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.348392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.348395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.348402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.348407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.348413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.348423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.348429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.348434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.348440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.348449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.348454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.348462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.348470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.348475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.348480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.348486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.348491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.348496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.348502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.348506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.348513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.348522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.348528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.348577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:57.353377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:57.354035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:57.354051Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:57.354055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:57.354059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:57.354066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 400 [2:7556254837362624779:4607]
2025-10-01T14:07:57.354082Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:57.354104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:57.354108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.354112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.354115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.354132Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:57.354138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:57.354148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:57.354209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.354216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.354218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.354221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:57.354224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:57.354541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 400
2025-10-01T14:07:57.354582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 400
2025-10-01T14:07:57.354387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:57.354397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.354410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.354419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.354435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:57.354453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739486857:5076], now have 1 active actors on pipe
2025-10-01T14:07:57.354457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739486682:2446], now have 1 active actors on pipe
2025-10-01T14:07:57.354466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254837362624774:4607]
2025-10-01T14:07:57.354468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254837362624774:4607]
2025-10-01T14:07:57.354470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254837362624774:4607]
2025-10-01T14:07:57.354486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:57.354502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:57.354510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:57.354514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:57.354516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:57.354516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:57.354519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:57.354560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254837362624774:4607]
2025-10-01T14:07:57.354567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:57.354575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:57.354718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.354728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.354765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:57.354775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.354780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.354783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:57.354793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.354805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:57.354822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:57.355143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.355146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.355161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:57.355291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 401 partition: 0 MaxSeqNo: 45 sessionId: src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0
2025-10-01T14:07:57.355651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|743665cf-b20d623c-a3baa2bf-36a7512d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:57.358612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0] Write session: try to update token
2025-10-01T14:07:57.358631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:57.381669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:57.381695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:57.381698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:57.381700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:57.381710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254837362624774:4607]
2025-10-01T14:07:57.381714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254837362624774:4607]
2025-10-01T14:07:57.381718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254837362624774:4607]
2025-10-01T14:07:57.381772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:57.381773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:57.381781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.381784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:57.381787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:57.381792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:57.381930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:57.386430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 401 sessionId: src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:57.389634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:57.416470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254839739486915:4446]
2025-10-01T14:07:57.417096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 400, pipe: [1:7556254839739486915:4446]
2025-10-01T14:07:57.536134Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:57.536721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.536736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.536778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739486915:4446], now have 1 active actors on pipe
2025-10-01T14:07:57.537035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:57.537158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:57.537223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254839739486915:4446]
2025-10-01T14:07:57.537250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:57.537335Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:07:57.537342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 401 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0
2025-10-01T14:07:57.537434Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 4 consumer shared/user session shared/user_1_4_9200912150680924553_v1 is DEAD
2025-10-01T14:07:57.537522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 401 sessionId: src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0 is DEAD
2025-10-01T14:07:57.537586Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254736660252070:4440] disconnected; active server actors: 1
2025-10-01T14:07:57.537604Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254736660252070:4440] client user disconnected session shared/user_1_4_9200912150680924553_v1
2025-10-01T14:07:57.538031Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:07:57.538030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:57.538055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0] Write session will restart in 0.006651s
2025-10-01T14:07:57.538082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0] Write session: Do CDS request
2025-10-01T14:07:57.538089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:57.538184Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:57.538191Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:07:57.538201Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.005249s
2025-10-01T14:07:57.544824Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:07:57.545207Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:07:57.545223Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 5
2025-10-01T14:07:57.545791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:57.545595Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 5 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:57.545665Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:07:57.545769Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 auth for : user
2025-10-01T14:07:57.545795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:57.545799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 402
2025-10-01T14:07:57.545993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:57.546029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:57.546033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:57.546037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:57.546087Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 Handle describe topics response
2025-10-01T14:07:57.546116Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 auth is DEAD
2025-10-01T14:07:57.546120Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:07:57.546636Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_5_10090980969717386432_v1
2025-10-01T14:07:57.546584Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:07:57.546754Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254839739486931:5080] connected; active server actors: 1
2025-10-01T14:07:57.546769Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556254839739486931:5080] session shared/user_1_5_10090980969717386432_v1
2025-10-01T14:07:57.546792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:07:57.546812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:07:57.546822Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_5_10090980969717386432_v1" (Sender=[1:7556254839739486927:5080], Pipe=[1:7556254839739486931:5080], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:57.546827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:07:57.546843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:07:57.546856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_5_10090980969717386432_v1" (Sender=[1:7556254839739486927:5080], Pipe=[1:7556254839739486931:5080], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:07:57.546870Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_5_10090980969717386432_v1" sender [1:7556254839739486927:5080] lock partition 0 for ReadingSession "shared/user_1_5_10090980969717386432_v1" (Sender=[1:7556254839739486927:5080], Pipe=[1:7556254839739486931:5080], Partitions=[], ActiveFamilyCount=1) generation 1 step 5
2025-10-01T14:07:57.546883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:07:57.546889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000043s
2025-10-01T14:07:57.547167Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 5 Session: "shared/user_1_5_10090980969717386432_v1" ClientId: "user" PipeClient { RawX1: 7556254839739486931 RawX2: 4503603922342872 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:07:57.547193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:07:57.547198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 402 sessionId:  describe result for acl check
2025-10-01T14:07:57.547247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:57.547249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:57.547251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:57.547258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254839739486937:5082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:57.549714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254839739486937:5082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:57.553137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254839739486937:5082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:57.560250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254839739486937:5082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:57.560274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254839739486937:5082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:57.560278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254839739486937:5082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:57.560289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:57.576527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:57.577517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:57.577744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:57.577757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:57.577770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:57.577841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:57.577896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254837362625008:4609]
2025-10-01T14:07:57.578663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:57.580788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:57.580883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:57.581284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:57.581350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.581351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.581352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.581354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.581356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.581357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.581358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.581360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.581362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.581363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.581364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.581366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.581367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.581369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.581376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.581388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.581393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.581397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.581402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.581405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.581424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.581428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.581432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.581436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.581440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.581444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.581447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.581451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.581460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.581469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.581476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.581482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.581490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.581495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.581499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.581504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.581510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.581514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.581519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.581524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.581531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.581536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.581541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.581545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.581550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.581556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.581561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.581566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.581572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.581577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.581582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.581588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.581593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.581600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.581605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.581611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.581651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:57.587891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 401
2025-10-01T14:07:57.587944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 401
2025-10-01T14:07:57.587972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 401, pipe: [1:7556254839739486936:5085]
2025-10-01T14:07:57.586306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:57.587165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:57.587178Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:57.587181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:57.587186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:57.587194Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 401 [2:7556254837362625008:4609]
2025-10-01T14:07:57.587219Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:57.587247Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:57.587251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.587257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.587259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.587276Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:57.587281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:57.587289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:57.587372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.587374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.587377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.587380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:57.587383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:57.587478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:57.587480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.587494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.587506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.587521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:57.587542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739486918:2446], now have 1 active actors on pipe
2025-10-01T14:07:57.587550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254837362625002:4609]
2025-10-01T14:07:57.587552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254837362625002:4609]
2025-10-01T14:07:57.587557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254837362625002:4609]
2025-10-01T14:07:57.587576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:57.587587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739486936:5085], now have 1 active actors on pipe
2025-10-01T14:07:57.587591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739486982:5082], now have 1 active actors on pipe
2025-10-01T14:07:57.587599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:57.587601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:57.587604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:57.587606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:57.587616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:57.587619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:57.587669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254837362625002:4609]
2025-10-01T14:07:57.587677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:57.587769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:57.588138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.588145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.588163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.588166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.588178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_5_10090980969717386432_v1 on pipe: [1:7556254839739486936:5085]
2025-10-01T14:07:57.588207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:57.588216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.588221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.588223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:57.588234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.588248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:57.588262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.588267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.588270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:57.588291Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_5_10090980969717386432_v1
2025-10-01T14:07:57.588295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.588328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:57.588341Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:07:57.588478Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_5_10090980969717386432_v1:1 with generation 401
2025-10-01T14:07:57.588971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 402 partition: 0 MaxSeqNo: 45 sessionId: src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0
2025-10-01T14:07:57.589404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f8370a-65863506-b02ed3b8-b7e8a4c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:57.592176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0] Write session: try to update token
2025-10-01T14:07:57.592193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:57.588776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.588791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.588824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:57.596745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:07:57.596783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:07:57.596794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.596798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.596812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.596824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:07:57.596838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:07:57.598924Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327677587 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:07:57.598954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:07:57.599008Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 sending to client partition status
2025-10-01T14:07:57.605803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 402 sessionId: src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:57.608351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.608382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.608420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:57.608079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:57.608539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:57.613353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:57.613383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:57.613387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:57.613390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:57.613402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254837362625002:4609]
2025-10-01T14:07:57.613408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254837362625002:4609]
2025-10-01T14:07:57.613414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254837362625002:4609]
2025-10-01T14:07:57.613478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:57.613488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.613491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:57.613671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:57.615467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:57.615487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:57.615492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:57.766285Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:57.774863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.774892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.775072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.775132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.775193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.775253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.775295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.775300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.775371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.775435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.775494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.775554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.775599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.775602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.775683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.775735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.775799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.775861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.775912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.775915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.775972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.776404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.776459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.776516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.776556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.776558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.776620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.776673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.776727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.776778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.776828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.776830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.776895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.776945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.776999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.777055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.777095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.777097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.777159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.777234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.777294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.777353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.777405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.777408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.777471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.777521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.777574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.777635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.777677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.777679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.777753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.777815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.777876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.777949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.778029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.778031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.778096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:57.778165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:57.778234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:57.778290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:57.778336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:57.778339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:57.779069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_5_10090980969717386432_v1
2025-10-01T14:07:57.779087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:57.779121Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_5_10090980969717386432_v1
2025-10-01T14:07:57.782855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:57.782870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0] Write session will restart in 0.006133s
2025-10-01T14:07:57.782897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0] Write session: Do CDS request
2025-10-01T14:07:57.782903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:57.782385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254839739486936:5085]
2025-10-01T14:07:57.782415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:57.782456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:57.782512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 402 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0
2025-10-01T14:07:57.782722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 402 sessionId: src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0 is DEAD
2025-10-01T14:07:57.794158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:57.794272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:57.794286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 403
2025-10-01T14:07:57.794429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:57.794455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:57.794462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:57.794466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:57.794851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 403 sessionId:  describe result for acl check
2025-10-01T14:07:57.794882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:57.794884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:57.794885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:57.794890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254839739487224:5089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:57.795658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254839739487224:5089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:57.798686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254839739487224:5089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:57.808522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254839739487224:5089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:57.808537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254839739487224:5089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:57.808549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254839739487224:5089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:57.808559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:57.808843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:57.812082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:57.812303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:57.812313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:57.812323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:57.812362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:57.812394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254837362625241:4612]
2025-10-01T14:07:57.812832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:57.813195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:57.813255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:57.813560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:57.813633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.813634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.813635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.813636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.813637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.813638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.813640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.813641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.813642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.813643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.813644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.813646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.813647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.813647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.813653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.813662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.813665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.813669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.813672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.813675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.813679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.813683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.813686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.813690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.813693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.813697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.813700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.813703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.813712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.813719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:57.813727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.813732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:57.813736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.813740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:57.813745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.813749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:57.813754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.813759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:57.813765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.813769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:57.813773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.813777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:57.813781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.813785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:57.813788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.813793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:57.813796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.813800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.813804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.813809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.813813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.813817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.813821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.813826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:57.813830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.813835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:57.813872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:57.820680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:57.822231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 402
2025-10-01T14:07:57.822274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 402
2025-10-01T14:07:57.823525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dd0e76-e3c94df4-f2799140-4036b23c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:57.826911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0] Write session: try to update token
2025-10-01T14:07:57.826937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:57.821445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:57.821466Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:57.821470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:57.821475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:57.821484Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 402 [2:7556254837362625241:4612]
2025-10-01T14:07:57.821502Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:57.821522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:57.821526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.821530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.821533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.821551Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:57.821558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:57.821565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:57.821633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.821636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.821638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.821643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:57.821645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:57.821721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:57.821725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.821739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:57.821753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:57.821770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:57.821788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254837362625234:4612]
2025-10-01T14:07:57.821791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254837362625234:4612]
2025-10-01T14:07:57.821797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254837362625234:4612]
2025-10-01T14:07:57.821817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:57.821831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:57.821847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:57.821850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:57.821871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:57.821876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:57.821879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:57.821890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254837362625234:4612]
2025-10-01T14:07:57.821894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:57.821972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:57.822595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739487387:5089], now have 1 active actors on pipe
2025-10-01T14:07:57.822599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739487164:2446], now have 1 active actors on pipe
2025-10-01T14:07:57.822612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.822618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.822651Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:57.822659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:57.822664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:57.822667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:57.822679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:57.822690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:57.822707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:57.822964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.822967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.822981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:57.823105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 403 partition: 0 MaxSeqNo: 45 sessionId: src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0
2025-10-01T14:07:57.842175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:57.842200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:57.842210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254837362625234:4612]
2025-10-01T14:07:57.842258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:57.842480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:57.842658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:57.842835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:57.843006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:57.843259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:57.843298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:57.843713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:57.853510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 403 sessionId: src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:57.856753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:57.857521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:57.857549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:57.857588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:57.857738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:57.869668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:57.869704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:57.869706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:57.869709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:57.869721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254837362625234:4612]
2025-10-01T14:07:57.869727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254837362625234:4612]
2025-10-01T14:07:57.869732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254837362625234:4612]
2025-10-01T14:07:57.869792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:57.869799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:57.869805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:57.869807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:57.869809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:57.869810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:57.869982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:57.883207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254839739487400:5085]
2025-10-01T14:07:57.883528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 402, pipe: [1:7556254839739487400:5085]
2025-10-01T14:07:58.016033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:58.016396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254839739487400:5085], now have 1 active actors on pipe
2025-10-01T14:07:58.027458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.027502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.027740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.027831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.027934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.028031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.028094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.028113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.028231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.028321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.028404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.028489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.028554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.028563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.028656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.028732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.028833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.028907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.028961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.028966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.029075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.029182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.029315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.029473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.029540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.029546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.029664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.029761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.029844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.029927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.029993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.029997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.030096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.030214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.030539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.030662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.030733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.030738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.030846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.030963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.031125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.031216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.031284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.031288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.031393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.031509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.031692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.031789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.031856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.031860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.031967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.032054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.032202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.032326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.032382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.032385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.032515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:58.032672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:58.032825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:58.032899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:58.032953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:58.032956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:58.035027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:58.035044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:58.035078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 403 reason: error at write: Disconnected sessionId: src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0
2025-10-01T14:07:58.035276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:58.035333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254839739487400:5085]
2025-10-01T14:07:58.035343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:58.035352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0] Write session will restart in 0.005957s
2025-10-01T14:07:58.035376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0] Write session: Do CDS request
2025-10-01T14:07:58.035383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:58.035384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 403 sessionId: src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0 is DEAD
2025-10-01T14:07:58.037070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:58.044082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.044170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:58.044194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 404
2025-10-01T14:07:58.044386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.044437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:58.044451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:58.044457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:58.044967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 404 sessionId:  describe result for acl check
2025-10-01T14:07:58.045004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:58.045006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:58.045009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:58.045014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254844034454732:5100] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:58.045571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254844034454732:5100] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:58.048884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254844034454732:5100] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:58.063521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254844034454732:5100] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:58.063542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254844034454732:5100] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:58.063546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254844034454732:5100] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:58.063559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:58.080144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:58.084015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:58.084220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:58.084230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:58.084240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:58.084297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:58.084342Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254841657592774:4616]
2025-10-01T14:07:58.084838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:58.085134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:58.085179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:58.085419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:58.085484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.085490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.085491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.085493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.085494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.085496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.085497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.085499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.085501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.085502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.085504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.085505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.085506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.085508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.085513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.085525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.085529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.085534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.085537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.085542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.085549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.085554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.085557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.085562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.085571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.085575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.085579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.085586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.085595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.085607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.085615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.085621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.085630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.085635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.085644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.085653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.085659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.085667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.085675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.085681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.085690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.085700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.085707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.085714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.085722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.085730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.085735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.085740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.085745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.085750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.085758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.085763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.085768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.085773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.085777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.085783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.085832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:58.091189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:58.092290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:58.092311Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:58.092313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:58.092317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:58.092325Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 403 [2:7556254841657592774:4616]
2025-10-01T14:07:58.092341Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:58.092359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:58.092362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.092365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.092367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.092382Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:58.092387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:58.092394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:58.092464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.092466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.092467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.092471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:58.092473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:58.092538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:58.092541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.092555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.092563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.092576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:58.092593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254841657592768:4616]
2025-10-01T14:07:58.092596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254841657592768:4616]
2025-10-01T14:07:58.092598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254841657592768:4616]
2025-10-01T14:07:58.092608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:58.092621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:58.092634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:58.092638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:58.092677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254841657592768:4616]
2025-10-01T14:07:58.092679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:58.092693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:58.092695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:58.092696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:58.092702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:58.093021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 403
2025-10-01T14:07:58.093064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 403
2025-10-01T14:07:58.092913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034454724:2446], now have 1 active actors on pipe
2025-10-01T14:07:58.092924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034454804:5100], now have 1 active actors on pipe
2025-10-01T14:07:58.093777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.093788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.093814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eef39c12-b10734c2-ef74a177-9d357790_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:58.093823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.093826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.093829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:58.093838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.093851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:58.093864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.098547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.098574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.098613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.098782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 404 partition: 0 MaxSeqNo: 45 sessionId: src_id|eef39c12-b10734c2-ef74a177-9d357790_0
2025-10-01T14:07:58.099180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|448d0ec4-23983e6f-5cfc687b-807e14ea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eef39c12-b10734c2-ef74a177-9d357790_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:58.102293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef39c12-b10734c2-ef74a177-9d357790_0] Write session: try to update token
2025-10-01T14:07:58.102316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef39c12-b10734c2-ef74a177-9d357790_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:58.115908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:58.115934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:58.115936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:58.115938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:58.115949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254841657592768:4616]
2025-10-01T14:07:58.115955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254841657592768:4616]
2025-10-01T14:07:58.115961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254841657592768:4616]
2025-10-01T14:07:58.116019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:58.116027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.116030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:58.116210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:58.116635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:58.116644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:58.116648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:58.126564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 404 sessionId: src_id|eef39c12-b10734c2-ef74a177-9d357790_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:58.129894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:58.135356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254844034454958:5085]
2025-10-01T14:07:58.136435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 403, pipe: [1:7556254844034454958:5085]
2025-10-01T14:07:58.258129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:58.258470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.258498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.258524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034454958:5085], now have 1 active actors on pipe
2025-10-01T14:07:58.259630Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:58.260234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef39c12-b10734c2-ef74a177-9d357790_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:58.260249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef39c12-b10734c2-ef74a177-9d357790_0] Write session will restart in 0.007925s
2025-10-01T14:07:58.260282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef39c12-b10734c2-ef74a177-9d357790_0] Write session: Do CDS request
2025-10-01T14:07:58.260288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef39c12-b10734c2-ef74a177-9d357790_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:58.259776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254844034454958:5085]
2025-10-01T14:07:58.259803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:58.259834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:58.259836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:58.259897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 404 reason: error at write: Disconnected sessionId: src_id|eef39c12-b10734c2-ef74a177-9d357790_0
2025-10-01T14:07:58.260055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 404 sessionId: src_id|eef39c12-b10734c2-ef74a177-9d357790_0 is DEAD
2025-10-01T14:07:58.270931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eef39c12-b10734c2-ef74a177-9d357790_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.271049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:58.271073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 405
2025-10-01T14:07:58.271207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.271237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:58.271243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:58.271247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:58.271798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 405 sessionId:  describe result for acl check
2025-10-01T14:07:58.271823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:58.271827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:58.271830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:58.271835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254844034455025:5106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:58.272385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254844034455025:5106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:58.278513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254844034455025:5106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:58.282826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254844034455025:5106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:58.282843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254844034455025:5106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:58.282847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254844034455025:5106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:58.282856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:58.284585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:58.288644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:58.288900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:58.288913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:58.288925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:58.288987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:58.289034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254841657593047:4629]
2025-10-01T14:07:58.289740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:58.290100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:58.290152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:58.290523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:58.290599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.290600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.290602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.290603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.290604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.290606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.290608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.290609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.290610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.290612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.290613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.290615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.290616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.290618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.290624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.290636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.290641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.290645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.290649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.290654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.290658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.290662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.290666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.290670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.290674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.290678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.290682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.290687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.290696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.290705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.290711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.290716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.290722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.290727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.290733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.290738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.290744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.290750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.290754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.290760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.290766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.290772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.290777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.290782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.290788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.290795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.290799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.290806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.290812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.290818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.290823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.290829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.290835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.290841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.290847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.290852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.290898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:58.295468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:58.296271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:58.296292Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:58.296298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:58.296303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:58.296312Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 404 [2:7556254841657593047:4629]
2025-10-01T14:07:58.296331Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:58.296820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 404
2025-10-01T14:07:58.296854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 404
2025-10-01T14:07:58.296352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:58.296356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.296359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.296361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.296376Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:58.296382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:58.296390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:58.296456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.296459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.296462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.296465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:58.296469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:58.296550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:58.296553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.296568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.296581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.296597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:58.296616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254841657593042:4629]
2025-10-01T14:07:58.296619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254841657593042:4629]
2025-10-01T14:07:58.296622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254841657593042:4629]
2025-10-01T14:07:58.296632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:58.296646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:58.296661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:58.296664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:58.296665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:58.296668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:58.296670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:58.296706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254841657593042:4629]
2025-10-01T14:07:58.296716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:58.296724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:58.296727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455203:5106], now have 1 active actors on pipe
2025-10-01T14:07:58.296732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034454984:2446], now have 1 active actors on pipe
2025-10-01T14:07:58.297086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.297103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.297136Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60a883e1-e5e78132-a445375f-7fc87f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:58.297148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.297157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.297160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:58.297169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.297185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:58.297207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.297509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.297521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.297554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.297677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 405 partition: 0 MaxSeqNo: 45 sessionId: src_id|60a883e1-e5e78132-a445375f-7fc87f4_0
2025-10-01T14:07:58.298031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eef39c12-b10734c2-ef74a177-9d357790_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|60a883e1-e5e78132-a445375f-7fc87f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:58.300970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a883e1-e5e78132-a445375f-7fc87f4_0] Write session: try to update token
2025-10-01T14:07:58.300988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a883e1-e5e78132-a445375f-7fc87f4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:58.322352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:58.322393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:58.322395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:58.322398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:58.322408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254841657593042:4629]
2025-10-01T14:07:58.322414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254841657593042:4629]
2025-10-01T14:07:58.322419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254841657593042:4629]
2025-10-01T14:07:58.322474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:58.322486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.322488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:58.320706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 405 sessionId: src_id|60a883e1-e5e78132-a445375f-7fc87f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:58.323700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:58.322647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:58.323906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:58.323913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:58.323917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:58.360089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254844034455218:5085]
2025-10-01T14:07:58.360813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 404, pipe: [1:7556254844034455218:5085]
2025-10-01T14:07:58.471730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a883e1-e5e78132-a445375f-7fc87f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:58.471746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a883e1-e5e78132-a445375f-7fc87f4_0] Write session will restart in 0.008308s
2025-10-01T14:07:58.471774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a883e1-e5e78132-a445375f-7fc87f4_0] Write session: Do CDS request
2025-10-01T14:07:58.471781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a883e1-e5e78132-a445375f-7fc87f4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:58.471059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:58.471107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:58.471109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:58.471179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 405 reason: error at write: Disconnected sessionId: src_id|60a883e1-e5e78132-a445375f-7fc87f4_0
2025-10-01T14:07:58.471333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 405 sessionId: src_id|60a883e1-e5e78132-a445375f-7fc87f4_0 is DEAD
2025-10-01T14:07:58.471483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254844034455218:5085]
2025-10-01T14:07:58.469105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:58.469840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.469852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.469901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455218:5085], now have 1 active actors on pipe
2025-10-01T14:07:58.471932Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:58.480912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a883e1-e5e78132-a445375f-7fc87f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.481442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:58.481470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 406
2025-10-01T14:07:58.481599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.481628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:58.481633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:58.481638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:58.485817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 406 sessionId:  describe result for acl check
2025-10-01T14:07:58.485865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:58.485870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:58.485872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:58.485878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254844034455238:5110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:58.486494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254844034455238:5110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:58.492100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254844034455238:5110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:58.498735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254844034455238:5110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:58.498760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254844034455238:5110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:58.498764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254844034455238:5110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:58.498775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:58.502275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:58.511881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:58.512181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:58.512195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:58.512208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:58.512284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:58.512341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254841657593279:4632]
2025-10-01T14:07:58.513017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:58.513403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:58.513455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:58.513788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:58.513870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.513872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.513873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.513874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.513876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.513877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.513878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.513880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.513882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.513883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.513884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.513886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.513887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.513888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.513895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.513905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.513908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.513912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.513915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.513918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.513923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.513926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.513929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.513933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.513937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.513940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.513944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.513947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.513956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.513964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.513969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.513974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.513979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.513985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.513988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.513993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.513998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.514003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.514007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.514012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.514017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.514022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.514027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.514031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.514036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.514041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.514045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.514050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.514055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.514060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.514064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.514069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.514074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.514079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.514085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.514090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.514130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:58.518485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:58.519173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:58.519193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:58.519196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:58.519201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:58.519209Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 405 [2:7556254841657593279:4632]
2025-10-01T14:07:58.519226Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:58.519247Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:58.519249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.519253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.519256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.519274Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:58.519280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:58.519287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:58.519359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.519362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.519365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.519369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:58.519371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:58.519445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:58.519448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.519459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.519466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.519475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:58.519488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254841657593273:4632]
2025-10-01T14:07:58.519490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254841657593273:4632]
2025-10-01T14:07:58.519492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254841657593273:4632]
2025-10-01T14:07:58.519498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:58.519509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:58.519519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:58.519521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:58.519530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:58.519534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:58.519537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:58.519555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254841657593273:4632]
2025-10-01T14:07:58.519557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:58.519563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:58.519567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455436:5110], now have 1 active actors on pipe
2025-10-01T14:07:58.519570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455221:2446], now have 1 active actors on pipe
2025-10-01T14:07:58.519788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 405
2025-10-01T14:07:58.519830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 405
2025-10-01T14:07:58.519933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.519948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.519981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:58.519992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.520001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.520008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:58.520023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.520039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:58.520059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.520298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.520306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.520325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.520491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 406 partition: 0 MaxSeqNo: 45 sessionId: src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0
2025-10-01T14:07:58.520892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a883e1-e5e78132-a445375f-7fc87f4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:58.523822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0] Write session: try to update token
2025-10-01T14:07:58.523843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:58.542012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 406 sessionId: src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:58.544578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:58.545314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.545349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.545384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:58.545387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:58.545389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:58.545391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:58.545400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254841657593273:4632]
2025-10-01T14:07:58.545406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254841657593273:4632]
2025-10-01T14:07:58.545417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254841657593273:4632]
2025-10-01T14:07:58.545467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:58.545483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:58.545487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:58.545488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:58.545496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.545499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:58.545666Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:58.571582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254844034455459:5085]
2025-10-01T14:07:58.571916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 405, pipe: [1:7556254844034455459:5085]
2025-10-01T14:07:58.699656Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:58.700126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:58.700186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455459:5085], now have 1 active actors on pipe
2025-10-01T14:07:58.700367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:58.700546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:58.700619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254844034455459:5085]
2025-10-01T14:07:58.711777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:58.711789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:58.711809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 406 reason: error at write: Disconnected sessionId: src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0
2025-10-01T14:07:58.711925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 406 sessionId: src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0 is DEAD
2025-10-01T14:07:58.712099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:58.712111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0] Write session will restart in 0.008026s
2025-10-01T14:07:58.712137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0] Write session: Do CDS request
2025-10-01T14:07:58.712148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:58.723152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.723651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:58.723669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 407
2025-10-01T14:07:58.723888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.723920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:58.723926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:58.723931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:58.724502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 407 sessionId:  describe result for acl check
2025-10-01T14:07:58.724544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:58.724545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:58.724547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:58.724552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254844034455483:5115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:58.725209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254844034455483:5115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:58.731527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254844034455483:5115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:58.736753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254844034455483:5115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:58.736773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254844034455483:5115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:58.736778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254844034455483:5115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:58.736787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:58.741728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:58.745554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:58.745799Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:58.745804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:58.745815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:58.745878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:58.745937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254841657593514:4635]
2025-10-01T14:07:58.746593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:58.747031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:58.747079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:58.747412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:58.747471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.747472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.747473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.747475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.747476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.747477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.747479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.747480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.747482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.747484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.747485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.747486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.747487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.747489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.747495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.747505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.747509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.747512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.747516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.747519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.747523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.747527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.747530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.747535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.747538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.747542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.747546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.747550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.747559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.747566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.747572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.747577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.747582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.747587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.747592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.747597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.747603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.747608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.747612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.747621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.747626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.747631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.747635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.747639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.747643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.747648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.747651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.747656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.747662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.747667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.747671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.747676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.747681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.747686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.747691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.747695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.747747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:58.753829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:58.754709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:58.754730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:58.754733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:58.754738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:58.754747Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 406 [2:7556254841657593514:4635]
2025-10-01T14:07:58.754765Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:58.754783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:58.754786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.754790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.754792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.754812Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:58.754818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:58.754825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:58.754891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.754894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.754896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.754899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:58.754902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:58.754984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:58.754988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.755001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.755013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.755029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:58.755046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254841657593509:4635]
2025-10-01T14:07:58.755049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254841657593509:4635]
2025-10-01T14:07:58.755051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254841657593509:4635]
2025-10-01T14:07:58.755059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:58.755071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:58.755074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:58.755077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:58.755079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455670:5115], now have 1 active actors on pipe
2025-10-01T14:07:58.755085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:58.755097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:58.755100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:58.755105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455464:2446], now have 1 active actors on pipe
2025-10-01T14:07:58.755142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254841657593509:4635]
2025-10-01T14:07:58.755151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:58.755157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:58.755342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 406
2025-10-01T14:07:58.755385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 406
2025-10-01T14:07:58.755488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.755504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.755533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:58.755546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.755551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.755558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:58.755568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.755582Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:58.755602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.755898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.755907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.755923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.756038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 407 partition: 0 MaxSeqNo: 45 sessionId: src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0
2025-10-01T14:07:58.756414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7dd39ad-f7d943b8-870bab28-9d9e605d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:58.759298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0] Write session: try to update token
2025-10-01T14:07:58.759315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:58.779010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:58.779032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:58.779036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:58.779038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:58.779049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254841657593509:4635]
2025-10-01T14:07:58.779055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254841657593509:4635]
2025-10-01T14:07:58.779060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254841657593509:4635]
2025-10-01T14:07:58.779121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:58.779128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.779131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:58.779130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:58.779137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:58.779142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:58.779302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:58.787278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 407 sessionId: src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:58.790356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:58.801154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254844034455704:5085]
2025-10-01T14:07:58.802846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 406, pipe: [1:7556254844034455704:5085]
2025-10-01T14:07:58.931707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:58.932621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.932634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.932675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455704:5085], now have 1 active actors on pipe
2025-10-01T14:07:58.932949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:58.933448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254844034455704:5085]
2025-10-01T14:07:58.933497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:58.933585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 407 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0
2025-10-01T14:07:58.933771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 407 sessionId: src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0 is DEAD
2025-10-01T14:07:58.933796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:58.933948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:07:58.933959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0] Write session will restart in 0.006462s
2025-10-01T14:07:58.933988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0] Write session: Do CDS request
2025-10-01T14:07:58.933994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:58.942243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.942667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:58.942684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 408
2025-10-01T14:07:58.942823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:58.942860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:58.942866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:58.942871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:58.943486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 408 sessionId:  describe result for acl check
2025-10-01T14:07:58.943524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:58.943528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:58.943530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:58.943536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254844034455715:5119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:58.944064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254844034455715:5119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:58.947818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254844034455715:5119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:58.954444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254844034455715:5119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:58.954466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254844034455715:5119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:58.954470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254844034455715:5119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:58.954480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:58.984972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:58.986944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:58.987183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:58.987196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:58.987209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:58.987281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:58.987344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254841657593748:4637]
2025-10-01T14:07:58.987995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:58.988391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:58.988441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:58.988784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:58.988883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.988891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.988892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.988893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.988894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.988895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.988896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.988897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.988899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.988900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.988901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.988903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.988904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.988905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.988911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.988920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.988924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.988928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.988931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.988935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.988938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.988942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.988946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.988953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.988956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.988960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.988965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.988968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.988976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.988984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:58.988991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.988996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:58.989000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.989005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:58.989009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.989015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:58.989020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.989026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:58.989030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.989035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:58.989039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.989045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:58.989049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.989055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:58.989059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.989064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:58.989069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.989075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.989079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.989084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.989088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.989092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.989096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.989101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:58.989105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.989110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:58.989162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:58.994548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:58.995387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:58.995407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:58.995409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:58.995413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:58.995420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 407 [2:7556254841657593748:4637]
2025-10-01T14:07:58.995437Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:58.995456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:58.995459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.995462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.995465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.995482Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:58.995495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:58.995502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:58.995559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.995568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.995570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.995574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:58.995577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:58.995648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:58.995656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:58.995670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:58.995682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:58.995699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:58.995717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254841657593743:4637]
2025-10-01T14:07:58.995720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254841657593743:4637]
2025-10-01T14:07:58.995722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254841657593743:4637]
2025-10-01T14:07:58.995753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:58.995773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:58.995787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:58.995790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:58.995832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254841657593743:4637]
2025-10-01T14:07:58.995841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:58.995991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:58.996003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:58.996007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:58.996013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:58.996794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455706:2446], now have 1 active actors on pipe
2025-10-01T14:07:58.996824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254844034455801:5119], now have 1 active actors on pipe
2025-10-01T14:07:58.996860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.996865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.996890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cd14126-ed4c900a-50319c6f-8730608e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:58.996898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:58.996903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:58.996906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:58.996915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:58.996927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:58.996943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.997129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:58.997137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:58.997151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:58.997679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5419a5-9d3754b1-cdc19f8f-3356f0ef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1cd14126-ed4c900a-50319c6f-8730608e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:58.996682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 407
2025-10-01T14:07:58.996732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 407
2025-10-01T14:07:58.997248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 408 partition: 0 MaxSeqNo: 45 sessionId: src_id|1cd14126-ed4c900a-50319c6f-8730608e_0
2025-10-01T14:07:59.000695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd14126-ed4c900a-50319c6f-8730608e_0] Write session: try to update token
2025-10-01T14:07:59.000715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd14126-ed4c900a-50319c6f-8730608e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:59.032828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254848329423266:5085]
2025-10-01T14:07:59.032870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 408 sessionId: src_id|1cd14126-ed4c900a-50319c6f-8730608e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:59.034670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 407, pipe: [1:7556254848329423266:5085]
2025-10-01T14:07:59.035631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:59.036740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329423266:5085], now have 1 active actors on pipe
2025-10-01T14:07:59.036778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.036786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.036820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:59.036824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:59.036827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:59.036829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:59.036837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254841657593743:4637]
2025-10-01T14:07:59.036842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254841657593743:4637]
2025-10-01T14:07:59.036846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254841657593743:4637]
2025-10-01T14:07:59.036918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:59.036931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.036933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:59.037085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:59.038456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:59.038472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:59.038476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:59.196724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:59.197129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:59.197291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:59.197454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254848329423266:5085]
2025-10-01T14:07:59.197503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:59.208727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:59.208739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:59.208762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 408 reason: error at write: Disconnected sessionId: src_id|1cd14126-ed4c900a-50319c6f-8730608e_0
2025-10-01T14:07:59.209054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd14126-ed4c900a-50319c6f-8730608e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:59.209074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd14126-ed4c900a-50319c6f-8730608e_0] Write session will restart in 0.006905s
2025-10-01T14:07:59.209100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd14126-ed4c900a-50319c6f-8730608e_0] Write session: Do CDS request
2025-10-01T14:07:59.208905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 408 sessionId: src_id|1cd14126-ed4c900a-50319c6f-8730608e_0 is DEAD
2025-10-01T14:07:59.209107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd14126-ed4c900a-50319c6f-8730608e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:59.216753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd14126-ed4c900a-50319c6f-8730608e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:59.216929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:59.216940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 409
2025-10-01T14:07:59.217128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:59.217160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:59.217165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:59.217173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:59.217715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 409 sessionId:  describe result for acl check
2025-10-01T14:07:59.217749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:59.217755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:59.217757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:59.217763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254848329423392:5132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:59.218288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254848329423392:5132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:59.220939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254848329423392:5132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:59.223599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:59.227200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254848329423392:5132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:59.227216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254848329423392:5132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:59.227219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254848329423392:5132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:59.227227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:59.229681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:59.229975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:59.229985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:59.229997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:59.230061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:59.230102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254845952561311:4642]
2025-10-01T14:07:59.230715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:59.231048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:59.231095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:59.231413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:59.231466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.231472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.231473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.231474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.231476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.231477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.231478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.231479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.231480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.231481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.231482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.231483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.231485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.231486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.231491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.231501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.231505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.231509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.231514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.231519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.231522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.231526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.231529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.231533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.231537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.231539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.231543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.231547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.231552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.231560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.231566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.231571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.231575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.231580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.231589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.231594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.231598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.231608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.231612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.231616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.231625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.231630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.231634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.231639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.231648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.231653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.231657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.231663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.231668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.231673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.231677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.231681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.231685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.231689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.231693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.231698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.231736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:59.235868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:59.236518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:59.236537Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:59.236539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:59.236542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:59.236549Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 408 [2:7556254845952561311:4642]
2025-10-01T14:07:59.236565Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:59.236580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:59.236583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.236587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.236589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.236605Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:59.236613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:59.236625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:59.236680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.236688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.236690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.236692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:59.236695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:59.236796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:59.236815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.236828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.236844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.236865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:59.236886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329423518:5132], now have 1 active actors on pipe
2025-10-01T14:07:59.236896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329423288:2446], now have 1 active actors on pipe
2025-10-01T14:07:59.236904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254845952561295:4642]
2025-10-01T14:07:59.236906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254845952561295:4642]
2025-10-01T14:07:59.236907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254845952561295:4642]
2025-10-01T14:07:59.236923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:59.236936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:59.236954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:59.236962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:59.236951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 408
2025-10-01T14:07:59.236964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 408
2025-10-01T14:07:59.236982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:59.236993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:59.236995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:59.236997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254845952561295:4642]
2025-10-01T14:07:59.236999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:59.237001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:59.237142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.237152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.237176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:59.237188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.237193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.237195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:59.237204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.237212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:59.237224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:59.237390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.237402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.237424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:59.237548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 409 partition: 0 MaxSeqNo: 45 sessionId: src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0
2025-10-01T14:07:59.237944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cd14126-ed4c900a-50319c6f-8730608e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:59.240672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0] Write session: try to update token
2025-10-01T14:07:59.240692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:59.257744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 409 sessionId: src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:59.260177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:59.260437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.260461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.260482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:59.260487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:59.260489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:59.260491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:59.260499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254845952561295:4642]
2025-10-01T14:07:59.260505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254845952561295:4642]
2025-10-01T14:07:59.260508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254845952561295:4642]
2025-10-01T14:07:59.260550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:59.260563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:59.260563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:59.260567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:59.260569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.260571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:59.260690Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:59.297554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254848329423533:5085]
2025-10-01T14:07:59.297765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 408, pipe: [1:7556254848329423533:5085]
2025-10-01T14:07:59.407139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:59.407440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:59.407492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329423533:5085], now have 1 active actors on pipe
2025-10-01T14:07:59.407600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:59.407619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:59.407659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254848329423533:5085]
2025-10-01T14:07:59.407690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:59.407698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:59.407771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 409 reason: error at write: Disconnected sessionId: src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0
2025-10-01T14:07:59.407931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 409 sessionId: src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0 is DEAD
2025-10-01T14:07:59.408069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:59.408075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0] Write session will restart in 0.005960s
2025-10-01T14:07:59.408093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0] Write session: Do CDS request
2025-10-01T14:07:59.408101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:59.414756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:59.414872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:59.414884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 410
2025-10-01T14:07:59.415010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:59.415035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:59.415041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:59.415044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:59.415724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 410 sessionId:  describe result for acl check
2025-10-01T14:07:59.415769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:59.415775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:59.415777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:59.415783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254848329423559:5136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:59.416273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254848329423559:5136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:59.419009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254848329423559:5136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:59.422895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254848329423559:5136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:59.422911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254848329423559:5136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:59.422914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254848329423559:5136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:59.422922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:59.424382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:59.427034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:59.427203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:59.427213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:59.427222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:59.427260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:59.427297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254845952561564:4655]
2025-10-01T14:07:59.427827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:59.428131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:59.428178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:59.428465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:59.428527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.428532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.428534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.428535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.428536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.428537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.428538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.428540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.428541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.428542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.428543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.428544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.428546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.428547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.428552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.428561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.428565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.428569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.428578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.428582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.428585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.428589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.428593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.428596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.428600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.428604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.428607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.428611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.428618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.428625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.428630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.428636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.428644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.428649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.428656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.428661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.428665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.428674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.428678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.428682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.428691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.428699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.428704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.428709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.428717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.428723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.428727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.428732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.428736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.428741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.428745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.428754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.428758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.428766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.428774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.428778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.428829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:59.432751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:59.433564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:59.433577Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:59.433579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:59.433583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:59.433590Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 409 [2:7556254845952561564:4655]
2025-10-01T14:07:59.433606Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:59.433623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:59.433630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.433633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.433635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.433652Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:59.433662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:59.433672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:59.433729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.433738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.433740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.433743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:59.433745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:59.433803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:59.433812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.433823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.433833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.433846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:59.433867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329423763:5136], now have 1 active actors on pipe
2025-10-01T14:07:59.433879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254845952561559:4655]
2025-10-01T14:07:59.433885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254845952561559:4655]
2025-10-01T14:07:59.433887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254845952561559:4655]
2025-10-01T14:07:59.433898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:59.433909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329423535:2446], now have 1 active actors on pipe
2025-10-01T14:07:59.433911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:59.433915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:59.433917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:59.433922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:59.433933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:59.433936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:59.433964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254845952561559:4655]
2025-10-01T14:07:59.433975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:59.433984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:59.433968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 409
2025-10-01T14:07:59.434060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 409
2025-10-01T14:07:59.434103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.434112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.434134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38c012cd-67c97556-2a1f0784-4c914a36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:59.434144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.434152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.434155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:59.434164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.434172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:59.434190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:59.434334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.434344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.434360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:59.439418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 410 partition: 0 MaxSeqNo: 45 sessionId: src_id|38c012cd-67c97556-2a1f0784-4c914a36_0
2025-10-01T14:07:59.439781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf011a13-4fc7a7b3-f17b3101-db4e1172_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|38c012cd-67c97556-2a1f0784-4c914a36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:59.442312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c012cd-67c97556-2a1f0784-4c914a36_0] Write session: try to update token
2025-10-01T14:07:59.442331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c012cd-67c97556-2a1f0784-4c914a36_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:59.450368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:59.450412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:59.450424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254845952561559:4655]
2025-10-01T14:07:59.450471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:59.450472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:59.450655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:59.450796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:59.450935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:59.451075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:59.451283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:59.451330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:59.459085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 410 sessionId: src_id|38c012cd-67c97556-2a1f0784-4c914a36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:59.461755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:59.461970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.461999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.462038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:07:59.462136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:07:59.468549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:59.468575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:59.468578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:59.468580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:59.468590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254845952561559:4655]
2025-10-01T14:07:59.468595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254845952561559:4655]
2025-10-01T14:07:59.468599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254845952561559:4655]
2025-10-01T14:07:59.468651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:59.468662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.468664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:59.468665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:59.468672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:59.468676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:59.468815Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:59.508008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254848329423778:5085]
2025-10-01T14:07:59.508301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 409, pipe: [1:7556254848329423778:5085]
2025-10-01T14:07:59.559875Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:07:59.616145Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:59.623596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.623627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.623779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.623833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.623895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.623956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.624000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.624011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.624078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.624132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.624184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.624236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.624279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.624285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.624344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.624409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.624466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.624533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.624580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.624585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.624646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.624707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.624771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.624842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.624896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.624904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.624967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.625028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.625088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.625144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.625187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.625192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.625251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.625305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.625362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.625427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.625467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.625472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.625536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.625590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.625646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.625703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.625742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.625749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.625811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.625871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.625934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.625993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.626038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.626045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.626106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.626160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.626219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.626277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.626317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.626322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.626403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:07:59.626460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:07:59.626521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:07:59.626593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:07:59.626637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:07:59.626642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:07:59.626704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329423778:5085], now have 1 active actors on pipe
2025-10-01T14:07:59.626979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:59.626994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:59.626999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254848329423778:5085]
2025-10-01T14:07:59.627024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 410 reason: error at write: Disconnected sessionId: src_id|38c012cd-67c97556-2a1f0784-4c914a36_0
2025-10-01T14:07:59.627031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:59.627245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 410 sessionId: src_id|38c012cd-67c97556-2a1f0784-4c914a36_0 is DEAD
2025-10-01T14:07:59.627417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c012cd-67c97556-2a1f0784-4c914a36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:59.627427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c012cd-67c97556-2a1f0784-4c914a36_0] Write session will restart in 0.009447s
2025-10-01T14:07:59.627453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c012cd-67c97556-2a1f0784-4c914a36_0] Write session: Do CDS request
2025-10-01T14:07:59.627459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c012cd-67c97556-2a1f0784-4c914a36_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:59.627920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:59.637891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38c012cd-67c97556-2a1f0784-4c914a36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:59.638026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:59.638042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 411
2025-10-01T14:07:59.638197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:59.638237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:59.638246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:59.638249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:59.638740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 411 sessionId:  describe result for acl check
2025-10-01T14:07:59.638778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:59.638783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:59.638785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:59.638790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254848329423887:5141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:59.639294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254848329423887:5141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:59.642116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254848329423887:5141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:59.644013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:59.646822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:59.647079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:59.647089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:59.647101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:59.647150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:59.647190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254845952561800:4657]
2025-10-01T14:07:59.647039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254848329423887:5141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:59.647055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254848329423887:5141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:59.647059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254848329423887:5141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:59.647068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:59.647735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:59.648049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:59.648097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:59.648395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:59.648466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.648475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.648476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.648477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.648478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.648479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.648480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.648481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.648482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.648484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.648485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.648486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.648486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.648487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.648493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.648501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.648504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.648507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.648511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.648514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.648517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.648520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.648523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.648526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.648529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.648532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.648535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.648538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.648546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.648553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.648561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.648566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.648570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.648574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.648578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.648581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.648586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.648590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.648593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.648598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.648603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.648608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.648611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.648616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.648619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.648624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.648628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.648634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.648640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.648644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.648648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.648652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.648655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.648659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.648663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.648667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.648701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:59.652845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:59.653487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:59.653504Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:59.653508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:59.653512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:59.653519Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 410 [2:7556254845952561800:4657]
2025-10-01T14:07:59.653537Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:59.653559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:59.653562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.653565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.653568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.653583Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:59.653592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:59.653600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:59.653654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.653660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.653662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.653665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:59.653668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:59.653735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:59.653743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.653755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.653769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.653788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:59.653810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329424015:5141], now have 1 active actors on pipe
2025-10-01T14:07:59.653820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329423782:2446], now have 1 active actors on pipe
2025-10-01T14:07:59.653827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254845952561794:4657]
2025-10-01T14:07:59.653829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254845952561794:4657]
2025-10-01T14:07:59.653831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254845952561794:4657]
2025-10-01T14:07:59.653844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:59.653862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:59.653867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:59.653872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:59.653875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:59.653878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:59.653882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:59.653924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254845952561794:4657]
2025-10-01T14:07:59.653931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:59.653886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 410
2025-10-01T14:07:59.653933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:59.653907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 410
2025-10-01T14:07:59.653948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.653953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.654000Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:59.654012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.654017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.654020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:59.654029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.654042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:59.654065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:59.654213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.654222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.654238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:59.654319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 411 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0
2025-10-01T14:07:59.654763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38c012cd-67c97556-2a1f0784-4c914a36_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:59.657545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0] Write session: try to update token
2025-10-01T14:07:59.657568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:59.676566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:59.676589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:59.676592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:59.676593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:59.676603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254845952561794:4657]
2025-10-01T14:07:59.676607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254845952561794:4657]
2025-10-01T14:07:59.676610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254845952561794:4657]
2025-10-01T14:07:59.676657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:59.676664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.676666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:59.676814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:59.678444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:59.678452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:59.678455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:59.684808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 411 sessionId: src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:59.687425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:59.727148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254848329424026:5085]
2025-10-01T14:07:59.727368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 410, pipe: [1:7556254848329424026:5085]
2025-10-01T14:07:59.823527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:07:59.824033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.824048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.824068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329424026:5085], now have 1 active actors on pipe
2025-10-01T14:07:59.826541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:07:59.826558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:07:59.826570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:07:59.826579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:07:59.826633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 411 reason: error at write: Disconnected sessionId: src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0
2025-10-01T14:07:59.826641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254848329424026:5085]
2025-10-01T14:07:59.826795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 411 sessionId: src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0 is DEAD
2025-10-01T14:07:59.827011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:07:59.827038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0] Write session will restart in 0.005391s
2025-10-01T14:07:59.827066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0] Write session: Do CDS request
2025-10-01T14:07:59.827072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:07:59.833897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:59.833991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:07:59.834003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 412
2025-10-01T14:07:59.834150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:07:59.834182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:07:59.834191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:07:59.834196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:07:59.834671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 412 sessionId:  describe result for acl check
2025-10-01T14:07:59.834702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:07:59.834708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:07:59.834710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:07:59.834715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254848329424075:5145] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:07:59.835219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254848329424075:5145] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:07:59.837422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254848329424075:5145] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:07:59.840252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254848329424075:5145] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:07:59.840267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254848329424075:5145] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:07:59.840271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254848329424075:5145] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:07:59.840278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:07:59.841468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:07:59.844134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:07:59.844352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:07:59.844362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:07:59.844373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:07:59.844419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:07:59.844458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254845952562041:4660]
2025-10-01T14:07:59.845222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:07:59.845507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:07:59.845547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:07:59.845844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:07:59.845897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.845903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.845904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.845905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.845906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.845907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.845908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.845909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.845911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.845912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.845913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.845914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.845915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.845916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.845921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.845930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.845934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.845938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.845941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.845945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.845949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.845951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.845955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.845959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.845962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.845965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.845969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.845972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.845978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.845985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:07:59.845991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.845996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:07:59.846000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.846005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:07:59.846009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.846014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:07:59.846018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.846023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:07:59.846027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.846033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:07:59.846042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.846047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:07:59.846051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.846058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:07:59.846062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.846067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:07:59.846071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.846075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.846088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.846094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.846099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.846103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.846107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.846110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:07:59.846114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.846120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:07:59.846160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:07:59.850234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:07:59.850877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:07:59.850890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:07:59.850893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:07:59.850897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:07:59.850904Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 411 [2:7556254845952562041:4660]
2025-10-01T14:07:59.850919Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:07:59.850937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:07:59.850944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.850947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.850950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.850968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:07:59.850977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:07:59.850984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:07:59.851038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.851044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.851046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.851049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:07:59.851052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:07:59.851119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:07:59.851131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.851144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:07:59.851154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:07:59.851169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:07:59.851191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329424259:5145], now have 1 active actors on pipe
2025-10-01T14:07:59.851199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329424029:2446], now have 1 active actors on pipe
2025-10-01T14:07:59.851207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254845952562035:4660]
2025-10-01T14:07:59.851214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254845952562035:4660]
2025-10-01T14:07:59.851216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254845952562035:4660]
2025-10-01T14:07:59.851228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:07:59.851238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:07:59.851241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:07:59.851243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:07:59.851245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:07:59.851260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:07:59.851267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:07:59.851301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254845952562035:4660]
2025-10-01T14:07:59.851311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:07:59.851318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:07:59.851611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 411
2025-10-01T14:07:59.851614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 411
2025-10-01T14:07:59.851937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.851949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.851976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:07:59.851989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:07:59.851997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:07:59.851999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:07:59.852009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:07:59.852019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:07:59.852035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:59.852183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:07:59.852190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:07:59.852203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:07:59.852376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 412 partition: 0 MaxSeqNo: 45 sessionId: src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0
2025-10-01T14:07:59.852861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b5a55da-25e6f22d-8901c816-70e550d9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:07:59.856089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0] Write session: try to update token
2025-10-01T14:07:59.856108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:07:59.864249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:07:59.864267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:59.864276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254845952562035:4660]
2025-10-01T14:07:59.864322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:07:59.864320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:07:59.864499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:07:59.864643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:59.864774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:59.864928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:07:59.865114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:07:59.865156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:07:59.892230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:07:59.892253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:07:59.892256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:07:59.892258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:07:59.892269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254845952562035:4660]
2025-10-01T14:07:59.892273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254845952562035:4660]
2025-10-01T14:07:59.892277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254845952562035:4660]
2025-10-01T14:07:59.892331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:07:59.892331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:07:59.892337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:07:59.892341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:07:59.892344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:07:59.892346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:07:59.892489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:07:59.895619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 412 sessionId: src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:07:59.898086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:07:59.927494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254848329424272:5085]
2025-10-01T14:07:59.927861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 411, pipe: [1:7556254848329424272:5085]
2025-10-01T14:08:00.058689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:00.059052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.059061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.059083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254848329424272:5085], now have 1 active actors on pipe
2025-10-01T14:08:00.059297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:00.060119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:00.060169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:00.060187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 412 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0
2025-10-01T14:08:00.060212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254848329424272:5085]
2025-10-01T14:08:00.060387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 412 sessionId: src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0 is DEAD
2025-10-01T14:08:00.062481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:00.062498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0] Write session will restart in 0.005202s
2025-10-01T14:08:00.062529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0] Write session: Do CDS request
2025-10-01T14:08:00.062536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:00.070825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.074553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:00.074576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 413
2025-10-01T14:08:00.074758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.074794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:00.074805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:00.074809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:00.076224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 413 sessionId:  describe result for acl check
2025-10-01T14:08:00.076264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:00.076266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:00.076268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:00.076273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254852624391605:5156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:00.076748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254852624391605:5156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:00.096321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254852624391605:5156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:00.106974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254852624391605:5156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:00.106993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254852624391605:5156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:00.106997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254852624391605:5156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:00.107007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:00.116561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:00.120127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:00.120336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:00.120346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:00.120356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:00.120394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:00.120437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254850247529595:4664]
2025-10-01T14:08:00.120881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:00.121461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:00.121522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:00.121848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:00.121938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.121947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.121948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.121949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.121951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.121952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.121953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.121955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.121956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.121957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.121959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.121961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.121963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.121964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.121971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.121981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.121986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.121990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.121994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.122013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.122017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.122020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.122024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.122029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.122033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.122037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.122041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.122045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.122055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.122063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.122070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.122077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.122083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.122089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.122095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.122101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.122107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.122113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.122118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.122123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.122128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.122133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.122138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.122143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.122147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.122153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.122164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.122169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.122182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.122187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.122192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.122198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.122210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.122215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.122221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.122233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.122278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:00.127373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:00.128042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:00.128063Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:00.128066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:00.128071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:00.128079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 412 [2:7556254850247529595:4664]
2025-10-01T14:08:00.128100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:00.128121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:00.128132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.128136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.128140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.128159Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:00.128172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:00.128183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:00.128248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.128258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.128260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.128264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:00.128267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:00.128339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:00.128348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.128363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.128373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.128563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 412
2025-10-01T14:08:00.128598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 412
2025-10-01T14:08:00.128393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:00.128417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624391770:5156], now have 1 active actors on pipe
2025-10-01T14:08:00.128421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624391584:2446], now have 1 active actors on pipe
2025-10-01T14:08:00.128427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254850247529590:4664]
2025-10-01T14:08:00.128430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254850247529590:4664]
2025-10-01T14:08:00.128432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254850247529590:4664]
2025-10-01T14:08:00.128444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:00.128458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:00.128459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:00.128463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:00.128466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:00.128472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:00.128476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:00.128513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254850247529590:4664]
2025-10-01T14:08:00.128520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:00.128562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:00.128790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.128796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.128835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b700b22-83792526-eb56124b-13480514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:00.128845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.128849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.128852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:00.128862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.128872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:00.128888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:00.129790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.129813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.129832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:00.129969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 413 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b700b22-83792526-eb56124b-13480514_0
2025-10-01T14:08:00.130342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad7bfa-45e802c3-1439d13e-a99b77cc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b700b22-83792526-eb56124b-13480514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:00.133419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b700b22-83792526-eb56124b-13480514_0] Write session: try to update token
2025-10-01T14:08:00.133439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b700b22-83792526-eb56124b-13480514_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:00.140576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:00.140595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:00.140604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254850247529590:4664]
2025-10-01T14:08:00.140650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:00.140653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:00.140852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:00.141009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:00.141158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:00.141302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:00.141501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:00.141544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:00.160999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624391839:5085], now have 1 active actors on pipe
2025-10-01T14:08:00.159926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 413 sessionId: src_id|6b700b22-83792526-eb56124b-13480514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:00.160474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254852624391839:5085]
2025-10-01T14:08:00.160739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 412, pipe: [1:7556254852624391839:5085]
2025-10-01T14:08:00.162844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:00.163309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.163332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.163374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:00.165562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:00.166359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:00.166563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:00.166566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:00.166568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:00.166579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254850247529590:4664]
2025-10-01T14:08:00.166584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254850247529590:4664]
2025-10-01T14:08:00.166589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254850247529590:4664]
2025-10-01T14:08:00.166644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:00.166653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.166655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:00.166794Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:00.170490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:00.170513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:00.170518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:00.332631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:00.341348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.341378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.341557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.341615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.341681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.341744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.341786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.341791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.341863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.341920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.341973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.342025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.342069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.342072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.342151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.342212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.342280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.342342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.342405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.342415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.342488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.342549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.342612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.342686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.342734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.342737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.342810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.342870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.342936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.343002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.343041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.343043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.343109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.343166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.343231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.343293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.343348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.343358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.343421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.343478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.343550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.343625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.343686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.343693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.343762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.343827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.343891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.343954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.344000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.344007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.344078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.344148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.344222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.344294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.344344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.344346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.344420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.344489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.344557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.344624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.344675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.344682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.347594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:00.347610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:00.347645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 413 reason: error at write: Disconnected sessionId: src_id|6b700b22-83792526-eb56124b-13480514_0
2025-10-01T14:08:00.348328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b700b22-83792526-eb56124b-13480514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:00.348339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b700b22-83792526-eb56124b-13480514_0] Write session will restart in 0.009446s
2025-10-01T14:08:00.348366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b700b22-83792526-eb56124b-13480514_0] Write session: Do CDS request
2025-10-01T14:08:00.348372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b700b22-83792526-eb56124b-13480514_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:00.347857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 413 sessionId: src_id|6b700b22-83792526-eb56124b-13480514_0 is DEAD
2025-10-01T14:08:00.348059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254852624391839:5085]
2025-10-01T14:08:00.348083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:00.349640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:00.359225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b700b22-83792526-eb56124b-13480514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.359651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:00.359666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 414
2025-10-01T14:08:00.359773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.359806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:00.359819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:00.359824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:00.360424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 414 sessionId:  describe result for acl check
2025-10-01T14:08:00.360460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:00.360463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:00.360465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:00.360471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254852624391914:5162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:00.360993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254852624391914:5162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:00.364318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254852624391914:5162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:00.369869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254852624391914:5162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:00.369888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254852624391914:5162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:00.369892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254852624391914:5162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:00.369902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:00.378266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:00.378848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:00.379058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:00.379070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:00.379082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:00.379138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:00.379180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254850247529866:4678]
2025-10-01T14:08:00.379760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:00.380169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:00.380209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:00.380425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:00.380461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.380466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.380467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.380467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.380468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.380469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.380470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.380471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.380471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.380472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.380473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.380473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.380474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.380475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.380479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.380485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.380488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.380490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.380492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.380495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.380497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.380499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.380501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.380503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.380506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.380509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.380513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.380516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.380522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.380529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.380535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.380540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.380545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.380550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.380554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.380558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.380563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.380567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.380572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.380576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.380580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.380585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.380588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.380592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.380596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.380601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.380605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.380610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.380615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.380621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.380624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.380629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.380639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.380644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.380651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.380656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.380689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:00.386523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:00.387471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:00.387491Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:00.387493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:00.387497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:00.387504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 413 [2:7556254850247529866:4678]
2025-10-01T14:08:00.387519Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:00.387538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:00.387547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.387551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.387553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.387572Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:00.387577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:00.387583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:00.387646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.387648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.387650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.387653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:00.387656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:00.387731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:00.387734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.387747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.387757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.387771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:00.387788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254850247529861:4678]
2025-10-01T14:08:00.387791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254850247529861:4678]
2025-10-01T14:08:00.387793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254850247529861:4678]
2025-10-01T14:08:00.387806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:00.387823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:00.387838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:00.387841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:00.387880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254850247529861:4678]
2025-10-01T14:08:00.387883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:00.387963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:00.387965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:00.387967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:00.387971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:00.388338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 413
2025-10-01T14:08:00.388389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 413
2025-10-01T14:08:00.389761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624391867:2446], now have 1 active actors on pipe
2025-10-01T14:08:00.389773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624392084:5162], now have 1 active actors on pipe
2025-10-01T14:08:00.389797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.389803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.389842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78f57077-28512d1a-2cc66046-ad64723b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:00.389852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.389857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.389860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:00.389872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.389887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:00.389905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:00.392713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.392725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.392757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:00.396416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 414 partition: 0 MaxSeqNo: 45 sessionId: src_id|78f57077-28512d1a-2cc66046-ad64723b_0
2025-10-01T14:08:00.397941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b700b22-83792526-eb56124b-13480514_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|78f57077-28512d1a-2cc66046-ad64723b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:00.401071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78f57077-28512d1a-2cc66046-ad64723b_0] Write session: try to update token
2025-10-01T14:08:00.401093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78f57077-28512d1a-2cc66046-ad64723b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:00.412326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:00.412346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:00.412349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:00.412350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:00.412360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254850247529861:4678]
2025-10-01T14:08:00.412365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254850247529861:4678]
2025-10-01T14:08:00.412372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254850247529861:4678]
2025-10-01T14:08:00.412424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:00.412431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.412434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:00.412588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:00.413107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:00.413113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:00.413118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:00.421113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 414 sessionId: src_id|78f57077-28512d1a-2cc66046-ad64723b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:00.423785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:00.450575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254852624392117:5085]
2025-10-01T14:08:00.451050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 413, pipe: [1:7556254852624392117:5085]
2025-10-01T14:08:00.570222Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:00.570781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.570801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.570823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624392117:5085], now have 1 active actors on pipe
2025-10-01T14:08:00.571045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:00.571065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254852624392117:5085]
2025-10-01T14:08:00.571091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:00.571093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:00.571101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:00.571480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f57077-28512d1a-2cc66046-ad64723b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:00.571491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f57077-28512d1a-2cc66046-ad64723b_0] Write session will restart in 0.006805s
2025-10-01T14:08:00.571529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f57077-28512d1a-2cc66046-ad64723b_0] Write session: Do CDS request
2025-10-01T14:08:00.571146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 414 reason: error at write: Disconnected sessionId: src_id|78f57077-28512d1a-2cc66046-ad64723b_0
2025-10-01T14:08:00.571337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 414 sessionId: src_id|78f57077-28512d1a-2cc66046-ad64723b_0 is DEAD
2025-10-01T14:08:00.571536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f57077-28512d1a-2cc66046-ad64723b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:00.579924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78f57077-28512d1a-2cc66046-ad64723b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.579999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:00.580012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 415
2025-10-01T14:08:00.580176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.580221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:00.580237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:00.580241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:00.580660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 415 sessionId:  describe result for acl check
2025-10-01T14:08:00.580698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:00.580704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:00.580706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:00.580711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254852624392164:5166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:00.581259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254852624392164:5166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:00.588496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254852624392164:5166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:00.591739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:00.591822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254852624392164:5166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:00.591842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254852624392164:5166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:00.591845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254852624392164:5166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:00.591854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:00.594317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:00.594619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:00.594631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:00.594645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:00.594711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:00.594755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254850247530109:4680]
2025-10-01T14:08:00.595308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:00.595637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:00.595689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:00.596026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:00.596089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.596095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.596096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.596097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.596099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.596100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.596101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.596102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.596103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.596104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.596105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.596106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.596107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.596108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.596114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.596122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.596126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.596129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.596133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.596136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.596139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.596142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.596145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.596148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.596151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.596155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.596158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.596161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.596169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.596176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.596182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.596187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.596191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.596195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.596205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.596209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.596213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.596218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.596222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.596227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.596233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.596238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.596242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.596250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.596254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.596263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.596268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.596276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.596281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.596286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.596290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.596295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.596299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.596304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.596310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.596314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.596350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:00.600288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:00.600920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:00.600933Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:00.600936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:00.600939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:00.600947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 414 [2:7556254850247530109:4680]
2025-10-01T14:08:00.600963Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:00.600984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:00.600991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.600995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.600997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.601018Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:00.601040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:00.601058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:00.601142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.601149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.601151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.601154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:00.601157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:00.601228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:00.601236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.601248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.601268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.601284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:00.601319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624392120:2446], now have 1 active actors on pipe
2025-10-01T14:08:00.601334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624392359:5166], now have 1 active actors on pipe
2025-10-01T14:08:00.601342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254850247530103:4680]
2025-10-01T14:08:00.601348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254850247530103:4680]
2025-10-01T14:08:00.601350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254850247530103:4680]
2025-10-01T14:08:00.601365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:00.601389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:00.601394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:00.601398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:00.601400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:00.601411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:00.601419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:00.601384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 414
2025-10-01T14:08:00.601396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 414
2025-10-01T14:08:00.601466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254850247530103:4680]
2025-10-01T14:08:00.601477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:00.601488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:00.601492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.601497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.601543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:00.601555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.601564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.601566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:00.601576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.601592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:00.601612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:00.601737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.601744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.601757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:00.601825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 415 partition: 0 MaxSeqNo: 45 sessionId: src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0
2025-10-01T14:08:00.602189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78f57077-28512d1a-2cc66046-ad64723b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:00.604713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0] Write session: try to update token
2025-10-01T14:08:00.604734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:00.619730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 415 sessionId: src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:00.622011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:00.622028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:00.622031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:00.622033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:00.622042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254850247530103:4680]
2025-10-01T14:08:00.622048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254850247530103:4680]
2025-10-01T14:08:00.622051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254850247530103:4680]
2025-10-01T14:08:00.622094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:00.622100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:00.622107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.622110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:00.622110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:00.622114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:00.622246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:00.622310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:00.671264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254852624392375:5085]
2025-10-01T14:08:00.671554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 414, pipe: [1:7556254852624392375:5085]
2025-10-01T14:08:00.771356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:00.771958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.771973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.772018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624392375:5085], now have 1 active actors on pipe
2025-10-01T14:08:00.772224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:00.772188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:00.772225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:00.772229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:00.772256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254852624392375:5085]
2025-10-01T14:08:00.772287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 415 reason: error at write: Disconnected sessionId: src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0
2025-10-01T14:08:00.772482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 415 sessionId: src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0 is DEAD
2025-10-01T14:08:00.772638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:00.772656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0] Write session will restart in 0.009150s
2025-10-01T14:08:00.772691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0] Write session: Do CDS request
2025-10-01T14:08:00.772698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:00.782945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.783027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:00.783044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 416
2025-10-01T14:08:00.783151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.783182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:00.783192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:00.783195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:00.783627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 416 sessionId:  describe result for acl check
2025-10-01T14:08:00.783664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:00.783668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:00.783670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:00.783675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254852624392492:5171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:00.784082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254852624392492:5171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:00.786446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254852624392492:5171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:00.787717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:00.789986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:00.790176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:00.790187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:00.790197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:00.790240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:00.790277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254850247530353:4683]
2025-10-01T14:08:00.790343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254852624392492:5171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:00.790355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254852624392492:5171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:00.790357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254852624392492:5171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:00.790363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:00.790932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:00.791207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:00.791248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:00.791519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:00.791575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.791581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.791582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.791583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.791584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.791585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.791586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.791587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.791588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.791589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.791589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.791590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.791591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.791591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.791594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.791600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.791602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.791604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.791606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.791608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.791610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.791612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.791614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.791616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.791617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.791619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.791621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.791623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.791628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.791632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:00.791636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.791639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:00.791642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.791644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:00.791647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.791649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:00.791652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.791655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:00.791657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.791659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:00.791662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.791665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:00.791667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.791670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:00.791672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.791675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:00.791677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.791680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.791684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.791687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.791689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.791692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.791695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.791697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:00.791699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.791702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:00.791722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:00.795207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:00.795780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:00.795792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:00.795794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:00.795797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:00.795802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 415 [2:7556254850247530353:4683]
2025-10-01T14:08:00.795812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:00.795827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:00.795830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.795834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.795836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.795852Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:00.795858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:00.795866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:00.795903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.795908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.795909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.795912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:00.795914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:00.795966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:00.795973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.795984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:00.795994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:00.796013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:00.796032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624392614:5171], now have 1 active actors on pipe
2025-10-01T14:08:00.796034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624392377:2446], now have 1 active actors on pipe
2025-10-01T14:08:00.796040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254850247530348:4683]
2025-10-01T14:08:00.796042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254850247530348:4683]
2025-10-01T14:08:00.796043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254850247530348:4683]
2025-10-01T14:08:00.796055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:00.796070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:00.796075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:00.796078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:00.796080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:00.796083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:00.796086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:00.796109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254850247530348:4683]
2025-10-01T14:08:00.796119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:00.796124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:00.796354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 415
2025-10-01T14:08:00.796355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 415
2025-10-01T14:08:00.796463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.796473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.796499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:00.796510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:00.796518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:00.796524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:00.796532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:00.796544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:00.796564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:00.796705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.796711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.796723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:00.796791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 416 partition: 0 MaxSeqNo: 45 sessionId: src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0
2025-10-01T14:08:00.797192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4dac79-d69e8e01-1dc81351-522e54af_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:00.799633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0] Write session: try to update token
2025-10-01T14:08:00.799651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:00.814014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 416 sessionId: src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:00.816640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:00.819518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:00.819355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.819375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.819422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:00.822271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:00.822278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:00.822282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:00.822284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:00.822294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254850247530348:4683]
2025-10-01T14:08:00.822304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254850247530348:4683]
2025-10-01T14:08:00.822309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254850247530348:4683]
2025-10-01T14:08:00.822367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:00.822386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:00.822390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:00.822497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:00.822515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:00.822518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:00.822713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:00.874496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254852624392626:5085]
2025-10-01T14:08:00.875008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 415, pipe: [1:7556254852624392626:5085]
2025-10-01T14:08:00.975705Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:00.983072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:00.983099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:00.983268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.983335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.983407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.983469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.983521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.983530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.983598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.983665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.983737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.983800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.983855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.983862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.983929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.983986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.984037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.984093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.984142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.984149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.984209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.984266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.984322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.984381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.984425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.984432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.984496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.984563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.984630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.984692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.984739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.984746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.984824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.984885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.984945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.985006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.985050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.985058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.985114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.985175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.985241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.985306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.985347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.985355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.985418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.985477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.985543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.985606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.985652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.985659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.985727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.985790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.985852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.985916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.985960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.985967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.986034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:00.986099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:00.986160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:00.986225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:00.986273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:00.986280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:00.986349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624392626:5085], now have 1 active actors on pipe
2025-10-01T14:08:00.986614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:00.986626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:00.986653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 416 reason: error at write: Disconnected sessionId: src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0
2025-10-01T14:08:00.986883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 416 sessionId: src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0 is DEAD
2025-10-01T14:08:00.986911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254852624392626:5085]
2025-10-01T14:08:00.986935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:00.987068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:00.987082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0] Write session will restart in 0.008431s
2025-10-01T14:08:00.987112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0] Write session: Do CDS request
2025-10-01T14:08:00.987120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:00.987712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:00.996931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.997080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:00.997099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 417
2025-10-01T14:08:00.997240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:00.997282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:00.997292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:00.997296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:00.997765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 417 sessionId:  describe result for acl check
2025-10-01T14:08:00.997799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:00.997805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:00.997809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:00.997814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254852624392691:5175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:00.998329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254852624392691:5175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:01.001337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254852624392691:5175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:01.009676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254852624392691:5175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:01.009696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254852624392691:5175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:01.009700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254852624392691:5175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:01.009710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:01.010413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:01.015405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:01.015658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:01.015668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:01.015680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:01.015748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:01.015801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254854542497892:4685]
2025-10-01T14:08:01.016450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:01.016885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:01.016942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:01.017277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:01.017347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.017353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.017354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.017356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.017357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.017358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.017360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.017361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.017362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.017364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.017365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.017366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.017368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.017370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.017376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.017387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.017391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.017395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.017399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.017403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.017407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.017410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.017414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.017418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.017421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.017438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.017448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.017452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.017461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.017472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.017484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.017495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.017501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.017511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.017519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.017525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.017532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.017541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.017545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.017554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.017558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.017567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.017572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.017581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.017586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.017591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.017601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.017606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.017611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.017618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.017623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.017629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.017638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.017643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.017648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.017653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.017694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:01.023642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 416
2025-10-01T14:08:01.023654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 416
2025-10-01T14:08:01.021981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:01.023126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:01.023133Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:01.023136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:01.023141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:01.023149Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 416 [2:7556254854542497892:4685]
2025-10-01T14:08:01.023167Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:01.023185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:01.023189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.023192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.023195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.023211Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:01.023216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:01.023224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:01.023289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.023291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.023294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.023297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:01.023300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:01.023384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:01.023387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.023400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.023409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.023424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:01.023444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254852624392631:2446], now have 1 active actors on pipe
2025-10-01T14:08:01.023452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254854542497887:4685]
2025-10-01T14:08:01.023454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254854542497887:4685]
2025-10-01T14:08:01.023456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254854542497887:4685]
2025-10-01T14:08:01.023473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:01.023483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360161:5175], now have 1 active actors on pipe
2025-10-01T14:08:01.023491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:01.023503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:01.023505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:01.023507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:01.023509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:01.023510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:01.023543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254854542497887:4685]
2025-10-01T14:08:01.023552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:01.023597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:01.023944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.023958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.023990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:01.024003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.024008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.024010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:01.024021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.024037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:01.024055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.024243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.024255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.024267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.024353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 417 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0
2025-10-01T14:08:01.024678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2646a57-275b6c3-6e9f5e9e-ca5528d0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:01.027761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0] Write session: try to update token
2025-10-01T14:08:01.027780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:01.036707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:01.036728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:01.036739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254854542497887:4685]
2025-10-01T14:08:01.036786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:01.036795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:01.036991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:01.037152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:01.037314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:01.037481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:01.037732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:01.037781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:01.044437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 417 sessionId: src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:01.047542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:01.050141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.050170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.050211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:01.050367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:01.058808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:01.058827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:01.058830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:01.058832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:01.058844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254854542497887:4685]
2025-10-01T14:08:01.058849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254854542497887:4685]
2025-10-01T14:08:01.058853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254854542497887:4685]
2025-10-01T14:08:01.058900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:01.058909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.058916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:01.058936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:01.058955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:01.058958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:01.059184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:01.087391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254856919360186:5085]
2025-10-01T14:08:01.087646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 416, pipe: [1:7556254856919360186:5085]
2025-10-01T14:08:01.216794Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:01.225438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.225474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.225651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.225733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.225802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.225869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.225915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.225924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.225996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.226080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.226138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.226194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.226241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.226248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.226325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.226415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.226488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.226561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.226612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.226620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.226701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.226778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.226854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.226926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.226980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.226987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.227061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.227145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.227218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.227287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.227336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.227344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.227422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.227488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.227566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.227633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.227685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.227693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.227767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.227834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.227906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.227980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.228035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.228042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.228112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.228179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.228247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.228317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.228362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.228369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.228443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.228513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.228584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.228658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.228707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.228714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.228785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.228861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.228927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.228997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.229043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.229051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.229123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360186:5085], now have 1 active actors on pipe
2025-10-01T14:08:01.229423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:01.229448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254856919360186:5085]
2025-10-01T14:08:01.229465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:01.230000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:01.230031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 417 reason: error at write: Disconnected sessionId: src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0
2025-10-01T14:08:01.230202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 417 sessionId: src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0 is DEAD
2025-10-01T14:08:01.230349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:01.230329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:01.230359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0] Write session will restart in 0.007386s
2025-10-01T14:08:01.230398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0] Write session: Do CDS request
2025-10-01T14:08:01.230407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:01.238907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:01.238941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:01.238960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 418
2025-10-01T14:08:01.242671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:01.242727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:01.242734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:01.242738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:01.243178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 418 sessionId:  describe result for acl check
2025-10-01T14:08:01.243205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:01.243206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:01.243207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:01.243213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254856919360333:5188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:01.243755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254856919360333:5188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:01.248310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:01.252344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:01.252619Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:01.252630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:01.252644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:01.252699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:01.252737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254854542498154:4690]
2025-10-01T14:08:01.252942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254856919360333:5188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:01.253287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:01.253505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:01.253537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:01.253787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:01.253834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.253839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.253840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.253841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.253842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.253844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.253845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.253846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.253847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.253849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.253850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.253851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.253852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.253853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.253858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.253869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.253873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.253878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.253882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.253886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.253889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.253890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.253892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.253895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.253897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.253899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.253900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.253902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.253907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.253912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.253917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.253920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.253924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.253927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.253930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.253933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.253936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.253939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.253942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.253945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.253948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.253951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.253953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.253956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.253958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.253962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.253964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.253967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.253969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.253972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.253975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.253977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.253980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.253983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.253985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.253988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.254009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:01.261400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254856919360333:5188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:01.261425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254856919360333:5188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:01.261431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254856919360333:5188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:01.261442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:01.263319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:01.264121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:01.264141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:01.264144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:01.264147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:01.264154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 417 [2:7556254854542498154:4690]
2025-10-01T14:08:01.264170Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:01.264189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:01.264200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.264204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.264207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.264221Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:01.264226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:01.264231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:01.264289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.264297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.264301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.264307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:01.264310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:01.264567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 417
2025-10-01T14:08:01.264576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 417
2025-10-01T14:08:01.264754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:01.264765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.264779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.264789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.264821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:01.264846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360219:2446], now have 1 active actors on pipe
2025-10-01T14:08:01.264850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360464:5188], now have 1 active actors on pipe
2025-10-01T14:08:01.264867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.264876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.264899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254854542498149:4690]
2025-10-01T14:08:01.264905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254854542498149:4690]
2025-10-01T14:08:01.264908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254854542498149:4690]
2025-10-01T14:08:01.264925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:01.264942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:01.264945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:01.264950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:01.264952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:01.264960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:01.264963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:01.264980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:01.264994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.265005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.265008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:01.265017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.265033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:01.265095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254854542498149:4690]
2025-10-01T14:08:01.265112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:01.265121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:01.265127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.265393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.265405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.265421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.265988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 418 partition: 0 MaxSeqNo: 45 sessionId: src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0
2025-10-01T14:08:01.266452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad130a19-1a4644d6-62436f1d-a30a5ed5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:01.272997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0] Write session: try to update token
2025-10-01T14:08:01.273021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:01.292693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 418 sessionId: src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:01.295720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:01.295961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.295985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.296024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:01.296134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:01.303192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:01.303213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:01.303216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:01.303218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:01.303228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254854542498149:4690]
2025-10-01T14:08:01.303233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254854542498149:4690]
2025-10-01T14:08:01.303238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254854542498149:4690]
2025-10-01T14:08:01.303292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:01.303299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.303302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:01.303454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:01.304862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:01.304879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:01.304882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:01.329705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254856919360473:5085]
2025-10-01T14:08:01.329928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 417, pipe: [1:7556254856919360473:5085]
2025-10-01T14:08:01.454518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:01.461194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.461216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.461361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.461420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.461474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.461530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.461571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.461581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.461640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.461693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.461750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.461807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.461851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.461856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.461912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.461959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.462011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.462062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.462101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.462106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.462159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.462213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.462264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.462316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.462355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.462360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.462438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.462488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.462537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.462596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.462642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.462650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.462718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.462774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.462828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.462886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.462927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.462932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.462988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.463040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.463095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.463147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.463187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.463192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.463247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.463300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.463354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.463413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.463454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.463459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.463516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.463571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.463631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.463690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.463731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.463736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.463797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.463852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.463908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.463961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.464000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.464005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.464050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360473:5085], now have 1 active actors on pipe
2025-10-01T14:08:01.464262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254856919360473:5085]
2025-10-01T14:08:01.464263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:01.464290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:01.464294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:01.464314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 418 reason: error at write: Disconnected sessionId: src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0
2025-10-01T14:08:01.464512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 418 sessionId: src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0 is DEAD
2025-10-01T14:08:01.464656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:01.464666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0] Write session will restart in 0.007390s
2025-10-01T14:08:01.464686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0] Write session: Do CDS request
2025-10-01T14:08:01.464691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:01.464868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:01.472868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:01.473266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:01.473279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 419
2025-10-01T14:08:01.473382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:01.473417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:01.473427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:01.473435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:01.473909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 419 sessionId:  describe result for acl check
2025-10-01T14:08:01.473946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:01.473952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:01.473953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:01.473958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254856919360508:5192] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:01.474573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254856919360508:5192] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:01.477999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254856919360508:5192] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:01.481259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254856919360508:5192] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:01.481278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254856919360508:5192] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:01.481282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254856919360508:5192] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:01.481290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:01.483612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:01.489184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:01.489473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:01.489482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:01.489494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:01.489549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:01.489594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254854542498431:4703]
2025-10-01T14:08:01.490227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:01.490654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:01.490725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:01.491104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:01.491191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.491198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.491199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.491201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.491202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.491203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.491204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.491206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.491207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.491208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.491210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.491211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.491212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.491213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.491220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.491230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.491234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.491237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.491241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.491245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.491248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.491252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.491256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.491259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.491263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.491266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.491270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.491273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.491281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.491291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.491303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.491308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.491313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.491322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.491330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.491335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.491339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.491349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.491353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.491359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.491364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.491370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.491374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.491385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.491389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.491394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.491402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.491407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.491411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.491421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.491426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.491435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.491444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.491449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.491454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.491464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.491507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:01.497409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:01.498086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:01.498099Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:01.498100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:01.498104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:01.498109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 418 [2:7556254854542498431:4703]
2025-10-01T14:08:01.498122Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:01.498139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:01.498140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.498143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.498144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.498158Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:01.498162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:01.498167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:01.498221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.498228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.498231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.498235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:01.498238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:01.498307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:01.498315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.498327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.498337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.498356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:01.498394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360475:2446], now have 1 active actors on pipe
2025-10-01T14:08:01.498402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360704:5192], now have 1 active actors on pipe
2025-10-01T14:08:01.498409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254854542498426:4703]
2025-10-01T14:08:01.498411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254854542498426:4703]
2025-10-01T14:08:01.498412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254854542498426:4703]
2025-10-01T14:08:01.498424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:01.498438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:01.498447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 418
2025-10-01T14:08:01.498454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 418
2025-10-01T14:08:01.498453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:01.498457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:01.498461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:01.498465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:01.498468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:01.498502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254854542498426:4703]
2025-10-01T14:08:01.498504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:01.498507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:01.498524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.498529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.498576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:01.498581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.498585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.498587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:01.498594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.498601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:01.498620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.499477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.499492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.499514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.499664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 419 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0
2025-10-01T14:08:01.500042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6be91c8-d8ed3f1b-41cc4385-8b8fada8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:01.502665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0] Write session: try to update token
2025-10-01T14:08:01.502684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:01.518587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 419 sessionId: src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:01.521378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:01.521563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.521580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.521611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:01.521693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:01.524015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:01.524029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:01.524032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:01.524033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:01.524043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254854542498426:4703]
2025-10-01T14:08:01.524048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254854542498426:4703]
2025-10-01T14:08:01.524051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254854542498426:4703]
2025-10-01T14:08:01.524098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:01.524098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:01.524103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:01.524107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:01.524108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.524111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:01.524241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:01.564203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254856919360727:5085]
2025-10-01T14:08:01.564445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 418, pipe: [1:7556254856919360727:5085]
2025-10-01T14:08:01.684744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:01.692584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.692619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.692825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.692889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.692960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.693030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.693074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.693082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.693160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.693220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.693288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.693361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.693406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.693410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.693485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.693548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.693607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.693670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.693711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.693714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.693786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.693849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.693910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.693970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.694015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.694018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.694090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.694154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.694219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.694279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.694322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.694326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.694419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.694485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.694567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.694644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.694696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.694700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.694776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.694843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.694913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.694987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.695031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.695034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.695107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.695177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.695248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.695318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.695379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.695389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.695471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.695545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.695617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.695680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.695728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.695731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.695809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:01.695875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:01.695943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:01.696010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:01.696047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:01.696049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:01.696120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360727:5085], now have 1 active actors on pipe
2025-10-01T14:08:01.697420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:01.698580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:01.698592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0] Write session will restart in 0.006413s
2025-10-01T14:08:01.698616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0] Write session: Do CDS request
2025-10-01T14:08:01.698621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:01.696463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254856919360727:5085]
2025-10-01T14:08:01.696491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:01.696493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:01.696514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:01.696521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 419 reason: error at write: Disconnected sessionId: src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0
2025-10-01T14:08:01.696694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 419 sessionId: src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0 is DEAD
2025-10-01T14:08:01.706923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:01.706997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:01.707009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 420
2025-10-01T14:08:01.711203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:01.711257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:01.711266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:01.711271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:01.711851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 420 sessionId:  describe result for acl check
2025-10-01T14:08:01.711888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:01.711894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:01.711896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:01.711902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254856919360759:5197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:01.712462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254856919360759:5197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:01.715619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254856919360759:5197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:01.718660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254856919360759:5197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:01.718675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254856919360759:5197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:01.718678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254856919360759:5197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:01.718687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:01.720694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:01.723336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:01.723591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:01.723605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:01.723618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:01.723674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:01.723731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254854542498678:4706]
2025-10-01T14:08:01.724296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:01.725978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:01.726033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:01.726360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:01.726445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.726446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.726447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.726448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.726449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.726450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.726451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.726452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.726453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.726454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.726456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.726457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.726458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.726459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.726464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.726474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.726478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.726481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.726484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.726487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.726490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.726493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.726497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.726500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.726503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.726506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.726510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.726513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.726520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.726530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.726536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.726541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.726545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.726549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.726553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.726557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.726561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.726566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.726570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.726574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.726578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.726583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.726586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.726592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.726595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.726600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.726603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.726608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.726612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.726617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.726620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.726624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.726629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.726633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.726637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.726640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.726677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:01.733168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:01.733827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:01.733844Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:01.733848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:01.733851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:01.733859Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 419 [2:7556254854542498678:4706]
2025-10-01T14:08:01.733876Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:01.733896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:01.733905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.733909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.733911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.733929Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:01.733939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:01.733946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:01.734016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.734023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.734025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.734029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:01.734031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:01.734104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:01.734111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.734123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.734134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.734152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:01.734171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360732:2446], now have 1 active actors on pipe
2025-10-01T14:08:01.734179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254854542498673:4706]
2025-10-01T14:08:01.734185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254854542498673:4706]
2025-10-01T14:08:01.734187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254854542498673:4706]
2025-10-01T14:08:01.734198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:01.734209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:01.734211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:01.734213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:01.734214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:01.734224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:01.734227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:01.734267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360957:5197], now have 1 active actors on pipe
2025-10-01T14:08:01.734272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254854542498673:4706]
2025-10-01T14:08:01.734281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:01.734445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:01.734313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 419
2025-10-01T14:08:01.734646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.734658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.734409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 419
2025-10-01T14:08:01.734684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:01.734697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.734701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.734704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:01.734714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.734725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:01.734749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.734987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 420 partition: 0 MaxSeqNo: 45 sessionId: src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0
2025-10-01T14:08:01.734888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.734896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.734911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.738505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4e6ab81-42c419d8-aba8685b-d7facc7c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:01.741041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0] Write session: try to update token
2025-10-01T14:08:01.741065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:01.762550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:01.762568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:01.762571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:01.762572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:01.762583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254854542498673:4706]
2025-10-01T14:08:01.762588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254854542498673:4706]
2025-10-01T14:08:01.762592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254854542498673:4706]
2025-10-01T14:08:01.762650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:01.762654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:01.762659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.762662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:01.762662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:01.762667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:01.762823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:01.777635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 420 sessionId: src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:01.780045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:01.796646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254856919360984:5085]
2025-10-01T14:08:01.797041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 419, pipe: [1:7556254856919360984:5085]
2025-10-01T14:08:01.929741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:01.930206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.930221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.930258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360984:5085], now have 1 active actors on pipe
2025-10-01T14:08:01.930727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254856919360984:5085]
2025-10-01T14:08:01.930731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:01.930734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:01.930756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:01.930801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 420 reason: error at write: Disconnected sessionId: src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0
2025-10-01T14:08:01.930992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 420 sessionId: src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0 is DEAD
2025-10-01T14:08:01.931447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:01.931458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0] Write session will restart in 0.007510s
2025-10-01T14:08:01.931483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0] Write session: Do CDS request
2025-10-01T14:08:01.931491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:01.931627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:01.939967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:01.940116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:01.940131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 421
2025-10-01T14:08:01.940276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:01.940308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:01.940313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:01.940320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:01.940724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 421 sessionId:  describe result for acl check
2025-10-01T14:08:01.940764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:01.940771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:01.940772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:01.940777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254856919361018:5201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:01.941280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254856919361018:5201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:01.943904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254856919361018:5201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:01.952010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:01.952239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254856919361018:5201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:01.952255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254856919361018:5201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:01.952259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254856919361018:5201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:01.952268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:01.955718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:01.955963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:01.955967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:01.955980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:01.956040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:01.956075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254854542498927:4708]
2025-10-01T14:08:01.956650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:01.957004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:01.957047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:01.957365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:01.957428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.957429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.957430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.957431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.957433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.957434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.957435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.957437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.957438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.957439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.957440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.957441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.957442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.957443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.957450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.957459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.957462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.957466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.957469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.957472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.957475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.957479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.957483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.957487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.957490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.957494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.957497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.957500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.957508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.957515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:01.957521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.957527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:01.957532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.957537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:01.957541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.957546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:01.957551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.957556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:01.957560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.957564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:01.957569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.957576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:01.957581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.957585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:01.957590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.957595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:01.957599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.957603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.957608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.957612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.957616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.957620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.957624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.957629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:01.957633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.957637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:01.957671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:01.962253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:01.962907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:01.962920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:01.962923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:01.962927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:01.962935Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 420 [2:7556254854542498927:4708]
2025-10-01T14:08:01.962956Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:01.962975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:01.962981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.962984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.962985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.962999Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:01.963003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:01.963008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:01.963054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.963059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.963061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.963064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:01.963066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:01.963121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:01.963126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:01.963135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:01.963140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:01.963149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:01.963165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254854542498919:4708]
2025-10-01T14:08:01.963170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254854542498919:4708]
2025-10-01T14:08:01.963172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254854542498919:4708]
2025-10-01T14:08:01.963180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:01.963185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:01.963188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:01.963190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:01.963190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:01.963200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:01.963202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:01.963212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919360987:2446], now have 1 active actors on pipe
2025-10-01T14:08:01.963215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254856919361227:5201], now have 1 active actors on pipe
2025-10-01T14:08:01.963252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254854542498919:4708]
2025-10-01T14:08:01.963264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:01.963322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:01.963294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 420
2025-10-01T14:08:01.963324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 420
2025-10-01T14:08:01.963435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.963446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.963473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:01.963485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:01.963489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:01.963497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:01.963507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:01.963519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:01.963537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.963743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.963752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.963768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:01.963858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 421 partition: 0 MaxSeqNo: 45 sessionId: src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0
2025-10-01T14:08:01.967349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87510a67-efc08bf6-573d18bf-6a82cc6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:01.969875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0] Write session: try to update token
2025-10-01T14:08:01.969899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:01.988361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 421 sessionId: src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:01.991242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:01.994740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:01.994765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:01.994805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:01.998495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:02.004600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:02.004618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:02.004619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:02.004621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:02.004628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254854542498919:4708]
2025-10-01T14:08:02.004633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254854542498919:4708]
2025-10-01T14:08:02.004637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254854542498919:4708]
2025-10-01T14:08:02.004677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:02.004682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:02.004684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:02.004687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:02.004695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.004697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:02.004860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:02.031364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254861214328541:5085]
2025-10-01T14:08:02.034321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 420, pipe: [1:7556254861214328541:5085]
2025-10-01T14:08:02.157625Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:02.166266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.166294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.166481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.166545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.166611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.166681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.166728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.166738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.166809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.166872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.166937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.169862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:02.169439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:02.169876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0] Write session will restart in 0.005118s
2025-10-01T14:08:02.169486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:02.169488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:02.169526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 421 reason: error at write: Disconnected sessionId: src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0
2025-10-01T14:08:02.169701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 421 sessionId: src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0 is DEAD
2025-10-01T14:08:02.169822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254861214328541:5085]
2025-10-01T14:08:02.169915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0] Write session: Do CDS request
2025-10-01T14:08:02.169921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:02.167008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.167058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.167061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.167122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.167178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.167233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.167284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.167324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.167327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.167384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.167440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.167494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.167547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.167584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.167587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.167650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.167708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.167767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.167822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.167860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.167863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.167929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.167973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.168024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.168075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.168116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.168118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.168173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.168218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.168268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.168316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.168350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.168351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.168405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.168451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.168499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.168551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.168587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.168588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.168644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.168692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.168744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.168810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.168850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.168852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.168915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.168967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.169026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.169085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.169120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.169122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.169192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214328541:5085], now have 1 active actors on pipe
2025-10-01T14:08:02.170140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:02.179036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:02.179599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:02.179612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 422
2025-10-01T14:08:02.180632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:02.180677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:02.180683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:02.180687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:02.181124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 422 sessionId:  describe result for acl check
2025-10-01T14:08:02.181158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:02.181165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:02.181167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:02.181173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254861214328588:5215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:02.181710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254861214328588:5215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:02.185630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254861214328588:5215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:02.189216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254861214328588:5215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:02.189234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254861214328588:5215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:02.189238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254861214328588:5215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:02.189247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:02.192979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:02.195944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:02.196265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:02.196277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:02.196291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:02.196352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:02.196394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254858837466489:4713]
2025-10-01T14:08:02.197023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:02.197860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:02.197916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:02.198240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:02.198308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.198314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.198315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.198316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.198317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.198319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.198320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.198321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.198322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.198323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.198324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.198325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.198327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.198328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.198334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.198343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.198347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.198350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.198354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.198358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.198362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.198365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.198385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.198391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.198394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.198398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.198402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.198405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.198414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.198422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.198430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.198435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.198439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.198444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.198448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.198453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.198464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.198469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.198473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.198478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.198482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.198487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.198491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.198496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.198500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.198505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.198509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.198513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.198518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.198523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.198527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.198533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.198544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.198548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.198554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.198558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.198594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:02.203655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:02.204312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:02.204328Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:02.204331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:02.204335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:02.204345Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 421 [2:7556254858837466489:4713]
2025-10-01T14:08:02.204363Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:02.204382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:02.204385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.204389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.204391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.204409Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:02.204415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:02.204420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:02.204475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.204484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.204485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.204489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:02.204492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:02.204564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:02.204571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.204583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.204593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.204607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:02.204626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214328772:5215], now have 1 active actors on pipe
2025-10-01T14:08:02.204629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214328569:2446], now have 1 active actors on pipe
2025-10-01T14:08:02.204637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254858837466484:4713]
2025-10-01T14:08:02.204639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254858837466484:4713]
2025-10-01T14:08:02.204641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254858837466484:4713]
2025-10-01T14:08:02.204653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:02.204667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:02.204681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:02.204684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:02.204720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254858837466484:4713]
2025-10-01T14:08:02.204722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:02.204759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:02.204769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:02.204772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:02.204777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:02.204759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 421
2025-10-01T14:08:02.204808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 421
2025-10-01T14:08:02.204937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.204948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.204987Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:02.205001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.205006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.205008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:02.205018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.205028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:02.205049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:02.205360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.205368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.205387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:02.205529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 422 partition: 0 MaxSeqNo: 45 sessionId: src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0
2025-10-01T14:08:02.205928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18f43ee-f75ff137-bc4174c1-67ef3652_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:02.208592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0] Write session: try to update token
2025-10-01T14:08:02.208614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:02.226086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:02.226106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:02.226118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254858837466484:4713]
2025-10-01T14:08:02.226172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:02.226198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:02.226359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:02.226527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:02.226674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:02.227012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:02.227339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:02.227386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:02.237957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 422 sessionId: src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:02.240860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:02.241848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.241876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.241919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:02.242319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:02.245857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:02.245876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:02.245879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:02.245882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:02.245974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254858837466484:4713]
2025-10-01T14:08:02.245982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254858837466484:4713]
2025-10-01T14:08:02.245986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254858837466484:4713]
2025-10-01T14:08:02.246036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:02.246043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.246046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:02.246189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:02.246193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:02.246200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:02.246204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:02.267203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254861214328840:5085]
2025-10-01T14:08:02.267474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 421, pipe: [1:7556254861214328840:5085]
2025-10-01T14:08:02.406349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:02.414620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.414641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.414809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.414870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.414935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.414997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.415043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.415051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.415120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.415179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.415248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.415316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.415360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.415366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.415426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.415485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.415560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.415622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.415665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.415671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.415730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.415789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.415842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.415905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.415946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.415952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.416009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.416063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.416123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.416185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.416227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.416234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.417751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:02.417799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254861214328840:5085]
2025-10-01T14:08:02.417972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:02.417985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:02.418010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 422 reason: error at write: Disconnected sessionId: src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0
2025-10-01T14:08:02.418201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 422 sessionId: src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0 is DEAD
2025-10-01T14:08:02.418317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:02.418325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0] Write session will restart in 0.008869s
2025-10-01T14:08:02.418359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0] Write session: Do CDS request
2025-10-01T14:08:02.418365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:02.416298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.416362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.416420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.416478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.416518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.416521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.416589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.416643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.416700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.416753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.416791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.416793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.416868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.416916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.416967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.417019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.417057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.417060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.417113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.417162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.417216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.417265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.417304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.417307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.417368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.417419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.417465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.417523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.417569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.417572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.417617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214328840:5085], now have 1 active actors on pipe
2025-10-01T14:08:02.418782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:02.428886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:02.429904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:02.429919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 423
2025-10-01T14:08:02.430042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:02.430080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:02.430090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:02.430096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:02.430552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 423 sessionId:  describe result for acl check
2025-10-01T14:08:02.430589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:02.430591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:02.430593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:02.430599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254861214328934:5220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:02.431110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254861214328934:5220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:02.433876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254861214328934:5220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:02.435985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:02.439190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:02.439465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:02.439474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:02.439486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:02.439536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:02.439576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254858837466768:4726]
2025-10-01T14:08:02.439633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254861214328934:5220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:02.439647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254861214328934:5220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:02.439649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254861214328934:5220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:02.439656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:02.440162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:02.440473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:02.440520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:02.440852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:02.440910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.440916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.440918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.440919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.440920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.440921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.440922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.440923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.440924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.440925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.440927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.440928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.440929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.440930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.440936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.440946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.440950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.440954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.440958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.440962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.440966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.440970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.440973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.440978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.440981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.440985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.440989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.440993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.441000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.441008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.441015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.441020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.441024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.441030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.441035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.441041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.441045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.441050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.441054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.441059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.441063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.441068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.441072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.441077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.441082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.441087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.441091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.441096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.441101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.441106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.441110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.441115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.441119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.441124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.441128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.441133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.441169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:02.445183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:02.445826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:02.445837Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:02.445839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:02.445842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:02.445847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 422 [2:7556254858837466768:4726]
2025-10-01T14:08:02.445860Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:02.445881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:02.445889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.445893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.445899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.445914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:02.445924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:02.445933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:02.445977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.445982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.445983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.445986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:02.445988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:02.446039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:02.446044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.446053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.446059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.446078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:02.446101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214329087:5220], now have 1 active actors on pipe
2025-10-01T14:08:02.446109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214328846:2446], now have 1 active actors on pipe
2025-10-01T14:08:02.446116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254858837466763:4726]
2025-10-01T14:08:02.446122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254858837466763:4726]
2025-10-01T14:08:02.446124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254858837466763:4726]
2025-10-01T14:08:02.446140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:02.446157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:02.446165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:02.446169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:02.446171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:02.446171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:02.446174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:02.446143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 422
2025-10-01T14:08:02.446173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 422
2025-10-01T14:08:02.446208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254858837466763:4726]
2025-10-01T14:08:02.446216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:02.446218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:02.446247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.446256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.446284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:02.446295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.446298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.446300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:02.446309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.446317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:02.446336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:02.446486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.446493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.446507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:02.446575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 423 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0
2025-10-01T14:08:02.446942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972370ec-f3249aa4-97a5bd74-35fa1060_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:02.449343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0] Write session: try to update token
2025-10-01T14:08:02.449364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:02.467301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 423 sessionId: src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:02.468825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:02.468842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:02.468844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:02.468846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:02.468857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254858837466763:4726]
2025-10-01T14:08:02.468863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254858837466763:4726]
2025-10-01T14:08:02.468867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254858837466763:4726]
2025-10-01T14:08:02.468919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:02.468921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:02.468927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:02.468931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:02.468931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.468933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:02.469055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:02.469673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:02.518050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254861214329099:5085]
2025-10-01T14:08:02.518357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 422, pipe: [1:7556254861214329099:5085]
2025-10-01T14:08:02.620909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:02.621296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.621309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.621347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214329099:5085], now have 1 active actors on pipe
2025-10-01T14:08:02.621510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:02.621581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:02.621589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254861214329099:5085]
2025-10-01T14:08:02.621617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:02.621685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 423 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0
2025-10-01T14:08:02.621873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 423 sessionId: src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0 is DEAD
2025-10-01T14:08:02.622036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:02.622046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0] Write session will restart in 0.005030s
2025-10-01T14:08:02.622075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0] Write session: Do CDS request
2025-10-01T14:08:02.622081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:02.627873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:02.627920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:02.627933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 424
2025-10-01T14:08:02.628059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:02.628084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:02.628089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:02.628092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:02.628528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 424 sessionId:  describe result for acl check
2025-10-01T14:08:02.628555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:02.628556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:02.628557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:02.628562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254861214329127:5225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:02.629167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254861214329127:5225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:02.632722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254861214329127:5225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:02.635520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254861214329127:5225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:02.635534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254861214329127:5225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:02.635537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254861214329127:5225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:02.635546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:02.636871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:02.639336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:02.639566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:02.639575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:02.639586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:02.639635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:02.639682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254858837467019:4728]
2025-10-01T14:08:02.640278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:02.640544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:02.640581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:02.640882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:02.640934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.640939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.640941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.640942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.640943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.640945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.640946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.640948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.640949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.640950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.640951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.640952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.640953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.640954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.640959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.640969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.640972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.640976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.640980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.640983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.640987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.640991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.640994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.640998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.641001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.641005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.641009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.641012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.641021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.641028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.641034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.641040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.641044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.641049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.641053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.641059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.641063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.641072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.641077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.641083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.641088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.641098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.641101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.641106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.641111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.641120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.641124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.641131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.641135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.641145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.641149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.641159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.641163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.641172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.641176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.641181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.641223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:02.645135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:02.645789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:02.645804Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:02.645806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:02.645810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:02.645816Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 423 [2:7556254858837467019:4728]
2025-10-01T14:08:02.645832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:02.645850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:02.645853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.645857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.645859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.645875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:02.645885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:02.645892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:02.645948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.645955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.645958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.645961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:02.645963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:02.646028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:02.646034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.646046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.646059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.646074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:02.646095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214329103:2446], now have 1 active actors on pipe
2025-10-01T14:08:02.646102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214329345:5225], now have 1 active actors on pipe
2025-10-01T14:08:02.646110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254858837467014:4728]
2025-10-01T14:08:02.646122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254858837467014:4728]
2025-10-01T14:08:02.646124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254858837467014:4728]
2025-10-01T14:08:02.646138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:02.646145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:02.646147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:02.646149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:02.646157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:02.646170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:02.646173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:02.646206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254858837467014:4728]
2025-10-01T14:08:02.646213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:02.646218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:02.646183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 423
2025-10-01T14:08:02.646217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 423
2025-10-01T14:08:02.646249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.646259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.646287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0e8e316-afad3e73-ca21217d-67d3619_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:02.646298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.646302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.646305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:02.646315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.646327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:02.646345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:02.647789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.647804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.647833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:02.647948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 424 partition: 0 MaxSeqNo: 45 sessionId: src_id|e0e8e316-afad3e73-ca21217d-67d3619_0
2025-10-01T14:08:02.648353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7eb42d2-9276c38d-e7defe63-9f924c25_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e0e8e316-afad3e73-ca21217d-67d3619_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:02.650856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e8e316-afad3e73-ca21217d-67d3619_0] Write session: try to update token
2025-10-01T14:08:02.650875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e8e316-afad3e73-ca21217d-67d3619_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:02.666029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 424 sessionId: src_id|e0e8e316-afad3e73-ca21217d-67d3619_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:02.668820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.668857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.668898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:02.668582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:02.668975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:02.672942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:02.672960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:02.672962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:02.672964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:02.672973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254858837467014:4728]
2025-10-01T14:08:02.672977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254858837467014:4728]
2025-10-01T14:08:02.672983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254858837467014:4728]
2025-10-01T14:08:02.673034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:02.673038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:02.673044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:02.673045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.673047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:02.673048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:02.673192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:02.721845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254861214329360:5085]
2025-10-01T14:08:02.723963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 423, pipe: [1:7556254861214329360:5085]
2025-10-01T14:08:02.827751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:02.836375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.836405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.836586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.836658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.836728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.836808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.836856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.836866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.836938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.837002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.837066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.837133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.837178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.837185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.837251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.837308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.837372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.837432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.837477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.837485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.837547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.837609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.837673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.837738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.837781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.837788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.837850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.837909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.837975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.838036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.838079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.838086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.838150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.838213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.838281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.840308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e8e316-afad3e73-ca21217d-67d3619_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:02.840322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e8e316-afad3e73-ca21217d-67d3619_0] Write session will restart in 0.007653s
2025-10-01T14:08:02.840348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e8e316-afad3e73-ca21217d-67d3619_0] Write session: Do CDS request
2025-10-01T14:08:02.840353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e8e316-afad3e73-ca21217d-67d3619_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:02.838351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.838421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.838426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.838492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.838565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.838617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.838678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.838721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.838725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.838785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.838842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.838909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.838962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.839000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.839002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.839073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.839130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.839188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.839245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.839289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.839292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.839362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:02.839420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:02.839480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:02.839537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:02.839580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:02.839582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:02.839648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214329360:5085], now have 1 active actors on pipe
2025-10-01T14:08:02.840788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:02.839870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254861214329360:5085]
2025-10-01T14:08:02.839899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:02.839937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:02.839941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:02.839974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 424 reason: error at write: Disconnected sessionId: src_id|e0e8e316-afad3e73-ca21217d-67d3619_0
2025-10-01T14:08:02.840191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 424 sessionId: src_id|e0e8e316-afad3e73-ca21217d-67d3619_0 is DEAD
2025-10-01T14:08:02.849031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e8e316-afad3e73-ca21217d-67d3619_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:02.849099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:02.849118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 425
2025-10-01T14:08:02.849293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:02.849338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:02.849348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:02.849353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:02.849976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 425 sessionId:  describe result for acl check
2025-10-01T14:08:02.850011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:02.850017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:02.850019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:02.850027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254861214329387:5229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:02.850566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254861214329387:5229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:02.854964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254861214329387:5229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:02.858576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254861214329387:5229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:02.858592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254861214329387:5229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:02.858596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254861214329387:5229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:02.858604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:02.863108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:02.865422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:02.865708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:02.865718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:02.865731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:02.865800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:02.865843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254858837467271:4731]
2025-10-01T14:08:02.866360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:02.866721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:02.866780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:02.867155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:02.867216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.867221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.867223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.867224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.867226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.867227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.867228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.867230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.867231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.867232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.867233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.867235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.867236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.867237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.867244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.867254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.867259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.867263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.867267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.867271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.867275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.867279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.867283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.867288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.867292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.867296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.867300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.867308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.867315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.867327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:02.867338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.867350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:02.867355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.867362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:02.867366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.867371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:02.867375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.867380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:02.867384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.867389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:02.867395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.867400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:02.867404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.867410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:02.867414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.867419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:02.867424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.867433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.867438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.867443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.867447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.867456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.867461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.867466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:02.867470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.867477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:02.867526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:02.871860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:02.872484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:02.872496Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:02.872499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:02.872502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:02.872509Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 424 [2:7556254858837467271:4731]
2025-10-01T14:08:02.872524Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:02.872541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:02.872544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.872548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.872551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.872567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:02.872577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:02.872587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:02.872647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.872652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.872654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.872658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:02.872661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:02.872723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:02.872732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.872744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:02.872757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:02.872774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:02.872806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214329363:2446], now have 1 active actors on pipe
2025-10-01T14:08:02.872813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214329577:5229], now have 1 active actors on pipe
2025-10-01T14:08:02.872821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254858837467266:4731]
2025-10-01T14:08:02.872823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254858837467266:4731]
2025-10-01T14:08:02.872825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254858837467266:4731]
2025-10-01T14:08:02.872837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:02.872850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:02.872853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:02.872859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:02.872861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:02.872866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:02.872869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:02.872852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 424
2025-10-01T14:08:02.872898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 424
2025-10-01T14:08:02.872903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254858837467266:4731]
2025-10-01T14:08:02.872913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:02.872919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:02.873071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.873079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.873103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:02.873113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:02.873121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:02.873123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:02.873134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:02.873146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:02.873161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:02.873345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.873352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.873368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:02.873497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 425 partition: 0 MaxSeqNo: 45 sessionId: src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0
2025-10-01T14:08:02.873874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0e8e316-afad3e73-ca21217d-67d3619_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:02.876360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0] Write session: try to update token
2025-10-01T14:08:02.876381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:02.893331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 425 sessionId: src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:02.895969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:02.896238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:02.896261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:02.896286Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:02.896290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:02.896293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:02.896295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:02.896305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254858837467266:4731]
2025-10-01T14:08:02.896314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254858837467266:4731]
2025-10-01T14:08:02.896317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254858837467266:4731]
2025-10-01T14:08:02.896376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:02.896375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:02.896381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:02.896384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:02.896387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:02.896389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:02.896509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:02.939961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254861214329620:5085]
2025-10-01T14:08:02.940324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 424, pipe: [1:7556254861214329620:5085]
2025-10-01T14:08:03.054393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:03.054791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:03.054855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254861214329620:5085], now have 1 active actors on pipe
2025-10-01T14:08:03.054943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:03.055053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:03.055112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254861214329620:5085]
2025-10-01T14:08:03.065712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:03.065724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:03.065749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 425 reason: error at write: Disconnected sessionId: src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0
2025-10-01T14:08:03.065898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 425 sessionId: src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0 is DEAD
2025-10-01T14:08:03.069801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:03.069818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0] Write session will restart in 0.006909s
2025-10-01T14:08:03.069849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0] Write session: Do CDS request
2025-10-01T14:08:03.069858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:03.077965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:03.078046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:03.078058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 426
2025-10-01T14:08:03.078807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:03.078852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:03.078859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:03.078871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:03.079352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 426 sessionId:  describe result for acl check
2025-10-01T14:08:03.079395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:03.079402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:03.079404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:03.079412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254865509296960:5233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:03.080010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254865509296960:5233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:03.084237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254865509296960:5233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:03.088779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254865509296960:5233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:03.088796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254865509296960:5233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:03.088811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254865509296960:5233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:03.088821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:03.094715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:03.097488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:03.097710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:03.097720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:03.097732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:03.097805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:03.097848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254863132434819:4733]
2025-10-01T14:08:03.098482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:03.098878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:03.098933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:03.099258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:03.099359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.099366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.099367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.099368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.099370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.099371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.099373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.099374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.099375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.099376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.099377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.099379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.099380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.099381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.099387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.099397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.099401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.099404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.099408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.099412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.099416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.099419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.099423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.099427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.099431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.099435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.099439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.099443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.099450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.099459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.099464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.099475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.099480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.099490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.099495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.099504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.099509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.099518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.099523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.099530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.099536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.099545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.099549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.099555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.099559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.099570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.099574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.099584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.099589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.099599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.099604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.099613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.099617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.099622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.099631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.099635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.099677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:03.105346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:03.105975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:03.105992Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:03.105996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:03.106000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:03.106007Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 425 [2:7556254863132434819:4733]
2025-10-01T14:08:03.106023Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:03.106042Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:03.106052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.106056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.106058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.106075Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:03.106089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:03.106101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:03.106162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.106169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.106172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.106175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:03.106178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:03.106246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:03.106254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.106266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.106283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.106302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:03.106326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297047:5233], now have 1 active actors on pipe
2025-10-01T14:08:03.106334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509296919:2446], now have 1 active actors on pipe
2025-10-01T14:08:03.106342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254863132434814:4733]
2025-10-01T14:08:03.106348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254863132434814:4733]
2025-10-01T14:08:03.106350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254863132434814:4733]
2025-10-01T14:08:03.106363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:03.106397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:03.106408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:03.106411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:03.106415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:03.106417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:03.106420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:03.106450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254863132434814:4733]
2025-10-01T14:08:03.106459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:03.106433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 425
2025-10-01T14:08:03.106474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:03.106441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 425
2025-10-01T14:08:03.106489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.106498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.106535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7df540f4-fd824a79-76dcd942-b2753cef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:03.106547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.106551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.106558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:03.106566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.106579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:03.106602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:03.107048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.107058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.107078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:03.107319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 426 partition: 0 MaxSeqNo: 45 sessionId: src_id|7df540f4-fd824a79-76dcd942-b2753cef_0
2025-10-01T14:08:03.107681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0d9b78-12d10ad4-53d84bbe-7d0e1915_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7df540f4-fd824a79-76dcd942-b2753cef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:03.110084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7df540f4-fd824a79-76dcd942-b2753cef_0] Write session: try to update token
2025-10-01T14:08:03.110101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7df540f4-fd824a79-76dcd942-b2753cef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:03.125760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 426 sessionId: src_id|7df540f4-fd824a79-76dcd942-b2753cef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:03.128002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:03.128169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.128190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.128227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:03.128296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:03.130789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:03.130808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:03.130810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:03.130812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:03.130821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254863132434814:4733]
2025-10-01T14:08:03.130826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254863132434814:4733]
2025-10-01T14:08:03.130830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254863132434814:4733]
2025-10-01T14:08:03.130875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:03.130885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.130885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:03.130888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:03.130891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:03.130895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:03.131025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:03.155508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254865509297178:5085]
2025-10-01T14:08:03.155778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 425, pipe: [1:7556254865509297178:5085]
2025-10-01T14:08:03.285406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:03.293573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.293606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.293788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.293862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.293939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.294013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.294061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.294071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.294144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.294218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.294289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.294362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.294432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.294441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.294508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.294570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.294632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.294693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.294745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.294753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.294814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.294876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.294936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.295002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.295053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.295062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.295129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.295192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.295257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.295322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.295366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.295374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.295444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.295503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.295573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.295643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.295691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.295699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.295770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.295831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.295898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.295960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.296005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.296015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.296083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.296141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.296199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.296265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.296308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.296314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.296382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.296451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.296526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.296594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.296643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.296658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.296731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:03.296811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:03.296876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:03.296940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:03.296986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:03.296993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:03.297061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297178:5085], now have 1 active actors on pipe
2025-10-01T14:08:03.297330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254865509297178:5085]
2025-10-01T14:08:03.297338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:03.297341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:03.297362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:03.297370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 426 reason: error at write: Disconnected sessionId: src_id|7df540f4-fd824a79-76dcd942-b2753cef_0
2025-10-01T14:08:03.297575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 426 sessionId: src_id|7df540f4-fd824a79-76dcd942-b2753cef_0 is DEAD
2025-10-01T14:08:03.297887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df540f4-fd824a79-76dcd942-b2753cef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:03.297897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df540f4-fd824a79-76dcd942-b2753cef_0] Write session will restart in 0.008426s
2025-10-01T14:08:03.297937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df540f4-fd824a79-76dcd942-b2753cef_0] Write session: Do CDS request
2025-10-01T14:08:03.297944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df540f4-fd824a79-76dcd942-b2753cef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:03.298189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:03.307912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7df540f4-fd824a79-76dcd942-b2753cef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:03.310572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:03.310589Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 427
2025-10-01T14:08:03.311116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:03.311161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:03.311172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:03.311176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:03.312110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 427 sessionId:  describe result for acl check
2025-10-01T14:08:03.312150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:03.312154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:03.312156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:03.312162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254865509297240:5246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:03.312695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254865509297240:5246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:03.317555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254865509297240:5246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:03.325283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254865509297240:5246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:03.325303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254865509297240:5246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:03.325307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254865509297240:5246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:03.325315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:03.335543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:03.339089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:03.339422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:03.339426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:03.339434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:03.339477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:03.339510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254863132435093:4739]
2025-10-01T14:08:03.339968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:03.340278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:03.340317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:03.340636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:03.340710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.340712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.340713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.340714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.340716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.340717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.340718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.340719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.340720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.340722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.340723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.340724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.340725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.340726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.340732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.340742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.340746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.340750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.340753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.340756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.340760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.340763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.340768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.340772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.340775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.340779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.340783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.340787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.340795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.340815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.340822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.340827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.340833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.340839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.340844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.340849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.340855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.340861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.340866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.340870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.340876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.340882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.340886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.340892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.340898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.340903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.340908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.340914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.340919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.340924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.340928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.340934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.340940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.340946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.340956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.340961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.341006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:03.345671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:03.346441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:03.346455Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:03.346459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:03.346464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:03.346471Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 426 [2:7556254863132435093:4739]
2025-10-01T14:08:03.346490Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:03.346513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:03.346519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.346523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.346526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.346544Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:03.346554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:03.346562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:03.346641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.346651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.346654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.346658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:03.346661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:03.346736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:03.346743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.346757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.346773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.346794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:03.346816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254863132435088:4739]
2025-10-01T14:08:03.346822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254863132435088:4739]
2025-10-01T14:08:03.346825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254863132435088:4739]
2025-10-01T14:08:03.346838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:03.346856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:03.346871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:03.346875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:03.346916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254863132435088:4739]
2025-10-01T14:08:03.346919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:03.346938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:03.346941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:03.346944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:03.346947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297359:5246], now have 1 active actors on pipe
2025-10-01T14:08:03.346949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:03.346951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297224:2446], now have 1 active actors on pipe
2025-10-01T14:08:03.347221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 426
2025-10-01T14:08:03.347385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 426
2025-10-01T14:08:03.347753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.347765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.347789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:03.347799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.347804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.347806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:03.347819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.347832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:03.347847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:03.351542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.351567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.351600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:03.351773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 427 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0
2025-10-01T14:08:03.352246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7df540f4-fd824a79-76dcd942-b2753cef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:03.355029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0] Write session: try to update token
2025-10-01T14:08:03.355053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:03.382390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 427 sessionId: src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:03.383184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:03.383205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:03.383209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:03.383212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:03.383223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254863132435088:4739]
2025-10-01T14:08:03.383228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254863132435088:4739]
2025-10-01T14:08:03.383232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254863132435088:4739]
2025-10-01T14:08:03.383289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:03.383298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.383301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:03.383470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:03.385556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:03.385745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:03.385762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:03.385766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:03.398709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254865509297482:5085]
2025-10-01T14:08:03.401278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 426, pipe: [1:7556254865509297482:5085]
2025-10-01T14:08:03.556589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:03.556600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:03.556644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 427 reason: error at write: Disconnected sessionId: src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0
2025-10-01T14:08:03.556820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 427 sessionId: src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0 is DEAD
2025-10-01T14:08:03.556989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254865509297482:5085]
2025-10-01T14:08:03.557003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:03.553788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:03.557279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:03.554366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.557288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0] Write session will restart in 0.009834s
2025-10-01T14:08:03.555662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.555723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297482:5085], now have 1 active actors on pipe
2025-10-01T14:08:03.557310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0] Write session: Do CDS request
2025-10-01T14:08:03.557317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:03.557847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:03.567923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:03.569548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:03.569571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 428
2025-10-01T14:08:03.573934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:03.573995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:03.574001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:03.574006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:03.575109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 428 sessionId:  describe result for acl check
2025-10-01T14:08:03.575153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:03.575155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:03.575157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:03.575163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254865509297510:5250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:03.575797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254865509297510:5250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:03.583088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254865509297510:5250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:03.588385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254865509297510:5250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:03.588404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254865509297510:5250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:03.588408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254865509297510:5250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:03.588416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:03.593648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:03.596573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:03.597094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:03.597099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:03.597117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:03.597198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:03.597240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254863132435376:4751]
2025-10-01T14:08:03.597726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:03.598071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:03.598125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:03.598642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:03.598715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.598721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.598722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.598724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.598725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.598726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.598728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.598729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.598729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.598730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.598731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.598732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.598734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.598735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.598741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.598751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.598755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.598758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.598763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.598767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.598771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.598775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.598779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.598784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.598788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.598792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.598796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.598800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.598808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.598816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.598823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.598829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.598839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.598844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.598849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.598859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.598868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.598877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.598886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.598896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.598901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.598906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.598910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.598915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.598922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.598928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.598937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.598946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.598955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.598961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.598965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.598970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.598975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.598980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.598985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.598990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.599038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:03.606599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:03.607250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:03.607264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:03.607266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:03.607269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:03.607275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 427 [2:7556254863132435376:4751]
2025-10-01T14:08:03.607288Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:03.607304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:03.607306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.607309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.607311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.607325Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:03.607329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:03.607335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:03.607385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.607387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.607389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.607392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:03.607395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:03.607474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:03.607483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.607495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.607509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.607526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:03.607547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254863132435371:4751]
2025-10-01T14:08:03.607554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254863132435371:4751]
2025-10-01T14:08:03.607556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254863132435371:4751]
2025-10-01T14:08:03.607566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:03.607572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:03.607581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:03.607585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:03.607590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:03.607598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:03.607600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:03.607611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297680:5250], now have 1 active actors on pipe
2025-10-01T14:08:03.607622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297487:2446], now have 1 active actors on pipe
2025-10-01T14:08:03.607665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254863132435371:4751]
2025-10-01T14:08:03.607678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:03.607734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 427
2025-10-01T14:08:03.607765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 427
2025-10-01T14:08:03.607877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:03.607979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.607986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.608006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:03.608017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.608020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.608022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:03.608028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.608036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:03.608046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:03.608542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.608554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.608576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:03.608932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 428 partition: 0 MaxSeqNo: 45 sessionId: src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0
2025-10-01T14:08:03.609749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f1e9e7-6555c547-7a246857-98b9a635_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:03.612171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0] Write session: try to update token
2025-10-01T14:08:03.612191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:03.638495Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:03.638515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:03.638518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:03.638520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:03.638531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254863132435371:4751]
2025-10-01T14:08:03.638536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254863132435371:4751]
2025-10-01T14:08:03.638540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254863132435371:4751]
2025-10-01T14:08:03.638592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:03.638595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:03.638600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:03.638601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.638604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:03.638604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:03.638750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:03.641404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 428 sessionId: src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:03.653610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:03.657268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254865509297747:5085]
2025-10-01T14:08:03.660702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 427, pipe: [1:7556254865509297747:5085]
2025-10-01T14:08:03.796779Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:03.797069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.797082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.797105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297747:5085], now have 1 active actors on pipe
2025-10-01T14:08:03.797362Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:03.797394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:03.797407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:03.797413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:03.797452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254865509297747:5085]
2025-10-01T14:08:03.797532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 428 reason: error at write: Disconnected sessionId: src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0
2025-10-01T14:08:03.797702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 428 sessionId: src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0 is DEAD
2025-10-01T14:08:03.797820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:03.797831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0] Write session will restart in 0.006757s
2025-10-01T14:08:03.797853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0] Write session: Do CDS request
2025-10-01T14:08:03.797857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:03.805880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:03.806228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:03.806245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 429
2025-10-01T14:08:03.806404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:03.806448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:03.806453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:03.806457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:03.806942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 429 sessionId:  describe result for acl check
2025-10-01T14:08:03.806975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:03.806980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:03.806982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:03.806986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254865509297763:5255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:03.807466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254865509297763:5255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:03.812438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254865509297763:5255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:03.819878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254865509297763:5255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:03.819893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254865509297763:5255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:03.819899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254865509297763:5255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:03.819968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:03.823180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:03.828669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:03.828939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:03.828944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:03.828956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:03.829041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:03.829085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254863132435633:4754]
2025-10-01T14:08:03.829815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:03.830346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:03.830422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:03.830791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:03.830866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.830868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.830869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.830870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.830872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.830874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.830875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.830877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.830878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.830879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.830881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.830882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.830884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.830885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.830891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.830901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.830905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.830909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.830914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.830919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.830923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.830926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.830930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.830935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.830938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.830942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.830946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.830950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.830959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.830967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:03.830974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.830979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:03.830985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.830990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:03.830997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.831002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:03.831009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.831015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:03.831022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.831027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:03.831035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.831040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:03.831045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.831050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:03.831057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.831062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:03.831068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.831085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.831095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.831101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.831106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.831113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.831119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.831125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:03.831129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.831135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:03.831182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:03.839555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:03.840618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:03.840637Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:03.840640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:03.840645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:03.840653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 428 [2:7556254863132435633:4754]
2025-10-01T14:08:03.840674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:03.840694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:03.840698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.840702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.840704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.840723Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:03.840729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:03.840737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:03.840828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.840839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.840842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.840846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:03.840849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:03.840929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:03.840932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.840946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:03.840957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:03.840972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:03.840991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254863132435628:4754]
2025-10-01T14:08:03.840994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254863132435628:4754]
2025-10-01T14:08:03.840996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254863132435628:4754]
2025-10-01T14:08:03.841015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:03.841031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:03.841047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:03.841050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:03.841091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254863132435628:4754]
2025-10-01T14:08:03.841093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:03.841191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:03.841194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:03.841196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:03.841203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:03.841507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297997:5255], now have 1 active actors on pipe
2025-10-01T14:08:03.841520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509297749:2446], now have 1 active actors on pipe
2025-10-01T14:08:03.843041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 428
2025-10-01T14:08:03.843103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 428
2025-10-01T14:08:03.843343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.843357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.843392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f65c964b-8278a20f-afe58736-20e75071_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:03.843403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:03.843408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:03.843411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:03.843425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:03.843441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:03.843463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:03.843947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:03.843965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:03.843986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:03.844551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c982fb1-d79331a3-3fd3a3be-21e50199_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f65c964b-8278a20f-afe58736-20e75071_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:03.844132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 429 partition: 0 MaxSeqNo: 45 sessionId: src_id|f65c964b-8278a20f-afe58736-20e75071_0
2025-10-01T14:08:03.848162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f65c964b-8278a20f-afe58736-20e75071_0] Write session: try to update token
2025-10-01T14:08:03.848179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f65c964b-8278a20f-afe58736-20e75071_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:03.869447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:03.869473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:03.869476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:03.869480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:03.869489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254863132435628:4754]
2025-10-01T14:08:03.869494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254863132435628:4754]
2025-10-01T14:08:03.869499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254863132435628:4754]
2025-10-01T14:08:03.869554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:03.869563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:03.869566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:03.869723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:03.870538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:03.870552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:03.870556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:03.874420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 429 sessionId: src_id|f65c964b-8278a20f-afe58736-20e75071_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:03.877478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:03.898519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254865509298011:5085]
2025-10-01T14:08:03.898947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 428, pipe: [1:7556254865509298011:5085]
2025-10-01T14:08:04.026320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:04.026950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.026973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.027020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254865509298011:5085], now have 1 active actors on pipe
2025-10-01T14:08:04.027712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254865509298011:5085]
2025-10-01T14:08:04.027742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:04.027745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:04.028431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f65c964b-8278a20f-afe58736-20e75071_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:04.028443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f65c964b-8278a20f-afe58736-20e75071_0] Write session will restart in 0.009748s
2025-10-01T14:08:04.028469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f65c964b-8278a20f-afe58736-20e75071_0] Write session: Do CDS request
2025-10-01T14:08:04.028476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f65c964b-8278a20f-afe58736-20e75071_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:04.027800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 429 reason: error at write: Disconnected sessionId: src_id|f65c964b-8278a20f-afe58736-20e75071_0
2025-10-01T14:08:04.027996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 429 sessionId: src_id|f65c964b-8278a20f-afe58736-20e75071_0 is DEAD
2025-10-01T14:08:04.028125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:04.028754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:04.039892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f65c964b-8278a20f-afe58736-20e75071_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.040036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:04.040050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 430
2025-10-01T14:08:04.041060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.041104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:04.041110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:04.041114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:04.041952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 430 sessionId:  describe result for acl check
2025-10-01T14:08:04.042000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:04.042002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:04.042004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:04.042010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254869804265337:5259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:04.042763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254869804265337:5259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:04.045940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254869804265337:5259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:04.050922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254869804265337:5259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:04.050946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254869804265337:5259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:04.050950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254869804265337:5259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:04.050960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:04.058616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:04.062716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:04.063031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:04.063050Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:04.063065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:04.063138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:04.063181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254867427403184:4756]
2025-10-01T14:08:04.063636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:04.063994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:04.064043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:04.064327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:04.064373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.064378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.064379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.064380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.064381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.064381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.064382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.064383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.064384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.064384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.064385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.064386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.064387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.064388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.064392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.064399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.064401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.064403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.064405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.064407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.064409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.064412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.064414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.064416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.064419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.064421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.064423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.064425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.064445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.064453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.064459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.064464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.064468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.064473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.064481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.064486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.064494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.064500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.064505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.064511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.064520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.064525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.064533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.064536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.064539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.064542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.064545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.064551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.064554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.064557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.064560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.064562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.064565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.064567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.064570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.064573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.064594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:04.069888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 429
2025-10-01T14:08:04.069898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 429
2025-10-01T14:08:04.068904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:04.069491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:04.069497Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:04.069500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:04.069504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:04.069513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 429 [2:7556254867427403184:4756]
2025-10-01T14:08:04.069530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:04.069544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:04.069546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.069550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.069553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.069569Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:04.069574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:04.069580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:04.069627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.069629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.069630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.069633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:04.069636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:04.070057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:04.070060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.070072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.070082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.070097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:04.070117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804265312:2446], now have 1 active actors on pipe
2025-10-01T14:08:04.070121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804265482:5259], now have 1 active actors on pipe
2025-10-01T14:08:04.070143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.070147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.070162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254867427403179:4756]
2025-10-01T14:08:04.070164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254867427403179:4756]
2025-10-01T14:08:04.070165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254867427403179:4756]
2025-10-01T14:08:04.070178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:04.070189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:04.070196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:04.070197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:04.070199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:04.070199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:04.070202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:04.070212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|788003b6-a5e09fab-c3d50db0-838799aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:04.070218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.070221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.070222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:04.070229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.070236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:04.070271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254867427403179:4756]
2025-10-01T14:08:04.070279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:04.070285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:04.070291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.070531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.070538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.070554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.070685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 430 partition: 0 MaxSeqNo: 45 sessionId: src_id|788003b6-a5e09fab-c3d50db0-838799aa_0
2025-10-01T14:08:04.071251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f65c964b-8278a20f-afe58736-20e75071_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|788003b6-a5e09fab-c3d50db0-838799aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:04.074098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|788003b6-a5e09fab-c3d50db0-838799aa_0] Write session: try to update token
2025-10-01T14:08:04.074117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|788003b6-a5e09fab-c3d50db0-838799aa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:04.093095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 430 sessionId: src_id|788003b6-a5e09fab-c3d50db0-838799aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:04.095467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:04.097237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.097264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.097288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:04.097292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:04.097294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:04.097296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:04.097306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254867427403179:4756]
2025-10-01T14:08:04.097311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254867427403179:4756]
2025-10-01T14:08:04.097314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254867427403179:4756]
2025-10-01T14:08:04.097357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:04.097371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:04.097373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:04.097378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.097379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:04.097380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:04.097516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:04.126739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254869804265572:5085]
2025-10-01T14:08:04.127001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 429, pipe: [1:7556254869804265572:5085]
2025-10-01T14:08:04.250349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:04.250790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:04.250853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804265572:5085], now have 1 active actors on pipe
2025-10-01T14:08:04.250951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:04.251051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:04.251060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:04.251136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 430 reason: error at write: Disconnected sessionId: src_id|788003b6-a5e09fab-c3d50db0-838799aa_0
2025-10-01T14:08:04.251288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 430 sessionId: src_id|788003b6-a5e09fab-c3d50db0-838799aa_0 is DEAD
2025-10-01T14:08:04.251406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788003b6-a5e09fab-c3d50db0-838799aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:04.251415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788003b6-a5e09fab-c3d50db0-838799aa_0] Write session will restart in 0.008327s
2025-10-01T14:08:04.251435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788003b6-a5e09fab-c3d50db0-838799aa_0] Write session: Do CDS request
2025-10-01T14:08:04.251440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788003b6-a5e09fab-c3d50db0-838799aa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:04.251453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254869804265572:5085]
2025-10-01T14:08:04.251477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:04.261363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|788003b6-a5e09fab-c3d50db0-838799aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.262021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:04.262035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 431
2025-10-01T14:08:04.262175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.262209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:04.262219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:04.262223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:04.262828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 431 sessionId:  describe result for acl check
2025-10-01T14:08:04.262862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:04.262864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:04.262866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:04.262874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254869804265690:5272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:04.263404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254869804265690:5272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:04.266477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254869804265690:5272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:04.275241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:04.275537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254869804265690:5272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:04.275556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254869804265690:5272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:04.275559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254869804265690:5272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:04.275568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:04.278731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:04.279014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:04.279025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:04.279037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:04.279099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:04.279147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254867427403462:4759]
2025-10-01T14:08:04.279752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:04.280105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:04.280140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:04.280362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:04.280411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.280416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.280427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.280431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.280432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.280434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.280435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.280436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.280437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.280438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.280439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.280441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.280442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.280443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.280448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.280458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.280462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.280466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.280469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.280473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.280487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.280491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.280494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.280499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.280503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.280507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.280510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.280514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.280522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.280527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.280531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.280534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.280537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.280540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.280543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.280546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.280549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.280552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.280556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.280559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.280562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.280565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.280568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.280571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.280574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.280577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.280579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.280583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.280585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.280588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.280591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.280595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.280600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.280604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.280608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.280613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.280659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:04.284730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:04.285754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:04.285771Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:04.285774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:04.285777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:04.285784Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 430 [2:7556254867427403462:4759]
2025-10-01T14:08:04.285801Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:04.285819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:04.285826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.285830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.285832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.285849Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:04.285859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:04.285864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:04.285924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.285931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.285934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.285936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:04.285939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:04.286006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:04.286016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.286028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.286038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.286054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:04.286076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804265606:2446], now have 1 active actors on pipe
2025-10-01T14:08:04.286083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804265869:5272], now have 1 active actors on pipe
2025-10-01T14:08:04.286091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254867427403454:4759]
2025-10-01T14:08:04.286097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254867427403454:4759]
2025-10-01T14:08:04.286099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254867427403454:4759]
2025-10-01T14:08:04.286112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:04.286130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:04.286111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 430
2025-10-01T14:08:04.286147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:04.286111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 430
2025-10-01T14:08:04.286155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:04.286166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:04.286170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:04.286171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:04.286193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254867427403454:4759]
2025-10-01T14:08:04.286196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:04.286202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:04.286217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.286226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.286274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd5194f1-65464b30-638bc911-67ac7b66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:04.286285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.286289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.286295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:04.286304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.286313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:04.286332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.286514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.286524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.286541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.286667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 431 partition: 0 MaxSeqNo: 45 sessionId: src_id|bd5194f1-65464b30-638bc911-67ac7b66_0
2025-10-01T14:08:04.287584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|788003b6-a5e09fab-c3d50db0-838799aa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bd5194f1-65464b30-638bc911-67ac7b66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:04.290319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5194f1-65464b30-638bc911-67ac7b66_0] Write session: try to update token
2025-10-01T14:08:04.290336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5194f1-65464b30-638bc911-67ac7b66_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:04.307636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:04.307656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:04.307658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:04.307660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:04.307669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254867427403454:4759]
2025-10-01T14:08:04.307674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254867427403454:4759]
2025-10-01T14:08:04.307677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254867427403454:4759]
2025-10-01T14:08:04.307726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:04.307728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:04.307734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:04.307737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:04.307737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.307740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:04.307871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:04.308196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 431 sessionId: src_id|bd5194f1-65464b30-638bc911-67ac7b66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:04.311012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:04.351918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254869804265882:5085]
2025-10-01T14:08:04.352342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 430, pipe: [1:7556254869804265882:5085]
2025-10-01T14:08:04.455742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:04.456060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.456078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.456126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804265882:5085], now have 1 active actors on pipe
2025-10-01T14:08:04.456321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:04.457071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5194f1-65464b30-638bc911-67ac7b66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:04.457086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5194f1-65464b30-638bc911-67ac7b66_0] Write session will restart in 0.007550s
2025-10-01T14:08:04.457112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5194f1-65464b30-638bc911-67ac7b66_0] Write session: Do CDS request
2025-10-01T14:08:04.457118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5194f1-65464b30-638bc911-67ac7b66_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:04.456614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254869804265882:5085]
2025-10-01T14:08:04.456636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:04.456644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:04.456709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd5194f1-65464b30-638bc911-67ac7b66_0
2025-10-01T14:08:04.456914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 431 sessionId: src_id|bd5194f1-65464b30-638bc911-67ac7b66_0 is DEAD
2025-10-01T14:08:04.465843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5194f1-65464b30-638bc911-67ac7b66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.466762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:04.466781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 432
2025-10-01T14:08:04.467331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.467371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:04.467377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:04.467381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:04.467863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 432 sessionId:  describe result for acl check
2025-10-01T14:08:04.467914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:04.467920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:04.467922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:04.467927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254869804265956:5276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:04.468414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254869804265956:5276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:04.471332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254869804265956:5276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:04.474632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:04.474587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254869804265956:5276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:04.474602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254869804265956:5276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:04.474606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254869804265956:5276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:04.474614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:04.477401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:04.477630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:04.477638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:04.477650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:04.477706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:04.477748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254867427403733:4764]
2025-10-01T14:08:04.478285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:04.478668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:04.478712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:04.479011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:04.479101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.479107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.479108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.479109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.479110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.479111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.479113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.479114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.479114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.479116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.479117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.479118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.479119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.479120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.479125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.479133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.479136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.479140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.479143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.479146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.479149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.479152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.479155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.479158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.479161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.479164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.479167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.479169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.479176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.479183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.479188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.479193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.479196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.479200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.479204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.479208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.479214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.479218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.479221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.479226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.479230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.479235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.479238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.479243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.479247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.479252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.479255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.479259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.479263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.479268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.479272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.479275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.479279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.479283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.479286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.479290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.479325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:04.483158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:04.483921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:04.483935Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:04.483937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:04.483940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:04.483946Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 431 [2:7556254867427403733:4764]
2025-10-01T14:08:04.483959Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:04.483974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:04.483981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.483984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.483986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.484000Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:04.484009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:04.484017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:04.484066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.484072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.484074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.484077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:04.484079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:04.484144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:04.484151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.484162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.484171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.484184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:04.484204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804265884:2446], now have 1 active actors on pipe
2025-10-01T14:08:04.484210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804266135:5276], now have 1 active actors on pipe
2025-10-01T14:08:04.484217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254867427403727:4764]
2025-10-01T14:08:04.484219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254867427403727:4764]
2025-10-01T14:08:04.484220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254867427403727:4764]
2025-10-01T14:08:04.484232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:04.484246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:04.484248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:04.484253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:04.484256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:04.484260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:04.484262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:04.484291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 431
2025-10-01T14:08:04.484307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 431
2025-10-01T14:08:04.484288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254867427403727:4764]
2025-10-01T14:08:04.484302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:04.484317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:04.484342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.484346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.484368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:04.484374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.484377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.484380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:04.484388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.484394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:04.484408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.484523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.484529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.484540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.484624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 432 partition: 0 MaxSeqNo: 45 sessionId: src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0
2025-10-01T14:08:04.485094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd5194f1-65464b30-638bc911-67ac7b66_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:04.488287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0] Write session: try to update token
2025-10-01T14:08:04.488307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:04.495262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:04.495280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:04.495289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254867427403727:4764]
2025-10-01T14:08:04.495332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:04.495335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:04.495538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:04.495685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:04.495822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:04.495962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:04.496149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:04.496184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:04.507121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 432 sessionId: src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:04.509635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:04.509976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.510001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.510041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:04.510179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:04.515288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:04.515303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:04.515305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:04.515307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:04.515316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254867427403727:4764]
2025-10-01T14:08:04.515320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254867427403727:4764]
2025-10-01T14:08:04.515323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254867427403727:4764]
2025-10-01T14:08:04.515371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:04.515372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:04.515378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.515379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:04.515381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:04.515382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:04.515524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:04.556865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254869804266149:5085]
2025-10-01T14:08:04.557115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 431, pipe: [1:7556254869804266149:5085]
2025-10-01T14:08:04.670669Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:04.678620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.678646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.678787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.678841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.678909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.678963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.679159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.679163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.679225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.679276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.679343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.679397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.679435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.679437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.679502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.679573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.679639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.679705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.679748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.679751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.679818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.680165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.680218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.680275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.680312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.680314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.680378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.680433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.680486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.680541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.680581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.680584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.680657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.680715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.680770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.680847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.680886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.680889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.680958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.681011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.681072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.681130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.681166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.681168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.681237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.681289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.681357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.681416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.681458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.681460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.681520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.681573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.681633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.681685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.681775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.681778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.681839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:04.681909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:04.681973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:04.682033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:04.682074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:04.682076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:04.682148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804266149:5085], now have 1 active actors on pipe
2025-10-01T14:08:04.682818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:04.682833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0] Write session will restart in 0.008191s
2025-10-01T14:08:04.682869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0] Write session: Do CDS request
2025-10-01T14:08:04.682876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:04.682968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:04.682368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:04.682387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254869804266149:5085]
2025-10-01T14:08:04.682415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:04.682418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:04.682446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 432 reason: error at write: Disconnected sessionId: src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0
2025-10-01T14:08:04.682621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 432 sessionId: src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0 is DEAD
2025-10-01T14:08:04.693489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.693565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:04.693583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 433
2025-10-01T14:08:04.694595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.694646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:04.694652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:04.694657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:04.695157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 433 sessionId:  describe result for acl check
2025-10-01T14:08:04.695194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:04.695201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:04.695202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:04.695217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254869804266253:5281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:04.695751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254869804266253:5281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:04.701057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:04.698508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254869804266253:5281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:04.704225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:04.704411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254869804266253:5281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:04.704426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254869804266253:5281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:04.704430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254869804266253:5281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:04.704437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:04.704495Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:04.704507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:04.704533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:04.704606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:04.704647Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254867427404008:4777]
2025-10-01T14:08:04.705258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:04.705589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:04.705657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:04.705952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:04.706002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.706006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.706007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.706008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.706009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.706009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.706010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.706011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.706012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.706012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.706013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.706014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.706015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.706016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.706019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.706026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.706028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.706030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.706033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.706035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.706037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.706040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.706042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.706044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.706046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.706059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.706063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.706067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.706072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.706080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.706086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.706092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.706098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.706107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.706111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.706120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.706129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.706132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.706137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.706141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.706143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.706146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.706152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.706155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.706158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.706161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.706164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.706167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.706169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.706175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.706177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.706180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.706185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.706188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.706191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.706196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.706217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:04.710278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:04.711152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:04.711171Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:04.711173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:04.711177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:04.711185Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 432 [2:7556254867427404008:4777]
2025-10-01T14:08:04.711201Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:04.711219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:04.711222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.711226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.711229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.711247Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:04.711259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:04.711264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:04.711337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.711346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.711348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.711351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:04.711353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:04.711427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:04.711439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.711452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.711461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.711477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:04.711495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254867427404003:4777]
2025-10-01T14:08:04.711498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254867427404003:4777]
2025-10-01T14:08:04.711499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254867427404003:4777]
2025-10-01T14:08:04.711507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:04.711517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:04.711520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:04.711522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:04.711528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804266154:2446], now have 1 active actors on pipe
2025-10-01T14:08:04.711534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804266407:5281], now have 1 active actors on pipe
2025-10-01T14:08:04.711539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:04.711553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:04.711556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:04.711598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254867427404003:4777]
2025-10-01T14:08:04.711609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:04.711651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:04.711840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 432
2025-10-01T14:08:04.711882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 432
2025-10-01T14:08:04.712039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.712050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.712081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:04.712089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.712094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.712096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:04.712108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.712120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:04.712134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.712326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.712342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.712366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.712450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 433 partition: 0 MaxSeqNo: 45 sessionId: src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0
2025-10-01T14:08:04.712858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebbeb682-e1c4aa86-ffedd702-dc9d3700_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:04.718134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0] Write session: try to update token
2025-10-01T14:08:04.718156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:04.735101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:04.735118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:04.735121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:04.735123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:04.735133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254867427404003:4777]
2025-10-01T14:08:04.735137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254867427404003:4777]
2025-10-01T14:08:04.735141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254867427404003:4777]
2025-10-01T14:08:04.735195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:04.735206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.735208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:04.735338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:04.738523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:04.738540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:04.738544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:04.740261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 433 sessionId: src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:04.743082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:04.783699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254869804266419:5085]
2025-10-01T14:08:04.784537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 432, pipe: [1:7556254869804266419:5085]
2025-10-01T14:08:04.886791Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:04.887407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.887424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.887467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804266419:5085], now have 1 active actors on pipe
2025-10-01T14:08:04.887699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254869804266419:5085]
2025-10-01T14:08:04.887675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:04.887730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:04.887732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:04.887790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 433 reason: error at write: Disconnected sessionId: src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0
2025-10-01T14:08:04.887960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 433 sessionId: src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0 is DEAD
2025-10-01T14:08:04.887971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:04.890613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:04.890627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0] Write session will restart in 0.009300s
2025-10-01T14:08:04.890658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0] Write session: Do CDS request
2025-10-01T14:08:04.890664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:04.903586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.904250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:04.904267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 434
2025-10-01T14:08:04.904472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:04.904502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:04.904507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:04.904511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:04.904954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 434 sessionId:  describe result for acl check
2025-10-01T14:08:04.904990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:04.904992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:04.904993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:04.904999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254869804266639:5285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:04.905543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254869804266639:5285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:04.906519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:04.911188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:04.911497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:04.911510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:04.911523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:04.911587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:04.911630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254867427404267:4779]
2025-10-01T14:08:04.912245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:04.912752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:04.912810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:04.913158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:04.913242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.913248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.913249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.913250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.913252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.913253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.913255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.913256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.913257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.913258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.913259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.913260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.913263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.913264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.913269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.913280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.913284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.913287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.913291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.913294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.913298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.913301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.913304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.913308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.913311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.913314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.913317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.913321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.913328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.913335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:04.913342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.913347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:04.913351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.913356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:04.913360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.913365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:04.913369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.913374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:04.913377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.913381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:04.913388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.913394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:04.913402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.913408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:04.913417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.913423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:04.913430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.913435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.913443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.913450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.913454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.913458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.913462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.913465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:04.913469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.913473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:04.913530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:04.913253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254869804266639:5285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:04.917672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:04.917718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254869804266639:5285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:04.917732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254869804266639:5285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:04.917735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254869804266639:5285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:04.917744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:04.918289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:04.918302Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:04.918305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:04.918308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:04.918315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 433 [2:7556254867427404267:4779]
2025-10-01T14:08:04.918331Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:04.918347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:04.918350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.918354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.918356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.918388Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:04.918400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:04.918406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:04.918457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.918463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.918465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.918468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:04.918469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:04.918520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:04.918525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.918533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:04.918539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:04.918548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:04.918565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804266422:2446], now have 1 active actors on pipe
2025-10-01T14:08:04.918574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254867427404261:4779]
2025-10-01T14:08:04.918576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254867427404261:4779]
2025-10-01T14:08:04.918578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254867427404261:4779]
2025-10-01T14:08:04.918584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:04.918594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:04.918598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:04.918601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:04.918603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:04.918606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:04.918608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:04.918635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254867427404261:4779]
2025-10-01T14:08:04.918645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:04.918660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:04.919454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 433
2025-10-01T14:08:04.920321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804266679:5285], now have 1 active actors on pipe
2025-10-01T14:08:04.920372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 433
2025-10-01T14:08:04.920506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.920519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.920548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:04.920563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:04.920573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:04.920576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:04.920590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:04.920607Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:04.920628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.920873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:04.920886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:04.920911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:04.921016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 434 partition: 0 MaxSeqNo: 45 sessionId: src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0
2025-10-01T14:08:04.921722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc45f31b-ca25b46b-ca5baf8a-52eec014_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:04.924712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0] Write session: try to update token
2025-10-01T14:08:04.924732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:04.942957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:04.942980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:04.942982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:04.942984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:04.942995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254867427404261:4779]
2025-10-01T14:08:04.942999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254867427404261:4779]
2025-10-01T14:08:04.943007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254867427404261:4779]
2025-10-01T14:08:04.943059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:04.943063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:04.943066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:04.943069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:04.943070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:04.943075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:04.943220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:04.945812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 434 sessionId: src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:04.948941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:04.987944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254869804266688:5085]
2025-10-01T14:08:04.988244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 433, pipe: [1:7556254869804266688:5085]
2025-10-01T14:08:05.116554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:05.116828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.116844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.116886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254869804266688:5085], now have 1 active actors on pipe
2025-10-01T14:08:05.117091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:05.117143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:05.117156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:05.117225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 434 reason: error at write: Disconnected sessionId: src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0
2025-10-01T14:08:05.117407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 434 sessionId: src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0 is DEAD
2025-10-01T14:08:05.117554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254869804266688:5085]
2025-10-01T14:08:05.117574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:05.118933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:05.118947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0] Write session will restart in 0.006137s
2025-10-01T14:08:05.118976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0] Write session: Do CDS request
2025-10-01T14:08:05.118981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:05.126892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:05.127241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:05.127262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 435
2025-10-01T14:08:05.127405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:05.127441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:05.127454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:05.127458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:05.128040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 435 sessionId:  describe result for acl check
2025-10-01T14:08:05.128083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:05.128091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:05.128094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:05.128100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254874099234013:5289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:05.128640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254874099234013:5289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:05.148112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254874099234013:5289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:05.154918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254874099234013:5289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:05.154935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254874099234013:5289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:05.154939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254874099234013:5289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:05.154947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:05.170922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:05.171917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:05.172123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:05.172127Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:05.172137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:05.172183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:05.172218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254871722371839:4781]
2025-10-01T14:08:05.172892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:05.173654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:05.173715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:05.174078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:05.174133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.174138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.174139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.174141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.174142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.174144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.174145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.174146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.174148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.174149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.174150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.174151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.174151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.174152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.174159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.174169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.174172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.174176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.174180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.174183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.174187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.174190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.174194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.174199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.174203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.174207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.174210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.174214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.174222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.174230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.174236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.174242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.174248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.174254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.174257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.174262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.174268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.174274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.174282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.174288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.174296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.174302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.174306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.174314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.174320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.174324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.174329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.174334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.174343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.174348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.174355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.174361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.174381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.174387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.174395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.174401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.174443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:05.178508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:05.179718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 434
2025-10-01T14:08:05.179763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 434
2025-10-01T14:08:05.179370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:05.179375Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:05.179376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:05.179378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:05.179383Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 434 [2:7556254871722371839:4781]
2025-10-01T14:08:05.179393Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:05.179407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:05.179409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.179412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.179413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.179426Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:05.179430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:05.179434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:05.179477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.179478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.179480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.179482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:05.179484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:05.179539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:05.179541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.179550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.179559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.179573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:05.179590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254871722371834:4781]
2025-10-01T14:08:05.179591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254871722371834:4781]
2025-10-01T14:08:05.179593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254871722371834:4781]
2025-10-01T14:08:05.179600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:05.179609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:05.179615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:05.179618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:05.179619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:05.179620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:05.179620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:05.179629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099233990:2446], now have 1 active actors on pipe
2025-10-01T14:08:05.179670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099234165:5289], now have 1 active actors on pipe
2025-10-01T14:08:05.179672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254871722371834:4781]
2025-10-01T14:08:05.179680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:05.179687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:05.179905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.179912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.179943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:05.179960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.179965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.179967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:05.179977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.179988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:05.180012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:05.180251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.180260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.180275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:05.180375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 435 partition: 0 MaxSeqNo: 45 sessionId: src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0
2025-10-01T14:08:05.180902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f1a9353-9493cec3-80d4d23a-892bf5ec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:05.183739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0] Write session: try to update token
2025-10-01T14:08:05.183760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:05.191621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:05.191641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:05.191651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254871722371834:4781]
2025-10-01T14:08:05.191695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:05.191701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:05.191857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:05.191992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:05.192128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:05.192267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:05.192462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:05.192509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:05.209875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 435 sessionId: src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:05.212498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:05.213357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:05.212963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.212992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.213022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:05.217826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254874099234278:5085]
2025-10-01T14:08:05.219559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 434, pipe: [1:7556254874099234278:5085]
2025-10-01T14:08:05.221163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:05.221181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:05.221185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:05.221188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:05.221201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254871722371834:4781]
2025-10-01T14:08:05.221205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254871722371834:4781]
2025-10-01T14:08:05.221209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254871722371834:4781]
2025-10-01T14:08:05.221257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:05.221266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:05.221270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:05.221282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099234278:5085], now have 1 active actors on pipe
2025-10-01T14:08:05.221293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:05.221299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.221302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:05.221438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:05.425700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:05.434075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.434112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.434296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.438129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:05.438145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0] Write session will restart in 0.009176s
2025-10-01T14:08:05.438174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0] Write session: Do CDS request
2025-10-01T14:08:05.438180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:05.434386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.437482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254874099234278:5085]
2025-10-01T14:08:05.437521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:05.437559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:05.437562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:05.437590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 435 reason: error at write: Disconnected sessionId: src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0
2025-10-01T14:08:05.437800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 435 sessionId: src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0 is DEAD
2025-10-01T14:08:05.434460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.434522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.434566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.434570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.434648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.434710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.434772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.434831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.434875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.434878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.434939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.434990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.435046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.435102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.435140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.435143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.435209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.435268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.435326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.435382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.435423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.435426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.435493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.435551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.435610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.435674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.435716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.435719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.435786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.435841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.435895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.435953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.435995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.435998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.436060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.436113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.436167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.436223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.436263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.436266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.436331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.436387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.436441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.436499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.436540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.436543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.436608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.436662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.436719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.436781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.436837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.436841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.436910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.436970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.437030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.437087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.437136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.437139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.438478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:05.450863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:05.451292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:05.451309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 436
2025-10-01T14:08:05.451539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:05.451575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:05.451584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:05.451587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:05.452010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 436 sessionId:  describe result for acl check
2025-10-01T14:08:05.452044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:05.452046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:05.452048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:05.452054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254874099234375:5302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:05.452587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254874099234375:5302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:05.457984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254874099234375:5302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:05.462594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254874099234375:5302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:05.462611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254874099234375:5302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:05.462614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254874099234375:5302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:05.462622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:05.478445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:05.481408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:05.481708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:05.481717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:05.481728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:05.481772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:05.481815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254871722372111:4787]
2025-10-01T14:08:05.482228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:05.482603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:05.482664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:05.482980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:05.483053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.483062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.483063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.483065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.483066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.483068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.483069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.483071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.483072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.483073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.483074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.483075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.483076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.483077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.483084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.483094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.483098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.483102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.483106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.483110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.483114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.483118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.483121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.483125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.483129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.483132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.483135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.483139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.483148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.483156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.483170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.483176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.483187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.483192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.483197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.483202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.483207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.483212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.483217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.483224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.483229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.483240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.483244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.483249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.483253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.483273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.483278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.483283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.483293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.483298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.483304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.483309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.483318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.483323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.483328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.483334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.483370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:05.487980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:05.488597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:05.488611Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:05.488613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:05.488616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:05.488623Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 435 [2:7556254871722372111:4787]
2025-10-01T14:08:05.488640Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:05.488660Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:05.488662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.488666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.488669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.488686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:05.488696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:05.488701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:05.488748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.488755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.488757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.488761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:05.488763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:05.488853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:05.488860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.488875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.488891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.488911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:05.488934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254871722372105:4787]
2025-10-01T14:08:05.488939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254871722372105:4787]
2025-10-01T14:08:05.488942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254871722372105:4787]
2025-10-01T14:08:05.488957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:05.488972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:05.488992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:05.488995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:05.489038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254871722372105:4787]
2025-10-01T14:08:05.489045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:05.489169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:05.489175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:05.489177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:05.489182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:05.489577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 435
2025-10-01T14:08:05.489625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 435
2025-10-01T14:08:05.489727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099234309:2446], now have 1 active actors on pipe
2025-10-01T14:08:05.489739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099234539:5302], now have 1 active actors on pipe
2025-10-01T14:08:05.489759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.489769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.489797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:05.489811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.489819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.489822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:05.489833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.489850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:05.489870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:05.490082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.490094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.490112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:05.490202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 436 partition: 0 MaxSeqNo: 45 sessionId: src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0
2025-10-01T14:08:05.490700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5a21e4-1e6e80e8-c630120e-d7e59978_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:05.493596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0] Write session: try to update token
2025-10-01T14:08:05.493617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:05.512215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:05.512227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:05.512229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:05.512231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:05.512240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254871722372105:4787]
2025-10-01T14:08:05.512245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254871722372105:4787]
2025-10-01T14:08:05.512249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254871722372105:4787]
2025-10-01T14:08:05.512298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:05.512302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:05.512304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:05.512308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:05.512309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.512312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:05.512445Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:05.513941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 436 sessionId: src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:05.516506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:05.534772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254874099234578:5085]
2025-10-01T14:08:05.535083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 435, pipe: [1:7556254874099234578:5085]
2025-10-01T14:08:05.669446Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:05.670258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.670274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.670318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099234578:5085], now have 1 active actors on pipe
2025-10-01T14:08:05.670561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:05.670575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:05.670633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254874099234578:5085]
2025-10-01T14:08:05.670656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:05.670725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 436 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0
2025-10-01T14:08:05.670929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 436 sessionId: src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0 is DEAD
2025-10-01T14:08:05.671093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:05.671105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0] Write session will restart in 0.005349s
2025-10-01T14:08:05.671134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0] Write session: Do CDS request
2025-10-01T14:08:05.671139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:05.677955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:05.678057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:05.678074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 437
2025-10-01T14:08:05.678226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:05.678264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:05.678273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:05.678278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:05.678725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 437 sessionId:  describe result for acl check
2025-10-01T14:08:05.678756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:05.678764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:05.678765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:05.678771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254874099234597:5307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:05.679336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254874099234597:5307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:05.686103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254874099234597:5307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:05.689157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254874099234597:5307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:05.689178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254874099234597:5307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:05.689181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254874099234597:5307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:05.689190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:05.690315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:05.697315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:05.697576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:05.697586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:05.697597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:05.697647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:05.697684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254871722372405:4800]
2025-10-01T14:08:05.698312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:05.698670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:05.698719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:05.699020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:05.699082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.699088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.699089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.699090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.699091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.699093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.699094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.699095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.699097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.699098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.699099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.699101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.699102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.699103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.699109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.699128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.699132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.699136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.699140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.699144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.699148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.699151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.699155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.699159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.699163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.699167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.699171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.699174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.699183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.699191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:05.699197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.699202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:05.699206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.699210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:05.699214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.699218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:05.699222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.699227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:05.699230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.699235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:05.699240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.699245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:05.699258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.699263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:05.699267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.699271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:05.699280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.699285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.699293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.699298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.699304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.699313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.699317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.699326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:05.699330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.699339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:05.699380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:05.703807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:05.704488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:05.704503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:05.704506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:05.704510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:05.704518Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 436 [2:7556254871722372405:4800]
2025-10-01T14:08:05.704535Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:05.704554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:05.704561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.704567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.704570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.704588Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:05.704598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:05.704605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:05.704675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.704682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.704684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.704687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:05.704690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:05.704761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:05.704768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.704779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:05.704791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:05.704823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:05.704845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254871722372400:4800]
2025-10-01T14:08:05.704851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254871722372400:4800]
2025-10-01T14:08:05.704853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254871722372400:4800]
2025-10-01T14:08:05.704865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:05.704885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:05.704889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:05.704892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:05.704894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:05.704899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:05.704902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:05.704914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099234839:5307], now have 1 active actors on pipe
2025-10-01T14:08:05.704956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099234583:2446], now have 1 active actors on pipe
2025-10-01T14:08:05.704964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254871722372400:4800]
2025-10-01T14:08:05.704975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:05.705007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 436
2025-10-01T14:08:05.705054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 436
2025-10-01T14:08:05.705048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:05.705247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.705257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.705290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58931bf4-3dde4499-5d242159-f19e9881_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:05.705307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:05.705311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:05.705322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:05.705336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:05.705350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:05.705384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:05.705607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.705617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.705640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:05.705723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 437 partition: 0 MaxSeqNo: 45 sessionId: src_id|58931bf4-3dde4499-5d242159-f19e9881_0
2025-10-01T14:08:05.706133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1928b35-5f5afcfc-c2d7ddeb-fc63c8a9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58931bf4-3dde4499-5d242159-f19e9881_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:05.710974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58931bf4-3dde4499-5d242159-f19e9881_0] Write session: try to update token
2025-10-01T14:08:05.710996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58931bf4-3dde4499-5d242159-f19e9881_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:05.718704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:05.718725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:05.718735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254871722372400:4800]
2025-10-01T14:08:05.718784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:05.718953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:05.719084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:05.719215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:05.719335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:05.719531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:05.719565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:05.719757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:05.734342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 437 sessionId: src_id|58931bf4-3dde4499-5d242159-f19e9881_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:05.744451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:05.745261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.745287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.745329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:05.745450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:05.753588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:05.753607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:05.753609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:05.753611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:05.753621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254871722372400:4800]
2025-10-01T14:08:05.753625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254871722372400:4800]
2025-10-01T14:08:05.753628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254871722372400:4800]
2025-10-01T14:08:05.753680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:05.753681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:05.753686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:05.753689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:05.753692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:05.753694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:05.753839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:05.774559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254874099234855:5085]
2025-10-01T14:08:05.775250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 436, pipe: [1:7556254874099234855:5085]
2025-10-01T14:08:05.974746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:05.985440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:05.985469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:05.985666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.985727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.985789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.985849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.985891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.985897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.985969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.986039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.986099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.986167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.986210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.986213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.986283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.986344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.986561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.986621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.986658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.986661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.986738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.986794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.986847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.986905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.986946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.986949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.987015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.987067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.987118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.987173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.987212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.987216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.987284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.987342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.987395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.987452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.987491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.987493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.987558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.987613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.987676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.987739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.987780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.987783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.987847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.987900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.987951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.988024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.988066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.988069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.988132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.988184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.988237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.988298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.988339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.988342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.988412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:05.988467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:05.988522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:05.988578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:05.988621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:05.988624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:05.988696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099234855:5085], now have 1 active actors on pipe
2025-10-01T14:08:05.990196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:05.991196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:05.991246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 437 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58931bf4-3dde4499-5d242159-f19e9881_0
2025-10-01T14:08:05.991454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 437 sessionId: src_id|58931bf4-3dde4499-5d242159-f19e9881_0 is DEAD
2025-10-01T14:08:05.991799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:05.991843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254874099234855:5085]
2025-10-01T14:08:05.992231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58931bf4-3dde4499-5d242159-f19e9881_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:05.992239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58931bf4-3dde4499-5d242159-f19e9881_0] Write session will restart in 0.005554s
2025-10-01T14:08:05.992263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58931bf4-3dde4499-5d242159-f19e9881_0] Write session: Do CDS request
2025-10-01T14:08:05.992270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58931bf4-3dde4499-5d242159-f19e9881_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:05.999155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58931bf4-3dde4499-5d242159-f19e9881_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:05.999310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:05.999330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 438
2025-10-01T14:08:06.004086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:06.004141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:06.004145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:06.004150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:06.012181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 438 sessionId:  describe result for acl check
2025-10-01T14:08:06.012225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:06.012227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:06.012230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:06.012235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254878394202194:5311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:06.012646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254878394202194:5311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:06.024355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254878394202194:5311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:06.035426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254878394202194:5311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:06.035442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254878394202194:5311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:06.035446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254878394202194:5311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:06.035455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:06.047779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:06.051993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:06.052259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:06.052269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:06.052281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:06.052337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:06.052377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254876017339966:4802]
2025-10-01T14:08:06.053007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:06.053410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:06.053465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:06.053838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:06.053896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.053897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.053898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.053899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.053901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.053902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.053904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.053905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.053907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.053908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.053909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.053911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.053912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.053914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.053919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.053930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.053934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.053938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.053942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.053946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.053949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.053953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.053956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.053960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.053964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.053968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.053971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.053975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.053984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.053992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.053998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.054004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.054008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.054013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.054018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.054023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.054029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.054034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.054038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.054043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.054047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.054052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.054057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.054062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.054066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.054071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.054077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.054082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.054086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.054091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.054095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.054102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.054107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.054112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.054116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.054122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.054160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:06.060959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:06.061603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:06.061609Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:06.061612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:06.061616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:06.061624Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 437 [2:7556254876017339966:4802]
2025-10-01T14:08:06.061642Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:06.061661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:06.061665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.061670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.061672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.061690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:06.061696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:06.061703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:06.061768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.061770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.061773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.061776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:06.061779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:06.061851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:06.061854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.061866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.061876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.061891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:06.061908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254876017339960:4802]
2025-10-01T14:08:06.061912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254876017339960:4802]
2025-10-01T14:08:06.061913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254876017339960:4802]
2025-10-01T14:08:06.061923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:06.061940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:06.061955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:06.061958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:06.061995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254876017339960:4802]
2025-10-01T14:08:06.061997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:06.062165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:06.062172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:06.062173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:06.062176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:06.062450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394202380:5311], now have 1 active actors on pipe
2025-10-01T14:08:06.062457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254874099234861:2446], now have 1 active actors on pipe
2025-10-01T14:08:06.062620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 437
2025-10-01T14:08:06.062650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 437
2025-10-01T14:08:06.062751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.062759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.062783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62ae3cf6-812d3608-670cd601-c8db55de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:06.062789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.062793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.062795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:06.062811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.062821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:06.062835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:06.063378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.063386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.063408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:06.063521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 438 partition: 0 MaxSeqNo: 45 sessionId: src_id|62ae3cf6-812d3608-670cd601-c8db55de_0
2025-10-01T14:08:06.066486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58931bf4-3dde4499-5d242159-f19e9881_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|62ae3cf6-812d3608-670cd601-c8db55de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:06.069083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62ae3cf6-812d3608-670cd601-c8db55de_0] Write session: try to update token
2025-10-01T14:08:06.069104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62ae3cf6-812d3608-670cd601-c8db55de_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:06.091311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254878394202422:5085]
2025-10-01T14:08:06.094177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394202422:5085], now have 1 active actors on pipe
2025-10-01T14:08:06.094176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 437, pipe: [1:7556254878394202422:5085]
2025-10-01T14:08:06.100214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 438 sessionId: src_id|62ae3cf6-812d3608-670cd601-c8db55de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:06.102967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:06.097947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:06.097965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:06.097968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:06.097970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:06.097980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254876017339960:4802]
2025-10-01T14:08:06.097985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254876017339960:4802]
2025-10-01T14:08:06.097989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254876017339960:4802]
2025-10-01T14:08:06.098041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:06.098049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.098051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:06.098209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:06.103174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:06.103180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:06.103183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:06.263905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:06.264366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.264384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.265234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254878394202422:5085]
2025-10-01T14:08:06.265261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:06.265294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:06.265300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:06.265353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 438 reason: error at write: Disconnected sessionId: src_id|62ae3cf6-812d3608-670cd601-c8db55de_0
2025-10-01T14:08:06.265537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 438 sessionId: src_id|62ae3cf6-812d3608-670cd601-c8db55de_0 is DEAD
2025-10-01T14:08:06.264939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:06.266717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ae3cf6-812d3608-670cd601-c8db55de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:06.266729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ae3cf6-812d3608-670cd601-c8db55de_0] Write session will restart in 0.005011s
2025-10-01T14:08:06.266757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ae3cf6-812d3608-670cd601-c8db55de_0] Write session: Do CDS request
2025-10-01T14:08:06.266766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ae3cf6-812d3608-670cd601-c8db55de_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:06.272946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62ae3cf6-812d3608-670cd601-c8db55de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:06.273345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:06.273359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 439
2025-10-01T14:08:06.274622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:06.274667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:06.274672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:06.274676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:06.275155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 439 sessionId:  describe result for acl check
2025-10-01T14:08:06.275191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:06.275197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:06.275199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:06.275204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254878394202482:5317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:06.275717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254878394202482:5317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:06.279683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254878394202482:5317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:06.284284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254878394202482:5317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:06.284300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254878394202482:5317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:06.284305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254878394202482:5317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:06.284314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:06.290164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:06.292966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:06.293210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:06.293219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:06.293231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:06.293282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:06.293320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254876017340245:4805]
2025-10-01T14:08:06.293918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:06.294276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:06.294334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:06.294684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:06.294754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.294763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.294764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.294766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.294767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.294768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.294769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.294770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.294771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.294772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.294774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.294775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.294776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.294777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.294783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.294793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.294797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.294801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.294804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.294809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.294813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.294816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.294820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.294825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.294828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.294831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.294835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.294839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.294847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.294855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.294861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.294865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.294871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.294876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.294880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.294885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.294890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.294896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.294900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.294906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.294912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.294916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.294920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.294925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.294930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.294936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.294940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.294945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.294950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.294955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.294960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.294965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.294970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.294975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.294980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.294985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.295028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:06.303269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:06.304012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:06.304028Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:06.304032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:06.304036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:06.304044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 438 [2:7556254876017340245:4805]
2025-10-01T14:08:06.304061Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:06.304079Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:06.304082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.304086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.304089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.304108Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:06.304114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:06.304120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:06.304181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.304187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.304189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.304193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:06.304195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:06.304267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:06.304275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.304287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.304298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.304317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:06.304340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394202607:5317], now have 1 active actors on pipe
2025-10-01T14:08:06.304353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254876017340240:4805]
2025-10-01T14:08:06.304356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254876017340240:4805]
2025-10-01T14:08:06.304358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254876017340240:4805]
2025-10-01T14:08:06.304370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:06.304383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394202451:2446], now have 1 active actors on pipe
2025-10-01T14:08:06.304383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:06.304389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:06.304391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:06.304396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:06.304410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:06.304418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:06.304461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254876017340240:4805]
2025-10-01T14:08:06.304472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:06.304481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:06.304475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 438
2025-10-01T14:08:06.304507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 438
2025-10-01T14:08:06.304657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.304673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.304707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:06.304723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.304732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.304735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:06.304745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.304760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:06.304786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:06.304967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.304980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.305002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:06.305102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 439 partition: 0 MaxSeqNo: 45 sessionId: src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0
2025-10-01T14:08:06.305446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62ae3cf6-812d3608-670cd601-c8db55de_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:06.307938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0] Write session: try to update token
2025-10-01T14:08:06.307953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:06.321486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:06.321506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:06.321516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254876017340240:4805]
2025-10-01T14:08:06.321563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:06.321562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:06.321769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:06.321947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:06.322114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:06.322279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:06.322529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:06.322575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:06.322858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 439 sessionId: src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:06.325608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:06.325871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.325891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.325924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:06.326002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:06.344975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:06.344994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:06.344996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:06.344998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:06.345006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254876017340240:4805]
2025-10-01T14:08:06.345009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254876017340240:4805]
2025-10-01T14:08:06.345012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254876017340240:4805]
2025-10-01T14:08:06.345053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:06.345059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:06.345061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:06.345062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:06.345068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.345070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:06.345200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:06.364220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254878394202750:5085]
2025-10-01T14:08:06.364564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 438, pipe: [1:7556254878394202750:5085]
2025-10-01T14:08:06.493669Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:06.502576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.502610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.502809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.502885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.502963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.503029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.503076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.503081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.503165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.503227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.503299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.503371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.503416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.503420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.503492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.503559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.503628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.503692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.503738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.503742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.503819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.503881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.503942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.504004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.504046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.504049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.504124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.504184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.504244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.504304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.504347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.504349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.504407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.504455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.504510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.504565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.504608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.504610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.504672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.504721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.504775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.504843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.504881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.504884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.504944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.504996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.505055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.505119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.505157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.505159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.505219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.505269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.506046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254878394202750:5085]
2025-10-01T14:08:06.505320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.506062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:06.506066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:06.506076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:06.505376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.506094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 439 reason: error at write: Disconnected sessionId: src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0
2025-10-01T14:08:06.505421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.505423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.505480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.505530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.505588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.505647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.505686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.505688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.505750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394202750:5085], now have 1 active actors on pipe
2025-10-01T14:08:06.506285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 439 sessionId: src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0 is DEAD
2025-10-01T14:08:06.506608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:06.506631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0] Write session will restart in 0.006781s
2025-10-01T14:08:06.506657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0] Write session: Do CDS request
2025-10-01T14:08:06.506664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:06.507113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:06.514916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:06.515031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:06.515046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 440
2025-10-01T14:08:06.515222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:06.515267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:06.515274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:06.515278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:06.515737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 440 sessionId:  describe result for acl check
2025-10-01T14:08:06.515781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:06.515783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:06.515785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:06.515789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254878394202777:5328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:06.516330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254878394202777:5328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:06.519190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254878394202777:5328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:06.523086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254878394202777:5328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:06.523101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254878394202777:5328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:06.523105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254878394202777:5328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:06.523113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:06.527514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:06.530610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:06.530868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:06.530882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:06.530897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:06.530962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:06.531002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254876017340518:4810]
2025-10-01T14:08:06.531576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:06.531941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:06.532001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:06.532368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:06.532449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.532454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.532455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.532456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.532457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.532458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.532459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.532460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.532461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.532463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.532464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.532465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.532466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.532467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.532473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.532482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.532485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.532488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.532492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.532496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.532499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.532502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.532505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.532509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.532512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.532515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.532519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.532522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.532529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.532536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.532542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.532546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.532550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.532554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.532557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.532562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.532566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.532570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.532575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.532579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.532584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.532588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.532592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.532596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.532600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.532605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.532610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.532614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.532617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.532622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.532625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.532630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.532633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.532638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.532641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.532645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.532679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:06.536598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:06.537668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:06.537684Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:06.537686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:06.538104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 439
2025-10-01T14:08:06.538105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 439
2025-10-01T14:08:06.537690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:06.537696Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 439 [2:7556254876017340518:4810]
2025-10-01T14:08:06.537713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:06.537730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:06.537734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.537737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.537740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.537758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:06.537763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:06.537770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:06.537832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.537834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.537836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.537839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:06.537841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:06.537913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:06.537916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.537928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.537939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.537954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:06.537971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394202753:2446], now have 1 active actors on pipe
2025-10-01T14:08:06.537975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394202936:5328], now have 1 active actors on pipe
2025-10-01T14:08:06.537982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254876017340513:4810]
2025-10-01T14:08:06.537984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254876017340513:4810]
2025-10-01T14:08:06.537986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254876017340513:4810]
2025-10-01T14:08:06.537998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:06.538009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:06.538015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:06.538018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:06.538020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:06.538023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:06.538026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:06.538060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254876017340513:4810]
2025-10-01T14:08:06.538065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:06.538070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:06.538164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.538169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.538194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|514049e2-971d8603-f426bde4-b0508567_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:06.538202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.538206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.538208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:06.538216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.538225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:06.538240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:06.538530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.538543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.538562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:06.538678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 440 partition: 0 MaxSeqNo: 45 sessionId: src_id|514049e2-971d8603-f426bde4-b0508567_0
2025-10-01T14:08:06.539113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5f8451a-288c73de-9e43ad36-a995b9fd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|514049e2-971d8603-f426bde4-b0508567_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:06.541745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514049e2-971d8603-f426bde4-b0508567_0] Write session: try to update token
2025-10-01T14:08:06.541771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514049e2-971d8603-f426bde4-b0508567_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:06.561878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 440 sessionId: src_id|514049e2-971d8603-f426bde4-b0508567_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:06.564664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.564691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.564729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:06.564462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:06.564792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:06.568220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:06.568240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:06.568242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:06.568244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:06.568255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254876017340513:4810]
2025-10-01T14:08:06.568260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254876017340513:4810]
2025-10-01T14:08:06.568265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254876017340513:4810]
2025-10-01T14:08:06.568316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:06.568321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:06.568327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:06.568329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.568332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:06.568331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:06.568471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:06.605807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254878394203026:5085]
2025-10-01T14:08:06.606081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 439, pipe: [1:7556254878394203026:5085]
2025-10-01T14:08:06.717555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:06.726043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.726075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.726255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.726325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.726409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.726477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.726529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.726538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.726614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.726675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.726738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.726805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.726858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.726866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.726926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.726986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.727048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.727112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.727159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.727162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.727228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.727295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.727381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.727442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.727489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.727497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.727567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.727625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.727688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.727748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.727793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.727798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.727858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.727918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.727993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.728066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.728115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.728123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.728189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.728247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.728314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.728377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.728425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.728432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.728492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.728553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.728614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.728683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.728730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.728740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.728824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.728888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.728954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.729020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.729076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.729084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.729160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:06.729223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:06.729293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:06.729362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:06.729401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:06.729408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:06.729473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394203026:5085], now have 1 active actors on pipe
2025-10-01T14:08:06.729713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:06.729733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:06.729737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:06.729759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254878394203026:5085]
2025-10-01T14:08:06.729764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 440 reason: error at write: Disconnected sessionId: src_id|514049e2-971d8603-f426bde4-b0508567_0
2025-10-01T14:08:06.729969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 440 sessionId: src_id|514049e2-971d8603-f426bde4-b0508567_0 is DEAD
2025-10-01T14:08:06.730134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514049e2-971d8603-f426bde4-b0508567_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:06.730146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514049e2-971d8603-f426bde4-b0508567_0] Write session will restart in 0.007225s
2025-10-01T14:08:06.730167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514049e2-971d8603-f426bde4-b0508567_0] Write session: Do CDS request
2025-10-01T14:08:06.730172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514049e2-971d8603-f426bde4-b0508567_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:06.730647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:06.738979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514049e2-971d8603-f426bde4-b0508567_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:06.739065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:06.739079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 441
2025-10-01T14:08:06.739284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:06.739332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:06.739341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:06.739347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:06.739718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 441 sessionId:  describe result for acl check
2025-10-01T14:08:06.739762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:06.739769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:06.739770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:06.739776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254878394203092:5333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:06.740212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254878394203092:5333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:06.743398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254878394203092:5333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:06.745866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254878394203092:5333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:06.745880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254878394203092:5333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:06.745884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254878394203092:5333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:06.745892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:06.746857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:06.749763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:06.750036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:06.750049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:06.750061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:06.750116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:06.750158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254876017340816:4823]
2025-10-01T14:08:06.750806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:06.751149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:06.751198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:06.751511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:06.751569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.751575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.751576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.751577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.751579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.751580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.751581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.751582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.751584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.751585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.751586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.751587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.751589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.751590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.751595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.751606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.751610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.751614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.751617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.751621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.751625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.751628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.751633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.751637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.751640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.751643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.751647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.751651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.751658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.751672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.751682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.751693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.751697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.751703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.751707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.751717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.751721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.751730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.751734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.751739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.751748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.751754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.751763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.751768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.751776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.751781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.751792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.751796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.751800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.751808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.751812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.751816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.751825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.751831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.751838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.751842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.751881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:06.755914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:06.756556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:06.756576Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:06.756578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:06.756582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:06.756589Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 440 [2:7556254876017340816:4823]
2025-10-01T14:08:06.756606Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:06.756629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:06.756633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.756637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.756644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.756663Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:06.756673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:06.756680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:06.756743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.756750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.756753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.756756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:06.756759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:06.756839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:06.756847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.756859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.756875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.756896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:06.756918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394203030:2446], now have 1 active actors on pipe
2025-10-01T14:08:06.756925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394203290:5333], now have 1 active actors on pipe
2025-10-01T14:08:06.756933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254876017340811:4823]
2025-10-01T14:08:06.756936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254876017340811:4823]
2025-10-01T14:08:06.756938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254876017340811:4823]
2025-10-01T14:08:06.756951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:06.756959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:06.756962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:06.756964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:06.756969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:06.756947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 440
2025-10-01T14:08:06.756984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:06.756991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:06.756957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 440
2025-10-01T14:08:06.757044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.757052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.757067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254876017340811:4823]
2025-10-01T14:08:06.757079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:06.757085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:06.757114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8139aea-cdbc087-960732c6-5bb21060_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:06.757126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:06.757136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:06.757139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:06.757148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:06.757156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:06.757184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:06.757329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.757337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.757350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:06.757425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 441 partition: 0 MaxSeqNo: 45 sessionId: src_id|a8139aea-cdbc087-960732c6-5bb21060_0
2025-10-01T14:08:06.757834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514049e2-971d8603-f426bde4-b0508567_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a8139aea-cdbc087-960732c6-5bb21060_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:06.761065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8139aea-cdbc087-960732c6-5bb21060_0] Write session: try to update token
2025-10-01T14:08:06.761087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8139aea-cdbc087-960732c6-5bb21060_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:06.776875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 441 sessionId: src_id|a8139aea-cdbc087-960732c6-5bb21060_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:06.778014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:06.778037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:06.778039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:06.778041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:06.778050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254876017340811:4823]
2025-10-01T14:08:06.778055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254876017340811:4823]
2025-10-01T14:08:06.778058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254876017340811:4823]
2025-10-01T14:08:06.778101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:06.778105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:06.778108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:06.778113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:06.778120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.778122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:06.778265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:06.779350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:06.830105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254878394203304:5085]
2025-10-01T14:08:06.830413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 440, pipe: [1:7556254878394203304:5085]
2025-10-01T14:08:06.934499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:06.935066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:06.935078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:06.935124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394203304:5085], now have 1 active actors on pipe
2025-10-01T14:08:06.935574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:06.935753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:06.935832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 441 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8139aea-cdbc087-960732c6-5bb21060_0
2025-10-01T14:08:06.936046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 441 sessionId: src_id|a8139aea-cdbc087-960732c6-5bb21060_0 is DEAD
2025-10-01T14:08:06.936161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:06.936192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254878394203304:5085]
2025-10-01T14:08:06.942501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8139aea-cdbc087-960732c6-5bb21060_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:06.942515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8139aea-cdbc087-960732c6-5bb21060_0] Write session will restart in 0.005433s
2025-10-01T14:08:06.942546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8139aea-cdbc087-960732c6-5bb21060_0] Write session: Do CDS request
2025-10-01T14:08:06.942553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8139aea-cdbc087-960732c6-5bb21060_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:06.949143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8139aea-cdbc087-960732c6-5bb21060_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:06.951762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:06.951782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 442
2025-10-01T14:08:06.958442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:06.958506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:06.958513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:06.958518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:06.959384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 442 sessionId:  describe result for acl check
2025-10-01T14:08:06.959422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:06.959424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:06.959425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:06.959431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254878394203359:5337] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:06.959998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254878394203359:5337] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:06.963438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254878394203359:5337] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:06.967912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254878394203359:5337] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:06.967928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254878394203359:5337] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:06.967932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254878394203359:5337] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:06.967940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:06.981165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:06.986924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:06.987199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:06.987204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:06.987217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:06.987287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:06.987343Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254876017341085:4825]
2025-10-01T14:08:06.987981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:06.996020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:06.996132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:06.996532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:06.996595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.996596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.996597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.996598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.996600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.996602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.996603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.996605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.996606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.996607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.996608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.996610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.996611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.996612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.996619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.996630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.996634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.996638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.996642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.996646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.996651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.996654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.996658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.996662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.996666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.996670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.996674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.996678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.996687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.996695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:06.996703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.996709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:06.996714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.996718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:06.996724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.996729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:06.996736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.996741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:06.996746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.996751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:06.996757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.996762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:06.996768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.996773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:06.996779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.996785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:06.996789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.996810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:06.996816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.996822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:06.996827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.996832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:06.996839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.996844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:06.996849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.996854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:06.996900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:07.009228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:07.009898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:07.010382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 441
2025-10-01T14:08:07.009904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:07.009907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:07.010383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 441
2025-10-01T14:08:07.009911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:07.009919Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 441 [2:7556254876017341085:4825]
2025-10-01T14:08:07.009939Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:07.009959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:07.009963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.009967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.009969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.009988Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:07.009994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:07.010001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:07.010061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.010063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.010065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.010068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:07.010071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:07.010150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:07.010153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.010165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.010175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.010190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:07.010207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254876017341080:4825]
2025-10-01T14:08:07.010210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254876017341080:4825]
2025-10-01T14:08:07.010212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254876017341080:4825]
2025-10-01T14:08:07.010220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:07.010235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:07.010237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:07.010249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:07.010251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:07.010251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:07.010254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:07.010266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394203488:5337], now have 1 active actors on pipe
2025-10-01T14:08:07.010270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254878394203309:2446], now have 1 active actors on pipe
2025-10-01T14:08:07.010310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254876017341080:4825]
2025-10-01T14:08:07.010319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:07.010324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:07.010709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.010724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.010757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:07.010765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.010770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.010772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:07.010784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.010795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:07.010812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.011047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.011055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.011071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.011152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 442 partition: 0 MaxSeqNo: 45 sessionId: src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0
2025-10-01T14:08:07.011661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8139aea-cdbc087-960732c6-5bb21060_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:07.014659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0] Write session: try to update token
2025-10-01T14:08:07.014676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:07.036395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:07.036416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:07.036420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:07.036422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:07.036434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254876017341080:4825]
2025-10-01T14:08:07.036440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254876017341080:4825]
2025-10-01T14:08:07.036444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254876017341080:4825]
2025-10-01T14:08:07.036501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:07.036505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:07.036507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:07.036513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.036514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:07.036515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:07.036663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:07.036358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 442 sessionId: src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:07.036438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254882689170881:5085]
2025-10-01T14:08:07.036770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 441, pipe: [1:7556254882689170881:5085]
2025-10-01T14:08:07.039479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:07.196593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:07.197304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689170881:5085], now have 1 active actors on pipe
2025-10-01T14:08:07.197344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.197352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.197584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:07.198257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:07.198279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0] Write session will restart in 0.006969s
2025-10-01T14:08:07.197643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:07.198305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0] Write session: Do CDS request
2025-10-01T14:08:07.198312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:07.197651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254882689170881:5085]
2025-10-01T14:08:07.197658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:07.197669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:07.197745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 442 reason: error at write: Disconnected sessionId: src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0
2025-10-01T14:08:07.197930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 442 sessionId: src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0 is DEAD
2025-10-01T14:08:07.210940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:07.214280Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:07.214295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 443
2025-10-01T14:08:07.214579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:07.214618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:07.214622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:07.214626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:07.215157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 443 sessionId:  describe result for acl check
2025-10-01T14:08:07.215184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:07.215185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:07.215187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:07.215191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254882689171070:5345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:07.215675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254882689171070:5345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:07.218964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254882689171070:5345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:07.219200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:07.222886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254882689171070:5345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:07.222902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254882689171070:5345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:07.222905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254882689171070:5345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:07.222913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:07.222469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:07.222728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:07.222732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:07.222743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:07.222799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:07.222836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254880312308660:4828]
2025-10-01T14:08:07.223530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:07.224039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:07.224087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:07.224391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:07.224462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.224463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.224464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.224465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.224466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.224468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.224469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.224470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.224471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.224473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.224474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.224475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.224476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.224477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.224483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.224493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.224497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.224501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.224504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.224508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.224512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.224516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.224519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.224523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.224527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.224531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.224535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.224538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.224546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.224554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.224561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.224565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.224569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.224573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.224577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.224580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.224583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.224586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.224589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.224591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.224594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.224598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.224600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.224603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.224606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.224609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.224614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.224619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.224624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.224628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.224633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.224638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.224641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.224644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.224647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.224650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.224672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:07.229415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:07.230056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:07.230078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:07.230080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:07.230085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:07.230091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 442 [2:7556254880312308660:4828]
2025-10-01T14:08:07.230109Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:07.230127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:07.230131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.230135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.230137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.230155Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:07.230160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:07.230166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:07.230228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.230230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.230232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.230236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:07.230239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:07.230318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:07.230320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.230332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.230343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.230359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:07.230392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689170891:2446], now have 1 active actors on pipe
2025-10-01T14:08:07.230395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689171166:5345], now have 1 active actors on pipe
2025-10-01T14:08:07.230402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254880312308655:4828]
2025-10-01T14:08:07.230405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254880312308655:4828]
2025-10-01T14:08:07.230407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254880312308655:4828]
2025-10-01T14:08:07.230423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:07.230438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:07.230453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:07.230456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:07.230494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254880312308655:4828]
2025-10-01T14:08:07.230497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:07.230814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:07.230823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:07.230825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:07.230829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:07.231129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.231142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.231168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9df32bc-834437cd-5b580b6e-92422c98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:07.231177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.231181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.231184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:07.231193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.231204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:07.231220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.231782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.231795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.231816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.232331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54771096-dcf5bcb5-7fe7ff95-2bd526f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9df32bc-834437cd-5b580b6e-92422c98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:07.230501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 442
2025-10-01T14:08:07.230549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 442
2025-10-01T14:08:07.231933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 443 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9df32bc-834437cd-5b580b6e-92422c98_0
2025-10-01T14:08:07.234869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9df32bc-834437cd-5b580b6e-92422c98_0] Write session: try to update token
2025-10-01T14:08:07.234890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9df32bc-834437cd-5b580b6e-92422c98_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:07.250322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 443 sessionId: src_id|f9df32bc-834437cd-5b580b6e-92422c98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:07.252893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:07.253130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.253154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.253193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:07.253300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:07.260949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:07.260970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:07.260973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:07.260974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:07.260985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254880312308655:4828]
2025-10-01T14:08:07.260989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254880312308655:4828]
2025-10-01T14:08:07.260992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254880312308655:4828]
2025-10-01T14:08:07.261035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:07.261044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:07.261047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:07.261050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:07.261051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.261053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:07.261174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:07.297573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254882689171181:5085]
2025-10-01T14:08:07.297815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 442, pipe: [1:7556254882689171181:5085]
2025-10-01T14:08:07.416091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:07.424731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.424757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.424927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.424987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.425047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.425108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.425562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.425581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.425655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.425723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.425794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.425867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.425918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.425927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.425990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.426051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.426108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.426173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.426217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.426226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.426289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.426351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.426473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.426535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.426579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.426587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.426647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.428697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254882689171181:5085]
2025-10-01T14:08:07.428736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:07.428773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:07.428780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:07.428814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 443 reason: error at write: Disconnected sessionId: src_id|f9df32bc-834437cd-5b580b6e-92422c98_0
2025-10-01T14:08:07.429016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 443 sessionId: src_id|f9df32bc-834437cd-5b580b6e-92422c98_0 is DEAD
2025-10-01T14:08:07.429207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9df32bc-834437cd-5b580b6e-92422c98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:07.429218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9df32bc-834437cd-5b580b6e-92422c98_0] Write session will restart in 0.009213s
2025-10-01T14:08:07.429244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9df32bc-834437cd-5b580b6e-92422c98_0] Write session: Do CDS request
2025-10-01T14:08:07.429251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9df32bc-834437cd-5b580b6e-92422c98_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:07.426717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.426780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.426842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.426881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.426884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.426946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.427006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.427073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.427141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.427191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.427194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.427266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.427323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.427384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.427444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.427480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.427484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.427546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.427600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.427662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.427726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.427768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.427771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.427845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.427905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.427963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.428026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.428072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.428075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.428139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.428197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.428256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.428320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.428358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.428361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.428436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689171181:5085], now have 1 active actors on pipe
2025-10-01T14:08:07.429139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:07.439900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9df32bc-834437cd-5b580b6e-92422c98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:07.439946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:07.439963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 444
2025-10-01T14:08:07.440101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:07.440138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:07.440148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:07.440152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:07.440533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 444 sessionId:  describe result for acl check
2025-10-01T14:08:07.440568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:07.440570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:07.440572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:07.440586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254882689171287:5356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:07.441150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254882689171287:5356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:07.443817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254882689171287:5356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:07.446910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254882689171287:5356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:07.446925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254882689171287:5356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:07.446929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254882689171287:5356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:07.446937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:07.448103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:07.451036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:07.451281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:07.451291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:07.451302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:07.451349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:07.451388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254880312308939:4833]
2025-10-01T14:08:07.451993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:07.452384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:07.452448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:07.452809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:07.452874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.452881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.452882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.452883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.452885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.452886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.452888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.452889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.452890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.452892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.452893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.452895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.452896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.452897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.452904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.452915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.452918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.452922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.452926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.452930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.452934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.452938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.452942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.452947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.452951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.452955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.452959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.452962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.452969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.452978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.452984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.452990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.452999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.453005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.453009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.453016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.453021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.453030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.453034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.453039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.453044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.453049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.453053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.453057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.453066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.453071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.453075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.453080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.453092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.453098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.453102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.453108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.453115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.453120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.453124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.453132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.453166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:07.457214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:07.458352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:07.458385Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:07.458388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:07.458392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:07.458399Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 443 [2:7556254880312308939:4833]
2025-10-01T14:08:07.458415Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:07.458432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:07.458435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.458439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.458446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.458465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:07.458475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:07.458481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:07.458542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.458552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.458554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.458557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:07.458560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:07.458626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:07.458633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.458645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.458657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.458670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:07.458694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689171208:2446], now have 1 active actors on pipe
2025-10-01T14:08:07.458702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689171468:5356], now have 1 active actors on pipe
2025-10-01T14:08:07.458709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254880312308934:4833]
2025-10-01T14:08:07.458711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254880312308934:4833]
2025-10-01T14:08:07.458713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254880312308934:4833]
2025-10-01T14:08:07.458726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:07.458740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:07.458747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:07.458751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:07.458753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:07.458757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:07.458760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:07.458798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254880312308934:4833]
2025-10-01T14:08:07.458807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:07.458814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:07.459166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.459179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.459207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|daa84b18-9534802a-c793cd7e-2397bb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:07.459220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.459225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.459227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:07.459237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.459247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:07.459264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.459464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.459472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.459495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.460130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9df32bc-834437cd-5b580b6e-92422c98_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|daa84b18-9534802a-c793cd7e-2397bb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:07.458839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 443
2025-10-01T14:08:07.459008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 443
2025-10-01T14:08:07.459773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 444 partition: 0 MaxSeqNo: 45 sessionId: src_id|daa84b18-9534802a-c793cd7e-2397bb7_0
2025-10-01T14:08:07.462532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daa84b18-9534802a-c793cd7e-2397bb7_0] Write session: try to update token
2025-10-01T14:08:07.462550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daa84b18-9534802a-c793cd7e-2397bb7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:07.470126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:07.470146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:07.470157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254880312308934:4833]
2025-10-01T14:08:07.470205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:07.470211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:07.470403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:07.470541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:07.470686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:07.470828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:07.471020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:07.471063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:07.485395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.485417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.485452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:07.482784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 444 sessionId: src_id|daa84b18-9534802a-c793cd7e-2397bb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:07.485174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:07.485528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:07.490873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:07.490891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:07.490894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:07.490896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:07.490907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254880312308934:4833]
2025-10-01T14:08:07.490911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254880312308934:4833]
2025-10-01T14:08:07.490915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254880312308934:4833]
2025-10-01T14:08:07.490963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:07.490963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:07.490969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:07.490970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.490972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:07.490973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:07.491109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:07.529183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254882689171482:5085]
2025-10-01T14:08:07.529532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 443, pipe: [1:7556254882689171482:5085]
2025-10-01T14:08:07.645466Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:07.654009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.654045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.654236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.654331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.654433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.654525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.654586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.654592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.654676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.654749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.654823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.654899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.654947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.654950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.655044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.655121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.655200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.655284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.655332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.655335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.655434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.655520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.655596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.655676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.655726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.655729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.655822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.655903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.655984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.656058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.656104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.656107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.656201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.656276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.656359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.656433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.656482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.656487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.656555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.656611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.656668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.656728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.656774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.656777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.656860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.656923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.656987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.657052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.657093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.657098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.657173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.657234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.657298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.657362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.657401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.657404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.657474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:07.657528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:07.657587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:07.657645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:07.657684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:07.657687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:07.658448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689171482:5085], now have 1 active actors on pipe
2025-10-01T14:08:07.659667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:07.660053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:07.660110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 444 reason: status is not ok: tablet will be restarted right now sessionId: src_id|daa84b18-9534802a-c793cd7e-2397bb7_0
2025-10-01T14:08:07.660306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 444 sessionId: src_id|daa84b18-9534802a-c793cd7e-2397bb7_0 is DEAD
2025-10-01T14:08:07.660385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:07.660442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa84b18-9534802a-c793cd7e-2397bb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:07.660436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254882689171482:5085]
2025-10-01T14:08:07.660458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa84b18-9534802a-c793cd7e-2397bb7_0] Write session will restart in 0.008581s
2025-10-01T14:08:07.660486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa84b18-9534802a-c793cd7e-2397bb7_0] Write session: Do CDS request
2025-10-01T14:08:07.660492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa84b18-9534802a-c793cd7e-2397bb7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:07.669899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|daa84b18-9534802a-c793cd7e-2397bb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:07.671865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:07.671881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 445
2025-10-01T14:08:07.672081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:07.672112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:07.672120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:07.672124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:07.672525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 445 sessionId:  describe result for acl check
2025-10-01T14:08:07.672553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:07.672554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:07.672556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:07.672559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254882689171547:5361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:07.673037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254882689171547:5361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:07.677358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254882689171547:5361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:07.681516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254882689171547:5361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:07.681530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254882689171547:5361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:07.681533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254882689171547:5361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:07.681542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:07.686803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:07.689308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:07.689590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:07.689602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:07.689616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:07.689677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:07.689735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254880312309242:4841]
2025-10-01T14:08:07.690394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:07.691104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:07.691167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:07.691510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:07.691567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.691568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.691570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.691571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.691572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.691573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.691574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.691575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.691576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.691577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.691578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.691579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.691580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.691581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.691587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.691596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.691600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.691603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.691607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.691611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.691614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.691618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.691621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.691625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.691628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.691631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.691635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.691638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.691646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.691653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.691660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.691665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.691669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.691674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.691677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.691681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.691685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.691689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.691693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.691698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.691702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.691707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.691710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.691715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.691719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.691724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.691727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.691731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.691734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.691739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.691743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.691748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.691752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.691757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.691760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.691764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.691800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:07.700132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:07.700775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:07.700791Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:07.700793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:07.700811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:07.700820Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 444 [2:7556254880312309242:4841]
2025-10-01T14:08:07.700837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:07.700857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:07.700860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.700864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.700866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.700884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:07.700890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:07.700896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:07.700956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.700958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.700959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.700962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:07.700965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:07.701038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:07.701041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.701052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.701062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.701076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:07.701094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254880312309237:4841]
2025-10-01T14:08:07.701097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254880312309237:4841]
2025-10-01T14:08:07.701100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254880312309237:4841]
2025-10-01T14:08:07.701110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:07.701125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:07.701140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:07.701142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:07.701185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254880312309237:4841]
2025-10-01T14:08:07.701188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:07.701412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:07.701419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:07.701421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:07.701427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:07.702134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 444
2025-10-01T14:08:07.702176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 444
2025-10-01T14:08:07.702475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689171487:2446], now have 1 active actors on pipe
2025-10-01T14:08:07.702490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689171750:5361], now have 1 active actors on pipe
2025-10-01T14:08:07.702513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.702519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.702548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:07.702558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.702564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.702566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:07.702577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.702589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:07.702608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.704625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.704642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.704680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.704829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 445 partition: 0 MaxSeqNo: 45 sessionId: src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0
2025-10-01T14:08:07.705211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|daa84b18-9534802a-c793cd7e-2397bb7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:07.707856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0] Write session: try to update token
2025-10-01T14:08:07.707878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:07.726061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:07.726080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:07.726083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:07.726085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:07.726096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254880312309237:4841]
2025-10-01T14:08:07.726101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254880312309237:4841]
2025-10-01T14:08:07.726105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254880312309237:4841]
2025-10-01T14:08:07.726152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:07.726155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:07.726161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.726164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:07.726164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:07.726167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:07.726311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:07.727775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 445 sessionId: src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:07.730477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:07.760416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254882689171764:5085]
2025-10-01T14:08:07.760711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 444, pipe: [1:7556254882689171764:5085]
2025-10-01T14:08:07.876254Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:07.876896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.876913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.876958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689171764:5085], now have 1 active actors on pipe
2025-10-01T14:08:07.877137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:07.877178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:07.877193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:07.877196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:07.877235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254882689171764:5085]
2025-10-01T14:08:07.877250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 445 reason: error at write: Disconnected sessionId: src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0
2025-10-01T14:08:07.877433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 445 sessionId: src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0 is DEAD
2025-10-01T14:08:07.877555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:07.877565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0] Write session will restart in 0.008568s
2025-10-01T14:08:07.877592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0] Write session: Do CDS request
2025-10-01T14:08:07.877598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:07.886912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:07.886994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:07.887009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 446
2025-10-01T14:08:07.887119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:07.887154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:07.887164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:07.887168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:07.887583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 446 sessionId:  describe result for acl check
2025-10-01T14:08:07.887613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:07.887619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:07.887622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:07.887628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254882689171816:5365] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:07.888075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254882689171816:5365] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:07.891073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254882689171816:5365] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:07.894492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254882689171816:5365] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:07.894507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254882689171816:5365] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:07.894511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254882689171816:5365] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:07.894519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:07.896994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:07.899675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:07.899919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:07.899931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:07.899944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:07.900007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:07.900048Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254880312309513:4848]
2025-10-01T14:08:07.900648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:07.900973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:07.901021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:07.901340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:07.901413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.901420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.901421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.901422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.901423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.901425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.901426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.901427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.901428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.901430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.901431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.901432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.901433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.901434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.901441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.901451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.901455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.901459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.901463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.901467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.901470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.901473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.901477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.901480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.901484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.901487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.901491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.901495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.901504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.901512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:07.901518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.901529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:07.901534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.901544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:07.901549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.901558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:07.901562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.901567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:07.901577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.901587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:07.901591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.901601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:07.901605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.901612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:07.901617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.901627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:07.901631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.901638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.901642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.901648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.901652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.901657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.901661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.901666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:07.901671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.901680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:07.901719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:07.905470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:07.906069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:07.906085Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:07.906087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:07.906091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:07.906099Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 445 [2:7556254880312309513:4848]
2025-10-01T14:08:07.906114Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:07.906135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:07.906141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.906145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.906147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.906164Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:07.906174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:07.906180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:07.906241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.906247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.906249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.906253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:07.906256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:07.906317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:07.906323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.906334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:07.906349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:07.906363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:07.906404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689172006:5365], now have 1 active actors on pipe
2025-10-01T14:08:07.906411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689171767:2446], now have 1 active actors on pipe
2025-10-01T14:08:07.906421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254880312309508:4848]
2025-10-01T14:08:07.906427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254880312309508:4848]
2025-10-01T14:08:07.906429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254880312309508:4848]
2025-10-01T14:08:07.906443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:07.906459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:07.906460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:07.906463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:07.906465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:07.906475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:07.906478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:07.906511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254880312309508:4848]
2025-10-01T14:08:07.906519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:07.906520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:07.906540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.906548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.906591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:07.906601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:07.906609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:07.906611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:07.906620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:07.906632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:07.906651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.906818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:07.906829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:07.906847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:07.907322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68734fe-51a9bfc0-ac3f9100-f18417ea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:07.909657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0] Write session: try to update token
2025-10-01T14:08:07.909675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:07.906461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 445
2025-10-01T14:08:07.906460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 445
2025-10-01T14:08:07.906951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 446 partition: 0 MaxSeqNo: 45 sessionId: src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0
2025-10-01T14:08:07.929318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 446 sessionId: src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:07.929789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:07.929809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:07.929812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:07.929814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:07.929823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254880312309508:4848]
2025-10-01T14:08:07.929829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254880312309508:4848]
2025-10-01T14:08:07.929832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254880312309508:4848]
2025-10-01T14:08:07.929881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:07.929887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:07.929889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:07.930030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:07.930350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:07.930355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:07.930357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:07.932780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:07.977532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254882689172046:5085]
2025-10-01T14:08:07.977844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 445, pipe: [1:7556254882689172046:5085]
2025-10-01T14:08:08.088097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:08.088770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.088780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.088838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254882689172046:5085], now have 1 active actors on pipe
2025-10-01T14:08:08.089075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:08.089132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:08.089148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:08.089210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 446 reason: error at write: Disconnected sessionId: src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0
2025-10-01T14:08:08.089391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 446 sessionId: src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0 is DEAD
2025-10-01T14:08:08.089433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254882689172046:5085]
2025-10-01T14:08:08.089463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:08.089746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:08.089760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0] Write session will restart in 0.009723s
2025-10-01T14:08:08.089790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0] Write session: Do CDS request
2025-10-01T14:08:08.089797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:08.100958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.101340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:08.101354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 447
2025-10-01T14:08:08.101526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.101560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:08.101570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:08.101577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:08.101938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 447 sessionId:  describe result for acl check
2025-10-01T14:08:08.101980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:08.101986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:08.101988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:08.101994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254886984139459:5369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:08.102492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254886984139459:5369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:08.104694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254886984139459:5369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:08.107447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254886984139459:5369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:08.107461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254886984139459:5369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:08.107464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254886984139459:5369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:08.107471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:08.108638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:08.110836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:08.111054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:08.111065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:08.111078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:08.111126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:08.111167Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254884607277081:4850]
2025-10-01T14:08:08.111772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:08.112082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:08.112149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:08.112482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:08.112543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.112548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.112549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.112550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.112551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.112552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.112553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.112554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.112556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.112556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.112557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.112558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.112560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.112561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.112566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.112575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.112579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.112582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.112586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.112589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.112592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.112595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.112598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.112602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.112605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.112608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.112611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.112615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.112622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.112629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.112635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.112639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.112644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.112653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.112658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.112666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.112670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.112675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.112683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.112687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.112691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.112696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.112700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.112705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.112713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.112720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.112728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.112732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.112736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.112744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.112748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.112757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.112761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.112765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.112769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.112778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.112828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:08.116755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:08.117476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:08.117490Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:08.117493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:08.117496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:08.117504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 446 [2:7556254884607277081:4850]
2025-10-01T14:08:08.117519Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:08.117537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:08.117544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.117548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.117550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.117866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 446
2025-10-01T14:08:08.117931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 446
2025-10-01T14:08:08.117569Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:08.117581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:08.117588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:08.117644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.117646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.117648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.117652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:08.117654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:08.117721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:08.117723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.117734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.117745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.117762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:08.117778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984139344:2446], now have 1 active actors on pipe
2025-10-01T14:08:08.117781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984139612:5369], now have 1 active actors on pipe
2025-10-01T14:08:08.117788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254884607277076:4850]
2025-10-01T14:08:08.117791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254884607277076:4850]
2025-10-01T14:08:08.117793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254884607277076:4850]
2025-10-01T14:08:08.117806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:08.117818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:08.117820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:08.117822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:08.117824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:08.117834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:08.117837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:08.117871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254884607277076:4850]
2025-10-01T14:08:08.117878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:08.117899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:08.117908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.117913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.117939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:08.117945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.117949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.117951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:08.117958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.117964Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:08.117978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.118231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.118239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.118255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.118382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 447 partition: 0 MaxSeqNo: 45 sessionId: src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0
2025-10-01T14:08:08.118759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebe24a24-8486dd2d-759b9e94-a4a5a14f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:08.121265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0] Write session: try to update token
2025-10-01T14:08:08.121280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:08.141922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 447 sessionId: src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:08.144467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:08.144008Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:08.144031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:08.144033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:08.144035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:08.144045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254884607277076:4850]
2025-10-01T14:08:08.144050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254884607277076:4850]
2025-10-01T14:08:08.144054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254884607277076:4850]
2025-10-01T14:08:08.144102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:08.144109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.144111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:08.144251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:08.146509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:08.146526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:08.146529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:08.189476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254886984139629:5085]
2025-10-01T14:08:08.189785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 446, pipe: [1:7556254886984139629:5085]
2025-10-01T14:08:08.306817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:08.307531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.307548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.307589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984139629:5085], now have 1 active actors on pipe
2025-10-01T14:08:08.307805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:08.307815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254886984139629:5085]
2025-10-01T14:08:08.307826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:08.307830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:08.307842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:08.307894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 447 reason: error at write: Disconnected sessionId: src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0
2025-10-01T14:08:08.308094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 447 sessionId: src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0 is DEAD
2025-10-01T14:08:08.308269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:08.308282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0] Write session will restart in 0.009239s
2025-10-01T14:08:08.308312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0] Write session: Do CDS request
2025-10-01T14:08:08.308318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:08.318963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.319444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:08.319464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 448
2025-10-01T14:08:08.319673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.319707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:08.319713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:08.319717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:08.320251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 448 sessionId:  describe result for acl check
2025-10-01T14:08:08.320298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:08.320305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:08.320313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:08.320317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254886984139710:5375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:08.320725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254886984139710:5375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:08.323070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254886984139710:5375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:08.325639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254886984139710:5375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:08.325655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254886984139710:5375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:08.325658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254886984139710:5375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:08.325664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:08.328351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:08.330901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:08.331155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:08.331177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:08.331189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:08.331251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:08.331294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254884607277370:4854]
2025-10-01T14:08:08.331931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:08.332506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:08.332562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:08.332926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:08.333008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.333014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.333015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.333016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.333017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.333018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.333020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.333022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.333023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.333024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.333025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.333027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.333028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.333029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.333034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.333044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.333047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.333050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.333054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.333058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.333066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.333069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.333073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.333083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.333087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.333090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.333099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.333107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.333115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.333123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.333134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.333143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.333152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.333161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.333169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.333179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.333188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.333193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.333201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.333207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.333215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.333220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.333228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.333233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.333241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.333246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.333255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.333272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.333280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.333286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.333294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.333299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.333304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.333312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.333316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.333320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.333358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:08.338806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 447
2025-10-01T14:08:08.338851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 447
2025-10-01T14:08:08.337331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:08.338139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:08.338145Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:08.338147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:08.338151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:08.338159Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 447 [2:7556254884607277370:4854]
2025-10-01T14:08:08.338173Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:08.338190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:08.338193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.338197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.338200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.338218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:08.338224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:08.338229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:08.338285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.338287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.338289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.338292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:08.338295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:08.338368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:08.338389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.338400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.338410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.338424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:08.338441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254884607277365:4854]
2025-10-01T14:08:08.338443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254884607277365:4854]
2025-10-01T14:08:08.338445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254884607277365:4854]
2025-10-01T14:08:08.338453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:08.338457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:08.338459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:08.338461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:08.338468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:08.338480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:08.338482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:08.338492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984139878:5375], now have 1 active actors on pipe
2025-10-01T14:08:08.338495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984139647:2446], now have 1 active actors on pipe
2025-10-01T14:08:08.338526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254884607277365:4854]
2025-10-01T14:08:08.338534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:08.338564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:08.339364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.339379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.339425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f59674e2-635db4c2-a5db667b-1db6618f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:08.339438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.339444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.339446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:08.339461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.339475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:08.339499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.339773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.339784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.339805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.339906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 448 partition: 0 MaxSeqNo: 45 sessionId: src_id|f59674e2-635db4c2-a5db667b-1db6618f_0
2025-10-01T14:08:08.340344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd8a9044-f1246e11-ff0732dd-a1a85a96_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f59674e2-635db4c2-a5db667b-1db6618f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:08.342824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f59674e2-635db4c2-a5db667b-1db6618f_0] Write session: try to update token
2025-10-01T14:08:08.342842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f59674e2-635db4c2-a5db667b-1db6618f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:08.360034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:08.360055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:08.360057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:08.360059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:08.360070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254884607277365:4854]
2025-10-01T14:08:08.360074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254884607277365:4854]
2025-10-01T14:08:08.360078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254884607277365:4854]
2025-10-01T14:08:08.360131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:08.360142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.360145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:08.360276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:08.362420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:08.362436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:08.362440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:08.365199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 448 sessionId: src_id|f59674e2-635db4c2-a5db667b-1db6618f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:08.372609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:08.408129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254886984139927:5085]
2025-10-01T14:08:08.408517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 447, pipe: [1:7556254886984139927:5085]
2025-10-01T14:08:08.504545Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:08.504836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.504848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.504869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984139927:5085], now have 1 active actors on pipe
2025-10-01T14:08:08.505124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:08.505176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:08.505183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254886984139927:5085]
2025-10-01T14:08:08.505214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:08.505310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 448 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f59674e2-635db4c2-a5db667b-1db6618f_0
2025-10-01T14:08:08.505656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59674e2-635db4c2-a5db667b-1db6618f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:08.505669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59674e2-635db4c2-a5db667b-1db6618f_0] Write session will restart in 0.006775s
2025-10-01T14:08:08.505693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59674e2-635db4c2-a5db667b-1db6618f_0] Write session: Do CDS request
2025-10-01T14:08:08.505700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59674e2-635db4c2-a5db667b-1db6618f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:08.505485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 448 sessionId: src_id|f59674e2-635db4c2-a5db667b-1db6618f_0 is DEAD
2025-10-01T14:08:08.513948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f59674e2-635db4c2-a5db667b-1db6618f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.514195Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:08.514213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 449
2025-10-01T14:08:08.514334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.514383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:08.514389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:08.514393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:08.515369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 449 sessionId:  describe result for acl check
2025-10-01T14:08:08.515415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:08.515416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:08.515418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:08.515424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254886984139993:5386] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:08.516008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254886984139993:5386] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:08.519387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254886984139993:5386] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:08.522725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254886984139993:5386] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:08.522745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254886984139993:5386] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:08.522749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254886984139993:5386] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:08.522758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:08.523805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:08.527073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:08.527282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:08.527291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:08.527301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:08.527347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:08.527388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254884607277651:4858]
2025-10-01T14:08:08.527788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:08.528057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:08.528099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:08.528349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:08.528403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.528408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.528409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.528410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.528412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.528413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.528414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.528415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.528417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.528418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.528419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.528421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.528422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.528424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.528428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.528437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.528441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.528445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.528448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.528451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.528454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.528458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.528462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.528466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.528471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.528479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.528483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.528486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.528505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.528516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.528525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.528534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.528542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.528551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.528555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.528560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.528567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.528572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.528576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.528581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.528589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.528594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.528598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.528603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.528611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.528617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.528624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.528628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.528633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.528636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.528638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.528641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.528646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.528648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.528652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.528655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.528687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:08.532846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:08.533750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:08.533762Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:08.533764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:08.533767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:08.533772Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 448 [2:7556254884607277651:4858]
2025-10-01T14:08:08.533782Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:08.533796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:08.533798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.533800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.533801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.533814Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:08.533818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:08.533822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:08.533864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.533871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.533872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.533874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:08.533876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:08.533938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:08.533945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.533953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.533958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.533967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:08.533978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254884607277646:4858]
2025-10-01T14:08:08.533981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254884607277646:4858]
2025-10-01T14:08:08.533983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254884607277646:4858]
2025-10-01T14:08:08.533993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:08.534005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:08.534007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:08.534016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:08.534019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:08.534019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:08.534021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:08.534030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984140219:5386], now have 1 active actors on pipe
2025-10-01T14:08:08.534032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984139954:2446], now have 1 active actors on pipe
2025-10-01T14:08:08.534059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254884607277646:4858]
2025-10-01T14:08:08.534067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:08.534087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:08.534142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 448
2025-10-01T14:08:08.534169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 448
2025-10-01T14:08:08.534255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.534271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.534308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:08.534322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.534331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.534334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:08.534344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.534387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:08.534408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.534582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.534591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.534605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.534700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 449 partition: 0 MaxSeqNo: 45 sessionId: src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0
2025-10-01T14:08:08.535123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f59674e2-635db4c2-a5db667b-1db6618f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:08.538157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0] Write session: try to update token
2025-10-01T14:08:08.538176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:08.557324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:08.557342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:08.557344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:08.557345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:08.557357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254884607277646:4858]
2025-10-01T14:08:08.557362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254884607277646:4858]
2025-10-01T14:08:08.557366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254884607277646:4858]
2025-10-01T14:08:08.557416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:08.557425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.557427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:08.557426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:08.557432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:08.557436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:08.557571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:08.558106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 449 sessionId: src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:08.560519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:08.605237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254886984140232:5085]
2025-10-01T14:08:08.605562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 448, pipe: [1:7556254886984140232:5085]
2025-10-01T14:08:08.707180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:08.707726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.707748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.707792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984140232:5085], now have 1 active actors on pipe
2025-10-01T14:08:08.708079Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:08.709594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:08.709609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0] Write session will restart in 0.009179s
2025-10-01T14:08:08.709635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0] Write session: Do CDS request
2025-10-01T14:08:08.709642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:08.708456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254886984140232:5085]
2025-10-01T14:08:08.708486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:08.708495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:08.708603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 449 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0
2025-10-01T14:08:08.708766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 449 sessionId: src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0 is DEAD
2025-10-01T14:08:08.720439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.720768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:08.720786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 450
2025-10-01T14:08:08.720962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.720988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:08.720993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:08.720997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:08.721661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 450 sessionId:  describe result for acl check
2025-10-01T14:08:08.721688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:08.721690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:08.721693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:08.721697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254886984140267:5391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:08.722258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254886984140267:5391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:08.732157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254886984140267:5391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:08.739677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254886984140267:5391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:08.739698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254886984140267:5391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:08.739702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254886984140267:5391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:08.739713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:08.747683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:08.752608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:08.752877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:08.752886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:08.752895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:08.752940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:08.752980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254884607277957:4871]
2025-10-01T14:08:08.753454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:08.756886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:08.756965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:08.757286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:08.757335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.757340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.757341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.757342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.757343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.757344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.757344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.757345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.757346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.757346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.757347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.757348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.757349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.757349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.757354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.757361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.757363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.757365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.757368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.757371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.757373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.757375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.757378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.757380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.757382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.757385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.757387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.757389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.757395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.757399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:08.757404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.757408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:08.757411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.757415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:08.757419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.757442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:08.757446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.757449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:08.757452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.757455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:08.757462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.757465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:08.757468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.757475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:08.757478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.757485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:08.757490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.757496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.757498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.757501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.757507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.757510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.757512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.757518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:08.757521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.757523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:08.757549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:08.764062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:08.764849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:08.764863Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:08.764866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:08.764869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:08.764877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 449 [2:7556254884607277957:4871]
2025-10-01T14:08:08.764896Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:08.764914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:08.764917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.764921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.764923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.764942Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:08.764954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:08.764961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:08.765019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.765024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.765026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.765029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:08.765032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:08.765107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:08.765113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.765127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:08.765141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:08.765158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:08.765180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984140490:5391], now have 1 active actors on pipe
2025-10-01T14:08:08.765187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984140237:2446], now have 1 active actors on pipe
2025-10-01T14:08:08.765195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254884607277951:4871]
2025-10-01T14:08:08.765200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254884607277951:4871]
2025-10-01T14:08:08.765202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254884607277951:4871]
2025-10-01T14:08:08.765217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:08.765234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:08.765229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:08.765244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:08.765247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:08.765251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:08.765254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:08.765295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254884607277951:4871]
2025-10-01T14:08:08.765304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:08.765309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:08.765475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.765484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.765507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3aec565f-1123e432-c22c7d06-8635d223_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:08.765518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.765523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.765529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:08.765538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.765550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:08.765568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.765737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.765744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.765756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:08.766255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b4fc050-bac583e4-497bb2f7-808d3c54_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3aec565f-1123e432-c22c7d06-8635d223_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:08.765277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 449
2025-10-01T14:08:08.765317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 449
2025-10-01T14:08:08.765859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 450 partition: 0 MaxSeqNo: 45 sessionId: src_id|3aec565f-1123e432-c22c7d06-8635d223_0
2025-10-01T14:08:08.769107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aec565f-1123e432-c22c7d06-8635d223_0] Write session: try to update token
2025-10-01T14:08:08.769125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aec565f-1123e432-c22c7d06-8635d223_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:08.790616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:08.790644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:08.790661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254884607277951:4871]
2025-10-01T14:08:08.790722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:08.790729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:08.791087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:08.791230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:08.791371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:08.791517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:08.791697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:08.791736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:08.794349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.794395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.791687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 450 sessionId: src_id|3aec565f-1123e432-c22c7d06-8635d223_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:08.794058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:08.794442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:08.794520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:08.806436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254886984140533:5085]
2025-10-01T14:08:08.808594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984140533:5085], now have 1 active actors on pipe
2025-10-01T14:08:08.808668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 449, pipe: [1:7556254886984140533:5085]
2025-10-01T14:08:08.825029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:08.825072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:08.825297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.825392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.825472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.825552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.825615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.825626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.825718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.825802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.825879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.825960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.826016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.826026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.826108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.826182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.826263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.826342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.826420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.826429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.826506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.826588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.826665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.826741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.826796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.826804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.826886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.826960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.827121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.827208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.827255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.827269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.827347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.827412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.827478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.827551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.827602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.827611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.827680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.827745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.827814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.827877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.827924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.827932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.828004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.828073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.828144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.828217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.828270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.828283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.828353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.828417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.828482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.828551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.828604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.828617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.828684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:08.828746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:08.828824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:08.828891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:08.828937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:08.828946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:08.829026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:08.829041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:08.829044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:08.829047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:08.829059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254884607277951:4871]
2025-10-01T14:08:08.829071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254884607277951:4871]
2025-10-01T14:08:08.829075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254884607277951:4871]
2025-10-01T14:08:08.829137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:08:08.829139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:08.829146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:08.829151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:08.829471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:08.829501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:08.829510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:08:08.829532Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829550Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829562Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829567Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829572Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829576Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829582Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829588Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829592Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829596Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829808Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829820Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829824Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829828Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829832Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829837Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829841Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829845Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829849Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829854Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829864Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829868Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829872Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829876Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829880Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829885Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829889Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829900Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829904Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829908Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829912Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829917Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829922Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829926Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829930Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:08.829953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:08:08.829973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:08:08.829984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:08:08.829988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:08:08.829991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:08:08.830406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:08:08.830434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:08:08.830441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:08:08.830445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:08:08.830449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:08:08.830452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:08:08.830884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:08:08.830910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:08:08.830916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:08:08.830920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:08:08.830924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:08:08.830927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:08:08.831408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:08:08.831435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:08.831542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327688831
2025-10-01T14:08:08.832313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:08.832331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:08.832334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:08.832465Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:08.977774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:08.978243Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:08:08.978280Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:08:08.978528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:08.978569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:08.978585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:08.978615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 450 reason: error at write: Disconnected sessionId: src_id|3aec565f-1123e432-c22c7d06-8635d223_0
2025-10-01T14:08:08.978803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 450 sessionId: src_id|3aec565f-1123e432-c22c7d06-8635d223_0 is DEAD
2025-10-01T14:08:08.978937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aec565f-1123e432-c22c7d06-8635d223_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:08.978948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aec565f-1123e432-c22c7d06-8635d223_0] Write session will restart in 0.008916s
2025-10-01T14:08:08.978985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aec565f-1123e432-c22c7d06-8635d223_0] Write session: Do CDS request
2025-10-01T14:08:08.978992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aec565f-1123e432-c22c7d06-8635d223_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:08.979013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254886984140533:5085]
2025-10-01T14:08:08.979044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:08.989138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3aec565f-1123e432-c22c7d06-8635d223_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.989241Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:08.989256Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 451
2025-10-01T14:08:08.989430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:08.989466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:08.989474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:08.989478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:08.989980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 451 sessionId:  describe result for acl check
2025-10-01T14:08:08.990034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:08.990041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:08.990043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:08.990049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254886984140557:5395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:08.990616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254886984140557:5395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:08.996754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254886984140557:5395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:09.000513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254886984140557:5395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:09.000532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254886984140557:5395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:09.000535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254886984140557:5395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:09.000544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:09.023183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:09.023881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:09.024075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:09.024079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:09.024088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:09.024131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:09.024170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254888902245531:4873]
2025-10-01T14:08:09.024782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:09.025167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:09.025209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:09.025526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:09.025581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.025582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.025583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.025584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.025586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.025587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.025588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.025590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.025591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.025592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.025593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.025594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.025595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.025597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.025601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.025610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.025613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.025616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.025620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.025623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.025626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.025628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.025632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.025635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.025638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.025641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.025644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.025647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.025654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.025661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.025666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.025671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.025676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.025680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.025685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.025689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.025696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.025701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.025705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.025709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.025714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.025718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.025722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.025726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.025730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.025735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.025739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.025744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.025748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.025752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.025756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.025762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.025766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.025771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.025775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.025779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.025816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:09.030056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:09.031379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:09.031403Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:09.031406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:09.031410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:09.031418Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 450 [2:7556254888902245531:4873]
2025-10-01T14:08:09.031435Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:09.031454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:09.031464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.031467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.031474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.031491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:09.031501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:09.031514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:09.031587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.031598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.031601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.031605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:09.031607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:09.031699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:09.031706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.031722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.031738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.031758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:09.031779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254888902245526:4873]
2025-10-01T14:08:09.031786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254888902245526:4873]
2025-10-01T14:08:09.031788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254888902245526:4873]
2025-10-01T14:08:09.031797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:09.031839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:09.031857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:09.031865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:09.031889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:09.031902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254888902245526:4873]
2025-10-01T14:08:09.031903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:09.031905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:09.031906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:09.031913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:09.031932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279107948:5395], now have 1 active actors on pipe
2025-10-01T14:08:09.031941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254886984140540:2446], now have 1 active actors on pipe
2025-10-01T14:08:09.032467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 450
2025-10-01T14:08:09.032519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 450
2025-10-01T14:08:09.032726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.032742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.032770Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:09.032783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.032804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.032816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:09.032829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.032846Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:09.032867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.033089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.033105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.033124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.033505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 451 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0
2025-10-01T14:08:09.034063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3aec565f-1123e432-c22c7d06-8635d223_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:09.037251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0] Write session: try to update token
2025-10-01T14:08:09.037269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:09.055985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:09.056010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:09.056013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:09.056015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:09.056054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254888902245526:4873]
2025-10-01T14:08:09.056060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254888902245526:4873]
2025-10-01T14:08:09.056065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254888902245526:4873]
2025-10-01T14:08:09.056120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:09.056128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.056131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:09.056304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:09.056390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:09.056398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:09.056403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:09.059080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 451 sessionId: src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:09.062319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:09.079805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254891279108116:5085]
2025-10-01T14:08:09.080327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 450, pipe: [1:7556254891279108116:5085]
2025-10-01T14:08:09.222813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:09.223467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.223486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.223531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279108116:5085], now have 1 active actors on pipe
2025-10-01T14:08:09.223737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:09.223848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254891279108116:5085]
2025-10-01T14:08:09.223872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:09.223906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:09.224095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 451 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0
2025-10-01T14:08:09.224393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:09.224401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0] Write session will restart in 0.005529s
2025-10-01T14:08:09.224424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0] Write session: Do CDS request
2025-10-01T14:08:09.224429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:09.224284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 451 sessionId: src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0 is DEAD
2025-10-01T14:08:09.230849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:09.230950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:09.230967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 452
2025-10-01T14:08:09.231164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:09.231205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:09.231215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:09.231220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:09.231671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 452 sessionId:  describe result for acl check
2025-10-01T14:08:09.231708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:09.231709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:09.231711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:09.231717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254891279108150:5401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:09.232296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254891279108150:5401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:09.236080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254891279108150:5401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:09.241053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254891279108150:5401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:09.241070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254891279108150:5401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:09.241073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254891279108150:5401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:09.241083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:09.248235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:09.250644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:09.250893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:09.250898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:09.250909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:09.250958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:09.250990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254888902245820:4876]
2025-10-01T14:08:09.251571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:09.251789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:09.251821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:09.252101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:09.252145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.252147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.252148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.252149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.252150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.252151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.252152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.252153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.252154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.252155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.252156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.252158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.252159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.252160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.252164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.252175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.252179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.252182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.252186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.252190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.252193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.252197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.252201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.252204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.252208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.252211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.252215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.252218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.252225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.252232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.252238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.252243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.252247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.252252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.252256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.252261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.252265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.252271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.252275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.252280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.252285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.252290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.252295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.252299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.252304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.252309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.252314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.252319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.252323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.252328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.252332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.252337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.252341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.252346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.252350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.252367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.252403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:09.256623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:09.257790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 451
2025-10-01T14:08:09.257819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 451
2025-10-01T14:08:09.257368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:09.257383Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:09.257385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:09.257391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:09.257398Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 451 [2:7556254888902245820:4876]
2025-10-01T14:08:09.257413Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:09.257429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:09.257431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.257435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.257437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.257452Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:09.257458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:09.257465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:09.257521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.257523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.257525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.257528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:09.257530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:09.257900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:09.257903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.257915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.257927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.257945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:09.257964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279108136:2446], now have 1 active actors on pipe
2025-10-01T14:08:09.257977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279108304:5401], now have 1 active actors on pipe
2025-10-01T14:08:09.257992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.257997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.258018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254888902245815:4876]
2025-10-01T14:08:09.258027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254888902245815:4876]
2025-10-01T14:08:09.258031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254888902245815:4876]
2025-10-01T14:08:09.258043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:09.258053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:09.258056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:09.258057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:09.258059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:09.258071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:09.258073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:09.258087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|601794d6-e8a889f5-81a1ece9-66424ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:09.258098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.258102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.258104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:09.258113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.258123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:09.258163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254888902245815:4876]
2025-10-01T14:08:09.258177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:09.258187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.258196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:09.258331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.258345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.258382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.258471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 452 partition: 0 MaxSeqNo: 45 sessionId: src_id|601794d6-e8a889f5-81a1ece9-66424ce_0
2025-10-01T14:08:09.262505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a5c8ef1-b25fdf49-49fc7c48-4d4d39ad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|601794d6-e8a889f5-81a1ece9-66424ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:09.265610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|601794d6-e8a889f5-81a1ece9-66424ce_0] Write session: try to update token
2025-10-01T14:08:09.265634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|601794d6-e8a889f5-81a1ece9-66424ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:09.280071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:09.280093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:09.280102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254888902245815:4876]
2025-10-01T14:08:09.280132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:09.280140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:09.280299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:09.280436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:09.280575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:09.280698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:09.280889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:09.280923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:09.302645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:09.302667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:09.302670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:09.302671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:09.302683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254888902245815:4876]
2025-10-01T14:08:09.302687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254888902245815:4876]
2025-10-01T14:08:09.302692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254888902245815:4876]
2025-10-01T14:08:09.302733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:09.302741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:09.302746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:09.302748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.302749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:09.302750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:09.302891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:09.304977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 452 sessionId: src_id|601794d6-e8a889f5-81a1ece9-66424ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:09.307595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:09.324054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254891279108424:5085]
2025-10-01T14:08:09.324317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 451, pipe: [1:7556254891279108424:5085]
2025-10-01T14:08:09.445005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:09.445271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.445283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.445300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279108424:5085], now have 1 active actors on pipe
2025-10-01T14:08:09.445479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:09.445516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254891279108424:5085]
2025-10-01T14:08:09.445547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:09.445553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:09.445608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 452 reason: status is not ok: tablet will be restarted right now sessionId: src_id|601794d6-e8a889f5-81a1ece9-66424ce_0
2025-10-01T14:08:09.445783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 452 sessionId: src_id|601794d6-e8a889f5-81a1ece9-66424ce_0 is DEAD
2025-10-01T14:08:09.445912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601794d6-e8a889f5-81a1ece9-66424ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:09.445925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601794d6-e8a889f5-81a1ece9-66424ce_0] Write session will restart in 0.006492s
2025-10-01T14:08:09.445951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601794d6-e8a889f5-81a1ece9-66424ce_0] Write session: Do CDS request
2025-10-01T14:08:09.445956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601794d6-e8a889f5-81a1ece9-66424ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:09.453848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|601794d6-e8a889f5-81a1ece9-66424ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:09.453974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:09.453989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 453
2025-10-01T14:08:09.454152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:09.454207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:09.454219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:09.454222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:09.454635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 453 sessionId:  describe result for acl check
2025-10-01T14:08:09.454673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:09.454679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:09.454681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:09.454686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254891279108473:5405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:09.454985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254891279108473:5405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:09.457884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254891279108473:5405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:09.461560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254891279108473:5405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:09.461575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254891279108473:5405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:09.461578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254891279108473:5405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:09.461585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:09.464229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:09.467494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:09.467730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:09.467742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:09.467755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:09.467810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:09.467850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254888902246100:4879]
2025-10-01T14:08:09.468325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:09.468724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:09.468765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:09.469068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:09.469140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.469145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.469147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.469148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.469149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.469150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.469151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.469152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.469153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.469154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.469156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.469157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.469158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.469159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.469163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.469168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.469170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.469172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.469174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.469176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.469178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.469180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.469182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.469184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.469186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.469188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.469190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.469191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.469196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.469201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.469205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.469208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.469211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.469214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.469216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.469219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.469222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.469225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.469228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.469231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.469234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.469239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.469243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.469247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.469252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.469257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.469261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.469266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.469270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.469274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.469278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.469290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.469296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.469300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.469304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.469310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.469345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:09.473250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:09.474041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:09.474059Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:09.474061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:09.474064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:09.474072Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 452 [2:7556254888902246100:4879]
2025-10-01T14:08:09.474087Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:09.474102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:09.474110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.474113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.474115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.474130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:09.474139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:09.474150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:09.474209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.474221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.474223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.474226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:09.474228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:09.474294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:09.474302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.474315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.474330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.474351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:09.474392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279108674:5405], now have 1 active actors on pipe
2025-10-01T14:08:09.474396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279108427:2446], now have 1 active actors on pipe
2025-10-01T14:08:09.474403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254888902246095:4879]
2025-10-01T14:08:09.474405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254888902246095:4879]
2025-10-01T14:08:09.474407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254888902246095:4879]
2025-10-01T14:08:09.474422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:09.474436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:09.474437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:09.474439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:09.474441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:09.474451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:09.474454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:09.474485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254888902246095:4879]
2025-10-01T14:08:09.474487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:09.474489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:09.474470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 452
2025-10-01T14:08:09.474509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 452
2025-10-01T14:08:09.474515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.474524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.474554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:09.474568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.474572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.474574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:09.474584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.474592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:09.474619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.474784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.474792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.474805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.474908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 453 partition: 0 MaxSeqNo: 45 sessionId: src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0
2025-10-01T14:08:09.475271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|601794d6-e8a889f5-81a1ece9-66424ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:09.478239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0] Write session: try to update token
2025-10-01T14:08:09.478260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:09.497672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:09.497690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:09.497692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:09.497693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:09.497700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254888902246095:4879]
2025-10-01T14:08:09.497703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254888902246095:4879]
2025-10-01T14:08:09.497705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254888902246095:4879]
2025-10-01T14:08:09.497750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:09.497754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:09.497760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.497763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:09.497763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:09.497767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:09.497891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:09.502863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 453 sessionId: src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:09.505271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:09.545772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254891279108734:5085]
2025-10-01T14:08:09.546055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 452, pipe: [1:7556254891279108734:5085]
2025-10-01T14:08:09.645546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:09.646094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.646111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.646151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279108734:5085], now have 1 active actors on pipe
2025-10-01T14:08:09.646384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:09.646478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:09.646488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:09.646495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:09.646539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254891279108734:5085]
2025-10-01T14:08:09.646602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 453 reason: error at write: Disconnected sessionId: src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0
2025-10-01T14:08:09.646838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 453 sessionId: src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0 is DEAD
2025-10-01T14:08:09.646940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:09.646951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0] Write session will restart in 0.005268s
2025-10-01T14:08:09.646978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0] Write session: Do CDS request
2025-10-01T14:08:09.646984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:09.653979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:09.654191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:09.654208Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 454
2025-10-01T14:08:09.654348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:09.654399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:09.654411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:09.654415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:09.655192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 454 sessionId:  describe result for acl check
2025-10-01T14:08:09.655226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:09.655228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:09.655229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:09.655236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254891279108760:5417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:09.655753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254891279108760:5417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:09.659996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254891279108760:5417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:09.665477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254891279108760:5417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:09.665494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254891279108760:5417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:09.665497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254891279108760:5417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:09.665506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:09.671130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:09.675322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:09.675606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:09.675620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:09.675637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:09.675717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:09.675765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254888902246390:4883]
2025-10-01T14:08:09.676353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:09.676706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:09.676767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:09.677091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:09.677176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.677184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.677185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.677187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.677188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.677190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.677191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.677193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.677194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.677195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.677196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.677198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.677199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.677201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.677207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.677218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.677222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.677227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.677231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.677235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.677239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.677243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.677247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.677251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.677255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.677259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.677262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.677266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.677274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.677281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.677287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.677292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.677299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.677304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.677309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.677313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.677318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.677323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.677327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.677333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.677338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.677342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.677346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.677351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.677357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.677362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.677367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.677372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.677378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.677390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.677395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.677404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.677408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.677418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.677422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.677431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.677472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:09.683105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:09.683826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:09.683840Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:09.683843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:09.683846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:09.683851Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 453 [2:7556254888902246390:4883]
2025-10-01T14:08:09.683864Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:09.683879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:09.683882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.683884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.683887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.683904Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:09.683914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:09.683921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:09.683980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.683987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.683988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.683991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:09.683993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:09.684059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:09.684065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.684074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.684089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.684111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:09.684134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254888902246385:4883]
2025-10-01T14:08:09.684140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254888902246385:4883]
2025-10-01T14:08:09.684142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254888902246385:4883]
2025-10-01T14:08:09.684155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:09.684169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:09.684179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279108949:5417], now have 1 active actors on pipe
2025-10-01T14:08:09.684180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:09.684182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279108739:2446], now have 1 active actors on pipe
2025-10-01T14:08:09.684183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:09.684190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:09.684202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:09.684210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:09.684219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 453
2025-10-01T14:08:09.684248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254888902246385:4883]
2025-10-01T14:08:09.684234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 453
2025-10-01T14:08:09.684256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:09.684258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:09.684272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.684276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.684330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:09.684342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.684347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.684353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:09.684362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.684375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:09.684398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.684569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.684584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.684611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.684691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 454 partition: 0 MaxSeqNo: 45 sessionId: src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0
2025-10-01T14:08:09.685056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81bb37f1-6c8107bd-1c549d22-6c819db6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:09.687803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0] Write session: try to update token
2025-10-01T14:08:09.687823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:09.709397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:09.709422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:09.709424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:09.709426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:09.709436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254888902246385:4883]
2025-10-01T14:08:09.709445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254888902246385:4883]
2025-10-01T14:08:09.709449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254888902246385:4883]
2025-10-01T14:08:09.709495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:09.709500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:09.709507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.709509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:09.709515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:09.709520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:09.709671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:09.723566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 454 sessionId: src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:09.726363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:09.747011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254891279109025:5085]
2025-10-01T14:08:09.747335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 453, pipe: [1:7556254891279109025:5085]
2025-10-01T14:08:09.865930Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:09.866299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.866320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.866345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279109025:5085], now have 1 active actors on pipe
2025-10-01T14:08:09.866591Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:09.866903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254891279109025:5085]
2025-10-01T14:08:09.866956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:09.867059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 454 reason: status is not ok: tablet will be restarted right now sessionId: src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0
2025-10-01T14:08:09.867208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:09.867239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 454 sessionId: src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0 is DEAD
2025-10-01T14:08:09.870529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:09.870546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0] Write session will restart in 0.007754s
2025-10-01T14:08:09.870590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0] Write session: Do CDS request
2025-10-01T14:08:09.870597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:09.883103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:09.883304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:09.883322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 455
2025-10-01T14:08:09.888237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:09.888321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:09.888327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:09.888333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:09.888937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 455 sessionId:  describe result for acl check
2025-10-01T14:08:09.888979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:09.888981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:09.888984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:09.888990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254891279109042:5421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:09.889575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254891279109042:5421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:09.901885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254891279109042:5421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:09.911177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254891279109042:5421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:09.911194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254891279109042:5421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:09.911198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254891279109042:5421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:09.911208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:09.916528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:09.919797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:09.920019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:09.920029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:09.920040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:09.920100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:09.920144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254888902246699:4896]
2025-10-01T14:08:09.920727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:09.921009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:09.921049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:09.921340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:09.921393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.921398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.921400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.921401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.921402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.921403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.921405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.921406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.921407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.921408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.921409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.921410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.921411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.921412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.921417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.921427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.921431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.921435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.921439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.921442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.921446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.921449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.921452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.921456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.921459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.921462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.921465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.921469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.921476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.921484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:09.921489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.921495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:09.921499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.921504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:09.921508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.921512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:09.921517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.921521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:09.921526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.921531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:09.921536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.921541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:09.921545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.921549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:09.921553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.921558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:09.921571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.921576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.921581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.921586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.921591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.921596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.921600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.921605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:09.921610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.921615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:09.921659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:09.925591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:09.926360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:09.926390Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:09.926393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:09.926397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:09.926404Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 454 [2:7556254888902246699:4896]
2025-10-01T14:08:09.926424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:09.926443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:09.926446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.926449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.926451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.926467Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:09.926472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:09.926479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:09.927172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 454
2025-10-01T14:08:09.927208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 454
2025-10-01T14:08:09.926536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.926543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.926545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.926548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:09.926551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:09.926620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:09.926623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.926635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:09.926646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:09.926663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:09.926681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254888902246694:4896]
2025-10-01T14:08:09.926683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254888902246694:4896]
2025-10-01T14:08:09.926685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254888902246694:4896]
2025-10-01T14:08:09.926693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:09.926709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:09.926710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279109028:2446], now have 1 active actors on pipe
2025-10-01T14:08:09.926711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:09.926712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:09.926714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279109252:5421], now have 1 active actors on pipe
2025-10-01T14:08:09.926722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:09.926736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:09.926739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:09.926774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254888902246694:4896]
2025-10-01T14:08:09.926782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:09.926791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:09.927450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.927459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.927485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93440796-98fddd25-ef68909a-9a4d4aec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:09.927492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:09.927496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:09.927499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:09.927509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:09.927519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:09.927534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.927681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:09.927687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:09.927700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:09.927769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 455 partition: 0 MaxSeqNo: 45 sessionId: src_id|93440796-98fddd25-ef68909a-9a4d4aec_0
2025-10-01T14:08:09.928165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90fe26b6-3c67ec85-de004a71-2ce00ac2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|93440796-98fddd25-ef68909a-9a4d4aec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:09.930583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93440796-98fddd25-ef68909a-9a4d4aec_0] Write session: try to update token
2025-10-01T14:08:09.930599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93440796-98fddd25-ef68909a-9a4d4aec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:09.949003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:09.949029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:09.949031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:09.949033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:09.949046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254888902246694:4896]
2025-10-01T14:08:09.949051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254888902246694:4896]
2025-10-01T14:08:09.949056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254888902246694:4896]
2025-10-01T14:08:09.949116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:09.949123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:09.949129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:09.949130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:09.949132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:09.949134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:09.948192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 455 sessionId: src_id|93440796-98fddd25-ef68909a-9a4d4aec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:09.949283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:09.952256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:09.968229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254891279109316:5085]
2025-10-01T14:08:09.968791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 454, pipe: [1:7556254891279109316:5085]
2025-10-01T14:08:10.103654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:10.104137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.104148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.104188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254891279109316:5085], now have 1 active actors on pipe
2025-10-01T14:08:10.104463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:10.104888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:10.104954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254891279109316:5085]
2025-10-01T14:08:10.105224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:10.105311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 455 reason: status is not ok: tablet will be restarted right now sessionId: src_id|93440796-98fddd25-ef68909a-9a4d4aec_0
2025-10-01T14:08:10.105489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 455 sessionId: src_id|93440796-98fddd25-ef68909a-9a4d4aec_0 is DEAD
2025-10-01T14:08:10.105861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93440796-98fddd25-ef68909a-9a4d4aec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:10.105874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93440796-98fddd25-ef68909a-9a4d4aec_0] Write session will restart in 0.009607s
2025-10-01T14:08:10.105904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93440796-98fddd25-ef68909a-9a4d4aec_0] Write session: Do CDS request
2025-10-01T14:08:10.105911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93440796-98fddd25-ef68909a-9a4d4aec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:10.116840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93440796-98fddd25-ef68909a-9a4d4aec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:10.116990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:10.117007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 456
2025-10-01T14:08:10.117947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:10.117991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:10.118001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:10.118007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:10.118487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 456 sessionId:  describe result for acl check
2025-10-01T14:08:10.118526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:10.118528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:10.118531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:10.118538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254895574076639:5425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:10.119105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254895574076639:5425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:10.122456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254895574076639:5425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:10.128278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254895574076639:5425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:10.128299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254895574076639:5425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:10.128302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254895574076639:5425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:10.128313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:10.139567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:10.143134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:10.143354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:10.143358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:10.143368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:10.143415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:10.143454Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254893197214289:4898]
2025-10-01T14:08:10.144146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:10.144615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:10.144668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:10.145027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:10.145085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.145087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.145088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.145090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.145091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.145092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.145094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.145095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.145097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.145099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.145100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.145102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.145103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.145104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.145110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.145121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.145126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.145130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.145134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.145143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.145147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.145152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.145155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.145160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.145164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.145168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.145173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.145177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.145184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.145193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.145200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.145206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.145211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.145217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.145222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.145228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.145235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.145241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.145246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.145252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.145257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.145263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.145269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.145274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.145279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.145285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.145292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.145297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.145303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.145308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.145313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.145319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.145325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.145331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.145336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.145341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.145387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:10.152463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:10.153197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:10.153213Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:10.153216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:10.153219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:10.153227Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 455 [2:7556254893197214289:4898]
2025-10-01T14:08:10.153243Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:10.153260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:10.153268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.153271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.153274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.153293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:10.153306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:10.153313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:10.153372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.153379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.153382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.153385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:10.153388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:10.153456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:10.153463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.153475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.153487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.153508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:10.153529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254893197214272:4898]
2025-10-01T14:08:10.153536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254893197214272:4898]
2025-10-01T14:08:10.153538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254893197214272:4898]
2025-10-01T14:08:10.153549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:10.153560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:10.153563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:10.153566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:10.153567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:10.153582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:10.153585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:10.153597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574076614:2446], now have 1 active actors on pipe
2025-10-01T14:08:10.153604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574076729:5425], now have 1 active actors on pipe
2025-10-01T14:08:10.153641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254893197214272:4898]
2025-10-01T14:08:10.153654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:10.153666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:10.153680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 455
2025-10-01T14:08:10.153784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 455
2025-10-01T14:08:10.153865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.153875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.153901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:10.153911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.153915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.153921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:10.153930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.153943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:10.153962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:10.154145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.154160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.154183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:10.154284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 456 partition: 0 MaxSeqNo: 45 sessionId: src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0
2025-10-01T14:08:10.154649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93440796-98fddd25-ef68909a-9a4d4aec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:10.157006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0] Write session: try to update token
2025-10-01T14:08:10.157022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:10.171805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 456 sessionId: src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:10.174731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:10.175536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.175559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.175595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:10.175727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:10.189099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:10.189125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:10.189127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:10.189129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:10.189138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254893197214272:4898]
2025-10-01T14:08:10.189143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254893197214272:4898]
2025-10-01T14:08:10.189146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254893197214272:4898]
2025-10-01T14:08:10.189193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:10.189196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:10.189202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:10.189205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.189206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:10.189208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:10.189397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:10.205229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254895574076910:5085]
2025-10-01T14:08:10.205509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 455, pipe: [1:7556254895574076910:5085]
2025-10-01T14:08:10.358069Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:10.358517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574076910:5085], now have 1 active actors on pipe
2025-10-01T14:08:10.368095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.368135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.368358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.368466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.368564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.368651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.369182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.369202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.369280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.369377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.369462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.369538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.369641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.369651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.369719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.369795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.369883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.369958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.370010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.370019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.370098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.370201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.370272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.370356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.370492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.370503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.370569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.370637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.370706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.370776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.373138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254895574076910:5085]
2025-10-01T14:08:10.373142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:10.373293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:10.373301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:10.373326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 456 reason: error at write: Disconnected sessionId: src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0
2025-10-01T14:08:10.373495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 456 sessionId: src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0 is DEAD
2025-10-01T14:08:10.373621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:10.373647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0] Write session will restart in 0.008004s
2025-10-01T14:08:10.373671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0] Write session: Do CDS request
2025-10-01T14:08:10.373676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:10.370822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.370836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.370958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.371022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.371098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.371181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.371235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.371238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.371315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.371402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.371487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.371555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.371596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.371599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.371696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.371769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.371827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.371891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.372040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.372047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.372143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.372208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.372274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.372363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.372420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.372424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.372510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:10.372569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:10.372636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:10.372704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:10.372759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:10.372764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:10.373594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:10.386868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:10.386953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:10.386973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 457
2025-10-01T14:08:10.387140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:10.387168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:10.387176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:10.387178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:10.387559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 457 sessionId:  describe result for acl check
2025-10-01T14:08:10.387585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:10.387586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:10.387588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:10.387592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254895574076970:5431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:10.388062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254895574076970:5431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:10.392790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254895574076970:5431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:10.397172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254895574076970:5431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:10.397188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254895574076970:5431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:10.397192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254895574076970:5431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:10.397201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:10.410033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:10.413107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:10.413286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:10.413294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:10.413301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:10.413338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:10.413377Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254893197214574:4902]
2025-10-01T14:08:10.413861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:10.414121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:10.414154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:10.414431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:10.414483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.414487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.414488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.414489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.414489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.414490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.414491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.414492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.414492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.414493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.414494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.414494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.414495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.414495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.414499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.414504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.414507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.414509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.414511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.414514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.414516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.414518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.414520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.414523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.414525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.414527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.414529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.414531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.414537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.414542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.414546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.414550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.414552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.414556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.414559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.414561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.414564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.414567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.414569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.414573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.414576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.414579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.414582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.414586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.414589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.414592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.414595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.414599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.414601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.414605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.414608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.414611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.414614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.414617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.414619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.414624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.414645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:10.418532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:10.419249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:10.419270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:10.419273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:10.419277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:10.419285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 456 [2:7556254893197214574:4902]
2025-10-01T14:08:10.419302Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:10.419321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:10.419328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.419333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.419336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.419351Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:10.419358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:10.419374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:10.419441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.419449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.419452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.419455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:10.419458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:10.419530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:10.419540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.419553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.419565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.419586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:10.419610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574077061:5431], now have 1 active actors on pipe
2025-10-01T14:08:10.419618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574076928:2446], now have 1 active actors on pipe
2025-10-01T14:08:10.419625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254893197214569:4902]
2025-10-01T14:08:10.419628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254893197214569:4902]
2025-10-01T14:08:10.419631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254893197214569:4902]
2025-10-01T14:08:10.419647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:10.419666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:10.419686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:10.419695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:10.419731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254893197214569:4902]
2025-10-01T14:08:10.419739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:10.419796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:10.419801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:10.419804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:10.419811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:10.422456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 456
2025-10-01T14:08:10.422515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 456
2025-10-01T14:08:10.422601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.422623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.422657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:10.422674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.422684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.422687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:10.422700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.422721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:10.422742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:10.422953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.422967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.422983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:10.423114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 457 partition: 0 MaxSeqNo: 45 sessionId: src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0
2025-10-01T14:08:10.423497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|537c5cff-6ebe4b4a-8d703aff-fd796421_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:10.426603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0] Write session: try to update token
2025-10-01T14:08:10.426620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:10.442096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:10.442121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:10.442124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:10.442126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:10.442137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254893197214569:4902]
2025-10-01T14:08:10.442142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254893197214569:4902]
2025-10-01T14:08:10.442147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254893197214569:4902]
2025-10-01T14:08:10.442201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:10.442212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.442215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:10.442218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:10.442226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:10.442230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:10.442397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:10.443901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 457 sessionId: src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:10.447219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:10.473550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254895574077218:5085]
2025-10-01T14:08:10.473821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 456, pipe: [1:7556254895574077218:5085]
2025-10-01T14:08:10.587751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:10.588716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.588736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.588774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574077218:5085], now have 1 active actors on pipe
2025-10-01T14:08:10.588994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:10.589075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:10.589077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:10.589133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254895574077218:5085]
2025-10-01T14:08:10.589173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 457 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0
2025-10-01T14:08:10.589383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 457 sessionId: src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0 is DEAD
2025-10-01T14:08:10.589539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:10.589549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0] Write session will restart in 0.008049s
2025-10-01T14:08:10.589570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0] Write session: Do CDS request
2025-10-01T14:08:10.589575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:10.599010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:10.599099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:10.599117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 458
2025-10-01T14:08:10.599230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:10.599264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:10.599268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:10.599271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:10.599706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 458 sessionId:  describe result for acl check
2025-10-01T14:08:10.599741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:10.599743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:10.599745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:10.599750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254895574077273:5442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:10.600293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254895574077273:5442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:10.602517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254895574077273:5442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:10.606050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254895574077273:5442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:10.606067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254895574077273:5442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:10.606071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254895574077273:5442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:10.606080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:10.613562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:10.617552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:10.617801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:10.617814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:10.617828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:10.617897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:10.617944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254893197214864:4906]
2025-10-01T14:08:10.618586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:10.619014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:10.619067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:10.619385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:10.619456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.619457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.619459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.619460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.619462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.619463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.619464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.619466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.619467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.619468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.619469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.619471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.619472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.619473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.619480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.619490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.619494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.619498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.619502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.619506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.619510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.619513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.619517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.619520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.619524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.619527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.619531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.619534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.619542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.619549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.619555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.619561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.619567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.619572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.619576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.619580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.619585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.619590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.619594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.619598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.619604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.619609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.619615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.619620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.619625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.619630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.619634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.619640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.619645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.619649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.619654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.619660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.619665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.619670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.619674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.619681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.619725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:10.623961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:10.624619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:10.624633Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:10.624635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:10.624638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:10.624644Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 457 [2:7556254893197214864:4906]
2025-10-01T14:08:10.624658Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:10.624677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:10.624683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.624685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.624687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.624700Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:10.624704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:10.624710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:10.624767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.624775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.624777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.624780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:10.624783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:10.624890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:10.624901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.624913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.624924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.624941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:10.624975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574077245:2446], now have 1 active actors on pipe
2025-10-01T14:08:10.624983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574077437:5442], now have 1 active actors on pipe
2025-10-01T14:08:10.624997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254893197214859:4906]
2025-10-01T14:08:10.624970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 457
2025-10-01T14:08:10.625004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254893197214859:4906]
2025-10-01T14:08:10.625006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254893197214859:4906]
2025-10-01T14:08:10.625003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 457
2025-10-01T14:08:10.625020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:10.625035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:10.625038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:10.625044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:10.625047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:10.625053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:10.625057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:10.625103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.625111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.625123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254893197214859:4906]
2025-10-01T14:08:10.625134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:10.625150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:10.625168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90da7ca3-71e853a3-20b76379-b9b0227_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:10.625178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.625186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.625189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:10.625198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.625212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:10.625237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:10.625379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.625391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.625408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:10.625811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c57014-2e730cbd-e11ba8a9-f903b2b9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|90da7ca3-71e853a3-20b76379-b9b0227_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:10.625493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 458 partition: 0 MaxSeqNo: 45 sessionId: src_id|90da7ca3-71e853a3-20b76379-b9b0227_0
2025-10-01T14:08:10.628729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90da7ca3-71e853a3-20b76379-b9b0227_0] Write session: try to update token
2025-10-01T14:08:10.628746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90da7ca3-71e853a3-20b76379-b9b0227_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:10.648253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:10.648281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:10.648284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:10.648286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:10.648296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254893197214859:4906]
2025-10-01T14:08:10.648302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254893197214859:4906]
2025-10-01T14:08:10.648307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254893197214859:4906]
2025-10-01T14:08:10.648363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:10.648365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:10.648374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:10.648375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.648378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:10.648379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:10.648530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:10.649729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 458 sessionId: src_id|90da7ca3-71e853a3-20b76379-b9b0227_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:10.652725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:10.689100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254895574077535:5085]
2025-10-01T14:08:10.689421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 457, pipe: [1:7556254895574077535:5085]
2025-10-01T14:08:10.806035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:10.806762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.806786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.806830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574077535:5085], now have 1 active actors on pipe
2025-10-01T14:08:10.807055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:10.807127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:10.807142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:10.807192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 458 reason: error at write: Disconnected sessionId: src_id|90da7ca3-71e853a3-20b76379-b9b0227_0
2025-10-01T14:08:10.807194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254895574077535:5085]
2025-10-01T14:08:10.807402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 458 sessionId: src_id|90da7ca3-71e853a3-20b76379-b9b0227_0 is DEAD
2025-10-01T14:08:10.807427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:10.807585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90da7ca3-71e853a3-20b76379-b9b0227_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:10.807600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90da7ca3-71e853a3-20b76379-b9b0227_0] Write session will restart in 0.008694s
2025-10-01T14:08:10.807626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90da7ca3-71e853a3-20b76379-b9b0227_0] Write session: Do CDS request
2025-10-01T14:08:10.807633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90da7ca3-71e853a3-20b76379-b9b0227_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:10.817871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90da7ca3-71e853a3-20b76379-b9b0227_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:10.817967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:10.817985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 459
2025-10-01T14:08:10.818091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:10.818124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:10.818135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:10.818139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:10.818614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 459 sessionId:  describe result for acl check
2025-10-01T14:08:10.818650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:10.818653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:10.818656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:10.818661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254895574077556:5447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:10.819084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254895574077556:5447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:10.821487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254895574077556:5447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:10.826245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254895574077556:5447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:10.826265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254895574077556:5447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:10.826268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254895574077556:5447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:10.826276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:10.837649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:10.842509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:10.842773Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:10.842778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:10.842790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:10.842846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:10.842892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254893197215181:4919]
2025-10-01T14:08:10.843520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:10.844020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:10.844061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:10.844395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:10.844452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.844453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.844455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.844456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.844457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.844459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.844460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.844461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.844462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.844463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.844464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.844473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.844474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.844475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.844481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.844492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.844496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.844500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.844503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.844507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.844511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.844515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.844518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.844522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.844526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.844530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.844533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.844537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.844545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.844552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:10.844558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.844563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:10.844568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.844573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:10.844577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.844582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:10.844587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.844594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:10.844598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.844603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:10.844608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.844613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:10.844617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.844621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:10.844626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.844631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:10.844635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.844641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.844645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.844650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.844654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.844658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.844663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.844668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:10.844673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.844678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:10.844718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:10.853602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:10.854230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:10.854252Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:10.854255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:10.854260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:10.854267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 458 [2:7556254893197215181:4919]
2025-10-01T14:08:10.854285Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:10.854304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:10.854307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.854310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.854313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.854330Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:10.854335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:10.854348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:10.854422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.854431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.854433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.854436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:10.854438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:10.854515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:10.854525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.854538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:10.854550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:10.854572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:10.854597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574077664:5447], now have 1 active actors on pipe
2025-10-01T14:08:10.854609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574077541:2446], now have 1 active actors on pipe
2025-10-01T14:08:10.854618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254893197215176:4919]
2025-10-01T14:08:10.854626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254893197215176:4919]
2025-10-01T14:08:10.854628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254893197215176:4919]
2025-10-01T14:08:10.854640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:10.854654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:10.854656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:10.854660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:10.854662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:10.854673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:10.854676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:10.854716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254893197215176:4919]
2025-10-01T14:08:10.854727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:10.854734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:10.855025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 458
2025-10-01T14:08:10.855062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 458
2025-10-01T14:08:10.855299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.855322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.855364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:10.855381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:10.855385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:10.855388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:10.855399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:10.855410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:10.855433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:10.855645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.855658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.855675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:10.855748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 459 partition: 0 MaxSeqNo: 45 sessionId: src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0
2025-10-01T14:08:10.856175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90da7ca3-71e853a3-20b76379-b9b0227_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:10.858993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0] Write session: try to update token
2025-10-01T14:08:10.859014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:10.874125Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:10.874148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:10.874159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254893197215176:4919]
2025-10-01T14:08:10.874212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:10.874418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:10.874580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:10.874765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:10.874951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:10.875205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:10.875252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:10.875385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:10.881903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 459 sessionId: src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:10.884555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:10.887193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:10.887224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:10.887265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:10.887466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:10.894795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:10.894820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:10.894822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:10.894824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:10.894833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254893197215176:4919]
2025-10-01T14:08:10.894837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254893197215176:4919]
2025-10-01T14:08:10.894840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254893197215176:4919]
2025-10-01T14:08:10.894882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:10.894886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:10.894889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:10.894891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:10.894891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:10.894894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:10.895032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:10.907187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254895574077829:5085]
2025-10-01T14:08:10.907510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 458, pipe: [1:7556254895574077829:5085]
2025-10-01T14:08:11.038308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:11.046738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.046771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.046947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.047011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.047076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.047149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.047587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.047603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.047676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.047739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.047806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.047876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.047982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.047990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.048058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.048119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.048180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.048244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.048292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.048299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.048360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.048423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.048489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.048550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.048592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.048599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.048697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.048807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.048867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.048929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.048973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.048982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.049049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.049114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.049180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.049248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.049293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.049302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.049368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.049426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.049489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.049555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.049622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.049628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.049696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.049756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.049817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.049883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.049934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.049943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.050013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.050076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.050146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.050215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.050341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.050349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.050434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.050499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.050561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.050624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.050668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.050677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.050749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254895574077829:5085], now have 1 active actors on pipe
2025-10-01T14:08:11.051106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254895574077829:5085]
2025-10-01T14:08:11.051113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:11.051118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:11.051138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:11.051151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 459 reason: error at write: Disconnected sessionId: src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0
2025-10-01T14:08:11.051327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 459 sessionId: src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0 is DEAD
2025-10-01T14:08:11.051465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:11.051476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0] Write session will restart in 0.006462s
2025-10-01T14:08:11.051501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0] Write session: Do CDS request
2025-10-01T14:08:11.051507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:11.051471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:11.058890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.058983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:11.059000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 460
2025-10-01T14:08:11.059192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.059231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:11.059240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:11.059244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:11.059643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 460 sessionId:  describe result for acl check
2025-10-01T14:08:11.059668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:11.059676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:11.059678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:11.059681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254899869045144:5451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:11.060120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254899869045144:5451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:11.064840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254899869045144:5451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:11.069315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254899869045144:5451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:11.069334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254899869045144:5451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:11.069338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254899869045144:5451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:11.069347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:11.074297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:11.078490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:11.078744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:11.078757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:11.078768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:11.078822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:11.078870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254897492182762:4921]
2025-10-01T14:08:11.079550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:11.079908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:11.079954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:11.080296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:11.080358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.080366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.080367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.080368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.080369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.080371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.080372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.080373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.080374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.080376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.080377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.080378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.080380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.080382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.080387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.080397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.080401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.080405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.080408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.080412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.080416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.080420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.080424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.080428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.080432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.080436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.080440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.080443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.080451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.080459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.080465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.080472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.080477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.080482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.080486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.080492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.080498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.080504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.080509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.080513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.080518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.080524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.080529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.080535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.080540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.080545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.080550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.080556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.080564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.080569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.080580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.080585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.080589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.080594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.080598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.080608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.080650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:11.084522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:11.085189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:11.085208Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:11.085211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:11.085216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:11.085222Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 459 [2:7556254897492182762:4921]
2025-10-01T14:08:11.085235Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:11.085249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:11.085257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.085260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.085262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.085277Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:11.085283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:11.085290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:11.085341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.085349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.085351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.085353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:11.085355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:11.085418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:11.085428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.085436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.085441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.085450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:11.085463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254897492182757:4921]
2025-10-01T14:08:11.085465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254897492182757:4921]
2025-10-01T14:08:11.085467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254897492182757:4921]
2025-10-01T14:08:11.085474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:11.085483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869045130:2446], now have 1 active actors on pipe
2025-10-01T14:08:11.085485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:11.085489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:11.085490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:11.085491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:11.085498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:11.085500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:11.085504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869045319:5451], now have 1 active actors on pipe
2025-10-01T14:08:11.085527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254897492182757:4921]
2025-10-01T14:08:11.085538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:11.085566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:11.085650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 459
2025-10-01T14:08:11.085667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 459
2025-10-01T14:08:11.085729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.085746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.085775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:11.085789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.085794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.085797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:11.085807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.085826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:11.085846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.086048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.086059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.086073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.086195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 460 partition: 0 MaxSeqNo: 45 sessionId: src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0
2025-10-01T14:08:11.086609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4eceda6-1f2c519c-e49161ec-e90d91e8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:11.089088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0] Write session: try to update token
2025-10-01T14:08:11.089109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:11.097960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:11.097987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:11.097997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254897492182757:4921]
2025-10-01T14:08:11.098054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:11.098053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:11.098239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:11.098421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:11.098572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:11.098715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:11.098904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:11.098940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:11.104837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 460 sessionId: src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:11.107292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:11.107557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.107589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.107628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:11.107742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:11.118348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:11.118390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:11.118393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:11.118395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:11.118405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254897492182757:4921]
2025-10-01T14:08:11.118410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254897492182757:4921]
2025-10-01T14:08:11.118415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254897492182757:4921]
2025-10-01T14:08:11.118468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:11.118466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:11.118474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:11.118476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.118478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:11.118478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:11.118675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:11.151411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254899869045421:5085]
2025-10-01T14:08:11.151700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 459, pipe: [1:7556254899869045421:5085]
2025-10-01T14:08:11.260881Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:11.270162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.270199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.270410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.270483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.270553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.270627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.270678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.270687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.270763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.270830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.270902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.270976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.271035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.271043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.271116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.271185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.271259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.271328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.271378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.271389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.271455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.271521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.271586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.271654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.271699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.271706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.271773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.271837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.271900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.271967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.272013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.272021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.272087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.272152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.272219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.272286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.272333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.272340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.272405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.272469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.272534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.272599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.272644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.272656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.272721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.272785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.272863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.272932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.272980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.272988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.273058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.273130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.273198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.273318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.273372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.273380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.273451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.273517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.273616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.273682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.273744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.273751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.273819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869045421:5085], now have 1 active actors on pipe
2025-10-01T14:08:11.274169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:11.274192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:11.274215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254899869045421:5085]
2025-10-01T14:08:11.274224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 460 reason: error at write: Disconnected sessionId: src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0
2025-10-01T14:08:11.274264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:11.274467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 460 sessionId: src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0 is DEAD
2025-10-01T14:08:11.274601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:11.274613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0] Write session will restart in 0.005158s
2025-10-01T14:08:11.274639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0] Write session: Do CDS request
2025-10-01T14:08:11.274646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:11.275036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:11.280965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.281041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:11.281058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 461
2025-10-01T14:08:11.281225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.281273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:11.281287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:11.281291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:11.282074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 461 sessionId:  describe result for acl check
2025-10-01T14:08:11.282106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:11.282117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:11.282119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:11.282123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254899869045453:5457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:11.282573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254899869045453:5457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:11.285201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254899869045453:5457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:11.291191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254899869045453:5457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:11.291209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254899869045453:5457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:11.291213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254899869045453:5457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:11.291222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:11.317809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:11.318698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:11.318927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:11.318931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:11.318941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:11.318990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:11.319023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254897492183063:4924]
2025-10-01T14:08:11.319648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:11.319976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:11.320021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:11.320285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:11.320339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.320347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.320348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.320349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.320349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.320350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.320351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.320352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.320353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.320354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.320354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.320355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.320356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.320357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.320360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.320367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.320370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.320373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.320375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.320377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.320380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.320382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.320385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.320388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.320390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.320392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.320395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.320397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.320401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.320406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.320410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.320414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.320416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.320423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.320425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.320429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.320432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.320435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.320438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.320440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.320443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.320446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.320449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.320451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.320454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.320457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.320460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.320462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.320465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.320467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.320470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.320472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.320475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.320478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.320480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.320483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.320505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:11.324542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:11.325298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:11.325318Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:11.325322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:11.325327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:11.325335Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 460 [2:7556254897492183063:4924]
2025-10-01T14:08:11.325355Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:11.325374Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:11.325383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.325387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.325389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.325405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:11.325411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:11.325418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:11.325481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.325490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.325492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.325495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:11.325499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:11.325578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:11.325589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.325599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.325615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.325632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:11.325654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254897492183058:4924]
2025-10-01T14:08:11.325661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254897492183058:4924]
2025-10-01T14:08:11.325664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254897492183058:4924]
2025-10-01T14:08:11.325675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:11.325693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:11.325712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:11.325719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:11.325752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254897492183058:4924]
2025-10-01T14:08:11.325759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:11.325843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:11.325850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:11.325852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:11.325858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:11.326223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 460
2025-10-01T14:08:11.326270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 460
2025-10-01T14:08:11.326099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869045531:5457], now have 1 active actors on pipe
2025-10-01T14:08:11.326115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869045445:2446], now have 1 active actors on pipe
2025-10-01T14:08:11.326403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.326414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.326448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:11.326457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.326462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.326472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:11.326484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.326497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:11.326512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.328526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.328540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.328567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.328715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 461 partition: 0 MaxSeqNo: 45 sessionId: src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0
2025-10-01T14:08:11.329112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10bd0d6e-6b1d94e9-6d52be68-c63d8872_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:11.331632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0] Write session: try to update token
2025-10-01T14:08:11.331652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:11.349323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:11.349351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:11.349354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:11.349357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:11.349370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254897492183058:4924]
2025-10-01T14:08:11.349375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254897492183058:4924]
2025-10-01T14:08:11.349380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254897492183058:4924]
2025-10-01T14:08:11.349433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:11.349441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.349444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:11.349646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:11.349659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:11.349662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:11.349764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:11.350543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 461 sessionId: src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:11.352951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:11.374126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254899869045739:5085]
2025-10-01T14:08:11.374617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 460, pipe: [1:7556254899869045739:5085]
2025-10-01T14:08:11.488306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:11.488865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.488879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.488914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869045739:5085], now have 1 active actors on pipe
2025-10-01T14:08:11.489276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254899869045739:5085]
2025-10-01T14:08:11.489312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:11.489335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:11.489357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:11.489454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 461 reason: error at write: Disconnected sessionId: src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0
2025-10-01T14:08:11.489661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 461 sessionId: src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0 is DEAD
2025-10-01T14:08:11.489721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:11.489799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:11.489808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0] Write session will restart in 0.007038s
2025-10-01T14:08:11.489831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0] Write session: Do CDS request
2025-10-01T14:08:11.489835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:11.497870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.497980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:11.497998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 462
2025-10-01T14:08:11.498175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.498221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:11.498229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:11.498234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:11.498730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 462 sessionId:  describe result for acl check
2025-10-01T14:08:11.498771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:11.498772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:11.498774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:11.498779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254899869045756:5461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:11.499310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254899869045756:5461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:11.501317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254899869045756:5461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:11.505251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254899869045756:5461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:11.505276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254899869045756:5461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:11.505279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254899869045756:5461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:11.505289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:11.514990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:11.518917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:11.519160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:11.519173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:11.519185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:11.519247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:11.519295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254897492183352:4927]
2025-10-01T14:08:11.520041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:11.520518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:11.520576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:11.520922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:11.521004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.521012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.521013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.521014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.521015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.521016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.521018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.521019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.521020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.521022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.521023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.521024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.521025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.521026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.521032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.521042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.521046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.521049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.521069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.521073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.521076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.521079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.521082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.521085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.521089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.521092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.521095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.521098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.521107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.521114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.521124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.521128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.521132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.521137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.521142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.521147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.521152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.521156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.521166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.521170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.521175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.521180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.521185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.521190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.521194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.521199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.521204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.521208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.521213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.521220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.521224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.521230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.521238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.521242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.521246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.521252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.521288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:11.525451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:11.526075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:11.526091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:11.526094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:11.526098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:11.526105Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 461 [2:7556254897492183352:4927]
2025-10-01T14:08:11.526123Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:11.526140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:11.526147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.526151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.526153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.526171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:11.526181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:11.526187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:11.526247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.526253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.526254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.526257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:11.526259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:11.526314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:11.526323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.526335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.526346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.526362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:11.526399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254897492183347:4927]
2025-10-01T14:08:11.526406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254897492183347:4927]
2025-10-01T14:08:11.526408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254897492183347:4927]
2025-10-01T14:08:11.526417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:11.526430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:11.526436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:11.526444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:11.526447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:11.526451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:11.526454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:11.526464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869045844:5461], now have 1 active actors on pipe
2025-10-01T14:08:11.526474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869045742:2446], now have 1 active actors on pipe
2025-10-01T14:08:11.526505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254897492183347:4927]
2025-10-01T14:08:11.526520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:11.526544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:11.526577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 461
2025-10-01T14:08:11.526586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 461
2025-10-01T14:08:11.526659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.526671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.526705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:11.526717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.526721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.526724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:11.526734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.526748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:11.526767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.526918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.526929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.526947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.527029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 462 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0
2025-10-01T14:08:11.527392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d541e4d-a1d2b18e-b45c2aa4-89446209_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:11.529714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0] Write session: try to update token
2025-10-01T14:08:11.529730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:11.546738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 462 sessionId: src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:11.549324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:11.550601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.550626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.550648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:11.550651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:11.550653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:11.550655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:11.550663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254897492183347:4927]
2025-10-01T14:08:11.550667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254897492183347:4927]
2025-10-01T14:08:11.550671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254897492183347:4927]
2025-10-01T14:08:11.550723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:11.550731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:11.550733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:11.550734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:11.550740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.550742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:11.550889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:11.589690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254899869046058:5085]
2025-10-01T14:08:11.590028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 461, pipe: [1:7556254899869046058:5085]
2025-10-01T14:08:11.700070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:11.700620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:11.700682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869046058:5085], now have 1 active actors on pipe
2025-10-01T14:08:11.700768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:11.700875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:11.700878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:11.700881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:11.700947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254899869046058:5085]
2025-10-01T14:08:11.700982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 462 reason: error at write: Disconnected sessionId: src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0
2025-10-01T14:08:11.701168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 462 sessionId: src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0 is DEAD
2025-10-01T14:08:11.701299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:11.701314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0] Write session will restart in 0.007367s
2025-10-01T14:08:11.701343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0] Write session: Do CDS request
2025-10-01T14:08:11.701353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:11.709983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.710021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:11.710032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 463
2025-10-01T14:08:11.710270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.710312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:11.710322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:11.710326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:11.710731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 463 sessionId:  describe result for acl check
2025-10-01T14:08:11.710788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:11.710800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:11.710802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:11.710809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254899869046107:5473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:11.711258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254899869046107:5473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:11.714297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254899869046107:5473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:11.718133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254899869046107:5473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:11.718152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254899869046107:5473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:11.718155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254899869046107:5473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:11.718165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:11.722760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:11.727149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:11.727439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:11.727453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:11.727465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:11.727533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:11.727603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254897492183649:4932]
2025-10-01T14:08:11.728255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:11.728627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:11.728682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:11.729055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:11.729139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.729146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.729147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.729148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.729151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.729152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.729153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.729154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.729155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.729156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.729157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.729158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.729159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.729160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.729163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.729170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.729172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.729175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.729177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.729180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.729182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.729184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.729187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.729189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.729191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.729193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.729195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.729197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.729204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.729208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.729212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.729216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.729221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.729225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.729228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.729231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.729235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.729238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.729241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.729245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.729248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.729255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.729258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.729261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.729267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.729270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.729273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.729277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.729279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.729287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.729290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.729296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.729299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.729305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.729308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.729314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.729339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:11.733225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:11.733924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:11.733939Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:11.733943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:11.733946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:11.733952Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 462 [2:7556254897492183649:4932]
2025-10-01T14:08:11.733966Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:11.733982Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:11.733985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.733988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.733991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.734008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:11.734017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:11.734024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:11.734090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.734098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.734101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.734104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:11.734106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:11.734179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:11.734190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.734202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.734211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.734226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:11.734245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869046063:2446], now have 1 active actors on pipe
2025-10-01T14:08:11.734255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869046275:5473], now have 1 active actors on pipe
2025-10-01T14:08:11.734262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254897492183644:4932]
2025-10-01T14:08:11.734267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254897492183644:4932]
2025-10-01T14:08:11.734270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254897492183644:4932]
2025-10-01T14:08:11.734284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:11.734301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:11.734311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:11.734318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:11.734322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:11.734322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:11.734325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:11.734355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254897492183644:4932]
2025-10-01T14:08:11.734382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:11.734387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:11.734359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 462
2025-10-01T14:08:11.735005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 462
2025-10-01T14:08:11.735771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.735790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.735822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:11.735842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.735847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.735849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:11.735863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.735877Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:11.735894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.736310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.736321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.736339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.736433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 463 partition: 0 MaxSeqNo: 45 sessionId: src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0
2025-10-01T14:08:11.736879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca52a95-d1a6e2b8-75e45314-b2df2109_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:11.739861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0] Write session: try to update token
2025-10-01T14:08:11.739882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:11.745677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:11.745700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:11.745710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254897492183644:4932]
2025-10-01T14:08:11.745755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:11.745768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:11.745937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:11.746103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:11.746251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:11.746434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:11.746646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:11.746694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:11.757374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 463 sessionId: src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:11.760249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:11.760486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.760533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.760570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:11.760688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:11.764958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:11.764977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:11.764981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:11.764983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:11.764996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254897492183644:4932]
2025-10-01T14:08:11.765000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254897492183644:4932]
2025-10-01T14:08:11.765008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254897492183644:4932]
2025-10-01T14:08:11.765059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:11.765064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:11.765070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.765071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:11.765073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:11.765077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:11.765220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:11.801117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254899869046359:5085]
2025-10-01T14:08:11.801460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 462, pipe: [1:7556254899869046359:5085]
2025-10-01T14:08:11.902935Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:11.910613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.910634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.910769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.910822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.910874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.910923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.911241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.911251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.911306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.911354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.911405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.911456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.911501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.911509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.911569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.911620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.911673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.911726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.911765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.911770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.911832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.911883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.911937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.911988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.912031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.912039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.912186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.912312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.912365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.912417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.912459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.912466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.912526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.912581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.912636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.912695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.912759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.912767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.912838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.912889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.912946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.912996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.913035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.913041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.913101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.913158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.913207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.913258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.913296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.913301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.913363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.913412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.913475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.913527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.913634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.913637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.913690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:11.913738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:11.913790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:11.913845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:11.913887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:11.913892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:11.913938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869046359:5085], now have 1 active actors on pipe
2025-10-01T14:08:11.914239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254899869046359:5085]
2025-10-01T14:08:11.914260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:11.914283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:11.914285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:11.914560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:11.914630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 463 reason: error at write: Disconnected sessionId: src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0
2025-10-01T14:08:11.914815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 463 sessionId: src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0 is DEAD
2025-10-01T14:08:11.914951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:11.914963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0] Write session will restart in 0.006268s
2025-10-01T14:08:11.914987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0] Write session: Do CDS request
2025-10-01T14:08:11.914993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:11.922749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.922872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:11.922896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 464
2025-10-01T14:08:11.923070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:11.923122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:11.923136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:11.923141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:11.923591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 464 sessionId:  describe result for acl check
2025-10-01T14:08:11.923643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:11.923649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:11.923650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:11.923656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254899869046394:5477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:11.924175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254899869046394:5477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:11.928079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254899869046394:5477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:11.931593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254899869046394:5477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:11.931609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254899869046394:5477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:11.931613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254899869046394:5477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:11.931620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:11.936330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:11.937055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:11.937237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:11.937245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:11.937254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:11.937291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:11.937321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254897492183967:4944]
2025-10-01T14:08:11.937758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:11.939964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:11.940014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:11.940271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:11.940324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.940330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.940332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.940333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.940334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.940335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.940336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.940337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.940338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.940340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.940341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.940342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.940343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.940344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.940349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.940355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.940358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.940360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.940362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.940364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.940366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.940368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.940369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.940371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.940373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.940375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.940377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.940379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.940384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.940389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:11.940393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.940396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:11.940399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.940402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:11.940404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.940407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:11.940409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.940412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:11.940414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.940417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:11.940420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.940423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:11.940425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.940427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:11.940430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.940438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:11.940440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.940443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.940445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.940448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.940450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.940453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.940456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.940458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:11.940460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.940463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:11.940489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:11.944219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:11.945074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:11.945090Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:11.945092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:11.945094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:11.945100Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 463 [2:7556254897492183967:4944]
2025-10-01T14:08:11.945113Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:11.945128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:11.945131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.945133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.945134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.945152Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:11.945158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:11.945178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:11.945231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.945237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.945238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.945241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:11.945243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:11.945301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:11.945306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.945315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:11.945321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:11.945331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:11.945346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254897492183962:4944]
2025-10-01T14:08:11.945351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254897492183962:4944]
2025-10-01T14:08:11.945352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254897492183962:4944]
2025-10-01T14:08:11.945359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:11.945370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:11.945375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:11.945379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:11.945381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:11.945389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:11.945390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869046363:2446], now have 1 active actors on pipe
2025-10-01T14:08:11.945393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:11.945393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254899869046555:5477], now have 1 active actors on pipe
2025-10-01T14:08:11.945422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254897492183962:4944]
2025-10-01T14:08:11.945432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:11.945443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 463
2025-10-01T14:08:11.945452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:11.945498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 463
2025-10-01T14:08:11.945560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.945569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.945591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:11.945598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:11.945602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:11.945604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:11.945611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:11.945617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:11.945628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.945766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.945775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.945785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:11.945891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 464 partition: 0 MaxSeqNo: 45 sessionId: src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0
2025-10-01T14:08:11.946235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|277c7a36-9c6904d6-f661b1a7-d3a6500c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:11.949236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0] Write session: try to update token
2025-10-01T14:08:11.949253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:11.956218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:11.956234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:11.956243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254897492183962:4944]
2025-10-01T14:08:11.956283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:11.956287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:11.956450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:11.956584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:11.956726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:11.956873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:11.957083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:11.957120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:11.963293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 464 sessionId: src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:11.965777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:11.966028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:11.966051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:11.966089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:11.966161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:11.975672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:11.975687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:11.975690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:11.975692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:11.975712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254897492183962:4944]
2025-10-01T14:08:11.975717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254897492183962:4944]
2025-10-01T14:08:11.975721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254897492183962:4944]
2025-10-01T14:08:11.975765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:11.975769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:11.975772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:11.975775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:11.975776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:11.975781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:11.975924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:12.014616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254904164013957:5085]
2025-10-01T14:08:12.014998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 463, pipe: [1:7556254904164013957:5085]
2025-10-01T14:08:12.113923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:12.120981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.121005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.121144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.121195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.121251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.121315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.121359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.121368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.121425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.121489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.121551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.121608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.121647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.121656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.121715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.121778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.121831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.121902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.121944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.121950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.122004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.122065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.122126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.122196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.122240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.122248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.122303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.122368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.122447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.122502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.122544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.122550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.122610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.122664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.122712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.122769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.122808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.124182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:12.124200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:12.124234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 464 reason: error at write: Disconnected sessionId: src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0
2025-10-01T14:08:12.122810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.124277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254904164013957:5085]
2025-10-01T14:08:12.122899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.122946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.124301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:12.122997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.123043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.123085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.123086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.123146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.123194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.123241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.123286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.123320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.123322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.123378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.123433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.123486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.123534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.123588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.123592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.123646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.123691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.123737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.123787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.123824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.123827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.123874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164013957:5085], now have 1 active actors on pipe
2025-10-01T14:08:12.124387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 464 sessionId: src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0 is DEAD
2025-10-01T14:08:12.124732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:12.124740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0] Write session will restart in 0.008089s
2025-10-01T14:08:12.124759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0] Write session: Do CDS request
2025-10-01T14:08:12.124764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:12.124783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:12.133904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:12.134005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:12.134028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 465
2025-10-01T14:08:12.134166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:12.134195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:12.134198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:12.134201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:12.134755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 465 sessionId:  describe result for acl check
2025-10-01T14:08:12.134807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:12.134811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:12.134813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:12.134818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254904164014021:5483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:12.135704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254904164014021:5483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:12.138508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254904164014021:5483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:12.142184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254904164014021:5483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:12.142200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254904164014021:5483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:12.142202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254904164014021:5483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:12.142209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:12.144939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:12.148456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:12.148680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:12.148688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:12.148698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:12.148749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:12.148818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254901787151566:4946]
2025-10-01T14:08:12.149400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:12.149691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:12.149732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:12.150025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:12.150077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.150081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.150083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.150083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.150084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.150085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.150085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.150086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.150087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.150087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.150088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.150089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.150089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.150090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.150094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.150100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.150102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.150104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.150106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.150109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.150111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.150113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.150115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.150117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.150120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.150122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.150124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.150127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.150132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.150136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.150140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.150143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.150146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.150149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.150151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.150154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.150157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.150164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.150166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.150170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.150176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.150179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.150182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.150188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.150190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.150194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.150200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.150202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.150208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.150214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.150217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.150220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.150225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.150228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.150231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.150234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.150256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:12.153992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:12.155067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:12.155080Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:12.155082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:12.155086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:12.155091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 464 [2:7556254901787151566:4946]
2025-10-01T14:08:12.155103Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:12.155119Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:12.155121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.155124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.155125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.155137Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:12.155140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:12.155145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:12.155193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.155198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.155199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.155202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:12.155204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:12.155264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:12.155269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.155279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.155288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.155305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:12.155326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254901787151549:4946]
2025-10-01T14:08:12.155332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254901787151549:4946]
2025-10-01T14:08:12.155334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254901787151549:4946]
2025-10-01T14:08:12.155348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:12.155366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164014204:5483], now have 1 active actors on pipe
2025-10-01T14:08:12.155374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164013959:2446], now have 1 active actors on pipe
2025-10-01T14:08:12.155381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:12.155399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:12.155405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:12.155438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254901787151549:4946]
2025-10-01T14:08:12.155445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:12.155448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:12.155415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 464
2025-10-01T14:08:12.155452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:12.155454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:12.155460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:12.155545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 464
2025-10-01T14:08:12.155631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.155639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.155662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:12.155673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.155676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.155679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:12.155688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.155701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:12.155722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:12.155824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.155831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.155843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:12.155910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 465 partition: 0 MaxSeqNo: 45 sessionId: src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0
2025-10-01T14:08:12.156210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d26c6374-23791b57-9adf2ab5-2bea3fae_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:12.158952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0] Write session: try to update token
2025-10-01T14:08:12.158976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:12.172915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 465 sessionId: src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:12.175401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:12.176533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.176552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.176570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:12.176572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:12.176574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:12.176575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:12.176582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254901787151549:4946]
2025-10-01T14:08:12.176586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254901787151549:4946]
2025-10-01T14:08:12.176588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254901787151549:4946]
2025-10-01T14:08:12.176626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:12.176631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:12.176636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.176638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:12.176638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:12.176645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:12.176757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:12.224539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254904164014273:5085]
2025-10-01T14:08:12.224843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 464, pipe: [1:7556254904164014273:5085]
2025-10-01T14:08:12.321609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:12.322110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:12.322170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164014273:5085], now have 1 active actors on pipe
2025-10-01T14:08:12.322255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:12.322391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:12.322480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254904164014273:5085]
2025-10-01T14:08:12.332821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:12.332835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:12.332853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 465 reason: error at write: Disconnected sessionId: src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0
2025-10-01T14:08:12.333035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 465 sessionId: src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0 is DEAD
2025-10-01T14:08:12.333200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:12.333206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0] Write session will restart in 0.007237s
2025-10-01T14:08:12.333224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0] Write session: Do CDS request
2025-10-01T14:08:12.333232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:12.341897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:12.342022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:12.342048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 466
2025-10-01T14:08:12.342216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:12.342265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:12.342277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:12.342280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:12.342739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 466 sessionId:  describe result for acl check
2025-10-01T14:08:12.342789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:12.342796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:12.342798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:12.342804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254904164014437:5489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:12.343301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254904164014437:5489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:12.346161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254904164014437:5489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:12.347461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:12.350822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:12.351044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:12.351056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:12.351065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:12.351117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:12.351156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254901787151859:4950]
2025-10-01T14:08:12.351230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254904164014437:5489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:12.351256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254904164014437:5489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:12.351259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254904164014437:5489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:12.351268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:12.351602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:12.351842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:12.351881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:12.352143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:12.352181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.352186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.352187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.352188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.352189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.352189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.352190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.352191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.352192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.352192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.352193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.352193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.352194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.352195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.352198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.352204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.352207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.352209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.352212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.352214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.352216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.352218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.352221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.352223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.352225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.352228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.352230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.352232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.352237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.352241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.352246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.352249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.352252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.352255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.352258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.352262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.352271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.352275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.352277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.352281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.352283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.352286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.352289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.352292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.352294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.352297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.352300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.352303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.352306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.352309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.352311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.352314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.352317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.352320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.352322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.352326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.352348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:12.356300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:12.357040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:12.357052Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:12.357055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:12.357059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:12.357066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 465 [2:7556254901787151859:4950]
2025-10-01T14:08:12.357081Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:12.357098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:12.357101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.357105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.357107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.357123Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:12.357132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:12.357138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:12.357196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.357202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.357204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.357208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:12.357210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:12.357422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 465
2025-10-01T14:08:12.357422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 465
2025-10-01T14:08:12.357611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:12.357623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.357636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.357648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.357666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:12.357689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164014566:5489], now have 1 active actors on pipe
2025-10-01T14:08:12.357697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164014279:2446], now have 1 active actors on pipe
2025-10-01T14:08:12.357712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.357723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.357746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254901787151854:4950]
2025-10-01T14:08:12.357753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254901787151854:4950]
2025-10-01T14:08:12.357756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254901787151854:4950]
2025-10-01T14:08:12.357770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:12.357788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:12.357795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:12.357800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:12.357802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:12.357806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:12.357811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:12.357825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:12.357837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.357841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.357844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:12.357853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.357862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:12.357896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254901787151854:4950]
2025-10-01T14:08:12.357909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:12.357922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:12.357922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:12.358104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.358114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.358129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:12.358245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 466 partition: 0 MaxSeqNo: 45 sessionId: src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0
2025-10-01T14:08:12.358612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397896ed-770f4174-3500b3b6-e3ca0b8a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:12.361488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0] Write session: try to update token
2025-10-01T14:08:12.361503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:12.368931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:12.368946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:12.368956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254901787151854:4950]
2025-10-01T14:08:12.368994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:12.368998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:12.369165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:12.369304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:12.369451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:12.369589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:12.369840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:12.369884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:12.378601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 466 sessionId: src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:12.381098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:12.381570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.381587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.381620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:12.381712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:12.391518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:12.391540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:12.391543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:12.391544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:12.391555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254901787151854:4950]
2025-10-01T14:08:12.391560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254901787151854:4950]
2025-10-01T14:08:12.391563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254901787151854:4950]
2025-10-01T14:08:12.391615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:12.391625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:12.391628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.391631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:12.391635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:12.391639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:12.391791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:12.422726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254904164014577:5085]
2025-10-01T14:08:12.423181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 465, pipe: [1:7556254904164014577:5085]
2025-10-01T14:08:12.545636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:12.554327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.554359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.554559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.554630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.554704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.554779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.554828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.554838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.554907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.554981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.555045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.555116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.555167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.555175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.555247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.558198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:12.558204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254904164014577:5085]
2025-10-01T14:08:12.558218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:12.558245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 466 reason: error at write: Disconnected sessionId: src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0
2025-10-01T14:08:12.555314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.555383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.555450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.555501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.555504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.555581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.555644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.555708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.555773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.555820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.555822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.555899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.555959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.556018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.556083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.556128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.556130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.556200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.556262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.556326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.556388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.556429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.556431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.556500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.556557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.556624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.556693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.556738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.556741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.556831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.556891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.556956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.557019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.557063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.557066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.557138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.557200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.557266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.557330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.557464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.557467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.557546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:12.557613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:12.557679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:12.557745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:12.557873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:12.557877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:12.557953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164014577:5085], now have 1 active actors on pipe
2025-10-01T14:08:12.558470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 466 sessionId: src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0 is DEAD
2025-10-01T14:08:12.558484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:12.559213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:12.562659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:12.562675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0] Write session will restart in 0.008909s
2025-10-01T14:08:12.562702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0] Write session: Do CDS request
2025-10-01T14:08:12.562710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:12.573658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:12.574148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:12.574167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 467
2025-10-01T14:08:12.574345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:12.574395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:12.574400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:12.574408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:12.574989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 467 sessionId:  describe result for acl check
2025-10-01T14:08:12.575039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:12.575041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:12.575048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:12.575055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254904164014591:5493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:12.575643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254904164014591:5493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:12.579011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254904164014591:5493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:12.589335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254904164014591:5493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:12.589355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254904164014591:5493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:12.589359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254904164014591:5493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:12.589369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:12.621472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:12.625607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:12.625838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:12.625853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:12.625865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:12.625932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:12.625971Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254901787152159:4952]
2025-10-01T14:08:12.626616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:12.626950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:12.627022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:12.627352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:12.627408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.627415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.627416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.627417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.627418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.627420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.627422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.627423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.627424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.627425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.627426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.627429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.627430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.627431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.627437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.627448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.627453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.627457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.627462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.627466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.627470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.627475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.627479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.627483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.627492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.627496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.627501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.627505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.627517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.627529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.627540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.627550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.627556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.627565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.627569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.627578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.627587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.627593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.627598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.627603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.627614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.627620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.627625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.627631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.627637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.627643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.627652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.627657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.627664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.627670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.627679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.627688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.627697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.627706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.627711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.627720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.627760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:12.631938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:12.632895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:12.632908Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:12.632910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:12.632912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:12.632918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 466 [2:7556254901787152159:4952]
2025-10-01T14:08:12.632929Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:12.632944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:12.632946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.632948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.632950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.632963Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:12.632967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:12.632972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:12.633018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.633023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.633025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.633027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:12.633030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:12.633095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:12.633104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.633117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.633132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.633152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:12.633171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164014580:2446], now have 1 active actors on pipe
2025-10-01T14:08:12.633177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164014667:5493], now have 1 active actors on pipe
2025-10-01T14:08:12.633183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254901787152146:4952]
2025-10-01T14:08:12.633185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254901787152146:4952]
2025-10-01T14:08:12.633186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254901787152146:4952]
2025-10-01T14:08:12.633196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:12.633211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:12.633223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:12.633229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:12.633230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:12.633233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:12.633235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:12.633262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254901787152146:4952]
2025-10-01T14:08:12.633244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 466
2025-10-01T14:08:12.633269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:12.633271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 466
2025-10-01T14:08:12.633273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:12.633309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.633318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.633346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cf06f57-78b421a7-b872231d-f848d876_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:12.633358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.633368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.633371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:12.633379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.633389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:12.633411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:12.633598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.633617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.633652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:12.633792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 467 partition: 0 MaxSeqNo: 45 sessionId: src_id|9cf06f57-78b421a7-b872231d-f848d876_0
2025-10-01T14:08:12.638673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3efb934-2b04ef05-124f3bb-4e2ced4a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9cf06f57-78b421a7-b872231d-f848d876_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:12.641838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf06f57-78b421a7-b872231d-f848d876_0] Write session: try to update token
2025-10-01T14:08:12.641861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf06f57-78b421a7-b872231d-f848d876_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:12.655319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:12.655340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:12.655343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:12.655345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:12.655354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254901787152146:4952]
2025-10-01T14:08:12.655362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254901787152146:4952]
2025-10-01T14:08:12.655366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254901787152146:4952]
2025-10-01T14:08:12.655421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:12.655432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.655435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:12.655582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:12.658225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254904164014904:5085]
2025-10-01T14:08:12.658397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:12.658415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:12.658419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:12.658569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 466, pipe: [1:7556254904164014904:5085]
2025-10-01T14:08:12.669746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 467 sessionId: src_id|9cf06f57-78b421a7-b872231d-f848d876_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:12.672204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:12.812748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:12.813250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164014904:5085], now have 1 active actors on pipe
2025-10-01T14:08:12.813308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.813320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.813535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:12.813873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254904164014904:5085]
2025-10-01T14:08:12.813909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:12.813956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:12.813976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 467 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cf06f57-78b421a7-b872231d-f848d876_0
2025-10-01T14:08:12.814186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 467 sessionId: src_id|9cf06f57-78b421a7-b872231d-f848d876_0 is DEAD
2025-10-01T14:08:12.817386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf06f57-78b421a7-b872231d-f848d876_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:12.817402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf06f57-78b421a7-b872231d-f848d876_0] Write session will restart in 0.006812s
2025-10-01T14:08:12.817435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf06f57-78b421a7-b872231d-f848d876_0] Write session: Do CDS request
2025-10-01T14:08:12.817444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf06f57-78b421a7-b872231d-f848d876_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:12.825923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf06f57-78b421a7-b872231d-f848d876_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:12.826287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:12.826303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 468
2025-10-01T14:08:12.826516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:12.826572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:12.826585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:12.826591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:12.827146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 468 sessionId:  describe result for acl check
2025-10-01T14:08:12.827207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:12.827221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:12.827223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:12.827231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254904164014921:5505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:12.828063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254904164014921:5505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:12.831697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254904164014921:5505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:12.837676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254904164014921:5505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:12.837693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254904164014921:5505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:12.837698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254904164014921:5505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:12.837714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:12.850121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:12.855153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:12.855394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:12.855403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:12.855416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:12.855470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:12.855511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254901787152469:4957]
2025-10-01T14:08:12.856127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:12.857149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:12.857204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:12.857542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:12.857610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.857617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.857618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.857619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.857620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.857621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.857622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.857623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.857624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.857625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.857626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.857627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.857628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.857629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.857636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.857645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.857649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.857653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.857657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.857661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.857665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.857668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.857672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.857676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.857679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.857683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.857687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.857690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.857700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.857708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:12.857714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.857719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:12.857723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.857729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:12.857733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.857738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:12.857742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.857747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:12.857751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.857755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:12.857759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.857763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:12.857766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.857772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:12.857776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.857782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:12.857786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.857792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.857797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.857803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.857807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.857811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.857815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.857826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:12.857830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.857835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:12.857878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:12.861989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:12.862698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:12.862709Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:12.862712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:12.862715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:12.862721Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 467 [2:7556254901787152469:4957]
2025-10-01T14:08:12.862736Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:12.862751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:12.862759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.862763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.862765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.862782Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:12.862792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:12.862798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:12.862854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.862859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.862860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.862863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:12.862865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:12.863051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:12.863057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.863066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:12.863072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:12.863082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:12.863103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164015016:5505], now have 1 active actors on pipe
2025-10-01T14:08:12.863110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164014907:2446], now have 1 active actors on pipe
2025-10-01T14:08:12.863118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254901787152463:4957]
2025-10-01T14:08:12.863124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254901787152463:4957]
2025-10-01T14:08:12.863126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254901787152463:4957]
2025-10-01T14:08:12.863138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:12.863149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:12.863159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:12.863164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:12.863192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254901787152463:4957]
2025-10-01T14:08:12.863197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:12.863262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:12.863266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:12.863268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:12.863272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:12.863338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 467
2025-10-01T14:08:12.863373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 467
2025-10-01T14:08:12.863576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.863586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.863612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:12.863625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:12.863631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:12.863633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:12.863642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:12.863660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:12.863678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:12.863872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:12.863878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:12.863888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:12.864836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 468 partition: 0 MaxSeqNo: 45 sessionId: src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0
2025-10-01T14:08:12.865307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cf06f57-78b421a7-b872231d-f848d876_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:12.868650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0] Write session: try to update token
2025-10-01T14:08:12.868676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:12.887167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:12.887186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:12.887189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:12.887190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:12.887220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254901787152463:4957]
2025-10-01T14:08:12.887224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254901787152463:4957]
2025-10-01T14:08:12.887229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254901787152463:4957]
2025-10-01T14:08:12.887275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:12.887278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:12.887282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:12.887285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:12.887286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:12.887287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:12.887434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:12.906915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 468 sessionId: src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:12.910364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:12.913729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254904164015207:5085]
2025-10-01T14:08:12.914210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 467, pipe: [1:7556254904164015207:5085]
2025-10-01T14:08:13.039786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:13.040144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.040162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.040186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254904164015207:5085], now have 1 active actors on pipe
2025-10-01T14:08:13.040427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:13.040751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254904164015207:5085]
2025-10-01T14:08:13.040820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:13.040914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 468 reason: status is not ok: tablet will be restarted right now sessionId: src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0
2025-10-01T14:08:13.041063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 468 sessionId: src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0 is DEAD
2025-10-01T14:08:13.041208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:13.041733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:13.041746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0] Write session will restart in 0.005508s
2025-10-01T14:08:13.041776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0] Write session: Do CDS request
2025-10-01T14:08:13.041783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:13.054853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.055121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:13.055137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 469
2025-10-01T14:08:13.055510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.055543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:13.055549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:13.055553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:13.056052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 469 sessionId:  describe result for acl check
2025-10-01T14:08:13.056085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:13.056087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:13.056089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:13.056093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254908458982568:5509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:13.056748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254908458982568:5509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:13.059564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254908458982568:5509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:13.063946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254908458982568:5509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:13.063960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254908458982568:5509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:13.063962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254908458982568:5509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:13.063969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:13.071855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:13.075032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:13.075299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:13.075314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:13.075325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:13.075381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:13.075425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254906082120075:4969]
2025-10-01T14:08:13.076078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:13.076541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:13.076588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:13.076894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:13.076935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.076936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.076936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.076937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.076938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.076939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.076939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.076940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.076941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.076942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.076943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.076944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.076944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.076945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.076949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.076955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.076957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.076959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.076962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.076965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.076968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.076970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.076972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.076974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.076977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.076979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.076981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.076983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.076990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.076995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.077000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.077003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.077006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.077009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.077012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.077016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.077019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.077022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.077024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.077028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.077030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.077033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.077035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.077038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.077041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.077044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.077046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.077049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.077053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.077056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.077058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.077062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.077065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.077068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.077071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.077074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.077097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:13.081612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:13.082839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:13.082856Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:13.082859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:13.082864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:13.082872Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 468 [2:7556254906082120075:4969]
2025-10-01T14:08:13.082890Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:13.082909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:13.082912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.082916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.082918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.082960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:13.082970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:13.082978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:13.083044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.083051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.083053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.083057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:13.083060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:13.083138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:13.083144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.083156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.083165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.083177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:13.083194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254906082120070:4969]
2025-10-01T14:08:13.083197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254906082120070:4969]
2025-10-01T14:08:13.083199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254906082120070:4969]
2025-10-01T14:08:13.083207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:13.083222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:13.083222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:13.083225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:13.083227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:13.083238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:13.083241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:13.083252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458982705:5509], now have 1 active actors on pipe
2025-10-01T14:08:13.083256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458982506:2446], now have 1 active actors on pipe
2025-10-01T14:08:13.083288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254906082120070:4969]
2025-10-01T14:08:13.083295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:13.083355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:13.084285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 468
2025-10-01T14:08:13.084320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 468
2025-10-01T14:08:13.085282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.085296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.085337Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a389c87a-11156068-eb92525a-68f67783_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:13.085348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.085353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.085356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:13.085369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.085384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:13.085400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.086184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.086197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.086217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.086760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 469 partition: 0 MaxSeqNo: 45 sessionId: src_id|a389c87a-11156068-eb92525a-68f67783_0
2025-10-01T14:08:13.087131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91c6edf9-c7c9d1d1-2ee9cd60-e7f87a1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a389c87a-11156068-eb92525a-68f67783_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:13.090828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a389c87a-11156068-eb92525a-68f67783_0] Write session: try to update token
2025-10-01T14:08:13.090847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a389c87a-11156068-eb92525a-68f67783_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:13.112458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:13.112481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:13.112484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:13.112486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:13.112497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254906082120070:4969]
2025-10-01T14:08:13.112501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254906082120070:4969]
2025-10-01T14:08:13.112506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254906082120070:4969]
2025-10-01T14:08:13.112565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:13.112572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.112575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:13.112722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:13.112319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 469 sessionId: src_id|a389c87a-11156068-eb92525a-68f67783_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:13.113343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:13.113359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:13.113364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:13.120205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:13.141066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254908458982808:5085]
2025-10-01T14:08:13.143346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 468, pipe: [1:7556254908458982808:5085]
2025-10-01T14:08:13.264141Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:13.265047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.265069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.265119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458982808:5085], now have 1 active actors on pipe
2025-10-01T14:08:13.265351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:13.265375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:13.265389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:13.265450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 469 reason: error at write: Disconnected sessionId: src_id|a389c87a-11156068-eb92525a-68f67783_0
2025-10-01T14:08:13.265600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 469 sessionId: src_id|a389c87a-11156068-eb92525a-68f67783_0 is DEAD
2025-10-01T14:08:13.265782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:13.265821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254908458982808:5085]
2025-10-01T14:08:13.266687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a389c87a-11156068-eb92525a-68f67783_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:13.266701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a389c87a-11156068-eb92525a-68f67783_0] Write session will restart in 0.005914s
2025-10-01T14:08:13.266728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a389c87a-11156068-eb92525a-68f67783_0] Write session: Do CDS request
2025-10-01T14:08:13.266736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a389c87a-11156068-eb92525a-68f67783_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:13.274747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a389c87a-11156068-eb92525a-68f67783_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.274903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:13.274916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 470
2025-10-01T14:08:13.277203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.277263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:13.277270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:13.277275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:13.277862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 470 sessionId:  describe result for acl check
2025-10-01T14:08:13.277912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:13.277918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:13.277922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:13.277928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254908458982915:5515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:13.278601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254908458982915:5515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:13.281235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254908458982915:5515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:13.286717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254908458982915:5515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:13.286737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254908458982915:5515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:13.286741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254908458982915:5515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:13.286753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:13.286824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:13.289935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:13.290181Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:13.290203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:13.290217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:13.290282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:13.290330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254906082120384:4972]
2025-10-01T14:08:13.290949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:13.291328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:13.291382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:13.291698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:13.291776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.291783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.291784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.291785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.291786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.291787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.291788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.291789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.291790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.291791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.291793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.291794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.291795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.291796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.291802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.291812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.291816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.291820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.291824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.291828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.291831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.291835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.291838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.291842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.291846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.291849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.291853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.291857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.291864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.291873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.291880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.291886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.291891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.291896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.291901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.291907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.291913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.291918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.291927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.291931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.291936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.291941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.291944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.291949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.291953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.291958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.291962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.291971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.291977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.291982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.291986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.291991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.292000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.292005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.292013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.292018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.292062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:13.297931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:13.298744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:13.298762Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:13.298765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:13.298768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:13.298776Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 469 [2:7556254906082120384:4972]
2025-10-01T14:08:13.298793Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:13.298811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:13.298818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.298821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.298824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.298841Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:13.298850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:13.298857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:13.298923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.298930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.298932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.298936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:13.298938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:13.299010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:13.299019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.299032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.299043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.299060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:13.299082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254906082120378:4972]
2025-10-01T14:08:13.299088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254906082120378:4972]
2025-10-01T14:08:13.299090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254906082120378:4972]
2025-10-01T14:08:13.299098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:13.299107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:13.299111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:13.299112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:13.299115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458983122:5515], now have 1 active actors on pipe
2025-10-01T14:08:13.299119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458982832:2446], now have 1 active actors on pipe
2025-10-01T14:08:13.299132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:13.299146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:13.299149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:13.299187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254906082120378:4972]
2025-10-01T14:08:13.299198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:13.299206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:13.299251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.299260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.299287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:13.299297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.299302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.299304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:13.299314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.299338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:13.299359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.299580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.299588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.299603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.300069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a389c87a-11156068-eb92525a-68f67783_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:13.299193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 469
2025-10-01T14:08:13.299232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 469
2025-10-01T14:08:13.299680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 470 partition: 0 MaxSeqNo: 45 sessionId: src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0
2025-10-01T14:08:13.303326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0] Write session: try to update token
2025-10-01T14:08:13.303344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:13.318726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:13.318758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:13.318772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254906082120378:4972]
2025-10-01T14:08:13.318826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:13.318827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:13.319044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:13.319221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:13.319385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:13.319551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:13.319793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:13.319844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:13.322755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 470 sessionId: src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:13.325990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:13.326251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.326276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.326316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:13.326453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:13.332998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:13.333022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:13.333025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:13.333028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:13.333040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254906082120378:4972]
2025-10-01T14:08:13.333045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254906082120378:4972]
2025-10-01T14:08:13.333050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254906082120378:4972]
2025-10-01T14:08:13.333105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:13.333109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:13.333116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:13.333119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.333120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:13.333122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:13.333385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:13.365808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254908458983135:5085]
2025-10-01T14:08:13.366075Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 469, pipe: [1:7556254908458983135:5085]
2025-10-01T14:08:13.478832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:13.485775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.485800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.485936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.485987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.486043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.486104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.486330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.486339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.486414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.486468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.486525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.486582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.486633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.486638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.486698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.486753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.486831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.486889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.486938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.486944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.487003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.487058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.487110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.487163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.487204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.487209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.487266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.487318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.487371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.487426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.487466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.487472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.487528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.487582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.487639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.487695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.487742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.487749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.487809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.487861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.487914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.487967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.488163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.488171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.488221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.488269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.488324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.488375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.488414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.488418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.488475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.488529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.488587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.488644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.488684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.488690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.488746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:13.488814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:13.488870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:13.488923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:13.488964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:13.488970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:13.489015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458983135:5085], now have 1 active actors on pipe
2025-10-01T14:08:13.489234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:13.489248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:13.489278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 470 reason: error at write: Disconnected sessionId: src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0
2025-10-01T14:08:13.489321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254908458983135:5085]
2025-10-01T14:08:13.489348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:13.489504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 470 sessionId: src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0 is DEAD
2025-10-01T14:08:13.489442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:13.489642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:13.489657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0] Write session will restart in 0.005847s
2025-10-01T14:08:13.489696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0] Write session: Do CDS request
2025-10-01T14:08:13.489702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:13.496922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.497405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:13.497419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 471
2025-10-01T14:08:13.497524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.497557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:13.497568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:13.497575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:13.497993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 471 sessionId:  describe result for acl check
2025-10-01T14:08:13.498031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:13.498038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:13.498040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:13.498047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254908458983156:5519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:13.498597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254908458983156:5519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:13.502111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254908458983156:5519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:13.505786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254908458983156:5519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:13.505804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254908458983156:5519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:13.505808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254908458983156:5519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:13.505817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:13.511223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:13.513858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:13.514041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:13.514049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:13.514058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:13.514094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:13.514124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254906082120682:4975]
2025-10-01T14:08:13.514608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:13.514906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:13.514952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:13.515260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:13.515331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.515338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.515339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.515340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.515341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.515342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.515343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.515344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.515345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.515346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.515347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.515348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.515349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.515350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.515356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.515366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.515369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.515373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.515376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.515380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.515383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.515387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.515390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.515394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.515397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.515400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.515404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.515407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.515414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.515421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.515427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.515433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.515438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.515443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.515447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.515452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.515458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.515462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.515468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.515471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.515475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.515485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.515491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.515499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.515504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.515512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.515517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.515525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.515532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.515541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.515545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.515549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.515553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.515558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.515561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.515566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.515600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:13.520758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:13.521372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:13.521388Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:13.521391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:13.521395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:13.521402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 470 [2:7556254906082120682:4975]
2025-10-01T14:08:13.521418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:13.521437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:13.521444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.521448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.521450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.521467Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:13.521476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:13.521482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:13.521538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.521544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.521547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.521550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:13.521553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:13.521622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:13.521630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.521643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.521659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.521678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:13.521700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458983138:2446], now have 1 active actors on pipe
2025-10-01T14:08:13.521708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458983322:5519], now have 1 active actors on pipe
2025-10-01T14:08:13.521715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254906082120677:4975]
2025-10-01T14:08:13.521718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254906082120677:4975]
2025-10-01T14:08:13.521720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254906082120677:4975]
2025-10-01T14:08:13.521734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:13.521749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:13.521764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:13.521769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:13.521773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:13.521773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:13.521775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:13.521811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254906082120677:4975]
2025-10-01T14:08:13.521819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:13.521821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:13.521852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.521860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.521756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 470
2025-10-01T14:08:13.521778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 470
2025-10-01T14:08:13.521889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:13.521899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.521903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.521906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:13.521914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.521927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:13.521952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.522085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.522093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.522107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.522179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 471 partition: 0 MaxSeqNo: 45 sessionId: src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0
2025-10-01T14:08:13.522531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dbe861d-52cdc6ca-e7abc1d8-9ec274dd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:13.525288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0] Write session: try to update token
2025-10-01T14:08:13.525311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:13.539062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 471 sessionId: src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:13.541643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:13.542548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.542572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.542591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:13.542593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:13.542595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:13.542597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:13.542603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254906082120677:4975]
2025-10-01T14:08:13.542607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254906082120677:4975]
2025-10-01T14:08:13.542610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254906082120677:4975]
2025-10-01T14:08:13.542656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:13.542659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:13.542664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.542666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:13.542670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:13.542673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:13.542798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:13.589568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254908458983441:5085]
2025-10-01T14:08:13.589944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 470, pipe: [1:7556254908458983441:5085]
2025-10-01T14:08:13.690619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:13.691350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:13.691401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458983441:5085], now have 1 active actors on pipe
2025-10-01T14:08:13.691505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:13.691641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:13.691706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254908458983441:5085]
2025-10-01T14:08:13.701889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:13.701905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:13.701930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 471 reason: error at write: Disconnected sessionId: src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0
2025-10-01T14:08:13.702103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 471 sessionId: src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0 is DEAD
2025-10-01T14:08:13.702235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:13.702246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0] Write session will restart in 0.005051s
2025-10-01T14:08:13.702271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0] Write session: Do CDS request
2025-10-01T14:08:13.702280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:13.708902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.709533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:13.709551Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 472
2025-10-01T14:08:13.709693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.709726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:13.709736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:13.709740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:13.710139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 472 sessionId:  describe result for acl check
2025-10-01T14:08:13.710175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:13.710180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:13.710182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:13.710186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254908458983603:5531] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:13.710680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254908458983603:5531] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:13.713086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254908458983603:5531] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:13.716171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254908458983603:5531] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:13.716186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254908458983603:5531] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:13.716190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254908458983603:5531] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:13.716197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:13.716206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:13.719731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:13.720004Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:13.720014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:13.720025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:13.720075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:13.720113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254906082120988:4980]
2025-10-01T14:08:13.720723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:13.721043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:13.721086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:13.721330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:13.721398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.721404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.721405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.721406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.721408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.721409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.721410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.721411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.721412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.721414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.721424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.721425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.721426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.721427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.721433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.721443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.721447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.721451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.721455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.721459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.721463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.721465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.721467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.721469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.721471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.721473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.721475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.721477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.721482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.721487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.721491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.721494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.721497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.721500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.721503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.721507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.721512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.721517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.721522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.721527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.721532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.721537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.721542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.721547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.721551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.721556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.721560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.721565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.721575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.721580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.721587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.721593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.721598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.721607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.721611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.721620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.721662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:13.725731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:13.726338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:13.726353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:13.726355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:13.726358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:13.726364Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 471 [2:7556254906082120988:4980]
2025-10-01T14:08:13.726407Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:13.726432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:13.726435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.726439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.726442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.726460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:13.726467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:13.726474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:13.726534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.726540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.726542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.726544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:13.726546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:13.726596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:13.726602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.726610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.726619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.726629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:13.726646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254906082120982:4980]
2025-10-01T14:08:13.726653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254906082120982:4980]
2025-10-01T14:08:13.726655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254906082120982:4980]
2025-10-01T14:08:13.726665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:13.726670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:13.726674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:13.726676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:13.726681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:13.726695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:13.726706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:13.726721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458983760:5531], now have 1 active actors on pipe
2025-10-01T14:08:13.726730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458983471:2446], now have 1 active actors on pipe
2025-10-01T14:08:13.726778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254906082120982:4980]
2025-10-01T14:08:13.726792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:13.726800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:13.726765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 471
2025-10-01T14:08:13.726767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 471
2025-10-01T14:08:13.726828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.726838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.727044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d98c82e8-f4448303-21ded009-90caf7f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:13.727060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.727065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.727067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:13.727077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.727087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:13.727123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.727292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.727300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.727315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.729745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 472 partition: 0 MaxSeqNo: 45 sessionId: src_id|d98c82e8-f4448303-21ded009-90caf7f5_0
2025-10-01T14:08:13.730217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ad1fa7b-53ae0476-ac86d172-bd90fdd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d98c82e8-f4448303-21ded009-90caf7f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:13.732662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d98c82e8-f4448303-21ded009-90caf7f5_0] Write session: try to update token
2025-10-01T14:08:13.732685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d98c82e8-f4448303-21ded009-90caf7f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:13.748769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:13.748783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:13.748786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:13.748787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:13.748809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254906082120982:4980]
2025-10-01T14:08:13.748815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254906082120982:4980]
2025-10-01T14:08:13.748818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254906082120982:4980]
2025-10-01T14:08:13.748867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:13.748874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.748877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:13.749007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:13.749255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:13.749261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:13.749265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:13.760393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 472 sessionId: src_id|d98c82e8-f4448303-21ded009-90caf7f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:13.762652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:13.794566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254908458983773:5085]
2025-10-01T14:08:13.794995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 471, pipe: [1:7556254908458983773:5085]
2025-10-01T14:08:13.894956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:13.895472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.895485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.895504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458983773:5085], now have 1 active actors on pipe
2025-10-01T14:08:13.895762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:13.895858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254908458983773:5085]
2025-10-01T14:08:13.895892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:13.895957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 472 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d98c82e8-f4448303-21ded009-90caf7f5_0
2025-10-01T14:08:13.896325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98c82e8-f4448303-21ded009-90caf7f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:13.896342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98c82e8-f4448303-21ded009-90caf7f5_0] Write session will restart in 0.007925s
2025-10-01T14:08:13.896392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98c82e8-f4448303-21ded009-90caf7f5_0] Write session: Do CDS request
2025-10-01T14:08:13.896399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98c82e8-f4448303-21ded009-90caf7f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:13.896121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 472 sessionId: src_id|d98c82e8-f4448303-21ded009-90caf7f5_0 is DEAD
2025-10-01T14:08:13.896234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:13.906265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d98c82e8-f4448303-21ded009-90caf7f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.906747Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:13.906760Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 473
2025-10-01T14:08:13.907339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:13.907400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:13.907416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:13.907431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:13.907897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 473 sessionId:  describe result for acl check
2025-10-01T14:08:13.907942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:13.907947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:13.907949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:13.907955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254908458983844:5535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:13.908553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254908458983844:5535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:13.915905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254908458983844:5535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:13.919665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254908458983844:5535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:13.919686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254908458983844:5535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:13.919691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254908458983844:5535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:13.919701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:13.921217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:13.926411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:13.926702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:13.926713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:13.926725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:13.926784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:13.926827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254906082121299:4988]
2025-10-01T14:08:13.927471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:13.931544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:13.931631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:13.931996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:13.932055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.932062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.932063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.932065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.932066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.932067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.932068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.932069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.932071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.932072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.932073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.932074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.932075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.932076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.932083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.932094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.932097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.932102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.932106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.932111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.932115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.932119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.932123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.932128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.932131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.932136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.932140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.932144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.932152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.932161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:13.932168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.932173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:13.932178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.932184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:13.932188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.932194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:13.932199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.932204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:13.932210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.932221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:13.932226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.932231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:13.932239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.932245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:13.932254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.932259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:13.932268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.932273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.932283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.932293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.932297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.932303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.932311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.932317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:13.932326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.932330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:13.932376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:13.938016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:13.938862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:13.938875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:13.938876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:13.938879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:13.938884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 472 [2:7556254906082121299:4988]
2025-10-01T14:08:13.938898Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:13.938917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:13.938924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.938927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.938929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.938945Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:13.938950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:13.938956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:13.939012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.939017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.939018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.939021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:13.939023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:13.939077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:13.939082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.939090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:13.939096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:13.939108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:13.939122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254906082121294:4988]
2025-10-01T14:08:13.939128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254906082121294:4988]
2025-10-01T14:08:13.939130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254906082121294:4988]
2025-10-01T14:08:13.939138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:13.939157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:13.939157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:13.939163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:13.939166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:13.939172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:13.939175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:13.939186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458983775:2446], now have 1 active actors on pipe
2025-10-01T14:08:13.939217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458984066:5535], now have 1 active actors on pipe
2025-10-01T14:08:13.939222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254906082121294:4988]
2025-10-01T14:08:13.939231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:13.939351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:13.939301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 472
2025-10-01T14:08:13.939394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 472
2025-10-01T14:08:13.939539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.939553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.939585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:13.939598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:13.939603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:13.939609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:13.939619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:13.939633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:13.939654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.940027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:13.940037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:13.940056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:13.940179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 473 partition: 0 MaxSeqNo: 45 sessionId: src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0
2025-10-01T14:08:13.945582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d98c82e8-f4448303-21ded009-90caf7f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:13.948561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0] Write session: try to update token
2025-10-01T14:08:13.948585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:13.961683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:13.961702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:13.961705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:13.961707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:13.961717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254906082121294:4988]
2025-10-01T14:08:13.961723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254906082121294:4988]
2025-10-01T14:08:13.961727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254906082121294:4988]
2025-10-01T14:08:13.961780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:13.961792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:13.961791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:13.961796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:13.961799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:13.961799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:13.961948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:13.971079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 473 sessionId: src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:13.974287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:13.996082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254908458984081:5085]
2025-10-01T14:08:13.996418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 472, pipe: [1:7556254908458984081:5085]
2025-10-01T14:08:14.106107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:14.106450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.106469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.106492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254908458984081:5085], now have 1 active actors on pipe
2025-10-01T14:08:14.106793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:14.106857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:14.106874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254908458984081:5085]
2025-10-01T14:08:14.106892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:14.106897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:14.106959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 473 reason: error at write: Disconnected sessionId: src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0
2025-10-01T14:08:14.107168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 473 sessionId: src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0 is DEAD
2025-10-01T14:08:14.107406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:14.107415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0] Write session will restart in 0.009114s
2025-10-01T14:08:14.107437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0] Write session: Do CDS request
2025-10-01T14:08:14.107442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:14.117891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:14.117978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:14.117994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 474
2025-10-01T14:08:14.118116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:14.118150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:14.118158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:14.118162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:14.119295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 474 sessionId:  describe result for acl check
2025-10-01T14:08:14.119338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:14.119343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:14.119345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:14.119351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254912753951403:5539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:14.120051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254912753951403:5539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:14.126724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254912753951403:5539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:14.129960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254912753951403:5539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:14.129977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254912753951403:5539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:14.129980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254912753951403:5539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:14.129992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:14.145267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:14.148059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:14.148247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:14.148255Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:14.148264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:14.148298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:14.148332Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254910377088911:4994]
2025-10-01T14:08:14.148724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:14.149062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:14.149107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:14.149371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:14.149414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.149418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.149419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.149420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.149421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.149422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.149423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.149423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.149424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.149425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.149426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.149427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.149427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.149428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.149431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.149437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.149439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.149441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.149443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.149446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.149448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.149450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.149452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.149454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.149456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.149459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.149461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.149463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.149469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.149474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.149477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.149481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.149484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.149487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.149489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.149492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.149495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.149498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.149500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.149503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.149505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.149508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.149511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.149513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.149516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.149519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.149523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.149528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.149535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.149540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.149544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.149548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.149552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.149557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.149559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.149563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.149593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:14.154942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:14.156195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:14.156201Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:14.156203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:14.156206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:14.156213Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 473 [2:7556254910377088911:4994]
2025-10-01T14:08:14.156225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:14.156239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:14.156241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.156243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.156244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.156257Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:14.156260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:14.156265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:14.156313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.156315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.156317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.156319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:14.156321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:14.156385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:14.156387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.156396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.156402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.156411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:14.156424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254910377088906:4994]
2025-10-01T14:08:14.156426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254910377088906:4994]
2025-10-01T14:08:14.156428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254910377088906:4994]
2025-10-01T14:08:14.156434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:14.156445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:14.156453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:14.156455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:14.156463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753951526:5539], now have 1 active actors on pipe
2025-10-01T14:08:14.156465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753951379:2446], now have 1 active actors on pipe
2025-10-01T14:08:14.156465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:14.156470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:14.156473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:14.156493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254910377088906:4994]
2025-10-01T14:08:14.156499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:14.156518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:14.156809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 473
2025-10-01T14:08:14.156863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 473
2025-10-01T14:08:14.156940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.156956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.156983Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:14.156996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.157004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.157007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:14.157016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.157031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:14.157047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:14.157252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.157262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.157277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:14.157380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 474 partition: 0 MaxSeqNo: 45 sessionId: src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0
2025-10-01T14:08:14.157742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7adfc5c-77a428b7-431dcac5-82c73f42_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:14.160810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0] Write session: try to update token
2025-10-01T14:08:14.160831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:14.171695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:14.171716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:14.171726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254910377088906:4994]
2025-10-01T14:08:14.171774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:14.171959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:14.172095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:14.172227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:14.172356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:14.172559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:14.172594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:14.172775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:14.180078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 474 sessionId: src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:14.183227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:14.183856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:14.183658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.183684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.183733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:14.206896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:14.206919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:14.206923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:14.206925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:14.206937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254910377088906:4994]
2025-10-01T14:08:14.206942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254910377088906:4994]
2025-10-01T14:08:14.206946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254910377088906:4994]
2025-10-01T14:08:14.206996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:14.207003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.207007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:14.206995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254912753951691:5085]
2025-10-01T14:08:14.207166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:14.210437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:14.210460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:14.210464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:14.210627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 473, pipe: [1:7556254912753951691:5085]
2025-10-01T14:08:14.357325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:14.357696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753951691:5085], now have 1 active actors on pipe
2025-10-01T14:08:14.364853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.364885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.365033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.365092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.365147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.365207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.365561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.365572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.365638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.365692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.365747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.365814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.365857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.365873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.365939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.366002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.366062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.366116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.366156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.366162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.366218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.366279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.366336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.366407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.366452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.366461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.366521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.366577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.366637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.366692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.366735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.366740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.366798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.366853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.366909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.366970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.367016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.367017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.367070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.367126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.367183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.367235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.367281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.367289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.367351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.367410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.367473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.367530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.367576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.367583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.367645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.367703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.367756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.367815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.367861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.367870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.367930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.367990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.368048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.368100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.368161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.368169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.368497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254912753951691:5085]
2025-10-01T14:08:14.368531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:14.368634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:14.368648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:14.368680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 474 reason: error at write: Disconnected sessionId: src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0
2025-10-01T14:08:14.368873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 474 sessionId: src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0 is DEAD
2025-10-01T14:08:14.369048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:14.369064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0] Write session will restart in 0.006937s
2025-10-01T14:08:14.369051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:14.369089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0] Write session: Do CDS request
2025-10-01T14:08:14.369095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:14.376963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:14.377108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:14.377129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 475
2025-10-01T14:08:14.377313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:14.377346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:14.377356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:14.377361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:14.377827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 475 sessionId:  describe result for acl check
2025-10-01T14:08:14.377868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:14.377870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:14.377873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:14.377879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254912753951764:5545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:14.378454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254912753951764:5545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:14.380973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254912753951764:5545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:14.386498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254912753951764:5545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:14.386517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254912753951764:5545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:14.386520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254912753951764:5545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:14.386533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:14.386560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:14.386928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:14.387109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:14.387122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:14.387133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:14.387182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:14.387219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254910377089226:4998]
2025-10-01T14:08:14.387700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:14.389842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:14.389905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:14.390167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:14.390205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.390210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.390211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.390211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.390212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.390212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.390213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.390214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.390214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.390215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.390215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.390216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.390217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.390217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.390221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.390226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.390229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.390231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.390233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.390235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.390237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.390239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.390241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.390244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.390246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.390250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.390253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.390256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.390262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.390270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.390276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.390279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.390281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.390284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.390286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.390289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.390291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.390294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.390297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.390300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.390304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.390307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.390310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.390313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.390325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.390328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.390330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.390333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.390336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.390339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.390341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.390345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.390347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.390350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.390352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.390355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.390392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:14.394234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:14.395204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:14.395220Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:14.395222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:14.395225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:14.395232Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 474 [2:7556254910377089226:4998]
2025-10-01T14:08:14.395245Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:14.395261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:14.395264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.395267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.395269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.395285Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:14.395290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:14.395296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:14.395348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.395355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.395358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.395361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:14.395364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:14.395424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:14.395431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.395442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.395453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.395472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:14.395494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753951709:2446], now have 1 active actors on pipe
2025-10-01T14:08:14.395506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254910377089220:4998]
2025-10-01T14:08:14.395508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254910377089220:4998]
2025-10-01T14:08:14.395510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254910377089220:4998]
2025-10-01T14:08:14.395523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:14.395534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:14.395537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:14.395539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:14.395539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:14.395551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:14.395554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:14.395559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753952004:5545], now have 1 active actors on pipe
2025-10-01T14:08:14.395587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254910377089220:4998]
2025-10-01T14:08:14.395596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:14.395602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:14.395570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 474
2025-10-01T14:08:14.395625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.395630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.395593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 474
2025-10-01T14:08:14.395662Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:14.395673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.395677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.395679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:14.395687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.395695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:14.395712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:14.395853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.395862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.395875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:14.395969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 475 partition: 0 MaxSeqNo: 45 sessionId: src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0
2025-10-01T14:08:14.396288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|181a3426-ed3afc40-24e58b86-36ea74b6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:14.399045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0] Write session: try to update token
2025-10-01T14:08:14.399066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:14.413353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 475 sessionId: src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:14.415652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:14.416811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.416839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.416858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:14.416860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:14.416862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:14.416863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:14.416870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254910377089220:4998]
2025-10-01T14:08:14.416873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254910377089220:4998]
2025-10-01T14:08:14.416877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254910377089220:4998]
2025-10-01T14:08:14.416920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:14.416930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:14.416930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:14.416934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:14.416937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.416939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:14.417073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:14.468644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254912753952017:5085]
2025-10-01T14:08:14.468982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 474, pipe: [1:7556254912753952017:5085]
2025-10-01T14:08:14.568127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:14.568331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:14.568377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753952017:5085], now have 1 active actors on pipe
2025-10-01T14:08:14.568477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:14.568574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254912753952017:5085]
2025-10-01T14:08:14.568605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:14.578809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:14.578821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:14.578844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 475 reason: error at write: Disconnected sessionId: src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0
2025-10-01T14:08:14.578974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 475 sessionId: src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0 is DEAD
2025-10-01T14:08:14.579136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:14.579148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0] Write session will restart in 0.005472s
2025-10-01T14:08:14.579173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0] Write session: Do CDS request
2025-10-01T14:08:14.579195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:14.585866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:14.585902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:14.585915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 476
2025-10-01T14:08:14.586069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:14.586096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:14.586106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:14.586109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:14.586556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 476 sessionId:  describe result for acl check
2025-10-01T14:08:14.586585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:14.586589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:14.586590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:14.586594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254912753952138:5549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:14.587037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254912753952138:5549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:14.589660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254912753952138:5549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:14.592405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:14.592722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254912753952138:5549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:14.592735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254912753952138:5549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:14.592738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254912753952138:5549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:14.592745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:14.595138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:14.595360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:14.595371Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:14.595383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:14.595430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:14.595466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254910377089527:5000]
2025-10-01T14:08:14.596059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:14.596461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:14.596496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:14.596750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:14.596930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.596939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.596941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.596942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.596943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.596944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.596945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.596946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.596947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.596948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.596949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.596950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.596951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.596952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.596957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.596967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.596971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.596974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.596978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.596981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.596985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.596989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.596992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.596996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.597000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.597003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.597007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.597010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.597017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.597027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.597038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.597044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.597047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.597050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.597053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.597056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.597058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.597061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.597063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.597066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.597069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.597072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.597075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.597080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.597088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.597094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.597101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.597106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.597111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.597116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.597120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.597128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.597133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.597140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.597143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.597149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.597190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:14.604045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 475
2025-10-01T14:08:14.604047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 475
2025-10-01T14:08:14.602518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:14.603638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:14.603645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:14.603648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:14.603651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:14.603658Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 475 [2:7556254910377089527:5000]
2025-10-01T14:08:14.603674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:14.603693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:14.603696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.603699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.603702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.603719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:14.603725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:14.603730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:14.603787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.603788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.603790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.603792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:14.603794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:14.603859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:14.603861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.603870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.603876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.603885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:14.603900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254910377089521:5000]
2025-10-01T14:08:14.603903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254910377089521:5000]
2025-10-01T14:08:14.603905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254910377089521:5000]
2025-10-01T14:08:14.603916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:14.603927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:14.603937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:14.603938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:14.603951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:14.603955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:14.603958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:14.603974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753952316:5549], now have 1 active actors on pipe
2025-10-01T14:08:14.603977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753952019:2446], now have 1 active actors on pipe
2025-10-01T14:08:14.603978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254910377089521:5000]
2025-10-01T14:08:14.603985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:14.604004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:14.604128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.604133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.604158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be14bd28-62397909-93e75f64-1f4970f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:14.604165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.604169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.604172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:14.604181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.604190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:14.604205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:14.604371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.604385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.604410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:14.604554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 476 partition: 0 MaxSeqNo: 45 sessionId: src_id|be14bd28-62397909-93e75f64-1f4970f3_0
2025-10-01T14:08:14.604941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e3f8ff2-4e130824-af8c0436-1fa6bc89_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be14bd28-62397909-93e75f64-1f4970f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:14.607330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be14bd28-62397909-93e75f64-1f4970f3_0] Write session: try to update token
2025-10-01T14:08:14.607350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be14bd28-62397909-93e75f64-1f4970f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:14.623211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 476 sessionId: src_id|be14bd28-62397909-93e75f64-1f4970f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:14.626644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:14.627128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.627162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.627207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:14.627535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:14.629672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:14.629692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:14.629695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:14.629697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:14.629708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254910377089521:5000]
2025-10-01T14:08:14.629711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254910377089521:5000]
2025-10-01T14:08:14.629716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254910377089521:5000]
2025-10-01T14:08:14.629761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:14.629767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.629769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:14.629875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:14.629884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:14.629889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:14.629915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:14.668857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254912753952330:5085]
2025-10-01T14:08:14.669161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 475, pipe: [1:7556254912753952330:5085]
2025-10-01T14:08:14.780879Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:14.788468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.788496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.788657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.788728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.788805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.788869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.788920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.788931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.788999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.789061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.789127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.789195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.789241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.789250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.789310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.789371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.789433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.789489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.789529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.789540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.789593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.789646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.789698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.789747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.789792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.789803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.789856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.789910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.789963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.790016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.790055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.790061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.790115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.790170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.790241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.790309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.790356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.790365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.790444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.790504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.790570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.790636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.790678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.790684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.790751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.790808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.790866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.790934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.790981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.790990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.791055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.791117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.791189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.791253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.791301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.791311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.791375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:14.791435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:14.791497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:14.791553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:14.791595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:14.791600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:14.791658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753952330:5085], now have 1 active actors on pipe
2025-10-01T14:08:14.792012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:14.792030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:14.792065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 476 reason: error at write: Disconnected sessionId: src_id|be14bd28-62397909-93e75f64-1f4970f3_0
2025-10-01T14:08:14.792065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254912753952330:5085]
2025-10-01T14:08:14.792089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:14.792243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 476 sessionId: src_id|be14bd28-62397909-93e75f64-1f4970f3_0 is DEAD
2025-10-01T14:08:14.792592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be14bd28-62397909-93e75f64-1f4970f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:14.792603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be14bd28-62397909-93e75f64-1f4970f3_0] Write session will restart in 0.008434s
2025-10-01T14:08:14.792627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be14bd28-62397909-93e75f64-1f4970f3_0] Write session: Do CDS request
2025-10-01T14:08:14.792635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be14bd28-62397909-93e75f64-1f4970f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:14.792747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:14.801887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be14bd28-62397909-93e75f64-1f4970f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:14.801961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:14.801989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 477
2025-10-01T14:08:14.802140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:14.802171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:14.802180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:14.802184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:14.802647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 477 sessionId:  describe result for acl check
2025-10-01T14:08:14.802681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:14.802685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:14.802687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:14.802702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254912753952379:5561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:14.803261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254912753952379:5561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:14.806490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254912753952379:5561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:14.815064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:14.815542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:14.815536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254912753952379:5561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:14.815552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254912753952379:5561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:14.815555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254912753952379:5561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:14.815564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:14.815736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:14.815746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:14.815756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:14.815802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:14.815846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254910377089839:5005]
2025-10-01T14:08:14.816474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:14.818552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:14.818604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:14.818993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:14.819059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.819064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.819065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.819067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.819068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.819069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.819071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.819072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.819073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.819074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.819075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.819077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.819078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.819079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.819085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.819097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.819101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.819105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.819109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.819113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.819116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.819120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.819123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.819127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.819131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.819135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.819139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.819142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.819150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.819159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:14.819165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.819170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:14.819174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.819180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:14.819185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.819190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:14.819195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.819200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:14.819210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.819216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:14.819225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.819235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:14.819240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.819249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:14.819253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.819263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:14.819271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.819278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.819290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.819300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.819304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.819312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.819318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.819323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:14.819333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.819338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:14.819381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:14.823457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:14.824425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:14.824441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:14.824444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:14.824450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:14.824458Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 476 [2:7556254910377089839:5005]
2025-10-01T14:08:14.824476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:14.824495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:14.824504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.824507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.824510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.824527Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:14.824537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:14.824545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:14.824617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.824625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.824628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.824631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:14.824634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:14.825218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:14.825229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.825246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:14.825264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:14.825289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:14.825314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753952354:2446], now have 1 active actors on pipe
2025-10-01T14:08:14.825323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753952653:5561], now have 1 active actors on pipe
2025-10-01T14:08:14.825344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.825352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.825369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254910377089833:5005]
2025-10-01T14:08:14.825375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254910377089833:5005]
2025-10-01T14:08:14.825379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254910377089833:5005]
2025-10-01T14:08:14.825392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:14.825405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:14.825412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:14.825412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:14.825415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:14.825428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:14.825436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:14.825455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:14.825466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:14.825474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:14.825476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:14.825486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:14.825496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:14.825539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254910377089833:5005]
2025-10-01T14:08:14.825555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:14.825567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:14.825570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:14.825760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.825769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.824857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 476
2025-10-01T14:08:14.824903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 476
2025-10-01T14:08:14.825870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 477 partition: 0 MaxSeqNo: 45 sessionId: src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0
2025-10-01T14:08:14.825783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:14.826282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be14bd28-62397909-93e75f64-1f4970f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:14.829230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0] Write session: try to update token
2025-10-01T14:08:14.829245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:14.847460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 477 sessionId: src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:14.848961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:14.848979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:14.848980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:14.848981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:14.848990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254910377089833:5005]
2025-10-01T14:08:14.848993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254910377089833:5005]
2025-10-01T14:08:14.848996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254910377089833:5005]
2025-10-01T14:08:14.849035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:14.849039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:14.849044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:14.849045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:14.849048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:14.849048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:14.849175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:14.850452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:14.892096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254912753952664:5085]
2025-10-01T14:08:14.892391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 476, pipe: [1:7556254912753952664:5085]
2025-10-01T14:08:14.991634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:14.991882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:14.991896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:14.991932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753952664:5085], now have 1 active actors on pipe
2025-10-01T14:08:14.992086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:14.992170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:14.992224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:14.992288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 477 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0
2025-10-01T14:08:14.992460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254912753952664:5085]
2025-10-01T14:08:14.992465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 477 sessionId: src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0 is DEAD
2025-10-01T14:08:14.992610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:14.992624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0] Write session will restart in 0.007160s
2025-10-01T14:08:14.992651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0] Write session: Do CDS request
2025-10-01T14:08:14.992656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:15.000877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.000973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:15.000990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 478
2025-10-01T14:08:15.001136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.001172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:15.001181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:15.001185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:15.001597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 478 sessionId:  describe result for acl check
2025-10-01T14:08:15.001628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:15.001633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:15.001635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:15.001640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254917048919994:5565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:15.002136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254917048919994:5565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:15.004966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254917048919994:5565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:15.009162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254917048919994:5565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:15.009178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254917048919994:5565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:15.009181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254917048919994:5565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:15.009190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:15.018541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:15.019111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:15.019292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:15.019307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:15.019320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:15.019363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:15.019398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254914672057468:5017]
2025-10-01T14:08:15.019845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:15.020276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:15.020314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:15.020539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:15.020585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.020592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.020593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.020594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.020595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.020596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.020598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.020599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.020600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.020602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.020603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.020605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.020606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.020608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.020613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.020623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.020627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.020632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.020636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.020640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.020644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.020647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.020651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.020656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.020659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.020663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.020667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.020670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.020678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.020686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.020692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.020697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.020701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.020706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.020728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.020737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.020742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.020752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.020756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.020761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.020770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.020775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.020783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.020789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.020804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.020814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.020818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.020828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.020833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.020842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.020849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.020858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.020863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.020872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.020874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.020878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.020904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:15.024691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:15.025847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:15.025861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:15.025863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:15.025867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:15.025873Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 477 [2:7556254914672057468:5017]
2025-10-01T14:08:15.025888Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:15.025904Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:15.025907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.025910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.025912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.025927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:15.025932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:15.025939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:15.025998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.026003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.026005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.026008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:15.026010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:15.026082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:15.026089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.026100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.026108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.026124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:15.026143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254912753952669:2446], now have 1 active actors on pipe
2025-10-01T14:08:15.026151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048920162:5565], now have 1 active actors on pipe
2025-10-01T14:08:15.026159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254914672057463:5017]
2025-10-01T14:08:15.026165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254914672057463:5017]
2025-10-01T14:08:15.026166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254914672057463:5017]
2025-10-01T14:08:15.026180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:15.026196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:15.026198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:15.026208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:15.026210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:15.026210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:15.026213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:15.026198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 477
2025-10-01T14:08:15.026235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 477
2025-10-01T14:08:15.026250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254914672057463:5017]
2025-10-01T14:08:15.026262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:15.026269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:15.026308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.026317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.026339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78667264-76a59212-79e8aba4-34ee586a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:15.026349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.026353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.026358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:15.026385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.026397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:15.026414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.026568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.026576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.026591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.026658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 478 partition: 0 MaxSeqNo: 45 sessionId: src_id|78667264-76a59212-79e8aba4-34ee586a_0
2025-10-01T14:08:15.026963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d77dbcf-ee25b0d-e5a7473f-36bc81fe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|78667264-76a59212-79e8aba4-34ee586a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:15.029607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78667264-76a59212-79e8aba4-34ee586a_0] Write session: try to update token
2025-10-01T14:08:15.029626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78667264-76a59212-79e8aba4-34ee586a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:15.037138Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:15.037161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:15.037172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254914672057463:5017]
2025-10-01T14:08:15.037214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:15.037223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:15.037400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:15.037565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:15.037823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:15.037971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:15.038194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:15.038244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:15.043319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 478 sessionId: src_id|78667264-76a59212-79e8aba4-34ee586a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:15.046307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:15.047191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.047220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.047260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:15.047389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:15.056772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:15.056806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:15.056809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:15.056810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:15.056820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254914672057463:5017]
2025-10-01T14:08:15.056823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254914672057463:5017]
2025-10-01T14:08:15.056827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254914672057463:5017]
2025-10-01T14:08:15.056879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:15.056885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.056887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:15.056920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:15.056936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:15.056941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:15.057031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:15.092812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254917048920274:5085]
2025-10-01T14:08:15.093013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 477, pipe: [1:7556254917048920274:5085]
2025-10-01T14:08:15.185376Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:15.192685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.192710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.192864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.192922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.192982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.193036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.193358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.193370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.193436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.193498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.193551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.193609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.193658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.193661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.193728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.193810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.193882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.193948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.193993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.194000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.194060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.194120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.194177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.194233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.194286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.194292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.194354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.194432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.194494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.194553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.194608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.194619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.194688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.194742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.194802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.194866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.194906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.194911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.194970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.195023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.195090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.195145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.195185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.195190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.195243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.195295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.195348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.195403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.195444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.195449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.195509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.195564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.195619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.195674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.195713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.195718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.195771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.195831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.195883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.195934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.195973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.195978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.196035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048920274:5085], now have 1 active actors on pipe
2025-10-01T14:08:15.196258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:15.196259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254917048920274:5085]
2025-10-01T14:08:15.196274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:15.196275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:15.196296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 478 reason: error at write: Disconnected sessionId: src_id|78667264-76a59212-79e8aba4-34ee586a_0
2025-10-01T14:08:15.196474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 478 sessionId: src_id|78667264-76a59212-79e8aba4-34ee586a_0 is DEAD
2025-10-01T14:08:15.196491Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:15.196647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78667264-76a59212-79e8aba4-34ee586a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:15.196654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78667264-76a59212-79e8aba4-34ee586a_0] Write session will restart in 0.007273s
2025-10-01T14:08:15.196671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78667264-76a59212-79e8aba4-34ee586a_0] Write session: Do CDS request
2025-10-01T14:08:15.196675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78667264-76a59212-79e8aba4-34ee586a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:15.204834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78667264-76a59212-79e8aba4-34ee586a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.204964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:15.204985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 479
2025-10-01T14:08:15.205168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.205205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:15.205216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:15.205224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:15.205674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 479 sessionId:  describe result for acl check
2025-10-01T14:08:15.205716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:15.205723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:15.205725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:15.205731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254917048920316:5570] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:15.206258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254917048920316:5570] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:15.209944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254917048920316:5570] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:15.213542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254917048920316:5570] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:15.213555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254917048920316:5570] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:15.213559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254917048920316:5570] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:15.213567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:15.219707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:15.222971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:15.223200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:15.223211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:15.223221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:15.223273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:15.223321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254914672057785:5020]
2025-10-01T14:08:15.224026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:15.224318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:15.224355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:15.224643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:15.224708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.224717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.224718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.224720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.224721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.224723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.224724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.224725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.224727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.224728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.224729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.224730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.224732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.224733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.224739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.224749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.224752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.224754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.224756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.224758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.224760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.224762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.224765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.224767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.224769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.224771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.224773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.224775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.224781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.224786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.224798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.224804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.224810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.224815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.224820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.224825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.224833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.224839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.224843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.224848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.224853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.224859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.224863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.224868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.224873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.224879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.224883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.224889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.224899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.224903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.224906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.224909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.224914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.224917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.224919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.224922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.224944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:15.228935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:15.230008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:15.230025Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:15.230028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:15.230033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:15.230039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 478 [2:7556254914672057785:5020]
2025-10-01T14:08:15.230054Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:15.230075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:15.230082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.230085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.230087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.230102Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:15.230112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:15.230117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:15.230159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.230164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.230168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.230170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:15.230172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:15.230224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:15.230229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.230236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.230245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.230257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:15.230278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254914672057780:5020]
2025-10-01T14:08:15.230284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254914672057780:5020]
2025-10-01T14:08:15.230286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254914672057780:5020]
2025-10-01T14:08:15.230300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:15.230308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:15.230312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:15.230314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:15.230314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048920287:2446], now have 1 active actors on pipe
2025-10-01T14:08:15.230319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048920484:5570], now have 1 active actors on pipe
2025-10-01T14:08:15.230324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:15.230336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:15.230344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:15.230385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254914672057780:5020]
2025-10-01T14:08:15.230396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:15.230404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:15.230364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 478
2025-10-01T14:08:15.230440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 478
2025-10-01T14:08:15.230489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.230497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.230517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:15.230524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.230532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.230534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:15.230543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.230556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:15.230570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.230704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.230710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.230723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.230814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 479 partition: 0 MaxSeqNo: 45 sessionId: src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0
2025-10-01T14:08:15.231155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78667264-76a59212-79e8aba4-34ee586a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:15.234065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0] Write session: try to update token
2025-10-01T14:08:15.234080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:15.246116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:15.246143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:15.246154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254914672057780:5020]
2025-10-01T14:08:15.246205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:15.246206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:15.246417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:15.246577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:15.246731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:15.246886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:15.247115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:15.247167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:15.250533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 479 sessionId: src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:15.252897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:15.253120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.253145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.253196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:15.253294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:15.260133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:15.260153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:15.260155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:15.260157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:15.260166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254914672057780:5020]
2025-10-01T14:08:15.260170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254914672057780:5020]
2025-10-01T14:08:15.260173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254914672057780:5020]
2025-10-01T14:08:15.260218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:15.260220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:15.260227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.260230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:15.260230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:15.260234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:15.260375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:15.296522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254917048920614:5085]
2025-10-01T14:08:15.296848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 478, pipe: [1:7556254917048920614:5085]
2025-10-01T14:08:15.397681Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:15.407039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.407065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.407207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.407269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.407332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.407391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.407433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.407441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.407500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.407563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.407614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.407673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.407725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.407729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.407800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.407860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.407922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.407981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.408025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.408031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.408093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.408153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.408209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.408267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.408308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.408313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.408381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.408437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.408507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.408571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.408619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.408625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.408690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.408752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.408824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.408888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.408940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.408945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.409012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.409074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.409134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.409197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.409244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.409250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.409316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.409376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.409437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.409497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.409542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.409547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.409614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.409673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.409729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.409786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.409834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.409840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.409897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:15.409953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:15.410010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:15.410068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:15.410110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:15.410116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:15.410173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048920614:5085], now have 1 active actors on pipe
2025-10-01T14:08:15.410458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254917048920614:5085]
2025-10-01T14:08:15.410475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:15.410479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:15.410496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:15.410515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 479 reason: error at write: Disconnected sessionId: src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0
2025-10-01T14:08:15.410762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 479 sessionId: src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0 is DEAD
2025-10-01T14:08:15.410854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:15.410867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0] Write session will restart in 0.007377s
2025-10-01T14:08:15.410904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0] Write session: Do CDS request
2025-10-01T14:08:15.410910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:15.411136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:15.420063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.420199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:15.420217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 480
2025-10-01T14:08:15.420342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.420375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:15.420387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:15.420391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:15.420893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 480 sessionId:  describe result for acl check
2025-10-01T14:08:15.420937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:15.420944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:15.420946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:15.420952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254917048920656:5575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:15.421546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254917048920656:5575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:15.424574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254917048920656:5575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:15.428250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254917048920656:5575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:15.428267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254917048920656:5575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:15.428271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254917048920656:5575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:15.428285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:15.433846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:15.437715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:15.437900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:15.437908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:15.437916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:15.437957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:15.437991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254914672058099:5023]
2025-10-01T14:08:15.438430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:15.439277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:15.439327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:15.439601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:15.439667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.439671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.439672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.439672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.439673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.439673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.439674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.439675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.439676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.439676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.439677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.439678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.439678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.439679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.439682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.439700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.439702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.439705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.439707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.439709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.439712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.439714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.439716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.439719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.439721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.439723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.439725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.439727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.439733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.439737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.439741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.439744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.439746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.439749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.439752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.439754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.439757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.439760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.439762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.439765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.439768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.439770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.439773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.439776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.439779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.439782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.439786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.439789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.439792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.439795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.439799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.439802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.439804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.439809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.439811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.439814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.439835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:15.443306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:15.444079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:15.444093Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:15.444095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:15.444099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:15.444106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 479 [2:7556254914672058099:5023]
2025-10-01T14:08:15.444121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:15.444141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:15.444148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.444152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.444154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.444170Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:15.444179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:15.444184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:15.444236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.444242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.444244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.444247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:15.444249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:15.444309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:15.444315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.444327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.444338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.444350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:15.444367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048920832:5575], now have 1 active actors on pipe
2025-10-01T14:08:15.444371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048920616:2446], now have 1 active actors on pipe
2025-10-01T14:08:15.444378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254914672058089:5023]
2025-10-01T14:08:15.444380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254914672058089:5023]
2025-10-01T14:08:15.444382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254914672058089:5023]
2025-10-01T14:08:15.444393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:15.444407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:15.444408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:15.444415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:15.444416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:15.444417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:15.444418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:15.444438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254914672058089:5023]
2025-10-01T14:08:15.444447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:15.444450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:15.444440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 479
2025-10-01T14:08:15.444469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 479
2025-10-01T14:08:15.444476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.444482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.444503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:15.444511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.444514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.444516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:15.444523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.444529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:15.444540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.444668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.444674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.444682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.444741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 480 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0
2025-10-01T14:08:15.445108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21ec716d-ba09722c-31a2a29e-a5e335e3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:15.448045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0] Write session: try to update token
2025-10-01T14:08:15.448065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:15.464270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:15.464295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:15.464298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:15.464300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:15.464310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254914672058089:5023]
2025-10-01T14:08:15.464314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254914672058089:5023]
2025-10-01T14:08:15.464318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254914672058089:5023]
2025-10-01T14:08:15.464362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:15.464368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:15.464375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.464376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:15.464377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:15.464380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:15.464514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:15.464944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 480 sessionId: src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:15.467616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:15.510540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254917048920933:5085]
2025-10-01T14:08:15.510799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 479, pipe: [1:7556254917048920933:5085]
2025-10-01T14:08:15.606497Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:15.607062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.607079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.607120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048920933:5085], now have 1 active actors on pipe
2025-10-01T14:08:15.607339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:15.607354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:15.607383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254917048920933:5085]
2025-10-01T14:08:15.607407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 480 reason: error at write: Disconnected sessionId: src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0
2025-10-01T14:08:15.607422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:15.607589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 480 sessionId: src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0 is DEAD
2025-10-01T14:08:15.607784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:15.607797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0] Write session will restart in 0.009159s
2025-10-01T14:08:15.607819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0] Write session: Do CDS request
2025-10-01T14:08:15.607827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:15.607815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:15.614133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:15.615706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:15.615914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:15.615925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:15.615935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:15.615993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:15.616023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254914672058161:5027]
2025-10-01T14:08:15.616543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:15.616804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:15.616854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:15.617136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:15.617200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.617207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.617210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.617211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.617212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.617213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.617214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.617216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.617217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.617218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.617219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.617220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.617222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.617223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.617228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.617236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.617240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.617244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.617247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.617251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.617255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.617258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.617262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.617266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.617271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.617275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.617278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.617282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.617291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.617295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.617299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.617304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.617307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.617310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.617314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.617319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.617328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.617332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.617336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.617341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.617345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.617354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.617358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.617362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.617367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.617372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.617379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.617384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.617391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.617396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.617403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.617408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.617417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.617425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.617430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.617440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.617476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:15.617873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.617923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:15.617936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 481
2025-10-01T14:08:15.618144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.618174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:15.618181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:15.618184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:15.618496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 481 sessionId:  describe result for acl check
2025-10-01T14:08:15.618519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:15.618523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:15.618524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:15.618527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254917048920965:5582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:15.618896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254917048920965:5582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:15.620736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254917048920965:5582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:15.620868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:15.621443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:15.621457Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:15.621460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:15.621463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:15.621468Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 480 [2:7556254914672058161:5027]
2025-10-01T14:08:15.621478Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:15.621494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:15.621500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.621502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.621503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.621515Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:15.621522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:15.621526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:15.621566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.621572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.621574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.621576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:15.621579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:15.621629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:15.621635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.621641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.621647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.621656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:15.621672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048920939:2446], now have 1 active actors on pipe
2025-10-01T14:08:15.621681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254914672058156:5027]
2025-10-01T14:08:15.621682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254914672058156:5027]
2025-10-01T14:08:15.621683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254914672058156:5027]
2025-10-01T14:08:15.621692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:15.621703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:15.621702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 480
2025-10-01T14:08:15.621713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:15.621714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:15.621716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:15.621722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:15.621723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:15.621738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254914672058156:5027]
2025-10-01T14:08:15.621742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:15.621744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:15.626159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254917048920965:5582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:15.626171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254917048920965:5582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:15.626173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254917048920965:5582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:15.626178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:15.626384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048921004:5582], now have 1 active actors on pipe
2025-10-01T14:08:15.626452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 480
2025-10-01T14:08:15.626503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.626513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.626535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:15.626545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.626549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.626550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:15.626558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.626571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:15.626588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.626688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.626693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.626702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.626741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 481 partition: 0 MaxSeqNo: 45 sessionId: src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0
2025-10-01T14:08:15.627052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5ccc40-f768e6f4-df5052c7-ac68e761_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:15.630059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0] Write session: try to update token
2025-10-01T14:08:15.630074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:15.641028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:15.641050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:15.641053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:15.641055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:15.641065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254914672058156:5027]
2025-10-01T14:08:15.641072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254914672058156:5027]
2025-10-01T14:08:15.641076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254914672058156:5027]
2025-10-01T14:08:15.641118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:15.641124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:15.641128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:15.641131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:15.641131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.641134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:15.641281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:15.643388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 481 sessionId: src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:15.645944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:15.707675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254917048921008:5085]
2025-10-01T14:08:15.707944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 480, pipe: [1:7556254917048921008:5085]
2025-10-01T14:08:15.780542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:15.780950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.780967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.781004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048921008:5085], now have 1 active actors on pipe
2025-10-01T14:08:15.781155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:15.781230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:15.781243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:15.781258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254917048921008:5085]
2025-10-01T14:08:15.781275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:15.781293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 481 reason: error at write: Disconnected sessionId: src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0
2025-10-01T14:08:15.781435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 481 sessionId: src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0 is DEAD
2025-10-01T14:08:15.781551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:15.781559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0] Write session will restart in 0.007380s
2025-10-01T14:08:15.781578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0] Write session: Do CDS request
2025-10-01T14:08:15.781583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:15.788238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:15.789680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:15.789917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:15.789939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.789927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:15.789938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:15.789986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:15.790011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:15.790026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 482
2025-10-01T14:08:15.790023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254914672058230:5032]
2025-10-01T14:08:15.790181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.790207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:15.790216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:15.790220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:15.790630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:15.790624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 482 sessionId:  describe result for acl check
2025-10-01T14:08:15.790657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:15.790659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:15.790660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:15.790665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254917048921051:5593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:15.790880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:15.790915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:15.791172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254917048921051:5593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:15.791184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:15.791237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.791242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.791243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.791244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.791246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.791247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.791248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.791249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.791250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.791252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.791253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.791254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.791255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.791256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.791261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.791270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.791273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.791277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.791280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.791284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.791298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.791302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.791310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.791314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.791322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.791325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.791329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.791334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.791342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.791353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.791363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.791373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.791380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.791385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.791391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.791402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.791406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.791411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.791414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.791418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.791424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.791429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.791433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.791438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.791452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.791461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.791465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.791470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.791474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.791483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.791487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.791493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.791498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.791506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.791514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.791519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.791563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:15.793333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254917048921051:5593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:15.795436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:15.795998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:15.795984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254917048921051:5593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:15.796008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254917048921051:5593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:15.796015Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:15.796011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254917048921051:5593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:15.796026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:15.796017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:15.796020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:15.796027Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 481 [2:7556254914672058230:5032]
2025-10-01T14:08:15.796042Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:15.796060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:15.796062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.796064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.796065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.796077Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:15.796080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:15.796084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:15.796122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.796123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.796124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.796126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:15.796128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:15.796191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:15.796198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.796210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.796219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.796239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:15.796258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048921031:2446], now have 1 active actors on pipe
2025-10-01T14:08:15.796264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048921091:5593], now have 1 active actors on pipe
2025-10-01T14:08:15.796268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254914672058225:5032]
2025-10-01T14:08:15.796270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254914672058225:5032]
2025-10-01T14:08:15.796271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254914672058225:5032]
2025-10-01T14:08:15.796281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:15.796269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 481
2025-10-01T14:08:15.796273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 481
2025-10-01T14:08:15.796293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:15.796307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:15.796311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:15.796315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:15.796316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:15.796318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:15.796352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.796359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.796368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254914672058225:5032]
2025-10-01T14:08:15.796376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:15.796393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:15.796406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:15.796413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.796420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.796421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:15.796429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.796442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:15.796465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.796589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.796595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.796605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.796657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 482 partition: 0 MaxSeqNo: 45 sessionId: src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0
2025-10-01T14:08:15.797099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41d400a3-36e112fa-ce8e0b63-140a33ac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:15.800116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0] Write session: try to update token
2025-10-01T14:08:15.800136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:15.816331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:15.816351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:15.816353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:15.816355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:15.816365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254914672058225:5032]
2025-10-01T14:08:15.816370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254914672058225:5032]
2025-10-01T14:08:15.816374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254914672058225:5032]
2025-10-01T14:08:15.816414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:15.816413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:15.816418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:15.816420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.816421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:15.816421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:15.816549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:15.823744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 482 sessionId: src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:15.826660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:15.881255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254917048921098:5085]
2025-10-01T14:08:15.881537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 481, pipe: [1:7556254917048921098:5085]
2025-10-01T14:08:15.955258Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:15.955539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.955550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.955568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048921098:5085], now have 1 active actors on pipe
2025-10-01T14:08:15.955719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:15.955801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:15.955820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:15.955856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254917048921098:5085]
2025-10-01T14:08:15.955910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 482 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0
2025-10-01T14:08:15.956050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 482 sessionId: src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0 is DEAD
2025-10-01T14:08:15.956206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:15.956215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0] Write session will restart in 0.008553s
2025-10-01T14:08:15.956235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0] Write session: Do CDS request
2025-10-01T14:08:15.956240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:15.961549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:15.962711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:15.962901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:15.962912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:15.962924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:15.962979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:15.963020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254914672058289:5034]
2025-10-01T14:08:15.963387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:15.963625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:15.963654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:15.963901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:15.963965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.963969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.963970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.963971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.963971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.963973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.963973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.963974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.963975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.963975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.963976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.963977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.963977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.963980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.963984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.963989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.963991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.963993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.963995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.963997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.963999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.964001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.964003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.964006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.964009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.964012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.964015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.964019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.964024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.964031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:15.964039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.964047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:15.964055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.964064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:15.964072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.964076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:15.964084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.964088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:15.964095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.964099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:15.964107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.964117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:15.964125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.964129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:15.964137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.964141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:15.964145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.964149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.964153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.964161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.964168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.964172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.964180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.964183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:15.964191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.964199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:15.964232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:15.965801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.966043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:15.966061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 483
2025-10-01T14:08:15.966178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:15.966211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:15.966221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:15.966226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:15.966588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 483 sessionId:  describe result for acl check
2025-10-01T14:08:15.966618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:15.966619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:15.966620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:15.966624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254917048921127:5597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:15.967045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254917048921127:5597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:15.967606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:15.968144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:15.968157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:15.968158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:15.968160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:15.968165Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 482 [2:7556254914672058289:5034]
2025-10-01T14:08:15.968176Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:15.968189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:15.968194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.968197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.968198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.968208Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:15.968212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:15.968217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:15.968254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.968260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.968261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.968263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:15.968265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:15.968310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:15.968316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.968324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:15.968333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:15.968346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:15.968365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254914672058284:5034]
2025-10-01T14:08:15.968372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254914672058284:5034]
2025-10-01T14:08:15.968373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254914672058284:5034]
2025-10-01T14:08:15.968381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:15.968390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:15.968391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048921102:2446], now have 1 active actors on pipe
2025-10-01T14:08:15.968392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:15.968394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:15.968397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:15.968409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:15.968416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:15.968415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 482
2025-10-01T14:08:15.968438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254914672058284:5034]
2025-10-01T14:08:15.968445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:15.968448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:15.968682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254917048921127:5597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:15.974234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254917048921127:5597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:15.974251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254917048921127:5597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:15.974254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254917048921127:5597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:15.974263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:15.974516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254917048921163:5597], now have 1 active actors on pipe
2025-10-01T14:08:15.974555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 482
2025-10-01T14:08:15.974624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.974637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.974658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:15.974671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:15.974679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:15.974681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:15.974689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:15.974707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:15.974725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.974895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:15.974901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:15.974912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:15.974976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 483 partition: 0 MaxSeqNo: 45 sessionId: src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0
2025-10-01T14:08:15.975335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c7c0443-45cffa4f-93f3ad8e-9ee1ac70_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:15.978152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0] Write session: try to update token
2025-10-01T14:08:15.978173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:15.988220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:15.988238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:15.988241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:15.988243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:15.988252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254914672058284:5034]
2025-10-01T14:08:15.988256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254914672058284:5034]
2025-10-01T14:08:15.988259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254914672058284:5034]
2025-10-01T14:08:15.988308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:15.988319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:15.988321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:15.988327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:15.988343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:15.988347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:15.988441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:15.994325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 483 sessionId: src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:15.997266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:16.055874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254921343888463:5085]
2025-10-01T14:08:16.056151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 482, pipe: [1:7556254921343888463:5085]
2025-10-01T14:08:16.126974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:16.127335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.127348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.127371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888463:5085], now have 1 active actors on pipe
2025-10-01T14:08:16.127659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:16.127629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:16.127704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:16.127707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:16.127776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 483 reason: error at write: Disconnected sessionId: src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0
2025-10-01T14:08:16.127968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 483 sessionId: src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0 is DEAD
2025-10-01T14:08:16.127961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254921343888463:5085]
2025-10-01T14:08:16.128147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:16.128156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0] Write session will restart in 0.009750s
2025-10-01T14:08:16.128176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0] Write session: Do CDS request
2025-10-01T14:08:16.128180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:16.134502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:16.136007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:16.136194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:16.136205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:16.136215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:16.136258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:16.136308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254918967025674:5046]
2025-10-01T14:08:16.136889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:16.137125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:16.137165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:16.137469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:16.137519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.137524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.137526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.137527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.137528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.137529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.137530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.137531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.137533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.137533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.137535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.137536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.137537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.137538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.137542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.137551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.137555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.137559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.137562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.137565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.137568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.137573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.137577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.137581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.137584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.137587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.137591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.137594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.137601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.137608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.137613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.137618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.137623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.137627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.137631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.137636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.137640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.137644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.137649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.137653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.137657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.137662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.137670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.137674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.137683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.137689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.137693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.137697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.137702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.137711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.137715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.137724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.137729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.137738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.137742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.137746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.137783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:16.138850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.138880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:16.138900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 484
2025-10-01T14:08:16.139186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.139235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:16.139245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:16.139248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:16.139592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 484 sessionId:  describe result for acl check
2025-10-01T14:08:16.139625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:16.139631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:16.139633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:16.139637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254921343888492:5601] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:16.140143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254921343888492:5601] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:16.141700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:16.142053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254921343888492:5601] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:16.142282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:16.142296Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:16.142299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:16.142302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:16.142308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 483 [2:7556254918967025674:5046]
2025-10-01T14:08:16.142322Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:16.142336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:16.142343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.142346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.142349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.142364Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:16.142387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:16.142397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:16.142445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.142451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.142453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.142456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:16.142459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:16.142520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:16.142527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.142538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.142547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.142562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:16.142583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888465:2446], now have 1 active actors on pipe
2025-10-01T14:08:16.142593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254918967025669:5046]
2025-10-01T14:08:16.142596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254918967025669:5046]
2025-10-01T14:08:16.142598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254918967025669:5046]
2025-10-01T14:08:16.142605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:16.142592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 483
2025-10-01T14:08:16.142619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:16.142621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:16.142629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:16.142632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:16.142633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:16.142636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:16.142670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254918967025669:5046]
2025-10-01T14:08:16.142680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:16.142689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:16.147342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254921343888492:5601] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:16.147354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254921343888492:5601] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:16.147356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254921343888492:5601] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:16.147365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:16.147599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888530:5601], now have 1 active actors on pipe
2025-10-01T14:08:16.147647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 483
2025-10-01T14:08:16.147708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.147721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.147749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:16.147763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.147768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.147771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:16.147783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.147795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:16.147813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.147972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.147983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.148001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.148076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 484 partition: 0 MaxSeqNo: 45 sessionId: src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0
2025-10-01T14:08:16.148415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f2494-c153ebed-28ea18a9-9fed2ee5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:16.151157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0] Write session: try to update token
2025-10-01T14:08:16.151174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:16.153188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:16.153207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:16.153217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254918967025669:5046]
2025-10-01T14:08:16.153255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:16.153275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:16.153419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:16.153567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.153707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.153847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.154039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:16.154074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:16.163221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 484 sessionId: src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:16.165875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:16.166123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.166143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.166181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:16.166283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:16.173395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:16.173414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:16.173417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:16.173419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:16.173431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254918967025669:5046]
2025-10-01T14:08:16.173434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254918967025669:5046]
2025-10-01T14:08:16.173438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254918967025669:5046]
2025-10-01T14:08:16.173479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:16.173487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:16.173491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:16.173494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:16.173495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.173498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:16.173621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:16.227849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254921343888540:5085]
2025-10-01T14:08:16.228171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 483, pipe: [1:7556254921343888540:5085]
2025-10-01T14:08:16.316901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:16.324265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.324296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.324453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.324513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.324574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.324631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.324673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.324682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.324744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.324815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.324879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.324942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.324991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.324998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.325063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.325125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.325183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.325243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.325285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.325292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.325359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.325422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.325482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.325545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.325587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.325593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.325657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.325715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.325778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.325838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.325882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.325889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.325952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.326011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.326075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.326138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.326181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.326187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.326249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.326340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.326420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.326481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.326523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.326529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.326595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.326652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.326710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.326770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.326811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.326817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.326878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.326935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.326993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.327052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.327097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.327103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.327164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.327223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.327281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.327338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.327381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.327387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.327433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888540:5085], now have 1 active actors on pipe
2025-10-01T14:08:16.327697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:16.327716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:16.327720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:16.327754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254921343888540:5085]
2025-10-01T14:08:16.327754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 484 reason: error at write: Disconnected sessionId: src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0
2025-10-01T14:08:16.327935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 484 sessionId: src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0 is DEAD
2025-10-01T14:08:16.328082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:16.328091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0] Write session will restart in 0.008124s
2025-10-01T14:08:16.328112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0] Write session: Do CDS request
2025-10-01T14:08:16.328117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:16.328340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:16.335134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:16.336866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:16.337014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:16.337024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:16.337033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:16.337078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:16.337116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254918967025749:5050]
2025-10-01T14:08:16.337505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:16.337780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:16.337806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.337820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:16.337907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:16.337922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 485
2025-10-01T14:08:16.338034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:16.338096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.338101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.338102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.338103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.338104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.338105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.338106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.338107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.338108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.338110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.338112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.338113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.338114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.338116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.338120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.338129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.338133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.338137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.338144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.338148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.338155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.338159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.338166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.338170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.338178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.338181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.338184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.338186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.338192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.338200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.338204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.338210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.338212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.338209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.338216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.338221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.338224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.338226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.338229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.338230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.338233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.338234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:16.338241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:16.338235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.338238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.338244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:16.338240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.338243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.338245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.338247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.338249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.338252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.338254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.338258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.338260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.338262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.338264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.338267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.338269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.338271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.338290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:16.338911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 485 sessionId:  describe result for acl check
2025-10-01T14:08:16.338955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:16.338960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:16.338964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:16.338969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254921343888584:5607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:16.339556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254921343888584:5607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:16.341229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254921343888584:5607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:16.342002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:16.342600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:16.342614Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:16.342616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:16.342620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:16.342629Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 484 [2:7556254918967025749:5050]
2025-10-01T14:08:16.342642Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:16.342658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:16.342661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.342665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.342668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.342683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:16.342694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:16.342700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:16.342745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.342750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.342752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.342755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:16.342759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:16.342818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:16.342824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.342833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.342847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.342866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:16.342887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888558:2446], now have 1 active actors on pipe
2025-10-01T14:08:16.342894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254918967025744:5050]
2025-10-01T14:08:16.342900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254918967025744:5050]
2025-10-01T14:08:16.342901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254918967025744:5050]
2025-10-01T14:08:16.342916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:16.342923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:16.342925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:16.342927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:16.342932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:16.342943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:16.342950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:16.342943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 484
2025-10-01T14:08:16.342979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254918967025744:5050]
2025-10-01T14:08:16.342990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:16.342999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:16.343938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254921343888584:5607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:16.343953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254921343888584:5607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:16.343955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254921343888584:5607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:16.343962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:16.344308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888623:5607], now have 1 active actors on pipe
2025-10-01T14:08:16.344340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 484
2025-10-01T14:08:16.344398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.344410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.344434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16def085-5ab737c5-9928182f-381091bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:16.344447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.344455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.344461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:16.344471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.344487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:16.344505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.344648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.344656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.344668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.344737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 485 partition: 0 MaxSeqNo: 45 sessionId: src_id|16def085-5ab737c5-9928182f-381091bb_0
2025-10-01T14:08:16.345035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30875500-d8c5dfb7-93ad75f8-46df475e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|16def085-5ab737c5-9928182f-381091bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:16.347291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16def085-5ab737c5-9928182f-381091bb_0] Write session: try to update token
2025-10-01T14:08:16.347305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16def085-5ab737c5-9928182f-381091bb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:16.359740Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:16.359761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:16.359771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254918967025744:5050]
2025-10-01T14:08:16.359765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 485 sessionId: src_id|16def085-5ab737c5-9928182f-381091bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:16.359818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:16.359836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:16.359991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:16.360134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.360295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.360423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.360629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:16.360691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:16.361946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:16.362175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.362195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.362226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:16.362325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:16.378065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:16.378087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:16.378089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:16.378090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:16.378097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254918967025744:5050]
2025-10-01T14:08:16.378101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254918967025744:5050]
2025-10-01T14:08:16.378103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254918967025744:5050]
2025-10-01T14:08:16.378146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:16.378159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.378162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:16.378169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:16.378178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:16.378183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:16.378288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:16.428059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254921343888626:5085]
2025-10-01T14:08:16.428341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 484, pipe: [1:7556254921343888626:5085]
2025-10-01T14:08:16.514364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:16.520733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.520758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.520904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.520957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.521009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.521061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.521100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.521108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.521160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.521218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.521272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.521329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.521371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.521377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.521430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.521483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.521535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.521586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.521625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.521630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.521685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.521738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.521790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.521844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.521882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.521887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.521942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.521994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.522057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.522125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.522166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.522171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.522225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.522278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.522330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.522404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.522443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.522448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.522501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.522550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.522602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.522654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.522693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.522697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.522755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.522812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.522879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.522946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.522993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.523000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.523057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.523132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.523186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.523236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.523277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.523282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.523334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.523383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.523433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.523485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.523522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.523527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.523569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888626:5085], now have 1 active actors on pipe
2025-10-01T14:08:16.523821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:16.523881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:16.523884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:16.523912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 485 reason: error at write: Disconnected sessionId: src_id|16def085-5ab737c5-9928182f-381091bb_0
2025-10-01T14:08:16.524260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16def085-5ab737c5-9928182f-381091bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:16.524273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16def085-5ab737c5-9928182f-381091bb_0] Write session will restart in 0.006919s
2025-10-01T14:08:16.524298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16def085-5ab737c5-9928182f-381091bb_0] Write session: Do CDS request
2025-10-01T14:08:16.524304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16def085-5ab737c5-9928182f-381091bb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:16.524109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 485 sessionId: src_id|16def085-5ab737c5-9928182f-381091bb_0 is DEAD
2025-10-01T14:08:16.524188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254921343888626:5085]
2025-10-01T14:08:16.524407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:16.530766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:16.531968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:16.532144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:16.532154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:16.532166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:16.532214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:16.532251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254918967025812:5052]
2025-10-01T14:08:16.532804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:16.532823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16def085-5ab737c5-9928182f-381091bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.532969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:16.532984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 486
2025-10-01T14:08:16.533053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:16.533093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:16.533142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.533173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:16.533182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:16.533189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:16.533371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:16.533420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.533425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.533426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.533427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.533428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.533429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.533431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.533432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.533433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.533434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.533437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.533438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.533439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.533441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.533444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.533454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.533458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.533462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.533466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.533469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.533473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.533476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.533480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.533485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.533489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.533492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.533495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.533502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.533509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.533519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.533529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.533538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.533546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.533550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.533559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.533563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.533540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 486 sessionId:  describe result for acl check
2025-10-01T14:08:16.533567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.533575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.533579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.533587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.533596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.533591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:16.533599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:16.533602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.533601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:16.533605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254921343888654:5611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:16.533611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.533616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.533623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.533628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.533634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.533638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.533646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.533654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.533661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.533665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.533669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.533673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.533677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.533681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.533714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:16.534056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254921343888654:5611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:16.535589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254921343888654:5611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:16.537620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:16.537673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254921343888654:5611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:16.537684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254921343888654:5611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:16.537687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254921343888654:5611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:16.537694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:16.538164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:16.538176Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:16.538178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:16.538180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:16.538185Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 485 [2:7556254918967025812:5052]
2025-10-01T14:08:16.538194Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:16.538205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:16.538207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.538209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.538210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.538223Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:16.538229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:16.538234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:16.538267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.538273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.538274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.538276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:16.538278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:16.538326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:16.538331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.538338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.538344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.538356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:16.538393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888691:5611], now have 1 active actors on pipe
2025-10-01T14:08:16.538403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888629:2446], now have 1 active actors on pipe
2025-10-01T14:08:16.538408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254918967025807:5052]
2025-10-01T14:08:16.538409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254918967025807:5052]
2025-10-01T14:08:16.538410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254918967025807:5052]
2025-10-01T14:08:16.538418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:16.538428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:16.538436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:16.538438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:16.538441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:16.538451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:16.538468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 485
2025-10-01T14:08:16.538453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:16.538456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254918967025807:5052]
2025-10-01T14:08:16.538479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 485
2025-10-01T14:08:16.538458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:16.538461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:16.538534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.538542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.538562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca3a59df-30654607-b4d3103f-63060189_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:16.538571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.538574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.538576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:16.538582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.538591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:16.538602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.538740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.538744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.538753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.538820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 486 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca3a59df-30654607-b4d3103f-63060189_0
2025-10-01T14:08:16.539128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16def085-5ab737c5-9928182f-381091bb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca3a59df-30654607-b4d3103f-63060189_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:16.541856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3a59df-30654607-b4d3103f-63060189_0] Write session: try to update token
2025-10-01T14:08:16.541871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3a59df-30654607-b4d3103f-63060189_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:16.556394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 486 sessionId: src_id|ca3a59df-30654607-b4d3103f-63060189_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:16.558656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:16.558674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:16.558677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:16.558678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:16.558686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254918967025807:5052]
2025-10-01T14:08:16.558693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254918967025807:5052]
2025-10-01T14:08:16.558696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254918967025807:5052]
2025-10-01T14:08:16.558738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:16.558743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.558746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:16.558743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:16.558750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:16.558761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:16.558835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:16.558859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:16.624173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254921343888700:5085]
2025-10-01T14:08:16.624429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 485, pipe: [1:7556254921343888700:5085]
2025-10-01T14:08:16.700824Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:16.701083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.701094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.701128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888700:5085], now have 1 active actors on pipe
2025-10-01T14:08:16.701277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:16.701347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:16.701354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:16.701399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254921343888700:5085]
2025-10-01T14:08:16.701423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 486 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca3a59df-30654607-b4d3103f-63060189_0
2025-10-01T14:08:16.701569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 486 sessionId: src_id|ca3a59df-30654607-b4d3103f-63060189_0 is DEAD
2025-10-01T14:08:16.701704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3a59df-30654607-b4d3103f-63060189_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:16.701709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3a59df-30654607-b4d3103f-63060189_0] Write session will restart in 0.008567s
2025-10-01T14:08:16.701731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3a59df-30654607-b4d3103f-63060189_0] Write session: Do CDS request
2025-10-01T14:08:16.701736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3a59df-30654607-b4d3103f-63060189_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:16.707679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:16.709035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:16.709225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:16.709235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:16.709246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:16.709299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:16.709339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254918967025877:5055]
2025-10-01T14:08:16.709889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:16.710186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:16.710240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:16.710549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:16.710627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.710637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.710639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.710640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.710641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.710642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.710643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.710645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.710646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.710647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.710649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.710650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.710651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.710652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.710657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.710666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.710671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.710674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.710678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.710681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.710684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.710687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.710691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.710694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.710697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.710701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.710704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.710707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.710714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.710721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.710728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.710732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.710736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.710746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.710754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.710757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.710765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.710770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.710775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.710780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.710785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.710795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.710803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.710811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.710819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.710823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.710827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.710838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.710842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.710847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.710850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.710856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.710859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.710863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.710871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.710875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.710914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:16.711844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3a59df-30654607-b4d3103f-63060189_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.712005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:16.712023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 487
2025-10-01T14:08:16.712150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.712177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:16.712187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:16.712190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:16.712627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 487 sessionId:  describe result for acl check
2025-10-01T14:08:16.712659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:16.712665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:16.712667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:16.712671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254921343888731:5616] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:16.713175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254921343888731:5616] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:16.714901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:16.715316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254921343888731:5616] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:16.715578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:16.715595Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:16.715598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:16.715601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:16.715607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 486 [2:7556254918967025877:5055]
2025-10-01T14:08:16.715622Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:16.715637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:16.715640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.715643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.715645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.715662Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:16.715668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:16.715674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:16.715726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.715731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.715732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.715735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:16.715737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:16.715798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:16.715806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.715817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.715826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.715837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:16.715853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888702:2446], now have 1 active actors on pipe
2025-10-01T14:08:16.715866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254918967025872:5055]
2025-10-01T14:08:16.715868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254918967025872:5055]
2025-10-01T14:08:16.715870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254918967025872:5055]
2025-10-01T14:08:16.715881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:16.715899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:16.715903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:16.715906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:16.715908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:16.715915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:16.715916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:16.715944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254918967025872:5055]
2025-10-01T14:08:16.715952Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:16.715954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:16.715904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 486
2025-10-01T14:08:16.720934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254921343888731:5616] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:16.720950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254921343888731:5616] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:16.720953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254921343888731:5616] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:16.720961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:16.721273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 486
2025-10-01T14:08:16.721244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888777:5616], now have 1 active actors on pipe
2025-10-01T14:08:16.721339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.721352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.721381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:16.721397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.721402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.721405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:16.721415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.721430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:16.721451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.721688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.721698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.721714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.721804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 487 partition: 0 MaxSeqNo: 45 sessionId: src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0
2025-10-01T14:08:16.722128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3a59df-30654607-b4d3103f-63060189_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:16.724727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0] Write session: try to update token
2025-10-01T14:08:16.724743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:16.732531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:16.732550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:16.732561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254918967025872:5055]
2025-10-01T14:08:16.732614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:16.732616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:16.732820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:16.732966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.733099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.733246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.733447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:16.733491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:16.738968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 487 sessionId: src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:16.741120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:16.741353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.741377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.741412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:16.741498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:16.746114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:16.746136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:16.746138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:16.746140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:16.746151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254918967025872:5055]
2025-10-01T14:08:16.746157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254918967025872:5055]
2025-10-01T14:08:16.746160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254918967025872:5055]
2025-10-01T14:08:16.746202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:16.746202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:16.746206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:16.746208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.746208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:16.746210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:16.746346Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:16.801309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254921343888804:5085]
2025-10-01T14:08:16.801581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 486, pipe: [1:7556254921343888804:5085]
2025-10-01T14:08:16.893458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:16.899965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.899985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.900118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.900172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.900225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.900277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.900316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.900323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.900381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.900444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.900496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.900547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.900587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.900593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.900653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.900707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.900762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.900830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.900869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.900874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.900939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.900992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.901046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.901102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.901143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.901147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.901215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.901272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.901327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.901378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.901424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.901432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.901493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.901547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.901600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.901659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.901698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.901705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.901759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.901829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.901887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.901955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.901993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.901998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.902087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.902141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.902196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.902253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.902292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.902297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.902352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.902426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.902479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.902532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.902571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.902576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.902631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:16.902686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:16.902741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:16.902796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:16.902835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:16.902843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:16.902880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888804:5085], now have 1 active actors on pipe
2025-10-01T14:08:16.903117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:16.903136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254921343888804:5085]
2025-10-01T14:08:16.903396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:16.903406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:16.903432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 487 reason: error at write: Disconnected sessionId: src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0
2025-10-01T14:08:16.903596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:16.903604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 487 sessionId: src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0 is DEAD
2025-10-01T14:08:16.903704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:16.903712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0] Write session will restart in 0.008500s
2025-10-01T14:08:16.903730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0] Write session: Do CDS request
2025-10-01T14:08:16.903735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:16.910295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:16.911544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:16.911699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:16.911708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:16.911719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:16.911758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:16.911795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254918967025948:5059]
2025-10-01T14:08:16.912336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:16.912605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:16.912646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:16.912869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.912922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:16.912969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.912975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.912976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.912977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.912977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.912978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.912979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.912979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.912981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.912982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.912982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.912983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.912983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.912985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.912989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.912995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.913022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:16.912997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.912999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.913000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.913002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.913036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 488
2025-10-01T14:08:16.913004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.913006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.913009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.913012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.913015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.913019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.913021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.913025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.913032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.913039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:16.913044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.913047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:16.913049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.913051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:16.913054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.913056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:16.913058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.913061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:16.913063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.913066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:16.913070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.913073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:16.913075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.913078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:16.913155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:16.913082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.913084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:16.913087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.913091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.913093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.913096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.913098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.913101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.913177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:16.913185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:16.913103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.913188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:16.913106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:16.913108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.913111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:16.913132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:16.913488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 488 sessionId:  describe result for acl check
2025-10-01T14:08:16.913517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:16.913518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:16.913520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:16.913524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254921343888836:5627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:16.913930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254921343888836:5627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:16.915530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254921343888836:5627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:16.916841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:16.917430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:16.917446Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:16.917448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:16.917451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:16.917457Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 487 [2:7556254918967025948:5059]
2025-10-01T14:08:16.917472Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:16.917486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:16.917488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.917492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.917495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.917511Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:16.917521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:16.917528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:16.917577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.917586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.917588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.917590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:16.917592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:16.917656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:16.917665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.917676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:16.917686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:16.917700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:16.917721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888807:2446], now have 1 active actors on pipe
2025-10-01T14:08:16.917733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254918967025943:5059]
2025-10-01T14:08:16.917736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254918967025943:5059]
2025-10-01T14:08:16.917737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254918967025943:5059]
2025-10-01T14:08:16.917749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:16.917763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:16.917752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 487
2025-10-01T14:08:16.917765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:16.917772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:16.917774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:16.917778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:16.917781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:16.917815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254918967025943:5059]
2025-10-01T14:08:16.917825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:16.917831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:16.918269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254921343888836:5627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:16.918282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254921343888836:5627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:16.918284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254921343888836:5627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:16.918292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:16.918517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 487
2025-10-01T14:08:16.918471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254921343888873:5627], now have 1 active actors on pipe
2025-10-01T14:08:16.918560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.918569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.918592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:16.918604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:16.918613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:16.918615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:16.918623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:16.918638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:16.918655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.918763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.918770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.918783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:16.918867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 488 partition: 0 MaxSeqNo: 45 sessionId: src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0
2025-10-01T14:08:16.919190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0a0baa-8e2ce68d-6896cf65-25980d39_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:16.921381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0] Write session: try to update token
2025-10-01T14:08:16.921394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:16.927959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:16.927983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:16.927993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254918967025943:5059]
2025-10-01T14:08:16.928032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:16.928039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:16.928200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:16.928343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.928488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.928635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:16.928855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:16.928897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:16.933580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 488 sessionId: src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:16.935779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:16.936034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:16.936051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:16.936083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:16.936160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:16.946474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:16.946491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:16.946494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:16.946496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:16.946508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254918967025943:5059]
2025-10-01T14:08:16.946512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254918967025943:5059]
2025-10-01T14:08:16.946517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254918967025943:5059]
2025-10-01T14:08:16.946566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:16.946567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:16.946573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:16.946573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:16.946575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:16.946577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:16.946724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:17.003053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254925638856174:5085]
2025-10-01T14:08:17.003467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 487, pipe: [1:7556254925638856174:5085]
2025-10-01T14:08:17.079821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:17.086911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.086937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.087081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.087137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.087193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.087247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.087285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.087292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.087351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.087407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.087462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.087522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.087562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.087568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.087633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.087689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.087747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.087804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.087844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.087851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.087911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.087968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.088033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.088088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.088135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.088141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.088201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.088254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.088312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.088370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.088409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.088414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.088472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.088533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.088589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.088654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.088693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.088700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.088758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.088823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.088881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.088939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.088978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.088983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.089048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.089103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.089168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.089222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.089261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.089265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.089327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.089385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.089442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.089493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.089536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.089542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.089603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.089659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.089718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.089773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.089813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.089818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.089862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856174:5085], now have 1 active actors on pipe
2025-10-01T14:08:17.090137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254925638856174:5085]
2025-10-01T14:08:17.090181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:17.090189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:17.090213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 488 reason: error at write: Disconnected sessionId: src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0
2025-10-01T14:08:17.090324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:17.090434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 488 sessionId: src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0 is DEAD
2025-10-01T14:08:17.090546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:17.090555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0] Write session will restart in 0.008037s
2025-10-01T14:08:17.090583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0] Write session: Do CDS request
2025-10-01T14:08:17.090589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:17.090760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:17.097506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:17.099304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:17.099531Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:17.099542Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:17.099555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:17.099616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:17.099656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254923261993339:5071]
2025-10-01T14:08:17.099852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.100005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:17.100021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 489
2025-10-01T14:08:17.100162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.100192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:17.100184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:17.100203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:17.100211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:17.100578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:17.100602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 489 sessionId:  describe result for acl check
2025-10-01T14:08:17.100639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:17.100642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:17.100644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:17.100645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:17.100650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254925638856210:5633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:17.100987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:17.101061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.101068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.101069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.101070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.101071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.101072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.101073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.101074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.101075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.101076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.101077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.101078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.101081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.101081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.101088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.101096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.101100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.101103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.101106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.101110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.101113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.101118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.101121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.101125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.101129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.101132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.101136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.101139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.101146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.101153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.101164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.101168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.101172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.101182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.101186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.101162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254925638856210:5633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:17.101194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.101203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.101211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.101214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.101222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.101226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.101233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.101237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.101245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.101253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.101262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.101269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.101273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.101280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.101285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.101292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.101298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.101306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.101313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.101321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.101329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.101367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:17.103344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254925638856210:5633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:17.105326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:17.105908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:17.105929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:17.105932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:17.105936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:17.105942Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 488 [2:7556254923261993339:5071]
2025-10-01T14:08:17.105956Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:17.105973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:17.105981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.105985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.105987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.106003Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:17.106013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:17.106020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:17.106078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.106085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.106087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.106090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:17.106095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:17.106163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:17.106172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.106185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.106198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.106216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:17.106238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856182:2446], now have 1 active actors on pipe
2025-10-01T14:08:17.106250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254923261993334:5071]
2025-10-01T14:08:17.106256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254923261993334:5071]
2025-10-01T14:08:17.106258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254923261993334:5071]
2025-10-01T14:08:17.106271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:17.106280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:17.106282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:17.106283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:17.106288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:17.106302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:17.106308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:17.106281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 488
2025-10-01T14:08:17.106304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254925638856210:5633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:17.106312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254925638856210:5633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:17.106315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254925638856210:5633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:17.106323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:17.106341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254923261993334:5071]
2025-10-01T14:08:17.106351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:17.106355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:17.106542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856243:5633], now have 1 active actors on pipe
2025-10-01T14:08:17.106562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 488
2025-10-01T14:08:17.106673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.106683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.106708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91613527-cbe3a4a0-94044f47-4d49c290_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:17.106721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.106730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.106733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:17.106741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.106751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:17.106769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.106918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.106928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.106943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.107037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 489 partition: 0 MaxSeqNo: 45 sessionId: src_id|91613527-cbe3a4a0-94044f47-4d49c290_0
2025-10-01T14:08:17.107356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82369ca0-6c3508b2-5d5ab21f-99b63e2f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|91613527-cbe3a4a0-94044f47-4d49c290_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:17.109632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91613527-cbe3a4a0-94044f47-4d49c290_0] Write session: try to update token
2025-10-01T14:08:17.109647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91613527-cbe3a4a0-94044f47-4d49c290_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:17.117339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:17.117361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:17.117371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254923261993334:5071]
2025-10-01T14:08:17.117422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:17.117427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:17.117622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:17.117797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:17.117958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:17.118115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:17.118331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:17.118398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:17.123435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 489 sessionId: src_id|91613527-cbe3a4a0-94044f47-4d49c290_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:17.126080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:17.126263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.126288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.126326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:17.126420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:17.136908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:17.136932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:17.136934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:17.136936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:17.136947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254923261993334:5071]
2025-10-01T14:08:17.136952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254923261993334:5071]
2025-10-01T14:08:17.136955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254923261993334:5071]
2025-10-01T14:08:17.137007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:17.137019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.137021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:17.137029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:17.137037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:17.137041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:17.137162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:17.190449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254925638856256:5085]
2025-10-01T14:08:17.190701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 488, pipe: [1:7556254925638856256:5085]
2025-10-01T14:08:17.285260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:17.292185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.292214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.292358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.292410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.292466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.292519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.292565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.292575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.292634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.292685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.292736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.292787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.292844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.292849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.292911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.292966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.293021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.293078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.293119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.293124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.293186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.293241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.293295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.293349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.293387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.293392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.293450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.293502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.293555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.293609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.293711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.293719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.293777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.293830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.293884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.293937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.293976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.293981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.294036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.294087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.294141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.294197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.294237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.294242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.294298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.294387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.294446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.294503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.294585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.294590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.294648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.294700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.294753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.294807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.294848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.294853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.294910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:17.294966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:17.295021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:17.295074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:17.295114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:17.295119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:17.295164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856256:5085], now have 1 active actors on pipe
2025-10-01T14:08:17.295464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:17.295468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:17.295482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:17.295504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254925638856256:5085]
2025-10-01T14:08:17.295508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 489 reason: error at write: Disconnected sessionId: src_id|91613527-cbe3a4a0-94044f47-4d49c290_0
2025-10-01T14:08:17.295684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 489 sessionId: src_id|91613527-cbe3a4a0-94044f47-4d49c290_0 is DEAD
2025-10-01T14:08:17.295827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91613527-cbe3a4a0-94044f47-4d49c290_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:17.295844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91613527-cbe3a4a0-94044f47-4d49c290_0] Write session will restart in 0.008171s
2025-10-01T14:08:17.295872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91613527-cbe3a4a0-94044f47-4d49c290_0] Write session: Do CDS request
2025-10-01T14:08:17.295877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91613527-cbe3a4a0-94044f47-4d49c290_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:17.295881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:17.302955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:17.304531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:17.304743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:17.304754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:17.304764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:17.304815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:17.304826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91613527-cbe3a4a0-94044f47-4d49c290_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.304845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254923261993420:5075]
2025-10-01T14:08:17.305055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:17.305068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 490
2025-10-01T14:08:17.305220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.305240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:17.305248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:17.305258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:17.305262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:17.305458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:17.305489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:17.305551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 490 sessionId:  describe result for acl check
2025-10-01T14:08:17.305583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:17.305584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:17.305585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:17.305588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254925638856305:5639] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:17.305697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:17.305734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.305740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.305741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.305742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.305743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.305743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.305744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.305745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.305745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.305746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.305746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.305747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.305748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.305748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.305751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.305758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.305760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.305764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.305766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.305768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.305770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.305772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.305774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.305776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.305778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.305780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.305782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.305783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.305788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.305792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.305796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.305800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.305802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.305805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.305807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.305810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.305812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.305815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.305817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.305820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.305822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.305825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.305827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.305830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.305832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.305835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.305837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.305840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.305843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.305849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.305851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.305854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.305856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.305862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.305864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.305866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.305886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:17.305957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254925638856305:5639] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:17.307725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254925638856305:5639] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:17.309593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:17.309785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254925638856305:5639] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:17.309797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254925638856305:5639] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:17.309799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254925638856305:5639] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:17.309805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:17.310164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:17.310178Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:17.310180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:17.310182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:17.310188Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 489 [2:7556254923261993420:5075]
2025-10-01T14:08:17.310198Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:17.310213Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:17.310215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.310218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.310220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.310232Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:17.310239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:17.310243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:17.310286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.310291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.310294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.310297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:17.310298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:17.310345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:17.310350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.310356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.310366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.310402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:17.310423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856342:5639], now have 1 active actors on pipe
2025-10-01T14:08:17.310430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856276:2446], now have 1 active actors on pipe
2025-10-01T14:08:17.310437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254923261993415:5075]
2025-10-01T14:08:17.310443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254923261993415:5075]
2025-10-01T14:08:17.310445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254923261993415:5075]
2025-10-01T14:08:17.310455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:17.310466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:17.310472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:17.310473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:17.310475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:17.310484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:17.310491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:17.310475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 489
2025-10-01T14:08:17.310482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 489
2025-10-01T14:08:17.310517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254923261993415:5075]
2025-10-01T14:08:17.310523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:17.310525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:17.310541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.310547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.310581Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:17.310589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.310595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.310597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:17.310602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.310611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:17.310625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.310751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.310758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.310772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.310853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 490 partition: 0 MaxSeqNo: 45 sessionId: src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0
2025-10-01T14:08:17.311162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91613527-cbe3a4a0-94044f47-4d49c290_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:17.313889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0] Write session: try to update token
2025-10-01T14:08:17.313903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:17.328329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 490 sessionId: src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:17.330968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:17.331119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:17.331135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:17.331137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:17.331138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:17.331147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254923261993415:5075]
2025-10-01T14:08:17.331150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254923261993415:5075]
2025-10-01T14:08:17.331152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254923261993415:5075]
2025-10-01T14:08:17.331185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:17.331197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.331197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:17.331200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:17.331205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.331222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:17.331230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.331233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:17.331358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:17.395745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254925638856350:5085]
2025-10-01T14:08:17.396028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 489, pipe: [1:7556254925638856350:5085]
2025-10-01T14:08:17.466767Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:17.467122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856350:5085], now have 1 active actors on pipe
2025-10-01T14:08:17.467313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:17.467407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:17.467424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:17.467434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254925638856350:5085]
2025-10-01T14:08:17.467455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:17.467510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 490 reason: error at write: Disconnected sessionId: src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0
2025-10-01T14:08:17.467687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 490 sessionId: src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0 is DEAD
2025-10-01T14:08:17.467806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:17.467819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0] Write session will restart in 0.006294s
2025-10-01T14:08:17.467843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0] Write session: Do CDS request
2025-10-01T14:08:17.467849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:17.474814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.474866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:17.474884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 491
2025-10-01T14:08:17.475034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.475068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:17.475079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:17.475083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:17.475286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:17.475501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 491 sessionId:  describe result for acl check
2025-10-01T14:08:17.475537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:17.475545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:17.475546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:17.475551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254925638856390:5643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:17.476005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254925638856390:5643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:17.477248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:17.477448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:17.477461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:17.477473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:17.477523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:17.477564Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254923261993487:5077]
2025-10-01T14:08:17.478001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254925638856390:5643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:17.478091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:17.478426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:17.478477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:17.478785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:17.478845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.478851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.478853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.478854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.478855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.478859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.478860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.478862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.478864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.478865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.478866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.478867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.478868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.478869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.478875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.478884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.478888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.478891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.478895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.478899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.478903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.478906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.478910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.478913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.478917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.478921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.478924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.478927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.478933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.478941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.478946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.478952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.478955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.478961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.478971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.478977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.478987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.478995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.478998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.479003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.479012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.479016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.479024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.479028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.479032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.479040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.479043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.479053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.479057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.479065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.479069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.479074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.479083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.479088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.479096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.479101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.479144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:17.482694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254925638856390:5643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:17.482712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254925638856390:5643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:17.482715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254925638856390:5643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:17.482721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:17.482898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:17.483481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:17.483503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:17.483505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:17.483509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:17.483516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 490 [2:7556254923261993487:5077]
2025-10-01T14:08:17.483532Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:17.483547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:17.483554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.483558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.483562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.483578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:17.483589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:17.483594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:17.483648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.483655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.483656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.483659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:17.483661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:17.483728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:17.483736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.483747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.483763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.483782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:17.483803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856351:2446], now have 1 active actors on pipe
2025-10-01T14:08:17.483811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856430:5643], now have 1 active actors on pipe
2025-10-01T14:08:17.483818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254923261993482:5077]
2025-10-01T14:08:17.483824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254923261993482:5077]
2025-10-01T14:08:17.483826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254923261993482:5077]
2025-10-01T14:08:17.483826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 490
2025-10-01T14:08:17.483843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 490
2025-10-01T14:08:17.483844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:17.483863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:17.483863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:17.483868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:17.483870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:17.483876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:17.483879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:17.483902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.483911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.483953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254923261993482:5077]
2025-10-01T14:08:17.483968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:17.483982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:17.483984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:17.483991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.483995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.483997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:17.484005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.484013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:17.484054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.484279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.484288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.484303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.484370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 491 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0
2025-10-01T14:08:17.484655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b0ebbf-5fdc7083-38989266-c4999ea0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:17.487455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0] Write session: try to update token
2025-10-01T14:08:17.487469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:17.503172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 491 sessionId: src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:17.505658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:17.505684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:17.505687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:17.505689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:17.505705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254923261993482:5077]
2025-10-01T14:08:17.505710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254923261993482:5077]
2025-10-01T14:08:17.505713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254923261993482:5077]
2025-10-01T14:08:17.505766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:17.505768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:17.505774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.505775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:17.505776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:17.505779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:17.505939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:17.506230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:17.567775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254925638856438:5085]
2025-10-01T14:08:17.568152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 490, pipe: [1:7556254925638856438:5085]
2025-10-01T14:08:17.667194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:17.667404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.667416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.667450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856438:5085], now have 1 active actors on pipe
2025-10-01T14:08:17.667637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:17.667675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:17.667689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:17.667735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:17.667748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 491 reason: error at write: Disconnected sessionId: src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0
2025-10-01T14:08:17.667804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254925638856438:5085]
2025-10-01T14:08:17.667904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 491 sessionId: src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0 is DEAD
2025-10-01T14:08:17.668057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:17.668070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0] Write session will restart in 0.007316s
2025-10-01T14:08:17.668095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0] Write session: Do CDS request
2025-10-01T14:08:17.668110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:17.675103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:17.676842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.676988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:17.677003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 492
2025-10-01T14:08:17.677093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:17.677160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.677188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:17.677198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:17.677205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:17.677219Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:17.677226Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:17.677234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:17.677266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:17.677302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254923261993557:5079]
2025-10-01T14:08:17.677674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 492 sessionId:  describe result for acl check
2025-10-01T14:08:17.677722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:17.677731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:17.677733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:17.677736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254925638856471:5648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:17.677768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:17.678081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:17.678115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:17.678173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254925638856471:5648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:17.678343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:17.678410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.678416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.678416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.678417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.678418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.678418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.678419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.678420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.678421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.678421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.678422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.678422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.678423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.678424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.678428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.678434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.678436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.678438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.678440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.678442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.678443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.678445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.678449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.678453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.678456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.678460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.678463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.678466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.678472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.678479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.678484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.678489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.678494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.678496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.678498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.678501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.678503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.678506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.678509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.678511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.678514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.678517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.678519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.678522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.678524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.678527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.678529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.678531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.678533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.678536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.678537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.678540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.678542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.678546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.678548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.678550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.678569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:17.679981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254925638856471:5648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:17.682118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254925638856471:5648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:17.682133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254925638856471:5648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:17.682135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254925638856471:5648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:17.682144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:17.682223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:17.682796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:17.682813Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:17.682815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:17.682818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:17.682822Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 491 [2:7556254923261993557:5079]
2025-10-01T14:08:17.682832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:17.682843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:17.682848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.682851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.682852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.682863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:17.682869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:17.682873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:17.682916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.682923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.682925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.682929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:17.682932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:17.682994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:17.682999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.683006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.683011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.683024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:17.683042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856442:2446], now have 1 active actors on pipe
2025-10-01T14:08:17.683047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856510:5648], now have 1 active actors on pipe
2025-10-01T14:08:17.683052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254923261993552:5079]
2025-10-01T14:08:17.683053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254923261993552:5079]
2025-10-01T14:08:17.683054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254923261993552:5079]
2025-10-01T14:08:17.683066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:17.683085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:17.683089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:17.683093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:17.683096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:17.683101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:17.683103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:17.683122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254923261993552:5079]
2025-10-01T14:08:17.683124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:17.683129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:17.683133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 491
2025-10-01T14:08:17.683139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 491
2025-10-01T14:08:17.683222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.683229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.683246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|595b10bb-ab043cfb-7bf09141-999d0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:17.683255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.683258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.683259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:17.683265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.683271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:17.683283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.683455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.683461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.683471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.683571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 492 partition: 0 MaxSeqNo: 45 sessionId: src_id|595b10bb-ab043cfb-7bf09141-999d0e_0
2025-10-01T14:08:17.683910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f802e27-cfa0f620-6f273ad2-a648386e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|595b10bb-ab043cfb-7bf09141-999d0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:17.686813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595b10bb-ab043cfb-7bf09141-999d0e_0] Write session: try to update token
2025-10-01T14:08:17.686828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595b10bb-ab043cfb-7bf09141-999d0e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:17.702692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 492 sessionId: src_id|595b10bb-ab043cfb-7bf09141-999d0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:17.704356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:17.704383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:17.704386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:17.704388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:17.704401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254923261993552:5079]
2025-10-01T14:08:17.704408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254923261993552:5079]
2025-10-01T14:08:17.704411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254923261993552:5079]
2025-10-01T14:08:17.704468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:17.704483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.704490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:17.704620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:17.704811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:17.704832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:17.704836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:17.705772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:17.768013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254925638856518:5085]
2025-10-01T14:08:17.768285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 491, pipe: [1:7556254925638856518:5085]
2025-10-01T14:08:17.843660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:17.843933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.843950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.843989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856518:5085], now have 1 active actors on pipe
2025-10-01T14:08:17.844207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:17.844276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254925638856518:5085]
2025-10-01T14:08:17.844282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:17.844315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:17.844407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 492 reason: status is not ok: tablet will be restarted right now sessionId: src_id|595b10bb-ab043cfb-7bf09141-999d0e_0
2025-10-01T14:08:17.844557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 492 sessionId: src_id|595b10bb-ab043cfb-7bf09141-999d0e_0 is DEAD
2025-10-01T14:08:17.844717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595b10bb-ab043cfb-7bf09141-999d0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:17.844729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595b10bb-ab043cfb-7bf09141-999d0e_0] Write session will restart in 0.008311s
2025-10-01T14:08:17.844751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595b10bb-ab043cfb-7bf09141-999d0e_0] Write session: Do CDS request
2025-10-01T14:08:17.844759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595b10bb-ab043cfb-7bf09141-999d0e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:17.852555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:17.853828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595b10bb-ab043cfb-7bf09141-999d0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.853921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:17.853940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 493
2025-10-01T14:08:17.854041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:17.854066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:17.854076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:17.854079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:17.854148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:17.854384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:17.854397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:17.854412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:17.854488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:17.854536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 493 sessionId:  describe result for acl check
2025-10-01T14:08:17.854536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254923261993633:5084]
2025-10-01T14:08:17.854568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:17.854569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:17.854570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:17.854574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254925638856574:5659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:17.855004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254925638856574:5659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:17.855100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:17.855395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:17.855436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:17.855727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:17.855790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.855795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.855796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.855797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.855798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.855799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.855801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.855802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.855803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.855804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.855807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.855808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.855809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.855810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.855816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.855826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.855830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.855833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.855836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.855840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.855844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.855848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.855851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.855855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.855858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.855861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.855864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.855867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.855874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.855881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:17.855886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.855890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:17.855897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.855902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:17.855907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.855911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:17.855916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.855920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:17.855924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.855929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:17.855938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.855943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:17.855951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.855957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:17.855965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.855970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:17.855974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.855978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.855981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.855986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.855990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.855995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.855998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.856002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:17.856005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.856009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:17.856046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:17.857386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254925638856574:5659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:17.859727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:17.859859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254925638856574:5659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:17.859873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254925638856574:5659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:17.859877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254925638856574:5659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:17.859887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:17.860306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:17.860318Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:17.860320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:17.860323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:17.860328Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 492 [2:7556254923261993633:5084]
2025-10-01T14:08:17.860338Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:17.860351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:17.860353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.860355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.860356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.860368Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:17.860372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:17.860376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:17.860422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.860428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.860430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.860433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:17.860436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:17.860495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:17.860501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.860508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:17.860513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:17.860525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:17.860540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856544:2446], now have 1 active actors on pipe
2025-10-01T14:08:17.860548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254923261993628:5084]
2025-10-01T14:08:17.860550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254923261993628:5084]
2025-10-01T14:08:17.860552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254923261993628:5084]
2025-10-01T14:08:17.860562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:17.860571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856610:5659], now have 1 active actors on pipe
2025-10-01T14:08:17.860577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:17.860584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:17.860588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:17.860591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:17.860597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:17.860599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:17.860613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254923261993628:5084]
2025-10-01T14:08:17.860619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:17.860614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 492
2025-10-01T14:08:17.860623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:17.860643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 492
2025-10-01T14:08:17.860673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.860679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.860697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|185aef71-f75579bf-933b9f93-35df06a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:17.860705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:17.860710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:17.860716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:17.860723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:17.860730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:17.860745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.860873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:17.860878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:17.860888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:17.860960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 493 partition: 0 MaxSeqNo: 45 sessionId: src_id|185aef71-f75579bf-933b9f93-35df06a6_0
2025-10-01T14:08:17.861204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595b10bb-ab043cfb-7bf09141-999d0e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|185aef71-f75579bf-933b9f93-35df06a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:17.863979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|185aef71-f75579bf-933b9f93-35df06a6_0] Write session: try to update token
2025-10-01T14:08:17.863999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|185aef71-f75579bf-933b9f93-35df06a6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:17.880806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 493 sessionId: src_id|185aef71-f75579bf-933b9f93-35df06a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:17.882302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:17.882334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:17.882337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:17.882339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:17.882351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254923261993628:5084]
2025-10-01T14:08:17.882355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254923261993628:5084]
2025-10-01T14:08:17.882364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254923261993628:5084]
2025-10-01T14:08:17.882432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:17.882437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:17.882438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:17.882442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:17.882444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:17.882446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:17.882617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:17.883915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:17.944635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254925638856618:5085]
2025-10-01T14:08:17.945019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 492, pipe: [1:7556254925638856618:5085]
2025-10-01T14:08:18.019863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:18.020219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.020233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.020265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254925638856618:5085], now have 1 active actors on pipe
2025-10-01T14:08:18.020458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:18.020571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:18.020633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:18.020696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254925638856618:5085]
2025-10-01T14:08:18.020729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 493 reason: status is not ok: tablet will be restarted right now sessionId: src_id|185aef71-f75579bf-933b9f93-35df06a6_0
2025-10-01T14:08:18.020905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 493 sessionId: src_id|185aef71-f75579bf-933b9f93-35df06a6_0 is DEAD
2025-10-01T14:08:18.021083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185aef71-f75579bf-933b9f93-35df06a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:18.021094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185aef71-f75579bf-933b9f93-35df06a6_0] Write session will restart in 0.008720s
2025-10-01T14:08:18.021124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185aef71-f75579bf-933b9f93-35df06a6_0] Write session: Do CDS request
2025-10-01T14:08:18.021129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185aef71-f75579bf-933b9f93-35df06a6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:18.029456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:18.030884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|185aef71-f75579bf-933b9f93-35df06a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.030970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:18.030987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 494
2025-10-01T14:08:18.031158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.031201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:18.031209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:18.031214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:18.031270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:18.031489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:18.031502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:18.031516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:18.031576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:18.031630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254927556960999:5086]
2025-10-01T14:08:18.031643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 494 sessionId:  describe result for acl check
2025-10-01T14:08:18.031679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:18.031681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:18.031683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:18.031688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254929933823949:5663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:18.032181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:18.032217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254929933823949:5663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:18.032531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:18.032569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:18.032833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:18.032877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.032883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.032884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.032884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.032885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.032886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.032887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.032888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.032888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.032889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.032890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.032891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.032891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.032892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.032896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.032902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.032904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.032907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.032909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.032911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.032913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.032926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.032930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.032932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.032936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.032939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.032941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.032943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.032949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.032957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.032963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.032977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.032981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.032988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.032991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.032996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.033001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.033006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.033010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.033014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.033017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.033020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.033022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.033025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.033028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.033031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.033033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.033036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.033038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.033041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.033044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.033047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.033050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.033053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.033058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.033062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.033085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:18.033794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254929933823949:5663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:18.036688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254929933823949:5663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:18.036703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254929933823949:5663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:18.036707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254929933823949:5663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:18.036716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:18.037103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:18.037691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:18.037715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:18.037718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:18.037721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:18.037728Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 493 [2:7556254927556960999:5086]
2025-10-01T14:08:18.037747Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:18.037763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:18.037766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.037770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.037780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.037797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:18.037808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:18.037816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:18.037872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.037880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.037883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.037886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:18.037889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:18.037962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:18.037973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.037993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.038005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.038023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:18.038049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933823985:5663], now have 1 active actors on pipe
2025-10-01T14:08:18.038059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933823918:2446], now have 1 active actors on pipe
2025-10-01T14:08:18.038066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254927556960994:5086]
2025-10-01T14:08:18.038068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254927556960994:5086]
2025-10-01T14:08:18.038070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254927556960994:5086]
2025-10-01T14:08:18.038087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:18.038080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 493
2025-10-01T14:08:18.038099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:18.038084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 493
2025-10-01T14:08:18.038114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:18.038117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:18.038117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:18.038120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:18.038120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:18.038150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254927556960994:5086]
2025-10-01T14:08:18.038158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:18.038162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:18.038180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.038189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.038235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:18.038246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.038250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.038252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:18.038260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.038268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:18.038293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.038487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.038503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.038531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.038603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 494 partition: 0 MaxSeqNo: 45 sessionId: src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0
2025-10-01T14:08:18.038922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|185aef71-f75579bf-933b9f93-35df06a6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:18.041719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0] Write session: try to update token
2025-10-01T14:08:18.041733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:18.059488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 494 sessionId: src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:18.059878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:18.059901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:18.059904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:18.059907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:18.059916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254927556960994:5086]
2025-10-01T14:08:18.059921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254927556960994:5086]
2025-10-01T14:08:18.059925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254927556960994:5086]
2025-10-01T14:08:18.059982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:18.059983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:18.059990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:18.059994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:18.059994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.059997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:18.060153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:18.061847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:18.120731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254929933823996:5085]
2025-10-01T14:08:18.120967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 493, pipe: [1:7556254929933823996:5085]
2025-10-01T14:08:18.193622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:18.193840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.193856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.193894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933823996:5085], now have 1 active actors on pipe
2025-10-01T14:08:18.194119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:18.194209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:18.194255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:18.194308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254929933823996:5085]
2025-10-01T14:08:18.194338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 494 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0
2025-10-01T14:08:18.194589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 494 sessionId: src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0 is DEAD
2025-10-01T14:08:18.194697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:18.194710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0] Write session will restart in 0.005299s
2025-10-01T14:08:18.194735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0] Write session: Do CDS request
2025-10-01T14:08:18.194741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:18.200857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.200962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:18.200974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 495
2025-10-01T14:08:18.201109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.201140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:18.201147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:18.201150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:18.201507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 495 sessionId:  describe result for acl check
2025-10-01T14:08:18.201533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:18.201539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:18.201540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:18.201544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254929933824032:5668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:18.201947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254929933824032:5668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:18.202247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:18.203929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254929933824032:5668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:18.203952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:18.204147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:18.204158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:18.204169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:18.204224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:18.204270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254927556961111:5099]
2025-10-01T14:08:18.204949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:18.205286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:18.205349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:18.205753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:18.205844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.205852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.205853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.205854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.205856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.205857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.205859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.205860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.205861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.205862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.205864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.205865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.205866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.205868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.205873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.205884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.205888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.205892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.205897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.205901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.205904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.205907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.205910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.205917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.205920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.205923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.205927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.205931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.205940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.205948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.205958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.205964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.205973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.205977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.205985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.205991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.206000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.206005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.206013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.206019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.206028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.206034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.206043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.206048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.206056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.206061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.206065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.206070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.206080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.206085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.206094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.206099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.206107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.206112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.206120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.206124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.206169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:18.206525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254929933824032:5668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:18.206542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254929933824032:5668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:18.206545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254929933824032:5668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:18.206553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:18.210023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:18.210768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:18.210785Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:18.210789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:18.210794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:18.210800Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 494 [2:7556254927556961111:5099]
2025-10-01T14:08:18.210820Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:18.210844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:18.210846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.210849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.210851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.210866Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:18.210871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:18.210882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:18.210945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.210954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.210957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.210960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:18.210963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:18.211027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:18.211034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.211045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.211057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.211073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:18.211094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824070:5668], now have 1 active actors on pipe
2025-10-01T14:08:18.211102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824002:2446], now have 1 active actors on pipe
2025-10-01T14:08:18.211109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254927556961106:5099]
2025-10-01T14:08:18.211114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254927556961106:5099]
2025-10-01T14:08:18.211116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254927556961106:5099]
2025-10-01T14:08:18.211128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:18.211144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:18.211145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:18.211148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:18.211151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:18.211163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:18.211167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:18.211195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254927556961106:5099]
2025-10-01T14:08:18.211206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:18.211213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:18.211205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 494
2025-10-01T14:08:18.211207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 494
2025-10-01T14:08:18.211330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.211341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.211365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:18.211375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.211384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.211387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:18.211395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.211408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:18.211427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.211591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.211599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.211613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.211701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 495 partition: 0 MaxSeqNo: 45 sessionId: src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0
2025-10-01T14:08:18.212037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cdecbd5-cc8c31c2-6a8a521a-5e62019c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:18.214854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0] Write session: try to update token
2025-10-01T14:08:18.214871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:18.227911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:18.227935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:18.227950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254927556961106:5099]
2025-10-01T14:08:18.227995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:18.227997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:18.228175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:18.228455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:18.228660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:18.228822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:18.229048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:18.229096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:18.231283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 495 sessionId: src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:18.233566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:18.233772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.233796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.233832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:18.233899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:18.241890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:18.241915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:18.241918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:18.241920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:18.241932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254927556961106:5099]
2025-10-01T14:08:18.241937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254927556961106:5099]
2025-10-01T14:08:18.241946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254927556961106:5099]
2025-10-01T14:08:18.241995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:18.242006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.242007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:18.242009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:18.242014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:18.242019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:18.242165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:18.294303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254929933824094:5085]
2025-10-01T14:08:18.294635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 494, pipe: [1:7556254929933824094:5085]
2025-10-01T14:08:18.378951Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:18.386202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.386230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.386367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.386440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.386501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.386557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.386603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.386611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.386670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.386721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.386772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.386828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.386869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.386875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.386946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.387003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.387062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.387125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.387167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.387173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.387239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.387302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.387365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.387434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.387482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.387489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.387554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.387622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.387683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.387740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.387782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.387792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.387858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.387926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.387993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.388061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.388111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.388119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.388190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.388256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.388319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.388388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.388437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.388445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.388513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.388572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.388632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.388751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.388818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.388827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.388922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.388972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.389023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.389074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.389119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.389125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.389183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.389238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.389293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.389348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.389387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.389391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.389451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824094:5085], now have 1 active actors on pipe
2025-10-01T14:08:18.389760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:18.389760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254929933824094:5085]
2025-10-01T14:08:18.389775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:18.389782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:18.389809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 495 reason: error at write: Disconnected sessionId: src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0
2025-10-01T14:08:18.389959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 495 sessionId: src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0 is DEAD
2025-10-01T14:08:18.390107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:18.390121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0] Write session will restart in 0.005850s
2025-10-01T14:08:18.390147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0] Write session: Do CDS request
2025-10-01T14:08:18.390154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:18.390239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:18.396855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.396973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:18.396993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 496
2025-10-01T14:08:18.397105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.397138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:18.397149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:18.397153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:18.397551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 496 sessionId:  describe result for acl check
2025-10-01T14:08:18.397584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:18.397585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:18.397587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:18.397590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254929933824126:5673] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:18.398006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254929933824126:5673] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:18.398458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:18.400235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:18.400282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254929933824126:5673] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:18.400421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:18.400435Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:18.400448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:18.400505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:18.400540Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254927556961185:5102]
2025-10-01T14:08:18.401094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:18.401417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:18.401477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:18.401746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:18.401788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.401793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.401794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.401795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.401796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.401797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.401798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.401798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.401799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.401800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.401801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.401802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.401803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.401804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.401808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.401814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.401816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.401819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.401821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.401823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.401825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.401829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.401831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.401834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.401836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.401838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.401840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.401842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.401848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.401852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.401856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.401859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.401862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.401865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.401867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.401870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.401873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.401876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.401878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.401881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.401885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.401889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.401891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.401894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.401896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.401900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.401903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.401906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.401909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.401913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.401915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.401918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.401921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.401924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.401927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.401929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.401951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:18.402312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254929933824126:5673] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:18.402322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254929933824126:5673] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:18.402324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254929933824126:5673] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:18.402330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:18.405593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:18.406319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:18.406332Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:18.406334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:18.406339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:18.406344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 495 [2:7556254927556961185:5102]
2025-10-01T14:08:18.406355Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:18.406390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:18.406394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.406397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.406398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.406414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:18.406426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:18.406432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:18.406476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.406482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.406484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.406486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:18.406489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:18.406540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:18.406546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.406553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.406559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.406568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:18.406581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824095:2446], now have 1 active actors on pipe
2025-10-01T14:08:18.406589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824168:5673], now have 1 active actors on pipe
2025-10-01T14:08:18.406594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254927556961180:5102]
2025-10-01T14:08:18.406596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254927556961180:5102]
2025-10-01T14:08:18.406597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254927556961180:5102]
2025-10-01T14:08:18.406605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:18.406615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:18.406619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:18.406626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:18.406628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:18.406630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:18.406636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:18.406666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254927556961180:5102]
2025-10-01T14:08:18.406652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 495
2025-10-01T14:08:18.406658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 495
2025-10-01T14:08:18.406675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:18.406677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:18.406690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.406694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.406731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:18.406745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.406747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.406749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:18.406757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.406765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:18.406774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.406880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.406887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.406895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.406959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 496 partition: 0 MaxSeqNo: 45 sessionId: src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0
2025-10-01T14:08:18.407243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abef1f61-d38fc97b-ddff20c3-f4920df7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:18.409994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0] Write session: try to update token
2025-10-01T14:08:18.410011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:18.425306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 496 sessionId: src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:18.428267Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:18.428297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:18.428301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:18.428302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:18.428319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254927556961180:5102]
2025-10-01T14:08:18.428328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254927556961180:5102]
2025-10-01T14:08:18.428334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254927556961180:5102]
2025-10-01T14:08:18.428390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:18.428399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:18.428405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:18.428408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:18.428408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.428410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:18.428629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:18.429253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:18.489907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254929933824175:5085]
2025-10-01T14:08:18.490198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 495, pipe: [1:7556254929933824175:5085]
2025-10-01T14:08:18.568370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:18.568668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.568684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.568728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824175:5085], now have 1 active actors on pipe
2025-10-01T14:08:18.569045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254929933824175:5085]
2025-10-01T14:08:18.569077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:18.569498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:18.569509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:18.569593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 496 reason: error at write: Disconnected sessionId: src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0
2025-10-01T14:08:18.569807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 496 sessionId: src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0 is DEAD
2025-10-01T14:08:18.569925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:18.569937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0] Write session will restart in 0.008039s
2025-10-01T14:08:18.569963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0] Write session: Do CDS request
2025-10-01T14:08:18.569973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:18.570052Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:18.577404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:18.578919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.579036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:18.579058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 497
2025-10-01T14:08:18.579068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:18.579227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.579236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:18.579245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:18.579256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:18.579254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:18.579265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:18.579273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:18.579302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:18.579352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254927556961258:5104]
2025-10-01T14:08:18.579735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 497 sessionId:  describe result for acl check
2025-10-01T14:08:18.579764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:18.579769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:18.579770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:18.579775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254929933824212:5677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:18.579912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:18.580246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254929933824212:5677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:18.580297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:18.580354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:18.580654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:18.580722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.580729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.580730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.580733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.580735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.580735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.580737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.580737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.580738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.580739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.580740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.580741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.580741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.580742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.580746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.580752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.580754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.580756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.580758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.580760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.580762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.580764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.580766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.580768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.580770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.580772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.580774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.580776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.580782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.580799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.580806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.580812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.580817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.580824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.580829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.580834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.580839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.580844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.580848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.580855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.580865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.580872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.580879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.580884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.580893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.580902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.580910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.580917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.580924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.580930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.580936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.580939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.580942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.580947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.580949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.580952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.580975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:18.582337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254929933824212:5677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:18.584600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:18.584860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254929933824212:5677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:18.584884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254929933824212:5677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:18.584892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254929933824212:5677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:18.584905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:18.585316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:18.585331Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:18.585336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:18.585339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:18.585345Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 496 [2:7556254927556961258:5104]
2025-10-01T14:08:18.585357Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:18.585373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:18.585381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.585389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.585395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.585411Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:18.585420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:18.585431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:18.585493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.585499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.585502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.585505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:18.585507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:18.585580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:18.585591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.585603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.585615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.585631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:18.585650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824251:5677], now have 1 active actors on pipe
2025-10-01T14:08:18.585655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824178:2446], now have 1 active actors on pipe
2025-10-01T14:08:18.585661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254927556961253:5104]
2025-10-01T14:08:18.585665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254927556961253:5104]
2025-10-01T14:08:18.585667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254927556961253:5104]
2025-10-01T14:08:18.585678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:18.585665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 496
2025-10-01T14:08:18.585694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:18.585678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 496
2025-10-01T14:08:18.585695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:18.585698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:18.585700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:18.585711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:18.585713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:18.585754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.585762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.585773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254927556961253:5104]
2025-10-01T14:08:18.585780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:18.585788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:18.585807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b579fc1-3976a22e-ace97695-11f17152_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:18.585816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.585819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.585820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:18.585826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.585834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:18.585849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.585969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.585974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.585984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.586055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 497 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b579fc1-3976a22e-ace97695-11f17152_0
2025-10-01T14:08:18.586430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbd6e3fa-75d6243f-a4b9b3bb-b5269c78_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b579fc1-3976a22e-ace97695-11f17152_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:18.589065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b579fc1-3976a22e-ace97695-11f17152_0] Write session: try to update token
2025-10-01T14:08:18.589085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b579fc1-3976a22e-ace97695-11f17152_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:18.601995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 497 sessionId: src_id|9b579fc1-3976a22e-ace97695-11f17152_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:18.604113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:18.604374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.604403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.604446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:18.604553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:18.607494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:18.607514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:18.607517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:18.607519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:18.607529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254927556961253:5104]
2025-10-01T14:08:18.607534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254927556961253:5104]
2025-10-01T14:08:18.607538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254927556961253:5104]
2025-10-01T14:08:18.607588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:18.607587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:18.607595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:18.607597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.607598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:18.607599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:18.607763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:18.669080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254929933824260:5085]
2025-10-01T14:08:18.669308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 496, pipe: [1:7556254929933824260:5085]
2025-10-01T14:08:18.748576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:18.756767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.756812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.756987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.757062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.757130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.757194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.757241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.757253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.757326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.757395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.757464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.757535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.757580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.757589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.757651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.757710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.757771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.757833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.757877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.757886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.757945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.758007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.758078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.758140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.758187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.758195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.758255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.758315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.758395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.758457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.758500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.758508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.758569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.758626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.758695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.758763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.758813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.758821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.758883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.758951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.759016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.759084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.759130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.759140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.759201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.759268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.759331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.759391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.759434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.759437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.759503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.759561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.759629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.759695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.759750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.759759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.759830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.759890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.759952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.760019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.760064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.760072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.760134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824260:5085], now have 1 active actors on pipe
2025-10-01T14:08:18.760395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:18.760397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:18.760400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:18.760423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 497 reason: error at write: Disconnected sessionId: src_id|9b579fc1-3976a22e-ace97695-11f17152_0
2025-10-01T14:08:18.760455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254929933824260:5085]
2025-10-01T14:08:18.760604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 497 sessionId: src_id|9b579fc1-3976a22e-ace97695-11f17152_0 is DEAD
2025-10-01T14:08:18.760717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b579fc1-3976a22e-ace97695-11f17152_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:18.760729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b579fc1-3976a22e-ace97695-11f17152_0] Write session will restart in 0.008966s
2025-10-01T14:08:18.760751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b579fc1-3976a22e-ace97695-11f17152_0] Write session: Do CDS request
2025-10-01T14:08:18.760756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b579fc1-3976a22e-ace97695-11f17152_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:18.761145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:18.769095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:18.770670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:18.770782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b579fc1-3976a22e-ace97695-11f17152_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.770871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:18.770898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 498
2025-10-01T14:08:18.770952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:18.770972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:18.770998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:18.771077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.771102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:18.771116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:18.771119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:18.771132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:18.771176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254927556961335:5107]
2025-10-01T14:08:18.771433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 498 sessionId:  describe result for acl check
2025-10-01T14:08:18.771462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:18.771467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:18.771468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:18.771473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254929933824298:5682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:18.771779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:18.771885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254929933824298:5682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:18.772117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:18.772159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:18.772448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:18.772499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.772507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.772510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.772511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.772512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.772513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.772514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.772515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.772516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.772517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.772518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.772519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.772520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.772521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.772526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.772536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.772540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.772544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.772547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.772551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.772555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.772559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.772562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.772566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.772569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.772572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.772575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.772578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.772584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.772591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.772596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.772601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.772604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.772610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.772614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.772620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.772624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.772628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.772633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.772639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.772643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.772647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.772651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.772655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.772659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.772665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.772669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.772675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.772680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.772685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.772689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.772694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.772698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.772702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.772706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.772710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.772740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:18.774161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254929933824298:5682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:18.776184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:18.776662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254929933824298:5682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:18.776672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254929933824298:5682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:18.776674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254929933824298:5682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:18.776680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:18.776749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:18.776764Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:18.776766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:18.776768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:18.776774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 497 [2:7556254927556961335:5107]
2025-10-01T14:08:18.776784Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:18.776806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:18.776809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.776812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.776813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.776823Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:18.776826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:18.776830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:18.776866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.776873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.776874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.776877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:18.776878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:18.776928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:18.776934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.776941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.776947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.776955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:18.776967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254927556961330:5107]
2025-10-01T14:08:18.776973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254927556961330:5107]
2025-10-01T14:08:18.776974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254927556961330:5107]
2025-10-01T14:08:18.776981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:18.776993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824263:2446], now have 1 active actors on pipe
2025-10-01T14:08:18.776993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:18.776997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:18.777000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824337:5682], now have 1 active actors on pipe
2025-10-01T14:08:18.777000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:18.777004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:18.777016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:18.777024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:18.777048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254927556961330:5107]
2025-10-01T14:08:18.777037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 497
2025-10-01T14:08:18.777057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:18.777044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 497
2025-10-01T14:08:18.777065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:18.777086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.777094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.777114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:18.777124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.777127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.777129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:18.777134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.777140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:18.777150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.777254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.777261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.777271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.777335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 498 partition: 0 MaxSeqNo: 45 sessionId: src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0
2025-10-01T14:08:18.777626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b579fc1-3976a22e-ace97695-11f17152_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:18.779873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0] Write session: try to update token
2025-10-01T14:08:18.779886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:18.787470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:18.787493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:18.787504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254927556961330:5107]
2025-10-01T14:08:18.787552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:18.787569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:18.787718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:18.787873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:18.788029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:18.788177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:18.788381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:18.788415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:18.793070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 498 sessionId: src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:18.795545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:18.795811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.795839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.795872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:18.795977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:18.807770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:18.807799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:18.807803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:18.807810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:18.807821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254927556961330:5107]
2025-10-01T14:08:18.807825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254927556961330:5107]
2025-10-01T14:08:18.807831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254927556961330:5107]
2025-10-01T14:08:18.807883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:18.807890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.807892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:18.807892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:18.807898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:18.807903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:18.808049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:18.860577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254929933824366:5085]
2025-10-01T14:08:18.860913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 497, pipe: [1:7556254929933824366:5085]
2025-10-01T14:08:18.952259Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:18.960872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.960906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.961080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.961144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.961206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.961265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.961308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.961320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.961397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.961462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.961530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.961599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.961645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.961656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.961723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.961792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.961856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.961922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.961969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.961975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.962042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.962112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.962176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.962242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.962290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.962296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.962362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.962449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.962516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.962578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.962629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.962632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.962697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.962764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.962828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.962889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.962933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.962939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.963014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.963084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.963172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.963241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.963287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.963295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.963357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.963416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.963482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.963550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.963596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.963602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.963667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.963732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.963804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.963888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.963935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.963943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.964006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:18.964065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:18.964133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:18.964205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:18.964253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:18.964261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:18.964329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824366:5085], now have 1 active actors on pipe
2025-10-01T14:08:18.964577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254929933824366:5085]
2025-10-01T14:08:18.964587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:18.964621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:18.964628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:18.964656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 498 reason: error at write: Disconnected sessionId: src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0
2025-10-01T14:08:18.964843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 498 sessionId: src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0 is DEAD
2025-10-01T14:08:18.964993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:18.965002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0] Write session will restart in 0.007555s
2025-10-01T14:08:18.965028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0] Write session: Do CDS request
2025-10-01T14:08:18.965033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:18.965466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:18.973947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.974031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:18.974049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 499
2025-10-01T14:08:18.974162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:18.974196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:18.974206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:18.974210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:18.974254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:18.974628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 499 sessionId:  describe result for acl check
2025-10-01T14:08:18.974663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:18.974670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:18.974674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:18.974680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254929933824407:5693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:18.975222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254929933824407:5693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:18.977543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254929933824407:5693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:18.978735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:18.979005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:18.979018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:18.979030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:18.979092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:18.979141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254927556961419:5111]
2025-10-01T14:08:18.979816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:18.980185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:18.980229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:18.980575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:18.980637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.980643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.980645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.980645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.980646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.980648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.980649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.980650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.980651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.980652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.980654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.980655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.980657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.980658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.980663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.980673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.980677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.980681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.980685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.980689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.980693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.980697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.980701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.980705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.980709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.980713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.980717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.980721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.980728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.980735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:18.980742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.980747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:18.980752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.980757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:18.980740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254929933824407:5693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:18.980754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254929933824407:5693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:18.980762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.980772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:18.980777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.980782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:18.980758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254929933824407:5693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:18.980786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.980766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:18.980802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:18.980807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.980812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:18.980817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.980822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:18.980826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.980832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:18.980841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.980846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.980850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.980859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.980863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.980868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.980873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.980882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:18.980887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.980892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:18.980934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:18.986059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:18.987303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 498
2025-10-01T14:08:18.987347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 498
2025-10-01T14:08:18.986791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:18.986808Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:18.986812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:18.986816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:18.986822Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 498 [2:7556254927556961419:5111]
2025-10-01T14:08:18.986844Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:18.986866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:18.986868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.986871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.986873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.986914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:18.986919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:18.986927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:18.986995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.986997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.986999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.987002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:18.987005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:18.987085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:18.987087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:18.987098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:18.987108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:18.987124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:18.987141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824442:5693], now have 1 active actors on pipe
2025-10-01T14:08:18.987145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254929933824372:2446], now have 1 active actors on pipe
2025-10-01T14:08:18.987152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254927556961413:5111]
2025-10-01T14:08:18.987154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254927556961413:5111]
2025-10-01T14:08:18.987157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254927556961413:5111]
2025-10-01T14:08:18.987168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:18.987184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:18.987192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:18.987196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:18.987197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:18.987199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:18.987200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:18.987234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254927556961413:5111]
2025-10-01T14:08:18.987240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:18.987250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:18.987837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.987861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.987906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb64d8cf-973c327d-97f979e2-4573844a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:18.987927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:18.987939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:18.987942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:18.987951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:18.987968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:18.987985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.988446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:18.988454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:18.988467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:18.988581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 499 partition: 0 MaxSeqNo: 45 sessionId: src_id|eb64d8cf-973c327d-97f979e2-4573844a_0
2025-10-01T14:08:18.989156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db46b11d-3cb5f60f-5adcbccc-5305596f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eb64d8cf-973c327d-97f979e2-4573844a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:18.991852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb64d8cf-973c327d-97f979e2-4573844a_0] Write session: try to update token
2025-10-01T14:08:18.991873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb64d8cf-973c327d-97f979e2-4573844a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:19.011162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 499 sessionId: src_id|eb64d8cf-973c327d-97f979e2-4573844a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:19.014194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:19.015363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.015395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.015415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:19.015417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:19.015420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:19.015423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:19.015432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254927556961413:5111]
2025-10-01T14:08:19.015437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254927556961413:5111]
2025-10-01T14:08:19.015441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254927556961413:5111]
2025-10-01T14:08:19.015493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:19.015499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:19.015503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:19.015512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:19.015518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.015521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:19.015679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:19.064904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254934228791748:5085]
2025-10-01T14:08:19.065240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 498, pipe: [1:7556254934228791748:5085]
2025-10-01T14:08:19.152669Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:19.153125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:19.153184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228791748:5085], now have 1 active actors on pipe
2025-10-01T14:08:19.153274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:19.153393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:19.153403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:19.153493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 499 reason: error at write: Disconnected sessionId: src_id|eb64d8cf-973c327d-97f979e2-4573844a_0
2025-10-01T14:08:19.153755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:19.153769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 499 sessionId: src_id|eb64d8cf-973c327d-97f979e2-4573844a_0 is DEAD
2025-10-01T14:08:19.153812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254934228791748:5085]
2025-10-01T14:08:19.153844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb64d8cf-973c327d-97f979e2-4573844a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:19.153856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb64d8cf-973c327d-97f979e2-4573844a_0] Write session will restart in 0.008369s
2025-10-01T14:08:19.153883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb64d8cf-973c327d-97f979e2-4573844a_0] Write session: Do CDS request
2025-10-01T14:08:19.153891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb64d8cf-973c327d-97f979e2-4573844a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:19.162821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:19.164843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:19.165035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:19.165043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:19.165050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:19.165111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:19.165145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254931851928831:5123]
2025-10-01T14:08:19.165692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:19.166007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:19.166085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:19.166427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:19.166524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.166530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.166532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.166533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.166534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.166536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.166537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.166538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.166539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.166540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.166541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.166543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.166544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.166546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.166551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.166562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.166566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.166569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.166572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.166576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.166580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.166583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.166587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.166590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.166595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.166598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.166602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.166606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.166615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.166623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.166628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.166633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.166637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.166641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.166646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.166651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.166655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.166666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.166671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.166676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.166681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.166690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.166695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.166700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.166704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.166710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.166718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.166723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.166732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.166737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.166746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.166751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.166759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.166764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.166773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.166778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.166826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:19.166839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb64d8cf-973c327d-97f979e2-4573844a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.166958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:19.166975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 500
2025-10-01T14:08:19.167108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.167138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:19.167149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:19.167153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:19.167622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 500 sessionId:  describe result for acl check
2025-10-01T14:08:19.167657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:19.167659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:19.167661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:19.167666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254934228791795:5697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:19.168273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254934228791795:5697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:19.170162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254934228791795:5697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:19.171776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:19.172185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254934228791795:5697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:19.172198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254934228791795:5697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:19.172204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254934228791795:5697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:19.172212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:19.172561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:19.172590Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:19.172593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:19.172597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:19.172604Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 499 [2:7556254931851928831:5123]
2025-10-01T14:08:19.172623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:19.172646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:19.172654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.172658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.172661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.172677Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:19.172687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:19.172695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:19.172774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.172783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.172785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.172801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:19.172803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:19.172882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:19.172885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.172898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.172909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.172931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:19.172953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228791830:5697], now have 1 active actors on pipe
2025-10-01T14:08:19.172962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228791753:2446], now have 1 active actors on pipe
2025-10-01T14:08:19.172968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254931851928826:5123]
2025-10-01T14:08:19.172971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254931851928826:5123]
2025-10-01T14:08:19.172972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254931851928826:5123]
2025-10-01T14:08:19.172986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:19.173001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:19.173007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 499
2025-10-01T14:08:19.173035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 499
2025-10-01T14:08:19.173021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:19.173029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:19.173064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254931851928826:5123]
2025-10-01T14:08:19.173069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:19.173077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:19.173081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:19.173084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:19.173090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:19.173182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.173192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.173226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:19.173312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.173317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.173319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:19.173329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.173340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:19.173368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.173601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.173613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.173634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.173743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 500 partition: 0 MaxSeqNo: 45 sessionId: src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0
2025-10-01T14:08:19.174185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb64d8cf-973c327d-97f979e2-4573844a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:19.176580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0] Write session: try to update token
2025-10-01T14:08:19.176596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:19.184755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:19.184777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:19.184801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254931851928826:5123]
2025-10-01T14:08:19.184856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:19.185101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:19.185263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.185476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.185634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.185843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:19.185878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:19.185957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:19.201371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 500 sessionId: src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:19.204639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:19.204969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.204992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.205023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:19.205113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:19.207694Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:19.207717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:19.207720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:19.207721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:19.207732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254931851928826:5123]
2025-10-01T14:08:19.207736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254931851928826:5123]
2025-10-01T14:08:19.207740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254931851928826:5123]
2025-10-01T14:08:19.207793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:19.207804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.207811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:19.207814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:19.207833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:19.207838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:19.207948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:19.253831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254934228791859:5085]
2025-10-01T14:08:19.254495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 499, pipe: [1:7556254934228791859:5085]
2025-10-01T14:08:19.348138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:19.355453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.355484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.355634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.355687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.355747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.355800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.355847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.355854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.355910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.355963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.356033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.356091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.356132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.356138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.356198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.356254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.356311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.356368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.356415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.356422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.356482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.356551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.356605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.356664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.356706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.356711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.356768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.356836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.356896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.356951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.356991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.356996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.357065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.357120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.357176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.357231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.357275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.357281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.357339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.357392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.357449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.357516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.357562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.357567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.357622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.357677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.357741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.357800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.357842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.357848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.357910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.357966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.358022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.358090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.358133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.358138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.358202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.358265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.358323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.358401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.358446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.358450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.358510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228791859:5085], now have 1 active actors on pipe
2025-10-01T14:08:19.358913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254934228791859:5085]
2025-10-01T14:08:19.358944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:19.358943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:19.358948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:19.358981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 500 reason: error at write: Disconnected sessionId: src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0
2025-10-01T14:08:19.359151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 500 sessionId: src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0 is DEAD
2025-10-01T14:08:19.359321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:19.359334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0] Write session will restart in 0.007857s
2025-10-01T14:08:19.359360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0] Write session: Do CDS request
2025-10-01T14:08:19.359333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:19.359366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:19.368617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:19.368913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.369019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:19.369041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 501
2025-10-01T14:08:19.369192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.369232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:19.369247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:19.369252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:19.369790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 501 sessionId:  describe result for acl check
2025-10-01T14:08:19.369839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:19.369847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:19.369849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:19.369855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254934228791903:5703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:19.370505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254934228791903:5703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:19.370804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:19.371116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:19.371129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:19.371144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:19.371208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:19.371251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254931851928911:5127]
2025-10-01T14:08:19.371839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:19.372110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:19.372156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:19.372464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:19.372559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.372566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.372567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.372568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.372569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.372570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.372571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.372572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.372576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.372577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.372578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.372579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.372580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.372581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.372587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.372597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.372600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.372604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.372607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.372611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.372614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.372617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.372621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.372624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.372628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.372631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.372634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.372642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.372608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254934228791903:5703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:19.372650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.372662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.372669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.372679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.372688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.372693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.372702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.372707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.372716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.372721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.372730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.372736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.372740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.372745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.372748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.372753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.372763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.372768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.372777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.372782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.372809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.372818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.372822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.372827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.372831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.372834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.372838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.372843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.372884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:19.376885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254934228791903:5703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:19.376909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254934228791903:5703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:19.376913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254934228791903:5703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:19.376922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:19.377038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:19.377697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:19.377719Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:19.377724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:19.377727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:19.377735Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 500 [2:7556254931851928911:5127]
2025-10-01T14:08:19.377750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:19.377773Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:19.377781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.377785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.377787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.377805Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:19.377820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:19.377827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:19.377887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.377897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.377898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.377903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:19.377905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:19.377996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:19.378004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.378015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.378025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.378045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:19.378070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228791865:2446], now have 1 active actors on pipe
2025-10-01T14:08:19.378078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228791942:5703], now have 1 active actors on pipe
2025-10-01T14:08:19.378085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254931851928905:5127]
2025-10-01T14:08:19.378087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254931851928905:5127]
2025-10-01T14:08:19.378089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254931851928905:5127]
2025-10-01T14:08:19.378101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:19.378114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:19.378119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:19.378123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:19.378126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:19.378134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:19.378137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:19.378129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 500
2025-10-01T14:08:19.378171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254931851928905:5127]
2025-10-01T14:08:19.378182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:19.378188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:19.378190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 500
2025-10-01T14:08:19.378230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.378242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.378266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:19.378278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.378286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.378288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:19.378297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.378310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:19.378328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.378572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.378585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.378602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.378684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 501 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0
2025-10-01T14:08:19.379033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|405412d4-c1cc3a35-8b811f95-31d56ce0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:19.382179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0] Write session: try to update token
2025-10-01T14:08:19.382197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:19.390523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:19.390541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:19.390549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254931851928905:5127]
2025-10-01T14:08:19.390586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:19.390609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:19.390767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:19.390903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.391034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.391167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.391353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:19.391387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:19.399626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 501 sessionId: src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:19.402703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:19.403104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.403133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.403174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:19.403351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:19.411611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:19.411636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:19.411639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:19.411644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:19.411656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254931851928905:5127]
2025-10-01T14:08:19.411660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254931851928905:5127]
2025-10-01T14:08:19.411664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254931851928905:5127]
2025-10-01T14:08:19.411713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:19.411717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:19.411725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.411728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:19.411730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:19.411742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:19.411867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:19.459151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254934228791949:5085]
2025-10-01T14:08:19.459510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 500, pipe: [1:7556254934228791949:5085]
2025-10-01T14:08:19.553329Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:19.561341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.561367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.561532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.561590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.561651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.561713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.561761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.561771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.561840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.561900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.561961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.562023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.562075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.562082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.562151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.562212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.562272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.562339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.562397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.562404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.562472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.562532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.562600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.562669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.562714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.562721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.562788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.562853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.562916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.562981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.563025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.563032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.563101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.563165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.563227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.563288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.563338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.563345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.563413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.563478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.563547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.563632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.563689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.563695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.563759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.563820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.563886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.563945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.563988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.563995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.564117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.564183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.564248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.564315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.564365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.564372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.564438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.564498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.564570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.564637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.564685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.564691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.564755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228791949:5085], now have 1 active actors on pipe
2025-10-01T14:08:19.564983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:19.565040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:19.565045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:19.565055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254934228791949:5085]
2025-10-01T14:08:19.565076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 501 reason: error at write: Disconnected sessionId: src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0
2025-10-01T14:08:19.565080Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:08:19.565210Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 5 consumer shared/user session shared/user_1_5_10090980969717386432_v1 is DEAD
2025-10-01T14:08:19.565298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 501 sessionId: src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0 is DEAD
2025-10-01T14:08:19.565328Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254839739486931:5080] disconnected; active server actors: 1
2025-10-01T14:08:19.565337Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254839739486931:5080] client user disconnected session shared/user_1_5_10090980969717386432_v1
2025-10-01T14:08:19.565432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:19.565446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0] Write session will restart in 0.009705s
2025-10-01T14:08:19.565473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0] Write session: Do CDS request
2025-10-01T14:08:19.565480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:19.565540Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:08:19.565694Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:08:19.565703Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:08:19.565715Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.008764s
2025-10-01T14:08:19.565836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:19.572936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:19.573431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:19.573558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:19.573566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:19.573574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:19.573605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:19.573633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254931851928988:5129]
2025-10-01T14:08:19.574182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:19.574751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:19.574805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:19.575125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:19.575192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.575198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.575199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.575200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.575201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.575203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.575204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.575207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.575208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.575209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.575210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.575211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.575212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.575213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.575218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.575227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.575230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.575233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.575237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.575240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.575243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.575246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.575249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.575252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.575256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.575259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.575262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.575265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.575273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.575282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.575288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.575292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.575296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.575304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.575307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.575312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.575316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.575326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.575331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.575340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.575346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.575351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.575358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.575362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.575366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.575371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.575378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.575382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.575386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.575394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.575397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.575402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.575409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.575413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.575417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.575421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.575454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:19.575916Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:08:19.575979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.576057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:19.576074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 502
2025-10-01T14:08:19.576131Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:08:19.576143Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 6
2025-10-01T14:08:19.576180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.576205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:19.576214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:19.576217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:19.576295Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 6 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:08:19.576360Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:08:19.576451Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 auth for : user
2025-10-01T14:08:19.576537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 502 sessionId:  describe result for acl check
2025-10-01T14:08:19.576542Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 Handle describe topics response
2025-10-01T14:08:19.576557Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 auth is DEAD
2025-10-01T14:08:19.576566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:19.576568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:19.576569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:19.576573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254934228791998:5707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:19.576576Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:08:19.576821Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:08:19.576928Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_6_17014875164461049393_v1
2025-10-01T14:08:19.576930Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254934228791999:5708] connected; active server actors: 1
2025-10-01T14:08:19.576949Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556254934228791999:5708] session shared/user_1_6_17014875164461049393_v1
2025-10-01T14:08:19.576958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:08:19.576969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:08:19.576980Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_6_17014875164461049393_v1" (Sender=[1:7556254934228791994:5708], Pipe=[1:7556254934228791999:5708], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:08:19.576984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254934228791998:5707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:19.576985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:08:19.576999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:08:19.577014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_6_17014875164461049393_v1" (Sender=[1:7556254934228791994:5708], Pipe=[1:7556254934228791999:5708], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:08:19.577025Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_6_17014875164461049393_v1" sender [1:7556254934228791994:5708] lock partition 0 for ReadingSession "shared/user_1_6_17014875164461049393_v1" (Sender=[1:7556254934228791994:5708], Pipe=[1:7556254934228791999:5708], Partitions=[], ActiveFamilyCount=1) generation 1 step 6
2025-10-01T14:08:19.577037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:08:19.577042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000034s
2025-10-01T14:08:19.577194Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 6 Session: "shared/user_1_6_17014875164461049393_v1" ClientId: "user" PipeClient { RawX1: 7556254934228791999 RawX2: 4503603922343500 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:08:19.577224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:08:19.578849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254934228791998:5707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:19.579375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:19.580124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:19.580141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:19.580143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:19.580147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:19.580154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 501 [2:7556254931851928988:5129]
2025-10-01T14:08:19.580169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:19.580189Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:19.580197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.580200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.580203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.580219Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:19.580228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:19.580234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:19.580289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.580297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.580298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.580301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:19.580303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:19.580374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:19.580383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.580395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.580409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.580472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 501
2025-10-01T14:08:19.580429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:19.580460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228792006:5713], now have 1 active actors on pipe
2025-10-01T14:08:19.580490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 501, pipe: [1:7556254934228792006:5713]
2025-10-01T14:08:19.580465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228791952:2446], now have 1 active actors on pipe
2025-10-01T14:08:19.580472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254931851928983:5129]
2025-10-01T14:08:19.580474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254931851928983:5129]
2025-10-01T14:08:19.580476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254931851928983:5129]
2025-10-01T14:08:19.580488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:19.580498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:19.580501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:19.580502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:19.580503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:19.580515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:19.580518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:19.580548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254931851928983:5129]
2025-10-01T14:08:19.580551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:19.580559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:19.580583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.580594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.580607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_6_17014875164461049393_v1 on pipe: [1:7556254934228792006:5713]
2025-10-01T14:08:19.580644Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_6_17014875164461049393_v1:1 with generation 501
2025-10-01T14:08:19.580645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.580651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.580653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:19.580669Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_6_17014875164461049393_v1
2025-10-01T14:08:19.580676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.580698Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:08:19.581082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254934228791998:5707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:19.581095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254934228791998:5707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:19.581098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254934228791998:5707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:19.581104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:19.581280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228792040:5707], now have 1 active actors on pipe
2025-10-01T14:08:19.581321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 501
2025-10-01T14:08:19.581364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.581373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.581394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4deb0efc-8a41e3d1-85d669df-25340149_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:19.581407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:08:19.585315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:08:19.585356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:08:19.585364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.585371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.585373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:19.585384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.585402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:19.585414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:08:19.585432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:08:19.585452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.585568Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327699579 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:08:19.585592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:08:19.585614Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 sending to client partition status
2025-10-01T14:08:19.585647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.585661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.585682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.585760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 502 partition: 0 MaxSeqNo: 45 sessionId: src_id|4deb0efc-8a41e3d1-85d669df-25340149_0
2025-10-01T14:08:19.586000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a419c48-b3af0e8e-88fa7b3a-567914c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4deb0efc-8a41e3d1-85d669df-25340149_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:19.588730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb0efc-8a41e3d1-85d669df-25340149_0] Write session: try to update token
2025-10-01T14:08:19.588749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb0efc-8a41e3d1-85d669df-25340149_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:19.603783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:19.603802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:19.603806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:19.603807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:19.603819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254931851928983:5129]
2025-10-01T14:08:19.603826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254931851928983:5129]
2025-10-01T14:08:19.603829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254931851928983:5129]
2025-10-01T14:08:19.603879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:19.603883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:19.603886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:19.603889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:19.603890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.603892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:19.604024Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:19.604078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 502 sessionId: src_id|4deb0efc-8a41e3d1-85d669df-25340149_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:19.606458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:19.748715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:19.749038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.749053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.749253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_6_17014875164461049393_v1
2025-10-01T14:08:19.749272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:19.749302Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_6_17014875164461049393_v1
2025-10-01T14:08:19.749285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:19.749302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:19.749365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 502 reason: error at write: Disconnected sessionId: src_id|4deb0efc-8a41e3d1-85d669df-25340149_0
2025-10-01T14:08:19.749552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 502 sessionId: src_id|4deb0efc-8a41e3d1-85d669df-25340149_0 is DEAD
2025-10-01T14:08:19.749706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb0efc-8a41e3d1-85d669df-25340149_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:19.749713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb0efc-8a41e3d1-85d669df-25340149_0] Write session will restart in 0.007439s
2025-10-01T14:08:19.749736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb0efc-8a41e3d1-85d669df-25340149_0] Write session: Do CDS request
2025-10-01T14:08:19.749742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb0efc-8a41e3d1-85d669df-25340149_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:19.749718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254934228792006:5713]
2025-10-01T14:08:19.749747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:19.757909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb0efc-8a41e3d1-85d669df-25340149_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.757979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:19.757996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 503
2025-10-01T14:08:19.758208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.758258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:19.758270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:19.758274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:19.758770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 503 sessionId:  describe result for acl check
2025-10-01T14:08:19.758816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:19.758819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:19.758824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:19.758830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254934228792088:5716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:19.758818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:19.759427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254934228792088:5716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:19.761009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:19.761190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:19.761201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:19.761213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:19.761266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:19.761316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254931851929073:5132]
2025-10-01T14:08:19.761570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254934228792088:5716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:19.761923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:19.762404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:19.762469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:19.762755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:19.762821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.762830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.762831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.762832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.762834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.762835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.762836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.762838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.762839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.762840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.762842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.762843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.762845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.762846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.762852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.762861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.762864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.762868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.762871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.762875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.762879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.762882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.762886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.762890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.762895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.762898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.762902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.762906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.762913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.762923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.762928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.762931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.762934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.762938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.762941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.762945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.762948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.762951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.762954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.762957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.762960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.762963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.762966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.762969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.762972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.762975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.762981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.762984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.762987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.762990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.762992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.762995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.762997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.763000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.763002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.763005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.763027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:19.766778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254934228792088:5716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:19.766798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254934228792088:5716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:19.766802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254934228792088:5716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:19.766810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:19.766995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:19.767714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:19.767732Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:19.767735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:19.767738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:19.767746Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 502 [2:7556254931851929073:5132]
2025-10-01T14:08:19.767758Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:19.767769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:19.767771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.767774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.767775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.767788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:19.767793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:19.767798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:19.767841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.767843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.767844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.767847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:19.767848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:19.767904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:19.767912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.767920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.767926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.767934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:19.767947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254931851929068:5132]
2025-10-01T14:08:19.767953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254931851929068:5132]
2025-10-01T14:08:19.767954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254931851929068:5132]
2025-10-01T14:08:19.767963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:19.767973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:19.767980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:19.767983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:19.767985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:19.767986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:19.767988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:19.767995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228792128:5716], now have 1 active actors on pipe
2025-10-01T14:08:19.767998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228792049:2446], now have 1 active actors on pipe
2025-10-01T14:08:19.768025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254931851929068:5132]
2025-10-01T14:08:19.768040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:19.768053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:19.768122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 502
2025-10-01T14:08:19.768124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 502
2025-10-01T14:08:19.768234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.768253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.768282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9079702-3df68e48-655b4ef2-2fe841be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:19.768295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.768300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.768302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:19.768312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.768329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:19.768343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.768536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.768548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.768568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.768662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 503 partition: 0 MaxSeqNo: 45 sessionId: src_id|a9079702-3df68e48-655b4ef2-2fe841be_0
2025-10-01T14:08:19.769017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb0efc-8a41e3d1-85d669df-25340149_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a9079702-3df68e48-655b4ef2-2fe841be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:19.772159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9079702-3df68e48-655b4ef2-2fe841be_0] Write session: try to update token
2025-10-01T14:08:19.772177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9079702-3df68e48-655b4ef2-2fe841be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:19.784301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:19.784323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:19.784334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254931851929068:5132]
2025-10-01T14:08:19.784384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:19.784409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:19.784581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:19.784719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.784860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.785000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.785207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:19.785244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:19.789095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 503 sessionId: src_id|a9079702-3df68e48-655b4ef2-2fe841be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:19.792156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:19.792400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.792421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.792455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:19.792550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:19.799774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:19.799790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:19.799792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:19.799794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:19.799802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254931851929068:5132]
2025-10-01T14:08:19.799806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254931851929068:5132]
2025-10-01T14:08:19.799809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254931851929068:5132]
2025-10-01T14:08:19.799847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:19.799852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.799854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:19.799870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:19.799879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:19.799884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:19.799974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:19.849791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254934228792136:5713]
2025-10-01T14:08:19.850139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 502, pipe: [1:7556254934228792136:5713]
2025-10-01T14:08:19.949911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:19.958022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.958053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.958226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.958286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.958357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.958438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.958483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.958492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.958554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.958614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.958668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.958722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.958778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.958788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.958858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.958916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.958980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.959044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.959087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.959093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.959160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.959223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.959282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.959347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.959389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.959395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.959460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.959519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.959577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.959637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.959686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.959692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.959756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.959821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.959885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.959952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.960079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.960088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.960156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.960218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.960284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.960350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.960400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.960407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.960474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.960543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.960607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.960669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.960717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.960725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.960786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.960856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.960921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.960983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.961033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.961040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.961102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:19.961159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:19.961222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:19.961291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:19.961414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:19.961422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:19.961485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228792136:5713], now have 1 active actors on pipe
2025-10-01T14:08:19.961852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:19.961869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:19.961919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 503 reason: error at write: Disconnected sessionId: src_id|a9079702-3df68e48-655b4ef2-2fe841be_0
2025-10-01T14:08:19.962116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 503 sessionId: src_id|a9079702-3df68e48-655b4ef2-2fe841be_0 is DEAD
2025-10-01T14:08:19.962273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9079702-3df68e48-655b4ef2-2fe841be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:19.962286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9079702-3df68e48-655b4ef2-2fe841be_0] Write session will restart in 0.006637s
2025-10-01T14:08:19.962313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9079702-3df68e48-655b4ef2-2fe841be_0] Write session: Do CDS request
2025-10-01T14:08:19.962317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9079702-3df68e48-655b4ef2-2fe841be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:19.962345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:19.962516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254934228792136:5713]
2025-10-01T14:08:19.962524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:19.969826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9079702-3df68e48-655b4ef2-2fe841be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.969950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:19.969969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 504
2025-10-01T14:08:19.970094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:19.970129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:19.970141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:19.970145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:19.970628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 504 sessionId:  describe result for acl check
2025-10-01T14:08:19.970685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:19.970692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:19.970693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:19.970699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254934228792200:5727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:19.971228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254934228792200:5727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:19.971925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:19.974005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:19.974017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254934228792200:5727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:19.974202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:19.974212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:19.974222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:19.974284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:19.974323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254931851929161:5136]
2025-10-01T14:08:19.974922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:19.975219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:19.975266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:19.975557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:19.975616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.975621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.975623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.975624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.975624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.975625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.975628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.975629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.975630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.975631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.975632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.975633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.975634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.975635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.975640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.975648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.975652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.975655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.975659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.975663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.975666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.975670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.975672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.975676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.975679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.975682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.975685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.975689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.975695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.975702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:19.975708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.975712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:19.975716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.975721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:19.975726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.975730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:19.975736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.975741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:19.975744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.975748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:19.975757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.975762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:19.975774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.975778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:19.975781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.975789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:19.975793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.975798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.975802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.975810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.975813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.975818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.975827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.975831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:19.975844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.975854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:19.975892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:19.979841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254934228792200:5727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:19.979861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254934228792200:5727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:19.979864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254934228792200:5727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:19.979874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:19.979997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:19.980579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:19.980593Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:19.980594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:19.980597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:19.980602Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 503 [2:7556254931851929161:5136]
2025-10-01T14:08:19.980614Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:19.980628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:19.980630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.980632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.980634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.980648Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:19.980655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:19.980660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:19.980700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.980704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.980705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.980708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:19.980710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:19.980768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:19.980777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:19.980801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:19.980807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:19.980816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:19.980830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228792162:2446], now have 1 active actors on pipe
2025-10-01T14:08:19.980832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254934228792239:5727], now have 1 active actors on pipe
2025-10-01T14:08:19.980837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254931851929156:5136]
2025-10-01T14:08:19.980839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254931851929156:5136]
2025-10-01T14:08:19.980840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254931851929156:5136]
2025-10-01T14:08:19.980849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:19.980859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:19.980864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:19.980866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:19.980867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:19.980868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:19.980869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:19.980892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254931851929156:5136]
2025-10-01T14:08:19.980893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:19.980896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:19.980916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 503
2025-10-01T14:08:19.980926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 503
2025-10-01T14:08:19.981004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.981020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.981046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:19.981058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:19.981062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:19.981065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:19.981074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:19.981083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:19.981097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.981265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:19.981272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:19.981282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:19.981358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 504 partition: 0 MaxSeqNo: 45 sessionId: src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0
2025-10-01T14:08:19.981771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9079702-3df68e48-655b4ef2-2fe841be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:19.984908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0] Write session: try to update token
2025-10-01T14:08:19.984928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:19.991721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:19.991739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:19.991746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254931851929156:5136]
2025-10-01T14:08:19.991785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:19.991824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:19.991959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:19.992117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.992257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.992390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:19.992582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:19.992621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:20.002741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 504 sessionId: src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:20.005396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:20.005640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.005666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.005708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:20.005798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:20.013234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:20.013256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:20.013259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:20.013261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:20.013273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254931851929156:5136]
2025-10-01T14:08:20.013280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254931851929156:5136]
2025-10-01T14:08:20.013286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254931851929156:5136]
2025-10-01T14:08:20.013334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:20.013341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:20.013347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:20.013347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.013350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:20.013351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:20.013491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:20.062765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254938523759544:5713]
2025-10-01T14:08:20.063364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 503, pipe: [1:7556254938523759544:5713]
2025-10-01T14:08:20.164773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:20.173014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.173038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.173178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.173234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.173293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.173345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.173392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.173400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.173458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.173516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.173569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.173622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.173665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.173672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.173742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.173800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.173856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.173917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.173959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.173966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.174030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.174087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.174145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.174209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.174257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.174264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.174328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.174406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.174467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.174527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.174573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.174579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.174641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.174702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.174764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.174833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.174884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.174895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.174956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.175011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.175081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.175144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.175188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.175195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.175253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.175303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.175359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.175415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.175459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.175466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.175526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.175586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.175650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.175707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.175755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.175762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.175819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.175878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.175932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.175985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.176026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.176033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.176164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759544:5713], now have 1 active actors on pipe
2025-10-01T14:08:20.176423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:20.176487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254938523759544:5713]
2025-10-01T14:08:20.176679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:20.176690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:20.176713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 504 reason: error at write: Disconnected sessionId: src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0
2025-10-01T14:08:20.176935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 504 sessionId: src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0 is DEAD
2025-10-01T14:08:20.177045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:20.177065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0] Write session will restart in 0.007660s
2025-10-01T14:08:20.177090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0] Write session: Do CDS request
2025-10-01T14:08:20.177096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:20.177226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:20.183921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:20.185440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:20.185618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:20.185627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:20.185638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:20.185683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:20.185732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254936146896579:5145]
2025-10-01T14:08:20.185926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.186068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:20.186082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 505
2025-10-01T14:08:20.186237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.186267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:20.186276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:20.186269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:20.186280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:20.186535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:20.186584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:20.186674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 505 sessionId:  describe result for acl check
2025-10-01T14:08:20.186711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:20.186717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:20.186719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:20.186725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254938523759596:5731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:20.186820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:20.186855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.186859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.186860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.186860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.186861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.186862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.186862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.186863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.186864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.186864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.186865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.186865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.186866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.186867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.186871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.186877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.186879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.186881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.186882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.186884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.186886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.186888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.186890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.186892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.186894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.186896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.186898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.186908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.186912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.186917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.186921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.186924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.186926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.186929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.186932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.186935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.186937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.186940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.186942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.186944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.186947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.186950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.186954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.186958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.186962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.186967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.186970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.186974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.186978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.186983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.186987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.186989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.186992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.186994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.186997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.187000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.187022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:20.187228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254938523759596:5731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:20.189163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254938523759596:5731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:20.190656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:20.191276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:20.191290Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:20.191292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:20.191296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:20.191302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 504 [2:7556254936146896579:5145]
2025-10-01T14:08:20.191318Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:20.191333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:20.191340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.191343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.191346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.191362Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:20.191372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:20.191378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:20.191426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.191433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.191434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.191437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:20.191440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:20.191429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254938523759596:5731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:20.191443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254938523759596:5731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:20.191446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254938523759596:5731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:20.191459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:20.191499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:20.191506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.191516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.191526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.191543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:20.191554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 504
2025-10-01T14:08:20.191562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759546:2446], now have 1 active actors on pipe
2025-10-01T14:08:20.191573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254936146896574:5145]
2025-10-01T14:08:20.191580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254936146896574:5145]
2025-10-01T14:08:20.191582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254936146896574:5145]
2025-10-01T14:08:20.191591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:20.191595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:20.191597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:20.191599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:20.191609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:20.191620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:20.191626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:20.191637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759630:5731], now have 1 active actors on pipe
2025-10-01T14:08:20.191646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 504
2025-10-01T14:08:20.191667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254936146896574:5145]
2025-10-01T14:08:20.191674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:20.191681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:20.191697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.191704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.191730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|639f36e3-1912c63e-846788dd-5204450d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:20.191741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.191749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.191751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:20.191759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.191771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:20.191793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.191938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.191955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.191977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.192053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 505 partition: 0 MaxSeqNo: 45 sessionId: src_id|639f36e3-1912c63e-846788dd-5204450d_0
2025-10-01T14:08:20.192428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87202d6d-cf3b49b1-a6945a65-51889f34_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|639f36e3-1912c63e-846788dd-5204450d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:20.195368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639f36e3-1912c63e-846788dd-5204450d_0] Write session: try to update token
2025-10-01T14:08:20.195389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639f36e3-1912c63e-846788dd-5204450d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:20.211496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:20.211518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:20.211520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:20.211523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:20.211533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254936146896574:5145]
2025-10-01T14:08:20.211540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254936146896574:5145]
2025-10-01T14:08:20.211544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254936146896574:5145]
2025-10-01T14:08:20.211589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:20.211593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:20.211595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:20.211599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:20.211600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.211602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:20.211727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:20.212292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 505 sessionId: src_id|639f36e3-1912c63e-846788dd-5204450d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:20.214806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:20.276785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254938523759654:5713]
2025-10-01T14:08:20.277057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 504, pipe: [1:7556254938523759654:5713]
2025-10-01T14:08:20.370627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:20.370922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.370936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.370968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759654:5713], now have 1 active actors on pipe
2025-10-01T14:08:20.371121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:20.371172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:20.371204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254938523759654:5713]
2025-10-01T14:08:20.371217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:20.371284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 505 reason: status is not ok: tablet will be restarted right now sessionId: src_id|639f36e3-1912c63e-846788dd-5204450d_0
2025-10-01T14:08:20.371443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 505 sessionId: src_id|639f36e3-1912c63e-846788dd-5204450d_0 is DEAD
2025-10-01T14:08:20.371624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f36e3-1912c63e-846788dd-5204450d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:20.371640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f36e3-1912c63e-846788dd-5204450d_0] Write session will restart in 0.008648s
2025-10-01T14:08:20.371672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f36e3-1912c63e-846788dd-5204450d_0] Write session: Do CDS request
2025-10-01T14:08:20.371679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f36e3-1912c63e-846788dd-5204450d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:20.377894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:20.379328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:20.379488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:20.379498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:20.379508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:20.379549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:20.379589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254936146896663:5152]
2025-10-01T14:08:20.380194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:20.380459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:20.380495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:20.380815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:20.380873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.380878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.380879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.380880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.380881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.380882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.380883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.380884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.380885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.380886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.380887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.380888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.380889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.380891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.380895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.380906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.380910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.380913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.380917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.380923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.380926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.380930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.380938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.380943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.380950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.380954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.380957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.380960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.380966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.380973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.380983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.380992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.381000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.381009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.381013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.381022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.381030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.381035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.381039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.381048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.381053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.381062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.381069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.381075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.381082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.381087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.381095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.381099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.381107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.381112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.381121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.381125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.381132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.381137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.381141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.381149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.381187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:20.381939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639f36e3-1912c63e-846788dd-5204450d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.382014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:20.382038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 506
2025-10-01T14:08:20.382162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.382189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:20.382199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:20.382203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:20.382595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 506 sessionId:  describe result for acl check
2025-10-01T14:08:20.382634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:20.382641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:20.382643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:20.382648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254938523759704:5737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:20.383042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254938523759704:5737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:20.384882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:20.385036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254938523759704:5737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:20.385503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:20.385515Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:20.385517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:20.385519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:20.385524Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 505 [2:7556254936146896663:5152]
2025-10-01T14:08:20.385534Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:20.385546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:20.385551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.385554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.385555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.385567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:20.385573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:20.385577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:20.385615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.385622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.385624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.385627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:20.385628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:20.385675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:20.385680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.385687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.385696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.385705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:20.385716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254936146896658:5152]
2025-10-01T14:08:20.385721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254936146896658:5152]
2025-10-01T14:08:20.385722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254936146896658:5152]
2025-10-01T14:08:20.385728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:20.385737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:20.385738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759657:2446], now have 1 active actors on pipe
2025-10-01T14:08:20.385739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:20.385741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:20.385745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:20.385753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:20.385759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:20.385779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254936146896658:5152]
2025-10-01T14:08:20.385787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:20.385770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 505
2025-10-01T14:08:20.385804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:20.390508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254938523759704:5737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:20.390520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254938523759704:5737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:20.390524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254938523759704:5737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:20.390531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:20.390705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759743:5737], now have 1 active actors on pipe
2025-10-01T14:08:20.390740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 505
2025-10-01T14:08:20.390805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.390815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.390839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88c652be-a83fbff7-47adc4e1-db18a245_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:20.390852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.390861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.390868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:20.390888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.390906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:20.390927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.391062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.391076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.391087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.391135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 506 partition: 0 MaxSeqNo: 45 sessionId: src_id|88c652be-a83fbff7-47adc4e1-db18a245_0
2025-10-01T14:08:20.391474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f36e3-1912c63e-846788dd-5204450d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|88c652be-a83fbff7-47adc4e1-db18a245_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:20.394364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88c652be-a83fbff7-47adc4e1-db18a245_0] Write session: try to update token
2025-10-01T14:08:20.394403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88c652be-a83fbff7-47adc4e1-db18a245_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:20.396382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:20.396399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:20.396409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254936146896658:5152]
2025-10-01T14:08:20.396441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:20.396445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:20.396592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:20.396715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:20.396853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:20.396984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:20.397180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:20.397212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:20.408734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 506 sessionId: src_id|88c652be-a83fbff7-47adc4e1-db18a245_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:20.411195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:20.411412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.411437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.411472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:20.411541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:20.416077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:20.416099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:20.416101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:20.416102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:20.416111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254936146896658:5152]
2025-10-01T14:08:20.416115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254936146896658:5152]
2025-10-01T14:08:20.416119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254936146896658:5152]
2025-10-01T14:08:20.416158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:20.416163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.416165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:20.416170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:20.416176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:20.416180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:20.416293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:20.471326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254938523759746:5713]
2025-10-01T14:08:20.471590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 505, pipe: [1:7556254938523759746:5713]
2025-10-01T14:08:20.574581Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:20.582805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.582833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.583005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.583066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.583135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.583202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.583253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.583262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.583334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.583398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.583465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.583532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.583677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.583686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.583757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.583823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.583889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.583955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.584007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.584015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.584081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.584146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.584212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.584276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.584322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.584330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.584401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.584471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.584540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.584604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.584657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.584664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.584733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.584808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.584876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.584945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.584989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.584996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.585064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.585125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.585199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.585267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.585310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.585317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.585387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.585448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.585520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.585589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.585636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.585643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.585709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.585768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.585835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.585902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.585950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.585956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.586026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:20.586090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:20.586156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:20.586218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:20.586259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:20.586266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:20.586334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759746:5713], now have 1 active actors on pipe
2025-10-01T14:08:20.586646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:20.586648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:20.586663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:20.586691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 506 reason: error at write: Disconnected sessionId: src_id|88c652be-a83fbff7-47adc4e1-db18a245_0
2025-10-01T14:08:20.586695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254938523759746:5713]
2025-10-01T14:08:20.586924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 506 sessionId: src_id|88c652be-a83fbff7-47adc4e1-db18a245_0 is DEAD
2025-10-01T14:08:20.587071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c652be-a83fbff7-47adc4e1-db18a245_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:20.587086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c652be-a83fbff7-47adc4e1-db18a245_0] Write session will restart in 0.009306s
2025-10-01T14:08:20.587113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c652be-a83fbff7-47adc4e1-db18a245_0] Write session: Do CDS request
2025-10-01T14:08:20.587120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c652be-a83fbff7-47adc4e1-db18a245_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:20.587398Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:20.595182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:20.597109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:20.597277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:20.597285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:20.597305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:20.597359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:20.597396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254936146896747:5154]
2025-10-01T14:08:20.597910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:20.597978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88c652be-a83fbff7-47adc4e1-db18a245_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.598047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:20.598063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 507
2025-10-01T14:08:20.598212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:20.598254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:20.598350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.598407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:20.598422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:20.598425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:20.598543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:20.598606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.598613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.598614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.598618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.598619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.598620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.598621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.598621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.598622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.598623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.598624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.598625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.598626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.598626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.598631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.598640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.598645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.598649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.598653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.598656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.598660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.598663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.598667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.598671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.598675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.598679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.598684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.598688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.598695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.598703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.598709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.598714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.598719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.598725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.598733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.598739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.598747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.598752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.598760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.598765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.598773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.598778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.598784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.598788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.598791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.598796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.598787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 507 sessionId:  describe result for acl check
2025-10-01T14:08:20.598800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.598809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.598813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.598821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.598817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:20.598823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:20.598825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.598827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:20.598829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.598832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254938523759796:5741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:20.598833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.598837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.598841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.598845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.598893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:20.599347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254938523759796:5741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:20.600916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254938523759796:5741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:20.602665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:20.603266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:20.603280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:20.603282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:20.603285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:20.603291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 506 [2:7556254936146896747:5154]
2025-10-01T14:08:20.603306Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:20.603321Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:20.603328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.603334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.603336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.603349Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:20.603358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:20.603373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:20.603425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.603431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.603433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.603435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:20.603438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:20.603498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:20.603507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.603519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.603530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.603546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:20.603568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759749:2446], now have 1 active actors on pipe
2025-10-01T14:08:20.603580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254936146896742:5154]
2025-10-01T14:08:20.603585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254936146896742:5154]
2025-10-01T14:08:20.603587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254936146896742:5154]
2025-10-01T14:08:20.603596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:20.603576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 506
2025-10-01T14:08:20.603614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:20.603615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:20.603624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:20.603627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:20.603629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:20.603631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:20.603642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254938523759796:5741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:20.603660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254938523759796:5741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:20.603663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254938523759796:5741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:20.603667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254936146896742:5154]
2025-10-01T14:08:20.603671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:20.603684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:20.603697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:20.603823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759832:5741], now have 1 active actors on pipe
2025-10-01T14:08:20.603853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 506
2025-10-01T14:08:20.603998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.604008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.604031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:20.604042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.604046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.604053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:20.604062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.604075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:20.604091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.604234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.604241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.604253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.604323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 507 partition: 0 MaxSeqNo: 45 sessionId: src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0
2025-10-01T14:08:20.604733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88c652be-a83fbff7-47adc4e1-db18a245_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:20.607667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0] Write session: try to update token
2025-10-01T14:08:20.607692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:20.622985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 507 sessionId: src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:20.624574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:20.624603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:20.624605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:20.624607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:20.624619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254936146896742:5154]
2025-10-01T14:08:20.624624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254936146896742:5154]
2025-10-01T14:08:20.624630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254936146896742:5154]
2025-10-01T14:08:20.624678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:20.624684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:20.624691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:20.624691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.624693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:20.624696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:20.624843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:20.625397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:20.686879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254938523759842:5713]
2025-10-01T14:08:20.687154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 506, pipe: [1:7556254938523759842:5713]
2025-10-01T14:08:20.775450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:08:20.775478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-01T14:08:20.781652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:20.781945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.781967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.782010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759842:5713], now have 1 active actors on pipe
2025-10-01T14:08:20.782345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:20.782388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:20.782410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-10-01T14:08:20.782425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254938523759842:5713]
2025-10-01T14:08:20.782439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:20.782441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:20.782495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 507 reason: error at write: Disconnected sessionId: src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0
2025-10-01T14:08:20.782714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 507 sessionId: src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0 is DEAD
2025-10-01T14:08:20.782866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:20.782875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0] Write session will restart in 0.009065s
2025-10-01T14:08:20.782901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0] Write session: Do CDS request
2025-10-01T14:08:20.782907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:20.790859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:20.792427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:20.792632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:20.792642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:20.792664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:20.792714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:20.792751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254936146896834:5158]
2025-10-01T14:08:20.792871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.792963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:20.792976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 508
2025-10-01T14:08:20.793072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.793099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:20.793109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:20.793112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:20.793384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:20.793493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 508 sessionId:  describe result for acl check
2025-10-01T14:08:20.793528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:20.793529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:20.793531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:20.793535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254938523759893:5746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:20.793617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:20.793657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:20.793944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:20.793994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.794001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.794002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.794003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.794004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.794005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.794006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.794007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.794008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.794009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.793995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254938523759893:5746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:20.794010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.794013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.794014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.794015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.794020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.794030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.794034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.794038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.794042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.794046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.794050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.794054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.794058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.794063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.794067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.794071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.794074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.794078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.794085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.794093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.794104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.794110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.794120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.794125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.794134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.794143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.794152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.794161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.794169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.794177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.794181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.794186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.794194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.794198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.794205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.794210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.794214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.794218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.794225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.794228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.794232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.794239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.794242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.794247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.794254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.794258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.794290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:20.795732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254938523759893:5746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:20.798017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:20.798057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254938523759893:5746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:20.798070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254938523759893:5746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:20.798073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254938523759893:5746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:20.798083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:20.798652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:20.798664Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:20.798667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:20.798673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:20.798679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 507 [2:7556254936146896834:5158]
2025-10-01T14:08:20.798696Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:20.798715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:20.798722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.798726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.798728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.798744Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:20.798755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:20.798761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:20.798812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.798819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.798821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.798824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:20.798826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:20.798889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:20.798897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.798908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.798917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.798936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:20.798958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759931:5746], now have 1 active actors on pipe
2025-10-01T14:08:20.798966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759847:2446], now have 1 active actors on pipe
2025-10-01T14:08:20.798973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254936146896829:5158]
2025-10-01T14:08:20.798977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254936146896829:5158]
2025-10-01T14:08:20.798979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254936146896829:5158]
2025-10-01T14:08:20.798991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:20.799009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:20.799017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:20.799020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:20.799023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:20.799027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:20.799031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:20.799016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 507
2025-10-01T14:08:20.799058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254936146896829:5158]
2025-10-01T14:08:20.799065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:20.799027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 507
2025-10-01T14:08:20.799068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:20.799080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.799087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.799146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3108087-60b765cb-344ddc99-cecfbe42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:20.799157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.799161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.799163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:20.799171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.799184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:20.799240Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:08:20.799279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.799428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.799440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.799454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.799478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 4 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:08:20.799512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:08:20.799531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 508 partition: 0 MaxSeqNo: 45 sessionId: src_id|3108087-60b765cb-344ddc99-cecfbe42_0
2025-10-01T14:08:20.799852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcbeb0fe-2cb451e0-a7c25837-25565740_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3108087-60b765cb-344ddc99-cecfbe42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:20.802520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3108087-60b765cb-344ddc99-cecfbe42_0] Write session: try to update token
2025-10-01T14:08:20.802537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3108087-60b765cb-344ddc99-cecfbe42_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:20.819255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 508 sessionId: src_id|3108087-60b765cb-344ddc99-cecfbe42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:20.820358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:20.820383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:20.820386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:20.820387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:20.820397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254936146896829:5158]
2025-10-01T14:08:20.820403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254936146896829:5158]
2025-10-01T14:08:20.820407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254936146896829:5158]
2025-10-01T14:08:20.820459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:20.820463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:20.820469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:20.820472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:20.820475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.820478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:20.820614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:20.822158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:20.882454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254938523759941:5713]
2025-10-01T14:08:20.882733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 507, pipe: [1:7556254938523759941:5713]
2025-10-01T14:08:20.978309Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:20.978618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.978633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.978677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759941:5713], now have 1 active actors on pipe
2025-10-01T14:08:20.978894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:20.978902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:20.978916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254938523759941:5713]
2025-10-01T14:08:20.978939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:20.978941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:20.979009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 508 reason: error at write: Disconnected sessionId: src_id|3108087-60b765cb-344ddc99-cecfbe42_0
2025-10-01T14:08:20.979224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 508 sessionId: src_id|3108087-60b765cb-344ddc99-cecfbe42_0 is DEAD
2025-10-01T14:08:20.980211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3108087-60b765cb-344ddc99-cecfbe42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:20.980227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3108087-60b765cb-344ddc99-cecfbe42_0] Write session will restart in 0.005897s
2025-10-01T14:08:20.980259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3108087-60b765cb-344ddc99-cecfbe42_0] Write session: Do CDS request
2025-10-01T14:08:20.980265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3108087-60b765cb-344ddc99-cecfbe42_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:20.986886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3108087-60b765cb-344ddc99-cecfbe42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.987032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:20.987052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 509
2025-10-01T14:08:20.987068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:20.987159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:20.987201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:20.987210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:20.987214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:20.987530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 509 sessionId:  describe result for acl check
2025-10-01T14:08:20.987553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:20.987554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:20.987555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:20.987559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254938523760017:5757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:20.987908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254938523760017:5757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:20.988589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:20.988782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:20.988802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:20.988814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:20.988868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:20.988906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254936146896928:5163]
2025-10-01T14:08:20.989394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254938523760017:5757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:20.989467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:20.989747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:20.989799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:20.990126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:20.990190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.990196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.990197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.990199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.990200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.990201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.990202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.990204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.990205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.990206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.990207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.990208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.990209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.990212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.990218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.990226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.990230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.990233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.990237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.990241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.990244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.990248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.990252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.990256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.990259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.990263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.990266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.990270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.990277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.990289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:20.990299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.990307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:20.990316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.990325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:20.990329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.990334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:20.990339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.990348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:20.990356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.990366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:20.990404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.990413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:20.990417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.990422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:20.990428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.990437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:20.990441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.990450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.990454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.990463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.990467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.990473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.990480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.990485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:20.990492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.990497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:20.990537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:20.993905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254938523760017:5757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:20.993917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254938523760017:5757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:20.993919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254938523760017:5757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:20.993925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:20.994098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:20.994717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:20.994730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:20.994732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:20.994735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:20.994742Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 508 [2:7556254936146896928:5163]
2025-10-01T14:08:20.994757Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:20.994777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:20.994783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.994786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.994788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.994804Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:20.994816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:20.994821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:20.994877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.994884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.994885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.994888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:20.994891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:20.994952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:20.994959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:20.994972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:20.994983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:20.995003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:20.995024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523760052:5757], now have 1 active actors on pipe
2025-10-01T14:08:20.995034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254938523759971:2446], now have 1 active actors on pipe
2025-10-01T14:08:20.995041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254936146896923:5163]
2025-10-01T14:08:20.995045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254936146896923:5163]
2025-10-01T14:08:20.995047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254936146896923:5163]
2025-10-01T14:08:20.995058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:20.995072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:20.995072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:20.995075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:20.995077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:20.995086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:20.995089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:20.995119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254936146896923:5163]
2025-10-01T14:08:20.995131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:20.995136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:20.995145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.995149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.995061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 508
2025-10-01T14:08:20.995073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 508
2025-10-01T14:08:20.995195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22843024-7041ba15-3bd8b850-eca24331_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:20.995206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:20.995211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:20.995213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:20.995221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:20.995230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:20.995250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.995539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:20.995552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:20.995572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:20.995647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 509 partition: 0 MaxSeqNo: 45 sessionId: src_id|22843024-7041ba15-3bd8b850-eca24331_0
2025-10-01T14:08:20.995993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3108087-60b765cb-344ddc99-cecfbe42_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|22843024-7041ba15-3bd8b850-eca24331_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:20.998250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22843024-7041ba15-3bd8b850-eca24331_0] Write session: try to update token
2025-10-01T14:08:20.998265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22843024-7041ba15-3bd8b850-eca24331_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:21.013555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 509 sessionId: src_id|22843024-7041ba15-3bd8b850-eca24331_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:21.015773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:21.015788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:21.015790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:21.015792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:21.015800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254936146896923:5163]
2025-10-01T14:08:21.015804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254936146896923:5163]
2025-10-01T14:08:21.015808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254936146896923:5163]
2025-10-01T14:08:21.015852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:21.015852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:21.015856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:21.015859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.015859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:21.015861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:21.015986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:21.016196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:21.079246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254942818727357:5713]
2025-10-01T14:08:21.079730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 508, pipe: [1:7556254942818727357:5713]
2025-10-01T14:08:21.159495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:21.159795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.159811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.159852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727357:5713], now have 1 active actors on pipe
2025-10-01T14:08:21.160110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:21.160126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:21.160064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:21.160185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 509 reason: error at write: Disconnected sessionId: src_id|22843024-7041ba15-3bd8b850-eca24331_0
2025-10-01T14:08:21.160235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254942818727357:5713]
2025-10-01T14:08:21.160256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:21.160370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 509 sessionId: src_id|22843024-7041ba15-3bd8b850-eca24331_0 is DEAD
2025-10-01T14:08:21.160552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22843024-7041ba15-3bd8b850-eca24331_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:21.160564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22843024-7041ba15-3bd8b850-eca24331_0] Write session will restart in 0.006208s
2025-10-01T14:08:21.160603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22843024-7041ba15-3bd8b850-eca24331_0] Write session: Do CDS request
2025-10-01T14:08:21.160610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22843024-7041ba15-3bd8b850-eca24331_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:21.167852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22843024-7041ba15-3bd8b850-eca24331_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.167983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:21.168001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 510
2025-10-01T14:08:21.168141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.168175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:21.168181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:21.168184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:21.168562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:21.168580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 510 sessionId:  describe result for acl check
2025-10-01T14:08:21.168619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:21.168620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:21.168622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:21.168627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254942818727406:5761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:21.169158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254942818727406:5761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:21.170440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:21.170623Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:21.170632Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:21.170642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:21.170689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:21.170722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254940441864310:5165]
2025-10-01T14:08:21.170970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254942818727406:5761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:21.171134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:21.171372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:21.171402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:21.171591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:21.171626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.171630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.171630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.171631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.171631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.171632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.171633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.171633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.171634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.171634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.171635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.171635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.171636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.171636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.171641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.171647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.171649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.171651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.171653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.171655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.171657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.171659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.171661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.171664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.171666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.171668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.171670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.171673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.171677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.171681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.171686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.171691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.171697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.171701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.171704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.171709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.171713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.171717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.171721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.171725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.171730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.171734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.171738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.171742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.171746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.171753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.171757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.171761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.171763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.171766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.171769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.171772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.171774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.171778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.171782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.171787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.171820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:21.175251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254942818727406:5761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:21.175266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254942818727406:5761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:21.175270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254942818727406:5761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:21.175278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:21.175436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:21.176024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:21.176036Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:21.176038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:21.176042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:21.176049Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 509 [2:7556254940441864310:5165]
2025-10-01T14:08:21.176063Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:21.176078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:21.176083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.176086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.176087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.176099Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:21.176102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:21.176107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:21.176156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.176163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.176164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.176167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:21.176170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:21.176236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:21.176241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.176252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.176261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.176279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:21.176299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727360:2446], now have 1 active actors on pipe
2025-10-01T14:08:21.176305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727446:5761], now have 1 active actors on pipe
2025-10-01T14:08:21.176312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254940441864305:5165]
2025-10-01T14:08:21.176315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254940441864305:5165]
2025-10-01T14:08:21.176317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254940441864305:5165]
2025-10-01T14:08:21.176328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:21.176341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:21.176354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:21.176350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 509
2025-10-01T14:08:21.176373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:21.176379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:21.176383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:21.176385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:21.176405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254940441864305:5165]
2025-10-01T14:08:21.176411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:21.176419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:21.176395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 509
2025-10-01T14:08:21.176438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.176447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.176476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:21.176486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.176490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.176492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:21.176499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.176511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:21.176530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.176692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.176704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.176727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.176827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 510 partition: 0 MaxSeqNo: 45 sessionId: src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0
2025-10-01T14:08:21.177190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22843024-7041ba15-3bd8b850-eca24331_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:21.179625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0] Write session: try to update token
2025-10-01T14:08:21.179642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:21.194010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 510 sessionId: src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:21.196399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:21.197416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.197440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.197460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:21.197463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:21.197466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:21.197468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:21.197477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254940441864305:5165]
2025-10-01T14:08:21.197481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254940441864305:5165]
2025-10-01T14:08:21.197484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254940441864305:5165]
2025-10-01T14:08:21.197524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:21.197537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:21.197538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:21.197541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:21.197543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.197551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:21.197676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:21.260315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254942818727470:5713]
2025-10-01T14:08:21.260698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 509, pipe: [1:7556254942818727470:5713]
2025-10-01T14:08:21.340109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:21.340315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:21.340361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727470:5713], now have 1 active actors on pipe
2025-10-01T14:08:21.340462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:21.340562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254942818727470:5713]
2025-10-01T14:08:21.340591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:21.349315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:21.350210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:21.350222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:21.350238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 510 reason: error at write: Disconnected sessionId: src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0
2025-10-01T14:08:21.350355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 510 sessionId: src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0 is DEAD
2025-10-01T14:08:21.350535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:21.350546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0] Write session will restart in 0.005524s
2025-10-01T14:08:21.350573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0] Write session: Do CDS request
2025-10-01T14:08:21.350579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:21.355914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:21.356114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:21.356124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:21.356134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:21.356178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:21.356215Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254940441864441:5179]
2025-10-01T14:08:21.356748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:21.356885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.357008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:21.357019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 511
2025-10-01T14:08:21.357043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:21.357085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:21.357112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.357133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:21.357140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:21.357143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:21.357438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:21.357438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 511 sessionId:  describe result for acl check
2025-10-01T14:08:21.357463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:21.357464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:21.357466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:21.357469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254942818727527:5767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:21.357502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.357507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.357510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.357511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.357512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.357513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.357514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.357515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.357516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.357517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.357518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.357519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.357520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.357521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.357526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.357534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.357537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.357541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.357544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.357547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.357550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.357553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.357556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.357559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.357562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.357565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.357567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.357570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.357577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.357583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.357588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.357592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.357596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.357602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.357605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.357609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.357612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.357616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.357620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.357628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.357633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.357637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.357644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.357647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.357651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.357655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.357660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.357667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.357670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.357675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.357678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.357685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.357690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.357694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.357702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.357706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.357806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:21.357837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254942818727527:5767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:21.360103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254942818727527:5767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:21.361513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:21.362165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254942818727527:5767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:21.362180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254942818727527:5767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:21.362183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254942818727527:5767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:21.362189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:21.362346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:21.362360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:21.362362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:21.362365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:21.362389Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 510 [2:7556254940441864441:5179]
2025-10-01T14:08:21.362404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:21.362479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:21.362489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.362492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.362497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.362512Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:21.362520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:21.362526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:21.362572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.362578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.362580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.362583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:21.362586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:21.362708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:21.362718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.362728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.362737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.362730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 510
2025-10-01T14:08:21.362732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 510
2025-10-01T14:08:21.362750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:21.362763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727563:5767], now have 1 active actors on pipe
2025-10-01T14:08:21.362770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727476:2446], now have 1 active actors on pipe
2025-10-01T14:08:21.362784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254940441864435:5179]
2025-10-01T14:08:21.362790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254940441864435:5179]
2025-10-01T14:08:21.362792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254940441864435:5179]
2025-10-01T14:08:21.362803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:21.362812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:21.362815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:21.362817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:21.362822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.362827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.362848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:21.362864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:21.362871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:21.362904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:21.362914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.362918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.362920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:21.362927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.362940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:21.362957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254940441864435:5179]
2025-10-01T14:08:21.362967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:21.362975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:21.362991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.363264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.363286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.363323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.363397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 511 partition: 0 MaxSeqNo: 45 sessionId: src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0
2025-10-01T14:08:21.363727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c06b946-5823c768-62df6dd5-a0c326b5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:21.366088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0] Write session: try to update token
2025-10-01T14:08:21.366109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:21.380203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 511 sessionId: src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:21.382547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:21.382610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:21.382629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:21.382632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:21.382635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:21.382643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254940441864435:5179]
2025-10-01T14:08:21.382648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254940441864435:5179]
2025-10-01T14:08:21.382651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254940441864435:5179]
2025-10-01T14:08:21.382679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:21.382691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:21.382694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:21.382700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.382710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.382729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:21.382741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.382747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:21.382862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:21.440565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254942818727571:5713]
2025-10-01T14:08:21.440923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 510, pipe: [1:7556254942818727571:5713]
2025-10-01T14:08:21.532777Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:21.533119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727571:5713], now have 1 active actors on pipe
2025-10-01T14:08:21.533306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:21.533626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:21.533712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 511 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0
2025-10-01T14:08:21.533889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 511 sessionId: src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0 is DEAD
2025-10-01T14:08:21.534037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:21.534044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0] Write session will restart in 0.008736s
2025-10-01T14:08:21.534062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0] Write session: Do CDS request
2025-10-01T14:08:21.534067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:21.534149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254942818727571:5713]
2025-10-01T14:08:21.534166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:21.542397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:21.543847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.543937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:21.543953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 512
2025-10-01T14:08:21.544065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.544095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:21.544103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:21.544107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:21.544112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:21.544323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:21.544333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:21.544346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:21.544414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:21.544452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254940441864529:5181]
2025-10-01T14:08:21.544444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 512 sessionId:  describe result for acl check
2025-10-01T14:08:21.544486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:21.544493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:21.544495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:21.544501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254942818727622:5771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:21.544995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254942818727622:5771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:21.545077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:21.545365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:21.545416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:21.545685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:21.545736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.545741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.545743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.545745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.545746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.545747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.545748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.545749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.545750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.545751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.545752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.545753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.545754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.545755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.545760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.545769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.545773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.545776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.545780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.545784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.545787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.545791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.545794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.545797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.545800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.545803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.545806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.545809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.545815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.545822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.545827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.545832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.545836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.545842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.545846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.545850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.545859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.545864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.545868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.545875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.545880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.545889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.545893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.545897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.545905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.545910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.545914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.545922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.545927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.545935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.545938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.545943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.545951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.545955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.545959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.545967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.546006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:21.546665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254942818727622:5771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:21.549216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254942818727622:5771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:21.549232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254942818727622:5771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:21.549236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254942818727622:5771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:21.549251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:21.549490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:21.550061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:21.550075Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:21.550077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:21.550083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:21.550088Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 511 [2:7556254940441864529:5181]
2025-10-01T14:08:21.550098Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:21.550111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:21.550114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.550116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.550117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.550128Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:21.550131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:21.550135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:21.550184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.550189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.550190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.550192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:21.550194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:21.550246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:21.550253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.550264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.550275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.550290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:21.550311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727660:5771], now have 1 active actors on pipe
2025-10-01T14:08:21.550317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727573:2446], now have 1 active actors on pipe
2025-10-01T14:08:21.550323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254940441864524:5181]
2025-10-01T14:08:21.550325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254940441864524:5181]
2025-10-01T14:08:21.550327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254940441864524:5181]
2025-10-01T14:08:21.550338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:21.550350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:21.550353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:21.550354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:21.550355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:21.550367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:21.550386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:21.550396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 511
2025-10-01T14:08:21.550399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 511
2025-10-01T14:08:21.550410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254940441864524:5181]
2025-10-01T14:08:21.550419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:21.550427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:21.550469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.550477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.550504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:21.550515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.550520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.550521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:21.550527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.550534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:21.550563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.550706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.550712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.550722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.550828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 512 partition: 0 MaxSeqNo: 45 sessionId: src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0
2025-10-01T14:08:21.551134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e79d676-a5e36b61-fde8fbd4-5972b984_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:21.553505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0] Write session: try to update token
2025-10-01T14:08:21.553526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:21.566777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 512 sessionId: src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:21.569001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:21.569170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.569189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.571118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:21.571152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:21.571155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:21.571157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:21.571160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:21.571170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254940441864524:5181]
2025-10-01T14:08:21.571181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254940441864524:5181]
2025-10-01T14:08:21.571186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254940441864524:5181]
2025-10-01T14:08:21.571205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:21.571227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:21.571237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:21.571241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:21.571343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:21.571356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.571359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:21.571493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:21.634081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254942818727670:5713]
2025-10-01T14:08:21.634297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 511, pipe: [1:7556254942818727670:5713]
2025-10-01T14:08:21.708222Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:21.715544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.715567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.715717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.715777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.715841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.715903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.715948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.715957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.716026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.716090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.716150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.716210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.716260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.716267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.716328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.716383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.716448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.716507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.716544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.716550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.716614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.716669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.716721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.716784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.716837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.716844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.716900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.716954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.717007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.717061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.717102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.717108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.717169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.717224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.717286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.717352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.717395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.717402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.717459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.717514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.717573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.717634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.717675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.717683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.717738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.717793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.717851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.717914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.717977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.717984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.718045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.718105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.718167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.718229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.718272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.718278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.718344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:21.718416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:21.718476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:21.718532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:21.718577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:21.718584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:21.718642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727670:5713], now have 1 active actors on pipe
2025-10-01T14:08:21.718889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254942818727670:5713]
2025-10-01T14:08:21.718915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:21.718915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:21.718919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:21.718946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 512 reason: error at write: Disconnected sessionId: src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0
2025-10-01T14:08:21.719131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 512 sessionId: src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0 is DEAD
2025-10-01T14:08:21.719285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:21.719298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0] Write session will restart in 0.006027s
2025-10-01T14:08:21.719324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0] Write session: Do CDS request
2025-10-01T14:08:21.719330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:21.719493Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:21.726844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.727295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:21.727309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 513
2025-10-01T14:08:21.727424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.727450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:21.727455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:21.727461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:21.727835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 513 sessionId:  describe result for acl check
2025-10-01T14:08:21.727860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:21.727862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:21.727863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:21.727868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254942818727719:5776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:21.728338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254942818727719:5776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:21.728696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:21.730537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:21.730718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:21.730728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:21.730738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:21.730779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:21.730810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254940441864620:5184]
2025-10-01T14:08:21.731007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254942818727719:5776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:21.731438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:21.731746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:21.731797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:21.732138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:21.732187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.732193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.732195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.732196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.732197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.732198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.732199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.732201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.732202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.732203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.732204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.732205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.732207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.732208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.732213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.732224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.732228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.732232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.732235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.732239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.732243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.732247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.732251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.732255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.732258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.732262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.732266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.732270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.732276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.732283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.732290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.732295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.732299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.732304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.732308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.732314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.732318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.732323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.732328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.732333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.732338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.732343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.732347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.732353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.732363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.732368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.732372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.732381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.732386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.732391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.732394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.732399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.732403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.732408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.732412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.732417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.732456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:21.736253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:21.736299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254942818727719:5776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:21.736315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254942818727719:5776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:21.736317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254942818727719:5776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:21.736323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:21.736953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:21.736966Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:21.736969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:21.736973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:21.736984Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 512 [2:7556254940441864620:5184]
2025-10-01T14:08:21.737003Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:21.737023Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:21.737029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.737033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.737039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.737055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:21.737064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:21.737074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:21.737130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.737136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.737138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.737141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:21.737143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:21.737206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:21.737213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.737225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.737240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.737261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:21.737272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 512
2025-10-01T14:08:21.737281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727672:2446], now have 1 active actors on pipe
2025-10-01T14:08:21.737292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 512
2025-10-01T14:08:21.737292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727761:5776], now have 1 active actors on pipe
2025-10-01T14:08:21.737299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254940441864615:5184]
2025-10-01T14:08:21.737301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254940441864615:5184]
2025-10-01T14:08:21.737303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254940441864615:5184]
2025-10-01T14:08:21.737311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:21.737319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:21.737322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:21.737325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:21.737325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:21.737339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:21.737342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:21.737362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.737367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.737404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254940441864615:5184]
2025-10-01T14:08:21.737414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:21.737424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:21.737428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:21.737434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.737438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.737440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:21.737448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.737455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:21.737492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.737628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.737638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.737651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.737743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 513 partition: 0 MaxSeqNo: 45 sessionId: src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0
2025-10-01T14:08:21.738451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d21f607e-106f65c9-efc13ed6-cfbc8f1a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:21.740922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0] Write session: try to update token
2025-10-01T14:08:21.740940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:21.758522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:21.758539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:21.758542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:21.758544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:21.758554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254940441864615:5184]
2025-10-01T14:08:21.758561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254940441864615:5184]
2025-10-01T14:08:21.758566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254940441864615:5184]
2025-10-01T14:08:21.758614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:21.758624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.758627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:21.758627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:21.758633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:21.758637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:21.758764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:21.761105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 513 sessionId: src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:21.766670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:21.818934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254942818727769:5713]
2025-10-01T14:08:21.819339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 512, pipe: [1:7556254942818727769:5713]
2025-10-01T14:08:21.907450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:21.908048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.908066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.908107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727769:5713], now have 1 active actors on pipe
2025-10-01T14:08:21.908330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254942818727769:5713]
2025-10-01T14:08:21.908338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:21.908359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:21.908365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:21.908420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 513 reason: error at write: Disconnected sessionId: src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0
2025-10-01T14:08:21.908603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 513 sessionId: src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0 is DEAD
2025-10-01T14:08:21.908641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:21.908921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:21.908931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0] Write session will restart in 0.006599s
2025-10-01T14:08:21.908984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0] Write session: Do CDS request
2025-10-01T14:08:21.908992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:21.916542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:21.916948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.917080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:21.917096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 514
2025-10-01T14:08:21.917217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:21.917248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:21.917259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:21.917262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:21.917572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 514 sessionId:  describe result for acl check
2025-10-01T14:08:21.917600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:21.917605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:21.917606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:21.917609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254942818727822:5780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:21.918059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254942818727822:5780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:21.918413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:21.918647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:21.918656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:21.918666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:21.918712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:21.918749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254940441864710:5186]
2025-10-01T14:08:21.919238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:21.919453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:21.919493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:21.919779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:21.919830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.919838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.919840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.919841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.919841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.919842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.919844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.919844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.919844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254942818727822:5780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:21.919845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.919846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.919847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.919849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.919850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.919851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.919855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.919863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.919868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.919872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.919875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.919879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.919882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.919885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.919887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.919891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.919894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.919897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.919900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.919902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.919908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.919915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:21.919920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.919925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:21.919930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.919934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:21.919937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.919941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:21.919945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.919949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:21.919952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.919957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:21.919960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.919965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:21.919968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.919973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:21.919978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.919983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:21.919987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.919992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.919996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.920000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.920004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.920008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.920012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.920016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:21.920020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.920024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:21.920059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:21.923489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254942818727822:5780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:21.923502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254942818727822:5780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:21.923504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254942818727822:5780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:21.923510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:21.924133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:21.925504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:21.925522Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:21.925524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:21.925527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:21.925534Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 513 [2:7556254940441864710:5186]
2025-10-01T14:08:21.925550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:21.925573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:21.925581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.925585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.925587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.925605Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:21.925615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:21.925621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:21.925681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.925688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.925690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.925693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:21.925696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:21.925763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:21.925771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.925784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:21.925798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:21.925816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:21.925839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727860:5780], now have 1 active actors on pipe
2025-10-01T14:08:21.925846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254942818727771:2446], now have 1 active actors on pipe
2025-10-01T14:08:21.925853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254940441864705:5186]
2025-10-01T14:08:21.925860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254940441864705:5186]
2025-10-01T14:08:21.925863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254940441864705:5186]
2025-10-01T14:08:21.925878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:21.925895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:21.925896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:21.925899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:21.925901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:21.925914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:21.925917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:21.925954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254940441864705:5186]
2025-10-01T14:08:21.925943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 513
2025-10-01T14:08:21.925968Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:21.925972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 513
2025-10-01T14:08:21.925995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:21.926016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.926027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.926056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e54d9ee-8651721e-374a8397-c71d3252_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:21.926067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:21.926074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:21.926078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:21.926086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:21.926096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:21.926116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.926279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:21.926289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:21.926307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:21.926411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 514 partition: 0 MaxSeqNo: 45 sessionId: src_id|1e54d9ee-8651721e-374a8397-c71d3252_0
2025-10-01T14:08:21.926820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a7ddba-61599024-c0e6d818-2b99daac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1e54d9ee-8651721e-374a8397-c71d3252_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:21.934100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e54d9ee-8651721e-374a8397-c71d3252_0] Write session: try to update token
2025-10-01T14:08:21.934117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e54d9ee-8651721e-374a8397-c71d3252_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:21.942556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:21.942574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:21.942583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254940441864705:5186]
2025-10-01T14:08:21.942635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:21.942634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:21.943171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:21.943642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:21.944522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:21.944810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:21.945398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:21.945448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:21.957235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:21.957251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:21.957253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:21.957255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:21.957264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254940441864705:5186]
2025-10-01T14:08:21.957267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254940441864705:5186]
2025-10-01T14:08:21.957270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254940441864705:5186]
2025-10-01T14:08:21.957315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:21.957320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:21.957326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:21.957326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:21.957328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:21.957330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:21.957651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:21.974616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 514 sessionId: src_id|1e54d9ee-8651721e-374a8397-c71d3252_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:21.977300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:22.008365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254947113695187:5713]
2025-10-01T14:08:22.008631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 513, pipe: [1:7556254947113695187:5713]
2025-10-01T14:08:22.102306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:22.102625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.102641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.102662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695187:5713], now have 1 active actors on pipe
2025-10-01T14:08:22.102837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254947113695187:5713]
2025-10-01T14:08:22.102857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:22.102884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:22.102899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:22.102884Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:22.102957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 514 reason: error at write: Disconnected sessionId: src_id|1e54d9ee-8651721e-374a8397-c71d3252_0
2025-10-01T14:08:22.103134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 514 sessionId: src_id|1e54d9ee-8651721e-374a8397-c71d3252_0 is DEAD
2025-10-01T14:08:22.103341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e54d9ee-8651721e-374a8397-c71d3252_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:22.103352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e54d9ee-8651721e-374a8397-c71d3252_0] Write session will restart in 0.008972s
2025-10-01T14:08:22.103382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e54d9ee-8651721e-374a8397-c71d3252_0] Write session: Do CDS request
2025-10-01T14:08:22.103386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e54d9ee-8651721e-374a8397-c71d3252_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:22.111372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:22.113031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:22.113208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:22.113216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:22.113226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:22.113273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:22.113312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254944736832105:5190]
2025-10-01T14:08:22.113881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e54d9ee-8651721e-374a8397-c71d3252_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.113855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:22.113987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:22.114004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 515
2025-10-01T14:08:22.114110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.114138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:22.114123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:22.114143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:22.114147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:22.114161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:22.114432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:22.114482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.114488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.114497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 515 sessionId:  describe result for acl check
2025-10-01T14:08:22.114489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.114490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.114491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.114492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.114533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:22.114493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.114494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.114494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.114495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.114538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:22.114496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.114497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.114540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:22.114498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.114545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254947113695254:5797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:22.114499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.114503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.114511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.114514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.114517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.114520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.114523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.114526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.114530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.114533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.114537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.114540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.114544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.114547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.114550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.114556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.114563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.114569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.114576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.114589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.114594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.114598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.114602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.114607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.114611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.114615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.114620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.114624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.114628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.114632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.114637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.114641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.114645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.114649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.114654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.114658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.114662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.114666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.114671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.114676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.114680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.114684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.114688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.114725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:22.115036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254947113695254:5797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:22.117269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254947113695254:5797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:22.118473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:22.119185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:22.119200Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:22.119202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:22.119205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:22.119212Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 514 [2:7556254944736832105:5190]
2025-10-01T14:08:22.119225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:22.119242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:22.119249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.119253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.119255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.119270Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:22.119276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:22.119282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:22.119338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.119348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.119352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.119355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:22.119357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:22.119423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:22.119430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.119441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.119454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.119473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:22.119493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254944736832100:5190]
2025-10-01T14:08:22.119495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254944736832100:5190]
2025-10-01T14:08:22.119497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254944736832100:5190]
2025-10-01T14:08:22.119512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:22.119528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:22.119536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:22.119538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:22.119539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:22.119541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:22.119545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:22.119571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254944736832100:5190]
2025-10-01T14:08:22.119579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:22.119594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:22.119614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695199:2446], now have 1 active actors on pipe
2025-10-01T14:08:22.120056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695291:5797], now have 1 active actors on pipe
2025-10-01T14:08:22.120297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.119817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254947113695254:5797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:22.120305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.120328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:22.120335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.119832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254947113695254:5797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:22.120339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.119835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254947113695254:5797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:22.119844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:22.120245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 514
2025-10-01T14:08:22.120341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:22.120268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 514
2025-10-01T14:08:22.120350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.120358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:22.120378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.120506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.120513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.120525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.120605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 515 partition: 0 MaxSeqNo: 45 sessionId: src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0
2025-10-01T14:08:22.120957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e54d9ee-8651721e-374a8397-c71d3252_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:22.123417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0] Write session: try to update token
2025-10-01T14:08:22.123433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:22.139626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 515 sessionId: src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:22.140325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:22.140344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:22.140347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:22.140349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:22.140359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254944736832100:5190]
2025-10-01T14:08:22.140365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254944736832100:5190]
2025-10-01T14:08:22.140368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254944736832100:5190]
2025-10-01T14:08:22.140415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:22.140426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:22.140430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:22.140434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.140434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:22.140436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:22.140630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:22.142426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:22.202916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254947113695304:5713]
2025-10-01T14:08:22.203199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 514, pipe: [1:7556254947113695304:5713]
2025-10-01T14:08:22.284100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:22.284427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.284441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.284481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695304:5713], now have 1 active actors on pipe
2025-10-01T14:08:22.284642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:22.284700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254947113695304:5713]
2025-10-01T14:08:22.284730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:22.284734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:22.284810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 515 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0
2025-10-01T14:08:22.285014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 515 sessionId: src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0 is DEAD
2025-10-01T14:08:22.285166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 164 BytesWritten: 85606466 MessagesWritten: 38 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-01T14:08:22.285208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:22.285215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0] Write session will restart in 0.005865s
2025-10-01T14:08:22.285241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0] Write session: Do CDS request
2025-10-01T14:08:22.285246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:22.291894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.291969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:22.291984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 516
2025-10-01T14:08:22.292130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.292168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:22.292178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:22.292181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:22.292586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 516 sessionId:  describe result for acl check
2025-10-01T14:08:22.292626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:22.292631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:22.292632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:22.292636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254947113695374:5803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:22.293124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254947113695374:5803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:22.293868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:22.294823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254947113695374:5803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:22.295458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:22.295626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:22.295634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:22.295642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:22.295677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:22.295713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254944736832240:5204]
2025-10-01T14:08:22.296254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:22.296558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:22.296598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:22.296896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:22.296964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.296969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.296971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.296972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.296973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.296974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.296975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.296976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.296977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.296978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.296979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.296981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.296982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.296983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.296988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.296998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.297002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.297006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.297010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.297014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.297017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.297021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.297024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.297028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.297032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.297036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.297041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.297045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.297051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.297059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.297064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.297069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.297073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.297078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.297081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.297086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.297090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.297094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.297097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.297102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.297112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.297116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.297120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.297124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.297128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.297133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.297137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.297144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.297152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.297157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.297161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.297166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.297174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.297178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.297182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.297190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.297186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254947113695374:5803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:22.297199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254947113695374:5803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:22.297202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254947113695374:5803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:22.297210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:22.297222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:22.300994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:22.301581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:22.301594Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:22.301596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:22.301599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:22.301605Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 515 [2:7556254944736832240:5204]
2025-10-01T14:08:22.301629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:22.301645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:22.301650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.301653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.301654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.301668Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:22.301674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:22.301684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:22.301739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.301750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.301752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.301755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:22.301757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:22.301823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:22.301829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.301840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.301856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.301876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:22.301898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695411:5803], now have 1 active actors on pipe
2025-10-01T14:08:22.301905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695324:2446], now have 1 active actors on pipe
2025-10-01T14:08:22.301912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254944736832235:5204]
2025-10-01T14:08:22.301916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254944736832235:5204]
2025-10-01T14:08:22.301918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254944736832235:5204]
2025-10-01T14:08:22.301930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:22.301946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:22.301947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:22.301950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:22.301952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:22.301963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:22.301965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:22.301954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 515
2025-10-01T14:08:22.301964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 515
2025-10-01T14:08:22.301995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254944736832235:5204]
2025-10-01T14:08:22.302005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:22.302010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:22.302020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.302024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.302066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:22.302077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.302084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.302086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:22.302092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.302102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:22.302118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.302263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.302270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.302282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.302354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 516 partition: 0 MaxSeqNo: 45 sessionId: src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0
2025-10-01T14:08:22.302715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6224d267-fea32d6f-7cef9717-dfd158bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:22.305041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0] Write session: try to update token
2025-10-01T14:08:22.305057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:22.319145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 516 sessionId: src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:22.321499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:22.323165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.323193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.323212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:22.323216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:22.323218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:22.323220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:22.323231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254944736832235:5204]
2025-10-01T14:08:22.323236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254944736832235:5204]
2025-10-01T14:08:22.323242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254944736832235:5204]
2025-10-01T14:08:22.323290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:22.323295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:22.323300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:22.323301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.323303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:22.323303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:22.323480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:22.384681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254947113695420:5713]
2025-10-01T14:08:22.384952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 515, pipe: [1:7556254947113695420:5713]
2025-10-01T14:08:22.482586Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:22.482897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:22.482954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695420:5713], now have 1 active actors on pipe
2025-10-01T14:08:22.483871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:22.483883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0] Write session will restart in 0.005799s
2025-10-01T14:08:22.483908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0] Write session: Do CDS request
2025-10-01T14:08:22.483914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:22.483399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:22.483505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:22.483508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:22.483574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 516 reason: error at write: Disconnected sessionId: src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0
2025-10-01T14:08:22.483722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 516 sessionId: src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0 is DEAD
2025-10-01T14:08:22.483895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254947113695420:5713]
2025-10-01T14:08:22.483909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:22.490880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.490959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:22.490976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 517
2025-10-01T14:08:22.491137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.491168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:22.491194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:22.491198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:22.491607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 517 sessionId:  describe result for acl check
2025-10-01T14:08:22.491639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:22.491646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:22.491648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:22.491654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254947113695430:5807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:22.492160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254947113695430:5807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:22.494162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254947113695430:5807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:22.496359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254947113695430:5807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:22.496373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254947113695430:5807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:22.496376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254947113695430:5807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:22.496384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:22.498281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:22.500241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:22.500452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:22.500462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:22.500474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:22.500519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:22.500556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254944736832336:5206]
2025-10-01T14:08:22.501104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:22.501376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:22.501415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:22.501690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:22.501740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.501745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.501746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.501747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.501747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.501749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.501750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.501751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.501752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.501753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.501754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.501755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.501757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.501758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.501762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.501771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.501775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.501778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.501782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.501785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.501788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.501791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.501795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.501799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.501803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.501806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.501809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.501812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.501818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.501826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.501833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.501837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.501841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.501845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.501848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.501852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.501856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.501861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.501864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.501873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.501878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.501882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.501885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.501895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.501899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.501904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.501907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.501915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.501919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.501923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.501927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.501935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.501939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.501943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.501951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.501956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.501990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:22.505700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:22.506366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:22.506397Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:22.506399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:22.506402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:22.506408Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 516 [2:7556254944736832336:5206]
2025-10-01T14:08:22.506423Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:22.506437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:22.506445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.506448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.506451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.506466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:22.506474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:22.506480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:22.506531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.506539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.506541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.506544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:22.506546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:22.506609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:22.506615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.506624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.506633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.506647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:22.506664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695423:2446], now have 1 active actors on pipe
2025-10-01T14:08:22.506671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695487:5807], now have 1 active actors on pipe
2025-10-01T14:08:22.506678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254944736832331:5206]
2025-10-01T14:08:22.506680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254944736832331:5206]
2025-10-01T14:08:22.506682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254944736832331:5206]
2025-10-01T14:08:22.506694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:22.506703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:22.506706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:22.506708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:22.506711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:22.506723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:22.506730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:22.506753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254944736832331:5206]
2025-10-01T14:08:22.506760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:22.506761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:22.506737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 516
2025-10-01T14:08:22.506750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 516
2025-10-01T14:08:22.506788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.506796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.506823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:22.506833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.506837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.506839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:22.506847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.506859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:22.506883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.507001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.507012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.507033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.507113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 517 partition: 0 MaxSeqNo: 45 sessionId: src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0
2025-10-01T14:08:22.507451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9635ea0b-9e21f48d-5ffe23e4-5db266e4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:22.509710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0] Write session: try to update token
2025-10-01T14:08:22.509726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:22.522543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 517 sessionId: src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:22.524886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:22.525121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.525138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.525167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:22.525251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:22.527739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:22.527753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:22.527754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:22.527758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:22.527764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254944736832331:5206]
2025-10-01T14:08:22.527766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254944736832331:5206]
2025-10-01T14:08:22.527769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254944736832331:5206]
2025-10-01T14:08:22.527809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:22.527817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.527819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:22.527819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:22.527823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:22.527828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:22.527938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:22.583833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254947113695523:5713]
2025-10-01T14:08:22.584091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 516, pipe: [1:7556254947113695523:5713]
2025-10-01T14:08:22.664439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:22.670784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.670805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.670944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.671000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.671054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.671110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.671149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.671158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.671266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.671343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.671428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.671485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.671524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.671530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.671582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.671656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.671731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.671779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.671815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.671820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.671873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.671928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.672001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.672051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.672141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.672147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.672209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.672258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.672329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.672379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.672434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.672441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.672500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.672547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.672602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.672657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.672708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.672713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.672821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.672871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.672920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.672977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.673015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.673019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.673070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.673118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.673166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.673223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.673317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.673323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.673378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.673427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.673485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.673540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.673628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.673633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.673686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:22.673737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:22.673792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:22.673843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:22.673880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:22.673886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:22.673924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695523:5713], now have 1 active actors on pipe
2025-10-01T14:08:22.674115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:22.674122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254947113695523:5713]
2025-10-01T14:08:22.674146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:22.674149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:22.674179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 517 reason: error at write: Disconnected sessionId: src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0
2025-10-01T14:08:22.674424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 517 sessionId: src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0 is DEAD
2025-10-01T14:08:22.674539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:22.674550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0] Write session will restart in 0.006577s
2025-10-01T14:08:22.674572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0] Write session: Do CDS request
2025-10-01T14:08:22.674577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:22.674768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:22.681872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.681972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:22.682227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:22.682240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 518
2025-10-01T14:08:22.682344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.682393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:22.682403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:22.682407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:22.682726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 518 sessionId:  describe result for acl check
2025-10-01T14:08:22.682759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:22.682765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:22.682766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:22.682771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254947113695583:5812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:22.683237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254947113695583:5812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:22.683669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:22.683821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:22.683832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:22.683843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:22.683892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:22.683931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254944736832430:5208]
2025-10-01T14:08:22.684361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:22.684541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:22.684568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:22.684777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:22.684821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.684825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.684826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.684827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.684827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.684828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.684829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.684829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.684830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.684831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.684831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.684832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.684832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.684833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.684836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.684841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.684843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.684845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.684847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.684849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.684851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.684853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.684855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.684858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.684860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.684862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.684863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.684878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254947113695583:5812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:22.684865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.684870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.684875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.684879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.684881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.684884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.684889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.684893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.684897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.684902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.684906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.684910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.684914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.684917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.684922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.684926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.684931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.684933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.684936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.684938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.684941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.684943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.684946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.684948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.684950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.684953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.684955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.684957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.684959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.684978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:22.688049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254947113695583:5812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:22.688060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254947113695583:5812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:22.688063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254947113695583:5812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:22.688069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:22.688176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:22.688685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:22.688694Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:22.688696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:22.688698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:22.688703Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 517 [2:7556254944736832430:5208]
2025-10-01T14:08:22.688713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:22.688724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:22.688730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.688733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.688734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.688746Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:22.688750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:22.688754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:22.688798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.688803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.688805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.688807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:22.688808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:22.688854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:22.688858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.688865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.688874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.688882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:22.688897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695622:5812], now have 1 active actors on pipe
2025-10-01T14:08:22.688903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695528:2446], now have 1 active actors on pipe
2025-10-01T14:08:22.688908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254944736832425:5208]
2025-10-01T14:08:22.688910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254944736832425:5208]
2025-10-01T14:08:22.688911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254944736832425:5208]
2025-10-01T14:08:22.688920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:22.688933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:22.688936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:22.688938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:22.688941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:22.688944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:22.688946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:22.688964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254944736832425:5208]
2025-10-01T14:08:22.688972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:22.688972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:22.688967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 517
2025-10-01T14:08:22.688993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 517
2025-10-01T14:08:22.689004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.689013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.689036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:22.689044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.689050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.689051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:22.689058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.689067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:22.689080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.689233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.689247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.689269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.689346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 518 partition: 0 MaxSeqNo: 45 sessionId: src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0
2025-10-01T14:08:22.689731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|905c92dd-2d388244-3d400f0c-2d3ea7b0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:22.692455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0] Write session: try to update token
2025-10-01T14:08:22.692475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:22.707450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 518 sessionId: src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:22.708254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:22.708273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:22.708275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:22.708277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:22.708286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254944736832425:5208]
2025-10-01T14:08:22.708290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254944736832425:5208]
2025-10-01T14:08:22.708294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254944736832425:5208]
2025-10-01T14:08:22.708329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:22.708333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:22.708337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:22.708342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:22.708348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.708355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:22.708521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:22.709641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:22.774808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254947113695630:5713]
2025-10-01T14:08:22.775017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 517, pipe: [1:7556254947113695630:5713]
2025-10-01T14:08:22.852984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:22.853222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.853233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.853266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695630:5713], now have 1 active actors on pipe
2025-10-01T14:08:22.853467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:22.853489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254947113695630:5713]
2025-10-01T14:08:22.853511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:22.853516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:22.853520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:22.853579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 518 reason: error at write: Disconnected sessionId: src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0
2025-10-01T14:08:22.853797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 518 sessionId: src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0 is DEAD
2025-10-01T14:08:22.853896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:22.853905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0] Write session will restart in 0.009369s
2025-10-01T14:08:22.853932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0] Write session: Do CDS request
2025-10-01T14:08:22.853936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:22.861641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:22.863212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:22.863409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:22.863420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:22.863432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:22.863484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:22.863522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254944736832525:5211]
2025-10-01T14:08:22.864104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:22.864382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:22.864427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:22.864709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:22.864784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.864803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.864804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.864805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.864806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.864807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.864845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.864808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.864809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.864810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.864811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.864812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.864813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.864814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.864815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.864820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.864830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.864834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.864837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.864841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.864845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.864849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.864853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.864856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.864861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.864865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.864868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.864872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.864876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.864885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.864892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:22.864898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.864903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:22.864907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.864912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:22.864916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.864920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:22.864925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.864929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:22.864933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.864989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:22.865004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 519
2025-10-01T14:08:22.864938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:22.864943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.864947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:22.864952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.864957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:22.864962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.864966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:22.864970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.864976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.864980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.864985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.864989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.864994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.864998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.865003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:22.865007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.865012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:22.865050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:22.865133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:22.865161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:22.865170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:22.865184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:22.865535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 519 sessionId:  describe result for acl check
2025-10-01T14:08:22.865571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:22.865577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:22.865579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:22.865585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254947113695693:5816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:22.866060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254947113695693:5816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:22.867595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254947113695693:5816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:22.869067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:22.869640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:22.869650Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:22.869651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:22.869656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:22.869661Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 518 [2:7556254944736832525:5211]
2025-10-01T14:08:22.869672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:22.869684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:22.869686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.869688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.869689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.869700Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:22.869703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:22.869707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:22.869751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.869758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.869759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.869762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:22.869764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:22.869826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:22.869832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.869839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:22.869844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:22.869853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:22.869866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695632:2446], now have 1 active actors on pipe
2025-10-01T14:08:22.869871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254944736832520:5211]
2025-10-01T14:08:22.869873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254944736832520:5211]
2025-10-01T14:08:22.869874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254944736832520:5211]
2025-10-01T14:08:22.869885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:22.869895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:22.869902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:22.869904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:22.869906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:22.869915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:22.869918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:22.869918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 518
2025-10-01T14:08:22.869947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254944736832520:5211]
2025-10-01T14:08:22.869955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:22.869961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:22.870196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254947113695693:5816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:22.870207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254947113695693:5816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:22.870210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254947113695693:5816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:22.870217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:22.870382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695729:5816], now have 1 active actors on pipe
2025-10-01T14:08:22.870438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 518
2025-10-01T14:08:22.870489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.870503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.870528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:22.870541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:22.870548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:22.870551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:22.870560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:22.870576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:22.870597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.870722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.870729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.870741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:22.870796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 519 partition: 0 MaxSeqNo: 45 sessionId: src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0
2025-10-01T14:08:22.871105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84e8fc2-9b9ed3c-a8d9bba5-9389f259_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:22.873322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0] Write session: try to update token
2025-10-01T14:08:22.873335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:22.885983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:22.886002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:22.886013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254944736832520:5211]
2025-10-01T14:08:22.886059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:22.886064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:22.886263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:22.886435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:22.886589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:22.886608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 519 sessionId: src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:22.886727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:22.886929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:22.886973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:22.888857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:22.889046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:22.889065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:22.889096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:22.889166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:22.900471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:22.900493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:22.900495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:22.900497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:22.900508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254944736832520:5211]
2025-10-01T14:08:22.900511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254944736832520:5211]
2025-10-01T14:08:22.900515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254944736832520:5211]
2025-10-01T14:08:22.900560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:22.900567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:22.900572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:22.900575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:22.900576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:22.900577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:22.900710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:22.953522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254947113695735:5713]
2025-10-01T14:08:22.953826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 518, pipe: [1:7556254947113695735:5713]
2025-10-01T14:08:23.047134Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:23.053767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.053788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.053935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.053984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.054036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.054090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.054132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.054136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.054190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.054237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.054288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.054352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.054410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.054416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.054499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.054549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.054598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.054683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.054720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.054724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.054777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.054852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.054908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.054963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.055001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.055006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.055057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.055106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.055162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.055236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.055277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.055282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.055332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.055384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.055438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.055499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.055540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.055547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.055610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.055662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.055718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.055774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.055815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.055820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.055883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.055941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.056020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.056095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.056139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.056146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.056204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.056259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.056314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.056373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.056417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.056425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.056486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.056539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.056595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.056650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.056690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.056697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.056745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254947113695735:5713], now have 1 active actors on pipe
2025-10-01T14:08:23.056957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:23.057000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254947113695735:5713]
2025-10-01T14:08:23.057021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:23.057028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:23.057052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 519 reason: error at write: Disconnected sessionId: src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0
2025-10-01T14:08:23.057270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 519 sessionId: src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0 is DEAD
2025-10-01T14:08:23.057385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:23.057392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0] Write session will restart in 0.005066s
2025-10-01T14:08:23.057417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0] Write session: Do CDS request
2025-10-01T14:08:23.057424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:23.057470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:23.063912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.065138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:23.065478Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:23.065490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 520
2025-10-01T14:08:23.065596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.065631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:23.065640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:23.065643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:23.066013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 520 sessionId:  describe result for acl check
2025-10-01T14:08:23.066046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:23.066051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:23.066052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:23.066058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254951408663114:5827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:23.066507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254951408663114:5827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:23.066542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:23.066677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:23.066690Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:23.066700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:23.066735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:23.066768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254949031799924:5215]
2025-10-01T14:08:23.067172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:23.067477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:23.067511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:23.067779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:23.067821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.067825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.067826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.067828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.067829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.067829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.067830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.067831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.067832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.067833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.067834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.067835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.067836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.067837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.067841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.067850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.067854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.067858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.067861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.067865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.067869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.067873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.067876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.067880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.067883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.067887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.067890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.067893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.067898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.067906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.067911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.067915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.067919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.067924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.067928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.067933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.067937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.067941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.067945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.067950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.067954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.067958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.067964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.067973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.067977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.067982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.067989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.067994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.067998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.068006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.068009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.068014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.068022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.068026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.068030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.068035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.068070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:23.068417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254951408663114:5827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:23.071496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254951408663114:5827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:23.071511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254951408663114:5827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:23.071514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254951408663114:5827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:23.071522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:23.071794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:23.072447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:23.072458Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:23.072461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:23.072464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:23.072469Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 519 [2:7556254949031799924:5215]
2025-10-01T14:08:23.072482Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:23.072495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:23.072498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.072501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.072504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.072518Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:23.072527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:23.072532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:23.072580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.072586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.072588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.072592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:23.072595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:23.072655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:23.072661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.072671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.072685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.072697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:23.072716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663057:2446], now have 1 active actors on pipe
2025-10-01T14:08:23.072723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663150:5827], now have 1 active actors on pipe
2025-10-01T14:08:23.072730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254949031799919:5215]
2025-10-01T14:08:23.072732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254949031799919:5215]
2025-10-01T14:08:23.072734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254949031799919:5215]
2025-10-01T14:08:23.072745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:23.072757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:23.072757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 519
2025-10-01T14:08:23.072763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 519
2025-10-01T14:08:23.072770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:23.072776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:23.072779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:23.072780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:23.072782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:23.072824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.072828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.072838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254949031799919:5215]
2025-10-01T14:08:23.072849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:23.072860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:23.072875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cdce777-8495a7db-aa563320-19df7cbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:23.072881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.072884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.072886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:23.072904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.072911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:23.072928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.073051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.073055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.073068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.073144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 520 partition: 0 MaxSeqNo: 45 sessionId: src_id|1cdce777-8495a7db-aa563320-19df7cbe_0
2025-10-01T14:08:23.073466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|547e1404-6bbf2745-d44eaab3-c1beac9e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1cdce777-8495a7db-aa563320-19df7cbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:23.075663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdce777-8495a7db-aa563320-19df7cbe_0] Write session: try to update token
2025-10-01T14:08:23.075677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdce777-8495a7db-aa563320-19df7cbe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:23.090434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 520 sessionId: src_id|1cdce777-8495a7db-aa563320-19df7cbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:23.092614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:23.092630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:23.092633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:23.092635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:23.092643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254949031799919:5215]
2025-10-01T14:08:23.092648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254949031799919:5215]
2025-10-01T14:08:23.092652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254949031799919:5215]
2025-10-01T14:08:23.092691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:23.092695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:23.092697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.092699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:23.092701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:23.092705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:23.092831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:23.093003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:23.157327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254951408663158:5713]
2025-10-01T14:08:23.157674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 519, pipe: [1:7556254951408663158:5713]
2025-10-01T14:08:23.170581Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 5 CurrentSessionLifetimeMs: 121188 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:08:23.244039Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:23.244351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.244365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.244406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663158:5713], now have 1 active actors on pipe
2025-10-01T14:08:23.244632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:23.245024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:23.245116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 520 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1cdce777-8495a7db-aa563320-19df7cbe_0
2025-10-01T14:08:23.245341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 520 sessionId: src_id|1cdce777-8495a7db-aa563320-19df7cbe_0 is DEAD
2025-10-01T14:08:23.245497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdce777-8495a7db-aa563320-19df7cbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:23.245509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdce777-8495a7db-aa563320-19df7cbe_0] Write session will restart in 0.007319s
2025-10-01T14:08:23.245529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdce777-8495a7db-aa563320-19df7cbe_0] Write session: Do CDS request
2025-10-01T14:08:23.245534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdce777-8495a7db-aa563320-19df7cbe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:23.245545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:23.245601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254951408663158:5713]
2025-10-01T14:08:23.253844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdce777-8495a7db-aa563320-19df7cbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.254214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:23.254235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 521
2025-10-01T14:08:23.254485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:23.254422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.254453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:23.254459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:23.254464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:23.255004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 521 sessionId:  describe result for acl check
2025-10-01T14:08:23.255044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:23.255046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:23.255048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:23.255054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254951408663224:5832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:23.255659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254951408663224:5832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:23.256231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:23.256422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:23.256431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:23.256443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:23.256489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:23.256526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254949031800033:5218]
2025-10-01T14:08:23.257120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:23.258193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:23.258239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:23.258544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:23.258602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.258607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.258608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.258609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.258610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.258611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.258612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.258613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.258614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.258615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.258616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.258618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.258619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.258620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.258625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.258635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.258638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.258642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.258644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.258648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.258651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.258655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.258658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.258662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.258665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.258668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.258671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.258674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.258680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.258687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.258693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.258699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.258709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.258726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.258733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.258738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.258747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.258751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.258759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.258764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.258770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.258778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.258782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.258787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.258795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.258800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.258804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.258809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.258814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.258822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.258827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.258831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.258837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.258841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.258848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.258852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.258887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:23.260354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254951408663224:5832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:23.263529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:23.264152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:23.264162Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:23.264165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:23.264168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:23.264174Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 520 [2:7556254949031800033:5218]
2025-10-01T14:08:23.264189Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:23.264204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:23.264207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.264210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.264212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.264227Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:23.264235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:23.264241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:23.264294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.264301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.264302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.264305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:23.264308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:23.264368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:23.264375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.264385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.264401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.264418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:23.264449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254949031800028:5218]
2025-10-01T14:08:23.264454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254949031800028:5218]
2025-10-01T14:08:23.264456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254949031800028:5218]
2025-10-01T14:08:23.264464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:23.264477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:23.264487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:23.264492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:23.264493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:23.264495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:23.264496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:23.264526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663167:2446], now have 1 active actors on pipe
2025-10-01T14:08:23.264533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254949031800028:5218]
2025-10-01T14:08:23.264536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:23.264567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:23.264926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 520
2025-10-01T14:08:23.265360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254951408663224:5832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:23.265368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254951408663224:5832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:23.265372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254951408663224:5832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:23.265381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:23.265657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663282:5832], now have 1 active actors on pipe
2025-10-01T14:08:23.265753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 520
2025-10-01T14:08:23.266008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.266027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.266067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7846981-8b903c14-631dd87b-f9941429_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:23.266078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.266085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.266088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:23.266099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.266115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:23.266133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.266462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.266474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.266498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.266618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 521 partition: 0 MaxSeqNo: 45 sessionId: src_id|e7846981-8b903c14-631dd87b-f9941429_0
2025-10-01T14:08:23.267092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cdce777-8495a7db-aa563320-19df7cbe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e7846981-8b903c14-631dd87b-f9941429_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:23.270067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7846981-8b903c14-631dd87b-f9941429_0] Write session: try to update token
2025-10-01T14:08:23.270086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7846981-8b903c14-631dd87b-f9941429_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:23.285805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:23.285826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:23.285829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:23.285833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:23.285843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254949031800028:5218]
2025-10-01T14:08:23.285849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254949031800028:5218]
2025-10-01T14:08:23.285853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254949031800028:5218]
2025-10-01T14:08:23.285901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:23.285904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:23.285908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.285910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:23.285911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:23.285914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:23.286056Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:23.290352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 521 sessionId: src_id|e7846981-8b903c14-631dd87b-f9941429_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:23.292699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:23.345755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254951408663287:5713]
2025-10-01T14:08:23.346093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 520, pipe: [1:7556254951408663287:5713]
2025-10-01T14:08:23.444859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:23.445187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.445203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.445243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663287:5713], now have 1 active actors on pipe
2025-10-01T14:08:23.445452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:23.445510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254951408663287:5713]
2025-10-01T14:08:23.445531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:23.445537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:23.445715Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:23.445589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 521 reason: error at write: Disconnected sessionId: src_id|e7846981-8b903c14-631dd87b-f9941429_0
2025-10-01T14:08:23.445792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 521 sessionId: src_id|e7846981-8b903c14-631dd87b-f9941429_0 is DEAD
2025-10-01T14:08:23.445972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7846981-8b903c14-631dd87b-f9941429_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:23.445997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7846981-8b903c14-631dd87b-f9941429_0] Write session will restart in 0.008605s
2025-10-01T14:08:23.446028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7846981-8b903c14-631dd87b-f9941429_0] Write session: Do CDS request
2025-10-01T14:08:23.446034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7846981-8b903c14-631dd87b-f9941429_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:23.456014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7846981-8b903c14-631dd87b-f9941429_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.456111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:23.456129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 522
2025-10-01T14:08:23.456280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.456327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:23.456338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:23.456342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:23.456733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 522 sessionId:  describe result for acl check
2025-10-01T14:08:23.456770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:23.456772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:23.456774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:23.456778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254951408663317:5837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:23.457364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254951408663317:5837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:23.459177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254951408663317:5837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:23.459176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:23.461254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:23.461450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:23.461460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:23.461471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:23.461528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254951408663317:5837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:23.461541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254951408663317:5837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:23.461530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:23.461544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254951408663317:5837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:23.461573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254949031800164:5231]
2025-10-01T14:08:23.461599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:23.462114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:23.462396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:23.462446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:23.462761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:23.462818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.462825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.462826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.462828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.462829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.462831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.462832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.462833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.462834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.462836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.462837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.462839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.462840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.462842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.462847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.462856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.462860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.462864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.462868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.462871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.462875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.462879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.462883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.462887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.462890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.462894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.462898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.462901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.462908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.462915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.462921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.462926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.462931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.462935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.462939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.462943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.462947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.462953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.462957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.462963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.462968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.462973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.462977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.462981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.462987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.462992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.463007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.463012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.463016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.463020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.463024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.463029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.463034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.463039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.463043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.463048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.463086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:23.467034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:23.467842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:23.467855Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:23.467856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:23.467859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:23.467864Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 521 [2:7556254949031800164:5231]
2025-10-01T14:08:23.467874Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:23.467888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:23.467890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.467892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.467893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.467904Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:23.467908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:23.467912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:23.467951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.467956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.467957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.467959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:23.467961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:23.468018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:23.468024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.468031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.468037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.468045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:23.468059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663290:2446], now have 1 active actors on pipe
2025-10-01T14:08:23.468065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254949031800159:5231]
2025-10-01T14:08:23.468068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254949031800159:5231]
2025-10-01T14:08:23.468069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254949031800159:5231]
2025-10-01T14:08:23.468082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:23.468090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663384:5837], now have 1 active actors on pipe
2025-10-01T14:08:23.468093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:23.468096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:23.468096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:23.468097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:23.468107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:23.468110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:23.468140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254949031800159:5231]
2025-10-01T14:08:23.468147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:23.468149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:23.468130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 521
2025-10-01T14:08:23.468176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 521
2025-10-01T14:08:23.468227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.468233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.468250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:23.468255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.468258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.468259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:23.468267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.468274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:23.468290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.468455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.468461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.468472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.468566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 522 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0
2025-10-01T14:08:23.468949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7846981-8b903c14-631dd87b-f9941429_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:23.472723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0] Write session: try to update token
2025-10-01T14:08:23.472743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:23.488524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 522 sessionId: src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:23.489463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:23.489487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:23.489490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:23.489492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:23.489503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254949031800159:5231]
2025-10-01T14:08:23.489508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254949031800159:5231]
2025-10-01T14:08:23.489512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254949031800159:5231]
2025-10-01T14:08:23.489570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:23.489582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.489584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:23.489710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:23.490973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:23.491094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:23.491106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:23.491111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:23.545885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254951408663395:5713]
2025-10-01T14:08:23.546284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 521, pipe: [1:7556254951408663395:5713]
2025-10-01T14:08:23.642499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:23.642985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.643001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.643043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663395:5713], now have 1 active actors on pipe
2025-10-01T14:08:23.643225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:23.643257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:23.643280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:23.643313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254951408663395:5713]
2025-10-01T14:08:23.643348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 522 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0
2025-10-01T14:08:23.643520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 522 sessionId: src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0 is DEAD
2025-10-01T14:08:23.643668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:23.643679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0] Write session will restart in 0.006929s
2025-10-01T14:08:23.643711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0] Write session: Do CDS request
2025-10-01T14:08:23.643717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:23.651766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:23.651933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.651987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:23.652004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 523
2025-10-01T14:08:23.652135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.652164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:23.652169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:23.652173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:23.652538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 523 sessionId:  describe result for acl check
2025-10-01T14:08:23.652577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:23.652584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:23.652585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:23.652590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254951408663460:5842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:23.653077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254951408663460:5842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:23.653415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:23.653636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:23.653647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:23.653671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:23.653730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:23.653768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254949031800263:5233]
2025-10-01T14:08:23.654334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:23.654597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:23.654649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:23.654937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:23.655005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.655011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.655012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.655013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.655014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.655015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.655016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.655017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.655017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.655019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.655020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.655021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.655022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.655023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.655028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.655036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.655039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.655043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.655046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.655049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.655052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.655055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.655058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.655062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.655065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.655068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.655071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.655074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.655081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.655087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.655092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.655097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.655100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.655104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.655108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.655112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.655116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.655120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.655124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.655128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.655133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.655137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.655141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.655146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.655150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.655154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.655158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.655162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.655166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.655158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254951408663460:5842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:23.655170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.655174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.655178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.655182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.655186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.655190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.655193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.655229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:23.658582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254951408663460:5842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:23.658595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254951408663460:5842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:23.658599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254951408663460:5842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:23.658607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:23.658804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:23.659388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:23.659400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:23.659402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:23.659405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:23.659417Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 522 [2:7556254949031800263:5233]
2025-10-01T14:08:23.659431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:23.659450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:23.659457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.659461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.659463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.659479Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:23.659489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:23.659494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:23.659545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.659552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.659554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.659558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:23.659561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:23.659622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:23.659629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.659639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.659650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.659669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:23.659689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663499:5842], now have 1 active actors on pipe
2025-10-01T14:08:23.659697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663400:2446], now have 1 active actors on pipe
2025-10-01T14:08:23.659704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254949031800258:5233]
2025-10-01T14:08:23.659707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254949031800258:5233]
2025-10-01T14:08:23.659709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254949031800258:5233]
2025-10-01T14:08:23.659721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:23.659733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:23.659736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:23.659742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:23.659744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:23.659749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:23.659751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:23.659776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254949031800258:5233]
2025-10-01T14:08:23.659785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:23.659793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:23.659852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 522
2025-10-01T14:08:23.659853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 522
2025-10-01T14:08:23.659906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.659916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.659939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:23.659949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.659953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.659955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:23.659963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.659975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:23.659992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.660181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.660194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.660217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.660302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 523 partition: 0 MaxSeqNo: 45 sessionId: src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0
2025-10-01T14:08:23.660664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1965e32-27b68fe3-13f04f93-c4dfecee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:23.663163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0] Write session: try to update token
2025-10-01T14:08:23.663182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:23.675287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:23.675305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:23.675317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254949031800258:5233]
2025-10-01T14:08:23.675356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:23.675445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:23.675612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:23.675752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:23.675888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:23.676020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:23.676206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:23.676248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:23.677384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 523 sessionId: src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:23.679773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:23.679942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.679960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.679989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:23.680071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:23.689195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:23.689213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:23.689216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:23.689218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:23.689229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254949031800258:5233]
2025-10-01T14:08:23.689233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254949031800258:5233]
2025-10-01T14:08:23.689236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254949031800258:5233]
2025-10-01T14:08:23.689286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:23.689291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:23.689298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.689299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:23.689302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:23.689302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:23.689422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:23.743512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254951408663506:5713]
2025-10-01T14:08:23.743765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 522, pipe: [1:7556254951408663506:5713]
2025-10-01T14:08:23.832139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:23.840228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.840259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.840424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.840488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.840550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.840612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.840656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.840665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.840728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.840796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.840858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.840918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.840961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.840968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.841071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.841136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.841213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.841284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.841330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.841339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.841413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.841474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.841533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.841596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.841642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.841649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.841717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.841779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.841839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.841895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.841940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.841949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.842017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.842081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.842146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.842218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.842266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.842277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.842351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.842425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.842483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.842551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.842613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.842621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.842677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.842731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.842787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.842849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.842893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.842900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.842965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.843026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.843089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.843153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.843199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.843207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.843274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:23.843341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:23.843403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:23.843465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:23.843508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:23.843514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:23.843580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663506:5713], now have 1 active actors on pipe
2025-10-01T14:08:23.843853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254951408663506:5713]
2025-10-01T14:08:23.843880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:23.843883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:23.843887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:23.843914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 523 reason: error at write: Disconnected sessionId: src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0
2025-10-01T14:08:23.844106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 523 sessionId: src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0 is DEAD
2025-10-01T14:08:23.844236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:23.844245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0] Write session will restart in 0.006076s
2025-10-01T14:08:23.844263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0] Write session: Do CDS request
2025-10-01T14:08:23.844268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:23.844592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:23.851808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.851914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:23.851930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 524
2025-10-01T14:08:23.852045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:23.852085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:23.852094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:23.852097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:23.852504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 524 sessionId:  describe result for acl check
2025-10-01T14:08:23.852562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:23.852569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:23.852571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:23.852577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254951408663559:5846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:23.853123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254951408663559:5846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:23.854249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:23.855269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254951408663559:5846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:23.855991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:23.856204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:23.856215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:23.856228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:23.856297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:23.856339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254949031800366:5236]
2025-10-01T14:08:23.856905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:23.857165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:23.857213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:23.857509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:23.857575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.857581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.857581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.857582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.857583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.857584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.857585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.857586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.857587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.857588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.857589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.857590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.857591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.857592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.857596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.857618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.857622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.857625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.857628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.857631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.857635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.857638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.857642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.857646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.857649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.857653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.857656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.857660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.857666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.857673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:23.857678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.857688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:23.857692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.857701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:23.857705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.857711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:23.857719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.857724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:23.857729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.857733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:23.857741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.857744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:23.857747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.857752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:23.857758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.857762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:23.857765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.857775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.857778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.857786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.857790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.857794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.857801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.857806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:23.857814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.857819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:23.857846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254951408663559:5846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:23.857859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254951408663559:5846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:23.857862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254951408663559:5846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:23.857871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:23.857860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:23.861607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:23.862254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:23.862267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:23.862271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:23.862274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:23.862280Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 523 [2:7556254949031800366:5236]
2025-10-01T14:08:23.862296Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:23.862313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:23.862320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.862324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.862329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.862345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:23.862354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:23.862360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:23.862437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.862444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.862446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.862449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:23.862451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:23.862518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:23.862527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.862539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:23.862551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:23.862568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:23.862589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663607:5846], now have 1 active actors on pipe
2025-10-01T14:08:23.862597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663509:2446], now have 1 active actors on pipe
2025-10-01T14:08:23.862604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254949031800360:5236]
2025-10-01T14:08:23.862606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254949031800360:5236]
2025-10-01T14:08:23.862608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254949031800360:5236]
2025-10-01T14:08:23.862622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:23.862637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:23.862639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:23.862640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:23.862641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:23.862655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:23.862629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 523
2025-10-01T14:08:23.862657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:23.862630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 523
2025-10-01T14:08:23.862704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.862713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.862726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254949031800360:5236]
2025-10-01T14:08:23.862736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:23.862743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:23.862765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:23.862776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:23.862780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:23.862782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:23.862790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:23.862801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:23.862823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.862950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.862956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.862968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:23.863043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 524 partition: 0 MaxSeqNo: 45 sessionId: src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0
2025-10-01T14:08:23.863396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea5128b9-86458bd0-bc7c1690-377656e5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:23.865757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0] Write session: try to update token
2025-10-01T14:08:23.865771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:23.879228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 524 sessionId: src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:23.881481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:23.883100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:23.883127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:23.883147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:23.883151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:23.883153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:23.883155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:23.883163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254949031800360:5236]
2025-10-01T14:08:23.883168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254949031800360:5236]
2025-10-01T14:08:23.883172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254949031800360:5236]
2025-10-01T14:08:23.883212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:23.883229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:23.883236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:23.883237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:23.883239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:23.883241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:23.883371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:23.944194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254951408663617:5713]
2025-10-01T14:08:23.944484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 523, pipe: [1:7556254951408663617:5713]
2025-10-01T14:08:24.040409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:24.040722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:24.040773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254951408663617:5713], now have 1 active actors on pipe
2025-10-01T14:08:24.040852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:24.048455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:24.049819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:24.049830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:24.049852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 524 reason: error at write: Disconnected sessionId: src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0
2025-10-01T14:08:24.049984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 524 sessionId: src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0 is DEAD
2025-10-01T14:08:24.050101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:24.050111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0] Write session will restart in 0.009009s
2025-10-01T14:08:24.050134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0] Write session: Do CDS request
2025-10-01T14:08:24.050141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:24.050153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:24.050189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254951408663617:5713]
2025-10-01T14:08:24.055452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:24.055680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:24.055689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:24.055699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:24.055744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:24.055795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254953326767763:5238]
2025-10-01T14:08:24.056439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:24.056738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:24.056773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:24.057089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:24.057138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.057143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.057145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.057146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.057147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.057148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.057149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.057150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.057152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.057153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.057154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.057155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.057156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.057157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.057162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.057172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.057176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.057180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.057184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.057188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.057191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.057195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.057199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.057211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.057215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.057219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.057223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.057226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.057232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.057239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.057245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.057250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.057254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.057260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.057264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.057269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.057274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.057279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.057283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.057289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.057297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.057302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.057306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.057310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.057314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.057319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.057323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.057329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.057333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.057338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.057342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.057347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.057355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.057361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.057368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.057373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.057417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:24.059915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.059959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:24.059972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 525
2025-10-01T14:08:24.060155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.060193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:24.060197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:24.060200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:24.060479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 525 sessionId:  describe result for acl check
2025-10-01T14:08:24.060508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:24.060514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:24.060516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:24.060520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254955703631003:5857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:24.061173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254955703631003:5857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:24.061180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:24.061813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:24.061826Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:24.061829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:24.061832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:24.061839Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 524 [2:7556254953326767763:5238]
2025-10-01T14:08:24.061853Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:24.061865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:24.061871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.061875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.061877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.061888Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:24.061895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:24.061900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:24.061936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.061941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.061942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.061944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:24.061946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:24.062008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:24.062015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.062025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.062034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.062048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:24.062064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703630985:2446], now have 1 active actors on pipe
2025-10-01T14:08:24.062076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254953326767757:5238]
2025-10-01T14:08:24.062081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254953326767757:5238]
2025-10-01T14:08:24.062082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254953326767757:5238]
2025-10-01T14:08:24.062095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:24.062110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:24.062103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 524
2025-10-01T14:08:24.062120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:24.062126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:24.062129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:24.062130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:24.062132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:24.062158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254953326767757:5238]
2025-10-01T14:08:24.062169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:24.062180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:24.063099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254955703631003:5857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:24.069250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254955703631003:5857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:24.069271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254955703631003:5857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:24.069275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254955703631003:5857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:24.069283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:24.069533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631040:5857], now have 1 active actors on pipe
2025-10-01T14:08:24.069573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 524
2025-10-01T14:08:24.069658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.069673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.069698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:24.069716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.069725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.069728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:24.069740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.069760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:24.069783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.069927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.069933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.069944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.070002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 525 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0
2025-10-01T14:08:24.070301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d3c0f0-c71ef37f-46b40bdb-4b0bff07_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:24.072589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:24.072605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:24.072615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254953326767757:5238]
2025-10-01T14:08:24.072648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:24.072656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:24.072726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0] Write session: try to update token
2025-10-01T14:08:24.072743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:24.072835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:24.073008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:24.073145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:24.073274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:24.073465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:24.073498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:24.094515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 525 sessionId: src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:24.096927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:24.097985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.098012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.098035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:24.098040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:24.098045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:24.098049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:24.098080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254953326767757:5238]
2025-10-01T14:08:24.098083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254953326767757:5238]
2025-10-01T14:08:24.098089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254953326767757:5238]
2025-10-01T14:08:24.098130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:24.098143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:24.098148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:24.098153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:24.098163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.098165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:24.098348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:24.150564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254955703631044:5713]
2025-10-01T14:08:24.150816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 524, pipe: [1:7556254955703631044:5713]
2025-10-01T14:08:24.256187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:24.256647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:24.256681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631044:5713], now have 1 active actors on pipe
2025-10-01T14:08:24.256846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:24.256876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254955703631044:5713]
2025-10-01T14:08:24.256892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:24.256918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:24.256923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:24.256983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 525 reason: error at write: Disconnected sessionId: src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0
2025-10-01T14:08:24.257126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 525 sessionId: src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0 is DEAD
2025-10-01T14:08:24.257308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:24.257322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0] Write session will restart in 0.005210s
2025-10-01T14:08:24.257355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0] Write session: Do CDS request
2025-10-01T14:08:24.257365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:24.263854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.264001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:24.264012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 526
2025-10-01T14:08:24.264080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.264107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:24.264118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:24.264121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:24.264730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 526 sessionId:  describe result for acl check
2025-10-01T14:08:24.264775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:24.264781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:24.264796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:24.264804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254955703631114:5862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:24.265345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254955703631114:5862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:24.265977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:24.267447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254955703631114:5862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:24.267584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:24.267767Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:24.267775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:24.267785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:24.267821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:24.267853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254953326767884:5243]
2025-10-01T14:08:24.268516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:24.268758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:24.268804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:24.269134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:24.269183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.269188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.269189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.269190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.269192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.269193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.269194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.269195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.269197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.269198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.269199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.269200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.269201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.269202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.269207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.269217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.269221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.269224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.269228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.269232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.269236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.269239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.269243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.269248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.269252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.269255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.269259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.269262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.269268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.269276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.269282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.269287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.269291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.269301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.269305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.269311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.269316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.269325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.269329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.269334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.269342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.269347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.269357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.269362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.269370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.269375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.269379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.269384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.269392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.269397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.269401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.269410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.269414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.269422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.269426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.269431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.269469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:24.270040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254955703631114:5862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:24.270055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254955703631114:5862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:24.270058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254955703631114:5862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:24.270066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:24.274123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:24.274921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:24.274936Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:24.274939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:24.274942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:24.274951Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 525 [2:7556254953326767884:5243]
2025-10-01T14:08:24.274964Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:24.274980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:24.274983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.274986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.274988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.275002Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:24.275007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:24.275013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:24.275068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.275075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.275077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.275080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:24.275082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:24.275144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:24.275152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.275165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.275176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.275192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:24.275209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631051:2446], now have 1 active actors on pipe
2025-10-01T14:08:24.275217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631168:5862], now have 1 active actors on pipe
2025-10-01T14:08:24.275224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254953326767879:5243]
2025-10-01T14:08:24.275226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254953326767879:5243]
2025-10-01T14:08:24.275228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254953326767879:5243]
2025-10-01T14:08:24.275242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:24.275256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:24.275259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:24.275266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:24.275268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:24.275272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:24.275275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:24.275285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 525
2025-10-01T14:08:24.275285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 525
2025-10-01T14:08:24.275303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254953326767879:5243]
2025-10-01T14:08:24.275314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:24.275323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:24.275346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.275350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.275376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:24.275386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.275391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.275392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:24.275401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.275412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:24.275426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.275565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.275572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.275586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.275647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 526 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0
2025-10-01T14:08:24.276029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b633de-2e32be77-2e22d8e4-6440e83f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:24.279155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0] Write session: try to update token
2025-10-01T14:08:24.279177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:24.293956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 526 sessionId: src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:24.296383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:24.296619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.296640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.296676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:24.296763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:24.302638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:24.302657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:24.302659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:24.302660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:24.302669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254953326767879:5243]
2025-10-01T14:08:24.302672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254953326767879:5243]
2025-10-01T14:08:24.302678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254953326767879:5243]
2025-10-01T14:08:24.302715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:24.302720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.302721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:24.302731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:24.302737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:24.302740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:24.302851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:24.356902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254955703631176:5713]
2025-10-01T14:08:24.357141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 525, pipe: [1:7556254955703631176:5713]
2025-10-01T14:08:24.450325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:24.458405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.458428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.458607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.458675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.458738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.458801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.458846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.458855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.458924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.458985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.459047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.459109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.459157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.459164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.459222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.459276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.459331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.459384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.459423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.459432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.459494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.459581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.459637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.459691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.459732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.459739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.459891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.459945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.460001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.460056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.460096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.460102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.460158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.460215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.460276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.460338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.460387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.460394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.460454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.460510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.460574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.460635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.460684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.460691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.460751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.460818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.460873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.460932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.460975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.460984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.461044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.461099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.461156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.461215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.461275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.461282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.461343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.461399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.461456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.461511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.461567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.461574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.461639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631176:5713], now have 1 active actors on pipe
2025-10-01T14:08:24.461840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:24.461842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254955703631176:5713]
2025-10-01T14:08:24.461866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:24.461868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:24.461896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 526 reason: error at write: Disconnected sessionId: src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0
2025-10-01T14:08:24.462103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 526 sessionId: src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0 is DEAD
2025-10-01T14:08:24.462231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:24.462246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0] Write session will restart in 0.009727s
2025-10-01T14:08:24.462272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0] Write session: Do CDS request
2025-10-01T14:08:24.462278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:24.462589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:24.471057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:24.472583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:24.472781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:24.472821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:24.472835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:24.472879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:24.472910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254953326768018:5256]
2025-10-01T14:08:24.472935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.472970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:24.472983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 527
2025-10-01T14:08:24.473161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.473195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:24.473200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:24.473205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:24.473379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:24.473547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 527 sessionId:  describe result for acl check
2025-10-01T14:08:24.473582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:24.473587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:24.473589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:24.473593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254955703631245:5867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:24.473653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:24.473706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:24.473949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:24.473990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.473994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.473995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.473996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.473997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.473997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.473998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.473999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.473999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.474000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.474001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.474001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.474002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.474020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254955703631245:5867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:24.474002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.474006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.474011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.474013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.474016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.474017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.474020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.474022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.474024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.474026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.474028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.474030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.474032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.474034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.474036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.474040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.474045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.474049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.474052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.474055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.474058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.474060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.474062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.474065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.474068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.474077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.474080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.474083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.474085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.474088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.474090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.474095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.474099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.474103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.474108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.474112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.474117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.474121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.474125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.474129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.474135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.474138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.474142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.474177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:24.476507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254955703631245:5867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:24.479030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:24.479088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254955703631245:5867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:24.479104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254955703631245:5867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:24.479108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254955703631245:5867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:24.479116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:24.479635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:24.479651Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:24.479654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:24.479656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:24.479663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 526 [2:7556254953326768018:5256]
2025-10-01T14:08:24.479680Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:24.479699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:24.479705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.479709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.479711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.479730Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:24.479734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:24.479745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:24.479801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.479809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.479810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.479813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:24.479816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:24.479877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:24.479885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.479897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.479911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.479930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:24.479952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631282:5867], now have 1 active actors on pipe
2025-10-01T14:08:24.479959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631179:2446], now have 1 active actors on pipe
2025-10-01T14:08:24.479966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254953326768013:5256]
2025-10-01T14:08:24.479973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254953326768013:5256]
2025-10-01T14:08:24.479975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254953326768013:5256]
2025-10-01T14:08:24.479962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 526
2025-10-01T14:08:24.479973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 526
2025-10-01T14:08:24.479989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:24.480006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:24.480007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:24.480015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:24.480017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:24.480020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:24.480023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:24.480057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254953326768013:5256]
2025-10-01T14:08:24.480069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:24.480082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:24.480131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.480140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.480164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|931287ef-fc955765-40a8fee2-91698076_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:24.480175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.480184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.480186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:24.480195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.480207Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:24.480226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.480411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.480426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.480447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.480543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 527 partition: 0 MaxSeqNo: 45 sessionId: src_id|931287ef-fc955765-40a8fee2-91698076_0
2025-10-01T14:08:24.480903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f242eb9-777ee567-7def519b-c8bc95d7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|931287ef-fc955765-40a8fee2-91698076_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:24.483436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|931287ef-fc955765-40a8fee2-91698076_0] Write session: try to update token
2025-10-01T14:08:24.483456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|931287ef-fc955765-40a8fee2-91698076_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:24.498926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 527 sessionId: src_id|931287ef-fc955765-40a8fee2-91698076_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:24.501369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:24.501674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.501697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.501738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:24.501854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:24.509993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:24.510013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:24.510014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:24.510016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:24.510029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254953326768013:5256]
2025-10-01T14:08:24.510033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254953326768013:5256]
2025-10-01T14:08:24.510037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254953326768013:5256]
2025-10-01T14:08:24.510081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:24.510087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.510089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:24.510094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:24.510097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:24.510101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:24.510228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:24.562228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254955703631289:5713]
2025-10-01T14:08:24.562534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 526, pipe: [1:7556254955703631289:5713]
2025-10-01T14:08:24.656163Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:24.664049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.664077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.664245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.664308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.664372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.664430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.664474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.664483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.664552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.664611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.664678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.664746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.664800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.664812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.664869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.664922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.664976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.665036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.665076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.665082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.665155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.665218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.665274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.665332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.665376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.665383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.665436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.665488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.665545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.665599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.665657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.665664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.665723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.665776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.665833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.665892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.665936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.665942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.665998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.666050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.666110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.666167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.666205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.666213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.666267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.666321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.666392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.666447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.666494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.666500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.666562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.666620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.666687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.666751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.666801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.666809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.666868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.666923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.666979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.667035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.667074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.667080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.667136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631289:5713], now have 1 active actors on pipe
2025-10-01T14:08:24.667374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:24.667381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:24.667384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:24.667409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 527 reason: error at write: Disconnected sessionId: src_id|931287ef-fc955765-40a8fee2-91698076_0
2025-10-01T14:08:24.667461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254955703631289:5713]
2025-10-01T14:08:24.667578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 527 sessionId: src_id|931287ef-fc955765-40a8fee2-91698076_0 is DEAD
2025-10-01T14:08:24.667740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931287ef-fc955765-40a8fee2-91698076_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:24.667751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931287ef-fc955765-40a8fee2-91698076_0] Write session will restart in 0.006436s
2025-10-01T14:08:24.667777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931287ef-fc955765-40a8fee2-91698076_0] Write session: Do CDS request
2025-10-01T14:08:24.667783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931287ef-fc955765-40a8fee2-91698076_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:24.668120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:24.675530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:24.675941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|931287ef-fc955765-40a8fee2-91698076_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.676047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:24.676061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 528
2025-10-01T14:08:24.676189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.676220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:24.676223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:24.676226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:24.676551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 528 sessionId:  describe result for acl check
2025-10-01T14:08:24.676579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:24.676585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:24.676587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:24.676592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254955703631359:5872] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:24.677070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254955703631359:5872] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:24.677429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:24.677643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:24.677654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:24.677665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:24.677711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:24.677745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254953326768125:5258]
2025-10-01T14:08:24.678155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:24.678425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:24.678478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:24.678783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:24.678846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.678852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.678853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.678854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.678855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.678856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.678857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.678858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.678858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.678859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.678860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.678861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.678862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.678863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.678867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.678875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.678878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.678881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.678884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.678888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.678890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.678893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.678897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.678900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.678903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.678906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.678909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.678913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.678918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.678925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.678930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.678935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.678938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.678943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.678946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.678951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.678955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.678959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.678963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.678967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.678971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.678975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.678979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.678983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.678987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.678991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.678995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.679000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.679003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.679007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.679011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.679015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.679019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.679023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.679028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.679039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.679009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254955703631359:5872] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:24.679074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:24.682685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254955703631359:5872] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:24.682696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254955703631359:5872] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:24.682699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254955703631359:5872] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:24.682705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:24.683027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:24.683601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:24.683615Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:24.683618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:24.683621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:24.683628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 527 [2:7556254953326768125:5258]
2025-10-01T14:08:24.683641Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:24.683658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:24.683661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.683665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.683667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.683681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:24.683685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:24.683690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:24.683739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.683747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.683749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.683752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:24.683755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:24.683824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:24.683832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.683843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.683855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.683871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:24.683894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631294:2446], now have 1 active actors on pipe
2025-10-01T14:08:24.683902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631398:5872], now have 1 active actors on pipe
2025-10-01T14:08:24.683909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254953326768118:5258]
2025-10-01T14:08:24.683911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254953326768118:5258]
2025-10-01T14:08:24.683913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254953326768118:5258]
2025-10-01T14:08:24.683908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 527
2025-10-01T14:08:24.683915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 527
2025-10-01T14:08:24.683927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:24.683939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:24.683941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:24.683942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:24.683943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:24.683957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:24.683963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:24.683999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.684008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.684024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254953326768118:5258]
2025-10-01T14:08:24.684031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:24.684037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:24.684051Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e84565d-5833abd8-d76a453-e140d062_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:24.684061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.684065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.684067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:24.684075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.684083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:24.684103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.684245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.684253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.684270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.684352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 528 partition: 0 MaxSeqNo: 45 sessionId: src_id|4e84565d-5833abd8-d76a453-e140d062_0
2025-10-01T14:08:24.684710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931287ef-fc955765-40a8fee2-91698076_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4e84565d-5833abd8-d76a453-e140d062_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:24.687001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e84565d-5833abd8-d76a453-e140d062_0] Write session: try to update token
2025-10-01T14:08:24.687015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e84565d-5833abd8-d76a453-e140d062_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:24.699915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 528 sessionId: src_id|4e84565d-5833abd8-d76a453-e140d062_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:24.702196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:24.702411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.702440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.702478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:24.702556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:24.709618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:24.709633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:24.709636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:24.709638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:24.709647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254953326768118:5258]
2025-10-01T14:08:24.709651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254953326768118:5258]
2025-10-01T14:08:24.709654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254953326768118:5258]
2025-10-01T14:08:24.709702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:24.709705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:24.709710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:24.709713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:24.709717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.709720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:24.709843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:24.767519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254955703631405:5713]
2025-10-01T14:08:24.767759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 527, pipe: [1:7556254955703631405:5713]
2025-10-01T14:08:24.863608Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:24.871665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.871699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.871864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.871924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.871981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.872043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.872100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.872110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.872179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.872239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.872305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.872368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.872416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.872423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.872480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.872534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.872588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.872651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.872692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.872700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.872759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.872828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.872910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.872965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.873005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.873012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.873067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.873125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.873178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.873238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.873288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.873295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.873355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.873428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.873485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.873543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.873587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.873595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.873658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.873716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.873773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.873830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.873875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.873882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.873946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.874000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.874057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.874117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.874162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.874173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.874234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.874288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.874355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.874439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.874494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.874501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.874562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:24.874612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:24.874665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:24.874716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:24.874780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:24.874788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:24.874855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631405:5713], now have 1 active actors on pipe
2025-10-01T14:08:24.875087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:24.875089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254955703631405:5713]
2025-10-01T14:08:24.875100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:24.875117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:24.875130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 528 reason: error at write: Disconnected sessionId: src_id|4e84565d-5833abd8-d76a453-e140d062_0
2025-10-01T14:08:24.875360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 528 sessionId: src_id|4e84565d-5833abd8-d76a453-e140d062_0 is DEAD
2025-10-01T14:08:24.875455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e84565d-5833abd8-d76a453-e140d062_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:24.875462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e84565d-5833abd8-d76a453-e140d062_0] Write session will restart in 0.006852s
2025-10-01T14:08:24.875487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e84565d-5833abd8-d76a453-e140d062_0] Write session: Do CDS request
2025-10-01T14:08:24.875492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e84565d-5833abd8-d76a453-e140d062_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:24.875865Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:24.883823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:24.883945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e84565d-5833abd8-d76a453-e140d062_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.884058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:24.884072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 529
2025-10-01T14:08:24.884209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:24.884269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:24.884279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:24.884282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:24.884679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 529 sessionId:  describe result for acl check
2025-10-01T14:08:24.884715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:24.884721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:24.884723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:24.884728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254955703631474:5876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:24.885275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254955703631474:5876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:24.885934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:24.886155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:24.886168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:24.886179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:24.886235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:24.886274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254953326768230:5261]
2025-10-01T14:08:24.886850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:24.887109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:24.887155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:24.887389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254955703631474:5876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:24.887462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:24.887529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.887535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.887536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.887537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.887538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.887539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.887540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.887542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.887543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.887544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.887545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.887547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.887548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.887559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.887565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.887575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.887579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.887583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.887587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.887599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.887602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.887605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.887608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.887612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.887616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.887620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.887624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.887627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.887634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.887641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:24.887646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.887651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:24.887656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.887665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:24.887674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.887679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:24.887683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.887690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:24.887694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.887703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:24.887708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.887712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:24.887716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.887721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:24.887725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.887730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:24.887735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.887746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.887754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.887759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.887767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.887773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.887779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.887783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:24.887787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.887792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:24.887834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:24.892981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254955703631474:5876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:24.892997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254955703631474:5876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:24.893001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254955703631474:5876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:24.893008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:24.893195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:24.893746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:24.893763Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:24.893766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:24.893769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:24.893778Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 528 [2:7556254953326768230:5261]
2025-10-01T14:08:24.893793Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:24.893809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:24.893813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.893817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.893819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.893834Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:24.893840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:24.893845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:24.893897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.893905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.893907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.893910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:24.893913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:24.893980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:24.893987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.894000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:24.894011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:24.894032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:24.894055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631513:5876], now have 1 active actors on pipe
2025-10-01T14:08:24.894063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631408:2446], now have 1 active actors on pipe
2025-10-01T14:08:24.894070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254953326768225:5261]
2025-10-01T14:08:24.894072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254953326768225:5261]
2025-10-01T14:08:24.894074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254953326768225:5261]
2025-10-01T14:08:24.894074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 528
2025-10-01T14:08:24.894087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:24.894074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 528
2025-10-01T14:08:24.894105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:24.894105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:24.894110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:24.894112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:24.894123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:24.894126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:24.894174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.894183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.894196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254953326768225:5261]
2025-10-01T14:08:24.894206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:24.894216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:24.894235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:24.894246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:24.894250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:24.894253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:24.894261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:24.894274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:24.894297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.894425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.894433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.894448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:24.894510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 529 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0
2025-10-01T14:08:24.894882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e84565d-5833abd8-d76a453-e140d062_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:24.897267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0] Write session: try to update token
2025-10-01T14:08:24.897283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:24.911556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 529 sessionId: src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:24.913906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:24.914768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:24.914792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:24.914830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:24.914930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:24.922558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:24.922576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:24.922578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:24.922580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:24.922589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254953326768225:5261]
2025-10-01T14:08:24.922593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254953326768225:5261]
2025-10-01T14:08:24.922596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254953326768225:5261]
2025-10-01T14:08:24.922636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:24.922639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:24.922645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:24.922647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:24.922650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:24.922654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:24.922774Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:24.975426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254955703631521:5713]
2025-10-01T14:08:24.975721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 528, pipe: [1:7556254955703631521:5713]
2025-10-01T14:08:25.062598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:25.069259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.069283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.069416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.069467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.069520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.069575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.069617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.069626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.069696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.069746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.069821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.069875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.069918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.069925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.069979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.070024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.070073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.070126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.070161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.070168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.070220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.070269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.070323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.070386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.070423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.070428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.070478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.070525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.070571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.070621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.070657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.070661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.070712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.070763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.070815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.070866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.070907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.070912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.070963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.071010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.071063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.071111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.071148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.071153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.071203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.071253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.071302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.071355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.071393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.071401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.071456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.071508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.071561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.071614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.071652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.071657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.071710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.071760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.071811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.071863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.071904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.071909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.071963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254955703631521:5713], now have 1 active actors on pipe
2025-10-01T14:08:25.072174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254955703631521:5713]
2025-10-01T14:08:25.072207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:25.072210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:25.072230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 529 reason: error at write: Disconnected sessionId: src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0
2025-10-01T14:08:25.072440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 529 sessionId: src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0 is DEAD
2025-10-01T14:08:25.072524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:25.072531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0] Write session will restart in 0.009090s
2025-10-01T14:08:25.072547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0] Write session: Do CDS request
2025-10-01T14:08:25.072551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:25.072602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:25.072900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:25.080546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:25.081936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:25.082135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:25.082146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:25.082156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:25.082200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:25.082233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254957621735634:5263]
2025-10-01T14:08:25.082765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.082745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:25.082978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:25.082994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 530
2025-10-01T14:08:25.083026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:25.083062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:25.083112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.083145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:25.083155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:25.083162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:25.083336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:25.083393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.083400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.083401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.083401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.083402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.083403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.083404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.083405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.083406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.083407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.083407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.083408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.083409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.083410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.083415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.083424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.083428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.083431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.083433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.083436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.083439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.083442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.083445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.083449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.083451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.083454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.083457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.083464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.083470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.083479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.083488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.083496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.083503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.083507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.083514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.083518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.083522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.083517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 530 sessionId:  describe result for acl check
2025-10-01T14:08:25.083526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.083533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.083537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.083541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.083544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.083548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.083552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.083550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:25.083560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.083556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:25.083568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.083558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:25.083573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.083562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254959998598903:5886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:25.083578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.083586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.083592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.083599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.083603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.083610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.083614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.083621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.083629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.083662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:25.084039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254959998598903:5886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:25.086172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254959998598903:5886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:25.087062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:25.087587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:25.087598Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:25.087599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:25.087602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:25.087607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 529 [2:7556254957621735634:5263]
2025-10-01T14:08:25.087616Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:25.087627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:25.087632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.087634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.087635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.087646Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:25.087653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:25.087656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:25.087693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.087699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.087700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.087703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:25.087704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:25.087752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:25.087759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.087766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.087772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.087780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:25.087793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998598834:2446], now have 1 active actors on pipe
2025-10-01T14:08:25.087798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254957621735629:5263]
2025-10-01T14:08:25.087799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254957621735629:5263]
2025-10-01T14:08:25.087800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254957621735629:5263]
2025-10-01T14:08:25.087809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:25.087817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:25.087818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:25.087823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:25.087825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:25.087826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:25.087827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:25.087845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254957621735629:5263]
2025-10-01T14:08:25.087852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:25.087856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:25.087874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 529
2025-10-01T14:08:25.090458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254959998598903:5886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:25.090471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254959998598903:5886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:25.090474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254959998598903:5886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:25.090481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:25.090917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998598942:5886], now have 1 active actors on pipe
2025-10-01T14:08:25.090982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 529
2025-10-01T14:08:25.091021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.091028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.091048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63cb4644-daba384f-f0e99a87-faa7828f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:25.091058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.091065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.091066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:25.091074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.091088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:25.091101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.091243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.091254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.091271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.091358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 530 partition: 0 MaxSeqNo: 45 sessionId: src_id|63cb4644-daba384f-f0e99a87-faa7828f_0
2025-10-01T14:08:25.091671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d166c3-4d82ee1d-38f83c17-9bcf47_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|63cb4644-daba384f-f0e99a87-faa7828f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:25.093975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63cb4644-daba384f-f0e99a87-faa7828f_0] Write session: try to update token
2025-10-01T14:08:25.093991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63cb4644-daba384f-f0e99a87-faa7828f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:25.099213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:25.099238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:25.099251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254957621735629:5263]
2025-10-01T14:08:25.099295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:25.099308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:25.099621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:25.099808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:25.100009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:25.100246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:25.100595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:25.100658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:25.107701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 530 sessionId: src_id|63cb4644-daba384f-f0e99a87-faa7828f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:25.110149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:25.110431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.110452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.110489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:25.110583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:25.119542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:25.119564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:25.119566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:25.119567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:25.119577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254957621735629:5263]
2025-10-01T14:08:25.119580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254957621735629:5263]
2025-10-01T14:08:25.119583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254957621735629:5263]
2025-10-01T14:08:25.119620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:25.119627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:25.119631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:25.119633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:25.119633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.119635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:25.119784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:25.172515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254959998598959:5713]
2025-10-01T14:08:25.172744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 529, pipe: [1:7556254959998598959:5713]
2025-10-01T14:08:25.255835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:25.262269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.262292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.262432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.262483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.262534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.262587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.262630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.262642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.262704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.262754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.262808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.262862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.262902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.262907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.262966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.263020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.263075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.263129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.263179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.263184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.263257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.263319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.263377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.263444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.263489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.263496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.263552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.263604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.263658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.263710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.263754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.263762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.263824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.263875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.263932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.264001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.264047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.264052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.264107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.264157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.264208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.264265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.264364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.264369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.264423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.264478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.264530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.264582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.264619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.264624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.264680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.264734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.264799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.264850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.264888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.264892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.264947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.264997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.265048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.265096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.265134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.265140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.265183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998598959:5713], now have 1 active actors on pipe
2025-10-01T14:08:25.265447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254959998598959:5713]
2025-10-01T14:08:25.265630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:25.265648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:25.265680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 530 reason: error at write: Disconnected sessionId: src_id|63cb4644-daba384f-f0e99a87-faa7828f_0
2025-10-01T14:08:25.265922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:25.265930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 530 sessionId: src_id|63cb4644-daba384f-f0e99a87-faa7828f_0 is DEAD
2025-10-01T14:08:25.266029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:25.266060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cb4644-daba384f-f0e99a87-faa7828f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:25.266068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cb4644-daba384f-f0e99a87-faa7828f_0] Write session will restart in 0.008126s
2025-10-01T14:08:25.266086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cb4644-daba384f-f0e99a87-faa7828f_0] Write session: Do CDS request
2025-10-01T14:08:25.266091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cb4644-daba384f-f0e99a87-faa7828f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:25.274410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:25.274769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63cb4644-daba384f-f0e99a87-faa7828f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.274869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:25.274880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 531
2025-10-01T14:08:25.275023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.275046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:25.275054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:25.275056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:25.275387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 531 sessionId:  describe result for acl check
2025-10-01T14:08:25.275424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:25.275429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:25.275431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:25.275449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254959998599052:5893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:25.275901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254959998599052:5893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:25.275957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:25.276095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:25.276103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:25.276110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:25.276141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:25.276167Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254957621735761:5268]
2025-10-01T14:08:25.276541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:25.276743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:25.276776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:25.277017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:25.277064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.277069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.277070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.277071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.277072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.277073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.277074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.277075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.277076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.277077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.277078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.277079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.277080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.277081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.277083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.277089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.277090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.277092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.277094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.277096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.277098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.277099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.277101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.277103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.277105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.277107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.277108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.277110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.277114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.277118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.277123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.277126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.277128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.277131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.277133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.277136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.277139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.277142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.277144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.277146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.277149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.277152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.277154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.277157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.277159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.277162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.277164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.277167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.277169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.277172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.277174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.277178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.277180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.277183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.277185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.277187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.277209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:25.277464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254959998599052:5893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:25.280280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254959998599052:5893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:25.280291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254959998599052:5893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:25.280296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254959998599052:5893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:25.280301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:25.280536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:25.281116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:25.281129Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:25.281130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:25.281133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:25.281138Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 530 [2:7556254957621735761:5268]
2025-10-01T14:08:25.281149Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:25.281167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:25.281174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.281178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.281180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.281192Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:25.281199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:25.281203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:25.281245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.281250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.281252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.281254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:25.281255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:25.281301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:25.281307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.281313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.281318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.281333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:25.281354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599090:5893], now have 1 active actors on pipe
2025-10-01T14:08:25.281362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998598971:2446], now have 1 active actors on pipe
2025-10-01T14:08:25.281369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254957621735756:5268]
2025-10-01T14:08:25.281371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254957621735756:5268]
2025-10-01T14:08:25.281372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254957621735756:5268]
2025-10-01T14:08:25.281382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:25.281390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:25.281392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:25.281398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:25.281399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:25.281400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:25.281401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:25.281422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254957621735756:5268]
2025-10-01T14:08:25.281427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:25.281429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:25.281403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 530
2025-10-01T14:08:25.281439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.281445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.281415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 530
2025-10-01T14:08:25.281476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:25.281484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.281487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.281488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:25.281493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.281500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:25.281515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.281632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.281640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.281652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.281709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 531 partition: 0 MaxSeqNo: 45 sessionId: src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0
2025-10-01T14:08:25.282077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63cb4644-daba384f-f0e99a87-faa7828f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:25.284433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0] Write session: try to update token
2025-10-01T14:08:25.284451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:25.298443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 531 sessionId: src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:25.300681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:25.300783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:25.300819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:25.300821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:25.300823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:25.300834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254957621735756:5268]
2025-10-01T14:08:25.300839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254957621735756:5268]
2025-10-01T14:08:25.300847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254957621735756:5268]
2025-10-01T14:08:25.300878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:25.300889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:25.300893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:25.300898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.300907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.300926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:25.300938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.300945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:25.301072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:25.365545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254959998599097:5713]
2025-10-01T14:08:25.365815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 530, pipe: [1:7556254959998599097:5713]
2025-10-01T14:08:25.440301Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:25.440666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599097:5713], now have 1 active actors on pipe
2025-10-01T14:08:25.440859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:25.441163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:25.441243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 531 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0
2025-10-01T14:08:25.441460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 531 sessionId: src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0 is DEAD
2025-10-01T14:08:25.441600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:25.441619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0] Write session will restart in 0.006360s
2025-10-01T14:08:25.441644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0] Write session: Do CDS request
2025-10-01T14:08:25.441619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254959998599097:5713]
2025-10-01T14:08:25.441655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:25.441644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:25.448944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.448961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:25.448977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 532
2025-10-01T14:08:25.449164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.449195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:25.449205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:25.449208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:25.449596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 532 sessionId:  describe result for acl check
2025-10-01T14:08:25.449634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:25.449642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:25.449644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:25.449649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254959998599168:5897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:25.450158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254959998599168:5897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:25.450873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:25.451819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254959998599168:5897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:25.452647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:25.452870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:25.452880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:25.452892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:25.452950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:25.452983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254957621735899:5281]
2025-10-01T14:08:25.453563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:25.453858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:25.453896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:25.454101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:25.454160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.454165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.454166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.454167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.454167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.454168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.454168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.454169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.454170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.454171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.454171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.454172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.454172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.454173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.454177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.454183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.454185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.454187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.454189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.454191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.454193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.454195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.454197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.454199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.454201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.454203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.454205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.454207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.454212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.454216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.454220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.454223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.454225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.454229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.454231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.454234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.454239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.454244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.454248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.454252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.454256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.454260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.454264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.454269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.454272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.454277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.454280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.454285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.454289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.454294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.454298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.454303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.454307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.454312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.454316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.454321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.454211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254959998599168:5897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:25.454223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254959998599168:5897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:25.454226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254959998599168:5897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:25.454234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:25.454342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:25.459313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:25.459919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:25.459940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:25.459943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:25.459947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:25.459954Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 531 [2:7556254957621735899:5281]
2025-10-01T14:08:25.459969Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:25.459985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:25.459994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.459998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.460000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.460016Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:25.460022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:25.460033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:25.460091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.460099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.460101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.460104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:25.460107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:25.460175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:25.460185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.460201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.460213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.460235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:25.460256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599205:5897], now have 1 active actors on pipe
2025-10-01T14:08:25.460265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599102:2446], now have 1 active actors on pipe
2025-10-01T14:08:25.460248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 531
2025-10-01T14:08:25.460272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254957621735894:5281]
2025-10-01T14:08:25.460279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254957621735894:5281]
2025-10-01T14:08:25.460283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254957621735894:5281]
2025-10-01T14:08:25.460255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 531
2025-10-01T14:08:25.460292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:25.460300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:25.460303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:25.460304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:25.460306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:25.460321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:25.460329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:25.460350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.460359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.460403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254957621735894:5281]
2025-10-01T14:08:25.460415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:25.460420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:25.460430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:25.460436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.460445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.460451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:25.460459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.460473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:25.460510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.460644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.460652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.460667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.460740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 532 partition: 0 MaxSeqNo: 45 sessionId: src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0
2025-10-01T14:08:25.461144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23e64161-7c21bec6-535a35ea-46b7fc77_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:25.463582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0] Write session: try to update token
2025-10-01T14:08:25.463601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:25.477573Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:25.477597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:25.477608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254957621735894:5281]
2025-10-01T14:08:25.477658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:25.477678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:25.477844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:25.477991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:25.478131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:25.478108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 532 sessionId: src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:25.478276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:25.478516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:25.478566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:25.480484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:25.480691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.480707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.480743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:25.480830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:25.502712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.502742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.502915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.502985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.503050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.503116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.503159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.503169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.503235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.503298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.503360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.503426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.503471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.503478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.503570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.503633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.503696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.503761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.503808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.503816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.503882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.503948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.504012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.504080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.504124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.504132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.504201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.504266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.504333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.504395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.504445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.504453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.504515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.504570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.504632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.504694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.504738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.504746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.504828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.504886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.504951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.505016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.505082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.505090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.505160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.505227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.505296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.505362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.505409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.505417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.505484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.505544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.505608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.505677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.505807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.505819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.505883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:25.505940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:25.506007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:25.506073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:25.506123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:25.506131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:25.506204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:25.506212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:25.506215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:25.506217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:25.506226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254957621735894:5281]
2025-10-01T14:08:25.506234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254957621735894:5281]
2025-10-01T14:08:25.506237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254957621735894:5281]
2025-10-01T14:08:25.506289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:25.506294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:08:25.506303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:25.506307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:25.506354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.506395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.506402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:08:25.506423Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506438Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506443Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506448Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506451Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506456Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506464Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506468Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506472Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506476Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506495Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506504Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506508Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506514Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506521Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506964Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506979Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506987Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506995Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.506998Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507002Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507010Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507018Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507022Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507030Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507257Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507268Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507272Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507280Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507285Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507293Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507298Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507303Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507308Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507312Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:25.507460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:08:25.507476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:08:25.507483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:08:25.507486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:08:25.507490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:08:25.507905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:08:25.507934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:08:25.507945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:08:25.507953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:08:25.507956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:08:25.507959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:08:25.508456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:08:25.508481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:08:25.508492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:08:25.508500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:08:25.508503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:08:25.508506Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:08:25.509107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:08:25.509131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.509241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327705508
2025-10-01T14:08:25.510025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:25.510047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.510049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:25.510189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:25.541696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254959998599214:5713]
2025-10-01T14:08:25.541929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 531, pipe: [1:7556254959998599214:5713]
2025-10-01T14:08:25.655323Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:25.655636Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:08:25.655671Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:08:25.655695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599214:5713], now have 1 active actors on pipe
2025-10-01T14:08:25.655878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:25.655961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:25.655970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254959998599214:5713]
2025-10-01T14:08:25.655993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:25.656031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 532 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0
2025-10-01T14:08:25.656243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 532 sessionId: src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0 is DEAD
2025-10-01T14:08:25.656370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:25.656400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0] Write session will restart in 0.008576s
2025-10-01T14:08:25.656426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0] Write session: Do CDS request
2025-10-01T14:08:25.656432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:25.664904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:25.665995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.666570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:25.666801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:25.666814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:25.666828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:25.666911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:25.666952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254957621736009:5283]
2025-10-01T14:08:25.666022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:25.666038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 533
2025-10-01T14:08:25.666229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.666265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:25.666270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:25.666274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:25.666678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 533 sessionId:  describe result for acl check
2025-10-01T14:08:25.666703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:25.666705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:25.666706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:25.666713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254959998599289:5902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:25.667219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254959998599289:5902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:25.667533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:25.667974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:25.668031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:25.668380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:25.668438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.668444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.668446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.668447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.668449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.668450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.668451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.668452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.668453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.668454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.668456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.668457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.668458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.668459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.668464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.668474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.668478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.668482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.668486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.668490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.668494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.668498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.668502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.668506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.668510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.668514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.668518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.668521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.668528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.668536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.668542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.668548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.668553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.668558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.668562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.668568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.668572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.668578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.668584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.668588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.668595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.668602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.668610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.668616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.668620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.668630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.668635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.668644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.668648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.668658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.668661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.668670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.668676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.668685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.668689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.668698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.668740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:25.669127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254959998599289:5902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:25.672613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254959998599289:5902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:25.672627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254959998599289:5902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:25.672629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254959998599289:5902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:25.672635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:25.672893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:25.673446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:25.673462Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:25.673465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:25.673468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:25.673474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 532 [2:7556254957621736009:5283]
2025-10-01T14:08:25.673490Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:25.673506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:25.673509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.673512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.673515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.673530Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:25.673540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:25.673546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:25.673600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.673607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.673609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.673611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:25.673614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:25.673678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:25.673685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.673697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.673708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.673728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:25.673750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599219:2446], now have 1 active actors on pipe
2025-10-01T14:08:25.673779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599328:5902], now have 1 active actors on pipe
2025-10-01T14:08:25.673790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254957621736004:5283]
2025-10-01T14:08:25.673794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254957621736004:5283]
2025-10-01T14:08:25.673796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254957621736004:5283]
2025-10-01T14:08:25.673777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 532
2025-10-01T14:08:25.673785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 532
2025-10-01T14:08:25.673804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:25.673810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:25.673813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:25.673814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:25.673822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:25.673835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:25.673842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:25.673859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.673867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.673908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254957621736004:5283]
2025-10-01T14:08:25.673918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:25.673925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:25.673935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:25.673946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.673955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.673957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:25.673965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.673977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:25.674016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.674118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.674126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.674139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.674201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 533 partition: 0 MaxSeqNo: 45 sessionId: src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0
2025-10-01T14:08:25.674582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b757c4-8cff41c5-d4b72ec1-aa09e9a6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:25.676843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0] Write session: try to update token
2025-10-01T14:08:25.676857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:25.692705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 533 sessionId: src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:25.693850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:25.693873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:25.693876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:25.693878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:25.693887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254957621736004:5283]
2025-10-01T14:08:25.693892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254957621736004:5283]
2025-10-01T14:08:25.693895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254957621736004:5283]
2025-10-01T14:08:25.693942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:25.693946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:25.693953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.693955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:25.693956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:25.693959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:25.694083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:25.695095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:25.756272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254959998599335:5713]
2025-10-01T14:08:25.756511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 532, pipe: [1:7556254959998599335:5713]
2025-10-01T14:08:25.854151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:25.854468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.854486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.854525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599335:5713], now have 1 active actors on pipe
2025-10-01T14:08:25.854845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254959998599335:5713]
2025-10-01T14:08:25.854845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:25.854887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:25.854890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:25.854915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:25.854953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 533 reason: error at write: Disconnected sessionId: src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0
2025-10-01T14:08:25.855155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 533 sessionId: src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0 is DEAD
2025-10-01T14:08:25.855823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:25.855833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0] Write session will restart in 0.005951s
2025-10-01T14:08:25.855861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0] Write session: Do CDS request
2025-10-01T14:08:25.855867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:25.862912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.863103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:25.863120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 534
2025-10-01T14:08:25.863284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:25.863329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:25.863338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:25.863342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:25.863786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 534 sessionId:  describe result for acl check
2025-10-01T14:08:25.863830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:25.863832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:25.863834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:25.863840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254959998599355:5906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:25.864418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254959998599355:5906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:25.867987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254959998599355:5906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:25.868232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:25.870276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:25.870544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254959998599355:5906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:25.870558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254959998599355:5906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:25.870562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254959998599355:5906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:25.870571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:25.870571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:25.870584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:25.870598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:25.870670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:25.870712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254957621736122:5286]
2025-10-01T14:08:25.871304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:25.871661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:25.871734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:25.872127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:25.872221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.872228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.872229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.872230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.872231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.872233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.872234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.872235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.872236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.872237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.872239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.872240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.872241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.872242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.872253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.872262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.872266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.872271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.872274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.872279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.872282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.872286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.872290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.872295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.872299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.872302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.872305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.872309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.872316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.872324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:25.872331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.872337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:25.872341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.872346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:25.872350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.872355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:25.872360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.872366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:25.872377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.872382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:25.872388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.872394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:25.872398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.872404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:25.872408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.872413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:25.872419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.872424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.872429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.872434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.872439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.872444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.872451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.872457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:25.872467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.872472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:25.872511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:25.877617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:25.878256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:25.878274Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:25.878278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:25.878282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:25.878290Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 533 [2:7556254957621736122:5286]
2025-10-01T14:08:25.878311Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:25.878705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 533
2025-10-01T14:08:25.878328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:25.878340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.878344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.878347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.878365Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:25.878383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:25.878390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:25.878450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.878452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.878454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.878460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:25.878462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:25.878536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:25.878539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.878553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:25.878564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:25.878579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:25.878598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599339:2446], now have 1 active actors on pipe
2025-10-01T14:08:25.878602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599445:5906], now have 1 active actors on pipe
2025-10-01T14:08:25.878610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254957621736117:5286]
2025-10-01T14:08:25.878612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254957621736117:5286]
2025-10-01T14:08:25.878614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254957621736117:5286]
2025-10-01T14:08:25.878633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:25.878648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:25.878663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:25.878666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:25.878704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254957621736117:5286]
2025-10-01T14:08:25.878706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:25.878768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:25.878772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:25.878774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:25.878782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:25.878879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.878886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.878913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:25.878920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:25.878924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:25.878927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:25.878937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:25.878947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:25.878972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.878749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 533
2025-10-01T14:08:25.879955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.879969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.879990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:25.880078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 534 partition: 0 MaxSeqNo: 45 sessionId: src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0
2025-10-01T14:08:25.880461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|974cfdfe-ad7cdb75-26fcbf07-90e3bbce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:25.882952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0] Write session: try to update token
2025-10-01T14:08:25.882972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:25.898050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 534 sessionId: src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:25.900386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:25.900521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:25.900545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:25.900548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:25.900552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:25.900563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254957621736117:5286]
2025-10-01T14:08:25.900567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254957621736117:5286]
2025-10-01T14:08:25.900572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254957621736117:5286]
2025-10-01T14:08:25.900613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:25.900627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:25.900631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:25.900631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:25.900641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:25.900662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:25.900673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:25.900675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:25.900827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:25.954875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254959998599457:5713]
2025-10-01T14:08:25.955182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 533, pipe: [1:7556254959998599457:5713]
2025-10-01T14:08:26.062283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:26.062708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254959998599457:5713], now have 1 active actors on pipe
2025-10-01T14:08:26.062925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:26.062956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:26.062974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254959998599457:5713]
2025-10-01T14:08:26.062999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:26.063002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:26.063074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 534 reason: error at write: Disconnected sessionId: src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0
2025-10-01T14:08:26.063277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 534 sessionId: src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0 is DEAD
2025-10-01T14:08:26.063414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:26.063423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0] Write session will restart in 0.007906s
2025-10-01T14:08:26.063446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0] Write session: Do CDS request
2025-10-01T14:08:26.063453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:26.072948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.073047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:26.073063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 535
2025-10-01T14:08:26.073185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.073241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:26.073250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:26.073254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:26.073698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 535 sessionId:  describe result for acl check
2025-10-01T14:08:26.073745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:26.073751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:26.073757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:26.073762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254964293566825:5910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:26.074271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:26.074447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254964293566825:5910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:26.076635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254964293566825:5910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:26.077907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:26.078131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:26.078146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:26.078158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:26.078221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:26.078263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254961916703529:5288]
2025-10-01T14:08:26.078839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:26.078998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254964293566825:5910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:26.079009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254964293566825:5910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:26.079011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254964293566825:5910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:26.079017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:26.079150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:26.079200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:26.079473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:26.079533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.079539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.079540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.079541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.079542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.079543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.079544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.079545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.079546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.079547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.079549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.079550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.079551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.079552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.079558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.079568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.079572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.079575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.079579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.079583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.079586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.079590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.079593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.079597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.079601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.079604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.079608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.079611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.079618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.079625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.079630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.079635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.079637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.079640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.079642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.079645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.079648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.079651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.079654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.079656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.079658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.079673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.079681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.079685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.079688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.079692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.079696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.079701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.079706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.079712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.079732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.079740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.079744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.079749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.079757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.079761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.079802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:26.084976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:26.085603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:26.085622Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:26.085624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:26.085628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:26.085635Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 534 [2:7556254961916703529:5288]
2025-10-01T14:08:26.085652Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:26.085668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:26.085671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.085675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.085678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.085694Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:26.085704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:26.085711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:26.085773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.085781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.085783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.085788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:26.085791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:26.085871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:26.085880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.085893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.085901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.085914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:26.085932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293566864:5910], now have 1 active actors on pipe
2025-10-01T14:08:26.085940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293566755:2446], now have 1 active actors on pipe
2025-10-01T14:08:26.085947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254961916703523:5288]
2025-10-01T14:08:26.085949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254961916703523:5288]
2025-10-01T14:08:26.085951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254961916703523:5288]
2025-10-01T14:08:26.085967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:26.085982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:26.085984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:26.085990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:26.085992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:26.085997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:26.086000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:26.086035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254961916703523:5288]
2025-10-01T14:08:26.086048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:26.086061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:26.086040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 534
2025-10-01T14:08:26.086113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 534
2025-10-01T14:08:26.086159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.086170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.086193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:26.086204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.086212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.086214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:26.086223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.086238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:26.086256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.086465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.086477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.086495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.086589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 535 partition: 0 MaxSeqNo: 45 sessionId: src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0
2025-10-01T14:08:26.086953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f5e7fc-5a4aa873-118e7b3e-98757846_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:26.093780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0] Write session: try to update token
2025-10-01T14:08:26.093807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:26.101265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:26.101338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:26.101358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254961916703523:5288]
2025-10-01T14:08:26.101411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:26.101417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:26.101613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:26.101782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:26.101974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:26.102173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:26.102419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:26.102465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:26.114386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 535 sessionId: src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:26.116825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:26.117034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.117057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.117096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:26.117198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:26.127489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:26.127512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:26.127514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:26.127515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:26.127525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254961916703523:5288]
2025-10-01T14:08:26.127529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254961916703523:5288]
2025-10-01T14:08:26.127532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254961916703523:5288]
2025-10-01T14:08:26.127583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:26.127590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.127592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:26.127595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:26.127601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:26.127604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:26.127790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:26.163255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254964293566896:5713]
2025-10-01T14:08:26.163537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 534, pipe: [1:7556254964293566896:5713]
2025-10-01T14:08:26.282289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:26.291415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.291444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.291626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.291690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.291755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.291821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.291869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.291875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.291951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.292014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.292076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.292138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.292182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.292185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.292258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.292319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.292382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.292448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.292492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.292494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.292565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.292649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.292715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.292781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.292859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.292863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.292935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.292991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.293051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.293113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.293157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.293160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.293232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.293292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.293358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.293465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.293508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.293511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.293587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.293646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.293709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.293774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.293816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.293819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.293889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.293949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.294008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.294066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.294106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.294109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.294182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.294241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.294302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.294618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.294674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.294677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.294744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:26.294802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:26.294859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:26.294923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:26.294968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:26.294972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:26.295047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293566896:5713], now have 1 active actors on pipe
2025-10-01T14:08:26.296529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:26.296538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254964293566896:5713]
2025-10-01T14:08:26.296568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:26.296571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:26.296600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 535 reason: error at write: Disconnected sessionId: src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0
2025-10-01T14:08:26.296853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 535 sessionId: src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0 is DEAD
2025-10-01T14:08:26.296652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:26.298566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:26.298577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0] Write session will restart in 0.009287s
2025-10-01T14:08:26.298603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0] Write session: Do CDS request
2025-10-01T14:08:26.298612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:26.306785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:26.308776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.309218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:26.309232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 536
2025-10-01T14:08:26.309343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.309366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:26.309371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:26.309375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:26.309796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 536 sessionId:  describe result for acl check
2025-10-01T14:08:26.309833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:26.309840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:26.309842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:26.309847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254964293566993:5923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:26.308964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:26.309226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:26.309231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:26.309244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:26.309301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:26.309336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254961916703661:5293]
2025-10-01T14:08:26.309908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:26.310351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254964293566993:5923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:26.310288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:26.310332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:26.310634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:26.310686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.310687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.310688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.310689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.310691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.310692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.310693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.310694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.310695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.310696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.310697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.310698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.310699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.310700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.310706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.310715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.310719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.310723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.310727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.310730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.310734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.310737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.310741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.310745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.310748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.310751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.310754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.310757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.310762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.310768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.310774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.310779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.310785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.310790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.310794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.310799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.310803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.310809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.310813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.310817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.310822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.310827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.310830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.310835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.310840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.310845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.310849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.310853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.310858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.310863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.310866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.310871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.310876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.310881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.310885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.310889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.310926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:26.312920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254964293566993:5923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:26.315350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254964293566993:5923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:26.315362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254964293566993:5923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:26.315365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254964293566993:5923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:26.315373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:26.315597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:26.316257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:26.316275Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:26.316278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:26.316282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:26.316291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 535 [2:7556254961916703661:5293]
2025-10-01T14:08:26.316306Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:26.316328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:26.316331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.316334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.316336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.316352Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:26.316358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:26.316363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:26.316415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.316418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.316420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.316423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:26.316426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:26.316492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:26.316494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.316503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.316511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.316526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:26.316542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254961916703655:5293]
2025-10-01T14:08:26.316545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254961916703655:5293]
2025-10-01T14:08:26.316547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254961916703655:5293]
2025-10-01T14:08:26.316675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 535
2025-10-01T14:08:26.316695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 535
2025-10-01T14:08:26.316555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:26.316579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:26.316592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:26.316595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:26.316597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:26.316600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:26.316602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:26.316623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254961916703655:5293]
2025-10-01T14:08:26.316626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:26.316631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:26.316644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567031:5923], now have 1 active actors on pipe
2025-10-01T14:08:26.316647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293566919:2446], now have 1 active actors on pipe
2025-10-01T14:08:26.316881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.316895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.316924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:26.316932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.316936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.316938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:26.316948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.316957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:26.316972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.317205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.317214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.317231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.317317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 536 partition: 0 MaxSeqNo: 45 sessionId: src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0
2025-10-01T14:08:26.317711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c72fc8c-ceca74cf-5eaeef34-e903dd58_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:26.320100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0] Write session: try to update token
2025-10-01T14:08:26.320117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:26.337106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 536 sessionId: src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:26.339711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:26.340142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:26.340167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:26.340170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:26.340172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:26.340182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254961916703655:5293]
2025-10-01T14:08:26.340187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254961916703655:5293]
2025-10-01T14:08:26.340190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254961916703655:5293]
2025-10-01T14:08:26.340241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:26.340256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.340262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:26.340261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:26.340267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:26.340271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:26.340409Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:26.396715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254964293567038:5713]
2025-10-01T14:08:26.397391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 535, pipe: [1:7556254964293567038:5713]
2025-10-01T14:08:26.498815Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:26.499115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.499132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.499178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567038:5713], now have 1 active actors on pipe
2025-10-01T14:08:26.499818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:26.499872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254964293567038:5713]
2025-10-01T14:08:26.499891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:26.499893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:26.499946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 536 reason: error at write: Disconnected sessionId: src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0
2025-10-01T14:08:26.500130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 536 sessionId: src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0 is DEAD
2025-10-01T14:08:26.500535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:26.500546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0] Write session will restart in 0.008424s
2025-10-01T14:08:26.500571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0] Write session: Do CDS request
2025-10-01T14:08:26.500578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:26.500634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:26.511205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.511294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:26.511310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 537
2025-10-01T14:08:26.511588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.511623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:26.511629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:26.511632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:26.512013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 537 sessionId:  describe result for acl check
2025-10-01T14:08:26.512040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:26.512042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:26.512044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:26.512049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254964293567068:5927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:26.512593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254964293567068:5927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:26.516701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254964293567068:5927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:26.521098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254964293567068:5927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:26.521115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254964293567068:5927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:26.521119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254964293567068:5927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:26.521128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:26.527310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:26.529784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:26.530033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:26.530038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:26.530050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:26.530101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:26.530139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254961916703807:5306]
2025-10-01T14:08:26.530788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:26.531160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:26.531220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:26.531529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:26.531579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.531580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.531581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.531583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.531584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.531585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.531586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.531588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.531589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.531590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.531592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.531593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.531594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.531595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.531601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.531610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.531614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.531619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.531622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.531626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.531630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.531634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.531638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.531642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.531645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.531648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.531651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.531653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.531660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.531667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.531673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.531678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.531683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.531687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.531692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.531696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.531701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.531707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.531711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.531716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.531721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.531727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.531731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.531736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.531739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.531744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.531747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.531751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.531755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.531762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.531767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.531772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.531776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.531781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.531785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.531790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.531826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:26.535975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:26.536582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:26.536587Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:26.536590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:26.536595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:26.536602Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 536 [2:7556254961916703807:5306]
2025-10-01T14:08:26.536619Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:26.536637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:26.536640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.536644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.536647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.536664Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:26.536670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:26.536676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:26.536741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.536742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.536745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.536748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:26.536751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:26.536863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:26.536866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.536879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.536891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.536906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:26.536926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567148:5927], now have 1 active actors on pipe
2025-10-01T14:08:26.536930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567044:2446], now have 1 active actors on pipe
2025-10-01T14:08:26.536937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254961916703802:5306]
2025-10-01T14:08:26.536939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254961916703802:5306]
2025-10-01T14:08:26.536942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254961916703802:5306]
2025-10-01T14:08:26.536956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:26.536971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:26.536974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:26.536978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:26.536980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:26.536986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:26.536989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:26.537028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254961916703802:5306]
2025-10-01T14:08:26.537035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:26.537045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:26.537379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 536
2025-10-01T14:08:26.537419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 536
2025-10-01T14:08:26.537740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.537754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.537786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd652628-740583aa-44f508d8-cef8872a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:26.537795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.537799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.537801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:26.537813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.537824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:26.537842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.538069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.538077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.538093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.538200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 537 partition: 0 MaxSeqNo: 45 sessionId: src_id|bd652628-740583aa-44f508d8-cef8872a_0
2025-10-01T14:08:26.540405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d62f021-639bc7dc-e1e32ff2-bed64df0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bd652628-740583aa-44f508d8-cef8872a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:26.543241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd652628-740583aa-44f508d8-cef8872a_0] Write session: try to update token
2025-10-01T14:08:26.543261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd652628-740583aa-44f508d8-cef8872a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:26.567917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 537 sessionId: src_id|bd652628-740583aa-44f508d8-cef8872a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:26.569850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:26.569877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:26.569879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:26.569882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:26.569894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254961916703802:5306]
2025-10-01T14:08:26.569901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254961916703802:5306]
2025-10-01T14:08:26.569907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254961916703802:5306]
2025-10-01T14:08:26.569961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:26.569972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.569975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:26.569978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:26.569985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:26.569989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:26.570107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:26.570456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:26.599996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254964293567161:5713]
2025-10-01T14:08:26.600778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 536, pipe: [1:7556254964293567161:5713]
2025-10-01T14:08:26.724186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:26.724590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.724608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.724652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567161:5713], now have 1 active actors on pipe
2025-10-01T14:08:26.724982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:26.726990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:26.727072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 537 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd652628-740583aa-44f508d8-cef8872a_0
2025-10-01T14:08:26.727261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 537 sessionId: src_id|bd652628-740583aa-44f508d8-cef8872a_0 is DEAD
2025-10-01T14:08:26.727402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd652628-740583aa-44f508d8-cef8872a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:26.727410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd652628-740583aa-44f508d8-cef8872a_0] Write session will restart in 0.006586s
2025-10-01T14:08:26.727437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd652628-740583aa-44f508d8-cef8872a_0] Write session: Do CDS request
2025-10-01T14:08:26.727443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd652628-740583aa-44f508d8-cef8872a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:26.727396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:26.727434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254964293567161:5713]
2025-10-01T14:08:26.735925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd652628-740583aa-44f508d8-cef8872a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.736224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:26.736239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 538
2025-10-01T14:08:26.736348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.736374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:26.736381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:26.736384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:26.736754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 538 sessionId:  describe result for acl check
2025-10-01T14:08:26.736800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:26.736807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:26.736809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:26.736814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254964293567238:5932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:26.737258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254964293567238:5932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:26.739071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254964293567238:5932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:26.740691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:26.743618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254964293567238:5932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:26.743632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254964293567238:5932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:26.743635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254964293567238:5932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:26.743643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:26.747368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:26.747599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:26.747610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:26.747622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:26.747677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:26.747708Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254961916703923:5309]
2025-10-01T14:08:26.748206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:26.750709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:26.750775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:26.751106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:26.751156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.751157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.751159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.751160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.751161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.751163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.751165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.751166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.751167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.751168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.751170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.751171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.751172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.751173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.751180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.751190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.751194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.751198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.751201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.751205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.751209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.751213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.751216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.751220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.751224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.751228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.751232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.751235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.751244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.751251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.751257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.751263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.751267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.751272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.751276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.751281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.751286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.751291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.751295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.751300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.751305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.751311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.751315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.751320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.751325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.751330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.751334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.751339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.751343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.751348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.751352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.751356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.751358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.751362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.751365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.751368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.751390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:26.758956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:26.759575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:26.759597Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:26.759600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:26.759603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:26.759611Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 537 [2:7556254961916703923:5309]
2025-10-01T14:08:26.759629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:26.759654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:26.759657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.759661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.759664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.759681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:26.759687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:26.759692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:26.759751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.759754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.759756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.759759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:26.759762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:26.759836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:26.759838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.759850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.759861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.759876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:26.759893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254961916703916:5309]
2025-10-01T14:08:26.759896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254961916703916:5309]
2025-10-01T14:08:26.759898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254961916703916:5309]
2025-10-01T14:08:26.759911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:26.759927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:26.759941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:26.759944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:26.759982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254961916703916:5309]
2025-10-01T14:08:26.759985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:26.760250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:26.760263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:26.760265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:26.760270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:26.760502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567275:5932], now have 1 active actors on pipe
2025-10-01T14:08:26.760511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567166:2446], now have 1 active actors on pipe
2025-10-01T14:08:26.760902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 537
2025-10-01T14:08:26.760954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 537
2025-10-01T14:08:26.761115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.761124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.761155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:26.761163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.761169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.761170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:26.761179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.761188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:26.761203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.761668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.761676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.761692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.762331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd652628-740583aa-44f508d8-cef8872a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:26.761815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 538 partition: 0 MaxSeqNo: 45 sessionId: src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0
2025-10-01T14:08:26.764901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0] Write session: try to update token
2025-10-01T14:08:26.764933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:26.787916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:26.787940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:26.787942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:26.787945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:26.787955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254961916703916:5309]
2025-10-01T14:08:26.787960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254961916703916:5309]
2025-10-01T14:08:26.787964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254961916703916:5309]
2025-10-01T14:08:26.788012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:26.788019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.788022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:26.788165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:26.789219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:26.789236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:26.789240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:26.787306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 538 sessionId: src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:26.789773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:26.827825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254964293567288:5713]
2025-10-01T14:08:26.828401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 537, pipe: [1:7556254964293567288:5713]
2025-10-01T14:08:26.943697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:26.944012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.944032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.944075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567288:5713], now have 1 active actors on pipe
2025-10-01T14:08:26.944330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:26.946263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:26.946276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:26.946340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 538 reason: error at write: Disconnected sessionId: src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0
2025-10-01T14:08:26.946638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:26.946647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0] Write session will restart in 0.006566s
2025-10-01T14:08:26.946672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0] Write session: Do CDS request
2025-10-01T14:08:26.946677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:26.946529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 538 sessionId: src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0 is DEAD
2025-10-01T14:08:26.946694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:26.946734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254964293567288:5713]
2025-10-01T14:08:26.954837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.954952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:26.954970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 539
2025-10-01T14:08:26.955211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:26.955253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:26.955262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:26.955266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:26.955681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 539 sessionId:  describe result for acl check
2025-10-01T14:08:26.955711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:26.955718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:26.955720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:26.955725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254964293567344:5936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:26.956227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254964293567344:5936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:26.958214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254964293567344:5936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:26.961171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254964293567344:5936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:26.961187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254964293567344:5936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:26.961190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254964293567344:5936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:26.961199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:26.962671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:26.966560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:26.966838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:26.966842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:26.966853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:26.966909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:26.966948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254961916704040:5311]
2025-10-01T14:08:26.967568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:26.968109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:26.968162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:26.968479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:26.968532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.968533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.968535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.968536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.968537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.968538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.968540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.968541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.968542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.968544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.968545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.968546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.968547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.968548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.968554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.968564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.968568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.968572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.968576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.968580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.968584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.968588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.968591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.968596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.968599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.968603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.968607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.968611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.968618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.968626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:26.968633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.968639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:26.968645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.968649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:26.968653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.968659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:26.968667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.968673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:26.968676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.968682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:26.968686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.968691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:26.968696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.968701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:26.968705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.968710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:26.968714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.968720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.968724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.968729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.968733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.968738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.968742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.968747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:26.968751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.968755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:26.968808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:26.974807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 538
2025-10-01T14:08:26.974844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 538
2025-10-01T14:08:26.975583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c83af98-f8a5c09d-a9e639bf-bceac420_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|65437025-f53bf546-1985bbb4-12999227_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:26.978090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65437025-f53bf546-1985bbb4-12999227_0] Write session: try to update token
2025-10-01T14:08:26.978108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65437025-f53bf546-1985bbb4-12999227_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:26.973277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:26.974061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:26.974067Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:26.974070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:26.974074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:26.974081Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 538 [2:7556254961916704040:5311]
2025-10-01T14:08:26.974110Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:26.974127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:26.974130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.974134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.974136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.974154Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:26.974159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:26.974165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:26.974232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.974234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.974237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.974241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:26.974244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:26.974313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:26.974315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:26.974327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:26.974338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:26.974356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:26.974394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254961916704034:5311]
2025-10-01T14:08:26.974396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254961916704034:5311]
2025-10-01T14:08:26.974398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254961916704034:5311]
2025-10-01T14:08:26.974413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:26.974430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:26.974446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:26.974449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:26.974458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:26.974462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:26.974465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:26.974483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254961916704034:5311]
2025-10-01T14:08:26.974486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:26.974542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:26.974604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567401:5936], now have 1 active actors on pipe
2025-10-01T14:08:26.974675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254964293567291:2446], now have 1 active actors on pipe
2025-10-01T14:08:26.974871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.974877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.974902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65437025-f53bf546-1985bbb4-12999227_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:26.974911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:26.974918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:26.974920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:26.974931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:26.974943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:26.974965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.975090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.975093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.975107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:26.975214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 539 partition: 0 MaxSeqNo: 45 sessionId: src_id|65437025-f53bf546-1985bbb4-12999227_0
2025-10-01T14:08:26.994521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 539 sessionId: src_id|65437025-f53bf546-1985bbb4-12999227_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:26.997042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:26.997305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:26.997333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:26.997372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:26.997507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:27.005430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:27.005457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:27.005460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:27.005462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:27.005510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254961916704034:5311]
2025-10-01T14:08:27.005515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254961916704034:5311]
2025-10-01T14:08:27.005518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254961916704034:5311]
2025-10-01T14:08:27.005566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:27.005580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:27.005583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:27.005585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:27.005593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.005595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:27.005732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:27.046463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254968588534715:5713]
2025-10-01T14:08:27.046742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 538, pipe: [1:7556254968588534715:5713]
2025-10-01T14:08:27.159655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:27.167382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.167410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.167560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.167620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.167680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.167747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.167794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.167798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.167871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.167933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.167995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.168054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.168094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.168097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.168157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.168206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.168258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.168334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.168371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.168374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.168466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.168519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.168595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.168650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.168686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.168689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.168747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.168811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.168886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.168949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.168988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.168991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.169052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.169104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.169163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.169222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.169264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.169266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.169331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.169382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.169441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.169494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.169555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.169558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.169618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.169667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.169719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.169773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.169812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.169816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.169883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.169940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.170000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.170055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.170094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.170100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.170165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:27.170219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:27.170280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:27.170340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:27.170419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:27.170421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:27.170510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588534715:5713], now have 1 active actors on pipe
2025-10-01T14:08:27.172206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254968588534715:5713]
2025-10-01T14:08:27.172239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:27.172241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:27.172264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 539 reason: error at write: Disconnected sessionId: src_id|65437025-f53bf546-1985bbb4-12999227_0
2025-10-01T14:08:27.172455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 539 sessionId: src_id|65437025-f53bf546-1985bbb4-12999227_0 is DEAD
2025-10-01T14:08:27.172574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:27.172925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:27.174293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65437025-f53bf546-1985bbb4-12999227_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:27.174305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65437025-f53bf546-1985bbb4-12999227_0] Write session will restart in 0.006602s
2025-10-01T14:08:27.174330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65437025-f53bf546-1985bbb4-12999227_0] Write session: Do CDS request
2025-10-01T14:08:27.174336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65437025-f53bf546-1985bbb4-12999227_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:27.182920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65437025-f53bf546-1985bbb4-12999227_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:27.183908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:27.183928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 540
2025-10-01T14:08:27.184097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:27.184128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:27.184133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:27.184138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:27.184726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 540 sessionId:  describe result for acl check
2025-10-01T14:08:27.184760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:27.184762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:27.184763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:27.184768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254968588534765:5950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:27.185293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254968588534765:5950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:27.187290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254968588534765:5950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:27.188619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:27.190943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:27.191157Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:27.191161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:27.191172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:27.191219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:27.191252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254966211671455:5313]
2025-10-01T14:08:27.191839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:27.192160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:27.192222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:27.192619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:27.192685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.192686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.192688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.192689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.192690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.192692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.192693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.192694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.192695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.192696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.192697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.192698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.192699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.192700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.192706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.192714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.192718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.192721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.192726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.192730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.192734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.192738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.192742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.192746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.192750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.192754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.192758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.192762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.192769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.192777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.192799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.192804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.192809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.192815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.192819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.192824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.192829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.192834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.192839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.192844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.192849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.192855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.192859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.192863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.192868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.192873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.192876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.192881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.192885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.192892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.192896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.192903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.192908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.192913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.192918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.192922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.192965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:27.193422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254968588534765:5950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:27.193438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254968588534765:5950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:27.193441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254968588534765:5950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:27.193448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:27.200048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:27.200756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:27.200762Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:27.200764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:27.200768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:27.200775Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 539 [2:7556254966211671455:5313]
2025-10-01T14:08:27.200807Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:27.200823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:27.200827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.200831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.200834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.200851Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:27.200857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:27.200863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:27.200924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.200927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.200928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.200931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:27.200934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:27.201105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:27.201108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.201122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.201135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.201155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:27.201179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254966211671446:5313]
2025-10-01T14:08:27.201182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254966211671446:5313]
2025-10-01T14:08:27.201185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254966211671446:5313]
2025-10-01T14:08:27.201194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:27.201210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:27.201225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:27.201228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:27.201265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254966211671446:5313]
2025-10-01T14:08:27.201267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:27.202196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 539
2025-10-01T14:08:27.202224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 539
2025-10-01T14:08:27.201630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:27.201642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:27.201644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:27.201649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:27.206736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588534849:5950], now have 1 active actors on pipe
2025-10-01T14:08:27.206754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588534731:2446], now have 1 active actors on pipe
2025-10-01T14:08:27.206773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.206779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.206814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:27.206824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.206829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.206832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:27.206844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.206863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:27.206885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:27.213149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.213175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.213223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:27.213622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 540 partition: 0 MaxSeqNo: 45 sessionId: src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0
2025-10-01T14:08:27.214775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65437025-f53bf546-1985bbb4-12999227_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:27.217312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0] Write session: try to update token
2025-10-01T14:08:27.217331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:27.229902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:27.229932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:27.229935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:27.229937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:27.229947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254966211671446:5313]
2025-10-01T14:08:27.229952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254966211671446:5313]
2025-10-01T14:08:27.229955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254966211671446:5313]
2025-10-01T14:08:27.230007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:27.230018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.230021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:27.230148Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:27.230321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:27.230326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:27.230330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:27.239339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 540 sessionId: src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:27.241929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:27.272213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254968588534871:5713]
2025-10-01T14:08:27.272636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 539, pipe: [1:7556254968588534871:5713]
2025-10-01T14:08:27.395598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:27.395970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.395983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.396006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588534871:5713], now have 1 active actors on pipe
2025-10-01T14:08:27.396332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:27.397244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:27.397247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254968588534871:5713]
2025-10-01T14:08:27.397266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:27.397334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 540 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0
2025-10-01T14:08:27.398063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 540 sessionId: src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0 is DEAD
2025-10-01T14:08:27.398465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:27.398478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0] Write session will restart in 0.009672s
2025-10-01T14:08:27.398508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0] Write session: Do CDS request
2025-10-01T14:08:27.398515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:27.410122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:27.410215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:27.410230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 541
2025-10-01T14:08:27.410447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:27.410479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:27.410489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:27.410493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:27.411319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 541 sessionId:  describe result for acl check
2025-10-01T14:08:27.411359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:27.411361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:27.411364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:27.411369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254968588534961:5957] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:27.411865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254968588534961:5957] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:27.412666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:27.415418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254968588534961:5957] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:27.419059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254968588534961:5957] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:27.419075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254968588534961:5957] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:27.419078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254968588534961:5957] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:27.419086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:27.418338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:27.418591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:27.418595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:27.418607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:27.418663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:27.418699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254966211671590:5319]
2025-10-01T14:08:27.419248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:27.419555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:27.419598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:27.419893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:27.419943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.419943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.419944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.419945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.419946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.419947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.419948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.419950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.419951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.419952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.419952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.419953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.419954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.419956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.419961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.419969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.419973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.419977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.419980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.419984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.419987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.419990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.419993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.419997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.420000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.420004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.420007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.420011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.420017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.420024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.420030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.420035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.420039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.420044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.420048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.420053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.420057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.420062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.420066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.420070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.420075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.420080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.420084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.420089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.420093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.420098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.420103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.420108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.420113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.420117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.420121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.420128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.420134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.420138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.420142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.420147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.420184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:27.424483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:27.425449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 540
2025-10-01T14:08:27.425475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 540
2025-10-01T14:08:27.425077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:27.425090Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:27.425092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:27.425095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:27.425101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 540 [2:7556254966211671590:5319]
2025-10-01T14:08:27.425113Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:27.425126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:27.425128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.425131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.425132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.425144Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:27.425148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:27.425152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:27.425197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.425199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.425200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.425202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:27.425205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:27.425268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:27.425271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.425280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.425289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.425302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:27.425318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254966211671585:5319]
2025-10-01T14:08:27.425320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254966211671585:5319]
2025-10-01T14:08:27.425323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254966211671585:5319]
2025-10-01T14:08:27.425331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:27.425339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:27.425341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:27.425343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:27.425343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:27.425355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:27.425358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:27.425367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588534998:5957], now have 1 active actors on pipe
2025-10-01T14:08:27.425370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588534888:2446], now have 1 active actors on pipe
2025-10-01T14:08:27.425399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254966211671585:5319]
2025-10-01T14:08:27.425405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:27.425459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:27.425732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.425739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.425761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:27.425766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.425770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.425771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:27.425779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.425786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:27.425797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:27.426028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.426033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.426044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:27.426536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49b0f085-ef4d779f-ab482082-f6a77d1e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:27.428960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0] Write session: try to update token
2025-10-01T14:08:27.428977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:27.426148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 541 partition: 0 MaxSeqNo: 45 sessionId: src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0
2025-10-01T14:08:27.454505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:27.454524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:27.454526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:27.454528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:27.454537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254966211671585:5319]
2025-10-01T14:08:27.454542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254966211671585:5319]
2025-10-01T14:08:27.454546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254966211671585:5319]
2025-10-01T14:08:27.454592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:27.454599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.454602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:27.454737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:27.455406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:27.455416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:27.455419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:27.455524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 541 sessionId: src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:27.458125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:27.497497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254968588535010:5713]
2025-10-01T14:08:27.502802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 540, pipe: [1:7556254968588535010:5713]
2025-10-01T14:08:27.616980Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:27.617203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.617211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.617245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588535010:5713], now have 1 active actors on pipe
2025-10-01T14:08:27.619052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:27.619135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 541 reason: status is not ok: tablet will be restarted right now sessionId: src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0
2025-10-01T14:08:27.619233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:27.619276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254968588535010:5713]
2025-10-01T14:08:27.619306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 541 sessionId: src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0 is DEAD
2025-10-01T14:08:27.619666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:27.619678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0] Write session will restart in 0.006144s
2025-10-01T14:08:27.619710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0] Write session: Do CDS request
2025-10-01T14:08:27.619716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:27.618628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:27.632631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:27.634762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:27.634781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 542
2025-10-01T14:08:27.641933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:27.641991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:27.641997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:27.642002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:27.642712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 542 sessionId:  describe result for acl check
2025-10-01T14:08:27.642755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:27.642757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:27.642759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:27.642765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254968588535026:5962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:27.643284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254968588535026:5962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:27.650325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254968588535026:5962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:27.655010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254968588535026:5962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:27.655029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254968588535026:5962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:27.655032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254968588535026:5962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:27.655041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:27.658898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:27.661292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:27.661561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:27.661565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:27.661578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:27.661644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:27.661683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254966211671740:5331]
2025-10-01T14:08:27.662465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:27.663112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:27.663169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:27.663480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:27.663541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.663542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.663543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.663544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.663545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.663547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.663548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.663549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.663551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.663552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.663554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.663555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.663556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.663557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.663563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.663574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.663578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.663582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.663586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.663590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.663593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.663597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.663601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.663605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.663609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.663613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.663617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.663622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.663629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.663638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.663645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.663650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.663655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.663660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.663665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.663670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.663675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.663679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.663683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.663688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.663693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.663701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.663705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.663710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.663715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.663720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.663723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.663728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.663733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.663738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.663743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.663748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.663753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.663758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.663762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.663767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.663806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:27.668113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:27.668779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:27.668798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:27.668801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:27.668805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:27.668812Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 541 [2:7556254966211671740:5331]
2025-10-01T14:08:27.668829Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:27.668850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:27.668853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.668858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.668860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.668876Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:27.668882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:27.668888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:27.668949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.668951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.668953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.668956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:27.668959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:27.669032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:27.669035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.669048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.669057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.669071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:27.669089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254966211671735:5331]
2025-10-01T14:08:27.669092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254966211671735:5331]
2025-10-01T14:08:27.669094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254966211671735:5331]
2025-10-01T14:08:27.669107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:27.669122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:27.669138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:27.669141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:27.669177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254966211671735:5331]
2025-10-01T14:08:27.669182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:27.669390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:27.669399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:27.669401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:27.669406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:27.670602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 541
2025-10-01T14:08:27.670636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 541
2025-10-01T14:08:27.673792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588535107:5962], now have 1 active actors on pipe
2025-10-01T14:08:27.673808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588535013:2446], now have 1 active actors on pipe
2025-10-01T14:08:27.673827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.673835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.673875Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:27.673886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.673892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.673895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:27.673908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.673925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:27.673947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:27.676554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.676577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.676616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:27.678627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 542 partition: 0 MaxSeqNo: 45 sessionId: src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0
2025-10-01T14:08:27.679678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87f575ab-1f1df9bb-f3c304bf-f08ba7db_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:27.682244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0] Write session: try to update token
2025-10-01T14:08:27.682264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:27.698711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:27.698732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:27.698735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:27.698738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:27.698748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254966211671735:5331]
2025-10-01T14:08:27.698753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254966211671735:5331]
2025-10-01T14:08:27.698756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254966211671735:5331]
2025-10-01T14:08:27.698805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:27.698812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.698815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:27.698994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:27.703165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:27.703186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:27.703191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:27.711715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 542 sessionId: src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:27.714321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:27.719723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254968588535140:5713]
2025-10-01T14:08:27.723138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 541, pipe: [1:7556254968588535140:5713]
2025-10-01T14:08:27.881164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:27.881574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.881589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.881611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588535140:5713], now have 1 active actors on pipe
2025-10-01T14:08:27.882030Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:27.882675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254968588535140:5713]
2025-10-01T14:08:27.882695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:27.882743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 542 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0
2025-10-01T14:08:27.882895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 542 sessionId: src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0 is DEAD
2025-10-01T14:08:27.882984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:27.883193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:27.883199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0] Write session will restart in 0.008362s
2025-10-01T14:08:27.883217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0] Write session: Do CDS request
2025-10-01T14:08:27.883224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:27.893782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:27.894274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:27.894290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 543
2025-10-01T14:08:27.894598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:27.894630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:27.894636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:27.894639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:27.899075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 543 sessionId:  describe result for acl check
2025-10-01T14:08:27.899117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:27.899119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:27.899125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:27.899131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254968588535151:5966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:27.899676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254968588535151:5966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:27.906419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254968588535151:5966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:27.915339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254968588535151:5966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:27.915355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254968588535151:5966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:27.915358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254968588535151:5966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:27.915367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:27.928104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:27.932934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:27.933199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:27.933203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:27.933217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:27.933273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:27.933315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254966211671861:5334]
2025-10-01T14:08:27.933898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:27.937283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:27.937364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:27.937725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:27.937800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.937809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.937811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.937812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.937813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.937815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.937816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.937818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.937819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.937820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.937822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.937823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.937825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.937826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.937833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.937847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.937851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.937854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.937858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.937862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.937866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.937869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.937873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.937879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.937882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.937886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.937889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.937893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.937901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.937909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:27.937918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.937923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:27.937928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.937933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:27.937936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.937942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:27.937965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.937976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:27.937980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.937985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:27.937990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.937996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:27.938000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.938004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:27.938009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.938013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:27.938018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.938022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.938027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.938031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.938037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.938043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.938047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.938052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:27.938056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.938060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:27.938097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:27.942761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:27.943478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:27.943496Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:27.943500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:27.943504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:27.943511Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 542 [2:7556254966211671861:5334]
2025-10-01T14:08:27.943529Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:27.943551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:27.943553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.943557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.943560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.943577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:27.943582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:27.943588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:27.943650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.943653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.943655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.943658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:27.943660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:27.943732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:27.943739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:27.943754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:27.943765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:27.943781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:27.943806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254966211671855:5334]
2025-10-01T14:08:27.943813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254966211671855:5334]
2025-10-01T14:08:27.943815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254966211671855:5334]
2025-10-01T14:08:27.943830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:27.943850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:27.943868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:27.943877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:27.943916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254966211671855:5334]
2025-10-01T14:08:27.943923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:27.944020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:27.944027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:27.944029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:27.944034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:27.944294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588535143:2446], now have 1 active actors on pipe
2025-10-01T14:08:27.944305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588535235:5966], now have 1 active actors on pipe
2025-10-01T14:08:27.946111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 542
2025-10-01T14:08:27.946166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 542
2025-10-01T14:08:27.949374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.949400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.949442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:27.949460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:27.949466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:27.949469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:27.949485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:27.949510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:27.949535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:27.950688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.950707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.950737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:27.951787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac1493-3c2435dd-cbeb6cb-166abf73_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:27.951387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 543 partition: 0 MaxSeqNo: 45 sessionId: src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0
2025-10-01T14:08:27.954584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0] Write session: try to update token
2025-10-01T14:08:27.954603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:27.972337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:27.972364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:27.972374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254966211671855:5334]
2025-10-01T14:08:27.972430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:27.972450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:27.972643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:27.972815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:27.972964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:27.973118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:27.973317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:27.973351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:27.974786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 543 sessionId: src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:27.977243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:27.977478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:27.977503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:27.977544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:27.977652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:27.986433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254968588535270:5713]
2025-10-01T14:08:27.994972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 542, pipe: [1:7556254968588535270:5713]
2025-10-01T14:08:27.994586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254968588535270:5713], now have 1 active actors on pipe
2025-10-01T14:08:28.008915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.008955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.009162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.009250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.009318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.009383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.009425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.009431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.009501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.009563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.009629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.009692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.009733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.009736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.009804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.009861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.009939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.009999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.010050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.010062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.010124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.010189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.010249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.010311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.010353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.010356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.010436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.010491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.010557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.010620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.010749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.010758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.010824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.010888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.010953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.011020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.011065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.011073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.011139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.011199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.011305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.011375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.011413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.011415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.011479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.011534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.011591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.011656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.011701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.011708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.011773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.011830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.011893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.011958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.012004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.012007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.012068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.012121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.012178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.012233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.012271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.012274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.012346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:28.012350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:28.012353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:28.012355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:28.012365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254966211671855:5334]
2025-10-01T14:08:28.012368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254966211671855:5334]
2025-10-01T14:08:28.012372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254966211671855:5334]
2025-10-01T14:08:28.012433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:08:28.012497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.012516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.012518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:08:28.012537Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.012547Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.012550Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.012554Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.012558Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.012561Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.012565Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.012568Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.012571Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.012577Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013089Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013093Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013096Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013100Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013103Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013106Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013110Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013113Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013118Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013122Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013357Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013364Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013370Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013380Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013386Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013392Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013398Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013404Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013410Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013417Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013539Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013546Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013553Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013559Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013565Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:28.013655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:08:28.013668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:08:28.013671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:08:28.013676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:08:28.013680Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:08:28.014073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:08:28.014087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:08:28.014092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:08:28.014095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:08:28.014098Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:08:28.014101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:08:28.014649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:28.014661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:28.014664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:28.015005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:08:28.015027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:08:28.015032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:08:28.015037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:08:28.015040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:08:28.015043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:08:28.015533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:08:28.015542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.015647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327708015
2025-10-01T14:08:28.016460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:28.016468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.016470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:28.016632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:28.170242Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:28.170623Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:08:28.170657Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:08:28.170913Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:28.171364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:28.171435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254968588535270:5713]
2025-10-01T14:08:28.171461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:28.171507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 543 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0
2025-10-01T14:08:28.171760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 543 sessionId: src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0 is DEAD
2025-10-01T14:08:28.171868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:28.171878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0] Write session will restart in 0.007093s
2025-10-01T14:08:28.171912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0] Write session: Do CDS request
2025-10-01T14:08:28.171921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:28.180502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:28.180597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:28.180613Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 544
2025-10-01T14:08:28.180939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:28.180981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:28.180987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:28.180990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:28.181750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 544 sessionId:  describe result for acl check
2025-10-01T14:08:28.181796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:28.181798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:28.181800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:28.181805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254972883502601:5970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:28.182433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254972883502601:5970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:28.185494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254972883502601:5970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:28.191180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:28.191060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254972883502601:5970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:28.191076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254972883502601:5970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:28.191080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254972883502601:5970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:28.191089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:28.193171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:28.193425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:28.193436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:28.193448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:28.193509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:28.193551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254970506639279:5336]
2025-10-01T14:08:28.194118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:28.194505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:28.194574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:28.194895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:28.194974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.194981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.194982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.194983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.194984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.194986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.194987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.194988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.194989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.194991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.194992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.194993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.194994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.194996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.195002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.195011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.195015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.195019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.195022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.195026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.195029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.195033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.195036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.195046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.195067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.195071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.195078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.195082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.195093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.195100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.195110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.195116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.195124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.195129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.195137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.195142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.195151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.195156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.195164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.195168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.195173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.195178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.195182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.195190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.195194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.195203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.195207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.195216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.195220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.195229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.195234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.195240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.195244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.195253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.195257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.195266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.195305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:28.202929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:28.203597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:28.203614Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:28.203617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:28.203621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:28.203630Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 543 [2:7556254970506639279:5336]
2025-10-01T14:08:28.203648Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:28.203668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:28.203675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.203680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.203682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.203699Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:28.203707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:28.203715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:28.203781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.203789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.203791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.203794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:28.203797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:28.203867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:28.203874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.204047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.204066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.204084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:28.204104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883502687:5970], now have 1 active actors on pipe
2025-10-01T14:08:28.204107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883502569:2446], now have 1 active actors on pipe
2025-10-01T14:08:28.204115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254970506639273:5336]
2025-10-01T14:08:28.204117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254970506639273:5336]
2025-10-01T14:08:28.204119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254970506639273:5336]
2025-10-01T14:08:28.204128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:28.204144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:28.204147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:28.204150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:28.204153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:28.204157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:28.204161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:28.204182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.204186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.204232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254970506639273:5336]
2025-10-01T14:08:28.204240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:28.204250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:28.204256Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:28.204263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.204267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.204270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:28.204279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.204288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:28.204325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:28.204476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.204485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.204501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:28.205041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0203063-8d55da6a-f4d68aa2-855c3ae2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:28.204084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 543
2025-10-01T14:08:28.204076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 543
2025-10-01T14:08:28.204658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 544 partition: 0 MaxSeqNo: 45 sessionId: src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0
2025-10-01T14:08:28.207644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0] Write session: try to update token
2025-10-01T14:08:28.207661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:28.217514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:28.217533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:28.217541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254970506639273:5336]
2025-10-01T14:08:28.217580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:28.217586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:28.217770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:28.217930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:28.218089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:28.218251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:28.218618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:28.218664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:28.229752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.229775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.229811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:28.226580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 544 sessionId: src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:28.229489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:28.229961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:28.242986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:28.243010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:28.243012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:28.243014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:28.243025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254970506639273:5336]
2025-10-01T14:08:28.243029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254970506639273:5336]
2025-10-01T14:08:28.243033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254970506639273:5336]
2025-10-01T14:08:28.243080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:28.243085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:28.243092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.243093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:28.243094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:28.243098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:28.243234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:28.271672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254972883502728:5713]
2025-10-01T14:08:28.271939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 543, pipe: [1:7556254972883502728:5713]
2025-10-01T14:08:28.394915Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:28.403037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.403068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.403231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.403293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.403360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.403422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.403470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.403481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.403557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.403617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.403679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.403749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.403800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.403807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.403871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.403935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.403990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.404045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.404081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.404084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.404145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.404196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.404259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.404321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.404359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.404362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.404426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.404478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.404535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.404588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.404625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.404628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.404693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.404745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.404822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.404887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.404932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.404934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.404991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.405046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.405106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.405162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.405203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.405205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.405278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.405339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.405400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.405466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.405531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.405534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.405612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.405685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.405757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.405827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.405889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.405892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.405966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:28.406069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:28.406133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:28.406191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:28.406239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:28.406244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:28.406319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883502728:5713], now have 1 active actors on pipe
2025-10-01T14:08:28.406726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254972883502728:5713]
2025-10-01T14:08:28.406739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:28.406772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:28.406775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:28.406801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 544 reason: error at write: Disconnected sessionId: src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0
2025-10-01T14:08:28.407160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:28.407172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0] Write session will restart in 0.006769s
2025-10-01T14:08:28.407007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 544 sessionId: src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0 is DEAD
2025-10-01T14:08:28.407202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0] Write session: Do CDS request
2025-10-01T14:08:28.407237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:28.408200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:28.414901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:28.418543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:28.418560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 545
2025-10-01T14:08:28.418716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:28.418749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:28.418759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:28.418762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:28.419148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 545 sessionId:  describe result for acl check
2025-10-01T14:08:28.419201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:28.419205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:28.419208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:28.419213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254972883502820:5983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:28.419741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254972883502820:5983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:28.422012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:28.422254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254972883502820:5983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:28.424069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:28.424243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:28.424251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:28.424259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:28.424291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:28.424329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254970506639420:5342]
2025-10-01T14:08:28.424882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:28.425228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:28.425273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:28.425343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254972883502820:5983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:28.425360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254972883502820:5983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:28.425365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254972883502820:5983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:28.425373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:28.425581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:28.425621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.425622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.425623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.425624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.425625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.425625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.425626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.425627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.425627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.425628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.425629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.425630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.425630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.425631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.425635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.425640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.425643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.425645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.425648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.425650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.425652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.425654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.425657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.425659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.425661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.425663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.425665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.425667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.425673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.425678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.425681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.425685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.425687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.425690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.425692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.425695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.425698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.425701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.425704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.425706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.425709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.425712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.425714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.425717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.425720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.425722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.425725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.425727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.425730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.425733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.425735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.425738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.425740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.425744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.425746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.425749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.425769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:28.431036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:28.431815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:28.431836Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:28.431839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:28.431843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:28.431850Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 544 [2:7556254970506639420:5342]
2025-10-01T14:08:28.431867Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:28.431887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:28.431891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.431895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.431897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.431915Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:28.431921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:28.431928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:28.431993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.432002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.432005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.432008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:28.432011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:28.432088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:28.432096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.432110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.432122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.432140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:28.432164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883502743:2446], now have 1 active actors on pipe
2025-10-01T14:08:28.432172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883502862:5983], now have 1 active actors on pipe
2025-10-01T14:08:28.432180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254970506639415:5342]
2025-10-01T14:08:28.432182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254970506639415:5342]
2025-10-01T14:08:28.432184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254970506639415:5342]
2025-10-01T14:08:28.432196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:28.432209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:28.432214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:28.432220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:28.432222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:28.432228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:28.432231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:28.432271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254970506639415:5342]
2025-10-01T14:08:28.432285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:28.432320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:28.432352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 544
2025-10-01T14:08:28.432355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 544
2025-10-01T14:08:28.432471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.432488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.432518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:28.432525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.432528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.432532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:28.432681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.432693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:28.432711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:28.432909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.432917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.432932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:28.433039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 545 partition: 0 MaxSeqNo: 45 sessionId: src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0
2025-10-01T14:08:28.433477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5c106bf-230e0f26-230dab2b-f07717e9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:28.436652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0] Write session: try to update token
2025-10-01T14:08:28.436673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:28.454632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:28.454653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:28.454663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254970506639415:5342]
2025-10-01T14:08:28.454711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:28.454896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:28.455049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:28.455199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:28.455356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:28.455550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:28.455590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:28.455665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:28.475694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 545 sessionId: src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:28.478452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:28.478619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:28.478641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:28.478644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:28.478646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:28.478655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254970506639415:5342]
2025-10-01T14:08:28.478659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254970506639415:5342]
2025-10-01T14:08:28.478662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254970506639415:5342]
2025-10-01T14:08:28.478690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:28.478695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:28.478699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:28.478713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.478722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.478743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:28.478750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.478754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:28.478927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:28.510447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254972883502872:5713]
2025-10-01T14:08:28.518457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 544, pipe: [1:7556254972883502872:5713]
2025-10-01T14:08:28.632225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:28.632634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883502872:5713], now have 1 active actors on pipe
2025-10-01T14:08:28.632953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:28.633003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:28.633079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 545 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0
2025-10-01T14:08:28.633319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 545 sessionId: src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0 is DEAD
2025-10-01T14:08:28.633493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:28.633504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0] Write session will restart in 0.008294s
2025-10-01T14:08:28.633531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0] Write session: Do CDS request
2025-10-01T14:08:28.633538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:28.633560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254972883502872:5713]
2025-10-01T14:08:28.632856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:28.642917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:28.643287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:28.643305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 546
2025-10-01T14:08:28.643512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:28.643545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:28.643552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:28.643555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:28.644036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 546 sessionId:  describe result for acl check
2025-10-01T14:08:28.644073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:28.644079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:28.644080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:28.644085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254972883502934:5988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:28.644576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254972883502934:5988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:28.647650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254972883502934:5988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:28.650920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:28.651511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254972883502934:5988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:28.651528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254972883502934:5988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:28.651531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254972883502934:5988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:28.651541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:28.651651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:28.651833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:28.651838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:28.651848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:28.651888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:28.651924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254970506639572:5354]
2025-10-01T14:08:28.652487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:28.652861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:28.652901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:28.653184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:28.653230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.653231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.653232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.653233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.653234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.653235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.653236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.653237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.653238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.653240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.653241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.653242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.653243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.653244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.653248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.653257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.653261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.653264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.653267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.653271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.653274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.653277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.653280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.653285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.653288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.653291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.653295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.653298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.653305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.653313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.653318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.653323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.653327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.653331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.653335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.653339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.653344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.653348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.653351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.653356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.653360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.653364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.653368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.653372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.653376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.653381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.653384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.653388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.653392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.653397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.653401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.653405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.653408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.653413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.653416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.653421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.653455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:28.657387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:28.658748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:28.658764Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:28.658767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:28.658770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:28.658777Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 545 [2:7556254970506639572:5354]
2025-10-01T14:08:28.658791Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:28.658807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:28.658810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.658813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.658815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.658831Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:28.658837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:28.658847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:28.658902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.658909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.658910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.658913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:28.658916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:28.658979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:28.658986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.658997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.659011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.659029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:28.659050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883502879:2446], now have 1 active actors on pipe
2025-10-01T14:08:28.659057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883502993:5988], now have 1 active actors on pipe
2025-10-01T14:08:28.659064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254970506639567:5354]
2025-10-01T14:08:28.659070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254970506639567:5354]
2025-10-01T14:08:28.659072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254970506639567:5354]
2025-10-01T14:08:28.659085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:28.659102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:28.659102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:28.659105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:28.659107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:28.659119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:28.659121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:28.659107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 545
2025-10-01T14:08:28.659152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254970506639567:5354]
2025-10-01T14:08:28.659162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:28.659121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 545
2025-10-01T14:08:28.659170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:28.659182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.659190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.659235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:28.659247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.659254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.659256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:28.659265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.659278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:28.659297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:28.659472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.659482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.659507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:28.659577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 546 partition: 0 MaxSeqNo: 45 sessionId: src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0
2025-10-01T14:08:28.659924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8d7949-e0567015-19b4da29-ba5c985c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:28.662520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0] Write session: try to update token
2025-10-01T14:08:28.662538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:28.677210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 546 sessionId: src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:28.678840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:28.678860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:28.678863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:28.678865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:28.678874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254970506639567:5354]
2025-10-01T14:08:28.678881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254970506639567:5354]
2025-10-01T14:08:28.678885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254970506639567:5354]
2025-10-01T14:08:28.678931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:28.678934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:28.678940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.678942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:28.678946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:28.678950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:28.679078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:28.679693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:28.733498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254972883503006:5713]
2025-10-01T14:08:28.733817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 545, pipe: [1:7556254972883503006:5713]
2025-10-01T14:08:28.832708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:28.832988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.833008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.833054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883503006:5713], now have 1 active actors on pipe
2025-10-01T14:08:28.833207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:28.833207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254972883503006:5713]
2025-10-01T14:08:28.833226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:28.833230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:28.833229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:28.833279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 546 reason: error at write: Disconnected sessionId: src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0
2025-10-01T14:08:28.833437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 546 sessionId: src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0 is DEAD
2025-10-01T14:08:28.833561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:28.833570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0] Write session will restart in 0.006656s
2025-10-01T14:08:28.833599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0] Write session: Do CDS request
2025-10-01T14:08:28.833604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:28.841819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:28.841903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:28.841918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 547
2025-10-01T14:08:28.842060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:28.842100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:28.842110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:28.842114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:28.842513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 547 sessionId:  describe result for acl check
2025-10-01T14:08:28.842549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:28.842550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:28.842552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:28.842557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254972883503081:5992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:28.843060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254972883503081:5992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:28.844910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254972883503081:5992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:28.845631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:28.847805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:28.848039Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:28.848052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:28.848064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:28.848090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254972883503081:5992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:28.848120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:28.848115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254972883503081:5992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:28.848118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254972883503081:5992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:28.848126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:28.848158Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254970506639698:5357]
2025-10-01T14:08:28.848728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:28.849028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:28.849078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:28.849390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:28.849456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.849462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.849463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.849464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.849465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.849467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.849468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.849469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.849470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.849471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.849472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.849473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.849474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.849476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.849483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.849493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.849496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.849501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.849504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.849508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.849512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.849515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.849519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.849523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.849526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.849530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.849533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.849537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.849544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.849551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:28.849557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.849562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:28.849568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.849574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:28.849585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.849590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:28.849596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.849601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:28.849604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.849609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:28.849615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.849620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:28.849624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.849629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:28.849632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.849638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:28.849644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.849649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.849658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.849663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.849671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.849676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.849680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.849684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:28.849689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.849693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:28.849728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:28.853466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:28.854071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:28.854088Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:28.854091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:28.854095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:28.854101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 546 [2:7556254970506639698:5357]
2025-10-01T14:08:28.854116Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:28.854137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:28.854145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.854159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.854165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.854182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:28.854192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:28.854198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:28.854263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.854271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.854273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.854277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:28.854280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:28.854385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:28.854396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.854409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:28.854420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:28.854435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:28.854460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883503127:5992], now have 1 active actors on pipe
2025-10-01T14:08:28.854469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883503008:2446], now have 1 active actors on pipe
2025-10-01T14:08:28.854477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254970506639692:5357]
2025-10-01T14:08:28.854479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254970506639692:5357]
2025-10-01T14:08:28.854481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254970506639692:5357]
2025-10-01T14:08:28.854494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:28.854512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:28.854530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:28.854533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:28.854511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 546
2025-10-01T14:08:28.854514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 546
2025-10-01T14:08:28.854561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:28.854564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254970506639692:5357]
2025-10-01T14:08:28.854567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:28.854571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:28.854573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:28.854579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:28.854682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.854692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.854721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:28.854732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:28.854741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:28.854743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:28.854753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:28.854765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:28.854785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:28.854961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.854969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.854983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:28.855075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 547 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0
2025-10-01T14:08:28.855468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4318370-ff7de2e-c0bf750-1eb4e59f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:28.857944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0] Write session: try to update token
2025-10-01T14:08:28.857961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:28.872535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 547 sessionId: src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:28.874860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:28.876052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:28.876078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:28.876101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:28.876105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:28.876108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:28.876110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:28.876118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254970506639692:5357]
2025-10-01T14:08:28.876125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254970506639692:5357]
2025-10-01T14:08:28.876136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254970506639692:5357]
2025-10-01T14:08:28.876170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:28.876183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:28.876186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:28.876193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:28.876205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:28.876207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:28.876338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:28.933324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254972883503138:5713]
2025-10-01T14:08:28.934682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 546, pipe: [1:7556254972883503138:5713]
2025-10-01T14:08:29.035310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:29.035766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:29.035821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254972883503138:5713], now have 1 active actors on pipe
2025-10-01T14:08:29.036327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:29.036425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:29.036430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:29.036524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 547 reason: error at write: Disconnected sessionId: src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0
2025-10-01T14:08:29.036556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254972883503138:5713]
2025-10-01T14:08:29.036576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:29.038221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 547 sessionId: src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0 is DEAD
2025-10-01T14:08:29.038567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:29.038576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0] Write session will restart in 0.007665s
2025-10-01T14:08:29.038596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0] Write session: Do CDS request
2025-10-01T14:08:29.038603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:29.048276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:29.048292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 548
2025-10-01T14:08:29.048920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:29.049301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.050616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.050664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:29.050670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:29.050675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:29.051066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 548 sessionId:  describe result for acl check
2025-10-01T14:08:29.051092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:29.051094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:29.051095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:29.051100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254977178470523:5996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:29.051639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254977178470523:5996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:29.052280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:29.052511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:29.052520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:29.052531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:29.052582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:29.052620Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254974801607118:5359]
2025-10-01T14:08:29.053204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:29.053817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254977178470523:5996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:29.054310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:29.054391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:29.054702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:29.054774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.054781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.054782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.054783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.054784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.054786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.054787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.054789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.054790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.054791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.054792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.054793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.054795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.054796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.054801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.054810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.054813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.054816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.054820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.054824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.054827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.054830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.054833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.054837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.054841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.054844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.054853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.054856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.054867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.054875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.054881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.054890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.054898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.054903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.054912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.054920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.054927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.054936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.054939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.054944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.054948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.054952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.054956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.054960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.054964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.054970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.054973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.054976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.054983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.054987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.054991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.054995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.055001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.055005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.055013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.055017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.055050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:29.059002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:29.059064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254977178470523:5996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:29.059081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254977178470523:5996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:29.059085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254977178470523:5996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:29.059093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:29.059696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:29.059715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:29.059717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:29.059721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:29.059728Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 547 [2:7556254974801607118:5359]
2025-10-01T14:08:29.059745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:29.059761Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:29.059765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.059768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.059771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.059787Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:29.059793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:29.059799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:29.059858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.059860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.059862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.059866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:29.059868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:29.059940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:29.059942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.059954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.059963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.059977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:29.059996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470560:5996], now have 1 active actors on pipe
2025-10-01T14:08:29.060000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470437:2446], now have 1 active actors on pipe
2025-10-01T14:08:29.060008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254974801607113:5359]
2025-10-01T14:08:29.060010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254974801607113:5359]
2025-10-01T14:08:29.060012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254974801607113:5359]
2025-10-01T14:08:29.060030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:29.060044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:29.060058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:29.060061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:29.060098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254974801607113:5359]
2025-10-01T14:08:29.060101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:29.060210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:29.060213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:29.060214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:29.060218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:29.060361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 547
2025-10-01T14:08:29.060387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 547
2025-10-01T14:08:29.060443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.060456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.060487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:29.060500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.060505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.060507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:29.060518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.060532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:29.060553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.060812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.060825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.060847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.060968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 548 partition: 0 MaxSeqNo: 45 sessionId: src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0
2025-10-01T14:08:29.061385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f5d43d-26b1d05f-cc03a37f-7606de41_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:29.065358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0] Write session: try to update token
2025-10-01T14:08:29.065377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:29.088235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 548 sessionId: src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:29.091367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:29.092662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.092685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.094728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:29.094765Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:29.094769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:29.094772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:29.094773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:29.094783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254974801607113:5359]
2025-10-01T14:08:29.094791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254974801607113:5359]
2025-10-01T14:08:29.094798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254974801607113:5359]
2025-10-01T14:08:29.094826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:29.094841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:29.094841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:29.094846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:29.094849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.094852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:29.094981Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:29.095163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:29.136951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254977178470569:5713]
2025-10-01T14:08:29.137187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 547, pipe: [1:7556254977178470569:5713]
2025-10-01T14:08:29.244700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:29.252653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.252690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.252860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.252926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.252989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.253054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.253104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.253112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.253190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.253253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.253326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.253395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.253526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.253535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.253595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.253651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.253706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.253764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.253805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.253811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.253873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.253931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.253988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.254045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.254088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.254095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.254153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.254208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.254270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.254331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.254396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.254404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.254466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.254526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.254587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.254650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.254696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.254704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.254795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.254852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.254913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.254976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.255030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.255037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.255101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.255162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.255220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.255284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.255338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.255345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.255412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.255470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.255530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.255596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.255645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.255651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.255723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.255788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.255848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.255905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.255947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.255953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.256014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470569:5713], now have 1 active actors on pipe
2025-10-01T14:08:29.257122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:29.258258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:29.258269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0] Write session will restart in 0.008894s
2025-10-01T14:08:29.258294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0] Write session: Do CDS request
2025-10-01T14:08:29.258300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:29.256355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254977178470569:5713]
2025-10-01T14:08:29.256390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:29.256393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:29.256419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 548 reason: error at write: Disconnected sessionId: src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0
2025-10-01T14:08:29.256577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:29.256649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 548 sessionId: src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0 is DEAD
2025-10-01T14:08:29.267908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.273279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:29.270532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:29.270548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 549
2025-10-01T14:08:29.270700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.270727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:29.270732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:29.270736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:29.271506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 549 sessionId:  describe result for acl check
2025-10-01T14:08:29.271534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:29.271536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:29.271537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:29.271544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254977178470679:6007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:29.272083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254977178470679:6007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:29.278102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:29.278358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:29.278386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:29.278398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:29.278460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:29.278502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254974801607255:5362]
2025-10-01T14:08:29.279043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254977178470679:6007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:29.279160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:29.279591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:29.279636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:29.279941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:29.279995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.279996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.279997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.279998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.279999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.280000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.280002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.280003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.280004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.280005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.280006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.280008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.280009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.280010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.280015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.280025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.280030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.280034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.280038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.280042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.280046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.280050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.280054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.280060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.280064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.280067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.280071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.280076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.280082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.280088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.280094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.280102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.280106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.280111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.280115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.280120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.280124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.280129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.280133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.280138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.280143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.280148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.280152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.280157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.280161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.280166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.280170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.280174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.280179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.280182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.280186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.280191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.280196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.280201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.280204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.280209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.280249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:29.289621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254977178470679:6007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:29.289638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254977178470679:6007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:29.289641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254977178470679:6007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:29.289651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:29.292186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:29.292934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:29.292954Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:29.292957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:29.292961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:29.292967Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 548 [2:7556254974801607255:5362]
2025-10-01T14:08:29.293464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 548
2025-10-01T14:08:29.292985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:29.293004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:29.293499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 548
2025-10-01T14:08:29.293007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.293011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.293013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.293032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:29.293041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:29.293048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:29.293113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.293116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.293121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.293125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:29.293127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:29.293207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:29.293209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.293223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.293234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.293250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:29.293268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254974801607250:5362]
2025-10-01T14:08:29.293270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254974801607250:5362]
2025-10-01T14:08:29.293273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254974801607250:5362]
2025-10-01T14:08:29.293282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:29.293289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:29.293292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:29.293294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:29.293297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470731:6007], now have 1 active actors on pipe
2025-10-01T14:08:29.293301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470578:2446], now have 1 active actors on pipe
2025-10-01T14:08:29.293309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:29.293323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:29.293326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:29.293368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254974801607250:5362]
2025-10-01T14:08:29.293380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:29.293406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:29.293635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.293649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.293679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:29.293693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.293702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.293705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:29.293713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.293729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:29.293751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.294208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.294221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.294240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.295003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 549 partition: 0 MaxSeqNo: 45 sessionId: src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0
2025-10-01T14:08:29.295480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ea18760-6e72c2b6-4b1898c9-45059e68_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:29.297989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0] Write session: try to update token
2025-10-01T14:08:29.298009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:29.306031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:29.306052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:29.306063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254974801607250:5362]
2025-10-01T14:08:29.306111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:29.306291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:29.306459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:29.306584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:29.306599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:29.306741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:29.306958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:29.306995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:29.315711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 549 sessionId: src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:29.318194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:29.318941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.318963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.319001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:29.319167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:29.351387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.351425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.351620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.351692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.351759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.351829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.351875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.351880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.351959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.352019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.352086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.352204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.352254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.352258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.352329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.352386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.352454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.352529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.352573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.352576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.352649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.352714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.352772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.352852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.352900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.352903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.352968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.353024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.353085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.353165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.353211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.353214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.353290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.353358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.353431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.353504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.353547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.353551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.353627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.353703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.353778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.353848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.353896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.353904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.353972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.354033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.354098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.354162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.354205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.354210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.354277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.354351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.354433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.354502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.354549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.354559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.354627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:29.354691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:29.356440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254977178470749:5713]
2025-10-01T14:08:29.356768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 548, pipe: [1:7556254977178470749:5713]
2025-10-01T14:08:29.354755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:29.354830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:29.354873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:29.354876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:29.354952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:29.354956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:29.354959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:29.354962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:29.354971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254974801607250:5362]
2025-10-01T14:08:29.354976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254974801607250:5362]
2025-10-01T14:08:29.354979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254974801607250:5362]
2025-10-01T14:08:29.355035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:29.355040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:08:29.355043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:29.355047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:29.355101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.355121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.355124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:08:29.355143Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355153Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355158Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355162Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355169Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355174Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355177Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355180Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355183Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355186Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355189Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355192Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355196Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355199Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355203Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355206Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355209Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355213Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355216Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355220Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355224Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355227Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355232Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355236Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355239Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355672Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355677Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355682Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355685Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355689Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355912Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355917Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355920Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355926Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355931Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:29.355953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:08:29.355965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:08:29.355968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:08:29.355971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:08:29.355975Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:08:29.356380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:08:29.356396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:08:29.356405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:08:29.356408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:08:29.356412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:08:29.356415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:08:29.357059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:08:29.357072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:08:29.357078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:08:29.357081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:08:29.357084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:08:29.357091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:08:29.357690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:08:29.357716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.357838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327709357
2025-10-01T14:08:29.358753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:29.358771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.358773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:29.358930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:29.513825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:29.514206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470749:5713], now have 1 active actors on pipe
2025-10-01T14:08:29.514220Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:08:29.514243Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:08:29.514561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:29.514578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:29.514578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254977178470749:5713]
2025-10-01T14:08:29.514598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:29.514606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 549 reason: error at write: Disconnected sessionId: src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0
2025-10-01T14:08:29.514834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 549 sessionId: src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0 is DEAD
2025-10-01T14:08:29.520169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:29.520185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0] Write session will restart in 0.006220s
2025-10-01T14:08:29.520210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0] Write session: Do CDS request
2025-10-01T14:08:29.520219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:29.514762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:29.528057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.528657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:29.528672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 550
2025-10-01T14:08:29.529033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.529072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:29.529077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:29.529081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:29.530266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 550 sessionId:  describe result for acl check
2025-10-01T14:08:29.530305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:29.530310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:29.530312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:29.530317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254977178470776:6013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:29.530823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254977178470776:6013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:29.533785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254977178470776:6013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:29.536212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:29.536811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254977178470776:6013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:29.536828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254977178470776:6013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:29.536833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254977178470776:6013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:29.536841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:29.538723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:29.538969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:29.538973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:29.538985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:29.539036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:29.539071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254974801607393:5367]
2025-10-01T14:08:29.539666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:29.540114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:29.540157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:29.540474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:29.540532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.540534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.540535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.540536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.540538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.540539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.540541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.540542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.540543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.540544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.540545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.540546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.540547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.540549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.540554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.540564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.540567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.540571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.540575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.540579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.540582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.540586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.540590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.540594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.540597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.540601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.540604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.540608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.540615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.540623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.540629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.540634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.540639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.540644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.540648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.540653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.540658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.540663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.540667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.540672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.540677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.540682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.540687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.540691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.540695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.540700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.540704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.540710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.540715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.540720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.540724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.540729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.540734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.540739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.540744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.540749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.540800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:29.546717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 549
2025-10-01T14:08:29.546766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 549
2025-10-01T14:08:29.545206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:29.545826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:29.545833Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:29.545836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:29.545841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:29.545862Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 549 [2:7556254974801607393:5367]
2025-10-01T14:08:29.545881Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:29.545899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:29.545903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.545908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.545913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.545930Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:29.545936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:29.545943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:29.546007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.546010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.546011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.546015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:29.546018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:29.546087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:29.546090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.546100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.546110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.546125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:29.546142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254974801607386:5367]
2025-10-01T14:08:29.546145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254974801607386:5367]
2025-10-01T14:08:29.546147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254974801607386:5367]
2025-10-01T14:08:29.546159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:29.546172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:29.546185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:29.546188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:29.546227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254974801607386:5367]
2025-10-01T14:08:29.546228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:29.546497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:29.546500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:29.546502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:29.546507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:29.546638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470752:2446], now have 1 active actors on pipe
2025-10-01T14:08:29.546642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470873:6013], now have 1 active actors on pipe
2025-10-01T14:08:29.546921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.546927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.546953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:29.546963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.546968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.546970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:29.546980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.546992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:29.547008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.547591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 550 partition: 0 MaxSeqNo: 45 sessionId: src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0
2025-10-01T14:08:29.548119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd6a1ecc-525043b3-d2ee87e4-964b9199_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:29.547217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.547234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.547249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.550625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0] Write session: try to update token
2025-10-01T14:08:29.550641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:29.573018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:29.573040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:29.573042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:29.573044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:29.573054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254974801607386:5367]
2025-10-01T14:08:29.573060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254974801607386:5367]
2025-10-01T14:08:29.573064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254974801607386:5367]
2025-10-01T14:08:29.573111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:29.573115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:29.573117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:29.573118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:29.573127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.573129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:29.573615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:29.581992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 550 sessionId: src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:29.584397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:29.615875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254977178470885:5713]
2025-10-01T14:08:29.616170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 549, pipe: [1:7556254977178470885:5713]
2025-10-01T14:08:29.726830Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:29.727483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.727493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.727517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470885:5713], now have 1 active actors on pipe
2025-10-01T14:08:29.729381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:29.729438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:29.729513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 550 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0
2025-10-01T14:08:29.730074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:29.730086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0] Write session will restart in 0.008402s
2025-10-01T14:08:29.730112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0] Write session: Do CDS request
2025-10-01T14:08:29.730119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:29.729770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 550 sessionId: src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0 is DEAD
2025-10-01T14:08:29.729827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254977178470885:5713]
2025-10-01T14:08:29.728581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:29.739958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.740123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:29.740140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 551
2025-10-01T14:08:29.740653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.740694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:29.740701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:29.740704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:29.741129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 551 sessionId:  describe result for acl check
2025-10-01T14:08:29.741161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:29.741163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:29.741165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:29.741170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254977178470930:6018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:29.741711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254977178470930:6018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:29.743961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254977178470930:6018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:29.744897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:29.748129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:29.748424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254977178470930:6018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:29.748439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254977178470930:6018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:29.748445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254977178470930:6018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:29.748453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:29.748374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:29.748386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:29.748398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:29.748448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:29.748478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254974801607550:5380]
2025-10-01T14:08:29.749286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:29.749662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:29.749704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:29.750008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:29.750057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.750058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.750060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.750061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.750062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.750063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.750064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.750066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.750067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.750068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.750069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.750070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.750071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.750073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.750078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.750088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.750092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.750096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.750100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.750104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.750108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.750113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.750117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.750122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.750126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.750130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.750134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.750138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.750145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.750153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.750159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.750165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.750169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.750174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.750179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.750184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.750189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.750195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.750199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.750205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.750210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.750215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.750219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.750225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.750230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.750237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.750241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.750247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.750251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.750256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.750260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.750267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.750272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.750277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.750291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.750297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.750338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:29.755399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:29.756713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:29.756721Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:29.756724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:29.756728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:29.756735Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 550 [2:7556254974801607550:5380]
2025-10-01T14:08:29.756752Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:29.756772Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:29.756775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.756779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.756795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.756814Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:29.756819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:29.756826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:29.756887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.756889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.756890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.756893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:29.756896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:29.756970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:29.756973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.756987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.756998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.757015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:29.757032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254974801607545:5380]
2025-10-01T14:08:29.757034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254974801607545:5380]
2025-10-01T14:08:29.757037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254974801607545:5380]
2025-10-01T14:08:29.757050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:29.757065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:29.757078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:29.757082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:29.757123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254974801607545:5380]
2025-10-01T14:08:29.757125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:29.757524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:29.757535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:29.757537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:29.757543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:29.758018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 550
2025-10-01T14:08:29.758075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 550
2025-10-01T14:08:29.758588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178470890:2446], now have 1 active actors on pipe
2025-10-01T14:08:29.758605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178471012:6018], now have 1 active actors on pipe
2025-10-01T14:08:29.758627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.758638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.758670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:29.758686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.758692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.758694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:29.758708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.758722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:29.758742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.758992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.759002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.759019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.759155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 551 partition: 0 MaxSeqNo: 45 sessionId: src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0
2025-10-01T14:08:29.759885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83d6b7eb-f7fe3d14-1e42378f-38a56591_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:29.762681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0] Write session: try to update token
2025-10-01T14:08:29.762701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:29.783459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 551 sessionId: src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:29.786201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:29.784327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:29.784351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:29.784354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:29.784356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:29.784367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254974801607545:5380]
2025-10-01T14:08:29.784371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254974801607545:5380]
2025-10-01T14:08:29.784378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254974801607545:5380]
2025-10-01T14:08:29.784431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:29.784435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:29.784439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:29.784443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.784443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:29.784446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:29.784594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:29.830792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254977178471024:5713]
2025-10-01T14:08:29.831498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 550, pipe: [1:7556254977178471024:5713]
2025-10-01T14:08:29.941965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:29.942254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.942270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.942315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178471024:5713], now have 1 active actors on pipe
2025-10-01T14:08:29.942636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:29.942678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:29.942702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254977178471024:5713]
2025-10-01T14:08:29.942722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:29.942799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 551 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0
2025-10-01T14:08:29.943006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 551 sessionId: src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0 is DEAD
2025-10-01T14:08:29.945184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:29.945197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0] Write session will restart in 0.008386s
2025-10-01T14:08:29.945225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0] Write session: Do CDS request
2025-10-01T14:08:29.945232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:29.955133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.955526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:29.955543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 552
2025-10-01T14:08:29.955721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:29.955754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:29.955764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:29.955768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:29.956184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 552 sessionId:  describe result for acl check
2025-10-01T14:08:29.956222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:29.956230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:29.956232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:29.956239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254977178471118:6022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:29.956507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:29.956767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254977178471118:6022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:29.958690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:29.958912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:29.958923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:29.958943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:29.958996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:29.959026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254974801607679:5382]
2025-10-01T14:08:29.959661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:29.959914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:29.959955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:29.960057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254977178471118:6022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:29.960197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:29.960247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.960255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.960256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.960257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.960258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.960259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.960260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.960262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.960263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.960264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.960265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.960266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.960267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.960268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.960272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.960281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.960284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.960287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.960291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.960295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.960299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.960303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.960307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.960311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.960314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.960318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.960321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.960323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.960327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.960332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:29.960336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.960339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:29.960343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.960348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:29.960352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.960355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:29.960359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.960363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:29.960366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.960371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:29.960375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.960379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:29.960383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.960386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:29.960390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.960394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:29.960398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.960403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.960407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.960411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.960415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.960419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.960422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.960427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:29.960431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.960435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:29.960477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:29.964096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254977178471118:6022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:29.964110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254977178471118:6022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:29.964114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254977178471118:6022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:29.964123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:29.964682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:29.965540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:29.965561Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:29.965564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:29.965568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:29.965578Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 551 [2:7556254974801607679:5382]
2025-10-01T14:08:29.965596Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:29.965614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:29.965617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.965622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.965624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.965642Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:29.965654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:29.965660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:29.965723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.965730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.965732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.965736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:29.965739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:29.965814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:29.965821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.965835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:29.965845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:29.965866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:29.965890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254974801607673:5382]
2025-10-01T14:08:29.965896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254974801607673:5382]
2025-10-01T14:08:29.965898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254974801607673:5382]
2025-10-01T14:08:29.965912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:29.965928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:29.965948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:29.965956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:29.965996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254974801607673:5382]
2025-10-01T14:08:29.966004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:29.966141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:29.966151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:29.966153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:29.966159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:29.966948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 551
2025-10-01T14:08:29.966974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 551
2025-10-01T14:08:29.966466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178471155:6022], now have 1 active actors on pipe
2025-10-01T14:08:29.966479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254977178471026:2446], now have 1 active actors on pipe
2025-10-01T14:08:29.967198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.967213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.967248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:29.967259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:29.967265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:29.967268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:29.967279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:29.967296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:29.967318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.967605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.967613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.967626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:29.967765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 552 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0
2025-10-01T14:08:29.968243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7c8e23d-82cf7f5c-f00b26c5-cb424165_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:29.971142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0] Write session: try to update token
2025-10-01T14:08:29.971166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:29.990821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 552 sessionId: src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:29.993737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:29.993760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:29.993452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:29.995799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:29.995837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:29.995840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:29.995843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:29.995845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:29.995854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254974801607673:5382]
2025-10-01T14:08:29.995862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254974801607673:5382]
2025-10-01T14:08:29.995866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254974801607673:5382]
2025-10-01T14:08:29.995912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:29.995923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:29.995925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:29.995933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:29.995939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:29.995943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:29.996102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:29.996387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:30.046830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254981473438458:5713]
2025-10-01T14:08:30.051120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 551, pipe: [1:7556254981473438458:5713]
2025-10-01T14:08:30.153338Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:30.161766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.161795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.161963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.162031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.162095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.162157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.162201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.162213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.162284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.162344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.162424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.162525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.162617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.162623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.162722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.162789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.162851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.162923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.162977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.162985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.163061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.163131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.163197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.163265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.163317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.163326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.163392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.163457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.163527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.163644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.163687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.163691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.163758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.163824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.163881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.164122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.164216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.164218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.164439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.164495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.164563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.164621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.164657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.164658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.164726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.164805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.164868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.164922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.165022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.165025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.165097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.165150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.165208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.165271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.165316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.165319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.165422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:30.165479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:30.165542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:30.165601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:30.165739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:30.165741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:30.165813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438458:5713], now have 1 active actors on pipe
2025-10-01T14:08:30.166164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:30.166242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254981473438458:5713]
2025-10-01T14:08:30.166267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:30.166270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:30.166295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 552 reason: error at write: Disconnected sessionId: src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0
2025-10-01T14:08:30.166792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:30.166802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0] Write session will restart in 0.009019s
2025-10-01T14:08:30.166829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0] Write session: Do CDS request
2025-10-01T14:08:30.166835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:30.167148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:30.166510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 552 sessionId: src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0 is DEAD
2025-10-01T14:08:30.177934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:30.178346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:30.178366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 553
2025-10-01T14:08:30.178555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:30.178592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:30.178601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:30.178605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:30.178964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 553 sessionId:  describe result for acl check
2025-10-01T14:08:30.178993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:30.178994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:30.178996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:30.179001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254981473438470:6026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:30.179551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254981473438470:6026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:30.190869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254981473438470:6026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:30.196348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254981473438470:6026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:30.196369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254981473438470:6026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:30.196375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254981473438470:6026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:30.196383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:30.214318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:30.216762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:30.217031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:30.217044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:30.217057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:30.217113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:30.217156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254979096575118:5384]
2025-10-01T14:08:30.217719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:30.218109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:30.218163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:30.218485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:30.218551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.218556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.218557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.218558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.218560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.218561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.218562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.218563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.218565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.218566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.218567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.218569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.218570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.218571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.218577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.218586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.218591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.218594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.218598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.218602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.218606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.218610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.218614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.218618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.218621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.218625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.218629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.218632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.218639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.218647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.218654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.218659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.218664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.218673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.218678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.218683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.218688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.218697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.218701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.218706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.218711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.218716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.218724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.218729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.218734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.218744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.218748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.218753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.218761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.218767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.218775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.218780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.218785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.218790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.218798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.218803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.218840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:30.222987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:30.223621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:30.223638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:30.223641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:30.223645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:30.223653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 552 [2:7556254979096575118:5384]
2025-10-01T14:08:30.223670Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:30.223690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:30.223698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:30.223703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:30.223705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:30.223722Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:30.223732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:30.223739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:30.224045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 552
2025-10-01T14:08:30.224050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 552
2025-10-01T14:08:30.223801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.223811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.223816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.223820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:30.223823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:30.223894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:30.223898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.223911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.223925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.223943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:30.223962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438461:2446], now have 1 active actors on pipe
2025-10-01T14:08:30.223965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438514:6026], now have 1 active actors on pipe
2025-10-01T14:08:30.223974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254979096575113:5384]
2025-10-01T14:08:30.223976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254979096575113:5384]
2025-10-01T14:08:30.223979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254979096575113:5384]
2025-10-01T14:08:30.223991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:30.224004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:30.224005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:30.224008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:30.224010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:30.224023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:30.224026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:30.224066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254979096575113:5384]
2025-10-01T14:08:30.224075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:30.224096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:30.224463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.224475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.224503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:30.224513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:30.224519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:30.224521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:30.224531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:30.224542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:30.224562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:30.226559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.226587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.226619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:30.226902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 553 partition: 0 MaxSeqNo: 45 sessionId: src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0
2025-10-01T14:08:30.231777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3dde53-1341ab03-d8cc65da-8a7fdc53_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:30.234464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0] Write session: try to update token
2025-10-01T14:08:30.234488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:30.249614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:30.249635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:30.249645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254979096575113:5384]
2025-10-01T14:08:30.249690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:30.249866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:30.250002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:30.250134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:30.250271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:30.250485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:30.250524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:30.250610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:30.266219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:30.266240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:30.266243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:30.266246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:30.266257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254979096575113:5384]
2025-10-01T14:08:30.266260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254979096575113:5384]
2025-10-01T14:08:30.266264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254979096575113:5384]
2025-10-01T14:08:30.266316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:30.266323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.266325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:30.266451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254981473438605:5713]
2025-10-01T14:08:30.266494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:30.266833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 552, pipe: [1:7556254981473438605:5713]
2025-10-01T14:08:30.267446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:30.267459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:30.267463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:30.273916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 553 sessionId: src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:30.276356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:30.434708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:30.435021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438605:5713], now have 1 active actors on pipe
2025-10-01T14:08:30.435064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.435074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.435648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254981473438605:5713]
2025-10-01T14:08:30.435681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:30.435715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:30.435719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:30.435774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 553 reason: error at write: Disconnected sessionId: src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0
2025-10-01T14:08:30.435941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 553 sessionId: src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0 is DEAD
2025-10-01T14:08:30.436077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:30.436088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0] Write session will restart in 0.006209s
2025-10-01T14:08:30.436123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0] Write session: Do CDS request
2025-10-01T14:08:30.436134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:30.439096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:30.444054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:30.444134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:30.444151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 554
2025-10-01T14:08:30.444318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:30.444347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:30.444353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:30.444357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:30.444755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 554 sessionId:  describe result for acl check
2025-10-01T14:08:30.444780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:30.444792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:30.444794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:30.444798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254981473438661:6039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:30.445199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254981473438661:6039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:30.449460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254981473438661:6039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:30.459409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254981473438661:6039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:30.459433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254981473438661:6039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:30.459436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254981473438661:6039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:30.459448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:30.464584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:30.466637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:30.466840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:30.466852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:30.466863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:30.466914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:30.466958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254979096575258:5390]
2025-10-01T14:08:30.467533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:30.469201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:30.469264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:30.469600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:30.469670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.469678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.469679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.469680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.469681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.469682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.469683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.469684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.469685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.469686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.469687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.469689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.469690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.469691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.469697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.469707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.469711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.469715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.469719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.469723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.469728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.469731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.469735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.469739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.469743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.469747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.469751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.469755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.469763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.469771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.469777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.469782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.469786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.469790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.469795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.469800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.469804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.469809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.469814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.469819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.469825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.469831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.469835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.469841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.469846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.469858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.469863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.469871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.469875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.469886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.469889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.469894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.469902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.469907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.469913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.469918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.469979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:30.473962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:30.474686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:30.474705Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:30.474708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:30.474712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:30.474724Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 553 [2:7556254979096575258:5390]
2025-10-01T14:08:30.474744Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:30.474765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:30.474772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:30.474776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:30.474781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:30.474796Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:30.474806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:30.474817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:30.474882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.474889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.474892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.474895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:30.474898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:30.474965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:30.474976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.474989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.475002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.475019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:30.475040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438729:6039], now have 1 active actors on pipe
2025-10-01T14:08:30.475049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438648:2446], now have 1 active actors on pipe
2025-10-01T14:08:30.475057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254979096575253:5390]
2025-10-01T14:08:30.475064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254979096575253:5390]
2025-10-01T14:08:30.475067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254979096575253:5390]
2025-10-01T14:08:30.475112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 553
2025-10-01T14:08:30.475139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 553
2025-10-01T14:08:30.475082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:30.475099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:30.475114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:30.475118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:30.475147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254979096575253:5390]
2025-10-01T14:08:30.475149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:30.475192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:30.475194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:30.475196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:30.475200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:30.475365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.475372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.475401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df43f52e-6211794c-a746d864-b873dcdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:30.475417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:30.475425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:30.475428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:30.475439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:30.475452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:30.475471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:30.475732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.475742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.475759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:30.475872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 554 partition: 0 MaxSeqNo: 45 sessionId: src_id|df43f52e-6211794c-a746d864-b873dcdc_0
2025-10-01T14:08:30.476277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6900ff98-94515f99-fd6bd85e-a3632ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|df43f52e-6211794c-a746d864-b873dcdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:30.478713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df43f52e-6211794c-a746d864-b873dcdc_0] Write session: try to update token
2025-10-01T14:08:30.478730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df43f52e-6211794c-a746d864-b873dcdc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:30.504913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:30.504936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:30.504940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:30.504943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:30.504954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254979096575253:5390]
2025-10-01T14:08:30.504959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254979096575253:5390]
2025-10-01T14:08:30.504964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254979096575253:5390]
2025-10-01T14:08:30.505019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:30.505028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.505037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:30.505186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:30.505395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:30.505410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:30.505413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:30.502686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 554 sessionId: src_id|df43f52e-6211794c-a746d864-b873dcdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:30.505299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:30.536268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254981473438791:5713]
2025-10-01T14:08:30.536603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 553, pipe: [1:7556254981473438791:5713]
2025-10-01T14:08:30.674252Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:30.674688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.674707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.674757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438791:5713], now have 1 active actors on pipe
2025-10-01T14:08:30.675207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:30.678697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254981473438791:5713]
2025-10-01T14:08:30.678726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:30.678758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:30.678834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 554 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df43f52e-6211794c-a746d864-b873dcdc_0
2025-10-01T14:08:30.679010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 554 sessionId: src_id|df43f52e-6211794c-a746d864-b873dcdc_0 is DEAD
2025-10-01T14:08:30.679600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df43f52e-6211794c-a746d864-b873dcdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:30.679610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df43f52e-6211794c-a746d864-b873dcdc_0] Write session will restart in 0.009735s
2025-10-01T14:08:30.679638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df43f52e-6211794c-a746d864-b873dcdc_0] Write session: Do CDS request
2025-10-01T14:08:30.679644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df43f52e-6211794c-a746d864-b873dcdc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:30.696734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df43f52e-6211794c-a746d864-b873dcdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:30.697956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:30.697972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 555
2025-10-01T14:08:30.698321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:30.698360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:30.698365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:30.698385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:30.698744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 555 sessionId:  describe result for acl check
2025-10-01T14:08:30.698773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:30.698775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:30.698776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:30.698782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254981473438870:6044] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:30.699285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254981473438870:6044] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:30.704896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254981473438870:6044] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:30.708334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:30.712293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254981473438870:6044] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:30.712311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254981473438870:6044] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:30.712314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254981473438870:6044] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:30.712324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:30.712296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:30.712532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:30.712536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:30.712549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:30.712598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:30.712633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254979096575422:5402]
2025-10-01T14:08:30.713258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:30.713592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:30.713629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:30.713923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:30.713971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.713972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.713973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.713974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.713975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.713977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.713978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.713979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.713980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.713981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.713982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.713984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.713985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.713986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.713991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.714001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.714005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.714009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.714013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.714017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.714021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.714025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.714029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.714033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.714037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.714041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.714045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.714048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.714055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.714063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:30.714069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.714074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:30.714079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.714084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:30.714089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.714094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:30.714099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.714104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:30.714108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.714113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:30.714118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.714124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:30.714128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.714133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:30.714138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.714143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:30.714148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.714153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.714157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.714162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.714166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.714171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.714176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.714181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:30.714185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.714191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:30.714228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:30.718423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:30.719047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:30.720299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 554
2025-10-01T14:08:30.719061Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:30.719072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:30.719076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:30.719083Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 554 [2:7556254979096575422:5402]
2025-10-01T14:08:30.719100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:30.719118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:30.719121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:30.719124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:30.720332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 554
2025-10-01T14:08:30.719127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:30.719146Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:30.719152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:30.719159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:30.719215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.719217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.719220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.719223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:30.719226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:30.719297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:30.719300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.719312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:30.719323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:30.719340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:30.719357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254979096575416:5402]
2025-10-01T14:08:30.719359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254979096575416:5402]
2025-10-01T14:08:30.719361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254979096575416:5402]
2025-10-01T14:08:30.719372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:30.719386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:30.719398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:30.719400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:30.719437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254979096575416:5402]
2025-10-01T14:08:30.719440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:30.719553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:30.719555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:30.719557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:30.719562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:30.723416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438925:6044], now have 1 active actors on pipe
2025-10-01T14:08:30.723437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438805:2446], now have 1 active actors on pipe
2025-10-01T14:08:30.723470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.723482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.723534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:30.723550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:30.723556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:30.723564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:30.723577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:30.723597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:30.723626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:30.728019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 555 partition: 0 MaxSeqNo: 45 sessionId: src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0
2025-10-01T14:08:30.727757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.727779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.727818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:30.730675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df43f52e-6211794c-a746d864-b873dcdc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:30.733217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0] Write session: try to update token
2025-10-01T14:08:30.733240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:30.751861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:30.751887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:30.751890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:30.751892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:30.751904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254979096575416:5402]
2025-10-01T14:08:30.751909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254979096575416:5402]
2025-10-01T14:08:30.751913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254979096575416:5402]
2025-10-01T14:08:30.751968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:30.751976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:30.751978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:30.752136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:30.754091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:30.754108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:30.754113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:30.764281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 555 sessionId: src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:30.767044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:30.778489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254981473438937:5713]
2025-10-01T14:08:30.779392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 554, pipe: [1:7556254981473438937:5713]
2025-10-01T14:08:30.955076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:30.955753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:30.955763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:30.955802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438937:5713], now have 1 active actors on pipe
2025-10-01T14:08:30.956694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:30.956709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:30.956761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 555 reason: error at write: Disconnected sessionId: src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0
2025-10-01T14:08:30.956940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 555 sessionId: src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0 is DEAD
2025-10-01T14:08:30.957065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254981473438937:5713]
2025-10-01T14:08:30.957078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:30.956803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:30.957434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:30.957442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0] Write session will restart in 0.007480s
2025-10-01T14:08:30.957469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0] Write session: Do CDS request
2025-10-01T14:08:30.957476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:30.966058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:30.966444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:30.966463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 556
2025-10-01T14:08:30.967322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:30.967360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:30.967366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:30.967370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:30.967750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 556 sessionId:  describe result for acl check
2025-10-01T14:08:30.967775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:30.967777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:30.967779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:30.967783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254981473438955:6048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:30.968291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254981473438955:6048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:30.977463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254981473438955:6048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:30.983088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254981473438955:6048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:30.983105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254981473438955:6048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:30.983108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254981473438955:6048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:30.983117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:30.996673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:31.001163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:31.001517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:31.001523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:31.001554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:31.001629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:31.001695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254979096575557:5405]
2025-10-01T14:08:31.002305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:31.002867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:31.002926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:31.003246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:31.003305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.003306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.003307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.003308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.003309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.003310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.003311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.003312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.003313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.003314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.003315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.003316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.003317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.003318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.003323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.003332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.003336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.003339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.003341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.003344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.003348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.003351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.003355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.003358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.003361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.003364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.003367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.003370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.003379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.003386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.003393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.003398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.003402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.003409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.003412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.003417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.003422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.003426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.003430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.003434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.003438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.003442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.003446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.003451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.003472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.003477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.003481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.003486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.003490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.003494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.003498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.003502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.003506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.003511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.003517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.003522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.003557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:31.009215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:31.010175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:31.010182Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:31.010185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:31.010189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:31.010197Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 555 [2:7556254979096575557:5405]
2025-10-01T14:08:31.010217Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:31.010235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:31.010239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:31.010243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:31.010246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:31.010264Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:31.010270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:31.010276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:31.010341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.010343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.010346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.010351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:31.010354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:31.010446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:31.010448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.010462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.010474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.010489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:31.010508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254979096575551:5405]
2025-10-01T14:08:31.010511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254979096575551:5405]
2025-10-01T14:08:31.010513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254979096575551:5405]
2025-10-01T14:08:31.010522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:31.010536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:31.010552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:31.010556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:31.010600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254979096575551:5405]
2025-10-01T14:08:31.010603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:31.010724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:31.010726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:31.010728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:31.010733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:31.012010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 555
2025-10-01T14:08:31.012041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 555
2025-10-01T14:08:31.012480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473439033:6048], now have 1 active actors on pipe
2025-10-01T14:08:31.012495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254981473438943:2446], now have 1 active actors on pipe
2025-10-01T14:08:31.012509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.012516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.012546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:31.012555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:31.012561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:31.012564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:31.012576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:31.012590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:31.012610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:31.012935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.012943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.012959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:31.013106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 556 partition: 0 MaxSeqNo: 45 sessionId: src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0
2025-10-01T14:08:31.013619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c332baf3-a884d562-b085653f-4d9d5ccb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:31.016220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0] Write session: try to update token
2025-10-01T14:08:31.016238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:31.058446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 556 sessionId: src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:31.061067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:31.061156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254985768406374:5713]
2025-10-01T14:08:31.062356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.062392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.062437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:31.062647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:31.067936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254985768406374:5713], now have 1 active actors on pipe
2025-10-01T14:08:31.068059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 555, pipe: [1:7556254985768406374:5713]
2025-10-01T14:08:31.074977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:31.074997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:31.075002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:31.075004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:31.075014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254979096575551:5405]
2025-10-01T14:08:31.075019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254979096575551:5405]
2025-10-01T14:08:31.075022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254979096575551:5405]
2025-10-01T14:08:31.075069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:31.075077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.075079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:31.075217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:31.079250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:31.079267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:31.079271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:31.265319Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:31.274913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.274938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.275124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.275187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.275250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.275315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.275675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.275682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.275760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.275826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.275889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.275959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.276000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.276003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.276073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.276175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.276237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.276328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.276373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.276376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.276445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.276506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.276565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.276628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.276667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.276671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.276742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.276813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.276870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.276929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.277057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.277061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.277134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.277193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.277255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.277330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.277444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.277450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.277526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.277582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.277639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.277699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.277741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.277744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.277807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.277868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.277925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.277985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.278229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.278232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.278305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.278362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.278858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.278934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.278979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.278982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.279056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.279112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.279184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.279243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.279282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.279285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.280433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:31.280446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:31.280474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 556 reason: error at write: Disconnected sessionId: src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0
2025-10-01T14:08:31.280654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 556 sessionId: src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0 is DEAD
2025-10-01T14:08:31.280799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254985768406374:5713]
2025-10-01T14:08:31.280824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:31.281201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:31.281209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0] Write session will restart in 0.009778s
2025-10-01T14:08:31.281234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0] Write session: Do CDS request
2025-10-01T14:08:31.281241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:31.281604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:31.294963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:31.295424Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:31.295441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 557
2025-10-01T14:08:31.295628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:31.295661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:31.295666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:31.295669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:31.296845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 557 sessionId:  describe result for acl check
2025-10-01T14:08:31.296883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:31.296885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:31.296886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:31.296891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254985768406436:6054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:31.297405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254985768406436:6054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:31.305919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254985768406436:6054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:31.310293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:31.319298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:31.319579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:31.319584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:31.319597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:31.319655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:31.319692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254983391542999:5408]
2025-10-01T14:08:31.320356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:31.320844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:31.320894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:31.321241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:31.321289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.321290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.321292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.321293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.321294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.321295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.321296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.321298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.321299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.321300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.321302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.321303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.321304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.321305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.321309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.321319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.321322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.321326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.321329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.321333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.321336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.321340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.321344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.321347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.321351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.321355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.321358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.321362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.321369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.321377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.321382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.321388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.321392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.321396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.321400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.321406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.321411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.321416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.321421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.321426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.321431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.321437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.321441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.321446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.321450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.321455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.321461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.321466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.321471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.321476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.321482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.321487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.321493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.321498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.321502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.321507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.321549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:31.323203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254985768406436:6054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:31.323222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254985768406436:6054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:31.323225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254985768406436:6054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:31.323235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:31.327018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:31.327639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:31.327645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:31.327647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:31.327651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:31.327658Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 556 [2:7556254983391542999:5408]
2025-10-01T14:08:31.327674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:31.327693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:31.327697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:31.327701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:31.327704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:31.327722Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:31.327728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:31.327734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:31.327796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.327798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.327801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.327804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:31.327807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:31.327879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:31.327882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.327893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.327904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.327921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:31.327939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254983391542993:5408]
2025-10-01T14:08:31.327941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254983391542993:5408]
2025-10-01T14:08:31.327944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254983391542993:5408]
2025-10-01T14:08:31.327957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:31.327972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:31.327987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:31.327990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:31.328026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254983391542993:5408]
2025-10-01T14:08:31.328028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:31.328273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:31.328281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:31.328284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:31.328288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:31.328616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 556
2025-10-01T14:08:31.328664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 556
2025-10-01T14:08:31.329243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254985768406390:2446], now have 1 active actors on pipe
2025-10-01T14:08:31.329254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254985768406536:6054], now have 1 active actors on pipe
2025-10-01T14:08:31.329274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.329279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.329307Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:31.329315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:31.329319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:31.329321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:31.329332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:31.329344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:31.329360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:31.329654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.329661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.329675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:31.330259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1fffd9-f4d1f7b5-ee952fd5-f26e9124_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:31.332839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0] Write session: try to update token
2025-10-01T14:08:31.332857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:31.329807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 557 partition: 0 MaxSeqNo: 45 sessionId: src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0
2025-10-01T14:08:31.382715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254985768406555:5713]
2025-10-01T14:08:31.383789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 557 sessionId: src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:31.386228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:31.386813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.386835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.386871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:31.390854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:31.394751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254985768406555:5713], now have 1 active actors on pipe
2025-10-01T14:08:31.404216Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:31.404240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:31.404242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:31.404244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:31.404253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254983391542993:5408]
2025-10-01T14:08:31.404257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254983391542993:5408]
2025-10-01T14:08:31.404261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254983391542993:5408]
2025-10-01T14:08:31.404311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:31.404318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.404320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:31.404466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:31.406909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:31.406931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:31.406935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:31.415718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 556, pipe: [1:7556254985768406555:5713]
2025-10-01T14:08:31.601028Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:31.609104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.609137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.609297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.609364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.609426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.609497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.609650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.609661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.609733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.609789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.609893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.609955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.610320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.610330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.610408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.610463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.610526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.610584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.610626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.610629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.610702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.610760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.610820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.610902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.610942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.610945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.611013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.611069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.611127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.611192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.611232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.611236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.611336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.611391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.611458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.611521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.611567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.611571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.611635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.611712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.611772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.611832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.611884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.611894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.611963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.612064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.612132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.612199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.612252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.612259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.612367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.612442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.612538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.612607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.612648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.612651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.612721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:31.612800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:31.612933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:31.613006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:31.613049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:31.613050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:31.617689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:31.618455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:31.618508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254985768406555:5713]
2025-10-01T14:08:31.618514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:31.618517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:31.618544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 557 reason: error at write: Disconnected sessionId: src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0
2025-10-01T14:08:31.618738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 557 sessionId: src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0 is DEAD
2025-10-01T14:08:31.622741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:31.622755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0] Write session will restart in 0.009004s
2025-10-01T14:08:31.622785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0] Write session: Do CDS request
2025-10-01T14:08:31.622792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:31.634853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:31.635240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:31.635257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 558
2025-10-01T14:08:31.635386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:31.635418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:31.635424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:31.635427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:31.635775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 558 sessionId:  describe result for acl check
2025-10-01T14:08:31.635805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:31.635809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:31.635811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:31.635818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254985768406587:6066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:31.636357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254985768406587:6066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:31.649065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254985768406587:6066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:31.675882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254985768406587:6066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:31.675900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254985768406587:6066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:31.675904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254985768406587:6066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:31.675913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:31.690488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:31.691137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:31.691328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:31.691333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:31.691345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:31.691387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:31.691422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254983391543160:5413]
2025-10-01T14:08:31.692153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:31.692632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:31.692673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:31.693052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:31.693113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.693114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.693115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.693116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.693117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.693118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.693119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.693120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.693121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.693122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.693123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.693124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.693125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.693126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.693132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.693141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.693145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.693148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.693152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.693156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.693159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.693162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.693166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.693169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.693173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.693176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.693180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.693183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.693194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.693202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.693208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.693213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.693217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.693222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.693226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.693231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.693238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.693243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.693247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.693252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.693257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.693262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.693267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.693272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.693276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.693281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.693285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.693289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.693304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.693309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.693314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.693319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.693323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.693327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.693332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.693337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.693374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:31.698582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:31.699396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:31.699402Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:31.699408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:31.699411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:31.699419Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 557 [2:7556254983391543160:5413]
2025-10-01T14:08:31.699435Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:31.699452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:31.699455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:31.699459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:31.699462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:31.699479Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:31.699486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:31.699494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:31.699554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.699556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.699558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.699561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:31.699564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:31.699655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:31.699658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.699669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.699681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.699697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:31.699714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254983391543152:5413]
2025-10-01T14:08:31.699716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254983391543152:5413]
2025-10-01T14:08:31.699718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254983391543152:5413]
2025-10-01T14:08:31.699731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:31.699743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:31.699757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:31.699760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:31.699795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254983391543152:5413]
2025-10-01T14:08:31.699798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:31.700027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:31.700029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:31.700032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:31.700036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:31.700747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 557
2025-10-01T14:08:31.700802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 557
2025-10-01T14:08:31.704646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254985768406571:2446], now have 1 active actors on pipe
2025-10-01T14:08:31.704667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254985768406658:6066], now have 1 active actors on pipe
2025-10-01T14:08:31.704699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.704706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.704742Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:31.704755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:31.704761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:31.704763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:31.704775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:31.704806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:31.704826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:31.705213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.705224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.705241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:31.705379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 558 partition: 0 MaxSeqNo: 45 sessionId: src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0
2025-10-01T14:08:31.706499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed0483b5-79018e8c-93cfd75d-3f84f8aa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:31.709088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0] Write session: try to update token
2025-10-01T14:08:31.709107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:31.719945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254985768406714:5713]
2025-10-01T14:08:31.723580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 557, pipe: [1:7556254985768406714:5713]
2025-10-01T14:08:31.723648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254985768406714:5713], now have 1 active actors on pipe
2025-10-01T14:08:31.737353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:31.737380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:31.737383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:31.737385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:31.737395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254983391543152:5413]
2025-10-01T14:08:31.737401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254983391543152:5413]
2025-10-01T14:08:31.737405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254983391543152:5413]
2025-10-01T14:08:31.737458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:31.737466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.737469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:31.737655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:31.738680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:31.738695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:31.738699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:31.744833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 558 sessionId: src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:31.747481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:31.903555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:31.904628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.904649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.906792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:31.907055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:31.907112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:31.907116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:31.907656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:31.907667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0] Write session will restart in 0.007704s
2025-10-01T14:08:31.907289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 558 reason: error at write: Disconnected sessionId: src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0
2025-10-01T14:08:31.907506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 558 sessionId: src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0 is DEAD
2025-10-01T14:08:31.907649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254985768406714:5713]
2025-10-01T14:08:31.907694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0] Write session: Do CDS request
2025-10-01T14:08:31.907755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:31.917379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:31.919169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:31.919186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 559
2025-10-01T14:08:31.919585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:31.919614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:31.919621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:31.919625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:31.920077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 559 sessionId:  describe result for acl check
2025-10-01T14:08:31.920110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:31.920112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:31.920114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:31.920118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254985768406728:6070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:31.920673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254985768406728:6070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:31.925526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254985768406728:6070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:31.935610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254985768406728:6070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:31.935628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254985768406728:6070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:31.935632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254985768406728:6070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:31.935641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:31.948599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:31.949239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:31.949446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:31.949452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:31.949465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:31.949518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:31.949564Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254983391543313:5426]
2025-10-01T14:08:31.950286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:31.951915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:31.951975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:31.952318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:31.952367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.952368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.952370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.952371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.952373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.952374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.952375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.952376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.952378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.952379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.952380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.952381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.952382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.952383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.952389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.952399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.952403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.952407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.952411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.952415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.952419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.952423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.952426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.952432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.952435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.952439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.952442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.952445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.952452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.952461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:31.952468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.952475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:31.952479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.952484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:31.952488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.952493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:31.952501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.952506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:31.952510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.952514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:31.952519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.952524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:31.952529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.952534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:31.952538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.952543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:31.952547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.952552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.952556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.952561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.952565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.952570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.952575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.952581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:31.952585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.952591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:31.952632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:31.958216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:31.958864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:31.958869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:31.958872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:31.958876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:31.958884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 558 [2:7556254983391543313:5426]
2025-10-01T14:08:31.958901Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:31.958919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:31.958923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:31.958927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:31.958929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:31.958947Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:31.958952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:31.958958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:31.959022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.959024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.959027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.959030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:31.959034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:31.959113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:31.959116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.959129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:31.959139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:31.959154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:31.959171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254983391543308:5426]
2025-10-01T14:08:31.959173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254983391543308:5426]
2025-10-01T14:08:31.959175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254983391543308:5426]
2025-10-01T14:08:31.959190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:31.959203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:31.959218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:31.959220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:31.959260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254983391543308:5426]
2025-10-01T14:08:31.959262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:31.959508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:31.959517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:31.959519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:31.959524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:31.961906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254985768406719:2446], now have 1 active actors on pipe
2025-10-01T14:08:31.961924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254985768406822:6070], now have 1 active actors on pipe
2025-10-01T14:08:31.963199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.963217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.963255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ec29859-4213593f-6f068e83-3a954b69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:31.963267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:31.963273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:31.963276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:31.963288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:31.963303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:31.963325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:31.962464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 558
2025-10-01T14:08:31.962514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 558
2025-10-01T14:08:31.976015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:31.976040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:31.976086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:31.982503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 559 partition: 0 MaxSeqNo: 45 sessionId: src_id|4ec29859-4213593f-6f068e83-3a954b69_0
2025-10-01T14:08:31.983138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fd0b7-3de507aa-da39a036-3291da1c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4ec29859-4213593f-6f068e83-3a954b69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:31.985761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec29859-4213593f-6f068e83-3a954b69_0] Write session: try to update token
2025-10-01T14:08:31.985783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec29859-4213593f-6f068e83-3a954b69_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:31.993065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:31.993089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:31.993092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:31.993095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:31.993105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254983391543308:5426]
2025-10-01T14:08:31.993110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254983391543308:5426]
2025-10-01T14:08:31.993114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254983391543308:5426]
2025-10-01T14:08:31.993163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:31.993170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:31.993172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:31.993309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:31.994539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:31.994557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:31.994561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:32.012745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254990063374158:5713]
2025-10-01T14:08:32.015292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 558, pipe: [1:7556254990063374158:5713]
2025-10-01T14:08:32.019918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 559 sessionId: src_id|4ec29859-4213593f-6f068e83-3a954b69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:32.022610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:32.204923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:32.205579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374158:5713], now have 1 active actors on pipe
2025-10-01T14:08:32.205612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.205619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.206086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:32.206927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254990063374158:5713]
2025-10-01T14:08:32.206955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:32.207011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:32.207314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 559 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ec29859-4213593f-6f068e83-3a954b69_0
2025-10-01T14:08:32.207484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 559 sessionId: src_id|4ec29859-4213593f-6f068e83-3a954b69_0 is DEAD
2025-10-01T14:08:32.208925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec29859-4213593f-6f068e83-3a954b69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:32.208936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec29859-4213593f-6f068e83-3a954b69_0] Write session will restart in 0.009546s
2025-10-01T14:08:32.208967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec29859-4213593f-6f068e83-3a954b69_0] Write session: Do CDS request
2025-10-01T14:08:32.208973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec29859-4213593f-6f068e83-3a954b69_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:32.220677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec29859-4213593f-6f068e83-3a954b69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:32.222762Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:32.222784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 560
2025-10-01T14:08:32.223011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:32.223042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:32.223048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:32.223053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:32.226735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 560 sessionId:  describe result for acl check
2025-10-01T14:08:32.226779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:32.226781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:32.226782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:32.226788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254990063374219:6077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:32.227409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254990063374219:6077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:32.240078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:32.246648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:32.246951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:32.246956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:32.246969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:32.247024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:32.247066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254987686510757:5428]
2025-10-01T14:08:32.247697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:32.248220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:32.248275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:32.248622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:32.248680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.248682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.248683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.248684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.248686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.248687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.248689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.248690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.248691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.248693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.248694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.248695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.248697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.248698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.248705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.248715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.248719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.248725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.248730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.248734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.248738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.248741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.248746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.248750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.248754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.248758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.248762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.248768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.248774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.248795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.248802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.248807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.248812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.248817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.248821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.248826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.248831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.248836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.248841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.248846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.248850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.248855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.248860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.248865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.248870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.248875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.248878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.248883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.248887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.248892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.248896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.248902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.248906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.248911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.248915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.248920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.248959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:32.255248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:32.255892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:32.255902Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:32.255906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:32.255910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:32.255918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 559 [2:7556254987686510757:5428]
2025-10-01T14:08:32.255935Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:32.255955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:32.255958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:32.255962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:32.255965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:32.255983Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:32.255990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:32.255997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:32.256060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.256062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.256065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.256069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:32.256072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:32.256146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:32.256149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.256162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.256174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.256190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:32.256208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254987686510751:5428]
2025-10-01T14:08:32.256210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254987686510751:5428]
2025-10-01T14:08:32.256215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254987686510751:5428]
2025-10-01T14:08:32.256224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:32.256232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:32.256236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:32.256238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:32.256238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:32.256252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:32.256256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:32.256266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374169:2446], now have 1 active actors on pipe
2025-10-01T14:08:32.256307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254987686510751:5428]
2025-10-01T14:08:32.256316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:32.256508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:32.256589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 559
2025-10-01T14:08:32.257303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254990063374219:6077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:32.275195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254990063374219:6077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:32.275213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254990063374219:6077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:32.275216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254990063374219:6077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:32.275226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:32.282554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374310:6077], now have 1 active actors on pipe
2025-10-01T14:08:32.282668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 559
2025-10-01T14:08:32.282802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.282814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.282849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11956528-40c5f6ec-dcf471e9-384030cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:32.282860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:32.282871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:32.282875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:32.282890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:32.282910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:32.282934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:32.287771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.287802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.287840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:32.288069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 560 partition: 0 MaxSeqNo: 45 sessionId: src_id|11956528-40c5f6ec-dcf471e9-384030cc_0
2025-10-01T14:08:32.292994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ec29859-4213593f-6f068e83-3a954b69_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|11956528-40c5f6ec-dcf471e9-384030cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:32.296370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11956528-40c5f6ec-dcf471e9-384030cc_0] Write session: try to update token
2025-10-01T14:08:32.296392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11956528-40c5f6ec-dcf471e9-384030cc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:32.301073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:32.301098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:32.301101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:32.301103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:32.301115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254987686510751:5428]
2025-10-01T14:08:32.301120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254987686510751:5428]
2025-10-01T14:08:32.301124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254987686510751:5428]
2025-10-01T14:08:32.301181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:32.301193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.301196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:32.301365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:32.302426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:32.302445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:32.302449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:32.308694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254990063374326:5713]
2025-10-01T14:08:32.314971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 559, pipe: [1:7556254990063374326:5713]
2025-10-01T14:08:32.335833Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 560 sessionId: src_id|11956528-40c5f6ec-dcf471e9-384030cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:32.338551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:32.541871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:32.542269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374326:5713], now have 1 active actors on pipe
2025-10-01T14:08:32.542312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.542317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.543018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:32.543116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:32.543169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254990063374326:5713]
2025-10-01T14:08:32.543191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:32.543194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:32.550223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 560 reason: error at write: Disconnected sessionId: src_id|11956528-40c5f6ec-dcf471e9-384030cc_0
2025-10-01T14:08:32.550465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 560 sessionId: src_id|11956528-40c5f6ec-dcf471e9-384030cc_0 is DEAD
2025-10-01T14:08:32.558850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11956528-40c5f6ec-dcf471e9-384030cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:32.558862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11956528-40c5f6ec-dcf471e9-384030cc_0] Write session will restart in 0.008085s
2025-10-01T14:08:32.558890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11956528-40c5f6ec-dcf471e9-384030cc_0] Write session: Do CDS request
2025-10-01T14:08:32.558897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11956528-40c5f6ec-dcf471e9-384030cc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:32.568291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11956528-40c5f6ec-dcf471e9-384030cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:32.568579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:32.568594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 561
2025-10-01T14:08:32.568761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:32.568813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:32.568819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:32.568822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:32.571080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 561 sessionId:  describe result for acl check
2025-10-01T14:08:32.571125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:32.571127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:32.571129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:32.571136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254990063374381:6089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:32.571648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254990063374381:6089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:32.577840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254990063374381:6089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:32.581753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:32.584020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:32.584270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:32.584280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:32.584292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:32.584344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:32.584380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254987686510905:5434]
2025-10-01T14:08:32.584953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:32.585435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:32.585484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:32.585805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:32.585865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.585866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.585867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.585869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.585870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.585871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.585872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.585873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.585875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.585876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.585877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.585878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.585879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.585880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.585885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.585896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.585900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.585903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.585906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.585909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.585913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.585916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.585919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.585922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.585925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.585928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.585931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.585934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.585941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.585948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.585954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.585958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.585962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.585967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.585971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.585976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.585980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.585984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.585989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.585994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.585999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.586003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.586007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.586011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.586015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.586019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.586023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.586028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.586032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.586036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.586040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.586044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.586048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.586053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.586057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.586062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.586095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:32.586110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254990063374381:6089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:32.586127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254990063374381:6089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:32.586130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254990063374381:6089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:32.586140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:32.591016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:32.592029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:32.592044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:32.592048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:32.592052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:32.592060Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 560 [2:7556254987686510905:5434]
2025-10-01T14:08:32.592080Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:32.592098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:32.592102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:32.592106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:32.592108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:32.592127Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:32.592133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:32.592140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:32.592203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.592205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.592208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.592211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:32.592213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:32.592290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:32.592292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.592305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.592316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.592331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:32.592348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254987686510899:5434]
2025-10-01T14:08:32.592350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254987686510899:5434]
2025-10-01T14:08:32.592353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254987686510899:5434]
2025-10-01T14:08:32.592361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:32.592375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:32.592377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:32.592380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:32.592382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:32.592389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:32.592392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:32.592403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374486:6089], now have 1 active actors on pipe
2025-10-01T14:08:32.592406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374352:2446], now have 1 active actors on pipe
2025-10-01T14:08:32.592442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254987686510899:5434]
2025-10-01T14:08:32.592451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:32.592477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:32.592762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 560
2025-10-01T14:08:32.592803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 560
2025-10-01T14:08:32.593442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.593460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.593487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb96a559-8abd1d2c-53811b9b-da777853_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:32.593502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:32.593506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:32.593512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:32.593519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:32.593528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:32.593546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:32.593815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.593828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.593850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:32.594191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 561 partition: 0 MaxSeqNo: 45 sessionId: src_id|cb96a559-8abd1d2c-53811b9b-da777853_0
2025-10-01T14:08:32.594653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11956528-40c5f6ec-dcf471e9-384030cc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cb96a559-8abd1d2c-53811b9b-da777853_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:32.597873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb96a559-8abd1d2c-53811b9b-da777853_0] Write session: try to update token
2025-10-01T14:08:32.597898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb96a559-8abd1d2c-53811b9b-da777853_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:32.620057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 561 sessionId: src_id|cb96a559-8abd1d2c-53811b9b-da777853_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:32.618751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:32.618770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:32.618775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:32.618777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:32.618789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254987686510899:5434]
2025-10-01T14:08:32.618794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254987686510899:5434]
2025-10-01T14:08:32.618798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254987686510899:5434]
2025-10-01T14:08:32.618846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:32.618853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.618858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:32.619011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:32.622628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:32.622643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:32.622648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:32.622730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:32.643110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254990063374498:5713]
2025-10-01T14:08:32.643381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 560, pipe: [1:7556254990063374498:5713]
2025-10-01T14:08:32.779284Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:32.779501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.779509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.779544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374498:5713], now have 1 active actors on pipe
2025-10-01T14:08:32.779917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:32.779843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:32.779902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254990063374498:5713]
2025-10-01T14:08:32.779936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:32.779939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:32.779992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 561 reason: error at write: Disconnected sessionId: src_id|cb96a559-8abd1d2c-53811b9b-da777853_0
2025-10-01T14:08:32.780477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb96a559-8abd1d2c-53811b9b-da777853_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:32.780484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb96a559-8abd1d2c-53811b9b-da777853_0] Write session will restart in 0.008746s
2025-10-01T14:08:32.780503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb96a559-8abd1d2c-53811b9b-da777853_0] Write session: Do CDS request
2025-10-01T14:08:32.780512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb96a559-8abd1d2c-53811b9b-da777853_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:32.780143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 561 sessionId: src_id|cb96a559-8abd1d2c-53811b9b-da777853_0 is DEAD
2025-10-01T14:08:32.790013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb96a559-8abd1d2c-53811b9b-da777853_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:32.790343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:32.790361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 562
2025-10-01T14:08:32.790579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:32.790611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:32.790616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:32.790619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:32.791188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 562 sessionId:  describe result for acl check
2025-10-01T14:08:32.791228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:32.791232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:32.791233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:32.791239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254990063374565:6094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:32.791882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254990063374565:6094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:32.795583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:32.797022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254990063374565:6094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:32.798046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:32.798263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:32.798274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:32.798286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:32.798333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:32.798367Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254987686511075:5447]
2025-10-01T14:08:32.799002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:32.799358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:32.799394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:32.799691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:32.799736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.799737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.799739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.799740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.799741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.799742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.799743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.799745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.799746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.799748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.799749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.799750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.799752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.799753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.799759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.799769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.799774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.799778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.799782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.799787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.799790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.799794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.799798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.799803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.799806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.799810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.799814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.799818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.799826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.799834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:32.799840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.799846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:32.799851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.799856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:32.799861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.799867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:32.799872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.799877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:32.799881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.799887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:32.799892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.799897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:32.799902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.799907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:32.799913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.799919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:32.799924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.799929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.799934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.799939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.799943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.799949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.799953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.799959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:32.799963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.799969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:32.800011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:32.803155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254990063374565:6094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:32.803172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254990063374565:6094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:32.803176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254990063374565:6094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:32.803186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:32.809074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 561
2025-10-01T14:08:32.809113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 561
2025-10-01T14:08:32.810073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 562 partition: 0 MaxSeqNo: 45 sessionId: src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0
2025-10-01T14:08:32.810444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb96a559-8abd1d2c-53811b9b-da777853_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:32.807647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:32.808351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:32.808357Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:32.808360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:32.808364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:32.808371Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 561 [2:7556254987686511075:5447]
2025-10-01T14:08:32.808388Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:32.808407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:32.808412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:32.808416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:32.808418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:32.808436Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:32.808442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:32.808448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:32.808510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.808512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.808513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.808517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:32.808520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:32.808605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:32.808608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.808621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:32.808631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:32.808648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:32.808667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254987686511070:5447]
2025-10-01T14:08:32.808670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254987686511070:5447]
2025-10-01T14:08:32.808672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254987686511070:5447]
2025-10-01T14:08:32.808680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:32.808688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:32.808691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:32.808693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:32.808698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:32.808714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:32.808718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:32.808730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374504:2446], now have 1 active actors on pipe
2025-10-01T14:08:32.808737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374638:6094], now have 1 active actors on pipe
2025-10-01T14:08:32.808775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254987686511070:5447]
2025-10-01T14:08:32.808806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:32.808979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:32.809323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.809331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.809362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:32.809371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:32.809376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:32.809379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:32.809391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:32.809401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:32.809419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:32.809924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.809929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.809949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:32.813403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0] Write session: try to update token
2025-10-01T14:08:32.813418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:32.831114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:32.831139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:32.831142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:32.831144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:32.831156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254987686511070:5447]
2025-10-01T14:08:32.831162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254987686511070:5447]
2025-10-01T14:08:32.831166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254987686511070:5447]
2025-10-01T14:08:32.831217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:32.831226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:32.831228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:32.831391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:32.834948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:32.834967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:32.834972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:32.837351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 562 sessionId: src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:32.840120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:32.882784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254990063374647:5713]
2025-10-01T14:08:32.884111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 561, pipe: [1:7556254990063374647:5713]
2025-10-01T14:08:32.991310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:32.991605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:32.991614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:32.991661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374647:5713], now have 1 active actors on pipe
2025-10-01T14:08:32.992150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254990063374647:5713]
2025-10-01T14:08:32.992198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:32.992232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:32.992249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:32.992421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:32.992870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 562 reason: error at write: Disconnected sessionId: src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0
2025-10-01T14:08:32.993200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:32.993067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 562 sessionId: src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0 is DEAD
2025-10-01T14:08:32.993209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0] Write session will restart in 0.009058s
2025-10-01T14:08:32.993251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0] Write session: Do CDS request
2025-10-01T14:08:32.993257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:33.006919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:33.010546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:33.010563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 563
2025-10-01T14:08:33.010777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:33.010812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:33.010818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:33.010821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:33.011459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 563 sessionId:  describe result for acl check
2025-10-01T14:08:33.011496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:33.011498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:33.011500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:33.011506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254994358341982:6098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:33.012029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254994358341982:6098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:33.016917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254994358341982:6098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:33.025201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:33.025449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254994358341982:6098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:33.025467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254994358341982:6098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:33.025471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254994358341982:6098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:33.025481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:33.028478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:33.028806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:33.028822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:33.028841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:33.028923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:33.028973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254991981478512:5449]
2025-10-01T14:08:33.029553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:33.030014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:33.030074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:33.030483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:33.030547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.030553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.030554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.030556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.030557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.030559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.030560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.030561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.030563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.030564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.030565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.030567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.030568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.030569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.030576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.030586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.030590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.030594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.030597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.030601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.030604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.030609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.030613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.030618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.030621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.030626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.030630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.030633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.030642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.030651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.030658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.030664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.030669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.030674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.030678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.030692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.030697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.030702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.030707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.030713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.030718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.030724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.030728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.030733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.030739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.030744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.030749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.030754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.030762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.030767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.030772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.030777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.030782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.030787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.030792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.030797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.030841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:33.039081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:33.039936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:33.039955Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:33.039958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:33.039962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:33.039968Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 562 [2:7556254991981478512:5449]
2025-10-01T14:08:33.039986Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:33.040006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:33.040008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:33.040012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:33.040015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:33.040033Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:33.040038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:33.040045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:33.040108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.040110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.040112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.040116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:33.040118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:33.040192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:33.040195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.040208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.040217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.040231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:33.040249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254991981478505:5449]
2025-10-01T14:08:33.040252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254991981478505:5449]
2025-10-01T14:08:33.040254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254991981478505:5449]
2025-10-01T14:08:33.040266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:33.040280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:33.040294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:33.040297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:33.040343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254991981478505:5449]
2025-10-01T14:08:33.040345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:33.040432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:33.040434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:33.040436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:33.040440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:33.041336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 562
2025-10-01T14:08:33.041368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 562
2025-10-01T14:08:33.041600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342080:6098], now have 1 active actors on pipe
2025-10-01T14:08:33.041612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254990063374653:2446], now have 1 active actors on pipe
2025-10-01T14:08:33.041626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.041633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.041664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:33.041673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:33.041679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:33.041683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:33.041693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:33.041708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:33.041728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:33.042022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.042029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.042044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:33.042175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 563 partition: 0 MaxSeqNo: 45 sessionId: src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0
2025-10-01T14:08:33.042578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb5eb19d-8bb1850a-95064071-95c5a8b8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:33.045311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0] Write session: try to update token
2025-10-01T14:08:33.045331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:33.074557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 563 sessionId: src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:33.076955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:33.077687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.077722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.077780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:33.077960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:33.094534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254994358342090:5713]
2025-10-01T14:08:33.094992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342090:5713], now have 1 active actors on pipe
2025-10-01T14:08:33.095116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 562, pipe: [1:7556254994358342090:5713]
2025-10-01T14:08:33.114078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.114114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.114297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.114350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.118503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.118594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.118765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.118769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.118852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.118911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.118969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.119402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.119618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.119621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.119682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.119735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.119794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.119847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.119888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.119890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.119944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.119995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.120046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.120099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.120133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.120135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.120191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.120249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.120312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.120367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.120404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.120406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.120470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.120523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.120576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.120631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.120667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.120669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.120728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.120807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.120865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.120918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.120965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.120967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.121025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.121078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.121133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.121187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.121223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.121227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.121297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.121351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.121406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.121464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.121618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.121620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.121679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.121729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.121788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.121845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.121930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.121932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.122036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:08:33.122085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:33.122097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:33.122100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:08:33.122114Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122121Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122126Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122129Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122132Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122230Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122233Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122235Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122237Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122240Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122243Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122247Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122249Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122252Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122255Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122312Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122314Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122316Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122319Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122323Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122365Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122653Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122670Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122674Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122677Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122706Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122709Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122712Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122715Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122719Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122721Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122738Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122741Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122744Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122747Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:33.122772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:08:33.122782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:08:33.122785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:08:33.122787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:08:33.122790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:08:33.123217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:08:33.123236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:08:33.123243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:08:33.123246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:08:33.123249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:08:33.123252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:08:33.123751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:08:33.123764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:08:33.123769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:08:33.123772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:08:33.123774Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:08:33.123777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:08:33.124290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:08:33.124299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:33.124407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327713122
2025-10-01T14:08:33.127516Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:08:33.127555Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:08:33.127568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:33.127572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:33.127574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:33.127577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:33.127584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254991981478505:5449]
2025-10-01T14:08:33.127588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254991981478505:5449]
2025-10-01T14:08:33.127591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254991981478505:5449]
2025-10-01T14:08:33.127684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:33.127688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.127690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:33.127825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:33.130430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:33.130437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:33.130441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:33.304153Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:33.307964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:33.307976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0] Write session will restart in 0.005821s
2025-10-01T14:08:33.308001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0] Write session: Do CDS request
2025-10-01T14:08:33.308007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:33.307034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:33.307048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:33.307074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 563 reason: error at write: Disconnected sessionId: src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0
2025-10-01T14:08:33.307250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 563 sessionId: src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0 is DEAD
2025-10-01T14:08:33.307376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:33.307410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254994358342090:5713]
2025-10-01T14:08:33.310604Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:33.315030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:33.315338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:33.315353Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 564
2025-10-01T14:08:33.315555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:33.315585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:33.315590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:33.315593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:33.316017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 564 sessionId:  describe result for acl check
2025-10-01T14:08:33.316043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:33.316044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:33.316045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:33.316050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254994358342124:6104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:33.316544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254994358342124:6104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:33.320311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254994358342124:6104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:33.325113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254994358342124:6104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:33.325124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254994358342124:6104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:33.325127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254994358342124:6104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:33.325133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:33.352699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:33.356927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:33.357190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:33.357195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:33.357208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:33.357272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:33.357314Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254991981478670:5452]
2025-10-01T14:08:33.357766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:33.358200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:33.358239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:33.358546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:33.358597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.358597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.358598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.358599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.358600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.358601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.358601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.358602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.358603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.358604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.358604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.358605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.358606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.358607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.358612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.358618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.358620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.358623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.358625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.358628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.358630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.358632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.358634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.358636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.358638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.358640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.358642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.358644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.358649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.358654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.358658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.358663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.358665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.358668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.358671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.358674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.358677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.358681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.358683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.358686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.358690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.358692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.358695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.358698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.358701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.358704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.358707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.358711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.358714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.358716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.358719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.358721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.358724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.358727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.358729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.358733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.358773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:33.364393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:33.365330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:33.365346Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:33.365349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:33.365352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:33.365359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 563 [2:7556254991981478670:5452]
2025-10-01T14:08:33.365375Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:33.365396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:33.365399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:33.365403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:33.365406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:33.365424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:33.365430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:33.365440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:33.365505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.365507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.365510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.365513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:33.365516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:33.365587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:33.365589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.365601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.365611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.365625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:33.365642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254991981478664:5452]
2025-10-01T14:08:33.365645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254991981478664:5452]
2025-10-01T14:08:33.365647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254991981478664:5452]
2025-10-01T14:08:33.365659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:33.365673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:33.365686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:33.365689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:33.365730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254991981478664:5452]
2025-10-01T14:08:33.365733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:33.365867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:33.365868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:33.365870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:33.365874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:33.366252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 563
2025-10-01T14:08:33.366292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 563
2025-10-01T14:08:33.370088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342117:2446], now have 1 active actors on pipe
2025-10-01T14:08:33.370105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342161:6104], now have 1 active actors on pipe
2025-10-01T14:08:33.370134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.370140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.370180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:33.370194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:33.370200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:33.370203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:33.370218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:33.370236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:33.370257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:33.370684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.370693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.370711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:33.370844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 564 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0
2025-10-01T14:08:33.371548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef840a4c-36c0753f-b3f0d5b-eebbc4d8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:33.374145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0] Write session: try to update token
2025-10-01T14:08:33.374164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:33.393151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 564 sessionId: src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:33.395713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:33.396253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.396274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.396312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:33.396459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:33.409304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:33.409328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:33.409331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:33.409334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:33.409345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254991981478664:5452]
2025-10-01T14:08:33.409350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254991981478664:5452]
2025-10-01T14:08:33.409354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254991981478664:5452]
2025-10-01T14:08:33.409404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:33.409412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.409414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:33.409570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:33.410440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254994358342263:5713]
2025-10-01T14:08:33.411129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:33.411138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:33.411141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:33.411255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 563, pipe: [1:7556254994358342263:5713]
2025-10-01T14:08:33.636859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:33.637265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342263:5713], now have 1 active actors on pipe
2025-10-01T14:08:33.645506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.645542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.645731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.645795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.645860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.645927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.646391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.646399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.646481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.646547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.646614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.646686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.646729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.646735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.646809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.646868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.646927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.646987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.647031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.647033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.647105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.647165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.647220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.647274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.647321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.647324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.647403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.647464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.647531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.647591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.647635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.647638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.647707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.647762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.647827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.647897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.647943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.647944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.648004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.648054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.648116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.648180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.648226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.648229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.648294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.648351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.648413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.648476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.648528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.648530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.648600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.648666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.648732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.648809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.648853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.648855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.648932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:33.648992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:33.649054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:33.649118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:33.649160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:33.649163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:33.650141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:33.651315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:33.651376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254994358342263:5713]
2025-10-01T14:08:33.652002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:33.652015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0] Write session will restart in 0.005382s
2025-10-01T14:08:33.652042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0] Write session: Do CDS request
2025-10-01T14:08:33.652049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:33.651402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:33.651444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 564 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0
2025-10-01T14:08:33.651633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 564 sessionId: src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0 is DEAD
2025-10-01T14:08:33.659358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:33.659838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:33.659854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 565
2025-10-01T14:08:33.660239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:33.660282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:33.660288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:33.660291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:33.661016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 565 sessionId:  describe result for acl check
2025-10-01T14:08:33.661049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:33.661051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:33.661053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:33.661059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254994358342303:6116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:33.661487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254994358342303:6116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:33.666887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254994358342303:6116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:33.679014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254994358342303:6116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:33.679033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254994358342303:6116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:33.679036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254994358342303:6116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:33.679046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:33.683011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:33.685396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:33.685583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:33.685588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:33.685597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:33.685635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:33.685663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254991981478820:5457]
2025-10-01T14:08:33.686083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:33.686447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:33.686480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:33.686722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:33.686758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.686758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.686759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.686760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.686760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.686761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.686762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.686763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.686764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.686765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.686765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.686766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.686766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.686767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.686770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.686776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.686778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.686781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.686783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.686785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.686788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.686790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.686792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.686794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.686796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.686798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.686800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.686803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.686808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.686812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.686817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.686820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.686823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.686826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.686828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.686832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.686834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.686837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.686840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.686843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.686846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.686849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.686851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.686854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.686857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.686860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.686863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.686866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.686868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.686872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.686874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.686877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.686879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.686882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.686886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.686889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.686912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:33.691382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:33.692398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:33.692405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:33.692407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:33.692410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:33.692418Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 564 [2:7556254991981478820:5457]
2025-10-01T14:08:33.692436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:33.692456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:33.692460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:33.692463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:33.692466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:33.692483Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:33.692488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:33.692496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:33.692544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.692546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.692548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.692552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:33.692554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:33.692632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:33.692635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.692646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.692656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.692671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:33.692690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254991981478815:5457]
2025-10-01T14:08:33.692693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254991981478815:5457]
2025-10-01T14:08:33.692695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254991981478815:5457]
2025-10-01T14:08:33.692708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:33.692722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:33.692736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:33.692739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:33.692776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254991981478815:5457]
2025-10-01T14:08:33.692778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:33.693039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:33.693047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:33.693049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:33.693054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:33.693418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 564
2025-10-01T14:08:33.693454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 564
2025-10-01T14:08:33.693665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342412:6116], now have 1 active actors on pipe
2025-10-01T14:08:33.693682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342295:2446], now have 1 active actors on pipe
2025-10-01T14:08:33.694045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.694058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.694092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:33.694102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:33.694108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:33.694110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:33.694122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:33.694135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:33.694153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:33.694538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.694545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.694560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:33.695046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1a2b1db-eb599bb2-661b2399-dd35538d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:33.697402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0] Write session: try to update token
2025-10-01T14:08:33.697420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:33.694682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 565 partition: 0 MaxSeqNo: 45 sessionId: src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0
2025-10-01T14:08:33.728272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:33.728295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:33.728297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:33.728299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:33.728310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254991981478815:5457]
2025-10-01T14:08:33.728315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254991981478815:5457]
2025-10-01T14:08:33.728319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254991981478815:5457]
2025-10-01T14:08:33.728393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:33.728401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.728406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:33.728565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:33.730427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:33.730436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:33.730440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:33.731373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 565 sessionId: src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:33.733889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:33.750284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254994358342441:5713]
2025-10-01T14:08:33.750733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 564, pipe: [1:7556254994358342441:5713]
2025-10-01T14:08:33.888549Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:33.888933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.888951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.888999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342441:5713], now have 1 active actors on pipe
2025-10-01T14:08:33.890618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:33.890685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:33.890741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254994358342441:5713]
2025-10-01T14:08:33.890759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:33.890762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:33.890830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 565 reason: error at write: Disconnected sessionId: src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0
2025-10-01T14:08:33.890988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 565 sessionId: src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0 is DEAD
2025-10-01T14:08:33.892583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:33.892595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0] Write session will restart in 0.006335s
2025-10-01T14:08:33.892622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0] Write session: Do CDS request
2025-10-01T14:08:33.892629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:33.900422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:33.900713Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:33.900730Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 566
2025-10-01T14:08:33.900845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:33.900886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:33.900896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:33.900899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:33.901336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 566 sessionId:  describe result for acl check
2025-10-01T14:08:33.901380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:33.901385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:33.901387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:33.901392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254994358342479:6120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:33.901840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254994358342479:6120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:33.905970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254994358342479:6120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:33.911591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:33.913972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:33.914046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254994358342479:6120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:33.914065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254994358342479:6120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:33.914068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254994358342479:6120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:33.914114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:33.914232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:33.914242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:33.914255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:33.914306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:33.914340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254991981478992:5470]
2025-10-01T14:08:33.914982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:33.915345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:33.915427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:33.915817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:33.915918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.915927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.915928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.915930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.915931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.915932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.915934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.915936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.915937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.915938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.915939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.915941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.915942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.915943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.915950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.915960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.915964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.915969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.915972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.915977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.915980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.915984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.915987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.915992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.915996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.915999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.916003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.916006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.916014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.916023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:33.916030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.916035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:33.916040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.916046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:33.916051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.916055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:33.916060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.916065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:33.916078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.916084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:33.916094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.916099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:33.916108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.916112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:33.916118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.916124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:33.916128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.916132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.916137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.916142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.916146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.916158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.916164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.916168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:33.916180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.916184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:33.916222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:33.921234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:33.921963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:33.921983Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:33.921987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:33.921991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:33.922001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 565 [2:7556254991981478992:5470]
2025-10-01T14:08:33.922020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:33.922041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:33.922050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:33.922054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:33.922057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:33.922074Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:33.922082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:33.922095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:33.922161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.922169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.922172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.922175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:33.922178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:33.922254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:33.922264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.922277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:33.922290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:33.922309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:33.922331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254991981478986:5470]
2025-10-01T14:08:33.922338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254991981478986:5470]
2025-10-01T14:08:33.922341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254991981478986:5470]
2025-10-01T14:08:33.922351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:33.922385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:33.922405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:33.922409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:33.922970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 565
2025-10-01T14:08:33.923005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 565
2025-10-01T14:08:33.922450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254991981478986:5470]
2025-10-01T14:08:33.922460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:33.922556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:33.922558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:33.922560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:33.922567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:33.923879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342581:6120], now have 1 active actors on pipe
2025-10-01T14:08:33.923897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342447:2446], now have 1 active actors on pipe
2025-10-01T14:08:33.923913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.923920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.923954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:33.923970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:33.923975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:33.923978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:33.923991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:33.924004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:33.924033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:33.925216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:33.925231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:33.925253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:33.925405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 566 partition: 0 MaxSeqNo: 45 sessionId: src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0
2025-10-01T14:08:33.925784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|934b2ec8-65439a85-6398ba08-500b7ed1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:33.928252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0] Write session: try to update token
2025-10-01T14:08:33.928267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:33.946728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:33.946753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:33.946756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:33.946758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:33.946769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254991981478986:5470]
2025-10-01T14:08:33.946775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254991981478986:5470]
2025-10-01T14:08:33.946779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254991981478986:5470]
2025-10-01T14:08:33.946836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:33.946844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:33.946847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:33.947051Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:33.950518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:33.950537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:33.950542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:33.970105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 566 sessionId: src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:33.972429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:33.994440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254994358342593:5713]
2025-10-01T14:08:33.998592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 565, pipe: [1:7556254994358342593:5713]
2025-10-01T14:08:34.121094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:34.121664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.121674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.121697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254994358342593:5713], now have 1 active actors on pipe
2025-10-01T14:08:34.122703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:34.122771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254994358342593:5713]
2025-10-01T14:08:34.122773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:34.122777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:34.122830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 566 reason: error at write: Disconnected sessionId: src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0
2025-10-01T14:08:34.123361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:34.123371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0] Write session will restart in 0.005101s
2025-10-01T14:08:34.123396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0] Write session: Do CDS request
2025-10-01T14:08:34.123403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:34.123006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 566 sessionId: src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0 is DEAD
2025-10-01T14:08:34.122470Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:34.133110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:34.133452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:34.133468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 567
2025-10-01T14:08:34.133798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:34.133834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:34.133840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:34.133846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:34.135495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 567 sessionId:  describe result for acl check
2025-10-01T14:08:34.135538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:34.135540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:34.135542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:34.135548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254998653309900:6124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:34.136054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254998653309900:6124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:34.143284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254998653309900:6124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:34.151016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254998653309900:6124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:34.151038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254998653309900:6124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:34.151043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254998653309900:6124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:34.151053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:34.156150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:34.157624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:34.157789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:34.157792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:34.157800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:34.157832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:34.157860Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254996276446432:5472]
2025-10-01T14:08:34.158250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:34.160098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:34.160144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:34.160393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:34.160430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.160430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.160431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.160432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.160433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.160433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.160434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.160435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.160436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.160437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.160438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.160438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.160439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.160440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.160444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.160451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.160453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.160456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.160458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.160461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.160463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.160466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.160468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.160471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.160473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.160475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.160477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.160479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.160485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.160490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.160495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.160498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.160501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.160504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.160507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.160510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.160513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.160516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.160518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.160522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.160526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.160529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.160532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.160534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.160539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.160542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.160545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.160547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.160550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.160552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.160555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.160557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.160560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.160563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.160565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.160568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.160590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:34.165071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:34.165678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:34.165682Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:34.165684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:34.165687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:34.165693Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 566 [2:7556254996276446432:5472]
2025-10-01T14:08:34.165705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:34.165720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:34.165722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:34.165724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:34.165726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:34.165748Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:34.165751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:34.165756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:34.165813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.165815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.165817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.165819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:34.165821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:34.165899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:34.165902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.165913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.165923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.165936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:34.165954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254996276446427:5472]
2025-10-01T14:08:34.165956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254996276446427:5472]
2025-10-01T14:08:34.165958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254996276446427:5472]
2025-10-01T14:08:34.165971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:34.165988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:34.166001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:34.166004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:34.166038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254996276446427:5472]
2025-10-01T14:08:34.166040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:34.166698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:34.166700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:34.166703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:34.166708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:34.167067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 566
2025-10-01T14:08:34.167099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 566
2025-10-01T14:08:34.170395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254998653310002:6124], now have 1 active actors on pipe
2025-10-01T14:08:34.170414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254998653309892:2446], now have 1 active actors on pipe
2025-10-01T14:08:34.170440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.170449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.170487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:34.170503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:34.170509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:34.170512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:34.170525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:34.170547Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:34.170569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:34.171915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 567 partition: 0 MaxSeqNo: 45 sessionId: src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0
2025-10-01T14:08:34.171753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.171762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.171776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:34.174486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5510cfc8-1a3f3543-ddfaa97b-5fffe863_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:34.177041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0] Write session: try to update token
2025-10-01T14:08:34.177061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:34.196981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:34.197004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:34.197017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556254996276446427:5472]
2025-10-01T14:08:34.197056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:34.200349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:34.200563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:34.200710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:34.200861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:34.200999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:34.201223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:34.201262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:34.208189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 567 sessionId: src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:34.210894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:34.211367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.211393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.211435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:34.211540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:34.222123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254998653310050:5713]
2025-10-01T14:08:34.222538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 566, pipe: [1:7556254998653310050:5713]
2025-10-01T14:08:34.221346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:34.221365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:34.221367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:34.221369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:34.221376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254996276446427:5472]
2025-10-01T14:08:34.221379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254996276446427:5472]
2025-10-01T14:08:34.221382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254996276446427:5472]
2025-10-01T14:08:34.221420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:34.221425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.221427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:34.221569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:34.222392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:34.222397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:34.222401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:34.387803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:34.388206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254998653310050:5713], now have 1 active actors on pipe
2025-10-01T14:08:34.396734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.396769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.396999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.397076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.397146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.397214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.397258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.397263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.397524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.397598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.397666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.397739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.397791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.397796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.397869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.397934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.397994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.398047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.398090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.398093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.398160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.398227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.398286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.398357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.398509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.398519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.398587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.398647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.398701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.398759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.398802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.398805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.398886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.398946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.399012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.399077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.399123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.399126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.399197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.399255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.399322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.399384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.399429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.399431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.399498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.399553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.399612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.399775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.399823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.399828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.399900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.399959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.400017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.400079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.400120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.400123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.400194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.400254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.400315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.400378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.400418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.400421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.401992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254998653310050:5713]
2025-10-01T14:08:34.402034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:34.402037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:34.402065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 567 reason: error at write: Disconnected sessionId: src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0
2025-10-01T14:08:34.402414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:34.402431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0] Write session will restart in 0.006549s
2025-10-01T14:08:34.402456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0] Write session: Do CDS request
2025-10-01T14:08:34.402462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:34.402351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 567 sessionId: src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0 is DEAD
2025-10-01T14:08:34.402403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:34.402763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:34.410825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:34.411515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:34.411533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 568
2025-10-01T14:08:34.411766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:34.411810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:34.411816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:34.411820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:34.412372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 568 sessionId:  describe result for acl check
2025-10-01T14:08:34.412412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:34.412418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:34.412420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:34.412425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254998653310082:6130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:34.412987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254998653310082:6130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:34.422648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254998653310082:6130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:34.436153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:34.438201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:34.438477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:34.438490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:34.438502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:34.438559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:34.438602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254996276446591:5476]
2025-10-01T14:08:34.439188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:34.439022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254998653310082:6130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:34.439042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254998653310082:6130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:34.439045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254998653310082:6130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:34.439055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:34.440020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:34.440075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:34.440387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:34.440428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.440429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.440430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.440431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.440432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.440433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.440433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.440434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.440435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.440436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.440437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.440437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.440438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.440439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.440443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.440450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.440452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.440454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.440457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.440459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.440461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.440464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.440467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.440471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.440475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.440478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.440482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.440485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.440493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.440500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.440507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.440512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.440517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.440521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.440526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.440530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.440535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.440539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.440543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.440548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.440553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.440558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.440562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.440566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.440571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.440575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.440580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.440585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.440589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.440595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.440599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.440603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.440608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.440613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.440616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.440621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.440656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:34.447057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:34.447719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:34.447734Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:34.447737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:34.447741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:34.447748Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 567 [2:7556254996276446591:5476]
2025-10-01T14:08:34.447766Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:34.447786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:34.447789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:34.447793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:34.447795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:34.447811Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:34.447817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:34.447823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:34.447887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.447889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.447892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.447895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:34.447897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:34.448453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 567
2025-10-01T14:08:34.448483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 567
2025-10-01T14:08:34.447978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:34.447987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.447998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.448008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.448022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:34.448040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254996276446586:5476]
2025-10-01T14:08:34.448042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254996276446586:5476]
2025-10-01T14:08:34.448045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254996276446586:5476]
2025-10-01T14:08:34.448056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:34.448065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:34.448071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:34.448071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:34.448073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:34.448084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:34.448087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:34.448098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254998653310206:6130], now have 1 active actors on pipe
2025-10-01T14:08:34.448101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254998653310068:2446], now have 1 active actors on pipe
2025-10-01T14:08:34.448137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254996276446586:5476]
2025-10-01T14:08:34.448145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:34.448433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:34.448517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.448523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.448552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:34.448558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:34.448563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:34.448566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:34.448575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:34.448585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:34.448603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:34.449118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.449132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.449154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:34.449277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 568 partition: 0 MaxSeqNo: 45 sessionId: src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0
2025-10-01T14:08:34.450595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|403e11e7-855d92b1-8167bf4e-23b1569b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:34.453301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0] Write session: try to update token
2025-10-01T14:08:34.453324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:34.473196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:34.473216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:34.473219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:34.473220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:34.473233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254996276446586:5476]
2025-10-01T14:08:34.473237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254996276446586:5476]
2025-10-01T14:08:34.473240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254996276446586:5476]
2025-10-01T14:08:34.473297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:34.473300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:34.473307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:34.473308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.473311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:34.473311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:34.473450Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:34.474011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 568 sessionId: src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:34.476504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:34.502244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254998653310219:5713]
2025-10-01T14:08:34.502605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 567, pipe: [1:7556254998653310219:5713]
2025-10-01T14:08:34.636636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:34.637037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.637048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.637096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254998653310219:5713], now have 1 active actors on pipe
2025-10-01T14:08:34.637363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:34.637788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:34.637860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254998653310219:5713]
2025-10-01T14:08:34.637892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:34.637982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 568 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0
2025-10-01T14:08:34.638154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 568 sessionId: src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0 is DEAD
2025-10-01T14:08:34.642272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:34.642288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0] Write session will restart in 0.007391s
2025-10-01T14:08:34.642323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0] Write session: Do CDS request
2025-10-01T14:08:34.642329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:34.654919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:34.655982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:34.656003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 569
2025-10-01T14:08:34.656178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:34.656214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:34.656220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:34.656225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:34.657367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 569 sessionId:  describe result for acl check
2025-10-01T14:08:34.657412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:34.657414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:34.657415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:34.657423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556254998653310246:6141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:34.658002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556254998653310246:6141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:34.669664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556254998653310246:6141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:34.680626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:34.685353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:34.685629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:34.685635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:34.685649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:34.685704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:34.685741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556254996276446738:5478]
2025-10-01T14:08:34.687489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556254998653310246:6141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:34.687507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556254998653310246:6141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:34.687510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556254998653310246:6141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:34.687519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:34.688098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:34.688558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:34.688607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:34.688985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:34.689045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.689047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.689048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.689049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.689050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.689051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.689052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.689053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.689054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.689055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.689056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.689057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.689058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.689060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.689066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.689076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.689080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.689084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.689087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.689090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.689094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.689097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.689100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.689105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.689108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.689112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.689115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.689118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.689125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.689133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:34.689139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.689143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:34.689147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.689151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:34.689155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.689160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:34.689163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.689169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:34.689172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.689177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:34.689182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.689186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:34.689190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.689195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:34.689199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.689204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:34.689208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.689212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.689217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.689221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.689227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.689232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.689236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.689241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:34.689244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.689248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:34.689285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:34.694889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:34.695755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:34.695760Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:34.695762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:34.695766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:34.695773Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 568 [2:7556254996276446738:5478]
2025-10-01T14:08:34.695788Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:34.695805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:34.695809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:34.695812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:34.695814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:34.695833Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:34.695839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:34.695844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:34.695905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.695907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.695909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.695913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:34.695915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:34.695989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:34.695991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.696005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:34.696014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:34.696028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:34.696044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556254996276446732:5478]
2025-10-01T14:08:34.696046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556254996276446732:5478]
2025-10-01T14:08:34.696049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556254996276446732:5478]
2025-10-01T14:08:34.696062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:34.696078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:34.696093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:34.696096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:34.696133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556254996276446732:5478]
2025-10-01T14:08:34.696136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:34.696358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:34.696367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:34.696369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:34.696373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:34.696627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254998653310236:2446], now have 1 active actors on pipe
2025-10-01T14:08:34.696634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254998653310377:6141], now have 1 active actors on pipe
2025-10-01T14:08:34.696757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 568
2025-10-01T14:08:34.696812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 568
2025-10-01T14:08:34.697352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.697364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.697403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:34.697412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:34.697418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:34.697420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:34.697433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:34.697444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:34.697461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:34.697694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.697701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.697715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:34.697867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 569 partition: 0 MaxSeqNo: 45 sessionId: src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0
2025-10-01T14:08:34.698327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43228a3b-7c6b4871-b759c1d8-37cc592a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:34.701114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0] Write session: try to update token
2025-10-01T14:08:34.701136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:34.725137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 569 sessionId: src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:34.727773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:34.728050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.728081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.728130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:34.728322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:34.733435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:34.733458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:34.733461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:34.733465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:34.733477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556254996276446732:5478]
2025-10-01T14:08:34.733482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556254996276446732:5478]
2025-10-01T14:08:34.733486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556254996276446732:5478]
2025-10-01T14:08:34.733537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:34.733548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:34.733551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:34.733713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:34.735059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:34.735071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:34.735074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:34.739095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556254998653310398:5713]
2025-10-01T14:08:34.744295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 568, pipe: [1:7556254998653310398:5713]
2025-10-01T14:08:34.984963Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:34.985529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556254998653310398:5713], now have 1 active actors on pipe
2025-10-01T14:08:34.996953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:34.996993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:34.997230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.997311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.997399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.997485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.997936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.997942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.998045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.998129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.998215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.998783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.998850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.998854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.998945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.999023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.999105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.999191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.999256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.999259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.999369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.999449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:34.999527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:34.999607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:34.999662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:34.999666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:34.999887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:34.999972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.000044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.000120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.000177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.000180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.000280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.000359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.000446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.000533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.000589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.000591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.000682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.000762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.000860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.000945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.001004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.001007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.001102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.001183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.001271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.001362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.001426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.001429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.001531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.001617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.001706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.001791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.001842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.001845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.001929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.001997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.002073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.002148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.002212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.002216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.003615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:35.007036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:35.007049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0] Write session will restart in 0.006603s
2025-10-01T14:08:35.007084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0] Write session: Do CDS request
2025-10-01T14:08:35.007090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:35.006560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:35.006619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 569 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0
2025-10-01T14:08:35.006850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 569 sessionId: src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0 is DEAD
2025-10-01T14:08:35.007009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556254998653310398:5713]
2025-10-01T14:08:35.007035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:35.014910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:35.015432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:35.015457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 570
2025-10-01T14:08:35.015710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:35.015737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:35.015743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:35.015746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:35.016271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 570 sessionId:  describe result for acl check
2025-10-01T14:08:35.016298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:35.016299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:35.016301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:35.016307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255002948277715:6146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:35.016837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255002948277715:6146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:35.037788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255002948277715:6146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:35.039984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:35.042520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:35.042780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:35.042784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:35.042798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:35.042855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:35.042904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255000571414220:5493]
2025-10-01T14:08:35.043487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:35.044328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:35.044383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:35.044760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:35.044864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.044865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.044866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.044868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.044869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.044871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.044872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.044874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.044875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.044876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.044878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.044879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.044881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.044883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.044891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.044904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.044908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.044913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.044917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.044921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.044925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.044930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.044934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.044939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.044943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.044948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.044952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.044956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.044965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.044974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.044981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.044987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.044992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.044998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.045002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.045007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.045012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.045018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.045023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.045028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.045034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.045039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.045044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.045050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.045056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.045062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.045066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.045073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.045077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.045081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.045085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.045090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.045094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.045099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.045103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.045108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.045149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:35.043940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255002948277715:6146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:35.043960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255002948277715:6146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:35.043964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255002948277715:6146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:35.043972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:35.053046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:35.054040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:35.054046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:35.054048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:35.054052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:35.054061Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 569 [2:7556255000571414220:5493]
2025-10-01T14:08:35.054079Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:35.054101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:35.054105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:35.054109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:35.054112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:35.054130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:35.054135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:35.054142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:35.054216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.054219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.054222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.054226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:35.054228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:35.054309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:35.054312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.054326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.054336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.054353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:35.054389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255000571414214:5493]
2025-10-01T14:08:35.054392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255000571414214:5493]
2025-10-01T14:08:35.054394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255000571414214:5493]
2025-10-01T14:08:35.054411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:35.054427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:35.054442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:35.054445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:35.054490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255000571414214:5493]
2025-10-01T14:08:35.054493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:35.054890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:35.054899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:35.054901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:35.054907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:35.055281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948277841:6146], now have 1 active actors on pipe
2025-10-01T14:08:35.055290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948277701:2446], now have 1 active actors on pipe
2025-10-01T14:08:35.056270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 569
2025-10-01T14:08:35.056306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 569
2025-10-01T14:08:35.057065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.057083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.057122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:35.057138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:35.057143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:35.057146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:35.057158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:35.057187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:35.057210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:35.061083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.061101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.061148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:35.061352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 570 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0
2025-10-01T14:08:35.062717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfebee8-2f9d6ec7-9f8685c8-8c31670f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:35.065395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0] Write session: try to update token
2025-10-01T14:08:35.065414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:35.110418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255002948277851:5713]
2025-10-01T14:08:35.110465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 570 sessionId: src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:35.113450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:35.114497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.114516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.114561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:35.114809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:35.119055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948277851:5713], now have 1 active actors on pipe
2025-10-01T14:08:35.126184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 569, pipe: [1:7556255002948277851:5713]
2025-10-01T14:08:35.158450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:35.158469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:35.158473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:35.163397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:35.163410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:35.163413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:35.163415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:35.163428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255000571414214:5493]
2025-10-01T14:08:35.163433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255000571414214:5493]
2025-10-01T14:08:35.163436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255000571414214:5493]
2025-10-01T14:08:35.163487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:35.163494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.163498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:35.163658Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:35.166476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:35.166483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:35.166487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:35.474727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:35.488547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.488573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.488806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.488889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.488977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.489057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.489440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.489447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.489545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.489618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.489690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.489774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.489824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.489827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.489910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.489980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.490061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.490139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.490194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.490198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.490279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.490350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.494848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.494937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.494984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.494991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.495076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.495139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.495202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.495281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.495329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.495333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.495414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.495484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.495553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.495631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.495678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.495681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.495761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.495824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.495902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.495970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.496031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.496034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.496117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.496184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.496253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.496329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.496381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.496384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.496487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.496551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.496617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.496689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.496808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.496812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.496894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.496962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.497038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.497112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.497195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.497199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.499105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:35.499119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:35.499148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 570 reason: error at write: Disconnected sessionId: src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0
2025-10-01T14:08:35.499346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 570 sessionId: src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0 is DEAD
2025-10-01T14:08:35.499506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:35.499541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255002948277851:5713]
2025-10-01T14:08:35.502609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:35.502623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0] Write session will restart in 0.009561s
2025-10-01T14:08:35.502651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0] Write session: Do CDS request
2025-10-01T14:08:35.502658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:35.502771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:35.514559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:35.518892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:35.518906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 571
2025-10-01T14:08:35.519139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:35.519171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:35.519177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:35.519180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:35.520103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 571 sessionId:  describe result for acl check
2025-10-01T14:08:35.520140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:35.520142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:35.520144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:35.520149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255002948277917:6152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:35.520667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255002948277917:6152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:35.526964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255002948277917:6152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:35.531156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:35.531979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255002948277917:6152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:35.532005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255002948277917:6152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:35.532008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255002948277917:6152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:35.532018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:35.534269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:35.534519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:35.534524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:35.534537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:35.534589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:35.534639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255000571414387:5497]
2025-10-01T14:08:35.535270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:35.535707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:35.535747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:35.536066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:35.536135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.536136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.536138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.536139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.536140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.536141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.536142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.536143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.536144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.536145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.536146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.536147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.536149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.536150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.536156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.536165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.536168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.536172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.536175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.536179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.536183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.536187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.536191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.536194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.536198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.536201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.536204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.536207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.536215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.536222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.536228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.536233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.536237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.536242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.536246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.536251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.536256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.536261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.536266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.536270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.536275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.536279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.536283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.536288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.536292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.536297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.536302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.536306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.536312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.536318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.536321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.536327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.536331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.536336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.536341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.536346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.536381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:35.541460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:35.542493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:35.542499Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:35.542501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:35.542505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:35.542513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 570 [2:7556255000571414387:5497]
2025-10-01T14:08:35.542529Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:35.542550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:35.542553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:35.542558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:35.542560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:35.542577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:35.542586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:35.542594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:35.542660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.542662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.542663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.542666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:35.542669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:35.542755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:35.542758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.542771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.542782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.542799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:35.542819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255000571414380:5497]
2025-10-01T14:08:35.542821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255000571414380:5497]
2025-10-01T14:08:35.542823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255000571414380:5497]
2025-10-01T14:08:35.542837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:35.542850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:35.542864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:35.542867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:35.542908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255000571414380:5497]
2025-10-01T14:08:35.542910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:35.544037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 570
2025-10-01T14:08:35.544072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 570
2025-10-01T14:08:35.543240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:35.543245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:35.543247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:35.543254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:35.550354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948278027:6152], now have 1 active actors on pipe
2025-10-01T14:08:35.550382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948277884:2446], now have 1 active actors on pipe
2025-10-01T14:08:35.550414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.550424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.550469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a496d17d-eca21dbc-fbe259b-34b38565_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:35.550498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:35.550507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:35.550510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:35.550523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:35.550543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:35.550582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:35.552300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 571 partition: 0 MaxSeqNo: 45 sessionId: src_id|a496d17d-eca21dbc-fbe259b-34b38565_0
2025-10-01T14:08:35.552772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5bf9eb-254b7a26-49cc8ccb-d9d096c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a496d17d-eca21dbc-fbe259b-34b38565_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:35.552136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.552147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.552176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:35.555634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a496d17d-eca21dbc-fbe259b-34b38565_0] Write session: try to update token
2025-10-01T14:08:35.555651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a496d17d-eca21dbc-fbe259b-34b38565_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:35.585126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 571 sessionId: src_id|a496d17d-eca21dbc-fbe259b-34b38565_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:35.587830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:35.588264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.588284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.588324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:35.588464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:35.601110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:35.601125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:35.601127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:35.601128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:35.601138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255000571414380:5497]
2025-10-01T14:08:35.601142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255000571414380:5497]
2025-10-01T14:08:35.601146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255000571414380:5497]
2025-10-01T14:08:35.601197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:35.601203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.601206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:35.601353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:35.599939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255002948278038:5713]
2025-10-01T14:08:35.604337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:35.604354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:35.604357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:35.606237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 570, pipe: [1:7556255002948278038:5713]
2025-10-01T14:08:35.761133Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:35.761413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948278038:5713], now have 1 active actors on pipe
2025-10-01T14:08:35.769845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.769874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.770068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.770133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.770198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.770269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.770317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.770324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.770490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.770552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.770615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.770682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.770736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.770739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.770812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.770869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.770938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.771001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.771046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.771049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.771118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.771176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.771237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.771298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.771345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.771347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.771415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.771476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.771539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.771604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.771652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.771654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.771729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.771790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.771854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.771928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.771973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.771977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.772059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.772127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.772195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.772259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.772304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.772306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.772373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.772431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.772494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.772555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.772596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.772599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.772667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.772728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.772805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.772865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.772913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.772916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.772987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:35.773052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:35.773120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:35.773187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:35.773240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:35.773243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:35.774487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:35.774341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255002948278038:5713]
2025-10-01T14:08:35.774391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:35.774394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:35.774419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 571 reason: error at write: Disconnected sessionId: src_id|a496d17d-eca21dbc-fbe259b-34b38565_0
2025-10-01T14:08:35.774602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 571 sessionId: src_id|a496d17d-eca21dbc-fbe259b-34b38565_0 is DEAD
2025-10-01T14:08:35.774738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:35.777195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a496d17d-eca21dbc-fbe259b-34b38565_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:35.777207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a496d17d-eca21dbc-fbe259b-34b38565_0] Write session will restart in 0.007613s
2025-10-01T14:08:35.777234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a496d17d-eca21dbc-fbe259b-34b38565_0] Write session: Do CDS request
2025-10-01T14:08:35.777241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a496d17d-eca21dbc-fbe259b-34b38565_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:35.786867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a496d17d-eca21dbc-fbe259b-34b38565_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:35.787473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:35.787490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 572
2025-10-01T14:08:35.787592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:35.787612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:35.787616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:35.787619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:35.787928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 572 sessionId:  describe result for acl check
2025-10-01T14:08:35.787964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:35.787969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:35.787971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:35.787975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255002948278121:6164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:35.788828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255002948278121:6164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:35.791667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:35.793810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:35.794019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:35.794030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:35.794040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:35.794132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:35.794175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255000571414543:5502]
2025-10-01T14:08:35.794732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:35.795100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:35.795152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:35.795592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:35.795670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.795672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.795672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.795674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.795675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.795676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.795677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.795678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.795679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.795680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.795681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.795682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.795684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.795685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.795690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.795699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.795703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.795706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.795710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.795714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.795717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.795720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.795723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.795727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.795730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.795734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.795737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.795740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.795750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.795757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:35.795764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.795768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:35.795773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.795777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:35.795781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.795786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:35.795790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.795795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:35.795799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.795803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:35.795808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.795812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:35.795816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.795820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:35.795824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.795830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:35.795834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.795840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.795844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.795849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.795861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.795867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.795871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.795877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:35.795881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.795886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:35.795923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:35.798306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255002948278121:6164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:35.801477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:35.802132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:35.802144Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:35.802147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:35.802151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:35.802157Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 571 [2:7556255000571414543:5502]
2025-10-01T14:08:35.802174Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:35.802191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:35.802195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:35.802199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:35.802201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:35.802217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:35.802223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:35.802230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:35.802293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.802300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.802303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.802306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:35.802309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:35.802391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:35.802394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.802406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:35.802418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:35.802441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:35.802458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255000571414538:5502]
2025-10-01T14:08:35.802462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255000571414538:5502]
2025-10-01T14:08:35.802465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255000571414538:5502]
2025-10-01T14:08:35.802473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:35.802483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:35.802486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:35.802488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:35.802492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:35.802507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:35.802510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:35.802523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948278071:2446], now have 1 active actors on pipe
2025-10-01T14:08:35.802555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255000571414538:5502]
2025-10-01T14:08:35.802568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:35.802866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:35.802612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 571
2025-10-01T14:08:35.803780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255002948278121:6164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:35.803798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255002948278121:6164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:35.803801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255002948278121:6164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:35.803810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:35.804596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 571
2025-10-01T14:08:35.804604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948278217:6164], now have 1 active actors on pipe
2025-10-01T14:08:35.804713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.804721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.804747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19b69805-66958b1d-1316ab35-2ea6012a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:35.804756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:35.804761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:35.804763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:35.804774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:35.804797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:35.804813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:35.805431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 572 partition: 0 MaxSeqNo: 45 sessionId: src_id|19b69805-66958b1d-1316ab35-2ea6012a_0
2025-10-01T14:08:35.805254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.805265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.805285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:35.806011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a496d17d-eca21dbc-fbe259b-34b38565_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|19b69805-66958b1d-1316ab35-2ea6012a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:35.809195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b69805-66958b1d-1316ab35-2ea6012a_0] Write session: try to update token
2025-10-01T14:08:35.809219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b69805-66958b1d-1316ab35-2ea6012a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:35.823041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:35.823055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:35.823057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:35.823059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:35.823068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255000571414538:5502]
2025-10-01T14:08:35.823072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255000571414538:5502]
2025-10-01T14:08:35.823075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255000571414538:5502]
2025-10-01T14:08:35.823115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:35.823123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:35.823125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:35.823262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:35.826432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:35.826456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:35.826460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:35.835375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 572 sessionId: src_id|19b69805-66958b1d-1316ab35-2ea6012a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:35.837895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:35.874613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255002948278223:5713]
2025-10-01T14:08:35.875170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 571, pipe: [1:7556255002948278223:5713]
2025-10-01T14:08:35.967820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:35.968635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:35.968710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255002948278223:5713]
2025-10-01T14:08:35.969006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:35.969092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 572 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19b69805-66958b1d-1316ab35-2ea6012a_0
2025-10-01T14:08:35.968197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:35.968209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:35.968230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948278223:5713], now have 1 active actors on pipe
2025-10-01T14:08:35.968550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:35.969284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 572 sessionId: src_id|19b69805-66958b1d-1316ab35-2ea6012a_0 is DEAD
2025-10-01T14:08:35.969574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b69805-66958b1d-1316ab35-2ea6012a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:35.969584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b69805-66958b1d-1316ab35-2ea6012a_0] Write session will restart in 0.009626s
2025-10-01T14:08:35.969611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b69805-66958b1d-1316ab35-2ea6012a_0] Write session: Do CDS request
2025-10-01T14:08:35.969616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b69805-66958b1d-1316ab35-2ea6012a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:35.981210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b69805-66958b1d-1316ab35-2ea6012a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:35.981550Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:35.981569Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 573
2025-10-01T14:08:35.986774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:35.986836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:35.986844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:35.986856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:35.988408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 573 sessionId:  describe result for acl check
2025-10-01T14:08:35.988463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:35.988471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:35.988474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:35.988480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255002948278289:6168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:35.989141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255002948278289:6168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:35.995097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255002948278289:6168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:35.999217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255002948278289:6168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:35.999239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255002948278289:6168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:35.999244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255002948278289:6168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:35.999253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:36.000475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:36.006174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:36.006451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:36.006462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:36.006475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:36.006536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:36.006588Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255004866382002:5504]
2025-10-01T14:08:36.007305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:36.008903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:36.008968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:36.009364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:36.009420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.009421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.009423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.009424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.009426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.009427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.009429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.009430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.009432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.009433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.009435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.009437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.009438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.009440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.009446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.009457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.009462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.009467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.009471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.009476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.009480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.009485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.009490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.009495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.009500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.009504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.009509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.009513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.009521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.009529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.009535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.009541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.009551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.009557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.009562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.009568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.009573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.009580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.009585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.009591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.009598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.009604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.009609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.009615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.009620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.009628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.009633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.009639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.009644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.009649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.009654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.009660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.009666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.009671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.009676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.009682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.009731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:36.015434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:36.016151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:36.016157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:36.016160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:36.016165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:36.016173Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 572 [2:7556255004866382002:5504]
2025-10-01T14:08:36.016193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:36.016215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:36.016219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.016223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.016226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.016244Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:36.016251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:36.016259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:36.016328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.016330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.016332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.016336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:36.016339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:36.016421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:36.016424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.016437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.016449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.016467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:36.016485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255000571414701:5504]
2025-10-01T14:08:36.016487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255000571414701:5504]
2025-10-01T14:08:36.016489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255000571414701:5504]
2025-10-01T14:08:36.016498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:36.016508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:36.016511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:36.016513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:36.016514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948278229:2446], now have 1 active actors on pipe
2025-10-01T14:08:36.016518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255002948278369:6168], now have 1 active actors on pipe
2025-10-01T14:08:36.016526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:36.016539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:36.016544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:36.016584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255000571414701:5504]
2025-10-01T14:08:36.016793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 572
2025-10-01T14:08:36.016799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 572
2025-10-01T14:08:36.016593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:36.016622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:36.017549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.017566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.017596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|872e5f51-540f3963-17a43e3e-57596fb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:36.017605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.017609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.017611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:36.017623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.017636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:36.017650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.020890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 573 partition: 0 MaxSeqNo: 45 sessionId: src_id|872e5f51-540f3963-17a43e3e-57596fb0_0
2025-10-01T14:08:36.020518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.020539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.020574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.022677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b69805-66958b1d-1316ab35-2ea6012a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|872e5f51-540f3963-17a43e3e-57596fb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:36.025445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|872e5f51-540f3963-17a43e3e-57596fb0_0] Write session: try to update token
2025-10-01T14:08:36.025465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|872e5f51-540f3963-17a43e3e-57596fb0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:36.040454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:36.040476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:36.040479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:36.040483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:36.040493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255000571414701:5504]
2025-10-01T14:08:36.040499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255000571414701:5504]
2025-10-01T14:08:36.040504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255000571414701:5504]
2025-10-01T14:08:36.040561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:36.040569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.040572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:36.040731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:36.041174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 573 sessionId: src_id|872e5f51-540f3963-17a43e3e-57596fb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:36.042190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:36.042210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:36.042215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:36.043847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:36.068913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255007243245678:5713]
2025-10-01T14:08:36.069937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 572, pipe: [1:7556255007243245678:5713]
2025-10-01T14:08:36.189887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:36.190259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.190277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.190318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243245678:5713], now have 1 active actors on pipe
2025-10-01T14:08:36.190574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:36.191585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872e5f51-540f3963-17a43e3e-57596fb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:36.191598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872e5f51-540f3963-17a43e3e-57596fb0_0] Write session will restart in 0.008268s
2025-10-01T14:08:36.191624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872e5f51-540f3963-17a43e3e-57596fb0_0] Write session: Do CDS request
2025-10-01T14:08:36.191630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872e5f51-540f3963-17a43e3e-57596fb0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:36.191127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:36.191160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:36.191209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255007243245678:5713]
2025-10-01T14:08:36.191237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 573 reason: status is not ok: tablet will be restarted right now sessionId: src_id|872e5f51-540f3963-17a43e3e-57596fb0_0
2025-10-01T14:08:36.191411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 573 sessionId: src_id|872e5f51-540f3963-17a43e3e-57596fb0_0 is DEAD
2025-10-01T14:08:36.200969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|872e5f51-540f3963-17a43e3e-57596fb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:36.201026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:36.201053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 574
2025-10-01T14:08:36.201213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:36.201246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:36.201258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:36.201265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:36.201714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 574 sessionId:  describe result for acl check
2025-10-01T14:08:36.201755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:36.201757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:36.201759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:36.201765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255007243245696:6172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:36.202409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255007243245696:6172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:36.208457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255007243245696:6172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:36.217706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255007243245696:6172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:36.217727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255007243245696:6172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:36.217732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255007243245696:6172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:36.217746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:36.220853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:36.224159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:36.224430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:36.224440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:36.224452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:36.224526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:36.224578Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255004866382170:5516]
2025-10-01T14:08:36.225381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:36.227710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:36.227805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:36.228270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:36.228338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.228339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.228341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.228342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.228343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.228345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.228346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.228347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.228348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.228349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.228350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.228352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.228353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.228354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.228359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.228366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.228369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.228371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.228374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.228377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.228380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.228382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.228385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.228388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.228390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.228392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.228395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.228397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.228406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.228412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.228417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.228423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.228429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.228435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.228439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.228445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.228450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.228456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.228460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.228465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.228470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.228476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.228480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.228486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.228491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.228495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.228500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.228505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.228510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.228516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.228520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.228524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.228530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.228534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.228539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.228544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.228587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:36.234102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:36.235212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:36.235236Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:36.235238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:36.235242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:36.235250Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 573 [2:7556255004866382170:5516]
2025-10-01T14:08:36.235269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:36.235289Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:36.235293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.235297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.235300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.235334Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:36.235344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:36.235352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:36.235427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.235429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.235431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.235435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:36.235438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:36.235510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:36.235512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.235522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.235529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.235538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:36.235553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255004866382164:5516]
2025-10-01T14:08:36.235555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255004866382164:5516]
2025-10-01T14:08:36.235557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255004866382164:5516]
2025-10-01T14:08:36.235572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:36.235586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:36.235601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:36.235604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:36.235624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:36.235629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:36.235631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:36.235647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255004866382164:5516]
2025-10-01T14:08:36.235649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:36.236035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 573
2025-10-01T14:08:36.236078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 573
2025-10-01T14:08:36.235714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:36.235955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243245682:2446], now have 1 active actors on pipe
2025-10-01T14:08:36.235959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243245829:6172], now have 1 active actors on pipe
2025-10-01T14:08:36.236159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.236167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.236200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:36.236208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.236213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.236216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:36.236228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.236242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:36.236260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.236492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.236506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.236526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.236628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 574 partition: 0 MaxSeqNo: 45 sessionId: src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0
2025-10-01T14:08:36.237232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|872e5f51-540f3963-17a43e3e-57596fb0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:36.240716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0] Write session: try to update token
2025-10-01T14:08:36.240738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:36.260281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 574 sessionId: src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:36.263023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:36.263048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:36.263051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:36.263053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:36.263064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255004866382164:5516]
2025-10-01T14:08:36.263068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255004866382164:5516]
2025-10-01T14:08:36.263073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255004866382164:5516]
2025-10-01T14:08:36.263135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:36.263033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:36.263147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.263150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:36.263315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:36.264818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:36.264834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:36.264840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:36.291620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255007243245848:5713]
2025-10-01T14:08:36.291975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 573, pipe: [1:7556255007243245848:5713]
2025-10-01T14:08:36.416039Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:36.416434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.416456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.416493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243245848:5713], now have 1 active actors on pipe
2025-10-01T14:08:36.416647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:36.416685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:36.416716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255007243245848:5713]
2025-10-01T14:08:36.416736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:36.416820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 574 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0
2025-10-01T14:08:36.417010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 574 sessionId: src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0 is DEAD
2025-10-01T14:08:36.417157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:36.417166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0] Write session will restart in 0.007930s
2025-10-01T14:08:36.417187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0] Write session: Do CDS request
2025-10-01T14:08:36.417192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:36.425962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:36.426027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:36.426042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 575
2025-10-01T14:08:36.426158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:36.426200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:36.426211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:36.426215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:36.426591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 575 sessionId:  describe result for acl check
2025-10-01T14:08:36.426623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:36.426629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:36.426631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:36.426636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255007243245938:6178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:36.427154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255007243245938:6178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:36.429001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:36.429152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255007243245938:6178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:36.430803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:36.431001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:36.431016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:36.431028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:36.431072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:36.431121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255004866382334:5520]
2025-10-01T14:08:36.431441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255007243245938:6178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:36.431454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255007243245938:6178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:36.431458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255007243245938:6178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:36.431467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:36.431660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:36.431867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:36.431906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:36.432189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:36.432233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.432238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.432240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.432241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.432242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.432242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.432243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.432244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.432246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.432247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.432248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.432248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.432250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.432251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.432255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.432265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.432268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.432272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.432275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.432279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.432283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.432286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.432290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.432294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.432297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.432300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.432302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.432303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.432308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.432312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.432316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.432319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.432323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.432326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.432328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.432330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.432333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.432336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.432338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.432340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.432345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.432361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.432365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.432369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.432373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.432377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.432380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.432385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.432389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.432392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.432395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.432399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.432403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.432413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.432417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.432422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.432455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:36.435915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:36.436563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:36.436575Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:36.436577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:36.436580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:36.436586Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 574 [2:7556255004866382334:5520]
2025-10-01T14:08:36.436600Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:36.436619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:36.436628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.436632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.436634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.436648Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:36.436653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:36.436659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:36.436708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.436713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.436715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.436719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:36.436721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:36.436794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:36.436800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.436810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.436825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.436843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:36.436865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243246009:6178], now have 1 active actors on pipe
2025-10-01T14:08:36.436875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243245862:2446], now have 1 active actors on pipe
2025-10-01T14:08:36.436881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255004866382329:5520]
2025-10-01T14:08:36.436887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255004866382329:5520]
2025-10-01T14:08:36.436890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255004866382329:5520]
2025-10-01T14:08:36.436902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:36.436912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:36.436915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:36.436886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 574
2025-10-01T14:08:36.436916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:36.436920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:36.436891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 574
2025-10-01T14:08:36.436931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:36.436938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:36.436971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.436981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.436996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255004866382329:5520]
2025-10-01T14:08:36.437007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:36.437010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:36.437029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:36.437036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.437040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.437042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:36.437050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.437058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:36.437086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.437219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.437228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.437242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.437303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 575 partition: 0 MaxSeqNo: 45 sessionId: src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0
2025-10-01T14:08:36.437667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbf2a44-90ac1de8-51f61136-36ec1dda_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:36.440561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0] Write session: try to update token
2025-10-01T14:08:36.440583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:36.458613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:36.458631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:36.458635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:36.458637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:36.458649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255004866382329:5520]
2025-10-01T14:08:36.458654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255004866382329:5520]
2025-10-01T14:08:36.458658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255004866382329:5520]
2025-10-01T14:08:36.458718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:36.458731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.458733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:36.458904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:36.459156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 575 sessionId: src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:36.461791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:36.461994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:36.462009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:36.462016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:36.518494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255007243246021:5713]
2025-10-01T14:08:36.519116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 574, pipe: [1:7556255007243246021:5713]
2025-10-01T14:08:36.612876Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:36.613356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.613372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.613418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243246021:5713], now have 1 active actors on pipe
2025-10-01T14:08:36.613633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:36.613669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:36.613695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255007243246021:5713]
2025-10-01T14:08:36.613715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:36.613778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 575 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0
2025-10-01T14:08:36.613970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 575 sessionId: src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0 is DEAD
2025-10-01T14:08:36.614106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:36.614114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0] Write session will restart in 0.009215s
2025-10-01T14:08:36.614140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0] Write session: Do CDS request
2025-10-01T14:08:36.614145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:36.624954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:36.624958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:36.624974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 576
2025-10-01T14:08:36.625195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:36.625245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:36.625254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:36.625258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:36.625666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 576 sessionId:  describe result for acl check
2025-10-01T14:08:36.625701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:36.625708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:36.625710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:36.625715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255007243246080:6182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:36.626214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255007243246080:6182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:36.628551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255007243246080:6182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:36.629167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:36.631213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:36.631264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255007243246080:6182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:36.631276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255007243246080:6182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:36.631279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255007243246080:6182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:36.631310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:36.631409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:36.631418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:36.631430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:36.631472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:36.631508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255004866382487:5522]
2025-10-01T14:08:36.632028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:36.632307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:36.632344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:36.632617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:36.632668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.632673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.632674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.632675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.632676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.632677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.632678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.632679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.632680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.632681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.632682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.632683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.632684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.632685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.632689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.632697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.632700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.632703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.632706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.632709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.632712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.632715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.632718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.632722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.632724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.632727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.632730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.632733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.632740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.632746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.632753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.632757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.632760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.632764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.632768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.632772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.632775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.632790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.632794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.632798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.632802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.632807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.632810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.632814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.632817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.632821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.632825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.632829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.632833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.632837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.632840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.632844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.632848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.632852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.632855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.632860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.632891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:36.636534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:36.637172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:36.637185Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:36.637188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:36.637192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:36.637201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 575 [2:7556255004866382487:5522]
2025-10-01T14:08:36.637216Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:36.637238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:36.637245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.637249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.637252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.637269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:36.637279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:36.637290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:36.637348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.637355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.637358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.637361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:36.637364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:36.637426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:36.637433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.637445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.637457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.637478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:36.637499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243246024:2446], now have 1 active actors on pipe
2025-10-01T14:08:36.637510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243246172:6182], now have 1 active actors on pipe
2025-10-01T14:08:36.637518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255004866382482:5522]
2025-10-01T14:08:36.637520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255004866382482:5522]
2025-10-01T14:08:36.637522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255004866382482:5522]
2025-10-01T14:08:36.637537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:36.637551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:36.637565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:36.637571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:36.637575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:36.637575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:36.637577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:36.637604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255004866382482:5522]
2025-10-01T14:08:36.637612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:36.637579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 575
2025-10-01T14:08:36.637584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 575
2025-10-01T14:08:36.637631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:36.637653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.637658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.637685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e48050-6bba102e-6b8edb26-ba0c2549_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:36.637696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.637705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.637707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:36.637717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.637725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:36.637738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.637888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.637896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.637910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.638013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 576 partition: 0 MaxSeqNo: 45 sessionId: src_id|e48050-6bba102e-6b8edb26-ba0c2549_0
2025-10-01T14:08:36.638397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3832dd35-a2141d83-b5ac99b7-a5fa11e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e48050-6bba102e-6b8edb26-ba0c2549_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:36.640897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e48050-6bba102e-6b8edb26-ba0c2549_0] Write session: try to update token
2025-10-01T14:08:36.640915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e48050-6bba102e-6b8edb26-ba0c2549_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:36.650069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:36.650086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:36.650097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255004866382482:5522]
2025-10-01T14:08:36.650145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:36.650153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:36.650405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:36.650564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:36.650718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:36.650853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:36.651045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:36.651087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:36.655909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 576 sessionId: src_id|e48050-6bba102e-6b8edb26-ba0c2549_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:36.658482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:36.658746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.658769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.658808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:36.658950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:36.669663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:36.669679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:36.669682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:36.669684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:36.669695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255004866382482:5522]
2025-10-01T14:08:36.669700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255004866382482:5522]
2025-10-01T14:08:36.669703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255004866382482:5522]
2025-10-01T14:08:36.669750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:36.669755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:36.669758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.669760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:36.669762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:36.669765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:36.669890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:36.714054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255007243246185:5713]
2025-10-01T14:08:36.714380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 575, pipe: [1:7556255007243246185:5713]
2025-10-01T14:08:36.822450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:36.830771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.830796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.830965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.831021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.831084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.831146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.831192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.831197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.831269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.831321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.831379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.831441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.831483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.831486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.831546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.831599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.831653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.831708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.831747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.831750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.831810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.832172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.832227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.832281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.832333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.832336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.832403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.832458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.832513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.832576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.832619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.832622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.832691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.832745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.832817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.832877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.832927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.832930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.832995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.833050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.833108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.833163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.833202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.833205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.833271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.833326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.833385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.833441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.833483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.833486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.833551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.833604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.833662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.833722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.833772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.833775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.833839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:36.833893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:36.833947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:36.834456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:36.834501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:36.834504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:36.834577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243246185:5713], now have 1 active actors on pipe
2025-10-01T14:08:36.836164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48050-6bba102e-6b8edb26-ba0c2549_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:36.836174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48050-6bba102e-6b8edb26-ba0c2549_0] Write session will restart in 0.007707s
2025-10-01T14:08:36.836199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48050-6bba102e-6b8edb26-ba0c2549_0] Write session: Do CDS request
2025-10-01T14:08:36.836205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48050-6bba102e-6b8edb26-ba0c2549_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:36.835908Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:36.835496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:36.835569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:36.835574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:36.835602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 576 reason: error at write: Disconnected sessionId: src_id|e48050-6bba102e-6b8edb26-ba0c2549_0
2025-10-01T14:08:36.835823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 576 sessionId: src_id|e48050-6bba102e-6b8edb26-ba0c2549_0 is DEAD
2025-10-01T14:08:36.836222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255007243246185:5713]
2025-10-01T14:08:36.846914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e48050-6bba102e-6b8edb26-ba0c2549_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:36.847050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:36.847064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 577
2025-10-01T14:08:36.847258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:36.847292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:36.847297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:36.847300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:36.847862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 577 sessionId:  describe result for acl check
2025-10-01T14:08:36.847898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:36.847903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:36.847905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:36.847911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255007243246299:6194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:36.848308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255007243246299:6194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:36.850243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255007243246299:6194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:36.851576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:36.853777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:36.853917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:36.853924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:36.853932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:36.853961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:36.853989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255004866382649:5527]
2025-10-01T14:08:36.854404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:36.854212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255007243246299:6194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:36.854234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255007243246299:6194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:36.854237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255007243246299:6194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:36.854247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:36.854753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:36.854803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:36.855098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:36.855150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.855155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.855156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.855157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.855158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.855160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.855161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.855162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.855163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.855165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.855166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.855167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.855169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.855170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.855176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.855186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.855190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.855194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.855198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.855202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.855206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.855209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.855213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.855217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.855221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.855225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.855228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.855231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.855239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.855249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:36.855257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.855263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:36.855270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.855275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:36.855282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.855287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:36.855294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.855299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:36.855307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.855312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:36.855317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.855324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:36.855328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.855336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:36.855345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.855350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:36.855357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.855362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.855368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.855376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.855381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.855388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.855392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.855397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:36.855403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.855408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:36.855442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:36.859680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:36.860514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:36.860527Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:36.860530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:36.860534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:36.860541Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 576 [2:7556255004866382649:5527]
2025-10-01T14:08:36.860562Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:36.860584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:36.860593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.860597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.860599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.860616Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:36.860625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:36.860636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:36.860701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.860708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.860710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.860714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:36.860716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:36.860791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:36.860798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.860810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:36.860821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:36.860841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:36.860860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243246213:2446], now have 1 active actors on pipe
2025-10-01T14:08:36.860864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243246359:6194], now have 1 active actors on pipe
2025-10-01T14:08:36.860871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255004866382643:5527]
2025-10-01T14:08:36.860874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255004866382643:5527]
2025-10-01T14:08:36.860876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255004866382643:5527]
2025-10-01T14:08:36.860888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:36.860902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:36.860904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:36.860905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:36.860907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:36.860919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:36.860923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:36.860963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255004866382643:5527]
2025-10-01T14:08:36.860970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:36.860975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:36.861128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 576
2025-10-01T14:08:36.861167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 576
2025-10-01T14:08:36.861313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.861322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.861353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|402e7cca-31361546-37559f98-e1131677_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:36.861360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:36.861364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:36.861367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:36.861377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:36.861387Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:36.861403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.861639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.861647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.861661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:36.861756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 577 partition: 0 MaxSeqNo: 45 sessionId: src_id|402e7cca-31361546-37559f98-e1131677_0
2025-10-01T14:08:36.862143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48050-6bba102e-6b8edb26-ba0c2549_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|402e7cca-31361546-37559f98-e1131677_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:36.864834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|402e7cca-31361546-37559f98-e1131677_0] Write session: try to update token
2025-10-01T14:08:36.864849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|402e7cca-31361546-37559f98-e1131677_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:36.883150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:36.883163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:36.883176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255004866382643:5527]
2025-10-01T14:08:36.883223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:36.883273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:36.883378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:36.883509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:36.883632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:36.883761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:36.883954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:36.883984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:36.885157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 577 sessionId: src_id|402e7cca-31361546-37559f98-e1131677_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:36.887694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:36.888013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:36.888033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:36.888069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:36.889054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:36.901907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:36.901924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:36.901927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:36.901928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:36.901938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255004866382643:5527]
2025-10-01T14:08:36.901942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255004866382643:5527]
2025-10-01T14:08:36.901946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255004866382643:5527]
2025-10-01T14:08:36.901990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:36.901997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:36.901999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:36.902131Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:36.904740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:36.904744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:36.904747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:36.938278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255007243246370:5713]
2025-10-01T14:08:36.938595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 576, pipe: [1:7556255007243246370:5713]
2025-10-01T14:08:37.051785Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:37.060280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.060313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.060493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.060555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.060622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.060690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.060740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.060750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.060842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.060911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.060983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.061062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.061109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.061118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.061181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.061247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.061314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.061374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.061420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.061427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.061492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.061555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.061610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.061670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.061716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.061718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.061789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.061864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.061931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.061990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.062035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.062037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.062104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.062163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.062250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.062310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.062386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.062389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.062458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.062518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.062584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.062644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.062706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.062719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.062788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.062885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.062961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.063070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.063974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:37.063988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:37.064016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 577 reason: error at write: Disconnected sessionId: src_id|402e7cca-31361546-37559f98-e1131677_0
2025-10-01T14:08:37.064206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 577 sessionId: src_id|402e7cca-31361546-37559f98-e1131677_0 is DEAD
2025-10-01T14:08:37.064347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255007243246370:5713]
2025-10-01T14:08:37.064374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402e7cca-31361546-37559f98-e1131677_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:37.064383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402e7cca-31361546-37559f98-e1131677_0] Write session will restart in 0.005519s
2025-10-01T14:08:37.064366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:37.064406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402e7cca-31361546-37559f98-e1131677_0] Write session: Do CDS request
2025-10-01T14:08:37.064412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402e7cca-31361546-37559f98-e1131677_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:37.063114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.063123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.063193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.063247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.063303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.063365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.063408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.063411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.063479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.063532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.063593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.063653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.063691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.063693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.063749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255007243246370:5713], now have 1 active actors on pipe
2025-10-01T14:08:37.064841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:37.071883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|402e7cca-31361546-37559f98-e1131677_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:37.071987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:37.072002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 578
2025-10-01T14:08:37.074603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:37.074656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:37.074663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:37.074667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:37.075105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 578 sessionId:  describe result for acl check
2025-10-01T14:08:37.075153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:37.075160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:37.075162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:37.075167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255011538213762:6200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:37.075709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255011538213762:6200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:37.078567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:37.078730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255011538213762:6200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:37.081164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:37.081405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:37.081417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:37.081428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:37.081482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:37.081528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255009161350130:5535]
2025-10-01T14:08:37.082113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:37.082419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:37.082481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:37.082791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:37.082861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.082868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.082870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.082871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.082872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.082873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.082874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.082875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.082876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.082878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.082879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.082880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.082881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.082882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.082888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.082898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.082902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.082906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.082909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.082914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.082917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.082920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.082924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.082928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.082932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.082935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.082938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.082942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.082948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.082956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.082962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.082968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.082973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.082978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.082982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.082987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.082992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.082997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.083002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.083006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.083010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.083014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.083019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.083024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.083029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.083033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.083043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.083048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.083053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.083062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.083067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.083072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.083076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.083080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.083085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.083090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.083130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:37.081878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255011538213762:6200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:37.081893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255011538213762:6200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:37.081898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255011538213762:6200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:37.081908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:37.087179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:37.087833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:37.087850Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:37.087853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:37.087858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:37.087866Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 577 [2:7556255009161350130:5535]
2025-10-01T14:08:37.087882Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:37.087901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:37.087905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:37.087909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:37.087911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:37.087930Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:37.087936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:37.087942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:37.088005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.088008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.088010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.088013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:37.088016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:37.088091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:37.088094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.088107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.088118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.088135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:37.088154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538213823:6200], now have 1 active actors on pipe
2025-10-01T14:08:37.088157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538213674:2446], now have 1 active actors on pipe
2025-10-01T14:08:37.088165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255009161350125:5535]
2025-10-01T14:08:37.088167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255009161350125:5535]
2025-10-01T14:08:37.088169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255009161350125:5535]
2025-10-01T14:08:37.088184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:37.088198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:37.088204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:37.088207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:37.088209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:37.088213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:37.088216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:37.088251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255009161350125:5535]
2025-10-01T14:08:37.088259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:37.088264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:37.088728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.088741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.088769Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:37.088794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:37.088799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:37.088802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:37.088812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:37.088824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:37.088841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:37.089025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.089033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.089049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:37.088425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 577
2025-10-01T14:08:37.088457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 577
2025-10-01T14:08:37.089138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 578 partition: 0 MaxSeqNo: 45 sessionId: src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0
2025-10-01T14:08:37.089535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|402e7cca-31361546-37559f98-e1131677_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:37.092040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0] Write session: try to update token
2025-10-01T14:08:37.092059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:37.112251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 578 sessionId: src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:37.114782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:37.116082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.116112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.116135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:37.116138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:37.116141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:37.116144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:37.116152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255009161350125:5535]
2025-10-01T14:08:37.116157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255009161350125:5535]
2025-10-01T14:08:37.116161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255009161350125:5535]
2025-10-01T14:08:37.116216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:37.116218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:37.116226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.116229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:37.116230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:37.116234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:37.116369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:37.164591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255011538213835:5713]
2025-10-01T14:08:37.164893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 577, pipe: [1:7556255011538213835:5713]
2025-10-01T14:08:37.263932Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:37.264409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:37.264471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538213835:5713], now have 1 active actors on pipe
2025-10-01T14:08:37.265127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:37.265216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:37.265225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:37.265247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255011538213835:5713]
2025-10-01T14:08:37.265277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:37.265294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 578 reason: error at write: Disconnected sessionId: src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0
2025-10-01T14:08:37.265453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 578 sessionId: src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0 is DEAD
2025-10-01T14:08:37.265584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:37.265594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0] Write session will restart in 0.006974s
2025-10-01T14:08:37.265618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0] Write session: Do CDS request
2025-10-01T14:08:37.265640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:37.273954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:37.274018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:37.274034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 579
2025-10-01T14:08:37.274182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:37.274229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:37.274239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:37.274242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:37.274679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 579 sessionId:  describe result for acl check
2025-10-01T14:08:37.274711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:37.274719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:37.274729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:37.274735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255011538213903:6205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:37.275246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255011538213903:6205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:37.278040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255011538213903:6205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:37.278607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:37.280823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:37.281078Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:37.281088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:37.281100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:37.281155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:37.281195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255009161350297:5542]
2025-10-01T14:08:37.281776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:37.282066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:37.282113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:37.282450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:37.282513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.282519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.282520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.282522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.282523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.282524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.282526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.282527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.282528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.282529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.282530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.282531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.282533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.282534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.282540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.282550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.282554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.282558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.282562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.282566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.282570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.282573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.282577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.282581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.282585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.282589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.282592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.282596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.282603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.282611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.282499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255011538213903:6205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:37.282617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.282623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.282628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.282633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.282514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255011538213903:6205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:37.282637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.282518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255011538213903:6205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:37.282531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:37.282641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.282646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.282650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.282654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.282660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.282665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.282669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.282672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.282677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.282681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.282686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.282692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.282697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.282702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.282707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.282712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.282717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.282721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.282726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.282731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.282736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.282777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:37.286924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:37.287531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:37.287547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:37.287550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:37.287554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:37.287560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 578 [2:7556255009161350297:5542]
2025-10-01T14:08:37.287576Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:37.287594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:37.287597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:37.287600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:37.287602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:37.287617Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:37.287629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:37.287636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:37.287697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.287704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.287707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.287710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:37.287713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:37.287786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:37.287794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.287807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.287819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.287840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:37.287862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538213997:6205], now have 1 active actors on pipe
2025-10-01T14:08:37.287870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538213844:2446], now have 1 active actors on pipe
2025-10-01T14:08:37.287878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255009161350292:5542]
2025-10-01T14:08:37.287885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255009161350292:5542]
2025-10-01T14:08:37.287887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255009161350292:5542]
2025-10-01T14:08:37.287900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:37.287914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:37.287917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:37.287917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:37.287919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:37.287931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:37.287933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:37.287917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 578
2025-10-01T14:08:37.287919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 578
2025-10-01T14:08:37.287965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255009161350292:5542]
2025-10-01T14:08:37.287973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:37.287977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:37.287995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.288004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.288049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:37.288058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:37.288062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:37.288065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:37.288074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:37.288082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:37.288101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:37.288227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.288234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.288249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:37.288343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 579 partition: 0 MaxSeqNo: 45 sessionId: src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0
2025-10-01T14:08:37.288660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dc50c67-a4480594-eea9a84c-52be5a24_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:37.291077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0] Write session: try to update token
2025-10-01T14:08:37.291094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:37.305470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 579 sessionId: src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:37.308212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:37.309363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.309387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.309408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:37.309412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:37.309415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:37.309417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:37.309426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255009161350292:5542]
2025-10-01T14:08:37.309431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255009161350292:5542]
2025-10-01T14:08:37.309435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255009161350292:5542]
2025-10-01T14:08:37.309493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:37.309500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.309502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:37.309648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:37.310473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:37.310480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:37.310485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:37.360686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255011538214022:5713]
2025-10-01T14:08:37.361257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 578, pipe: [1:7556255011538214022:5713]
2025-10-01T14:08:37.461701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:37.462044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:37.462108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538214022:5713], now have 1 active actors on pipe
2025-10-01T14:08:37.462666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:37.462770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:37.462773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:37.462850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 579 reason: error at write: Disconnected sessionId: src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0
2025-10-01T14:08:37.463024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 579 sessionId: src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0 is DEAD
2025-10-01T14:08:37.463178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:37.463190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0] Write session will restart in 0.006122s
2025-10-01T14:08:37.463219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0] Write session: Do CDS request
2025-10-01T14:08:37.463225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:37.463217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255011538214022:5713]
2025-10-01T14:08:37.463241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:37.474910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:37.475013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:37.475030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 580
2025-10-01T14:08:37.475229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:37.475263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:37.475272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:37.475279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:37.475778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 580 sessionId:  describe result for acl check
2025-10-01T14:08:37.475823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:37.475830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:37.475832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:37.475838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255011538214058:6210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:37.476390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255011538214058:6210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:37.480457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255011538214058:6210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:37.482266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:37.484670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:37.484932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:37.484942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:37.484913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255011538214058:6210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:37.484954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:37.484932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255011538214058:6210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:37.484935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255011538214058:6210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:37.484945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:37.485008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:37.485061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255009161350455:5545]
2025-10-01T14:08:37.485702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:37.486031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:37.486088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:37.486452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:37.486536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.486542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.486543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.486544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.486546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.486547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.486548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.486549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.486551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.486552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.486553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.486554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.486555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.486556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.486563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.486573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.486577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.486581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.486585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.486589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.486593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.486597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.486601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.486605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.486610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.486613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.486618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.486622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.486631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.486640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.486646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.486652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.486656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.486662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.486667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.486672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.486677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.486682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.486687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.486693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.486698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.486703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.486710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.486714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.486718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.486724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.486728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.486733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.486737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.486743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.486756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.486762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.486767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.486772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.486777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.486781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.486823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:37.492282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:37.493290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:37.493310Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:37.493313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:37.493316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:37.493324Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 579 [2:7556255009161350455:5545]
2025-10-01T14:08:37.493341Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:37.493362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:37.493371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:37.493376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:37.493378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:37.493396Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:37.493406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:37.493414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:37.493493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.493500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.493502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.493505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:37.493508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:37.493581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:37.493588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.493602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.493614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.493630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:37.493649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255009161350450:5545]
2025-10-01T14:08:37.493651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255009161350450:5545]
2025-10-01T14:08:37.493653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255009161350450:5545]
2025-10-01T14:08:37.493663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:37.493673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:37.493675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:37.493678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:37.493679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:37.493693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:37.493696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:37.493707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538214176:6210], now have 1 active actors on pipe
2025-10-01T14:08:37.493711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538214025:2446], now have 1 active actors on pipe
2025-10-01T14:08:37.493749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255009161350450:5545]
2025-10-01T14:08:37.493757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:37.494015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:37.494147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.494154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.494190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:37.494200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:37.494205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:37.494208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:37.494219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:37.494232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:37.494252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:37.493749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 579
2025-10-01T14:08:37.493781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 579
2025-10-01T14:08:37.494597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.494609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.494626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:37.494767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 580 partition: 0 MaxSeqNo: 45 sessionId: src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0
2025-10-01T14:08:37.495250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18e9ab-c7001998-d8ec278c-9d2c4962_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:37.498003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0] Write session: try to update token
2025-10-01T14:08:37.498022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:37.522420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 580 sessionId: src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:37.525033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:37.525235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.525255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.525297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:37.526042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:37.527367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:37.527387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:37.527390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:37.527392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:37.527402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255009161350450:5545]
2025-10-01T14:08:37.527407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255009161350450:5545]
2025-10-01T14:08:37.527413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255009161350450:5545]
2025-10-01T14:08:37.527461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:37.527472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.527471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:37.527475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:37.527479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:37.527484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:37.527619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:37.564119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255011538214188:5713]
2025-10-01T14:08:37.564377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 579, pipe: [1:7556255011538214188:5713]
2025-10-01T14:08:37.695322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:37.705201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.705233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.705424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.705503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.705576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.705652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.705710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.705720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.705801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.705871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.705946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.706026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.710159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:37.710175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0] Write session will restart in 0.009317s
2025-10-01T14:08:37.710205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0] Write session: Do CDS request
2025-10-01T14:08:37.710212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:37.706185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.706198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.709583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:37.709598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:37.709621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 580 reason: error at write: Disconnected sessionId: src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0
2025-10-01T14:08:37.709791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 580 sessionId: src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0 is DEAD
2025-10-01T14:08:37.709923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:37.709955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255011538214188:5713]
2025-10-01T14:08:37.706269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.706336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.706427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.706498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.706544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.706547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.706619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.706686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.706752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.706817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.706862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.706868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.706943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.707003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.707073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.707140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.707185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.707188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.707267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.707328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.707399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.707468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.707516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.707519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.707593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.707654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.707721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.707792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.707838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.707840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.707916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.707981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.708047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.708111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.708157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.708159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.708236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.708303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.708373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.708442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.708489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.708492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.708566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:37.708634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:37.708702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:37.708769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:37.708832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:37.708838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:37.708924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538214188:5713], now have 1 active actors on pipe
2025-10-01T14:08:37.710291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:37.714625Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:08:37.720994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:37.721526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:37.721554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 581
2025-10-01T14:08:37.723695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:37.723759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:37.723767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:37.723772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:37.725339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 581 sessionId:  describe result for acl check
2025-10-01T14:08:37.725374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:37.725376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:37.725381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:37.725388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255011538214202:6215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:37.725980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255011538214202:6215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:37.736256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255011538214202:6215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:37.744164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255011538214202:6215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:37.744183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255011538214202:6215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:37.744186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255011538214202:6215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:37.744197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:37.750485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:37.754155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:37.754429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:37.754434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:37.754449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:37.754510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:37.754563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255009161350617:5548]
2025-10-01T14:08:37.755195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:37.755655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:37.755711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:37.756043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:37.756103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.756104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.756105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.756107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.756108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.756110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.756111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.756112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.756113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.756114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.756115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.756116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.756117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.756118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.756125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.756134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.756138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.756141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.756144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.756148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.756152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.756155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.756158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.756161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.756164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.756168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.756171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.756174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.756183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.756190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:37.756196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.756201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:37.756206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.756211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:37.756214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.756219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:37.756224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.756228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:37.756233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.756237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:37.756242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.756247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:37.756251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.756256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:37.756260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.756265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:37.756270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.756275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.756279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.756284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.756291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.756295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.756302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.756307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:37.756312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.756316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:37.756371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:37.762177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:37.764371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 580
2025-10-01T14:08:37.764411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 580
2025-10-01T14:08:37.763280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:37.763297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:37.763300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:37.763304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:37.763311Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 580 [2:7556255009161350617:5548]
2025-10-01T14:08:37.763331Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:37.763351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:37.763355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:37.763360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:37.763362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:37.763380Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:37.763386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:37.763393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:37.763465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.763468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.763470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.763473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:37.763476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:37.763552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:37.763555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.763568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:37.763580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:37.763595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:37.763612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255009161350611:5548]
2025-10-01T14:08:37.763615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255009161350611:5548]
2025-10-01T14:08:37.763619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255009161350611:5548]
2025-10-01T14:08:37.763637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:37.763652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:37.763666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:37.763669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:37.763712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255009161350611:5548]
2025-10-01T14:08:37.763714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:37.763887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:37.763889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:37.763891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:37.763895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:37.769038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538214324:6215], now have 1 active actors on pipe
2025-10-01T14:08:37.769054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538214193:2446], now have 1 active actors on pipe
2025-10-01T14:08:37.769077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.769086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.769131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:37.769143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:37.769149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:37.769152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:37.769165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:37.769183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:37.769207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:37.772314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.772333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.772380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:37.772613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 581 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0
2025-10-01T14:08:37.774725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|553d4547-4e4211ca-5574ef54-eb278fb6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:37.777556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0] Write session: try to update token
2025-10-01T14:08:37.777577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:37.795906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:37.795924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:37.795928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:37.795930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:37.795940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255009161350611:5548]
2025-10-01T14:08:37.795945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255009161350611:5548]
2025-10-01T14:08:37.795950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255009161350611:5548]
2025-10-01T14:08:37.796001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:37.796012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:37.796015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:37.796176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:37.798525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:37.798537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:37.798542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:37.811952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255011538214374:5713]
2025-10-01T14:08:37.812471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 580, pipe: [1:7556255011538214374:5713]
2025-10-01T14:08:37.826452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 581 sessionId: src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:37.829430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:37.988429Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:37.988914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538214374:5713], now have 1 active actors on pipe
2025-10-01T14:08:37.988947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:37.988955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:37.989841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:37.989852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0] Write session will restart in 0.005407s
2025-10-01T14:08:37.989878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0] Write session: Do CDS request
2025-10-01T14:08:37.989884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:37.989341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255011538214374:5713]
2025-10-01T14:08:37.989377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:37.989413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:37.989415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:37.989476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 581 reason: error at write: Disconnected sessionId: src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0
2025-10-01T14:08:37.989662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 581 sessionId: src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0 is DEAD
2025-10-01T14:08:37.989492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:37.998051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:37.998580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:37.998597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 582
2025-10-01T14:08:38.006530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:38.006589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:38.006594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:38.006599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:38.008052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 582 sessionId:  describe result for acl check
2025-10-01T14:08:38.008093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:38.008096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:38.008098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:38.008104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255015833181756:6226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:38.008627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255015833181756:6226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:38.017346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255015833181756:6226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:38.020301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:38.023930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255015833181756:6226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:38.023949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255015833181756:6226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:38.023953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255015833181756:6226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:38.023964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:38.023312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:38.023560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:38.023565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:38.023577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:38.023636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:38.023676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255013456318077:5552]
2025-10-01T14:08:38.024298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:38.024981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:38.025032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:38.025368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:38.025434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.025435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.025436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.025438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.025439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.025440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.025442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.025443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.025444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.025445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.025446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.025447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.025449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.025450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.025457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.025469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.025473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.025477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.025481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.025486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.025489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.025511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.025515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.025520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.025523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.025528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.025532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.025537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.025546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.025554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.025561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.025567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.025572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.025577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.025582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.025587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.025592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.025597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.025603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.025608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.025614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.025619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.025623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.025629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.025633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.025638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.025642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.025647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.025651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.025655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.025659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.025663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.025667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.025671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.025675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.025680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.025720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:38.032429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:38.034313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 581
2025-10-01T14:08:38.034365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 581
2025-10-01T14:08:38.037865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 582 partition: 0 MaxSeqNo: 45 sessionId: src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0
2025-10-01T14:08:38.033110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:38.033125Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:38.033129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:38.033133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:38.033143Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 581 [2:7556255013456318077:5552]
2025-10-01T14:08:38.033161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:38.033181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:38.033185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:38.033189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:38.033191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:38.033210Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:38.033215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:38.033222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:38.033294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.033296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.033298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.033301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:38.033304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:38.033381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:38.033385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.033396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.033407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.033423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:38.033440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255013456318071:5552]
2025-10-01T14:08:38.033442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255013456318071:5552]
2025-10-01T14:08:38.033445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255013456318071:5552]
2025-10-01T14:08:38.033459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:38.033474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:38.033488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:38.033492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:38.033534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255013456318071:5552]
2025-10-01T14:08:38.033538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:38.033622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:38.033624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:38.033626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:38.033630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:38.034703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255011538214388:2446], now have 1 active actors on pipe
2025-10-01T14:08:38.034708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833181837:6226], now have 1 active actors on pipe
2025-10-01T14:08:38.034731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.034736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.034766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:38.034774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:38.034780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:38.034783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:38.034794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:38.034806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:38.034826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:38.037663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.037672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.037706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:38.042671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca16b5d7-38633bfa-254ad66c-b93f468d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:38.045562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0] Write session: try to update token
2025-10-01T14:08:38.045583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:38.066392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:38.066411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:38.066414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:38.066417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:38.066428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255013456318071:5552]
2025-10-01T14:08:38.066434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255013456318071:5552]
2025-10-01T14:08:38.066439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255013456318071:5552]
2025-10-01T14:08:38.066497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:38.066505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.066507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:38.066672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:38.070555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:38.070568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:38.070572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:38.080475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 582 sessionId: src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:38.083396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:38.098072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255015833181851:5713]
2025-10-01T14:08:38.098470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 581, pipe: [1:7556255015833181851:5713]
2025-10-01T14:08:38.293778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:38.294423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.294440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.294485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833181851:5713], now have 1 active actors on pipe
2025-10-01T14:08:38.299093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255015833181851:5713]
2025-10-01T14:08:38.299124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:38.299160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:38.299163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:38.299229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 582 reason: error at write: Disconnected sessionId: src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0
2025-10-01T14:08:38.299422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 582 sessionId: src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0 is DEAD
2025-10-01T14:08:38.299173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:38.303774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:38.303786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0] Write session will restart in 0.007545s
2025-10-01T14:08:38.303835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0] Write session: Do CDS request
2025-10-01T14:08:38.303842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:38.313122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:38.313658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:38.313675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 583
2025-10-01T14:08:38.313870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:38.313903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:38.313909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:38.313912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:38.314700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 583 sessionId:  describe result for acl check
2025-10-01T14:08:38.314741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:38.314743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:38.314745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:38.314750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255015833181879:6231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:38.315322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255015833181879:6231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:38.336144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255015833181879:6231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:38.341478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:38.350285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:38.350572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:38.350576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:38.350588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:38.350650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:38.350701Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255013456318281:5565]
2025-10-01T14:08:38.351350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:38.352267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:38.352315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:38.352654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:38.352707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.352708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.352710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.352711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.352713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.352714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.352716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.352717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.352718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.352719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.352721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.352722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.352723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.352725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.352731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.352741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.352745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.352749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.352752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.352756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.352760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.352764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.352767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.352772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.352775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.352794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.352798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.352802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.352810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.352817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.352824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.352829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.352834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.352839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.352844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.352849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.352854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.352859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.352864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.352869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.352874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.352879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.352884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.352891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.352896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.352903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.352909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.352914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.352919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.352924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.352929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.352934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.352938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.352944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.352948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.352953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.352995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:38.355804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255015833181879:6231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:38.355824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255015833181879:6231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:38.355827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255015833181879:6231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:38.355837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:38.359312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:38.359956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:38.359962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:38.359965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:38.359968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:38.359976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 582 [2:7556255013456318281:5565]
2025-10-01T14:08:38.359995Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:38.360013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:38.360016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:38.360020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:38.360023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:38.360041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:38.360047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:38.360053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:38.360119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.360121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.360123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.360126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:38.360129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:38.360206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:38.360209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.360219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.360229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.360245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:38.360262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255013456318275:5565]
2025-10-01T14:08:38.360266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255013456318275:5565]
2025-10-01T14:08:38.360268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255013456318275:5565]
2025-10-01T14:08:38.360281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:38.360318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:38.360334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:38.360338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:38.360377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255013456318275:5565]
2025-10-01T14:08:38.360380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:38.360876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:38.360884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:38.360886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:38.360892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:38.361677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 582
2025-10-01T14:08:38.362148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833181864:2446], now have 1 active actors on pipe
2025-10-01T14:08:38.362487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833182035:6231], now have 1 active actors on pipe
2025-10-01T14:08:38.362603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 582
2025-10-01T14:08:38.362752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.362762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.362792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:38.362802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:38.362808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:38.362811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:38.362822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:38.362837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:38.362857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:38.363167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.363175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.363191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:38.363337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 583 partition: 0 MaxSeqNo: 45 sessionId: src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0
2025-10-01T14:08:38.367320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3307f234-863be3e0-5658b97a-ec7a37ba_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:38.369976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0] Write session: try to update token
2025-10-01T14:08:38.369996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:38.402792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255015833182041:5713]
2025-10-01T14:08:38.406749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833182041:5713], now have 1 active actors on pipe
2025-10-01T14:08:38.406882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 582, pipe: [1:7556255015833182041:5713]
2025-10-01T14:08:38.411790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 583 sessionId: src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:38.414421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:38.414666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.414685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.414726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:38.418215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:38.428531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:38.428550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:38.428553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:38.428555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:38.428567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255013456318275:5565]
2025-10-01T14:08:38.428572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255013456318275:5565]
2025-10-01T14:08:38.428575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255013456318275:5565]
2025-10-01T14:08:38.428623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:38.428631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.428634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:38.428773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:38.430669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:38.430680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:38.430684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:38.633168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:38.640686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.640713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.640889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.640949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.641012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.641078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.641128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.641133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.641204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.641260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.641320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.641381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.641419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.641422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.641482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.641533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.641603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.641663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.641700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.641702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.641761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.641825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.641878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.641931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.641970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.641972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.642031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.642090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.642157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.642213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.642250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.642252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.642314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.642367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.642445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.642527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.642574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.642576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.642647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.642700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.642755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.642811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.642905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.642916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.642978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.643030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.643090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.643155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.643195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.643197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.643262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.643317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.643375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.643437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.643476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.643478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.643540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.643596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.643667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.643725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.643769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.643771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.646877Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:38.648979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:38.648991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0] Write session will restart in 0.008862s
2025-10-01T14:08:38.649019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0] Write session: Do CDS request
2025-10-01T14:08:38.649026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:38.647302Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:38.647422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:38.647425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:38.647453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 583 reason: error at write: Disconnected sessionId: src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0
2025-10-01T14:08:38.647669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 583 sessionId: src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0 is DEAD
2025-10-01T14:08:38.647743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255015833182041:5713]
2025-10-01T14:08:38.660374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:38.661128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:38.661143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 584
2025-10-01T14:08:38.661296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:38.661321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:38.661325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:38.661328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:38.662738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 584 sessionId:  describe result for acl check
2025-10-01T14:08:38.662788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:38.662791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:38.662793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:38.662799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255015833182057:6237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:38.663389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255015833182057:6237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:38.671608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255015833182057:6237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:38.683327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255015833182057:6237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:38.683342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255015833182057:6237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:38.683345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255015833182057:6237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:38.683353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:38.696153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:38.699088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:38.699640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:38.699646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:38.699665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:38.699761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:38.699809Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255013456318446:5568]
2025-10-01T14:08:38.700504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:38.700900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:38.700950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:38.701307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:38.701396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.701397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.701398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.701399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.701401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.701402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.701403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.701405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.701406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.701407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.701409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.701410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.701411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.701412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.701419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.701430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.701435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.701439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.701443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.701447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.701452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.701455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.701459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.701464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.701468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.701499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.701504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.701508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.701518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.701528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.701536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.701542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.701549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.701555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.701561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.701567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.701572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.701578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.701583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.701588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.701594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.701600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.701604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.701610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.701616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.701622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.701627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.701633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.701638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.701644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.701648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.701654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.701658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.701664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.701680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.701687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.701730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:38.705776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:38.706415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:38.706421Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:38.706423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:38.706426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:38.706432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 583 [2:7556255013456318446:5568]
2025-10-01T14:08:38.706445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:38.706886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 583
2025-10-01T14:08:38.706915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 583
2025-10-01T14:08:38.707545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 584 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a884e3a-26896b90-f8806fd0-5605f603_0
2025-10-01T14:08:38.707897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfba123d-2a023f8f-3e47d601-88d90c15_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a884e3a-26896b90-f8806fd0-5605f603_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:38.706463Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:38.706473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:38.706476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:38.706479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:38.706494Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:38.706498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:38.706503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:38.706565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.706566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.706568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.706570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:38.706572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:38.706629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:38.706631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.706641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.706651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.706664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:38.710495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a884e3a-26896b90-f8806fd0-5605f603_0] Write session: try to update token
2025-10-01T14:08:38.706685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833182107:6237], now have 1 active actors on pipe
2025-10-01T14:08:38.706689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833182049:2446], now have 1 active actors on pipe
2025-10-01T14:08:38.706697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255013456318438:5568]
2025-10-01T14:08:38.706699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255013456318438:5568]
2025-10-01T14:08:38.710516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a884e3a-26896b90-f8806fd0-5605f603_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:38.706701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255013456318438:5568]
2025-10-01T14:08:38.706717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:38.706730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:38.706739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:38.706742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:38.706745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:38.706745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:38.706747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:38.706779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255013456318438:5568]
2025-10-01T14:08:38.706787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:38.706812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:38.707088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.707094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.707122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a884e3a-26896b90-f8806fd0-5605f603_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:38.707130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:38.707135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:38.707137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:38.707146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:38.707157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:38.707174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:38.707419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.707422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.707437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:38.727301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 584 sessionId: src_id|6a884e3a-26896b90-f8806fd0-5605f603_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:38.730146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:38.730618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:38.730413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.730435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.730484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:38.733641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:38.733648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:38.733651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:38.733653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:38.733661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255013456318438:5568]
2025-10-01T14:08:38.733666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255013456318438:5568]
2025-10-01T14:08:38.733670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255013456318438:5568]
2025-10-01T14:08:38.733720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:38.733727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:38.733728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:38.733733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:38.733734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.733737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:38.733882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:38.748430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255015833182217:5713]
2025-10-01T14:08:38.748773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 583, pipe: [1:7556255015833182217:5713]
2025-10-01T14:08:38.886463Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:38.886786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833182217:5713], now have 1 active actors on pipe
2025-10-01T14:08:38.894825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.894851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.895007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.895077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.895147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.895217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.895263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.895273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.895342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.895404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.895468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.895537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.895582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.895591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.895657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.895716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.895776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.895839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.895884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.895890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.895949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.896012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.896071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.896135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.896177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.896184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.896243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.896301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.896363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.896429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.896475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.896481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.896543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.896599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.896665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.896729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.896800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.896806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.896870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.896928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.896995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.897056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.897098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.897109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.897170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.897234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.897295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.897359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.897406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.897413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.897482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.897546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.897612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.897676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.897719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.897722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.897795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:38.897860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:38.897927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:38.898016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:38.898056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:38.898059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:38.898344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255015833182217:5713]
2025-10-01T14:08:38.898400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:38.898408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:38.898433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 584 reason: error at write: Disconnected sessionId: src_id|6a884e3a-26896b90-f8806fd0-5605f603_0
2025-10-01T14:08:38.898671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 584 sessionId: src_id|6a884e3a-26896b90-f8806fd0-5605f603_0 is DEAD
2025-10-01T14:08:38.898777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a884e3a-26896b90-f8806fd0-5605f603_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:38.898787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a884e3a-26896b90-f8806fd0-5605f603_0] Write session will restart in 0.005206s
2025-10-01T14:08:38.898812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a884e3a-26896b90-f8806fd0-5605f603_0] Write session: Do CDS request
2025-10-01T14:08:38.898818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a884e3a-26896b90-f8806fd0-5605f603_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:38.898901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:38.899199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:38.904857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a884e3a-26896b90-f8806fd0-5605f603_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:38.904927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:38.904945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 585
2025-10-01T14:08:38.905089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:38.905119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:38.905126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:38.905129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:38.905460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 585 sessionId:  describe result for acl check
2025-10-01T14:08:38.905491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:38.905492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:38.905493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:38.905498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255015833182248:6247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:38.905921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255015833182248:6247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:38.908504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255015833182248:6247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:38.910586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:38.911217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255015833182248:6247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:38.911231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255015833182248:6247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:38.911234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255015833182248:6247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:38.911241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:38.912718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:38.912917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:38.912926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:38.912937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:38.912993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:38.913030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255013456318609:5571]
2025-10-01T14:08:38.913464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:38.913778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:38.913822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:38.914043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:38.914089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.914093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.914094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.914095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.914096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.914097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.914098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.914099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.914100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.914101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.914102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.914103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.914104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.914105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.914111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.914121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.914125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.914129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.914133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.914136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.914140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.914144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.914147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.914151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.914155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.914159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.914161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.914165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.914172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.914182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:38.914191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.914198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:38.914205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.914210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:38.914216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.914220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:38.914224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.914230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:38.914237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.914242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:38.914247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.914253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:38.914259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.914265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:38.914272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.914276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:38.914280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.914285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.914290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.914295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.914299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.914304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.914311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.914316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:38.914321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.914329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:38.914366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:38.917758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:38.918533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:38.918544Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:38.918546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:38.918550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:38.918556Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 584 [2:7556255013456318609:5571]
2025-10-01T14:08:38.918570Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:38.918586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:38.918592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:38.918596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:38.918598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:38.918615Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:38.918623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:38.918628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:38.918683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.918688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.918691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.918694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:38.918697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:38.918763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:38.918769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.918781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:38.918793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:38.918812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:38.918833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833182233:2446], now have 1 active actors on pipe
2025-10-01T14:08:38.918839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833182388:6247], now have 1 active actors on pipe
2025-10-01T14:08:38.918847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255013456318603:5571]
2025-10-01T14:08:38.918861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255013456318603:5571]
2025-10-01T14:08:38.918863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255013456318603:5571]
2025-10-01T14:08:38.918877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:38.918892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:38.918892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:38.918895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:38.918897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:38.918909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:38.918912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:38.918903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 584
2025-10-01T14:08:38.918924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 584
2025-10-01T14:08:38.918938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255013456318603:5571]
2025-10-01T14:08:38.918945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:38.918948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:38.918966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.918970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.919010Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4635953-e623b531-5ee4809f-84918f45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:38.919020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:38.919023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:38.919026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:38.919033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:38.919041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:38.919058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:38.919196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.919202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.919214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:38.919283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 585 partition: 0 MaxSeqNo: 45 sessionId: src_id|4635953-e623b531-5ee4809f-84918f45_0
2025-10-01T14:08:38.919629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a884e3a-26896b90-f8806fd0-5605f603_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4635953-e623b531-5ee4809f-84918f45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:38.922035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4635953-e623b531-5ee4809f-84918f45_0] Write session: try to update token
2025-10-01T14:08:38.922051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4635953-e623b531-5ee4809f-84918f45_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:38.935162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 585 sessionId: src_id|4635953-e623b531-5ee4809f-84918f45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:38.937530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:38.938939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:38.938960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:38.938978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:38.938980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:38.938982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:38.938984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:38.938990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255013456318603:5571]
2025-10-01T14:08:38.938993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255013456318603:5571]
2025-10-01T14:08:38.938995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255013456318603:5571]
2025-10-01T14:08:38.939030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:38.939034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:38.939037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:38.939049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:38.939061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:38.939068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:38.939204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:38.998574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255015833182410:5713]
2025-10-01T14:08:38.998879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 584, pipe: [1:7556255015833182410:5713]
2025-10-01T14:08:39.089059Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:39.089897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:39.089993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255015833182410:5713], now have 1 active actors on pipe
2025-10-01T14:08:39.090055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:39.090230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:39.090326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255015833182410:5713]
2025-10-01T14:08:39.105281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:39.105864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:39.105879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:39.105904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 585 reason: error at write: Disconnected sessionId: src_id|4635953-e623b531-5ee4809f-84918f45_0
2025-10-01T14:08:39.106036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 585 sessionId: src_id|4635953-e623b531-5ee4809f-84918f45_0 is DEAD
2025-10-01T14:08:39.106175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4635953-e623b531-5ee4809f-84918f45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:39.106185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4635953-e623b531-5ee4809f-84918f45_0] Write session will restart in 0.006385s
2025-10-01T14:08:39.106220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4635953-e623b531-5ee4809f-84918f45_0] Write session: Do CDS request
2025-10-01T14:08:39.106228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4635953-e623b531-5ee4809f-84918f45_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:39.112509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:39.112820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:39.112830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:39.112843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:39.112899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:39.112955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255017751286073:5575]
2025-10-01T14:08:39.113527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:39.113865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:39.113908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:39.113957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4635953-e623b531-5ee4809f-84918f45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.114093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:39.114107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 586
2025-10-01T14:08:39.114203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:39.114223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.114257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.114262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:39.114263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.114274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:39.114264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.114277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:39.114265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.114266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.114267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.114268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.114269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.114270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.114272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.114273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.114274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.114275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.114277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.114282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.114300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.114304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.114308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.114311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.114315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.114318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.114322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.114325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.114328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.114332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.114335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.114338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.114341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.114348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.114355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.114361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.114366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.114382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.114387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.114391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.114396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.114400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.114409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.114412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.114417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.114425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.114430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.114433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.114438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.114442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.114446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.114450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.114459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.114464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.114468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.114473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.114477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.114481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.114485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.114489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.114493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.114529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:39.114686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 586 sessionId:  describe result for acl check
2025-10-01T14:08:39.114725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:39.114733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:39.114735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:39.114740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255020128149835:6252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:39.115268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255020128149835:6252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:39.118328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:39.118403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255020128149835:6252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:39.119928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:39.119941Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:39.119943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:39.119947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:39.119954Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 585 [2:7556255017751286073:5575]
2025-10-01T14:08:39.119973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:39.119989Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:39.119996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.119999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.120002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.120017Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:39.120026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:39.120031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:39.120085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.120093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.120095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.120097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:39.120100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:39.120176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:39.120178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.120202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.120211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.120227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:39.120246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128149708:2446], now have 1 active actors on pipe
2025-10-01T14:08:39.120254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255017751286068:5575]
2025-10-01T14:08:39.120256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255017751286068:5575]
2025-10-01T14:08:39.120258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255017751286068:5575]
2025-10-01T14:08:39.120267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:39.120277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:39.120279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:39.120279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:39.120281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:39.120293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:39.120296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:39.120310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 585
2025-10-01T14:08:39.120332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255017751286068:5575]
2025-10-01T14:08:39.120340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:39.120342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:39.122583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255020128149835:6252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:39.122597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255020128149835:6252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:39.122602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255020128149835:6252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:39.122609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:39.122885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 585
2025-10-01T14:08:39.122885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128149875:6252], now have 1 active actors on pipe
2025-10-01T14:08:39.123003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.123015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.123043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:39.123056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.123065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.123067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:39.123080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.123106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:39.123128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.123283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.123291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.123306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.123432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 586 partition: 0 MaxSeqNo: 45 sessionId: src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0
2025-10-01T14:08:39.123810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4635953-e623b531-5ee4809f-84918f45_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:39.132131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0] Write session: try to update token
2025-10-01T14:08:39.132155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:39.137405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:39.137422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:39.137433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255017751286068:5575]
2025-10-01T14:08:39.137479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:39.137480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:39.137802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:39.137952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:39.138259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:39.138590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:39.138785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:39.138834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:39.149952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 586 sessionId: src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:39.150239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:39.150259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:39.150262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:39.150264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:39.150274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255017751286068:5575]
2025-10-01T14:08:39.150280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255017751286068:5575]
2025-10-01T14:08:39.150283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255017751286068:5575]
2025-10-01T14:08:39.150327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:39.150334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:39.150339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:39.150341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.150342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:39.150343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:39.150499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:39.152410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:39.190582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255020128149878:5713]
2025-10-01T14:08:39.190857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 585, pipe: [1:7556255020128149878:5713]
2025-10-01T14:08:39.301972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:39.302331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.302344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.302386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128149878:5713], now have 1 active actors on pipe
2025-10-01T14:08:39.302610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:39.302771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:39.302847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 586 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0
2025-10-01T14:08:39.303047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 586 sessionId: src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0 is DEAD
2025-10-01T14:08:39.303199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:39.303207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0] Write session will restart in 0.009266s
2025-10-01T14:08:39.303233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0] Write session: Do CDS request
2025-10-01T14:08:39.303238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:39.303152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255020128149878:5713]
2025-10-01T14:08:39.303175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:39.313895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.314111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:39.314125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 587
2025-10-01T14:08:39.314229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.314252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:39.314257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:39.314260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:39.314841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 587 sessionId:  describe result for acl check
2025-10-01T14:08:39.314882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:39.314888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:39.314890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:39.314895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255020128149991:6257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:39.315414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255020128149991:6257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:39.317304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255020128149991:6257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:39.319364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:39.321113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:39.321275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255020128149991:6257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:39.321289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255020128149991:6257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:39.321293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255020128149991:6257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:39.321301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:39.321307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:39.321318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:39.321329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:39.321375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:39.321415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255017751286277:5588]
2025-10-01T14:08:39.322026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:39.322272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:39.322313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:39.322610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:39.322670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.322671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.322672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.322673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.322674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.322676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.322677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.322678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.322679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.322680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.322681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.322682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.322683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.322685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.322690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.322699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.322702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.322706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.322709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.322712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.322715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.322718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.322722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.322725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.322728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.322732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.322735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.322739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.322746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.322753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.322759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.322764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.322768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.322773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.322777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.322781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.322785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.322790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.322793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.322798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.322802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.322807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.322810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.322815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.322819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.322825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.322830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.322834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.322840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.322844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.322848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.322853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.322857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.322861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.322865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.322870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.322908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:39.327820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:39.328654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:39.328666Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:39.328668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:39.328672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:39.328679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 586 [2:7556255017751286277:5588]
2025-10-01T14:08:39.328693Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:39.328709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:39.328715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.328718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.328720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.328735Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:39.328744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:39.328749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:39.328821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.328827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.328829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.328832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:39.328835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:39.328897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:39.328904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.328915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.328929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.328947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:39.328965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255017751286272:5588]
2025-10-01T14:08:39.328971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255017751286272:5588]
2025-10-01T14:08:39.328972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255017751286272:5588]
2025-10-01T14:08:39.328989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:39.329005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:39.329017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:39.329020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:39.329021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:39.329023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:39.329026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:39.329054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255017751286272:5588]
2025-10-01T14:08:39.329056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:39.329084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:39.329174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150048:6257], now have 1 active actors on pipe
2025-10-01T14:08:39.329183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128149889:2446], now have 1 active actors on pipe
2025-10-01T14:08:39.329301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 586
2025-10-01T14:08:39.329326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 586
2025-10-01T14:08:39.329482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.329494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.329521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|723f3525-e5710e03-b8e0f5d1-791db746_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:39.329530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.329535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.329538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:39.329547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.329557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:39.329573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.330962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.330977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.330999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.331125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 587 partition: 0 MaxSeqNo: 45 sessionId: src_id|723f3525-e5710e03-b8e0f5d1-791db746_0
2025-10-01T14:08:39.331486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f329d648-4559c2ee-96959e5f-35c6fcf0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|723f3525-e5710e03-b8e0f5d1-791db746_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:39.333804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723f3525-e5710e03-b8e0f5d1-791db746_0] Write session: try to update token
2025-10-01T14:08:39.333819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723f3525-e5710e03-b8e0f5d1-791db746_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:39.351311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:39.351328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:39.351330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:39.351332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:39.351341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255017751286272:5588]
2025-10-01T14:08:39.351346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255017751286272:5588]
2025-10-01T14:08:39.351349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255017751286272:5588]
2025-10-01T14:08:39.351395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:39.351405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.351408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:39.351577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:39.351936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 587 sessionId: src_id|723f3525-e5710e03-b8e0f5d1-791db746_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:39.354422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:39.354443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:39.354457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:39.354460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:39.404314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255020128150071:5713]
2025-10-01T14:08:39.404979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 586, pipe: [1:7556255020128150071:5713]
2025-10-01T14:08:39.501736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:39.502040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.502050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.502095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150071:5713], now have 1 active actors on pipe
2025-10-01T14:08:39.502747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:39.503083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255020128150071:5713]
2025-10-01T14:08:39.503116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:39.503118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:39.503165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 587 reason: error at write: Disconnected sessionId: src_id|723f3525-e5710e03-b8e0f5d1-791db746_0
2025-10-01T14:08:39.503333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 587 sessionId: src_id|723f3525-e5710e03-b8e0f5d1-791db746_0 is DEAD
2025-10-01T14:08:39.503474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:39.504108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723f3525-e5710e03-b8e0f5d1-791db746_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:39.504119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723f3525-e5710e03-b8e0f5d1-791db746_0] Write session will restart in 0.007995s
2025-10-01T14:08:39.504155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723f3525-e5710e03-b8e0f5d1-791db746_0] Write session: Do CDS request
2025-10-01T14:08:39.504161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723f3525-e5710e03-b8e0f5d1-791db746_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:39.512926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723f3525-e5710e03-b8e0f5d1-791db746_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.514540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:39.514561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 588
2025-10-01T14:08:39.514721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.514764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:39.514773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:39.514777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:39.515318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 588 sessionId:  describe result for acl check
2025-10-01T14:08:39.515355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:39.515361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:39.515364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:39.515370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255020128150106:6262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:39.515837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255020128150106:6262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:39.518956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255020128150106:6262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:39.521091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255020128150106:6262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:39.521104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255020128150106:6262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:39.521107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255020128150106:6262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:39.521115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:39.523740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:39.531789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:39.532054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:39.532058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:39.532071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:39.532131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:39.532169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255017751286444:5591]
2025-10-01T14:08:39.532768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:39.533088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:39.533139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:39.533448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:39.533507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.533508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.533509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.533511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.533512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.533514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.533515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.533516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.533517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.533518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.533519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.533520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.533521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.533522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.533527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.533536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.533540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.533543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.533547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.533550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.533553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.533556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.533560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.533564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.533567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.533570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.533573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.533576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.533583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.533592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.533598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.533603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.533607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.533611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.533616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.533620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.533624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.533629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.533633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.533637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.533642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.533646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.533650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.533655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.533659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.533663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.533667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.533672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.533676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.533681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.533684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.533689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.533693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.533697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.533703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.533707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.533745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:39.544656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:39.545438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:39.545453Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:39.545456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:39.545460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:39.545469Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 587 [2:7556255017751286444:5591]
2025-10-01T14:08:39.545487Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:39.545506Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:39.545509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.545512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.545515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.545532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:39.545537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:39.545544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:39.545605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.545606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.545608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.545612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:39.545615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:39.545940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 587
2025-10-01T14:08:39.545941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 587
2025-10-01T14:08:39.545687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:39.545689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.545700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.545709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.545722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:39.545739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255017751286439:5591]
2025-10-01T14:08:39.545741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255017751286439:5591]
2025-10-01T14:08:39.545744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255017751286439:5591]
2025-10-01T14:08:39.545753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:39.545768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:39.545780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:39.545783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:39.545804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:39.545809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:39.545812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:39.545823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255017751286439:5591]
2025-10-01T14:08:39.545827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:39.545834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:39.545849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150074:2446], now have 1 active actors on pipe
2025-10-01T14:08:39.545853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150231:6262], now have 1 active actors on pipe
2025-10-01T14:08:39.546065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.546079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.546107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:39.546127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.546136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.546138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:39.546149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.546163Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:39.546185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.546469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.546487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.546510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.546662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 588 partition: 0 MaxSeqNo: 45 sessionId: src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0
2025-10-01T14:08:39.549604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723f3525-e5710e03-b8e0f5d1-791db746_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:39.552017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0] Write session: try to update token
2025-10-01T14:08:39.552036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:39.569139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 588 sessionId: src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:39.571617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:39.572390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.572413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.572434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:39.572437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:39.572440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:39.572442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:39.572451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255017751286439:5591]
2025-10-01T14:08:39.572455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255017751286439:5591]
2025-10-01T14:08:39.572458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255017751286439:5591]
2025-10-01T14:08:39.572514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:39.572516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:39.572520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:39.572522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.572524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:39.572524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:39.572701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:39.603280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255020128150246:5713]
2025-10-01T14:08:39.605023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 587, pipe: [1:7556255020128150246:5713]
2025-10-01T14:08:39.717144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:39.717587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:39.717638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150246:5713], now have 1 active actors on pipe
2025-10-01T14:08:39.718083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:39.718185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:39.718188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:39.718256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 588 reason: error at write: Disconnected sessionId: src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0
2025-10-01T14:08:39.718410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:39.718454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 588 sessionId: src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0 is DEAD
2025-10-01T14:08:39.718458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255020128150246:5713]
2025-10-01T14:08:39.718575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:39.718586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0] Write session will restart in 0.007899s
2025-10-01T14:08:39.718610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0] Write session: Do CDS request
2025-10-01T14:08:39.718618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:39.727860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.728228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:39.728247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 589
2025-10-01T14:08:39.728374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.728416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:39.728425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:39.728429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:39.728829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 589 sessionId:  describe result for acl check
2025-10-01T14:08:39.728861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:39.728866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:39.728868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:39.728872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255020128150373:6267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:39.729401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255020128150373:6267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:39.730561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:39.731543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255020128150373:6267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:39.732442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:39.732608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:39.732617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:39.732628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:39.732668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:39.732695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255017751286612:5594]
2025-10-01T14:08:39.733100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:39.733301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:39.733343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:39.733615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:39.733662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.733668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.733669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.733669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.733670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.733671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.733671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.733672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.733673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.733673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.733674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.733675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.733675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.733676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.733679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.733685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.733687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.733689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.733691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.733693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.733695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.733698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.733700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.733702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.733704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.733706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.733708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.733710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.733716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.733726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.733733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.733737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.733741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.733745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.733749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.733754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.733758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.733763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.733767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.733772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.733776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.733782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.733787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.733791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255020128150373:6267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:39.733792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.733796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.733816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255020128150373:6267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:39.733801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.733805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.733820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255020128150373:6267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:39.733828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:39.733809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.733813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.733817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.733821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.733825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.733830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.733834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.733838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.733843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.733877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:39.737515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:39.738168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:39.738184Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:39.738187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:39.738191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:39.738197Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 588 [2:7556255017751286612:5594]
2025-10-01T14:08:39.738212Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:39.738234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:39.738244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.738247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.738249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.738264Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:39.738270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:39.738276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:39.738327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.738334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.738336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.738339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:39.738342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:39.738432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:39.738443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.738455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.738466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.738481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:39.738499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150412:6267], now have 1 active actors on pipe
2025-10-01T14:08:39.738507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150250:2446], now have 1 active actors on pipe
2025-10-01T14:08:39.738516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255017751286607:5594]
2025-10-01T14:08:39.738522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255017751286607:5594]
2025-10-01T14:08:39.738524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255017751286607:5594]
2025-10-01T14:08:39.738537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:39.738537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 588
2025-10-01T14:08:39.738537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 588
2025-10-01T14:08:39.738559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:39.738561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:39.738564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:39.738566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:39.738579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:39.738582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:39.738626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.738638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.738651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255017751286607:5594]
2025-10-01T14:08:39.738662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:39.738669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:39.738692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:39.738703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.738707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.738709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:39.738718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.738733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:39.738757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.738903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.738912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.738928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.739022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 589 partition: 0 MaxSeqNo: 45 sessionId: src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0
2025-10-01T14:08:39.739358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a737fc0a-373082d2-7e36d26d-9844c5bb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:39.741748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0] Write session: try to update token
2025-10-01T14:08:39.741764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:39.755256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 589 sessionId: src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:39.757670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:39.758358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.758397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.758418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:39.758427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:39.758429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:39.758431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:39.758441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255017751286607:5594]
2025-10-01T14:08:39.758445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255017751286607:5594]
2025-10-01T14:08:39.758449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255017751286607:5594]
2025-10-01T14:08:39.758484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:39.758495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:39.758501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:39.758504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:39.758510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.758513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:39.758674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:39.818776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255020128150422:5713]
2025-10-01T14:08:39.819058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 588, pipe: [1:7556255020128150422:5713]
2025-10-01T14:08:39.897470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:39.897904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:39.897947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150422:5713], now have 1 active actors on pipe
2025-10-01T14:08:39.898011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:39.898117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255020128150422:5713]
2025-10-01T14:08:39.898141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:39.907722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:39.907741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:39.907764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 589 reason: error at write: Disconnected sessionId: src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0
2025-10-01T14:08:39.907956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 589 sessionId: src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0 is DEAD
2025-10-01T14:08:39.908274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:39.908285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0] Write session will restart in 0.007358s
2025-10-01T14:08:39.908324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0] Write session: Do CDS request
2025-10-01T14:08:39.908334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:39.915097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:39.916838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.917225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:39.917439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:39.917453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:39.917464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:39.917529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:39.917569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255017751286778:5596]
2025-10-01T14:08:39.917664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:39.917676Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 590
2025-10-01T14:08:39.917777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:39.917798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:39.917802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:39.917804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:39.918049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 590 sessionId:  describe result for acl check
2025-10-01T14:08:39.918072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:39.918073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:39.918074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:39.918077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255020128150556:6273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:39.918130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:39.918432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:39.918440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255020128150556:6273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:39.918485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:39.918782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:39.918861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.918867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.918868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.918869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.918870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.918871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.918872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.918873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.918874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.918874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.918876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.918877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.918877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.918879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.918883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.918891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.918894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.918897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.918899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.918902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.918905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.918908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.918911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.918914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.918917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.918921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.918924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.918927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.918933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.918940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:39.918946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.918951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:39.918955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.918960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:39.918964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.918968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:39.918972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.918977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:39.918980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.918984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:39.918988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.918993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:39.918996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.919007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:39.919011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.919016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:39.919020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.919026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.919034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.919039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.919046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.919051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.919056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.919060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:39.919065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.919069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:39.919107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:39.920533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255020128150556:6273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:39.922696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:39.922798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255020128150556:6273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:39.922808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255020128150556:6273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:39.922810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255020128150556:6273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:39.922815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:39.923421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:39.923432Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:39.923434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:39.923438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:39.923444Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 589 [2:7556255017751286778:5596]
2025-10-01T14:08:39.923458Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:39.923476Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:39.923483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.923486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.923488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.923502Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:39.923510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:39.923515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:39.923560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.923566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.923568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.923589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:39.923595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:39.923653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:39.923660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.923671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:39.923680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:39.923695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:39.923710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150424:2446], now have 1 active actors on pipe
2025-10-01T14:08:39.923717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150602:6273], now have 1 active actors on pipe
2025-10-01T14:08:39.923722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255017751286773:5596]
2025-10-01T14:08:39.923724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255017751286773:5596]
2025-10-01T14:08:39.923725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255017751286773:5596]
2025-10-01T14:08:39.923715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 589
2025-10-01T14:08:39.923735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:39.923747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:39.923749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 589
2025-10-01T14:08:39.923749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:39.923752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:39.923752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:39.923765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:39.923767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:39.923809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.923817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.923829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255017751286773:5596]
2025-10-01T14:08:39.923836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:39.923850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:39.923855Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:39.923860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:39.923863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:39.923864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:39.923870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:39.923876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:39.924009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.924124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:39.924135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:39.924152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:39.924266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 590 partition: 0 MaxSeqNo: 45 sessionId: src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0
2025-10-01T14:08:39.924585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f7529b1-9c8b9d98-9a698715-d4f9eef3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:39.927054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0] Write session: try to update token
2025-10-01T14:08:39.927070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:39.942734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 590 sessionId: src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:39.943037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:39.943057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:39.943059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:39.943062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:39.943069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255017751286773:5596]
2025-10-01T14:08:39.943074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255017751286773:5596]
2025-10-01T14:08:39.943077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255017751286773:5596]
2025-10-01T14:08:39.943117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:39.943126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:39.943128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:39.943131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:39.943132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:39.943134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:39.943276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:39.945226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:39.998518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255020128150620:5713]
2025-10-01T14:08:39.998867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 589, pipe: [1:7556255020128150620:5713]
2025-10-01T14:08:40.087867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:40.088170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.088187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.088229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255020128150620:5713], now have 1 active actors on pipe
2025-10-01T14:08:40.088463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:40.088535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:40.088740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:40.088819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255020128150620:5713]
2025-10-01T14:08:40.088862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 590 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0
2025-10-01T14:08:40.089035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 590 sessionId: src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0 is DEAD
2025-10-01T14:08:40.089165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:40.089176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0] Write session will restart in 0.008737s
2025-10-01T14:08:40.089202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0] Write session: Do CDS request
2025-10-01T14:08:40.089209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:40.098912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.099090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:40.099108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 591
2025-10-01T14:08:40.099261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.099288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:40.099293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:40.099296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:40.099678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 591 sessionId:  describe result for acl check
2025-10-01T14:08:40.099712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:40.099716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:40.099717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:40.099721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255024423118039:6282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:40.100140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255024423118039:6282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:40.101072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:40.102003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255024423118039:6282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:40.103337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:40.103544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:40.103556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:40.103567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:40.103618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:40.103659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255022046254248:5600]
2025-10-01T14:08:40.104252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:40.104521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:40.104576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:40.104678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255024423118039:6282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:40.104693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255024423118039:6282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:40.104696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255024423118039:6282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:40.104705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:40.104895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:40.104952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.104957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.104958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.104959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.104960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.104961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.104962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.104964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.104965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.104966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.104967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.104968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.104969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.104970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.104976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.104985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.104999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.105006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.105009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.105012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.105020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.105023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.105027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.105035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.105038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.105045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.105049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.105056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.105062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.105073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.105082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.105090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.105098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.105103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.105111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.105116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.105121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.105125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.105130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.105135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.105144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.105149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.105156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.105161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.105165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.105174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.105178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.105182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.105186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.105190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.105194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.105198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.105202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.105212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.105219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.105223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.105263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:40.108911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:40.109758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:40.109769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:40.109771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:40.109774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:40.109782Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 590 [2:7556255022046254248:5600]
2025-10-01T14:08:40.109798Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:40.109813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:40.109814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.109817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.109818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.109830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:40.109834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:40.109840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:40.109887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.109899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.109901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.109905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:40.109907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:40.109969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:40.109975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.109987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.109996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.110015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:40.110037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423117918:2446], now have 1 active actors on pipe
2025-10-01T14:08:40.110042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118084:6282], now have 1 active actors on pipe
2025-10-01T14:08:40.110050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255022046254243:5600]
2025-10-01T14:08:40.110055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255022046254243:5600]
2025-10-01T14:08:40.110058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255022046254243:5600]
2025-10-01T14:08:40.110069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:40.110085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:40.110091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:40.110095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:40.110097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:40.110101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:40.110104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:40.110134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255022046254243:5600]
2025-10-01T14:08:40.110144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:40.110173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:40.110210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 590
2025-10-01T14:08:40.110570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 590
2025-10-01T14:08:40.110642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.110651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.110674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:40.110685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.110692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.110697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:40.110718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.110732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:40.110748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.110911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.110916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.110929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.111009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 591 partition: 0 MaxSeqNo: 45 sessionId: src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0
2025-10-01T14:08:40.111370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23ea39ee-4d59c2d1-85b63bdc-3cbb0601_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:40.113869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0] Write session: try to update token
2025-10-01T14:08:40.113883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:40.120626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:40.120646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:40.120658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255022046254243:5600]
2025-10-01T14:08:40.120706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:40.120710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:40.120970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:40.121170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:40.121331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:40.121515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:40.121851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:40.121895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:40.128451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 591 sessionId: src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:40.131037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:40.131213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.131229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.131264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:40.131354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:40.139705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:40.139722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:40.139725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:40.139726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:40.139737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255022046254243:5600]
2025-10-01T14:08:40.139741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255022046254243:5600]
2025-10-01T14:08:40.139745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255022046254243:5600]
2025-10-01T14:08:40.139785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:40.139789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:40.139795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:40.139795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.139798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:40.139802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:40.139965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:40.188945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255024423118093:5713]
2025-10-01T14:08:40.189172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 590, pipe: [1:7556255024423118093:5713]
2025-10-01T14:08:40.282693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:40.289448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.289469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.289600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.289650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.289701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.289759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.290108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.290119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.290174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.290225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.290280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.290333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.290388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.290396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.290457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.290536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.290620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.290694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.290734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.290739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.290840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.290912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.290978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.291040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.291085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.291092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.291150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.291210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.291269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.291326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.291363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.291370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.291434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.291490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.291549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.291608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.291713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.291717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.291779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.291827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.291911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.291995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.292039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.292044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.292101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.292172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.292252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.292327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.292380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.292384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.292448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.292501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.292568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.292630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.292689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.292695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.292751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.292820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.292884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.292951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.293000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.293007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.293072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118093:5713], now have 1 active actors on pipe
2025-10-01T14:08:40.293329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:40.293435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:40.293442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:40.293469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 591 reason: error at write: Disconnected sessionId: src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0
2025-10-01T14:08:40.293640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 591 sessionId: src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0 is DEAD
2025-10-01T14:08:40.293653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255024423118093:5713]
2025-10-01T14:08:40.293652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:40.293775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:40.293786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0] Write session will restart in 0.006071s
2025-10-01T14:08:40.293810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0] Write session: Do CDS request
2025-10-01T14:08:40.293816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:40.300904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.300941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:40.300957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 592
2025-10-01T14:08:40.301124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.301157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:40.301167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:40.301170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:40.301560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 592 sessionId:  describe result for acl check
2025-10-01T14:08:40.301591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:40.301597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:40.301598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:40.301602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255024423118140:6287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:40.302036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255024423118140:6287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:40.304208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255024423118140:6287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:40.305651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:40.307556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:40.307715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255024423118140:6287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:40.307729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255024423118140:6287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:40.307732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255024423118140:6287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:40.307739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:40.307883Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:40.307897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:40.307912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:40.307980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:40.308017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255022046254457:5613]
2025-10-01T14:08:40.308560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:40.308824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:40.308872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:40.309156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:40.309228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.309235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.309236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.309237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.309239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.309240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.309241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.309242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.309243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.309244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.309245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.309246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.309247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.309248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.309253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.309263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.309267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.309271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.309274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.309278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.309282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.309286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.309290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.309293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.309297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.309300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.309303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.309307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.309314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.309322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.309327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.309332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.309337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.309342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.309346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.309351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.309355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.309366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.309371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.309380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.309384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.309393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.309398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.309403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.309412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.309416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.309425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.309429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.309434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.309442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.309446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.309451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.309460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.309464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.309468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.309473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.309508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:40.313197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:40.313939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:40.313956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:40.313959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:40.313962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:40.313968Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 591 [2:7556255022046254457:5613]
2025-10-01T14:08:40.313981Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:40.314000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:40.314007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.314010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.314013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.314033Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:40.314041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:40.314047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:40.314100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.314107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.314109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.314114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:40.314116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:40.314177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:40.314183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.314193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.314206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.314222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:40.314243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118270:6287], now have 1 active actors on pipe
2025-10-01T14:08:40.314250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118106:2446], now have 1 active actors on pipe
2025-10-01T14:08:40.314257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255022046254452:5613]
2025-10-01T14:08:40.314259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255022046254452:5613]
2025-10-01T14:08:40.314260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255022046254452:5613]
2025-10-01T14:08:40.314271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:40.314287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:40.314288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:40.314292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:40.314294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:40.314303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:40.314306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:40.314335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255022046254452:5613]
2025-10-01T14:08:40.314342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:40.314344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:40.314315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 591
2025-10-01T14:08:40.314325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 591
2025-10-01T14:08:40.314389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.314396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.314429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:40.314439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.314443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.314449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:40.314458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.314471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:40.314495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.314627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.314636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.314653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.314734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 592 partition: 0 MaxSeqNo: 45 sessionId: src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0
2025-10-01T14:08:40.315921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaa01b12-b7c0b666-2f236161-20fcb35d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:40.318285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0] Write session: try to update token
2025-10-01T14:08:40.318307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:40.337668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.337696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.337732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:40.334670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 592 sessionId: src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:40.337235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:40.337833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:40.343942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:40.343960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:40.343963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:40.343964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:40.343973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255022046254452:5613]
2025-10-01T14:08:40.343978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255022046254452:5613]
2025-10-01T14:08:40.343981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255022046254452:5613]
2025-10-01T14:08:40.344029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:40.344037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.344039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:40.344200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:40.346422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:40.346439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:40.346443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:40.393778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255024423118293:5713]
2025-10-01T14:08:40.394119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 591, pipe: [1:7556255024423118293:5713]
2025-10-01T14:08:40.509840Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:40.517546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.517571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.517722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.517776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.517833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.517897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.517999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.518007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.518075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.518143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.518231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.518298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.518345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.518352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.518436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.518491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.518553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.518619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.518659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.518668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.518731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.518794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.520902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:40.520918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:40.520928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255024423118293:5713]
2025-10-01T14:08:40.520946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 592 reason: error at write: Disconnected sessionId: src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0
2025-10-01T14:08:40.520947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:40.521127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 592 sessionId: src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0 is DEAD
2025-10-01T14:08:40.521295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:40.521308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0] Write session will restart in 0.007596s
2025-10-01T14:08:40.521334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0] Write session: Do CDS request
2025-10-01T14:08:40.521340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:40.518851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.518914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.518950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.518952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.519007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.519058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.519108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.519165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.519214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.519219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.519274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.519320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.519371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.519426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.519464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.519467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.519524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.519572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.519628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.519679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.519721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.519723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.519778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.519828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.519883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.519937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.519975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.519976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.520060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.520110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.520160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.520216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.520254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.520256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.520316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.520365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.520426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.520498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.520550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.520553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.520621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118293:5713], now have 1 active actors on pipe
2025-10-01T14:08:40.521956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:40.529828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.530133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:40.530151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 593
2025-10-01T14:08:40.530729Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.530769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:40.530786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:40.530794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:40.531163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 593 sessionId:  describe result for acl check
2025-10-01T14:08:40.531201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:40.531214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:40.531217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:40.531222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255024423118366:6292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:40.531689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255024423118366:6292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:40.533874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255024423118366:6292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:40.536400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:40.536585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255024423118366:6292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:40.536597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255024423118366:6292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:40.536600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255024423118366:6292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:40.536608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:40.538623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:40.538840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:40.538851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:40.538861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:40.538911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:40.538951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255022046254629:5616]
2025-10-01T14:08:40.539502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:40.539770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:40.539805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:40.540061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:40.540105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.540109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.540110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.540111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.540112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.540113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.540114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.540115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.540116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.540117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.540118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.540118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.540119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.540120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.540124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.540134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.540137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.540140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.540143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.540146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.540149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.540152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.540155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.540158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.540161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.540164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.540167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.540171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.540177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.540184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.540189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.540193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.540197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.540200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.540204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.540209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.540213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.540217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.540220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.540229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.540232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.540236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.540240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.540244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.540248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.540256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.540260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.540263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.540267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.540275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.540279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.540283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.540287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.540294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.540298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.540303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.540337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:40.547613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:40.548535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:40.548562Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:40.548566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:40.548573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:40.548583Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 592 [2:7556255022046254629:5616]
2025-10-01T14:08:40.548618Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:40.548661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:40.548679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.548690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.548700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.548725Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:40.548736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:40.548751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:40.548866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.548881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.548886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.548890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:40.548896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:40.548983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:40.548988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.549003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.549013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.549039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:40.549064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118296:2446], now have 1 active actors on pipe
2025-10-01T14:08:40.549068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118461:6292], now have 1 active actors on pipe
2025-10-01T14:08:40.549079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255022046254623:5616]
2025-10-01T14:08:40.549085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255022046254623:5616]
2025-10-01T14:08:40.549090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255022046254623:5616]
2025-10-01T14:08:40.549118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:40.549145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:40.549160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:40.549163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:40.549167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:40.549176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:40.549185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:40.549170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 592
2025-10-01T14:08:40.549206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 592
2025-10-01T14:08:40.549238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255022046254623:5616]
2025-10-01T14:08:40.549248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:40.549282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:40.549341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.549352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.549387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:40.549405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.549411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.549413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:40.549426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.549442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:40.549465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.549626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.549637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.549652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.549742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 593 partition: 0 MaxSeqNo: 45 sessionId: src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0
2025-10-01T14:08:40.550200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff523ff8-e9890ca2-f3a77cdb-ef292a86_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:40.553705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0] Write session: try to update token
2025-10-01T14:08:40.553731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:40.575395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:40.575416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:40.575418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:40.575422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:40.575432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255022046254623:5616]
2025-10-01T14:08:40.575437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255022046254623:5616]
2025-10-01T14:08:40.575441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255022046254623:5616]
2025-10-01T14:08:40.575490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:40.575499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.575504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:40.575507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:40.575514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:40.575519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:40.575647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:40.581621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 593 sessionId: src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:40.584328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:40.620605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255024423118473:5713]
2025-10-01T14:08:40.620908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 592, pipe: [1:7556255024423118473:5713]
2025-10-01T14:08:40.725944Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:40.726684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.726696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.726731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118473:5713], now have 1 active actors on pipe
2025-10-01T14:08:40.726943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255024423118473:5713]
2025-10-01T14:08:40.726970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:40.726982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:40.727019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:40.727026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:40.727083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 593 reason: error at write: Disconnected sessionId: src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0
2025-10-01T14:08:40.727328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 593 sessionId: src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0 is DEAD
2025-10-01T14:08:40.730564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:40.730578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0] Write session will restart in 0.009147s
2025-10-01T14:08:40.730617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0] Write session: Do CDS request
2025-10-01T14:08:40.730622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:40.741313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.741451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:40.741468Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 594
2025-10-01T14:08:40.741617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.741649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:40.741655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:40.741659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:40.742081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 594 sessionId:  describe result for acl check
2025-10-01T14:08:40.742117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:40.742132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:40.742134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:40.742140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255024423118608:6297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:40.742444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:40.742719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255024423118608:6297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:40.744633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:40.744910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:40.744920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:40.744931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:40.744989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:40.745050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255024423118608:6297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:40.745057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255022046254802:5619]
2025-10-01T14:08:40.745692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:40.746033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:40.746096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:40.746460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:40.746550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.746551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.746553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.746554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.746555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.746557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.746558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.746560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.746561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.746562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.746564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.746565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.746567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.746568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.746574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.746584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.746588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.746602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.746605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.746609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.746613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.746617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.746621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.746624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.746628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.746631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.746635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.746639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.746646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.746654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.746662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.746667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.746671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.746675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.746680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.746686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.746690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.746694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.746700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.746706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.746710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.746716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.746720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.746725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.746729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.746734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.746738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.746744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.746748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.746753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.746757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.746761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.746766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.746771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.746775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.746779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.746830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:40.747779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255024423118608:6297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:40.747793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255024423118608:6297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:40.747795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255024423118608:6297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:40.747803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:40.750948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:40.751666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:40.751683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:40.751686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:40.751690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:40.751697Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 593 [2:7556255022046254802:5619]
2025-10-01T14:08:40.751713Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:40.751731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:40.751735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.751739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.751742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.751757Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:40.751763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:40.751777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:40.751945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.751954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.751956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.751959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:40.751962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:40.752039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:40.752046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.752058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.752073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.752094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:40.752118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118477:2446], now have 1 active actors on pipe
2025-10-01T14:08:40.752126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118647:6297], now have 1 active actors on pipe
2025-10-01T14:08:40.752135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255022046254797:5619]
2025-10-01T14:08:40.752138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255022046254797:5619]
2025-10-01T14:08:40.752140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255022046254797:5619]
2025-10-01T14:08:40.752157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:40.752176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:40.752175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:40.752179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:40.752181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:40.752190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:40.752194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:40.752156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 593
2025-10-01T14:08:40.752176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 593
2025-10-01T14:08:40.752236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255022046254797:5619]
2025-10-01T14:08:40.752249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:40.752258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:40.752266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.752270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.752318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:40.752330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.752335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.752337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:40.752347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.752357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:40.752374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.752508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.752516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.752531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.752588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 594 partition: 0 MaxSeqNo: 45 sessionId: src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0
2025-10-01T14:08:40.752934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d18c5cb2-1f83ebf2-c30b0289-ecfe054f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:40.755462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0] Write session: try to update token
2025-10-01T14:08:40.755479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:40.769950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 594 sessionId: src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:40.772435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:40.772669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.772694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.772733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:40.772830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:40.780626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:40.780642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:40.780645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:40.780647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:40.780657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255022046254797:5619]
2025-10-01T14:08:40.780662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255022046254797:5619]
2025-10-01T14:08:40.780666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255022046254797:5619]
2025-10-01T14:08:40.780721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:40.780726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:40.780731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.780733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:40.780734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:40.780736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:40.780876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:40.826898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255024423118655:5713]
2025-10-01T14:08:40.827151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 593, pipe: [1:7556255024423118655:5713]
2025-10-01T14:08:40.940827Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:40.949345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.949376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.949555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.949619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.949679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.949745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.949811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.949822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.949921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.949981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.950042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.950109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.950156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.950165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.950226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.950316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.950396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.950454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.950504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.950512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.950572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.950663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.950725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.950779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.950820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.950833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.950899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.950961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.951018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.951073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.951115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.951123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.951182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.951236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.951307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.951370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.951414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.951421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.951485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.951543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.951611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.951673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.951720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.951727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.951791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.951848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.951904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.951968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.952078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.952086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.952151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.952212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.952272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.952334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.952379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.952386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.952449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:40.952515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:40.952579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:40.952641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:40.952709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:40.952717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:40.952793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118655:5713], now have 1 active actors on pipe
2025-10-01T14:08:40.953008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255024423118655:5713]
2025-10-01T14:08:40.953040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:40.953081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:40.953089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:40.953123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 594 reason: error at write: Disconnected sessionId: src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0
2025-10-01T14:08:40.953328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 594 sessionId: src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0 is DEAD
2025-10-01T14:08:40.953509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:40.953520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0] Write session will restart in 0.008981s
2025-10-01T14:08:40.953545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0] Write session: Do CDS request
2025-10-01T14:08:40.953551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:40.954237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:40.963895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.964370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:40.964386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 595
2025-10-01T14:08:40.964491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:40.964519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:40.964528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:40.964532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:40.965142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 595 sessionId:  describe result for acl check
2025-10-01T14:08:40.965175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:40.965176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:40.965178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:40.965183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255024423118791:6307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:40.965718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255024423118791:6307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:40.967382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255024423118791:6307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:40.967630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:40.968340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:40.968532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:40.968542Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:40.968554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:40.968610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:40.968656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255022046254973:5621]
2025-10-01T14:08:40.969269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:40.970287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:40.970348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:40.970636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255024423118791:6307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:40.970649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255024423118791:6307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:40.970653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255024423118791:6307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:40.970660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:40.970709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:40.970777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.970786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.970787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.970788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.970789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.970790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.970792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.970793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.970794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.970795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.970797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.970798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.970799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.970800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.970807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.970817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.970822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.970825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.970829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.970834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.970837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.970841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.970845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.970850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.970854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.970858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.970874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.970878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.970885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.970898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:40.970910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.970917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:40.970925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.970931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:40.970939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.970945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:40.970954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.970960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:40.970969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.970974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:40.970983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.970989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:40.970998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.971003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:40.971012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.971018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:40.971029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.971034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.971039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.971044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.971058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.971063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.971068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.971075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:40.971080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.971085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:40.971125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:40.975589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:40.976276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:40.976292Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:40.976295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:40.976299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:40.976306Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 594 [2:7556255022046254973:5621]
2025-10-01T14:08:40.976322Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:40.976339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:40.976349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.976353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.976355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.976371Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:40.976376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:40.976383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:40.976445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.976453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.976455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.976458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:40.976461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:40.976673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 594
2025-10-01T14:08:40.976722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:40.976732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:40.976744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:40.976726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 594
2025-10-01T14:08:40.976760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:40.976795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:40.976821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118665:2446], now have 1 active actors on pipe
2025-10-01T14:08:40.976829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255024423118839:6307], now have 1 active actors on pipe
2025-10-01T14:08:40.976845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.976854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.976877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255022046254968:5621]
2025-10-01T14:08:40.976884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255022046254968:5621]
2025-10-01T14:08:40.976886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255022046254968:5621]
2025-10-01T14:08:40.976903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:40.976921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:40.976927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:40.976929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:40.976931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:40.976939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:40.976943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:40.976958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|225457de-8c17c937-ab329295-89c77271_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:40.976970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:40.976975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:40.976982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:40.976990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:40.977004Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:40.977047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255022046254968:5621]
2025-10-01T14:08:40.977059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:40.977065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:40.977070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.977245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:40.977253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:40.977270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:40.977365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 595 partition: 0 MaxSeqNo: 45 sessionId: src_id|225457de-8c17c937-ab329295-89c77271_0
2025-10-01T14:08:40.977737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd8eb6b-10be0c21-19c72331-e989bc8a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|225457de-8c17c937-ab329295-89c77271_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:40.980353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|225457de-8c17c937-ab329295-89c77271_0] Write session: try to update token
2025-10-01T14:08:40.980374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|225457de-8c17c937-ab329295-89c77271_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:40.990595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:40.990613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:40.990622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255022046254968:5621]
2025-10-01T14:08:40.990669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:40.990669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:40.990843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:40.990987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:40.991134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:40.991277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:40.991493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:40.991541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:40.997310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 595 sessionId: src_id|225457de-8c17c937-ab329295-89c77271_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:41.000139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:41.000318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.000338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.000374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:41.000482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:41.017868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:41.017888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:41.017891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:41.017893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:41.017905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255022046254968:5621]
2025-10-01T14:08:41.017909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255022046254968:5621]
2025-10-01T14:08:41.017913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255022046254968:5621]
2025-10-01T14:08:41.017962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:41.017965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:41.017971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:41.017975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:41.017975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.017978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:41.018118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:41.056127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255028718086154:5713]
2025-10-01T14:08:41.056338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 594, pipe: [1:7556255028718086154:5713]
2025-10-01T14:08:41.173931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:41.181873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.181908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.182094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.182154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.182217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.182280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.182331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.182336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.182523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.182601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.182702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.182771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.182824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.182833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.182903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.183000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.183069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.183137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.183185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.183195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.183263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.183326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.183386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.183455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.183502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.183510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.183577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.183644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.183747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.186129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:41.186148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255028718086154:5713]
2025-10-01T14:08:41.186171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:41.186173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:41.186201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 595 reason: error at write: Disconnected sessionId: src_id|225457de-8c17c937-ab329295-89c77271_0
2025-10-01T14:08:41.183817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.183867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.183871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.183945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.184008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.184074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.184139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.184188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.184191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.184263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.184327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.184405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.184475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.184520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.184523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.184596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.184660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.184725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.184811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.184857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.184860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.184933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.184995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.185058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.185123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.186477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 595 sessionId: src_id|225457de-8c17c937-ab329295-89c77271_0 is DEAD
2025-10-01T14:08:41.185167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.185169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.185235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.185316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.185379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.185443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.185501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.185504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.185571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086154:5713], now have 1 active actors on pipe
2025-10-01T14:08:41.186878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:41.190497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225457de-8c17c937-ab329295-89c77271_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:41.190511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225457de-8c17c937-ab329295-89c77271_0] Write session will restart in 0.005615s
2025-10-01T14:08:41.190539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225457de-8c17c937-ab329295-89c77271_0] Write session: Do CDS request
2025-10-01T14:08:41.190545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225457de-8c17c937-ab329295-89c77271_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:41.197164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|225457de-8c17c937-ab329295-89c77271_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:41.197277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:41.197293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 596
2025-10-01T14:08:41.197490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:41.197535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:41.197545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:41.197548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:41.197989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 596 sessionId:  describe result for acl check
2025-10-01T14:08:41.198025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:41.198026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:41.198027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:41.198031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255028718086165:6312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:41.198542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255028718086165:6312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:41.201136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255028718086165:6312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:41.206743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255028718086165:6312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:41.206766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255028718086165:6312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:41.206769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255028718086165:6312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:41.206778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:41.208503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:41.211353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:41.211614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:41.211626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:41.211638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:41.211692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:41.211781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255026341222449:5625]
2025-10-01T14:08:41.212386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:41.212992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:41.213056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:41.213393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:41.213456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.213463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.213464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.213465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.213466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.213468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.213469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.213470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.213471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.213472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.213474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.213475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.213476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.213477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.213484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.213494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.213498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.213502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.213505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.213509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.213513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.213516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.213518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.213522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.213526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.213529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.213533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.213536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.213545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.213553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.213559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.213567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.213571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.213576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.213584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.213589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.213594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.213599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.213604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.213609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.213618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.213636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.213647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.213651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.213660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.213664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.213669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.213678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.213683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.213688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.213696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.213701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.213710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.213714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.213719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.213723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.213760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:41.218753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:41.219781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:41.219800Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:41.219803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:41.219807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:41.219815Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 595 [2:7556255026341222449:5625]
2025-10-01T14:08:41.219833Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:41.219861Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:41.219864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:41.219868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:41.219871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:41.219893Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:41.219903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:41.219910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:41.219974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.219981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.219985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.219988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:41.219990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:41.220063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:41.220069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.220082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.220096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.220112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:41.220136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255026341222444:5625]
2025-10-01T14:08:41.220139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255026341222444:5625]
2025-10-01T14:08:41.220141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255026341222444:5625]
2025-10-01T14:08:41.220153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:41.220169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:41.220172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086322:6312], now have 1 active actors on pipe
2025-10-01T14:08:41.220176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086157:2446], now have 1 active actors on pipe
2025-10-01T14:08:41.220179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:41.220181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:41.220183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:41.220197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:41.220205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:41.220243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255026341222444:5625]
2025-10-01T14:08:41.220250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:41.220226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 595
2025-10-01T14:08:41.220264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:41.220404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 595
2025-10-01T14:08:41.220451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.220460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.220483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a36596b0-e077c13-78faf3ef-c977c403_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:41.220493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:41.220498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:41.220504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:41.220513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:41.220526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:41.220544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:41.220711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.220718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.220732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:41.220835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 596 partition: 0 MaxSeqNo: 45 sessionId: src_id|a36596b0-e077c13-78faf3ef-c977c403_0
2025-10-01T14:08:41.221226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|225457de-8c17c937-ab329295-89c77271_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a36596b0-e077c13-78faf3ef-c977c403_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:41.223948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a36596b0-e077c13-78faf3ef-c977c403_0] Write session: try to update token
2025-10-01T14:08:41.223968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a36596b0-e077c13-78faf3ef-c977c403_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:41.241862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:41.241889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:41.241899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255026341222444:5625]
2025-10-01T14:08:41.241951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:41.242150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:41.242272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:41.242319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:41.242484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:41.242473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 596 sessionId: src_id|a36596b0-e077c13-78faf3ef-c977c403_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:41.242636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:41.243137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:41.243192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:41.245134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:41.245359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.245378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.245415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:41.245513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:41.268797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:41.268816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:41.268819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:41.268821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:41.268834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255026341222444:5625]
2025-10-01T14:08:41.268839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255026341222444:5625]
2025-10-01T14:08:41.268842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255026341222444:5625]
2025-10-01T14:08:41.268894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:41.268906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.268908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:41.269044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:41.269919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:41.269932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:41.269934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:41.286171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255028718086344:5713]
2025-10-01T14:08:41.286933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 595, pipe: [1:7556255028718086344:5713]
2025-10-01T14:08:41.425495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:41.433706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.433747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.433930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.433999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.434070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.434135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.434627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.434641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.434714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.434773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.434841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.434906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.434950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.434957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.435019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.435077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.435144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.435209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.435253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.435259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.435322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.435385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.435451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.435514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.435559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.435568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.435631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.435693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.435750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.435807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.435871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.435878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.435944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.436003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.436065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.436132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.436181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.436187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.436254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.436316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.436408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.436487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.436533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.436540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.436606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.436668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.436730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.436809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.436871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.436880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.436946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.437008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.437070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.437137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.437185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.437195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.437256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:41.437312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:41.437373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:41.437434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:41.437478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:41.437489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:41.437552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086344:5713], now have 1 active actors on pipe
2025-10-01T14:08:41.437782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:41.437796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:41.437824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 596 reason: error at write: Disconnected sessionId: src_id|a36596b0-e077c13-78faf3ef-c977c403_0
2025-10-01T14:08:41.437825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255028718086344:5713]
2025-10-01T14:08:41.437850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:41.438075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 596 sessionId: src_id|a36596b0-e077c13-78faf3ef-c977c403_0 is DEAD
2025-10-01T14:08:41.438159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36596b0-e077c13-78faf3ef-c977c403_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:41.438169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36596b0-e077c13-78faf3ef-c977c403_0] Write session will restart in 0.008997s
2025-10-01T14:08:41.438194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36596b0-e077c13-78faf3ef-c977c403_0] Write session: Do CDS request
2025-10-01T14:08:41.438199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36596b0-e077c13-78faf3ef-c977c403_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:41.438186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:41.447998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a36596b0-e077c13-78faf3ef-c977c403_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:41.448885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:41.448901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 597
2025-10-01T14:08:41.449097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:41.449136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:41.449144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:41.449147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:41.449532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 597 sessionId:  describe result for acl check
2025-10-01T14:08:41.449569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:41.449577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:41.449579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:41.449585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255028718086465:6318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:41.450114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255028718086465:6318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:41.452301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:41.452586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255028718086465:6318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:41.455020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:41.455507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255028718086465:6318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:41.455528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255028718086465:6318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:41.455531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255028718086465:6318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:41.455544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:41.455980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:41.456003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:41.456025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:41.456138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:41.456193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255026341222667:5639]
2025-10-01T14:08:41.456900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:41.457698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:41.457762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:41.458156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:41.458235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.458242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.458243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.458245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.458246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.458248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.458250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.458251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.458253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.458254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.458255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.458257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.458258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.458259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.458267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.458279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.458284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.458288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.458292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.458296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.458300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.458304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.458309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.458314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.458318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.458322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.458325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.458330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.458339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.458348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.458355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.458364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.458389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.458399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.458405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.458411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.458421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.458427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.458437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.458447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.458453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.458463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.458473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.458479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.458488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.458494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.458504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.458509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.458520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.458526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.458535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.458543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.458552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.458558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.458567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.458573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.458615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:41.462950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:41.463780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:41.463799Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:41.463802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:41.463806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:41.463824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 596 [2:7556255026341222667:5639]
2025-10-01T14:08:41.463845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:41.463871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:41.463880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:41.463884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:41.463887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:41.463910Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:41.463922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:41.463930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:41.464009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.464017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.464020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.464023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:41.464027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:41.464109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:41.464122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.464139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.464152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.464172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:41.464200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086532:6318], now have 1 active actors on pipe
2025-10-01T14:08:41.464209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086363:2446], now have 1 active actors on pipe
2025-10-01T14:08:41.464219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255026341222661:5639]
2025-10-01T14:08:41.464227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255026341222661:5639]
2025-10-01T14:08:41.464230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255026341222661:5639]
2025-10-01T14:08:41.464249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:41.464265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:41.464270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:41.464273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:41.464276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:41.464283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:41.464287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:41.464332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255026341222661:5639]
2025-10-01T14:08:41.464340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:41.464347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:41.464362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.464368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.464432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:41.464446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:41.464456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:41.464464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:41.464475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:41.464485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:41.464516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:41.464727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.464738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.464755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:41.464269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 596
2025-10-01T14:08:41.464280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 596
2025-10-01T14:08:41.464867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 597 partition: 0 MaxSeqNo: 45 sessionId: src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0
2025-10-01T14:08:41.465301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a36596b0-e077c13-78faf3ef-c977c403_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:41.468552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0] Write session: try to update token
2025-10-01T14:08:41.468575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:41.487289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:41.487310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:41.487314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:41.487316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:41.487328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255026341222661:5639]
2025-10-01T14:08:41.487334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255026341222661:5639]
2025-10-01T14:08:41.487338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255026341222661:5639]
2025-10-01T14:08:41.487388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:41.487399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:41.487400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:41.487407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.487409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:41.487410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:41.488458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:41.494270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 597 sessionId: src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:41.496972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:41.538106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255028718086543:5713]
2025-10-01T14:08:41.538417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 596, pipe: [1:7556255028718086543:5713]
2025-10-01T14:08:41.640350Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:41.641113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.641131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.641154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086543:5713], now have 1 active actors on pipe
2025-10-01T14:08:41.641318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:41.641381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:41.641396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:41.641418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255028718086543:5713]
2025-10-01T14:08:41.641441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:41.641452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 597 reason: error at write: Disconnected sessionId: src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0
2025-10-01T14:08:41.641625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 597 sessionId: src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0 is DEAD
2025-10-01T14:08:41.641782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:41.641792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0] Write session will restart in 0.008558s
2025-10-01T14:08:41.641819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0] Write session: Do CDS request
2025-10-01T14:08:41.641825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:41.651926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:41.652007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:41.652024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 598
2025-10-01T14:08:41.652177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:41.652232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:41.652242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:41.652245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:41.652765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 598 sessionId:  describe result for acl check
2025-10-01T14:08:41.652844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:41.652856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:41.652860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:41.652867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255028718086680:6323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:41.653417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255028718086680:6323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:41.654276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:41.655611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255028718086680:6323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:41.656744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:41.656984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:41.656995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:41.657007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:41.657058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:41.657098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255026341222840:5641]
2025-10-01T14:08:41.657706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:41.657998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:41.658047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:41.658178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255028718086680:6323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:41.658196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255028718086680:6323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:41.658199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255028718086680:6323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:41.658207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:41.658350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:41.658426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.658433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.658434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.658436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.658437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.658438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.658439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.658441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.658442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.658444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.658445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.658446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.658447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.658448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.658455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.658465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.658469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.658474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.658477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.658481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.658485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.658488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.658492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.658496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.658499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.658503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.658507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.658510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.658518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.658525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.658532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.658537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.658547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.658555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.658564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.658569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.658579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.658584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.658589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.658594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.658601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.658610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.658614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.658623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.658629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.658634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.658639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.658644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.658649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.658654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.658658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.658663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.658668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.658674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.658678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.658683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.658725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:41.662546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:41.663136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:41.663154Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:41.663156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:41.663160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:41.663167Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 597 [2:7556255026341222840:5641]
2025-10-01T14:08:41.663181Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:41.663196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:41.663202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:41.663204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:41.663206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:41.663220Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:41.663227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:41.663232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:41.663279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.663285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.663286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.663289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:41.663290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:41.663346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:41.663355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.663367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.663380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.663393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:41.663411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086548:2446], now have 1 active actors on pipe
2025-10-01T14:08:41.663416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086720:6323], now have 1 active actors on pipe
2025-10-01T14:08:41.663423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255026341222835:5641]
2025-10-01T14:08:41.663424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255026341222835:5641]
2025-10-01T14:08:41.663426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255026341222835:5641]
2025-10-01T14:08:41.663434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:41.663444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:41.663469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:41.663475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:41.663478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:41.663480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:41.663482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:41.663460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 597
2025-10-01T14:08:41.663470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 597
2025-10-01T14:08:41.663519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.663527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.663543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255026341222835:5641]
2025-10-01T14:08:41.663551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:41.663557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:41.663577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa962229-9f4a5762-31089d33-d87645f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:41.663588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:41.663592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:41.663595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:41.663604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:41.663611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:41.663632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:41.663775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.663783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.663796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:41.663872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 598 partition: 0 MaxSeqNo: 45 sessionId: src_id|fa962229-9f4a5762-31089d33-d87645f_0
2025-10-01T14:08:41.664262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45a6cbc7-1fd081ae-f5bd9217-10271eb1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fa962229-9f4a5762-31089d33-d87645f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:41.666752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa962229-9f4a5762-31089d33-d87645f_0] Write session: try to update token
2025-10-01T14:08:41.666774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa962229-9f4a5762-31089d33-d87645f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:41.681611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 598 sessionId: src_id|fa962229-9f4a5762-31089d33-d87645f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:41.684311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:41.685899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:41.685922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:41.685925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:41.685927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:41.685938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255026341222835:5641]
2025-10-01T14:08:41.685942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255026341222835:5641]
2025-10-01T14:08:41.685947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255026341222835:5641]
2025-10-01T14:08:41.686000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:41.686005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:41.686007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:41.686012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:41.686014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.686017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:41.686207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:41.741372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255028718086729:5713]
2025-10-01T14:08:41.741699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 597, pipe: [1:7556255028718086729:5713]
2025-10-01T14:08:41.848663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:41.849109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.849132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.849180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086729:5713], now have 1 active actors on pipe
2025-10-01T14:08:41.849401Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:41.851476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa962229-9f4a5762-31089d33-d87645f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:41.851488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa962229-9f4a5762-31089d33-d87645f_0] Write session will restart in 0.008917s
2025-10-01T14:08:41.850945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255028718086729:5713]
2025-10-01T14:08:41.850977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:41.851029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:41.851104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 598 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa962229-9f4a5762-31089d33-d87645f_0
2025-10-01T14:08:41.851327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 598 sessionId: src_id|fa962229-9f4a5762-31089d33-d87645f_0 is DEAD
2025-10-01T14:08:41.851523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa962229-9f4a5762-31089d33-d87645f_0] Write session: Do CDS request
2025-10-01T14:08:41.851571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa962229-9f4a5762-31089d33-d87645f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:41.861873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa962229-9f4a5762-31089d33-d87645f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:41.863037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:41.863055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 599
2025-10-01T14:08:41.866505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:41.866564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:41.866574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:41.866579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:41.867204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 599 sessionId:  describe result for acl check
2025-10-01T14:08:41.867253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:41.867259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:41.867261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:41.867267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255028718086809:6327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:41.867853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255028718086809:6327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:41.872606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255028718086809:6327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:41.876869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:41.876980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255028718086809:6327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:41.877002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255028718086809:6327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:41.877005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255028718086809:6327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:41.877014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:41.880515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:41.880845Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:41.880850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:41.880864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:41.880933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:41.880973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255026341223018:5644]
2025-10-01T14:08:41.881626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:41.881944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:41.881998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:41.882317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:41.882384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.882385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.882387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.882388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.882389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.882390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.882391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.882393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.882394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.882395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.882397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.882398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.882399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.882401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.882407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.882417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.882421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.882425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.882429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.882433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.882437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.882441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.882445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.882449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.882453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.882457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.882460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.882464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.882471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.882480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:41.882486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.882491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:41.882496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.882501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:41.882506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.882511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:41.882516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.882521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:41.882525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.882531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:41.882536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.882541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:41.882546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.882550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:41.882555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.882561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:41.882566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.882571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.882576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.882581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.882587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.882593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.882598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.882603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:41.882607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.882612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:41.882655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:41.887612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:41.888305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:41.888319Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:41.888323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:41.888327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:41.888334Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 598 [2:7556255026341223018:5644]
2025-10-01T14:08:41.888352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:41.888375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:41.888381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:41.888386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:41.888388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:41.888407Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:41.888416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:41.888428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:41.888495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.888501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.888503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.888507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:41.888510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:41.888587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:41.888594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.888606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:41.888616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:41.888630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:41.888648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086732:2446], now have 1 active actors on pipe
2025-10-01T14:08:41.888651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086901:6327], now have 1 active actors on pipe
2025-10-01T14:08:41.888659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255026341223012:5644]
2025-10-01T14:08:41.888662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255026341223012:5644]
2025-10-01T14:08:41.888664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255026341223012:5644]
2025-10-01T14:08:41.888678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:41.888689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:41.888692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:41.888695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:41.888697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:41.888712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:41.888715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:41.888755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255026341223012:5644]
2025-10-01T14:08:41.888767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:41.888772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:41.889291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 598
2025-10-01T14:08:41.889379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.889393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.889425Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:41.889332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 598
2025-10-01T14:08:41.889434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:41.889442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:41.889445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:41.889458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:41.889468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:41.889486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:41.889631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.889640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.889656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:41.889735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 599 partition: 0 MaxSeqNo: 45 sessionId: src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0
2025-10-01T14:08:41.890129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa962229-9f4a5762-31089d33-d87645f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:41.892657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0] Write session: try to update token
2025-10-01T14:08:41.892674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:41.912477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 599 sessionId: src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:41.916514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:41.917169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:41.917195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:41.917217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:41.917221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:41.917225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:41.917228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:41.917238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255026341223012:5644]
2025-10-01T14:08:41.917246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255026341223012:5644]
2025-10-01T14:08:41.917250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255026341223012:5644]
2025-10-01T14:08:41.917317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:41.917329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:41.917335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:41.917546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:41.918169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:41.918174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:41.918178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:41.952280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255028718086915:5713]
2025-10-01T14:08:41.953099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 598, pipe: [1:7556255028718086915:5713]
2025-10-01T14:08:42.070032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:42.070677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:42.070738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255028718086915:5713], now have 1 active actors on pipe
2025-10-01T14:08:42.071530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:42.072004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:42.072010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:42.072102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 599 reason: error at write: Disconnected sessionId: src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0
2025-10-01T14:08:42.072318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 599 sessionId: src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0 is DEAD
2025-10-01T14:08:42.072546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:42.072555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0] Write session will restart in 0.009438s
2025-10-01T14:08:42.072582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0] Write session: Do CDS request
2025-10-01T14:08:42.072589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:42.072582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:42.072642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255028718086915:5713]
2025-10-01T14:08:42.086994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:42.087385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:42.087401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 600
2025-10-01T14:08:42.087542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:42.087569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:42.087574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:42.087578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:42.088376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 600 sessionId:  describe result for acl check
2025-10-01T14:08:42.088407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:42.088409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:42.088411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:42.088416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255033013054282:6340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:42.088956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255033013054282:6340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:42.091947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255033013054282:6340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:42.095764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255033013054282:6340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:42.095780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255033013054282:6340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:42.095783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255033013054282:6340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:42.095793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:42.099373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:42.101862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:42.102119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:42.102130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:42.102142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:42.102192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:42.102232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255030636190500:5648]
2025-10-01T14:08:42.102848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:42.103461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:42.103507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:42.103819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:42.103867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.103869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.103870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.103871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.103872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.103872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.103873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.103874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.103875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.103877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.103878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.103879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.103880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.103881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.103886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.103895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.103898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.103902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.103905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.103908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.103912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.103915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.103918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.103922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.103925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.103928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.103931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.103934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.103942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.103948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.103955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.103960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.103964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.103979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.103983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.103987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.103992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.103996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.104000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.104005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.104009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.104013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.104019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.104023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.104028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.104032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.104036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.104041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.104045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.104049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.104052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.104057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.104061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.104065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.104068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.104073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.104106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:42.109493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:42.110189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:42.110204Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:42.110208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:42.110212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:42.110220Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 599 [2:7556255030636190500:5648]
2025-10-01T14:08:42.110240Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:42.110259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:42.110262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:42.110266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:42.110269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:42.110287Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:42.110293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:42.110300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:42.110367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.110394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.110396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.110399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:42.110402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:42.110478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:42.110481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.110493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.110505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.110522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:42.110540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255030636190494:5648]
2025-10-01T14:08:42.110542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255030636190494:5648]
2025-10-01T14:08:42.110545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255030636190494:5648]
2025-10-01T14:08:42.110560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:42.110576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:42.110592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:42.110596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:42.110635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255030636190494:5648]
2025-10-01T14:08:42.110637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:42.111221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 599
2025-10-01T14:08:42.111269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 599
2025-10-01T14:08:42.110812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:42.110817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:42.110820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:42.110825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:42.114556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054241:2446], now have 1 active actors on pipe
2025-10-01T14:08:42.114574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054403:6340], now have 1 active actors on pipe
2025-10-01T14:08:42.114615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.114622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.114669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:42.114680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:42.114686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:42.114690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:42.114703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:42.114722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:42.114746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:42.115422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.115433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.115452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:42.116026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7015032-665a147-7a2c7e37-1f5b6bce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:42.115595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 600 partition: 0 MaxSeqNo: 45 sessionId: src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0
2025-10-01T14:08:42.118674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0] Write session: try to update token
2025-10-01T14:08:42.118692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:42.139934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:42.139960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:42.139963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:42.139966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:42.139975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255030636190494:5648]
2025-10-01T14:08:42.139980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255030636190494:5648]
2025-10-01T14:08:42.139985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255030636190494:5648]
2025-10-01T14:08:42.140038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:42.140041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:42.140049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:42.140052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.140054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:42.140054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:42.140197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:42.137886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 600 sessionId: src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:42.140614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:42.172980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255033013054422:5713]
2025-10-01T14:08:42.173279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 599, pipe: [1:7556255033013054422:5713]
2025-10-01T14:08:42.316966Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:42.317348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.317362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.317402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054422:5713], now have 1 active actors on pipe
2025-10-01T14:08:42.317634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:42.318293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:42.318305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0] Write session will restart in 0.007085s
2025-10-01T14:08:42.318331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0] Write session: Do CDS request
2025-10-01T14:08:42.318338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:42.317751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:42.317790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:42.317793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:42.317842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 600 reason: error at write: Disconnected sessionId: src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0
2025-10-01T14:08:42.318035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 600 sessionId: src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0 is DEAD
2025-10-01T14:08:42.318151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255033013054422:5713]
2025-10-01T14:08:42.326926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:42.331153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:42.331169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 601
2025-10-01T14:08:42.334491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:42.334533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:42.334537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:42.334541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:42.335092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 601 sessionId:  describe result for acl check
2025-10-01T14:08:42.335131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:42.335137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:42.335138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:42.335144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255033013054521:6345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:42.335676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255033013054521:6345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:42.339304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255033013054521:6345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:42.342139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255033013054521:6345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:42.342153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255033013054521:6345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:42.342157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255033013054521:6345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:42.342174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:42.342691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:42.345388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:42.345620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:42.345631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:42.345643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:42.345710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:42.345764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255030636190720:5661]
2025-10-01T14:08:42.346340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:42.346773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:42.346825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:42.347141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:42.347216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.347217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.347218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.347218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.347219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.347220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.347221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.347222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.347223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.347224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.347225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.347226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.347227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.347228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.347234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.347243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.347246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.347250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.347253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.347256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.347259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.347262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.347265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.347269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.347272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.347274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.347278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.347281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.347288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.347295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.347302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.347306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.347310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.347313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.347320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.347324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.347328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.347332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.347335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.347339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.347343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.347346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.347350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.347354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.347358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.347362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.347365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.347370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.347374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.347378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.347381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.347385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.347389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.347393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.347397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.347401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.347440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:42.351332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:42.352150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:42.352167Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:42.352169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:42.352174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:42.352181Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 600 [2:7556255030636190720:5661]
2025-10-01T14:08:42.352198Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:42.352215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:42.352227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:42.352230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:42.352233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:42.352251Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:42.352261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:42.352267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:42.352325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.352332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.352335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.352337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:42.352340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:42.352420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:42.352430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.352442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.352451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.352471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:42.352493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054438:2446], now have 1 active actors on pipe
2025-10-01T14:08:42.352502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054607:6345], now have 1 active actors on pipe
2025-10-01T14:08:42.352510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255030636190715:5661]
2025-10-01T14:08:42.352516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255030636190715:5661]
2025-10-01T14:08:42.352519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255030636190715:5661]
2025-10-01T14:08:42.352533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:42.352543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:42.352546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:42.352548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:42.352551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:42.352564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:42.352572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:42.352604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255030636190715:5661]
2025-10-01T14:08:42.352616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:42.352625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:42.352759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 600
2025-10-01T14:08:42.352809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 600
2025-10-01T14:08:42.352957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.352973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.353002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:42.353014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:42.353019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:42.353022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:42.353032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:42.353047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:42.353067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:42.353335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.353349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.353372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:42.355815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 601 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0
2025-10-01T14:08:42.356200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7b23ffe-94735c51-d0816a43-c2e69df0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:42.358640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0] Write session: try to update token
2025-10-01T14:08:42.358660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:42.373101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 601 sessionId: src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:42.375655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:42.375668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:42.375691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:42.375694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:42.375696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:42.375704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255030636190715:5661]
2025-10-01T14:08:42.375708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255030636190715:5661]
2025-10-01T14:08:42.375712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255030636190715:5661]
2025-10-01T14:08:42.375764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:42.375775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.375778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:42.375836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:42.375849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:42.375853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:42.375908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:42.418450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255033013054631:5713]
2025-10-01T14:08:42.426468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 600, pipe: [1:7556255033013054631:5713]
2025-10-01T14:08:42.535622Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:42.535891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.535906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.535955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054631:5713], now have 1 active actors on pipe
2025-10-01T14:08:42.536271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:42.538507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:42.538507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255033013054631:5713]
2025-10-01T14:08:42.538533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:42.538567Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:08:42.538611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0
2025-10-01T14:08:42.538675Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 6 consumer shared/user session shared/user_1_6_17014875164461049393_v1 is DEAD
2025-10-01T14:08:42.539097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:42.539107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0] Write session will restart in 0.006946s
2025-10-01T14:08:42.539109Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:08:42.539124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0] Write session: Do CDS request
2025-10-01T14:08:42.539130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:42.539176Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:08:42.539180Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:08:42.539189Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.006439s
2025-10-01T14:08:42.538771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 601 sessionId: src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0 is DEAD
2025-10-01T14:08:42.538799Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254934228791999:5708] disconnected; active server actors: 1
2025-10-01T14:08:42.538803Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556254934228791999:5708] client user disconnected session shared/user_1_6_17014875164461049393_v1
2025-10-01T14:08:42.546785Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:08:42.547097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:42.546987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:42.547001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 602
2025-10-01T14:08:42.547539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:42.547563Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:08:42.547566Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 7
2025-10-01T14:08:42.547585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:42.547595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:42.547599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:42.547711Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 7 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:08:42.547755Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:08:42.547843Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 auth for : user
2025-10-01T14:08:42.547947Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 Handle describe topics response
2025-10-01T14:08:42.547968Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 auth is DEAD
2025-10-01T14:08:42.547982Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:08:42.548169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 602 sessionId:  describe result for acl check
2025-10-01T14:08:42.548198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:42.548205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:42.548206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:42.548211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255033013054680:6350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:42.548230Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:08:42.548371Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255033013054683:6351] connected; active server actors: 1
2025-10-01T14:08:42.548390Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255033013054683:6351] session shared/user_1_7_9030679859490182292_v1
2025-10-01T14:08:42.548400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:08:42.548420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:08:42.548432Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_7_9030679859490182292_v1" (Sender=[1:7556255033013054662:6351], Pipe=[1:7556255033013054683:6351], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:08:42.548437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:08:42.548453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:08:42.548466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_7_9030679859490182292_v1" (Sender=[1:7556255033013054662:6351], Pipe=[1:7556255033013054683:6351], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:08:42.548481Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_7_9030679859490182292_v1" sender [1:7556255033013054662:6351] lock partition 0 for ReadingSession "shared/user_1_7_9030679859490182292_v1" (Sender=[1:7556255033013054662:6351], Pipe=[1:7556255033013054683:6351], Partitions=[], ActiveFamilyCount=1) generation 1 step 7
2025-10-01T14:08:42.548493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:08:42.548497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000038s
2025-10-01T14:08:42.548576Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_7_9030679859490182292_v1
2025-10-01T14:08:42.548757Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 7 Session: "shared/user_1_7_9030679859490182292_v1" ClientId: "user" PipeClient { RawX1: 7556255033013054683 RawX2: 4503603922344143 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:08:42.548767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255033013054680:6350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:42.548798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:08:42.551579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255033013054680:6350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:42.552954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:42.555282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:42.555512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:42.555523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:42.555536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:42.555600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:42.555642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255030636190898:5664]
2025-10-01T14:08:42.555686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255033013054680:6350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:42.555704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255033013054680:6350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:42.555708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255033013054680:6350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:42.555717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:42.556207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:42.556596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:42.556674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:42.557002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:42.557075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.557080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.557081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.557082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.557084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.557085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.557086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.557088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.557089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.557090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.557092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.557093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.557094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.557095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.557101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.557111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.557115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.557119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.557124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.557127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.557131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.557135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.557139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.557143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.557147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.557152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.557156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.557160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.557168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.557181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.557191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.557200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.557205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.557209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.557213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.557218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.557222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.557228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.557232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.557238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.557248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.557258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.557263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.557272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.557278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.557287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.557292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.557301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.557322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.557327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.557334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.557339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.557344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.557352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.557359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.557364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.557406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:42.561598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:42.562631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:42.562645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:42.562647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:42.562650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:42.562657Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 601 [2:7556255030636190898:5664]
2025-10-01T14:08:42.562673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:42.562692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:42.562698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:42.562702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:42.562704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:42.562723Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:42.562731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:42.562737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:42.562799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.562806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.562808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.562811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:42.562814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:42.562882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:42.562888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.562900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.562915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.562980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 601
2025-10-01T14:08:42.563006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 601, pipe: [1:7556255033013054705:6355]
2025-10-01T14:08:42.563028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 601
2025-10-01T14:08:42.568829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e5c9ff2-9ceaee83-74784801-e8fd0f31_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:42.567944Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327722562 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:08:42.568270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:08:42.568319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 602 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0
2025-10-01T14:08:42.568448Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 sending to client partition status
2025-10-01T14:08:42.571932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0] Write session: try to update token
2025-10-01T14:08:42.571951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:42.562935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:42.562959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054634:2446], now have 1 active actors on pipe
2025-10-01T14:08:42.562963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054705:6355], now have 1 active actors on pipe
2025-10-01T14:08:42.562966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054815:6350], now have 1 active actors on pipe
2025-10-01T14:08:42.562975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255030636190893:5664]
2025-10-01T14:08:42.562977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255030636190893:5664]
2025-10-01T14:08:42.562978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255030636190893:5664]
2025-10-01T14:08:42.562991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:42.563004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:42.563010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:42.563013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:42.563015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:42.563017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:42.563019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:42.563078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.563083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.563096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_7_9030679859490182292_v1 on pipe: [1:7556255033013054705:6355]
2025-10-01T14:08:42.563121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255030636190893:5664]
2025-10-01T14:08:42.563129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:42.563153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:42.563159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:42.563161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:42.563178Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_7_9030679859490182292_v1
2025-10-01T14:08:42.563180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:42.563211Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:08:42.563216Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_7_9030679859490182292_v1:1 with generation 601
2025-10-01T14:08:42.566448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:42.566795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.566807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.566839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:42.566851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:08:42.567582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:08:42.567615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:08:42.567624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:42.567631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:42.567634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:42.567657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:42.567672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:42.567681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:08:42.567698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:08:42.567717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:42.568015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.568022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.568045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:42.597955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 602 sessionId: src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:42.600802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:42.601043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:42.601064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:42.601066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:42.601068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:42.601078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255030636190893:5664]
2025-10-01T14:08:42.601083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255030636190893:5664]
2025-10-01T14:08:42.601087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255030636190893:5664]
2025-10-01T14:08:42.601141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:42.601151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.601153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:42.601321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:42.602457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:42.602464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:42.602468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:42.761824Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:42.762144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.762162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.762417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:42.762432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:42.762494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 602 reason: error at write: Disconnected sessionId: src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0
2025-10-01T14:08:42.762503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:42.762557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255033013054705:6355]
2025-10-01T14:08:42.762723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 602 sessionId: src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0 is DEAD
2025-10-01T14:08:42.762440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_7_9030679859490182292_v1
2025-10-01T14:08:42.762458Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:42.762864Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_7_9030679859490182292_v1
2025-10-01T14:08:42.763089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:42.763104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0] Write session will restart in 0.008345s
2025-10-01T14:08:42.763129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0] Write session: Do CDS request
2025-10-01T14:08:42.763136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:42.773028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:42.773973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:42.774004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 603
2025-10-01T14:08:42.774111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:42.774139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:42.774145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:42.774149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:42.774626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 603 sessionId:  describe result for acl check
2025-10-01T14:08:42.774660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:42.774662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:42.774664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:42.774670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255033013054925:6359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:42.775193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255033013054925:6359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:42.779864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:42.777877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255033013054925:6359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:42.782381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:42.782627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:42.782641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:42.782654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:42.782709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:42.782749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255030636191083:5667]
2025-10-01T14:08:42.783357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:42.783669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:42.783715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:42.784024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:42.784093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.784094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.784095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.784096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.784098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.784099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.784100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.784101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.784102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.784104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.784105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.784106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.784107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.784108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.784115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.784124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.784128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.784132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.784135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.784139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.784142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.784145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.784149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.784154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.784159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.784162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.784165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.784168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.784176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.784184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:42.784190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.784195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:42.784201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.784206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:42.784210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.784214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:42.784217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.784222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:42.784226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.784231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:42.784236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.784240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:42.784245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.784249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:42.784254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.784260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:42.784263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.784268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.784272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.784277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.784282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.784287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.784293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.784298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:42.784301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.784305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:42.784342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:42.782610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255033013054925:6359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:42.782626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255033013054925:6359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:42.782630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255033013054925:6359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:42.782638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:42.788614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:42.789523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:42.789541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:42.789544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:42.789548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:42.789554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 602 [2:7556255030636191083:5667]
2025-10-01T14:08:42.789572Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:42.789591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:42.789594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:42.789597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:42.789600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:42.789618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:42.789624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:42.789631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:42.789694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.789704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.789706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.789709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:42.789712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:42.789784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:42.789793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.789804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:42.789814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:42.789833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:42.789860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013055007:6359], now have 1 active actors on pipe
2025-10-01T14:08:42.789864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013054831:2446], now have 1 active actors on pipe
2025-10-01T14:08:42.789873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255030636191078:5667]
2025-10-01T14:08:42.789876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255030636191078:5667]
2025-10-01T14:08:42.789878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255030636191078:5667]
2025-10-01T14:08:42.789893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:42.789932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 602
2025-10-01T14:08:42.789942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 602
2025-10-01T14:08:42.789909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:42.789927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:42.789930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:42.789965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255030636191078:5667]
2025-10-01T14:08:42.789967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:42.790027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:42.790029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:42.790030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:42.790035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:42.790079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.790087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.790124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e399b52-404a7e63-1358fcec-988876be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:42.790133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:42.790137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:42.790139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:42.790150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:42.790162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:42.790185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:42.790396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.790407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.790424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:42.790509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 603 partition: 0 MaxSeqNo: 45 sessionId: src_id|1e399b52-404a7e63-1358fcec-988876be_0
2025-10-01T14:08:42.790893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a7f9c70-4eed0945-656c3fb2-58356512_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1e399b52-404a7e63-1358fcec-988876be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:42.793578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e399b52-404a7e63-1358fcec-988876be_0] Write session: try to update token
2025-10-01T14:08:42.793596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e399b52-404a7e63-1358fcec-988876be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:42.816528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:42.816550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:42.816564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255030636191078:5667]
2025-10-01T14:08:42.816617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:42.816837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:42.817005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:42.817164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:42.817310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:42.817508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:42.817550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:42.817703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:42.817598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 603 sessionId: src_id|1e399b52-404a7e63-1358fcec-988876be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:42.820372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:42.822675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:42.822695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:42.822738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:42.823977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:42.839482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:42.839502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:42.839505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:42.839507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:42.839519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255030636191078:5667]
2025-10-01T14:08:42.839523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255030636191078:5667]
2025-10-01T14:08:42.839527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255030636191078:5667]
2025-10-01T14:08:42.839582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:42.839591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:42.839590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:42.839594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:42.839598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:42.839602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:42.839753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:42.862679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255033013055018:6355]
2025-10-01T14:08:42.862987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 602, pipe: [1:7556255033013055018:6355]
2025-10-01T14:08:43.001221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:43.010051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.010082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.010274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.010346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.010463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.010538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.010584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.010590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.010674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.010736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.010800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.010879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.010930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.010933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.011004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.011064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.011127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.011191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.011232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.011236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.011305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.011371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.011437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.011504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.011554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.011557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.011629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.011695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.011760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.011822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.011883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.011895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.011966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.012037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.012117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.012193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.012255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.012264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.012337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.012408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.012474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.012552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.012603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.012613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.012687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.012758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.012847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.012920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.012966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.012969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.013047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.013109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.013187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.013260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.013385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.013393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.013468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.013533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.013600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.013666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.013741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.013749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.013816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255033013055018:6355], now have 1 active actors on pipe
2025-10-01T14:08:43.014056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:43.014059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:43.014063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:43.014094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 603 reason: error at write: Disconnected sessionId: src_id|1e399b52-404a7e63-1358fcec-988876be_0
2025-10-01T14:08:43.014143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255033013055018:6355]
2025-10-01T14:08:43.014472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e399b52-404a7e63-1358fcec-988876be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:43.014483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e399b52-404a7e63-1358fcec-988876be_0] Write session will restart in 0.008644s
2025-10-01T14:08:43.014510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e399b52-404a7e63-1358fcec-988876be_0] Write session: Do CDS request
2025-10-01T14:08:43.014517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e399b52-404a7e63-1358fcec-988876be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:43.014364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 603 sessionId: src_id|1e399b52-404a7e63-1358fcec-988876be_0 is DEAD
2025-10-01T14:08:43.015038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:43.023933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e399b52-404a7e63-1358fcec-988876be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.024066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:43.024085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 604
2025-10-01T14:08:43.024203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.024235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:43.024240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:43.024243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:43.025132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 604 sessionId:  describe result for acl check
2025-10-01T14:08:43.025184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:43.025189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:43.025193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:43.025198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255037308022344:6363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:43.025736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255037308022344:6363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:43.028549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255037308022344:6363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:43.031685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255037308022344:6363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:43.031706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255037308022344:6363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:43.031709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255037308022344:6363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:43.031720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:43.033208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:43.041357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:43.041637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:43.041641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:43.041652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:43.041703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:43.041739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255034931158560:5669]
2025-10-01T14:08:43.042161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:43.043678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:43.043754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:43.044119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:43.044178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.044179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.044180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.044181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.044183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.044184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.044186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.044187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.044188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.044190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.044191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.044193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.044194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.044195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.044203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.044213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.044217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.044222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.044225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.044229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.044234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.044238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.044242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.044246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.044250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.044254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.044257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.044262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.044272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.044281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.044288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.044295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.044299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.044304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.044309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.044315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.044320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.044325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.044330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.044336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.044341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.044346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.044351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.044356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.044361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.044367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.044372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.044377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.044382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.044389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.044393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.044399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.044404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.044410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.044414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.044418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.044459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:43.052056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:43.053088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:43.053094Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:43.053098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:43.053102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:43.053109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 603 [2:7556255034931158560:5669]
2025-10-01T14:08:43.053126Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:43.053148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:43.053152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.053156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.053159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.053178Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:43.053196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:43.053203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:43.053281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.053290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.053292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.053296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:43.053298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:43.053376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:43.053385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.053398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.053414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.053435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:43.053461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255034931158555:5669]
2025-10-01T14:08:43.053464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255034931158555:5669]
2025-10-01T14:08:43.053467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255034931158555:5669]
2025-10-01T14:08:43.053477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:43.053486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:43.053489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:43.053492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:43.053494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:43.053511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:43.053519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:43.053531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022490:6363], now have 1 active actors on pipe
2025-10-01T14:08:43.053541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022320:2446], now have 1 active actors on pipe
2025-10-01T14:08:43.053580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255034931158555:5669]
2025-10-01T14:08:43.053593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:43.053653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 603
2025-10-01T14:08:43.053687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 603
2025-10-01T14:08:43.053986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:43.054106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.054111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.054141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:43.054151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.054157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.054159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:43.054169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.054180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:43.054200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.054540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.054551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.054568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.054872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 604 partition: 0 MaxSeqNo: 45 sessionId: src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0
2025-10-01T14:08:43.055255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e399b52-404a7e63-1358fcec-988876be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:43.057915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0] Write session: try to update token
2025-10-01T14:08:43.057935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:43.079406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 604 sessionId: src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:43.079486Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:43.079513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:43.079515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:43.079517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:43.079527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255034931158555:5669]
2025-10-01T14:08:43.079531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255034931158555:5669]
2025-10-01T14:08:43.079535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255034931158555:5669]
2025-10-01T14:08:43.079590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:43.079595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:43.079601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:43.079604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.079605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:43.079606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:43.079756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:43.081905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:43.114022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255037308022530:6355]
2025-10-01T14:08:43.114619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 603, pipe: [1:7556255037308022530:6355]
2025-10-01T14:08:43.237046Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:43.238191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:43.238201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0] Write session will restart in 0.007625s
2025-10-01T14:08:43.238228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0] Write session: Do CDS request
2025-10-01T14:08:43.238235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:43.237749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255037308022530:6355]
2025-10-01T14:08:43.237794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:43.237797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:43.237856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 604 reason: error at write: Disconnected sessionId: src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0
2025-10-01T14:08:43.238058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 604 sessionId: src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0 is DEAD
2025-10-01T14:08:43.238091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:43.237451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.237469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.237513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022530:6355], now have 1 active actors on pipe
2025-10-01T14:08:43.238419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:43.246966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.247053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:43.247069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 605
2025-10-01T14:08:43.247213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.247248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:43.247254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:43.247257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:43.247660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 605 sessionId:  describe result for acl check
2025-10-01T14:08:43.247694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:43.247696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:43.247698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:43.247704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255037308022550:6375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:43.248198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255037308022550:6375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:43.252003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255037308022550:6375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:43.257274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255037308022550:6375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:43.257297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255037308022550:6375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:43.257300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255037308022550:6375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:43.257309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:43.261634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:43.263730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:43.263993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:43.264007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:43.264021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:43.264092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:43.264136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255034931158750:5673]
2025-10-01T14:08:43.264795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:43.265136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:43.265194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:43.265549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:43.265646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.265652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.265653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.265654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.265655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.265657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.265659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.265660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.265661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.265663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.265664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.265665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.265666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.265667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.265674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.265684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.265689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.265693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.265697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.265701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.265705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.265709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.265714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.265719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.265723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.265726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.265729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.265732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.265741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.265750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.265756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.265769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.265774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.265779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.265784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.265789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.265795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.265800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.265804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.265814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.265819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.265827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.265832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.265837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.265841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.265846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.265852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.265857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.265863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.265868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.265874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.265880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.265892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.265896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.265901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.265906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.265960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:43.272079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:43.272758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:43.272787Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:43.272791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:43.272794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:43.272802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 604 [2:7556255034931158750:5673]
2025-10-01T14:08:43.272820Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:43.272839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:43.272842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.272846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.272848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.272867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:43.272874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:43.272881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:43.272945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.272947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.272949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.272953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:43.272955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:43.273039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:43.273042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.273055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.273066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.273081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:43.273098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255034931158745:5673]
2025-10-01T14:08:43.273100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255034931158745:5673]
2025-10-01T14:08:43.273102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255034931158745:5673]
2025-10-01T14:08:43.273111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:43.273127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:43.273127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:43.273131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:43.273133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:43.273142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:43.273145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:43.273157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022536:2446], now have 1 active actors on pipe
2025-10-01T14:08:43.273161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022672:6375], now have 1 active actors on pipe
2025-10-01T14:08:43.273202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255034931158745:5673]
2025-10-01T14:08:43.273211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:43.273221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:43.274107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 604
2025-10-01T14:08:43.274147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 604
2025-10-01T14:08:43.274248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.274264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.274292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:43.274303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.274309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.274312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:43.274323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.274336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:43.274367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.274669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.274671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.274682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.275250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 605 partition: 0 MaxSeqNo: 45 sessionId: src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0
2025-10-01T14:08:43.275628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b83a5e23-9c7b3f13-371a868b-20eda327_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:43.278334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0] Write session: try to update token
2025-10-01T14:08:43.278354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:43.289539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:43.289559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:43.289567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255034931158745:5673]
2025-10-01T14:08:43.289607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:43.289609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:43.289762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:43.289892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:43.290018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:43.290142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:43.290336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:43.290399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:43.300619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 605 sessionId: src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:43.303361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:43.303633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.303655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.303697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:43.303850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:43.326700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:43.326725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:43.326728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:43.326734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:43.326744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255034931158745:5673]
2025-10-01T14:08:43.326748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255034931158745:5673]
2025-10-01T14:08:43.326751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255034931158745:5673]
2025-10-01T14:08:43.326793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:43.326807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.326810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:43.326947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:43.332961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:43.332981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:43.332984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:43.336752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255037308022728:6355]
2025-10-01T14:08:43.339142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 604, pipe: [1:7556255037308022728:6355]
2025-10-01T14:08:43.500482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:43.509176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.509210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.509384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.509448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.509512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.509578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.509767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.509780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.509849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.509916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.509979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.510048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.510092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.510100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.510162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.510225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.510287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.510355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.510416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.510424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.510491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.510554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.510616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.510679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.510725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.510733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.510797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.510859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.510922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.510989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.511043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.511051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.511117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.511177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.511240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.511310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.511355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.511362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.511435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.511495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.511571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.511633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.511690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.511701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.511766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.511828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.511893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.511957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.512010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.512020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.512085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.512149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.512213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.512280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.512327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.512337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.512400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.512458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.512522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.512587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.512630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.512637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.512708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022728:6355], now have 1 active actors on pipe
2025-10-01T14:08:43.512923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255037308022728:6355]
2025-10-01T14:08:43.512975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:43.512977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:43.513004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 605 reason: error at write: Disconnected sessionId: src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0
2025-10-01T14:08:43.513244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 605 sessionId: src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0 is DEAD
2025-10-01T14:08:43.513412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:43.513935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:43.514473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:43.514487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0] Write session will restart in 0.005341s
2025-10-01T14:08:43.514520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0] Write session: Do CDS request
2025-10-01T14:08:43.514527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:43.521022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.522517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:43.522534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 606
2025-10-01T14:08:43.522657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.522679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:43.522683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:43.522687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:43.523252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 606 sessionId:  describe result for acl check
2025-10-01T14:08:43.523286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:43.523287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:43.523289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:43.523293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255037308022755:6380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:43.523798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255037308022755:6380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:43.528223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255037308022755:6380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:43.534217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255037308022755:6380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:43.534237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255037308022755:6380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:43.534240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255037308022755:6380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:43.534249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:43.545464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:43.548367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:43.548696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:43.548708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:43.548725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:43.548815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:43.548859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255034931158975:5687]
2025-10-01T14:08:43.549446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:43.551542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:43.551620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:43.552035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:43.552124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.552131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.552132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.552134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.552135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.552136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.552138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.552139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.552140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.552142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.552143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.552144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.552146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.552147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.552154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.552164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.552168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.552172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.552176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.552179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.552183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.552187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.552191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.552196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.552199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.552203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.552207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.552211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.552218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.552226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.552233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.552238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.552243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.552248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.552252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.552257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.552262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.552267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.552272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.552277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.552281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.552286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.552290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.552294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.552299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.552303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.552306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.552309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.552311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.552314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.552331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.552334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.552338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.552341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.552343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.552346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.552369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:43.556534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:43.557365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:43.557380Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:43.557382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:43.557384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:43.557390Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 605 [2:7556255034931158975:5687]
2025-10-01T14:08:43.557402Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:43.557416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:43.557418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.557421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.557422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.557437Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:43.557441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:43.557446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:43.557492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.557498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.557499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.557502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:43.557503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:43.557570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:43.557577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.557589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.557603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.557620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:43.557642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255034931158970:5687]
2025-10-01T14:08:43.557648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255034931158970:5687]
2025-10-01T14:08:43.557651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255034931158970:5687]
2025-10-01T14:08:43.557660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:43.557664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:43.557666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:43.557668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:43.557673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:43.557686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:43.557689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:43.557701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022822:6380], now have 1 active actors on pipe
2025-10-01T14:08:43.557710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022745:2446], now have 1 active actors on pipe
2025-10-01T14:08:43.557749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255034931158970:5687]
2025-10-01T14:08:43.557759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:43.557763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:43.558262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.558275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.558301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:43.558309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.558314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.558321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:43.558328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.558336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:43.558354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.558009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 605
2025-10-01T14:08:43.558044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 605
2025-10-01T14:08:43.558581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.558591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.558606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.558704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 606 partition: 0 MaxSeqNo: 45 sessionId: src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0
2025-10-01T14:08:43.562698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd11af97-f0a8fc9c-a56bc1af-823e1d10_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:43.565069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0] Write session: try to update token
2025-10-01T14:08:43.565089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:43.582213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:43.582231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:43.582233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:43.582235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:43.582243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255034931158970:5687]
2025-10-01T14:08:43.582247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255034931158970:5687]
2025-10-01T14:08:43.582250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255034931158970:5687]
2025-10-01T14:08:43.582297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:43.582300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:43.582302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:43.582306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:43.582309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.582311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:43.582535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:43.587996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 606 sessionId: src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:43.590718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:43.611486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255037308022934:6355]
2025-10-01T14:08:43.614291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 605, pipe: [1:7556255037308022934:6355]
2025-10-01T14:08:43.731528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:43.731865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.731873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.731907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022934:6355], now have 1 active actors on pipe
2025-10-01T14:08:43.732240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:43.735974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:43.735987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0] Write session will restart in 0.007693s
2025-10-01T14:08:43.736013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0] Write session: Do CDS request
2025-10-01T14:08:43.736020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:43.735328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:43.735330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:43.735403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255037308022934:6355]
2025-10-01T14:08:43.735409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 606 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0
2025-10-01T14:08:43.735603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 606 sessionId: src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0 is DEAD
2025-10-01T14:08:43.746884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.746986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:43.747007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 607
2025-10-01T14:08:43.747137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.747174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:43.747195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:43.747203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:43.748007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 607 sessionId:  describe result for acl check
2025-10-01T14:08:43.748044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:43.748047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:43.748048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:43.748053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255037308023015:6385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:43.748569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255037308023015:6385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:43.751192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255037308023015:6385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:43.751421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:43.755140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:43.755385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:43.755394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:43.755405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:43.755455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:43.755494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255034931159161:5690]
2025-10-01T14:08:43.755444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255037308023015:6385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:43.755462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255037308023015:6385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:43.755465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255037308023015:6385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:43.755474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:43.756086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:43.756700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:43.756748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:43.757072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:43.757131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.757137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.757139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.757140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.757142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.757143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.757144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.757144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.757145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.757146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.757148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.757149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.757150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.757151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.757157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.757166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.757170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.757174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.757177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.757181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.757184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.757188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.757192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.757197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.757200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.757214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.757217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.757221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.757229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.757242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.757252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.757262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.757266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.757276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.757280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.757289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.757294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.757303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.757308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.757312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.757320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.757325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.757329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.757333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.757337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.757348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.757351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.757355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.757359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.757363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.757367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.757371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.757376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.757379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.757383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.757387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.757420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:43.763929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:43.764583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:43.764601Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:43.764604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:43.764608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:43.764616Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 606 [2:7556255034931159161:5690]
2025-10-01T14:08:43.764630Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:43.764644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:43.764651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.764654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.764655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.764670Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:43.764680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:43.764691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:43.764757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.764763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.764766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.764769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:43.764772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:43.764861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:43.764868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.764881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.764892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.764910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:43.764933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308023118:6385], now have 1 active actors on pipe
2025-10-01T14:08:43.764941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308022939:2446], now have 1 active actors on pipe
2025-10-01T14:08:43.764949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255034931159156:5690]
2025-10-01T14:08:43.764956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255034931159156:5690]
2025-10-01T14:08:43.764960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255034931159156:5690]
2025-10-01T14:08:43.764978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:43.764988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:43.764996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:43.764996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:43.764998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:43.765010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:43.765013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:43.765050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255034931159156:5690]
2025-10-01T14:08:43.765061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:43.765067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:43.765124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 606
2025-10-01T14:08:43.765166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 606
2025-10-01T14:08:43.765180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.765190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.765211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b08ea48-e59985fb-a4985732-51cbf535_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:43.765216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.765220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.765222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:43.765229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.765240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:43.765261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.765405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.765413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.765433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.765530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 607 partition: 0 MaxSeqNo: 45 sessionId: src_id|b08ea48-e59985fb-a4985732-51cbf535_0
2025-10-01T14:08:43.765933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5445b66e-1fb01f1c-ffde39e7-ae1cb056_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b08ea48-e59985fb-a4985732-51cbf535_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:43.768541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b08ea48-e59985fb-a4985732-51cbf535_0] Write session: try to update token
2025-10-01T14:08:43.768559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b08ea48-e59985fb-a4985732-51cbf535_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:43.778000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:43.778020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:43.778031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255034931159156:5690]
2025-10-01T14:08:43.778078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:43.778138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:43.778253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:43.778424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:43.778567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:43.778733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:43.778937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:43.778979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:43.786931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 607 sessionId: src_id|b08ea48-e59985fb-a4985732-51cbf535_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:43.789664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:43.790045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.790070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.790109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:43.790221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:43.799432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:43.799449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:43.799452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:43.799454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:43.799465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255034931159156:5690]
2025-10-01T14:08:43.799469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255034931159156:5690]
2025-10-01T14:08:43.799473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255034931159156:5690]
2025-10-01T14:08:43.799530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:43.799539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:43.799545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:43.799545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.799547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:43.799552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:43.799721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:43.835461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255037308023130:6355]
2025-10-01T14:08:43.835766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 606, pipe: [1:7556255037308023130:6355]
2025-10-01T14:08:43.952298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:43.961184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.961214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.961385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.961451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.961517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.961591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.961642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.961652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.961723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.961788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.961893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.961961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.962014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.962025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.962092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.962148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.962211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.962272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.962321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.962328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.962416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.962479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.962541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.962604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.962649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.962661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.962726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.962784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.962843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.962905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.962950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.962959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.963026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.963084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.963150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.963215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.963263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.963270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.963341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.963402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.963469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.963531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.963577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.963580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.963650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.963712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.963773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.963841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.963890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.963898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.963971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.964034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.964098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.964163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.964212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.964219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.964288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:43.964350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:43.964414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:43.964478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:43.964525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:43.964532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:43.964606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308023130:6355], now have 1 active actors on pipe
2025-10-01T14:08:43.964855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:43.964871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:43.964875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255037308023130:6355]
2025-10-01T14:08:43.964902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:43.964903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 607 reason: error at write: Disconnected sessionId: src_id|b08ea48-e59985fb-a4985732-51cbf535_0
2025-10-01T14:08:43.965126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 607 sessionId: src_id|b08ea48-e59985fb-a4985732-51cbf535_0 is DEAD
2025-10-01T14:08:43.965272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08ea48-e59985fb-a4985732-51cbf535_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:43.965293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08ea48-e59985fb-a4985732-51cbf535_0] Write session will restart in 0.009435s
2025-10-01T14:08:43.965318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08ea48-e59985fb-a4985732-51cbf535_0] Write session: Do CDS request
2025-10-01T14:08:43.965324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08ea48-e59985fb-a4985732-51cbf535_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:43.966057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:43.976001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b08ea48-e59985fb-a4985732-51cbf535_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.976029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:43.976052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 608
2025-10-01T14:08:43.976238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:43.976273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:43.976279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:43.976282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:43.976874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 608 sessionId:  describe result for acl check
2025-10-01T14:08:43.976905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:43.976909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:43.976911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:43.976916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255037308023231:6389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:43.977456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255037308023231:6389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:43.979980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255037308023231:6389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:43.983001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255037308023231:6389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:43.982997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:43.983018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255037308023231:6389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:43.983031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255037308023231:6389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:43.983039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:43.985750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:43.985996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:43.986008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:43.986020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:43.986073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:43.986118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255034931159346:5692]
2025-10-01T14:08:43.986736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:43.987069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:43.987117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:43.987410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:43.987496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.987503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.987504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.987505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.987506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.987508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.987509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.987510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.987511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.987512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.987513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.987514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.987515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.987516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.987522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.987532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.987536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.987539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.987542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.987550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.987554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.987557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.987561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.987565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.987573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.987577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.987580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.987584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.987591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.987598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:43.987607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.987613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:43.987621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.987625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:43.987633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.987638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:43.987642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.987651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:43.987654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.987659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:43.987664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.987672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:43.987681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.987689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:43.987693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.987702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:43.987706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.987710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.987716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.987721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.987725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.987730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.987734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.987739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:43.987745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.987749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:43.987790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:43.991700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:43.992568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:43.992583Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:43.992586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:43.992589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:43.992596Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 607 [2:7556255034931159346:5692]
2025-10-01T14:08:43.992611Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:43.992638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:43.992641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.992645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.992647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.992663Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:43.992674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:43.992680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:43.992739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.992746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.992749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.992752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:43.992755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:43.992831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:43.992839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:43.992850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:43.992860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:43.992878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:43.992897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308023312:6389], now have 1 active actors on pipe
2025-10-01T14:08:43.992904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255037308023136:2446], now have 1 active actors on pipe
2025-10-01T14:08:43.992911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255034931159340:5692]
2025-10-01T14:08:43.992913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255034931159340:5692]
2025-10-01T14:08:43.992915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255034931159340:5692]
2025-10-01T14:08:43.992928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:43.992944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:43.992945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:43.992949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:43.992951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:43.992961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:43.992963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:43.992995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255034931159340:5692]
2025-10-01T14:08:43.993005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:43.993011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:43.993333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 607
2025-10-01T14:08:43.993366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 607
2025-10-01T14:08:43.993425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.993439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.993467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:43.993479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:43.993488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:43.993491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:43.993502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:43.993517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:43.993537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.993722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:43.993731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:43.993745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:43.993852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 608 partition: 0 MaxSeqNo: 45 sessionId: src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0
2025-10-01T14:08:43.994226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b08ea48-e59985fb-a4985732-51cbf535_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:43.996749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0] Write session: try to update token
2025-10-01T14:08:43.996771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:44.003923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:44.003942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:44.003952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255034931159340:5692]
2025-10-01T14:08:44.003998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:44.004019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:44.004173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:44.004323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:44.004482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:44.004625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:44.004850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:44.004893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:44.011784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 608 sessionId: src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:44.014459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:44.014683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.014709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.014756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:44.014862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:44.024222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:44.024247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:44.024249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:44.024252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:44.024262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255034931159340:5692]
2025-10-01T14:08:44.024267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255034931159340:5692]
2025-10-01T14:08:44.024272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255034931159340:5692]
2025-10-01T14:08:44.024318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:44.024320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:44.024328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.024330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:44.024332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:44.024335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:44.024476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:44.064866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255041602990620:6355]
2025-10-01T14:08:44.065213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 607, pipe: [1:7556255041602990620:6355]
2025-10-01T14:08:44.179597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:44.187355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.187379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.187543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.187607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.187672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.187733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.187937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.187949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.188012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.188072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.188124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.188187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.188235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.188244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.188322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.188397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.188468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.188536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.188578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.188583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.188646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.188708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.188773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.188851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.188896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.188901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.188962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.189019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.189088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.189145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.189195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.189200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.189267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.189325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.189386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.189466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.189508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.189514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.189589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.189645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.189704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.189761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.189808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.189815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.189888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.189946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.189998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.190056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.190097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.190102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.190165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.190252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.190309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.190396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.190443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.190451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.190513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.190571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.190636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.190703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.190767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.190774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.190844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602990620:6355], now have 1 active actors on pipe
2025-10-01T14:08:44.191104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:44.191118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:44.191121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:44.191150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 608 reason: error at write: Disconnected sessionId: src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0
2025-10-01T14:08:44.191171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255041602990620:6355]
2025-10-01T14:08:44.191385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 608 sessionId: src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0 is DEAD
2025-10-01T14:08:44.191545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:44.191556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0] Write session will restart in 0.006271s
2025-10-01T14:08:44.191581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0] Write session: Do CDS request
2025-10-01T14:08:44.191587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:44.191697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:44.199052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:44.199133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:44.199150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 609
2025-10-01T14:08:44.199270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:44.199302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:44.199312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:44.199316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:44.199860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 609 sessionId:  describe result for acl check
2025-10-01T14:08:44.199896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:44.199902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:44.199904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:44.199908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255041602990679:6400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:44.200417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255041602990679:6400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:44.203031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255041602990679:6400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:44.205867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:44.208361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:44.208575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:44.208587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:44.208599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:44.208668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:44.208660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255041602990679:6400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:44.208680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255041602990679:6400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:44.208685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255041602990679:6400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:44.208693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:44.208709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255039226126833:5696]
2025-10-01T14:08:44.209327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:44.209628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:44.209678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:44.209996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:44.210060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.210066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.210068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.210069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.210070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.210071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.210073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.210074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.210075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.210076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.210078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.210079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.210080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.210081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.210087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.210098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.210102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.210107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.210111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.210115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.210119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.210123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.210128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.210132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.210137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.210141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.210145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.210154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.210162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.210175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.210186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.210196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.210206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.210211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.210220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.210226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.210235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.210240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.210249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.210255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.210264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.210275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.210285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.210295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.210303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.210308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.210317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.210323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.210333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.210344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.210352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.210357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.210366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.210390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.210398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.210404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.210452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:44.214297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:44.215192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:44.215211Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:44.215214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:44.215218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:44.215225Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 608 [2:7556255039226126833:5696]
2025-10-01T14:08:44.215240Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:44.215257Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:44.215267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:44.215271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:44.215273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:44.215290Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:44.215301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:44.215307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:44.215367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.215375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.215377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.215381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:44.215384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:44.215451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:44.215459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.215473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.215486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.215508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:44.215532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602990826:6400], now have 1 active actors on pipe
2025-10-01T14:08:44.215539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602990648:2446], now have 1 active actors on pipe
2025-10-01T14:08:44.215547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255039226126828:5696]
2025-10-01T14:08:44.215550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255039226126828:5696]
2025-10-01T14:08:44.215552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255039226126828:5696]
2025-10-01T14:08:44.215567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:44.215578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:44.215584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:44.215588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:44.215590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:44.215599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:44.215608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:44.215590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 608
2025-10-01T14:08:44.215639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 608
2025-10-01T14:08:44.215654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.215664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.215677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255039226126828:5696]
2025-10-01T14:08:44.215684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:44.215689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:44.215718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:44.215729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:44.215738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:44.215740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:44.215750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:44.215763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:44.215788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:44.215942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.215954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.215971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:44.216055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 609 partition: 0 MaxSeqNo: 45 sessionId: src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0
2025-10-01T14:08:44.216457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecb87ddd-f98c2101-3798c1cd-a041b905_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:44.219070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0] Write session: try to update token
2025-10-01T14:08:44.219089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:44.235289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 609 sessionId: src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:44.237080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:44.237103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:44.237105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:44.237107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:44.237119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255039226126828:5696]
2025-10-01T14:08:44.237125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255039226126828:5696]
2025-10-01T14:08:44.237129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255039226126828:5696]
2025-10-01T14:08:44.237187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:44.237195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:44.237201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:44.237205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:44.237205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.237208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:44.237360Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:44.237684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:44.291107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255041602990843:6355]
2025-10-01T14:08:44.291418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 608, pipe: [1:7556255041602990843:6355]
2025-10-01T14:08:44.394112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:44.394359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.394386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.394424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602990843:6355], now have 1 active actors on pipe
2025-10-01T14:08:44.394607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:44.394693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255041602990843:6355]
2025-10-01T14:08:44.394694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:44.394749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:44.394756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:44.394809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 609 reason: error at write: Disconnected sessionId: src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0
2025-10-01T14:08:44.395036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 609 sessionId: src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0 is DEAD
2025-10-01T14:08:44.395213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:44.395224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0] Write session will restart in 0.007869s
2025-10-01T14:08:44.395252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0] Write session: Do CDS request
2025-10-01T14:08:44.395258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:44.403945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:44.404125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:44.404141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 610
2025-10-01T14:08:44.404230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:44.404254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:44.404259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:44.404263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:44.404724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 610 sessionId:  describe result for acl check
2025-10-01T14:08:44.404760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:44.404767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:44.404769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:44.404786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255041602990929:6406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:44.405303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255041602990929:6406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:44.407378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255041602990929:6406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:44.408466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:44.410894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:44.411119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:44.411135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:44.411149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:44.411222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:44.411268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255039226127048:5706]
2025-10-01T14:08:44.411296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255041602990929:6406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:44.411312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255041602990929:6406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:44.411316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255041602990929:6406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:44.411324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:44.411876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:44.412174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:44.412227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:44.412542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:44.412619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.412626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.412628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.412629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.412631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.412632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.412633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.412634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.412635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.412636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.412638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.412639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.412640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.412641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.412648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.412659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.412664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.412669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.412673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.412677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.412681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.412685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.412689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.412693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.412697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.412701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.412704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.412707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.412714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.412722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.412729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.412734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.412739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.412743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.412747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.412753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.412757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.412763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.412767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.412773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.412796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.412801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.412810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.412816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.412825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.412831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.412841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.412846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.412855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.412860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.412867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.412873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.412877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.412882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.412891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.412896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.412938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:44.416827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:44.417871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:44.417892Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:44.417895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:44.417898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:44.417905Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 609 [2:7556255039226127048:5706]
2025-10-01T14:08:44.417922Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:44.417944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:44.417953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:44.417957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:44.417959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:44.417977Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:44.417987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:44.417998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:44.418064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.418071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.418073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.418076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:44.418079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:44.418147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:44.418153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.418168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.418186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.418207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:44.418230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602991042:6406], now have 1 active actors on pipe
2025-10-01T14:08:44.418239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602990860:2446], now have 1 active actors on pipe
2025-10-01T14:08:44.418246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255039226127043:5706]
2025-10-01T14:08:44.418253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255039226127043:5706]
2025-10-01T14:08:44.418256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255039226127043:5706]
2025-10-01T14:08:44.418271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:44.418288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:44.418289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:44.418298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:44.418300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:44.418304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:44.418306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:44.418306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 609
2025-10-01T14:08:44.418353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255039226127043:5706]
2025-10-01T14:08:44.418307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 609
2025-10-01T14:08:44.418365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:44.418386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:44.418408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.418417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.418474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:44.418488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:44.418496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:44.418498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:44.418508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:44.418524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:44.418548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:44.418718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.418730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.418747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:44.418830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 610 partition: 0 MaxSeqNo: 45 sessionId: src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0
2025-10-01T14:08:44.419194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58a0af6c-efbe2ecd-6ba8c3d6-b02f6527_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:44.421866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0] Write session: try to update token
2025-10-01T14:08:44.421884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:44.436413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 610 sessionId: src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:44.438838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:44.439208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.439238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.439260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:44.439269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:44.439271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:44.439273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:44.439282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255039226127043:5706]
2025-10-01T14:08:44.439287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255039226127043:5706]
2025-10-01T14:08:44.439295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255039226127043:5706]
2025-10-01T14:08:44.439345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:44.439355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:44.439362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:44.439363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.439365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:44.439366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:44.439500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:44.494913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255041602991054:6355]
2025-10-01T14:08:44.495594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 609, pipe: [1:7556255041602991054:6355]
2025-10-01T14:08:44.591811Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:44.592113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:44.592180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602991054:6355], now have 1 active actors on pipe
2025-10-01T14:08:44.592245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:44.592388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:44.592464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255041602991054:6355]
2025-10-01T14:08:44.603973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:44.603989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:44.604014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 610 reason: error at write: Disconnected sessionId: src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0
2025-10-01T14:08:44.604182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 610 sessionId: src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0 is DEAD
2025-10-01T14:08:44.604308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:44.604316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0] Write session will restart in 0.008407s
2025-10-01T14:08:44.604335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0] Write session: Do CDS request
2025-10-01T14:08:44.604342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:44.609227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:44.611920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:44.612147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:44.612160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:44.612176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:44.612234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:44.612277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255039226127251:5712]
2025-10-01T14:08:44.612925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:44.613206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:44.613258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:44.613565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:44.613646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.613653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.613654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.613656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.613657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.613658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.613659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.613660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.613662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.613663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.613664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.613665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.613666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.613667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.613673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.613683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.613687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.613691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.613694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.613698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.613701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.613705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.613708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.613712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.613716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.613720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.613723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.613727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.613734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.613742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.613753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.613758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.613762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.613768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.613772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.613781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.613786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.613796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.613804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.613814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.613823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.613828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.613835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.613839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.613844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.613852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.613856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.613861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.613869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.613874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.613877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.613886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.613894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.613898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.613903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.613907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.613946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:44.613992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:44.614034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:44.614050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 611
2025-10-01T14:08:44.614209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:44.614243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:44.614249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:44.614254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:44.614584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 611 sessionId:  describe result for acl check
2025-10-01T14:08:44.614614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:44.614620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:44.614622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:44.614625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255041602991209:6410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:44.615061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255041602991209:6410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:44.617231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255041602991209:6410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:44.617630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:44.618614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:44.618628Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:44.618630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:44.618633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:44.618639Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 610 [2:7556255039226127251:5712]
2025-10-01T14:08:44.618653Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:44.618668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:44.618676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:44.618679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:44.618685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:44.618701Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:44.618710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:44.618717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:44.618778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.618784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.618786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.618789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:44.618791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:44.618855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:44.618862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.618874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.618884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.618902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:44.618923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602991056:2446], now have 1 active actors on pipe
2025-10-01T14:08:44.618934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255039226127246:5712]
2025-10-01T14:08:44.618940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255039226127246:5712]
2025-10-01T14:08:44.618941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255039226127246:5712]
2025-10-01T14:08:44.618955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:44.618951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 610
2025-10-01T14:08:44.618972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:44.618973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:44.618981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:44.618983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:44.618986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:44.618989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:44.619029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255039226127246:5712]
2025-10-01T14:08:44.619042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:44.619062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:44.622580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255041602991209:6410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:44.622594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255041602991209:6410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:44.622598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255041602991209:6410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:44.622606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:44.622832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602991248:6410], now have 1 active actors on pipe
2025-10-01T14:08:44.622871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 610
2025-10-01T14:08:44.622918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.622930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.622961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:44.622974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:44.622983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:44.622993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:44.623005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:44.623024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:44.623046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:44.623170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.623179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.623194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:44.623255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 611 partition: 0 MaxSeqNo: 45 sessionId: src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0
2025-10-01T14:08:44.623636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be16d4c8-e303f47-3820d470-f8e19f4e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:44.626078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0] Write session: try to update token
2025-10-01T14:08:44.626095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:44.634822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:44.634840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:44.634850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255039226127246:5712]
2025-10-01T14:08:44.634899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:44.634910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:44.635105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:44.635262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:44.635410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:44.635557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:44.635772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:44.635815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:44.639444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 611 sessionId: src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:44.641870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:44.642125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.642143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.642178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:44.642272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:44.648091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:44.648106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:44.648108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:44.648111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:44.648122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255039226127246:5712]
2025-10-01T14:08:44.648127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255039226127246:5712]
2025-10-01T14:08:44.648131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255039226127246:5712]
2025-10-01T14:08:44.648172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:44.648177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:44.648183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:44.648186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:44.648187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.648188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:44.648320Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:44.692517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255041602991253:6355]
2025-10-01T14:08:44.692769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 610, pipe: [1:7556255041602991253:6355]
2025-10-01T14:08:44.791289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:44.799762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.799789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.799963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.800027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.800092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.800165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.800221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.800230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.800309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.800372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.800434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.800506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.800562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.800569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.800647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.800748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.800831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.800905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.800952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.800959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.801034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.801109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.801180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.801246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.801294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.801302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.801374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.801445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.801510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.801586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.801633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.801641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.801717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.801783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.801850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.801925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.801992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.802000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.802076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.802139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.802207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.802279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.802336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.802345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.802423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.802482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.802545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.802611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.802654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.802660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.802731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.802796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.802861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.802928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.802971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.802978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.803045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:44.803108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:44.803178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:44.803242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:44.803287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:44.803294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:44.803361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602991253:6355], now have 1 active actors on pipe
2025-10-01T14:08:44.803621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:44.803638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:44.803668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 611 reason: error at write: Disconnected sessionId: src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0
2025-10-01T14:08:44.803899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 611 sessionId: src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0 is DEAD
2025-10-01T14:08:44.803935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:44.803995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255041602991253:6355]
2025-10-01T14:08:44.804065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:44.804075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0] Write session will restart in 0.007243s
2025-10-01T14:08:44.804100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0] Write session: Do CDS request
2025-10-01T14:08:44.804107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:44.804305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:44.813138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:44.813269Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:44.813286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 612
2025-10-01T14:08:44.813423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:44.813454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:44.813460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:44.813463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:44.813988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 612 sessionId:  describe result for acl check
2025-10-01T14:08:44.814018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:44.814022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:44.814024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:44.814028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255041602991288:6415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:44.814557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255041602991288:6415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:44.817411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255041602991288:6415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:44.820317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255041602991288:6415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:44.820335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255041602991288:6415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:44.820338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255041602991288:6415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:44.820347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:44.820504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:44.822991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:44.823337Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:44.823349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:44.823364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:44.823427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:44.823467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255039226127442:5715]
2025-10-01T14:08:44.824059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:44.824393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:44.824440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:44.824739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:44.824815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.824821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.824822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.824823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.824825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.824826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.824827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.824828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.824829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.824830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.824831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.824832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.824833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.824834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.824840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.824850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.824853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.824857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.824861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.824864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.824868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.824871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.824875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.824879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.824882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.824885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.824889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.824892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.824900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.824907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:44.824913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.824918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:44.824922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.824927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:44.824931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.824936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:44.824940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.824945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:44.824950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.824954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:44.824959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.824967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:44.824971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.824979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:44.824987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.824991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:44.824999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.825003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.825011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.825020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.825023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.825032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.825036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.825040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:44.825050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.825055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:44.825091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:44.829095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:44.829802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:44.829815Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:44.829818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:44.829822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:44.829829Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 611 [2:7556255039226127442:5715]
2025-10-01T14:08:44.829845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:44.829866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:44.829869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:44.829872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:44.829874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:44.829894Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:44.829904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:44.829910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:44.829973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.829986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.829988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.829991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:44.829994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:44.830067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:44.830075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.830086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:44.830096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:44.830111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:44.830130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602991439:6415], now have 1 active actors on pipe
2025-10-01T14:08:44.830137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602991256:2446], now have 1 active actors on pipe
2025-10-01T14:08:44.830146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255039226127436:5715]
2025-10-01T14:08:44.830148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255039226127436:5715]
2025-10-01T14:08:44.830150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255039226127436:5715]
2025-10-01T14:08:44.830163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:44.830178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:44.830180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:44.830186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:44.830187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:44.830195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:44.830198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:44.830234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255039226127436:5715]
2025-10-01T14:08:44.830245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:44.830230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 611
2025-10-01T14:08:44.830250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:44.830271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 611
2025-10-01T14:08:44.830440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.830452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.830482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30bc54de-3f247c33-9438814-1b8c332b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:44.830502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:44.830511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:44.830513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:44.830524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:44.830540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:44.830561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:44.832253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.832267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.832297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:44.832387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 612 partition: 0 MaxSeqNo: 45 sessionId: src_id|30bc54de-3f247c33-9438814-1b8c332b_0
2025-10-01T14:08:44.832772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c52e838-d9e56b5c-446dddf4-954aaf93_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|30bc54de-3f247c33-9438814-1b8c332b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:44.835526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30bc54de-3f247c33-9438814-1b8c332b_0] Write session: try to update token
2025-10-01T14:08:44.835546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30bc54de-3f247c33-9438814-1b8c332b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:44.846889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:44.846919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:44.846931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255039226127436:5715]
2025-10-01T14:08:44.846972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:44.846978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:44.847158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:44.847309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:44.847452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:44.847596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:44.847807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:44.847843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:44.852407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 612 sessionId: src_id|30bc54de-3f247c33-9438814-1b8c332b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:44.854734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:44.854920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:44.854943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:44.854980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:44.855046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:44.868437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:44.868455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:44.868457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:44.868458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:44.868469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255039226127436:5715]
2025-10-01T14:08:44.868474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255039226127436:5715]
2025-10-01T14:08:44.868477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255039226127436:5715]
2025-10-01T14:08:44.868531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:44.868535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:44.868539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:44.868541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:44.868542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:44.868546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:44.868679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:44.903972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255041602991451:6355]
2025-10-01T14:08:44.904167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 611, pipe: [1:7556255041602991451:6355]
2025-10-01T14:08:45.022300Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:45.030924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.030958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.031138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.031205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.031277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.031346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.031400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.031410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.031487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.031553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.031618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.031682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.031838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.031851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.031919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.031978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.032046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.032114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.032162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.032170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.032243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.032306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.032369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.032438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.032491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.032499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.032568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.032629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.032694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.032757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.032820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.032827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.032894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.032966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.033034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.033104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.033154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.033161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.033234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.033298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.033366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.033434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.033478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.033485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.033553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.033617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.033684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.033748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.033793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.033800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.033865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.033929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.033993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.034057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.034104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.034115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.034183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.034244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.034307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.034390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.034436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.034443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.034510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255041602991451:6355], now have 1 active actors on pipe
2025-10-01T14:08:45.034740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:45.034756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:45.034758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255041602991451:6355]
2025-10-01T14:08:45.034789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:45.034793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 612 reason: error at write: Disconnected sessionId: src_id|30bc54de-3f247c33-9438814-1b8c332b_0
2025-10-01T14:08:45.035022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 612 sessionId: src_id|30bc54de-3f247c33-9438814-1b8c332b_0 is DEAD
2025-10-01T14:08:45.035479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bc54de-3f247c33-9438814-1b8c332b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:45.035491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bc54de-3f247c33-9438814-1b8c332b_0] Write session will restart in 0.007881s
2025-10-01T14:08:45.035518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bc54de-3f247c33-9438814-1b8c332b_0] Write session: Do CDS request
2025-10-01T14:08:45.035524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bc54de-3f247c33-9438814-1b8c332b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:45.035550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:45.044981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30bc54de-3f247c33-9438814-1b8c332b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.045024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:45.045042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 613
2025-10-01T14:08:45.045221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.045251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:45.045260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:45.045264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:45.045709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 613 sessionId:  describe result for acl check
2025-10-01T14:08:45.045739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:45.045745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:45.045747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:45.045753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255045897958863:6419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:45.046246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255045897958863:6419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:45.047929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:45.048452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255045897958863:6419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:45.050272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:45.050514Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:45.050525Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:45.050537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:45.050597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:45.050635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255043521094926:5717]
2025-10-01T14:08:45.051178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255045897958863:6419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:45.051193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255045897958863:6419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:45.051207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255045897958863:6419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:45.051216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:45.051209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:45.051476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:45.051524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:45.051827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:45.051888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.051894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.051895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.051896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.051897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.051898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.051900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.051901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.051902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.051903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.051904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.051905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.051906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.051907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.051913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.051922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.051926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.051930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.051933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.051936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.051940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.051943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.051947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.051951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.051955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.051958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.051962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.051965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.051972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.051979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.051989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.051994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.052001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.052006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.052009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.052014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.052022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.052027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.052035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.052039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.052044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.052049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.052053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.052058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.052062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.052066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.052069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.052074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.052078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.052085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.052093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.052098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.052105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.052114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.052122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.052130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.052163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:45.056076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:45.057010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:45.057025Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:45.057027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:45.057031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:45.057039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 612 [2:7556255043521094926:5717]
2025-10-01T14:08:45.057060Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:45.057082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:45.057090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.057094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.057100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.057118Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:45.057128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:45.057138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:45.057202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.057208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.057210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.057212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:45.057215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:45.057285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:45.057292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.057304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.057319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.057341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:45.057360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897958934:6419], now have 1 active actors on pipe
2025-10-01T14:08:45.057363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897958752:2446], now have 1 active actors on pipe
2025-10-01T14:08:45.057371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255043521094921:5717]
2025-10-01T14:08:45.057373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255043521094921:5717]
2025-10-01T14:08:45.057375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255043521094921:5717]
2025-10-01T14:08:45.057389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:45.057403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:45.057406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:45.057409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:45.057411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:45.057415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:45.057419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:45.057456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255043521094921:5717]
2025-10-01T14:08:45.057467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:45.057483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:45.057461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 612
2025-10-01T14:08:45.057509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.057464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 612
2025-10-01T14:08:45.057519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.057548Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81267400-6175064e-dabb88ef-ea17b274_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:45.057560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.057564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.057567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:45.057577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.057591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:45.057611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.057762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.057771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.057786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.057874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 613 partition: 0 MaxSeqNo: 45 sessionId: src_id|81267400-6175064e-dabb88ef-ea17b274_0
2025-10-01T14:08:45.058268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30bc54de-3f247c33-9438814-1b8c332b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|81267400-6175064e-dabb88ef-ea17b274_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:45.060880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81267400-6175064e-dabb88ef-ea17b274_0] Write session: try to update token
2025-10-01T14:08:45.060901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81267400-6175064e-dabb88ef-ea17b274_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:45.068888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:45.068906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:45.068917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255043521094921:5717]
2025-10-01T14:08:45.068959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:45.068967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:45.069135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:45.069280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:45.069422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:45.069557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:45.069748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:45.069790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:45.077624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 613 sessionId: src_id|81267400-6175064e-dabb88ef-ea17b274_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:45.080763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:45.081021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.081046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.081086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:45.081180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:45.092062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:45.092082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:45.092084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:45.092086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:45.092097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255043521094921:5717]
2025-10-01T14:08:45.092101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255043521094921:5717]
2025-10-01T14:08:45.092104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255043521094921:5717]
2025-10-01T14:08:45.092156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:45.092155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:45.092162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:45.092165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.092167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:45.092167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:45.092314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:45.134897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255045897958951:6355]
2025-10-01T14:08:45.135215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 612, pipe: [1:7556255045897958951:6355]
2025-10-01T14:08:45.247157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:45.255518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.255545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.255714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.255778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.255850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.255929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.256343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.256356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.256436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.256520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.256599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.256669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.256716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.256723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.256821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.256886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.256952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.257024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.257069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.257072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.257150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.257218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.257283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.257356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.257408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.257412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.257487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.257555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.257621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.257681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.257746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.257748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.257814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.257884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.257952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.258006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.258115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.258119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.258195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.258269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.258343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.260367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255045897958951:6355]
2025-10-01T14:08:45.260404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:45.260407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:45.260432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 613 reason: error at write: Disconnected sessionId: src_id|81267400-6175064e-dabb88ef-ea17b274_0
2025-10-01T14:08:45.260660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 613 sessionId: src_id|81267400-6175064e-dabb88ef-ea17b274_0 is DEAD
2025-10-01T14:08:45.260806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:45.258576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.258632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.258635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.258712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.258777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.258846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.258914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.258960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.258963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.259039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.259104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.259172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.259238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.259284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.259287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.259363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:45.259429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:45.259500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:45.259566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:45.259610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:45.259613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:45.259688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897958951:6355], now have 1 active actors on pipe
2025-10-01T14:08:45.260520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:45.262877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81267400-6175064e-dabb88ef-ea17b274_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:45.262891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81267400-6175064e-dabb88ef-ea17b274_0] Write session will restart in 0.006177s
2025-10-01T14:08:45.262919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81267400-6175064e-dabb88ef-ea17b274_0] Write session: Do CDS request
2025-10-01T14:08:45.262926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81267400-6175064e-dabb88ef-ea17b274_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:45.274882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81267400-6175064e-dabb88ef-ea17b274_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.274974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:45.274995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 614
2025-10-01T14:08:45.275126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.275162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:45.275172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:45.275175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:45.275610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 614 sessionId:  describe result for acl check
2025-10-01T14:08:45.275649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:45.275650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:45.275654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:45.275660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255045897959034:6431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:45.276199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255045897959034:6431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:45.279784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255045897959034:6431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:45.283851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255045897959034:6431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:45.283867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255045897959034:6431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:45.283870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255045897959034:6431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:45.283879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:45.285911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:45.288645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:45.288948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:45.288961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:45.288973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:45.289039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:45.289079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255043521095127:5721]
2025-10-01T14:08:45.289768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:45.290205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:45.290260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:45.290624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:45.290699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.290706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.290707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.290708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.290709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.290711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.290712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.290713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.290715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.290716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.290717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.290718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.290720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.290721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.290727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.290738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.290742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.290747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.290751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.290755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.290758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.290761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.290765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.290769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.290772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.290776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.290779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.290783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.290793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.290801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.290807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.290812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.290817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.290823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.290828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.290834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.290839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.290844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.290848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.290854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.290859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.290872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.290877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.290888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.290893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.290898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.290907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.290912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.290920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.290929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.290934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.290940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.290948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.290953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.290958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.290968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.291008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:45.295680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:45.296515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:45.296522Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:45.296527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:45.296532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:45.296546Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 613 [2:7556255043521095127:5721]
2025-10-01T14:08:45.296571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:45.296593Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:45.296596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.296600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.296603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.296620Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:45.296625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:45.296633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:45.296705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.296708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.296710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.296714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:45.296718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:45.296815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:45.296818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.296831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.296840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.296855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:45.296874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255043521095122:5721]
2025-10-01T14:08:45.296877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255043521095122:5721]
2025-10-01T14:08:45.296879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255043521095122:5721]
2025-10-01T14:08:45.296898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:45.296912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:45.296926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:45.296930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:45.296971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255043521095122:5721]
2025-10-01T14:08:45.296974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:45.297224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:45.297232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:45.297234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:45.297242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:45.297573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959166:6431], now have 1 active actors on pipe
2025-10-01T14:08:45.297582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897958986:2446], now have 1 active actors on pipe
2025-10-01T14:08:45.297606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 613
2025-10-01T14:08:45.297636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 613
2025-10-01T14:08:45.297806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.297815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.297848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:45.297858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.297865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.297869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:45.297879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.297892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:45.297909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.298179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.298186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.298205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.298326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 614 partition: 0 MaxSeqNo: 45 sessionId: src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0
2025-10-01T14:08:45.298794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81267400-6175064e-dabb88ef-ea17b274_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:45.301299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0] Write session: try to update token
2025-10-01T14:08:45.301321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:45.318581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 614 sessionId: src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:45.320232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:45.320253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:45.320256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:45.320258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:45.320268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255043521095122:5721]
2025-10-01T14:08:45.320271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255043521095122:5721]
2025-10-01T14:08:45.320276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255043521095122:5721]
2025-10-01T14:08:45.320325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:45.320330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:45.320337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:45.320337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.320340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:45.320341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:45.320478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:45.321058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:45.362564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255045897959184:6355]
2025-10-01T14:08:45.367104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 613, pipe: [1:7556255045897959184:6355]
2025-10-01T14:08:45.476690Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:45.477277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.477287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.477335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959184:6355], now have 1 active actors on pipe
2025-10-01T14:08:45.478282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:45.478308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:45.478421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 614 reason: error at write: Disconnected sessionId: src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0
2025-10-01T14:08:45.478481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:45.478540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255045897959184:6355]
2025-10-01T14:08:45.478050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:45.478649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 614 sessionId: src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0 is DEAD
2025-10-01T14:08:45.479212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:45.479220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0] Write session will restart in 0.007665s
2025-10-01T14:08:45.479252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0] Write session: Do CDS request
2025-10-01T14:08:45.479259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:45.487991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.488216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:45.488235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 615
2025-10-01T14:08:45.488390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.488439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:45.488444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:45.488448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:45.489063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 615 sessionId:  describe result for acl check
2025-10-01T14:08:45.489102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:45.489103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:45.489105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:45.489110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255045897959212:6436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:45.489522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255045897959212:6436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:45.496549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255045897959212:6436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:45.508311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:45.507493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255045897959212:6436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:45.507514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255045897959212:6436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:45.507517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255045897959212:6436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:45.507526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:45.511128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:45.511371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:45.511381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:45.511394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:45.511443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:45.511486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255043521095360:5731]
2025-10-01T14:08:45.512062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:45.512415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:45.512458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:45.512755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:45.512827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.512828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.512830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.512830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.512832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.512833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.512835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.512836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.512837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.512838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.512839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.512840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.512841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.512843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.512848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.512858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.512862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.512866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.512870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.512874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.512877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.512881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.512885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.512889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.512892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.512896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.512900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.512903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.512910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.512918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.512924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.512929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.512934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.512939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.512942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.512947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.512952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.512957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.512961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.512965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.512970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.512975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.512979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.512985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.512989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.512993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.512998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.513003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.513007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.513012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.513015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.513021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.513029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.513034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.513038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.513043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.513083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:45.519911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:45.520595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:45.520601Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:45.520605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:45.520608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:45.520615Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 614 [2:7556255043521095360:5731]
2025-10-01T14:08:45.520633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:45.520654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:45.520658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.520662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.520664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.520681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:45.520686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:45.520692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:45.521825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 614
2025-10-01T14:08:45.521857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 614
2025-10-01T14:08:45.520752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.520765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.520767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.520770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:45.520772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:45.520861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:45.520864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.520877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.520888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.520906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:45.520923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255043521095354:5731]
2025-10-01T14:08:45.520926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255043521095354:5731]
2025-10-01T14:08:45.520928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255043521095354:5731]
2025-10-01T14:08:45.520941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:45.520956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:45.520971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:45.520974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:45.521015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255043521095354:5731]
2025-10-01T14:08:45.521018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:45.521102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:45.521105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:45.521107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:45.521111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:45.521739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959198:2446], now have 1 active actors on pipe
2025-10-01T14:08:45.521744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959383:6436], now have 1 active actors on pipe
2025-10-01T14:08:45.522691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.522705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.522749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3268245c-ad0af0df-8037aece-582766b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:45.522762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.522768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.522772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:45.522786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.522804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:45.522825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.523134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.523138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.523175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.523325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 615 partition: 0 MaxSeqNo: 45 sessionId: src_id|3268245c-ad0af0df-8037aece-582766b9_0
2025-10-01T14:08:45.523795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1663c129-f4f5d675-d8f904a9-6afa8c3f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3268245c-ad0af0df-8037aece-582766b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:45.527062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3268245c-ad0af0df-8037aece-582766b9_0] Write session: try to update token
2025-10-01T14:08:45.527087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3268245c-ad0af0df-8037aece-582766b9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:45.550664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:45.550682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:45.550685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:45.550687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:45.550697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255043521095354:5731]
2025-10-01T14:08:45.550702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255043521095354:5731]
2025-10-01T14:08:45.550706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255043521095354:5731]
2025-10-01T14:08:45.550760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:45.550769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.550771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:45.550923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:45.551523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:45.551532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:45.551535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:45.558749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 615 sessionId: src_id|3268245c-ad0af0df-8037aece-582766b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:45.561730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:45.576743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255045897959396:6355]
2025-10-01T14:08:45.577140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 614, pipe: [1:7556255045897959396:6355]
2025-10-01T14:08:45.714767Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:45.715419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.715435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.715457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959396:6355], now have 1 active actors on pipe
2025-10-01T14:08:45.715687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:45.716569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3268245c-ad0af0df-8037aece-582766b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:45.716583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3268245c-ad0af0df-8037aece-582766b9_0] Write session will restart in 0.009896s
2025-10-01T14:08:45.716621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3268245c-ad0af0df-8037aece-582766b9_0] Write session: Do CDS request
2025-10-01T14:08:45.716628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3268245c-ad0af0df-8037aece-582766b9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:45.715733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:45.715735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:45.715739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:45.715797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255045897959396:6355]
2025-10-01T14:08:45.715799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 615 reason: error at write: Disconnected sessionId: src_id|3268245c-ad0af0df-8037aece-582766b9_0
2025-10-01T14:08:45.716026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 615 sessionId: src_id|3268245c-ad0af0df-8037aece-582766b9_0 is DEAD
2025-10-01T14:08:45.728022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3268245c-ad0af0df-8037aece-582766b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.728089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:45.728107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 616
2025-10-01T14:08:45.728324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.728386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:45.728397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:45.728402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:45.728894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 616 sessionId:  describe result for acl check
2025-10-01T14:08:45.728941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:45.728949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:45.728950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:45.728958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255045897959456:6441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:45.729495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255045897959456:6441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:45.733067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255045897959456:6441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:45.735933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255045897959456:6441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:45.735956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255045897959456:6441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:45.735959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255045897959456:6441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:45.735969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:45.736420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:45.739728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:45.739987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:45.740000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:45.740013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:45.740076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:45.740132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255043521095559:5738]
2025-10-01T14:08:45.740836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:45.741238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:45.741309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:45.741664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:45.741734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.741736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.741737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.741739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.741740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.741741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.741742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.741744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.741746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.741747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.741748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.741749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.741750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.741752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.741757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.741769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.741773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.741778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.741781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.741785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.741789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.741792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.741796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.741802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.741805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.741809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.741813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.741817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.741825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.741834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.741841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.741848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.741856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.741863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.741869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.741875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.741881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.741887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.741892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.741898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.741905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.741911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.741915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.741919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.741925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.741931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.741936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.741942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.741947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.741953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.741958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.741964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.741968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.741973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.741978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.741982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.742024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:45.749754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 615
2025-10-01T14:08:45.749862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 615
2025-10-01T14:08:45.748113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:45.749103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:45.749109Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:45.749112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:45.749117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:45.749125Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 615 [2:7556255043521095559:5738]
2025-10-01T14:08:45.749146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:45.749167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:45.749171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.749175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.749177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.749193Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:45.749200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:45.749208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:45.749282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.749285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.749288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.749291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:45.749294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:45.749373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:45.749376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.749391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.749404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.749422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:45.749444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959593:6441], now have 1 active actors on pipe
2025-10-01T14:08:45.749448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959406:2446], now have 1 active actors on pipe
2025-10-01T14:08:45.749455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255043521095554:5738]
2025-10-01T14:08:45.749458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255043521095554:5738]
2025-10-01T14:08:45.749463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255043521095554:5738]
2025-10-01T14:08:45.749480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:45.749494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:45.749495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:45.749499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:45.749502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:45.749510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:45.749514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:45.749556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255043521095554:5738]
2025-10-01T14:08:45.749565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:45.749583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:45.749986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.749990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.750020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:45.750026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.750030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.750033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:45.750044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.750056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:45.750071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.750511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.750516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.750532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.750760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 616 partition: 0 MaxSeqNo: 45 sessionId: src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0
2025-10-01T14:08:45.751154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3268245c-ad0af0df-8037aece-582766b9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:45.754161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0] Write session: try to update token
2025-10-01T14:08:45.754177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:45.762205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:45.762231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:45.762241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255043521095554:5738]
2025-10-01T14:08:45.762290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:45.762339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:45.762488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:45.762631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:45.762766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:45.762902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:45.763112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:45.763145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:45.778064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 616 sessionId: src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:45.781398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:45.782550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.782574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.782597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:45.782600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:45.782603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:45.782605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:45.782615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255043521095554:5738]
2025-10-01T14:08:45.782619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255043521095554:5738]
2025-10-01T14:08:45.782623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255043521095554:5738]
2025-10-01T14:08:45.782678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:45.782684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:45.782684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:45.782688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:45.782692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.782694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:45.782852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:45.816099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255045897959606:6355]
2025-10-01T14:08:45.816760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 615, pipe: [1:7556255045897959606:6355]
2025-10-01T14:08:45.948103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:45.948475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:45.948513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959606:6355], now have 1 active actors on pipe
2025-10-01T14:08:45.950240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:45.951237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:45.951248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0] Write session will restart in 0.005178s
2025-10-01T14:08:45.951274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0] Write session: Do CDS request
2025-10-01T14:08:45.951281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:45.950485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:45.950501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:45.950583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 616 reason: error at write: Disconnected sessionId: src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0
2025-10-01T14:08:45.950783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 616 sessionId: src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0 is DEAD
2025-10-01T14:08:45.950955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255045897959606:6355]
2025-10-01T14:08:45.950971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:45.958908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.959287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:45.959302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 617
2025-10-01T14:08:45.959484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:45.959523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:45.959530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:45.959533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:45.960238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 617 sessionId:  describe result for acl check
2025-10-01T14:08:45.960272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:45.960274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:45.960276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:45.960281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255045897959625:6445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:45.960978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255045897959625:6445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:45.967586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255045897959625:6445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:45.972895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255045897959625:6445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:45.972914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255045897959625:6445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:45.972920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255045897959625:6445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:45.972929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:45.975013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:45.979716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:45.979978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:45.979982Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:45.979995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:45.980046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:45.980085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255043521095754:5740]
2025-10-01T14:08:45.980698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:45.981201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:45.981244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:45.981563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:45.981624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.981625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.981626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.981627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.981629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.981630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.981632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.981633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.981634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.981635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.981636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.981637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.981638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.981639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.981644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.981654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.981657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.981661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.981664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.981667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.981670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.981673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.981677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.981681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.981684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.981686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.981690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.981693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.981700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.981708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:45.981714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.981720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:45.981724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.981730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:45.981734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.981738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:45.981743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.981748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:45.981752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.981757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:45.981762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.981766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:45.981769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.981774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:45.981778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.981782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:45.981785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.981790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.981795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.981800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.981804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.981808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.981812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.981817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:45.981821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.981825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:45.981860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:45.987153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:45.987799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:45.987815Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:45.987818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:45.987822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:45.987830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 616 [2:7556255043521095754:5740]
2025-10-01T14:08:45.987849Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:45.987870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:45.987874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.987879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.987882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.987902Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:45.987907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:45.987915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:45.988000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.988003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.988005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.988009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:45.988012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:45.988202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:45.988205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:45.988219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:45.988231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:45.988251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:45.988268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255043521095749:5740]
2025-10-01T14:08:45.988270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255043521095749:5740]
2025-10-01T14:08:45.988273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255043521095749:5740]
2025-10-01T14:08:45.988294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:45.988309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:45.988324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:45.988327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:45.988337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:45.988341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:45.988344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:45.988367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255043521095749:5740]
2025-10-01T14:08:45.988370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:45.988436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:45.988713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959611:2446], now have 1 active actors on pipe
2025-10-01T14:08:45.989089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 616
2025-10-01T14:08:45.988725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255045897959795:6445], now have 1 active actors on pipe
2025-10-01T14:08:45.989293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.989134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 616
2025-10-01T14:08:45.989300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.989332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:45.989341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:45.989347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:45.989350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:45.989360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:45.989374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:45.989396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.989654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:45.989660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:45.989675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:45.989784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 617 partition: 0 MaxSeqNo: 45 sessionId: src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0
2025-10-01T14:08:45.990158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4b177b5-e8749f87-5ac8b0b8-665c73b3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:45.996367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0] Write session: try to update token
2025-10-01T14:08:45.996390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:46.014470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:46.014487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:46.014490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:46.014491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:46.014501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255043521095749:5740]
2025-10-01T14:08:46.014508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255043521095749:5740]
2025-10-01T14:08:46.014511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255043521095749:5740]
2025-10-01T14:08:46.014563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:46.014571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.014573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:46.014728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:46.015220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:46.015226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:46.015235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:46.014324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 617 sessionId: src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:46.016848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:46.051663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255050192927105:6355]
2025-10-01T14:08:46.051942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 616, pipe: [1:7556255050192927105:6355]
2025-10-01T14:08:46.171831Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:46.172403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.172420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.172465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927105:6355], now have 1 active actors on pipe
2025-10-01T14:08:46.173471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:46.173265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255050192927105:6355]
2025-10-01T14:08:46.173308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:46.173351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:46.173354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:46.173417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 617 reason: error at write: Disconnected sessionId: src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0
2025-10-01T14:08:46.173663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 617 sessionId: src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0 is DEAD
2025-10-01T14:08:46.174063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:46.174072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0] Write session will restart in 0.005722s
2025-10-01T14:08:46.174101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0] Write session: Do CDS request
2025-10-01T14:08:46.174108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:46.182838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:46.188489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:46.188508Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 618
2025-10-01T14:08:46.190459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:46.190521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:46.190527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:46.190531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:46.191698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 618 sessionId:  describe result for acl check
2025-10-01T14:08:46.191739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:46.191741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:46.191743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:46.191749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255050192927208:6449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:46.192338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255050192927208:6449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:46.198689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255050192927208:6449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:46.204089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255050192927208:6449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:46.204111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255050192927208:6449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:46.204114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255050192927208:6449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:46.204123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:46.207777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:46.212139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:46.212460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:46.212465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:46.212479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:46.212545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:46.212582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255047816063244:5742]
2025-10-01T14:08:46.213170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:46.213660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:46.213717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:46.214044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:46.214134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.214135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.214136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.214137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.214139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.214140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.214141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.214142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.214144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.214145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.214146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.214147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.214148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.214149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.214155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.214164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.214168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.214172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.214175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.214179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.214182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.214185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.214189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.214192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.214196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.214198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.214201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.214205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.214212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.214220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.214227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.214232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.214236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.214241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.214245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.214249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.214253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.214258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.214262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.214266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.214270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.214274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.214278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.214283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.214287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.214292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.214296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.214302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.214305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.214310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.214314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.214318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.214322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.214326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.214330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.214335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.214387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:46.219676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:46.220267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:46.220271Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:46.220273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:46.220276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:46.220283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 617 [2:7556255047816063244:5742]
2025-10-01T14:08:46.220296Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:46.220312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:46.220314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:46.220316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:46.220318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:46.220330Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:46.220334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:46.220338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:46.220388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.220389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.220390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.220393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:46.220394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:46.220454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:46.220455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.220463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.220468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.220478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:46.220490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255047816063237:5742]
2025-10-01T14:08:46.220492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255047816063237:5742]
2025-10-01T14:08:46.220493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255047816063237:5742]
2025-10-01T14:08:46.220504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:46.220514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:46.220523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:46.220525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:46.220557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255047816063237:5742]
2025-10-01T14:08:46.220559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:46.220751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:46.220754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:46.220756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:46.220761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:46.221113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927309:6449], now have 1 active actors on pipe
2025-10-01T14:08:46.221123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927108:2446], now have 1 active actors on pipe
2025-10-01T14:08:46.221621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 617
2025-10-01T14:08:46.221649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 617
2025-10-01T14:08:46.222420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.222445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.222478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:46.222490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:46.222497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:46.222500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:46.222511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:46.222525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:46.222546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:46.224670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.224685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.224719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:46.224854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 618 partition: 0 MaxSeqNo: 45 sessionId: src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0
2025-10-01T14:08:46.225259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eea8d5ab-242c6cc6-1257e3cb-c5fa52ff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:46.227734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0] Write session: try to update token
2025-10-01T14:08:46.227750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:46.245044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 618 sessionId: src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:46.247827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:46.246503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:46.246517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:46.246520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:46.246522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:46.246531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255047816063237:5742]
2025-10-01T14:08:46.246536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255047816063237:5742]
2025-10-01T14:08:46.246539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255047816063237:5742]
2025-10-01T14:08:46.246589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:46.246596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.246598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:46.246615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:46.246623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:46.246627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:46.246745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:46.273380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255050192927338:6355]
2025-10-01T14:08:46.274906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 617, pipe: [1:7556255050192927338:6355]
2025-10-01T14:08:46.404468Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:46.404905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.404918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.404962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927338:6355], now have 1 active actors on pipe
2025-10-01T14:08:46.407589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255050192927338:6355]
2025-10-01T14:08:46.407625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:46.407690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 618 reason: status is not ok: tablet will be restarted right now sessionId: src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0
2025-10-01T14:08:46.406815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:46.407893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 618 sessionId: src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0 is DEAD
2025-10-01T14:08:46.408028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:46.408036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0] Write session will restart in 0.008376s
2025-10-01T14:08:46.408023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:46.408055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0] Write session: Do CDS request
2025-10-01T14:08:46.408060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:46.417817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:46.418133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:46.418156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 619
2025-10-01T14:08:46.418313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:46.418348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:46.418359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:46.418365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:46.418768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 619 sessionId:  describe result for acl check
2025-10-01T14:08:46.418799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:46.418801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:46.418803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:46.418808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255050192927370:6462] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:46.419332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255050192927370:6462] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:46.433905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:46.439316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255050192927370:6462] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:46.438641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:46.438906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:46.438911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:46.438924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:46.438981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:46.439019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255047816063460:5748]
2025-10-01T14:08:46.439651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:46.439952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:46.439993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:46.440285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:46.440332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.440333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.440334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.440335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.440336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.440337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.440338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.440339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.440340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.440341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.440342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.440343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.440344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.440345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.440350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.440358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.440362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.440366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.440369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.440372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.440376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.440379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.440382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.440386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.440390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.440393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.440397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.440400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.440407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.440413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.440420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.440424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.440429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.440433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.440438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.440442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.440447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.440452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.440455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.440460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.440465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.440469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.440473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.440479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.440483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.440487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.440491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.440496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.440500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.440505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.440509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.440515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.440519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.440524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.440528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.440532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.440569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:46.443470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255050192927370:6462] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:46.443488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255050192927370:6462] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:46.443491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255050192927370:6462] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:46.443501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:46.446670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:46.447435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:46.447447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:46.447450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:46.447453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:46.447460Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 618 [2:7556255047816063460:5748]
2025-10-01T14:08:46.447480Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:46.447499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:46.447502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:46.447506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:46.447508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:46.447527Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:46.447539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:46.447545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:46.447616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.447623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.447626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.447629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:46.447632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:46.447711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:46.447722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.447733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.447745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.447760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:46.447779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927356:2446], now have 1 active actors on pipe
2025-10-01T14:08:46.447788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927550:6462], now have 1 active actors on pipe
2025-10-01T14:08:46.447796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255047816063455:5748]
2025-10-01T14:08:46.447798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255047816063455:5748]
2025-10-01T14:08:46.447800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255047816063455:5748]
2025-10-01T14:08:46.447812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:46.447826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:46.447830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:46.447834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:46.447836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:46.447844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:46.447847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:46.447814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 618
2025-10-01T14:08:46.447863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 618
2025-10-01T14:08:46.447883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255047816063455:5748]
2025-10-01T14:08:46.447890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:46.447893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:46.448060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.448070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.448093Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|520ec1d9-e722d40f-6dc4992-41f98497_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:46.448103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:46.448107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:46.448110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:46.448120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:46.448132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:46.448148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:46.448342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.448353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.448378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:46.448509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 619 partition: 0 MaxSeqNo: 45 sessionId: src_id|520ec1d9-e722d40f-6dc4992-41f98497_0
2025-10-01T14:08:46.449361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efa888f5-145f8d1d-a396e2bb-1fb2c7e6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|520ec1d9-e722d40f-6dc4992-41f98497_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:46.451957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|520ec1d9-e722d40f-6dc4992-41f98497_0] Write session: try to update token
2025-10-01T14:08:46.451978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|520ec1d9-e722d40f-6dc4992-41f98497_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:46.481152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:46.481170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:46.481173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:46.481175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:46.481185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255047816063455:5748]
2025-10-01T14:08:46.481189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255047816063455:5748]
2025-10-01T14:08:46.481193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255047816063455:5748]
2025-10-01T14:08:46.481246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:46.481252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.481255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:46.481393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:46.479508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 619 sessionId: src_id|520ec1d9-e722d40f-6dc4992-41f98497_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:46.482011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:46.481766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:46.481777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:46.481782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:46.507570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255050192927559:6355]
2025-10-01T14:08:46.508296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 618, pipe: [1:7556255050192927559:6355]
2025-10-01T14:08:46.640370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:46.640929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.640946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.640992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927559:6355], now have 1 active actors on pipe
2025-10-01T14:08:46.641206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:46.642060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255050192927559:6355]
2025-10-01T14:08:46.642101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:46.642172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:46.642174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 619 reason: status is not ok: tablet will be restarted right now sessionId: src_id|520ec1d9-e722d40f-6dc4992-41f98497_0
2025-10-01T14:08:46.642353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 619 sessionId: src_id|520ec1d9-e722d40f-6dc4992-41f98497_0 is DEAD
2025-10-01T14:08:46.642652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520ec1d9-e722d40f-6dc4992-41f98497_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:46.642663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520ec1d9-e722d40f-6dc4992-41f98497_0] Write session will restart in 0.009344s
2025-10-01T14:08:46.642692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520ec1d9-e722d40f-6dc4992-41f98497_0] Write session: Do CDS request
2025-10-01T14:08:46.642698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520ec1d9-e722d40f-6dc4992-41f98497_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:46.652934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|520ec1d9-e722d40f-6dc4992-41f98497_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:46.653565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:46.653587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 620
2025-10-01T14:08:46.653708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:46.653753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:46.653763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:46.653767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:46.654134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 620 sessionId:  describe result for acl check
2025-10-01T14:08:46.654176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:46.654183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:46.654184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:46.654189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255050192927576:6467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:46.654737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255050192927576:6467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:46.656914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255050192927576:6467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:46.661549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255050192927576:6467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:46.661566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255050192927576:6467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:46.661569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255050192927576:6467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:46.661578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:46.666656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:46.668982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:46.669147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:46.669155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:46.669162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:46.669194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:46.669222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255047816063688:5760]
2025-10-01T14:08:46.669617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:46.669826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:46.669856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:46.670049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:46.670082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.670086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.670087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.670087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.670088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.670089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.670090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.670090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.670091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.670092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.670092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.670093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.670094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.670094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.670097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.670103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.670105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.670108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.670110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.670112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.670114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.670116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.670118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.670120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.670122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.670124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.670126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.670128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.670133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.670138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.670142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.670145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.670150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.670153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.670155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.670158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.670160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.670163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.670165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.670168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.670171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.670174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.670176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.670179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.670181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.670184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.670186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.670189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.670192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.670195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.670197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.670200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.670203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.670205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.670208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.670210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.670230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:46.674193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:46.674871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:46.674886Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:46.674888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:46.674892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:46.674898Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 619 [2:7556255047816063688:5760]
2025-10-01T14:08:46.674914Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:46.674933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:46.674938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:46.674940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:46.674942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:46.674954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:46.674957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:46.674962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:46.675004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.675009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.675010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.675013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:46.675015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:46.675072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:46.675079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.675088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.675101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.675119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:46.675136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927661:6467], now have 1 active actors on pipe
2025-10-01T14:08:46.675143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927562:2446], now have 1 active actors on pipe
2025-10-01T14:08:46.675150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255047816063683:5760]
2025-10-01T14:08:46.675157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255047816063683:5760]
2025-10-01T14:08:46.675159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255047816063683:5760]
2025-10-01T14:08:46.675173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:46.675185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:46.675188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:46.675194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:46.675196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:46.675200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:46.675203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:46.675233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255047816063683:5760]
2025-10-01T14:08:46.675243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:46.675250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:46.675351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 619
2025-10-01T14:08:46.675390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 619
2025-10-01T14:08:46.675434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.675442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.675466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32a95573-db814cef-d81d6eaf-1c427de4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:46.675476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:46.675480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:46.675486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:46.675497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:46.675509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:46.675526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:46.675716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.675726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.675742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:46.675850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 620 partition: 0 MaxSeqNo: 45 sessionId: src_id|32a95573-db814cef-d81d6eaf-1c427de4_0
2025-10-01T14:08:46.676214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|520ec1d9-e722d40f-6dc4992-41f98497_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|32a95573-db814cef-d81d6eaf-1c427de4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:46.678593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a95573-db814cef-d81d6eaf-1c427de4_0] Write session: try to update token
2025-10-01T14:08:46.678611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a95573-db814cef-d81d6eaf-1c427de4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:46.692485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 620 sessionId: src_id|32a95573-db814cef-d81d6eaf-1c427de4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:46.694962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:46.696835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.696859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.696885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:46.696889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:46.696893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:46.696895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:46.696905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255047816063683:5760]
2025-10-01T14:08:46.696910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255047816063683:5760]
2025-10-01T14:08:46.696915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255047816063683:5760]
2025-10-01T14:08:46.696959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:46.696965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:46.696968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:46.696973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:46.696980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.696983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:46.697119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:46.742049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255050192927767:6355]
2025-10-01T14:08:46.742289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 619, pipe: [1:7556255050192927767:6355]
2025-10-01T14:08:46.845769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:46.846272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:46.846338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927767:6355], now have 1 active actors on pipe
2025-10-01T14:08:46.846560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:46.846625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255050192927767:6355]
2025-10-01T14:08:46.846823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:46.846911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:46.846919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:46.847010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 620 reason: error at write: Disconnected sessionId: src_id|32a95573-db814cef-d81d6eaf-1c427de4_0
2025-10-01T14:08:46.847175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 620 sessionId: src_id|32a95573-db814cef-d81d6eaf-1c427de4_0 is DEAD
2025-10-01T14:08:46.847311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a95573-db814cef-d81d6eaf-1c427de4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:46.847321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a95573-db814cef-d81d6eaf-1c427de4_0] Write session will restart in 0.008929s
2025-10-01T14:08:46.847348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a95573-db814cef-d81d6eaf-1c427de4_0] Write session: Do CDS request
2025-10-01T14:08:46.847356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a95573-db814cef-d81d6eaf-1c427de4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:46.857923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a95573-db814cef-d81d6eaf-1c427de4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:46.857996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:46.858013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 621
2025-10-01T14:08:46.858148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:46.858193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:46.858206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:46.858214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:46.858612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 621 sessionId:  describe result for acl check
2025-10-01T14:08:46.858655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:46.858661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:46.858662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:46.858668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255050192927884:6471] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:46.859170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255050192927884:6471] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:46.861762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:46.861963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255050192927884:6471] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:46.863939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:46.864148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:46.864159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:46.864172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:46.864217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:46.864255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255047816063887:5763]
2025-10-01T14:08:46.864511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255050192927884:6471] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:46.864526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255050192927884:6471] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:46.864529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255050192927884:6471] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:46.864545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:46.864705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:46.864937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:46.864979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:46.865223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:46.865275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.865280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.865282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.865283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.865284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.865285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.865287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.865288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.865289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.865290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.865291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.865292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.865293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.865294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.865299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.865308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.865313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.865317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.865321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.865325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.865329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.865333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.865336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.865340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.865344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.865347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.865351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.865354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.865362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.865369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:46.865376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.865381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:46.865385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.865391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:46.865395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.865400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:46.865405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.865410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:46.865414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.865425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:46.865431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.865436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:46.865448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.865453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:46.865457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.865462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:46.865466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.865471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.865475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.865480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.865484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.865489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.865494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.865499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:46.865503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.865508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:46.865536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:46.869383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:46.870078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:46.870092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:46.870094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:46.870097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:46.870103Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 620 [2:7556255047816063887:5763]
2025-10-01T14:08:46.870115Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:46.870129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:46.870135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:46.870139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:46.870141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:46.870159Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:46.870170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:46.870174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:46.870441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.870448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.870449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.870452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:46.870454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:46.870511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:46.870516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.870525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:46.870531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:46.870544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:46.870561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255047816063882:5763]
2025-10-01T14:08:46.870563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255047816063882:5763]
2025-10-01T14:08:46.870564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255047816063882:5763]
2025-10-01T14:08:46.870570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:46.870579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:46.870582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927962:6471], now have 1 active actors on pipe
2025-10-01T14:08:46.870587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927770:2446], now have 1 active actors on pipe
2025-10-01T14:08:46.870591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:46.870594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:46.870596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:46.870600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:46.870602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:46.870632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255047816063882:5763]
2025-10-01T14:08:46.870641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:46.870655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:46.870749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.870760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.870785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66724909-4555720-3479f9da-88add27f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:46.870795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:46.870799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:46.870800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:46.870807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:46.870815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:46.870827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:46.871017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:46.871025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:46.871042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:46.871519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a95573-db814cef-d81d6eaf-1c427de4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|66724909-4555720-3479f9da-88add27f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:46.874143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66724909-4555720-3479f9da-88add27f_0] Write session: try to update token
2025-10-01T14:08:46.874163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66724909-4555720-3479f9da-88add27f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:46.870676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 620
2025-10-01T14:08:46.870676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 620
2025-10-01T14:08:46.871137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 621 partition: 0 MaxSeqNo: 45 sessionId: src_id|66724909-4555720-3479f9da-88add27f_0
2025-10-01T14:08:46.889945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 621 sessionId: src_id|66724909-4555720-3479f9da-88add27f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:46.892389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:46.892398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:46.892410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:46.892413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:46.892416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:46.892426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255047816063882:5763]
2025-10-01T14:08:46.892431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255047816063882:5763]
2025-10-01T14:08:46.892435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255047816063882:5763]
2025-10-01T14:08:46.892485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:46.892486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:46.892493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:46.892495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:46.892497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:46.892505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:46.892612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:46.947022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255050192927973:6355]
2025-10-01T14:08:46.947471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 620, pipe: [1:7556255050192927973:6355]
2025-10-01T14:08:47.047044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:47.047322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.047340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.047385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255050192927973:6355], now have 1 active actors on pipe
2025-10-01T14:08:47.047615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:47.047605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:47.047612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:47.047625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:47.047667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255050192927973:6355]
2025-10-01T14:08:47.047685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 621 reason: error at write: Disconnected sessionId: src_id|66724909-4555720-3479f9da-88add27f_0
2025-10-01T14:08:47.047882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 621 sessionId: src_id|66724909-4555720-3479f9da-88add27f_0 is DEAD
2025-10-01T14:08:47.047977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66724909-4555720-3479f9da-88add27f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:47.047986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66724909-4555720-3479f9da-88add27f_0] Write session will restart in 0.006089s
2025-10-01T14:08:47.048012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66724909-4555720-3479f9da-88add27f_0] Write session: Do CDS request
2025-10-01T14:08:47.048018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66724909-4555720-3479f9da-88add27f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:47.054871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66724909-4555720-3479f9da-88add27f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:47.055560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:47.055576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 622
2025-10-01T14:08:47.055753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:47.055798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:47.055815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:47.055819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:47.056209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 622 sessionId:  describe result for acl check
2025-10-01T14:08:47.056246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:47.056248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:47.056250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:47.056254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255054487895290:6477] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:47.056748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255054487895290:6477] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:47.059757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255054487895290:6477] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:47.063658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:47.064014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255054487895290:6477] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:47.064029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255054487895290:6477] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:47.064032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255054487895290:6477] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:47.064041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:47.066238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:47.066505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:47.066517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:47.066530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:47.066597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:47.066637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255052111031382:5765]
2025-10-01T14:08:47.067207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:47.067528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:47.067589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:47.067885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:47.067974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.067978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.067979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.067980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.067980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.067981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.067981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.067982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.067982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.067983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.067983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.067984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.067985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.067985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.067996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.068002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.068004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.068006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.068009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.068011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.068013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.068015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.068017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.068020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.068021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.068024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.068027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.068031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.068038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.068046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.068052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.068059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.068063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.068068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.068072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.068077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.068082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.068087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.068090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.068093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.068095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.068098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.068100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.068103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.068106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.068108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.068111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.068113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.068116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.068119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.068121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.068124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.068126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.068129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.068131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.068135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.068155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:47.072758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:47.073415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:47.073429Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:47.073432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:47.073436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:47.073443Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 621 [2:7556255052111031382:5765]
2025-10-01T14:08:47.073459Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:47.073479Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:47.073489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:47.073493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:47.073496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:47.073513Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:47.073522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:47.073529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:47.073596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.073604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.073606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.073610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:47.073612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:47.073681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:47.073688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.073700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.073713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.073731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:47.073749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895276:2446], now have 1 active actors on pipe
2025-10-01T14:08:47.073756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895470:6477], now have 1 active actors on pipe
2025-10-01T14:08:47.073764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255052111031376:5765]
2025-10-01T14:08:47.073770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255052111031376:5765]
2025-10-01T14:08:47.073772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255052111031376:5765]
2025-10-01T14:08:47.073784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:47.073802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:47.073818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:47.073820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:47.073825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:47.073827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:47.073830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:47.073863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255052111031376:5765]
2025-10-01T14:08:47.073871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:47.073873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:47.073905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.073914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.073820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 621
2025-10-01T14:08:47.073829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 621
2025-10-01T14:08:47.073947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:47.073960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:47.073964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:47.073967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:47.073975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:47.073985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:47.074003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:47.074176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.074186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.074203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:47.074302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 622 partition: 0 MaxSeqNo: 45 sessionId: src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0
2025-10-01T14:08:47.074743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66724909-4555720-3479f9da-88add27f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:47.077312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0] Write session: try to update token
2025-10-01T14:08:47.077330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:47.095065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 622 sessionId: src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:47.095924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:47.095947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:47.095949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:47.095951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:47.095961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255052111031376:5765]
2025-10-01T14:08:47.095965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255052111031376:5765]
2025-10-01T14:08:47.095968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255052111031376:5765]
2025-10-01T14:08:47.096010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:47.096014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:47.096022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:47.096022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.096024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:47.096026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:47.096159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:47.097537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:47.147573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255054487895482:6355]
2025-10-01T14:08:47.148485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 621, pipe: [1:7556255054487895482:6355]
2025-10-01T14:08:47.264789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255054487895482:6355]
2025-10-01T14:08:47.264831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:47.264898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 622 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0
2025-10-01T14:08:47.265259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:47.265268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0] Write session will restart in 0.008585s
2025-10-01T14:08:47.265294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0] Write session: Do CDS request
2025-10-01T14:08:47.265301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:47.265097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 622 sessionId: src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0 is DEAD
2025-10-01T14:08:47.265250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:47.263014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:47.263507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.263518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.263570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895482:6355], now have 1 active actors on pipe
2025-10-01T14:08:47.263818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:47.275163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:47.278251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:47.278270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 623
2025-10-01T14:08:47.278447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:47.278480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:47.278485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:47.278489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:47.278863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 623 sessionId:  describe result for acl check
2025-10-01T14:08:47.278906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:47.278908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:47.278912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:47.278918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255054487895519:6488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:47.279424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255054487895519:6488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:47.284651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255054487895519:6488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:47.289795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:47.289675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255054487895519:6488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:47.289697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255054487895519:6488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:47.289699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255054487895519:6488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:47.289719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:47.297609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:47.297902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:47.297912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:47.297926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:47.297988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:47.298049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255052111031583:5767]
2025-10-01T14:08:47.298675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:47.302430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:47.302508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:47.302879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:47.302958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.302966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.302967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.302968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.302970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.302971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.302972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.302973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.302975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.302976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.302977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.302978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.302979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.302980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.302987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.302996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.302999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.303004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.303007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.303011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.303015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.303018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.303022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.303027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.303031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.303034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.303038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.303042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.303049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.303057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.303064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.303069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.303075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.303081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.303086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.303091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.303095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.303100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.303104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.303109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.303113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.303118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.303122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.303127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.303130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.303135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.303139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.303144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.303148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.303153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.303157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.303161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.303166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.303170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.303174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.303179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.303214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:47.308792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:47.310130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 622
2025-10-01T14:08:47.310133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 622
2025-10-01T14:08:47.309749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:47.309763Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:47.309765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:47.309769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:47.309776Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 622 [2:7556255052111031583:5767]
2025-10-01T14:08:47.309791Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:47.309808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:47.309811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:47.309815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:47.309818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:47.309834Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:47.309839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:47.309844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:47.309901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.309903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.309905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.309908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:47.309911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:47.309984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:47.309986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.309999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.310009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.310022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:47.310039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895697:6488], now have 1 active actors on pipe
2025-10-01T14:08:47.310042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895504:2446], now have 1 active actors on pipe
2025-10-01T14:08:47.310050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255052111031575:5767]
2025-10-01T14:08:47.310052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255052111031575:5767]
2025-10-01T14:08:47.310054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255052111031575:5767]
2025-10-01T14:08:47.310066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:47.310078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:47.310090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:47.310093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:47.310130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255052111031575:5767]
2025-10-01T14:08:47.310132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:47.310173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:47.310176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:47.310178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:47.310184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:47.310458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.310472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.310508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:47.310517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:47.310522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:47.310524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:47.310533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:47.310544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:47.310559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:47.311170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.311180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.311199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:47.311400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 623 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0
2025-10-01T14:08:47.312456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4373c75-97a24c3c-1872745f-a3b1241a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:47.314872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0] Write session: try to update token
2025-10-01T14:08:47.314890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:47.332757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 623 sessionId: src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:47.335362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:47.336080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.336103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.336143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:47.337178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:47.340179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:47.340200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:47.340203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:47.340205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:47.340216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255052111031575:5767]
2025-10-01T14:08:47.340222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255052111031575:5767]
2025-10-01T14:08:47.340226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255052111031575:5767]
2025-10-01T14:08:47.340275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:47.340283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.340285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:47.340431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:47.342636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:47.342648Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:47.342653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:47.365191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255054487895723:6355]
2025-10-01T14:08:47.365646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 622, pipe: [1:7556255054487895723:6355]
2025-10-01T14:08:47.503817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:47.504208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895723:6355], now have 1 active actors on pipe
2025-10-01T14:08:47.512331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.512362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.512555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.512629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.512692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.512761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.512815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.512819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.512886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.512945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.513011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.513082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.513129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.513131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.513190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.513248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.513308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.513361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.513408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.513410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.513476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.513531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.513596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.513658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.513700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.513703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.513771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.513828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.513895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.513957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.514002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.514004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.514076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.514139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.514203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.514268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.514319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.514322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.514695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.514764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.514826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.514889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.515019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.515023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.515094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.515156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.515225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.515290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.515336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.515340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.515416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.515481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.515553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.515621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.515669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.515672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.515747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:47.515813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:47.515887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:47.515952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:47.515998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:47.516001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:47.517585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:47.517652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255054487895723:6355]
2025-10-01T14:08:47.517817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:47.517831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:47.517864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 623 reason: error at write: Disconnected sessionId: src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0
2025-10-01T14:08:47.518079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 623 sessionId: src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0 is DEAD
2025-10-01T14:08:47.518475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:47.518488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0] Write session will restart in 0.009332s
2025-10-01T14:08:47.518518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0] Write session: Do CDS request
2025-10-01T14:08:47.518526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:47.517860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:47.531667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:47.532791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:47.532818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 624
2025-10-01T14:08:47.533062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:47.533119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:47.533135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:47.533141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:47.534533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 624 sessionId:  describe result for acl check
2025-10-01T14:08:47.534573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:47.534574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:47.534575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:47.534581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255054487895749:6494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:47.535086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255054487895749:6494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:47.552708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255054487895749:6494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:47.558300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255054487895749:6494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:47.558316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255054487895749:6494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:47.558319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255054487895749:6494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:47.558328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:47.567095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:47.570082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:47.570479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:47.570491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:47.570506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:47.570579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:47.570617Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255052111031817:5773]
2025-10-01T14:08:47.571310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:47.571601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:47.571643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:47.571973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:47.572037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.572038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.572039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.572040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.572041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.572042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.572043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.572045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.572046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.572047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.572049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.572050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.572051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.572052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.572059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.572069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.572073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.572077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.572081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.572085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.572089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.572095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.572099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.572104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.572107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.572112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.572115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.572119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.572125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.572133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.572139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.572145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.572149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.572154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.572158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.572163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.572167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.572172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.572177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.572182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.572187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.572192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.572197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.572202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.572207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.572212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.572216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.572221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.572226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.572231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.572236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.572241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.572250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.572254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.572258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.572262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.572300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:47.578905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:47.580532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 623
2025-10-01T14:08:47.580591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 623
2025-10-01T14:08:47.579670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:47.579681Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:47.579684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:47.579688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:47.579695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 623 [2:7556255052111031817:5773]
2025-10-01T14:08:47.579714Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:47.579731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:47.579735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:47.579739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:47.579741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:47.579759Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:47.579764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:47.579771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:47.579833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.579837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.579839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.579842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:47.579846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:47.579921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:47.579923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.579936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.579948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.579965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:47.579984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895738:2446], now have 1 active actors on pipe
2025-10-01T14:08:47.579988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895894:6494], now have 1 active actors on pipe
2025-10-01T14:08:47.579997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255052111031811:5773]
2025-10-01T14:08:47.579999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255052111031811:5773]
2025-10-01T14:08:47.580001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255052111031811:5773]
2025-10-01T14:08:47.580019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:47.580033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:47.580049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:47.580052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:47.580091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255052111031811:5773]
2025-10-01T14:08:47.580093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:47.580204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:47.580207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:47.580208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:47.580212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:47.582293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.582303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.582338Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:47.582348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:47.582353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:47.582356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:47.582367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:47.582401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:47.582424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:47.582921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 624 partition: 0 MaxSeqNo: 45 sessionId: src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0
2025-10-01T14:08:47.583352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b766577-36ea28dc-5e460d0d-58b0ed5b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:47.585925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0] Write session: try to update token
2025-10-01T14:08:47.585948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:47.582775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.582784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.582801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:47.602667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:47.602693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:47.602696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:47.602699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:47.602712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255052111031811:5773]
2025-10-01T14:08:47.602718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255052111031811:5773]
2025-10-01T14:08:47.602721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255052111031811:5773]
2025-10-01T14:08:47.602778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:47.602793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.602795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:47.602938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:47.606290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:47.606305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:47.606308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:47.611701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 624 sessionId: src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:47.614321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:47.618123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255054487895945:6355]
2025-10-01T14:08:47.618606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 623, pipe: [1:7556255054487895945:6355]
2025-10-01T14:08:47.764817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:47.765265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.765278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.765304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895945:6355], now have 1 active actors on pipe
2025-10-01T14:08:47.765961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:47.766473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255054487895945:6355]
2025-10-01T14:08:47.766507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:47.766607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:47.766683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 624 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0
2025-10-01T14:08:47.766862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 624 sessionId: src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0 is DEAD
2025-10-01T14:08:47.767301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:47.767313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0] Write session will restart in 0.006763s
2025-10-01T14:08:47.767341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0] Write session: Do CDS request
2025-10-01T14:08:47.767348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:47.775069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:47.775135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:47.775153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 625
2025-10-01T14:08:47.775432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:47.775472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:47.775477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:47.775480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:47.775957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 625 sessionId:  describe result for acl check
2025-10-01T14:08:47.775986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:47.775988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:47.775990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:47.775996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255054487895963:6499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:47.776499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255054487895963:6499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:47.785273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255054487895963:6499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:47.791867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255054487895963:6499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:47.791888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255054487895963:6499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:47.791892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255054487895963:6499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:47.791906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:47.801907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:47.806967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:47.807438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:47.807445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:47.807465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:47.807558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:47.807597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255052111032038:5786]
2025-10-01T14:08:47.808183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:47.808713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:47.808768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:47.809125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:47.809187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.809188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.809189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.809191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.809192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.809193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.809194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.809196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.809197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.809198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.809199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.809200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.809202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.809203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.809210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.809220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.809224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.809228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.809232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.809236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.809240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.809243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.809247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.809251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.809255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.809259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.809262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.809266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.809274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.809282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:47.809289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.809294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:47.809300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.809304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:47.809309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.809314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:47.809320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.809324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:47.809329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.809346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:47.809351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.809356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:47.809360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.809365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:47.809370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.809376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:47.809380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.809385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.809390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.809395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.809401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.809406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.809411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.809416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:47.809420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.809425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:47.809464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:47.818545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:47.819720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:47.819726Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:47.819728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:47.819732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:47.819739Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 624 [2:7556255052111032038:5786]
2025-10-01T14:08:47.819758Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:47.819777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:47.819781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:47.819785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:47.819788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:47.819805Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:47.819812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:47.819819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:47.819882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.819883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.819885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.819889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:47.819891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:47.819971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:47.819974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.819987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:47.819998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:47.820012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:47.820032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255052111032033:5786]
2025-10-01T14:08:47.820035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255052111032033:5786]
2025-10-01T14:08:47.820036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255052111032033:5786]
2025-10-01T14:08:47.820051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:47.820070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:47.820085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:47.820088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:47.820132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255052111032033:5786]
2025-10-01T14:08:47.820135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:47.820466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:47.820471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:47.820473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:47.820478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:47.821461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 624
2025-10-01T14:08:47.821502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 624
2025-10-01T14:08:47.823836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487895950:2446], now have 1 active actors on pipe
2025-10-01T14:08:47.823850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487896059:6499], now have 1 active actors on pipe
2025-10-01T14:08:47.823878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.823885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.823916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|835dd075-19a57d35-47959a10-5c23afd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:47.823927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:47.823933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:47.823937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:47.823950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:47.823966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:47.823988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:47.825513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:47.825526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:47.825553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:47.825756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 625 partition: 0 MaxSeqNo: 45 sessionId: src_id|835dd075-19a57d35-47959a10-5c23afd_0
2025-10-01T14:08:47.826193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f829c97-472bbdf5-d37458a9-30fd4ce0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|835dd075-19a57d35-47959a10-5c23afd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:47.828682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|835dd075-19a57d35-47959a10-5c23afd_0] Write session: try to update token
2025-10-01T14:08:47.828699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|835dd075-19a57d35-47959a10-5c23afd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:47.855338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:47.855360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:47.855364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:47.855366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:47.855376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255052111032033:5786]
2025-10-01T14:08:47.855381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255052111032033:5786]
2025-10-01T14:08:47.855388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255052111032033:5786]
2025-10-01T14:08:47.855441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:47.855453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:47.855455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:47.855612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:47.859213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:47.859229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:47.859233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:47.859068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 625 sessionId: src_id|835dd075-19a57d35-47959a10-5c23afd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:47.861559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:47.867485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255054487896158:6355]
2025-10-01T14:08:47.868067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 624, pipe: [1:7556255054487896158:6355]
2025-10-01T14:08:48.045952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:48.046271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.046282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.046308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255054487896158:6355], now have 1 active actors on pipe
2025-10-01T14:08:48.046611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:48.050525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:48.050530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:48.050596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255054487896158:6355]
2025-10-01T14:08:48.050632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 625 reason: status is not ok: tablet will be restarted right now sessionId: src_id|835dd075-19a57d35-47959a10-5c23afd_0
2025-10-01T14:08:48.050833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 625 sessionId: src_id|835dd075-19a57d35-47959a10-5c23afd_0 is DEAD
2025-10-01T14:08:48.051001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|835dd075-19a57d35-47959a10-5c23afd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:48.051010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|835dd075-19a57d35-47959a10-5c23afd_0] Write session will restart in 0.009134s
2025-10-01T14:08:48.051036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|835dd075-19a57d35-47959a10-5c23afd_0] Write session: Do CDS request
2025-10-01T14:08:48.051043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|835dd075-19a57d35-47959a10-5c23afd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:48.062921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|835dd075-19a57d35-47959a10-5c23afd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:48.063387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:48.063403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 626
2025-10-01T14:08:48.063571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:48.063605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:48.063610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:48.063613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:48.064046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 626 sessionId:  describe result for acl check
2025-10-01T14:08:48.064082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:48.064084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:48.064085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:48.064091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255058782863473:6503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:48.064584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255058782863473:6503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:48.080164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255058782863473:6503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:48.089998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255058782863473:6503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:48.090020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255058782863473:6503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:48.090023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255058782863473:6503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:48.090032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:48.096048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:48.101063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:48.101328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:48.101338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:48.101350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:48.101405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:48.101446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255056405999537:5788]
2025-10-01T14:08:48.102060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:48.102687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:48.102735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:48.102991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:48.103063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.103070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.103071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.103072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.103074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.103075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.103076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.103078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.103079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.103080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.103082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.103083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.103084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.103085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.103090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.103099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.103103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.103108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.103112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.103115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.103118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.103122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.103125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.103129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.103133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.103145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.103150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.103154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.103161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.103165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.103170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.103174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.103178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.103184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.103188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.103195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.103200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.103210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.103215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.103220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.103224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.103229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.103232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.103235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.103238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.103242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.103244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.103248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.103251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.103254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.103257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.103260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.103262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.103265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.103268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.103270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.103293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:48.115394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:48.116244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:48.116257Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:48.116260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:48.116265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:48.116272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 625 [2:7556255056405999537:5788]
2025-10-01T14:08:48.116292Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:48.116313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:48.116318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:48.116321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:48.116323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:48.116342Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:48.116349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:48.116356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:48.116429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.116432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.116434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.116438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:48.116441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:48.116514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:48.116522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.116535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.116547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.116579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:48.116597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255056405999531:5788]
2025-10-01T14:08:48.116600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255056405999531:5788]
2025-10-01T14:08:48.116602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255056405999531:5788]
2025-10-01T14:08:48.116617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:48.116631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:48.116646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:48.116649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:48.116692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255056405999531:5788]
2025-10-01T14:08:48.116700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:48.117099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:48.117108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:48.117111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:48.117118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:48.118363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 625
2025-10-01T14:08:48.118446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 625
2025-10-01T14:08:48.118593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255058782863637:6503], now have 1 active actors on pipe
2025-10-01T14:08:48.118606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255058782863459:2446], now have 1 active actors on pipe
2025-10-01T14:08:48.118963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.118978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.119012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:48.119022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:48.119028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:48.119030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:48.119046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:48.119069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:48.119091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:48.119368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.119377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.119394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:48.119518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 626 partition: 0 MaxSeqNo: 45 sessionId: src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0
2025-10-01T14:08:48.122544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|835dd075-19a57d35-47959a10-5c23afd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:48.125197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0] Write session: try to update token
2025-10-01T14:08:48.125218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:48.156386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:48.156408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:48.156411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:48.156413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:48.156424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255056405999531:5788]
2025-10-01T14:08:48.156433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255056405999531:5788]
2025-10-01T14:08:48.156437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255056405999531:5788]
2025-10-01T14:08:48.156497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:48.156505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.156507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:48.156509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:48.156517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:48.156535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:48.156669Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:48.159177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255058782863667:6355]
2025-10-01T14:08:48.159705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 626 sessionId: src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:48.162752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:48.163111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 625, pipe: [1:7556255058782863667:6355]
2025-10-01T14:08:48.336861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:48.337099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.337109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.337130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255058782863667:6355], now have 1 active actors on pipe
2025-10-01T14:08:48.342703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:48.346481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255058782863667:6355]
2025-10-01T14:08:48.346543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:48.346627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 626 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0
2025-10-01T14:08:48.346812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 626 sessionId: src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0 is DEAD
2025-10-01T14:08:48.346946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:48.348631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:48.348642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0] Write session will restart in 0.006419s
2025-10-01T14:08:48.348670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0] Write session: Do CDS request
2025-10-01T14:08:48.348676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:48.358853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:48.359647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:48.359665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 627
2025-10-01T14:08:48.359815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:48.359844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:48.359849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:48.359852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:48.360253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 627 sessionId:  describe result for acl check
2025-10-01T14:08:48.360278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:48.360282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:48.360284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:48.360290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255058782863700:6514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:48.360976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255058782863700:6514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:48.365269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255058782863700:6514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:48.383579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255058782863700:6514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:48.383597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255058782863700:6514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:48.383600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255058782863700:6514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:48.383609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:48.399833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:48.406030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:48.406279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:48.406284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:48.406296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:48.406346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:48.406496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255056405999762:5792]
2025-10-01T14:08:48.407178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:48.407661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:48.407708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:48.408046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:48.408099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.408100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.408101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.408102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.408104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.408106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.408108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.408109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.408110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.408112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.408113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.408114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.408116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.408117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.408122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.408132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.408137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.408141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.408145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.408149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.408153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.408157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.408162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.408166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.408170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.408174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.408177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.408181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.408188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.408196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.408202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.408208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.408212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.408218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.408223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.408228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.408233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.408238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.408244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.408249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.408254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.408259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.408264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.408270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.408275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.408280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.408284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.408289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.408295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.408300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.408305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.408310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.408315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.408322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.408327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.408332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.408373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:48.419309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:48.420113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:48.420120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:48.420123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:48.420127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:48.420136Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 626 [2:7556255056405999762:5792]
2025-10-01T14:08:48.420154Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:48.420176Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:48.420180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:48.420184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:48.420187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:48.420207Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:48.420212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:48.420219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:48.420289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.420292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.420294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.420297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:48.420300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:48.420425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:48.420428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.420442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.420454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.420482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:48.420500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255056405999757:5792]
2025-10-01T14:08:48.420503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255056405999757:5792]
2025-10-01T14:08:48.420505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255056405999757:5792]
2025-10-01T14:08:48.420519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:48.420536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:48.420552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:48.420555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:48.420598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255056405999757:5792]
2025-10-01T14:08:48.420600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:48.421334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:48.421342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:48.421344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:48.421349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:48.421897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 626
2025-10-01T14:08:48.421940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 626
2025-10-01T14:08:48.422058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255058782863695:2446], now have 1 active actors on pipe
2025-10-01T14:08:48.422066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255058782863790:6514], now have 1 active actors on pipe
2025-10-01T14:08:48.422235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.422242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.422272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bae31a67-3e96c719-9db79cab-36ccb908_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:48.422282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:48.422287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:48.422290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:48.422301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:48.422316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:48.422334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:48.424465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.424484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.424521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:48.424807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 627 partition: 0 MaxSeqNo: 45 sessionId: src_id|bae31a67-3e96c719-9db79cab-36ccb908_0
2025-10-01T14:08:48.426722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da34b7f7-86fd14c7-6ff9833c-63abb0d6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bae31a67-3e96c719-9db79cab-36ccb908_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:48.429287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae31a67-3e96c719-9db79cab-36ccb908_0] Write session: try to update token
2025-10-01T14:08:48.429309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae31a67-3e96c719-9db79cab-36ccb908_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:48.447576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255058782863922:6355]
2025-10-01T14:08:48.448254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255058782863922:6355], now have 1 active actors on pipe
2025-10-01T14:08:48.448465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 626, pipe: [1:7556255058782863922:6355]
2025-10-01T14:08:48.480999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 627 sessionId: src_id|bae31a67-3e96c719-9db79cab-36ccb908_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:48.484120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:48.485934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.485955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.485997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:48.489956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:48.496085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:48.496106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:48.496109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:48.496111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:48.496123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255056405999757:5792]
2025-10-01T14:08:48.496130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255056405999757:5792]
2025-10-01T14:08:48.496134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255056405999757:5792]
2025-10-01T14:08:48.496189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:48.496196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.496199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:48.496362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:48.498847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:48.498855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:48.498859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:48.789776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:48.799916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.799950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.800150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.800220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.800287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.800355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.800400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.800405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.800483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.800550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.800619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.800691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.800739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.800743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.800838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.800903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.800970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.801036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.801076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.801079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.801167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.801230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.801294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.801354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.801395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.801398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.801468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.801533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.801590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.801647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.801694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.801696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.801763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.801820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.801884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.801950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.802005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.802008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.802074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.802133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.802198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.802267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.802322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.802325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.802640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.802713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.802776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.802844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.802892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.802896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.802980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.803045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.803110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.803175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.803217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.803220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.803312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:48.803373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:48.803437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:48.803506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:48.803572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:48.803575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:48.807686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae31a67-3e96c719-9db79cab-36ccb908_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:48.807701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae31a67-3e96c719-9db79cab-36ccb908_0] Write session will restart in 0.005666s
2025-10-01T14:08:48.807730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae31a67-3e96c719-9db79cab-36ccb908_0] Write session: Do CDS request
2025-10-01T14:08:48.807737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae31a67-3e96c719-9db79cab-36ccb908_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:48.806940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:48.806999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:48.807002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:48.807031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 627 reason: error at write: Disconnected sessionId: src_id|bae31a67-3e96c719-9db79cab-36ccb908_0
2025-10-01T14:08:48.807230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 627 sessionId: src_id|bae31a67-3e96c719-9db79cab-36ccb908_0 is DEAD
2025-10-01T14:08:48.807379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255058782863922:6355]
2025-10-01T14:08:48.810586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:48.818841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae31a67-3e96c719-9db79cab-36ccb908_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:48.819535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:48.819552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 628
2025-10-01T14:08:48.819719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:48.819749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:48.819755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:48.819764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:48.820282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 628 sessionId:  describe result for acl check
2025-10-01T14:08:48.820317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:48.820319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:48.820320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:48.820325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255058782863942:6521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:48.820882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255058782863942:6521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:48.826027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255058782863942:6521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:48.843737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255058782863942:6521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:48.843760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255058782863942:6521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:48.843764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255058782863942:6521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:48.843774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:48.854881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:48.858125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:48.858433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:48.858438Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:48.858452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:48.858510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:48.858559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255056406000001:5807]
2025-10-01T14:08:48.859241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:48.859687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:48.859728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:48.860089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:48.860139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.860140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.860142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.860143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.860144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.860145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.860146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.860147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.860149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.860150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.860151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.860152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.860154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.860155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.860161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.860172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.860177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.860181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.860184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.860188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.860192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.860196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.860200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.860204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.860208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.860212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.860216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.860219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.860227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.860235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:48.860242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.860248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:48.860253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.860258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:48.860263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.860269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:48.860274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.860280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:48.860285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.860291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:48.860296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.860302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:48.860307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.860313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:48.860320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.860326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:48.860330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.860335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.860340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.860346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.860350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.860356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.860373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.860378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:48.860382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.860387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:48.860434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:48.867323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:48.868518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:48.868535Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:48.868538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:48.868542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:48.868550Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 627 [2:7556255056406000001:5807]
2025-10-01T14:08:48.868567Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:48.868586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:48.868590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:48.868594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:48.868598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:48.868619Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:48.868630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:48.868636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:48.868712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.868717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.868720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.868723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:48.868725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:48.868818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:48.868821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.868836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:48.868848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:48.868864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:48.868881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255056405999995:5807]
2025-10-01T14:08:48.868884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255056405999995:5807]
2025-10-01T14:08:48.868886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255056405999995:5807]
2025-10-01T14:08:48.868900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:48.868919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:48.868933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:48.868936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:48.868955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:48.868957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:48.868959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:48.868980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255056405999995:5807]
2025-10-01T14:08:48.868982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:48.869018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:48.869197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255058782864079:6521], now have 1 active actors on pipe
2025-10-01T14:08:48.869204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255058782863934:2446], now have 1 active actors on pipe
2025-10-01T14:08:48.869480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 627
2025-10-01T14:08:48.869510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 627
2025-10-01T14:08:48.869809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.869821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.869856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:48.869867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:48.869872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:48.869874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:48.869885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:48.869897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:48.869924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:48.870312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.870318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.870335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:48.870685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 628 partition: 0 MaxSeqNo: 45 sessionId: src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0
2025-10-01T14:08:48.871346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae31a67-3e96c719-9db79cab-36ccb908_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:48.874178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0] Write session: try to update token
2025-10-01T14:08:48.874202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:48.893420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 628 sessionId: src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:48.896224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:48.897578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:48.897604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:48.897657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:48.900540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:48.908393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:48.908411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:48.908414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:48.908416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:48.908426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255056405999995:5807]
2025-10-01T14:08:48.908434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255056405999995:5807]
2025-10-01T14:08:48.908439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255056405999995:5807]
2025-10-01T14:08:48.908493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255058782864143:6355], now have 1 active actors on pipe
2025-10-01T14:08:48.908505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:48.908512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:48.908514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:48.908663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:48.909028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:48.909034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:48.909039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:48.907344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255058782864143:6355]
2025-10-01T14:08:48.908490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 627, pipe: [1:7556255058782864143:6355]
2025-10-01T14:08:49.095876Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:49.104223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.104260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.104444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.104504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.104569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.104640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.104696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.104706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.104792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.104860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.104935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.105003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.105048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.105051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.105119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.105175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.105227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.105273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.105313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.105316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.105382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.105435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.105492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.105549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.105588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.105592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.105655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.105709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.105763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.105817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.105852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.105854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.105918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.105976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.106047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.106101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.106139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.106142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.106212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.106266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.106325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.106543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.106609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.106617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.106681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.106742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.106805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.106868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.106918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.106921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.106983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.107032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.107093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.107158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.107199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.107202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.107265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.107324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.107384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.107461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.107504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.107511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.109067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:49.109338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255058782864143:6355]
2025-10-01T14:08:49.109369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:49.109403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:49.109406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:49.109430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 628 reason: error at write: Disconnected sessionId: src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0
2025-10-01T14:08:49.109611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 628 sessionId: src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0 is DEAD
2025-10-01T14:08:49.109990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:49.110001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0] Write session will restart in 0.006405s
2025-10-01T14:08:49.110027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0] Write session: Do CDS request
2025-10-01T14:08:49.110033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:49.118700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:49.118901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:49.118920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 629
2025-10-01T14:08:49.119108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:49.119144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:49.119148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:49.119152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:49.119639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 629 sessionId:  describe result for acl check
2025-10-01T14:08:49.119685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:49.119692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:49.119694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:49.119699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255063077831486:6525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:49.120212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255063077831486:6525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:49.126417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255063077831486:6525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:49.131716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:49.131332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255063077831486:6525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:49.131351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255063077831486:6525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:49.131355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255063077831486:6525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:49.131364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:49.134432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:49.134656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:49.134666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:49.134678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:49.134731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:49.134770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255060700967504:5809]
2025-10-01T14:08:49.135342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:49.135681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:49.135727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:49.136078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:49.136143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.136150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.136151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.136152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.136154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.136155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.136156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.136157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.136158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.136159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.136161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.136162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.136163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.136164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.136170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.136181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.136185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.136189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.136193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.136197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.136201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.136206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.136210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.136214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.136218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.136223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.136227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.136234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.136241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.136248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.136254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.136260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.136265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.136270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.136275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.136280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.136285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.136291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.136295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.136301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.136308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.136314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.136324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.136330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.136338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.136344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.136353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.136358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.136363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.136372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.136377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.136382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.136390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.136396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.136404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.136410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.136454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:49.140742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:49.141541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:49.141556Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:49.141559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:49.141563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:49.141570Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 628 [2:7556255060700967504:5809]
2025-10-01T14:08:49.141585Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:49.141603Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:49.141606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:49.141610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:49.141613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:49.141629Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:49.141640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:49.141647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:49.141713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.141718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.141721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.141725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:49.141728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:49.141797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:49.141805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.141818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.141831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.141849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:49.141867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077831445:2446], now have 1 active actors on pipe
2025-10-01T14:08:49.141873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077831645:6525], now have 1 active actors on pipe
2025-10-01T14:08:49.141881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255060700967498:5809]
2025-10-01T14:08:49.141883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255060700967498:5809]
2025-10-01T14:08:49.141886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255060700967498:5809]
2025-10-01T14:08:49.141901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:49.141916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:49.141918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:49.141922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:49.141924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:49.141933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:49.141938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:49.141972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255060700967498:5809]
2025-10-01T14:08:49.141982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:49.141989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:49.142027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 628
2025-10-01T14:08:49.142072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 628
2025-10-01T14:08:49.142187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.142197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.142221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|353d68c-a68e58ed-330f73cf-7344edee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:49.142232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:49.142236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:49.142239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:49.142248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:49.142256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:49.142272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:49.142768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.142778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.142794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:49.143532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 629 partition: 0 MaxSeqNo: 45 sessionId: src_id|353d68c-a68e58ed-330f73cf-7344edee_0
2025-10-01T14:08:49.143880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbf464ec-2e92579b-4471fb0c-10342c9d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|353d68c-a68e58ed-330f73cf-7344edee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:49.146404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|353d68c-a68e58ed-330f73cf-7344edee_0] Write session: try to update token
2025-10-01T14:08:49.146424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|353d68c-a68e58ed-330f73cf-7344edee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:49.164254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:49.164275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:49.164277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:49.164279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:49.164288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255060700967498:5809]
2025-10-01T14:08:49.164293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255060700967498:5809]
2025-10-01T14:08:49.164297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255060700967498:5809]
2025-10-01T14:08:49.164336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:49.164343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:49.164344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:49.164346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:49.164351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.164353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:49.164478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:49.166422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 629 sessionId: src_id|353d68c-a68e58ed-330f73cf-7344edee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:49.168763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:49.209409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255063077831659:6355]
2025-10-01T14:08:49.209738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 628, pipe: [1:7556255063077831659:6355]
2025-10-01T14:08:49.322808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:49.323229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.323242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.323278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077831659:6355], now have 1 active actors on pipe
2025-10-01T14:08:49.323426Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:49.323484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:49.323498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255063077831659:6355]
2025-10-01T14:08:49.323498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:49.323515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:49.323552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 629 reason: error at write: Disconnected sessionId: src_id|353d68c-a68e58ed-330f73cf-7344edee_0
2025-10-01T14:08:49.323732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 629 sessionId: src_id|353d68c-a68e58ed-330f73cf-7344edee_0 is DEAD
2025-10-01T14:08:49.323849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353d68c-a68e58ed-330f73cf-7344edee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:49.323857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353d68c-a68e58ed-330f73cf-7344edee_0] Write session will restart in 0.007869s
2025-10-01T14:08:49.323885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353d68c-a68e58ed-330f73cf-7344edee_0] Write session: Do CDS request
2025-10-01T14:08:49.323891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353d68c-a68e58ed-330f73cf-7344edee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:49.332926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|353d68c-a68e58ed-330f73cf-7344edee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:49.333049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:49.333069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 630
2025-10-01T14:08:49.333209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:49.333244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:49.333250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:49.333253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:49.333684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 630 sessionId:  describe result for acl check
2025-10-01T14:08:49.333721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:49.333729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:49.333731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:49.333736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255063077831714:6530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:49.334283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255063077831714:6530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:49.337242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255063077831714:6530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:49.340071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255063077831714:6530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:49.340087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255063077831714:6530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:49.340090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255063077831714:6530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:49.340098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:49.341006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:49.343553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:49.343791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:49.343800Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:49.343812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:49.343880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:49.343920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255060700967724:5811]
2025-10-01T14:08:49.344463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:49.344819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:49.344870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:49.345181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:49.345256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.345261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.345262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.345264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.345265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.345266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.345268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.345269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.345270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.345272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.345273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.345274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.345275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.345277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.345284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.345294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.345297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.345301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.345305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.345309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.345312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.345316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.345319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.345323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.345326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.345329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.345333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.345337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.345344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.345352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.345358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.345363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.345368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.345373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.345378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.345383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.345388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.345392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.345397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.345403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.345408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.345413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.345417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.345421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.345426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.345431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.345436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.345447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.345452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.345462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.345466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.345476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.345481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.345485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.345493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.345498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.345537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:49.349446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:49.350029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:49.350040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:49.350043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:49.350046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:49.350054Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 629 [2:7556255060700967724:5811]
2025-10-01T14:08:49.350069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:49.350088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:49.350095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:49.350098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:49.350100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:49.350113Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:49.350117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:49.350121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:49.350167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.350172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.350174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.350177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:49.350179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:49.350254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:49.350262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.350275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.350285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.350300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:49.350325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077831869:6530], now have 1 active actors on pipe
2025-10-01T14:08:49.350333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077831669:2446], now have 1 active actors on pipe
2025-10-01T14:08:49.350340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255060700967719:5811]
2025-10-01T14:08:49.350346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255060700967719:5811]
2025-10-01T14:08:49.350349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255060700967719:5811]
2025-10-01T14:08:49.350363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:49.350394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:49.350412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:49.350411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:49.350415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:49.350392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 629
2025-10-01T14:08:49.350417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:49.350394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 629
2025-10-01T14:08:49.350419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:49.350454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255060700967719:5811]
2025-10-01T14:08:49.350457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:49.350459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:49.350488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.350493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.350523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8573cf5c-9e162443-6f026ea2-d495950c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:49.350532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:49.350535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:49.350537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:49.350544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:49.350552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:49.350574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:49.350726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.350736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.350752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:49.350829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 630 partition: 0 MaxSeqNo: 45 sessionId: src_id|8573cf5c-9e162443-6f026ea2-d495950c_0
2025-10-01T14:08:49.351184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|353d68c-a68e58ed-330f73cf-7344edee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8573cf5c-9e162443-6f026ea2-d495950c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:49.353689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8573cf5c-9e162443-6f026ea2-d495950c_0] Write session: try to update token
2025-10-01T14:08:49.353713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8573cf5c-9e162443-6f026ea2-d495950c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:49.367675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 630 sessionId: src_id|8573cf5c-9e162443-6f026ea2-d495950c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:49.370234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:49.371860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.371886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.371909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:49.371912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:49.371915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:49.371917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:49.371925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255060700967719:5811]
2025-10-01T14:08:49.371930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255060700967719:5811]
2025-10-01T14:08:49.371933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255060700967719:5811]
2025-10-01T14:08:49.371974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:49.371987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:49.371990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:49.371991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:49.371998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.372001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:49.372139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:49.425459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255063077831908:6355]
2025-10-01T14:08:49.425997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 629, pipe: [1:7556255063077831908:6355]
2025-10-01T14:08:49.525099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:49.525655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:49.525717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077831908:6355], now have 1 active actors on pipe
2025-10-01T14:08:49.525833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:49.525947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:49.526008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255063077831908:6355]
2025-10-01T14:08:49.537641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:49.537656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:49.537684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 630 reason: error at write: Disconnected sessionId: src_id|8573cf5c-9e162443-6f026ea2-d495950c_0
2025-10-01T14:08:49.537866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 630 sessionId: src_id|8573cf5c-9e162443-6f026ea2-d495950c_0 is DEAD
2025-10-01T14:08:49.538006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8573cf5c-9e162443-6f026ea2-d495950c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:49.538017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8573cf5c-9e162443-6f026ea2-d495950c_0] Write session will restart in 0.005733s
2025-10-01T14:08:49.538041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8573cf5c-9e162443-6f026ea2-d495950c_0] Write session: Do CDS request
2025-10-01T14:08:49.538051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8573cf5c-9e162443-6f026ea2-d495950c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:49.544886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8573cf5c-9e162443-6f026ea2-d495950c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:49.544952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:49.544970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 631
2025-10-01T14:08:49.545242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:49.545276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:49.545286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:49.545289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:49.546126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 631 sessionId:  describe result for acl check
2025-10-01T14:08:49.546164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:49.546166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:49.546167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:49.546173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255063077832038:6542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:49.546670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255063077832038:6542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:49.549377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255063077832038:6542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:49.549574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:49.551905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:49.552168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:49.552180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:49.552197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:49.552281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:49.552330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255060700967938:5817]
2025-10-01T14:08:49.552639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255063077832038:6542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:49.552655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255063077832038:6542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:49.552658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255063077832038:6542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:49.552667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:49.552786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:49.553071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:49.553124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:49.553465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:49.553523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.553528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.553529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.553530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.553531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.553532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.553533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.553534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.553534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.553535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.553536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.553537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.553537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.553538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.553542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.553547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.553549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.553551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.553553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.553555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.553557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.553559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.553561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.553564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.553566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.553568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.553570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.553572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.553578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.553582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.553586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.553590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.553594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.553599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.553603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.553608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.553613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.553617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.553622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.553627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.553629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.553632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.553635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.553637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.553640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.553643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.553648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.553654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.553658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.553662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.553666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.553670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.553674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.553680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.553684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.553688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.553724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:49.557992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:49.558646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:49.558663Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:49.558667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:49.558671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:49.558679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 630 [2:7556255060700967938:5817]
2025-10-01T14:08:49.558695Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:49.558715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:49.558718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:49.558723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:49.558726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:49.558744Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:49.558756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:49.558762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:49.558836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.558844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.558847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.558850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:49.558853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:49.558931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:49.558939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.558952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.558965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.558982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:49.558999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255060700967933:5817]
2025-10-01T14:08:49.559002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255060700967933:5817]
2025-10-01T14:08:49.559005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255060700967933:5817]
2025-10-01T14:08:49.559016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:49.559027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:49.559030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:49.559032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:49.559033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077831920:2446], now have 1 active actors on pipe
2025-10-01T14:08:49.559037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077832123:6542], now have 1 active actors on pipe
2025-10-01T14:08:49.559046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:49.559059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:49.559068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:49.559106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255060700967933:5817]
2025-10-01T14:08:49.559118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:49.559128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:49.559176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 630
2025-10-01T14:08:49.559204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 630
2025-10-01T14:08:49.559258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.559269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.559294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:49.559301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:49.559305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:49.559308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:49.559319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:49.559328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:49.559343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:49.559562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.559575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.559599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:49.559699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 631 partition: 0 MaxSeqNo: 45 sessionId: src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0
2025-10-01T14:08:49.560092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8573cf5c-9e162443-6f026ea2-d495950c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:49.562965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0] Write session: try to update token
2025-10-01T14:08:49.562985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:49.576630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:49.576652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:49.576667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255060700967933:5817]
2025-10-01T14:08:49.576720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:49.576923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:49.577076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:49.577224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:49.577242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:49.577410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:49.577633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:49.577676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:49.577318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 631 sessionId: src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:49.581267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.581287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.581323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:49.581024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:49.581455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:49.592261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:49.592283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:49.592286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:49.592288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:49.592300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255060700967933:5817]
2025-10-01T14:08:49.592305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255060700967933:5817]
2025-10-01T14:08:49.592309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255060700967933:5817]
2025-10-01T14:08:49.592360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:49.592373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.592381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:49.592521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:49.594639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:49.594657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:49.594662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:49.626185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255063077832134:6355]
2025-10-01T14:08:49.626524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 630, pipe: [1:7556255063077832134:6355]
2025-10-01T14:08:49.824696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:49.832458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.832484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.832641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.832708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.832785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.832849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.832896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.832905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.832974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.833033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.833091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.833158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.833203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.833209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.833279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.833338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.833399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.833466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.833511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.833517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.833586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.833653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.833715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.833786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.834005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.834014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.834082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.834144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.834206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.834262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.834318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.834324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.834412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.834480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.834543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.834610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.834657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.834667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.834740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.834811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.834881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.834952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.835006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.835017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.835083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.835151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.835219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.835287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.835334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.835342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.835417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.835482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.835552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.835623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.835674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.835682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.835749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:49.835815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:49.835883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:49.835949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:49.835996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:49.836004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:49.836797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:49.836808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0] Write session will restart in 0.006937s
2025-10-01T14:08:49.836355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255063077832134:6355]
2025-10-01T14:08:49.836361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:49.836394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:49.836397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:49.836845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0] Write session: Do CDS request
2025-10-01T14:08:49.836425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 631 reason: error at write: Disconnected sessionId: src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0
2025-10-01T14:08:49.836643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 631 sessionId: src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0 is DEAD
2025-10-01T14:08:49.836851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:49.836076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077832134:6355], now have 1 active actors on pipe
2025-10-01T14:08:49.837135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:49.844953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:49.845638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:49.845657Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 632
2025-10-01T14:08:49.845981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:49.846021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:49.846026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:49.846030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:49.847243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 632 sessionId:  describe result for acl check
2025-10-01T14:08:49.847283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:49.847292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:49.847294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:49.847300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255063077832179:6547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:49.847796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255063077832179:6547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:49.850755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255063077832179:6547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:49.855088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:49.855375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255063077832179:6547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:49.855394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255063077832179:6547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:49.855397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255063077832179:6547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:49.855407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:49.857792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:49.858008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:49.858018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:49.858029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:49.858075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:49.858120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255060700968179:5830]
2025-10-01T14:08:49.858702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:49.859069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:49.859123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:49.859459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:49.859512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.859517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.859519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.859521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.859522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.859523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.859524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.859525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.859526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.859527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.859528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.859529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.859530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.859531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.859537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.859546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.859551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.859555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.859559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.859563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.859566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.859570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.859574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.859578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.859581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.859585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.859589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.859593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.859600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.859608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:49.859614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.859626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:49.859630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.859635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:49.859640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.859645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:49.859649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.859654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:49.859658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.859662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:49.859666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.859671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:49.859675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.859680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:49.859684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.859688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:49.859693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.859699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.859703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.859707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.859711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.859715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.859719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.859724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:49.859728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.859734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:49.859773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:49.867753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:49.868433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:49.868452Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:49.868455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:49.868459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:49.868467Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 631 [2:7556255060700968179:5830]
2025-10-01T14:08:49.868485Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:49.868507Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:49.868517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:49.868521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:49.868524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:49.868542Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:49.868548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:49.868561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:49.868628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.868637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.868639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.868642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:49.868645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:49.868720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:49.868730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.868744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:49.868756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:49.868783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:49.868803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077832143:2446], now have 1 active actors on pipe
2025-10-01T14:08:49.868807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077832343:6547], now have 1 active actors on pipe
2025-10-01T14:08:49.868816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255060700968173:5830]
2025-10-01T14:08:49.868818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255060700968173:5830]
2025-10-01T14:08:49.868820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255060700968173:5830]
2025-10-01T14:08:49.868835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:49.868851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:49.868866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:49.868869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:49.868879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 631
2025-10-01T14:08:49.868886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 631
2025-10-01T14:08:49.868891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:49.868899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:49.868902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:49.868909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255060700968173:5830]
2025-10-01T14:08:49.868912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:49.868919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:49.868953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.868959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.868988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9895671c-5f619174-577ce215-ad6e4643_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:49.868995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:49.869000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:49.869003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:49.869013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:49.869023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:49.869040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:49.869222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.869233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.869251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:49.869463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 632 partition: 0 MaxSeqNo: 45 sessionId: src_id|9895671c-5f619174-577ce215-ad6e4643_0
2025-10-01T14:08:49.869870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84e25e6-d52c4854-9fac29e2-dec227fa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9895671c-5f619174-577ce215-ad6e4643_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:49.872366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9895671c-5f619174-577ce215-ad6e4643_0] Write session: try to update token
2025-10-01T14:08:49.872382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9895671c-5f619174-577ce215-ad6e4643_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:49.883318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:49.883335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:49.883345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255060700968173:5830]
2025-10-01T14:08:49.883393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:49.883571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:49.883635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:49.883719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:49.883855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:49.884010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:49.884206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:49.884242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:49.890734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 632 sessionId: src_id|9895671c-5f619174-577ce215-ad6e4643_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:49.893187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:49.893655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:49.893676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:49.893720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:49.893817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:49.906505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:49.906526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:49.906528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:49.906530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:49.906541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255060700968173:5830]
2025-10-01T14:08:49.906545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255060700968173:5830]
2025-10-01T14:08:49.906549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255060700968173:5830]
2025-10-01T14:08:49.906595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:49.906607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:49.906614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:49.906753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:49.910464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:49.910485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:49.910490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:49.936441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255063077832356:6355]
2025-10-01T14:08:49.936725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 631, pipe: [1:7556255063077832356:6355]
2025-10-01T14:08:50.069802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:50.078825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.078850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.079032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.079090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.079153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.079217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.079267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.079272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.079341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.079399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.079456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.079517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.079555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.079559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.079622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.079673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.079731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.079784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.079823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.079827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.079885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.079966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.080020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.080080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.080116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.080120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.080179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.080230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.080287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.080341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.080382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.080386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.080449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.080525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.080583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.080640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.080680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.080683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.080743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.080810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.080863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.080923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.080963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.080966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.081026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.081080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.081135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.081193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.081244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.081249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.081314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.081368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.081425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.081498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.081542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.081551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.081615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.081675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.081740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.081808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.081858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.081865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.081934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255063077832356:6355], now have 1 active actors on pipe
2025-10-01T14:08:50.082615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255063077832356:6355]
2025-10-01T14:08:50.082646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:50.082692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:50.082698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:50.082725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 632 reason: error at write: Disconnected sessionId: src_id|9895671c-5f619174-577ce215-ad6e4643_0
2025-10-01T14:08:50.082965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 632 sessionId: src_id|9895671c-5f619174-577ce215-ad6e4643_0 is DEAD
2025-10-01T14:08:50.083111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9895671c-5f619174-577ce215-ad6e4643_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:50.083119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9895671c-5f619174-577ce215-ad6e4643_0] Write session will restart in 0.005530s
2025-10-01T14:08:50.083145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9895671c-5f619174-577ce215-ad6e4643_0] Write session: Do CDS request
2025-10-01T14:08:50.083151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9895671c-5f619174-577ce215-ad6e4643_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:50.083238Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:50.089891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9895671c-5f619174-577ce215-ad6e4643_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:50.090220Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:50.090236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 633
2025-10-01T14:08:50.090418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:50.090466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:50.090479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:50.090483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:50.090847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 633 sessionId:  describe result for acl check
2025-10-01T14:08:50.090887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:50.090894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:50.090895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:50.090900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255067372799671:6551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:50.091428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255067372799671:6551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:50.094815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255067372799671:6551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:50.098622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255067372799671:6551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:50.099468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255067372799671:6551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:50.099478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255067372799671:6551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:50.099490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:50.106182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:50.108837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:50.109154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:50.109167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:50.109182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:50.109250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:50.109308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255064995935686:5832]
2025-10-01T14:08:50.109936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:50.110263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:50.110308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:50.110606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:50.110658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.110659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.110659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.110660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.110661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.110662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.110663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.110664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.110664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.110665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.110666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.110666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.110667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.110668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.110672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.110678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.110680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.110682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.110684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.110686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.110688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.110691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.110695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.110698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.110702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.110705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.110709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.110712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.110718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.110725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.110731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.110738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.110744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.110749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.110754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.110759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.110764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.110769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.110771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.110774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.110777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.110780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.110782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.110785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.110787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.110790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.110793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.110796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.110798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.110801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.110803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.110806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.110809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.110811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.110813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.110817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.110848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:50.114952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:50.116072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 632
2025-10-01T14:08:50.116106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 632
2025-10-01T14:08:50.115644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:50.115660Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:50.115663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:50.115667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:50.115674Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 632 [2:7556255064995935686:5832]
2025-10-01T14:08:50.115691Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:50.115710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:50.115713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:50.115717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:50.115720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:50.115737Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:50.115742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:50.115749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:50.115817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.115819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.115824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.115827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:50.115830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:50.115903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:50.115906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.115918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.115928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.115944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:50.115965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372799777:6551], now have 1 active actors on pipe
2025-10-01T14:08:50.115969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372799657:2446], now have 1 active actors on pipe
2025-10-01T14:08:50.115977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255064995935680:5832]
2025-10-01T14:08:50.115980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255064995935680:5832]
2025-10-01T14:08:50.115982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255064995935680:5832]
2025-10-01T14:08:50.115998Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:50.116011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:50.116014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:50.116018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:50.116020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:50.116028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:50.116032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:50.116070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255064995935680:5832]
2025-10-01T14:08:50.116079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:50.116089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:50.116253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.116259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.116290Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:50.116303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:50.116308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:50.116311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:50.116321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:50.116332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:50.116361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:50.116560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.116573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.116594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:50.116715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 633 partition: 0 MaxSeqNo: 45 sessionId: src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0
2025-10-01T14:08:50.117117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9895671c-5f619174-577ce215-ad6e4643_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:50.119800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0] Write session: try to update token
2025-10-01T14:08:50.119818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:50.137846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 633 sessionId: src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:50.140333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:50.141298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.141327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.141349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:50.141353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:50.141355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:50.141357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:50.141366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255064995935680:5832]
2025-10-01T14:08:50.141371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255064995935680:5832]
2025-10-01T14:08:50.141381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255064995935680:5832]
2025-10-01T14:08:50.141417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:50.141430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:50.141434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:50.141439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:50.141447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.141449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:50.141601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:50.182726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255067372799874:6355]
2025-10-01T14:08:50.183292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 632, pipe: [1:7556255067372799874:6355]
2025-10-01T14:08:50.297382Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:50.297651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:50.297729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372799874:6355], now have 1 active actors on pipe
2025-10-01T14:08:50.297826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:50.297895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:50.297925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:50.297928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:50.297943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255067372799874:6355]
2025-10-01T14:08:50.298000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 633 reason: error at write: Disconnected sessionId: src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0
2025-10-01T14:08:50.298166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 633 sessionId: src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0 is DEAD
2025-10-01T14:08:50.298323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:50.298334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0] Write session will restart in 0.008550s
2025-10-01T14:08:50.298360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0] Write session: Do CDS request
2025-10-01T14:08:50.298385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:50.307968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:50.308078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:50.308098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 634
2025-10-01T14:08:50.308204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:50.308238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:50.308250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:50.308254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:50.308721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 634 sessionId:  describe result for acl check
2025-10-01T14:08:50.308761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:50.308762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:50.308764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:50.308769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255067372799941:6556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:50.309298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255067372799941:6556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:50.313032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255067372799941:6556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:50.316625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:50.316568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255067372799941:6556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:50.316584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255067372799941:6556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:50.316587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255067372799941:6556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:50.316596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:50.319519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:50.319740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:50.319745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:50.319757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:50.319811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:50.319845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255064995935896:5834]
2025-10-01T14:08:50.320370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:50.320670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:50.320719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:50.321060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:50.321113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.321114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.321116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.321117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.321118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.321120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.321121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.321122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.321123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.321124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.321125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.321126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.321127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.321128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.321134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.321144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.321148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.321152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.321156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.321160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.321163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.321167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.321170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.321174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.321178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.321181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.321185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.321188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.321198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.321206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.321212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.321217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.321224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.321229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.321233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.321238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.321242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.321247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.321252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.321257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.321262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.321267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.321273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.321279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.321283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.321288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.321292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.321297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.321302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.321307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.321311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.321316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.321320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.321325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.321328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.321332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.321371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:50.325413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:50.326010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:50.326023Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:50.326026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:50.326030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:50.326037Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 633 [2:7556255064995935896:5834]
2025-10-01T14:08:50.326053Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:50.326069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:50.326076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:50.326079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:50.326082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:50.326098Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:50.326107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:50.326118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:50.326174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.326182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.326184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.326187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:50.326190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:50.326265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:50.326273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.326283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.326292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.326306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:50.326325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372800089:6556], now have 1 active actors on pipe
2025-10-01T14:08:50.326329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372799881:2446], now have 1 active actors on pipe
2025-10-01T14:08:50.326336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255064995935890:5834]
2025-10-01T14:08:50.326339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255064995935890:5834]
2025-10-01T14:08:50.326341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255064995935890:5834]
2025-10-01T14:08:50.326353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:50.326367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:50.326366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:50.326386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:50.326388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:50.326401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:50.326405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:50.326434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255064995935890:5834]
2025-10-01T14:08:50.326416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 633
2025-10-01T14:08:50.326445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:50.326449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 633
2025-10-01T14:08:50.326463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:50.326607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.326615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.326640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4219584-f7876966-c8435ea5-99f9394d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:50.326647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:50.326652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:50.326654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:50.326663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:50.326671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:50.326684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:50.326827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.326834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.326847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:50.326920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 634 partition: 0 MaxSeqNo: 45 sessionId: src_id|e4219584-f7876966-c8435ea5-99f9394d_0
2025-10-01T14:08:50.327266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|408aa0ce-92981105-ef3c0fbd-89e4b20_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e4219584-f7876966-c8435ea5-99f9394d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:50.329742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4219584-f7876966-c8435ea5-99f9394d_0] Write session: try to update token
2025-10-01T14:08:50.329759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4219584-f7876966-c8435ea5-99f9394d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:50.337848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:50.337869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:50.337877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255064995935890:5834]
2025-10-01T14:08:50.337925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:50.337930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:50.338100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:50.338256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:50.338424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:50.338560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:50.338774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:50.338821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:50.345499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 634 sessionId: src_id|e4219584-f7876966-c8435ea5-99f9394d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:50.348045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:50.348385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.348406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.348441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:50.348520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:50.357808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:50.357829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:50.357832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:50.357834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:50.357845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255064995935890:5834]
2025-10-01T14:08:50.357849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255064995935890:5834]
2025-10-01T14:08:50.357853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255064995935890:5834]
2025-10-01T14:08:50.357897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:50.357903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:50.357910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.357913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:50.357920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:50.357924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:50.358049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:50.398254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255067372800102:6355]
2025-10-01T14:08:50.398671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 633, pipe: [1:7556255067372800102:6355]
2025-10-01T14:08:50.515922Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:50.523799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.523823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.523975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.524027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.524088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.524148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.524189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.524193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.524252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.524310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.524362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.524412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.524460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.524463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.524536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.524597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.524650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.524705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.524742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.524746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.524827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.524888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.524939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.524997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.525039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.525041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.525109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.525161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.525216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.525268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.525315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.525318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.525390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.525445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.525501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.525569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.525612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.525615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.525679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.525728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.525781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.525833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.525871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.525873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.525928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.525979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.526031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.526094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.526134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.526135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.526197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.526253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.526306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.526360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.526644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.526658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.526731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.526793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.526858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.526920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.526973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.526980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.527048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372800102:6355], now have 1 active actors on pipe
2025-10-01T14:08:50.527326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:50.527348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:50.527366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255067372800102:6355]
2025-10-01T14:08:50.527377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 634 reason: error at write: Disconnected sessionId: src_id|e4219584-f7876966-c8435ea5-99f9394d_0
2025-10-01T14:08:50.527393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:50.527604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 634 sessionId: src_id|e4219584-f7876966-c8435ea5-99f9394d_0 is DEAD
2025-10-01T14:08:50.527733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4219584-f7876966-c8435ea5-99f9394d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:50.527755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4219584-f7876966-c8435ea5-99f9394d_0] Write session will restart in 0.005080s
2025-10-01T14:08:50.527780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4219584-f7876966-c8435ea5-99f9394d_0] Write session: Do CDS request
2025-10-01T14:08:50.527787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4219584-f7876966-c8435ea5-99f9394d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:50.528186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:50.534309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4219584-f7876966-c8435ea5-99f9394d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:50.534409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:50.534425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 635
2025-10-01T14:08:50.534598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:50.534633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:50.534641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:50.534649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:50.535121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 635 sessionId:  describe result for acl check
2025-10-01T14:08:50.535157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:50.535164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:50.535165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:50.535171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255067372800155:6568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:50.535771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255067372800155:6568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:50.540653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255067372800155:6568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:50.545116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255067372800155:6568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:50.545136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255067372800155:6568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:50.545139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255067372800155:6568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:50.545149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:50.561212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:50.574267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:50.574572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:50.574583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:50.574597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:50.574661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:50.574697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255064995936129:5840]
2025-10-01T14:08:50.575561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:50.577737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:50.577812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:50.578194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:50.578268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.578269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.578270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.578272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.578273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.578274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.578276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.578277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.578278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.578279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.578281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.578282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.578283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.578284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.578291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.578301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.578304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.578307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.578310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.578314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.578318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.578321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.578325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.578329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.578332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.578335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.578339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.578342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.578350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.578358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.578364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.578384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.578388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.578392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.578397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.578401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.578405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.578410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.578415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.578420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.578425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.578429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.578435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.578439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.578444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.578448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.578452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.578456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.578461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.578465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.578470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.578475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.578479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.578483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.578488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.578493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.578529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:50.584424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:50.585081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:50.585087Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:50.585090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:50.585094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:50.585101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 634 [2:7556255064995936129:5840]
2025-10-01T14:08:50.585120Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:50.585139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:50.585153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:50.585157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:50.585159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:50.585176Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:50.585181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:50.585189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:50.585267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.585274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.585276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.585279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:50.585282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:50.585350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:50.585359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.585372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.585384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.585407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:50.585431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372800219:6568], now have 1 active actors on pipe
2025-10-01T14:08:50.585443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255064995936124:5840]
2025-10-01T14:08:50.585449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255064995936124:5840]
2025-10-01T14:08:50.585452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255064995936124:5840]
2025-10-01T14:08:50.585461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:50.585471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:50.585476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:50.585478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:50.585480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:50.585498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:50.585505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:50.585621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 634
2025-10-01T14:08:50.585661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 634
2025-10-01T14:08:50.585544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372800142:2446], now have 1 active actors on pipe
2025-10-01T14:08:50.585554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255064995936124:5840]
2025-10-01T14:08:50.585562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:50.585604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:50.585985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.585996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.586026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:50.586037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:50.586043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:50.586047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:50.586058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:50.586073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:50.586095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:50.586367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.586388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.586403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:50.586527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 635 partition: 0 MaxSeqNo: 45 sessionId: src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0
2025-10-01T14:08:50.586926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4219584-f7876966-c8435ea5-99f9394d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:50.589734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0] Write session: try to update token
2025-10-01T14:08:50.589758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:50.599224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:50.599245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:50.599257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255064995936124:5840]
2025-10-01T14:08:50.599306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:50.599309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:50.599505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:50.599654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:50.599806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:50.599961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:50.600184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:50.600231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:50.608496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 635 sessionId: src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:50.611055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:50.611263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.611284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.611325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:50.611443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:50.622295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:50.622314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:50.622316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:50.622319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:50.622330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255064995936124:5840]
2025-10-01T14:08:50.622335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255064995936124:5840]
2025-10-01T14:08:50.622339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255064995936124:5840]
2025-10-01T14:08:50.622412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:50.622421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.622423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:50.622578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:50.623278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:50.623285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:50.623289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:50.626628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255067372800357:6355]
2025-10-01T14:08:50.628683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 634, pipe: [1:7556255067372800357:6355]
2025-10-01T14:08:50.775575Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:08:50.775602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-01T14:08:50.811352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:50.811848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372800357:6355], now have 1 active actors on pipe
2025-10-01T14:08:50.819747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.819775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.819953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.820014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.820079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.820153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.820195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.820200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.820274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.820330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.820391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.820453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.820501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.820504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.820571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.820627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.820689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.820746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.820801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.820804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.820864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.820922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.820978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.821035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.821076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.821079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.821149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.821211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.821267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.821326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.821365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.821368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.821438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.821499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.821571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.821632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.821676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.821679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.821749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.821806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.821865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.821926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.821985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.821989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.822054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.822113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.822188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.822256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.822298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.822301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.822599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.824152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:50.824163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0] Write session will restart in 0.009637s
2025-10-01T14:08:50.824188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0] Write session: Do CDS request
2025-10-01T14:08:50.824194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:50.823700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:50.823711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255067372800357:6355]
2025-10-01T14:08:50.823724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 5
2025-10-01T14:08:50.823746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:50.823748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:50.823778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 635 reason: error at write: Disconnected sessionId: src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0
2025-10-01T14:08:50.824044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 635 sessionId: src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0 is DEAD
2025-10-01T14:08:50.822672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.822741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.822809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.822853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.822856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.822929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:50.822992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:50.823053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:50.823114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:50.823157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:50.823160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:50.824301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:50.834976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:50.835052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:50.835072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 636
2025-10-01T14:08:50.835265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:50.835304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:50.835311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:50.835314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:50.835759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 636 sessionId:  describe result for acl check
2025-10-01T14:08:50.835807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:50.835815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:50.835817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:50.835834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255067372800414:6573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:50.836417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255067372800414:6573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:50.840970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255067372800414:6573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:50.844608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255067372800414:6573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:50.844628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255067372800414:6573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:50.844632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255067372800414:6573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:50.844644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:50.845887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:50.849005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:50.849258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:50.849266Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:50.849275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:50.849313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:50.849374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255064995936374:5854]
2025-10-01T14:08:50.849960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:50.850265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:50.850317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:50.850678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:50.850770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.850778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.850779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.850780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.850782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.850783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.850784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.850786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.850787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.850788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.850790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.850791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.850793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.850794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.850800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.850810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.850814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.850817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.850820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.850824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.850827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.850831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.850835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.850838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.850842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.850845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.850848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.850852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.850860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.850867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:50.850875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.850880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:50.850886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.850891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:50.850894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.850899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:50.850903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.850908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:50.850912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.850916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:50.850921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.850926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:50.850930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.850934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:50.850939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.850944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:50.850947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.850951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.850956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.850960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.850964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.850969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.850983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.850988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:50.850992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.850996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:50.851043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:50.856349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 635
2025-10-01T14:08:50.856393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 635
2025-10-01T14:08:50.855313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:50.855976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:50.855981Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:50.855983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:50.855987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:50.855995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 635 [2:7556255064995936374:5854]
2025-10-01T14:08:50.856014Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:50.856030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:50.856034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:50.856038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:50.856041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:50.856058Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:50.856064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:50.856070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:50.856129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.856131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.856133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.856138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:50.856141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:50.856216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:50.856218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.856231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:50.856241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:50.856255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:50.856275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372800570:6573], now have 1 active actors on pipe
2025-10-01T14:08:50.856278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372800368:2446], now have 1 active actors on pipe
2025-10-01T14:08:50.856285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255064995936369:5854]
2025-10-01T14:08:50.856287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255064995936369:5854]
2025-10-01T14:08:50.856289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255064995936369:5854]
2025-10-01T14:08:50.856304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:50.856320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:50.856331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:50.856333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:50.856336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:50.856336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:50.856339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:50.856374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255064995936369:5854]
2025-10-01T14:08:50.856737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 5 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:08:50.856377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:50.856380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:50.856405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.856410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.856444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:50.856782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:08:50.856451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:50.856456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:50.856458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:50.856830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 636 partition: 0 MaxSeqNo: 45 sessionId: src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0
2025-10-01T14:08:50.856467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:50.856476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:50.856505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:50.856561Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:08:50.856698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.856704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.856726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:50.857201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|590c1649-d9fff9aa-c80ff636-340fdd13_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:50.859795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0] Write session: try to update token
2025-10-01T14:08:50.859816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:50.876501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 636 sessionId: src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:50.878889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:50.879099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:50.879124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:50.879165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:50.879261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:50.889738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:50.889762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:50.889765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:50.889767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:50.889777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255064995936369:5854]
2025-10-01T14:08:50.889781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255064995936369:5854]
2025-10-01T14:08:50.889785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255064995936369:5854]
2025-10-01T14:08:50.889836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:50.889842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:50.889844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:50.889977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:50.891308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:50.891323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:50.891329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:50.924477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255067372800587:6355]
2025-10-01T14:08:50.924908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 635, pipe: [1:7556255067372800587:6355]
2025-10-01T14:08:51.047262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:51.055406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.055436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.055613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.055680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.055746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.055811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.055858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.055867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.055939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.056007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.056080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.056148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.056192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.056200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.056263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.056329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.056386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.056447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.056488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.056491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.056556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.056612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.056664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.056717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.056756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.056758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.056828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.056875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.056930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.056985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.057021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.057023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.057083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.057138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.057198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.057263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.057304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.057306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.057374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.057423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.057478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.057532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.057576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.057579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.057641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.057696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.057757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.057816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.057857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.057860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.057928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.057985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.058045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.058103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.058144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.058146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.058209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.058277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.058344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.058424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.058478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.058485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.058572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255067372800587:6355], now have 1 active actors on pipe
2025-10-01T14:08:51.059921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:51.060317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255067372800587:6355]
2025-10-01T14:08:51.060351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:51.060363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-01T14:08:51.060398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:51.060402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:51.060428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 636 reason: error at write: Disconnected sessionId: src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0
2025-10-01T14:08:51.060618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 636 sessionId: src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0 is DEAD
2025-10-01T14:08:51.062187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:51.062197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0] Write session will restart in 0.008171s
2025-10-01T14:08:51.062221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0] Write session: Do CDS request
2025-10-01T14:08:51.062227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:51.071880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.071959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:51.071977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 637
2025-10-01T14:08:51.072100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.072137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:51.072143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:51.072149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:51.072566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 637 sessionId:  describe result for acl check
2025-10-01T14:08:51.072605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:51.072607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:51.072609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:51.072614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255071667767944:6577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:51.073165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255071667767944:6577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:51.077012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255071667767944:6577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:51.077764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:51.080551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:51.080796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:51.080810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:51.080824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:51.080892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:51.080934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255069290903884:5857]
2025-10-01T14:08:51.081011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255071667767944:6577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:51.081027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255071667767944:6577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:51.081030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255071667767944:6577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:51.081038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:51.081501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:51.081813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:51.081866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:51.082175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:51.082244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.082249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.082250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.082251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.082252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.082253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.082254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.082255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.082256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.082257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.082258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.082259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.082260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.082261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.082266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.082274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.082278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.082281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.082285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.082288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.082291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.082295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.082298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.082301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.082305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.082308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.082312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.082314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.082320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.082327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.082333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.082338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.082342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.082346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.082350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.082355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.082359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.082363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.082407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.082417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.082421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.082425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.082428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.082432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.082440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.082445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.082448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.082453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.082462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.082467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.082470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.082474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.082478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.082482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.082486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.082490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.082522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:51.086224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:51.086926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:51.086938Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:51.086940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:51.086942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:51.086947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 636 [2:7556255069290903884:5857]
2025-10-01T14:08:51.086958Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:51.086973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:51.086975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:51.086977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:51.086979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:51.086991Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:51.086994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:51.086999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:51.087258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.087264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.087265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.087268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:51.087270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:51.087322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:51.087326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.087335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.087341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.087354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:51.087372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768097:6577], now have 1 active actors on pipe
2025-10-01T14:08:51.087383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255069290903879:5857]
2025-10-01T14:08:51.087389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255069290903879:5857]
2025-10-01T14:08:51.087392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255069290903879:5857]
2025-10-01T14:08:51.087404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:51.087415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667767891:2446], now have 1 active actors on pipe
2025-10-01T14:08:51.087423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:51.087425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:51.087425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:51.087427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:51.087433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:51.087435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:51.087458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255069290903879:5857]
2025-10-01T14:08:51.087465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:51.087471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:51.087500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 636
2025-10-01T14:08:51.087510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 636
2025-10-01T14:08:51.087572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.087578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.087611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db5799bf-699e936f-dfd22871-73385196_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:51.087619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:51.087622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:51.087624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:51.087631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:51.087637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:51.087678Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:08:51.087701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:51.087850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.087857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.087868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:51.087855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 6 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:08:51.087884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:08:51.087922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 637 partition: 0 MaxSeqNo: 45 sessionId: src_id|db5799bf-699e936f-dfd22871-73385196_0
2025-10-01T14:08:51.088250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1fca452-b51e7104-e78b9bca-36cf81d3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db5799bf-699e936f-dfd22871-73385196_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:51.090784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db5799bf-699e936f-dfd22871-73385196_0] Write session: try to update token
2025-10-01T14:08:51.090803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db5799bf-699e936f-dfd22871-73385196_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:51.099053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:51.099073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:51.099085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255069290903879:5857]
2025-10-01T14:08:51.099143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:51.099149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:51.099347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:51.099515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:51.099677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:51.099847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:51.100087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:51.100143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:51.111855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 637 sessionId: src_id|db5799bf-699e936f-dfd22871-73385196_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:51.114532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:51.115145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.115179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.115220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:51.119276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:51.130945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:51.130964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:51.130966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:51.130968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:51.130979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255069290903879:5857]
2025-10-01T14:08:51.130982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255069290903879:5857]
2025-10-01T14:08:51.130986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255069290903879:5857]
2025-10-01T14:08:51.131032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:51.131039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.131042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:51.131065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:51.131073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:51.131078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:51.131172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:51.160635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255071667768113:6355]
2025-10-01T14:08:51.160912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 636, pipe: [1:7556255071667768113:6355]
2025-10-01T14:08:51.295157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:51.304177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.304205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.304391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.304451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.304517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.304588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.304633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.304639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.304709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.304787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.304851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.304912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.304962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.304965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.305041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.305105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.305175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.305244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.305287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.305290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.305369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.305436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.305501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.305569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.305614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.305617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.305687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.305750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.305809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.305878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.305918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.305921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.305999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.306062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.306125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.306193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.306236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.306239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.306313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.306583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.306664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.306737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.306813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.306821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.306899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.306976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.307053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.307125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.307171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.307178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.307255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.307326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.307405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.307472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.307518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.307521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.307603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:51.307673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:51.307744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:51.307814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:51.307867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:51.307869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:51.307950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768113:6355], now have 1 active actors on pipe
2025-10-01T14:08:51.309415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:51.310277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5799bf-699e936f-dfd22871-73385196_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:51.310287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5799bf-699e936f-dfd22871-73385196_0] Write session will restart in 0.005968s
2025-10-01T14:08:51.310313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5799bf-699e936f-dfd22871-73385196_0] Write session: Do CDS request
2025-10-01T14:08:51.310321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5799bf-699e936f-dfd22871-73385196_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:51.309806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:51.309859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:51.309911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db5799bf-699e936f-dfd22871-73385196_0
2025-10-01T14:08:51.310131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 637 sessionId: src_id|db5799bf-699e936f-dfd22871-73385196_0 is DEAD
2025-10-01T14:08:51.310286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255071667768113:6355]
2025-10-01T14:08:51.317894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db5799bf-699e936f-dfd22871-73385196_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.317974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:51.317994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 638
2025-10-01T14:08:51.318105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.318136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:51.318147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:51.318150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:51.318549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 638 sessionId:  describe result for acl check
2025-10-01T14:08:51.318588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:51.318590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:51.318591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:51.318596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255071667768141:6582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:51.319104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255071667768141:6582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:51.321884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255071667768141:6582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:51.327610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255071667768141:6582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:51.327631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255071667768141:6582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:51.327635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255071667768141:6582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:51.327645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:51.331609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:51.342442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:51.342713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:51.342724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:51.342734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:51.342779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:51.342810Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255069290904113:5860]
2025-10-01T14:08:51.343301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:51.343625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:51.343675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:51.344180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:51.344268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.344269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.344270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.344271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.344272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.344273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.344274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.344275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.344276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.344277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.344278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.344280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.344281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.344282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.344288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.344298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.344301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.344305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.344308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.344312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.344316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.344319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.344322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.344325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.344328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.344331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.344334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.344338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.344345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.344353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.344359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.344364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.344368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.344372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.344376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.344381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.344385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.344390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.344394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.344398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.344404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.344408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.344412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.344416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.344420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.344424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.344428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.344432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.344437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.344441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.344446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.344451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.344455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.344470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.344474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.344478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.344526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:51.348529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:51.349197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:51.349214Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:51.349217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:51.349221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:51.349228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 637 [2:7556255069290904113:5860]
2025-10-01T14:08:51.349247Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:51.349267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:51.349273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:51.349278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:51.349280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:51.349298Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:51.349304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:51.349311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:51.349375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.349384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.349386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.349389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:51.349392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:51.349468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:51.349477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.349492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.349504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.349521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:51.349713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 637
2025-10-01T14:08:51.349749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 637
2025-10-01T14:08:51.349544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255069290904095:5860]
2025-10-01T14:08:51.349551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255069290904095:5860]
2025-10-01T14:08:51.349553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255069290904095:5860]
2025-10-01T14:08:51.349563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:51.349578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:51.349588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:51.349593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:51.349596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:51.349598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:51.349601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:51.349608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768333:6582], now have 1 active actors on pipe
2025-10-01T14:08:51.349645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768127:2446], now have 1 active actors on pipe
2025-10-01T14:08:51.349648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255069290904095:5860]
2025-10-01T14:08:51.349660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:51.349667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:51.349906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.349919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.349961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:51.349969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:51.349974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:51.349976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:51.349988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:51.350000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:51.350018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:51.350513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.350527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.350551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:51.352601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 638 partition: 0 MaxSeqNo: 45 sessionId: src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0
2025-10-01T14:08:51.352993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db5799bf-699e936f-dfd22871-73385196_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:51.355819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0] Write session: try to update token
2025-10-01T14:08:51.355839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:51.378030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:51.378053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:51.378055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:51.378057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:51.378067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255069290904095:5860]
2025-10-01T14:08:51.378073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255069290904095:5860]
2025-10-01T14:08:51.378077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255069290904095:5860]
2025-10-01T14:08:51.378130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:51.378143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.378146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:51.378288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:51.376305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 638 sessionId: src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:51.378607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:51.378691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:51.378711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:51.378715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:51.410658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255071667768348:6355]
2025-10-01T14:08:51.411065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 637, pipe: [1:7556255071667768348:6355]
2025-10-01T14:08:51.532109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:51.532466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.532475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.532519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768348:6355], now have 1 active actors on pipe
2025-10-01T14:08:51.533197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:51.533211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:51.533269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 638 reason: error at write: Disconnected sessionId: src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0
2025-10-01T14:08:51.532992Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:51.533468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 638 sessionId: src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0 is DEAD
2025-10-01T14:08:51.533638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:51.533648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0] Write session will restart in 0.006256s
2025-10-01T14:08:51.533680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0] Write session: Do CDS request
2025-10-01T14:08:51.533686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:51.533659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:51.533695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255071667768348:6355]
2025-10-01T14:08:51.541260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.542497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:51.542513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 639
2025-10-01T14:08:51.546682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.546742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:51.546753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:51.546757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:51.547434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 639 sessionId:  describe result for acl check
2025-10-01T14:08:51.547469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:51.547470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:51.547472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:51.547477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255071667768411:6593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:51.549331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255071667768411:6593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:51.554676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255071667768411:6593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:51.559080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255071667768411:6593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:51.559096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255071667768411:6593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:51.559099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255071667768411:6593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:51.559107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:51.561230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:51.564225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:51.564479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:51.564492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:51.564503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:51.564555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:51.564598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255069290904338:5864]
2025-10-01T14:08:51.565326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:51.566155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:51.566232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:51.566668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:51.566753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.566760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.566762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.566763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.566764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.566765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.566767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.566768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.566769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.566771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.566772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.566773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.566774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.566775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.566782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.566801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.566804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.566808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.566812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.566817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.566822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.566827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.566831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.566835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.566840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.566846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.566850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.566854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.566864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.566874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.566884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.566889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.566895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.566901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.566906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.566912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.566925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.566932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.566942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.566947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.566959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.566966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.566977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.566983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.566994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.567000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.567010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.567016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.567029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.567040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.567055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.567064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.567070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.567081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.567086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.567097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.567155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:51.572483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:51.573161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:51.573178Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:51.573182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:51.573185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:51.573192Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 638 [2:7556255069290904338:5864]
2025-10-01T14:08:51.573209Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:51.573227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:51.573230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:51.573234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:51.573236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:51.573253Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:51.573263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:51.573270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:51.573338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.573340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.573342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.573345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:51.573348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:51.573423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:51.573425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.573436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.573445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.573459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:51.573476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255069290904333:5864]
2025-10-01T14:08:51.573478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255069290904333:5864]
2025-10-01T14:08:51.573480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255069290904333:5864]
2025-10-01T14:08:51.573507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:51.573523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:51.573537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:51.573540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:51.573579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255069290904333:5864]
2025-10-01T14:08:51.573582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:51.573854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:51.573865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:51.573867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:51.573871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:51.574174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768583:6593], now have 1 active actors on pipe
2025-10-01T14:08:51.574185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768376:2446], now have 1 active actors on pipe
2025-10-01T14:08:51.574795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.574811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.574844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2649159d-7e407c2a-8554bab6-a777e612_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:51.574858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:51.574867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:51.574870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:51.574881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:51.574899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:51.574920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:51.575474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.574412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 638
2025-10-01T14:08:51.575485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.574445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 638
2025-10-01T14:08:51.575506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:51.575600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 639 partition: 0 MaxSeqNo: 45 sessionId: src_id|2649159d-7e407c2a-8554bab6-a777e612_0
2025-10-01T14:08:51.576142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9af7c065-4b432ca8-cb16d7c6-565a76d7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2649159d-7e407c2a-8554bab6-a777e612_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:51.578592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2649159d-7e407c2a-8554bab6-a777e612_0] Write session: try to update token
2025-10-01T14:08:51.578610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2649159d-7e407c2a-8554bab6-a777e612_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:51.600236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 639 sessionId: src_id|2649159d-7e407c2a-8554bab6-a777e612_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:51.601447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:51.601466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:51.601468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:51.601470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:51.601480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255069290904333:5864]
2025-10-01T14:08:51.601484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255069290904333:5864]
2025-10-01T14:08:51.601488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255069290904333:5864]
2025-10-01T14:08:51.601528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:51.601532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:51.601534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:51.601537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:51.601538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.601539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:51.601684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:51.602736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:51.633701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255071667768608:6355]
2025-10-01T14:08:51.634247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 638, pipe: [1:7556255071667768608:6355]
2025-10-01T14:08:51.755735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:51.756275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.756286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.756329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768608:6355], now have 1 active actors on pipe
2025-10-01T14:08:51.756562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:51.757325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:51.757329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255071667768608:6355]
2025-10-01T14:08:51.757350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:51.757415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 639 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2649159d-7e407c2a-8554bab6-a777e612_0
2025-10-01T14:08:51.757595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 639 sessionId: src_id|2649159d-7e407c2a-8554bab6-a777e612_0 is DEAD
2025-10-01T14:08:51.757841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2649159d-7e407c2a-8554bab6-a777e612_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:51.757850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2649159d-7e407c2a-8554bab6-a777e612_0] Write session will restart in 0.009312s
2025-10-01T14:08:51.757887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2649159d-7e407c2a-8554bab6-a777e612_0] Write session: Do CDS request
2025-10-01T14:08:51.757894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2649159d-7e407c2a-8554bab6-a777e612_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:51.767941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2649159d-7e407c2a-8554bab6-a777e612_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.768193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:51.768206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 640
2025-10-01T14:08:51.772004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.772063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:51.772074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:51.772078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:51.773200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 640 sessionId:  describe result for acl check
2025-10-01T14:08:51.773236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:51.773238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:51.773240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:51.773246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255071667768647:6599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:51.773728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255071667768647:6599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:51.778711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255071667768647:6599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:51.784078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255071667768647:6599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:51.784096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255071667768647:6599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:51.784100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255071667768647:6599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:51.784109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:51.784700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:51.787427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:51.787683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:51.787696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:51.787708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:51.787762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:51.787798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255069290904556:5869]
2025-10-01T14:08:51.788407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:51.788734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:51.788786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:51.789002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:51.789042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.789043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.789044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.789045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.789045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.789046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.789047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.789048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.789048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.789049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.789050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.789050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.789051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.789052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.789055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.789061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.789064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.789067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.789069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.789071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.789073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.789075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.789077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.789079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.789081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.789083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.789085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.789087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.789092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.789098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:51.789102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.789106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:51.789108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.789111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:51.789113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.789116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:51.789119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.789123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:51.789126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.789131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:51.789136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.789141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:51.789145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.789150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:51.789155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.789160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:51.789165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.789169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.789171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.789174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.789176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.789179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.789181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.789184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:51.789187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.789189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:51.789220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:51.793257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:51.793926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:51.793932Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:51.793935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:51.793938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:51.793947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 639 [2:7556255069290904556:5869]
2025-10-01T14:08:51.793966Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:51.793985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:51.793989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:51.793993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:51.793996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:51.794015Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:51.794021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:51.794027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:51.794092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.794094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.794097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.794101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:51.794103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:51.794177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:51.794180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.794192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:51.794203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:51.794217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:51.794236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768824:6599], now have 1 active actors on pipe
2025-10-01T14:08:51.794242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768613:2446], now have 1 active actors on pipe
2025-10-01T14:08:51.794250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255069290904551:5869]
2025-10-01T14:08:51.794251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255069290904551:5869]
2025-10-01T14:08:51.794253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255069290904551:5869]
2025-10-01T14:08:51.794269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:51.794282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:51.794285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:51.794286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:51.794287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:51.794300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:51.794303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:51.794340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255069290904551:5869]
2025-10-01T14:08:51.794347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:51.794354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:51.794359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 639
2025-10-01T14:08:51.794410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 639
2025-10-01T14:08:51.794641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.794665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.794698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:51.794707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:51.794713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:51.794715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:51.794729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:51.794741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:51.794757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:51.795344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.795358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.795381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:51.796205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 640 partition: 0 MaxSeqNo: 45 sessionId: src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0
2025-10-01T14:08:51.796603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2649159d-7e407c2a-8554bab6-a777e612_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:51.799107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0] Write session: try to update token
2025-10-01T14:08:51.799125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:51.821314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 640 sessionId: src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:51.821808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:51.821829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:51.821832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:51.821835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:51.821844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255069290904551:5869]
2025-10-01T14:08:51.821850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255069290904551:5869]
2025-10-01T14:08:51.821853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255069290904551:5869]
2025-10-01T14:08:51.821902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:51.821905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:51.821912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:51.821914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:51.821918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:51.821922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:51.823894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:51.822059Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:51.854383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255071667768837:6355]
2025-10-01T14:08:51.856814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 639, pipe: [1:7556255071667768837:6355]
2025-10-01T14:08:51.989346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:51.989612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:51.989621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:51.989667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768837:6355], now have 1 active actors on pipe
2025-10-01T14:08:51.989981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:51.990072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:51.990085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:51.990086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255071667768837:6355]
2025-10-01T14:08:51.990107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:51.990140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 640 reason: error at write: Disconnected sessionId: src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0
2025-10-01T14:08:51.990294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 640 sessionId: src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0 is DEAD
2025-10-01T14:08:51.990637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:51.990644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0] Write session will restart in 0.007197s
2025-10-01T14:08:51.990664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0] Write session: Do CDS request
2025-10-01T14:08:51.990669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:51.999126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.999493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:51.999513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 641
2025-10-01T14:08:51.999697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:51.999740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:51.999751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:51.999755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:52.000187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 641 sessionId:  describe result for acl check
2025-10-01T14:08:52.000239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:52.000248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:52.000249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:52.000255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255071667768856:6603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:52.000790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255071667768856:6603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:52.005312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255071667768856:6603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:52.009595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255071667768856:6603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:52.009613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255071667768856:6603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:52.009616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255071667768856:6603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:52.009626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:52.019128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:52.022453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:52.022746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:52.022759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:52.022774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:52.022847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:52.022896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255073585872100:5881]
2025-10-01T14:08:52.023757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:52.025891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:52.025964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:52.026469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:52.026548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.026554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.026555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.026557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.026558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.026560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.026562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.026564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.026565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.026567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.026568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.026569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.026571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.026573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.026581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.026592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.026596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.026601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.026606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.026610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.026614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.026618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.026623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.026628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.026631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.026635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.026640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.026644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.026653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.026663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.026676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.026685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.026694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.026702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.026711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.026718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.026728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.026733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.026736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.026741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.026747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.026751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.026757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.026769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.026775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.026781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.026785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.026790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.026794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.026799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.026804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.026808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.026812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.026818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.026822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.026826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.026864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:52.031322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:52.032401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:52.032409Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:52.032412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:52.032416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:52.032423Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 640 [2:7556255073585872100:5881]
2025-10-01T14:08:52.032440Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:52.032460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:52.032463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:52.032466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:52.032469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:52.032487Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:52.032493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:52.032499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:52.032564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.032566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.032567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.032570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:52.032572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:52.032647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:52.032649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.032664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.032674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.032689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:52.032708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255073585872094:5881]
2025-10-01T14:08:52.032711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255073585872094:5881]
2025-10-01T14:08:52.032712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255073585872094:5881]
2025-10-01T14:08:52.032727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:52.032741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:52.032755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:52.032758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:52.032810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255073585872094:5881]
2025-10-01T14:08:52.032813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:52.033051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:52.033062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:52.033064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:52.033069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:52.033306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 640
2025-10-01T14:08:52.033306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 640
2025-10-01T14:08:52.033505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255075962736345:6603], now have 1 active actors on pipe
2025-10-01T14:08:52.033516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255071667768843:2446], now have 1 active actors on pipe
2025-10-01T14:08:52.033534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.033540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.033565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f62cf54c-4861c64f-51220deb-de7e8625_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:52.033576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:52.033580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:52.033583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:52.033593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:52.033605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:52.033621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:52.034420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.034432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.034455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:52.035699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 641 partition: 0 MaxSeqNo: 45 sessionId: src_id|f62cf54c-4861c64f-51220deb-de7e8625_0
2025-10-01T14:08:52.037977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf0fb6ea-2721ff04-632fd1d3-be34ec92_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f62cf54c-4861c64f-51220deb-de7e8625_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:52.040444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f62cf54c-4861c64f-51220deb-de7e8625_0] Write session: try to update token
2025-10-01T14:08:52.040464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f62cf54c-4861c64f-51220deb-de7e8625_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:52.054079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 641 sessionId: src_id|f62cf54c-4861c64f-51220deb-de7e8625_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:52.056403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:52.056612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.056638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.056677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:52.056856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:52.060568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:52.060586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:52.060588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:52.060590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:52.060601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255073585872094:5881]
2025-10-01T14:08:52.060608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255073585872094:5881]
2025-10-01T14:08:52.060611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255073585872094:5881]
2025-10-01T14:08:52.060659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:52.060667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.060669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:52.060813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:52.061591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:52.061598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:52.061602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:52.088899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255075962736363:6355]
2025-10-01T14:08:52.094463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 640, pipe: [1:7556255075962736363:6355]
2025-10-01T14:08:52.222745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:52.232071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.232093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.232251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.232327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.232396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.232457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.232505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.232510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.232587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.232654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.232717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.232801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.232844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.232847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.232908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.232957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.233020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.233112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.233151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.233153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.233218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.233281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.233336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.233396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.233435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.233438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.233502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.233560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.233622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.233679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.233726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.233729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.233791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.233848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.233906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.233963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.234005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.234012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.234087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.234144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.234205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.234263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.234317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.234324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.234775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.234843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.234904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.234973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.235019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.235022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.235097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.235159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.235227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.235293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.235340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.235343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.235414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.235490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.235558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.235627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.235681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.235683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.235747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255075962736363:6355], now have 1 active actors on pipe
2025-10-01T14:08:52.236911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:52.239429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:52.239489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 641 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f62cf54c-4861c64f-51220deb-de7e8625_0
2025-10-01T14:08:52.239665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 641 sessionId: src_id|f62cf54c-4861c64f-51220deb-de7e8625_0 is DEAD
2025-10-01T14:08:52.239810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255075962736363:6355]
2025-10-01T14:08:52.239823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:52.242577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62cf54c-4861c64f-51220deb-de7e8625_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:52.242591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62cf54c-4861c64f-51220deb-de7e8625_0] Write session will restart in 0.005270s
2025-10-01T14:08:52.242617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62cf54c-4861c64f-51220deb-de7e8625_0] Write session: Do CDS request
2025-10-01T14:08:52.242623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62cf54c-4861c64f-51220deb-de7e8625_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:52.250193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f62cf54c-4861c64f-51220deb-de7e8625_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:52.258512Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:52.258531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 642
2025-10-01T14:08:52.258718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:52.258760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:52.258766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:52.258770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:52.259442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 642 sessionId:  describe result for acl check
2025-10-01T14:08:52.259478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:52.259480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:52.259482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:52.259488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255075962736394:6610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:52.260004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255075962736394:6610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:52.264526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255075962736394:6610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:52.270363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255075962736394:6610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:52.270395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255075962736394:6610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:52.270398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255075962736394:6610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:52.270408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:52.291908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:52.301527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:52.301868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:52.301874Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:52.301888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:52.301971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:52.302017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255073585872319:5883]
2025-10-01T14:08:52.302621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:52.307324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:52.307413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:52.307810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:52.307875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.307876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.307877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.307879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.307880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.307882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.307884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.307885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.307887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.307888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.307889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.307891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.307892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.307893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.307900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.307910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.307914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.307917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.307921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.307925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.307928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.307932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.307935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.307939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.307943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.307947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.307951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.307955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.307962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.307972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.307978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.307983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.307989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.307994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.307997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.308002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.308006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.308011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.308016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.308020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.308025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.308030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.308034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.308039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.308044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.308049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.308054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.308059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.308067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.308074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.308078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.308083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.308086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.308091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.308097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.308102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.308137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:52.320359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:52.321355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:52.321374Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:52.321376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:52.321379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:52.321386Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 641 [2:7556255073585872319:5883]
2025-10-01T14:08:52.321402Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:52.321421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:52.321425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:52.321428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:52.321430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:52.321446Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:52.321452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:52.321459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:52.321533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.321535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.321539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.321542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:52.321545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:52.321618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:52.321621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.321634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.321643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.321657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:52.321673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255073585872313:5883]
2025-10-01T14:08:52.321676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255073585872313:5883]
2025-10-01T14:08:52.321677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255073585872313:5883]
2025-10-01T14:08:52.321690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:52.321704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:52.321718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:52.321720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:52.321763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255073585872313:5883]
2025-10-01T14:08:52.321765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:52.322564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255075962736371:2446], now have 1 active actors on pipe
2025-10-01T14:08:52.322567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:52.322570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:52.322572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255075962736454:6610], now have 1 active actors on pipe
2025-10-01T14:08:52.322572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:52.322578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:52.323673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 641
2025-10-01T14:08:52.323719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 641
2025-10-01T14:08:52.329670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.329706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.329745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:52.329758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:52.329764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:52.329767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:52.329780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:52.329799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:52.329823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:52.330302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.330313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.330332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:52.330499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 642 partition: 0 MaxSeqNo: 45 sessionId: src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0
2025-10-01T14:08:52.330952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62cf54c-4861c64f-51220deb-de7e8625_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:52.333791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0] Write session: try to update token
2025-10-01T14:08:52.333812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:52.342445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255075962736598:6355]
2025-10-01T14:08:52.344930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 641, pipe: [1:7556255075962736598:6355]
2025-10-01T14:08:52.346416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255075962736598:6355], now have 1 active actors on pipe
2025-10-01T14:08:52.376208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 642 sessionId: src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:52.379108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:52.379421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.379442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.379479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:52.381519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:52.389336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:52.389360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:52.389363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:52.389365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:52.389375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255073585872313:5883]
2025-10-01T14:08:52.389381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255073585872313:5883]
2025-10-01T14:08:52.389385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255073585872313:5883]
2025-10-01T14:08:52.389436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:52.389445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.389448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:52.389607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:52.390865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:52.390878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:52.390882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:52.590022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:52.600562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.600591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.600810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.600891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.600978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.601062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.601115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.601121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.601215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.601283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.601349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.601423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.601483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.601486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.601558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.601625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.601692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.601761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.601807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.601810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.601889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.601958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.602027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.602098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.602147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.602150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.602225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.602292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.602358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.605219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:52.605278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255075962736598:6355]
2025-10-01T14:08:52.605301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:52.605304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:52.605331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 642 reason: error at write: Disconnected sessionId: src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0
2025-10-01T14:08:52.605539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 642 sessionId: src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0 is DEAD
2025-10-01T14:08:52.602704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.602759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.602763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.602843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.602910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.602982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.603053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.603101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.603104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.603179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.603243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.603312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.603374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.603417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.603420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.603491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.603557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.603622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.603694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.603740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.603742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.603819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.603883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.603952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.604031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.604082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.604085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.605988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:52.606004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0] Write session will restart in 0.005356s
2025-10-01T14:08:52.606032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0] Write session: Do CDS request
2025-10-01T14:08:52.606038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:52.604168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.604238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.604308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.604376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.604422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.604424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.606140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:52.614822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:52.616859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:52.616875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 643
2025-10-01T14:08:52.617413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:52.617451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:52.617455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:52.617459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:52.617949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 643 sessionId:  describe result for acl check
2025-10-01T14:08:52.617981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:52.617982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:52.617984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:52.617989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255075962736637:6621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:52.618528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255075962736637:6621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:52.626198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255075962736637:6621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:52.636145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255075962736637:6621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:52.636165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255075962736637:6621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:52.636171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255075962736637:6621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:52.636181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:52.668095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:52.674115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:52.674452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:52.674466Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:52.674483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:52.674562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:52.674609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255073585872562:5887]
2025-10-01T14:08:52.675215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:52.675667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:52.675718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:52.676034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:52.676114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.676115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.676117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.676118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.676119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.676121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.676122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.676123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.676125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.676126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.676127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.676128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.676129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.676130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.676136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.676146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.676149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.676153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.676156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.676160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.676163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.676167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.676171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.676174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.676177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.676181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.676185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.676188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.676197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.676204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:52.676211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.676216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:52.676224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.676228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:52.676232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.676237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:52.676241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.676246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:52.676250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.676254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:52.676258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.676263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:52.676267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.676272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:52.676276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.676281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:52.676286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.676290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.676294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.676299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.676302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.676306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.676310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.676315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:52.676318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.676323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:52.676359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:52.681385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:52.682109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:52.682115Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:52.682118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:52.682121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:52.682129Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 642 [2:7556255073585872562:5887]
2025-10-01T14:08:52.682145Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:52.682164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:52.682168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:52.682172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:52.682174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:52.682190Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:52.682196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:52.682202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:52.682279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.682280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.682283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.682288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:52.682290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:52.682362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:52.682364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.682389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:52.682398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:52.682413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:52.682430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255073585872556:5887]
2025-10-01T14:08:52.682433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255073585872556:5887]
2025-10-01T14:08:52.682434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255073585872556:5887]
2025-10-01T14:08:52.682447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:52.682461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:52.682473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:52.682476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:52.682513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255073585872556:5887]
2025-10-01T14:08:52.682516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:52.682604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:52.682606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:52.682608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:52.682612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:52.683141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 642
2025-10-01T14:08:52.683141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 642
2025-10-01T14:08:52.687158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255075962736704:6621], now have 1 active actors on pipe
2025-10-01T14:08:52.687172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255075962736629:2446], now have 1 active actors on pipe
2025-10-01T14:08:52.687200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.687207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.687241Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:52.687252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:52.687257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:52.687260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:52.687272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:52.687288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:52.687304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:52.687688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.687695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.687709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:52.687836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 643 partition: 0 MaxSeqNo: 45 sessionId: src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0
2025-10-01T14:08:52.688260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31bb70f-ea445e44-cf505721-e5fd66ed_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:52.691195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0] Write session: try to update token
2025-10-01T14:08:52.691218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:52.709893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255075962736865:6355], now have 1 active actors on pipe
2025-10-01T14:08:52.708659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255075962736865:6355]
2025-10-01T14:08:52.710117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 642, pipe: [1:7556255075962736865:6355]
2025-10-01T14:08:52.730058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 643 sessionId: src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:52.733162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:52.742223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.742248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.742292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:52.742452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:52.751965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:52.751991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:52.751994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:52.751996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:52.752007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255073585872556:5887]
2025-10-01T14:08:52.752012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255073585872556:5887]
2025-10-01T14:08:52.752016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255073585872556:5887]
2025-10-01T14:08:52.752069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:52.752084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:52.752091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:52.752248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:52.752279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:52.752293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:52.752297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:52.964508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:52.974700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:52.974733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:52.974976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.975041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.975105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.975170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.975214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.975219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.975299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.975360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.975440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.975514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.975559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.975562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.975625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.975678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.975736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.975791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.975832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.975836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.975905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.975967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.976029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.976089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.976129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.976132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.976197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.976250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.976308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.976366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.976406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.976409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.976475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.976534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.976600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.976661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.976704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.976706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.976786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.976841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.976901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.976961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.977003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.977006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.977071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.977133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.977191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.977253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.977303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.977306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.977374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.977432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.977500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.977564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.977609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.977612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.977682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:52.977749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:52.977816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:52.977878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:52.977921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:52.977924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:52.979986Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:52.983009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:52.983061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255075962736865:6355]
2025-10-01T14:08:52.983078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:52.983116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 643 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0
2025-10-01T14:08:52.983474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:52.983486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0] Write session will restart in 0.009613s
2025-10-01T14:08:52.983514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0] Write session: Do CDS request
2025-10-01T14:08:52.983520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:52.983309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 643 sessionId: src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0 is DEAD
2025-10-01T14:08:52.993939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:52.994288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:52.994305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 644
2025-10-01T14:08:52.994527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:52.994563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:52.994569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:52.994573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:52.995063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 644 sessionId:  describe result for acl check
2025-10-01T14:08:52.995102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:52.995107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:52.995109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:52.995113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255075962736883:6627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:52.995713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255075962736883:6627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:53.010640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255075962736883:6627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:53.023249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255075962736883:6627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:53.023273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255075962736883:6627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:53.023276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255075962736883:6627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:53.023287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:53.044448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:53.049873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:53.050176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:53.050180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:53.050192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:53.050243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:53.050282Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255077880840111:5902]
2025-10-01T14:08:53.050929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:53.054487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:53.054570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:53.054973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:53.055030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.055032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.055034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.055035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.055036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.055038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.055039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.055040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.055041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.055043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.055044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.055045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.055047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.055048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.055055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.055065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.055069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.055073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.055077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.055081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.055085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.055089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.055093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.055097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.055101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.055105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.055108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.055112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.055120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.055129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.055136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.055141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.055146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.055151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.055156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.055161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.055166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.055171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.055176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.055183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.055191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.055196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.055201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.055206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.055211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.055216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.055221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.055226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.055231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.055236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.055243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.055249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.055254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.055258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.055263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.055268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.055308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:53.064059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:53.064809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:53.064823Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:53.064826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:53.064830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:53.064838Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 643 [2:7556255077880840111:5902]
2025-10-01T14:08:53.064857Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:53.064878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:53.064881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:53.064886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:53.064888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:53.064907Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:53.064914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:53.064922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:53.064993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.064997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.064999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.065002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:53.065005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:53.065086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:53.065088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.065100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.065110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.065126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:53.065143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255077880840105:5902]
2025-10-01T14:08:53.065146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255077880840105:5902]
2025-10-01T14:08:53.065149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255077880840105:5902]
2025-10-01T14:08:53.065163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:53.065178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:53.065190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:53.065194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:53.065235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255077880840105:5902]
2025-10-01T14:08:53.065237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:53.065564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:53.065566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:53.065568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:53.065573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:53.066509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257704295:6627], now have 1 active actors on pipe
2025-10-01T14:08:53.066519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255075962736874:2446], now have 1 active actors on pipe
2025-10-01T14:08:53.066583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 643
2025-10-01T14:08:53.066617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 643
2025-10-01T14:08:53.070640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.070660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.070703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:53.070717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:53.070723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:53.070727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:53.070740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:53.070756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:53.070780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:53.072992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.073005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.073041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:53.073948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 644 partition: 0 MaxSeqNo: 45 sessionId: src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0
2025-10-01T14:08:53.074693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4b588e4-a70abb1e-a59771b1-ec1157d3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:53.077358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0] Write session: try to update token
2025-10-01T14:08:53.077380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:53.083109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255080257704392:6355]
2025-10-01T14:08:53.086795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 643, pipe: [1:7556255080257704392:6355]
2025-10-01T14:08:53.086655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257704392:6355], now have 1 active actors on pipe
2025-10-01T14:08:53.100666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:53.100687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:53.100690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:53.100692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:53.100704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255077880840105:5902]
2025-10-01T14:08:53.100710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255077880840105:5902]
2025-10-01T14:08:53.100714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255077880840105:5902]
2025-10-01T14:08:53.100766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:53.100785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.100788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:53.100933Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:53.102522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:53.102534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:53.102539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:53.108998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 644 sessionId: src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:53.111853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:53.301846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:53.302635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.302685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.306782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:53.307826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:53.307914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 644 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0
2025-10-01T14:08:53.310723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:53.310740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0] Write session will restart in 0.007071s
2025-10-01T14:08:53.310770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0] Write session: Do CDS request
2025-10-01T14:08:53.310777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:53.308093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 644 sessionId: src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0 is DEAD
2025-10-01T14:08:53.308225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:53.308260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255080257704392:6355]
2025-10-01T14:08:53.322949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:53.323804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:53.323831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 645
2025-10-01T14:08:53.324049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:53.324095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:53.324111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:53.324116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:53.324620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 645 sessionId:  describe result for acl check
2025-10-01T14:08:53.324664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:53.324669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:53.324671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:53.324678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255080257704424:6632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:53.325367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255080257704424:6632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:53.347399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255080257704424:6632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:53.358568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255080257704424:6632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:53.358591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255080257704424:6632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:53.358594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255080257704424:6632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:53.358603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:53.370090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:53.370290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:53.370507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:53.370521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:53.370535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:53.370590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:53.370637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255077880840348:5904]
2025-10-01T14:08:53.371327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:53.371903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:53.371951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:53.372372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:53.372419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.372420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.372422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.372422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.372424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.372426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.372427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.372429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.372430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.372431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.372432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.372433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.372434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.372435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.372441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.372451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.372456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.372459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.372463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.372466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.372469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.372473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.372477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.372481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.372485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.372488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.372492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.372495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.372503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.372510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.372517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.372522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.372526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.372532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.372554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.372559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.372564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.372569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.372574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.372578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.372583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.372587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.372592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.372596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.372600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.372605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.372609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.372614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.372618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.372623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.372627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.372632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.372639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.372645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.372649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.372654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.372693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:53.379347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:53.380157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:53.380164Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:53.380167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:53.380172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:53.380180Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 644 [2:7556255077880840348:5904]
2025-10-01T14:08:53.380200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:53.380221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:53.380226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:53.380230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:53.380234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:53.380253Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:53.380261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:53.380268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:53.380349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.380352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.380355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.380359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:53.380363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:53.380450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:53.380453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.380468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.380480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.380497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:53.380516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255077880840343:5904]
2025-10-01T14:08:53.380519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255077880840343:5904]
2025-10-01T14:08:53.380522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255077880840343:5904]
2025-10-01T14:08:53.380537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:53.380554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:53.380570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:53.380574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:53.380621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255077880840343:5904]
2025-10-01T14:08:53.380624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:53.383476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 644
2025-10-01T14:08:53.383518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 644
2025-10-01T14:08:53.382662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:53.382672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:53.382675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:53.382681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:53.382970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257704411:2446], now have 1 active actors on pipe
2025-10-01T14:08:53.382978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257704598:6632], now have 1 active actors on pipe
2025-10-01T14:08:53.383764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.383781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.383823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:53.383835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:53.383842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:53.383847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:53.383861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:53.383890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:53.383917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:53.390576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.390594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.390629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:53.390775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 645 partition: 0 MaxSeqNo: 45 sessionId: src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0
2025-10-01T14:08:53.391286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8cde682-9f15fb87-16a86163-134ab5c1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:53.394101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0] Write session: try to update token
2025-10-01T14:08:53.394121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:53.410019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255080257704635:6355]
2025-10-01T14:08:53.410516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257704635:6355], now have 1 active actors on pipe
2025-10-01T14:08:53.410633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 644, pipe: [1:7556255080257704635:6355]
2025-10-01T14:08:53.426442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:53.426458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:53.426460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:53.426463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:53.426472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255077880840343:5904]
2025-10-01T14:08:53.426478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255077880840343:5904]
2025-10-01T14:08:53.426482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255077880840343:5904]
2025-10-01T14:08:53.426530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:53.426538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.426541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:53.426694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:53.427671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:53.427684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:53.427687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:53.433302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 645 sessionId: src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:53.436141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:53.595814Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:53.596430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.596442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.597423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:53.597480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255080257704635:6355]
2025-10-01T14:08:53.597498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:53.597564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 645 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0
2025-10-01T14:08:53.597735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 645 sessionId: src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0 is DEAD
2025-10-01T14:08:53.598710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:53.598719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0] Write session will restart in 0.005058s
2025-10-01T14:08:53.598746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0] Write session: Do CDS request
2025-10-01T14:08:53.598753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:53.596799Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:53.606141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:53.606282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:53.606296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 646
2025-10-01T14:08:53.606395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:53.606424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:53.606429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:53.606433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:53.606797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 646 sessionId:  describe result for acl check
2025-10-01T14:08:53.606837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:53.606838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:53.606839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:53.606843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255080257704664:6637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:53.607345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255080257704664:6637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:53.619030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255080257704664:6637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:53.632136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255080257704664:6637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:53.632154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255080257704664:6637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:53.632158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255080257704664:6637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:53.632166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:53.644964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:53.651482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:53.651713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:53.651717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:53.651725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:53.651768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:53.651813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255077880840571:5908]
2025-10-01T14:08:53.652252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:53.652666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:53.652699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:53.654795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:53.654901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.654902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.654903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.654904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.654905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.654905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.654907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.654908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.654908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.654909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.654910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.654911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.654911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.654912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.654917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.654923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.654926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.654928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.654930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.654933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.654935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.654937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.654939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.654942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.654944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.654946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.654949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.654951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.654961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.654966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.654971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.654975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.654978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.654982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.654984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.654988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.654991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.654994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.654997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.655000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.655003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.655006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.655009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.655012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.655014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.655017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.655020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.655023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.655030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.655032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.655035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.655038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.655040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.655043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.655046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.655049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.655071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:53.663786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:53.664404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:53.664409Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:53.664411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:53.664413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:53.664419Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 645 [2:7556255077880840571:5908]
2025-10-01T14:08:53.664430Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:53.664444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:53.664446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:53.664449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:53.664450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:53.664463Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:53.664468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:53.664473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:53.664522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.664524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.664525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.664527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:53.664529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:53.664591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:53.664594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.664604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.664614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.664637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:53.664654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255077880840565:5908]
2025-10-01T14:08:53.664668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255077880840565:5908]
2025-10-01T14:08:53.664670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255077880840565:5908]
2025-10-01T14:08:53.664684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:53.664700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:53.664719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257704652:2446], now have 1 active actors on pipe
2025-10-01T14:08:53.664720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:53.664722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:53.664725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:53.664739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:53.664747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:53.664752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257704814:6637], now have 1 active actors on pipe
2025-10-01T14:08:53.664806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255077880840565:5908]
2025-10-01T14:08:53.664818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:53.664825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:53.665549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 645
2025-10-01T14:08:53.665601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 645
2025-10-01T14:08:53.665792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.665811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.665838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:53.665852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:53.665857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:53.665864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:53.665873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:53.665890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:53.665916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:53.671003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 646 partition: 0 MaxSeqNo: 45 sessionId: src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0
2025-10-01T14:08:53.670771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.670792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.670834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:53.672734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffff81bb-c670b50c-5c652302-bf6ed109_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:53.675355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0] Write session: try to update token
2025-10-01T14:08:53.675382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:53.688868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:53.688893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:53.688904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255077880840565:5908]
2025-10-01T14:08:53.688951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:53.689031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:53.689127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:53.689281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:53.689430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:53.689576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:53.689802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:53.689847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:53.697810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255080257704897:6355]
2025-10-01T14:08:53.698127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257704897:6355], now have 1 active actors on pipe
2025-10-01T14:08:53.698211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 645, pipe: [1:7556255080257704897:6355]
2025-10-01T14:08:53.712279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 646 sessionId: src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:53.714923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:53.715848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.715875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.715899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:53.715903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:53.715906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:53.715908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:53.715919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255077880840565:5908]
2025-10-01T14:08:53.715924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255077880840565:5908]
2025-10-01T14:08:53.715929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255077880840565:5908]
2025-10-01T14:08:53.715989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:53.715996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.715998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:53.716164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:53.718716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:53.718729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:53.718733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:53.894010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:53.894065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255080257704897:6355]
2025-10-01T14:08:53.894112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:53.894182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:53.894194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:53.892982Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:53.893418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:53.894261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 646 reason: error at write: Disconnected sessionId: src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0
2025-10-01T14:08:53.894419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 646 sessionId: src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0 is DEAD
2025-10-01T14:08:53.894555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:53.894566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0] Write session will restart in 0.005141s
2025-10-01T14:08:53.894594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0] Write session: Do CDS request
2025-10-01T14:08:53.894600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:53.905022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:53.907015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:53.907038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 647
2025-10-01T14:08:53.907163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:53.907193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:53.907199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:53.907203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:53.907656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 647 sessionId:  describe result for acl check
2025-10-01T14:08:53.907685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:53.907690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:53.907693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:53.907698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255080257704922:6649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:53.908263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255080257704922:6649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:53.923154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255080257704922:6649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:53.929572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255080257704922:6649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:53.929593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255080257704922:6649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:53.929597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255080257704922:6649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:53.929608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:53.943935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:53.944269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:53.944489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:53.944494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:53.944507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:53.944558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:53.944607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255077880840804:5913]
2025-10-01T14:08:53.945203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:53.945722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:53.945762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:53.946081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:53.946173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.946174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.946175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.946176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.946177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.946178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.946179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.946180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.946181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.946182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.946183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.946184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.946185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.946186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.946193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.946204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.946207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.946211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.946215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.946218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.946221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.946224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.946227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.946230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.946234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.946237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.946240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.946243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.946251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.946259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:53.946267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.946272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:53.946276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.946281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:53.946284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.946288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:53.946293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.946297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:53.946301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.946307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:53.946312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.946316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:53.946320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.946359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:53.946383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.946388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:53.946393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.946397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.946403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.946407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.946417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.946421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.946425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.946429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:53.946433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.946442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:53.946479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:53.952283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:53.953113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:53.953118Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:53.953121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:53.953124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:53.953132Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 646 [2:7556255077880840804:5913]
2025-10-01T14:08:53.953151Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:53.953171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:53.953174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:53.953178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:53.953181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:53.953200Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:53.953208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:53.953218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:53.953285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.953287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.953289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.953293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:53.953295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:53.953387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:53.953390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.953401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:53.953410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:53.953424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:53.953442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255077880840798:5913]
2025-10-01T14:08:53.953445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255077880840798:5913]
2025-10-01T14:08:53.953447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255077880840798:5913]
2025-10-01T14:08:53.953461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:53.953476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:53.953490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:53.953493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:53.953537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255077880840798:5913]
2025-10-01T14:08:53.953539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:53.954657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 646
2025-10-01T14:08:53.954688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 646
2025-10-01T14:08:53.953856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:53.953867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:53.953869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:53.953874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:53.954587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257705064:6649], now have 1 active actors on pipe
2025-10-01T14:08:53.954593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257704909:2446], now have 1 active actors on pipe
2025-10-01T14:08:53.955402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.955415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.955460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d46facac-6213a0eb-1100848-a9f21a30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:53.955470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:53.955477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:53.955480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:53.955494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:53.955508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:53.955529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:53.955888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.955897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.955915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:53.956072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 647 partition: 0 MaxSeqNo: 45 sessionId: src_id|d46facac-6213a0eb-1100848-a9f21a30_0
2025-10-01T14:08:53.957577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bce26b-b73956f3-f2a0d766-f5e3ba97_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d46facac-6213a0eb-1100848-a9f21a30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:53.960262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d46facac-6213a0eb-1100848-a9f21a30_0] Write session: try to update token
2025-10-01T14:08:53.960279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d46facac-6213a0eb-1100848-a9f21a30_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:53.984750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 647 sessionId: src_id|d46facac-6213a0eb-1100848-a9f21a30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:53.987639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:53.987964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:53.987987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:53.988027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:53.988153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:53.993542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255080257705138:6355]
2025-10-01T14:08:53.994664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 646, pipe: [1:7556255080257705138:6355]
2025-10-01T14:08:53.997277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255080257705138:6355], now have 1 active actors on pipe
2025-10-01T14:08:53.997311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:53.997315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:53.997318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:53.997321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:53.997331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255077880840798:5913]
2025-10-01T14:08:53.997337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255077880840798:5913]
2025-10-01T14:08:53.997341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255077880840798:5913]
2025-10-01T14:08:53.997396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:53.997402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:53.997405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:53.997409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:53.997414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:53.997416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:53.997636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:54.211439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:54.227932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:54.227965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:54.228161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.228223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.228291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.228356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.228800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.228815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.228896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.228977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.229052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.229122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.229165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.229168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.229237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.229298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.229361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.229427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.229468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.229471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.229548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.229862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.229927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.229990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.230034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.230037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.230110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.230167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.230228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.230293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.230336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.230339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.234304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.234405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.234509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.234646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.234695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.234701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.234835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.234969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.235103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.235326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.235388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.235393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.235524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.235611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.235681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.235765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.235812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.235815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.235902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.235962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.236027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.236093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.236139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.236142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.236210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.236273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.236334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.236394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.236435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.236438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.240197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255080257705138:6355]
2025-10-01T14:08:54.240229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:54.240269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 647 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d46facac-6213a0eb-1100848-a9f21a30_0
2025-10-01T14:08:54.240461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 647 sessionId: src_id|d46facac-6213a0eb-1100848-a9f21a30_0 is DEAD
2025-10-01T14:08:54.240581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:54.239557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:54.246499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46facac-6213a0eb-1100848-a9f21a30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:54.246514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46facac-6213a0eb-1100848-a9f21a30_0] Write session will restart in 0.008455s
2025-10-01T14:08:54.246542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46facac-6213a0eb-1100848-a9f21a30_0] Write session: Do CDS request
2025-10-01T14:08:54.246549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46facac-6213a0eb-1100848-a9f21a30_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:54.255956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d46facac-6213a0eb-1100848-a9f21a30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:54.258769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:54.258788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 648
2025-10-01T14:08:54.259312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:54.259347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:54.259353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:54.259357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:54.259930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 648 sessionId:  describe result for acl check
2025-10-01T14:08:54.259964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:54.259965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:54.259967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:54.259972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255084552672458:6654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:54.260507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255084552672458:6654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:54.272451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255084552672458:6654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:54.278276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255084552672458:6654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:54.278293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255084552672458:6654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:54.278298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255084552672458:6654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:54.278307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:54.317602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:54.317844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:54.318067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:54.318071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:54.318083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:54.318131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:54.318170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255082175808356:5925]
2025-10-01T14:08:54.318801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:54.319464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:54.319515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:54.319879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:54.319931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:54.319933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:54.319934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:54.319935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:54.319937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:54.319938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:54.319939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:54.319941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:54.319942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:54.319943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.319945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.319946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.319948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:54.319950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:54.319956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:54.319967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:54.319971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:54.319976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:54.319980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:54.319985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:54.319989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:54.319993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:54.319997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:54.320001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.320006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.320010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.320014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:54.320018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:54.320027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:54.320035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:54.320042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:54.320048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:54.320053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:54.320058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:54.320063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:54.320069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:54.320074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:54.320080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:54.320085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:54.320090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:54.320095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:54.320101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:54.320106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:54.320111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:54.320116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:54.320121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:54.320127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.320133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.320137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.320143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.320148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.320154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.320159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:54.320164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:54.320169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:54.320174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:54.320230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:54.328108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:54.328823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:54.328830Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:54.328833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:54.328839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:54.328847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 647 [2:7556255082175808356:5925]
2025-10-01T14:08:54.328867Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:54.328889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:54.328893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:54.328897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:54.328899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:54.328919Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:54.328925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:54.328932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:54.329006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.329009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.329012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.329015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:54.329018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:54.329097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:54.329100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.329114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.329125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.329142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:54.329159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255082175808350:5925]
2025-10-01T14:08:54.329162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255082175808350:5925]
2025-10-01T14:08:54.329164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255082175808350:5925]
2025-10-01T14:08:54.329178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:54.329194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:54.329207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:54.329211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:54.329255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255082175808350:5925]
2025-10-01T14:08:54.329258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:54.329505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:54.329514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:54.329516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:54.329521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:54.330287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 647
2025-10-01T14:08:54.330316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 647
2025-10-01T14:08:54.330655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255084552672523:6654], now have 1 active actors on pipe
2025-10-01T14:08:54.330670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255084552672449:2446], now have 1 active actors on pipe
2025-10-01T14:08:54.330907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:54.330915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:54.330948Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:54.330958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:54.330964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:54.330967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:54.330979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:54.330993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:54.331012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:54.331268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:54.331278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:54.331292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:54.331411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 648 partition: 0 MaxSeqNo: 45 sessionId: src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0
2025-10-01T14:08:54.334673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d46facac-6213a0eb-1100848-a9f21a30_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:54.337339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0] Write session: try to update token
2025-10-01T14:08:54.337362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:54.338711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255084552672682:6355]
2025-10-01T14:08:54.344913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255084552672682:6355], now have 1 active actors on pipe
2025-10-01T14:08:54.345128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 647, pipe: [1:7556255084552672682:6355]
2025-10-01T14:08:54.398938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 648 sessionId: src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:54.401607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:54.402811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:54.402832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:54.404844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:54.404874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:54.404877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:54.404880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:54.404882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:54.404893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255082175808350:5925]
2025-10-01T14:08:54.404898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255082175808350:5925]
2025-10-01T14:08:54.404902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255082175808350:5925]
2025-10-01T14:08:54.404950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:54.404957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.404960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:54.405119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:54.406607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:54.406619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:54.406623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:54.410392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:54.698303Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:54.707475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:54.707507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:54.707704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.707763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.707831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.707906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.707953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.707959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.708047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.708106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.708171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.708246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.708291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.708294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.708361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.708414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.708479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.708546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.708596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.708599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.708672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.708731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.708809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.708872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.708911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.708914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.708990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.709044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.709103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.709161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.709206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.709209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.709278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.709357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.709422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.709485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.709527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.709530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.709595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.709646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.709702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.709760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.709802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.709805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.709872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.709929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.709987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.710051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.710104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.710107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.710178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.710242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.710305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.710952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.711008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.711012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.711085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:54.711140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:54.711200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:54.711272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:54.711320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:54.711323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:54.713116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:54.716079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:54.716151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 648 reason: status is not ok: tablet will be restarted right now sessionId: src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0
2025-10-01T14:08:54.716340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 648 sessionId: src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0 is DEAD
2025-10-01T14:08:54.717205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:54.717262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255084552672682:6355]
2025-10-01T14:08:54.718721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:54.718729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0] Write session will restart in 0.006678s
2025-10-01T14:08:54.718755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0] Write session: Do CDS request
2025-10-01T14:08:54.718762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:54.726938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:54.727213Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:54.727240Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 649
2025-10-01T14:08:54.727388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:54.727424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:54.727439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:54.727451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:54.728182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 649 sessionId:  describe result for acl check
2025-10-01T14:08:54.728226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:54.728228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:54.728229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:54.728235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255084552672728:6666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:54.728813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255084552672728:6666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:54.751724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255084552672728:6666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:54.766088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:54.764891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255084552672728:6666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:54.764914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255084552672728:6666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:54.764918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255084552672728:6666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:54.764927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:54.776286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:54.776570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:54.776574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:54.776587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:54.776641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:54.776682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255082175808607:5929]
2025-10-01T14:08:54.777651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:54.780184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:54.780261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:54.780706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:54.780803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:54.780811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:54.780813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:54.780815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:54.780816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:54.780818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:54.780820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:54.780821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:54.780823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:54.780824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.780826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.780827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.780829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:54.780830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:54.780839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:54.780850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:54.780854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:54.780859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:54.780863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:54.780868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:54.780872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:54.780876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:54.780881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:54.780885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.780889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.780893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.780898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:54.780901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:54.780911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:54.780921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:54.780929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:54.780935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:54.780940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:54.780946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:54.780951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:54.780957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:54.780962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:54.780968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:54.780973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:54.780979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:54.780984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:54.780990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:54.780995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:54.781000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:54.781007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:54.781013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:54.781018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.781024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.781029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.781039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.781049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.781055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.781062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:54.781073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:54.781078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:54.781084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:54.781128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:54.799590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:54.800358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:54.800376Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:54.800379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:54.800384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:54.800392Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 648 [2:7556255082175808607:5929]
2025-10-01T14:08:54.800414Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:54.800435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:54.800439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:54.800442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:54.800445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:54.800462Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:54.800469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:54.800476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:54.800556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.800559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.800562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.800565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:54.800568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:54.800998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:54.801010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.801024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:54.801034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:54.801052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:54.801079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255084552672939:6666], now have 1 active actors on pipe
2025-10-01T14:08:54.801087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255084552672707:2446], now have 1 active actors on pipe
2025-10-01T14:08:54.801095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255082175808593:5929]
2025-10-01T14:08:54.801097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255082175808593:5929]
2025-10-01T14:08:54.801100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255082175808593:5929]
2025-10-01T14:08:54.801115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:54.801135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:54.801156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:54.801163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:54.801217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255082175808593:5929]
2025-10-01T14:08:54.801224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:54.801328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:54.801330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:54.801333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:54.801339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:54.803589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:54.803609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:54.803651Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:54.803662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:54.803667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:54.803670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:54.803686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:54.803701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:54.803717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:54.803036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 648
2025-10-01T14:08:54.803079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 648
2025-10-01T14:08:54.814586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:54.814611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:54.814659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:54.814908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 649 partition: 0 MaxSeqNo: 45 sessionId: src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0
2025-10-01T14:08:54.815245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255084552672955:6355]
2025-10-01T14:08:54.818522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|630bbdc3-d6abfae4-e7ccc3b4-661e62e4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:54.818550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255084552672955:6355], now have 1 active actors on pipe
2025-10-01T14:08:54.821454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0] Write session: try to update token
2025-10-01T14:08:54.821476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:54.822613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 648, pipe: [1:7556255084552672955:6355]
2025-10-01T14:08:54.858441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 649 sessionId: src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:54.861186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:54.866736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:54.862600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:54.862628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:54.864690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:54.864695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:54.864699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:54.864701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:54.864711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255082175808593:5929]
2025-10-01T14:08:54.864720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255082175808593:5929]
2025-10-01T14:08:54.864725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255082175808593:5929]
2025-10-01T14:08:54.864793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:54.864810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:54.864817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:54.864820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:54.864968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:54.866547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:54.866557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:54.866562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:55.061351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:55.069250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.069280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.069458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.069537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.069607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.069676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.069723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.069734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.069809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.069875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.069947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.070015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.070062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.070070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.070134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.070195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.070261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.070319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.070358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.070361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.072912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255084552672955:6355]
2025-10-01T14:08:55.072945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:55.072948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:55.072968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 649 reason: error at write: Disconnected sessionId: src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0
2025-10-01T14:08:55.073135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 649 sessionId: src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0 is DEAD
2025-10-01T14:08:55.073253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:55.073264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0] Write session will restart in 0.005806s
2025-10-01T14:08:55.073272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:55.073289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0] Write session: Do CDS request
2025-10-01T14:08:55.073297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:55.070476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.070538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.070589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.070644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.070688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.070691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.070754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.070807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.070868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.070932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.070974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.070977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.071046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.071098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.071161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.071229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.071275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.071278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.071345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.071399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.071464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.071525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.071571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.071574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.071640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.071701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.071761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.071823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.071870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.071873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.071942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.072007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.072077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.072139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.072183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.072186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.072255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:55.072313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:55.072371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:55.072435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:55.072476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:55.072479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:55.074278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:55.079894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:55.082535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:55.082553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 650
2025-10-01T14:08:55.082826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:55.082874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:55.082879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:55.082883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:55.083286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 650 sessionId:  describe result for acl check
2025-10-01T14:08:55.083323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:55.083330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:55.083331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:55.083336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255088847640312:6671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:55.083827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255088847640312:6671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:55.087082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255088847640312:6671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:55.090631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255088847640312:6671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:55.090649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255088847640312:6671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:55.090653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255088847640312:6671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:55.090661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:55.091289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:55.093588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:55.093799Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:55.093808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:55.093819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:55.093868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:55.093905Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255086470776146:5936]
2025-10-01T14:08:55.094517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:55.094913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:55.094970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:55.095287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:55.095336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.095342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.095343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.095344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.095345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.095346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.095348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.095349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.095351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.095352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.095353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.095354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.095355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.095356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.095361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.095371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.095374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.095378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.095381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.095384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.095388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.095391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.095394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.095398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.095402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.095405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.095408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.095412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.095418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.095426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.095431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.095437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.095441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.095446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.095450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.095455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.095459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.095464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.095467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.095472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.095475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.095479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.095483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.095487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.095493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.095502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.095506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.095510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.095513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.095517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.095526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.095532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.095542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.095546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.095553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.095557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.095594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:55.099581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:55.100230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:55.100249Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:55.100252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:55.100255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:55.100262Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 649 [2:7556255086470776146:5936]
2025-10-01T14:08:55.100278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:55.100294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:55.100301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:55.100305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:55.100306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:55.100324Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:55.100333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:55.100339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:55.100403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.100413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.100415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.100418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:55.100420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:55.100611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 649
2025-10-01T14:08:55.100615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 649
2025-10-01T14:08:55.100486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:55.100496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.100507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.100516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.100531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:55.100552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640481:6671], now have 1 active actors on pipe
2025-10-01T14:08:55.100555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640261:2446], now have 1 active actors on pipe
2025-10-01T14:08:55.100562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255086470776141:5936]
2025-10-01T14:08:55.100564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255086470776141:5936]
2025-10-01T14:08:55.100566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255086470776141:5936]
2025-10-01T14:08:55.100580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:55.100594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:55.100607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:55.100610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:55.100623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:55.100627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:55.100629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:55.100645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255086470776141:5936]
2025-10-01T14:08:55.100647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:55.100655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:55.100680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.100685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.100717Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:55.100723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:55.100728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:55.100730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:55.100738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:55.100747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:55.100762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:55.100912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.100918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.100947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:55.101007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 650 partition: 0 MaxSeqNo: 45 sessionId: src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0
2025-10-01T14:08:55.101416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c7dd26-b71ad1a0-36a99137-f1713393_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:55.103871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0] Write session: try to update token
2025-10-01T14:08:55.103890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:55.118572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 650 sessionId: src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:55.121091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:55.121778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.121806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.121828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:55.121831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:55.121834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:55.121836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:55.121845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255086470776141:5936]
2025-10-01T14:08:55.121850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255086470776141:5936]
2025-10-01T14:08:55.121854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255086470776141:5936]
2025-10-01T14:08:55.121890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:55.121896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:55.121899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:55.121914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:55.121924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.121926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:55.122072Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:55.173168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255088847640497:6355]
2025-10-01T14:08:55.176245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 649, pipe: [1:7556255088847640497:6355]
2025-10-01T14:08:55.279213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:55.279706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:55.279765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640497:6355], now have 1 active actors on pipe
2025-10-01T14:08:55.279837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:55.279938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:55.279953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:55.279956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:55.280009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255088847640497:6355]
2025-10-01T14:08:55.280027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 650 reason: error at write: Disconnected sessionId: src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0
2025-10-01T14:08:55.280186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 650 sessionId: src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0 is DEAD
2025-10-01T14:08:55.280302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:55.280313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0] Write session will restart in 0.007408s
2025-10-01T14:08:55.280352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0] Write session: Do CDS request
2025-10-01T14:08:55.280357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:55.289048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:55.289144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:55.289162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 651
2025-10-01T14:08:55.289338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:55.289381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:55.289391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:55.289394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:55.289810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 651 sessionId:  describe result for acl check
2025-10-01T14:08:55.289841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:55.289843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:55.289844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:55.289851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255088847640547:6676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:55.290358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255088847640547:6676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:55.293034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255088847640547:6676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:55.302086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255088847640547:6676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:55.302121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255088847640547:6676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:55.302127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255088847640547:6676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:55.302141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:55.304813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:55.309839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:55.310109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:55.310126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:55.310140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:55.310202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:55.310250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255086470776389:5946]
2025-10-01T14:08:55.310906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:55.311449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:55.311508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:55.311824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:55.311898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.311905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.311907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.311908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.311909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.311910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.311911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.311913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.311914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.311915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.311917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.311918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.311920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.311921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.311927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.311938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.311943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.311947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.311951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.311955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.311959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.311964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.311968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.311972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.311977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.311980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.311984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.311988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.311997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.312008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.312015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.312021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.312026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.312037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.312041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.312052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.312057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.312064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.312069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.312074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.312083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.312089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.312111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.312117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.312121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.312127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.312131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.312137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.312142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.312147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.312151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.312159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.312163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.312171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.312175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.312185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.312225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:55.317326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:55.317910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:55.317926Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:55.317928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:55.317931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:55.317938Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 650 [2:7556255086470776389:5946]
2025-10-01T14:08:55.317955Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:55.317983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:55.317986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:55.317989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:55.317992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:55.318008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:55.318013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:55.318020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:55.318082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.318085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.318087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.318090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:55.318093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:55.318158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:55.318166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.318179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.318190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.318207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:55.318224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255086470776384:5946]
2025-10-01T14:08:55.318227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255086470776384:5946]
2025-10-01T14:08:55.318229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255086470776384:5946]
2025-10-01T14:08:55.318240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:55.318253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:55.318268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:55.318270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:55.318301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255086470776384:5946]
2025-10-01T14:08:55.318308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:55.318469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:55.318476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:55.318479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:55.318483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:55.318601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 650
2025-10-01T14:08:55.318644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 650
2025-10-01T14:08:55.318712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640505:2446], now have 1 active actors on pipe
2025-10-01T14:08:55.318720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640725:6676], now have 1 active actors on pipe
2025-10-01T14:08:55.318738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.318742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.318767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:55.318777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:55.318782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:55.318784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:55.318792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:55.318801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:55.318816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:55.319003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.319011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.319025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:55.319111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 651 partition: 0 MaxSeqNo: 45 sessionId: src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0
2025-10-01T14:08:55.319433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c9dbd3-d9812088-d5d95e07-9728a7c7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:55.325912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0] Write session: try to update token
2025-10-01T14:08:55.325932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:55.348305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:55.348326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:55.348329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:55.348331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:55.348342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255086470776384:5946]
2025-10-01T14:08:55.348346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255086470776384:5946]
2025-10-01T14:08:55.348350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255086470776384:5946]
2025-10-01T14:08:55.348394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:55.348403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.348405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:55.348414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:55.348421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:55.348425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:55.348535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:55.346418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 651 sessionId: src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:55.351394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:55.380021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255088847640742:6355]
2025-10-01T14:08:55.380291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 650, pipe: [1:7556255088847640742:6355]
2025-10-01T14:08:55.504102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:55.504960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255088847640742:6355]
2025-10-01T14:08:55.504988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:55.505021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:55.505028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:55.505082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 651 reason: error at write: Disconnected sessionId: src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0
2025-10-01T14:08:55.505635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:55.505646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0] Write session will restart in 0.009183s
2025-10-01T14:08:55.505671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0] Write session: Do CDS request
2025-10-01T14:08:55.505677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:55.505254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 651 sessionId: src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0 is DEAD
2025-10-01T14:08:55.504617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.504639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.504683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640742:6355], now have 1 active actors on pipe
2025-10-01T14:08:55.510137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:55.515900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:55.516261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:55.516275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 652
2025-10-01T14:08:55.516470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:55.516535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:55.516550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:55.516556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:55.517209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 652 sessionId:  describe result for acl check
2025-10-01T14:08:55.517249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:55.517260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:55.517262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:55.517269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255088847640780:6681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:55.517887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255088847640780:6681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:55.525344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255088847640780:6681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:55.526460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:55.529797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:55.530047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:55.530052Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:55.530064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:55.530120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:55.530172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255086470776632:5950]
2025-10-01T14:08:55.530281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255088847640780:6681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:55.530299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255088847640780:6681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:55.530303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255088847640780:6681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:55.530312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:55.530788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:55.531373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:55.531440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:55.531777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:55.531835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.531842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.531843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.531844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.531845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.531847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.531848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.531849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.531850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.531851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.531853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.531854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.531855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.531856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.531863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.531874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.531878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.531882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.531886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.531890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.531894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.531897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.531901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.531905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.531908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.531911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.531915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.531919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.531925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.531933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.531941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.531946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.531950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.531956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.531960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.531965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.531970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.531975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.531980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.531985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.531991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.531996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.532000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.532005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.532010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.532015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.532020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.532025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.532030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.532035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.532039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.532044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.532049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.532055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.532058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.532061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.532083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:55.536256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:55.537153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:55.537167Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:55.537169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:55.537173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:55.537182Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 651 [2:7556255086470776632:5950]
2025-10-01T14:08:55.537198Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:55.537216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:55.537224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:55.537228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:55.537233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:55.537250Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:55.537259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:55.537269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:55.537337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.537343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.537345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.537348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:55.537351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:55.537418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:55.537424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.537436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.537450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.537466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:55.537487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640756:2446], now have 1 active actors on pipe
2025-10-01T14:08:55.537495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640980:6681], now have 1 active actors on pipe
2025-10-01T14:08:55.537502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255086470776627:5950]
2025-10-01T14:08:55.537508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255086470776627:5950]
2025-10-01T14:08:55.537510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255086470776627:5950]
2025-10-01T14:08:55.537522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:55.537531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:55.537533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:55.537535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:55.537540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:55.537555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:55.537561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:55.537596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255086470776627:5950]
2025-10-01T14:08:55.537607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:55.537613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:55.538446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 651
2025-10-01T14:08:55.538493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 651
2025-10-01T14:08:55.538717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.538735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.538778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:55.538793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:55.538801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:55.538804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:55.538814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:55.538830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:55.538852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:55.539690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.539708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.539732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:55.539868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 652 partition: 0 MaxSeqNo: 45 sessionId: src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0
2025-10-01T14:08:55.540535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2463eb0f-fb3ebdce-6d1e02f3-d482fd78_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:55.543344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0] Write session: try to update token
2025-10-01T14:08:55.543362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:55.557892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:55.557920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:55.557932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255086470776627:5950]
2025-10-01T14:08:55.557992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:55.558264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:55.558345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:55.558594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:55.558739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:55.558884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:55.559092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:55.559139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:55.568225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 652 sessionId: src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:55.573125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:55.575768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.575796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.575819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:55.575823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:55.575826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:55.575828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:55.575840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255086470776627:5950]
2025-10-01T14:08:55.575844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255086470776627:5950]
2025-10-01T14:08:55.575848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255086470776627:5950]
2025-10-01T14:08:55.575904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:55.575911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:55.575917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.575920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:55.575920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:55.575924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:55.576083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:55.606717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255088847640992:6355]
2025-10-01T14:08:55.607059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 651, pipe: [1:7556255088847640992:6355]
2025-10-01T14:08:55.730191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:55.730602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:55.730645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640992:6355], now have 1 active actors on pipe
2025-10-01T14:08:55.740817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:55.740994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:55.741008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:55.741088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 652 reason: error at write: Disconnected sessionId: src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0
2025-10-01T14:08:55.741237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 652 sessionId: src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0 is DEAD
2025-10-01T14:08:55.741423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:55.741482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255088847640992:6355]
2025-10-01T14:08:55.750483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:55.750501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0] Write session will restart in 0.005041s
2025-10-01T14:08:55.750530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0] Write session: Do CDS request
2025-10-01T14:08:55.750539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:55.759679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:55.762646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:55.762664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 653
2025-10-01T14:08:55.763028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:55.763066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:55.763075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:55.763079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:55.763716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 653 sessionId:  describe result for acl check
2025-10-01T14:08:55.763749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:55.763751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:55.763753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:55.763762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255088847641012:6686] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:55.764322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255088847641012:6686] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:55.781715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255088847641012:6686] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:55.797413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255088847641012:6686] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:55.797437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255088847641012:6686] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:55.797441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255088847641012:6686] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:55.797450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:55.803457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:55.813173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:55.813436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:55.813449Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:55.813462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:55.813520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:55.813562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255086470776864:5952]
2025-10-01T14:08:55.814153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:55.815965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:55.816036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:55.816455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:55.816538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.816545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.816547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.816548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.816549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.816550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.816552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.816553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.816555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.816556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.816557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.816558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.816560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.816561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.816568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.816579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.816584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.816588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.816592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.816596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.816600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.816604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.816608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.816613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.816622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.816626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.816634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.816638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.816650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.816666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:55.816677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.816683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:55.816692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.816699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:55.816705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.816710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:55.816720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.816727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:55.816736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.816741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:55.816750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.816755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:55.816760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.816765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:55.816781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.816790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:55.816794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.816799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.816808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.816814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.816823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.816828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.816837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.816842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:55.816847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.816856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:55.816896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:55.822317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:55.823036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:55.823056Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:55.823059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:55.823062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:55.823069Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 652 [2:7556255086470776864:5952]
2025-10-01T14:08:55.823088Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:55.823109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:55.823114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:55.823118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:55.823121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:55.823142Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:55.823149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:55.823157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:55.823226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.823228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.823230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.823234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:55.823237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:55.823316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:55.823321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.823334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:55.823345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:55.823362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:55.823380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255086470776859:5952]
2025-10-01T14:08:55.823382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255086470776859:5952]
2025-10-01T14:08:55.823384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255086470776859:5952]
2025-10-01T14:08:55.823399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:55.823415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:55.823418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:55.823422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:55.823424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:55.823430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:55.823433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:55.823471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255086470776859:5952]
2025-10-01T14:08:55.823474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:55.823492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:55.823505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847640997:2446], now have 1 active actors on pipe
2025-10-01T14:08:55.823509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847641185:6686], now have 1 active actors on pipe
2025-10-01T14:08:55.823660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 652
2025-10-01T14:08:55.823704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 652
2025-10-01T14:08:55.824349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.824365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.824394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:55.824404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:55.824409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:55.824412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:55.824424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:55.824439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:55.824456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:55.824676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.824685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.824701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:55.824793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 653 partition: 0 MaxSeqNo: 45 sessionId: src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0
2025-10-01T14:08:55.825233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|381c99fa-cac5eb8d-9fa13de-bc0b3ec7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:55.827967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0] Write session: try to update token
2025-10-01T14:08:55.827989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:55.838868Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:55.838886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:55.838896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255086470776859:5952]
2025-10-01T14:08:55.838921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:55.838935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:55.839127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:55.839285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:55.839440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:55.839591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:55.839794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:55.839832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:55.840185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255088847641255:6355]
2025-10-01T14:08:55.840639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255088847641255:6355], now have 1 active actors on pipe
2025-10-01T14:08:55.840726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 652, pipe: [1:7556255088847641255:6355]
2025-10-01T14:08:55.848543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 653 sessionId: src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:55.851183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:55.851541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:55.851567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:55.851605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:55.851803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:55.868436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:55.868458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:55.868460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:55.868462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:55.868473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255086470776859:5952]
2025-10-01T14:08:55.868477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255086470776859:5952]
2025-10-01T14:08:55.868481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255086470776859:5952]
2025-10-01T14:08:55.868522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:55.868530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:55.868532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:55.868661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:55.868665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:55.868669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:55.868671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:56.025995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:56.034287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.034318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.038358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255088847641255:6355]
2025-10-01T14:08:56.038404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:56.038631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:56.038643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:56.038671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 653 reason: error at write: Disconnected sessionId: src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0
2025-10-01T14:08:56.038863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 653 sessionId: src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0 is DEAD
2025-10-01T14:08:56.039083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:56.039098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0] Write session will restart in 0.008589s
2025-10-01T14:08:56.039124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0] Write session: Do CDS request
2025-10-01T14:08:56.039130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:56.034565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.034637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.034701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.034762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.034807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.034812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.034888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.034949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.035020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.035087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.035128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.035131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.035198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.035255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.035318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.035382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.035434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.035437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.035506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.035568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.035630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.035693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.035734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.035740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.035807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.035868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.035931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.035991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.036033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.036037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.036106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.036165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.036230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.036292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.036335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.036339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.036415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.036477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.036543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.036612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.036652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.036655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.036726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.036805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.036871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.036934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.036978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.036981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.037051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.037112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.037169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.037236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.037279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.037282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.037354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.037417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.037476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.037530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.037572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.037575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.038661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:56.050228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.050898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:56.050915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 654
2025-10-01T14:08:56.051019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.051066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:56.051076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:56.051080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:56.051434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 654 sessionId:  describe result for acl check
2025-10-01T14:08:56.051467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:56.051471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:56.051473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:56.051478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255093142608589:6697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:56.052053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255093142608589:6697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:56.054976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255093142608589:6697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:56.060317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255093142608589:6697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:56.060335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255093142608589:6697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:56.060338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255093142608589:6697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:56.060346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:56.063080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:56.065575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:56.065822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:56.065832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:56.065843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:56.065898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:56.065940Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255090765744399:5957]
2025-10-01T14:08:56.066555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:56.066906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:56.066958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:56.067247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:56.067321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.067328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.067329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.067330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.067331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.067332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.067334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.067335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.067336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.067337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.067338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.067339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.067341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.067342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.067348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.067358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.067362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.067365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.067368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.067372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.067375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.067379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.067382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.067386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.067390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.067393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.067396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.067399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.067407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.067415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.067420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.067425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.067431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.067435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.067439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.067443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.067449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.067453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.067458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.067462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.067466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.067471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.067481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.067486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.067491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.067501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.067505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.067515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.067520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.067524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.067533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.067538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.067542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.067547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.067555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.067561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.067604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:56.071676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:56.072311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:56.072327Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:56.072329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:56.072332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:56.072338Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 653 [2:7556255090765744399:5957]
2025-10-01T14:08:56.072350Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:56.072363Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:56.072365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:56.072367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:56.072370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:56.072382Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:56.072386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:56.072390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:56.072442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.072450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.072451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.072455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:56.072457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:56.072527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:56.072535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.072544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.072549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.072558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:56.072571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255090765744394:5957]
2025-10-01T14:08:56.072573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255090765744394:5957]
2025-10-01T14:08:56.072574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255090765744394:5957]
2025-10-01T14:08:56.072580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:56.072590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:56.072590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:56.072593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:56.072595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:56.072598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:56.072600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:56.072609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142608772:6697], now have 1 active actors on pipe
2025-10-01T14:08:56.072613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142608558:2446], now have 1 active actors on pipe
2025-10-01T14:08:56.072644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255090765744394:5957]
2025-10-01T14:08:56.072659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:56.072668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:56.072693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 653
2025-10-01T14:08:56.072709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 653
2025-10-01T14:08:56.072779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.072788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.072815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:56.072821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:56.072832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:56.072835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:56.072843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:56.072852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:56.072866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:56.073030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.073042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.073061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:56.073164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 654 partition: 0 MaxSeqNo: 45 sessionId: src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0
2025-10-01T14:08:56.073511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedd3d2-de7f8967-2d6ab65f-61d5e4c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:56.076218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0] Write session: try to update token
2025-10-01T14:08:56.076245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:56.095234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 654 sessionId: src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:56.097481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:56.097501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:56.097504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:56.097505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:56.097517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255090765744394:5957]
2025-10-01T14:08:56.097521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255090765744394:5957]
2025-10-01T14:08:56.097525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255090765744394:5957]
2025-10-01T14:08:56.097572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:56.097576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:56.097579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:56.097583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:56.097583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.097585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:56.097723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:56.097909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:56.138271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255093142608793:6355]
2025-10-01T14:08:56.138595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 653, pipe: [1:7556255093142608793:6355]
2025-10-01T14:08:56.257723Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:56.258204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.258224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.258272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142608793:6355], now have 1 active actors on pipe
2025-10-01T14:08:56.258694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:56.258709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:56.258764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 654 reason: error at write: Disconnected sessionId: src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0
2025-10-01T14:08:56.258963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 654 sessionId: src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0 is DEAD
2025-10-01T14:08:56.258709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:56.259088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:56.259097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0] Write session will restart in 0.007946s
2025-10-01T14:08:56.259134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0] Write session: Do CDS request
2025-10-01T14:08:56.259141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:56.259140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:56.258570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255093142608793:6355]
2025-10-01T14:08:56.268803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.269041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:56.269057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 655
2025-10-01T14:08:56.270622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.270672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:56.270683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:56.270687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:56.271097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 655 sessionId:  describe result for acl check
2025-10-01T14:08:56.271141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:56.271143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:56.271145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:56.271150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255093142608856:6702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:56.271902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255093142608856:6702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:56.275640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255093142608856:6702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:56.278993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255093142608856:6702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:56.279013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255093142608856:6702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:56.279016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255093142608856:6702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:56.279026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:56.280409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:56.284035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:56.284316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:56.284327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:56.284341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:56.284404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:56.284453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255090765744660:5969]
2025-10-01T14:08:56.285218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:56.285603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:56.285659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:56.286009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:56.286421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.286429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.286431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.286445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.286446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.286447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.286448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.286450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.286451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.286452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.286453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.286455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.286456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.286457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.286465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.286476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.286480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.286484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.286488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.286491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.286495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.286498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.286502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.286506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.286509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.286512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.286515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.286518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.286530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.286538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.286544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.286549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.286553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.286568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.286572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.286578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.286583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.286588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.286595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.286601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.286605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.286609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.286613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.286618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.286622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.286626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.286630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.286635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.286639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.286644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.286648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.286652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.286656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.286660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.286664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.286669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.286706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:56.290761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:56.291845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:56.291864Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:56.291867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:56.291871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:56.291879Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 654 [2:7556255090765744660:5969]
2025-10-01T14:08:56.291897Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:56.291914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:56.291917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:56.291921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:56.291923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:56.291941Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:56.291947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:56.291953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:56.292020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.292022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.292024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.292029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:56.292032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:56.292103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:56.292105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.292117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.292127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.292144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:56.292160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255090765744655:5969]
2025-10-01T14:08:56.292162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255090765744655:5969]
2025-10-01T14:08:56.292164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255090765744655:5969]
2025-10-01T14:08:56.292179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:56.292192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:56.292206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:56.292209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:56.292257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255090765744655:5969]
2025-10-01T14:08:56.292260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:56.292733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 654
2025-10-01T14:08:56.292791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 654
2025-10-01T14:08:56.292354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:56.292358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:56.292360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:56.292366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:56.292633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142608803:2446], now have 1 active actors on pipe
2025-10-01T14:08:56.292641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142609024:6702], now have 1 active actors on pipe
2025-10-01T14:08:56.293004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.293018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.293046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f552a4df-439f6f6b-aab43383-750646a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:56.293063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:56.293072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:56.293075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:56.293086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:56.293107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:56.293125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:56.293494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.293508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.293530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:56.293975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 655 partition: 0 MaxSeqNo: 45 sessionId: src_id|f552a4df-439f6f6b-aab43383-750646a_0
2025-10-01T14:08:56.294420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1176f8da-4ffd9831-f2321a91-d0e752d4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f552a4df-439f6f6b-aab43383-750646a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:56.297071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f552a4df-439f6f6b-aab43383-750646a_0] Write session: try to update token
2025-10-01T14:08:56.297090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f552a4df-439f6f6b-aab43383-750646a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:56.313599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 655 sessionId: src_id|f552a4df-439f6f6b-aab43383-750646a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:56.315116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:56.315142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:56.315144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:56.315147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:56.315157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255090765744655:5969]
2025-10-01T14:08:56.315162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255090765744655:5969]
2025-10-01T14:08:56.315166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255090765744655:5969]
2025-10-01T14:08:56.315222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:56.315234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.315234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:56.315237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:56.315241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:56.315244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:56.315379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:56.316581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:56.360521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255093142609043:6355]
2025-10-01T14:08:56.360807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 654, pipe: [1:7556255093142609043:6355]
2025-10-01T14:08:56.468111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:56.468358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.468371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.468407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142609043:6355], now have 1 active actors on pipe
2025-10-01T14:08:56.468660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:56.468664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255093142609043:6355]
2025-10-01T14:08:56.468683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:56.468686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:56.468751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 655 reason: error at write: Disconnected sessionId: src_id|f552a4df-439f6f6b-aab43383-750646a_0
2025-10-01T14:08:56.468632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:56.468950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 655 sessionId: src_id|f552a4df-439f6f6b-aab43383-750646a_0 is DEAD
2025-10-01T14:08:56.469051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f552a4df-439f6f6b-aab43383-750646a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:56.469071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f552a4df-439f6f6b-aab43383-750646a_0] Write session will restart in 0.008027s
2025-10-01T14:08:56.469098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f552a4df-439f6f6b-aab43383-750646a_0] Write session: Do CDS request
2025-10-01T14:08:56.469103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f552a4df-439f6f6b-aab43383-750646a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:56.477940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f552a4df-439f6f6b-aab43383-750646a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.478004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:56.478018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 656
2025-10-01T14:08:56.478138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.478172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:56.478176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:56.478180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:56.478636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 656 sessionId:  describe result for acl check
2025-10-01T14:08:56.478667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:56.478673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:56.478675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:56.478680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255093142609118:6707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:56.479175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255093142609118:6707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:56.481782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255093142609118:6707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:56.484443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255093142609118:6707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:56.484459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255093142609118:6707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:56.484462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255093142609118:6707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:56.484469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:56.484763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:56.487196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:56.487414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:56.487424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:56.487435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:56.487502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:56.487539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255090765744906:5973]
2025-10-01T14:08:56.488153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:56.488462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:56.488516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:56.488845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:56.488926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.488933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.488934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.488935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.488936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.488938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.488938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.488940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.488941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.488942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.488943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.488944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.488945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.488946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.488953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.488963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.488967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.488972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.488976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.488980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.488984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.488988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.488992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.488997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.489005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.489009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.489017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.489021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.489033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.489046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.489057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.489066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.489075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.489084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.489092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.489101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.489110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.489120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.489128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.489138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.489143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.489148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.489152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.489160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.489169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.489179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.489189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.489194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.489199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.489204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.489209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.489218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.489224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.489233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.489242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.489251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.489296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:56.493129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:56.493874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:56.493892Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:56.493895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:56.493898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:56.493905Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 655 [2:7556255090765744906:5973]
2025-10-01T14:08:56.493925Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:56.493944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:56.493951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:56.493955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:56.493958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:56.493975Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:56.493985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:56.493991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:56.494060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.494068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.494070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.494074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:56.494076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:56.494145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:56.494153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.494167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.494183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.494202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:56.494225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142609284:6707], now have 1 active actors on pipe
2025-10-01T14:08:56.494234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142609057:2446], now have 1 active actors on pipe
2025-10-01T14:08:56.494242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255090765744901:5973]
2025-10-01T14:08:56.494245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255090765744901:5973]
2025-10-01T14:08:56.494247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255090765744901:5973]
2025-10-01T14:08:56.494260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:56.494275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:56.494278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:56.494280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:56.494283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:56.494299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:56.494316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 655
2025-10-01T14:08:56.494354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 655
2025-10-01T14:08:56.494323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:56.494358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255090765744901:5973]
2025-10-01T14:08:56.494380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:56.494398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.494404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.494415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:56.494451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:56.494464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:56.494471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:56.494473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:56.494483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:56.494496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:56.494523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:56.495337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.495358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.495383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:56.495513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 656 partition: 0 MaxSeqNo: 45 sessionId: src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0
2025-10-01T14:08:56.498515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f552a4df-439f6f6b-aab43383-750646a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:56.501250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0] Write session: try to update token
2025-10-01T14:08:56.501270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:56.517278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:56.517300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:56.517303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:56.517305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:56.517317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255090765744901:5973]
2025-10-01T14:08:56.517322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255090765744901:5973]
2025-10-01T14:08:56.517327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255090765744901:5973]
2025-10-01T14:08:56.517376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:56.517382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:56.517390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.517393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:56.517406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:56.517410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:56.517538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:56.520594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 656 sessionId: src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:56.523284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:56.568871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255093142609297:6355]
2025-10-01T14:08:56.569221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 655, pipe: [1:7556255093142609297:6355]
2025-10-01T14:08:56.678165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:56.678755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.678773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.678818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142609297:6355], now have 1 active actors on pipe
2025-10-01T14:08:56.679079Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:56.679751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:56.679812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255093142609297:6355]
2025-10-01T14:08:56.679834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:56.679909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 656 reason: status is not ok: tablet will be restarted right now sessionId: src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0
2025-10-01T14:08:56.680091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 656 sessionId: src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0 is DEAD
2025-10-01T14:08:56.680241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:56.680249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0] Write session will restart in 0.008011s
2025-10-01T14:08:56.680277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0] Write session: Do CDS request
2025-10-01T14:08:56.680283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:56.694838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.694928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:56.694958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 657
2025-10-01T14:08:56.695132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.695167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:56.695172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:56.695178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:56.697331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 657 sessionId:  describe result for acl check
2025-10-01T14:08:56.697373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:56.697375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:56.697376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:56.697383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255093142609377:6712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:56.697943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255093142609377:6712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:56.701188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255093142609377:6712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:56.704571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255093142609377:6712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:56.704592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255093142609377:6712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:56.704596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255093142609377:6712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:56.704605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:56.712067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:56.712644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:56.712938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:56.712958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:56.712989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:56.713137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:56.713207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255090765745141:5975]
2025-10-01T14:08:56.713842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:56.714208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:56.714274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:56.714735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:56.714835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.714842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.714844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.714845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.714847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.714848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.714850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.714851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.714853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.714854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.714856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.714858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.714859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.714861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.714867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.714879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.714884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.714889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.714950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.714959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.714963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.714967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.714971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.714976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.714979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.714983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.714986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.714989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.714999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.715007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:56.715013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.715020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:56.715039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.715046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:56.715051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.715059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:56.715064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.715069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:56.715074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.715080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:56.715086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.715091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:56.715096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.715101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:56.715106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.715111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:56.715133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.715138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.715144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.715149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.715154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.715159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.715167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.715172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:56.715177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.715182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:56.715228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:56.719814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:56.720616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:56.720634Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:56.720637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:56.720642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:56.720649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 656 [2:7556255090765745141:5975]
2025-10-01T14:08:56.720667Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:56.720687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:56.720690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:56.720694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:56.720695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:56.720711Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:56.720717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:56.720724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:56.720803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.720812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.720815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.720818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:56.720821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:56.720895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:56.720905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.720920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:56.720929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:56.720944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:56.720968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142609536:6712], now have 1 active actors on pipe
2025-10-01T14:08:56.720976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142609301:2446], now have 1 active actors on pipe
2025-10-01T14:08:56.720984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255090765745136:5975]
2025-10-01T14:08:56.720986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255090765745136:5975]
2025-10-01T14:08:56.720988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255090765745136:5975]
2025-10-01T14:08:56.721005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:56.721018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:56.721021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:56.721024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:56.721026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:56.721037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:56.721040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:56.721077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255090765745136:5975]
2025-10-01T14:08:56.721085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:56.721063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 656
2025-10-01T14:08:56.721113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 656
2025-10-01T14:08:56.721095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:56.721116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.721122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.721147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e747e641-f360e2ae-3040ade6-73169b14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:56.721154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:56.721158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:56.721161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:56.721172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:56.721182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:56.721194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:56.721467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.721484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.721502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:56.721629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 657 partition: 0 MaxSeqNo: 45 sessionId: src_id|e747e641-f360e2ae-3040ade6-73169b14_0
2025-10-01T14:08:56.722069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67ef3d2e-3a5ae04b-7f898ad4-2acc976f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e747e641-f360e2ae-3040ade6-73169b14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:56.724591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e747e641-f360e2ae-3040ade6-73169b14_0] Write session: try to update token
2025-10-01T14:08:56.724615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e747e641-f360e2ae-3040ade6-73169b14_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:56.739705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 657 sessionId: src_id|e747e641-f360e2ae-3040ade6-73169b14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:56.740675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:56.740695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:56.740704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255090765745136:5975]
2025-10-01T14:08:56.740750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:56.740967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:56.741136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:56.741316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:56.741479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:56.741695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:56.741734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:56.742003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:56.746209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:56.746656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.746701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.746739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:56.746951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:56.778818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255093142609551:6355]
2025-10-01T14:08:56.786267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 656, pipe: [1:7556255093142609551:6355]
2025-10-01T14:08:56.793979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:56.794016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:56.794188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.794244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.794307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.794392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.794442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.794446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.794526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.794583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.794648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.794720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.795218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.795225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.795305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.795365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.795441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.796884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.797030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.797034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.797113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.798001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.798290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.798634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.798775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.798785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.798875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.799160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.799452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.799529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.799658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.799664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.799735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.799793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.799852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.799913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.800044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.800047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.800300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.800543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.800808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.800872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.801003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.801006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.801072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.801131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.801188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.801442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.801482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.801487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.801700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.801913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.802132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.802191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.802340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.802344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.802557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:56.802623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:56.802696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:56.802955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:56.803074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:56.803085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:56.803200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142609551:6355], now have 1 active actors on pipe
2025-10-01T14:08:56.803213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:08:56.803284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:56.803304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:56.803310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:08:56.803330Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803344Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803351Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803354Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803356Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803362Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803364Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803367Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803370Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803373Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803379Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803383Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803387Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803391Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803399Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803403Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803406Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803410Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803414Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803418Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803663Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803672Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803676Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803679Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803682Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803816Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803827Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803830Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803833Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803837Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803943Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803956Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803959Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803963Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.803966Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:08:56.804030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:08:56.804045Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:08:56.804052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:08:56.804055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:08:56.804059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:08:56.804467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:08:56.804495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:08:56.804502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:08:56.804505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:08:56.804509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:08:56.804511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:08:56.805049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:08:56.805066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:08:56.805072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:08:56.805075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:08:56.805079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:08:56.805082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:08:56.805541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:08:56.805554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:56.805678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327736805
2025-10-01T14:08:56.808607Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:08:56.808643Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:08:56.808658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:56.808661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:56.808664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:56.808666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:56.808675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255090765745136:5975]
2025-10-01T14:08:56.808679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255090765745136:5975]
2025-10-01T14:08:56.808685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255090765745136:5975]
2025-10-01T14:08:56.808792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:56.808801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:56.808804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:56.808953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:56.810516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:56.810537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:56.810542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:56.967959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:56.968742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:56.969887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e747e641-f360e2ae-3040ade6-73169b14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:08:56.969901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e747e641-f360e2ae-3040ade6-73169b14_0] Write session will restart in 0.009591s
2025-10-01T14:08:56.969926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e747e641-f360e2ae-3040ade6-73169b14_0] Write session: Do CDS request
2025-10-01T14:08:56.969933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e747e641-f360e2ae-3040ade6-73169b14_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:56.969136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255093142609551:6355]
2025-10-01T14:08:56.969185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:56.969231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 657 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e747e641-f360e2ae-3040ade6-73169b14_0
2025-10-01T14:08:56.969400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 657 sessionId: src_id|e747e641-f360e2ae-3040ade6-73169b14_0 is DEAD
2025-10-01T14:08:56.969666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:56.980955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e747e641-f360e2ae-3040ade6-73169b14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.981532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:56.981554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 658
2025-10-01T14:08:56.981736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:56.981772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:56.981777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:56.981782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:56.982252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 658 sessionId:  describe result for acl check
2025-10-01T14:08:56.982295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:56.982301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:56.982303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:56.982310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255093142609594:6723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:56.982896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255093142609594:6723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:56.985614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255093142609594:6723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:57.001050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255093142609594:6723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:57.001072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255093142609594:6723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:57.001076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255093142609594:6723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:57.001084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:57.009862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:57.017723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:57.017988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:57.017993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:57.018004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:57.018064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:57.018111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255095060712683:5980]
2025-10-01T14:08:57.018978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:57.019672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:57.019786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:57.020300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:57.020389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.020399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.020400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.020402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.020403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.020404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.020406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.020407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.020408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.020410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.020411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.020413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.020414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.020416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.020423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.020433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.020438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.020442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.020447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.020451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.020455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.020459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.020464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.020468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.020472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.020476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.020480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.020484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.020493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.020502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.020508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.020513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.020518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.020523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.020529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.020534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.020541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.020547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.020551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.020556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.020561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.020566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.020569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.020574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.020579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.020584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.020588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.020593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.020596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.020601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.020605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.020610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.020621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.020626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.020631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.020636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.020678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:57.026199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:57.026937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:57.026945Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:57.026948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:57.026953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:57.026962Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 657 [2:7556255095060712683:5980]
2025-10-01T14:08:57.026983Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:57.027004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:57.027008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:57.027012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:57.027014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:57.027032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:57.027039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:57.027047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:57.027123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.027125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.027128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.027131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:57.027134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:57.027221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:57.027224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.027236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.027246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.027260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:57.027280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255095060712677:5980]
2025-10-01T14:08:57.027283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255095060712677:5980]
2025-10-01T14:08:57.027286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255095060712677:5980]
2025-10-01T14:08:57.027302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:57.027317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:57.027332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:57.027336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:57.027375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255095060712677:5980]
2025-10-01T14:08:57.027378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:57.027666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:57.027677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:57.027680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:57.027686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:57.028021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255093142609580:2446], now have 1 active actors on pipe
2025-10-01T14:08:57.028030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577037:6723], now have 1 active actors on pipe
2025-10-01T14:08:57.028784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 657
2025-10-01T14:08:57.028849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 657
2025-10-01T14:08:57.032225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.032254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.032300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:57.032312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:57.032317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:57.032321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:57.032334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:57.032362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:57.032382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:57.034695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.034720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.034758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:57.035031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 658 partition: 0 MaxSeqNo: 45 sessionId: src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0
2025-10-01T14:08:57.035395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e747e641-f360e2ae-3040ade6-73169b14_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:57.038316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0] Write session: try to update token
2025-10-01T14:08:57.038335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:57.059754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:57.059772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:57.059774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:57.059775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:57.059784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255095060712677:5980]
2025-10-01T14:08:57.059786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255095060712677:5980]
2025-10-01T14:08:57.059789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255095060712677:5980]
2025-10-01T14:08:57.059840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:57.059847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.059850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:57.059853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:57.059866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:57.059871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:57.060229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:57.069101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255097437577119:6355]
2025-10-01T14:08:57.069476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 657, pipe: [1:7556255097437577119:6355]
2025-10-01T14:08:57.069770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 658 sessionId: src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:57.072890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:57.216752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:57.217291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577119:6355], now have 1 active actors on pipe
2025-10-01T14:08:57.217350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.217361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.217633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255097437577119:6355]
2025-10-01T14:08:57.217665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:57.217714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:57.217726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:57.217773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 658 reason: error at write: Disconnected sessionId: src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0
2025-10-01T14:08:57.217973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 658 sessionId: src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0 is DEAD
2025-10-01T14:08:57.217827Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:57.218445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:57.218458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0] Write session will restart in 0.005463s
2025-10-01T14:08:57.218495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0] Write session: Do CDS request
2025-10-01T14:08:57.218502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:57.225977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:57.227833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:57.227866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 659
2025-10-01T14:08:57.228081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:57.228128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:57.228138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:57.228144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:57.228676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 659 sessionId:  describe result for acl check
2025-10-01T14:08:57.228731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:57.228733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:57.228735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:57.228742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255097437577131:6729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:57.229402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255097437577131:6729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:57.232719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255097437577131:6729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:57.235929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255097437577131:6729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:57.235947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255097437577131:6729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:57.235952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255097437577131:6729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:57.235960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:57.257020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:57.260470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:57.260689Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:57.260707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:57.260718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:57.260777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:57.260823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255095060712948:5992]
2025-10-01T14:08:57.261342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:57.261704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:57.261765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:57.262074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:57.262160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.262168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.262169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.262170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.262172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.262173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.262175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.262176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.262178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.262179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.262180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.262181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.262182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.262183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.262189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.262200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.262204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.262208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.262212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.262216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.262220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.262223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.262227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.262231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.262235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.262239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.262242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.262246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.262254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.262261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.262267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.262272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.262277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.262282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.262289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.262294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.262299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.262305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.262309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.262314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.262323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.262330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.262335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.262340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.262350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.262355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.262359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.262363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.262366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.262386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.262394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.262398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.262404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.262412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.262417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.262426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.262465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:57.267006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:57.268081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:57.268097Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:57.268100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:57.268104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:57.268109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 658 [2:7556255095060712948:5992]
2025-10-01T14:08:57.268125Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:57.268143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:57.268146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:57.268149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:57.268151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:57.268166Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:57.268171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:57.268178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:57.268242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.268252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.268255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.268258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:57.268260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:57.268338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:57.268346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.268357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.268370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.268525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 658
2025-10-01T14:08:57.268389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:57.268572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 658
2025-10-01T14:08:57.268413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577124:2446], now have 1 active actors on pipe
2025-10-01T14:08:57.268416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577171:6729], now have 1 active actors on pipe
2025-10-01T14:08:57.268422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255095060712943:5992]
2025-10-01T14:08:57.268424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255095060712943:5992]
2025-10-01T14:08:57.268426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255095060712943:5992]
2025-10-01T14:08:57.268438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:57.268455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:57.268455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:57.268459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:57.268461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:57.268468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:57.268471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:57.268500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255095060712943:5992]
2025-10-01T14:08:57.268508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:57.268521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:57.268686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.268696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.268719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:57.268730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:57.268734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:57.268737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:57.268745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:57.268755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:57.268766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:57.269031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.269041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.269056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:57.269510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 659 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0
2025-10-01T14:08:57.269890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73bf8f76-32da9971-bdf45161-d13d37f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:57.272989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0] Write session: try to update token
2025-10-01T14:08:57.273012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:57.285376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:57.285399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:57.285410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255095060712943:5992]
2025-10-01T14:08:57.285459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:57.285473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:57.285669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:57.285841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:57.286008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:57.286169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:57.286427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:57.286476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:57.289049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 659 sessionId: src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:57.291921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:57.292468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.292495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.292531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:57.292677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:57.305944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:57.305969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:57.305972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:57.305974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:57.305984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255095060712943:5992]
2025-10-01T14:08:57.305989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255095060712943:5992]
2025-10-01T14:08:57.305993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255095060712943:5992]
2025-10-01T14:08:57.306039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:57.306047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.306047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:57.306053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:57.306057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:57.306058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:57.306199Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:57.317919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255097437577372:6355]
2025-10-01T14:08:57.319586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 658, pipe: [1:7556255097437577372:6355]
2025-10-01T14:08:57.469875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:57.470263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577372:6355], now have 1 active actors on pipe
2025-10-01T14:08:57.478363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.478414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.478588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.478651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.478718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.478778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.478822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.478833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.478898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.478955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.479015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.479079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.479127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.479135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.479208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.479272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.479335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.479439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.479492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.479499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.479566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.479669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.479733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.479800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.479850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.479857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.479922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.479984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.480047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.480149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.480199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.480207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.480313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.480376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.480440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.480505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.480551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.480558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.480622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.480718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.480794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.480860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.480912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.480919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.480982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.481041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.481107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.481172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.481231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.481238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.481303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.481366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.481430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.481492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.481550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.481561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.481623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.481679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.481738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.481797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.481840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.481847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.482273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:57.482295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:57.482328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 659 reason: error at write: Disconnected sessionId: src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0
2025-10-01T14:08:57.482333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255097437577372:6355]
2025-10-01T14:08:57.482360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:57.482690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:57.482700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0] Write session will restart in 0.006220s
2025-10-01T14:08:57.482725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0] Write session: Do CDS request
2025-10-01T14:08:57.482731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:57.482544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 659 sessionId: src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0 is DEAD
2025-10-01T14:08:57.483125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:57.489943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:57.490109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:57.490129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 660
2025-10-01T14:08:57.490403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:57.490449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:57.490461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:57.490466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:57.490895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 660 sessionId:  describe result for acl check
2025-10-01T14:08:57.490929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:57.490931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:57.490933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:57.490938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255097437577399:6735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:57.491508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255097437577399:6735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:57.493239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255097437577399:6735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:57.497553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255097437577399:6735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:57.497583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255097437577399:6735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:57.497589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255097437577399:6735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:57.497599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:57.512687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:57.517964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:57.518192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:57.518203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:57.518214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:57.518266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:57.518326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255095060713198:5996]
2025-10-01T14:08:57.519015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:57.519894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:57.519958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:57.520317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:57.520396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.520401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.520403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.520404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.520406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.520408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.520409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.520410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.520412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.520413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.520415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.520416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.520418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.520419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.520425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.520437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.520441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.520445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.520449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.520454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.520458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.520461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.520466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.520470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.520474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.520476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.520478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.520481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.520487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.520492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.520498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.520502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.520504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.520508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.520515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.520519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.520522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.520529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.520532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.520536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.520543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.520547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.520553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.520556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.520560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.520566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.520569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.520573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.520581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.520585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.520590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.520595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.520600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.520609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.520616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.520623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.520649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:57.525375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:57.526522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:57.526540Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:57.526543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:57.526547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:57.526554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 659 [2:7556255095060713198:5996]
2025-10-01T14:08:57.526571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:57.526590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:57.526594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:57.526605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:57.526608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:57.526625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:57.526630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:57.526643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:57.526718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.526726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.526729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.526732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:57.526734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:57.526810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:57.526818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.526830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.526845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.526863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:57.526888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577387:2446], now have 1 active actors on pipe
2025-10-01T14:08:57.526899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255095060713193:5996]
2025-10-01T14:08:57.526906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255095060713193:5996]
2025-10-01T14:08:57.526909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255095060713193:5996]
2025-10-01T14:08:57.526924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:57.526939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577436:6735], now have 1 active actors on pipe
2025-10-01T14:08:57.526950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:57.526970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:57.526973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:57.527012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255095060713193:5996]
2025-10-01T14:08:57.527021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:57.527047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 659
2025-10-01T14:08:57.527108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 659
2025-10-01T14:08:57.527166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:57.527173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:57.527175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:57.527180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:57.527400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.527410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.527439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:57.527447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:57.527452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:57.527454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:57.527467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:57.527478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:57.527495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:57.527750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.527757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.527772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:57.529956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 660 partition: 0 MaxSeqNo: 45 sessionId: src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0
2025-10-01T14:08:57.530385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d2d8aff-da16cf92-6cbaa1e7-85f920fa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:57.532842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0] Write session: try to update token
2025-10-01T14:08:57.532860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:57.547757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 660 sessionId: src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:57.550682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:57.553330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.553362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.553385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:57.553388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:57.553390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:57.553393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:57.553402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255095060713193:5996]
2025-10-01T14:08:57.553407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255095060713193:5996]
2025-10-01T14:08:57.553413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255095060713193:5996]
2025-10-01T14:08:57.553459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:57.553478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:57.553480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:57.553482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:57.553488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.553491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:57.553636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:57.582839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255097437577631:6355]
2025-10-01T14:08:57.583419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 659, pipe: [1:7556255097437577631:6355]
2025-10-01T14:08:57.704204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:57.704630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:57.704682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577631:6355], now have 1 active actors on pipe
2025-10-01T14:08:57.705203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:57.705213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0] Write session will restart in 0.009396s
2025-10-01T14:08:57.705245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0] Write session: Do CDS request
2025-10-01T14:08:57.705251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:57.704794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:57.704850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255097437577631:6355]
2025-10-01T14:08:57.704870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:57.704887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:57.704889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:57.704945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 660 reason: error at write: Disconnected sessionId: src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0
2025-10-01T14:08:57.705068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 660 sessionId: src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0 is DEAD
2025-10-01T14:08:57.715899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:57.715973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:57.715993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 661
2025-10-01T14:08:57.716159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:57.716208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:57.716220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:57.716225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:57.716608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 661 sessionId:  describe result for acl check
2025-10-01T14:08:57.716655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:57.716663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:57.716664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:57.716670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255097437577668:6740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:57.717250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255097437577668:6740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:57.719568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255097437577668:6740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:57.723071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255097437577668:6740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:57.723084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255097437577668:6740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:57.723089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255097437577668:6740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:57.723097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:57.724405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:57.727346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:57.727542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:57.727550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:57.727564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:57.727597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:57.727639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255095060713437:5998]
2025-10-01T14:08:57.728239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:57.728618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:57.728657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:57.728961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:57.729016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.729022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.729024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.729025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.729026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.729027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.729028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.729029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.729031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.729032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.729033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.729034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.729035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.729036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.729041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.729051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.729054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.729057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.729060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.729064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.729068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.729071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.729075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.729079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.729082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.729086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.729089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.729093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.729099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.729106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.729113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.729118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.729123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.729128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.729136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.729141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.729146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.729154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.729158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.729164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.729172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.729177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.729181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.729190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.729194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.729203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.729208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.729212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.729220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.729225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.729232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.729237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.729245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.729250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.729254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.729258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.729295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:57.733404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:57.734034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:57.734050Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:57.734052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:57.734055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:57.734062Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 660 [2:7556255095060713437:5998]
2025-10-01T14:08:57.734080Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:57.734098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:57.734105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:57.734109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:57.734111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:57.734128Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:57.734137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:57.734143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:57.734204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.734211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.734213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.734216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:57.734219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:57.734284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:57.734290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.734302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.734316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.734334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:57.734352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577636:2446], now have 1 active actors on pipe
2025-10-01T14:08:57.734359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577865:6740], now have 1 active actors on pipe
2025-10-01T14:08:57.734365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255095060713432:5998]
2025-10-01T14:08:57.734393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255095060713432:5998]
2025-10-01T14:08:57.734399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255095060713432:5998]
2025-10-01T14:08:57.734412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:57.734421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:57.734430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:57.734431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:57.734432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:57.734446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:57.734450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:57.734485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255095060713432:5998]
2025-10-01T14:08:57.734494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:57.734498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:57.734527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 660
2025-10-01T14:08:57.734536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 660
2025-10-01T14:08:57.734607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.734617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.734641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:57.734648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:57.734652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:57.734654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:57.734663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:57.734671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:57.734684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:57.734916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.734928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.734962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:57.735094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 661 partition: 0 MaxSeqNo: 45 sessionId: src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0
2025-10-01T14:08:57.735477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac57c15a-18f418c6-8d0a9d81-c4c5697b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:57.737908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0] Write session: try to update token
2025-10-01T14:08:57.737924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:57.752730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 661 sessionId: src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:57.755300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:57.755528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.755555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.755594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:57.755655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:57.759475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:57.759491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:57.759494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:57.759496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:57.759516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255095060713432:5998]
2025-10-01T14:08:57.759521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255095060713432:5998]
2025-10-01T14:08:57.759524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255095060713432:5998]
2025-10-01T14:08:57.759570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:57.759584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.759587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:57.759589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:57.759603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:57.759608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:57.759718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:57.805411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255097437577880:6355]
2025-10-01T14:08:57.805795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 660, pipe: [1:7556255097437577880:6355]
2025-10-01T14:08:57.923253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:57.932352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:57.932384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:57.932561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.932641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.932706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.932788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.932834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.932839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.932933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.932993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.933053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.933123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.933162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.933165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.933245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.933301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.933356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.933409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.933460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.933464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.933527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.933582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.933638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.933700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.933739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.933742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.933823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.933876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.933954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.934014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.934052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.934055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.934117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.934212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.934304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.934580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.934640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.934643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.934706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.934762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.934818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.934908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.934963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.934965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.935026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.935080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.935134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.935196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.935239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.935242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.935310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.935369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.935435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.935497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.935536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.935538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.935613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:57.935671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:57.935741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:57.935801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:57.935844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:57.935846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:57.935924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577880:6355], now have 1 active actors on pipe
2025-10-01T14:08:57.937249Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:57.937544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:57.937609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:57.937614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:57.937645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 661 reason: error at write: Disconnected sessionId: src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0
2025-10-01T14:08:57.937819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 661 sessionId: src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0 is DEAD
2025-10-01T14:08:57.937986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255097437577880:6355]
2025-10-01T14:08:57.938350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:57.938361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0] Write session will restart in 0.006554s
2025-10-01T14:08:57.938402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0] Write session: Do CDS request
2025-10-01T14:08:57.938409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:57.946084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:57.950684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:57.950706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 662
2025-10-01T14:08:57.950969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:57.951006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:57.951012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:57.951016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:57.954246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 662 sessionId:  describe result for acl check
2025-10-01T14:08:57.954296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:57.954298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:57.954300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:57.954306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255097437577907:6750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:57.954913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255097437577907:6750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:57.966172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255097437577907:6750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:57.984028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255097437577907:6750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:57.984049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255097437577907:6750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:57.984052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255097437577907:6750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:57.984061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:57.989545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:57.992623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:57.992880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:57.992892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:57.992912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:57.992969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:57.993016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255095060713684:6001]
2025-10-01T14:08:57.993632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:57.994017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:57.994074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:57.994401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:57.994461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.994467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.994468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.994470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.994471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.994473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.994474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.994476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.994477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.994478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.994480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.994481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.994482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.994484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.994490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.994500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.994505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.994508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.994513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.994517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.994521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.994525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.994528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.994533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.994536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.994540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.994544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.994547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.994555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.994563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:57.994571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.994576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:57.994581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.994586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:57.994590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.994595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:57.994601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.994606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:57.994611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.994615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:57.994620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.994625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:57.994630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.994635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:57.994646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.994651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:57.994655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.994660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:57.994665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.994669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:57.994673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.994678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:57.994682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.994687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:57.994691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.994696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:57.994737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:58.000268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:58.001156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:58.001173Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:58.001176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:58.001179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:58.001187Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 661 [2:7556255095060713684:6001]
2025-10-01T14:08:58.001204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:58.001229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:58.001240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.001244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.001246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.001265Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:58.001271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:58.001279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:58.001349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.001356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.001358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.001362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:58.001364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:58.001445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:58.001456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.001470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.001484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.001499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:58.001518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255095060713679:6001]
2025-10-01T14:08:58.001526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255095060713679:6001]
2025-10-01T14:08:58.001528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255095060713679:6001]
2025-10-01T14:08:58.001544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:58.001565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:58.001590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:58.001592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:58.001606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:58.001609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:58.001612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:58.001633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255095060713679:6001]
2025-10-01T14:08:58.001636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:58.001694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:58.001868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437578050:6750], now have 1 active actors on pipe
2025-10-01T14:08:58.001883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255097437577896:2446], now have 1 active actors on pipe
2025-10-01T14:08:58.001928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 661
2025-10-01T14:08:58.002038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.002051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.002052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 661
2025-10-01T14:08:58.002084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3713f267-e1854bf5-541e04ed-d292344e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:58.002098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.002106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.002108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:58.002119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.002135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:58.002158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.002672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.002686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.002708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.003696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b16fef-154f7dd4-bd8da37b-c8abea78_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3713f267-e1854bf5-541e04ed-d292344e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:58.002847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 662 partition: 0 MaxSeqNo: 45 sessionId: src_id|3713f267-e1854bf5-541e04ed-d292344e_0
2025-10-01T14:08:58.006779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3713f267-e1854bf5-541e04ed-d292344e_0] Write session: try to update token
2025-10-01T14:08:58.006794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3713f267-e1854bf5-541e04ed-d292344e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:58.027263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:58.027288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:58.027295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:58.027297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:58.027309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255095060713679:6001]
2025-10-01T14:08:58.027314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255095060713679:6001]
2025-10-01T14:08:58.027318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255095060713679:6001]
2025-10-01T14:08:58.027369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:58.027374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:58.027376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:58.027380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:58.027381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.027383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:58.027552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:58.038329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255101732545447:6355]
2025-10-01T14:08:58.039082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 661, pipe: [1:7556255101732545447:6355]
2025-10-01T14:08:58.043589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 662 sessionId: src_id|3713f267-e1854bf5-541e04ed-d292344e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:58.046526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:58.184085Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:58.184650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732545447:6355], now have 1 active actors on pipe
2025-10-01T14:08:58.184677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.184685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.186885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:58.187253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3713f267-e1854bf5-541e04ed-d292344e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:58.187266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3713f267-e1854bf5-541e04ed-d292344e_0] Write session will restart in 0.009047s
2025-10-01T14:08:58.187295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3713f267-e1854bf5-541e04ed-d292344e_0] Write session: Do CDS request
2025-10-01T14:08:58.187302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3713f267-e1854bf5-541e04ed-d292344e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:58.186678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:58.186748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:58.186751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:58.186832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 662 reason: error at write: Disconnected sessionId: src_id|3713f267-e1854bf5-541e04ed-d292344e_0
2025-10-01T14:08:58.187039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 662 sessionId: src_id|3713f267-e1854bf5-541e04ed-d292344e_0 is DEAD
2025-10-01T14:08:58.187355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255101732545447:6355]
2025-10-01T14:08:58.198278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3713f267-e1854bf5-541e04ed-d292344e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:58.198401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:58.198422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 663
2025-10-01T14:08:58.198617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:58.198652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:58.198658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:58.198662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:58.199123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 663 sessionId:  describe result for acl check
2025-10-01T14:08:58.199157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:58.199161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:58.199163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:58.199169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255101732545501:6755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:58.199719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255101732545501:6755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:58.208858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:58.209273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255101732545501:6755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:58.216688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:58.217154Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:58.217169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:58.217185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:58.217263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:58.217303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255099355681233:6005]
2025-10-01T14:08:58.217960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:58.218881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:58.218943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:58.219237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:58.219288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.219293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.219294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.219296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.219297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.219298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.219300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.219302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.219305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.219306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.219308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.219309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.219310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.219311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.219319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.219328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.219333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.219347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.219351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.219355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.219359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.219363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.219367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.219371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.219375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.219379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.219383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.219388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.219396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.219408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.219418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.219424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.219433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.219440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.219447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.219453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.219458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.219464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.219471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.219476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.219480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.219484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.219489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.219493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.219497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.219502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.219507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.219512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.219516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.219530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.219535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.219540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.219545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.219550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.219555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.219560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.219602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:58.223229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255101732545501:6755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:58.223254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255101732545501:6755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:58.223258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255101732545501:6755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:58.223268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:58.231527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:58.232465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:58.232481Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:58.232483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:58.232486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:58.232493Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 662 [2:7556255099355681233:6005]
2025-10-01T14:08:58.232512Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:58.232530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:58.232542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.232546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.232554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.232570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:58.232580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:58.232587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:58.232652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.232659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.232661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.232664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:58.232667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:58.232745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:58.232752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.232765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.232793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.232808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:58.232830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255099355681228:6005]
2025-10-01T14:08:58.232837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255099355681228:6005]
2025-10-01T14:08:58.232839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255099355681228:6005]
2025-10-01T14:08:58.232849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:58.232857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:58.232859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:58.232861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:58.232868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:58.232887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:58.232889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:58.232902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732545686:6755], now have 1 active actors on pipe
2025-10-01T14:08:58.232906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732545449:2446], now have 1 active actors on pipe
2025-10-01T14:08:58.232944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255099355681228:6005]
2025-10-01T14:08:58.232955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:58.233012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:58.233149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 662
2025-10-01T14:08:58.233184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 662
2025-10-01T14:08:58.233403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.233417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.233446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:58.233461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.233469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.233471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:58.233482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.233498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:58.233517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.233844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.233855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.233872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.234010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 663 partition: 0 MaxSeqNo: 45 sessionId: src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0
2025-10-01T14:08:58.234404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3713f267-e1854bf5-541e04ed-d292344e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:58.237595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0] Write session: try to update token
2025-10-01T14:08:58.237615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:58.266421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 663 sessionId: src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:58.267934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:58.267957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:58.267959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:58.267961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:58.267971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255099355681228:6005]
2025-10-01T14:08:58.267975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255099355681228:6005]
2025-10-01T14:08:58.267978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255099355681228:6005]
2025-10-01T14:08:58.268029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:58.268034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:58.268042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:58.268042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.268045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:58.268049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:58.268190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:58.268977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:58.287656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255101732545702:6355]
2025-10-01T14:08:58.287945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 662, pipe: [1:7556255101732545702:6355]
2025-10-01T14:08:58.429971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:58.430848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.430868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.430912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732545702:6355], now have 1 active actors on pipe
2025-10-01T14:08:58.431113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:58.431712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:58.431723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0] Write session will restart in 0.009916s
2025-10-01T14:08:58.431758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0] Write session: Do CDS request
2025-10-01T14:08:58.431764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:58.431284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:58.431290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255101732545702:6355]
2025-10-01T14:08:58.431299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:58.431310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:58.431369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 663 reason: error at write: Disconnected sessionId: src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0
2025-10-01T14:08:58.431549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 663 sessionId: src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0 is DEAD
2025-10-01T14:08:58.443775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:58.443910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:58.443936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 664
2025-10-01T14:08:58.444076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:58.444111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:58.444117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:58.444130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:58.444675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 664 sessionId:  describe result for acl check
2025-10-01T14:08:58.444718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:58.444724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:58.444726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:58.444731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255101732545782:6760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:58.445305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255101732545782:6760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:58.448222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255101732545782:6760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:58.454128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255101732545782:6760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:58.454148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255101732545782:6760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:58.454152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255101732545782:6760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:58.454161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:58.458753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:58.467357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:58.467656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:58.467671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:58.467685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:58.467759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:58.467806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255099355681504:6019]
2025-10-01T14:08:58.468409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:58.468834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:58.468890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:58.469202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:58.469267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.469274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.469276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.469277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.469278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.469279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.469281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.469282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.469283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.469285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.469286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.469287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.469288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.469290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.469295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.469304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.469308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.469312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.469316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.469320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.469323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.469326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.469330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.469335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.469339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.469342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.469345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.469349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.469356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.469363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.469369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.469375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.469380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.469385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.469389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.469394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.469399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.469411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.469420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.469425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.469430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.469435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.469439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.469448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.469453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.469462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.469467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.469475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.469480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.469489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.469493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.469502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.469507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.469516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.469520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.469525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.469567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:58.474604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:58.475311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:58.475328Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:58.475330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:58.475333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:58.475340Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 663 [2:7556255099355681504:6019]
2025-10-01T14:08:58.475358Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:58.475375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:58.475383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.475387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.475389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.475406Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:58.475415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:58.475422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:58.475484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.475492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.475494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.475497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:58.475500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:58.475569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:58.475576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.475586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.475600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.475619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:58.475641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255099355681499:6019]
2025-10-01T14:08:58.475649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255099355681499:6019]
2025-10-01T14:08:58.475651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255099355681499:6019]
2025-10-01T14:08:58.475661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:58.475674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:58.475679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:58.475692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:58.475694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:58.475695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:58.475697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:58.475707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732545708:2446], now have 1 active actors on pipe
2025-10-01T14:08:58.475711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732545916:6760], now have 1 active actors on pipe
2025-10-01T14:08:58.475740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255099355681499:6019]
2025-10-01T14:08:58.475756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:58.475769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 663
2025-10-01T14:08:58.475773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 663
2025-10-01T14:08:58.475949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:58.476143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.476158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.476184Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|202a695c-63964504-cafa7a11-4e3bb663_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:58.476196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.476201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.476203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:58.476213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.476224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:58.476240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.476805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.476817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.476837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.477020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 664 partition: 0 MaxSeqNo: 45 sessionId: src_id|202a695c-63964504-cafa7a11-4e3bb663_0
2025-10-01T14:08:58.477383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7bccd77-7f415ea6-390b692f-7d2e82d9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|202a695c-63964504-cafa7a11-4e3bb663_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:58.480092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|202a695c-63964504-cafa7a11-4e3bb663_0] Write session: try to update token
2025-10-01T14:08:58.480111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|202a695c-63964504-cafa7a11-4e3bb663_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:58.498333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.498355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.498409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:58.495823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 664 sessionId: src_id|202a695c-63964504-cafa7a11-4e3bb663_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:58.498107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:58.498560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:58.501136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:58.501158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:58.501160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:58.501162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:58.501172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255099355681499:6019]
2025-10-01T14:08:58.501177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255099355681499:6019]
2025-10-01T14:08:58.501180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255099355681499:6019]
2025-10-01T14:08:58.501220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:58.501234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:58.501236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:58.501237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:58.501244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.501247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:58.501367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:58.531392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255101732545968:6355]
2025-10-01T14:08:58.531727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 663, pipe: [1:7556255101732545968:6355]
2025-10-01T14:08:58.650764Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:58.658708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.658735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.658901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.658962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.659031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.659094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.659144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.659148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.659218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.659279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.659341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.659406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.659449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.659457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.659524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.659581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.659646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.659709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.659744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.659747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.659809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.659859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.659913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.659964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.660002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.660005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.660065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.660117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.660174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.660228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.660265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.660267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.660328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.660375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.660432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.660487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.660527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.660530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.660586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.660641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.660694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.660748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.660795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.660798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.660857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.660912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.660974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.661029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.661071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.661073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.661137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.661189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.661247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.661302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.661342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.661344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.661408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:58.661462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:58.661514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:58.661574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:58.661613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:58.661616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:58.661690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732545968:6355], now have 1 active actors on pipe
2025-10-01T14:08:58.663135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|202a695c-63964504-cafa7a11-4e3bb663_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:58.663147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|202a695c-63964504-cafa7a11-4e3bb663_0] Write session will restart in 0.007797s
2025-10-01T14:08:58.663173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|202a695c-63964504-cafa7a11-4e3bb663_0] Write session: Do CDS request
2025-10-01T14:08:58.663179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|202a695c-63964504-cafa7a11-4e3bb663_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:58.662746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255101732545968:6355]
2025-10-01T14:08:58.662793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:58.662795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:58.662825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 664 reason: error at write: Disconnected sessionId: src_id|202a695c-63964504-cafa7a11-4e3bb663_0
2025-10-01T14:08:58.662993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 664 sessionId: src_id|202a695c-63964504-cafa7a11-4e3bb663_0 is DEAD
2025-10-01T14:08:58.663129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:58.663167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:58.671819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|202a695c-63964504-cafa7a11-4e3bb663_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:58.671944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:58.671967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 665
2025-10-01T14:08:58.672106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:58.672156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:58.672162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:58.672169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:58.672674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 665 sessionId:  describe result for acl check
2025-10-01T14:08:58.672729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:58.672736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:58.672738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:58.672745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255101732545985:6766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:58.673342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255101732545985:6766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:58.676387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255101732545985:6766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:58.681684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255101732545985:6766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:58.681702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255101732545985:6766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:58.681705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255101732545985:6766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:58.681714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:58.692827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:58.697513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:58.697783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:58.697799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:58.697812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:58.697881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:58.697943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255099355681745:6021]
2025-10-01T14:08:58.698603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:58.699396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:58.699460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:58.699791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:58.699880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.699889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.699890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.699892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.699893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.699895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.699897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.699898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.699899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.699900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.699902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.699902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.699904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.699905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.699911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.699922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.699926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.699930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.699934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.699938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.699941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.699944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.699947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.699952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.699956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.699959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.699963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.699966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.699975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.699983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.699988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.699993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.700002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.700008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.700012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.700017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.700022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.700027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.700031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.700036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.700041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.700046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.700051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.700055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.700060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.700067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.700071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.700076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.700081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.700085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.700089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.700094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.700099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.700104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.700108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.700114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.700151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:58.709773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:58.710969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:58.710977Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:58.710980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:58.710985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:58.710992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 664 [2:7556255099355681745:6021]
2025-10-01T14:08:58.711011Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:58.711030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:58.711033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.711037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.711039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.711054Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:58.711059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:58.711065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:58.711138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.711141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.711143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.711150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:58.711153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:58.711228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:58.711230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.711242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.711251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.711266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:58.711282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255099355681739:6021]
2025-10-01T14:08:58.711284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255099355681739:6021]
2025-10-01T14:08:58.711286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255099355681739:6021]
2025-10-01T14:08:58.711300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:58.711315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:58.711330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:58.711333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:58.711370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255099355681739:6021]
2025-10-01T14:08:58.711373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:58.711763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:58.711790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:58.711792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:58.711798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:58.711929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732545970:2446], now have 1 active actors on pipe
2025-10-01T14:08:58.711943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732546114:6766], now have 1 active actors on pipe
2025-10-01T14:08:58.713817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 664
2025-10-01T14:08:58.713866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 664
2025-10-01T14:08:58.714045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.714062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.714092Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:58.714107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.714114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.714116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:58.714129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.714148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:58.714169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.714397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.714411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.714430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.714531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 665 partition: 0 MaxSeqNo: 45 sessionId: src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0
2025-10-01T14:08:58.714870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|202a695c-63964504-cafa7a11-4e3bb663_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:58.717836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0] Write session: try to update token
2025-10-01T14:08:58.717855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:58.735204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 665 sessionId: src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:58.738932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:58.738954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:58.738957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:58.738959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:58.738969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255099355681739:6021]
2025-10-01T14:08:58.738975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255099355681739:6021]
2025-10-01T14:08:58.738979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255099355681739:6021]
2025-10-01T14:08:58.739035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:58.739051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.739054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:58.739217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:58.740655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:58.740826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:58.740842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:58.740847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:58.762828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255101732546221:6355]
2025-10-01T14:08:58.763489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 664, pipe: [1:7556255101732546221:6355]
2025-10-01T14:08:58.890027Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:58.890683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.890700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.890736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732546221:6355], now have 1 active actors on pipe
2025-10-01T14:08:58.890961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:58.891382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:58.891390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0] Write session will restart in 0.007331s
2025-10-01T14:08:58.891413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0] Write session: Do CDS request
2025-10-01T14:08:58.891419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:58.890994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:58.891014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:58.891095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 665 reason: error at write: Disconnected sessionId: src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0
2025-10-01T14:08:58.891270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 665 sessionId: src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0 is DEAD
2025-10-01T14:08:58.891641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255101732546221:6355]
2025-10-01T14:08:58.891661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:58.899932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:58.900022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:58.900041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 666
2025-10-01T14:08:58.900162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:58.900189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:58.900209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:58.900219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:58.900649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 666 sessionId:  describe result for acl check
2025-10-01T14:08:58.900683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:58.900689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:58.900690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:58.900694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255101732546237:6770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:58.901205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255101732546237:6770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:58.903796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255101732546237:6770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:58.908624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255101732546237:6770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:58.908645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255101732546237:6770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:58.908648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255101732546237:6770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:58.908658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:58.914365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:58.922522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:58.922810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:58.922825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:58.922837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:58.922896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:58.922941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255099355681991:6024]
2025-10-01T14:08:58.923563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:58.924521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:58.924591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:58.925003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:58.925090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.925091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.925092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.925093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.925095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.925096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.925098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.925099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.925101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.925101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.925103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.925104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.925105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.925107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.925113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.925122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.925126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.925130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.925133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.925137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.925140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.925143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.925147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.925151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.925154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.925157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.925161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.925164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.925173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.925180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:58.925185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.925190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:58.925195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.925200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:58.925205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.925209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:58.925215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.925221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:58.925226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.925231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:58.925235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.925240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:58.925244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.925248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:58.925253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.925259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:58.925263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.925268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.925271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.925278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.925283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.925287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.925292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.925297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:58.925301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.925306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:58.925345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:58.930654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:58.931405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:58.931412Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:58.931416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:58.931421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:58.931430Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 665 [2:7556255099355681991:6024]
2025-10-01T14:08:58.931452Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:58.931473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:58.931476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.931480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.931482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.931499Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:58.931505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:58.931513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:58.931585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.931588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.931590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.931593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:58.931596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:58.931675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:58.931678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.931692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:58.931702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:58.931717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:58.931735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255099355681986:6024]
2025-10-01T14:08:58.931738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255099355681986:6024]
2025-10-01T14:08:58.931741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255099355681986:6024]
2025-10-01T14:08:58.931756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:58.931771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:58.931786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:58.931788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:58.931830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255099355681986:6024]
2025-10-01T14:08:58.931832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:58.932078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:58.932088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:58.932091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:58.932096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:58.932550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 665
2025-10-01T14:08:58.932651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 665
2025-10-01T14:08:58.936514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732546224:2446], now have 1 active actors on pipe
2025-10-01T14:08:58.936534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732546401:6770], now have 1 active actors on pipe
2025-10-01T14:08:58.936563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.936570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.936611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|492df18f-6975a4ac-3117d4b2-49647a23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:58.936621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:58.936626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:58.936629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:58.936642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:58.936658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:58.936674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.937293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:58.937312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:58.937346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:58.937588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 666 partition: 0 MaxSeqNo: 45 sessionId: src_id|492df18f-6975a4ac-3117d4b2-49647a23_0
2025-10-01T14:08:58.937981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa83357b-17e0155c-2aba1c56-b8c1657e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|492df18f-6975a4ac-3117d4b2-49647a23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:58.940764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|492df18f-6975a4ac-3117d4b2-49647a23_0] Write session: try to update token
2025-10-01T14:08:58.940800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|492df18f-6975a4ac-3117d4b2-49647a23_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:58.962274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:58.962303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:58.962306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:58.962308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:58.962319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255099355681986:6024]
2025-10-01T14:08:58.962324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255099355681986:6024]
2025-10-01T14:08:58.962332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255099355681986:6024]
2025-10-01T14:08:58.962403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:58.962411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:58.962417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:58.962419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:58.962424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:58.962428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:58.962578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:58.968572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 666 sessionId: src_id|492df18f-6975a4ac-3117d4b2-49647a23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:58.971530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:58.991626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255101732546477:6355]
2025-10-01T14:08:58.991972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 665, pipe: [1:7556255101732546477:6355]
2025-10-01T14:08:59.099892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:59.100310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.100326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.100377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255101732546477:6355], now have 1 active actors on pipe
2025-10-01T14:08:59.100657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:59.100779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:59.100852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255101732546477:6355]
2025-10-01T14:08:59.100880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:59.100891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:59.100961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 666 reason: error at write: Disconnected sessionId: src_id|492df18f-6975a4ac-3117d4b2-49647a23_0
2025-10-01T14:08:59.101336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492df18f-6975a4ac-3117d4b2-49647a23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:59.101345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492df18f-6975a4ac-3117d4b2-49647a23_0] Write session will restart in 0.006285s
2025-10-01T14:08:59.101364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492df18f-6975a4ac-3117d4b2-49647a23_0] Write session: Do CDS request
2025-10-01T14:08:59.101379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492df18f-6975a4ac-3117d4b2-49647a23_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:59.101208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 666 sessionId: src_id|492df18f-6975a4ac-3117d4b2-49647a23_0 is DEAD
2025-10-01T14:08:59.108975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|492df18f-6975a4ac-3117d4b2-49647a23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.109056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:59.109076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 667
2025-10-01T14:08:59.109284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.109328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:59.109340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:59.109344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:59.109872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 667 sessionId:  describe result for acl check
2025-10-01T14:08:59.109908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:59.109909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:59.109911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:59.109916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255106027513807:6781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:59.110438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255106027513807:6781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:59.114812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255106027513807:6781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:59.121976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:59.123055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255106027513807:6781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:59.123072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255106027513807:6781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:59.123075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255106027513807:6781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:59.123083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:59.127188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:59.127436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:59.127451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:59.127463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:59.127522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:59.127570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255103650649537:6028]
2025-10-01T14:08:59.128459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:59.128896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:59.128955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:59.129305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:59.129385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.129392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.129393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.129394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.129395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.129396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.129397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.129398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.129400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.129401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.129402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.129403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.129405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.129406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.129412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.129421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.129424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.129428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.129431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.129434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.129437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.129441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.129444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.129447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.129450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.129453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.129456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.129460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.129468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.129475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.129481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.129486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.129490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.129494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.129498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.129509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.129513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.129521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.129525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.129530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.129534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.129543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.129547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.129556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.129560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.129565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.129568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.129572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.129576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.129580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.129584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.129589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.129594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.129599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.129607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.129612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.129648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:59.137013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:59.138094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:59.138114Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:59.138117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:59.138120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:59.138129Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 666 [2:7556255103650649537:6028]
2025-10-01T14:08:59.138146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:59.138164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:59.138172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:59.138176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:59.138178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:59.138193Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:59.138203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:59.138209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:59.138276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.138282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.138284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.138287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:59.138289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:59.138356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:59.138363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.138389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.138407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.138425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:59.138446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027513793:2446], now have 1 active actors on pipe
2025-10-01T14:08:59.138453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514031:6781], now have 1 active actors on pipe
2025-10-01T14:08:59.138462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255103650649531:6028]
2025-10-01T14:08:59.138468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255103650649531:6028]
2025-10-01T14:08:59.138470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255103650649531:6028]
2025-10-01T14:08:59.138482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:59.138490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:59.138495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:59.138503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:59.138505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:59.138508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:59.138510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:59.138550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255103650649531:6028]
2025-10-01T14:08:59.138565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:59.138572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:59.138559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 666
2025-10-01T14:08:59.138601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.138587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 666
2025-10-01T14:08:59.138609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.138638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:59.138649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:59.138657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:59.138660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:59.138669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:59.138681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:59.138699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:59.138953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.138962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.138977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:59.139073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 667 partition: 0 MaxSeqNo: 45 sessionId: src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0
2025-10-01T14:08:59.139448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|492df18f-6975a4ac-3117d4b2-49647a23_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:59.141901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0] Write session: try to update token
2025-10-01T14:08:59.141919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:59.157352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 667 sessionId: src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:59.158936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:08:59.158961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:59.158972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255103650649531:6028]
2025-10-01T14:08:59.159019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:08:59.159019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:08:59.159204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:08:59.159363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:59.159836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:59.159518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:59.159674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:08:59.159875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:08:59.159912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:08:59.160042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.160058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.160086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:59.160169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:59.174500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:59.174524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:59.174527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:59.174529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:59.174540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255103650649531:6028]
2025-10-01T14:08:59.174544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255103650649531:6028]
2025-10-01T14:08:59.174547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255103650649531:6028]
2025-10-01T14:08:59.174593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:59.174597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:59.174601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:59.174604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:59.174605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.174607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:59.174741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:59.201062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255106027514044:6355]
2025-10-01T14:08:59.201284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 666, pipe: [1:7556255106027514044:6355]
2025-10-01T14:08:59.336360Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:59.345167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.345202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.345386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.345469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.345559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.345628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.345998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.346011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.346085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.346156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.346226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.346305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.346354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.346364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.346462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.346523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.346591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.346671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.346729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.346738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.346807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.346914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.346984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.347051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.347098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.347106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.347175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.347245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.347319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.347398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.347465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.347473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.347549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.347622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.347694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.347763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.347813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.347821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.347894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.347964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.348037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.348104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.348154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.348160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.348229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.348297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.348370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.348445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.348494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.348501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.348571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.348634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.348702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.348798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.348856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.348864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.348930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:08:59.348997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:08:59.349064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:08:59.349134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:08:59.349180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:08:59.349188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:08:59.349258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514044:6355], now have 1 active actors on pipe
2025-10-01T14:08:59.349523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255106027514044:6355]
2025-10-01T14:08:59.349528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:59.349533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:59.349560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:59.349567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 667 reason: error at write: Disconnected sessionId: src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0
2025-10-01T14:08:59.349743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 667 sessionId: src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0 is DEAD
2025-10-01T14:08:59.350206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:59.350216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0] Write session will restart in 0.006466s
2025-10-01T14:08:59.350241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0] Write session: Do CDS request
2025-10-01T14:08:59.350247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:59.350307Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:59.357861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.358570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:59.358597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 668
2025-10-01T14:08:59.358742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.358782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:59.358787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:59.358791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:59.359217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 668 sessionId:  describe result for acl check
2025-10-01T14:08:59.359251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:59.359253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:59.359254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:59.359259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255106027514083:6786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:59.359809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255106027514083:6786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:59.362781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255106027514083:6786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:59.366686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255106027514083:6786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:59.366716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255106027514083:6786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:59.366720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255106027514083:6786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:59.366728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:59.372338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:59.375367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:59.375593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:59.375602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:59.375610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:59.375650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:59.375702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255103650649825:6041]
2025-10-01T14:08:59.376266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:59.376572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:59.376610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:59.376889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:59.376964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.376971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.376972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.376973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.376974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.376976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.376977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.376978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.376979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.376981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.376982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.376983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.376984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.376985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.376990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.377008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.377012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.377015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.377019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.377023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.377027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.377031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.377035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.377040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.377044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.377047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.377051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.377055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.377061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.377068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.377074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.377080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.377084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.377090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.377099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.377104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.377108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.377111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.377114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.377117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.377123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.377126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.377129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.377132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.377138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.377141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.377147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.377151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.377153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.377156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.377159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.377162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.377164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.377167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.377170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.377173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.377195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:59.381079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:59.381828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:59.381843Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:59.381845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:59.381848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:59.381854Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 667 [2:7556255103650649825:6041]
2025-10-01T14:08:59.381870Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:59.381887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:59.381890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:59.381894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:59.381896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:59.381912Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:59.381921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:59.381928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:59.381998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.382005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.382007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.382011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:59.382013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:59.382077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:59.382084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.382095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.382105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.382124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:59.382146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514059:2446], now have 1 active actors on pipe
2025-10-01T14:08:59.382149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514225:6786], now have 1 active actors on pipe
2025-10-01T14:08:59.382157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255103650649814:6041]
2025-10-01T14:08:59.382163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255103650649814:6041]
2025-10-01T14:08:59.382165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255103650649814:6041]
2025-10-01T14:08:59.382177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:59.382189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:59.382192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:59.382200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:59.382202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:59.382205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:59.382208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:59.382242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255103650649814:6041]
2025-10-01T14:08:59.382249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:59.382255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:59.382284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.382293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.382318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82a7ebad-59214a33-225e8251-c1b007f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:59.382330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:59.382334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:59.382337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:59.382349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:59.382362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:59.382393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:59.382608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.382620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.382641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:59.383056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45248188-c0701991-2ef8d4f9-6c8eb4d5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82a7ebad-59214a33-225e8251-c1b007f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:59.382229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 667
2025-10-01T14:08:59.382250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 667
2025-10-01T14:08:59.382745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 668 partition: 0 MaxSeqNo: 45 sessionId: src_id|82a7ebad-59214a33-225e8251-c1b007f0_0
2025-10-01T14:08:59.385414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82a7ebad-59214a33-225e8251-c1b007f0_0] Write session: try to update token
2025-10-01T14:08:59.385433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82a7ebad-59214a33-225e8251-c1b007f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:59.399821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 668 sessionId: src_id|82a7ebad-59214a33-225e8251-c1b007f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:59.402184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:59.403928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.403959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.403981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:59.403985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:59.403987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:59.403989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:59.403998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255103650649814:6041]
2025-10-01T14:08:59.404003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255103650649814:6041]
2025-10-01T14:08:59.404007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255103650649814:6041]
2025-10-01T14:08:59.404066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:59.404078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.404080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:59.404219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:59.406424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:59.406441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:59.406445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:59.449900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255106027514308:6355]
2025-10-01T14:08:59.450183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 667, pipe: [1:7556255106027514308:6355]
2025-10-01T14:08:59.561618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:59.561935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:08:59.562003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514308:6355], now have 1 active actors on pipe
2025-10-01T14:08:59.562229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:08:59.562280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255106027514308:6355]
2025-10-01T14:08:59.562311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:59.562320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:59.562322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:59.562411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 668 reason: error at write: Disconnected sessionId: src_id|82a7ebad-59214a33-225e8251-c1b007f0_0
2025-10-01T14:08:59.562560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 668 sessionId: src_id|82a7ebad-59214a33-225e8251-c1b007f0_0 is DEAD
2025-10-01T14:08:59.562923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a7ebad-59214a33-225e8251-c1b007f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:59.562930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a7ebad-59214a33-225e8251-c1b007f0_0] Write session will restart in 0.006351s
2025-10-01T14:08:59.562955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a7ebad-59214a33-225e8251-c1b007f0_0] Write session: Do CDS request
2025-10-01T14:08:59.562963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a7ebad-59214a33-225e8251-c1b007f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:59.570940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82a7ebad-59214a33-225e8251-c1b007f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.571094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:59.571108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 669
2025-10-01T14:08:59.571270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.571300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:59.571311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:59.571315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:59.571697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 669 sessionId:  describe result for acl check
2025-10-01T14:08:59.571728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:59.571735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:59.571736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:59.571742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255106027514336:6791] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:59.572322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255106027514336:6791] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:59.574135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255106027514336:6791] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:59.577877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255106027514336:6791] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:59.577894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255106027514336:6791] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:59.577905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255106027514336:6791] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:59.577913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:59.585392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:59.588285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:59.588502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:59.588513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:59.588524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:59.588590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:59.588627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255103650650071:6044]
2025-10-01T14:08:59.589173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:59.589592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:59.589638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:59.589875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:59.589914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.589919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.589920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.589920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.589921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.589922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.589923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.589924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.589924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.589933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.589934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.589935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.589936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.589936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.589940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.589946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.589948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.589951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.589953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.589955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.589957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.589959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.589961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.589965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.589967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.589969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.589971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.589973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.589977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.589982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.589986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.589989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.589999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.590004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.590008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.590013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.590017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.590022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.590026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.590031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.590035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.590038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.590041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.590044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.590048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.590053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.590057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.590061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.590065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.590070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.590074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.590083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.590088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.590090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.590093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.590096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.590117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:59.593866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:59.594495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:59.594509Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:59.594512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:59.594516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:59.594522Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 668 [2:7556255103650650071:6044]
2025-10-01T14:08:59.594540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:59.594559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:59.594567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:59.594571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:59.594573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:59.594592Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:59.594604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:59.594611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:59.594676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.594683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.594685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.594689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:59.594691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:59.594755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:59.594763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.594773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.594784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.594801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:59.594821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514429:6791], now have 1 active actors on pipe
2025-10-01T14:08:59.594824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514323:2446], now have 1 active actors on pipe
2025-10-01T14:08:59.594831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255103650650066:6044]
2025-10-01T14:08:59.594833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255103650650066:6044]
2025-10-01T14:08:59.594835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255103650650066:6044]
2025-10-01T14:08:59.594849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:59.595217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 668
2025-10-01T14:08:59.595266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 668
2025-10-01T14:08:59.594863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:59.594863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:59.594866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:59.594869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:59.594881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:59.594884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:59.594918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255103650650066:6044]
2025-10-01T14:08:59.594925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:59.594970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:59.595646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.595659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.595691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:59.595704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:59.595713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:59.595716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:59.595727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:59.595742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:59.595765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:59.595917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.595934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.595957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:59.596113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 669 partition: 0 MaxSeqNo: 45 sessionId: src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0
2025-10-01T14:08:59.596490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82a7ebad-59214a33-225e8251-c1b007f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:59.598945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0] Write session: try to update token
2025-10-01T14:08:59.598973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:59.615784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 669 sessionId: src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:59.616673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:59.616694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:59.616697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:59.616699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:59.616709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255103650650066:6044]
2025-10-01T14:08:59.616715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255103650650066:6044]
2025-10-01T14:08:59.616719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255103650650066:6044]
2025-10-01T14:08:59.616775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:59.616778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:59.616784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:59.616786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.616788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:59.616788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:59.616930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:59.618463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:59.662400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255106027514575:6355]
2025-10-01T14:08:59.662709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 668, pipe: [1:7556255106027514575:6355]
2025-10-01T14:08:59.771369Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:59.771761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.771777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.771819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514575:6355], now have 1 active actors on pipe
2025-10-01T14:08:59.772019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:59.772042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255106027514575:6355]
2025-10-01T14:08:59.772044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:59.772046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:59.772072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:59.772098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 669 reason: error at write: Disconnected sessionId: src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0
2025-10-01T14:08:59.772457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:59.772279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 669 sessionId: src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0 is DEAD
2025-10-01T14:08:59.772478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0] Write session will restart in 0.005249s
2025-10-01T14:08:59.772509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0] Write session: Do CDS request
2025-10-01T14:08:59.772515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:59.778900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.779307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:59.779323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 670
2025-10-01T14:08:59.779535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.779571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:59.779580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:59.779584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:59.779962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 670 sessionId:  describe result for acl check
2025-10-01T14:08:59.779993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:59.779999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:59.780000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:59.780006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255106027514594:6796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:59.780523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255106027514594:6796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:59.784448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255106027514594:6796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:59.788643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255106027514594:6796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:59.788661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255106027514594:6796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:59.788664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255106027514594:6796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:59.788674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:59.793058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:59.796134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:59.796384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:59.796395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:59.796405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:59.796455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:59.796494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255103650650319:6046]
2025-10-01T14:08:59.797020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:59.797304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:59.797363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:08:59.797697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:08:59.797753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.797754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.797755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.797756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.797757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.797758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.797759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.797760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.797761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.797763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.797764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.797765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.797767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.797768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.797774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.797783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.797787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.797790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.797793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.797798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.797801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.797805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.797809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.797812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.797816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.797820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.797823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.797827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.797834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.797841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:08:59.797846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.797852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:08:59.797856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.797861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:08:59.797865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.797870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:08:59.797875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.797890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:08:59.797896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.797900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:08:59.797905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.797909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:08:59.797914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.797919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:08:59.797924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.797929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:08:59.797933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.797938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.797942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.797947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.797951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.797955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.797960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.797964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:08:59.797968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.797973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:08:59.798008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:08:59.801811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:08:59.802437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:08:59.802451Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:08:59.802454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:08:59.802458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:08:59.802464Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 669 [2:7556255103650650319:6046]
2025-10-01T14:08:59.802480Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:08:59.802498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:08:59.802505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:59.802509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:59.802512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:59.802528Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:08:59.802538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:08:59.802544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:08:59.802606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.802615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.802617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.802620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:08:59.802623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:08:59.802689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:08:59.802696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.802707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:08:59.802723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:08:59.802743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:08:59.802768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514744:6796], now have 1 active actors on pipe
2025-10-01T14:08:59.802775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514580:2446], now have 1 active actors on pipe
2025-10-01T14:08:59.802783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255103650650314:6046]
2025-10-01T14:08:59.802785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255103650650314:6046]
2025-10-01T14:08:59.802787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255103650650314:6046]
2025-10-01T14:08:59.802800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:08:59.802812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:08:59.802817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:08:59.802821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:08:59.802823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:08:59.802832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:08:59.802840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:08:59.802872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255103650650314:6046]
2025-10-01T14:08:59.802883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:08:59.802856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 669
2025-10-01T14:08:59.802861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 669
2025-10-01T14:08:59.802937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:08:59.803227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.803240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.803267Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:08:59.803274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:08:59.803282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:08:59.803284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:08:59.803293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:08:59.803304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:08:59.803318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:59.803575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.803584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.803599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:08:59.803700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 670 partition: 0 MaxSeqNo: 45 sessionId: src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0
2025-10-01T14:08:59.804043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25ae171c-5ab4e47e-3d110552-b04b42d7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:08:59.806555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0] Write session: try to update token
2025-10-01T14:08:59.806572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:08:59.825087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:08:59.825116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:08:59.825119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:08:59.825120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:08:59.825131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255103650650314:6046]
2025-10-01T14:08:59.825136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255103650650314:6046]
2025-10-01T14:08:59.825140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255103650650314:6046]
2025-10-01T14:08:59.825193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:08:59.825195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:08:59.825204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:08:59.825207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:08:59.825221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:08:59.825225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:08:59.825357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:08:59.825644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 670 sessionId: src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:08:59.828360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:08:59.872261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255106027514834:6355]
2025-10-01T14:08:59.872460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 669, pipe: [1:7556255106027514834:6355]
2025-10-01T14:08:59.976306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:08:59.976820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:08:59.976837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:08:59.976877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514834:6355], now have 1 active actors on pipe
2025-10-01T14:08:59.977107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:08:59.977085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:08:59.977093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:08:59.977100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:08:59.977155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255106027514834:6355]
2025-10-01T14:08:59.977161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 670 reason: error at write: Disconnected sessionId: src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0
2025-10-01T14:08:59.977335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 670 sessionId: src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0 is DEAD
2025-10-01T14:08:59.977507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:08:59.977538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0] Write session will restart in 0.005049s
2025-10-01T14:08:59.977569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0] Write session: Do CDS request
2025-10-01T14:08:59.977575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:08:59.985495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.985588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:08:59.985605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 671
2025-10-01T14:08:59.986485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:08:59.986536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:08:59.986546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:08:59.986552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:08:59.986981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 671 sessionId:  describe result for acl check
2025-10-01T14:08:59.987018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:08:59.987022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:08:59.987024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:08:59.987030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255106027514865:6800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:08:59.987547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255106027514865:6800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:08:59.989799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255106027514865:6800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:08:59.993189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255106027514865:6800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:08:59.993205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255106027514865:6800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:08:59.993209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255106027514865:6800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:08:59.993217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:08:59.995352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:08:59.998524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:08:59.998834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:08:59.998843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:08:59.998855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:08:59.998917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:08:59.998970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255103650650566:6049]
2025-10-01T14:08:59.999561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:08:59.999891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:08:59.999935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:00.000185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:00.000245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.000249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.000251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.000251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.000252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.000253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.000254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.000254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.000255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.000256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.000257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.000258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.000259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.000260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.000266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.000274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.000277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.000280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.000283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.000286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.000289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.000292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.000295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.000298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.000301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.000304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.000307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.000310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.000317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.000323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.000329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.000333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.000337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.000342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.000346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.000350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.000354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.000359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.000362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.000366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.000372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.000376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.000380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.000385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.000389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.000393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.000397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.000404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.000408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.000413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.000417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.000421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.000427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.000431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.000434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.000438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.000473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:00.004384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:00.005587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:00.005606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:00.005609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:00.005613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:00.005620Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 670 [2:7556255103650650566:6049]
2025-10-01T14:09:00.005640Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:00.005658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:00.005670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.005673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.005675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.005692Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:00.005698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:00.005705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:00.005768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.005776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.005778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.005782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:00.005784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:00.005849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:00.005856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.005870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.005882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.005903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:00.005924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027515057:6800], now have 1 active actors on pipe
2025-10-01T14:09:00.005931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255106027514839:2446], now have 1 active actors on pipe
2025-10-01T14:09:00.005939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255103650650561:6049]
2025-10-01T14:09:00.005946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255103650650561:6049]
2025-10-01T14:09:00.005947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255103650650561:6049]
2025-10-01T14:09:00.005961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:00.005975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:00.005977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:00.005981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:00.005983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:00.005987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:00.005989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:00.006020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255103650650561:6049]
2025-10-01T14:09:00.006027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:00.006030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:00.005996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 670
2025-10-01T14:09:00.006075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 670
2025-10-01T14:09:00.006135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.006146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.006171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:00.006177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.006188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.006190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:00.006200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.006208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:00.006222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.007217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 671 partition: 0 MaxSeqNo: 45 sessionId: src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0
2025-10-01T14:09:00.006631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.006648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.006673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.007617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15dc4960-18c3660-a8684a9a-cbb6ef4b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:00.010092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0] Write session: try to update token
2025-10-01T14:09:00.010108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:00.022038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:00.022059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:00.022071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255103650650561:6049]
2025-10-01T14:09:00.022118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:00.022117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:00.022285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:00.022442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:00.022596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:00.022741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:00.022947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:00.022987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:00.028592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 671 sessionId: src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:00.031009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:00.031180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.031203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.031237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:00.031302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:00.036532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:00.036553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:00.036556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:00.036558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:00.036568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255103650650561:6049]
2025-10-01T14:09:00.036571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255103650650561:6049]
2025-10-01T14:09:00.036575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255103650650561:6049]
2025-10-01T14:09:00.036618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:00.036623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:00.036630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:00.036631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.036633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:00.036633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:00.036756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:00.077183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255110322482409:6355]
2025-10-01T14:09:00.077380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 670, pipe: [1:7556255110322482409:6355]
2025-10-01T14:09:00.185855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:00.193027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.193052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.193185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.193232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.193287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.193334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.193372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.193378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.193432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.193488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.193538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.193592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.193630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.193636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.193699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.193754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.193810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.193873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.193913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.193918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.193981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.194038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.194093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.194151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.194195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.194202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.194259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.194317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.194398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.194463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.194506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.194513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.194576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.194725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.194789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.194851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.194912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.194919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.194985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.195046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.195111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.195174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.195226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.195233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.195301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.195365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.195427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.195490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.195530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.195538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.195600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.195656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.195717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.195780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.195826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.195833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.195895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.195953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.196023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.196102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.196162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.196170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.196236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322482409:6355], now have 1 active actors on pipe
2025-10-01T14:09:00.196542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255110322482409:6355]
2025-10-01T14:09:00.196545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:00.196549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:00.196578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 671 reason: error at write: Disconnected sessionId: src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0
2025-10-01T14:09:00.196589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:00.196832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 671 sessionId: src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0 is DEAD
2025-10-01T14:09:00.196942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:00.196953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0] Write session will restart in 0.008068s
2025-10-01T14:09:00.196979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0] Write session: Do CDS request
2025-10-01T14:09:00.196985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:00.197136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:00.205976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:00.206089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:00.206110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 672
2025-10-01T14:09:00.206287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:00.206323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:00.206328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:00.206332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:00.206912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 672 sessionId:  describe result for acl check
2025-10-01T14:09:00.206953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:00.206955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:00.206957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:00.206963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255110322482428:6811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:00.207477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255110322482428:6811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:00.211422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255110322482428:6811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:00.215613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255110322482428:6811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:00.215631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255110322482428:6811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:00.215634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255110322482428:6811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:00.215643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:00.220259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:00.223662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:00.224071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:00.224088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:00.224103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:00.224181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:00.224224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255107945618119:6053]
2025-10-01T14:09:00.224855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:00.225180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:00.225230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:00.225535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:00.225605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.225611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.225612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.225613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.225614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.225616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.225617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.225619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.225620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.225621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.225622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.225624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.225625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.225626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.225631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.225642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.225646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.225650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.225654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.225659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.225662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.225667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.225671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.225676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.225680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.225684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.225688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.225692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.225699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.225708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.225719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.225724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.225730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.225738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.225743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.225749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.225754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.225763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.225768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.225774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.225783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.225789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.225794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.225803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.225808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.225813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.225818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.225823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.225829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.225834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.225841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.225850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.225856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.225865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.225874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.225879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.225930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:00.230311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:00.231015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:00.231031Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:00.231034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:00.231039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:00.231046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 671 [2:7556255107945618119:6053]
2025-10-01T14:09:00.231063Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:00.231080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:00.231084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.231087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.231090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.231106Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:00.231116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:00.231123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:00.231185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.231195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.231197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.231200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:00.231202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:00.231270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:00.231278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.231290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.231305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.231327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:00.231349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322482574:6811], now have 1 active actors on pipe
2025-10-01T14:09:00.231357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322482414:2446], now have 1 active actors on pipe
2025-10-01T14:09:00.231365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255107945618114:6053]
2025-10-01T14:09:00.231371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255107945618114:6053]
2025-10-01T14:09:00.231373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255107945618114:6053]
2025-10-01T14:09:00.231388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:00.231402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:00.231415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:00.231417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:00.231433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:00.231437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:00.231440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:00.231411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 671
2025-10-01T14:09:00.231417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 671
2025-10-01T14:09:00.231452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255107945618114:6053]
2025-10-01T14:09:00.231460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:00.231462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:00.231476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.231481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.231530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:00.231541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.231546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.231552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:00.231561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.231574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:00.231601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.231755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.231770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.231791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.231889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 672 partition: 0 MaxSeqNo: 45 sessionId: src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0
2025-10-01T14:09:00.232271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39f6538f-77c5d42f-dd9b1459-9861a2da_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:00.235418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0] Write session: try to update token
2025-10-01T14:09:00.235440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:00.254121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:00.254151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:00.254155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:00.254157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:00.254167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255107945618114:6053]
2025-10-01T14:09:00.254173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255107945618114:6053]
2025-10-01T14:09:00.254177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255107945618114:6053]
2025-10-01T14:09:00.254232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:00.254249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:00.254254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:00.254457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 672 sessionId: src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:00.254475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:00.254490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.254492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:00.254636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:00.257050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:00.296753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255110322482676:6355]
2025-10-01T14:09:00.297109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 671, pipe: [1:7556255110322482676:6355]
2025-10-01T14:09:00.413913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:00.413922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:00.413932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:00.414002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 672 reason: error at write: Disconnected sessionId: src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0
2025-10-01T14:09:00.414179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 672 sessionId: src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0 is DEAD
2025-10-01T14:09:00.414282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255110322482676:6355]
2025-10-01T14:09:00.414343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:00.414356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0] Write session will restart in 0.007920s
2025-10-01T14:09:00.414399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0] Write session: Do CDS request
2025-10-01T14:09:00.414406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:00.413192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:00.413604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.413615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.413660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322482676:6355], now have 1 active actors on pipe
2025-10-01T14:09:00.414850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:00.427008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:00.427194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:00.427219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 673
2025-10-01T14:09:00.427340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:00.427378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:00.427388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:00.427391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:00.427812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 673 sessionId:  describe result for acl check
2025-10-01T14:09:00.427847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:00.427855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:00.427858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:00.427864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255110322482796:6816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:00.428323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255110322482796:6816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:00.430321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255110322482796:6816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:00.432671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:00.435476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:00.435722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:00.435730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:00.435743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:00.435754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255110322482796:6816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:00.435771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255110322482796:6816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:00.435775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255110322482796:6816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:00.435792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:00.435795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:00.435837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255107945618410:6067]
2025-10-01T14:09:00.436428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:00.436750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:00.436816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:00.437130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:00.437191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.437197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.437198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.437200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.437201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.437202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.437203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.437205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.437206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.437207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.437208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.437209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.437210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.437211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.437217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.437226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.437230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.437234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.437237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.437241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.437245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.437259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.437267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.437271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.437278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.437282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.437289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.437293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.437303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.437315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.437324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.437334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.437342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.437351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.437359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.437364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.437372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.437377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.437382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.437386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.437390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.437398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.437406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.437410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.437418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.437427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.437434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.437443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.437451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.437455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.437463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.437473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.437481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.437486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.437495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.437503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.437546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:00.441666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:00.442389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:00.442404Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:00.442406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:00.442410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:00.442418Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 672 [2:7556255107945618410:6067]
2025-10-01T14:09:00.442436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:00.442455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:00.442466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.442470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.442472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.442490Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:00.442495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:00.442502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:00.442563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.442572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.442573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.442576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:00.442579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:00.442782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 672
2025-10-01T14:09:00.442789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 672
2025-10-01T14:09:00.443028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:00.443041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.443056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.443069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.443084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:00.443111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322482925:6816], now have 1 active actors on pipe
2025-10-01T14:09:00.443124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322482684:2446], now have 1 active actors on pipe
2025-10-01T14:09:00.443144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.443153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.443170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255107945618405:6067]
2025-10-01T14:09:00.443176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255107945618405:6067]
2025-10-01T14:09:00.443178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255107945618405:6067]
2025-10-01T14:09:00.443190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:00.443201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:00.443212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:00.443213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:00.443214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:00.443228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:00.443235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:00.443252Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:00.443263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.443267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.443270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:00.443280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.443291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:00.443339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255107945618405:6067]
2025-10-01T14:09:00.443349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:00.443355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:00.443367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.443578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.443596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.443619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.443719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 673 partition: 0 MaxSeqNo: 45 sessionId: src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0
2025-10-01T14:09:00.444080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d72203-6da6848a-5d3e4d42-14d4ced1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:00.446818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0] Write session: try to update token
2025-10-01T14:09:00.446837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:00.461914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 673 sessionId: src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:00.464514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:00.464778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.464804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.464822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:00.464825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:00.464826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:00.464828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:00.464834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255107945618405:6067]
2025-10-01T14:09:00.464836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255107945618405:6067]
2025-10-01T14:09:00.464840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255107945618405:6067]
2025-10-01T14:09:00.464874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:00.464880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:00.464883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:00.464896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:00.464910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.464912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:00.465034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:00.514334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255110322482950:6355]
2025-10-01T14:09:00.514641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 672, pipe: [1:7556255110322482950:6355]
2025-10-01T14:09:00.619487Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:00.619746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:00.619802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322482950:6355], now have 1 active actors on pipe
2025-10-01T14:09:00.619893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:00.620009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255110322482950:6355]
2025-10-01T14:09:00.620039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:00.631691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:00.631708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:00.631730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 673 reason: error at write: Disconnected sessionId: src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0
2025-10-01T14:09:00.631884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 673 sessionId: src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0 is DEAD
2025-10-01T14:09:00.631989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:00.631999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0] Write session will restart in 0.009383s
2025-10-01T14:09:00.632031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0] Write session: Do CDS request
2025-10-01T14:09:00.632039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:00.642977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:00.643051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:00.643070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 674
2025-10-01T14:09:00.643204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:00.643239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:00.643250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:00.643256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:00.643664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 674 sessionId:  describe result for acl check
2025-10-01T14:09:00.643708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:00.643715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:00.643716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:00.643722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255110322483043:6821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:00.644254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255110322483043:6821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:00.650589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255110322483043:6821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:00.653709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255110322483043:6821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:00.653727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255110322483043:6821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:00.653730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255110322483043:6821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:00.653739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:00.653931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:00.657220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:00.657511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:00.657522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:00.657535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:00.657591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:00.657637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255107945618665:6069]
2025-10-01T14:09:00.658239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:00.658680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:00.658759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:00.659401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:00.659492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.659498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.659500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.659501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.659502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.659504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.659505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.659506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.659507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.659508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.659510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.659511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.659512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.659513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.659519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.659529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.659534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.659538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.659541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.659545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.659549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.659552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.659555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.659559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.659563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.659566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.659569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.659573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.659581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.659588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.659594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.659599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.659603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.659616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.659621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.659625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.659630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.659635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.659639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.659644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.659649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.659653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.659658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.659662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.659666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.659673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.659676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.659681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.659685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.659690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.659699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.659703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.659707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.659719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.659724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.659728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.659769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:00.664104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:00.664734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:00.664753Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:00.664756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:00.664760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:00.664780Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 673 [2:7556255107945618665:6069]
2025-10-01T14:09:00.664796Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:00.664822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:00.664826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.664830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.664832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.664851Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:00.664862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:00.664868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:00.664930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.664937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.664939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.664943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:00.664945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:00.665015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:00.665023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.665035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.665047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.665062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:00.665083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255107945618659:6069]
2025-10-01T14:09:00.665091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255107945618659:6069]
2025-10-01T14:09:00.665093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255107945618659:6069]
2025-10-01T14:09:00.665109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:00.665126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322482956:2446], now have 1 active actors on pipe
2025-10-01T14:09:00.665129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:00.665131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322483202:6821], now have 1 active actors on pipe
2025-10-01T14:09:00.665133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:00.665135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:00.665139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:00.665153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:00.665157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:00.665167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 673
2025-10-01T14:09:00.665194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255107945618659:6069]
2025-10-01T14:09:00.665202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:00.665205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:00.665218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 673
2025-10-01T14:09:00.665257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.665266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.665288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:00.665294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.665298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.665300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:00.665308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.665317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:00.665335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.665563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.665577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.665601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.665722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 674 partition: 0 MaxSeqNo: 45 sessionId: src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0
2025-10-01T14:09:00.666103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e963c02-3b6e091c-1fc0b7ff-e858bda3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:00.669026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0] Write session: try to update token
2025-10-01T14:09:00.669047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:00.678917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:00.678939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:00.678949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255107945618659:6069]
2025-10-01T14:09:00.678997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:00.679000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:00.679193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:00.679372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:00.679536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:00.679691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:00.680032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:00.680083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:00.688754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 674 sessionId: src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:00.691776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:00.692010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.692033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.692077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:00.692177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:00.696826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:00.696846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:00.696849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:00.696851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:00.696861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255107945618659:6069]
2025-10-01T14:09:00.696865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255107945618659:6069]
2025-10-01T14:09:00.696870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255107945618659:6069]
2025-10-01T14:09:00.696919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:00.696921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:00.696927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.696930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:00.696934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:00.696938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:00.697112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:00.720202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255110322483217:6355]
2025-10-01T14:09:00.720515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 673, pipe: [1:7556255110322483217:6355]
2025-10-01T14:09:00.852413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:00.861061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.861092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.861273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.861350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.861421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.861482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.861738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.861750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.861818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.861887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.861954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.862312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.862364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.862367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.862462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.862535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.862611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.862679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.862729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.862732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.862814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.862883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.862947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.863014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.863064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.863067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.863140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.863208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.865487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255110322483217:6355]
2025-10-01T14:09:00.863271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.863334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.863378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.863381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.863459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.863526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.863590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.865527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:00.863657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.865530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:00.863700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.865556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 674 reason: error at write: Disconnected sessionId: src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0
2025-10-01T14:09:00.863704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.863778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.863842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.863905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.863975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.864022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.864028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.864095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.864155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.864222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.864286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.864329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.864333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.864408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.864469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.864534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.864604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.864669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.864673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.864751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:00.864837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:00.864904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:00.864971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:00.865017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:00.865019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:00.865103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322483217:6355], now have 1 active actors on pipe
2025-10-01T14:09:00.865675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:00.865761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 674 sessionId: src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0 is DEAD
2025-10-01T14:09:00.865873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:00.865885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0] Write session will restart in 0.007589s
2025-10-01T14:09:00.865914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0] Write session: Do CDS request
2025-10-01T14:09:00.865920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:00.866243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:00.874960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:00.876089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:00.876123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 675
2025-10-01T14:09:00.876282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:00.876316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:00.876325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:00.876331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:00.877021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 675 sessionId:  describe result for acl check
2025-10-01T14:09:00.877072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:00.877074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:00.877076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:00.877082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255110322483234:6826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:00.877675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255110322483234:6826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:00.882665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255110322483234:6826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:00.891345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255110322483234:6826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:00.891383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255110322483234:6826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:00.891387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255110322483234:6826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:00.891395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:00.893536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:00.897177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:00.897457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:00.897473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:00.897498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:00.897560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:00.897610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255107945618918:6072]
2025-10-01T14:09:00.898201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:00.899599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:00.899672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:00.900026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:00.900090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.900095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.900097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.900098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.900099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.900100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.900102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.900103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.900104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.900105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.900107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.900108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.900109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.900110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.900116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.900125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.900129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.900134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.900138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.900142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.900145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.900149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.900153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.900158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.900161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.900165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.900169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.900172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.900180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.900188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:00.900194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.900199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:00.900203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.900208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:00.900212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.900217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:00.900221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.900226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:00.900230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.900235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:00.900240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.900245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:00.900252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.900257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:00.900262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.900269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:00.900273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.900278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.900287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.900291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.900296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.900306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.900311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.900318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:00.900322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.900327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:00.900368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:00.904487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:00.905504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:00.905519Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:00.905521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:00.905526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:00.905533Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 674 [2:7556255107945618918:6072]
2025-10-01T14:09:00.905550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:00.905569Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:00.905579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.905582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.905584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.905601Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:00.905607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:00.905613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:00.905678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.905685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.905687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.905690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:00.905693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:00.905763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:00.905769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.905781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:00.905793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:00.905811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:00.905833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255107945618913:6072]
2025-10-01T14:09:00.905840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255107945618913:6072]
2025-10-01T14:09:00.905842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255107945618913:6072]
2025-10-01T14:09:00.905851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:00.905866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:00.905867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:00.905871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:00.905873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:00.905879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:00.905881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:00.905891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322483220:2446], now have 1 active actors on pipe
2025-10-01T14:09:00.905900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322483463:6826], now have 1 active actors on pipe
2025-10-01T14:09:00.905934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255107945618913:6072]
2025-10-01T14:09:00.905944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:00.905957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:00.906494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 674
2025-10-01T14:09:00.906554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 674
2025-10-01T14:09:00.907459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.907472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.907501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59d40e57-bb53e6bd-8270b714-29a93144_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:00.907512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:00.907520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:00.907523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:00.907534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:00.907548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:00.907568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.907766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.907775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.907796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:00.907940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 675 partition: 0 MaxSeqNo: 45 sessionId: src_id|59d40e57-bb53e6bd-8270b714-29a93144_0
2025-10-01T14:09:00.908481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3512f01b-9d1112a9-c55d2b3d-7b1fd8c2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|59d40e57-bb53e6bd-8270b714-29a93144_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:00.911093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59d40e57-bb53e6bd-8270b714-29a93144_0] Write session: try to update token
2025-10-01T14:09:00.911112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59d40e57-bb53e6bd-8270b714-29a93144_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:00.929182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:00.929202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:00.929215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255107945618913:6072]
2025-10-01T14:09:00.929268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:00.929452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:00.929604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:00.929746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:00.929887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:00.930078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:00.930131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:00.930290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:00.928964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 675 sessionId: src_id|59d40e57-bb53e6bd-8270b714-29a93144_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:00.931580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:00.931794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:00.931812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:00.931850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:00.932134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:00.946909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:00.946927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:00.946930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:00.946933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:00.946946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255107945618913:6072]
2025-10-01T14:09:00.946950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255107945618913:6072]
2025-10-01T14:09:00.946955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255107945618913:6072]
2025-10-01T14:09:00.947015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:00.947014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:00.947022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:00.947023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:00.947024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:00.947028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:00.947185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:00.966522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255110322483478:6355]
2025-10-01T14:09:00.967099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 674, pipe: [1:7556255110322483478:6355]
2025-10-01T14:09:01.127836Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:01.135668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.135696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.135854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.135911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.135979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.136036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.136079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.136089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.136150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.136210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.136274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.136335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.136374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.136380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.136444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.136508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.136573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.136641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.136680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.136684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.136752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.136828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.136890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.136944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.136988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.136995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.137053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.137119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.137177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.137243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.137290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.137299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.137359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.137412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.137472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.137530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.137580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.137589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.137649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.137705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.137772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.137832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.137875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.137881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.137942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.137998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.138063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.138121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.138165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.138168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.138236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.138292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.138352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.138428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.138563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.138573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.138644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.138705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.138774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.138847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.138893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.138900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.138964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255110322483478:6355], now have 1 active actors on pipe
2025-10-01T14:09:01.139207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:01.139211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255110322483478:6355]
2025-10-01T14:09:01.139247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:01.139250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:01.139276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 675 reason: error at write: Disconnected sessionId: src_id|59d40e57-bb53e6bd-8270b714-29a93144_0
2025-10-01T14:09:01.139472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 675 sessionId: src_id|59d40e57-bb53e6bd-8270b714-29a93144_0 is DEAD
2025-10-01T14:09:01.139614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d40e57-bb53e6bd-8270b714-29a93144_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:01.139626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d40e57-bb53e6bd-8270b714-29a93144_0] Write session will restart in 0.008098s
2025-10-01T14:09:01.139654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d40e57-bb53e6bd-8270b714-29a93144_0] Write session: Do CDS request
2025-10-01T14:09:01.139660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d40e57-bb53e6bd-8270b714-29a93144_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:01.140184Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:01.148915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59d40e57-bb53e6bd-8270b714-29a93144_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:01.149046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:01.149063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 676
2025-10-01T14:09:01.149187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:01.149218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:01.149226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:01.149228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:01.149699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 676 sessionId:  describe result for acl check
2025-10-01T14:09:01.149745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:01.149752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:01.149754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:01.149759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255114617450835:6837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:01.150279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255114617450835:6837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:01.152532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255114617450835:6837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:01.155995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255114617450835:6837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:01.156012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255114617450835:6837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:01.156016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255114617450835:6837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:01.156024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:01.159689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:01.160405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:01.160589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:01.160597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:01.160607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:01.160647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:01.160684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255112240586475:6076]
2025-10-01T14:09:01.161263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:01.163127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:01.163185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:01.163560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:01.163634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.163640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.163641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.163642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.163644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.163645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.163646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.163647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.163648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.163649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.163651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.163652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.163653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.163654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.163661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.163671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.163675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.163679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.163682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.163686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.163689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.163692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.163696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.163699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.163703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.163718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.163721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.163724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.163731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.163741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.163751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.163756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.163760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.163770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.163773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.163790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.163797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.163802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.163806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.163810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.163814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.163819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.163823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.163828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.163832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.163836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.163841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.163845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.163852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.163857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.163860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.163864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.163868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.163871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.163874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.163881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.163921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:01.167933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:01.168724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:01.168739Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:01.168742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:01.168745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:01.168752Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 675 [2:7556255112240586475:6076]
2025-10-01T14:09:01.168785Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:01.168803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:01.168806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:01.168810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:01.168811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:01.168828Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:01.168835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:01.168842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:01.168902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.168910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.168912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.168915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:01.168918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:01.168992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:01.169001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.169012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.169023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.169038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:01.169060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617450802:2446], now have 1 active actors on pipe
2025-10-01T14:09:01.169067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617450988:6837], now have 1 active actors on pipe
2025-10-01T14:09:01.169075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255112240586470:6076]
2025-10-01T14:09:01.169077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255112240586470:6076]
2025-10-01T14:09:01.169079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255112240586470:6076]
2025-10-01T14:09:01.169091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:01.169102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:01.169109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:01.169109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:01.169111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:01.169123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:01.169130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:01.169163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255112240586470:6076]
2025-10-01T14:09:01.169170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:01.169174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:01.169154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 675
2025-10-01T14:09:01.169204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.169213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.169239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e9c4346-b605427-3cfcceb6-8732b484_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:01.169250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:01.169255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:01.169262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:01.169272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:01.169285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:01.169303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:01.169428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.169437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.169453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:01.169538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 676 partition: 0 MaxSeqNo: 45 sessionId: src_id|8e9c4346-b605427-3cfcceb6-8732b484_0
2025-10-01T14:09:01.169571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 675
2025-10-01T14:09:01.169942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59d40e57-bb53e6bd-8270b714-29a93144_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8e9c4346-b605427-3cfcceb6-8732b484_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:01.172552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9c4346-b605427-3cfcceb6-8732b484_0] Write session: try to update token
2025-10-01T14:09:01.172570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9c4346-b605427-3cfcceb6-8732b484_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:01.187058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 676 sessionId: src_id|8e9c4346-b605427-3cfcceb6-8732b484_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:01.189632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:01.189988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.190010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.190030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:01.190033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:01.190035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:01.190037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:01.190045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255112240586470:6076]
2025-10-01T14:09:01.190049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255112240586470:6076]
2025-10-01T14:09:01.190053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255112240586470:6076]
2025-10-01T14:09:01.190083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:01.190095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:01.190099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:01.190107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:01.190114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.190116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:01.190255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:01.239317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255114617451059:6355]
2025-10-01T14:09:01.239612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 675, pipe: [1:7556255114617451059:6355]
2025-10-01T14:09:01.347842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:01.347940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:01.347949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:01.348020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 676 reason: error at write: Disconnected sessionId: src_id|8e9c4346-b605427-3cfcceb6-8732b484_0
2025-10-01T14:09:01.348164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255114617451059:6355]
2025-10-01T14:09:01.348186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 676 sessionId: src_id|8e9c4346-b605427-3cfcceb6-8732b484_0 is DEAD
2025-10-01T14:09:01.348192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:01.347438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:01.347669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:01.347722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451059:6355], now have 1 active actors on pipe
2025-10-01T14:09:01.348321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9c4346-b605427-3cfcceb6-8732b484_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:01.348333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9c4346-b605427-3cfcceb6-8732b484_0] Write session will restart in 0.007521s
2025-10-01T14:09:01.348357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9c4346-b605427-3cfcceb6-8732b484_0] Write session: Do CDS request
2025-10-01T14:09:01.348367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9c4346-b605427-3cfcceb6-8732b484_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:01.356929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9c4346-b605427-3cfcceb6-8732b484_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:01.357017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:01.357043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 677
2025-10-01T14:09:01.357174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:01.357207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:01.357216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:01.357220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:01.358121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 677 sessionId:  describe result for acl check
2025-10-01T14:09:01.358161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:01.358162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:01.358164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:01.358169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255114617451095:6842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:01.358745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255114617451095:6842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:01.361703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255114617451095:6842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:01.364457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255114617451095:6842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:01.364472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255114617451095:6842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:01.364475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255114617451095:6842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:01.364483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:01.371151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:01.374334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:01.374699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:01.374717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:01.374732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:01.374796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:01.374847Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255112240586743:6081]
2025-10-01T14:09:01.375422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:01.375764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:01.375811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:01.376296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:01.376357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.376358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.376359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.376360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.376361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.376362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.376363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.376364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.376365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.376366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.376367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.376368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.376369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.376370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.376375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.376383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.376386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.376400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.376403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.376406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.376410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.376413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.376416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.376419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.376422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.376425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.376429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.376431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.376438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.376445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.376451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.376456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.376459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.376463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.376467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.376471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.376477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.376481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.376485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.376489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.376493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.376497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.376504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.376509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.376513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.376516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.376520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.376524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.376527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.376531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.376535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.376538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.376542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.376546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.376549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.376553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.376584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:01.380413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:01.381123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:01.381134Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:01.381136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:01.381140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:01.381146Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 676 [2:7556255112240586743:6081]
2025-10-01T14:09:01.381160Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:01.381179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:01.381186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:01.381189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:01.381191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:01.381207Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:01.381216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:01.381222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:01.381281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.381288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.381290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.381292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:01.381294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:01.381357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:01.381364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.381374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.381387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.381403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:01.381424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451239:6842], now have 1 active actors on pipe
2025-10-01T14:09:01.381432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451070:2446], now have 1 active actors on pipe
2025-10-01T14:09:01.381439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255112240586738:6081]
2025-10-01T14:09:01.381441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255112240586738:6081]
2025-10-01T14:09:01.381442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255112240586738:6081]
2025-10-01T14:09:01.381454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:01.381470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:01.381487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:01.381494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:01.381524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255112240586738:6081]
2025-10-01T14:09:01.381532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:01.381535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:01.381538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:01.381540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:01.381547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:01.381517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 676
2025-10-01T14:09:01.381518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 676
2025-10-01T14:09:01.381636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.381647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.381672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|814b90a9-4311e331-19708e52-8055cd32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:01.381683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:01.381688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:01.381691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:01.381698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:01.381706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:01.381723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:01.381873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.381882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.381898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:01.381972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 677 partition: 0 MaxSeqNo: 45 sessionId: src_id|814b90a9-4311e331-19708e52-8055cd32_0
2025-10-01T14:09:01.382333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e9c4346-b605427-3cfcceb6-8732b484_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|814b90a9-4311e331-19708e52-8055cd32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:01.384776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814b90a9-4311e331-19708e52-8055cd32_0] Write session: try to update token
2025-10-01T14:09:01.384793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814b90a9-4311e331-19708e52-8055cd32_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:01.400490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 677 sessionId: src_id|814b90a9-4311e331-19708e52-8055cd32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:01.403311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:01.403483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:01.403506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:01.403509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:01.403512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:01.403521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255112240586738:6081]
2025-10-01T14:09:01.403526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255112240586738:6081]
2025-10-01T14:09:01.403529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255112240586738:6081]
2025-10-01T14:09:01.403561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:01.403566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:01.403569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:01.403585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.403599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.403619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:01.403631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.403638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:01.403773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:01.448267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255114617451331:6355]
2025-10-01T14:09:01.448579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 676, pipe: [1:7556255114617451331:6355]
2025-10-01T14:09:01.557626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:01.558218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451331:6355], now have 1 active actors on pipe
2025-10-01T14:09:01.558455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:01.558539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255114617451331:6355]
2025-10-01T14:09:01.558573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:01.559165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814b90a9-4311e331-19708e52-8055cd32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:01.559181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814b90a9-4311e331-19708e52-8055cd32_0] Write session will restart in 0.005189s
2025-10-01T14:09:01.559205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814b90a9-4311e331-19708e52-8055cd32_0] Write session: Do CDS request
2025-10-01T14:09:01.559212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814b90a9-4311e331-19708e52-8055cd32_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:01.558661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 677 reason: status is not ok: tablet will be restarted right now sessionId: src_id|814b90a9-4311e331-19708e52-8055cd32_0
2025-10-01T14:09:01.558841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 677 sessionId: src_id|814b90a9-4311e331-19708e52-8055cd32_0 is DEAD
2025-10-01T14:09:01.558897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:01.565962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|814b90a9-4311e331-19708e52-8055cd32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:01.565994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:01.566012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 678
2025-10-01T14:09:01.566189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:01.566243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:01.566254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:01.566257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:01.566721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 678 sessionId:  describe result for acl check
2025-10-01T14:09:01.566770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:01.566776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:01.566778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:01.566783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255114617451360:6847] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:01.567324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255114617451360:6847] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:01.570815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255114617451360:6847] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:01.574241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255114617451360:6847] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:01.574261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255114617451360:6847] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:01.574264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255114617451360:6847] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:01.574273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:01.580038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:01.583508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:01.583752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:01.583765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:01.583777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:01.583839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:01.583909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255112240587026:6092]
2025-10-01T14:09:01.584481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:01.584760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:01.584814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:01.585118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:01.585163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.585167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.585168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.585169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.585170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.585171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.585172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.585173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.585173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.585174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.585175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.585176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.585176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.585177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.585180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.585188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.585192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.585196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.585200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.585203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.585207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.585210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.585214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.585217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.585219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.585221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.585223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.585224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.585229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.585233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.585238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.585241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.585244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.585247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.585249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.585254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.585258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.585263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.585267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.585272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.585277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.585282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.585286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.585290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.585292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.585295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.585298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.585300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.585303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.585306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.585308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.585311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.585314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.585316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.585319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.585322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.585344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:01.589272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:01.590302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:01.590318Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:01.590320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:01.590324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:01.590330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 677 [2:7556255112240587026:6092]
2025-10-01T14:09:01.590346Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:01.590366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:01.590391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:01.590396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:01.590398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:01.590415Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:01.590426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:01.590432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:01.590504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.590512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.590514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.590517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:01.590519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:01.590591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:01.590599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.590614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.590627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.590641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:01.590661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255112240587020:6092]
2025-10-01T14:09:01.590668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255112240587020:6092]
2025-10-01T14:09:01.590670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255112240587020:6092]
2025-10-01T14:09:01.590679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:01.590696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:01.590698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:01.590702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:01.590706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:01.590715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:01.590718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:01.590730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451346:2446], now have 1 active actors on pipe
2025-10-01T14:09:01.590737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451496:6847], now have 1 active actors on pipe
2025-10-01T14:09:01.590781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255112240587020:6092]
2025-10-01T14:09:01.590794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:01.590840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:01.590866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 677
2025-10-01T14:09:01.590931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 677
2025-10-01T14:09:01.591080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.591095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.591122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41359f6-fe2467-1d480508-8a38222e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:01.591133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:01.591139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:01.591142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:01.591154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:01.591166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:01.591183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:01.591393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.591401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.591414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:01.591514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 678 partition: 0 MaxSeqNo: 45 sessionId: src_id|41359f6-fe2467-1d480508-8a38222e_0
2025-10-01T14:09:01.591901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|814b90a9-4311e331-19708e52-8055cd32_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|41359f6-fe2467-1d480508-8a38222e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:01.594283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41359f6-fe2467-1d480508-8a38222e_0] Write session: try to update token
2025-10-01T14:09:01.594302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41359f6-fe2467-1d480508-8a38222e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:01.613722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 678 sessionId: src_id|41359f6-fe2467-1d480508-8a38222e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:01.616236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:01.617048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:01.616880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.616904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.616942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:01.628752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:01.628785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:01.628788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:01.628790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:01.628800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255112240587020:6092]
2025-10-01T14:09:01.628805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255112240587020:6092]
2025-10-01T14:09:01.628809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255112240587020:6092]
2025-10-01T14:09:01.628853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:01.628865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:01.628868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:01.628881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:01.628889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.628892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:01.629017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:01.658722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255114617451607:6355]
2025-10-01T14:09:01.659019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 677, pipe: [1:7556255114617451607:6355]
2025-10-01T14:09:01.785751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:01.793924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.793953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.794128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.794192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.794251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.794317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.794796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.794813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.794895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.794955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.795033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.795101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.795146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.795148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.795216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.795269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.795326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.795378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.795470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.795480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.795535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.795586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.795646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.795703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.795744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.795746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.795799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.795847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.795896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.795946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.795983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.795985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.796040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.796092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.796152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.796209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.796248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.796253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.796308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.796366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.796423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.796478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.796521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.796530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.796586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.796641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.796698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.796757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.796828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.796834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.796894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.796948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.797006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.797062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.797111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.797115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.797172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:01.797230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:01.797290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:01.797350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:01.797392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:01.797394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:01.797454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451607:6355], now have 1 active actors on pipe
2025-10-01T14:09:01.797779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:01.797784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255114617451607:6355]
2025-10-01T14:09:01.797792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:01.797806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:01.797817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 678 reason: error at write: Disconnected sessionId: src_id|41359f6-fe2467-1d480508-8a38222e_0
2025-10-01T14:09:01.798073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 678 sessionId: src_id|41359f6-fe2467-1d480508-8a38222e_0 is DEAD
2025-10-01T14:09:01.798233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41359f6-fe2467-1d480508-8a38222e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:01.798243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41359f6-fe2467-1d480508-8a38222e_0] Write session will restart in 0.005751s
2025-10-01T14:09:01.798268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41359f6-fe2467-1d480508-8a38222e_0] Write session: Do CDS request
2025-10-01T14:09:01.798274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41359f6-fe2467-1d480508-8a38222e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:01.798093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:01.804981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41359f6-fe2467-1d480508-8a38222e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:01.806442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:01.806459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 679
2025-10-01T14:09:01.806620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:01.806655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:01.806663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:01.806666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:01.807041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 679 sessionId:  describe result for acl check
2025-10-01T14:09:01.807084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:01.807086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:01.807088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:01.807093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255114617451626:6852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:01.807638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255114617451626:6852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:01.809957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255114617451626:6852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:01.813195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255114617451626:6852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:01.813220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255114617451626:6852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:01.813224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255114617451626:6852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:01.813233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:01.828915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:01.834760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:01.835009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:01.835019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:01.835032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:01.835091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:01.835139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255112240587285:6095]
2025-10-01T14:09:01.835719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:01.842543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:01.842641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:01.843022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:01.843081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.843087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.843089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.843090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.843092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.843093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.843095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.843096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.843098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.843099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.843100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.843102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.843103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.843104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.843111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.843121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.843126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.843130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.843134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.843138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.843143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.843147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.843151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.843181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.843190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.843193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.843197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.843201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.843210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.843219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:01.843231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.843237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:01.843243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.843248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:01.843252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.843257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:01.843267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.843272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:01.843276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.843286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:01.843291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.843297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:01.843305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.843310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:01.843315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.843325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:01.843330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.843335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.843341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.843346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.843351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.843359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.843368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.843372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:01.843376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.843381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:01.843423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:01.848352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:01.849331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:01.849338Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:01.849341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:01.849345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:01.849352Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 678 [2:7556255112240587285:6095]
2025-10-01T14:09:01.849370Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:01.849390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:01.849394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:01.849398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:01.849401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:01.849420Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:01.849426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:01.849433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:01.849504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.849507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.849509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.849512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:01.849515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:01.849601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:01.849604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.849619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:01.849629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:01.849908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 678
2025-10-01T14:09:01.849944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 678
2025-10-01T14:09:01.849644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:01.849663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255112240587280:6095]
2025-10-01T14:09:01.849666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255112240587280:6095]
2025-10-01T14:09:01.849668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255112240587280:6095]
2025-10-01T14:09:01.849685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:01.849699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:01.849703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451669:6852], now have 1 active actors on pipe
2025-10-01T14:09:01.849703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:01.849706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:01.849707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451612:2446], now have 1 active actors on pipe
2025-10-01T14:09:01.849717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:01.849732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:01.849735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:01.849778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255112240587280:6095]
2025-10-01T14:09:01.849787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:01.849797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:01.850057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.850074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.850104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f57972b-4e53f7eb-257b2821-75514598_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:01.850117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:01.850122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:01.850124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:01.850134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:01.850150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:01.850172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:01.850352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.850363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.850406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:01.850519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 679 partition: 0 MaxSeqNo: 45 sessionId: src_id|5f57972b-4e53f7eb-257b2821-75514598_0
2025-10-01T14:09:01.850977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41359f6-fe2467-1d480508-8a38222e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5f57972b-4e53f7eb-257b2821-75514598_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:01.853646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f57972b-4e53f7eb-257b2821-75514598_0] Write session: try to update token
2025-10-01T14:09:01.853665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f57972b-4e53f7eb-257b2821-75514598_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:01.867385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:01.867413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:01.867427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255112240587280:6095]
2025-10-01T14:09:01.867476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:01.867480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:01.867675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:01.867823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:01.867958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:01.868118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:01.868369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:01.868412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:01.873141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 679 sessionId: src_id|5f57972b-4e53f7eb-257b2821-75514598_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:01.875810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:01.876379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:01.876400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:01.876446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:01.876547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:01.888742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:01.888758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:01.888760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:01.888761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:01.888782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255112240587280:6095]
2025-10-01T14:09:01.888786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255112240587280:6095]
2025-10-01T14:09:01.888788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255112240587280:6095]
2025-10-01T14:09:01.888829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:01.888835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:01.888838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:01.888963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:01.890431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:01.890445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:01.890449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:01.897760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255114617451875:6355]
2025-10-01T14:09:01.898039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 678, pipe: [1:7556255114617451875:6355]
2025-10-01T14:09:02.035414Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:02.044086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.044123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.044290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.044360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.044426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.044490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.044543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.044548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.044623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.044685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.044748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.044827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.044869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.044872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.044941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.045000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.045074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.045136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.045177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.045180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.045253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.045323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.045385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.045447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.045489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.045492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.045558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.045619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.045682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.045744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.045784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.045787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.045851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.045909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.045970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.046031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.046076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.046080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.046141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.046201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.046268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.046329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.046555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.046568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.046630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.046688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.046752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.046818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.046866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.046873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.046934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.046998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.047059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.047133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.047192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.047203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.047269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.047331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.047397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.047469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.047524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.047532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.047601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255114617451875:6355], now have 1 active actors on pipe
2025-10-01T14:09:02.047876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255114617451875:6355]
2025-10-01T14:09:02.047916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:02.047923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:02.047927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:02.047951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 679 reason: error at write: Disconnected sessionId: src_id|5f57972b-4e53f7eb-257b2821-75514598_0
2025-10-01T14:09:02.048168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 679 sessionId: src_id|5f57972b-4e53f7eb-257b2821-75514598_0 is DEAD
2025-10-01T14:09:02.048233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f57972b-4e53f7eb-257b2821-75514598_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:02.048242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f57972b-4e53f7eb-257b2821-75514598_0] Write session will restart in 0.008856s
2025-10-01T14:09:02.048267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f57972b-4e53f7eb-257b2821-75514598_0] Write session: Do CDS request
2025-10-01T14:09:02.048273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f57972b-4e53f7eb-257b2821-75514598_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:02.048782Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:02.057891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f57972b-4e53f7eb-257b2821-75514598_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.057956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:02.057972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 680
2025-10-01T14:09:02.058096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.058130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:02.058148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:02.058156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:02.058665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 680 sessionId:  describe result for acl check
2025-10-01T14:09:02.058706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:02.058716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:02.058718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:02.058723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255118912419226:6858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:02.059258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255118912419226:6858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:02.061863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255118912419226:6858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:02.065013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255118912419226:6858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:02.065027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255118912419226:6858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:02.065031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255118912419226:6858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:02.065038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:02.066823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:02.069613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:02.069833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:02.069842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:02.069853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:02.069907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:02.069946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255116535554837:6097]
2025-10-01T14:09:02.070543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:02.070844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:02.070893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:02.071209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:02.071261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.071266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.071267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.071268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.071269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.071270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.071271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.071272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.071273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.071274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.071275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.071276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.071277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.071278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.071283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.071292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.071296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.071300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.071304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.071307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.071311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.071314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.071318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.071322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.071325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.071329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.071332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.071336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.071343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.071350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.071355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.071360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.071364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.071368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.071372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.071376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.071379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.071383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.071387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.071392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.071400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.071405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.071412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.071417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.071420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.071424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.071432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.071437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.071446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.071460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.071468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.071472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.071476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.071484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.071488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.071493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.071528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:02.075072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:02.075887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:02.075900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:02.075903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:02.075906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:02.075913Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 679 [2:7556255116535554837:6097]
2025-10-01T14:09:02.075927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:02.075947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:02.075954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.075957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.075959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.075974Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:02.075984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:02.075990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:02.076041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.076047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.076050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.076053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:02.076055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:02.076117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:02.076124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.076135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.076153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.076168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:02.076188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912419179:2446], now have 1 active actors on pipe
2025-10-01T14:09:02.076197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912419418:6858], now have 1 active actors on pipe
2025-10-01T14:09:02.076203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255116535554832:6097]
2025-10-01T14:09:02.076205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255116535554832:6097]
2025-10-01T14:09:02.076208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255116535554832:6097]
2025-10-01T14:09:02.076219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:02.076237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:02.076230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 679
2025-10-01T14:09:02.076241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:02.076245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:02.076247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:02.076255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:02.076258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:02.076289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255116535554832:6097]
2025-10-01T14:09:02.076291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:02.076272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 679
2025-10-01T14:09:02.076309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:02.076321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.076324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.076355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:02.076366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.076370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.076373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:02.076381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.076393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:02.076409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.076522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.076529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.076543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.076620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 680 partition: 0 MaxSeqNo: 45 sessionId: src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0
2025-10-01T14:09:02.076942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f57972b-4e53f7eb-257b2821-75514598_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:02.079333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0] Write session: try to update token
2025-10-01T14:09:02.079352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:02.095195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 680 sessionId: src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:02.096331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:02.096352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:02.096355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:02.096357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:02.096366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255116535554832:6097]
2025-10-01T14:09:02.096370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255116535554832:6097]
2025-10-01T14:09:02.096376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255116535554832:6097]
2025-10-01T14:09:02.096440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:02.096453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:02.096457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:02.096692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:02.096706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.096709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:02.096849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:02.097924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:02.148208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255118912419453:6355]
2025-10-01T14:09:02.148536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 679, pipe: [1:7556255118912419453:6355]
2025-10-01T14:09:02.247505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:02.247816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.247837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.247882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912419453:6355], now have 1 active actors on pipe
2025-10-01T14:09:02.248126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:02.248142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:02.248145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255118912419453:6355]
2025-10-01T14:09:02.248164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:02.248195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 680 reason: error at write: Disconnected sessionId: src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0
2025-10-01T14:09:02.248376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 680 sessionId: src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0 is DEAD
2025-10-01T14:09:02.248136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:02.250593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:02.250603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0] Write session will restart in 0.008025s
2025-10-01T14:09:02.250630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0] Write session: Do CDS request
2025-10-01T14:09:02.250636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:02.259936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.260011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:02.260026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 681
2025-10-01T14:09:02.260141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.260174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:02.260180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:02.260184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:02.260610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 681 sessionId:  describe result for acl check
2025-10-01T14:09:02.260654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:02.260660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:02.260663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:02.260668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255118912419552:6870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:02.261232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255118912419552:6870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:02.268402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255118912419552:6870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:02.266721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:02.269702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:02.269922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:02.269938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:02.269949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:02.270006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:02.270044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255116535555101:6101]
2025-10-01T14:09:02.270395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255118912419552:6870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:02.270409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255118912419552:6870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:02.270412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255118912419552:6870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:02.270421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:02.270668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:02.271075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:02.271126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:02.271444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:02.271510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.271516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.271517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.271518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.271519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.271520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.271521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.271522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.271524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.271525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.271526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.271527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.271528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.271530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.271534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.271543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.271548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.271552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.271555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.271559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.271563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.271566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.271580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.271584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.271588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.271591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.271595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.271598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.271605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.271613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.271623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.271628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.271633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.271638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.271642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.271651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.271656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.271661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.271669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.271674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.271683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.271687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.271692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.271709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.271717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.271722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.271732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.271737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.271746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.271751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.271757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.271761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.271769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.271774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.271778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.271783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.271820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:02.275751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:02.276796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 680
2025-10-01T14:09:02.276889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 680
2025-10-01T14:09:02.277334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 681 partition: 0 MaxSeqNo: 45 sessionId: src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0
2025-10-01T14:09:02.277680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ca266e1-eb25e492-240ab6e6-74e23dbd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:02.276389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:02.276407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:02.276409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:02.276413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:02.276420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 680 [2:7556255116535555101:6101]
2025-10-01T14:09:02.276436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:02.276453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:02.276456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.276460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.276461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.276477Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:02.276482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:02.276487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:02.276553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.276555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.276557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.276560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:02.276562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:02.276615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:02.276616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.276624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.276629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.276638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:02.276650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255116535555096:6101]
2025-10-01T14:09:02.276652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255116535555096:6101]
2025-10-01T14:09:02.276654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255116535555096:6101]
2025-10-01T14:09:02.276663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:02.276671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:02.276675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:02.276676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:02.276677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:02.276690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:02.276692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:02.276702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912419722:6870], now have 1 active actors on pipe
2025-10-01T14:09:02.276705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912419472:2446], now have 1 active actors on pipe
2025-10-01T14:09:02.276739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255116535555096:6101]
2025-10-01T14:09:02.276748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:02.276762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:02.276956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.276963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.276990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:02.276998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.277003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.277005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:02.277014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.277025Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:02.277039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.277193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.277198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.277218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.280246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0] Write session: try to update token
2025-10-01T14:09:02.280263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:02.287471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:02.287493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:02.287503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255116535555096:6101]
2025-10-01T14:09:02.287546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:02.287551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:02.287722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:02.287868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:02.288004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:02.288146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:02.288353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:02.288392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:02.297880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 681 sessionId: src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:02.300353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:02.300570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.300597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.300636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:02.300734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:02.307402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:02.307423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:02.307426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:02.307428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:02.307439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255116535555096:6101]
2025-10-01T14:09:02.307443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255116535555096:6101]
2025-10-01T14:09:02.307447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255116535555096:6101]
2025-10-01T14:09:02.307500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:02.307502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:02.307508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.307510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:02.307513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:02.307516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:02.307647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:02.348584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255118912419737:6355]
2025-10-01T14:09:02.348891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 680, pipe: [1:7556255118912419737:6355]
2025-10-01T14:09:02.458438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:02.467267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.467300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.467485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.467557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.467628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.467700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.467749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.467758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.467831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.467903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.467971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.468045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.468094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.468104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.468165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.468227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.468295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.468361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.468410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.468419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.468508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.468573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.468639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.468700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.468993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.469001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.469062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.469122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.469184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.469248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.469347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.469354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.469421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.469474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.469545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.469612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.469655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.469661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.469722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.469782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.469848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.469913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.469955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.469961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.470026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.470086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.470148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.470213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.470255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.470262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.470327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.470402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.470469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.470544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.470590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.470599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.470672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:02.470735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:02.470798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:02.470867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:02.470913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:02.470921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:02.470985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912419737:6355], now have 1 active actors on pipe
2025-10-01T14:09:02.471259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:02.471276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:02.471307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 681 reason: error at write: Disconnected sessionId: src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0
2025-10-01T14:09:02.471543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 681 sessionId: src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0 is DEAD
2025-10-01T14:09:02.471595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:02.471657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255118912419737:6355]
2025-10-01T14:09:02.472131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:02.473769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:02.473780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0] Write session will restart in 0.008423s
2025-10-01T14:09:02.473805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0] Write session: Do CDS request
2025-10-01T14:09:02.473819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:02.483945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.484008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:02.484024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 682
2025-10-01T14:09:02.484146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.484179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:02.484188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:02.484191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:02.484676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 682 sessionId:  describe result for acl check
2025-10-01T14:09:02.484713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:02.484721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:02.484725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:02.484730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255118912419848:6875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:02.485236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255118912419848:6875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:02.487684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255118912419848:6875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:02.490929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255118912419848:6875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:02.490946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255118912419848:6875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:02.490950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255118912419848:6875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:02.490959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:02.491854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:02.494854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:02.495091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:02.495101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:02.495114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:02.495167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:02.495212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255116535555404:6115]
2025-10-01T14:09:02.495836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:02.496204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:02.496253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:02.496544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:02.496635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.496642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.496644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.496645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.496646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.496648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.496650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.496651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.496652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.496654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.496655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.496656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.496657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.496658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.496664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.496673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.496677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.496680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.496683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.496687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.496690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.496694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.496697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.496702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.496704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.496708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.496711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.496714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.496722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.496730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.496737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.496742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.496751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.496756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.496760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.496776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.496781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.496785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.496789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.496795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.496800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.496805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.496809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.496821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.496825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.496830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.496834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.496838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.496844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.496848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.496853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.496857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.496861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.496866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.496870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.496875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.496925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:02.500894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:02.501494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:02.501509Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:02.501511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:02.501514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:02.501521Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 681 [2:7556255116535555404:6115]
2025-10-01T14:09:02.501537Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:02.501554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:02.501566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.501570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.501572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.501588Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:02.501595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:02.501600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:02.501657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.501664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.501666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.501670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:02.501672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:02.501745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:02.501753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.501764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.501774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.501788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:02.501805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912419742:2446], now have 1 active actors on pipe
2025-10-01T14:09:02.501812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912420002:6875], now have 1 active actors on pipe
2025-10-01T14:09:02.501819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255116535555399:6115]
2025-10-01T14:09:02.501821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255116535555399:6115]
2025-10-01T14:09:02.501824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255116535555399:6115]
2025-10-01T14:09:02.501884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 681
2025-10-01T14:09:02.501897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 681
2025-10-01T14:09:02.501835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:02.501847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:02.501850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:02.501851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:02.501852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:02.501864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:02.501867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:02.501905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255116535555399:6115]
2025-10-01T14:09:02.501907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:02.501909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:02.501937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.501942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.501972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:02.501983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.501987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.501992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:02.502001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.502013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:02.502038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.502182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.502190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.502202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.502268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 682 partition: 0 MaxSeqNo: 45 sessionId: src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0
2025-10-01T14:09:02.502638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b89514c-ff772261-a4a8111e-d7ebeff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:02.505044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0] Write session: try to update token
2025-10-01T14:09:02.505064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:02.524633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 682 sessionId: src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:02.527024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:02.527045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:02.527048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:02.527050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:02.527060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255116535555399:6115]
2025-10-01T14:09:02.527065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255116535555399:6115]
2025-10-01T14:09:02.527070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255116535555399:6115]
2025-10-01T14:09:02.527114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:02.527121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:02.527126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:02.527128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.527130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:02.527131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:02.527116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:02.527253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:02.572069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255118912420016:6355]
2025-10-01T14:09:02.572382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 681, pipe: [1:7556255118912420016:6355]
2025-10-01T14:09:02.678297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:02.678635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.678652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.678700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912420016:6355], now have 1 active actors on pipe
2025-10-01T14:09:02.678924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:02.678912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255118912420016:6355]
2025-10-01T14:09:02.678955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:02.678958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:02.678993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:02.679004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 682 reason: error at write: Disconnected sessionId: src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0
2025-10-01T14:09:02.679240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 682 sessionId: src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0 is DEAD
2025-10-01T14:09:02.679405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:02.679416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0] Write session will restart in 0.009765s
2025-10-01T14:09:02.679444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0] Write session: Do CDS request
2025-10-01T14:09:02.679462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:02.690907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.691044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:02.691059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 683
2025-10-01T14:09:02.691156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.691189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:02.691199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:02.691202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:02.691604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 683 sessionId:  describe result for acl check
2025-10-01T14:09:02.691643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:02.691649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:02.691651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:02.691656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255118912420189:6880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:02.692165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255118912420189:6880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:02.694106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255118912420189:6880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:02.694200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:02.697110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:02.697355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:02.697366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:02.697381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:02.697378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255118912420189:6880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:02.697392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255118912420189:6880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:02.697395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255118912420189:6880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:02.697403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:02.697445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:02.697484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255116535555662:6117]
2025-10-01T14:09:02.698041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:02.698352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:02.698419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:02.698714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:02.698806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.698812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.698813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.698814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.698816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.698817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.698818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.698819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.698821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.698822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.698823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.698824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.698825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.698826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.698832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.698841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.698845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.698848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.698851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.698854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.698858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.698866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.698869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.698878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.698881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.698885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.698889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.698892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.698899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.698911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.698921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.698930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.698937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.698942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.698949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.698959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.698968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.698977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.698985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.698990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.698998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.699007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.699017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.699023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.699030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.699039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.699047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.699055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.699063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.699067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.699071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.699076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.699084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.699088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.699096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.699101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.699139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:02.702967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:02.703585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:02.703597Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:02.703599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:02.703602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:02.703610Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 682 [2:7556255116535555662:6117]
2025-10-01T14:09:02.703627Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:02.703647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:02.703654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.703657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.703659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.703675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:02.703683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:02.703690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:02.703745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.703751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.703753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.703756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:02.703759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:02.703831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:02.703838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.703849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.703861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.703879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:02.703899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912420275:6880], now have 1 active actors on pipe
2025-10-01T14:09:02.703908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912420020:2446], now have 1 active actors on pipe
2025-10-01T14:09:02.703915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255116535555657:6117]
2025-10-01T14:09:02.703917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255116535555657:6117]
2025-10-01T14:09:02.703919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255116535555657:6117]
2025-10-01T14:09:02.703933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:02.703946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:02.703948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:02.703949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:02.703951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:02.703965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:02.703968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:02.703969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 682
2025-10-01T14:09:02.703968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 682
2025-10-01T14:09:02.703999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255116535555657:6117]
2025-10-01T14:09:02.704010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:02.704032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:02.704155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.704164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.704192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:02.704204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.704209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.704211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:02.704220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.704235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:02.704255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.704402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.704417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.704429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.704513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 683 partition: 0 MaxSeqNo: 45 sessionId: src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0
2025-10-01T14:09:02.704874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|354ef39c-34955ac4-91cb6fb7-26de320a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:02.707918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0] Write session: try to update token
2025-10-01T14:09:02.707941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:02.715015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:02.715034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:02.715044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255116535555657:6117]
2025-10-01T14:09:02.715089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:02.715092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:02.715268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:02.715420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:02.715550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:02.715682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:02.715869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:02.715921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:02.731553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 683 sessionId: src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:02.733878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:02.733896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:02.733899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:02.733901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:02.733912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255116535555657:6117]
2025-10-01T14:09:02.733916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255116535555657:6117]
2025-10-01T14:09:02.733919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255116535555657:6117]
2025-10-01T14:09:02.733957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:02.733963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.733962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:02.733965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:02.733968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:02.733972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:02.734092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:02.734201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:02.778920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255118912420286:6355]
2025-10-01T14:09:02.779239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 682, pipe: [1:7556255118912420286:6355]
2025-10-01T14:09:02.888181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:02.888858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.888877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.888898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912420286:6355], now have 1 active actors on pipe
2025-10-01T14:09:02.889132Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:02.889173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255118912420286:6355]
2025-10-01T14:09:02.889209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:02.889233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:02.889299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 683 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0
2025-10-01T14:09:02.889483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 683 sessionId: src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0 is DEAD
2025-10-01T14:09:02.889645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:02.889654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0] Write session will restart in 0.006468s
2025-10-01T14:09:02.889679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0] Write session: Do CDS request
2025-10-01T14:09:02.889685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:02.896899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.897012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:02.897030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 684
2025-10-01T14:09:02.897169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:02.897205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:02.897215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:02.897218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:02.897693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 684 sessionId:  describe result for acl check
2025-10-01T14:09:02.897726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:02.897728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:02.897730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:02.897734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255118912420303:6884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:02.898239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255118912420303:6884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:02.900679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255118912420303:6884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:02.904898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255118912420303:6884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:02.904917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255118912420303:6884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:02.904921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255118912420303:6884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:02.904932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:02.909801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:02.912880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:02.913108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:02.913121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:02.913133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:02.913185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:02.913222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255116535555925:6120]
2025-10-01T14:09:02.913764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:02.914046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:02.914079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:02.914343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:02.914419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.914425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.914426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.914428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.914429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.914430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.914431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.914432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.914433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.914434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.914436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.914437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.914438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.914439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.914444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.914453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.914457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.914461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.914465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.914468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.914470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.914471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.914473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.914475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.914477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.914479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.914481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.914483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.914489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.914495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:02.914500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.914506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:02.914510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.914515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:02.914520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.914524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:02.914529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.914534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:02.914538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.914543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:02.914547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.914552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:02.914556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.914560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:02.914564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.914569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:02.914573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.914578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.914582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.914586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.914590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.914595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.914599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.914603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:02.914607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.914611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:02.914651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:02.918499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:02.919498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:02.919513Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:02.919515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:02.919519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:02.919525Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 683 [2:7556255116535555925:6120]
2025-10-01T14:09:02.919542Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:02.919558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:02.919561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.919565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.919567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.919584Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:02.919595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:02.919600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:02.919656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.919663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.919665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.919668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:02.919670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:02.919748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:02.919754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.919765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:02.919777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:02.919791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:02.919811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255116535555920:6120]
2025-10-01T14:09:02.919817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255116535555920:6120]
2025-10-01T14:09:02.919819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255116535555920:6120]
2025-10-01T14:09:02.919828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:02.919842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:02.919855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:02.919862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:02.919863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:02.919867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:02.919869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:02.919893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255116535555920:6120]
2025-10-01T14:09:02.919901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:02.919910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912420432:6884], now have 1 active actors on pipe
2025-10-01T14:09:02.919910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:02.919913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912420289:2446], now have 1 active actors on pipe
2025-10-01T14:09:02.920182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.920196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.920221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:02.920233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:02.920239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:02.920242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:02.920250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:02.920258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:02.920269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.920444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:02.920457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:02.920481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:02.920970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72be2336-7a27318-13a2dfeb-45cd3b75_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:02.920037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 683
2025-10-01T14:09:02.920086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 683
2025-10-01T14:09:02.920586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 684 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0
2025-10-01T14:09:02.923473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0] Write session: try to update token
2025-10-01T14:09:02.923489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:02.940901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:02.940919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:02.940922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:02.940923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:02.940933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255116535555920:6120]
2025-10-01T14:09:02.940939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255116535555920:6120]
2025-10-01T14:09:02.940942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255116535555920:6120]
2025-10-01T14:09:02.940987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:02.940991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:02.940994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:02.940997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:02.940998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:02.941001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:02.941141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:02.945423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 684 sessionId: src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:02.948011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:02.990438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255118912420556:6355]
2025-10-01T14:09:02.994704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 683, pipe: [1:7556255118912420556:6355]
2025-10-01T14:09:03.093968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:03.093987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:03.093987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:03.094045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255118912420556:6355]
2025-10-01T14:09:03.094047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 684 reason: error at write: Disconnected sessionId: src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0
2025-10-01T14:09:03.094245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 684 sessionId: src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0 is DEAD
2025-10-01T14:09:03.093391Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:03.093699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.093710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.093756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255118912420556:6355], now have 1 active actors on pipe
2025-10-01T14:09:03.094469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:03.094480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0] Write session will restart in 0.008582s
2025-10-01T14:09:03.094506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0] Write session: Do CDS request
2025-10-01T14:09:03.094530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:03.094880Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:03.104839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:03.104932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:03.104948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 685
2025-10-01T14:09:03.105056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:03.105086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:03.105096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:03.105099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:03.105582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 685 sessionId:  describe result for acl check
2025-10-01T14:09:03.105620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:03.105621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:03.105623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:03.105629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255123207387899:6888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:03.106230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255123207387899:6888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:03.109443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255123207387899:6888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:03.113949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255123207387899:6888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:03.113966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255123207387899:6888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:03.113970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255123207387899:6888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:03.113978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:03.116536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:03.119342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:03.119570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:03.119582Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:03.119593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:03.119664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:03.119704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255120830523483:6122]
2025-10-01T14:09:03.120320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:03.120674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:03.120732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:03.121047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:03.121117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.121119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.121120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.121121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.121122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.121123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.121124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.121125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.121127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.121128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.121129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.121130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.121132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.121133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.121138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.121148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.121151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.121155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.121159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.121162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.121166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.121170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.121173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.121178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.121182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.121185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.121189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.121192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.121201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.121208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.121214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.121219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.121224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.121228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.121232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.121238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.121243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.121247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.121251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.121256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.121261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.121266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.121270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.121274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.121279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.121284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.121289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.121294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.121298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.121304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.121308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.121313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.121318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.121323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.121327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.121332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.121371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:03.125197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:03.125832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:03.125849Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:03.125852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:03.125856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:03.125863Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 684 [2:7556255120830523483:6122]
2025-10-01T14:09:03.125880Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:03.125898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:03.125901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:03.125904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:03.125907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:03.125921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:03.125926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:03.125930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:03.125982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.125984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.125986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.125989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:03.125992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:03.126073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:03.126074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.126081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.126086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.126096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:03.126110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388109:6888], now have 1 active actors on pipe
2025-10-01T14:09:03.126113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207387855:2446], now have 1 active actors on pipe
2025-10-01T14:09:03.126118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255120830523478:6122]
2025-10-01T14:09:03.126119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255120830523478:6122]
2025-10-01T14:09:03.126121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255120830523478:6122]
2025-10-01T14:09:03.126133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:03.126146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:03.126158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:03.126159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:03.126161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:03.126161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:03.126163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:03.126190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255120830523478:6122]
2025-10-01T14:09:03.126196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:03.126200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:03.126634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.126646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.126675Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2a55691-314af0be-76f9a83c-110c7e29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:03.126695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:03.126699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:03.126702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:03.126711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:03.126720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:03.126735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:03.127167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.127175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.127190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:03.127721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e877c6b-62d3643e-4e2b0dba-6acc2ee9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a2a55691-314af0be-76f9a83c-110c7e29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:03.130338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a55691-314af0be-76f9a83c-110c7e29_0] Write session: try to update token
2025-10-01T14:09:03.130359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a55691-314af0be-76f9a83c-110c7e29_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:03.126484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 684
2025-10-01T14:09:03.126518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 684
2025-10-01T14:09:03.127338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 685 partition: 0 MaxSeqNo: 45 sessionId: src_id|a2a55691-314af0be-76f9a83c-110c7e29_0
2025-10-01T14:09:03.141553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:03.141570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:03.141582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255120830523478:6122]
2025-10-01T14:09:03.141628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:03.141796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:03.141932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:03.142066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:03.142199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:03.142434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:03.143845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:03.143908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:03.165865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 685 sessionId: src_id|a2a55691-314af0be-76f9a83c-110c7e29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:03.168383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:03.172896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.172920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.172964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:03.173093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:03.177950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:03.177967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:03.177969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:03.177971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:03.177983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255120830523478:6122]
2025-10-01T14:09:03.177986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255120830523478:6122]
2025-10-01T14:09:03.177990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255120830523478:6122]
2025-10-01T14:09:03.178041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:03.178048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.178051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:03.178191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:03.178271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:03.178283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:03.178287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:03.194155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255123207388136:6355]
2025-10-01T14:09:03.194485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 684, pipe: [1:7556255123207388136:6355]
2025-10-01T14:09:03.336620Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:03.345147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.345177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.345350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.345425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.345500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.345576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.345634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.345647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.345725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.345796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.345873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.345950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.346000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.346009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.346088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.346154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.346225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.346301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.346347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.346355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.346446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.346525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.346598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.346669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.346715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.346724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.346789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.346848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.346914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.346985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.347039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.347046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.347116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.347187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.347266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.347341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.347397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.347404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.347473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.347542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.347617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.347683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.347753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.347761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.347831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.347902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.347970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.348046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.348103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.348111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.348191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.348260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.348329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.348394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.348442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.348449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.348519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.348583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.348653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.348718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.348759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.348777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.348834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388136:6355], now have 1 active actors on pipe
2025-10-01T14:09:03.349050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:03.349061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255123207388136:6355]
2025-10-01T14:09:03.349085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:03.349087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:03.349113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 685 reason: error at write: Disconnected sessionId: src_id|a2a55691-314af0be-76f9a83c-110c7e29_0
2025-10-01T14:09:03.349287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 685 sessionId: src_id|a2a55691-314af0be-76f9a83c-110c7e29_0 is DEAD
2025-10-01T14:09:03.349450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a55691-314af0be-76f9a83c-110c7e29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:03.349461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a55691-314af0be-76f9a83c-110c7e29_0] Write session will restart in 0.008498s
2025-10-01T14:09:03.349487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a55691-314af0be-76f9a83c-110c7e29_0] Write session: Do CDS request
2025-10-01T14:09:03.349493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a55691-314af0be-76f9a83c-110c7e29_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:03.349804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:03.358919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a55691-314af0be-76f9a83c-110c7e29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:03.358984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:03.359000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 686
2025-10-01T14:09:03.359132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:03.359164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:03.359174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:03.359178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:03.359588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 686 sessionId:  describe result for acl check
2025-10-01T14:09:03.359627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:03.359634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:03.359636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:03.359653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255123207388185:6900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:03.360141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255123207388185:6900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:03.362937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255123207388185:6900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:03.366521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255123207388185:6900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:03.366537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255123207388185:6900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:03.366541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255123207388185:6900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:03.366559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:03.372904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:03.376059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:03.376308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:03.376323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:03.376337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:03.376414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:03.376457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255120830523755:6127]
2025-10-01T14:09:03.377078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:03.377428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:03.377488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:03.377818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:03.377902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.377909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.377910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.377911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.377913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.377914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.377915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.377916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.377917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.377919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.377920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.377921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.377923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.377924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.377930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.377940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.377944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.377948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.377952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.377956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.377959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.377963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.377967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.377971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.377975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.377978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.377982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.377986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.377994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.378002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.378009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.378013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.378018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.378023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.378026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.378031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.378036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.378040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.378044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.378049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.378053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.378067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.378071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.378080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.378085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.378089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.378099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.378106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.378114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.378119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.378122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.378127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.378132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.378137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.378154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.378164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.378202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:03.383759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 685
2025-10-01T14:09:03.383796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 685
2025-10-01T14:09:03.382435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:03.383152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:03.383159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:03.383161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:03.383165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:03.383174Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 685 [2:7556255120830523755:6127]
2025-10-01T14:09:03.383195Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:03.383215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:03.383218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:03.383221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:03.383223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:03.383242Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:03.383248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:03.383254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:03.383337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.383339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.383340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.383343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:03.383345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:03.383415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:03.383418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.383430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.383441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.384201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 686 partition: 0 MaxSeqNo: 45 sessionId: src_id|acbcb36e-35a2f696-a4900739-58edbb40_0
2025-10-01T14:09:03.383456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:03.383474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255120830523750:6127]
2025-10-01T14:09:03.383476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255120830523750:6127]
2025-10-01T14:09:03.383478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255120830523750:6127]
2025-10-01T14:09:03.383490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:03.383503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:03.383517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:03.383519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:03.383564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255120830523750:6127]
2025-10-01T14:09:03.383566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:03.383579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:03.383582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:03.383583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:03.383588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:03.383656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388156:2446], now have 1 active actors on pipe
2025-10-01T14:09:03.383661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388351:6900], now have 1 active actors on pipe
2025-10-01T14:09:03.383837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.383845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.383870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acbcb36e-35a2f696-a4900739-58edbb40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:03.383877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:03.383881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:03.383883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:03.383892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:03.383902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:03.383919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:03.384078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.384084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.384103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:03.384556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2a55691-314af0be-76f9a83c-110c7e29_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|acbcb36e-35a2f696-a4900739-58edbb40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:03.387138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acbcb36e-35a2f696-a4900739-58edbb40_0] Write session: try to update token
2025-10-01T14:09:03.387157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acbcb36e-35a2f696-a4900739-58edbb40_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:03.395425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:03.395442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:03.395450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255120830523750:6127]
2025-10-01T14:09:03.395490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:03.395494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:03.395651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:03.395802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:03.395957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:03.396082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:03.396288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:03.396332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:03.401375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 686 sessionId: src_id|acbcb36e-35a2f696-a4900739-58edbb40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:03.403717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:03.403953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.403975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.404016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:03.404126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:03.416129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:03.416159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:03.416161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:03.416164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:03.416175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255120830523750:6127]
2025-10-01T14:09:03.416178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255120830523750:6127]
2025-10-01T14:09:03.416182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255120830523750:6127]
2025-10-01T14:09:03.416233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:03.416236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:03.416243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.416244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:03.416246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:03.416248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:03.416374Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:03.449129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255123207388426:6355]
2025-10-01T14:09:03.449443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 685, pipe: [1:7556255123207388426:6355]
2025-10-01T14:09:03.568994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:03.577016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.577044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.577212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.577274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.577333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.577400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.577447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.577457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.577521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.577582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.577637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.577693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.577743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.577751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.577808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.577859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.577922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.577987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.578030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.578037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.578094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.578149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.578205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.578266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.578312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.578320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.578395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.578460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.578526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.578592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.578641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.578649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.578719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.578789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.578853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.578924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.578977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.578980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.579048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.579100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.579161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.579219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.579266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.579270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.579324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.579375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.579432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.579482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.579517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.579520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.579578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.579626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.579678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.579736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.579776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.579780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.579845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.579905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.579959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.580015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.580056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.580059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.580123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388426:6355], now have 1 active actors on pipe
2025-10-01T14:09:03.581089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbcb36e-35a2f696-a4900739-58edbb40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:03.581101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbcb36e-35a2f696-a4900739-58edbb40_0] Write session will restart in 0.005320s
2025-10-01T14:09:03.581127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbcb36e-35a2f696-a4900739-58edbb40_0] Write session: Do CDS request
2025-10-01T14:09:03.581131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbcb36e-35a2f696-a4900739-58edbb40_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:03.581298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:03.580452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:03.580469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:03.580507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 686 reason: error at write: Disconnected sessionId: src_id|acbcb36e-35a2f696-a4900739-58edbb40_0
2025-10-01T14:09:03.580605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:03.580652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255123207388426:6355]
2025-10-01T14:09:03.580692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 686 sessionId: src_id|acbcb36e-35a2f696-a4900739-58edbb40_0 is DEAD
2025-10-01T14:09:03.587909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acbcb36e-35a2f696-a4900739-58edbb40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:03.587990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:03.588007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 687
2025-10-01T14:09:03.588150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:03.588177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:03.588182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:03.588186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:03.588534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 687 sessionId:  describe result for acl check
2025-10-01T14:09:03.588557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:03.588558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:03.588559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:03.588562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255123207388457:6905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:03.589043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255123207388457:6905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:03.591578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255123207388457:6905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:03.596389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255123207388457:6905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:03.596407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255123207388457:6905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:03.596409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255123207388457:6905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:03.596418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:03.602673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:03.605742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:03.606134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:03.606146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:03.606158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:03.606208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:03.606245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255120830524060:6140]
2025-10-01T14:09:03.606807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:03.607055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:03.607091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:03.607362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:03.607408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.607413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.607414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.607415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.607416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.607417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.607419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.607420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.607421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.607422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.607423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.607424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.607425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.607426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.607431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.607440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.607444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.607448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.607451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.607454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.607458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.607461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.607465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.607469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.607472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.607476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.607479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.607482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.607488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.607494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.607500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.607505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.607509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.607514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.607524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.607528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.607532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.607537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.607544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.607548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.607565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.607573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.607577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.607581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.607589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.607593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.607596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.607604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.607608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.607612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.607620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.607624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.607629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.607636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.607640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.607644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.607677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:03.611426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:03.611996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:03.612009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:03.612012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:03.612015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:03.612021Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 686 [2:7556255120830524060:6140]
2025-10-01T14:09:03.612035Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:03.612051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:03.612053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:03.612056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:03.612058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:03.612072Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:03.612077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:03.612083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:03.612135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.612142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.612144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.612147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:03.612149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:03.612206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:03.612215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.612224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.612234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.612249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:03.612269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388443:2446], now have 1 active actors on pipe
2025-10-01T14:09:03.612276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388577:6905], now have 1 active actors on pipe
2025-10-01T14:09:03.612282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255120830524054:6140]
2025-10-01T14:09:03.612288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255120830524054:6140]
2025-10-01T14:09:03.612290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255120830524054:6140]
2025-10-01T14:09:03.612305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:03.612322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:03.612327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:03.612331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:03.612332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:03.612337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:03.612340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:03.612346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 686
2025-10-01T14:09:03.612363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255120830524054:6140]
2025-10-01T14:09:03.612372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:03.612374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:03.612407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 686
2025-10-01T14:09:03.612471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.612480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.612500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:03.612511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:03.612515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:03.612518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:03.612527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:03.612535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:03.612547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:03.612713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.612720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.612733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:03.612832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 687 partition: 0 MaxSeqNo: 45 sessionId: src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0
2025-10-01T14:09:03.613190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acbcb36e-35a2f696-a4900739-58edbb40_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:03.615825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0] Write session: try to update token
2025-10-01T14:09:03.615842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:03.623174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:03.623192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:03.623202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255120830524054:6140]
2025-10-01T14:09:03.623247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:03.623424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:03.623562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:03.623698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:03.623836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:03.624018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:03.624058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:03.624219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:03.630527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 687 sessionId: src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:03.632941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:03.633562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.633587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.633625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:03.633694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:03.643260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:03.643276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:03.643279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:03.643281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:03.643292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255120830524054:6140]
2025-10-01T14:09:03.643296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255120830524054:6140]
2025-10-01T14:09:03.643300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255120830524054:6140]
2025-10-01T14:09:03.643341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:03.643346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:03.643349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:03.643350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:03.643358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.643360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:03.643493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:03.681070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255123207388713:6355]
2025-10-01T14:09:03.682608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 686, pipe: [1:7556255123207388713:6355]
2025-10-01T14:09:03.793205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:03.801599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.801627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.801773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.801825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.801883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.801935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.801972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.801979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.802038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.802093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.802145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.802198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.802243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.802249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.802307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.802364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.802448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.802510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.802551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.802559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.802617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.802671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.802729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.802786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.802830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.802835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.802891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.802945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.803000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.803053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.803098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.803104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.803163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.803217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.803272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.803332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.803376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.803380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.803438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.803488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.803545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.803601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.803642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.803647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.803702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.803753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.803833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.803887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.803929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.803934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.803994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.804050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.804102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.804157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.804201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.804206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.804263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:03.804316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:03.804370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:03.804435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:03.804481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:03.804487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:03.804549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388713:6355], now have 1 active actors on pipe
2025-10-01T14:09:03.805105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:03.805122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:03.805150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 687 reason: error at write: Disconnected sessionId: src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0
2025-10-01T14:09:03.805319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 687 sessionId: src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0 is DEAD
2025-10-01T14:09:03.805476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255123207388713:6355]
2025-10-01T14:09:03.805478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:03.805500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0] Write session will restart in 0.007063s
2025-10-01T14:09:03.805497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:03.805526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0] Write session: Do CDS request
2025-10-01T14:09:03.805502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:03.805533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:03.813885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:03.813975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:03.814004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 688
2025-10-01T14:09:03.814139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:03.814170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:03.814179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:03.814184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:03.814672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 688 sessionId:  describe result for acl check
2025-10-01T14:09:03.814700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:03.814705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:03.814707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:03.814711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255123207388747:6910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:03.815206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255123207388747:6910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:03.818187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255123207388747:6910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:03.821449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255123207388747:6910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:03.821464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255123207388747:6910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:03.821467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255123207388747:6910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:03.821476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:03.824030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:03.826986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:03.827264Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:03.827277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:03.827293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:03.827382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:03.827427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255120830524327:6143]
2025-10-01T14:09:03.828028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:03.828325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:03.828381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:03.828714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:03.828800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.828805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.828806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.828807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.828808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.828810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.828811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.828812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.828813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.828814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.828815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.828816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.828818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.828819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.828823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.828838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.828842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.828845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.828849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.828853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.828856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.828859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.828863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.828867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.828870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.828874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.828878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.828882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.828889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.828896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:03.828904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.828910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:03.828913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.828918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:03.828922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.828927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:03.828931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.828935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:03.828940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.828945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:03.828950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.828959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:03.828963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.828967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:03.828972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.828977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:03.828982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.828987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.828995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.829001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.829008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.829013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.829021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.829026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:03.829033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.829038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:03.829080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:03.832975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:03.833626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:03.833638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:03.833640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:03.833643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:03.833650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 687 [2:7556255120830524327:6143]
2025-10-01T14:09:03.833666Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:03.833682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:03.833689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:03.833693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:03.833695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:03.833711Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:03.833722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:03.833729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:03.833788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.833795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.833797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.833800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:03.833803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:03.833870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:03.833876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.833888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:03.833900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:03.833919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:03.833941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388948:6910], now have 1 active actors on pipe
2025-10-01T14:09:03.833949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388715:2446], now have 1 active actors on pipe
2025-10-01T14:09:03.833956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255120830524322:6143]
2025-10-01T14:09:03.833963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255120830524322:6143]
2025-10-01T14:09:03.833965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255120830524322:6143]
2025-10-01T14:09:03.833982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:03.833995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:03.834000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:03.834003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:03.834005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:03.834013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:03.834016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:03.834049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255120830524322:6143]
2025-10-01T14:09:03.834036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 687
2025-10-01T14:09:03.834057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:03.834041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 687
2025-10-01T14:09:03.834072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:03.834100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.834109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.834134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:03.834144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:03.834151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:03.834154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:03.834164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:03.834176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:03.834193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:03.834346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:03.834353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:03.834387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:03.834878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 688 partition: 0 MaxSeqNo: 45 sessionId: src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0
2025-10-01T14:09:03.835235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f0d04da-58c2f940-5533a5ff-1081b893_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:03.837689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0] Write session: try to update token
2025-10-01T14:09:03.837708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:03.855931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:03.855952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:03.855955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:03.855957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:03.855967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255120830524322:6143]
2025-10-01T14:09:03.855971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255120830524322:6143]
2025-10-01T14:09:03.855978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255120830524322:6143]
2025-10-01T14:09:03.856032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:03.856042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:03.856045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:03.856067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:03.856082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:03.856087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:03.856178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:03.858960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 688 sessionId: src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:03.861465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:03.905825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255123207388987:6355]
2025-10-01T14:09:03.906072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 687, pipe: [1:7556255123207388987:6355]
2025-10-01T14:09:04.004594Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:04.005225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.005245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.005291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255123207388987:6355], now have 1 active actors on pipe
2025-10-01T14:09:04.005515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:04.005532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:04.005546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:04.005550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:04.005590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255123207388987:6355]
2025-10-01T14:09:04.005614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 688 reason: error at write: Disconnected sessionId: src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0
2025-10-01T14:09:04.005758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 688 sessionId: src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0 is DEAD
2025-10-01T14:09:04.005917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:04.005926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0] Write session will restart in 0.007941s
2025-10-01T14:09:04.005955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0] Write session: Do CDS request
2025-10-01T14:09:04.005961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:04.014933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.015040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:04.015055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 689
2025-10-01T14:09:04.015141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.015171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:04.015180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:04.015184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:04.015602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 689 sessionId:  describe result for acl check
2025-10-01T14:09:04.015651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:04.015657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:04.015659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:04.015664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255127502356327:6914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:04.016158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255127502356327:6914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:04.018875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255127502356327:6914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:04.021787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255127502356327:6914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:04.021801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255127502356327:6914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:04.021804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255127502356327:6914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:04.021818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:04.026462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:04.029621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:04.029912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:04.029925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:04.029940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:04.030007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:04.030054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255125125491888:6145]
2025-10-01T14:09:04.030697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:04.031024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:04.031071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:04.031380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:04.031426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.031430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.031431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.031432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.031433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.031434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.031435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.031435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.031436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.031437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.031438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.031439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.031439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.031440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.031444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.031450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.031452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.031455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.031457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.031460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.031462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.031464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.031466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.031469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.031472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.031474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.031476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.031479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.031485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.031489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.031495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.031500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.031505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.031511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.031515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.031519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.031524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.031530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.031535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.031540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.031545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.031548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.031551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.031554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.031557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.031560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.031563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.031566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.031568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.031571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.031573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.031576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.031579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.031582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.031584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.031587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.031610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:04.035932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:04.036672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:04.036683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:04.036686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:04.036689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:04.036696Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 688 [2:7556255125125491888:6145]
2025-10-01T14:09:04.036723Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:04.036740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:04.036743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.036747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.036749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.036773Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:04.036787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:04.036793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:04.036853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.036861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.036863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.036867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:04.036870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:04.036945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:04.036952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.036961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.036975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.036993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:04.037015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502356491:6914], now have 1 active actors on pipe
2025-10-01T14:09:04.037021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502356287:2446], now have 1 active actors on pipe
2025-10-01T14:09:04.037028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255125125491883:6145]
2025-10-01T14:09:04.037030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255125125491883:6145]
2025-10-01T14:09:04.037033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255125125491883:6145]
2025-10-01T14:09:04.037046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:04.037064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:04.037064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:04.037067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:04.037070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:04.037081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:04.037085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:04.037115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255125125491883:6145]
2025-10-01T14:09:04.037126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:04.037181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:04.037158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 688
2025-10-01T14:09:04.037165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 688
2025-10-01T14:09:04.037324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.037334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.037363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d226422-717f855c-ee411609-aff49b33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:04.037370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.037374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.037376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:04.037385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.037396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:04.037416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.038245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.038252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.038268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.038351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 689 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d226422-717f855c-ee411609-aff49b33_0
2025-10-01T14:09:04.039234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40ed2d6b-a56f33cb-db7b99fd-54ebdb2c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d226422-717f855c-ee411609-aff49b33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:04.041827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d226422-717f855c-ee411609-aff49b33_0] Write session: try to update token
2025-10-01T14:09:04.041844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d226422-717f855c-ee411609-aff49b33_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:04.054520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:04.054549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:04.054560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255125125491883:6145]
2025-10-01T14:09:04.054619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:04.054629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:04.055198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:04.055354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:04.055535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:04.055690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:04.055890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:04.055937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:04.060925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 689 sessionId: src_id|8d226422-717f855c-ee411609-aff49b33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:04.063195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:04.065035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.065055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.065090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:04.065228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:04.081744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:04.081763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:04.081765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:04.081767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:04.081778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255125125491883:6145]
2025-10-01T14:09:04.081782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255125125491883:6145]
2025-10-01T14:09:04.081786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255125125491883:6145]
2025-10-01T14:09:04.081834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:04.081837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:04.081839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.081841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:04.081843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:04.081850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:04.081968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:04.105516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255127502356557:6355]
2025-10-01T14:09:04.105831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 688, pipe: [1:7556255127502356557:6355]
2025-10-01T14:09:04.232704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:04.239991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.240015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.240146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.240203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.240262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.240321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.240363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.240372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.240437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.240496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.240553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.240612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.240653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.240659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.240721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.240786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.240844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.240902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.240942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.240947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.241007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.241071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.241126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.241182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.241228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.241235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.241296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.241357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.241416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.241482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.241521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.241527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.241585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.241639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.241695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.241759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.241801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.241808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.241866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.241920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.241977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.242037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.242082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.242089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.242154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.242218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.242279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.242343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.243669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d226422-717f855c-ee411609-aff49b33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:04.243681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d226422-717f855c-ee411609-aff49b33_0] Write session will restart in 0.009060s
2025-10-01T14:09:04.243708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d226422-717f855c-ee411609-aff49b33_0] Write session: Do CDS request
2025-10-01T14:09:04.243714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d226422-717f855c-ee411609-aff49b33_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:04.243284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:04.243300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:04.243338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 689 reason: error at write: Disconnected sessionId: src_id|8d226422-717f855c-ee411609-aff49b33_0
2025-10-01T14:09:04.243525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 689 sessionId: src_id|8d226422-717f855c-ee411609-aff49b33_0 is DEAD
2025-10-01T14:09:04.243687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:04.243720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255127502356557:6355]
2025-10-01T14:09:04.242412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.242420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.242491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.242546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.242598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.242652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.242710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.242712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.242768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.242817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.242876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.242930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.242970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.242972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.243034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502356557:6355], now have 1 active actors on pipe
2025-10-01T14:09:04.244169Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:04.253854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d226422-717f855c-ee411609-aff49b33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.253922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:04.253941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 690
2025-10-01T14:09:04.254087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.254132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:04.254141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:04.254145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:04.254566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 690 sessionId:  describe result for acl check
2025-10-01T14:09:04.254599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:04.254601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:04.254602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:04.254607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255127502356640:6925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:04.255074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255127502356640:6925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:04.258124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255127502356640:6925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:04.261094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255127502356640:6925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:04.261108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255127502356640:6925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:04.261111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255127502356640:6925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:04.261118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:04.263693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:04.267047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:04.267568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:04.267584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:04.267599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:04.267675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:04.267717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255125125492161:6147]
2025-10-01T14:09:04.268323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:04.268655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:04.268710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:04.269026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:04.269109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.269116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.269117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.269119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.269120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.269121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.269122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.269123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.269124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.269125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.269126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.269127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.269128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.269130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.269136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.269145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.269149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.269153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.269157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.269162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.269165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.269169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.269173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.269177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.269181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.269185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.269189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.269192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.269199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.269208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.269214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.269219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.269224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.269230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.269234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.269239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.269244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.269249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.269253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.269263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.269267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.269273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.269279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.269284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.269289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.269293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.269297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.269302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.269307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.269317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.269321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.269326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.269330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.269340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.269343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.269348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.269385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:04.273187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:04.273858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:04.273875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:04.273878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:04.273882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:04.273889Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 689 [2:7556255125125492161:6147]
2025-10-01T14:09:04.273905Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:04.273926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:04.273932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.273935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.273937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.273951Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:04.273960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:04.273965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:04.274025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.274031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.274033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.274036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:04.274038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:04.274102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:04.274110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.274122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.274137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.274171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:04.274193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502356578:2446], now have 1 active actors on pipe
2025-10-01T14:09:04.274201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502356833:6925], now have 1 active actors on pipe
2025-10-01T14:09:04.274208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255125125492156:6147]
2025-10-01T14:09:04.274212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255125125492156:6147]
2025-10-01T14:09:04.274219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255125125492156:6147]
2025-10-01T14:09:04.274225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 689
2025-10-01T14:09:04.274236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:04.274253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:04.274254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:04.274276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 689
2025-10-01T14:09:04.274256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:04.274258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:04.274269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:04.274272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:04.274299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255125125492156:6147]
2025-10-01T14:09:04.274302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:04.274304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:04.274323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.274332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.274391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a26bb063-705f3524-6f058304-577944ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:04.274402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.274407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.274409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:04.274419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.274433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:04.274454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.274666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.274677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.274695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.274783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 690 partition: 0 MaxSeqNo: 45 sessionId: src_id|a26bb063-705f3524-6f058304-577944ce_0
2025-10-01T14:09:04.275138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d226422-717f855c-ee411609-aff49b33_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a26bb063-705f3524-6f058304-577944ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:04.277429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a26bb063-705f3524-6f058304-577944ce_0] Write session: try to update token
2025-10-01T14:09:04.277447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a26bb063-705f3524-6f058304-577944ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:04.291432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 690 sessionId: src_id|a26bb063-705f3524-6f058304-577944ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:04.293759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:04.294486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.294508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.294548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:04.294864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:04.298170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:04.298189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:04.298192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:04.298194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:04.298205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255125125492156:6147]
2025-10-01T14:09:04.298210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255125125492156:6147]
2025-10-01T14:09:04.298214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255125125492156:6147]
2025-10-01T14:09:04.298258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:04.298263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:04.298271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:04.298271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.298274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:04.298274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:04.298444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:04.344054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255127502356865:6355]
2025-10-01T14:09:04.344277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 689, pipe: [1:7556255127502356865:6355]
2025-10-01T14:09:04.450634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:04.458925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.458956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.459129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.459203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.459273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.459343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.459393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.459403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.459473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.459544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.459608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.459679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.459728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.459736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.459798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.459861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.459920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.459981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.460035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.460042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.460100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.460165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.460233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.460298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.460344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.460355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.460418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.460478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.460544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.460605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.460652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.460662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.460726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.460804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.460876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.460942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.460991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.460998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.461077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.461141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.461205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.461276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.461327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.461339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.461403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.461464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.461527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.461592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.461636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.461643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.461711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.461779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.461842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.461909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.461956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.461964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.462034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.462098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.462163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.462231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.462278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.462288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.462359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502356865:6355], now have 1 active actors on pipe
2025-10-01T14:09:04.463159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26bb063-705f3524-6f058304-577944ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:04.463170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26bb063-705f3524-6f058304-577944ce_0] Write session will restart in 0.006945s
2025-10-01T14:09:04.463199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26bb063-705f3524-6f058304-577944ce_0] Write session: Do CDS request
2025-10-01T14:09:04.463205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26bb063-705f3524-6f058304-577944ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:04.463428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:04.462744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255127502356865:6355]
2025-10-01T14:09:04.462781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:04.462790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:04.462816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 690 reason: error at write: Disconnected sessionId: src_id|a26bb063-705f3524-6f058304-577944ce_0
2025-10-01T14:09:04.462840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:04.462995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 690 sessionId: src_id|a26bb063-705f3524-6f058304-577944ce_0 is DEAD
2025-10-01T14:09:04.470921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a26bb063-705f3524-6f058304-577944ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.471011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:04.471031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 691
2025-10-01T14:09:04.471210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.471251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:04.471259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:04.471263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:04.471643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 691 sessionId:  describe result for acl check
2025-10-01T14:09:04.471684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:04.471688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:04.471690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:04.471695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255127502356890:6930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:04.472226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255127502356890:6930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:04.475772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255127502356890:6930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:04.480148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255127502356890:6930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:04.480182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255127502356890:6930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:04.480186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255127502356890:6930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:04.480194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:04.483852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:04.487014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:04.487366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:04.487376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:04.487388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:04.487444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:04.487481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255125125492443:6153]
2025-10-01T14:09:04.488043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:04.488367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:04.488431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:04.488923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:04.488996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.489002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.489003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.489004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.489005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.489006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.489007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.489008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.489009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.489010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.489011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.489012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.489013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.489015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.489020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.489030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.489034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.489038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.489041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.489045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.489048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.489052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.489056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.489060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.489063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.489067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.489071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.489075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.489081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.489089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.489094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.489100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.489105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.489109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.489116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.489121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.489125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.489130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.489134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.489139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.489144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.489149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.489154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.489159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.489163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.489168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.489172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.489177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.489192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.489197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.489201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.489206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.489210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.489215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.489219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.489223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.489260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:04.493633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:04.494266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:04.494283Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:04.494286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:04.494289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:04.494297Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 690 [2:7556255125125492443:6153]
2025-10-01T14:09:04.494324Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:04.494344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:04.494347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.494351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.494353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.494384Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:04.494391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:04.494397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:04.494459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.494462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.494464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.494679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 690
2025-10-01T14:09:04.494468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:04.494471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:04.494539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:04.494541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.494553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.494722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 690
2025-10-01T14:09:04.494564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.494581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:04.494599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255125125492438:6153]
2025-10-01T14:09:04.494601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255125125492438:6153]
2025-10-01T14:09:04.494603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255125125492438:6153]
2025-10-01T14:09:04.494612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:04.494625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:04.494630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:04.494633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:04.494635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:04.494639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:04.494642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:04.494652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502356868:2446], now have 1 active actors on pipe
2025-10-01T14:09:04.494656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502357066:6930], now have 1 active actors on pipe
2025-10-01T14:09:04.494690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255125125492438:6153]
2025-10-01T14:09:04.494700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:04.494703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:04.494826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.494835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.494861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa71105d-f684de84-31174b20-d0cb51e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:04.494875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.494880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.494893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:04.494909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.494920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:04.494938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.495116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.495123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.495138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.495242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 691 partition: 0 MaxSeqNo: 45 sessionId: src_id|fa71105d-f684de84-31174b20-d0cb51e9_0
2025-10-01T14:09:04.495655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26bb063-705f3524-6f058304-577944ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fa71105d-f684de84-31174b20-d0cb51e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:04.498354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa71105d-f684de84-31174b20-d0cb51e9_0] Write session: try to update token
2025-10-01T14:09:04.498409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa71105d-f684de84-31174b20-d0cb51e9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:04.515327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 691 sessionId: src_id|fa71105d-f684de84-31174b20-d0cb51e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:04.515577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:04.515597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:04.515600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:04.515602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:04.515610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255125125492438:6153]
2025-10-01T14:09:04.515615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255125125492438:6153]
2025-10-01T14:09:04.515619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255125125492438:6153]
2025-10-01T14:09:04.515667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:04.515678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.515677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:04.515681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:04.515684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:04.515687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:04.515811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:04.517838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:04.562735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255127502357155:6355]
2025-10-01T14:09:04.563041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 690, pipe: [1:7556255127502357155:6355]
2025-10-01T14:09:04.668659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:04.669108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.669122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.669163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502357155:6355], now have 1 active actors on pipe
2025-10-01T14:09:04.670742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:04.670814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255127502357155:6355]
2025-10-01T14:09:04.670838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:04.670925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 691 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa71105d-f684de84-31174b20-d0cb51e9_0
2025-10-01T14:09:04.670628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:04.671137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 691 sessionId: src_id|fa71105d-f684de84-31174b20-d0cb51e9_0 is DEAD
2025-10-01T14:09:04.671286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa71105d-f684de84-31174b20-d0cb51e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:04.671296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa71105d-f684de84-31174b20-d0cb51e9_0] Write session will restart in 0.005647s
2025-10-01T14:09:04.671323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa71105d-f684de84-31174b20-d0cb51e9_0] Write session: Do CDS request
2025-10-01T14:09:04.671329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa71105d-f684de84-31174b20-d0cb51e9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:04.677970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa71105d-f684de84-31174b20-d0cb51e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.678033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:04.678050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 692
2025-10-01T14:09:04.678205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.678238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:04.678251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:04.678255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:04.678667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 692 sessionId:  describe result for acl check
2025-10-01T14:09:04.678697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:04.678698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:04.678700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:04.678705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255127502357169:6936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:04.679186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255127502357169:6936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:04.681447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255127502357169:6936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:04.684289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255127502357169:6936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:04.684317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255127502357169:6936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:04.684321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255127502357169:6936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:04.684330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:04.693169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:04.696167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:04.696378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:04.696387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:04.696397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:04.696438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:04.696475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255125125492741:6165]
2025-10-01T14:09:04.697114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:04.697381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:04.697421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:04.697707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:04.697761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.697767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.697768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.697769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.697771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.697772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.697773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.697774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.697775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.697776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.697777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.697778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.697779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.697780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.697785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.697796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.697801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.697805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.697808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.697812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.697816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.697820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.697824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.697828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.697832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.697836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.697840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.697844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.697851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.697859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.697865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.697871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.697876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.697882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.697886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.697891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.697895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.697901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.697905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.697910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.697915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.697920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.697924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.697929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.697935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.697951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.697955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.697960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.697965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.697970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.697974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.697979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.697983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.697988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.697991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.697996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.698031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:04.701911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:04.702506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:04.702520Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:04.702523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:04.702526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:04.702533Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 691 [2:7556255125125492741:6165]
2025-10-01T14:09:04.702543Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:04.702557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:04.702560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.702564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.702566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.702579Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:04.702589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:04.702595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:04.702650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.702656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.702657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.702661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:04.702663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:04.702722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:04.702728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.702735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.702741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.702751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:04.702771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502357230:6936], now have 1 active actors on pipe
2025-10-01T14:09:04.702778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502357159:2446], now have 1 active actors on pipe
2025-10-01T14:09:04.702785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255125125492736:6165]
2025-10-01T14:09:04.702791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255125125492736:6165]
2025-10-01T14:09:04.702793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255125125492736:6165]
2025-10-01T14:09:04.702804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:04.702815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:04.702818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:04.702824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:04.702826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:04.702830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:04.702832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:04.702856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255125125492736:6165]
2025-10-01T14:09:04.702863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:04.702874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:04.702866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 691
2025-10-01T14:09:04.702904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.702912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.702920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 691
2025-10-01T14:09:04.702936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:04.702946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.702951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.702953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:04.702961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.702974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:04.702993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.703344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.703354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.703373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.703496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 692 partition: 0 MaxSeqNo: 45 sessionId: src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0
2025-10-01T14:09:04.703878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa71105d-f684de84-31174b20-d0cb51e9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:04.706276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0] Write session: try to update token
2025-10-01T14:09:04.706289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:04.714063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:04.714079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:04.714089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255125125492736:6165]
2025-10-01T14:09:04.714129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:04.714132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:04.714323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:04.714615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:04.714764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:04.714902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:04.715090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:04.715130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:04.719523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 692 sessionId: src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:04.722019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:04.722700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.722721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.722759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:04.722869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:04.737072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:04.737095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:04.737099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:04.737101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:04.737113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255125125492736:6165]
2025-10-01T14:09:04.737117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255125125492736:6165]
2025-10-01T14:09:04.737121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255125125492736:6165]
2025-10-01T14:09:04.737171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:04.737174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:04.737182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:04.737182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.737185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:04.737186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:04.737308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:04.771123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255127502357435:6355]
2025-10-01T14:09:04.771572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 691, pipe: [1:7556255127502357435:6355]
2025-10-01T14:09:04.884402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:04.892431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.892458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.892615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.892690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.892756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.892827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.892870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.892879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.892945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.893006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.893073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.893132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.893176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.893183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.893249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.893306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.893374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.893439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.893483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.893488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.893543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.893595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.893662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.893726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.893768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.893775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.893841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.893903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.893960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.894023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.894077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.894083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.894156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.894218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.894283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.894347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.894414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.894423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.894496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.894561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.894623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.894691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.894750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.894763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.895872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:04.895873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:04.895891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:04.895913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255127502357435:6355]
2025-10-01T14:09:04.895920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 692 reason: error at write: Disconnected sessionId: src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0
2025-10-01T14:09:04.896107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 692 sessionId: src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0 is DEAD
2025-10-01T14:09:04.896249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:04.896259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0] Write session will restart in 0.005183s
2025-10-01T14:09:04.896284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0] Write session: Do CDS request
2025-10-01T14:09:04.896290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:04.894832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.894897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.894955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.895011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.895050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.895056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.895120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.895176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.895229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.895284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.895320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.895322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.895378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:04.895424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:04.895488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:04.895541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:04.895576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:04.895578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:04.895642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502357435:6355], now have 1 active actors on pipe
2025-10-01T14:09:04.896979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:04.902875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.902915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:04.902930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 693
2025-10-01T14:09:04.903117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:04.903152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:04.903157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:04.903161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:04.903557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 693 sessionId:  describe result for acl check
2025-10-01T14:09:04.903584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:04.903586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:04.903588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:04.903593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255127502357452:6940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:04.904113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255127502357452:6940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:04.906989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255127502357452:6940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:04.910658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255127502357452:6940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:04.910680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255127502357452:6940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:04.910683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255127502357452:6940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:04.910692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:04.920507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:04.923627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:04.923884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:04.923897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:04.923910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:04.923977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:04.924019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255125125493012:6168]
2025-10-01T14:09:04.924656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:04.924935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:04.924976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:04.925272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:04.925327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.925333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.925334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.925335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.925336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.925337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.925338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.925339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.925341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.925342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.925344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.925345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.925346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.925347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.925352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.925363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.925367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.925371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.925375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.925379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.925383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.925387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.925390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.925395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.925398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.925402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.925406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.925409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.925416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.925423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:04.925429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.925434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:04.925439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.925443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:04.925447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.925452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:04.925457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.925463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:04.925472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.925478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:04.925482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.925487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:04.925491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.925496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:04.925501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.925505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:04.925508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.925514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.925519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.925524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.925527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.925532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.925536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.925541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:04.925550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.925557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:04.925594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:04.929431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:04.930052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:04.930064Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:04.930066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:04.930070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:04.930078Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 692 [2:7556255125125493012:6168]
2025-10-01T14:09:04.930093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:04.930109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:04.930112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.930116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.930118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.930135Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:04.930140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:04.930152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:04.930206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.930213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.930215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.930218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:04.930221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:04.930283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:04.930291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.930302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:04.930325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:04.930346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:04.930383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502357438:2446], now have 1 active actors on pipe
2025-10-01T14:09:04.930391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502357540:6940], now have 1 active actors on pipe
2025-10-01T14:09:04.930398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255125125493007:6168]
2025-10-01T14:09:04.930401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255125125493007:6168]
2025-10-01T14:09:04.930403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255125125493007:6168]
2025-10-01T14:09:04.930415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:04.930426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:04.930432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:04.930435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:04.930436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:04.930447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:04.930450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:04.930481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255125125493007:6168]
2025-10-01T14:09:04.930498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:04.930442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 692
2025-10-01T14:09:04.930500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 692
2025-10-01T14:09:04.930544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:04.930591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.930601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.930624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:04.930631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:04.930636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:04.930638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:04.930647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:04.930657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:04.930669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.930916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.930929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.930953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:04.931063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 693 partition: 0 MaxSeqNo: 45 sessionId: src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0
2025-10-01T14:09:04.931438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39c889c9-1c0619e9-a76f3aa0-7aee149e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:04.933797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0] Write session: try to update token
2025-10-01T14:09:04.933814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:04.949776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 693 sessionId: src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:04.952698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:04.954102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:04.954129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:04.954154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:04.954158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:04.954161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:04.954163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:04.954172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255125125493007:6168]
2025-10-01T14:09:04.954176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255125125493007:6168]
2025-10-01T14:09:04.954181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255125125493007:6168]
2025-10-01T14:09:04.954233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:04.954241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:04.954247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:04.954248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:04.954251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:04.954251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:04.954454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:04.995879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255127502357714:6355]
2025-10-01T14:09:04.996067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 692, pipe: [1:7556255127502357714:6355]
2025-10-01T14:09:05.107022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:05.107569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:05.107619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255127502357714:6355], now have 1 active actors on pipe
2025-10-01T14:09:05.107697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:05.107931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255127502357714:6355]
2025-10-01T14:09:05.107958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:05.119596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:05.119616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:05.119642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 693 reason: error at write: Disconnected sessionId: src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0
2025-10-01T14:09:05.119781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 693 sessionId: src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0 is DEAD
2025-10-01T14:09:05.119899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:05.119909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0] Write session will restart in 0.006749s
2025-10-01T14:09:05.119928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0] Write session: Do CDS request
2025-10-01T14:09:05.119935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:05.127888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.128034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:05.128055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 694
2025-10-01T14:09:05.128163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.128194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:05.128203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:05.128207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:05.128798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 694 sessionId:  describe result for acl check
2025-10-01T14:09:05.128843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:05.128851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:05.128853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:05.128860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255131797325150:6944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:05.129401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255131797325150:6944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:05.133190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255131797325150:6944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:05.135266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:05.136127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255131797325150:6944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:05.136145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255131797325150:6944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:05.136148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255131797325150:6944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:05.136156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:05.138412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:05.138633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:05.138646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:05.138660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:05.138717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:05.138756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255129420460580:6170]
2025-10-01T14:09:05.139291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:05.139567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:05.139607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:05.139907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:05.139962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.139968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.139969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.139970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.139971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.139972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.139974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.139975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.139976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.139977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.139978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.139979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.139980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.139982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.139987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.139997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.140000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.140003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.140007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.140010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.140013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.140016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.140020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.140023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.140026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.140030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.140033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.140036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.140043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.140050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.140056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.140060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.140064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.140068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.140072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.140076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.140080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.140085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.140088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.140093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.140098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.140104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.140109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.140113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.140118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.140123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.140128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.140132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.140135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.140139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.140149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.140155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.140160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.140168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.140172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.140177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.140219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:05.144287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:05.144960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:05.144974Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:05.144977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:05.144981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:05.144989Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 693 [2:7556255129420460580:6170]
2025-10-01T14:09:05.145007Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:05.145025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:05.145037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.145041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.145043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.145063Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:05.145068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:05.145076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:05.145140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.145149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.145151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.145154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:05.145157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:05.145234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:05.145243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.145259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.145271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.145293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:05.145319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325283:6944], now have 1 active actors on pipe
2025-10-01T14:09:05.145327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325015:2446], now have 1 active actors on pipe
2025-10-01T14:09:05.145335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255129420460574:6170]
2025-10-01T14:09:05.145343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255129420460574:6170]
2025-10-01T14:09:05.145345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255129420460574:6170]
2025-10-01T14:09:05.145361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:05.145382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:05.145386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:05.145390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:05.145393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:05.145398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:05.145401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:05.145387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 693
2025-10-01T14:09:05.145393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 693
2025-10-01T14:09:05.145439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255129420460574:6170]
2025-10-01T14:09:05.145447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:05.145450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:05.145469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.145479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.145529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:05.145544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.145549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.145552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:05.145562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.145575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:05.145598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.145819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.145834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.145858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.145949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 694 partition: 0 MaxSeqNo: 45 sessionId: src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0
2025-10-01T14:09:05.146335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db45755b-9bd21ece-1e53fc59-ab422cb2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:05.148968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0] Write session: try to update token
2025-10-01T14:09:05.148989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:05.167403Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:05.167422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:05.167424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:05.167426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:05.167435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255129420460574:6170]
2025-10-01T14:09:05.167440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255129420460574:6170]
2025-10-01T14:09:05.167443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255129420460574:6170]
2025-10-01T14:09:05.167491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:05.167493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:05.167498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.167499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:05.167501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:05.167503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:05.167643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:05.172072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 694 sessionId: src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:05.174558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:05.207836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255131797325300:6355]
2025-10-01T14:09:05.208090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 693, pipe: [1:7556255131797325300:6355]
2025-10-01T14:09:05.314421Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:05.315131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.315148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.315191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325300:6355], now have 1 active actors on pipe
2025-10-01T14:09:05.315379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:05.315441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:05.315453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:05.315467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255131797325300:6355]
2025-10-01T14:09:05.315487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:05.315499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 694 reason: error at write: Disconnected sessionId: src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0
2025-10-01T14:09:05.315675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 694 sessionId: src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0 is DEAD
2025-10-01T14:09:05.315790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:05.315801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0] Write session will restart in 0.006126s
2025-10-01T14:09:05.315828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0] Write session: Do CDS request
2025-10-01T14:09:05.315833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:05.322837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.322891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:05.322905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 695
2025-10-01T14:09:05.323033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.323066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:05.323071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:05.323080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:05.323442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 695 sessionId:  describe result for acl check
2025-10-01T14:09:05.323477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:05.323483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:05.323484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:05.323489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255131797325355:6956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:05.324000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255131797325355:6956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:05.326577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255131797325355:6956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:05.329825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255131797325355:6956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:05.329838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255131797325355:6956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:05.329840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255131797325355:6956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:05.329845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:05.333745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:05.336509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:05.336687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:05.336700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:05.336713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:05.336771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:05.336808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255129420460859:6174]
2025-10-01T14:09:05.337296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:05.337657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:05.337706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:05.337932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:05.337971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.337975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.337976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.337977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.337977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.337978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.337978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.337979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.337980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.337981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.337981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.337982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.337983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.337983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.337986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.337992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.337995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.337997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.337999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.338001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.338003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.338005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.338007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.338010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.338012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.338014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.338016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.338018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.338023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.338027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.338031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.338034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.338036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.338039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.338041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.338044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.338046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.338050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.338052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.338054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.338058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.338062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.338066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.338070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.338075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.338080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.338085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.338090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.338094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.338099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.338103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.338107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.338111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.338115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.338119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.338123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.338159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:05.341849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:05.342485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:05.342497Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:05.342500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:05.342503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:05.342518Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 694 [2:7556255129420460859:6174]
2025-10-01T14:09:05.342532Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:05.342547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:05.342552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.342555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.342556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.342568Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:05.342576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:05.342583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:05.342658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.342665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.342667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.342670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:05.342672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:05.342734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:05.342740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.342750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.342763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.342780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:05.342800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325338:2446], now have 1 active actors on pipe
2025-10-01T14:09:05.342807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325511:6956], now have 1 active actors on pipe
2025-10-01T14:09:05.342814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255129420460854:6174]
2025-10-01T14:09:05.342820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255129420460854:6174]
2025-10-01T14:09:05.342822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255129420460854:6174]
2025-10-01T14:09:05.342835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:05.342853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:05.342859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:05.342861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:05.342863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:05.342866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:05.342869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:05.342894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255129420460854:6174]
2025-10-01T14:09:05.342900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:05.342912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:05.342895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 694
2025-10-01T14:09:05.342929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.342937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.342963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:05.342973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.342977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.342983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:05.342991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.343006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:05.343018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.343031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 694
2025-10-01T14:09:05.343095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.343100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.343111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.343185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 695 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0
2025-10-01T14:09:05.343509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24aa9bb-862d1cfd-1f21ba9a-81948fbd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:05.345882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0] Write session: try to update token
2025-10-01T14:09:05.345899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:05.362314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 695 sessionId: src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:05.363938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:05.363954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:05.363956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:05.363957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:05.363965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255129420460854:6174]
2025-10-01T14:09:05.363968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255129420460854:6174]
2025-10-01T14:09:05.363971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255129420460854:6174]
2025-10-01T14:09:05.364011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:05.364011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:05.364016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.364017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:05.364017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:05.364019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:05.364150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:05.364777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:05.415755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255131797325614:6355]
2025-10-01T14:09:05.416080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 694, pipe: [1:7556255131797325614:6355]
2025-10-01T14:09:05.513571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:05.514260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.514277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.514321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325614:6355], now have 1 active actors on pipe
2025-10-01T14:09:05.514519Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:05.514644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255131797325614:6355]
2025-10-01T14:09:05.514657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:05.514678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:05.514741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 695 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0
2025-10-01T14:09:05.514917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 695 sessionId: src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0 is DEAD
2025-10-01T14:09:05.515092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:05.515102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0] Write session will restart in 0.009070s
2025-10-01T14:09:05.515138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0] Write session: Do CDS request
2025-10-01T14:09:05.515144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:05.524924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.524979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:05.524995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 696
2025-10-01T14:09:05.525123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.525152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:05.525158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:05.525163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:05.525573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 696 sessionId:  describe result for acl check
2025-10-01T14:09:05.525629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:05.525636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:05.525637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:05.525643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255131797325677:6961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:05.526161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255131797325677:6961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:05.530144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255131797325677:6961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:05.533090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255131797325677:6961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:05.533109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255131797325677:6961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:05.533112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255131797325677:6961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:05.533127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:05.536933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:05.539569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:05.539780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:05.539791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:05.539804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:05.539866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:05.539904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255129420461149:6178]
2025-10-01T14:09:05.540338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:05.540599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:05.540652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:05.540975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:05.541047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.541053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.541054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.541056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.541057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.541058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.541059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.541060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.541062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.541063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.541064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.541065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.541067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.541068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.541084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.541095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.541099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.541103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.541106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.541110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.541114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.541117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.541121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.541124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.541128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.541132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.541140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.541143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.541150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.541158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.541168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.541174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.541182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.541187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.541195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.541200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.541204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.541210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.541218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.541223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.541228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.541237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.541241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.541245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.541251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.541260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.541263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.541268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.541272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.541276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.541284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.541288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.541293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.541301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.541305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.541310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.541346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:05.547107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:05.548032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:05.548049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:05.548051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:05.548055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:05.548062Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 695 [2:7556255129420461149:6178]
2025-10-01T14:09:05.548081Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:05.548098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:05.548101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.548105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.548107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.548124Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:05.548134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:05.548139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:05.548184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.548189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.548191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.548193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:05.548195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:05.548258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:05.548265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.548278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.548293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.548313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:05.548332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325628:2446], now have 1 active actors on pipe
2025-10-01T14:09:05.548337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325846:6961], now have 1 active actors on pipe
2025-10-01T14:09:05.548343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255129420461140:6178]
2025-10-01T14:09:05.548346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255129420461140:6178]
2025-10-01T14:09:05.548347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255129420461140:6178]
2025-10-01T14:09:05.548358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:05.548368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:05.548380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:05.548385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:05.548398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:05.548411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:05.548413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:05.548420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255129420461140:6178]
2025-10-01T14:09:05.548426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:05.548441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:05.548426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 695
2025-10-01T14:09:05.548464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.548472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.548487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 695
2025-10-01T14:09:05.548497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54ea2513-2651034e-9791b788-8fe79d14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:05.548508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.548512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.548518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:05.548527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.548537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:05.548560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.548694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.548704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.548717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.548790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 696 partition: 0 MaxSeqNo: 45 sessionId: src_id|54ea2513-2651034e-9791b788-8fe79d14_0
2025-10-01T14:09:05.549120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7ce8ee8-cb438ac5-3b6d8570-9a2f2902_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54ea2513-2651034e-9791b788-8fe79d14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:05.551779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54ea2513-2651034e-9791b788-8fe79d14_0] Write session: try to update token
2025-10-01T14:09:05.551802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54ea2513-2651034e-9791b788-8fe79d14_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:05.569113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 696 sessionId: src_id|54ea2513-2651034e-9791b788-8fe79d14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:05.571861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:05.572601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.572628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.572650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:05.572653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:05.572656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:05.572658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:05.572670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255129420461140:6178]
2025-10-01T14:09:05.572674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255129420461140:6178]
2025-10-01T14:09:05.572692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255129420461140:6178]
2025-10-01T14:09:05.572755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:05.572774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.572776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:05.572910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:05.574570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:05.574581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:05.574585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:05.614949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255131797325908:6355]
2025-10-01T14:09:05.616213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 695, pipe: [1:7556255131797325908:6355]
2025-10-01T14:09:05.723475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:05.723834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:05.723890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325908:6355], now have 1 active actors on pipe
2025-10-01T14:09:05.723962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:05.724070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:05.724123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255131797325908:6355]
2025-10-01T14:09:05.734065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:05.734080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:05.734103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 696 reason: error at write: Disconnected sessionId: src_id|54ea2513-2651034e-9791b788-8fe79d14_0
2025-10-01T14:09:05.734239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 696 sessionId: src_id|54ea2513-2651034e-9791b788-8fe79d14_0 is DEAD
2025-10-01T14:09:05.734610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ea2513-2651034e-9791b788-8fe79d14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:05.734622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ea2513-2651034e-9791b788-8fe79d14_0] Write session will restart in 0.008273s
2025-10-01T14:09:05.734646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ea2513-2651034e-9791b788-8fe79d14_0] Write session: Do CDS request
2025-10-01T14:09:05.734654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ea2513-2651034e-9791b788-8fe79d14_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:05.747426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54ea2513-2651034e-9791b788-8fe79d14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.747493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:05.747521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 697
2025-10-01T14:09:05.747662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.747698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:05.747708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:05.747715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:05.748180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 697 sessionId:  describe result for acl check
2025-10-01T14:09:05.748223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:05.748230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:05.748232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:05.748239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255131797326125:6966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:05.748814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255131797326125:6966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:05.751522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:05.751700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255131797326125:6966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:05.754413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:05.754654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:05.754666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:05.754679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:05.754743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:05.754788Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255129420461446:6190]
2025-10-01T14:09:05.754806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255131797326125:6966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:05.754821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255131797326125:6966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:05.754824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255131797326125:6966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:05.754832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:05.755424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:05.755726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:05.755781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:05.756138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:05.756213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.756222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.756223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.756224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.756226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.756227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.756228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.756229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.756231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.756232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.756233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.756234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.756235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.756237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.756243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.756254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.756258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.756262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.756266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.756270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.756274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.756278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.756281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.756285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.756289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.756292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.756295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.756298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.756306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.756314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.756321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.756326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.756331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.756336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.756347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.756351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.756356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.756361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.756365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.756372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.756377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.756387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.756391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.756396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.756403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.756408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.756417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.756422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.756427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.756432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.756436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.756441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.756446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.756451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.756455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.756460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.756498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:05.761072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:05.761732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:05.761747Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:05.761750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:05.761753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:05.761759Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 696 [2:7556255129420461446:6190]
2025-10-01T14:09:05.761775Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:05.761791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:05.761794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.761797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.761799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.761814Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:05.761824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:05.761829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:05.761881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.761888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.761890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.761893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:05.761895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:05.761972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:05.761978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.761989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.761999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.762015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:05.762037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797325913:2446], now have 1 active actors on pipe
2025-10-01T14:09:05.762044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797326182:6966], now have 1 active actors on pipe
2025-10-01T14:09:05.762050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255129420461441:6190]
2025-10-01T14:09:05.762052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255129420461441:6190]
2025-10-01T14:09:05.762054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255129420461441:6190]
2025-10-01T14:09:05.762066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:05.762084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:05.762089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:05.762093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:05.762095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:05.762100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:05.762103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:05.762138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255129420461441:6190]
2025-10-01T14:09:05.762149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:05.762180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:05.762330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.762140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 696
2025-10-01T14:09:05.762347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.762172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 696
2025-10-01T14:09:05.762392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:05.762406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.762414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.762417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:05.762427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.762453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:05.762478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.762860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.762867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.762884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.763014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 697 partition: 0 MaxSeqNo: 45 sessionId: src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0
2025-10-01T14:09:05.763402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ea2513-2651034e-9791b788-8fe79d14_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:05.765943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0] Write session: try to update token
2025-10-01T14:09:05.765961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:05.783934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:05.783954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:05.783958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:05.783959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:05.783970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255129420461441:6190]
2025-10-01T14:09:05.783974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255129420461441:6190]
2025-10-01T14:09:05.783977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255129420461441:6190]
2025-10-01T14:09:05.784030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:05.784033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:05.784039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:05.784042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.784043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:05.784045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:05.784177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:05.786584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 697 sessionId: src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:05.789645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:05.824326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255131797326196:6355]
2025-10-01T14:09:05.824588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 696, pipe: [1:7556255131797326196:6355]
2025-10-01T14:09:05.933071Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:05.933297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.933309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.933345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797326196:6355], now have 1 active actors on pipe
2025-10-01T14:09:05.933546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255131797326196:6355]
2025-10-01T14:09:05.933504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:05.933557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:05.933560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:05.933583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:05.933634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 697 reason: error at write: Disconnected sessionId: src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0
2025-10-01T14:09:05.933825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 697 sessionId: src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0 is DEAD
2025-10-01T14:09:05.933989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:05.933999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0] Write session will restart in 0.005961s
2025-10-01T14:09:05.934027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0] Write session: Do CDS request
2025-10-01T14:09:05.934034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:05.940866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.940965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:05.940980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 698
2025-10-01T14:09:05.941113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:05.941147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:05.941158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:05.941161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:05.941572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 698 sessionId:  describe result for acl check
2025-10-01T14:09:05.941606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:05.941612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:05.941613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:05.941618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255131797326216:6970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:05.942127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255131797326216:6970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:05.944650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255131797326216:6970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:05.947935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255131797326216:6970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:05.947951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255131797326216:6970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:05.947954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255131797326216:6970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:05.947966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:05.953729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:05.956578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:05.956816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:05.956824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:05.956833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:05.956872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:05.956903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255129420461724:6193]
2025-10-01T14:09:05.957322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:05.957619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:05.957686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:05.958024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:05.958092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.958098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.958099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.958100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.958101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.958102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.958103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.958104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.958105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.958107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.958108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.958109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.958111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.958112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.958117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.958126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.958129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.958133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.958136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.958140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.958143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.958146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.958149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.958154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.958157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.958160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.958164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.958168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.958175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.958182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:05.958189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.958196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:05.958200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.958205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:05.958222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.958231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:05.958235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.958239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:05.958244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.958253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:05.958257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.958262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:05.958267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.958272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:05.958277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.958282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:05.958285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.958290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.958296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.958308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.958314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.958319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.958324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.958328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:05.958333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.958338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:05.958382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:05.962556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:05.963602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:05.963622Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:05.963624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:05.963628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:05.963635Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 697 [2:7556255129420461724:6193]
2025-10-01T14:09:05.963651Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:05.963669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:05.963677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.963681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.963683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.963700Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:05.963706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:05.963712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:05.964044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 697
2025-10-01T14:09:05.963779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.964097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 697
2025-10-01T14:09:05.963789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.963792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.963795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:05.963797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:05.963875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:05.963878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.963891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:05.963902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:05.963917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:05.963938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797326198:2446], now have 1 active actors on pipe
2025-10-01T14:09:05.963942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255131797326362:6970], now have 1 active actors on pipe
2025-10-01T14:09:05.963949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255129420461719:6193]
2025-10-01T14:09:05.963951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255129420461719:6193]
2025-10-01T14:09:05.963953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255129420461719:6193]
2025-10-01T14:09:05.963969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:05.963979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:05.963982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:05.963983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:05.963985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:05.964000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:05.964003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:05.964046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255129420461719:6193]
2025-10-01T14:09:05.964056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:05.964093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:05.964262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.964278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.964305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:05.964319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:05.964324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:05.964326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:05.964337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:05.964348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:05.964369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.964520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.964529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.964545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:05.964636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 698 partition: 0 MaxSeqNo: 45 sessionId: src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0
2025-10-01T14:09:05.965001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbcf5f61-2da14c32-2e416c3f-560751a0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:05.967562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0] Write session: try to update token
2025-10-01T14:09:05.967580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:05.975989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:05.976006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:05.976015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255129420461719:6193]
2025-10-01T14:09:05.976057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:05.976061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:05.976285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:05.976432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:05.976569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:05.976703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:05.976892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:05.976933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:05.985716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 698 sessionId: src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:05.988504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:05.988826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:05.988860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:05.988901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:05.989079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:05.998468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:05.998489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:05.998492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:05.998494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:05.998505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255129420461719:6193]
2025-10-01T14:09:05.998510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255129420461719:6193]
2025-10-01T14:09:05.998514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255129420461719:6193]
2025-10-01T14:09:05.998563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:05.998579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:05.998582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:05.998719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:06.000951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:06.000968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:06.000972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:06.033723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255136092293776:6355]
2025-10-01T14:09:06.033992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 697, pipe: [1:7556255136092293776:6355]
2025-10-01T14:09:06.152087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:06.160515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.160546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.160732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.160815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.160894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.160970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.161031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.161041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.161116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.161182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.161255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.161345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.161396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.161404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.161470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.161528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.161590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.161651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.161699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.161707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.161773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.161846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.161911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.161975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.162021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.162029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.162093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.162164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.162228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.162290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.162349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.162357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.162446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.162512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.162582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.162657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.162711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.162718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.162785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.162845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.162911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.162977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.163030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.163038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.163107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.163175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.163240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.163310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.163364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.163373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.163443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.163512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.163578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.164350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:06.164401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255136092293776:6355]
2025-10-01T14:09:06.164407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:06.164410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:06.164438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 698 reason: error at write: Disconnected sessionId: src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0
2025-10-01T14:09:06.164638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 698 sessionId: src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0 is DEAD
2025-10-01T14:09:06.164814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:06.164823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0] Write session will restart in 0.007848s
2025-10-01T14:09:06.164850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0] Write session: Do CDS request
2025-10-01T14:09:06.164855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:06.163649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.163704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.163709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.163777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:06.163840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:06.163906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:06.163971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:06.164015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:06.164017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:06.164097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092293776:6355], now have 1 active actors on pipe
2025-10-01T14:09:06.165245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:06.176628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:06.176749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:06.176776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 699
2025-10-01T14:09:06.176942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:06.176987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:06.176998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:06.177002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:06.177503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 699 sessionId:  describe result for acl check
2025-10-01T14:09:06.177543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:06.177549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:06.177551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:06.177557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255136092293858:6974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:06.178086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255136092293858:6974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:06.181277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255136092293858:6974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:06.184432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255136092293858:6974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:06.184447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255136092293858:6974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:06.184453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255136092293858:6974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:06.184467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:06.185315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:06.188480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:06.188985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:06.188998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:06.189011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:06.189072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:06.189114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255133715429296:6195]
2025-10-01T14:09:06.189741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:06.190092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:06.190138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:06.190473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:06.190538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.190548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.190550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.190551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.190552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.190554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.190556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.190557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.190558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.190560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.190571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.190573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.190574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.190576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.190583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.190594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.190599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.190604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.190608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.190613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.190617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.190622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.190626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.190630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.190635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.190639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.190643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.190647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.190656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.190666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.190672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.190678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.190687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.190694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.190703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.190709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.190721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.190728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.190732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.190738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.190748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.190755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.190760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.190770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.190777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.190787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.190792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.190798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.190807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.190813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.190822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.190827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.190834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.190839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.190848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.190854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.190901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:06.196257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 698
2025-10-01T14:09:06.196259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 698
2025-10-01T14:09:06.195222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:06.195842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:06.195847Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:06.195850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:06.195854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:06.195861Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 698 [2:7556255133715429296:6195]
2025-10-01T14:09:06.195882Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:06.195901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:06.195905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:06.195909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:06.195912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:06.195930Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:06.195935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:06.195943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:06.196003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.196006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.196009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.196013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:06.196016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:06.196091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:06.196094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.196106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.196118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.196138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:06.196159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092293779:2446], now have 1 active actors on pipe
2025-10-01T14:09:06.196163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294048:6974], now have 1 active actors on pipe
2025-10-01T14:09:06.196171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255133715429291:6195]
2025-10-01T14:09:06.196174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255133715429291:6195]
2025-10-01T14:09:06.196177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255133715429291:6195]
2025-10-01T14:09:06.196193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:06.196207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:06.196225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:06.196228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:06.196239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:06.196244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:06.196246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:06.196267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255133715429291:6195]
2025-10-01T14:09:06.196270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:06.196290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:06.196306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.196311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.196345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:06.196351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:06.196357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:06.196359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:06.196367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:06.196375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:06.196391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:06.196578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.196586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.196613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:06.196724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 699 partition: 0 MaxSeqNo: 45 sessionId: src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0
2025-10-01T14:09:06.197087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4d7175-816cc27d-7ce9a19d-563bdbb2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:06.199610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0] Write session: try to update token
2025-10-01T14:09:06.199626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:06.218331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 699 sessionId: src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:06.220835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:06.221721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.221747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.221768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:06.221772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:06.221775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:06.221777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:06.221787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255133715429291:6195]
2025-10-01T14:09:06.221792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255133715429291:6195]
2025-10-01T14:09:06.221797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255133715429291:6195]
2025-10-01T14:09:06.221840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:06.221853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:06.221856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:06.221859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:06.221860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.221863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:06.221994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:06.264638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255136092294068:6355]
2025-10-01T14:09:06.264942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 698, pipe: [1:7556255136092294068:6355]
2025-10-01T14:09:06.380970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:06.381422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:06.381491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294068:6355], now have 1 active actors on pipe
2025-10-01T14:09:06.381715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:06.381729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:06.381783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255136092294068:6355]
2025-10-01T14:09:06.381811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:06.381814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:06.381898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 699 reason: error at write: Disconnected sessionId: src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0
2025-10-01T14:09:06.382087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 699 sessionId: src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0 is DEAD
2025-10-01T14:09:06.382173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:06.382183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0] Write session will restart in 0.008596s
2025-10-01T14:09:06.382208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0] Write session: Do CDS request
2025-10-01T14:09:06.382216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:06.391945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:06.392051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:06.392070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 700
2025-10-01T14:09:06.392185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:06.392221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:06.392231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:06.392234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:06.392754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 700 sessionId:  describe result for acl check
2025-10-01T14:09:06.392800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:06.392806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:06.392808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:06.392814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255136092294147:6986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:06.393318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255136092294147:6986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:06.396119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255136092294147:6986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:06.404237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255136092294147:6986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:06.404258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255136092294147:6986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:06.404262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255136092294147:6986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:06.404271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:06.407181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:06.410482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:06.410844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:06.410856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:06.410870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:06.410958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:06.411004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255133715429593:6200]
2025-10-01T14:09:06.411617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:06.412006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:06.412067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:06.412458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:06.412537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.412545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.412547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.412548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.412550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.412551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.412552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.412553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.412554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.412555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.412557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.412558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.412560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.412561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.412568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.412578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.412582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.412586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.412590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.412594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.412598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.412602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.412606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.412613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.412616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.412620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.412624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.412633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.412642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.412655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.412667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.412673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.412678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.412684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.412688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.412694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.412703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.412709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.412713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.412718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.412724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.412729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.412734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.412738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.412747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.412753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.412771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.412776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.412785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.412791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.412800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.412806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.412830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.412837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.412845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.412850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.412886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:06.417132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:06.417807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:06.417827Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:06.417831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:06.417836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:06.417844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 699 [2:7556255133715429593:6200]
2025-10-01T14:09:06.417862Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:06.417894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:06.417902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:06.417906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:06.417909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:06.417927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:06.417933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:06.417940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:06.418010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.418019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.418021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.418024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:06.418027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:06.418107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:06.418116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.418130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.418140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.418153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:06.418177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255133715429588:6200]
2025-10-01T14:09:06.418184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255133715429588:6200]
2025-10-01T14:09:06.418186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255133715429588:6200]
2025-10-01T14:09:06.418196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:06.418210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:06.418230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:06.418234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:06.418273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255133715429588:6200]
2025-10-01T14:09:06.418281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:06.418283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:06.418285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:06.418287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:06.418293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:06.418312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294344:6986], now have 1 active actors on pipe
2025-10-01T14:09:06.418315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294100:2446], now have 1 active actors on pipe
2025-10-01T14:09:06.418688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.418706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.418737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:06.418753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:06.418758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:06.418761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:06.418772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:06.418784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:06.418809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:06.419005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.419016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.419044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:06.419565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b2865e9-6f296dd9-b3db8d02-ef8e6bd1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:06.418426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 699
2025-10-01T14:09:06.418435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 699
2025-10-01T14:09:06.419147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 700 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0
2025-10-01T14:09:06.422101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0] Write session: try to update token
2025-10-01T14:09:06.422120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:06.440978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:06.440997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:06.440999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:06.441001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:06.441012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255133715429588:6200]
2025-10-01T14:09:06.441018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255133715429588:6200]
2025-10-01T14:09:06.441021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255133715429588:6200]
2025-10-01T14:09:06.441076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:06.441091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.441081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:06.441094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:06.441098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:06.441101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:06.438404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 700 sessionId: src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:06.441327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:06.441250Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:06.482438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255136092294381:6355]
2025-10-01T14:09:06.486467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 699, pipe: [1:7556255136092294381:6355]
2025-10-01T14:09:06.598539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:06.599323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.599345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.599387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294381:6355], now have 1 active actors on pipe
2025-10-01T14:09:06.599593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255136092294381:6355]
2025-10-01T14:09:06.599615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:06.599619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:06.599636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:06.599602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:06.599684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 700 reason: error at write: Disconnected sessionId: src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0
2025-10-01T14:09:06.599877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 700 sessionId: src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0 is DEAD
2025-10-01T14:09:06.599993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:06.600003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0] Write session will restart in 0.005044s
2025-10-01T14:09:06.600033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0] Write session: Do CDS request
2025-10-01T14:09:06.600040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:06.605887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:06.605961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:06.605980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 701
2025-10-01T14:09:06.606112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:06.606142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:06.606146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:06.606150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:06.606605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 701 sessionId:  describe result for acl check
2025-10-01T14:09:06.606651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:06.606657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:06.606659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:06.606664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255136092294410:6991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:06.607177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255136092294410:6991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:06.610069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255136092294410:6991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:06.614220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255136092294410:6991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:06.614238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255136092294410:6991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:06.614242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255136092294410:6991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:06.614250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:06.619363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:06.623045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:06.623293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:06.623316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:06.623328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:06.623384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:06.623423Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255133715429884:6209]
2025-10-01T14:09:06.624033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:06.624396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:06.624449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:06.624818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:06.624890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.624897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.624898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.624899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.624900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.624901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.624902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.624903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.624904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.624905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.624906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.624907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.624909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.624910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.624916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.624924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.624928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.624931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.624935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.624939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.624942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.624945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.624949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.624952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.624955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.624959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.624962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.624965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.624974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.624982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.624988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.624993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.624998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.625003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.625007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.625011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.625016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.625021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.625026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.625048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.625058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.625063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.625071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.625076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.625080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.625086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.625091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.625101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.625106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.625111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.625120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.625125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.625134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.625139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.625147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.625152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.625196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:06.629301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:06.630047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:06.630070Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:06.630073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:06.630076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:06.630084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 700 [2:7556255133715429884:6209]
2025-10-01T14:09:06.630100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:06.630116Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:06.630124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:06.630128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:06.630130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:06.630147Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:06.630158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:06.630164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:06.630227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.630236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.630240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.630244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:06.630247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:06.630314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:06.630321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.630335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.630353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.630395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:06.630422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294395:2446], now have 1 active actors on pipe
2025-10-01T14:09:06.630430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294570:6991], now have 1 active actors on pipe
2025-10-01T14:09:06.630438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255133715429879:6209]
2025-10-01T14:09:06.630445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255133715429879:6209]
2025-10-01T14:09:06.630447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255133715429879:6209]
2025-10-01T14:09:06.630460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:06.630475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:06.630477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:06.630456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 700
2025-10-01T14:09:06.630481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:06.630483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:06.630496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:06.630499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:06.630469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 700
2025-10-01T14:09:06.630551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.630560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.630579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255133715429879:6209]
2025-10-01T14:09:06.630591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:06.630605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:06.630631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:06.630644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:06.630650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:06.630653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:06.630663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:06.630677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:06.630709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:06.630868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.630877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.630891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:06.630989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 701 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0
2025-10-01T14:09:06.631323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a595a98-ae82fa40-f8ecf3fb-2430d888_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:06.633786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0] Write session: try to update token
2025-10-01T14:09:06.633808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:06.648152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 701 sessionId: src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:06.650904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:06.652324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.652358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.652382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:06.652385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:06.652388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:06.652390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:06.652400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255133715429879:6209]
2025-10-01T14:09:06.652404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255133715429879:6209]
2025-10-01T14:09:06.652409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255133715429879:6209]
2025-10-01T14:09:06.652463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:06.652473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:06.652476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:06.652480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:06.652481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.652483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:06.652637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:06.699815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255136092294682:6355]
2025-10-01T14:09:06.700091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 700, pipe: [1:7556255136092294682:6355]
2025-10-01T14:09:06.801284Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:06.801513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:06.801567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294682:6355], now have 1 active actors on pipe
2025-10-01T14:09:06.801662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:06.801759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255136092294682:6355]
2025-10-01T14:09:06.801796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:06.801838Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:09:06.802031Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 7 consumer shared/user session shared/user_1_7_9030679859490182292_v1 is DEAD
2025-10-01T14:09:06.802171Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:09:06.802164Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255033013054683:6351] disconnected; active server actors: 1
2025-10-01T14:09:06.802171Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255033013054683:6351] client user disconnected session shared/user_1_7_9030679859490182292_v1
2025-10-01T14:09:06.802321Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:09:06.802328Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:09:06.802336Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.008974s
2025-10-01T14:09:06.811794Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:09:06.811801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:06.811816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:06.811840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 701 reason: error at write: Disconnected sessionId: src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0
2025-10-01T14:09:06.811947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 701 sessionId: src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0 is DEAD
2025-10-01T14:09:06.812032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:06.812041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0] Write session will restart in 0.007987s
2025-10-01T14:09:06.812076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0] Write session: Do CDS request
2025-10-01T14:09:06.812082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:06.812082Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:09:06.812090Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 8
2025-10-01T14:09:06.812275Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 8 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:09:06.812323Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:09:06.812395Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 auth for : user
2025-10-01T14:09:06.812507Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 Handle describe topics response
2025-10-01T14:09:06.812524Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 auth is DEAD
2025-10-01T14:09:06.812527Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:09:06.812692Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:09:06.812792Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255136092294718:6996] connected; active server actors: 1
2025-10-01T14:09:06.812816Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_8_11479685912846437090_v1
2025-10-01T14:09:06.812813Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255136092294718:6996] session shared/user_1_8_11479685912846437090_v1
2025-10-01T14:09:06.812827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:09:06.812837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:09:06.812843Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_8_11479685912846437090_v1" (Sender=[1:7556255136092294715:6996], Pipe=[1:7556255136092294718:6996], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:09:06.812847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:09:06.812860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:09:06.812866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_8_11479685912846437090_v1" (Sender=[1:7556255136092294715:6996], Pipe=[1:7556255136092294718:6996], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:09:06.812878Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_8_11479685912846437090_v1" sender [1:7556255136092294715:6996] lock partition 0 for ReadingSession "shared/user_1_8_11479685912846437090_v1" (Sender=[1:7556255136092294715:6996], Pipe=[1:7556255136092294718:6996], Partitions=[], ActiveFamilyCount=1) generation 1 step 8
2025-10-01T14:09:06.812888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:09:06.812890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000029s
2025-10-01T14:09:06.813039Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 8 Session: "shared/user_1_8_11479685912846437090_v1" ClientId: "user" PipeClient { RawX1: 7556255136092294718 RawX2: 4503603922344788 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:09:06.813063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:09:06.820924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:06.821211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:06.821228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 702
2025-10-01T14:09:06.821353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:06.821384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:06.821391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:06.821398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:06.821780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 702 sessionId:  describe result for acl check
2025-10-01T14:09:06.821816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:06.821824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:06.821825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:06.821831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255136092294826:7000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:06.822338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255136092294826:7000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:06.825631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255136092294826:7000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:06.828013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:06.831541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255136092294826:7000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:06.831558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255136092294826:7000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:06.831561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255136092294826:7000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:06.831571Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:06.831131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:06.831360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:06.831364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:06.831371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:06.831424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:06.831458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255133715430182:6216]
2025-10-01T14:09:06.832092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:06.832401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:06.832454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:06.832821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:06.832885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.832891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.832893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.832894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.832895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.832896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.832898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.832899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.832900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.832901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.832903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.832904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.832905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.832906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.832912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.832922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.832926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.832930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.832934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.832938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.832942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.832946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.832950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.832955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.832959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.832963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.832967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.832971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.832978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.832985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:06.832992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.832997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:06.833001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.833006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:06.833009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.833015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:06.833028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.833032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:06.833036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.833040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:06.833045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.833049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:06.833054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.833058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:06.833063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.833069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:06.833073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.833077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.833081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.833084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.833089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.833093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.833099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.833110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:06.833117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.833122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:06.833163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:06.837075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:06.837833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:06.837847Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:06.837850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:06.837853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:06.837860Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 701 [2:7556255133715430182:6216]
2025-10-01T14:09:06.837877Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:06.837895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:06.837898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:06.837901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:06.837903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:06.837919Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:06.837929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:06.837935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:06.837990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.837997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.837999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.838003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:06.838005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:06.838087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:06.838094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.838106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:06.838121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:06.838142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:06.838165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294721:6999], now have 1 active actors on pipe
2025-10-01T14:09:06.838172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294965:7000], now have 1 active actors on pipe
2025-10-01T14:09:06.838175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255136092294685:2446], now have 1 active actors on pipe
2025-10-01T14:09:06.838182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255133715430176:6216]
2025-10-01T14:09:06.838189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255133715430176:6216]
2025-10-01T14:09:06.838191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255133715430176:6216]
2025-10-01T14:09:06.838206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:06.838206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 701
2025-10-01T14:09:06.838223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:06.838207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 701, pipe: [1:7556255136092294721:6999]
2025-10-01T14:09:06.838236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:06.838240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:06.838242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:06.838230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 701
2025-10-01T14:09:06.838250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:06.838253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:06.838300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.838309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.838322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_8_11479685912846437090_v1 on pipe: [1:7556255136092294721:6999]
2025-10-01T14:09:06.838347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.838353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.838358Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_8_11479685912846437090_v1:1 with generation 701
2025-10-01T14:09:06.838363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255133715430176:6216]
2025-10-01T14:09:06.838383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:06.838389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:06.838403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:06.838413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:06.838415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:06.838431Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_8_11479685912846437090_v1
2025-10-01T14:09:06.838439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:06.838468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:06.838485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:09:06.838506Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:09:06.840971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:09:06.841005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:09:06.841013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:06.841019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:06.841022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:06.841032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:06.841043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:06.841055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:09:06.841068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:09:06.841087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:06.841222Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327746837 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:09:06.841243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:09:06.841275Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 sending to client partition status
2025-10-01T14:09:06.841280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:06.841302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:06.841328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:06.841458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 702 partition: 0 MaxSeqNo: 45 sessionId: src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0
2025-10-01T14:09:06.841810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ed79024-de368ec3-7ec8ed1a-d774a521_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:06.844316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0] Write session: try to update token
2025-10-01T14:09:06.844333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:06.858054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 702 sessionId: src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:06.859101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:06.859121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:06.859123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:06.859125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:06.859134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255133715430176:6216]
2025-10-01T14:09:06.859138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255133715430176:6216]
2025-10-01T14:09:06.859141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255133715430176:6216]
2025-10-01T14:09:06.859188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:06.859189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:06.859193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:06.859196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:06.859197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:06.859199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:06.859334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:06.860559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:07.008476Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:07.009105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.009124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.009402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_8_11479685912846437090_v1
2025-10-01T14:09:07.009402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255136092294721:6999]
2025-10-01T14:09:07.009425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:07.009423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:07.009436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:07.009438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:07.009449Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_8_11479685912846437090_v1
2025-10-01T14:09:07.009509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 702 reason: error at write: Disconnected sessionId: src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0
2025-10-01T14:09:07.009704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 702 sessionId: src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0 is DEAD
2025-10-01T14:09:07.009862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:07.009875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0] Write session will restart in 0.009598s
2025-10-01T14:09:07.009899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0] Write session: Do CDS request
2025-10-01T14:09:07.009905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:07.020895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.020957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:07.020974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 703
2025-10-01T14:09:07.021125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.021158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:07.021163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:07.021167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:07.021672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 703 sessionId:  describe result for acl check
2025-10-01T14:09:07.021719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:07.021726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:07.021728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:07.021734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255140387262331:7004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:07.022278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255140387262331:7004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:07.024460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255140387262331:7004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:07.027689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255140387262331:7004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:07.027705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255140387262331:7004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:07.027709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255140387262331:7004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:07.027717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:07.030696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:07.033670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:07.033921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:07.033933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:07.033948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:07.034018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:07.034288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255138010397760:6218]
2025-10-01T14:09:07.034906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:07.035227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:07.035285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:07.035593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:07.035681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.035688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.035689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.035690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.035691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.035692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.035693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.035695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.035696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.035697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.035698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.035700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.035701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.035701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.035708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.035718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.035722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.035726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.035730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.035733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.035737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.035741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.035744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.035750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.035754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.035758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.035761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.035765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.035772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.035780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.035786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.035790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.035795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.035800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.035804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.035815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.035819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.035828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.035833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.035842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.035846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.035851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.035856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.035861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.035870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.035875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.035879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.035883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.035887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.035892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.035899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.035904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.035909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.035917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.035921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.035930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.035967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:07.039864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:07.040498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:07.040514Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:07.040517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:07.040520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:07.040527Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 702 [2:7556255138010397760:6218]
2025-10-01T14:09:07.040547Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:07.040564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:07.040573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.040577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.040579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.040597Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:07.040608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:07.040615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:07.040673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.040681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.040684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.040687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:07.040690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:07.040758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:07.040775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.040788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.040805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.040827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:07.040850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387262278:2446], now have 1 active actors on pipe
2025-10-01T14:09:07.040860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387262508:7004], now have 1 active actors on pipe
2025-10-01T14:09:07.040868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255138010397755:6218]
2025-10-01T14:09:07.040871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255138010397755:6218]
2025-10-01T14:09:07.040873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255138010397755:6218]
2025-10-01T14:09:07.040887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:07.040901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:07.040903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:07.040906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:07.040909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:07.040919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:07.040923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:07.040935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 702
2025-10-01T14:09:07.040956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 702
2025-10-01T14:09:07.040957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255138010397755:6218]
2025-10-01T14:09:07.040967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:07.040969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:07.041000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.041011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.041044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:07.041055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.041060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.041062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:07.041072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.041085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:07.041108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.041306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.041320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.041342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.041427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 703 partition: 0 MaxSeqNo: 45 sessionId: src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0
2025-10-01T14:09:07.041737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48d440cd-f6b40754-5497fbde-aab99a3a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:07.044592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0] Write session: try to update token
2025-10-01T14:09:07.044614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:07.059271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 703 sessionId: src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:07.061703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:07.062869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.062894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.062910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:07.062913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:07.062914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:07.062915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:07.062922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255138010397755:6218]
2025-10-01T14:09:07.062925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255138010397755:6218]
2025-10-01T14:09:07.062928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255138010397755:6218]
2025-10-01T14:09:07.062974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:07.062977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:07.062983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.062984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:07.062985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:07.062987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:07.063125Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:07.109384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255140387262565:6999]
2025-10-01T14:09:07.109613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 702, pipe: [1:7556255140387262565:6999]
2025-10-01T14:09:07.206679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:07.207221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:07.207270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387262565:6999], now have 1 active actors on pipe
2025-10-01T14:09:07.207376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:07.207468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255140387262565:6999]
2025-10-01T14:09:07.207499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:07.219178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:07.219194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:07.219218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 703 reason: error at write: Disconnected sessionId: src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0
2025-10-01T14:09:07.219366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 703 sessionId: src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0 is DEAD
2025-10-01T14:09:07.219496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:07.219510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0] Write session will restart in 0.006142s
2025-10-01T14:09:07.219535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0] Write session: Do CDS request
2025-10-01T14:09:07.219544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:07.226835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.227227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:07.227243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 704
2025-10-01T14:09:07.227393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.227425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:07.227435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:07.227438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:07.227813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 704 sessionId:  describe result for acl check
2025-10-01T14:09:07.227844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:07.227850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:07.227852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:07.227858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255140387262706:7010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:07.228346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255140387262706:7010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:07.230795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255140387262706:7010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:07.232564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:07.235576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:07.235699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255140387262706:7010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:07.235714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255140387262706:7010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:07.235717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255140387262706:7010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:07.235728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:07.235812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:07.235821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:07.235832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:07.235881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:07.235926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255138010398039:6220]
2025-10-01T14:09:07.236393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:07.236646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:07.236687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:07.236978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:07.237027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.237032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.237032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.237033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.237034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.237034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.237035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.237036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.237037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.237037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.237038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.237039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.237040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.237040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.237043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.237049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.237052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.237054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.237056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.237058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.237060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.237062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.237064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.237068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.237071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.237075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.237078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.237080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.237088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.237105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.237110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.237115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.237119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.237124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.237127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.237132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.237136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.237141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.237145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.237149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.237154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.237163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.237167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.237172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.237181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.237186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.237190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.237194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.237203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.237208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.237215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.237220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.237230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.237234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.237242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.237247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.237286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:07.241023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:07.241975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:07.241987Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:07.241989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:07.241993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:07.242000Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 703 [2:7556255138010398039:6220]
2025-10-01T14:09:07.242019Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:07.242032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:07.242039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.242043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.242045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.242059Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:07.242069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:07.242075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:07.242135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.242141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.242142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.242145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:07.242148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:07.242209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:07.242215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.242227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.242242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.242261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:07.242281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387262843:7010], now have 1 active actors on pipe
2025-10-01T14:09:07.242289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387262567:2446], now have 1 active actors on pipe
2025-10-01T14:09:07.242296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255138010398034:6220]
2025-10-01T14:09:07.242302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255138010398034:6220]
2025-10-01T14:09:07.242304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255138010398034:6220]
2025-10-01T14:09:07.242318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:07.242333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:07.242341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:07.242344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:07.242346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:07.242350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:07.242353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:07.242342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 703
2025-10-01T14:09:07.242348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 703
2025-10-01T14:09:07.242397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255138010398034:6220]
2025-10-01T14:09:07.242403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:07.242405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:07.242422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.242430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.242473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:07.242482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.242487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.242493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:07.242502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.242513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:07.242534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.242667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.242674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.242685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.242748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 704 partition: 0 MaxSeqNo: 45 sessionId: src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0
2025-10-01T14:09:07.243074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3959d8da-7d263bdb-ef08fee4-a5000b87_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:07.245547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0] Write session: try to update token
2025-10-01T14:09:07.245568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:07.260365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 704 sessionId: src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:07.262897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:07.262988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:07.263006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:07.263009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:07.263010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:07.263021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255138010398034:6220]
2025-10-01T14:09:07.263026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255138010398034:6220]
2025-10-01T14:09:07.263029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255138010398034:6220]
2025-10-01T14:09:07.263053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:07.263059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:07.263062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:07.263084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.263102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.263123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:07.263134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.263137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:07.263267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:07.307536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255140387262860:6999]
2025-10-01T14:09:07.307812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 703, pipe: [1:7556255140387262860:6999]
2025-10-01T14:09:07.407446Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:07.407813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387262860:6999], now have 1 active actors on pipe
2025-10-01T14:09:07.408002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:07.408089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:07.408102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:07.408113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:07.408138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255140387262860:6999]
2025-10-01T14:09:07.408179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 704 reason: error at write: Disconnected sessionId: src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0
2025-10-01T14:09:07.408367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 704 sessionId: src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0 is DEAD
2025-10-01T14:09:07.408483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:07.408493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0] Write session will restart in 0.006994s
2025-10-01T14:09:07.408518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0] Write session: Do CDS request
2025-10-01T14:09:07.408525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:07.416936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.417031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:07.417046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 705
2025-10-01T14:09:07.417152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.417183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:07.417192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:07.417195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:07.418103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 705 sessionId:  describe result for acl check
2025-10-01T14:09:07.418140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:07.418142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:07.418143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:07.418148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255140387262922:7022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:07.418677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255140387262922:7022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:07.421557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255140387262922:7022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:07.425340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255140387262922:7022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:07.425356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255140387262922:7022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:07.425359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255140387262922:7022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:07.425367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:07.428490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:07.431699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:07.431916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:07.431926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:07.431936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:07.431984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:07.432021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255138010398342:6226]
2025-10-01T14:09:07.432626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:07.432956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:07.432996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:07.433302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:07.433368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.433374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.433375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.433376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.433377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.433378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.433379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.433380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.433382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.433383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.433384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.433385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.433386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.433387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.433392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.433402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.433406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.433420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.433424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.433428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.433431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.433435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.433439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.433443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.433447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.433450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.433455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.433458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.433466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.433473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.433479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.433484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.433488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.433493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.433497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.433502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.433508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.433518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.433523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.433527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.433532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.433535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.433544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.433548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.433554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.433559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.433566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.433571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.433575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.433580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.433583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.433588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.433592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.433597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.433605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.433609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.433662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:07.437550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:07.438761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:07.438774Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:07.438776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:07.438780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:07.438787Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 704 [2:7556255138010398342:6226]
2025-10-01T14:09:07.438806Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:07.438827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:07.438833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.438837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.438839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.438854Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:07.438864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:07.438871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:07.438925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.438935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.438938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.438941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:07.438944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:07.439004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:07.439011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.439022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.439038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.439059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:07.439076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387263117:7022], now have 1 active actors on pipe
2025-10-01T14:09:07.439080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387262889:2446], now have 1 active actors on pipe
2025-10-01T14:09:07.439086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255138010398337:6226]
2025-10-01T14:09:07.439092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255138010398337:6226]
2025-10-01T14:09:07.439095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255138010398337:6226]
2025-10-01T14:09:07.439106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:07.439119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:07.439122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:07.439130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:07.439132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:07.439136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:07.439139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:07.439114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 704
2025-10-01T14:09:07.439133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 704
2025-10-01T14:09:07.439183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.439192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.439204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255138010398337:6226]
2025-10-01T14:09:07.439214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:07.439221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:07.439245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:07.439251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.439256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.439262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:07.439270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.439281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:07.439306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.439446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.439459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.439483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.439596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 705 partition: 0 MaxSeqNo: 45 sessionId: src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0
2025-10-01T14:09:07.439934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3b07e12-5c8c3d73-1448ba3-39f17313_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:07.442257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0] Write session: try to update token
2025-10-01T14:09:07.442272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:07.455436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 705 sessionId: src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:07.457795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:07.459892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.459920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.459942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:07.459945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:07.459947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:07.459949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:07.459957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255138010398337:6226]
2025-10-01T14:09:07.459962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255138010398337:6226]
2025-10-01T14:09:07.459967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255138010398337:6226]
2025-10-01T14:09:07.460016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:07.460024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:07.460029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:07.460030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.460033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:07.460034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:07.460176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:07.508253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255140387263187:6999]
2025-10-01T14:09:07.508518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 704, pipe: [1:7556255140387263187:6999]
2025-10-01T14:09:07.607232Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:07.607474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:07.607521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387263187:6999], now have 1 active actors on pipe
2025-10-01T14:09:07.607587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:07.607669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255140387263187:6999]
2025-10-01T14:09:07.607685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:07.607687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:07.607704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:07.607761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 705 reason: error at write: Disconnected sessionId: src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0
2025-10-01T14:09:07.607895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 705 sessionId: src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0 is DEAD
2025-10-01T14:09:07.608027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:07.608038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0] Write session will restart in 0.008652s
2025-10-01T14:09:07.608061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0] Write session: Do CDS request
2025-10-01T14:09:07.608068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:07.617871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.617973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:07.617996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 706
2025-10-01T14:09:07.618101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.618130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:07.618140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:07.618144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:07.618624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 706 sessionId:  describe result for acl check
2025-10-01T14:09:07.618662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:07.618676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:07.618679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:07.618685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255140387263256:7027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:07.619161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255140387263256:7027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:07.621873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255140387263256:7027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:07.625018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255140387263256:7027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:07.625032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255140387263256:7027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:07.625035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255140387263256:7027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:07.625048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:07.626829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:07.629532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:07.629761Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:07.629770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:07.629780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:07.629836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:07.629873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255138010398625:6228]
2025-10-01T14:09:07.630467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:07.630812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:07.630877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:07.631214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:07.631265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.631275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.631276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.631277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.631279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.631280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.631281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.631282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.631283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.631284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.631285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.631287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.631288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.631289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.631295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.631304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.631308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.631314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.631318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.631322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.631325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.631329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.631333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.631337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.631340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.631344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.631348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.631351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.631358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.631367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.631374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.631379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.631383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.631387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.631402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.631406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.631410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.631414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.631417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.631422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.631427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.631432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.631435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.631440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.631444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.631449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.631452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.631457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.631468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.631473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.631476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.631481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.631485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.631489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.631493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.631498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.631535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:07.635420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:07.636043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:07.636062Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:07.636064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:07.636068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:07.636075Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 705 [2:7556255138010398625:6228]
2025-10-01T14:09:07.636092Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:07.636108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:07.636115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.636118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.636121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.636136Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:07.636144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:07.636151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:07.636207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.636214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.636216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.636219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:07.636222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:07.636279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:07.636286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.636299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.636314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.636333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:07.636354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387263190:2446], now have 1 active actors on pipe
2025-10-01T14:09:07.636362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387263457:7027], now have 1 active actors on pipe
2025-10-01T14:09:07.636369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255138010398620:6228]
2025-10-01T14:09:07.636373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255138010398620:6228]
2025-10-01T14:09:07.636375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255138010398620:6228]
2025-10-01T14:09:07.636387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:07.636406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:07.636411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:07.636417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:07.636419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:07.636427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:07.636430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:07.636464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255138010398620:6228]
2025-10-01T14:09:07.636471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:07.636458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 705
2025-10-01T14:09:07.636461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 705
2025-10-01T14:09:07.636495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:07.636577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.636590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.636617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:07.636629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.636638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.636640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:07.636650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.636664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:07.636692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.636831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.636839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.636856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.636958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 706 partition: 0 MaxSeqNo: 45 sessionId: src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0
2025-10-01T14:09:07.637285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a6f134e-f626c355-a8fdb853-a4990f74_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:07.639896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0] Write session: try to update token
2025-10-01T14:09:07.639913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:07.656543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 706 sessionId: src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:07.659164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:07.660955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.660985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.661006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:07.661009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:07.661012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:07.661014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:07.661023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255138010398620:6228]
2025-10-01T14:09:07.661027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255138010398620:6228]
2025-10-01T14:09:07.661030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255138010398620:6228]
2025-10-01T14:09:07.661074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:07.661087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:07.661088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:07.661091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:07.661096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.661099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:07.661245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:07.707937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255140387263481:6999]
2025-10-01T14:09:07.708188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 705, pipe: [1:7556255140387263481:6999]
2025-10-01T14:09:07.806452Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:07.807155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:07.807235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387263481:6999], now have 1 active actors on pipe
2025-10-01T14:09:07.807285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:07.807413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:07.807472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255140387263481:6999]
2025-10-01T14:09:07.817144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:07.817158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:07.817183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 706 reason: error at write: Disconnected sessionId: src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0
2025-10-01T14:09:07.817301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 706 sessionId: src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0 is DEAD
2025-10-01T14:09:07.817433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:07.817452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0] Write session will restart in 0.008324s
2025-10-01T14:09:07.817475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0] Write session: Do CDS request
2025-10-01T14:09:07.817483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:07.826838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.827002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:07.827029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 707
2025-10-01T14:09:07.827127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:07.827155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:07.827165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:07.827168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:07.827647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 707 sessionId:  describe result for acl check
2025-10-01T14:09:07.827682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:07.827688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:07.827690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:07.827695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255140387263625:7032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:07.828203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255140387263625:7032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:07.830672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255140387263625:7032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:07.833412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255140387263625:7032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:07.833428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255140387263625:7032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:07.833431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255140387263625:7032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:07.833438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:07.833775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:07.836584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:07.836809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:07.836819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:07.836830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:07.836883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:07.836922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255138010398940:6241]
2025-10-01T14:09:07.837494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:07.837839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:07.837914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:07.838241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:07.838319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.838326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.838327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.838328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.838329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.838330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.838331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.838332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.838332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.838333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.838334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.838335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.838336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.838337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.838342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.838351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.838355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.838360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.838363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.838367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.838395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.838398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.838401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.838405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.838409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.838412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.838415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.838418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.838426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.838433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:07.838439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.838444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:07.838455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.838460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:07.838468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.838473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:07.838483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.838487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:07.838492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.838497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:07.838501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.838506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:07.838511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.838515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:07.838520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.838525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:07.838529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.838534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.838540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.838547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.838556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.838561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.838565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.838571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:07.838574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.838578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:07.838619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:07.842188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:07.843153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:07.843170Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:07.843172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:07.843175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:07.843181Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 706 [2:7556255138010398940:6241]
2025-10-01T14:09:07.843195Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:07.843212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:07.843215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.843218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.843220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.843235Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:07.843245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:07.843251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:07.843309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.843317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.843319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.843323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:07.843326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:07.843390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:07.843400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.843411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:07.843420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:07.843434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:07.843452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387263762:7032], now have 1 active actors on pipe
2025-10-01T14:09:07.843460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387263484:2446], now have 1 active actors on pipe
2025-10-01T14:09:07.843468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255138010398934:6241]
2025-10-01T14:09:07.843476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255138010398934:6241]
2025-10-01T14:09:07.843478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255138010398934:6241]
2025-10-01T14:09:07.843492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:07.843504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:07.843505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:07.843516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:07.843518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:07.843531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:07.843539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:07.843558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 706
2025-10-01T14:09:07.843567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255138010398934:6241]
2025-10-01T14:09:07.843566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 706
2025-10-01T14:09:07.843584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:07.843603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:07.843621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.843631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.843658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ab4f302-9b256c7-fba62e14-de832f81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:07.843669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:07.843673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:07.843680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:07.843689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:07.843703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:07.843717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.843893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.843902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.843918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:07.843995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 707 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ab4f302-9b256c7-fba62e14-de832f81_0
2025-10-01T14:09:07.844325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dc2173e-2e17e76b-1c6cc427-fcc67259_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ab4f302-9b256c7-fba62e14-de832f81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:07.846728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab4f302-9b256c7-fba62e14-de832f81_0] Write session: try to update token
2025-10-01T14:09:07.846743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab4f302-9b256c7-fba62e14-de832f81_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:07.859819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:07.859840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:07.859851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255138010398934:6241]
2025-10-01T14:09:07.859899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:07.859913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:07.860066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:07.860225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:07.860381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:07.860515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:07.860697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:07.860736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:07.861839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 707 sessionId: src_id|9ab4f302-9b256c7-fba62e14-de832f81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:07.864310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:07.864494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:07.864514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:07.864549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:07.864615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:07.874009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:07.874032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:07.874035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:07.874037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:07.874049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255138010398934:6241]
2025-10-01T14:09:07.874053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255138010398934:6241]
2025-10-01T14:09:07.874057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255138010398934:6241]
2025-10-01T14:09:07.874104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:07.874105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:07.874117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:07.874119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:07.874124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:07.874128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:07.874249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:07.907629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255140387263774:6999]
2025-10-01T14:09:07.907928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 706, pipe: [1:7556255140387263774:6999]
2025-10-01T14:09:08.024819Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:08.032335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.032365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.032540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.032604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.032665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.032729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.032787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.032798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.032868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.032928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.032987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.033050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.033097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.033103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.033162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.033213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.033267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.033326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.033378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.033387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.033448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.033504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.033555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.033623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.033668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.033674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.033733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.033787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.033847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.033908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.034008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.034013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.034072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.034124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.034183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.034242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.034281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.034287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.034349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.034431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.034488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.034546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.034587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.034593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.034652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.034708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.034763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.034822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.034877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.034886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.034955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.035021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.035090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.035153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.035201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.035209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.035277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.035342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.035413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.035479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.035523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.035534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.035587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255140387263774:6999], now have 1 active actors on pipe
2025-10-01T14:09:08.035873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255140387263774:6999]
2025-10-01T14:09:08.035883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:08.035887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:08.035905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:08.035914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 707 reason: error at write: Disconnected sessionId: src_id|9ab4f302-9b256c7-fba62e14-de832f81_0
2025-10-01T14:09:08.036103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 707 sessionId: src_id|9ab4f302-9b256c7-fba62e14-de832f81_0 is DEAD
2025-10-01T14:09:08.036241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab4f302-9b256c7-fba62e14-de832f81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:08.036252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab4f302-9b256c7-fba62e14-de832f81_0] Write session will restart in 0.008472s
2025-10-01T14:09:08.036279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab4f302-9b256c7-fba62e14-de832f81_0] Write session: Do CDS request
2025-10-01T14:09:08.036286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab4f302-9b256c7-fba62e14-de832f81_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:08.036740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:08.045828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab4f302-9b256c7-fba62e14-de832f81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.045886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:08.045902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 708
2025-10-01T14:09:08.046025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.046056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:08.046065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:08.046068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:08.046579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 708 sessionId:  describe result for acl check
2025-10-01T14:09:08.046611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:08.046616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:08.046617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:08.046622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255144682231101:7036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:08.047155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255144682231101:7036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:08.050240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255144682231101:7036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:08.053610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255144682231101:7036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:08.053633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255144682231101:7036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:08.053637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255144682231101:7036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:08.053644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:08.057223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:08.059784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:08.060090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:08.060107Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:08.060119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:08.060189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:08.060230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255142305366520:6243]
2025-10-01T14:09:08.060789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:08.061137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:08.061193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:08.061553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:08.061619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.061625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.061626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.061628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.061628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.061630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.061631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.061632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.061633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.061634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.061635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.061636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.061637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.061638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.061645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.061655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.061660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.061664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.061668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.061671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.061675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.061679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.061683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.061687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.061691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.061695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.061699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.061703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.061709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.061717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.061724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.061732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.061736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.061742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.061746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.061752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.061757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.061761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.061765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.061771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.061780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.061784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.061789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.061798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.061803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.061812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.061817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.061826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.061831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.061841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.061846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.061851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.061855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.061865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.061870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.061878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.061915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:08.065652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:08.066561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:08.066572Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:08.066574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:08.066576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:08.066581Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 707 [2:7556255142305366520:6243]
2025-10-01T14:09:08.066595Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:08.066608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:08.066611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.066613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.066614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.066626Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:08.066629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:08.066633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:08.066675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.066680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.066681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.066683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:08.066685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:08.066733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:08.066740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.066747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.066752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.066763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:08.066780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255142305366515:6243]
2025-10-01T14:09:08.066786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255142305366515:6243]
2025-10-01T14:09:08.066788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255142305366515:6243]
2025-10-01T14:09:08.066803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:08.066815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:08.066818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:08.066820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682231073:2446], now have 1 active actors on pipe
2025-10-01T14:09:08.066821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:08.066825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682231300:7036], now have 1 active actors on pipe
2025-10-01T14:09:08.066828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:08.066837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:08.066838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:08.066864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255142305366515:6243]
2025-10-01T14:09:08.066875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:08.066871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 707
2025-10-01T14:09:08.066898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:08.066884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 707
2025-10-01T14:09:08.066918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.066927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.066951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:08.066961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.066966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.066967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:08.066976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.066984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:08.066996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.067128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.067141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.067164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.067262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 708 partition: 0 MaxSeqNo: 45 sessionId: src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0
2025-10-01T14:09:08.067604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ab4f302-9b256c7-fba62e14-de832f81_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:08.069939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0] Write session: try to update token
2025-10-01T14:09:08.069952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:08.084978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 708 sessionId: src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:08.087685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:08.088194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.088216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.088236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:08.088239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:08.088242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:08.088244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:08.088250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255142305366515:6243]
2025-10-01T14:09:08.088256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255142305366515:6243]
2025-10-01T14:09:08.088258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255142305366515:6243]
2025-10-01T14:09:08.088291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:08.088303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:08.088305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:08.088309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.088309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:08.088310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:08.088431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:08.135960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255144682231365:6999]
2025-10-01T14:09:08.136229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 707, pipe: [1:7556255144682231365:6999]
2025-10-01T14:09:08.230917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:08.231176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:08.231250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682231365:6999], now have 1 active actors on pipe
2025-10-01T14:09:08.231327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:08.231443Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:08.231493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255144682231365:6999]
2025-10-01T14:09:08.240189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:08.240206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:08.240230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 708 reason: error at write: Disconnected sessionId: src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0
2025-10-01T14:09:08.240347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 708 sessionId: src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0 is DEAD
2025-10-01T14:09:08.240476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:08.240486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0] Write session will restart in 0.006068s
2025-10-01T14:09:08.240521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0] Write session: Do CDS request
2025-10-01T14:09:08.240531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:08.247799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.247914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:08.247929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 709
2025-10-01T14:09:08.248056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.248081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:08.248094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:08.248100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:08.248539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 709 sessionId:  describe result for acl check
2025-10-01T14:09:08.248572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:08.248578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:08.248580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:08.248585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255144682231467:7041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:08.249027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255144682231467:7041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:08.251354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255144682231467:7041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:08.255763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255144682231467:7041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:08.255791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255144682231467:7041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:08.255794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255144682231467:7041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:08.255807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:08.255853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:08.259092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:08.259342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:08.259363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:08.259376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:08.259436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:08.259479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255142305366805:6245]
2025-10-01T14:09:08.260088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:08.260397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:08.260451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:08.260775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:08.260829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.260835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.260836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.260837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.260839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.260840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.260841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.260842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.260843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.260845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.260846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.260846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.260847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.260848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.260851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.260857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.260859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.260861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.260863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.260865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.260867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.260869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.260871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.260873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.260875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.260877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.260879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.260881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.260887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.260892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.260896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.260898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.260902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.260906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.260909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.260912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.260916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.260920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.260924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.260928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.260932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.260937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.260941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.260945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.260948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.260951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.260953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.260956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.260958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.260961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.260963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.260966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.260968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.260971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.260973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.260975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.260996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:08.264707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:08.265350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:08.265363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:08.265366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:08.265370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:08.265377Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 708 [2:7556255142305366805:6245]
2025-10-01T14:09:08.265391Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:08.265407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:08.265417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.265420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.265422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.265437Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:08.265446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:08.265452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:08.265510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.265517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.265519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.265522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:08.265525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:08.265586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:08.265593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.265605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.265614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.265629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:08.265646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682231652:7041], now have 1 active actors on pipe
2025-10-01T14:09:08.265649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682231367:2446], now have 1 active actors on pipe
2025-10-01T14:09:08.265656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255142305366799:6245]
2025-10-01T14:09:08.265658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255142305366799:6245]
2025-10-01T14:09:08.265660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255142305366799:6245]
2025-10-01T14:09:08.265674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:08.265683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:08.265685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:08.265687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:08.265693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:08.265706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:08.265714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:08.265706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 708
2025-10-01T14:09:08.265720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 708
2025-10-01T14:09:08.265757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.265766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.265778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255142305366799:6245]
2025-10-01T14:09:08.265789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:08.265792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:08.265818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:08.265834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.265838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.265841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:08.265850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.265860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:08.265881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.266051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.266068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.266090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.266170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 709 partition: 0 MaxSeqNo: 45 sessionId: src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0
2025-10-01T14:09:08.266503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1877c3fe-f78e8f2-412f61ee-c7a1e481_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:08.268704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0] Write session: try to update token
2025-10-01T14:09:08.268720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:08.282567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 709 sessionId: src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:08.285052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:08.285908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.285933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.285949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:08.285952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:08.285954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:08.285955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:08.285961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255142305366799:6245]
2025-10-01T14:09:08.285964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255142305366799:6245]
2025-10-01T14:09:08.285967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255142305366799:6245]
2025-10-01T14:09:08.285998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:08.286012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:08.286012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:08.286015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:08.286019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.286021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:08.286144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:08.331559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255144682231668:6999]
2025-10-01T14:09:08.331822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 708, pipe: [1:7556255144682231668:6999]
2025-10-01T14:09:08.430906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:08.431156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:08.431218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682231668:6999], now have 1 active actors on pipe
2025-10-01T14:09:08.431317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:08.431409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255144682231668:6999]
2025-10-01T14:09:08.431411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:08.431414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:08.431442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:08.431499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 709 reason: error at write: Disconnected sessionId: src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0
2025-10-01T14:09:08.431644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 709 sessionId: src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0 is DEAD
2025-10-01T14:09:08.431771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:08.431782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0] Write session will restart in 0.005211s
2025-10-01T14:09:08.431807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0] Write session: Do CDS request
2025-10-01T14:09:08.431817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:08.437868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.437938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:08.437952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 710
2025-10-01T14:09:08.438068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.438100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:08.438105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:08.438108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:08.438515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 710 sessionId:  describe result for acl check
2025-10-01T14:09:08.438547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:08.438553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:08.438554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:08.438559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255144682231708:7052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:08.439009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255144682231708:7052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:08.440985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255144682231708:7052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:08.444437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255144682231708:7052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:08.444457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255144682231708:7052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:08.444461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255144682231708:7052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:08.444469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:08.451856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:08.455247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:08.455506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:08.455522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:08.455536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:08.455614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:08.455672Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255142305367113:6251]
2025-10-01T14:09:08.456198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:08.456529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:08.456573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:08.456868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:08.456929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.456934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.456935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.456937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.456938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.456939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.456940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.456941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.456942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.456944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.456945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.456946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.456947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.456948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.456954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.456963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.456967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.456971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.456974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.456978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.456981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.456985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.456988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.456992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.456996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.456999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.457003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.457006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.457013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.457021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.457027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.457031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.457036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.457041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.457045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.457050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.457054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.457058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.457067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.457071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.457076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.457083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.457086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.457091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.457096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.457101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.457110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.457115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.457124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.457129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.457133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.457137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.457145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.457151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.457155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.457159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.457203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:08.460974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:08.462038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:08.462053Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:08.462055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:08.462057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:08.462062Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 709 [2:7556255142305367113:6251]
2025-10-01T14:09:08.462075Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:08.462089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:08.462091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.462093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.462094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.462106Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:08.462114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:08.462119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:08.462160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.462166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.462167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.462171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:08.462173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:08.462236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:08.462242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.462251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.462265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.462283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:08.462304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682231695:2446], now have 1 active actors on pipe
2025-10-01T14:09:08.462311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682231805:7052], now have 1 active actors on pipe
2025-10-01T14:09:08.462319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255142305367108:6251]
2025-10-01T14:09:08.462321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255142305367108:6251]
2025-10-01T14:09:08.462323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255142305367108:6251]
2025-10-01T14:09:08.462335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:08.462347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:08.462352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:08.462354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:08.462356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:08.462361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:08.462363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:08.462407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255142305367108:6251]
2025-10-01T14:09:08.462411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 709
2025-10-01T14:09:08.462410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:08.462424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:08.462448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.462453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.462423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 709
2025-10-01T14:09:08.462479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f445b52f-35f85a6d-3da11185-8b63e289_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:08.462486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.462490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.462492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:08.462501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.462508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:08.462521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.462675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.462682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.462694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.462794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 710 partition: 0 MaxSeqNo: 45 sessionId: src_id|f445b52f-35f85a6d-3da11185-8b63e289_0
2025-10-01T14:09:08.463151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb8e67e5-1e8c47f1-6d684a0e-2816424e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f445b52f-35f85a6d-3da11185-8b63e289_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:08.465530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f445b52f-35f85a6d-3da11185-8b63e289_0] Write session: try to update token
2025-10-01T14:09:08.465549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f445b52f-35f85a6d-3da11185-8b63e289_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:08.473484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:08.473504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:08.473514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255142305367108:6251]
2025-10-01T14:09:08.473555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:08.473559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:08.473733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:08.473882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:08.474045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:08.474209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:08.474490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:08.474536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:08.480354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 710 sessionId: src_id|f445b52f-35f85a6d-3da11185-8b63e289_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:08.483148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:08.483567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.483594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.483632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:08.483729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:08.501553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:08.501573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:08.501575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:08.501578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:08.501587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255142305367108:6251]
2025-10-01T14:09:08.501592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255142305367108:6251]
2025-10-01T14:09:08.501596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255142305367108:6251]
2025-10-01T14:09:08.501617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:08.501623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:08.501627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:08.501636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:08.501643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.501649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:08.501776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:08.531754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255144682231998:6999]
2025-10-01T14:09:08.532031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 709, pipe: [1:7556255144682231998:6999]
2025-10-01T14:09:08.646434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:08.653565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.653592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.653729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.653784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.653835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.653888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.653934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.653944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.654006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.654061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.654118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.654180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.654223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.654229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.654293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.654351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.654492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.654548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.654587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.654593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.654651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.654711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.654773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.654831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.654874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.654884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.654945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.655003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.655065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.655129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.655176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.655181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.655235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.655287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.655344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.655398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.655438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.655445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.655502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.655554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.655609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.655666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.655712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.655718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.655781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.655838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.655900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.655959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.656004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.656010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.656070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.656123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.656179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.656234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.656278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.656284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.656345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.656400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.656454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.656513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.656552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.656558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.656611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682231998:6999], now have 1 active actors on pipe
2025-10-01T14:09:08.656878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:08.656895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:08.656902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255144682231998:6999]
2025-10-01T14:09:08.656930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 710 reason: error at write: Disconnected sessionId: src_id|f445b52f-35f85a6d-3da11185-8b63e289_0
2025-10-01T14:09:08.656944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:08.657136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 710 sessionId: src_id|f445b52f-35f85a6d-3da11185-8b63e289_0 is DEAD
2025-10-01T14:09:08.657257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f445b52f-35f85a6d-3da11185-8b63e289_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:08.657266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f445b52f-35f85a6d-3da11185-8b63e289_0] Write session will restart in 0.007416s
2025-10-01T14:09:08.657291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f445b52f-35f85a6d-3da11185-8b63e289_0] Write session: Do CDS request
2025-10-01T14:09:08.657297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f445b52f-35f85a6d-3da11185-8b63e289_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:08.657691Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:08.665854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f445b52f-35f85a6d-3da11185-8b63e289_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.665965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:08.665983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 711
2025-10-01T14:09:08.666099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.666130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:08.666136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:08.666140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:08.666562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 711 sessionId:  describe result for acl check
2025-10-01T14:09:08.666605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:08.666613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:08.666615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:08.666620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255144682232012:7057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:08.667187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255144682232012:7057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:08.669346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255144682232012:7057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:08.673477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255144682232012:7057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:08.673495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255144682232012:7057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:08.673499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255144682232012:7057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:08.673513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:08.682554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:08.685653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:08.685863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:08.685872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:08.685883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:08.685941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:08.685982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255142305367415:6253]
2025-10-01T14:09:08.686575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:08.686895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:08.686939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:08.687233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:08.687281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.687286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.687287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.687288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.687290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.687291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.687292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.687293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.687294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.687295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.687296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.687297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.687298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.687299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.687304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.687313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.687317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.687321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.687324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.687328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.687331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.687335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.687338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.687343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.687346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.687350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.687353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.687357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.687363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.687373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.687379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.687388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.687392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.687402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.687408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.687413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.687421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.687425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.687428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.687438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.687442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.687451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.687454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.687465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.687469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.687477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.687481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.687485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.687493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.687498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.687501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.687506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.687514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.687518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.687522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.687526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.687563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:08.691420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:08.692016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:08.692033Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:08.692035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:08.692038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:08.692044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 710 [2:7556255142305367415:6253]
2025-10-01T14:09:08.692061Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:08.692080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:08.692087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.692090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.692093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.692108Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:08.692117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:08.692123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:08.692180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.692186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.692187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.692190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:08.692192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:08.692256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:08.692267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.692277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.692286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.692298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:08.692315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682232100:7057], now have 1 active actors on pipe
2025-10-01T14:09:08.692318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682232002:2446], now have 1 active actors on pipe
2025-10-01T14:09:08.692325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255142305367410:6253]
2025-10-01T14:09:08.692327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255142305367410:6253]
2025-10-01T14:09:08.692329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255142305367410:6253]
2025-10-01T14:09:08.692344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:08.692359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:08.692370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:08.692370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:08.692374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:08.692376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:08.692378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:08.692409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255142305367410:6253]
2025-10-01T14:09:08.692411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:08.692419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:08.692457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.692466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.692488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8e2187e-bec004c8-75336d27-b90a349f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:08.692498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.692502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.692504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:08.692512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.692519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:08.692535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.692398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 710
2025-10-01T14:09:08.692450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 710
2025-10-01T14:09:08.692671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.692686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.692707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.692813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 711 partition: 0 MaxSeqNo: 45 sessionId: src_id|f8e2187e-bec004c8-75336d27-b90a349f_0
2025-10-01T14:09:08.693127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f445b52f-35f85a6d-3da11185-8b63e289_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f8e2187e-bec004c8-75336d27-b90a349f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:08.695603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e2187e-bec004c8-75336d27-b90a349f_0] Write session: try to update token
2025-10-01T14:09:08.695621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e2187e-bec004c8-75336d27-b90a349f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:08.709075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:08.709098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:08.709108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255142305367410:6253]
2025-10-01T14:09:08.709157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:08.709158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:08.709342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:08.709492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:08.709642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:08.709779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:08.709982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:08.710023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:08.712093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 711 sessionId: src_id|f8e2187e-bec004c8-75336d27-b90a349f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:08.714594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:08.714785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.714810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.714849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:08.714932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:08.723288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:08.723313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:08.723316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:08.723318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:08.723330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255142305367410:6253]
2025-10-01T14:09:08.723334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255142305367410:6253]
2025-10-01T14:09:08.723338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255142305367410:6253]
2025-10-01T14:09:08.723382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:08.723388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:08.723388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:08.723391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:08.723397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.723399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:08.723542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:08.757008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255144682232298:6999]
2025-10-01T14:09:08.757245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 710, pipe: [1:7556255144682232298:6999]
2025-10-01T14:09:08.872741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:08.880797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.880829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.880997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.881060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.881124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.881189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.881289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.881302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.881369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.881427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.881485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.881545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.881586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.881592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.881649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.881710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.881772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.881839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.881883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.881892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.881950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.882009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.882065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.882127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.882169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.882177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.882238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.882296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.882356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.882442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.882486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.882493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.882559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.882615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.882677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.882746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.882804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.882812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.882880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.882953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.883024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.883091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.883151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.883159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.883221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.883285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.883346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.883415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.883469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.883477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.883551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.883623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.883690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.883749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.883796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.883804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.883872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:08.883939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:08.884006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:08.884069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:08.884110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:08.884117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:08.884180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682232298:6999], now have 1 active actors on pipe
2025-10-01T14:09:08.884395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255144682232298:6999]
2025-10-01T14:09:08.884441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:08.884756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:08.884776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:08.884801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 711 reason: error at write: Disconnected sessionId: src_id|f8e2187e-bec004c8-75336d27-b90a349f_0
2025-10-01T14:09:08.884975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 711 sessionId: src_id|f8e2187e-bec004c8-75336d27-b90a349f_0 is DEAD
2025-10-01T14:09:08.885105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e2187e-bec004c8-75336d27-b90a349f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:08.885117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e2187e-bec004c8-75336d27-b90a349f_0] Write session will restart in 0.006270s
2025-10-01T14:09:08.885142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e2187e-bec004c8-75336d27-b90a349f_0] Write session: Do CDS request
2025-10-01T14:09:08.885148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e2187e-bec004c8-75336d27-b90a349f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:08.885226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:08.892944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e2187e-bec004c8-75336d27-b90a349f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.893031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:08.893049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 712
2025-10-01T14:09:08.893192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:08.893238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:08.893250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:08.893254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:08.893628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 712 sessionId:  describe result for acl check
2025-10-01T14:09:08.893663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:08.893670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:08.893672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:08.893676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255144682232315:7062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:08.894173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255144682232315:7062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:08.897881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255144682232315:7062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:08.901459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255144682232315:7062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:08.901479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255144682232315:7062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:08.901482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255144682232315:7062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:08.901490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:08.907213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:08.910181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:08.910428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:08.910437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:08.910449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:08.910509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:08.910563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255142305367721:6266]
2025-10-01T14:09:08.911151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:08.911431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:08.911475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:08.911754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:08.911803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.911809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.911810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.911811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.911812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.911813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.911815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.911816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.911817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.911819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.911820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.911821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.911822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.911824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.911828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.911838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.911842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.911845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.911849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.911852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.911855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.911859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.911862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.911865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.911868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.911872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.911875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.911878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.911884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.911890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:08.911896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.911901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:08.911906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.911911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:08.911915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.911920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:08.911924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.911928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:08.911931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.911936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:08.911941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.911945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:08.911949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.911954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:08.911958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.911963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:08.911967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.911972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.911975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.911981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.911985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.911989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.911993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.911997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:08.912001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.912006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:08.912046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:08.915908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:08.916783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:08.916796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:08.916798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:08.916801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:08.916809Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 711 [2:7556255142305367721:6266]
2025-10-01T14:09:08.916826Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:08.916845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:08.916852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.916855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.916858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.916873Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:08.916882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:08.916891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:08.916946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.916952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.916954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.916958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:08.916961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:08.917026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:08.917032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.917045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:08.917059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:08.917078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:08.917099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682232454:7062], now have 1 active actors on pipe
2025-10-01T14:09:08.917103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682232301:2446], now have 1 active actors on pipe
2025-10-01T14:09:08.917110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255142305367716:6266]
2025-10-01T14:09:08.917112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255142305367716:6266]
2025-10-01T14:09:08.917114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255142305367716:6266]
2025-10-01T14:09:08.917127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:08.917140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:08.917151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:08.917153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:08.917156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:08.917162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:08.917164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:08.917190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255142305367716:6266]
2025-10-01T14:09:08.917198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:08.917200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:08.917171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 711
2025-10-01T14:09:08.917224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.917233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.917263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:08.917274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:08.917278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:08.917280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:08.917289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:08.917301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:08.917321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.917330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 711
2025-10-01T14:09:08.917457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.917466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.917492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:08.917570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 712 partition: 0 MaxSeqNo: 45 sessionId: src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0
2025-10-01T14:09:08.917856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8e2187e-bec004c8-75336d27-b90a349f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:08.920349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0] Write session: try to update token
2025-10-01T14:09:08.920366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:08.934946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 712 sessionId: src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:08.937389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:08.938045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:08.938075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:08.938097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:08.938100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:08.938102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:08.938104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:08.938112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255142305367716:6266]
2025-10-01T14:09:08.938117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255142305367716:6266]
2025-10-01T14:09:08.938124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255142305367716:6266]
2025-10-01T14:09:08.938168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:08.938182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:08.938183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:08.938186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:08.938189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:08.938192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:08.938321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:08.984363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255144682232597:6999]
2025-10-01T14:09:08.984631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 711, pipe: [1:7556255144682232597:6999]
2025-10-01T14:09:09.086141Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:09.086734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:09.086818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255144682232597:6999], now have 1 active actors on pipe
2025-10-01T14:09:09.086898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:09.087005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:09.087056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255144682232597:6999]
2025-10-01T14:09:09.098545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:09.098563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:09.098589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 712 reason: error at write: Disconnected sessionId: src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0
2025-10-01T14:09:09.098907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:09.098918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0] Write session will restart in 0.006762s
2025-10-01T14:09:09.098943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0] Write session: Do CDS request
2025-10-01T14:09:09.098949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:09.098731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 712 sessionId: src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0 is DEAD
2025-10-01T14:09:09.106908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.110530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:09.110548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 713
2025-10-01T14:09:09.110719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.110750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:09.110755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:09.110759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:09.111122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 713 sessionId:  describe result for acl check
2025-10-01T14:09:09.111152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:09.111154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:09.111156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:09.111161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255148977200012:7066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:09.111632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255148977200012:7066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:09.114664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255148977200012:7066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:09.117901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255148977200012:7066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:09.117918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255148977200012:7066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:09.117922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255148977200012:7066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:09.117931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:09.118608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:09.121836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:09.122084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:09.122094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:09.122104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:09.122157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:09.122195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255146600335307:6268]
2025-10-01T14:09:09.122865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:09.123275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:09.123329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:09.123655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:09.123703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.123704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.123706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.123707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.123708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.123709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.123710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.123711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.123713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.123714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.123715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.123716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.123717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.123718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.123725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.123735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.123740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.123744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.123748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.123752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.123756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.123760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.123764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.123768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.123772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.123776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.123779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.123783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.123790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.123798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.123804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.123809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.123814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.123820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.123824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.123829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.123834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.123840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.123845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.123850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.123855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.123860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.123864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.123870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.123877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.123882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.123886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.123891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.123896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.123901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.123905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.123910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.123915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.123920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.123925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.123930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.123970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:09.128326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:09.128939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:09.128955Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:09.128958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:09.128963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:09.128970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 712 [2:7556255146600335307:6268]
2025-10-01T14:09:09.128987Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:09.129005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:09.129013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:09.129017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:09.129019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:09.129036Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:09.129048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:09.129055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:09.129211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.129219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.129220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.129223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:09.129226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:09.129295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:09.129302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.129314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.129328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.129347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:09.129370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977200179:7066], now have 1 active actors on pipe
2025-10-01T14:09:09.129377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977199895:2446], now have 1 active actors on pipe
2025-10-01T14:09:09.129384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255146600335302:6268]
2025-10-01T14:09:09.129391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255146600335302:6268]
2025-10-01T14:09:09.129393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255146600335302:6268]
2025-10-01T14:09:09.129408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:09.129426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:09.129431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:09.129435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:09.129438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:09.129444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:09.129422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 712
2025-10-01T14:09:09.129430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 712
2025-10-01T14:09:09.129446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:09.129478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255146600335302:6268]
2025-10-01T14:09:09.129483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:09.129503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.129506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:09.129510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.129561Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|927345bd-c974963e-4f50b578-26134426_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:09.129572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:09.129577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:09.129579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:09.129587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:09.129601Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:09.129630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:09.129814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.129821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.129832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:09.130097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 713 partition: 0 MaxSeqNo: 45 sessionId: src_id|927345bd-c974963e-4f50b578-26134426_0
2025-10-01T14:09:09.130499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd46e2f-afe7c1d-43d98186-d7de9df3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|927345bd-c974963e-4f50b578-26134426_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:09.133054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927345bd-c974963e-4f50b578-26134426_0] Write session: try to update token
2025-10-01T14:09:09.133074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927345bd-c974963e-4f50b578-26134426_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:09.147558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 713 sessionId: src_id|927345bd-c974963e-4f50b578-26134426_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:09.150027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:09.150549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.150576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.152470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:09.152491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:09.152494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:09.152495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:09.152504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255146600335302:6268]
2025-10-01T14:09:09.152509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255146600335302:6268]
2025-10-01T14:09:09.152513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255146600335302:6268]
2025-10-01T14:09:09.152561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:09.152562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:09.152568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:09.152573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:09.152582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:09.152588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.152595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:09.152697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:09.152725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:09.187106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255148977200192:6999]
2025-10-01T14:09:09.187440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 712, pipe: [1:7556255148977200192:6999]
2025-10-01T14:09:09.305158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:09.312499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.312527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.312692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.312753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.312835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.312902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.312948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.312955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.313030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.313089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.313150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.313212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.313262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.313270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.313330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.313381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.313446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.313501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.313542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.313548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.313603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.313658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.313720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.313779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.313827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.313834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.313892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.313949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.314005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.314072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.314116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.314123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.314185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.314241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.314301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.314396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.314450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.314457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.314523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.314585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.314647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.314714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.314763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.314767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.314834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.314898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.314964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.315032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.315084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.315091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.315161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.315223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.315282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.315342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.315383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.315391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.315458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.315523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.315586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.315662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.315708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.315716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.315784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977200192:6999], now have 1 active actors on pipe
2025-10-01T14:09:09.316078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:09.316094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:09.316123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 713 reason: error at write: Disconnected sessionId: src_id|927345bd-c974963e-4f50b578-26134426_0
2025-10-01T14:09:09.316341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 713 sessionId: src_id|927345bd-c974963e-4f50b578-26134426_0 is DEAD
2025-10-01T14:09:09.316423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255148977200192:6999]
2025-10-01T14:09:09.316450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:09.316495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927345bd-c974963e-4f50b578-26134426_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:09.316507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927345bd-c974963e-4f50b578-26134426_0] Write session will restart in 0.008966s
2025-10-01T14:09:09.316546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927345bd-c974963e-4f50b578-26134426_0] Write session: Do CDS request
2025-10-01T14:09:09.316553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927345bd-c974963e-4f50b578-26134426_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:09.317098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:09.326851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|927345bd-c974963e-4f50b578-26134426_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.326920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:09.326938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 714
2025-10-01T14:09:09.327151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.327188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:09.327202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:09.327206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:09.327700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 714 sessionId:  describe result for acl check
2025-10-01T14:09:09.327736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:09.327742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:09.327744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:09.327750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255148977200246:7071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:09.328281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255148977200246:7071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:09.331587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255148977200246:7071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:09.336655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255148977200246:7071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:09.336673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255148977200246:7071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:09.336676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255148977200246:7071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:09.336685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:09.338772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:09.341660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:09.341971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:09.342020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:09.342045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:09.342166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:09.342239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255146600335598:6270]
2025-10-01T14:09:09.343034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:09.343457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:09.343550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:09.344046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:09.344155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.344167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.344168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.344169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.344171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.344172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.344173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.344174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.344176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.344177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.344178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.344180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.344181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.344182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.344190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.344200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.344212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.344217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.344221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.344225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.344230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.344234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.344238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.344242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.344253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.344265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.344269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.344280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.344300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.344309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.344314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.344320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.344333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.344338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.344347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.344352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.344357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.344362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.344370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.344374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.344379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.344385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.344389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.344394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.344400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.344408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.344414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.344419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.344424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.344433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.344437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.344441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.344445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.344449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.344457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.344461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.344500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:09.348942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:09.349797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:09.349811Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:09.349814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:09.349817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:09.349824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 713 [2:7556255146600335598:6270]
2025-10-01T14:09:09.349841Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:09.349859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:09.349867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:09.349870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:09.349872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:09.349889Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:09.349899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:09.349906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:09.349963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.349970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.349972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.349976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:09.349979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:09.350039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:09.350047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.350058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.350067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.350083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:09.350103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977200486:7071], now have 1 active actors on pipe
2025-10-01T14:09:09.350114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977200203:2446], now have 1 active actors on pipe
2025-10-01T14:09:09.350121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255146600335593:6270]
2025-10-01T14:09:09.350124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255146600335593:6270]
2025-10-01T14:09:09.350126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255146600335593:6270]
2025-10-01T14:09:09.350138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:09.350150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:09.350152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:09.350153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:09.350156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:09.350165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:09.350168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:09.350185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 713
2025-10-01T14:09:09.350189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 713
2025-10-01T14:09:09.350198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255146600335593:6270]
2025-10-01T14:09:09.350209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:09.350229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:09.350242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.350247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.350283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:09.350290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:09.350294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:09.350297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:09.350306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:09.350314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:09.350329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:09.350537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.350553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.350575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:09.350654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 714 partition: 0 MaxSeqNo: 45 sessionId: src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0
2025-10-01T14:09:09.351021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|927345bd-c974963e-4f50b578-26134426_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:09.353526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0] Write session: try to update token
2025-10-01T14:09:09.353543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:09.367624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 714 sessionId: src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:09.370076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:09.370300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.370337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.370401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:09.370493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:09.374706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:09.374731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:09.374733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:09.374735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:09.374745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255146600335593:6270]
2025-10-01T14:09:09.374750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255146600335593:6270]
2025-10-01T14:09:09.374754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255146600335593:6270]
2025-10-01T14:09:09.374799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:09.374810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:09.374813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:09.374817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:09.374819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.374821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:09.374979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:09.416501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255148977200500:6999]
2025-10-01T14:09:09.416798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 713, pipe: [1:7556255148977200500:6999]
2025-10-01T14:09:09.526923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:09.535172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.535202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.535384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.535447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.535519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.535590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.535645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.535654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.535725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.535793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.535851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.535917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.535961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.535964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.536036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.536088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.536145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.536200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.536238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.536242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.536302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.536355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.536403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.536452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.536488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.536491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.536551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.536607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.536659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.536712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.536749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.536751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.536828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.536887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.536954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.537012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.537058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.537060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.537126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.537181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.537245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.537304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.537415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.537418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.537478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.537525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.537584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.537643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.537680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.537686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.537759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.537822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.537884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.537944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.537987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.537990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.538052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:09.538111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:09.538172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:09.538229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:09.538269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:09.538272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:09.538326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977200500:6999], now have 1 active actors on pipe
2025-10-01T14:09:09.538955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:09.538967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0] Write session will restart in 0.006735s
2025-10-01T14:09:09.538591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:09.539002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0] Write session: Do CDS request
2025-10-01T14:09:09.538607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:09.539009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:09.538633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 714 reason: error at write: Disconnected sessionId: src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0
2025-10-01T14:09:09.538802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 714 sessionId: src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0 is DEAD
2025-10-01T14:09:09.538933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:09.538958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255148977200500:6999]
2025-10-01T14:09:09.539747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:09.550897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.550977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:09.550996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 715
2025-10-01T14:09:09.551113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.551144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:09.551150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:09.551157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:09.551593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 715 sessionId:  describe result for acl check
2025-10-01T14:09:09.551641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:09.551653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:09.551655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:09.551661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255148977200555:7083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:09.552232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255148977200555:7083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:09.555070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255148977200555:7083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:09.559115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255148977200555:7083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:09.559136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255148977200555:7083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:09.559140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255148977200555:7083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:09.559149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:09.565690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:09.569177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:09.569460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:09.569472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:09.569485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:09.569552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:09.569593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255146600335910:6276]
2025-10-01T14:09:09.570240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:09.570696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:09.570756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:09.571098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:09.571163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.571173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.571174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.571176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.571177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.571178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.571179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.571181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.571182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.571183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.571184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.571185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.571186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.571187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.571209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.571219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.571223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.571227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.571230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.571234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.571238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.571242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.571245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.571250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.571254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.571257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.571261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.571264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.571273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.571288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.571300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.571310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.571320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.571330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.571339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.571349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.571359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.571368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.571372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.571378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.571383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.571393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.571402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.571411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.571416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.571427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.571436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.571442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.571454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.571464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.571469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.571473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.571482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.571491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.571500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.571508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.571555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:09.575692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:09.576711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:09.576730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:09.576733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:09.576737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:09.576746Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 714 [2:7556255146600335910:6276]
2025-10-01T14:09:09.576779Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:09.576802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:09.576814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:09.576817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:09.576820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:09.576837Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:09.576844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:09.576850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:09.576923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.576933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.576935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.576939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:09.576942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:09.577021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:09.577029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.577044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.577062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.577087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:09.577111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255146600335905:6276]
2025-10-01T14:09:09.577119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255146600335905:6276]
2025-10-01T14:09:09.577121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255146600335905:6276]
2025-10-01T14:09:09.577131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:09.577140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:09.577146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:09.577156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:09.577158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:09.577162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:09.577165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:09.577179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977200704:7083], now have 1 active actors on pipe
2025-10-01T14:09:09.577184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977200539:2446], now have 1 active actors on pipe
2025-10-01T14:09:09.577217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255146600335905:6276]
2025-10-01T14:09:09.577230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:09.577241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:09.577250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 714
2025-10-01T14:09:09.577251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 714
2025-10-01T14:09:09.577359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.577372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.577398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|359e5740-f988c8b0-a052b026-42a5a728_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:09.577409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:09.577416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:09.577418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:09.577427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:09.577440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:09.577458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:09.577614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.577621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.577634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:09.577721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 715 partition: 0 MaxSeqNo: 45 sessionId: src_id|359e5740-f988c8b0-a052b026-42a5a728_0
2025-10-01T14:09:09.578103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45ec2b9f-a756aae8-b2d1590d-a3682a38_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|359e5740-f988c8b0-a052b026-42a5a728_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:09.580634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359e5740-f988c8b0-a052b026-42a5a728_0] Write session: try to update token
2025-10-01T14:09:09.580654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359e5740-f988c8b0-a052b026-42a5a728_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:09.595308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 715 sessionId: src_id|359e5740-f988c8b0-a052b026-42a5a728_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:09.597818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:09.598630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.598660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.598682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:09.598691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:09.598693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:09.598695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:09.598704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255146600335905:6276]
2025-10-01T14:09:09.598710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255146600335905:6276]
2025-10-01T14:09:09.598714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255146600335905:6276]
2025-10-01T14:09:09.598744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:09.598759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:09.598763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:09.598775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:09.598781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.598784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:09.598911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:09.639215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255148977200836:6999]
2025-10-01T14:09:09.639490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 714, pipe: [1:7556255148977200836:6999]
2025-10-01T14:09:09.766732Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:09.767318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:09.767390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977200836:6999], now have 1 active actors on pipe
2025-10-01T14:09:09.767452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:09.767555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:09.767607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255148977200836:6999]
2025-10-01T14:09:09.778871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:09.778890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:09.778915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 715 reason: error at write: Disconnected sessionId: src_id|359e5740-f988c8b0-a052b026-42a5a728_0
2025-10-01T14:09:09.779062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 715 sessionId: src_id|359e5740-f988c8b0-a052b026-42a5a728_0 is DEAD
2025-10-01T14:09:09.779480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359e5740-f988c8b0-a052b026-42a5a728_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:09.779492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359e5740-f988c8b0-a052b026-42a5a728_0] Write session will restart in 0.005201s
2025-10-01T14:09:09.779518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359e5740-f988c8b0-a052b026-42a5a728_0] Write session: Do CDS request
2025-10-01T14:09:09.779526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359e5740-f988c8b0-a052b026-42a5a728_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:09.786002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|359e5740-f988c8b0-a052b026-42a5a728_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.786077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:09.786094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 716
2025-10-01T14:09:09.786221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.786254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:09.786264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:09.786269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:09.786945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 716 sessionId:  describe result for acl check
2025-10-01T14:09:09.786989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:09.786991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:09.786993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:09.786998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255148977200908:7088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:09.787509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255148977200908:7088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:09.790525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255148977200908:7088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:09.793605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255148977200908:7088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:09.793623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255148977200908:7088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:09.793626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255148977200908:7088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:09.793634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:09.800550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:09.801094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:09.801279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:09.801290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:09.801300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:09.801346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:09.801387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255146600336234:6288]
2025-10-01T14:09:09.801840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:09.802065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:09.802104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:09.802384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:09.802441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.802448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.802449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.802451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.802452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.802453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.802454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.802455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.802457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.802458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.802467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.802469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.802470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.802471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.802476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.802487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.802491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.802495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.802499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.802504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.802507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.802511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.802515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.802519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.802523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.802527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.802531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.802533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.802540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.802545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:09.802548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.802552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:09.802554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.802560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:09.802563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.802568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:09.802573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.802578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:09.802583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.802588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:09.802593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.802598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:09.802603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.802608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:09.802617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.802623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:09.802631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.802636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.802645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.802651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.802655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.802664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.802669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.802678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:09.802682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.802687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:09.802726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:09.806542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:09.807208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:09.807224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:09.807228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:09.807231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:09.807237Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 715 [2:7556255146600336234:6288]
2025-10-01T14:09:09.807254Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:09.807271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:09.807278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:09.807282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:09.807285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:09.807301Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:09.807306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:09.807313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:09.807364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.807372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.807375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.807379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:09.807381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:09.807450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:09.807462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.807472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:09.807482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:09.807512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:09.807531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977200842:2446], now have 1 active actors on pipe
2025-10-01T14:09:09.807540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977201087:7088], now have 1 active actors on pipe
2025-10-01T14:09:09.807547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255146600336229:6288]
2025-10-01T14:09:09.807553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255146600336229:6288]
2025-10-01T14:09:09.807555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255146600336229:6288]
2025-10-01T14:09:09.807571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:09.807585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:09.807604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:09.807611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:09.807640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255146600336229:6288]
2025-10-01T14:09:09.807609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 715
2025-10-01T14:09:09.807647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:09.807618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 715
2025-10-01T14:09:09.807694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:09.807706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:09.807709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:09.807715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:09.807833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.807844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.807868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c45f348-7dcd97c3-206be898-4d600a78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:09.807880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:09.807884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:09.807886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:09.807898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:09.807908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:09.807926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:09.808123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.808132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.808147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:09.808222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 716 partition: 0 MaxSeqNo: 45 sessionId: src_id|5c45f348-7dcd97c3-206be898-4d600a78_0
2025-10-01T14:09:09.808571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|359e5740-f988c8b0-a052b026-42a5a728_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5c45f348-7dcd97c3-206be898-4d600a78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:09.811073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c45f348-7dcd97c3-206be898-4d600a78_0] Write session: try to update token
2025-10-01T14:09:09.811091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c45f348-7dcd97c3-206be898-4d600a78_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:09.826807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 716 sessionId: src_id|5c45f348-7dcd97c3-206be898-4d600a78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:09.828711Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:09.828730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:09.828733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:09.828735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:09.828745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255146600336229:6288]
2025-10-01T14:09:09.828749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255146600336229:6288]
2025-10-01T14:09:09.828753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255146600336229:6288]
2025-10-01T14:09:09.828808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:09.828812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:09.828819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:09.828819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:09.828821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:09.828823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:09.828951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:09.829218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:09.867575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255148977201139:6999]
2025-10-01T14:09:09.870675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 715, pipe: [1:7556255148977201139:6999]
2025-10-01T14:09:09.981921Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:09.982652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:09.982667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:09.982709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977201139:6999], now have 1 active actors on pipe
2025-10-01T14:09:09.982903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:09.983306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c45f348-7dcd97c3-206be898-4d600a78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:09.983316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c45f348-7dcd97c3-206be898-4d600a78_0] Write session will restart in 0.007578s
2025-10-01T14:09:09.983340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c45f348-7dcd97c3-206be898-4d600a78_0] Write session: Do CDS request
2025-10-01T14:09:09.983345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c45f348-7dcd97c3-206be898-4d600a78_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:09.982904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:09.982916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255148977201139:6999]
2025-10-01T14:09:09.982919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:09.982940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:09.982971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 716 reason: error at write: Disconnected sessionId: src_id|5c45f348-7dcd97c3-206be898-4d600a78_0
2025-10-01T14:09:09.983165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 716 sessionId: src_id|5c45f348-7dcd97c3-206be898-4d600a78_0 is DEAD
2025-10-01T14:09:09.991985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c45f348-7dcd97c3-206be898-4d600a78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.992776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:09.992794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 717
2025-10-01T14:09:09.992912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:09.992945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:09.992954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:09.992958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:09.993516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 717 sessionId:  describe result for acl check
2025-10-01T14:09:09.993555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:09.993562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:09.993564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:09.993569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255148977201182:7092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:09.994085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255148977201182:7092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:09.996387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255148977201182:7092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:10.002367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255148977201182:7092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:10.002398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255148977201182:7092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:10.002401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255148977201182:7092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:10.002410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:10.003612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:10.006425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:10.006880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:10.006893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:10.006907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:10.006992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:10.007034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255150895303824:6291]
2025-10-01T14:09:10.007650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:10.007967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:10.008029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:10.008368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:10.008443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.008449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.008450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.008451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.008453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.008455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.008456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.008457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.008458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.008460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.008461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.008462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.008463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.008464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.008470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.008479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.008494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.008497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.008500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.008505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.008509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.008513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.008516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.008519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.008522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.008525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.008528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.008531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.008538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.008546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.008558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.008576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.008584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.008589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.008593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.008603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.008607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.008613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.008629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.008638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.008644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.008653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.008657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.008667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.008671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.008681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.008685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.008690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.008695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.008701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.008706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.008715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.008720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.008724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.008732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.008737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.008790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:10.012788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:10.013457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:10.013476Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:10.013478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:10.013481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:10.013487Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 716 [2:7556255150895303824:6291]
2025-10-01T14:09:10.013499Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:10.013514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:10.013516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.013519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.013520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.013534Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:10.013539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:10.013544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:10.013589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.013596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.013598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.013600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:10.013602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:10.013657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:10.013663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.013672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.013682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.013692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:10.013710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272168723:7092], now have 1 active actors on pipe
2025-10-01T14:09:10.013720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255150895303818:6291]
2025-10-01T14:09:10.013721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255150895303818:6291]
2025-10-01T14:09:10.013723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255150895303818:6291]
2025-10-01T14:09:10.013732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:10.013741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255148977201145:2446], now have 1 active actors on pipe
2025-10-01T14:09:10.013742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:10.013744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:10.013746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:10.013750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:10.013762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:10.013766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:10.013807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255150895303818:6291]
2025-10-01T14:09:10.013819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:10.013825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:10.013841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 716
2025-10-01T14:09:10.013873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.013884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.013884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 716
2025-10-01T14:09:10.013906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cb4a0c3-291f0668-61724be0-db16c822_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:10.013915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.013919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.013921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:10.013927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.013941Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:10.013964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.014101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.014107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.014117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.014202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 717 partition: 0 MaxSeqNo: 45 sessionId: src_id|8cb4a0c3-291f0668-61724be0-db16c822_0
2025-10-01T14:09:10.014597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c45f348-7dcd97c3-206be898-4d600a78_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8cb4a0c3-291f0668-61724be0-db16c822_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:10.017113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb4a0c3-291f0668-61724be0-db16c822_0] Write session: try to update token
2025-10-01T14:09:10.017134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb4a0c3-291f0668-61724be0-db16c822_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:10.025774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:10.025810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:10.025823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255150895303818:6291]
2025-10-01T14:09:10.025878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:10.026011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:10.026135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:10.026363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:10.026618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:10.026849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:10.027131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:10.027171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:10.032716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 717 sessionId: src_id|8cb4a0c3-291f0668-61724be0-db16c822_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:10.035398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:10.035611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.035644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.035680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:10.035758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:10.044153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:10.044172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:10.044174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:10.044176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:10.044188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255150895303818:6291]
2025-10-01T14:09:10.044191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255150895303818:6291]
2025-10-01T14:09:10.044198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255150895303818:6291]
2025-10-01T14:09:10.044242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:10.044241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:10.044247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.044247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:10.044249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:10.044251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:10.044363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:10.083102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255153272168738:6999]
2025-10-01T14:09:10.083376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 716, pipe: [1:7556255153272168738:6999]
2025-10-01T14:09:10.191801Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:10.200151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.200185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.200352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.200418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.200485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.200547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.200598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.200608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.200671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.200735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.200812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.200875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.200924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.200933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.201005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.201071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.201132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.201194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.201245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.201252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.201320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.201389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.201456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.201809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.201864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.201867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.201932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.201987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.202045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.202102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.202142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.202145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.202211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.202272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.202330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.202480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.202531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.202539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.202608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.202674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.202737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.202800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.202853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.202862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.202921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.202984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.203049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.203111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.203156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.203164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.203228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.203293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.203359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.203423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.203479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.203488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.203555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.203618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.203683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.203749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.204079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:10.204095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:10.204123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 717 reason: error at write: Disconnected sessionId: src_id|8cb4a0c3-291f0668-61724be0-db16c822_0
2025-10-01T14:09:10.204325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 717 sessionId: src_id|8cb4a0c3-291f0668-61724be0-db16c822_0 is DEAD
2025-10-01T14:09:10.204500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb4a0c3-291f0668-61724be0-db16c822_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:10.204491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:10.204515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb4a0c3-291f0668-61724be0-db16c822_0] Write session will restart in 0.006776s
2025-10-01T14:09:10.204535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb4a0c3-291f0668-61724be0-db16c822_0] Write session: Do CDS request
2025-10-01T14:09:10.204540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb4a0c3-291f0668-61724be0-db16c822_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:10.204530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255153272168738:6999]
2025-10-01T14:09:10.203797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.203808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.203871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272168738:6999], now have 1 active actors on pipe
2025-10-01T14:09:10.204735Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:10.212887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb4a0c3-291f0668-61724be0-db16c822_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:10.213012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:10.213036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 718
2025-10-01T14:09:10.213197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:10.213245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:10.213259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:10.213264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:10.213842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 718 sessionId:  describe result for acl check
2025-10-01T14:09:10.213891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:10.213902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:10.213904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:10.213911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255153272168764:7096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:10.214367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255153272168764:7096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:10.220333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255153272168764:7096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:10.224269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255153272168764:7096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:10.224288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255153272168764:7096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:10.224291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255153272168764:7096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:10.224299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:10.231551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:10.234476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:10.234687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:10.234698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:10.234708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:10.234760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:10.234798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255150895304118:6293]
2025-10-01T14:09:10.235358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:10.235682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:10.235727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:10.236011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:10.236064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.236070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.236071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.236072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.236073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.236074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.236075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.236076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.236077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.236079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.236080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.236081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.236082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.236083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.236088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.236097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.236101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.236105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.236108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.236112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.236115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.236119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.236122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.236126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.236129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.236133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.236136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.236139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.236146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.236153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.236159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.236165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.236169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.236175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.236179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.236184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.236188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.236193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.236197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.236203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.236208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.236213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.236217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.236222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.236229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.236233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.236237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.236247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.236252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.236261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.236266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.236275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.236280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.236289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.236293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.236302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.236339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:10.240004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:10.240809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:10.240824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:10.240826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:10.240830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:10.240851Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 717 [2:7556255150895304118:6293]
2025-10-01T14:09:10.240871Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:10.240892Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:10.240899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.240902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.240904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.240919Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:10.240928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:10.240938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:10.240990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.240996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.240997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.241000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:10.241003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:10.241050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:10.241056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.241064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.241070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.241079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:10.241091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255150895304113:6293]
2025-10-01T14:09:10.241092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255150895304113:6293]
2025-10-01T14:09:10.241093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255150895304113:6293]
2025-10-01T14:09:10.241100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:10.241109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:10.241110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:10.241113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:10.241115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:10.241119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:10.241120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:10.241128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272168874:7096], now have 1 active actors on pipe
2025-10-01T14:09:10.241130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272168741:2446], now have 1 active actors on pipe
2025-10-01T14:09:10.241150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255150895304113:6293]
2025-10-01T14:09:10.241157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:10.241170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:10.241176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 717
2025-10-01T14:09:10.241192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 717
2025-10-01T14:09:10.241227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.241234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.241253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:10.241261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.241264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.241266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:10.241272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.241278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:10.241288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.241425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.241441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.241465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.241548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 718 partition: 0 MaxSeqNo: 45 sessionId: src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0
2025-10-01T14:09:10.241885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cb4a0c3-291f0668-61724be0-db16c822_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:10.244435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0] Write session: try to update token
2025-10-01T14:09:10.244452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:10.251708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:10.251729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:10.251738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255150895304113:6293]
2025-10-01T14:09:10.251774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:10.251781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:10.251943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:10.252083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:10.252220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:10.252354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:10.252804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:10.252848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:10.258651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 718 sessionId: src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:10.261091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:10.261277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.261300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.261334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:10.261428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:10.270756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:10.270782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:10.270785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:10.270786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:10.270798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255150895304113:6293]
2025-10-01T14:09:10.270802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255150895304113:6293]
2025-10-01T14:09:10.270806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255150895304113:6293]
2025-10-01T14:09:10.270846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:10.270854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:10.270860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.270860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:10.270862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:10.270866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:10.271003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:10.304836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255153272169050:6999]
2025-10-01T14:09:10.305092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 717, pipe: [1:7556255153272169050:6999]
2025-10-01T14:09:10.430749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:10.438713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.438745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.438919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.438991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.439053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.439115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.439163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.439173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.439240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.439311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.439376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.439442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.439490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.439498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.439561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.439621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.439685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.439748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.439795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.439802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.439869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.439935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.439999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.440065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.440113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.440120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.440187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.440243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.440304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.440369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.440471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.440479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.440544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.440601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.440664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.442171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:10.442196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255153272169050:6999]
2025-10-01T14:09:10.442220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:10.442222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:10.442249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 718 reason: error at write: Disconnected sessionId: src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0
2025-10-01T14:09:10.440725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.440792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.440795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.440865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.440918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.440978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.441034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.441072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.441076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.441135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.441187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.441246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.441301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.441342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.441345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.441406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.441457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.441513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.441569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.441608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.441611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.441673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:10.442440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 718 sessionId: src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0 is DEAD
2025-10-01T14:09:10.441724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:10.441778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:10.441835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:10.441874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:10.441877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:10.441946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272169050:6999], now have 1 active actors on pipe
2025-10-01T14:09:10.442595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:10.442606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0] Write session will restart in 0.008230s
2025-10-01T14:09:10.442632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0] Write session: Do CDS request
2025-10-01T14:09:10.442638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:10.443083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:10.451895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:10.451950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:10.451964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 719
2025-10-01T14:09:10.452104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:10.452133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:10.452139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:10.452146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:10.452514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 719 sessionId:  describe result for acl check
2025-10-01T14:09:10.452557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:10.452564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:10.452566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:10.452571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255153272169070:7101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:10.453195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255153272169070:7101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:10.456160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255153272169070:7101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:10.467193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255153272169070:7101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:10.467212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255153272169070:7101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:10.467215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255153272169070:7101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:10.467224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:10.476922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:10.479804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:10.480019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:10.480030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:10.480041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:10.480097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:10.480137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255150895304428:6297]
2025-10-01T14:09:10.480740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:10.481055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:10.481097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:10.481397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:10.481447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.481453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.481454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.481455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.481456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.481458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.481459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.481460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.481461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.481463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.481464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.481465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.481466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.481467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.481473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.481483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.481487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.481491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.481495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.481499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.481503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.481507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.481511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.481515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.481519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.481523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.481527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.481531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.481537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.481545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.481551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.481561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.481566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.481572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.481576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.481586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.481591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.481601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.481607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.481616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.481621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.481630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.481635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.481641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.481650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.481655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.481663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.481669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.481679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.481685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.481693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.481698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.481702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.481711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.481715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.481722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.481765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:10.487146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:10.488070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:10.488083Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:10.488086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:10.488089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:10.488096Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 718 [2:7556255150895304428:6297]
2025-10-01T14:09:10.488111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:10.488126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:10.488129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.488132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.488134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.488150Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:10.488160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:10.488166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:10.488219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.488225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.488227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.488231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:10.488233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:10.488296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:10.488303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.488315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.488330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.488351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:10.488371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255150895304423:6297]
2025-10-01T14:09:10.488378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255150895304423:6297]
2025-10-01T14:09:10.488380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255150895304423:6297]
2025-10-01T14:09:10.488389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:10.488405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272169055:2446], now have 1 active actors on pipe
2025-10-01T14:09:10.488408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:10.488409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272169214:7101], now have 1 active actors on pipe
2025-10-01T14:09:10.488411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:10.488413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:10.488414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:10.488426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:10.488429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:10.488458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255150895304423:6297]
2025-10-01T14:09:10.488468Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:10.488474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:10.490436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 718
2025-10-01T14:09:10.490495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 718
2025-10-01T14:09:10.490609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.490624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.490655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:10.490671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.490677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.490680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:10.490694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.490709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:10.490732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.491034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.491045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.491064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.491169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 719 partition: 0 MaxSeqNo: 45 sessionId: src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0
2025-10-01T14:09:10.491563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a1f059-b7107cb7-3e34264d-74e7a1cc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:10.494019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0] Write session: try to update token
2025-10-01T14:09:10.494037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:10.509374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 719 sessionId: src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:10.511855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:10.509416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:10.509432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:10.509434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:10.509436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:10.509446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255150895304423:6297]
2025-10-01T14:09:10.509450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255150895304423:6297]
2025-10-01T14:09:10.509453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255150895304423:6297]
2025-10-01T14:09:10.509500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:10.509504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:10.509506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:10.509509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:10.509510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.509512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:10.509638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:10.543323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255153272169392:6999]
2025-10-01T14:09:10.543592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 718, pipe: [1:7556255153272169392:6999]
2025-10-01T14:09:10.656576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:10.656868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.656878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.656920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272169392:6999], now have 1 active actors on pipe
2025-10-01T14:09:10.657265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:10.657287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:10.657292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:10.657334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255153272169392:6999]
2025-10-01T14:09:10.657349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 719 reason: error at write: Disconnected sessionId: src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0
2025-10-01T14:09:10.657528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 719 sessionId: src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0 is DEAD
2025-10-01T14:09:10.657838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:10.657846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0] Write session will restart in 0.007330s
2025-10-01T14:09:10.657864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0] Write session: Do CDS request
2025-10-01T14:09:10.657872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:10.657339Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:10.665896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:10.666039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:10.666054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 720
2025-10-01T14:09:10.666193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:10.666222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:10.666232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:10.666235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:10.666636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 720 sessionId:  describe result for acl check
2025-10-01T14:09:10.666667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:10.666668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:10.666669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:10.666673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255153272169411:7113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:10.667446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255153272169411:7113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:10.672828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255153272169411:7113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:10.676695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255153272169411:7113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:10.676714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255153272169411:7113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:10.676717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255153272169411:7113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:10.676726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:10.682119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:10.685703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:10.685946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:10.685956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:10.685967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:10.686025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:10.686062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255150895304732:6301]
2025-10-01T14:09:10.686653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:10.687014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:10.687077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:10.687383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:10.687441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.687442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.687443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.687444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.687445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.687446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.687447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.687447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.687448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.687449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.687450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.687450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.687451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.687451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.687456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.687461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.687463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.687466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.687468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.687470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.687472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.687474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.687476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.687479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.687481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.687483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.687485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.687487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.687494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.687499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.687504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.687507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.687509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.687512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.687517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.687520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.687523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.687527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.687532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.687536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.687540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.687544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.687548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.687553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.687558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.687563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.687567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.687571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.687576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.687580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.687584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.687589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.687593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.687598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.687601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.687606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.687643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:10.691629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:10.692254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:10.692266Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:10.692268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:10.692272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:10.692279Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 719 [2:7556255150895304732:6301]
2025-10-01T14:09:10.692296Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:10.692312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:10.692320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.692323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.692326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.692342Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:10.692351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:10.692358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:10.692415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.692421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.692423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.692426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:10.692429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:10.692493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:10.692499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.692512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.692525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.692545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:10.692569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272169395:2446], now have 1 active actors on pipe
2025-10-01T14:09:10.692576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272169604:7113], now have 1 active actors on pipe
2025-10-01T14:09:10.692583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255150895304727:6301]
2025-10-01T14:09:10.692589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255150895304727:6301]
2025-10-01T14:09:10.692591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255150895304727:6301]
2025-10-01T14:09:10.692603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:10.692616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:10.692623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:10.692626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:10.692629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:10.692629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:10.692631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:10.692599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 719
2025-10-01T14:09:10.692624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 719
2025-10-01T14:09:10.692662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255150895304727:6301]
2025-10-01T14:09:10.692671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:10.692673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:10.692702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.692707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.692739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51713875-ef2b607b-534f9498-523127dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:10.692745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.692749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.692751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:10.692777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.692786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:10.692803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.692936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.692943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.692964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.693044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 720 partition: 0 MaxSeqNo: 45 sessionId: src_id|51713875-ef2b607b-534f9498-523127dd_0
2025-10-01T14:09:10.693412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36391f1d-ee9ce883-f46166a9-3cf86434_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|51713875-ef2b607b-534f9498-523127dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:10.695913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51713875-ef2b607b-534f9498-523127dd_0] Write session: try to update token
2025-10-01T14:09:10.695932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51713875-ef2b607b-534f9498-523127dd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:10.710246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 720 sessionId: src_id|51713875-ef2b607b-534f9498-523127dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:10.712905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:10.713308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.713330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.713351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:10.713355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:10.713357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:10.713359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:10.713368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255150895304727:6301]
2025-10-01T14:09:10.713373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255150895304727:6301]
2025-10-01T14:09:10.713377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255150895304727:6301]
2025-10-01T14:09:10.713414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:10.713425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:10.713428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:10.713431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:10.713437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.713440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:10.713586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:10.757442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255153272169700:6999]
2025-10-01T14:09:10.757785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 719, pipe: [1:7556255153272169700:6999]
2025-10-01T14:09:10.864856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:10.865511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:10.865568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272169700:6999], now have 1 active actors on pipe
2025-10-01T14:09:10.865650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:10.865997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:10.866044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255153272169700:6999]
2025-10-01T14:09:10.876378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:10.876391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:10.876410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 720 reason: error at write: Disconnected sessionId: src_id|51713875-ef2b607b-534f9498-523127dd_0
2025-10-01T14:09:10.876532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 720 sessionId: src_id|51713875-ef2b607b-534f9498-523127dd_0 is DEAD
2025-10-01T14:09:10.876681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51713875-ef2b607b-534f9498-523127dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:10.876691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51713875-ef2b607b-534f9498-523127dd_0] Write session will restart in 0.008477s
2025-10-01T14:09:10.876714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51713875-ef2b607b-534f9498-523127dd_0] Write session: Do CDS request
2025-10-01T14:09:10.876723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51713875-ef2b607b-534f9498-523127dd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:10.886881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51713875-ef2b607b-534f9498-523127dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:10.886971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:10.886987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 721
2025-10-01T14:09:10.887126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:10.887176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:10.887187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:10.887195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:10.887690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 721 sessionId:  describe result for acl check
2025-10-01T14:09:10.887741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:10.887746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:10.887748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:10.887754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255153272169809:7118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:10.888205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255153272169809:7118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:10.891422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255153272169809:7118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:10.896317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:10.896339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255153272169809:7118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:10.896357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255153272169809:7118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:10.896361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255153272169809:7118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:10.896369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:10.899703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:10.900029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:10.900039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:10.900052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:10.900112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:10.900151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255150895305060:6314]
2025-10-01T14:09:10.900779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:10.901095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:10.901140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:10.901452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:10.901515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.901521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.901522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.901523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.901524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.901525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.901526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.901527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.901529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.901530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.901531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.901532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.901533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.901535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.901550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.901561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.901564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.901568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.901572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.901576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.901580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.901583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.901587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.901591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.901594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.901598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.901602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.901606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.901624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.901631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:10.901639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.901645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:10.901651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.901656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:10.901660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.901665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:10.901674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.901679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:10.901688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.901692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:10.901699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.901704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:10.901707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.901712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:10.901722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.901727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:10.901733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.901737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.901742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.901749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.901753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.901757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.901766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.901770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:10.901775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.901783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:10.901834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:10.905661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:10.906558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:10.906570Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:10.906572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:10.906576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:10.906582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 720 [2:7556255150895305060:6314]
2025-10-01T14:09:10.906600Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:10.906619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:10.906622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.906626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.906628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.906644Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:10.906649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:10.906655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:10.906717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.906723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.906725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.906728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:10.906731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:10.906793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:10.906802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.906814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:10.906825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:10.906842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:10.906862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272169994:7118], now have 1 active actors on pipe
2025-10-01T14:09:10.906870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272169705:2446], now have 1 active actors on pipe
2025-10-01T14:09:10.906878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255150895305054:6314]
2025-10-01T14:09:10.906879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255150895305054:6314]
2025-10-01T14:09:10.906881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255150895305054:6314]
2025-10-01T14:09:10.906893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:10.906907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:10.906910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:10.906912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:10.906913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:10.906927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:10.906933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:10.906961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255150895305054:6314]
2025-10-01T14:09:10.906926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 720
2025-10-01T14:09:10.906969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:10.906972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:10.906946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 720
2025-10-01T14:09:10.906985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.906990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.907037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:10.907047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:10.907051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:10.907054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:10.907062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:10.907073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:10.907094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.907300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.907311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.907333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:10.907418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 721 partition: 0 MaxSeqNo: 45 sessionId: src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0
2025-10-01T14:09:10.907771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51713875-ef2b607b-534f9498-523127dd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:10.910147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0] Write session: try to update token
2025-10-01T14:09:10.910163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:10.924471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 721 sessionId: src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:10.926820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:10.927165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:10.927000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:10.927032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:10.927106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:10.929234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:10.929239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:10.929241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:10.929243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:10.929251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255150895305054:6314]
2025-10-01T14:09:10.929254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255150895305054:6314]
2025-10-01T14:09:10.929257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255150895305054:6314]
2025-10-01T14:09:10.929301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:10.929306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:10.929307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:10.929311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:10.929319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:10.929323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:10.929437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:10.966318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255153272170010:6999]
2025-10-01T14:09:10.966577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 720, pipe: [1:7556255153272170010:6999]
2025-10-01T14:09:11.076463Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:11.085139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.085173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.085359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.085425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.085492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.085555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.085597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.085602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.085674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.085730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.085798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.085867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.085918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.085927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.085987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.086044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.086106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.086165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.086210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.086218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.086274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.086331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.086407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.086471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.086514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.086521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.086585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.086647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.086709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.086768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.086813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.086818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.088539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255153272170010:6999]
2025-10-01T14:09:11.088546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:11.088550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:11.088577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:11.088585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 721 reason: error at write: Disconnected sessionId: src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0
2025-10-01T14:09:11.088948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:11.088958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0] Write session will restart in 0.007676s
2025-10-01T14:09:11.088934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 721 sessionId: src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0 is DEAD
2025-10-01T14:09:11.088982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0] Write session: Do CDS request
2025-10-01T14:09:11.088990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:11.086883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.086942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.087007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.087063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.087102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.087105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.087167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.087223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.087283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.087341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.087386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.087389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.087451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.087503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.087554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.087612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.087662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.087666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.087733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.087791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.087848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.087911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.087954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.087957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.088022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.088078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.088137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.088193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.088232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.088235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.088305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255153272170010:6999], now have 1 active actors on pipe
2025-10-01T14:09:11.089459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:11.097882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.097984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:11.097999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 722
2025-10-01T14:09:11.098102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.098136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:11.098146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:11.098149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:11.098560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 722 sessionId:  describe result for acl check
2025-10-01T14:09:11.098597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:11.098599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:11.098600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:11.098605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255157567137334:7122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:11.099161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255157567137334:7122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:11.102004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255157567137334:7122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:11.105797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255157567137334:7122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:11.105812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255157567137334:7122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:11.105815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255157567137334:7122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:11.105824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:11.111272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:11.114301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:11.114568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:11.114579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:11.114593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:11.114665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:11.114712Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255155190272654:6316]
2025-10-01T14:09:11.115346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:11.115693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:11.115755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:11.116233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:11.116530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.116536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.116536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.116537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.116538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.116539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.116539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.116541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.116541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.116542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.116542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.116543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.116544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.116545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.116549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.116556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.116559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.116562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.116564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.116566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.116568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.116570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.116572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.116577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.116579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.116581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.116584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.116586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.116592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.116597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.116601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.116605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.116607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.116611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.116613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.116616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.116619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.116622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.116625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.116628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.116631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.116633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.116636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.116639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.116642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.116645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.116649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.116652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.116655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.116657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.116660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.116663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.116666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.116671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.116675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.116679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.116716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:11.125855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:11.126488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:11.126503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:11.126506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:11.126509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:11.126517Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 721 [2:7556255155190272654:6316]
2025-10-01T14:09:11.126534Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:11.126555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:11.126562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.126566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.126569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.126589Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:11.126599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:11.126605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:11.126667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.126673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.126675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.126679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:11.126682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:11.126754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:11.126761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.126773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.126787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.126807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:11.126830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255155190272649:6316]
2025-10-01T14:09:11.126836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255155190272649:6316]
2025-10-01T14:09:11.126838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255155190272649:6316]
2025-10-01T14:09:11.126853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:11.126872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567137491:7122], now have 1 active actors on pipe
2025-10-01T14:09:11.126876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:11.126879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567137307:2446], now have 1 active actors on pipe
2025-10-01T14:09:11.126880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:11.126882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:11.126887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:11.126900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:11.126903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:11.126942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255155190272649:6316]
2025-10-01T14:09:11.126954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:11.126962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:11.126961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 721
2025-10-01T14:09:11.126994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 721
2025-10-01T14:09:11.127095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.127106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.127134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:11.127141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.127146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.127148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:11.127157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.127165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:11.127180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.127344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.127353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.127366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.127451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 722 partition: 0 MaxSeqNo: 45 sessionId: src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0
2025-10-01T14:09:11.127778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ce51dd-1aae2cdb-cbe078de-b49bf6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:11.130179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0] Write session: try to update token
2025-10-01T14:09:11.130194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:11.143804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 722 sessionId: src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:11.146506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:11.147189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.147212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.147233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:11.147242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:11.147245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:11.147247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:11.147255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255155190272649:6316]
2025-10-01T14:09:11.147260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255155190272649:6316]
2025-10-01T14:09:11.147264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255155190272649:6316]
2025-10-01T14:09:11.147314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:11.147324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:11.147325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:11.147329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:11.147331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.147334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:11.147467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:11.188525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255157567137613:6999]
2025-10-01T14:09:11.188836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 721, pipe: [1:7556255157567137613:6999]
2025-10-01T14:09:11.297185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:11.297628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:11.297694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567137613:6999], now have 1 active actors on pipe
2025-10-01T14:09:11.297758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:11.297993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:11.298043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255157567137613:6999]
2025-10-01T14:09:11.310602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:11.310620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:11.310650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 722 reason: error at write: Disconnected sessionId: src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0
2025-10-01T14:09:11.310865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 722 sessionId: src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0 is DEAD
2025-10-01T14:09:11.310932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:11.310942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0] Write session will restart in 0.005212s
2025-10-01T14:09:11.310967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0] Write session: Do CDS request
2025-10-01T14:09:11.310976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:11.316884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.316969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:11.316983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 723
2025-10-01T14:09:11.317124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.317165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:11.317175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:11.317179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:11.317577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 723 sessionId:  describe result for acl check
2025-10-01T14:09:11.317609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:11.317615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:11.317617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:11.317622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255157567137687:7127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:11.318061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255157567137687:7127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:11.322173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255157567137687:7127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:11.326129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255157567137687:7127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:11.326148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255157567137687:7127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:11.326151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255157567137687:7127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:11.326159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:11.329097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:11.332380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:11.332599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:11.332607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:11.332618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:11.332687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:11.332724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255155190272954:6318]
2025-10-01T14:09:11.333337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:11.333625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:11.333692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:11.333945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:11.333987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.333991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.333992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.333993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.333994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.333995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.333995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.333996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.333997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.333997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.333998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.333999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.333999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.334000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.334004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.334009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.334012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.334014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.334016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.334019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.334021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.334023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.334025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.334027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.334029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.334031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.334033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.334035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.334041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.334045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.334049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.334052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.334055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.334058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.334060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.334063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.334066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.334068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.334071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.334074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.334076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.334079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.334082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.334085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.334088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.334091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.334093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.334096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.334098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.334103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.334105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.334108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.334110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.334113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.334115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.334118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.334139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:11.337850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:11.338871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:11.338885Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:11.338887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:11.338890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:11.338897Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 722 [2:7556255155190272954:6318]
2025-10-01T14:09:11.338918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:11.338936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:11.338942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.338946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.338948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.338965Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:11.338973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:11.338980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:11.339042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.339048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.339050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.339053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:11.339055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:11.339119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:11.339129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.339141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.339151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.339164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:11.339181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567137623:2446], now have 1 active actors on pipe
2025-10-01T14:09:11.339185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567137902:7127], now have 1 active actors on pipe
2025-10-01T14:09:11.339192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255155190272949:6318]
2025-10-01T14:09:11.339194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255155190272949:6318]
2025-10-01T14:09:11.339196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255155190272949:6318]
2025-10-01T14:09:11.339210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:11.339223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:11.339232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:11.339234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:11.339235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:11.339237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:11.339238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:11.339272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255155190272949:6318]
2025-10-01T14:09:11.339281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:11.339296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:11.339272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 722
2025-10-01T14:09:11.339325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 722
2025-10-01T14:09:11.339416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.339426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.339447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:11.339458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.339462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.339464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:11.339474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.339487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:11.339505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.339705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.339724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.339749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.339827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 723 partition: 0 MaxSeqNo: 45 sessionId: src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0
2025-10-01T14:09:11.340197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c56185b-cff9c4eb-40eb0f92-b9e87551_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:11.342553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0] Write session: try to update token
2025-10-01T14:09:11.342582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:11.350764Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:11.350782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:11.350793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255155190272949:6318]
2025-10-01T14:09:11.350843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:11.350843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:11.351025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:11.351166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:11.351317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:11.351471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:11.352128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:11.352185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:11.357463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 723 sessionId: src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:11.359966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:11.360146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.360170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.360207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:11.360296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:11.369873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:11.369891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:11.369894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:11.369896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:11.369906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255155190272949:6318]
2025-10-01T14:09:11.369909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255155190272949:6318]
2025-10-01T14:09:11.369913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255155190272949:6318]
2025-10-01T14:09:11.369962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:11.369977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.369979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:11.370026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:11.370032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:11.370036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:11.370121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:11.398466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255157567137932:6999]
2025-10-01T14:09:11.398745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 722, pipe: [1:7556255157567137932:6999]
2025-10-01T14:09:11.521775Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:11.530059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.530086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.530252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.530317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.530403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.530472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.530524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.530530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.530605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.530672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.530739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.530802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.530857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.530868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.530944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.531015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.531085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.531153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.531204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.531212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.531280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.531570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.531638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.531705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.531748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.531751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.531817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.531880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.531943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.532004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.532053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.532060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.532127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.532195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.532264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.532332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.532388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.532401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.532476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.532537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.532602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.532677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.532738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.532748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.532832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.532902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.532967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.533042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.533090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.533101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.533175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.533241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.533304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.533370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.533422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.533429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.533502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:11.533569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:11.533635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:11.533694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:11.533743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:11.533751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:11.533825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567137932:6999], now have 1 active actors on pipe
2025-10-01T14:09:11.534078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:11.534131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:11.534139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:11.534167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 723 reason: error at write: Disconnected sessionId: src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0
2025-10-01T14:09:11.534367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 723 sessionId: src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0 is DEAD
2025-10-01T14:09:11.534505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:11.534516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0] Write session will restart in 0.005993s
2025-10-01T14:09:11.534541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0] Write session: Do CDS request
2025-10-01T14:09:11.534547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:11.534573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255157567137932:6999]
2025-10-01T14:09:11.534797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:11.541885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.541972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:11.541990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 724
2025-10-01T14:09:11.542114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.542146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:11.542151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:11.542155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:11.542670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 724 sessionId:  describe result for acl check
2025-10-01T14:09:11.542707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:11.542713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:11.542715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:11.542719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255157567137981:7138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:11.543188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255157567137981:7138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:11.546156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255157567137981:7138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:11.550255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255157567137981:7138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:11.550270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255157567137981:7138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:11.550273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255157567137981:7138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:11.550282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:11.556311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:11.559897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:11.560148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:11.560152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:11.560165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:11.560230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:11.560267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255155190273277:6322]
2025-10-01T14:09:11.560871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:11.561207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:11.561254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:11.561568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:11.561623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.561629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.561630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.561631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.561632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.561633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.561634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.561635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.561636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.561637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.561638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.561640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.561641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.561642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.561648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.561657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.561660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.561664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.561669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.561672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.561676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.561681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.561684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.561688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.561692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.561695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.561699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.561702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.561709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.561717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.561723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.561730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.561735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.561741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.561750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.561756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.561760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.561765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.561773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.561778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.561784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.561794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.561798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.561807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.561813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.561822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.561827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.561833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.561843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.561848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.561854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.561863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.561867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.561872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.561881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.561887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.561932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:11.566228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:11.567130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:11.567144Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:11.567146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:11.567148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:11.567153Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 723 [2:7556255155190273277:6322]
2025-10-01T14:09:11.567165Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:11.567178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:11.567180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.567182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.567184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.567197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:11.567201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:11.567206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:11.567249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.567254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.567255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.567258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:11.567260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:11.567321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:11.567328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.567338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.567348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.567366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:11.567387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567138138:7138], now have 1 active actors on pipe
2025-10-01T14:09:11.567395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567137961:2446], now have 1 active actors on pipe
2025-10-01T14:09:11.567402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255155190273272:6322]
2025-10-01T14:09:11.567408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255155190273272:6322]
2025-10-01T14:09:11.567409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255155190273272:6322]
2025-10-01T14:09:11.567422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:11.567433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:11.567437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:11.567440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:11.567442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:11.567450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:11.567453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:11.567483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255155190273272:6322]
2025-10-01T14:09:11.567497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:11.567508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:11.567531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.567544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.567577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:11.567588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.567597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.567599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:11.567607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.567616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:11.567634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.567795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.567802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.567817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.568288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f79738cc-5377b697-2b6a2cfe-9982b77c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:11.567477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 723
2025-10-01T14:09:11.567492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 723
2025-10-01T14:09:11.567911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 724 partition: 0 MaxSeqNo: 45 sessionId: src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0
2025-10-01T14:09:11.570808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0] Write session: try to update token
2025-10-01T14:09:11.570824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:11.586006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 724 sessionId: src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:11.588423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:11.588443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:11.588445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:11.588447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:11.588458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255155190273272:6322]
2025-10-01T14:09:11.588463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255155190273272:6322]
2025-10-01T14:09:11.588466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255155190273272:6322]
2025-10-01T14:09:11.588516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:11.588518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:11.588525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:11.588527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.588529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:11.588530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:11.588526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:11.588675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:11.634449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255157567138278:6999]
2025-10-01T14:09:11.634663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 723, pipe: [1:7556255157567138278:6999]
2025-10-01T14:09:11.737079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:11.737627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.737646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.737691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567138278:6999], now have 1 active actors on pipe
2025-10-01T14:09:11.737921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:11.737952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255157567138278:6999]
2025-10-01T14:09:11.737986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:11.738336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:11.738418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 724 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0
2025-10-01T14:09:11.738739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:11.738749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0] Write session will restart in 0.007990s
2025-10-01T14:09:11.738772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0] Write session: Do CDS request
2025-10-01T14:09:11.738778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:11.738585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 724 sessionId: src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0 is DEAD
2025-10-01T14:09:11.747895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.747959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:11.747978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 725
2025-10-01T14:09:11.748086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.748119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:11.748132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:11.748136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:11.748667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 725 sessionId:  describe result for acl check
2025-10-01T14:09:11.748701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:11.748703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:11.748705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:11.748711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255157567138326:7144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:11.749272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255157567138326:7144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:11.752195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255157567138326:7144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:11.756228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255157567138326:7144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:11.756245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255157567138326:7144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:11.756248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255157567138326:7144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:11.756256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:11.761620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:11.764807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:11.765005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:11.765013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:11.765022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:11.765059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:11.765088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255155190273578:6326]
2025-10-01T14:09:11.765545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:11.765925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:11.765975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:11.766264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:11.766336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.766346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.766347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.766348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.766349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.766350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.766351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.766353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.766354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.766355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.766356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.766357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.766358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.766359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.766365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.766389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.766392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.766396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.766400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.766405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.766409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.766412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.766415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.766418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.766422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.766426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.766429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.766432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.766439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.766445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.766451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.766456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.766461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.766466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.766471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.766476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.766480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.766485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.766490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.766495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.766499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.766504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.766507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.766512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.766517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.766522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.766525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.766530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.766535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.766540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.766546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.766550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.766554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.766558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.766566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.766570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.766606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:11.770289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:11.771030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:11.771046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:11.771048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:11.771052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:11.771058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 724 [2:7556255155190273578:6326]
2025-10-01T14:09:11.771074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:11.771089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:11.771092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.771096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.771098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.771115Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:11.771126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:11.771132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:11.771196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.771203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.771205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.771208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:11.771211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:11.771274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:11.771281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.771292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.771303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.771320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:11.771340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567138495:7144], now have 1 active actors on pipe
2025-10-01T14:09:11.771350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567138282:2446], now have 1 active actors on pipe
2025-10-01T14:09:11.771358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255155190273573:6326]
2025-10-01T14:09:11.771361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255155190273573:6326]
2025-10-01T14:09:11.771362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255155190273573:6326]
2025-10-01T14:09:11.771377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:11.771389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:11.771402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:11.771405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:11.771412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:11.771419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:11.771421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:11.771387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 724
2025-10-01T14:09:11.771403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 724
2025-10-01T14:09:11.771435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255155190273573:6326]
2025-10-01T14:09:11.771444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:11.771453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:11.771462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.771471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.771516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:11.771529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.771533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.771536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:11.771545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.771552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:11.771570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.771685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.771692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.771704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.771779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 725 partition: 0 MaxSeqNo: 45 sessionId: src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0
2025-10-01T14:09:11.772105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac6c655-45c96453-8970ef2-95ccc5fe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:11.774489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0] Write session: try to update token
2025-10-01T14:09:11.774507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:11.788746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 725 sessionId: src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:11.791192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:11.791814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.791835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.791856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:11.791859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:11.791862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:11.791864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:11.791872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255155190273573:6326]
2025-10-01T14:09:11.791877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255155190273573:6326]
2025-10-01T14:09:11.791882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255155190273573:6326]
2025-10-01T14:09:11.791927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:11.791936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:11.791936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:11.791939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:11.791942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.791945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:11.792079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:11.838238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255157567138591:6999]
2025-10-01T14:09:11.838823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 724, pipe: [1:7556255157567138591:6999]
2025-10-01T14:09:11.938104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:11.938330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:11.938400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567138591:6999], now have 1 active actors on pipe
2025-10-01T14:09:11.938549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:11.938637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:11.938645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:11.938713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 725 reason: error at write: Disconnected sessionId: src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0
2025-10-01T14:09:11.938716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:11.938775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255157567138591:6999]
2025-10-01T14:09:11.938923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:11.938837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 725 sessionId: src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0 is DEAD
2025-10-01T14:09:11.938933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0] Write session will restart in 0.007216s
2025-10-01T14:09:11.938967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0] Write session: Do CDS request
2025-10-01T14:09:11.938975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:11.946815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.946895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:11.946914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 726
2025-10-01T14:09:11.947108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:11.947145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:11.947151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:11.947157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:11.947564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 726 sessionId:  describe result for acl check
2025-10-01T14:09:11.947587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:11.947588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:11.947589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:11.947593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255157567138608:7148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:11.948075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255157567138608:7148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:11.950478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255157567138608:7148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:11.956297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255157567138608:7148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:11.956315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255157567138608:7148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:11.956318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255157567138608:7148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:11.956327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:11.960967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:11.964049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:11.964297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:11.964309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:11.964323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:11.964390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:11.964450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255155190273911:6339]
2025-10-01T14:09:11.965042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:11.965413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:11.965468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:11.965772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:11.965860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.965866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.965868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.965869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.965870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.965871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.965872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.965873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.965874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.965875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.965876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.965877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.965878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.965879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.965885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.965895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.965899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.965902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.965906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.965909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.965913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.965916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.965919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.965923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.965926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.965929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.965933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.965936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.965944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.965952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:11.965958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.965963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:11.965970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.965974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:11.965978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.965982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:11.965989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.965993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:11.965997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.966002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:11.966007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.966011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:11.966015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.966019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:11.966030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.966036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:11.966040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.966045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.966050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.966056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.966064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.966068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.966073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.966082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:11.966085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.966090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:11.966128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:11.970043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:11.970971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:11.970989Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:11.970993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:11.970998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:11.971006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 725 [2:7556255155190273911:6339]
2025-10-01T14:09:11.971025Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:11.971043Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:11.971050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.971054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.971056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.971074Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:11.971085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:11.971091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:11.971161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.971169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.971172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.971176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:11.971179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:11.971258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:11.971265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.971280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:11.971297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:11.971320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:11.971344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567138803:7148], now have 1 active actors on pipe
2025-10-01T14:09:11.971354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255157567138593:2446], now have 1 active actors on pipe
2025-10-01T14:09:11.971362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255155190273906:6339]
2025-10-01T14:09:11.971365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255155190273906:6339]
2025-10-01T14:09:11.971368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255155190273906:6339]
2025-10-01T14:09:11.971383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:11.971401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:11.971430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:11.971439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:11.971426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 725
2025-10-01T14:09:11.971426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 725
2025-10-01T14:09:11.971477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255155190273906:6339]
2025-10-01T14:09:11.971485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:11.971506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:11.971514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:11.971516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:11.971523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:11.971682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.971693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.971722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:11.971737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:11.971742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:11.971745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:11.971757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:11.971769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:11.971790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.971971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:11.971981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:11.971998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:11.972108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 726 partition: 0 MaxSeqNo: 45 sessionId: src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0
2025-10-01T14:09:11.972490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f85c4120-4ba0dd8f-2088b88f-b33cf300_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:11.975129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0] Write session: try to update token
2025-10-01T14:09:11.975147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:11.993476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:11.993499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:11.993502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:11.993504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:11.993513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255155190273906:6339]
2025-10-01T14:09:11.993521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255155190273906:6339]
2025-10-01T14:09:11.993525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255155190273906:6339]
2025-10-01T14:09:11.993579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:11.993579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:11.993586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:11.993590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:11.993592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:11.993595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:11.993719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:11.993927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 726 sessionId: src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:11.996444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:12.038965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255161862106202:6999]
2025-10-01T14:09:12.039227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 725, pipe: [1:7556255161862106202:6999]
2025-10-01T14:09:12.140950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:12.141244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.141265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.141322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862106202:6999], now have 1 active actors on pipe
2025-10-01T14:09:12.141515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:12.141656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255161862106202:6999]
2025-10-01T14:09:12.141694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:12.141914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 726 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0
2025-10-01T14:09:12.141967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:12.142083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 726 sessionId: src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0 is DEAD
2025-10-01T14:09:12.142228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:12.142239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0] Write session will restart in 0.008484s
2025-10-01T14:09:12.142264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0] Write session: Do CDS request
2025-10-01T14:09:12.142270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:12.151945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.152021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:12.152041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 727
2025-10-01T14:09:12.152261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.152306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:12.152317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:12.152320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:12.152863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 727 sessionId:  describe result for acl check
2025-10-01T14:09:12.152900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:12.152925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:12.152926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:12.152933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255161862106219:7154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:12.153457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255161862106219:7154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:12.155773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255161862106219:7154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:12.159963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255161862106219:7154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:12.159978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255161862106219:7154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:12.159980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255161862106219:7154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:12.159987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:12.166356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:12.169443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:12.169670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:12.169686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:12.169698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:12.169751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:12.169789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255159485241511:6341]
2025-10-01T14:09:12.170415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:12.170924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:12.170976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:12.171326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:12.171383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.171390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.171391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.171392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.171394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.171395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.171396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.171398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.171399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.171400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.171402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.171403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.171405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.171406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.171412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.171423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.171427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.171431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.171434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.171439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.171443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.171447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.171450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.171455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.171458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.171461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.171465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.171468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.171475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.171483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.171490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.171496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.171504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.171509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.171514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.171519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.171533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.171543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.171548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.171559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.171564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.171573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.171576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.171581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.171584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.171589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.171598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.171603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.171612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.171618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.171623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.171628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.171632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.171637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.171645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.171651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.171690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:12.175720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:12.176463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:12.176476Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:12.176478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:12.176481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:12.176489Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 726 [2:7556255159485241511:6341]
2025-10-01T14:09:12.176506Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:12.176525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:12.176528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:12.176531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:12.176533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:12.176550Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:12.176562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:12.176569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:12.176627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.176634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.176636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.176639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:12.176642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:12.176709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:12.176716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.176728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.176869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 726
2025-10-01T14:09:12.176876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 726
2025-10-01T14:09:12.176742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.176774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:12.176793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862106362:7154], now have 1 active actors on pipe
2025-10-01T14:09:12.176796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862106205:2446], now have 1 active actors on pipe
2025-10-01T14:09:12.176803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255159485241506:6341]
2025-10-01T14:09:12.176806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255159485241506:6341]
2025-10-01T14:09:12.176808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255159485241506:6341]
2025-10-01T14:09:12.176821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:12.176835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:12.176844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:12.176848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:12.176849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:12.176850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:12.176852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:12.176890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255159485241506:6341]
2025-10-01T14:09:12.176893Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:12.176916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:12.176941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.176947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.176973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5508b2a-ca271886-1565c0d0-3e347442_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:12.176979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:12.176984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:12.176986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:12.176996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:12.177005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:12.177019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:12.177220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.177234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.177259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:12.177370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 727 partition: 0 MaxSeqNo: 45 sessionId: src_id|b5508b2a-ca271886-1565c0d0-3e347442_0
2025-10-01T14:09:12.177754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadd6b11-7a2b77c9-b55d5d79-1c6b2657_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b5508b2a-ca271886-1565c0d0-3e347442_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:12.180406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5508b2a-ca271886-1565c0d0-3e347442_0] Write session: try to update token
2025-10-01T14:09:12.180429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5508b2a-ca271886-1565c0d0-3e347442_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:12.194460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:12.194480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:12.194491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255159485241506:6341]
2025-10-01T14:09:12.194545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:12.194620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:12.194729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:12.194879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:12.195028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:12.195182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:12.195384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:12.195432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:12.196066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 727 sessionId: src_id|b5508b2a-ca271886-1565c0d0-3e347442_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:12.198652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:12.198847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.198865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.198900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:12.199022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:12.208434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:12.208454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:12.208457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:12.208458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:12.208470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255159485241506:6341]
2025-10-01T14:09:12.208473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255159485241506:6341]
2025-10-01T14:09:12.208479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255159485241506:6341]
2025-10-01T14:09:12.208532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:12.208533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:12.208538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.208540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:12.208541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:12.208544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:12.208676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:12.241712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255161862106516:6999]
2025-10-01T14:09:12.242004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 726, pipe: [1:7556255161862106516:6999]
2025-10-01T14:09:12.362287Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:12.370720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.370746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.370916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.370971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.371028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.371082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.371127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.371134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.371192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.371241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.371294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.371346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.371392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.371397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.371455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.371513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.371567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.371625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.371663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.371671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.371730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.371783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.371836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.371890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.371932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.371933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.371990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.372042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.372097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.372163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.372205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.372210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.372267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.372319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.372375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.372435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.372479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.372484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.372541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.372591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.372647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.372706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.372747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.372753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.372826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.372876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.372929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.372978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.373019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.373026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.373084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.373137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.373194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.373249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.373293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.373298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.373354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.373405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.373459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.373511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.373549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.373555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.373609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862106516:6999], now have 1 active actors on pipe
2025-10-01T14:09:12.373857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:12.373869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:12.373892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 727 reason: error at write: Disconnected sessionId: src_id|b5508b2a-ca271886-1565c0d0-3e347442_0
2025-10-01T14:09:12.373909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:12.373967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255161862106516:6999]
2025-10-01T14:09:12.374089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 727 sessionId: src_id|b5508b2a-ca271886-1565c0d0-3e347442_0 is DEAD
2025-10-01T14:09:12.374201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5508b2a-ca271886-1565c0d0-3e347442_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:12.374208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5508b2a-ca271886-1565c0d0-3e347442_0] Write session will restart in 0.008108s
2025-10-01T14:09:12.374248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5508b2a-ca271886-1565c0d0-3e347442_0] Write session: Do CDS request
2025-10-01T14:09:12.374255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5508b2a-ca271886-1565c0d0-3e347442_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:12.374808Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:12.383910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5508b2a-ca271886-1565c0d0-3e347442_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.383967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:12.383984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 728
2025-10-01T14:09:12.384123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.384156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:12.384165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:12.384168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:12.384637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 728 sessionId:  describe result for acl check
2025-10-01T14:09:12.384682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:12.384689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:12.384690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:12.384696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255161862106578:7159] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:12.385277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255161862106578:7159] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:12.388049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255161862106578:7159] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:12.391875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255161862106578:7159] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:12.391895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255161862106578:7159] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:12.391924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255161862106578:7159] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:12.391936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:12.395320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:12.398118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:12.398333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:12.398350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:12.398362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:12.398423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:12.398463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255159485241818:6344]
2025-10-01T14:09:12.399056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:12.399389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:12.399451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:12.399778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:12.399842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.399848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.399849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.399851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.399852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.399853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.399854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.399855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.399856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.399857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.399858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.399859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.399860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.399861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.399866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.399875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.399885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.399889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.399892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.399895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.399899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.399902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.399906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.399910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.399914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.399918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.399922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.399926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.399933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.399940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.399945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.399951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.399961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.399965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.399973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.399977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.399982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.399986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.399993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.399998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.400002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.400007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.400014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.400019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.400023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.400032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.400036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.400041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.400045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.400049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.400057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.400061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.400065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.400073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.400077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.400083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.400121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:12.403978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:12.404843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:12.404856Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:12.404858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:12.404861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:12.404867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 727 [2:7556255159485241818:6344]
2025-10-01T14:09:12.404882Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:12.404903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:12.404910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:12.404914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:12.404916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:12.404933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:12.404942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:12.404956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:12.405016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.405022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.405024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.405027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:12.405030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:12.405096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:12.405102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.405113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.405123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.405142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:12.405163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862106527:2446], now have 1 active actors on pipe
2025-10-01T14:09:12.405175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862106777:7159], now have 1 active actors on pipe
2025-10-01T14:09:12.405182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255159485241813:6344]
2025-10-01T14:09:12.405184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255159485241813:6344]
2025-10-01T14:09:12.405186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255159485241813:6344]
2025-10-01T14:09:12.405199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:12.405210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:12.405217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:12.405223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:12.405225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:12.405226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:12.405227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:12.405257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255159485241813:6344]
2025-10-01T14:09:12.405264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:12.405246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 727
2025-10-01T14:09:12.405249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 727
2025-10-01T14:09:12.405287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:12.405300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.405304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.405331Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:12.405343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:12.405346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:12.405353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:12.405361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:12.405369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:12.405387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:12.405512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.405520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.405534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:12.405593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 728 partition: 0 MaxSeqNo: 45 sessionId: src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0
2025-10-01T14:09:12.405947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5508b2a-ca271886-1565c0d0-3e347442_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:12.408325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0] Write session: try to update token
2025-10-01T14:09:12.408342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:12.422481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 728 sessionId: src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:12.424896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:12.425944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.425968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.425987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:12.425990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:12.425992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:12.425993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:12.426002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255159485241813:6344]
2025-10-01T14:09:12.426005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255159485241813:6344]
2025-10-01T14:09:12.426010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255159485241813:6344]
2025-10-01T14:09:12.426047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:12.426058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:12.426061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:12.426066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:12.426074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.426076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:12.426315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:12.474135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255161862106839:6999]
2025-10-01T14:09:12.474415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 727, pipe: [1:7556255161862106839:6999]
2025-10-01T14:09:12.573865Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:12.574389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:12.574443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862106839:6999], now have 1 active actors on pipe
2025-10-01T14:09:12.574537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:12.585764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:12.585779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:12.585801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 728 reason: error at write: Disconnected sessionId: src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0
2025-10-01T14:09:12.585928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 728 sessionId: src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0 is DEAD
2025-10-01T14:09:12.586017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:12.586027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0] Write session will restart in 0.007573s
2025-10-01T14:09:12.586049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0] Write session: Do CDS request
2025-10-01T14:09:12.586054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:12.586272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:12.586315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255161862106839:6999]
2025-10-01T14:09:12.594880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.594924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:12.594940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 729
2025-10-01T14:09:12.595118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.595161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:12.595170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:12.595176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:12.595570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 729 sessionId:  describe result for acl check
2025-10-01T14:09:12.595601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:12.595607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:12.595608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:12.595612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255161862107027:7171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:12.596418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255161862107027:7171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:12.598765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255161862107027:7171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:12.601339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:12.604449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:12.605185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:12.605181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255161862107027:7171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:12.605201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255161862107027:7171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:12.605204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255161862107027:7171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:12.605197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:12.605213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:12.605209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:12.605272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:12.605313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255159485242150:6347]
2025-10-01T14:09:12.605813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:12.606107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:12.606152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:12.606435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:12.606506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.606511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.606512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.606512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.606513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.606514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.606515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.606515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.606516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.606517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.606517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.606518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.606519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.606519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.606523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.606529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.606531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.606533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.606535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.606537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.606539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.606541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.606543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.606545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.606547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.606548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.606550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.606552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.606557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.606563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.606568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.606573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.606577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.606582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.606596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.606601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.606605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.606611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.606615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.606620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.606625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.606630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.606634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.606641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.606645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.606650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.606654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.606659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.606664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.606669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.606673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.606678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.606682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.606687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.606691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.606696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.606717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:12.610464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:12.611423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:12.611433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:12.611434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:12.611436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:12.611440Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 728 [2:7556255159485242150:6347]
2025-10-01T14:09:12.611454Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:12.611470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:12.611476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:12.611480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:12.611482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:12.611502Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:12.611509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:12.611514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:12.611563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.611573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.611574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.611578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:12.611580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:12.611639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:12.611646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.611656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.611666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.611683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:12.611704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862107177:7171], now have 1 active actors on pipe
2025-10-01T14:09:12.611711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862106911:2446], now have 1 active actors on pipe
2025-10-01T14:09:12.611718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255159485242141:6347]
2025-10-01T14:09:12.611724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255159485242141:6347]
2025-10-01T14:09:12.611727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255159485242141:6347]
2025-10-01T14:09:12.611737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:12.611745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:12.611747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:12.611756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:12.611763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:12.611779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 728
2025-10-01T14:09:12.611785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 728
2025-10-01T14:09:12.611774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:12.611780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:12.611810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255159485242141:6347]
2025-10-01T14:09:12.611812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:12.611815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:12.611826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.611831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.611876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5df5e64-da2d4966-17979ff0-e78257e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:12.611883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:12.611887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:12.611889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:12.611896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:12.611905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:12.611920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:12.612068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.612075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.612088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:12.612180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 729 partition: 0 MaxSeqNo: 45 sessionId: src_id|5df5e64-da2d4966-17979ff0-e78257e5_0
2025-10-01T14:09:12.612471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ebb7fe-85077b37-e9defe1-d9e5ed9e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5df5e64-da2d4966-17979ff0-e78257e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:12.614794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5e64-da2d4966-17979ff0-e78257e5_0] Write session: try to update token
2025-10-01T14:09:12.614813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5e64-da2d4966-17979ff0-e78257e5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:12.628374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 729 sessionId: src_id|5df5e64-da2d4966-17979ff0-e78257e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:12.631040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:12.632313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.632337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.632356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:12.632359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:12.632362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:12.632364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:12.632372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255159485242141:6347]
2025-10-01T14:09:12.632377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255159485242141:6347]
2025-10-01T14:09:12.632381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255159485242141:6347]
2025-10-01T14:09:12.632422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:12.632431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:12.632436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.632437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:12.632445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:12.632449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:12.632556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:12.686647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255161862107191:6999]
2025-10-01T14:09:12.686991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 728, pipe: [1:7556255161862107191:6999]
2025-10-01T14:09:12.779522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:12.780019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:12.780089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862107191:6999], now have 1 active actors on pipe
2025-10-01T14:09:12.780607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5e64-da2d4966-17979ff0-e78257e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:12.780616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5e64-da2d4966-17979ff0-e78257e5_0] Write session will restart in 0.009903s
2025-10-01T14:09:12.780634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5e64-da2d4966-17979ff0-e78257e5_0] Write session: Do CDS request
2025-10-01T14:09:12.780640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5e64-da2d4966-17979ff0-e78257e5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:12.780197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:12.780284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:12.780287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:12.780361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 729 reason: error at write: Disconnected sessionId: src_id|5df5e64-da2d4966-17979ff0-e78257e5_0
2025-10-01T14:09:12.780482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 729 sessionId: src_id|5df5e64-da2d4966-17979ff0-e78257e5_0 is DEAD
2025-10-01T14:09:12.780641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:12.780672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255161862107191:6999]
2025-10-01T14:09:12.790510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:12.791866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5e64-da2d4966-17979ff0-e78257e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.791987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:12.792012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 730
2025-10-01T14:09:12.792106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:12.792117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.792150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:12.792159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:12.792162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:12.792324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:12.792334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:12.792347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:12.792403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:12.792458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255159485242209:6351]
2025-10-01T14:09:12.792522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 730 sessionId:  describe result for acl check
2025-10-01T14:09:12.792552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:12.792557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:12.792559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:12.792564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255161862107214:7176] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:12.793057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:12.793059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255161862107214:7176] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:12.793397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:12.793455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:12.793780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:12.793841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.793847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.793849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.793850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.793851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.793852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.793853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.793854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.793855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.793857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.793858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.793859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.793860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.793862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.793869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.793877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.793882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.793886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.793889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.793893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.793897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.793900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.793904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.793908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.793911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.793914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.793918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.793922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.793929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.793936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:12.793941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.793946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:12.793951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.793956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:12.793960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.793965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:12.793969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.793973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:12.793977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.793982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:12.793986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.793996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:12.794000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.794005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:12.794014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.794020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:12.794028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.794032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.794040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.794045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.794048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.794057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.794061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.794066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:12.794075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.794080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:12.794117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:12.794939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255161862107214:7176] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:12.797516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255161862107214:7176] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:12.797530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255161862107214:7176] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:12.797534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255161862107214:7176] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:12.797541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:12.797750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:12.798666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:12.798680Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:12.798683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:12.798687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:12.798694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 729 [2:7556255159485242209:6351]
2025-10-01T14:09:12.798708Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:12.798723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:12.798726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:12.798729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:12.798732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:12.798746Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:12.798757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:12.798763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:12.798815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.798818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.798819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.798822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:12.798826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:12.798885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:12.798892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.798903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:12.798912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:12.798926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:12.798942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862107252:7176], now have 1 active actors on pipe
2025-10-01T14:09:12.798950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862107193:2446], now have 1 active actors on pipe
2025-10-01T14:09:12.798958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255159485242203:6351]
2025-10-01T14:09:12.798964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255159485242203:6351]
2025-10-01T14:09:12.798965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255159485242203:6351]
2025-10-01T14:09:12.798979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:12.798994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:12.798995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:12.798998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:12.799000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:12.799013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:12.799015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:12.799043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255159485242203:6351]
2025-10-01T14:09:12.799053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:12.799062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:12.799085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 729
2025-10-01T14:09:12.799108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 729
2025-10-01T14:09:12.799196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.799207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.799233Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73f51b74-8ae0c012-4e6d254a-487746b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:12.799243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:12.799253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:12.799255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:12.799263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:12.799279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:12.799298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:12.799431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.799438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.799450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:12.799549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 730 partition: 0 MaxSeqNo: 45 sessionId: src_id|73f51b74-8ae0c012-4e6d254a-487746b_0
2025-10-01T14:09:12.799891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df5e64-da2d4966-17979ff0-e78257e5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|73f51b74-8ae0c012-4e6d254a-487746b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:12.802328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73f51b74-8ae0c012-4e6d254a-487746b_0] Write session: try to update token
2025-10-01T14:09:12.802343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73f51b74-8ae0c012-4e6d254a-487746b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:12.810163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:12.810181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:12.810190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255159485242203:6351]
2025-10-01T14:09:12.810233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:12.810236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:12.810506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:12.810654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:12.810812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:12.810959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:12.811158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:12.811205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:12.816943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 730 sessionId: src_id|73f51b74-8ae0c012-4e6d254a-487746b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:12.819588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:12.819798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.819816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.819862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:12.819955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:12.829553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:12.829569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:12.829572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:12.829574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:12.829586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255159485242203:6351]
2025-10-01T14:09:12.829590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255159485242203:6351]
2025-10-01T14:09:12.829594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255159485242203:6351]
2025-10-01T14:09:12.829639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:12.829640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:12.829646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:12.829647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:12.829648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:12.829650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:12.829776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:12.880678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255161862107259:6999]
2025-10-01T14:09:12.880913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 729, pipe: [1:7556255161862107259:6999]
2025-10-01T14:09:12.976403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:12.984718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:12.984753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:12.984932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.985004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.985075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.985139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.985184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.985194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.985265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.985328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.985389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.985454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.985500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.985510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.985583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.985646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.985712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.985778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.985828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.985835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.985905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.985969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.986035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.986101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.986152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.986159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.986229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.986294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.986357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.986437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.988263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:12.988275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255161862107259:6999]
2025-10-01T14:09:12.988300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:12.988302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:12.988328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 730 reason: error at write: Disconnected sessionId: src_id|73f51b74-8ae0c012-4e6d254a-487746b_0
2025-10-01T14:09:12.988503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 730 sessionId: src_id|73f51b74-8ae0c012-4e6d254a-487746b_0 is DEAD
2025-10-01T14:09:12.988921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f51b74-8ae0c012-4e6d254a-487746b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:12.988931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f51b74-8ae0c012-4e6d254a-487746b_0] Write session will restart in 0.007725s
2025-10-01T14:09:12.988949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f51b74-8ae0c012-4e6d254a-487746b_0] Write session: Do CDS request
2025-10-01T14:09:12.988954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f51b74-8ae0c012-4e6d254a-487746b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:12.986492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.986503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.986578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.986643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.986701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.986759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.986800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.986803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.986873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.986925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.986989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.987049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.987088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.987091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.987154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.987208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.987263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.987318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.987356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.987358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.987426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.987482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.987546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.987604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.987643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.987645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.987707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:12.987758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:12.987813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:12.987866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:12.987906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:12.987910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:12.987992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862107259:6999], now have 1 active actors on pipe
2025-10-01T14:09:12.989130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:12.996826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:12.997861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73f51b74-8ae0c012-4e6d254a-487746b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.998235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:12.998254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 731
2025-10-01T14:09:12.998363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:12.998359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:12.998427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:12.998437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:12.998440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:12.998578Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:12.998589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:12.998600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:12.998697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:12.998732Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255159485242298:6364]
2025-10-01T14:09:12.998791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 731 sessionId:  describe result for acl check
2025-10-01T14:09:12.998821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:12.998827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:12.998828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:12.998832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255161862107283:7180] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:12.999314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:12.999631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:12.999681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:12.999351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255161862107283:7180] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:13.000020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:13.000074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.000082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.000084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.000084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.000085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.000086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.000087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.000088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.000090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.000091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.000092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.000093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.000094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.000095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.000101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.000109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.000112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.000117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.000121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.000124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.000127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.000130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.000133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.000137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.000139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.000142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.000146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.000149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.000156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.000164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.000170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.000174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.000178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.000182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.000185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.000189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.000193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.000197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.000200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.000204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.000208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.000212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.000217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.000221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.000225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.000229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.000232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.000236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.000240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.000244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.000247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.000251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.000254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.000258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.000261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.000265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.000297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:13.001587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255161862107283:7180] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:13.004097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:13.004778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255161862107283:7180] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:13.004795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255161862107283:7180] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:13.004798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255161862107283:7180] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:13.004806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:13.005172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:13.005188Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:13.005191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:13.005195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:13.005268Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 730 [2:7556255159485242298:6364]
2025-10-01T14:09:13.005295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:13.005332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:13.005336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.005341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.005343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.005365Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:13.005374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:13.005392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:13.005465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.005479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.005482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.005486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:13.005488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:13.005588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:13.005606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.005620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.005640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.005665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:13.005699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255159485242293:6364]
2025-10-01T14:09:13.005702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255159485242293:6364]
2025-10-01T14:09:13.005705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255159485242293:6364]
2025-10-01T14:09:13.005725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:13.005729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:13.005731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:13.005734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:13.005757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:13.005774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:13.005778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:13.005828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 730
2025-10-01T14:09:13.005832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 730
2025-10-01T14:09:13.005793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074614:7180], now have 1 active actors on pipe
2025-10-01T14:09:13.005807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255161862107264:2446], now have 1 active actors on pipe
2025-10-01T14:09:13.005852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255159485242293:6364]
2025-10-01T14:09:13.005857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:13.005868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:13.005903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.005912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.005953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:13.005981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.005995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.006005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:13.006017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.006039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:13.006061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.006219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.006236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.006260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.006335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 731 partition: 0 MaxSeqNo: 45 sessionId: src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0
2025-10-01T14:09:13.006681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73f51b74-8ae0c012-4e6d254a-487746b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:13.009130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0] Write session: try to update token
2025-10-01T14:09:13.009150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:13.022645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 731 sessionId: src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:13.025354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:13.026321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.026344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.026363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:13.026367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:13.026393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:13.026396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:13.026405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255159485242293:6364]
2025-10-01T14:09:13.026409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255159485242293:6364]
2025-10-01T14:09:13.026414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255159485242293:6364]
2025-10-01T14:09:13.026457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:13.026468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:13.026472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:13.026474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.026476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:13.026477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:13.026611Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:13.088055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255166157074622:6999]
2025-10-01T14:09:13.088318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 730, pipe: [1:7556255166157074622:6999]
2025-10-01T14:09:13.170540Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:13.170830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:13.170885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074622:6999], now have 1 active actors on pipe
2025-10-01T14:09:13.170954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:13.171063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:13.171119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255166157074622:6999]
2025-10-01T14:09:13.179237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:13.180685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:13.180899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:13.180913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:13.180926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:13.180990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:13.181051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255163780209653:6366]
2025-10-01T14:09:13.181434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:13.181448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:13.181469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 731 reason: error at write: Disconnected sessionId: src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0
2025-10-01T14:09:13.181611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 731 sessionId: src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0 is DEAD
2025-10-01T14:09:13.181621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:13.181735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:13.181742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0] Write session will restart in 0.005546s
2025-10-01T14:09:13.181770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0] Write session: Do CDS request
2025-10-01T14:09:13.181776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:13.188267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:13.188355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:13.188714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:13.188787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.188793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.188794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.188795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.188796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.188797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.188799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.188800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.188801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.188802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.188803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.188804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.188805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.188806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.188813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.188824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.188828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.188832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.188836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.188840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.188843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.188848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.188852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.188856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.188859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.188863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.188866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.188870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.188877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.188885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.188891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.188896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.188900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.188905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.188909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.188912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.188916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.188921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.188924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.188928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.188933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.188938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.188942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.188946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.188951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.188956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.188960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.188973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.188965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.188969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.188974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.188978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.188983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.188986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.188991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.188994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.188999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.188993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:13.189013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 732
2025-10-01T14:09:13.189037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:13.189194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.189237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:13.189250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:13.189252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:13.189661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 732 sessionId:  describe result for acl check
2025-10-01T14:09:13.189701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:13.189719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:13.189721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:13.189726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255166157074650:7184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:13.190276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255166157074650:7184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:13.192588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255166157074650:7184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:13.193018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:13.193771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:13.193787Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:13.193789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:13.193793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:13.193802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 731 [2:7556255163780209653:6366]
2025-10-01T14:09:13.193817Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:13.193839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:13.193847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.193851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.193857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.193875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:13.193885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:13.193895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:13.193960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.193968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.193970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.193973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:13.193975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:13.194042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:13.194050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.194060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.194065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.194076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:13.194091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074625:2446], now have 1 active actors on pipe
2025-10-01T14:09:13.194099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255163780209648:6366]
2025-10-01T14:09:13.194100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255163780209648:6366]
2025-10-01T14:09:13.194102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255163780209648:6366]
2025-10-01T14:09:13.194115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:13.194124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:13.194130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:13.194132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:13.194134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:13.194148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:13.194155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:13.194148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 731
2025-10-01T14:09:13.194190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255163780209648:6366]
2025-10-01T14:09:13.194201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:13.194206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:13.199103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255166157074650:7184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:13.199121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255166157074650:7184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:13.199125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255166157074650:7184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:13.199134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:13.199401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074688:7184], now have 1 active actors on pipe
2025-10-01T14:09:13.199432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 731
2025-10-01T14:09:13.199492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.199510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.199539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:13.199557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.199564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.199567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:13.199578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.199594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:13.199617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.199850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.199860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.199876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.199956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 732 partition: 0 MaxSeqNo: 45 sessionId: src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0
2025-10-01T14:09:13.200269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1e00d69-7e1d0873-a6a5a458-858a1ed1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:13.202857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0] Write session: try to update token
2025-10-01T14:09:13.202875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:13.205169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:13.205189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:13.205199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255163780209648:6366]
2025-10-01T14:09:13.205242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:13.205246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:13.205428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:13.205573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:13.205718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:13.205865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:13.206055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:13.206091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:13.217612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 732 sessionId: src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:13.220165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:13.220504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.220524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.220569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:13.220686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:13.224776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:13.224792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:13.224794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:13.224797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:13.224807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255163780209648:6366]
2025-10-01T14:09:13.224810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255163780209648:6366]
2025-10-01T14:09:13.224813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255163780209648:6366]
2025-10-01T14:09:13.224861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:13.224864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:13.224869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.224870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:13.224871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:13.224874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:13.225000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:13.271308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255166157074696:6999]
2025-10-01T14:09:13.271557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 731, pipe: [1:7556255166157074696:6999]
2025-10-01T14:09:13.371734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:13.378895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.378920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.379060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.379107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.379158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.379208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.379248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.379254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.379306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.379354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.379404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.379458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.379659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.379670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.379731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.379781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.379832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.379884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.379924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.379929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.379985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.380037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.380121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.380178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.380227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.380235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.380298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.380357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.380420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.380474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.380513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.380518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.380572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.380630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.380691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.380746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.380803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.380810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.380868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.380924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.380984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.381049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.381094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.381101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.381164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.381219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.381273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.381324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.381366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.381371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.381428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.381476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.381530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.381583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.381622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.381627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.381686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.381749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.381806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.381864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.381903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.381908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.381948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074696:6999], now have 1 active actors on pipe
2025-10-01T14:09:13.382188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255166157074696:6999]
2025-10-01T14:09:13.382200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:13.382204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:13.382222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:13.382227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 732 reason: error at write: Disconnected sessionId: src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0
2025-10-01T14:09:13.382366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 732 sessionId: src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0 is DEAD
2025-10-01T14:09:13.382521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:13.382530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0] Write session will restart in 0.007524s
2025-10-01T14:09:13.382557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0] Write session: Do CDS request
2025-10-01T14:09:13.382563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:13.382685Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:13.390891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.390930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:13.390947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 733
2025-10-01T14:09:13.390823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:13.391108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.391170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:13.391180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:13.391184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:13.391611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 733 sessionId:  describe result for acl check
2025-10-01T14:09:13.391650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:13.391657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:13.391659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:13.391664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255166157074722:7189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:13.392199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255166157074722:7189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:13.392241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:13.392439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:13.392452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:13.392464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:13.392521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:13.392565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255163780209716:6369]
2025-10-01T14:09:13.393139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:13.393386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:13.393439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:13.393765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:13.393847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.393855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.393856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.393858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.393859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.393860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.393861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.393862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.393863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.393865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.393866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.393867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.393869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.393869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.393875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.393884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.393889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.393893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.393897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.393900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.393904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.393907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.393911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.393915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.393918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.393922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.393925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.393928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.393935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.393948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.393958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.393967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.393976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.393984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.393993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.394001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.394010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.394018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.394025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.394030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.394038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.394047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.394051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.394056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.394064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.394070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.394078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.394108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.394117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.394121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.394125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.394130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.394134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.394142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.394146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.394155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.394197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:13.394562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255166157074722:7189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:13.397600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255166157074722:7189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:13.397614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255166157074722:7189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:13.397617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255166157074722:7189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:13.397622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:13.397808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:13.398409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:13.398422Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:13.398425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:13.398430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:13.398437Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 732 [2:7556255163780209716:6369]
2025-10-01T14:09:13.398452Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:13.398472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:13.398479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.398482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.398484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.398499Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:13.398507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:13.398517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:13.398573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.398583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.398585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.398588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:13.398591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:13.398656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:13.398665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.398676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.398692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.398715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:13.398737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074762:7189], now have 1 active actors on pipe
2025-10-01T14:09:13.398745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074702:2446], now have 1 active actors on pipe
2025-10-01T14:09:13.398751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255163780209711:6369]
2025-10-01T14:09:13.398758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255163780209711:6369]
2025-10-01T14:09:13.398761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255163780209711:6369]
2025-10-01T14:09:13.398773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:13.398786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:13.398789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:13.398794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:13.398796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:13.398804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:13.398808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:13.398792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 732
2025-10-01T14:09:13.398795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 732
2025-10-01T14:09:13.398832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255163780209711:6369]
2025-10-01T14:09:13.398840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:13.398843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:13.398856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.398861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.398907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:13.398913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.398917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.398919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:13.398927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.398934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:13.398957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.399107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.399114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.399129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.399243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 733 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0
2025-10-01T14:09:13.399579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b3cbfb-8c034e81-7e9ad6e9-71414c65_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:13.401967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0] Write session: try to update token
2025-10-01T14:09:13.401983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:13.415954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 733 sessionId: src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:13.418348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:13.418793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:13.418490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.418515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.418555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:13.420774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:13.420793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:13.420796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:13.420797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:13.420806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255163780209711:6369]
2025-10-01T14:09:13.420811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255163780209711:6369]
2025-10-01T14:09:13.420815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255163780209711:6369]
2025-10-01T14:09:13.420860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:13.420864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:13.420870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.420873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:13.420874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:13.420878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:13.421003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:13.482263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255166157074770:6999]
2025-10-01T14:09:13.482579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 732, pipe: [1:7556255166157074770:6999]
2025-10-01T14:09:13.571118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:13.578019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.578048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.578199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.578255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.578320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.578394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.578438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.578449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.578518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.578584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.578648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.578714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.578850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.578859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.578918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.578975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.579033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.579085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.579122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.579128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.579179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.579234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.579292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.579351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.579394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.579401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.579460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.579514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.579575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.579638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.579682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.579689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.579751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.579810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.579873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.579948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.580002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.580009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.580072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.580139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.580199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.580264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.580313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.580321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.581525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:13.581590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255166157074770:6999]
2025-10-01T14:09:13.580384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.580441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.580527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.580589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.580637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.580640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.580704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.580774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.580831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.580893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.580934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.580937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.581003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.581061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.581123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.581182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.581223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.581226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.581280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074770:6999], now have 1 active actors on pipe
2025-10-01T14:09:13.581758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:13.581771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:13.581798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 733 reason: error at write: Disconnected sessionId: src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0
2025-10-01T14:09:13.581996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 733 sessionId: src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0 is DEAD
2025-10-01T14:09:13.582119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:13.582130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0] Write session will restart in 0.005638s
2025-10-01T14:09:13.582155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0] Write session: Do CDS request
2025-10-01T14:09:13.582162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:13.582461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:13.588915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.588962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:13.588979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 734
2025-10-01T14:09:13.589119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.589151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:13.589156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:13.589160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:13.589582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 734 sessionId:  describe result for acl check
2025-10-01T14:09:13.589624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:13.589626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:13.589628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:13.589633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255166157074794:7194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:13.590159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255166157074794:7194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:13.592587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255166157074794:7194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:13.593342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:13.594824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:13.595048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:13.595058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:13.595070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:13.595114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255166157074794:7194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:13.595128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255166157074794:7194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:13.595131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255166157074794:7194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:13.595127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:13.595138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:13.595168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255163780209789:6372]
2025-10-01T14:09:13.595758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:13.596057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:13.596109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:13.596415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:13.596480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.596486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.596488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.596489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.596490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.596491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.596493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.596494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.596495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.596497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.596498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.596499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.596501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.596502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.596508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.596517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.596521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.596525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.596529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.596537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.596541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.596546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.596555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.596559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.596567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.596570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.596574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.596578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.596584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.596596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.596606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.596611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.596619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.596625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.596633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.596640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.596647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.596652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.596656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.596661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.596665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.596671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.596678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.596683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.596687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.596692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.596696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.596701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.596706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.596711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.596715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.596720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.596724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.596736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.596740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.596745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.596797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:13.600491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:13.601094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:13.601109Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:13.601111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:13.601114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:13.601120Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 733 [2:7556255163780209789:6372]
2025-10-01T14:09:13.601133Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:13.601149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:13.601151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.601155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.601157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.601172Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:13.601182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:13.601188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:13.601240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.601247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.601249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.601251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:13.601254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:13.601318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:13.601325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.601334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.601340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.601348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:13.601359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255163780209784:6372]
2025-10-01T14:09:13.601364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255163780209784:6372]
2025-10-01T14:09:13.601365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255163780209784:6372]
2025-10-01T14:09:13.601370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:13.601379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074840:7194], now have 1 active actors on pipe
2025-10-01T14:09:13.601381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:13.601381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074784:2446], now have 1 active actors on pipe
2025-10-01T14:09:13.601383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:13.601385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:13.601387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:13.601395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:13.601397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:13.601418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255163780209784:6372]
2025-10-01T14:09:13.601422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:13.601432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:13.601453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 733
2025-10-01T14:09:13.601485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 733
2025-10-01T14:09:13.601494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.601502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.601527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:13.601538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.601542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.601546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:13.601553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.601565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:13.601581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.601705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.601711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.601724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.601791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 734 partition: 0 MaxSeqNo: 45 sessionId: src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0
2025-10-01T14:09:13.602126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a4a5048-c190c74d-1e13ed8b-19f75fb1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:13.604398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0] Write session: try to update token
2025-10-01T14:09:13.604412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:13.617910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 734 sessionId: src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:13.620493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:13.621724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.621747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.621768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:13.621771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:13.621774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:13.621777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:13.621786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255163780209784:6372]
2025-10-01T14:09:13.621791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255163780209784:6372]
2025-10-01T14:09:13.621795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255163780209784:6372]
2025-10-01T14:09:13.621837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:13.621849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:13.621851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:13.621853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:13.621857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.621860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:13.621987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:13.681965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255166157074877:6999]
2025-10-01T14:09:13.682221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 733, pipe: [1:7556255166157074877:6999]
2025-10-01T14:09:13.775134Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:13.775565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:13.775622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074877:6999], now have 1 active actors on pipe
2025-10-01T14:09:13.775704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:13.775794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:13.775840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255166157074877:6999]
2025-10-01T14:09:13.786339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:13.787645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:13.787655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0] Write session will restart in 0.007195s
2025-10-01T14:09:13.787678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0] Write session: Do CDS request
2025-10-01T14:09:13.787685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:13.787302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:13.787318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:13.787339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 734 reason: error at write: Disconnected sessionId: src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0
2025-10-01T14:09:13.787467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 734 sessionId: src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0 is DEAD
2025-10-01T14:09:13.794033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:13.794284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:13.794300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:13.794313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:13.794390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:13.794432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255163780209859:6376]
2025-10-01T14:09:13.795041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:13.795377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:13.795434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:13.795714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:13.795781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.795789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.795791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.795792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.795794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.795795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.795796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.795799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.795801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.795802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.795803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.795804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.795805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.795806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.795812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.795822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.795825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.795829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.795833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.795836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.795840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.795844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.795848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.795852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.795856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.795859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.795863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.795867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.795874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.795881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:13.795901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.795886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.795891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:13.795895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.795900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:13.795903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.795908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:13.795912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.795916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:13.795921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.795925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:13.795929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.795933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:13.795936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.795940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:13.795944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.795949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:13.795954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.795959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.795964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.795969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.795973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.795978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.795982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.795987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:13.795994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.795998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:13.795995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:13.796013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 735
2025-10-01T14:09:13.796036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:13.796133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.796163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:13.796173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:13.796176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:13.797070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 735 sessionId:  describe result for acl check
2025-10-01T14:09:13.797113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:13.797120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:13.797122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:13.797127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255166157074908:7206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:13.797672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255166157074908:7206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:13.799956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:13.800093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255166157074908:7206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:13.800566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:13.800579Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:13.800581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:13.800585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:13.800591Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 734 [2:7556255163780209859:6376]
2025-10-01T14:09:13.800604Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:13.800619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:13.800626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.800629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.800631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.800648Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:13.800659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:13.800665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:13.800714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.800723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.800725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.800728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:13.800731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:13.800808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:13.800816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.800827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:13.800838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:13.800860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:13.800881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074879:2446], now have 1 active actors on pipe
2025-10-01T14:09:13.800894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255163780209853:6376]
2025-10-01T14:09:13.800901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255163780209853:6376]
2025-10-01T14:09:13.800903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255163780209853:6376]
2025-10-01T14:09:13.800914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:13.800925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:13.800929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:13.800919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 734
2025-10-01T14:09:13.800933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:13.800936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:13.800944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:13.800947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:13.800979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255163780209853:6376]
2025-10-01T14:09:13.800989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:13.800994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:13.806180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255166157074908:7206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:13.806196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255166157074908:7206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:13.806200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255166157074908:7206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:13.806208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:13.806444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074946:7206], now have 1 active actors on pipe
2025-10-01T14:09:13.806486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 734
2025-10-01T14:09:13.806547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.806564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.806593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:13.806608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:13.806617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:13.806621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:13.806635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:13.806655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:13.806673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.806809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.806816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.806828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:13.806887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 735 partition: 0 MaxSeqNo: 45 sessionId: src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0
2025-10-01T14:09:13.807197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e22ae1-dfe6d3cf-d4c36530-c9ed679b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:13.809747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0] Write session: try to update token
2025-10-01T14:09:13.809766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:13.811440Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:13.811457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:13.811467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255163780209853:6376]
2025-10-01T14:09:13.811512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:13.811512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:13.811680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:13.811821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:13.811952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:13.812087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:13.812264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:13.812298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:13.823355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 735 sessionId: src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:13.826063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:13.826291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.826314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.826353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:13.826457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:13.830685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:13.830698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:13.830700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:13.830701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:13.830711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255163780209853:6376]
2025-10-01T14:09:13.830716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255163780209853:6376]
2025-10-01T14:09:13.830721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255163780209853:6376]
2025-10-01T14:09:13.830762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:13.830764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:13.830770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:13.830773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:13.830777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:13.830780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:13.830895Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:13.876022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255166157074949:6999]
2025-10-01T14:09:13.876332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 734, pipe: [1:7556255166157074949:6999]
2025-10-01T14:09:13.979198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:13.987271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:13.987296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:13.987436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.987487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.987540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.987591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.987632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.987642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.987705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.987753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.987805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.987858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.987901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.987907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.987975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.988026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.988083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.988148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.988190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.988196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.988254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.988310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.988364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.988416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.988464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.988472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.988535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.988588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.988654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.988711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.988755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.988770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.988829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.988888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.988951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.989016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.989124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.989129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.989192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.989248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.989308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.989372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.989411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.989417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.989480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.989541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.989600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.989672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.989716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.989727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.989786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.989847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.989902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.989960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.990001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.990008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.990075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:13.990131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:13.990186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:13.990247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:13.990292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:13.990298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:13.990363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074949:6999], now have 1 active actors on pipe
2025-10-01T14:09:13.990636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:13.990691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:13.990702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:13.990731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 735 reason: error at write: Disconnected sessionId: src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0
2025-10-01T14:09:13.990898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255166157074949:6999]
2025-10-01T14:09:13.990915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 735 sessionId: src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0 is DEAD
2025-10-01T14:09:13.991073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:13.991083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0] Write session will restart in 0.005431s
2025-10-01T14:09:13.991106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0] Write session: Do CDS request
2025-10-01T14:09:13.991112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:13.991498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:13.997859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.997972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:13.997989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 736
2025-10-01T14:09:13.998144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:13.998190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:13.998200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:13.998205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:13.998605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 736 sessionId:  describe result for acl check
2025-10-01T14:09:13.998642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:13.998605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:13.998648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:13.998651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:13.998656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255166157074977:7210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:13.999132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255166157074977:7210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:13.999946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:14.000151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:14.000165Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:14.000178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:14.000239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:14.000294Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255163780209953:6389]
2025-10-01T14:09:14.000833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:14.001116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:14.001171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:14.001457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:14.001537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.001545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.001546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.001549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.001550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.001551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.001552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.001553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.001554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.001554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.001555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.001556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.001557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.001558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.001564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.001573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.001577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.001580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.001583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.001586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.001590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.001593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.001597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.001600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.001603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.001606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.001610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.001613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.001620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.001628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.001633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.001637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.001641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.001646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.001650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.001655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.001660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.001665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.001668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.001673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.001677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.001681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.001685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.001689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.001693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.001704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.001707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.001711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.001715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.001718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.001723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.001727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.001731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.001735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.001738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.001742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.001743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255166157074977:7210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:14.001779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:14.005066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255166157074977:7210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:14.005083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255166157074977:7210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:14.005086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255166157074977:7210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:14.005094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:14.005320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:14.006095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:14.006114Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:14.006117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:14.006121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:14.006129Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 735 [2:7556255163780209953:6389]
2025-10-01T14:09:14.006143Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:14.006158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:14.006165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.006169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.006171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.006187Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:14.006196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:14.006202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:14.006254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.006261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.006264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.006266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:14.006269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:14.006336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:14.006345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.006356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.006365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.006397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:14.006422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042310:7210], now have 1 active actors on pipe
2025-10-01T14:09:14.006418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 735
2025-10-01T14:09:14.006431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255166157074954:2446], now have 1 active actors on pipe
2025-10-01T14:09:14.006445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 735
2025-10-01T14:09:14.006440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255163780209948:6389]
2025-10-01T14:09:14.006442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255163780209948:6389]
2025-10-01T14:09:14.006443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255163780209948:6389]
2025-10-01T14:09:14.006455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:14.006469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:14.006470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:14.006472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:14.006473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:14.006483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:14.006485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:14.006502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.006507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.006545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255163780209948:6389]
2025-10-01T14:09:14.006557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:14.006572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:14.006583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.006592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.006594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:14.006601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.006605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:14.006615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:14.006654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.006786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.006798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.006829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.006916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 736 partition: 0 MaxSeqNo: 45 sessionId: src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0
2025-10-01T14:09:14.007258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a491cbc-6f3cfef6-36158f9f-c14a9daf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:14.009499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0] Write session: try to update token
2025-10-01T14:09:14.009515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:14.023992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 736 sessionId: src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:14.026632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:14.027453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.027481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.027499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:14.027502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:14.027505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:14.027507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:14.027514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255163780209948:6389]
2025-10-01T14:09:14.027520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255163780209948:6389]
2025-10-01T14:09:14.027523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255163780209948:6389]
2025-10-01T14:09:14.027582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:14.027584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:14.027590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:14.027592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.027594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:14.027594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:14.027720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:14.091068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255170452042317:6999]
2025-10-01T14:09:14.091350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 735, pipe: [1:7556255170452042317:6999]
2025-10-01T14:09:14.171360Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:14.171598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:14.171648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042317:6999], now have 1 active actors on pipe
2025-10-01T14:09:14.171749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:14.171795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:14.171841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255170452042317:6999]
2025-10-01T14:09:14.171851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:14.171853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:14.171931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 736 reason: error at write: Disconnected sessionId: src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0
2025-10-01T14:09:14.172078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 736 sessionId: src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0 is DEAD
2025-10-01T14:09:14.172211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:14.172220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0] Write session will restart in 0.007933s
2025-10-01T14:09:14.172256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0] Write session: Do CDS request
2025-10-01T14:09:14.172264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:14.180653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:14.180883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.180963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:14.180978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 737
2025-10-01T14:09:14.181081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.181111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:14.181120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:14.181123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:14.181490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 737 sessionId:  describe result for acl check
2025-10-01T14:09:14.181529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:14.181535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:14.181536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:14.181541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255170452042345:7214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:14.182052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255170452042345:7214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:14.182055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:14.182265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:14.182279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:14.182292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:14.182357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:14.182417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255168075177313:6391]
2025-10-01T14:09:14.182964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:14.183282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:14.183330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:14.183605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:14.183649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.183654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.183655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.183656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.183657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.183657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.183658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.183659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.183659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.183660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.183660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.183661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.183662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.183662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.183666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.183671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.183673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.183676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.183678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.183680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.183684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.183686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.183688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.183690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.183692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.183694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.183696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.183698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.183703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.183709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.183716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.183720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.183724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.183728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.183731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.183736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.183739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.183744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.183747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.183752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.183757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.183762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.183766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.183771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.183776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.183780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.183784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.183789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.183793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.183798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.183802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.183817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255170452042345:7214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:14.183807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.183819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.183823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.183827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.183831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.183865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:14.187140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255170452042345:7214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:14.187156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255170452042345:7214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:14.187160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255170452042345:7214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:14.187169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:14.187368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:14.187956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:14.187969Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:14.187972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:14.187975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:14.187980Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 736 [2:7556255168075177313:6391]
2025-10-01T14:09:14.187990Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:14.188002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:14.188004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.188006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.188007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.188019Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:14.188024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:14.188028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:14.188065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.188072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.188073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.188077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:14.188079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:14.188136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:14.188141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.188147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.188153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.188161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:14.188177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042320:2446], now have 1 active actors on pipe
2025-10-01T14:09:14.188185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255168075177308:6391]
2025-10-01T14:09:14.188186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255168075177308:6391]
2025-10-01T14:09:14.188187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255168075177308:6391]
2025-10-01T14:09:14.188196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:14.188205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042384:7214], now have 1 active actors on pipe
2025-10-01T14:09:14.188208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:14.188211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:14.188211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:14.188213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:14.188218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:14.188220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:14.188238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255168075177308:6391]
2025-10-01T14:09:14.188248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:14.188251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 736
2025-10-01T14:09:14.188268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:14.188251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 736
2025-10-01T14:09:14.188303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.188309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.188327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e54b939-6e9a0035-84048319-405f22c6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:14.188335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.188338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.188339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:14.188346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.188351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:14.188360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.188458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.188463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.188471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.188544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 737 partition: 0 MaxSeqNo: 45 sessionId: src_id|8e54b939-6e9a0035-84048319-405f22c6_0
2025-10-01T14:09:14.188884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72329cec-7e35b9b6-5b9ecd18-49b95493_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8e54b939-6e9a0035-84048319-405f22c6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:14.191265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e54b939-6e9a0035-84048319-405f22c6_0] Write session: try to update token
2025-10-01T14:09:14.191281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e54b939-6e9a0035-84048319-405f22c6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:14.199072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:14.199090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:14.199102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255168075177308:6391]
2025-10-01T14:09:14.199139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:14.199148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:14.199303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:14.199438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:14.199564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:14.199708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:14.199890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:14.199934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:14.204786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 737 sessionId: src_id|8e54b939-6e9a0035-84048319-405f22c6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:14.207072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:14.207271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.207293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.207335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:14.207418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:14.217681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:14.217697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:14.217700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:14.217702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:14.217712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255168075177308:6391]
2025-10-01T14:09:14.217716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255168075177308:6391]
2025-10-01T14:09:14.217726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255168075177308:6391]
2025-10-01T14:09:14.217768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:14.217773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:14.217779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.217779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:14.217781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:14.217783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:14.217902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:14.271800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255170452042396:6999]
2025-10-01T14:09:14.272098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 736, pipe: [1:7556255170452042396:6999]
2025-10-01T14:09:14.360698Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:14.368622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.368667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.368874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.368955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.369031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.369109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.369164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.369179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.369268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.369341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.369419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.369502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.369554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.369563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.369647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.369730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.369814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.369894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.369945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.369960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.370045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.370130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.370208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.370298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.370350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.370357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.370461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.370544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.370626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.370710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.370760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.370768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.370852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.370914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.370979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.371041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.371085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.371092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.371160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.371223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.371286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.371351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.371399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.371405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.371473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.371532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.371595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.371650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.371687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.371692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.371747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.371797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.371852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.371906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.371944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.371951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.372006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.372056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.372107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.372158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.372195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.372206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.372270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042396:6999], now have 1 active actors on pipe
2025-10-01T14:09:14.372483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:14.372543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255170452042396:6999]
2025-10-01T14:09:14.372579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:14.372586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:14.372615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 737 reason: error at write: Disconnected sessionId: src_id|8e54b939-6e9a0035-84048319-405f22c6_0
2025-10-01T14:09:14.372799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 737 sessionId: src_id|8e54b939-6e9a0035-84048319-405f22c6_0 is DEAD
2025-10-01T14:09:14.372920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e54b939-6e9a0035-84048319-405f22c6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:14.372931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e54b939-6e9a0035-84048319-405f22c6_0] Write session will restart in 0.009283s
2025-10-01T14:09:14.372954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e54b939-6e9a0035-84048319-405f22c6_0] Write session: Do CDS request
2025-10-01T14:09:14.372959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e54b939-6e9a0035-84048319-405f22c6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:14.373200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:14.381848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:14.383399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:14.383639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:14.383648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:14.383658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:14.383712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:14.383759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255168075177381:6394]
2025-10-01T14:09:14.383901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e54b939-6e9a0035-84048319-405f22c6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.383972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:14.384001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 738
2025-10-01T14:09:14.384132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.384183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:14.384193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:14.384196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:14.384420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:14.384572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 738 sessionId:  describe result for acl check
2025-10-01T14:09:14.384613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:14.384615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:14.384616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:14.384621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255170452042431:7219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:14.384686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:14.384728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:14.385012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:14.385087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.385093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.385094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.385095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.385096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.385097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.385100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.385101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.385103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.385104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.385105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.385106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.385107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.385107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.385121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255170452042431:7219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:14.385113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.385120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.385123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.385126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.385129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.385132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.385135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.385138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.385141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.385145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.385148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.385151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.385155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.385157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.385165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.385171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.385176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.385180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.385183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.385186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.385190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.385194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.385199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.385204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.385208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.385212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.385216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.385221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.385224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.385229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.385232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.385236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.385239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.385243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.385246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.385249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.385252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.385266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.385270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.385273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.385276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.385281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.385310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:14.387864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255170452042431:7219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:14.389005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:14.389656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:14.389668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:14.389670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:14.389673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:14.389679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 737 [2:7556255168075177381:6394]
2025-10-01T14:09:14.389694Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:14.389709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:14.389715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.389719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.389722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.389740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:14.389749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:14.389755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:14.389795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.389799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.389801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.389803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:14.389805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:14.389861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:14.389867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.389878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.389890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.389908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:14.389929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042402:2446], now have 1 active actors on pipe
2025-10-01T14:09:14.389937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255168075177376:6394]
2025-10-01T14:09:14.389939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255168075177376:6394]
2025-10-01T14:09:14.389940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255168075177376:6394]
2025-10-01T14:09:14.389949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:14.389960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:14.389962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:14.389964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:14.389966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:14.389979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:14.389985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:14.390013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255168075177376:6394]
2025-10-01T14:09:14.389987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 737
2025-10-01T14:09:14.390019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:14.390020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:14.390815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255170452042431:7219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:14.390828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255170452042431:7219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:14.390831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255170452042431:7219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:14.390839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:14.391023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042473:7219], now have 1 active actors on pipe
2025-10-01T14:09:14.391097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 737
2025-10-01T14:09:14.391213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.391225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.391251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:14.391266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.391272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.391274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:14.391283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.391295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:14.391314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.391491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.391500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.391514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.391623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 738 partition: 0 MaxSeqNo: 45 sessionId: src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0
2025-10-01T14:09:14.391954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e54b939-6e9a0035-84048319-405f22c6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:14.394450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0] Write session: try to update token
2025-10-01T14:09:14.394466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:14.400927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:14.400950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:14.400962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255168075177376:6394]
2025-10-01T14:09:14.401001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:14.401010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:14.401216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:14.401384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:14.401538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:14.401702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:14.401909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:14.401956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:14.408578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 738 sessionId: src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:14.411211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:14.411402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.411421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.411459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:14.411541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:14.419834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:14.419850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:14.419853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:14.419854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:14.419862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255168075177376:6394]
2025-10-01T14:09:14.419865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255168075177376:6394]
2025-10-01T14:09:14.419868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255168075177376:6394]
2025-10-01T14:09:14.419909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:14.419912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:14.419917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.419918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:14.419919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:14.419922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:14.420045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:14.428789Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:09:14.472477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255170452042479:6999]
2025-10-01T14:09:14.472729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 737, pipe: [1:7556255170452042479:6999]
2025-10-01T14:09:14.571032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:14.578685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.578712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.578868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.578929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.578998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.579053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.579347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.579358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.579421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.579474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.579528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.579590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.579634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.579640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.579706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.579767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.579826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.579881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.579921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.579929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.579989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.580041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.580104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.580159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.580284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.580292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.580355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.580411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.580465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.580525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.580567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.580573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.580638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.580693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.580752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.580820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.580859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.580863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.580920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.580969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.581033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.581089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.581125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.581130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.581195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.581254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.581305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.581355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.581393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.581401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.581460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.581513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.581564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.581625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.581669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.581675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.581738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.581796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.581856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.581914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.581956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.581962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.582030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042479:6999], now have 1 active actors on pipe
2025-10-01T14:09:14.582234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:14.582238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255170452042479:6999]
2025-10-01T14:09:14.582262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:14.582264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:14.582288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 738 reason: error at write: Disconnected sessionId: src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0
2025-10-01T14:09:14.582505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 738 sessionId: src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0 is DEAD
2025-10-01T14:09:14.582652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:14.582662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0] Write session will restart in 0.006778s
2025-10-01T14:09:14.582685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0] Write session: Do CDS request
2025-10-01T14:09:14.582690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:14.582613Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:14.590210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:14.590861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.590963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:14.590981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 739
2025-10-01T14:09:14.591105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.591137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:14.591149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:14.591152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:14.591504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 739 sessionId:  describe result for acl check
2025-10-01T14:09:14.591536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:14.591538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:14.591539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:14.591544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255170452042520:7224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:14.591986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:14.592048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255170452042520:7224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:14.592180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:14.592192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:14.592203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:14.592261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:14.592295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255168075177459:6397]
2025-10-01T14:09:14.592874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:14.593179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:14.593224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:14.593551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:14.593616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.593625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.593626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.593627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.593628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.593630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.593631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.593632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.593633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.593634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.593635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.593636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.593638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.593639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.593644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.593653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.593656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.593659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.593663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.593666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.593670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.593673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.593679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.593683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.593687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.593691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.593694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.593697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.593703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.593710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.593716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.593721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.593725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.593729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.593733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.593739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.593743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.593747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.593751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.593755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.593761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.593766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.593770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.593774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.593778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.593782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.593786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.593791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.593795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.593800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.593804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.593808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.593813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.593818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.593828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.593832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.593869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:14.594230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255170452042520:7224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:14.597282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255170452042520:7224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:14.597300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255170452042520:7224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:14.597303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255170452042520:7224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:14.597319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:14.597580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:14.598144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:14.598159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:14.598161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:14.598164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:14.598171Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 738 [2:7556255168075177459:6397]
2025-10-01T14:09:14.598185Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:14.598199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:14.598201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.598204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.598205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.598234Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:14.598245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:14.598250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:14.598296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.598302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.598304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.598306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:14.598308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:14.598389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:14.598398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.598410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.598420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.598430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:14.598444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042560:7224], now have 1 active actors on pipe
2025-10-01T14:09:14.598452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042493:2446], now have 1 active actors on pipe
2025-10-01T14:09:14.598459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255168075177454:6397]
2025-10-01T14:09:14.598461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255168075177454:6397]
2025-10-01T14:09:14.598462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255168075177454:6397]
2025-10-01T14:09:14.598474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:14.598486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:14.598485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:14.598489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:14.598491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:14.598503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:14.598506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:14.598498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 738
2025-10-01T14:09:14.598499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 738
2025-10-01T14:09:14.598532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255168075177454:6397]
2025-10-01T14:09:14.598538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:14.598540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:14.598552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.598558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.598612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74ef45f0-cbef287a-42097a42-694fbf16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:14.598622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.598626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.598628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:14.598636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.598643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:14.598664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.598857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.598867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.598891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.598972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 739 partition: 0 MaxSeqNo: 45 sessionId: src_id|74ef45f0-cbef287a-42097a42-694fbf16_0
2025-10-01T14:09:14.599307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb124aa0-bc0d3940-61fc5f8a-265e6303_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|74ef45f0-cbef287a-42097a42-694fbf16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:14.601816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74ef45f0-cbef287a-42097a42-694fbf16_0] Write session: try to update token
2025-10-01T14:09:14.601834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74ef45f0-cbef287a-42097a42-694fbf16_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:14.615804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 739 sessionId: src_id|74ef45f0-cbef287a-42097a42-694fbf16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:14.617987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:14.618909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.618933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.618954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:14.618958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:14.618962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:14.618967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:14.618980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255168075177454:6397]
2025-10-01T14:09:14.618984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255168075177454:6397]
2025-10-01T14:09:14.618987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255168075177454:6397]
2025-10-01T14:09:14.619024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:14.619036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:14.619038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:14.619040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:14.619045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.619047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:14.619171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:14.682415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255170452042583:6999]
2025-10-01T14:09:14.682690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 738, pipe: [1:7556255170452042583:6999]
2025-10-01T14:09:14.766004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:14.766387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:14.766453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042583:6999], now have 1 active actors on pipe
2025-10-01T14:09:14.766552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:14.766686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255170452042583:6999]
2025-10-01T14:09:14.766714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:14.775615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:14.777213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:14.777226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:14.777247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 739 reason: error at write: Disconnected sessionId: src_id|74ef45f0-cbef287a-42097a42-694fbf16_0
2025-10-01T14:09:14.777385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 739 sessionId: src_id|74ef45f0-cbef287a-42097a42-694fbf16_0 is DEAD
2025-10-01T14:09:14.777512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ef45f0-cbef287a-42097a42-694fbf16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:14.777522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ef45f0-cbef287a-42097a42-694fbf16_0] Write session will restart in 0.009748s
2025-10-01T14:09:14.777549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ef45f0-cbef287a-42097a42-694fbf16_0] Write session: Do CDS request
2025-10-01T14:09:14.777556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ef45f0-cbef287a-42097a42-694fbf16_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:14.783634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:14.783872Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:14.783882Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:14.783894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:14.783950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:14.783988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255168075177534:6401]
2025-10-01T14:09:14.784563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:14.784902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:14.784945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:14.785219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:14.785289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.785294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.785295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.785296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.785297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.785298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.785299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.785300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.785301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.785302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.785303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.785304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.785305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.785306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.785311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.785320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.785326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.785329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.785332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.785335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.785339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.785342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.785345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.785349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.785352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.785355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.785358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.785362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.785370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.785384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:14.785393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.785402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:14.785410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.785419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:14.785426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.785431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:14.785441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.785445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:14.785449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.785452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:14.785457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.785461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:14.785464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.785468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:14.785473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.785477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:14.785486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.785491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.785495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.785504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.785507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.785511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.785514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.785518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:14.785523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.785527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:14.785565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:14.788921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74ef45f0-cbef287a-42097a42-694fbf16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.789017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:14.789035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 740
2025-10-01T14:09:14.789139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.789179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:14.789190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:14.789194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:14.789597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 740 sessionId:  describe result for acl check
2025-10-01T14:09:14.789630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:14.789636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:14.789638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:14.789643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255170452042628:7236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:14.789928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:14.790423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255170452042628:7236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:14.790505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:14.790520Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:14.790524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:14.790526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:14.790532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 739 [2:7556255168075177534:6401]
2025-10-01T14:09:14.790548Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:14.790563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:14.790566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.790569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.790571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.790586Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:14.790593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:14.790598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:14.790655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.790667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.790668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.790671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:14.790673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:14.790737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:14.790746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.790756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:14.790768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:14.790783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:14.790801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255168075177528:6401]
2025-10-01T14:09:14.790803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255168075177528:6401]
2025-10-01T14:09:14.790805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255168075177528:6401]
2025-10-01T14:09:14.790815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:14.790946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 739
2025-10-01T14:09:14.790828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:14.790834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:14.790837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:14.790839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:14.790841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:14.790844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:14.790880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042594:2446], now have 1 active actors on pipe
2025-10-01T14:09:14.790883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255168075177528:6401]
2025-10-01T14:09:14.790892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:14.790908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:14.792992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255170452042628:7236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:14.798046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255170452042628:7236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:14.798065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255170452042628:7236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:14.798069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255170452042628:7236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:14.798077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:14.798340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042666:7236], now have 1 active actors on pipe
2025-10-01T14:09:14.798408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 739
2025-10-01T14:09:14.798497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.798509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.798536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:14.798551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:14.798560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:14.798563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:14.798575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:14.798592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:14.798616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.798825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.798839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.798862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:14.798986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 740 partition: 0 MaxSeqNo: 45 sessionId: src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0
2025-10-01T14:09:14.799329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74ef45f0-cbef287a-42097a42-694fbf16_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:14.801814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:14.801831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:14.801875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0] Write session: try to update token
2025-10-01T14:09:14.801839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255168075177528:6401]
2025-10-01T14:09:14.801880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:14.801903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:14.801888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:14.802058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:14.802206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:14.802346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:14.802503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:14.802711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:14.802749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:14.818579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 740 sessionId: src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:14.821112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:14.821429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.821452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.821489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:14.821559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:14.826070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:14.826092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:14.826095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:14.826097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:14.826107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255168075177528:6401]
2025-10-01T14:09:14.826112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255168075177528:6401]
2025-10-01T14:09:14.826117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255168075177528:6401]
2025-10-01T14:09:14.826156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:14.826162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:14.826163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:14.826167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:14.826169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:14.826172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:14.826306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:14.866750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255170452042669:6999]
2025-10-01T14:09:14.867044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 739, pipe: [1:7556255170452042669:6999]
2025-10-01T14:09:14.974659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:14.982680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:14.982709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:14.982873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.982942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.983012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.983075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.983464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.983476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.983536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.983595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.983653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.983714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.983760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.983770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.983835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.983894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.983956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.984017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.984065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.984071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.984134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.984196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.984263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.984328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.984374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.984380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.984447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.984514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.984585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.984647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.984696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.984703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.984793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.984858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.984921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.984986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.985033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.985044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.985109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.985166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.985237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.985305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.985349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.985356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.985419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.985484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.985545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.985610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.985653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.985658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.985717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.985783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.985850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.985910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.985959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.985970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.986040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:14.986111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:14.986184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:14.986243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:14.986289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:14.986292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:14.986361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042669:6999], now have 1 active actors on pipe
2025-10-01T14:09:14.986627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255170452042669:6999]
2025-10-01T14:09:14.986661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:14.987073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:14.987084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:14.987108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 740 reason: error at write: Disconnected sessionId: src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0
2025-10-01T14:09:14.987264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:14.987303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 740 sessionId: src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0 is DEAD
2025-10-01T14:09:14.987406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:14.987413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0] Write session will restart in 0.009887s
2025-10-01T14:09:14.987438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0] Write session: Do CDS request
2025-10-01T14:09:14.987444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:14.995822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:14.997539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:14.997750Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:14.997759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:14.997770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:14.997818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:14.997858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255168075177633:6414]
2025-10-01T14:09:14.998485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:14.998783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.998929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:14.998947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 741
2025-10-01T14:09:14.999411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:14.999473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:14.999479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:14.999482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:14.999964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 741 sessionId:  describe result for acl check
2025-10-01T14:09:15.000003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:15.000009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:15.000010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:15.000016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255170452042704:7240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:15.000460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:15.000522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:15.000570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255170452042704:7240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:15.000888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:15.000952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.000958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.000959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.000960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.000962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.000963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.000964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.000966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.000967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.000968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.000970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.000973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.000974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.000975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.000982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.000992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.000996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.001000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.001004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.001008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.001013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.001017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.001021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.001025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.001029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.001032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.001036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.001040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.001046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.001054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.001069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.001079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.001083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.001094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.001098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.001109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.001113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.001122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.001127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.001136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.001146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.001151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.001160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.001164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.001173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.001178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.001186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.001191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.001200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.001205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.001209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.001216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.001227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.001232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.001240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.001249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.001288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:15.003117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255170452042704:7240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:15.005207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:15.005794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255170452042704:7240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:15.005812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255170452042704:7240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:15.005815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255170452042704:7240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:15.005823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:15.005844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:15.005859Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:15.005861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:15.005865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:15.005872Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 740 [2:7556255168075177633:6414]
2025-10-01T14:09:15.005888Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:15.005905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:15.005909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.005912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.005915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.005930Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:15.005943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:15.005950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:15.006002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.006010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.006012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.006015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:15.006018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:15.006085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:15.006093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.006107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.006125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.006148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:15.006168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255170452042674:2446], now have 1 active actors on pipe
2025-10-01T14:09:15.006177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010035:7240], now have 1 active actors on pipe
2025-10-01T14:09:15.006183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255168075177628:6414]
2025-10-01T14:09:15.006186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255168075177628:6414]
2025-10-01T14:09:15.006188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255168075177628:6414]
2025-10-01T14:09:15.006185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 740
2025-10-01T14:09:15.006202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:15.006200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 740
2025-10-01T14:09:15.006210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:15.006213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:15.006214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:15.006220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:15.006237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:15.006240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:15.006286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.006295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.006309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255168075177628:6414]
2025-10-01T14:09:15.006321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:15.006333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:15.006360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:15.006391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.006395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.006398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:15.006406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.006416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:15.006441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.006624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.006634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.006649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.006717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 741 partition: 0 MaxSeqNo: 45 sessionId: src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0
2025-10-01T14:09:15.007190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5327cdb9-dd766a6b-5388d926-51a9bb8c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:15.009587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0] Write session: try to update token
2025-10-01T14:09:15.009601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:15.025270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 741 sessionId: src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:15.027792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:15.029519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.029546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.029566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:15.029569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:15.029572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:15.029574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:15.029583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255168075177628:6414]
2025-10-01T14:09:15.029591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255168075177628:6414]
2025-10-01T14:09:15.029598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255168075177628:6414]
2025-10-01T14:09:15.029654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:15.029659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:15.029664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.029666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:15.029667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:15.029668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:15.029795Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:15.086864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255174747010043:6999]
2025-10-01T14:09:15.087121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 740, pipe: [1:7556255174747010043:6999]
2025-10-01T14:09:15.180412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:15.180662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:15.180722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010043:6999], now have 1 active actors on pipe
2025-10-01T14:09:15.180796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:15.181159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:15.181214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255174747010043:6999]
2025-10-01T14:09:15.191539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:15.193299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:15.193541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:15.193552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:15.193565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:15.193636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:15.193680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255172370145001:6416]
2025-10-01T14:09:15.194315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:15.194678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:15.194727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:15.195047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:15.195121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.195127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.195128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.195129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.195130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.195131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.195132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.195133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.195134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.195135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.195137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.195138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.195139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.195140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.195145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.195156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.195159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.195163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.195167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.195171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.195174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.195177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.195181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.195186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.195190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.195194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.195197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.195201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.195209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.195216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.195225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.195230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.195234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.195239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.195242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.195247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.195251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.195257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.195263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.195268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.195279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.195283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.195289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.195293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.195301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.195305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.195309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.195313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.195319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.195323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.195327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.195333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.195337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.195343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.195346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.195328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:15.195351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.195338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:15.195359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 741 reason: error at write: Disconnected sessionId: src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0
2025-10-01T14:09:15.195395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:15.195499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 741 sessionId: src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0 is DEAD
2025-10-01T14:09:15.195815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:15.195826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0] Write session will restart in 0.008768s
2025-10-01T14:09:15.195850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0] Write session: Do CDS request
2025-10-01T14:09:15.195856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:15.205246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:15.205907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:15.205924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:15.205943Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:15.205946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:15.205950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:15.205956Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 741 [2:7556255172370145001:6416]
2025-10-01T14:09:15.205977Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:15.205995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:15.206001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.206005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.206007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.206024Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:15.206030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:15.206036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:15.206090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.206098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.206099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.206103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:15.206106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:15.206174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:15.206181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.206195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.206212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.206233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:15.206252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255172370144995:6416]
2025-10-01T14:09:15.206258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255172370144995:6416]
2025-10-01T14:09:15.206260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255172370144995:6416]
2025-10-01T14:09:15.206269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:15.206280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:15.206288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010050:2446], now have 1 active actors on pipe
2025-10-01T14:09:15.206289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:15.206291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:15.206294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:15.206307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:15.206314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:15.206350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255172370144995:6416]
2025-10-01T14:09:15.206360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:15.206354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 741
2025-10-01T14:09:15.206386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:15.206462Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:15.206486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 742
2025-10-01T14:09:15.206598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:15.206632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:15.206637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:15.206641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:15.207088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 742 sessionId:  describe result for acl check
2025-10-01T14:09:15.207130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:15.207138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:15.207140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:15.207145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255174747010089:7244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:15.207763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255174747010089:7244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:15.210252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255174747010089:7244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:15.216498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255174747010089:7244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:15.216521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255174747010089:7244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:15.216524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255174747010089:7244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:15.216533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:15.216829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 741
2025-10-01T14:09:15.217260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010127:7244], now have 1 active actors on pipe
2025-10-01T14:09:15.217290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.217298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.217317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:15.217320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:15.217328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255172370144995:6416]
2025-10-01T14:09:15.217364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:15.217377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:15.217388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.217394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.217397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:15.217409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.217425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:15.217449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:15.217639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:15.217787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:15.217933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:15.218081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:15.218289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:15.218342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.218364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:15.218581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.218593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.218613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.218766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 742 partition: 0 MaxSeqNo: 45 sessionId: src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0
2025-10-01T14:09:15.219163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9429bf4f-84cd15fe-2fdc4168-cea19060_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:15.221632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0] Write session: try to update token
2025-10-01T14:09:15.221653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:15.236587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 742 sessionId: src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:15.237389Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:15.237408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:15.237412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:15.237413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:15.237426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255172370144995:6416]
2025-10-01T14:09:15.237429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255172370144995:6416]
2025-10-01T14:09:15.237432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255172370144995:6416]
2025-10-01T14:09:15.237484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:15.237499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.237501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:15.237502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:15.237507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:15.237511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:15.237633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:15.239205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:15.281454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255174747010133:6999]
2025-10-01T14:09:15.281692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 741, pipe: [1:7556255174747010133:6999]
2025-10-01T14:09:15.395147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:15.395467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.395482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.395505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010133:6999], now have 1 active actors on pipe
2025-10-01T14:09:15.395710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:15.395749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255174747010133:6999]
2025-10-01T14:09:15.395758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:15.395776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:15.395857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 742 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0
2025-10-01T14:09:15.396019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 742 sessionId: src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0 is DEAD
2025-10-01T14:09:15.396162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:15.396174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0] Write session will restart in 0.009205s
2025-10-01T14:09:15.396201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0] Write session: Do CDS request
2025-10-01T14:09:15.396208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:15.403991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:15.405556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:15.405706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:15.405715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:15.405723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:15.405754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:15.405796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255172370145072:6419]
2025-10-01T14:09:15.406254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:15.406560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:15.406603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:15.406866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:15.406919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:15.406935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:15.406949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 743
2025-10-01T14:09:15.406976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.406982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.406983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.406984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.406986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.406987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.406990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.406992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.406994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.406994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.406995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.406997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.406998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.406999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.407012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.407022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.407025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.407029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.407032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.407036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.407039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.407042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.407045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.407049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.407052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.407055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.407058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.407062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.407069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.407066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:15.407077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.407085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.407092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.407097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.407094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:15.407102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.407107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.407103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:15.407112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.407107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:15.407116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.407122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.407126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.407131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.407136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.407141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.407150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.407155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.407164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.407169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.407176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.407180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.407184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.407192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.407196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.407201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.407209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.407215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.407223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.407227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.407265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:15.407486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 743 sessionId:  describe result for acl check
2025-10-01T14:09:15.407515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:15.407517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:15.407519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:15.407523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255174747010173:7249] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:15.407932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255174747010173:7249] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:15.409616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255174747010173:7249] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:15.410943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:15.411674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:15.411691Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:15.411694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:15.411697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:15.411704Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 742 [2:7556255172370145072:6419]
2025-10-01T14:09:15.411718Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:15.411735Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:15.411737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.411741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.411743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.411759Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:15.411768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:15.411773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:15.411838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.411848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.411850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.411852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:15.411855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:15.411917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:15.411924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.411935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.411949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.411966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:15.411986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010139:2446], now have 1 active actors on pipe
2025-10-01T14:09:15.411997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255172370145067:6419]
2025-10-01T14:09:15.411999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255172370145067:6419]
2025-10-01T14:09:15.412000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255172370145067:6419]
2025-10-01T14:09:15.412014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 742
2025-10-01T14:09:15.412014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:15.412030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:15.412033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:15.412036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:15.412038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:15.412042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:15.412045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:15.412074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255172370145067:6419]
2025-10-01T14:09:15.412081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:15.412085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:15.412250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255174747010173:7249] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:15.412260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255174747010173:7249] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:15.412275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255174747010173:7249] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:15.412285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:15.412464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010211:7249], now have 1 active actors on pipe
2025-10-01T14:09:15.412518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 742
2025-10-01T14:09:15.412569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.412577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.412600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|866c0637-a9f09670-f7e227ab-581d2950_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:15.412611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.412616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.412618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:15.412626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.412641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:15.412657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.412818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.412825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.412838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.412953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 743 partition: 0 MaxSeqNo: 45 sessionId: src_id|866c0637-a9f09670-f7e227ab-581d2950_0
2025-10-01T14:09:15.413255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9345f4b-819d29fe-a5d66be6-f28f448a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|866c0637-a9f09670-f7e227ab-581d2950_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:15.415789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|866c0637-a9f09670-f7e227ab-581d2950_0] Write session: try to update token
2025-10-01T14:09:15.415808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|866c0637-a9f09670-f7e227ab-581d2950_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:15.423109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:15.423128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:15.423140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255172370145067:6419]
2025-10-01T14:09:15.423186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:15.423185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:15.423376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:15.423522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:15.423668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:15.423810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:15.424004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:15.424046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:15.429735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 743 sessionId: src_id|866c0637-a9f09670-f7e227ab-581d2950_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:15.431956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:15.432120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.432139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.432174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:15.432240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:15.441300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:15.441316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:15.441318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:15.441320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:15.441327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255172370145067:6419]
2025-10-01T14:09:15.441329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255172370145067:6419]
2025-10-01T14:09:15.441331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255172370145067:6419]
2025-10-01T14:09:15.441367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:15.441371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:15.441372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:15.441374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:15.441377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.441381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:15.441499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:15.495987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255174747010219:6999]
2025-10-01T14:09:15.496261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 742, pipe: [1:7556255174747010219:6999]
2025-10-01T14:09:15.588413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:15.596193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.596222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.596391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.596456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.596520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.596579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.596621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.596635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.596707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.596785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.596853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.596922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.596969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.596980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.597051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.597121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.597195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.597266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.597315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.597322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.597395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.597464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.597533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.597599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.597649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.597656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.597725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.597799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.597863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.597928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.597971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.597978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.598049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.598111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.598176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.598280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.598322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.598327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.598411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.598474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.598549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.598617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.598668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.598676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.598744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.598811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.598881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.598950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.598996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.599007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.599070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.599132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.599189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.599248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.599289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.599294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.599349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:15.599402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:15.599466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:15.599535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:15.599583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:15.599589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:15.599649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010219:6999], now have 1 active actors on pipe
2025-10-01T14:09:15.599867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:15.599896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255174747010219:6999]
2025-10-01T14:09:15.599915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:15.599917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:15.599951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 743 reason: error at write: Disconnected sessionId: src_id|866c0637-a9f09670-f7e227ab-581d2950_0
2025-10-01T14:09:15.600145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 743 sessionId: src_id|866c0637-a9f09670-f7e227ab-581d2950_0 is DEAD
2025-10-01T14:09:15.600280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866c0637-a9f09670-f7e227ab-581d2950_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:15.600291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866c0637-a9f09670-f7e227ab-581d2950_0] Write session will restart in 0.008806s
2025-10-01T14:09:15.600318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866c0637-a9f09670-f7e227ab-581d2950_0] Write session: Do CDS request
2025-10-01T14:09:15.600325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866c0637-a9f09670-f7e227ab-581d2950_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:15.600697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:15.609075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:15.609916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|866c0637-a9f09670-f7e227ab-581d2950_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:15.609964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:15.609979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 744
2025-10-01T14:09:15.610142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:15.610176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:15.610185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:15.610189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:15.610761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:15.610959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:15.610971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:15.610981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:15.611042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:15.611088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255172370145160:6424]
2025-10-01T14:09:15.611680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:15.612202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:15.612262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:15.610645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 744 sessionId:  describe result for acl check
2025-10-01T14:09:15.610676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:15.610678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:15.610679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:15.610685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255174747010270:7256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:15.611202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255174747010270:7256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:15.612558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:15.612621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.612628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.612629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.612630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.612631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.612633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.612634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.612635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.612636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.612637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.612638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.612639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.612640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.612641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.612648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.612657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.612659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.612662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.612664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.612667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.612669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.612671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.612673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.612675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.612678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.612680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.612682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.612684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.612689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.612694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.612700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.612703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.612706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.612709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.612711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.612714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.612717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.612720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.612723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.612725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.612728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.612731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.612733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.612736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.612739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.612742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.612744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.612748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.612750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.612753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.612755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.612772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.612775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.612778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.612781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.612786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.612823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:15.613240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255174747010270:7256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:15.616231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255174747010270:7256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:15.616244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255174747010270:7256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:15.616247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255174747010270:7256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:15.616253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:15.616476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:15.617128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:15.617143Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:15.617145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:15.617150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:15.617157Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 743 [2:7556255172370145160:6424]
2025-10-01T14:09:15.617171Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:15.617186Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:15.617195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.617198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.617200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.617215Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:15.617225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:15.617231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:15.617280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.617285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.617287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.617290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:15.617293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:15.617353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:15.617361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.617372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.617383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.617400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:15.617418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010309:7256], now have 1 active actors on pipe
2025-10-01T14:09:15.617425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255172370145155:6424]
2025-10-01T14:09:15.617427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255172370145155:6424]
2025-10-01T14:09:15.617429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255172370145155:6424]
2025-10-01T14:09:15.617441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:15.617454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010238:2446], now have 1 active actors on pipe
2025-10-01T14:09:15.617460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:15.617462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:15.617462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:15.617465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:15.617474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:15.617477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:15.617507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255172370145155:6424]
2025-10-01T14:09:15.617517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:15.617525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:15.617545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 743
2025-10-01T14:09:15.617550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 743
2025-10-01T14:09:15.617597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.617608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.617629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:15.617636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.617640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.617641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:15.617650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.617658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:15.617675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.617852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.617864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.617886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.618011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 744 partition: 0 MaxSeqNo: 45 sessionId: src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0
2025-10-01T14:09:15.618439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|866c0637-a9f09670-f7e227ab-581d2950_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:15.620812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0] Write session: try to update token
2025-10-01T14:09:15.620831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:15.635467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 744 sessionId: src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:15.638068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:15.638956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.638983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.639004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:15.639007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:15.639010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:15.639011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:15.639023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255172370145155:6424]
2025-10-01T14:09:15.639027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255172370145155:6424]
2025-10-01T14:09:15.639030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255172370145155:6424]
2025-10-01T14:09:15.639084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:15.639091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:15.639093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:15.639095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:15.639099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.639101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:15.639252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:15.700252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255174747010333:6999]
2025-10-01T14:09:15.700454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 743, pipe: [1:7556255174747010333:6999]
2025-10-01T14:09:15.792131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:15.792420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:15.792474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010333:6999], now have 1 active actors on pipe
2025-10-01T14:09:15.792554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:15.792701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255174747010333:6999]
2025-10-01T14:09:15.792725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:15.805730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:15.805740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:15.805764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 744 reason: error at write: Disconnected sessionId: src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0
2025-10-01T14:09:15.805940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 744 sessionId: src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0 is DEAD
2025-10-01T14:09:15.806636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:15.806647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0] Write session will restart in 0.008463s
2025-10-01T14:09:15.806675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0] Write session: Do CDS request
2025-10-01T14:09:15.806683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:15.813351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:15.815279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:15.815538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:15.815550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:15.815563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:15.815626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:15.815674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255172370145244:6428]
2025-10-01T14:09:15.815925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:15.816313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:15.816501Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:15.816513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 745
2025-10-01T14:09:15.816658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:15.816686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:15.816695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:15.816698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:15.816696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:15.816749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:15.817079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:15.817083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 745 sessionId:  describe result for acl check
2025-10-01T14:09:15.817117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:15.817120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:15.817122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:15.817127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255174747010381:7268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:15.817156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.817163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.817164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.817166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.817167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.817168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.817172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.817174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.817175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.817176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.817177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.817178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.817179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.817181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.817187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.817197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.817202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.817206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.817210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.817214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.817218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.817222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.817226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.817231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.817235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.817238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.817242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.817246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.817255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.817262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:15.817267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.817272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:15.817276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.817281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:15.817285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.817290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:15.817295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.817302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:15.817305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.817310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:15.817314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.817318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:15.817330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.817335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:15.817339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.817344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:15.817348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.817353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.817358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.817364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.817368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.817374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.817383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.817387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:15.817391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.817395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:15.817436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:15.817616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255174747010381:7268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:15.819817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255174747010381:7268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:15.821758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:15.822555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:15.822569Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:15.822572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:15.822576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:15.822585Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 744 [2:7556255172370145244:6428]
2025-10-01T14:09:15.822602Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:15.822621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:15.822630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.822634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.822638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.822658Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:15.822663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:15.822670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:15.822734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.822741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.822743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.822745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:15.822748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:15.822821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:15.822830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.822842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:15.822851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:15.822869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:15.822893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010345:2446], now have 1 active actors on pipe
2025-10-01T14:09:15.822907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255172370145239:6428]
2025-10-01T14:09:15.822914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255172370145239:6428]
2025-10-01T14:09:15.822916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255172370145239:6428]
2025-10-01T14:09:15.822933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:15.822949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:15.822968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:15.822975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:15.823014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255172370145239:6428]
2025-10-01T14:09:15.822972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 744
2025-10-01T14:09:15.823020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:15.823083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:15.823090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:15.823092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:15.823097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:15.826796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255174747010381:7268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:15.826812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255174747010381:7268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:15.826815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255174747010381:7268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:15.826825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:15.827167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010421:7268], now have 1 active actors on pipe
2025-10-01T14:09:15.827419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 744
2025-10-01T14:09:15.827490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.827504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.827534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:15.827552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:15.827563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:15.827566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:15.827578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:15.827595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:15.827616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.827907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.827922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.827945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:15.828071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 745 partition: 0 MaxSeqNo: 45 sessionId: src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0
2025-10-01T14:09:15.829926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc0dc6b-2e5d0c37-90b8bc80-78d0144e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:15.832795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0] Write session: try to update token
2025-10-01T14:09:15.832816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:15.837438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:15.837460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:15.837470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255172370145239:6428]
2025-10-01T14:09:15.837517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:15.837527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:15.837706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:15.837860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:15.838011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:15.838155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:15.838346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:15.838411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:15.854878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 745 sessionId: src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:15.857737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:15.857828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:15.857846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:15.857849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:15.857851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:15.857865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255172370145239:6428]
2025-10-01T14:09:15.857869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255172370145239:6428]
2025-10-01T14:09:15.857873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255172370145239:6428]
2025-10-01T14:09:15.857912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:15.857918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:15.857922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:15.857932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:15.857949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:15.857971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:15.857984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:15.857991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:15.858144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:15.892794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255174747010424:6999]
2025-10-01T14:09:15.893041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 744, pipe: [1:7556255174747010424:6999]
2025-10-01T14:09:16.003484Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:16.003831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255174747010424:6999], now have 1 active actors on pipe
2025-10-01T14:09:16.004032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:16.004039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:16.004047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:16.004051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:16.004088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255174747010424:6999]
2025-10-01T14:09:16.004105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 745 reason: error at write: Disconnected sessionId: src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0
2025-10-01T14:09:16.004426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:16.004436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0] Write session will restart in 0.007297s
2025-10-01T14:09:16.004458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0] Write session: Do CDS request
2025-10-01T14:09:16.004465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:16.004287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 745 sessionId: src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0 is DEAD
2025-10-01T14:09:16.012918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.012890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:16.012976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:16.012988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 746
2025-10-01T14:09:16.013205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.013232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:16.013237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:16.013241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:16.013555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 746 sessionId:  describe result for acl check
2025-10-01T14:09:16.013588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:16.013589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:16.013591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:16.013595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255179041977759:7272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:16.014022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255179041977759:7272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:16.014544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:16.015006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:16.015018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:16.015033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:16.015094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:16.015130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255176665112641:6437]
2025-10-01T14:09:16.015642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255179041977759:7272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:16.015660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:16.015932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:16.015982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:16.016349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:16.016401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.016407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.016408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.016409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.016410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.016411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.016413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.016414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.016415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.016416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.016417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.016418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.016419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.016420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.016425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.016434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.016438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.016443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.016446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.016450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.016453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.016456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.016460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.016464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.016467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.016471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.016474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.016477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.016483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.016490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.016496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.016500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.016504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.016508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.016512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.016517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.016521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.016525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.016529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.016534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.016538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.016542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.016546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.016551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.016555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.016560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.016563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.016568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.016572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.016577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.016580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.016585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.016588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.016593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.016597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.016602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.016637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:16.020043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255179041977759:7272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:16.020056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255179041977759:7272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:16.020059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255179041977759:7272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:16.020067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:16.020249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:16.020879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:16.020899Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:16.020901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:16.020905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:16.020911Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 745 [2:7556255176665112641:6437]
2025-10-01T14:09:16.020928Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:16.020943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:16.020947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.020950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.020952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.020968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:16.020979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:16.020985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:16.021040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.021052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.021054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.021057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:16.021060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:16.021120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:16.021128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.021140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.021153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.021174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:16.021196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977795:7272], now have 1 active actors on pipe
2025-10-01T14:09:16.021204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977725:2446], now have 1 active actors on pipe
2025-10-01T14:09:16.021212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255176665112624:6437]
2025-10-01T14:09:16.021219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255176665112624:6437]
2025-10-01T14:09:16.021221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255176665112624:6437]
2025-10-01T14:09:16.021234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:16.021238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 745
2025-10-01T14:09:16.021252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:16.021252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:16.021255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:16.021258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:16.021270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:16.021274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:16.021273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 745
2025-10-01T14:09:16.021303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255176665112624:6437]
2025-10-01T14:09:16.021310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:16.021312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:16.021327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.021335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.021381Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:16.021392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.021396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.021403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:16.021411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.021423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:16.021445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.021582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.021589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.021601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.021672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 746 partition: 0 MaxSeqNo: 45 sessionId: src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0
2025-10-01T14:09:16.022002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7334a66-6a5de1cc-498e9e3f-ca8ac0b0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:16.024504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0] Write session: try to update token
2025-10-01T14:09:16.024524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:16.038014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 746 sessionId: src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:16.040483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:16.042024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.042052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.042075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:16.042079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:16.042081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:16.042083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:16.042091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255176665112624:6437]
2025-10-01T14:09:16.042096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255176665112624:6437]
2025-10-01T14:09:16.042100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255176665112624:6437]
2025-10-01T14:09:16.042147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:16.042160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:16.042160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:16.042164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:16.042167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.042170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:16.042319Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:16.104205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255179041977802:6999]
2025-10-01T14:09:16.104493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 745, pipe: [1:7556255179041977802:6999]
2025-10-01T14:09:16.186992Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:16.187331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:16.187397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977802:6999], now have 1 active actors on pipe
2025-10-01T14:09:16.187491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:16.187590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:16.187596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:16.187674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 746 reason: error at write: Disconnected sessionId: src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0
2025-10-01T14:09:16.187801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 746 sessionId: src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0 is DEAD
2025-10-01T14:09:16.187924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:16.187934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0] Write session will restart in 0.005749s
2025-10-01T14:09:16.187958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0] Write session: Do CDS request
2025-10-01T14:09:16.187965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:16.187961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255179041977802:6999]
2025-10-01T14:09:16.187993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:16.194803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.194899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:16.194911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 747
2025-10-01T14:09:16.195056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.195094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:16.195104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:16.195107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:16.195540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 747 sessionId:  describe result for acl check
2025-10-01T14:09:16.195577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:16.195579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:16.195581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:16.195586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255179041977819:7276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:16.196134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255179041977819:7276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:16.198195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255179041977819:7276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:16.198914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:16.202511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:16.202662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255179041977819:7276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:16.202675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255179041977819:7276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:16.202679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255179041977819:7276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:16.202687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:16.202723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:16.202734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:16.202747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:16.202822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:16.202871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255176665112717:6443]
2025-10-01T14:09:16.203418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:16.203714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:16.203766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:16.204112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:16.204188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.204193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.204194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.204195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.204197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.204198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.204199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.204200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.204210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.204211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.204212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.204213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.204215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.204216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.204221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.204231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.204235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.204238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.204242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.204246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.204250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.204254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.204257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.204262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.204266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.204269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.204273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.204276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.204282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.204290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.204300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.204305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.204313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.204318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.204322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.204330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.204335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.204342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.204347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.204351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.204354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.204356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.204361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.204363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.204365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.204368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.204370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.204372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.204374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.204377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.204379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.204381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.204397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.204400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.204404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.204408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.204437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:16.207911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:16.208642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:16.208666Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:16.208670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:16.208674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:16.208680Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 746 [2:7556255176665112717:6443]
2025-10-01T14:09:16.208699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:16.208714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:16.208722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.208725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.208727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.208742Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:16.208751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:16.208771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:16.208832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.208839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.208841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.208845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:16.208847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:16.208907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:16.208915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.208926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.208936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.208951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:16.208975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977875:7276], now have 1 active actors on pipe
2025-10-01T14:09:16.208982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977805:2446], now have 1 active actors on pipe
2025-10-01T14:09:16.208990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255176665112711:6443]
2025-10-01T14:09:16.208995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255176665112711:6443]
2025-10-01T14:09:16.208999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255176665112711:6443]
2025-10-01T14:09:16.209011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:16.209022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:16.209024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:16.209031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:16.209033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:16.209037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:16.209040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:16.209033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 746
2025-10-01T14:09:16.209038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 746
2025-10-01T14:09:16.209068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255176665112711:6443]
2025-10-01T14:09:16.209076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:16.209077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:16.209106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.209114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.209146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:16.209157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.209168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.209177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:16.209185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.209197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:16.209220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.209377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.209384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.209395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.209463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 747 partition: 0 MaxSeqNo: 45 sessionId: src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0
2025-10-01T14:09:16.209801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f27c4f2-962ad44d-1dec3d8e-781c5bfc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:16.212111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0] Write session: try to update token
2025-10-01T14:09:16.212129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:16.226204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 747 sessionId: src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:16.228556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:16.228741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.228775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.228823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:16.228938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:16.235421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:16.235438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:16.235440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:16.235443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:16.235452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255176665112711:6443]
2025-10-01T14:09:16.235457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255176665112711:6443]
2025-10-01T14:09:16.235461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255176665112711:6443]
2025-10-01T14:09:16.235510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:16.235512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:16.235519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:16.235522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.235522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:16.235525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:16.235661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:16.288000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255179041977895:6999]
2025-10-01T14:09:16.288284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 746, pipe: [1:7556255179041977895:6999]
2025-10-01T14:09:16.382696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:16.390982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.391011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.391189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.391251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.391321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.391394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.391790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.391803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.391877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.391940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.392003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.392072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.392123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.392129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.392193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.392251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.392312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.392373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.392423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.392431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.392496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.392560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.392628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.392695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.392738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.392746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.392821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.392892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.392955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.393018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.393065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.393080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.393149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.393210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.393275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.393340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.393383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.393390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.393452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.393517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.393584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.393648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.393689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.393696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.393760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.393817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.393883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.393943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.393987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.393994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.394066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.394126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.394189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.394252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.394301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.394307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.394390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.394457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.394524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.394593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.394643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.394651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.394717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977895:6999], now have 1 active actors on pipe
2025-10-01T14:09:16.394970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:16.394975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:16.394979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:16.395002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 747 reason: error at write: Disconnected sessionId: src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0
2025-10-01T14:09:16.395018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255179041977895:6999]
2025-10-01T14:09:16.395157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 747 sessionId: src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0 is DEAD
2025-10-01T14:09:16.395282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:16.395292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0] Write session will restart in 0.007262s
2025-10-01T14:09:16.395318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0] Write session: Do CDS request
2025-10-01T14:09:16.395325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:16.395487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:16.403937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.403967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:16.403979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 748
2025-10-01T14:09:16.404173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.404205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:16.404214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:16.404218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:16.404593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 748 sessionId:  describe result for acl check
2025-10-01T14:09:16.404626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:16.404628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:16.404629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:16.404635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255179041977934:7281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:16.405149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255179041977934:7281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:16.405351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:16.407191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:16.407384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:16.407393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:16.407404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:16.407445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:16.407477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255176665112794:6446]
2025-10-01T14:09:16.407579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255179041977934:7281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:16.408204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:16.408510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:16.408553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:16.408807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:16.408870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.408876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.408878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.408879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.408880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.408881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.408882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.408883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.408884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.408885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.408886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.408887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.408888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.408888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.408895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.408903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.408908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.408911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.408916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.408919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.408922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.408926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.408930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.408934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.408938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.408942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.408946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.408949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.408957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.408964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.408970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.408975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.408979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.408984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.408988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.408994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.408998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.409007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.409013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.409022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.409027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.409036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.409041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.409047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.409055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.409060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.409068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.409074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.409082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.409087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.409095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.409099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.409102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.409106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.409110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.409117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.409151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:16.412973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255179041977934:7281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:16.413002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255179041977934:7281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:16.413007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255179041977934:7281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:16.413020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:16.413010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:16.413683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:16.413698Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:16.413700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:16.413704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:16.413711Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 747 [2:7556255176665112794:6446]
2025-10-01T14:09:16.413726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:16.413741Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:16.413743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.413747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.413749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.413766Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:16.413775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:16.413780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:16.413835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.413841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.413843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.413846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:16.413851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:16.413918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:16.413923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.413934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.413944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.413959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:16.413975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977975:7281], now have 1 active actors on pipe
2025-10-01T14:09:16.413986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977900:2446], now have 1 active actors on pipe
2025-10-01T14:09:16.413992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255176665112788:6446]
2025-10-01T14:09:16.413994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255176665112788:6446]
2025-10-01T14:09:16.413996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255176665112788:6446]
2025-10-01T14:09:16.414013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:16.414015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:16.414017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:16.414028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:16.414043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:16.414025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 747
2025-10-01T14:09:16.414061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:16.414068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:16.414086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 747
2025-10-01T14:09:16.414113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.414125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.414138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255176665112788:6446]
2025-10-01T14:09:16.414145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:16.414158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:16.414178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9534732-c1230288-94cd526b-e6155921_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:16.414189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.414193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.414200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:16.414209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.414217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:16.414243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.414443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.414451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.414463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.414545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 748 partition: 0 MaxSeqNo: 45 sessionId: src_id|9534732-c1230288-94cd526b-e6155921_0
2025-10-01T14:09:16.414909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f45eb836-70d680b7-6d734ee-47aa9b7d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9534732-c1230288-94cd526b-e6155921_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:16.417510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9534732-c1230288-94cd526b-e6155921_0] Write session: try to update token
2025-10-01T14:09:16.417531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9534732-c1230288-94cd526b-e6155921_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:16.432434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 748 sessionId: src_id|9534732-c1230288-94cd526b-e6155921_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:16.435077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:16.435195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:16.435217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:16.435219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:16.435221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:16.435234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255176665112788:6446]
2025-10-01T14:09:16.435238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255176665112788:6446]
2025-10-01T14:09:16.435241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255176665112788:6446]
2025-10-01T14:09:16.435265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:16.435270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:16.435273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:16.435296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.435308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.435325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:16.435332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.435338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:16.435452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:16.495424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255179041977983:6999]
2025-10-01T14:09:16.495753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 747, pipe: [1:7556255179041977983:6999]
2025-10-01T14:09:16.584501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:16.584951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977983:6999], now have 1 active actors on pipe
2025-10-01T14:09:16.585143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255179041977983:6999]
2025-10-01T14:09:16.585164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:16.585157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:16.585161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:16.585167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:16.585221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 748 reason: error at write: Disconnected sessionId: src_id|9534732-c1230288-94cd526b-e6155921_0
2025-10-01T14:09:16.585401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 748 sessionId: src_id|9534732-c1230288-94cd526b-e6155921_0 is DEAD
2025-10-01T14:09:16.585540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9534732-c1230288-94cd526b-e6155921_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:16.585551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9534732-c1230288-94cd526b-e6155921_0] Write session will restart in 0.006460s
2025-10-01T14:09:16.585585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9534732-c1230288-94cd526b-e6155921_0] Write session: Do CDS request
2025-10-01T14:09:16.585591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9534732-c1230288-94cd526b-e6155921_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:16.592785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9534732-c1230288-94cd526b-e6155921_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.592862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:16.592872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 749
2025-10-01T14:09:16.592984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.593008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:16.593014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:16.593017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:16.593425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 749 sessionId:  describe result for acl check
2025-10-01T14:09:16.593462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:16.593469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:16.593470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:16.593475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255179041978031:7286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:16.593997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255179041978031:7286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:16.594331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:16.595932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:16.595985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255179041978031:7286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:16.596132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:16.596143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:16.596154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:16.596215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:16.596250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255176665112882:6449]
2025-10-01T14:09:16.596697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:16.596981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:16.597019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:16.597303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:16.597351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.597356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.597358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.597359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.597360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.597361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.597362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.597363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.597364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.597365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.597366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.597369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.597370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.597371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.597377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.597387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.597390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.597393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.597396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.597399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.597412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.597416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.597420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.597423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.597426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.597430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.597433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.597436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.597442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.597448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.597458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.597463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.597467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.597473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.597481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.597486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.597495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.597500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.597507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.597512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.597520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.597524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.597529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.597537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.597541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.597546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.597549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.597558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.597562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.597567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.597575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.597580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.597587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.597591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.597595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.597603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.597643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:16.598460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255179041978031:7286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:16.598472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255179041978031:7286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:16.598475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255179041978031:7286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:16.598484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:16.601338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:16.602012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:16.602035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:16.602038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:16.602041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:16.602048Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 748 [2:7556255176665112882:6449]
2025-10-01T14:09:16.602064Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:16.602083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:16.602092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.602095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.602098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.602114Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:16.602124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:16.602136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:16.602202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.602209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.602211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.602214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:16.602217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:16.602282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:16.602290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.602303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.602312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.602326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:16.602350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041978073:7286], now have 1 active actors on pipe
2025-10-01T14:09:16.602359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041977997:2446], now have 1 active actors on pipe
2025-10-01T14:09:16.602366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255176665112877:6449]
2025-10-01T14:09:16.602392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255176665112877:6449]
2025-10-01T14:09:16.602394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255176665112877:6449]
2025-10-01T14:09:16.602409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:16.602424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:16.602430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:16.602433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:16.602407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 748
2025-10-01T14:09:16.602436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:16.602438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:16.602419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 748
2025-10-01T14:09:16.602442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:16.602487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.602499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.602516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255176665112877:6449]
2025-10-01T14:09:16.602523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:16.602542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:16.602553Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:16.602561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.602570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.602572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:16.602582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.602595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:16.602622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.602831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.602843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.602864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.602947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 749 partition: 0 MaxSeqNo: 45 sessionId: src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0
2025-10-01T14:09:16.603283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9534732-c1230288-94cd526b-e6155921_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:16.605795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0] Write session: try to update token
2025-10-01T14:09:16.605813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:16.620512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 749 sessionId: src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:16.623234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:16.624403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.624426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.624444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:16.624448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:16.624450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:16.624451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:16.624457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255176665112877:6449]
2025-10-01T14:09:16.624460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255176665112877:6449]
2025-10-01T14:09:16.624462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255176665112877:6449]
2025-10-01T14:09:16.624497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:16.624502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:16.624505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:16.624505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:16.624510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.624511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:16.624632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:16.685357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255179041978083:6999]
2025-10-01T14:09:16.685693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 748, pipe: [1:7556255179041978083:6999]
2025-10-01T14:09:16.772218Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:16.772575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:16.772632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041978083:6999], now have 1 active actors on pipe
2025-10-01T14:09:16.772704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:16.774628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:16.774678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255179041978083:6999]
2025-10-01T14:09:16.782990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:16.784820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:16.785034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:16.785046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:16.785058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:16.785105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:16.785147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255176665112967:6451]
2025-10-01T14:09:16.785672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:16.785683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:16.785703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 749 reason: error at write: Disconnected sessionId: src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0
2025-10-01T14:09:16.785720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:16.785830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 749 sessionId: src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0 is DEAD
2025-10-01T14:09:16.786003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:16.786015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0] Write session will restart in 0.005708s
2025-10-01T14:09:16.786040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0] Write session: Do CDS request
2025-10-01T14:09:16.786045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:16.792672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:16.792781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:16.792908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.793150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:16.793222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.793229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.793231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.793232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.793233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.793234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.793235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.793236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.793237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.793240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.793241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.793242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.793243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.793244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.793251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.793260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.793264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.793268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.793272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.793276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.793280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.793282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.793286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.793290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.793293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.793297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.793301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.793304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.793313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.793320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.793326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.793331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.793336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.793340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.793343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.793350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.793354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.793359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.793362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.793367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.793386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.793393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.793401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.793406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.793410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.793415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.793423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.793428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.793432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.793437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.793440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.793445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.793449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.793453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.793457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.793461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.793188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:16.793212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 750
2025-10-01T14:09:16.793310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.793334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:16.793339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:16.793342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:16.793499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:16.793986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 750 sessionId:  describe result for acl check
2025-10-01T14:09:16.794018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:16.794021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:16.794022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:16.794027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255179041978153:7298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:16.794572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255179041978153:7298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:16.796840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255179041978153:7298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:16.797349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:16.797924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:16.797938Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:16.797941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:16.797944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:16.797951Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 749 [2:7556255176665112967:6451]
2025-10-01T14:09:16.797968Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:16.797984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:16.797993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.797996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.797998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.798014Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:16.798023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:16.798031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:16.798089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.798096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.798098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.798100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:16.798102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:16.798164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:16.798170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.798183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.798198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.798213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:16.798229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041978100:2446], now have 1 active actors on pipe
2025-10-01T14:09:16.798236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255176665112962:6451]
2025-10-01T14:09:16.798238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255176665112962:6451]
2025-10-01T14:09:16.798239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255176665112962:6451]
2025-10-01T14:09:16.798251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:16.798265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:16.798274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:16.798276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:16.798279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:16.798283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:16.798285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:16.798313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255176665112962:6451]
2025-10-01T14:09:16.798320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:16.798322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 749
2025-10-01T14:09:16.798346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:16.800092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255179041978153:7298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:16.800106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255179041978153:7298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:16.800109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255179041978153:7298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:16.800115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:16.800303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041978188:7298], now have 1 active actors on pipe
2025-10-01T14:09:16.800344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 749
2025-10-01T14:09:16.800394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.800406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.800430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:16.800439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:16.800446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:16.800448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:16.800458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:16.800474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:16.800491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.800618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.800625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.800637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:16.800709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 750 partition: 0 MaxSeqNo: 45 sessionId: src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0
2025-10-01T14:09:16.801028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c14cc7-7136b191-f0cbdd5-f6025b99_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:16.803713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0] Write session: try to update token
2025-10-01T14:09:16.803730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:16.816803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:16.816826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:16.816837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255176665112962:6451]
2025-10-01T14:09:16.816880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:16.816886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:16.817062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:16.817208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:16.817347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:16.817512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:16.817716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:16.817772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:16.818125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 750 sessionId: src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:16.820649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:16.820923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.820943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.820978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:16.821239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:16.830179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:16.830196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:16.830199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:16.830201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:16.830211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255176665112962:6451]
2025-10-01T14:09:16.830215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255176665112962:6451]
2025-10-01T14:09:16.830219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255176665112962:6451]
2025-10-01T14:09:16.830267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:16.830277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.830280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:16.830300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:16.830313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:16.830317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:16.830434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:16.874782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255179041978191:6999]
2025-10-01T14:09:16.875147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 749, pipe: [1:7556255179041978191:6999]
2025-10-01T14:09:16.976596Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:16.983786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:16.983821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:16.983984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.984038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.984098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.984165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.984207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.984215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.984274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.984325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.984374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.984425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.984470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.984478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.984538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.984595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.984659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.984713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.984754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.984791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.984857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.984924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.984979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.985034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.985082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.985088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.985152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.985217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.985270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.985319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.985360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.985365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.985423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.985476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.985534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.985593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.985637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.985644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.985708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.985759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.985816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.985871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.985916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.985924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.985983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.986038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.986091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.986153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.986199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.986205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.986270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.986327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.986403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.986464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.986510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.986517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.986585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:16.986643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:16.986706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:16.986762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:16.986800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:16.986803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:16.986853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041978191:6999], now have 1 active actors on pipe
2025-10-01T14:09:16.987109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255179041978191:6999]
2025-10-01T14:09:16.987118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:16.987143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:16.987146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:16.987184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 750 reason: error at write: Disconnected sessionId: src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0
2025-10-01T14:09:16.987370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 750 sessionId: src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0 is DEAD
2025-10-01T14:09:16.987494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:16.987505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0] Write session will restart in 0.005415s
2025-10-01T14:09:16.987537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0] Write session: Do CDS request
2025-10-01T14:09:16.987542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:16.987851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:16.993918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.994033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:16.994047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 751
2025-10-01T14:09:16.994168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:16.994203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:16.994209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:16.994212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:16.994576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 751 sessionId:  describe result for acl check
2025-10-01T14:09:16.994611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:16.994613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:16.994615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:16.994620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255179041978233:7302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:16.995115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255179041978233:7302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:16.995591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:16.997074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:16.997273Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:16.997283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:16.997294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:16.997341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:16.997381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255176665113047:6456]
2025-10-01T14:09:16.997435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255179041978233:7302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:16.997980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:16.998247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:16.998292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:16.998610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:16.998671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.998677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.998678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.998679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.998681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.998682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.998683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.998684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.998685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.998686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.998687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.998688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.998689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.998690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.998695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.998704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.998708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.998712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.998715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.998719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.998723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.998727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.998731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.998735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.998738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.998742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.998752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.998756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.998762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.998774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:16.998784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.998789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:16.998797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.998802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:16.998810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.998814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:16.998823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.998827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:16.998835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.998840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:16.998849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.998853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:16.998857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.998865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:16.998869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.998878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:16.998888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.998893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:16.998901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.998906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:16.998913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.998917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:16.998921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.998925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:16.998932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.998935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:16.998973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:17.002483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:17.002584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255179041978233:7302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:17.002599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255179041978233:7302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:17.002603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255179041978233:7302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:17.002613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:17.003178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:17.003193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:17.003196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:17.003199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:17.003206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 750 [2:7556255176665113047:6456]
2025-10-01T14:09:17.003222Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:17.003237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:17.003241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.003244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.003246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.003264Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:17.003275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:17.003282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:17.003338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.003345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.003348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.003351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:17.003354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:17.003419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:17.003426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.003436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.003446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.003465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:17.003487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945567:7302], now have 1 active actors on pipe
2025-10-01T14:09:17.003495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255179041978197:2446], now have 1 active actors on pipe
2025-10-01T14:09:17.003501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255176665113042:6456]
2025-10-01T14:09:17.003506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255176665113042:6456]
2025-10-01T14:09:17.003513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255176665113042:6456]
2025-10-01T14:09:17.003525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:17.003543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:17.003545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:17.003548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:17.003550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:17.003560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:17.003563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:17.003526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 750
2025-10-01T14:09:17.003530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 750
2025-10-01T14:09:17.003589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255176665113042:6456]
2025-10-01T14:09:17.003597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:17.003599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:17.003617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.003625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.003669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f64b0f34-f03d4185-56904e17-6b1684_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:17.003679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.003684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.003690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:17.003701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.003713Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:17.003732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.003888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.003910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.003930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.004001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 751 partition: 0 MaxSeqNo: 45 sessionId: src_id|f64b0f34-f03d4185-56904e17-6b1684_0
2025-10-01T14:09:17.004347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9e2d038-25049028-4e5d49bd-6ef29508_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f64b0f34-f03d4185-56904e17-6b1684_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:17.006824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f64b0f34-f03d4185-56904e17-6b1684_0] Write session: try to update token
2025-10-01T14:09:17.006842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f64b0f34-f03d4185-56904e17-6b1684_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:17.020299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 751 sessionId: src_id|f64b0f34-f03d4185-56904e17-6b1684_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:17.022681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:17.023060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:17.022871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.022895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.022967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:17.025061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:17.025066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:17.025068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:17.025070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:17.025078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255176665113042:6456]
2025-10-01T14:09:17.025081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255176665113042:6456]
2025-10-01T14:09:17.025084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255176665113042:6456]
2025-10-01T14:09:17.025126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:17.025129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:17.025132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.025134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:17.025135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:17.025138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:17.025268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:17.087250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255183336945578:6999]
2025-10-01T14:09:17.087476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 750, pipe: [1:7556255183336945578:6999]
2025-10-01T14:09:17.169640Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:17.177452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.177482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.177660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.177729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.177797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.177862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.178300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.178313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.178399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.178467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.178537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.178617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.178669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.178678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.178749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.178823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.178895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.178969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.179013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.179021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.179089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.179168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.179246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.179316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.179365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.179372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.179445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.179505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.179580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.179650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.179701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.179709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.179787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.179858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.179933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.180008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.180070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.180077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.180156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.180225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.180296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.180369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.180422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.180429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.180504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.180578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.180659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.180739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.180806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.180814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.180903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.180986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.181069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.181149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.181204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.181213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.181296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.181374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.181455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.181536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.181595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.181604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.181898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:17.181910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:17.181939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 751 reason: error at write: Disconnected sessionId: src_id|f64b0f34-f03d4185-56904e17-6b1684_0
2025-10-01T14:09:17.182004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255183336945578:6999]
2025-10-01T14:09:17.182031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:17.182119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 751 sessionId: src_id|f64b0f34-f03d4185-56904e17-6b1684_0 is DEAD
2025-10-01T14:09:17.181676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945578:6999], now have 1 active actors on pipe
2025-10-01T14:09:17.182437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:17.182816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f64b0f34-f03d4185-56904e17-6b1684_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:17.182825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f64b0f34-f03d4185-56904e17-6b1684_0] Write session will restart in 0.005585s
2025-10-01T14:09:17.182851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f64b0f34-f03d4185-56904e17-6b1684_0] Write session: Do CDS request
2025-10-01T14:09:17.182857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f64b0f34-f03d4185-56904e17-6b1684_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:17.189908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f64b0f34-f03d4185-56904e17-6b1684_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.189940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:17.189950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 752
2025-10-01T14:09:17.190110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.190134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:17.190138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:17.190141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:17.190474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 752 sessionId:  describe result for acl check
2025-10-01T14:09:17.190501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:17.190506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:17.190508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:17.190513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255183336945604:7308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:17.191009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255183336945604:7308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:17.192513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:17.193461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255183336945604:7308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:17.194147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:17.194366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:17.194388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:17.194401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:17.194467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:17.194503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255180960080452:6468]
2025-10-01T14:09:17.195146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:17.195448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:17.195506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:17.195868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:17.195928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.195934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.195936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.195937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.195938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.195939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.195940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.195942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.195943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.195944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.195946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.195947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.195948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.195949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.195955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.195965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.195969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.195973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.195977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.195981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.195985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.195989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.195993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.195997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.196001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.196004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.196008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.196011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.196019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.196026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.196033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.196038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.196042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.196048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.196051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.196057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.196062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.196067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.196071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.196087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.196092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.196102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.196107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.196112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.196121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.196126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.196130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.196139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.196144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.196148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.196152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.196158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.196162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.196167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.196171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.196176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.196220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:17.196540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255183336945604:7308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:17.196553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255183336945604:7308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:17.196556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255183336945604:7308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:17.196570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:17.200086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:17.200659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:17.200672Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:17.200675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:17.200679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:17.200686Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 751 [2:7556255180960080452:6468]
2025-10-01T14:09:17.200702Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:17.200733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:17.200742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.200745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.200748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.200771Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:17.200776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:17.200782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:17.200823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.200829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.200831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.200834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:17.200835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:17.200892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:17.200901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.200909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.200914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.200923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:17.200936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255180960080446:6468]
2025-10-01T14:09:17.200938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255180960080446:6468]
2025-10-01T14:09:17.200939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255180960080446:6468]
2025-10-01T14:09:17.200946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:17.200954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:17.200956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:17.200956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:17.200957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:17.200964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:17.200965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:17.200973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945660:7308], now have 1 active actors on pipe
2025-10-01T14:09:17.200975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945581:2446], now have 1 active actors on pipe
2025-10-01T14:09:17.201001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255180960080446:6468]
2025-10-01T14:09:17.201010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:17.201024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:17.201039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 751
2025-10-01T14:09:17.201043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 751
2025-10-01T14:09:17.201116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.201127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.201156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d03413da-181f898a-137528a4-eca21608_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:17.201168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.201171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.201174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:17.201182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.201190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:17.201203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.201398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.201408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.201422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.201525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 752 partition: 0 MaxSeqNo: 45 sessionId: src_id|d03413da-181f898a-137528a4-eca21608_0
2025-10-01T14:09:17.201895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f64b0f34-f03d4185-56904e17-6b1684_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d03413da-181f898a-137528a4-eca21608_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:17.204373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d03413da-181f898a-137528a4-eca21608_0] Write session: try to update token
2025-10-01T14:09:17.204392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d03413da-181f898a-137528a4-eca21608_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:17.219254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 752 sessionId: src_id|d03413da-181f898a-137528a4-eca21608_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:17.221593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:17.222240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.222267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.222288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:17.222291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:17.222294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:17.222296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:17.222304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255180960080446:6468]
2025-10-01T14:09:17.222308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255180960080446:6468]
2025-10-01T14:09:17.222312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255180960080446:6468]
2025-10-01T14:09:17.222385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:17.222383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:17.222391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:17.222395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:17.222398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.222401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:17.222535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:17.282342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255183336945674:6999]
2025-10-01T14:09:17.283301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 751, pipe: [1:7556255183336945674:6999]
2025-10-01T14:09:17.368438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:17.369071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:17.369222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:17.369140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945674:6999], now have 1 active actors on pipe
2025-10-01T14:09:17.369374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255183336945674:6999]
2025-10-01T14:09:17.369400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:17.378074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:17.379341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:17.379353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:17.379377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 752 reason: error at write: Disconnected sessionId: src_id|d03413da-181f898a-137528a4-eca21608_0
2025-10-01T14:09:17.379540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 752 sessionId: src_id|d03413da-181f898a-137528a4-eca21608_0 is DEAD
2025-10-01T14:09:17.379712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d03413da-181f898a-137528a4-eca21608_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:17.379724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d03413da-181f898a-137528a4-eca21608_0] Write session will restart in 0.008204s
2025-10-01T14:09:17.379752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d03413da-181f898a-137528a4-eca21608_0] Write session: Do CDS request
2025-10-01T14:09:17.379758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d03413da-181f898a-137528a4-eca21608_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:17.385399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:17.385640Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:17.385652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:17.385664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:17.385717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:17.385756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255180960080534:6471]
2025-10-01T14:09:17.386344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:17.386671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:17.386718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:17.387001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:17.387059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.387068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.387069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.387070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.387071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.387072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.387073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.387074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.387076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.387077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.387078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.387079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.387080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.387081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.387086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.387094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.387097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.387103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.387106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.387109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.387112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.387115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.387119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.387122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.387125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.387128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.387130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.387134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.387142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.387148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.387154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.387159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.387163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.387166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.387170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.387175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.387179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.387183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.387187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.387191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.387195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.387199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.387202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.387207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.387212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.387216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.387220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.387224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.387229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.387233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.387237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.387242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.387245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.387249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.387253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.387257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.387293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:17.388944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d03413da-181f898a-137528a4-eca21608_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.389009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:17.389020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 753
2025-10-01T14:09:17.389142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.389182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:17.389192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:17.389198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:17.389608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 753 sessionId:  describe result for acl check
2025-10-01T14:09:17.389640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:17.389642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:17.389644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:17.389648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255183336945726:7313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:17.390303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255183336945726:7313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:17.391396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:17.392066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:17.392078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:17.392081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:17.392084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:17.392091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 752 [2:7556255180960080534:6471]
2025-10-01T14:09:17.392107Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:17.392124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:17.392128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.392131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.392134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.392152Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:17.392163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:17.392169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:17.392225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.392234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.392235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.392238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:17.392241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:17.392308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:17.392316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.392328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.392344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.392366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:17.392387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255180960080528:6471]
2025-10-01T14:09:17.392389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255180960080528:6471]
2025-10-01T14:09:17.392392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255180960080528:6471]
2025-10-01T14:09:17.392404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:17.392411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:17.392414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:17.392416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:17.392425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945680:2446], now have 1 active actors on pipe
2025-10-01T14:09:17.392436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 752
2025-10-01T14:09:17.392434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:17.392449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:17.392452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:17.392490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255180960080528:6471]
2025-10-01T14:09:17.392501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:17.392506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:17.392616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255183336945726:7313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:17.402837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255183336945726:7313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:17.402852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255183336945726:7313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:17.402856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255183336945726:7313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:17.402864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:17.403159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945764:7313], now have 1 active actors on pipe
2025-10-01T14:09:17.403210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 752
2025-10-01T14:09:17.403273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.403287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.403318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c28c44f-35a44077-d6584156-7fe09150_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:17.403334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.403346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.403353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:17.403366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.403386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:17.403413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.403703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.403715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.403737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.403805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 753 partition: 0 MaxSeqNo: 45 sessionId: src_id|6c28c44f-35a44077-d6584156-7fe09150_0
2025-10-01T14:09:17.404156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d03413da-181f898a-137528a4-eca21608_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6c28c44f-35a44077-d6584156-7fe09150_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:17.406605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c28c44f-35a44077-d6584156-7fe09150_0] Write session: try to update token
2025-10-01T14:09:17.406623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c28c44f-35a44077-d6584156-7fe09150_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:17.413526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:17.413545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:17.413546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:17.413548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:17.413555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255180960080528:6471]
2025-10-01T14:09:17.413560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255180960080528:6471]
2025-10-01T14:09:17.413565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255180960080528:6471]
2025-10-01T14:09:17.413605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:17.413612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:17.413617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:17.413618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.413619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:17.413621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:17.413743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:17.420593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 753 sessionId: src_id|6c28c44f-35a44077-d6584156-7fe09150_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:17.423154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:17.469730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255183336945768:6999]
2025-10-01T14:09:17.470002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 752, pipe: [1:7556255183336945768:6999]
2025-10-01T14:09:17.555586Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:17.555869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.555883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.555905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945768:6999], now have 1 active actors on pipe
2025-10-01T14:09:17.556128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:17.556154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255183336945768:6999]
2025-10-01T14:09:17.556182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:17.556213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:17.556278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 753 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6c28c44f-35a44077-d6584156-7fe09150_0
2025-10-01T14:09:17.556457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 753 sessionId: src_id|6c28c44f-35a44077-d6584156-7fe09150_0 is DEAD
2025-10-01T14:09:17.556582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c28c44f-35a44077-d6584156-7fe09150_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:17.556601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c28c44f-35a44077-d6584156-7fe09150_0] Write session will restart in 0.008107s
2025-10-01T14:09:17.556628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c28c44f-35a44077-d6584156-7fe09150_0] Write session: Do CDS request
2025-10-01T14:09:17.556634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c28c44f-35a44077-d6584156-7fe09150_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:17.564105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:17.565618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:17.565790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:17.565808Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:17.565820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:17.565847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c28c44f-35a44077-d6584156-7fe09150_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.565867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:17.565904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255180960080626:6474]
2025-10-01T14:09:17.565975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:17.565986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 754
2025-10-01T14:09:17.566093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.566119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:17.566129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:17.566133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:17.566387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:17.566501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 754 sessionId:  describe result for acl check
2025-10-01T14:09:17.566535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:17.566543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:17.566545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:17.566550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255183336945826:7318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:17.566630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:17.566663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:17.566881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:17.566921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.566925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.566925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.566926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.566927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.566927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.566928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.566929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.566929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.566930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.566931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.566931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.566933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.566933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.566936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.566942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.566944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.566946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.566948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.566950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.566952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.566954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.566957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.566960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.566963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.566966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.566970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.566972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.566979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.566986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.566992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.566996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.567000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.567005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.567009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.567013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.567020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.567025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.567029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.567033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.567039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.567042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.567044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.567047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.567050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.567053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.567055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.567058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.567060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.567062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.567064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.567067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.567069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.567072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.567074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.567077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.567101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255183336945826:7318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:17.567108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:17.568878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255183336945826:7318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:17.570627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:17.571234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:17.571246Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:17.571248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:17.571251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:17.571258Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 753 [2:7556255180960080626:6474]
2025-10-01T14:09:17.571273Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:17.571288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:17.571290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.571293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.571296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.571309Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:17.571314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:17.571321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:17.571372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.571380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.571382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.571385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:17.571387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:17.571449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:17.571456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.571466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.571475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.571495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:17.571517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945781:2446], now have 1 active actors on pipe
2025-10-01T14:09:17.571528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255180960080621:6474]
2025-10-01T14:09:17.571534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255180960080621:6474]
2025-10-01T14:09:17.571536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255180960080621:6474]
2025-10-01T14:09:17.571547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:17.571535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 753
2025-10-01T14:09:17.571564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:17.571567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:17.571573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:17.571575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:17.571580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:17.571583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:17.571613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255180960080621:6474]
2025-10-01T14:09:17.571622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:17.571633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:17.571800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255183336945826:7318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:17.571812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255183336945826:7318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:17.571816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255183336945826:7318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:17.571823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:17.571984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945865:7318], now have 1 active actors on pipe
2025-10-01T14:09:17.572035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 753
2025-10-01T14:09:17.572074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.572085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.572107Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50424419-767ddb62-daa3bfa3-2996292d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:17.572114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.572119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.572121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:17.572128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.572141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:17.572158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.572266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.572271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.572280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.572338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 754 partition: 0 MaxSeqNo: 45 sessionId: src_id|50424419-767ddb62-daa3bfa3-2996292d_0
2025-10-01T14:09:17.572657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c28c44f-35a44077-d6584156-7fe09150_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50424419-767ddb62-daa3bfa3-2996292d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:17.575064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50424419-767ddb62-daa3bfa3-2996292d_0] Write session: try to update token
2025-10-01T14:09:17.575077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50424419-767ddb62-daa3bfa3-2996292d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:17.582761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:17.582780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:17.582790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255180960080621:6474]
2025-10-01T14:09:17.582827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:17.582839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:17.583002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:17.583148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:17.583282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:17.583416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:17.583598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:17.583640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:17.588953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 754 sessionId: src_id|50424419-767ddb62-daa3bfa3-2996292d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:17.591421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:17.591634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.591652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.591684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:17.591754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:17.603257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:17.603280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:17.603282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:17.603285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:17.603298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255180960080621:6474]
2025-10-01T14:09:17.603301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255180960080621:6474]
2025-10-01T14:09:17.603306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255180960080621:6474]
2025-10-01T14:09:17.603347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:17.603348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:17.603354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:17.603354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.603357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:17.603358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:17.603483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:17.656142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255183336945871:6999]
2025-10-01T14:09:17.656455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 753, pipe: [1:7556255183336945871:6999]
2025-10-01T14:09:17.748895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:17.756472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.756499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.756643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.756696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.756768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.756824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.756874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.756882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.756942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.756994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.757044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.757097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.757142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.757148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.757204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.757255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.757307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.757366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.757417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.757426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.757490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.757543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.757597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.757650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.757688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.757693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.757762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.757819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.757872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.757932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.757974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.757979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.758040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.758097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.758152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.758209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.758252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.758258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.758318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.758387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.758457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.758517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.758553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.758559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.758612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.758661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.758713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.758774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.758823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.758828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.758887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.758939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.758993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.759045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.759091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.759100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.759159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.759207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.759261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.759319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.759363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.759368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.759423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945871:6999], now have 1 active actors on pipe
2025-10-01T14:09:17.759725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255183336945871:6999]
2025-10-01T14:09:17.759760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:17.759763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:17.759788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 754 reason: error at write: Disconnected sessionId: src_id|50424419-767ddb62-daa3bfa3-2996292d_0
2025-10-01T14:09:17.759929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:17.759982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 754 sessionId: src_id|50424419-767ddb62-daa3bfa3-2996292d_0 is DEAD
2025-10-01T14:09:17.760126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50424419-767ddb62-daa3bfa3-2996292d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:17.760136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50424419-767ddb62-daa3bfa3-2996292d_0] Write session will restart in 0.005459s
2025-10-01T14:09:17.760162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50424419-767ddb62-daa3bfa3-2996292d_0] Write session: Do CDS request
2025-10-01T14:09:17.760168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50424419-767ddb62-daa3bfa3-2996292d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:17.760219Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:17.767880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50424419-767ddb62-daa3bfa3-2996292d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.767940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:17.767951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 755
2025-10-01T14:09:17.768123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.768172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:17.768181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:17.768185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:17.768602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 755 sessionId:  describe result for acl check
2025-10-01T14:09:17.768647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:17.768653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:17.768655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:17.768660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255183336945916:7323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:17.769203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255183336945916:7323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:17.769506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:17.771040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:17.771254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:17.771268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:17.771280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:17.771344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:17.771389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255180960080710:6476]
2025-10-01T14:09:17.771533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255183336945916:7323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:17.771977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:17.772302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:17.772357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:17.772689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:17.772747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.772754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.772755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.772771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.772772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.772773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.772775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.772776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.772777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.772778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.772780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.772781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.772782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.772784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.772789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.772799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.772803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.772807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.772811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.772815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.772819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.772823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.772827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.772832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.772835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.772840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.772844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.772847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.772855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.772862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.772868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.772890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.772899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.772904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.772908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.772913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.772918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.772923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.772928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.772933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.772938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.772943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.772947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.772952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.772958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.772967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.772971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.772977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.772985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.772991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.772995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.773001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.773005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.773010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.773015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.773020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.773062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:17.776717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255183336945916:7323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:17.776734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255183336945916:7323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:17.776738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255183336945916:7323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:17.776747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:17.776930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:17.777621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:17.777636Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:17.777639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:17.777642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:17.777650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 754 [2:7556255180960080710:6476]
2025-10-01T14:09:17.777665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:17.777680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:17.777688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.777692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.777695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.777710Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:17.777716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:17.777727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:17.777775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.777785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.777787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.777791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:17.777793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:17.777858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:17.777866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.777877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.777889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.777908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:17.777926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255180960080705:6476]
2025-10-01T14:09:17.777931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255180960080705:6476]
2025-10-01T14:09:17.777933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255180960080705:6476]
2025-10-01T14:09:17.777941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:17.777952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:17.777957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:17.777970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:17.777961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:17.777977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:17.777978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:17.777987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945956:7323], now have 1 active actors on pipe
2025-10-01T14:09:17.777991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945875:2446], now have 1 active actors on pipe
2025-10-01T14:09:17.778024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255180960080705:6476]
2025-10-01T14:09:17.778034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:17.778040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:17.778057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 754
2025-10-01T14:09:17.778093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 754
2025-10-01T14:09:17.778123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.778131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.778158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4317c8d-620336f0-af6cbed6-424ea218_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:17.778167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:17.778173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:17.778175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:17.778185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:17.778197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:17.778215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.778345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.778353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.778366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:17.778455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 755 partition: 0 MaxSeqNo: 45 sessionId: src_id|b4317c8d-620336f0-af6cbed6-424ea218_0
2025-10-01T14:09:17.778816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50424419-767ddb62-daa3bfa3-2996292d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b4317c8d-620336f0-af6cbed6-424ea218_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:17.781340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4317c8d-620336f0-af6cbed6-424ea218_0] Write session: try to update token
2025-10-01T14:09:17.781359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4317c8d-620336f0-af6cbed6-424ea218_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:17.799438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 755 sessionId: src_id|b4317c8d-620336f0-af6cbed6-424ea218_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:17.801848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:17.802048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.802079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.802125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:17.802289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:17.820187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:17.820206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:17.820208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:17.820209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:17.820218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255180960080705:6476]
2025-10-01T14:09:17.820222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255180960080705:6476]
2025-10-01T14:09:17.820224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255180960080705:6476]
2025-10-01T14:09:17.820270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:17.820274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:17.820277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:17.820280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.820281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:17.820283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:17.820403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:17.859884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255183336945986:6999]
2025-10-01T14:09:17.860194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 754, pipe: [1:7556255183336945986:6999]
2025-10-01T14:09:17.971083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:17.979337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:17.979375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:17.979558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.979629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.979701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.979768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.979821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.979826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.979905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.979977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.980051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.980126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.980180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.980190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.980252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.980317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.980388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.980462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.980514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.980517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.980585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.980652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.980714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.980783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.980830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.980833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.980899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.980955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.981011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.981077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.981120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.981123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.981194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.981253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.981318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.981380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.981428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.981431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.981503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.981566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.981625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.981687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.981728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.981731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.981797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.981857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.981921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.981985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.982026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.982029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.982100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.982156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.982210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.982268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.982307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.982310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.982390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:17.982442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:17.982500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:17.982559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:17.982596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:17.982599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:17.982697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945986:6999], now have 1 active actors on pipe
2025-10-01T14:09:17.983890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:17.984019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:17.984458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4317c8d-620336f0-af6cbed6-424ea218_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:17.984480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4317c8d-620336f0-af6cbed6-424ea218_0] Write session will restart in 0.008460s
2025-10-01T14:09:17.984029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:17.984029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255183336945986:6999]
2025-10-01T14:09:17.984052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:17.984061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 755 reason: error at write: Disconnected sessionId: src_id|b4317c8d-620336f0-af6cbed6-424ea218_0
2025-10-01T14:09:17.984279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 755 sessionId: src_id|b4317c8d-620336f0-af6cbed6-424ea218_0 is DEAD
2025-10-01T14:09:17.984517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4317c8d-620336f0-af6cbed6-424ea218_0] Write session: Do CDS request
2025-10-01T14:09:17.984523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4317c8d-620336f0-af6cbed6-424ea218_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:17.993327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:17.993886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4317c8d-620336f0-af6cbed6-424ea218_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.993911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:17.993921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 756
2025-10-01T14:09:17.994112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:17.994154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:17.994163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:17.994167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:17.994579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 756 sessionId:  describe result for acl check
2025-10-01T14:09:17.994615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:17.994623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:17.994626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:17.994631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255183336946036:7334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:17.994873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:17.995085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:17.995095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:17.995105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:17.995151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:17.995147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255183336946036:7334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:17.995185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255180960080802:6481]
2025-10-01T14:09:17.995734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:17.995949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:17.995981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:17.996244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:17.996287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.996292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.996293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.996294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.996295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.996296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.996297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.996298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.996299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.996300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.996301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.996301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.996302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.996303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.996307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.996315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.996319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.996322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.996326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.996329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.996332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.996335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.996337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.996341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.996343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.996347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.996350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.996352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.996358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.996364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:17.996369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.996374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:17.996378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.996382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:17.996386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.996390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:17.996394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.996398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:17.996401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.996406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:17.996409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.996414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:17.996417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.996421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:17.996424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.996429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:17.996432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.996436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:17.996440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.996444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:17.996447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.996451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:17.996454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.996460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:17.996463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.996467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:17.996499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:17.996821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255183336946036:7334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:17.999876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255183336946036:7334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:17.999891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255183336946036:7334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:17.999895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255183336946036:7334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:17.999903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:18.000077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:18.000642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:18.000655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:18.000657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:18.000659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:18.000665Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 755 [2:7556255180960080802:6481]
2025-10-01T14:09:18.000679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:18.000693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:18.000698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.000702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.000704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.000719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:18.000729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:18.000733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:18.000787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.000793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.000796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.000799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:18.000801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:18.000860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:18.000866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.000876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.000884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.000901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:18.000920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336945992:2446], now have 1 active actors on pipe
2025-10-01T14:09:18.000924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 755
2025-10-01T14:09:18.000932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255183336946072:7334], now have 1 active actors on pipe
2025-10-01T14:09:18.000939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255180960080797:6481]
2025-10-01T14:09:18.000941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255180960080797:6481]
2025-10-01T14:09:18.000947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 755
2025-10-01T14:09:18.000942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255180960080797:6481]
2025-10-01T14:09:18.000951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:18.000959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:18.000962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:18.000964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:18.000964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:18.000975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:18.000977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:18.001013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.001023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.001038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255180960080797:6481]
2025-10-01T14:09:18.001048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:18.001056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:18.001078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:18.001088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.001095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.001097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:18.001105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.001113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:18.001136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.001248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.001254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.001265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.001340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 756 partition: 0 MaxSeqNo: 45 sessionId: src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0
2025-10-01T14:09:18.001655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4317c8d-620336f0-af6cbed6-424ea218_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:18.003957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0] Write session: try to update token
2025-10-01T14:09:18.003976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:18.021510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:18.021532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:18.021534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:18.021539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:18.021550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255180960080797:6481]
2025-10-01T14:09:18.021555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255180960080797:6481]
2025-10-01T14:09:18.021560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255180960080797:6481]
2025-10-01T14:09:18.021603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:18.021612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:18.021616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:18.021619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.021620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:18.021621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:18.021757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:18.023029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 756 sessionId: src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:18.025421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:18.084114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255187631913375:6999]
2025-10-01T14:09:18.084359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 755, pipe: [1:7556255187631913375:6999]
2025-10-01T14:09:18.167232Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:18.167578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.167594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.167637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913375:6999], now have 1 active actors on pipe
2025-10-01T14:09:18.167844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:18.167868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:18.167883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:18.167898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:18.167943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 756 reason: error at write: Disconnected sessionId: src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0
2025-10-01T14:09:18.167950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255187631913375:6999]
2025-10-01T14:09:18.168131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 756 sessionId: src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0 is DEAD
2025-10-01T14:09:18.168253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:18.168261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0] Write session will restart in 0.009302s
2025-10-01T14:09:18.168287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0] Write session: Do CDS request
2025-10-01T14:09:18.168292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:18.176090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:18.177474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:18.177653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:18.177666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:18.177677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:18.177728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:18.177772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255185255048212:6493]
2025-10-01T14:09:18.178328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:18.178612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:18.178667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:18.178891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.178968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:18.178979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 757
2025-10-01T14:09:18.178997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:18.179062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.179069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.179070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.179071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.179072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.179073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.179074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.179075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.179075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.179076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.179077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.179078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.179078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.179079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.179086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.179104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.179106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.179109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.179112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.179115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.179118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.179121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.179123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.179126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.179129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.179132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.179135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.179138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.179145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.179151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.179156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.179161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.179164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.179172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.179176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.179180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.179184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.179189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.179196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.179200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.179204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.179208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.179215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.179219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.179222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.179228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.179235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.179238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.179242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.179246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.179255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.179259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.179262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.179266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.179269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.179273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.179306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:18.179115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.179161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:18.179166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:18.179170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:18.179528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 757 sessionId:  describe result for acl check
2025-10-01T14:09:18.179559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:18.179561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:18.179562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:18.179567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255187631913429:7338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:18.180070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255187631913429:7338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:18.182155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255187631913429:7338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:18.182847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:18.183489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:18.183503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:18.183505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:18.183509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:18.183515Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 756 [2:7556255185255048212:6493]
2025-10-01T14:09:18.183529Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:18.183548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:18.183551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.183553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.183556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.183570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:18.183580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:18.183585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:18.183639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.183644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.183645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.183647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:18.183649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:18.183696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:18.183704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.183714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.183723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.183740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:18.183763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913380:2446], now have 1 active actors on pipe
2025-10-01T14:09:18.183774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255185255048207:6493]
2025-10-01T14:09:18.183779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255185255048207:6493]
2025-10-01T14:09:18.183780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255185255048207:6493]
2025-10-01T14:09:18.183789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:18.183801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:18.183806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:18.183809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:18.183811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:18.183818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:18.183821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:18.183844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255185255048207:6493]
2025-10-01T14:09:18.183850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:18.183853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:18.183832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 756
2025-10-01T14:09:18.185438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255187631913429:7338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:18.185453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255187631913429:7338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:18.185457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255187631913429:7338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:18.185464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:18.185651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913462:7338], now have 1 active actors on pipe
2025-10-01T14:09:18.185696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 756
2025-10-01T14:09:18.185754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.185768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.185794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:18.185815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.185824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.185827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:18.185836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.185853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:18.185870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.186016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.186022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.186035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.186094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 757 partition: 0 MaxSeqNo: 45 sessionId: src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0
2025-10-01T14:09:18.186442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f727eeac-6b7e3a8e-47afa797-b6b58d17_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:18.188787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0] Write session: try to update token
2025-10-01T14:09:18.188806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:18.199963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:18.199982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:18.199990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255185255048207:6493]
2025-10-01T14:09:18.200028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:18.200032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:18.200188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:18.200321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:18.200452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:18.200589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:18.200783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:18.200822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:18.207477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 757 sessionId: src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:18.210105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:18.210287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.210307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.210351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:18.210425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:18.215166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:18.215185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:18.215187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:18.215189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:18.215199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255185255048207:6493]
2025-10-01T14:09:18.215203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255185255048207:6493]
2025-10-01T14:09:18.215207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255185255048207:6493]
2025-10-01T14:09:18.215239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:18.215247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:18.215249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:18.215250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:18.215257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.215259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:18.215382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:18.267928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255187631913475:6999]
2025-10-01T14:09:18.268441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 756, pipe: [1:7556255187631913475:6999]
2025-10-01T14:09:18.357599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:18.364584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.364611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.364773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.364829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.364885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.364942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.364983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.364994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.365051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.365107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.365159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.365216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.365264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.365270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.365333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.365394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.365447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.365507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.365604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.365609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.365679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.365732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.365785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.365847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.365933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.365940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.366004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.366056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.366111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.366166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.366208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.366214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.366276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.366327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.366410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.366476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.366521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.366530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.366602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.366665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.366738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.366818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.366864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.366871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.366941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.367004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.367069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.367140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.367187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.367195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.367269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.367336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.367402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.367455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.367495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.367500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.367558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.367613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.367664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.367715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.367756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.367761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.367813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913475:6999], now have 1 active actors on pipe
2025-10-01T14:09:18.368021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:18.368066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:18.368069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:18.368080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255187631913475:6999]
2025-10-01T14:09:18.368099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 757 reason: error at write: Disconnected sessionId: src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0
2025-10-01T14:09:18.368311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 757 sessionId: src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0 is DEAD
2025-10-01T14:09:18.368493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:18.368504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0] Write session will restart in 0.008701s
2025-10-01T14:09:18.368530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0] Write session: Do CDS request
2025-10-01T14:09:18.368537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:18.368650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:18.376621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:18.378219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:18.378422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:18.378432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:18.378442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:18.378518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:18.378565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255185255048298:6496]
2025-10-01T14:09:18.378880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.378931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:18.378955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 758
2025-10-01T14:09:18.379120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.379135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:18.379154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:18.379164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:18.379168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:18.379456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:18.379498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:18.379548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 758 sessionId:  describe result for acl check
2025-10-01T14:09:18.379583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:18.379584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:18.379586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:18.379591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255187631913529:7343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:18.379834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:18.379894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.379899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.379900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.379903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.379904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.379905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.379906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.379907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.379908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.379909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.379910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.379911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.379912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.379913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.379919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.379927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.379930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.379934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.379937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.379940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.379944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.379946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.379950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.379955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.379958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.379961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.379964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.379967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.379974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.379982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.379995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.380005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.380014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.380019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.380025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.380034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.380038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.380044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.380052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.380056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.380065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.380074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.380077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.380086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.380090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.380096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.380099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.380104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.380108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.380113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.380116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.380121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.380124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.380095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255187631913529:7343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:18.380129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.380138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.380143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.380182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:18.382497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255187631913529:7343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:18.383932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:18.384642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:18.384657Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:18.384659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:18.384663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:18.384669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 757 [2:7556255185255048298:6496]
2025-10-01T14:09:18.384683Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:18.384702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:18.384707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.384712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.384714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.384729Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:18.384738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:18.384744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:18.384802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.384809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.384812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.384815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:18.384817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:18.384875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:18.384882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.384892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.384901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.384913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:18.384934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913480:2446], now have 1 active actors on pipe
2025-10-01T14:09:18.384946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255185255048293:6496]
2025-10-01T14:09:18.384951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255185255048293:6496]
2025-10-01T14:09:18.384953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255185255048293:6496]
2025-10-01T14:09:18.384965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:18.384977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:18.384967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 757
2025-10-01T14:09:18.384980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:18.384980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:18.384982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:18.384991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:18.384993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:18.385027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255185255048293:6496]
2025-10-01T14:09:18.385035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:18.385042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:18.385461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255187631913529:7343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:18.385474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255187631913529:7343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:18.385478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255187631913529:7343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:18.385485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:18.385672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913567:7343], now have 1 active actors on pipe
2025-10-01T14:09:18.385726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.385691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 757
2025-10-01T14:09:18.385737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.385762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:18.385774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.385785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.385787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:18.385795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.385806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:18.385824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.385967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.385975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.385988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.386067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 758 partition: 0 MaxSeqNo: 45 sessionId: src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0
2025-10-01T14:09:18.386408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ec8603d-72338faf-aa2bd453-f26d04d8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:18.388962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0] Write session: try to update token
2025-10-01T14:09:18.388979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:18.396003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:18.396024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:18.396032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255185255048293:6496]
2025-10-01T14:09:18.396075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:18.396079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:18.396229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:18.396351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:18.396479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:18.396599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:18.396789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:18.396827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:18.403258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 758 sessionId: src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:18.405646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:18.405837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.405859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.405896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:18.405987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:18.414239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:18.414258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:18.414261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:18.414263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:18.414272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255185255048293:6496]
2025-10-01T14:09:18.414279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255185255048293:6496]
2025-10-01T14:09:18.414282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255185255048293:6496]
2025-10-01T14:09:18.414332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:18.414352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.414360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:18.414426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:18.414440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:18.414444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:18.414520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:18.468112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255187631913573:6999]
2025-10-01T14:09:18.468364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 757, pipe: [1:7556255187631913573:6999]
2025-10-01T14:09:18.559602Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:18.566725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.566754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.566930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.566997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.567061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.567128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.567176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.567187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.567258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.567325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.567384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.567445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.567486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.567491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.567553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.567608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.567662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.567724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.567773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.567780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.567850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.567904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.567958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.568017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.568059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.568065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.568124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.568177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.568239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.568304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.568348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.568354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.568416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.568471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.568526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.568583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.568632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.568638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.568699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.568765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.568838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.568900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.568940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.568946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.569002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.569053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.569111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.569167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.569202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.569206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.569275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.569339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.569397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.569452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.569491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.569497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.569553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:18.569605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:18.569658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:18.569710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:18.569750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:18.569758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:18.569809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913573:6999], now have 1 active actors on pipe
2025-10-01T14:09:18.570080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:18.570090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:18.570093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255187631913573:6999]
2025-10-01T14:09:18.570113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:18.570131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 758 reason: error at write: Disconnected sessionId: src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0
2025-10-01T14:09:18.570315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 758 sessionId: src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0 is DEAD
2025-10-01T14:09:18.570460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:18.570468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0] Write session will restart in 0.005412s
2025-10-01T14:09:18.570487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0] Write session: Do CDS request
2025-10-01T14:09:18.570493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:18.570596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:18.576841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.576975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:18.576986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 759
2025-10-01T14:09:18.577110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.577141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:18.577150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:18.577153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:18.577547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 759 sessionId:  describe result for acl check
2025-10-01T14:09:18.577577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:18.577584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:18.577585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:18.577592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255187631913631:7348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:18.578092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255187631913631:7348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:18.578850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:18.579960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255187631913631:7348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:18.580328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:18.580502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:18.580512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:18.580533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:18.580582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:18.580631Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255185255048396:6499]
2025-10-01T14:09:18.581160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:18.581405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:18.581443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:18.581702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:18.581775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.581783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.581784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.581785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.581786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.581787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.581789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.581789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.581791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.581791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.581792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.581793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.581794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.581795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.581800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.581808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.581812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.581816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.581819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.581823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.581826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.581830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.581833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.581837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.581840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.581844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.581847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.581851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.581860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.581867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.581873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.581881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.581885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.581889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.581893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.581898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.581902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.581907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.581911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.581916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.581919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.581924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.581927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.581932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.581936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.581940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.581944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.581949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.581952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.581957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.581960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.581964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.581968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.581972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.581976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.581980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.582015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:18.582537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255187631913631:7348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:18.582552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255187631913631:7348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:18.582557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255187631913631:7348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:18.582565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:18.585843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:18.586499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:18.586516Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:18.586520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:18.586524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:18.586531Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 758 [2:7556255185255048396:6499]
2025-10-01T14:09:18.586546Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:18.586567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:18.586581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.586584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.586586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.586602Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:18.586608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:18.586613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:18.586668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.586676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.586679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.586682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:18.586685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:18.586754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:18.586761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.586774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.586789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.586809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:18.586833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913673:7348], now have 1 active actors on pipe
2025-10-01T14:09:18.586841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913587:2446], now have 1 active actors on pipe
2025-10-01T14:09:18.586848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255185255048391:6499]
2025-10-01T14:09:18.586850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255185255048391:6499]
2025-10-01T14:09:18.586852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255185255048391:6499]
2025-10-01T14:09:18.586864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:18.586876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:18.586879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:18.586886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:18.586888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:18.586894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:18.586899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:18.586898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 758
2025-10-01T14:09:18.586933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255185255048391:6499]
2025-10-01T14:09:18.586945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:18.586961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:18.586962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.586968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.587013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67a5612b-c6d708de-491deb61-41eef120_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:18.587024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.587029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.587031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:18.587028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 758
2025-10-01T14:09:18.587040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.587049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:18.587072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.587217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.587227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.587243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.587309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 759 partition: 0 MaxSeqNo: 45 sessionId: src_id|67a5612b-c6d708de-491deb61-41eef120_0
2025-10-01T14:09:18.587654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe6b1c4-52118915-94e938e5-dbc354a6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67a5612b-c6d708de-491deb61-41eef120_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:18.590614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a5612b-c6d708de-491deb61-41eef120_0] Write session: try to update token
2025-10-01T14:09:18.590633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a5612b-c6d708de-491deb61-41eef120_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:18.604716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 759 sessionId: src_id|67a5612b-c6d708de-491deb61-41eef120_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:18.607102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:18.607940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.607961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.607980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:18.607984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:18.607985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:18.607987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:18.607993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255185255048391:6499]
2025-10-01T14:09:18.607995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255185255048391:6499]
2025-10-01T14:09:18.607998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255185255048391:6499]
2025-10-01T14:09:18.608038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:18.608044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:18.608047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:18.608049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:18.608057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.608060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:18.608215Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:18.670420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255187631913681:6999]
2025-10-01T14:09:18.670710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 758, pipe: [1:7556255187631913681:6999]
2025-10-01T14:09:18.753182Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:18.753464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:18.753510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913681:6999], now have 1 active actors on pipe
2025-10-01T14:09:18.753596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:18.753665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:18.753690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:18.753694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:18.753712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255187631913681:6999]
2025-10-01T14:09:18.753782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 759 reason: error at write: Disconnected sessionId: src_id|67a5612b-c6d708de-491deb61-41eef120_0
2025-10-01T14:09:18.753956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 759 sessionId: src_id|67a5612b-c6d708de-491deb61-41eef120_0 is DEAD
2025-10-01T14:09:18.754070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a5612b-c6d708de-491deb61-41eef120_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:18.754081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a5612b-c6d708de-491deb61-41eef120_0] Write session will restart in 0.007390s
2025-10-01T14:09:18.754106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a5612b-c6d708de-491deb61-41eef120_0] Write session: Do CDS request
2025-10-01T14:09:18.754112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a5612b-c6d708de-491deb61-41eef120_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:18.762827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a5612b-c6d708de-491deb61-41eef120_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.763432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:18.763444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 760
2025-10-01T14:09:18.763444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:18.763552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.763590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:18.763599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:18.763602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:18.764021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 760 sessionId:  describe result for acl check
2025-10-01T14:09:18.764053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:18.764070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:18.764076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:18.764083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255187631913733:7353] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:18.764594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255187631913733:7353] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:18.765370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:18.765570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:18.765581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:18.765591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:18.765643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:18.765679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255185255048484:6501]
2025-10-01T14:09:18.766177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:18.766301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255187631913733:7353] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:18.766403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:18.766446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:18.766713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:18.766769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.766777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.766778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.766781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.766782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.766784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.766785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.766786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.766787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.766788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.766789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.766790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.766791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.766792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.766797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.766807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.766811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.766815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.766819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.766823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.766826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.766830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.766834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.766837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.766841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.766843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.766845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.766847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.766852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.766857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.766861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.766864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.766867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.766870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.766873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.766876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.766879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.766882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.766885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.766887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.766891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.766894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.766897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.766899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.766902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.766905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.766907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.766910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.766913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.766916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.766918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.766921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.766923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.766926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.766928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.766931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.766952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:18.770452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255187631913733:7353] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:18.770467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255187631913733:7353] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:18.770470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255187631913733:7353] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:18.770479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:18.770642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:18.771257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:18.771274Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:18.771276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:18.771280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:18.771287Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 759 [2:7556255185255048484:6501]
2025-10-01T14:09:18.771306Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:18.771327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:18.771338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.771341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.771345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.771360Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:18.771366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:18.771378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:18.771436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.771443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.771444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.771448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:18.771451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:18.771514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:18.771523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.771534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.771545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.771563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:18.771586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913685:2446], now have 1 active actors on pipe
2025-10-01T14:09:18.771591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913772:7353], now have 1 active actors on pipe
2025-10-01T14:09:18.771599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255185255048479:6501]
2025-10-01T14:09:18.771605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255185255048479:6501]
2025-10-01T14:09:18.771607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255185255048479:6501]
2025-10-01T14:09:18.771618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:18.771635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:18.771644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:18.771647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:18.771649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:18.771653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:18.771655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:18.771659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 759
2025-10-01T14:09:18.771671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 759
2025-10-01T14:09:18.771685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255185255048479:6501]
2025-10-01T14:09:18.771693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:18.771695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:18.771711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.771720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.771764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:18.771775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.771778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.771780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:18.771789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.771801Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:18.771822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.772091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.772100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.772114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.772203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 760 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0
2025-10-01T14:09:18.772510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a5612b-c6d708de-491deb61-41eef120_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:18.775074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0] Write session: try to update token
2025-10-01T14:09:18.775095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:18.789997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 760 sessionId: src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:18.792399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:18.793015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.793042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.793064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:18.793084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:18.793087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:18.793089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:18.793098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255185255048479:6501]
2025-10-01T14:09:18.793105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255185255048479:6501]
2025-10-01T14:09:18.793112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255185255048479:6501]
2025-10-01T14:09:18.793146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:18.793157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:18.793161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:18.793172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:18.793185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.793193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:18.793368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:18.853668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255187631913793:6999]
2025-10-01T14:09:18.853946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 759, pipe: [1:7556255187631913793:6999]
2025-10-01T14:09:18.940401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:18.940701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:18.940748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913793:6999], now have 1 active actors on pipe
2025-10-01T14:09:18.940861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:18.940938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:18.940995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255187631913793:6999]
2025-10-01T14:09:18.951757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:18.951769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:18.951786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 760 reason: error at write: Disconnected sessionId: src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0
2025-10-01T14:09:18.951902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 760 sessionId: src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0 is DEAD
2025-10-01T14:09:18.952048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:18.952058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0] Write session will restart in 0.005794s
2025-10-01T14:09:18.952085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0] Write session: Do CDS request
2025-10-01T14:09:18.952094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:18.958864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.958945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:18.958958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 761
2025-10-01T14:09:18.959081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:18.959116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:18.959122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:18.959124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:18.959255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:18.959561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 761 sessionId:  describe result for acl check
2025-10-01T14:09:18.959597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:18.959604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:18.959605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:18.959609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255187631913857:7364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:18.960102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255187631913857:7364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:18.961024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:18.961206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:18.961216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:18.961226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:18.961266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:18.961303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255185255048583:6506]
2025-10-01T14:09:18.961983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:18.962199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:18.962233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:18.962269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255187631913857:7364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:18.962543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:18.962592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.962598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.962601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.962602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.962603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.962604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.962605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.962606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.962607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.962608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.962610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.962611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.962612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.962613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.962617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.962626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.962630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.962634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.962638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.962641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.962645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.962649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.962653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.962656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.962660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.962663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.962667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.962670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.962677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.962684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:18.962690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.962695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:18.962699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.962705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:18.962709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.962714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:18.962719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.962724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:18.962728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.962733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:18.962738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.962743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:18.962752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.962757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:18.962761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.962770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:18.962774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.962779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.962784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.962789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.962793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.962798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.962803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.962813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:18.962817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.962826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:18.962866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:18.966500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255187631913857:7364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:18.966513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255187631913857:7364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:18.966516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255187631913857:7364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:18.966522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:18.966611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:18.967185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:18.967200Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:18.967202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:18.967206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:18.967213Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 760 [2:7556255185255048583:6506]
2025-10-01T14:09:18.967229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:18.967245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:18.967249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.967252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.967254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.967269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:18.967278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:18.967284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:18.967337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.967343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.967346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.967349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:18.967352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:18.967412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:18.967419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.967430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:18.967441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:18.967462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:18.967483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913804:2446], now have 1 active actors on pipe
2025-10-01T14:09:18.967490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255187631913892:7364], now have 1 active actors on pipe
2025-10-01T14:09:18.967497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255185255048577:6506]
2025-10-01T14:09:18.967501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255185255048577:6506]
2025-10-01T14:09:18.967503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255185255048577:6506]
2025-10-01T14:09:18.967497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 760
2025-10-01T14:09:18.967512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:18.967522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 760
2025-10-01T14:09:18.967529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:18.967531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:18.967547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:18.967550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:18.967552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:18.967555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:18.967571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.967579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.967614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255185255048577:6506]
2025-10-01T14:09:18.967625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:18.967639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:18.967644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:18.967652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:18.967656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:18.967658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:18.967666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:18.967673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:18.967703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.967833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.967840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.967852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:18.967946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 761 partition: 0 MaxSeqNo: 45 sessionId: src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0
2025-10-01T14:09:18.968321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a83b5c7-f34e989-b4b2a407-d8542ed0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:18.970810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0] Write session: try to update token
2025-10-01T14:09:18.970829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:18.984917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 761 sessionId: src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:18.987398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:18.988537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:18.988560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:18.988576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:18.988579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:18.988580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:18.988582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:18.988588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255185255048577:6506]
2025-10-01T14:09:18.988593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255185255048577:6506]
2025-10-01T14:09:18.988596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255185255048577:6506]
2025-10-01T14:09:18.988627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:18.988639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:18.988639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:18.988641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:18.988645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:18.988647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:18.988780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:19.041071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255191926881196:6999]
2025-10-01T14:09:19.041353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 760, pipe: [1:7556255191926881196:6999]
2025-10-01T14:09:19.131912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:19.132215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:19.132261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881196:6999], now have 1 active actors on pipe
2025-10-01T14:09:19.132346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:19.132392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255191926881196:6999]
2025-10-01T14:09:19.132417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:19.141399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:19.143211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:19.143352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:19.143364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:19.143385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 761 reason: error at write: Disconnected sessionId: src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0
2025-10-01T14:09:19.143430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:19.143441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:19.143451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:19.143495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:19.143532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255189550015996:6514]
2025-10-01T14:09:19.143540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 761 sessionId: src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0 is DEAD
2025-10-01T14:09:19.143649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:19.143656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0] Write session will restart in 0.009002s
2025-10-01T14:09:19.143679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0] Write session: Do CDS request
2025-10-01T14:09:19.143683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:19.144246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:19.147085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:19.147139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:19.147488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:19.147540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.147547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.147548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.147549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.147550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.147551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.147552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.147553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.147554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.147555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.147556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.147557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.147558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.147559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.147565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.147574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.147578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.147582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.147585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.147588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.147592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.147595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.147599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.147604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.147607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.147610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.147614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.147617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.147625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.147632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.147638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.147643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.147648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.147653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.147657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.147661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.147665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.147670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.147674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.147678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.147684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.147689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.147697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.147702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.147706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.147710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.147719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.147724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.147728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.147732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.147736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.147740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.147743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.147747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.147750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.147754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.147796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:19.151460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:19.152191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:19.152205Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:19.152208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:19.152211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:19.152220Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 761 [2:7556255189550015996:6514]
2025-10-01T14:09:19.152235Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:19.152251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:19.152258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.152261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.152263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.152277Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:19.152286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:19.152292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:19.152345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.152351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.152353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.152356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:19.152358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:19.152420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:19.152426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.152438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.152447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.152464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:19.152481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881199:2446], now have 1 active actors on pipe
2025-10-01T14:09:19.152492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255189550015991:6514]
2025-10-01T14:09:19.152494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255189550015991:6514]
2025-10-01T14:09:19.152496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255189550015991:6514]
2025-10-01T14:09:19.152509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:19.152522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:19.152524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:19.152531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:19.152534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:19.152538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:19.152540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:19.152528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 761
2025-10-01T14:09:19.152563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255189550015991:6514]
2025-10-01T14:09:19.152569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:19.152571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:19.153898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.153964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:19.153975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 762
2025-10-01T14:09:19.154107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.154142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:19.154153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:19.154157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:19.154626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 762 sessionId:  describe result for acl check
2025-10-01T14:09:19.154661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:19.154670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:19.154672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:19.154679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255191926881261:7368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:19.155203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255191926881261:7368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:19.157722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255191926881261:7368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:19.163182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255191926881261:7368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:19.163195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255191926881261:7368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:19.163200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255191926881261:7368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:19.163208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:19.163465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881292:7368], now have 1 active actors on pipe
2025-10-01T14:09:19.163511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 761
2025-10-01T14:09:19.163582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.163595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.163621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:19.163645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.163655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.163658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:19.163670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.163690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:19.163710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.163861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.163867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.163881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.163945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 762 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0
2025-10-01T14:09:19.164314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c10c2d7-a4ab160d-e5549019-b9cfa02_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:19.166780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0] Write session: try to update token
2025-10-01T14:09:19.166799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:19.172628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:19.172648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:19.172651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:19.172653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:19.172664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255189550015991:6514]
2025-10-01T14:09:19.172668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255189550015991:6514]
2025-10-01T14:09:19.172672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255189550015991:6514]
2025-10-01T14:09:19.172718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:19.172720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:19.172726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.172731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:19.172732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:19.172737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:19.172872Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:19.181121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 762 sessionId: src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:19.183620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:19.232539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255191926881295:6999]
2025-10-01T14:09:19.232793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 761, pipe: [1:7556255191926881295:6999]
2025-10-01T14:09:19.314925Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:19.315259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.315282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.315314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881295:6999], now have 1 active actors on pipe
2025-10-01T14:09:19.315554Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:19.316060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:19.316070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0] Write session will restart in 0.008332s
2025-10-01T14:09:19.316097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0] Write session: Do CDS request
2025-10-01T14:09:19.316103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:19.315604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255191926881295:6999]
2025-10-01T14:09:19.315635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:19.315669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:19.315740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 762 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0
2025-10-01T14:09:19.315926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 762 sessionId: src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0 is DEAD
2025-10-01T14:09:19.325934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.325987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:19.325999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 763
2025-10-01T14:09:19.326163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.326192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:19.326201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:19.326204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:19.326636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 763 sessionId:  describe result for acl check
2025-10-01T14:09:19.326670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:19.326679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:19.326680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:19.326685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255191926881355:7373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:19.327100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:19.327153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255191926881355:7373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:19.328691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:19.328876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:19.328888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:19.328898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:19.328947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:19.328981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255189550016086:6520]
2025-10-01T14:09:19.329105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255191926881355:7373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:19.329515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:19.329813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:19.329855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:19.330147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:19.330201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.330207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.330208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.330209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.330210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.330211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.330212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.330213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.330214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.330215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.330216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.330217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.330218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.330219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.330224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.330233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.330236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.330240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.330244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.330247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.330251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.330254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.330258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.330261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.330264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.330269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.330272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.330275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.330281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.330288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.330293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.330298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.330302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.330307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.330311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.330315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.330320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.330324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.330328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.330333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.330338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.330343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.330347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.330352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.330356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.330361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.330366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.330385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.330390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.330395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.330402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.330407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.330417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.330422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.330430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.330435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.330468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:19.333965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255191926881355:7373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:19.333984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255191926881355:7373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:19.333987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255191926881355:7373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:19.333993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:19.334236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:19.334845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:19.334860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:19.334862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:19.334866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:19.334873Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 762 [2:7556255189550016086:6520]
2025-10-01T14:09:19.334888Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:19.334903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:19.334913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.334916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.334918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.334933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:19.334939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:19.334944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:19.334996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.335004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.335006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.335009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:19.335011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:19.335068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:19.335075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.335087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.335102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.335121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:19.335143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881395:7373], now have 1 active actors on pipe
2025-10-01T14:09:19.335150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881303:2446], now have 1 active actors on pipe
2025-10-01T14:09:19.335157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255189550016081:6520]
2025-10-01T14:09:19.335162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255189550016081:6520]
2025-10-01T14:09:19.335164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255189550016081:6520]
2025-10-01T14:09:19.335177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:19.335182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 762
2025-10-01T14:09:19.335190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 762
2025-10-01T14:09:19.335193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:19.335195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:19.335198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:19.335200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:19.335209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:19.335212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:19.335241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255189550016081:6520]
2025-10-01T14:09:19.335247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:19.335252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:19.335261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.335266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.335312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8eec6310-78f61b45-947cc3f0-5267b799_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:19.335325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.335329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.335331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:19.335340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.335349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:19.335365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.335496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.335505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.335519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.335586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 763 partition: 0 MaxSeqNo: 45 sessionId: src_id|8eec6310-78f61b45-947cc3f0-5267b799_0
2025-10-01T14:09:19.335934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f4bca2d-b238cd7d-def58698-265bd67b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8eec6310-78f61b45-947cc3f0-5267b799_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:19.338134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eec6310-78f61b45-947cc3f0-5267b799_0] Write session: try to update token
2025-10-01T14:09:19.338147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eec6310-78f61b45-947cc3f0-5267b799_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:19.355242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 763 sessionId: src_id|8eec6310-78f61b45-947cc3f0-5267b799_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:19.356078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:19.356096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:19.356099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:19.356101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:19.356109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255189550016081:6520]
2025-10-01T14:09:19.356117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255189550016081:6520]
2025-10-01T14:09:19.356122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255189550016081:6520]
2025-10-01T14:09:19.356163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:19.356170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:19.356176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:19.356177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.356179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:19.356180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:19.356312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:19.357728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:19.414838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255191926881403:6999]
2025-10-01T14:09:19.415128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 762, pipe: [1:7556255191926881403:6999]
2025-10-01T14:09:19.501475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:19.501722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.501735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.501779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881403:6999], now have 1 active actors on pipe
2025-10-01T14:09:19.501956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:19.502030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:19.502040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:19.502042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255191926881403:6999]
2025-10-01T14:09:19.502065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:19.502088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 763 reason: error at write: Disconnected sessionId: src_id|8eec6310-78f61b45-947cc3f0-5267b799_0
2025-10-01T14:09:19.502267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 763 sessionId: src_id|8eec6310-78f61b45-947cc3f0-5267b799_0 is DEAD
2025-10-01T14:09:19.502422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eec6310-78f61b45-947cc3f0-5267b799_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:19.502432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eec6310-78f61b45-947cc3f0-5267b799_0] Write session will restart in 0.007701s
2025-10-01T14:09:19.502458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eec6310-78f61b45-947cc3f0-5267b799_0] Write session: Do CDS request
2025-10-01T14:09:19.502464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eec6310-78f61b45-947cc3f0-5267b799_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:19.510833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:19.510863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8eec6310-78f61b45-947cc3f0-5267b799_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.510961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:19.510972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 764
2025-10-01T14:09:19.511069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.511107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:19.511116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:19.511120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:19.511490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 764 sessionId:  describe result for acl check
2025-10-01T14:09:19.511521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:19.511526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:19.511528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:19.511533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255191926881457:7377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:19.512003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255191926881457:7377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:19.512474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:19.512645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:19.512656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:19.512666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:19.512708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:19.512781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255189550016191:6524]
2025-10-01T14:09:19.513365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:19.513618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:19.513670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:19.513938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:19.513970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255191926881457:7377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:19.513992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.514000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.514001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.514013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.514013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.514015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.514016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.514017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.514018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.514019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.514020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.514021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.514022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.514024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.514029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.514036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.514039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.514043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.514046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.514049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.514053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.514056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.514060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.514064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.514067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.514070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.514073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.514075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.514081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.514089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.514093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.514098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.514101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.514106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.514109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.514113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.514117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.514122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.514125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.514131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.514135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.514141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.514145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.514148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.514153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.514157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.514161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.514172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.514176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.514180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.514183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.514189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.514197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.514201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.514205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.514213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.514247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:19.517536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255191926881457:7377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:19.517548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255191926881457:7377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:19.517552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255191926881457:7377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:19.517561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:19.517733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:19.518389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:19.518403Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:19.518405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:19.518408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:19.518415Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 763 [2:7556255189550016191:6524]
2025-10-01T14:09:19.518429Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:19.518453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:19.518456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.518459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.518461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.518477Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:19.518487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:19.518492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:19.518544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.518551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.518553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.518557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:19.518560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:19.518615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:19.518751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 763
2025-10-01T14:09:19.518623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.518634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.518753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 763
2025-10-01T14:09:19.518644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.518658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:19.518674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881496:7377], now have 1 active actors on pipe
2025-10-01T14:09:19.518677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881406:2446], now have 1 active actors on pipe
2025-10-01T14:09:19.518684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255189550016186:6524]
2025-10-01T14:09:19.518687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255189550016186:6524]
2025-10-01T14:09:19.518688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255189550016186:6524]
2025-10-01T14:09:19.518701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:19.518716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:19.518718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:19.518721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:19.518723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:19.518729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:19.518732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:19.518758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255189550016186:6524]
2025-10-01T14:09:19.518760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:19.518792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:19.518825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.518829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.518850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:19.518861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.518866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.518868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:19.518876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.518888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:19.518903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.519017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.519023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.519035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.519114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 764 partition: 0 MaxSeqNo: 45 sessionId: src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0
2025-10-01T14:09:19.519420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8eec6310-78f61b45-947cc3f0-5267b799_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:19.521772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0] Write session: try to update token
2025-10-01T14:09:19.521786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:19.535210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:19.535230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:19.535242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255189550016186:6524]
2025-10-01T14:09:19.535279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:19.535294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:19.535437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:19.535561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:19.535682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:19.535800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:19.535824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 764 sessionId: src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:19.535994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:19.536043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:19.538135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:19.538437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.538455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.538486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:19.538571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:19.549205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:19.549223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:19.549225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:19.549227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:19.549237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255189550016186:6524]
2025-10-01T14:09:19.549241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255189550016186:6524]
2025-10-01T14:09:19.549246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255189550016186:6524]
2025-10-01T14:09:19.549278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:19.549289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:19.549289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:19.549291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:19.549294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.549296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:19.549418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:19.602228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255191926881516:6999]
2025-10-01T14:09:19.602476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 763, pipe: [1:7556255191926881516:6999]
2025-10-01T14:09:19.686496Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:19.692991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.693016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.693159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.693212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.693267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.693327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.693377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.693388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.693455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.693508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.693561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.693619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.693660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.693665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.693723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.693774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.693830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.693884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.693921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.693926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.693981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.694040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.694095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.694144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.694183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.694189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.694248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.694300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.694352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.694433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.694478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.694480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.694540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.694595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.694651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.694754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.694802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.694807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.694861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.694910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.694963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.695018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.695057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.695064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.695120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.695171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.695222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.695272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.695312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.695317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.695369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.695419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.695471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.695526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.695567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.695574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.695631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.695680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.695729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.695780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.695818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.695822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.695863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881516:6999], now have 1 active actors on pipe
2025-10-01T14:09:19.696068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:19.696074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:19.696078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:19.696106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 764 reason: error at write: Disconnected sessionId: src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0
2025-10-01T14:09:19.696123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255191926881516:6999]
2025-10-01T14:09:19.696321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 764 sessionId: src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0 is DEAD
2025-10-01T14:09:19.696397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:19.696407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0] Write session will restart in 0.005845s
2025-10-01T14:09:19.696433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0] Write session: Do CDS request
2025-10-01T14:09:19.696439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:19.696580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:19.703851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.703985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:19.703996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 765
2025-10-01T14:09:19.704139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.704170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:19.704175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:19.704179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:19.704561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 765 sessionId:  describe result for acl check
2025-10-01T14:09:19.704596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:19.704601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:19.704604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:19.704608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255191926881573:7383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:19.704712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:19.705073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255191926881573:7383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:19.706303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:19.706508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:19.706519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:19.706529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:19.706573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:19.706607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255189550016283:6526]
2025-10-01T14:09:19.707141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:19.707298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255191926881573:7383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:19.707354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:19.707392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:19.707670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:19.707720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.707725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.707726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.707728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.707729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.707730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.707731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.707733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.707734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.707735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.707736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.707737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.707738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.707739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.707744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.707754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.707760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.707764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.707767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.707770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.707773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.707777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.707780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.707784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.707788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.707792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.707795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.707799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.707805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.707812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.707817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.707822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.707830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.707835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.707839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.707848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.707852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.707861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.707865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.707871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.707878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.707885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.707889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.707893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.707898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.707903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.707910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.707919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.707923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.707932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.707936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.707940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.707946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.707952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.707956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.707962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.708000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:19.711191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255191926881573:7383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:19.711203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255191926881573:7383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:19.711207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255191926881573:7383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:19.711215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:19.711431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:19.712042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:19.712058Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:19.712060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:19.712064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:19.712069Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 764 [2:7556255189550016283:6526]
2025-10-01T14:09:19.712082Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:19.712100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:19.712103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.712106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.712108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.712122Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:19.712132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:19.712141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:19.712196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.712203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.712205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.712208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:19.712210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:19.712271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:19.712278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.712289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.712305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.712324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:19.712345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881613:7383], now have 1 active actors on pipe
2025-10-01T14:09:19.712352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881521:2446], now have 1 active actors on pipe
2025-10-01T14:09:19.712358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255189550016278:6526]
2025-10-01T14:09:19.712360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255189550016278:6526]
2025-10-01T14:09:19.712362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255189550016278:6526]
2025-10-01T14:09:19.712373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:19.712387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:19.712400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:19.712405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:19.712407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:19.712409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:19.712411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:19.712430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255189550016278:6526]
2025-10-01T14:09:19.712441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:19.712445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:19.712490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 764
2025-10-01T14:09:19.712496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 764
2025-10-01T14:09:19.712566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.712575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.712597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:19.712608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.712612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.712615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:19.712623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.712635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:19.712652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.712807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.712817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.712833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.712907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 765 partition: 0 MaxSeqNo: 45 sessionId: src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0
2025-10-01T14:09:19.713223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67fa586-7d37b1e3-e950ebf1-185dd549_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:19.715641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0] Write session: try to update token
2025-10-01T14:09:19.715657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:19.723368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:19.723393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:19.723402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255189550016278:6526]
2025-10-01T14:09:19.723439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:19.723444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:19.723600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:19.723739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:19.723872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:19.724022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:19.724269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:19.724312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:19.729254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 765 sessionId: src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:19.732098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:19.732447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.732470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.732505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:19.732607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:19.742714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:19.742735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:19.742738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:19.742740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:19.742753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255189550016278:6526]
2025-10-01T14:09:19.742757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255189550016278:6526]
2025-10-01T14:09:19.742763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255189550016278:6526]
2025-10-01T14:09:19.742810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:19.742815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:19.742820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:19.742824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.742824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:19.742826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:19.742955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:19.796246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255191926881621:6999]
2025-10-01T14:09:19.796473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 764, pipe: [1:7556255191926881621:6999]
2025-10-01T14:09:19.889663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:19.899112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.899145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.899305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.899369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.899438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.899503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.899552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.899558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.899628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.899686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.899742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.899803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.899848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.899851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.899924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.899982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.900046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.900111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.900153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.900156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.900227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.900291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.900353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.900414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.900458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.900462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.900534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.900590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.900650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.900710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.900747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.900750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.900858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.900917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.900983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.901048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.901089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.901094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.901168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.901223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.901287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.901353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.901395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.901397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.901471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.901530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.901593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.901651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.901691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.901694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.901761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.901817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.901876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.901940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.901988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.901991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.902061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:19.902115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:19.902169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:19.902227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:19.902270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:19.902273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:19.902342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881621:6999], now have 1 active actors on pipe
2025-10-01T14:09:19.903403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:19.904402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:19.904411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0] Write session will restart in 0.007077s
2025-10-01T14:09:19.904436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0] Write session: Do CDS request
2025-10-01T14:09:19.904442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:19.904028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:19.904071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 765 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0
2025-10-01T14:09:19.904272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 765 sessionId: src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0 is DEAD
2025-10-01T14:09:19.904440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:19.904472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255191926881621:6999]
2025-10-01T14:09:19.913095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.913769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:19.913780Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 766
2025-10-01T14:09:19.913905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:19.913936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:19.913941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:19.913944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:19.915672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:19.916664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 766 sessionId:  describe result for acl check
2025-10-01T14:09:19.916694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:19.916696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:19.916698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:19.916703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255191926881691:7393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:19.917284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255191926881691:7393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:19.918160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:19.918339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:19.918342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:19.918352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:19.918406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:19.918438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255189550016379:6529]
2025-10-01T14:09:19.919041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:19.919347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:19.919389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:19.919673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:19.919727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.919733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.919734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.919735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.919736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.919737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.919738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.919739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.919740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.919741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.919743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.919744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.919745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.919746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.919751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.919760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.919764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.919768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.919771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.919775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.919779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.919783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.919787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.919791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.919795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.919799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.919803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.919807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.919813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.919826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:19.919832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.919837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:19.919840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.919844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:19.919848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.919852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:19.919856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.919860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:19.919864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.919869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:19.919873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.919879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:19.919883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.919887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:19.919891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.919896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:19.919905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.919910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.919918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.919922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.919930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.919934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.919940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.919944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:19.919948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.919952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:19.919985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:19.920041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255191926881691:7393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:19.924787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255191926881691:7393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:19.924803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255191926881691:7393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:19.924807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255191926881691:7393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:19.924815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:19.925433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:19.926026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:19.926030Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:19.926031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:19.926035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:19.926040Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 765 [2:7556255189550016379:6529]
2025-10-01T14:09:19.926051Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:19.926062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:19.926064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.926067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.926068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.926078Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:19.926081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:19.926085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:19.926121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.926123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.926124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.926126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:19.926128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:19.926176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:19.926177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.926184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:19.926189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:19.926198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:19.926209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255189550016373:6529]
2025-10-01T14:09:19.926210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255189550016373:6529]
2025-10-01T14:09:19.926212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255189550016373:6529]
2025-10-01T14:09:19.926222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:19.926236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:19.926236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:19.926240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:19.926242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:19.926249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:19.926252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:19.926271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255189550016373:6529]
2025-10-01T14:09:19.926273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:19.926287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881638:2446], now have 1 active actors on pipe
2025-10-01T14:09:19.926293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255191926881734:7393], now have 1 active actors on pipe
2025-10-01T14:09:19.926343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:19.926905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.926918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.926947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5844bdf1-f7214992-79486146-57f3455b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:19.926954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:19.926958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:19.926960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:19.926970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:19.926980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:19.926993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.926802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 765
2025-10-01T14:09:19.926840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 765
2025-10-01T14:09:19.927584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.927597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.927616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:19.927705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 766 partition: 0 MaxSeqNo: 45 sessionId: src_id|5844bdf1-f7214992-79486146-57f3455b_0
2025-10-01T14:09:19.928067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70dbae79-8a812592-3b0f1dbf-a0519070_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5844bdf1-f7214992-79486146-57f3455b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:19.930953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5844bdf1-f7214992-79486146-57f3455b_0] Write session: try to update token
2025-10-01T14:09:19.930971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5844bdf1-f7214992-79486146-57f3455b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:19.945573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 766 sessionId: src_id|5844bdf1-f7214992-79486146-57f3455b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:19.947821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:19.948039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:19.948064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:19.948103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:19.948247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:19.956316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:19.956333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:19.956336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:19.956338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:19.956347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255189550016373:6529]
2025-10-01T14:09:19.956352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255189550016373:6529]
2025-10-01T14:09:19.956356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255189550016373:6529]
2025-10-01T14:09:19.956399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:19.956405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:19.956407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:19.956527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:19.958594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:19.958600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:19.958603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:20.004634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255196221849039:6999]
2025-10-01T14:09:20.006205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 765, pipe: [1:7556255196221849039:6999]
2025-10-01T14:09:20.116689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:20.124994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.125026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.125202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.125258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.125314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.125372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.125413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.125418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.125489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.125550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.125607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.125670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.125709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.125714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.125776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.125830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.125882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.125938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.126228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.126232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.126289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.126341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.126535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.126594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.126692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.126695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.126759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.126815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.126877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.126935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.126984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.126987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.127054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.127114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.127182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.127252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.127296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.127298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.127360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.127418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.127489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.127548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.127586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.127589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.127649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.127704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.127756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.127813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.127853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.127858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.127925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.127985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.128043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.128099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.128139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.128141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.128206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.128272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.128334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.128394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.128432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.128434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.128519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849039:6999], now have 1 active actors on pipe
2025-10-01T14:09:20.129474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:20.130164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:20.130207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:20.130244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 766 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5844bdf1-f7214992-79486146-57f3455b_0
2025-10-01T14:09:20.130476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 766 sessionId: src_id|5844bdf1-f7214992-79486146-57f3455b_0 is DEAD
2025-10-01T14:09:20.130540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255196221849039:6999]
2025-10-01T14:09:20.130628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5844bdf1-f7214992-79486146-57f3455b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:20.130635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5844bdf1-f7214992-79486146-57f3455b_0] Write session will restart in 0.005920s
2025-10-01T14:09:20.130660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5844bdf1-f7214992-79486146-57f3455b_0] Write session: Do CDS request
2025-10-01T14:09:20.130666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5844bdf1-f7214992-79486146-57f3455b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:20.138491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5844bdf1-f7214992-79486146-57f3455b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.138961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:20.138974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 767
2025-10-01T14:09:20.139084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.139115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:20.139121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:20.139124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:20.139488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 767 sessionId:  describe result for acl check
2025-10-01T14:09:20.139522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:20.139528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:20.139529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:20.139533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255196221849055:7397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:20.140005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255196221849055:7397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:20.143709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255196221849055:7397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:20.150666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:20.153778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255196221849055:7397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:20.153792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255196221849055:7397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:20.153795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255196221849055:7397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:20.153804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:20.158692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:20.158987Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:20.158992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:20.159015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:20.159087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:20.159133Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255193844983792:6533]
2025-10-01T14:09:20.159751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:20.160255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:20.160305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:20.160566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:20.160610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.160610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.160611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.160612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.160612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.160613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.160614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.160615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.160615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.160616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.160616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.160617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.160617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.160618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.160622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.160628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.160630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.160632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.160634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.160637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.160639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.160644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.160648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.160652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.160654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.160657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.160660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.160663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.160669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.160676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.160683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.160687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.160694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.160700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.160705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.160709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.160714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.160719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.160723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.160727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.160730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.160732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.160735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.160737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.160741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.160744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.160747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.160749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.160752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.160768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.160772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.160776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.160779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.160782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.160785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.160787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.160808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:20.167827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:20.168537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:20.168543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:20.168545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:20.168549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:20.168557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 766 [2:7556255193844983792:6533]
2025-10-01T14:09:20.168574Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:20.168591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:20.168594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.168597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.168600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.168616Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:20.168621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:20.168627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:20.168684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.168686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.168688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.168691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:20.168695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:20.168831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:20.168833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.168846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.168860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.168878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:20.168895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255193844983786:6533]
2025-10-01T14:09:20.168897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255193844983786:6533]
2025-10-01T14:09:20.168899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255193844983786:6533]
2025-10-01T14:09:20.168918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:20.168934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:20.168949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:20.168952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:20.168970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:20.168974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:20.168976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:20.168988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255193844983786:6533]
2025-10-01T14:09:20.168990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:20.169049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:20.169305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849131:7397], now have 1 active actors on pipe
2025-10-01T14:09:20.169317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849042:2446], now have 1 active actors on pipe
2025-10-01T14:09:20.169413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.169422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.169450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:20.169458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.169462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.169464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:20.169473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.169482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:20.169497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.169301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 766
2025-10-01T14:09:20.169315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 766
2025-10-01T14:09:20.171034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.171059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.171083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.171215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 767 partition: 0 MaxSeqNo: 45 sessionId: src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0
2025-10-01T14:09:20.174470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5844bdf1-f7214992-79486146-57f3455b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:20.176855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0] Write session: try to update token
2025-10-01T14:09:20.176873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:20.196710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:20.196731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:20.196734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:20.196736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:20.196747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255193844983786:6533]
2025-10-01T14:09:20.196751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255193844983786:6533]
2025-10-01T14:09:20.196767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255193844983786:6533]
2025-10-01T14:09:20.196817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:20.196825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.196827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:20.196967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:20.198128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:20.198133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:20.198136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:20.198977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 767 sessionId: src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:20.201490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:20.231066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255196221849143:6999]
2025-10-01T14:09:20.232122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 766, pipe: [1:7556255196221849143:6999]
2025-10-01T14:09:20.377882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:20.379185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.379205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.379242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849143:6999], now have 1 active actors on pipe
2025-10-01T14:09:20.379513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:20.379553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:20.379528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:20.379608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 767 reason: error at write: Disconnected sessionId: src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0
2025-10-01T14:09:20.379761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255196221849143:6999]
2025-10-01T14:09:20.379774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 767 sessionId: src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0 is DEAD
2025-10-01T14:09:20.379787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:20.379932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:20.379941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0] Write session will restart in 0.006211s
2025-10-01T14:09:20.379966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0] Write session: Do CDS request
2025-10-01T14:09:20.379982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:20.386963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.386991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:20.387003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 768
2025-10-01T14:09:20.387220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.387272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:20.387284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:20.387287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:20.387686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 768 sessionId:  describe result for acl check
2025-10-01T14:09:20.387728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:20.387734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:20.387736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:20.387741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255196221849207:7402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:20.388304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255196221849207:7402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:20.388501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:20.390069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:20.390258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:20.390267Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:20.390277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:20.390329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:20.390385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255193844983903:6546]
2025-10-01T14:09:20.390475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255196221849207:7402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:20.390888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:20.391166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:20.391202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:20.391493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:20.391546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.391552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.391553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.391554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.391555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.391556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.391557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.391558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.391559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.391560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.391561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.391562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.391563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.391564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.391569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.391581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.391584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.391588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.391592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.391596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.391601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.391604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.391609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.391613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.391617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.391620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.391621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.391624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.391629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.391635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.391639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.391642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.391644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.391648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.391653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.391656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.391659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.391663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.391666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.391670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.391674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.391677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.391679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.391684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.391688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.391691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.391693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.391696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.391698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.391701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.391703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.391706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.391709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.391712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.391714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.391717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.391753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:20.395059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255196221849207:7402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:20.395069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255196221849207:7402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:20.395072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255196221849207:7402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:20.395078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:20.395278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:20.397086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:20.397102Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:20.397104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:20.397107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:20.397113Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 767 [2:7556255193844983903:6546]
2025-10-01T14:09:20.397127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:20.397146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:20.397154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.397158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.397164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.397179Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:20.397191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:20.397197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:20.397265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.397272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.397274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.397278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:20.397280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:20.397339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:20.397347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.397360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.397376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.397401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:20.397423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849248:7402], now have 1 active actors on pipe
2025-10-01T14:09:20.397431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849154:2446], now have 1 active actors on pipe
2025-10-01T14:09:20.397437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255193844983898:6546]
2025-10-01T14:09:20.397443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255193844983898:6546]
2025-10-01T14:09:20.397445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255193844983898:6546]
2025-10-01T14:09:20.397454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:20.397436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 767
2025-10-01T14:09:20.397440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 767
2025-10-01T14:09:20.397466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:20.397472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:20.397472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:20.397474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:20.397486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:20.397494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:20.397545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.397554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.397565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255193844983898:6546]
2025-10-01T14:09:20.397576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:20.397598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:20.397610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51796ffa-efde4858-55e0dac9-99a13e44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:20.397616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.397625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.397627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:20.397637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.397651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:20.397671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.397766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.397776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.397789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.397854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 768 partition: 0 MaxSeqNo: 45 sessionId: src_id|51796ffa-efde4858-55e0dac9-99a13e44_0
2025-10-01T14:09:20.398161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|753b52b4-684a0d82-fa26ab4-91f7de35_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|51796ffa-efde4858-55e0dac9-99a13e44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:20.405511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51796ffa-efde4858-55e0dac9-99a13e44_0] Write session: try to update token
2025-10-01T14:09:20.405531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51796ffa-efde4858-55e0dac9-99a13e44_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:20.417839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:20.417863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:20.417865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:20.417867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:20.417877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255193844983898:6546]
2025-10-01T14:09:20.417882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255193844983898:6546]
2025-10-01T14:09:20.417886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255193844983898:6546]
2025-10-01T14:09:20.417934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:20.417938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:20.417941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:20.417945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:20.417946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.417948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:20.418076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:20.426125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 768 sessionId: src_id|51796ffa-efde4858-55e0dac9-99a13e44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:20.429003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:20.479794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255196221849257:6999]
2025-10-01T14:09:20.480053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 767, pipe: [1:7556255196221849257:6999]
2025-10-01T14:09:20.561322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:20.561598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.561611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.561628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849257:6999], now have 1 active actors on pipe
2025-10-01T14:09:20.561785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:20.561851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255196221849257:6999]
2025-10-01T14:09:20.561853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:20.561881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:20.561954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 768 reason: status is not ok: tablet will be restarted right now sessionId: src_id|51796ffa-efde4858-55e0dac9-99a13e44_0
2025-10-01T14:09:20.562111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 768 sessionId: src_id|51796ffa-efde4858-55e0dac9-99a13e44_0 is DEAD
2025-10-01T14:09:20.562485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51796ffa-efde4858-55e0dac9-99a13e44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:20.562539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51796ffa-efde4858-55e0dac9-99a13e44_0] Write session will restart in 0.008368s
2025-10-01T14:09:20.562564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51796ffa-efde4858-55e0dac9-99a13e44_0] Write session: Do CDS request
2025-10-01T14:09:20.562568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51796ffa-efde4858-55e0dac9-99a13e44_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:20.571652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:20.571886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51796ffa-efde4858-55e0dac9-99a13e44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.571929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:20.571941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 769
2025-10-01T14:09:20.572142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.572172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:20.572183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:20.572187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:20.572599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 769 sessionId:  describe result for acl check
2025-10-01T14:09:20.572640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:20.572739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:20.572746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:20.572766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255196221849328:7407] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:20.573297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255196221849328:7407] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:20.573422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:20.573648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:20.573660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:20.573671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:20.573732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:20.573771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255193844984012:6549]
2025-10-01T14:09:20.574326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:20.574797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:20.574874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:20.575206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:20.575260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.575268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.575269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.575271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.575272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.575273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.575275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.575276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.575277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.575279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.575280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.575281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.575283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.575284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.575290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.575300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.575304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.575308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.575312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.575316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.575321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.575325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.575329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.575334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.575338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.575342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.575346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.575349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.575355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.575362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.575368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.575373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.575378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.575383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.575367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255196221849328:7407] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:20.575387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.575398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.575402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.575407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.575411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.575416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.575427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.575432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.575440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.575444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.575449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.575453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.575459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.575464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.575473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.575477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.575485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.575490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.575498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.575503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.575506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.575514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.575554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:20.579225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255196221849328:7407] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:20.579239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255196221849328:7407] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:20.579243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255196221849328:7407] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:20.579251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:20.579436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:20.580585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:20.580601Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:20.580604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:20.580607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:20.580614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 768 [2:7556255193844984012:6549]
2025-10-01T14:09:20.580628Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:20.580643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:20.580650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.580656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.580658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.580675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:20.580685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:20.580690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:20.580750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.580767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.580769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.580772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:20.580775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:20.580843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:20.580854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.580865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.580876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.580892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:20.580909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849271:2446], now have 1 active actors on pipe
2025-10-01T14:09:20.580912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849366:7407], now have 1 active actors on pipe
2025-10-01T14:09:20.580919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255193844984006:6549]
2025-10-01T14:09:20.580921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255193844984006:6549]
2025-10-01T14:09:20.580923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255193844984006:6549]
2025-10-01T14:09:20.580936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:20.580948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:20.580950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:20.580959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:20.580961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:20.580964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:20.580967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:20.580997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255193844984006:6549]
2025-10-01T14:09:20.581009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:20.581042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:20.581093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.581105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.581129Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:20.581140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.581146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.581148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:20.581157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.581170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:20.581185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.581353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.581370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.581391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.581783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51796ffa-efde4858-55e0dac9-99a13e44_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:20.581001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 768
2025-10-01T14:09:20.581006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 768
2025-10-01T14:09:20.581466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 769 partition: 0 MaxSeqNo: 45 sessionId: src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0
2025-10-01T14:09:20.584233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0] Write session: try to update token
2025-10-01T14:09:20.584251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:20.592451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:20.592470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:20.592481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255193844984006:6549]
2025-10-01T14:09:20.592527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:20.592538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:20.592748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:20.592975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:20.593133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:20.593297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:20.593498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:20.593539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:20.603474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 769 sessionId: src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:20.605966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:20.606155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.606180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.606216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:20.606305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:20.614192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:20.614212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:20.614215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:20.614219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:20.614233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255193844984006:6549]
2025-10-01T14:09:20.614237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255193844984006:6549]
2025-10-01T14:09:20.614240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255193844984006:6549]
2025-10-01T14:09:20.614289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:20.614291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:20.614297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:20.614300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.614300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:20.614303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:20.614446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:20.662052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255196221849375:6999]
2025-10-01T14:09:20.662299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 768, pipe: [1:7556255196221849375:6999]
2025-10-01T14:09:20.761106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:20.769065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.769094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.769268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.769342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.769413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.769481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.769528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.769538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.769663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.769723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.769785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.769848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.769891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.769898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.769957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.770022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.770078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.770135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.770174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.770180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.770293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.770397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.770455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.770541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.770582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.770588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.770645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.770700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.770755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.770815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.770858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.770866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.770939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.770990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.771066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.771131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.771186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.771191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.771254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.771306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.771364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.771419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.771463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.771470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.771528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.771584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.771639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.771701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.771745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.771751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.771812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.771868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.771929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.771989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.772031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.772037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.772106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:20.772168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:20.772231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:20.772296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:20.772340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:20.772347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:20.772406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849375:6999], now have 1 active actors on pipe
2025-10-01T14:09:20.772599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:20.772603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:20.772607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:20.772632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 769 reason: error at write: Disconnected sessionId: src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0
2025-10-01T14:09:20.772673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255196221849375:6999]
2025-10-01T14:09:20.772873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 769 sessionId: src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0 is DEAD
2025-10-01T14:09:20.772999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:20.773012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0] Write session will restart in 0.008595s
2025-10-01T14:09:20.773039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0] Write session: Do CDS request
2025-10-01T14:09:20.773045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:20.773466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:20.775680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:09:20.775698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 6
2025-10-01T14:09:20.782230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:20.783819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:20.784034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:20.784043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:20.784053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:20.784111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:20.784156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255193844984109:6551]
2025-10-01T14:09:20.784763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:20.785007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:20.785047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:20.785332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:20.785391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.785397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.785398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.785399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.785401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.785402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.785403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.785404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.785405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.785406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.785408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.785409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.785410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.785411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.785416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.785425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.785429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.785432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.785435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.785439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.785444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.785447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.785451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.785454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.785457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.785460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.785463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.785467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.785474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.785481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.785487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.785492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.785496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.785502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.785506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.785511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.785520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.785525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.785528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.785537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.785541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.785546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.785554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.785559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.785563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.785571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.785576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.785580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.785588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.785593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.785597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.785602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.785610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.785613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.785618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.785627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.785666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:20.786895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.786978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:20.786990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 770
2025-10-01T14:09:20.787130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.787161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:20.787170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:20.787175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:20.787503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 770 sessionId:  describe result for acl check
2025-10-01T14:09:20.787530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:20.787537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:20.787539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:20.787544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255196221849445:7412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:20.787976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255196221849445:7412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:20.789381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:20.789975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255196221849445:7412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:20.789981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:20.789995Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:20.789997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:20.790000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:20.790006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 769 [2:7556255193844984109:6551]
2025-10-01T14:09:20.790020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:20.790034Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:20.790041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.790045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.790048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.790063Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:20.790068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:20.790074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:20.790130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.790136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.790138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.790143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:20.790145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:20.790204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:20.790210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.790220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.790230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.790247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:20.790264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849382:2446], now have 1 active actors on pipe
2025-10-01T14:09:20.790273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255193844984104:6551]
2025-10-01T14:09:20.790274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255193844984104:6551]
2025-10-01T14:09:20.790276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255193844984104:6551]
2025-10-01T14:09:20.790285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:20.790284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 769
2025-10-01T14:09:20.790299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:20.790299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:20.790302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:20.790304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:20.790314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:20.790318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:20.790359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255193844984104:6551]
2025-10-01T14:09:20.790367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:20.790392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:20.790438Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:09:20.790633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 7 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:09:20.790666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:09:20.793933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255196221849445:7412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:20.793949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255196221849445:7412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:20.793952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255196221849445:7412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:20.793973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:20.794233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849486:7412], now have 1 active actors on pipe
2025-10-01T14:09:20.794254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 769
2025-10-01T14:09:20.794329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.794343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.794387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:20.794404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.794411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.794413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:20.794423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.794437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:20.794454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.794587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.794594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.794606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.794665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 770 partition: 0 MaxSeqNo: 45 sessionId: src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0
2025-10-01T14:09:20.795004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40b7c98e-f549ec8b-286401ec-e3721b7f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:20.797829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0] Write session: try to update token
2025-10-01T14:09:20.797848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:20.810221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:20.810242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:20.810244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:20.810245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:20.810253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255193844984104:6551]
2025-10-01T14:09:20.810256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255193844984104:6551]
2025-10-01T14:09:20.810259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255193844984104:6551]
2025-10-01T14:09:20.810295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:20.810301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:20.810302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:20.810305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:20.810308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.810312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:20.810456Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:20.816529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 770 sessionId: src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:20.818939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:20.873014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255196221849489:6999]
2025-10-01T14:09:20.873309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 769, pipe: [1:7556255196221849489:6999]
2025-10-01T14:09:20.950030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:20.950366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.950402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.950422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849489:6999], now have 1 active actors on pipe
2025-10-01T14:09:20.950608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:20.950906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255196221849489:6999]
2025-10-01T14:09:20.950944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:20.951009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 770 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0
2025-10-01T14:09:20.951189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 770 sessionId: src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0 is DEAD
2025-10-01T14:09:20.951327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:20.951472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:20.951479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0] Write session will restart in 0.008244s
2025-10-01T14:09:20.951498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0] Write session: Do CDS request
2025-10-01T14:09:20.951502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:20.959530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:20.960906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.960936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:20.960949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 771
2025-10-01T14:09:20.961128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:20.961165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:20.961174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:20.961177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:20.961304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:20.961511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:20.961520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:20.961531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:20.961587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:20.961609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 771 sessionId:  describe result for acl check
2025-10-01T14:09:20.961623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255193844984218:6555]
2025-10-01T14:09:20.961635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:20.961639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:20.961640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:20.961643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255196221849577:7423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:20.962020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255196221849577:7423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:20.962160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:20.962429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:20.962475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:20.962772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:20.962826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.962834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.962836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.962837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.962838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.962839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.962840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.962841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.962842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.962843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.962844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.962845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.962846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.962847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.962853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.962861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.962865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.962869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.962873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.962877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.962880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.962884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.962888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.962892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.962895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.962900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.962903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.962907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.962913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.962920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:20.962925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.962930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:20.962934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.962939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:20.962943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.962948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:20.962952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.962958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:20.962962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.962967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:20.962971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.962976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:20.962979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.962984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:20.962988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.962992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:20.962996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.963000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.963011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.963015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.963019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.963023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.963028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.963033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:20.963037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.963042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:20.963081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:20.963583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255196221849577:7423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:20.966598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255196221849577:7423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:20.966613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255196221849577:7423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:20.966616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255196221849577:7423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:20.966623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:20.966672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:20.967318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:20.967330Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:20.967332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:20.967335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:20.967339Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 770 [2:7556255193844984218:6555]
2025-10-01T14:09:20.967351Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:20.967365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:20.967370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.967374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.967376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.967388Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:20.967395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:20.967399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:20.967439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.967443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.967445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.967447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:20.967448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:20.967495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:20.967504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.967514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:20.967522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:20.967535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:20.967556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849613:7423], now have 1 active actors on pipe
2025-10-01T14:09:20.967559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255196221849511:2446], now have 1 active actors on pipe
2025-10-01T14:09:20.967564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255193844984206:6555]
2025-10-01T14:09:20.967565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255193844984206:6555]
2025-10-01T14:09:20.967566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255193844984206:6555]
2025-10-01T14:09:20.967577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:20.967578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 770
2025-10-01T14:09:20.967589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:20.967589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 770
2025-10-01T14:09:20.967590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:20.967593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:20.967594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:20.967600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:20.967602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:20.967620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255193844984206:6555]
2025-10-01T14:09:20.967626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:20.967627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:20.967647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.967656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.967684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:20.967693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:20.967696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:20.967697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:20.967703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:20.967709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:20.967726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.967830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:20.967835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:20.967845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:20.967897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 771 partition: 0 MaxSeqNo: 45 sessionId: src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0
2025-10-01T14:09:20.968222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc9b2802-335ebc8a-f70a7dd3-8c83e832_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:20.970942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0] Write session: try to update token
2025-10-01T14:09:20.970959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:20.985532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 771 sessionId: src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:20.987484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:20.987512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:20.987516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:20.987518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:20.987528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255193844984206:6555]
2025-10-01T14:09:20.987537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255193844984206:6555]
2025-10-01T14:09:20.987542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255193844984206:6555]
2025-10-01T14:09:20.987585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:20.987593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:20.987599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:20.987600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:20.987602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:20.987603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:20.987777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:20.987935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:21.051177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255200516816916:6999]
2025-10-01T14:09:21.051388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 770, pipe: [1:7556255200516816916:6999]
2025-10-01T14:09:21.128531Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:21.128996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.129012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.129055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516816916:6999], now have 1 active actors on pipe
2025-10-01T14:09:21.129293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:21.130053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:21.130061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0] Write session will restart in 0.008792s
2025-10-01T14:09:21.130078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0] Write session: Do CDS request
2025-10-01T14:09:21.130083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:21.129312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:21.129313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255200516816916:6999]
2025-10-01T14:09:21.129324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:21.129338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:21.129350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-01T14:09:21.129385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 771 reason: error at write: Disconnected sessionId: src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0
2025-10-01T14:09:21.129575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 771 sessionId: src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0 is DEAD
2025-10-01T14:09:21.139904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.140122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:21.140150Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 772
2025-10-01T14:09:21.140395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.140448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:21.140454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:21.140459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:21.140993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 772 sessionId:  describe result for acl check
2025-10-01T14:09:21.141029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:21.141038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:21.141042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:21.141047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255200516816951:7427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:21.141590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255200516816951:7427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:21.144650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:21.145684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255200516816951:7427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:21.146788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:21.147038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:21.147049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:21.147073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:21.147150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:21.147197Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255198139951614:6559]
2025-10-01T14:09:21.147751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:21.148139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:21.148178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:21.148472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:21.148532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.148533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.148534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.148534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.148535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.148536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.148537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.148538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.148539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.148540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.148541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.148542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.148543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.148544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.148550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.148558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.148561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.148565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.148568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.148572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.148575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.148578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.148581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.148586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.148590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.148594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.148597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.148600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.148608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.148615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.148621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.148626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.148629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.148633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.148637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.148641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.148645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.148650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.148654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.148658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.148662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.148667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.148670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.148675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.148680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.148684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.148689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.148694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.148698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.148703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.148706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.148711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.148715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.148720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.148724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.148730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.148782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:21.149283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255200516816951:7427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:21.149300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255200516816951:7427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:21.149303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255200516816951:7427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:21.149311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:21.152493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:21.153091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:21.153103Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:21.153105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:21.153107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:21.153113Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 771 [2:7556255198139951614:6559]
2025-10-01T14:09:21.153124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:21.153146Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:21.153152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.153154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.153155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.153167Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:21.153174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:21.153178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:21.153220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.153225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.153226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.153229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:21.153231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:21.153280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:21.153285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.153292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.153298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.153317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:21.153338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255198139951609:6559]
2025-10-01T14:09:21.153342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255198139951609:6559]
2025-10-01T14:09:21.153344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255198139951609:6559]
2025-10-01T14:09:21.153351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:21.153362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516816919:2446], now have 1 active actors on pipe
2025-10-01T14:09:21.153362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:21.153365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:21.153367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:21.153369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817018:7427], now have 1 active actors on pipe
2025-10-01T14:09:21.153377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:21.153391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:21.153392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:21.153420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255198139951609:6559]
2025-10-01T14:09:21.153431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:21.153437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:21.153456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 771
2025-10-01T14:09:21.153502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 771
2025-10-01T14:09:21.153577Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:09:21.153606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.153609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.153624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:21.153634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.153637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.153639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:21.153645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.153653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:21.153662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.153786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 8 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:09:21.153794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.153801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.153814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.153826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:09:21.153934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 772 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0
2025-10-01T14:09:21.154286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ecdc201-da74f6-6b9e4e54-2809af7b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:21.156874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0] Write session: try to update token
2025-10-01T14:09:21.156893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:21.176231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:21.176249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:21.176251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:21.176253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:21.176263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255198139951609:6559]
2025-10-01T14:09:21.176266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255198139951609:6559]
2025-10-01T14:09:21.176268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255198139951609:6559]
2025-10-01T14:09:21.176311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:21.176316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.176317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:21.176319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:21.176326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:21.176329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:21.176441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:21.180076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 772 sessionId: src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:21.182612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:21.224211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255200516817028:6999]
2025-10-01T14:09:21.225944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 771, pipe: [1:7556255200516817028:6999]
2025-10-01T14:09:21.328807Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:21.329133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.329164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.329210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817028:6999], now have 1 active actors on pipe
2025-10-01T14:09:21.329382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:21.329468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:21.329474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255200516817028:6999]
2025-10-01T14:09:21.329482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:21.329494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:21.329552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 772 reason: error at write: Disconnected sessionId: src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0
2025-10-01T14:09:21.329751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 772 sessionId: src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0 is DEAD
2025-10-01T14:09:21.329867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:21.329877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0] Write session will restart in 0.009511s
2025-10-01T14:09:21.329897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0] Write session: Do CDS request
2025-10-01T14:09:21.329901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:21.338403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:21.340122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:21.340321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:21.340331Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:21.340342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:21.340392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:21.340430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255198139951743:6572]
2025-10-01T14:09:21.340841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.340983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:21.340995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 773
2025-10-01T14:09:21.341054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:21.341140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.341179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:21.341184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:21.341187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:21.341389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:21.341443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:21.341544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 773 sessionId:  describe result for acl check
2025-10-01T14:09:21.341575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:21.341577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:21.341579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:21.341583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255200516817105:7432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:21.341783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:21.341855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.341860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.341861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.341862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.341864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.341865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.341866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.341867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.341868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.341868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.341869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.341870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.341871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.341872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.341878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.341888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.341891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.341896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.341900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.341904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.341907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.341910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.341914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.341918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.341922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.341926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.341930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.341933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.341941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.341949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.341954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.341959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.341963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.341968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.341972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.341982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.341987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.341996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.341999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.342004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.342008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.342013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.342018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.342023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.342031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.342036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.342043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.342049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.342068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.342076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.342080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.342090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.342095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.342080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255200516817105:7432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:21.342103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.342107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.342112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.342152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:21.343849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255200516817105:7432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:21.345951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:21.346234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255200516817105:7432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:21.346246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255200516817105:7432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:21.346249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255200516817105:7432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:21.346258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:21.346670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:21.346687Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:21.346690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:21.346697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:21.346703Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 772 [2:7556255198139951743:6572]
2025-10-01T14:09:21.346720Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:21.346742Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:21.346745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.346748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.346750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.346767Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:21.346773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:21.346779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:21.346831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.346840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.346842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.346845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:21.346848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:21.346908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:21.346915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.346926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.346941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.346959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:21.346979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817042:2446], now have 1 active actors on pipe
2025-10-01T14:09:21.346987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817142:7432], now have 1 active actors on pipe
2025-10-01T14:09:21.346994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255198139951738:6572]
2025-10-01T14:09:21.347001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255198139951738:6572]
2025-10-01T14:09:21.347003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255198139951738:6572]
2025-10-01T14:09:21.347017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:21.347034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:21.347040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:21.347042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:21.347045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:21.347051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:21.347054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:21.347088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255198139951738:6572]
2025-10-01T14:09:21.347098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:21.347103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:21.347111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.347116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.347243Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:21.347255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.347259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.347261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:21.347269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.347282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:21.347305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.347421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.347429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.347444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.347808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad17c773-69abc078-ac52e1b8-b98e4ae2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:21.347016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 772
2025-10-01T14:09:21.347019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 772
2025-10-01T14:09:21.347510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 773 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0
2025-10-01T14:09:21.350175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0] Write session: try to update token
2025-10-01T14:09:21.350191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:21.365369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 773 sessionId: src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:21.368512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:21.368910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.368937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.368953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:21.368957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:21.368959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:21.368960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:21.368966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255198139951738:6572]
2025-10-01T14:09:21.368969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255198139951738:6572]
2025-10-01T14:09:21.368975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255198139951738:6572]
2025-10-01T14:09:21.369023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:21.369026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:21.369031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:21.369035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.369035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:21.369037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:21.369188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:21.429526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255200516817149:6999]
2025-10-01T14:09:21.429817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 772, pipe: [1:7556255200516817149:6999]
2025-10-01T14:09:21.513778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:21.514035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:21.514104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817149:6999], now have 1 active actors on pipe
2025-10-01T14:09:21.514157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:21.518613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255200516817149:6999]
2025-10-01T14:09:21.518643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:21.524258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:21.524272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:21.524296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 773 reason: error at write: Disconnected sessionId: src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0
2025-10-01T14:09:21.524433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 773 sessionId: src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0 is DEAD
2025-10-01T14:09:21.524604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:21.524616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0] Write session will restart in 0.005009s
2025-10-01T14:09:21.524643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0] Write session: Do CDS request
2025-10-01T14:09:21.524652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:21.530981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.530947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:21.530961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 774
2025-10-01T14:09:21.531199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.531250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:21.531262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:21.531265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:21.531723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 774 sessionId:  describe result for acl check
2025-10-01T14:09:21.531766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:21.531772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:21.531775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:21.531782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255200516817213:7436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:21.532276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:21.532276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255200516817213:7436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:21.534053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:21.534248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:21.534260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:21.534271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:21.534312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:21.534350Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255198139951859:6576]
2025-10-01T14:09:21.535000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:21.535022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255200516817213:7436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:21.535261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:21.535295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:21.535596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:21.535640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.535653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.535654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.535655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.535657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.535658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.535659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.535660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.535661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.535662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.535663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.535664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.535666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.535667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.535671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.535680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.535684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.535688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.535691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.535695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.535698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.535702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.535706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.535709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.535713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.535717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.535721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.535724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.535729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.535736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.535741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.535746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.535755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.535759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.535763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.535768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.535777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.535782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.535790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.535794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.535804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.535808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.535817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.535822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.535826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.535834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.535838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.535846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.535850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.535855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.535858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.535863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.535866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.535871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.535875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.535879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.535916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:21.539364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255200516817213:7436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:21.539381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255200516817213:7436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:21.539385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255200516817213:7436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:21.539393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:21.539554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:21.540259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:21.540277Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:21.540279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:21.540283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:21.540289Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 773 [2:7556255198139951859:6576]
2025-10-01T14:09:21.540304Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:21.540318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:21.540325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.540330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.540338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.540353Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:21.540364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:21.540373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:21.540426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.540434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.540436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.540439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:21.540441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:21.540504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:21.540510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.540520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.540530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.540549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:21.540571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817265:7436], now have 1 active actors on pipe
2025-10-01T14:09:21.540577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817152:2446], now have 1 active actors on pipe
2025-10-01T14:09:21.540583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255198139951854:6576]
2025-10-01T14:09:21.540585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255198139951854:6576]
2025-10-01T14:09:21.540587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255198139951854:6576]
2025-10-01T14:09:21.540574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 773
2025-10-01T14:09:21.540596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:21.540585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 773
2025-10-01T14:09:21.540608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:21.540610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:21.540611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:21.540612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:21.540624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:21.540627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:21.540645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.540654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.540687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255198139951854:6576]
2025-10-01T14:09:21.540697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:21.540703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:21.540715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac6a1249-a116439d-18653a11-8fe81943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:21.540724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.540728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.540734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:21.540741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.540763Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:21.540800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.540942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.540948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.540959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.541083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 774 partition: 0 MaxSeqNo: 45 sessionId: src_id|ac6a1249-a116439d-18653a11-8fe81943_0
2025-10-01T14:09:21.541425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d74005f-5f86e5a6-b252d32f-76b30625_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ac6a1249-a116439d-18653a11-8fe81943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:21.543736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac6a1249-a116439d-18653a11-8fe81943_0] Write session: try to update token
2025-10-01T14:09:21.543751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac6a1249-a116439d-18653a11-8fe81943_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:21.551500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:21.551521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:21.551530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255198139951854:6576]
2025-10-01T14:09:21.551573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:21.551573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:21.551759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:21.551903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:21.552040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:21.552177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:21.552369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:21.552413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:21.558599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 774 sessionId: src_id|ac6a1249-a116439d-18653a11-8fe81943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:21.561271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:21.561456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.561481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.561520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:21.561604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:21.570557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:21.570576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:21.570579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:21.570581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:21.570596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255198139951854:6576]
2025-10-01T14:09:21.570600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255198139951854:6576]
2025-10-01T14:09:21.570603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255198139951854:6576]
2025-10-01T14:09:21.570651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:21.570657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:21.570660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.570662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:21.570673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:21.570677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:21.570861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:21.618962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255200516817273:6999]
2025-10-01T14:09:21.619203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 773, pipe: [1:7556255200516817273:6999]
2025-10-01T14:09:21.714659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:21.722077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.722105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.722257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.722340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.722421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.722479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.722889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.722902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.722966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.723025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.723080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.723138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.723185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.723193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.723260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.723321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.723388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.723454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.723499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.723504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.723566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.723621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.723688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.723757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.723798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.723803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.723873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.723939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.724005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.724060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.724099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.724105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.724167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.724232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.724298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.724371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.724409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.724411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.724473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.724539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.724599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.724661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.724721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.724727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.724803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.724862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.724919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.724980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.725025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.725031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.725093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.725160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.725222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.725290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.725400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.725405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.725464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.725528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.725590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.725649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.725690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.725696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.725759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817273:6999], now have 1 active actors on pipe
2025-10-01T14:09:21.725993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:21.726028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255200516817273:6999]
2025-10-01T14:09:21.726041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:21.726048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:21.726073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 774 reason: error at write: Disconnected sessionId: src_id|ac6a1249-a116439d-18653a11-8fe81943_0
2025-10-01T14:09:21.726266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 774 sessionId: src_id|ac6a1249-a116439d-18653a11-8fe81943_0 is DEAD
2025-10-01T14:09:21.726286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:21.726419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac6a1249-a116439d-18653a11-8fe81943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:21.726430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac6a1249-a116439d-18653a11-8fe81943_0] Write session will restart in 0.009778s
2025-10-01T14:09:21.726456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac6a1249-a116439d-18653a11-8fe81943_0] Write session: Do CDS request
2025-10-01T14:09:21.726473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac6a1249-a116439d-18653a11-8fe81943_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:21.735618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:21.737091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:21.737280Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:21.737295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:21.737307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:21.737373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:21.737411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255198139951961:6578]
2025-10-01T14:09:21.737853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac6a1249-a116439d-18653a11-8fe81943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.737883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:21.737894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 775
2025-10-01T14:09:21.737941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:21.738046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.738068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:21.738072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:21.738076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:21.738227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:21.738279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:21.738413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 775 sessionId:  describe result for acl check
2025-10-01T14:09:21.738445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:21.738450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:21.738452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:21.738457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255200516817343:7442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:21.738587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:21.738668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.738676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.738677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.738677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.738679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.738679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.738680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.738681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.738683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.738684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.738685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.738686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.738687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.738688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.738694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.738703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.738708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.738711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.738714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.738718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.738720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.738723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.738727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.738730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.738733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.738736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.738740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.738743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.738749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.738756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.738761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.738766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.738770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.738774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.738777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.738781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.738785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.738790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.738794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.738801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.738806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.738810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.738814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.738818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.738822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.738835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.738839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.738844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.738848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.738852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.738855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.738859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.738863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.738868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.738871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.738876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.738914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:21.738968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255200516817343:7442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:21.741113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255200516817343:7442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:21.742528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:21.743275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:21.743291Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:21.743293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:21.743297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:21.743302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 774 [2:7556255198139951961:6578]
2025-10-01T14:09:21.743321Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:21.743345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:21.743348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.743352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.743354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.743370Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:21.743380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:21.743386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:21.743449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.743457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.743459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.743461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:21.743464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:21.743482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255200516817343:7442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:21.743496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255200516817343:7442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:21.743501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255200516817343:7442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:21.743510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:21.743528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:21.743536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.743547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.743561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.743577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:21.743599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817277:2446], now have 1 active actors on pipe
2025-10-01T14:09:21.743610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255198139951956:6578]
2025-10-01T14:09:21.743612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255198139951956:6578]
2025-10-01T14:09:21.743614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255198139951956:6578]
2025-10-01T14:09:21.743627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:21.743641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 774
2025-10-01T14:09:21.743639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:21.743645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:21.743647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:21.743649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:21.743663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:21.743665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:21.743704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255198139951956:6578]
2025-10-01T14:09:21.743713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:21.743714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:21.743725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817379:7442], now have 1 active actors on pipe
2025-10-01T14:09:21.743756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 774
2025-10-01T14:09:21.743786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.743796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.743819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:21.743830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.743838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.743849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:21.743858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.743870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:21.743887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.744025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.744035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.744053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.744135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 775 partition: 0 MaxSeqNo: 45 sessionId: src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0
2025-10-01T14:09:21.744440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac6a1249-a116439d-18653a11-8fe81943_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:21.746786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0] Write session: try to update token
2025-10-01T14:09:21.746801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:21.754202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:21.754226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:21.754237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255198139951956:6578]
2025-10-01T14:09:21.754269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:21.754283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:21.754767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:21.754942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:21.755103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:21.755260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:21.755467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:21.755519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:21.762221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 775 sessionId: src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:21.764450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:21.764636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.764662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.764693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:21.764786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:21.772991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:21.773008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:21.773011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:21.773013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:21.773022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255198139951956:6578]
2025-10-01T14:09:21.773025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255198139951956:6578]
2025-10-01T14:09:21.773028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255198139951956:6578]
2025-10-01T14:09:21.773059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:21.773061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:21.773067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.773068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:21.773071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:21.773074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:21.773184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:21.826327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255200516817387:6999]
2025-10-01T14:09:21.826572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 774, pipe: [1:7556255200516817387:6999]
2025-10-01T14:09:21.911758Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:21.919148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.919176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.919338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.919398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.919460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.919524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.919964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.919976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.920039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.920102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.920161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.920223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.920264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.920271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.920326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.920399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.920483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.920567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.920605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.920611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.920693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.920749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.920818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.920868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.920909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.920912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.920965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.921016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.921074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.921135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.921256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.921266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.921320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.921372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.921428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.921485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.921528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.921534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.921598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.921654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.921710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.921767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.921821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.921827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.921885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.921940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.921994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.922049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.922093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.922099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.922160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.922219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.922285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.922345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.922402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.922409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.922470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:21.922530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:21.922596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:21.922659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:21.922705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:21.922717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:21.922778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817387:6999], now have 1 active actors on pipe
2025-10-01T14:09:21.923026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:21.923030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255200516817387:6999]
2025-10-01T14:09:21.923055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:21.923057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:21.923083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 775 reason: error at write: Disconnected sessionId: src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0
2025-10-01T14:09:21.923257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 775 sessionId: src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0 is DEAD
2025-10-01T14:09:21.923300Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:21.923390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:21.923400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0] Write session will restart in 0.005584s
2025-10-01T14:09:21.923424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0] Write session: Do CDS request
2025-10-01T14:09:21.923429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:21.929847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.929939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:21.929948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 776
2025-10-01T14:09:21.930087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:21.930129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:21.930134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:21.930138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:21.930558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 776 sessionId:  describe result for acl check
2025-10-01T14:09:21.930591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:21.930593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:21.930594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:21.930599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255200516817437:7446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:21.931074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255200516817437:7446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:21.932139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:21.933729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255200516817437:7446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:21.933755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:21.933947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:21.933959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:21.933971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:21.934021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:21.934058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255198139952066:6581]
2025-10-01T14:09:21.934647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:21.934974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:21.935021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:21.935341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:21.935389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.935394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.935395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.935397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.935398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.935399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.935400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.935401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.935402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.935403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.935405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.935405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.935406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.935407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.935412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.935421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.935425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.935429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.935432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.935436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.935439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.935443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.935446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.935450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.935454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.935457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.935461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.935464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.935471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.935478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:21.935491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.935496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:21.935500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.935509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:21.935513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.935518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:21.935526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.935531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:21.935538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.935543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:21.935547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.935556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:21.935560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.935564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:21.935571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.935576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:21.935583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.935588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.935592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.935597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.935604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.935608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.935613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.935620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:21.935624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.935628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:21.935669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:21.938611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255200516817437:7446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:21.938640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255200516817437:7446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:21.938643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255200516817437:7446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:21.938652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:21.939188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:21.939811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:21.939824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:21.939827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:21.939830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:21.939837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 775 [2:7556255198139952066:6581]
2025-10-01T14:09:21.939852Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:21.939873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:21.939880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.939885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.939891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.939913Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:21.939925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:21.939932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:21.939987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.939994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.939996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.939999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:21.940001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:21.940061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:21.940068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.940080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:21.940093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:21.940112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:21.940133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817390:2446], now have 1 active actors on pipe
2025-10-01T14:09:21.940140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255200516817493:7446], now have 1 active actors on pipe
2025-10-01T14:09:21.940147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255198139952061:6581]
2025-10-01T14:09:21.940149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255198139952061:6581]
2025-10-01T14:09:21.940150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255198139952061:6581]
2025-10-01T14:09:21.940163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:21.940179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:21.940185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:21.940189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:21.940191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:21.940195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:21.940175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 775
2025-10-01T14:09:21.940198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:21.940178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 775
2025-10-01T14:09:21.940223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255198139952061:6581]
2025-10-01T14:09:21.940229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:21.940232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:21.940255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.940264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.940291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92109441-602137de-92fe307e-b2f2444c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:21.940301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:21.940304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:21.940310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:21.940320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:21.940328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:21.940347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.940466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.940472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.940485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:21.940557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 776 partition: 0 MaxSeqNo: 45 sessionId: src_id|92109441-602137de-92fe307e-b2f2444c_0
2025-10-01T14:09:21.940888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a22dc542-1c2a3fb-cbd342ae-b8facb3d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|92109441-602137de-92fe307e-b2f2444c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:21.943286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92109441-602137de-92fe307e-b2f2444c_0] Write session: try to update token
2025-10-01T14:09:21.943303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92109441-602137de-92fe307e-b2f2444c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:21.957486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 776 sessionId: src_id|92109441-602137de-92fe307e-b2f2444c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:21.959841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:21.960517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:21.960540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:21.960563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:21.960567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:21.960569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:21.960571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:21.960580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255198139952061:6581]
2025-10-01T14:09:21.960584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255198139952061:6581]
2025-10-01T14:09:21.960590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255198139952061:6581]
2025-10-01T14:09:21.960623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:21.960636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:21.960639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:21.960642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:21.960648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:21.960650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:21.960792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:22.022950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255204811784819:6999]
2025-10-01T14:09:22.023206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 775, pipe: [1:7556255204811784819:6999]
2025-10-01T14:09:22.102315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:22.102640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:22.102686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811784819:6999], now have 1 active actors on pipe
2025-10-01T14:09:22.102757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:22.102920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255204811784819:6999]
2025-10-01T14:09:22.102950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:22.112801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:22.114558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:22.114776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:22.114788Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:22.114800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:22.114866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:22.114909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255202434919475:6585]
2025-10-01T14:09:22.114894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:22.114908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:22.114933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 776 reason: error at write: Disconnected sessionId: src_id|92109441-602137de-92fe307e-b2f2444c_0
2025-10-01T14:09:22.115090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 776 sessionId: src_id|92109441-602137de-92fe307e-b2f2444c_0 is DEAD
2025-10-01T14:09:22.115215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92109441-602137de-92fe307e-b2f2444c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:22.115225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92109441-602137de-92fe307e-b2f2444c_0] Write session will restart in 0.007361s
2025-10-01T14:09:22.115249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92109441-602137de-92fe307e-b2f2444c_0] Write session: Do CDS request
2025-10-01T14:09:22.115255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92109441-602137de-92fe307e-b2f2444c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:22.115491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:22.121546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:22.121628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:22.122009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:22.122068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.122074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.122075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.122077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.122078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.122079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.122081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.122082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.122083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.122084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.122086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.122087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.122088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.122089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.122096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.122106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.122109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.122113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.122117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.122121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.122125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.122129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.122133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.122136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.122140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.122144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.122148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.122151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.122166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.122174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.122180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.122185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.122190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.122195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.122200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.122213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.122218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.122224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.122228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.122233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.122238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.122243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.122255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.122259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.122264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.122268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.122272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.122276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.122285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.122289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.122295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.122305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.122309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.122314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.122322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.122326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.122365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:22.123892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92109441-602137de-92fe307e-b2f2444c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.123989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:22.124004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 777
2025-10-01T14:09:22.124152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.124197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:22.124208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:22.124212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:22.124775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 777 sessionId:  describe result for acl check
2025-10-01T14:09:22.124823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:22.124830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:22.124832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:22.124839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255204811784901:7463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:22.125790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255204811784901:7463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:22.126262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:22.126860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:22.126875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:22.126878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:22.126881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:22.126889Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 776 [2:7556255202434919475:6585]
2025-10-01T14:09:22.126905Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:22.126919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:22.126930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.126934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.126936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.126952Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:22.126961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:22.126967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:22.127026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.127035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.127037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.127040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:22.127042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:22.127108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:22.127114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.127125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.127139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.127159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:22.127178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811784830:2446], now have 1 active actors on pipe
2025-10-01T14:09:22.127190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255202434919469:6585]
2025-10-01T14:09:22.127195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255202434919469:6585]
2025-10-01T14:09:22.127197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255202434919469:6585]
2025-10-01T14:09:22.127207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 776
2025-10-01T14:09:22.127208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:22.127225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:22.127229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:22.127232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:22.127234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:22.127239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:22.127242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:22.127273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255202434919469:6585]
2025-10-01T14:09:22.127282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:22.127288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:22.128107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255204811784901:7463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:22.133517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255204811784901:7463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:22.133533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255204811784901:7463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:22.133536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255204811784901:7463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:22.133544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:22.133776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811784938:7463], now have 1 active actors on pipe
2025-10-01T14:09:22.133826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 776
2025-10-01T14:09:22.133911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.133926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.133954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:22.133972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.133978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.133981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:22.133994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.134014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:22.134039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.134202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.134218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.134236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.134339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 777 partition: 0 MaxSeqNo: 45 sessionId: src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0
2025-10-01T14:09:22.134679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92109441-602137de-92fe307e-b2f2444c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:22.137080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0] Write session: try to update token
2025-10-01T14:09:22.137097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:22.147647Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:22.147670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:22.147676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:22.147678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:22.147686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255202434919469:6585]
2025-10-01T14:09:22.147691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255202434919469:6585]
2025-10-01T14:09:22.147695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255202434919469:6585]
2025-10-01T14:09:22.147741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:22.147745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:22.147748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.147751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:22.147751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:22.147755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:22.147919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:22.153048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 777 sessionId: src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:22.155485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:22.203181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255204811784942:6999]
2025-10-01T14:09:22.208283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 776, pipe: [1:7556255204811784942:6999]
2025-10-01T14:09:22.296910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:22.297252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.297270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.297292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811784942:6999], now have 1 active actors on pipe
2025-10-01T14:09:22.297469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:22.297480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:22.297489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:22.297527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 777 reason: error at write: Disconnected sessionId: src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0
2025-10-01T14:09:22.297530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255204811784942:6999]
2025-10-01T14:09:22.297488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:22.297719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 777 sessionId: src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0 is DEAD
2025-10-01T14:09:22.297837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 163 BytesWritten: 85606466 MessagesWritten: 38 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-01T14:09:22.297889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:22.297894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0] Write session will restart in 0.006010s
2025-10-01T14:09:22.297918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0] Write session: Do CDS request
2025-10-01T14:09:22.297924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:22.304909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.305007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:22.305023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 778
2025-10-01T14:09:22.305140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.305175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:22.305181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:22.305185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:22.305542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 778 sessionId:  describe result for acl check
2025-10-01T14:09:22.305572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:22.305574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:22.305575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:22.305579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255204811784968:7468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:22.306086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255204811784968:7468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:22.308068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255204811784968:7468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:22.309041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:22.311233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:22.311462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:22.311472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:22.311484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:22.311528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:22.311766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255204811784968:7468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:22.311783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255204811784968:7468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:22.311786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255204811784968:7468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:22.311794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:22.311565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255202434919610:6597]
2025-10-01T14:09:22.312121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:22.312413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:22.312451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:22.312725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:22.312794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.312800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.312802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.312803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.312804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.312805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.312806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.312808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.312809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.312810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.312811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.312812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.312814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.312815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.312820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.312830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.312833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.312836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.312839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.312842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.312844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.312848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.312851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.312855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.312859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.312862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.312865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.312869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.312876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.312883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.312889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.312894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.312898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.312902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.312907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.312912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.312916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.312921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.312930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.312934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.312939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.312949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.312952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.312957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.312966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.312972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.312980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.312985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.312994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.312999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.313008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.313013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.313017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.313025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.313029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.313033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.313070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:22.321514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:22.322207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:22.322224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:22.322227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:22.322231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:22.322240Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 777 [2:7556255202434919610:6597]
2025-10-01T14:09:22.322258Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:22.322279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:22.322286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.322290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.322292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.322310Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:22.322315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:22.322339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:22.322418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.322425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.322427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.322431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:22.322433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:22.322502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:22.322511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.322524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.322536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.322552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:22.322680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 777
2025-10-01T14:09:22.322716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 777
2025-10-01T14:09:22.322570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255202434919604:6597]
2025-10-01T14:09:22.322573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255202434919604:6597]
2025-10-01T14:09:22.322575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255202434919604:6597]
2025-10-01T14:09:22.322584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:22.322592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:22.322595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:22.322598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:22.322601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785052:7468], now have 1 active actors on pipe
2025-10-01T14:09:22.322605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811784954:2446], now have 1 active actors on pipe
2025-10-01T14:09:22.322613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:22.322627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:22.322630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:22.322670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255202434919604:6597]
2025-10-01T14:09:22.322677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:22.322684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:22.322900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.322916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.322950Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:22.322958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.322963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.322965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:22.322975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.322986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:22.323006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.323293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.323303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.323317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.323405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 778 partition: 0 MaxSeqNo: 45 sessionId: src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0
2025-10-01T14:09:22.323773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b5ea2e2-ee1bde4b-4aff6745-ce99618_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:22.326249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0] Write session: try to update token
2025-10-01T14:09:22.326266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:22.340575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 778 sessionId: src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:22.342883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:22.344496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.344522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.344563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:22.344682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:22.357041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:22.357062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:22.357066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:22.357068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:22.357078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255202434919604:6597]
2025-10-01T14:09:22.357086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255202434919604:6597]
2025-10-01T14:09:22.357091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255202434919604:6597]
2025-10-01T14:09:22.357131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:22.357143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:22.357145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:22.357149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:22.357151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.357154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:22.357288Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:22.397742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255204811785066:6999]
2025-10-01T14:09:22.398025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 777, pipe: [1:7556255204811785066:6999]
2025-10-01T14:09:22.502722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:22.509966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.509991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.510129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.510184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.510248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.510308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.510348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.510356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.510436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.510492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.510548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.510609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.510656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.510662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.510718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.510773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.510834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.510891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.510930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.510936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.511036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.511092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.511145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.511196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.511236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.511243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.511310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.511365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.511434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.511497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.511539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.511546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.511616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.511675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.511735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.511798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.511840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.511849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.511912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.511972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.512038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.512096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.512134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.512142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.512196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.512247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.512305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.512356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.512461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.512466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.512519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.512572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.512627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.512677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.512718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.512724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.512800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.512852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.512906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.512959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.512997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.513002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.513080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785066:6999], now have 1 active actors on pipe
2025-10-01T14:09:22.513279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:22.513282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255204811785066:6999]
2025-10-01T14:09:22.513291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:22.513301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:22.513318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 778 reason: error at write: Disconnected sessionId: src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0
2025-10-01T14:09:22.513494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 778 sessionId: src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0 is DEAD
2025-10-01T14:09:22.513616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:22.513626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0] Write session will restart in 0.005044s
2025-10-01T14:09:22.513649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0] Write session: Do CDS request
2025-10-01T14:09:22.513655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:22.513924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:22.519901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.519983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:22.519995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 779
2025-10-01T14:09:22.520312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.520360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:22.520370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:22.520374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:22.520787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 779 sessionId:  describe result for acl check
2025-10-01T14:09:22.520828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:22.520834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:22.520836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:22.520841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255204811785083:7472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:22.521307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255204811785083:7472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:22.523618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255204811785083:7472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:22.524220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:22.526097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:22.526205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255204811785083:7472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:22.526217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255204811785083:7472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:22.526220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255204811785083:7472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:22.526229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:22.526286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:22.526294Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:22.526302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:22.526339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:22.526393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255202434919730:6601]
2025-10-01T14:09:22.526936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:22.527208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:22.527254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:22.527516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:22.527574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.527581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.527582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.527583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.527584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.527585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.527586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.527587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.527588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.527589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.527590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.527591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.527592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.527593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.527598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.527607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.527612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.527616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.527619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.527623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.527626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.527630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.527633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.527637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.527641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.527644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.527647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.527651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.527658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.527665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.527670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.527675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.527680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.527685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.527694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.527697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.527699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.527702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.527704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.527707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.527710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.527713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.527715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.527718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.527721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.527723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.527726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.527729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.527731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.527734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.527736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.527739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.527741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.527744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.527746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.527749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.527768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:22.531322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:22.531977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:22.531993Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:22.531997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:22.532000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:22.532006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 778 [2:7556255202434919730:6601]
2025-10-01T14:09:22.532020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:22.532041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:22.532048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.532051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.532053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.532068Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:22.532077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:22.532083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:22.532149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.532156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.532158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.532161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:22.532163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:22.532234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:22.532241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.532253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.532269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.532289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:22.532310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785171:7472], now have 1 active actors on pipe
2025-10-01T14:09:22.532318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785069:2446], now have 1 active actors on pipe
2025-10-01T14:09:22.532325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255202434919724:6601]
2025-10-01T14:09:22.532332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255202434919724:6601]
2025-10-01T14:09:22.532334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255202434919724:6601]
2025-10-01T14:09:22.532347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:22.532359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:22.532366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:22.532368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:22.532370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:22.532380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:22.532356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 778
2025-10-01T14:09:22.532383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:22.532374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 778
2025-10-01T14:09:22.532415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255202434919724:6601]
2025-10-01T14:09:22.532426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:22.532430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:22.532444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.532453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.532498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:22.532510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.532517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.532519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:22.532531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.532540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:22.532562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.532740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.532749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.532774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.532857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 779 partition: 0 MaxSeqNo: 45 sessionId: src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0
2025-10-01T14:09:22.533188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de98ac3-1f08d790-4fb21649-783f5d44_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:22.535467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0] Write session: try to update token
2025-10-01T14:09:22.535484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:22.557673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 779 sessionId: src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:22.560036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:22.560236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.560261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.560297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:22.560369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:22.566168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:22.566190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:22.566193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:22.566195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:22.566208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255202434919724:6601]
2025-10-01T14:09:22.566212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255202434919724:6601]
2025-10-01T14:09:22.566218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255202434919724:6601]
2025-10-01T14:09:22.566267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:22.566273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.566275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:22.566460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:22.570434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:22.570456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:22.570460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:22.613269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255204811785195:6999]
2025-10-01T14:09:22.613566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 778, pipe: [1:7556255204811785195:6999]
2025-10-01T14:09:22.713439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:22.720676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.720707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.720890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.720964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.721039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.721103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.721149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.721155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.721230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.721292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.721347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.721402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.721442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.721444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.721530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.721602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.721657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.721716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.721753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.721756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.721816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.721868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.721916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.721964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.721999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.722001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.722056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.722104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.722157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.722207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.722243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.722248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.722307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.722523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.722588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.722643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.722683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.722688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.722751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.722811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.722866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.722923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.722962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.722968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.723024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.723087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.723152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.723221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.723266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.723272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.723332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.723388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.723447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.723522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.723566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.723571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.723632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:22.723686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:22.723745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:22.723804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:22.723855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:22.723862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:22.723919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785195:6999], now have 1 active actors on pipe
2025-10-01T14:09:22.724132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255204811785195:6999]
2025-10-01T14:09:22.724141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:22.724166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:22.724168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:22.724202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 779 reason: error at write: Disconnected sessionId: src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0
2025-10-01T14:09:22.724403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 779 sessionId: src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0 is DEAD
2025-10-01T14:09:22.724541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:22.724553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0] Write session will restart in 0.006389s
2025-10-01T14:09:22.724579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0] Write session: Do CDS request
2025-10-01T14:09:22.724585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:22.724903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:22.731896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.732037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:22.732050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 780
2025-10-01T14:09:22.732157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.732199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:22.732209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:22.732213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:22.732573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 780 sessionId:  describe result for acl check
2025-10-01T14:09:22.732602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:22.732607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:22.732610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:22.732615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255204811785264:7478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:22.733113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255204811785264:7478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:22.733463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:22.735136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:22.735331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:22.735343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:22.735353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:22.735403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:22.735457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255202434919836:6603]
2025-10-01T14:09:22.735571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255204811785264:7478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:22.735992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:22.736298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:22.736344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:22.736630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:22.736684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.736689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.736690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.736691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.736692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.736693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.736694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.736695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.736696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.736697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.736698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.736699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.736700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.736701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.736706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.736716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.736720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.736724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.736727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.736731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.736734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.736737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.736740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.736742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.736744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.736750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.736751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.736763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.736770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.736778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.736782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.736785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.736787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.736790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.736792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.736795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.736797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.736800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.736805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.736808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.736811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.736813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.736816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.736819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.736821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.736823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.736827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.736830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.736836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.736838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.736841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.736843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.736848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.736851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.736853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.736856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.736880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:22.740308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255204811785264:7478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:22.740322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255204811785264:7478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:22.740325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255204811785264:7478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:22.740333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:22.740456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:22.741097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:22.741111Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:22.741113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:22.741117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:22.741124Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 779 [2:7556255202434919836:6603]
2025-10-01T14:09:22.741139Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:22.741169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:22.741176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.741179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.741182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.741197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:22.741203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:22.741209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:22.741266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.741273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.741277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.741280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:22.741283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:22.741348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:22.741355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.741366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.741377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.741393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:22.741416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785306:7478], now have 1 active actors on pipe
2025-10-01T14:09:22.741419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785199:2446], now have 1 active actors on pipe
2025-10-01T14:09:22.741427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255202434919831:6603]
2025-10-01T14:09:22.741431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255202434919831:6603]
2025-10-01T14:09:22.741430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 779
2025-10-01T14:09:22.741433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255202434919831:6603]
2025-10-01T14:09:22.741439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 779
2025-10-01T14:09:22.741447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:22.741462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:22.741471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:22.741476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:22.741479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:22.741482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:22.741484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:22.741506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255202434919831:6603]
2025-10-01T14:09:22.741517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:22.741525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:22.741532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.741537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.741583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f833618-144746bf-5b524af4-ada69a19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:22.741598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.741602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.741604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:22.741614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.741623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:22.741640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.741773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.741780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.741794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.741858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 780 partition: 0 MaxSeqNo: 45 sessionId: src_id|f833618-144746bf-5b524af4-ada69a19_0
2025-10-01T14:09:22.742181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5df578c8-23ab825c-e6ab9f0-f7e904e4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f833618-144746bf-5b524af4-ada69a19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:22.744522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f833618-144746bf-5b524af4-ada69a19_0] Write session: try to update token
2025-10-01T14:09:22.744539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f833618-144746bf-5b524af4-ada69a19_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:22.758026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 780 sessionId: src_id|f833618-144746bf-5b524af4-ada69a19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:22.760232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:22.762160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.762183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.762209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:22.762211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:22.762214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:22.762216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:22.762225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255202434919831:6603]
2025-10-01T14:09:22.762229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255202434919831:6603]
2025-10-01T14:09:22.762232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255202434919831:6603]
2025-10-01T14:09:22.762273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:22.762291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:22.762295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:22.762297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.762299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:22.762299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:22.762459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:22.824241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255204811785314:6999]
2025-10-01T14:09:22.824579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 779, pipe: [1:7556255204811785314:6999]
2025-10-01T14:09:22.909122Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:22.909347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:22.909400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785314:6999], now have 1 active actors on pipe
2025-10-01T14:09:22.909480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:22.909580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:22.909620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255204811785314:6999]
2025-10-01T14:09:22.919179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:22.919681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:22.919694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:22.919715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 780 reason: error at write: Disconnected sessionId: src_id|f833618-144746bf-5b524af4-ada69a19_0
2025-10-01T14:09:22.919843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 780 sessionId: src_id|f833618-144746bf-5b524af4-ada69a19_0 is DEAD
2025-10-01T14:09:22.919969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f833618-144746bf-5b524af4-ada69a19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:22.919992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f833618-144746bf-5b524af4-ada69a19_0] Write session will restart in 0.006401s
2025-10-01T14:09:22.920019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f833618-144746bf-5b524af4-ada69a19_0] Write session: Do CDS request
2025-10-01T14:09:22.920024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f833618-144746bf-5b524af4-ada69a19_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:22.924765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:22.924965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:22.924978Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:22.924988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:22.925036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:22.925072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255202434919947:6606]
2025-10-01T14:09:22.925660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:22.925966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:22.926007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:22.926242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:22.926311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.926316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.926317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.926318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.926318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.926319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.926320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.926321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.926321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.926322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.926323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.926323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.926324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.926325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.926328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.926335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.926337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.926339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.926340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.926342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.926344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.926346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.926348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.926350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.926352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.926354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.926355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.926357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.926385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.926390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:22.926394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.926396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:22.926399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.926403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:22.926406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.926409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:22.926412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.926414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:22.926416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.926419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:22.926422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.926425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:22.926427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.926430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:22.926432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.926435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:22.926438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.926440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.926443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.926445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.926448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.926451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.926453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.926456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:22.926458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.926461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:22.926481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:22.927926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f833618-144746bf-5b524af4-ada69a19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.927970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:22.927983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 781
2025-10-01T14:09:22.928128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:22.928158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:22.928168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:22.928171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:22.928552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 781 sessionId:  describe result for acl check
2025-10-01T14:09:22.928588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:22.928594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:22.928596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:22.928601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255204811785390:7482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:22.929147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255204811785390:7482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:22.930182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:22.930893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:22.930907Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:22.930910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:22.930916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:22.930922Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 780 [2:7556255202434919947:6606]
2025-10-01T14:09:22.930938Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:22.930954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:22.930963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.930966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.930969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.930985Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:22.930996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:22.931002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:22.931053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.931061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.931064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.931067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:22.931070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:22.931133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:22.931142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.931154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:22.931169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:22.931189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:22.931213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785316:2446], now have 1 active actors on pipe
2025-10-01T14:09:22.931225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255202434919941:6606]
2025-10-01T14:09:22.931227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255202434919941:6606]
2025-10-01T14:09:22.931229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255202434919941:6606]
2025-10-01T14:09:22.931240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:22.931253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:22.931254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:22.931258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:22.931220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 780
2025-10-01T14:09:22.931260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:22.931271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:22.931274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:22.931310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255202434919941:6606]
2025-10-01T14:09:22.931321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:22.931340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:22.931588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255204811785390:7482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:22.937875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255204811785390:7482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:22.937890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255204811785390:7482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:22.937893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255204811785390:7482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:22.937902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:22.938137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255204811785428:7482], now have 1 active actors on pipe
2025-10-01T14:09:22.938169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 780
2025-10-01T14:09:22.938222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.938234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.938259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:22.938275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:22.938281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:22.938283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:22.938294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:22.938317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:22.938340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.938507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.938520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.938548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:22.938645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 781 partition: 0 MaxSeqNo: 45 sessionId: src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0
2025-10-01T14:09:22.939026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f833618-144746bf-5b524af4-ada69a19_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:22.941340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0] Write session: try to update token
2025-10-01T14:09:22.941357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:22.941920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:22.941939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:22.941945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255202434919941:6606]
2025-10-01T14:09:22.941977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:22.941983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:22.942141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:22.942277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:22.942426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:22.942571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:22.942776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:22.942828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:22.958762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 781 sessionId: src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:22.961085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:22.961407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:22.961448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:22.961483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:22.961548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:22.963395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:22.963413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:22.963416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:22.963418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:22.963428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255202434919941:6606]
2025-10-01T14:09:22.963432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255202434919941:6606]
2025-10-01T14:09:22.963435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255202434919941:6606]
2025-10-01T14:09:22.963479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:22.963480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:22.963486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:22.963489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:22.963491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:22.963494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:22.963617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:23.009555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255209106752732:6999]
2025-10-01T14:09:23.009817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 780, pipe: [1:7556255209106752732:6999]
2025-10-01T14:09:23.106365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:23.113268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.113298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.113460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.113521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.113586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.113644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.113760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.113773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.113835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.113886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.113951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.114009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.114052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.114059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.114121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.114175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.114232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.114294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.114334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.114341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.114418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.114486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.114546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.114606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.114647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.114654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.114709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.114760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.114829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.114886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.115335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.115346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.115421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.115494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.115547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.115604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.115698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.115708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.115764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.115816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.115880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.115939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.115980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.115986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.116045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.116100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.116158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.116210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.116248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.116257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.116313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.116360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.116419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.116473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.116511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.116516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.116569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:23.116624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:23.116676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:23.116726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:23.116775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:23.116781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:23.116836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106752732:6999], now have 1 active actors on pipe
2025-10-01T14:09:23.117052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255209106752732:6999]
2025-10-01T14:09:23.117084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:23.117128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:23.117138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:23.117166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 781 reason: error at write: Disconnected sessionId: src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0
2025-10-01T14:09:23.117260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:23.117353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 781 sessionId: src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0 is DEAD
2025-10-01T14:09:23.117488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:23.117498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0] Write session will restart in 0.008902s
2025-10-01T14:09:23.117521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0] Write session: Do CDS request
2025-10-01T14:09:23.117536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:23.126409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:23.127796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.127875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:23.127886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 782
2025-10-01T14:09:23.127980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.127980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:23.128002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:23.128009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:23.128012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:23.128170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:23.128179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:23.128186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:23.128231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:23.128265Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255206729887359:6610]
2025-10-01T14:09:23.128357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 782 sessionId:  describe result for acl check
2025-10-01T14:09:23.128403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:23.128409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:23.128411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:23.128415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255209106752823:7493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:23.128775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:23.128930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255209106752823:7493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:23.129053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:23.129095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:23.129377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:23.129430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.129437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.129438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.129440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.129441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.129442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.129443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.129444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.129445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.129446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.129447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.129448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.129449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.129450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.129455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.129464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.129468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.129472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.129475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.129479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.129483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.129487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.129491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.129495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.129499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.129503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.129507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.129511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.129517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.129524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.129530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.129535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.129539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.129545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.129549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.129555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.129559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.129564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.129569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.129574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.129578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.129590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.129594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.129603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.129608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.129632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.129643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.129653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.129659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.129664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.129672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.129677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.129682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.129691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.129696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.129705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.129743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:23.130859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255209106752823:7493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:23.133144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:23.133547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255209106752823:7493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:23.133559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255209106752823:7493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:23.133562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255209106752823:7493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:23.133569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:23.133696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:23.133709Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:23.133711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:23.133713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:23.133717Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 781 [2:7556255206729887359:6610]
2025-10-01T14:09:23.133728Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:23.133739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:23.133740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.133743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.133744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.133754Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:23.133757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:23.133761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:23.133799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.133806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.133808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.133811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:23.133814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:23.133872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:23.133879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.133889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.133898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.133916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:23.133937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106752862:7493], now have 1 active actors on pipe
2025-10-01T14:09:23.133944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106752753:2446], now have 1 active actors on pipe
2025-10-01T14:09:23.133950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255206729887354:6610]
2025-10-01T14:09:23.133956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255206729887354:6610]
2025-10-01T14:09:23.133958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255206729887354:6610]
2025-10-01T14:09:23.133972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:23.133955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 781
2025-10-01T14:09:23.133957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 781
2025-10-01T14:09:23.133985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:23.133989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:23.133994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:23.133995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:23.134003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:23.134005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:23.134040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.134047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.134056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255206729887354:6610]
2025-10-01T14:09:23.134066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:23.134086Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:23.134090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:23.134094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.134097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.134099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:23.134104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.134110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:23.134123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.134236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.134241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.134265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.134341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 782 partition: 0 MaxSeqNo: 45 sessionId: src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0
2025-10-01T14:09:23.134679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eada411a-3dc58454-d5ac7167-e5c6765d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:23.136934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0] Write session: try to update token
2025-10-01T14:09:23.136951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:23.149917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 782 sessionId: src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:23.152306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:23.154195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.154225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.154246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:23.154249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:23.154252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:23.154253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:23.154264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255206729887354:6610]
2025-10-01T14:09:23.154267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255206729887354:6610]
2025-10-01T14:09:23.154270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255206729887354:6610]
2025-10-01T14:09:23.154322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:23.154323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:23.154328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:23.154332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:23.154333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.154335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:23.154484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:23.217463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255209106752869:6999]
2025-10-01T14:09:23.217742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 781, pipe: [1:7556255209106752869:6999]
2025-10-01T14:09:23.256543Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 7 CurrentSessionLifetimeMs: 181274 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:09:23.297040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:23.297290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:23.297341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106752869:6999], now have 1 active actors on pipe
2025-10-01T14:09:23.297413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:23.297496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:23.297506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:23.297574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 782 reason: error at write: Disconnected sessionId: src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0
2025-10-01T14:09:23.297703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 782 sessionId: src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0 is DEAD
2025-10-01T14:09:23.297765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255209106752869:6999]
2025-10-01T14:09:23.297793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:23.297825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:23.297834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0] Write session will restart in 0.008338s
2025-10-01T14:09:23.297863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0] Write session: Do CDS request
2025-10-01T14:09:23.297869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:23.306902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.306960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:23.306972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 783
2025-10-01T14:09:23.307146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.307177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:23.307185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:23.307188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:23.307567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 783 sessionId:  describe result for acl check
2025-10-01T14:09:23.307599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:23.307601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:23.307602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:23.307607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255209106752949:7498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:23.308084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255209106752949:7498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:23.308183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:23.309705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255209106752949:7498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:23.309857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:23.310055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:23.310066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:23.310077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:23.310133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:23.310160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255206729887483:6618]
2025-10-01T14:09:23.310578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:23.310827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:23.310868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:23.311124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:23.311175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.311181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.311182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.311183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.311184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.311185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.311186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.311187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.311188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.311189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.311190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.311191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.311192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.311193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.311199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.311207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.311211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.311215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.311219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.311222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.311225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.311228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.311231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.311235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.311238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.311241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.311245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.311247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.311254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.311260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.311265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.311270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.311274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.311279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.311286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.311290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.311295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.311301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.311305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.311314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.311319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.311324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.311332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.311337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.311342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.311350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.311353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.311360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.311364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.311373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.311377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.311382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.311390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.311396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.311404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.311409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.311446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:23.313468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255209106752949:7498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:23.313481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255209106752949:7498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:23.313484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255209106752949:7498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:23.313524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:23.315190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:23.315784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:23.315799Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:23.315801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:23.315805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:23.315811Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 782 [2:7556255206729887483:6618]
2025-10-01T14:09:23.315826Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:23.315841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:23.315844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.315846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.315849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.315863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:23.315868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:23.315873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:23.315926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.315933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.315935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.315939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:23.315942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:23.316001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:23.316008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.316019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.316029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.316047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:23.316063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255206729887477:6618]
2025-10-01T14:09:23.316070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255206729887477:6618]
2025-10-01T14:09:23.316071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255206729887477:6618]
2025-10-01T14:09:23.316079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:23.316094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106752988:7498], now have 1 active actors on pipe
2025-10-01T14:09:23.316095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:23.316098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:23.316100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:23.316101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106752879:2446], now have 1 active actors on pipe
2025-10-01T14:09:23.316109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:23.316121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:23.316125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:23.316118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 782
2025-10-01T14:09:23.316140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 782
2025-10-01T14:09:23.316156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255206729887477:6618]
2025-10-01T14:09:23.316162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:23.316172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:23.316178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.316184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.316230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:23.316241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.316245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.316248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:23.316256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.316265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:23.316280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.316416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.316429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.316450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.316526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 783 partition: 0 MaxSeqNo: 45 sessionId: src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0
2025-10-01T14:09:23.316864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab5ad95-b2335f5e-9d8e5965-2906eb52_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:23.319213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0] Write session: try to update token
2025-10-01T14:09:23.319230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:23.332663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 783 sessionId: src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:23.335035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:23.336342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:23.336363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:23.336366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:23.336367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:23.336376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255206729887477:6618]
2025-10-01T14:09:23.336381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255206729887477:6618]
2025-10-01T14:09:23.336385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255206729887477:6618]
2025-10-01T14:09:23.336430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:23.336439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.336443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:23.336448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:23.336447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.336468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:23.336481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.336485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:23.336623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:23.397664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255209106752999:6999]
2025-10-01T14:09:23.397916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 782, pipe: [1:7556255209106752999:6999]
2025-10-01T14:09:23.477590Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:23.477805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106752999:6999], now have 1 active actors on pipe
2025-10-01T14:09:23.477968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:23.477970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255209106752999:6999]
2025-10-01T14:09:23.477979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:23.477997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:23.478032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:23.478044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 783 reason: error at write: Disconnected sessionId: src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0
2025-10-01T14:09:23.478204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 783 sessionId: src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0 is DEAD
2025-10-01T14:09:23.478334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:23.478342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0] Write session will restart in 0.009669s
2025-10-01T14:09:23.478387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0] Write session: Do CDS request
2025-10-01T14:09:23.478393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:23.487850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:23.488906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.488995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:23.489007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 784
2025-10-01T14:09:23.489130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.489160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:23.489165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:23.489169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:23.489559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 784 sessionId:  describe result for acl check
2025-10-01T14:09:23.489605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:23.489612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:23.489614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:23.489620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255209106753074:7502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:23.489929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:23.490121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255209106753074:7502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:23.490115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:23.490126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:23.490136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:23.490189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:23.490227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255206729887625:6626]
2025-10-01T14:09:23.490772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:23.491056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:23.491095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:23.491374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:23.491433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.491439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.491440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.491441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.491442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.491454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.491455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.491456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.491457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.491458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.491459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.491460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.491461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.491462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.491466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.491474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.491478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.491481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.491484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.491487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.491490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.491493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.491496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.491499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.491502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.491505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.491508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.491511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.491518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.491525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.491531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.491535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.491547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.491551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.491555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.491563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.491567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.491571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.491578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.491582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.491586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.491594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.491598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.491602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.491610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.491614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.491618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.491623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.491627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.491631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.491634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.491639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.491647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.491651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.491654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.491664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.491696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:23.492030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255209106753074:7502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:23.495065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255209106753074:7502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:23.495075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255209106753074:7502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:23.495078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255209106753074:7502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:23.495084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:23.495310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:23.496046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:23.496060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:23.496062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:23.496066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:23.496072Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 783 [2:7556255206729887625:6626]
2025-10-01T14:09:23.496085Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:23.496098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:23.496105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.496108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.496109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.496123Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:23.496133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:23.496138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:23.496190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.496195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.496197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.496200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:23.496202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:23.496269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:23.496276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.496286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.496302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.496316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:23.496332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106753002:2446], now have 1 active actors on pipe
2025-10-01T14:09:23.496339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106753113:7502], now have 1 active actors on pipe
2025-10-01T14:09:23.496346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255206729887619:6626]
2025-10-01T14:09:23.496351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255206729887619:6626]
2025-10-01T14:09:23.496353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255206729887619:6626]
2025-10-01T14:09:23.496368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:23.496354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 783
2025-10-01T14:09:23.496367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 783
2025-10-01T14:09:23.496383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:23.496387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:23.496390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:23.496394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:23.496401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:23.496403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:23.496437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255206729887619:6626]
2025-10-01T14:09:23.496446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:23.496460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.496467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:23.496467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.496503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:23.496512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.496519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.496522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:23.496529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.496540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:23.496569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.496707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.496713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.496727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.496796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 784 partition: 0 MaxSeqNo: 45 sessionId: src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0
2025-10-01T14:09:23.497164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91cd0c7-a217a55e-6fa90ef5-349fa26e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:23.499689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0] Write session: try to update token
2025-10-01T14:09:23.499711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:23.515433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 784 sessionId: src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:23.516724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:23.516746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:23.516749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:23.516764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:23.516772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255206729887619:6626]
2025-10-01T14:09:23.516777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255206729887619:6626]
2025-10-01T14:09:23.516781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255206729887619:6626]
2025-10-01T14:09:23.516826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:23.516835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:23.516838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.516840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:23.516842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:23.516845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:23.516968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:23.517958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:23.577908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255209106753132:6999]
2025-10-01T14:09:23.578133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 783, pipe: [1:7556255209106753132:6999]
2025-10-01T14:09:23.655137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:23.655357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.655368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.655405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106753132:6999], now have 1 active actors on pipe
2025-10-01T14:09:23.655631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:23.655616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:23.655638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255209106753132:6999]
2025-10-01T14:09:23.655661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:23.655664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:23.655718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 784 reason: error at write: Disconnected sessionId: src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0
2025-10-01T14:09:23.655898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 784 sessionId: src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0 is DEAD
2025-10-01T14:09:23.656008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:23.656017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0] Write session will restart in 0.006479s
2025-10-01T14:09:23.656039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0] Write session: Do CDS request
2025-10-01T14:09:23.656045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:23.663851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.663914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:23.663925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 785
2025-10-01T14:09:23.664041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.664063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:23.664070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:23.664072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:23.664410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 785 sessionId:  describe result for acl check
2025-10-01T14:09:23.664438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:23.664443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:23.664445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:23.664449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255209106753207:7507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:23.664479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:23.664852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255209106753207:7507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:23.666153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:23.666310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:23.666319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:23.666328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:23.666361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:23.666409Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255206729887736:6628]
2025-10-01T14:09:23.666540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255209106753207:7507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:23.666897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:23.667152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:23.667196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:23.667459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:23.667533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.667539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.667540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.667541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.667542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.667543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.667544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.667545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.667546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.667547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.667548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.667549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.667550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.667551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.667555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.667563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.667567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.667571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.667574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.667578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.667581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.667585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.667589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.667592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.667596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.667599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.667603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.667606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.667612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.667617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.667629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.667634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.667636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.667639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.667641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.667644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.667646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.667649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.667652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.667654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.667657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.667659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.667661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.667664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.667666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.667669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.667672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.667675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.667678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.667680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.667683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.667686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.667688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.667691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.667693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.667696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.667715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:23.671041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255209106753207:7507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:23.671053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255209106753207:7507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:23.671056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255209106753207:7507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:23.671064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:23.671169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:23.671709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:23.671721Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:23.671723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:23.671725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:23.671730Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 784 [2:7556255206729887736:6628]
2025-10-01T14:09:23.671739Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:23.671755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:23.671760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.671763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.671765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.671789Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:23.671795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:23.671798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:23.671832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.671836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.671837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.671839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:23.671841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:23.671886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:23.671891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.671898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.671903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.671912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:23.671927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106753247:7507], now have 1 active actors on pipe
2025-10-01T14:09:23.671934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106753134:2446], now have 1 active actors on pipe
2025-10-01T14:09:23.671941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255206729887731:6628]
2025-10-01T14:09:23.671943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255206729887731:6628]
2025-10-01T14:09:23.671945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255206729887731:6628]
2025-10-01T14:09:23.671956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:23.671970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:23.671972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:23.671972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:23.671975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:23.671980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:23.671982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:23.671998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255206729887731:6628]
2025-10-01T14:09:23.672007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:23.672012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:23.672013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 784
2025-10-01T14:09:23.672013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 784
2025-10-01T14:09:23.672074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.672082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.672104Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:23.672114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.672118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.672124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:23.672131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.672139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:23.672153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.672287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.672294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.672308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.672379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 785 partition: 0 MaxSeqNo: 45 sessionId: src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0
2025-10-01T14:09:23.672682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1d36a2f-4dffb8ee-5c2afca7-38d3eb5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:23.675084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0] Write session: try to update token
2025-10-01T14:09:23.675102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:23.688383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 785 sessionId: src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:23.690934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:23.691454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.691476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.691492Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:23.691495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:23.691496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:23.691498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:23.691504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255206729887731:6628]
2025-10-01T14:09:23.691507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255206729887731:6628]
2025-10-01T14:09:23.691510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255206729887731:6628]
2025-10-01T14:09:23.691545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:23.691555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:23.691560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:23.691561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.691562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:23.691563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:23.691684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:23.755572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255209106753256:6999]
2025-10-01T14:09:23.755846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 784, pipe: [1:7556255209106753256:6999]
2025-10-01T14:09:23.841560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:23.842146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:23.842202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106753256:6999], now have 1 active actors on pipe
2025-10-01T14:09:23.842301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:23.843000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:23.843087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255209106753256:6999]
2025-10-01T14:09:23.852562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:23.852577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:23.852599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 785 reason: error at write: Disconnected sessionId: src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0
2025-10-01T14:09:23.852751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 785 sessionId: src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0 is DEAD
2025-10-01T14:09:23.852956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:23.852967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0] Write session will restart in 0.008044s
2025-10-01T14:09:23.852994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0] Write session: Do CDS request
2025-10-01T14:09:23.853004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:23.858204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:23.860073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:23.860281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:23.860293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:23.860304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:23.860366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:23.860410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255206729887852:6631]
2025-10-01T14:09:23.861063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:23.861327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:23.861356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:23.861615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:23.861661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.861666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.861667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.861667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.861668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.861668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.861669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.861670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.861670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.861671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.861672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.861672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.861673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.861673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.861676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.861682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.861685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.861687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.861689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.861691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.861693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.861696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.861698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.861700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.861702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.861704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.861706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.861708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.861713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.861717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:23.861721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.861724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:23.861726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.861729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:23.861731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.861734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:23.861736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.861739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:23.861741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.861745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:23.861748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.861751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:23.861753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.861758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:23.861762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.861766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:23.861770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.861774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.861778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.861782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.861785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.861789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.861793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.861797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:23.861800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.861804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:23.861836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:23.861943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.862020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:23.862032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 786
2025-10-01T14:09:23.862155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:23.862190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:23.862196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:23.862204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:23.862677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 786 sessionId:  describe result for acl check
2025-10-01T14:09:23.862709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:23.862711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:23.862713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:23.862717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255209106753338:7512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:23.863241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255209106753338:7512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:23.866079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255209106753338:7512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:23.866147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:23.866935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:23.866949Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:23.866952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:23.866955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:23.866978Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 785 [2:7556255206729887852:6631]
2025-10-01T14:09:23.866992Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:23.867008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:23.867011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.867014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.867016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.867032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:23.867043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:23.867048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:23.867108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.867115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.867117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.867120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:23.867122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:23.867183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:23.867190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.867200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:23.867214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:23.867227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:23.867249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106753259:2446], now have 1 active actors on pipe
2025-10-01T14:09:23.867260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255206729887847:6631]
2025-10-01T14:09:23.867261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255206729887847:6631]
2025-10-01T14:09:23.867264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255206729887847:6631]
2025-10-01T14:09:23.867257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 785
2025-10-01T14:09:23.867280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:23.867290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:23.867296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:23.867299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:23.867301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:23.867308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:23.867310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:23.867342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255206729887847:6631]
2025-10-01T14:09:23.867355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:23.867371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:23.870610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255209106753338:7512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:23.870623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255209106753338:7512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:23.870626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255209106753338:7512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:23.870634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:23.870931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 785
2025-10-01T14:09:23.870879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106753376:7512], now have 1 active actors on pipe
2025-10-01T14:09:23.870978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.870985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.871024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:23.871036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:23.871048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:23.871050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:23.871064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:23.871079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:23.871110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.871288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.871305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.871326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:23.871404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 786 partition: 0 MaxSeqNo: 45 sessionId: src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0
2025-10-01T14:09:23.871775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d38a6722-fbaa7d39-9eb7adfa-c540e03d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:23.874831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0] Write session: try to update token
2025-10-01T14:09:23.874846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:23.889323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 786 sessionId: src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:23.889832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:23.889854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:23.889863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255206729887847:6631]
2025-10-01T14:09:23.889905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:23.889912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:23.890102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:23.890261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:23.890431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:23.890591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:23.890796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:23.890839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:23.891747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:23.891924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:23.891941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:23.891973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:23.892030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:23.905154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:23.905172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:23.905174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:23.905175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:23.905183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255206729887847:6631]
2025-10-01T14:09:23.905186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255206729887847:6631]
2025-10-01T14:09:23.905188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255206729887847:6631]
2025-10-01T14:09:23.905225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:23.905236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:23.905239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:23.905243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:23.905249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:23.905254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:23.905367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:23.943480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255209106753379:6999]
2025-10-01T14:09:23.943692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 785, pipe: [1:7556255209106753379:6999]
2025-10-01T14:09:24.053528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:24.061519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.061548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.061712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.061765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.061816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.061872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.061912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.061919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.061979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.062030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.062082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.062135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.062178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.062183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.062235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.062282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.062333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.062403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.062450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.062457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.062525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.062594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.062656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.062718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.062765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.062772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.062836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.062897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.062966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.063030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.063068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.063073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.063125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.063174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.063230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.063279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.063315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.063320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.063372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.063422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.063474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.063526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.063559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.063564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.063620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.063674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.063728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.063782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.063821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.063826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.063881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.063932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.063981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.064034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.064079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.064084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.064136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.064185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.064232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.064284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.064322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.064326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.064381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255209106753379:6999], now have 1 active actors on pipe
2025-10-01T14:09:24.064657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255209106753379:6999]
2025-10-01T14:09:24.064697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:24.064700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:24.064727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 786 reason: error at write: Disconnected sessionId: src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0
2025-10-01T14:09:24.064980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 786 sessionId: src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0 is DEAD
2025-10-01T14:09:24.065066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:24.065074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0] Write session will restart in 0.009867s
2025-10-01T14:09:24.065092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0] Write session: Do CDS request
2025-10-01T14:09:24.065097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:24.065251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:24.065326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:24.075581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:24.075911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.075975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:24.075992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 787
2025-10-01T14:09:24.076171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.076205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:24.076215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:24.076218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:24.076610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 787 sessionId:  describe result for acl check
2025-10-01T14:09:24.076643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:24.076651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:24.076654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:24.076659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255213401720766:7522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:24.077203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255213401720766:7522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:24.077444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:24.077588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:24.077596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:24.077603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:24.077635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:24.077668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255211024855262:6633]
2025-10-01T14:09:24.078054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:24.078250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:24.078277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:24.078516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:24.078556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.078561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.078561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.078562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.078563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.078563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.078564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.078565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.078565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.078566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.078566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.078567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.078567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.078568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.078572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.078577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.078580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.078582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.078584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.078586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.078588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.078591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.078593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.078595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.078597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.078599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.078601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.078603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.078607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.078612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.078617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.078620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.078622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.078625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.078628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.078631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.078633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.078636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.078639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.078641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.078644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.078647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.078649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.078652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.078654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.078657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.078660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.078663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.078665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.078668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.078670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.078673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.078677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.078680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.078682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.078685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.078705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:24.078746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255213401720766:7522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:24.082881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255213401720766:7522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:24.082896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255213401720766:7522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:24.082899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255213401720766:7522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:24.082907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:24.083044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:24.083605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:24.083618Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:24.083621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:24.083624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:24.083631Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 786 [2:7556255211024855262:6633]
2025-10-01T14:09:24.083646Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:24.083663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:24.083670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.083674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.083676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.083690Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:24.083698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:24.083703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:24.083755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.083761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.083763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.083766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:24.083768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:24.083919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:24.083928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.083939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.083921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 786
2025-10-01T14:09:24.083938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 786
2025-10-01T14:09:24.083951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.083971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:24.083993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401720812:7522], now have 1 active actors on pipe
2025-10-01T14:09:24.084000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401720691:2446], now have 1 active actors on pipe
2025-10-01T14:09:24.084016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.084024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.084040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255211024855256:6633]
2025-10-01T14:09:24.084046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255211024855256:6633]
2025-10-01T14:09:24.084048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255211024855256:6633]
2025-10-01T14:09:24.084060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:24.084068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:24.084070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:24.084071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:24.084076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:24.084089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:24.084095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:24.084110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:24.084121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.084125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.084128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:24.084137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.084149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:24.084183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255211024855256:6633]
2025-10-01T14:09:24.084193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:24.084201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:24.084204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.084341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.084354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.084373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.084459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 787 partition: 0 MaxSeqNo: 45 sessionId: src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0
2025-10-01T14:09:24.084785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e06bf1f3-14b13120-54402bb9-9ddb2623_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:24.087091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0] Write session: try to update token
2025-10-01T14:09:24.087106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:24.100914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 787 sessionId: src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:24.103005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:24.103025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:24.103035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255211024855256:6633]
2025-10-01T14:09:24.103082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:24.103085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:24.103126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:24.103244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:24.103387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:24.103528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:24.103661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:24.103984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:24.104032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.104043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.104062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:24.104095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:24.104157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:24.121239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:24.121258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:24.121260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:24.121261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:24.121271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255211024855256:6633]
2025-10-01T14:09:24.121274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255211024855256:6633]
2025-10-01T14:09:24.121276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255211024855256:6633]
2025-10-01T14:09:24.121311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:24.121322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:24.121325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:24.126836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.126857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.126989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.127048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.127108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.127166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.127204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.127211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.127265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.127316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.127381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.127435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.127474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.127479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.127539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.127596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.127651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.127729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.127773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.127777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.127855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.127936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.127991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.128050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.128096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.128102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.128160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.128212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.128263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.128314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.128355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.128360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.128414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.128476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.128534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.128595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.128649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.128654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.128718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.128784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.128842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.128895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.128932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.128937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.128993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.129047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.129116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.129179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.129218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.129223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.129279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.129328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.129383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.129439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.129478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.129482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.129539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.129594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.129656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.129710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.129746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.129751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.129798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:24.129808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.129810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:24.129937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:24.164627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255213401720822:6999]
2025-10-01T14:09:24.164897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 786, pipe: [1:7556255213401720822:6999]
2025-10-01T14:09:24.272225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:24.273184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401720822:6999], now have 1 active actors on pipe
2025-10-01T14:09:24.273356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:24.273403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255213401720822:6999]
2025-10-01T14:09:24.273414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:24.273418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:24.273432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:24.273445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 787 reason: error at write: Disconnected sessionId: src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0
2025-10-01T14:09:24.273619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 787 sessionId: src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0 is DEAD
2025-10-01T14:09:24.273812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:24.273822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0] Write session will restart in 0.006239s
2025-10-01T14:09:24.273847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0] Write session: Do CDS request
2025-10-01T14:09:24.273853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:24.280899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.280983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:24.280993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 788
2025-10-01T14:09:24.281105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.281128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:24.281136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:24.281140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:24.281462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 788 sessionId:  describe result for acl check
2025-10-01T14:09:24.281486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:24.281488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:24.281489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:24.281492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255213401720905:7528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:24.281879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255213401720905:7528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:24.282494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:24.284265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255213401720905:7528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:24.284557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:24.284807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:24.284816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:24.284827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:24.284883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:24.284922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255211024855384:6637]
2025-10-01T14:09:24.285493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:24.285696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:24.285733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:24.286020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:24.286066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.286071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.286072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.286073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.286075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.286075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.286077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.286078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.286079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.286080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.286082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.286083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.286084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.286085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.286089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.286099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.286103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.286107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.286111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.286114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.286118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.286121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.286125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.286129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.286132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.286135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.286139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.286142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.286147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.286154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.286160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.286165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.286170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.286175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.286179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.286183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.286188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.286192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.286196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.286201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.286205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.286210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.286219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.286224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.286233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.286237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.286241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.286246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.286250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.286255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.286264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.286269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.286276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.286281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.286288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.286293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.286333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:24.287137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255213401720905:7528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:24.287148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255213401720905:7528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:24.287151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255213401720905:7528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:24.287157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:24.290250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:24.290959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:24.290976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:24.290978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:24.290982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:24.290988Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 787 [2:7556255211024855384:6637]
2025-10-01T14:09:24.291000Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:24.291014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:24.291024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.291027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.291029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.291042Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:24.291048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:24.291054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:24.291108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.291114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.291116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.291120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:24.291122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:24.291180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:24.291187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.291196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.291211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.291231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:24.291253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401720947:7528], now have 1 active actors on pipe
2025-10-01T14:09:24.291257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401720831:2446], now have 1 active actors on pipe
2025-10-01T14:09:24.291263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255211024855379:6637]
2025-10-01T14:09:24.291265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255211024855379:6637]
2025-10-01T14:09:24.291267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255211024855379:6637]
2025-10-01T14:09:24.291280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:24.291288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 787
2025-10-01T14:09:24.291297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:24.291308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:24.291311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:24.291313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:24.291315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:24.291323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 787
2025-10-01T14:09:24.291318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:24.291343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255211024855379:6637]
2025-10-01T14:09:24.291353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:24.291361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:24.291367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.291371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.291406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bc60989-be0f0111-b566df21-37d9a54b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:24.291416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.291420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.291426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:24.291434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.291446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:24.291465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.291575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.291581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.291594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.291673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 788 partition: 0 MaxSeqNo: 45 sessionId: src_id|6bc60989-be0f0111-b566df21-37d9a54b_0
2025-10-01T14:09:24.291983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b1793c4-7a14f737-6cd4e397-75d4bf4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6bc60989-be0f0111-b566df21-37d9a54b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:24.294256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc60989-be0f0111-b566df21-37d9a54b_0] Write session: try to update token
2025-10-01T14:09:24.294269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc60989-be0f0111-b566df21-37d9a54b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:24.308394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 788 sessionId: src_id|6bc60989-be0f0111-b566df21-37d9a54b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:24.310656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:24.310842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.310861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.310904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:24.310973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:24.316501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:24.316521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:24.316523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:24.316525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:24.316533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255211024855379:6637]
2025-10-01T14:09:24.316537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255211024855379:6637]
2025-10-01T14:09:24.316541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255211024855379:6637]
2025-10-01T14:09:24.316577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:24.316584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:24.316588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:24.316591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:24.316591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.316593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:24.316721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:24.373802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255213401720957:6999]
2025-10-01T14:09:24.374051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 787, pipe: [1:7556255213401720957:6999]
2025-10-01T14:09:24.458058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:24.465734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.465765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.465937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.466007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.466073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.466142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.466191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.466203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.466273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.466335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.466417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.466484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.466528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.466536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.466599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.466658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.466716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.466775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.466820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.466828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.466885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.466949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.467007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.467066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.467109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.467117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.467170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.467218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.467276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.467336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.467379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.467386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.467446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.467503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.467568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.467635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.467686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.467693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.467753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.467813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.467877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.467942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.467986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.467992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.468056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.468117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.468180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.468248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.468291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.468297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.468365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.468427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.468494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.468563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.468609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.468617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.468685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:24.468780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:24.468840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:24.468905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:24.468956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:24.468963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:24.469026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401720957:6999], now have 1 active actors on pipe
2025-10-01T14:09:24.469247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:24.469288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255213401720957:6999]
2025-10-01T14:09:24.469297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:24.469299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:24.469323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 788 reason: error at write: Disconnected sessionId: src_id|6bc60989-be0f0111-b566df21-37d9a54b_0
2025-10-01T14:09:24.469541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 788 sessionId: src_id|6bc60989-be0f0111-b566df21-37d9a54b_0 is DEAD
2025-10-01T14:09:24.469681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc60989-be0f0111-b566df21-37d9a54b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:24.469692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc60989-be0f0111-b566df21-37d9a54b_0] Write session will restart in 0.008384s
2025-10-01T14:09:24.469716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc60989-be0f0111-b566df21-37d9a54b_0] Write session: Do CDS request
2025-10-01T14:09:24.469721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc60989-be0f0111-b566df21-37d9a54b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:24.470598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:24.478899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc60989-be0f0111-b566df21-37d9a54b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.479364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:24.479382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 789
2025-10-01T14:09:24.479588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.479640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:24.479652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:24.479656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:24.480038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:24.480142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 789 sessionId:  describe result for acl check
2025-10-01T14:09:24.480193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:24.480199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:24.480202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:24.480208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255213401721036:7532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:24.481143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255213401721036:7532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:24.482223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:24.482424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:24.482432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:24.482441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:24.482480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:24.482509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255211024855545:6651]
2025-10-01T14:09:24.482906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:24.483174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:24.483215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:24.483335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255213401721036:7532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:24.483423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:24.483468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.483473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.483473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.483474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.483475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.483475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.483476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.483477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.483478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.483479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.483479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.483480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.483481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.483481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.483484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.483490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.483492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.483494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.483496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.483499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.483501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.483503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.483505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.483508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.483510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.483512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.483514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.483516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.483520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.483525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.483529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.483532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.483534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.483537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.483540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.483543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.483545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.483548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.483550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.483553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.483555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.483558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.483560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.483563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.483566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.483569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.483571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.483573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.483580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.483582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.483584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.483587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.483589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.483592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.483594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.483597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.483616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:24.487488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255213401721036:7532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:24.487509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255213401721036:7532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:24.487512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255213401721036:7532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:24.487520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:24.487646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:24.488299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:24.488317Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:24.488320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:24.488323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:24.488330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 788 [2:7556255211024855545:6651]
2025-10-01T14:09:24.488345Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:24.488365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:24.488372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.488376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.488378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.488395Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:24.488404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:24.488410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:24.488466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.488473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.488474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.488478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:24.488480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:24.488551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:24.488558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.488567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.488580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.488598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:24.488618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401721076:7532], now have 1 active actors on pipe
2025-10-01T14:09:24.488625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401720960:2446], now have 1 active actors on pipe
2025-10-01T14:09:24.488632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255211024855539:6651]
2025-10-01T14:09:24.488638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255211024855539:6651]
2025-10-01T14:09:24.488640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255211024855539:6651]
2025-10-01T14:09:24.488655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:24.488668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:24.488675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:24.488678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:24.488680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:24.488686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:24.488689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:24.488718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255211024855539:6651]
2025-10-01T14:09:24.488726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:24.488727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:24.488740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.488749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.488808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:24.488819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.488823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.488825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:24.488832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.488841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:24.488862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.489003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.489013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.489027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.489443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc60989-be0f0111-b566df21-37d9a54b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:24.488640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 788
2025-10-01T14:09:24.488645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 788
2025-10-01T14:09:24.489100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 789 partition: 0 MaxSeqNo: 45 sessionId: src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0
2025-10-01T14:09:24.491867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0] Write session: try to update token
2025-10-01T14:09:24.491884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:24.509965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 789 sessionId: src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:24.511356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:24.511375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:24.511378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:24.511381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:24.511391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255211024855539:6651]
2025-10-01T14:09:24.511399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255211024855539:6651]
2025-10-01T14:09:24.511402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255211024855539:6651]
2025-10-01T14:09:24.511458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:24.511469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.511472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:24.511605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:24.512507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:24.512639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:24.512653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:24.512657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:24.569607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255213401721095:6999]
2025-10-01T14:09:24.569864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 788, pipe: [1:7556255213401721095:6999]
2025-10-01T14:09:24.657727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:24.658123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.658140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.658184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401721095:6999], now have 1 active actors on pipe
2025-10-01T14:09:24.658409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:24.658391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:24.658367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:24.658397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:24.658447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255213401721095:6999]
2025-10-01T14:09:24.658449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 789 reason: error at write: Disconnected sessionId: src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0
2025-10-01T14:09:24.658670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 789 sessionId: src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0 is DEAD
2025-10-01T14:09:24.658823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:24.658833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0] Write session will restart in 0.008418s
2025-10-01T14:09:24.658860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0] Write session: Do CDS request
2025-10-01T14:09:24.658866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:24.668000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:24.668971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.669167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:24.669177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 790
2025-10-01T14:09:24.669317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.669348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:24.669355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:24.669358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:24.669568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:24.669731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 790 sessionId:  describe result for acl check
2025-10-01T14:09:24.669765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:24.669766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:24.669772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:24.669774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:24.669775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:24.669779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255213401721176:7537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:24.669786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:24.669830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:24.669865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255211024855661:6653]
2025-10-01T14:09:24.670217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255213401721176:7537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:24.670417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:24.670676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:24.670712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:24.670958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:24.671006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.671011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.671012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.671013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.671014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.671015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.671016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.671017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.671018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.671019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.671020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.671021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.671022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.671023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.671027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.671035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.671038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.671042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.671045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.671049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.671053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.671056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.671059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.671063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.671066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.671069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.671072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.671076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.671081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.671088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.671093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.671097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.671102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.671107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.671110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.671114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.671118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.671122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.671126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.671135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.671140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.671147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.671151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.671156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.671160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.671168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.671171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.671176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.671179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.671183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.671186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.671190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.671194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.671198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.671202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.671206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.671238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:24.672111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255213401721176:7537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:24.674567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255213401721176:7537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:24.674578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255213401721176:7537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:24.674580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255213401721176:7537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:24.674586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:24.674801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:24.675396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:24.675411Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:24.675414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:24.675417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:24.675422Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 789 [2:7556255211024855661:6653]
2025-10-01T14:09:24.675433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:24.675449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:24.675451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.675455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.675457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.675473Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:24.675485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:24.675490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:24.675537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.675542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.675543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.675545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:24.675547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:24.675592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:24.675597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.675604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.675610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.675618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:24.675634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401721215:7537], now have 1 active actors on pipe
2025-10-01T14:09:24.675638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401721098:2446], now have 1 active actors on pipe
2025-10-01T14:09:24.675643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255211024855656:6653]
2025-10-01T14:09:24.675644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255211024855656:6653]
2025-10-01T14:09:24.675646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255211024855656:6653]
2025-10-01T14:09:24.675656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:24.675666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:24.675674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:24.675676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:24.675679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:24.675697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 789
2025-10-01T14:09:24.675682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:24.675702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 789
2025-10-01T14:09:24.675684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:24.675696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255211024855656:6653]
2025-10-01T14:09:24.675703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:24.675709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:24.675729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.675733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.675762Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39a13a22-e3e760dc-5920e6b3-98847843_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:24.675769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.675778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.675781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:24.675788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.675799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:24.675813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.675935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.675948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.675970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.676046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 790 partition: 0 MaxSeqNo: 45 sessionId: src_id|39a13a22-e3e760dc-5920e6b3-98847843_0
2025-10-01T14:09:24.676381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a842153-dcebcb0f-a5f74839-1c2332ef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|39a13a22-e3e760dc-5920e6b3-98847843_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:24.678718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39a13a22-e3e760dc-5920e6b3-98847843_0] Write session: try to update token
2025-10-01T14:09:24.678734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39a13a22-e3e760dc-5920e6b3-98847843_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:24.695742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 790 sessionId: src_id|39a13a22-e3e760dc-5920e6b3-98847843_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:24.696682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:24.696702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:24.696704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:24.696705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:24.696712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255211024855656:6653]
2025-10-01T14:09:24.696715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255211024855656:6653]
2025-10-01T14:09:24.696718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255211024855656:6653]
2025-10-01T14:09:24.696772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:24.696771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:24.696779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.696782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:24.696786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:24.696790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:24.696903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:24.698050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:24.758551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255213401721224:6999]
2025-10-01T14:09:24.758802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 789, pipe: [1:7556255213401721224:6999]
2025-10-01T14:09:24.836406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:24.836789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.836802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.836838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401721224:6999], now have 1 active actors on pipe
2025-10-01T14:09:24.837027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:24.837097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255213401721224:6999]
2025-10-01T14:09:24.837104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:24.837108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:24.837125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:24.837208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 790 reason: error at write: Disconnected sessionId: src_id|39a13a22-e3e760dc-5920e6b3-98847843_0
2025-10-01T14:09:24.837411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 790 sessionId: src_id|39a13a22-e3e760dc-5920e6b3-98847843_0 is DEAD
2025-10-01T14:09:24.837613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a13a22-e3e760dc-5920e6b3-98847843_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:24.837627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a13a22-e3e760dc-5920e6b3-98847843_0] Write session will restart in 0.006789s
2025-10-01T14:09:24.837657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a13a22-e3e760dc-5920e6b3-98847843_0] Write session: Do CDS request
2025-10-01T14:09:24.837664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a13a22-e3e760dc-5920e6b3-98847843_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:24.845917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39a13a22-e3e760dc-5920e6b3-98847843_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.846312Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:24.846330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 791
2025-10-01T14:09:24.846453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:24.846483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:24.846522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:24.846532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:24.846537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:24.847025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 791 sessionId:  describe result for acl check
2025-10-01T14:09:24.847066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:24.847068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:24.847070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:24.847077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255213401721306:7542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:24.847529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255213401721306:7542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:24.848101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:24.848295Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:24.848305Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:24.848316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:24.848366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:24.848405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255211024855781:6656]
2025-10-01T14:09:24.848965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:24.849210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:24.849254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:24.849542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:24.849612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.849618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.849619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.849620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.849621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.849623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.849615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255213401721306:7542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:24.849624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.849625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.849626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.849627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.849629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.849630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.849631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.849632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.849637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.849646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.849650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.849653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.849656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.849660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.849663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.849667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.849670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.849674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.849677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.849680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.849683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.849687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.849694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.849702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:24.849708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.849713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:24.849717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.849721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:24.849726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.849731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:24.849735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.849740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:24.849749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.849755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:24.849764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.849773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:24.849777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.849780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:24.849785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.849793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:24.849801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.849810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.849819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.849828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.849835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.849844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.849852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.849861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:24.849865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.849869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:24.849911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:24.853178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255213401721306:7542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:24.853195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255213401721306:7542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:24.853199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255213401721306:7542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:24.853208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:24.853375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:24.854001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:24.854015Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:24.854017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:24.854021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:24.854027Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 790 [2:7556255211024855781:6656]
2025-10-01T14:09:24.854041Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:24.854059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:24.854067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.854070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.854072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.854087Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:24.854092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:24.854098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:24.854147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.854154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.854156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.854159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:24.854161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:24.854229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:24.854236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.854247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:24.854262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:24.854281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:24.854303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401721345:7542], now have 1 active actors on pipe
2025-10-01T14:09:24.854307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401721226:2446], now have 1 active actors on pipe
2025-10-01T14:09:24.854314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255211024855776:6656]
2025-10-01T14:09:24.854321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255211024855776:6656]
2025-10-01T14:09:24.854323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255211024855776:6656]
2025-10-01T14:09:24.854335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:24.854351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:24.854353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:24.854357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:24.854359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:24.854367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:24.854390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:24.854416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255211024855776:6656]
2025-10-01T14:09:24.854424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:24.854408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 790
2025-10-01T14:09:24.854442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:24.854414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 790
2025-10-01T14:09:24.854683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.854694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.854726Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:24.854736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:24.854740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:24.854742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:24.854751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:24.854759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:24.854774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.854964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:24.854972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:24.854985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:24.855075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 791 partition: 0 MaxSeqNo: 45 sessionId: src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0
2025-10-01T14:09:24.855443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a13a22-e3e760dc-5920e6b3-98847843_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:24.858258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0] Write session: try to update token
2025-10-01T14:09:24.858275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:24.874553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:24.874575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:24.874578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:24.874580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:24.874590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255211024855776:6656]
2025-10-01T14:09:24.874595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255211024855776:6656]
2025-10-01T14:09:24.874598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255211024855776:6656]
2025-10-01T14:09:24.874639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:24.874647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:24.874652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:24.874655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:24.874656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:24.874657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:24.874797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:24.875809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 791 sessionId: src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:24.878323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:24.937268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255213401721352:6999]
2025-10-01T14:09:24.937486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 790, pipe: [1:7556255213401721352:6999]
2025-10-01T14:09:25.013028Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:25.013363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.013381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.013424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255213401721352:6999], now have 1 active actors on pipe
2025-10-01T14:09:25.013659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255213401721352:6999]
2025-10-01T14:09:25.013694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:25.013828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:25.013594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:25.014021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 791 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0
2025-10-01T14:09:25.014182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 791 sessionId: src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0 is DEAD
2025-10-01T14:09:25.014361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:25.014384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0] Write session will restart in 0.005072s
2025-10-01T14:09:25.014408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0] Write session: Do CDS request
2025-10-01T14:09:25.014415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:25.020988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.021080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:25.021104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 792
2025-10-01T14:09:25.021321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.021357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:25.021367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:25.021371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:25.021766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 792 sessionId:  describe result for acl check
2025-10-01T14:09:25.021797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:25.021803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:25.021805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:25.021810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255217696688684:7546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:25.022335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255217696688684:7546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:25.024065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:25.024505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255217696688684:7546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:25.025916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:25.026096Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:25.026106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:25.026117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:25.026164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:25.026202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255215319823197:6658]
2025-10-01T14:09:25.026761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:25.026887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255217696688684:7546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:25.026899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255217696688684:7546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:25.026902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255217696688684:7546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:25.026909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:25.027043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:25.027089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:25.027390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:25.027454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.027459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.027460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.027461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.027462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.027463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.027464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.027465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.027466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.027467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.027468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.027469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.027470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.027471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.027476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.027485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.027489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.027493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.027496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.027500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.027503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.027507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.027511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.027515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.027518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.027522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.027525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.027529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.027535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.027542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.027548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.027553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.027557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.027562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.027571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.027577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.027581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.027586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.027590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.027599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.027604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.027613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.027619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.027648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.027656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.027661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.027665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.027670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.027675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.027679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.027683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.027688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.027692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.027700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.027705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.027709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.027750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:25.031464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:25.032053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:25.032071Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:25.032073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:25.032077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:25.032083Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 791 [2:7556255215319823197:6658]
2025-10-01T14:09:25.032100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:25.032133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:25.032144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.032147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.032149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.032164Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:25.032170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:25.032176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:25.032229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.032236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.032239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.032242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:25.032245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:25.032304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:25.032313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.032325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.032337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.032354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:25.032376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696688768:7546], now have 1 active actors on pipe
2025-10-01T14:09:25.032384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696688650:2446], now have 1 active actors on pipe
2025-10-01T14:09:25.032391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255215319823191:6658]
2025-10-01T14:09:25.032393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255215319823191:6658]
2025-10-01T14:09:25.032396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255215319823191:6658]
2025-10-01T14:09:25.032408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:25.032416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:25.032418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:25.032419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:25.032425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:25.032438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:25.032446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:25.032437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 791
2025-10-01T14:09:25.032477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255215319823191:6658]
2025-10-01T14:09:25.032485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:25.032491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:25.032490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 791
2025-10-01T14:09:25.032501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.032510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.032557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:25.032569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.032573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.032579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:25.032587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.032599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:25.032620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.033456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.033471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.033494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.033573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 792 partition: 0 MaxSeqNo: 45 sessionId: src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0
2025-10-01T14:09:25.034486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c81949-782add1-dd6165a0-5a6fb07a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:25.037285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0] Write session: try to update token
2025-10-01T14:09:25.037306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:25.052844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:25.052868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:25.052870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:25.052872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:25.052883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255215319823191:6658]
2025-10-01T14:09:25.052892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255215319823191:6658]
2025-10-01T14:09:25.052896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255215319823191:6658]
2025-10-01T14:09:25.052945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:25.052956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.052957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:25.052959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:25.052963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:25.052968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:25.053085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:25.058004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 792 sessionId: src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:25.060981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:25.113877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255217696688793:6999]
2025-10-01T14:09:25.114162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 791, pipe: [1:7556255217696688793:6999]
2025-10-01T14:09:25.209659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:25.209973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.209992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.210036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696688793:6999], now have 1 active actors on pipe
2025-10-01T14:09:25.210339Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:25.210406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255217696688793:6999]
2025-10-01T14:09:25.210411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:25.210415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:25.210455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:25.210497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 792 reason: error at write: Disconnected sessionId: src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0
2025-10-01T14:09:25.210760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 792 sessionId: src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0 is DEAD
2025-10-01T14:09:25.210924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:25.210936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0] Write session will restart in 0.006348s
2025-10-01T14:09:25.210968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0] Write session: Do CDS request
2025-10-01T14:09:25.210975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:25.218844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.218933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:25.218950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 793
2025-10-01T14:09:25.219520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.219565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:25.219576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:25.219585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:25.220142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 793 sessionId:  describe result for acl check
2025-10-01T14:09:25.220174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:25.220182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:25.220184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:25.220190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255217696688841:7557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:25.220748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255217696688841:7557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:25.223194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255217696688841:7557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:25.223414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:25.225657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:25.225869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:25.225878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:25.225889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:25.225942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:25.225994Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255215319823325:6662]
2025-10-01T14:09:25.226223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255217696688841:7557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:25.226236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255217696688841:7557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:25.226240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255217696688841:7557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:25.226248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:25.226529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:25.226807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:25.226855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:25.227155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:25.227209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.227214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.227216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.227217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.227218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.227220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.227221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.227223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.227224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.227226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.227227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.227229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.227230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.227232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.227237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.227248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.227252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.227257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.227260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.227265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.227269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.227273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.227277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.227281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.227285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.227289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.227293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.227297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.227304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.227312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.227323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.227333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.227339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.227348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.227353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.227362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.227366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.227375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.227380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.227387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.227396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.227401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.227405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.227411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.227420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.227426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.227436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.227441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.227450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.227456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.227460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.227465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.227470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.227474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.227479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.227483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.227524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:25.231621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:25.232302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:25.232315Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:25.232317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:25.232320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:25.232327Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 792 [2:7556255215319823325:6662]
2025-10-01T14:09:25.232492Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:25.232515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:25.232521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.232525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.232526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.232540Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:25.232547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:25.232551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:25.232601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.232608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.232610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.232614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:25.232616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:25.232680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:25.232686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.232693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.232699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.232708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:25.232720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255215319823320:6662]
2025-10-01T14:09:25.232722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255215319823320:6662]
2025-10-01T14:09:25.232725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255215319823320:6662]
2025-10-01T14:09:25.232731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:25.232744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:25.232745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:25.232750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:25.232761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:25.232774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:25.232777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:25.232788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696688807:2446], now have 1 active actors on pipe
2025-10-01T14:09:25.232792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696688923:7557], now have 1 active actors on pipe
2025-10-01T14:09:25.232826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255215319823320:6662]
2025-10-01T14:09:25.232838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:25.232846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:25.232847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 792
2025-10-01T14:09:25.232894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 792
2025-10-01T14:09:25.232960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.232970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.232992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|882e2343-f635c9b6-83523dd0-772e18f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:25.233004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.233010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.233012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:25.233021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.233035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:25.233048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.233341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.233350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.233364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.233443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 793 partition: 0 MaxSeqNo: 45 sessionId: src_id|882e2343-f635c9b6-83523dd0-772e18f9_0
2025-10-01T14:09:25.233800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2aeb6-c35193f8-a71829d4-2db61124_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|882e2343-f635c9b6-83523dd0-772e18f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:25.236806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|882e2343-f635c9b6-83523dd0-772e18f9_0] Write session: try to update token
2025-10-01T14:09:25.236825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|882e2343-f635c9b6-83523dd0-772e18f9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:25.250520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:25.250543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:25.250555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255215319823320:6662]
2025-10-01T14:09:25.250604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:25.250605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:25.250793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:25.250947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:25.251091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:25.251245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:25.251453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:25.251493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:25.252055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 793 sessionId: src_id|882e2343-f635c9b6-83523dd0-772e18f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:25.254336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:25.254578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.254598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.254632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:25.254712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:25.264620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:25.264643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:25.264646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:25.264648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:25.264658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255215319823320:6662]
2025-10-01T14:09:25.264664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255215319823320:6662]
2025-10-01T14:09:25.264668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255215319823320:6662]
2025-10-01T14:09:25.264721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:25.264727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:25.264733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.264735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:25.264736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:25.264740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:25.264921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:25.310517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255217696688940:6999]
2025-10-01T14:09:25.310815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 792, pipe: [1:7556255217696688940:6999]
2025-10-01T14:09:25.409389Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:25.419974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.420005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.420209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.420282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.420352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.420414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.420477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.420481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.420553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.420621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.420688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.420766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.420825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.420829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.420920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.420988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.421059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.421132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.421188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.421194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.421280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.421347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.421418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.421488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.421538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.421541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.421619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.421686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.421754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.421830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.421884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.421888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.421970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.422034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.422105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.422178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.422232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.422238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.422330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.422616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.422702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.422782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.423589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.423603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.423687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.423763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.423845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.423920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.423977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.423984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.424063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.424137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.424216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.424297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.424358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.424364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.424446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:25.424519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:25.424595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:25.424676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:25.424735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:25.424742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:25.424830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696688940:6999], now have 1 active actors on pipe
2025-10-01T14:09:25.425151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:25.425161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255217696688940:6999]
2025-10-01T14:09:25.425195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:25.425198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:25.425225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 793 reason: error at write: Disconnected sessionId: src_id|882e2343-f635c9b6-83523dd0-772e18f9_0
2025-10-01T14:09:25.425379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 793 sessionId: src_id|882e2343-f635c9b6-83523dd0-772e18f9_0 is DEAD
2025-10-01T14:09:25.425544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882e2343-f635c9b6-83523dd0-772e18f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:25.425566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882e2343-f635c9b6-83523dd0-772e18f9_0] Write session will restart in 0.007215s
2025-10-01T14:09:25.425546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:25.425592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882e2343-f635c9b6-83523dd0-772e18f9_0] Write session: Do CDS request
2025-10-01T14:09:25.425598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882e2343-f635c9b6-83523dd0-772e18f9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:25.433892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|882e2343-f635c9b6-83523dd0-772e18f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.434436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:25.434453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 794
2025-10-01T14:09:25.434620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.434661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:25.434670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:25.434674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:25.435079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 794 sessionId:  describe result for acl check
2025-10-01T14:09:25.435106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:25.435108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:25.435110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:25.435115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255217696688977:7562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:25.435650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255217696688977:7562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:25.438944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255217696688977:7562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:25.439138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:25.442213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:25.442441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:25.442452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:25.442463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:25.442521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:25.442564Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255215319823489:6675]
2025-10-01T14:09:25.443175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:25.443536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:25.443595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:25.443967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:25.444041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.444043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.444044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.444045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.444046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.444048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.444049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.444051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.444052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.444053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.444054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.444055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.444056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.444057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.444063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.444072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.444076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.444079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.444083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.444086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.444090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.444093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.444097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.444101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.444104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.444108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.444111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.444115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.444123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.444130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.444136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.444141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.444145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.444150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.444154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.444158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.444162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.444168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.444172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.444177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.444181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.444186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.444190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.444194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.444199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.444204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.444208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.444212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.444217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.444222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.444226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.444231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.444236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.444241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.444245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.444250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.444288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:25.444215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255217696688977:7562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:25.444235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255217696688977:7562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:25.444238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255217696688977:7562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:25.444247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:25.448116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:25.448826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:25.448843Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:25.448846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:25.448850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:25.448857Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 793 [2:7556255215319823489:6675]
2025-10-01T14:09:25.448877Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:25.448894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:25.448897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.448901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.448904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.448920Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:25.448932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:25.448938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:25.449005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.449012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.449014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.449018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:25.449020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:25.449092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:25.449102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.449114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.449125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.449141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:25.449164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696689063:7562], now have 1 active actors on pipe
2025-10-01T14:09:25.449172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696688948:2446], now have 1 active actors on pipe
2025-10-01T14:09:25.449178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255215319823484:6675]
2025-10-01T14:09:25.449180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255215319823484:6675]
2025-10-01T14:09:25.449183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255215319823484:6675]
2025-10-01T14:09:25.449198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:25.449276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 793
2025-10-01T14:09:25.449310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 793
2025-10-01T14:09:25.449215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:25.449215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:25.449219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:25.449221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:25.449232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:25.449235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:25.449266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255215319823484:6675]
2025-10-01T14:09:25.449269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:25.449273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:25.449460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.449482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.449508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87bda9e8-832d3565-480ab235-1fe79c98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:25.449520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.449524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.449526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:25.449537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.449557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:25.449574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.449738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.449746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.449760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.449937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 794 partition: 0 MaxSeqNo: 45 sessionId: src_id|87bda9e8-832d3565-480ab235-1fe79c98_0
2025-10-01T14:09:25.450313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|882e2343-f635c9b6-83523dd0-772e18f9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|87bda9e8-832d3565-480ab235-1fe79c98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:25.453224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87bda9e8-832d3565-480ab235-1fe79c98_0] Write session: try to update token
2025-10-01T14:09:25.453245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87bda9e8-832d3565-480ab235-1fe79c98_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:25.469477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:25.469493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:25.469496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:25.469498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:25.469509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255215319823484:6675]
2025-10-01T14:09:25.469513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255215319823484:6675]
2025-10-01T14:09:25.469518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255215319823484:6675]
2025-10-01T14:09:25.469565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:25.469569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:25.469572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.469575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:25.469578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:25.469579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:25.469620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 794 sessionId: src_id|87bda9e8-832d3565-480ab235-1fe79c98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:25.469722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:25.472428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:25.525564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255217696689074:6999]
2025-10-01T14:09:25.525896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 793, pipe: [1:7556255217696689074:6999]
2025-10-01T14:09:25.612077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:25.612404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.612420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.612459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696689074:6999], now have 1 active actors on pipe
2025-10-01T14:09:25.612641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:25.612791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:25.612855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255217696689074:6999]
2025-10-01T14:09:25.612926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:25.612937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:25.613011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 794 reason: error at write: Disconnected sessionId: src_id|87bda9e8-832d3565-480ab235-1fe79c98_0
2025-10-01T14:09:25.613170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 794 sessionId: src_id|87bda9e8-832d3565-480ab235-1fe79c98_0 is DEAD
2025-10-01T14:09:25.613291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87bda9e8-832d3565-480ab235-1fe79c98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:25.613302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87bda9e8-832d3565-480ab235-1fe79c98_0] Write session will restart in 0.007110s
2025-10-01T14:09:25.613326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87bda9e8-832d3565-480ab235-1fe79c98_0] Write session: Do CDS request
2025-10-01T14:09:25.613332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87bda9e8-832d3565-480ab235-1fe79c98_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:25.621947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87bda9e8-832d3565-480ab235-1fe79c98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.622003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:25.622017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 795
2025-10-01T14:09:25.622141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.622173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:25.622178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:25.622182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:25.622646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 795 sessionId:  describe result for acl check
2025-10-01T14:09:25.622687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:25.622693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:25.622695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:25.622700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255217696689156:7567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:25.623300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255217696689156:7567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:25.624592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:25.627144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255217696689156:7567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:25.627220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:25.627438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:25.627451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:25.627464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:25.627538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:25.627591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255215319823612:6678]
2025-10-01T14:09:25.628247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:25.628566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:25.628628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:25.629087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:25.629245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.629255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.629256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.629257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.629258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.629258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.629259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.629260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.629261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.629262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.629263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.629263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.629264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.629265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.629270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.629276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.629279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.629281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.629283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.629285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.629289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.629293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.629297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.629302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.629306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.629310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.629314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.629318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.629328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.629333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.629338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.629341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.629345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.629348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.629350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.629354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.629357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.629360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.629363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.629366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.629370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.629374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.629376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.629379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.629383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.629389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.629393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.629398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.629403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.629408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.629412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.629418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.629423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.629428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.629432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.629437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.629469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:25.629701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255217696689156:7567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:25.629718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255217696689156:7567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:25.629722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255217696689156:7567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:25.629731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:25.634054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:25.634613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:25.634625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:25.634627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:25.634630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:25.634636Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 794 [2:7556255215319823612:6678]
2025-10-01T14:09:25.634649Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:25.634665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:25.634667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.634669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.634671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.634683Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:25.634687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:25.634692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:25.634747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.634758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.634759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.634762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:25.634763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:25.634816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:25.634824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.634834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.634844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.634858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:25.634882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255215319823606:6678]
2025-10-01T14:09:25.634891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255215319823606:6678]
2025-10-01T14:09:25.634893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255215319823606:6678]
2025-10-01T14:09:25.634902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:25.634909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:25.634911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696689209:7567], now have 1 active actors on pipe
2025-10-01T14:09:25.634913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:25.634915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:25.634918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696689088:2446], now have 1 active actors on pipe
2025-10-01T14:09:25.634922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:25.634930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:25.634933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:25.634959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255215319823606:6678]
2025-10-01T14:09:25.634969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:25.634978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:25.635036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 794
2025-10-01T14:09:25.635038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 794
2025-10-01T14:09:25.635138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.635151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.635174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:25.635183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.635194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.635200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:25.635206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.635217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:25.635232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.635360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.635373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.635383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.635464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 795 partition: 0 MaxSeqNo: 45 sessionId: src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0
2025-10-01T14:09:25.635794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87bda9e8-832d3565-480ab235-1fe79c98_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:25.638557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0] Write session: try to update token
2025-10-01T14:09:25.638573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:25.656208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 795 sessionId: src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:25.658502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:25.658520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:25.658523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:25.658525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:25.658536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255215319823606:6678]
2025-10-01T14:09:25.658540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255215319823606:6678]
2025-10-01T14:09:25.658544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255215319823606:6678]
2025-10-01T14:09:25.658594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:25.658594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:25.658599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:25.658601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.658603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:25.658604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:25.658759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:25.658990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:25.712955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255217696689220:6999]
2025-10-01T14:09:25.713226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 794, pipe: [1:7556255217696689220:6999]
2025-10-01T14:09:25.799144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:25.799575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.799592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.799635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696689220:6999], now have 1 active actors on pipe
2025-10-01T14:09:25.799829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:25.799892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:25.799902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:25.799906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:25.799962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255217696689220:6999]
2025-10-01T14:09:25.799964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 795 reason: error at write: Disconnected sessionId: src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0
2025-10-01T14:09:25.800156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 795 sessionId: src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0 is DEAD
2025-10-01T14:09:25.800314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:25.800326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0] Write session will restart in 0.008762s
2025-10-01T14:09:25.800354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0] Write session: Do CDS request
2025-10-01T14:09:25.800360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:25.809504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:25.809966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.810069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:25.810083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 796
2025-10-01T14:09:25.810247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.810281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:25.810290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:25.810293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:25.810698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 796 sessionId:  describe result for acl check
2025-10-01T14:09:25.810738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:25.810746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:25.810747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:25.810752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255217696689307:7572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:25.811192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255217696689307:7572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:25.811393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:25.811540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:25.811546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:25.811554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:25.811595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:25.811628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255215319823736:6680]
2025-10-01T14:09:25.812160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:25.812395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:25.812424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:25.812687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:25.812736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.812742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.812742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.812743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.812744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.812745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.812747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.812748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.812749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.812750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.812761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.812763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.812782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255217696689307:7572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:25.812764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.812765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.812770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.812779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.812783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.812786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.812790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.812793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.812797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.812800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.812804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.812807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.812811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.812814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.812818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.812821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.812828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.812835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:25.812841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.812846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:25.812850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.812862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:25.812865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.812867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:25.812870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.812873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:25.812875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.812878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:25.812881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.812884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:25.812886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.812891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:25.812895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.812899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:25.812904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.812908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.812911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.812925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.812931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.812935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.812939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.812947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:25.812951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.812956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:25.812992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:25.816287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255217696689307:7572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:25.816299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255217696689307:7572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:25.816302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255217696689307:7572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:25.816309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:25.816694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:25.817365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:25.817378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:25.817380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:25.817383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:25.817390Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 795 [2:7556255215319823736:6680]
2025-10-01T14:09:25.817404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:25.817422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:25.817429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.817432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.817435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.817449Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:25.817457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:25.817462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:25.817510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.817516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.817517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.817520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:25.817523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:25.817585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:25.817593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.817604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:25.817615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:25.817630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:25.817648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696689346:7572], now have 1 active actors on pipe
2025-10-01T14:09:25.817656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696689223:2446], now have 1 active actors on pipe
2025-10-01T14:09:25.817662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255215319823729:6680]
2025-10-01T14:09:25.817664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255215319823729:6680]
2025-10-01T14:09:25.817666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255215319823729:6680]
2025-10-01T14:09:25.817677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:25.817685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:25.817687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:25.817688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:25.817694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:25.817689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 795
2025-10-01T14:09:25.817697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 795
2025-10-01T14:09:25.817707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:25.817714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:25.817749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.817758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.817774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255215319823729:6680]
2025-10-01T14:09:25.817781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:25.817803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:25.817807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:25.817813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:25.817817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:25.817820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:25.817827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:25.817839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:25.817864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.818013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.818020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.818032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:25.818093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 796 partition: 0 MaxSeqNo: 45 sessionId: src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0
2025-10-01T14:09:25.818429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bbfc25-6f2c7f55-82c6e139-e195b49d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:25.821213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0] Write session: try to update token
2025-10-01T14:09:25.821231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:25.837280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 796 sessionId: src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:25.839590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:25.839605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:25.839608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:25.839610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:25.839619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255215319823729:6680]
2025-10-01T14:09:25.839624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255215319823729:6680]
2025-10-01T14:09:25.839628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255215319823729:6680]
2025-10-01T14:09:25.839662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:25.839672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:25.839674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:25.839675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:25.839694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:25.839696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:25.839824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:25.839928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:25.900359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255217696689353:6999]
2025-10-01T14:09:25.900670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 795, pipe: [1:7556255217696689353:6999]
2025-10-01T14:09:25.986657Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:25.986987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:25.987002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:25.987046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696689353:6999], now have 1 active actors on pipe
2025-10-01T14:09:25.987252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:25.987271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:25.987285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:25.987298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255217696689353:6999]
2025-10-01T14:09:25.987327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:25.987341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 796 reason: error at write: Disconnected sessionId: src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0
2025-10-01T14:09:25.987506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 796 sessionId: src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0 is DEAD
2025-10-01T14:09:25.987658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:25.987666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0] Write session will restart in 0.009979s
2025-10-01T14:09:25.987689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0] Write session: Do CDS request
2025-10-01T14:09:25.987694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:25.998958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.999087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:25.999103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 797
2025-10-01T14:09:25.999255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:25.999286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:25.999294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:25.999298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:25.999738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 797 sessionId:  describe result for acl check
2025-10-01T14:09:25.999776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:25.999783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:25.999786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:25.999790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255217696689442:7576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:26.000344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255217696689442:7576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:26.000337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:26.002466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255217696689442:7576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:26.002462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:26.002643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:26.002652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:26.002663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:26.002710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:26.002750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255219614791158:6683]
2025-10-01T14:09:26.003369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:26.003577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:26.003617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:26.003860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:26.003917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.003922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.003924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.003925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.003926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.003928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.003929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.003931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.003932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.003933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.003935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.003936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.003937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.003938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.003944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.003954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.003959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.003962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.003967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.003970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.003975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.003978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.003981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.003983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.003985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.003989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.003993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.003996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.004003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.004010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.004016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.004021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.004026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.004031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.004035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.004040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.004045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.004050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.004054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.004059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.004063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.004068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.004072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.004077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.004082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.004092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.004097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.004102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.004110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.004115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.004120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.004129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.004134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.004143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.004148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.004154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.004196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:26.004849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255217696689442:7576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:26.004860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255217696689442:7576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:26.004865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255217696689442:7576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:26.004881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:26.008070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:26.008669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:26.008681Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:26.008684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:26.008687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:26.008695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 796 [2:7556255219614791158:6683]
2025-10-01T14:09:26.008710Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:26.008725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:26.008729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.008733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.008735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.008749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:26.008764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:26.008771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:26.008824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.008832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.008834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.008838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:26.008840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:26.008903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:26.008910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.008921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.008934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.008956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:26.008977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991656775:7576], now have 1 active actors on pipe
2025-10-01T14:09:26.008984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255217696689358:2446], now have 1 active actors on pipe
2025-10-01T14:09:26.008991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255219614791153:6683]
2025-10-01T14:09:26.008997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255219614791153:6683]
2025-10-01T14:09:26.009000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255219614791153:6683]
2025-10-01T14:09:26.009016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:26.009033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:26.009051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:26.009058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:26.009043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 796
2025-10-01T14:09:26.009062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 796
2025-10-01T14:09:26.009071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:26.009080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:26.009082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:26.009083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255219614791153:6683]
2025-10-01T14:09:26.009086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:26.009088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:26.009140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.009149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.009171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:26.009181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.009185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.009192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:26.009200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.009212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:26.009232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.009421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.009427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.009439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.009531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 797 partition: 0 MaxSeqNo: 45 sessionId: src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0
2025-10-01T14:09:26.009850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|600f4a17-50d32fd0-4f582865-240c0ecb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:26.012641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0] Write session: try to update token
2025-10-01T14:09:26.012659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:26.020801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:26.020812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:26.020820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255219614791153:6683]
2025-10-01T14:09:26.020860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:26.020871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:26.021010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:26.021125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:26.021239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:26.021362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:26.021540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:26.021574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:26.027900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 797 sessionId: src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:26.030667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:26.030908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.030932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.030969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:26.031097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:26.041075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:26.041094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:26.041097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:26.041099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:26.041107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255219614791153:6683]
2025-10-01T14:09:26.041111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255219614791153:6683]
2025-10-01T14:09:26.041114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255219614791153:6683]
2025-10-01T14:09:26.041162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:26.041166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:26.041167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:26.041171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:26.041173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.041176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:26.041315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:26.087731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255221991656782:6999]
2025-10-01T14:09:26.088313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 796, pipe: [1:7556255221991656782:6999]
2025-10-01T14:09:26.175641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:26.183815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.183844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.184005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.184068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.184138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.184197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.184430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.184440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.184501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.184562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.184619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.184964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.185128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.185135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.185205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.185257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.185311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.185422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.185463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.185468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.185586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.185639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.185692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.185746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.185782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.185787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.185843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.185908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.185969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.186027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.186066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.186071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.186128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.186177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.186227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.186299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.186339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.186344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.186419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.186477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.186532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.186583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.186624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.186630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.186687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.186737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.186788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.186850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.186890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.186894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.186951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.187002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.187054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.187106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.187206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.187211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.187266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.187315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.187367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.187420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.187458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.187464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.187514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991656782:6999], now have 1 active actors on pipe
2025-10-01T14:09:26.187761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255221991656782:6999]
2025-10-01T14:09:26.187790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:26.187829Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:26.187840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:26.187849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:26.187874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 797 reason: error at write: Disconnected sessionId: src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0
2025-10-01T14:09:26.188103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:26.188113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0] Write session will restart in 0.005895s
2025-10-01T14:09:26.188136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0] Write session: Do CDS request
2025-10-01T14:09:26.188141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:26.188127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 797 sessionId: src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0 is DEAD
2025-10-01T14:09:26.195004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.195022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:26.195038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 798
2025-10-01T14:09:26.195595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.195631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:26.195641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:26.195646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:26.196347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 798 sessionId:  describe result for acl check
2025-10-01T14:09:26.196380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:26.196382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:26.196385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:26.196390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255221991656841:7587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:26.196911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255221991656841:7587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:26.199291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255221991656841:7587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:26.199815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:26.201718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:26.201917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:26.201927Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:26.201937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:26.201991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255221991656841:7587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:26.202008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255221991656841:7587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:26.201993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:26.202035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255219614791290:6687]
2025-10-01T14:09:26.202109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255221991656841:7587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:26.202119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:26.202546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:26.202818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:26.202856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:26.203067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:26.203105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.203111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.203112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.203113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.203114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.203115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.203116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.203117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.203118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.203119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.203120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.203121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.203122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.203123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.203128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.203135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.203136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.203139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.203141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.203143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.203145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.203147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.203149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.203151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.203153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.203155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.203157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.203159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.203164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.203169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.203172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.203176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.203178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.203181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.203184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.203186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.203189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.203192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.203195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.203198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.203200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.203203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.203205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.203208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.203211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.203214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.203216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.203219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.203222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.203225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.203227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.203230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.203233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.203235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.203238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.203240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.203262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:26.207073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:26.207987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:26.208006Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:26.208009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:26.208013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:26.208019Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 797 [2:7556255219614791290:6687]
2025-10-01T14:09:26.208033Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:26.208051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:26.208058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.208062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.208068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.208084Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:26.208094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:26.208101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:26.208165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.208173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.208175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.208179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:26.208181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:26.208249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:26.208257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.208268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.208282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.208299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:26.208322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255219614791284:6687]
2025-10-01T14:09:26.208332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255219614791284:6687]
2025-10-01T14:09:26.208334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255219614791284:6687]
2025-10-01T14:09:26.208347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:26.208361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:26.208361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991656928:7587], now have 1 active actors on pipe
2025-10-01T14:09:26.208363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:26.208365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991656810:2446], now have 1 active actors on pipe
2025-10-01T14:09:26.208365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:26.208373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:26.208386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:26.208394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:26.208421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255219614791284:6687]
2025-10-01T14:09:26.208431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:26.208424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 797
2025-10-01T14:09:26.208430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 797
2025-10-01T14:09:26.208454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:26.208490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.208501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.208523Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:26.208534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.208540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.208546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:26.208555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.208569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:26.208584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.208745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.208762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.208793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.208905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 798 partition: 0 MaxSeqNo: 45 sessionId: src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0
2025-10-01T14:09:26.209329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ef50dc-4d67604c-2137f4d8-646857a1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:26.212454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0] Write session: try to update token
2025-10-01T14:09:26.212476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:26.220546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:26.220566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:26.220577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255219614791284:6687]
2025-10-01T14:09:26.220622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:26.220775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:26.220826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:26.220982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:26.221130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:26.221299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:26.221524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:26.221566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:26.230300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 798 sessionId: src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:26.233812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:26.234035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.234055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.234090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:26.234188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:26.241279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:26.241296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:26.241299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:26.241302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:26.241316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255219614791284:6687]
2025-10-01T14:09:26.241320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255219614791284:6687]
2025-10-01T14:09:26.241325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255219614791284:6687]
2025-10-01T14:09:26.241375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:26.241381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:26.241384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.241387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:26.241388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:26.241392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:26.241536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:26.287905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255221991656945:6999]
2025-10-01T14:09:26.288263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 797, pipe: [1:7556255221991656945:6999]
2025-10-01T14:09:26.377782Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:26.384423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.384445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.384598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.384666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.384736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.384809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.384855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.384867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.384938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.384998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.385057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.385120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.385166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.385175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.385235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.385288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.385342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.385386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.385421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.385426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.385475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.385525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.385573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.385628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.385675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.385681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.385731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.385778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.385827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.385874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.385914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.385919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.385973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.386021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.386087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.386149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.386211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.386217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.386269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.386319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.386384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.386438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.386477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.386484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.386543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.386596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.386646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.386709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.386753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.386758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.386817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.386867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.386919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.386971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.387009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.387014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.387068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.387122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.387176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.387230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.387268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.387273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.387314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991656945:6999], now have 1 active actors on pipe
2025-10-01T14:09:26.387533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:26.387544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:26.387575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255221991656945:6999]
2025-10-01T14:09:26.387582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 798 reason: error at write: Disconnected sessionId: src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0
2025-10-01T14:09:26.387609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:26.387770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 798 sessionId: src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0 is DEAD
2025-10-01T14:09:26.387883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:26.387891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0] Write session will restart in 0.006053s
2025-10-01T14:09:26.387914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0] Write session: Do CDS request
2025-10-01T14:09:26.387919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:26.388045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:26.394902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.394989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:26.395005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 799
2025-10-01T14:09:26.395132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.395164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:26.395184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:26.395193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:26.395638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 799 sessionId:  describe result for acl check
2025-10-01T14:09:26.395676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:26.395679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:26.395681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:26.395687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255221991656964:7592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:26.396227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255221991656964:7592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:26.398703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255221991656964:7592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:26.400662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:26.402874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:26.402959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255221991656964:7592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:26.402978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255221991656964:7592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:26.402982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255221991656964:7592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:26.402988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:26.403103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:26.403115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:26.403127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:26.403185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:26.403234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255219614791419:6690]
2025-10-01T14:09:26.403875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:26.404128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:26.404174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:26.404455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:26.404528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.404534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.404535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.404536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.404537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.404537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.404538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.404539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.404540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.404541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.404542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.404542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.404543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.404544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.404548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.404554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.404557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.404559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.404562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.404564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.404566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.404578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.404580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.404583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.404585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.404587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.404589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.404591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.404596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.404601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.404604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.404608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.404611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.404614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.404617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.404619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.404622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.404626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.404628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.404631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.404634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.404637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.404640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.404643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.404645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.404648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.404651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.404654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.404657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.404660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.404663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.404666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.404669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.404672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.404678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.404683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.404717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:26.408512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:26.409210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:26.409224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:26.409226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:26.409230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:26.409236Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 798 [2:7556255219614791419:6690]
2025-10-01T14:09:26.409250Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:26.409271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:26.409279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.409283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.409285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.409299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:26.409311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:26.409318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:26.409391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.409398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.409399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.409402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:26.409404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:26.409472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:26.409481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.409491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.409506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.409522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:26.409543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657072:7592], now have 1 active actors on pipe
2025-10-01T14:09:26.409552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991656950:2446], now have 1 active actors on pipe
2025-10-01T14:09:26.409559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255219614791414:6690]
2025-10-01T14:09:26.409561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255219614791414:6690]
2025-10-01T14:09:26.409564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255219614791414:6690]
2025-10-01T14:09:26.409575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:26.409593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:26.409594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:26.409597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:26.409599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:26.409611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:26.409614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:26.409621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 798
2025-10-01T14:09:26.409632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 798
2025-10-01T14:09:26.409642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255219614791414:6690]
2025-10-01T14:09:26.409658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:26.409660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:26.409680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.409684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.409716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:26.409728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.409732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.409734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:26.409743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.409757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:26.409778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.409926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.409936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.409947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.410022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 799 partition: 0 MaxSeqNo: 45 sessionId: src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0
2025-10-01T14:09:26.410363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84d53e98-97edb5a8-332895eb-ed2b919b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:26.412986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0] Write session: try to update token
2025-10-01T14:09:26.413001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:26.425710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 799 sessionId: src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:26.427994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:26.428239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.428263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.428302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:26.428404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:26.431323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:26.431339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:26.431342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:26.431344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:26.431352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255219614791414:6690]
2025-10-01T14:09:26.431357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255219614791414:6690]
2025-10-01T14:09:26.431361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255219614791414:6690]
2025-10-01T14:09:26.431414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:26.431416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:26.431425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:26.431428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.431429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:26.431431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:26.431631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:26.487562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255221991657085:6999]
2025-10-01T14:09:26.487793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 798, pipe: [1:7556255221991657085:6999]
2025-10-01T14:09:26.570631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:26.577894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.577916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.578073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.578125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.578191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.578251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.578397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.578408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.578479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.578538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.578597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.578657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.578699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.578706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.578767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.578822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.578882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.578938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.578978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.578990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.579048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.579382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.579445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.579504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.579546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.579553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.579616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.579760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.579813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.579866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.579905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.579909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.579968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.580019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.580078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.580135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.580181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.580187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.580244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.580296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.580350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.580403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.580441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.580445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.580498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.580652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.580709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.580776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.580821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.580827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.580889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.580950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.581010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.581073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.581121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.581127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.581188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:26.581251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:26.581316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:26.581376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:26.581419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:26.581425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:26.581484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657085:6999], now have 1 active actors on pipe
2025-10-01T14:09:26.581764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255221991657085:6999]
2025-10-01T14:09:26.581790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:26.581796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:26.581799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:26.581832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 799 reason: error at write: Disconnected sessionId: src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0
2025-10-01T14:09:26.582051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 799 sessionId: src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0 is DEAD
2025-10-01T14:09:26.582064Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:26.582203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:26.582213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0] Write session will restart in 0.006282s
2025-10-01T14:09:26.582239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0] Write session: Do CDS request
2025-10-01T14:09:26.582257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:26.589876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.589957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:26.589972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 800
2025-10-01T14:09:26.590107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.590138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:26.590147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:26.590151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:26.591502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 800 sessionId:  describe result for acl check
2025-10-01T14:09:26.591554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:26.591558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:26.591560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:26.591566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255221991657133:7597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:26.592170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255221991657133:7597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:26.594718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255221991657133:7597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:26.595183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:26.597655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:26.597854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:26.597863Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:26.597874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:26.597931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:26.597971Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255219614791587:6703]
2025-10-01T14:09:26.598638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:26.599181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:26.599258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:26.599665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:26.599735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.599743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.599745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.599746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.599748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.599750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.599752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.599754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.599755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.599757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.599758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.599760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.599762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.599763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.599770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.599782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.599787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.599792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.599796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.599801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.599805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.599810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.599814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.599818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.599822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.599826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.599831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.599835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.599844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.599853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.599860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.599867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.599871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.599877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.599883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.599889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.599901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.599908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.599913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.599925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.599931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.599942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.599908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255221991657133:7597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:26.599947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.599928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255221991657133:7597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:26.599952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.599958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.599933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255221991657133:7597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:26.599964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.599942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:26.599968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.599974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.599980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.599986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.599991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.599998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.600004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.600009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.600015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.600021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.600069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:26.604340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:26.605703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:26.605720Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:26.605723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:26.605727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:26.605734Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 799 [2:7556255219614791587:6703]
2025-10-01T14:09:26.605751Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:26.605770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:26.605779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.605782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.605784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.605800Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:26.605811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:26.605818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:26.605882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.605893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.605895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.605899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:26.605901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:26.605971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:26.605979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.605992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.606003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.606019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:26.606043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657223:7597], now have 1 active actors on pipe
2025-10-01T14:09:26.606052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657099:2446], now have 1 active actors on pipe
2025-10-01T14:09:26.606058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255219614791582:6703]
2025-10-01T14:09:26.606061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255219614791582:6703]
2025-10-01T14:09:26.606063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255219614791582:6703]
2025-10-01T14:09:26.606076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:26.606088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:26.606094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:26.606098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:26.606101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:26.606108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:26.606111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:26.606112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 799
2025-10-01T14:09:26.606146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255219614791582:6703]
2025-10-01T14:09:26.606113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 799
2025-10-01T14:09:26.606155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:26.606157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:26.606172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.606176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.606219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:26.606230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.606234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.606236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:26.606248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.606257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:26.606280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.608216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.608233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.608259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.608366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 800 partition: 0 MaxSeqNo: 45 sessionId: src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0
2025-10-01T14:09:26.608694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b01ce56d-36c84266-49bcb6f7-c8341fbd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:26.611586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0] Write session: try to update token
2025-10-01T14:09:26.611606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:26.629254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:26.629276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:26.629279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:26.629282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:26.629292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255219614791582:6703]
2025-10-01T14:09:26.629296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255219614791582:6703]
2025-10-01T14:09:26.629300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255219614791582:6703]
2025-10-01T14:09:26.629355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:26.629357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:26.629363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.629365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:26.629366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:26.629369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:26.629565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:26.629612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 800 sessionId: src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:26.632608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:26.682160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255221991657236:6999]
2025-10-01T14:09:26.682443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 799, pipe: [1:7556255221991657236:6999]
2025-10-01T14:09:26.782247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:26.782927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.782946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.782990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657236:6999], now have 1 active actors on pipe
2025-10-01T14:09:26.783286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:26.783287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:26.783307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:26.783360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255221991657236:6999]
2025-10-01T14:09:26.783407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:26.783395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 800 reason: error at write: Disconnected sessionId: src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0
2025-10-01T14:09:26.783603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 800 sessionId: src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0 is DEAD
2025-10-01T14:09:26.783817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:26.783828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0] Write session will restart in 0.006119s
2025-10-01T14:09:26.783856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0] Write session: Do CDS request
2025-10-01T14:09:26.783864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:26.790853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.791047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:26.791063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 801
2025-10-01T14:09:26.791257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.791291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:26.791304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:26.791309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:26.791857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 801 sessionId:  describe result for acl check
2025-10-01T14:09:26.791901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:26.791903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:26.791906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:26.791911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255221991657270:7602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:26.792488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255221991657270:7602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:26.794508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255221991657270:7602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:26.794865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:26.796996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:26.797188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:26.797200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:26.797212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:26.797269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:26.797277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255221991657270:7602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:26.797293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255221991657270:7602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:26.797295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255221991657270:7602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:26.797302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:26.797307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255219614791716:6705]
2025-10-01T14:09:26.797865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:26.798144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:26.798192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:26.798502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:26.798573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.798579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.798581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.798582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.798583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.798584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.798585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.798586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.798587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.798588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.798590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.798591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.798591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.798593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.798599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.798608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.798612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.798615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.798618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.798622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.798625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.798629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.798633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.798637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.798644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.798648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.798655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.798659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.798670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.798682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.798691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.798702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.798710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.798716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.798725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.798733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.798740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.798748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.798752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.798760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.798768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.798776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.798787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.798792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.798796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.798805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.798813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.798819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.798826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.798831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.798838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.798843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.798850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.798854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.798861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.798865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.798905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:26.802444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:26.803057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:26.803068Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:26.803071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:26.803075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:26.803082Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 800 [2:7556255219614791716:6705]
2025-10-01T14:09:26.803096Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:26.803113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:26.803120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.803124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.803126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.803143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:26.803148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:26.803154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:26.803205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.803211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.803215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.803218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:26.803221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:26.803289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:26.803295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.803307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.803325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.803346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:26.803370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657363:7602], now have 1 active actors on pipe
2025-10-01T14:09:26.803377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657239:2446], now have 1 active actors on pipe
2025-10-01T14:09:26.803384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255219614791710:6705]
2025-10-01T14:09:26.803388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255219614791710:6705]
2025-10-01T14:09:26.803390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255219614791710:6705]
2025-10-01T14:09:26.803403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:26.803420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:26.803422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:26.803423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:26.803425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:26.803437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:26.803440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:26.803446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 800
2025-10-01T14:09:26.803464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255219614791710:6705]
2025-10-01T14:09:26.803472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:26.803446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 800
2025-10-01T14:09:26.803474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:26.803498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.803502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.803534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:26.803540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.803544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.803546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:26.803556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.803568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:26.803588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.803715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.803722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.803735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.803838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 801 partition: 0 MaxSeqNo: 45 sessionId: src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0
2025-10-01T14:09:26.804220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cdbd6d7-60fa078d-43477b24-cf884d7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:26.806965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0] Write session: try to update token
2025-10-01T14:09:26.806986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:26.822880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 801 sessionId: src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:26.823856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:26.823881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:26.823885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:26.823888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:26.823897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255219614791710:6705]
2025-10-01T14:09:26.823902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255219614791710:6705]
2025-10-01T14:09:26.823906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255219614791710:6705]
2025-10-01T14:09:26.823956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:26.823958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:26.823965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.823968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:26.823968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:26.823972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:26.824101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:26.825767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:26.883387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255221991657374:6999]
2025-10-01T14:09:26.883732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 800, pipe: [1:7556255221991657374:6999]
2025-10-01T14:09:26.973430Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:26.973853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.973865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.973900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657374:6999], now have 1 active actors on pipe
2025-10-01T14:09:26.974096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:26.974112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:26.974144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:26.974150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:26.974172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255221991657374:6999]
2025-10-01T14:09:26.974196Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:09:26.974245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 801 reason: error at write: Disconnected sessionId: src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0
2025-10-01T14:09:26.974331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 801 sessionId: src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0 is DEAD
2025-10-01T14:09:26.974442Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 8 consumer shared/user session shared/user_1_8_11479685912846437090_v1 is DEAD
2025-10-01T14:09:26.974548Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:09:26.974599Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255136092294718:6996] disconnected; active server actors: 1
2025-10-01T14:09:26.974607Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255136092294718:6996] client user disconnected session shared/user_1_8_11479685912846437090_v1
2025-10-01T14:09:26.974657Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:09:26.974661Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:09:26.974667Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.005248s
2025-10-01T14:09:26.974693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:26.974707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0] Write session will restart in 0.008103s
2025-10-01T14:09:26.974745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0] Write session: Do CDS request
2025-10-01T14:09:26.974751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:26.980769Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:09:26.981045Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:09:26.981063Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 9
2025-10-01T14:09:26.981259Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 9 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:09:26.981311Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:09:26.981391Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 auth for : user
2025-10-01T14:09:26.981579Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 Handle describe topics response
2025-10-01T14:09:26.981604Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 auth is DEAD
2025-10-01T14:09:26.981612Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:09:26.981945Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:09:26.982034Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_9_13937073349618143967_v1
2025-10-01T14:09:26.982063Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255221991657431:7606] connected; active server actors: 1
2025-10-01T14:09:26.982127Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255221991657431:7606] session shared/user_1_9_13937073349618143967_v1
2025-10-01T14:09:26.982146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:09:26.982161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:09:26.982172Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_9_13937073349618143967_v1" (Sender=[1:7556255221991657397:7606], Pipe=[1:7556255221991657431:7606], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:09:26.982178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:09:26.982199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:09:26.982212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_9_13937073349618143967_v1" (Sender=[1:7556255221991657397:7606], Pipe=[1:7556255221991657431:7606], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:09:26.982227Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_9_13937073349618143967_v1" sender [1:7556255221991657397:7606] lock partition 0 for ReadingSession "shared/user_1_9_13937073349618143967_v1" (Sender=[1:7556255221991657397:7606], Pipe=[1:7556255221991657431:7606], Partitions=[], ActiveFamilyCount=1) generation 1 step 9
2025-10-01T14:09:26.982243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:09:26.982251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000045s
2025-10-01T14:09:26.982543Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 9 Session: "shared/user_1_9_13937073349618143967_v1" ClientId: "user" PipeClient { RawX1: 7556255221991657431 RawX2: 4503603922345398 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:09:26.982567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:09:26.983767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.983991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:26.984006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 802
2025-10-01T14:09:26.984081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:26.984136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:26.984165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:26.984174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:26.984177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:26.984496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 802 sessionId:  describe result for acl check
2025-10-01T14:09:26.984521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:26.984526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:26.984528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:26.984533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255221991657477:7610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:26.985026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255221991657477:7610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:26.985875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:26.986027Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:26.986035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:26.986043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:26.986073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:26.986123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255219614791849:6708]
2025-10-01T14:09:26.986508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:26.986757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:26.986805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:26.986860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255221991657477:7610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:26.987073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:26.987120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.987124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.987125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.987125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.987126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.987127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.987128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.987128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.987129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.987129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.987130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.987131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.987131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.987132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.987136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.987141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.987143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.987146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.987147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.987150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.987152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.987154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.987156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.987160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.987162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.987164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.987166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.987168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.987172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.987177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:26.987184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.987189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:26.987193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.987198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:26.987206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.987210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:26.987219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.987228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:26.987231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.987234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:26.987236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.987239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:26.987243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.987246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:26.987248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.987257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:26.987260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.987263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.987265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.987268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.987272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.987275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.987277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.987280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:26.987285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.987288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:26.987308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:26.990551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255221991657477:7610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:26.990563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255221991657477:7610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:26.990567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255221991657477:7610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:26.990574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:26.990717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:26.991318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:26.991328Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:26.991330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:26.991333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:26.991339Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 801 [2:7556255219614791849:6708]
2025-10-01T14:09:26.991354Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:26.991369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:26.991375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.991379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.991381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.991396Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:26.991406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:26.991411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:26.991457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.991462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.991464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.991467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:26.991469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:26.991525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:26.991531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:26.991537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:26.991543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:26.991552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:26.991569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657512:7610], now have 1 active actors on pipe
2025-10-01T14:09:26.991580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255219614791843:6708]
2025-10-01T14:09:26.991586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255219614791843:6708]
2025-10-01T14:09:26.991588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255219614791843:6708]
2025-10-01T14:09:26.991599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:26.991607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:26.991610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:26.991611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657457:7609], now have 1 active actors on pipe
2025-10-01T14:09:26.991612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:26.991613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255221991657379:2446], now have 1 active actors on pipe
2025-10-01T14:09:26.991621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:26.991629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:26.991635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:26.991649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 801
2025-10-01T14:09:26.991662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255219614791843:6708]
2025-10-01T14:09:26.991668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:26.991673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:26.991672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 801, pipe: [1:7556255221991657457:7609]
2025-10-01T14:09:26.991674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 801
2025-10-01T14:09:26.991693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.991703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.991716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.991717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.991722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_9_13937073349618143967_v1 on pipe: [1:7556255221991657457:7609]
2025-10-01T14:09:26.991749Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_9_13937073349618143967_v1:1 with generation 801
2025-10-01T14:09:26.991776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e74856e1-37dd71ea-c094274b-49316717_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:26.991784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.991787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.991788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:26.991794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.991804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:26.991819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.991826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.991828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:26.991840Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_9_13937073349618143967_v1
2025-10-01T14:09:26.991845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.991865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.991879Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:09:26.991963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:26.991971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:26.991984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:26.992052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 802 partition: 0 MaxSeqNo: 45 sessionId: src_id|e74856e1-37dd71ea-c094274b-49316717_0
2025-10-01T14:09:26.992390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|588a1e26-d9578e37-10894b6d-bcbdc3e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e74856e1-37dd71ea-c094274b-49316717_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:26.994193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:09:26.994217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:09:26.994223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:26.994225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:26.994226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:26.994231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:09:26.994238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:09:26.994415Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327766991 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:09:26.994438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:09:26.994471Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 sending to client partition status
2025-10-01T14:09:26.995134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e74856e1-37dd71ea-c094274b-49316717_0] Write session: try to update token
2025-10-01T14:09:26.995151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e74856e1-37dd71ea-c094274b-49316717_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:27.010477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 802 sessionId: src_id|e74856e1-37dd71ea-c094274b-49316717_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:27.011786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:27.011804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:27.011806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:27.011808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:27.011816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255219614791843:6708]
2025-10-01T14:09:27.011821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255219614791843:6708]
2025-10-01T14:09:27.011826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255219614791843:6708]
2025-10-01T14:09:27.011870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:27.011871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:27.011876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.011877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:27.011877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:27.011881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:27.011994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:27.012940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:27.147180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:27.147581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.147595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.147838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255221991657457:7609]
2025-10-01T14:09:27.147846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:27.147851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:27.147864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:27.147948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 802 reason: error at write: Disconnected sessionId: src_id|e74856e1-37dd71ea-c094274b-49316717_0
2025-10-01T14:09:27.148007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_9_13937073349618143967_v1
2025-10-01T14:09:27.148027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:27.148050Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_9_13937073349618143967_v1
2025-10-01T14:09:27.148138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 802 sessionId: src_id|e74856e1-37dd71ea-c094274b-49316717_0 is DEAD
2025-10-01T14:09:27.148265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74856e1-37dd71ea-c094274b-49316717_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:27.148277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74856e1-37dd71ea-c094274b-49316717_0] Write session will restart in 0.005655s
2025-10-01T14:09:27.148301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74856e1-37dd71ea-c094274b-49316717_0] Write session: Do CDS request
2025-10-01T14:09:27.148307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74856e1-37dd71ea-c094274b-49316717_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:27.154833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e74856e1-37dd71ea-c094274b-49316717_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.155031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:27.155044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 803
2025-10-01T14:09:27.155185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.155218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:27.155227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:27.155231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:27.155540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 803 sessionId:  describe result for acl check
2025-10-01T14:09:27.155565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:27.155571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:27.155572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:27.155576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255226286624843:7620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:27.156011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255226286624843:7620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:27.158172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255226286624843:7620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:27.159336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:27.161069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:27.161257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:27.161270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:27.161282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:27.161330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255226286624843:7620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:27.161340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255226286624843:7620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:27.161335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:27.161347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255226286624843:7620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:27.161355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:27.161366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255223909759277:6710]
2025-10-01T14:09:27.161910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:27.162152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:27.162201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:27.162490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:27.162554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.162560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.162560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.162561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.162562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.162563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.162564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.162565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.162566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.162567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.162567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.162568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.162569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.162570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.162575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.162584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.162587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.162590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.162593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.162596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.162599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.162601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.162604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.162608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.162611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.162614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.162616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.162619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.162625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.162631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.162636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.162640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.162643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.162647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.162650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.162654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.162659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.162663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.162666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.162670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.162674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.162678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.162681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.162685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.162688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.162691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.162695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.162698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.162702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.162706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.162709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.162713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.162716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.162720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.162722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.162726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.162757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:27.166019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:27.166748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:27.166759Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:27.166761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:27.166764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:27.166770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 802 [2:7556255223909759277:6710]
2025-10-01T14:09:27.166785Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:27.166798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:27.166801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.166805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.166807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.166821Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:27.166830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:27.166835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:27.166882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.166888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.166889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.166892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:27.166895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:27.166949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:27.166956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.166966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.166977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.166996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:27.167015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286624962:7620], now have 1 active actors on pipe
2025-10-01T14:09:27.167021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286624824:2446], now have 1 active actors on pipe
2025-10-01T14:09:27.167027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255223909759271:6710]
2025-10-01T14:09:27.167029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255223909759271:6710]
2025-10-01T14:09:27.167031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255223909759271:6710]
2025-10-01T14:09:27.167043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:27.167054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:27.167055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:27.167056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:27.167057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:27.167068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:27.167070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:27.167055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 802
2025-10-01T14:09:27.167083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 802
2025-10-01T14:09:27.167089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255223909759271:6710]
2025-10-01T14:09:27.167096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:27.167099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:27.167111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.167119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.167158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:27.167169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.167173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.167179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:27.167186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.167193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:27.167212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.167313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.167319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.167330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.167399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 803 partition: 0 MaxSeqNo: 45 sessionId: src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0
2025-10-01T14:09:27.167698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e74856e1-37dd71ea-c094274b-49316717_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:27.169912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0] Write session: try to update token
2025-10-01T14:09:27.169925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:27.185578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 803 sessionId: src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:27.185862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:27.185879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:27.185881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:27.185882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:27.185890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255223909759271:6710]
2025-10-01T14:09:27.185894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255223909759271:6710]
2025-10-01T14:09:27.185897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255223909759271:6710]
2025-10-01T14:09:27.185935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:27.185939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:27.185941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:27.185943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:27.185946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.185948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:27.186067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:27.187935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:27.247915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255226286624983:7609]
2025-10-01T14:09:27.248155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 802, pipe: [1:7556255226286624983:7609]
2025-10-01T14:09:27.327876Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:27.328221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.328240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.328279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286624983:7609], now have 1 active actors on pipe
2025-10-01T14:09:27.328500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:27.328501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:27.328510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:27.328512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:27.328554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255226286624983:7609]
2025-10-01T14:09:27.328559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 803 reason: error at write: Disconnected sessionId: src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0
2025-10-01T14:09:27.328725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 803 sessionId: src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0 is DEAD
2025-10-01T14:09:27.328918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:27.328928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0] Write session will restart in 0.006595s
2025-10-01T14:09:27.328950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0] Write session: Do CDS request
2025-10-01T14:09:27.328955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:27.337027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.337148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:27.337170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 804
2025-10-01T14:09:27.337357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.337390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:27.337403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:27.337408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:27.337912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 804 sessionId:  describe result for acl check
2025-10-01T14:09:27.337950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:27.337959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:27.337962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:27.337968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255226286625084:7630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:27.338568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:27.338566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255226286625084:7630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:27.340213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:27.340350Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:27.340356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:27.340364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:27.340393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:27.340418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255223909759415:6714]
2025-10-01T14:09:27.340674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255226286625084:7630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:27.340809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:27.341013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:27.341035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:27.341215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:27.341246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.341250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.341251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.341251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.341252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.341253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.341253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.341254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.341254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.341255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.341256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.341256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.341257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.341257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.341260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.341265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.341267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.341269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.341271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.341274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.341275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.341277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.341279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.341281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.341283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.341285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.341287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.341289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.341294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.341298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.341301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.341304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.341306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.341309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.341311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.341314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.341316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.341319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.341321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.341324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.341328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.341334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.341336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.341339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.341341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.341344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.341349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.341352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.341354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.341360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.341362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.341365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.341367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.341370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.341372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.341374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.341393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:27.344677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:27.344716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255226286625084:7630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:27.344731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255226286625084:7630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:27.344735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255226286625084:7630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:27.344744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:27.345248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:27.345259Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:27.345260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:27.345263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:27.345268Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 803 [2:7556255223909759415:6714]
2025-10-01T14:09:27.345279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:27.345291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:27.345296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.345298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.345299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.345309Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:27.345313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:27.345320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:27.345357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.345362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.345363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.345365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:27.345367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:27.345410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:27.345415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.345421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.345430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.345445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:27.345458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286624994:2446], now have 1 active actors on pipe
2025-10-01T14:09:27.345460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625124:7630], now have 1 active actors on pipe
2025-10-01T14:09:27.345465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255223909759409:6714]
2025-10-01T14:09:27.345467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255223909759409:6714]
2025-10-01T14:09:27.345470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255223909759409:6714]
2025-10-01T14:09:27.345479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:27.345488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:27.345496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:27.345499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:27.345499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:27.345500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:27.345501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:27.345519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255223909759409:6714]
2025-10-01T14:09:27.345525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:27.345527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:27.345536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 803
2025-10-01T14:09:27.345539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 803
2025-10-01T14:09:27.345573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.345580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.345598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5cc631e-7de7be41-adb0125f-7011e515_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:27.345606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.345608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.345610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:27.345615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.345622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:27.345630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.345784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.345789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.345800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.345884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 804 partition: 0 MaxSeqNo: 45 sessionId: src_id|f5cc631e-7de7be41-adb0125f-7011e515_0
2025-10-01T14:09:27.346188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5418fd19-ea9bd99f-90d8cc8b-ab6ad7a1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f5cc631e-7de7be41-adb0125f-7011e515_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:27.348594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cc631e-7de7be41-adb0125f-7011e515_0] Write session: try to update token
2025-10-01T14:09:27.348608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cc631e-7de7be41-adb0125f-7011e515_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:27.355836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:27.355851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:27.355858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255223909759409:6714]
2025-10-01T14:09:27.355895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:27.355902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:27.356046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:27.356173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:27.356292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:27.356415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:27.356597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:27.356625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:27.362030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 804 sessionId: src_id|f5cc631e-7de7be41-adb0125f-7011e515_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:27.364814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:27.365052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.365068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.365097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:27.365180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:27.373264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:27.373278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:27.373280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:27.373281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:27.373288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255223909759409:6714]
2025-10-01T14:09:27.373291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255223909759409:6714]
2025-10-01T14:09:27.373294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255223909759409:6714]
2025-10-01T14:09:27.373328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:27.373333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.373334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:27.373335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:27.373340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:27.373342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:27.373443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:27.428678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255226286625132:7609]
2025-10-01T14:09:27.428988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 803, pipe: [1:7556255226286625132:7609]
2025-10-01T14:09:27.504879Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:27.512010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.512037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.512207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.512271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.512333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.512393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.512439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.512451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.512520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.512579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.512639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.512699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.512742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.512759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.512819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.512876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.512934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.512992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.513034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.513042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.513099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.513153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.513205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.513261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.513302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.513309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.513365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.513418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.513474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.513531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.513577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.513586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.513645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.513696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.513751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.513803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.513850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.513857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.513915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.513972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.514033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.514090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.514132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.514139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.514194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.514250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.514301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.514356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.514411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.514417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.514473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.514522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.514573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.514626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.514666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.514675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.514731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.514784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.514837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.514891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.514930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.514936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.514984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625132:7609], now have 1 active actors on pipe
2025-10-01T14:09:27.515239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255226286625132:7609]
2025-10-01T14:09:27.515291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:27.515295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:27.515325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 804 reason: error at write: Disconnected sessionId: src_id|f5cc631e-7de7be41-adb0125f-7011e515_0
2025-10-01T14:09:27.515493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 804 sessionId: src_id|f5cc631e-7de7be41-adb0125f-7011e515_0 is DEAD
2025-10-01T14:09:27.515515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:27.515663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cc631e-7de7be41-adb0125f-7011e515_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:27.515674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cc631e-7de7be41-adb0125f-7011e515_0] Write session will restart in 0.005355s
2025-10-01T14:09:27.515700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cc631e-7de7be41-adb0125f-7011e515_0] Write session: Do CDS request
2025-10-01T14:09:27.515705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cc631e-7de7be41-adb0125f-7011e515_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:27.516012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:27.521909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cc631e-7de7be41-adb0125f-7011e515_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.522013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:27.522027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 805
2025-10-01T14:09:27.522174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.522209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:27.522218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:27.522222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:27.522684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 805 sessionId:  describe result for acl check
2025-10-01T14:09:27.522718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:27.522722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:27.522723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:27.522729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255226286625150:7634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:27.523271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255226286625150:7634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:27.526146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255226286625150:7634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:27.528575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:27.529062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255226286625150:7634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:27.529072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255226286625150:7634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:27.529075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255226286625150:7634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:27.529080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:27.530761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:27.530988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:27.530999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:27.531011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:27.531074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:27.531117Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255223909759591:6728]
2025-10-01T14:09:27.531708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:27.532030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:27.532083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:27.532393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:27.532470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.532477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.532479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.532480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.532482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.532483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.532485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.532486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.532488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.532489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.532490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.532492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.532493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.532494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.532500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.532510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.532514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.532518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.532520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.532523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.532525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.532527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.532529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.532531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.532533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.532535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.532537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.532539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.532545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.532550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.532556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.532562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.532566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.532572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.532576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.532587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.532593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.532603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.532608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.532618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.532623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.532633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.532637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.532643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.532653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.532659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.532670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.532675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.532685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.532692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.532702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.532706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.532716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.532721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.532731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.532736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.532792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:27.536456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:27.537321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:27.537332Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:27.537334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:27.537337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:27.537341Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 804 [2:7556255223909759591:6728]
2025-10-01T14:09:27.537352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:27.537364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:27.537366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.537368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.537370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.537380Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:27.537389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:27.537393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:27.537437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.537449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.537451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.537454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:27.537456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:27.537520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:27.537529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.537539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.537545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.537559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:27.537577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625137:2446], now have 1 active actors on pipe
2025-10-01T14:09:27.537585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625262:7634], now have 1 active actors on pipe
2025-10-01T14:09:27.537590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255223909759585:6728]
2025-10-01T14:09:27.537592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255223909759585:6728]
2025-10-01T14:09:27.537593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255223909759585:6728]
2025-10-01T14:09:27.537603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:27.537616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:27.537617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:27.537619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:27.537621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:27.537629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:27.537631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:27.537651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255223909759585:6728]
2025-10-01T14:09:27.537661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:27.537667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 804
2025-10-01T14:09:27.537671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 804
2025-10-01T14:09:27.537688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:27.537738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.537747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.537766Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c69e72dd-436aa265-602ed156-4555a628_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:27.537776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.537782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.537784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:27.537790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.537799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:27.537811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.537935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.537942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.537950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.538010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 805 partition: 0 MaxSeqNo: 45 sessionId: src_id|c69e72dd-436aa265-602ed156-4555a628_0
2025-10-01T14:09:27.538341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5cc631e-7de7be41-adb0125f-7011e515_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c69e72dd-436aa265-602ed156-4555a628_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:27.540618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c69e72dd-436aa265-602ed156-4555a628_0] Write session: try to update token
2025-10-01T14:09:27.540636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c69e72dd-436aa265-602ed156-4555a628_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:27.547949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:27.547967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:27.547979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255223909759585:6728]
2025-10-01T14:09:27.548020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:27.548029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:27.548197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:27.548352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:27.548500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:27.548645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:27.548859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:27.548900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:27.553703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 805 sessionId: src_id|c69e72dd-436aa265-602ed156-4555a628_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:27.556370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:27.556570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.556594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.556623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:27.556699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:27.567904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:27.567928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:27.567932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:27.567934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:27.567946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255223909759585:6728]
2025-10-01T14:09:27.567950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255223909759585:6728]
2025-10-01T14:09:27.567956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255223909759585:6728]
2025-10-01T14:09:27.568006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:27.568013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.568014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:27.568025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:27.568028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:27.568033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:27.568179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:27.615542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255226286625285:7609]
2025-10-01T14:09:27.615857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 804, pipe: [1:7556255226286625285:7609]
2025-10-01T14:09:27.703490Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:27.710352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.710391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.710536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.710592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.710651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.710708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.710769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.710780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.710836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.710893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.710946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.711000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.711043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.711050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.711114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.711168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.711225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.711282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.711321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.711327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.711385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.711443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.711499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.711556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.711598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.711605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.711669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.711736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.711796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.711857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.711899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.711905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.711963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.712016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.712070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.712128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.712176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.712183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.712243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.712293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.712348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.712405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.712444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.712450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.712506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.712559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.712614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.712676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.712722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.712729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.712796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.712847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.712903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.712960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.713003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.713013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.713075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.713140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.713211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.713274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.713312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.713319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.713359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625285:7609], now have 1 active actors on pipe
2025-10-01T14:09:27.713644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255226286625285:7609]
2025-10-01T14:09:27.713670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:27.713674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:27.713678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:27.713707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 805 reason: error at write: Disconnected sessionId: src_id|c69e72dd-436aa265-602ed156-4555a628_0
2025-10-01T14:09:27.713937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 805 sessionId: src_id|c69e72dd-436aa265-602ed156-4555a628_0 is DEAD
2025-10-01T14:09:27.714053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69e72dd-436aa265-602ed156-4555a628_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:27.714058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69e72dd-436aa265-602ed156-4555a628_0] Write session will restart in 0.005978s
2025-10-01T14:09:27.714078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69e72dd-436aa265-602ed156-4555a628_0] Write session: Do CDS request
2025-10-01T14:09:27.714083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69e72dd-436aa265-602ed156-4555a628_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:27.714316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:27.720990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c69e72dd-436aa265-602ed156-4555a628_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.721069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:27.721088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 806
2025-10-01T14:09:27.721256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.721289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:27.721294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:27.721299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:27.721733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 806 sessionId:  describe result for acl check
2025-10-01T14:09:27.721771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:27.722314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:27.722323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:27.722329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255226286625304:7640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:27.722921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255226286625304:7640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:27.726107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255226286625304:7640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:27.727194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:27.729629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:27.729814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:27.729826Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:27.729835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:27.729878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:27.729917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255223909759723:6730]
2025-10-01T14:09:27.729989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255226286625304:7640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:27.730005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255226286625304:7640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:27.730009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255226286625304:7640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:27.730017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:27.730386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:27.730653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:27.730683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:27.730947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:27.730999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.731007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.731008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.731009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.731010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.731011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.731012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.731013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.731014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.731015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.731016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.731018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.731019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.731020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.731026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.731035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.731039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.731043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.731047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.731050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.731054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.731057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.731060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.731064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.731066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.731069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.731073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.731077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.731084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.731091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.731097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.731103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.731107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.731112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.731116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.731121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.731125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.731130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.731135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.731140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.731144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.731149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.731154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.731158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.731162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.731167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.731170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.731175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.731180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.731184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.731188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.731194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.731198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.731203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.731207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.731214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.731255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:27.734969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:27.735590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:27.735608Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:27.735611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:27.735614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:27.735621Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 805 [2:7556255223909759723:6730]
2025-10-01T14:09:27.735637Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:27.735652Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:27.735661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.735664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.735666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.735681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:27.735694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:27.735700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:27.735754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.735756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.735758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.735761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:27.735764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:27.735831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:27.735841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.735853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.735865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.735878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:27.735894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625419:7640], now have 1 active actors on pipe
2025-10-01T14:09:27.735907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255223909759718:6730]
2025-10-01T14:09:27.735909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255223909759718:6730]
2025-10-01T14:09:27.735912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255223909759718:6730]
2025-10-01T14:09:27.735926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:27.735936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625290:2446], now have 1 active actors on pipe
2025-10-01T14:09:27.735943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:27.735949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:27.735951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:27.735953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:27.735953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:27.735958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:27.735974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255223909759718:6730]
2025-10-01T14:09:27.735982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:27.735984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:27.736023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 805
2025-10-01T14:09:27.736031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 805
2025-10-01T14:09:27.736136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.736150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.736176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:27.736183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.736188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.736190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:27.736199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.736208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:27.736226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.736413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.736429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.736459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.736544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 806 partition: 0 MaxSeqNo: 45 sessionId: src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0
2025-10-01T14:09:27.736974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c69e72dd-436aa265-602ed156-4555a628_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:27.739324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0] Write session: try to update token
2025-10-01T14:09:27.739340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:27.746752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:27.746771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:27.746782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255223909759718:6730]
2025-10-01T14:09:27.746829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:27.746852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:27.747017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:27.747173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:27.747320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:27.747467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:27.747681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:27.747720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:27.753730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 806 sessionId: src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:27.756501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:27.756801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.756823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.756871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:27.756978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:27.765249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:27.765262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:27.765265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:27.765267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:27.765278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255223909759718:6730]
2025-10-01T14:09:27.765282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255223909759718:6730]
2025-10-01T14:09:27.765290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255223909759718:6730]
2025-10-01T14:09:27.765339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:27.765350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.765348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:27.765353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:27.765355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:27.765358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:27.765486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:27.813688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255226286625431:7609]
2025-10-01T14:09:27.813962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 805, pipe: [1:7556255226286625431:7609]
2025-10-01T14:09:27.908829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:27.916536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.916565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.916732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.916811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.916876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.916936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.916983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.916995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.917059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.917121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.917185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.917248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.917407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.917417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.917488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.917559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.917622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.917680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.917719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.917724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.917792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.917852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.917911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.917970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.918011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.918017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.918080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.918147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.918204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.918263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.918301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.918306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.918366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.918433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.918494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.918550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.918590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.918597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.918657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.918711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.918769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.918827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.918868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.918874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.918930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.918982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.919037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.919092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.919133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.919138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.919207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.919265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.919321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.919380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.919420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.919425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.919485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:27.919558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:27.919634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:27.919702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:27.919746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:27.919752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:27.919812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625431:7609], now have 1 active actors on pipe
2025-10-01T14:09:27.920136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:27.920155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:27.920169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255226286625431:7609]
2025-10-01T14:09:27.920186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 806 reason: error at write: Disconnected sessionId: src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0
2025-10-01T14:09:27.920209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:27.920370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 806 sessionId: src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0 is DEAD
2025-10-01T14:09:27.920495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:27.920508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0] Write session will restart in 0.005009s
2025-10-01T14:09:27.920538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0] Write session: Do CDS request
2025-10-01T14:09:27.920546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:27.920840Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:27.926871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.926917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:27.926932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 807
2025-10-01T14:09:27.927182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:27.927215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:27.927225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:27.927229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:27.927659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 807 sessionId:  describe result for acl check
2025-10-01T14:09:27.927689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:27.927691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:27.927693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:27.927698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255226286625446:7644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:27.928225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255226286625446:7644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:27.931008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255226286625446:7644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:27.933174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:27.933530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255226286625446:7644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:27.933546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255226286625446:7644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:27.933550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255226286625446:7644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:27.933573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:27.935474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:27.935647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:27.935657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:27.935668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:27.935712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:27.935749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255223909759860:6733]
2025-10-01T14:09:27.936291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:27.936565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:27.936595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:27.936807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:27.936844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.936849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.936850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.936850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.936851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.936852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.936853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.936854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.936854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.936855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.936856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.936857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.936857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.936858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.936861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.936867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.936869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.936872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.936876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.936880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.936884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.936888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.936891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.936895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.936899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.936903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.936906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.936907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.936913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.936917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:27.936921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.936925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:27.936927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.936930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:27.936934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.936937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:27.936940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.936943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:27.936945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.936948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:27.936951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.936954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:27.936956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.936961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:27.936966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.936971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:27.936975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.936979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.936984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.936989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.936993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.936998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.937000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.937003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:27.937006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.937008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:27.937029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:27.940689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:27.941268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:27.941280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:27.941282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:27.941285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:27.941292Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 806 [2:7556255223909759860:6733]
2025-10-01T14:09:27.941302Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:27.941314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:27.941322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.941325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.941327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.941341Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:27.941346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:27.941352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:27.941399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.941407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.941410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.941412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:27.941415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:27.941477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:27.941484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.941494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:27.941506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:27.941525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:27.941544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625563:7644], now have 1 active actors on pipe
2025-10-01T14:09:27.941551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255226286625433:2446], now have 1 active actors on pipe
2025-10-01T14:09:27.941557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255223909759854:6733]
2025-10-01T14:09:27.941562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255223909759854:6733]
2025-10-01T14:09:27.941564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255223909759854:6733]
2025-10-01T14:09:27.941576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:27.941587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:27.941591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:27.941594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:27.941595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:27.941604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:27.941607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:27.941584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 806
2025-10-01T14:09:27.941590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 806
2025-10-01T14:09:27.941625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255223909759854:6733]
2025-10-01T14:09:27.941632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:27.941633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:27.941660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.941668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.941691Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:27.941699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:27.941701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:27.941703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:27.941709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:27.941714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:27.941729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.941890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:27.941897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:27.941908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:27.942030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 807 partition: 0 MaxSeqNo: 45 sessionId: src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0
2025-10-01T14:09:27.942332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a58ef67d-9dc35fb-49713e5a-f7d21a50_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:27.945201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0] Write session: try to update token
2025-10-01T14:09:27.945218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:27.961064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 807 sessionId: src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:27.962515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:27.962531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:27.962534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:27.962536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:27.962545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255223909759854:6733]
2025-10-01T14:09:27.962548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255223909759854:6733]
2025-10-01T14:09:27.962551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255223909759854:6733]
2025-10-01T14:09:27.962606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:27.962605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:27.962612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:27.962615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:27.962617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:27.962620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:27.962748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:27.963706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:28.020541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255230581592871:7609]
2025-10-01T14:09:28.020853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 806, pipe: [1:7556255230581592871:7609]
2025-10-01T14:09:28.103402Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:28.103685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.103698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.103733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581592871:7609], now have 1 active actors on pipe
2025-10-01T14:09:28.103951Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:28.104071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255230581592871:7609]
2025-10-01T14:09:28.104071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:28.104105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:28.104158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 807 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0
2025-10-01T14:09:28.104313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 807 sessionId: src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0 is DEAD
2025-10-01T14:09:28.104447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:28.104456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0] Write session will restart in 0.008773s
2025-10-01T14:09:28.104480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0] Write session: Do CDS request
2025-10-01T14:09:28.104486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:28.114719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:28.114919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.115025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:28.115038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 808
2025-10-01T14:09:28.115177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.115202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:28.115206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:28.115209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:28.115607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 808 sessionId:  describe result for acl check
2025-10-01T14:09:28.115639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:28.115645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:28.115647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:28.115652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255230581592969:7648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:28.116172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255230581592969:7648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:28.117244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:28.117406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:28.117414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:28.117422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:28.117457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:28.117485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255228204727290:6735]
2025-10-01T14:09:28.117900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:28.118099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:28.118127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:28.118188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255230581592969:7648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:28.118336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:28.118401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.118409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.118411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.118412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.118413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.118414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.118415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.118416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.118417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.118418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.118419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.118420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.118421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.118422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.118427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.118434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.118435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.118438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.118440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.118442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.118444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.118446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.118448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.118450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.118452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.118453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.118455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.118457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.118462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.118466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.118470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.118473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.118477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.118480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.118483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.118486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.118488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.118491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.118494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.118496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.118499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.118502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.118504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.118507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.118510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.118512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.118515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.118518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.118520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.118523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.118525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.118528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.118530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.118533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.118536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.118538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.118558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:28.121987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255230581592969:7648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:28.122002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255230581592969:7648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:28.122004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255230581592969:7648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:28.122011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:28.122226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:28.122796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:28.122808Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:28.122811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:28.122813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:28.122819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 807 [2:7556255228204727290:6735]
2025-10-01T14:09:28.122833Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:28.122848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:28.122854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.122857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.122860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.122876Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:28.122884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:28.122893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:28.122944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.122950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.122952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.122956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:28.122958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:28.123019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:28.123025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.123036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.123050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.123069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:28.123089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593009:7648], now have 1 active actors on pipe
2025-10-01T14:09:28.123097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581592873:2446], now have 1 active actors on pipe
2025-10-01T14:09:28.123102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255228204727284:6735]
2025-10-01T14:09:28.123104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255228204727284:6735]
2025-10-01T14:09:28.123106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255228204727284:6735]
2025-10-01T14:09:28.123117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:28.123126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:28.123132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:28.123134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:28.123134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:28.123147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:28.123153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:28.123141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 807
2025-10-01T14:09:28.123147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 807
2025-10-01T14:09:28.123173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255228204727284:6735]
2025-10-01T14:09:28.123180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:28.123182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:28.123195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.123203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.123243Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d26759a-44441da9-cee8128-f6069704_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:28.123252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.123255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.123259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:28.123265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.123274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:28.123295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.123406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.123414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.123427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.123490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 808 partition: 0 MaxSeqNo: 45 sessionId: src_id|1d26759a-44441da9-cee8128-f6069704_0
2025-10-01T14:09:28.123809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a8972b-b5b0e26c-eb2444ad-1dc7d4da_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1d26759a-44441da9-cee8128-f6069704_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:28.126262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d26759a-44441da9-cee8128-f6069704_0] Write session: try to update token
2025-10-01T14:09:28.126274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d26759a-44441da9-cee8128-f6069704_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:28.138400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 808 sessionId: src_id|1d26759a-44441da9-cee8128-f6069704_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:28.140524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:28.140734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.140763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.140793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:28.140862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:28.143516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:28.143531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:28.143532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:28.143534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:28.143541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255228204727284:6735]
2025-10-01T14:09:28.143544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255228204727284:6735]
2025-10-01T14:09:28.143547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255228204727284:6735]
2025-10-01T14:09:28.143584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:28.143593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.143597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:28.143597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:28.143601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:28.143604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:28.143716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:28.204330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255230581593029:7609]
2025-10-01T14:09:28.204580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 807, pipe: [1:7556255230581593029:7609]
2025-10-01T14:09:28.278778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:28.285598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.285620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.285765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.285817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.285875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.285930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.285974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.285981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.286040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.286092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.286151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.286217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.286258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.286266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.286324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.286397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.286457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.286514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.286552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.286557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.286613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.286666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.286723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.286780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.286823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.286829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.286882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.286932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.286983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.287033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.287072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.287078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.287131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.287179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.287237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.287300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.287339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.287344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.287398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.287447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.287498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.287557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.287601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.287605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.287661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.287710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.287760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.287821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.287864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.287869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.287926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.287980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.288033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.288087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.288139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.288145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.288206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.288260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.288322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.288379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.288419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.288424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.288464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593029:7609], now have 1 active actors on pipe
2025-10-01T14:09:28.288628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:28.288641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:28.288649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:28.288666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 808 reason: error at write: Disconnected sessionId: src_id|1d26759a-44441da9-cee8128-f6069704_0
2025-10-01T14:09:28.288711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255230581593029:7609]
2025-10-01T14:09:28.288835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 808 sessionId: src_id|1d26759a-44441da9-cee8128-f6069704_0 is DEAD
2025-10-01T14:09:28.288928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d26759a-44441da9-cee8128-f6069704_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:28.288935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d26759a-44441da9-cee8128-f6069704_0] Write session will restart in 0.006945s
2025-10-01T14:09:28.288954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d26759a-44441da9-cee8128-f6069704_0] Write session: Do CDS request
2025-10-01T14:09:28.288958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d26759a-44441da9-cee8128-f6069704_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:28.289305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:28.296960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d26759a-44441da9-cee8128-f6069704_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.297061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:28.297074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 809
2025-10-01T14:09:28.297199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.297226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:28.297246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:28.297253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:28.297597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 809 sessionId:  describe result for acl check
2025-10-01T14:09:28.297624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:28.297629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:28.297631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:28.297634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255230581593067:7660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:28.298047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255230581593067:7660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:28.300154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255230581593067:7660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:28.301246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:28.303480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:28.303651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:28.303664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:28.303674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:28.303724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:28.303768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255228204727434:6739]
2025-10-01T14:09:28.303855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255230581593067:7660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:28.303867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255230581593067:7660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:28.303871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255230581593067:7660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:28.303877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:28.304361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:28.304640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:28.304690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:28.305005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:28.305074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.305082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.305083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.305084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.305086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.305087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.305088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.305089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.305090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.305091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.305092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.305093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.305093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.305094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.305100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.305109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.305112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.305116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.305119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.305123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.305126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.305129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.305132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.305136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.305139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.305143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.305146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.305149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.305157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.305164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.305170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.305175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.305179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.305182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.305185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.305189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.305194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.305198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.305202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.305207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.305218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.305222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.305232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.305237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.305247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.305252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.305262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.305268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.305278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.305283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.305287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.305293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.305296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.305303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.305307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.305310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.305332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:28.308841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:28.309531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:28.309551Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:28.309554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:28.309558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:28.309566Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 808 [2:7556255228204727434:6739]
2025-10-01T14:09:28.309582Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:28.309604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:28.309611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.309614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.309616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.309631Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:28.309641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:28.309654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:28.309709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.309716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.309719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.309722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:28.309724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:28.309794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:28.309802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.309812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.309827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.309846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:28.309868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593180:7660], now have 1 active actors on pipe
2025-10-01T14:09:28.309876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593048:2446], now have 1 active actors on pipe
2025-10-01T14:09:28.309882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255228204727429:6739]
2025-10-01T14:09:28.309884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255228204727429:6739]
2025-10-01T14:09:28.309886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255228204727429:6739]
2025-10-01T14:09:28.309895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:28.309876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 808
2025-10-01T14:09:28.309908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:28.309912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:28.309916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:28.309888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 808
2025-10-01T14:09:28.309918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:28.309925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:28.309928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:28.309948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.309957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.309994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255228204727429:6739]
2025-10-01T14:09:28.310007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:28.310013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:28.310023Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6547621d-6090c308-67b40332-6159838d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:28.310033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.310038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.310041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:28.310050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.310059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:28.310097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.310212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.310221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.310235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.310323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 809 partition: 0 MaxSeqNo: 45 sessionId: src_id|6547621d-6090c308-67b40332-6159838d_0
2025-10-01T14:09:28.310645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d26759a-44441da9-cee8128-f6069704_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6547621d-6090c308-67b40332-6159838d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:28.313364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6547621d-6090c308-67b40332-6159838d_0] Write session: try to update token
2025-10-01T14:09:28.313378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6547621d-6090c308-67b40332-6159838d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:28.327579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 809 sessionId: src_id|6547621d-6090c308-67b40332-6159838d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:28.329969Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:28.329987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:28.329988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:28.329990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:28.329997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255228204727429:6739]
2025-10-01T14:09:28.330000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255228204727429:6739]
2025-10-01T14:09:28.330003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255228204727429:6739]
2025-10-01T14:09:28.330042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:28.330047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.330049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:28.330054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:28.330079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:28.330084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:28.330169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:28.330343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:28.388641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255230581593194:7609]
2025-10-01T14:09:28.388907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 808, pipe: [1:7556255230581593194:7609]
2025-10-01T14:09:28.472043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:28.472356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.472374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.472414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593194:7609], now have 1 active actors on pipe
2025-10-01T14:09:28.472626Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:28.472595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:28.472596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:28.472599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:28.472642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255230581593194:7609]
2025-10-01T14:09:28.472659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 809 reason: error at write: Disconnected sessionId: src_id|6547621d-6090c308-67b40332-6159838d_0
2025-10-01T14:09:28.472834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 809 sessionId: src_id|6547621d-6090c308-67b40332-6159838d_0 is DEAD
2025-10-01T14:09:28.472961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6547621d-6090c308-67b40332-6159838d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:28.472970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6547621d-6090c308-67b40332-6159838d_0] Write session will restart in 0.005249s
2025-10-01T14:09:28.472990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6547621d-6090c308-67b40332-6159838d_0] Write session: Do CDS request
2025-10-01T14:09:28.472995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6547621d-6090c308-67b40332-6159838d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:28.478769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6547621d-6090c308-67b40332-6159838d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.478928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:28.478940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 810
2025-10-01T14:09:28.479091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.479133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:28.479143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:28.479148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:28.479431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 810 sessionId:  describe result for acl check
2025-10-01T14:09:28.479455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:28.479457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:28.479458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:28.479461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255230581593213:7664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:28.479886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255230581593213:7664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:28.482067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255230581593213:7664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:28.483073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:28.484952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:28.485128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:28.485139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:28.485150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:28.485196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:28.485236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255228204727586:6743]
2025-10-01T14:09:28.485311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255230581593213:7664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:28.485330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255230581593213:7664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:28.485334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255230581593213:7664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:28.485340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:28.485813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:28.486073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:28.486113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:28.486424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:28.486477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.486482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.486483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.486484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.486485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.486487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.486488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.486489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.486490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.486491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.486492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.486493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.486494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.486495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.486500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.486509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.486512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.486516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.486524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.486528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.486535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.486539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.486542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.486546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.486550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.486553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.486556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.486560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.486570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.486580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.486590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.486599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.486606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.486611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.486618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.486623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.486631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.486639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.486643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.486651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.486659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.486667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.486674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.486680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.486687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.486691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.486700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.486705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.486712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.486717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.486724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.486728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.486735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.486739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.486746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.486750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.486789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:28.490465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:28.491129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:28.491141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:28.491143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:28.491146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:28.491151Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 809 [2:7556255228204727586:6743]
2025-10-01T14:09:28.491165Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:28.491177Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:28.491185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.491187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.491188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.491198Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:28.491202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:28.491206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:28.491244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.491249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.491250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.491252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:28.491254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:28.491303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:28.491311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.491322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.491331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.491345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:28.491361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593197:2446], now have 1 active actors on pipe
2025-10-01T14:09:28.491369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593329:7664], now have 1 active actors on pipe
2025-10-01T14:09:28.491376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255228204727580:6743]
2025-10-01T14:09:28.491378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255228204727580:6743]
2025-10-01T14:09:28.491380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255228204727580:6743]
2025-10-01T14:09:28.491392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:28.491404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:28.491412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 809
2025-10-01T14:09:28.491409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:28.491413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 809
2025-10-01T14:09:28.491414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:28.491416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:28.491421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:28.491423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:28.491450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255228204727580:6743]
2025-10-01T14:09:28.491455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:28.491457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:28.491477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.491482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.491503Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|413e727f-9785bce0-34b596a9-59141a48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:28.491515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.491519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.491521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:28.491529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.491537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:28.491553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.491665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.491670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.491682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.491762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 810 partition: 0 MaxSeqNo: 45 sessionId: src_id|413e727f-9785bce0-34b596a9-59141a48_0
2025-10-01T14:09:28.492101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6547621d-6090c308-67b40332-6159838d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|413e727f-9785bce0-34b596a9-59141a48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:28.494617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|413e727f-9785bce0-34b596a9-59141a48_0] Write session: try to update token
2025-10-01T14:09:28.494634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|413e727f-9785bce0-34b596a9-59141a48_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:28.507556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 810 sessionId: src_id|413e727f-9785bce0-34b596a9-59141a48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:28.509775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:28.509936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.509953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.509981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:28.510050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:28.512930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:28.512947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:28.512950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:28.512952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:28.512959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255228204727580:6743]
2025-10-01T14:09:28.512964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255228204727580:6743]
2025-10-01T14:09:28.512968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255228204727580:6743]
2025-10-01T14:09:28.512997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:28.513005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:28.513008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:28.513012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:28.513018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.513020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:28.513144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:28.572989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255230581593352:7609]
2025-10-01T14:09:28.573292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 809, pipe: [1:7556255230581593352:7609]
2025-10-01T14:09:28.651483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:28.659006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.659036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.659202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.659263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.659324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.659385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.659523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.659536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.659606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.659663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.659719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.659779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.659819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.659829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.659885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.659940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.659995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.660051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.660092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.660100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.660156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.660566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.660623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.660683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.660721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.660728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.660812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.660866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.660919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.660980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.661021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.661031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.661090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.661147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.661205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.661263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.661307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.661314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.661373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.661426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.661486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.661543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.661583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.661589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.661646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.661703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.661759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.661816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.661857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.661864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.661926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.661989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.662047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.662110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.662157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.662163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.662224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:28.662279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:28.662339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:28.662411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:28.662457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:28.662463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:28.662523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593352:7609], now have 1 active actors on pipe
2025-10-01T14:09:28.662700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:28.662714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255230581593352:7609]
2025-10-01T14:09:28.662738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:28.662740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:28.662764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 810 reason: error at write: Disconnected sessionId: src_id|413e727f-9785bce0-34b596a9-59141a48_0
2025-10-01T14:09:28.663059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413e727f-9785bce0-34b596a9-59141a48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:28.663066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413e727f-9785bce0-34b596a9-59141a48_0] Write session will restart in 0.007413s
2025-10-01T14:09:28.663092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413e727f-9785bce0-34b596a9-59141a48_0] Write session: Do CDS request
2025-10-01T14:09:28.663098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413e727f-9785bce0-34b596a9-59141a48_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:28.663089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 810 sessionId: src_id|413e727f-9785bce0-34b596a9-59141a48_0 is DEAD
2025-10-01T14:09:28.663120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:28.671856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|413e727f-9785bce0-34b596a9-59141a48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.671946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:28.671960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 811
2025-10-01T14:09:28.672090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.672122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:28.672132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:28.672135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:28.672551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 811 sessionId:  describe result for acl check
2025-10-01T14:09:28.672597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:28.672602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:28.672604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:28.672610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255230581593451:7669] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:28.673134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255230581593451:7669] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:28.673276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:28.675067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255230581593451:7669] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:28.675312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:28.675492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:28.675499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:28.675508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:28.675553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:28.675580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255228204727754:6755]
2025-10-01T14:09:28.676069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:28.676271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:28.676302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:28.676541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:28.676575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.676579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.676580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.676581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.676581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.676582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.676583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.676583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.676584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.676584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.676585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.676586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.676586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.676587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.676590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.676595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.676597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.676599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.676601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.676603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.676605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.676607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.676609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.676612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.676614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.676616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.676617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.676619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.676624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.676630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.676636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.676641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.676645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.676650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.676654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.676658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.676661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.676664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.676666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.676668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.676671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.676674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.676676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.676679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.676682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.676685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.676688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.676690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.676693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.676696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.676699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.676701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.676704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.676707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.676709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.676712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.676741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:28.677434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255230581593451:7669] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:28.677448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255230581593451:7669] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:28.677451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255230581593451:7669] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:28.677459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:28.680537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:28.681408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:28.681420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:28.681422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:28.681424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:28.681429Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 810 [2:7556255228204727754:6755]
2025-10-01T14:09:28.681439Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:28.681450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:28.681456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.681458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.681459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.681471Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:28.681474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:28.681478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:28.681520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.681526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.681528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.681531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:28.681534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:28.681583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:28.681589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.681599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.681608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.681624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:28.681639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593493:7669], now have 1 active actors on pipe
2025-10-01T14:09:28.681645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593355:2446], now have 1 active actors on pipe
2025-10-01T14:09:28.681651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255228204727748:6755]
2025-10-01T14:09:28.681652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255228204727748:6755]
2025-10-01T14:09:28.681653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255228204727748:6755]
2025-10-01T14:09:28.681662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:28.681671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:28.681673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:28.681674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:28.681674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:28.681682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:28.681688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:28.681708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255228204727748:6755]
2025-10-01T14:09:28.681716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:28.681719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:28.681710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 810
2025-10-01T14:09:28.681715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 810
2025-10-01T14:09:28.681781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.681787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.681808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:28.681814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.681822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.681825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:28.681833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.681844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:28.681859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.681998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.682007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.682016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.682098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 811 partition: 0 MaxSeqNo: 45 sessionId: src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0
2025-10-01T14:09:28.682468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|413e727f-9785bce0-34b596a9-59141a48_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:28.685343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0] Write session: try to update token
2025-10-01T14:09:28.685359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:28.700139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 811 sessionId: src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:28.702024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:28.702042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:28.702044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:28.702045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:28.702054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255228204727748:6755]
2025-10-01T14:09:28.702057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255228204727748:6755]
2025-10-01T14:09:28.702060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255228204727748:6755]
2025-10-01T14:09:28.702106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:28.702112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.702112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:28.702114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:28.702116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:28.702119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:28.702242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:28.702631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:28.762924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255230581593502:7609]
2025-10-01T14:09:28.763187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 810, pipe: [1:7556255230581593502:7609]
2025-10-01T14:09:28.837848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:28.838346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.838359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.838408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593502:7609], now have 1 active actors on pipe
2025-10-01T14:09:28.838568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:28.838627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:28.838631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:28.838642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:28.838677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255230581593502:7609]
2025-10-01T14:09:28.838697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 811 reason: error at write: Disconnected sessionId: src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0
2025-10-01T14:09:28.838876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 811 sessionId: src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0 is DEAD
2025-10-01T14:09:28.838994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:28.839000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0] Write session will restart in 0.005076s
2025-10-01T14:09:28.839018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0] Write session: Do CDS request
2025-10-01T14:09:28.839023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:28.844915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.845099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:28.845119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 812
2025-10-01T14:09:28.845295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:28.845332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:28.845340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:28.845343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:28.845685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 812 sessionId:  describe result for acl check
2025-10-01T14:09:28.845720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:28.845722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:28.845723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:28.845727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255230581593554:7674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:28.846205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255230581593554:7674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:28.847885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:28.847984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255230581593554:7674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:28.849756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:28.849896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:28.849905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:28.849915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:28.849956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:28.849991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255228204727894:6758]
2025-10-01T14:09:28.850090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255230581593554:7674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:28.850101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255230581593554:7674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:28.850103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255230581593554:7674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:28.850108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:28.850401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:28.850616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:28.850655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:28.850930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:28.850976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.850980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.850982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.850983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.850984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.850985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.850986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.850987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.850988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.850989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.850990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.850992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.850992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.850993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.850998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.851009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.851013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.851017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.851021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.851025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.851029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.851032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.851035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.851039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.851043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.851047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.851051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.851054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.851060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.851071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:28.851079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.851089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:28.851096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.851102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:28.851109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.851115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:28.851122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.851128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:28.851135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.851139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:28.851145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.851150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:28.851158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.851162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:28.851170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.851175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:28.851183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.851188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.851195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.851200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.851207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.851211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.851219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.851224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:28.851230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.851235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:28.851275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:28.855013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:28.855616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:28.855630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:28.855633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:28.855636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:28.855642Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 811 [2:7556255228204727894:6758]
2025-10-01T14:09:28.855658Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:28.855674Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:28.855680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.855683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.855686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.855702Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:28.855710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:28.855717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:28.855768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.855774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.855776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.855778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:28.855781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:28.855845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:28.855851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.855862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:28.855877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:28.855896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:28.855915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593504:2446], now have 1 active actors on pipe
2025-10-01T14:09:28.855922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593639:7674], now have 1 active actors on pipe
2025-10-01T14:09:28.855929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255228204727889:6758]
2025-10-01T14:09:28.855934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255228204727889:6758]
2025-10-01T14:09:28.855938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255228204727889:6758]
2025-10-01T14:09:28.855951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:28.855958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:28.855960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:28.855961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:28.855966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:28.855980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:28.855986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:28.855954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 811
2025-10-01T14:09:28.855966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 811
2025-10-01T14:09:28.856086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.856094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.856108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255228204727889:6758]
2025-10-01T14:09:28.856118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:28.856122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:28.856147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:28.856156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:28.856163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:28.856166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:28.856174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:28.856183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:28.856207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.856311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:28.856316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:28.856329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:28.856420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 812 partition: 0 MaxSeqNo: 45 sessionId: src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0
2025-10-01T14:09:28.856781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb662d2-1aa577f3-3b50ade3-87f52c0b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:28.859551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0] Write session: try to update token
2025-10-01T14:09:28.859570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:28.877791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 812 sessionId: src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:28.878788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:28.878809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:28.878812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:28.878814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:28.878823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255228204727889:6758]
2025-10-01T14:09:28.878828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255228204727889:6758]
2025-10-01T14:09:28.878832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255228204727889:6758]
2025-10-01T14:09:28.878881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:28.878892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:28.878895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:28.878894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:28.878900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:28.878911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:28.879030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:28.880245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:28.939028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255230581593651:7609]
2025-10-01T14:09:28.939272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 811, pipe: [1:7556255230581593651:7609]
2025-10-01T14:09:29.013576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:29.013939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.013951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.013983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255230581593651:7609], now have 1 active actors on pipe
2025-10-01T14:09:29.014134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:29.014177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:29.014200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:29.014232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255230581593651:7609]
2025-10-01T14:09:29.014277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 812 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0
2025-10-01T14:09:29.014471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 812 sessionId: src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0 is DEAD
2025-10-01T14:09:29.014639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:29.014653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0] Write session will restart in 0.007592s
2025-10-01T14:09:29.014680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0] Write session: Do CDS request
2025-10-01T14:09:29.014687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:29.023841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.023956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:29.023967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 813
2025-10-01T14:09:29.024104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.024126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:29.024133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:29.024136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:29.024526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 813 sessionId:  describe result for acl check
2025-10-01T14:09:29.024562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:29.024569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:29.024570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:29.024575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255234876561040:7678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:29.025126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255234876561040:7678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:29.026095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:29.026884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255234876561040:7678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:29.028910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:29.029068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:29.029077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:29.029096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:29.029144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:29.029183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255232499695331:6760]
2025-10-01T14:09:29.029328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255234876561040:7678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:29.029341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255234876561040:7678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:29.029344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255234876561040:7678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:29.029351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:29.029664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:29.029916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:29.029945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:29.030167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:29.030205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.030210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.030210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.030211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.030212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.030212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.030213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.030213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.030214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.030214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.030215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.030216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.030216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.030217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.030221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.030226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.030229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.030231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.030233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.030235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.030237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.030239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.030241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.030243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.030245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.030247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.030249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.030253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.030260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.030266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.030272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.030277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.030281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.030286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.030289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.030294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.030298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.030300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.030302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.030305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.030308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.030311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.030313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.030316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.030318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.030321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.030324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.030328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.030330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.030333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.030335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.030338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.030340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.030342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.030345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.030347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.030385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:29.034240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:29.034865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:29.034883Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:29.034885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:29.034888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:29.034894Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 812 [2:7556255232499695331:6760]
2025-10-01T14:09:29.034909Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:29.034924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:29.034931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.034935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.034937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.034952Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:29.034962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:29.034971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:29.035031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.035039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.035041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.035044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:29.035047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:29.035126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:29.035132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.035143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.035155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.035175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:29.035195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255232499695325:6760]
2025-10-01T14:09:29.035201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255232499695325:6760]
2025-10-01T14:09:29.035203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255232499695325:6760]
2025-10-01T14:09:29.035215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:29.035226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:29.035234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561086:7678], now have 1 active actors on pipe
2025-10-01T14:09:29.035237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876560950:2446], now have 1 active actors on pipe
2025-10-01T14:09:29.035239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:29.035242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:29.035245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:29.035257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:29.035261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:29.035283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255232499695325:6760]
2025-10-01T14:09:29.035296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:29.035307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:29.035334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 812
2025-10-01T14:09:29.035389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 812
2025-10-01T14:09:29.035470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.035480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.035502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:29.035512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.035518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.035519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:29.035525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.035535Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:29.035549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.035738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.035746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.035762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.035869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 813 partition: 0 MaxSeqNo: 45 sessionId: src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0
2025-10-01T14:09:29.036215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f42080-5ec4cec6-e35e1979-1f0d2d35_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:29.039131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0] Write session: try to update token
2025-10-01T14:09:29.039149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:29.057028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 813 sessionId: src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:29.057956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:29.057973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:29.057976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:29.057978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:29.057988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255232499695325:6760]
2025-10-01T14:09:29.057993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255232499695325:6760]
2025-10-01T14:09:29.057997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255232499695325:6760]
2025-10-01T14:09:29.058044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:29.058056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.058054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:29.058062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:29.058062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:29.058066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:29.058207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:29.059972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:29.114169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255234876561097:7609]
2025-10-01T14:09:29.114494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 812, pipe: [1:7556255234876561097:7609]
2025-10-01T14:09:29.198305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:29.198802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.198818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.198860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561097:7609], now have 1 active actors on pipe
2025-10-01T14:09:29.199069Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:29.199159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:29.199167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:29.199229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255234876561097:7609]
2025-10-01T14:09:29.199266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 813 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0
2025-10-01T14:09:29.199424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 813 sessionId: src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0 is DEAD
2025-10-01T14:09:29.199573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:29.199578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0] Write session will restart in 0.005819s
2025-10-01T14:09:29.199602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0] Write session: Do CDS request
2025-10-01T14:09:29.199611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:29.206846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.206966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:29.206981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 814
2025-10-01T14:09:29.207118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.207154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:29.207164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:29.207170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:29.207604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 814 sessionId:  describe result for acl check
2025-10-01T14:09:29.207643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:29.207650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:29.207652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:29.207658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255234876561132:7682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:29.208226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255234876561132:7682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:29.210644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255234876561132:7682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:29.211360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:29.213434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:29.213625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:29.213635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:29.213646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:29.213689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:29.213739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255232499695472:6762]
2025-10-01T14:09:29.213877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255234876561132:7682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:29.213891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255234876561132:7682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:29.213895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255234876561132:7682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:29.213904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:29.214242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:29.214537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:29.214586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:29.214828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:29.214883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.214888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.214889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.214890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.214890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.214891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.214892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.214893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.214893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.214894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.214896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.214897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.214898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.214899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.214905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.214914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.214918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.214922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.214925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.214929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.214931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.214932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.214935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.214937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.214939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.214940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.214943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.214944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.214950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.214962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.214965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.214969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.214972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.214975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.214977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.214980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.214982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.214985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.214987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.214990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.214993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.214996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.214998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.215001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.215005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.215008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.215010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.215013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.215017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.215020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.215022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.215025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.215027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.215030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.215032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.215035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.215056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:29.218685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:29.219266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:29.219278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:29.219280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:29.219289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:29.219299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 813 [2:7556255232499695472:6762]
2025-10-01T14:09:29.219317Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:29.219336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:29.219343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.219347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.219352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.219366Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:29.219372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:29.219376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:29.219418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.219425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.219427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.219430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:29.219433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:29.219493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:29.219499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.219506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.219511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.219519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:29.219532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561100:2446], now have 1 active actors on pipe
2025-10-01T14:09:29.219538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255232499695467:6762]
2025-10-01T14:09:29.219540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255232499695467:6762]
2025-10-01T14:09:29.219541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255232499695467:6762]
2025-10-01T14:09:29.219547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:29.219556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:29.219557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:29.219560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:29.219562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:29.219569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:29.219572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:29.219576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561237:7682], now have 1 active actors on pipe
2025-10-01T14:09:29.219603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255232499695467:6762]
2025-10-01T14:09:29.219612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:29.219620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:29.219630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 813
2025-10-01T14:09:29.219640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 813
2025-10-01T14:09:29.219671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.219679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.219700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa57f391-5385269f-687fc88b-5b719a0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:29.219707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.219711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.219712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:29.219718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.219728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:29.219745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.219900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.219910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.219923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.220012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 814 partition: 0 MaxSeqNo: 45 sessionId: src_id|aa57f391-5385269f-687fc88b-5b719a0c_0
2025-10-01T14:09:29.220347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dcf4e1e-d6130bf-10e292e-ba5e3efd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aa57f391-5385269f-687fc88b-5b719a0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:29.222973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa57f391-5385269f-687fc88b-5b719a0c_0] Write session: try to update token
2025-10-01T14:09:29.222991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa57f391-5385269f-687fc88b-5b719a0c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:29.237281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 814 sessionId: src_id|aa57f391-5385269f-687fc88b-5b719a0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:29.239787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:29.240027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.240048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.240070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:29.240073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:29.240076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:29.240078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:29.240086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255232499695467:6762]
2025-10-01T14:09:29.240093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255232499695467:6762]
2025-10-01T14:09:29.240096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255232499695467:6762]
2025-10-01T14:09:29.240152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:29.240160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:29.240164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:29.240166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.240168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:29.240169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:29.240303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:29.299466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255234876561278:7609]
2025-10-01T14:09:29.299728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 813, pipe: [1:7556255234876561278:7609]
2025-10-01T14:09:29.384634Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:29.385168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:29.385228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561278:7609], now have 1 active actors on pipe
2025-10-01T14:09:29.385340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:29.385407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:29.385444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:29.385448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:29.385453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255234876561278:7609]
2025-10-01T14:09:29.385516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 814 reason: error at write: Disconnected sessionId: src_id|aa57f391-5385269f-687fc88b-5b719a0c_0
2025-10-01T14:09:29.385688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 814 sessionId: src_id|aa57f391-5385269f-687fc88b-5b719a0c_0 is DEAD
2025-10-01T14:09:29.385793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa57f391-5385269f-687fc88b-5b719a0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:29.385801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa57f391-5385269f-687fc88b-5b719a0c_0] Write session will restart in 0.006880s
2025-10-01T14:09:29.385824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa57f391-5385269f-687fc88b-5b719a0c_0] Write session: Do CDS request
2025-10-01T14:09:29.385833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa57f391-5385269f-687fc88b-5b719a0c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:29.393883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa57f391-5385269f-687fc88b-5b719a0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.394051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:29.394070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 815
2025-10-01T14:09:29.394216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.394252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:29.394261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:29.394265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:29.394655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 815 sessionId:  describe result for acl check
2025-10-01T14:09:29.394690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:29.394691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:29.394693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:29.394696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255234876561325:7694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:29.395123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255234876561325:7694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:29.396974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255234876561325:7694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:29.397081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:29.398878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:29.399009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:29.399017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:29.399025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:29.399053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:29.399079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255232499695623:6767]
2025-10-01T14:09:29.399345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255234876561325:7694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:29.399356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255234876561325:7694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:29.399369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255234876561325:7694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:29.399380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:29.399480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:29.399688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:29.399717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:29.399916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:29.399951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.399955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.399956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.399956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.399957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.399957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.399958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.399959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.399960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.399960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.399961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.399961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.399962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.399963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.399966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.399972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.399974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.399976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.399978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.399980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.399982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.399984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.399986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.399989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.399991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.399993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.399995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.399997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.400001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.400006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.400010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.400013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.400015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.400018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.400020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.400023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.400026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.400028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.400031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.400034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.400036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.400039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.400041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.400044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.400046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.400049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.400052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.400055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.400057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.400060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.400062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.400065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.400068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.400070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.400073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.400075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.400095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:29.403553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:29.404121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:29.404129Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:29.404131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:29.404134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:29.404138Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 814 [2:7556255232499695623:6767]
2025-10-01T14:09:29.404157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:29.404170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:29.404172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.404174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.404175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.404186Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:29.404190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:29.404194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:29.404229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.404234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.404235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.404238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:29.404239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:29.404289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:29.404297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.404307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.404317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.404332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:29.404352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561421:7694], now have 1 active actors on pipe
2025-10-01T14:09:29.404362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561283:2446], now have 1 active actors on pipe
2025-10-01T14:09:29.404369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255232499695617:6767]
2025-10-01T14:09:29.404371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255232499695617:6767]
2025-10-01T14:09:29.404373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255232499695617:6767]
2025-10-01T14:09:29.404386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:29.404397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:29.404396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:29.404399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:29.404402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:29.404409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:29.404410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:29.404417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 814
2025-10-01T14:09:29.404429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255232499695617:6767]
2025-10-01T14:09:29.404423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 814
2025-10-01T14:09:29.404436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:29.404443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:29.404465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.404474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.404499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:29.404510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.404517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.404519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:29.404527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.404538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:29.404553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.404657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.404663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.404675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.404764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 815 partition: 0 MaxSeqNo: 45 sessionId: src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0
2025-10-01T14:09:29.405112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa57f391-5385269f-687fc88b-5b719a0c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:29.407628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0] Write session: try to update token
2025-10-01T14:09:29.407646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:29.421269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 815 sessionId: src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:29.423542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:29.424896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.424919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.424938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:29.424940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:29.424943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:29.424944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:29.424950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255232499695617:6767]
2025-10-01T14:09:29.424953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255232499695617:6767]
2025-10-01T14:09:29.424956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255232499695617:6767]
2025-10-01T14:09:29.424986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:29.424996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:29.424999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:29.425002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:29.425006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.425012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:29.425138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:29.485857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255234876561433:7609]
2025-10-01T14:09:29.486059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 814, pipe: [1:7556255234876561433:7609]
2025-10-01T14:09:29.563690Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:29.564314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:29.564357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561433:7609], now have 1 active actors on pipe
2025-10-01T14:09:29.564416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:29.564747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255234876561433:7609]
2025-10-01T14:09:29.564773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:29.573333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:29.573349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:29.573370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 815 reason: error at write: Disconnected sessionId: src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0
2025-10-01T14:09:29.573503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 815 sessionId: src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0 is DEAD
2025-10-01T14:09:29.573599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:29.573608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0] Write session will restart in 0.009908s
2025-10-01T14:09:29.573624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0] Write session: Do CDS request
2025-10-01T14:09:29.573632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:29.579561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:29.581405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:29.581657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:29.581670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:29.581683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:29.581746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:29.581786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255232499695807:6776]
2025-10-01T14:09:29.582389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:29.582683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:29.582734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:29.583072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:29.583150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.583157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.583158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.583159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.583160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.583161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.583162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.583164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.583165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.583165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.583167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.583168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.583169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.583170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.583176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.583186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.583190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.583195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.583199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.583203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.583206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.583210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.583214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.583218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.583221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.583225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.583229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.583232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.583241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.583249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.583255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.583261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.583272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.583281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.583286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.583291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.583300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.583309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.583316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.583321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.583330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.583339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.583346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.583355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.583363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.583368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.583376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.583380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.583384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.583390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.583394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.583399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.583403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.583408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.583421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.583426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.583464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:29.584879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.584959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:29.584972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 816
2025-10-01T14:09:29.585096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.585127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:29.585136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:29.585140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:29.585511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 816 sessionId:  describe result for acl check
2025-10-01T14:09:29.585547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:29.585553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:29.585554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:29.585559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255234876561558:7699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:29.586052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255234876561558:7699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:29.586846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:29.587384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:29.587398Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:29.587400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:29.587403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:29.587410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 815 [2:7556255232499695807:6776]
2025-10-01T14:09:29.587424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:29.587439Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:29.587446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.587450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.587452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.587466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:29.587475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:29.587480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:29.587531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.587539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.587541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.587543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:29.587546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:29.587608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:29.587615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.587626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.587641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.587661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:29.587688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561447:2446], now have 1 active actors on pipe
2025-10-01T14:09:29.587695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255232499695802:6776]
2025-10-01T14:09:29.587698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255232499695802:6776]
2025-10-01T14:09:29.587687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 815
2025-10-01T14:09:29.587699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255232499695802:6776]
2025-10-01T14:09:29.587715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:29.587724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:29.587727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:29.587728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:29.587730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:29.587745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:29.587753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:29.587782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255232499695802:6776]
2025-10-01T14:09:29.587802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:29.587916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:29.588146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255234876561558:7699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:29.594397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255234876561558:7699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:29.594412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255234876561558:7699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:29.594416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255234876561558:7699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:29.594425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:29.594633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561593:7699], now have 1 active actors on pipe
2025-10-01T14:09:29.594688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 815
2025-10-01T14:09:29.594746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.594756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.594776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:29.594789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.594797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.594800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:29.594808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.594832Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:29.594850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.594986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.595006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.595027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.595098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 816 partition: 0 MaxSeqNo: 45 sessionId: src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0
2025-10-01T14:09:29.595429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a4e7d-4a4ba180-3b6e09e1-47b69f71_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:29.597594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0] Write session: try to update token
2025-10-01T14:09:29.597607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:29.605056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:29.605082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:29.605100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255232499695802:6776]
2025-10-01T14:09:29.605147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:29.605155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:29.605438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:29.605674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:29.605869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:29.606061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:29.606252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:29.606288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:29.610485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 816 sessionId: src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:29.612923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:29.613105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.613121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.613162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:29.613240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:29.616234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:29.616249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:29.616251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:29.616252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:29.616259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255232499695802:6776]
2025-10-01T14:09:29.616262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255232499695802:6776]
2025-10-01T14:09:29.616264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255232499695802:6776]
2025-10-01T14:09:29.616296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:29.616296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:29.616304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:29.616305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.616306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:29.616306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:29.616422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:29.665064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255234876561597:7609]
2025-10-01T14:09:29.665289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 815, pipe: [1:7556255234876561597:7609]
2025-10-01T14:09:29.750765Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:29.757486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.757511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.757645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.757694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.757749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.757797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.757836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.757846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.757903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.757956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.758015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.758075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.758420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.758428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.758489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.758549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.758601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.758657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.758700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.758704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.758763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.758818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.758875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.758932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.758972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.758977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.759044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.759098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.759150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.759202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.759241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.759248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.759305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.759356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.759413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.759468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.759505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.759514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.759579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.759633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.759686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.759742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.759782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.759787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.759844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.759896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.759952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.760004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.760049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.760056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.760117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.760178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.760230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.760279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.760317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.760322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.760378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:29.760430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:29.760484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:29.760540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:29.760586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:29.760593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:29.760635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561597:7609], now have 1 active actors on pipe
2025-10-01T14:09:29.760872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255234876561597:7609]
2025-10-01T14:09:29.760875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:29.760904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:29.760906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:29.760926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 816 reason: error at write: Disconnected sessionId: src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0
2025-10-01T14:09:29.761074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:29.761096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 816 sessionId: src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0 is DEAD
2025-10-01T14:09:29.761208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:29.761227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0] Write session will restart in 0.006358s
2025-10-01T14:09:29.761251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0] Write session: Do CDS request
2025-10-01T14:09:29.761257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:29.768901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.768964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:29.768977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 817
2025-10-01T14:09:29.769101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.769133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:29.769142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:29.769150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:29.769540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 817 sessionId:  describe result for acl check
2025-10-01T14:09:29.769572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:29.769573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:29.769575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:29.769579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255234876561676:7704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:29.770149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255234876561676:7704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:29.771411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:29.772451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255234876561676:7704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:29.773187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:29.773330Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:29.773338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:29.773346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:29.773377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:29.773403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255232499695951:6782]
2025-10-01T14:09:29.773764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:29.773956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:29.773979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:29.774195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:29.774231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.774236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.774236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.774237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.774237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.774238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.774239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.774239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.774240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.774240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.774241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.774242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.774242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.774243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.774245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.774250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.774253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.774255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.774256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.774259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.774260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.774262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.774264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.774267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.774269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.774271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.774273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.774275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.774279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.774284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.774287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.774290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.774292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.774295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.774297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.774300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.774302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.774305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.774307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.774309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.774312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.774314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.774317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.774320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.774322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.774325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.774327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.774330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.774334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.774337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.774339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.774341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.774344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.774346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.774348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.774351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.774389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:29.774665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255234876561676:7704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:29.774677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255234876561676:7704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:29.774680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255234876561676:7704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:29.774686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:29.777658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:29.778266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:29.778276Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:29.778277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:29.778279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:29.778284Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 816 [2:7556255232499695951:6782]
2025-10-01T14:09:29.778294Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:29.778306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:29.778311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.778313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.778315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.778326Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:29.778333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:29.778339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:29.778401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.778408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.778410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.778412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:29.778414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:29.778468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:29.778478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.778488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.778495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.778504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:29.778518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561745:7704], now have 1 active actors on pipe
2025-10-01T14:09:29.778521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561601:2446], now have 1 active actors on pipe
2025-10-01T14:09:29.778527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255232499695945:6782]
2025-10-01T14:09:29.778528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255232499695945:6782]
2025-10-01T14:09:29.778530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255232499695945:6782]
2025-10-01T14:09:29.778539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:29.778551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:29.778552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:29.778555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:29.778557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:29.778569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:29.778572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:29.778598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255232499695945:6782]
2025-10-01T14:09:29.778605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:29.778610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:29.778607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 816
2025-10-01T14:09:29.778608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 816
2025-10-01T14:09:29.778692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.778700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.778718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:29.778725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.778728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.778729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:29.778736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.778744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:29.778757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.778936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.778950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.778970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.779041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 817 partition: 0 MaxSeqNo: 45 sessionId: src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0
2025-10-01T14:09:29.779407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fbaf9e-11a3ffb3-3bb192ca-f9842245_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:29.781868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0] Write session: try to update token
2025-10-01T14:09:29.781885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:29.795521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 817 sessionId: src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:29.797809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:29.797829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:29.797832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:29.797834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:29.797845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255232499695945:6782]
2025-10-01T14:09:29.797849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255232499695945:6782]
2025-10-01T14:09:29.797853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255232499695945:6782]
2025-10-01T14:09:29.797883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:29.797892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:29.797895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:29.797895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:29.797901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.797904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:29.797882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:29.798023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:29.861129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255234876561753:7609]
2025-10-01T14:09:29.861372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 816, pipe: [1:7556255234876561753:7609]
2025-10-01T14:09:29.937294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:29.937587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.937601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.937637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561753:7609], now have 1 active actors on pipe
2025-10-01T14:09:29.937831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255234876561753:7609]
2025-10-01T14:09:29.937839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:29.937858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:29.937843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:29.937861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:29.937914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 817 reason: error at write: Disconnected sessionId: src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0
2025-10-01T14:09:29.938106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 817 sessionId: src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0 is DEAD
2025-10-01T14:09:29.938223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:29.938231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0] Write session will restart in 0.006609s
2025-10-01T14:09:29.938249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0] Write session: Do CDS request
2025-10-01T14:09:29.938254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:29.945809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.945951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:29.945961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 818
2025-10-01T14:09:29.946046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:29.946078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:29.946084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:29.946088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:29.946369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 818 sessionId:  describe result for acl check
2025-10-01T14:09:29.946420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:29.946422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:29.946423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:29.946426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255234876561858:7708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:29.946786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255234876561858:7708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:29.947509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:29.948175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255234876561858:7708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:29.949321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:29.949465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:29.949472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:29.949479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:29.949510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:29.949539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255232499696097:6785]
2025-10-01T14:09:29.949896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:29.950070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:29.950097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:29.950182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255234876561858:7708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:29.950195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255234876561858:7708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:29.950198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255234876561858:7708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:29.950205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:29.950288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:29.950320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.950324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.950325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.950326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.950326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.950327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.950327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.950328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.950328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.950329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.950330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.950330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.950331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.950331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.950334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.950340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.950342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.950344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.950346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.950348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.950350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.950351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.950353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.950356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.950357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.950360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.950362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.950364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.950382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.950388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:29.950394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.950399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:29.950403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.950407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:29.950410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.950412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:29.950415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.950418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:29.950420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.950422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:29.950425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.950427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:29.950430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.950432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:29.950435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.950437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:29.950439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.950442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.950444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.950447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.950449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.950452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.950454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.950457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:29.950459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.950462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:29.950484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:29.953943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:29.954486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:29.954495Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:29.954497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:29.954499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:29.954504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 817 [2:7556255232499696097:6785]
2025-10-01T14:09:29.954513Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:29.954532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:29.954533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.954535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.954536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.954547Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:29.954551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:29.954555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:29.954589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.954594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.954595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.954597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:29.954599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:29.954641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:29.954646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.954652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:29.954658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:29.954666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:29.954680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561754:2446], now have 1 active actors on pipe
2025-10-01T14:09:29.954686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255234876561898:7708], now have 1 active actors on pipe
2025-10-01T14:09:29.954690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255232499696092:6785]
2025-10-01T14:09:29.954692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255232499696092:6785]
2025-10-01T14:09:29.954693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255232499696092:6785]
2025-10-01T14:09:29.954701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:29.954712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:29.954712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:29.954714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:29.954715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:29.954723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:29.954725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:29.954741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255232499696092:6785]
2025-10-01T14:09:29.954748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:29.954752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:29.954755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 817
2025-10-01T14:09:29.954762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 817
2025-10-01T14:09:29.954816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.954822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.954837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|400ce2f5-17633b08-abf2319c-31835000_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:29.954845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:29.954848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:29.954849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:29.954855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:29.954860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:29.954872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.954994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.954999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.955008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:29.955093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 818 partition: 0 MaxSeqNo: 45 sessionId: src_id|400ce2f5-17633b08-abf2319c-31835000_0
2025-10-01T14:09:29.955420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abd8803-1ace26cb-f109fba5-51e1046e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|400ce2f5-17633b08-abf2319c-31835000_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:29.957715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400ce2f5-17633b08-abf2319c-31835000_0] Write session: try to update token
2025-10-01T14:09:29.957744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400ce2f5-17633b08-abf2319c-31835000_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:29.964994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:29.965005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:29.965011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255232499696092:6785]
2025-10-01T14:09:29.965046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:29.965047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:29.965206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:29.965330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:29.965459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:29.965578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:29.965755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:29.965786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:29.969940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 818 sessionId: src_id|400ce2f5-17633b08-abf2319c-31835000_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:29.972041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:29.972365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:29.972380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:29.972406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:29.972479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:29.984368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:29.984388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:29.984391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:29.984392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:29.984403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255232499696092:6785]
2025-10-01T14:09:29.984408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255232499696092:6785]
2025-10-01T14:09:29.984411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255232499696092:6785]
2025-10-01T14:09:29.984452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:29.984459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:29.984463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:29.984465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:29.984466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:29.984469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:29.984586Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:30.037809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255239171529204:7609]
2025-10-01T14:09:30.038033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 817, pipe: [1:7556255239171529204:7609]
2025-10-01T14:09:30.127022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:30.140185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.140213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.140408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.140480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.140561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.140635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.140995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.141005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.141083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.141185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.141260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.141704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.141756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.141764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.141829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.141884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.141968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.142046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.142092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.142098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.142163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.142226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.142292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.142355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.142429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.142435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.142511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.142581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.142652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.142727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.142781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.142788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.142861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.142927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.143012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.143093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.143148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.143155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.143243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.143320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.143414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.143495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.143557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.143563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.143657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.143746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.143834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.143932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.143988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.144003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.144094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.144180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.144262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.144345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.144402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.144410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.144491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.144566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.144644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.144725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.144795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.144806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.144885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529204:7609], now have 1 active actors on pipe
2025-10-01T14:09:30.145162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255239171529204:7609]
2025-10-01T14:09:30.145171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:30.145266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:30.145304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:30.145307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:30.145335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 818 reason: error at write: Disconnected sessionId: src_id|400ce2f5-17633b08-abf2319c-31835000_0
2025-10-01T14:09:30.145578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 818 sessionId: src_id|400ce2f5-17633b08-abf2319c-31835000_0 is DEAD
2025-10-01T14:09:30.145749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400ce2f5-17633b08-abf2319c-31835000_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:30.145761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400ce2f5-17633b08-abf2319c-31835000_0] Write session will restart in 0.006783s
2025-10-01T14:09:30.145788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400ce2f5-17633b08-abf2319c-31835000_0] Write session: Do CDS request
2025-10-01T14:09:30.145794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400ce2f5-17633b08-abf2319c-31835000_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:30.153786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400ce2f5-17633b08-abf2319c-31835000_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.153925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:30.153937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 819
2025-10-01T14:09:30.154037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.154068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:30.154077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:30.154080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:30.154453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 819 sessionId:  describe result for acl check
2025-10-01T14:09:30.154488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:30.154494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:30.154496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:30.154500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255239171529307:7712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:30.154971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255239171529307:7712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:30.155706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:30.156776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255239171529307:7712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:30.157530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:30.157724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:30.157738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:30.157749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:30.157804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:30.157844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255236794663542:6787]
2025-10-01T14:09:30.158272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:30.158582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:30.158633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:30.158974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:30.159032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.159037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.159039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.159040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.159041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.159042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.159043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.159044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.159045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.159046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.159047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.159048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.159049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.159050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.159055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.159064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.159067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.159070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.159073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.159076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.159079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.159082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.159086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.159090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.159093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.159096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.159099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.159102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.159108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.159115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.159121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.159125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.159128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.159133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.159136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.159140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.159145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.159127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255239171529307:7712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:30.159139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255239171529307:7712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:30.159149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.159142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255239171529307:7712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:30.159149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:30.159152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.159157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.159161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.159165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.159168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.159174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.159177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.159181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.159185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.159189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.159194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.159198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.159201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.159213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.159217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.159224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.159228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.159232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.159268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:30.162641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:30.163382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:30.163392Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:30.163394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:30.163399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:30.163406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 818 [2:7556255236794663542:6787]
2025-10-01T14:09:30.163416Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:30.163428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:30.163433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.163435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.163437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.163450Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:30.163456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:30.163461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:30.163502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.163507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.163508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.163510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:30.163512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:30.163560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:30.163566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.163572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.163577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.163585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:30.163601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529351:7712], now have 1 active actors on pipe
2025-10-01T14:09:30.163610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255236794663535:6787]
2025-10-01T14:09:30.163611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255236794663535:6787]
2025-10-01T14:09:30.163612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255236794663535:6787]
2025-10-01T14:09:30.163624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:30.163631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:30.163634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:30.163635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529207:2446], now have 1 active actors on pipe
2025-10-01T14:09:30.163635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:30.163642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:30.163653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:30.163660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:30.163688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255236794663535:6787]
2025-10-01T14:09:30.163695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:30.163671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 818
2025-10-01T14:09:30.163697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:30.163841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 818
2025-10-01T14:09:30.163891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.163905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.163933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cd210df-822abe89-d1c24b5c-4fa294_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:30.163945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.163953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.163955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:30.163965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.163979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:30.163998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.164121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.164127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.164138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.164207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 819 partition: 0 MaxSeqNo: 45 sessionId: src_id|9cd210df-822abe89-d1c24b5c-4fa294_0
2025-10-01T14:09:30.164532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400ce2f5-17633b08-abf2319c-31835000_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9cd210df-822abe89-d1c24b5c-4fa294_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:30.166950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd210df-822abe89-d1c24b5c-4fa294_0] Write session: try to update token
2025-10-01T14:09:30.166970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd210df-822abe89-d1c24b5c-4fa294_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:30.174312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:30.174324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:30.174341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255236794663535:6787]
2025-10-01T14:09:30.174388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:30.174400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:30.174576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:30.174721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:30.174871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:30.175014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:30.175233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:30.175271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:30.180290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 819 sessionId: src_id|9cd210df-822abe89-d1c24b5c-4fa294_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:30.182655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:30.182913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.182930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.182957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:30.183050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:30.192452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:30.192469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:30.192471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:30.192472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:30.192480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255236794663535:6787]
2025-10-01T14:09:30.192482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255236794663535:6787]
2025-10-01T14:09:30.192484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255236794663535:6787]
2025-10-01T14:09:30.192521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:30.192524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:30.192529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.192530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:30.192531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:30.192533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:30.192650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:30.245146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255239171529364:7609]
2025-10-01T14:09:30.245372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 818, pipe: [1:7556255239171529364:7609]
2025-10-01T14:09:30.330216Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:30.337660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.337686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.337826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.337879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.337936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.337993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.338033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.338040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.338098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.338151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.338202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.338254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.338292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.338294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.338353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.338428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.338486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.338542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.338583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.338587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.338648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.338703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.338759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.338817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.338855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.338860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.338918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.338984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.339041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.339097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.339134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.339140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.339199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.339252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.339314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.339373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.339415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.339420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.339478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.339529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.339582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.339639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.339678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.339683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.339743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.339796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.339853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.339907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.339947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.339952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.340006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.340059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.340114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.340170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.340210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.340215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.340272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.340328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.340388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.340443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.340484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.340489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.340533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529364:7609], now have 1 active actors on pipe
2025-10-01T14:09:30.340824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:30.340826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255239171529364:7609]
2025-10-01T14:09:30.340854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:30.340857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:30.340884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 819 reason: error at write: Disconnected sessionId: src_id|9cd210df-822abe89-d1c24b5c-4fa294_0
2025-10-01T14:09:30.341090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 819 sessionId: src_id|9cd210df-822abe89-d1c24b5c-4fa294_0 is DEAD
2025-10-01T14:09:30.341214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd210df-822abe89-d1c24b5c-4fa294_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:30.341219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd210df-822abe89-d1c24b5c-4fa294_0] Write session will restart in 0.008705s
2025-10-01T14:09:30.341238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd210df-822abe89-d1c24b5c-4fa294_0] Write session: Do CDS request
2025-10-01T14:09:30.341242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd210df-822abe89-d1c24b5c-4fa294_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:30.341314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:30.350886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd210df-822abe89-d1c24b5c-4fa294_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.351413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:30.351427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 820
2025-10-01T14:09:30.351436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:30.351540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.351584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:30.351593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:30.351597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:30.351964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 820 sessionId:  describe result for acl check
2025-10-01T14:09:30.352003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:30.352009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:30.352011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:30.352016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255239171529507:7724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:30.352489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255239171529507:7724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:30.353532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:30.353716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:30.353727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:30.353738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:30.353787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:30.353824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255236794663696:6791]
2025-10-01T14:09:30.354263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255239171529507:7724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:30.354386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:30.354631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:30.354679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:30.354968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:30.355029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.355035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.355037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.355038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.355039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.355040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.355041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.355042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.355043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.355044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.355045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.355046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.355047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.355048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.355054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.355063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.355068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.355072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.355075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.355079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.355082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.355085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.355089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.355093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.355098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.355101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.355105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.355109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.355115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.355122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.355129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.355134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.355138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.355143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.355148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.355153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.355164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.355169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.355178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.355183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.355192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.355197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.355205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.355209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.355215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.355223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.355228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.355237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.355242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.355247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.355255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.355259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.355264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.355268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.355272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.355281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.355321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:30.358586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255239171529507:7724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:30.358601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255239171529507:7724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:30.358605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255239171529507:7724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:30.358613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:30.358747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:30.359638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:30.359658Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:30.359660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:30.359664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:30.359671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 819 [2:7556255236794663696:6791]
2025-10-01T14:09:30.359684Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:30.359700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:30.359703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.359707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.359709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.359725Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:30.359731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:30.359736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:30.359791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.359800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.359802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.359806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:30.359808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:30.359880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:30.359888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.359901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.359913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.359933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:30.359955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529399:2446], now have 1 active actors on pipe
2025-10-01T14:09:30.359964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529543:7724], now have 1 active actors on pipe
2025-10-01T14:09:30.359971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255236794663690:6791]
2025-10-01T14:09:30.359955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 819
2025-10-01T14:09:30.359975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255236794663690:6791]
2025-10-01T14:09:30.359965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 819
2025-10-01T14:09:30.359977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255236794663690:6791]
2025-10-01T14:09:30.359987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:30.359994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:30.359997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:30.359999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:30.360001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:30.360016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:30.360023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:30.360041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.360049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.360083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255236794663690:6791]
2025-10-01T14:09:30.360096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:30.360105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:30.360110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:30.360121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.360136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.360138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:30.360148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.360157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:30.360193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.360316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.360327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.360353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.360425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 820 partition: 0 MaxSeqNo: 45 sessionId: src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0
2025-10-01T14:09:30.360765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd210df-822abe89-d1c24b5c-4fa294_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:30.363106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0] Write session: try to update token
2025-10-01T14:09:30.363120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:30.370778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:30.370799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:30.370809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255236794663690:6791]
2025-10-01T14:09:30.370839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:30.370855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:30.371028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:30.371180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:30.371333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:30.371480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:30.371673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:30.371718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:30.376483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 820 sessionId: src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:30.379006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:30.379584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.379609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.379648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:30.379740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:30.389152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:30.389177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:30.389179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:30.389181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:30.389192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255236794663690:6791]
2025-10-01T14:09:30.389196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255236794663690:6791]
2025-10-01T14:09:30.389200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255236794663690:6791]
2025-10-01T14:09:30.389235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:30.389246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:30.389247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:30.389249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:30.389254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.389256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:30.389383Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:30.440730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255239171529550:7609]
2025-10-01T14:09:30.440966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 819, pipe: [1:7556255239171529550:7609]
2025-10-01T14:09:30.546526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:30.554639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.554665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.554835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.554898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.554962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.555021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.555062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.555073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.555140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.555199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.555258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.555321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.555373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.555380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.555446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.555509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.555571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.555635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.555678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.555686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.555751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.555818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.555884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.555949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.556256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.556265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.556325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.556396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.556463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.556524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.556566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.556573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.556638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.556704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.556783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.556848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.556894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.556901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.556966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.557028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.557098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.557164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.557205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.557212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.557279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.557341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.557407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.557467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.557511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.557518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.557582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.557640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.557701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.557760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.557805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.557812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.557877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.557937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.557998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.558058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.558100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.558111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.558180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529550:7609], now have 1 active actors on pipe
2025-10-01T14:09:30.558406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:30.558416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:30.558443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 820 reason: error at write: Disconnected sessionId: src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0
2025-10-01T14:09:30.558463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255239171529550:7609]
2025-10-01T14:09:30.558491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:30.558635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 820 sessionId: src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0 is DEAD
2025-10-01T14:09:30.558760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:30.558768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0] Write session will restart in 0.007832s
2025-10-01T14:09:30.558808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0] Write session: Do CDS request
2025-10-01T14:09:30.558814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:30.558869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:30.567870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.567939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:30.567951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 821
2025-10-01T14:09:30.568442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.568472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:30.568477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:30.568479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:30.568808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 821 sessionId:  describe result for acl check
2025-10-01T14:09:30.568838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:30.568844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:30.568847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:30.568850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255239171529661:7729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:30.569173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255239171529661:7729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:30.570654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:30.570742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255239171529661:7729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:30.572456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:30.572612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:30.572621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:30.572632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:30.572676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:30.572713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255236794663862:6795]
2025-10-01T14:09:30.572712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255239171529661:7729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:30.572723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255239171529661:7729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:30.572726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255239171529661:7729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:30.572732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:30.573231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:30.573450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:30.573483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:30.573688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:30.573724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.573728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.573729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.573730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.573730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.573731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.573732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.573733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.573733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.573734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.573735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.573735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.573736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.573737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.573741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.573749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.573753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.573757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.573760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.573765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.573768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.573776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.573779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.573785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.573787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.573788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.573791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.573792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.573797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.573805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.573815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.573826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.573830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.573835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.573839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.573844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.573848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.573851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.573853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.573856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.573858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.573861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.573863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.573866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.573872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.573874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.573877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.573880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.573882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.573890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.573898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.573907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.573916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.573924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.573928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.573933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.573958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:30.577528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:30.578221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:30.578240Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:30.578242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:30.578245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:30.578253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 820 [2:7556255236794663862:6795]
2025-10-01T14:09:30.578266Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:30.578280Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:30.578283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.578287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.578290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.578304Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:30.578315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:30.578320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:30.578393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.578400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.578403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.578406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:30.578408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:30.578473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:30.578482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.578492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.578503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.578523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:30.578545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529553:2446], now have 1 active actors on pipe
2025-10-01T14:09:30.578553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529709:7729], now have 1 active actors on pipe
2025-10-01T14:09:30.578560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255236794663853:6795]
2025-10-01T14:09:30.578566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255236794663853:6795]
2025-10-01T14:09:30.578567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255236794663853:6795]
2025-10-01T14:09:30.578565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 820
2025-10-01T14:09:30.578589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:30.578588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 820
2025-10-01T14:09:30.578605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:30.578608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:30.578609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:30.578610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:30.578625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:30.578632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:30.578654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.578662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.578694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255236794663853:6795]
2025-10-01T14:09:30.578706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:30.578722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:30.578737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:30.578747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.578756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.578759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:30.578766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.578779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:30.578818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.578970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.578980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.578996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.579057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 821 partition: 0 MaxSeqNo: 45 sessionId: src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0
2025-10-01T14:09:30.579378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f4a8bb2-7ad56974-15a6525a-299bdd3e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:30.581778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0] Write session: try to update token
2025-10-01T14:09:30.581798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:30.594808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 821 sessionId: src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:30.597076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:30.597266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.597289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.599158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:30.599197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:30.599201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:30.599203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:30.599205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:30.599212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255236794663853:6795]
2025-10-01T14:09:30.599221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255236794663853:6795]
2025-10-01T14:09:30.599224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255236794663853:6795]
2025-10-01T14:09:30.599248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:30.599261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:30.599263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:30.599265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:30.599269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.599271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:30.599274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:30.599386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:30.658868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255239171529726:7609]
2025-10-01T14:09:30.659170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 820, pipe: [1:7556255239171529726:7609]
2025-10-01T14:09:30.734083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:30.740925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.740947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.741102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.741167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.741222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.741278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.741326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.741335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.741400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.741460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.741517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.741569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.741607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.741612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.741662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.741707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.741756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.741807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.741849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.741855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.741914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.741963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.742024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.742073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.742110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.742115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.742166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.742215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.742264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.742326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.742387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.742394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.742448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.742493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.742545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.742598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.742638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.742643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.742698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.742746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.742797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.742847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.742886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.742891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.742951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.743000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.743051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.743103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.743141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.743146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.743200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.743248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.743299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.743352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.743415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.743421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.743480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:30.743534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:30.743590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:30.743645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:30.743682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:30.743691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:30.743731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529726:7609], now have 1 active actors on pipe
2025-10-01T14:09:30.743982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:30.743992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255239171529726:7609]
2025-10-01T14:09:30.744021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:30.744024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:30.744050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 821 reason: error at write: Disconnected sessionId: src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0
2025-10-01T14:09:30.744222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 821 sessionId: src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0 is DEAD
2025-10-01T14:09:30.744361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:30.744373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0] Write session will restart in 0.009043s
2025-10-01T14:09:30.744398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0] Write session: Do CDS request
2025-10-01T14:09:30.744403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:30.744767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:30.754049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:30.754859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.754922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:30.754934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 822
2025-10-01T14:09:30.755085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.755114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:30.755123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:30.755126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:30.755514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 822 sessionId:  describe result for acl check
2025-10-01T14:09:30.755543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:30.755549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:30.755550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:30.755555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255239171529840:7734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:30.755977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:30.756064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255239171529840:7734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:30.756200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:30.756209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:30.756220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:30.756269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:30.756306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255236794664039:6807]
2025-10-01T14:09:30.756876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:30.757118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:30.757177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:30.757411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:30.757448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.757453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.757453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.757454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.757454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.757455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.757455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.757456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.757457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.757457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.757458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.757459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.757459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.757460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.757463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.757478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.757480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.757482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.757484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.757486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.757488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.757490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.757493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.757495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.757497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.757499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.757501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.757503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.757507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.757512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.757516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.757519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.757523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.757526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.757528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.757531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.757533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.757536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.757538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.757541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.757544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.757547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.757549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.757552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.757554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.757557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.757560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.757562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.757565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.757567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.757570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.757573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.757575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.757578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.757580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.757583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.757602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:30.758090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255239171529840:7734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:30.760830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255239171529840:7734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:30.760841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255239171529840:7734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:30.760844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255239171529840:7734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:30.760850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:30.761026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:30.761561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:30.761569Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:30.761570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:30.761573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:30.761579Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 821 [2:7556255236794664039:6807]
2025-10-01T14:09:30.761590Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:30.761605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:30.761610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.761612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.761613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.761625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:30.761632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:30.761636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:30.761677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.761682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.761683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.761686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:30.761688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:30.761748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:30.761758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.761768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.761778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.761792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:30.761807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529730:2446], now have 1 active actors on pipe
2025-10-01T14:09:30.761814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529879:7734], now have 1 active actors on pipe
2025-10-01T14:09:30.761819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255236794664033:6807]
2025-10-01T14:09:30.761820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255236794664033:6807]
2025-10-01T14:09:30.761821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255236794664033:6807]
2025-10-01T14:09:30.761833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:30.761844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:30.761835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 821
2025-10-01T14:09:30.761843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 821
2025-10-01T14:09:30.761848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:30.761850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:30.761852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:30.761861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:30.761864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:30.761893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255236794664033:6807]
2025-10-01T14:09:30.761902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:30.761911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:30.761915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.761919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.761954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77a206c6-5d82ca70-aaf626d6-90777260_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:30.761964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.761968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.761970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:30.761978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.761990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:30.762009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.762123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.762129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.762144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.762204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 822 partition: 0 MaxSeqNo: 45 sessionId: src_id|77a206c6-5d82ca70-aaf626d6-90777260_0
2025-10-01T14:09:30.762504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6226817-4a5829a8-c1824d71-68b8c77a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|77a206c6-5d82ca70-aaf626d6-90777260_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:30.764808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a206c6-5d82ca70-aaf626d6-90777260_0] Write session: try to update token
2025-10-01T14:09:30.764825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a206c6-5d82ca70-aaf626d6-90777260_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:30.778382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 822 sessionId: src_id|77a206c6-5d82ca70-aaf626d6-90777260_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:30.780630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:30.781203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.781226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.781245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:30.781248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:30.781251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:30.781253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:30.781260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255236794664033:6807]
2025-10-01T14:09:30.781265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255236794664033:6807]
2025-10-01T14:09:30.781269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255236794664033:6807]
2025-10-01T14:09:30.781300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:30.781311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:30.781314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:30.781321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:30.781327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.781330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:30.781453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:30.844202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255239171529887:7609]
2025-10-01T14:09:30.844422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 821, pipe: [1:7556255239171529887:7609]
2025-10-01T14:09:30.927928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:30.928382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:30.928430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529887:7609], now have 1 active actors on pipe
2025-10-01T14:09:30.928542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:30.928621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255239171529887:7609]
2025-10-01T14:09:30.928645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:30.938252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:30.938266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:30.938285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 822 reason: error at write: Disconnected sessionId: src_id|77a206c6-5d82ca70-aaf626d6-90777260_0
2025-10-01T14:09:30.938443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 822 sessionId: src_id|77a206c6-5d82ca70-aaf626d6-90777260_0 is DEAD
2025-10-01T14:09:30.938566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a206c6-5d82ca70-aaf626d6-90777260_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:30.938574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a206c6-5d82ca70-aaf626d6-90777260_0] Write session will restart in 0.005310s
2025-10-01T14:09:30.938599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a206c6-5d82ca70-aaf626d6-90777260_0] Write session: Do CDS request
2025-10-01T14:09:30.938608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a206c6-5d82ca70-aaf626d6-90777260_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:30.944909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a206c6-5d82ca70-aaf626d6-90777260_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.944983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:30.944999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 823
2025-10-01T14:09:30.945105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:30.945135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:30.945144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:30.945147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:30.945500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 823 sessionId:  describe result for acl check
2025-10-01T14:09:30.945534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:30.945540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:30.945541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:30.945546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255239171530010:7738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:30.945967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:30.946031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255239171530010:7738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:30.948184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:30.948331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255239171530010:7738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:30.948397Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:30.948408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:30.948421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:30.948476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:30.948520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255236794664191:6810]
2025-10-01T14:09:30.949094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:30.949382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:30.949429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:30.949727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:30.949793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.949800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.949801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.949802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.949803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.949804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.949805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.949807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.949808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.949809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.949810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.949812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.949813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.949814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.949819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.949828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.949831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.949839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.949843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.949850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.949854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.949863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.949871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.949875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.949882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.949886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.949889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.949893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.949902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.949913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:30.949923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.949928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:30.949937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.949942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:30.949947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.949952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:30.949957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.949963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:30.949967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.949972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:30.949977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.949982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:30.949987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.949992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:30.949997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.950002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:30.950011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.950016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.950021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.950029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.950033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.950039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.950047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.950066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:30.950074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.950080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:30.950123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:30.950957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255239171530010:7738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:30.950971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255239171530010:7738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:30.950976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255239171530010:7738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:30.950984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:30.954278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:30.954901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:30.954919Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:30.954922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:30.954926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:30.954934Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 822 [2:7556255236794664191:6810]
2025-10-01T14:09:30.954950Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:30.954976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:30.954979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.954983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.954990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.955008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:30.955019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:30.955030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:30.955089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.955098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.955101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.955104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:30.955107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:30.955177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:30.955185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.955197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:30.955212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:30.955231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:30.955250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171530050:7738], now have 1 active actors on pipe
2025-10-01T14:09:30.955256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255239171529889:2446], now have 1 active actors on pipe
2025-10-01T14:09:30.955261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255236794664186:6810]
2025-10-01T14:09:30.955267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255236794664186:6810]
2025-10-01T14:09:30.955269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255236794664186:6810]
2025-10-01T14:09:30.955278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:30.955253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 822
2025-10-01T14:09:30.955295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:30.955297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:30.955263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 822
2025-10-01T14:09:30.955300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:30.955302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:30.955312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:30.955316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:30.955333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.955345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.955380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255236794664186:6810]
2025-10-01T14:09:30.955385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:30.955395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:30.955404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:30.955407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:30.955409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:30.955415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:30.955425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:30.955431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:30.955449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.955627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.955642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.955665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:30.955747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 823 partition: 0 MaxSeqNo: 45 sessionId: src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0
2025-10-01T14:09:30.956098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a206c6-5d82ca70-aaf626d6-90777260_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:30.958626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0] Write session: try to update token
2025-10-01T14:09:30.958641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:30.967459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:30.967480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:30.967491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255236794664186:6810]
2025-10-01T14:09:30.967541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:30.967544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:30.967734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:30.967880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:30.968026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:30.968168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:30.968366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:30.968406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:30.976299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 823 sessionId: src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:30.978540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:30.978788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:30.978806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:30.978835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:30.978927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:30.986367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:30.986401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:30.986404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:30.986405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:30.986416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255236794664186:6810]
2025-10-01T14:09:30.986420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255236794664186:6810]
2025-10-01T14:09:30.986424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255236794664186:6810]
2025-10-01T14:09:30.986473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:30.986475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:30.986480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:30.986483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:30.986485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:30.986488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:30.986638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:31.029024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255243466497354:7609]
2025-10-01T14:09:31.029287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 822, pipe: [1:7556255243466497354:7609]
2025-10-01T14:09:31.125483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:31.131977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.131999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.132133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.132183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.132242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.132299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.132517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.132527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.132580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.132632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.132683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.132844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.132967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.132973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.133029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.133078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.133128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.133179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.133217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.133224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.133289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.133346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.133395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.133456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.133493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.133498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.133554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.133605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.133656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.133707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.133745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.133759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.133824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.133877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.133931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.133988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.134026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.134032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.134087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.134135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.134187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.134237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.134278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.134283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.134343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.134419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.134476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.134526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.134563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.134569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.134624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.134672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.134724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.134778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.134823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.134830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.134886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.134941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.135004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.135059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.135097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.135102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.135148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497354:7609], now have 1 active actors on pipe
2025-10-01T14:09:31.135381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:31.135392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:31.135397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255243466497354:7609]
2025-10-01T14:09:31.135413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 823 reason: error at write: Disconnected sessionId: src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0
2025-10-01T14:09:31.135418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:31.135444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:31.135611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 823 sessionId: src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0 is DEAD
2025-10-01T14:09:31.135731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:31.135739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0] Write session will restart in 0.008428s
2025-10-01T14:09:31.135764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0] Write session: Do CDS request
2025-10-01T14:09:31.135770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:31.144920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.144965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:31.144978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 824
2025-10-01T14:09:31.145107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.145140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:31.145145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:31.145162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:31.145515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 824 sessionId:  describe result for acl check
2025-10-01T14:09:31.145540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:31.145542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:31.145543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:31.145548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255243466497437:7742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:31.146038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255243466497437:7742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:31.147541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:31.148501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255243466497437:7742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:31.149468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:31.149662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:31.149673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:31.149683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:31.149730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:31.149765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255241089631639:6812]
2025-10-01T14:09:31.150354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:31.150619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:31.150681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:31.150934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:31.150952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255243466497437:7742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:31.150965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255243466497437:7742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:31.150969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255243466497437:7742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:31.150980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.150976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:31.150986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.150987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.150988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.150989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.150990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.150991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.150992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.150993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.150994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.150995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.150996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.150997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.150998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.151003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.151011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.151014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.151017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.151020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.151024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.151028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.151031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.151034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.151037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.151039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.151041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.151043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.151045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.151050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.151054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.151058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.151061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.151063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.151066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.151069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.151071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.151074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.151077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.151079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.151081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.151084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.151087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.151089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.151091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.151094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.151097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.151099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.151102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.151104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.151108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.151110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.151113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.151116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.151119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.151121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.151124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.151145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:31.154682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:31.155315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:31.155328Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:31.155331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:31.155335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:31.155342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 823 [2:7556255241089631639:6812]
2025-10-01T14:09:31.155355Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:31.155371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:31.155375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.155378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.155381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.155396Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:31.155406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:31.155414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:31.155472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.155478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.155480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.155483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:31.155486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:31.155673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 823
2025-10-01T14:09:31.155682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 823
2025-10-01T14:09:31.155749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:31.155756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.155767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.155783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.155804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:31.155827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497357:2446], now have 1 active actors on pipe
2025-10-01T14:09:31.155835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497506:7742], now have 1 active actors on pipe
2025-10-01T14:09:31.155855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.155863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.155879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255241089631634:6812]
2025-10-01T14:09:31.155885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255241089631634:6812]
2025-10-01T14:09:31.155887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255241089631634:6812]
2025-10-01T14:09:31.155899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:31.155914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:31.155916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:31.155923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:31.155925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:31.155931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:31.155934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:31.155951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9be37b-285c782c-d7ddba00-f485a10f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:31.155962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.155971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.155973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:31.155982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.155994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:31.156034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255241089631634:6812]
2025-10-01T14:09:31.156045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:31.156055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:31.156060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.156204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.156211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.156223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.156291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 824 partition: 0 MaxSeqNo: 45 sessionId: src_id|e9be37b-285c782c-d7ddba00-f485a10f_0
2025-10-01T14:09:31.156655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a77e38-736d8e8f-6cced9c7-eafdf856_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e9be37b-285c782c-d7ddba00-f485a10f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:31.159025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9be37b-285c782c-d7ddba00-f485a10f_0] Write session: try to update token
2025-10-01T14:09:31.159039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9be37b-285c782c-d7ddba00-f485a10f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:31.166802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:31.166820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:31.166829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255241089631634:6812]
2025-10-01T14:09:31.166874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:31.166884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:31.167061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:31.167203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:31.167350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:31.167488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:31.167698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:31.167740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:31.172178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 824 sessionId: src_id|e9be37b-285c782c-d7ddba00-f485a10f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:31.174365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:31.174558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.174577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.174618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:31.174688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:31.185151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:31.185168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:31.185170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:31.185172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:31.185183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255241089631634:6812]
2025-10-01T14:09:31.185186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255241089631634:6812]
2025-10-01T14:09:31.185188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255241089631634:6812]
2025-10-01T14:09:31.185225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:31.185226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:31.185230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:31.185233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.185234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:31.185236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:31.185352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:31.235350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255243466497515:7609]
2025-10-01T14:09:31.235571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 823, pipe: [1:7556255243466497515:7609]
2025-10-01T14:09:31.327686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:31.334671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.334695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.334859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.334920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.334979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.335036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.335083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.335089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.335150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.335203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.335266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.335323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.335361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.335367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.335419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.335465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.335517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.335572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.335612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.335617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.335676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.335730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.335782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.335833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.335870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.335875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.335931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.335987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.336040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.336100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.336140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.336147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.336205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.336266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.336324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.336386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.336427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.336432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.336488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.336540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.336600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.336656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.336694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.336699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.336769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.336821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.336875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.336929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.336975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.336979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.337037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.337088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.337147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.337201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.337241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.337245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.337310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:31.337368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:31.337425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:31.337478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:31.337518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:31.337522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:31.337567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497515:7609], now have 1 active actors on pipe
2025-10-01T14:09:31.337809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:31.337832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:31.337836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:31.337853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255243466497515:7609]
2025-10-01T14:09:31.337860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 824 reason: error at write: Disconnected sessionId: src_id|e9be37b-285c782c-d7ddba00-f485a10f_0
2025-10-01T14:09:31.338060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 824 sessionId: src_id|e9be37b-285c782c-d7ddba00-f485a10f_0 is DEAD
2025-10-01T14:09:31.338188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9be37b-285c782c-d7ddba00-f485a10f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:31.338199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9be37b-285c782c-d7ddba00-f485a10f_0] Write session will restart in 0.009415s
2025-10-01T14:09:31.338224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9be37b-285c782c-d7ddba00-f485a10f_0] Write session: Do CDS request
2025-10-01T14:09:31.338230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9be37b-285c782c-d7ddba00-f485a10f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:31.338536Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:31.349075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9be37b-285c782c-d7ddba00-f485a10f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.349071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:31.349085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 825
2025-10-01T14:09:31.349283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.349290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:31.349330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:31.349338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:31.349342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:31.349745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 825 sessionId:  describe result for acl check
2025-10-01T14:09:31.349787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:31.349793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:31.349795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:31.349800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255243466497666:7754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:31.350343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255243466497666:7754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:31.351357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:31.351546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:31.351553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:31.351562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:31.351612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:31.351643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255241089631798:6816]
2025-10-01T14:09:31.352078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:31.352300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:31.352337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:31.352603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:31.352636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255243466497666:7754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:31.352652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.352658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.352659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.352660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.352661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.352662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.352663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.352664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.352665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.352666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.352667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.352668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.352669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.352669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.352674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.352682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.352685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.352688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.352692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.352695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.352697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.352700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.352703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.352707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.352709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.352712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.352716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.352718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.352725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.352731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.352736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.352740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.352744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.352759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.352763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.352768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.352772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.352776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.352780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.352784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.352788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.352792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.352795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.352800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.352803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.352808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.352811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.352815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.352819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.352824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.352828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.352831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.352835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.352839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.352842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.352846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.352879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:31.356349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255243466497666:7754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:31.356362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255243466497666:7754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:31.356365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255243466497666:7754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:31.356374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:31.356401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:31.357129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:31.357140Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:31.357142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:31.357145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:31.357151Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 824 [2:7556255241089631798:6816]
2025-10-01T14:09:31.357165Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:31.357184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:31.357186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.357190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.357192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.357206Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:31.357215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:31.357221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:31.357277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.357294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.357301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.357303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:31.357306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:31.357364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:31.357370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.357377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.357383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.357391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:31.357405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497701:7754], now have 1 active actors on pipe
2025-10-01T14:09:31.357412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497552:2446], now have 1 active actors on pipe
2025-10-01T14:09:31.357418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255241089631792:6816]
2025-10-01T14:09:31.357421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255241089631792:6816]
2025-10-01T14:09:31.357423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255241089631792:6816]
2025-10-01T14:09:31.357435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:31.357447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:31.357450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:31.357455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:31.357457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:31.357470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 824
2025-10-01T14:09:31.357475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 824
2025-10-01T14:09:31.357475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:31.357482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:31.357511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255241089631792:6816]
2025-10-01T14:09:31.357520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:31.357534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:31.357537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.357541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.357583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:31.357594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.357602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.357604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:31.357612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.357626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:31.357645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.357783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.357793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.357810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.357857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 825 partition: 0 MaxSeqNo: 45 sessionId: src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0
2025-10-01T14:09:31.358193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9be37b-285c782c-d7ddba00-f485a10f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:31.360650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0] Write session: try to update token
2025-10-01T14:09:31.360670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:31.375956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 825 sessionId: src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:31.377600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:31.377619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:31.377621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:31.377623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:31.377632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255241089631792:6816]
2025-10-01T14:09:31.377636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255241089631792:6816]
2025-10-01T14:09:31.377643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255241089631792:6816]
2025-10-01T14:09:31.377692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:31.377703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.377705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:31.377835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:31.378185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:31.378198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:31.378202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:31.378224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:31.438111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255243466497708:7609]
2025-10-01T14:09:31.438332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 824, pipe: [1:7556255243466497708:7609]
2025-10-01T14:09:31.515646Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:31.516022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.516037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.516080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497708:7609], now have 1 active actors on pipe
2025-10-01T14:09:31.516342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:31.516353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255243466497708:7609]
2025-10-01T14:09:31.516376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:31.516378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:31.516436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 825 reason: error at write: Disconnected sessionId: src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0
2025-10-01T14:09:31.516663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 825 sessionId: src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0 is DEAD
2025-10-01T14:09:31.516806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:31.516818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0] Write session will restart in 0.008727s
2025-10-01T14:09:31.516842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0] Write session: Do CDS request
2025-10-01T14:09:31.516851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:31.517323Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:31.526832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.526962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:31.526976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 826
2025-10-01T14:09:31.527112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.527147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:31.527157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:31.527161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:31.527290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:31.527525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 826 sessionId:  describe result for acl check
2025-10-01T14:09:31.527566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:31.527570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:31.527571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:31.527574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255243466497824:7758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:31.527979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255243466497824:7758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:31.529396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:31.529584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:31.529594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:31.529604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:31.529648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:31.529678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255241089631965:6820]
2025-10-01T14:09:31.529896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255243466497824:7758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:31.530213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:31.530433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:31.530467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:31.530737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:31.530782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.530788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.530789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.530790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.530791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.530792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.530793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.530794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.530795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.530796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.530797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.530798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.530799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.530800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.530804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.530813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.530817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.530821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.530824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.530828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.530832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.530835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.530839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.530842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.530846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.530849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.530853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.530856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.530861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.530868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.530874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.530879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.530883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.530887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.530896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.530901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.530905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.530914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.530918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.530922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.530930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.530934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.530936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.530938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.530940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.530943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.530945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.530948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.530951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.530953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.530957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.530959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.530962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.530964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.530966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.530969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.530988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:31.534068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255243466497824:7758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:31.534082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255243466497824:7758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:31.534084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255243466497824:7758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:31.534090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:31.534338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:31.534912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:31.534924Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:31.534926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:31.534929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:31.534935Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 825 [2:7556255241089631965:6820]
2025-10-01T14:09:31.534949Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:31.534966Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:31.534972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.534975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.534978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.534992Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:31.535001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:31.535006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:31.535053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.535059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.535061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.535064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:31.535067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:31.535127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:31.535133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.535143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.535154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.535172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:31.535192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497864:7758], now have 1 active actors on pipe
2025-10-01T14:09:31.535198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497711:2446], now have 1 active actors on pipe
2025-10-01T14:09:31.535205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255241089631959:6820]
2025-10-01T14:09:31.535210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255241089631959:6820]
2025-10-01T14:09:31.535212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255241089631959:6820]
2025-10-01T14:09:31.535224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:31.535234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:31.535219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 825
2025-10-01T14:09:31.535234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:31.535241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:31.535231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 825
2025-10-01T14:09:31.535242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:31.535246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:31.535249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:31.535270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255241089631959:6820]
2025-10-01T14:09:31.535278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:31.535279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:31.535291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.535299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.535340Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:31.535350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.535357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.535360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:31.535367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.535379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:31.535399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.535525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.535535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.535550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.535621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 826 partition: 0 MaxSeqNo: 45 sessionId: src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0
2025-10-01T14:09:31.535940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a3e894-5bb64585-75a6a7ac-7040ca04_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:31.538396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0] Write session: try to update token
2025-10-01T14:09:31.538413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:31.555127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 826 sessionId: src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:31.555574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:31.555592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:31.555595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:31.555597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:31.555606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255241089631959:6820]
2025-10-01T14:09:31.555610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255241089631959:6820]
2025-10-01T14:09:31.555614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255241089631959:6820]
2025-10-01T14:09:31.555655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:31.555667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:31.555670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:31.555674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:31.555675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.555677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:31.555810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:31.557740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:31.616297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255243466497883:7609]
2025-10-01T14:09:31.616518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 825, pipe: [1:7556255243466497883:7609]
2025-10-01T14:09:31.696573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:31.697029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.697046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.697080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497883:7609], now have 1 active actors on pipe
2025-10-01T14:09:31.697280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:31.697302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255243466497883:7609]
2025-10-01T14:09:31.697320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:31.697323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:31.697373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 826 reason: error at write: Disconnected sessionId: src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0
2025-10-01T14:09:31.697394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:31.697587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 826 sessionId: src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0 is DEAD
2025-10-01T14:09:31.697725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:31.697735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0] Write session will restart in 0.007004s
2025-10-01T14:09:31.697759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0] Write session: Do CDS request
2025-10-01T14:09:31.697764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:31.705948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.706023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:31.706037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 827
2025-10-01T14:09:31.706179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.706224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:31.706236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:31.706242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:31.706678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 827 sessionId:  describe result for acl check
2025-10-01T14:09:31.706713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:31.706720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:31.706722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:31.706727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255243466497957:7764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:31.707266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255243466497957:7764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:31.709304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255243466497957:7764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:31.709733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:31.711865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:31.712101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:31.712114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:31.712126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:31.712185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:31.712197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255243466497957:7764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:31.712210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255243466497957:7764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:31.712215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255243466497957:7764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:31.712226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255241089632148:6832]
2025-10-01T14:09:31.712223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:31.712830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:31.713157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:31.713216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:31.713557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:31.713619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.713625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.713626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.713627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.713628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.713630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.713631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.713632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.713633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.713644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.713646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.713647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.713648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.713649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.713655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.713664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.713667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.713671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.713679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.713684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.713687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.713690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.713694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.713699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.713702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.713706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.713709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.713713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.713720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.713728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.713738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.713744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.713752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.713758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.713766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.713771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.713780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.713785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.713793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.713798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.713803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.713808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.713812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.713830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.713839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.713844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.713853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.713858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.713869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.713875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.713883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.713887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.713893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.713902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.713907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.713912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.713953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:31.717789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:31.718460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:31.718473Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:31.718476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:31.718480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:31.718487Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 826 [2:7556255241089632148:6832]
2025-10-01T14:09:31.718506Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:31.718528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:31.718542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.718551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.718555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.718581Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:31.718595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:31.718601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:31.718668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.718677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.718679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.718687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:31.718690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:31.718769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:31.718777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.718788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.718801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.718826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:31.718855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466497888:2446], now have 1 active actors on pipe
2025-10-01T14:09:31.718866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466498038:7764], now have 1 active actors on pipe
2025-10-01T14:09:31.718877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255241089632143:6832]
2025-10-01T14:09:31.718886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255241089632143:6832]
2025-10-01T14:09:31.718888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255241089632143:6832]
2025-10-01T14:09:31.718900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 826
2025-10-01T14:09:31.718906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:31.718903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 826
2025-10-01T14:09:31.718927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:31.718932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:31.718936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:31.718939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:31.718940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:31.718943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:31.718991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.719002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.719016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255241089632143:6832]
2025-10-01T14:09:31.719026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:31.719037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:31.719054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:31.719065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.719069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.719075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:31.719084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.719097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:31.719267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.719636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.719648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.719669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.719757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 827 partition: 0 MaxSeqNo: 45 sessionId: src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0
2025-10-01T14:09:31.720117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e663800f-4d260b7d-2b44dda8-fdc10ea2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:31.722652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0] Write session: try to update token
2025-10-01T14:09:31.722672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:31.737356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 827 sessionId: src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:31.739496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:31.739525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:31.739528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:31.739530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:31.739540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255241089632143:6832]
2025-10-01T14:09:31.739546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255241089632143:6832]
2025-10-01T14:09:31.739550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255241089632143:6832]
2025-10-01T14:09:31.739603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:31.739602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:31.739608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:31.739611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:31.739616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.739619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:31.739776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:31.740081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:31.797557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255243466498050:7609]
2025-10-01T14:09:31.797877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 826, pipe: [1:7556255243466498050:7609]
2025-10-01T14:09:31.896970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:31.897347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.897364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.897402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466498050:7609], now have 1 active actors on pipe
2025-10-01T14:09:31.897631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:31.898203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:31.898212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0] Write session will restart in 0.007945s
2025-10-01T14:09:31.898239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0] Write session: Do CDS request
2025-10-01T14:09:31.898246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:31.897647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:31.897714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:31.897800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 827 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0
2025-10-01T14:09:31.898032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 827 sessionId: src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0 is DEAD
2025-10-01T14:09:31.898162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255243466498050:7609]
2025-10-01T14:09:31.907926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.908080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:31.908106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 828
2025-10-01T14:09:31.908251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:31.908294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:31.908305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:31.908309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:31.908740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 828 sessionId:  describe result for acl check
2025-10-01T14:09:31.908793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:31.908800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:31.908802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:31.908808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255243466498120:7768] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:31.909371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255243466498120:7768] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:31.911614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255243466498120:7768] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:31.912664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:31.918878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:31.919134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:31.919153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:31.919166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:31.919226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:31.919263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255241089632305:6835]
2025-10-01T14:09:31.919962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:31.920344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:31.920424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:31.920793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:31.920869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.920875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.920876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.920878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.920879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.920880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.920882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.920883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.920885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.920886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.920887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.920889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.920890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.920891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.920897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.920906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.920910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.920914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.920917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.920921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.920925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.920928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.920933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.920937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.920940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.920944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.920947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.920950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.920958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.920966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:31.920973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.920978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:31.920983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.920987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:31.920992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.920997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:31.921002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.921007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:31.921011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.921018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:31.921022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.921027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:31.921031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.921036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:31.921040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.921044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:31.921048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.921053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.921058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.921062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.921066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.921071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.921084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.921089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:31.921093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.921098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:31.921136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:31.918989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255243466498120:7768] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:31.919006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255243466498120:7768] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:31.919009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255243466498120:7768] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:31.919020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:31.928563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:31.929270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:31.929285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:31.929289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:31.929293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:31.929302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 827 [2:7556255241089632305:6835]
2025-10-01T14:09:31.929321Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:31.929342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:31.929351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.929355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.929357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.929377Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:31.929388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:31.929395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:31.929460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.929467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.929469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.929473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:31.929476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:31.929552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:31.929560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.929572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:31.929583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:31.929603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:31.929626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466498202:7768], now have 1 active actors on pipe
2025-10-01T14:09:31.929634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466498052:2446], now have 1 active actors on pipe
2025-10-01T14:09:31.929643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255241089632300:6835]
2025-10-01T14:09:31.929651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255241089632300:6835]
2025-10-01T14:09:31.929653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255241089632300:6835]
2025-10-01T14:09:31.929670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:31.929694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:31.929696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:31.929700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:31.929703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:31.929708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:31.929711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:31.929716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 827
2025-10-01T14:09:31.929722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 827
2025-10-01T14:09:31.929750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255241089632300:6835]
2025-10-01T14:09:31.929764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:31.929774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:31.929818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.929832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.929863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:31.929875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:31.929880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:31.929887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:31.929898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:31.929912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:31.929934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.930085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.930093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.930107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:31.930225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 828 partition: 0 MaxSeqNo: 45 sessionId: src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0
2025-10-01T14:09:31.930648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b88c21d-b943f84-fc4b265a-49498ab8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:31.933299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0] Write session: try to update token
2025-10-01T14:09:31.933313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:31.941369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:31.941389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:31.941400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255241089632300:6835]
2025-10-01T14:09:31.941438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:31.941449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:31.941644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:31.941810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:31.942004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:31.942180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:31.942433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:31.942479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:31.948508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 828 sessionId: src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:31.951313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:31.951551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:31.951573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:31.951612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:31.951693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:31.960802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:31.960823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:31.960825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:31.960828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:31.960838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255241089632300:6835]
2025-10-01T14:09:31.960842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255241089632300:6835]
2025-10-01T14:09:31.960845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255241089632300:6835]
2025-10-01T14:09:31.960876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:31.960887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:31.960890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:31.960891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:31.960899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:31.960901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:31.961048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:31.998534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255243466498215:7609]
2025-10-01T14:09:32.002943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 827, pipe: [1:7556255243466498215:7609]
2025-10-01T14:09:32.123024Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:32.130584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.130617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.130784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.130843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.130900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.130954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.131003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.131010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.131074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.131139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.131203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.131264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.131305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.131312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.131386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.131455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.131531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.131593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.131638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.131646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.131723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.131787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.131847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.131911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.131954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.131960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.132064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.132119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.132198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.132260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.132318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.132325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.132393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.132459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.132529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.132598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.132654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.132657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.132725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.132802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.132874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.132951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.132995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.133003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.133067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.133129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.133191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.133255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.133299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.133306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.133374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.133433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.133501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.133576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.133624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.133632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.133700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.133760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.133826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.133892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.133933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.133946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.134014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255243466498215:7609], now have 1 active actors on pipe
2025-10-01T14:09:32.134286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:32.134287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:32.134302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:32.134331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 828 reason: error at write: Disconnected sessionId: src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0
2025-10-01T14:09:32.134336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255243466498215:7609]
2025-10-01T14:09:32.134529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 828 sessionId: src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0 is DEAD
2025-10-01T14:09:32.134651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:32.134662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0] Write session will restart in 0.005171s
2025-10-01T14:09:32.134686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0] Write session: Do CDS request
2025-10-01T14:09:32.134692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:32.135220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:32.140952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:32.141016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:32.141029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 829
2025-10-01T14:09:32.141195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:32.141228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:32.141236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:32.141239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:32.141632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 829 sessionId:  describe result for acl check
2025-10-01T14:09:32.141662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:32.141667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:32.141668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:32.141672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255247761465531:7774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:32.142114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255247761465531:7774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:32.145173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255247761465531:7774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:32.148087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:32.148402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255247761465531:7774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:32.148427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255247761465531:7774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:32.148431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255247761465531:7774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:32.148440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:32.150204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:32.150423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:32.150434Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:32.150447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:32.150505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:32.150553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255245384599760:6837]
2025-10-01T14:09:32.151180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:32.151438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:32.151479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:32.151791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:32.151865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.151872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.151873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.151874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.151875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.151876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.151877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.151879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.151880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.151881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.151882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.151883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.151884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.151885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.151891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.151899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.151903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.151906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.151909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.151912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.151915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.151919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.151922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.151925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.151929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.151932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.151935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.151938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.151947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.151954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.151960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.151965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.151970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.151975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.151979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.151984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.151989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.151994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.152012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.152020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.152031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.152036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.152045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.152051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.152059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.152064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.152073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.152078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.152083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.152092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.152096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.152105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.152110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.152120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.152125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.152134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.152173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:32.156019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:32.156920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:32.156933Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:32.156935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:32.156939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:32.156946Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 828 [2:7556255245384599760:6837]
2025-10-01T14:09:32.156960Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:32.156978Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:32.156981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:32.156985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:32.156992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:32.157009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:32.157018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:32.157024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:32.157085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.157096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.157098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.157101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:32.157104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:32.157178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:32.157189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.157201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.157210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.157229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:32.157255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761465669:7774], now have 1 active actors on pipe
2025-10-01T14:09:32.157265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761465517:2446], now have 1 active actors on pipe
2025-10-01T14:09:32.157274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255245384599754:6837]
2025-10-01T14:09:32.157277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255245384599754:6837]
2025-10-01T14:09:32.157279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255245384599754:6837]
2025-10-01T14:09:32.157292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 828
2025-10-01T14:09:32.157311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 828
2025-10-01T14:09:32.157299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:32.157320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:32.157323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:32.157326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:32.157328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:32.157335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:32.157339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:32.157384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255245384599754:6837]
2025-10-01T14:09:32.157396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:32.157411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:32.157412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.157416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.157457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:32.157468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:32.157477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:32.157480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:32.157489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:32.157504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:32.157525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:32.157704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.157712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.157727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:32.157942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 829 partition: 0 MaxSeqNo: 45 sessionId: src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0
2025-10-01T14:09:32.158335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85ce6a81-2fad7139-b4112d6b-3a91c4ec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:32.160958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0] Write session: try to update token
2025-10-01T14:09:32.160977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:32.176605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 829 sessionId: src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:32.178708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:32.178731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:32.178734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:32.178736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:32.178746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255245384599754:6837]
2025-10-01T14:09:32.178751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255245384599754:6837]
2025-10-01T14:09:32.178756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255245384599754:6837]
2025-10-01T14:09:32.178802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:32.178809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:32.178814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:32.178817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.178818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:32.178819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:32.178971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:32.179136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:32.234266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255247761465680:7609]
2025-10-01T14:09:32.234530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 828, pipe: [1:7556255247761465680:7609]
2025-10-01T14:09:32.334546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:32.334807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.334819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.334851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761465680:7609], now have 1 active actors on pipe
2025-10-01T14:09:32.339012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:32.341647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:32.341660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0] Write session will restart in 0.009999s
2025-10-01T14:09:32.341684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0] Write session: Do CDS request
2025-10-01T14:09:32.341690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:32.339759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:32.339837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 829 reason: status is not ok: tablet will be restarted right now sessionId: src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0
2025-10-01T14:09:32.340026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 829 sessionId: src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0 is DEAD
2025-10-01T14:09:32.340142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:32.340184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255247761465680:7609]
2025-10-01T14:09:32.352905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:32.353007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:32.353020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 830
2025-10-01T14:09:32.353562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:32.353607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:32.353616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:32.353620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:32.354061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 830 sessionId:  describe result for acl check
2025-10-01T14:09:32.354097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:32.354103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:32.354106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:32.354111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255247761465813:7785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:32.354663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255247761465813:7785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:32.355808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:32.356501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255247761465813:7785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:32.357959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:32.358178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:32.358188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:32.358212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:32.358260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:32.358299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255245384599917:6839]
2025-10-01T14:09:32.358859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255247761465813:7785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:32.358870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255247761465813:7785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:32.358873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255247761465813:7785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:32.358879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:32.358894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:32.359123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:32.359156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:32.359436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:32.359485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.359490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.359491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.359492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.359493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.359494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.359495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.359496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.359497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.359498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.359499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.359500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.359500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.359502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.359506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.359514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.359518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.359521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.359524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.359527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.359530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.359533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.359536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.359540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.359543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.359547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.359550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.359554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.359559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.359565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.359571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.359575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.359579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.359583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.359586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.359591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.359595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.359599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.359603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.359606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.359611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.359616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.359619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.359623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.359627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.359632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.359636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.359640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.359644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.359648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.359651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.359655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.359659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.359664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.359667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.359671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.359704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:32.363258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:32.363873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:32.363888Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:32.363890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:32.363893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:32.363899Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 829 [2:7556255245384599917:6839]
2025-10-01T14:09:32.363913Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:32.363931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:32.363938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:32.363942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:32.363944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:32.363958Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:32.363967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:32.363973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:32.364036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.364042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.364044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.364047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:32.364049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:32.364109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:32.364117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.364126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.364135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.364148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:32.364164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761465704:2446], now have 1 active actors on pipe
2025-10-01T14:09:32.364166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761465856:7785], now have 1 active actors on pipe
2025-10-01T14:09:32.364173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255245384599912:6839]
2025-10-01T14:09:32.364175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255245384599912:6839]
2025-10-01T14:09:32.364177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255245384599912:6839]
2025-10-01T14:09:32.364188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:32.364200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:32.364201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:32.364202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:32.364205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:32.364213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:32.364217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:32.364245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 829
2025-10-01T14:09:32.364238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255245384599912:6839]
2025-10-01T14:09:32.364252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:32.364274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:32.364287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 829
2025-10-01T14:09:32.364364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.364376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.364397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|42164e71-36a250e2-b8f5f649-f21fc593_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:32.364406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:32.364410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:32.364416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:32.364425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:32.364436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:32.364451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:32.364597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.364603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.364615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:32.364702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 830 partition: 0 MaxSeqNo: 45 sessionId: src_id|42164e71-36a250e2-b8f5f649-f21fc593_0
2025-10-01T14:09:32.365040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22daa227-276ddb4b-db3bfc06-d0fba89_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|42164e71-36a250e2-b8f5f649-f21fc593_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:32.367421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42164e71-36a250e2-b8f5f649-f21fc593_0] Write session: try to update token
2025-10-01T14:09:32.367438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42164e71-36a250e2-b8f5f649-f21fc593_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:32.381751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 830 sessionId: src_id|42164e71-36a250e2-b8f5f649-f21fc593_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:32.384273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:32.385015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.385042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.385063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:32.385067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:32.385069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:32.385071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:32.385081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255245384599912:6839]
2025-10-01T14:09:32.385086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255245384599912:6839]
2025-10-01T14:09:32.385090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255245384599912:6839]
2025-10-01T14:09:32.385131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:32.385143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:32.385146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:32.385146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:32.385153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.385156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:32.385293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:32.440114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255247761465877:7609]
2025-10-01T14:09:32.440420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 829, pipe: [1:7556255247761465877:7609]
2025-10-01T14:09:32.539440Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:32.539739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:32.539802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761465877:7609], now have 1 active actors on pipe
2025-10-01T14:09:32.539932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:32.540014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:32.540071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255247761465877:7609]
2025-10-01T14:09:32.540091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:32.540098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:32.540115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 830 reason: error at write: Disconnected sessionId: src_id|42164e71-36a250e2-b8f5f649-f21fc593_0
2025-10-01T14:09:32.540282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 830 sessionId: src_id|42164e71-36a250e2-b8f5f649-f21fc593_0 is DEAD
2025-10-01T14:09:32.540400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42164e71-36a250e2-b8f5f649-f21fc593_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:32.540406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42164e71-36a250e2-b8f5f649-f21fc593_0] Write session will restart in 0.009447s
2025-10-01T14:09:32.540424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42164e71-36a250e2-b8f5f649-f21fc593_0] Write session: Do CDS request
2025-10-01T14:09:32.540431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42164e71-36a250e2-b8f5f649-f21fc593_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:32.550871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|42164e71-36a250e2-b8f5f649-f21fc593_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:32.551018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:32.551031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 831
2025-10-01T14:09:32.551192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:32.551224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:32.551246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:32.551251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:32.551654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 831 sessionId:  describe result for acl check
2025-10-01T14:09:32.551681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:32.551685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:32.551687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:32.551690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255247761465942:7790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:32.552079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255247761465942:7790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:32.554667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255247761465942:7790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:32.556705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:32.559247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:32.559441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:32.559450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:32.559462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:32.559511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:32.559550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255245384600096:6845]
2025-10-01T14:09:32.559579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255247761465942:7790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:32.559603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255247761465942:7790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:32.559606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255247761465942:7790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:32.559615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:32.560006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:32.561039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:32.561091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:32.561403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:32.561468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.561473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.561474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.561475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.561477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.561478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.561479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.561480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.561481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.561482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.561483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.561484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.561485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.561486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.561491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.561500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.561504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.561508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.561511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.561515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.561519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.561522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.561526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.561529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.561533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.561536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.561539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.561543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.561549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.561556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.561563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.561568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.561572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.561577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.561581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.561586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.561590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.561595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.561599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.561603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.561614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.561623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.561627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.561632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.561641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.561649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.561655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.561663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.561668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.561677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.561680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.561689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.561693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.561697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.561700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.561704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.561740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:32.565518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:32.566113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:32.566128Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:32.566131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:32.566135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:32.566143Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 830 [2:7556255245384600096:6845]
2025-10-01T14:09:32.566163Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:32.566185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:32.566192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:32.566197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:32.566204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:32.566221Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:32.566231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:32.566242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:32.566305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.566312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.566315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.566319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:32.566322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:32.566408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:32.566419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.566431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.566444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.566466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:32.566491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761465880:2446], now have 1 active actors on pipe
2025-10-01T14:09:32.566495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761466034:7790], now have 1 active actors on pipe
2025-10-01T14:09:32.566502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255245384600091:6845]
2025-10-01T14:09:32.566509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255245384600091:6845]
2025-10-01T14:09:32.566512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255245384600091:6845]
2025-10-01T14:09:32.566525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:32.566541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:32.566543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:32.566549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:32.566551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:32.566560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:32.566564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:32.566554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 830
2025-10-01T14:09:32.566569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 830
2025-10-01T14:09:32.566601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255245384600091:6845]
2025-10-01T14:09:32.566609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:32.566612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:32.566643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.566652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.566682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:32.566693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:32.566697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:32.566700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:32.566709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:32.566721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:32.566746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:32.566911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.566922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.566939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:32.567044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 831 partition: 0 MaxSeqNo: 45 sessionId: src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0
2025-10-01T14:09:32.567418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|42164e71-36a250e2-b8f5f649-f21fc593_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:32.569827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0] Write session: try to update token
2025-10-01T14:09:32.569842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:32.584084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 831 sessionId: src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:32.586580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:32.586891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.586913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.586944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:32.587043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:32.591091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:32.591112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:32.591114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:32.591116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:32.591126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255245384600091:6845]
2025-10-01T14:09:32.591131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255245384600091:6845]
2025-10-01T14:09:32.591135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255245384600091:6845]
2025-10-01T14:09:32.591174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:32.591180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:32.591184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:32.591189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:32.591197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.591199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:32.591335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:32.640345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255247761466058:7609]
2025-10-01T14:09:32.640776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 830, pipe: [1:7556255247761466058:7609]
2025-10-01T14:09:32.741178Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:32.750030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.750071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.750293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.753969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:32.754036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:32.754039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:32.754083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 831 reason: error at write: Disconnected sessionId: src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0
2025-10-01T14:09:32.754323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 831 sessionId: src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0 is DEAD
2025-10-01T14:09:32.750388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.754387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255247761466058:7609]
2025-10-01T14:09:32.750465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.750534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.750578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.750584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.750662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.750725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.750788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.754503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:32.754515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0] Write session will restart in 0.007431s
2025-10-01T14:09:32.754542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0] Write session: Do CDS request
2025-10-01T14:09:32.754549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:32.750852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.750896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.750899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.750963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.751028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.751091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.751154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.751203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.751205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.751269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.751326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.751395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.751463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.751502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.751504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.751565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.751623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.751681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.751741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.751782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.751784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.751851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.751909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.751974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.752038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.752082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.752085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.752149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.752207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.752267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.752328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.752367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.752370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.752449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.752508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.752567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.752631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.752674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.752679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.752777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.752845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.752909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.752975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.753021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.753024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.753102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:32.753169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:32.753234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:32.753309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:32.753359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:32.753362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:32.753451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761466058:7609], now have 1 active actors on pipe
2025-10-01T14:09:32.754930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:32.762953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:32.763097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:32.763120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 832
2025-10-01T14:09:32.763563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:32.763620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:32.763626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:32.763630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:32.764113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 832 sessionId:  describe result for acl check
2025-10-01T14:09:32.764167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:32.764175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:32.764177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:32.764182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255247761466088:7796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:32.764822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255247761466088:7796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:32.770347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255247761466088:7796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:32.779458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:32.779126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255247761466088:7796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:32.779143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255247761466088:7796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:32.779146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255247761466088:7796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:32.779155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:32.782663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:32.782934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:32.782939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:32.782951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:32.783004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:32.783033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255245384600286:6857]
2025-10-01T14:09:32.783460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:32.783772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:32.783805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:32.784040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:32.784077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.784078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.784078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.784079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.784080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.784081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.784081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.784082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.784083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.784084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.784084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.784085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.784086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.784087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.784090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.784096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.784098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.784100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.784102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.784105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.784107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.784109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.784112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.784114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.784116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.784118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.784120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.784122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.784127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.784132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:32.784137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.784140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:32.784143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.784146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:32.784150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.784152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:32.784155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.784158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:32.784161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.784164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:32.784167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.784172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:32.784176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.784181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:32.784186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.784192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:32.784196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.784199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.784202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.784204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.784208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.784212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.784214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.784217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:32.784219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.784222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:32.784243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:32.791098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:32.791847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:32.791854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:32.791856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:32.791859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:32.791867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 831 [2:7556255245384600286:6857]
2025-10-01T14:09:32.791885Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:32.791902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:32.791906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:32.791909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:32.791912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:32.791929Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:32.791934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:32.791941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:32.792007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.792010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.792012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.792015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:32.792018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:32.792099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:32.792103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.792115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:32.792126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:32.792143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:32.792163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761466214:7796], now have 1 active actors on pipe
2025-10-01T14:09:32.792167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761466064:2446], now have 1 active actors on pipe
2025-10-01T14:09:32.792176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255245384600280:6857]
2025-10-01T14:09:32.792179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255245384600280:6857]
2025-10-01T14:09:32.792181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255245384600280:6857]
2025-10-01T14:09:32.792196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:32.792213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:32.792218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:32.792223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:32.792226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:32.792228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:32.792232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:32.792267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255245384600280:6857]
2025-10-01T14:09:32.792276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:32.792285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:32.795028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 831
2025-10-01T14:09:32.795060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 831
2025-10-01T14:09:32.795419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.795451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.795489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77ed024f-4158239-e979116a-b501ffd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:32.795515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:32.795522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:32.795525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:32.795540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:32.795562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:32.795587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:32.796171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.796193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.796223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:32.798143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 832 partition: 0 MaxSeqNo: 45 sessionId: src_id|77ed024f-4158239-e979116a-b501ffd_0
2025-10-01T14:09:32.799459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118ad963-8fb3ca7b-b570d465-8f24d2ed_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|77ed024f-4158239-e979116a-b501ffd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:32.801954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77ed024f-4158239-e979116a-b501ffd_0] Write session: try to update token
2025-10-01T14:09:32.801973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77ed024f-4158239-e979116a-b501ffd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:32.817032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:32.817055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:32.817058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:32.817060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:32.817071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255245384600280:6857]
2025-10-01T14:09:32.817076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255245384600280:6857]
2025-10-01T14:09:32.817086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255245384600280:6857]
2025-10-01T14:09:32.817145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:32.817158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:32.817161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:32.817323Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:32.818472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:32.818493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:32.818497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:32.822062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 832 sessionId: src_id|77ed024f-4158239-e979116a-b501ffd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:32.824475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:32.858468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255247761466228:7609]
2025-10-01T14:09:32.859584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 831, pipe: [1:7556255247761466228:7609]
2025-10-01T14:09:32.998919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:32.999204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:32.999216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:32.999250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761466228:7609], now have 1 active actors on pipe
2025-10-01T14:09:32.999681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:33.000439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ed024f-4158239-e979116a-b501ffd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:33.000453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ed024f-4158239-e979116a-b501ffd_0] Write session will restart in 0.009212s
2025-10-01T14:09:33.000481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ed024f-4158239-e979116a-b501ffd_0] Write session: Do CDS request
2025-10-01T14:09:33.000488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ed024f-4158239-e979116a-b501ffd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:32.999943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255247761466228:7609]
2025-10-01T14:09:32.999976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:33.000049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 832 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77ed024f-4158239-e979116a-b501ffd_0
2025-10-01T14:09:33.000210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 832 sessionId: src_id|77ed024f-4158239-e979116a-b501ffd_0 is DEAD
2025-10-01T14:09:33.000583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:33.010950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77ed024f-4158239-e979116a-b501ffd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.011087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:33.011104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 833
2025-10-01T14:09:33.011780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.011819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:33.011828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:33.011833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:33.012328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 833 sessionId:  describe result for acl check
2025-10-01T14:09:33.012361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:33.012368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:33.012370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:33.012376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255252056433563:7800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:33.012913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255252056433563:7800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:33.018581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255252056433563:7800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:33.022005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255252056433563:7800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:33.022023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255252056433563:7800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:33.022026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255252056433563:7800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:33.022035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:33.023687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:33.026339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:33.026610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:33.026627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:33.026641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:33.026704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:33.026767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255249679567744:6860]
2025-10-01T14:09:33.027392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:33.027857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:33.027916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:33.028235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:33.028315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.028325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.028326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.028327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.028328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.028330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.028331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.028333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.028334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.028335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.028337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.028339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.028340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.028341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.028349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.028360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.028364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.028368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.028372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.028376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.028380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.028383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.028387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.028392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.028395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.028399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.028404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.028408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.028418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.028427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.028433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.028440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.028445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.028451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.028455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.028460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.028468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.028473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.028477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.028484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.028490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.028495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.028499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.028505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.028509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.028515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.028528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.028533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.028538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.028544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.028549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.028554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.028559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.028565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.028569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.028574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.028616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:33.033013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:33.033676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:33.033694Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:33.033698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:33.033703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:33.033710Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 832 [2:7556255249679567744:6860]
2025-10-01T14:09:33.033727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:33.033752Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:33.033760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.033764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.033766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.033785Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:33.033790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:33.033804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:33.033869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.033876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.033878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.033882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:33.033884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:33.033958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:33.033967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.033981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.033996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.034015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:33.034039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056433679:7800], now have 1 active actors on pipe
2025-10-01T14:09:33.034048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255247761466234:2446], now have 1 active actors on pipe
2025-10-01T14:09:33.034057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255249679567739:6860]
2025-10-01T14:09:33.034063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255249679567739:6860]
2025-10-01T14:09:33.034065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255249679567739:6860]
2025-10-01T14:09:33.034081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:33.034094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:33.034099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:33.034108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:33.034110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:33.034114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:33.034117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:33.034154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255249679567739:6860]
2025-10-01T14:09:33.034170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:33.034191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:33.034129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 832
2025-10-01T14:09:33.034166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 832
2025-10-01T14:09:33.034441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.034454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.034480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d7ae336-af923e0-e5ea955b-357085f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:33.034492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.034503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.034506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:33.034516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.034527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:33.034554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.035011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.035023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.035043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.035175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 833 partition: 0 MaxSeqNo: 45 sessionId: src_id|6d7ae336-af923e0-e5ea955b-357085f2_0
2025-10-01T14:09:33.035576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77ed024f-4158239-e979116a-b501ffd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6d7ae336-af923e0-e5ea955b-357085f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:33.038113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d7ae336-af923e0-e5ea955b-357085f2_0] Write session: try to update token
2025-10-01T14:09:33.038138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d7ae336-af923e0-e5ea955b-357085f2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:33.048127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:33.048156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:33.048167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255249679567739:6860]
2025-10-01T14:09:33.048220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:33.048233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:33.048411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:33.048571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:33.048737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:33.048920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:33.049153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:33.049212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:33.057726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 833 sessionId: src_id|6d7ae336-af923e0-e5ea955b-357085f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:33.060845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:33.061062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.061091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.061130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:33.061204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:33.074201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:33.074224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:33.074227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:33.074229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:33.074241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255249679567739:6860]
2025-10-01T14:09:33.074245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255249679567739:6860]
2025-10-01T14:09:33.074250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255249679567739:6860]
2025-10-01T14:09:33.074303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:33.074313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.074317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:33.074319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:33.074339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:33.074344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:33.074492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:33.099544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255252056433694:7609]
2025-10-01T14:09:33.099827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 832, pipe: [1:7556255252056433694:7609]
2025-10-01T14:09:33.211017Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:33.221482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.221518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.221723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.221801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.221877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.221951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.222002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.222007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.222092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.222160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.222234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.222307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.222362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.225980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:33.225997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:33.226033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 833 reason: error at write: Disconnected sessionId: src_id|6d7ae336-af923e0-e5ea955b-357085f2_0
2025-10-01T14:09:33.226212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:33.226397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d7ae336-af923e0-e5ea955b-357085f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:33.226409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d7ae336-af923e0-e5ea955b-357085f2_0] Write session will restart in 0.006585s
2025-10-01T14:09:33.226266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255252056433694:7609]
2025-10-01T14:09:33.226291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 833 sessionId: src_id|6d7ae336-af923e0-e5ea955b-357085f2_0 is DEAD
2025-10-01T14:09:33.226434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d7ae336-af923e0-e5ea955b-357085f2_0] Write session: Do CDS request
2025-10-01T14:09:33.226440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d7ae336-af923e0-e5ea955b-357085f2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:33.222488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.222586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.222664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.222729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.222795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.222848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.222851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.222928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.222998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.223065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.223131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.223188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.223192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.223272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.223339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.223412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.223481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.223532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.223534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.223611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.223678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.223752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.223825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.223892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.223895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.223975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.224040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.224109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.224179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.224234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.224236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.224315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.224387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.224455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.224523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.224578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.224580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.224663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.224729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.224815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.224888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.224944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.224947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.225029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.225096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.225169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.225240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.225297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.225300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.225392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056433694:7609], now have 1 active actors on pipe
2025-10-01T14:09:33.226231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:33.238327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d7ae336-af923e0-e5ea955b-357085f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.238547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:33.238565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 834
2025-10-01T14:09:33.238753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.238800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:33.238807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:33.238812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:33.239365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 834 sessionId:  describe result for acl check
2025-10-01T14:09:33.239409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:33.239411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:33.239413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:33.239419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255252056433730:7804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:33.239977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255252056433730:7804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:33.242355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255252056433730:7804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:33.245386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255252056433730:7804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:33.245408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255252056433730:7804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:33.245412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255252056433730:7804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:33.245422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:33.247124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:33.249722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:33.249939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:33.249944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:33.249955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:33.250005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:33.250050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255249679567906:6862]
2025-10-01T14:09:33.250969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:33.251404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:33.251445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:33.251781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:33.251836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.251838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.251839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.251841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.251842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.251844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.251845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.251847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.251849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.251850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.251851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.251853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.251854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.251856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.251861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.251873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.251877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.251881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.251886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.251890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.251895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.251899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.251904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.251908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.251913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.251917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.251921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.251925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.251932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.251941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.251947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.251953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.251958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.251963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.251969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.251975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.251980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.251986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.251990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.251996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.252038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.252044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.252049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.252054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.252059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.252066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.252070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.252076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.252081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.252087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.252091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.252097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.252103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.252109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.252115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.252119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.252165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:33.257484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:33.258274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:33.258281Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:33.258285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:33.258290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:33.258298Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 833 [2:7556255249679567906:6862]
2025-10-01T14:09:33.258316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:33.258336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:33.258340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.258344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.258346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.258365Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:33.258390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:33.258397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:33.258466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.258468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.258470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.258473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:33.258476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:33.259124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 833
2025-10-01T14:09:33.259159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 833
2025-10-01T14:09:33.262268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 834 partition: 0 MaxSeqNo: 45 sessionId: src_id|68a2217e-e7daf443-66fd91fe-5012a964_0
2025-10-01T14:09:33.259373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:33.259387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.259401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.259415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.259434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:33.259457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056433697:2446], now have 1 active actors on pipe
2025-10-01T14:09:33.259461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056433852:7804], now have 1 active actors on pipe
2025-10-01T14:09:33.259469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255249679567901:6862]
2025-10-01T14:09:33.259471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255249679567901:6862]
2025-10-01T14:09:33.259474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255249679567901:6862]
2025-10-01T14:09:33.259491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:33.259507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:33.259522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:33.259526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:33.259577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255249679567901:6862]
2025-10-01T14:09:33.259580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:33.259686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:33.259688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:33.259691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:33.259697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:33.261647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.261658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.261694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68a2217e-e7daf443-66fd91fe-5012a964_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:33.261704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.261710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.261713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:33.261729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.261746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:33.261763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.262065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.262073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.262094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.262699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d7ae336-af923e0-e5ea955b-357085f2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|68a2217e-e7daf443-66fd91fe-5012a964_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:33.265062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2217e-e7daf443-66fd91fe-5012a964_0] Write session: try to update token
2025-10-01T14:09:33.265093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2217e-e7daf443-66fd91fe-5012a964_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:33.273563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:33.273588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:33.273597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255249679567901:6862]
2025-10-01T14:09:33.273647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:33.273655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:33.273828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:33.273973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:33.274109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:33.274254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:33.274495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:33.274550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:33.279683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 834 sessionId: src_id|68a2217e-e7daf443-66fd91fe-5012a964_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:33.282118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:33.282368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.282407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.282446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:33.282533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:33.301433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:33.301463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:33.301466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:33.301468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:33.301480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255249679567901:6862]
2025-10-01T14:09:33.301488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255249679567901:6862]
2025-10-01T14:09:33.301492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255249679567901:6862]
2025-10-01T14:09:33.301545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:33.301548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:33.301553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.301554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:33.301555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:33.301558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:33.301721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:33.326411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255252056433871:7609]
2025-10-01T14:09:33.326752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 833, pipe: [1:7556255252056433871:7609]
2025-10-01T14:09:33.435805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:33.446823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.446873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.447227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.447429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.447630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.447837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.447955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.447980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.448169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.448328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.448486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.448653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.448767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.448782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.448946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.449125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.449310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.449489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.449620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.449643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.449842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.449964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.450052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.450147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.450222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.450230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.450355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.450450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.450529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.450610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.450670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.450683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.450774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.450859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.450945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.451049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.451143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.451152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.451286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.451418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.451515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.451593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.451653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.451663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.451751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.451827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.451914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.452004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.452067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.452074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.452155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.452229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.452303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.452384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.452444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.452451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.452532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.452615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.452699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.452795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.452850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.452857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.452938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056433871:7609], now have 1 active actors on pipe
2025-10-01T14:09:33.453184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:33.453209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255252056433871:7609]
2025-10-01T14:09:33.453238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:33.453241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:33.453270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 834 reason: error at write: Disconnected sessionId: src_id|68a2217e-e7daf443-66fd91fe-5012a964_0
2025-10-01T14:09:33.453487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 834 sessionId: src_id|68a2217e-e7daf443-66fd91fe-5012a964_0 is DEAD
2025-10-01T14:09:33.453621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2217e-e7daf443-66fd91fe-5012a964_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:33.453633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2217e-e7daf443-66fd91fe-5012a964_0] Write session will restart in 0.007745s
2025-10-01T14:09:33.453658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2217e-e7daf443-66fd91fe-5012a964_0] Write session: Do CDS request
2025-10-01T14:09:33.453664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2217e-e7daf443-66fd91fe-5012a964_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:33.454719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:33.462977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2217e-e7daf443-66fd91fe-5012a964_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.463082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:33.463100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 835
2025-10-01T14:09:33.463763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.463796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:33.463801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:33.463805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:33.464387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 835 sessionId:  describe result for acl check
2025-10-01T14:09:33.464418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:33.464424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:33.464425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:33.464430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255252056433941:7816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:33.464913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255252056433941:7816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:33.467284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255252056433941:7816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:33.469085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:33.471778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:33.472001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:33.472015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:33.472027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:33.472088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:33.472135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255249679568089:6867]
2025-10-01T14:09:33.472146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255252056433941:7816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:33.472159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255252056433941:7816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:33.472162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255252056433941:7816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:33.472174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:33.472815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:33.473125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:33.473174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:33.473496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:33.473564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.473571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.473572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.473573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.473574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.473575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.473576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.473577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.473578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.473580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.473581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.473582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.473583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.473584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.473590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.473599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.473603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.473606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.473609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.473613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.473616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.473619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.473622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.473625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.473628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.473631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.473634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.473637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.473645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.473651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.473657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.473661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.473665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.473670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.473673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.473678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.473682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.473687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.473691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.473695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.473700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.473705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.473710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.473722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.473733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.473743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.473753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.473764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.473773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.473785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.473794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.473805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.473815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.473824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.473834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.473844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.473893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:33.478280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:33.479376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:33.479396Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:33.479398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:33.479403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:33.479416Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 834 [2:7556255249679568089:6867]
2025-10-01T14:09:33.479439Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:33.479464Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:33.479471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.479474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.479477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.479492Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:33.479505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:33.479517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:33.479590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.479598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.479600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.479603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:33.479606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:33.479684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:33.479692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.479705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.479717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.479732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:33.479755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056434055:7816], now have 1 active actors on pipe
2025-10-01T14:09:33.479764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056433900:2446], now have 1 active actors on pipe
2025-10-01T14:09:33.479771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255249679568078:6867]
2025-10-01T14:09:33.479773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255249679568078:6867]
2025-10-01T14:09:33.479775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255249679568078:6867]
2025-10-01T14:09:33.479787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:33.479797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:33.479800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:33.479802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:33.479805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:33.479820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:33.479829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:33.479830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 834
2025-10-01T14:09:33.479836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 834
2025-10-01T14:09:33.479873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255249679568078:6867]
2025-10-01T14:09:33.479884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:33.479888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:33.479906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.479915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.479959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:33.479972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.479976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.479979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:33.479989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.480005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:33.480027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.480155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.480165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.480180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.480268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 835 partition: 0 MaxSeqNo: 45 sessionId: src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0
2025-10-01T14:09:33.480641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68a2217e-e7daf443-66fd91fe-5012a964_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:33.483384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0] Write session: try to update token
2025-10-01T14:09:33.483405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:33.496979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 835 sessionId: src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:33.499426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:33.499676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.499711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.499751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:33.499816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:33.503130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:33.503154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:33.503157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:33.503159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:33.503169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255249679568078:6867]
2025-10-01T14:09:33.503174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255249679568078:6867]
2025-10-01T14:09:33.503179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255249679568078:6867]
2025-10-01T14:09:33.503229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:33.503235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:33.503242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:33.503243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.503245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:33.503246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:33.503412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:33.553211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255252056434067:7609]
2025-10-01T14:09:33.553526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 834, pipe: [1:7556255252056434067:7609]
2025-10-01T14:09:33.649789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:33.658504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.658537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.658720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.658782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.658843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.658897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.659232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.659241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.659316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.659369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.659427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.659489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.659528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.659530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.659592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.659642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.659702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.659765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.659804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.659807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.659869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.659923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.659984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.660053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.660124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.660129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.660192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.660245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.660307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.660382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.660430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.660440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.660506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.660574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.660645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.660713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.660774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.660784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.660848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.660909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.660976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.661038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.661080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.661089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.661153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.661208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.661270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.661331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.661375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.661382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.661447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.661514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.661573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.661629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.661680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.661684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.661755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:33.661830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:33.661903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:33.661968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:33.662024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:33.662032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:33.662101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056434067:7609], now have 1 active actors on pipe
2025-10-01T14:09:33.662410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255252056434067:7609]
2025-10-01T14:09:33.662413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:33.662417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:33.662440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:33.662444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 835 reason: error at write: Disconnected sessionId: src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0
2025-10-01T14:09:33.662668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 835 sessionId: src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0 is DEAD
2025-10-01T14:09:33.662790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:33.662802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0] Write session will restart in 0.008624s
2025-10-01T14:09:33.662828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0] Write session: Do CDS request
2025-10-01T14:09:33.662834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:33.662845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:33.672936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.673065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:33.673078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 836
2025-10-01T14:09:33.673168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.673198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:33.673208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:33.673212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:33.673580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 836 sessionId:  describe result for acl check
2025-10-01T14:09:33.673609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:33.673612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:33.673613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:33.673616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255252056434096:7821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:33.674032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255252056434096:7821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:33.676391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255252056434096:7821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:33.678890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255252056434096:7821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:33.678904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255252056434096:7821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:33.678908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255252056434096:7821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:33.678916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:33.687078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:33.693509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:33.693802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:33.693812Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:33.693824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:33.693879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:33.693930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255249679568253:6870]
2025-10-01T14:09:33.694537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:33.694921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:33.694975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:33.695342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:33.695412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.695419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.695420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.695422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.695424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.695426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.695427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.695429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.695430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.695431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.695433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.695434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.695436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.695438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.695444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.695454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.695457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.695462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.695465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.695469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.695474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.695477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.695481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.695492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.695500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.695509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.695514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.695524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.695540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.695556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.695566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.695572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.695582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.695589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.695600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.695610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.695621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.695632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.695642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.695652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.695665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.695675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.695681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.695686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.695691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.695697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.695706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.695713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.695722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.695732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.695737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.695748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.695753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.695763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.695773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.695779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.695828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:33.700109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:33.700983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:33.701004Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:33.701007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:33.701011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:33.701022Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 835 [2:7556255249679568253:6870]
2025-10-01T14:09:33.701039Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:33.701065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:33.701077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.701081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.701084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.701103Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:33.701115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:33.701121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:33.701202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.701210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.701212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.701216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:33.701218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:33.701308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:33.701316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.701330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.701347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.701371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:33.701407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056434144:7821], now have 1 active actors on pipe
2025-10-01T14:09:33.701416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056434082:2446], now have 1 active actors on pipe
2025-10-01T14:09:33.701425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255249679568248:6870]
2025-10-01T14:09:33.701427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255249679568248:6870]
2025-10-01T14:09:33.701430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255249679568248:6870]
2025-10-01T14:09:33.701445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:33.701460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:33.701464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:33.701470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:33.701472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:33.701478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:33.701481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:33.701432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 835
2025-10-01T14:09:33.701522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255249679568248:6870]
2025-10-01T14:09:33.701538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:33.701546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:33.701559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.701565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.701615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2b0f195-898d5606-e008882f-2c479018_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:33.701629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.701634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.701636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:33.701646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.701661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:33.701675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 835
2025-10-01T14:09:33.701690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.701815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.701830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.701844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.701945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 836 partition: 0 MaxSeqNo: 45 sessionId: src_id|f2b0f195-898d5606-e008882f-2c479018_0
2025-10-01T14:09:33.702315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef8e942c-c43e2949-232f91c8-b76fe348_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f2b0f195-898d5606-e008882f-2c479018_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:33.705817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0f195-898d5606-e008882f-2c479018_0] Write session: try to update token
2025-10-01T14:09:33.705833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0f195-898d5606-e008882f-2c479018_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:33.726890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:33.726916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:33.726920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:33.726922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:33.726933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255249679568248:6870]
2025-10-01T14:09:33.726939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255249679568248:6870]
2025-10-01T14:09:33.726945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255249679568248:6870]
2025-10-01T14:09:33.727001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:33.727019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.727022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:33.727222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:33.729332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 836 sessionId: src_id|f2b0f195-898d5606-e008882f-2c479018_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:33.730670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:33.730688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:33.730692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:33.733275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:33.763487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255252056434261:7609]
2025-10-01T14:09:33.764915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 835, pipe: [1:7556255252056434261:7609]
2025-10-01T14:09:33.883097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:33.883399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.883410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.883467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056434261:7609], now have 1 active actors on pipe
2025-10-01T14:09:33.883874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255252056434261:7609]
2025-10-01T14:09:33.883917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:33.883959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:33.883962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:33.884045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 836 reason: error at write: Disconnected sessionId: src_id|f2b0f195-898d5606-e008882f-2c479018_0
2025-10-01T14:09:33.884212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 836 sessionId: src_id|f2b0f195-898d5606-e008882f-2c479018_0 is DEAD
2025-10-01T14:09:33.884459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:33.886570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0f195-898d5606-e008882f-2c479018_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:33.886581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0f195-898d5606-e008882f-2c479018_0] Write session will restart in 0.006648s
2025-10-01T14:09:33.886610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0f195-898d5606-e008882f-2c479018_0] Write session: Do CDS request
2025-10-01T14:09:33.886615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0f195-898d5606-e008882f-2c479018_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:33.895080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0f195-898d5606-e008882f-2c479018_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.895202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:33.895221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 837
2025-10-01T14:09:33.895747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:33.895790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:33.895796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:33.895803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:33.897017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 837 sessionId:  describe result for acl check
2025-10-01T14:09:33.897051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:33.897053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:33.897055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:33.897060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255252056434388:7826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:33.897616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255252056434388:7826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:33.898940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:33.900023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255252056434388:7826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:33.902064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:33.902294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:33.902305Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:33.902316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:33.902363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:33.902412Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255249679568448:6883]
2025-10-01T14:09:33.902723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255252056434388:7826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:33.902749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255252056434388:7826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:33.902753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255252056434388:7826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:33.902761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:33.903062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:33.903292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:33.903327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:33.903580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:33.903649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.903656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.903657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.903658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.903659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.903661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.903662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.903663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.903665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.903666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.903667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.903667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.903669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.903670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.903675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.903685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.903688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.903692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.903696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.903700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.903703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.903708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.903711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.903716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.903719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.903723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.903727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.903731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.903737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.903744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:33.903760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.903766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:33.903771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.903776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:33.903781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.903787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:33.903791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.903796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:33.903801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.903806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:33.903812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.903817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:33.903823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.903828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:33.903833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.903838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:33.903842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.903848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.903853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.903858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.903862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.903867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.903873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.903878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:33.903882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.903887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:33.903924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:33.907717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:33.908384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:33.908398Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:33.908400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:33.908404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:33.908410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 836 [2:7556255249679568448:6883]
2025-10-01T14:09:33.908425Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:33.908443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:33.908446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.908450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.908452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.908469Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:33.908475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:33.908482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:33.908542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.908553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.908556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.908559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:33.908561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:33.908625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:33.908634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.908645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:33.908656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:33.908671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:33.908691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056434423:7826], now have 1 active actors on pipe
2025-10-01T14:09:33.908694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056434264:2446], now have 1 active actors on pipe
2025-10-01T14:09:33.908702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255249679568443:6883]
2025-10-01T14:09:33.908704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255249679568443:6883]
2025-10-01T14:09:33.908706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255249679568443:6883]
2025-10-01T14:09:33.908719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:33.908730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:33.908732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:33.908743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:33.908745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:33.908758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:33.908761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:33.908793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255249679568443:6883]
2025-10-01T14:09:33.908801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:33.908816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:33.908805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 836
2025-10-01T14:09:33.908832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 836
2025-10-01T14:09:33.908904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.908915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.908944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:33.908955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:33.908960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:33.908962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:33.908972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:33.908987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:33.909003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.909142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:33.909151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:33.909167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:33.909248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 837 partition: 0 MaxSeqNo: 45 sessionId: src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0
2025-10-01T14:09:33.909617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2b0f195-898d5606-e008882f-2c479018_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:33.912663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0] Write session: try to update token
2025-10-01T14:09:33.912685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:33.930011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:33.930036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:33.930039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:33.930041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:33.930051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255249679568443:6883]
2025-10-01T14:09:33.930056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255249679568443:6883]
2025-10-01T14:09:33.930060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255249679568443:6883]
2025-10-01T14:09:33.930106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:33.930111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:33.930113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:33.930117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:33.930118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:33.930121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:33.930267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:33.938441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 837 sessionId: src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:33.941568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:33.984333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255252056434436:7609]
2025-10-01T14:09:33.986975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 836, pipe: [1:7556255252056434436:7609]
2025-10-01T14:09:34.080812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:34.081307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.081328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.081348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255252056434436:7609], now have 1 active actors on pipe
2025-10-01T14:09:34.081600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:34.081618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:34.081624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:34.081670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255252056434436:7609]
2025-10-01T14:09:34.081714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 837 reason: error at write: Disconnected sessionId: src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0
2025-10-01T14:09:34.081901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 837 sessionId: src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0 is DEAD
2025-10-01T14:09:34.082058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:34.082069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0] Write session will restart in 0.008132s
2025-10-01T14:09:34.082094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0] Write session: Do CDS request
2025-10-01T14:09:34.082102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:34.081544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:34.092447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.092561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:34.092597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 838
2025-10-01T14:09:34.092782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.092822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:34.092827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:34.092842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:34.093254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 838 sessionId:  describe result for acl check
2025-10-01T14:09:34.093300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:34.093303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:34.093307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:34.093313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255256351401844:7830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:34.093775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255256351401844:7830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:34.095302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:34.095834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255256351401844:7830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:34.098204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:34.098464Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:34.098490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:34.098502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:34.098562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:34.098607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255253974535909:6885]
2025-10-01T14:09:34.098671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255256351401844:7830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:34.098687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255256351401844:7830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:34.098690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255256351401844:7830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:34.098698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:34.099240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:34.099558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:34.099600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:34.099902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:34.099959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.099967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.099968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.099970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.099971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.099972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.099973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.099974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.099975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.099976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.099977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.099979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.099980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.099981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.099987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.099997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.100001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.100005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.100008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.100011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.100015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.100019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.100022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.100028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.100031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.100035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.100039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.100043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.100051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.100059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.100065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.100070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.100074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.100080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.100084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.100090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.100095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.100100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.100105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.100110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.100115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.100120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.100125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.100130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.100135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.100140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.100144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.100149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.100155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.100160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.100164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.100169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.100173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.100178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.100182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.100187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.100225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:34.104209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:34.104854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:34.104872Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:34.104875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:34.104879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:34.104886Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 837 [2:7556255253974535909:6885]
2025-10-01T14:09:34.104902Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:34.104934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:34.104938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.104942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.104944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.104961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:34.104972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:34.104978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:34.105040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.105048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.105050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.105053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:34.105057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:34.105125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:34.105133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.105145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.105156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.105174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:34.105198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351401734:2446], now have 1 active actors on pipe
2025-10-01T14:09:34.105209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351401895:7830], now have 1 active actors on pipe
2025-10-01T14:09:34.105215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255253974535904:6885]
2025-10-01T14:09:34.105217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255253974535904:6885]
2025-10-01T14:09:34.105218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255253974535904:6885]
2025-10-01T14:09:34.105228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:34.105240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:34.105250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:34.105254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:34.105259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:34.105259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:34.105261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:34.105294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255253974535904:6885]
2025-10-01T14:09:34.105265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 837
2025-10-01T14:09:34.105301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:34.105289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 837
2025-10-01T14:09:34.105303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:34.105328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.105335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.105365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:34.105376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.105380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.105382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:34.105392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.105401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:34.105421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.105574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.105580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.105590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.105676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 838 partition: 0 MaxSeqNo: 45 sessionId: src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0
2025-10-01T14:09:34.106155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4134ff4-5bd4c830-46c8bbe9-b2b952af_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:34.109311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0] Write session: try to update token
2025-10-01T14:09:34.109334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:34.125633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:34.125657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:34.125660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:34.125662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:34.125671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255253974535904:6885]
2025-10-01T14:09:34.125679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255253974535904:6885]
2025-10-01T14:09:34.125684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255253974535904:6885]
2025-10-01T14:09:34.125733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:34.125737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:34.125743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:34.125744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.125747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:34.125746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:34.126282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:34.127172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 838 sessionId: src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:34.129645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:34.181944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255256351401907:7609]
2025-10-01T14:09:34.182258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 837, pipe: [1:7556255256351401907:7609]
2025-10-01T14:09:34.291803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:34.292356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.292376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.292426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351401907:7609], now have 1 active actors on pipe
2025-10-01T14:09:34.292716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:34.292725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255256351401907:7609]
2025-10-01T14:09:34.292770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:34.292772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:34.292840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 838 reason: error at write: Disconnected sessionId: src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0
2025-10-01T14:09:34.293022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 838 sessionId: src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0 is DEAD
2025-10-01T14:09:34.293383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:34.293398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0] Write session will restart in 0.009901s
2025-10-01T14:09:34.293425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0] Write session: Do CDS request
2025-10-01T14:09:34.293444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:34.292764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:34.304967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.305077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:34.305092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 839
2025-10-01T14:09:34.305301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.305352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:34.305362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:34.305366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:34.306608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 839 sessionId:  describe result for acl check
2025-10-01T14:09:34.306646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:34.306647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:34.306649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:34.306654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255256351402001:7835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:34.307178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255256351402001:7835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:34.309763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255256351402001:7835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:34.310985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:34.313571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:34.313949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255256351402001:7835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:34.313963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255256351402001:7835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:34.313967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255256351402001:7835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:34.313975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:34.313829Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:34.313860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:34.313875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:34.313949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:34.313985Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255253974536076:6887]
2025-10-01T14:09:34.314645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:34.314963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:34.315010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:34.315330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:34.315389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.315406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.315407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.315409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.315410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.315411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.315412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.315414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.315415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.315417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.315418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.315419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.315420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.315422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.315428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.315439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.315444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.315447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.315451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.315454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.315458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.315461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.315465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.315469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.315473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.315477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.315480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.315484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.315492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.315501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.315507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.315513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.315518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.315524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.315528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.315533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.315538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.315543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.315547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.315553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.315558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.315563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.315568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.315573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.315578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.315583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.315588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.315594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.315599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.315604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.315608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.315615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.315620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.315624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.315629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.315635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.315674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:34.319752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:34.320588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:34.320604Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:34.320606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:34.320609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:34.320614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 838 [2:7556255253974536076:6887]
2025-10-01T14:09:34.320628Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:34.320641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:34.320643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.320645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.320647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.320660Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:34.320664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:34.320668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:34.320717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.320723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.320725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.320727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:34.320729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:34.320790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:34.320801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.320809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.320815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.320824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:34.320837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255253974536071:6887]
2025-10-01T14:09:34.320838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255253974536071:6887]
2025-10-01T14:09:34.320841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255253974536071:6887]
2025-10-01T14:09:34.320847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:34.320856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:34.320858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:34.320860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:34.320863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:34.320867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:34.320869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:34.320877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351401916:2446], now have 1 active actors on pipe
2025-10-01T14:09:34.320880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402079:7835], now have 1 active actors on pipe
2025-10-01T14:09:34.320907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255253974536071:6887]
2025-10-01T14:09:34.320912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:34.320920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:34.320965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 838
2025-10-01T14:09:34.320975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 838
2025-10-01T14:09:34.321071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.321084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.321106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c600ce7d-af834feb-d8074a8e-36be814e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:34.321115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.321119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.321120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:34.321127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.321134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:34.321145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.321309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.321314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.321325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.321407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 839 partition: 0 MaxSeqNo: 45 sessionId: src_id|c600ce7d-af834feb-d8074a8e-36be814e_0
2025-10-01T14:09:34.321805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e777ac-f2afd06e-466b4e62-b3932f68_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c600ce7d-af834feb-d8074a8e-36be814e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:34.324999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c600ce7d-af834feb-d8074a8e-36be814e_0] Write session: try to update token
2025-10-01T14:09:34.325022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c600ce7d-af834feb-d8074a8e-36be814e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:34.338045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:34.338070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:34.338082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255253974536071:6887]
2025-10-01T14:09:34.338129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:34.338138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:34.338321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:34.338504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:34.338663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:34.338820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:34.339026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:34.339074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:34.349497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 839 sessionId: src_id|c600ce7d-af834feb-d8074a8e-36be814e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:34.351394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:34.351419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:34.351421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:34.351423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:34.351436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255253974536071:6887]
2025-10-01T14:09:34.351441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255253974536071:6887]
2025-10-01T14:09:34.351444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255253974536071:6887]
2025-10-01T14:09:34.351483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:34.351493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:34.351497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:34.351500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.351501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:34.351503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:34.351643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:34.352151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:34.392874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255256351402093:7609]
2025-10-01T14:09:34.393140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 838, pipe: [1:7556255256351402093:7609]
2025-10-01T14:09:34.498543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:34.498804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.498819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.498846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402093:7609], now have 1 active actors on pipe
2025-10-01T14:09:34.499063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:34.499067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:34.499093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255256351402093:7609]
2025-10-01T14:09:34.499133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:34.499218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 839 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c600ce7d-af834feb-d8074a8e-36be814e_0
2025-10-01T14:09:34.499395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 839 sessionId: src_id|c600ce7d-af834feb-d8074a8e-36be814e_0 is DEAD
2025-10-01T14:09:34.499719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c600ce7d-af834feb-d8074a8e-36be814e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:34.499730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c600ce7d-af834feb-d8074a8e-36be814e_0] Write session will restart in 0.009249s
2025-10-01T14:09:34.499758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c600ce7d-af834feb-d8074a8e-36be814e_0] Write session: Do CDS request
2025-10-01T14:09:34.499764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c600ce7d-af834feb-d8074a8e-36be814e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:34.509902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c600ce7d-af834feb-d8074a8e-36be814e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.509985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:34.510004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 840
2025-10-01T14:09:34.510106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.510133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:34.510143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:34.510149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:34.510534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 840 sessionId:  describe result for acl check
2025-10-01T14:09:34.510561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:34.510566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:34.510567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:34.510571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255256351402234:7846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:34.511055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255256351402234:7846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:34.512617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:34.513154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255256351402234:7846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:34.515746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:34.515926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:34.515936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:34.515943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:34.515978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:34.516005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255253974536264:6893]
2025-10-01T14:09:34.516075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255256351402234:7846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:34.516088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255256351402234:7846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:34.516093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255256351402234:7846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:34.516102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:34.516469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:34.516720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:34.516758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:34.516993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:34.517037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.517041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.517041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.517042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.517043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.517044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.517045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.517045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.517046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.517047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.517047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.517048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.517048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.517049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.517053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.517059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.517061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.517063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.517066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.517068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.517070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.517081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.517084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.517086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.517089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.517091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.517093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.517095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.517100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.517104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.517108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.517111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.517114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.517117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.517120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.517123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.517125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.517128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.517131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.517134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.517137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.517140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.517142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.517145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.517147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.517150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.517153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.517156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.517160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.517163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.517165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.517168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.517172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.517175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.517177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.517180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.517202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:34.521049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:34.521629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:34.521642Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:34.521644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:34.521647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:34.521653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 839 [2:7556255253974536264:6893]
2025-10-01T14:09:34.521664Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:34.521676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:34.521677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.521680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.521682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.521693Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:34.521699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:34.521704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:34.521744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.521750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.521752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.521754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:34.521756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:34.521805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:34.521811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.521817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.521823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.521831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:34.521847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255253974536259:6893]
2025-10-01T14:09:34.521852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255253974536259:6893]
2025-10-01T14:09:34.521853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255253974536259:6893]
2025-10-01T14:09:34.521860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:34.521870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:34.521871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:34.521875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:34.521877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:34.521882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:34.521884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:34.521891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402279:7846], now have 1 active actors on pipe
2025-10-01T14:09:34.521894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402120:2446], now have 1 active actors on pipe
2025-10-01T14:09:34.521917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255253974536259:6893]
2025-10-01T14:09:34.521928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:34.521938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:34.521946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 839
2025-10-01T14:09:34.521947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 839
2025-10-01T14:09:34.521999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.522007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.522029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:34.522038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.522041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.522043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:34.522232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.522243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:34.522254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.522439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.522447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.522458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.522538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 840 partition: 0 MaxSeqNo: 45 sessionId: src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0
2025-10-01T14:09:34.522844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c600ce7d-af834feb-d8074a8e-36be814e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:34.525564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0] Write session: try to update token
2025-10-01T14:09:34.525578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:34.532502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:34.532519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:34.532528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255253974536259:6893]
2025-10-01T14:09:34.532561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:34.532575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:34.532733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:34.532866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:34.532998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:34.533114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:34.533306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:34.533340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:34.542063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 840 sessionId: src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:34.544931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:34.545268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.545298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.545334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:34.545430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:34.551695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:34.551720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:34.551723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:34.551725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:34.551736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255253974536259:6893]
2025-10-01T14:09:34.551740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255253974536259:6893]
2025-10-01T14:09:34.551744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255253974536259:6893]
2025-10-01T14:09:34.551797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:34.551798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:34.551803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:34.551807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:34.551809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.551812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:34.551956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:34.599267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255256351402303:7609]
2025-10-01T14:09:34.600031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 839, pipe: [1:7556255256351402303:7609]
2025-10-01T14:09:34.712559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:34.721727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.721759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.721940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.722008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.722075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.722143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.722207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.722216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.722291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.722358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.722463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.722531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.722575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.722580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.722653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.722714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.722772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.722832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.722880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.722888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.722955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.723029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.723094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.723159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.723202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.723210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.723277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.723337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.723401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.723465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.723507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.723514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.723580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.723642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.723712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.723780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.723823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.723830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.723896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.723955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.724019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.724084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.724132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.724138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.724202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.724266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.724329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.724390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.724442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.724451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.724517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.724575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.724635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.724696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.724738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.724745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.724822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:34.724879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:34.724949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:34.725018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:34.725059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:34.725066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:34.725134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402303:7609], now have 1 active actors on pipe
2025-10-01T14:09:34.725405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:34.725424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:34.725433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:34.725459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 840 reason: error at write: Disconnected sessionId: src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0
2025-10-01T14:09:34.725504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255256351402303:7609]
2025-10-01T14:09:34.725647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 840 sessionId: src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0 is DEAD
2025-10-01T14:09:34.726022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:34.726033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0] Write session will restart in 0.008360s
2025-10-01T14:09:34.726055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0] Write session: Do CDS request
2025-10-01T14:09:34.726059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:34.726133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:34.736079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.736404Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:34.736417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 841
2025-10-01T14:09:34.736606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.736662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:34.736673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:34.736677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:34.737175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 841 sessionId:  describe result for acl check
2025-10-01T14:09:34.737211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:34.737213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:34.737214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:34.737220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255256351402407:7852] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:34.737776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255256351402407:7852] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:34.739377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:34.739732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255256351402407:7852] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:34.742240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:34.742518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:34.742529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:34.742541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:34.742591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:34.742637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255253974536437:6895]
2025-10-01T14:09:34.742644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255256351402407:7852] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:34.742663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255256351402407:7852] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:34.742667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255256351402407:7852] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:34.742682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:34.743251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:34.743534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:34.743575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:34.743874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:34.743926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.743931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.743933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.743934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.743936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.743937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.743938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.743939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.743940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.743941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.743943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.743944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.743945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.743946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.743951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.743961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.743964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.743968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.743972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.743976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.743979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.743982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.743986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.743990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.743994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.743997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.744001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.744005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.744011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.744019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.744025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.744031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.744037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.744047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.744051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.744056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.744065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.744071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.744079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.744083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.744093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.744098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.744106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.744111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.744115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.744125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.744133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.744139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.744145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.744153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.744157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.744162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.744170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.744174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.744182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.744186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.744223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:34.748089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:34.748724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:34.748739Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:34.748741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:34.748755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:34.748762Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 840 [2:7556255253974536437:6895]
2025-10-01T14:09:34.748778Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:34.748798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:34.748805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.748808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.748810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.748828Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:34.748839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:34.748846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:34.748907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.748913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.748915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.748918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:34.748920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:34.748986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:34.748995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.749007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.749018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.749038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:34.749062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402472:7852], now have 1 active actors on pipe
2025-10-01T14:09:34.749069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402308:2446], now have 1 active actors on pipe
2025-10-01T14:09:34.749076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255253974536428:6895]
2025-10-01T14:09:34.749078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255253974536428:6895]
2025-10-01T14:09:34.749080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255253974536428:6895]
2025-10-01T14:09:34.749095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:34.749113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:34.749126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:34.749132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:34.749135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:34.749135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 840
2025-10-01T14:09:34.749137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:34.749145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 840
2025-10-01T14:09:34.749139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:34.749168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255253974536428:6895]
2025-10-01T14:09:34.749171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:34.749173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:34.749185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.749189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.749236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:34.749251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.749255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.749257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:34.749265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.749273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:34.749295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.749460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.749467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.749483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.749569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 841 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0
2025-10-01T14:09:34.749950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73d44292-f98c3e9a-fa7b8a14-3ad45fd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:34.752726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0] Write session: try to update token
2025-10-01T14:09:34.752742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:34.767230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 841 sessionId: src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:34.769783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:34.770114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.770145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.770166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:34.770170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:34.770172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:34.770174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:34.770182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255253974536428:6895]
2025-10-01T14:09:34.770186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255253974536428:6895]
2025-10-01T14:09:34.770190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255253974536428:6895]
2025-10-01T14:09:34.770223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:34.770237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:34.770248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:34.770250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:34.770260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.770262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:34.770424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:34.825518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255256351402484:7609]
2025-10-01T14:09:34.825770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 840, pipe: [1:7556255256351402484:7609]
2025-10-01T14:09:34.915803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:34.916175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:34.916236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402484:7609], now have 1 active actors on pipe
2025-10-01T14:09:34.916415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:34.916505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:34.916512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:34.916581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 841 reason: error at write: Disconnected sessionId: src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0
2025-10-01T14:09:34.916761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 841 sessionId: src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0 is DEAD
2025-10-01T14:09:34.916859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:34.916868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0] Write session will restart in 0.007164s
2025-10-01T14:09:34.916893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0] Write session: Do CDS request
2025-10-01T14:09:34.916900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:34.916994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:34.917043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255256351402484:7609]
2025-10-01T14:09:34.924919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.925479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:34.925493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 842
2025-10-01T14:09:34.925702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:34.925756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:34.925767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:34.925772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:34.928226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 842 sessionId:  describe result for acl check
2025-10-01T14:09:34.928269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:34.928271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:34.928273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:34.928278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255256351402545:7856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:34.928838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255256351402545:7856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:34.932141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255256351402545:7856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:34.934014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:34.936440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:34.936635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:34.936645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:34.936656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:34.936671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255256351402545:7856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:34.936703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:34.936687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255256351402545:7856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:34.936691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255256351402545:7856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:34.936699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:34.936763Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255253974536634:6908]
2025-10-01T14:09:34.937294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:34.937614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:34.937684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:34.938047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:34.938105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.938111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.938112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.938113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.938114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.938115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.938117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.938118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.938119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.938120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.938121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.938122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.938123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.938124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.938129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.938138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.938142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.938147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.938151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.938154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.938157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.938161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.938164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.938168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.938171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.938175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.938192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.938196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.938204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.938211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:34.938217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.938223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:34.938235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.938240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:34.938244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.938248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:34.938253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.938258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:34.938262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.938267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:34.938272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.938277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:34.938281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.938292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:34.938296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.938305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:34.938310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.938315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.938320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.938329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.938333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.938338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.938347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.938352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:34.938360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.938365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:34.938415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:34.942385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:34.943029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:34.943044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:34.943047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:34.943051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:34.943057Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 841 [2:7556255253974536634:6908]
2025-10-01T14:09:34.943073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:34.943090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:34.943098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.943101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.943103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.943119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:34.943144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:34.943149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:34.943204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.943211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.943213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.943216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:34.943219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:34.943284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:34.943292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.943303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:34.943313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:34.943329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:34.943350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402486:2446], now have 1 active actors on pipe
2025-10-01T14:09:34.943359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255256351402650:7856], now have 1 active actors on pipe
2025-10-01T14:09:34.943368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255253974536628:6908]
2025-10-01T14:09:34.943371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255253974536628:6908]
2025-10-01T14:09:34.943373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255253974536628:6908]
2025-10-01T14:09:34.943386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:34.943400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:34.943402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:34.943408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:34.943410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:34.943416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:34.943418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:34.943400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 841
2025-10-01T14:09:34.943424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 841
2025-10-01T14:09:34.943454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255253974536628:6908]
2025-10-01T14:09:34.943464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:34.943470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:34.943485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.943493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.943540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:34.943551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:34.943555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:34.943557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:34.943566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:34.943574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:34.943598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.943725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:34.943733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:34.943746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:34.943824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 842 partition: 0 MaxSeqNo: 45 sessionId: src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0
2025-10-01T14:09:34.944205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b4cb276-3929e517-6cc2ce32-67e57adb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:34.947278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0] Write session: try to update token
2025-10-01T14:09:34.947303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:34.964762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:34.964784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:34.964787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:34.964790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:34.964800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255253974536628:6908]
2025-10-01T14:09:34.964805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255253974536628:6908]
2025-10-01T14:09:34.964808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255253974536628:6908]
2025-10-01T14:09:34.964848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:34.964854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:34.964860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:34.964865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:34.964872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:34.964883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:34.965029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:34.968649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 842 sessionId: src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:34.971106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:35.016995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255260646369958:7609]
2025-10-01T14:09:35.017240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 841, pipe: [1:7556255260646369958:7609]
2025-10-01T14:09:35.114425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:35.114966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.114978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.115015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646369958:7609], now have 1 active actors on pipe
2025-10-01T14:09:35.115208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:35.115250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255260646369958:7609]
2025-10-01T14:09:35.115255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:35.115258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:35.115280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:35.115324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 842 reason: error at write: Disconnected sessionId: src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0
2025-10-01T14:09:35.115541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 842 sessionId: src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0 is DEAD
2025-10-01T14:09:35.115692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:35.115702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0] Write session will restart in 0.005373s
2025-10-01T14:09:35.115729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0] Write session: Do CDS request
2025-10-01T14:09:35.115735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:35.122769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.122889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:35.122905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 843
2025-10-01T14:09:35.123102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.123133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:35.123143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:35.123146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:35.123551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 843 sessionId:  describe result for acl check
2025-10-01T14:09:35.123578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:35.123586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:35.123588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:35.123593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255260646369977:7860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:35.124123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255260646369977:7860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:35.126736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255260646369977:7860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:35.129643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255260646369977:7860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:35.129659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255260646369977:7860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:35.129663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255260646369977:7860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:35.129670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:35.130206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:35.132312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:35.132520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:35.132524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:35.132535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:35.132597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:35.132636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255258269504102:6910]
2025-10-01T14:09:35.133251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:35.133567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:35.133612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:35.133901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:35.133978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.133985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.133987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.133988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.133989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.133990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.133991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.133992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.133994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.133995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.133996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.133998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.133998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.133999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.134006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.134015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.134019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.134023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.134026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.134030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.134033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.134037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.134041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.134045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.134048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.134051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.134055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.134058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.134066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.134073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.134079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.134085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.134089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.134094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.134098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.134103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.134108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.134118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.134123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.134128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.134134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.134143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.134147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.134152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.134157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.134166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.134169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.134174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.134182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.134187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.134191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.134199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.134202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.134206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.134211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.134219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.134256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:35.138024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:35.138647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:35.138664Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:35.138667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:35.138670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:35.138678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 842 [2:7556255258269504102:6910]
2025-10-01T14:09:35.138693Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:35.138709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:35.138711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.138714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.138716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.138729Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:35.138737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:35.138742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:35.138787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.138794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.138796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.138798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:35.138800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:35.138852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:35.138857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.138864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.138870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.138879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:35.138894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255258269504097:6910]
2025-10-01T14:09:35.138899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255258269504097:6910]
2025-10-01T14:09:35.138900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255258269504097:6910]
2025-10-01T14:09:35.138907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:35.138918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:35.138918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:35.138921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:35.138923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:35.138927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:35.138929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:35.138937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646369962:2446], now have 1 active actors on pipe
2025-10-01T14:09:35.138940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370129:7860], now have 1 active actors on pipe
2025-10-01T14:09:35.138968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255258269504097:6910]
2025-10-01T14:09:35.138979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:35.138999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:35.139017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 842
2025-10-01T14:09:35.139076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 842
2025-10-01T14:09:35.139139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.139149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.139171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:35.139178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.139182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.139184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:35.139193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.139201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:35.139218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.139380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.139391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.139414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.139510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 843 partition: 0 MaxSeqNo: 45 sessionId: src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0
2025-10-01T14:09:35.139904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e5e275a-f4bbe24-d7c81d06-bb7a161_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:35.142692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0] Write session: try to update token
2025-10-01T14:09:35.142715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:35.160367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:35.160385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:35.160388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:35.160390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:35.160400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255258269504097:6910]
2025-10-01T14:09:35.160404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255258269504097:6910]
2025-10-01T14:09:35.160408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255258269504097:6910]
2025-10-01T14:09:35.160447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:35.160458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:35.160458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:35.160461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:35.160465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.160467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:35.160610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:35.162326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 843 sessionId: src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:35.164912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:35.215677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255260646370143:7609]
2025-10-01T14:09:35.216022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 842, pipe: [1:7556255260646370143:7609]
2025-10-01T14:09:35.310700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:35.311187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.311202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.311243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370143:7609], now have 1 active actors on pipe
2025-10-01T14:09:35.311418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:35.311451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:35.311502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255260646370143:7609]
2025-10-01T14:09:35.311524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:35.311590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 843 reason: status is not ok: tablet will be restarted right now sessionId: src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0
2025-10-01T14:09:35.311782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 843 sessionId: src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0 is DEAD
2025-10-01T14:09:35.311964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:35.311978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0] Write session will restart in 0.005256s
2025-10-01T14:09:35.312007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0] Write session: Do CDS request
2025-10-01T14:09:35.312014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:35.318880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.318993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:35.319011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 844
2025-10-01T14:09:35.319111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.319143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:35.319152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:35.319156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:35.319605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 844 sessionId:  describe result for acl check
2025-10-01T14:09:35.319652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:35.319660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:35.319662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:35.319667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255260646370167:7865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:35.320225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255260646370167:7865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:35.323635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255260646370167:7865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:35.326305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255260646370167:7865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:35.326324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255260646370167:7865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:35.326328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255260646370167:7865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:35.326336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:35.326510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:35.329284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:35.329580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:35.329592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:35.329622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:35.329692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:35.329739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255258269504273:6912]
2025-10-01T14:09:35.330405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:35.330767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:35.330811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:35.331143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:35.331220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.331226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.331227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.331229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.331229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.331230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.331232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.331233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.331234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.331235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.331236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.331238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.331239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.331240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.331246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.331255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.331259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.331263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.331267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.331271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.331274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.331277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.331281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.331285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.331289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.331298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.331301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.331310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.331319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.331330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.331341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.331351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.331361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.331370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.331380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.331386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.331395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.331405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.331414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.331423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.331431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.331440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.331449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.331455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.331463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.331468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.331481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.331491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.331502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.331510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.331519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.331528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.331537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.331545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.331554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.331560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.331600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:35.335570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:35.336335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:35.336352Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:35.336355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:35.336358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:35.336365Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 843 [2:7556255258269504273:6912]
2025-10-01T14:09:35.336383Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:35.336401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:35.336411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.336414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.336416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.336433Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:35.336439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:35.336445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:35.336506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.336514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.336516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.336519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:35.336522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:35.336590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:35.336597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.336609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.336619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.336637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:35.336660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370153:2446], now have 1 active actors on pipe
2025-10-01T14:09:35.336667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370319:7865], now have 1 active actors on pipe
2025-10-01T14:09:35.336675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255258269504267:6912]
2025-10-01T14:09:35.336681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255258269504267:6912]
2025-10-01T14:09:35.336683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255258269504267:6912]
2025-10-01T14:09:35.336697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:35.336707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:35.336713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:35.336715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:35.336716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:35.336737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:35.336760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:35.336731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 843
2025-10-01T14:09:35.336760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 843
2025-10-01T14:09:35.336804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255258269504267:6912]
2025-10-01T14:09:35.336819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:35.336834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.336833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:35.336846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.336895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:35.336906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.336910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.336912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:35.336922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.336934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:35.336957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.337108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.337120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.337144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.337232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 844 partition: 0 MaxSeqNo: 45 sessionId: src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0
2025-10-01T14:09:35.337603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99c6dbd0-7e46dadf-fafb83de-a5336f95_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:35.340068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0] Write session: try to update token
2025-10-01T14:09:35.340088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:35.356660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 844 sessionId: src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:35.358141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:35.358160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:35.358162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:35.358164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:35.358174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255258269504267:6912]
2025-10-01T14:09:35.358180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255258269504267:6912]
2025-10-01T14:09:35.358184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255258269504267:6912]
2025-10-01T14:09:35.358227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:35.358231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:35.358238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.358240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:35.358241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:35.358243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:35.358365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:35.359410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:35.411703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255260646370334:7609]
2025-10-01T14:09:35.411941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 843, pipe: [1:7556255260646370334:7609]
2025-10-01T14:09:35.506942Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:35.507300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.507313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.507353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370334:7609], now have 1 active actors on pipe
2025-10-01T14:09:35.507533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:35.507578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255260646370334:7609]
2025-10-01T14:09:35.507551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:35.507589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:35.507592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:35.507645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 844 reason: error at write: Disconnected sessionId: src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0
2025-10-01T14:09:35.507817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 844 sessionId: src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0 is DEAD
2025-10-01T14:09:35.507983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:35.507996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0] Write session will restart in 0.009645s
2025-10-01T14:09:35.508020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0] Write session: Do CDS request
2025-10-01T14:09:35.508026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:35.518988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.519031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:35.519047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 845
2025-10-01T14:09:35.519223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.519247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:35.519267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:35.519270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:35.519559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 845 sessionId:  describe result for acl check
2025-10-01T14:09:35.519580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:35.519584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:35.519585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:35.519589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255260646370494:7876] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:35.519637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:35.519990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255260646370494:7876] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:35.521762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:35.521906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:35.521916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:35.521904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255260646370494:7876] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:35.521925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:35.521964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:35.521999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255258269504465:6918]
2025-10-01T14:09:35.522496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:35.522776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:35.522811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:35.523022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:35.523057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.523061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.523061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.523062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.523063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.523063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.523064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.523065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.523065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.523066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.523066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.523067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.523068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.523068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.523071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.523076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.523078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.523081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.523083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.523084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.523086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.523088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.523090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.523093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.523095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.523097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.523099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.523101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.523105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.523109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.523113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.523116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.523118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.523121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.523124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.523127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.523129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.523132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.523134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.523137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.523139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.523142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.523145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.523147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.523149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.523152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.523154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.523157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.523159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.523162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.523165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.523167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.523169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.523172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.523174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.523177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.523197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:35.526555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255260646370494:7876] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:35.526570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255260646370494:7876] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:35.526574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255260646370494:7876] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:35.526582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:35.526685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:35.527244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:35.527254Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:35.527255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:35.527258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:35.527263Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 844 [2:7556255258269504465:6918]
2025-10-01T14:09:35.527273Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:35.527286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:35.527287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.527289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.527290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.527301Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:35.527304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:35.527309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:35.527356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.527362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.527363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.527365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:35.527366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:35.527422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:35.527428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.527435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.527447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.527464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:35.527480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370361:2446], now have 1 active actors on pipe
2025-10-01T14:09:35.527487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370530:7876], now have 1 active actors on pipe
2025-10-01T14:09:35.527494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255258269504460:6918]
2025-10-01T14:09:35.527500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255258269504460:6918]
2025-10-01T14:09:35.527502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255258269504460:6918]
2025-10-01T14:09:35.527514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:35.527527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:35.527527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 844
2025-10-01T14:09:35.527530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:35.527527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 844
2025-10-01T14:09:35.527534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:35.527536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:35.527542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:35.527544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:35.527567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255258269504460:6918]
2025-10-01T14:09:35.527577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:35.527582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:35.527597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.527604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.527643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:35.527655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.527659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.527660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:35.527666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.527673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:35.527688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.527817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.527825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.527837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.527909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 845 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0
2025-10-01T14:09:35.528197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5779b5-dd6e199e-f8897061-cee1a6b4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:35.530310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0] Write session: try to update token
2025-10-01T14:09:35.530323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:35.543760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 845 sessionId: src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:35.546159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:35.547558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.547577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.547595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:35.547598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:35.547599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:35.547601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:35.547607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255258269504460:6918]
2025-10-01T14:09:35.547612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255258269504460:6918]
2025-10-01T14:09:35.547615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255258269504460:6918]
2025-10-01T14:09:35.547657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:35.547656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:35.547662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:35.547663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.547665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:35.547665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:35.547793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:35.607833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255260646370549:7609]
2025-10-01T14:09:35.608074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 844, pipe: [1:7556255260646370549:7609]
2025-10-01T14:09:35.696371Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:35.696638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:35.696700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370549:7609], now have 1 active actors on pipe
2025-10-01T14:09:35.696789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:35.696895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255260646370549:7609]
2025-10-01T14:09:35.696923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:35.708572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:35.708593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:35.708616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 845 reason: error at write: Disconnected sessionId: src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0
2025-10-01T14:09:35.708805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 845 sessionId: src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0 is DEAD
2025-10-01T14:09:35.708955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:35.708970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0] Write session will restart in 0.009253s
2025-10-01T14:09:35.708995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0] Write session: Do CDS request
2025-10-01T14:09:35.709004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:35.715474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:35.717735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:35.718001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:35.718010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:35.718019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:35.718069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:35.718105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255258269504639:6920]
2025-10-01T14:09:35.718583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:35.718899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:35.718957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:35.719277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:35.719350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.719356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.719357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.719358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.719360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.719361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.719362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.719363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.719364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.719365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.719366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.719368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.719369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.719370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.719375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.719386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.719389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.719392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.719396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.719400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.719403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.719406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.719409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.719413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.719417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.719420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.719424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.719427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.719435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.719443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.719449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.719456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.719461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.719471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.719475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.719479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.719487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.719491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.719495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.719504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.719508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.719513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.719516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.719525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.719529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.719533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.719541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.719546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.719556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.719561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.719569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.719573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.719578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.719586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.719591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.719595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.719633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:35.719892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.719976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:35.719989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 846
2025-10-01T14:09:35.720161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.720207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:35.720216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:35.720220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:35.720575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 846 sessionId:  describe result for acl check
2025-10-01T14:09:35.720608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:35.720615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:35.720617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:35.720622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255260646370693:7882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:35.721110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255260646370693:7882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:35.722975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255260646370693:7882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:35.723530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:35.724159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:35.724176Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:35.724179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:35.724182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:35.724189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 845 [2:7556255258269504639:6920]
2025-10-01T14:09:35.724204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:35.724229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:35.724237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.724242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.724244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.724262Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:35.724281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:35.724288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:35.724352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.724362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.724367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.724370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:35.724373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:35.724461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:35.724470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.724480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.724490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.724503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:35.724524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370554:2446], now have 1 active actors on pipe
2025-10-01T14:09:35.724536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255258269504634:6920]
2025-10-01T14:09:35.724542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255258269504634:6920]
2025-10-01T14:09:35.724544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255258269504634:6920]
2025-10-01T14:09:35.724537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 845
2025-10-01T14:09:35.724558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:35.724567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:35.724569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:35.724570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:35.724575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:35.724588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:35.724593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:35.724638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255258269504634:6920]
2025-10-01T14:09:35.724650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:35.724655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:35.725302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255260646370693:7882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:35.725316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255260646370693:7882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:35.725320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255260646370693:7882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:35.725327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:35.725567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370729:7882], now have 1 active actors on pipe
2025-10-01T14:09:35.725597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 845
2025-10-01T14:09:35.725700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.725713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.725739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:35.725753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.725762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.725765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:35.725775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.725788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:35.725808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.725957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.725966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.725982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.726071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 846 partition: 0 MaxSeqNo: 45 sessionId: src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0
2025-10-01T14:09:35.726504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc958d59-7ad63f08-92d73dec-b0021dff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:35.729570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0] Write session: try to update token
2025-10-01T14:09:35.729591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:35.745879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:35.745899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:35.745902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:35.745905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:35.745916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255258269504634:6920]
2025-10-01T14:09:35.745922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255258269504634:6920]
2025-10-01T14:09:35.745925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255258269504634:6920]
2025-10-01T14:09:35.745978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:35.745989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.745992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:35.745992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:35.745999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:35.746002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:35.746143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:35.747065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 846 sessionId: src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:35.749517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:35.797301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255260646370737:7609]
2025-10-01T14:09:35.797560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 845, pipe: [1:7556255260646370737:7609]
2025-10-01T14:09:35.893101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:35.893523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.893541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.893599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370737:7609], now have 1 active actors on pipe
2025-10-01T14:09:35.893800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:35.894172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255260646370737:7609]
2025-10-01T14:09:35.894220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:35.894260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:35.894327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 846 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0
2025-10-01T14:09:35.894528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 846 sessionId: src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0 is DEAD
2025-10-01T14:09:35.898648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:35.898664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0] Write session will restart in 0.009757s
2025-10-01T14:09:35.898694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0] Write session: Do CDS request
2025-10-01T14:09:35.898701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:35.910855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.914573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:35.914588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 847
2025-10-01T14:09:35.914748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:35.914777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:35.914783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:35.914787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:35.915119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:35.915208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 847 sessionId:  describe result for acl check
2025-10-01T14:09:35.915242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:35.915244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:35.915246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:35.915252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255260646370873:7886] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:35.915791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255260646370873:7886] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:35.918043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255260646370873:7886] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:35.920901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:35.921338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:35.921350Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:35.921365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:35.921434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:35.921479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255258269504844:6933]
2025-10-01T14:09:35.922087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:35.922908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255260646370873:7886] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:35.922924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255260646370873:7886] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:35.922927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255260646370873:7886] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:35.922935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:35.922973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:35.923035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:35.923370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:35.923444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.923446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.923447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.923448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.923449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.923450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.923452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.923453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.923455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.923456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.923457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.923458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.923460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.923461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.923467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.923476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.923480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.923484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.923487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.923491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.923495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.923498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.923502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.923506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.923509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.923513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.923516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.923519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.923527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.923534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:35.923541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.923547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:35.923554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.923559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:35.923564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.923569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:35.923574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.923579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:35.923583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.923587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:35.923593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.923598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:35.923602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.923606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:35.923613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.923618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:35.923623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.923627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.923631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.923638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.923642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.923646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.923651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.923655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:35.923660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.923664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:35.923703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:35.930454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:35.931131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:35.931148Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:35.931151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:35.931155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:35.931162Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 846 [2:7556255258269504844:6933]
2025-10-01T14:09:35.931179Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:35.931198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:35.931201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.931205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.931211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.931227Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:35.931237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:35.931244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:35.931303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.931309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.931312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.931315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:35.931318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:35.931394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:35.931401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.931413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:35.931429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:35.931449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:35.931468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370739:2446], now have 1 active actors on pipe
2025-10-01T14:09:35.931476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370909:7886], now have 1 active actors on pipe
2025-10-01T14:09:35.931484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255258269504838:6933]
2025-10-01T14:09:35.931491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255258269504838:6933]
2025-10-01T14:09:35.931493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255258269504838:6933]
2025-10-01T14:09:35.931506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:35.931521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:35.931523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:35.931528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:35.931530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:35.931539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:35.931547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:35.931522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 846
2025-10-01T14:09:35.931533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 846
2025-10-01T14:09:35.931586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255258269504838:6933]
2025-10-01T14:09:35.931597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:35.931607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:35.931761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.931770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.931819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:35.931828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:35.931833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:35.931839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:35.931849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:35.931857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:35.931883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.932080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:35.932091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:35.932108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:35.932315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 847 partition: 0 MaxSeqNo: 45 sessionId: src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0
2025-10-01T14:09:35.932833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d698e0f8-929d9b66-50d25fb0-b948d929_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:35.935704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0] Write session: try to update token
2025-10-01T14:09:35.935723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:35.953927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 847 sessionId: src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:35.954133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:35.954157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:35.954161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:35.954163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:35.954172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255258269504838:6933]
2025-10-01T14:09:35.954177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255258269504838:6933]
2025-10-01T14:09:35.954185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255258269504838:6933]
2025-10-01T14:09:35.954240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:35.954244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:35.954250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:35.954252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:35.954254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:35.954255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:35.954435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:35.956632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:35.994474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255260646370920:7609]
2025-10-01T14:09:35.995049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 846, pipe: [1:7556255260646370920:7609]
2025-10-01T14:09:36.109277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:36.109658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.109669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.109714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255260646370920:7609], now have 1 active actors on pipe
2025-10-01T14:09:36.110783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:36.118187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:36.118204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0] Write session will restart in 0.009818s
2025-10-01T14:09:36.118235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0] Write session: Do CDS request
2025-10-01T14:09:36.118241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:36.114714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:36.114815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 847 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0
2025-10-01T14:09:36.115031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 847 sessionId: src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0 is DEAD
2025-10-01T14:09:36.115178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255260646370920:7609]
2025-10-01T14:09:36.115191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:36.129014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:36.129127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:36.129147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 848
2025-10-01T14:09:36.129379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:36.129412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:36.129416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:36.129419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:36.130776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 848 sessionId:  describe result for acl check
2025-10-01T14:09:36.130817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:36.130819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:36.130821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:36.130827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255264941338271:7890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:36.131444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255264941338271:7890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:36.140605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255264941338271:7890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:36.148080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255264941338271:7890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:36.148097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255264941338271:7890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:36.148100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255264941338271:7890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:36.148108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:36.152082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:36.153500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:36.153720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:36.153725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:36.153735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:36.153783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:36.153841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255262564472317:6935]
2025-10-01T14:09:36.154575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:36.155047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:36.155097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:36.155450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:36.155504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.155505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.155507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.155509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.155510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.155512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.155513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.155515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.155516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.155518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.155519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.155521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.155522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.155523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.155529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.155539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.155543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.155548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.155551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.155556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.155559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.155563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.155567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.155571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.155575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.155578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.155582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.155586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.155593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.155600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.155606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.155611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.155616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.155622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.155628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.155634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.155639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.155644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.155650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.155655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.155661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.155666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.155673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.155678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.155684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.155689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.155696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.155702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.155708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.155713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.155718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.155723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.155728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.155734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.155739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.155744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.155804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:36.165461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:36.166769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:36.166778Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:36.166782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:36.166787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:36.166798Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 847 [2:7556255262564472317:6935]
2025-10-01T14:09:36.166819Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:36.166841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:36.166846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:36.166852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:36.166856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:36.166873Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:36.166879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:36.166886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:36.167063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.167069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.167072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.167077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:36.167080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:36.167698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 847
2025-10-01T14:09:36.167732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 847
2025-10-01T14:09:36.167191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:36.167204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.167223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.167235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.167255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:36.167277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255262564472311:6935]
2025-10-01T14:09:36.167279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255262564472311:6935]
2025-10-01T14:09:36.167282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255262564472311:6935]
2025-10-01T14:09:36.167292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:36.167301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:36.167303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:36.167306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:36.167316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:36.167333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:36.167337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:36.167350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338387:7890], now have 1 active actors on pipe
2025-10-01T14:09:36.167354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338219:2446], now have 1 active actors on pipe
2025-10-01T14:09:36.167398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255262564472311:6935]
2025-10-01T14:09:36.167407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:36.167534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:36.169985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.170009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.170067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:36.170080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:36.170086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:36.170088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:36.170102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:36.170119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:36.170149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:36.171447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.171459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.171484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:36.171638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 848 partition: 0 MaxSeqNo: 45 sessionId: src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0
2025-10-01T14:09:36.174974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d0646c3-349961f2-1142dba9-e3dde27d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:36.178065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0] Write session: try to update token
2025-10-01T14:09:36.178085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:36.214212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 848 sessionId: src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:36.217401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:36.217486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255264941338400:7609]
2025-10-01T14:09:36.218113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.218141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.218188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:36.222472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:36.230992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338400:7609], now have 1 active actors on pipe
2025-10-01T14:09:36.235062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 847, pipe: [1:7556255264941338400:7609]
2025-10-01T14:09:36.234650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:36.234664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:36.234667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:36.234669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:36.234681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255262564472311:6935]
2025-10-01T14:09:36.234686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255262564472311:6935]
2025-10-01T14:09:36.234690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255262564472311:6935]
2025-10-01T14:09:36.234740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:36.234748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.234751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:36.234920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:36.238486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:36.238495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:36.238499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:36.401252Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:36.409307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.409338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.409519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.409578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.409659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.409730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.409913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.409918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.409998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.410061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.410126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.410195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.410239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.410241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.410312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.410475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.410540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.410612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.410655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.410658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.410732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.410793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.410860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.410929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.410979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.410982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.411049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.411106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.411167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.411229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.411275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.411287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.411354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.411415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.411485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.411554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.411601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.411607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.411675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.411735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.411798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.411866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.411912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.411918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.411980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.412037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.412096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.412158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.412202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.412211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.412281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.412345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.412411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.412479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.412531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.412533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.412606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:36.412663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:36.412728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:36.412818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:36.412866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:36.412869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:36.414960Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:36.415762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:36.415815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 848 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0
2025-10-01T14:09:36.416025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 848 sessionId: src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0 is DEAD
2025-10-01T14:09:36.416195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255264941338400:7609]
2025-10-01T14:09:36.416209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:36.416435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:36.416443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0] Write session will restart in 0.006439s
2025-10-01T14:09:36.416469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0] Write session: Do CDS request
2025-10-01T14:09:36.416474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:36.426886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:36.428000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:36.428015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 849
2025-10-01T14:09:36.430520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:36.430578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:36.430606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:36.430610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:36.430954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 849 sessionId:  describe result for acl check
2025-10-01T14:09:36.430988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:36.430990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:36.430994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:36.431000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255264941338424:7895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:36.431513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255264941338424:7895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:36.437356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255264941338424:7895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:36.444250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255264941338424:7895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:36.444266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255264941338424:7895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:36.444270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255264941338424:7895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:36.444279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:36.456192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:36.469880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:36.470134Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:36.470145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:36.470157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:36.470217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:36.470260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255262564472498:6938]
2025-10-01T14:09:36.470912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:36.474776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:36.474864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:36.475226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:36.475331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.475339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.475341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.475342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.475343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.475345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.475347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.475348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.475349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.475350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.475352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.475353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.475357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.475358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.475366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.475375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.475379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.475383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.475386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.475390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.475394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.475399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.475403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.475409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.475412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.475416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.475420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.475424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.475446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.475458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.475471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.475476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.475480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.475484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.475488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.475492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.475499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.475506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.475510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.475514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.475520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.475527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.475543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.475547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.475556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.475565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.475568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.475577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.475580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.475589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.475596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.475601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.475610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.475619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.475626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.475631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.475671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:36.486847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:36.487777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:36.487801Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:36.487804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:36.487808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:36.487818Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 848 [2:7556255262564472498:6938]
2025-10-01T14:09:36.487837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:36.487859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:36.487863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:36.487867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:36.487869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:36.487890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:36.487897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:36.487904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:36.487982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.487985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.487987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.487990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:36.487993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:36.488072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:36.488075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.488092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.488103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.488119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:36.488137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255262564472492:6938]
2025-10-01T14:09:36.488139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255262564472492:6938]
2025-10-01T14:09:36.488141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255262564472492:6938]
2025-10-01T14:09:36.488152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:36.488168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:36.488182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:36.488184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:36.488230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255262564472492:6938]
2025-10-01T14:09:36.488232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:36.489236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:36.489238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:36.489240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:36.489245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:36.489483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338501:7895], now have 1 active actors on pipe
2025-10-01T14:09:36.489490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338415:2446], now have 1 active actors on pipe
2025-10-01T14:09:36.494683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 848
2025-10-01T14:09:36.494728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 848
2025-10-01T14:09:36.495604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.495626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.495670Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99932f18-1373315e-bd6ed094-790c0583_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:36.495684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:36.495690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:36.495694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:36.495707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:36.495729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:36.495755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:36.498655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.498678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.498718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:36.501531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 849 partition: 0 MaxSeqNo: 45 sessionId: src_id|99932f18-1373315e-bd6ed094-790c0583_0
2025-10-01T14:09:36.501953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7912e2ae-105011f8-8c7f786a-6cdb2772_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|99932f18-1373315e-bd6ed094-790c0583_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:36.505061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99932f18-1373315e-bd6ed094-790c0583_0] Write session: try to update token
2025-10-01T14:09:36.505086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99932f18-1373315e-bd6ed094-790c0583_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:36.517148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255264941338610:7609]
2025-10-01T14:09:36.517680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338610:7609], now have 1 active actors on pipe
2025-10-01T14:09:36.517787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 848, pipe: [1:7556255264941338610:7609]
2025-10-01T14:09:36.542913Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:36.542935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:36.542938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:36.542940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:36.542954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255262564472492:6938]
2025-10-01T14:09:36.542958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255262564472492:6938]
2025-10-01T14:09:36.542962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255262564472492:6938]
2025-10-01T14:09:36.543015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:36.543016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:36.543021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:36.543024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.543025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:36.543027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:36.543167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:36.547326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 849 sessionId: src_id|99932f18-1373315e-bd6ed094-790c0583_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:36.550653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:36.701595Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:36.701940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.701958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.702581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:36.702603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:36.702615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:36.702661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 849 reason: error at write: Disconnected sessionId: src_id|99932f18-1373315e-bd6ed094-790c0583_0
2025-10-01T14:09:36.702665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255264941338610:7609]
2025-10-01T14:09:36.702921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 849 sessionId: src_id|99932f18-1373315e-bd6ed094-790c0583_0 is DEAD
2025-10-01T14:09:36.703161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99932f18-1373315e-bd6ed094-790c0583_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:36.703172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99932f18-1373315e-bd6ed094-790c0583_0] Write session will restart in 0.008160s
2025-10-01T14:09:36.703198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99932f18-1373315e-bd6ed094-790c0583_0] Write session: Do CDS request
2025-10-01T14:09:36.703207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99932f18-1373315e-bd6ed094-790c0583_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:36.703288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:36.713096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99932f18-1373315e-bd6ed094-790c0583_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:36.713642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:36.713658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 850
2025-10-01T14:09:36.713796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:36.713835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:36.713840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:36.713852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:36.714394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 850 sessionId:  describe result for acl check
2025-10-01T14:09:36.714433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:36.714450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:36.714457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:36.714462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255264941338652:7908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:36.714992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255264941338652:7908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:36.717391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255264941338652:7908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:36.724561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255264941338652:7908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:36.724577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255264941338652:7908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:36.724581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255264941338652:7908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:36.724591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:36.731941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:36.734949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:36.735276Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:36.735286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:36.735298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:36.735366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:36.735416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255262564472695:6943]
2025-10-01T14:09:36.736248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:36.737289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:36.737350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:36.737665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:36.737725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.737726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.737727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.737728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.737730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.737732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.737733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.737735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.737737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.737738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.737740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.737741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.737742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.737743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.737750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.737760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.737764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.737768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.737772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.737776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.737779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.737784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.737788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.737793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.737797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.737799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.737801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.737803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.737811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.737816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.737822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.737826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.737831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.737834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.737838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.737842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.737846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.737850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.737854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.737858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.737862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.737866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.737869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.737873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.737877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.737880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.737883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.737887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.737890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.737893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.737896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.737900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.737904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.737907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.737910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.737913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.737942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:36.744889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:36.745652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:36.745661Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:36.745665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:36.745670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:36.745678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 849 [2:7556255262564472695:6943]
2025-10-01T14:09:36.745699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:36.745720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:36.745724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:36.745729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:36.745731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:36.745749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:36.745755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:36.745763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:36.745848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.745851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.745854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.745858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:36.745861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:36.745939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:36.745942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.745956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.745967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.745981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:36.745999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255262564472690:6943]
2025-10-01T14:09:36.746001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255262564472690:6943]
2025-10-01T14:09:36.746004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255262564472690:6943]
2025-10-01T14:09:36.746024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:36.746041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:36.746054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:36.746058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:36.746098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255262564472690:6943]
2025-10-01T14:09:36.746100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:36.746361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:36.746368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:36.746386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:36.746392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:36.746740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338638:2446], now have 1 active actors on pipe
2025-10-01T14:09:36.746748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338726:7908], now have 1 active actors on pipe
2025-10-01T14:09:36.749852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 849
2025-10-01T14:09:36.750035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 849
2025-10-01T14:09:36.750161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.750180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.750216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:36.750227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:36.750233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:36.750236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:36.750250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:36.750265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:36.750287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:36.750844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.750858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.750874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:36.751035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 850 partition: 0 MaxSeqNo: 45 sessionId: src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0
2025-10-01T14:09:36.751480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99932f18-1373315e-bd6ed094-790c0583_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:36.757371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0] Write session: try to update token
2025-10-01T14:09:36.757393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:36.777935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 850 sessionId: src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:36.778185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:36.778209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:36.778212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:36.778214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:36.778235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255262564472690:6943]
2025-10-01T14:09:36.778241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255262564472690:6943]
2025-10-01T14:09:36.778244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255262564472690:6943]
2025-10-01T14:09:36.778295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:36.778298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:36.778304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.778306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:36.778312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:36.778317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:36.778493Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:36.780863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:36.802862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255264941338823:7609]
2025-10-01T14:09:36.803260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 849, pipe: [1:7556255264941338823:7609]
2025-10-01T14:09:36.921916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:36.922455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.922479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.922528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338823:7609], now have 1 active actors on pipe
2025-10-01T14:09:36.922766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:36.922766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255264941338823:7609]
2025-10-01T14:09:36.922781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:36.922799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:36.922849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 850 reason: error at write: Disconnected sessionId: src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0
2025-10-01T14:09:36.923077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 850 sessionId: src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0 is DEAD
2025-10-01T14:09:36.923423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:36.923586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:36.923595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0] Write session will restart in 0.008614s
2025-10-01T14:09:36.923625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0] Write session: Do CDS request
2025-10-01T14:09:36.923630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:36.934052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:36.934068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 851
2025-10-01T14:09:36.934135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:36.934421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:36.934455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:36.934464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:36.934469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:36.934958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 851 sessionId:  describe result for acl check
2025-10-01T14:09:36.934992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:36.934994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:36.934996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:36.935001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255264941338964:7912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:36.935795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255264941338964:7912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:36.936514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:36.937792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255264941338964:7912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:36.938967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:36.939217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:36.939229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:36.939241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:36.939308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:36.939348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255262564472903:6956]
2025-10-01T14:09:36.939930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:36.940193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255264941338964:7912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:36.940209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255264941338964:7912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:36.940212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255264941338964:7912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:36.940220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:36.940259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:36.940308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:36.940635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:36.940710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.940716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.940717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.940718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.940719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.940720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.940721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.940722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.940724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.940725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.940726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.940727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.940728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.940729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.940734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.940743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.940759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.940762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.940766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.940769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.940772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.940775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.940779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.940782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.940786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.940789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.940792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.940795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.940803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.940810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:36.940816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.940821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:36.940824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.940829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:36.940832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.940837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:36.940841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.940846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:36.940851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.940862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:36.940866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.940874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:36.940878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.940887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:36.940890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.940895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:36.940898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.940903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.940907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.940914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.940918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.940922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.940931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.940935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:36.940940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.940948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:36.940984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:36.945427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:36.946292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:36.946308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:36.946310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:36.946314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:36.946320Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 850 [2:7556255262564472903:6956]
2025-10-01T14:09:36.946335Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:36.946356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:36.946362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:36.946366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:36.946387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:36.946403Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:36.946414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:36.946421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:36.946485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.946493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.946494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.946497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:36.946500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:36.946562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:36.946572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.946583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:36.946594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:36.946608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:36.946626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941339001:7912], now have 1 active actors on pipe
2025-10-01T14:09:36.946634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255264941338827:2446], now have 1 active actors on pipe
2025-10-01T14:09:36.946641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255262564472898:6956]
2025-10-01T14:09:36.946647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255262564472898:6956]
2025-10-01T14:09:36.946649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255262564472898:6956]
2025-10-01T14:09:36.946662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:36.946672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:36.946678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:36.946681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:36.946682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:36.946690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:36.946693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:36.946726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255262564472898:6956]
2025-10-01T14:09:36.946736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:36.946741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:36.946754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 850
2025-10-01T14:09:36.946816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 850
2025-10-01T14:09:36.946881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.946890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.946914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:36.946925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:36.946929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:36.946937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:36.946947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:36.946961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:36.946978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:36.947223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.947233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.947250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:36.947399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 851 partition: 0 MaxSeqNo: 45 sessionId: src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0
2025-10-01T14:09:36.947800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa82398b-332aaa98-6247e96b-1c4ab363_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:36.951008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0] Write session: try to update token
2025-10-01T14:09:36.951030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:36.962779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:36.962804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:36.962814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255262564472898:6956]
2025-10-01T14:09:36.962857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:36.962859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:36.963038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:36.963187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:36.963330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:36.963476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:36.963673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:36.963718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:36.978354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 851 sessionId: src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:36.981332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:36.981705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:36.981729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:36.981769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:36.982671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:36.989698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:36.989716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:36.989718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:36.989721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:36.989732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255262564472898:6956]
2025-10-01T14:09:36.989736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255262564472898:6956]
2025-10-01T14:09:36.989739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255262564472898:6956]
2025-10-01T14:09:36.989790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:36.989802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:36.989805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:36.989891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:36.989905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:36.989908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:36.989954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:37.022983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255269236306306:7609]
2025-10-01T14:09:37.023453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 850, pipe: [1:7556255269236306306:7609]
2025-10-01T14:09:37.148838Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:37.157237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.157264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.157436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.157507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.157582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.157909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.157958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.157969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.158042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.158106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.158169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.158230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.158269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.158271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.158341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.158421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.158487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.158558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.158603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.158614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.158685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.158755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.158816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.158878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.158920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.158927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.158991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.159053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.159120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.159180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.159221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.159224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.159288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.159348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.159407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.159467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.159510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.159517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.159583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.159644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.159715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.159780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.159822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.159828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.159892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.159952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.160020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.160091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.160134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.160140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.160275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.160336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.160395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.160456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.160504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.160510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.160574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:37.160637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:37.160700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:37.161297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:37.161309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255269236306306:7609]
2025-10-01T14:09:37.161335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:37.161338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:37.161367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 851 reason: error at write: Disconnected sessionId: src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0
2025-10-01T14:09:37.161640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 851 sessionId: src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0 is DEAD
2025-10-01T14:09:37.160773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:37.160820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:37.160823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:37.160885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306306:7609], now have 1 active actors on pipe
2025-10-01T14:09:37.161836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:37.162319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:37.162335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0] Write session will restart in 0.005583s
2025-10-01T14:09:37.162363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0] Write session: Do CDS request
2025-10-01T14:09:37.162388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:37.169055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:37.169112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:37.169128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 852
2025-10-01T14:09:37.169375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:37.169415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:37.169426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:37.169429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:37.169825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 852 sessionId:  describe result for acl check
2025-10-01T14:09:37.169866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:37.169874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:37.169876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:37.169881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255269236306326:7918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:37.170434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255269236306326:7918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:37.172838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255269236306326:7918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:37.176346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255269236306326:7918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:37.176362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255269236306326:7918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:37.176366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255269236306326:7918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:37.176374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:37.179742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:37.181455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:37.181694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:37.181707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:37.181720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:37.181773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:37.181809Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255266859440380:6958]
2025-10-01T14:09:37.182424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:37.182706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:37.182749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:37.183030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:37.183079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.183086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.183087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.183088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.183089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.183091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.183092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.183093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.183094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.183095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.183096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.183097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.183098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.183099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.183104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.183112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.183115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.183118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.183121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.183125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.183128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.183132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.183135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.183138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.183142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.183145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.183147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.183151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.183158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.183165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.183170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.183175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.183178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.183183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.183187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.183192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.183196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.183201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.183205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.183209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.183213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.183217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.183221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.183225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.183229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.183234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.183241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.183245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.183250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.183259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.183263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.183268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.183276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.183281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.183287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.183295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.183329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:37.187729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:37.188421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:37.188440Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:37.188444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:37.188449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:37.188457Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 851 [2:7556255266859440380:6958]
2025-10-01T14:09:37.188475Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:37.188496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:37.188505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:37.188509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:37.188512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:37.188531Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:37.188537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:37.188544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:37.188609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.188618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.188620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.188624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:37.188627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:37.188701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:37.188709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.188724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.188742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.188775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:37.188798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255266859440375:6958]
2025-10-01T14:09:37.188805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255266859440375:6958]
2025-10-01T14:09:37.188808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255266859440375:6958]
2025-10-01T14:09:37.188817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:37.188827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:37.188830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:37.188832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:37.188838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:37.188854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:37.188862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:37.188874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306479:7918], now have 1 active actors on pipe
2025-10-01T14:09:37.188883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306312:2446], now have 1 active actors on pipe
2025-10-01T14:09:37.188922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255266859440375:6958]
2025-10-01T14:09:37.188937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:37.189003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:37.189111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.189125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.188998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 851
2025-10-01T14:09:37.189160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:37.189174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:37.189008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 851
2025-10-01T14:09:37.189179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:37.189181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:37.189191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:37.189202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:37.189220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:37.189387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.189396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.189410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:37.189505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 852 partition: 0 MaxSeqNo: 45 sessionId: src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0
2025-10-01T14:09:37.189963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3c3c8f2-48480471-8f50e79d-fe5957c8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:37.193029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0] Write session: try to update token
2025-10-01T14:09:37.193055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:37.212820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:37.212838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:37.212840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:37.212842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:37.212850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255266859440375:6958]
2025-10-01T14:09:37.212856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255266859440375:6958]
2025-10-01T14:09:37.212858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255266859440375:6958]
2025-10-01T14:09:37.212904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:37.212908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:37.212911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:37.212915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:37.212915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.212918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:37.213060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:37.216600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 852 sessionId: src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:37.219222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:37.261610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255269236306498:7609]
2025-10-01T14:09:37.261905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 851, pipe: [1:7556255269236306498:7609]
2025-10-01T14:09:37.357960Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:37.358471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.358486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.358531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306498:7609], now have 1 active actors on pipe
2025-10-01T14:09:37.358722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:37.358795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255269236306498:7609]
2025-10-01T14:09:37.358800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:37.358803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:37.358821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:37.358859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 852 reason: error at write: Disconnected sessionId: src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0
2025-10-01T14:09:37.359042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 852 sessionId: src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0 is DEAD
2025-10-01T14:09:37.359243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:37.359258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0] Write session will restart in 0.009560s
2025-10-01T14:09:37.359290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0] Write session: Do CDS request
2025-10-01T14:09:37.359297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:37.369849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:37.370163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:37.370188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 853
2025-10-01T14:09:37.370337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:37.370390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:37.370401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:37.370404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:37.370842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 853 sessionId:  describe result for acl check
2025-10-01T14:09:37.370876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:37.370882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:37.370891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:37.370896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255269236306648:7923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:37.371358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255269236306648:7923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:37.371786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:37.373028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255269236306648:7923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:37.374262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:37.374466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:37.374476Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:37.374494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:37.374535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:37.374571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255266859440562:6960]
2025-10-01T14:09:37.375226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:37.375374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255269236306648:7923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:37.375387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255269236306648:7923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:37.375391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255269236306648:7923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:37.375398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:37.375498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:37.375545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:37.375783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:37.375836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.375842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.375842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.375843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.375844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.375844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.375845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.375846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.375846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.375847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.375848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.375848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.375849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.375849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.375853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.375858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.375861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.375863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.375865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.375867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.375869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.375871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.375874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.375877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.375879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.375881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.375883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.375885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.375890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.375894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.375898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.375901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.375904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.375907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.375909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.375912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.375914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.375917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.375920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.375924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.375926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.375929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.375931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.375933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.375936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.375938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.375942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.375944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.375947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.375949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.375952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.375954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.375957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.375959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.375961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.375964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.375984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:37.379685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:37.380259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:37.380271Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:37.380274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:37.380277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:37.380283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 852 [2:7556255266859440562:6960]
2025-10-01T14:09:37.380311Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:37.380331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:37.380337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:37.380340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:37.380342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:37.380357Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:37.380366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:37.380372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:37.380426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.380432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.380434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.380438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:37.380441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:37.380513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:37.380519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.380530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.380545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.380565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:37.380586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306687:7923], now have 1 active actors on pipe
2025-10-01T14:09:37.380592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306509:2446], now have 1 active actors on pipe
2025-10-01T14:09:37.380601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255266859440554:6960]
2025-10-01T14:09:37.380608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255266859440554:6960]
2025-10-01T14:09:37.380610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255266859440554:6960]
2025-10-01T14:09:37.380617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 852
2025-10-01T14:09:37.380620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 852
2025-10-01T14:09:37.380624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:37.380640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:37.380654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:37.380653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:37.380656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:37.380657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:37.380658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:37.380685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255266859440554:6960]
2025-10-01T14:09:37.380689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:37.380690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:37.380703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.380708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.380761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:37.380768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:37.380772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:37.380774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:37.380784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:37.380792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:37.380812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:37.380998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.381008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.381023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:37.381093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 853 partition: 0 MaxSeqNo: 45 sessionId: src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0
2025-10-01T14:09:37.381497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8374006d-2cc0a8f6-c566a4da-f2e564ec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:37.384403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0] Write session: try to update token
2025-10-01T14:09:37.384424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:37.401061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 853 sessionId: src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:37.403038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:37.403054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:37.403057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:37.403059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:37.403069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255266859440554:6960]
2025-10-01T14:09:37.403073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255266859440554:6960]
2025-10-01T14:09:37.403077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255266859440554:6960]
2025-10-01T14:09:37.403117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:37.403121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:37.403124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:37.403125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:37.403132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.403135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:37.403266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:37.404019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:37.458694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255269236306697:7609]
2025-10-01T14:09:37.458930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 852, pipe: [1:7556255269236306697:7609]
2025-10-01T14:09:37.552266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:37.552716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.552731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.552782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306697:7609], now have 1 active actors on pipe
2025-10-01T14:09:37.552949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:37.554502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:37.554597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 853 reason: status is not ok: tablet will be restarted right now sessionId: src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0
2025-10-01T14:09:37.554793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 853 sessionId: src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0 is DEAD
2025-10-01T14:09:37.554977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:37.554990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0] Write session will restart in 0.008090s
2025-10-01T14:09:37.554979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:37.555028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0] Write session: Do CDS request
2025-10-01T14:09:37.555035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:37.555027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255269236306697:7609]
2025-10-01T14:09:37.563933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:37.564005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:37.564019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 854
2025-10-01T14:09:37.564175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:37.564206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:37.564211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:37.564215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:37.564697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 854 sessionId:  describe result for acl check
2025-10-01T14:09:37.564728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:37.564729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:37.564731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:37.564736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255269236306780:7933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:37.565204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255269236306780:7933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:37.570740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:37.573565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:37.573813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:37.573825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:37.573837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:37.573888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:37.573923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255266859440755:6964]
2025-10-01T14:09:37.574513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:37.574930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:37.574981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:37.575282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:37.575331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.575333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.575333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.575335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.575336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.575337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.575338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.575339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.575340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.575341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.575343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.575344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.575345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.575346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.575351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.575361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.575364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.575368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.575372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.575375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.575379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.575382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.575386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.575390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.575393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.575397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.575401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.575404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.575410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.575417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.575423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.575428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.575433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.575438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.575442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.575447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.575451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.575456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.575459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.575463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.575468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.575473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.575477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.575481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.575485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.575490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.575495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.575500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.575504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.575509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.575512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.575517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.575521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.575525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.575528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.575533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.575567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:37.575862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255269236306780:7933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:37.579612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255269236306780:7933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:37.579631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255269236306780:7933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:37.579635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255269236306780:7933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:37.579644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:37.579989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:37.580620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:37.580625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:37.580628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:37.580631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:37.580638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 853 [2:7556255266859440755:6964]
2025-10-01T14:09:37.580653Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:37.580672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:37.580675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:37.580679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:37.580682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:37.580698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:37.580704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:37.580710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:37.580783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.580785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.580787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.580790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:37.580793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:37.580864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:37.580867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.580879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.580890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.580905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:37.580921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255266859440750:6964]
2025-10-01T14:09:37.580924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255266859440750:6964]
2025-10-01T14:09:37.580926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255266859440750:6964]
2025-10-01T14:09:37.580938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:37.580952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:37.580967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:37.580970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:37.581007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255266859440750:6964]
2025-10-01T14:09:37.581009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:37.581578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 853
2025-10-01T14:09:37.581633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 853
2025-10-01T14:09:37.581257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:37.581263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:37.581265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:37.581270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:37.581495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306705:2446], now have 1 active actors on pipe
2025-10-01T14:09:37.581503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306890:7933], now have 1 active actors on pipe
2025-10-01T14:09:37.581748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.581758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.581786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:37.581795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:37.581799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:37.581802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:37.581812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:37.581823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:37.581840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:37.582552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 854 partition: 0 MaxSeqNo: 45 sessionId: src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0
2025-10-01T14:09:37.582331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.582345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.582367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:37.583009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611f7993-1f9970a-8b0e93d0-4e2f4edd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:37.585823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0] Write session: try to update token
2025-10-01T14:09:37.585844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:37.603966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:37.603993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:37.603995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:37.603998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:37.604009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255266859440750:6964]
2025-10-01T14:09:37.604014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255266859440750:6964]
2025-10-01T14:09:37.604020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255266859440750:6964]
2025-10-01T14:09:37.604074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:37.604081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.604079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:37.604084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:37.604087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:37.604095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:37.604260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:37.614000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 854 sessionId: src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:37.616926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:37.655439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255269236306920:7609]
2025-10-01T14:09:37.655799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 853, pipe: [1:7556255269236306920:7609]
2025-10-01T14:09:37.762768Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:37.763316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.763327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.763346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306920:7609], now have 1 active actors on pipe
2025-10-01T14:09:37.763806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255269236306920:7609]
2025-10-01T14:09:37.763810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:37.763847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:37.763850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:37.763926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 854 reason: error at write: Disconnected sessionId: src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0
2025-10-01T14:09:37.764156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 854 sessionId: src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0 is DEAD
2025-10-01T14:09:37.764520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:37.764533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0] Write session will restart in 0.007819s
2025-10-01T14:09:37.764567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0] Write session: Do CDS request
2025-10-01T14:09:37.764576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:37.763883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:37.773862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:37.774250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:37.774268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 855
2025-10-01T14:09:37.774463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:37.774490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:37.774496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:37.774500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:37.774902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 855 sessionId:  describe result for acl check
2025-10-01T14:09:37.774929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:37.774930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:37.774932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:37.774937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255269236306932:7940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:37.775733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255269236306932:7940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:37.779495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255269236306932:7940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:37.791664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255269236306932:7940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:37.791684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255269236306932:7940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:37.791687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255269236306932:7940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:37.791696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:37.798830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:37.799802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:37.800018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:37.800028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:37.800040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:37.800095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:37.800150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255266859440946:6968]
2025-10-01T14:09:37.800741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:37.802367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:37.802456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:37.802803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:37.802863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.802869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.802870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.802871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.802872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.802873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.802874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.802875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.802876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.802877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.802878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.802879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.802879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.802880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.802887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.802896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.802900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.802903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.802907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.802911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.802914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.802918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.802922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.802927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.802931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.802933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.802935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.802937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.802944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.802950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:37.802955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.802958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:37.802961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.802965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:37.802967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.802971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:37.802974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.802977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:37.802980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.802983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:37.802987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.802990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:37.802993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.802996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:37.802999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.803015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:37.803019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.803024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.803030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.803035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.803044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.803048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.803051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.803054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:37.803057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.803059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:37.803085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:37.808279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:37.809024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:37.809040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:37.809043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:37.809046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:37.809054Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 854 [2:7556255266859440946:6968]
2025-10-01T14:09:37.809071Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:37.809088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:37.809091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:37.809095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:37.809097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:37.809116Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:37.809122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:37.809138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:37.809200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.809203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.809205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.809208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:37.809211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:37.809279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:37.809282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.809294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:37.809306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:37.809321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:37.809340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236306924:2446], now have 1 active actors on pipe
2025-10-01T14:09:37.809344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236307044:7940], now have 1 active actors on pipe
2025-10-01T14:09:37.809352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255266859440940:6968]
2025-10-01T14:09:37.809354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255266859440940:6968]
2025-10-01T14:09:37.809356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255266859440940:6968]
2025-10-01T14:09:37.809370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:37.809383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:37.809397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:37.809400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:37.809441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255266859440940:6968]
2025-10-01T14:09:37.809444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:37.809444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:37.809447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:37.809450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:37.809456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:37.809585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 854
2025-10-01T14:09:37.809626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 854
2025-10-01T14:09:37.809691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.809707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.809733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32a5f171-f395a553-40ff084f-b5b718f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:37.809760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:37.809764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:37.809767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:37.809778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:37.809788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:37.809805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:37.810017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 855 partition: 0 MaxSeqNo: 45 sessionId: src_id|32a5f171-f395a553-40ff084f-b5b718f0_0
2025-10-01T14:09:37.809932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.809942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.809958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:37.814138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57c51ba4-8983d14e-a4f5c161-f782dd56_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|32a5f171-f395a553-40ff084f-b5b718f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:37.817102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a5f171-f395a553-40ff084f-b5b718f0_0] Write session: try to update token
2025-10-01T14:09:37.817124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a5f171-f395a553-40ff084f-b5b718f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:37.839031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:37.839047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:37.839050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:37.839051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:37.839059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255266859440940:6968]
2025-10-01T14:09:37.839063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255266859440940:6968]
2025-10-01T14:09:37.839067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255266859440940:6968]
2025-10-01T14:09:37.839121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:37.839120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:37.839126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:37.839129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:37.839130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:37.839130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:37.839265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:37.845432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 855 sessionId: src_id|32a5f171-f395a553-40ff084f-b5b718f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:37.847761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:37.863719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255269236307114:7609]
2025-10-01T14:09:37.863984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 854, pipe: [1:7556255269236307114:7609]
2025-10-01T14:09:37.994820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:37.995349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:37.995364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:37.995409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236307114:7609], now have 1 active actors on pipe
2025-10-01T14:09:37.995634Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:37.995716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255269236307114:7609]
2025-10-01T14:09:37.995749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:37.995783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:37.995785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:37.995851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 855 reason: error at write: Disconnected sessionId: src_id|32a5f171-f395a553-40ff084f-b5b718f0_0
2025-10-01T14:09:37.996059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 855 sessionId: src_id|32a5f171-f395a553-40ff084f-b5b718f0_0 is DEAD
2025-10-01T14:09:37.996302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a5f171-f395a553-40ff084f-b5b718f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:37.996315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a5f171-f395a553-40ff084f-b5b718f0_0] Write session will restart in 0.008014s
2025-10-01T14:09:37.996336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a5f171-f395a553-40ff084f-b5b718f0_0] Write session: Do CDS request
2025-10-01T14:09:37.996341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a5f171-f395a553-40ff084f-b5b718f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:38.006428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32a5f171-f395a553-40ff084f-b5b718f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.006961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:38.006977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 856
2025-10-01T14:09:38.007146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.007203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:38.007213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:38.007217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:38.007759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 856 sessionId:  describe result for acl check
2025-10-01T14:09:38.007803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:38.007806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:38.007809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:38.007818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255273531274429:7944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:38.008399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255273531274429:7944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:38.014536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255273531274429:7944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:38.018271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255273531274429:7944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:38.018280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255273531274429:7944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:38.018284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255273531274429:7944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:38.018293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:38.018478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:38.023514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:38.023790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:38.023801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:38.023813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:38.023864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:38.023908Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255271154408456:6981]
2025-10-01T14:09:38.024529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:38.026799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:38.026877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:38.027293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:38.027348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.027349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.027350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.027351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.027352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.027353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.027355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.027355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.027357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.027358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.027359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.027360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.027361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.027362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.027369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.027379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.027382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.027387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.027391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.027395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.027399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.027403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.027406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.027411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.027415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.027419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.027422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.027426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.027435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.027442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.027448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.027451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.027454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.027457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.027460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.027463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.027466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.027469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.027471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.027474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.027477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.027480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.027483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.027488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.027492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.027497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.027502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.027508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.027512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.027517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.027521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.027526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.027531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.027536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.027540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.027546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.027570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:38.032501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:38.033171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:38.033184Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:38.033187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:38.033191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:38.033199Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 855 [2:7556255271154408456:6981]
2025-10-01T14:09:38.033219Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:38.033241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:38.033249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.033253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.033254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.033267Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:38.033274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:38.033279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:38.033324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.033330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.033332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.033334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:38.033337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:38.033391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:38.033396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.033403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.033409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.033420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:38.033439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255269236307119:2446], now have 1 active actors on pipe
2025-10-01T14:09:38.033446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255271154408450:6981]
2025-10-01T14:09:38.033453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255271154408450:6981]
2025-10-01T14:09:38.033455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255271154408450:6981]
2025-10-01T14:09:38.033463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:38.033472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:38.033475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:38.033477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:38.033481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531274590:7944], now have 1 active actors on pipe
2025-10-01T14:09:38.033486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:38.033495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:38.033497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:38.033522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255271154408450:6981]
2025-10-01T14:09:38.033531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:38.033538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:38.034408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.034420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.034442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4252b5be-b08b8644-f247c03d-f3e36188_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:38.034448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.034452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.034454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:38.034462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.034471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:38.034305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 855
2025-10-01T14:09:38.034486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.034328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 855
2025-10-01T14:09:38.034677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.034684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.034697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.034806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 856 partition: 0 MaxSeqNo: 45 sessionId: src_id|4252b5be-b08b8644-f247c03d-f3e36188_0
2025-10-01T14:09:38.035150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32a5f171-f395a553-40ff084f-b5b718f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4252b5be-b08b8644-f247c03d-f3e36188_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:38.038150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4252b5be-b08b8644-f247c03d-f3e36188_0] Write session: try to update token
2025-10-01T14:09:38.038169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4252b5be-b08b8644-f247c03d-f3e36188_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:38.054436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:38.054452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:38.054455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:38.054457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:38.054468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255271154408450:6981]
2025-10-01T14:09:38.054473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255271154408450:6981]
2025-10-01T14:09:38.054476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255271154408450:6981]
2025-10-01T14:09:38.054531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:38.054543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.054545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:38.054609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:38.054636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:38.054641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:38.054686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:38.060993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 856 sessionId: src_id|4252b5be-b08b8644-f247c03d-f3e36188_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:38.064158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:38.095656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255273531274603:7609]
2025-10-01T14:09:38.095960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 855, pipe: [1:7556255273531274603:7609]
2025-10-01T14:09:38.202829Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:38.203347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.203365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.203390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531274603:7609], now have 1 active actors on pipe
2025-10-01T14:09:38.203576Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:38.204833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4252b5be-b08b8644-f247c03d-f3e36188_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:38.204856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4252b5be-b08b8644-f247c03d-f3e36188_0] Write session will restart in 0.006795s
2025-10-01T14:09:38.204881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4252b5be-b08b8644-f247c03d-f3e36188_0] Write session: Do CDS request
2025-10-01T14:09:38.204887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4252b5be-b08b8644-f247c03d-f3e36188_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:38.203730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:38.203850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 856 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4252b5be-b08b8644-f247c03d-f3e36188_0
2025-10-01T14:09:38.204032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 856 sessionId: src_id|4252b5be-b08b8644-f247c03d-f3e36188_0 is DEAD
2025-10-01T14:09:38.204560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:38.204618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255273531274603:7609]
2025-10-01T14:09:38.213069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4252b5be-b08b8644-f247c03d-f3e36188_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.213181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:38.213201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 857
2025-10-01T14:09:38.213313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.213354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:38.213364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:38.213369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:38.213902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 857 sessionId:  describe result for acl check
2025-10-01T14:09:38.213931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:38.213933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:38.213935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:38.213940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255273531274628:7948] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:38.214462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255273531274628:7948] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:38.216628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255273531274628:7948] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:38.219172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255273531274628:7948] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:38.219188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255273531274628:7948] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:38.219192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255273531274628:7948] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:38.219200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:38.219474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:38.222704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:38.222943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:38.222954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:38.222967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:38.223031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:38.223079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255271154408641:6983]
2025-10-01T14:09:38.223700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:38.224116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:38.224167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:38.224497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:38.224603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.224610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.224612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.224613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.224614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.224615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.224616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.224618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.224619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.224620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.224621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.224622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.224623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.224624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.224630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.224639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.224644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.224648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.224651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.224655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.224660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.224664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.224668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.224672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.224675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.224679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.224682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.224685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.224693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.224703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.224710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.224716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.224722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.224727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.224732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.224737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.224760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.224770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.224775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.224780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.224785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.224796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.224805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.224810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.224815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.224824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.224828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.224832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.224840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.224844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.224847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.224851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.224860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.224865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.224874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.224879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.224918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:38.229132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:38.230063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:38.230078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:38.230080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:38.230084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:38.230091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 856 [2:7556255271154408641:6983]
2025-10-01T14:09:38.230107Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:38.230128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:38.230135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.230139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.230145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.230161Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:38.230171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:38.230181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:38.230243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.230250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.230252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.230255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:38.230257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:38.230330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:38.230339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.230350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.230365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.230398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:38.230419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255271154408635:6983]
2025-10-01T14:09:38.230427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255271154408635:6983]
2025-10-01T14:09:38.230429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255271154408635:6983]
2025-10-01T14:09:38.230446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:38.230459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:38.230476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:38.230483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:38.230500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:38.230509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:38.230510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:38.230520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255271154408635:6983]
2025-10-01T14:09:38.230523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:38.230587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:38.230740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 856
2025-10-01T14:09:38.230745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 856
2025-10-01T14:09:38.230903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531274783:7948], now have 1 active actors on pipe
2025-10-01T14:09:38.230922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531274605:2446], now have 1 active actors on pipe
2025-10-01T14:09:38.230939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.230945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.230982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:38.230997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.231006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.231009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:38.231391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 857 partition: 0 MaxSeqNo: 45 sessionId: src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0
2025-10-01T14:09:38.231020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.231032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:38.231058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.231253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.231259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.231281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.231829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4252b5be-b08b8644-f247c03d-f3e36188_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:38.235080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0] Write session: try to update token
2025-10-01T14:09:38.235102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:38.266935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:38.266972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:38.266975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:38.266977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:38.266990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255271154408635:6983]
2025-10-01T14:09:38.266996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255271154408635:6983]
2025-10-01T14:09:38.267000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255271154408635:6983]
2025-10-01T14:09:38.267054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:38.267066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.267073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:38.264908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 857 sessionId: src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:38.267237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:38.267236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:38.267242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:38.267245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:38.267499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:38.304563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255273531274801:7609]
2025-10-01T14:09:38.310673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 856, pipe: [1:7556255273531274801:7609]
2025-10-01T14:09:38.421331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255273531274801:7609]
2025-10-01T14:09:38.421333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:38.421337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:38.421363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:38.421398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 857 reason: error at write: Disconnected sessionId: src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0
2025-10-01T14:09:38.421629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 857 sessionId: src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0 is DEAD
2025-10-01T14:09:38.423190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:38.423202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0] Write session will restart in 0.009279s
2025-10-01T14:09:38.423228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0] Write session: Do CDS request
2025-10-01T14:09:38.423235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:38.420590Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:38.420915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.420926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.420975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531274801:7609], now have 1 active actors on pipe
2025-10-01T14:09:38.421189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:38.433896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.434416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:38.434434Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 858
2025-10-01T14:09:38.434618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.434654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:38.434659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:38.434664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:38.435069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 858 sessionId:  describe result for acl check
2025-10-01T14:09:38.435098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:38.435100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:38.435102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:38.435107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255273531274821:7953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:38.435637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255273531274821:7953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:38.439970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255273531274821:7953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:38.443249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255273531274821:7953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:38.443267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255273531274821:7953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:38.443271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255273531274821:7953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:38.443280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:38.447055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:38.447608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:38.447792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:38.447796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:38.447807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:38.447852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:38.447889Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255271154408829:6986]
2025-10-01T14:09:38.448551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:38.448856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:38.448893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:38.449199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:38.449244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.449245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.449246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.449247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.449249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.449250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.449251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.449252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.449253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.449255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.449256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.449257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.449259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.449260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.449265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.449276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.449280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.449285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.449289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.449293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.449297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.449301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.449305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.449309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.449314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.449318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.449322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.449326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.449333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.449341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.449347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.449352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.449357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.449362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.449367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.449372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.449377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.449383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.449387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.449393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.449397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.449403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.449409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.449414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.449419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.449424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.449431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.449436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.449440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.449445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.449449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.449455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.449460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.449465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.449469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.449474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.449516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:38.454196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:38.456491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29ec166a-a19aadb7-6d10d77a-4d47f4b7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:38.454845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:38.454863Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:38.454866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:38.454870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:38.454878Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 857 [2:7556255271154408829:6986]
2025-10-01T14:09:38.454896Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:38.454913Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:38.454917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.454920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.454923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.454940Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:38.454946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:38.454952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:38.455012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.455014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.455016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.455020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:38.455023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:38.455098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:38.455101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.455114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.455127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.455145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:38.455163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531274806:2446], now have 1 active actors on pipe
2025-10-01T14:09:38.455167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531274985:7953], now have 1 active actors on pipe
2025-10-01T14:09:38.455175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255271154408824:6986]
2025-10-01T14:09:38.455178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255271154408824:6986]
2025-10-01T14:09:38.455180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255271154408824:6986]
2025-10-01T14:09:38.455197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:38.455211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:38.455227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:38.455230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:38.455261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255271154408824:6986]
2025-10-01T14:09:38.455264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:38.455356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:38.455358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:38.455360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:38.455364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:38.455553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.455562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.455593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:38.455602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.455606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.455609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:38.455620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.455630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:38.455645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.455934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.455938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.455952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.455284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 857
2025-10-01T14:09:38.455334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 857
2025-10-01T14:09:38.456043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 858 partition: 0 MaxSeqNo: 45 sessionId: src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0
2025-10-01T14:09:38.459289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0] Write session: try to update token
2025-10-01T14:09:38.459307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:38.479875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 858 sessionId: src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:38.482336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:38.483160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:38.482742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.482767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.482817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:38.485819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:38.485824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:38.485827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:38.485829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:38.485838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255271154408824:6986]
2025-10-01T14:09:38.485842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255271154408824:6986]
2025-10-01T14:09:38.485846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255271154408824:6986]
2025-10-01T14:09:38.485903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:38.485905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:38.485912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:38.485912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.485915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:38.485916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:38.486079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:38.522506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255273531274999:7609]
2025-10-01T14:09:38.527053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 857, pipe: [1:7556255273531274999:7609]
2025-10-01T14:09:38.658701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:38.675846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.675877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.676074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.676143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.676226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.676294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.676342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.676351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.676430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.676493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.676568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.676644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.676687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.676693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.676778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.676838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.676905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.676970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.677011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.677015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.677088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.677151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.677210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.677270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.677312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.677316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.677388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.677448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.677518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.677582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.677625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.677629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.677699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.677763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.677828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.677895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.677940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.677943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.678011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.678072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.678142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.678211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.678252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.678255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.678320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.680771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.680862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.680929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.680970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.680973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.681053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.681116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.681181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.681246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.681289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.681292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.681369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:38.681440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:38.681506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:38.681574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:38.681617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:38.681620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:38.681707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531274999:7609], now have 1 active actors on pipe
2025-10-01T14:09:38.685487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255273531274999:7609]
2025-10-01T14:09:38.685520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:38.685778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:38.685789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:38.685816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 858 reason: error at write: Disconnected sessionId: src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0
2025-10-01T14:09:38.686193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 858 sessionId: src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0 is DEAD
2025-10-01T14:09:38.686616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:38.686632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0] Write session will restart in 0.007026s
2025-10-01T14:09:38.686666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0] Write session: Do CDS request
2025-10-01T14:09:38.686672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:38.689148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:38.695098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.695629Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:38.695645Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 859
2025-10-01T14:09:38.698927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.698980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:38.698986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:38.698990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:38.699729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 859 sessionId:  describe result for acl check
2025-10-01T14:09:38.699765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:38.699766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:38.699768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:38.699774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255273531275055:7966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:38.700268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255273531275055:7966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:38.709846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255273531275055:7966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:38.724825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255273531275055:7966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:38.724842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255273531275055:7966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:38.724846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255273531275055:7966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:38.724855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:38.740435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:38.743909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:38.744338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:38.744349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:38.744363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:38.744431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:38.744473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255271154409035:6991]
2025-10-01T14:09:38.745076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:38.745690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:38.745756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:38.746082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:38.746141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.746142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.746147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.746149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.746150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.746151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.746153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.746154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.746155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.746157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.746158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.746159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.746160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.746161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.746167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.746179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.746183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.746187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.746191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.746195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.746199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.746203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.746207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.746212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.746216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.746220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.746224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.746228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.746236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.746245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.746252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.746259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.746264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.746269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.746273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.746279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.746284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.746290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.746294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.746299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.746305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.746310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.746313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.746318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.746323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.746328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.746333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.746338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.746344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.746349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.746354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.746359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.746365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.746390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.746394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.746398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.746437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:38.756637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:38.757516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:38.757521Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:38.757524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:38.757528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:38.757535Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 858 [2:7556255271154409035:6991]
2025-10-01T14:09:38.757552Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:38.757570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:38.757575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.757579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.757581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.757598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:38.757605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:38.757613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:38.757680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.757681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.757686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.757689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:38.757692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:38.757767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:38.757770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.757782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.757795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.757812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:38.757830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255271154409029:6991]
2025-10-01T14:09:38.757832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255271154409029:6991]
2025-10-01T14:09:38.757834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255271154409029:6991]
2025-10-01T14:09:38.757850Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:38.757865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:38.757880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:38.757883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:38.757925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255271154409029:6991]
2025-10-01T14:09:38.757927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:38.758281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:38.758294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:38.758296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:38.758304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:38.758599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 858
2025-10-01T14:09:38.758601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 858
2025-10-01T14:09:38.758703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531275156:7966], now have 1 active actors on pipe
2025-10-01T14:09:38.758720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531275039:2446], now have 1 active actors on pipe
2025-10-01T14:09:38.758740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.758749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.758779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:38.758794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.758800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.758803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:38.758815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.758831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:38.758855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.759090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.759103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.759125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.759400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 859 partition: 0 MaxSeqNo: 45 sessionId: src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0
2025-10-01T14:09:38.761155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ecf57e8-d93d9204-4a418a54-d0dd1d60_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:38.764376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0] Write session: try to update token
2025-10-01T14:09:38.764400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:38.780625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:38.780646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:38.780649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:38.780651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:38.780660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255271154409029:6991]
2025-10-01T14:09:38.780665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255271154409029:6991]
2025-10-01T14:09:38.780668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255271154409029:6991]
2025-10-01T14:09:38.780711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:38.780720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:38.780722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:38.780723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:38.780730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.780732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:38.780891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:38.781162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255273531275231:7609]
2025-10-01T14:09:38.781347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 858, pipe: [1:7556255273531275231:7609]
2025-10-01T14:09:38.809306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 859 sessionId: src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:38.811864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:38.945500Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:38.945987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531275231:7609], now have 1 active actors on pipe
2025-10-01T14:09:38.946038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.946045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.946452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:38.946742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:38.946755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:38.946758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:38.946802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255273531275231:7609]
2025-10-01T14:09:38.946809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 859 reason: error at write: Disconnected sessionId: src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0
2025-10-01T14:09:38.947033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 859 sessionId: src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0 is DEAD
2025-10-01T14:09:38.947863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:38.947877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0] Write session will restart in 0.008688s
2025-10-01T14:09:38.947907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0] Write session: Do CDS request
2025-10-01T14:09:38.947926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:38.958807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.958932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:38.958950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 860
2025-10-01T14:09:38.959065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:38.959099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:38.959108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:38.959111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:38.959785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 860 sessionId:  describe result for acl check
2025-10-01T14:09:38.959824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:38.959830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:38.959832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:38.959838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255273531275264:7970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:38.960350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255273531275264:7970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:38.963005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255273531275264:7970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:38.965677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255273531275264:7970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:38.965689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255273531275264:7970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:38.965693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255273531275264:7970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:38.965700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:38.965708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:38.968127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:38.968299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:38.968307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:38.968315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:38.968375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:38.968407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255271154409254:7000]
2025-10-01T14:09:38.968829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:38.969094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:38.969129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:38.969345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:38.969385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.969390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.969391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.969392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.969393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.969394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.969395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.969396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.969398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.969399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.969400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.969401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.969402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.969403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.969408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.969418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.969422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.969426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.969429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.969433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.969448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.969451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.969455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.969459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.969463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.969467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.969471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.969475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.969481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.969488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:38.969494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.969503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:38.969508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.969514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:38.969522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.969527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:38.969533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.969538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:38.969545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.969548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:38.969552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.969555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:38.969557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.969560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:38.969562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.969565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:38.969568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.969571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.969573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.969575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.969579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.969582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.969584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.969587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:38.969589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.969592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:38.969612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:38.973472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:38.974194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:38.974208Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:38.974211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:38.974214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:38.974221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 859 [2:7556255271154409254:7000]
2025-10-01T14:09:38.974238Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:38.974255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:38.974258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.974261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.974264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.974280Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:38.974287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:38.974294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:38.974355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.974364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.974366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.974390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:38.974393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:38.974461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:38.974469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:38.974481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:38.974493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:38.974515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:38.974538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531275234:2446], now have 1 active actors on pipe
2025-10-01T14:09:38.974545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255273531275417:7970], now have 1 active actors on pipe
2025-10-01T14:09:38.974553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255271154409236:7000]
2025-10-01T14:09:38.974556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255271154409236:7000]
2025-10-01T14:09:38.974559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255271154409236:7000]
2025-10-01T14:09:38.974571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:38.974582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:38.974585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:38.974587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:38.974589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:38.974604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:38.974611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:38.974645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255271154409236:7000]
2025-10-01T14:09:38.974623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 859
2025-10-01T14:09:38.974660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:38.974627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 859
2025-10-01T14:09:38.974678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:38.974716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.974724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.974754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:38.974765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:38.974770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:38.974774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:38.974782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:38.974791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:38.974806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.975091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:38.975103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:38.975117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:38.975286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 860 partition: 0 MaxSeqNo: 45 sessionId: src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0
2025-10-01T14:09:38.978508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd56acfd-b68d6fb0-ab964e76-f18667e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:38.981749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0] Write session: try to update token
2025-10-01T14:09:38.981769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:38.985856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:38.985875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:38.985884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255271154409236:7000]
2025-10-01T14:09:38.985925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:38.985926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:38.986088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:38.986239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:38.986403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:38.986542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:38.986744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:38.986785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:39.006882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:39.006905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:39.006907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:39.006909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:39.006922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255271154409236:7000]
2025-10-01T14:09:39.006927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255271154409236:7000]
2025-10-01T14:09:39.006931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255271154409236:7000]
2025-10-01T14:09:39.006974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:39.006978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:39.006984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:39.006985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.006987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:39.006990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:39.007127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:39.021670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 860 sessionId: src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:39.025255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:39.050465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255277826242725:7609]
2025-10-01T14:09:39.051034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 859, pipe: [1:7556255277826242725:7609]
2025-10-01T14:09:39.202014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:39.215404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:39.215425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:39.215450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255277826242725:7609], now have 1 active actors on pipe
2025-10-01T14:09:39.215857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:39.217545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:39.217596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255277826242725:7609]
2025-10-01T14:09:39.217616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:39.217763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 860 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0
2025-10-01T14:09:39.217962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 860 sessionId: src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0 is DEAD
2025-10-01T14:09:39.219211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:39.219224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0] Write session will restart in 0.009504s
2025-10-01T14:09:39.219253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0] Write session: Do CDS request
2025-10-01T14:09:39.219260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:39.234257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:39.239731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:39.239749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 861
2025-10-01T14:09:39.243597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:39.243651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:39.243655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:39.243659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:39.245544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 861 sessionId:  describe result for acl check
2025-10-01T14:09:39.245606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:39.245608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:39.245614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:39.245622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255277826242779:7974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:39.246265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255277826242779:7974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:39.249671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255277826242779:7974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:39.256489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255277826242779:7974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:39.256507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255277826242779:7974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:39.256510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255277826242779:7974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:39.256521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:39.265185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:39.269449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:39.269857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:39.269862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:39.269878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:39.269945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:39.269981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255275449376739:7006]
2025-10-01T14:09:39.270669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:39.274745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:39.274824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:39.275232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:39.275290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:39.275291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:39.275293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:39.275294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:39.275295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:39.275297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:39.275298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:39.275299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:39.275301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:39.275302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.275303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.275304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.275305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:39.275306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:39.275314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:39.275325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:39.275329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:39.275333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:39.275337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:39.275341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:39.275345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:39.275349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:39.275353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:39.275358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.275361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.275364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.275368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:39.275373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:39.275384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:39.275393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:39.275400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:39.275405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:39.275410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:39.275416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:39.275420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:39.275427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:39.275432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:39.275438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:39.275454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:39.275459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:39.275465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:39.275470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:39.275475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:39.275480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:39.275486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:39.275492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:39.275497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.275502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.275507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.275513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.275517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.275523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.275527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:39.275532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:39.275536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:39.275543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:39.275586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:39.281200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:39.282100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:39.282106Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:39.282109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:39.282112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:39.282121Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 860 [2:7556255275449376739:7006]
2025-10-01T14:09:39.282140Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:39.282160Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:39.282164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:39.282169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:39.282171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:39.282191Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:39.282198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:39.282205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:39.282267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.282269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.282272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.282275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:39.282278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:39.282353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:39.282356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.282389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.282399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.282415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:39.282434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255275449376733:7006]
2025-10-01T14:09:39.282436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255275449376733:7006]
2025-10-01T14:09:39.282438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255275449376733:7006]
2025-10-01T14:09:39.282455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:39.282471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:39.282485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:39.282488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:39.282529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255275449376733:7006]
2025-10-01T14:09:39.282531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:39.282883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:39.282890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:39.282892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:39.282898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:39.283237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 860
2025-10-01T14:09:39.283274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 860
2025-10-01T14:09:39.287661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255277826242902:7974], now have 1 active actors on pipe
2025-10-01T14:09:39.287677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255277826242728:2446], now have 1 active actors on pipe
2025-10-01T14:09:39.287706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:39.287715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:39.287758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:39.287773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:39.287780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:39.287783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:39.287796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:39.287814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:39.287837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:39.293423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:39.293443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:39.293489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:39.293705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 861 partition: 0 MaxSeqNo: 45 sessionId: src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0
2025-10-01T14:09:39.297865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54352a09-29a9ada4-63f2d373-27d8b4ac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:39.302655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0] Write session: try to update token
2025-10-01T14:09:39.302692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:39.317830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255277826242927:7609]
2025-10-01T14:09:39.320688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255277826242927:7609], now have 1 active actors on pipe
2025-10-01T14:09:39.320699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 860, pipe: [1:7556255277826242927:7609]
2025-10-01T14:09:39.357204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:39.357225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:39.357227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:39.357229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:39.353146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 861 sessionId: src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:39.357239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255275449376733:7006]
2025-10-01T14:09:39.357244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255275449376733:7006]
2025-10-01T14:09:39.356631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:39.357247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255275449376733:7006]
2025-10-01T14:09:39.357298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:39.357305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.357308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:39.357459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:39.358560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:39.358570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:39.358573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:39.678972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:39.679322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:39.679334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:39.680324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:39.680343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:39.680405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 861 reason: error at write: Disconnected sessionId: src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0
2025-10-01T14:09:39.680613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 861 sessionId: src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0 is DEAD
2025-10-01T14:09:39.680742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:39.680794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255277826242927:7609]
2025-10-01T14:09:39.681063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:39.681076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0] Write session will restart in 0.008556s
2025-10-01T14:09:39.681107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0] Write session: Do CDS request
2025-10-01T14:09:39.681114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:39.681529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:39.690966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:39.695248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:39.695273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 862
2025-10-01T14:09:39.696349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:39.696413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:39.696418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:39.696423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:39.697053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 862 sessionId:  describe result for acl check
2025-10-01T14:09:39.697089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:39.697091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:39.697093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:39.697100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255277826242972:7987] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:39.697772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255277826242972:7987] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:39.711452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255277826242972:7987] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:39.739133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255277826242972:7987] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:39.739153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255277826242972:7987] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:39.739157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255277826242972:7987] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:39.739166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:39.755665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:39.761620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:39.761948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:39.761961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:39.761974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:39.762038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:39.762074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255275449376946:7010]
2025-10-01T14:09:39.762761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:39.764822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:39.764886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:39.765260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:39.765338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:39.765339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:39.765341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:39.765342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:39.765344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:39.765345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:39.765346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:39.765347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:39.765349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:39.765349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.765351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.765352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.765353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:39.765354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:39.766238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:39.766250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:39.766254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:39.766259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:39.766263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:39.766266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:39.766270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:39.766273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:39.766277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:39.766281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.766285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.766289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.766292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:39.766296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:39.766307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:39.766316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:39.766322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:39.766328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:39.766332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:39.766337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:39.766352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:39.766357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:39.766362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:39.766384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:39.766389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:39.766394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:39.766399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:39.766404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:39.766408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:39.766413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:39.766418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:39.766423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:39.766427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.766432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.766436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.766440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.766444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.766449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.766453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:39.766466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:39.766470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:39.766475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:39.766519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:39.780980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255277826243163:7609]
2025-10-01T14:09:39.786775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:39.787639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:39.787645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:39.787648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:39.787652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:39.787659Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 861 [2:7556255275449376946:7010]
2025-10-01T14:09:39.787677Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:39.787696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:39.787700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:39.787704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:39.787707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:39.787726Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:39.787747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:39.787753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:39.787819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.787821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.787824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.787827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:39.787830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:39.787907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:39.787910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.787923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:39.787935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:39.787954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:39.787973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255275449376940:7010]
2025-10-01T14:09:39.787975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255275449376940:7010]
2025-10-01T14:09:39.787978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255275449376940:7010]
2025-10-01T14:09:39.787991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:39.788005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:39.788019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:39.788022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:39.788067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255275449376940:7010]
2025-10-01T14:09:39.788069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:39.788290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:39.788298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:39.788301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:39.788307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:39.788671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255277826243163:7609], now have 1 active actors on pipe
2025-10-01T14:09:39.788675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255277826242962:2446], now have 1 active actors on pipe
2025-10-01T14:09:39.788678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255277826243145:7987], now have 1 active actors on pipe
2025-10-01T14:09:39.789242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 861, pipe: [1:7556255277826243163:7609]
2025-10-01T14:09:39.789275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 861
2025-10-01T14:09:39.789299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 861
2025-10-01T14:09:39.791346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:39.791360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:39.791404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:39.791416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:39.791421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:39.791424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:39.791438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:39.791453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:39.791471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:39.792395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:39.792406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:39.792433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:39.792624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 862 partition: 0 MaxSeqNo: 45 sessionId: src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0
2025-10-01T14:09:39.794249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53f090d8-50d8d3e0-72598234-1ad5663b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:39.797674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0] Write session: try to update token
2025-10-01T14:09:39.797702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:39.825199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:39.825218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:39.825222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:39.825223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:39.825234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255275449376940:7010]
2025-10-01T14:09:39.825239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255275449376940:7010]
2025-10-01T14:09:39.825243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255275449376940:7010]
2025-10-01T14:09:39.825298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:39.825310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:39.825312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:39.825470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:39.828260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:39.828272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:39.828276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:39.852074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 862 sessionId: src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:39.854805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:40.023984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:40.024285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.024299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.024431Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:40.024954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255277826243163:7609]
2025-10-01T14:09:40.024983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:40.025964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:40.025991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0] Write session will restart in 0.009220s
2025-10-01T14:09:40.026018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0] Write session: Do CDS request
2025-10-01T14:09:40.026025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:40.025011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:40.025067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 862 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0
2025-10-01T14:09:40.025270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 862 sessionId: src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0 is DEAD
2025-10-01T14:09:40.038604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:40.042626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:40.042654Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 863
2025-10-01T14:09:40.042856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:40.042894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:40.042902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:40.042907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:40.043783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 863 sessionId:  describe result for acl check
2025-10-01T14:09:40.043825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:40.043826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:40.043829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:40.043835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255282121210536:7992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:40.044736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255282121210536:7992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:40.048112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255282121210536:7992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:40.048983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:40.051673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:40.051951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:40.051956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:40.051969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:40.052043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:40.052083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255279744344470:7025]
2025-10-01T14:09:40.052650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:40.052910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255282121210536:7992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:40.052926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255282121210536:7992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:40.052930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255282121210536:7992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:40.052940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:40.053126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:40.053193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:40.053514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:40.053593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.053599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.053600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.053601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.053602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.053603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.053604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.053605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.053606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.053607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.053608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.053609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.053611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.053612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.053617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.053627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.053630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.053634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.053637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.053640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.053643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.053647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.053650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.053654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.053657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.053660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.053663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.053666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.053673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.053680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.053687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.053691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.053695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.053699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.053703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.053707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.053711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.053716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.053719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.053724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.053728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.053732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.053735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.053740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.053744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.053749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.053752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.053756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.053761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.053765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.053769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.053773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.053776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.053794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.053798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.053801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.053837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:40.058347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:40.059241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:40.059258Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:40.059260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:40.059264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:40.059272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 862 [2:7556255279744344470:7025]
2025-10-01T14:09:40.059290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:40.059310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:40.059319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:40.059323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:40.059325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:40.059346Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:40.059356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:40.059362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:40.059433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.059440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.059442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.059445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:40.059448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:40.059526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:40.059533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.059547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.059560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.059578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:40.059615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255279744344465:7025]
2025-10-01T14:09:40.059623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255279744344465:7025]
2025-10-01T14:09:40.059625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255279744344465:7025]
2025-10-01T14:09:40.059635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:40.059652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:40.059656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:40.059656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:40.059658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:40.059670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:40.059677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:40.059743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121210657:7992], now have 1 active actors on pipe
2025-10-01T14:09:40.059751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121210472:2446], now have 1 active actors on pipe
2025-10-01T14:09:40.059754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255279744344465:7025]
2025-10-01T14:09:40.059762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:40.059774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:40.059795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 862
2025-10-01T14:09:40.059835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 862
2025-10-01T14:09:40.059944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.059966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.060001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:40.060018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:40.060024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:40.060027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:40.060037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:40.060048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:40.060070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:40.060446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.060457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.060478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:40.061007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 863 partition: 0 MaxSeqNo: 45 sessionId: src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0
2025-10-01T14:09:40.061557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94e834e1-ab7a8136-43ad0fed-d7456da8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:40.064695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0] Write session: try to update token
2025-10-01T14:09:40.064715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:40.084512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:40.084534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:40.084537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:40.084540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:40.084550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255279744344465:7025]
2025-10-01T14:09:40.084555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255279744344465:7025]
2025-10-01T14:09:40.084559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255279744344465:7025]
2025-10-01T14:09:40.083086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 863 sessionId: src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:40.085868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:40.084619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:40.084628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:40.084635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:40.084638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.084641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:40.084642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:40.084805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:40.124710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255282121210667:7609]
2025-10-01T14:09:40.126815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 862, pipe: [1:7556255282121210667:7609]
2025-10-01T14:09:40.254332Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:40.254708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.254721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.254766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121210667:7609], now have 1 active actors on pipe
2025-10-01T14:09:40.255130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:40.256461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255282121210667:7609]
2025-10-01T14:09:40.256494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:40.256564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 863 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0
2025-10-01T14:09:40.256774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 863 sessionId: src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0 is DEAD
2025-10-01T14:09:40.256896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:40.256980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:40.256996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0] Write session will restart in 0.007645s
2025-10-01T14:09:40.257028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0] Write session: Do CDS request
2025-10-01T14:09:40.257035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:40.266795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:40.270727Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:40.270752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 864
2025-10-01T14:09:40.271007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:40.271040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:40.271046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:40.271051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:40.274915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 864 sessionId:  describe result for acl check
2025-10-01T14:09:40.274985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:40.274987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:40.274989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:40.274996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255282121210680:7997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:40.275639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255282121210680:7997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:40.287938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255282121210680:7997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:40.288597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:40.291242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:40.291506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:40.291526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:40.291538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:40.291591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:40.291633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255279744344662:7027]
2025-10-01T14:09:40.291584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255282121210680:7997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:40.291601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255282121210680:7997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:40.291605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255282121210680:7997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:40.291613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:40.292208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:40.292492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:40.292534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:40.292831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:40.292892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.292897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.292899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.292899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.292901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.292902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.292903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.292905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.292906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.292907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.292909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.292910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.292911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.292912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.292917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.292926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.292930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.292934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.292938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.292942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.292945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.292948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.292952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.292956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.292959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.292962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.292965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.292968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.292975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.292981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.292987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.292992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.292995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.293000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.293004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.293008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.293012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.293016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.293020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.293024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.293030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.293038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.293041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.293050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.293055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.293064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.293068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.293078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.293083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.293092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.293096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.293101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.293110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.293116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.293126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.293132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.293168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:40.297032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:40.297705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:40.297721Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:40.297723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:40.297726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:40.297733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 863 [2:7556255279744344662:7027]
2025-10-01T14:09:40.297749Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:40.297766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:40.297769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:40.297772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:40.297775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:40.297790Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:40.297796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:40.297802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:40.297860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.297868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.297870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.297873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:40.297875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:40.297939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:40.297946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.297957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.297974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.297990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:40.298008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121210860:7997], now have 1 active actors on pipe
2025-10-01T14:09:40.298018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121210669:2446], now have 1 active actors on pipe
2025-10-01T14:09:40.298026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255279744344657:7027]
2025-10-01T14:09:40.298028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255279744344657:7027]
2025-10-01T14:09:40.298030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255279744344657:7027]
2025-10-01T14:09:40.298044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:40.298055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:40.298058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:40.298060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:40.298062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:40.298075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:40.298082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:40.298115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255279744344657:7027]
2025-10-01T14:09:40.298125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:40.298129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:40.298145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 863
2025-10-01T14:09:40.298188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 863
2025-10-01T14:09:40.298254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.298264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.298294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:40.298308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:40.298317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:40.298319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:40.298330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:40.298346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:40.298365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:40.298770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.298779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.298796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:40.299159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 864 partition: 0 MaxSeqNo: 45 sessionId: src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0
2025-10-01T14:09:40.301131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce95c7b2-e5a06e2c-83bc5cc6-4b3f8051_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:40.304332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0] Write session: try to update token
2025-10-01T14:09:40.304353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:40.310482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:40.310498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:40.310508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255279744344657:7027]
2025-10-01T14:09:40.310554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:40.310740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:40.310897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:40.311039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:40.311185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:40.311387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:40.311424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:40.311564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:40.352601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 864 sessionId: src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:40.354221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255282121210876:7609]
2025-10-01T14:09:40.355052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 863, pipe: [1:7556255282121210876:7609]
2025-10-01T14:09:40.355135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:40.355351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121210876:7609], now have 1 active actors on pipe
2025-10-01T14:09:40.355558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.355568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.355605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:40.355719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:40.365977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:40.366009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:40.366012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:40.366014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:40.366028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255279744344657:7027]
2025-10-01T14:09:40.366034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255279744344657:7027]
2025-10-01T14:09:40.366040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255279744344657:7027]
2025-10-01T14:09:40.366104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:40.366114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.366117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:40.366295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:40.366500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:40.366504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:40.366509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:40.550045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:40.561240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.561279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.561499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.561577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.561658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.561736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.561798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.561810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.561887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.561958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.562034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.562105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.562168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.562177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.562262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.562337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.562457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.562536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.562599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.562609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.562702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.562776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.562859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.565434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255282121210876:7609]
2025-10-01T14:09:40.565437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:40.565479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:40.565482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:40.565511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 864 reason: error at write: Disconnected sessionId: src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0
2025-10-01T14:09:40.565755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 864 sessionId: src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0 is DEAD
2025-10-01T14:09:40.562936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.563002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.563005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.563093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.563162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.563235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.563302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.563355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.563358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.563441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.563521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.563592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.563667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.563721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.563725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.563804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.563866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.563939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.564011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.564066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.564070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.564154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.564221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.564292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.564363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.564413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.564416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.564498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.564564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.564636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.564712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.564781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.564785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.564868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.564933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.564997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.565066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.565125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.565129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.566630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:40.566643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0] Write session will restart in 0.009745s
2025-10-01T14:09:40.566669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0] Write session: Do CDS request
2025-10-01T14:09:40.566676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:40.567034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:40.578326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:40.578493Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:40.578523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 865
2025-10-01T14:09:40.578699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:40.578738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:40.578744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:40.578747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:40.580649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 865 sessionId:  describe result for acl check
2025-10-01T14:09:40.580697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:40.580699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:40.580705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:40.580710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255282121210888:8001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:40.581308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255282121210888:8001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:40.590549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255282121210888:8001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:40.594617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255282121210888:8001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:40.594634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255282121210888:8001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:40.594638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255282121210888:8001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:40.594646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:40.605790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:40.616836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:40.617042Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:40.617046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:40.617056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:40.617092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:40.617121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255279744344871:7031]
2025-10-01T14:09:40.617555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:40.617981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:40.618012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:40.618211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:40.618240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.618241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.618242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.618243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.618244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.618244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.618245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.618246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.618247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.618247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.618248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.618249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.618249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.618250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.618254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.618260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.618262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.618264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.618266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.618269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.618271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.618273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.618275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.618277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.618279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.618282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.618284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.618286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.618291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.618295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.618300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.618303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.618306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.618309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.618312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.618315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.618318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.618320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.618323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.618325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.618328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.618332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.618334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.618337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.618339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.618342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.618345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.618348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.618350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.618353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.618355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.618358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.618361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.618364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.618366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.618388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.618423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:40.631162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:40.632178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:40.632189Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:40.632191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:40.632195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:40.632205Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 864 [2:7556255279744344871:7031]
2025-10-01T14:09:40.632220Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:40.632238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:40.632247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:40.632251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:40.632259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:40.632276Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:40.632282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:40.632289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:40.632356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.632358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.632359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.632362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:40.632365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:40.632436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:40.632438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.632451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.632459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.632472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:40.632489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255279744344865:7031]
2025-10-01T14:09:40.632491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255279744344865:7031]
2025-10-01T14:09:40.632494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255279744344865:7031]
2025-10-01T14:09:40.632507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:40.632524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:40.632536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:40.632539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:40.632578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255279744344865:7031]
2025-10-01T14:09:40.632581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:40.632686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:40.632687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:40.632691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:40.632695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:40.632962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121211013:8001], now have 1 active actors on pipe
2025-10-01T14:09:40.633034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 864
2025-10-01T14:09:40.632967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121210879:2446], now have 1 active actors on pipe
2025-10-01T14:09:40.633046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 864
2025-10-01T14:09:40.633164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.633175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.633205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8614b388-4495bccc-a8e5106f-6995a613_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:40.633217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:40.633225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:40.633227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:40.633237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:40.633248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:40.633269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:40.633428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.633436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.633450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:40.633545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 865 partition: 0 MaxSeqNo: 45 sessionId: src_id|8614b388-4495bccc-a8e5106f-6995a613_0
2025-10-01T14:09:40.633885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bddff404-56956d37-5d16ea30-74a5ccfc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8614b388-4495bccc-a8e5106f-6995a613_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:40.636595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8614b388-4495bccc-a8e5106f-6995a613_0] Write session: try to update token
2025-10-01T14:09:40.636616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8614b388-4495bccc-a8e5106f-6995a613_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:40.654829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 865 sessionId: src_id|8614b388-4495bccc-a8e5106f-6995a613_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:40.657373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:40.658584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.658607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.658647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:40.661688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:40.664945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:40.664961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:40.664964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:40.664965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:40.664977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255279744344865:7031]
2025-10-01T14:09:40.664981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255279744344865:7031]
2025-10-01T14:09:40.664986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255279744344865:7031]
2025-10-01T14:09:40.665034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:40.665041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.665043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:40.665183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:40.665414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:40.665429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:40.665433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:40.666478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255282121211091:7609]
2025-10-01T14:09:40.670470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 864, pipe: [1:7556255282121211091:7609]
2025-10-01T14:09:40.844846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:40.845253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121211091:7609], now have 1 active actors on pipe
2025-10-01T14:09:40.853092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.853123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.853312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.853372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.853437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.853497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.853539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.853544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.853618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.853679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.853742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.853808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.853852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.853855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.853922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.853976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.854038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.854094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.854131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.854134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.854199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.854254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.854311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.857115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255282121211091:7609]
2025-10-01T14:09:40.857147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:40.857149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:40.857173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 865 reason: error at write: Disconnected sessionId: src_id|8614b388-4495bccc-a8e5106f-6995a613_0
2025-10-01T14:09:40.857395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 865 sessionId: src_id|8614b388-4495bccc-a8e5106f-6995a613_0 is DEAD
2025-10-01T14:09:40.854524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.854567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.854569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.854634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.854687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.854743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.854798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.854839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.854841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.854906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.854963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.855028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.855095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.855151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.855154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.855220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.855278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.855336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.855394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.855443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.855445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.855512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.855570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.855628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.855689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.855733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.855737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.855810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.855873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.855937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.856001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.856046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.856048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.856121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:40.856185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:40.856268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:40.856331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:40.856372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:40.856374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:40.857533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:40.858045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:40.858574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614b388-4495bccc-a8e5106f-6995a613_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:40.858584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614b388-4495bccc-a8e5106f-6995a613_0] Write session will restart in 0.005208s
2025-10-01T14:09:40.858609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614b388-4495bccc-a8e5106f-6995a613_0] Write session: Do CDS request
2025-10-01T14:09:40.858615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614b388-4495bccc-a8e5106f-6995a613_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:40.866164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8614b388-4495bccc-a8e5106f-6995a613_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:40.866304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:40.866320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 866
2025-10-01T14:09:40.866447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:40.866473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:40.866478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:40.866491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:40.867117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 866 sessionId:  describe result for acl check
2025-10-01T14:09:40.867154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:40.867156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:40.867158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:40.867162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255282121211129:8014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:40.867641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255282121211129:8014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:40.869388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255282121211129:8014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:40.872900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255282121211129:8014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:40.872915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255282121211129:8014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:40.872919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255282121211129:8014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:40.872927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:40.885364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:40.889587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:40.889858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:40.889870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:40.889883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:40.889944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:40.890000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255279744345074:7036]
2025-10-01T14:09:40.890661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:40.891047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:40.891126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:40.891554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:40.891630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.891636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.891637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.891639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.891640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.891641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.891643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.891644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.891645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.891646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.891648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.891649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.891651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.891652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.891658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.891669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.891673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.891677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.891681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.891685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.891689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.891693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.891696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.891701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.891704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.891708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.891711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.891715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.891723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.891730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:40.891736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.891741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:40.891746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.891751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:40.891755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.891768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:40.891773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.891783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:40.891788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.891797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:40.891803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.891812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:40.891816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.891826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:40.891834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.891840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:40.891848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.891853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.891862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.891867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.891872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.891881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.891886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.891895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:40.891899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.891907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:40.891946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:40.899679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:40.900354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:40.900371Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:40.900375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:40.900378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:40.900386Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 865 [2:7556255279744345074:7036]
2025-10-01T14:09:40.900404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:40.900423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:40.900427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:40.900437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:40.900439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:40.900458Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:40.900466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:40.900474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:40.900546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.900554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.900556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.900559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:40.900562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:40.901015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 865
2025-10-01T14:09:40.901064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 865
2025-10-01T14:09:40.900633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:40.900643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.900654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:40.900664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:40.900679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:40.900696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255279744345069:7036]
2025-10-01T14:09:40.900699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255279744345069:7036]
2025-10-01T14:09:40.900701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255279744345069:7036]
2025-10-01T14:09:40.900711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:40.900720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:40.900723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:40.900725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:40.900727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:40.900754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:40.900757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:40.900770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121211121:2446], now have 1 active actors on pipe
2025-10-01T14:09:40.900774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121211180:8014], now have 1 active actors on pipe
2025-10-01T14:09:40.900815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255279744345069:7036]
2025-10-01T14:09:40.900824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:40.900916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:40.901242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.901253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.901285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:40.901297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:40.901306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:40.901309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:40.901324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:40.901338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:40.901359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:40.901532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:40.901538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:40.901553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:40.901661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 866 partition: 0 MaxSeqNo: 45 sessionId: src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0
2025-10-01T14:09:40.902041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8614b388-4495bccc-a8e5106f-6995a613_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:40.904792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0] Write session: try to update token
2025-10-01T14:09:40.904813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:40.923356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 866 sessionId: src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:40.924670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:40.924691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:40.924694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:40.924696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:40.924704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255279744345069:7036]
2025-10-01T14:09:40.924709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255279744345069:7036]
2025-10-01T14:09:40.924713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255279744345069:7036]
2025-10-01T14:09:40.924771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:40.924780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:40.924779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:40.924782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:40.924787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:40.924791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:40.924911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:40.925913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:40.955693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255282121211321:7609]
2025-10-01T14:09:40.955981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 865, pipe: [1:7556255282121211321:7609]
2025-10-01T14:09:41.083598Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:41.084220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.084229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.084263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255282121211321:7609], now have 1 active actors on pipe
2025-10-01T14:09:41.084841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:41.084881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:41.084884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:41.084937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 866 reason: error at write: Disconnected sessionId: src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0
2025-10-01T14:09:41.085124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 866 sessionId: src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0 is DEAD
2025-10-01T14:09:41.085240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255282121211321:7609]
2025-10-01T14:09:41.085514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:41.085523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0] Write session will restart in 0.005610s
2025-10-01T14:09:41.084930Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:41.085548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0] Write session: Do CDS request
2025-10-01T14:09:41.085981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:41.093597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:41.093961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:41.093975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 867
2025-10-01T14:09:41.094388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:41.094427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:41.094433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:41.094436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:41.095025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 867 sessionId:  describe result for acl check
2025-10-01T14:09:41.095050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:41.095052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:41.095053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:41.095058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255286416178629:8018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:41.095550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255286416178629:8018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:41.100418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255286416178629:8018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:41.109560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255286416178629:8018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:41.109576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255286416178629:8018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:41.109579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255286416178629:8018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:41.109588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:41.133244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:41.136834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:41.137066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:41.137072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:41.137083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:41.137133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:41.137170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255284039312595:7048]
2025-10-01T14:09:41.137817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:41.138404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:41.138458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:41.138769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:41.138835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.138836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.138837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.138838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.138839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.138841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.138842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.138843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.138844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.138846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.138847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.138848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.138849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.138850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.138855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.138865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.138869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.138873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.138877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.138881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.138885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.138888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.138892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.138895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.138899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.138902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.138906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.138909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.138916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.138924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.138931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.138935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.138940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.138944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.138948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.138953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.138957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.138962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.138965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.138969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.138974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.138977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.138981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.138985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.138989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.138993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.138996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.139012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.139016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.139020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.139025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.139030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.139037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.139042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.139047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.139052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.139091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:41.144322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:41.145062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:41.145068Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:41.145071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:41.145075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:41.145084Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 866 [2:7556255284039312595:7048]
2025-10-01T14:09:41.145102Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:41.145122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:41.145126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:41.145131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:41.145134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:41.145152Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:41.145158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:41.145165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:41.145228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.145230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.145233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.145237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:41.145240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:41.145320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:41.145323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.145335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.145346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.145362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:41.145384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255284039312588:7048]
2025-10-01T14:09:41.145387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255284039312588:7048]
2025-10-01T14:09:41.145389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255284039312588:7048]
2025-10-01T14:09:41.145398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:41.145414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:41.145428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:41.145432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:41.145471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255284039312588:7048]
2025-10-01T14:09:41.145474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:41.145975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 866
2025-10-01T14:09:41.146018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 866
2025-10-01T14:09:41.145682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:41.145690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:41.145691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:41.145696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:41.146391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416178619:2446], now have 1 active actors on pipe
2025-10-01T14:09:41.146400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416178676:8018], now have 1 active actors on pipe
2025-10-01T14:09:41.146420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.146425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.146453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:41.146463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:41.146467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:41.146470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:41.146482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:41.146494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:41.146508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:41.146831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.146841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.146859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:41.147620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c7e6f5-c8da3405-6d712646-73d13608_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:41.147263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 867 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0
2025-10-01T14:09:41.150077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0] Write session: try to update token
2025-10-01T14:09:41.150094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:41.165900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 867 sessionId: src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:41.168714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:41.168979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.168998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.169036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:41.169165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:41.177723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:41.177745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:41.177748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:41.177750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:41.177763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255284039312588:7048]
2025-10-01T14:09:41.177768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255284039312588:7048]
2025-10-01T14:09:41.177772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255284039312588:7048]
2025-10-01T14:09:41.177820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:41.177827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.177830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:41.177971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:41.180963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:41.180975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:41.180979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:41.185574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255286416178821:7609]
2025-10-01T14:09:41.189790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 866, pipe: [1:7556255286416178821:7609]
2025-10-01T14:09:41.329939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:41.330473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416178821:7609], now have 1 active actors on pipe
2025-10-01T14:09:41.337955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.337978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.338129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.338191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.338265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.338332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.338394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.338403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.338473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.338530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.338587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.338647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.338695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.338703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.338762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.338813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.338867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.338923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.338967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.338974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.339031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.339086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.339144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.339202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.339246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.339253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.339307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.339358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.339414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.339483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.339526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.339531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.339589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.339646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.339708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.339768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.339813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.339820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.339877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.339931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.339997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.340052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.340092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.340098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.340161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.341267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:41.341276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:41.341280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:41.341309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 867 reason: error at write: Disconnected sessionId: src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0
2025-10-01T14:09:41.341327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255286416178821:7609]
2025-10-01T14:09:41.341536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 867 sessionId: src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0 is DEAD
2025-10-01T14:09:41.340216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.340277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.340330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.340369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.340370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.340434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.340492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.340548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.340600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.340643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.340646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.340708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.340780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.340836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.340888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.340932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.340934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.342456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:41.342475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0] Write session will restart in 0.008756s
2025-10-01T14:09:41.342265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:41.342504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0] Write session: Do CDS request
2025-10-01T14:09:41.342513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:41.352981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:41.353016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:41.353032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 868
2025-10-01T14:09:41.353209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:41.353244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:41.353255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:41.353258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:41.353686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 868 sessionId:  describe result for acl check
2025-10-01T14:09:41.353721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:41.353722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:41.353724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:41.353729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255286416178972:8023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:41.354249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255286416178972:8023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:41.355793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:41.356675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255286416178972:8023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:41.358247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:41.358446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:41.358455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:41.358466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:41.358511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:41.358546Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255284039312790:7050]
2025-10-01T14:09:41.359164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:41.359411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:41.359452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:41.359747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:41.359798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.359799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.359801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.359802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.359803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.359804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.359805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.359806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.359808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.359809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.359819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.359820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.359821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.359821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.359826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.359835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.359839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.359843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.359847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.359850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.359853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.359857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.359861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.359864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.359868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.359872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.359875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.359878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.359885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.359891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.359897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.359902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.359905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.359910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.359914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.359919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.359923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.359927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.359931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.359935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.359940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.359945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.359948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.359953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.359957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.359962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.359966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.359971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.359975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.359980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.359984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.359989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.359993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.359997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.360001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.360005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.360042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:41.363851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:41.364498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:41.364509Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:41.364511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:41.364514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:41.364520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 867 [2:7556255284039312790:7050]
2025-10-01T14:09:41.364531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:41.364546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:41.364547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:41.364550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:41.364551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:41.364564Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:41.364568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:41.364585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:41.364845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.364852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.364854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.364857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:41.364859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:41.364922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:41.364930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.364941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.364955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.364970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:41.364994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416178835:2446], now have 1 active actors on pipe
2025-10-01T14:09:41.365005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255284039312785:7050]
2025-10-01T14:09:41.365011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255284039312785:7050]
2025-10-01T14:09:41.365012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255284039312785:7050]
2025-10-01T14:09:41.365026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:41.365039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:41.365042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:41.365042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:41.365045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:41.365056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:41.365062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:41.365094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255284039312785:7050]
2025-10-01T14:09:41.365104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:41.365108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:41.367771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416179033:8023], now have 1 active actors on pipe
2025-10-01T14:09:41.370297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.370321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.370350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b17e94d5-12da068a-8cec928d-74dd0815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:41.370366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:41.370391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:41.370394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:41.366587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 867
2025-10-01T14:09:41.370409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:41.367035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255286416178972:8023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:41.370438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:41.367042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255286416178972:8023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:41.367047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255286416178972:8023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:41.367055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:41.370138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 867
2025-10-01T14:09:41.370461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:41.370760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.370769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.370786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:41.370893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 868 partition: 0 MaxSeqNo: 45 sessionId: src_id|b17e94d5-12da068a-8cec928d-74dd0815_0
2025-10-01T14:09:41.374151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7d613-b190f0c9-45dd31a0-874bd044_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b17e94d5-12da068a-8cec928d-74dd0815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:41.376760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17e94d5-12da068a-8cec928d-74dd0815_0] Write session: try to update token
2025-10-01T14:09:41.376784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17e94d5-12da068a-8cec928d-74dd0815_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:41.384241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:41.384261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:41.384272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255284039312785:7050]
2025-10-01T14:09:41.384319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:41.384319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:41.384488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:41.384633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:41.384796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:41.384938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:41.385134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:41.385177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:41.393828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 868 sessionId: src_id|b17e94d5-12da068a-8cec928d-74dd0815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:41.396792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.396822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.396862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:41.396523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:41.397668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:41.417723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:41.417746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:41.417749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:41.417751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:41.417763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255284039312785:7050]
2025-10-01T14:09:41.417767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255284039312785:7050]
2025-10-01T14:09:41.417775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255284039312785:7050]
2025-10-01T14:09:41.417830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:41.417843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.417846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:41.417991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:41.419026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:41.419042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:41.419046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:41.441600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255286416179037:7609]
2025-10-01T14:09:41.441876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 867, pipe: [1:7556255286416179037:7609]
2025-10-01T14:09:41.584470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:41.593673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.597013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.597236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.597300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.597368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.597434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.597479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.597485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.597559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.597622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.597690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.597760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.597815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.597819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.597886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.597945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.598005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.598064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.598106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.598110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.598176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.598248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.598312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.598401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.598452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.598455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.598526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.598586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.598647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.598713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.598756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.598760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.598826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.598891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.598955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.599017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.599058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.599060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.599128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.599187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.599250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.599310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.599352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.599355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.599427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.599494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.599560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.599630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.599673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.599676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.599753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.610284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:41.610297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:41.610323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 868 reason: error at write: Disconnected sessionId: src_id|b17e94d5-12da068a-8cec928d-74dd0815_0
2025-10-01T14:09:41.610813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17e94d5-12da068a-8cec928d-74dd0815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:41.610833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17e94d5-12da068a-8cec928d-74dd0815_0] Write session will restart in 0.006380s
2025-10-01T14:09:41.610865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17e94d5-12da068a-8cec928d-74dd0815_0] Write session: Do CDS request
2025-10-01T14:09:41.610498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255286416179037:7609]
2025-10-01T14:09:41.610872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17e94d5-12da068a-8cec928d-74dd0815_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:41.610529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:41.610548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 868 sessionId: src_id|b17e94d5-12da068a-8cec928d-74dd0815_0 is DEAD
2025-10-01T14:09:41.609048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.609152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.609223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.609285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.609291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.609372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:41.609435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:41.609499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:41.609563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:41.609605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:41.609609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:41.609692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416179037:7609], now have 1 active actors on pipe
2025-10-01T14:09:41.610911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:41.623937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17e94d5-12da068a-8cec928d-74dd0815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:41.630075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:41.630090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 869
2025-10-01T14:09:41.630341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:41.630400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:41.630406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:41.630410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:41.630795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 869 sessionId:  describe result for acl check
2025-10-01T14:09:41.630822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:41.630824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:41.630825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:41.630830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255286416179075:8028] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:41.631332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255286416179075:8028] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:41.642062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255286416179075:8028] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:41.648368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255286416179075:8028] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:41.648383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255286416179075:8028] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:41.648387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255286416179075:8028] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:41.648396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:41.658493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:41.660558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:41.660807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:41.660812Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:41.660824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:41.660874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:41.660909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255284039313003:7054]
2025-10-01T14:09:41.661515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:41.661895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:41.661935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:41.662234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:41.662290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.662291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.662292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.662294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.662296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.662297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.662298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.662299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.662300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.662302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.662303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.662304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.662305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.662306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.662311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.662322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.662326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.662330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.662334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.662337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.662341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.662345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.662348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.662352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.662356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.662360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.662363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.662366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.662389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.662397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:41.662403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.662408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:41.662412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.662417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:41.662421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.662427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:41.662431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.662436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:41.662440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.662445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:41.662450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.662455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:41.662459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.662464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:41.662468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.662473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:41.662478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.662501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.662506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.662511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.662515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.662520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.662525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.662529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:41.662534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.662538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:41.662578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:41.667192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:41.667837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:41.667843Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:41.667846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:41.667850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:41.667858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 868 [2:7556255284039313003:7054]
2025-10-01T14:09:41.667876Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:41.667894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:41.667897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:41.667901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:41.667904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:41.667921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:41.667928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:41.667935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:41.667999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.668002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.668004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.668007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:41.668011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:41.668084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:41.668087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.668098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:41.668109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:41.668124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:41.668142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255284039312997:7054]
2025-10-01T14:09:41.668144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255284039312997:7054]
2025-10-01T14:09:41.668146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255284039312997:7054]
2025-10-01T14:09:41.668159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:41.668175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:41.668188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:41.668190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:41.668228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255284039312997:7054]
2025-10-01T14:09:41.668231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:41.668349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:41.668351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:41.668353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:41.668358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:41.669128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 868
2025-10-01T14:09:41.669167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 868
2025-10-01T14:09:41.669374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416179040:2446], now have 1 active actors on pipe
2025-10-01T14:09:41.669391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416179199:8028], now have 1 active actors on pipe
2025-10-01T14:09:41.669429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.669435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.669467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|622a448c-10a207d-61378c89-7a5d8688_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:41.669477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:41.669482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:41.669485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:41.669496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:41.669510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:41.669527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:41.674954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 869 partition: 0 MaxSeqNo: 45 sessionId: src_id|622a448c-10a207d-61378c89-7a5d8688_0
2025-10-01T14:09:41.674774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.674795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.674830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:41.679410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17e94d5-12da068a-8cec928d-74dd0815_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|622a448c-10a207d-61378c89-7a5d8688_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:41.682084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|622a448c-10a207d-61378c89-7a5d8688_0] Write session: try to update token
2025-10-01T14:09:41.682113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|622a448c-10a207d-61378c89-7a5d8688_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:41.703937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:41.703958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:41.703961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:41.703963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:41.703977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255284039312997:7054]
2025-10-01T14:09:41.703982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255284039312997:7054]
2025-10-01T14:09:41.703988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255284039312997:7054]
2025-10-01T14:09:41.704038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:41.704046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:41.704049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:41.704206Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:41.707082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:41.707095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:41.707101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:41.717604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255286416179258:7609]
2025-10-01T14:09:41.717647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 869 sessionId: src_id|622a448c-10a207d-61378c89-7a5d8688_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:41.720505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:41.721254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 868, pipe: [1:7556255286416179258:7609]
2025-10-01T14:09:41.947203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:41.947888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:41.947899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:41.947925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416179258:7609], now have 1 active actors on pipe
2025-10-01T14:09:41.948976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:41.950925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255286416179258:7609]
2025-10-01T14:09:41.950951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:41.950983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:41.951051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 869 reason: status is not ok: tablet will be restarted right now sessionId: src_id|622a448c-10a207d-61378c89-7a5d8688_0
2025-10-01T14:09:41.951239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 869 sessionId: src_id|622a448c-10a207d-61378c89-7a5d8688_0 is DEAD
2025-10-01T14:09:41.951618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622a448c-10a207d-61378c89-7a5d8688_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:41.951626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622a448c-10a207d-61378c89-7a5d8688_0] Write session will restart in 0.006218s
2025-10-01T14:09:41.951653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622a448c-10a207d-61378c89-7a5d8688_0] Write session: Do CDS request
2025-10-01T14:09:41.951659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622a448c-10a207d-61378c89-7a5d8688_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:41.962310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|622a448c-10a207d-61378c89-7a5d8688_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:41.962855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:41.962871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 870
2025-10-01T14:09:41.963070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:41.963117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:41.963124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:41.963128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:41.963996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 870 sessionId:  describe result for acl check
2025-10-01T14:09:41.964029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:41.964030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:41.964032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:41.964038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255286416179284:8039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:41.964526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255286416179284:8039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:41.967690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255286416179284:8039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:41.975847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255286416179284:8039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:41.975866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255286416179284:8039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:41.975869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255286416179284:8039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:41.975877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:42.018343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:42.023132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:42.023376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:42.023380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:42.023390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:42.023437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:42.023485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255288334280507:7057]
2025-10-01T14:09:42.023945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:42.024426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:42.024462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:42.024726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:42.024802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.024803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.024804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.024805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.024806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.024806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.024807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.024809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.024809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.024810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.024810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.024811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.024812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.024813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.024817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.024824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.024826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.024829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.024831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.024833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.024835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.024837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.024839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.024841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.024843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.024845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.024848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.024850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.024855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.024862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.024866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.024873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.024876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.024879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.024881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.024884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.024887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.024891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.024894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.024897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.024900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.024903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.024906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.024909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.024913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.024916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.024919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.024922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.024925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.024930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.024932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.024935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.024938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.024941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.024943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.024946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.024967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:42.034622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:42.035336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:42.035343Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:42.035347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:42.035350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:42.035356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 869 [2:7556255288334280507:7057]
2025-10-01T14:09:42.035369Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:42.035384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:42.035388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:42.035392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:42.035394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:42.035414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:42.035419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:42.035426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:42.035492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.035494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.035496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.035500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:42.035503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:42.035578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:42.035580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.035591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.035600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.035614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:42.035632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255288334280502:7057]
2025-10-01T14:09:42.035635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255288334280502:7057]
2025-10-01T14:09:42.035637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255288334280502:7057]
2025-10-01T14:09:42.035650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:42.035667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:42.035681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:42.035684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:42.035730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255288334280502:7057]
2025-10-01T14:09:42.035733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:42.036155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:42.036164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:42.036166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:42.036171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:42.039060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416179274:2446], now have 1 active actors on pipe
2025-10-01T14:09:42.039077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255286416179331:8039], now have 1 active actors on pipe
2025-10-01T14:09:42.042484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 869
2025-10-01T14:09:42.042539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 869
2025-10-01T14:09:42.045854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.045875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.045914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:42.045927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:42.045934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:42.045937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:42.045953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:42.045972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:42.046001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:42.047499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.047517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.047552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:42.049582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|622a448c-10a207d-61378c89-7a5d8688_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:42.052268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0] Write session: try to update token
2025-10-01T14:09:42.052287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:42.049246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 870 partition: 0 MaxSeqNo: 45 sessionId: src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0
2025-10-01T14:09:42.058659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255290711146782:7609]
2025-10-01T14:09:42.060206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 869, pipe: [1:7556255290711146782:7609]
2025-10-01T14:09:42.062078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711146782:7609], now have 1 active actors on pipe
2025-10-01T14:09:42.081757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:42.081778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:42.081781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:42.081783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:42.081794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255288334280502:7057]
2025-10-01T14:09:42.081802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255288334280502:7057]
2025-10-01T14:09:42.081806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255288334280502:7057]
2025-10-01T14:09:42.081863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:42.081870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.081873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:42.082026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:42.082032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:42.082034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:42.082036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:42.109822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 870 sessionId: src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:42.112502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:42.236892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:42.237537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.237548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.238443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255290711146782:7609]
2025-10-01T14:09:42.238480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:42.238517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:42.238520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:42.238574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 870 reason: error at write: Disconnected sessionId: src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0
2025-10-01T14:09:42.238773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 870 sessionId: src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0 is DEAD
2025-10-01T14:09:42.239194Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:42.242471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:42.242482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0] Write session will restart in 0.007925s
2025-10-01T14:09:42.242509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0] Write session: Do CDS request
2025-10-01T14:09:42.242518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:42.252028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:42.252414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:42.252428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 871
2025-10-01T14:09:42.252564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:42.252621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:42.252629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:42.252632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:42.253169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 871 sessionId:  describe result for acl check
2025-10-01T14:09:42.253203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:42.253204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:42.253206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:42.253212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255290711146803:8046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:42.253719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255290711146803:8046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:42.256449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255290711146803:8046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:42.267321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255290711146803:8046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:42.267335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255290711146803:8046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:42.267338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255290711146803:8046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:42.267344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:42.275856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:42.278974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:42.279209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:42.279220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:42.279230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:42.279282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:42.279323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255288334280735:7071]
2025-10-01T14:09:42.279936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:42.280341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:42.280393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:42.280727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:42.280836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.280838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.280839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.280840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.280841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.280843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.280844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.280845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.280846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.280847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.280848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.280849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.280850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.280851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.280857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.280866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.280870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.280873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.280876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.280879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.280882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.280886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.280889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.280893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.280896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.280899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.280903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.280906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.280915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.280924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.280930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.280935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.280951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.280956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.280960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.280964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.280972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.280977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.280980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.280985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.280989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.280993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.280996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.281001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.281006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.281011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.281015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.281019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.281023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.281027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.281031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.281036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.281040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.281044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.281048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.281052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.281087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:42.286571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:42.287261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:42.287275Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:42.287277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:42.287280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:42.287286Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 870 [2:7556255288334280735:7071]
2025-10-01T14:09:42.287298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:42.287314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:42.287319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:42.287322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:42.287324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:42.287339Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:42.287346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:42.287351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:42.287405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.287413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.287414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.287417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:42.287419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:42.287470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:42.287471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.287485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.287495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.287511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:42.287526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255288334280730:7071]
2025-10-01T14:09:42.287527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255288334280730:7071]
2025-10-01T14:09:42.287529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255288334280730:7071]
2025-10-01T14:09:42.287541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:42.287552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:42.287560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:42.287563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:42.287592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255288334280730:7071]
2025-10-01T14:09:42.287594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:42.287760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:42.287764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:42.287766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:42.287772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:42.287927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711146905:8046], now have 1 active actors on pipe
2025-10-01T14:09:42.287948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711146793:2446], now have 1 active actors on pipe
2025-10-01T14:09:42.288921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 870
2025-10-01T14:09:42.288963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 870
2025-10-01T14:09:42.289230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.289246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.289282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:42.289296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:42.289304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:42.289307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:42.289318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:42.289335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:42.289356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:42.290990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.291002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.291038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:42.291395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 871 partition: 0 MaxSeqNo: 45 sessionId: src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0
2025-10-01T14:09:42.291803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a757ca22-4fbc63c4-3cd5a380-8308958c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:42.294606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0] Write session: try to update token
2025-10-01T14:09:42.294625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:42.310922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:42.310942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:42.310944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:42.310946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:42.310957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255288334280730:7071]
2025-10-01T14:09:42.310961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255288334280730:7071]
2025-10-01T14:09:42.310965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255288334280730:7071]
2025-10-01T14:09:42.311012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:42.311023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.311025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:42.311173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:42.314439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:42.314449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:42.314453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:42.321566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 871 sessionId: src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:42.324219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:42.338626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255290711147007:7609]
2025-10-01T14:09:42.338868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 870, pipe: [1:7556255290711147007:7609]
2025-10-01T14:09:42.486172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:42.486692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.486707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.486730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711147007:7609], now have 1 active actors on pipe
2025-10-01T14:09:42.488795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:42.490439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:42.490501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255290711147007:7609]
2025-10-01T14:09:42.490524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:42.490626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 871 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0
2025-10-01T14:09:42.490849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 871 sessionId: src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0 is DEAD
2025-10-01T14:09:42.491702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:42.491716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0] Write session will restart in 0.005637s
2025-10-01T14:09:42.491748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0] Write session: Do CDS request
2025-10-01T14:09:42.491754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:42.499251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:42.499976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:42.499994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 872
2025-10-01T14:09:42.500327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:42.500360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:42.500365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:42.500370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:42.504535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 872 sessionId:  describe result for acl check
2025-10-01T14:09:42.504579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:42.504581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:42.504583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:42.504592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255290711147027:8051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:42.505188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255290711147027:8051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:42.523002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255290711147027:8051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:42.539370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255290711147027:8051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:42.539390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255290711147027:8051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:42.539395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255290711147027:8051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:42.539405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:42.551798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:42.558929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:42.559188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:42.559192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:42.559203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:42.559258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:42.559298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255288334280949:7074]
2025-10-01T14:09:42.560238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:42.562861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:42.562964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:42.563376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:42.563473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.563474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.563475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.563476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.563478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.563480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.563481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.563483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.563484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.563485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.563487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.563489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.563490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.563492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.563498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.563508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.563512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.563515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.563519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.563523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.563526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.563530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.563533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.563537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.563540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.563543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.563547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.563550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.563560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.563568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.563574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.563579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.563583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.563588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.563592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.563597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.563603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.563608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.563613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.563618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.563623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.563628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.563633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.563638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.563643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.563647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.563653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.563658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.563663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.563668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.563673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.563678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.563683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.563688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.563692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.563697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.563735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:42.569666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:42.570452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:42.570458Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:42.570462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:42.570467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:42.570474Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 871 [2:7556255288334280949:7074]
2025-10-01T14:09:42.570492Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:42.570514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:42.570518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:42.570521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:42.570524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:42.570542Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:42.570548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:42.570555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:42.570632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.570634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.570637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.570640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:42.570643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:42.570922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:42.570925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.570938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.570948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.570964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:42.570983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255288334280944:7074]
2025-10-01T14:09:42.570985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255288334280944:7074]
2025-10-01T14:09:42.570987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255288334280944:7074]
2025-10-01T14:09:42.571007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:42.571023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:42.571037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:42.571040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:42.571080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255288334280944:7074]
2025-10-01T14:09:42.571082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:42.571328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:42.571336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:42.571338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:42.571343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:42.572097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 871
2025-10-01T14:09:42.572137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 871
2025-10-01T14:09:42.575470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711147011:2446], now have 1 active actors on pipe
2025-10-01T14:09:42.575492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711147190:8051], now have 1 active actors on pipe
2025-10-01T14:09:42.575526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.575533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.575569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:42.575588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:42.575601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:42.575605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:42.575617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:42.575635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:42.575655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:42.580159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.580182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.580216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:42.580418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 872 partition: 0 MaxSeqNo: 45 sessionId: src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0
2025-10-01T14:09:42.586769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0838c56-41e4acdd-6f121f2f-a8f841ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:42.589754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0] Write session: try to update token
2025-10-01T14:09:42.589775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:42.590708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255290711147212:7609]
2025-10-01T14:09:42.591263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 871, pipe: [1:7556255290711147212:7609]
2025-10-01T14:09:42.591188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711147212:7609], now have 1 active actors on pipe
2025-10-01T14:09:42.638109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 872 sessionId: src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:42.641317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.641340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.641380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:42.640819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:42.641608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:42.655661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:42.655683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:42.655686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:42.655688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:42.655697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255288334280944:7074]
2025-10-01T14:09:42.655702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255288334280944:7074]
2025-10-01T14:09:42.655707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255288334280944:7074]
2025-10-01T14:09:42.655755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:42.655764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.655766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:42.655920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:42.657885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:42.657896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:42.657901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:42.849899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:42.874802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.874841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.875077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.875161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.875235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.875315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.875377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.875386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.875479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.875573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.875648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.875722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.875774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.875778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.875867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.875934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.876005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.876075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.876129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.876133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.876213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.876283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.876352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.876418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.876481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.876485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.876585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.876660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.876728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.876813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.876866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.876870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.876955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.877026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.877109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.877186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.877464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.877477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.877565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.877662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.877735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.877810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.877863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.877866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.877942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.878010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.878070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.879590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:42.879639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:42.879642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:42.879670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 872 reason: error at write: Disconnected sessionId: src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0
2025-10-01T14:09:42.879874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 872 sessionId: src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0 is DEAD
2025-10-01T14:09:42.880012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255290711147212:7609]
2025-10-01T14:09:42.878132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.878184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.878187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.878253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.878318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.878401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.878469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.878510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.878513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.878582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:42.878637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:42.878701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:42.878762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:42.878807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:42.878809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:42.880229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:42.884845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:42.884863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0] Write session will restart in 0.005319s
2025-10-01T14:09:42.884892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0] Write session: Do CDS request
2025-10-01T14:09:42.884899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:42.894865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:42.897804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:42.897818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 873
2025-10-01T14:09:42.898086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:42.898116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:42.898122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:42.898125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:42.899583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 873 sessionId:  describe result for acl check
2025-10-01T14:09:42.899619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:42.899621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:42.899623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:42.899628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255290711147257:8057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:42.900151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255290711147257:8057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:42.906448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255290711147257:8057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:42.915174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255290711147257:8057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:42.915189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255290711147257:8057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:42.915192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255290711147257:8057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:42.915201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:42.919239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:42.925114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:42.925455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:42.925460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:42.925474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:42.925537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:42.925573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255288334281154:7078]
2025-10-01T14:09:42.926076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:42.926397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:42.926438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:42.926775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:42.926845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.926846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.926848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.926849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.926850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.926851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.926852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.926853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.926854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.926856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.926857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.926858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.926859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.926860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.926866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.926900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.926904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.926909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.926912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.926916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.926920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.926924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.926927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.926932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.926935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.926938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.926942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.926946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.926954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.926961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:42.926967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.926971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:42.926977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.926982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:42.926986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.926992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:42.926996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.927001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:42.927004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.927008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:42.927013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.927017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:42.927021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.927025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:42.927029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.927034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:42.927039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.927043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.927048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.927052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.927056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.927060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.927064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.927068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:42.927072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.927077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:42.927114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:42.936372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 872
2025-10-01T14:09:42.936418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 872
2025-10-01T14:09:42.934667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:42.935264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:42.935270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:42.935272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:42.935276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:42.935284Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 872 [2:7556255288334281154:7078]
2025-10-01T14:09:42.935303Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:42.935323Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:42.935327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:42.935331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:42.935333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:42.935352Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:42.935359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:42.935365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:42.935426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.935429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.935431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.935436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:42.935439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:42.935521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:42.935524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.935535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:42.935546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:42.935561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:42.935578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255288334281149:7078]
2025-10-01T14:09:42.935581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255288334281149:7078]
2025-10-01T14:09:42.935583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255288334281149:7078]
2025-10-01T14:09:42.935598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:42.935611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:42.935624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:42.935627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:42.935670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255288334281149:7078]
2025-10-01T14:09:42.935672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:42.935796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:42.935798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:42.935800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:42.935805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:42.936529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711147233:2446], now have 1 active actors on pipe
2025-10-01T14:09:42.936535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711147425:8057], now have 1 active actors on pipe
2025-10-01T14:09:42.936553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.936559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.936584Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:42.936590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:42.936594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:42.936596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:42.936604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:42.936615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:42.936633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:42.939259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:42.939276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:42.939305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:42.939761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 873 partition: 0 MaxSeqNo: 45 sessionId: src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0
2025-10-01T14:09:42.940243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf6c6de1-af7a4a42-49705d1e-a0bf7afc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:42.943009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0] Write session: try to update token
2025-10-01T14:09:42.943027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:42.960434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:42.960458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:42.960462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:42.960464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:42.960475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255288334281149:7078]
2025-10-01T14:09:42.960481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255288334281149:7078]
2025-10-01T14:09:42.960485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255288334281149:7078]
2025-10-01T14:09:42.960537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:42.960543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:42.960546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:42.960754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:42.962521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:42.962535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:42.962538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:42.964035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 873 sessionId: src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:42.966572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:42.982383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255290711147444:7609]
2025-10-01T14:09:42.982789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 872, pipe: [1:7556255290711147444:7609]
2025-10-01T14:09:43.118242Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:43.119813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.119832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.119878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255290711147444:7609], now have 1 active actors on pipe
2025-10-01T14:09:43.120091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:43.120631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:43.120681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:43.121108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:43.120760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0
2025-10-01T14:09:43.120928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255290711147444:7609]
2025-10-01T14:09:43.121132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0] Write session will restart in 0.009521s
2025-10-01T14:09:43.120957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 873 sessionId: src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0 is DEAD
2025-10-01T14:09:43.121167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0] Write session: Do CDS request
2025-10-01T14:09:43.121174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:43.134927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:43.135297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:43.135313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 874
2025-10-01T14:09:43.138524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:43.138583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:43.138594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:43.138600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:43.138993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 874 sessionId:  describe result for acl check
2025-10-01T14:09:43.139031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:43.139038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:43.139040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:43.139045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255295006114774:8068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:43.139613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255295006114774:8068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:43.146382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255295006114774:8068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:43.155105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255295006114774:8068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:43.155123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255295006114774:8068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:43.155126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255295006114774:8068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:43.155135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:43.161268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:43.165602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:43.165855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:43.165859Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:43.165872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:43.165921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:43.165954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255292629248672:7082]
2025-10-01T14:09:43.166567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:43.166922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:43.166967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:43.167265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:43.167310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.167312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.167313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.167313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.167315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.167315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.167317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.167318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.167319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.167320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.167321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.167323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.167324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.167325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.167330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.167340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.167343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.167347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.167350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.167354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.167357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.167360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.167364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.167367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.167370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.167373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.167377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.167380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.167386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.167394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.167399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.167404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.167408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.167413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.167418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.167423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.167430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.167435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.167440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.167444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.167449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.167453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.167457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.167461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.167466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.167471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.167474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.167479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.167484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.167488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.167492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.167497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.167500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.167505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.167509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.167514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.167547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:43.175848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:43.176542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:43.176546Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:43.176549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:43.176553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:43.176560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 873 [2:7556255292629248672:7082]
2025-10-01T14:09:43.176575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:43.176591Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:43.176594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:43.176598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:43.176600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:43.176616Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:43.176621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:43.176628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:43.176685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.176688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.176689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.176692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:43.176695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:43.176782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:43.176784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.176795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.176805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.176819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:43.176837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255292629248660:7082]
2025-10-01T14:09:43.176839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255292629248660:7082]
2025-10-01T14:09:43.176841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255292629248660:7082]
2025-10-01T14:09:43.176855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:43.176873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:43.176887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:43.176890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:43.176931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255292629248660:7082]
2025-10-01T14:09:43.176933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:43.177299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:43.177305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:43.177307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:43.177312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:43.177700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 873
2025-10-01T14:09:43.177750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 873
2025-10-01T14:09:43.178144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255295006114761:2446], now have 1 active actors on pipe
2025-10-01T14:09:43.178155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255295006114954:8068], now have 1 active actors on pipe
2025-10-01T14:09:43.178173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.178178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.178206Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80c8a963-9743ce86-d5b29e32-94787552_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:43.178214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:43.178220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:43.178223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:43.178233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:43.178246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:43.178263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:43.178703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.178711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.178727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:43.180667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 874 partition: 0 MaxSeqNo: 45 sessionId: src_id|80c8a963-9743ce86-d5b29e32-94787552_0
2025-10-01T14:09:43.182509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fd73b40-910ed937-fe9d9c9c-2de60389_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|80c8a963-9743ce86-d5b29e32-94787552_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:43.186008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c8a963-9743ce86-d5b29e32-94787552_0] Write session: try to update token
2025-10-01T14:09:43.186030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c8a963-9743ce86-d5b29e32-94787552_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:43.218132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:43.218155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:43.218158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:43.218160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:43.218173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255292629248660:7082]
2025-10-01T14:09:43.218178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255292629248660:7082]
2025-10-01T14:09:43.218182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255292629248660:7082]
2025-10-01T14:09:43.218233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:43.218240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.218243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:43.218435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:43.222489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255295006114968:7609]
2025-10-01T14:09:43.222541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:43.222556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:43.222560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:43.222932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 873, pipe: [1:7556255295006114968:7609]
2025-10-01T14:09:43.224400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 874 sessionId: src_id|80c8a963-9743ce86-d5b29e32-94787552_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:43.227593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:43.391583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:43.392261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255295006114968:7609], now have 1 active actors on pipe
2025-10-01T14:09:43.392301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.392309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.392610Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:43.392674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:43.392688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:43.392752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 874 reason: error at write: Disconnected sessionId: src_id|80c8a963-9743ce86-d5b29e32-94787552_0
2025-10-01T14:09:43.392961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 874 sessionId: src_id|80c8a963-9743ce86-d5b29e32-94787552_0 is DEAD
2025-10-01T14:09:43.393142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:43.393180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255295006114968:7609]
2025-10-01T14:09:43.393947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c8a963-9743ce86-d5b29e32-94787552_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:43.393957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c8a963-9743ce86-d5b29e32-94787552_0] Write session will restart in 0.008876s
2025-10-01T14:09:43.393988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c8a963-9743ce86-d5b29e32-94787552_0] Write session: Do CDS request
2025-10-01T14:09:43.393994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c8a963-9743ce86-d5b29e32-94787552_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:43.406835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80c8a963-9743ce86-d5b29e32-94787552_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:43.407656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:43.407671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 875
2025-10-01T14:09:43.410493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:43.410542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:43.410548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:43.410552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:43.411025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 875 sessionId:  describe result for acl check
2025-10-01T14:09:43.411056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:43.411058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:43.411060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:43.411067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255295006114995:8073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:43.411622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255295006114995:8073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:43.415572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255295006114995:8073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:43.426890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255295006114995:8073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:43.426910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255295006114995:8073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:43.426913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255295006114995:8073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:43.426924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:43.459481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:43.462474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:43.462701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:43.462706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:43.462718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:43.462790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:43.462830Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255292629248893:7095]
2025-10-01T14:09:43.463502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:43.466736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:43.466816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:43.467168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:43.467229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.467230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.467232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.467233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.467234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.467235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.467236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.467238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.467239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.467240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.467242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.467243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.467244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.467245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.467251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.467260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.467263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.467267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.467270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.467273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.467276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.467279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.467283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.467286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.467289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.467293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.467296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.467301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.467309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.467316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.467322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.467328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.467334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.467339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.467343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.467348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.467352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.467356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.467360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.467366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.467371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.467377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.467381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.467387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.467391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.467396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.467399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.467403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.467407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.467411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.467415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.467421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.467425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.467430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.467434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.467439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.467479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:43.475107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:43.475951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:43.475965Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:43.475968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:43.475972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:43.475978Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 874 [2:7556255292629248893:7095]
2025-10-01T14:09:43.475994Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:43.476010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:43.476021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:43.476024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:43.476026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:43.476041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:43.476050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:43.476055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:43.476112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.476118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.476120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.476123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:43.476126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:43.476191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:43.476197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.476208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.476216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.476229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:43.476246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255295006115074:8073], now have 1 active actors on pipe
2025-10-01T14:09:43.476248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255295006114981:2446], now have 1 active actors on pipe
2025-10-01T14:09:43.476256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255292629248888:7095]
2025-10-01T14:09:43.476258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255292629248888:7095]
2025-10-01T14:09:43.476260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255292629248888:7095]
2025-10-01T14:09:43.476273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:43.476286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:43.476297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:43.476300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:43.476334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255292629248888:7095]
2025-10-01T14:09:43.476337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:43.476519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:43.476523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:43.476525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:43.476531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:43.476897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.476906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.476930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:43.476937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:43.476940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:43.476943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:43.476950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:43.476959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:43.476975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:43.476365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 874
2025-10-01T14:09:43.476400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 874
2025-10-01T14:09:43.479504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.479518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.479549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:43.481233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 875 partition: 0 MaxSeqNo: 45 sessionId: src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0
2025-10-01T14:09:43.486620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80c8a963-9743ce86-d5b29e32-94787552_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:43.489405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0] Write session: try to update token
2025-10-01T14:09:43.489425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:43.493434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255295006115188:7609], now have 1 active actors on pipe
2025-10-01T14:09:43.493211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255295006115188:7609]
2025-10-01T14:09:43.493617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 874, pipe: [1:7556255295006115188:7609]
2025-10-01T14:09:43.496973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:43.496989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:43.496999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255292629248888:7095]
2025-10-01T14:09:43.497039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:43.497040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:43.497189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:43.497312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:43.497432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:43.497561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:43.497752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:43.497791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:43.510421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 875 sessionId: src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:43.513011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:43.514487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.514512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.514553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:43.517772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:43.549372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.549400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.549575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.549639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.549712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.549770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.549826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.549832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.549903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.549964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.550023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.550099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.550141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.550145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.550215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.550276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.550343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.550540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.550593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.550602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.550675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.550747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.550820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.550891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.550939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.550946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.551018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.551092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.551163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.551238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.551288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.551296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.551370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.551443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.551515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.551589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.551638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.551646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.551723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.551795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.551870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.551948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.552000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.552007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.552082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.552158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.552232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.552306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.552355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.552363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.552446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.552524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.552592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.552664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.552711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.552714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.552799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:43.552864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:43.552927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:43.553002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:43.553046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:43.553049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:43.553140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:09:43.553204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:43.553224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:43.553227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:09:43.553246Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553256Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553260Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553264Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553268Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553272Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553276Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553280Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553284Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553288Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553547Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553551Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553555Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553559Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553562Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553569Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553574Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553578Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553581Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553585Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553903Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553907Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553911Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553916Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553920Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553924Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553928Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553932Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553935Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.553939Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.554083Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.554087Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.554092Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.554095Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.554099Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:09:43.554120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:09:43.554129Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:09:43.554133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:09:43.554136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:09:43.554141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:09:43.554778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:09:43.554803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:09:43.554893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:09:43.554896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:09:43.554899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:09:43.554903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:09:43.555424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:09:43.555436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:09:43.555441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:09:43.555446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:09:43.555449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:09:43.555453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:09:43.555942Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:09:43.555952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:43.556055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327783550
2025-10-01T14:09:43.559429Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:09:43.559459Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:09:43.559470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:43.559473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:43.559477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:43.559479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:43.559487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255292629248888:7095]
2025-10-01T14:09:43.559491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255292629248888:7095]
2025-10-01T14:09:43.559494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255292629248888:7095]
2025-10-01T14:09:43.559570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:43.559574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.559577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:43.559724Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:43.562779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:43.562787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:43.562791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:43.716650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:43.717267Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:43.717893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255295006115188:7609]
2025-10-01T14:09:43.717934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:43.717975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 875 reason: status is not ok: tablet will be restarted right now sessionId: src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0
2025-10-01T14:09:43.718226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 875 sessionId: src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0 is DEAD
2025-10-01T14:09:43.718339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:43.718350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0] Write session will restart in 0.007854s
2025-10-01T14:09:43.718392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0] Write session: Do CDS request
2025-10-01T14:09:43.718400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:43.718414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:43.724592Z node 2 :BS_PROXY_PUT ERROR: dsproxy_put_impl.cpp:72: [a70353ddd3d5ca74] Result# TEvPutResult {Id# [72075186224037892:874:1:2:1:6759616:0] Status# BLOCKED StatusFlags# { } ErrorReason# "Got VPutResult status# BLOCKED from VDiskId# [82000000:1:0:0:0]" ApproximateFreeSpaceShare# 0} GroupId# 2181038080 Marker# BPP12
2025-10-01T14:09:43.727949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:43.728373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:43.728386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 876
2025-10-01T14:09:43.729027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:43.729078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:43.729096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:43.729100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:43.729449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 876 sessionId:  describe result for acl check
2025-10-01T14:09:43.729480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:43.729481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:43.729482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:43.729486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255295006115224:8079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:43.729932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255295006115224:8079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:43.732140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255295006115224:8079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:43.737663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255295006115224:8079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:43.737681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255295006115224:8079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:43.737685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255295006115224:8079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:43.737695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:43.742954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:43.750912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:43.751232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:43.751237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:43.751249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:43.751306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:43.751346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255292629249111:7098]
2025-10-01T14:09:43.751932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:43.752343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:43.752385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:43.752664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:43.752728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.752735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.752736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.752737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.752739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.752753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.752755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.752756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.752757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.752758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.752759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.752761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.752762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.752763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.752769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.752777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.752781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.752784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.752788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.752791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.752794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.752798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.752802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.752805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.752808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.752812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.752815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.752818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.752826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.752832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:43.752838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.752843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:43.752847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.752852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:43.752856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.752860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:43.752865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.752874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:43.752879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.752884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:43.752893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.752897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:43.752902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.752911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:43.752920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.752928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:43.752933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.752939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.752947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.752952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.752962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.752967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.752972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.752982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:43.752986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.752990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:43.753029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:43.766991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:43.767663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:43.767668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:43.767672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:43.767675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:43.767683Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 875 [2:7556255292629249111:7098]
2025-10-01T14:09:43.767711Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:43.767730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:43.767733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:43.767737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:43.767740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:43.767758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:43.767763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:43.767771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:43.767839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.767841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.767843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.767847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:43.767850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:43.767928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:43.767930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.767941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:43.767952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:43.767968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:43.767985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255292629249105:7098]
2025-10-01T14:09:43.767988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255292629249105:7098]
2025-10-01T14:09:43.767990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255292629249105:7098]
2025-10-01T14:09:43.768000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:43.768014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:43.768028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:43.768030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:43.768032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:43.768034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:43.768036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:43.768071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255292629249105:7098]
2025-10-01T14:09:43.768081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:43.768083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:43.768091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255295006115366:8079], now have 1 active actors on pipe
2025-10-01T14:09:43.768095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255295006115209:2446], now have 1 active actors on pipe
2025-10-01T14:09:43.768429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 875
2025-10-01T14:09:43.768464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 875
2025-10-01T14:09:43.768775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.768793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.768826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:43.768844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:43.768850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:43.768858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:43.768871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:43.768889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:43.768913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:43.769239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.769252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.769273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:43.769445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 876 partition: 0 MaxSeqNo: 45 sessionId: src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0
2025-10-01T14:09:43.770325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a1a3ce-85a9121f-7bf84988-db1456ba_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:43.772989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0] Write session: try to update token
2025-10-01T14:09:43.773005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:43.795349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:43.795369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:43.795373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:43.795375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:43.795385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255292629249105:7098]
2025-10-01T14:09:43.795391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255292629249105:7098]
2025-10-01T14:09:43.795396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255292629249105:7098]
2025-10-01T14:09:43.795451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:43.795458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:43.795461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:43.795486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:43.795496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:43.795502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:43.795610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:43.800041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 876 sessionId: src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:43.803332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:43.817993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255295006115419:7609]
2025-10-01T14:09:43.823422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 875, pipe: [1:7556255295006115419:7609]
2025-10-01T14:09:43.996739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:43.997398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:43.997408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:43.997427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255295006115419:7609], now have 1 active actors on pipe
2025-10-01T14:09:43.998529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:44.000702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:44.000801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 876 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0
2025-10-01T14:09:44.000999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 876 sessionId: src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0 is DEAD
2025-10-01T14:09:44.001131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255295006115419:7609]
2025-10-01T14:09:44.001146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:44.001454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:44.001463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0] Write session will restart in 0.008139s
2025-10-01T14:09:44.001493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0] Write session: Do CDS request
2025-10-01T14:09:44.001501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:44.010899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:44.011524Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:44.011541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 877
2025-10-01T14:09:44.011774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:44.011800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:44.011806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:44.011810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:44.019368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 877 sessionId:  describe result for acl check
2025-10-01T14:09:44.019417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:44.019419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:44.019421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:44.019427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255299301082735:8083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:44.019961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255299301082735:8083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:44.022610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255299301082735:8083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:44.030313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255299301082735:8083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:44.030329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255299301082735:8083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:44.030332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255299301082735:8083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:44.030341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:44.065207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:44.070849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:44.071094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:44.071099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:44.071110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:44.071155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:44.071194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255296924216615:7101]
2025-10-01T14:09:44.071724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:44.075521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:44.075593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:44.075927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:44.075970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.075971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.075972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.075973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.075974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.075975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.075976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.075977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.075978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.075979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.075980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.075981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.075982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.075983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.075989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.075996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.076000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.076003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.076007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.076010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.076013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.076016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.076019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.076023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.076026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.076028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.076031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.076034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.076041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.076048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.076053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.076058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.076061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.076066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.076070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.076074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.076077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.076081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.076085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.076089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.076093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.076097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.076102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.076106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.076110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.076114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.076117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.076122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.076125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.076129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.076133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.076137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.076140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.076144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.076147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.076152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.076185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:44.085099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:44.086005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:44.086021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:44.086023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:44.086027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:44.086034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 876 [2:7556255296924216615:7101]
2025-10-01T14:09:44.086051Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:44.086069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:44.086077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:44.086080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:44.086082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:44.086098Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:44.086103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:44.086109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:44.086169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.086179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.086180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.086184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:44.086186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:44.086259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:44.086262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.086273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.086282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.086296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:44.086312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255296924216609:7101]
2025-10-01T14:09:44.086314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255296924216609:7101]
2025-10-01T14:09:44.086316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255296924216609:7101]
2025-10-01T14:09:44.086327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:44.086340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:44.086353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:44.086356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:44.086411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255296924216609:7101]
2025-10-01T14:09:44.086413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:44.087049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:44.087053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:44.087055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:44.087060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:44.087811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 876
2025-10-01T14:09:44.087839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 876
2025-10-01T14:09:44.089630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301082781:8083], now have 1 active actors on pipe
2025-10-01T14:09:44.089648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301082723:2446], now have 1 active actors on pipe
2025-10-01T14:09:44.089671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.089678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.089712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:44.089723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:44.089729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:44.089732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:44.089747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:44.089762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:44.089785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:44.090288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.090296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.090316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:44.090476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 877 partition: 0 MaxSeqNo: 45 sessionId: src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0
2025-10-01T14:09:44.094523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b52c9149-513c6e1a-a7d9c4ac-f55f5ae8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:44.097390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0] Write session: try to update token
2025-10-01T14:09:44.097410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:44.101600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255299301082953:7609]
2025-10-01T14:09:44.102532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 876, pipe: [1:7556255299301082953:7609]
2025-10-01T14:09:44.102928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301082953:7609], now have 1 active actors on pipe
2025-10-01T14:09:44.128282Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:44.128303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:44.128306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:44.128308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:44.128320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255296924216609:7101]
2025-10-01T14:09:44.128325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255296924216609:7101]
2025-10-01T14:09:44.128328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255296924216609:7101]
2025-10-01T14:09:44.128380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:44.128388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.128390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:44.128414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:44.128424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:44.128431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:44.128548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:44.131679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 877 sessionId: src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:44.134526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:44.319623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:44.319849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.319857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.320178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:44.320483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:44.320538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255299301082953:7609]
2025-10-01T14:09:44.320560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:44.320626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 877 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0
2025-10-01T14:09:44.320856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 877 sessionId: src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0 is DEAD
2025-10-01T14:09:44.322463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:44.322476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0] Write session will restart in 0.007454s
2025-10-01T14:09:44.322516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0] Write session: Do CDS request
2025-10-01T14:09:44.322523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:44.330849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:44.332399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:44.332413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 878
2025-10-01T14:09:44.332552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:44.332582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:44.332587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:44.332590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:44.332941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 878 sessionId:  describe result for acl check
2025-10-01T14:09:44.332975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:44.332982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:44.332984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:44.332989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255299301083041:8095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:44.333460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255299301083041:8095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:44.335921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255299301083041:8095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:44.338972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255299301083041:8095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:44.338996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255299301083041:8095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:44.338999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255299301083041:8095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:44.339006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:44.338923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:44.342575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:44.342802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:44.342813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:44.342825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:44.342872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:44.342915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255296924216859:7115]
2025-10-01T14:09:44.343527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:44.343796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:44.343839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:44.344141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:44.344192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.344194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.344195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.344196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.344198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.344199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.344200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.344201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.344203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.344204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.344205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.344207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.344208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.344209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.344214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.344224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.344228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.344232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.344236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.344240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.344244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.344248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.344252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.344256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.344260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.344264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.344267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.344271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.344277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.344285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.344291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.344297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.344301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.344307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.344311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.344316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.344320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.344326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.344330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.344337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.344342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.344347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.344351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.344356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.344360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.344365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.344369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.344374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.344378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.344382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.344386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.344391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.344396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.344401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.344405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.344410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.344451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:44.350130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:44.350915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:44.350921Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:44.350924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:44.350928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:44.350936Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 877 [2:7556255296924216859:7115]
2025-10-01T14:09:44.350952Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:44.350970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:44.350974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:44.350977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:44.350980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:44.350996Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:44.351002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:44.351008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:44.351322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.351326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.351328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.351332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:44.351334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:44.351422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:44.351424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.351437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.351447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.351464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:44.351484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255296924216853:7115]
2025-10-01T14:09:44.351487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255296924216853:7115]
2025-10-01T14:09:44.351489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255296924216853:7115]
2025-10-01T14:09:44.351498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:44.351516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:44.351515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:44.351518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:44.351521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:44.351529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:44.351532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:44.351545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301083166:8095], now have 1 active actors on pipe
2025-10-01T14:09:44.351548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301082966:2446], now have 1 active actors on pipe
2025-10-01T14:09:44.351585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255296924216853:7115]
2025-10-01T14:09:44.351595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:44.351832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:44.352102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.352114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.352142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50a87754-823cc74b-d016e2df-d4e88c06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:44.352151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:44.352157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:44.352160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:44.352173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:44.352186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:44.352203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:44.353698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.353712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.353737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:44.354634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5947185b-2ddfd76d-1e9e830a-272624e9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50a87754-823cc74b-d016e2df-d4e88c06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:44.357273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a87754-823cc74b-d016e2df-d4e88c06_0] Write session: try to update token
2025-10-01T14:09:44.357293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a87754-823cc74b-d016e2df-d4e88c06_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:44.351596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 877
2025-10-01T14:09:44.351629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 877
2025-10-01T14:09:44.354221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 878 partition: 0 MaxSeqNo: 45 sessionId: src_id|50a87754-823cc74b-d016e2df-d4e88c06_0
2025-10-01T14:09:44.372519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:44.372535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:44.372546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255296924216853:7115]
2025-10-01T14:09:44.372600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:44.372798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:44.372944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:44.373099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:44.373218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:44.373241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:44.373451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:44.373509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:44.382640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 878 sessionId: src_id|50a87754-823cc74b-d016e2df-d4e88c06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:44.385457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:44.386189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.386212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.386252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:44.386402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:44.400190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:44.400212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:44.400214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:44.400217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:44.400229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255296924216853:7115]
2025-10-01T14:09:44.400234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255296924216853:7115]
2025-10-01T14:09:44.400238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255296924216853:7115]
2025-10-01T14:09:44.400291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:44.400297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.400301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:44.400430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:44.401177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:44.401194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:44.401198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:44.420872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255299301083179:7609]
2025-10-01T14:09:44.421273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 877, pipe: [1:7556255299301083179:7609]
2025-10-01T14:09:44.586199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:44.595511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.595545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.595735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.595798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.595868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.595934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.595984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.595990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.596073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.596142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.596208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.596296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.596350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.596353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.596425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.596495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.596561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.596629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.596678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.596681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.596766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.596836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.596896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.596958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.597004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.597008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.597091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.597157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.597225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.597299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.597347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.597350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.597427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.597491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.597560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.597629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.597678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.597682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.597756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.597821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.597892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.597966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.598010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.598016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.598096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.598163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.598230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.598303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.598351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.598353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.598674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.598750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.598818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.598895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.598939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.598942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.599016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:44.599077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:44.599152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:44.599226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:44.599272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:44.599276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:44.599357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301083179:7609], now have 1 active actors on pipe
2025-10-01T14:09:44.602384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a87754-823cc74b-d016e2df-d4e88c06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:44.602403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a87754-823cc74b-d016e2df-d4e88c06_0] Write session will restart in 0.009777s
2025-10-01T14:09:44.602432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a87754-823cc74b-d016e2df-d4e88c06_0] Write session: Do CDS request
2025-10-01T14:09:44.602439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a87754-823cc74b-d016e2df-d4e88c06_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:44.601269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:44.601282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:44.601313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 878 reason: error at write: Disconnected sessionId: src_id|50a87754-823cc74b-d016e2df-d4e88c06_0
2025-10-01T14:09:44.601522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 878 sessionId: src_id|50a87754-823cc74b-d016e2df-d4e88c06_0 is DEAD
2025-10-01T14:09:44.601666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:44.601702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255299301083179:7609]
2025-10-01T14:09:44.602620Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:44.614040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a87754-823cc74b-d016e2df-d4e88c06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:44.614133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:44.614151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 879
2025-10-01T14:09:44.614303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:44.614348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:44.614359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:44.614363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:44.614842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 879 sessionId:  describe result for acl check
2025-10-01T14:09:44.614873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:44.614878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:44.614879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:44.614883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255299301083216:8099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:44.615368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255299301083216:8099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:44.618855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255299301083216:8099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:44.623117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255299301083216:8099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:44.623135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255299301083216:8099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:44.623138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255299301083216:8099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:44.623146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:44.625847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:44.628538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:44.628782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:44.628791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:44.628802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:44.628847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:44.628891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255296924217080:7119]
2025-10-01T14:09:44.629299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:44.629588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:44.629622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:44.629882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:44.629931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.629939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.629940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.629941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.629941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.629942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.629943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.629944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.629945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.629946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.629947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.629948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.629948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.629949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.629952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.629959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.629961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.629963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.629966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.629968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.629971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.629973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.629975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.629978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.629980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.629982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.629984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.629986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.629992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.629997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.630002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.630005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.630007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.630012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.630015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.630017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.630020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.630023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.630025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.630028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.630030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.630033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.630035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.630038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.630041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.630044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.630047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.630050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.630052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.630055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.630057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.630060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.630064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.630068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.630073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.630077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.630102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:44.633975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:44.634644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:44.634667Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:44.634671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:44.634674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:44.634681Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 878 [2:7556255296924217080:7119]
2025-10-01T14:09:44.634697Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:44.634714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:44.634717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:44.634721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:44.634723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:44.634741Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:44.634754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:44.634760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:44.634821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.634830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.634832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.634835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:44.634839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:44.634909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:44.634919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.634930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.634944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.634959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:44.634982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301083182:2446], now have 1 active actors on pipe
2025-10-01T14:09:44.634989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301083371:8099], now have 1 active actors on pipe
2025-10-01T14:09:44.634997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255296924217075:7119]
2025-10-01T14:09:44.635003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255296924217075:7119]
2025-10-01T14:09:44.635005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255296924217075:7119]
2025-10-01T14:09:44.635017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:44.635029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:44.635033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:44.635034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:44.635035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:44.635047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:44.635051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:44.635084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255296924217075:7119]
2025-10-01T14:09:44.635097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:44.635103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:44.636236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.636251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.636278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:44.636287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:44.636293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:44.636295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:44.636307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:44.636319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:44.636072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 878
2025-10-01T14:09:44.636094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 878
2025-10-01T14:09:44.636337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:44.636491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.636500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.636512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:44.636601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 879 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0
2025-10-01T14:09:44.637016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a87754-823cc74b-d016e2df-d4e88c06_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:44.639721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0] Write session: try to update token
2025-10-01T14:09:44.639744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:44.658480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:44.658500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:44.658502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:44.658504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:44.658512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255296924217075:7119]
2025-10-01T14:09:44.658518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255296924217075:7119]
2025-10-01T14:09:44.658521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255296924217075:7119]
2025-10-01T14:09:44.658560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:44.658572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:44.658572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:44.658576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:44.658580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.658583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:44.658722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:44.667615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 879 sessionId: src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:44.670395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:44.702519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255299301083409:7609]
2025-10-01T14:09:44.703712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 878, pipe: [1:7556255299301083409:7609]
2025-10-01T14:09:44.814451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:44.814860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.814871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.814913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301083409:7609], now have 1 active actors on pipe
2025-10-01T14:09:44.815167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:44.822569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:44.822647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:44.822744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 879 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0
2025-10-01T14:09:44.822977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 879 sessionId: src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0 is DEAD
2025-10-01T14:09:44.823146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:44.823166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0] Write session will restart in 0.007525s
2025-10-01T14:09:44.823172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255299301083409:7609]
2025-10-01T14:09:44.823194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0] Write session: Do CDS request
2025-10-01T14:09:44.823202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:44.831957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:44.832093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:44.832110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 880
2025-10-01T14:09:44.834897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:44.834954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:44.834960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:44.834964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:44.835835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 880 sessionId:  describe result for acl check
2025-10-01T14:09:44.835876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:44.835881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:44.835883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:44.835888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255299301083446:8105] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:44.836394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255299301083446:8105] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:44.842221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255299301083446:8105] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:44.848338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255299301083446:8105] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:44.848358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255299301083446:8105] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:44.848361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255299301083446:8105] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:44.848371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:44.851929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:44.855907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:44.856178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:44.856183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:44.856195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:44.856247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:44.856292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255296924217290:7121]
2025-10-01T14:09:44.856988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:44.857587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:44.857648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:44.858007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:44.858080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.858081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.858083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.858084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.858085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.858087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.858088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.858089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.858090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.858091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.858092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.858094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.858095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.858096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.858102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.858112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.858116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.858119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.858123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.858127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.858130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.858134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.858137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.858141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.858145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.858149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.858152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.858156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.858165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.858173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:44.858179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.858185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:44.858189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.858195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:44.858199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.858205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:44.858211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.858216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:44.858221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.858227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:44.858233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.858239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:44.858244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.858252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:44.858257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.858263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:44.858268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.858272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.858277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.858282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.858286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.858291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.858297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.858303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:44.858308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.858314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:44.858354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:44.862551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:44.863281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:44.863286Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:44.863289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:44.863294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:44.863302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 879 [2:7556255296924217290:7121]
2025-10-01T14:09:44.863321Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:44.863340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:44.863344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:44.863348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:44.863350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:44.863366Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:44.863372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:44.863380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:44.863444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.863447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.863449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.863452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:44.863455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:44.863529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:44.863533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.863544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:44.863556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:44.863572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:44.863589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255296924217284:7121]
2025-10-01T14:09:44.863591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255296924217284:7121]
2025-10-01T14:09:44.863593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255296924217284:7121]
2025-10-01T14:09:44.863605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:44.863619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:44.863633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:44.863636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:44.863667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255296924217284:7121]
2025-10-01T14:09:44.863670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:44.863801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:44.863804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:44.863806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:44.863811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:44.864061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 879
2025-10-01T14:09:44.864111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 879
2025-10-01T14:09:44.864124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301083413:2446], now have 1 active actors on pipe
2025-10-01T14:09:44.864131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301083603:8105], now have 1 active actors on pipe
2025-10-01T14:09:44.864323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.864328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.864347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e049db38-68abd733-9bca7b87-e4ba2008_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:44.864352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:44.864356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:44.864357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:44.864366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:44.864376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:44.864394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:44.865162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:44.865173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:44.865191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:44.865363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 880 partition: 0 MaxSeqNo: 45 sessionId: src_id|e049db38-68abd733-9bca7b87-e4ba2008_0
2025-10-01T14:09:44.865780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d7af193-ad9c0d86-caee1f48-6f630d69_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e049db38-68abd733-9bca7b87-e4ba2008_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:44.868317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e049db38-68abd733-9bca7b87-e4ba2008_0] Write session: try to update token
2025-10-01T14:09:44.868337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e049db38-68abd733-9bca7b87-e4ba2008_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:44.875571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:44.875596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:44.875607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255296924217284:7121]
2025-10-01T14:09:44.875660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:44.875866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:44.876027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:44.876180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:44.876344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:44.876564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:44.876604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:44.876798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:44.895622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 880 sessionId: src_id|e049db38-68abd733-9bca7b87-e4ba2008_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:44.898183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:44.897687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:44.897713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:44.897717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:44.897720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:44.897731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255296924217284:7121]
2025-10-01T14:09:44.897737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255296924217284:7121]
2025-10-01T14:09:44.897742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255296924217284:7121]
2025-10-01T14:09:44.897796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:44.897806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:44.897809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:44.897982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:44.900760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:44.900777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:44.900782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:44.923160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255299301083628:7609]
2025-10-01T14:09:44.926892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 879, pipe: [1:7556255299301083628:7609]
2025-10-01T14:09:45.056773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:45.057667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.057687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.057708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255299301083628:7609], now have 1 active actors on pipe
2025-10-01T14:09:45.057993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:45.059438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e049db38-68abd733-9bca7b87-e4ba2008_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:45.059454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e049db38-68abd733-9bca7b87-e4ba2008_0] Write session will restart in 0.008574s
2025-10-01T14:09:45.058933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:45.058993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255299301083628:7609]
2025-10-01T14:09:45.059481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e049db38-68abd733-9bca7b87-e4ba2008_0] Write session: Do CDS request
2025-10-01T14:09:45.059013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:45.059086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 880 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e049db38-68abd733-9bca7b87-e4ba2008_0
2025-10-01T14:09:45.059490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e049db38-68abd733-9bca7b87-e4ba2008_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:45.059258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 880 sessionId: src_id|e049db38-68abd733-9bca7b87-e4ba2008_0 is DEAD
2025-10-01T14:09:45.069003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e049db38-68abd733-9bca7b87-e4ba2008_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:45.069451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:45.069467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 881
2025-10-01T14:09:45.069672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:45.069726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:45.069738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:45.069744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:45.070200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 881 sessionId:  describe result for acl check
2025-10-01T14:09:45.070234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:45.070240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:45.070241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:45.070246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255303596050942:8109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:45.070850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255303596050942:8109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:45.073030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255303596050942:8109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:45.078713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255303596050942:8109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:45.078733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255303596050942:8109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:45.078737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255303596050942:8109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:45.078747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:45.095743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:45.101607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:45.101882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:45.101886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:45.101898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:45.101956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:45.102007Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255301219184796:7124]
2025-10-01T14:09:45.102610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:45.106876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:45.106983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:45.107392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:45.107486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.107494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.107495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.107496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.107498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.107500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.107501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.107502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.107504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.107506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.107508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.107509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.107511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.107512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.107519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.107531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.107536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.107541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.107546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.107551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.107555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.107560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.107564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.107570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.107574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.107579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.107583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.107588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.107599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.107608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.107615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.107622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.107627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.107634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.107648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.107655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.107667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.107674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.107679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.107684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.107697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.107702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.107709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.107714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.107720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.107731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.107741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.107753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.107763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.107777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.107783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.107788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.107800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.107805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.107810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.107821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.107864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:45.119783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:45.120532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:45.120538Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:45.120541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:45.120544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:45.120552Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 880 [2:7556255301219184796:7124]
2025-10-01T14:09:45.120570Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:45.120588Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:45.120591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:45.120595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:45.120598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:45.120616Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:45.120621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:45.120644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:45.120711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.120713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.120715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.120718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:45.120720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:45.120818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:45.120821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.120832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.120845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.120863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:45.120881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255301219184789:7124]
2025-10-01T14:09:45.120883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255301219184789:7124]
2025-10-01T14:09:45.120885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255301219184789:7124]
2025-10-01T14:09:45.120896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:45.120911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:45.120927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:45.120926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:45.120930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:45.120932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:45.120934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:45.120941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051061:8109], now have 1 active actors on pipe
2025-10-01T14:09:45.120984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596050928:2446], now have 1 active actors on pipe
2025-10-01T14:09:45.120986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255301219184789:7124]
2025-10-01T14:09:45.120999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:45.121031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:45.122054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 880
2025-10-01T14:09:45.122100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 880
2025-10-01T14:09:45.122994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 881 partition: 0 MaxSeqNo: 45 sessionId: src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0
2025-10-01T14:09:45.123358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e049db38-68abd733-9bca7b87-e4ba2008_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:45.122291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.122317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.122349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:45.122359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:45.122364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:45.122367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:45.122393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:45.122406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:45.122424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:45.122807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.122819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.122852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:45.126699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0] Write session: try to update token
2025-10-01T14:09:45.126716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:45.134293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:45.134316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:45.134326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255301219184789:7124]
2025-10-01T14:09:45.134367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:45.134588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:45.134752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:45.134912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:45.135072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:45.135126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:45.135305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:45.135365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:45.150776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 881 sessionId: src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:45.153948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:45.154352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.154392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.154431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:45.154707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:45.157883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:45.157908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:45.157911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:45.157913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:45.157925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255301219184789:7124]
2025-10-01T14:09:45.157930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255301219184789:7124]
2025-10-01T14:09:45.157935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255301219184789:7124]
2025-10-01T14:09:45.157996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:45.158014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.158017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:45.158175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:45.159587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:45.159604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:45.159612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:45.158684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255303596051169:7609]
2025-10-01T14:09:45.159738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 880, pipe: [1:7556255303596051169:7609]
2025-10-01T14:09:45.310809Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:45.311233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051169:7609], now have 1 active actors on pipe
2025-10-01T14:09:45.320642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.320676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.320880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.320957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.321031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.321114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.321167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.321172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.321250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.321316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.321380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.321457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.321502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.321505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.321582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.321641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.321702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.321767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.321823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.321826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.321900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.321964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.322027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.322088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.322134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.322137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.322209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.322265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.322324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.322414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.322461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.322465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.322533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.322598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.322675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.322741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.322780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.322784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.322854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.322930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.323001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.323072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.323120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.323123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.323198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.323261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.323324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.323397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.323444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.323447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.323527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.323596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.323664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.323732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.323779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.323782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.323860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.323928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.323996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.324062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.324122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.324125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.325451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:45.325467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:45.325496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 881 reason: error at write: Disconnected sessionId: src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0
2025-10-01T14:09:45.325693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 881 sessionId: src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0 is DEAD
2025-10-01T14:09:45.325878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:45.325891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0] Write session will restart in 0.008108s
2025-10-01T14:09:45.325919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0] Write session: Do CDS request
2025-10-01T14:09:45.325926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:45.325762Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:45.326096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:45.326142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255303596051169:7609]
2025-10-01T14:09:45.334934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:45.335043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:45.335081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 882
2025-10-01T14:09:45.336546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:45.336609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:45.336615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:45.336619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:45.337002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 882 sessionId:  describe result for acl check
2025-10-01T14:09:45.337041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:45.337047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:45.337049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:45.337055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255303596051200:8121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:45.338008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255303596051200:8121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:45.341147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255303596051200:8121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:45.344451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255303596051200:8121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:45.344468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255303596051200:8121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:45.344472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255303596051200:8121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:45.344483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:45.349348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:45.349970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:45.350170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:45.350179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:45.350196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:45.350237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:45.350276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255301219185042:7138]
2025-10-01T14:09:45.351019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:45.351372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:45.351426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:45.351753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:45.351812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.351817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.351818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.351819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.351821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.351822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.351823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.351824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.351826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.351827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.351828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.351829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.351830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.351831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.351836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.351845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.351848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.351851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.351855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.351858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.351861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.351864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.351867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.351871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.351874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.351877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.351881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.351884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.351892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.351899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.351905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.351910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.351914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.351918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.351922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.351926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.351934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.351939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.351943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.351949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.351953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.351958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.351962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.351966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.351970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.351975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.351983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.351988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.351992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.352007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.352016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.352020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.352025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.352029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.352033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.352037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.352074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:45.356110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:45.356801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:45.356814Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:45.356816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:45.356820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:45.356828Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 881 [2:7556255301219185042:7138]
2025-10-01T14:09:45.356844Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:45.356862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:45.356869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:45.356874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:45.356876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:45.356905Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:45.356915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:45.356921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:45.356986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.356994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.356997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.357000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:45.357002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:45.357071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:45.357079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.357090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.357104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.357122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:45.357146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051183:2446], now have 1 active actors on pipe
2025-10-01T14:09:45.357151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051384:8121], now have 1 active actors on pipe
2025-10-01T14:09:45.357158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255301219185037:7138]
2025-10-01T14:09:45.357160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255301219185037:7138]
2025-10-01T14:09:45.357162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255301219185037:7138]
2025-10-01T14:09:45.357177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:45.357192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:45.357211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:45.357219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:45.357239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:45.357250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:45.357253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:45.357187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 881
2025-10-01T14:09:45.357256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255301219185037:7138]
2025-10-01T14:09:45.357213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 881
2025-10-01T14:09:45.357259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:45.357281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:45.357381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.357393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.357436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:45.357447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:45.357453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:45.357458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:45.357469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:45.357484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:45.357505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:45.357684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.357692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.357706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:45.357806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 882 partition: 0 MaxSeqNo: 45 sessionId: src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0
2025-10-01T14:09:45.358210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cfd559b-15a872a4-1512086c-b4f8ed5e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:45.361572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0] Write session: try to update token
2025-10-01T14:09:45.361593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:45.380214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 882 sessionId: src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:45.382825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:45.384318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.384346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.384366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:45.384369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:45.384372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:45.384374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:45.384384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255301219185037:7138]
2025-10-01T14:09:45.384390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255301219185037:7138]
2025-10-01T14:09:45.384394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255301219185037:7138]
2025-10-01T14:09:45.384439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:45.384453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:45.384453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:45.384456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:45.384462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.384464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:45.384608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:45.426478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255303596051400:7609]
2025-10-01T14:09:45.426818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 881, pipe: [1:7556255303596051400:7609]
2025-10-01T14:09:45.534870Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:45.535246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:45.535297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051400:7609], now have 1 active actors on pipe
2025-10-01T14:09:45.535422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:45.535459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:45.535507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255303596051400:7609]
2025-10-01T14:09:45.535530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:45.535533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:45.535604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 882 reason: error at write: Disconnected sessionId: src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0
2025-10-01T14:09:45.535827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 882 sessionId: src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0 is DEAD
2025-10-01T14:09:45.535979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:45.535995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0] Write session will restart in 0.008715s
2025-10-01T14:09:45.536026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0] Write session: Do CDS request
2025-10-01T14:09:45.536034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:45.546001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:45.546665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:45.546680Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 883
2025-10-01T14:09:45.547054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:45.547099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:45.547105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:45.547109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:45.547937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 883 sessionId:  describe result for acl check
2025-10-01T14:09:45.547973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:45.547975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:45.547977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:45.547984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255303596051453:8125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:45.548564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255303596051453:8125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:45.556072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255303596051453:8125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:45.558833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:45.559320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255303596051453:8125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:45.559333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255303596051453:8125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:45.559338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255303596051453:8125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:45.559345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:45.561591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:45.561837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:45.561848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:45.561860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:45.561930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:45.561991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255301219185266:7142]
2025-10-01T14:09:45.562601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:45.562932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:45.562982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:45.563309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:45.563376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.563382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.563383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.563384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.563386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.563387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.563389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.563390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.563391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.563392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.563394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.563395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.563396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.563397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.563403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.563414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.563418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.563422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.563438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.563442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.563445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.563449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.563452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.563456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.563459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.563463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.563467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.563471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.563479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.563488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.563494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.563503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.563508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.563517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.563523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.563528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.563534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.563540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.563550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.563556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.563564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.563570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.563575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.563586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.563592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.563602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.563607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.563612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.563617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.563623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.563628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.563633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.563638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.563644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.563651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.563656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.563699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:45.568141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:45.568846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:45.568862Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:45.568865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:45.568869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:45.568879Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 882 [2:7556255301219185266:7142]
2025-10-01T14:09:45.568896Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:45.568915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:45.568924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:45.568928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:45.568931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:45.568948Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:45.568960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:45.568967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:45.569034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.569042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.569044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.569047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:45.569050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:45.569122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:45.569135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.569148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.569158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.569174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:45.569198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051402:2446], now have 1 active actors on pipe
2025-10-01T14:09:45.569212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255301219185259:7142]
2025-10-01T14:09:45.569215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255301219185259:7142]
2025-10-01T14:09:45.569217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255301219185259:7142]
2025-10-01T14:09:45.569231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:45.569246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051608:8125], now have 1 active actors on pipe
2025-10-01T14:09:45.569259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:45.569290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 882
2025-10-01T14:09:45.569305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 882
2025-10-01T14:09:45.569278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:45.569286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:45.569314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:45.569318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:45.569330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255301219185259:7142]
2025-10-01T14:09:45.569333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:45.569320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:45.569345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:45.569390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.569400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.569428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|424552cb-28c52799-e6cd081d-50c8f51d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:45.569440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:45.569449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:45.569452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:45.569461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:45.569476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:45.569494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:45.569655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.569664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.569680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:45.569789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 883 partition: 0 MaxSeqNo: 45 sessionId: src_id|424552cb-28c52799-e6cd081d-50c8f51d_0
2025-10-01T14:09:45.570218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d675e55-7c4ce2c7-e9b0c03f-a3877703_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|424552cb-28c52799-e6cd081d-50c8f51d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:45.573949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424552cb-28c52799-e6cd081d-50c8f51d_0] Write session: try to update token
2025-10-01T14:09:45.573979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424552cb-28c52799-e6cd081d-50c8f51d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:45.589834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:45.589856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:45.589868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255301219185259:7142]
2025-10-01T14:09:45.589918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:45.589936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:45.590163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:45.590350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:45.590554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:45.590737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:45.590979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:45.591031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:45.594012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 883 sessionId: src_id|424552cb-28c52799-e6cd081d-50c8f51d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:45.597082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:45.597250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.597274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.597319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:45.597409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:45.612814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:45.612836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:45.612839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:45.612841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:45.612853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255301219185259:7142]
2025-10-01T14:09:45.612858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255301219185259:7142]
2025-10-01T14:09:45.612861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255301219185259:7142]
2025-10-01T14:09:45.612913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:45.612926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.612934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:45.613079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:45.613506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:45.613524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:45.613527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:45.635878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255303596051625:7609]
2025-10-01T14:09:45.636163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 882, pipe: [1:7556255303596051625:7609]
2025-10-01T14:09:45.774077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:45.782730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.782761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.782928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.783001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.783073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.783143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.783188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.783200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.783271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.783333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.783394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.783457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.783511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.783519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.783583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.783644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.783704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.783770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.783820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.783828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.783894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.783959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.784021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.784079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.784130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.784139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.784207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.784272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.784337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.784400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.784443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.784449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.784515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.784573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.784640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.784703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.784761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.784769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.784834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.784892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.784954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.785009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.785050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.785053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.785119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.785174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.785234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.785296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.785337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.785340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.785411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.785469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.785527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.785585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.785632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.785647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.785707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:45.785769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:45.785832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:45.785895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:45.785940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:45.785947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:45.786013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051625:7609], now have 1 active actors on pipe
2025-10-01T14:09:45.786256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:45.786269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255303596051625:7609]
2025-10-01T14:09:45.786295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:45.786297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:45.786327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 883 reason: error at write: Disconnected sessionId: src_id|424552cb-28c52799-e6cd081d-50c8f51d_0
2025-10-01T14:09:45.786588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 883 sessionId: src_id|424552cb-28c52799-e6cd081d-50c8f51d_0 is DEAD
2025-10-01T14:09:45.786778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424552cb-28c52799-e6cd081d-50c8f51d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:45.786786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424552cb-28c52799-e6cd081d-50c8f51d_0] Write session will restart in 0.009241s
2025-10-01T14:09:45.786813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424552cb-28c52799-e6cd081d-50c8f51d_0] Write session: Do CDS request
2025-10-01T14:09:45.786828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424552cb-28c52799-e6cd081d-50c8f51d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:45.787241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:45.797051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424552cb-28c52799-e6cd081d-50c8f51d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:45.797187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:45.797202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 884
2025-10-01T14:09:45.797494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:45.797554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:45.797568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:45.797575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:45.798173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 884 sessionId:  describe result for acl check
2025-10-01T14:09:45.798229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:45.798232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:45.798239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:45.798245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255303596051720:8131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:45.798906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255303596051720:8131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:45.801727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255303596051720:8131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:45.803612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:45.806221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:45.806483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:45.806493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:45.806504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:45.806561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:45.806601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255301219185481:7144]
2025-10-01T14:09:45.807237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:45.807665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:45.807724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:45.808047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:45.808106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.808112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.808114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.808116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.808117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.808118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.808119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.808120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.808121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.808123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.808124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.808124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.808126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.808127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.808133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.808143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.808147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.808151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.808155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.808159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.808162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.808166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.808170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.808174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.808177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.808181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.808185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.808188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.808197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.808205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:45.808211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.808216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:45.808222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.808232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:45.808237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.808247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:45.808256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.808260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:45.808268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.808273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:45.808282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.808287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:45.808296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.808301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:45.808310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.808315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:45.808323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.808328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.808337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.808341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.808349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.808354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.808363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.808368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:45.808374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.808383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:45.808425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:45.806704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255303596051720:8131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:45.806724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255303596051720:8131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:45.806728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255303596051720:8131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:45.806738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:45.812430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:45.813105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:45.813122Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:45.813125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:45.813129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:45.813136Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 883 [2:7556255301219185481:7144]
2025-10-01T14:09:45.813153Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:45.813170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:45.813178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:45.813182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:45.813185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:45.813203Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:45.813213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:45.813219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:45.813283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.813290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.813293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.813296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:45.813299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:45.813366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:45.813373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.813385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:45.813401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:45.813422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:45.813447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051848:8131], now have 1 active actors on pipe
2025-10-01T14:09:45.813455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051642:2446], now have 1 active actors on pipe
2025-10-01T14:09:45.813463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255301219185476:7144]
2025-10-01T14:09:45.813470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255301219185476:7144]
2025-10-01T14:09:45.813472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255301219185476:7144]
2025-10-01T14:09:45.813486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:45.813501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:45.813509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:45.813512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:45.813515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:45.813521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:45.813529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:45.813561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255301219185476:7144]
2025-10-01T14:09:45.813574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:45.813590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:45.813529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 883
2025-10-01T14:09:45.813541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 883
2025-10-01T14:09:45.813655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.813665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.813694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:45.813705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:45.813709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:45.813715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:45.813725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:45.813735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:45.813754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:45.813947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.813956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.813972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:45.814046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 884 partition: 0 MaxSeqNo: 45 sessionId: src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0
2025-10-01T14:09:45.814442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424552cb-28c52799-e6cd081d-50c8f51d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:45.817281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0] Write session: try to update token
2025-10-01T14:09:45.817298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:45.837382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:45.837413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:45.837416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:45.837418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:45.837429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255301219185476:7144]
2025-10-01T14:09:45.837435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255301219185476:7144]
2025-10-01T14:09:45.837440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255301219185476:7144]
2025-10-01T14:09:45.837492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:45.837497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:45.837499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:45.837503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:45.837505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:45.837508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:45.837697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:45.847245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 884 sessionId: src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:45.850833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:45.886269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255303596051861:7609]
2025-10-01T14:09:45.889675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 883, pipe: [1:7556255303596051861:7609]
2025-10-01T14:09:45.998162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:45.998876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:45.998897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:45.998920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051861:7609], now have 1 active actors on pipe
2025-10-01T14:09:45.999127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:45.999281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:45.999290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255303596051861:7609]
2025-10-01T14:09:45.999315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:45.999393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 884 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0
2025-10-01T14:09:45.999533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 884 sessionId: src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0 is DEAD
2025-10-01T14:09:45.999667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:45.999677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0] Write session will restart in 0.007491s
2025-10-01T14:09:45.999699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0] Write session: Do CDS request
2025-10-01T14:09:45.999703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:46.007901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.008319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:46.008339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 885
2025-10-01T14:09:46.008457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.008489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:46.008502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:46.008506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:46.008970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 885 sessionId:  describe result for acl check
2025-10-01T14:09:46.009012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:46.009019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:46.009021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:46.009027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255307891019175:8135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:46.009620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255307891019175:8135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:46.012034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255307891019175:8135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:46.018765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255307891019175:8135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:46.018785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255307891019175:8135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:46.018789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255307891019175:8135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:46.018798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:46.024697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:46.027968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:46.028242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:46.028258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:46.028270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:46.028337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:46.028386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255305514152992:7147]
2025-10-01T14:09:46.029100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:46.029438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:46.029496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:46.029842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:46.029905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.029913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.029915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.029916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.029917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.029919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.029920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.029921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.029923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.029924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.029926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.029928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.029929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.029931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.029937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.029948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.029952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.029957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.029962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.029967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.029969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.029972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.029974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.029977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.029979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.029981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.029984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.029986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.029993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.029998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.030002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.030006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.030009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.030013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.030016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.030021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.030024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.030027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.030033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.030036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.030040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.030043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.030046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.030049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.030052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.030055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.030058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.030061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.030066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.030068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.030072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.030075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.030079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.030082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.030084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.030087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.030112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:46.041634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:46.042449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:46.042469Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:46.042472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:46.042477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:46.042486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 884 [2:7556255305514152992:7147]
2025-10-01T14:09:46.042506Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:46.042528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:46.042553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.042557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.042560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.042582Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:46.042589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:46.042596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:46.042679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.042682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.042686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.042689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:46.042692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:46.042781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:46.042785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.042798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.042810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.042827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:46.042847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255305514152987:7147]
2025-10-01T14:09:46.042850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255305514152987:7147]
2025-10-01T14:09:46.042856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255305514152987:7147]
2025-10-01T14:09:46.042873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:46.042889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:46.042903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:46.042907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:46.042954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255305514152987:7147]
2025-10-01T14:09:46.042957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:46.043388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:46.043403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:46.043407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:46.043414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:46.043639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255303596051865:2446], now have 1 active actors on pipe
2025-10-01T14:09:46.043653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891019339:8135], now have 1 active actors on pipe
2025-10-01T14:09:46.043828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 884
2025-10-01T14:09:46.043884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 884
2025-10-01T14:09:46.043986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.044010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.044046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:46.044066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.044078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.044082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:46.044095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.044118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:46.044143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.044353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.044371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.044403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.044560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 885 partition: 0 MaxSeqNo: 45 sessionId: src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0
2025-10-01T14:09:46.044939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b232f6-8a1976ea-ff820015-c902bb9a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:46.048014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0] Write session: try to update token
2025-10-01T14:09:46.048039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:46.065062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 885 sessionId: src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:46.068140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:46.068512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.068544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.068579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:46.068666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:46.072532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:46.072564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:46.072567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:46.072569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:46.072579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255305514152987:7147]
2025-10-01T14:09:46.072584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255305514152987:7147]
2025-10-01T14:09:46.072590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255305514152987:7147]
2025-10-01T14:09:46.072642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:46.072647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:46.072654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.072656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:46.072657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:46.072660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:46.072833Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:46.099267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255307891019378:7609]
2025-10-01T14:09:46.099605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 884, pipe: [1:7556255307891019378:7609]
2025-10-01T14:09:46.218896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:46.229422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.229461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.229634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.229699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.229762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.229822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.229898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.229911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.229979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.230045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.230100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.230175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.230229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.230238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.230303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.230365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.230440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.230503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.230542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.230565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.230626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.230688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.230746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.230801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.230844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.230851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.230910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.230962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.231015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.231077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.231118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.231124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.231180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.231242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.231307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.231366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.231410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.231416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.231472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.231525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.231584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.231637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.231684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.231690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.231746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.231811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.231867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.231930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.231973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.231978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.232038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.232098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.232157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.232212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.232252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.232261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.232324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.232381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.232440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.232494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.232535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.232540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.232606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891019378:7609], now have 1 active actors on pipe
2025-10-01T14:09:46.232946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255307891019378:7609]
2025-10-01T14:09:46.232967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:46.232971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:46.232973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:46.233000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 885 reason: error at write: Disconnected sessionId: src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0
2025-10-01T14:09:46.233208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 885 sessionId: src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0 is DEAD
2025-10-01T14:09:46.233331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:46.233342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0] Write session will restart in 0.006862s
2025-10-01T14:09:46.233362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0] Write session: Do CDS request
2025-10-01T14:09:46.233367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:46.233790Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:46.241946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.242039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:46.242055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 886
2025-10-01T14:09:46.242227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.242274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:46.242284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:46.242288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:46.243210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 886 sessionId:  describe result for acl check
2025-10-01T14:09:46.243249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:46.243254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:46.243256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:46.243261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255307891019430:8146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:46.243767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255307891019430:8146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:46.246149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255307891019430:8146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:46.249719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255307891019430:8146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:46.249734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255307891019430:8146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:46.249738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255307891019430:8146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:46.249746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:46.252451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:46.255711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:46.255972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:46.255981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:46.255992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:46.256049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:46.256172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255305514153213:7151]
2025-10-01T14:09:46.256855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:46.257180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:46.257227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:46.257544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:46.257596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.257603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.257604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.257606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.257607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.257608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.257609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.257610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.257612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.257613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.257614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.257615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.257616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.257618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.257623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.257633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.257637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.257641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.257645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.257649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.257652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.257656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.257660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.257664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.257667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.257671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.257674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.257678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.257687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.257694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.257700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.257705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.257709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.257715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.257719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.257724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.257728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.257734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.257739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.257744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.257749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.257755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.257759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.257764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.257768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.257773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.257777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.257782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.257788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.257793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.257797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.257807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.257812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.257821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.257829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.257834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.257876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:46.262893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:46.263538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:46.263553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:46.263556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:46.263560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:46.263569Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 885 [2:7556255305514153213:7151]
2025-10-01T14:09:46.263587Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:46.263606Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:46.263615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.263618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.263622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.263639Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:46.263654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:46.263662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:46.263722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.263729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.263731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.263735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:46.263738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:46.263811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:46.263818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.263831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.263846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.263867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:46.263893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891019407:2446], now have 1 active actors on pipe
2025-10-01T14:09:46.263896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891019568:8146], now have 1 active actors on pipe
2025-10-01T14:09:46.263904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255305514153207:7151]
2025-10-01T14:09:46.263907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255305514153207:7151]
2025-10-01T14:09:46.263909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255305514153207:7151]
2025-10-01T14:09:46.263925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:46.263940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:46.263943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:46.263947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:46.263949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:46.263958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:46.263961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:46.264000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255305514153207:7151]
2025-10-01T14:09:46.264008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:46.263992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 885
2025-10-01T14:09:46.264012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 885
2025-10-01T14:09:46.264033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:46.264047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.264052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.264077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:46.264085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.264088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.264091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:46.264101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.264110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:46.264125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.264298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.264310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.264332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.264441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 886 partition: 0 MaxSeqNo: 45 sessionId: src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0
2025-10-01T14:09:46.265130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb1b67ec-95596dcd-f65dab60-a3e36f29_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:46.268351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0] Write session: try to update token
2025-10-01T14:09:46.268373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:46.282391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:46.282414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:46.282424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255305514153207:7151]
2025-10-01T14:09:46.282464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:46.282476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:46.282641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:46.282793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:46.282924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:46.283051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:46.283228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:46.283261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:46.293085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 886 sessionId: src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:46.295743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:46.295955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.295981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.296024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:46.296144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:46.298826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:46.298845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:46.298847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:46.298850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:46.298862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255305514153207:7151]
2025-10-01T14:09:46.298865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255305514153207:7151]
2025-10-01T14:09:46.298868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255305514153207:7151]
2025-10-01T14:09:46.298908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:46.298913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:46.298920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:46.298920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.298923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:46.298939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:46.299075Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:46.333235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255307891019631:7609]
2025-10-01T14:09:46.333573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 885, pipe: [1:7556255307891019631:7609]
2025-10-01T14:09:46.454655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:46.463205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.463236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.463418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.463482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.463552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.463615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.463664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.463676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.463744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.463802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.463867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.463930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.463981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.463989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.464065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.464131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.464198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.464271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.464323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.464333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.464405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.464470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.464538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.464604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.464649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.464656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.464727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.464802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.464873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.464936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.464981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.464988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.465059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.465120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.465187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.465251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.465301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.465312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.465382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.465448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.465518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.465584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.465634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.465644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.465704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.465763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.465830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.465895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.465940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.465947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.466052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.466122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.466194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.466260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.466305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.466312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.466396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:46.466460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:46.466520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:46.466582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:46.466638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:46.466647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:46.466718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891019631:7609], now have 1 active actors on pipe
2025-10-01T14:09:46.467521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:46.467543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:46.467574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 886 reason: error at write: Disconnected sessionId: src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0
2025-10-01T14:09:46.467995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:46.468006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0] Write session will restart in 0.006580s
2025-10-01T14:09:46.468034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0] Write session: Do CDS request
2025-10-01T14:09:46.468040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:46.468038Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:46.467826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 886 sessionId: src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0 is DEAD
2025-10-01T14:09:46.467834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:46.467888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255307891019631:7609]
2025-10-01T14:09:46.476017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.476139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:46.476160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 887
2025-10-01T14:09:46.476338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.476383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:46.476394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:46.476401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:46.476851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 887 sessionId:  describe result for acl check
2025-10-01T14:09:46.476904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:46.476911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:46.476914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:46.476920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255307891019658:8151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:46.477470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255307891019658:8151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:46.480133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255307891019658:8151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:46.483830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255307891019658:8151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:46.483847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255307891019658:8151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:46.483851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255307891019658:8151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:46.483860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:46.485997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:46.488968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:46.489164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:46.489173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:46.489181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:46.489229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:46.489277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255305514153460:7164]
2025-10-01T14:09:46.489815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:46.490117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:46.490160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:46.490488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:46.490543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.490548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.490549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.490551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.490552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.490553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.490555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.490556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.490557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.490559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.490560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.490561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.490563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.490564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.490569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.490581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.490585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.490588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.490593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.490597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.490601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.490604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.490609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.490613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.490618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.490627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.490631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.490635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.490657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.490664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.490671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.490676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.490680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.490686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.490692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.490702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.490711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.490720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.490729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.490738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.490743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.490748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.490753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.490758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.490765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.490771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.490775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.490779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.490787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.490796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.490804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.490810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.490815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.490824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.490832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.490841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.490885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:46.495116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:46.495692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:46.495706Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:46.495708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:46.495711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:46.495717Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 886 [2:7556255305514153460:7164]
2025-10-01T14:09:46.495729Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:46.495749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:46.495754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.495756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.495758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.495773Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:46.495780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:46.495785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:46.495835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.495841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.495842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.495845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:46.495847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:46.495909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:46.495919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.495930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.495940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.495955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:46.495974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891019640:2446], now have 1 active actors on pipe
2025-10-01T14:09:46.495981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891019837:8151], now have 1 active actors on pipe
2025-10-01T14:09:46.495987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255305514153455:7164]
2025-10-01T14:09:46.495988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255305514153455:7164]
2025-10-01T14:09:46.495990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255305514153455:7164]
2025-10-01T14:09:46.496001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:46.496019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:46.496026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:46.496036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:46.496040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:46.496043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:46.496044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:46.496043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 886
2025-10-01T14:09:46.496051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 886
2025-10-01T14:09:46.496082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255305514153455:7164]
2025-10-01T14:09:46.496091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:46.496103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:46.496126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.496131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.496170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:46.496184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.496188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.496190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:46.496199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.496214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:46.496235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.496379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.496389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.496408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.496500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 887 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0
2025-10-01T14:09:46.496883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3247b1d0-3d04e5eb-10ecdba7-c63fcd38_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:46.499716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0] Write session: try to update token
2025-10-01T14:09:46.499735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:46.519966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:46.519993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:46.519996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:46.519998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:46.520009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255305514153455:7164]
2025-10-01T14:09:46.520014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255305514153455:7164]
2025-10-01T14:09:46.520018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255305514153455:7164]
2025-10-01T14:09:46.520068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:46.520070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:46.520074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:46.520078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.520081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:46.520081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:46.520225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:46.517935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 887 sessionId: src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:46.520705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:46.568225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255307891019860:7609]
2025-10-01T14:09:46.568551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 886, pipe: [1:7556255307891019860:7609]
2025-10-01T14:09:46.672336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:46.672907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.672922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.672959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891019860:7609], now have 1 active actors on pipe
2025-10-01T14:09:46.673128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:46.673395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:46.673401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:46.673412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:46.673447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255307891019860:7609]
2025-10-01T14:09:46.673467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 887 reason: error at write: Disconnected sessionId: src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0
2025-10-01T14:09:46.673658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 887 sessionId: src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0 is DEAD
2025-10-01T14:09:46.674107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:46.674122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0] Write session will restart in 0.006457s
2025-10-01T14:09:46.674153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0] Write session: Do CDS request
2025-10-01T14:09:46.674160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:46.682257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.684638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:46.684653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 888
2025-10-01T14:09:46.689871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.689917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:46.689920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:46.689923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:46.690264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 888 sessionId:  describe result for acl check
2025-10-01T14:09:46.690292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:46.690297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:46.690298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:46.690302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255307891019921:8156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:46.690897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255307891019921:8156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:46.695684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255307891019921:8156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:46.701053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255307891019921:8156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:46.701077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255307891019921:8156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:46.701081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255307891019921:8156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:46.701093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:46.702510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:46.706789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:46.707074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:46.707090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:46.707104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:46.707174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:46.707232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255305514153687:7167]
2025-10-01T14:09:46.707961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:46.708374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:46.708449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:46.708875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:46.708954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.708961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.708963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.708965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.708977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.708978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.708980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.708981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.708983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.708984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.708987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.708989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.708991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.708993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.709000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.709010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.709015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.709020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.709024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.709028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.709032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.709036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.709039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.709043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.709047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.709051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.709054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.709058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.709067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.709075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.709082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.709094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.709101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.709113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.709122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.709128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.709138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.709143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.709156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.709165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.709170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.709180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.709185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.709191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.709200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.709206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.709216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.709222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.709227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.709232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.709235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.709248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.709251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.709255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.709258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.709261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.709287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:46.714608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:46.715463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:46.715484Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:46.715488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:46.715493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:46.715502Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 887 [2:7556255305514153687:7167]
2025-10-01T14:09:46.715523Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:46.715544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:46.715553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.715558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.715561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.715580Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:46.715591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:46.715604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:46.715685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.715695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.715698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.715702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:46.715706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:46.715788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:46.715791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.715806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.715817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.715833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:46.715852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255305514153682:7167]
2025-10-01T14:09:46.715855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255305514153682:7167]
2025-10-01T14:09:46.715860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255305514153682:7167]
2025-10-01T14:09:46.715869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:46.715885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:46.715899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:46.715903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:46.715942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255305514153682:7167]
2025-10-01T14:09:46.715945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:46.717088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:46.717102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:46.717108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:46.717117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:46.718366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891019873:2446], now have 1 active actors on pipe
2025-10-01T14:09:46.718402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891020081:8156], now have 1 active actors on pipe
2025-10-01T14:09:46.718429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.718435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.718468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:46.718484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.718492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.718496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:46.718513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.718530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:46.718555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.719513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.719531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.719556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.721336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f51f3-53c8630d-35b820f-d1d4d658_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:46.717422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 887
2025-10-01T14:09:46.717475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 887
2025-10-01T14:09:46.719693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 888 partition: 0 MaxSeqNo: 45 sessionId: src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0
2025-10-01T14:09:46.724358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0] Write session: try to update token
2025-10-01T14:09:46.724375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:46.742386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 888 sessionId: src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:46.743318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:46.743338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:46.743341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:46.743343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:46.743354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255305514153682:7167]
2025-10-01T14:09:46.743358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255305514153682:7167]
2025-10-01T14:09:46.743363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255305514153682:7167]
2025-10-01T14:09:46.743418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:46.743423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:46.743431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:46.743431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.743434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:46.743433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:46.745152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:46.743567Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:46.774411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255307891020098:7609]
2025-10-01T14:09:46.774894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 887, pipe: [1:7556255307891020098:7609]
2025-10-01T14:09:46.902108Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:46.902616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.902639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.902685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891020098:7609], now have 1 active actors on pipe
2025-10-01T14:09:46.903047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255307891020098:7609]
2025-10-01T14:09:46.903083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:46.903125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:46.903132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:46.903188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 888 reason: error at write: Disconnected sessionId: src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0
2025-10-01T14:09:46.903403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 888 sessionId: src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0 is DEAD
2025-10-01T14:09:46.903720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:46.906478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:46.906490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0] Write session will restart in 0.007109s
2025-10-01T14:09:46.906517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0] Write session: Do CDS request
2025-10-01T14:09:46.906522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:46.917990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.918537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:46.918556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 889
2025-10-01T14:09:46.918677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:46.918704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:46.918708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:46.918712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:46.919233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 889 sessionId:  describe result for acl check
2025-10-01T14:09:46.919272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:46.919274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:46.919276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:46.919283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255307891020117:8161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:46.919864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255307891020117:8161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:46.926203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255307891020117:8161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:46.933434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255307891020117:8161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:46.933454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255307891020117:8161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:46.933458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255307891020117:8161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:46.933468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:46.946820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:46.953925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:46.954206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:46.954211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:46.954228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:46.954313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:46.954365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255305514153906:7170]
2025-10-01T14:09:46.955042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:46.960151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:46.960241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:46.960667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:46.960756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.960757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.960758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.960760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.960762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.960764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.960766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.960768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.960769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.960770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.960772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.960773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.960775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.960776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.960782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.960792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.960796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.960799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.960803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.960806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.960809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.960813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.960816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.960820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.960823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.960826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.960830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.960833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.960845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.960853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:46.960859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.960865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:46.960869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.960874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:46.960879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.960884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:46.960888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.960894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:46.960899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.960905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:46.960914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.960919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:46.960924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.960928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:46.960933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.960938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:46.960943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.960947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.960953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.960957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.960962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.960967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.960972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.960977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:46.960982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.960987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:46.961026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:46.968765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:46.970183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 888
2025-10-01T14:09:46.970229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 888
2025-10-01T14:09:46.969439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:46.969463Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:46.969467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:46.969472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:46.969480Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 888 [2:7556255305514153906:7170]
2025-10-01T14:09:46.969501Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:46.969520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:46.969524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.969527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.969530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.969548Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:46.969554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:46.969560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:46.969627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.969629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.969632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.969636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:46.969639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:46.969724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:46.969727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:46.969740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:46.969751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:46.969769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:46.969787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255305514153900:7170]
2025-10-01T14:09:46.969790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255305514153900:7170]
2025-10-01T14:09:46.969792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255305514153900:7170]
2025-10-01T14:09:46.969807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:46.969822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:46.969838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:46.969841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:46.969844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:46.969852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:46.969855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:46.969882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255305514153900:7170]
2025-10-01T14:09:46.969886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:46.969913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:46.970052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891020246:8161], now have 1 active actors on pipe
2025-10-01T14:09:46.970061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255307891020101:2446], now have 1 active actors on pipe
2025-10-01T14:09:46.970448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.970456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.970486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:46.970494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:46.970499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:46.970501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:46.970513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:46.970524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:46.970542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.971047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:46.971053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:46.971084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:46.971242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 889 partition: 0 MaxSeqNo: 45 sessionId: src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0
2025-10-01T14:09:46.971666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7505b3b-b0f64f56-674234d6-bc3ae8de_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:46.974776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0] Write session: try to update token
2025-10-01T14:09:46.974795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:46.989434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:46.989456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:46.989465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255305514153900:7170]
2025-10-01T14:09:46.989508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:46.989510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:46.989700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:46.989847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:46.989985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:46.990127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:46.990337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:46.990408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:46.998517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 889 sessionId: src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:47.001655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:47.001936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.001966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.002012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:47.002150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:47.003448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255312185987620:7609]
2025-10-01T14:09:47.003634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185987620:7609], now have 1 active actors on pipe
2025-10-01T14:09:47.003667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 888, pipe: [1:7556255312185987620:7609]
2025-10-01T14:09:47.012584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:47.012626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:47.012630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:47.012632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:47.012644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255305514153900:7170]
2025-10-01T14:09:47.012649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255305514153900:7170]
2025-10-01T14:09:47.012653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255305514153900:7170]
2025-10-01T14:09:47.012710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:47.012709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:47.012717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:47.012721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:47.012723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.012726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:47.012880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:47.166217Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:47.175282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.175315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.175508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.175580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.175657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.175726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.175778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.175789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.175863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.175934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.176008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.176078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.176126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.176134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.176207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.176270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.176329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.176388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.176433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.176441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.176505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.176567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.176635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.176697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.177030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.177041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.177101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.177160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.177219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.177276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.177328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.177337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.177398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.177459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.177526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.177590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.177638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.177646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.177717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.177775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.177837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.177902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.177944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.177952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.178018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.178080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.178146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.178211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.178258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.178265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.178335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.178418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.178489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.178558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.178604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.178612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.178682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.178754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.178825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.178895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.178946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.178955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.179275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:47.179299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:47.179337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 889 reason: error at write: Disconnected sessionId: src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0
2025-10-01T14:09:47.179520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 889 sessionId: src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0 is DEAD
2025-10-01T14:09:47.179881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:47.179933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:47.179976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:47.179985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0] Write session will restart in 0.009484s
2025-10-01T14:09:47.179991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255312185987620:7609]
2025-10-01T14:09:47.180012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0] Write session: Do CDS request
2025-10-01T14:09:47.180019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:47.190870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:47.192205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:47.192224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 890
2025-10-01T14:09:47.192334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:47.192364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:47.192373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:47.192377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:47.192800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 890 sessionId:  describe result for acl check
2025-10-01T14:09:47.192833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:47.192834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:47.192836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:47.192841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255312185987708:8173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:47.193337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255312185987708:8173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:47.200619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:47.201324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255312185987708:8173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:47.203843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:47.204194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:47.204206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:47.204218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:47.204287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:47.204338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255309809121419:7172]
2025-10-01T14:09:47.204831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255312185987708:8173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:47.204851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255312185987708:8173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:47.204854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255312185987708:8173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:47.204865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:47.204959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:47.205287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:47.205325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:47.205568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:47.205621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.205626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.205628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.205629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.205630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.205632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.205633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.205634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.205636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.205637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.205639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.205640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.205640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.205641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.205647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.205658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.205661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.205665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.205669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.205673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.205676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.205680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.205684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.205687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.205691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.205695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.205699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.205703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.205710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.205718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.205724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.205731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.205740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.205750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.205758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.205763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.205772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.205778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.205785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.205792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.205800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.205805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.205812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.205818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.205826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.205831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.205839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.205844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.205851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.205856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.205863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.205869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.205876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.205885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.205889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.205893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.205934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:47.212510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:47.213686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:47.213708Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:47.213711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:47.213715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:47.213723Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 889 [2:7556255309809121419:7172]
2025-10-01T14:09:47.213741Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:47.213765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:47.213768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:47.213771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:47.213774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:47.213791Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:47.213801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:47.213808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:47.213886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.213898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.213901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.213904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:47.213906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:47.213985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:47.213988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.214000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.214010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.214023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:47.214041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255309809121414:7172]
2025-10-01T14:09:47.214043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255309809121414:7172]
2025-10-01T14:09:47.214045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255309809121414:7172]
2025-10-01T14:09:47.214059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:47.214074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:47.214087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:47.214090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:47.214128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255309809121414:7172]
2025-10-01T14:09:47.214130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:47.214135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:47.214162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:47.214164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:47.214173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:47.214438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 889
2025-10-01T14:09:47.214475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 889
2025-10-01T14:09:47.214461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185987851:8173], now have 1 active actors on pipe
2025-10-01T14:09:47.214474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185987630:2446], now have 1 active actors on pipe
2025-10-01T14:09:47.214590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.214602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.214638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c18d9d70-7d481113-fdb74551-8afb3397_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:47.214648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:47.214653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:47.214656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:47.214669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:47.214684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:47.214702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:47.214902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.214913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.214934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:47.215165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 890 partition: 0 MaxSeqNo: 45 sessionId: src_id|c18d9d70-7d481113-fdb74551-8afb3397_0
2025-10-01T14:09:47.215534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d32b3ff1-9d579361-3ea92f3-3a10f652_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c18d9d70-7d481113-fdb74551-8afb3397_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:47.218760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c18d9d70-7d481113-fdb74551-8afb3397_0] Write session: try to update token
2025-10-01T14:09:47.218781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c18d9d70-7d481113-fdb74551-8afb3397_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:47.237962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 890 sessionId: src_id|c18d9d70-7d481113-fdb74551-8afb3397_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:47.240481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:47.240860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.240892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.240912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:47.240916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:47.240918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:47.240921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:47.240930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255309809121414:7172]
2025-10-01T14:09:47.240936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255309809121414:7172]
2025-10-01T14:09:47.240939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255309809121414:7172]
2025-10-01T14:09:47.240983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:47.241004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:47.241011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.241012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:47.241013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:47.241017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:47.241176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:47.280426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255312185987877:7609]
2025-10-01T14:09:47.280681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 889, pipe: [1:7556255312185987877:7609]
2025-10-01T14:09:47.382706Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:47.383510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:47.383578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185987877:7609], now have 1 active actors on pipe
2025-10-01T14:09:47.383763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:47.383789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255312185987877:7609]
2025-10-01T14:09:47.383811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:47.383887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:47.383895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:47.383990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 890 reason: error at write: Disconnected sessionId: src_id|c18d9d70-7d481113-fdb74551-8afb3397_0
2025-10-01T14:09:47.384190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 890 sessionId: src_id|c18d9d70-7d481113-fdb74551-8afb3397_0 is DEAD
2025-10-01T14:09:47.384716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18d9d70-7d481113-fdb74551-8afb3397_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:47.384727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18d9d70-7d481113-fdb74551-8afb3397_0] Write session will restart in 0.007332s
2025-10-01T14:09:47.384761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18d9d70-7d481113-fdb74551-8afb3397_0] Write session: Do CDS request
2025-10-01T14:09:47.384770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18d9d70-7d481113-fdb74551-8afb3397_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:47.393057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c18d9d70-7d481113-fdb74551-8afb3397_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:47.393490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:47.393506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 891
2025-10-01T14:09:47.393727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:47.393765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:47.393775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:47.393779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:47.395060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 891 sessionId:  describe result for acl check
2025-10-01T14:09:47.395104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:47.395106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:47.395108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:47.395115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255312185987913:8179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:47.395687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255312185987913:8179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:47.397930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255312185987913:8179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:47.401555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255312185987913:8179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:47.401570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255312185987913:8179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:47.401574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255312185987913:8179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:47.401582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:47.402614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:47.406559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:47.406833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:47.406844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:47.406854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:47.406908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:47.406959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255309809121660:7182]
2025-10-01T14:09:47.407579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:47.408060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:47.408110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:47.408441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:47.408526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.408531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.408532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.408533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.408534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.408535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.408537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.408539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.408540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.408541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.408542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.408543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.408544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.408545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.408550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.408559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.408562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.408565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.408568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.408572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.408575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.408578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.408581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.408586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.408589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.408591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.408594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.408597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.408604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.408610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.408616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.408620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.408624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.408630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.408634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.408639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.408643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.408648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.408652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.408656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.408662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.408671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.408675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.408684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.408688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.408693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.408700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.408705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.408710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.408718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.408722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.408726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.408734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.408749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.408757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.408761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.408795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:47.413376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:47.414019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:47.414036Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:47.414039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:47.414042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:47.414050Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 890 [2:7556255309809121660:7182]
2025-10-01T14:09:47.414068Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:47.414086Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:47.414090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:47.414094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:47.414096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:47.414114Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:47.414120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:47.414126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:47.414181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.414190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.414193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.414196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:47.414198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:47.414271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:47.414281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.414293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.414311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.414333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:47.414358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185987886:2446], now have 1 active actors on pipe
2025-10-01T14:09:47.414392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255309809121655:7182]
2025-10-01T14:09:47.414401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255309809121655:7182]
2025-10-01T14:09:47.414404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255309809121655:7182]
2025-10-01T14:09:47.414420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:47.414436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185988097:8179], now have 1 active actors on pipe
2025-10-01T14:09:47.414436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:47.414441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:47.414445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:47.414450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:47.414466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:47.414474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:47.414517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255309809121655:7182]
2025-10-01T14:09:47.414538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:47.414561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:47.414668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 890
2025-10-01T14:09:47.414676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 890
2025-10-01T14:09:47.414772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.414782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.414804Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:47.414814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:47.414818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:47.414819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:47.414827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:47.414843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:47.414864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:47.418685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.418713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.418746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:47.420781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 891 partition: 0 MaxSeqNo: 45 sessionId: src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0
2025-10-01T14:09:47.421692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c18d9d70-7d481113-fdb74551-8afb3397_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:47.424838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0] Write session: try to update token
2025-10-01T14:09:47.424860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:47.438117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:47.438138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:47.438140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:47.438142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:47.438154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255309809121655:7182]
2025-10-01T14:09:47.438158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255309809121655:7182]
2025-10-01T14:09:47.438162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255309809121655:7182]
2025-10-01T14:09:47.438207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:47.438213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.438217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:47.438216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:47.438223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:47.438228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:47.438365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:47.447616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 891 sessionId: src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:47.450541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:47.484231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255312185988111:7609]
2025-10-01T14:09:47.484547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 890, pipe: [1:7556255312185988111:7609]
2025-10-01T14:09:47.575891Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:47.576557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.576571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.576589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185988111:7609], now have 1 active actors on pipe
2025-10-01T14:09:47.576804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:47.576906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255312185988111:7609]
2025-10-01T14:09:47.576924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:47.576947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:47.577040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 891 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0
2025-10-01T14:09:47.577212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 891 sessionId: src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0 is DEAD
2025-10-01T14:09:47.577325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:47.577335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0] Write session will restart in 0.006182s
2025-10-01T14:09:47.577361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0] Write session: Do CDS request
2025-10-01T14:09:47.577366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:47.584863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:47.585186Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:47.585203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 892
2025-10-01T14:09:47.585326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:47.585361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:47.585371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:47.585376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:47.585763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 892 sessionId:  describe result for acl check
2025-10-01T14:09:47.585793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:47.585800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:47.585802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:47.585806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255312185988127:8183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:47.586324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255312185988127:8183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:47.588902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255312185988127:8183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:47.592458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255312185988127:8183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:47.592486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255312185988127:8183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:47.592490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255312185988127:8183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:47.592499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:47.596401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:47.599803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:47.600051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:47.600062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:47.600082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:47.600134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:47.600183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255309809121908:7190]
2025-10-01T14:09:47.600773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:47.601110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:47.601174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:47.601534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:47.601597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.601603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.601604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.601606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.601607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.601609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.601611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.601612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.601614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.601615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.601616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.601618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.601619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.601620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.601625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.601635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.601639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.601644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.601647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.601650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.601654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.601658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.601661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.601665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.601668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.601672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.601676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.601680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.601687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.601695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.601700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.601707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.601716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.601720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.601724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.601734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.601739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.601743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.601748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.601753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.601757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.601762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.601767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.601772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.601777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.601782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.601786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.601796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.601800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.601809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.601815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.601820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.601824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.601831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.601835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.601840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.601883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:47.605978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:47.606667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:47.606684Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:47.606686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:47.606690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:47.606696Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 891 [2:7556255309809121908:7190]
2025-10-01T14:09:47.606708Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:47.606723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:47.606729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:47.606732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:47.606733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:47.606745Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:47.606749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:47.606757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:47.606817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.606825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.606827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.606830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:47.606832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:47.607052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 891
2025-10-01T14:09:47.607067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 891
2025-10-01T14:09:47.607288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:47.607297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.607309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.607328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.607347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:47.607368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185988258:8183], now have 1 active actors on pipe
2025-10-01T14:09:47.607377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185988114:2446], now have 1 active actors on pipe
2025-10-01T14:09:47.607389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.607393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.607415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255309809121903:7190]
2025-10-01T14:09:47.607421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255309809121903:7190]
2025-10-01T14:09:47.607423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255309809121903:7190]
2025-10-01T14:09:47.607435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:47.607449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:47.607454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:47.607457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:47.607459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:47.607463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:47.607467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:47.607483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:47.607494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:47.607498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:47.607501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:47.607509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:47.607522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:47.607564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255309809121903:7190]
2025-10-01T14:09:47.607575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:47.607582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:47.607591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:47.607752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.607766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.607786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:47.607881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 892 partition: 0 MaxSeqNo: 45 sessionId: src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0
2025-10-01T14:09:47.608205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b19787b-657d5a66-cffc2ead-86cdee0f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:47.611231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0] Write session: try to update token
2025-10-01T14:09:47.611247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:47.631289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 892 sessionId: src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:47.633984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:47.634020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:47.634024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:47.634027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:47.634039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255309809121903:7190]
2025-10-01T14:09:47.634050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255309809121903:7190]
2025-10-01T14:09:47.634056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255309809121903:7190]
2025-10-01T14:09:47.634119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:47.634126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:47.634135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:47.634135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.634138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:47.634139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:47.634362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:47.635466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:47.677235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255312185988352:7609]
2025-10-01T14:09:47.677579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 891, pipe: [1:7556255312185988352:7609]
2025-10-01T14:09:47.763531Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:47.764099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.764114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.764156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185988352:7609], now have 1 active actors on pipe
2025-10-01T14:09:47.764428Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:47.764410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:47.764418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:47.764427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:47.764472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255312185988352:7609]
2025-10-01T14:09:47.764498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 892 reason: error at write: Disconnected sessionId: src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0
2025-10-01T14:09:47.764758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 892 sessionId: src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0 is DEAD
2025-10-01T14:09:47.764910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:47.764920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0] Write session will restart in 0.009249s
2025-10-01T14:09:47.764948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0] Write session: Do CDS request
2025-10-01T14:09:47.764955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:47.774960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:47.775285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:47.775302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 893
2025-10-01T14:09:47.775420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:47.775456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:47.775466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:47.775470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:47.775923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 893 sessionId:  describe result for acl check
2025-10-01T14:09:47.775963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:47.775965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:47.775966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:47.775975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255312185988371:8189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:47.776549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255312185988371:8189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:47.780073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255312185988371:8189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:47.783779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255312185988371:8189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:47.783797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255312185988371:8189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:47.783800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255312185988371:8189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:47.783809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:47.788941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:47.792873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:47.793116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:47.793129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:47.793142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:47.793203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:47.793258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255309809122128:7192]
2025-10-01T14:09:47.793920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:47.794184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:47.794238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:47.794578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:47.794654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.794660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.794661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.794663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.794664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.794665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.794667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.794668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.794669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.794671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.794672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.794673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.794674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.794675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.794680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.794690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.794693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.794697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.794701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.794704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.794708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.794711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.794715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.794719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.794722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.794726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.794729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.794732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.794742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.794749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:47.794754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.794759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:47.794764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.794769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:47.794774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.794779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:47.794785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.794791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:47.794802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.794807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:47.794812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.794818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:47.794822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.794827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:47.794832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.794837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:47.794841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.794847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.794858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.794862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.794872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.794877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.794887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.794893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:47.794901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.794906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:47.794948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:47.799147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:47.799927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:47.799942Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:47.799945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:47.799949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:47.799957Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 892 [2:7556255309809122128:7192]
2025-10-01T14:09:47.799974Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:47.799994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:47.799998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:47.800001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:47.800003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:47.800019Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:47.800025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:47.800032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:47.800101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.800111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.800113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.800117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:47.800120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:47.800195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:47.800202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.800214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:47.800229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:47.800249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:47.800271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255309809122123:7192]
2025-10-01T14:09:47.800278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255309809122123:7192]
2025-10-01T14:09:47.800280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255309809122123:7192]
2025-10-01T14:09:47.800293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:47.800306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:47.800325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:47.800328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:47.800357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:47.800363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255309809122123:7192]
2025-10-01T14:09:47.800365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:47.800371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:47.800376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:47.800384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:47.800582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185988500:8189], now have 1 active actors on pipe
2025-10-01T14:09:47.800591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185988357:2446], now have 1 active actors on pipe
2025-10-01T14:09:47.800626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 892
2025-10-01T14:09:47.800636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 892
2025-10-01T14:09:47.800761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.800772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.800801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e8c4c23-f4142106-7da1a020-60a05919_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:47.800812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:47.800821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:47.800823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:47.800834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:47.800849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:47.800868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:47.801153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.801163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.801175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:47.801277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 893 partition: 0 MaxSeqNo: 45 sessionId: src_id|1e8c4c23-f4142106-7da1a020-60a05919_0
2025-10-01T14:09:47.801624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1fbd36d-3ab784a6-1643c716-1df05e99_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1e8c4c23-f4142106-7da1a020-60a05919_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:47.804761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8c4c23-f4142106-7da1a020-60a05919_0] Write session: try to update token
2025-10-01T14:09:47.804781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8c4c23-f4142106-7da1a020-60a05919_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:47.812988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:47.813015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:47.813026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255309809122123:7192]
2025-10-01T14:09:47.813078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:47.813154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:47.813286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:47.813471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:47.813640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:47.813803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:47.814054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:47.814129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:47.830082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 893 sessionId: src_id|1e8c4c23-f4142106-7da1a020-60a05919_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:47.833283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:47.833596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.833629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.833672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:47.833846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:47.837255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:47.837284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:47.837288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:47.837290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:47.837302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255309809122123:7192]
2025-10-01T14:09:47.837307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255309809122123:7192]
2025-10-01T14:09:47.837312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255309809122123:7192]
2025-10-01T14:09:47.837373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:47.837387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:47.837391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:47.837503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:47.837515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:47.837519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:47.837718Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:47.865577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255312185988584:7609]
2025-10-01T14:09:47.865988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 892, pipe: [1:7556255312185988584:7609]
2025-10-01T14:09:47.978199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:47.979010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185988584:7609], now have 1 active actors on pipe
2025-10-01T14:09:47.987625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:47.987662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:47.987870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.987954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.988038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.988118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.988483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.988499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.988589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.988668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.988758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.988839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.988895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.988905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.988978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.989048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.989128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.989202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.989257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.989267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.989329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.989398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.989464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.989526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.989583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.989592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.989656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.989721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.989795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.989861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.989917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.989927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.989995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.990066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.990131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.990200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.990247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.990250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.990326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.990485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.990558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.992335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:47.992340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:47.992345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:47.992376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 893 reason: error at write: Disconnected sessionId: src_id|1e8c4c23-f4142106-7da1a020-60a05919_0
2025-10-01T14:09:47.992420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255312185988584:7609]
2025-10-01T14:09:47.992651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 893 sessionId: src_id|1e8c4c23-f4142106-7da1a020-60a05919_0 is DEAD
2025-10-01T14:09:47.992806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8c4c23-f4142106-7da1a020-60a05919_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:47.992819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8c4c23-f4142106-7da1a020-60a05919_0] Write session will restart in 0.008394s
2025-10-01T14:09:47.992846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8c4c23-f4142106-7da1a020-60a05919_0] Write session: Do CDS request
2025-10-01T14:09:47.992854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8c4c23-f4142106-7da1a020-60a05919_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:47.990622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.990672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.990675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.990746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.990803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.990866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.990927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.990974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.990977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.991049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.991107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.991170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.991236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.991282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.991285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.991362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:47.991425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:47.991490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:47.991554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:47.991963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:47.991966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:47.992699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:48.002888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8c4c23-f4142106-7da1a020-60a05919_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.002993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:48.003007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 894
2025-10-01T14:09:48.003122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.003169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:48.003183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:48.003187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:48.004042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 894 sessionId:  describe result for acl check
2025-10-01T14:09:48.004077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:48.004083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:48.004085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:48.004089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255316480956030:8193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:48.004522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255316480956030:8193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:48.006725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:48.007184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255316480956030:8193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:48.009256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:48.009463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:48.009470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:48.009480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:48.009547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:48.009569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255316480956030:8193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:48.009594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255314104089647:7195]
2025-10-01T14:09:48.009581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255316480956030:8193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:48.009584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255316480956030:8193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:48.009590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:48.010257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:48.010555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:48.010593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:48.010898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:48.010953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.010959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.010960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.010961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.010962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.010964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.010965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.010966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.010968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.010969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.010970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.010971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.010972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.010974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.010979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.010989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.010993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.010997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.011001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.011005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.011011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.011015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.011023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.011027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.011035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.011039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.011042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.011046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.011058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.011069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.011077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.011086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.011094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.011103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.011110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.011120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.011129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.011138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.011145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.011151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.011161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.011171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.011179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.011188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.011196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.011204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.011209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.011216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.011225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.011231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.011238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.011247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.011256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.011264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.011272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.011281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.011317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:48.015066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:48.015791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:48.015813Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:48.015817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:48.015821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:48.015828Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 893 [2:7556255314104089647:7195]
2025-10-01T14:09:48.015848Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:48.015866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:48.015869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.015872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.015875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.015891Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:48.015904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:48.015912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:48.015981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.015995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.015997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.016000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:48.016003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:48.016078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:48.016086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.016098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.016113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.016137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:48.016160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956100:8193], now have 1 active actors on pipe
2025-10-01T14:09:48.016169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255312185988590:2446], now have 1 active actors on pipe
2025-10-01T14:09:48.016176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255314104089642:7195]
2025-10-01T14:09:48.016178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255314104089642:7195]
2025-10-01T14:09:48.016181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255314104089642:7195]
2025-10-01T14:09:48.016197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:48.016212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:48.016216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:48.016224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:48.016227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:48.016230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:48.016235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:48.016206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 893
2025-10-01T14:09:48.016211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 893
2025-10-01T14:09:48.016271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255314104089642:7195]
2025-10-01T14:09:48.016285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:48.016292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:48.016303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.016308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.016361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|963d7d73-29e520c3-5890f2-c0db9613_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:48.016373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.016378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.016380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:48.016390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.016400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:48.016426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.016606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.016625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.016650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.016759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 894 partition: 0 MaxSeqNo: 45 sessionId: src_id|963d7d73-29e520c3-5890f2-c0db9613_0
2025-10-01T14:09:48.017148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e8c4c23-f4142106-7da1a020-60a05919_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|963d7d73-29e520c3-5890f2-c0db9613_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:48.020364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963d7d73-29e520c3-5890f2-c0db9613_0] Write session: try to update token
2025-10-01T14:09:48.020380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963d7d73-29e520c3-5890f2-c0db9613_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:48.036316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 894 sessionId: src_id|963d7d73-29e520c3-5890f2-c0db9613_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:48.036988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:48.037017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:48.037021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:48.037023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:48.037035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255314104089642:7195]
2025-10-01T14:09:48.037040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255314104089642:7195]
2025-10-01T14:09:48.037044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255314104089642:7195]
2025-10-01T14:09:48.037094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:48.037099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:48.037104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.037107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:48.037110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:48.037114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:48.037279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:48.039142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:48.092446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255316480956112:7609]
2025-10-01T14:09:48.092662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 893, pipe: [1:7556255316480956112:7609]
2025-10-01T14:09:48.178882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:48.179615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.179638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.179687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956112:7609], now have 1 active actors on pipe
2025-10-01T14:09:48.179915Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:48.180376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963d7d73-29e520c3-5890f2-c0db9613_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:48.180391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963d7d73-29e520c3-5890f2-c0db9613_0] Write session will restart in 0.007135s
2025-10-01T14:09:48.180420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963d7d73-29e520c3-5890f2-c0db9613_0] Write session: Do CDS request
2025-10-01T14:09:48.180428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963d7d73-29e520c3-5890f2-c0db9613_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:48.179921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:48.179931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255316480956112:7609]
2025-10-01T14:09:48.179935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:48.179955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:48.179995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 894 reason: error at write: Disconnected sessionId: src_id|963d7d73-29e520c3-5890f2-c0db9613_0
2025-10-01T14:09:48.180205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 894 sessionId: src_id|963d7d73-29e520c3-5890f2-c0db9613_0 is DEAD
2025-10-01T14:09:48.188963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963d7d73-29e520c3-5890f2-c0db9613_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.189071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:48.189089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 895
2025-10-01T14:09:48.189265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.189303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:48.189314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:48.189318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:48.189706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 895 sessionId:  describe result for acl check
2025-10-01T14:09:48.189738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:48.189745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:48.189747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:48.189752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255316480956127:8197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:48.190285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255316480956127:8197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:48.192786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255316480956127:8197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:48.199202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255316480956127:8197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:48.199220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255316480956127:8197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:48.199223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255316480956127:8197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:48.199232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:48.205095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:48.207601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:48.207853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:48.207864Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:48.207877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:48.207935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:48.207973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255314104089870:7197]
2025-10-01T14:09:48.208596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:48.208963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:48.209017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:48.209344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:48.209432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.209440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.209441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.209442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.209443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.209445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.209446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.209447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.209448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.209450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.209451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.209452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.209453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.209454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.209459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.209470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.209475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.209478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.209481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.209485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.209488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.209492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.209496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.209500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.209503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.209507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.209510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.209514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.209521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.209528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.209534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.209539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.209544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.209550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.209554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.209559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.209564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.209569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.209573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.209578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.209582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.209587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.209592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.209597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.209602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.209607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.209611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.209616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.209624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.209628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.209633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.209637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.209642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.209654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.209659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.209663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.209699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:48.214294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:48.215074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:48.215091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:48.215094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:48.215098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:48.215106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 894 [2:7556255314104089870:7197]
2025-10-01T14:09:48.215124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:48.215142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:48.215149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.215153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.215160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.215177Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:48.215187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:48.215197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:48.215264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.215272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.215274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.215276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:48.215279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:48.215520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 894
2025-10-01T14:09:48.215530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 894
2025-10-01T14:09:48.215352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:48.215363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.215376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.215387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.215404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:48.215423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956275:8197], now have 1 active actors on pipe
2025-10-01T14:09:48.215426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956114:2446], now have 1 active actors on pipe
2025-10-01T14:09:48.215434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255314104089865:7197]
2025-10-01T14:09:48.215436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255314104089865:7197]
2025-10-01T14:09:48.215439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255314104089865:7197]
2025-10-01T14:09:48.215451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:48.215466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:48.215481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:48.215482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:48.215484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:48.215485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:48.215487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:48.215526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255314104089865:7197]
2025-10-01T14:09:48.215533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:48.215548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:48.215572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.215578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.215616Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:48.215624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.215630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.215633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:48.215643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.215651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:48.215669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.215836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.215845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.215860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.216007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 895 partition: 0 MaxSeqNo: 45 sessionId: src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0
2025-10-01T14:09:48.216491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963d7d73-29e520c3-5890f2-c0db9613_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:48.219856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0] Write session: try to update token
2025-10-01T14:09:48.219880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:48.237715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:48.237741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:48.237744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:48.237746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:48.237756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255314104089865:7197]
2025-10-01T14:09:48.237763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255314104089865:7197]
2025-10-01T14:09:48.237767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255314104089865:7197]
2025-10-01T14:09:48.237816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:48.237821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:48.237828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.237831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:48.237831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:48.237835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:48.237989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:48.246056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 895 sessionId: src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:48.248723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:48.279848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255316480956370:7609]
2025-10-01T14:09:48.280134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 894, pipe: [1:7556255316480956370:7609]
2025-10-01T14:09:48.401714Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:48.402032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.402049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.402070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956370:7609], now have 1 active actors on pipe
2025-10-01T14:09:48.402961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:48.402977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0] Write session will restart in 0.006165s
2025-10-01T14:09:48.403005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0] Write session: Do CDS request
2025-10-01T14:09:48.403011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:48.402272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:48.402461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:48.402552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 895 reason: status is not ok: tablet will be restarted right now sessionId: src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0
2025-10-01T14:09:48.402753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 895 sessionId: src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0 is DEAD
2025-10-01T14:09:48.402943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255316480956370:7609]
2025-10-01T14:09:48.402956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:48.409920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.410324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:48.410346Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 896
2025-10-01T14:09:48.410520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.410553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:48.410563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:48.410567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:48.410977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 896 sessionId:  describe result for acl check
2025-10-01T14:09:48.411008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:48.411014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:48.411017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:48.411021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255316480956390:8209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:48.411553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255316480956390:8209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:48.413127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255316480956390:8209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:48.416556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255316480956390:8209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:48.416572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255316480956390:8209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:48.416575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255316480956390:8209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:48.416584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:48.423409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:48.426231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:48.426478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:48.426488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:48.426498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:48.426550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:48.426603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255314104090116:7202]
2025-10-01T14:09:48.427239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:48.427521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:48.427566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:48.427875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:48.427935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.427942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.427943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.427945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.427946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.427947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.427948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.427949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.427950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.427951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.427952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.427953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.427954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.427956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.427962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.427971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.427975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.427979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.427982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.427987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.427991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.427994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.427998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.428003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.428006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.428010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.428014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.428018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.428024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.428031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.428037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.428042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.428047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.428052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.428056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.428060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.428064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.428069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.428073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.428081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.428085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.428090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.428095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.428100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.428105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.428110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.428118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.428123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.428128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.428133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.428137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.428143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.428147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.428152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.428156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.428160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.428194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:48.434101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:48.434893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:48.434912Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:48.434915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:48.434919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:48.434928Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 895 [2:7556255314104090116:7202]
2025-10-01T14:09:48.434944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:48.434961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:48.434970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.434974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.434976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.434994Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:48.435006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:48.435012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:48.435073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.435075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.435077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.435082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:48.435085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:48.435235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:48.435246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.435258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.435268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.435282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:48.435285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 895
2025-10-01T14:09:48.435303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956379:2446], now have 1 active actors on pipe
2025-10-01T14:09:48.435296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 895
2025-10-01T14:09:48.435312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956459:8209], now have 1 active actors on pipe
2025-10-01T14:09:48.435321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255314104090110:7202]
2025-10-01T14:09:48.435323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255314104090110:7202]
2025-10-01T14:09:48.435324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255314104090110:7202]
2025-10-01T14:09:48.435340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:48.435358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:48.435374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:48.435380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:48.435410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:48.435423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:48.435426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:48.435432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.435436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.435449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255314104090110:7202]
2025-10-01T14:09:48.435484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:48.435521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:48.435532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.435536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.435538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:48.435547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.435569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:48.435572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:48.435591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.435910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.435921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.435939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.436213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 896 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0
2025-10-01T14:09:48.436592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ae909-ac4d8315-8ba311d7-eb1f9157_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:48.439456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0] Write session: try to update token
2025-10-01T14:09:48.439476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:48.456140Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:48.456165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:48.456167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:48.456169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:48.456179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255314104090110:7202]
2025-10-01T14:09:48.456183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255314104090110:7202]
2025-10-01T14:09:48.456203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255314104090110:7202]
2025-10-01T14:09:48.456249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:48.456251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:48.456258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:48.456261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.456262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:48.456264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:48.456398Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:48.456675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 896 sessionId: src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:48.459275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:48.503209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255316480956609:7609]
2025-10-01T14:09:48.508253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 895, pipe: [1:7556255316480956609:7609]
2025-10-01T14:09:48.606257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:48.607037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.607056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.607100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956609:7609], now have 1 active actors on pipe
2025-10-01T14:09:48.607299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:48.607324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:48.607359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255316480956609:7609]
2025-10-01T14:09:48.607373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:48.607454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 896 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0
2025-10-01T14:09:48.607636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 896 sessionId: src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0 is DEAD
2025-10-01T14:09:48.607747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:48.607756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0] Write session will restart in 0.005907s
2025-10-01T14:09:48.607783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0] Write session: Do CDS request
2025-10-01T14:09:48.607788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:48.614891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.614960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:48.614976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 897
2025-10-01T14:09:48.615175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.615210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:48.615219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:48.615222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:48.615575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 897 sessionId:  describe result for acl check
2025-10-01T14:09:48.615610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:48.615637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:48.615638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:48.615644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255316480956635:8213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:48.616141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255316480956635:8213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:48.618729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255316480956635:8213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:48.621710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255316480956635:8213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:48.621724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255316480956635:8213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:48.621726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255316480956635:8213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:48.621734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:48.623607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:48.626414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:48.626635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:48.626647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:48.626658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:48.626709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:48.626778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255314104090368:7215]
2025-10-01T14:09:48.627481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:48.627824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:48.627896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:48.628222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:48.628316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.628323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.628325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.628326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.628327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.628328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.628329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.628330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.628332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.628333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.628334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.628335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.628336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.628338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.628343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.628353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.628357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.628361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.628365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.628368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.628371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.628375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.628379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.628383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.628387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.628391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.628395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.628399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.628407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.628415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.628422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.628428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.628437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.628443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.628453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.628458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.628468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.628473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.628478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.628488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.628493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.628503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.628506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.628515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.628520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.628525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.628529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.628534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.628538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.628543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.628552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.628556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.628565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.628570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.628579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.628584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.628625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:48.632485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:48.633359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:48.633373Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:48.633375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:48.633378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:48.633383Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 896 [2:7556255314104090368:7215]
2025-10-01T14:09:48.633395Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:48.633413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:48.633420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.633424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.633426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.633442Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:48.633447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:48.633454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:48.633509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.633514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.633515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.633518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:48.633520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:48.633581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:48.633586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.633593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.633602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.633613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:48.633630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956819:8213], now have 1 active actors on pipe
2025-10-01T14:09:48.633635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956612:2446], now have 1 active actors on pipe
2025-10-01T14:09:48.633640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255314104090363:7215]
2025-10-01T14:09:48.633642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255314104090363:7215]
2025-10-01T14:09:48.633643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255314104090363:7215]
2025-10-01T14:09:48.633653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:48.633667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:48.633678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:48.633684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:48.633686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:48.633691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:48.633693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:48.633712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255314104090363:7215]
2025-10-01T14:09:48.633722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:48.633713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 896
2025-10-01T14:09:48.633748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:48.633719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 896
2025-10-01T14:09:48.633754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.633757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.633779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:48.633790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.633799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.633801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:48.633810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.633822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:48.633839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.633954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.633959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.633969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.634063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 897 partition: 0 MaxSeqNo: 45 sessionId: src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0
2025-10-01T14:09:48.634425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9ba3942-c8e5a2d9-cf330444-439be5f7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:48.637020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0] Write session: try to update token
2025-10-01T14:09:48.637036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:48.645534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:48.645558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:48.645568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255314104090363:7215]
2025-10-01T14:09:48.645616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:48.645615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:48.645791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:48.645939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:48.646076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:48.646217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:48.646564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:48.646617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:48.653836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 897 sessionId: src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:48.656363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:48.656580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.656606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.656645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:48.656719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:48.666016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:48.666036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:48.666038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:48.666040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:48.666051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255314104090363:7215]
2025-10-01T14:09:48.666055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255314104090363:7215]
2025-10-01T14:09:48.666059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255314104090363:7215]
2025-10-01T14:09:48.666106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:48.666105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:48.666112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:48.666116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:48.666118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.666121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:48.666253Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:48.707348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255316480956857:7609]
2025-10-01T14:09:48.707638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 896, pipe: [1:7556255316480956857:7609]
2025-10-01T14:09:48.830120Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:48.838759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.838793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.838970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.839029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.839092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.839152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.839203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.839212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.839278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.839343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.839405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.839468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.839512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.839520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.839591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.839655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.839717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.839783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.839828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.839836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.839904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.839966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.840030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.840090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.840135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.840139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.840278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.840341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.840402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.840463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.840511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.840514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.840588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.840647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.840777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.840848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.840892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.840899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.840968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.841030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.841096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.841162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.841206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.841213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.841283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.841346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.841412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.841475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.841520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.841530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.841601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.841666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.841730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.841795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.841842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.841849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.841915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:48.841978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:48.842044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:48.842104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:48.842148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:48.842155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:48.842227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956857:7609], now have 1 active actors on pipe
2025-10-01T14:09:48.842510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:48.842518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:48.842521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:48.842562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 897 reason: error at write: Disconnected sessionId: src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0
2025-10-01T14:09:48.842581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255316480956857:7609]
2025-10-01T14:09:48.842813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 897 sessionId: src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0 is DEAD
2025-10-01T14:09:48.842977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:48.842989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0] Write session will restart in 0.006102s
2025-10-01T14:09:48.843018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0] Write session: Do CDS request
2025-10-01T14:09:48.843026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:48.843461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:48.849941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.850310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:48.850325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 898
2025-10-01T14:09:48.850485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:48.850515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:48.850523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:48.850527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:48.851019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 898 sessionId:  describe result for acl check
2025-10-01T14:09:48.851069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:48.851076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:48.851078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:48.851082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255316480956868:8219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:48.851623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255316480956868:8219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:48.853657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255316480956868:8219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:48.857121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255316480956868:8219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:48.857138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255316480956868:8219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:48.857141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255316480956868:8219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:48.857149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:48.865312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:48.867937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:48.868170Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:48.868179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:48.868190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:48.868234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:48.868273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255314104090596:7218]
2025-10-01T14:09:48.868914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:48.869224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:48.869270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:48.869553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:48.869600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.869605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.869606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.869607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.869608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.869609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.869611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.869612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.869613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.869614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.869615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.869617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.869618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.869619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.869624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.869632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.869636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.869639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.869642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.869646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.869650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.869653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.869657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.869660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.869664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.869667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.869671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.869674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.869679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.869687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:48.869693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.869698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:48.869701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.869706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:48.869709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.869714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:48.869718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.869723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:48.869727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.869732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:48.869736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.869746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:48.869751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.869757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:48.869766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.869771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:48.869779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.869785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.869795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.869800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.869809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.869814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.869818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.869827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:48.869832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.869839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:48.869880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:48.873850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:48.874679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:48.874693Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:48.874696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:48.874699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:48.874707Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 897 [2:7556255314104090596:7218]
2025-10-01T14:09:48.874725Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:48.874743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:48.874746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.874749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.874753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.874770Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:48.874779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:48.874785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:48.874840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.874847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.874850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.874853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:48.874856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:48.874930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:48.874937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.874951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:48.874967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:48.875059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 897
2025-10-01T14:09:48.875068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 897
2025-10-01T14:09:48.875005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:48.875220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956938:8219], now have 1 active actors on pipe
2025-10-01T14:09:48.875225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480956860:2446], now have 1 active actors on pipe
2025-10-01T14:09:48.875233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255314104090591:7218]
2025-10-01T14:09:48.875235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255314104090591:7218]
2025-10-01T14:09:48.875238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255314104090591:7218]
2025-10-01T14:09:48.875253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:48.875265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:48.875267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:48.875268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:48.875270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:48.875283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:48.875286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:48.875311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.875315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.875357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255314104090591:7218]
2025-10-01T14:09:48.875364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:48.875371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:48.875383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:48.875391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:48.875395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:48.875397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:48.875407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:48.875416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:48.875453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.875612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:48.875621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:48.875635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:48.875727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 898 partition: 0 MaxSeqNo: 45 sessionId: src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0
2025-10-01T14:09:48.876214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7072c50-b6a3a71a-9c0e91a1-7c5980e5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:48.878743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0] Write session: try to update token
2025-10-01T14:09:48.878766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:48.896958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 898 sessionId: src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:48.897380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:48.897407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:48.897410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:48.897412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:48.897422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255314104090591:7218]
2025-10-01T14:09:48.897427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255314104090591:7218]
2025-10-01T14:09:48.897432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255314104090591:7218]
2025-10-01T14:09:48.897472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:48.897484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:48.897485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:48.897489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:48.897492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:48.897495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:48.897631Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:48.899745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:48.944126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255316480957093:7609]
2025-10-01T14:09:48.944545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 897, pipe: [1:7556255316480957093:7609]
2025-10-01T14:09:49.059496Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:49.059896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.059910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.059953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255316480957093:7609], now have 1 active actors on pipe
2025-10-01T14:09:49.060141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:49.060204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:49.060220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:49.060244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255316480957093:7609]
2025-10-01T14:09:49.060272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:49.060284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 898 reason: error at write: Disconnected sessionId: src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0
2025-10-01T14:09:49.060507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 898 sessionId: src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0 is DEAD
2025-10-01T14:09:49.060812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:49.060827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0] Write session will restart in 0.006321s
2025-10-01T14:09:49.060857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0] Write session: Do CDS request
2025-10-01T14:09:49.060864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:49.068158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.068367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:49.068383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 899
2025-10-01T14:09:49.068542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.068575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:49.068585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:49.068588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:49.069044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 899 sessionId:  describe result for acl check
2025-10-01T14:09:49.069075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:49.069082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:49.069084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:49.069090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255320775924426:8223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:49.069665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255320775924426:8223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:49.072977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255320775924426:8223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:49.077025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255320775924426:8223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:49.077050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255320775924426:8223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:49.077053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255320775924426:8223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:49.077061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:49.081300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:49.084598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:49.084909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:49.084923Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:49.084937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:49.085000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:49.085044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255318399058118:7220]
2025-10-01T14:09:49.085780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:49.086160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:49.086214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:49.086536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:49.086605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.086611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.086612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.086613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.086615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.086616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.086617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.086619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.086620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.086621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.086622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.086624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.086625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.086627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.086632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.086643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.086647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.086651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.086655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.086659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.086663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.086666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.086670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.086674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.086678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.086682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.086686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.086690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.086698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.086706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.086712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.086717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.086722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.086727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.086731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.086737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.086741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.086746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.086749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.086754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.086759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.086764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.086768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.086773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.086777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.086782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.086786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.086791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.086795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.086800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.086804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.086810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.086815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.086819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.086823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.086829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.086868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:49.094808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:49.095482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:49.095501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:49.095504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:49.095508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:49.095516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 898 [2:7556255318399058118:7220]
2025-10-01T14:09:49.095534Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:49.095557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:49.095565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.095568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.095570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.095583Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:49.095589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:49.095595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:49.095660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.095668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.095670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.095674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:49.095677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:49.095753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:49.095764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.095777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.095789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.095804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:49.095826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775924619:8223], now have 1 active actors on pipe
2025-10-01T14:09:49.095836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775924392:2446], now have 1 active actors on pipe
2025-10-01T14:09:49.095845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255318399058113:7220]
2025-10-01T14:09:49.095847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255318399058113:7220]
2025-10-01T14:09:49.095850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255318399058113:7220]
2025-10-01T14:09:49.095864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:49.095885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:49.095895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:49.095899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:49.095901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:49.095904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:49.095907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:49.095924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 898
2025-10-01T14:09:49.095952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255318399058113:7220]
2025-10-01T14:09:49.095964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:49.095980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:49.096014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 898
2025-10-01T14:09:49.096047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.096055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.096078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f5593c3-d574b163-1265b7d-69e78c58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:49.096090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.096100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.096102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:49.096112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.096121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:49.096146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.096412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 899 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f5593c3-d574b163-1265b7d-69e78c58_0
2025-10-01T14:09:49.096830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e8adc-58e961ff-8e74c28b-958b5589_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f5593c3-d574b163-1265b7d-69e78c58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:49.096296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.096308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.096325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.099307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5593c3-d574b163-1265b7d-69e78c58_0] Write session: try to update token
2025-10-01T14:09:49.099325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5593c3-d574b163-1265b7d-69e78c58_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:49.122351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:49.122397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:49.122400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:49.122402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:49.122413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255318399058113:7220]
2025-10-01T14:09:49.122418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255318399058113:7220]
2025-10-01T14:09:49.122422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255318399058113:7220]
2025-10-01T14:09:49.122466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:49.122471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.122473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:49.122478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:49.122486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:49.122490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:49.122606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:49.128382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 899 sessionId: src_id|2f5593c3-d574b163-1265b7d-69e78c58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:49.131773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:49.160517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255320775924633:7609]
2025-10-01T14:09:49.161038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 898, pipe: [1:7556255320775924633:7609]
2025-10-01T14:09:49.274591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:49.275053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.275066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.275104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775924633:7609], now have 1 active actors on pipe
2025-10-01T14:09:49.275278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:49.275335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:49.275354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:49.275411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 899 reason: error at write: Disconnected sessionId: src_id|2f5593c3-d574b163-1265b7d-69e78c58_0
2025-10-01T14:09:49.275641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 899 sessionId: src_id|2f5593c3-d574b163-1265b7d-69e78c58_0 is DEAD
2025-10-01T14:09:49.275765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5593c3-d574b163-1265b7d-69e78c58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:49.275776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5593c3-d574b163-1265b7d-69e78c58_0] Write session will restart in 0.006019s
2025-10-01T14:09:49.275801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5593c3-d574b163-1265b7d-69e78c58_0] Write session: Do CDS request
2025-10-01T14:09:49.275807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5593c3-d574b163-1265b7d-69e78c58_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:49.275817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:49.275861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255320775924633:7609]
2025-10-01T14:09:49.282825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5593c3-d574b163-1265b7d-69e78c58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.282891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:49.282903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 900
2025-10-01T14:09:49.283039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.283068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:49.283077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:49.283080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:49.283456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 900 sessionId:  describe result for acl check
2025-10-01T14:09:49.283491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:49.283496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:49.283497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:49.283500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255320775924676:8234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:49.283947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255320775924676:8234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:49.286152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255320775924676:8234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:49.288798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255320775924676:8234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:49.288810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255320775924676:8234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:49.288812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255320775924676:8234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:49.288819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:49.290080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:49.292200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:49.292368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:49.292377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:49.292387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:49.292434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:49.292471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255318399058346:7222]
2025-10-01T14:09:49.292974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:49.293258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:49.293300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:49.293576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:49.293639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.293645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.293646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.293647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.293648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.293649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.293650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.293651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.293652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.293653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.293654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.293663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.293664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.293665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.293670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.293679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.293683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.293687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.293690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.293694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.293698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.293701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.293704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.293708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.293712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.293715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.293719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.293723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.293728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.293735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.293741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.293746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.293749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.293759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.293761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.293766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.293770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.293774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.293784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.293788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.293792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.293796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.293799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.293807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.293811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.293815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.293818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.293821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.293825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.293833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.293836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.293841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.293845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.293853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.293857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.293867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.293905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:49.297967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:49.298779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:49.298791Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:49.298793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:49.298795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:49.298799Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 899 [2:7556255318399058346:7222]
2025-10-01T14:09:49.298808Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:49.298821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:49.298824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.298827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.298829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.298844Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:49.298849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:49.298853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:49.298893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.298900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.298902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.298905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:49.298907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:49.298955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:49.298962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.298972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.298982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.299002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:49.299021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775924649:2446], now have 1 active actors on pipe
2025-10-01T14:09:49.299028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775924872:8234], now have 1 active actors on pipe
2025-10-01T14:09:49.299035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255318399058341:7222]
2025-10-01T14:09:49.299037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255318399058341:7222]
2025-10-01T14:09:49.299039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255318399058341:7222]
2025-10-01T14:09:49.299051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:49.299066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:49.299073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:49.299076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:49.299078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:49.299051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 899
2025-10-01T14:09:49.299083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:49.299064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 899
2025-10-01T14:09:49.299085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:49.299120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255318399058341:7222]
2025-10-01T14:09:49.299128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:49.299139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.299145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.299147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:49.299176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21735ad-dd8700eb-ce815eff-5f38857b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:49.299183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.299186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.299188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:49.299194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.299204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:49.299223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.299359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.299369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.299379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.299456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 900 partition: 0 MaxSeqNo: 45 sessionId: src_id|21735ad-dd8700eb-ce815eff-5f38857b_0
2025-10-01T14:09:49.299764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f5593c3-d574b163-1265b7d-69e78c58_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|21735ad-dd8700eb-ce815eff-5f38857b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:49.302049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21735ad-dd8700eb-ce815eff-5f38857b_0] Write session: try to update token
2025-10-01T14:09:49.302067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21735ad-dd8700eb-ce815eff-5f38857b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:49.315254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 900 sessionId: src_id|21735ad-dd8700eb-ce815eff-5f38857b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:49.317638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:49.317900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.317928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.317967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:49.318095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:49.321278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:49.321298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:49.321300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:49.321302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:49.321312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255318399058341:7222]
2025-10-01T14:09:49.321316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255318399058341:7222]
2025-10-01T14:09:49.321320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255318399058341:7222]
2025-10-01T14:09:49.321366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:49.321378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.321377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:49.321380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:49.321387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:49.321392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:49.321509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:49.376039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255320775924899:7609]
2025-10-01T14:09:49.376305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 899, pipe: [1:7556255320775924899:7609]
2025-10-01T14:09:49.473412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:49.481553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.481577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.481736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.481799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.481862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.481929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.481976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.481986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.482052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.482113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.482176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.482239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.482283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.482289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.482350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.482424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.482488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.482555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.482600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.482607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.482667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.482727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.482790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.482866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.482909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.482916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.482973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.483048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.483108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.483171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.483214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.483221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.483283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.483342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.483406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.483474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.483518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.483525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.483590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.483652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.483710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.483773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.483815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.483821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.483881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.483938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.483997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.484058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.484104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.484110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.484175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.484235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.484300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.484362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.484407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.484413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.484480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:49.484546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:49.484614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:49.484677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:49.484726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:49.484732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:49.484800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775924899:7609], now have 1 active actors on pipe
2025-10-01T14:09:49.484991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:49.485042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:49.485049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:49.485071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 900 reason: error at write: Disconnected sessionId: src_id|21735ad-dd8700eb-ce815eff-5f38857b_0
2025-10-01T14:09:49.485159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255320775924899:7609]
2025-10-01T14:09:49.485263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 900 sessionId: src_id|21735ad-dd8700eb-ce815eff-5f38857b_0 is DEAD
2025-10-01T14:09:49.485439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735ad-dd8700eb-ce815eff-5f38857b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:49.485450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735ad-dd8700eb-ce815eff-5f38857b_0] Write session will restart in 0.007066s
2025-10-01T14:09:49.485473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735ad-dd8700eb-ce815eff-5f38857b_0] Write session: Do CDS request
2025-10-01T14:09:49.485479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735ad-dd8700eb-ce815eff-5f38857b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:49.485828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:49.493934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21735ad-dd8700eb-ce815eff-5f38857b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.494023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:49.494040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 901
2025-10-01T14:09:49.494191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.494224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:49.494233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:49.494248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:49.494889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 901 sessionId:  describe result for acl check
2025-10-01T14:09:49.494924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:49.494926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:49.494928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:49.494933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255320775924928:8239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:49.495435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255320775924928:8239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:49.498716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255320775924928:8239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:49.501639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255320775924928:8239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:49.501651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255320775924928:8239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:49.501655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255320775924928:8239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:49.501662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:49.501730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:49.504177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:49.504362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:49.504373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:49.504383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:49.504429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:49.504570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255318399058613:7237]
2025-10-01T14:09:49.505107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:49.505378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:49.505417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:49.505695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:49.505750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.505756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.505757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.505758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.505759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.505760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.505761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.505762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.505763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.505764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.505765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.505766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.505767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.505768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.505773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.505782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.505785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.505788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.505791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.505794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.505798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.505801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.505804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.505808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.505811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.505814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.505822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.505825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.505834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.505845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.505854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.505862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.505869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.505875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.505884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.505891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.505895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.505904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.505907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.505912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.505916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.505925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.505932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.505937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.505944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.505948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.505957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.505965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.505968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.505974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.505980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.505985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.505992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.505997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.506004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.506008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.506047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:49.509648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:49.510227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:49.510241Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:49.510243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:49.510247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:49.510253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 900 [2:7556255318399058613:7237]
2025-10-01T14:09:49.510267Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:49.510288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:49.510294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.510297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.510299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.510314Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:49.510323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:49.510328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:49.510395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.510401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.510403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.510406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:49.510408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:49.510473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:49.510479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.510489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.510499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.510516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:49.510537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775925125:8239], now have 1 active actors on pipe
2025-10-01T14:09:49.510544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775924905:2446], now have 1 active actors on pipe
2025-10-01T14:09:49.510552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255318399058607:7237]
2025-10-01T14:09:49.510558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255318399058607:7237]
2025-10-01T14:09:49.510560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255318399058607:7237]
2025-10-01T14:09:49.510572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:49.510586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:49.510586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:49.510599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:49.510600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:49.510602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:49.510605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:49.510582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 900
2025-10-01T14:09:49.510586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 900
2025-10-01T14:09:49.510626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255318399058607:7237]
2025-10-01T14:09:49.510633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:49.510635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:49.510661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.510670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.510698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:49.510708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.510713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.510718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:49.510728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.510739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:49.510761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.510925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.510942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.510962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.511070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 901 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0
2025-10-01T14:09:49.511538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21735ad-dd8700eb-ce815eff-5f38857b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:49.513986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0] Write session: try to update token
2025-10-01T14:09:49.514002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:49.527413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 901 sessionId: src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:49.529715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:49.530404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.530425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.530447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:49.530450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:49.530453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:49.530455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:49.530463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255318399058607:7237]
2025-10-01T14:09:49.530467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255318399058607:7237]
2025-10-01T14:09:49.530474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255318399058607:7237]
2025-10-01T14:09:49.530515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:49.530528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:49.530529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:49.530531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:49.530535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.530537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:49.530671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:49.585442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255320775925138:7609]
2025-10-01T14:09:49.585666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 900, pipe: [1:7556255320775925138:7609]
2025-10-01T14:09:49.681338Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:49.681891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:49.681950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775925138:7609], now have 1 active actors on pipe
2025-10-01T14:09:49.682016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:49.682117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:49.682137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:49.682140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:49.682170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255320775925138:7609]
2025-10-01T14:09:49.682187Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:09:49.682218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 901 reason: error at write: Disconnected sessionId: src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0
2025-10-01T14:09:49.682262Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 9 consumer shared/user session shared/user_1_9_13937073349618143967_v1 is DEAD
2025-10-01T14:09:49.682290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 901 sessionId: src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0 is DEAD
2025-10-01T14:09:49.682393Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255221991657431:7606] disconnected; active server actors: 1
2025-10-01T14:09:49.682403Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255221991657431:7606] client user disconnected session shared/user_1_9_13937073349618143967_v1
2025-10-01T14:09:49.682608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:49.682608Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:09:49.682620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0] Write session will restart in 0.006158s
2025-10-01T14:09:49.682650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0] Write session: Do CDS request
2025-10-01T14:09:49.682655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:49.682687Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:09:49.682691Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:09:49.682697Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.005752s
2025-10-01T14:09:49.689905Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:09:49.689995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.690165Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:09:49.690165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:49.690171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 902
2025-10-01T14:09:49.690180Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 10
2025-10-01T14:09:49.690294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.690318Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 10 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:09:49.690328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:49.690333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:49.690336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:49.690357Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:09:49.690428Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 auth for : user
2025-10-01T14:09:49.690504Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 Handle describe topics response
2025-10-01T14:09:49.690524Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 auth is DEAD
2025-10-01T14:09:49.690544Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:09:49.690691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 902 sessionId:  describe result for acl check
2025-10-01T14:09:49.690716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:49.690722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:49.690724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:49.690728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255320775925169:8244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:49.690768Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:09:49.690859Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_10_4908489780046192851_v1
2025-10-01T14:09:49.691117Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255320775925171:8245] connected; active server actors: 1
2025-10-01T14:09:49.691137Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255320775925171:8245] session shared/user_1_10_4908489780046192851_v1
2025-10-01T14:09:49.691147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:09:49.691163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:09:49.691169Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_10_4908489780046192851_v1" (Sender=[1:7556255320775925165:8245], Pipe=[1:7556255320775925171:8245], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:09:49.691178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:09:49.691190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:09:49.691199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_10_4908489780046192851_v1" (Sender=[1:7556255320775925165:8245], Pipe=[1:7556255320775925171:8245], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:09:49.691213Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_10_4908489780046192851_v1" sender [1:7556255320775925165:8245] lock partition 0 for ReadingSession "shared/user_1_10_4908489780046192851_v1" (Sender=[1:7556255320775925165:8245], Pipe=[1:7556255320775925171:8245], Partitions=[], ActiveFamilyCount=1) generation 1 step 10
2025-10-01T14:09:49.691214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255320775925169:8244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:49.691220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:09:49.691228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-10-01T14:09:49.691401Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 10 Session: "shared/user_1_10_4908489780046192851_v1" ClientId: "user" PipeClient { RawX1: 7556255320775925171 RawX2: 4503603922346037 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:09:49.691422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:09:49.694022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255320775925169:8244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:49.697005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255320775925169:8244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:49.697020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255320775925169:8244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:49.697023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255320775925169:8244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:49.697031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:49.700051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:49.703191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:49.703455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:49.703465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:49.703479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:49.703541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:49.703589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255318399058855:7240]
2025-10-01T14:09:49.704282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:49.704648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:49.704712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:49.705077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:49.705146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.705152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.705153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.705154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.705155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.705156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.705157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.705158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.705159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.705160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.705162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.705162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.705164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.705165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.705171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.705181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.705184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.705187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.705190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.705194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.705198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.705201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.705204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.705208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.705211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.705238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.705249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.705256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.705264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.705271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.705277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.705282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.705290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.705299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.705305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.705314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.705322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.705326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.705333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.705337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.705347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.705351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.705354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.705359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.705363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.705367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.705375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.705379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.705383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.705392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.705395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.705404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.705414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.705422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.705427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.705435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.705480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:49.709793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:49.710489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:49.710500Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:49.710503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:49.710506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:49.710516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 901 [2:7556255318399058855:7240]
2025-10-01T14:09:49.710533Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:49.710552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:49.710555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.710558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.710561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.710577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:49.710583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:49.710589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:49.710653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.710661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.710662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.710666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:49.710668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:49.710738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:49.710744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.710755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.710764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.710780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:49.710801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775925184:8250], now have 1 active actors on pipe
2025-10-01T14:09:49.710808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775925152:2446], now have 1 active actors on pipe
2025-10-01T14:09:49.710811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775925330:8244], now have 1 active actors on pipe
2025-10-01T14:09:49.710819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255318399058850:7240]
2025-10-01T14:09:49.710822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255318399058850:7240]
2025-10-01T14:09:49.710824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255318399058850:7240]
2025-10-01T14:09:49.710837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:49.710849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:49.710851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:49.710853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:49.710855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:49.710868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:49.710875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:49.710875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 901, pipe: [1:7556255320775925184:8250]
2025-10-01T14:09:49.710915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 901
2025-10-01T14:09:49.710912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255318399058850:7240]
2025-10-01T14:09:49.710922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:49.710928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:49.710944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.710951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.710938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 901
2025-10-01T14:09:49.710964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_10_4908489780046192851_v1 on pipe: [1:7556255320775925184:8250]
2025-10-01T14:09:49.711008Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_10_4908489780046192851_v1:1 with generation 901
2025-10-01T14:09:49.711015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.711020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.711023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:49.711042Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_10_4908489780046192851_v1
2025-10-01T14:09:49.711048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.711080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.711085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.711091Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:09:49.711111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:49.711120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:09:49.714243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:09:49.714278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:09:49.714287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.714297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.714300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:49.714313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.714331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:49.714343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:09:49.714362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:09:49.714398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.714598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.714612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.714633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.714513Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327789710 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:09:49.714534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:09:49.714564Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 sending to client partition status
2025-10-01T14:09:49.714739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 902 partition: 0 MaxSeqNo: 45 sessionId: src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0
2025-10-01T14:09:49.718665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a8acf0c-9a264979-6c634ba7-f8352093_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:49.721378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0] Write session: try to update token
2025-10-01T14:09:49.721403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:49.732665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:49.732685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:49.732688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:49.732690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:49.732701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255318399058850:7240]
2025-10-01T14:09:49.732706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255318399058850:7240]
2025-10-01T14:09:49.732711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255318399058850:7240]
2025-10-01T14:09:49.732772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:49.732775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:49.732779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:49.732782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.732784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:49.732785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:49.732923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:49.737698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 902 sessionId: src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:49.740521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:49.885439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:49.885954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.885967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.886213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_10_4908489780046192851_v1
2025-10-01T14:09:49.886229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:49.886255Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_10_4908489780046192851_v1
2025-10-01T14:09:49.886955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:49.886963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:49.887003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255320775925184:8250]
2025-10-01T14:09:49.887072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 902 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0
2025-10-01T14:09:49.887285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 902 sessionId: src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0 is DEAD
2025-10-01T14:09:49.887423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:49.887434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0] Write session will restart in 0.009709s
2025-10-01T14:09:49.887465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0] Write session: Do CDS request
2025-10-01T14:09:49.887471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:49.897927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.897994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:49.898008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 903
2025-10-01T14:09:49.898128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:49.898169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:49.898176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:49.898178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:49.898566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 903 sessionId:  describe result for acl check
2025-10-01T14:09:49.898597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:49.898599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:49.898601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:49.898607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255320775925452:8253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:49.899045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255320775925452:8253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:49.902087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255320775925452:8253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:49.904725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255320775925452:8253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:49.904761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255320775925452:8253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:49.904765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255320775925452:8253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:49.904773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:49.906413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:49.909795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:49.910016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:49.910025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:49.910033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:49.910075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:49.910111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255318399059089:7243]
2025-10-01T14:09:49.910595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:49.910952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:49.910993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:49.911222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:49.911273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.911278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.911279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.911280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.911281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.911282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.911283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.911284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.911285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.911285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.911286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.911287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.911287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.911288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.911292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.911299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.911301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.911304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.911306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.911308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.911310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.911313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.911315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.911317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.911320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.911324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.911327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.911331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.911337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.911344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:49.911351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.911363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:49.911372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.911381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:49.911389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.911393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:49.911404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.911409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:49.911414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.911419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:49.911426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.911429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:49.911436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.911439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:49.911442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.911448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:49.911451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.911454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.911460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.911463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.911466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.911469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.911471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.911476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:49.911483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.911487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:49.911530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:49.915665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:49.916511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:49.916523Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:49.916524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:49.916528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:49.916534Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 902 [2:7556255318399059089:7243]
2025-10-01T14:09:49.916546Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:49.916563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:49.916568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.916571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.916573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.916586Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:49.916594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:49.916599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:49.916646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.916651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.916652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.916654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:49.916657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:49.916728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:49.916734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.916757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:49.916771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:49.916789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:49.916810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775925624:8253], now have 1 active actors on pipe
2025-10-01T14:09:49.916815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775925401:2446], now have 1 active actors on pipe
2025-10-01T14:09:49.916820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255318399059084:7243]
2025-10-01T14:09:49.916822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255318399059084:7243]
2025-10-01T14:09:49.916823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255318399059084:7243]
2025-10-01T14:09:49.916833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:49.916846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:49.916847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:49.916850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:49.916852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:49.916863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:49.916867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:49.916852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 902
2025-10-01T14:09:49.916882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 902
2025-10-01T14:09:49.916907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255318399059084:7243]
2025-10-01T14:09:49.916916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:49.916921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:49.916933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.916936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.916980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:49.916991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:49.916996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:49.917003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:49.917011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:49.917021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:49.917042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.917194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:49.917201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:49.917214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:49.917285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 903 partition: 0 MaxSeqNo: 45 sessionId: src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0
2025-10-01T14:09:49.917684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaafe78a-d0991a3a-3e6781a5-56af7f0c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:49.920351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0] Write session: try to update token
2025-10-01T14:09:49.920374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:49.936952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 903 sessionId: src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:49.938446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:49.938465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:49.938467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:49.938470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:49.938480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255318399059084:7243]
2025-10-01T14:09:49.938485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255318399059084:7243]
2025-10-01T14:09:49.938491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255318399059084:7243]
2025-10-01T14:09:49.938546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:49.938554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:49.938557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:49.938560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:49.938566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:49.938571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:49.938720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:49.940451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:49.958336Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:09:49.987368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255320775925638:8250]
2025-10-01T14:09:49.987694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 902, pipe: [1:7556255320775925638:8250]
2025-10-01T14:09:50.078914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:50.079690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.079707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.079772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255320775925638:8250], now have 1 active actors on pipe
2025-10-01T14:09:50.080420Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:50.080453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:50.080474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:50.080555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 903 reason: error at write: Disconnected sessionId: src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0
2025-10-01T14:09:50.080734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 903 sessionId: src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0 is DEAD
2025-10-01T14:09:50.080916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:50.080966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255320775925638:8250]
2025-10-01T14:09:50.081220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:50.081227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0] Write session will restart in 0.005284s
2025-10-01T14:09:50.081254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0] Write session: Do CDS request
2025-10-01T14:09:50.081260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:50.088988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.090574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:50.090591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 904
2025-10-01T14:09:50.094511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.094573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:50.094579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:50.094584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:50.096174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 904 sessionId:  describe result for acl check
2025-10-01T14:09:50.096217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:50.096219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:50.096221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:50.096228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255325070892961:8257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:50.096788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255325070892961:8257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:50.105092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255325070892961:8257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:50.110194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255325070892961:8257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:50.110214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255325070892961:8257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:50.110218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255325070892961:8257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:50.110226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:50.116922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:50.120758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:50.120994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:50.120999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:50.121011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:50.121060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:50.121094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255322694026617:7245]
2025-10-01T14:09:50.121760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:50.122208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:50.122279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:50.122655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:50.122748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.122755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.122757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.122759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.122760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.122762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.122764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.122765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.122766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.122768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.122770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.122771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.122772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.122773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.122779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.122790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.122794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.122799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.122803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.122807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.122810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.122814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.122818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.122822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.122826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.122829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.122833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.122837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.122845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.122853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.122859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.122864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.122868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.122873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.122878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.122883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.122896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.122901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.122906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.122910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.122918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.122923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.122927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.122932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.122937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.122943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.122949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.122954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.122959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.122968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.122972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.122978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.122982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.122988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.122993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.122998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.123042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:50.127854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:50.128612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:50.128625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:50.128629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:50.128632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:50.128640Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 903 [2:7556255322694026617:7245]
2025-10-01T14:09:50.128654Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:50.128669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:50.128671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:50.128673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:50.128675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:50.128688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:50.128693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:50.128698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:50.128762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.128769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.128771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.128773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:50.128775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:50.128831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:50.128836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.128846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.128852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.128862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:50.128875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255322694026612:7245]
2025-10-01T14:09:50.128877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255322694026612:7245]
2025-10-01T14:09:50.128878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255322694026612:7245]
2025-10-01T14:09:50.128884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:50.128895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:50.128904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:50.128905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:50.128914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:50.128916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:50.128919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:50.128936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255322694026612:7245]
2025-10-01T14:09:50.128938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:50.128942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:50.128946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070892937:2446], now have 1 active actors on pipe
2025-10-01T14:09:50.128948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893115:8257], now have 1 active actors on pipe
2025-10-01T14:09:50.129971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.129980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.130008Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:50.130017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:50.130021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:50.130023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:50.130031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:50.130038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:50.130052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:50.130237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.130242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.130252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:50.129558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 903
2025-10-01T14:09:50.129595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 903
2025-10-01T14:09:50.130388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 904 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0
2025-10-01T14:09:50.134769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b4e1598-d0a1d75f-be29cadb-c4107815_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:50.138082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0] Write session: try to update token
2025-10-01T14:09:50.138106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:50.153114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:50.153132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:50.153134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:50.153137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:50.153147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255322694026612:7245]
2025-10-01T14:09:50.153153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255322694026612:7245]
2025-10-01T14:09:50.153159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255322694026612:7245]
2025-10-01T14:09:50.153218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:50.153226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.153225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:50.153229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:50.153233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:50.153237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:50.153416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:50.161340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 904 sessionId: src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:50.164417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:50.181447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255325070893175:8250]
2025-10-01T14:09:50.181838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 903, pipe: [1:7556255325070893175:8250]
2025-10-01T14:09:50.309856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:50.310144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.310157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.310175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893175:8250], now have 1 active actors on pipe
2025-10-01T14:09:50.310580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:50.312581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:50.312605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0] Write session will restart in 0.008814s
2025-10-01T14:09:50.312634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0] Write session: Do CDS request
2025-10-01T14:09:50.312641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:50.312068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:50.312120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255325070893175:8250]
2025-10-01T14:09:50.312138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:50.312205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 904 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0
2025-10-01T14:09:50.312391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 904 sessionId: src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0 is DEAD
2025-10-01T14:09:50.322876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.328631Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:50.328646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 905
2025-10-01T14:09:50.328902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.328933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:50.328937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:50.328941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:50.329338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 905 sessionId:  describe result for acl check
2025-10-01T14:09:50.329375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:50.329377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:50.329378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:50.329384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255325070893261:8268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:50.329892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255325070893261:8268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:50.337493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255325070893261:8268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:50.342445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255325070893261:8268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:50.342462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255325070893261:8268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:50.342465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255325070893261:8268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:50.342474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:50.347597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:50.348016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:50.348255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:50.348266Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:50.348278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:50.348334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:50.348371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255322694026850:7247]
2025-10-01T14:09:50.349001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:50.350618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:50.350670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:50.351113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:50.351188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.351195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.351196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.351198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.351199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.351200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.351201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.351202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.351203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.351204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.351206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.351207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.351208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.351209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.351215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.351225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.351230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.351234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.351238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.351242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.351246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.351250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.351253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.351258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.351262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.351266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.351270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.351274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.351281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.351290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.351297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.351303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.351307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.351313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.351317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.351322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.351327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.351332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.351336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.351342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.351347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.351352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.351356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.351368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.351373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.351378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.351383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.351388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.351393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.351398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.351402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.351406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.351411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.351417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.351426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.351432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.351472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:50.358792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:50.359561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:50.359568Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:50.359571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:50.359575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:50.359584Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 904 [2:7556255322694026850:7247]
2025-10-01T14:09:50.359603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:50.359624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:50.359629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:50.359633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:50.359637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:50.359659Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:50.359666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:50.359672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:50.359745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.359748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.359751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.359756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:50.359760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:50.359866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:50.359869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.359883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.359896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.359915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:50.359936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255322694026844:7247]
2025-10-01T14:09:50.359938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255322694026844:7247]
2025-10-01T14:09:50.359941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255322694026844:7247]
2025-10-01T14:09:50.359959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:50.359977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:50.359995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:50.359999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:50.360022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:50.360026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:50.360028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:50.360042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255322694026844:7247]
2025-10-01T14:09:50.360045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:50.360099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:50.360386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893400:8268], now have 1 active actors on pipe
2025-10-01T14:09:50.360391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893189:2446], now have 1 active actors on pipe
2025-10-01T14:09:50.360887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 904
2025-10-01T14:09:50.360917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 904
2025-10-01T14:09:50.364584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.364601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.364642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:50.364654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:50.364661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:50.364664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:50.364677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:50.364695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:50.364717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:50.365963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.365979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.366002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:50.366410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 905 partition: 0 MaxSeqNo: 45 sessionId: src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0
2025-10-01T14:09:50.369277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e060ed5-8cdf84a1-f3a34544-10203099_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:50.372715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0] Write session: try to update token
2025-10-01T14:09:50.372758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:50.391474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:50.391491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:50.391494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:50.391496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:50.391507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255322694026844:7247]
2025-10-01T14:09:50.391512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255322694026844:7247]
2025-10-01T14:09:50.391516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255322694026844:7247]
2025-10-01T14:09:50.391567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:50.391569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:50.391575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:50.391580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.391582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:50.391582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:50.391739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:50.400688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 905 sessionId: src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:50.403835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:50.413583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255325070893448:8250]
2025-10-01T14:09:50.414103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 904, pipe: [1:7556255325070893448:8250]
2025-10-01T14:09:50.543636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:50.544239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.544257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.544280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893448:8250], now have 1 active actors on pipe
2025-10-01T14:09:50.544472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255325070893448:8250]
2025-10-01T14:09:50.544506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:50.544548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:50.544560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:50.544636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 905 reason: error at write: Disconnected sessionId: src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0
2025-10-01T14:09:50.544903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 905 sessionId: src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0 is DEAD
2025-10-01T14:09:50.545045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:50.545057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0] Write session will restart in 0.009767s
2025-10-01T14:09:50.545082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0] Write session: Do CDS request
2025-10-01T14:09:50.545094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:50.545253Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:50.555961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.556067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:50.556090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 906
2025-10-01T14:09:50.556484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.556544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:50.556555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:50.556559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:50.557028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 906 sessionId:  describe result for acl check
2025-10-01T14:09:50.557063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:50.557069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:50.557070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:50.557075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255325070893525:8273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:50.557639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255325070893525:8273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:50.560569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255325070893525:8273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:50.567085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255325070893525:8273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:50.567104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255325070893525:8273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:50.567108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255325070893525:8273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:50.567118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:50.568226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:50.568948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:50.569136Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:50.569146Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:50.569158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:50.569204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:50.569246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255322694027133:7263]
2025-10-01T14:09:50.569870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:50.571654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:50.571720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:50.572078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:50.572131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.572137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.572139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.572140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.572141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.572142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.572143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.572145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.572146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.572147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.572148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.572149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.572150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.572152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.572158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.572169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.572173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.572176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.572180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.572183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.572188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.572191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.572195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.572199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.572203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.572206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.572210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.572213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.572220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.572235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.572242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.572247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.572251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.572256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.572260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.572265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.572270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.572275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.572281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.572287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.572291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.572296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.572300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.572305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.572310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.572314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.572318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.572323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.572327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.572332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.572337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.572342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.572353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.572358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.572361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.572366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.572405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:50.576442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:50.577256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:50.577271Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:50.577273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:50.577278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:50.577285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 905 [2:7556255322694027133:7263]
2025-10-01T14:09:50.577302Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:50.577319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:50.577327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:50.577331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:50.577333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:50.577350Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:50.577355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:50.577362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:50.577426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.577433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.577435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.577438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:50.577441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:50.577513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:50.577520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.577532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.577541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.577554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:50.577575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255322694027128:7263]
2025-10-01T14:09:50.577577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255322694027128:7263]
2025-10-01T14:09:50.577579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255322694027128:7263]
2025-10-01T14:09:50.577588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:50.577596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:50.577598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:50.577600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:50.577604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:50.577618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:50.577621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:50.577633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893453:2446], now have 1 active actors on pipe
2025-10-01T14:09:50.577636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893678:8273], now have 1 active actors on pipe
2025-10-01T14:09:50.577676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255322694027128:7263]
2025-10-01T14:09:50.577690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:50.577674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 905
2025-10-01T14:09:50.577688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 905
2025-10-01T14:09:50.577712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:50.577853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.577867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.577897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22c7479d-d57d3967-e7523e9a-d98e523_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:50.577911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:50.577919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:50.577922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:50.577933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:50.577948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:50.577971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:50.578192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.578206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.578228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:50.578323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 906 partition: 0 MaxSeqNo: 45 sessionId: src_id|22c7479d-d57d3967-e7523e9a-d98e523_0
2025-10-01T14:09:50.579524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31f88f64-ceeebe7f-d654934-f221bdc7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|22c7479d-d57d3967-e7523e9a-d98e523_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:50.582494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22c7479d-d57d3967-e7523e9a-d98e523_0] Write session: try to update token
2025-10-01T14:09:50.582517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22c7479d-d57d3967-e7523e9a-d98e523_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:50.590672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:50.590688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:50.590698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255322694027128:7263]
2025-10-01T14:09:50.590747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:50.590763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:50.590947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:50.591099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:50.591252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:50.591406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:50.591628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:50.591661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:50.606172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 906 sessionId: src_id|22c7479d-d57d3967-e7523e9a-d98e523_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:50.609165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:50.610866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.610898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.610922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:50.610925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:50.610928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:50.610930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:50.610941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255322694027128:7263]
2025-10-01T14:09:50.610945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255322694027128:7263]
2025-10-01T14:09:50.610948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255322694027128:7263]
2025-10-01T14:09:50.610999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:50.611010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:50.611012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:50.611016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:50.611018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.611020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:50.611161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:50.644818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255325070893691:8250]
2025-10-01T14:09:50.645156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 905, pipe: [1:7556255325070893691:8250]
2025-10-01T14:09:50.769139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:50.769502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:50.769540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893691:8250], now have 1 active actors on pipe
2025-10-01T14:09:50.769636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:50.769728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:50.769738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:50.769741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:50.769808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255325070893691:8250]
2025-10-01T14:09:50.769816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 906 reason: error at write: Disconnected sessionId: src_id|22c7479d-d57d3967-e7523e9a-d98e523_0
2025-10-01T14:09:50.769973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 906 sessionId: src_id|22c7479d-d57d3967-e7523e9a-d98e523_0 is DEAD
2025-10-01T14:09:50.770185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c7479d-d57d3967-e7523e9a-d98e523_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:50.770196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c7479d-d57d3967-e7523e9a-d98e523_0] Write session will restart in 0.006001s
2025-10-01T14:09:50.770223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c7479d-d57d3967-e7523e9a-d98e523_0] Write session: Do CDS request
2025-10-01T14:09:50.770232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c7479d-d57d3967-e7523e9a-d98e523_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:50.775814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:09:50.775837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 7
2025-10-01T14:09:50.777964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22c7479d-d57d3967-e7523e9a-d98e523_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.778063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:50.778077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 907
2025-10-01T14:09:50.778290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.778339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:50.778348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:50.778351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:50.778833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 907 sessionId:  describe result for acl check
2025-10-01T14:09:50.778869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:50.778871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:50.778872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:50.778877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255325070893731:8279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:50.779358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255325070893731:8279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:50.781874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255325070893731:8279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:50.786759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255325070893731:8279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:50.786775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255325070893731:8279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:50.786778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255325070893731:8279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:50.786787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:50.787953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:50.791146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:50.791384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:50.791394Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:50.791404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:50.791448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:50.791481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255322694027368:7265]
2025-10-01T14:09:50.791967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:50.792258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:50.792296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:50.792521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:50.792577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.792582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.792583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.792584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.792585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.792585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.792586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.792587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.792587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.792588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.792589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.792589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.792590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.792591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.792595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.792602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.792604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.792606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.792608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.792611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.792612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.792614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.792617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.792619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.792620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.792622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.792624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.792626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.792632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.792637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.792641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.792644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.792647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.792650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.792653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.792656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.792661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.792663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.792666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.792669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.792671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.792674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.792677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.792679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.792682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.792685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.792687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.792690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.792693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.792696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.792698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.792701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.792703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.792706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.792709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.792711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.792734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:50.796870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:50.797663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:50.797679Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:50.797682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:50.797685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:50.797692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 906 [2:7556255322694027368:7265]
2025-10-01T14:09:50.797712Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:50.797731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:50.797739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:50.797744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:50.797746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:50.797765Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:50.797775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:50.797781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:50.797847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.797854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.797856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.797860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:50.797863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:50.797938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:50.797945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.797960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.797971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.797997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:50.798016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255322694027363:7265]
2025-10-01T14:09:50.798024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255322694027363:7265]
2025-10-01T14:09:50.798027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255322694027363:7265]
2025-10-01T14:09:50.798037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:50.798048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:50.798051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:50.798053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:50.798057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:50.798072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:50.798081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:50.798092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893708:2446], now have 1 active actors on pipe
2025-10-01T14:09:50.798098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893938:8279], now have 1 active actors on pipe
2025-10-01T14:09:50.798135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255322694027363:7265]
2025-10-01T14:09:50.798148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:50.798166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:50.798178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 906
2025-10-01T14:09:50.798183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 906
2025-10-01T14:09:50.798265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.798275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.798338Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:09:50.798390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f53f005-4194a682-19ee82f3-12035a6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:50.798404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:50.798409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:50.798411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:50.798423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:50.798433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:50.798452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:50.798614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 9 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:09:50.798666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:09:50.798776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.798786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.798803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:50.798904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 907 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f53f005-4194a682-19ee82f3-12035a6c_0
2025-10-01T14:09:50.799341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22c7479d-d57d3967-e7523e9a-d98e523_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f53f005-4194a682-19ee82f3-12035a6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:50.802442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f53f005-4194a682-19ee82f3-12035a6c_0] Write session: try to update token
2025-10-01T14:09:50.802468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f53f005-4194a682-19ee82f3-12035a6c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:50.818364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:50.818404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:50.818407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:50.818409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:50.818419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255322694027363:7265]
2025-10-01T14:09:50.818424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255322694027363:7265]
2025-10-01T14:09:50.818427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255322694027363:7265]
2025-10-01T14:09:50.818466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:50.818472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.818474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:50.818474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:50.818480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:50.818483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:50.818599Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:50.821538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 907 sessionId: src_id|7f53f005-4194a682-19ee82f3-12035a6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:50.824027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:50.870053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255325070893955:8250]
2025-10-01T14:09:50.870395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 906, pipe: [1:7556255325070893955:8250]
2025-10-01T14:09:50.972636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:50.973209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:50.973225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:50.973268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893955:8250], now have 1 active actors on pipe
2025-10-01T14:09:50.973476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:50.973531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255325070893955:8250]
2025-10-01T14:09:50.973534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:50.973538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:50.973560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:50.973611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 907 reason: error at write: Disconnected sessionId: src_id|7f53f005-4194a682-19ee82f3-12035a6c_0
2025-10-01T14:09:50.973843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 907 sessionId: src_id|7f53f005-4194a682-19ee82f3-12035a6c_0 is DEAD
2025-10-01T14:09:50.973997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f53f005-4194a682-19ee82f3-12035a6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:50.974007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f53f005-4194a682-19ee82f3-12035a6c_0] Write session will restart in 0.007832s
2025-10-01T14:09:50.974027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f53f005-4194a682-19ee82f3-12035a6c_0] Write session: Do CDS request
2025-10-01T14:09:50.974032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f53f005-4194a682-19ee82f3-12035a6c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:50.983049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f53f005-4194a682-19ee82f3-12035a6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.983084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:50.983098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 908
2025-10-01T14:09:50.983268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:50.983299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:50.983307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:50.983311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:50.983739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 908 sessionId:  describe result for acl check
2025-10-01T14:09:50.983769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:50.983774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:50.983776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:50.983780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255325070893982:8283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:50.984285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255325070893982:8283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:50.986346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255325070893982:8283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:50.989987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255325070893982:8283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:50.990002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255325070893982:8283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:50.990005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255325070893982:8283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:50.990012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:50.993136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:50.996932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:50.997160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:50.997170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:50.997181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:50.997235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:50.997374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255322694027607:7269]
2025-10-01T14:09:50.997899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:50.998271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:50.998309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:50.998601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:50.998660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.998665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.998666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.998667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.998669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.998670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.998671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.998672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.998674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.998675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.998676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.998677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.998678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.998679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.998683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.998693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.998697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.998701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.998704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.998708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.998712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.998715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.998719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.998723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.998726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.998730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.998733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.998737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.998743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.998750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:50.998756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.998761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:50.998769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.998774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:50.998781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.998786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:50.998795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.998799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:50.998803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.998808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:50.998814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.998823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:50.998826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.998836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:50.998840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.998849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:50.998853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.998859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:50.998863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.998868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:50.998874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.998882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:50.998887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.998895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:50.998899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.998907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:50.998946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:51.003892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:51.004505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:51.004518Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:51.004520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:51.004524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:51.004532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 907 [2:7556255322694027607:7269]
2025-10-01T14:09:51.004549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:51.004570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:51.004578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.004582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.004585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.004603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:51.004613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:51.004623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:51.004686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.004693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.004695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.004698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:51.004701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:51.004791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:51.004798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.004810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.004825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.004847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:51.004870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070893964:2446], now have 1 active actors on pipe
2025-10-01T14:09:51.004877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255325070894150:8283], now have 1 active actors on pipe
2025-10-01T14:09:51.004886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255322694027602:7269]
2025-10-01T14:09:51.004888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255322694027602:7269]
2025-10-01T14:09:51.004891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255322694027602:7269]
2025-10-01T14:09:51.004903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:51.004915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:51.004917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:51.004919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:51.004924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:51.004938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:51.004946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:51.004980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255322694027602:7269]
2025-10-01T14:09:51.004990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:51.004989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 907
2025-10-01T14:09:51.005049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 907
2025-10-01T14:09:51.005117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:51.005242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.005251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.005275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:51.005286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.005292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.005298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:51.005306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.005315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:51.005328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.005495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.005502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.005515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.005707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 908 partition: 0 MaxSeqNo: 45 sessionId: src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0
2025-10-01T14:09:51.006106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f53f005-4194a682-19ee82f3-12035a6c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:51.009011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0] Write session: try to update token
2025-10-01T14:09:51.009032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:51.029644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:51.029665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:51.029668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:51.029670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:51.029681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255322694027602:7269]
2025-10-01T14:09:51.029686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255322694027602:7269]
2025-10-01T14:09:51.029690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255322694027602:7269]
2025-10-01T14:09:51.029743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:51.029758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.029765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:51.029765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:51.029776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:51.029782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:51.029914Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:51.041270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 908 sessionId: src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:51.044698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:51.073844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255329365861499:8250]
2025-10-01T14:09:51.074146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 907, pipe: [1:7556255329365861499:8250]
2025-10-01T14:09:51.194261Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:51.195009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.195025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.195049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365861499:8250], now have 1 active actors on pipe
2025-10-01T14:09:51.195311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:51.195330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:51.195353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:51.195357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:51.195385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255329365861499:8250]
2025-10-01T14:09:51.195432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 908 reason: error at write: Disconnected sessionId: src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0
2025-10-01T14:09:51.195645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 908 sessionId: src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0 is DEAD
2025-10-01T14:09:51.195774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:51.195783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0] Write session will restart in 0.009457s
2025-10-01T14:09:51.195804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0] Write session: Do CDS request
2025-10-01T14:09:51.195809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:51.206811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:51.206966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:51.206983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 909
2025-10-01T14:09:51.207097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:51.207122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:51.207130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:51.207133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:51.207634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 909 sessionId:  describe result for acl check
2025-10-01T14:09:51.207660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:51.207661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:51.207662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:51.207666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255329365861583:8287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:51.208051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255329365861583:8287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:51.210649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255329365861583:8287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:51.213380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255329365861583:8287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:51.213394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255329365861583:8287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:51.213398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255329365861583:8287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:51.213405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:51.213983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:51.217468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:51.217733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:51.217745Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:51.217757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:51.217831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:51.217875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255326988995139:7271]
2025-10-01T14:09:51.218516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:51.218880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:51.218931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:51.219239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:51.219313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.219320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.219321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.219323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.219324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.219325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.219327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.219328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.219329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.219330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.219332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.219333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.219335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.219336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.219342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.219353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.219358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.219362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.219366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.219371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.219375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.219379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.219383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.219387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.219391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.219396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.219400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.219404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.219412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.219420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.219432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.219439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.219449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.219455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.219463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.219469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.219479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.219484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.219493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.219499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.219509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.219514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.219523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.219528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.219533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.219542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.219547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.219557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.219567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.219572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.219581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.219587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.219597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.219603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.219612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.219622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.219666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:51.223935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:51.224909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:51.224922Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:51.224925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:51.224928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:51.224936Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 908 [2:7556255326988995139:7271]
2025-10-01T14:09:51.224954Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:51.224976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:51.224984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.224987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.224994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.225009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:51.225018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:51.225029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:51.225107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.225115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.225117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.225121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:51.225124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:51.225194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:51.225203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.225234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.225250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.225270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:51.225295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365861502:2446], now have 1 active actors on pipe
2025-10-01T14:09:51.225298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365861733:8287], now have 1 active actors on pipe
2025-10-01T14:09:51.225306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255326988995134:7271]
2025-10-01T14:09:51.225309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255326988995134:7271]
2025-10-01T14:09:51.225311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255326988995134:7271]
2025-10-01T14:09:51.225327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:51.225320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 908
2025-10-01T14:09:51.225348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:51.225356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 908
2025-10-01T14:09:51.225354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:51.225357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:51.225359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:51.225367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:51.225370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:51.225404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255326988995134:7271]
2025-10-01T14:09:51.225416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:51.225432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:51.225437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.225442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.225498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:51.225508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.225513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.225518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:51.225528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.225541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:51.225559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.225709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.225720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.225735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.225822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 909 partition: 0 MaxSeqNo: 45 sessionId: src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0
2025-10-01T14:09:51.226216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58f5018-b739fd49-a3fb743c-d0e529f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:51.230952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0] Write session: try to update token
2025-10-01T14:09:51.230976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:51.246072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 909 sessionId: src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:51.248710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:51.248732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:51.248734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:51.248747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:51.248757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255326988995134:7271]
2025-10-01T14:09:51.248762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255326988995134:7271]
2025-10-01T14:09:51.248766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255326988995134:7271]
2025-10-01T14:09:51.248807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:51.248812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:51.248814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:51.248815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:51.248822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.248825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:51.248946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:51.250579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:51.295529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255329365861751:8250]
2025-10-01T14:09:51.295799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 908, pipe: [1:7556255329365861751:8250]
2025-10-01T14:09:51.399803Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:51.400195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.400211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.400252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365861751:8250], now have 1 active actors on pipe
2025-10-01T14:09:51.400454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:51.400530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:51.400679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 909 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0
2025-10-01T14:09:51.400892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 909 sessionId: src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0 is DEAD
2025-10-01T14:09:51.401034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:51.401042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0] Write session will restart in 0.009233s
2025-10-01T14:09:51.401059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0] Write session: Do CDS request
2025-10-01T14:09:51.401063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:51.401061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255329365861751:8250]
2025-10-01T14:09:51.401080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:51.411928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:51.411990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:51.412003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 910
2025-10-01T14:09:51.412147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:51.412176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:51.412185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:51.412188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:51.412631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 910 sessionId:  describe result for acl check
2025-10-01T14:09:51.412665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:51.412671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:51.412672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:51.412676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255329365861889:8299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:51.413125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255329365861889:8299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:51.415183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255329365861889:8299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:51.416829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:51.417619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255329365861889:8299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:51.417633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255329365861889:8299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:51.417636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255329365861889:8299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:51.417644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:51.420044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:51.420228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:51.420238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:51.420249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:51.420291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:51.420331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255326988995385:7274]
2025-10-01T14:09:51.420875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:51.421146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:51.421177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:51.421388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:51.421526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.421532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.421534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.421535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.421536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.421537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.421539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.421540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.421541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.421542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.421543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.421545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.421546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.421547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.421552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.421562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.421566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.421570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.421574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.421577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.421581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.421584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.421588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.421592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.421596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.421599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.421603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.421606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.421614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.421621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.421627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.421632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.421637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.421642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.421646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.421652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.421655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.421657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.421660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.421663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.421666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.421669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.421671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.421674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.421677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.421679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.421682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.421685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.421687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.421690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.421693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.421695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.421698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.421701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.421703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.421706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.421733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:51.425607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:51.426185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:51.426196Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:51.426197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:51.426200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:51.426205Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 909 [2:7556255326988995385:7274]
2025-10-01T14:09:51.426219Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:51.426233Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:51.426235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.426241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.426242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.426269Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:51.426279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:51.426286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:51.426334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.426340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.426341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.426343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:51.426345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:51.426415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:51.426423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.426430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.426435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.426445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:51.426458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255326988995379:7274]
2025-10-01T14:09:51.426459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255326988995379:7274]
2025-10-01T14:09:51.426460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255326988995379:7274]
2025-10-01T14:09:51.426470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:51.426478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:51.426481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:51.426483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:51.426487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:51.426500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:51.426502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:51.426513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365862010:8299], now have 1 active actors on pipe
2025-10-01T14:09:51.426523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365861769:2446], now have 1 active actors on pipe
2025-10-01T14:09:51.426558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255326988995379:7274]
2025-10-01T14:09:51.426568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:51.426567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 909
2025-10-01T14:09:51.426592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:51.426606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.426570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 909
2025-10-01T14:09:51.426612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.426638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:51.426645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.426649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.426651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:51.426658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.426665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:51.426680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.427024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.427034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.427049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.427182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 910 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0
2025-10-01T14:09:51.427596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59e761f6-6d8ab09e-3f33c5e4-c0f96811_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:51.429995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0] Write session: try to update token
2025-10-01T14:09:51.430015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:51.443124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:51.443140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:51.443150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255326988995379:7274]
2025-10-01T14:09:51.443189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:51.443210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:51.443345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:51.443483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:51.443624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:51.443766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:51.443949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:51.443985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:51.446494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 910 sessionId: src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:51.448786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:51.448959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.448975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.449012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:51.449076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:51.458447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:51.458462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:51.458465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:51.458466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:51.458476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255326988995379:7274]
2025-10-01T14:09:51.458480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255326988995379:7274]
2025-10-01T14:09:51.458484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255326988995379:7274]
2025-10-01T14:09:51.458514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:51.458518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:51.458521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:51.458527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:51.458534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.458536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:51.458670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:51.501338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255329365862022:8250]
2025-10-01T14:09:51.501569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 909, pipe: [1:7556255329365862022:8250]
2025-10-01T14:09:51.602044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:51.610843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.610872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.611056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.611129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.611194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.611258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.611304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.611310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.611382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.611444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.611504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.611646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.611688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.611690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.611817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.611879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.611942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.612002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.612041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.612044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.612111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.612177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.612237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.612291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.612333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.612336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.612410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.612471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.612535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.612663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.612707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.612710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.612873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.612990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.613055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.613124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.613166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.613170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.613243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.613303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.613367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.613423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.613558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.613562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.613630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.613685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.613746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.613806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.613846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.613849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.613925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.613985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.614041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.614102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.614142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.614145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.614208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:51.614265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:51.614326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:51.614407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:51.614527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:51.614530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:51.614605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365862022:8250], now have 1 active actors on pipe
2025-10-01T14:09:51.615911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:51.616083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:51.616135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 910 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0
2025-10-01T14:09:51.616170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255329365862022:8250]
2025-10-01T14:09:51.616279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:51.616401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 910 sessionId: src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0 is DEAD
2025-10-01T14:09:51.618607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:51.618621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0] Write session will restart in 0.008809s
2025-10-01T14:09:51.618649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0] Write session: Do CDS request
2025-10-01T14:09:51.618656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:51.628922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:51.628995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:51.629012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 911
2025-10-01T14:09:51.629121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:51.629151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:51.629164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:51.629167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:51.629691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 911 sessionId:  describe result for acl check
2025-10-01T14:09:51.629726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:51.629731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:51.629733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:51.629738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255329365862129:8303] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:51.630191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255329365862129:8303] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:51.633010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255329365862129:8303] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:51.635341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:51.635568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255329365862129:8303] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:51.635583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255329365862129:8303] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:51.635586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255329365862129:8303] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:51.635595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:51.638243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:51.638529Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:51.638539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:51.638550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:51.638589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:51.638621Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255326988995665:7289]
2025-10-01T14:09:51.639152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:51.639412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:51.639453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:51.639727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:51.639807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.639812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.639813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.639814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.639815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.639816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.639817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.639818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.639819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.639821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.639822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.639823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.639824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.639825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.639829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.639839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.639843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.639847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.639850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.639853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.639856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.639859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.639863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.639867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.639870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.639873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.639886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.639890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.639897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.639908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.639914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.639922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.639926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.639931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.639939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.639943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.639948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.639957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.639961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.639967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.639976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.639981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.639989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.639993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.639997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.640002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.640007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.640012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.640016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.640020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.640024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.640028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.640032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.640036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.640039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.640044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.640079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:51.643683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:51.644609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:51.644621Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:51.644624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:51.644627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:51.644633Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 910 [2:7556255326988995665:7289]
2025-10-01T14:09:51.644649Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:51.644666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:51.644668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.644670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.644672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.644684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:51.644689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:51.644693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:51.644754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.644762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.644763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.644766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:51.644768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:51.644819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:51.644826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.644835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.644845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.644861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:51.644878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255326988995659:7289]
2025-10-01T14:09:51.644886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255326988995659:7289]
2025-10-01T14:09:51.644887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255326988995659:7289]
2025-10-01T14:09:51.644899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:51.644909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:51.644918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:51.644919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:51.644937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:51.644945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:51.644945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255326988995659:7289]
2025-10-01T14:09:51.644947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:51.644947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:51.644954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:51.645071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365862027:2446], now have 1 active actors on pipe
2025-10-01T14:09:51.645080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365862259:8303], now have 1 active actors on pipe
2025-10-01T14:09:51.645140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 910
2025-10-01T14:09:51.645149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 910
2025-10-01T14:09:51.645211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.645220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.645248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:51.645260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.645268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.645270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:51.645278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.645287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:51.645305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.645447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.645453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.645466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.645547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 911 partition: 0 MaxSeqNo: 45 sessionId: src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0
2025-10-01T14:09:51.645945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4cdabbc-fec3a053-2e6530f7-7e760654_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:51.648329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0] Write session: try to update token
2025-10-01T14:09:51.648348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:51.664980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 911 sessionId: src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:51.666946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:51.666966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:51.666968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:51.666970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:51.666979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255326988995659:7289]
2025-10-01T14:09:51.666983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255326988995659:7289]
2025-10-01T14:09:51.666987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255326988995659:7289]
2025-10-01T14:09:51.667030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:51.667036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:51.667040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:51.667043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:51.667049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.667051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:51.667191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:51.667703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:51.716392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255329365862284:8250]
2025-10-01T14:09:51.718723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 910, pipe: [1:7556255329365862284:8250]
2025-10-01T14:09:51.818931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:51.819233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.819249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.819295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365862284:8250], now have 1 active actors on pipe
2025-10-01T14:09:51.819543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:51.819606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255329365862284:8250]
2025-10-01T14:09:51.819607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:51.819643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:51.819718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 911 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0
2025-10-01T14:09:51.819945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 911 sessionId: src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0 is DEAD
2025-10-01T14:09:51.820140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:51.820148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0] Write session will restart in 0.008197s
2025-10-01T14:09:51.820195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0] Write session: Do CDS request
2025-10-01T14:09:51.820202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:51.829931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:51.830063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:51.830079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 912
2025-10-01T14:09:51.830367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:51.830424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:51.830443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:51.830451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:51.830831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 912 sessionId:  describe result for acl check
2025-10-01T14:09:51.830867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:51.830869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:51.830871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:51.830876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255329365862347:8309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:51.831389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255329365862347:8309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:51.833718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255329365862347:8309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:51.837564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255329365862347:8309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:51.837582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255329365862347:8309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:51.837585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255329365862347:8309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:51.837594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:51.838966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:51.842039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:51.842261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:51.842272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:51.842283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:51.842333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:51.842393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255326988995906:7291]
2025-10-01T14:09:51.843176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:51.843518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:51.843562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:51.843858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:51.843910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.843915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.843917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.843919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.843920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.843921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.843922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.843924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.843925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.843926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.843927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.843928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.843929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.843930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.843936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.843947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.843951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.843954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.843958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.843961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.843965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.843968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.843972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.843976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.843980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.843984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.843988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.843991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.843999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.844006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:51.844012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.844018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:51.844028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.844032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:51.844041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.844046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:51.844054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.844058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:51.844061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.844066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:51.844075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.844080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:51.844088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.844093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:51.844101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.844106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:51.844114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.844119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.844127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.844131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.844139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.844145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.844154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.844159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:51.844167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.844173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:51.844215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:51.848290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:51.849012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:51.849029Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:51.849032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:51.849036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:51.849043Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 911 [2:7556255326988995906:7291]
2025-10-01T14:09:51.849059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:51.849076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:51.849079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.849083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.849085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.849104Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:51.849110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:51.849118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:51.849180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.849188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.849190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.849193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:51.849196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:51.849265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:51.849272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.849283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:51.849295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:51.849312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:51.849330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365862519:8309], now have 1 active actors on pipe
2025-10-01T14:09:51.849333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365862287:2446], now have 1 active actors on pipe
2025-10-01T14:09:51.849341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255326988995901:7291]
2025-10-01T14:09:51.849349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255326988995901:7291]
2025-10-01T14:09:51.849352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255326988995901:7291]
2025-10-01T14:09:51.849369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:51.849388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:51.849390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:51.849394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:51.849397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:51.849406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:51.849409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:51.849409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 911
2025-10-01T14:09:51.849417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 911
2025-10-01T14:09:51.849447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255326988995901:7291]
2025-10-01T14:09:51.849458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:51.849461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:51.849489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.849498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.849530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:51.849540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:51.849544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:51.849548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:51.849557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:51.849569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:51.849588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.850171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.850183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.850202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:51.850300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 912 partition: 0 MaxSeqNo: 45 sessionId: src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0
2025-10-01T14:09:51.850702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e60c03a-8bc082f5-2d2b4687-c438f725_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:51.853197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0] Write session: try to update token
2025-10-01T14:09:51.853215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:51.867694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 912 sessionId: src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:51.870512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:51.872557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:51.872581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:51.872603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:51.872606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:51.872609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:51.872611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:51.872619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255326988995901:7291]
2025-10-01T14:09:51.872624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255326988995901:7291]
2025-10-01T14:09:51.872628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255326988995901:7291]
2025-10-01T14:09:51.872664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:51.872673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:51.872676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:51.872684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:51.872691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:51.872699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:51.872846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:51.919658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255329365862533:8250]
2025-10-01T14:09:51.919897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 911, pipe: [1:7556255329365862533:8250]
2025-10-01T14:09:52.023686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:52.024283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:52.024340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255329365862533:8250], now have 1 active actors on pipe
2025-10-01T14:09:52.024461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:52.024492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:52.024539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255329365862533:8250]
2025-10-01T14:09:52.024557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:52.024560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:52.024635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 912 reason: error at write: Disconnected sessionId: src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0
2025-10-01T14:09:52.024821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 912 sessionId: src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0 is DEAD
2025-10-01T14:09:52.024955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:52.024963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0] Write session will restart in 0.006131s
2025-10-01T14:09:52.024983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0] Write session: Do CDS request
2025-10-01T14:09:52.024991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:52.031957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.032943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:52.032958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 913
2025-10-01T14:09:52.033069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.033102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:52.033113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:52.033117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:52.033493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 913 sessionId:  describe result for acl check
2025-10-01T14:09:52.033525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:52.033531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:52.033532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:52.033539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255333660829855:8313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:52.034068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255333660829855:8313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:52.036605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255333660829855:8313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:52.039240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255333660829855:8313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:52.039253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255333660829855:8313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:52.039256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255333660829855:8313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:52.039265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:52.041874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:52.044466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:52.044677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:52.044695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:52.044712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:52.044779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:52.044819Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255331283963444:7294]
2025-10-01T14:09:52.045414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:52.045682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:52.045730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:52.046040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:52.046102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.046109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.046110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.046112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.046113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.046114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.046115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.046116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.046118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.046119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.046132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.046133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.046134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.046136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.046141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.046151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.046155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.046159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.046163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.046168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.046172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.046175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.046179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.046184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.046188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.046192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.046197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.046200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.046208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.046221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.046228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.046233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.046243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.046248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.046257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.046262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.046271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.046277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.046281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.046288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.046297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.046302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.046310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.046316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.046320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.046325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.046334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.046339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.046353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.046366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.046386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.046390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.046396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.046406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.046411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.046421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.046462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:52.050299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:52.051385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:52.051397Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:52.051398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:52.051401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:52.051406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 912 [2:7556255331283963444:7294]
2025-10-01T14:09:52.051418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:52.051432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:52.051434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.051436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.051437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.051449Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:52.051452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:52.051457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:52.051497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.051503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.051504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.051508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:52.051510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:52.051573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:52.051580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.051586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.051592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.051601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:52.051617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255331283963439:7294]
2025-10-01T14:09:52.051622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255331283963439:7294]
2025-10-01T14:09:52.051623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255331283963439:7294]
2025-10-01T14:09:52.051634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:52.051647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660829832:2446], now have 1 active actors on pipe
2025-10-01T14:09:52.051652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830019:8313], now have 1 active actors on pipe
2025-10-01T14:09:52.051658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:52.051658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:52.051661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:52.051664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:52.051666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:52.051668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:52.051694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255331283963439:7294]
2025-10-01T14:09:52.051702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:52.051711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:52.051721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 912
2025-10-01T14:09:52.051733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 912
2025-10-01T14:09:52.051795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.051804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.051822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:52.051831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.051834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.051835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:52.051841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.051853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:52.051871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.052052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.052061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.052075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.052190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 913 partition: 0 MaxSeqNo: 45 sessionId: src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0
2025-10-01T14:09:52.052442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6e3d701-29c89b2d-fbcc0cdd-4796d22_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:52.055093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0] Write session: try to update token
2025-10-01T14:09:52.055113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:52.067506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:52.067523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:52.067533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255331283963439:7294]
2025-10-01T14:09:52.067576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:52.067583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:52.067746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:52.067882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:52.068019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:52.068165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:52.068346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:52.068382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:52.069455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 913 sessionId: src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:52.072037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:52.072290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.072309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.072343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:52.072429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:52.082262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:52.082280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:52.082282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:52.082284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:52.082295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255331283963439:7294]
2025-10-01T14:09:52.082298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255331283963439:7294]
2025-10-01T14:09:52.082301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255331283963439:7294]
2025-10-01T14:09:52.082346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:52.082349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:52.082354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:52.082357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:52.082359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.082362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:52.082511Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:52.125003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255333660830083:8250]
2025-10-01T14:09:52.125266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 912, pipe: [1:7556255333660830083:8250]
2025-10-01T14:09:52.227473Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:52.235611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.235636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.235805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.235863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.235928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.235981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.236226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.236235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.236292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.236349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.236408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.236466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.236506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.236513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.236576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.236632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.236689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.236756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.236801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.236809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.236874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.236935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.236995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.237053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.237096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.237102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.237158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.237215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.237272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.237327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.237372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.237377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.237440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.237505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.237592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.237660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.237706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.237713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.237786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.237845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.237914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.237977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.238022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.238028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.238090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.238147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.238211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.238276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.238322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.238329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.238414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.238483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.238556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.238618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.238666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.238673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.238729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.238784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.238843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.238896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.238937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.238944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.239019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830083:8250], now have 1 active actors on pipe
2025-10-01T14:09:52.239218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:52.239230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255333660830083:8250]
2025-10-01T14:09:52.239255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:52.239257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:52.239287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 913 reason: error at write: Disconnected sessionId: src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0
2025-10-01T14:09:52.239534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 913 sessionId: src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0 is DEAD
2025-10-01T14:09:52.239640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:52.239648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0] Write session will restart in 0.007858s
2025-10-01T14:09:52.239557Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:52.239672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0] Write session: Do CDS request
2025-10-01T14:09:52.239677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:52.249007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.249071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:52.249087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 914
2025-10-01T14:09:52.249250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.249280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:52.249290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:52.249297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:52.249761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 914 sessionId:  describe result for acl check
2025-10-01T14:09:52.249800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:52.249811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:52.249813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:52.249818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255333660830132:8319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:52.250355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255333660830132:8319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:52.253412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255333660830132:8319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:52.256169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255333660830132:8319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:52.256186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255333660830132:8319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:52.256189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255333660830132:8319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:52.256198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:52.256252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:52.259022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:52.259228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:52.259241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:52.259252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:52.259307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:52.259348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255331283963685:7296]
2025-10-01T14:09:52.259884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:52.260161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:52.260195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:52.260404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:52.260443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.260447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.260448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.260449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.260449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.260450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.260451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.260451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.260452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.260453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.260453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.260454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.260455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.260455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.260459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.260468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.260471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.260474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.260478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.260481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.260485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.260488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.260490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.260492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.260494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.260496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.260498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.260500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.260505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.260509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.260513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.260516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.260518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.260521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.260523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.260526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.260529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.260532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.260534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.260537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.260539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.260543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.260545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.260548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.260550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.260553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.260555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.260558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.260561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.260564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.260567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.260569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.260571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.260575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.260577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.260580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.260601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:52.264129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:52.265034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:52.265045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:52.265047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:52.265049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:52.265054Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 913 [2:7556255331283963685:7296]
2025-10-01T14:09:52.265067Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:52.265079Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:52.265081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.265083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.265085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.265097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:52.265105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:52.265110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:52.265151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.265157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.265158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.265160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:52.265161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:52.265213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:52.265218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.265225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.265231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.265239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:52.265251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255331283963679:7296]
2025-10-01T14:09:52.265256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255331283963679:7296]
2025-10-01T14:09:52.265257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255331283963679:7296]
2025-10-01T14:09:52.265263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:52.265272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:52.265274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:52.265275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:52.265277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:52.265283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:52.265286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:52.265296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830085:2446], now have 1 active actors on pipe
2025-10-01T14:09:52.265303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830321:8319], now have 1 active actors on pipe
2025-10-01T14:09:52.265332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255331283963679:7296]
2025-10-01T14:09:52.265343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:52.265356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:52.265356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 913
2025-10-01T14:09:52.265357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 913
2025-10-01T14:09:52.265401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.265410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.265436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ac759d6-461f641e-c7316f87-658cc5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:52.265446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.265450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.265455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:52.265464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.265475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:52.265491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.265641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.265649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.265661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.265736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 914 partition: 0 MaxSeqNo: 45 sessionId: src_id|8ac759d6-461f641e-c7316f87-658cc5f_0
2025-10-01T14:09:52.266119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bc0c405-bd6f8135-8dfb7060-3f1ed884_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8ac759d6-461f641e-c7316f87-658cc5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:52.268697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac759d6-461f641e-c7316f87-658cc5f_0] Write session: try to update token
2025-10-01T14:09:52.268714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac759d6-461f641e-c7316f87-658cc5f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:52.276304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:52.276320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:52.276329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255331283963679:7296]
2025-10-01T14:09:52.276367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:52.276369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:52.276529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:52.276668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:52.276808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:52.276948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:52.277164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:52.277206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:52.287001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 914 sessionId: src_id|8ac759d6-461f641e-c7316f87-658cc5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:52.289433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:52.289772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.289799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.289831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:52.289933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:52.295496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:52.295514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:52.295516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:52.295518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:52.295529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255331283963679:7296]
2025-10-01T14:09:52.295531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255331283963679:7296]
2025-10-01T14:09:52.295535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255331283963679:7296]
2025-10-01T14:09:52.295577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:52.295582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:52.295587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:52.295589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.295592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:52.295598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:52.295729Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:52.339492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255333660830341:8250]
2025-10-01T14:09:52.339779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 913, pipe: [1:7556255333660830341:8250]
2025-10-01T14:09:52.440971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:52.449016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.449047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.449221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.449291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.449350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.449410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.449454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.449459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.449538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.449598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.449657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.449724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.449768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.449771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.449839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.449898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.449957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.450015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.450054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.450056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.450118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.450180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.450237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.450297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.450346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.450350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.452624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:52.452638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:52.452676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 914 reason: error at write: Disconnected sessionId: src_id|8ac759d6-461f641e-c7316f87-658cc5f_0
2025-10-01T14:09:52.452988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 914 sessionId: src_id|8ac759d6-461f641e-c7316f87-658cc5f_0 is DEAD
2025-10-01T14:09:52.450552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.450614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.450673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.450736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.450778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.450781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.450851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.450911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.450969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.453241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:52.451031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.451072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.451076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.451145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.453280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255333660830341:8250]
2025-10-01T14:09:52.451207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.451273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.451334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.451386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.451389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.451457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.451514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.451574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.451643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.451691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.451694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.451769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.451831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.451893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.451953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.452006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.452009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.452075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.452130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.452194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.452253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.452297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.452300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.452378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830341:8250], now have 1 active actors on pipe
2025-10-01T14:09:52.453556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:52.454259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac759d6-461f641e-c7316f87-658cc5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:52.454270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac759d6-461f641e-c7316f87-658cc5f_0] Write session will restart in 0.006308s
2025-10-01T14:09:52.454302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac759d6-461f641e-c7316f87-658cc5f_0] Write session: Do CDS request
2025-10-01T14:09:52.454310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac759d6-461f641e-c7316f87-658cc5f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:52.461907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac759d6-461f641e-c7316f87-658cc5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.462009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:52.462025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 915
2025-10-01T14:09:52.462146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.462175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:52.462184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:52.462188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:52.462806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 915 sessionId:  describe result for acl check
2025-10-01T14:09:52.462848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:52.462854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:52.462856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:52.462861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255333660830395:8331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:52.463400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255333660830395:8331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:52.465969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255333660830395:8331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:52.470002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255333660830395:8331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:52.470016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255333660830395:8331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:52.470020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255333660830395:8331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:52.470028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:52.471288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:52.473887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:52.474088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:52.474100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:52.474122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:52.474172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:52.474211Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255331283963937:7301]
2025-10-01T14:09:52.474843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:52.475231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:52.475290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:52.475644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:52.475717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.475725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.475726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.475728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.475729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.475730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.475733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.475734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.475735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.475736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.475737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.475738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.475739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.475740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.475747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.475757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.475761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.475764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.475768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.475772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.475777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.475781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.475785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.475788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.475792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.475795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.475798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.475802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.475809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.475817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.475823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.475828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.475833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.475838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.475842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.475846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.475851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.475856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.475861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.475871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.475875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.475880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.475883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.475888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.475893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.475901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.475906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.475911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.475916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.475928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.475931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.475940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.475944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.475948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.475955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.475960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.476007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:52.479974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:52.480817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:52.480831Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:52.480833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:52.480837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:52.480844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 914 [2:7556255331283963937:7301]
2025-10-01T14:09:52.480861Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:52.480878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:52.480886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.480891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.480893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.480912Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:52.480921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:52.480928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:52.480990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.480997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.480999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.481003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:52.481005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:52.481073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:52.481080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.481092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.481105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.481122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:52.481143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830363:2446], now have 1 active actors on pipe
2025-10-01T14:09:52.481151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830604:8331], now have 1 active actors on pipe
2025-10-01T14:09:52.481159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255331283963932:7301]
2025-10-01T14:09:52.481165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255331283963932:7301]
2025-10-01T14:09:52.481168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255331283963932:7301]
2025-10-01T14:09:52.481187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:52.481207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:52.481200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 914
2025-10-01T14:09:52.481221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 914
2025-10-01T14:09:52.481224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:52.481234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:52.481246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:52.481249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:52.481252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:52.481267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255331283963932:7301]
2025-10-01T14:09:52.481270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:52.481283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:52.481618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.481628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.481655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fa14f54-93536c03-f52cb111-a07c4457_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:52.481669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.481673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.481675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:52.481685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.481696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:52.481714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.481942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.481953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.481978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.482284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 915 partition: 0 MaxSeqNo: 45 sessionId: src_id|4fa14f54-93536c03-f52cb111-a07c4457_0
2025-10-01T14:09:52.482807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ac759d6-461f641e-c7316f87-658cc5f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4fa14f54-93536c03-f52cb111-a07c4457_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:52.485508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa14f54-93536c03-f52cb111-a07c4457_0] Write session: try to update token
2025-10-01T14:09:52.485532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa14f54-93536c03-f52cb111-a07c4457_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:52.501212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 915 sessionId: src_id|4fa14f54-93536c03-f52cb111-a07c4457_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:52.502304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:52.502323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:52.502326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:52.502328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:52.502336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255331283963932:7301]
2025-10-01T14:09:52.502340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255331283963932:7301]
2025-10-01T14:09:52.502343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255331283963932:7301]
2025-10-01T14:09:52.502413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:52.502416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:52.502422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:52.502424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.502425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:52.502426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:52.502560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:52.503768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:52.553493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255333660830618:8250]
2025-10-01T14:09:52.554600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 914, pipe: [1:7556255333660830618:8250]
2025-10-01T14:09:52.653061Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:52.653435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.653447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.653489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830618:8250], now have 1 active actors on pipe
2025-10-01T14:09:52.653714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255333660830618:8250]
2025-10-01T14:09:52.653735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:52.653739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:52.653743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:52.653794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 915 reason: error at write: Disconnected sessionId: src_id|4fa14f54-93536c03-f52cb111-a07c4457_0
2025-10-01T14:09:52.654321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:52.654464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa14f54-93536c03-f52cb111-a07c4457_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:52.654474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa14f54-93536c03-f52cb111-a07c4457_0] Write session will restart in 0.007988s
2025-10-01T14:09:52.654500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa14f54-93536c03-f52cb111-a07c4457_0] Write session: Do CDS request
2025-10-01T14:09:52.654509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa14f54-93536c03-f52cb111-a07c4457_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:52.654041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 915 sessionId: src_id|4fa14f54-93536c03-f52cb111-a07c4457_0 is DEAD
2025-10-01T14:09:52.666907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa14f54-93536c03-f52cb111-a07c4457_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.667546Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:52.667561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 916
2025-10-01T14:09:52.673282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:52.674531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.674593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:52.674607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:52.674613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:52.675081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 916 sessionId:  describe result for acl check
2025-10-01T14:09:52.675116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:52.675122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:52.675124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:52.675129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255333660830828:8335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:52.675660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255333660830828:8335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:52.676484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:52.676714Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:52.676719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:52.676731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:52.676799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:52.676835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255331283964221:7314]
2025-10-01T14:09:52.677476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:52.677804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:52.677817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255333660830828:8335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:52.677860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:52.678239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:52.678293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.678299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.678300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.678301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.678303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.678304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.678305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.678307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.678308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.678309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.678311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.678312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.678314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.678315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.678320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.678329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.678333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.678337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.678341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.678345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.678349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.678353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.678357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.678361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.678365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.678383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.678387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.678391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.678399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.678408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.678419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.678424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.678429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.678438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.678442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.678447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.678458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.678463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.678467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.678472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.678477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.678483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.678487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.678492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.678497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.678502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.678506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.678511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.678516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.678523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.678527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.678533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.678537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.678542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.678546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.678551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.678591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:52.682350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255333660830828:8335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:52.682366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255333660830828:8335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:52.682389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255333660830828:8335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:52.682397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:52.683065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:52.683964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:52.683970Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:52.683973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:52.683976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:52.683983Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 915 [2:7556255331283964221:7314]
2025-10-01T14:09:52.683998Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:52.684014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:52.684017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.684021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.684023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.684041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:52.684046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:52.684052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:52.684109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.684416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 915
2025-10-01T14:09:52.684455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 915
2025-10-01T14:09:52.684112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.684114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.684117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:52.684119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:52.684193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:52.684195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.684206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.684218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.684234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:52.684251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255331283964216:7314]
2025-10-01T14:09:52.684254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255331283964216:7314]
2025-10-01T14:09:52.684257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255331283964216:7314]
2025-10-01T14:09:52.684266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:52.684280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:52.684293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:52.684295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:52.684307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:52.684311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:52.684313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:52.684331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255331283964216:7314]
2025-10-01T14:09:52.684334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:52.684337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:52.684343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830874:8335], now have 1 active actors on pipe
2025-10-01T14:09:52.684346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830623:2446], now have 1 active actors on pipe
2025-10-01T14:09:52.684516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.684521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.684549Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:52.684556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.684560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.684562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:52.684572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.684580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:52.684595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.684773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.684782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.684796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.684902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 916 partition: 0 MaxSeqNo: 45 sessionId: src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0
2025-10-01T14:09:52.686640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fa14f54-93536c03-f52cb111-a07c4457_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:52.689471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0] Write session: try to update token
2025-10-01T14:09:52.689494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:52.697065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:52.697084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:52.697095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255331283964216:7314]
2025-10-01T14:09:52.697141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:52.697153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:52.697334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:52.697480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:52.697618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:52.697755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:52.697948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:52.697993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:52.707424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 916 sessionId: src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:52.710431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:52.710618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.710640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.710679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:52.710846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:52.720961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:52.720977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:52.720980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:52.720982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:52.720993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255331283964216:7314]
2025-10-01T14:09:52.720996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255331283964216:7314]
2025-10-01T14:09:52.721000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255331283964216:7314]
2025-10-01T14:09:52.721046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:52.721047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:52.721054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.721054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:52.721056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:52.721058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:52.721175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:52.753713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255333660830884:8250]
2025-10-01T14:09:52.753938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 915, pipe: [1:7556255333660830884:8250]
2025-10-01T14:09:52.861885Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:52.870171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.870203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.870392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.870456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.870516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.870577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.870629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.870639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.870708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.870771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.870831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.870895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.870939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.870948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.871012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.871078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.871145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.871205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.871258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.871266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.871331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.871397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.871454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.871520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.871566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.871573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.871633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.871688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.871745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.871803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.871846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.871853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.871914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.871972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.872042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.872106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.872151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.872160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.872217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.872273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.872336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.872395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.872443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.872453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.872515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.872573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.872629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.872696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.872760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.872767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.872831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.872890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.872945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.873005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.873051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.873057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.873115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:52.873172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:52.873234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:52.873295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:52.873339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:52.873346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:52.873415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830884:8250], now have 1 active actors on pipe
2025-10-01T14:09:52.873719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:52.873724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255333660830884:8250]
2025-10-01T14:09:52.873734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:52.873762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 916 reason: error at write: Disconnected sessionId: src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0
2025-10-01T14:09:52.873840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:52.874208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 916 sessionId: src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0 is DEAD
2025-10-01T14:09:52.874341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:52.874352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0] Write session will restart in 0.009189s
2025-10-01T14:09:52.874390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0] Write session: Do CDS request
2025-10-01T14:09:52.874397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:52.874422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:52.884970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.885054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:52.885070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 917
2025-10-01T14:09:52.885231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:52.885274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:52.885285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:52.885297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:52.885681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 917 sessionId:  describe result for acl check
2025-10-01T14:09:52.885729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:52.885731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:52.885733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:52.885738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255333660830957:8341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:52.886251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255333660830957:8341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:52.889279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255333660830957:8341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:52.892196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255333660830957:8341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:52.892215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255333660830957:8341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:52.892218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255333660830957:8341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:52.892228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:52.893627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:52.896730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:52.897012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:52.897020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:52.897031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:52.897078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:52.897127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255331283964468:7317]
2025-10-01T14:09:52.897808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:52.898114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:52.898153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:52.898489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:52.898537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.898542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.898543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.898544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.898545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.898547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.898548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.898549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.898551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.898552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.898553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.898554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.898555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.898556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.898562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.898571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.898575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.898580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.898584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.898587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.898591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.898595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.898599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.898603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.898606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.898610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.898614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.898618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.898624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.898632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:52.898642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.898648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:52.898652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.898657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:52.898661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.898667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:52.898675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.898680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:52.898685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.898693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:52.898699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.898708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:52.898713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.898722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:52.898727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.898736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:52.898740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.898745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.898753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.898760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.898770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.898774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.898779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.898785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:52.898793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.898798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:52.898840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:52.902648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:52.903399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:52.903413Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:52.903415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:52.903419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:52.903425Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 916 [2:7556255331283964468:7317]
2025-10-01T14:09:52.903440Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:52.903457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:52.903459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.903463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.903466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.903480Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:52.903490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:52.903496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:52.903552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.903558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.903560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.903563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:52.903566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:52.903631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:52.903637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.903647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:52.903658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:52.903677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:52.903699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660831125:8341], now have 1 active actors on pipe
2025-10-01T14:09:52.903706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660830887:2446], now have 1 active actors on pipe
2025-10-01T14:09:52.903714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255331283964463:7317]
2025-10-01T14:09:52.903716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255331283964463:7317]
2025-10-01T14:09:52.903718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255331283964463:7317]
2025-10-01T14:09:52.903731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:52.903750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:52.903753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:52.903757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:52.903761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:52.903768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:52.903771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:52.903812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.903820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.903832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255331283964463:7317]
2025-10-01T14:09:52.903843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:52.903856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:52.903871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1592e409-742c1c3-fd68d66d-236ab686_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:52.903881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:52.903889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:52.903892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:52.903900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:52.903911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:52.903932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.903727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 916
2025-10-01T14:09:52.903734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 916
2025-10-01T14:09:52.904060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:52.904066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:52.904080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:52.904141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 917 partition: 0 MaxSeqNo: 45 sessionId: src_id|1592e409-742c1c3-fd68d66d-236ab686_0
2025-10-01T14:09:52.904509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514a5d47-7a484487-937a2e3b-cf601a8d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1592e409-742c1c3-fd68d66d-236ab686_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:52.907066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1592e409-742c1c3-fd68d66d-236ab686_0] Write session: try to update token
2025-10-01T14:09:52.907085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1592e409-742c1c3-fd68d66d-236ab686_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:52.923584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 917 sessionId: src_id|1592e409-742c1c3-fd68d66d-236ab686_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:52.923961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:52.923980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:52.923986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:52.923988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:52.923996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255331283964463:7317]
2025-10-01T14:09:52.924002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255331283964463:7317]
2025-10-01T14:09:52.924007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255331283964463:7317]
2025-10-01T14:09:52.924060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:52.924073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:52.924075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:52.924142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:52.924158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:52.924162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:52.924211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:52.926332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:52.973891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255333660831139:8250]
2025-10-01T14:09:52.974254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 916, pipe: [1:7556255333660831139:8250]
2025-10-01T14:09:53.091978Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:53.092979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.093000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.093047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255333660831139:8250], now have 1 active actors on pipe
2025-10-01T14:09:53.093309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:53.093319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:53.093322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:53.093383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 917 reason: error at write: Disconnected sessionId: src_id|1592e409-742c1c3-fd68d66d-236ab686_0
2025-10-01T14:09:53.093387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255333660831139:8250]
2025-10-01T14:09:53.093394Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:53.093584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 917 sessionId: src_id|1592e409-742c1c3-fd68d66d-236ab686_0 is DEAD
2025-10-01T14:09:53.093742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1592e409-742c1c3-fd68d66d-236ab686_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:53.093752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1592e409-742c1c3-fd68d66d-236ab686_0] Write session will restart in 0.008056s
2025-10-01T14:09:53.093784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1592e409-742c1c3-fd68d66d-236ab686_0] Write session: Do CDS request
2025-10-01T14:09:53.093791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1592e409-742c1c3-fd68d66d-236ab686_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:53.102855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1592e409-742c1c3-fd68d66d-236ab686_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.102997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:53.103012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 918
2025-10-01T14:09:53.103151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.103183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:53.103197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:53.103200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:53.103622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 918 sessionId:  describe result for acl check
2025-10-01T14:09:53.103675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:53.103681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:53.103683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:53.103689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255337955798475:8345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:53.104235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255337955798475:8345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:53.107373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255337955798475:8345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:53.110281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255337955798475:8345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:53.110294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255337955798475:8345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:53.110296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255337955798475:8345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:53.110306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:53.111498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:53.116029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:53.116278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:53.116293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:53.116307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:53.116373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:53.116435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255335578932010:7319]
2025-10-01T14:09:53.117038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:53.117336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:53.117382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:53.117696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:53.117775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.117781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.117782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.117783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.117784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.117785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.117786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.117787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.117788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.117789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.117791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.117792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.117793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.117794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.117799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.117809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.117812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.117816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.117819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.117823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.117827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.117830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.117834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.117838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.117842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.117844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.117852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.117855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.117867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.117878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.117888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.117898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.117906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.117915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.117924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.117934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.117942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.117948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.117957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.117966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.117976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.117982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.117990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.118000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.118009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.118018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.118026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.118035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.118044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.118053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.118061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.118070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.118079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.118089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.118098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.118107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.118157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:53.121973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:53.122857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:53.122872Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:53.122874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:53.122878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:53.122885Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 917 [2:7556255335578932010:7319]
2025-10-01T14:09:53.122902Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:53.122921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:53.122929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.122932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.122934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.122948Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:53.122958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:53.122968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:53.123026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.123033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.123035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.123038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:53.123041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:53.123112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:53.123119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.123129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.123144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.123162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:53.123185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955798676:8345], now have 1 active actors on pipe
2025-10-01T14:09:53.123192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955798437:2446], now have 1 active actors on pipe
2025-10-01T14:09:53.123199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255335578932004:7319]
2025-10-01T14:09:53.123205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255335578932004:7319]
2025-10-01T14:09:53.123207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255335578932004:7319]
2025-10-01T14:09:53.123217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:53.123227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:53.123234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:53.123237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:53.123240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:53.123247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:53.123251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:53.123226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 917
2025-10-01T14:09:53.123279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255335578932004:7319]
2025-10-01T14:09:53.123239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 917
2025-10-01T14:09:53.123291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:53.123297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:53.123309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.123317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.123363Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db16903-552bfb01-21de246a-7c88b640_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:53.123375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.123381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.123387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:53.123396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.123404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:53.123423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.123600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.123610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.123627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.123694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 918 partition: 0 MaxSeqNo: 45 sessionId: src_id|db16903-552bfb01-21de246a-7c88b640_0
2025-10-01T14:09:53.124048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1592e409-742c1c3-fd68d66d-236ab686_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db16903-552bfb01-21de246a-7c88b640_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:53.126304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db16903-552bfb01-21de246a-7c88b640_0] Write session: try to update token
2025-10-01T14:09:53.126320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db16903-552bfb01-21de246a-7c88b640_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:53.143824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:53.143841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:53.143843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:53.143846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:53.143855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255335578932004:7319]
2025-10-01T14:09:53.143860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255335578932004:7319]
2025-10-01T14:09:53.143864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255335578932004:7319]
2025-10-01T14:09:53.143902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:53.143911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:53.143915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:53.143918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:53.143919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.143921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:53.144060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:53.151814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 918 sessionId: src_id|db16903-552bfb01-21de246a-7c88b640_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:53.154521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:53.193511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255337955798690:8250]
2025-10-01T14:09:53.193751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 917, pipe: [1:7556255337955798690:8250]
2025-10-01T14:09:53.292843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:53.293594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.293610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.293633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955798690:8250], now have 1 active actors on pipe
2025-10-01T14:09:53.293862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:53.293974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:53.293987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:53.294050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 918 reason: error at write: Disconnected sessionId: src_id|db16903-552bfb01-21de246a-7c88b640_0
2025-10-01T14:09:53.294302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 918 sessionId: src_id|db16903-552bfb01-21de246a-7c88b640_0 is DEAD
2025-10-01T14:09:53.294432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:53.294471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255337955798690:8250]
2025-10-01T14:09:53.295231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db16903-552bfb01-21de246a-7c88b640_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:53.295244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db16903-552bfb01-21de246a-7c88b640_0] Write session will restart in 0.007180s
2025-10-01T14:09:53.295273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db16903-552bfb01-21de246a-7c88b640_0] Write session: Do CDS request
2025-10-01T14:09:53.295280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db16903-552bfb01-21de246a-7c88b640_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:53.305993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db16903-552bfb01-21de246a-7c88b640_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.306034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:53.306059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 919
2025-10-01T14:09:53.306281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.306317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:53.306327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:53.306331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:53.306692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 919 sessionId:  describe result for acl check
2025-10-01T14:09:53.306717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:53.306719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:53.306720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:53.306726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255337955798745:8350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:53.307216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255337955798745:8350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:53.309278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255337955798745:8350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:53.312681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255337955798745:8350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:53.312698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255337955798745:8350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:53.312701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255337955798745:8350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:53.312722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:53.321616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:53.324796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:53.325275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:53.325299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:53.325320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:53.325398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:53.325467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255335578932257:7321]
2025-10-01T14:09:53.326313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:53.326764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:53.326826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:53.327188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:53.327252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.327258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.327259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.327260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.327262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.327263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.327265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.327266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.327267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.327268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.327270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.327271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.327272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.327273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.327280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.327290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.327295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.327299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.327303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.327307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.327311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.327315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.327319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.327324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.327328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.327332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.327336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.327340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.327348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.327357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.327369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.327379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.327385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.327391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.327400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.327410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.327419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.327429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.327433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.327456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.327466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.327472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.327480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.327486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.327494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.327500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.327505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.327515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.327524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.327529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.327538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.327543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.327554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.327563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.327568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.327577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.327616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:53.331550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:53.332498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:53.332513Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:53.332516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:53.332520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:53.332530Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 918 [2:7556255335578932257:7321]
2025-10-01T14:09:53.332548Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:53.332565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:53.332573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.332577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.332579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.332598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:53.332608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:53.332615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:53.332678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.332685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.332687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.332690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:53.332693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:53.332765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:53.332773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.332780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.332786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.332797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:53.332814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255335578932252:7321]
2025-10-01T14:09:53.332817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255335578932252:7321]
2025-10-01T14:09:53.332819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255335578932252:7321]
2025-10-01T14:09:53.332829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:53.332837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:53.332842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:53.332846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:53.332848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:53.332854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:53.332856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:53.332868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955798700:2446], now have 1 active actors on pipe
2025-10-01T14:09:53.332876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955798845:8350], now have 1 active actors on pipe
2025-10-01T14:09:53.332907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255335578932252:7321]
2025-10-01T14:09:53.332918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:53.332923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:53.333148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 918
2025-10-01T14:09:53.333191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 918
2025-10-01T14:09:53.333261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.333271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.333295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:53.333304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.333309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.333317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:53.333327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.333340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:53.333358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.333506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.333512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.333524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.333595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 919 partition: 0 MaxSeqNo: 45 sessionId: src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0
2025-10-01T14:09:53.333992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db16903-552bfb01-21de246a-7c88b640_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:53.336473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0] Write session: try to update token
2025-10-01T14:09:53.336492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:53.349381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:53.349398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:53.349408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255335578932252:7321]
2025-10-01T14:09:53.349456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:53.349467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:53.349622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:53.349769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:53.349908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:53.350044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:53.350238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:53.350275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:53.355344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 919 sessionId: src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:53.357746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:53.357975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.357997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.358031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:53.358319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:53.364704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:53.364725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:53.364729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:53.364731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:53.364753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255335578932252:7321]
2025-10-01T14:09:53.364764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255335578932252:7321]
2025-10-01T14:09:53.364768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255335578932252:7321]
2025-10-01T14:09:53.364822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:53.364824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:53.364830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:53.364837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:53.364837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.364840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:53.365029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:53.394742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255337955798956:8250]
2025-10-01T14:09:53.395030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 918, pipe: [1:7556255337955798956:8250]
2025-10-01T14:09:53.501138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:53.508583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.508614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.508780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.508840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.508899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.508964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.509013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.509022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.509085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.509143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.509243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.509355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.509397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.509402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.509459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.509540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.509616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.509675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.509722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.509727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.509779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.509834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.509887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.510037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.510077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.510082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.510138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.510311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.510390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.510454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.510565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.510572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.510630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.510687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.510754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.510821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.510862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.510867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.510925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.510981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.511041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.511107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.511152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.511159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.511225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.511284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.511340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.511400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.511442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.511452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.511522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.511577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.511641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.511703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.511825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.511832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.511894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.511952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.512016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.512075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.512114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.512119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.512187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955798956:8250], now have 1 active actors on pipe
2025-10-01T14:09:53.512448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255337955798956:8250]
2025-10-01T14:09:53.512476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:53.512478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:53.512481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:53.512499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 919 reason: error at write: Disconnected sessionId: src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0
2025-10-01T14:09:53.512716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 919 sessionId: src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0 is DEAD
2025-10-01T14:09:53.512876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:53.512887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0] Write session will restart in 0.006002s
2025-10-01T14:09:53.512914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0] Write session: Do CDS request
2025-10-01T14:09:53.512920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:53.513066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:53.519955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.520020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:53.520033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 920
2025-10-01T14:09:53.520168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.520197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:53.520206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:53.520210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:53.520571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 920 sessionId:  describe result for acl check
2025-10-01T14:09:53.520603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:53.520608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:53.520610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:53.520615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255337955798998:8361] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:53.521108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255337955798998:8361] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:53.523300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255337955798998:8361] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:53.527035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255337955798998:8361] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:53.527050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255337955798998:8361] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:53.527066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255337955798998:8361] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:53.527074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:53.530995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:53.533995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:53.534298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:53.534309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:53.534322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:53.534368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:53.534422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255335578932513:7326]
2025-10-01T14:09:53.534975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:53.535257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:53.535297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:53.535586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:53.535665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.535670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.535671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.535673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.535674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.535675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.535676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.535677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.535678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.535679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.535680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.535681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.535682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.535683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.535687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.535695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.535699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.535701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.535704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.535707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.535710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.535713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.535716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.535719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.535722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.535725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.535728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.535731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.535739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.535746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.535751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.535755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.535762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.535766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.535769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.535773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.535776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.535780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.535784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.535788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.535791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.535795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.535798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.535802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.535806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.535810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.535814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.535818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.535821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.535825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.535829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.535833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.535837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.535841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.535845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.535849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.535882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:53.539623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:53.540213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:53.540228Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:53.540231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:53.540234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:53.540242Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 919 [2:7556255335578932513:7326]
2025-10-01T14:09:53.540257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:53.540273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:53.540276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.540280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.540283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.540298Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:53.540308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:53.540315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:53.540367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.540374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.540375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.540379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:53.540381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:53.540444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:53.540451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.540462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.540472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.540491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:53.540512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955798984:2446], now have 1 active actors on pipe
2025-10-01T14:09:53.540522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955799147:8361], now have 1 active actors on pipe
2025-10-01T14:09:53.540529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255335578932508:7326]
2025-10-01T14:09:53.540531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255335578932508:7326]
2025-10-01T14:09:53.540534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255335578932508:7326]
2025-10-01T14:09:53.540552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:53.540566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:53.540579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:53.540582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:53.540587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:53.540591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:53.540594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:53.540608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255335578932508:7326]
2025-10-01T14:09:53.540616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:53.540618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:53.540586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 919
2025-10-01T14:09:53.540604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 919
2025-10-01T14:09:53.540644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.540653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.540681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:53.540692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.540696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.540698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:53.540706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.540714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:53.540728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.540920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.540928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.540942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.541018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 920 partition: 0 MaxSeqNo: 45 sessionId: src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0
2025-10-01T14:09:53.541427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6acea4ca-cc13cf5f-1445b818-5d1cf4ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:53.543911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0] Write session: try to update token
2025-10-01T14:09:53.543926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:53.562576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:53.562594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:53.562597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:53.562599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:53.562609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255335578932508:7326]
2025-10-01T14:09:53.562614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255335578932508:7326]
2025-10-01T14:09:53.562619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255335578932508:7326]
2025-10-01T14:09:53.562673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:53.562672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:53.562678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:53.562683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:53.562686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.562689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:53.562870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:53.560902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 920 sessionId: src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:53.563346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:53.613235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255337955799236:8250]
2025-10-01T14:09:53.613617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 919, pipe: [1:7556255337955799236:8250]
2025-10-01T14:09:53.710975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:53.711574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.711589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.711631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955799236:8250], now have 1 active actors on pipe
2025-10-01T14:09:53.711819Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:53.711835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:53.711864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:53.711867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:53.711883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255337955799236:8250]
2025-10-01T14:09:53.711931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 920 reason: error at write: Disconnected sessionId: src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0
2025-10-01T14:09:53.712113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 920 sessionId: src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0 is DEAD
2025-10-01T14:09:53.712246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:53.712259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0] Write session will restart in 0.005930s
2025-10-01T14:09:53.712286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0] Write session: Do CDS request
2025-10-01T14:09:53.712291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:53.719906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.720006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:53.720017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 921
2025-10-01T14:09:53.720135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.720172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:53.720178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:53.720181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:53.720575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 921 sessionId:  describe result for acl check
2025-10-01T14:09:53.720610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:53.720630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:53.720632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:53.720637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255337955799278:8367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:53.721137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255337955799278:8367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:53.723818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255337955799278:8367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:53.727551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255337955799278:8367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:53.727565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255337955799278:8367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:53.727568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255337955799278:8367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:53.727578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:53.729737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:53.732635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:53.732923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:53.732936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:53.732949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:53.733012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:53.733072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255335578932802:7339]
2025-10-01T14:09:53.733614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:53.733907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:53.733962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:53.734230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:53.734295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.734301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.734302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.734303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.734305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.734306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.734307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.734308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.734309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.734310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.734311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.734312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.734313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.734315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.734320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.734330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.734334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.734338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.734342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.734346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.734350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.734354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.734357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.734364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.734366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.734382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.734386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.734389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.734397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.734404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.734410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.734415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.734422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.734429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.734432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.734437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.734446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.734451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.734455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.734461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.734470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.734479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.734483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.734488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.734493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.734498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.734507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.734511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.734516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.734520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.734524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.734530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.734538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.734545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.734553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.734562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.734591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:53.738762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:53.739420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:53.739443Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:53.739445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:53.739449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:53.739456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 920 [2:7556255335578932802:7339]
2025-10-01T14:09:53.739471Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:53.739491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:53.739499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.739503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.739505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.739523Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:53.739533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:53.739540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:53.739606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.739614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.739617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.739621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:53.739624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:53.739703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:53.739712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.739723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.739732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.739749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:53.739768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255335578932797:7339]
2025-10-01T14:09:53.739774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255335578932797:7339]
2025-10-01T14:09:53.739776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255335578932797:7339]
2025-10-01T14:09:53.739785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:53.739794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:53.739805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:53.739805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955799255:2446], now have 1 active actors on pipe
2025-10-01T14:09:53.739807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:53.739810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:53.739822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:53.739825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:53.739830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955799478:8367], now have 1 active actors on pipe
2025-10-01T14:09:53.739864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255335578932797:7339]
2025-10-01T14:09:53.739875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:53.739908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:53.739900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 920
2025-10-01T14:09:53.739903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 920
2025-10-01T14:09:53.739958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.739967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.739996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6670ae11-7d7bce79-54a491d-59eb8687_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:53.740008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.740013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.740019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:53.740031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.740044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:53.740068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.740215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.740222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.740238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.740351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 921 partition: 0 MaxSeqNo: 45 sessionId: src_id|6670ae11-7d7bce79-54a491d-59eb8687_0
2025-10-01T14:09:53.740839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6bbf42d-6bc37486-12d9af5e-2aa6cd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6670ae11-7d7bce79-54a491d-59eb8687_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:53.743519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6670ae11-7d7bce79-54a491d-59eb8687_0] Write session: try to update token
2025-10-01T14:09:53.743536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6670ae11-7d7bce79-54a491d-59eb8687_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:53.753036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:53.753055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:53.753066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255335578932797:7339]
2025-10-01T14:09:53.753113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:53.753295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:53.753483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:53.753656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:53.753802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:53.754063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:53.754104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:53.754414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:53.764933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 921 sessionId: src_id|6670ae11-7d7bce79-54a491d-59eb8687_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:53.767294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:53.767786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.767806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.767853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:53.767952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:53.772623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:53.772642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:53.772645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:53.772646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:53.772657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255335578932797:7339]
2025-10-01T14:09:53.772660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255335578932797:7339]
2025-10-01T14:09:53.772664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255335578932797:7339]
2025-10-01T14:09:53.772700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:53.772706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:53.772707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:53.772709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:53.772714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.772716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:53.772857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:53.812023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255337955799508:8250]
2025-10-01T14:09:53.812331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 920, pipe: [1:7556255337955799508:8250]
2025-10-01T14:09:53.922566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:53.930419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.930444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.930616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.930673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.930731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.930788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.930835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.930840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.930908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.930963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.931020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.931078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.931122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.931125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.931208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.931257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.931307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.931359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.931396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.931399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.931459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.931513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.931564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.931617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.931659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.931663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.931719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.931774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.931829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.931896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.931940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.931947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.932008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.932060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.932118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.932199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.932242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.932249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.932309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.932364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.932423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.932481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.932524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.932531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.932589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.932644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.932702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.932772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.932814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.932820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.932884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.932942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.933010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.933076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.933214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.933223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.933290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:53.933349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:53.933409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:53.933466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:53.933578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:53.933585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:53.933661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955799508:8250], now have 1 active actors on pipe
2025-10-01T14:09:53.933893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:53.933914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:53.933917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:53.933939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 921 reason: error at write: Disconnected sessionId: src_id|6670ae11-7d7bce79-54a491d-59eb8687_0
2025-10-01T14:09:53.933951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255337955799508:8250]
2025-10-01T14:09:53.934130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 921 sessionId: src_id|6670ae11-7d7bce79-54a491d-59eb8687_0 is DEAD
2025-10-01T14:09:53.934177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:53.934261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670ae11-7d7bce79-54a491d-59eb8687_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:53.934270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670ae11-7d7bce79-54a491d-59eb8687_0] Write session will restart in 0.008878s
2025-10-01T14:09:53.934295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670ae11-7d7bce79-54a491d-59eb8687_0] Write session: Do CDS request
2025-10-01T14:09:53.934300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670ae11-7d7bce79-54a491d-59eb8687_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:53.943962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6670ae11-7d7bce79-54a491d-59eb8687_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.944076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:53.944091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 922
2025-10-01T14:09:53.944223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:53.944272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:53.944284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:53.944288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:53.944709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 922 sessionId:  describe result for acl check
2025-10-01T14:09:53.944750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:53.944756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:53.944758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:53.944763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255337955799561:8371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:53.945280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255337955799561:8371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:53.948434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255337955799561:8371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:53.951704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255337955799561:8371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:53.951718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255337955799561:8371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:53.951722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255337955799561:8371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:53.951730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:53.952715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:53.955206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:53.955387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:53.955396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:53.955406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:53.955443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:53.955480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255335578933054:7342]
2025-10-01T14:09:53.956141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:53.956405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:53.956439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:53.956725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:53.956784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.956789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.956790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.956792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.956793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.956794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.956795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.956796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.956797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.956798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.956800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.956801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.956803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.956804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.956809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.956818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.956822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.956826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.956829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.956833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.956836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.956840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.956843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.956847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.956851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.956854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.956858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.956861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.956867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.956874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:53.956880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.956885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:53.956889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.956900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:53.956904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.956908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:53.956914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.956922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:53.956926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.956935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:53.956939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.956944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:53.956951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.956956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:53.956960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.956969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:53.956977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.956982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.956990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.956998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.957002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.957010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.957018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.957024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:53.957031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.957035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:53.957071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:53.960687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:53.961293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:53.961305Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:53.961307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:53.961310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:53.961317Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 921 [2:7556255335578933054:7342]
2025-10-01T14:09:53.961330Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:53.961346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:53.961349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.961352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.961353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.961367Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:53.961372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:53.961379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:53.961440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.961447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.961449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.961451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:53.961454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:53.961519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:53.961527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.961537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:53.961546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:53.961559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:53.961575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955799510:2446], now have 1 active actors on pipe
2025-10-01T14:09:53.961582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255337955799753:8371], now have 1 active actors on pipe
2025-10-01T14:09:53.961589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255335578933049:7342]
2025-10-01T14:09:53.961591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255335578933049:7342]
2025-10-01T14:09:53.961592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255335578933049:7342]
2025-10-01T14:09:53.961604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:53.961616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:53.961620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:53.961623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:53.961626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:53.961627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:53.961630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:53.961654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255335578933049:7342]
2025-10-01T14:09:53.961657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:53.961653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 921
2025-10-01T14:09:53.961663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 921
2025-10-01T14:09:53.961680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:53.961684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.961688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.961715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d962f38a-a915dc88-198e0871-d37652bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:53.961726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:53.961730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:53.961732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:53.961740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:53.961747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:53.961764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.961889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.961896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.961907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:53.961977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 922 partition: 0 MaxSeqNo: 45 sessionId: src_id|d962f38a-a915dc88-198e0871-d37652bf_0
2025-10-01T14:09:53.962336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670ae11-7d7bce79-54a491d-59eb8687_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d962f38a-a915dc88-198e0871-d37652bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:53.964788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d962f38a-a915dc88-198e0871-d37652bf_0] Write session: try to update token
2025-10-01T14:09:53.964807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d962f38a-a915dc88-198e0871-d37652bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:53.978962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 922 sessionId: src_id|d962f38a-a915dc88-198e0871-d37652bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:53.981390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:53.982644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:53.982665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:53.982682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:53.982685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:53.982686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:53.982688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:53.982694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255335578933049:7342]
2025-10-01T14:09:53.982697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255335578933049:7342]
2025-10-01T14:09:53.982700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255335578933049:7342]
2025-10-01T14:09:53.982730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:53.982742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:53.982742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:53.982747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:53.982748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:53.982748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:53.982864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:54.034205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255342250767063:8250]
2025-10-01T14:09:54.034487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 921, pipe: [1:7556255342250767063:8250]
2025-10-01T14:09:54.122356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:54.122992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:54.123052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767063:8250], now have 1 active actors on pipe
2025-10-01T14:09:54.123138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:54.123219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:54.123269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255342250767063:8250]
2025-10-01T14:09:54.136834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:54.136846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:54.136865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 922 reason: error at write: Disconnected sessionId: src_id|d962f38a-a915dc88-198e0871-d37652bf_0
2025-10-01T14:09:54.137007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 922 sessionId: src_id|d962f38a-a915dc88-198e0871-d37652bf_0 is DEAD
2025-10-01T14:09:54.137191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d962f38a-a915dc88-198e0871-d37652bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:54.137203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d962f38a-a915dc88-198e0871-d37652bf_0] Write session will restart in 0.006019s
2025-10-01T14:09:54.137238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d962f38a-a915dc88-198e0871-d37652bf_0] Write session: Do CDS request
2025-10-01T14:09:54.137247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d962f38a-a915dc88-198e0871-d37652bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:54.144962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d962f38a-a915dc88-198e0871-d37652bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.145099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:54.145111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 923
2025-10-01T14:09:54.145287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.145311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:54.145315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:54.145317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:54.145654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 923 sessionId:  describe result for acl check
2025-10-01T14:09:54.145679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:54.145680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:54.145681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:54.145685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255342250767269:8375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:54.146143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255342250767269:8375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:54.148358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:54.149183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255342250767269:8375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:54.151446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:54.151632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:54.151635Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:54.151644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:54.151679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:54.151708Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255339873900599:7344]
2025-10-01T14:09:54.152106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:54.152391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:54.152419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:54.152630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:54.152670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.152675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.152675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.152676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.152677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.152678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.152678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.152679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.152680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.152681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.152681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.152682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.152682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.152683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.152686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.152692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.152694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.152697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.152699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.152701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.152703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.152705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.152707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.152709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.152711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.152713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.152715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.152717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.152722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.152726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.152730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.152733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.152746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.152749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.152751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.152754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.152757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.152760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.152763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.152766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.152768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.152771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.152773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.152776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.152778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.152781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.152784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.152787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.152789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.152792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.152803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.152806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.152809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.152812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.152814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.152817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.152838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:54.152697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255342250767269:8375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:54.152708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255342250767269:8375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:54.152710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255342250767269:8375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:54.152716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:54.156937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:54.157636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:54.157645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:54.157647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:54.157649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:54.157654Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 922 [2:7556255339873900599:7344]
2025-10-01T14:09:54.157666Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:54.157678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:54.157680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.157682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.157684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.157696Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:54.157699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:54.157703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:54.157739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.157745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.157746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.157749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:54.157750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:54.157796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:54.157802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.157810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.157815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.157823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:54.157839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255339873900594:7344]
2025-10-01T14:09:54.157843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255339873900594:7344]
2025-10-01T14:09:54.157845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255339873900594:7344]
2025-10-01T14:09:54.157861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:54.157869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:54.157872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:54.157874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:54.157874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767313:8375], now have 1 active actors on pipe
2025-10-01T14:09:54.157879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767066:2446], now have 1 active actors on pipe
2025-10-01T14:09:54.157883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:54.157890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:54.157895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:54.157920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255339873900594:7344]
2025-10-01T14:09:54.157928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:54.158002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 922
2025-10-01T14:09:54.158031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 922
2025-10-01T14:09:54.158039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:54.158249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.158258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.158278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:54.158287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.158290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.158292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:54.158300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.158307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:54.158320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.158516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.158524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.158535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.158632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 923 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0
2025-10-01T14:09:54.162480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d962f38a-a915dc88-198e0871-d37652bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:54.164765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0] Write session: try to update token
2025-10-01T14:09:54.164784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:54.178214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:54.178233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:54.178236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:54.178238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:54.178249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255339873900594:7344]
2025-10-01T14:09:54.178255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255339873900594:7344]
2025-10-01T14:09:54.178260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255339873900594:7344]
2025-10-01T14:09:54.178304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:54.178310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:54.178314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:54.178315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:54.178323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.178326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:54.178528Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:54.180780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 923 sessionId: src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:54.183383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:54.223142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255342250767323:8250]
2025-10-01T14:09:54.223417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 922, pipe: [1:7556255342250767323:8250]
2025-10-01T14:09:54.321398Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:54.321985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.322004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.322052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767323:8250], now have 1 active actors on pipe
2025-10-01T14:09:54.322240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:54.322305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:54.322307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255342250767323:8250]
2025-10-01T14:09:54.322318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:54.322328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:54.322395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 923 reason: error at write: Disconnected sessionId: src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0
2025-10-01T14:09:54.322641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 923 sessionId: src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0 is DEAD
2025-10-01T14:09:54.322818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:54.322828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0] Write session will restart in 0.006300s
2025-10-01T14:09:54.322854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0] Write session: Do CDS request
2025-10-01T14:09:54.322861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:54.329970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.330052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:54.330073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 924
2025-10-01T14:09:54.330194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.330234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:54.330245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:54.330248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:54.330708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 924 sessionId:  describe result for acl check
2025-10-01T14:09:54.330743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:54.330751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:54.330752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:54.330758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255342250767353:8380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:54.331322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255342250767353:8380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:54.334128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255342250767353:8380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:54.337148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255342250767353:8380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:54.337162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255342250767353:8380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:54.337167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255342250767353:8380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:54.337176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:54.339564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:54.342009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:54.342207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:54.342217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:54.342231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:54.342281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:54.342322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255339873900852:7346]
2025-10-01T14:09:54.342730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:54.342991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:54.343022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:54.343218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:54.343249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.343253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.343254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.343255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.343255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.343256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.343257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.343257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.343258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.343258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.343259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.343260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.343260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.343261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.343264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.343270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.343272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.343274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.343276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.343278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.343280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.343282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.343284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.343286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.343288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.343290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.343292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.343294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.343300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.343305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.343309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.343312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.343315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.343317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.343320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.343322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.343325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.343328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.343330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.343333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.343336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.343339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.343343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.343345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.343348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.343350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.343353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.343355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.343359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.343363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.343367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.343371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.343375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.343379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.343383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.343388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.343407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:54.346677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:54.347495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:54.347504Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:54.347505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:54.347508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:54.347513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 923 [2:7556255339873900852:7346]
2025-10-01T14:09:54.347523Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:54.347540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:54.347544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.347547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.347548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.347560Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:54.347569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:54.347580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:54.347624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.347629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.347630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.347633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:54.347635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:54.347686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:54.347692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.347702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.347715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.347733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:54.347755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767526:8380], now have 1 active actors on pipe
2025-10-01T14:09:54.347759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767333:2446], now have 1 active actors on pipe
2025-10-01T14:09:54.347768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255339873900847:7346]
2025-10-01T14:09:54.347771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255339873900847:7346]
2025-10-01T14:09:54.347773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255339873900847:7346]
2025-10-01T14:09:54.347786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:54.347802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:54.347813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:54.347815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:54.347818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:54.347819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:54.347821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:54.347793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 923
2025-10-01T14:09:54.347830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 923
2025-10-01T14:09:54.347835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255339873900847:7346]
2025-10-01T14:09:54.347840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:54.347843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:54.347861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.347868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.347890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:54.347899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.347906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.347908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:54.347914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.347924Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:54.347941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.348082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.348090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.348105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.348191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 924 partition: 0 MaxSeqNo: 45 sessionId: src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0
2025-10-01T14:09:54.348566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cec3b-17a1f704-d14cce72-bfe2ced1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:54.350944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0] Write session: try to update token
2025-10-01T14:09:54.350961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:54.365819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 924 sessionId: src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:54.368322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:54.368343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:54.368345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:54.368347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:54.368358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255339873900847:7346]
2025-10-01T14:09:54.368362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255339873900847:7346]
2025-10-01T14:09:54.368366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255339873900847:7346]
2025-10-01T14:09:54.368418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:54.368423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.368426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:54.368424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:54.368431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:54.368435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:54.368508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:54.368545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:54.422309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255342250767594:8250]
2025-10-01T14:09:54.422573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 923, pipe: [1:7556255342250767594:8250]
2025-10-01T14:09:54.506752Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:54.507011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.507024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.507064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767594:8250], now have 1 active actors on pipe
2025-10-01T14:09:54.507225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:54.507772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:54.507781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0] Write session will restart in 0.006119s
2025-10-01T14:09:54.507806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0] Write session: Do CDS request
2025-10-01T14:09:54.507811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:54.507318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255342250767594:8250]
2025-10-01T14:09:54.507347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:54.507376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:54.507436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 924 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0
2025-10-01T14:09:54.507648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 924 sessionId: src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0 is DEAD
2025-10-01T14:09:54.517949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.518327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:54.518345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 925
2025-10-01T14:09:54.518479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.518512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:54.518521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:54.518524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:54.518883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 925 sessionId:  describe result for acl check
2025-10-01T14:09:54.518918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:54.518924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:54.518926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:54.518931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255342250767683:8390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:54.519424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255342250767683:8390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:54.523081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255342250767683:8390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:54.524935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:54.527342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255342250767683:8390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:54.527353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255342250767683:8390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:54.527356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255342250767683:8390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:54.527363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:54.527567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:54.527760Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:54.527773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:54.527784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:54.527840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:54.527883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255339873901106:7349]
2025-10-01T14:09:54.528439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:54.528696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:54.528731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:54.529022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:54.529070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.529075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.529076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.529077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.529078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.529078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.529079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.529080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.529081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.529082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.529083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.529084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.529085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.529086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.529090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.529098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.529101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.529104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.529107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.529110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.529113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.529116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.529119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.529122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.529125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.529128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.529131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.529143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.529149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.529156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.529161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.529165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.529169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.529173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.529176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.529180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.529189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.529194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.529197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.529201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.529209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.529213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.529217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.529220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.529225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.529228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.529232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.529236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.529239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.529243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.529247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.529251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.529254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.529260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.529263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.529267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.529303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:54.533211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:54.534333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:54.534347Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:54.534349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:54.534353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:54.534359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 924 [2:7556255339873901106:7349]
2025-10-01T14:09:54.534399Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:54.534415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:54.534422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.534427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.534430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.534447Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:54.534457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:54.534463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:54.534522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.534530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.534532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.534535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:54.534537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:54.534602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:54.534610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.534621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.534636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.534657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:54.534681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767610:2446], now have 1 active actors on pipe
2025-10-01T14:09:54.534689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767857:8390], now have 1 active actors on pipe
2025-10-01T14:09:54.534696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255339873901100:7349]
2025-10-01T14:09:54.534700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255339873901100:7349]
2025-10-01T14:09:54.534702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255339873901100:7349]
2025-10-01T14:09:54.534717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:54.534732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:54.534735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:54.534740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:54.534743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:54.534767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:54.534775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:54.534810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255339873901100:7349]
2025-10-01T14:09:54.534820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:54.534827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:54.535809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 924
2025-10-01T14:09:54.535837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 924
2025-10-01T14:09:54.535952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.535965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.535990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56942aaf-a7433694-92490bfe-8a0418e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:54.535998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.536002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.536010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:54.536019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.536035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:54.536056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.536224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.536237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.536260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.536356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 925 partition: 0 MaxSeqNo: 45 sessionId: src_id|56942aaf-a7433694-92490bfe-8a0418e6_0
2025-10-01T14:09:54.536718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2222a8-eaf8d907-eae1ddce-c7a939be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|56942aaf-a7433694-92490bfe-8a0418e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:54.539120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56942aaf-a7433694-92490bfe-8a0418e6_0] Write session: try to update token
2025-10-01T14:09:54.539136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56942aaf-a7433694-92490bfe-8a0418e6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:54.546457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:54.546478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:54.546489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255339873901100:7349]
2025-10-01T14:09:54.546534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:54.546538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:54.546735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:54.546877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:54.547005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:54.547138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:54.547337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:54.547383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:54.553417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 925 sessionId: src_id|56942aaf-a7433694-92490bfe-8a0418e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:54.555770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:54.555968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.555987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.556025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:54.556107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:54.564952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:54.564973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:54.564975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:54.564977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:54.564988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255339873901100:7349]
2025-10-01T14:09:54.564992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255339873901100:7349]
2025-10-01T14:09:54.564995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255339873901100:7349]
2025-10-01T14:09:54.565038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:54.565041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:54.565047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.565049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:54.565052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:54.565053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:54.565176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:54.607674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255342250767878:8250]
2025-10-01T14:09:54.607924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 924, pipe: [1:7556255342250767878:8250]
2025-10-01T14:09:54.716732Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:54.724926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.724954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.725120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.725183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.725245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.725305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.725355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.725364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.725427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.725488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.725550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.725617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.725662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.725669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.725741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.725802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.725866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.725953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.725995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.726001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.726076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.726137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.726198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.726261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.726305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.726312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.726394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.726503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.726580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.726641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.726700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.726707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.726777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.726839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.726905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.726975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.727020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.727026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.727097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.727160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.727226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.727296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.727344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.727352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.727426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.727499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.727571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.727639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.727687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.727694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.727762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.727830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.727897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.727962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.728008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.728015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.728085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:54.728151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:54.728218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:54.728288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:54.728333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:54.728340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:54.728399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767878:8250], now have 1 active actors on pipe
2025-10-01T14:09:54.728631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:54.728669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255342250767878:8250]
2025-10-01T14:09:54.728693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:54.728695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:54.728721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 925 reason: error at write: Disconnected sessionId: src_id|56942aaf-a7433694-92490bfe-8a0418e6_0
2025-10-01T14:09:54.728952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 925 sessionId: src_id|56942aaf-a7433694-92490bfe-8a0418e6_0 is DEAD
2025-10-01T14:09:54.729074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56942aaf-a7433694-92490bfe-8a0418e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:54.729086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56942aaf-a7433694-92490bfe-8a0418e6_0] Write session will restart in 0.009831s
2025-10-01T14:09:54.729109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56942aaf-a7433694-92490bfe-8a0418e6_0] Write session: Do CDS request
2025-10-01T14:09:54.729114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56942aaf-a7433694-92490bfe-8a0418e6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:54.729467Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:54.739938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56942aaf-a7433694-92490bfe-8a0418e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.740016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:54.740029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 926
2025-10-01T14:09:54.740123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.740146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:54.740152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:54.740155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:54.740619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 926 sessionId:  describe result for acl check
2025-10-01T14:09:54.740655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:54.740664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:54.740665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:54.740670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255342250767965:8397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:54.741188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255342250767965:8397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:54.746155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255342250767965:8397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:54.746812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:54.749747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:54.749978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:54.749989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:54.750012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:54.750074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:54.750116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255339873901406:7364]
2025-10-01T14:09:54.750474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255342250767965:8397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:54.750489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255342250767965:8397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:54.750492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255342250767965:8397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:54.750500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:54.750749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:54.751028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:54.751080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:54.751381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:54.751474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.751480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.751481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.751483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.751484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.751485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.751486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.751488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.751489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.751490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.751491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.751492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.751493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.751494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.751499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.751510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.751514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.751517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.751521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.751526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.751530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.751534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.751538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.751541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.751544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.751548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.751551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.751555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.751564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.751572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.751578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.751582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.751586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.751591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.751595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.751600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.751604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.751609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.751613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.751623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.751628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.751633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.751639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.751647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.751652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.751661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.751665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.751672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.751680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.751685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.751693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.751698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.751703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.751711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.751715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.751724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.751761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:54.756338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:54.757162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:54.757178Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:54.757181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:54.757185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:54.757192Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 925 [2:7556255339873901406:7364]
2025-10-01T14:09:54.757208Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:54.757226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:54.757235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.757239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.757241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.757259Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:54.757270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:54.757277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:54.757353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.757361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.757364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.757367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:54.757370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:54.757434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:54.757443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.757455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.757467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.757483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:54.757502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250767898:2446], now have 1 active actors on pipe
2025-10-01T14:09:54.757512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250768144:8397], now have 1 active actors on pipe
2025-10-01T14:09:54.757520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255339873901401:7364]
2025-10-01T14:09:54.757522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255339873901401:7364]
2025-10-01T14:09:54.757524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255339873901401:7364]
2025-10-01T14:09:54.757538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:54.757550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:54.757559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:54.757560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:54.757562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:54.757575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:54.757583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:54.757579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 925
2025-10-01T14:09:54.757596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 925
2025-10-01T14:09:54.757624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255339873901401:7364]
2025-10-01T14:09:54.757639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:54.757645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:54.757661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.757670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.757718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:54.757730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.757739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.757742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:54.757751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.757764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:54.757787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.757976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.757989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.758007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.758074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 926 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0
2025-10-01T14:09:54.758459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56942aaf-a7433694-92490bfe-8a0418e6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:54.761086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0] Write session: try to update token
2025-10-01T14:09:54.761104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:54.776190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 926 sessionId: src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:54.778741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:54.779826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.779855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.779878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:54.779890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:54.779892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:54.779894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:54.779905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255339873901401:7364]
2025-10-01T14:09:54.779910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255339873901401:7364]
2025-10-01T14:09:54.779914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255339873901401:7364]
2025-10-01T14:09:54.779946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:54.779955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:54.779958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:54.779979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:54.779990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.779997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:54.780141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:54.828826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255342250768156:8250]
2025-10-01T14:09:54.829065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 925, pipe: [1:7556255342250768156:8250]
2025-10-01T14:09:54.940995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:54.941284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:54.941348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250768156:8250], now have 1 active actors on pipe
2025-10-01T14:09:54.941562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:54.941605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255342250768156:8250]
2025-10-01T14:09:54.941623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:54.941658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:54.941668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:54.941741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 926 reason: error at write: Disconnected sessionId: src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0
2025-10-01T14:09:54.941947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 926 sessionId: src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0 is DEAD
2025-10-01T14:09:54.946420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:54.946433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0] Write session will restart in 0.007866s
2025-10-01T14:09:54.946460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0] Write session: Do CDS request
2025-10-01T14:09:54.946469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:54.955802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.956729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:54.956753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 927
2025-10-01T14:09:54.956956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:54.957004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:54.957015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:54.957018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:54.957440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 927 sessionId:  describe result for acl check
2025-10-01T14:09:54.957481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:54.957487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:54.957488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:54.957493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255342250768177:8401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:54.957984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255342250768177:8401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:54.961481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255342250768177:8401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:54.965286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255342250768177:8401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:54.965301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255342250768177:8401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:54.965305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255342250768177:8401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:54.965312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:54.976785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:54.982497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:54.982754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:54.982769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:54.982782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:54.982840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:54.982884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255339873901664:7367]
2025-10-01T14:09:54.983502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:54.984022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:54.984070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:54.984382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:54.984445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.984450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.984451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.984452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.984453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.984454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.984455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.984456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.984458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.984459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.984459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.984461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.984462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.984463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.984469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.984479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.984482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.984485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.984488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.984492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.984495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.984499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.984502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.984505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.984509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.984512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.984515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.984518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.984526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.984533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:54.984539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.984543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:54.984547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.984551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:54.984557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.984562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:54.984566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.984571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:54.984576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.984580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:54.984585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.984590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:54.984594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.984599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:54.984603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.984609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:54.984612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.984617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.984620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.984644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.984649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.984653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.984658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.984662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:54.984667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.984675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:54.984711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:54.991061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:54.991665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:54.991679Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:54.991681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:54.991685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:54.991692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 926 [2:7556255339873901664:7367]
2025-10-01T14:09:54.991707Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:54.991724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:54.991732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.991736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.991739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.991756Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:54.991761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:54.991767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:54.991829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.991836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.991838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.991841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:54.991844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:54.991919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:54.991929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:54.991942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:54.991953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:54.991968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:54.991987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250768270:8401], now have 1 active actors on pipe
2025-10-01T14:09:54.991990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255342250768158:2446], now have 1 active actors on pipe
2025-10-01T14:09:54.991998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255339873901659:7367]
2025-10-01T14:09:54.992000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255339873901659:7367]
2025-10-01T14:09:54.992002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255339873901659:7367]
2025-10-01T14:09:54.992015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:54.992026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:54.992028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:54.992028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:54.992031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:54.992041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:54.992043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:54.992077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255339873901659:7367]
2025-10-01T14:09:54.992080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:54.992090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:54.992345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.992357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.992383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:54.992395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:54.992404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:54.992406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:54.992417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:54.992426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:54.992445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.993085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:54.993099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:54.993118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:54.993646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b18c903-b1246d9c-2a3b3f6b-b96d60ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:54.996212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0] Write session: try to update token
2025-10-01T14:09:54.996231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:54.992060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 926
2025-10-01T14:09:54.992121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 926
2025-10-01T14:09:54.993247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 927 partition: 0 MaxSeqNo: 45 sessionId: src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0
2025-10-01T14:09:55.003450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:55.003470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:55.003477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255339873901659:7367]
2025-10-01T14:09:55.003515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:55.003673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:55.003808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:55.003961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:55.004091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:55.004413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:55.004451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:55.004897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:55.017224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 927 sessionId: src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:55.019689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:55.020239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.020260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.020297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:55.020900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:55.027461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:55.027479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:55.027482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:55.027484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:55.027494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255339873901659:7367]
2025-10-01T14:09:55.027498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255339873901659:7367]
2025-10-01T14:09:55.027502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255339873901659:7367]
2025-10-01T14:09:55.027530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:55.027536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:55.027539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:55.027542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:55.027549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.027552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:55.027721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:55.041806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255346545735716:8250]
2025-10-01T14:09:55.042090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 926, pipe: [1:7556255346545735716:8250]
2025-10-01T14:09:55.189310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:55.189853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545735716:8250], now have 1 active actors on pipe
2025-10-01T14:09:55.196419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.196442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.196593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.196647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.196702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.196774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.196818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.196825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.196887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.196972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.197031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.197091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.197135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.197140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.197198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.197247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.197314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.197376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.197427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.197435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.197498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.197569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.197625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.197680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.197722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.197727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.197780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.197844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.197907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.197959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.198008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.198013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.198069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.198121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.198176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.198229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.198270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.198275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.198332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.198408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.198481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.198546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.198589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.198596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.198661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.198731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.198790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.198859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.198908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.198915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.198987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.199063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.199140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.199207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.199253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.199260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.199329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:55.199397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:55.199461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:55.199525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:55.199652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:55.199664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:55.199927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:55.199941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:55.199953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:55.199979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 927 reason: error at write: Disconnected sessionId: src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0
2025-10-01T14:09:55.199997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255346545735716:8250]
2025-10-01T14:09:55.200223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 927 sessionId: src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0 is DEAD
2025-10-01T14:09:55.200324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:55.200330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0] Write session will restart in 0.009672s
2025-10-01T14:09:55.200349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0] Write session: Do CDS request
2025-10-01T14:09:55.200353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:55.200866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:55.211190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.211276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:55.211288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 928
2025-10-01T14:09:55.211411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.211435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:55.211442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:55.211445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:55.211852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 928 sessionId:  describe result for acl check
2025-10-01T14:09:55.211882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:55.211888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:55.211889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:55.211895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255346545735806:8405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:55.212332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255346545735806:8405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:55.216372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255346545735806:8405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:55.217503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:55.220099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:55.220263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:55.220273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:55.220284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:55.220333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:55.220364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255344168869216:7369]
2025-10-01T14:09:55.220445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255346545735806:8405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:55.220458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255346545735806:8405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:55.220461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255346545735806:8405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:55.220467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:55.220753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:55.220946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:55.220971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:55.221172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:55.221209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.221213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.221214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.221215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.221216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.221216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.221217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.221218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.221218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.221219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.221219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.221220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.221221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.221221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.221224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.221231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.221233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.221235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.221237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.221239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.221241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.221243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.221245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.221247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.221249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.221251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.221253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.221255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.221261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.221266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.221269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.221272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.221274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.221277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.221279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.221282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.221284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.221290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.221292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.221295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.221297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.221303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.221305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.221308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.221310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.221313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.221319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.221321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.221325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.221327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.221330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.221336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.221338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.221341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.221346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.221348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.221367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:55.224713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:55.225905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:55.225921Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:55.225923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:55.225926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:55.225932Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 927 [2:7556255344168869216:7369]
2025-10-01T14:09:55.225951Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:55.225970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:55.225977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:55.225981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:55.225988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:55.226004Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:55.226013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:55.226020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:55.226079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.226086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.226088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.226091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:55.226094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:55.226159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:55.226167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.226177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.226191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.226208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:55.226230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545735975:8405], now have 1 active actors on pipe
2025-10-01T14:09:55.226237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545735724:2446], now have 1 active actors on pipe
2025-10-01T14:09:55.226246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255344168869211:7369]
2025-10-01T14:09:55.226252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255344168869211:7369]
2025-10-01T14:09:55.226254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255344168869211:7369]
2025-10-01T14:09:55.226269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:55.226264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 927
2025-10-01T14:09:55.226265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 927
2025-10-01T14:09:55.226285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:55.226286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:55.226294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:55.226296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:55.226298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:55.226301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:55.226339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.226343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.226356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255344168869211:7369]
2025-10-01T14:09:55.226386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:55.226395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:55.226420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:55.226431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:55.226441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:55.226448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:55.226457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:55.226469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:55.226493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:55.226628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.226639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.226656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:55.226762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 928 partition: 0 MaxSeqNo: 45 sessionId: src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0
2025-10-01T14:09:55.227132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1c70-1546361f-cc5bc17-66e02df1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:55.229572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0] Write session: try to update token
2025-10-01T14:09:55.229588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:55.243305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 928 sessionId: src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:55.245983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:55.246018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:55.246039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:55.246041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:55.246043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:55.246054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255344168869211:7369]
2025-10-01T14:09:55.246060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255344168869211:7369]
2025-10-01T14:09:55.246064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255344168869211:7369]
2025-10-01T14:09:55.246110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:55.246121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.246128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:55.246118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:55.246148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:55.246153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:55.246257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:55.300375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255346545735992:8250]
2025-10-01T14:09:55.300587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 927, pipe: [1:7556255346545735992:8250]
2025-10-01T14:09:55.382655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:55.382881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.382896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.382931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545735992:8250], now have 1 active actors on pipe
2025-10-01T14:09:55.383082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:55.383159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:55.383171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:55.383181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:55.383221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 928 reason: error at write: Disconnected sessionId: src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0
2025-10-01T14:09:55.383232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255346545735992:8250]
2025-10-01T14:09:55.383387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 928 sessionId: src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0 is DEAD
2025-10-01T14:09:55.383485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:55.383493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0] Write session will restart in 0.006571s
2025-10-01T14:09:55.383511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0] Write session: Do CDS request
2025-10-01T14:09:55.383515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:55.391021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.391080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:55.391093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 929
2025-10-01T14:09:55.391245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.391279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:55.391286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:55.391288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:55.391637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 929 sessionId:  describe result for acl check
2025-10-01T14:09:55.391666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:55.391671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:55.391673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:55.391678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255346545736026:8410] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:55.392114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255346545736026:8410] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:55.394653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255346545736026:8410] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:55.397366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255346545736026:8410] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:55.397380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255346545736026:8410] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:55.397384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255346545736026:8410] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:55.397391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:55.399200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:55.401736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:55.401935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:55.401946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:55.401956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:55.402005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:55.402042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255344168869475:7371]
2025-10-01T14:09:55.402626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:55.402921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:55.402962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:55.403198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:55.403233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.403239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.403240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.403241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.403241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.403242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.403242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.403243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.403244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.403245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.403246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.403246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.403247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.403248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.403251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.403257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.403259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.403262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.403264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.403266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.403268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.403270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.403272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.403274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.403276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.403278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.403280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.403282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.403289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.403293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.403296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.403300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.403302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.403306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.403310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.403314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.403319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.403323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.403327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.403331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.403336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.403340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.403343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.403345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.403347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.403350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.403352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.403355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.403357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.403360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.403362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.403365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.403367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.403370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.403373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.403376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.403395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:55.407064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:55.407619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:55.407634Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:55.407637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:55.407639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:55.407644Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 928 [2:7556255344168869475:7371]
2025-10-01T14:09:55.407655Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:55.407667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:55.407669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:55.407672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:55.407673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:55.407685Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:55.407689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:55.407694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:55.407751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.407758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.407760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.407764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:55.407766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:55.407826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:55.407832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.407838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.407844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.407852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:55.407864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255344168869470:7371]
2025-10-01T14:09:55.407869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255344168869470:7371]
2025-10-01T14:09:55.407871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255344168869470:7371]
2025-10-01T14:09:55.407877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:55.407886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:55.407887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545735997:2446], now have 1 active actors on pipe
2025-10-01T14:09:55.407889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545736226:8410], now have 1 active actors on pipe
2025-10-01T14:09:55.407893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:55.407895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:55.407895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:55.407903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:55.407905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:55.407926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255344168869470:7371]
2025-10-01T14:09:55.407934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:55.407970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:55.407975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 928
2025-10-01T14:09:55.407979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 928
2025-10-01T14:09:55.408179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.408190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.408218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|505120a8-30e80100-ac859c54-29e6b70a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:55.408229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:55.408234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:55.408240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:55.408249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:55.408262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:55.408281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:55.408412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.408421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.408433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:55.408491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 929 partition: 0 MaxSeqNo: 45 sessionId: src_id|505120a8-30e80100-ac859c54-29e6b70a_0
2025-10-01T14:09:55.408820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5dc4891-37e2911e-bf4147bd-58a9771c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|505120a8-30e80100-ac859c54-29e6b70a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:55.411352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505120a8-30e80100-ac859c54-29e6b70a_0] Write session: try to update token
2025-10-01T14:09:55.411369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505120a8-30e80100-ac859c54-29e6b70a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:55.426556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 929 sessionId: src_id|505120a8-30e80100-ac859c54-29e6b70a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:55.427924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:55.427942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:55.427943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:55.427945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:55.427953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255344168869470:7371]
2025-10-01T14:09:55.427956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255344168869470:7371]
2025-10-01T14:09:55.427958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255344168869470:7371]
2025-10-01T14:09:55.428000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:55.428000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:55.428006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:55.428009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.428010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:55.428010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:55.428139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:55.428911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:55.483182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255346545736261:8250]
2025-10-01T14:09:55.483425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 928, pipe: [1:7556255346545736261:8250]
2025-10-01T14:09:55.578470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:55.578712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.578726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.578770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545736261:8250], now have 1 active actors on pipe
2025-10-01T14:09:55.578998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:55.579043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:55.579095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255346545736261:8250]
2025-10-01T14:09:55.579116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:55.579122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:55.579171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 929 reason: error at write: Disconnected sessionId: src_id|505120a8-30e80100-ac859c54-29e6b70a_0
2025-10-01T14:09:55.579399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 929 sessionId: src_id|505120a8-30e80100-ac859c54-29e6b70a_0 is DEAD
2025-10-01T14:09:55.579552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505120a8-30e80100-ac859c54-29e6b70a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:55.579560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505120a8-30e80100-ac859c54-29e6b70a_0] Write session will restart in 0.006692s
2025-10-01T14:09:55.579588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505120a8-30e80100-ac859c54-29e6b70a_0] Write session: Do CDS request
2025-10-01T14:09:55.579595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505120a8-30e80100-ac859c54-29e6b70a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:55.587939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|505120a8-30e80100-ac859c54-29e6b70a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.589635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:55.589656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 930
2025-10-01T14:09:55.589902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.589946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:55.589952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:55.589957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:55.590532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 930 sessionId:  describe result for acl check
2025-10-01T14:09:55.590567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:55.590569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:55.590571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:55.590576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255346545736359:8421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:55.591191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255346545736359:8421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:55.594782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255346545736359:8421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:55.596169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:55.598499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:55.598657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:55.598666Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:55.598678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:55.598723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:55.598761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255344168869750:7376]
2025-10-01T14:09:55.599235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:55.599285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255346545736359:8421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:55.599301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255346545736359:8421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:55.599304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255346545736359:8421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:55.599313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:55.599485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:55.599524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:55.599877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:55.599953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.599959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.599960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.599961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.599961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.599962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.599963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.599964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.599965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.599966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.599967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.599968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.599969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.599969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.599974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.599983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.599987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.599990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.599993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.599997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.600000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.600003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.600006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.600010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.600013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.600016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.600019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.600022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.600029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.600035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.600041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.600045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.600049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.600053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.600057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.600061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.600070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.600074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.600082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.600086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.600094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.600103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.600106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.600114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.600123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.600131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.600136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.600143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.600147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.600154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.600158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.600162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.600165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.600169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.600173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.600177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.600213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:55.603874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:55.604785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:55.604795Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:55.604797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:55.604801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:55.604808Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 929 [2:7556255344168869750:7376]
2025-10-01T14:09:55.604821Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:55.604838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:55.604841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:55.604845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:55.604847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:55.604863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:55.604869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:55.604882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:55.604943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.604951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.604953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.604956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:55.604958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:55.605024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:55.605031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.605043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.605058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.605076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:55.605103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545736539:8421], now have 1 active actors on pipe
2025-10-01T14:09:55.605111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545736288:2446], now have 1 active actors on pipe
2025-10-01T14:09:55.605118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255344168869745:7376]
2025-10-01T14:09:55.605124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255344168869745:7376]
2025-10-01T14:09:55.605126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255344168869745:7376]
2025-10-01T14:09:55.605139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:55.605157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:55.605158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:55.605166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:55.605168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:55.605171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:55.605173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:55.605208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.605217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.605235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255344168869745:7376]
2025-10-01T14:09:55.605245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:55.605266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:55.605275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffa1131b-4f293a1d-3e590581-924210af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:55.605283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:55.605293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:55.605295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:55.605305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:55.605319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:55.605341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:55.605480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.605488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.605503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:55.605128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 929
2025-10-01T14:09:55.605164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 929
2025-10-01T14:09:55.605576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 930 partition: 0 MaxSeqNo: 45 sessionId: src_id|ffa1131b-4f293a1d-3e590581-924210af_0
2025-10-01T14:09:55.605937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|505120a8-30e80100-ac859c54-29e6b70a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ffa1131b-4f293a1d-3e590581-924210af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:55.608398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa1131b-4f293a1d-3e590581-924210af_0] Write session: try to update token
2025-10-01T14:09:55.608417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa1131b-4f293a1d-3e590581-924210af_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:55.622231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 930 sessionId: src_id|ffa1131b-4f293a1d-3e590581-924210af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:55.624551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:55.625655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.625678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.625697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:55.625700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:55.625703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:55.625705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:55.625714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255344168869745:7376]
2025-10-01T14:09:55.625718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255344168869745:7376]
2025-10-01T14:09:55.625721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255344168869745:7376]
2025-10-01T14:09:55.625757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:55.625765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:55.625768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:55.625769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.625771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:55.625771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:55.625891Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:55.679267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255346545736550:8250]
2025-10-01T14:09:55.679600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 929, pipe: [1:7556255346545736550:8250]
2025-10-01T14:09:55.773310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:55.773723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:55.773801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545736550:8250], now have 1 active actors on pipe
2025-10-01T14:09:55.773847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:55.774109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255346545736550:8250]
2025-10-01T14:09:55.774134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:55.785288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:55.785305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:55.785329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 930 reason: error at write: Disconnected sessionId: src_id|ffa1131b-4f293a1d-3e590581-924210af_0
2025-10-01T14:09:55.785667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa1131b-4f293a1d-3e590581-924210af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:55.785681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa1131b-4f293a1d-3e590581-924210af_0] Write session will restart in 0.008414s
2025-10-01T14:09:55.785707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa1131b-4f293a1d-3e590581-924210af_0] Write session: Do CDS request
2025-10-01T14:09:55.785713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa1131b-4f293a1d-3e590581-924210af_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:55.785519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 930 sessionId: src_id|ffa1131b-4f293a1d-3e590581-924210af_0 is DEAD
2025-10-01T14:09:55.794972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa1131b-4f293a1d-3e590581-924210af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.795113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:55.795129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 931
2025-10-01T14:09:55.795227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.795247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:55.795250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:55.795254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:55.795843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 931 sessionId:  describe result for acl check
2025-10-01T14:09:55.795869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:55.795871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:55.795873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:55.795878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255346545736671:8427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:55.796378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255346545736671:8427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:55.799206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255346545736671:8427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:55.801948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255346545736671:8427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:55.801986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255346545736671:8427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:55.801989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255346545736671:8427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:55.801996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:55.807804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:55.811126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:55.811392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:55.811403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:55.811416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:55.811489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:55.811533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255344168870039:7389]
2025-10-01T14:09:55.812169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:55.812564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:55.812636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:55.812981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:55.813060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.813068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.813070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.813071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.813072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.813074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.813075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.813076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.813077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.813078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.813079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.813080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.813081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.813083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.813088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.813098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.813102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.813105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.813109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.813113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.813116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.813119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.813123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.813128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.813132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.813135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.813139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.813143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.813151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.813159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:55.813165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.813169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:55.813174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.813180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:55.813185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.813191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:55.813196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.813202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:55.813206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.813211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:55.813216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.813222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:55.813227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.813233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:55.813238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.813243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:55.813247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.813252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.813256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.813262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.813266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.813272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.813277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.813282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:55.813287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.813292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:55.813335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:55.817266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:55.818424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:55.818439Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:55.818441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:55.818445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:55.818452Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 930 [2:7556255344168870039:7389]
2025-10-01T14:09:55.818469Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:55.818488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:55.818491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:55.818494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:55.818497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:55.818515Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:55.818520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:55.818525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:55.818588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.818590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.818592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.818595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:55.818598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:55.818670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:55.818679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.818694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:55.818709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:55.818728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:55.818749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255344168870034:7389]
2025-10-01T14:09:55.818755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255344168870034:7389]
2025-10-01T14:09:55.818757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255344168870034:7389]
2025-10-01T14:09:55.818776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:55.818794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:55.818800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:55.818804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:55.818809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:55.818811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:55.818814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:55.818854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255344168870034:7389]
2025-10-01T14:09:55.818861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:55.818870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:55.818871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545736753:8427], now have 1 active actors on pipe
2025-10-01T14:09:55.818885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545736569:2446], now have 1 active actors on pipe
2025-10-01T14:09:55.818984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 930
2025-10-01T14:09:55.818991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 930
2025-10-01T14:09:55.819095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.819104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.819130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22413365-d2f71f65-f2ffb517-31918971_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:55.819140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:55.819145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:55.819151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:55.819160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:55.819172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:55.819189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:55.819410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.819418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.819433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:55.819538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 931 partition: 0 MaxSeqNo: 45 sessionId: src_id|22413365-d2f71f65-f2ffb517-31918971_0
2025-10-01T14:09:55.819982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa1131b-4f293a1d-3e590581-924210af_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|22413365-d2f71f65-f2ffb517-31918971_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:55.822603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22413365-d2f71f65-f2ffb517-31918971_0] Write session: try to update token
2025-10-01T14:09:55.822621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22413365-d2f71f65-f2ffb517-31918971_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:55.841563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:55.841583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:55.841586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:55.841588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:55.841598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255344168870034:7389]
2025-10-01T14:09:55.841603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255344168870034:7389]
2025-10-01T14:09:55.841607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255344168870034:7389]
2025-10-01T14:09:55.841649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:55.841659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:55.841660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:55.841664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:55.841666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:55.841669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:55.841799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:55.843078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 931 sessionId: src_id|22413365-d2f71f65-f2ffb517-31918971_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:55.845650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:55.874315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255346545736832:8250]
2025-10-01T14:09:55.874653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 930, pipe: [1:7556255346545736832:8250]
2025-10-01T14:09:55.981919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:55.982137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:55.982148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:55.982183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545736832:8250], now have 1 active actors on pipe
2025-10-01T14:09:55.982330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:55.982389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:55.982402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:55.982409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255346545736832:8250]
2025-10-01T14:09:55.982427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:55.982455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 931 reason: error at write: Disconnected sessionId: src_id|22413365-d2f71f65-f2ffb517-31918971_0
2025-10-01T14:09:55.982645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 931 sessionId: src_id|22413365-d2f71f65-f2ffb517-31918971_0 is DEAD
2025-10-01T14:09:55.982768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22413365-d2f71f65-f2ffb517-31918971_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:55.982776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22413365-d2f71f65-f2ffb517-31918971_0] Write session will restart in 0.007492s
2025-10-01T14:09:55.982802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22413365-d2f71f65-f2ffb517-31918971_0] Write session: Do CDS request
2025-10-01T14:09:55.982808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22413365-d2f71f65-f2ffb517-31918971_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:55.991948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22413365-d2f71f65-f2ffb517-31918971_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.991976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:55.991988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 932
2025-10-01T14:09:55.992122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:55.992152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:55.992161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:55.992164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:55.992454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 932 sessionId:  describe result for acl check
2025-10-01T14:09:55.992482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:55.992486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:55.992487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:55.992490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255346545736912:8431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:55.992899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255346545736912:8431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:55.995025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255346545736912:8431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:55.997352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255346545736912:8431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:55.997364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255346545736912:8431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:55.997368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255346545736912:8431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:55.997376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:55.998835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:56.001592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:56.001893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:56.001906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:56.001919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:56.001978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:56.002022Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255348463837597:7392]
2025-10-01T14:09:56.002649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:56.003018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:56.003073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:56.003372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:56.003433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.003439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.003440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.003441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.003442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.003443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.003444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.003446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.003447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.003448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.003449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.003450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.003451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.003453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.003458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.003468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.003472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.003476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.003479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.003482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.003485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.003489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.003492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.003497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.003500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.003503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.003506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.003510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.003517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.003524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.003530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.003554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.003563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.003567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.003576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.003581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.003585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.003594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.003598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.003603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.003612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.003617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.003627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.003634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.003642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.003647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.003654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.003658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.003662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.003666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.003675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.003680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.003688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.003693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.003698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.003702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.003741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:56.007217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:56.008182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:56.008203Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:56.008205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:56.008209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:56.008216Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 931 [2:7556255348463837597:7392]
2025-10-01T14:09:56.008234Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:56.008254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:56.008267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.008271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.008273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.008293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:56.008308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:56.008322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:56.008394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.008405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.008407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.008410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:56.008412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:56.008486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:56.008493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.008505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.008519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.008540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:56.008562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545737087:8431], now have 1 active actors on pipe
2025-10-01T14:09:56.008570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255346545736838:2446], now have 1 active actors on pipe
2025-10-01T14:09:56.008577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255344168870296:7392]
2025-10-01T14:09:56.008584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255344168870296:7392]
2025-10-01T14:09:56.008586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255344168870296:7392]
2025-10-01T14:09:56.008595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:56.008571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 931
2025-10-01T14:09:56.008603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:56.008574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 931
2025-10-01T14:09:56.008606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:56.008607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:56.008613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:56.008628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:56.008635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:56.008652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.008660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.008699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255344168870296:7392]
2025-10-01T14:09:56.008710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:56.008720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:56.008728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:56.008746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.008755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.008757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:56.008770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.008783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:56.008824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.008945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.008955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.008970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.009037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 932 partition: 0 MaxSeqNo: 45 sessionId: src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0
2025-10-01T14:09:56.009409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22413365-d2f71f65-f2ffb517-31918971_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:56.011561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0] Write session: try to update token
2025-10-01T14:09:56.011575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:56.024697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 932 sessionId: src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:56.024985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:56.025004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:56.025014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255344168870296:7392]
2025-10-01T14:09:56.025062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:56.025187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:56.025247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:56.025406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:56.025549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:56.025699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:56.025900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:56.025941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:56.026919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:56.027095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.027111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.027146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:56.027218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:56.039462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:56.039485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:56.039487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:56.039490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:56.039501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255344168870296:7392]
2025-10-01T14:09:56.039505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255344168870296:7392]
2025-10-01T14:09:56.039509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255344168870296:7392]
2025-10-01T14:09:56.039548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:56.039555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:56.039561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:56.039563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.039565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:56.039565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:56.039702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:56.082723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255350840704397:8250]
2025-10-01T14:09:56.083021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 931, pipe: [1:7556255350840704397:8250]
2025-10-01T14:09:56.182911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:56.189733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.189759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.189897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.189951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.190005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.190060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.190103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.190110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.190173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.190231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.190288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.190349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.190415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.190423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.190487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.190542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.190600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.190660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.190706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.190713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.190778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.190835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.190894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.190987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.191028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.191033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.191106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.191163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.191220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.191278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.191340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.191346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.191406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.191465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.191529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.191586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.191627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.191632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.191692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.191757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.191823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.191881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.191933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.191938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.191997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.192051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.192113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.192173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.192235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.192241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.192296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.192349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.192403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.192456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.192562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.192568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.192623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:56.192678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:56.192733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:56.192801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:56.192849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:56.192855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:56.192904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840704397:8250], now have 1 active actors on pipe
2025-10-01T14:09:56.193127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:56.193152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255350840704397:8250]
2025-10-01T14:09:56.193171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:56.193173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:56.193194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 932 reason: error at write: Disconnected sessionId: src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0
2025-10-01T14:09:56.193387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 932 sessionId: src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0 is DEAD
2025-10-01T14:09:56.193514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:56.193525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0] Write session will restart in 0.005099s
2025-10-01T14:09:56.193550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0] Write session: Do CDS request
2025-10-01T14:09:56.193556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:56.193858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:56.199876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:56.199957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:56.199971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 933
2025-10-01T14:09:56.200085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:56.200110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:56.200114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:56.200116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:56.200458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 933 sessionId:  describe result for acl check
2025-10-01T14:09:56.200486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:56.200492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:56.200494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:56.200497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255350840704415:8435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:56.201004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255350840704415:8435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:56.202922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255350840704415:8435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:56.206086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255350840704415:8435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:56.206099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255350840704415:8435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:56.206102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255350840704415:8435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:56.206110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:56.210366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:56.212719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:56.212919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:56.212930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:56.212941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:56.212991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:56.213030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255348463837858:7394]
2025-10-01T14:09:56.213548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:56.213802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:56.213843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:56.214078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:56.214120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.214125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.214126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.214126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.214127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.214128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.214129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.214130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.214130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.214131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.214132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.214132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.214133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.214133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.214137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.214150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.214153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.214155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.214157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.214159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.214161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.214164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.214166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.214168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.214170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.214172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.214174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.214176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.214182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.214187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.214191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.214194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.214197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.214200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.214204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.214206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.214209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.214211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.214214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.214216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.214219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.214221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.214223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.214226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.214229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.214232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.214234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.214237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.214239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.214241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.214243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.214246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.214248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.214251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.214253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.214256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.214276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:56.217760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:56.218437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:56.218448Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:56.218449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:56.218451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:56.218456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 932 [2:7556255348463837858:7394]
2025-10-01T14:09:56.218466Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:56.218478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:56.218479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.218481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.218483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.218494Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:56.218498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:56.218502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:56.218540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.218545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.218546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.218549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:56.218550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:56.218604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:56.218611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.218622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.218627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.218640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:56.218655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840704401:2446], now have 1 active actors on pipe
2025-10-01T14:09:56.218660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840704543:8435], now have 1 active actors on pipe
2025-10-01T14:09:56.218665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255348463837853:7394]
2025-10-01T14:09:56.218667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255348463837853:7394]
2025-10-01T14:09:56.218668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255348463837853:7394]
2025-10-01T14:09:56.218677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:56.218690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 932
2025-10-01T14:09:56.218708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 932
2025-10-01T14:09:56.218693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:56.218701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:56.218703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:56.218704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:56.218709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:56.218712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:56.218746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255348463837853:7394]
2025-10-01T14:09:56.218756Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:56.218759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:56.218770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.218778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.218821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:56.218830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.218834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.218836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:56.218845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.218856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:56.218872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.219007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.219014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.219026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.219103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 933 partition: 0 MaxSeqNo: 45 sessionId: src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0
2025-10-01T14:09:56.219613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|955226ac-cdeec09b-bf2ceeae-afea77e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:56.222054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0] Write session: try to update token
2025-10-01T14:09:56.222072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:56.235157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 933 sessionId: src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:56.237390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:56.237810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.237833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.237849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:56.237851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:56.237853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:56.237854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:56.237860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255348463837853:7394]
2025-10-01T14:09:56.237864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255348463837853:7394]
2025-10-01T14:09:56.237868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255348463837853:7394]
2025-10-01T14:09:56.237913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:56.237919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:56.237924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:56.237925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.237926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:56.237927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:56.238047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:56.293141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255350840704674:8250]
2025-10-01T14:09:56.293352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 932, pipe: [1:7556255350840704674:8250]
2025-10-01T14:09:56.382863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:56.383157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:56.383210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840704674:8250], now have 1 active actors on pipe
2025-10-01T14:09:56.383331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:56.383422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:56.383486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255350840704674:8250]
2025-10-01T14:09:56.394082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:56.394095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:56.394120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 933 reason: error at write: Disconnected sessionId: src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0
2025-10-01T14:09:56.394294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 933 sessionId: src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0 is DEAD
2025-10-01T14:09:56.394444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:56.394456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0] Write session will restart in 0.009180s
2025-10-01T14:09:56.394482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0] Write session: Do CDS request
2025-10-01T14:09:56.394492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:56.403861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:56.404940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:56.405147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:56.405162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 934
2025-10-01T14:09:56.405294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:56.405338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:56.405347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:56.405350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:56.405771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 934 sessionId:  describe result for acl check
2025-10-01T14:09:56.405805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:56.405812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:56.405814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:56.405819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255350840704902:8440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:56.406298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255350840704902:8440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:56.406565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:56.406753Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:56.406763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:56.406773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:56.406816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:56.406852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255348463838120:7396]
2025-10-01T14:09:56.407385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:56.407588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:56.407626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:56.407891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:56.407941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.407947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.407948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.407949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.407950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.407951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.407952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.407953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.407954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.407955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.407956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.407957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.407958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.407959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.407964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.407972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.407976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.407979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.407982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.407986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.407989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.407992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.407996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.407999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.408003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.408006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.408009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.408012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.408018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.408025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.408030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.408039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.408042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.408051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.408058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.408065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.408073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.408077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.408081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.408086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.408090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.408094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.408101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.408105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.408109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.408114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.408119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.408123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.408128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.408137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.408140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.408145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.408152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.408156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.408159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.408163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.408190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255350840704902:8440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:56.408203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:56.411328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255350840704902:8440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:56.411341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255350840704902:8440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:56.411344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255350840704902:8440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:56.411352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:56.411567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:56.412312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:56.412325Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:56.412328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:56.412331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:56.412337Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 933 [2:7556255348463838120:7396]
2025-10-01T14:09:56.412350Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:56.412365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:56.412372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.412376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.412378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.412392Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:56.412398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:56.412403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:56.412455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.412462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.412464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.412467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:56.412470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:56.412534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:56.412541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.412552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.412561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.412579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:56.412611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840704679:2446], now have 1 active actors on pipe
2025-10-01T14:09:56.412618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840704940:8440], now have 1 active actors on pipe
2025-10-01T14:09:56.412626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255348463838115:7396]
2025-10-01T14:09:56.412628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255348463838115:7396]
2025-10-01T14:09:56.412630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255348463838115:7396]
2025-10-01T14:09:56.412639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:56.412621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 933
2025-10-01T14:09:56.412625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 933
2025-10-01T14:09:56.412656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:56.412657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:56.412659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:56.412661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:56.412673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:56.412676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:56.412716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.412723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.412747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255348463838115:7396]
2025-10-01T14:09:56.412758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:56.412779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:56.412787Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:56.412794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.412798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.412804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:56.412812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.412824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:56.412847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.412957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.412963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.412978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.413075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 934 partition: 0 MaxSeqNo: 45 sessionId: src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0
2025-10-01T14:09:56.413479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629b03b7-d062e835-de2ab5ec-5719c4ee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:56.416134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0] Write session: try to update token
2025-10-01T14:09:56.416151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:56.430222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 934 sessionId: src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:56.443890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:56.443904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:56.443906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:56.443908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:56.443916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255348463838115:7396]
2025-10-01T14:09:56.443919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255348463838115:7396]
2025-10-01T14:09:56.443922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255348463838115:7396]
2025-10-01T14:09:56.443982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:56.443989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:56.443994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:56.444765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:56.444782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.444784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:56.444922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:56.445645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:56.483590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255350840704949:8250]
2025-10-01T14:09:56.483835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 933, pipe: [1:7556255350840704949:8250]
2025-10-01T14:09:56.589485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:56.589728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:56.589737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:56.589748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255348463838115:7396]
2025-10-01T14:09:56.589814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.589816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:56.589827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.589847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840704949:8250], now have 1 active actors on pipe
2025-10-01T14:09:56.590139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:56.590085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:56.590098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:56.590162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 934 reason: error at write: Disconnected sessionId: src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0
2025-10-01T14:09:56.590384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 934 sessionId: src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0 is DEAD
2025-10-01T14:09:56.590508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:56.590550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:56.590557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0] Write session will restart in 0.006820s
2025-10-01T14:09:56.590559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255350840704949:8250]
2025-10-01T14:09:56.590582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0] Write session: Do CDS request
2025-10-01T14:09:56.590589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:56.598883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:56.599724Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:56.599744Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 935
2025-10-01T14:09:56.599850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:56.599882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:56.599886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:56.599890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:56.600233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 935 sessionId:  describe result for acl check
2025-10-01T14:09:56.600263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:56.600271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:56.600272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:56.600277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255350840704984:8450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:56.600709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255350840704984:8450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:56.603514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255350840704984:8450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:56.606153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255350840704984:8450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:56.606168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255350840704984:8450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:56.606170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255350840704984:8450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:56.606178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:56.614122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:56.615043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:56.615322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:56.615333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:56.615347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:56.615427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:56.615467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255348463838402:7400]
2025-10-01T14:09:56.616039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:56.616343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:56.616396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:56.616757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:56.616821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.616827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.616828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.616829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.616831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.616832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.616833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.616834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.616835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.616836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.616837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.616838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.616839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.616840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.616845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.616855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.616859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.616863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.616866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.616870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.616873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.616877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.616880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.616884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.616888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.616891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.616895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.616899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.616905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.616913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.616920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.616929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.616933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.616938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.616940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.616943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.616946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.616953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.616955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.616958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.616961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.616964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.616966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.616969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.616971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.616974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.616976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.616979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.616981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.616984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.616986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.616988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.616991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.616993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.616995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.616999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.617035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:56.621075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:56.622022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:56.622038Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:56.622041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:56.622044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:56.622051Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 934 [2:7556255348463838402:7400]
2025-10-01T14:09:56.622067Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:56.622084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:56.622092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.622096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.622098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.622116Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:56.622126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:56.622132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:56.622188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.622195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.622196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.622200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:56.622202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:56.622289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:56.622297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.622308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.622322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.622348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:56.622390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840704967:2446], now have 1 active actors on pipe
2025-10-01T14:09:56.622399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840705232:8450], now have 1 active actors on pipe
2025-10-01T14:09:56.622407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255348463838397:7400]
2025-10-01T14:09:56.622409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255348463838397:7400]
2025-10-01T14:09:56.622411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255348463838397:7400]
2025-10-01T14:09:56.622426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:56.622439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:56.622445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:56.622449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:56.622451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:56.622463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:56.622472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:56.622505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255348463838397:7400]
2025-10-01T14:09:56.622514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:56.622539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:56.622786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.622799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.622829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:56.622837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.622841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.622843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:56.622852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.622862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:56.622876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.622426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 934
2025-10-01T14:09:56.622470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 934
2025-10-01T14:09:56.623106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.623118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.623140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.623233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 935 partition: 0 MaxSeqNo: 45 sessionId: src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0
2025-10-01T14:09:56.623617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217550a2-b84e5917-a95e1d6-1a499e6c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:56.625888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0] Write session: try to update token
2025-10-01T14:09:56.625904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:56.642231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 935 sessionId: src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:56.643576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:56.643598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:56.643601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:56.643603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:56.643613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255348463838397:7400]
2025-10-01T14:09:56.643618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255348463838397:7400]
2025-10-01T14:09:56.643621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255348463838397:7400]
2025-10-01T14:09:56.643666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:56.643672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:56.643672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:56.643676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:56.643680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.643683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:56.643858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:56.644683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:56.690464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255350840705455:8250]
2025-10-01T14:09:56.695042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 934, pipe: [1:7556255350840705455:8250]
2025-10-01T14:09:56.801929Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:56.802163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.802177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.802215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840705455:8250], now have 1 active actors on pipe
2025-10-01T14:09:56.802439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:56.802800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:56.807144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255350840705455:8250]
2025-10-01T14:09:56.807171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:56.807234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 935 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0
2025-10-01T14:09:56.807435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 935 sessionId: src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0 is DEAD
2025-10-01T14:09:56.807756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:56.807765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0] Write session will restart in 0.006110s
2025-10-01T14:09:56.807784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0] Write session: Do CDS request
2025-10-01T14:09:56.807789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:56.814966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:56.815059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:56.815075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 936
2025-10-01T14:09:56.815192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:56.815225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:56.815235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:56.815238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:56.815575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 936 sessionId:  describe result for acl check
2025-10-01T14:09:56.815608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:56.815614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:56.815616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:56.815622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255350840705562:8457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:56.816114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255350840705562:8457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:56.823690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:56.823779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255350840705562:8457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:56.824475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:56.824661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:56.824671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:56.824682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:56.824725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:56.824772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255348463838694:7414]
2025-10-01T14:09:56.825313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:56.825560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:56.825599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:56.825902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:56.826010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.826017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.826019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.826020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.826021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.826022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.826022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.826023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.826024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.826026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.826027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.826027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.826028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.826029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.826034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.826044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.826047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.826051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.826054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.826057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.826060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.826063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.826067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.826070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.826073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.826077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.826084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.826088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.826099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.826106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:56.826115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.826124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:56.826131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.826139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:56.826147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.826151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:56.826155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.826160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:56.826163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.826167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:56.826172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.826181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:56.826184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.826189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:56.826192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.826197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:56.826201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.826208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.826212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.826220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.826225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.826229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.826236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.826241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:56.826248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.826252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:56.826280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255350840705562:8457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:56.826295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255350840705562:8457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:56.826298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255350840705562:8457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:56.826303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:56.826309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:56.829797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:56.830405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:56.830418Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:56.830421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:56.830424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:56.830431Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 935 [2:7556255348463838694:7414]
2025-10-01T14:09:56.830446Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:56.830462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:56.830465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.830468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.830471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.830487Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:56.830497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:56.830503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:56.830558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.830565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.830568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.830570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:56.830573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:56.830644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:56.830651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.830662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:56.830678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:56.830699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:56.830720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840705475:2446], now have 1 active actors on pipe
2025-10-01T14:09:56.830727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840705940:8457], now have 1 active actors on pipe
2025-10-01T14:09:56.830734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255348463838689:7414]
2025-10-01T14:09:56.830740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255348463838689:7414]
2025-10-01T14:09:56.830743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255348463838689:7414]
2025-10-01T14:09:56.830755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:56.830770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:56.830748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 935
2025-10-01T14:09:56.830773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:56.830773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:56.830775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:56.830786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:56.830790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 935
2025-10-01T14:09:56.830789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:56.830818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255348463838689:7414]
2025-10-01T14:09:56.830825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:56.830831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:56.830847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.830856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.831101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:56.831112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:56.831116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:56.831121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:56.831129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:56.831141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:56.831160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.831313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.831320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.831333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:56.831415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 936 partition: 0 MaxSeqNo: 45 sessionId: src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0
2025-10-01T14:09:56.831748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e67bf0cd-ae5b8445-ed340780-19da36d5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:56.834131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0] Write session: try to update token
2025-10-01T14:09:56.834148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:56.847777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 936 sessionId: src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:56.850160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:56.850956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:56.850983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:56.851005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:56.851013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:56.851015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:56.851016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:56.851029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255348463838689:7414]
2025-10-01T14:09:56.851037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255348463838689:7414]
2025-10-01T14:09:56.851041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255348463838689:7414]
2025-10-01T14:09:56.851085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:56.851097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:56.851098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:56.851102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:56.851104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:56.851106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:56.851240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:56.907558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255350840705949:8250]
2025-10-01T14:09:56.907773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 935, pipe: [1:7556255350840705949:8250]
2025-10-01T14:09:56.990838Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:56.991271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:56.991332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840705949:8250], now have 1 active actors on pipe
2025-10-01T14:09:56.991384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:56.991554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255350840705949:8250]
2025-10-01T14:09:56.991584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:57.001548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:57.001563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:57.001586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 936 reason: error at write: Disconnected sessionId: src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0
2025-10-01T14:09:57.001726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 936 sessionId: src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0 is DEAD
2025-10-01T14:09:57.001892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:57.001903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0] Write session will restart in 0.008883s
2025-10-01T14:09:57.001926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0] Write session: Do CDS request
2025-10-01T14:09:57.001935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:57.011833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.012119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:57.012134Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 937
2025-10-01T14:09:57.012257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.012288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:57.012297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:57.012301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:57.012554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:57.012671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 937 sessionId:  describe result for acl check
2025-10-01T14:09:57.012703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:57.012709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:57.012711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:57.012716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255355135673682:8461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:57.013234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255355135673682:8461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:57.013305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:57.013488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:57.013497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:57.013507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:57.013549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:57.013586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255352758806257:7417]
2025-10-01T14:09:57.014125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:57.014355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:57.014407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:57.014687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:57.014742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.014748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.014749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.014750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.014751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.014752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.014753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.014754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.014755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.014756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.014757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.014758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.014759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.014759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.014764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.014773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.014777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.014780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.014784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.014788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.014792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.014795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.014798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.014804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.014807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.014810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.014814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.014817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.014827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.014834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.014839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.014844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.014849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.014854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.014858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.014863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.014868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.014872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.014876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.014881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.014885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.014890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.014894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.014899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.014903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.014908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.014912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.014916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.014921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.014926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.014930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.014935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.014939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.014945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.014955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.014960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.014999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:57.015964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255355135673682:8461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:57.018578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:57.018795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255355135673682:8461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:57.018811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255355135673682:8461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:57.018814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255355135673682:8461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:57.018824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:57.019339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:57.019352Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:57.019355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:57.019357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:57.019364Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 936 [2:7556255352758806257:7417]
2025-10-01T14:09:57.019377Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:57.019397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:57.019405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.019408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.019410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.019425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:57.019430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:57.019436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:57.019486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.019493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.019496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.019498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:57.019501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:57.019565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:57.019572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.019583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.019595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.019615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:57.019637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135673717:8461], now have 1 active actors on pipe
2025-10-01T14:09:57.019644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255350840705954:2446], now have 1 active actors on pipe
2025-10-01T14:09:57.019651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255352758806252:7417]
2025-10-01T14:09:57.019653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255352758806252:7417]
2025-10-01T14:09:57.019655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255352758806252:7417]
2025-10-01T14:09:57.019656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 936
2025-10-01T14:09:57.019668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:57.019657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 936
2025-10-01T14:09:57.019684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:57.019687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:57.019689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:57.019691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:57.019697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:57.019700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:57.019735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.019746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.019762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255352758806252:7417]
2025-10-01T14:09:57.019768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:57.019775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:57.019790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f72b814a-5fd55718-8979539d-bb62b05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:57.019796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.019800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.019802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:57.019810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.019818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:57.019841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.019963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.019970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.019982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.020033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 937 partition: 0 MaxSeqNo: 45 sessionId: src_id|f72b814a-5fd55718-8979539d-bb62b05_0
2025-10-01T14:09:57.020412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a786c9a-5027bfe0-dce76ac7-37423cd0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f72b814a-5fd55718-8979539d-bb62b05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:57.022633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f72b814a-5fd55718-8979539d-bb62b05_0] Write session: try to update token
2025-10-01T14:09:57.022647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f72b814a-5fd55718-8979539d-bb62b05_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:57.035806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 937 sessionId: src_id|f72b814a-5fd55718-8979539d-bb62b05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:57.038355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:57.039795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.039822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.039844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:57.039847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:57.039849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:57.039851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:57.039859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255352758806252:7417]
2025-10-01T14:09:57.039865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255352758806252:7417]
2025-10-01T14:09:57.039869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255352758806252:7417]
2025-10-01T14:09:57.039916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:57.039917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:57.039922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:57.039926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:57.039927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.039930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:57.040058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:57.091884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255355135673728:8250]
2025-10-01T14:09:57.092157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 936, pipe: [1:7556255355135673728:8250]
2025-10-01T14:09:57.191387Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:57.191838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:57.191899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135673728:8250], now have 1 active actors on pipe
2025-10-01T14:09:57.191977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:57.192087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255355135673728:8250]
2025-10-01T14:09:57.192117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:57.203343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:57.203357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:57.203378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 937 reason: error at write: Disconnected sessionId: src_id|f72b814a-5fd55718-8979539d-bb62b05_0
2025-10-01T14:09:57.203564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 937 sessionId: src_id|f72b814a-5fd55718-8979539d-bb62b05_0 is DEAD
2025-10-01T14:09:57.203722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72b814a-5fd55718-8979539d-bb62b05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:57.203733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72b814a-5fd55718-8979539d-bb62b05_0] Write session will restart in 0.009713s
2025-10-01T14:09:57.203759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72b814a-5fd55718-8979539d-bb62b05_0] Write session: Do CDS request
2025-10-01T14:09:57.203769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72b814a-5fd55718-8979539d-bb62b05_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:57.214730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:57.214989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f72b814a-5fd55718-8979539d-bb62b05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.215043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:57.215057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 938
2025-10-01T14:09:57.215200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.215230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:57.215240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:57.215244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:57.215651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 938 sessionId:  describe result for acl check
2025-10-01T14:09:57.215667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:57.215696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:57.215702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:57.215705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:57.215710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255355135674165:8467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:57.215827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:57.215838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:57.215849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:57.215892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:57.215926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255352758806522:7419]
2025-10-01T14:09:57.216200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255355135674165:8467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:57.216617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:57.216888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:57.216932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:57.217253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:57.217307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.217312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.217313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.217314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.217316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.217317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.217318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.217319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.217320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.217321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.217322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.217323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.217324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.217325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.217331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.217340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.217344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.217348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.217351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.217356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.217359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.217363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.217366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.217370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.217374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.217377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.217381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.217384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.217392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.217403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.217413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.217418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.217426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.217430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.217438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.217443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.217452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.217457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.217465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.217470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.217478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.217484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.217492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.217497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.217501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.217512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.217520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.217525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.217533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.217537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.217547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.217551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.217559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.217565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.217572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.217577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.217617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:57.218781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255355135674165:8467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:57.221404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:57.221500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255355135674165:8467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:57.221518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255355135674165:8467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:57.221522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255355135674165:8467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:57.221531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:57.222441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:57.222459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:57.222462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:57.222466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:57.222472Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 937 [2:7556255352758806522:7419]
2025-10-01T14:09:57.222489Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:57.222508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:57.222517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.222521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.222523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.222541Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:57.222555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:57.222562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:57.222626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.222636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.222639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.222642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:57.222645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:57.222720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:57.222731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.222744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.222754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.222768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:57.222794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135674216:8467], now have 1 active actors on pipe
2025-10-01T14:09:57.222804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135673731:2446], now have 1 active actors on pipe
2025-10-01T14:09:57.222812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255352758806517:7419]
2025-10-01T14:09:57.222806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 937
2025-10-01T14:09:57.222820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255352758806517:7419]
2025-10-01T14:09:57.222809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 937
2025-10-01T14:09:57.222822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255352758806517:7419]
2025-10-01T14:09:57.222833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:57.222846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:57.222852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:57.222854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:57.222857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:57.222866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:57.222870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:57.222889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.222895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.222951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255352758806517:7419]
2025-10-01T14:09:57.222967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:57.222972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:57.222990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fde5f2c9-12729349-3802a099-cabd622e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:57.223003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.223014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.223016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:57.223028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.223044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:57.223090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.223249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.223266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.223285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.223391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 938 partition: 0 MaxSeqNo: 45 sessionId: src_id|fde5f2c9-12729349-3802a099-cabd622e_0
2025-10-01T14:09:57.223806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f72b814a-5fd55718-8979539d-bb62b05_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fde5f2c9-12729349-3802a099-cabd622e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:57.226289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fde5f2c9-12729349-3802a099-cabd622e_0] Write session: try to update token
2025-10-01T14:09:57.226308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fde5f2c9-12729349-3802a099-cabd622e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:57.240548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 938 sessionId: src_id|fde5f2c9-12729349-3802a099-cabd622e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:57.242990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:57.243203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.243224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.243265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:57.243355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:57.245760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:57.245779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:57.245781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:57.245782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:57.245789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255352758806517:7419]
2025-10-01T14:09:57.245791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255352758806517:7419]
2025-10-01T14:09:57.245794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255352758806517:7419]
2025-10-01T14:09:57.245838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:57.245843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:57.245845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.245847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:57.245854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:57.245856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:57.246012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:57.292052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255355135674229:8250]
2025-10-01T14:09:57.292295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 937, pipe: [1:7556255355135674229:8250]
2025-10-01T14:09:57.392202Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:57.398873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.398903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.399089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.399159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.399231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.399296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.399532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.399544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.399623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.399688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.399771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.399877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.399923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.399931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.399992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.400052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.400146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.400208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.400253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.400260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.400321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.400382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.400448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.400510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.400555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.400563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.400625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.400681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.400747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.400806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.400850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.400857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.400919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.400980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.401083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.401187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.401234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.401241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.401307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.401365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.401429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.401488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.401531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.401540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.401598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.401650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.401701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.401754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.401794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.401798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.401857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.401912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.401968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.402022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.402061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.402066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.402121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.402176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.402229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.402339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.402408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.402412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.402449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135674229:8250], now have 1 active actors on pipe
2025-10-01T14:09:57.402711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255355135674229:8250]
2025-10-01T14:09:57.402712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:57.402716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:57.402740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 938 reason: error at write: Disconnected sessionId: src_id|fde5f2c9-12729349-3802a099-cabd622e_0
2025-10-01T14:09:57.402753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:57.402968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 938 sessionId: src_id|fde5f2c9-12729349-3802a099-cabd622e_0 is DEAD
2025-10-01T14:09:57.403083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde5f2c9-12729349-3802a099-cabd622e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:57.403092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde5f2c9-12729349-3802a099-cabd622e_0] Write session will restart in 0.005805s
2025-10-01T14:09:57.403115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde5f2c9-12729349-3802a099-cabd622e_0] Write session: Do CDS request
2025-10-01T14:09:57.403121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde5f2c9-12729349-3802a099-cabd622e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:57.403165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:57.409860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fde5f2c9-12729349-3802a099-cabd622e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.409897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:57.409908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 939
2025-10-01T14:09:57.410247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.410270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:57.410274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:57.410277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:57.410585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 939 sessionId:  describe result for acl check
2025-10-01T14:09:57.410609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:57.410610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:57.410611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:57.410614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255355135674357:8472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:57.411014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255355135674357:8472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:57.412969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255355135674357:8472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:57.415108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255355135674357:8472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:57.415121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255355135674357:8472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:57.415125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255355135674357:8472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:57.415134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:57.417839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:57.418536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:57.418703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:57.418713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:57.418723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:57.418770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:57.418808Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255352758806791:7422]
2025-10-01T14:09:57.419405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:57.419662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:57.419691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:57.419892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:57.419927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.419931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.419931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.419932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.419933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.419934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.419934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.419935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.419935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.419936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.419936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.419937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.419938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.419938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.419941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.419947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.419949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.419952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.419954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.419956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.419958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.419960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.419962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.419965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.419967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.419969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.419971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.419973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.419978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.419982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.419985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.419988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.419991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.419994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.419996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.419999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.420001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.420004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.420007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.420009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.420012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.420015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.420017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.420020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.420022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.420025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.420028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.420030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.420034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.420037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.420039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.420042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.420044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.420047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.420049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.420051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.420073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:57.423487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:57.424310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:57.424320Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:57.424322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:57.424325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:57.424330Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 938 [2:7556255352758806791:7422]
2025-10-01T14:09:57.424342Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:57.424359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:57.424364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.424366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.424367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.424380Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:57.424383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:57.424388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:57.424430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.424435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.424436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.424438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:57.424440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:57.424491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:57.424498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.424505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.424510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.424523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:57.424540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135674234:2446], now have 1 active actors on pipe
2025-10-01T14:09:57.424543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135674641:8472], now have 1 active actors on pipe
2025-10-01T14:09:57.424550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255352758806786:7422]
2025-10-01T14:09:57.424555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255352758806786:7422]
2025-10-01T14:09:57.424556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255352758806786:7422]
2025-10-01T14:09:57.424566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:57.424574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:57.424576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:57.424577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:57.424578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:57.424586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:57.424588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:57.424619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255352758806786:7422]
2025-10-01T14:09:57.424629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:57.424641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:57.424630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 938
2025-10-01T14:09:57.424634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 938
2025-10-01T14:09:57.424669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.424676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.424693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:57.424701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.424708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.424711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:57.424720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.424731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:57.424760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.424900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.424908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.424918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.425015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 939 partition: 0 MaxSeqNo: 45 sessionId: src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0
2025-10-01T14:09:57.425340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fde5f2c9-12729349-3802a099-cabd622e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:57.427545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0] Write session: try to update token
2025-10-01T14:09:57.427559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:57.441527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 939 sessionId: src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:57.444022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:57.444046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:57.444048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:57.444063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:57.444051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:57.444061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255352758806786:7422]
2025-10-01T14:09:57.444068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255352758806786:7422]
2025-10-01T14:09:57.444072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255352758806786:7422]
2025-10-01T14:09:57.444118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:57.444126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:57.444129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.444130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:57.444131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:57.444133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:57.444257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:57.503003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255355135674716:8250]
2025-10-01T14:09:57.503276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 938, pipe: [1:7556255355135674716:8250]
2025-10-01T14:09:57.587800Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:57.588249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.588264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.588302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135674716:8250], now have 1 active actors on pipe
2025-10-01T14:09:57.588454Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:57.588567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:57.588581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255355135674716:8250]
2025-10-01T14:09:57.588602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:57.588665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 939 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0
2025-10-01T14:09:57.588921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 939 sessionId: src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0 is DEAD
2025-10-01T14:09:57.589045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:09:57.589057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0] Write session will restart in 0.008728s
2025-10-01T14:09:57.589086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0] Write session: Do CDS request
2025-10-01T14:09:57.589091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:57.598979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.599064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:57.599079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 940
2025-10-01T14:09:57.599202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.599235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:57.599244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:57.599247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:57.599668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 940 sessionId:  describe result for acl check
2025-10-01T14:09:57.599699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:57.599705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:57.599707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:57.599712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255355135674801:8476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:57.600221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255355135674801:8476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:57.602281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255355135674801:8476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:57.605107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255355135674801:8476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:57.605124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255355135674801:8476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:57.605127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255355135674801:8476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:57.605136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:57.610579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:57.611412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:57.611581Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:57.611590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:57.611598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:57.611630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:57.611657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255352758807070:7424]
2025-10-01T14:09:57.612052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:57.612295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:57.612323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:57.612528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:57.612574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.612578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.612579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.612580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.612581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.612581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.612582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.612582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.612583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.612584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.612584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.612585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.612586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.612587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.612592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.612600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.612604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.612609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.612612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.612616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.612620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.612623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.612625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.612627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.612629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.612631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.612633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.612635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.612639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.612644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.612648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.612650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.612653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.612656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.612658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.612661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.612665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.612668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.612670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.612673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.612676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.612678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.612681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.612683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.612686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.612689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.612692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.612696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.612698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.612701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.612703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.612705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.612707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.612710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.612712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.612715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.612745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:57.616284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:57.616970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:57.616983Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:57.616985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:57.616988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:57.616992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 939 [2:7556255352758807070:7424]
2025-10-01T14:09:57.617003Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:57.617017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:57.617019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.617022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.617024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.617041Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:57.617053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:57.617058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:57.617125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.617132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.617134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.617137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:57.617139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:57.617198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:57.617206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.617215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.617220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.617229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:57.617242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135674718:2446], now have 1 active actors on pipe
2025-10-01T14:09:57.617244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135675031:8476], now have 1 active actors on pipe
2025-10-01T14:09:57.617249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255352758807065:7424]
2025-10-01T14:09:57.617251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255352758807065:7424]
2025-10-01T14:09:57.617252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255352758807065:7424]
2025-10-01T14:09:57.617261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:57.617273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:57.617273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:57.617276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:57.617278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:57.617281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:57.617282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:57.617301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255352758807065:7424]
2025-10-01T14:09:57.617309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:57.617315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:57.617463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 939
2025-10-01T14:09:57.617500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 939
2025-10-01T14:09:57.617588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.617598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.617622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:57.617633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.617641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.617644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:57.617653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.617666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:57.617683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.617923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.617930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.617941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.618063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 940 partition: 0 MaxSeqNo: 45 sessionId: src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0
2025-10-01T14:09:57.618479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5d5500b-ee83976c-e1aef712-355b26ca_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:57.621268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0] Write session: try to update token
2025-10-01T14:09:57.621286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:57.627964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:57.627988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:57.628000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255352758807065:7424]
2025-10-01T14:09:57.628043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:57.628046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:57.628226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:57.628385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:57.628533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:57.628681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:57.628882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:57.628922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:57.636255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 940 sessionId: src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:57.638968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:57.639688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.639709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.639746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:57.639820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:57.647875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:57.647898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:57.647900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:57.647902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:57.647915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255352758807065:7424]
2025-10-01T14:09:57.647919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255352758807065:7424]
2025-10-01T14:09:57.647922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255352758807065:7424]
2025-10-01T14:09:57.647971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:57.647976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:57.647982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.647984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:57.647987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:57.647990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:57.648137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:57.688870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255355135675222:8250]
2025-10-01T14:09:57.689180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 939, pipe: [1:7556255355135675222:8250]
2025-10-01T14:09:57.793674Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:57.802014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.802041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.802182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.802249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.802315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.802411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.802458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.802468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.802538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.802604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.802672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.802738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.802783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.802791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.802862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.802930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.802997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.803064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.803113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.803121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.803195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.803507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.803583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.803652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.803757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.803765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.803836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.803901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.803975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.804043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.804090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.804097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.804171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.804241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.804313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.804387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.804429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.804435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.804498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.804555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.804613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.804674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.804719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.804726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.804807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.804867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.804930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.804988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.805028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.805033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.805094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.805154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.805212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.805274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.805359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.805364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.805436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:57.805495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:57.805552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:57.805609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:57.805654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:57.805660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:57.805705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135675222:8250], now have 1 active actors on pipe
2025-10-01T14:09:57.805927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:57.805930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:57.805942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:57.805969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255355135675222:8250]
2025-10-01T14:09:57.805985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 940 reason: error at write: Disconnected sessionId: src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0
2025-10-01T14:09:57.806214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 940 sessionId: src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0 is DEAD
2025-10-01T14:09:57.806408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:57.806419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0] Write session will restart in 0.005023s
2025-10-01T14:09:57.806444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0] Write session: Do CDS request
2025-10-01T14:09:57.806450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:57.806456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:57.812882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.812952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:57.812965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 941
2025-10-01T14:09:57.813097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:57.813136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:57.813149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:57.813152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:57.813572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 941 sessionId:  describe result for acl check
2025-10-01T14:09:57.813604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:57.813609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:57.813611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:57.813615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255355135675308:8489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:57.814095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255355135675308:8489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:57.816489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255355135675308:8489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:57.818711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255355135675308:8489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:57.818725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255355135675308:8489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:57.818728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255355135675308:8489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:57.818734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:57.822300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:57.823531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:57.823687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:57.823696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:57.823707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:57.823748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:57.823777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255352758807359:7435]
2025-10-01T14:09:57.824179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:57.824411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:57.824437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:57.824622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:57.824653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.824657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.824658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.824659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.824659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.824660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.824660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.824661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.824662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.824662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.824663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.824663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.824664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.824664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.824667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.824673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.824675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.824677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.824679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.824681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.824683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.824685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.824687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.824689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.824691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.824693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.824695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.824698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.824702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.824706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:57.824710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.824712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:57.824715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.824718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:57.824720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.824722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:57.824724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.824727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:57.824729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.824732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:57.824745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.824750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:57.824754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.824758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:57.824762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.824766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:57.824770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.824779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.824786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.824788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.824790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.824793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.824798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.824800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:57.824802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.824805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:57.824827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:57.828291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:57.829087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:57.829103Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:57.829105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:57.829108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:57.829116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 940 [2:7556255352758807359:7435]
2025-10-01T14:09:57.829131Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:57.829147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:57.829154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.829157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.829159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.829174Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:57.829178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:57.829187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:57.829238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.829245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.829247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.829249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:57.829253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:57.829327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:57.829335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.829346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:57.829357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:57.829376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:57.829397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135675577:8489], now have 1 active actors on pipe
2025-10-01T14:09:57.829404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135675239:2446], now have 1 active actors on pipe
2025-10-01T14:09:57.829412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255352758807354:7435]
2025-10-01T14:09:57.829414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255352758807354:7435]
2025-10-01T14:09:57.829416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255352758807354:7435]
2025-10-01T14:09:57.829428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:57.829448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:57.829465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:57.829471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:57.829485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:57.829463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 940
2025-10-01T14:09:57.829489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:57.829464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 940
2025-10-01T14:09:57.829491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:57.829500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255352758807354:7435]
2025-10-01T14:09:57.829503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:57.829509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:57.829533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.829542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.829568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:57.829578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:57.829582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:57.829588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:57.829596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:57.829603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:57.829618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.829728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.829736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.829749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:57.829833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 941 partition: 0 MaxSeqNo: 45 sessionId: src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0
2025-10-01T14:09:57.830228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33f4b4d-ba711b59-acec7d9d-ab3ea57a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:57.832663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0] Write session: try to update token
2025-10-01T14:09:57.832678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:57.840541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:57.840560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:57.840570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255352758807354:7435]
2025-10-01T14:09:57.840616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:57.840624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:57.840818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:57.840970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:57.841167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:57.841361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:57.841628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:57.841678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:57.850445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 941 sessionId: src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:57.853193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:57.853384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:57.853409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:57.853463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:57.859725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:57.860418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:57.860441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:57.860443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:57.860445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:57.860457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255352758807354:7435]
2025-10-01T14:09:57.860460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255352758807354:7435]
2025-10-01T14:09:57.860465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255352758807354:7435]
2025-10-01T14:09:57.860513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:57.860517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:57.860524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:57.860527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:57.860529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:57.860534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:57.860673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:57.905948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255355135675721:8250]
2025-10-01T14:09:57.906229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 940, pipe: [1:7556255355135675721:8250]
2025-10-01T14:09:58.018036Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:58.026612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.026641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.026800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.026860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.026928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.026989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.027106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.027116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.027181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.027272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.027335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.027401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.027447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.027457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.027522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.027583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.027645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.027715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.027821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.027830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.027895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.027965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.028026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.028089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.028192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.028200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.028263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.028346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.028410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.028475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.028517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.028524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.028589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.028678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.028753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.028818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.028860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.028867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.028934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.028996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.029058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.029120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.029162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.029175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.029233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.029290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.029352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.029421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.029463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.029470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.029534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.029599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.029663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.029727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.029768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.029775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.029839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.029903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.029963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.030027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.030069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.030076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.030129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255355135675721:8250], now have 1 active actors on pipe
2025-10-01T14:09:58.030418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:58.030484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255355135675721:8250]
2025-10-01T14:09:58.030693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:58.030704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:58.030727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 941 reason: error at write: Disconnected sessionId: src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0
2025-10-01T14:09:58.030926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 941 sessionId: src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0 is DEAD
2025-10-01T14:09:58.031072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:58.031079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0] Write session will restart in 0.005804s
2025-10-01T14:09:58.031097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0] Write session: Do CDS request
2025-10-01T14:09:58.031102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:58.031128Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:58.037833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.037923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:58.037937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 942
2025-10-01T14:09:58.038043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.038084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:58.038094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:58.038097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:58.038563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 942 sessionId:  describe result for acl check
2025-10-01T14:09:58.038592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:58.038594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:58.038595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:58.038600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255359430643092:8493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:58.039050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255359430643092:8493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:58.041864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255359430643092:8493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:58.044796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255359430643092:8493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:58.044819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255359430643092:8493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:58.044822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255359430643092:8493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:58.044828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:58.048866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:58.049875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:58.050045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:58.050053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:58.050063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:58.050107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:58.050147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255357053774943:7442]
2025-10-01T14:09:58.050665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:58.050949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:58.050987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:58.051250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:58.051295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.051300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.051301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.051302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.051303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.051304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.051305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.051306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.051307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.051308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.051309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.051310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.051311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.051312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.051316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.051324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.051327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.051330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.051334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.051337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.051339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.051342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.051345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.051348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.051351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.051354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.051357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.051360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.051367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.051374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.051379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.051383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.051386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.051390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.051394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.051398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.051401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.051405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.051408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.051412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.051416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.051419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.051423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.051427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.051431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.051435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.051438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.051442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.051445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.051449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.051452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.051457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.051462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.051466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.051469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.051473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.051507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:58.055074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:58.055772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:58.055785Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:58.055787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:58.055790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:58.055796Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 941 [2:7556255357053774943:7442]
2025-10-01T14:09:58.055808Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:58.055822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:58.055824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.055827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.055828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.055843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:58.055852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:58.055857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:58.055910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.055920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.055922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.055924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:58.055926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:58.055982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:58.055992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.056001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.056010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.056023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:58.056037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255357053774938:7442]
2025-10-01T14:09:58.056039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255357053774938:7442]
2025-10-01T14:09:58.056041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255357053774938:7442]
2025-10-01T14:09:58.056048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:58.056056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:58.056059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:58.056059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430643363:8493], now have 1 active actors on pipe
2025-10-01T14:09:58.056061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:58.056062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430643022:2446], now have 1 active actors on pipe
2025-10-01T14:09:58.056069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:58.056123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 941
2025-10-01T14:09:58.056159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 941
2025-10-01T14:09:58.056080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:58.056090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:58.056119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255357053774938:7442]
2025-10-01T14:09:58.056121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:58.056139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:58.056229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.056248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.056277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:58.056289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.056297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.056300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:58.056308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.056321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:58.056340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.056711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.056719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.056745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.056835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 942 partition: 0 MaxSeqNo: 45 sessionId: src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0
2025-10-01T14:09:58.057229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9f75b03-c84c2649-a173af86-15fb0c4f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:58.059669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0] Write session: try to update token
2025-10-01T14:09:58.059683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:58.073430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 942 sessionId: src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:58.075898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:58.077188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.077215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.077238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:58.077241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:58.077243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:58.077245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:58.077254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255357053774938:7442]
2025-10-01T14:09:58.077257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255357053774938:7442]
2025-10-01T14:09:58.077261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255357053774938:7442]
2025-10-01T14:09:58.077300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:58.077314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:58.077315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:58.077317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:58.077321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.077324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:58.077466Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:58.130724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255359430643504:8250]
2025-10-01T14:09:58.130923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 941, pipe: [1:7556255359430643504:8250]
2025-10-01T14:09:58.226128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:58.226340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:58.226410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430643504:8250], now have 1 active actors on pipe
2025-10-01T14:09:58.226495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:58.226591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255359430643504:8250]
2025-10-01T14:09:58.226615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:58.236080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:58.236095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:58.236118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 942 reason: error at write: Disconnected sessionId: src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0
2025-10-01T14:09:58.236296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 942 sessionId: src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0 is DEAD
2025-10-01T14:09:58.236391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:58.236402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0] Write session will restart in 0.007856s
2025-10-01T14:09:58.236424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0] Write session: Do CDS request
2025-10-01T14:09:58.236431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:58.245275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:58.245939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.246007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:58.246021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 943
2025-10-01T14:09:58.246117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.246149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:58.246155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:58.246158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:58.246544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:58.246587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 943 sessionId:  describe result for acl check
2025-10-01T14:09:58.246622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:58.246630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:58.246632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:58.246637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255359430643944:8497] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:58.246720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:58.246728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:58.246736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:58.246770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:58.246798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255357053775212:7444]
2025-10-01T14:09:58.247096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255359430643944:8497] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:58.247229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:58.247531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:58.247576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:58.247898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:58.247951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.247956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.247958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.247959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.247960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.247961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.247962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.247963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.247964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.247965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.247967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.247968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.247969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.247970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.247975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.247998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.248003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.248007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.248011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.248015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.248019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.248023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.248026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.248031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.248039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.248043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.248047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.248055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.248061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.248072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.248082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.248087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.248095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.248100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.248109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.248114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.248120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.248123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.248126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.248129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.248133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.248139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.248152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.248160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.248165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.248171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.248174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.248176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.248182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.248185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.248188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.248191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.248193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.248196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.248198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.248201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.248222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:58.249779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255359430643944:8497] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:58.252065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:58.252149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255359430643944:8497] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:58.252163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255359430643944:8497] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:58.252167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255359430643944:8497] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:58.252175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:58.253142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:58.253160Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:58.253162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:58.253165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:58.253172Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 942 [2:7556255357053775212:7444]
2025-10-01T14:09:58.253187Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:58.253201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:58.253203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.253205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.253206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.253219Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:58.253226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:58.253232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:58.253282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.253289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.253290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.253293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:58.253294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:58.253346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:58.253354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.253366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.253381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.253394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:58.253410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430643982:8497], now have 1 active actors on pipe
2025-10-01T14:09:58.253416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430643505:2446], now have 1 active actors on pipe
2025-10-01T14:09:58.253422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255357053775207:7444]
2025-10-01T14:09:58.253423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255357053775207:7444]
2025-10-01T14:09:58.253424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255357053775207:7444]
2025-10-01T14:09:58.253434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:58.253443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:58.253447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:58.253449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:58.253451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:58.253460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:58.253463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:58.253480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 942
2025-10-01T14:09:58.253492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255357053775207:7444]
2025-10-01T14:09:58.253505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:58.253521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:58.253531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.253534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.253529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 942
2025-10-01T14:09:58.253555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|911bd15f-9c32f613-5626d467-2a764f0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:58.253564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.253567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.253569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:58.253575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.253581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:58.253597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.253727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.253735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.253746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.253836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 943 partition: 0 MaxSeqNo: 45 sessionId: src_id|911bd15f-9c32f613-5626d467-2a764f0e_0
2025-10-01T14:09:58.254233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aa3752a-adbadf2b-ac1554d9-14ff92b0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|911bd15f-9c32f613-5626d467-2a764f0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:58.256708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|911bd15f-9c32f613-5626d467-2a764f0e_0] Write session: try to update token
2025-10-01T14:09:58.256723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|911bd15f-9c32f613-5626d467-2a764f0e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:58.271155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 943 sessionId: src_id|911bd15f-9c32f613-5626d467-2a764f0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:58.273667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:58.274410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.274433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.274451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:58.274454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:58.274456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:58.274457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:58.274463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255357053775207:7444]
2025-10-01T14:09:58.274466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255357053775207:7444]
2025-10-01T14:09:58.274469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255357053775207:7444]
2025-10-01T14:09:58.274506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:58.274513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:58.274518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.274519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:58.274520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:58.274523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:58.274648Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:58.326823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255359430643997:8250]
2025-10-01T14:09:58.327138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 942, pipe: [1:7556255359430643997:8250]
2025-10-01T14:09:58.417503Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:58.417719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:58.417772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430643997:8250], now have 1 active actors on pipe
2025-10-01T14:09:58.417839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:58.417980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255359430643997:8250]
2025-10-01T14:09:58.418012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:58.429172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:58.429186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:58.429210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 943 reason: error at write: Disconnected sessionId: src_id|911bd15f-9c32f613-5626d467-2a764f0e_0
2025-10-01T14:09:58.429391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 943 sessionId: src_id|911bd15f-9c32f613-5626d467-2a764f0e_0 is DEAD
2025-10-01T14:09:58.429491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911bd15f-9c32f613-5626d467-2a764f0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:58.429503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911bd15f-9c32f613-5626d467-2a764f0e_0] Write session will restart in 0.005955s
2025-10-01T14:09:58.429528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911bd15f-9c32f613-5626d467-2a764f0e_0] Write session: Do CDS request
2025-10-01T14:09:58.429537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911bd15f-9c32f613-5626d467-2a764f0e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:58.436897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|911bd15f-9c32f613-5626d467-2a764f0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.437326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:58.437340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 944
2025-10-01T14:09:58.437459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.437482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:58.437490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:58.437494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:58.437891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 944 sessionId:  describe result for acl check
2025-10-01T14:09:58.437927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:58.437934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:58.437935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:58.437940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255359430644439:8502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:58.438486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255359430644439:8502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:58.438964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:58.439938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:58.440073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:58.440081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:58.440088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:58.440117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:58.440142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255357053775485:7447]
2025-10-01T14:09:58.440442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255359430644439:8502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:58.440561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:58.440813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:58.440855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:58.441080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:58.441119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.441123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.441124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.441124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.441125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.441126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.441126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.441127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.441127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.441128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.441129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.441129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.441130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.441131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.441134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.441140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.441142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.441144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.441146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.441149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.441150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.441153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.441155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.441157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.441159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.441161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.441163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.441165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.441170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.441174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.441178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.441181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.441184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.441186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.441188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.441191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.441194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.441197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.441199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.441202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.441205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.441207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.441209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.441212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.441215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.441217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.441221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.441223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.441226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.441228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.441230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.441233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.441235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.441238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.441240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.441242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.441262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:58.444359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255359430644439:8502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:58.444371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255359430644439:8502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:58.444373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255359430644439:8502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:58.444379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:58.444625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:58.445287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:58.445296Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:58.445297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:58.445299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:58.445304Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 943 [2:7556255357053775485:7447]
2025-10-01T14:09:58.445314Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:58.445325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:58.445326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.445329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.445330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.445343Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:58.445347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:58.445351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:58.445384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.445389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.445391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.445394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:58.445396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:58.445455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:58.445463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.445474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.445487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.445506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:58.445524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430644002:2446], now have 1 active actors on pipe
2025-10-01T14:09:58.445530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430644480:8502], now have 1 active actors on pipe
2025-10-01T14:09:58.445535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255357053775480:7447]
2025-10-01T14:09:58.445537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255357053775480:7447]
2025-10-01T14:09:58.445538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255357053775480:7447]
2025-10-01T14:09:58.445548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:58.445562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:58.445571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:58.445579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:58.445580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:58.445582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:58.445583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:58.445569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 943
2025-10-01T14:09:58.445589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 943
2025-10-01T14:09:58.445609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255357053775480:7447]
2025-10-01T14:09:58.445616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:58.445618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:58.445634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.445642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.445683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:58.445694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.445702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.445704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:58.445712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.445723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:58.445742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.445873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.445880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.445892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.445956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 944 partition: 0 MaxSeqNo: 45 sessionId: src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0
2025-10-01T14:09:58.446312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|911bd15f-9c32f613-5626d467-2a764f0e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:58.448617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0] Write session: try to update token
2025-10-01T14:09:58.448636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:58.461451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 944 sessionId: src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:58.463917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:58.465502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.465533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.465555Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:58.465558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:58.465561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:58.465562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:58.465571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255357053775480:7447]
2025-10-01T14:09:58.465576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255357053775480:7447]
2025-10-01T14:09:58.465579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255357053775480:7447]
2025-10-01T14:09:58.465633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:58.465638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:58.465644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.465646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:58.465647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:58.465652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:58.465812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:58.518298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255359430644488:8250]
2025-10-01T14:09:58.518527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 943, pipe: [1:7556255359430644488:8250]
2025-10-01T14:09:58.606357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:58.606981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:58.607034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430644488:8250], now have 1 active actors on pipe
2025-10-01T14:09:58.607107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:58.607225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:58.607283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255359430644488:8250]
2025-10-01T14:09:58.617413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:58.617425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:58.617445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 944 reason: error at write: Disconnected sessionId: src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0
2025-10-01T14:09:58.617611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 944 sessionId: src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0 is DEAD
2025-10-01T14:09:58.617746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:58.617768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0] Write session will restart in 0.009523s
2025-10-01T14:09:58.617792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0] Write session: Do CDS request
2025-10-01T14:09:58.617800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:58.626553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:58.627737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:58.627903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:58.627911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:58.627918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:58.627951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:58.627979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255357053775769:7450]
2025-10-01T14:09:58.628393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:58.628631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:58.628658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:58.628909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.628922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:58.628986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.628991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.628992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.628993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.628994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.628995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.628996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.628997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.628998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.628999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.629000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.629001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.629001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.629003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.629007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.629015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.629019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.629022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.629025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.629029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.629032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.629035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.629038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.629041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.629044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.629048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.629051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.629054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.629061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.629071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.629077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.629081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.629089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.629093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.629101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.629105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.629114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.629118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.629122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.629126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.629129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.629134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.629137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.629141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.629145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.629149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.629153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.629158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.629161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.629166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.629169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.629173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.629176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.629180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.629183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.629187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.629220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:58.629210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:58.629224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 945
2025-10-01T14:09:58.629369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.629396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:58.629405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:58.629408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:58.629763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 945 sessionId:  describe result for acl check
2025-10-01T14:09:58.629797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:58.629805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:58.629807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:58.629811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255359430644936:8506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:58.630335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255359430644936:8506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:58.632634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255359430644936:8506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:58.632837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:58.633456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:58.633478Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:58.633480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:58.633482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:58.633488Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 944 [2:7556255357053775769:7450]
2025-10-01T14:09:58.633499Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:58.633514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:58.633519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.633522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.633523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.633534Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:58.633541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:58.633546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:58.633818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.633824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.633826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.633828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:58.633829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:58.633875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:58.633881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.633888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.633893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.633902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:58.633914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255357053775764:7450]
2025-10-01T14:09:58.633915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255357053775764:7450]
2025-10-01T14:09:58.633916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255357053775764:7450]
2025-10-01T14:09:58.633922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:58.633932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:58.633940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:58.633942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:58.633950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:58.633953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:58.633955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:58.633962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255357053775764:7450]
2025-10-01T14:09:58.633964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:58.633974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:58.633976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430644490:2446], now have 1 active actors on pipe
2025-10-01T14:09:58.634050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 944
2025-10-01T14:09:58.638481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255359430644936:8506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:58.638494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255359430644936:8506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:58.638498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255359430644936:8506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:58.638520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:58.638742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430644974:8506], now have 1 active actors on pipe
2025-10-01T14:09:58.638776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 944
2025-10-01T14:09:58.638829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.638839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.638869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:58.638885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.638894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.638900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:58.638911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.638929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:58.638949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.639097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.639102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.639114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.639186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 945 partition: 0 MaxSeqNo: 45 sessionId: src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0
2025-10-01T14:09:58.639578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1a16e6b-111bff4a-4cb9782b-14e09894_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:58.641891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0] Write session: try to update token
2025-10-01T14:09:58.641906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:58.644289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:58.644304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:58.644312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255357053775764:7450]
2025-10-01T14:09:58.644347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:58.644353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:58.644504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:58.644626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:58.644767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:58.644893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:58.645117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:58.645155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:58.654581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 945 sessionId: src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:58.656891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:58.657201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.657223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.657258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:58.657354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:58.662621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:58.662641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:58.662643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:58.662644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:58.662654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255357053775764:7450]
2025-10-01T14:09:58.662658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255357053775764:7450]
2025-10-01T14:09:58.662661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255357053775764:7450]
2025-10-01T14:09:58.662695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:58.662706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:58.662706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:58.662709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:58.662713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.662715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:58.662860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:58.707271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255359430644999:8250]
2025-10-01T14:09:58.707503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 944, pipe: [1:7556255359430644999:8250]
2025-10-01T14:09:58.810538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:58.818703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.818731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.818895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.818960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.819031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.819099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.819148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.819157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.819231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.819297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.819360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.819421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.819476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.819485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.819555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.819623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.819690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.819762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.819811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.819821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.819895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.819957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.820017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.820083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.820122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.820131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.820189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.820240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.820292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.820360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.820406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.820412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.820478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.820539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.820604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.820664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.820708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.820714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.820787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.820845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.820908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.820974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.821018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.821024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.821095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.821157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.821221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.821283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.821327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.821335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.821399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.821457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.821519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.821578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.821637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.821643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.821705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:58.821762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:58.821826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:58.821889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:58.821937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:58.821943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:58.822006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430644999:8250], now have 1 active actors on pipe
2025-10-01T14:09:58.822230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:58.822235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:58.822239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:58.822266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 945 reason: error at write: Disconnected sessionId: src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0
2025-10-01T14:09:58.822286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255359430644999:8250]
2025-10-01T14:09:58.822500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 945 sessionId: src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0 is DEAD
2025-10-01T14:09:58.822618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:58.822626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0] Write session will restart in 0.007610s
2025-10-01T14:09:58.822654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0] Write session: Do CDS request
2025-10-01T14:09:58.822661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:58.822925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:58.831965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.832045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:58.832060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 946
2025-10-01T14:09:58.832201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:58.832242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:58.832252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:58.832256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:58.833131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 946 sessionId:  describe result for acl check
2025-10-01T14:09:58.833165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:58.833167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:58.833168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:58.833173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255359430645323:8519] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:58.833689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255359430645323:8519] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:58.835550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255359430645323:8519] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:58.837791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255359430645323:8519] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:58.837804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255359430645323:8519] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:58.837807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255359430645323:8519] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:58.837814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:58.838116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:58.839348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:58.839534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:58.839543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:58.839555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:58.839604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:58.839640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255357053776062:7454]
2025-10-01T14:09:58.840026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:58.840272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:58.840320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:58.840643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:58.840695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.840700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.840701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.840702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.840703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.840704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.840705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.840706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.840707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.840708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.840709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.840710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.840712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.840713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.840718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.840726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.840730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.840745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.840748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.840752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.840755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.840758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.840763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.840767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.840774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.840777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.840780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.840783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.840790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.840797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:58.840805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.840814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:58.840822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.840826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:58.840833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.840842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:58.840846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.840851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:58.840858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.840862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:58.840870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.840878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:58.840885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.840890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:58.840894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.840903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:58.840906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.840912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.840922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.840927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.840935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.840945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.840955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.840964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:58.840972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.840981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:58.841023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:58.844512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:58.845165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:58.845178Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:58.845180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:58.845183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:58.845189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 945 [2:7556255357053776062:7454]
2025-10-01T14:09:58.845204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:58.845219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:58.845226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.845229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.845231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.845245Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:58.845250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:58.845255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:58.845305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.845311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.845312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.845315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:58.845317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:58.845365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:58.845370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.845376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:58.845382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:58.845390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:58.845403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430645016:2446], now have 1 active actors on pipe
2025-10-01T14:09:58.845409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430645491:8519], now have 1 active actors on pipe
2025-10-01T14:09:58.845414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255357053776051:7454]
2025-10-01T14:09:58.845415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255357053776051:7454]
2025-10-01T14:09:58.845417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255357053776051:7454]
2025-10-01T14:09:58.845425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:58.845436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:58.845438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:58.845444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:58.845445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:58.845447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:58.845448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:58.845466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255357053776051:7454]
2025-10-01T14:09:58.845476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:58.845479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:58.845486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 945
2025-10-01T14:09:58.845507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 945
2025-10-01T14:09:58.845517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.845524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.845541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:58.845549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:58.845552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:58.845554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:58.845560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:58.845565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:58.845578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.845710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.845716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.845726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:58.845806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 946 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0
2025-10-01T14:09:58.846140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cc90c4e-f84fecac-2700bfe8-50f07d2f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:58.848500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0] Write session: try to update token
2025-10-01T14:09:58.848516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:58.856099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:58.856118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:58.856128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255357053776051:7454]
2025-10-01T14:09:58.856165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:58.856167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:58.856327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:58.856464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:58.856605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:58.856751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:58.856933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:58.856969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:58.861052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 946 sessionId: src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:58.863327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:58.863502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:58.863523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:58.863559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:58.863644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:58.874197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:58.874216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:58.874218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:58.874220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:58.874231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255357053776051:7454]
2025-10-01T14:09:58.874234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255357053776051:7454]
2025-10-01T14:09:58.874237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255357053776051:7454]
2025-10-01T14:09:58.874283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:58.874289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:58.874293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:58.874295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:58.874296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:58.874299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:58.874444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:58.922307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255359430645503:8250]
2025-10-01T14:09:58.922592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 945, pipe: [1:7556255359430645503:8250]
2025-10-01T14:09:59.024165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:59.031220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.031245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.031376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.031425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.031474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.031526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.031564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.031571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.031630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.031684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.031741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.031796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.031836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.031842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.031898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.031951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.032004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.032059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.032097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.032102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.032159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.032210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.032260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.032311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.032350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.032358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.032414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.032465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.032517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.032569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.032608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.032613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.032668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.032718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.032785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.032839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.032877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.032882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.032936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.032986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.033037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.033090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.033128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.033133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.033183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.033230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.033282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.033340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.033378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.033384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.033436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.033488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.033536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.033586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.033630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.033635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.033685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.033734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.033784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.033836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.033891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.033896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.033934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255359430645503:8250], now have 1 active actors on pipe
2025-10-01T14:09:59.034150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255359430645503:8250]
2025-10-01T14:09:59.034192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:59.034194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:59.034214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 946 reason: error at write: Disconnected sessionId: src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0
2025-10-01T14:09:59.034420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 946 sessionId: src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0 is DEAD
2025-10-01T14:09:59.034585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:59.034594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0] Write session will restart in 0.005255s
2025-10-01T14:09:59.034620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0] Write session: Do CDS request
2025-10-01T14:09:59.034626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:59.034652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:59.034812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:59.040823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.040925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:59.040937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 947
2025-10-01T14:09:59.041044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.041069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:59.041084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:59.041088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:59.041411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 947 sessionId:  describe result for acl check
2025-10-01T14:09:59.041434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:59.041436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:59.041438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:59.041442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255363725612898:8523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:59.041878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255363725612898:8523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:59.044402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255363725612898:8523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:59.047084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255363725612898:8523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:59.047104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255363725612898:8523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:59.047107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255363725612898:8523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:59.047115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:59.048411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:59.049148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:59.049279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:59.049287Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:59.049295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:59.049323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:59.049364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255361348743653:7467]
2025-10-01T14:09:59.049727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:59.049943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:59.049969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:59.050172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:59.050208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.050212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.050213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.050213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.050214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.050214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.050215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.050216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.050216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.050217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.050217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.050218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.050218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.050219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.050222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.050228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.050230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.050232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.050234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.050237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.050239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.050241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.050243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.050245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.050247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.050250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.050252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.050254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.050259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.050264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.050268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.050270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.050273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.050276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.050278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.050281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.050283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.050286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.050288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.050291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.050293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.050296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.050298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.050301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.050304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.050308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.050310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.050313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.050315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.050318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.050320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.050323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.050325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.050327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.050330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.050332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.050352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:59.053757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:59.054356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:59.054392Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:59.054399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:59.054402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:59.054408Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 946 [2:7556255361348743653:7467]
2025-10-01T14:09:59.054427Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:59.054444Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:59.054451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.054455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.054461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.054475Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:59.054483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:59.054488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:59.054521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.054526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.054527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.054529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:59.054531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:59.054577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:59.054583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.054590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.054605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.054619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:59.054631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725613275:8523], now have 1 active actors on pipe
2025-10-01T14:09:59.054633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725612802:2446], now have 1 active actors on pipe
2025-10-01T14:09:59.054638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255361348743648:7467]
2025-10-01T14:09:59.054640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255361348743648:7467]
2025-10-01T14:09:59.054641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255361348743648:7467]
2025-10-01T14:09:59.054649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:59.054658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:59.054664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:59.054666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:59.054666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:59.054667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:59.054668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:59.054683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255361348743648:7467]
2025-10-01T14:09:59.054688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:59.054689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:59.054674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 946
2025-10-01T14:09:59.054740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 946
2025-10-01T14:09:59.054781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.054788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.054805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66ec0698-b6d1379b-f02d7004-48384c32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:59.054813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.054816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.054817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:59.054823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.054828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:59.054840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.054961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.054966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.054975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.055044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 947 partition: 0 MaxSeqNo: 45 sessionId: src_id|66ec0698-b6d1379b-f02d7004-48384c32_0
2025-10-01T14:09:59.055374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b9e6cf6-8a17e879-6214b052-a6a4670d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|66ec0698-b6d1379b-f02d7004-48384c32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:59.057614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ec0698-b6d1379b-f02d7004-48384c32_0] Write session: try to update token
2025-10-01T14:09:59.057627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ec0698-b6d1379b-f02d7004-48384c32_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:59.064790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:59.064810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:59.064819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255361348743648:7467]
2025-10-01T14:09:59.064862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:59.064863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:59.065052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:59.065200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:59.065385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:59.065557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:59.065796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:59.065831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:59.070959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 947 sessionId: src_id|66ec0698-b6d1379b-f02d7004-48384c32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:59.073308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:59.073785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.073809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.073847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:59.073921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:59.083529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:59.083548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:59.083550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:59.083552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:59.083562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255361348743648:7467]
2025-10-01T14:09:59.083565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255361348743648:7467]
2025-10-01T14:09:59.083568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255361348743648:7467]
2025-10-01T14:09:59.083612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:59.083617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:59.083622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:59.083624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.083626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:59.083628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:59.083750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:59.134229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255363725613290:8250]
2025-10-01T14:09:59.134502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 946, pipe: [1:7556255363725613290:8250]
2025-10-01T14:09:59.229688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:59.237555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.237585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.237750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.237812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.237878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.237942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.237989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.237999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.238064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.238128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.238193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.238250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.238294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.238298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.238386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.238453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.238523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.238593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.238647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.238655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.238725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.238790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.238857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.238922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.238971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.238979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.239045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.239106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.239174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.239240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.239294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.239302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.239371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.239436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.239499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.239565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.239611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.239619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.239688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.239749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.239818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.239891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.239940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.239945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.240007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.240059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.240117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.240173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.240215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.240223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.240279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.240329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.240382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.240438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.240478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.240483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.240536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.240591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.240650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.240699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.240747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.240752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.240803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725613290:8250], now have 1 active actors on pipe
2025-10-01T14:09:59.241088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255363725613290:8250]
2025-10-01T14:09:59.241214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:59.241256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:59.241266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:59.241293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 947 reason: error at write: Disconnected sessionId: src_id|66ec0698-b6d1379b-f02d7004-48384c32_0
2025-10-01T14:09:59.241515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 947 sessionId: src_id|66ec0698-b6d1379b-f02d7004-48384c32_0 is DEAD
2025-10-01T14:09:59.241672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ec0698-b6d1379b-f02d7004-48384c32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:59.241683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ec0698-b6d1379b-f02d7004-48384c32_0] Write session will restart in 0.005929s
2025-10-01T14:09:59.241711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ec0698-b6d1379b-f02d7004-48384c32_0] Write session: Do CDS request
2025-10-01T14:09:59.241718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ec0698-b6d1379b-f02d7004-48384c32_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:59.241768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:59.248848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66ec0698-b6d1379b-f02d7004-48384c32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.248959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:59.248978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 948
2025-10-01T14:09:59.249145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.249176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:59.249185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:59.249190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:59.249678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 948 sessionId:  describe result for acl check
2025-10-01T14:09:59.249715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:59.249721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:59.249723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:59.249728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255363725613361:8527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:59.250296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255363725613361:8527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:59.253004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255363725613361:8527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:59.256399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255363725613361:8527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:59.256419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255363725613361:8527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:59.256422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255363725613361:8527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:59.256428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:59.258944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:59.260319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:59.260532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:59.260541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:59.260550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:59.260589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:59.260619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255361348743928:7469]
2025-10-01T14:09:59.261012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:59.261266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:59.261295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:59.261486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:59.261520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.261524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.261525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.261525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.261526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.261526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.261527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.261528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.261529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.261529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.261530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.261530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.261531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.261532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.261535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.261541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.261543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.261545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.261547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.261549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.261551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.261553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.261555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.261557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.261559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.261560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.261562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.261564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.261570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.261574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.261578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.261581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.261584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.261586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.261589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.261591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.261594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.261597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.261599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.261602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.261605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.261607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.261610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.261613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.261615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.261618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.261621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.261624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.261627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.261630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.261632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.261635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.261637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.261640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.261646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.261650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.261673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:59.265460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:59.265995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:59.266008Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:59.266009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:59.266011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:59.266016Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 947 [2:7556255361348743928:7469]
2025-10-01T14:09:59.266025Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:59.266037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:59.266043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.266045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.266046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.266057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:59.266061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:59.266066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:59.266110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.266117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.266119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.266122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:59.266124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:59.266189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:59.266198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.266205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.266211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.266220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:59.266232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255361348743923:7469]
2025-10-01T14:09:59.266233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255361348743923:7469]
2025-10-01T14:09:59.266235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255361348743923:7469]
2025-10-01T14:09:59.266241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:59.266254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:59.266257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:59.266262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:59.266265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:59.266265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:59.266266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:59.266274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725613292:2446], now have 1 active actors on pipe
2025-10-01T14:09:59.266277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725613725:8527], now have 1 active actors on pipe
2025-10-01T14:09:59.266290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255361348743923:7469]
2025-10-01T14:09:59.266304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:59.266330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:59.266307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 947
2025-10-01T14:09:59.266326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 947
2025-10-01T14:09:59.266406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.266414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.266432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf8c6482-8a18075f-30be1212-24419184_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:59.266440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.266443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.266444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:59.266451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.266457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:59.266472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.266612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.266618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.266627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.266695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 948 partition: 0 MaxSeqNo: 45 sessionId: src_id|cf8c6482-8a18075f-30be1212-24419184_0
2025-10-01T14:09:59.267052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66ec0698-b6d1379b-f02d7004-48384c32_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cf8c6482-8a18075f-30be1212-24419184_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:59.269283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8c6482-8a18075f-30be1212-24419184_0] Write session: try to update token
2025-10-01T14:09:59.269297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8c6482-8a18075f-30be1212-24419184_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:59.282409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 948 sessionId: src_id|cf8c6482-8a18075f-30be1212-24419184_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:59.285014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:59.285219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.285242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.285282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:59.285356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:59.287876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:59.287893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:59.287895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:59.287898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:59.287907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255361348743923:7469]
2025-10-01T14:09:59.287912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255361348743923:7469]
2025-10-01T14:09:59.287916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255361348743923:7469]
2025-10-01T14:09:59.287962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:59.287967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:59.287974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.287976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:59.287976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:59.287982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:59.288109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:59.341032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255363725613789:8250]
2025-10-01T14:09:59.341367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 947, pipe: [1:7556255363725613789:8250]
2025-10-01T14:09:59.428696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:59.436021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.436048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.436190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.436247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.436307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.436360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.436405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.436412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.436471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.436526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.436584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.436639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.436679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.436684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.436745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.436792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.436838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.436891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.436931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.436937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.436990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.437045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.437096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.437145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.437190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.437195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.437246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.437299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.437349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.437397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.437435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.437439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.437491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.437536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.437588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.437639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.437677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.437683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.437733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.437783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.437836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.437886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.437923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.437927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.437987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.438037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.438088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.438148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.438186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.438191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.438243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.438292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.438349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.438422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.438461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.438466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.438521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.438570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.438620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.438670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.438721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.438729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.438776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725613789:8250], now have 1 active actors on pipe
2025-10-01T14:09:59.438990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:59.439003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:59.439019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:59.439024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 948 reason: error at write: Disconnected sessionId: src_id|cf8c6482-8a18075f-30be1212-24419184_0
2025-10-01T14:09:59.439084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255363725613789:8250]
2025-10-01T14:09:59.439199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 948 sessionId: src_id|cf8c6482-8a18075f-30be1212-24419184_0 is DEAD
2025-10-01T14:09:59.439346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8c6482-8a18075f-30be1212-24419184_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:59.439354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8c6482-8a18075f-30be1212-24419184_0] Write session will restart in 0.007690s
2025-10-01T14:09:59.439382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8c6482-8a18075f-30be1212-24419184_0] Write session: Do CDS request
2025-10-01T14:09:59.439387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8c6482-8a18075f-30be1212-24419184_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:59.439555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:59.447816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8c6482-8a18075f-30be1212-24419184_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.447934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:59.447951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 949
2025-10-01T14:09:59.448137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.448171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:59.448181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:59.448186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:59.448652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 949 sessionId:  describe result for acl check
2025-10-01T14:09:59.448686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:59.448692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:59.448694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:59.448700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255363725613923:8532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:59.449237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255363725613923:8532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:59.452241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255363725613923:8532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:59.454919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255363725613923:8532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:59.454935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255363725613923:8532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:59.454939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255363725613923:8532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:59.454947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:59.456463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:59.457640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:59.457793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:59.457803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:59.457812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:59.457848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:59.457889Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255361348744206:7472]
2025-10-01T14:09:59.458585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:59.458970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:59.459030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:59.459367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:59.459425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.459433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.459435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.459436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.459438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.459439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.459440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.459441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.459442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.459444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.459445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.459446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.459447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.459449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.459455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.459465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.459470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.459474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.459477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.459481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.459485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.459489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.459493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.459498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.459502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.459506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.459515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.459520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.459529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.459542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.459554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.459560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.459570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.459576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.459586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.459592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.459603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.459609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.459619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.459625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.459635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.459641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.459652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.459657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.459668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.459673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.459683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.459689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.459699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.459706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.459716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.459722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.459732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.459737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.459746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.459752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.459795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:59.463793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:59.464673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:59.464692Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:59.464694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:59.464698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:59.464704Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 948 [2:7556255361348744206:7472]
2025-10-01T14:09:59.464722Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:59.464752Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:59.464762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.464766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.464768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.464784Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:59.464795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:59.464802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:59.464867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.464877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.464880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.464883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:59.464886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:59.464956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:59.464965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.464977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.464990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.465011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:59.465036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725613794:2446], now have 1 active actors on pipe
2025-10-01T14:09:59.465046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725614270:8532], now have 1 active actors on pipe
2025-10-01T14:09:59.465052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255361348744201:7472]
2025-10-01T14:09:59.465055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255361348744201:7472]
2025-10-01T14:09:59.465058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255361348744201:7472]
2025-10-01T14:09:59.465077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:59.465094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:59.465106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:59.465111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:59.465113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:59.465114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:59.465118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:59.465151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255361348744201:7472]
2025-10-01T14:09:59.465160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:59.465146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 948
2025-10-01T14:09:59.465184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:59.465152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 948
2025-10-01T14:09:59.465196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.465200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.465224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23298a7f-6be2da21-79daaf80-713db851_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:59.465236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.465240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.465243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:59.465253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.465267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:59.465284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.465450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.465459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.465472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.465576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 949 partition: 0 MaxSeqNo: 45 sessionId: src_id|23298a7f-6be2da21-79daaf80-713db851_0
2025-10-01T14:09:59.465904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf8c6482-8a18075f-30be1212-24419184_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|23298a7f-6be2da21-79daaf80-713db851_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:59.468378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23298a7f-6be2da21-79daaf80-713db851_0] Write session: try to update token
2025-10-01T14:09:59.468395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23298a7f-6be2da21-79daaf80-713db851_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:59.482505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 949 sessionId: src_id|23298a7f-6be2da21-79daaf80-713db851_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:59.483272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:09:59.483297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:59.483309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255361348744201:7472]
2025-10-01T14:09:59.483359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:09:59.483377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:09:59.483558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:09:59.483724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:59.483878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:59.484034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:09:59.484344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:09:59.484390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:09:59.484830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:59.485122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.485138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.485167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:09:59.485279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:09:59.498620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:59.498644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:59.498647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:59.498648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:59.498659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255361348744201:7472]
2025-10-01T14:09:59.498663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255361348744201:7472]
2025-10-01T14:09:59.498670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255361348744201:7472]
2025-10-01T14:09:59.498715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:59.498720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:59.498728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.498730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:59.498731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:59.498733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:59.498886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:59.539243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255363725614285:8250]
2025-10-01T14:09:59.539556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 948, pipe: [1:7556255363725614285:8250]
2025-10-01T14:09:59.637618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:59.645315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.645343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.645492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.645548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.645601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.645656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.645702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.645710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.645771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.645824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.645884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.645941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.645981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.645988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.646041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.646093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.646149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.646208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.646252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.646255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.646317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.646390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.646537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.646597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.646641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.646649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.646716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.646776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.646837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.646910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.647090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.647102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.647170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.647237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.647311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.647380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.647425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.647433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.647516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.647584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.647656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.647714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.647751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.647756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.647807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.647859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.647910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.647974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.648015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.648022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.648086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.648142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.648192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.648241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.648279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.648284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.648342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:09:59.648393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:09:59.648453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:09:59.648507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:09:59.648558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:09:59.648563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:09:59.648614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725614285:8250], now have 1 active actors on pipe
2025-10-01T14:09:59.648912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:59.648956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:59.648962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:59.648963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255363725614285:8250]
2025-10-01T14:09:59.648998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 949 reason: error at write: Disconnected sessionId: src_id|23298a7f-6be2da21-79daaf80-713db851_0
2025-10-01T14:09:59.649263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 949 sessionId: src_id|23298a7f-6be2da21-79daaf80-713db851_0 is DEAD
2025-10-01T14:09:59.649355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23298a7f-6be2da21-79daaf80-713db851_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:59.649364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23298a7f-6be2da21-79daaf80-713db851_0] Write session will restart in 0.006643s
2025-10-01T14:09:59.649384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23298a7f-6be2da21-79daaf80-713db851_0] Write session: Do CDS request
2025-10-01T14:09:59.649389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23298a7f-6be2da21-79daaf80-713db851_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:59.649648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:59.656891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23298a7f-6be2da21-79daaf80-713db851_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.656984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:59.657001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 950
2025-10-01T14:09:59.657103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.657134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:59.657150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:59.657160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:59.657635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 950 sessionId:  describe result for acl check
2025-10-01T14:09:59.657681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:59.657688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:59.657690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:59.657697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255363725614371:8536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:59.658326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255363725614371:8536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:59.661238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255363725614371:8536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:59.664052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255363725614371:8536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:59.664081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255363725614371:8536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:59.664085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255363725614371:8536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:59.664136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:59.668765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:59.670309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:59.670515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:59.670526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:59.670537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:59.670588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:59.670636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255361348744497:7475]
2025-10-01T14:09:59.671282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:59.671582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:59.671632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:59.671950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:59.672005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.672013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.672014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.672016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.672016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.672017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.672018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.672018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.672019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.672020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.672021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.672022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.672023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.672024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.672027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.672034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.672036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.672038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.672040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.672042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.672044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.672046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.672047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.672050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.672052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.672053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.672055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.672058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.672065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.672072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.672078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.672083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.672087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.672092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.672096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.672101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.672105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.672109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.672113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.672118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.672124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.672130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.672135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.672139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.672144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.672149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.672153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.672159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.672164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.672170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.672174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.672176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.672179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.672182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.672186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.672196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.672221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:59.675892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:59.676643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:59.676657Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:59.676660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:59.676665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:59.676673Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 949 [2:7556255361348744497:7475]
2025-10-01T14:09:59.676689Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:59.676712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:59.676724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.676728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.676731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.676755Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:59.676761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:59.676769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:59.676829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.676837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.676840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.676843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:59.676846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:59.676912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:59.676920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.676932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.676942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.676960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:59.676982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725614659:8536], now have 1 active actors on pipe
2025-10-01T14:09:59.676989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725614288:2446], now have 1 active actors on pipe
2025-10-01T14:09:59.676995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255361348744492:7475]
2025-10-01T14:09:59.676998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255361348744492:7475]
2025-10-01T14:09:59.677000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255361348744492:7475]
2025-10-01T14:09:59.677014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:59.677032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:59.677041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:59.677043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 949
2025-10-01T14:09:59.677045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:59.677048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:59.677053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:59.677056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:59.677087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255361348744492:7475]
2025-10-01T14:09:59.677091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:59.677093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:59.677107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.677114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.677159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df75cfde-be87b898-75e03a98-3615a023_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:59.677170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.677175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.677177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:59.677186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.677195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:59.677173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 949
2025-10-01T14:09:59.677216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.677419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.677429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.677446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.677562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 950 partition: 0 MaxSeqNo: 45 sessionId: src_id|df75cfde-be87b898-75e03a98-3615a023_0
2025-10-01T14:09:59.677903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23298a7f-6be2da21-79daaf80-713db851_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|df75cfde-be87b898-75e03a98-3615a023_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:59.680728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df75cfde-be87b898-75e03a98-3615a023_0] Write session: try to update token
2025-10-01T14:09:59.680752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df75cfde-be87b898-75e03a98-3615a023_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:59.697032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:59.697057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:59.697059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:59.697060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:59.697067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255361348744492:7475]
2025-10-01T14:09:59.697071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255361348744492:7475]
2025-10-01T14:09:59.697074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255361348744492:7475]
2025-10-01T14:09:59.697112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:59.697115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:59.697119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.697121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:59.697121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:59.697125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:59.697278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:59.697981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 950 sessionId: src_id|df75cfde-be87b898-75e03a98-3615a023_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:59.700680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:59.749140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255363725614815:8250]
2025-10-01T14:09:59.749470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 949, pipe: [1:7556255363725614815:8250]
2025-10-01T14:09:59.827883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:09:59.828246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.828267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.828313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725614815:8250], now have 1 active actors on pipe
2025-10-01T14:09:59.828536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255363725614815:8250]
2025-10-01T14:09:59.828545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:09:59.828549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:09:59.828572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:09:59.828588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:09:59.828620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 950 reason: error at write: Disconnected sessionId: src_id|df75cfde-be87b898-75e03a98-3615a023_0
2025-10-01T14:09:59.828835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 950 sessionId: src_id|df75cfde-be87b898-75e03a98-3615a023_0 is DEAD
2025-10-01T14:09:59.829306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df75cfde-be87b898-75e03a98-3615a023_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:09:59.829318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df75cfde-be87b898-75e03a98-3615a023_0] Write session will restart in 0.006999s
2025-10-01T14:09:59.829348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df75cfde-be87b898-75e03a98-3615a023_0] Write session: Do CDS request
2025-10-01T14:09:59.829355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df75cfde-be87b898-75e03a98-3615a023_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:09:59.837941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df75cfde-be87b898-75e03a98-3615a023_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.838004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:09:59.838022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 951
2025-10-01T14:09:59.838203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:09:59.838236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:09:59.838243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:09:59.838245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:09:59.838749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 951 sessionId:  describe result for acl check
2025-10-01T14:09:59.838799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:09:59.838807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:09:59.838809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:09:59.838815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255363725614954:8549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:09:59.839399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255363725614954:8549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:09:59.841790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255363725614954:8549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:09:59.845975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255363725614954:8549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:09:59.845993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255363725614954:8549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:09:59.845996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255363725614954:8549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:09:59.846005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:09:59.849131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:09:59.850788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:09:59.850958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:09:59.850967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:09:59.850976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:09:59.851011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:09:59.851042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255361348744784:7479]
2025-10-01T14:09:59.851545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:09:59.851810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:09:59.851841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:09:59.852048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:09:59.852089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.852094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.852095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.852096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.852097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.852098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.852099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.852100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.852101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.852101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.852102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.852102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.852103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.852104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.852107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.852112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.852115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.852117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.852119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.852121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.852123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.852127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.852131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.852134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.852137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.852141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.852144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.852148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.852155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.852161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:09:59.852165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.852168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:09:59.852171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.852174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:09:59.852176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.852179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:09:59.852181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.852184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:09:59.852186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.852190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:09:59.852195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.852198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:09:59.852200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.852203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:09:59.852206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.852209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:09:59.852211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.852214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.852216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.852219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.852221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.852224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.852226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.852240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:09:59.852242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.852245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:09:59.852268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:09:59.856322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:09:59.857033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:09:59.857049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:09:59.857051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:09:59.857054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:09:59.857060Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 950 [2:7556255361348744784:7479]
2025-10-01T14:09:59.857074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:09:59.857090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:09:59.857092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.857095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.857097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.857110Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:09:59.857119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:09:59.857124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:09:59.857258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.857272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.857274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.857278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:09:59.857281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:09:59.857357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:09:59.857363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.857373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:09:59.857382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:09:59.857392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:09:59.857410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255361348744777:7479]
2025-10-01T14:09:59.857415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255361348744777:7479]
2025-10-01T14:09:59.857416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255361348744777:7479]
2025-10-01T14:09:59.857429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:09:59.857445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:09:59.857450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725614818:2446], now have 1 active actors on pipe
2025-10-01T14:09:59.857456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725615296:8549], now have 1 active actors on pipe
2025-10-01T14:09:59.857463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:09:59.857466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:09:59.857466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:09:59.857477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:09:59.857479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:09:59.857507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255361348744777:7479]
2025-10-01T14:09:59.857510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:09:59.857514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:09:59.857529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.857491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 950
2025-10-01T14:09:59.857534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.857534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 950
2025-10-01T14:09:59.857577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9533e9c-77dbeaec-199ab744-d484e61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:09:59.857590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:09:59.857593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:09:59.857595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:09:59.857603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:09:59.857614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:09:59.857644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.857809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:09:59.857818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:09:59.857831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:09:59.857927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 951 partition: 0 MaxSeqNo: 45 sessionId: src_id|e9533e9c-77dbeaec-199ab744-d484e61_0
2025-10-01T14:09:59.858288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df75cfde-be87b898-75e03a98-3615a023_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e9533e9c-77dbeaec-199ab744-d484e61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:09:59.861043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9533e9c-77dbeaec-199ab744-d484e61_0] Write session: try to update token
2025-10-01T14:09:59.861059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9533e9c-77dbeaec-199ab744-d484e61_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:09:59.875957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 951 sessionId: src_id|e9533e9c-77dbeaec-199ab744-d484e61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:09:59.878625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:09:59.878648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:09:59.878650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:09:59.878652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:09:59.878660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255361348744777:7479]
2025-10-01T14:09:59.878663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255361348744777:7479]
2025-10-01T14:09:59.878667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255361348744777:7479]
2025-10-01T14:09:59.878709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:09:59.878713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:09:59.878719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:09:59.878719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:09:59.878721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:09:59.878722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:09:59.878824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:09:59.878868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:09:59.929200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255363725615310:8250]
2025-10-01T14:09:59.929488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 950, pipe: [1:7556255363725615310:8250]
2025-10-01T14:10:00.011936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:00.012944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.012964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.013003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255363725615310:8250], now have 1 active actors on pipe
2025-10-01T14:10:00.013230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:00.013337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:00.013375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:00.013392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255363725615310:8250]
2025-10-01T14:10:00.013461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 951 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e9533e9c-77dbeaec-199ab744-d484e61_0
2025-10-01T14:10:00.013656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 951 sessionId: src_id|e9533e9c-77dbeaec-199ab744-d484e61_0 is DEAD
2025-10-01T14:10:00.013763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9533e9c-77dbeaec-199ab744-d484e61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:00.013771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9533e9c-77dbeaec-199ab744-d484e61_0] Write session will restart in 0.006221s
2025-10-01T14:10:00.013792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9533e9c-77dbeaec-199ab744-d484e61_0] Write session: Do CDS request
2025-10-01T14:10:00.013796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9533e9c-77dbeaec-199ab744-d484e61_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:00.020843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9533e9c-77dbeaec-199ab744-d484e61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.021010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:00.021027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 952
2025-10-01T14:10:00.021146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.021178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:00.021189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:00.021200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:00.021655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 952 sessionId:  describe result for acl check
2025-10-01T14:10:00.021695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:00.021701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:00.021703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:00.021708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255368020582722:8553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:00.022275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255368020582722:8553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:00.024573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255368020582722:8553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:00.027472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255368020582722:8553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:00.027489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255368020582722:8553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:00.027492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255368020582722:8553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:00.027504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:00.028139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:00.029085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:00.029263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:00.029270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:00.029277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:00.029318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:00.029358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255365643712388:7492]
2025-10-01T14:10:00.029912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:00.030217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:00.030281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:00.030654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:00.030740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.030746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.030747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.030749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.030751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.030752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.030753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.030755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.030756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.030757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.030759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.030760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.030761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.030762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.030768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.030778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.030783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.030787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.030791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.030795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.030799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.030803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.030807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.030813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.030822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.030831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.030839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.030843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.030855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.030862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.030872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.030881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.030889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.030899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.030907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.030915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.030924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.030934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.030939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.030945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.030954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.030964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.030972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.030982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.030992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.031002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.031011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.031019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.031028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.031037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.031045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.031053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.031062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.031070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.031074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.031079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.031139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:00.034935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:00.035660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:00.035678Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:00.035682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:00.035686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:00.035693Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 951 [2:7556255365643712388:7492]
2025-10-01T14:10:00.035710Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:00.035733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:00.035740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.035744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.035747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.035764Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:00.035776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:00.035787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:00.035854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.035864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.035867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.035871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:00.035874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:00.035950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:00.035958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.035970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.035986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.036005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:00.036030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020583089:8553], now have 1 active actors on pipe
2025-10-01T14:10:00.036038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020582609:2446], now have 1 active actors on pipe
2025-10-01T14:10:00.036046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255365643712383:7492]
2025-10-01T14:10:00.036049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255365643712383:7492]
2025-10-01T14:10:00.036052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255365643712383:7492]
2025-10-01T14:10:00.036065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:00.036090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:00.036110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:00.036118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:00.036139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:00.036149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:00.036151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:00.036152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255365643712383:7492]
2025-10-01T14:10:00.036155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:00.036159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:00.036138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 951
2025-10-01T14:10:00.036194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.036206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.036242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68481df1-b21eae96-dbad50fe-e09686f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:00.036254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.036264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.036270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:00.036262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 951
2025-10-01T14:10:00.036282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.036298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:00.036318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.036482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.036490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.036504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.036606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 952 partition: 0 MaxSeqNo: 45 sessionId: src_id|68481df1-b21eae96-dbad50fe-e09686f3_0
2025-10-01T14:10:00.036998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9533e9c-77dbeaec-199ab744-d484e61_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|68481df1-b21eae96-dbad50fe-e09686f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:00.039612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68481df1-b21eae96-dbad50fe-e09686f3_0] Write session: try to update token
2025-10-01T14:10:00.039628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68481df1-b21eae96-dbad50fe-e09686f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:00.054321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 952 sessionId: src_id|68481df1-b21eae96-dbad50fe-e09686f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:00.056151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:00.056173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:00.056176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:00.056178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:00.056187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255365643712383:7492]
2025-10-01T14:10:00.056191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255365643712383:7492]
2025-10-01T14:10:00.056195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255365643712383:7492]
2025-10-01T14:10:00.056235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:00.056240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.056242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:00.056256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:00.056267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:00.056273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:00.056434Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:00.057023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:00.113691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255368020583102:8250]
2025-10-01T14:10:00.114271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 951, pipe: [1:7556255368020583102:8250]
2025-10-01T14:10:00.199318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:00.199877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.199892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.199922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020583102:8250], now have 1 active actors on pipe
2025-10-01T14:10:00.200083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:00.200215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255368020583102:8250]
2025-10-01T14:10:00.200245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:00.200250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:00.200314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 952 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68481df1-b21eae96-dbad50fe-e09686f3_0
2025-10-01T14:10:00.200513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 952 sessionId: src_id|68481df1-b21eae96-dbad50fe-e09686f3_0 is DEAD
2025-10-01T14:10:00.200667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68481df1-b21eae96-dbad50fe-e09686f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:00.200680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68481df1-b21eae96-dbad50fe-e09686f3_0] Write session will restart in 0.008271s
2025-10-01T14:10:00.200702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68481df1-b21eae96-dbad50fe-e09686f3_0] Write session: Do CDS request
2025-10-01T14:10:00.200708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68481df1-b21eae96-dbad50fe-e09686f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:00.209906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68481df1-b21eae96-dbad50fe-e09686f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.210029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:00.210044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 953
2025-10-01T14:10:00.210146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.210176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:00.210184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:00.210187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:00.210548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 953 sessionId:  describe result for acl check
2025-10-01T14:10:00.210581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:00.210590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:00.210592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:00.210597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255368020583394:8557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:00.211103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255368020583394:8557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:00.212796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255368020583394:8557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:00.215147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:00.215240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255368020583394:8557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:00.215253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255368020583394:8557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:00.215257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255368020583394:8557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:00.215265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:00.216097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:00.216261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:00.216281Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:00.216296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:00.216334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:00.216374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255365643712668:7494]
2025-10-01T14:10:00.216776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:00.217003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:00.217032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:00.217243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:00.217288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.217294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.217295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.217296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.217296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.217297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.217297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.217298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.217299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.217300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.217300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.217301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.217301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.217302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.217305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.217311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.217313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.217315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.217317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.217319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.217321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.217323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.217325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.217327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.217329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.217331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.217333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.217335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.217340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.217344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.217348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.217351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.217353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.217356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.217358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.217361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.217363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.217366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.217368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.217371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.217373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.217376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.217379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.217381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.217384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.217386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.217389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.217391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.217394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.217397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.217399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.217402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.217404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.217407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.217409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.217411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.217430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:00.220996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:00.221596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:00.221611Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:00.221613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:00.221617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:00.221623Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 952 [2:7556255365643712668:7494]
2025-10-01T14:10:00.221637Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:00.221653Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:00.221660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.221664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.221666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.221680Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:00.221690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:00.221696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:00.221745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.221752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.221753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.221758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:00.221760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:00.221824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:00.221831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.221841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.221856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.221872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:00.221893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020583589:8557], now have 1 active actors on pipe
2025-10-01T14:10:00.221905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020583107:2446], now have 1 active actors on pipe
2025-10-01T14:10:00.221911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255365643712662:7494]
2025-10-01T14:10:00.221894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 952
2025-10-01T14:10:00.221913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255365643712662:7494]
2025-10-01T14:10:00.221918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 952
2025-10-01T14:10:00.221915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255365643712662:7494]
2025-10-01T14:10:00.221923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:00.221928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:00.221931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:00.221932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:00.221935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:00.221948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:00.221951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:00.221969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.221973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.222007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255365643712662:7494]
2025-10-01T14:10:00.222019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:00.222038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:00.222040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:00.222048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.222052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.222054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:00.222063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.222076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:00.222108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.222247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.222255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.222268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.222340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 953 partition: 0 MaxSeqNo: 45 sessionId: src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0
2025-10-01T14:10:00.222712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68481df1-b21eae96-dbad50fe-e09686f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:00.225117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0] Write session: try to update token
2025-10-01T14:10:00.225131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:00.238365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:00.238398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:00.238410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255365643712662:7494]
2025-10-01T14:10:00.238463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:00.238464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:00.238660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:00.238793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 953 sessionId: src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:00.238810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:00.238959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:00.239100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:00.239314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:00.239358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:00.241154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:00.241388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.241409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.241443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:00.241519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:00.251851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:00.251874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:00.251876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:00.251878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:00.251888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255365643712662:7494]
2025-10-01T14:10:00.251892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255365643712662:7494]
2025-10-01T14:10:00.251895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255365643712662:7494]
2025-10-01T14:10:00.251943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:00.251945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:00.251951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:00.251954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.251956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:00.251956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:00.252093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:00.300560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255368020583609:8250]
2025-10-01T14:10:00.300764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 952, pipe: [1:7556255368020583609:8250]
2025-10-01T14:10:00.389907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:00.396623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.396649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.396791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.396845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.396900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.396953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.396993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.397000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.397056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.397107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.397168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.397230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.397270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.397275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.397326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.397374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.397427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.397480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.397523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.397528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.397588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.397642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.397696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.397748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.397787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.397792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.397844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.397894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.397944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.397998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.398037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.398042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.398096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.398148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.398208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.398262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.398301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.398305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.398366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.398436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.398492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.398542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.398581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.398588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.398642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.398690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.398741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.398788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.398831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.398836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.398898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.398966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.399012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.399058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.399096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.399104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.399158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.399213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.399269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.399321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.399409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.399413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.399449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020583609:8250], now have 1 active actors on pipe
2025-10-01T14:10:00.399677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:00.399688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:00.399694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:00.399718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 953 reason: error at write: Disconnected sessionId: src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0
2025-10-01T14:10:00.399730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255368020583609:8250]
2025-10-01T14:10:00.399875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 953 sessionId: src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0 is DEAD
2025-10-01T14:10:00.399984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:00.399991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0] Write session will restart in 0.008539s
2025-10-01T14:10:00.400010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0] Write session: Do CDS request
2025-10-01T14:10:00.400014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:00.400319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:00.409815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.409874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:00.409887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 954
2025-10-01T14:10:00.410000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.410029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:00.410038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:00.410041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:00.410420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 954 sessionId:  describe result for acl check
2025-10-01T14:10:00.410448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:00.410453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:00.410454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:00.410457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255368020584040:8562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:00.410869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255368020584040:8562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:00.412075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:00.412575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255368020584040:8562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:00.413513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:00.413709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:00.413718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:00.413728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:00.413774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:00.413809Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255365643712950:7497]
2025-10-01T14:10:00.414237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:00.414505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:00.414548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:00.414852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:00.414917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.414923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.414924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.414925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.414927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.414928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.414929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.414931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.414932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.414933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.414934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.414936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.414937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.414938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.414943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.414953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.414957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.414961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.414964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.414968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.414972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.414975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.414979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.414983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.414987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.414991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.414995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.414998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.415005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.415013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.415023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.415027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.415031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.415039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.415043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.415047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.415054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.415058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.415062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.415070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.415074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.415084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.415089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.415098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.415102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.415111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.415115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.415124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.415130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.415135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.415143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.415146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.415151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.415155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.415159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.415164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.415206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:00.415496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255368020584040:8562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:00.415516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255368020584040:8562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:00.415520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255368020584040:8562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:00.415529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:00.419432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:00.420391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:00.420410Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:00.420413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:00.420417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:00.420426Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 953 [2:7556255365643712950:7497]
2025-10-01T14:10:00.420443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:00.420462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:00.420467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.420471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.420474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.420491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:00.420505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:00.420512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:00.420575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.420578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.420581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.420585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:00.420588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:00.420661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:00.420670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.420688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.420714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.420811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 953
2025-10-01T14:10:00.420822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 953
2025-10-01T14:10:00.420760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:00.420787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020584102:8562], now have 1 active actors on pipe
2025-10-01T14:10:00.420792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020583614:2446], now have 1 active actors on pipe
2025-10-01T14:10:00.420801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255365643712945:7497]
2025-10-01T14:10:00.420804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255365643712945:7497]
2025-10-01T14:10:00.420807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255365643712945:7497]
2025-10-01T14:10:00.420819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:00.420834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:00.420848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:00.420855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:00.420856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:00.420859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:00.420859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:00.420903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255365643712945:7497]
2025-10-01T14:10:00.420910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:00.420922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:00.421037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.421053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.421091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e114afc-f616da41-8429ca58-e52ec28c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:00.421105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.421111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.421118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:00.421129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.421146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:00.421163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.421354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.421367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.421386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.421508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 954 partition: 0 MaxSeqNo: 45 sessionId: src_id|4e114afc-f616da41-8429ca58-e52ec28c_0
2025-10-01T14:10:00.421918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f218b36-5b6f67e9-a1198b98-ed336667_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4e114afc-f616da41-8429ca58-e52ec28c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:00.424539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e114afc-f616da41-8429ca58-e52ec28c_0] Write session: try to update token
2025-10-01T14:10:00.424557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e114afc-f616da41-8429ca58-e52ec28c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:00.431797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:00.431821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:00.431831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255365643712945:7497]
2025-10-01T14:10:00.431867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:00.431878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:00.432034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:00.432168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:00.432298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:00.432427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:00.432601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:00.432644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:00.438909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 954 sessionId: src_id|4e114afc-f616da41-8429ca58-e52ec28c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:00.441327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:00.441500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.441521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.441560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:00.441627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:00.450199Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:00.450220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:00.450222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:00.450224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:00.450234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255365643712945:7497]
2025-10-01T14:10:00.450237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255365643712945:7497]
2025-10-01T14:10:00.450241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255365643712945:7497]
2025-10-01T14:10:00.450285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:00.450292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:00.450295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.450297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:00.450298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:00.450300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:00.450517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:00.499746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255368020584110:8250]
2025-10-01T14:10:00.499962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 953, pipe: [1:7556255368020584110:8250]
2025-10-01T14:10:00.598401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:00.606622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.606652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.606814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.606876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.606938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.607007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.607256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.607271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.607337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.607401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.607461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.607528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.607581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.607589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.607653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.607720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.607797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.607861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.607904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.607911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.607978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.608042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.608105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.608170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.608212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.608219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.608288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.608346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.608407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.608472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.608514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.608521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.608591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.608656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.608723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.608800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.608847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.608855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.608921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.608982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.609050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.609142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.609188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.609195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.609285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.609349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.609415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.609482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.609526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.609532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.609599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.609663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.609728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.609794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.609839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.609845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.609914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:00.609980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:00.610046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:00.610112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:00.610167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:00.610174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:00.610244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020584110:8250], now have 1 active actors on pipe
2025-10-01T14:10:00.610493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:00.610502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:00.610513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:00.610544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 954 reason: error at write: Disconnected sessionId: src_id|4e114afc-f616da41-8429ca58-e52ec28c_0
2025-10-01T14:10:00.610558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255368020584110:8250]
2025-10-01T14:10:00.610762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 954 sessionId: src_id|4e114afc-f616da41-8429ca58-e52ec28c_0 is DEAD
2025-10-01T14:10:00.610843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:00.610923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e114afc-f616da41-8429ca58-e52ec28c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:00.610935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e114afc-f616da41-8429ca58-e52ec28c_0] Write session will restart in 0.006424s
2025-10-01T14:10:00.610970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e114afc-f616da41-8429ca58-e52ec28c_0] Write session: Do CDS request
2025-10-01T14:10:00.610976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e114afc-f616da41-8429ca58-e52ec28c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:00.618893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e114afc-f616da41-8429ca58-e52ec28c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.618955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:00.618970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 955
2025-10-01T14:10:00.619110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.619140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:00.619156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:00.619160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:00.619514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 955 sessionId:  describe result for acl check
2025-10-01T14:10:00.619549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:00.619555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:00.619556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:00.619560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255368020584336:8566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:00.620053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255368020584336:8566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:00.622193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255368020584336:8566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:00.624654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255368020584336:8566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:00.624667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255368020584336:8566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:00.624669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255368020584336:8566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:00.624675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:00.625170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:00.626478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:00.626667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:00.626678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:00.626688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:00.626734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:00.626772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255365643713249:7500]
2025-10-01T14:10:00.627380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:00.627615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:00.627652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:00.627936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:00.627984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.627990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.627991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.627992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.627993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.627994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.627995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.627996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.627997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.627998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.627999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.628001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.628002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.628003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.628008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.628018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.628022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.628026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.628029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.628033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.628037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.628040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.628044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.628048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.628052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.628056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.628059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.628063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.628070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.628077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.628082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.628087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.628091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.628096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.628101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.628106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.628110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.628115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.628125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.628130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.628139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.628144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.628152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.628157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.628167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.628176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.628181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.628190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.628194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.628203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.628207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.628212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.628220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.628225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.628230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.628239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.628276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:00.631926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:00.632465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:00.632476Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:00.632478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:00.632480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:00.632485Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 954 [2:7556255365643713249:7500]
2025-10-01T14:10:00.632496Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:00.632510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:00.632516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.632518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.632519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.632532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:00.632537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:00.632547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:00.632599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.632605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.632607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.632609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:00.632612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:00.632670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:00.632676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.632686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.632701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.632722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:00.632748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020584601:8566], now have 1 active actors on pipe
2025-10-01T14:10:00.632755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020584116:2446], now have 1 active actors on pipe
2025-10-01T14:10:00.632761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255365643713244:7500]
2025-10-01T14:10:00.632778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255365643713244:7500]
2025-10-01T14:10:00.632780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255365643713244:7500]
2025-10-01T14:10:00.632788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:00.632780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 954
2025-10-01T14:10:00.632801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:00.632781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 954
2025-10-01T14:10:00.632806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:00.632809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:00.632811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:00.632813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:00.632815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:00.632856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.632869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.632879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255365643713244:7500]
2025-10-01T14:10:00.632890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:00.632899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:00.632916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:00.632927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.632934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.632936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:00.632943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.632955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:00.632976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.633093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.633100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.633112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.633170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 955 partition: 0 MaxSeqNo: 45 sessionId: src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0
2025-10-01T14:10:00.633477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e114afc-f616da41-8429ca58-e52ec28c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:00.635761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0] Write session: try to update token
2025-10-01T14:10:00.635777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:00.649952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 955 sessionId: src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:00.652999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:00.653027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:00.653031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:00.653033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:00.653044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255365643713244:7500]
2025-10-01T14:10:00.653050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255365643713244:7500]
2025-10-01T14:10:00.653055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255365643713244:7500]
2025-10-01T14:10:00.653105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:00.653113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:00.653116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:00.653118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:00.653122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.653125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:00.653322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:00.653490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:00.710700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255368020584614:8250]
2025-10-01T14:10:00.710955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 954, pipe: [1:7556255368020584614:8250]
2025-10-01T14:10:00.791128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:00.791637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.791651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.791690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020584614:8250], now have 1 active actors on pipe
2025-10-01T14:10:00.791839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:00.791889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:00.791926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255368020584614:8250]
2025-10-01T14:10:00.791933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:00.791991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 955 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0
2025-10-01T14:10:00.792212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 955 sessionId: src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0 is DEAD
2025-10-01T14:10:00.792349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:00.792355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0] Write session will restart in 0.008201s
2025-10-01T14:10:00.792376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0] Write session: Do CDS request
2025-10-01T14:10:00.792381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:00.801925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.802016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:00.802032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 956
2025-10-01T14:10:00.802568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:00.802626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:00.802638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:00.802642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:00.803083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 956 sessionId:  describe result for acl check
2025-10-01T14:10:00.803125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:00.803132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:00.803134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:00.803141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255368020584894:8579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:00.803683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255368020584894:8579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:00.805482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255368020584894:8579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:00.807837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255368020584894:8579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:00.807850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255368020584894:8579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:00.807853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255368020584894:8579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:00.807858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:00.808432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:00.809660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:00.809855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:00.809865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:00.809877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:00.809926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:00.809966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255365643713539:7504]
2025-10-01T14:10:00.810601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:00.810877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:00.810921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:00.811227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:00.811282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.811288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.811289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.811290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.811291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.811292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.811293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.811294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.811295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.811296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.811297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.811298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.811299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.811300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.811306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.811317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.811321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.811325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.811329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.811333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.811337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.811341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.811345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.811351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.811355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.811359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.811363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.811367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.811374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.811382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:00.811388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.811399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:00.811409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.811414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:00.811423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.811429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:00.811438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.811443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:00.811450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.811455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:00.811464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.811470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:00.811479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.811484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:00.811493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.811498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:00.811507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.811513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.811522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.811528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.811537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.811542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.811551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.811556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:00.811565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.811570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:00.811610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:00.815086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:00.815878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:00.815893Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:00.815895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:00.815899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:00.815906Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 955 [2:7556255365643713539:7504]
2025-10-01T14:10:00.815925Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:00.815943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:00.815950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.815953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.815955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.815970Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:00.815981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:00.815991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:00.816046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.816052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.816054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.816058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:00.816060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:00.816122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:00.816129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.816140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:00.816156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:00.816176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:00.816242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 955
2025-10-01T14:10:00.816196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020584655:2446], now have 1 active actors on pipe
2025-10-01T14:10:00.816243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 955
2025-10-01T14:10:00.816204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020585136:8579], now have 1 active actors on pipe
2025-10-01T14:10:00.816211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255365643713534:7504]
2025-10-01T14:10:00.816214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255365643713534:7504]
2025-10-01T14:10:00.816216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255365643713534:7504]
2025-10-01T14:10:00.816228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:00.816239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:00.816244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:00.816247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:00.816249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:00.816252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:00.816255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:00.816279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255365643713534:7504]
2025-10-01T14:10:00.816282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:00.816284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:00.816297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.816301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.816347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:00.816358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:00.816366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:00.816372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:00.816380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:00.816392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:00.816411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.816537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.816547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.816560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:00.816637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 956 partition: 0 MaxSeqNo: 45 sessionId: src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0
2025-10-01T14:10:00.817001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc974fcd-f078a37d-b455aeb-3ce1170b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:00.819405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0] Write session: try to update token
2025-10-01T14:10:00.819423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:00.834417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 956 sessionId: src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:00.836858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:00.836879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:00.836881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:00.836883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:00.836880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:00.836892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255365643713534:7504]
2025-10-01T14:10:00.836895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255365643713534:7504]
2025-10-01T14:10:00.836899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255365643713534:7504]
2025-10-01T14:10:00.836947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:00.836954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:00.836958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:00.836960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:00.836960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:00.836963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:00.837078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:00.891953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255368020585149:8250]
2025-10-01T14:10:00.892209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 955, pipe: [1:7556255368020585149:8250]
2025-10-01T14:10:00.992326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:00.992613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:00.992629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:00.992669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020585149:8250], now have 1 active actors on pipe
2025-10-01T14:10:00.992882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:00.992889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:00.992895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:00.992920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255368020585149:8250]
2025-10-01T14:10:00.992941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:00.992955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 956 reason: error at write: Disconnected sessionId: src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0
2025-10-01T14:10:00.993168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 956 sessionId: src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0 is DEAD
2025-10-01T14:10:00.993264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:00.993273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0] Write session will restart in 0.006642s
2025-10-01T14:10:00.993292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0] Write session: Do CDS request
2025-10-01T14:10:00.993296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:01.000862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.001019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:01.001042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 957
2025-10-01T14:10:01.001191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.001230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:01.001240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:01.001243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:01.001592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 957 sessionId:  describe result for acl check
2025-10-01T14:10:01.001620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:01.001626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:01.001628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:01.001633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255372315552558:8583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:01.002076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255372315552558:8583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:01.003676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255372315552558:8583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:01.006525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255372315552558:8583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:01.006541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255372315552558:8583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:01.006545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255372315552558:8583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:01.006553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:01.009040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:01.010697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:01.010870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:01.010881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:01.010893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:01.010936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:01.010973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255369938681150:7517]
2025-10-01T14:10:01.011559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:01.011802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:01.011845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:01.012143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:01.012194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.012200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.012201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.012202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.012204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.012205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.012206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.012207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.012208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.012209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.012210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.012211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.012212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.012213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.012218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.012227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.012231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.012235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.012239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.012243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.012246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.012250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.012253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.012258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.012262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.012265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.012269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.012273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.012279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.012287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.012294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.012300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.012304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.012309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.012314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.012319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.012324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.012335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.012340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.012349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.012354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.012362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.012367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.012376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.012381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.012386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.012390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.012400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.012404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.012409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.012417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.012423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.012431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.012436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.012444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.012449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.012491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:01.016248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:01.017135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:01.017159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:01.017162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:01.017166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:01.017174Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 956 [2:7556255369938681150:7517]
2025-10-01T14:10:01.017190Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:01.017212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:01.017215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.017218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.017221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.017238Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:01.017252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:01.017262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:01.017319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.017326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.017328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.017331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:01.017333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:01.017403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:01.017412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.017423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.017438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.017455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:01.017477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315552897:8583], now have 1 active actors on pipe
2025-10-01T14:10:01.017484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255368020585155:2446], now have 1 active actors on pipe
2025-10-01T14:10:01.017491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255369938681145:7517]
2025-10-01T14:10:01.017498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255369938681145:7517]
2025-10-01T14:10:01.017500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255369938681145:7517]
2025-10-01T14:10:01.017512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:01.017528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:01.017533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:01.017539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:01.017540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:01.017546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:01.017549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:01.017530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 956
2025-10-01T14:10:01.017579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255369938681145:7517]
2025-10-01T14:10:01.017591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:01.017550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 956
2025-10-01T14:10:01.017611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.017619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.017661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:01.017661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:01.017672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.017675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.017677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:01.017685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.017697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:01.017715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.017851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.017861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.017876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.017956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 957 partition: 0 MaxSeqNo: 45 sessionId: src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0
2025-10-01T14:10:01.018266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec8fcfe-25158dcc-f865af8c-ac8e8b6d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:01.020678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0] Write session: try to update token
2025-10-01T14:10:01.020695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:01.035327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 957 sessionId: src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:01.037595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:01.037836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.037865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.037885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:01.037889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:01.037891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:01.037893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:01.037902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255369938681145:7517]
2025-10-01T14:10:01.037907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255369938681145:7517]
2025-10-01T14:10:01.037911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255369938681145:7517]
2025-10-01T14:10:01.037952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:01.037966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:01.037968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:01.037971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:01.037973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.037976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:01.038091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:01.093132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255372315552946:8250]
2025-10-01T14:10:01.093401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 956, pipe: [1:7556255372315552946:8250]
2025-10-01T14:10:01.178331Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:01.178784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:01.178829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315552946:8250], now have 1 active actors on pipe
2025-10-01T14:10:01.178898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:01.179009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255372315552946:8250]
2025-10-01T14:10:01.179035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:01.188060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:01.188076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:01.188099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 957 reason: error at write: Disconnected sessionId: src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0
2025-10-01T14:10:01.188231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 957 sessionId: src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0 is DEAD
2025-10-01T14:10:01.188359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:01.188370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0] Write session will restart in 0.006228s
2025-10-01T14:10:01.188395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0] Write session: Do CDS request
2025-10-01T14:10:01.188403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:01.195898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.196005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:01.196018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 958
2025-10-01T14:10:01.196130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.196152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:01.196159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:01.196163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:01.196554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 958 sessionId:  describe result for acl check
2025-10-01T14:10:01.196588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:01.196593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:01.196595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:01.196600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255372315553400:8587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:01.197200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255372315553400:8587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:01.197552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:01.198906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:01.199052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:01.199060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:01.199067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:01.199095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:01.199120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255369938681434:7519]
2025-10-01T14:10:01.199319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255372315553400:8587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:01.199635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:01.201889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255372315553400:8587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:01.201905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255372315553400:8587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:01.201911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255372315553400:8587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:01.201923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:01.202351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:01.202456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:01.202803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:01.202860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.202866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.202867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.202868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.202869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.202871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.202872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.202873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.202875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.202876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.202877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.202878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.202879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.202881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.202887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.202897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.202901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.202905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.202908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.202912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.202917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.202920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.202924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.202928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.202932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.202936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.202939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.202943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.202952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.202960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.202966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.202971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.202975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.202980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.202984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.202989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.202993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.202999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.203003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.203008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.203013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.203018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.203022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.203027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.203031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.203036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.203040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.203045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.203053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.203058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.203062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.203067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.203071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.203076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.203085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.203090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.203130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:01.207273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:01.208522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:01.208536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:01.208538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:01.208542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:01.208550Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 957 [2:7556255369938681434:7519]
2025-10-01T14:10:01.208565Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:01.208578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:01.208580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.208583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.208584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.208598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:01.208602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:01.208607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:01.208656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.208662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.208663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.208666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:01.208668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:01.208724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:01.208729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.208747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.208752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.208761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:01.208779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255369938681429:7519]
2025-10-01T14:10:01.208780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255369938681429:7519]
2025-10-01T14:10:01.208782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255369938681429:7519]
2025-10-01T14:10:01.208789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:01.208800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:01.208801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:01.208804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:01.208806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:01.208820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:01.208822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:01.208834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315553437:8587], now have 1 active actors on pipe
2025-10-01T14:10:01.208837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315552949:2446], now have 1 active actors on pipe
2025-10-01T14:10:01.208873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255369938681429:7519]
2025-10-01T14:10:01.208888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:01.208910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:01.208899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 957
2025-10-01T14:10:01.208904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 957
2025-10-01T14:10:01.208962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.208974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.209005Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef148f45-e536c379-a355bab2-3871b175_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:01.209019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.209028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.209030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:01.209039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.209052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:01.209068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.209235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.209245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.209260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.209382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 958 partition: 0 MaxSeqNo: 45 sessionId: src_id|ef148f45-e536c379-a355bab2-3871b175_0
2025-10-01T14:10:01.209746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0d31d86-80e4e689-a7e12baa-af2679b3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ef148f45-e536c379-a355bab2-3871b175_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:01.212771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef148f45-e536c379-a355bab2-3871b175_0] Write session: try to update token
2025-10-01T14:10:01.212790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef148f45-e536c379-a355bab2-3871b175_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:01.222178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:01.222205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:01.222219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255369938681429:7519]
2025-10-01T14:10:01.222267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:01.222273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:01.222498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:01.222674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:01.222845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:01.223020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:01.223263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:01.223327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:01.234121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 958 sessionId: src_id|ef148f45-e536c379-a355bab2-3871b175_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:01.237018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:01.237256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.237293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.237342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:01.237456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:01.243103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:01.243120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:01.243121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:01.243123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:01.243133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255369938681429:7519]
2025-10-01T14:10:01.243136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255369938681429:7519]
2025-10-01T14:10:01.243139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255369938681429:7519]
2025-10-01T14:10:01.243178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:01.243183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.243185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:01.243193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:01.243199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:01.243203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:01.243303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:01.279023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255372315553448:8250]
2025-10-01T14:10:01.279308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 957, pipe: [1:7556255372315553448:8250]
2025-10-01T14:10:01.376115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:01.382736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.382758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.382891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.382942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.382996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.383043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.383081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.383090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.383141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.383189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.383240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.383292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.383329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.383335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.383396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.383448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.383501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.383556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.383595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.383601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.383657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.383707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.383759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.383810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.383846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.383851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.383911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.383961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.384011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.384123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.384161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.384166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.384220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.384269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.384321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.384373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.384418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.384426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.384480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.384533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.384582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.384633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.384689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.384694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.384759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.384810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.384861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.384916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.384972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.384977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.385030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.385077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.385131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.385182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.385234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.385240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.385291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:01.385345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:01.385396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:01.385458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:01.385502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:01.385507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:01.385544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315553448:8250], now have 1 active actors on pipe
2025-10-01T14:10:01.385818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:01.385829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:01.385833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:01.385858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 958 reason: error at write: Disconnected sessionId: src_id|ef148f45-e536c379-a355bab2-3871b175_0
2025-10-01T14:10:01.385883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255372315553448:8250]
2025-10-01T14:10:01.386091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 958 sessionId: src_id|ef148f45-e536c379-a355bab2-3871b175_0 is DEAD
2025-10-01T14:10:01.386229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef148f45-e536c379-a355bab2-3871b175_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:01.386240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef148f45-e536c379-a355bab2-3871b175_0] Write session will restart in 0.006290s
2025-10-01T14:10:01.386265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef148f45-e536c379-a355bab2-3871b175_0] Write session: Do CDS request
2025-10-01T14:10:01.386270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef148f45-e536c379-a355bab2-3871b175_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:01.386332Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:01.393858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef148f45-e536c379-a355bab2-3871b175_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.393961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:01.393974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 959
2025-10-01T14:10:01.394093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.394123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:01.394134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:01.394137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:01.394508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 959 sessionId:  describe result for acl check
2025-10-01T14:10:01.394537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:01.394542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:01.394544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:01.394549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255372315553648:8592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:01.395363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255372315553648:8592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:01.397179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255372315553648:8592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:01.399456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255372315553648:8592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:01.399468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255372315553648:8592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:01.399471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255372315553648:8592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:01.399478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:01.402214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:01.403847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:01.404110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:01.404119Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:01.404128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:01.404178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:01.404210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255369938681724:7521]
2025-10-01T14:10:01.404665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:01.404898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:01.404935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:01.405165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:01.405210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.405215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.405216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.405216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.405217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.405218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.405219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.405219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.405220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.405221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.405222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.405223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.405223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.405224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.405227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.405234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.405236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.405238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.405240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.405243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.405245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.405247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.405249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.405251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.405253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.405255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.405257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.405259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.405264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.405268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.405272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.405275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.405278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.405280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.405282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.405285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.405288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.405291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.405293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.405296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.405298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.405301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.405304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.405307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.405309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.405312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.405314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.405317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.405320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.405323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.405326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.405328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.405331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.405333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.405335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.405338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.405359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:01.409088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:01.410174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:01.410190Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:01.410193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:01.410197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:01.410203Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 958 [2:7556255369938681724:7521]
2025-10-01T14:10:01.410220Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:01.410248Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:01.410251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.410254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.410257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.410273Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:01.410284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:01.410294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:01.410360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.410385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.410390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.410393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:01.410396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:01.410461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:01.410468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.410479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.410493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.410512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:01.410534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315553913:8592], now have 1 active actors on pipe
2025-10-01T14:10:01.410541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315553459:2446], now have 1 active actors on pipe
2025-10-01T14:10:01.410547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255369938681719:7521]
2025-10-01T14:10:01.410549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255369938681719:7521]
2025-10-01T14:10:01.410551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255369938681719:7521]
2025-10-01T14:10:01.410568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:01.410565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 958
2025-10-01T14:10:01.410586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:01.410588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:01.410593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:01.410568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 958
2025-10-01T14:10:01.410595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:01.410604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:01.410607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:01.410654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.410663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.410675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255369938681719:7521]
2025-10-01T14:10:01.410688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:01.410702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:01.410721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:01.410732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.410737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.410743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:01.410753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.410765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:01.410790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.410935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.410945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.410962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.411151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 959 partition: 0 MaxSeqNo: 45 sessionId: src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0
2025-10-01T14:10:01.411489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef148f45-e536c379-a355bab2-3871b175_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:01.413705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0] Write session: try to update token
2025-10-01T14:10:01.413717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:01.426860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 959 sessionId: src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:01.429120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:01.431076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.431104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.431128Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:01.431132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:01.431134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:01.431136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:01.431146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255369938681719:7521]
2025-10-01T14:10:01.431151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255369938681719:7521]
2025-10-01T14:10:01.431156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255369938681719:7521]
2025-10-01T14:10:01.431191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:01.431205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:01.431208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:01.431215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:01.431224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.431226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:01.431393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:01.485877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255372315553960:8250]
2025-10-01T14:10:01.486157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 958, pipe: [1:7556255372315553960:8250]
2025-10-01T14:10:01.567057Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:01.567519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:01.567575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315553960:8250], now have 1 active actors on pipe
2025-10-01T14:10:01.567646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:01.567808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:01.567860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255372315553960:8250]
2025-10-01T14:10:01.576877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:01.576889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:01.576910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 959 reason: error at write: Disconnected sessionId: src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0
2025-10-01T14:10:01.577037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 959 sessionId: src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0 is DEAD
2025-10-01T14:10:01.577176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:01.577185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0] Write session will restart in 0.007100s
2025-10-01T14:10:01.577204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0] Write session: Do CDS request
2025-10-01T14:10:01.577211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:01.585851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.585951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:01.585964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 960
2025-10-01T14:10:01.586079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.586100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:01.586107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:01.586109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:01.586477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 960 sessionId:  describe result for acl check
2025-10-01T14:10:01.586511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:01.586517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:01.586519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:01.586524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255372315554416:8596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:01.587017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255372315554416:8596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:01.587436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:01.588903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:01.589077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:01.589089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:01.589101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:01.589154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:01.589187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255369938682011:7524]
2025-10-01T14:10:01.589284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255372315554416:8596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:01.589637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:01.589848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:01.589878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:01.590060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:01.590092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.590096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.590096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.590097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.590098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.590098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.590099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.590100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.590100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.590101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.590101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.590102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.590102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.590103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.590106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.590111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.590113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.590115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.590117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.590119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.590121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.590123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.590125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.590127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.590129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.590131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.590133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.590135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.590140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.590144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.590147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.590150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.590152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.590155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.590157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.590159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.590162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.590164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.590167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.590169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.590171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.590174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.590176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.590179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.590182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.590184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.590187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.590189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.590192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.590194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.590196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.590199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.590201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.590205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.590208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.590212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.590246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:01.593313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255372315554416:8596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:01.593328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255372315554416:8596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:01.593331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255372315554416:8596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:01.593339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:01.593526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:01.594439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:01.594456Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:01.594458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:01.594461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:01.594469Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 959 [2:7556255369938682011:7524]
2025-10-01T14:10:01.594482Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:01.594496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:01.594504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.594507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.594509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.594525Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:01.594530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:01.594540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:01.594589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.594596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.594598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.594601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:01.594604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:01.594667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:01.594674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.594685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.594697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.594716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:01.594736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315554456:8596], now have 1 active actors on pipe
2025-10-01T14:10:01.594742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315553963:2446], now have 1 active actors on pipe
2025-10-01T14:10:01.594749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255369938682006:7524]
2025-10-01T14:10:01.594751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255369938682006:7524]
2025-10-01T14:10:01.594752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255369938682006:7524]
2025-10-01T14:10:01.594765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:01.594781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:01.594780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:01.594783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:01.594785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:01.594795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:01.594797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:01.594790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 959
2025-10-01T14:10:01.594807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 959
2025-10-01T14:10:01.594822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255369938682006:7524]
2025-10-01T14:10:01.594829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:01.594832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:01.594844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.594855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.594896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:01.594908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.594912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.594914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:01.594922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.594930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:01.594951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.595115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.595126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.595140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.595215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 960 partition: 0 MaxSeqNo: 45 sessionId: src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0
2025-10-01T14:10:01.595538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc1ff5b-de4e5fcb-e1d9920f-3ca358_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:01.597880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0] Write session: try to update token
2025-10-01T14:10:01.597900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:01.611657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 960 sessionId: src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:01.614493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:01.615235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.615264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.615287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:01.615290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:01.615292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:01.615294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:01.615302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255369938682006:7524]
2025-10-01T14:10:01.615306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255369938682006:7524]
2025-10-01T14:10:01.615310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255369938682006:7524]
2025-10-01T14:10:01.615348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:01.615363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:01.615367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:01.615369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:01.615374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.615377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:01.615520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:01.668145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255372315554465:8250]
2025-10-01T14:10:01.668401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 959, pipe: [1:7556255372315554465:8250]
2025-10-01T14:10:01.755244Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:01.755893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:01.755953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315554465:8250], now have 1 active actors on pipe
2025-10-01T14:10:01.756023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:01.756170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255372315554465:8250]
2025-10-01T14:10:01.756193Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:01.766241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:01.766253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:01.766274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 960 reason: error at write: Disconnected sessionId: src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0
2025-10-01T14:10:01.766435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 960 sessionId: src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0 is DEAD
2025-10-01T14:10:01.766572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:01.766583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0] Write session will restart in 0.005243s
2025-10-01T14:10:01.766607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0] Write session: Do CDS request
2025-10-01T14:10:01.766617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:01.772848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.772955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:01.772971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 961
2025-10-01T14:10:01.773066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.773096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:01.773107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:01.773110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:01.773503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 961 sessionId:  describe result for acl check
2025-10-01T14:10:01.773540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:01.773543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:01.773545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:01.773550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255372315554898:8602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:01.774030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255372315554898:8602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:01.776125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255372315554898:8602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:01.777118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:01.777485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:01.777646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:01.777657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:01.777668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:01.777712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:01.777751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255369938682311:7527]
2025-10-01T14:10:01.778124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255372315554898:8602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:01.778135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255372315554898:8602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:01.778137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255372315554898:8602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:01.778142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:01.778281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:01.778521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:01.778565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:01.778849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:01.778906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.778912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.778913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.778914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.778915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.778916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.778917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.778918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.778920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.778921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.778922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.778923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.778924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.778925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.778929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.778937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.778941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.778944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.778948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.778952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.778955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.778957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.778960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.778963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.778966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.778970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.778973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.778976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.778982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.778995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.779004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.779013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.779022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.779031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.779038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.779042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.779047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.779051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.779055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.779059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.779063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.779072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.779080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.779089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.779097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.779106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.779114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.779121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.779129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.779137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.779145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.779150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.779157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.779161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.779169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.779178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.779214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:01.782646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:01.783406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:01.783423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:01.783425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:01.783428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:01.783435Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 960 [2:7556255369938682311:7527]
2025-10-01T14:10:01.783450Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:01.783469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:01.783476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.783479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.783481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.783495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:01.783506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:01.783511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:01.783562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.783568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.783569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.783572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:01.783574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:01.783636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:01.783642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.783651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.783661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.783679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:01.783700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315554481:2446], now have 1 active actors on pipe
2025-10-01T14:10:01.783707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315554972:8602], now have 1 active actors on pipe
2025-10-01T14:10:01.783714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255369938682306:7527]
2025-10-01T14:10:01.783720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255369938682306:7527]
2025-10-01T14:10:01.783722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255369938682306:7527]
2025-10-01T14:10:01.783734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:01.783748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:01.783751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:01.783736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 960
2025-10-01T14:10:01.783758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:01.783767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 960
2025-10-01T14:10:01.783760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:01.783764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:01.783766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:01.783794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255369938682306:7527]
2025-10-01T14:10:01.783798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:01.783799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:01.783816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.783823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.783863Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:01.783874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.783878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.783881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:01.783888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.783897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:01.783919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.784235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.784247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.784264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.784344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 961 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0
2025-10-01T14:10:01.784699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fbd221b-81c5c45a-1cfeaf01-8b69a6ee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:01.787194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0] Write session: try to update token
2025-10-01T14:10:01.787211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:01.801073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 961 sessionId: src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:01.803324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:01.803659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.803690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.803713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:01.803717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:01.803719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:01.803721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:01.803729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255369938682306:7527]
2025-10-01T14:10:01.803739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255369938682306:7527]
2025-10-01T14:10:01.803742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255369938682306:7527]
2025-10-01T14:10:01.803775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:01.803787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:01.803800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:01.803790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:01.803812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.803814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:01.803942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:01.856535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255372315555006:8250]
2025-10-01T14:10:01.856791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 960, pipe: [1:7556255372315555006:8250]
2025-10-01T14:10:01.939266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:01.939615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:01.939664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315555006:8250], now have 1 active actors on pipe
2025-10-01T14:10:01.939783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:01.939786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:01.939823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255372315555006:8250]
2025-10-01T14:10:01.939875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:01.939880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:01.939947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 961 reason: error at write: Disconnected sessionId: src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0
2025-10-01T14:10:01.940122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 961 sessionId: src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0 is DEAD
2025-10-01T14:10:01.940309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:01.940321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0] Write session will restart in 0.006859s
2025-10-01T14:10:01.940347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0] Write session: Do CDS request
2025-10-01T14:10:01.940353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:01.948953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.949035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:01.949051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 962
2025-10-01T14:10:01.949154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:01.949176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:01.949192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:01.949199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:01.949513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 962 sessionId:  describe result for acl check
2025-10-01T14:10:01.949545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:01.949555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:01.949556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:01.949562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255372315555285:8613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:01.950041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255372315555285:8613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:01.952316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255372315555285:8613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:01.953989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:01.954310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255372315555285:8613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:01.954321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255372315555285:8613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:01.954323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255372315555285:8613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:01.954330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:01.955516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:01.955726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:01.955739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:01.955753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:01.955812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:01.955852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255369938682610:7532]
2025-10-01T14:10:01.956461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:01.956755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:01.956813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:01.957126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:01.957205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.957212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.957213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.957214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.957215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.957216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.957217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.957218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.957219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.957220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.957221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.957222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.957224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.957225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.957230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.957240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.957244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.957247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.957251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.957255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.957258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.957261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.957265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.957268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.957271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.957275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.957278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.957281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.957289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.957296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:01.957302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.957306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:01.957310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.957315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:01.957318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.957323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:01.957334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.957339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:01.957346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.957351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:01.957357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.957366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:01.957370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.957374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:01.957378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.957382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:01.957386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.957391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.957400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.957404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.957407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.957411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.957417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.957426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:01.957430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.957439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:01.957475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:01.961269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:01.962254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:01.962267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:01.962270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:01.962273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:01.962281Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 961 [2:7556255369938682610:7532]
2025-10-01T14:10:01.962297Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:01.962318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:01.962325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.962328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.962331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.962347Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:01.962366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:01.962390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:01.962450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.962456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.962458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.962461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:01.962463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:01.962528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:01.962534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.962544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:01.962558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:01.962578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:01.962600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315555500:8613], now have 1 active actors on pipe
2025-10-01T14:10:01.962607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255372315555007:2446], now have 1 active actors on pipe
2025-10-01T14:10:01.962615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255369938682604:7532]
2025-10-01T14:10:01.962621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255369938682604:7532]
2025-10-01T14:10:01.962623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255369938682604:7532]
2025-10-01T14:10:01.962638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:01.962654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:01.962662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:01.962666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:01.962668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:01.962672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:01.962676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:01.962702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255369938682604:7532]
2025-10-01T14:10:01.962705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:01.962677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 961
2025-10-01T14:10:01.962720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:01.962760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 961
2025-10-01T14:10:01.962810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.962833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.962855Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff479a-c5163745-3222a423-3fc117ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:01.962867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:01.962872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:01.962879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:01.962889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:01.962902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:01.962918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.963054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.963068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.963089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:01.963164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 962 partition: 0 MaxSeqNo: 45 sessionId: src_id|ff479a-c5163745-3222a423-3fc117ea_0
2025-10-01T14:10:01.963545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b12db23-1a0d2c91-2004ae61-2b4cd628_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ff479a-c5163745-3222a423-3fc117ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:01.966127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff479a-c5163745-3222a423-3fc117ea_0] Write session: try to update token
2025-10-01T14:10:01.966144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff479a-c5163745-3222a423-3fc117ea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:01.973525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:01.973542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:01.973551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255369938682604:7532]
2025-10-01T14:10:01.973582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:01.973591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:01.973744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:01.973890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:01.974030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:01.974163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:01.974343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:01.974398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:01.979130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 962 sessionId: src_id|ff479a-c5163745-3222a423-3fc117ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:01.981978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:01.982159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:01.982179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:01.982216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:01.982314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:01.992560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:01.992578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:01.992580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:01.992582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:01.992592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255369938682604:7532]
2025-10-01T14:10:01.992595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255369938682604:7532]
2025-10-01T14:10:01.992599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255369938682604:7532]
2025-10-01T14:10:01.992634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:01.992639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:01.992642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:01.992648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:01.992654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:01.992657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:01.992834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:02.039846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255376610522808:8250]
2025-10-01T14:10:02.040135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 961, pipe: [1:7556255376610522808:8250]
2025-10-01T14:10:02.137212Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:02.144646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.144673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.144836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.144887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.144943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.145003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.145043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.145050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.145111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.145178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.145234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.145291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.145342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.145349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.145410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.145464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.145516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.145572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.145612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.145617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.145678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.145735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.145797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.145859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.146161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.146169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.146226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.146277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.146330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.146411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.146453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.146459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.146517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.146571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.146627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.146681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.146721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.146729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.146789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.146842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.146910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.146965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.147002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.147007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.147066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.147125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.147179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.147230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.147267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.147272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.147323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.147373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.147427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.147500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.147541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.147545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.147597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.147645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.147693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.147743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.147782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.147786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.147844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610522808:8250], now have 1 active actors on pipe
2025-10-01T14:10:02.148025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:02.148028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:02.148031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:02.148052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 962 reason: error at write: Disconnected sessionId: src_id|ff479a-c5163745-3222a423-3fc117ea_0
2025-10-01T14:10:02.148078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255376610522808:8250]
2025-10-01T14:10:02.148233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 962 sessionId: src_id|ff479a-c5163745-3222a423-3fc117ea_0 is DEAD
2025-10-01T14:10:02.148378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff479a-c5163745-3222a423-3fc117ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:02.148388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff479a-c5163745-3222a423-3fc117ea_0] Write session will restart in 0.005631s
2025-10-01T14:10:02.148414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff479a-c5163745-3222a423-3fc117ea_0] Write session: Do CDS request
2025-10-01T14:10:02.148420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff479a-c5163745-3222a423-3fc117ea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:02.148559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:02.154861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff479a-c5163745-3222a423-3fc117ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.154967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:02.154983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 963
2025-10-01T14:10:02.155093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.155127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:02.155136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:02.155144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:02.155599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 963 sessionId:  describe result for acl check
2025-10-01T14:10:02.155629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:02.155636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:02.155637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:02.155642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255376610522909:8619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:02.156123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255376610522909:8619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:02.158526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255376610522909:8619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:02.160829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255376610522909:8619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:02.160839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255376610522909:8619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:02.160842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255376610522909:8619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:02.160847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:02.162908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:02.164066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:02.164207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:02.164214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:02.164222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:02.164252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:02.164281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255374233650226:7544]
2025-10-01T14:10:02.164663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:02.164863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:02.164888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:02.165093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:02.165133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.165137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.165137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.165138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.165138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.165139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.165140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.165140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.165141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.165141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.165142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.165142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.165143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.165144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.165146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.165152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.165154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.165156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.165158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.165160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.165162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.165164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.165166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.165168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.165170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.165172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.165174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.165176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.165181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.165185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.165189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.165192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.165194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.165197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.165199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.165202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.165204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.165207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.165209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.165212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.165215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.165217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.165220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.165222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.165226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.165228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.165230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.165233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.165236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.165239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.165241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.165244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.165246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.165248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.165251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.165253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.165271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:02.168577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:02.169330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:02.169338Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:02.169339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:02.169342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:02.169347Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 962 [2:7556255374233650226:7544]
2025-10-01T14:10:02.169358Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:02.169371Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:02.169372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.169374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.169375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.169386Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:02.169391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:02.169396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:02.169447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.169453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.169455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.169458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:02.169460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:02.169521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:02.169526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.169533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.169539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.169547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:02.169563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610523292:8619], now have 1 active actors on pipe
2025-10-01T14:10:02.169570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610522814:2446], now have 1 active actors on pipe
2025-10-01T14:10:02.169578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255374233650221:7544]
2025-10-01T14:10:02.169584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255374233650221:7544]
2025-10-01T14:10:02.169586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255374233650221:7544]
2025-10-01T14:10:02.169598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:02.169609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:02.169613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:02.169617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:02.169618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:02.169627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:02.169629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:02.169656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255374233650221:7544]
2025-10-01T14:10:02.169665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:02.169679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:02.169674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 962
2025-10-01T14:10:02.169729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 962
2025-10-01T14:10:02.169775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.169784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.169805Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:02.169815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.169819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.169825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:02.169833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.169840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:02.169855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.169965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.169971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.169983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.170053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 963 partition: 0 MaxSeqNo: 45 sessionId: src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0
2025-10-01T14:10:02.170401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff479a-c5163745-3222a423-3fc117ea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:02.172667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0] Write session: try to update token
2025-10-01T14:10:02.172682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:02.188810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:02.188828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:02.188831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:02.188833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:02.188847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255374233650221:7544]
2025-10-01T14:10:02.188851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255374233650221:7544]
2025-10-01T14:10:02.188856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255374233650221:7544]
2025-10-01T14:10:02.188904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:02.188909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:02.188913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:02.188920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:02.188928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.188931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:02.189064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:02.189926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 963 sessionId: src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:02.192394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:02.248264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255376610523318:8250]
2025-10-01T14:10:02.248500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 962, pipe: [1:7556255376610523318:8250]
2025-10-01T14:10:02.327990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:02.328636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.328650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.328688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610523318:8250], now have 1 active actors on pipe
2025-10-01T14:10:02.328896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:02.328973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:02.328973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:02.328993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:02.329019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255376610523318:8250]
2025-10-01T14:10:02.329054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 963 reason: error at write: Disconnected sessionId: src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0
2025-10-01T14:10:02.329274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 963 sessionId: src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0 is DEAD
2025-10-01T14:10:02.329450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:02.329466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0] Write session will restart in 0.006319s
2025-10-01T14:10:02.329496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0] Write session: Do CDS request
2025-10-01T14:10:02.329501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:02.336937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.336963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:02.336974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 964
2025-10-01T14:10:02.337265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.337302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:02.337312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:02.337315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:02.337669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 964 sessionId:  describe result for acl check
2025-10-01T14:10:02.337699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:02.337705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:02.337707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:02.337712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255376610523435:8624] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:02.338226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255376610523435:8624] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:02.340148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255376610523435:8624] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:02.342469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255376610523435:8624] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:02.342484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255376610523435:8624] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:02.342487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255376610523435:8624] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:02.342495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:02.345001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:02.346403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:02.346606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:02.346617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:02.346629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:02.346682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:02.346720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255374233650517:7546]
2025-10-01T14:10:02.347329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:02.347649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:02.347701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:02.347992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:02.348061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.348069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.348070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.348072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.348073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.348074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.348075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.348076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.348077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.348078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.348079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.348080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.348082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.348083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.348088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.348098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.348102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.348106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.348109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.348114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.348118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.348122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.348125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.348129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.348133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.348136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.348140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.348144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.348152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.348160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.348166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.348171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.348175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.348180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.348184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.348189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.348193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.348199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.348204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.348208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.348213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.348218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.348222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.348226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.348231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.348236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.348242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.348252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.348258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.348264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.348273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.348278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.348282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.348288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.348296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.348302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.348342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:02.352090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:02.352672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:02.352700Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:02.352703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:02.352707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:02.352714Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 963 [2:7556255374233650517:7546]
2025-10-01T14:10:02.352729Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:02.352756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:02.352764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.352768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.352771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.352786Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:02.352795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:02.352802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:02.352859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.352866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.352868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.352871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:02.352874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:02.352938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:02.352946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.352958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.352974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.352996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:02.353017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610523773:8624], now have 1 active actors on pipe
2025-10-01T14:10:02.353025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610523326:2446], now have 1 active actors on pipe
2025-10-01T14:10:02.353032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255374233650512:7546]
2025-10-01T14:10:02.353034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255374233650512:7546]
2025-10-01T14:10:02.353037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255374233650512:7546]
2025-10-01T14:10:02.353049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:02.353066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:02.353067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:02.353071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:02.353073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:02.353085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:02.353087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:02.353058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 963
2025-10-01T14:10:02.353063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 963
2025-10-01T14:10:02.353112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255374233650512:7546]
2025-10-01T14:10:02.353119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:02.353121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:02.353137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.353148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.353194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:02.353200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.353205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.353207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:02.353215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.353224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:02.353246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.353604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.353615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.353634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.353704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 964 partition: 0 MaxSeqNo: 45 sessionId: src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0
2025-10-01T14:10:02.354041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73aaabb-af2cc815-e4b57d03-3562f2b1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:02.356956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0] Write session: try to update token
2025-10-01T14:10:02.356975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:02.372025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 964 sessionId: src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:02.373599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:02.373620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:02.373622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:02.373625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:02.373634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255374233650512:7546]
2025-10-01T14:10:02.373642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255374233650512:7546]
2025-10-01T14:10:02.373645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255374233650512:7546]
2025-10-01T14:10:02.373695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:02.373701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.373704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:02.373828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:02.374158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:02.374166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:02.374169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:02.374439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:02.428942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255376610523834:8250]
2025-10-01T14:10:02.429182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 963, pipe: [1:7556255376610523834:8250]
2025-10-01T14:10:02.511555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:02.512125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.512139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.512174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610523834:8250], now have 1 active actors on pipe
2025-10-01T14:10:02.512344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:02.512510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255376610523834:8250]
2025-10-01T14:10:02.512545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:02.512545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:02.512645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 964 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0
2025-10-01T14:10:02.512860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 964 sessionId: src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0 is DEAD
2025-10-01T14:10:02.513008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:02.513022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0] Write session will restart in 0.007615s
2025-10-01T14:10:02.513050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0] Write session: Do CDS request
2025-10-01T14:10:02.513055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:02.521931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.522028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:02.522044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 965
2025-10-01T14:10:02.522213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.522248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:02.522258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:02.522262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:02.522726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 965 sessionId:  describe result for acl check
2025-10-01T14:10:02.522759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:02.522765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:02.522767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:02.522773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255376610523934:8628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:02.523369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255376610523934:8628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:02.526207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255376610523934:8628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:02.528993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255376610523934:8628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:02.529014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255376610523934:8628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:02.529018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255376610523934:8628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:02.529027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:02.534030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:02.536005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:02.536166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:02.536175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:02.536183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:02.536218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:02.536257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255374233650811:7549]
2025-10-01T14:10:02.536773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:02.537133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:02.537179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:02.537485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:02.537541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.537547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.537548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.537549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.537550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.537551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.537552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.537553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.537554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.537555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.537556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.537557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.537558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.537558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.537562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.537569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.537571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.537574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.537576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.537579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.537581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.537584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.537586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.537589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.537591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.537594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.537596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.537598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.537605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.537611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.537616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.537619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.537622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.537626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.537628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.537632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.537635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.537638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.537642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.537644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.537647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.537651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.537654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.537657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.537660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.537663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.537668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.537672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.537674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.537678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.537680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.537684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.537689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.537694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.537698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.537703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.537758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:02.542042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:02.542756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:02.542768Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:02.542771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:02.542776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:02.542783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 964 [2:7556255374233650811:7549]
2025-10-01T14:10:02.542797Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:02.542814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:02.542822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.542825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.542827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.542839Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:02.542843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:02.542850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:02.542907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.542915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.542916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.542919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:02.542921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:02.542978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:02.542991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.542999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.543006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.543015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:02.543028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255374233650806:7549]
2025-10-01T14:10:02.543030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255374233650806:7549]
2025-10-01T14:10:02.543032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255374233650806:7549]
2025-10-01T14:10:02.543040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:02.543053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:02.543054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:02.543058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:02.543060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:02.543062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:02.543065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:02.543072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610523837:2446], now have 1 active actors on pipe
2025-10-01T14:10:02.543075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610524205:8628], now have 1 active actors on pipe
2025-10-01T14:10:02.543104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255374233650806:7549]
2025-10-01T14:10:02.543117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:02.543127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:02.543561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 964
2025-10-01T14:10:02.543576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 964
2025-10-01T14:10:02.543642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.543651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.543673Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:02.543682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.543686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.543687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:02.543697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.543705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:02.543717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.543867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.543879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.543887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.543976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 965 partition: 0 MaxSeqNo: 45 sessionId: src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0
2025-10-01T14:10:02.544309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fed73678-272fafc0-79e56b0e-727f1a0a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:02.547357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0] Write session: try to update token
2025-10-01T14:10:02.547376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:02.559432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:02.559450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:02.559460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255374233650806:7549]
2025-10-01T14:10:02.559504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:02.559518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:02.559686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:02.559829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:02.559974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:02.560117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:02.560950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:02.560997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:02.567985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 965 sessionId: src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:02.570906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:02.571465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.571490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.571526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:02.571643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:02.573981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:02.573995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:02.573998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:02.573999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:02.574007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255374233650806:7549]
2025-10-01T14:10:02.574011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255374233650806:7549]
2025-10-01T14:10:02.574015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255374233650806:7549]
2025-10-01T14:10:02.574058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:02.574065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:02.574067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.574069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:02.574077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:02.574081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:02.574232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:02.612797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255376610524343:8250]
2025-10-01T14:10:02.613091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 964, pipe: [1:7556255376610524343:8250]
2025-10-01T14:10:02.721432Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:02.730767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.730797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.730968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.731038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.731106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.731174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.731227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.731237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.731305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.731378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.731448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.731511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.731560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.731569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.731642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.731718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.731784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.731851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.731900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.731908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.731987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.732057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.732127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.732192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.732236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.732243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.732321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.732391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.732491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.732559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.732611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.732619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.732688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.732771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.732843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.732913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.732963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.732971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.733042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.733104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.733175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.733243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.733289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.733296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.733362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.733422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.733483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.733544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.733587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.733596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.733669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.733733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.733797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.733863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.733907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.733914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.733984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:02.734047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:02.734110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:02.734175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:02.734236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:02.734242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:02.734307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610524343:8250], now have 1 active actors on pipe
2025-10-01T14:10:02.734550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255376610524343:8250]
2025-10-01T14:10:02.734694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:02.734717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:02.734721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:02.734750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 965 reason: error at write: Disconnected sessionId: src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0
2025-10-01T14:10:02.734989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 965 sessionId: src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0 is DEAD
2025-10-01T14:10:02.735195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:02.735208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0] Write session will restart in 0.008309s
2025-10-01T14:10:02.735238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0] Write session: Do CDS request
2025-10-01T14:10:02.735246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:02.735509Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:02.746887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.746973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:02.746991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 966
2025-10-01T14:10:02.747261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.747315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:02.747329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:02.747334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:02.747773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 966 sessionId:  describe result for acl check
2025-10-01T14:10:02.747812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:02.747814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:02.747816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:02.747823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255376610524596:8634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:02.748386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255376610524596:8634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:02.750734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255376610524596:8634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:02.753301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255376610524596:8634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:02.753319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255376610524596:8634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:02.753323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255376610524596:8634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:02.753331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:02.757737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:02.759543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:02.759749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:02.759759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:02.759768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:02.759807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:02.759843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255374233651117:7552]
2025-10-01T14:10:02.760423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:02.760707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:02.760764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:02.761047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:02.761095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.761100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.761101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.761101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.761102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.761103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.761104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.761104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.761105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.761106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.761106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.761107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.761108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.761109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.761113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.761119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.761122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.761124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.761126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.761129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.761131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.761133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.761136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.761138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.761140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.761143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.761147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.761151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.761157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.761165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.761171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.761177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.761182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.761187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.761192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.761197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.761202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.761208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.761212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.761218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.761222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.761228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.761232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.761237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.761242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.761248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.761254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.761259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.761264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.761269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.761273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.761277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.761282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.761287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.761291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.761297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.761339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:02.765165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:02.765874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:02.765885Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:02.765889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:02.765893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:02.765899Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 965 [2:7556255374233651117:7552]
2025-10-01T14:10:02.765916Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:02.765933Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:02.765940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.765944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.765946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.765962Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:02.765970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:02.765977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:02.766028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.766034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.766036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.766040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:02.766043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:02.766110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:02.766116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.766128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.766143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.766163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:02.766183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610524360:2446], now have 1 active actors on pipe
2025-10-01T14:10:02.766190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610524774:8634], now have 1 active actors on pipe
2025-10-01T14:10:02.766198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255374233651112:7552]
2025-10-01T14:10:02.766204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255374233651112:7552]
2025-10-01T14:10:02.766207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255374233651112:7552]
2025-10-01T14:10:02.766219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:02.766202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 965
2025-10-01T14:10:02.766232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:02.766222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 965
2025-10-01T14:10:02.766237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:02.766239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:02.766241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:02.766250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:02.766252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:02.766294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.766302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.766316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255374233651112:7552]
2025-10-01T14:10:02.766326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:02.766333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:02.766356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:02.766366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.766386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.766392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:02.766402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.766414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:02.766438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.766586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.766595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.766610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.766683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 966 partition: 0 MaxSeqNo: 45 sessionId: src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0
2025-10-01T14:10:02.767085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d901eea-3abf91f8-b864b37e-d17c4fa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:02.769759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0] Write session: try to update token
2025-10-01T14:10:02.769775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:02.786954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:02.786977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:02.786980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:02.786982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:02.786994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255374233651112:7552]
2025-10-01T14:10:02.787000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255374233651112:7552]
2025-10-01T14:10:02.787005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255374233651112:7552]
2025-10-01T14:10:02.787052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:02.787055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:02.787062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:02.787062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.787065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:02.787066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:02.787203Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:02.787724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 966 sessionId: src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:02.790159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:02.834973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255376610524881:8250]
2025-10-01T14:10:02.835211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 965, pipe: [1:7556255376610524881:8250]
2025-10-01T14:10:02.946612Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:02.947283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.947300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.947341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610524881:8250], now have 1 active actors on pipe
2025-10-01T14:10:02.947625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255376610524881:8250]
2025-10-01T14:10:02.947641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:02.947674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:02.947676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:02.947735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 966 reason: error at write: Disconnected sessionId: src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0
2025-10-01T14:10:02.947979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 966 sessionId: src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0 is DEAD
2025-10-01T14:10:02.948139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:02.948149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0] Write session will restart in 0.007303s
2025-10-01T14:10:02.948170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0] Write session: Do CDS request
2025-10-01T14:10:02.948177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:02.948175Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:02.956933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.957024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:02.957039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 967
2025-10-01T14:10:02.957172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:02.957205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:02.957215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:02.957219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:02.957606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 967 sessionId:  describe result for acl check
2025-10-01T14:10:02.957648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:02.957657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:02.957660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:02.957665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255376610525035:8645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:02.958175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255376610525035:8645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:02.960265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255376610525035:8645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:02.963260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255376610525035:8645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:02.963274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255376610525035:8645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:02.963278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255376610525035:8645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:02.963285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:02.964749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:02.966244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:02.966432Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:02.966441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:02.966451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:02.966493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:02.966522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255374233651421:7557]
2025-10-01T14:10:02.966947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:02.967192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:02.967219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:02.967425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:02.967464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.967468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.967469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.967470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.967471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.967471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.967472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.967472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.967474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.967475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.967475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.967476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.967477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.967477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.967480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.967487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.967490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.967492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.967494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.967497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.967499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.967501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.967503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.967505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.967508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.967510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.967512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.967514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.967519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.967524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:02.967527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.967531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:02.967533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.967537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:02.967539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.967542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:02.967545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.967548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:02.967554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.967556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:02.967560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.967563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:02.967566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.967570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:02.967573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.967576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:02.967580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.967586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.967589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.967592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.967594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.967596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.967599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.967601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:02.967607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.967610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:02.967630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:02.971464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:02.972017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:02.972024Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:02.972026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:02.972029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:02.972034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 966 [2:7556255374233651421:7557]
2025-10-01T14:10:02.972045Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:02.972060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:02.972065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.972068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.972070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.972081Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:02.972088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:02.972094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:02.972163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.972168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.972170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.972172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:02.972174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:02.972226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:02.972231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:02.972237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:02.972243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:02.972253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:02.972266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610524892:2446], now have 1 active actors on pipe
2025-10-01T14:10:02.972273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255376610525387:8645], now have 1 active actors on pipe
2025-10-01T14:10:02.972279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255374233651416:7557]
2025-10-01T14:10:02.972280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255374233651416:7557]
2025-10-01T14:10:02.972282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255374233651416:7557]
2025-10-01T14:10:02.972288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:02.972301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:02.972305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:02.972308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:02.972313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:02.972316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:02.972318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:02.972340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255374233651416:7557]
2025-10-01T14:10:02.972346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:02.972359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:02.972335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 966
2025-10-01T14:10:02.972351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 966
2025-10-01T14:10:02.972382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.972392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.972413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eac63563-84da1903-f7b0a666-863cacdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:02.972421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:02.972425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:02.972427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:02.972433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:02.972439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:02.972450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.972548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.972555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.972564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:02.972632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 967 partition: 0 MaxSeqNo: 45 sessionId: src_id|eac63563-84da1903-f7b0a666-863cacdd_0
2025-10-01T14:10:02.973025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b46fb8-b498dae9-93b1ecc9-dcc6a676_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eac63563-84da1903-f7b0a666-863cacdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:02.975518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63563-84da1903-f7b0a666-863cacdd_0] Write session: try to update token
2025-10-01T14:10:02.975534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63563-84da1903-f7b0a666-863cacdd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:02.983991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:02.984006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:02.984016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255374233651416:7557]
2025-10-01T14:10:02.984050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:02.984054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:02.984226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:02.984370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:02.984538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:02.984676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:02.984876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:02.984912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:02.989356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 967 sessionId: src_id|eac63563-84da1903-f7b0a666-863cacdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:02.991757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:02.991967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:02.991991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:02.992022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:02.992103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:03.003826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:03.003841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:03.003843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:03.003844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:03.003854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255374233651416:7557]
2025-10-01T14:10:03.003857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255374233651416:7557]
2025-10-01T14:10:03.003859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255374233651416:7557]
2025-10-01T14:10:03.003899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:03.003898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:03.003904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:03.003906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.003907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:03.003908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:03.004038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:03.047502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255380905492697:8250]
2025-10-01T14:10:03.047808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 966, pipe: [1:7556255380905492697:8250]
2025-10-01T14:10:03.143553Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:03.151213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.151239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.151394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.151457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.151518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.151583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.151632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.151637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.151705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.151760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.151828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.151894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.151935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.151940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.151996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.152048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.152103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.152156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.152197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.152203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.152259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.152317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.152380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.152434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.152475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.152481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.152537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.152594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.152656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.152714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.152775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.152780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.152840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.152900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.152957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.153019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.153104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.153110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.153167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.153225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.153284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.153345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.153394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.153399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.153463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.153531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.153589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.153656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.153709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.153715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.153786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.153854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.153920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.153983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.154034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.154041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.154111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:03.154178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:03.154248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:03.154313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:03.154354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:03.154363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:03.154448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905492697:8250], now have 1 active actors on pipe
2025-10-01T14:10:03.154705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:03.154764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:03.154772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:03.154802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 967 reason: error at write: Disconnected sessionId: src_id|eac63563-84da1903-f7b0a666-863cacdd_0
2025-10-01T14:10:03.154813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255380905492697:8250]
2025-10-01T14:10:03.155129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 967 sessionId: src_id|eac63563-84da1903-f7b0a666-863cacdd_0 is DEAD
2025-10-01T14:10:03.155256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63563-84da1903-f7b0a666-863cacdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:03.155275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63563-84da1903-f7b0a666-863cacdd_0] Write session will restart in 0.009335s
2025-10-01T14:10:03.155304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63563-84da1903-f7b0a666-863cacdd_0] Write session: Do CDS request
2025-10-01T14:10:03.155311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63563-84da1903-f7b0a666-863cacdd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:03.155542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:03.165841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63563-84da1903-f7b0a666-863cacdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.165951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:03.165967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 968
2025-10-01T14:10:03.166094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.166125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:03.166137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:03.166141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:03.166542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 968 sessionId:  describe result for acl check
2025-10-01T14:10:03.166577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:03.166583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:03.166584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:03.166590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255380905492990:8649] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:03.167184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255380905492990:8649] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:03.169637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255380905492990:8649] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:03.172533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:03.172580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255380905492990:8649] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:03.172594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255380905492990:8649] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:03.172597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255380905492990:8649] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:03.172605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:03.174425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:03.174638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:03.174650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:03.174661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:03.174715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:03.174773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255378528619041:7569]
2025-10-01T14:10:03.175365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:03.175681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:03.175730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:03.176040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:03.176100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.176106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.176107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.176108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.176109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.176110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.176111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.176112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.176113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.176115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.176116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.176117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.176118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.176119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.176124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.176134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.176138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.176142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.176145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.176149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.176152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.176156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.176165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.176169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.176173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.176182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.176186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.176190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.176197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.176205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.176216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.176221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.176228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.176232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.176236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.176246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.176250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.176254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.176259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.176268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.176273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.176282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.176286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.176291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.176300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.176311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.176315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.176320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.176325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.176330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.176338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.176343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.176348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.176357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.176361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.176366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.176411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:03.180250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:03.180881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:03.180891Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:03.180893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:03.180895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:03.180901Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 967 [2:7556255378528619041:7569]
2025-10-01T14:10:03.180911Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:03.180925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:03.180927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.180931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.180934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.180949Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:03.180958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:03.180965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:03.181022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.181029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.181031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.181034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:03.181037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:03.181094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:03.181099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.181110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.181120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.181143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:03.181160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905492700:2446], now have 1 active actors on pipe
2025-10-01T14:10:03.181168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905493197:8649], now have 1 active actors on pipe
2025-10-01T14:10:03.181176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255378528619035:7569]
2025-10-01T14:10:03.181182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255378528619035:7569]
2025-10-01T14:10:03.181184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255378528619035:7569]
2025-10-01T14:10:03.181197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:03.181214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:03.181219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:03.181222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:03.181224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:03.181231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:03.181237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:03.181232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 967
2025-10-01T14:10:03.181270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255378528619035:7569]
2025-10-01T14:10:03.181280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:03.181244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 967
2025-10-01T14:10:03.181286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:03.181299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.181309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.181361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:03.181374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.181379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.181382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:03.181391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.181399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:03.181416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.181567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.181578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.181592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.181657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 968 partition: 0 MaxSeqNo: 45 sessionId: src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0
2025-10-01T14:10:03.182020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eac63563-84da1903-f7b0a666-863cacdd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:03.184466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0] Write session: try to update token
2025-10-01T14:10:03.184481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:03.197469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 968 sessionId: src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:03.199812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:03.201206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.201225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.201242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:03.201245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:03.201247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:03.201248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:03.201254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255378528619035:7569]
2025-10-01T14:10:03.201257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255378528619035:7569]
2025-10-01T14:10:03.201260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255378528619035:7569]
2025-10-01T14:10:03.201293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:03.201301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:03.201303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:03.201304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:03.201308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.201310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:03.201427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:03.254825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255380905493209:8250]
2025-10-01T14:10:03.255033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 967, pipe: [1:7556255380905493209:8250]
2025-10-01T14:10:03.342279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:03.342904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:03.342955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905493209:8250], now have 1 active actors on pipe
2025-10-01T14:10:03.343032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:03.343234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:03.343287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255380905493209:8250]
2025-10-01T14:10:03.352680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:03.352695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:03.352717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 968 reason: error at write: Disconnected sessionId: src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0
2025-10-01T14:10:03.352904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 968 sessionId: src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0 is DEAD
2025-10-01T14:10:03.353076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:03.353090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0] Write session will restart in 0.008492s
2025-10-01T14:10:03.353112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0] Write session: Do CDS request
2025-10-01T14:10:03.353119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:03.363715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:03.363853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.363919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:03.363933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 969
2025-10-01T14:10:03.364126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.364161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:03.364169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:03.364173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:03.364549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 969 sessionId:  describe result for acl check
2025-10-01T14:10:03.364584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:03.364586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:03.364588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:03.364593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255380905493685:8654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:03.365093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255380905493685:8654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:03.365828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:03.366002Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:03.366012Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:03.366023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:03.366072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:03.366107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255378528619336:7571]
2025-10-01T14:10:03.366658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:03.366908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:03.366947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:03.367213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:03.367273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.367279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.367280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.367280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.367281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.367282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.367283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.367284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.367285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.367286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.367287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.367288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.367289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.367290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.367295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.367303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.367307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.367310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.367313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.367316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.367319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.367322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.367325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.367328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.367332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.367335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.367338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.367341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.367347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.367354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.367369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.367374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.367380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.367384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.367388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.367392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.367395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.367400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.367404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.367408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.367413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.367417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.367420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.367424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.367428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.367432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.367435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.367440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.367444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.367448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.367451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.367455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.367459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.367464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.367467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.367471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.367502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:03.367943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255380905493685:8654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:03.370775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255380905493685:8654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:03.370791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255380905493685:8654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:03.370795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255380905493685:8654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:03.370803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:03.370977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:03.371512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:03.371521Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:03.371523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:03.371525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:03.371530Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 968 [2:7556255378528619336:7571]
2025-10-01T14:10:03.371542Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:03.371554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:03.371556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.371558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.371560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.371570Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:03.371578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:03.371582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:03.371631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.371636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.371638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.371640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:03.371642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:03.371689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:03.371694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.371701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.371706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.371715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:03.371730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905493723:8654], now have 1 active actors on pipe
2025-10-01T14:10:03.371736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905493217:2446], now have 1 active actors on pipe
2025-10-01T14:10:03.371740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255378528619331:7571]
2025-10-01T14:10:03.371743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255378528619331:7571]
2025-10-01T14:10:03.371744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255378528619331:7571]
2025-10-01T14:10:03.371753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:03.371765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:03.371768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:03.371770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:03.371773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:03.371776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:03.371778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:03.371768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 968
2025-10-01T14:10:03.371795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255378528619331:7571]
2025-10-01T14:10:03.371800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:03.371793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 968
2025-10-01T14:10:03.371803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:03.371815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.371820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.371850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5881d919-f5de0bb-5346da90-a19bc35e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:03.371858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.371861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.371864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:03.371870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.371879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:03.371891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.372043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.372050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.372061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.372119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 969 partition: 0 MaxSeqNo: 45 sessionId: src_id|5881d919-f5de0bb-5346da90-a19bc35e_0
2025-10-01T14:10:03.372505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|559bf8cc-5829bf77-fc4ef70-161f2f31_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5881d919-f5de0bb-5346da90-a19bc35e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:03.375404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5881d919-f5de0bb-5346da90-a19bc35e_0] Write session: try to update token
2025-10-01T14:10:03.375443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5881d919-f5de0bb-5346da90-a19bc35e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:03.390880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:03.390897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:03.390898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:03.390900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:03.390908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255378528619331:7571]
2025-10-01T14:10:03.390911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255378528619331:7571]
2025-10-01T14:10:03.390914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255378528619331:7571]
2025-10-01T14:10:03.390958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:03.390958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:03.390962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:03.390965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:03.390969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.390971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:03.391096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:03.391922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 969 sessionId: src_id|5881d919-f5de0bb-5346da90-a19bc35e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:03.394540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:03.443243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255380905493730:8250]
2025-10-01T14:10:03.443515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 968, pipe: [1:7556255380905493730:8250]
2025-10-01T14:10:03.530097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:03.530779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.530800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.530847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905493730:8250], now have 1 active actors on pipe
2025-10-01T14:10:03.531063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:03.531098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:03.531113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:03.531116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:03.531161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255380905493730:8250]
2025-10-01T14:10:03.531169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 969 reason: error at write: Disconnected sessionId: src_id|5881d919-f5de0bb-5346da90-a19bc35e_0
2025-10-01T14:10:03.531414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 969 sessionId: src_id|5881d919-f5de0bb-5346da90-a19bc35e_0 is DEAD
2025-10-01T14:10:03.531582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5881d919-f5de0bb-5346da90-a19bc35e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:03.531597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5881d919-f5de0bb-5346da90-a19bc35e_0] Write session will restart in 0.006992s
2025-10-01T14:10:03.531644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5881d919-f5de0bb-5346da90-a19bc35e_0] Write session: Do CDS request
2025-10-01T14:10:03.531650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5881d919-f5de0bb-5346da90-a19bc35e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:03.540413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5881d919-f5de0bb-5346da90-a19bc35e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.540578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:03.540595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 970
2025-10-01T14:10:03.540795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.540830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:03.540840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:03.540844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:03.541210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 970 sessionId:  describe result for acl check
2025-10-01T14:10:03.541242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:03.541246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:03.541248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:03.541252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255380905493905:8658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:03.541717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255380905493905:8658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:03.544324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255380905493905:8658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:03.546822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255380905493905:8658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:03.546841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255380905493905:8658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:03.546844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255380905493905:8658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:03.546852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:03.550765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:03.552307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:03.552519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:03.552527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:03.552539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:03.552582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:03.552619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255378528619636:7574]
2025-10-01T14:10:03.553211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:03.553447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:03.553501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:03.553849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:03.553908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.553914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.553915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.553916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.553917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.553918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.553919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.553920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.553921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.553922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.553923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.553924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.553925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.553926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.553931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.553941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.553945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.553948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.553952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.553956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.553959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.553962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.553966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.553969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.553973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.553976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.553980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.553983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.553989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.553997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.554008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.554013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.554017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.554022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.554031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.554035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.554043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.554048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.554056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.554061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.554069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.554078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.554086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.554091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.554099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.554103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.554110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.554115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.554123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.554131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.554138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.554143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.554148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.554156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.554160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.554165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.554206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:03.557899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:03.559063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:03.559076Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:03.559078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:03.559082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:03.559091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 969 [2:7556255378528619636:7574]
2025-10-01T14:10:03.559538Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:03.559560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:03.559563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.559566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.559568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.559584Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:03.559590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:03.559600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:03.559655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.559661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.559663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.559666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:03.559669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:03.559734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:03.559740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.559751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.559762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.559781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:03.559804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905493732:2446], now have 1 active actors on pipe
2025-10-01T14:10:03.559807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905494113:8658], now have 1 active actors on pipe
2025-10-01T14:10:03.559814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255378528619631:7574]
2025-10-01T14:10:03.559816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255378528619631:7574]
2025-10-01T14:10:03.559818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255378528619631:7574]
2025-10-01T14:10:03.559831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:03.559840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:03.559843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:03.559845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:03.559845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:03.559858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:03.559862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:03.559844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 969
2025-10-01T14:10:03.559852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 969
2025-10-01T14:10:03.559895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255378528619631:7574]
2025-10-01T14:10:03.559905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:03.559921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:03.559923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.559928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.559976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d2693d2-f399d3e0-8970c669-b079532e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:03.559988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.560006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.560012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:03.560020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.560030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:03.560050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.560194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.560200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.560213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.560276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 970 partition: 0 MaxSeqNo: 45 sessionId: src_id|9d2693d2-f399d3e0-8970c669-b079532e_0
2025-10-01T14:10:03.560713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5881d919-f5de0bb-5346da90-a19bc35e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9d2693d2-f399d3e0-8970c669-b079532e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:03.568844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2693d2-f399d3e0-8970c669-b079532e_0] Write session: try to update token
2025-10-01T14:10:03.568860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2693d2-f399d3e0-8970c669-b079532e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:03.580487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:03.580504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:03.580512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:03.580514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:03.580525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255378528619631:7574]
2025-10-01T14:10:03.580530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255378528619631:7574]
2025-10-01T14:10:03.580534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255378528619631:7574]
2025-10-01T14:10:03.580580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:03.580583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:03.580590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.580593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:03.580593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:03.580598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:03.580889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:03.586934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 970 sessionId: src_id|9d2693d2-f399d3e0-8970c669-b079532e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:03.589385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:03.631131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255380905494245:8250]
2025-10-01T14:10:03.631322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 969, pipe: [1:7556255380905494245:8250]
2025-10-01T14:10:03.740031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:03.740338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.740352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.740373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905494245:8250], now have 1 active actors on pipe
2025-10-01T14:10:03.740584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:03.740624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255380905494245:8250]
2025-10-01T14:10:03.740636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:03.740640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:03.740654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:03.740700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 970 reason: error at write: Disconnected sessionId: src_id|9d2693d2-f399d3e0-8970c669-b079532e_0
2025-10-01T14:10:03.740958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 970 sessionId: src_id|9d2693d2-f399d3e0-8970c669-b079532e_0 is DEAD
2025-10-01T14:10:03.741158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2693d2-f399d3e0-8970c669-b079532e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:03.741168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2693d2-f399d3e0-8970c669-b079532e_0] Write session will restart in 0.008536s
2025-10-01T14:10:03.741196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2693d2-f399d3e0-8970c669-b079532e_0] Write session: Do CDS request
2025-10-01T14:10:03.741203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2693d2-f399d3e0-8970c669-b079532e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:03.750930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2693d2-f399d3e0-8970c669-b079532e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.750984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:03.751002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 971
2025-10-01T14:10:03.751140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.751171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:03.751182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:03.751185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:03.751567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 971 sessionId:  describe result for acl check
2025-10-01T14:10:03.751601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:03.751603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:03.751604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:03.751609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255380905494483:8664] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:03.752095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255380905494483:8664] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:03.753804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255380905494483:8664] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:03.756197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255380905494483:8664] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:03.756211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255380905494483:8664] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:03.756214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255380905494483:8664] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:03.756222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:03.757427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:03.758843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:03.759006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:03.759015Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:03.759026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:03.759061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:03.759093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255378528619947:7577]
2025-10-01T14:10:03.759718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:03.759954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:03.759991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:03.760295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:03.760343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.760348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.760349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.760350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.760351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.760352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.760353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.760354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.760355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.760356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.760357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.760358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.760360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.760361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.760366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.760375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.760378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.760382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.760386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.760390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.760393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.760397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.760400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.760408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.760412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.760416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.760419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.760426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.760432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.760443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.760453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.760462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.760469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.760475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.760483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.760487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.760492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.760500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.760504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.760512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.760520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.760529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.760536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.760541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.760549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.760557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.760565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.760573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.760581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.760589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.760596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.760601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.760609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.760617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.760624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.760629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.760669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:03.764165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:03.764714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:03.764726Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:03.764740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:03.764743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:03.764750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 970 [2:7556255378528619947:7577]
2025-10-01T14:10:03.764767Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:03.764786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:03.764793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.764797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.764799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.764812Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:03.764817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:03.764823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:03.764874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.764880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.764882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.764885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:03.764888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:03.764949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:03.764955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.764966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.764976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.764995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:03.765018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905494759:8664], now have 1 active actors on pipe
2025-10-01T14:10:03.765021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905494261:2446], now have 1 active actors on pipe
2025-10-01T14:10:03.765028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255378528619942:7577]
2025-10-01T14:10:03.765030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255378528619942:7577]
2025-10-01T14:10:03.765032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255378528619942:7577]
2025-10-01T14:10:03.765045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:03.765060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:03.765061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:03.765066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:03.765067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:03.765076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:03.765079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:03.765072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 970
2025-10-01T14:10:03.765100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255378528619942:7577]
2025-10-01T14:10:03.765085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 970
2025-10-01T14:10:03.765107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:03.765108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:03.765135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.765142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.765169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|457bc58a-93d24667-52fdd64d-d8b37073_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:03.765178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.765182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.765184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:03.765192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.765202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:03.765221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.765361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.765368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.765381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.765468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 971 partition: 0 MaxSeqNo: 45 sessionId: src_id|457bc58a-93d24667-52fdd64d-d8b37073_0
2025-10-01T14:10:03.765884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d2693d2-f399d3e0-8970c669-b079532e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|457bc58a-93d24667-52fdd64d-d8b37073_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:03.768624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|457bc58a-93d24667-52fdd64d-d8b37073_0] Write session: try to update token
2025-10-01T14:10:03.768645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|457bc58a-93d24667-52fdd64d-d8b37073_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:03.783019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 971 sessionId: src_id|457bc58a-93d24667-52fdd64d-d8b37073_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:03.785253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:03.785269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:03.785271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:03.785274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:03.785282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255378528619942:7577]
2025-10-01T14:10:03.785287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255378528619942:7577]
2025-10-01T14:10:03.785291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255378528619942:7577]
2025-10-01T14:10:03.785333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:03.785338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:03.785343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:03.785345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.785346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:03.785347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:03.785377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:03.785497Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:03.840545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255380905494774:8250]
2025-10-01T14:10:03.840848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 970, pipe: [1:7556255380905494774:8250]
2025-10-01T14:10:03.937032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:03.937754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.937772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.937819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905494774:8250], now have 1 active actors on pipe
2025-10-01T14:10:03.938019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:03.938022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:03.938033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:03.938067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255380905494774:8250]
2025-10-01T14:10:03.938102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 971 reason: error at write: Disconnected sessionId: src_id|457bc58a-93d24667-52fdd64d-d8b37073_0
2025-10-01T14:10:03.938325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 971 sessionId: src_id|457bc58a-93d24667-52fdd64d-d8b37073_0 is DEAD
2025-10-01T14:10:03.938028Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:03.938487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457bc58a-93d24667-52fdd64d-d8b37073_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:03.938498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457bc58a-93d24667-52fdd64d-d8b37073_0] Write session will restart in 0.006241s
2025-10-01T14:10:03.938527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457bc58a-93d24667-52fdd64d-d8b37073_0] Write session: Do CDS request
2025-10-01T14:10:03.938532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457bc58a-93d24667-52fdd64d-d8b37073_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:03.945985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|457bc58a-93d24667-52fdd64d-d8b37073_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.946002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:03.946017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 972
2025-10-01T14:10:03.946214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:03.946247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:03.946254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:03.946257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:03.946665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 972 sessionId:  describe result for acl check
2025-10-01T14:10:03.946690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:03.946696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:03.946697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:03.946701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255380905494851:8675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:03.947122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255380905494851:8675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:03.949623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255380905494851:8675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:03.952525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255380905494851:8675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:03.952542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255380905494851:8675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:03.952545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255380905494851:8675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:03.952553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:03.957257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:03.958768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:03.958954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:03.958963Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:03.958972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:03.959009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:03.959040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255378528620255:7582]
2025-10-01T14:10:03.959442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:03.959632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:03.959658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:03.959847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:03.959882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.959888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.959888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.959889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.959890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.959891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.959891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.959892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.959893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.959894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.959894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.959895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.959896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.959897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.959899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.959905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.959908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.959910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.959912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.959914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.959916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.959918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.959920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.959922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.959924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.959926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.959928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.959931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.959935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.959940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:03.959943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.959946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:03.959948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.959951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:03.959953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.959956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:03.959959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.959963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:03.959967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.959972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:03.959977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.959981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:03.959985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.959989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:03.959998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.960005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:03.960007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.960010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.960013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.960019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.960032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.960038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.960041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.960044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:03.960046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.960049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:03.960070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:03.963716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:03.964652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:03.964665Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:03.964667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:03.964671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:03.964681Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 971 [2:7556255378528620255:7582]
2025-10-01T14:10:03.964701Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:03.964722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:03.964746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.964749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.964751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.964768Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:03.964778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:03.964788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:03.964847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.964853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.964856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.964859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:03.964862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:03.964926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:03.964940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.964952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:03.964963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:03.964978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:03.965002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905494800:2446], now have 1 active actors on pipe
2025-10-01T14:10:03.965009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255380905495174:8675], now have 1 active actors on pipe
2025-10-01T14:10:03.965017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255378528620250:7582]
2025-10-01T14:10:03.965019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255378528620250:7582]
2025-10-01T14:10:03.965021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255378528620250:7582]
2025-10-01T14:10:03.965033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:03.965043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:03.965050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:03.965050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:03.965052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:03.965064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:03.965072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:03.965041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 971
2025-10-01T14:10:03.965043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 971
2025-10-01T14:10:03.965107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255378528620250:7582]
2025-10-01T14:10:03.965117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:03.965121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:03.965142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.965151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.965196Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:03.965210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:03.965215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:03.965217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:03.965228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:03.965237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:03.965254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.965433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:03.965443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:03.965459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:03.965556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 972 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0
2025-10-01T14:10:03.965977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457bc58a-93d24667-52fdd64d-d8b37073_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:03.968631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0] Write session: try to update token
2025-10-01T14:10:03.968648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:03.983605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 972 sessionId: src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:03.985791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:03.985812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:03.985814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:03.985816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:03.985826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255378528620250:7582]
2025-10-01T14:10:03.985830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255378528620250:7582]
2025-10-01T14:10:03.985833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255378528620250:7582]
2025-10-01T14:10:03.985875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:03.985882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:03.985886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:03.985889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:03.985890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:03.985891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:03.986049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:03.986182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:04.038192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255385200462607:8250]
2025-10-01T14:10:04.038504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 971, pipe: [1:7556255385200462607:8250]
2025-10-01T14:10:04.145390Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:04.145685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.145700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.145742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200462607:8250], now have 1 active actors on pipe
2025-10-01T14:10:04.145956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:04.146002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255385200462607:8250]
2025-10-01T14:10:04.146039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:04.146112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 972 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0
2025-10-01T14:10:04.146125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:04.146353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 972 sessionId: src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0 is DEAD
2025-10-01T14:10:04.146494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:04.146502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0] Write session will restart in 0.009296s
2025-10-01T14:10:04.146529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0] Write session: Do CDS request
2025-10-01T14:10:04.146536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:04.156996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:04.157040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:04.157057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 973
2025-10-01T14:10:04.157252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:04.157297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:04.157303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:04.157307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:04.158167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 973 sessionId:  describe result for acl check
2025-10-01T14:10:04.158204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:04.158212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:04.158214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:04.158220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255385200462740:8679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:04.158787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255385200462740:8679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:04.160963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255385200462740:8679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:04.163388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255385200462740:8679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:04.163405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255385200462740:8679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:04.163418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255385200462740:8679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:04.163426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:04.167461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:04.169577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:04.169764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:04.169772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:04.169780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:04.169814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:04.169843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255382823587881:7594]
2025-10-01T14:10:04.170316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:04.170624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:04.170670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:04.170967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:04.171025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.171032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.171032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.171034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.171035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.171036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.171037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.171038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.171039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.171040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.171042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.171043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.171044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.171045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.171050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.171061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.171065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.171068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.171072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.171075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.171079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.171083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.171086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.171090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.171094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.171097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.171101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.171109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.171116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.171128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.171139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.171148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.171157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.171167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.171175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.171181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.171186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.171191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.171194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.171203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.171210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.171219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.171227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.171232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.171236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.171241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.171249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.171254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.171263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.171272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.171280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.171285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.171293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.171302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.171306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.171315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.171338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:04.175045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:04.175638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:04.175653Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:04.175656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:04.175660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:04.175668Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 972 [2:7556255382823587881:7594]
2025-10-01T14:10:04.175690Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:04.175715Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:04.175722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:04.175726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:04.175729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:04.175746Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:04.175752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:04.175762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:04.175820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.175827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.175829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.175832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:04.175835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:04.176056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:04.176065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.176076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.176063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 972
2025-10-01T14:10:04.176077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 972
2025-10-01T14:10:04.176088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.176105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:04.176126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200463020:8679], now have 1 active actors on pipe
2025-10-01T14:10:04.176129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200462613:2446], now have 1 active actors on pipe
2025-10-01T14:10:04.176137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255382823587876:7594]
2025-10-01T14:10:04.176143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255382823587876:7594]
2025-10-01T14:10:04.176145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255382823587876:7594]
2025-10-01T14:10:04.176156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:04.176163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:04.176165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:04.176167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:04.176169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:04.176183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:04.176191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:04.176209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.176218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.176266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255382823587876:7594]
2025-10-01T14:10:04.176276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:04.176279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:04.176294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be704118-7739b8a6-16d0503f-bd30c820_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:04.176304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:04.176311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:04.176313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:04.176322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:04.176335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:04.176375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:04.176542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.176554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.176578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:04.176675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 973 partition: 0 MaxSeqNo: 45 sessionId: src_id|be704118-7739b8a6-16d0503f-bd30c820_0
2025-10-01T14:10:04.177104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1f9b978-f60a50ea-3b48ec6b-c3095e35_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be704118-7739b8a6-16d0503f-bd30c820_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:04.179597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be704118-7739b8a6-16d0503f-bd30c820_0] Write session: try to update token
2025-10-01T14:10:04.179615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be704118-7739b8a6-16d0503f-bd30c820_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:04.194650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 973 sessionId: src_id|be704118-7739b8a6-16d0503f-bd30c820_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:04.197767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:04.198417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.198436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.198455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:04.198457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:04.198459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:04.198460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:04.198466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255382823587876:7594]
2025-10-01T14:10:04.198469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255382823587876:7594]
2025-10-01T14:10:04.198472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255382823587876:7594]
2025-10-01T14:10:04.198506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:04.198511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:04.198515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:04.198519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:04.198526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.198528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:04.198678Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:04.246058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255385200463125:8250]
2025-10-01T14:10:04.246343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 972, pipe: [1:7556255385200463125:8250]
2025-10-01T14:10:04.340688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:04.341395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:04.341452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200463125:8250], now have 1 active actors on pipe
2025-10-01T14:10:04.341577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:04.341624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:04.341674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255385200463125:8250]
2025-10-01T14:10:04.354359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:04.354383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:04.354411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 973 reason: error at write: Disconnected sessionId: src_id|be704118-7739b8a6-16d0503f-bd30c820_0
2025-10-01T14:10:04.354596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 973 sessionId: src_id|be704118-7739b8a6-16d0503f-bd30c820_0 is DEAD
2025-10-01T14:10:04.354712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be704118-7739b8a6-16d0503f-bd30c820_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:04.354723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be704118-7739b8a6-16d0503f-bd30c820_0] Write session will restart in 0.009466s
2025-10-01T14:10:04.354747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be704118-7739b8a6-16d0503f-bd30c820_0] Write session: Do CDS request
2025-10-01T14:10:04.354755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be704118-7739b8a6-16d0503f-bd30c820_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:04.364945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be704118-7739b8a6-16d0503f-bd30c820_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:04.365307Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:04.365322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 974
2025-10-01T14:10:04.365456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:04.365486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:04.365495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:04.365499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:04.366017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 974 sessionId:  describe result for acl check
2025-10-01T14:10:04.366050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:04.366056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:04.366057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:04.366062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255385200463606:8684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:04.366297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:04.366580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255385200463606:8684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:04.368634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:04.368897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:04.368907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:04.368919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:04.368970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:04.369004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255382823588181:7596]
2025-10-01T14:10:04.369177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255385200463606:8684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:04.369444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:04.369704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:04.369741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:04.369996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:04.370050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.370056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.370057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.370058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.370059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.370060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.370060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.370061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.370062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.370065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.370066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.370067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.370068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.370069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.370074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.370083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.370087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.370091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.370094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.370098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.370101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.370105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.370109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.370114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.370117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.370120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.370124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.370127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.370133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.370140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.370144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.370147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.370149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.370152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.370154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.370156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.370159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.370161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.370163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.370165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.370168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.370171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.370173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.370175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.370178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.370181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.370183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.370186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.370188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.370191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.370194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.370196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.370198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.370201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.370203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.370205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.370232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:04.373910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255385200463606:8684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:04.373924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255385200463606:8684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:04.373926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255385200463606:8684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:04.373933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:04.373985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:04.374986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:04.374995Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:04.374997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:04.375000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:04.375006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 973 [2:7556255382823588181:7596]
2025-10-01T14:10:04.375020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:04.375038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:04.375043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:04.375046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:04.375047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:04.375058Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:04.375065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:04.375069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:04.375105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.375118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.375119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.375121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:04.375123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:04.375182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:04.375189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.375196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.375202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.375210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:04.375223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200463645:8684], now have 1 active actors on pipe
2025-10-01T14:10:04.375229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200463134:2446], now have 1 active actors on pipe
2025-10-01T14:10:04.375234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255382823588176:7596]
2025-10-01T14:10:04.375236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255382823588176:7596]
2025-10-01T14:10:04.375237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255382823588176:7596]
2025-10-01T14:10:04.375244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:04.375256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:04.375256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:04.375259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:04.375261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:04.375267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:04.375270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:04.375262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 973
2025-10-01T14:10:04.375279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 973
2025-10-01T14:10:04.375296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255382823588176:7596]
2025-10-01T14:10:04.375303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:04.375305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:04.375319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.375322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.375356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:04.375364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:04.375367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:04.375369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:04.375374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:04.375383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:04.375398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:04.375506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.375513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.375527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:04.375607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 974 partition: 0 MaxSeqNo: 45 sessionId: src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0
2025-10-01T14:10:04.375976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be704118-7739b8a6-16d0503f-bd30c820_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:04.378180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0] Write session: try to update token
2025-10-01T14:10:04.378192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:04.390276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 974 sessionId: src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:04.392508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:04.394348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.394389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.394410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:04.394413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:04.394415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:04.394417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:04.394425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255382823588176:7596]
2025-10-01T14:10:04.394430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255382823588176:7596]
2025-10-01T14:10:04.394433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255382823588176:7596]
2025-10-01T14:10:04.394471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:04.394482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:04.394486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:04.394493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:04.394502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.394504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:04.394656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:04.441651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255385200463652:8250]
2025-10-01T14:10:04.441920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 973, pipe: [1:7556255385200463652:8250]
2025-10-01T14:10:04.530677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:04.531033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:04.531086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200463652:8250], now have 1 active actors on pipe
2025-10-01T14:10:04.531184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:04.531277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:04.531279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:04.531282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:04.531336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255385200463652:8250]
2025-10-01T14:10:04.531346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 974 reason: error at write: Disconnected sessionId: src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0
2025-10-01T14:10:04.531530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 974 sessionId: src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0 is DEAD
2025-10-01T14:10:04.531639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:04.531647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0] Write session will restart in 0.005345s
2025-10-01T14:10:04.531664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0] Write session: Do CDS request
2025-10-01T14:10:04.531671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:04.537875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:04.538058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:04.538071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 975
2025-10-01T14:10:04.538175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:04.538212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:04.538219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:04.538222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:04.538563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 975 sessionId:  describe result for acl check
2025-10-01T14:10:04.538594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:04.538596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:04.538597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:04.538601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255385200463724:8688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:04.539095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255385200463724:8688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:04.540660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255385200463724:8688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:04.543221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255385200463724:8688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:04.543243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255385200463724:8688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:04.543246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255385200463724:8688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:04.543254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:04.549462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:04.550917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:04.551148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:04.551160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:04.551171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:04.551226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:04.551266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255382823588486:7599]
2025-10-01T14:10:04.551846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:04.552135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:04.552213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:04.552593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:04.552654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.552661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.552662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.552663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.552665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.552666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.552667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.552669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.552670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.552671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.552673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.552674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.552675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.552677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.552683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.552693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.552697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.552702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.552705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.552710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.552714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.552722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.552726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.552749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.552754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.552762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.552766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.552770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.552779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.552791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.552801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.552811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.552820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.552829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.552838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.552848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.552857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.552867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.552871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.552880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.552889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.552898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.552904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.552913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.552922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.552931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.552939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.552946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.552954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.552963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.552971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.552980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.552989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.552994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.553000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.553008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.553050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:04.556593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:04.557285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:04.557301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:04.557303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:04.557307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:04.557313Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 974 [2:7556255382823588486:7599]
2025-10-01T14:10:04.557332Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:04.557353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:04.557360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:04.557363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:04.557365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:04.557382Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:04.557391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:04.557397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:04.557448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.557456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.557458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.557461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:04.557464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:04.557532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:04.557539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.557550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.557559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.557577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:04.557599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200463990:8688], now have 1 active actors on pipe
2025-10-01T14:10:04.557607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200463654:2446], now have 1 active actors on pipe
2025-10-01T14:10:04.557614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255382823588481:7599]
2025-10-01T14:10:04.557620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255382823588481:7599]
2025-10-01T14:10:04.557623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255382823588481:7599]
2025-10-01T14:10:04.557636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:04.557649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:04.557655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:04.557655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:04.557658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:04.557670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:04.557677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:04.557659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 974
2025-10-01T14:10:04.557664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 974
2025-10-01T14:10:04.557711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255382823588481:7599]
2025-10-01T14:10:04.557721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:04.557727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:04.557742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.557750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.557795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c454fb8-404b5794-857c5d4-550e39b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:04.557806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:04.557810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:04.557816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:04.558109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:04.558126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:04.558155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:04.558293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.558300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.558314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:04.558416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 975 partition: 0 MaxSeqNo: 45 sessionId: src_id|6c454fb8-404b5794-857c5d4-550e39b7_0
2025-10-01T14:10:04.558804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59b3d4db-fc59e4bb-75450928-53debf1a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6c454fb8-404b5794-857c5d4-550e39b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:04.561180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c454fb8-404b5794-857c5d4-550e39b7_0] Write session: try to update token
2025-10-01T14:10:04.561198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c454fb8-404b5794-857c5d4-550e39b7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:04.575840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 975 sessionId: src_id|6c454fb8-404b5794-857c5d4-550e39b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:04.577507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:04.577523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:04.577525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:04.577527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:04.577538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255382823588481:7599]
2025-10-01T14:10:04.577542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255382823588481:7599]
2025-10-01T14:10:04.577546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255382823588481:7599]
2025-10-01T14:10:04.577591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:04.577594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:04.577597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.577599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:04.577600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:04.577604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:04.577811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:04.578268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:04.632135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255385200464172:8250]
2025-10-01T14:10:04.632390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 974, pipe: [1:7556255385200464172:8250]
2025-10-01T14:10:04.729426Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:04.729875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.729887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.729934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200464172:8250], now have 1 active actors on pipe
2025-10-01T14:10:04.731041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c454fb8-404b5794-857c5d4-550e39b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:04.731053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c454fb8-404b5794-857c5d4-550e39b7_0] Write session will restart in 0.009254s
2025-10-01T14:10:04.731080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c454fb8-404b5794-857c5d4-550e39b7_0] Write session: Do CDS request
2025-10-01T14:10:04.731086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c454fb8-404b5794-857c5d4-550e39b7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:04.730956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:04.730467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:04.730539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255385200464172:8250]
2025-10-01T14:10:04.730564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:04.730566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:04.730659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 975 reason: error at write: Disconnected sessionId: src_id|6c454fb8-404b5794-857c5d4-550e39b7_0
2025-10-01T14:10:04.730854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 975 sessionId: src_id|6c454fb8-404b5794-857c5d4-550e39b7_0 is DEAD
2025-10-01T14:10:04.742169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c454fb8-404b5794-857c5d4-550e39b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:04.742542Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:04.742562Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 976
2025-10-01T14:10:04.742744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:04.742775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:04.742781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:04.742786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:04.743832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 976 sessionId:  describe result for acl check
2025-10-01T14:10:04.744869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:04.744878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:04.744883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:04.744890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255385200464240:8694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:04.745434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255385200464240:8694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:04.750795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255385200464240:8694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:04.756217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255385200464240:8694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:04.756231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255385200464240:8694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:04.756235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255385200464240:8694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:04.756243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:04.802140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:04.811412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:04.811975Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:04.811992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:04.812006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:04.812080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:04.812136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255382823588803:7602]
2025-10-01T14:10:04.812856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:04.813386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:04.813436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:04.813840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:04.813900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.813908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.813908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.813909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.813910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.813911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.813912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.813913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.813914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.813915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.813916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.813917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.813918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.813919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.813923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.813929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.813932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.813935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.813937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.813940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.813942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.813945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.813947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.813950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.813953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.813955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.813957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.813960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.813965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.813970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:04.813975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.813979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:04.813982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.813986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:04.813989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.813992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:04.813995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.813999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:04.814003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.814006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:04.814009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.814013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:04.814015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.814019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:04.814023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.814026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:04.814032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.814036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.814039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.814043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.814045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.814049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.814052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.814055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:04.814058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.814061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:04.814085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:04.822255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:04.822950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:04.822957Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:04.822961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:04.822965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:04.822973Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 975 [2:7556255382823588803:7602]
2025-10-01T14:10:04.822996Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:04.823016Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:04.823020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:04.823024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:04.823027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:04.823045Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:04.823051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:04.823058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:04.823121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.823123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.823126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.823129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:04.823132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:04.823220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:04.823223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.823237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:04.823250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:04.823269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:04.823287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255382823588797:7602]
2025-10-01T14:10:04.823290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255382823588797:7602]
2025-10-01T14:10:04.823292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255382823588797:7602]
2025-10-01T14:10:04.823303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:04.823324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:04.823327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:04.823334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:04.823337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:04.823340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:04.823344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:04.823355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200464176:2446], now have 1 active actors on pipe
2025-10-01T14:10:04.823361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200464398:8694], now have 1 active actors on pipe
2025-10-01T14:10:04.823402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255382823588797:7602]
2025-10-01T14:10:04.823416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:04.823727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 975
2025-10-01T14:10:04.823785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 975
2025-10-01T14:10:04.823896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:04.824181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.824196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.824228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:04.824237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:04.824243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:04.824246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:04.824256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:04.824268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:04.824286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:04.824945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.824964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.824986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:04.828156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 976 partition: 0 MaxSeqNo: 45 sessionId: src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0
2025-10-01T14:10:04.828632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c454fb8-404b5794-857c5d4-550e39b7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:04.829864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255385200464704:8250]
2025-10-01T14:10:04.830732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 975, pipe: [1:7556255385200464704:8250]
2025-10-01T14:10:04.830850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255385200464704:8250], now have 1 active actors on pipe
2025-10-01T14:10:04.831169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0] Write session: try to update token
2025-10-01T14:10:04.831187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:04.847647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 976 sessionId: src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:04.850676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:04.851057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:04.851081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:04.851124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:04.851264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:04.855045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:04.855067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:04.855070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:04.855073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:04.855084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255382823588797:7602]
2025-10-01T14:10:04.855090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255382823588797:7602]
2025-10-01T14:10:04.855098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255382823588797:7602]
2025-10-01T14:10:04.855160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:04.855176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:04.855179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:04.855487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:04.857259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:04.857279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:04.857290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:05.010617Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:05.021538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.021587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.021873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.022013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.022144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.022357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.023149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.023165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.023249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.023311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.023381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.023444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.023491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.023494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.023556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.023616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.023683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.023746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.023788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.023794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.023855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.023925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.024004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.024055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.024094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.024099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.024153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.024206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.024271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.024335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.024399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.024408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.024483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.024576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.024674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.024748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.024809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.024815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.024879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.024938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.024996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.025056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.025098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.025104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.025168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.025228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.025292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.025351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.025470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.025473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.025540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.025607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.025668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.025728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.025787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.025790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.025855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.025910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.025964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.026027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.026079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.026082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.026443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255385200464704:8250]
2025-10-01T14:10:05.026478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:05.026484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:05.026486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:05.026512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 976 reason: error at write: Disconnected sessionId: src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0
2025-10-01T14:10:05.026768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 976 sessionId: src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0 is DEAD
2025-10-01T14:10:05.026883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:05.026894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0] Write session will restart in 0.007563s
2025-10-01T14:10:05.026919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0] Write session: Do CDS request
2025-10-01T14:10:05.026927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:05.026873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:05.036142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.036316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:05.036335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 977
2025-10-01T14:10:05.036464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.036496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:05.036507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:05.036511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:05.036902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 977 sessionId:  describe result for acl check
2025-10-01T14:10:05.036936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:05.036944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:05.036946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:05.036951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255389495432106:8705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:05.037959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255389495432106:8705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:05.039932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255389495432106:8705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:05.043254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255389495432106:8705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:05.043275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255389495432106:8705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:05.043279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255389495432106:8705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:05.043288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:05.059183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:05.060985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:05.061294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:05.061303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:05.061316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:05.061375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:05.061415Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255387118556412:7607]
2025-10-01T14:10:05.061974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:05.062282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:05.062337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:05.062656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:05.062718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.062719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.062720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.062721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.062722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.062723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.062724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.062726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.062727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.062728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.062729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.062730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.062731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.062732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.062737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.062748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.062752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.062755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.062759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.062763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.062766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.062770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.062773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.062777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.062780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.062784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.062786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.062790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.062796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.062804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.062810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.062815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.062821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.062826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.062830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.062835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.062839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.062844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.062848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.062852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.062857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.062862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.062865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.062871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.062875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.062879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.062883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.062888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.062893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.062898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.062902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.062906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.062910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.062915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.062918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.062924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.062961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:05.068192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:05.069304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:05.069319Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:05.069321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:05.069325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:05.069331Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 976 [2:7556255387118556412:7607]
2025-10-01T14:10:05.069350Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:05.069367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:05.069370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.069373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.069375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.069391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:05.069402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:05.069408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:05.069480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.069489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.069491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.069495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:05.069498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:05.069571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:05.069580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.069599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.069611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.069629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:05.069652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495432030:2446], now have 1 active actors on pipe
2025-10-01T14:10:05.069659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495432314:8705], now have 1 active actors on pipe
2025-10-01T14:10:05.069667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255387118556407:7607]
2025-10-01T14:10:05.069674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255387118556407:7607]
2025-10-01T14:10:05.069675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255387118556407:7607]
2025-10-01T14:10:05.069689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:05.069702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:05.069710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:05.069711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:05.069713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:05.069724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:05.069731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:05.069773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255387118556407:7607]
2025-10-01T14:10:05.069784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:05.069790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:05.069824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.069832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.069861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:05.069872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.069882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.069885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:05.069894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.069903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:05.069924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.069739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 976
2025-10-01T14:10:05.069748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 976
2025-10-01T14:10:05.070055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.070063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.070076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.070148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 977 partition: 0 MaxSeqNo: 45 sessionId: src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0
2025-10-01T14:10:05.070510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e0e0ce1-a2b6ad3a-ece689c9-6145a4a5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:05.072976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0] Write session: try to update token
2025-10-01T14:10:05.072991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:05.087240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:05.087257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:05.087265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255387118556407:7607]
2025-10-01T14:10:05.087315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:05.087317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:05.087494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:05.087634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.087800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.087933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.088111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:05.088148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:05.088717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 977 sessionId: src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:05.091339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:05.091525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.091543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.091580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:05.091660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:05.100992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:05.101008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:05.101010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:05.101011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:05.101019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255387118556407:7607]
2025-10-01T14:10:05.101021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255387118556407:7607]
2025-10-01T14:10:05.101024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255387118556407:7607]
2025-10-01T14:10:05.101062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:05.101067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:05.101068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.101069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:05.101072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:05.101076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:05.101200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:05.126722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255389495432558:8250]
2025-10-01T14:10:05.127136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 976, pipe: [1:7556255389495432558:8250]
2025-10-01T14:10:05.246942Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:05.257147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.257177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.257380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.257451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.257524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.257625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.257698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.257709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.257789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.257855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.257921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.258388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.258443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.258452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.258544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.258612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.258682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.258749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.258796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.258812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.258884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.258954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.259022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.259094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.259141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.259150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.259215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.259282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.259352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.259424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.259474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.259481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.259577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.259648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.259716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.259785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.259848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.259856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.259922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.259983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.260055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.260124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.260251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.260259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.260330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.260391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.260452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.260505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.260550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.260557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.260616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.260669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.260725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.260793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.260832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.260838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.260896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.260951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.261011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.261065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.261107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.261114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.261179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495432558:8250], now have 1 active actors on pipe
2025-10-01T14:10:05.261425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:05.261446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255389495432558:8250]
2025-10-01T14:10:05.261469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:05.261471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:05.261495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 977 reason: error at write: Disconnected sessionId: src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0
2025-10-01T14:10:05.261740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 977 sessionId: src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0 is DEAD
2025-10-01T14:10:05.261883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:05.261895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0] Write session will restart in 0.008284s
2025-10-01T14:10:05.261921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0] Write session: Do CDS request
2025-10-01T14:10:05.261927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:05.262028Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:05.270868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.271001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:05.271015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 978
2025-10-01T14:10:05.271136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.271177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:05.271188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:05.271192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:05.271634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 978 sessionId:  describe result for acl check
2025-10-01T14:10:05.271670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:05.271675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:05.271677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:05.271682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255389495432716:8709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:05.272218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255389495432716:8709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:05.274661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255389495432716:8709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:05.277269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255389495432716:8709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:05.277281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255389495432716:8709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:05.277284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255389495432716:8709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:05.277292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:05.279493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:05.282054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:05.282220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:05.282229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:05.282255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:05.282296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:05.282325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255387118556757:7619]
2025-10-01T14:10:05.282782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:05.282999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:05.283030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:05.283370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:05.283417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.283421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.283422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.283422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.283423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.283424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.283424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.283425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.283426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.283426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.283427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.283427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.283428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.283429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.283431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.283437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.283440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.283442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.283444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.283446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.283448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.283450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.283452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.283455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.283457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.283459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.283461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.283463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.283469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.283473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.283477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.283480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.283482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.283485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.283488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.283491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.283495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.283498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.283500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.283503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.283506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.283509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.283511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.283513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.283516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.283518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.283520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.283523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.283525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.283528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.283530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.283532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.283535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.283537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.283540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.283542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.283561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:05.286923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:05.287469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:05.287485Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:05.287487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:05.287491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:05.287498Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 977 [2:7556255387118556757:7619]
2025-10-01T14:10:05.287511Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:05.287525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:05.287527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.287529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.287531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.287543Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:05.287547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:05.287551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:05.287592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.287599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.287600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.287603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:05.287604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:05.287659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:05.287665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.287672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.287677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.287686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:05.287701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255387118556748:7619]
2025-10-01T14:10:05.287706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255387118556748:7619]
2025-10-01T14:10:05.287708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255387118556748:7619]
2025-10-01T14:10:05.287715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:05.287724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:05.287725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:05.287726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:05.287728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:05.287734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:05.287735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:05.287743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495432563:2446], now have 1 active actors on pipe
2025-10-01T14:10:05.287745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433051:8709], now have 1 active actors on pipe
2025-10-01T14:10:05.287761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255387118556748:7619]
2025-10-01T14:10:05.287769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:05.287776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:05.287815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 977
2025-10-01T14:10:05.287818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 977
2025-10-01T14:10:05.287881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.287889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.287908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|697b620e-9aba65d3-613c3705-66da9b6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:05.287917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.287921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.287923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:05.287931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.287944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:05.287957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.288113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.288120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.288134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.288235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 978 partition: 0 MaxSeqNo: 45 sessionId: src_id|697b620e-9aba65d3-613c3705-66da9b6c_0
2025-10-01T14:10:05.288609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a30f7dda-efad0f0b-322d511e-a15719eb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|697b620e-9aba65d3-613c3705-66da9b6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:05.291120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|697b620e-9aba65d3-613c3705-66da9b6c_0] Write session: try to update token
2025-10-01T14:10:05.291136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|697b620e-9aba65d3-613c3705-66da9b6c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:05.298333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:05.298347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:05.298355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255387118556748:7619]
2025-10-01T14:10:05.298415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:05.298420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:05.298577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:05.298710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.298852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.298986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.299167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:05.299197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:05.305598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 978 sessionId: src_id|697b620e-9aba65d3-613c3705-66da9b6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:05.308086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:05.308272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.308291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.308326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:05.308428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:05.317246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:05.317263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:05.317265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:05.317266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:05.317274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255387118556748:7619]
2025-10-01T14:10:05.317277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255387118556748:7619]
2025-10-01T14:10:05.317280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255387118556748:7619]
2025-10-01T14:10:05.317318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:05.317325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.317327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:05.317333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:05.317339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:05.317342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:05.317473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:05.361725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255389495433096:8250]
2025-10-01T14:10:05.361986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 977, pipe: [1:7556255389495433096:8250]
2025-10-01T14:10:05.452959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:05.459979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.460004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.460137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.460189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.460243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.460296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.460338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.460346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.460401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.460449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.460501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.460549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.460587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.460592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.460650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.460707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.460772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.460831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.460870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.460876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.460935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.460984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.461035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.461087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.461130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.461138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.461194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.461242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.461293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.461344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.461388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.461395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.461453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.461503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.461554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.461607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.461645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.461650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.461703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.461753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.461806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.461857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.461902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.461910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.461962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.462009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.462058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.462116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.462160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.462166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.462235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.462296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.462355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.462422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.462471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.462478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.462532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.462580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.462630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.462680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.462716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.462721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.462764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433096:8250], now have 1 active actors on pipe
2025-10-01T14:10:05.462949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255389495433096:8250]
2025-10-01T14:10:05.462957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:05.462995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:05.462998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:05.463023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 978 reason: error at write: Disconnected sessionId: src_id|697b620e-9aba65d3-613c3705-66da9b6c_0
2025-10-01T14:10:05.463248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 978 sessionId: src_id|697b620e-9aba65d3-613c3705-66da9b6c_0 is DEAD
2025-10-01T14:10:05.463392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697b620e-9aba65d3-613c3705-66da9b6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:05.463400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697b620e-9aba65d3-613c3705-66da9b6c_0] Write session will restart in 0.007510s
2025-10-01T14:10:05.463427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697b620e-9aba65d3-613c3705-66da9b6c_0] Write session: Do CDS request
2025-10-01T14:10:05.463433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697b620e-9aba65d3-613c3705-66da9b6c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:05.463718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:05.470262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:05.471924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|697b620e-9aba65d3-613c3705-66da9b6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.472053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:05.472069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 979
2025-10-01T14:10:05.472172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.472215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:05.472224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:05.472228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:05.472257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:05.472482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:05.472498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:05.472510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:05.472562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:05.472599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255387118556817:7622]
2025-10-01T14:10:05.472609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 979 sessionId:  describe result for acl check
2025-10-01T14:10:05.472646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:05.472654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:05.472656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:05.472661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255389495433119:8714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:05.473174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255389495433119:8714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:05.473168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:05.473481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:05.473523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:05.473811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:05.473871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.473876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.473877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.473878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.473879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.473881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.473884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.473886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.473887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.473887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.473888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.473890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.473891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.473891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.473897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.473904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.473907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.473911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.473914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.473917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.473920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.473923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.473926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.473929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.473933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.473935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.473939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.473942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.473948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.473956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.473961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.473966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.473970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.473975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.473979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.473983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.473987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.473991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.473995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.473998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.474003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.474007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.474011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.474015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.474019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.474022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.474026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.474030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.474034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.474038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.474042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.474045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.474049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.474053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.474056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.474060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.474094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:05.475841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255389495433119:8714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:05.477723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:05.478438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:05.478454Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:05.478457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:05.478461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:05.478468Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 978 [2:7556255387118556817:7622]
2025-10-01T14:10:05.478483Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:05.478502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:05.478505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.478508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.478510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.478529Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:05.478539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:05.478544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:05.478603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.478610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.478611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.478614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:05.478617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:05.478639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255389495433119:8714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:05.478654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255389495433119:8714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:05.478657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255389495433119:8714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:05.478665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:05.478683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:05.478690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.478702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.478711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.478725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:05.478747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433099:2446], now have 1 active actors on pipe
2025-10-01T14:10:05.478758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255387118556812:7622]
2025-10-01T14:10:05.478764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255387118556812:7622]
2025-10-01T14:10:05.478766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255387118556812:7622]
2025-10-01T14:10:05.478778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:05.478789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:05.478793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:05.478796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:05.478798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:05.478807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:05.478810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:05.478794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 978
2025-10-01T14:10:05.478842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255387118556812:7622]
2025-10-01T14:10:05.478851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:05.478853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:05.478874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433158:8714], now have 1 active actors on pipe
2025-10-01T14:10:05.478934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 978
2025-10-01T14:10:05.478998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.479012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.479039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:05.479050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.479054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.479057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:05.479067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.479082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:05.479100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.479499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.479507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.479521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.479629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 979 partition: 0 MaxSeqNo: 45 sessionId: src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0
2025-10-01T14:10:05.479998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697b620e-9aba65d3-613c3705-66da9b6c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:05.482636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0] Write session: try to update token
2025-10-01T14:10:05.482655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:05.490264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:05.490282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:05.490293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255387118556812:7622]
2025-10-01T14:10:05.490338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:05.490339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:05.490571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:05.490717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.490870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.491013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.491211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:05.491252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:05.497301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 979 sessionId: src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:05.500097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:05.500304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.500326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.500364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:05.500448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:05.510053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:05.510077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:05.510080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:05.510082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:05.510093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255387118556812:7622]
2025-10-01T14:10:05.510102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255387118556812:7622]
2025-10-01T14:10:05.510105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255387118556812:7622]
2025-10-01T14:10:05.510143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:05.510150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:05.510152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:05.510154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:05.510159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.510161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:05.510309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:05.562929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255389495433165:8250]
2025-10-01T14:10:05.563219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 978, pipe: [1:7556255389495433165:8250]
2025-10-01T14:10:05.654763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:05.663332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.663367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.663557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.663622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.663687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.663754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.663914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.663920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.663993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.664052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.664108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.664175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.664219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.664222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.664300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.664367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.664442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.664505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.664555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.664558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.664641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.664712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.664799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.664891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.664945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.664948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.665026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.665089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.665155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.665227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.665277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.665280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.665357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.665423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.665490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.665563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.665613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.665617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.665695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.665759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.665827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.665889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.665933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.665936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.666009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.666073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.666144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.666211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.666252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.666255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.666324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.666639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.666722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.666796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.666856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.666864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.666935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.667005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.667069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.667133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.667193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.667202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.667291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433165:8250], now have 1 active actors on pipe
2025-10-01T14:10:05.667841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:05.667987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:05.668004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0] Write session will restart in 0.008774s
2025-10-01T14:10:05.668030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0] Write session: Do CDS request
2025-10-01T14:10:05.668037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:05.667549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:05.667577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:05.667580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:05.667610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 979 reason: error at write: Disconnected sessionId: src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0
2025-10-01T14:10:05.667613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255389495433165:8250]
2025-10-01T14:10:05.667846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 979 sessionId: src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0 is DEAD
2025-10-01T14:10:05.674264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:05.676764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:05.676976Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:05.676987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:05.677010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:05.677062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:05.677100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255387118556887:7625]
2025-10-01T14:10:05.677678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:05.677928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.677958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:05.677999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:05.678008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:05.678025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 980
2025-10-01T14:10:05.678177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.678207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:05.678218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:05.678221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:05.678290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:05.678338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.678343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.678344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.678345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.678346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.678347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.678348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.678351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.678352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.678353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.678354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.678355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.678356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.678356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.678361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.678387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.678391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.678394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.678398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.678401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.678405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.678408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.678411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.678414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.678418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.678425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.678428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.678431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.678437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.678448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.678457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.678465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.678473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.678477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.678480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.678484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.678488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.678497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.678503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.678512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.678520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.678524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.678531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.678535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.678542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.678547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.678554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.678562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.678571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.678579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.678584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.678588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.678596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.678600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.678607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.678611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.678615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 980 sessionId:  describe result for acl check
2025-10-01T14:10:05.678650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:05.678655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:05.678663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:05.678665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:05.678670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255389495433190:8718] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:05.679166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255389495433190:8718] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:05.681558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255389495433190:8718] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:05.682569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:05.683163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:05.683179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:05.683182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:05.683185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:05.683192Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 979 [2:7556255387118556887:7625]
2025-10-01T14:10:05.683206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:05.683221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:05.683231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.683234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.683236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.683253Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:05.683259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:05.683264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:05.683324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.683330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.683332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.683336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:05.683338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:05.683398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:05.683408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.683419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.683428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.683442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:05.683462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433168:2446], now have 1 active actors on pipe
2025-10-01T14:10:05.683474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255387118556882:7625]
2025-10-01T14:10:05.683479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255387118556882:7625]
2025-10-01T14:10:05.683481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255387118556882:7625]
2025-10-01T14:10:05.683496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:05.683513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:05.683491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 979
2025-10-01T14:10:05.683515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:05.683519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:05.683521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:05.683529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:05.683531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:05.683567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255387118556882:7625]
2025-10-01T14:10:05.683573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:05.683584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:05.683688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255389495433190:8718] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:05.683702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255389495433190:8718] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:05.683705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255389495433190:8718] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:05.683713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:05.684047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433235:8718], now have 1 active actors on pipe
2025-10-01T14:10:05.684079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 979
2025-10-01T14:10:05.684132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.684143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.684169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:05.684180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.684189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.684195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:05.684204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.684216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:05.684235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.684358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.684364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.684376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.684443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 980 partition: 0 MaxSeqNo: 45 sessionId: src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0
2025-10-01T14:10:05.684778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|464326c9-1edfb570-8a99e0d1-6c5ee303_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:05.687192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0] Write session: try to update token
2025-10-01T14:10:05.687210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:05.694605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:05.694625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:05.694635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255387118556882:7625]
2025-10-01T14:10:05.694677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:05.694684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:05.694869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:05.695029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.695179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.695331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:05.695566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:05.695626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:05.701844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 980 sessionId: src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:05.704236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:05.704392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.704420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.704454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:05.704527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:05.714058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:05.714078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:05.714081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:05.714083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:05.714093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255387118556882:7625]
2025-10-01T14:10:05.714100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255387118556882:7625]
2025-10-01T14:10:05.714104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255387118556882:7625]
2025-10-01T14:10:05.714142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:05.714148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:05.714152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:05.714152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:05.714158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.714161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:05.714280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:05.767724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255389495433257:8250]
2025-10-01T14:10:05.767991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 979, pipe: [1:7556255389495433257:8250]
2025-10-01T14:10:05.864448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:05.873025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.873059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.873251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.873318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.873393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.873463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.873521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.873532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.873607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.873686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.873754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.873828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.873882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.873890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.873968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.874038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.874117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.874191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.874249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.874263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.874339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.874464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.874539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.874609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.874661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.874672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.874747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.874832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.874895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.874955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.875008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.875011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.875090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.875156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.875220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.875286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.875330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.875333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.875412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.875474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.875542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.875609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.875654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.875658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.875730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.875791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.875855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.875915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.875961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.875964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.876047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.876108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.876256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.876323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.876367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.876370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.876440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:05.876507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:05.876575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:05.876643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:05.876690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:05.876693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:05.876796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433257:8250], now have 1 active actors on pipe
2025-10-01T14:10:05.877318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:05.877386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255389495433257:8250]
2025-10-01T14:10:05.877418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:05.877420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:05.877451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 980 reason: error at write: Disconnected sessionId: src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0
2025-10-01T14:10:05.877756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 980 sessionId: src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0 is DEAD
2025-10-01T14:10:05.877857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:05.877866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0] Write session will restart in 0.008282s
2025-10-01T14:10:05.877906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0] Write session: Do CDS request
2025-10-01T14:10:05.877913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:05.878126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:05.886933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.888164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:05.888187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 981
2025-10-01T14:10:05.888314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:05.888383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:05.888422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:05.888427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:05.888431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:05.888865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 981 sessionId:  describe result for acl check
2025-10-01T14:10:05.888901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:05.888908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:05.888909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:05.888916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255389495433282:8724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:05.889476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255389495433282:8724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:05.891624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:05.891865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:05.891869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:05.891881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:05.891933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:05.891976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255387118556949:7628]
2025-10-01T14:10:05.892816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:05.893580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255389495433282:8724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:05.893126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:05.893176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:05.893524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:05.893578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.893580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.893581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.893582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.893584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.893585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.893587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.893589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.893590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.893594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.893595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.893597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.893598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.893599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.893604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.893615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.893619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.893623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.893628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.893632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.893636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.893640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.893644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.893648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.893652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.893656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.893660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.893664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.893671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.893678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:05.893684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.893690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:05.893695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.893700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:05.893705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.893711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:05.893716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.893721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:05.893726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.893732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:05.893739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.893744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:05.893749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.893755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:05.893760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.893765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:05.893769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.893775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.893780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.893786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.893790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.893797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.893802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.893808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:05.893813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.893818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:05.893859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:05.897296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255389495433282:8724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:05.897316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255389495433282:8724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:05.897320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255389495433282:8724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:05.897327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:05.898774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:05.899547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:05.899552Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:05.899556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:05.899561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:05.899568Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 980 [2:7556255387118556949:7628]
2025-10-01T14:10:05.899584Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:05.899604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:05.899607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.899611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.899613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.899628Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:05.899634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:05.899643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:05.899704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.899706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.899708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.899711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:05.899714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:05.899796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:05.899801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.899812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:05.899823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:05.899840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:05.899859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433262:2446], now have 1 active actors on pipe
2025-10-01T14:10:05.899863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433321:8724], now have 1 active actors on pipe
2025-10-01T14:10:05.899870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255387118556943:7628]
2025-10-01T14:10:05.899872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255387118556943:7628]
2025-10-01T14:10:05.899875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255387118556943:7628]
2025-10-01T14:10:05.899892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:05.899900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:05.899904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:05.899906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:05.899907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:05.899923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:05.899926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:05.899959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255387118556943:7628]
2025-10-01T14:10:05.899966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:05.900183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:05.902001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 980
2025-10-01T14:10:05.902050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 980
2025-10-01T14:10:05.902808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.902828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.902859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:05.902870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:05.902877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:05.902880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:05.902896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:05.902912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:05.902927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.903213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:05.903221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:05.903236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:05.903367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 981 partition: 0 MaxSeqNo: 45 sessionId: src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0
2025-10-01T14:10:05.903874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1daf1318-af1c56b0-acc82325-e9ab3ddd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:05.906742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0] Write session: try to update token
2025-10-01T14:10:05.906766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:05.926569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:05.926591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:05.926594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:05.926596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:05.926607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255387118556943:7628]
2025-10-01T14:10:05.926614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255387118556943:7628]
2025-10-01T14:10:05.926620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255387118556943:7628]
2025-10-01T14:10:05.926680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:05.926692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:05.926695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:05.926693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:05.926703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:05.926708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:05.926866Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:05.928387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 981 sessionId: src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:05.931540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:05.977129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255389495433343:8250]
2025-10-01T14:10:05.977375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 980, pipe: [1:7556255389495433343:8250]
2025-10-01T14:10:06.074473Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:06.074848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.074866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.074907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255389495433343:8250], now have 1 active actors on pipe
2025-10-01T14:10:06.075204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:06.075509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:06.075569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255389495433343:8250]
2025-10-01T14:10:06.075589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:06.075591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:06.075652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 981 reason: error at write: Disconnected sessionId: src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0
2025-10-01T14:10:06.075860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 981 sessionId: src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0 is DEAD
2025-10-01T14:10:06.078673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:06.078689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0] Write session will restart in 0.007350s
2025-10-01T14:10:06.078721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0] Write session: Do CDS request
2025-10-01T14:10:06.078728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:06.085935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:06.086968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.087172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:06.087190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 982
2025-10-01T14:10:06.087303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.087342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:06.087353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:06.087357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:06.087786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 982 sessionId:  describe result for acl check
2025-10-01T14:10:06.087834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:06.087836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:06.087838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:06.087844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255393790400673:8735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:06.088362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255393790400673:8735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:06.088367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:06.088603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:06.088614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:06.088626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:06.088679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:06.088719Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255391413524312:7632]
2025-10-01T14:10:06.089378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:06.089745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:06.089793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:06.090136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:06.090200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.090207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.090209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.090210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.090213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.090215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.090217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.090219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.090220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.090221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.090223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.090224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.090225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.090226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.090232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.090241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.090245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.090249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.090253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.090256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.090260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.090264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.090268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.090271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.090275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.090278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.090282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.090285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.090292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.090300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.090306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.090311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.090317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.090322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.090326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.090333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.090338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.090343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.090349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.090354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.090358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.090363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.090367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.090387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.090391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.090396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.090401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.090406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.090411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.090416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.090420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.090425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.090429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.090434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.090438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.090443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.090482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:06.091185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255393790400673:8735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:06.093990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255393790400673:8735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:06.094006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255393790400673:8735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:06.094009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255393790400673:8735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:06.094018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:06.094417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:06.095099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:06.095114Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:06.095117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:06.095120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:06.095128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 981 [2:7556255391413524312:7632]
2025-10-01T14:10:06.095143Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:06.095157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:06.095160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:06.095164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:06.095168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:06.095185Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:06.095190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:06.095196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:06.095250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.095252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.095254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.095257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:06.095260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:06.095323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:06.095326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.095336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.095348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.095363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:06.095381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400711:8735], now have 1 active actors on pipe
2025-10-01T14:10:06.095384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400650:2446], now have 1 active actors on pipe
2025-10-01T14:10:06.095393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255391413524306:7632]
2025-10-01T14:10:06.095395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255391413524306:7632]
2025-10-01T14:10:06.095398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255391413524306:7632]
2025-10-01T14:10:06.095410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:06.095423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:06.095412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 981
2025-10-01T14:10:06.095435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 981
2025-10-01T14:10:06.095434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:06.095438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:06.095440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:06.095449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:06.095453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:06.095490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.095495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.095507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255391413524306:7632]
2025-10-01T14:10:06.095516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:06.095525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:06.095545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:06.095557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:06.095562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:06.095564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:06.095572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:06.095580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:06.095600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:06.095788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.095796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.095809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:06.095883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 982 partition: 0 MaxSeqNo: 45 sessionId: src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0
2025-10-01T14:10:06.096290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78614e42-ddb60641-8b4e2c3b-d3c036be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:06.098918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0] Write session: try to update token
2025-10-01T14:10:06.098939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:06.117728Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:06.117749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:06.117753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:06.117755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:06.117764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255391413524306:7632]
2025-10-01T14:10:06.117768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255391413524306:7632]
2025-10-01T14:10:06.117771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255391413524306:7632]
2025-10-01T14:10:06.117816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:06.117822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.117824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:06.117860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:06.117878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:06.117882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:06.117976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:06.119224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 982 sessionId: src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:06.122344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:06.176193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255393790400719:8250]
2025-10-01T14:10:06.178138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 981, pipe: [1:7556255393790400719:8250]
2025-10-01T14:10:06.292073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:06.292146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255393790400719:8250]
2025-10-01T14:10:06.292169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:06.292267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 982 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0
2025-10-01T14:10:06.292544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 982 sessionId: src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0 is DEAD
2025-10-01T14:10:06.293591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:06.293605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0] Write session will restart in 0.008608s
2025-10-01T14:10:06.293640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0] Write session: Do CDS request
2025-10-01T14:10:06.293646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:06.290682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:06.291428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.291438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.291486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400719:8250], now have 1 active actors on pipe
2025-10-01T14:10:06.291746Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:06.304447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.304642Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:06.304659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 983
2025-10-01T14:10:06.304931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.304967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:06.304973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:06.304976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:06.305533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 983 sessionId:  describe result for acl check
2025-10-01T14:10:06.305574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:06.305581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:06.305583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:06.305589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255393790400745:8740] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:06.306149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255393790400745:8740] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:06.309396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255393790400745:8740] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:06.309577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:06.312549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:06.312819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:06.312831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:06.312841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:06.312901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:06.312719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255393790400745:8740] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:06.312756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255393790400745:8740] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:06.312760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255393790400745:8740] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:06.312769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:06.312953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255391413524403:7644]
2025-10-01T14:10:06.313633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:06.313931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:06.313979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:06.314389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:06.314477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.314485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.314486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.314487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.314488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.314490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.314491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.314492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.314493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.314495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.314496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.314498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.314499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.314500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.314508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.314517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.314522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.314525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.314529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.314532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.314535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.314539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.314542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.314546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.314549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.314552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.314555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.314561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.314568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.314575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.314582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.314587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.314594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.314599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.314603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.314608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.314612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.314619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.314623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.314630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.314634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.314639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.314643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.314648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.314652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.314657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.314661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.314665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.314670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.314674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.314679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.314683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.314689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.314694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.314699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.314703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.314744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:06.320905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:06.323678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:06.323700Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:06.323702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:06.323707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:06.323715Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 982 [2:7556255391413524403:7644]
2025-10-01T14:10:06.323733Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:06.323752Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:06.323756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:06.323765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:06.323768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:06.323788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:06.323794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:06.323800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:06.323875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.323886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.323887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.323891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:06.323893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:06.323968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:06.323978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.323995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.324010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.324032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:06.324054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255391413524398:7644]
2025-10-01T14:10:06.324061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255391413524398:7644]
2025-10-01T14:10:06.324063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255391413524398:7644]
2025-10-01T14:10:06.324082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:06.324272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 982
2025-10-01T14:10:06.324322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 982
2025-10-01T14:10:06.324115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:06.324134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:06.324137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:06.324144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:06.324148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:06.324149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:06.324205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400726:2446], now have 1 active actors on pipe
2025-10-01T14:10:06.324210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400787:8740], now have 1 active actors on pipe
2025-10-01T14:10:06.324212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255391413524398:7644]
2025-10-01T14:10:06.324216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:06.324217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:06.324489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.324504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.324533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0c57609-bb754861-d62d1b2-22e32051_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:06.324545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:06.324550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:06.324558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:06.324571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:06.324589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:06.324608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:06.324995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.325009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.325030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:06.325995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 983 partition: 0 MaxSeqNo: 45 sessionId: src_id|e0c57609-bb754861-d62d1b2-22e32051_0
2025-10-01T14:10:06.328677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f73741-74ea8f91-e577c0c3-d7e8df75_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e0c57609-bb754861-d62d1b2-22e32051_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:06.332225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c57609-bb754861-d62d1b2-22e32051_0] Write session: try to update token
2025-10-01T14:10:06.332244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c57609-bb754861-d62d1b2-22e32051_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:06.352401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 983 sessionId: src_id|e0c57609-bb754861-d62d1b2-22e32051_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:06.354991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:06.355720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.355739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.357777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:06.357817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:06.357820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:06.357823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:06.357825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:06.357835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255391413524398:7644]
2025-10-01T14:10:06.357839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255391413524398:7644]
2025-10-01T14:10:06.357843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255391413524398:7644]
2025-10-01T14:10:06.357886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:06.357898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.357901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:06.358037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:06.358079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:06.358085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:06.358090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:06.358173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:06.392370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255393790400801:8250]
2025-10-01T14:10:06.392672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 982, pipe: [1:7556255393790400801:8250]
2025-10-01T14:10:06.519460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:06.526345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.526382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.526539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.526604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.526664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.526728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.526774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.526781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.526846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.526901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.526960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.527018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.527058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.527063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.527118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.527169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.527226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.527330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.527374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.527384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.527471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.527534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.527591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.527647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.527688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.527694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.527753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.527811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.527880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.527938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.527979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.527985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.528045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.528100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.528162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.528226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.528273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.528278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.528342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.528398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.528459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.528518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.528565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.528571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.528630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.528682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.528746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.528801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.528841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.528849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.528917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.528981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.529044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.529105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.529150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.529156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.529221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.529290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.529352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.529420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.529462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.529468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.529517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400801:8250], now have 1 active actors on pipe
2025-10-01T14:10:06.529721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255393790400801:8250]
2025-10-01T14:10:06.529738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:06.529751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:06.529753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:06.529772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 983 reason: error at write: Disconnected sessionId: src_id|e0c57609-bb754861-d62d1b2-22e32051_0
2025-10-01T14:10:06.529957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 983 sessionId: src_id|e0c57609-bb754861-d62d1b2-22e32051_0 is DEAD
2025-10-01T14:10:06.530112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c57609-bb754861-d62d1b2-22e32051_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:06.530121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c57609-bb754861-d62d1b2-22e32051_0] Write session will restart in 0.009845s
2025-10-01T14:10:06.530140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c57609-bb754861-d62d1b2-22e32051_0] Write session: Do CDS request
2025-10-01T14:10:06.530144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c57609-bb754861-d62d1b2-22e32051_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:06.530464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:06.536178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:06.538228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:06.538444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:06.538458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:06.538471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:06.538529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:06.538576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255391413524467:7647]
2025-10-01T14:10:06.539205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:06.539871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:06.539921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:06.540251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:06.540312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.540324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.540325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.540326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.540327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.540328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.540329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.540330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.540332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.540333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.540334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.540335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.540336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.540337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.540343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.540353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.540356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.540360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.540364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.540370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.540374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.540378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.540382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.540386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.540390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.540393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.540397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.540401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.540408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.540415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.540420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.540425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.540429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.540436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.540440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.540445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.540450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.540455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.540459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.540464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.540469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.540474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.540483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.540489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.540493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.540503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.540507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.540518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.540523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.540527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.540536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.540541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.540551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.540556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.540564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.540569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.540615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:06.540970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c57609-bb754861-d62d1b2-22e32051_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.541185Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:06.541205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 984
2025-10-01T14:10:06.541335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.541378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:06.541386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:06.541390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:06.541756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 984 sessionId:  describe result for acl check
2025-10-01T14:10:06.541782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:06.541786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:06.541790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:06.541794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255393790400833:8744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:06.542229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255393790400833:8744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:06.544482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255393790400833:8744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:06.544638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:06.545274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:06.545286Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:06.545288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:06.545292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:06.545298Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 983 [2:7556255391413524467:7647]
2025-10-01T14:10:06.545313Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:06.545330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:06.545336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:06.545340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:06.545342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:06.545358Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:06.545368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:06.545376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:06.545426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.545431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.545435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.545439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:06.545441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:06.545496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:06.545503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.545513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.545525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.545542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:06.545563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400804:2446], now have 1 active actors on pipe
2025-10-01T14:10:06.545574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255391413524462:7647]
2025-10-01T14:10:06.545579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255391413524462:7647]
2025-10-01T14:10:06.545581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255391413524462:7647]
2025-10-01T14:10:06.545594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:06.545587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 983
2025-10-01T14:10:06.545604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:06.545610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:06.545612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:06.545614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:06.545624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:06.545626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:06.545662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255391413524462:7647]
2025-10-01T14:10:06.545672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:06.545679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:06.551378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255393790400833:8744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:06.551399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255393790400833:8744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:06.551402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255393790400833:8744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:06.551411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:06.551656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400871:8744], now have 1 active actors on pipe
2025-10-01T14:10:06.551827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 983
2025-10-01T14:10:06.551897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.551913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.551936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:06.551948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:06.551954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:06.551959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:06.551968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:06.551983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:06.552008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:06.552155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.552169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.552190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:06.552257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 984 partition: 0 MaxSeqNo: 45 sessionId: src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0
2025-10-01T14:10:06.552621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0c57609-bb754861-d62d1b2-22e32051_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:06.555225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0] Write session: try to update token
2025-10-01T14:10:06.555243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:06.558691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:06.558711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:06.558725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255391413524462:7647]
2025-10-01T14:10:06.558763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:06.558772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:06.558942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:06.559143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:06.559321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:06.559464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:06.559662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:06.559699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:06.572317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 984 sessionId: src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:06.574710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:06.574890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.574909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.574941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:06.575021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:06.581139Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:06.581159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:06.581161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:06.581163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:06.581176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255391413524462:7647]
2025-10-01T14:10:06.581180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255391413524462:7647]
2025-10-01T14:10:06.581184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255391413524462:7647]
2025-10-01T14:10:06.581223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:06.581229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:06.581236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:06.581237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.581239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:06.581240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:06.581374Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:06.629932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255393790400875:8250]
2025-10-01T14:10:06.630193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 983, pipe: [1:7556255393790400875:8250]
2025-10-01T14:10:06.726472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:06.734506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.734536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.734702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.734756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.734819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.734881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.734927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.734940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.734999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.735056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.735113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.735168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.735212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.735219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.735287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.735349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.735410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.735474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.735517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.735524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.735588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.735644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.735704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.735764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.735807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.735816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.735879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.735934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.735991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.736049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.736088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.736094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.736159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.736215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.736281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.736340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.736381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.736388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.736450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.736514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.736580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.736646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.736707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.736718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.736796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.736856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.736921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.736986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.737030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.737037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.737103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.737163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.737223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.737284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.737326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.737332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.737391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.737445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.737503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.737557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.737597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.737603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.737668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400875:8250], now have 1 active actors on pipe
2025-10-01T14:10:06.737885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:06.737901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:06.737927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 984 reason: error at write: Disconnected sessionId: src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0
2025-10-01T14:10:06.738036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255393790400875:8250]
2025-10-01T14:10:06.738059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:06.738143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 984 sessionId: src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0 is DEAD
2025-10-01T14:10:06.738290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:06.738298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0] Write session will restart in 0.008775s
2025-10-01T14:10:06.738323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0] Write session: Do CDS request
2025-10-01T14:10:06.738329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:06.738646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:06.747024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:06.747439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:06.747613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:06.747622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:06.747633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:06.747676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:06.747750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255391413524543:7650]
2025-10-01T14:10:06.747952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.748197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:06.748222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 985
2025-10-01T14:10:06.748308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.748336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:06.748349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:06.748354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:06.748347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:06.748622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:06.748662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:06.748748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 985 sessionId:  describe result for acl check
2025-10-01T14:10:06.748777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:06.748784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:06.748785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:06.748790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255393790400919:8750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:06.748962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:06.749019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.749025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.749026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.749027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.749028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.749029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.749030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.749031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.749032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.749033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.749034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.749035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.749039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.749040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.749045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.749053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.749056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.749060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.749063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.749066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.749070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.749073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.749076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.749080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.749084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.749087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.749091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.749095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.749101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.749108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.749114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.749121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.749129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.749134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.749138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.749147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.749152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.749160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.749163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.749168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.749177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.749182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.749190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.749183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255393790400919:8750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:06.749195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.749203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.749208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.749211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.749216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.749224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.749228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.749232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.749238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.749242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.749248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.749255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.749259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.749296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:06.750903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255393790400919:8750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:06.753742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255393790400919:8750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:06.753756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255393790400919:8750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:06.753761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255393790400919:8750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:06.753770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:06.755979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:06.756615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:06.756629Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:06.756631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:06.756634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:06.756639Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 984 [2:7556255391413524543:7650]
2025-10-01T14:10:06.756653Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:06.756665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:06.756668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:06.756670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:06.756672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:06.756686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:06.756694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:06.756699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:06.756767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.756773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.756774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.756778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:06.756780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:06.756850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:06.756858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.756866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.756875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.756890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:06.756909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400956:8750], now have 1 active actors on pipe
2025-10-01T14:10:06.756922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255391413524538:7650]
2025-10-01T14:10:06.756924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255391413524538:7650]
2025-10-01T14:10:06.756926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255391413524538:7650]
2025-10-01T14:10:06.756938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:06.756951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:06.756952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400883:2446], now have 1 active actors on pipe
2025-10-01T14:10:06.756960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:06.756960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:06.756962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:06.756970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:06.756973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:06.757002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255391413524538:7650]
2025-10-01T14:10:06.757012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:06.757023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:06.757072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.757081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.757106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:06.757116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:06.757121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:06.757128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:06.757137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:06.757148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:06.757170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:06.757008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 984
2025-10-01T14:10:06.757014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 984
2025-10-01T14:10:06.757283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.757288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.757297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:06.757367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 985 partition: 0 MaxSeqNo: 45 sessionId: src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0
2025-10-01T14:10:06.757761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa9ea026-3575187f-7cb4032b-3a621e40_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:06.760438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0] Write session: try to update token
2025-10-01T14:10:06.760454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:06.770838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:06.770857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:06.770869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255391413524538:7650]
2025-10-01T14:10:06.770915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:06.770924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:06.771122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:06.771292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:06.771445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:06.771606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:06.771837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:06.771886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:06.778077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 985 sessionId: src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:06.780624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:06.780826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.780849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.780894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:06.781001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:06.793850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:06.793870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:06.793872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:06.793874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:06.793885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255391413524538:7650]
2025-10-01T14:10:06.793889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255391413524538:7650]
2025-10-01T14:10:06.793893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255391413524538:7650]
2025-10-01T14:10:06.793945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:06.793953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:06.793958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.793959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:06.793961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:06.793963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:06.794096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:06.838323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255393790400964:8250]
2025-10-01T14:10:06.838600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 984, pipe: [1:7556255393790400964:8250]
2025-10-01T14:10:06.954909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:06.963968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:06.963994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:06.964170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.964230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.964288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.964346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.964390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.964395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.964464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.964525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.964582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.964648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.964686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.964688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.964769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.964828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.964883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.964934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.964973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.964976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.965045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.965111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.965171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.965230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.965273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.965275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.965347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.965416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.965480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.965541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.965582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.965585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.965653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.965712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.965770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.965828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.965877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.965880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.965949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.966001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.966065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.966127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.966166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.966168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.966234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.966291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.966348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.966619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.966669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.966676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.966741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.966802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.966865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.966928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.966972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.966975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.967041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:06.967094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:06.967159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:06.967220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:06.967262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:06.967264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:06.967331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400964:8250], now have 1 active actors on pipe
2025-10-01T14:10:06.967692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255393790400964:8250]
2025-10-01T14:10:06.967729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:06.967927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:06.967938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:06.967967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 985 reason: error at write: Disconnected sessionId: src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0
2025-10-01T14:10:06.968189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 985 sessionId: src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0 is DEAD
2025-10-01T14:10:06.968554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:06.968568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0] Write session will restart in 0.008286s
2025-10-01T14:10:06.968595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0] Write session: Do CDS request
2025-10-01T14:10:06.968601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:06.968464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:06.977772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.978070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:06.978089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 986
2025-10-01T14:10:06.978229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:06.978265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:06.978272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:06.978277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:06.978786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 986 sessionId:  describe result for acl check
2025-10-01T14:10:06.978837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:06.978839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:06.978841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:06.978846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255393790400983:8754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:06.979404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255393790400983:8754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:06.982955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255393790400983:8754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:06.986200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255393790400983:8754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:06.986215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255393790400983:8754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:06.986218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255393790400983:8754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:06.986227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:06.988290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:06.991096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:06.991393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:06.991404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:06.991418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:06.991474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:06.991513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255391413524612:7653]
2025-10-01T14:10:06.992133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:06.994863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:06.994925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:06.995269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:06.995338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.995339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.995340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.995341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.995342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.995343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.995344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.995345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.995346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.995347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.995348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.995349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.995350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.995351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.995358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.995367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.995370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.995374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.995377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.995381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.995384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.995387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.995390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.995393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.995399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.995402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.995405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.995408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.995420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.995429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:06.995438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.995443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:06.995448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.995454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:06.995459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.995464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:06.995469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.995474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:06.995478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.995483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:06.995487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.995493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:06.995497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.995502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:06.995506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.995510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:06.995514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.995519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:06.995523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.995527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:06.995531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.995536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:06.995540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.995544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:06.995550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.995556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:06.995595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:07.011101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:07.011719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:07.011735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:07.011738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:07.011741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:07.011749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 985 [2:7556255391413524612:7653]
2025-10-01T14:10:07.011767Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:07.011787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:07.011794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.011797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.011800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.011816Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:07.011822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:07.011828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:07.011895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.011902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.011904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.011907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:07.011910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:07.011986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:07.011993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.012004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.012015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.012035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:07.012054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255391413524607:7653]
2025-10-01T14:10:07.012061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255391413524607:7653]
2025-10-01T14:10:07.012063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255391413524607:7653]
2025-10-01T14:10:07.012081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:07.012101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:07.012101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:07.012104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:07.012106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:07.012114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:07.012117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:07.012157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255391413524607:7653]
2025-10-01T14:10:07.012159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:07.012194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:07.012323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790401025:8754], now have 1 active actors on pipe
2025-10-01T14:10:07.012327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255393790400970:2446], now have 1 active actors on pipe
2025-10-01T14:10:07.012654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 985
2025-10-01T14:10:07.012685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 985
2025-10-01T14:10:07.018644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.018665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.018710Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:07.018721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.018727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.018730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:07.018743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.018764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:07.018785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.026717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.026748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.026790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.027393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 986 partition: 0 MaxSeqNo: 45 sessionId: src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0
2025-10-01T14:10:07.030540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6134dfbc-d02002cf-bb74ea5-afc2cc88_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:07.033340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0] Write session: try to update token
2025-10-01T14:10:07.033359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:07.039678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:07.039701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:07.039711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255391413524607:7653]
2025-10-01T14:10:07.039762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:07.039950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:07.040105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:07.040249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:07.040392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:07.040603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:07.040637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:07.042437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:07.059916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 986 sessionId: src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:07.062693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:07.062905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.062925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.062963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:07.063057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:07.066962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:07.066981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:07.066983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:07.066985Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:07.066997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255391413524607:7653]
2025-10-01T14:10:07.067003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255391413524607:7653]
2025-10-01T14:10:07.067009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255391413524607:7653]
2025-10-01T14:10:07.067060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:07.067071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.067073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:07.067222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:07.067623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:07.067637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:07.067641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:07.068395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255398085368360:8250]
2025-10-01T14:10:07.068946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 985, pipe: [1:7556255398085368360:8250]
2025-10-01T14:10:07.230599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:07.231089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368360:8250], now have 1 active actors on pipe
2025-10-01T14:10:07.239405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.239430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.239604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.239668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.239737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.239801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.239860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.239870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.239938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.240004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.240069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.240134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.240180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.240187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.240257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.240318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.240387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.240453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.240495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.240503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.240575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.240640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.240702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.240780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.240824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.240831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.240899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.240962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.241025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.241089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.241138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.241145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.241215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.241277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.241341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.241410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.241454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.241461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.241529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.241592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.241657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.241723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.241770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.241778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.241843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.241909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.241979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.242043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.242088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.242095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.242166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.242225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.242285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.242353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.242416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.242424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.242493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.242555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.242618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.242679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.242723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.242730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.243991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:07.243981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:07.243997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:07.244026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 986 reason: error at write: Disconnected sessionId: src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0
2025-10-01T14:10:07.244243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 986 sessionId: src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0 is DEAD
2025-10-01T14:10:07.244380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:07.244431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255398085368360:8250]
2025-10-01T14:10:07.244574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:07.244583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0] Write session will restart in 0.008409s
2025-10-01T14:10:07.244609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0] Write session: Do CDS request
2025-10-01T14:10:07.244616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:07.254339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:07.256918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:07.257166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:07.257171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:07.257183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:07.257231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:07.257268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255395708492009:7667]
2025-10-01T14:10:07.257860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:07.258439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:07.258484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:07.258815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:07.258887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:07.258948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.258954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.258955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.258956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.258957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.258959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.258960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.258961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.258963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.258964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.258965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.258966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.258967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.258969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.258975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.258987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.258991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.258996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.259000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.259004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.259016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.259021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.259027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.259032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.259036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.259040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.259044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.259048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.259056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.259064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.259077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.259083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.259087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.259092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.259097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.259102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.259107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.259112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.259117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.259123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.259128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.259134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.259138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.259143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.259148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.259153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.259161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.259166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.259171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.259180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.259185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.259194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.259199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.259204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.259212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.259222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.259297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:07.259210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:07.259227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 987
2025-10-01T14:10:07.259411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:07.259441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:07.259448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:07.259451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:07.259799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 987 sessionId:  describe result for acl check
2025-10-01T14:10:07.259829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:07.259831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:07.259832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:07.259837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255398085368397:8767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:07.260361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255398085368397:8767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:07.263427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:07.263806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255398085368397:8767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:07.264039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:07.264053Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:07.264056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:07.264059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:07.264067Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 986 [2:7556255395708492009:7667]
2025-10-01T14:10:07.264083Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:07.264102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:07.264110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.264114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.264116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.264134Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:07.264150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:07.264162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:07.264226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.264234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.264236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.264239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:07.264242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:07.264322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:07.264330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.264342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.264355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.264376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:07.264399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368366:2446], now have 1 active actors on pipe
2025-10-01T14:10:07.264411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255395708492004:7667]
2025-10-01T14:10:07.264417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255395708492004:7667]
2025-10-01T14:10:07.264419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255395708492004:7667]
2025-10-01T14:10:07.264432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:07.264443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:07.264450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:07.264453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:07.264455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:07.264459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:07.264461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:07.264451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 986
2025-10-01T14:10:07.264492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255395708492004:7667]
2025-10-01T14:10:07.264503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:07.264558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:07.269680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255398085368397:8767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:07.269697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255398085368397:8767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:07.269701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255398085368397:8767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:07.269710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:07.270256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368431:8767], now have 1 active actors on pipe
2025-10-01T14:10:07.270311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 986
2025-10-01T14:10:07.270423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.270434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.270456Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f467f179-ca589e29-b06a6150-9a0020de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:07.270468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.270475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.270477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:07.270486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.270502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:07.270520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.270688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.270693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.270701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.270771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 987 partition: 0 MaxSeqNo: 45 sessionId: src_id|f467f179-ca589e29-b06a6150-9a0020de_0
2025-10-01T14:10:07.274599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb9b09d-95560563-9ad982f4-d31d082c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f467f179-ca589e29-b06a6150-9a0020de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:07.277549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f467f179-ca589e29-b06a6150-9a0020de_0] Write session: try to update token
2025-10-01T14:10:07.277572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f467f179-ca589e29-b06a6150-9a0020de_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:07.285787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:07.285799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:07.285801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:07.285802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:07.285812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255395708492004:7667]
2025-10-01T14:10:07.285815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255395708492004:7667]
2025-10-01T14:10:07.285817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255395708492004:7667]
2025-10-01T14:10:07.285854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:07.285859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.285860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:07.285865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:07.285872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:07.285876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:07.285978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:07.302305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 987 sessionId: src_id|f467f179-ca589e29-b06a6150-9a0020de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:07.305059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:07.344701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255398085368441:8250]
2025-10-01T14:10:07.344996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 986, pipe: [1:7556255398085368441:8250]
2025-10-01T14:10:07.446385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:07.446896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.446912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.446934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368441:8250], now have 1 active actors on pipe
2025-10-01T14:10:07.449130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f467f179-ca589e29-b06a6150-9a0020de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:07.449141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f467f179-ca589e29-b06a6150-9a0020de_0] Write session will restart in 0.005228s
2025-10-01T14:10:07.449167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f467f179-ca589e29-b06a6150-9a0020de_0] Write session: Do CDS request
2025-10-01T14:10:07.449174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f467f179-ca589e29-b06a6150-9a0020de_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:07.448171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255398085368441:8250]
2025-10-01T14:10:07.448208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:07.448210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:07.448270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 987 reason: error at write: Disconnected sessionId: src_id|f467f179-ca589e29-b06a6150-9a0020de_0
2025-10-01T14:10:07.448519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 987 sessionId: src_id|f467f179-ca589e29-b06a6150-9a0020de_0 is DEAD
2025-10-01T14:10:07.448681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:07.449633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:07.457747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f467f179-ca589e29-b06a6150-9a0020de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:07.457944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:07.457965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 988
2025-10-01T14:10:07.458108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:07.458359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:07.458426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:07.458437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:07.458442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:07.462236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 988 sessionId:  describe result for acl check
2025-10-01T14:10:07.462292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:07.462294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:07.462296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:07.462303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255398085368475:8772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:07.462947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255398085368475:8772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:07.463120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:07.463365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:07.463378Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:07.463399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:07.463461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:07.463514Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255395708492078:7670]
2025-10-01T14:10:07.464076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:07.464695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:07.464767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:07.465090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:07.465153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.465162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.465163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.465164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.465165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.465166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.465166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.465167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.465168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.465169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.465170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.465171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.465173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.465174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.465179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.465188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.465192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.465196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.465200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.465204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.465207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.465211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.465214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.465219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.465222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.465243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.465246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.465248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.465255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.465263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.465179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255398085368475:8772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:07.465269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.465274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.465279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.465284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.465289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.465294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.465298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.465303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.465307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.465312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.465317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.465322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.465326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.465331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.465335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.465340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.465344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.465349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.465353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.465358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.465362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.465367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.465371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.465376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.465388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.465393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.465435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:07.468989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255398085368475:8772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:07.469008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255398085368475:8772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:07.469011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255398085368475:8772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:07.469020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:07.469229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:07.469838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:07.469852Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:07.469854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:07.469858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:07.469864Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 987 [2:7556255395708492078:7670]
2025-10-01T14:10:07.469878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:07.469902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:07.469908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.469912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.469917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.469934Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:07.469942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:07.469951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:07.470002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.470007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.470009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.470012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:07.470015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:07.470085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:07.470091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.470101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.470113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.470130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:07.470150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255395708492073:7670]
2025-10-01T14:10:07.470156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255395708492073:7670]
2025-10-01T14:10:07.470158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255395708492073:7670]
2025-10-01T14:10:07.470167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:07.470184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:07.470197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:07.470200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:07.470203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:07.470206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:07.470208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:07.470230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255395708492073:7670]
2025-10-01T14:10:07.470239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:07.470243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:07.470249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368447:2446], now have 1 active actors on pipe
2025-10-01T14:10:07.470252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368513:8772], now have 1 active actors on pipe
2025-10-01T14:10:07.470266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 987
2025-10-01T14:10:07.470302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 987
2025-10-01T14:10:07.470359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.470386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.470410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78ccb274-d0e87410-cca0039e-d3386e76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:07.470422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.470429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.470432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:07.470442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.470456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:07.470474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.470718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.470725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.470740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.470819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 988 partition: 0 MaxSeqNo: 45 sessionId: src_id|78ccb274-d0e87410-cca0039e-d3386e76_0
2025-10-01T14:10:07.471195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f467f179-ca589e29-b06a6150-9a0020de_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|78ccb274-d0e87410-cca0039e-d3386e76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:07.473807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ccb274-d0e87410-cca0039e-d3386e76_0] Write session: try to update token
2025-10-01T14:10:07.473826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ccb274-d0e87410-cca0039e-d3386e76_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:07.481804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:07.481826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:07.481849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255395708492073:7670]
2025-10-01T14:10:07.481893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:07.481896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:07.482107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:07.482266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:07.482439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:07.482598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:07.482822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:07.482866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:07.488494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 988 sessionId: src_id|78ccb274-d0e87410-cca0039e-d3386e76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:07.491393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.491414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.491456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:07.491183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:07.491512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:07.502559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:07.502577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:07.502580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:07.502584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:07.502594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255395708492073:7670]
2025-10-01T14:10:07.502598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255395708492073:7670]
2025-10-01T14:10:07.502601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255395708492073:7670]
2025-10-01T14:10:07.502648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:07.502649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:07.502654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:07.502656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:07.502658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.502660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:07.502792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:07.548461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255398085368520:8250]
2025-10-01T14:10:07.548715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 987, pipe: [1:7556255398085368520:8250]
2025-10-01T14:10:07.656545Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:07.664572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.664603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.664784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.664850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.664916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.664979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.665029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.665038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.665102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.665161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.665253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.665315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.665358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.665365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.665429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.665490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.665552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.665615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.665656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.665662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.665759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.665823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.665912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.665971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.666014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.666020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.666079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.666135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.666195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.666256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.666301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.666311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.666393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.666459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.666518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.666578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.666619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.666627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.666696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.666752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.666817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.666880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.666922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.666929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.666990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.667046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.667103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.667160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.667206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.667213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.667270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.667323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.667377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.667435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.667478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.667485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.667545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.667602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.667659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.667716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.667772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.667779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.667841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368520:8250], now have 1 active actors on pipe
2025-10-01T14:10:07.668040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255398085368520:8250]
2025-10-01T14:10:07.668047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:07.668050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:07.668068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:07.668076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 988 reason: error at write: Disconnected sessionId: src_id|78ccb274-d0e87410-cca0039e-d3386e76_0
2025-10-01T14:10:07.668277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 988 sessionId: src_id|78ccb274-d0e87410-cca0039e-d3386e76_0 is DEAD
2025-10-01T14:10:07.668390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ccb274-d0e87410-cca0039e-d3386e76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:07.668401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ccb274-d0e87410-cca0039e-d3386e76_0] Write session will restart in 0.008266s
2025-10-01T14:10:07.668424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ccb274-d0e87410-cca0039e-d3386e76_0] Write session: Do CDS request
2025-10-01T14:10:07.668431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ccb274-d0e87410-cca0039e-d3386e76_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:07.668872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:07.675047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:07.677406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:07.677599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:07.677610Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:07.677622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:07.677672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:07.677711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255395708492157:7673]
2025-10-01T14:10:07.677827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78ccb274-d0e87410-cca0039e-d3386e76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:07.678248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:07.678266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:07.678279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 989
2025-10-01T14:10:07.678391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:07.678412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:07.678419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:07.678421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:07.678542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:07.678589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:07.678693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 989 sessionId:  describe result for acl check
2025-10-01T14:10:07.678720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:07.678724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:07.678725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:07.678728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255398085368554:8776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:07.678867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:07.678931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.678938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.678939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.678940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.678941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.678942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.678943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.678944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.678945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.678946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.678947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.678948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.678949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.678950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.678955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.678964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.678967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.678971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.678974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.678977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.678980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.678984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.678987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.678992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.678995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.679000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.679004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.679006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.679012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.679019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.679025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.679030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.679034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.679039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.679043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.679047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.679052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.679056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.679060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.679064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.679070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.679074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.679080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.679084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.679088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.679093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.679101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.679105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.679110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.679114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.679119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.679126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.679130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.679119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255398085368554:8776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:07.679135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.679144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.679149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.679186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:07.680946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255398085368554:8776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:07.682614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:07.683129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255398085368554:8776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:07.683142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255398085368554:8776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:07.683145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255398085368554:8776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:07.683153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:07.683230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:07.683248Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:07.683251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:07.683254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:07.683260Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 988 [2:7556255395708492157:7673]
2025-10-01T14:10:07.683272Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:07.683291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:07.683298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.683301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.683303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.683318Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:07.683327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:07.683333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:07.683382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.683390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.683391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.683394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:07.683396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:07.683455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:07.683463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.683474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.683484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.683498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:07.683515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368523:2446], now have 1 active actors on pipe
2025-10-01T14:10:07.683522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368591:8776], now have 1 active actors on pipe
2025-10-01T14:10:07.683529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255395708492152:7673]
2025-10-01T14:10:07.683530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255395708492152:7673]
2025-10-01T14:10:07.683532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255395708492152:7673]
2025-10-01T14:10:07.683516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 988
2025-10-01T14:10:07.683541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:07.683547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:07.683550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:07.683551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:07.683552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:07.683559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 988
2025-10-01T14:10:07.683564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:07.683566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:07.683601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.683609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.683620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255395708492152:7673]
2025-10-01T14:10:07.683634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:07.683644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:07.683660Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60a12280-da8f8d06-e873348d-13457edd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:07.683671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.683676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.683678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:07.683686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.683697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:07.683721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.684025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.684038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.684054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.684113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 989 partition: 0 MaxSeqNo: 45 sessionId: src_id|60a12280-da8f8d06-e873348d-13457edd_0
2025-10-01T14:10:07.684414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78ccb274-d0e87410-cca0039e-d3386e76_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|60a12280-da8f8d06-e873348d-13457edd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:07.686563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a12280-da8f8d06-e873348d-13457edd_0] Write session: try to update token
2025-10-01T14:10:07.686575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a12280-da8f8d06-e873348d-13457edd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:07.698879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 989 sessionId: src_id|60a12280-da8f8d06-e873348d-13457edd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:07.700964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:07.701178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.701200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.701234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:07.701300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:07.703805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:07.703822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:07.703825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:07.703827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:07.703839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255395708492152:7673]
2025-10-01T14:10:07.703843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255395708492152:7673]
2025-10-01T14:10:07.703846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255395708492152:7673]
2025-10-01T14:10:07.703879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:07.703888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:07.703889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:07.703892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:07.703894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.703896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:07.704025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:07.770430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255398085368621:8250]
2025-10-01T14:10:07.770864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 988, pipe: [1:7556255398085368621:8250]
2025-10-01T14:10:07.855660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:07.864094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.864120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.864294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.864363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.864428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.864491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.864893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.864906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.864990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.865068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.865145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.865213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.865258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.865267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.865336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.865395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.865475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.865541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.865586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.865594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.865656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.865716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.865783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.865841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.865884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.865891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.865950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.866010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.866072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.866134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.866191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.866198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.866258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.866317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.866402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.866460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.866503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.866511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.866576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.866637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.866709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.866777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.866822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.866830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.866900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.866959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.867018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.867081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.867125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.867132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.867210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.867267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.867322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.867374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.867415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.867422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.867480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:07.867533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:07.867589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:07.867651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:07.867695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:07.867702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:07.867764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368621:8250], now have 1 active actors on pipe
2025-10-01T14:10:07.868039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:07.868073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255398085368621:8250]
2025-10-01T14:10:07.868090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:07.868092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:07.868117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 989 reason: error at write: Disconnected sessionId: src_id|60a12280-da8f8d06-e873348d-13457edd_0
2025-10-01T14:10:07.868343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 989 sessionId: src_id|60a12280-da8f8d06-e873348d-13457edd_0 is DEAD
2025-10-01T14:10:07.868366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:07.868482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a12280-da8f8d06-e873348d-13457edd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:07.868493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a12280-da8f8d06-e873348d-13457edd_0] Write session will restart in 0.005998s
2025-10-01T14:10:07.868514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a12280-da8f8d06-e873348d-13457edd_0] Write session: Do CDS request
2025-10-01T14:10:07.868518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a12280-da8f8d06-e873348d-13457edd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:07.875301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:07.875860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60a12280-da8f8d06-e873348d-13457edd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:07.876115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:07.876130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 990
2025-10-01T14:10:07.876224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:07.876255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:07.876263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:07.876266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:07.877403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:07.877448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 990 sessionId:  describe result for acl check
2025-10-01T14:10:07.877486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:07.877494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:07.877496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:07.877501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255398085368654:8782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:07.877610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:07.877619Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:07.877630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:07.877676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:07.877716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255395708492227:7676]
2025-10-01T14:10:07.877984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255398085368654:8782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:07.878272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:07.878524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:07.878568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:07.878852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:07.878909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.878914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.878915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.878916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.878917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.878918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.878919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.878920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.878921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.878922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.878923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.878924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.878925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.878926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.878931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.878939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.878942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.878945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.878949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.878952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.878955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.878959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.878963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.878967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.878971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.878974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.878979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.878982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.878989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.878995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:07.879000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.879004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:07.879009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.879014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:07.879018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.879022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:07.879026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.879030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:07.879033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.879037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:07.879042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.879046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:07.879050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.879054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:07.879064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.879068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:07.879072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.879076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.879081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.879088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.879092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.879096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.879103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.879108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:07.879112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.879118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:07.879155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:07.879784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255398085368654:8782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:07.882403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255398085368654:8782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:07.882418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255398085368654:8782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:07.882421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255398085368654:8782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:07.882436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:07.882639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:07.883260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:07.883272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:07.883275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:07.883278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:07.883285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 989 [2:7556255395708492227:7676]
2025-10-01T14:10:07.883298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:07.883318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:07.883320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.883323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.883325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.883341Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:07.883345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:07.883351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:07.883401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.883407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.883409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.883412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:07.883414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:07.883480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:07.883488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.883499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:07.883510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:07.883526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:07.883548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368624:2446], now have 1 active actors on pipe
2025-10-01T14:10:07.883556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368693:8782], now have 1 active actors on pipe
2025-10-01T14:10:07.883563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255395708492222:7676]
2025-10-01T14:10:07.883566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255395708492222:7676]
2025-10-01T14:10:07.883568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255395708492222:7676]
2025-10-01T14:10:07.883580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:07.883582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:07.883585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:07.883586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:07.883597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:07.883563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 989
2025-10-01T14:10:07.883588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 989
2025-10-01T14:10:07.883611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:07.883618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:07.883661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.883669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.883682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255395708492222:7676]
2025-10-01T14:10:07.883694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:07.883698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:07.883716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9322a0a6-ab010637-395b165b-257ffc9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:07.883726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:07.883730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:07.883732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:07.883740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:07.883751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:07.883773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.883919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:07.883929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:07.883945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:07.884007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 990 partition: 0 MaxSeqNo: 45 sessionId: src_id|9322a0a6-ab010637-395b165b-257ffc9e_0
2025-10-01T14:10:07.884377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60a12280-da8f8d06-e873348d-13457edd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9322a0a6-ab010637-395b165b-257ffc9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:07.887027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9322a0a6-ab010637-395b165b-257ffc9e_0] Write session: try to update token
2025-10-01T14:10:07.887051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9322a0a6-ab010637-395b165b-257ffc9e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:07.904717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 990 sessionId: src_id|9322a0a6-ab010637-395b165b-257ffc9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:07.905164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:07.905185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:07.905188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:07.905190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:07.905199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255395708492222:7676]
2025-10-01T14:10:07.905204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255395708492222:7676]
2025-10-01T14:10:07.905207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255395708492222:7676]
2025-10-01T14:10:07.905262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:07.905269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:07.905276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:07.905419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:07.905447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:07.905452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:07.905456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:07.907173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:07.968302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255398085368701:8250]
2025-10-01T14:10:07.968600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 989, pipe: [1:7556255398085368701:8250]
2025-10-01T14:10:08.067335Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:08.067866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.067882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.067922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255398085368701:8250], now have 1 active actors on pipe
2025-10-01T14:10:08.068174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:08.068469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255398085368701:8250]
2025-10-01T14:10:08.068505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:08.068579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 990 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9322a0a6-ab010637-395b165b-257ffc9e_0
2025-10-01T14:10:08.068960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 990 sessionId: src_id|9322a0a6-ab010637-395b165b-257ffc9e_0 is DEAD
2025-10-01T14:10:08.069133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:08.069382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9322a0a6-ab010637-395b165b-257ffc9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:08.069393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9322a0a6-ab010637-395b165b-257ffc9e_0] Write session will restart in 0.008510s
2025-10-01T14:10:08.069419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9322a0a6-ab010637-395b165b-257ffc9e_0] Write session: Do CDS request
2025-10-01T14:10:08.069424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9322a0a6-ab010637-395b165b-257ffc9e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:08.078939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9322a0a6-ab010637-395b165b-257ffc9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.079634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:08.079285Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:08.079305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 991
2025-10-01T14:10:08.079495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.079543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:08.079549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:08.079555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:08.080080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 991 sessionId:  describe result for acl check
2025-10-01T14:10:08.080124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:08.080126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:08.080127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:08.080137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255402380336042:8792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:08.080666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255402380336042:8792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:08.081253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:08.081429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:08.081437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:08.081448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:08.081484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:08.081520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255400003459593:7678]
2025-10-01T14:10:08.082279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:08.082836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:08.082877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:08.082929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255402380336042:8792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:08.083189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:08.083237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.083244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.083245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.083246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.083247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.083248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.083249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.083250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.083251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.083252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.083253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.083254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.083255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.083256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.083260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.083271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.083274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.083278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.083281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.083285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.083288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.083292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.083295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.083299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.083302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.083305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.083309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.083312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.083319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.083326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.083331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.083336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.083342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.083346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.083350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.083355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.083359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.083363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.083369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.083374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.083378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.083383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.083387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.083391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.083395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.083400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.083404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.083410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.083418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.083423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.083427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.083432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.083440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.083445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.083453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.083458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.083495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:08.087143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255402380336042:8792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:08.087162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255402380336042:8792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:08.087165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255402380336042:8792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:08.087173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:08.087473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:08.088146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:08.088160Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:08.088162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:08.088166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:08.088172Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 990 [2:7556255400003459593:7678]
2025-10-01T14:10:08.088186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:08.088207Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:08.088217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.088220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.088222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.088236Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:08.088242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:08.088248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:08.088298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.088304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.088306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.088308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:08.088311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:08.088375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:08.088382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.088393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.088407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.088424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:08.088444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336089:8792], now have 1 active actors on pipe
2025-10-01T14:10:08.088452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336013:2446], now have 1 active actors on pipe
2025-10-01T14:10:08.088458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255400003459587:7678]
2025-10-01T14:10:08.088464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255400003459587:7678]
2025-10-01T14:10:08.088466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255400003459587:7678]
2025-10-01T14:10:08.088479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:08.088494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:08.088497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:08.088487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 990
2025-10-01T14:10:08.088500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:08.088497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 990
2025-10-01T14:10:08.088502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:08.088510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:08.088513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:08.088545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255400003459587:7678]
2025-10-01T14:10:08.088554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:08.088567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.088568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:08.088574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.088615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:08.088624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.088627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.088629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:08.088637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.088648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:08.088671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.088838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.088844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.088854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.088917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 991 partition: 0 MaxSeqNo: 45 sessionId: src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0
2025-10-01T14:10:08.089249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9322a0a6-ab010637-395b165b-257ffc9e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:08.092145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0] Write session: try to update token
2025-10-01T14:10:08.092158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:08.112594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 991 sessionId: src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:08.115486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:08.116116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.116140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.116183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:08.116289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:08.130663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:08.130682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:08.130685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:08.130686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:08.130697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255400003459587:7678]
2025-10-01T14:10:08.130701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255400003459587:7678]
2025-10-01T14:10:08.130708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255400003459587:7678]
2025-10-01T14:10:08.130757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:08.130764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.130766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:08.130901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:08.132149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:08.132167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:08.132171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:08.168507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255402380336099:8250]
2025-10-01T14:10:08.168726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 990, pipe: [1:7556255402380336099:8250]
2025-10-01T14:10:08.280109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:08.293355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.293391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.293561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.293628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.293693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.293757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.293806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.293816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.293883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.293946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.294011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.294076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.294124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.294132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.294194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.294263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.294333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.294418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.294465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.294472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.294539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.294604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.294667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.294729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.294772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.294779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.294843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.294903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.294969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.295029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.295078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.295085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.295156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.295220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.295286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.295353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.295403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.295410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.295478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.295538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.295605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.295668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.295719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.295726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.295786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.295848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.295911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.295970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.296008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.296013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.296070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.296121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.296170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.296224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.296265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.296270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.296324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.296376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.296434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.296490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.296530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.296534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.296619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336099:8250], now have 1 active actors on pipe
2025-10-01T14:10:08.296876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:08.296884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255402380336099:8250]
2025-10-01T14:10:08.296901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:08.296904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:08.296934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 991 reason: error at write: Disconnected sessionId: src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0
2025-10-01T14:10:08.297170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 991 sessionId: src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0 is DEAD
2025-10-01T14:10:08.297311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:08.297320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0] Write session will restart in 0.008596s
2025-10-01T14:10:08.297344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0] Write session: Do CDS request
2025-10-01T14:10:08.297350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:08.297603Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:08.306667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:08.307506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.307664Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:08.307679Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 992
2025-10-01T14:10:08.307795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.307830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:08.307840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:08.307845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:08.308270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 992 sessionId:  describe result for acl check
2025-10-01T14:10:08.308313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:08.308320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:08.308322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:08.308327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255402380336142:8798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:08.308595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:08.308812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:08.308823Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:08.308834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:08.308884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:08.308896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255402380336142:8798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:08.308924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255400003459699:7692]
2025-10-01T14:10:08.309536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:08.309791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:08.309834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:08.310145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:08.310197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.310203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.310205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.310206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.310207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.310208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.310209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.310210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.310211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.310212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.310213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.310214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.310215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.310217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.310222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.310232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.310236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.310240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.310244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.310248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.310252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.310256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.310260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.310264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.310268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.310278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.310286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.310289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.310295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.310303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.310313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.310318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.310327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.310331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.310340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.310344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.310350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.310358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.310367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.310391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.310396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.310401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.310405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.310409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.310414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.310419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.310423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.310428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.310432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.310436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.310440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.310445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.310450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.310455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.310459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.310465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.310503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:08.310814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255402380336142:8798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:08.314138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255402380336142:8798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:08.314154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255402380336142:8798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:08.314160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255402380336142:8798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:08.314169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:08.314439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:08.315037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:08.315049Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:08.315051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:08.315054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:08.315061Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 991 [2:7556255400003459699:7692]
2025-10-01T14:10:08.315078Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:08.315099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:08.315106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.315110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.315116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.315131Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:08.315141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:08.315151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:08.315207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.315213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.315215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.315219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:08.315222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:08.315286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:08.315296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.315307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.315319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.315341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:08.315365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336178:8798], now have 1 active actors on pipe
2025-10-01T14:10:08.315374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336110:2446], now have 1 active actors on pipe
2025-10-01T14:10:08.315382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255400003459694:7692]
2025-10-01T14:10:08.315384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255400003459694:7692]
2025-10-01T14:10:08.315386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255400003459694:7692]
2025-10-01T14:10:08.315402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:08.315410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:08.315412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:08.315414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:08.315401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 991
2025-10-01T14:10:08.315421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:08.315406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 991
2025-10-01T14:10:08.315436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:08.315438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:08.315474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255400003459694:7692]
2025-10-01T14:10:08.315485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:08.315490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:08.315502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.315511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.315556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9587d891-3670a02-4ab44927-144473cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:08.315569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.315573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.315576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:08.315585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.315596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:08.315618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.315758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.315765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.315778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.315848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 992 partition: 0 MaxSeqNo: 45 sessionId: src_id|9587d891-3670a02-4ab44927-144473cc_0
2025-10-01T14:10:08.316228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c9f236b-dcc6f063-b5ff1f52-2bf8ebfb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9587d891-3670a02-4ab44927-144473cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:08.322546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9587d891-3670a02-4ab44927-144473cc_0] Write session: try to update token
2025-10-01T14:10:08.322565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9587d891-3670a02-4ab44927-144473cc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:08.336573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 992 sessionId: src_id|9587d891-3670a02-4ab44927-144473cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:08.337893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:08.337910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:08.337912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:08.337914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:08.337923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255400003459694:7692]
2025-10-01T14:10:08.337928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255400003459694:7692]
2025-10-01T14:10:08.337934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255400003459694:7692]
2025-10-01T14:10:08.337971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:08.337973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:08.337977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.337978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:08.337978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:08.337982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:08.338092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:08.338877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:08.396857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255402380336188:8250]
2025-10-01T14:10:08.397110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 991, pipe: [1:7556255402380336188:8250]
2025-10-01T14:10:08.479739Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:08.480172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.480184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.480216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336188:8250], now have 1 active actors on pipe
2025-10-01T14:10:08.480432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:08.480433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255402380336188:8250]
2025-10-01T14:10:08.480458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:08.480371Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:08.480505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 992 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9587d891-3670a02-4ab44927-144473cc_0
2025-10-01T14:10:08.480678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 992 sessionId: src_id|9587d891-3670a02-4ab44927-144473cc_0 is DEAD
2025-10-01T14:10:08.480842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587d891-3670a02-4ab44927-144473cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:08.480851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587d891-3670a02-4ab44927-144473cc_0] Write session will restart in 0.007250s
2025-10-01T14:10:08.480870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587d891-3670a02-4ab44927-144473cc_0] Write session: Do CDS request
2025-10-01T14:10:08.480874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587d891-3670a02-4ab44927-144473cc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:08.486468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:08.488366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:08.488522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:08.488532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:08.488539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:08.488572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:08.488602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255400003459772:7695]
2025-10-01T14:10:08.488927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9587d891-3670a02-4ab44927-144473cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.489028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:08.489033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:08.489048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 993
2025-10-01T14:10:08.489154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.489174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:08.489182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:08.489185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:08.489295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:08.489336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:08.489530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 993 sessionId:  describe result for acl check
2025-10-01T14:10:08.489567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:08.489583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:08.489573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:08.489577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:08.489581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255402380336226:8802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:08.489623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.489627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.489628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.489629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.489629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.489630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.489631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.489631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.489632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.489634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.489635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.489636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.489636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.489637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.489640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.489646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.489648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.489650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.489652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.489654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.489656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.489659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.489661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.489663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.489665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.489667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.489669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.489671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.489676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.489680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.489683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.489687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.489690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.489695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.489699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.489703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.489707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.489711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.489715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.489719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.489724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.489733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.489739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.489745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.489748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.489750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.489760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.489765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.489767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.489770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.489772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.489775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.489781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.489783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.489786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.489788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.489808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:08.490074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255402380336226:8802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:08.491644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255402380336226:8802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:08.493644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255402380336226:8802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:08.493665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255402380336226:8802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:08.493667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255402380336226:8802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:08.493672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:08.493750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:08.494345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:08.494383Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:08.494390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:08.494394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:08.494401Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 992 [2:7556255400003459772:7695]
2025-10-01T14:10:08.494414Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:08.494432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:08.494439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.494443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.494446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.494463Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:08.494472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:08.494479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:08.494518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.494523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.494525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.494527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:08.494529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:08.494586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:08.494592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.494602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.494615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.494635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:08.494657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336263:8802], now have 1 active actors on pipe
2025-10-01T14:10:08.494664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336191:2446], now have 1 active actors on pipe
2025-10-01T14:10:08.494672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255400003459767:7695]
2025-10-01T14:10:08.494677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255400003459767:7695]
2025-10-01T14:10:08.494679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255400003459767:7695]
2025-10-01T14:10:08.494690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:08.494700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 992
2025-10-01T14:10:08.494708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 992
2025-10-01T14:10:08.494707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:08.494718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:08.494721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:08.494723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:08.494724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:08.494727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:08.494759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255400003459767:7695]
2025-10-01T14:10:08.494766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:08.494768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:08.494793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.494801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.494825Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:08.494834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.494837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.494840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:08.494846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.494855Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:08.494876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.495019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.495040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.495061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.495176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 993 partition: 0 MaxSeqNo: 45 sessionId: src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0
2025-10-01T14:10:08.495523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9587d891-3670a02-4ab44927-144473cc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:08.497748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0] Write session: try to update token
2025-10-01T14:10:08.497761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:08.511099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 993 sessionId: src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:08.513488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:08.513663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.513683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.513717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:08.513804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:08.515874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:08.515888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:08.515890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:08.515891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:08.515897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255400003459767:7695]
2025-10-01T14:10:08.515900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255400003459767:7695]
2025-10-01T14:10:08.515903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255400003459767:7695]
2025-10-01T14:10:08.515936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:08.515937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:08.515941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:08.515941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.515943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:08.515943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:08.516058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:08.580626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255402380336270:8250]
2025-10-01T14:10:08.580950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 992, pipe: [1:7556255402380336270:8250]
2025-10-01T14:10:08.654299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:08.662525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.662552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.662715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.662776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.662839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.662896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.662940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.662950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.663019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.663079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.663144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.663209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.663253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.663260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.663318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.663375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.663430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.663513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.663556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.663563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.663634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.663694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.663754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.663811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.663853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.663860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.663917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.663973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.664032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.664090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.664131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.664138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.664201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.664262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.664323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.664385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.664431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.664438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.664500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.664555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.664614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.664676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.664722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.664740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.664801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.664857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.664916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.664996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.665041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.665048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.665120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.665180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.665242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.665306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.665349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.665356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.665460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:08.665519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:08.665581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:08.665643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:08.665702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:08.665709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:08.665771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336270:8250], now have 1 active actors on pipe
2025-10-01T14:10:08.665995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:08.665998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:08.666008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:08.666030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 993 reason: error at write: Disconnected sessionId: src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0
2025-10-01T14:10:08.666035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255402380336270:8250]
2025-10-01T14:10:08.666203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 993 sessionId: src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0 is DEAD
2025-10-01T14:10:08.666347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:08.666354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0] Write session will restart in 0.005084s
2025-10-01T14:10:08.666402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0] Write session: Do CDS request
2025-10-01T14:10:08.666409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:08.667059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:08.672881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.672948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:08.672963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 994
2025-10-01T14:10:08.673042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.673064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:08.673071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:08.673074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:08.673437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 994 sessionId:  describe result for acl check
2025-10-01T14:10:08.673474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:08.673479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:08.673481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:08.673485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255402380336306:8806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:08.673819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:08.673988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255402380336306:8806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:08.675874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:08.676067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:08.676076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:08.676085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:08.676126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:08.676156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255400003459857:7698]
2025-10-01T14:10:08.676204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255402380336306:8806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:08.676575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:08.676792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:08.676821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:08.677021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:08.677053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.677057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.677058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.677059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.677059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.677060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.677061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.677061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.677062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.677063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.677063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.677064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.677065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.677067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.677070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.677076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.677078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.677080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.677082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.677084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.677086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.677088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.677090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.677093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.677095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.677097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.677099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.677101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.677105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.677109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.677113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.677116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.677118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.677121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.677127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.677130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.677132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.677135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.677146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.677154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.677157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.677159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.677162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.677164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.677168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.677170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.677173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.677175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.677178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.677180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.677182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.677185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.677187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.677190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.677193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.677195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.677215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:08.680531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255402380336306:8806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:08.680544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255402380336306:8806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:08.680546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255402380336306:8806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:08.680554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:08.680686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:08.681274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:08.681284Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:08.681286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:08.681288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:08.681293Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 993 [2:7556255400003459857:7698]
2025-10-01T14:10:08.681302Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:08.681312Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:08.681317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.681320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.681321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.681332Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:08.681338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:08.681343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:08.681382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.681386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.681387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.681388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:08.681390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:08.681436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:08.681442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.681451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.681465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.681477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:08.681491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336273:2446], now have 1 active actors on pipe
2025-10-01T14:10:08.681497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336346:8806], now have 1 active actors on pipe
2025-10-01T14:10:08.681502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255400003459852:7698]
2025-10-01T14:10:08.681507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255400003459852:7698]
2025-10-01T14:10:08.681508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255400003459852:7698]
2025-10-01T14:10:08.681518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:08.681525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:08.681527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:08.681529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:08.681507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 993
2025-10-01T14:10:08.681512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 993
2025-10-01T14:10:08.681530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:08.681537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:08.681539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:08.681567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.681573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.681582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255400003459852:7698]
2025-10-01T14:10:08.681589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:08.681594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:08.681608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:08.681615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.681618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.681619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:08.681625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.681631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:08.681644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.681753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.681762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.681779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.681834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 994 partition: 0 MaxSeqNo: 45 sessionId: src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0
2025-10-01T14:10:08.682159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab4e3723-aaa091a5-98cc0f05-fd3aeeb3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:08.684520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0] Write session: try to update token
2025-10-01T14:10:08.684538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:08.697890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 994 sessionId: src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:08.700352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:08.702068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.702089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.702109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:08.702113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:08.702115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:08.702117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:08.702123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255400003459852:7698]
2025-10-01T14:10:08.702126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255400003459852:7698]
2025-10-01T14:10:08.702130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255400003459852:7698]
2025-10-01T14:10:08.702174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:08.702184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:08.702187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:08.702191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.702191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:08.702193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:08.702352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:08.765975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255402380336367:8250]
2025-10-01T14:10:08.766153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 993, pipe: [1:7556255402380336367:8250]
2025-10-01T14:10:08.839006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:08.839534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:08.839590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336367:8250], now have 1 active actors on pipe
2025-10-01T14:10:08.839656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:08.839721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:08.839752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:08.839760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:08.839771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255402380336367:8250]
2025-10-01T14:10:08.839839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 994 reason: error at write: Disconnected sessionId: src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0
2025-10-01T14:10:08.840044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 994 sessionId: src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0 is DEAD
2025-10-01T14:10:08.840147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:08.840156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0] Write session will restart in 0.009566s
2025-10-01T14:10:08.840174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0] Write session: Do CDS request
2025-10-01T14:10:08.840179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:08.846072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:08.848387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:08.848568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:08.848577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:08.848585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:08.848632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:08.848663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255400003459930:7700]
2025-10-01T14:10:08.849066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:08.849259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:08.849295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:08.849533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:08.849579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.849583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.849584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.849584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.849585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.849585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.849586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.849587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.849587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.849588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.849589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.849589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.849590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.849590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.849593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.849599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.849601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.849604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.849606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.849608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.849609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.849611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.849613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.849615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.849617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.849619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.849623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.849625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.849630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.849634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:08.849638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.849641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:08.849643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.849646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:08.849648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.849651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:08.849653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.849656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:08.849658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.849660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:08.849664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.849667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:08.849669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.849672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:08.849674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.849677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:08.849681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.849685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.849689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.849698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.849705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.849709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.849717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.849721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:08.849728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.849732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:08.849766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:08.850855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.850944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:08.850958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 995
2025-10-01T14:10:08.851049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:08.851069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:08.851073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:08.851076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:08.851345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 995 sessionId:  describe result for acl check
2025-10-01T14:10:08.851374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:08.851380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:08.851381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:08.851384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255402380336409:8812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:08.851788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255402380336409:8812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:08.853230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:08.853498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255402380336409:8812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:08.853782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:08.853793Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:08.853794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:08.853796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:08.853800Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 994 [2:7556255400003459930:7700]
2025-10-01T14:10:08.853809Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:08.853819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:08.853825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.853827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.853828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.853838Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:08.853844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:08.853848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:08.853883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.853887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.853888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.853890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:08.853891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:08.853934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:08.853939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.853945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:08.853950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:08.853962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:08.853980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336369:2446], now have 1 active actors on pipe
2025-10-01T14:10:08.853991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255400003459925:7700]
2025-10-01T14:10:08.853994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255400003459925:7700]
2025-10-01T14:10:08.853996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255400003459925:7700]
2025-10-01T14:10:08.854008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:08.854020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:08.854025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:08.854029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:08.854031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:08.854037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:08.854013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 994
2025-10-01T14:10:08.854039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:08.854064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255400003459925:7700]
2025-10-01T14:10:08.854074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:08.854090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:08.858585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255402380336409:8812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:08.858599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255402380336409:8812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:08.858601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255402380336409:8812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:08.858606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:08.858790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336448:8812], now have 1 active actors on pipe
2025-10-01T14:10:08.858823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 994
2025-10-01T14:10:08.858867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.858878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.858901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:08.858910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:08.858914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:08.858916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:08.858925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:08.858937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:08.858950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.859080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:08.859087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:08.859099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:08.859153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 995 partition: 0 MaxSeqNo: 45 sessionId: src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0
2025-10-01T14:10:08.859478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb81bd4-ea054bc0-b05876f5-b3eaf8ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:08.862578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0] Write session: try to update token
2025-10-01T14:10:08.862594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:08.875478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:08.875496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:08.875499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:08.875501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:08.875510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255400003459925:7700]
2025-10-01T14:10:08.875517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255400003459925:7700]
2025-10-01T14:10:08.875520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255400003459925:7700]
2025-10-01T14:10:08.875568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:08.875580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:08.875581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:08.875583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:08.875586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:08.875589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:08.875721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:08.875864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 995 sessionId: src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:08.878639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:08.940069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255402380336451:8250]
2025-10-01T14:10:08.940322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 994, pipe: [1:7556255402380336451:8250]
2025-10-01T14:10:09.013315Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:09.013616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.013630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.013672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255402380336451:8250], now have 1 active actors on pipe
2025-10-01T14:10:09.013922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:09.013942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255402380336451:8250]
2025-10-01T14:10:09.013952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:09.013979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:09.013981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:09.014039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 995 reason: error at write: Disconnected sessionId: src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0
2025-10-01T14:10:09.014228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 995 sessionId: src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0 is DEAD
2025-10-01T14:10:09.014315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:09.014323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0] Write session will restart in 0.005475s
2025-10-01T14:10:09.014362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0] Write session: Do CDS request
2025-10-01T14:10:09.014367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:09.020963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.021750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:09.021085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:09.021105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 996
2025-10-01T14:10:09.021188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.021225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:09.021230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:09.021234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:09.021682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 996 sessionId:  describe result for acl check
2025-10-01T14:10:09.021706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:09.021708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:09.021710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:09.021715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255406675303785:8816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:09.022193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255406675303785:8816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:09.023825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:09.024007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:09.024027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:09.024038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:09.024105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:09.024149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255404298427302:7703]
2025-10-01T14:10:09.024406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255406675303785:8816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:09.024701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:09.024958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:09.025008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:09.025322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:09.025378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.025383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.025385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.025386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.025387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.025390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.025392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.025393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.025394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.025395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.025396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.025397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.025398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.025398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.025404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.025413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.025416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.025419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.025422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.025426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.025429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.025432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.025435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.025439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.025442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.025445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.025448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.025451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.025458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.025465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.025471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.025475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.025481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.025486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.025489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.025493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.025497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.025501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.025505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.025510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.025514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.025518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.025521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.025526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.025535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.025539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.025543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.025547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.025551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.025559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.025563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.025566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.025574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.025578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.025582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.025603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.025641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:09.029048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255406675303785:8816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:09.029066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255406675303785:8816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:09.029068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255406675303785:8816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:09.029074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:09.029253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:09.029895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:09.029908Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:09.029910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:09.029914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:09.029922Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 995 [2:7556255404298427302:7703]
2025-10-01T14:10:09.029938Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:09.029954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:09.029956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.029960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.029967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.029986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:09.029995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:09.030000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:09.030054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.030060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.030062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.030064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:09.030066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:09.030134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:09.030140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.030151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.030164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.030183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:09.030203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675303749:2446], now have 1 active actors on pipe
2025-10-01T14:10:09.030211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675303825:8816], now have 1 active actors on pipe
2025-10-01T14:10:09.030218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255404298427297:7703]
2025-10-01T14:10:09.030224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255404298427297:7703]
2025-10-01T14:10:09.030226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255404298427297:7703]
2025-10-01T14:10:09.030242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:09.030242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 995
2025-10-01T14:10:09.030256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:09.030244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 995
2025-10-01T14:10:09.030259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:09.030264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:09.030266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:09.030271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:09.030274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:09.030306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255404298427297:7703]
2025-10-01T14:10:09.030313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:09.030315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:09.030332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.030342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.030421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:09.030433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.030437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.030443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:09.030450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.030460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:09.030483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.030619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.030625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.030639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.030702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 996 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0
2025-10-01T14:10:09.031069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cb4f20e-4a5d8a51-1b054ff3-9cce33eb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:09.033460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0] Write session: try to update token
2025-10-01T14:10:09.033478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:09.048120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 996 sessionId: src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:09.050601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:09.050925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.050949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.050971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:09.050974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:09.050976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:09.050978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:09.050988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255404298427297:7703]
2025-10-01T14:10:09.050994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255404298427297:7703]
2025-10-01T14:10:09.050998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255404298427297:7703]
2025-10-01T14:10:09.051023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:09.051031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:09.051041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:09.051055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:09.051065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.051071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:09.051196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:09.114157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255406675303845:8250]
2025-10-01T14:10:09.114437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 995, pipe: [1:7556255406675303845:8250]
2025-10-01T14:10:09.197210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:09.197518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:09.197578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675303845:8250], now have 1 active actors on pipe
2025-10-01T14:10:09.197698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:09.197874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:09.197927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255406675303845:8250]
2025-10-01T14:10:09.206162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:09.208517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:09.208701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:09.208709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:09.208717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:09.208773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:09.208813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255404298427384:7707]
2025-10-01T14:10:09.209239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:09.209595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:09.209642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:09.209830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:09.209844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:09.209865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 996 reason: error at write: Disconnected sessionId: src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0
2025-10-01T14:10:09.209919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:09.209975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.209983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.209984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.209985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.209986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.209987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.209988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.209989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.209990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.209991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.209993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.209994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.209995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.209996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.210000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.210010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.210014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.210018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.210021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.210025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.210028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.210032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.210036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.210040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.210055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.210058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.210061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.210065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.210078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.210059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 996 sessionId: src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0 is DEAD
2025-10-01T14:10:09.210089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.210099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.210104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.210115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.210120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.210128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.210133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.210137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.210145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.210149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.210160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.210166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.210174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.210178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.210183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.210191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.210196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.210206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.210211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.210216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.210224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.210228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.210233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.210237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.210245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.210249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.210258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.210298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:09.214472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:09.214486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0] Write session will restart in 0.005758s
2025-10-01T14:10:09.214515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0] Write session: Do CDS request
2025-10-01T14:10:09.214522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:09.219903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:09.220950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:09.220962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:09.220965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:09.220968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:09.220977Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 996 [2:7556255404298427384:7707]
2025-10-01T14:10:09.221003Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:09.221024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:09.221031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.221035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.221037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.221054Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:09.221064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:09.221075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:09.221132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.221138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.221140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.221143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:09.221145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:09.221214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:09.221224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.221236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.221248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.221264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:09.221287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675303857:2446], now have 1 active actors on pipe
2025-10-01T14:10:09.221299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255404298427379:7707]
2025-10-01T14:10:09.221302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255404298427379:7707]
2025-10-01T14:10:09.221304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255404298427379:7707]
2025-10-01T14:10:09.221317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:09.221327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:09.221330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:09.221332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:09.221335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:09.221350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:09.221356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:09.221396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255404298427379:7707]
2025-10-01T14:10:09.221406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:09.221414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:09.221576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 996
2025-10-01T14:10:09.221992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.222085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:09.222097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 997
2025-10-01T14:10:09.222262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.222305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:09.222316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:09.222320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:09.222742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 997 sessionId:  describe result for acl check
2025-10-01T14:10:09.222774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:09.222780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:09.222782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:09.222787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255406675303903:8827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:09.223771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255406675303903:8827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:09.226383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255406675303903:8827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:09.232977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255406675303903:8827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:09.232995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255406675303903:8827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:09.232999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255406675303903:8827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:09.233008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:09.233219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675303937:8827], now have 1 active actors on pipe
2025-10-01T14:10:09.233276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 996
2025-10-01T14:10:09.234511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.234529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.234552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:09.234555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:09.234564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255404298427379:7707]
2025-10-01T14:10:09.234611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:09.234621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.234627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.234630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:09.234641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.234658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:09.234674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:09.234853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:09.235006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:09.235145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:09.235278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:09.235468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:09.235504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.235527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:09.235548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:09.235748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.235761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.235784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.235909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 997 partition: 0 MaxSeqNo: 45 sessionId: src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0
2025-10-01T14:10:09.236340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae304b2b-afeea749-99e2d3ab-70b2a05c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:09.238914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0] Write session: try to update token
2025-10-01T14:10:09.238934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:09.256737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 997 sessionId: src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:09.257632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:09.257651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:09.257653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:09.257654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:09.257664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255404298427379:7707]
2025-10-01T14:10:09.257668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255404298427379:7707]
2025-10-01T14:10:09.257671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255404298427379:7707]
2025-10-01T14:10:09.257702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:09.257713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:09.257714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:09.257717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:09.257720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.257721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:09.257856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:09.259286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:09.297959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255406675303946:8250]
2025-10-01T14:10:09.302861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 996, pipe: [1:7556255406675303946:8250]
2025-10-01T14:10:09.404990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:09.405502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.405523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.405547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675303946:8250], now have 1 active actors on pipe
2025-10-01T14:10:09.405789Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:09.405794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:09.405809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:09.405809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:09.405869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255406675303946:8250]
2025-10-01T14:10:09.405869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 997 reason: error at write: Disconnected sessionId: src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0
2025-10-01T14:10:09.406078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 997 sessionId: src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0 is DEAD
2025-10-01T14:10:09.406252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:09.406261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0] Write session will restart in 0.006676s
2025-10-01T14:10:09.406280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0] Write session: Do CDS request
2025-10-01T14:10:09.406285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:09.413976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.414005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:09.414022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 998
2025-10-01T14:10:09.414220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.414259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:09.414270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:09.414273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:09.414706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 998 sessionId:  describe result for acl check
2025-10-01T14:10:09.414744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:09.414751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:09.414752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:09.414758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255406675303987:8832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:09.415277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255406675303987:8832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:09.417100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:09.417033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255406675303987:8832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:09.419420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:09.419613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:09.419621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:09.419629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:09.419667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:09.419700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255404298427492:7720]
2025-10-01T14:10:09.419704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255406675303987:8832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:09.419719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255406675303987:8832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:09.419723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255406675303987:8832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:09.419731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:09.420158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:09.420423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:09.420455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:09.420671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:09.420710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.420715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.420716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.420716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.420717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.420717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.420718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.420718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.420719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.420720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.420721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.420721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.420722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.420722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.420725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.420741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.420745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.420746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.420748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.420750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.420752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.420754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.420755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.420758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.420759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.420762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.420771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.420773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.420779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.420783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.420787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.420790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.420792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.420795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.420798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.420801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.420803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.420806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.420808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.420811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.420813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.420816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.420819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.420822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.420825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.420827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.420830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.420833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.420837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.420840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.420852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.420857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.420861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.420865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.420868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.420871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.420890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:09.424602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:09.425585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:09.425603Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:09.425605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:09.425609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:09.425616Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 997 [2:7556255404298427492:7720]
2025-10-01T14:10:09.425633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:09.425649Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:09.425658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.425661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.425663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.425681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:09.425691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:09.425699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:09.425776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.425783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.425784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.425787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:09.425788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:09.425856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:09.425863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.425875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.425897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.425912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:09.425931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304024:8832], now have 1 active actors on pipe
2025-10-01T14:10:09.425940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675303951:2446], now have 1 active actors on pipe
2025-10-01T14:10:09.425948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255404298427487:7720]
2025-10-01T14:10:09.425953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255404298427487:7720]
2025-10-01T14:10:09.425955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255404298427487:7720]
2025-10-01T14:10:09.425971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:09.425990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:09.425991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:09.425994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:09.425996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:09.426008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:09.426011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:09.426048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255404298427487:7720]
2025-10-01T14:10:09.426005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 997
2025-10-01T14:10:09.426060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:09.426066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:09.426077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.426014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 997
2025-10-01T14:10:09.426082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.426134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be80d7d1-672e7124-534f686b-e5930dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:09.426149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.426158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.426160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:09.426170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.426184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:09.426210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.426361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.426384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.426404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.426520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 998 partition: 0 MaxSeqNo: 45 sessionId: src_id|be80d7d1-672e7124-534f686b-e5930dd_0
2025-10-01T14:10:09.426909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|556a2d0a-4bc37787-f07c80c7-75d97683_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be80d7d1-672e7124-534f686b-e5930dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:09.429356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be80d7d1-672e7124-534f686b-e5930dd_0] Write session: try to update token
2025-10-01T14:10:09.429374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be80d7d1-672e7124-534f686b-e5930dd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:09.447547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:09.447565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:09.447567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:09.447568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:09.447575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255404298427487:7720]
2025-10-01T14:10:09.447578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255404298427487:7720]
2025-10-01T14:10:09.447581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255404298427487:7720]
2025-10-01T14:10:09.447619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:09.447625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.447626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:09.447629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:09.447635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:09.447639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:09.447749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:09.446756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 998 sessionId: src_id|be80d7d1-672e7124-534f686b-e5930dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:09.449361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:09.505830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255406675304036:8250]
2025-10-01T14:10:09.506072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 997, pipe: [1:7556255406675304036:8250]
2025-10-01T14:10:09.590431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:09.590791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.590803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.590838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304036:8250], now have 1 active actors on pipe
2025-10-01T14:10:09.590997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:09.591088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:09.591096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255406675304036:8250]
2025-10-01T14:10:09.591102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:09.591119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:09.591155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 998 reason: error at write: Disconnected sessionId: src_id|be80d7d1-672e7124-534f686b-e5930dd_0
2025-10-01T14:10:09.591328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 998 sessionId: src_id|be80d7d1-672e7124-534f686b-e5930dd_0 is DEAD
2025-10-01T14:10:09.591509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be80d7d1-672e7124-534f686b-e5930dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:09.591520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be80d7d1-672e7124-534f686b-e5930dd_0] Write session will restart in 0.006490s
2025-10-01T14:10:09.591547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be80d7d1-672e7124-534f686b-e5930dd_0] Write session: Do CDS request
2025-10-01T14:10:09.591553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be80d7d1-672e7124-534f686b-e5930dd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:09.598663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:09.598996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:09.599033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be80d7d1-672e7124-534f686b-e5930dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.599011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 999
2025-10-01T14:10:09.599257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.599291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:09.599303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:09.599307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:09.599623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 999 sessionId:  describe result for acl check
2025-10-01T14:10:09.599659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:09.599665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:09.599667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:09.599672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255406675304077:8836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:09.600070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255406675304077:8836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:09.600880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:09.601067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:09.601079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:09.601090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:09.601136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:09.601189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255404298427568:7722]
2025-10-01T14:10:09.601716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255406675304077:8836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:09.601753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:09.602019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:09.602060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:09.602345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:09.602417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.602424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.602425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.602426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.602427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.602428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.602429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.602431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.602432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.602433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.602434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.602435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.602436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.602437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.602443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.602452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.602457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.602460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.602464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.602468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.602472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.602476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.602480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.602484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.602488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.602493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.602496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.602504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.602511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.602522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.602532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.602538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.602546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.602552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.602560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.602565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.602574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.602579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.602588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.602597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.602602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.602610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.602615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.602620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.602629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.602635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.602642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.602647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.602656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.602661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.602667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.602672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.602680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.602685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.602692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.602697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.602742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:09.606085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255406675304077:8836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:09.606097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255406675304077:8836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:09.606100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255406675304077:8836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:09.606114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:09.606241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:09.606886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:09.606899Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:09.606902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:09.606905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:09.606911Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 998 [2:7556255404298427568:7722]
2025-10-01T14:10:09.606926Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:09.606941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:09.606949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.606952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.606955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.606968Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:09.606979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:09.606990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:09.607044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.607052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.607055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.607058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:09.607061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:09.607124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:09.607133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.607143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.607152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.607167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:09.607189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304116:8836], now have 1 active actors on pipe
2025-10-01T14:10:09.607196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304038:2446], now have 1 active actors on pipe
2025-10-01T14:10:09.607203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255404298427563:7722]
2025-10-01T14:10:09.607208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255404298427563:7722]
2025-10-01T14:10:09.607210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255404298427563:7722]
2025-10-01T14:10:09.607226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:09.607228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 998
2025-10-01T14:10:09.607253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 998
2025-10-01T14:10:09.607243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:09.607254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:09.607258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:09.607260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:09.607261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:09.607263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:09.607285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255404298427563:7722]
2025-10-01T14:10:09.607291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:09.607294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:09.607310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.607317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.607353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:09.607361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.607364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.607367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:09.607373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.607382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:09.607394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.607516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.607521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.607532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.607584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 999 partition: 0 MaxSeqNo: 45 sessionId: src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0
2025-10-01T14:10:09.607931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be80d7d1-672e7124-534f686b-e5930dd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:09.610319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0] Write session: try to update token
2025-10-01T14:10:09.610340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:09.624609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 999 sessionId: src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:09.626960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:09.626977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:09.626979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:09.626980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:09.626997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255404298427563:7722]
2025-10-01T14:10:09.626969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:09.627002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255404298427563:7722]
2025-10-01T14:10:09.627006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255404298427563:7722]
2025-10-01T14:10:09.627055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:09.627058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:09.627064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:09.627066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.627067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:09.627068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:09.627191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:09.691180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255406675304124:8250]
2025-10-01T14:10:09.691434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 998, pipe: [1:7556255406675304124:8250]
2025-10-01T14:10:09.762193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:09.762441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.762455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.762488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304124:8250], now have 1 active actors on pipe
2025-10-01T14:10:09.762660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:09.762676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255406675304124:8250]
2025-10-01T14:10:09.762684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:09.762687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:09.762743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 999 reason: error at write: Disconnected sessionId: src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0
2025-10-01T14:10:09.762755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:09.762956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 999 sessionId: src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0 is DEAD
2025-10-01T14:10:09.763089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:09.763099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0] Write session will restart in 0.006336s
2025-10-01T14:10:09.763125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0] Write session: Do CDS request
2025-10-01T14:10:09.763134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:09.770308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:09.770888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.770923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:09.770937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1000
2025-10-01T14:10:09.771072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.771100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:09.771108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:09.771111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:09.771583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1000 sessionId:  describe result for acl check
2025-10-01T14:10:09.771610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:09.771616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:09.771617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:09.771622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255406675304180:8842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:09.772009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255406675304180:8842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:09.772415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:09.772561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:09.772568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:09.772575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:09.772605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:09.772634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255404298427658:7725]
2025-10-01T14:10:09.773003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:09.773181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:09.773205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:09.773391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:09.773423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.773427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.773428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.773428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.773431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.773431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.773432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.773432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.773433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.773433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.773434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.773434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.773435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.773436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.773438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.773444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.773446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.773448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.773450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.773452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.773454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.773456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.773458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.773461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.773463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.773465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.773467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.773469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.773473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.773477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.773481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.773484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.773486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.773489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.773491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.773495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.773497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.773500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.773502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.773504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.773506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.773509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.773512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.773515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.773517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.773520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.773527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.773529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.773532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.773534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.773537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.773543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.773520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255406675304180:8842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:09.773545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.773548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.773550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.773552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.773573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:09.776504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255406675304180:8842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:09.776515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255406675304180:8842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:09.776520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255406675304180:8842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:09.776526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:09.776718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:09.777287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:09.777297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:09.777299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:09.777301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:09.777306Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 999 [2:7556255404298427658:7725]
2025-10-01T14:10:09.777318Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:09.777337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:09.777343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.777346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.777350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.777368Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:09.777378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:09.777388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:09.777436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.777442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.777443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.777445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:09.777447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:09.777491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:09.777496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.777503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.777508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.777520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:09.777535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304139:2446], now have 1 active actors on pipe
2025-10-01T14:10:09.777540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304224:8842], now have 1 active actors on pipe
2025-10-01T14:10:09.777544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255404298427653:7725]
2025-10-01T14:10:09.777546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255404298427653:7725]
2025-10-01T14:10:09.777547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255404298427653:7725]
2025-10-01T14:10:09.777555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:09.777562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 999
2025-10-01T14:10:09.777567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:09.777567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:09.777575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:09.777576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:09.777577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:09.777578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:09.777598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255404298427653:7725]
2025-10-01T14:10:09.777603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:09.777595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 999
2025-10-01T14:10:09.777614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:09.777623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.777626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.777643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:09.777652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.777656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.777658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:09.777663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.777668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:09.777682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.778043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.778056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.778071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.778143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1000 partition: 0 MaxSeqNo: 45 sessionId: src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0
2025-10-01T14:10:09.778464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c37b5c25-bc834cf0-4e0b4226-780a4705_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:09.780901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0] Write session: try to update token
2025-10-01T14:10:09.780919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:09.794156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1000 sessionId: src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:09.796608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:09.797537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.797559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.797576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:09.797579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:09.797580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:09.797582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:09.797588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255404298427653:7725]
2025-10-01T14:10:09.797596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255404298427653:7725]
2025-10-01T14:10:09.797599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255404298427653:7725]
2025-10-01T14:10:09.797635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:09.797642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:09.797646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:09.797647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.797648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:09.797650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:09.797773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:09.862780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255406675304235:8250]
2025-10-01T14:10:09.863036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 999, pipe: [1:7556255406675304235:8250]
2025-10-01T14:10:09.936317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:09.936919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:09.936975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304235:8250], now have 1 active actors on pipe
2025-10-01T14:10:09.937139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:09.937174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:09.937219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:09.937220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255406675304235:8250]
2025-10-01T14:10:09.937226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:09.937291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1000 reason: error at write: Disconnected sessionId: src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0
2025-10-01T14:10:09.937456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1000 sessionId: src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0 is DEAD
2025-10-01T14:10:09.937611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:09.937623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0] Write session will restart in 0.006272s
2025-10-01T14:10:09.937649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0] Write session: Do CDS request
2025-10-01T14:10:09.937658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:09.944951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.945176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:09.945193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1001
2025-10-01T14:10:09.945231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:09.945329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:09.945363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:09.945379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:09.945386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:09.945762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1001 sessionId:  describe result for acl check
2025-10-01T14:10:09.945811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:09.945817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:09.945819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:09.945824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255406675304279:8846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:09.946399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255406675304279:8846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:09.947395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:09.947622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:09.947629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:09.947641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:09.947693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:09.947729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255404298427739:7728]
2025-10-01T14:10:09.948280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:09.948540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:09.948550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255406675304279:8846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:09.948584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:09.948898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:09.948957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.948964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.948967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.948968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.948969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.948970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.948971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.948972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.948973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.948974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.948975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.948976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.948977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.948978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.948983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.948991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.948994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.948998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.949001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.949005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.949008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.949012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.949015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.949019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.949022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.949026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.949029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.949032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.949039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.949047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:09.949052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.949057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:09.949061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.949067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:09.949071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.949076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:09.949080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.949084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:09.949088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.949093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:09.949097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.949101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:09.949105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.949110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:09.949114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.949123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:09.949127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.949131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.949137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.949141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.949144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.949149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.949152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.949158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:09.949165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.949170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:09.949207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:09.952622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255406675304279:8846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:09.952641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255406675304279:8846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:09.952644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255406675304279:8846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:09.952652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:09.952901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:09.953559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:09.953574Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:09.953577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:09.953581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:09.953588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1000 [2:7556255404298427739:7728]
2025-10-01T14:10:09.953602Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:09.953624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:09.953634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.953641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.953643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.953660Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:09.953669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:09.953678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:09.953738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.953744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.953746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.953749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:09.953752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:09.953846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:09.953855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.953866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:09.953880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:09.953899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:09.953922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304236:2446], now have 1 active actors on pipe
2025-10-01T14:10:09.953932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255406675304318:8846], now have 1 active actors on pipe
2025-10-01T14:10:09.953938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255404298427734:7728]
2025-10-01T14:10:09.953925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1000
2025-10-01T14:10:09.953940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255404298427734:7728]
2025-10-01T14:10:09.953954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1000
2025-10-01T14:10:09.953942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255404298427734:7728]
2025-10-01T14:10:09.953959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:09.953973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:09.953985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:09.953987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:09.953989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:09.953990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:09.953991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:09.954026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255404298427734:7728]
2025-10-01T14:10:09.954040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:09.954052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:09.954061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.954065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.954110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:09.954121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:09.954126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:09.954128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:09.954136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:09.954149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:09.954169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.954301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:09.954308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:09.954322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:09.954404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1001 partition: 0 MaxSeqNo: 45 sessionId: src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0
2025-10-01T14:10:09.958660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b99b2a9-dead16af-6f4cf1ae-8a08036b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:09.961598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0] Write session: try to update token
2025-10-01T14:10:09.961617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:09.975546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:09.975565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:09.975568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:09.975570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:09.975580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255404298427734:7728]
2025-10-01T14:10:09.975587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255404298427734:7728]
2025-10-01T14:10:09.975591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255404298427734:7728]
2025-10-01T14:10:09.975636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:09.975647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:09.975651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:09.975653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:09.975658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:09.975662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:09.975794Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:09.982956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1001 sessionId: src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:09.985443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:10.037305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255410970271621:8250]
2025-10-01T14:10:10.037558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1000, pipe: [1:7556255410970271621:8250]
2025-10-01T14:10:10.120215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:10.120502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.120520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.120543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271621:8250], now have 1 active actors on pipe
2025-10-01T14:10:10.120757Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:10.120740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:10.121300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:10.121322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0] Write session will restart in 0.008549s
2025-10-01T14:10:10.120804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255410970271621:8250]
2025-10-01T14:10:10.120822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:10.121348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0] Write session: Do CDS request
2025-10-01T14:10:10.120891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1001 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0
2025-10-01T14:10:10.121018Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:10:10.121093Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 10 consumer shared/user session shared/user_1_10_4908489780046192851_v1 is DEAD
2025-10-01T14:10:10.121122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1001 sessionId: src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0 is DEAD
2025-10-01T14:10:10.121354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:10.121241Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255320775925171:8245] disconnected; active server actors: 1
2025-10-01T14:10:10.121245Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255320775925171:8245] client user disconnected session shared/user_1_10_4908489780046192851_v1
2025-10-01T14:10:10.121428Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:10:10.121542Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:10:10.121548Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:10:10.121556Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.005064s
2025-10-01T14:10:10.127809Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:10:10.127977Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:10:10.127990Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 11
2025-10-01T14:10:10.128143Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 11 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:10:10.128196Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:10:10.128275Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 auth for : user
2025-10-01T14:10:10.128365Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 Handle describe topics response
2025-10-01T14:10:10.128388Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 auth is DEAD
2025-10-01T14:10:10.128401Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:10:10.128635Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:10:10.128716Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_11_18163181406657330534_v1
2025-10-01T14:10:10.128782Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255410970271678:8856] connected; active server actors: 1
2025-10-01T14:10:10.128801Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255410970271678:8856] session shared/user_1_11_18163181406657330534_v1
2025-10-01T14:10:10.128813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:10:10.128830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:10:10.128842Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_11_18163181406657330534_v1" (Sender=[1:7556255410970271674:8856], Pipe=[1:7556255410970271678:8856], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:10:10.128852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:10:10.128867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:10:10.128883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_11_18163181406657330534_v1" (Sender=[1:7556255410970271674:8856], Pipe=[1:7556255410970271678:8856], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:10:10.128899Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_11_18163181406657330534_v1" sender [1:7556255410970271674:8856] lock partition 0 for ReadingSession "shared/user_1_11_18163181406657330534_v1" (Sender=[1:7556255410970271674:8856], Pipe=[1:7556255410970271678:8856], Partitions=[], ActiveFamilyCount=1) generation 1 step 11
2025-10-01T14:10:10.128911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:10:10.128920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000047s
2025-10-01T14:10:10.129151Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 11 Session: "shared/user_1_11_18163181406657330534_v1" ClientId: "user" PipeClient { RawX1: 7556255410970271678 RawX2: 4503603922346648 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:10:10.129170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:10:10.129227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:10.130801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.130830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:10.130844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1002
2025-10-01T14:10:10.130961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.130988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:10.130994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:10.130997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:10.131333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1002 sessionId:  describe result for acl check
2025-10-01T14:10:10.131359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:10.131361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:10.131363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:10.131367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255410970271687:8860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:10.131375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:10.131549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:10.131559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:10.131581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:10.131634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:10.131669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255408593395117:7730]
2025-10-01T14:10:10.131852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255410970271687:8860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:10.132216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:10.132480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:10.132521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:10.132827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:10.132885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.132893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.132894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.132895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.132896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.132897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.132898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.132900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.132903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.132904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.132905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.132906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.132907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.132908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.132913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.132923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.132926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.132930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.132933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.132937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.132940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.132944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.132948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.132952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.132955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.132959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.132963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.132967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.132972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.132980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.132986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.132991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.132995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.133004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.133008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.133017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.133021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.133026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.133029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.133036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.133043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.133048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.133052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.133061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.133078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.133088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.133092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.133097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.133101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.133106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.133110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.133117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.133122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.133127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.133131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.133138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.133173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:10.135045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255410970271687:8860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:10.136991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:10.137799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255410970271687:8860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:10.137813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255410970271687:8860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:10.137818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255410970271687:8860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:10.137826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:10.137891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:10.137903Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:10.137905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:10.137909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:10.137915Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1001 [2:7556255408593395117:7730]
2025-10-01T14:10:10.137930Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:10.137947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:10.137954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.137957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.137959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.137974Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:10.137982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:10.137988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:10.138037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.138043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.138045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.138048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:10.138050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:10.138111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:10.138117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.138129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.138140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.138161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:10.138181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271624:2446], now have 1 active actors on pipe
2025-10-01T14:10:10.138190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271682:8859], now have 1 active actors on pipe
2025-10-01T14:10:10.138193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271724:8860], now have 1 active actors on pipe
2025-10-01T14:10:10.138200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255408593395111:7730]
2025-10-01T14:10:10.138202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255408593395111:7730]
2025-10-01T14:10:10.138204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255408593395111:7730]
2025-10-01T14:10:10.138216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:10.138228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:10.138232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:10.138216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1001
2025-10-01T14:10:10.138235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:10.138237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:10.138246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:10.138249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:10.138257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1001, pipe: [1:7556255410970271682:8859]
2025-10-01T14:10:10.138272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1001
2025-10-01T14:10:10.138281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255408593395111:7730]
2025-10-01T14:10:10.138287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:10.138290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:10.138301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.138309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.138323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_11_18163181406657330534_v1 on pipe: [1:7556255410970271682:8859]
2025-10-01T14:10:10.138361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.138367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.138385Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_11_18163181406657330534_v1:1 with generation 1001
2025-10-01T14:10:10.138399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.138408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.138410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:10.138425Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_11_18163181406657330534_v1
2025-10-01T14:10:10.138432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.138458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:10.138468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:10:10.138479Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:10:10.141673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:10:10.141700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:10:10.141707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.141714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.141716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:10.141727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.141737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:10.141747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:10:10.141759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:10:10.141777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.141902Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327810137 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:10:10.141923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:10:10.141978Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 sending to client partition status
2025-10-01T14:10:10.142033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.142043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.142062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.142184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1002 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0
2025-10-01T14:10:10.142588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fa5b849-bafd6ac4-81498a77-30edfc75_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:10.145203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0] Write session: try to update token
2025-10-01T14:10:10.145223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:10.160928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1002 sessionId: src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:10.162451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:10.162470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:10.162473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:10.162476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:10.162486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255408593395111:7730]
2025-10-01T14:10:10.162490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255408593395111:7730]
2025-10-01T14:10:10.162493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255408593395111:7730]
2025-10-01T14:10:10.162549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:10.162558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:10.162563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.162563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:10.162566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:10.162567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:10.162708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:10.163353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:10.301482Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:10.301738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.301750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.301889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_11_18163181406657330534_v1
2025-10-01T14:10:10.301898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:10.301965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:10.301966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:10.301977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:10.302008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255410970271682:8859]
2025-10-01T14:10:10.302041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1002 reason: error at write: Disconnected sessionId: src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0
2025-10-01T14:10:10.302072Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_11_18163181406657330534_v1
2025-10-01T14:10:10.302223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1002 sessionId: src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0 is DEAD
2025-10-01T14:10:10.302390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:10.302401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0] Write session will restart in 0.008227s
2025-10-01T14:10:10.302419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0] Write session: Do CDS request
2025-10-01T14:10:10.302424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:10.309269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:10.311046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:10.311248Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:10.311263Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:10.311279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:10.311335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:10.311376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255408593395220:7740]
2025-10-01T14:10:10.311820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.311874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:10.311889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1003
2025-10-01T14:10:10.311930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:10.312018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.312044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:10.312052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:10.312055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:10.312188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:10.312237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:10.312363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1003 sessionId:  describe result for acl check
2025-10-01T14:10:10.312387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:10.312392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:10.312393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:10.312396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255410970271796:8866] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:10.312513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:10.312586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.312594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.312595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.312596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.312597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.312598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.312600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.312601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.312602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.312610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.312611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.312612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.312613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.312614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.312619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.312629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.312637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.312645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.312649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.312652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.312660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.312663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.312666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.312675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.312678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.312681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.312684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.312688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.312693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.312705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.312714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.312724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.312744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.312749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.312758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.312767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.312775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.312780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.312787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.312792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.312802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.312811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.312819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.312823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.312831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.312840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.312849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.312858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.312866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.312871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.312862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255410970271796:8866] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:10.312878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.312886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.312895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.312903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.312907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.312911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.312947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:10.314593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255410970271796:8866] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:10.316331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:10.316851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255410970271796:8866] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:10.316863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255410970271796:8866] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:10.316866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255410970271796:8866] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:10.316872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:10.316921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:10.316932Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:10.316934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:10.316936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:10.316941Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1002 [2:7556255408593395220:7740]
2025-10-01T14:10:10.316951Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:10.316961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:10.316962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.316964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.316966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.316979Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:10.316986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:10.316993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:10.317038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.317045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.317046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.317049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:10.317052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:10.317117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:10.317123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.317129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.317135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.317143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:10.317155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271833:8866], now have 1 active actors on pipe
2025-10-01T14:10:10.317159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271751:2446], now have 1 active actors on pipe
2025-10-01T14:10:10.317164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255408593395215:7740]
2025-10-01T14:10:10.317165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255408593395215:7740]
2025-10-01T14:10:10.317166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255408593395215:7740]
2025-10-01T14:10:10.317175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:10.317184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:10.317185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:10.317187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:10.317189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:10.317197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:10.317184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1002
2025-10-01T14:10:10.317186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1002
2025-10-01T14:10:10.317200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:10.317220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255408593395215:7740]
2025-10-01T14:10:10.317223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:10.317224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:10.317240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.317248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.317285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:10.317295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.317299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.317302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:10.317310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.317315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:10.317326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.317438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.317445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.317455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.317507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1003 partition: 0 MaxSeqNo: 45 sessionId: src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0
2025-10-01T14:10:10.317801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b63f76-53152b71-a4ee44f5-87b51d63_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:10.320173Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0] Write session: try to update token
2025-10-01T14:10:10.320198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:10.332808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1003 sessionId: src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:10.335334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:10.336003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.336030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.336050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:10.336054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:10.336056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:10.336058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:10.336066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255408593395215:7740]
2025-10-01T14:10:10.336071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255408593395215:7740]
2025-10-01T14:10:10.336074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255408593395215:7740]
2025-10-01T14:10:10.336103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:10.336114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:10.336117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:10.336129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:10.336141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.336143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:10.336267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:10.402337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255410970271843:8859]
2025-10-01T14:10:10.402551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1002, pipe: [1:7556255410970271843:8859]
2025-10-01T14:10:10.491445Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:10.491748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:10.491809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271843:8859], now have 1 active actors on pipe
2025-10-01T14:10:10.491898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:10.492241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255410970271843:8859]
2025-10-01T14:10:10.492267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:10.501434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:10.501449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:10.501448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:10.501474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1003 reason: error at write: Disconnected sessionId: src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0
2025-10-01T14:10:10.501642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1003 sessionId: src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0 is DEAD
2025-10-01T14:10:10.501755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:10.501765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0] Write session will restart in 0.009500s
2025-10-01T14:10:10.501791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0] Write session: Do CDS request
2025-10-01T14:10:10.501796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:10.504724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:10.504880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:10.504887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:10.504894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:10.504927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:10.504954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255408593395322:7747]
2025-10-01T14:10:10.505319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:10.505487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:10.505513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:10.505689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:10.505723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.505727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.505728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.505729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.505729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.505730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.505731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.505731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.505732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.505732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.505733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.505733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.505734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.505735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.505738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.505743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.505746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.505748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.505750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.505752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.505754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.505756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.505758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.505760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.505762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.505764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.505766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.505768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.505772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.505776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.505780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.505784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.505786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.505789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.505791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.505793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.505795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.505798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.505800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.505802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.505805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.505807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.505809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.505812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.505814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.505816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.505818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.505821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.505823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.505829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.505831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.505834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.505836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.505841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.505843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.505846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.505865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:10.509056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:10.509577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:10.509589Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:10.509590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:10.509592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:10.509597Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1003 [2:7556255408593395322:7747]
2025-10-01T14:10:10.509607Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:10.509621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:10.509626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.509628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.509630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.509640Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:10.509647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:10.509651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:10.509691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.509696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.509698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.509700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:10.509702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:10.509742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:10.509747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.509753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.509759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.509770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:10.509783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255408593395315:7747]
2025-10-01T14:10:10.509787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255408593395315:7747]
2025-10-01T14:10:10.509788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255408593395315:7747]
2025-10-01T14:10:10.509793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:10.509801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:10.509810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:10.509812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:10.509814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:10.509819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:10.509821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:10.509839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271846:2446], now have 1 active actors on pipe
2025-10-01T14:10:10.509846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255408593395315:7747]
2025-10-01T14:10:10.509852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:10.509859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:10.509906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1003
2025-10-01T14:10:10.512820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.512898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:10.512911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1004
2025-10-01T14:10:10.513006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.513030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:10.513039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:10.513049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:10.513417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1004 sessionId:  describe result for acl check
2025-10-01T14:10:10.513453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:10.513460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:10.513462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:10.513466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255410970271899:8870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:10.513898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255410970271899:8870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:10.515927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255410970271899:8870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:10.518715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255410970271899:8870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:10.518728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255410970271899:8870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:10.518731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255410970271899:8870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:10.518737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:10.519066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1003
2025-10-01T14:10:10.524419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271935:8870], now have 1 active actors on pipe
2025-10-01T14:10:10.524449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.524455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.524471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:10.524477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:10.524483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255408593395315:7747]
2025-10-01T14:10:10.524514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:10.524517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:10.524525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.524532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.524534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:10.524542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.524556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:10.524566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:10.524718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:10.524855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:10.524973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:10.525104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:10.525278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:10.525310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.525329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:10.525524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.525531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.525543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.525619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1004 partition: 0 MaxSeqNo: 45 sessionId: src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0
2025-10-01T14:10:10.525958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3db476b7-5ce11563-cb3cd42c-42fbfe7a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:10.528345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0] Write session: try to update token
2025-10-01T14:10:10.528364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:10.537453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:10.537472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:10.537474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:10.537475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:10.537484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255408593395315:7747]
2025-10-01T14:10:10.537487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255408593395315:7747]
2025-10-01T14:10:10.537490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255408593395315:7747]
2025-10-01T14:10:10.537525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:10.537531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:10.537534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.537535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:10.537535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:10.537540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:10.537654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:10.540567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1004 sessionId: src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:10.542811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:10.592260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255410970271936:8859]
2025-10-01T14:10:10.592462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1003, pipe: [1:7556255410970271936:8859]
2025-10-01T14:10:10.675632Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:10.675955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.675968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.675986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271936:8859], now have 1 active actors on pipe
2025-10-01T14:10:10.676153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:10.676169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:10.676169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255410970271936:8859]
2025-10-01T14:10:10.676184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:10.676199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:10.676238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1004 reason: error at write: Disconnected sessionId: src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0
2025-10-01T14:10:10.676442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1004 sessionId: src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0 is DEAD
2025-10-01T14:10:10.676598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:10.676608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0] Write session will restart in 0.005286s
2025-10-01T14:10:10.676627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0] Write session: Do CDS request
2025-10-01T14:10:10.676631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:10.682900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.682991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:10.683006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1005
2025-10-01T14:10:10.683129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.683158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:10.683169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:10.683172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:10.683529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1005 sessionId:  describe result for acl check
2025-10-01T14:10:10.683554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:10.683558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:10.683561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:10.683565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255410970271983:8874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:10.683686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:10.683935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255410970271983:8874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:10.685754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255410970271983:8874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:10.685866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:10.686083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:10.686091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:10.686100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:10.686148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:10.686185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255408593395416:7750]
2025-10-01T14:10:10.686604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:10.686878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:10.686917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:10.687115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:10.687152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.687156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.687157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.687159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.687160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.687161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.687162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.687162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.687163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.687163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.687164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.687164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.687165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.687165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.687168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.687174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.687176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.687178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.687179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.687182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.687186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.687189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.687192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.687196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.687199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.687201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.687205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.687208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.687214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.687218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.687222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.687224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.687228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.687234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.687237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.687243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.687245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.687248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.687250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.687253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.687255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.687258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.687264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.687267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.687269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.687272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.687274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.687276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.687278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.687281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.687283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.687286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.687288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.687291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.687292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.687295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.687314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:10.690469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255410970271983:8874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:10.690483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255410970271983:8874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:10.690485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255410970271983:8874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:10.690491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:10.690576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:10.691283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:10.691295Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:10.691296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:10.691299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:10.691303Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1004 [2:7556255408593395416:7750]
2025-10-01T14:10:10.691313Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:10.691325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:10.691327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.691330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.691331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.691341Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:10.691345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:10.691348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:10.691383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.691388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.691390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.691392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:10.691393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:10.691458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:10.691463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.691469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.691475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.691483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:10.691498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970271938:2446], now have 1 active actors on pipe
2025-10-01T14:10:10.691507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255408593395411:7750]
2025-10-01T14:10:10.691508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255408593395411:7750]
2025-10-01T14:10:10.691509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255408593395411:7750]
2025-10-01T14:10:10.691521Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:10.691529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970272023:8874], now have 1 active actors on pipe
2025-10-01T14:10:10.691538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:10.691536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:10.691540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:10.691542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:10.691548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:10.691551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:10.691569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255408593395411:7750]
2025-10-01T14:10:10.691574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:10.691555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1004
2025-10-01T14:10:10.691580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:10.691596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.691556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1004
2025-10-01T14:10:10.691599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.691619Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:10.691628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.691630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.691635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:10.691639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.691648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:10.691660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.691776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.691783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.691796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.691864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1005 partition: 0 MaxSeqNo: 45 sessionId: src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0
2025-10-01T14:10:10.692238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc945d43-2f2c2b43-67610d2-e3f25bd0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:10.694415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0] Write session: try to update token
2025-10-01T14:10:10.694428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:10.702159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:10.702176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:10.702185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255408593395411:7750]
2025-10-01T14:10:10.702222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:10.702229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:10.702397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:10.702517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:10.702652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:10.702790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:10.702968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:10.703002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:10.707217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1005 sessionId: src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:10.709339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:10.709510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.709528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.709558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:10.709675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:10.719709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:10.719725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:10.719727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:10.719728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:10.719739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255408593395411:7750]
2025-10-01T14:10:10.719742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255408593395411:7750]
2025-10-01T14:10:10.719745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255408593395411:7750]
2025-10-01T14:10:10.719772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:10.719777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:10.719780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:10.719782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:10.719787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.719788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:10.719896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:10.776119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255410970272044:8859]
2025-10-01T14:10:10.776345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1004, pipe: [1:7556255410970272044:8859]
2025-10-01T14:10:10.854879Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:10.863157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.863186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.863342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.863405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.863466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.863528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.863578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.863587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.863658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.863716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.863776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.863839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.864302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.864313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.864376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.864430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.864489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.864552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.864594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.864600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.864658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.864719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.864790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.864854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.864899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.864904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.864971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.865028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.865083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.865140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.865186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.865192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.865258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.865316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.865378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.865439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.865488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.865495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.865560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.865616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.865679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.865733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.865774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.865780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.865839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.865894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.865952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.866012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.866053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.866059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.866116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.866170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.866225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.866282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.866324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.866329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.866401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:10.866453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:10.866507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:10.866571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:10.866616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:10.866622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:10.866681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970272044:8859], now have 1 active actors on pipe
2025-10-01T14:10:10.866893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:10.866906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:10.866929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255410970272044:8859]
2025-10-01T14:10:10.866931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1005 reason: error at write: Disconnected sessionId: src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0
2025-10-01T14:10:10.866950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:10.867172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1005 sessionId: src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0 is DEAD
2025-10-01T14:10:10.867301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:10.867286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:10.867308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0] Write session will restart in 0.006564s
2025-10-01T14:10:10.867338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0] Write session: Do CDS request
2025-10-01T14:10:10.867350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:10.874918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.874960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:10.874978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1006
2025-10-01T14:10:10.875139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:10.875173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:10.875183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:10.875186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:10.875564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1006 sessionId:  describe result for acl check
2025-10-01T14:10:10.875599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:10.875600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:10.875602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:10.875605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255410970272092:8880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:10.875882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:10.876005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255410970272092:8880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:10.877806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255410970272092:8880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:10.878146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:10.878300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:10.878307Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:10.878314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:10.878348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:10.878398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255408593395502:7753]
2025-10-01T14:10:10.878934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:10.879214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:10.879269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:10.879492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:10.879539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.879545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.879546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.879547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.879549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.879550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.879551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.879552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.879554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.879555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.879556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.879557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.879558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.879559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.879564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.879574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.879577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.879581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.879585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.879588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.879590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.879592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.879594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.879596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.879598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.879600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.879602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.879603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.879608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.879615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:10.879621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.879625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:10.879630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.879635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:10.879639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.879649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:10.879654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.879661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:10.879663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.879667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:10.879670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.879672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:10.879674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.879677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:10.879679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.879683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:10.879685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.879687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.879691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.879694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.879697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.879699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.879701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.879704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:10.879706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.879708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:10.879728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:10.880121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255410970272092:8880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:10.880134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255410970272092:8880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:10.880138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255410970272092:8880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:10.880145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:10.883272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:10.884000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:10.884014Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:10.884016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:10.884019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:10.884024Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1005 [2:7556255408593395502:7753]
2025-10-01T14:10:10.884039Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:10.884051Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:10.884053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.884056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.884057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.884069Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:10.884078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:10.884082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:10.884125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.884131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.884133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.884135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:10.884137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:10.884196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:10.884203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.884214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:10.884225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:10.884233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:10.884247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970272047:2446], now have 1 active actors on pipe
2025-10-01T14:10:10.884252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970272132:8880], now have 1 active actors on pipe
2025-10-01T14:10:10.884258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255408593395497:7753]
2025-10-01T14:10:10.884259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255408593395497:7753]
2025-10-01T14:10:10.884260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255408593395497:7753]
2025-10-01T14:10:10.884268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:10.884279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:10.884283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:10.884287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:10.884289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:10.884290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:10.884292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:10.884317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255408593395497:7753]
2025-10-01T14:10:10.884322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:10.884321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1005
2025-10-01T14:10:10.884343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:10.884340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1005
2025-10-01T14:10:10.884376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.884384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.884406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:10.884418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:10.884423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:10.884425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:10.884430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:10.884437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:10.884446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.884585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:10.884591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:10.884602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:10.884681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1006 partition: 0 MaxSeqNo: 45 sessionId: src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0
2025-10-01T14:10:10.885105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b170d6-eb0ce3d-e385fe27-cff420e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:10.887673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0] Write session: try to update token
2025-10-01T14:10:10.887690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:10.904000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1006 sessionId: src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:10.905099Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:10.905124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:10.905127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:10.905129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:10.905139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255408593395497:7753]
2025-10-01T14:10:10.905145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255408593395497:7753]
2025-10-01T14:10:10.905149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255408593395497:7753]
2025-10-01T14:10:10.905200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:10.905203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:10.905210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:10.905212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:10.905214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:10.905215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:10.905359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:10.906411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:10.967064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255410970272140:8859]
2025-10-01T14:10:10.967299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1005, pipe: [1:7556255410970272140:8859]
2025-10-01T14:10:11.054028Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:11.054481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.054493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.054531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255410970272140:8859], now have 1 active actors on pipe
2025-10-01T14:10:11.054742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:11.054750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255410970272140:8859]
2025-10-01T14:10:11.054782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:11.054792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:11.054855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1006 reason: error at write: Disconnected sessionId: src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0
2025-10-01T14:10:11.055035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1006 sessionId: src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0 is DEAD
2025-10-01T14:10:11.055177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:11.055187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0] Write session will restart in 0.007264s
2025-10-01T14:10:11.055212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0] Write session: Do CDS request
2025-10-01T14:10:11.055221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:11.055305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:11.061549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:11.063741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:11.063878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.063926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:11.063920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:11.063936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:11.063935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1007
2025-10-01T14:10:11.063946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:11.064004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:11.064043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255412888362883:7755]
2025-10-01T14:10:11.064143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.064170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:11.064180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:11.064188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:11.064454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:11.064533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1007 sessionId:  describe result for acl check
2025-10-01T14:10:11.064563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:11.064568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:11.064569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:11.064572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255415265239485:8884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:11.064668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:11.064703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:11.064911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:11.064949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.064954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.064955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.064955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.064956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.064957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.064957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.064958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.064958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.064959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.064960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.064960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.064963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.064963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.064985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255415265239485:8884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:11.064966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.064971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.064973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.064976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.064978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.064980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.064982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.064984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.064986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.064988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.064990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.064992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.064994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.064995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.064999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.065003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.065007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.065010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.065012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.065015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.065017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.065020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.065022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.065026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.065032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.065037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.065040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.065050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.065057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.065063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.065071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.065074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.065080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.065082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.065085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.065091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.065093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.065096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.065098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.065101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.065104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.065107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.065127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:11.066399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255415265239485:8884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:11.068524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255415265239485:8884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:11.068537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255415265239485:8884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:11.068541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255415265239485:8884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:11.068548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:11.068622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:11.069319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:11.069345Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:11.069348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:11.069352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:11.069359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1006 [2:7556255412888362883:7755]
2025-10-01T14:10:11.069375Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:11.069396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:11.069399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.069403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.069405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.069422Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:11.069434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:11.069440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:11.069501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.069509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.069511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.069514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:11.069517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:11.069580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:11.069588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.069600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.069616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.069639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:11.069645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1006
2025-10-01T14:10:11.069668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1006
2025-10-01T14:10:11.069660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239524:8884], now have 1 active actors on pipe
2025-10-01T14:10:11.069671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239438:2446], now have 1 active actors on pipe
2025-10-01T14:10:11.069678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255412888362878:7755]
2025-10-01T14:10:11.069680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255412888362878:7755]
2025-10-01T14:10:11.069682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255412888362878:7755]
2025-10-01T14:10:11.069691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:11.069696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:11.069698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:11.069699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:11.069705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:11.069719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:11.069726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:11.069742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.069751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.069788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255412888362878:7755]
2025-10-01T14:10:11.069797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:11.069806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:11.069811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:11.069817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.069820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.069821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:11.069827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.069838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:11.069869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.069982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.069989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.070000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.070073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1007 partition: 0 MaxSeqNo: 45 sessionId: src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0
2025-10-01T14:10:11.070401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb2e3271-da12b03b-7ba90219-19ee257c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:11.072777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0] Write session: try to update token
2025-10-01T14:10:11.072792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:11.085504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1007 sessionId: src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:11.088062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:11.088240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.088262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.090170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:11.090200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:11.090203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:11.090205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:11.090207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:11.090213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255412888362878:7755]
2025-10-01T14:10:11.090217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255412888362878:7755]
2025-10-01T14:10:11.090220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255412888362878:7755]
2025-10-01T14:10:11.090239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:11.090243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:11.090246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:11.090251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:11.090256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.090258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:11.090264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:11.090411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:11.154989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255415265239532:8859]
2025-10-01T14:10:11.155201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1006, pipe: [1:7556255415265239532:8859]
2025-10-01T14:10:11.225076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:11.235202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.235234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.235399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.235466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.235534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.235602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.235648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.235657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.235729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.235793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.235873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.235947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.235991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.235997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.236063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.236123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.236183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.236244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.236291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.236297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.236358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.236414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.236473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.236530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.236571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.236577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.236637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.236693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.236763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.236823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.236870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.236876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.236942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.237000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.237062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.237131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.237175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.237182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.237251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.237311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.237373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.237436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.237482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.237490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.237552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.237611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.237668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.237728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.237776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.237782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.237848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.237908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.237970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.238035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.238080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.238086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.238152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.238214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.238280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.238344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.238403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.238410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.238480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239532:8859], now have 1 active actors on pipe
2025-10-01T14:10:11.238713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:11.238731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255415265239532:8859]
2025-10-01T14:10:11.238755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:11.238757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:11.238783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1007 reason: error at write: Disconnected sessionId: src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0
2025-10-01T14:10:11.239013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1007 sessionId: src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0 is DEAD
2025-10-01T14:10:11.239149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:11.239158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0] Write session will restart in 0.007096s
2025-10-01T14:10:11.239178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0] Write session: Do CDS request
2025-10-01T14:10:11.239182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:11.239573Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:11.245679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:11.247901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.247968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:11.247983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1008
2025-10-01T14:10:11.248114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.248137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:11.248141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:11.248143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:11.248148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:11.248378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:11.248390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:11.248402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:11.248459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:11.248468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1008 sessionId:  describe result for acl check
2025-10-01T14:10:11.248497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:11.248502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:11.248497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255412888362977:7759]
2025-10-01T14:10:11.248503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:11.248507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255415265239606:8895] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:11.248972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255415265239606:8895] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:11.249002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:11.249258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:11.249300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:11.249565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:11.249620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.249626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.249627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.249628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.249629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.249630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.249631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.249632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.249633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.249634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.249634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.249635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.249636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.249640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.249645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.249653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.249656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.249660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.249662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.249665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.249668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.249676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.249679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.249682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.249685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.249692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.249695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.249702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.249708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.249715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.249725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.249729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.249736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.249741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.249744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.249748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.249756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.249760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.249765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.249773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.249778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.249786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.249793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.249797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.249805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.249809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.249812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.249816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.249820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.249828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.249830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.249838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.249846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.249850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.249858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.249866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.249905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:11.251312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255415265239606:8895] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:11.253452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:11.254018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255415265239606:8895] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:11.254031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255415265239606:8895] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:11.254033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255415265239606:8895] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:11.254048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:11.254093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:11.254105Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:11.254108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:11.254111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:11.254118Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1007 [2:7556255412888362977:7759]
2025-10-01T14:10:11.254132Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:11.254151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:11.254157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.254161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.254163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.254179Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:11.254189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:11.254195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:11.254246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.254252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.254254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.254257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:11.254260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:11.254315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:11.254321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.254330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.254340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.254354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:11.254399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239642:8895], now have 1 active actors on pipe
2025-10-01T14:10:11.254406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239558:2446], now have 1 active actors on pipe
2025-10-01T14:10:11.254413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255412888362972:7759]
2025-10-01T14:10:11.254415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255412888362972:7759]
2025-10-01T14:10:11.254417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255412888362972:7759]
2025-10-01T14:10:11.254428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:11.254423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1007
2025-10-01T14:10:11.254444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:11.254422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1007
2025-10-01T14:10:11.254444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:11.254446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:11.254448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:11.254462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:11.254465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:11.254509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.254517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.254530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255412888362972:7759]
2025-10-01T14:10:11.254536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:11.254546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:11.254566Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:11.254576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.254580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.254587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:11.254594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.254602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:11.254625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.254742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.254748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.254761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.254845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1008 partition: 0 MaxSeqNo: 45 sessionId: src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0
2025-10-01T14:10:11.255162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8ea301c-344232db-d52f1512-8c6d5c8e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:11.259658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0] Write session: try to update token
2025-10-01T14:10:11.259675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:11.273259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1008 sessionId: src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:11.276394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:11.276409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:11.276411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:11.276412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:11.276419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255412888362972:7759]
2025-10-01T14:10:11.276422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255412888362972:7759]
2025-10-01T14:10:11.276425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255412888362972:7759]
2025-10-01T14:10:11.276476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:11.276485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.276485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:11.276487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:11.276491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:11.276495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:11.276605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:11.278032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:11.338790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255415265239657:8859]
2025-10-01T14:10:11.339072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1007, pipe: [1:7556255415265239657:8859]
2025-10-01T14:10:11.411232Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:11.411622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.411635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.411672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239657:8859], now have 1 active actors on pipe
2025-10-01T14:10:11.411855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:11.411881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255415265239657:8859]
2025-10-01T14:10:11.411911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:11.411930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:11.412005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1008 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0
2025-10-01T14:10:11.412239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1008 sessionId: src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0 is DEAD
2025-10-01T14:10:11.412372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:11.412381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0] Write session will restart in 0.008303s
2025-10-01T14:10:11.412401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0] Write session: Do CDS request
2025-10-01T14:10:11.412406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:11.420240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:11.421879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.421994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:11.422008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1009
2025-10-01T14:10:11.422171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.422204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:11.422227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:11.422231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:11.422297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:11.422528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:11.422543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:11.422557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:11.422618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:11.422615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1009 sessionId:  describe result for acl check
2025-10-01T14:10:11.422649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:11.422655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:11.422657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:11.422661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255412888363095:7772]
2025-10-01T14:10:11.422662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255415265239713:8900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:11.423214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255415265239713:8900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:11.423267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:11.423581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:11.423633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:11.423929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:11.423986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.423992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.423993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.423994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.423995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.423996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.423997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.423999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.424001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.424002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.424003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.424004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.424005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.424006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.424010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.424018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.424021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.424025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.424028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.424031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.424034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.424037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.424040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.424043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.424046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.424049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.424052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.424055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.424060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.424067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.424072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.424076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.424079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.424083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.424088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.424092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.424096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.424100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.424105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.424109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.424112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.424116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.424126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.424130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.424137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.424146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.424150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.424154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.424163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.424167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.424176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.424181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.424190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.424194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.424203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.424208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.424246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:11.424915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255415265239713:8900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:11.427618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255415265239713:8900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:11.427632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255415265239713:8900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:11.427635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255415265239713:8900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:11.427641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:11.427869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:11.428856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:11.428874Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:11.428877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:11.428880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:11.428887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1008 [2:7556255412888363095:7772]
2025-10-01T14:10:11.428903Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:11.428925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:11.428932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.428935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.428937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.428953Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:11.428958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:11.428968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:11.429027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.429034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.429036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.429040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:11.429043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:11.429114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:11.429122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.429133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.429148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.429168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:11.429192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239749:8900], now have 1 active actors on pipe
2025-10-01T14:10:11.429200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239664:2446], now have 1 active actors on pipe
2025-10-01T14:10:11.429208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255412888363090:7772]
2025-10-01T14:10:11.429214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255412888363090:7772]
2025-10-01T14:10:11.429216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255412888363090:7772]
2025-10-01T14:10:11.429200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1008
2025-10-01T14:10:11.429227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:11.429202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1008
2025-10-01T14:10:11.429232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:11.429234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:11.429236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:11.429246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:11.429259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:11.429266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:11.429287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.429296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.429334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255412888363090:7772]
2025-10-01T14:10:11.429345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:11.429348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:11.429364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:11.429376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.429383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.429385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:11.429395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.429408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:11.429452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.429574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.429584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.429599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.429659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1009 partition: 0 MaxSeqNo: 45 sessionId: src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0
2025-10-01T14:10:11.430118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58eeffa3-e811323e-349c24e3-dfb0d8e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:11.432611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0] Write session: try to update token
2025-10-01T14:10:11.432626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:11.444932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:11.444951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:11.444960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255412888363090:7772]
2025-10-01T14:10:11.444999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:11.445000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:11.445160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:11.445289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:11.445417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:11.445545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:11.445732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:11.445769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:11.447103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1009 sessionId: src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:11.449582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:11.449738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.449754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.449793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:11.449852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:11.460980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:11.460999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:11.461002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:11.461003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:11.461012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255412888363090:7772]
2025-10-01T14:10:11.461015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255412888363090:7772]
2025-10-01T14:10:11.461017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255412888363090:7772]
2025-10-01T14:10:11.461055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:11.461057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:11.461061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:11.461063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.461064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:11.461064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:11.461186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:11.511847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255415265239757:8859]
2025-10-01T14:10:11.512068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1008, pipe: [1:7556255415265239757:8859]
2025-10-01T14:10:11.593313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:11.600235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.600257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.600389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.600440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.600501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.600550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.600869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.600877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.600932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.600980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.601029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.601078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.601116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.601121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.601181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.601232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.601286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.601339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.601381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.601386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.601444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.601506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.601561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.601612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.601650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.601655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.601715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.601764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.601817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.601871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.601908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.601913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.601977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.602026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.602079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.602135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.602173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.602178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.602230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.602281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.602336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.602404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.602447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.602452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.602503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.602560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.602612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.602663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.602700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.602704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.602768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.602822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.602877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.602936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.602989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.602994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.603057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:11.603109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:11.603163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:11.603211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:11.603255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:11.603259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:11.603298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239757:8859], now have 1 active actors on pipe
2025-10-01T14:10:11.603519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255415265239757:8859]
2025-10-01T14:10:11.603545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:11.603548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:11.603551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:11.603572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1009 reason: error at write: Disconnected sessionId: src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0
2025-10-01T14:10:11.603758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1009 sessionId: src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0 is DEAD
2025-10-01T14:10:11.603908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:11.603919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0] Write session will restart in 0.007607s
2025-10-01T14:10:11.603945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0] Write session: Do CDS request
2025-10-01T14:10:11.603952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:11.604141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:11.611401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:11.612805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.612944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:11.612958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1010
2025-10-01T14:10:11.613067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.613090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:11.613098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:11.613100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:11.613154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:11.613315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:11.613322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:11.613329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:11.613364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:11.613392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255412888363183:7774]
2025-10-01T14:10:11.613400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1010 sessionId:  describe result for acl check
2025-10-01T14:10:11.613423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:11.613427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:11.613428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:11.613432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255415265239810:8904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:11.613765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:11.613783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255415265239810:8904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:11.613982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:11.614011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:11.614185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:11.614220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.614224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.614225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.614225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.614226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.614227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.614227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.614228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.614228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.614229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.614230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.614230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.614231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.614232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.614234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.614240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.614242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.614244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.614246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.614248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.614250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.614252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.614254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.614256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.614258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.614261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.614263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.614265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.614270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.614274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.614278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.614281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.614284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.614286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.614289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.614291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.614293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.614296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.614298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.614301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.614303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.614306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.614308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.614311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.614313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.614316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.614318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.614321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.614324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.614326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.614328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.614331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.614333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.614338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.614340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.614342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.614363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:11.615747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255415265239810:8904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:11.617753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:11.617870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255415265239810:8904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:11.617882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255415265239810:8904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:11.617885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255415265239810:8904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:11.617891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:11.618294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:11.618307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:11.618309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:11.618312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:11.618317Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1009 [2:7556255412888363183:7774]
2025-10-01T14:10:11.618326Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:11.618337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:11.618339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.618342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.618343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.618353Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:11.618356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:11.618360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:11.618413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.618419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.618421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.618423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:11.618425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:11.618470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:11.618475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.618482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.618488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.618496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:11.618512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239849:8904], now have 1 active actors on pipe
2025-10-01T14:10:11.618517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239759:2446], now have 1 active actors on pipe
2025-10-01T14:10:11.618522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255412888363178:7774]
2025-10-01T14:10:11.618523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255412888363178:7774]
2025-10-01T14:10:11.618524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255412888363178:7774]
2025-10-01T14:10:11.618535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:11.618546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:11.618547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:11.618548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:11.618549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:11.618554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:11.618556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:11.618555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1009
2025-10-01T14:10:11.618570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1009
2025-10-01T14:10:11.618573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255412888363178:7774]
2025-10-01T14:10:11.618578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:11.618588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:11.618598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.618601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.618622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:11.618630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.618632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.618633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:11.618638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.618644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:11.618655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.618752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.618757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.618765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.618820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1010 partition: 0 MaxSeqNo: 45 sessionId: src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0
2025-10-01T14:10:11.619114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff871a9e-a6dfdc4e-a2ef2cf7-95a136c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:11.621400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0] Write session: try to update token
2025-10-01T14:10:11.621414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:11.634266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1010 sessionId: src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:11.636645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:11.637832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.637856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.637875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:11.637877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:11.637879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:11.637880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:11.637887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255412888363178:7774]
2025-10-01T14:10:11.637890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255412888363178:7774]
2025-10-01T14:10:11.637892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255412888363178:7774]
2025-10-01T14:10:11.637924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:11.637930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:11.637933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:11.637934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:11.637939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.637941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:11.638061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:11.703839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255415265239857:8859]
2025-10-01T14:10:11.704085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1009, pipe: [1:7556255415265239857:8859]
2025-10-01T14:10:11.773081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:11.773480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:11.773549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239857:8859], now have 1 active actors on pipe
2025-10-01T14:10:11.773607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:11.773703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:11.773751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255415265239857:8859]
2025-10-01T14:10:11.780898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:11.782862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:11.783066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:11.783081Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:11.783094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:11.783149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:11.783203Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255412888363284:7777]
2025-10-01T14:10:11.783772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:11.784232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:11.784283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:11.784268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:11.784281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:11.784302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1010 reason: error at write: Disconnected sessionId: src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0
2025-10-01T14:10:11.784455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1010 sessionId: src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0 is DEAD
2025-10-01T14:10:11.784603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:11.784595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:11.784612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0] Write session will restart in 0.007306s
2025-10-01T14:10:11.784636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0] Write session: Do CDS request
2025-10-01T14:10:11.784643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:11.784637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.784641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.784642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.784643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.784644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.784644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.784645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.784646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.784646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.784647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.784648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.784648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.784649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.784650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.784653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.784659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.784661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.784664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.784666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.784668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.784670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.784672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.784674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.784676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.784678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.784682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.784684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.784685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.784690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.784695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.784700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.784703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.784705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.784708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.784710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.784714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.784716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.784719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.784721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.784734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.784738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.784741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.784744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.784746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.784748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.784751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.784753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.784756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.784758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.784765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.784767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.784769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.784772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.784774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.784776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.784779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.784800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:11.791134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:11.791907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:11.791921Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:11.791922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:11.791925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:11.791931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1010 [2:7556255412888363284:7777]
2025-10-01T14:10:11.791943Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:11.791959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:11.791964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.791967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.791969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.791982Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:11.791985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:11.791989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:11.792032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.792038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.792039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.792042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:11.792043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:11.792103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:11.792111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.792121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.792130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.792148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:11.792170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239872:2446], now have 1 active actors on pipe
2025-10-01T14:10:11.792179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255412888363279:7777]
2025-10-01T14:10:11.792183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255412888363279:7777]
2025-10-01T14:10:11.792185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255412888363279:7777]
2025-10-01T14:10:11.792194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:11.792206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:11.792208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:11.792210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:11.792211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:11.792225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:11.792228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:11.792212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1010
2025-10-01T14:10:11.792257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255412888363279:7777]
2025-10-01T14:10:11.792270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:11.792286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:11.792830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.792931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:11.792946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1011
2025-10-01T14:10:11.793036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.793058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:11.793065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:11.793067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:11.793396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1011 sessionId:  describe result for acl check
2025-10-01T14:10:11.793417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:11.793421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:11.793423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:11.793426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255415265239934:8910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:11.793832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255415265239934:8910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:11.795852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255415265239934:8910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:11.801195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255415265239934:8910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:11.801207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255415265239934:8910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:11.801209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255415265239934:8910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:11.801215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:11.801385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239968:8910], now have 1 active actors on pipe
2025-10-01T14:10:11.801435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1010
2025-10-01T14:10:11.801476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.801487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.801512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:11.801526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.801532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.801535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:11.801546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.801564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:11.801584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.801662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.801669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.802522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.802548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:11.802554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:11.802559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255412888363279:7777]
2025-10-01T14:10:11.802586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:11.802585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:11.802608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1011 partition: 0 MaxSeqNo: 45 sessionId: src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0
2025-10-01T14:10:11.802752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:11.802895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:11.802943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e39c086f-8ae6ad4-b8aa9b99-2a820e74_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:11.803036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:11.803175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:11.803352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:11.803382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:11.805110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0] Write session: try to update token
2025-10-01T14:10:11.805122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:11.818025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1011 sessionId: src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:11.820195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:11.821391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.821415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.821432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:11.821435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:11.821437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:11.821438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:11.821446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255412888363279:7777]
2025-10-01T14:10:11.821448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255412888363279:7777]
2025-10-01T14:10:11.821452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255412888363279:7777]
2025-10-01T14:10:11.821492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:11.821495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:11.821500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.821501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:11.821506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:11.821510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:11.821614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:11.873824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255415265239971:8859]
2025-10-01T14:10:11.874080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1010, pipe: [1:7556255415265239971:8859]
2025-10-01T14:10:11.956539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:11.956894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:11.956920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239971:8859], now have 1 active actors on pipe
2025-10-01T14:10:11.957002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:11.957043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255415265239971:8859]
2025-10-01T14:10:11.957061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:11.957254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:11.957263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:11.957335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1011 reason: error at write: Disconnected sessionId: src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0
2025-10-01T14:10:11.957536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1011 sessionId: src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0 is DEAD
2025-10-01T14:10:11.957596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:11.957605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0] Write session will restart in 0.008792s
2025-10-01T14:10:11.957622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0] Write session: Do CDS request
2025-10-01T14:10:11.957628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:11.963812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:11.965939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:11.966145Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:11.966154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:11.966165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:11.966331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:11.966386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255412888363377:7780]
2025-10-01T14:10:11.966897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:11.967116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:11.967155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:11.967448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:11.967495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.967501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.967502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.967503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.967504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.967505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.967506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.967507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.967508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.967509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.967510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.967511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.967511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.967513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.967517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.967526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.967529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.967532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.967535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.967538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.967541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.967544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.967548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.967551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.967555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.967558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.967561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.967564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.967572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.967582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:11.967591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.967599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:11.967604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.967612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:11.967619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.967624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:11.967628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.967632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:11.967640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.967645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:11.967653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.967661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:11.967668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.967672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:11.967679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.967687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:11.967691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.967695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.967698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.967702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.967709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.967713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.967717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.967725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:11.967729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.967736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:11.967769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:11.967846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.967945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:11.967958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1012
2025-10-01T14:10:11.968068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:11.968099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:11.968108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:11.968111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:11.968395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1012 sessionId:  describe result for acl check
2025-10-01T14:10:11.968428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:11.968432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:11.968434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:11.968437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255415265240032:8914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:11.968881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255415265240032:8914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:11.970649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255415265240032:8914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:11.971165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:11.971866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:11.971878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:11.971879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:11.971882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:11.971886Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1011 [2:7556255412888363377:7780]
2025-10-01T14:10:11.971895Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:11.971907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:11.971912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.971914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.971916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.971926Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:11.971933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:11.971936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:11.971972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.971977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.971978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.971980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:11.971982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:11.972027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:11.972033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:11.972041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:11.972046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:11.972056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:11.972068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255412888363372:7780]
2025-10-01T14:10:11.972069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255412888363372:7780]
2025-10-01T14:10:11.972070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255412888363372:7780]
2025-10-01T14:10:11.972077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:11.972085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:11.972089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:11.972093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:11.972093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:11.972095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:11.972096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:11.972103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265239976:2446], now have 1 active actors on pipe
2025-10-01T14:10:11.972124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255412888363372:7780]
2025-10-01T14:10:11.972134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:11.972140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:11.972157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1011
2025-10-01T14:10:11.972711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255415265240032:8914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:11.972724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255415265240032:8914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:11.972735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255415265240032:8914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:11.972743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:11.972913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255415265240065:8914], now have 1 active actors on pipe
2025-10-01T14:10:11.972950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1011
2025-10-01T14:10:11.972992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.973000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.973018Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:11.973028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:11.973033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:11.973035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:11.973042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:11.973050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:11.973062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.973203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.973217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.973240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:11.973312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1012 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0
2025-10-01T14:10:11.973601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6214a0b0-ab0bcea-f4865bf2-d04f7ae2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:11.975857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0] Write session: try to update token
2025-10-01T14:10:11.975870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:11.982276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:11.982297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:11.982306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255412888363372:7780]
2025-10-01T14:10:11.982347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:11.982349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:11.982523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:11.982648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:11.982766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:11.982894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:11.983071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:11.983112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:11.988165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1012 sessionId: src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:11.990318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:11.990489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:11.990509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:11.990537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:11.990608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:12.000050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:12.000068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:12.000069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:12.000071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:12.000079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255412888363372:7780]
2025-10-01T14:10:12.000082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255412888363372:7780]
2025-10-01T14:10:12.000085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255412888363372:7780]
2025-10-01T14:10:12.000130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:12.000130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:12.000137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:12.000138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.000139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:12.000141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:12.000260Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:12.057116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255419560207370:8859]
2025-10-01T14:10:12.057320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1011, pipe: [1:7556255419560207370:8859]
2025-10-01T14:10:12.135852Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:12.142509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.142534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.142678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.142729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.142786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.142836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.142877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.142885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.142943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.142997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.143052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.143105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.143150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.143155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.143216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.143267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.143320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.143377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.143422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.143427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.143487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.143543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.143598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.143652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.143698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.143703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.143763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.143815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.143868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.143920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.143959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.143964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.144018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.144071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.144126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.144180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.144219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.144224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.144281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.144333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.144393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.144453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.144498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.144503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.144557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.144605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.144657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.144711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.144764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.144769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.144825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.144877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.144931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.144983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.145020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.145025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.145079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.145128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.145181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.145232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.145272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.145277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.145319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207370:8859], now have 1 active actors on pipe
2025-10-01T14:10:12.145571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:12.145577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255419560207370:8859]
2025-10-01T14:10:12.145585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:12.145593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:12.145606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1012 reason: error at write: Disconnected sessionId: src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0
2025-10-01T14:10:12.145792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1012 sessionId: src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0 is DEAD
2025-10-01T14:10:12.145928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:12.145936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0] Write session will restart in 0.005160s
2025-10-01T14:10:12.145955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0] Write session: Do CDS request
2025-10-01T14:10:12.145960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:12.146040Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:12.151844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.151954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:12.151968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1013
2025-10-01T14:10:12.152110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.152134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:12.152141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:12.152144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:12.152445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:12.152479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1013 sessionId:  describe result for acl check
2025-10-01T14:10:12.152518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:12.152525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:12.152527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:12.152532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255419560207425:8920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:12.153057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255419560207425:8920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:12.154573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255419560207425:8920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:12.154571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:12.154709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:12.154717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:12.154725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:12.154755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:12.154782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255417183330764:7782]
2025-10-01T14:10:12.155164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:12.155363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:12.155387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:12.155591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:12.155636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.155640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.155641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.155642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.155642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.155643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.155643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.155644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.155645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.155645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.155646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.155647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.155647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.155648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.155651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.155656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.155659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.155661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.155663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.155665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.155668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.155670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.155672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.155674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.155676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.155678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.155680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.155682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.155687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.155691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.155695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.155698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.155700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.155703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.155705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.155708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.155710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.155713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.155715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.155717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.155720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.155722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.155724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.155727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.155729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.155732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.155734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.155738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.155742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.155744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.155746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.155749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.155751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.155753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.155756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.155758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.155777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:12.158891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255419560207425:8920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:12.158907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255419560207425:8920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:12.158909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255419560207425:8920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:12.158917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:12.159069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:12.159886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:12.159898Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:12.159899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:12.159901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:12.159905Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1012 [2:7556255417183330764:7782]
2025-10-01T14:10:12.159915Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:12.159928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:12.159931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.159935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.159937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.159952Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:12.159956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:12.159960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:12.159995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.160000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.160001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.160004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:12.160006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:12.160054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:12.160059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.160066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.160071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.160080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:12.160094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255417183330759:7782]
2025-10-01T14:10:12.160098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255417183330759:7782]
2025-10-01T14:10:12.160099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255417183330759:7782]
2025-10-01T14:10:12.160105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:12.160114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207465:8920], now have 1 active actors on pipe
2025-10-01T14:10:12.160115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:12.160117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207373:2446], now have 1 active actors on pipe
2025-10-01T14:10:12.160118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:12.160120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:12.160122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:12.160130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:12.160131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:12.160148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255417183330759:7782]
2025-10-01T14:10:12.160156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:12.160150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1012
2025-10-01T14:10:12.160164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1012
2025-10-01T14:10:12.160172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:12.160189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.160196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.160215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:12.160224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.160227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.160228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:12.160234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.160241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:12.160254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.160476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.160483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.160494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.160569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1013 partition: 0 MaxSeqNo: 45 sessionId: src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0
2025-10-01T14:10:12.160925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca06ed33-21c98bb2-29d3d88f-3e6ceeb3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:12.163158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0] Write session: try to update token
2025-10-01T14:10:12.163172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:12.170118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:12.170136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:12.170143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255417183330759:7782]
2025-10-01T14:10:12.170176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:12.170181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:12.170348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:12.170508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:12.170667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:12.170821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:12.171065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:12.171119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:12.177949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1013 sessionId: src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:12.180615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:12.180819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.180840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.180875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:12.180962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:12.187962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:12.187981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:12.187983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:12.187984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:12.187992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255417183330759:7782]
2025-10-01T14:10:12.187999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255417183330759:7782]
2025-10-01T14:10:12.188001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255417183330759:7782]
2025-10-01T14:10:12.188035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:12.188034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:12.188043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.188044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:12.188047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:12.188050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:12.188158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:12.245558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255419560207494:8859]
2025-10-01T14:10:12.245830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1012, pipe: [1:7556255419560207494:8859]
2025-10-01T14:10:12.321226Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:12.328209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.328232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.328357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.328407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.328475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.328524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.328562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.328570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.328624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.328672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.328722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.328788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.328832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.328837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.328894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.328947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.329006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.329063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.329102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.329107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.329171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.329226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.329278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.329331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.329368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.329373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.329435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.329491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.329548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.329601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.329640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.329645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.329700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.329750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.329815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.329875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.329913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.329918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.329979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.330028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.330082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.330133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.330170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.330175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.330231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.330282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.330336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.330405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.330450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.330456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.330521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.330574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.330627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.330681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.330722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.330727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.330791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:12.330841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:12.330896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:12.330950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:12.330993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:12.331000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:12.331041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207494:8859], now have 1 active actors on pipe
2025-10-01T14:10:12.331260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:12.331273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:12.331285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:12.331295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1013 reason: error at write: Disconnected sessionId: src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0
2025-10-01T14:10:12.331320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255419560207494:8859]
2025-10-01T14:10:12.331469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1013 sessionId: src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0 is DEAD
2025-10-01T14:10:12.331646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:12.331658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0] Write session will restart in 0.006238s
2025-10-01T14:10:12.331682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0] Write session: Do CDS request
2025-10-01T14:10:12.331687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:12.331912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:12.337947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:12.338796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.338936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:12.338950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1014
2025-10-01T14:10:12.339598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.339622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:12.339630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:12.339632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:12.339947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:12.339978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1014 sessionId:  describe result for acl check
2025-10-01T14:10:12.340016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:12.340018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:12.340020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:12.340024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255419560207558:8932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:12.340076Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:12.340083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:12.340091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:12.340121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:12.340173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255417183330863:7786]
2025-10-01T14:10:12.340444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255419560207558:8932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:12.340560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:12.340763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:12.340795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:12.341014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:12.341050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.341055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.341056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.341057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.341057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.341058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.341058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.341059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.341060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.341060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.341061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.341061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.341062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.341063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.341069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.341077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.341081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.341085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.341089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.341093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.341097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.341101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.341104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.341108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.341112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.341116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.341119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.341123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.341133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.341141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.341147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.341150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.341156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.341159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.341162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.341164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.341170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.341173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.341176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.341179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.341184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.341187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.341189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.341192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.341198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.341202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.341204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.341210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.341212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.341215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.341219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.341223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.341226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.341228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.341233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.341236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.341257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:12.341778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255419560207558:8932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:12.344619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:12.344634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255419560207558:8932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:12.344650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255419560207558:8932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:12.344653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255419560207558:8932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:12.344661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:12.345423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:12.345434Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:12.345435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:12.345438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:12.345443Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1013 [2:7556255417183330863:7786]
2025-10-01T14:10:12.345454Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:12.345470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:12.345471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.345474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.345475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.345485Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:12.345491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:12.345495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:12.345532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.345537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.345538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.345541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:12.345542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:12.345593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:12.345600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.345609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.345623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.345640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:12.345659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207597:8932], now have 1 active actors on pipe
2025-10-01T14:10:12.345664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207504:2446], now have 1 active actors on pipe
2025-10-01T14:10:12.345669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255417183330858:7786]
2025-10-01T14:10:12.345670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255417183330858:7786]
2025-10-01T14:10:12.345671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255417183330858:7786]
2025-10-01T14:10:12.345682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:12.345673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1013
2025-10-01T14:10:12.345676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1013
2025-10-01T14:10:12.345697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:12.345697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:12.345700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:12.345701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:12.345715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:12.345717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:12.345748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.345754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.345766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255417183330858:7786]
2025-10-01T14:10:12.345774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:12.345781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:12.345794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:12.345804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.345812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.345817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:12.345825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.345835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:12.345858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.345968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.345980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.346000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.346070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1014 partition: 0 MaxSeqNo: 45 sessionId: src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0
2025-10-01T14:10:12.346436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fcf4487-f37b7424-ed3be2d9-89f02bc3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:12.348715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0] Write session: try to update token
2025-10-01T14:10:12.348743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:12.362609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1014 sessionId: src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:12.364604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:12.364625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:12.364628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:12.364630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:12.364636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255417183330858:7786]
2025-10-01T14:10:12.364640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255417183330858:7786]
2025-10-01T14:10:12.364642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255417183330858:7786]
2025-10-01T14:10:12.364685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:12.364688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:12.364692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:12.364695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:12.364695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.364696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:12.364835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:12.364885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:12.431389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255419560207607:8859]
2025-10-01T14:10:12.431640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1013, pipe: [1:7556255419560207607:8859]
2025-10-01T14:10:12.501386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:12.501663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.501675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.501711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207607:8859], now have 1 active actors on pipe
2025-10-01T14:10:12.501868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:12.501905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:12.501912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255419560207607:8859]
2025-10-01T14:10:12.501920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:12.501935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:12.501989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1014 reason: error at write: Disconnected sessionId: src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0
2025-10-01T14:10:12.502205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1014 sessionId: src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0 is DEAD
2025-10-01T14:10:12.502335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:12.502345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0] Write session will restart in 0.009605s
2025-10-01T14:10:12.502363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0] Write session: Do CDS request
2025-10-01T14:10:12.502367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:12.509920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:12.512060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:12.512209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:12.512217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:12.512224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:12.512254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:12.512287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255417183330987:7799]
2025-10-01T14:10:12.512808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:12.512831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.512937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:12.512952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1015
2025-10-01T14:10:12.513026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:12.513056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:12.513052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.513080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:12.513088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:12.513091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:12.513249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:12.513286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.513291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.513292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.513293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.513293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.513294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.513294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.513295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.513296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.513296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.513297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.513297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.513298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.513299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.513302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.513308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.513310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.513312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.513314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.513316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.513318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.513320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.513322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.513325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.513327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.513330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.513334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.513337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.513343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.513350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.513356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.513361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.513365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.513370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.513374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.513384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.513392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.513398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.513405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.513414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.513419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.513428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.513436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.513445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.513452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.513433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1015 sessionId:  describe result for acl check
2025-10-01T14:10:12.513457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.513464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.513465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:12.513471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.513470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:12.513472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:12.513480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.513476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255419560207667:8936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:12.513488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.513496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.513502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.513510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.513519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.513527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.513535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.513571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:12.513948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255419560207667:8936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:12.515551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255419560207667:8936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:12.516989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:12.517509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:12.517520Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:12.517521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:12.517524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:12.517529Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1014 [2:7556255417183330987:7799]
2025-10-01T14:10:12.517539Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:12.517550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:12.517555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.517557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.517558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.517568Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:12.517580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:12.517585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:12.517637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.517644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.517645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.517649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:12.517651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:12.517790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1014
2025-10-01T14:10:12.517844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:12.517853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.517863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.517873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.517895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:12.517917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207609:2446], now have 1 active actors on pipe
2025-10-01T14:10:12.517930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255417183330982:7799]
2025-10-01T14:10:12.517936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255417183330982:7799]
2025-10-01T14:10:12.517938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255417183330982:7799]
2025-10-01T14:10:12.517951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:12.517958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255419560207667:8936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:12.517966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:12.517971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255419560207667:8936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:12.517974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255419560207667:8936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:12.517981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:12.517968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:12.517974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:12.517976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:12.517980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:12.517983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:12.518008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255417183330982:7799]
2025-10-01T14:10:12.518019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:12.518026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:12.518125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207704:8936], now have 1 active actors on pipe
2025-10-01T14:10:12.518172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1014
2025-10-01T14:10:12.518211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.518218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.518235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:12.518244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.518249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.518251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:12.518257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.518267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:12.518280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.518404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.518412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.518422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.518495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1015 partition: 0 MaxSeqNo: 45 sessionId: src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0
2025-10-01T14:10:12.518808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|626846c0-f7e1e545-308e4e0e-bdff338e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:12.521076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0] Write session: try to update token
2025-10-01T14:10:12.521092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:12.534934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1015 sessionId: src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:12.537218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:12.537265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:12.537286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:12.537289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:12.537292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:12.537301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255417183330982:7799]
2025-10-01T14:10:12.537308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255417183330982:7799]
2025-10-01T14:10:12.537311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255417183330982:7799]
2025-10-01T14:10:12.537361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:12.537371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.537376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:12.537378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:12.537382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:12.537386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:12.537506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:12.601907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255419560207711:8859]
2025-10-01T14:10:12.602110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1014, pipe: [1:7556255419560207711:8859]
2025-10-01T14:10:12.675878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:12.676409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.676422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.676456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207711:8859], now have 1 active actors on pipe
2025-10-01T14:10:12.676617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:12.676753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255419560207711:8859]
2025-10-01T14:10:12.676777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:12.676780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:12.676785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:12.676830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1015 reason: error at write: Disconnected sessionId: src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0
2025-10-01T14:10:12.677036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1015 sessionId: src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0 is DEAD
2025-10-01T14:10:12.677149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:12.677170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0] Write session will restart in 0.007023s
2025-10-01T14:10:12.677197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0] Write session: Do CDS request
2025-10-01T14:10:12.677203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:12.684009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:12.684893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.684953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:12.684967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1016
2025-10-01T14:10:12.685056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.685079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:12.685086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:12.685089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:12.685466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1016 sessionId:  describe result for acl check
2025-10-01T14:10:12.685504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:12.685510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:12.685512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:12.685517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255419560207770:8940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:12.686008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255419560207770:8940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:12.686101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:12.686262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:12.686271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:12.686283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:12.686331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:12.686363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255417183331093:7802]
2025-10-01T14:10:12.686865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:12.687125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:12.687166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:12.687434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:12.687481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.687486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.687487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.687488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.687488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.687489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.687490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.687491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.687492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.687493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.687494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.687495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.687496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.687497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.687502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.687510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.687514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.687517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.687497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255419560207770:8940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:12.687520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.687523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.687526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.687529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.687532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.687535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.687538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.687542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.687545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.687548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.687554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.687565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.687576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.687581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.687589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.687598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.687606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.687611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.687615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.687623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.687630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.687635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.687642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.687647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.687650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.687658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.687666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.687671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.687678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.687681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.687688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.687692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.687699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.687704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.687711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.687718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.687722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.687726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.687759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:12.690924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255419560207770:8940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:12.690952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255419560207770:8940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:12.690956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255419560207770:8940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:12.690964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:12.691107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:12.691638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:12.691651Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:12.691652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:12.691654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:12.691659Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1015 [2:7556255417183331093:7802]
2025-10-01T14:10:12.691669Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:12.691683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:12.691687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.691689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.691692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.691703Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:12.691709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:12.691713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:12.691751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.691755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.691756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.691758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:12.691760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:12.691817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:12.691823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.691829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.691838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.691846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:12.691860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207809:8940], now have 1 active actors on pipe
2025-10-01T14:10:12.691866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207713:2446], now have 1 active actors on pipe
2025-10-01T14:10:12.691871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255417183331088:7802]
2025-10-01T14:10:12.691872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255417183331088:7802]
2025-10-01T14:10:12.691873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255417183331088:7802]
2025-10-01T14:10:12.691882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:12.691895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:12.691896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:12.691898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:12.691900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:12.691905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:12.691907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:12.691922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255417183331088:7802]
2025-10-01T14:10:12.691927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:12.691911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1015
2025-10-01T14:10:12.691939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:12.691948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.691929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1015
2025-10-01T14:10:12.691951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.691974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:12.691981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.691984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.691988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:12.691993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.692001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:12.692016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.692116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.692121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.692131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.692181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1016 partition: 0 MaxSeqNo: 45 sessionId: src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0
2025-10-01T14:10:12.692506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ab13dc-dc29ac87-6e43c331-12afa8b9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:12.694724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0] Write session: try to update token
2025-10-01T14:10:12.694742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:12.707857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1016 sessionId: src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:12.710011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:12.710992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.711014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.711032Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:12.711035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:12.711038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:12.711040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:12.711048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255417183331088:7802]
2025-10-01T14:10:12.711052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255417183331088:7802]
2025-10-01T14:10:12.711055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255417183331088:7802]
2025-10-01T14:10:12.711084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:12.711094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:12.711097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:12.711101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:12.711111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.711114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:12.711230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:12.777001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255419560207830:8859]
2025-10-01T14:10:12.777237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1015, pipe: [1:7556255419560207830:8859]
2025-10-01T14:10:12.845271Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:12.845539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:12.845596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207830:8859], now have 1 active actors on pipe
2025-10-01T14:10:12.845697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:12.845767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:12.845792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:12.845798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:12.845831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255419560207830:8859]
2025-10-01T14:10:12.845854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1016 reason: error at write: Disconnected sessionId: src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0
2025-10-01T14:10:12.846017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1016 sessionId: src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0 is DEAD
2025-10-01T14:10:12.846107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:12.846116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0] Write session will restart in 0.008503s
2025-10-01T14:10:12.846136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0] Write session: Do CDS request
2025-10-01T14:10:12.846143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:12.853818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:12.855870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.855911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:12.855924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1017
2025-10-01T14:10:12.856038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:12.856064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:12.856067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:12.856070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:12.856344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1017 sessionId:  describe result for acl check
2025-10-01T14:10:12.856376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:12.856377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:12.856378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:12.856384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255419560207890:8946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:12.856765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255419560207890:8946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:12.857689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:12.857893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:12.857908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:12.857918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:12.857969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:12.858025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255417183331190:7804]
2025-10-01T14:10:12.858503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:12.858527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255419560207890:8946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:12.858728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:12.858770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:12.859035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:12.859103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.859110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.859111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.859111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.859112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.859113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.859114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.859115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.859115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.859116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.859117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.859118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.859119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.859119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.859124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.859133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.859137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.859141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.859144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.859147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.859150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.859154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.859157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.859160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.859163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.859166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.859170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.859175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.859180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.859187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:12.859193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.859197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:12.859206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.859210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:12.859217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.859221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:12.859229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.859238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:12.859241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.859249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:12.859255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.859259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:12.859262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.859271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:12.859278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.859282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:12.859290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.859293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.859301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.859310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.859316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.859320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.859327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.859330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:12.859337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.859341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:12.859376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:12.862469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255419560207890:8946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:12.862485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255419560207890:8946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:12.862488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255419560207890:8946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:12.862495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:12.862708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:12.865250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:12.865263Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:12.865265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:12.865267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:12.865272Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1016 [2:7556255417183331190:7804]
2025-10-01T14:10:12.865283Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:12.865293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:12.865296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.865298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.865300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.865310Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:12.865319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:12.865324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:12.865395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.865401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.865403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.865406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:12.865408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:12.865552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1016
2025-10-01T14:10:12.865557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1016
2025-10-01T14:10:12.865743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:12.865753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.865764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:12.865777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:12.865797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:12.865815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207832:2446], now have 1 active actors on pipe
2025-10-01T14:10:12.865818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207928:8946], now have 1 active actors on pipe
2025-10-01T14:10:12.865833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.865838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.865855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255417183331183:7804]
2025-10-01T14:10:12.865858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255417183331183:7804]
2025-10-01T14:10:12.865860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255417183331183:7804]
2025-10-01T14:10:12.865872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:12.865882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:12.865885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:12.865890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:12.865891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:12.865897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:12.865900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:12.865914Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|266b1164-792e14-6d00f45-7c6cc79b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:12.865925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:12.865931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:12.865933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:12.865941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:12.865952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:12.865979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255417183331183:7804]
2025-10-01T14:10:12.865988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:12.865995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:12.866002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.866155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:12.866162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:12.866179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:12.866229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1017 partition: 0 MaxSeqNo: 45 sessionId: src_id|266b1164-792e14-6d00f45-7c6cc79b_0
2025-10-01T14:10:12.866557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|983a0c06-b2b15575-2f83aaad-bd90e4cf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|266b1164-792e14-6d00f45-7c6cc79b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:12.868720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|266b1164-792e14-6d00f45-7c6cc79b_0] Write session: try to update token
2025-10-01T14:10:12.868749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|266b1164-792e14-6d00f45-7c6cc79b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:12.884487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:12.884506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:12.884508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:12.884509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:12.884519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255417183331183:7804]
2025-10-01T14:10:12.884523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255417183331183:7804]
2025-10-01T14:10:12.884527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255417183331183:7804]
2025-10-01T14:10:12.884561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:12.884571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:12.884575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:12.884576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:12.884581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:12.884588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:12.884934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:12.886752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1017 sessionId: src_id|266b1164-792e14-6d00f45-7c6cc79b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:12.889088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:12.945988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255419560207936:8859]
2025-10-01T14:10:12.946230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1016, pipe: [1:7556255419560207936:8859]
2025-10-01T14:10:13.018107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:13.018335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.018347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.018391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255419560207936:8859], now have 1 active actors on pipe
2025-10-01T14:10:13.018624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:13.018648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:13.018653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255419560207936:8859]
2025-10-01T14:10:13.018674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:13.018676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:13.018725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1017 reason: error at write: Disconnected sessionId: src_id|266b1164-792e14-6d00f45-7c6cc79b_0
2025-10-01T14:10:13.018936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1017 sessionId: src_id|266b1164-792e14-6d00f45-7c6cc79b_0 is DEAD
2025-10-01T14:10:13.019088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266b1164-792e14-6d00f45-7c6cc79b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:13.019097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266b1164-792e14-6d00f45-7c6cc79b_0] Write session will restart in 0.005865s
2025-10-01T14:10:13.019118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266b1164-792e14-6d00f45-7c6cc79b_0] Write session: Do CDS request
2025-10-01T14:10:13.019123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266b1164-792e14-6d00f45-7c6cc79b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:13.025779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:13.025824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|266b1164-792e14-6d00f45-7c6cc79b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.025940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:13.025953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1018
2025-10-01T14:10:13.026079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.026102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:13.026109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:13.026111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:13.026464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1018 sessionId:  describe result for acl check
2025-10-01T14:10:13.026497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:13.026503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:13.026504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:13.026509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255423855175293:8950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:13.026998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255423855175293:8950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:13.028067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:13.028213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:13.028221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:13.028229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:13.028260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:13.028290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255421478298583:7807]
2025-10-01T14:10:13.028616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255423855175293:8950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:13.028682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:13.028926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:13.028970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:13.029236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:13.029304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.029311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.029312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.029313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.029314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.029315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.029316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.029316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.029317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.029318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.029319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.029320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.029321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.029322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.029326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.029334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.029337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.029340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.029345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.029348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.029351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.029354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.029357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.029361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.029364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.029367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.029369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.029372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.029377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.029385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.029390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.029394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.029398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.029403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.029406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.029410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.029414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.029418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.029421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.029425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.029429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.029433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.029436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.029439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.029449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.029453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.029456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.029461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.029464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.029468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.029475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.029479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.029482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.029486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.029494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.029497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.029529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:13.032823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255423855175293:8950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:13.032838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255423855175293:8950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:13.032841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255423855175293:8950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:13.032849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:13.032945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:13.033721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:13.033735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:13.033736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:13.033739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:13.033745Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1017 [2:7556255421478298583:7807]
2025-10-01T14:10:13.033756Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:13.033766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:13.033768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.033770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.033771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.033784Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:13.033787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:13.033791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:13.033843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.033849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.033850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.033852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:13.033854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:13.033906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:13.033911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.033919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.033924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.033933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:13.033951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175332:8950], now have 1 active actors on pipe
2025-10-01T14:10:13.033956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175234:2446], now have 1 active actors on pipe
2025-10-01T14:10:13.033961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255421478298578:7807]
2025-10-01T14:10:13.033962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255421478298578:7807]
2025-10-01T14:10:13.033963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255421478298578:7807]
2025-10-01T14:10:13.033973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:13.033982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:13.033988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:13.033990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:13.033992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:13.033993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:13.033995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:13.034013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255421478298578:7807]
2025-10-01T14:10:13.034017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:13.034018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:13.034011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1017
2025-10-01T14:10:13.034026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1017
2025-10-01T14:10:13.034040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.034051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.034072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be5f742e-857e61db-2bb7ab94-a291620a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:13.034076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.034079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.034081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:13.034086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.034092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:13.034105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.034228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.034237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.034249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.034320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1018 partition: 0 MaxSeqNo: 45 sessionId: src_id|be5f742e-857e61db-2bb7ab94-a291620a_0
2025-10-01T14:10:13.034679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|266b1164-792e14-6d00f45-7c6cc79b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be5f742e-857e61db-2bb7ab94-a291620a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:13.036967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5f742e-857e61db-2bb7ab94-a291620a_0] Write session: try to update token
2025-10-01T14:10:13.036982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5f742e-857e61db-2bb7ab94-a291620a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:13.053785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:13.053807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:13.053808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:13.053810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:13.053819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255421478298578:7807]
2025-10-01T14:10:13.053823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255421478298578:7807]
2025-10-01T14:10:13.053826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255421478298578:7807]
2025-10-01T14:10:13.053863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:13.053862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:13.053867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:13.053868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.053870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:13.053870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:13.054171Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:13.056631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1018 sessionId: src_id|be5f742e-857e61db-2bb7ab94-a291620a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:13.059496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:13.118989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255423855175340:8859]
2025-10-01T14:10:13.119224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1017, pipe: [1:7556255423855175340:8859]
2025-10-01T14:10:13.191018Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:13.191223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.191235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.191265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175340:8859], now have 1 active actors on pipe
2025-10-01T14:10:13.191425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:13.191454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:13.191479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:13.191483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:13.191500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255423855175340:8859]
2025-10-01T14:10:13.191537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1018 reason: error at write: Disconnected sessionId: src_id|be5f742e-857e61db-2bb7ab94-a291620a_0
2025-10-01T14:10:13.191737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1018 sessionId: src_id|be5f742e-857e61db-2bb7ab94-a291620a_0 is DEAD
2025-10-01T14:10:13.191876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5f742e-857e61db-2bb7ab94-a291620a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:13.191884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5f742e-857e61db-2bb7ab94-a291620a_0] Write session will restart in 0.008576s
2025-10-01T14:10:13.191905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5f742e-857e61db-2bb7ab94-a291620a_0] Write session: Do CDS request
2025-10-01T14:10:13.191910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5f742e-857e61db-2bb7ab94-a291620a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:13.198796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:13.200626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:13.200774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:13.200781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:13.200788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:13.200823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:13.200875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255421478298680:7809]
2025-10-01T14:10:13.201227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:13.201410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:13.201441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:13.201622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:13.201654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.201658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.201659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.201659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.201660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.201660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.201661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.201662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.201662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.201663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.201663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.201664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.201664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.201665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.201667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.201673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.201675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.201677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.201679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.201681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.201683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.201685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.201687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.201689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.201691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.201693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.201695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.201697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.201704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.201707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.201711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.201714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.201717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.201719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.201722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.201725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.201728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.201730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.201732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.201735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.201737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.201740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.201742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.201744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.201746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.201749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.201751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.201753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.201755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.201758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.201760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.201763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.201766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.201768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.201770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.201772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.201790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:13.201898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be5f742e-857e61db-2bb7ab94-a291620a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.201958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:13.201974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1019
2025-10-01T14:10:13.202077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.202097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:13.202104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:13.202107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:13.202453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1019 sessionId:  describe result for acl check
2025-10-01T14:10:13.202485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:13.202491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:13.202494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:13.202498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255423855175405:8954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:13.202981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255423855175405:8954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:13.204441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255423855175405:8954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:13.204949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:13.205485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:13.205501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:13.205503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:13.205509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:13.205515Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1018 [2:7556255421478298680:7809]
2025-10-01T14:10:13.205530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:13.205548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:13.205555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.205558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.205559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.205573Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:13.205582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:13.205588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:13.205637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.205642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.205643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.205645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:13.205647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:13.205701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:13.205707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.205718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.205731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.205750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:13.205768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175341:2446], now have 1 active actors on pipe
2025-10-01T14:10:13.205776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255421478298675:7809]
2025-10-01T14:10:13.205781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255421478298675:7809]
2025-10-01T14:10:13.205782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255421478298675:7809]
2025-10-01T14:10:13.205789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:13.205776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1018
2025-10-01T14:10:13.205801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:13.205802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:13.205804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:13.205805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:13.205822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:13.205824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:13.205849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255421478298675:7809]
2025-10-01T14:10:13.205859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:13.205865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:13.207974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255423855175405:8954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:13.207985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255423855175405:8954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:13.207987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255423855175405:8954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:13.207992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:13.208199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1018
2025-10-01T14:10:13.208179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175444:8954], now have 1 active actors on pipe
2025-10-01T14:10:13.208255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.208266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.208286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:13.208297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.208303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.208304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:13.208313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.208324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:13.208339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.208438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.208445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.208455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.208502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1019 partition: 0 MaxSeqNo: 45 sessionId: src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0
2025-10-01T14:10:13.208821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be5f742e-857e61db-2bb7ab94-a291620a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:13.210990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0] Write session: try to update token
2025-10-01T14:10:13.211004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:13.224890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:13.224912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:13.224914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:13.224916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:13.224925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255421478298675:7809]
2025-10-01T14:10:13.224930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255421478298675:7809]
2025-10-01T14:10:13.224933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255421478298675:7809]
2025-10-01T14:10:13.224976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:13.224982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:13.224986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:13.224989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:13.224996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.224998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:13.225134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:13.227827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1019 sessionId: src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:13.230630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:13.291516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255423855175470:8859]
2025-10-01T14:10:13.291715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1018, pipe: [1:7556255423855175470:8859]
2025-10-01T14:10:13.358579Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:13.358805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.358816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.358849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175470:8859], now have 1 active actors on pipe
2025-10-01T14:10:13.358988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:13.359039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:13.359066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255423855175470:8859]
2025-10-01T14:10:13.359084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:13.359143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1019 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0
2025-10-01T14:10:13.359320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1019 sessionId: src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0 is DEAD
2025-10-01T14:10:13.359465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:13.359473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0] Write session will restart in 0.008986s
2025-10-01T14:10:13.359495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0] Write session: Do CDS request
2025-10-01T14:10:13.359499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:13.366291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:13.368267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:13.368436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:13.368445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:13.368456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:13.368497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:13.368534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255421478298785:7813]
2025-10-01T14:10:13.368910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:13.369128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:13.369152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:13.369337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:13.369372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.369376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.369377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.369377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.369378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.369379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.369379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.369380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.369381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.369381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.369382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.369382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.369383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.369384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.369386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.369392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.369394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.369397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.369399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.369401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.369403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.369405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.369407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.369410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.369412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.369414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.369416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.369418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.369424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.369428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.369432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.369435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.369437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.369440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.369442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.369445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.369448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.369450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.369452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.369455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.369458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.369460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.369462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.369465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.369467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.369470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.369472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.369474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.369477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.369480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.369482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.369485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.369487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.369489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.369491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.369494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.369513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:13.369861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.369910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:13.369921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1020
2025-10-01T14:10:13.370059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.370080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:13.370084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:13.370087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:13.370382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1020 sessionId:  describe result for acl check
2025-10-01T14:10:13.370411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:13.370417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:13.370418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:13.370422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255423855175544:8966] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:13.370990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255423855175544:8966] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:13.372381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255423855175544:8966] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:13.372883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:13.373431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:13.373443Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:13.373445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:13.373449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:13.373454Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1019 [2:7556255421478298785:7813]
2025-10-01T14:10:13.373464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:13.373475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:13.373477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.373479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.373480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.373491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:13.373494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:13.373498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:13.373535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.373541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.373542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.373544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:13.373546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:13.373605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:13.373612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.373620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.373625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.373633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:13.373645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175479:2446], now have 1 active actors on pipe
2025-10-01T14:10:13.373650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255421478298780:7813]
2025-10-01T14:10:13.373651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255421478298780:7813]
2025-10-01T14:10:13.373653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255421478298780:7813]
2025-10-01T14:10:13.373658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:13.373667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:13.373667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:13.373670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:13.373672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:13.373674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:13.373676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:13.373695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255421478298780:7813]
2025-10-01T14:10:13.373704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:13.373706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:13.373692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1019
2025-10-01T14:10:13.373954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255423855175544:8966] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:13.373964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255423855175544:8966] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:13.373968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255423855175544:8966] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:13.373973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:13.374145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175581:8966], now have 1 active actors on pipe
2025-10-01T14:10:13.374162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1019
2025-10-01T14:10:13.374205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.374213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.374235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:13.374246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.374249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.374251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:13.374259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.374268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:13.374277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.374408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.374413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.374422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.374473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1020 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0
2025-10-01T14:10:13.374726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e3724e-edd6983f-a8473ccb-c92e6562_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:13.376977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0] Write session: try to update token
2025-10-01T14:10:13.376990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:13.388644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:13.388664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:13.388671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255421478298780:7813]
2025-10-01T14:10:13.388693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:13.388702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:13.388873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:13.389000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:13.389124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:13.389244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:13.389414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:13.389445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:13.390323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1020 sessionId: src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:13.392617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:13.392772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.392787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.392810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:13.392866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:13.401505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:13.401522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:13.401524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:13.401525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:13.401533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255421478298780:7813]
2025-10-01T14:10:13.401536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255421478298780:7813]
2025-10-01T14:10:13.401540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255421478298780:7813]
2025-10-01T14:10:13.401571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:13.401577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:13.401581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.401583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:13.401584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:13.401588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:13.401689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:13.458958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255423855175587:8859]
2025-10-01T14:10:13.459162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1019, pipe: [1:7556255423855175587:8859]
2025-10-01T14:10:13.537093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:13.543789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.543815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.543951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.544005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.544058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.544108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.544153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.544163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.544250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.544303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.544405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.544458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.544499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.544505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.544565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.544619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.544699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.544770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.544810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.544817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.544876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.545010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.545067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.545150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.545255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.545261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.545316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.545366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.545420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.545503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.545556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.545562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.545645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.545722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.545804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.545859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.545911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.545916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.545975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.546026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.546210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.546267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.546318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.546323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.546391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.546442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.546496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.546549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.546594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.546599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.546658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.546710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.546775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.546829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.546869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.546874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.546928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:13.547001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:13.547263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:13.547455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:13.547504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:13.547509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:13.547554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175587:8859], now have 1 active actors on pipe
2025-10-01T14:10:13.547795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255423855175587:8859]
2025-10-01T14:10:13.547823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:13.547824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:13.547827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:13.547856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1020 reason: error at write: Disconnected sessionId: src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0
2025-10-01T14:10:13.548077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1020 sessionId: src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0 is DEAD
2025-10-01T14:10:13.548218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:13.548229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0] Write session will restart in 0.006948s
2025-10-01T14:10:13.548255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0] Write session: Do CDS request
2025-10-01T14:10:13.548262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:13.548415Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:13.555365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:13.556912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.556960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:13.556974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1021
2025-10-01T14:10:13.557129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.557153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:13.557161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:13.557165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:13.557468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:13.557499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1021 sessionId:  describe result for acl check
2025-10-01T14:10:13.557532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:13.557538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:13.557540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:13.557544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255423855175650:8970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:13.557641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:13.557650Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:13.557661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:13.557711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:13.557749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255421478298915:7826]
2025-10-01T14:10:13.558026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255423855175650:8970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:13.558275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:13.558557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:13.558602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:13.558899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:13.558963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.558969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.558970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.558971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.558972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.558973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.558974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.558975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.558976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.558977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.558978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.558979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.558981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.558982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.558987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.558997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.559001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.559004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.559007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.559010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.559013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.559016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.559021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.559025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.559028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.559031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.559035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.559039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.559045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.559053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.559064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.559074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.559082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.559089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.559094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.559099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.559103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.559110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.559113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.559122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.559129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.559137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.559145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.559150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.559153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.559162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.559165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.559172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.559176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.559180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.559188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.559191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.559195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.559201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.559204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.559208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.559244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:13.560258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255423855175650:8970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:13.562473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255423855175650:8970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:13.562485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255423855175650:8970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:13.562488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255423855175650:8970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:13.562494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:13.562645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:13.563252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:13.563266Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:13.563268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:13.563270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:13.563275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1020 [2:7556255421478298915:7826]
2025-10-01T14:10:13.563285Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:13.563299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:13.563304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.563307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.563308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.563321Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:13.563327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:13.563331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:13.563371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.563376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.563377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.563379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:13.563381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:13.563430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:13.563434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.563441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.563446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.563455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:13.563466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255421478298910:7826]
2025-10-01T14:10:13.563470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255421478298910:7826]
2025-10-01T14:10:13.563472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255421478298910:7826]
2025-10-01T14:10:13.563478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:13.563485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:13.563488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175589:2446], now have 1 active actors on pipe
2025-10-01T14:10:13.563490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175688:8970], now have 1 active actors on pipe
2025-10-01T14:10:13.563493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:13.563495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:13.563496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:13.563507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:13.563509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:13.563531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255421478298910:7826]
2025-10-01T14:10:13.563542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:13.563554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:13.563556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1020
2025-10-01T14:10:13.563556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1020
2025-10-01T14:10:13.563686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.563694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.563711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2eda3526-cde58fac-3b002044-90d85fc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:13.563719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.563723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.563725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:13.563732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.563739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:13.563754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.563868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.563874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.563887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.563958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1021 partition: 0 MaxSeqNo: 45 sessionId: src_id|2eda3526-cde58fac-3b002044-90d85fc3_0
2025-10-01T14:10:13.564283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b45c360-a4233658-4d5bb62f-1667e13a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2eda3526-cde58fac-3b002044-90d85fc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:13.566616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eda3526-cde58fac-3b002044-90d85fc3_0] Write session: try to update token
2025-10-01T14:10:13.566631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eda3526-cde58fac-3b002044-90d85fc3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:13.579708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1021 sessionId: src_id|2eda3526-cde58fac-3b002044-90d85fc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:13.581902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:13.582819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.582846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.582865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:13.582868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:13.582871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:13.582873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:13.582883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255421478298910:7826]
2025-10-01T14:10:13.582890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255421478298910:7826]
2025-10-01T14:10:13.582895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255421478298910:7826]
2025-10-01T14:10:13.582925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:13.582937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:13.582939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:13.582940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:13.582945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.582947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:13.583060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:13.647910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255423855175697:8859]
2025-10-01T14:10:13.648161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1020, pipe: [1:7556255423855175697:8859]
2025-10-01T14:10:13.717715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:13.717928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:13.717973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175697:8859], now have 1 active actors on pipe
2025-10-01T14:10:13.718050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:13.718090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:13.718126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255423855175697:8859]
2025-10-01T14:10:13.718140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:13.718143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:13.718209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1021 reason: error at write: Disconnected sessionId: src_id|2eda3526-cde58fac-3b002044-90d85fc3_0
2025-10-01T14:10:13.718398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1021 sessionId: src_id|2eda3526-cde58fac-3b002044-90d85fc3_0 is DEAD
2025-10-01T14:10:13.718555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eda3526-cde58fac-3b002044-90d85fc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:13.718566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eda3526-cde58fac-3b002044-90d85fc3_0] Write session will restart in 0.009146s
2025-10-01T14:10:13.718592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eda3526-cde58fac-3b002044-90d85fc3_0] Write session: Do CDS request
2025-10-01T14:10:13.718599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eda3526-cde58fac-3b002044-90d85fc3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:13.725867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:13.727816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:13.727959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:13.727966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:13.727974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:13.728003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:13.728033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255421478299027:7829]
2025-10-01T14:10:13.728407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:13.728653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:13.728682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:13.728836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eda3526-cde58fac-3b002044-90d85fc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.728886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:13.728887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:13.728903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1022
2025-10-01T14:10:13.728922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.728927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.728927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.728928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.728929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.728930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.728930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.728931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.728931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.728932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.728932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.728933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.728933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.728934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.728937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.728942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.728944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.728946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.728948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.728950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.728952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.728954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.728956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.728959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.728960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.728962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.728964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.728966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.728972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.728976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.728979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.728982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.728985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.728988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.728990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.728993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.728995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.729004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.728998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.729001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.729004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.729006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.729009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.729011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.729014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.729017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.729019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.729022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.729024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.729027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.729030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.729032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.729030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:13.729035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.729037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.729040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.729042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.729039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:13.729046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:13.729045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.729068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:13.729344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1022 sessionId:  describe result for acl check
2025-10-01T14:10:13.729379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:13.729385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:13.729386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:13.729393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255423855175767:8975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:13.729745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255423855175767:8975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:13.731505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255423855175767:8975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:13.732344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:13.732887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:13.732897Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:13.732899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:13.732901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:13.732907Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1021 [2:7556255421478299027:7829]
2025-10-01T14:10:13.732916Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:13.732926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:13.732928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.732930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.732931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.732941Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:13.732949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:13.732953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:13.732987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.732991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.732992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.732994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:13.732996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:13.733054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:13.733061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.733070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.733083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.733100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:13.733118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175700:2446], now have 1 active actors on pipe
2025-10-01T14:10:13.733127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255421478299022:7829]
2025-10-01T14:10:13.733128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255421478299022:7829]
2025-10-01T14:10:13.733129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255421478299022:7829]
2025-10-01T14:10:13.733139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:13.733144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1021
2025-10-01T14:10:13.733152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:13.733156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:13.733159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:13.733161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:13.733168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:13.733171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:13.733189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255421478299022:7829]
2025-10-01T14:10:13.733195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:13.733197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:13.733444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255423855175767:8975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:13.733460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255423855175767:8975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:13.733463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255423855175767:8975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:13.733470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:13.733618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175804:8975], now have 1 active actors on pipe
2025-10-01T14:10:13.733649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1021
2025-10-01T14:10:13.733689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.733697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.733718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:13.733728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.733735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.733737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:13.733744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.733755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:13.733768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.733875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.733881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.733892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.733942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1022 partition: 0 MaxSeqNo: 45 sessionId: src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0
2025-10-01T14:10:13.734237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eda3526-cde58fac-3b002044-90d85fc3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:13.736503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0] Write session: try to update token
2025-10-01T14:10:13.736516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:13.749211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1022 sessionId: src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:13.751510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:13.752381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.752404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.752423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:13.752426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:13.752427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:13.752428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:13.752436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255421478299022:7829]
2025-10-01T14:10:13.752440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255421478299022:7829]
2025-10-01T14:10:13.752442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255421478299022:7829]
2025-10-01T14:10:13.752477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:13.752488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:13.752491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:13.752498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:13.752504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.752511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:13.752627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:13.818426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255423855175822:8859]
2025-10-01T14:10:13.818736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1021, pipe: [1:7556255423855175822:8859]
2025-10-01T14:10:13.885201Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:13.885685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:13.885728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175822:8859], now have 1 active actors on pipe
2025-10-01T14:10:13.885799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:13.885853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255423855175822:8859]
2025-10-01T14:10:13.885876Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:13.885886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:13.885893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:13.885957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1022 reason: error at write: Disconnected sessionId: src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0
2025-10-01T14:10:13.886119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1022 sessionId: src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0 is DEAD
2025-10-01T14:10:13.886228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:13.886237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0] Write session will restart in 0.006131s
2025-10-01T14:10:13.886257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0] Write session: Do CDS request
2025-10-01T14:10:13.886264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:13.893914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.893942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:13.893955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1023
2025-10-01T14:10:13.894132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:13.894163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:13.894169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:13.894178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:13.894578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1023 sessionId:  describe result for acl check
2025-10-01T14:10:13.894620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:13.894628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:13.894631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:13.894638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255423855175885:8980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:13.894758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:13.895141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255423855175885:8980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:13.896769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:13.896909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:13.896917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:13.896925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:13.896928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255423855175885:8980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:13.896955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:13.896981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255421478299130:7832]
2025-10-01T14:10:13.897372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:13.897594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:13.897630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:13.897908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:13.897969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.897972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.897973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.897973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.897974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.897975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.897975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.897976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.897976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.897977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.897978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.897978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.897979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.897980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.897983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.897989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.897991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.897993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.897995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.897997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.897999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.898001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.898003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.898005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.898007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.898009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.898010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.898012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.898017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.898022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:13.898027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.898030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:13.898032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.898035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:13.898038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.898041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:13.898043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.898046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:13.898048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.898051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:13.898054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.898057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:13.898059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.898062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:13.898064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.898067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:13.898069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.898072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.898074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.898077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.898079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.898082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.898084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.898087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:13.898089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.898092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:13.898115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:13.901692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255423855175885:8980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:13.901709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255423855175885:8980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:13.901713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255423855175885:8980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:13.901722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:13.901752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:13.902308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:13.902322Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:13.902324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:13.902327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:13.902331Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1022 [2:7556255421478299130:7832]
2025-10-01T14:10:13.902617Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:13.902635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:13.902637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.902639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.902641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.902652Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:13.902655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:13.902659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:13.902703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.902709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.902710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.902712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:13.902713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:13.902760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:13.902766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.902773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:13.902779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:13.902789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:13.902804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255421478299125:7832]
2025-10-01T14:10:13.902809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255421478299125:7832]
2025-10-01T14:10:13.902810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255421478299125:7832]
2025-10-01T14:10:13.902815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:13.902824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:13.902828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175925:8980], now have 1 active actors on pipe
2025-10-01T14:10:13.902834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:13.902835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:13.902838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:13.902842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:13.902843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:13.902846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175823:2446], now have 1 active actors on pipe
2025-10-01T14:10:13.902868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255421478299125:7832]
2025-10-01T14:10:13.902876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:13.902884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:13.902897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1022
2025-10-01T14:10:13.902901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1022
2025-10-01T14:10:13.902966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.902975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.903001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:13.903012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:13.903016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:13.903018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:13.903027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:13.903039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:13.903054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.903328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.903343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.903364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:13.903457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1023 partition: 0 MaxSeqNo: 45 sessionId: src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0
2025-10-01T14:10:13.903823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b069a8be-115fa32a-928d5b2-2b4a737f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:13.906214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0] Write session: try to update token
2025-10-01T14:10:13.906233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:13.919113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1023 sessionId: src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:13.921354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:13.921472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:13.921494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:13.923206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:13.923222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:13.923224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:13.923225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:13.923232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255421478299125:7832]
2025-10-01T14:10:13.923236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255421478299125:7832]
2025-10-01T14:10:13.923239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255421478299125:7832]
2025-10-01T14:10:13.923273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:13.923283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:13.923283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:13.923287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:13.923300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:13.923311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:13.923313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:13.923390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:13.923438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:13.985800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255423855175933:8859]
2025-10-01T14:10:13.986023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1022, pipe: [1:7556255423855175933:8859]
2025-10-01T14:10:14.055534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:14.061711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.061735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.061864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.061917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.061968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.062019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.062057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.062064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.062117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.062165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.062214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.062266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.062489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.062496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.062548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.062597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.062663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.062709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.062746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.062750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.062828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.062878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.062934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.062983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.063019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.063024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.063072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.063146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.063220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.063267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.063303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.063308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.063358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.063433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.063483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.063535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.063647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.063653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.063702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.063750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.063800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.063848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.063891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.063897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.063947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.064025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.064075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.064125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.064164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.064169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.064223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.064274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.064326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.064397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.064439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.064444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.064516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.064587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.064681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.064744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.064780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.064787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.064826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255423855175933:8859], now have 1 active actors on pipe
2025-10-01T14:10:14.065043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255423855175933:8859]
2025-10-01T14:10:14.065048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:14.065052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:14.065075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:14.065077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1023 reason: error at write: Disconnected sessionId: src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0
2025-10-01T14:10:14.065279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1023 sessionId: src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0 is DEAD
2025-10-01T14:10:14.065381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:14.065387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0] Write session will restart in 0.008135s
2025-10-01T14:10:14.065404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0] Write session: Do CDS request
2025-10-01T14:10:14.065408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:14.065594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:14.074785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.074811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:14.074895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:14.074912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1024
2025-10-01T14:10:14.075009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.075041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:14.075050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:14.075056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:14.075284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:14.075358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1024 sessionId:  describe result for acl check
2025-10-01T14:10:14.075382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:14.075386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:14.075388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:14.075391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255428150143295:8984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:14.075444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:14.075454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:14.075464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:14.075505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:14.075540Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255425773266528:7834]
2025-10-01T14:10:14.075767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255428150143295:8984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:14.075997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:14.076224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:14.076259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:14.076491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:14.076540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.076545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.076546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.076547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.076549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.076550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.076551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.076552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.076553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.076555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.076556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.076557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.076558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.076559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.076564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.076574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.076577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.076581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.076585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.076588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.076592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.076595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.076599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.076602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.076606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.076609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.076613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.076616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.076622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.076628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.076634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.076638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.076642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.076647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.076653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.076657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.076662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.076669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.076673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.076678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.076683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.076692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.076696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.076700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.076704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.076708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.076712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.076722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.076733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.076738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.076742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.076746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.076753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.076757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.076761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.076765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.076787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:14.077835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255428150143295:8984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:14.079945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255428150143295:8984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:14.079958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255428150143295:8984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:14.079960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255428150143295:8984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:14.079965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:14.079995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:14.080517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:14.080529Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:14.080530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:14.080533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:14.080537Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1023 [2:7556255425773266528:7834]
2025-10-01T14:10:14.080546Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:14.080558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:14.080559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.080561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.080563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.080573Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:14.080577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:14.080580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:14.080615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.080620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.080621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.080623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:14.080625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:14.080677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:14.080685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.080695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.080705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.080732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:14.080750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143334:8984], now have 1 active actors on pipe
2025-10-01T14:10:14.080756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143231:2446], now have 1 active actors on pipe
2025-10-01T14:10:14.080760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255425773266523:7834]
2025-10-01T14:10:14.080762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255425773266523:7834]
2025-10-01T14:10:14.080764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255425773266523:7834]
2025-10-01T14:10:14.080765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1023
2025-10-01T14:10:14.080764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1023
2025-10-01T14:10:14.080775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:14.080791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:14.080793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:14.080795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:14.080796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:14.080807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:14.080809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:14.080838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.080846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.080857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255425773266523:7834]
2025-10-01T14:10:14.080866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:14.080875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:14.080892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:14.080903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.080910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.080912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:14.080922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.080933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:14.080953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.081033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.081041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.081056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.081128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1024 partition: 0 MaxSeqNo: 45 sessionId: src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0
2025-10-01T14:10:14.081406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa90ff-2a77afd4-b67a7b80-350a90f6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:14.083659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0] Write session: try to update token
2025-10-01T14:10:14.083673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:14.096347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1024 sessionId: src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:14.098572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:14.098728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.098750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.098784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:14.098835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:14.100490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:14.100507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:14.100509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:14.100511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:14.100520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255425773266523:7834]
2025-10-01T14:10:14.100524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255425773266523:7834]
2025-10-01T14:10:14.100527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255425773266523:7834]
2025-10-01T14:10:14.100562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:14.100567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:14.100572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.100573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:14.100574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:14.100577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:14.100743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:14.165019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255428150143342:8859]
2025-10-01T14:10:14.165269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1023, pipe: [1:7556255428150143342:8859]
2025-10-01T14:10:14.235191Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:14.241416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.241440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.241572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.241626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.241687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.241743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.241791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.241796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.241876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.241940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.242006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.242075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.242125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.242133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.242200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.242260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.242329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.242403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.242446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.242453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.242509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.242563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.242619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.242675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.242718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.242725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.242847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.243058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.243119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.243177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.243266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.243274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.243339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.243398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.243464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.243529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.243576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.243583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.243649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.243708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.243769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.243827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.243873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.243879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.243944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.244002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.244062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.244125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.244168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.244174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.244239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.244298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.244367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.244431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.244535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.244542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.244610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.244683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.244763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.244830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.244872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.244879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.244924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143342:8859], now have 1 active actors on pipe
2025-10-01T14:10:14.245128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255428150143342:8859]
2025-10-01T14:10:14.245144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:14.245148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:14.245170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1024 reason: error at write: Disconnected sessionId: src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0
2025-10-01T14:10:14.245178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:14.245345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1024 sessionId: src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0 is DEAD
2025-10-01T14:10:14.245506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:14.245517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0] Write session will restart in 0.009205s
2025-10-01T14:10:14.245543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0] Write session: Do CDS request
2025-10-01T14:10:14.245549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:14.246017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:14.252243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:14.252602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:14.252738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:14.252747Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:14.252759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:14.252799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:14.252827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255425773266631:7836]
2025-10-01T14:10:14.253186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:14.254359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:14.254399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:14.254601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:14.254633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.254637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.254638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.254639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.254639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.254640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.254640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.254641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.254642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.254642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.254643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.254643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.254644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.254644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.254647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.254653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.254655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.254657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.254659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.254661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.254663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.254664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.254666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.254669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.254671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.254673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.254674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.254676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.254681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.254685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.254688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.254691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.254694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.254696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.254698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.254701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.254704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.254706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.254709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.254712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.254714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.254717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.254720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.254723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.254725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.254728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.254730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.254733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.254737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.254740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.254742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.254745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.254747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.254750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.254752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.254754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.254773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:14.255849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.255935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:14.255953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1025
2025-10-01T14:10:14.256062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.256094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:14.256105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:14.256123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:14.256425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1025 sessionId:  describe result for acl check
2025-10-01T14:10:14.256450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:14.256453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:14.256455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:14.256458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255428150143413:8988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:14.256850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255428150143413:8988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:14.258041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:14.258790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:14.258803Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:14.258804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:14.258806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:14.258811Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1024 [2:7556255425773266631:7836]
2025-10-01T14:10:14.258820Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:14.258831Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:14.258833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.258835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.258836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.258847Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:14.258850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:14.258854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:14.258888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.258894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.258895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.258897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:14.258898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:14.258944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:14.258949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.258956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.258961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.258969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:14.258982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143344:2446], now have 1 active actors on pipe
2025-10-01T14:10:14.258991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255425773266626:7836]
2025-10-01T14:10:14.258992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255425773266626:7836]
2025-10-01T14:10:14.258993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255425773266626:7836]
2025-10-01T14:10:14.259002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:14.259010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:14.259011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:14.259013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:14.259015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:14.259022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:14.259023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:14.259015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255428150143413:8988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:14.259040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255425773266626:7836]
2025-10-01T14:10:14.259045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:14.259047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:14.259112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1024
2025-10-01T14:10:14.263454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255428150143413:8988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:14.263468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255428150143413:8988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:14.263471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255428150143413:8988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:14.263478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:14.263856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143455:8988], now have 1 active actors on pipe
2025-10-01T14:10:14.263892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1024
2025-10-01T14:10:14.263941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.263952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.263976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:14.263989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.263998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.264001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:14.264013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.264030Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:14.264051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.264203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.264210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.264221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.264275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1025 partition: 0 MaxSeqNo: 45 sessionId: src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0
2025-10-01T14:10:14.264633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ba4a5b2-79a6c254-3e4a8c23-eec8305_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:14.266952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0] Write session: try to update token
2025-10-01T14:10:14.266968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:14.273749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:14.273767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:14.273775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255425773266626:7836]
2025-10-01T14:10:14.273814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:14.273816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:14.273972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:14.274104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:14.274234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:14.274361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:14.274567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:14.274604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:14.279043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1025 sessionId: src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:14.281572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:14.281759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.281777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.281808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:14.281895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:14.286896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:14.286914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:14.286916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:14.286917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:14.286925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255425773266626:7836]
2025-10-01T14:10:14.286927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255425773266626:7836]
2025-10-01T14:10:14.286929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255425773266626:7836]
2025-10-01T14:10:14.286966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:14.286970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.286970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:14.286972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:14.286974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:14.286977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:14.287087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:14.345233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255428150143483:8859]
2025-10-01T14:10:14.345431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1024, pipe: [1:7556255428150143483:8859]
2025-10-01T14:10:14.418219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:14.424496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.424518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.424637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.424689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.424749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.424794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.424830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.424837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.424888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.424938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.424981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.425027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.425067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.425072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.425129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.425181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.425233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.425285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.425322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.425327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.425380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.425431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.425483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.425536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.425574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.425579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.425634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.425685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.425736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.425784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.425821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.425825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.425881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.425958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.426030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.426081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.426119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.426123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.426177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.426225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.426276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.426327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.426364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.426384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.426459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.426524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.426589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.426655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.426703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.426711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.426780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.426840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.426905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.426975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.427021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.427027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.427099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:14.427163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:14.427227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:14.427288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:14.427335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:14.427343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:14.427381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143483:8859], now have 1 active actors on pipe
2025-10-01T14:10:14.427555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255428150143483:8859]
2025-10-01T14:10:14.427581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:14.427752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:14.427764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:14.427790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1025 reason: error at write: Disconnected sessionId: src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0
2025-10-01T14:10:14.428031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1025 sessionId: src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0 is DEAD
2025-10-01T14:10:14.428133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:14.428143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0] Write session will restart in 0.005027s
2025-10-01T14:10:14.428168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0] Write session: Do CDS request
2025-10-01T14:10:14.428174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:14.428166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:14.433817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.433881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:14.433895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1026
2025-10-01T14:10:14.434008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.434031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:14.434035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:14.434038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:14.434304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1026 sessionId:  describe result for acl check
2025-10-01T14:10:14.434328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:14.434329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:14.434330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:14.434333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255428150143551:9000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:14.434721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255428150143551:9000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:14.435629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:14.436492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255428150143551:9000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:14.437753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:14.437900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:14.437909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:14.437916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:14.437948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:14.437973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255425773266757:7847]
2025-10-01T14:10:14.438334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:14.438440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255428150143551:9000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:14.438452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255428150143551:9000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:14.438456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255428150143551:9000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:14.438462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:14.438545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:14.438569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:14.438749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:14.438782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.438786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.438786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.438787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.438788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.438788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.438789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.438790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.438790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.438791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.438791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.438792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.438793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.438793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.438796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.438802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.438804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.438806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.438808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.438810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.438812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.438814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.438816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.438818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.438820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.438822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.438824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.438826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.438830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.438834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.438838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.438841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.438843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.438846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.438848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.438851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.438853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.438856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.438858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.438860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.438862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.438865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.438867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.438870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.438872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.438875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.438877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.438879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.438882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.438885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.438886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.438889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.438891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.438893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.438895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.438897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.438926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:14.442141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:14.442648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:14.442659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:14.442660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:14.442662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:14.442666Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1025 [2:7556255425773266757:7847]
2025-10-01T14:10:14.442675Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:14.442684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:14.442686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.442688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.442689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.442698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:14.442702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:14.442709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:14.442744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.442749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.442749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.442752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:14.442754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:14.442796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:14.442801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.442807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.442812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.442823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:14.442837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143590:9000], now have 1 active actors on pipe
2025-10-01T14:10:14.442842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143488:2446], now have 1 active actors on pipe
2025-10-01T14:10:14.442847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255425773266752:7847]
2025-10-01T14:10:14.442848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255425773266752:7847]
2025-10-01T14:10:14.442849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255425773266752:7847]
2025-10-01T14:10:14.442857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:14.442865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:14.442868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:14.442873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:14.442875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:14.442875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:14.442877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:14.442890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255425773266752:7847]
2025-10-01T14:10:14.442901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:14.442904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:14.442929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1025
2025-10-01T14:10:14.442943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1025
2025-10-01T14:10:14.442989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.442995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.443013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:14.443018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.443021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.443022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:14.443027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.443033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:14.443042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.443137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.443143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.443151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.443225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1026 partition: 0 MaxSeqNo: 45 sessionId: src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0
2025-10-01T14:10:14.443510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|843e78c5-2b68be2f-4a95fc68-4d50fb99_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:14.445837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0] Write session: try to update token
2025-10-01T14:10:14.445864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:14.460199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1026 sessionId: src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:14.461973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:14.461996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:14.461999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:14.462001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:14.462009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255425773266752:7847]
2025-10-01T14:10:14.462013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255425773266752:7847]
2025-10-01T14:10:14.462017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255425773266752:7847]
2025-10-01T14:10:14.462054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:14.462065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:14.462066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:14.462070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:14.462071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.462074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:14.462202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:14.462324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:14.527498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255428150143601:8859]
2025-10-01T14:10:14.527688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1025, pipe: [1:7556255428150143601:8859]
2025-10-01T14:10:14.595134Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:14.595490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.595502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.595535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143601:8859], now have 1 active actors on pipe
2025-10-01T14:10:14.595694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:14.595745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:14.595758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:14.595768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255428150143601:8859]
2025-10-01T14:10:14.595803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1026 reason: error at write: Disconnected sessionId: src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0
2025-10-01T14:10:14.595877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:14.595965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1026 sessionId: src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0 is DEAD
2025-10-01T14:10:14.596147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:14.596158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0] Write session will restart in 0.008786s
2025-10-01T14:10:14.596178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0] Write session: Do CDS request
2025-10-01T14:10:14.596183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:14.603052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:14.604988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:14.605124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:14.605132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:14.605139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:14.605179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:14.605206Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255425773266878:7853]
2025-10-01T14:10:14.605843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.605899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:14.605996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:14.606012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1027
2025-10-01T14:10:14.606083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:14.606108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:14.606167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.606213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:14.606226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:14.606231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:14.606292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:14.606327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.606331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.606331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.606332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.606333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.606333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.606334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.606334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.606335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.606335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.606336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.606337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.606337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.606338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.606340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.606347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.606349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.606351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.606353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.606355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.606357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.606360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.606362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.606366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.606383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.606387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.606390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.606393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.606402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.606408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.606413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.606418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.606423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.606427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.606432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.606437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.606441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.606446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.606450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.606452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.606455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.606458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.606461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.606464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.606466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.606469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.606471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.606474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.606477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.606480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.606482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.606485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.606488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.606490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.606492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.606495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.606516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:14.606652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1027 sessionId:  describe result for acl check
2025-10-01T14:10:14.606688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:14.606697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:14.606698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:14.606703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255428150143672:9004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:14.607207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255428150143672:9004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:14.608846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255428150143672:9004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:14.609715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:14.610202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:14.610214Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:14.610215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:14.610217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:14.610221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1026 [2:7556255425773266878:7853]
2025-10-01T14:10:14.610229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:14.610239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:14.610241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.610242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.610243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.610253Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:14.610256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:14.610260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:14.610295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.610301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.610303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.610304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:14.610306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:14.610358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:14.610363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.610402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.610411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.610431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:14.610451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143602:2446], now have 1 active actors on pipe
2025-10-01T14:10:14.610461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255425773266873:7853]
2025-10-01T14:10:14.610463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255425773266873:7853]
2025-10-01T14:10:14.610465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255425773266873:7853]
2025-10-01T14:10:14.610476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:14.610459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1026
2025-10-01T14:10:14.610489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:14.610496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:14.610499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:14.610500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:14.610501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:14.610501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:14.610521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255425773266873:7853]
2025-10-01T14:10:14.610528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:14.610538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:14.610879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255428150143672:9004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:14.610891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255428150143672:9004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:14.610894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255428150143672:9004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:14.610900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:14.611047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143711:9004], now have 1 active actors on pipe
2025-10-01T14:10:14.611083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1026
2025-10-01T14:10:14.611118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.611125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.611142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c55432c4-bf91da52-bf829830-4157edf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:14.611150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.611153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.611154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:14.611160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.611166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:14.611181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.611337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.611349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.611366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.611444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1027 partition: 0 MaxSeqNo: 45 sessionId: src_id|c55432c4-bf91da52-bf829830-4157edf0_0
2025-10-01T14:10:14.611767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723c4681-11c0cb81-bb1ec542-30aeb84f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c55432c4-bf91da52-bf829830-4157edf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:14.614554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c55432c4-bf91da52-bf829830-4157edf0_0] Write session: try to update token
2025-10-01T14:10:14.614571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c55432c4-bf91da52-bf829830-4157edf0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:14.626234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1027 sessionId: src_id|c55432c4-bf91da52-bf829830-4157edf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:14.628378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:14.628903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.628931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.628954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:14.628960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:14.628962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:14.628964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:14.628970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255425773266873:7853]
2025-10-01T14:10:14.628973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255425773266873:7853]
2025-10-01T14:10:14.628975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255425773266873:7853]
2025-10-01T14:10:14.629007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:14.629017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:14.629018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:14.629020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:14.629022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.629023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:14.629157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:14.695957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255428150143717:8859]
2025-10-01T14:10:14.696142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1026, pipe: [1:7556255428150143717:8859]
2025-10-01T14:10:14.759638Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:14.760196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:14.760251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143717:8859], now have 1 active actors on pipe
2025-10-01T14:10:14.760298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:14.760395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:14.760440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255428150143717:8859]
2025-10-01T14:10:14.767574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:14.769512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:14.769654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:14.769661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:14.769669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:14.769699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:14.769735Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255425773266996:7856]
2025-10-01T14:10:14.770115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:14.770293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:14.770324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:14.770549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:14.770591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.770596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.770596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.770597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.770598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.770598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.770599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.770600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.770601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.770601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.770602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.770603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.770604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.770604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.770607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.770614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.770616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.770618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.770620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.770623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.770625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.770627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.770629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.770632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.770635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.770637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.770639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.770641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.770646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.770651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.770654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.770659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.770661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.770664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.770666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.770669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.770672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.770674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.770677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.770680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.770682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.770685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.770687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.770690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.770692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.770695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.770697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.770700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.770704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.770707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.770709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.770712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.770714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.770717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.770719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.770722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.770754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:14.771144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:14.771158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:14.771179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1027 reason: error at write: Disconnected sessionId: src_id|c55432c4-bf91da52-bf829830-4157edf0_0
2025-10-01T14:10:14.771354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1027 sessionId: src_id|c55432c4-bf91da52-bf829830-4157edf0_0 is DEAD
2025-10-01T14:10:14.771497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55432c4-bf91da52-bf829830-4157edf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:14.771506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55432c4-bf91da52-bf829830-4157edf0_0] Write session will restart in 0.007431s
2025-10-01T14:10:14.771523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55432c4-bf91da52-bf829830-4157edf0_0] Write session: Do CDS request
2025-10-01T14:10:14.771528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55432c4-bf91da52-bf829830-4157edf0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:14.774587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:14.775188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:14.775202Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:14.775203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:14.775206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:14.775211Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1027 [2:7556255425773266996:7856]
2025-10-01T14:10:14.775220Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:14.775237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:14.775250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.775254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.775256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.775268Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:14.775275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:14.775279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:14.775315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.775321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.775322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.775324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:14.775326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:14.775386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:14.775392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.775399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.775404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.775413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:14.775426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143732:2446], now have 1 active actors on pipe
2025-10-01T14:10:14.775435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255425773266991:7856]
2025-10-01T14:10:14.775439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255425773266991:7856]
2025-10-01T14:10:14.775441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255425773266991:7856]
2025-10-01T14:10:14.775449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:14.775462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:14.775465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:14.775469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:14.775471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:14.775474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:14.775477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:14.775499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255425773266991:7856]
2025-10-01T14:10:14.775504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:14.775506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:14.775493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1027
2025-10-01T14:10:14.779774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c55432c4-bf91da52-bf829830-4157edf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.779922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:14.779938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1028
2025-10-01T14:10:14.780080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.780110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:14.780120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:14.780122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:14.780486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1028 sessionId:  describe result for acl check
2025-10-01T14:10:14.780514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:14.780520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:14.780521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:14.780526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255428150143810:9010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:14.781028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255428150143810:9010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:14.783230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255428150143810:9010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:14.785295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:14.785311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:14.785318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255425773266991:7856]
2025-10-01T14:10:14.785342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:14.785351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:14.785767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:14.785891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:14.786007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:14.786130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:14.786298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:14.786327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:14.788691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255428150143810:9010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:14.788702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255428150143810:9010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:14.788705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255428150143810:9010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:14.788711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:14.788877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143845:9010], now have 1 active actors on pipe
2025-10-01T14:10:14.788926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1027
2025-10-01T14:10:14.788986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.788995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.789015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:14.789027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.789030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.789035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:14.789043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.789054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:14.789068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.789213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.789230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.789252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.789324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1028 partition: 0 MaxSeqNo: 45 sessionId: src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0
2025-10-01T14:10:14.789639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c55432c4-bf91da52-bf829830-4157edf0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:14.792376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0] Write session: try to update token
2025-10-01T14:10:14.792388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:14.803534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:14.803552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:14.803554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:14.803555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:14.803566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255425773266991:7856]
2025-10-01T14:10:14.803569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255425773266991:7856]
2025-10-01T14:10:14.803571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255425773266991:7856]
2025-10-01T14:10:14.803609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:14.803612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:14.803618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.803618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:14.803619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:14.803622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:14.803751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:14.806003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1028 sessionId: src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:14.808339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:14.860827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255428150143848:8859]
2025-10-01T14:10:14.861015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1027, pipe: [1:7556255428150143848:8859]
2025-10-01T14:10:14.937870Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:14.938251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.938264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.938282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143848:8859], now have 1 active actors on pipe
2025-10-01T14:10:14.938459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:14.938488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:14.938518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255428150143848:8859]
2025-10-01T14:10:14.938536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:14.938599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1028 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0
2025-10-01T14:10:14.938783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1028 sessionId: src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0 is DEAD
2025-10-01T14:10:14.938902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:14.938911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0] Write session will restart in 0.008725s
2025-10-01T14:10:14.938929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0] Write session: Do CDS request
2025-10-01T14:10:14.938935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:14.945597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:14.947591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:14.947724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:14.947731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:14.947739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:14.947766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:14.947792Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255425773267105:7859]
2025-10-01T14:10:14.948177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:14.948344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:14.948367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:14.948554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:14.948588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.948592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.948593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.948593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.948594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.948594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.948595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.948596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.948596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.948597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.948598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.948598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.948599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.948599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.948602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.948607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.948609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.948611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.948613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.948615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.948617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.948619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.948621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.948623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.948625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.948627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.948629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.948631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.948636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.948640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:14.948643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.948646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:14.948649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.948652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:14.948655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.948657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:14.948660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.948666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:14.948668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.948671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:14.948673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.948676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:14.948679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.948681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:14.948685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.948688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:14.948690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.948695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.948697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.948700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.948702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.948707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.948709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.948712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:14.948714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.948717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:14.948747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:14.948811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.948898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:14.948911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1029
2025-10-01T14:10:14.949006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:14.949026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:14.949033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:14.949036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:14.949294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1029 sessionId:  describe result for acl check
2025-10-01T14:10:14.949316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:14.949321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:14.949322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:14.949325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255428150143923:9014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:14.949695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255428150143923:9014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:14.951572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255428150143923:9014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:14.951900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:14.952597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:14.952606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:14.952608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:14.952610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:14.952614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1028 [2:7556255425773267105:7859]
2025-10-01T14:10:14.952623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:14.952633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:14.952640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.952642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.952643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.952653Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:14.952659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:14.952663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:14.952698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.952702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.952703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.952705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:14.952707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:14.952769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:14.952774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.952781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:14.952790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:14.952803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:14.952818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143849:2446], now have 1 active actors on pipe
2025-10-01T14:10:14.952827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255425773267100:7859]
2025-10-01T14:10:14.952828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255425773267100:7859]
2025-10-01T14:10:14.952829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255425773267100:7859]
2025-10-01T14:10:14.952839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:14.952850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:14.952845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1028
2025-10-01T14:10:14.952851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:14.952858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:14.952859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:14.952860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:14.952861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:14.952881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255425773267100:7859]
2025-10-01T14:10:14.952889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:14.952894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:14.953497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255428150143923:9014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:14.953510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255428150143923:9014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:14.953512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255428150143923:9014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:14.953518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:14.953645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255428150143962:9014], now have 1 active actors on pipe
2025-10-01T14:10:14.953672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1028
2025-10-01T14:10:14.953706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.953712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.953729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:14.953737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:14.953743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:14.953744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:14.953750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:14.953760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:14.953772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.953866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.953871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.953879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:14.953923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1029 partition: 0 MaxSeqNo: 45 sessionId: src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0
2025-10-01T14:10:14.954145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54aea0f8-1330ab87-c8f14340-c42430bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:14.956606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0] Write session: try to update token
2025-10-01T14:10:14.956620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:14.962582Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:14.962605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:14.962612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255425773267100:7859]
2025-10-01T14:10:14.962645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:14.962646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:14.962820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:14.962936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:14.963054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:14.963168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:14.963329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:14.963357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:14.968376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1029 sessionId: src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:14.970551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:14.970728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:14.970746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:14.970779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:14.970859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:14.981928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:14.981942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:14.981943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:14.981945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:14.981954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255425773267100:7859]
2025-10-01T14:10:14.981956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255425773267100:7859]
2025-10-01T14:10:14.981958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255425773267100:7859]
2025-10-01T14:10:14.981985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:14.981988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:14.981993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:14.981994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:14.981995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:14.981998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:14.982098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:15.038503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255432445111262:8859]
2025-10-01T14:10:15.038750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1028, pipe: [1:7556255432445111262:8859]
2025-10-01T14:10:15.114101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:15.120264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.120287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.120415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.120464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.120512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.120558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.120595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.120603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.120655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.120703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.120760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.120812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.120852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.120857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.120908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.120959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.121006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.121055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.121093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.121098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.121149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.121196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.121246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.121295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.121331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.121337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.121385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.121431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.121477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.121525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.121563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.121568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.121616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.121662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.121713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.121759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.121796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.121801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.121848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.121895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.121943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.121992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.122028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.122033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.122085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.122137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.122185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.122237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.122275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.122280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.122331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.122389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.122439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.122487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.122526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.122531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.122579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.122627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.122677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.122727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.122764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.122768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.122806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111262:8859], now have 1 active actors on pipe
2025-10-01T14:10:15.123043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:15.123047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255432445111262:8859]
2025-10-01T14:10:15.123061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:15.123074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:15.123088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1029 reason: error at write: Disconnected sessionId: src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0
2025-10-01T14:10:15.123298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1029 sessionId: src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0 is DEAD
2025-10-01T14:10:15.123405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:15.123421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0] Write session will restart in 0.009263s
2025-10-01T14:10:15.123438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0] Write session: Do CDS request
2025-10-01T14:10:15.123442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:15.123527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:15.131093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:15.132904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:15.133030Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:15.133037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:15.133045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:15.133072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:15.133100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255430068234511:7861]
2025-10-01T14:10:15.133481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:15.133675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:15.133703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:15.133839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.133855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:15.133867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1030
2025-10-01T14:10:15.133905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:15.133943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.133947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.133947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.133948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.133949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.133949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.133950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.133950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.133951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.133951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.133952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.133953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.133953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.133954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.133957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.133962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.133964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.133966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.133968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.133970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.133972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.133974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.133976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.133979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.133981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.133983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.133985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.133986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.133991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.133996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.134000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.134003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.134006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.134009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.134011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.134014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.134016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.134019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.134022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.134027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.134029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.134032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.134037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.134040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.134043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.134045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.134049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.134052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.134055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.134059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.134064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.134066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.134069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.134071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.134076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.134079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.134100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:15.134109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.134148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:15.134157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:15.134165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:15.134501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1030 sessionId:  describe result for acl check
2025-10-01T14:10:15.134530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:15.134538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:15.134540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:15.134544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255432445111343:9018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:15.135031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255432445111343:9018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:15.137374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:15.137541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255432445111343:9018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:15.137911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:15.137924Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:15.137925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:15.137927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:15.137932Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1029 [2:7556255430068234511:7861]
2025-10-01T14:10:15.137942Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:15.137954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:15.137956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.137958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.137959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.137970Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:15.137973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:15.137977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:15.138014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.138020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.138021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.138023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:15.138024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:15.138073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:15.138080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.138089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.138103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.138115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:15.138130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111266:2446], now have 1 active actors on pipe
2025-10-01T14:10:15.138138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255430068234506:7861]
2025-10-01T14:10:15.138139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255430068234506:7861]
2025-10-01T14:10:15.138140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255430068234506:7861]
2025-10-01T14:10:15.138150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:15.138161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:15.138172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:15.138161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1029
2025-10-01T14:10:15.138172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:15.138175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:15.138176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:15.138176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:15.138199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255430068234506:7861]
2025-10-01T14:10:15.138207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:15.138214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:15.142429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255432445111343:9018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:15.142443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255432445111343:9018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:15.142445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255432445111343:9018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:15.142451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:15.142634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111382:9018], now have 1 active actors on pipe
2025-10-01T14:10:15.142675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1029
2025-10-01T14:10:15.142720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.142729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.142750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c90a6d87-a7071693-75165cf4-61023cab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:15.142760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.142768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.142770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:15.142780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.142795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:15.142810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.142952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.142957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.142967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.143033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1030 partition: 0 MaxSeqNo: 45 sessionId: src_id|c90a6d87-a7071693-75165cf4-61023cab_0
2025-10-01T14:10:15.143339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|594c4a13-695f9da5-4ae01b7d-9fe06cb0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c90a6d87-a7071693-75165cf4-61023cab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:15.145533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c90a6d87-a7071693-75165cf4-61023cab_0] Write session: try to update token
2025-10-01T14:10:15.145546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c90a6d87-a7071693-75165cf4-61023cab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:15.148180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:15.148199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:15.148206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255430068234506:7861]
2025-10-01T14:10:15.148233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:15.148238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:15.148379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:15.148499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:15.148615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:15.148743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:15.148911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:15.148942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:15.157687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1030 sessionId: src_id|c90a6d87-a7071693-75165cf4-61023cab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:15.159828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:15.160114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:15.159990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.160009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.160038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:15.167171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:15.167188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:15.167190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:15.167191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:15.167199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255430068234506:7861]
2025-10-01T14:10:15.167202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255430068234506:7861]
2025-10-01T14:10:15.167206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255430068234506:7861]
2025-10-01T14:10:15.167240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:15.167241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:15.167245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:15.167248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:15.167248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.167250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:15.167357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:15.223323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255432445111388:8859]
2025-10-01T14:10:15.223543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1029, pipe: [1:7556255432445111388:8859]
2025-10-01T14:10:15.302150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:15.309270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.309296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.309411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.309459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.309509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.309559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.309597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.309603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.309653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.309701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.309748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.309799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.309837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.309845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.309900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.309949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.309998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.310047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.310084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.310091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.310144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.310196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.310247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.310296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.310335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.310339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.310414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.310485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.310554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.310620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.310666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.310674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.310744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.310813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.310885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.310958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.311007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.311015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.311082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.311141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.311199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.311253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.311291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.311298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.311357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.311410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.311462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.311514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.311554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.311560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.311614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.311663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.311714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.311765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.311854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.311859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.311911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.311960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.312011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.312062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.312101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.312106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.312142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111388:8859], now have 1 active actors on pipe
2025-10-01T14:10:15.312359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:15.312374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:15.312393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1030 reason: error at write: Disconnected sessionId: src_id|c90a6d87-a7071693-75165cf4-61023cab_0
2025-10-01T14:10:15.312584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1030 sessionId: src_id|c90a6d87-a7071693-75165cf4-61023cab_0 is DEAD
2025-10-01T14:10:15.312706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90a6d87-a7071693-75165cf4-61023cab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:15.312715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90a6d87-a7071693-75165cf4-61023cab_0] Write session will restart in 0.009305s
2025-10-01T14:10:15.312740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90a6d87-a7071693-75165cf4-61023cab_0] Write session: Do CDS request
2025-10-01T14:10:15.312745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90a6d87-a7071693-75165cf4-61023cab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:15.312739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255432445111388:8859]
2025-10-01T14:10:15.312756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:15.312959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:15.319320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:15.320975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:15.321087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:15.321095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:15.321102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:15.321127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:15.321155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255430068234620:7863]
2025-10-01T14:10:15.321504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:15.321664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:15.321686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:15.321857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:15.321886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.321890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.321891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.321891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.321892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.321893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.321893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.321895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.321895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.321896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.321896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.321897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.321897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.321898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.321900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.321906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.321908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.321910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.321911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.321914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.321915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.321917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.321919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.321921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.321923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.321925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.321927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.321929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.321934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.321937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.321941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.321944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.321946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.321948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.321951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.321953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.321957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.321960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.321965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.321968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.321970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.321978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.321980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.321983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.321988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.321992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.321994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.321999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.322001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.322004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.322006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.322008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.322010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.322013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.322016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.322019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.322036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:15.322788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c90a6d87-a7071693-75165cf4-61023cab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.322887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:15.322899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1031
2025-10-01T14:10:15.322993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.323010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:15.323016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:15.323020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:15.323553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1031 sessionId:  describe result for acl check
2025-10-01T14:10:15.323574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:15.323579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:15.323580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:15.323583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255432445111488:9029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:15.323907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255432445111488:9029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:15.325085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:15.325604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:15.325615Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:15.325616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:15.325618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:15.325622Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1030 [2:7556255430068234620:7863]
2025-10-01T14:10:15.325626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255432445111488:9029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:15.325631Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:15.325645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:15.325647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.325649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.325650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.325660Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:15.325663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:15.325667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:15.325698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.325703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.325704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.325706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:15.325708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:15.325752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:15.325758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.325764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.325769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.325777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:15.325792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255430068234615:7863]
2025-10-01T14:10:15.325795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255430068234615:7863]
2025-10-01T14:10:15.325796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255430068234615:7863]
2025-10-01T14:10:15.325803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:15.325811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111409:2446], now have 1 active actors on pipe
2025-10-01T14:10:15.325811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:15.325813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:15.325815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:15.325820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:15.325813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1030
2025-10-01T14:10:15.325828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:15.325829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:15.325847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255430068234615:7863]
2025-10-01T14:10:15.325854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:15.325862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:15.329983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255432445111488:9029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:15.329996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255432445111488:9029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:15.329998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255432445111488:9029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:15.330002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:15.330145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111532:9029], now have 1 active actors on pipe
2025-10-01T14:10:15.330169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1030
2025-10-01T14:10:15.330214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.330226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.330250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:15.330263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.330266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.330268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:15.330275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.330290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:15.330309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.330438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.330444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.330457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.330515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1031 partition: 0 MaxSeqNo: 45 sessionId: src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0
2025-10-01T14:10:15.330790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c90a6d87-a7071693-75165cf4-61023cab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:15.332890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0] Write session: try to update token
2025-10-01T14:10:15.332901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:15.335539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:15.335557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:15.335564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255430068234615:7863]
2025-10-01T14:10:15.335604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:15.335609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:15.335753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:15.335874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:15.335992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:15.336107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:15.336275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:15.336304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:15.344325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1031 sessionId: src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:15.346431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:15.346753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.346773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.346811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:15.346883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:15.352980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:15.352996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:15.352998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:15.352999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:15.353007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255430068234615:7863]
2025-10-01T14:10:15.353009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255430068234615:7863]
2025-10-01T14:10:15.353012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255430068234615:7863]
2025-10-01T14:10:15.353047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:15.353054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.353056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:15.353065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:15.353080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:15.353084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:15.353166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:15.412769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255432445111538:8859]
2025-10-01T14:10:15.412973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1030, pipe: [1:7556255432445111538:8859]
2025-10-01T14:10:15.483931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:15.489922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.489946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.490078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.490127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.490177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.490225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.490262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.490269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.490320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.490390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.490443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.490494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.490537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.490546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.490608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.490660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.490713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.490768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.490808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.490813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.490870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.490921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.490975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.491026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.491068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.491073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.491125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.491175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.491230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.491285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.491326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.491331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.491387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.491437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.491489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.491543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.491581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.491588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.491642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.491693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.491746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.491799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.491839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.491844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.491896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.491944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.491994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.492046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.492081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.492086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.492140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.492192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.492244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.492296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.492338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.492342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.492400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.492450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.492507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.492565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.492608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.492613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.492647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111538:8859], now have 1 active actors on pipe
2025-10-01T14:10:15.492868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255432445111538:8859]
2025-10-01T14:10:15.492881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:15.492884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:15.492892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:15.492905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1031 reason: error at write: Disconnected sessionId: src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0
2025-10-01T14:10:15.493083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1031 sessionId: src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0 is DEAD
2025-10-01T14:10:15.493313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:15.493322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0] Write session will restart in 0.005006s
2025-10-01T14:10:15.493314Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:15.493348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0] Write session: Do CDS request
2025-10-01T14:10:15.493354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:15.499760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.499845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:15.499859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1032
2025-10-01T14:10:15.500219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.500242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:15.500258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:15.500263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:15.500578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1032 sessionId:  describe result for acl check
2025-10-01T14:10:15.500583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:15.500609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:15.500615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:15.500617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:15.500621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255432445111616:9036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:15.500996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255432445111616:9036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:15.502425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:15.502542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:15.502557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:15.502565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:15.502577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255432445111616:9036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:15.502596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:15.502623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255430068234770:7880]
2025-10-01T14:10:15.502979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:15.503139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:15.503163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:15.503339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:15.503371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.503375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.503375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.503376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.503377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.503377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.503378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.503378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.503379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.503379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.503380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.503381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.503381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.503382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.503385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.503390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.503392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.503394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.503396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.503398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.503400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.503402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.503404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.503406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.503408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.503410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.503412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.503414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.503417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.503422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.503425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.503428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.503430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.503433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.503435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.503438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.503440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.503443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.503445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.503447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.503450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.503452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.503458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.503460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.503462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.503465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.503469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.503471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.503474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.503479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.503481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.503484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.503487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.503493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.503495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.503497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.503515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:15.506351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255432445111616:9036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:15.506363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255432445111616:9036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:15.506365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255432445111616:9036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:15.506384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:15.506617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:15.507249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:15.507262Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:15.507264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:15.507266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:15.507271Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1031 [2:7556255430068234770:7880]
2025-10-01T14:10:15.507284Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:15.507301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:15.507308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.507312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.507318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.507331Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:15.507340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:15.507348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:15.507398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.507404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.507406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.507408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:15.507410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:15.507454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:15.507460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.507466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.507471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.507480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:15.507495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111545:2446], now have 1 active actors on pipe
2025-10-01T14:10:15.507502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255430068234765:7880]
2025-10-01T14:10:15.507504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255430068234765:7880]
2025-10-01T14:10:15.507505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255430068234765:7880]
2025-10-01T14:10:15.507511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:15.507520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111653:9036], now have 1 active actors on pipe
2025-10-01T14:10:15.507523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:15.507526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:15.507528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:15.507529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:15.507537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:15.507538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:15.507553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255430068234765:7880]
2025-10-01T14:10:15.507558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:15.507545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1031
2025-10-01T14:10:15.507566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:15.507577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1031
2025-10-01T14:10:15.507633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.507639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.507654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35ec6bb9-748af227-1556f52e-70f86f20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:15.507662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.507665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.507667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:15.507673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.507681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:15.507693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.507806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.507811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.507819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.508064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1032 partition: 0 MaxSeqNo: 45 sessionId: src_id|35ec6bb9-748af227-1556f52e-70f86f20_0
2025-10-01T14:10:15.508334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b287d201-6b706d84-60a7f97f-c2cc0705_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|35ec6bb9-748af227-1556f52e-70f86f20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:15.510451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35ec6bb9-748af227-1556f52e-70f86f20_0] Write session: try to update token
2025-10-01T14:10:15.510463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35ec6bb9-748af227-1556f52e-70f86f20_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:15.524624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1032 sessionId: src_id|35ec6bb9-748af227-1556f52e-70f86f20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:15.526346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:15.526365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:15.526367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:15.526388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:15.526396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255430068234765:7880]
2025-10-01T14:10:15.526401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255430068234765:7880]
2025-10-01T14:10:15.526405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255430068234765:7880]
2025-10-01T14:10:15.526451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:15.526455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:15.526460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:15.526464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:15.526466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.526469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:15.526613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:15.527207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:15.593222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255432445111664:8859]
2025-10-01T14:10:15.593433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1031, pipe: [1:7556255432445111664:8859]
2025-10-01T14:10:15.655930Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:15.656488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.656503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.656544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111664:8859], now have 1 active actors on pipe
2025-10-01T14:10:15.656710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:15.656757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255432445111664:8859]
2025-10-01T14:10:15.656769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:15.656783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:15.656831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1032 reason: status is not ok: tablet will be restarted right now sessionId: src_id|35ec6bb9-748af227-1556f52e-70f86f20_0
2025-10-01T14:10:15.657004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1032 sessionId: src_id|35ec6bb9-748af227-1556f52e-70f86f20_0 is DEAD
2025-10-01T14:10:15.657175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ec6bb9-748af227-1556f52e-70f86f20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:15.657186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ec6bb9-748af227-1556f52e-70f86f20_0] Write session will restart in 0.005599s
2025-10-01T14:10:15.657206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ec6bb9-748af227-1556f52e-70f86f20_0] Write session: Do CDS request
2025-10-01T14:10:15.657210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ec6bb9-748af227-1556f52e-70f86f20_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:15.663248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:15.663806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35ec6bb9-748af227-1556f52e-70f86f20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.663874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:15.663886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1033
2025-10-01T14:10:15.663967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.663990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:15.663997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:15.663999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:15.664286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1033 sessionId:  describe result for acl check
2025-10-01T14:10:15.664313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:15.664318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:15.664319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:15.664322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255432445111744:9042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:15.664673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255432445111744:9042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:15.665128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:15.665238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:15.665245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:15.665253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:15.665279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:15.665307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255430068234896:7883]
2025-10-01T14:10:15.665655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:15.665812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:15.665836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:15.666013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:15.666047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.666048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.666049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.666049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.666050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.666051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.666051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.666052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.666052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.666053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.666053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.666060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255432445111744:9042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:15.666054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.666055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.666055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.666058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.666063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.666065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.666067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.666069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.666071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.666073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.666075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.666077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.666080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.666082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.666084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.666086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.666088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.666092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.666096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.666099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.666102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.666105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.666108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.666110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.666113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.666115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.666119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.666121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.666124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.666126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.666129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.666131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.666134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.666136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.666139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.666141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.666143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.666146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.666148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.666150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.666153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.666155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.666158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.666160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.666162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.666182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:15.669041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255432445111744:9042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:15.669051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255432445111744:9042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:15.669054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255432445111744:9042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:15.669059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:15.669286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:15.669810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:15.669824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:15.669826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:15.669829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:15.669835Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1032 [2:7556255430068234896:7883]
2025-10-01T14:10:15.669847Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:15.669860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:15.669868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.669871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.669873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.669888Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:15.669898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:15.669903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:15.669947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.669955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.669957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.669959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:15.669962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:15.670015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:15.670021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.670031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.670042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.670063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:15.670083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111671:2446], now have 1 active actors on pipe
2025-10-01T14:10:15.670076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1032
2025-10-01T14:10:15.670089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111783:9042], now have 1 active actors on pipe
2025-10-01T14:10:15.670093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1032
2025-10-01T14:10:15.670096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255430068234891:7883]
2025-10-01T14:10:15.670098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255430068234891:7883]
2025-10-01T14:10:15.670100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255430068234891:7883]
2025-10-01T14:10:15.670108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:15.670112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:15.670114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:15.670116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:15.670123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:15.670136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:15.670142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:15.670160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.670168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.670196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255430068234891:7883]
2025-10-01T14:10:15.670206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:15.670212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:15.670220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:15.670226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.670229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.670231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:15.670239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.670246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:15.670278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.670365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.670383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.670395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.670465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1033 partition: 0 MaxSeqNo: 45 sessionId: src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0
2025-10-01T14:10:15.670746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35ec6bb9-748af227-1556f52e-70f86f20_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:15.673015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0] Write session: try to update token
2025-10-01T14:10:15.673028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:15.684981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1033 sessionId: src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:15.687401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:15.687580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.687596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.689292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:15.689325Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:15.689328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:15.689330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:15.689332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:15.689340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255430068234891:7883]
2025-10-01T14:10:15.689344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255430068234891:7883]
2025-10-01T14:10:15.689347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255430068234891:7883]
2025-10-01T14:10:15.689367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:15.689374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:15.689383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:15.689385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:15.689386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:15.689392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.689395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:15.689514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:15.756818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255432445111792:8859]
2025-10-01T14:10:15.757003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1032, pipe: [1:7556255432445111792:8859]
2025-10-01T14:10:15.818132Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:15.824862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.824883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.825023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.825075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.825134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.825189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.825231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.825238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.825297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.825351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.825406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.825460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.825502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.825507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.825564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.825611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.825661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.825709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.825754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.825760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.825810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.825860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.825911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.825961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.825998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.826003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.826057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.826105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.826156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.826207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.826244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.826249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.826299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.826347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.826419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.826475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.826565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.826572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.826624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.826673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.826724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.826780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.826892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.826904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.826967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.827025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.827084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.827148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.827192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.827199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.827261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.827322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.827387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.827594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.827637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.827643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.827699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:15.827750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:15.827803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:15.827855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:15.827893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:15.827898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:15.827936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111792:8859], now have 1 active actors on pipe
2025-10-01T14:10:15.828307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:15.828320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:15.828341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1033 reason: error at write: Disconnected sessionId: src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0
2025-10-01T14:10:15.828516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1033 sessionId: src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0 is DEAD
2025-10-01T14:10:15.828523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255432445111792:8859]
2025-10-01T14:10:15.828551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:15.828646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:15.828656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0] Write session will restart in 0.006974s
2025-10-01T14:10:15.828674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0] Write session: Do CDS request
2025-10-01T14:10:15.828679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:15.828984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:15.836914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.836963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:15.836978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1034
2025-10-01T14:10:15.837161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:15.837197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:15.837201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:15.837204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:15.837513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1034 sessionId:  describe result for acl check
2025-10-01T14:10:15.837538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:15.837542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:15.837544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:15.837547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255432445111881:9048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:15.837807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:15.837968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255432445111881:9048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:15.838137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:15.838245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:15.838253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:15.838260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:15.838286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:15.838310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255430068235009:7885]
2025-10-01T14:10:15.838700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:15.838998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:15.839041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:15.839283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:15.839325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.839330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.839331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.839331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.839332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.839333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.839334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.839334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.839335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.839336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.839336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.839337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.839338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.839338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.839342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.839347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.839349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.839352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.839354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.839356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.839359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.839361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.839363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.839366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.839368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.839370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.839372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.839374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.839379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.839383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:15.839387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.839391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:15.839394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.839397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:15.839400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.839403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:15.839406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.839409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:15.839411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.839414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:15.839417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.839420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:15.839422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.839425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:15.839428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.839431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:15.839433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.839436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.839439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.839442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.839444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.839447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.839450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.839452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:15.839455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.839457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:15.839478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:15.839902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255432445111881:9048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:15.842750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255432445111881:9048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:15.842766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255432445111881:9048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:15.842770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255432445111881:9048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:15.842779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:15.842916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:15.843486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:15.843494Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:15.843496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:15.843498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:15.843503Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1033 [2:7556255430068235009:7885]
2025-10-01T14:10:15.843514Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:15.843527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:15.843529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.843531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.843532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.843545Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:15.843548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:15.843552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:15.843591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.843597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.843598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.843600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:15.843602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:15.843661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:15.843668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.843679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:15.843694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:15.843712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:15.843733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111807:2446], now have 1 active actors on pipe
2025-10-01T14:10:15.843740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111920:9048], now have 1 active actors on pipe
2025-10-01T14:10:15.843745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255430068235004:7885]
2025-10-01T14:10:15.843747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255430068235004:7885]
2025-10-01T14:10:15.843748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255430068235004:7885]
2025-10-01T14:10:15.843759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:15.843772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:15.843772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:15.843774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:15.843776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:15.843788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:15.843792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:15.843782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1033
2025-10-01T14:10:15.843787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1033
2025-10-01T14:10:15.843821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255430068235004:7885]
2025-10-01T14:10:15.843831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:15.843836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:15.843845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.843853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.843897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:15.843908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:15.843912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:15.843914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:15.843922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:15.843930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:15.843951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.844079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:15.844086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:15.844099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:15.844148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1034 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0
2025-10-01T14:10:15.844478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8671a7-f15fc97a-c29caf0d-4363859_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:15.847220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0] Write session: try to update token
2025-10-01T14:10:15.847234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:15.862765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1034 sessionId: src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:15.863611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:15.863623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:15.863625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:15.863626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:15.863633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255430068235004:7885]
2025-10-01T14:10:15.863638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255430068235004:7885]
2025-10-01T14:10:15.863641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255430068235004:7885]
2025-10-01T14:10:15.863678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:15.863682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:15.863684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:15.863802Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:15.864005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:15.864032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:15.864037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:15.864942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:15.928833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255432445111927:8859]
2025-10-01T14:10:15.929089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1033, pipe: [1:7556255432445111927:8859]
2025-10-01T14:10:15.999629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:16.000002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.000014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.000046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111927:8859], now have 1 active actors on pipe
2025-10-01T14:10:16.000213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:16.000222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255432445111927:8859]
2025-10-01T14:10:16.000227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:16.000253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:16.000255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:16.000301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1034 reason: error at write: Disconnected sessionId: src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0
2025-10-01T14:10:16.000457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1034 sessionId: src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0 is DEAD
2025-10-01T14:10:16.000588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:16.000600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0] Write session will restart in 0.009480s
2025-10-01T14:10:16.000623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0] Write session: Do CDS request
2025-10-01T14:10:16.000627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:16.007366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:16.009232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:16.009419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:16.009431Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:16.009444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:16.009508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:16.009547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255434363202419:7888]
2025-10-01T14:10:16.010117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:16.010368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:16.010437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:16.010751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:16.010770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.010825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.010831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.010833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.010834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.010835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.010836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.010837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.010838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.010839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.010840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.010841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.010842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.010843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.010845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.010851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.010861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.010865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.010868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.010871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.010875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.010878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.010882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.010885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.010890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.010898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.010901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.010905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.010869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:16.010908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.010884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1035
2025-10-01T14:10:16.010920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.010931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.010941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.010950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.010958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.010966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.010962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.010974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.010979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.010984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:16.010984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.010987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:16.010990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.010998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.010994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:16.011005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.011009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.011014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.011020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.011028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.011035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.011044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.011051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.011056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.011063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.011067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.011074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.011079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.011086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.011091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.011098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.011104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.011146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:16.011273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1035 sessionId:  describe result for acl check
2025-10-01T14:10:16.011303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:16.011310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:16.011312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:16.011316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255436740079303:9052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:16.011704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255436740079303:9052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:16.013209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255436740079303:9052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:16.014526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:16.015286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255436740079303:9052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:16.015297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255436740079303:9052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:16.015300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255436740079303:9052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:16.015306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:16.015385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:16.015400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:16.015403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:16.015406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:16.015412Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1034 [2:7556255434363202419:7888]
2025-10-01T14:10:16.015426Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:16.015441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:16.015449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.015452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.015458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.015472Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:16.015481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:16.015487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:16.015544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.015551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.015553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.015556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:16.015558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:16.015623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:16.015631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.015642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.015657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.015677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:16.015678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1034
2025-10-01T14:10:16.015683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1034
2025-10-01T14:10:16.015698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079340:9052], now have 1 active actors on pipe
2025-10-01T14:10:16.015706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255432445111929:2446], now have 1 active actors on pipe
2025-10-01T14:10:16.015721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255434363202414:7888]
2025-10-01T14:10:16.015724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255434363202414:7888]
2025-10-01T14:10:16.015726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255434363202414:7888]
2025-10-01T14:10:16.015734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:16.015740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:16.015742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:16.015743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:16.015748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:16.015761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:16.015769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:16.015785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.015793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.015826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255434363202414:7888]
2025-10-01T14:10:16.015837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:16.015845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:16.015854Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:16.015865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.015873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.015875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:16.015884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.015896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:16.015937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.016052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.016062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.016077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.016137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1035 partition: 0 MaxSeqNo: 45 sessionId: src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0
2025-10-01T14:10:16.016374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e82c35e-71ba9e88-8ce642eb-29463db1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:16.018748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0] Write session: try to update token
2025-10-01T14:10:16.018761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:16.031131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1035 sessionId: src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:16.033191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:16.033480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.033499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.035180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:16.035212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:16.035215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:16.035216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:16.035217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:16.035225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255434363202414:7888]
2025-10-01T14:10:16.035228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255434363202414:7888]
2025-10-01T14:10:16.035231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255434363202414:7888]
2025-10-01T14:10:16.035250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:16.035262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:16.035260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:16.035262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:16.035263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:16.035266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.035268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:16.035389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:16.100381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255436740079347:8859]
2025-10-01T14:10:16.100631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1034, pipe: [1:7556255436740079347:8859]
2025-10-01T14:10:16.172327Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:16.178591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.178610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.178749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.178803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.178856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.178907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.178951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.178958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.179015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.179067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.179125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.179179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.179217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.179222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.179272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.179318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.179371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.179417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.179454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.179459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.179509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.179557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.179639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.179686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.179722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.179728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.179778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.179825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.179874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.179928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.179967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.179972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.180022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.180068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.180147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.180200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.180238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.180243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.180294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.180343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.180393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.180441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.180478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.180483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.180532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.180579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.180625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.180676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.180715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.180720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.180782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.180855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.180905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.180958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.180996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.181001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.181052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.181101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.181151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.181201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.181237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.181242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.181275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079347:8859], now have 1 active actors on pipe
2025-10-01T14:10:16.181412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:16.181425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:16.181435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:16.181448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1035 reason: error at write: Disconnected sessionId: src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0
2025-10-01T14:10:16.181491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255436740079347:8859]
2025-10-01T14:10:16.181613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1035 sessionId: src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0 is DEAD
2025-10-01T14:10:16.181748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:16.181757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0] Write session will restart in 0.008184s
2025-10-01T14:10:16.181775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0] Write session: Do CDS request
2025-10-01T14:10:16.181780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:16.182063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:16.188335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:16.190322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:16.190444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:16.190451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:16.190459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:16.190487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:16.190513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255434363202533:7890]
2025-10-01T14:10:16.190816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.190866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:16.190891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:16.190904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1036
2025-10-01T14:10:16.191025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.191046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:16.191053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:16.191055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:16.191053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:16.191075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:16.191253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:16.191282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.191286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.191286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.191287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.191288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.191288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.191289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.191289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.191290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.191291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.191291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.191292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.191292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.191293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.191296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.191301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.191303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.191305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.191307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.191309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.191311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.191313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.191315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.191317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.191319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.191321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.191323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.191328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1036 sessionId:  describe result for acl check
2025-10-01T14:10:16.191324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.191328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.191333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.191336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.191339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.191342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.191345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.191347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.191350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.191352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.191355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.191349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:16.191357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.191354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:16.191359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.191355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:16.191361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.191358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255436740079428:9056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:16.191364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.191366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.191369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.191371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.191373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.191376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.191378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.191380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.191383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.191385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.191388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.191390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.191393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.191395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.191398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.191418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:16.191768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255436740079428:9056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:16.193945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255436740079428:9056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:16.194566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:16.195098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:16.195108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:16.195109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:16.195111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:16.195115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1035 [2:7556255434363202533:7890]
2025-10-01T14:10:16.195124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:16.195134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:16.195136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.195137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.195139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.195150Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:16.195154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:16.195158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:16.195191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.195196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.195197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.195199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:16.195201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:16.195242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:16.195247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.195253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.195258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.195270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:16.195284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079350:2446], now have 1 active actors on pipe
2025-10-01T14:10:16.195292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255434363202528:7890]
2025-10-01T14:10:16.195293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255434363202528:7890]
2025-10-01T14:10:16.195294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255434363202528:7890]
2025-10-01T14:10:16.195302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:16.195313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:16.195315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:16.195317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:16.195320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:16.195323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:16.195325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:16.195341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255434363202528:7890]
2025-10-01T14:10:16.195346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:16.195349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:16.195336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1035
2025-10-01T14:10:16.199443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255436740079428:9056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:16.199454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255436740079428:9056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:16.199457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255436740079428:9056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:16.199462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:16.199618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079469:9056], now have 1 active actors on pipe
2025-10-01T14:10:16.199659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1035
2025-10-01T14:10:16.199697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.199704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.199723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:16.199731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.199736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.199738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:16.199743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.199755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:16.199767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.199867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.199873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.199881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.199934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1036 partition: 0 MaxSeqNo: 45 sessionId: src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0
2025-10-01T14:10:16.200215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9920d5e8-3de2179c-5ee2bdf5-f1e7e23d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:16.202930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0] Write session: try to update token
2025-10-01T14:10:16.202945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:16.208754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:16.208767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:16.208775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255434363202528:7890]
2025-10-01T14:10:16.208809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:16.208812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:16.208963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:16.209085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:16.209200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:16.209313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:16.209480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:16.209509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:16.215484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1036 sessionId: src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:16.217768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:16.217934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.217949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.217976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:16.218044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:16.222429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:16.222440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:16.222441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:16.222443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:16.222451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255434363202528:7890]
2025-10-01T14:10:16.222453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255434363202528:7890]
2025-10-01T14:10:16.222456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255434363202528:7890]
2025-10-01T14:10:16.222487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:16.222490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:16.222492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.222494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:16.222497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:16.222500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:16.222604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:16.281634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255436740079472:8859]
2025-10-01T14:10:16.281915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1035, pipe: [1:7556255436740079472:8859]
2025-10-01T14:10:16.356253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:16.362622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.362640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.362767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.362818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.362870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.362923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.362963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.362970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.363026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.363079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.363135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.363188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.363227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.363232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.363291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.363341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.363395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.363448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.363485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.363493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.363548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.363601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.363655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.363721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.363764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.363769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.363824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.363876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.363930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.363983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.364022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.364027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.364081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.364131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.364188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.364245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.364282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.364288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.364346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.364393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.364448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.364501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.364539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.364543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.364598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.364648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.364700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.364765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.364820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.364824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.364876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.364925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.364980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.365034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.365076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.365081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.365135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.365185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.365238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.365298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.365342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.365347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.365383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079472:8859], now have 1 active actors on pipe
2025-10-01T14:10:16.365599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255436740079472:8859]
2025-10-01T14:10:16.365622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:16.365625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:16.365626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:16.365651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1036 reason: error at write: Disconnected sessionId: src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0
2025-10-01T14:10:16.365820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1036 sessionId: src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0 is DEAD
2025-10-01T14:10:16.365964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:16.365973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0] Write session will restart in 0.006088s
2025-10-01T14:10:16.365992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0] Write session: Do CDS request
2025-10-01T14:10:16.365997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:16.366083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:16.372836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.372917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:16.372931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1037
2025-10-01T14:10:16.373017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.373038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:16.373045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:16.373047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:16.373292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:16.373348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1037 sessionId:  describe result for acl check
2025-10-01T14:10:16.373370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:16.373375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:16.373376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:16.373379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255436740079585:9068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:16.373715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255436740079585:9068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:16.375224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255436740079585:9068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:16.375672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:16.375805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:16.375813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:16.375820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:16.375849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:16.375876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255434363202655:7894]
2025-10-01T14:10:16.376225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:16.376417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:16.376441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:16.376621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:16.376651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.376655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.376656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.376656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.376657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.376658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.376658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.376659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.376660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.376660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.376661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.376661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.376662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.376662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.376665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.376670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.376673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.376675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.376677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.376678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.376680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.376682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.376685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.376687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.376689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.376690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.376692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.376694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.376698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.376702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.376706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.376709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.376713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.376715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.376718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.376720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.376731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.376734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.376736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.376739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.376741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.376744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.376750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.376753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.376756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.376758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.376764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.376767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.376769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.376771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.376776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.376779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.376781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.376784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.376786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.376789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.376811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:16.377635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255436740079585:9068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:16.377648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255436740079585:9068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:16.377651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255436740079585:9068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:16.377657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:16.380020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:16.380556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:16.380566Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:16.380567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:16.380569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:16.380574Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1036 [2:7556255434363202655:7894]
2025-10-01T14:10:16.380583Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:16.380594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:16.380595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.380598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.380599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.380609Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:16.380615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:16.380620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:16.380655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.380660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.380661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.380663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:16.380664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:16.380706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:16.380711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.380717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.380732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.380745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:16.380761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079509:2446], now have 1 active actors on pipe
2025-10-01T14:10:16.380767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079622:9068], now have 1 active actors on pipe
2025-10-01T14:10:16.380771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255434363202650:7894]
2025-10-01T14:10:16.380773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255434363202650:7894]
2025-10-01T14:10:16.380774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255434363202650:7894]
2025-10-01T14:10:16.380782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:16.380793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:16.380794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:16.380796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:16.380797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:16.380804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:16.380805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:16.380794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1036
2025-10-01T14:10:16.380799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1036
2025-10-01T14:10:16.380824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255434363202650:7894]
2025-10-01T14:10:16.380830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:16.380833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:16.380840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.380845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.380873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:16.380881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.380887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.380888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:16.380893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.380899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:16.380913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.381010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.381015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.381024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.381083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1037 partition: 0 MaxSeqNo: 45 sessionId: src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0
2025-10-01T14:10:16.381368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d45aca8-44d05149-3e4357bf-6bd2c376_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:16.383826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0] Write session: try to update token
2025-10-01T14:10:16.383840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:16.396022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1037 sessionId: src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:16.398040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:16.399342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.399363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.399379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:16.399382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:16.399383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:16.399384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:16.399392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255434363202650:7894]
2025-10-01T14:10:16.399395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255434363202650:7894]
2025-10-01T14:10:16.399397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255434363202650:7894]
2025-10-01T14:10:16.399425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:16.399433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:16.399436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:16.399448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:16.399453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.399458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:16.399573Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:16.465901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255436740079630:8859]
2025-10-01T14:10:16.466160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1036, pipe: [1:7556255436740079630:8859]
2025-10-01T14:10:16.532228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:16.532685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:16.532739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079630:8859], now have 1 active actors on pipe
2025-10-01T14:10:16.532818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:16.532913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:16.532973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255436740079630:8859]
2025-10-01T14:10:16.541426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:16.542832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:16.542848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:16.542870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1037 reason: error at write: Disconnected sessionId: src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0
2025-10-01T14:10:16.543038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1037 sessionId: src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0 is DEAD
2025-10-01T14:10:16.543140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:16.543148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0] Write session will restart in 0.005485s
2025-10-01T14:10:16.543167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0] Write session: Do CDS request
2025-10-01T14:10:16.543172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:16.546252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:16.546421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:16.546428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:16.546436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:16.546473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:16.546507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255434363202804:7907]
2025-10-01T14:10:16.546909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:16.547116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:16.547148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:16.547339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:16.547373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.547377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.547378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.547379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.547380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.547380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.547381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.547382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.547382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.547383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.547384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.547384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.547385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.547385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.547388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.547394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.547396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.547398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.547400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.547402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.547404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.547406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.547408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.547411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.547413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.547415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.547417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.547419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.547424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.547428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.547431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.547435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.547437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.547440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.547442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.547446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.547448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.547451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.547453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.547456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.547459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.547465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.547467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.547470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.547472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.547478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.547480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.547483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.547490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.547493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.547495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.547502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.547504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.547507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.547509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.547511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.547534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:16.550843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.550962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:16.550987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1038
2025-10-01T14:10:16.551076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.551100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:16.551103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:16.551111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:16.551133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:16.551657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1038 sessionId:  describe result for acl check
2025-10-01T14:10:16.551679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:16.551680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:16.551681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:16.551684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255436740079717:9072] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:16.551916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:16.551926Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:16.551927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:16.551929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:16.551934Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1037 [2:7556255434363202804:7907]
2025-10-01T14:10:16.551944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:16.551955Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:16.551961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.551963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.551965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.551975Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:16.551981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:16.551985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:16.552032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.552038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.552040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.552043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:16.552046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:16.552042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255436740079717:9072] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:16.552094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:16.552099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.552107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.552116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.552128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:16.552144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255434363202798:7907]
2025-10-01T14:10:16.552149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255434363202798:7907]
2025-10-01T14:10:16.552150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255434363202798:7907]
2025-10-01T14:10:16.552156Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:16.552166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079634:2446], now have 1 active actors on pipe
2025-10-01T14:10:16.552166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:16.552169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:16.552170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:16.552172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:16.552182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:16.552184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:16.552206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255434363202798:7907]
2025-10-01T14:10:16.552216Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:16.552209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1037
2025-10-01T14:10:16.552239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:16.553829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255436740079717:9072] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:16.558549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255436740079717:9072] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:16.558566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255436740079717:9072] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:16.558570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255436740079717:9072] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:16.558578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:16.558835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079752:9072], now have 1 active actors on pipe
2025-10-01T14:10:16.558940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1037
2025-10-01T14:10:16.559277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.559292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.559318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af1dff32-ff130aee-942889d2-9d474ccd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:16.559334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.559345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.559352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:16.559365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.559385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:16.559411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.559544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.559551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.559564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.559637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1038 partition: 0 MaxSeqNo: 45 sessionId: src_id|af1dff32-ff130aee-942889d2-9d474ccd_0
2025-10-01T14:10:16.559969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6fcf455-86e0bcee-bbf3541-7354fac5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|af1dff32-ff130aee-942889d2-9d474ccd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:16.562326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:16.562345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:16.562353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255434363202798:7907]
2025-10-01T14:10:16.562399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:16.562410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:16.562514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af1dff32-ff130aee-942889d2-9d474ccd_0] Write session: try to update token
2025-10-01T14:10:16.562527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af1dff32-ff130aee-942889d2-9d474ccd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:16.562560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:16.562690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:16.562821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:16.562948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:16.563121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:16.563155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:16.576225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1038 sessionId: src_id|af1dff32-ff130aee-942889d2-9d474ccd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:16.578424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:16.578605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.578626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.578663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:16.578741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:16.580860Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:16.580873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:16.580875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:16.580876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:16.580885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255434363202798:7907]
2025-10-01T14:10:16.580888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255434363202798:7907]
2025-10-01T14:10:16.580890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255434363202798:7907]
2025-10-01T14:10:16.580929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:16.580937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.580938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:16.580952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:16.580967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:16.580971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:16.581052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:16.633359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255436740079756:8859]
2025-10-01T14:10:16.633568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1037, pipe: [1:7556255436740079756:8859]
2025-10-01T14:10:16.720280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:16.728240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.728270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.728431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.728485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.728538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.728599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.728645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.728655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.728717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.728787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.728840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.728901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.728952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.728960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.729019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.729075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.729138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.729197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.729244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.729255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.729320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.729374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.729423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.729472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.729510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.729515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.729566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.729615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.729663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.729711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.729749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.729754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.729809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.729860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.729915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.729970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.730009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.730014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.730068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.730118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.730172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.730224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.730267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.730273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.730327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.730399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.730454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.730504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.730546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.730551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.730608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.730659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.730710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.730764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.730802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.730806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.730860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.730909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.730958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.731008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.731044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.731049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.731097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079756:8859], now have 1 active actors on pipe
2025-10-01T14:10:16.731292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:16.731317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:16.731320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:16.731340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255436740079756:8859]
2025-10-01T14:10:16.731347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1038 reason: error at write: Disconnected sessionId: src_id|af1dff32-ff130aee-942889d2-9d474ccd_0
2025-10-01T14:10:16.731566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1038 sessionId: src_id|af1dff32-ff130aee-942889d2-9d474ccd_0 is DEAD
2025-10-01T14:10:16.731667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af1dff32-ff130aee-942889d2-9d474ccd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:16.731674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af1dff32-ff130aee-942889d2-9d474ccd_0] Write session will restart in 0.006609s
2025-10-01T14:10:16.731705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af1dff32-ff130aee-942889d2-9d474ccd_0] Write session: Do CDS request
2025-10-01T14:10:16.731710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af1dff32-ff130aee-942889d2-9d474ccd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:16.731786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:16.738891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:16.739822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af1dff32-ff130aee-942889d2-9d474ccd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.739896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:16.739910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1039
2025-10-01T14:10:16.740002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.740025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:16.740032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:16.740035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:16.740346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1039 sessionId:  describe result for acl check
2025-10-01T14:10:16.740368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:16.740374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:16.740375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:16.740378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255436740079839:9077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:16.740750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255436740079839:9077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:16.740757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:16.740880Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:16.740888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:16.740895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:16.740922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:16.740947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255434363202932:7910]
2025-10-01T14:10:16.741305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:16.741513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:16.741546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:16.741766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:16.741801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.741806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.741806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.741807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.741807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.741808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.741808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.741809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.741810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.741810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.741811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.741811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.741812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.741813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.741816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.741821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.741823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.741825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.741827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.741829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.741831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.741833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.741835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.741837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.741839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.741841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.741843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.741845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.741849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.741853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.741856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.741859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.741861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.741864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.741867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.741869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.741872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.741874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.741877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.741880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.741882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.741885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.741887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.741890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.741892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.741895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.741897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.741901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.741908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.741911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.741917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.741920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.741922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.741925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.741927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.741935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.741966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:16.742965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255436740079839:9077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:16.745270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:16.745605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255436740079839:9077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:16.745620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255436740079839:9077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:16.745624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255436740079839:9077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:16.745631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:16.745844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:16.745852Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:16.745853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:16.745856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:16.745861Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1038 [2:7556255434363202932:7910]
2025-10-01T14:10:16.745871Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:16.745883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:16.745884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.745887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.745889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.745900Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:16.745903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:16.745907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:16.745941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.745947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.745948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.745950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:16.745952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:16.746007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:16.746012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.746018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.746024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.746032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:16.746048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079760:2446], now have 1 active actors on pipe
2025-10-01T14:10:16.746053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079878:9077], now have 1 active actors on pipe
2025-10-01T14:10:16.746058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255434363202927:7910]
2025-10-01T14:10:16.746059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255434363202927:7910]
2025-10-01T14:10:16.746060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255434363202927:7910]
2025-10-01T14:10:16.746055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1038
2025-10-01T14:10:16.746072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:16.746078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1038
2025-10-01T14:10:16.746085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:16.746089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:16.746090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:16.746092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:16.746093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:16.746095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:16.746114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255434363202927:7910]
2025-10-01T14:10:16.746119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:16.746120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:16.746131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.746137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.746170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbb00063-4690bc2b-3170f545-eec34d72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:16.746177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.746180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.746182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:16.746188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.746194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:16.746206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.746296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.746302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.746312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.746403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1039 partition: 0 MaxSeqNo: 45 sessionId: src_id|bbb00063-4690bc2b-3170f545-eec34d72_0
2025-10-01T14:10:16.746734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af1dff32-ff130aee-942889d2-9d474ccd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bbb00063-4690bc2b-3170f545-eec34d72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:16.749004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb00063-4690bc2b-3170f545-eec34d72_0] Write session: try to update token
2025-10-01T14:10:16.749017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb00063-4690bc2b-3170f545-eec34d72_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:16.761293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1039 sessionId: src_id|bbb00063-4690bc2b-3170f545-eec34d72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:16.763428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:16.763549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.763565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.763591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:16.763645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:16.765754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:16.765769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:16.765771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:16.765773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:16.765783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255434363202927:7910]
2025-10-01T14:10:16.765787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255434363202927:7910]
2025-10-01T14:10:16.765790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255434363202927:7910]
2025-10-01T14:10:16.765819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:16.765828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:16.765830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:16.765831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:16.765834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.765836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:16.765948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:16.831526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255436740079899:8859]
2025-10-01T14:10:16.831812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1038, pipe: [1:7556255436740079899:8859]
2025-10-01T14:10:16.898247Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:16.904664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.904684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.904825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.904872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.904922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.904970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.905268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.905277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.905330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.905380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.905432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.905482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.905530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.905538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.905590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.905634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.905681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.905726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.905761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.905765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.905815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.905861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.905925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.905972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.906007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.906011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.906061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.906105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.906148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.906194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.906234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.906238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.906286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.906331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.906397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.906461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.906499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.906503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.906551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.906608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.906666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.906716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.906753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.906758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.906808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.906866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.906914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.906972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.907010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.907016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.907069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.907117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.907165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.907216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.907251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.907257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.907308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:16.907359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:16.907408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:16.907458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:16.907503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:16.907507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:16.907542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079899:8859], now have 1 active actors on pipe
2025-10-01T14:10:16.907875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:16.907884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255436740079899:8859]
2025-10-01T14:10:16.907890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:16.907903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:16.907914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1039 reason: error at write: Disconnected sessionId: src_id|bbb00063-4690bc2b-3170f545-eec34d72_0
2025-10-01T14:10:16.907976Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:16.908110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1039 sessionId: src_id|bbb00063-4690bc2b-3170f545-eec34d72_0 is DEAD
2025-10-01T14:10:16.908227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb00063-4690bc2b-3170f545-eec34d72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:16.908233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb00063-4690bc2b-3170f545-eec34d72_0] Write session will restart in 0.009380s
2025-10-01T14:10:16.908250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb00063-4690bc2b-3170f545-eec34d72_0] Write session: Do CDS request
2025-10-01T14:10:16.908255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb00063-4690bc2b-3170f545-eec34d72_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:16.914972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:16.915230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:16.915340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:16.915347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:16.915354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:16.915379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:16.915405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255434363203052:7913]
2025-10-01T14:10:16.915797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:16.917127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:16.917155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:16.917347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:16.917379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.917383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.917384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.917384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.917385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.917386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.917387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.917387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.917388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.917388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.917389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.917389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.917390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.917390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.917393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.917399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.917401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.917403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.917405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.917407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.917408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.917410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.917412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.917414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.917416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.917418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.917420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.917422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.917427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.917431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:16.917435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.917438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:16.917440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.917443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:16.917445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.917448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:16.917451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.917455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:16.917457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.917460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:16.917462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.917465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:16.917469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.917473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:16.917481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.917486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:16.917493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.917498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.917503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.917508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.917510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.917512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.917515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.917517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:16.917520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.917523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:16.917543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:16.918790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb00063-4690bc2b-3170f545-eec34d72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.918862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:16.918877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1040
2025-10-01T14:10:16.918975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:16.918999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:16.919005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:16.919009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:16.919327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1040 sessionId:  describe result for acl check
2025-10-01T14:10:16.919365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:16.919371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:16.919373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:16.919377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255436740079985:9082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:16.919896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255436740079985:9082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:16.920628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:16.921159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:16.921170Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:16.921172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:16.921174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:16.921178Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1039 [2:7556255434363203052:7913]
2025-10-01T14:10:16.921187Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:16.921196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:16.921202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.921205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.921206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.921215Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:16.921219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:16.921223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:16.921254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.921258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.921260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.921261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:16.921265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:16.921306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:16.921311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.921318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:16.921323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:16.921331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:16.921346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740079900:2446], now have 1 active actors on pipe
2025-10-01T14:10:16.921354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255434363203047:7913]
2025-10-01T14:10:16.921355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255434363203047:7913]
2025-10-01T14:10:16.921356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255434363203047:7913]
2025-10-01T14:10:16.921364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:16.921372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:16.921377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:16.921368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1039
2025-10-01T14:10:16.921379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:16.921380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:16.921382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:16.921384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:16.921400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255434363203047:7913]
2025-10-01T14:10:16.921406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:16.921410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:16.921881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255436740079985:9082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:16.926744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255436740079985:9082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:16.926757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255436740079985:9082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:16.926760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255436740079985:9082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:16.926767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:16.926919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255436740080024:9082], now have 1 active actors on pipe
2025-10-01T14:10:16.926947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1039
2025-10-01T14:10:16.926988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.926997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.927022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd62361f-50e3ab41-55a96438-2776537_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:16.927035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:16.927041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:16.927043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:16.927053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:16.927065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:16.927086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.927190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:16.927195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:16.927207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:16.927256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1040 partition: 0 MaxSeqNo: 45 sessionId: src_id|fd62361f-50e3ab41-55a96438-2776537_0
2025-10-01T14:10:16.927512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbb00063-4690bc2b-3170f545-eec34d72_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fd62361f-50e3ab41-55a96438-2776537_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:16.929609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62361f-50e3ab41-55a96438-2776537_0] Write session: try to update token
2025-10-01T14:10:16.929619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62361f-50e3ab41-55a96438-2776537_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:16.940264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:16.940283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:16.940286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:16.940288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:16.940301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255434363203047:7913]
2025-10-01T14:10:16.940306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255434363203047:7913]
2025-10-01T14:10:16.940310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255434363203047:7913]
2025-10-01T14:10:16.940356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:16.940359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:16.940366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:16.940368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:16.940368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:16.940372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:16.940503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:16.941339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1040 sessionId: src_id|fd62361f-50e3ab41-55a96438-2776537_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:16.943449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:17.008209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255441035047324:8859]
2025-10-01T14:10:17.008466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1039, pipe: [1:7556255441035047324:8859]
2025-10-01T14:10:17.073901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:17.074495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.074509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.074542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047324:8859], now have 1 active actors on pipe
2025-10-01T14:10:17.074695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:17.074774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255441035047324:8859]
2025-10-01T14:10:17.074784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:17.074805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:17.074859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1040 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fd62361f-50e3ab41-55a96438-2776537_0
2025-10-01T14:10:17.075057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1040 sessionId: src_id|fd62361f-50e3ab41-55a96438-2776537_0 is DEAD
2025-10-01T14:10:17.075352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62361f-50e3ab41-55a96438-2776537_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:17.075361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62361f-50e3ab41-55a96438-2776537_0] Write session will restart in 0.009592s
2025-10-01T14:10:17.075380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62361f-50e3ab41-55a96438-2776537_0] Write session: Do CDS request
2025-10-01T14:10:17.075384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62361f-50e3ab41-55a96438-2776537_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:17.082382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:17.084234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:17.084365Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:17.084372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:17.084380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:17.084408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:17.084434Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255438658170467:7915]
2025-10-01T14:10:17.084805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:17.084971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:17.085003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:17.085187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:17.085220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.085224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.085224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.085225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.085226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.085226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.085227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.085228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.085228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.085229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.085229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.085230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.085231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.085231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.085234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.085240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.085242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.085244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.085246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.085248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.085250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.085251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.085253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.085256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.085258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.085260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.085261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.085264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.085268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.085273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.085276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.085279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.085281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.085284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.085286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.085289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.085291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.085294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.085296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.085299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.085302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.085304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.085306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.085309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.085311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.085314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.085316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.085319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.085322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.085324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.085326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.085329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.085335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.085337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.085339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.085342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.085361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:17.085789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62361f-50e3ab41-55a96438-2776537_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.085882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:17.085897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1041
2025-10-01T14:10:17.085982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.086002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:17.086005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:17.086008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:17.086266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1041 sessionId:  describe result for acl check
2025-10-01T14:10:17.086293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:17.086297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:17.086299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:17.086301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255441035047413:9088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:17.086782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255441035047413:9088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:17.088561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255441035047413:9088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:17.088616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:17.089160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:17.089172Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:17.089173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:17.089175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:17.089180Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1040 [2:7556255438658170467:7915]
2025-10-01T14:10:17.089189Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:17.089205Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:17.089212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.089215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.089217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.089232Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:17.089239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:17.089243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:17.089281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.089286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.089287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.089289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:17.089291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:17.089334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:17.089338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.089345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.089350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.089361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:17.089376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047328:2446], now have 1 active actors on pipe
2025-10-01T14:10:17.089384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255438658170462:7915]
2025-10-01T14:10:17.089387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255438658170462:7915]
2025-10-01T14:10:17.089389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255438658170462:7915]
2025-10-01T14:10:17.089398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:17.089410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:17.089410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:17.089413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:17.089414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:17.089420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:17.089422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:17.089407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1040
2025-10-01T14:10:17.089439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255438658170462:7915]
2025-10-01T14:10:17.089444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:17.089446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:17.093840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255441035047413:9088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:17.093852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255441035047413:9088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:17.093855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255441035047413:9088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:17.093861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:17.094035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047453:9088], now have 1 active actors on pipe
2025-10-01T14:10:17.094056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1040
2025-10-01T14:10:17.094121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.094131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.094152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:17.094159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.094164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.094165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:17.094174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.094185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:17.094196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.094330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.094335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.094344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.094402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1041 partition: 0 MaxSeqNo: 45 sessionId: src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0
2025-10-01T14:10:17.094678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd62361f-50e3ab41-55a96438-2776537_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:17.096779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0] Write session: try to update token
2025-10-01T14:10:17.096792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:17.099467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:17.099489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:17.099499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255438658170462:7915]
2025-10-01T14:10:17.099540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:17.099548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:17.099787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:17.099998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:17.100186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:17.100373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:17.100624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:17.100676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:17.108850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1041 sessionId: src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:17.110893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:17.111167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.111184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.111213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:17.111278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:17.117958Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:17.117973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:17.117974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:17.117975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:17.117983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255438658170462:7915]
2025-10-01T14:10:17.117985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255438658170462:7915]
2025-10-01T14:10:17.117988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255438658170462:7915]
2025-10-01T14:10:17.118022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:17.118027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.118028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:17.118031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:17.118035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:17.118037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:17.118137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:17.175064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255441035047457:8859]
2025-10-01T14:10:17.175278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1040, pipe: [1:7556255441035047457:8859]
2025-10-01T14:10:17.250547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:17.257045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.257064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.257191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.257241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.257292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.257341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.257384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.257391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.257444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.257495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.257549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.257603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.257645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.257650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.257705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.257756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.257809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.257865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.257903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.257911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.257971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.258024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.258077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.258130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.258168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.258173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.258230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.258282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.258333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.258405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.258448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.258450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.258520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.258584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.258647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.258710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.258752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.258760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.258825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.258885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.258947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.259008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.259050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.259062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.259129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.259190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.259256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.259317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.259360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.259367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.259432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.259495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.259556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.259617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.259661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.259668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.259737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.259797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.259858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.259919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.259963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.259970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.260018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047457:8859], now have 1 active actors on pipe
2025-10-01T14:10:17.260244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255441035047457:8859]
2025-10-01T14:10:17.260250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:17.260253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:17.260271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:17.260279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1041 reason: error at write: Disconnected sessionId: src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0
2025-10-01T14:10:17.260436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1041 sessionId: src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0 is DEAD
2025-10-01T14:10:17.260600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:17.260611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0] Write session will restart in 0.007658s
2025-10-01T14:10:17.260634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0] Write session: Do CDS request
2025-10-01T14:10:17.260640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:17.261276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:17.269808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.269877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:17.269890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1042
2025-10-01T14:10:17.270031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.270054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:17.270057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:17.270060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:17.270222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:17.270348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1042 sessionId:  describe result for acl check
2025-10-01T14:10:17.270392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:17.270398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:17.270399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:17.270402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255441035047541:9092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:17.270545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:17.270686Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:17.270694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:17.270701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:17.270731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:17.270756Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255438658170588:7917]
2025-10-01T14:10:17.270825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255441035047541:9092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:17.271124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:17.271283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:17.271307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:17.271497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:17.271534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.271538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.271539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.271539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.271540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.271541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.271541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.271542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.271543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.271543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.271544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.271545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.271545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.271546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.271549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.271554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.271557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.271559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.271561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.271563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.271565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.271567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.271569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.271571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.271573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.271575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.271577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.271579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.271583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.271587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.271591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.271593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.271596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.271599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.271609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.271615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.271618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.271621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.271623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.271626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.271629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.271632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.271637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.271640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.271643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.271649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.271651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.271654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.271657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.271664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.271666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.271669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.271672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.271674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.271679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.271682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.271701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:17.272643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255441035047541:9092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:17.274913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255441035047541:9092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:17.274925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255441035047541:9092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:17.274927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255441035047541:9092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:17.274932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:17.274942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:17.275517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:17.275526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:17.275528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:17.275530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:17.275535Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1041 [2:7556255438658170588:7917]
2025-10-01T14:10:17.275544Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:17.275555Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:17.275557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.275560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.275561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.275571Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:17.275578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:17.275583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:17.275624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.275629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.275630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.275632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:17.275633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:17.275677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:17.275684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.275692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.275698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.275707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:17.275720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047459:2446], now have 1 active actors on pipe
2025-10-01T14:10:17.275725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047580:9092], now have 1 active actors on pipe
2025-10-01T14:10:17.275730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255438658170583:7917]
2025-10-01T14:10:17.275732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255438658170583:7917]
2025-10-01T14:10:17.275733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255438658170583:7917]
2025-10-01T14:10:17.275741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:17.275754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:17.275755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:17.275763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:17.275763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:17.275765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:17.275765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:17.275783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255438658170583:7917]
2025-10-01T14:10:17.275788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:17.275791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:17.275770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1041
2025-10-01T14:10:17.275774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1041
2025-10-01T14:10:17.275808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.275814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.275835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:17.275843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.275845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.275849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:17.275856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.275862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:17.275876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.275983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.275987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.275996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.276071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1042 partition: 0 MaxSeqNo: 45 sessionId: src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0
2025-10-01T14:10:17.276356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79131c18-4c9615ab-57599f08-8bdb6db2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:17.278721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0] Write session: try to update token
2025-10-01T14:10:17.278738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:17.294365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1042 sessionId: src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:17.295185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:17.295202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:17.295204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:17.295205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:17.295212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255438658170583:7917]
2025-10-01T14:10:17.295215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255438658170583:7917]
2025-10-01T14:10:17.295221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255438658170583:7917]
2025-10-01T14:10:17.295260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:17.295262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:17.295267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:17.295269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.295270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:17.295271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:17.295404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:17.297026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:17.360403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255441035047604:8859]
2025-10-01T14:10:17.360679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1041, pipe: [1:7556255441035047604:8859]
2025-10-01T14:10:17.430684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:17.431155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.431170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.431209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047604:8859], now have 1 active actors on pipe
2025-10-01T14:10:17.431399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:17.431384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:17.431398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:17.431402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:17.431437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255441035047604:8859]
2025-10-01T14:10:17.431446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1042 reason: error at write: Disconnected sessionId: src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0
2025-10-01T14:10:17.431646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1042 sessionId: src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0 is DEAD
2025-10-01T14:10:17.431760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:17.431774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0] Write session will restart in 0.009387s
2025-10-01T14:10:17.431803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0] Write session: Do CDS request
2025-10-01T14:10:17.431811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:17.438302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:17.440270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:17.440409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:17.440417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:17.440424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:17.440454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:17.440479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255438658170718:7922]
2025-10-01T14:10:17.440856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:17.441024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:17.441049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:17.441224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:17.441254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.441258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.441259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.441259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.441260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.441261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.441261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.441262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.441262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.441263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.441263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.441264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.441264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.441265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.441268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.441275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.441279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.441282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.441285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.441289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.441292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.441295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.441298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.441301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.441304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.441306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.441309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.441313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.441319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.441330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.441339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.441348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.441356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.441365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.441370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.441373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.441379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.441382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.441384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.441387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.441392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.441395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.441398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.441403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.441406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.441409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.441414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.441417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.441420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.441422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.441424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.441428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.441434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.441436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.441439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.441441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.441469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:17.441898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.441956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:17.441968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1043
2025-10-01T14:10:17.442118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.442139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:17.442146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:17.442149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:17.442461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1043 sessionId:  describe result for acl check
2025-10-01T14:10:17.442490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:17.442495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:17.442496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:17.442499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255441035047709:9104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:17.442872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255441035047709:9104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:17.444219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255441035047709:9104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:17.444961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:17.445493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:17.445503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:17.445504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:17.445507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:17.445512Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1042 [2:7556255438658170718:7922]
2025-10-01T14:10:17.445521Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:17.445536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:17.445541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.445543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.445545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.445556Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:17.445562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:17.445567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:17.445611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.445616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.445617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.445619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:17.445621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:17.445678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:17.445683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.445689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.445695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.445708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:17.445725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047621:2446], now have 1 active actors on pipe
2025-10-01T14:10:17.445731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255438658170713:7922]
2025-10-01T14:10:17.445732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255438658170713:7922]
2025-10-01T14:10:17.445733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255438658170713:7922]
2025-10-01T14:10:17.445743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:17.445755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:17.445758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:17.445761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:17.445763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:17.445766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:17.445749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1042
2025-10-01T14:10:17.445768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:17.445784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255438658170713:7922]
2025-10-01T14:10:17.445789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:17.445791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:17.446733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255441035047709:9104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:17.446747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255441035047709:9104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:17.446750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255441035047709:9104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:17.446758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:17.446919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047748:9104], now have 1 active actors on pipe
2025-10-01T14:10:17.446939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1042
2025-10-01T14:10:17.446983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.446990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.447009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:17.447017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.447023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.447025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:17.447030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.447037Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:17.447051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.447146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.447153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.447163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.447214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1043 partition: 0 MaxSeqNo: 45 sessionId: src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0
2025-10-01T14:10:17.447495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e406e7e-d81e0c4d-885375ea-3daca46e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:17.450212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0] Write session: try to update token
2025-10-01T14:10:17.450226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:17.455984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:17.456001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:17.456007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255438658170713:7922]
2025-10-01T14:10:17.456039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:17.456041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:17.456183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:17.456308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:17.456424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:17.456538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:17.456693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:17.456736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:17.464172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1043 sessionId: src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:17.466244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:17.466444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.466468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.466508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:17.466585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:17.474257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:17.474276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:17.474277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:17.474279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:17.474287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255438658170713:7922]
2025-10-01T14:10:17.474291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255438658170713:7922]
2025-10-01T14:10:17.474296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255438658170713:7922]
2025-10-01T14:10:17.474332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:17.474340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.474339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:17.474341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:17.474343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:17.474345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:17.474489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:17.531414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255441035047752:8859]
2025-10-01T14:10:17.531632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1042, pipe: [1:7556255441035047752:8859]
2025-10-01T14:10:17.608198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:17.614625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.614646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.614776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.614826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.614883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.614935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.614981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.614990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.615045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.615097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.615151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.615204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.615243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.615249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.615307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.615360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.615413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.615467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.615508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.615513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.615570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.615625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.615679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.615741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.615782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.615788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.615846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.615899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.615953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.616006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.616044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.616049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.616105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.616157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.616211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.616266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.616305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.616309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.616366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.616427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.616501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.616557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.616598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.616603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.616661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.616716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.616786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.616846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.616893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.616899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.616963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.617026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.617088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.617144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.617183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.617188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.617246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.617307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.617368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.617427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.617471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.617476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.617516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047752:8859], now have 1 active actors on pipe
2025-10-01T14:10:17.617736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:17.617762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:17.617767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:17.617795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1043 reason: error at write: Disconnected sessionId: src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0
2025-10-01T14:10:17.617800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255441035047752:8859]
2025-10-01T14:10:17.617976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1043 sessionId: src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0 is DEAD
2025-10-01T14:10:17.618086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:17.618095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0] Write session will restart in 0.008734s
2025-10-01T14:10:17.618113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0] Write session: Do CDS request
2025-10-01T14:10:17.618118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:17.618471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:17.626467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:17.627803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.627887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:17.627902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1044
2025-10-01T14:10:17.628033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.628067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:17.628074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:17.628077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:17.628412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:17.628508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1044 sessionId:  describe result for acl check
2025-10-01T14:10:17.628532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:17.628539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:17.628546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:17.628535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:17.628541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:17.628542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:17.628545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255441035047838:9108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:17.628583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:17.628616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255438658170870:7934]
2025-10-01T14:10:17.628903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255441035047838:9108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:17.629121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:17.629365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:17.629403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:17.629651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:17.629705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.629710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.629711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.629713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.629713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.629714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.629715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.629716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.629716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.629717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.629718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.629719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.629720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.629721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.629725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.629733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.629737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.629740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.629743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.629746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.629749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.629752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.629754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.629758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.629760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.629763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.629766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.629769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.629773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.629779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.629784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.629791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.629794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.629798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.629801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.629807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.629810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.629814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.629819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.629823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.629832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.629836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.629839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.629845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.629848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.629852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.629859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.629864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.629869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.629876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.629879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.629883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.629889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.629892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.629895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.629899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.629931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:17.630700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255441035047838:9108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:17.632838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255441035047838:9108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:17.632850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255441035047838:9108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:17.632853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255441035047838:9108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:17.632859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:17.633138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:17.633743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:17.633752Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:17.633753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:17.633756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:17.633760Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1043 [2:7556255438658170870:7934]
2025-10-01T14:10:17.633768Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:17.633779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:17.633781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.633783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.633784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.633793Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:17.633799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:17.633804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:17.633837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.633841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.633842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.633844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:17.633846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:17.633888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:17.633893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.633899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.633904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.633912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:17.633923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255438658170865:7934]
2025-10-01T14:10:17.633927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255438658170865:7934]
2025-10-01T14:10:17.633928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255438658170865:7934]
2025-10-01T14:10:17.633933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:17.633941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:17.633942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:17.633945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:17.633946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:17.633948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:17.633950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:17.633956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047878:9108], now have 1 active actors on pipe
2025-10-01T14:10:17.633976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047754:2446], now have 1 active actors on pipe
2025-10-01T14:10:17.633982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255438658170865:7934]
2025-10-01T14:10:17.633988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:17.633997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1043
2025-10-01T14:10:17.634002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:17.634014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1043
2025-10-01T14:10:17.634037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.634044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.634067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec023a72-87902e49-2847b3a-2df774c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:17.634074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.634077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.634078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:17.634084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.634091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:17.634101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.634257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.634262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.634271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.634333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1044 partition: 0 MaxSeqNo: 45 sessionId: src_id|ec023a72-87902e49-2847b3a-2df774c8_0
2025-10-01T14:10:17.634595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84c6e6b6-344f681b-8d0cb53d-df785de1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ec023a72-87902e49-2847b3a-2df774c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:17.637595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec023a72-87902e49-2847b3a-2df774c8_0] Write session: try to update token
2025-10-01T14:10:17.637615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec023a72-87902e49-2847b3a-2df774c8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:17.643723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:17.643739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:17.643746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255438658170865:7934]
2025-10-01T14:10:17.643780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:17.643811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:17.643914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:17.644023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:17.644132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:17.644242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:17.644405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:17.644432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:17.650925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1044 sessionId: src_id|ec023a72-87902e49-2847b3a-2df774c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:17.653010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:17.653195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.653210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.653235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:17.653315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:17.661714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:17.661733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:17.661735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:17.661737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:17.661747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255438658170865:7934]
2025-10-01T14:10:17.661751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255438658170865:7934]
2025-10-01T14:10:17.661754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255438658170865:7934]
2025-10-01T14:10:17.661795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:17.661807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.661809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:17.661821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:17.661837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:17.661842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:17.661932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:17.717804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255441035047885:8859]
2025-10-01T14:10:17.718094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1043, pipe: [1:7556255441035047885:8859]
2025-10-01T14:10:17.795362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:17.802195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.802219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.802352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.802415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.802466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.802517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.802558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.802565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.802617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.802669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.802718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.802768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.802807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.802813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.802871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.802921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.802976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.803029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.803069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.803074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.803128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.803181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.803236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.803301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.803349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.803355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.803414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.803463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.803515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.803567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.803608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.803613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.803668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.803718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.803770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.803823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.803860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.803865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.804038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.804087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.804140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.804192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.804231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.804236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.804294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.804345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.804398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.804450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.804491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.804496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.804551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.804600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.804652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.804705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.804755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.804760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.804813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.804863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.804916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.804971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.805009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.805014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.805051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047885:8859], now have 1 active actors on pipe
2025-10-01T14:10:17.805305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255441035047885:8859]
2025-10-01T14:10:17.805308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:17.805468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:17.805478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:17.805500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1044 reason: error at write: Disconnected sessionId: src_id|ec023a72-87902e49-2847b3a-2df774c8_0
2025-10-01T14:10:17.805697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1044 sessionId: src_id|ec023a72-87902e49-2847b3a-2df774c8_0 is DEAD
2025-10-01T14:10:17.805807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec023a72-87902e49-2847b3a-2df774c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:17.805816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec023a72-87902e49-2847b3a-2df774c8_0] Write session will restart in 0.006512s
2025-10-01T14:10:17.805835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec023a72-87902e49-2847b3a-2df774c8_0] Write session: Do CDS request
2025-10-01T14:10:17.805839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec023a72-87902e49-2847b3a-2df774c8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:17.806004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:17.813110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:17.813342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:17.813458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:17.813465Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:17.813472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:17.813500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:17.813524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255438658171005:7937]
2025-10-01T14:10:17.813833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec023a72-87902e49-2847b3a-2df774c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.813875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:17.813934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:17.813949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1045
2025-10-01T14:10:17.814069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.814088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:17.814095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:17.814097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:17.814380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1045 sessionId:  describe result for acl check
2025-10-01T14:10:17.814410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:17.814411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:17.814412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:17.814415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255441035047987:9114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:17.814785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255441035047987:9114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:17.815704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:17.815753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:17.816012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:17.816066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.816071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.816072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.816073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.816073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.816074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.816075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.816076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.816077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.816077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.816078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.816079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.816080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.816081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.816085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.816092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.816095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.816098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.816101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.816104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.816107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.816110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.816112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.816115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.816118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.816121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.816123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.816126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.816132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.816138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.816143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.816147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.816150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.816155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.816162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.816167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.816170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.816174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.816177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.816181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.816185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.816189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.816192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.816195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.816199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.816202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.816205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.816209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.816212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.816216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.816220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.816224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.816227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.816231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.816234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.816239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.816273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:17.816570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255441035047987:9114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:17.819294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255441035047987:9114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:17.819305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255441035047987:9114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:17.819307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255441035047987:9114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:17.819312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:17.819599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:17.820127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:17.820137Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:17.820138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:17.820140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:17.820145Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1044 [2:7556255438658171005:7937]
2025-10-01T14:10:17.820154Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:17.820168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:17.820173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.820175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.820176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.820187Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:17.820193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:17.820197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:17.820233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.820238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.820239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.820240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:17.820242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:17.820284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:17.820288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.820295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.820300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.820311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:17.820324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255438658171000:7937]
2025-10-01T14:10:17.820325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255438658171000:7937]
2025-10-01T14:10:17.820327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255438658171000:7937]
2025-10-01T14:10:17.820332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:17.820344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:17.820347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:17.820350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:17.820351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:17.820356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:17.820358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:17.820370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035047902:2446], now have 1 active actors on pipe
2025-10-01T14:10:17.820377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035048026:9114], now have 1 active actors on pipe
2025-10-01T14:10:17.820393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255438658171000:7937]
2025-10-01T14:10:17.820405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:17.820399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1044
2025-10-01T14:10:17.820406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1044
2025-10-01T14:10:17.820422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:17.820450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.820456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.820472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3813208c-6578ee89-8762d3d7-2063860a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:17.820479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:17.820482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:17.820486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:17.820492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:17.820500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:17.820512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.820643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.820648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.820656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:17.820733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1045 partition: 0 MaxSeqNo: 45 sessionId: src_id|3813208c-6578ee89-8762d3d7-2063860a_0
2025-10-01T14:10:17.820956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec023a72-87902e49-2847b3a-2df774c8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3813208c-6578ee89-8762d3d7-2063860a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:17.823176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3813208c-6578ee89-8762d3d7-2063860a_0] Write session: try to update token
2025-10-01T14:10:17.823190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3813208c-6578ee89-8762d3d7-2063860a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:17.834954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1045 sessionId: src_id|3813208c-6578ee89-8762d3d7-2063860a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:17.837039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:17.837551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.837571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.839223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:17.839250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:17.839252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:17.839254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:17.839256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:17.839261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255438658171000:7937]
2025-10-01T14:10:17.839267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255438658171000:7937]
2025-10-01T14:10:17.839274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255438658171000:7937]
2025-10-01T14:10:17.839292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:17.839300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:17.839301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:17.839303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:17.839305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.839306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:17.839345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:17.839440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:17.905717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255441035048033:8859]
2025-10-01T14:10:17.905955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1044, pipe: [1:7556255441035048033:8859]
2025-10-01T14:10:17.974136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:17.982118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:17.982141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:17.982307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.982405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.982475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.982541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.982950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.982968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.983043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.983107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.983169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.983237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.983281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.983288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.983352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.983415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.983480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.983540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.983580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.983588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.983650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.983713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.983770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.983833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.983874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.983881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.983940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.983996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.984055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.984117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.984165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.984172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.984234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.984294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.984362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.984431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.984475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.984482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.984544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.984601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.984669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.984746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.984788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.984795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.984858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.984920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.984981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.985047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.985095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.985102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.985170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.985239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.985306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.985370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.985417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.985424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.985488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:17.985551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:17.985616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:17.985677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:17.985721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:17.985728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:17.985789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035048033:8859], now have 1 active actors on pipe
2025-10-01T14:10:17.986012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:17.986012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255441035048033:8859]
2025-10-01T14:10:17.986028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:17.986031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:17.986053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1045 reason: error at write: Disconnected sessionId: src_id|3813208c-6578ee89-8762d3d7-2063860a_0
2025-10-01T14:10:17.986240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1045 sessionId: src_id|3813208c-6578ee89-8762d3d7-2063860a_0 is DEAD
2025-10-01T14:10:17.986356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3813208c-6578ee89-8762d3d7-2063860a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:17.986365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3813208c-6578ee89-8762d3d7-2063860a_0] Write session will restart in 0.005551s
2025-10-01T14:10:17.986398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3813208c-6578ee89-8762d3d7-2063860a_0] Write session: Do CDS request
2025-10-01T14:10:17.986403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3813208c-6578ee89-8762d3d7-2063860a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:17.986440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:17.992782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3813208c-6578ee89-8762d3d7-2063860a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.992843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:17.992858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1046
2025-10-01T14:10:17.992946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:17.992969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:17.992973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:17.992976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:17.993290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1046 sessionId:  describe result for acl check
2025-10-01T14:10:17.993315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:17.993316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:17.993317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:17.993320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255441035048121:9118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:17.993729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255441035048121:9118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:17.994332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:17.996208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:17.996236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255441035048121:9118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:17.996326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:17.996332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:17.996339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:17.996367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:17.996392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255438658171131:7940]
2025-10-01T14:10:17.996767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:17.996947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:17.996973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:17.997155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:17.997186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.997190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.997191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.997191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.997192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.997193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.997193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.997194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.997195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.997195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.997196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.997196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.997197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.997198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.997201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.997207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.997209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.997211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.997213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.997215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.997217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.997220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.997222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.997225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.997227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.997229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.997231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.997233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.997237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.997241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:17.997245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.997248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:17.997250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.997253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:17.997255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.997258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:17.997260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.997263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:17.997265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.997268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:17.997271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.997273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:17.997279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.997281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:17.997283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.997286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:17.997288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.997291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:17.997293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.997296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:17.997301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.997305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:17.997307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.997310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:17.997316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.997318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:17.997337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:18.000762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255441035048121:9118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:18.000779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255441035048121:9118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:18.000782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255441035048121:9118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:18.000790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:18.000882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:18.001442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:18.001456Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:18.001457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:18.001460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:18.001465Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1045 [2:7556255438658171131:7940]
2025-10-01T14:10:18.001475Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:18.001486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:18.001488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.001490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.001492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.001503Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:18.001506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:18.001510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:18.001553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.001559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.001561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.001563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:18.001564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:18.001623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:18.001630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.001639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.001652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.001670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:18.001690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015456:9118], now have 1 active actors on pipe
2025-10-01T14:10:18.001697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255441035048038:2446], now have 1 active actors on pipe
2025-10-01T14:10:18.001693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1045
2025-10-01T14:10:18.001704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255438658171126:7940]
2025-10-01T14:10:18.001710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255438658171126:7940]
2025-10-01T14:10:18.001712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255438658171126:7940]
2025-10-01T14:10:18.001720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:18.001727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:18.001730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:18.001731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:18.001732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:18.001745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:18.001733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1045
2025-10-01T14:10:18.001751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:18.001765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.001773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.001806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255438658171126:7940]
2025-10-01T14:10:18.001815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:18.001829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:18.001833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffc86432-413b2667-448319fc-c48226d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:18.001839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.001842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.001844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:18.001851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.001858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:18.001886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.001991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.001998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.002010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.002063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1046 partition: 0 MaxSeqNo: 45 sessionId: src_id|ffc86432-413b2667-448319fc-c48226d9_0
2025-10-01T14:10:18.002356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3813208c-6578ee89-8762d3d7-2063860a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ffc86432-413b2667-448319fc-c48226d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:18.004670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc86432-413b2667-448319fc-c48226d9_0] Write session: try to update token
2025-10-01T14:10:18.004684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc86432-413b2667-448319fc-c48226d9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:18.016791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1046 sessionId: src_id|ffc86432-413b2667-448319fc-c48226d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:18.018798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:18.018998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.019018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.019055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:18.019114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:18.020987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:18.021004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:18.021006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:18.021008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:18.021016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255438658171126:7940]
2025-10-01T14:10:18.021022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255438658171126:7940]
2025-10-01T14:10:18.021030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255438658171126:7940]
2025-10-01T14:10:18.021065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:18.021074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:18.021077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:18.021079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:18.021081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.021083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:18.021214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:18.085905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255445330015463:8859]
2025-10-01T14:10:18.086098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1045, pipe: [1:7556255445330015463:8859]
2025-10-01T14:10:18.153999Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:18.160717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.160752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.160882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.160931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.160989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.161040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.161082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.161089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.161143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.161193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.161245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.161301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.161337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.161342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.161390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.161437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.161490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.161539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.161578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.161583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.161631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.161679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.161725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.161771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.161808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.161813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.161862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.161909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.161957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.162004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.162041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.162046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.162096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.162143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.162194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.162245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.162303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.162309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.162358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.162415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.162466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.162517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.162554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.162559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.162610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.162659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.162708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.162757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.162795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.162800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.162853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.162904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.162957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.163011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.163049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.163053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.163107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.163157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.163209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.163261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.163300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.163305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.163342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015463:8859], now have 1 active actors on pipe
2025-10-01T14:10:18.163551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:18.163565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:18.163589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1046 reason: error at write: Disconnected sessionId: src_id|ffc86432-413b2667-448319fc-c48226d9_0
2025-10-01T14:10:18.163595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:18.163654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255445330015463:8859]
2025-10-01T14:10:18.163759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1046 sessionId: src_id|ffc86432-413b2667-448319fc-c48226d9_0 is DEAD
2025-10-01T14:10:18.163920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc86432-413b2667-448319fc-c48226d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:18.163927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc86432-413b2667-448319fc-c48226d9_0] Write session will restart in 0.005359s
2025-10-01T14:10:18.163946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc86432-413b2667-448319fc-c48226d9_0] Write session: Do CDS request
2025-10-01T14:10:18.163951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc86432-413b2667-448319fc-c48226d9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:18.164261Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:18.170843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc86432-413b2667-448319fc-c48226d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.170896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:18.170910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1047
2025-10-01T14:10:18.171048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.171071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:18.171074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:18.171077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:18.171345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1047 sessionId:  describe result for acl check
2025-10-01T14:10:18.171368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:18.171372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:18.171373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:18.171377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255445330015552:9122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:18.171496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:18.171750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255445330015552:9122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:18.173547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:18.173728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:18.173738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:18.173749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:18.173781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255445330015552:9122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:18.173798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:18.173832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255442953138552:7942]
2025-10-01T14:10:18.174402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:18.174653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:18.174696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:18.174989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:18.175038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.175045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.175046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.175047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.175048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.175049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.175050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.175051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.175052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.175054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.175055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.175056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.175057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.175057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.175062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.175071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.175075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.175079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.175083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.175087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.175090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.175094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.175098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.175102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.175106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.175110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.175114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.175117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.175124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.175136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.175145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.175152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.175160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.175165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.175174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.175183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.175191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.175199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.175207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.175217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.175226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.175234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.175242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.175248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.175256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.175265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.175274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.175282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.175290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.175299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.175307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.175312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.175320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.175329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.175333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.175338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.175376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:18.176956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255445330015552:9122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:18.176967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255445330015552:9122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:18.176970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255445330015552:9122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:18.176975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:18.178657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:18.179221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:18.179234Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:18.179236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:18.179239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:18.179246Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1046 [2:7556255442953138552:7942]
2025-10-01T14:10:18.179260Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:18.179277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:18.179283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.179287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.179292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.179306Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:18.179314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:18.179323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:18.179368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.179374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.179376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.179378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:18.179381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:18.179436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:18.179442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.179452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.179466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.179485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:18.179505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015592:9122], now have 1 active actors on pipe
2025-10-01T14:10:18.179512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015466:2446], now have 1 active actors on pipe
2025-10-01T14:10:18.179520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255442953138547:7942]
2025-10-01T14:10:18.179525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255442953138547:7942]
2025-10-01T14:10:18.179527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255442953138547:7942]
2025-10-01T14:10:18.179541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:18.179524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1046
2025-10-01T14:10:18.179556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:18.179562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:18.179565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:18.179567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:18.179531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1046
2025-10-01T14:10:18.179574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:18.179576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:18.179609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.179618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.179635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255442953138547:7942]
2025-10-01T14:10:18.179645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:18.179662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:18.179674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:18.179684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.179691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.179698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:18.179706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.179718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:18.179741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.179838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.179845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.179859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.179918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1047 partition: 0 MaxSeqNo: 45 sessionId: src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0
2025-10-01T14:10:18.180231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc86432-413b2667-448319fc-c48226d9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:18.182333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0] Write session: try to update token
2025-10-01T14:10:18.182345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:18.194353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1047 sessionId: src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:18.196409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:18.196513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.196532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.198294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:18.198330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:18.198337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:18.198339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:18.198340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:18.198346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255442953138547:7942]
2025-10-01T14:10:18.198349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255442953138547:7942]
2025-10-01T14:10:18.198352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255442953138547:7942]
2025-10-01T14:10:18.198388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:18.198393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:18.198397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:18.198401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:18.198407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.198410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:18.198420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:18.198547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:18.263561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255445330015601:8859]
2025-10-01T14:10:18.263761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1046, pipe: [1:7556255445330015601:8859]
2025-10-01T14:10:18.332912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:18.339013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.339033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.339171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.339235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.339298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.339360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.339400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.339407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.339465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.339517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.339569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.339625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.339663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.339669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.339721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.339771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.339823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.339871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.339910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.339916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.339965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.340013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.340062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.340108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.340144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.340149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.340195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.340244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.340291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.340337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.340374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.340379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.340434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.340483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.340537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.340588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.340626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.340631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.340681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.340738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.340789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.340840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.340878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.340883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.340933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.340980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.341030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.341081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.341122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.341127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.341180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.341228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.341277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.341327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.341363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.341368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.341420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.341467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.341515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.341564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.341600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.341605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.341640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015601:8859], now have 1 active actors on pipe
2025-10-01T14:10:18.341862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255445330015601:8859]
2025-10-01T14:10:18.341877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:18.341880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:18.341884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:18.341900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1047 reason: error at write: Disconnected sessionId: src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0
2025-10-01T14:10:18.342041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1047 sessionId: src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0 is DEAD
2025-10-01T14:10:18.342161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:18.342167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0] Write session will restart in 0.008409s
2025-10-01T14:10:18.342186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0] Write session: Do CDS request
2025-10-01T14:10:18.342191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:18.342327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:18.349281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:18.351498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:18.351659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:18.351668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:18.351677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:18.351732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:18.351764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255442953138678:7944]
2025-10-01T14:10:18.351807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.351871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:18.351885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1048
2025-10-01T14:10:18.351977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.351998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:18.352004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:18.352007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:18.352287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1048 sessionId:  describe result for acl check
2025-10-01T14:10:18.352315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:18.352314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:18.352319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:18.352320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:18.352324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255445330015697:9127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:18.352523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:18.352549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:18.352678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255445330015697:9127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:18.352787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:18.352826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.352829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.352830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.352830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.352831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.352831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.352832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.352833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.352833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.352833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.352834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.352835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.352835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.352836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.352839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.352844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.352846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.352848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.352850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.352852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.352854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.352856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.352858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.352860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.352863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.352866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.352869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.352872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.352878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.352885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.352890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.352894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.352896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.352899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.352901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.352907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.352910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.352913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.352918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.352921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.352923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.352930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.352932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.352935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.352941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.352943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.352946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.352948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.352954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.352957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.352959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.352964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.352967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.352970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.352972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.352978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.352996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:18.354235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255445330015697:9127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:18.356235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255445330015697:9127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:18.356247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255445330015697:9127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:18.356249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255445330015697:9127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:18.356254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:18.356349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:18.356901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:18.356910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:18.356911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:18.356914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:18.356919Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1047 [2:7556255442953138678:7944]
2025-10-01T14:10:18.356929Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:18.356939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:18.356945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.356947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.356949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.356959Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:18.356965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:18.356969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:18.357002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.357009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.357010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.357012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:18.357013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:18.357059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:18.357064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.357070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.357079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.357091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:18.357105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015609:2446], now have 1 active actors on pipe
2025-10-01T14:10:18.357111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015736:9127], now have 1 active actors on pipe
2025-10-01T14:10:18.357115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255442953138673:7944]
2025-10-01T14:10:18.357116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255442953138673:7944]
2025-10-01T14:10:18.357117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255442953138673:7944]
2025-10-01T14:10:18.357126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:18.357137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:18.357137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:18.357140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:18.357141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:18.357148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:18.357130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1047
2025-10-01T14:10:18.357150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:18.357131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1047
2025-10-01T14:10:18.357177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.357183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.357192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255442953138673:7944]
2025-10-01T14:10:18.357199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:18.357207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:18.357220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58428cbc-68472f2f-8e80b247-d38eed18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:18.357224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.357227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.357232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:18.357237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.357243Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:18.357258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.357348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.357355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.357364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.357410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1048 partition: 0 MaxSeqNo: 45 sessionId: src_id|58428cbc-68472f2f-8e80b247-d38eed18_0
2025-10-01T14:10:18.357689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6464b7-f84981f1-139cbcb8-17e61242_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58428cbc-68472f2f-8e80b247-d38eed18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:18.359949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58428cbc-68472f2f-8e80b247-d38eed18_0] Write session: try to update token
2025-10-01T14:10:18.359966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58428cbc-68472f2f-8e80b247-d38eed18_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:18.373195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1048 sessionId: src_id|58428cbc-68472f2f-8e80b247-d38eed18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:18.375446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:18.375953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.375978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.375995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:18.376001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:18.376002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:18.376004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:18.376010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255442953138673:7944]
2025-10-01T14:10:18.376012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255442953138673:7944]
2025-10-01T14:10:18.376018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255442953138673:7944]
2025-10-01T14:10:18.376049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:18.376059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:18.376062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:18.376063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:18.376067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.376068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:18.376176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:18.442266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255445330015768:8859]
2025-10-01T14:10:18.442497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1047, pipe: [1:7556255445330015768:8859]
2025-10-01T14:10:18.510605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:18.510854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:18.510910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015768:8859], now have 1 active actors on pipe
2025-10-01T14:10:18.511023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:18.511067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255445330015768:8859]
2025-10-01T14:10:18.511410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:18.511482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:18.511487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:18.511541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1048 reason: error at write: Disconnected sessionId: src_id|58428cbc-68472f2f-8e80b247-d38eed18_0
2025-10-01T14:10:18.511673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1048 sessionId: src_id|58428cbc-68472f2f-8e80b247-d38eed18_0 is DEAD
2025-10-01T14:10:18.511791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58428cbc-68472f2f-8e80b247-d38eed18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:18.511799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58428cbc-68472f2f-8e80b247-d38eed18_0] Write session will restart in 0.008924s
2025-10-01T14:10:18.511818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58428cbc-68472f2f-8e80b247-d38eed18_0] Write session: Do CDS request
2025-10-01T14:10:18.511823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58428cbc-68472f2f-8e80b247-d38eed18_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:18.517850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:18.519900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:18.520018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:18.520025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:18.520034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:18.520072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:18.520098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255442953138814:7949]
2025-10-01T14:10:18.520457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:18.520615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:18.520638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:18.520840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:18.520876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.520881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.520881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.520882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.520883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.520883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.520884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.520884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.520885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.520885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.520886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.520887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.520887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.520888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.520891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.520896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.520898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.520900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.520902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.520904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.520906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.520908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.520910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.520912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.520914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.520916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.520918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.520920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.520924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.520928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.520932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.520935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.520937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.520940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.520942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.520945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.520947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.520950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.520952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.520954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.520957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.520960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.520962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.520965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.520969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.520973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.520975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.520980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.520982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.520985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.520987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.520989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.520994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.520997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.520999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.521001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.521023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:18.521812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58428cbc-68472f2f-8e80b247-d38eed18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.521884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:18.521899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1049
2025-10-01T14:10:18.521984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.522004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:18.522008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:18.522014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:18.522274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1049 sessionId:  describe result for acl check
2025-10-01T14:10:18.522301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:18.522305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:18.522307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:18.522310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255445330015864:9138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:18.522708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255445330015864:9138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:18.524186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:18.524305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255445330015864:9138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:18.524740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:18.524750Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:18.524751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:18.524753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:18.524758Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1048 [2:7556255442953138814:7949]
2025-10-01T14:10:18.524767Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:18.524779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:18.524784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.524786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.524788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.524798Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:18.524803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:18.524807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:18.524842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.524847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.524848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.524850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:18.524852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:18.524898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:18.524903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.524909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.524915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.524927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:18.524943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015770:2446], now have 1 active actors on pipe
2025-10-01T14:10:18.524952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255442953138809:7949]
2025-10-01T14:10:18.524953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255442953138809:7949]
2025-10-01T14:10:18.524955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255442953138809:7949]
2025-10-01T14:10:18.524964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:18.524975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:18.524977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:18.524979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:18.524981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:18.524986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:18.524988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:18.524984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1048
2025-10-01T14:10:18.525005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255442953138809:7949]
2025-10-01T14:10:18.525010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:18.525013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:18.528710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255445330015864:9138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:18.528719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255445330015864:9138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:18.528729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255445330015864:9138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:18.528747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:18.528927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015902:9138], now have 1 active actors on pipe
2025-10-01T14:10:18.528954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1048
2025-10-01T14:10:18.529007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.529015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.529034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|221cceb9-fb765298-e35bc4b5-80a77307_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:18.529044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.529050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.529052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:18.529059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.529073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:18.529088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.529207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.529212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.529221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.529283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1049 partition: 0 MaxSeqNo: 45 sessionId: src_id|221cceb9-fb765298-e35bc4b5-80a77307_0
2025-10-01T14:10:18.529558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58428cbc-68472f2f-8e80b247-d38eed18_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|221cceb9-fb765298-e35bc4b5-80a77307_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:18.531844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|221cceb9-fb765298-e35bc4b5-80a77307_0] Write session: try to update token
2025-10-01T14:10:18.531859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|221cceb9-fb765298-e35bc4b5-80a77307_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:18.535289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:18.535309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:18.535319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255442953138809:7949]
2025-10-01T14:10:18.535363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:18.535370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:18.535569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:18.535735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:18.535940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:18.536095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:18.536314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:18.536358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:18.544712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1049 sessionId: src_id|221cceb9-fb765298-e35bc4b5-80a77307_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:18.546751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:18.546868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.546883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.546910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:18.546967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:18.554026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:18.554040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:18.554043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:18.554045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:18.554054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255442953138809:7949]
2025-10-01T14:10:18.554058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255442953138809:7949]
2025-10-01T14:10:18.554061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255442953138809:7949]
2025-10-01T14:10:18.554095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:18.554105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:18.554108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:18.554108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:18.554115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.554119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:18.554246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:18.611245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255445330015906:8859]
2025-10-01T14:10:18.611481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1048, pipe: [1:7556255445330015906:8859]
2025-10-01T14:10:18.696363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:18.703159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.703181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.703315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.703365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.703422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.703475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.703594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.703602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.703658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.703708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.703758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.703812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.703851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.703860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.703923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.703976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.704030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.704083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.704122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.704127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.704183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.704235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.704287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.704339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.704377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.704382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.704437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.704490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.704543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.704594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.704633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.704638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.704691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.704758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.704814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.704868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.704908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.704913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.704970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.705020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.705077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.705131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.705170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.705175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.705230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.705286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.705340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.705390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.705428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.705433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.705488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.705537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.705591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.705645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.705684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.705689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.705741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.705792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.705845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.705897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.705935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.705939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.705978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015906:8859], now have 1 active actors on pipe
2025-10-01T14:10:18.706251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:18.706293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:18.706306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:18.706332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1049 reason: error at write: Disconnected sessionId: src_id|221cceb9-fb765298-e35bc4b5-80a77307_0
2025-10-01T14:10:18.706458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255445330015906:8859]
2025-10-01T14:10:18.706563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1049 sessionId: src_id|221cceb9-fb765298-e35bc4b5-80a77307_0 is DEAD
2025-10-01T14:10:18.706682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221cceb9-fb765298-e35bc4b5-80a77307_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:18.706693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221cceb9-fb765298-e35bc4b5-80a77307_0] Write session will restart in 0.008535s
2025-10-01T14:10:18.706718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221cceb9-fb765298-e35bc4b5-80a77307_0] Write session: Do CDS request
2025-10-01T14:10:18.706723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221cceb9-fb765298-e35bc4b5-80a77307_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:18.706778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:18.715767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:18.716860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|221cceb9-fb765298-e35bc4b5-80a77307_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.716936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:18.716950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1050
2025-10-01T14:10:18.717036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.717059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:18.717066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:18.717069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:18.717352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1050 sessionId:  describe result for acl check
2025-10-01T14:10:18.717375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:18.717380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:18.717381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:18.717385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255445330015999:9142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:18.717747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255445330015999:9142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:18.718112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:18.718242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:18.718252Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:18.718259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:18.718293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:18.718329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255442953138984:7962]
2025-10-01T14:10:18.718964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:18.719199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:18.719234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:18.719438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:18.719476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.719480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.719481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.719481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.719482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.719483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.719484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.719485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.719485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.719486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.719487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.719487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.719488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.719514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255445330015999:9142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:18.719488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.719491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.719497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.719499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.719502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.719504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.719506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.719508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.719510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.719513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.719515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.719517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.719519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.719521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.719525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.719531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.719538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.719544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.719549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.719553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.719558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.719563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.719568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.719570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.719574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.719577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.719579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.719583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.719586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.719588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.719591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.719594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.719596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.719599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.719602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.719604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.719607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.719609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.719612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.719615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.719618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.719620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.719623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.719644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:18.722740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255445330015999:9142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:18.722751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255445330015999:9142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:18.722753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255445330015999:9142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:18.722759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:18.722964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:18.723830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:18.723840Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:18.723841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:18.723844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:18.723848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1049 [2:7556255442953138984:7962]
2025-10-01T14:10:18.723858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:18.723868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:18.723873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.723875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.723877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.723887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:18.723890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:18.723894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:18.723926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.723931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.723932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.723934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:18.723936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:18.723988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:18.723994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.724005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.724019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.724037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:18.724057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330015909:2446], now have 1 active actors on pipe
2025-10-01T14:10:18.724063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330016040:9142], now have 1 active actors on pipe
2025-10-01T14:10:18.724067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255442953138978:7962]
2025-10-01T14:10:18.724068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255442953138978:7962]
2025-10-01T14:10:18.724070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255442953138978:7962]
2025-10-01T14:10:18.724078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:18.724091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:18.724090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:18.724093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:18.724095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:18.724094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1049
2025-10-01T14:10:18.724108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:18.724114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:18.724143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.724151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.724168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255442953138978:7962]
2025-10-01T14:10:18.724176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:18.724183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:18.724200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75dbcb32-d88d3d40-877b655b-12d47189_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:18.724210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.724218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.724220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:18.724210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1049
2025-10-01T14:10:18.724227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.724240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:18.724267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.724360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.724367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.724379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.724439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1050 partition: 0 MaxSeqNo: 45 sessionId: src_id|75dbcb32-d88d3d40-877b655b-12d47189_0
2025-10-01T14:10:18.724702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|221cceb9-fb765298-e35bc4b5-80a77307_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|75dbcb32-d88d3d40-877b655b-12d47189_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:18.726881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75dbcb32-d88d3d40-877b655b-12d47189_0] Write session: try to update token
2025-10-01T14:10:18.726895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75dbcb32-d88d3d40-877b655b-12d47189_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:18.739012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1050 sessionId: src_id|75dbcb32-d88d3d40-877b655b-12d47189_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:18.741249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:18.741452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.741470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.741498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:18.741566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:18.743437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:18.743452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:18.743454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:18.743455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:18.743462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255442953138978:7962]
2025-10-01T14:10:18.743465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255442953138978:7962]
2025-10-01T14:10:18.743468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255442953138978:7962]
2025-10-01T14:10:18.743501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:18.743503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:18.743508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.743509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:18.743511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:18.743514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:18.743626Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:18.806821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255445330016060:8859]
2025-10-01T14:10:18.807061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1049, pipe: [1:7556255445330016060:8859]
2025-10-01T14:10:18.880272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:18.887148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.887172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.887330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.887391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.887457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.887530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.887572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.887582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.887648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.887703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.887764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.887826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.887873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.887880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.887937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.887989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.888050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.888110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.888149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.888156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.888214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.888276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.888330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.888383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.888420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.888427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.888477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.888531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.888582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.888645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.888686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.888692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.888760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.888813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.888864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.888916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.888953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.888961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.889014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.889062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.889113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.889164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.889201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.889206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.889256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.889305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.889356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.889408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.889446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.889451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.889505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.889555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.889608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.889658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.889695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.889702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.889753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:18.889803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:18.889856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:18.889908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:18.889950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:18.889956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:18.889991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330016060:8859], now have 1 active actors on pipe
2025-10-01T14:10:18.890223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:18.890228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:18.890235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:18.890255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1050 reason: error at write: Disconnected sessionId: src_id|75dbcb32-d88d3d40-877b655b-12d47189_0
2025-10-01T14:10:18.890275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255445330016060:8859]
2025-10-01T14:10:18.890446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1050 sessionId: src_id|75dbcb32-d88d3d40-877b655b-12d47189_0 is DEAD
2025-10-01T14:10:18.890556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75dbcb32-d88d3d40-877b655b-12d47189_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:18.890561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75dbcb32-d88d3d40-877b655b-12d47189_0] Write session will restart in 0.005183s
2025-10-01T14:10:18.890582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75dbcb32-d88d3d40-877b655b-12d47189_0] Write session: Do CDS request
2025-10-01T14:10:18.890587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75dbcb32-d88d3d40-877b655b-12d47189_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:18.890844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:18.896755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75dbcb32-d88d3d40-877b655b-12d47189_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.896927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:18.896944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1051
2025-10-01T14:10:18.897062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:18.897093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:18.897102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:18.897110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:18.897397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1051 sessionId:  describe result for acl check
2025-10-01T14:10:18.897426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:18.897430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:18.897431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:18.897434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255445330016150:9148] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:18.897823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255445330016150:9148] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:18.898658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:18.899559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255445330016150:9148] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:18.900855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:18.901036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:18.901047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:18.901060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:18.901119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:18.901147Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255442953139114:7965]
2025-10-01T14:10:18.901529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:18.901761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:18.901793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:18.902054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:18.902052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255445330016150:9148] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:18.902065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255445330016150:9148] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:18.902070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255445330016150:9148] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:18.902078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:18.902120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.902126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.902127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.902128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.902129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.902130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.902131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.902132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.902133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.902134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.902135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.902136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.902137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.902139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.902144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.902152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.902156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.902159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.902162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.902166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.902170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.902173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.902176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.902180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.902183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.902186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.902190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.902194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.902200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.902207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:18.902213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.902218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:18.902222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.902227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:18.902232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.902237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:18.902240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.902243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:18.902245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.902248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:18.902251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.902254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:18.902256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.902259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:18.902262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.902264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:18.902267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.902270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.902272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.902275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.902277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.902280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.902282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.902285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:18.902287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.902290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:18.902310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:18.905717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:18.906254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:18.906266Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:18.906267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:18.906269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:18.906274Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1050 [2:7556255442953139114:7965]
2025-10-01T14:10:18.906283Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:18.906294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:18.906300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.906303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.906304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.906315Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:18.906318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:18.906322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:18.906358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.906362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.906364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.906366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:18.906387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:18.906434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:18.906439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.906446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:18.906452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:18.906462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:18.906480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255442953139109:7965]
2025-10-01T14:10:18.906487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255442953139109:7965]
2025-10-01T14:10:18.906489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255442953139109:7965]
2025-10-01T14:10:18.906498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:18.906502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:18.906504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:18.906505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:18.906509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330016190:9148], now have 1 active actors on pipe
2025-10-01T14:10:18.906517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:18.906533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:18.906539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:18.906544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330016062:2446], now have 1 active actors on pipe
2025-10-01T14:10:18.906560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255442953139109:7965]
2025-10-01T14:10:18.906571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:18.906564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1050
2025-10-01T14:10:18.906571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1050
2025-10-01T14:10:18.906584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:18.906602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.906611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.906636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:18.906644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:18.906647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:18.906648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:18.906654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:18.906661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:18.906676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.906805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.906811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.906824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:18.906907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1051 partition: 0 MaxSeqNo: 45 sessionId: src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0
2025-10-01T14:10:18.907223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75dbcb32-d88d3d40-877b655b-12d47189_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:18.909361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0] Write session: try to update token
2025-10-01T14:10:18.909374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:18.921901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1051 sessionId: src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:18.923904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:18.925543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:18.925562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:18.925579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:18.925581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:18.925583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:18.925585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:18.925593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255442953139109:7965]
2025-10-01T14:10:18.925596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255442953139109:7965]
2025-10-01T14:10:18.925598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255442953139109:7965]
2025-10-01T14:10:18.925637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:18.925638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:18.925643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:18.925644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:18.925647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:18.925651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:18.925757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:18.990637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255445330016200:8859]
2025-10-01T14:10:18.990891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1050, pipe: [1:7556255445330016200:8859]
2025-10-01T14:10:19.061659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:19.061892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:19.061942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255445330016200:8859], now have 1 active actors on pipe
2025-10-01T14:10:19.062024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:19.062107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255445330016200:8859]
2025-10-01T14:10:19.062162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:19.069756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:19.069882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:19.069893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:19.069911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1051 reason: error at write: Disconnected sessionId: src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0
2025-10-01T14:10:19.070036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1051 sessionId: src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0 is DEAD
2025-10-01T14:10:19.070155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:19.070164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0] Write session will restart in 0.009191s
2025-10-01T14:10:19.070184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0] Write session: Do CDS request
2025-10-01T14:10:19.070188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:19.072692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:19.072833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:19.072841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:19.072848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:19.072877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:19.072902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255447248106540:7967]
2025-10-01T14:10:19.073253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:19.073464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:19.073489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:19.073730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:19.073773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.073778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.073779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.073780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.073781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.073782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.073783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.073784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.073785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.073786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.073786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.073787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.073788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.073789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.073793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.073802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.073806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.073809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.073813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.073817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.073820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.073824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.073827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.073831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.073836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.073839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.073841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.073843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.073848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.073853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.073857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.073861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.073863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.073866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.073869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.073872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.073875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.073878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.073880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.073883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.073885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.073888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.073893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.073895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.073897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.073900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.073902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.073906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.073908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.073911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.073913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.073915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.073917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.073920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.073922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.073924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.073944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:19.077114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:19.077649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:19.077660Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:19.077662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:19.077665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:19.077671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1051 [2:7556255447248106540:7967]
2025-10-01T14:10:19.077681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:19.077692Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:19.077696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.077698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.077699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.077708Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:19.077715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:19.077719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:19.077753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.077757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.077758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.077760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:19.077762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:19.077803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:19.077809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.077818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.077827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.077844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:19.077862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983497:2446], now have 1 active actors on pipe
2025-10-01T14:10:19.077873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255447248106535:7967]
2025-10-01T14:10:19.077875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255447248106535:7967]
2025-10-01T14:10:19.077876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255447248106535:7967]
2025-10-01T14:10:19.077887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:19.077884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1051
2025-10-01T14:10:19.077903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:19.077906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:19.077909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:19.077911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:19.077919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:19.077922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:19.077944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255447248106535:7967]
2025-10-01T14:10:19.077954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:19.077969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:19.080830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.080903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:19.080913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1052
2025-10-01T14:10:19.081004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.081026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:19.081032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:19.081034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:19.081345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1052 sessionId:  describe result for acl check
2025-10-01T14:10:19.081373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:19.081378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:19.081379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:19.081383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255449624983599:9152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:19.081737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255449624983599:9152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:19.083419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255449624983599:9152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:19.086611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255449624983599:9152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:19.086622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255449624983599:9152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:19.086626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255449624983599:9152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:19.086632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:19.086807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1051
2025-10-01T14:10:19.087361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983635:9152], now have 1 active actors on pipe
2025-10-01T14:10:19.087383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.087389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.087402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:19.087404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:19.087408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255447248106535:7967]
2025-10-01T14:10:19.087423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:19.087434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32ef3122-518f84d7-15b09815-b415c1cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:19.087443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.087450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.087451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:19.087459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.087470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:19.087485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:19.087627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:19.087745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:19.087867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:19.087988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:19.088148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:19.088187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.088210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:19.088441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.088450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.088465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.088529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1052 partition: 0 MaxSeqNo: 45 sessionId: src_id|32ef3122-518f84d7-15b09815-b415c1cd_0
2025-10-01T14:10:19.088816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aff23b03-f28da483-5958ec6f-f70f47e9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|32ef3122-518f84d7-15b09815-b415c1cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:19.090978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ef3122-518f84d7-15b09815-b415c1cd_0] Write session: try to update token
2025-10-01T14:10:19.090995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ef3122-518f84d7-15b09815-b415c1cd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:19.104351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1052 sessionId: src_id|32ef3122-518f84d7-15b09815-b415c1cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:19.105959Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:19.105973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:19.105974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:19.105975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:19.105983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255447248106535:7967]
2025-10-01T14:10:19.105985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255447248106535:7967]
2025-10-01T14:10:19.105987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255447248106535:7967]
2025-10-01T14:10:19.106019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:19.106022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:19.106023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:19.106026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:19.106026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.106028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:19.106142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:19.106359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:19.162135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255449624983637:8859]
2025-10-01T14:10:19.162364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1051, pipe: [1:7556255449624983637:8859]
2025-10-01T14:10:19.238499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:19.239059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.239075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.239098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983637:8859], now have 1 active actors on pipe
2025-10-01T14:10:19.239327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:19.239338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255449624983637:8859]
2025-10-01T14:10:19.239361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:19.239363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:19.239340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:19.239431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1052 reason: error at write: Disconnected sessionId: src_id|32ef3122-518f84d7-15b09815-b415c1cd_0
2025-10-01T14:10:19.239615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1052 sessionId: src_id|32ef3122-518f84d7-15b09815-b415c1cd_0 is DEAD
2025-10-01T14:10:19.239751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ef3122-518f84d7-15b09815-b415c1cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:19.239758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ef3122-518f84d7-15b09815-b415c1cd_0] Write session will restart in 0.007524s
2025-10-01T14:10:19.239778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ef3122-518f84d7-15b09815-b415c1cd_0] Write session: Do CDS request
2025-10-01T14:10:19.239783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ef3122-518f84d7-15b09815-b415c1cd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:19.247802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:19.248837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32ef3122-518f84d7-15b09815-b415c1cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.248957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:19.248974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1053
2025-10-01T14:10:19.249077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.249108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:19.249115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:19.249122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:19.249557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1053 sessionId:  describe result for acl check
2025-10-01T14:10:19.249588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:19.249598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:19.249602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:19.249607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255449624983732:9156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:19.250108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255449624983732:9156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:19.250590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:19.250784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:19.250797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:19.250808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:19.250862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:19.250899Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255447248106671:7969]
2025-10-01T14:10:19.251452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:19.251702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:19.251749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:19.251783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255449624983732:9156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:19.252048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:19.252109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.252115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.252117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.252118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.252120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.252121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.252122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.252123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.252124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.252126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.252127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.252128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.252129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.252130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.252135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.252144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.252148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.252152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.252155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.252159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.252167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.252170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.252178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.252184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.252188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.252192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.252195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.252199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.252205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.252216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.252227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.252236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.252244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.252248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.252256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.252265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.252274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.252284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.252291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.252296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.252305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.252314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.252322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.252331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.252340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.252350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.252358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.252364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.252372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.252379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.252388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.252398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.252406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.252412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.252420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.252428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.252467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:19.255495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255449624983732:9156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:19.255506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255449624983732:9156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:19.255508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255449624983732:9156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:19.255552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:19.255679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:19.256181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:19.256193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:19.256194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:19.256197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:19.256201Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1052 [2:7556255447248106671:7969]
2025-10-01T14:10:19.256210Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:19.256221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:19.256226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.256229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.256230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.256241Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:19.256248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:19.256252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:19.256287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.256292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.256294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.256296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:19.256298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:19.256343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:19.256349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.256355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.256361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.256369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:19.256385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983771:9156], now have 1 active actors on pipe
2025-10-01T14:10:19.256391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983638:2446], now have 1 active actors on pipe
2025-10-01T14:10:19.256396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255447248106666:7969]
2025-10-01T14:10:19.256397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255447248106666:7969]
2025-10-01T14:10:19.256399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255447248106666:7969]
2025-10-01T14:10:19.256409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:19.256420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:19.256420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:19.256423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:19.256424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:19.256432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:19.256433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:19.256431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1052
2025-10-01T14:10:19.256450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255447248106666:7969]
2025-10-01T14:10:19.256456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:19.256468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:19.256452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1052
2025-10-01T14:10:19.256474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.256477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.256498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea94ec99-74db977d-bd4adabb-e709017e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:19.256506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.256509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.256513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:19.256519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.256526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:19.256543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.256657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.256662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.256672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.256755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1053 partition: 0 MaxSeqNo: 45 sessionId: src_id|ea94ec99-74db977d-bd4adabb-e709017e_0
2025-10-01T14:10:19.257081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32ef3122-518f84d7-15b09815-b415c1cd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ea94ec99-74db977d-bd4adabb-e709017e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:19.259132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94ec99-74db977d-bd4adabb-e709017e_0] Write session: try to update token
2025-10-01T14:10:19.259145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94ec99-74db977d-bd4adabb-e709017e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:19.271792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1053 sessionId: src_id|ea94ec99-74db977d-bd4adabb-e709017e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:19.274082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:19.275550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.275571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.275588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:19.275590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:19.275591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:19.275593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:19.275600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255447248106666:7969]
2025-10-01T14:10:19.275604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255447248106666:7969]
2025-10-01T14:10:19.275606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255447248106666:7969]
2025-10-01T14:10:19.275646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:19.275650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:19.275654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.275656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:19.275656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:19.275660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:19.275801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:19.339456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255449624983784:8859]
2025-10-01T14:10:19.339678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1052, pipe: [1:7556255449624983784:8859]
2025-10-01T14:10:19.409699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:19.409985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:19.410037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983784:8859], now have 1 active actors on pipe
2025-10-01T14:10:19.410113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:19.410194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255449624983784:8859]
2025-10-01T14:10:19.410219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:19.418358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:19.418382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:19.418398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1053 reason: error at write: Disconnected sessionId: src_id|ea94ec99-74db977d-bd4adabb-e709017e_0
2025-10-01T14:10:19.418524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1053 sessionId: src_id|ea94ec99-74db977d-bd4adabb-e709017e_0 is DEAD
2025-10-01T14:10:19.418674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94ec99-74db977d-bd4adabb-e709017e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:19.418681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94ec99-74db977d-bd4adabb-e709017e_0] Write session will restart in 0.009704s
2025-10-01T14:10:19.418702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94ec99-74db977d-bd4adabb-e709017e_0] Write session: Do CDS request
2025-10-01T14:10:19.418707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94ec99-74db977d-bd4adabb-e709017e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:19.422113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:19.424928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:19.425130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:19.425141Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:19.425153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:19.425194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:19.425220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255447248106807:7971]
2025-10-01T14:10:19.425614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:19.425796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:19.425823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:19.426021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:19.426054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.426059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.426060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.426060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.426061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.426062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.426063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.426063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.426064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.426065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.426065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.426066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.426067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.426068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.426071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.426076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.426078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.426080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.426082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.426085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.426087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.426089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.426091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.426094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.426096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.426098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.426099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.426102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.426108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.426112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.426116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.426119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.426122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.426126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.426132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.426135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.426138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.426142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.426150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.426154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.426162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.426172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.426178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.426180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.426183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.426189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.426191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.426194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.426200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.426202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.426208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.426210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.426213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.426216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.426221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.426224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.426244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:19.429568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:19.429884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94ec99-74db977d-bd4adabb-e709017e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.429979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:19.429997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1054
2025-10-01T14:10:19.430102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.430132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:19.430143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:19.430146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:19.430460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:19.430483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1054 sessionId:  describe result for acl check
2025-10-01T14:10:19.430471Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:19.430474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:19.430477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:19.430484Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1053 [2:7556255447248106807:7971]
2025-10-01T14:10:19.430498Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:19.430512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:19.430515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.430519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.430521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.430512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:19.430535Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:19.430518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:19.430521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:19.430540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:19.430548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:19.430526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255449624983901:9167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:19.430591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.430597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.430599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.430604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:19.430607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:19.430664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:19.430669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.430679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.430690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.430710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:19.430731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983788:2446], now have 1 active actors on pipe
2025-10-01T14:10:19.430743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255447248106801:7971]
2025-10-01T14:10:19.430745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255447248106801:7971]
2025-10-01T14:10:19.430748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255447248106801:7971]
2025-10-01T14:10:19.430762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:19.430779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:19.430780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:19.430785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:19.430786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:19.430794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:19.430799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:19.430817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255447248106801:7971]
2025-10-01T14:10:19.430825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:19.430832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:19.431011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1053
2025-10-01T14:10:19.431027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255449624983901:9167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:19.432789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255449624983901:9167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:19.437341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255449624983901:9167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:19.437353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255449624983901:9167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:19.437355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255449624983901:9167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:19.437360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:19.437747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1053
2025-10-01T14:10:19.437764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983938:9167], now have 1 active actors on pipe
2025-10-01T14:10:19.437801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.437808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.437836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:19.437852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.437857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.437859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:19.437870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.437887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:19.437906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.438038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.438043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.438056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.438115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1054 partition: 0 MaxSeqNo: 45 sessionId: src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0
2025-10-01T14:10:19.438415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea94ec99-74db977d-bd4adabb-e709017e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:19.440524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0] Write session: try to update token
2025-10-01T14:10:19.440537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:19.449291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:19.449308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:19.449311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:19.449313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:19.449323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255447248106801:7971]
2025-10-01T14:10:19.449328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255447248106801:7971]
2025-10-01T14:10:19.449331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255447248106801:7971]
2025-10-01T14:10:19.449363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:19.449374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:19.449377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:19.449394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:19.449404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.449405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:19.449521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:19.453489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1054 sessionId: src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:19.455915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:19.510325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255449624983952:8859]
2025-10-01T14:10:19.510581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1053, pipe: [1:7556255449624983952:8859]
2025-10-01T14:10:19.581214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:19.581415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.581426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.581458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983952:8859], now have 1 active actors on pipe
2025-10-01T14:10:19.581586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:19.581641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:19.581695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255449624983952:8859]
2025-10-01T14:10:19.581974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:19.582038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1054 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0
2025-10-01T14:10:19.582220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1054 sessionId: src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0 is DEAD
2025-10-01T14:10:19.582309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:19.582316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0] Write session will restart in 0.008419s
2025-10-01T14:10:19.582340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0] Write session: Do CDS request
2025-10-01T14:10:19.582345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:19.590436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:19.591990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.592064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:19.592076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1055
2025-10-01T14:10:19.592193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.592223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:19.592232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:19.592235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:19.592580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1055 sessionId:  describe result for acl check
2025-10-01T14:10:19.592609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:19.592615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:19.592668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:19.592680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255449624984048:9172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:19.592795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:19.592935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:19.592944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:19.592951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:19.592984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:19.593013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255447248106959:7982]
2025-10-01T14:10:19.593136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255449624984048:9172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:19.593395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:19.593577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:19.593603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:19.593792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:19.593833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.593838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.593839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.593839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.593840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.593841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.593842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.593842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.593843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.593843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.593844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.593845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.593846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.593846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.593849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.593854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.593856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.593859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.593861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.593863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.593865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.593867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.593869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.593871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.593873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.593875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.593877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.593879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.593883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.593887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.593891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.593894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.593897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.593899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.593902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.593905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.593907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.593909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.593912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.593914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.593917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.593920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.593922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.593925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.593928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.593931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.593934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.593937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.593939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.593942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.593944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.593946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.593948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.593951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.593954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.593956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.593977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:19.595056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255449624984048:9172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:19.597327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255449624984048:9172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:19.597338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255449624984048:9172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:19.597340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255449624984048:9172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:19.597346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:19.597378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:19.597917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:19.597929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:19.597930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:19.597932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:19.597937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1054 [2:7556255447248106959:7982]
2025-10-01T14:10:19.597946Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:19.597962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:19.597967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.597969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.597971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.597982Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:19.597989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:19.597993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:19.598035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.598040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.598041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.598043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:19.598045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:19.598086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:19.598091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.598098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.598106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.598124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:19.598143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624983953:2446], now have 1 active actors on pipe
2025-10-01T14:10:19.598150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624984087:9172], now have 1 active actors on pipe
2025-10-01T14:10:19.598157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255447248106954:7982]
2025-10-01T14:10:19.598162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255447248106954:7982]
2025-10-01T14:10:19.598151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1054
2025-10-01T14:10:19.598164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255447248106954:7982]
2025-10-01T14:10:19.598176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:19.598176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1054
2025-10-01T14:10:19.598181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:19.598187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:19.598187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:19.598189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:19.598199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:19.598202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:19.598229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.598236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.598249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255447248106954:7982]
2025-10-01T14:10:19.598257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:19.598276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:19.598277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:19.598282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.598285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.598286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:19.598291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.598298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:19.598336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.598445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.598455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.598469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.598546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1055 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0
2025-10-01T14:10:19.599042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f149fd9d-7c4057dd-dcd33ec6-bcf2bf0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:19.601260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0] Write session: try to update token
2025-10-01T14:10:19.601274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:19.613286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1055 sessionId: src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:19.615458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:19.617650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.617676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.617698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:19.617701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:19.617703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:19.617705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:19.617714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255447248106954:7982]
2025-10-01T14:10:19.617718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255447248106954:7982]
2025-10-01T14:10:19.617722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255447248106954:7982]
2025-10-01T14:10:19.617767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:19.617779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:19.617781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:19.617782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:19.617788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.617790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:19.617925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:19.681783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255449624984095:8859]
2025-10-01T14:10:19.682026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1054, pipe: [1:7556255449624984095:8859]
2025-10-01T14:10:19.753673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:19.754430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:19.754478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624984095:8859], now have 1 active actors on pipe
2025-10-01T14:10:19.754552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:19.754643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255449624984095:8859]
2025-10-01T14:10:19.754667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:19.762687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:19.763076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:19.763093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:19.763108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1055 reason: error at write: Disconnected sessionId: src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0
2025-10-01T14:10:19.763249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1055 sessionId: src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0 is DEAD
2025-10-01T14:10:19.763385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:19.763392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0] Write session will restart in 0.007842s
2025-10-01T14:10:19.763418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0] Write session: Do CDS request
2025-10-01T14:10:19.763423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:19.766004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:19.766159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:19.766167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:19.766175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:19.766203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:19.766252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255447248107121:7989]
2025-10-01T14:10:19.766715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:19.766920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:19.766945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:19.767118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:19.767150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.767154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.767155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.767155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.767156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.767157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.767158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.767158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.767159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.767160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.767160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.767161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.767161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.767162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.767164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.767170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.767172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.767174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.767176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.767178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.767180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.767181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.767183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.767185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.767187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.767189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.767191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.767193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.767197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.767202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.767205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.767208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.767211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.767213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.767216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.767218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.767221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.767223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.767226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.767228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.767231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.767234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.767236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.767239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.767241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.767244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.767247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.767249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.767251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.767254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.767256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.767258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.767260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.767263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.767265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.767271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.767290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:19.770729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:19.771235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:19.771242Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:19.771243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:19.771246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:19.771249Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1055 [2:7556255447248107121:7989]
2025-10-01T14:10:19.771257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:19.771268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:19.771273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.771275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.771276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.771286Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:19.771291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:19.771296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:19.771329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.771333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.771334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.771336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:19.771338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:19.771381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:19.771386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.771392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.771398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.771406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:19.771421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624984098:2446], now have 1 active actors on pipe
2025-10-01T14:10:19.771429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255447248107116:7989]
2025-10-01T14:10:19.771433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255447248107116:7989]
2025-10-01T14:10:19.771434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255447248107116:7989]
2025-10-01T14:10:19.771442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:19.771454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:19.771456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:19.771456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:19.771458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:19.771463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:19.771465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:19.771479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255447248107116:7989]
2025-10-01T14:10:19.771480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:19.771481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:19.771499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1055
2025-10-01T14:10:19.772795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.772871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:19.772881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1056
2025-10-01T14:10:19.773048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.773070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:19.773073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:19.773075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:19.773397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1056 sessionId:  describe result for acl check
2025-10-01T14:10:19.773436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:19.773442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:19.773444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:19.773448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255449624984216:9178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:19.773891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255449624984216:9178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:19.775571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255449624984216:9178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:19.780433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255449624984216:9178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:19.780448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255449624984216:9178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:19.780451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255449624984216:9178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:19.780459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:19.780661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624984250:9178], now have 1 active actors on pipe
2025-10-01T14:10:19.780697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1055
2025-10-01T14:10:19.780820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.780830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.780857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6704252-77d48ddb-1595976a-fe2e0314_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:19.780868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.780875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.780878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:19.780889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.780909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:19.780927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.781100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.781106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.781115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.781175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1056 partition: 0 MaxSeqNo: 45 sessionId: src_id|a6704252-77d48ddb-1595976a-fe2e0314_0
2025-10-01T14:10:19.781437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3c2c7e-244a366b-1e8e3988-6a6b3b1b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a6704252-77d48ddb-1595976a-fe2e0314_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:19.783615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6704252-77d48ddb-1595976a-fe2e0314_0] Write session: try to update token
2025-10-01T14:10:19.783628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6704252-77d48ddb-1595976a-fe2e0314_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:19.790337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:19.790352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:19.790353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:19.790355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:19.790362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255447248107116:7989]
2025-10-01T14:10:19.790365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255447248107116:7989]
2025-10-01T14:10:19.790367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255447248107116:7989]
2025-10-01T14:10:19.790427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:19.790433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:19.790435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.790437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:19.790444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:19.790454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:19.790550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:19.795750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1056 sessionId: src_id|a6704252-77d48ddb-1595976a-fe2e0314_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:19.797990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:19.854873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255449624984254:8859]
2025-10-01T14:10:19.855076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1055, pipe: [1:7556255449624984254:8859]
2025-10-01T14:10:19.920093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:19.920485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.920497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.920515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624984254:8859], now have 1 active actors on pipe
2025-10-01T14:10:19.920670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:19.920748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255449624984254:8859]
2025-10-01T14:10:19.920752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:19.920781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:19.920839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1056 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6704252-77d48ddb-1595976a-fe2e0314_0
2025-10-01T14:10:19.921026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1056 sessionId: src_id|a6704252-77d48ddb-1595976a-fe2e0314_0 is DEAD
2025-10-01T14:10:19.921163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6704252-77d48ddb-1595976a-fe2e0314_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:19.921174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6704252-77d48ddb-1595976a-fe2e0314_0] Write session will restart in 0.007075s
2025-10-01T14:10:19.921199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6704252-77d48ddb-1595976a-fe2e0314_0] Write session: Do CDS request
2025-10-01T14:10:19.921205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6704252-77d48ddb-1595976a-fe2e0314_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:19.928400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:19.929778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6704252-77d48ddb-1595976a-fe2e0314_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.929871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:19.929886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1057
2025-10-01T14:10:19.929967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:19.929988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:19.929995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:19.929998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:19.930276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1057 sessionId:  describe result for acl check
2025-10-01T14:10:19.930296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:19.930300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:19.930301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:19.930304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255449624984352:9182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:19.930542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:19.930662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:19.930671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:19.930675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255449624984352:9182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:19.930682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:19.930723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:19.930746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255447248107258:7992]
2025-10-01T14:10:19.931104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:19.931302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:19.931327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:19.931508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:19.931540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.931544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.931544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.931545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.931545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.931546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.931546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.931547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.931547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.931548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.931548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.931549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.931549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.931550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.931553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.931558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.931560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.931562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.931564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.931566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.931568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.931570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.931572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.931574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.931576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.931578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.931580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.931582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.931585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.931589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:19.931593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.931596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:19.931598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.931601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:19.931603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.931606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:19.931608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.931611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:19.931613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.931616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:19.931618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.931621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:19.931624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.931626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:19.931628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.931635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:19.931637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.931640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.931642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.931646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.931648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.931650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.931654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.931656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:19.931659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.931661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:19.931680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:19.932057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255449624984352:9182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:19.934641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255449624984352:9182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:19.934651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255449624984352:9182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:19.934654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255449624984352:9182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:19.934659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:19.934906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:19.935463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:19.935474Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:19.935475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:19.935477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:19.935482Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1056 [2:7556255447248107258:7992]
2025-10-01T14:10:19.935644Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:19.935657Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:19.935659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.935661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.935662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.935672Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:19.935675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:19.935679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:19.935712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.935718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.935719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.935721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:19.935722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:19.935770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:19.935775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.935782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:19.935787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:19.935796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:19.935808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624984255:2446], now have 1 active actors on pipe
2025-10-01T14:10:19.935813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255449624984391:9182], now have 1 active actors on pipe
2025-10-01T14:10:19.935818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255447248107253:7992]
2025-10-01T14:10:19.935820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255447248107253:7992]
2025-10-01T14:10:19.935821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255447248107253:7992]
2025-10-01T14:10:19.935829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:19.935841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:19.935849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:19.935850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:19.935852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:19.935857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:19.935848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1056
2025-10-01T14:10:19.935850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1056
2025-10-01T14:10:19.935859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:19.935869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255447248107253:7992]
2025-10-01T14:10:19.935870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:19.935872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:19.936009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.936015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.936032Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cab5f1e8-fef92383-267d7f7e-74103350_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:19.936038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:19.936044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:19.936046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:19.936051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:19.936056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:19.936070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.936203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.936208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.936217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:19.936275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1057 partition: 0 MaxSeqNo: 45 sessionId: src_id|cab5f1e8-fef92383-267d7f7e-74103350_0
2025-10-01T14:10:19.936519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6704252-77d48ddb-1595976a-fe2e0314_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cab5f1e8-fef92383-267d7f7e-74103350_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:19.938659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab5f1e8-fef92383-267d7f7e-74103350_0] Write session: try to update token
2025-10-01T14:10:19.938672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab5f1e8-fef92383-267d7f7e-74103350_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:19.950915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1057 sessionId: src_id|cab5f1e8-fef92383-267d7f7e-74103350_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:19.952893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:19.954242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:19.954263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:19.954278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:19.954281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:19.954285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:19.954286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:19.954292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255447248107253:7992]
2025-10-01T14:10:19.954295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255447248107253:7992]
2025-10-01T14:10:19.954297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255447248107253:7992]
2025-10-01T14:10:19.954325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:19.954335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:19.954337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:19.954337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:19.954342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:19.954343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:19.954483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:20.020773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255453919951695:8859]
2025-10-01T14:10:20.021003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1056, pipe: [1:7556255453919951695:8859]
2025-10-01T14:10:20.084602Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:20.084808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:20.084852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919951695:8859], now have 1 active actors on pipe
2025-10-01T14:10:20.084907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:20.085039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255453919951695:8859]
2025-10-01T14:10:20.085065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:20.092850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:20.092863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:20.092880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1057 reason: error at write: Disconnected sessionId: src_id|cab5f1e8-fef92383-267d7f7e-74103350_0
2025-10-01T14:10:20.093019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1057 sessionId: src_id|cab5f1e8-fef92383-267d7f7e-74103350_0 is DEAD
2025-10-01T14:10:20.093152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab5f1e8-fef92383-267d7f7e-74103350_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:20.093163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab5f1e8-fef92383-267d7f7e-74103350_0] Write session will restart in 0.005359s
2025-10-01T14:10:20.093187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab5f1e8-fef92383-267d7f7e-74103350_0] Write session: Do CDS request
2025-10-01T14:10:20.093196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab5f1e8-fef92383-267d7f7e-74103350_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:20.096641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:20.098599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:20.098774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:20.098785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:20.098796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:20.098844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:20.098882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255451543074691:7994]
2025-10-01T14:10:20.099423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:20.099654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:20.099690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:20.099794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab5f1e8-fef92383-267d7f7e-74103350_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.099857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:20.099870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1058
2025-10-01T14:10:20.099958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.099984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:20.099992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:20.099996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:20.099992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:20.100028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.100032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.100033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.100034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.100034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.100035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.100036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.100036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.100037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.100038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.100039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.100040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.100040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.100041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.100045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.100050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.100052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.100055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.100057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.100059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.100061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.100063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.100065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.100068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.100070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.100072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.100074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.100077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.100082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.100086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.100089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.100093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.100099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.100102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.100104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.100107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.100113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.100116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.100118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.100124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.100126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.100129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.100134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.100137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.100140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.100142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.100145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.100151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.100153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.100156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.100162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.100165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.100167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.100170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.100175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.100178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.100211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:20.100247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1058 sessionId:  describe result for acl check
2025-10-01T14:10:20.100271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:20.100274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:20.100275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:20.100279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255453919951798:9186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:20.100642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255453919951798:9186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:20.102367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255453919951798:9186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:20.103581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:20.104407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:20.104419Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:20.104421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:20.104423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:20.104427Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1057 [2:7556255451543074691:7994]
2025-10-01T14:10:20.104436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:20.104447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:20.104449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.104451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.104452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.104462Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:20.104464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:20.104469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:20.104515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.104522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.104523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.104525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:20.104527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:20.104572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:20.104577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.104583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.104588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.104597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:20.104611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255451543074685:7994]
2025-10-01T14:10:20.104616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255451543074685:7994]
2025-10-01T14:10:20.104618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255451543074685:7994]
2025-10-01T14:10:20.104623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:20.104631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:20.104633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919951696:2446], now have 1 active actors on pipe
2025-10-01T14:10:20.104638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:20.104639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:20.104640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:20.104646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:20.104648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:20.104642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255453919951798:9186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:20.104642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1057
2025-10-01T14:10:20.104665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255451543074685:7994]
2025-10-01T14:10:20.104655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255453919951798:9186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:20.104673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:20.104658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255453919951798:9186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:20.104664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:20.104686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:20.104855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919951834:9186], now have 1 active actors on pipe
2025-10-01T14:10:20.104882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1057
2025-10-01T14:10:20.104928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.104934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.104949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:20.104958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.104966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.104967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:20.104974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.104983Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:20.104997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.105101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.105107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.105117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.105186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1058 partition: 0 MaxSeqNo: 45 sessionId: src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0
2025-10-01T14:10:20.105433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab5f1e8-fef92383-267d7f7e-74103350_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:20.108220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0] Write session: try to update token
2025-10-01T14:10:20.108239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:20.120516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1058 sessionId: src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:20.122672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:20.123801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.123821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.123838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:20.123840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:20.123842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:20.123843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:20.123849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255451543074685:7994]
2025-10-01T14:10:20.123852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255451543074685:7994]
2025-10-01T14:10:20.123854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255451543074685:7994]
2025-10-01T14:10:20.123885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:20.123894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:20.123894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:20.123897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:20.123898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.123900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:20.124009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:20.185072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255453919951842:8859]
2025-10-01T14:10:20.185308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1057, pipe: [1:7556255453919951842:8859]
2025-10-01T14:10:20.258481Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:20.258665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:20.258704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919951842:8859], now have 1 active actors on pipe
2025-10-01T14:10:20.258749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:20.258830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:20.258878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255453919951842:8859]
2025-10-01T14:10:20.266570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:20.266582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:20.266600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1058 reason: error at write: Disconnected sessionId: src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0
2025-10-01T14:10:20.266730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1058 sessionId: src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0 is DEAD
2025-10-01T14:10:20.266888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:20.266897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0] Write session will restart in 0.009750s
2025-10-01T14:10:20.266915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0] Write session: Do CDS request
2025-10-01T14:10:20.266923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:20.271584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:20.271930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:20.272053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:20.272060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:20.272068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:20.272097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:20.272121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255451543074828:7996]
2025-10-01T14:10:20.272476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:20.272690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:20.272717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:20.272908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:20.272941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.272945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.272945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.272946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.272946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.272947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.272948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.272948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.272949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.272949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.272950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.272951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.272951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.272952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.272954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.272960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.272963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.272965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.272967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.272969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.272971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.272972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.272974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.272976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.272979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.272981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.272982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.272984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.272990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.272994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.272998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.273001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.273003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.273006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.273008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.273011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.273013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.273016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.273018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.273021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.273024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.273026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.273029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.273031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.273033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.273037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.273039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.273042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.273044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.273047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.273049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.273052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.273054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.273056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.273058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.273061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.273080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:20.276184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:20.276815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:20.276827Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:20.276829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:20.276830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:20.276835Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1058 [2:7556255451543074828:7996]
2025-10-01T14:10:20.276843Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:20.276857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:20.276862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.276864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.276865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.276875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:20.276881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:20.276884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:20.276918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.276922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.276923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.276926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:20.276927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:20.276982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:20.276984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.276993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.277003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.277016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:20.277031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919951843:2446], now have 1 active actors on pipe
2025-10-01T14:10:20.277037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255451543074823:7996]
2025-10-01T14:10:20.277038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255451543074823:7996]
2025-10-01T14:10:20.277040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255451543074823:7996]
2025-10-01T14:10:20.277052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:20.277063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:20.277063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:20.277065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:20.277067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:20.277074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:20.277076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:20.277094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255451543074823:7996]
2025-10-01T14:10:20.277099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:20.277103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:20.277296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1058
2025-10-01T14:10:20.277821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.277875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:20.277881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1059
2025-10-01T14:10:20.278030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.278052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:20.278055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:20.278057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:20.278383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1059 sessionId:  describe result for acl check
2025-10-01T14:10:20.278412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:20.278414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:20.278415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:20.278421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255453919951952:9190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:20.278899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255453919951952:9190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:20.280695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255453919951952:9190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:20.285530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255453919951952:9190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:20.285545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255453919951952:9190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:20.285548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255453919951952:9190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:20.285556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:20.285749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1058
2025-10-01T14:10:20.285751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919951986:9190], now have 1 active actors on pipe
2025-10-01T14:10:20.285781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.285788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.285812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:20.285822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.285833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.285836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:20.285849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.285867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:20.285888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.285994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.286002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.291326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.291355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:20.291358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:20.291363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255451543074823:7996]
2025-10-01T14:10:20.291387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:20.291392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:20.291441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1059 partition: 0 MaxSeqNo: 45 sessionId: src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0
2025-10-01T14:10:20.291535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:20.291652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:20.291757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62944a3c-f8b3a388-a35d14f6-dc363420_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:20.291761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:20.291874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:20.292026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:20.292057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:20.293890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0] Write session: try to update token
2025-10-01T14:10:20.293903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:20.304640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:20.304661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:20.304663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:20.304664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:20.304673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255451543074823:7996]
2025-10-01T14:10:20.304676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255451543074823:7996]
2025-10-01T14:10:20.304678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255451543074823:7996]
2025-10-01T14:10:20.304709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:20.304712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:20.304714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:20.304716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:20.304717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.304719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:20.304849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:20.305348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1059 sessionId: src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:20.307506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:20.359181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255453919951998:8859]
2025-10-01T14:10:20.359434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1058, pipe: [1:7556255453919951998:8859]
2025-10-01T14:10:20.439999Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:20.440401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.440416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.440436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919951998:8859], now have 1 active actors on pipe
2025-10-01T14:10:20.440611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:20.440673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255453919951998:8859]
2025-10-01T14:10:20.440699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:20.440834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:20.440912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1059 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0
2025-10-01T14:10:20.441114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1059 sessionId: src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0 is DEAD
2025-10-01T14:10:20.441260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:20.441268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0] Write session will restart in 0.007153s
2025-10-01T14:10:20.441287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0] Write session: Do CDS request
2025-10-01T14:10:20.441292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:20.449291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:20.449817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.449940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:20.449958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1060
2025-10-01T14:10:20.450047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.450077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:20.450085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:20.450089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:20.450426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1060 sessionId:  describe result for acl check
2025-10-01T14:10:20.450463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:20.450469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:20.450471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:20.450476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255453919952113:9201] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:20.450960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255453919952113:9201] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:20.451974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:20.452183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:20.452192Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:20.452203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:20.452251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:20.452288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255451543074967:7999]
2025-10-01T14:10:20.452594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255453919952113:9201] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:20.452907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:20.453128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:20.453166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:20.453460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:20.453508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.453514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.453515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.453516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.453517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.453518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.453519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.453520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.453521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.453522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.453523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.453524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.453525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.453526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.453531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.453542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.453545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.453550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.453554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.453561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.453565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.453568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.453576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.453579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.453582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.453589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.453593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.453600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.453605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.453616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.453625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.453633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.453643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.453652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.453659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.453665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.453672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.453681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.453688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.453693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.453701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.453709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.453718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.453726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.453734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.453738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.453746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.453750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.453754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.453759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.453766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.453771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.453776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.453782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.453790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.453794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.453832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:20.457000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255453919952113:9201] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:20.457017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255453919952113:9201] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:20.457021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255453919952113:9201] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:20.457029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:20.457128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:20.457856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:20.457869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:20.457872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:20.457875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:20.457881Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1059 [2:7556255451543074967:7999]
2025-10-01T14:10:20.457894Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:20.457912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:20.457919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.457922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.457927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.457944Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:20.457952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:20.457957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:20.458005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.458011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.458013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.458016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:20.458018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:20.458079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:20.458087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.458097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.458107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.458123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:20.458140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919951999:2446], now have 1 active actors on pipe
2025-10-01T14:10:20.458147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952151:9201], now have 1 active actors on pipe
2025-10-01T14:10:20.458154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255451543074962:7999]
2025-10-01T14:10:20.458160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255451543074962:7999]
2025-10-01T14:10:20.458162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255451543074962:7999]
2025-10-01T14:10:20.458174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:20.458184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:20.458190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:20.458190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:20.458191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:20.458204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:20.458211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:20.458208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1059
2025-10-01T14:10:20.458231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255451543074962:7999]
2025-10-01T14:10:20.458237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:20.458239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:20.458242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1059
2025-10-01T14:10:20.458270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.458278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.458305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:20.458316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.458323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.458325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:20.458337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.458347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:20.458362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.458517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.458523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.458536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.458614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1060 partition: 0 MaxSeqNo: 45 sessionId: src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0
2025-10-01T14:10:20.458938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5108ca8a-6d64cf48-3a50eabd-5f63fb19_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:20.461130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0] Write session: try to update token
2025-10-01T14:10:20.461143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:20.474792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1060 sessionId: src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:20.477068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:20.477111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:20.477127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:20.477129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:20.477130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:20.477135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255451543074962:7999]
2025-10-01T14:10:20.477138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255451543074962:7999]
2025-10-01T14:10:20.477140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255451543074962:7999]
2025-10-01T14:10:20.477163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:20.477167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:20.477169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:20.477197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.477212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.477236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:20.477248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.477250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:20.477419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:20.540959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255453919952169:8859]
2025-10-01T14:10:20.541207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1059, pipe: [1:7556255453919952169:8859]
2025-10-01T14:10:20.612442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:20.612684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952169:8859], now have 1 active actors on pipe
2025-10-01T14:10:20.612828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:20.612866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255453919952169:8859]
2025-10-01T14:10:20.612892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:20.612894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:20.612947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1060 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0
2025-10-01T14:10:20.613122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1060 sessionId: src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0 is DEAD
2025-10-01T14:10:20.613273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:20.613284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0] Write session will restart in 0.008617s
2025-10-01T14:10:20.613309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0] Write session: Do CDS request
2025-10-01T14:10:20.613315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:20.621111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:20.622760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.622846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:20.622860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1061
2025-10-01T14:10:20.622948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.622970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:20.622976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:20.622979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:20.623233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1061 sessionId:  describe result for acl check
2025-10-01T14:10:20.623259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:20.623264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:20.623266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:20.623269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255453919952272:9206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:20.623587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:20.623634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255453919952272:9206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:20.623707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:20.623715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:20.623723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:20.623751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:20.623777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255451543075126:8009]
2025-10-01T14:10:20.624122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:20.624306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:20.624330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:20.624504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:20.624537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.624541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.624542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.624542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.624543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.624543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.624544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.624545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.624545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.624546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.624546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.624547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.624547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.624548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.624551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.624556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.624558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.624560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.624562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.624564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.624566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.624568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.624570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.624573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.624575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.624577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.624579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.624581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.624584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.624588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.624592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.624594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.624598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.624601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.624603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.624606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.624609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.624611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.624613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.624616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.624618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.624621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.624627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.624629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.624631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.624633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.624635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.624638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.624643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.624646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.624647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.624650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.624652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.624657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.624660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.624662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.624682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:20.625334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255453919952272:9206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:20.627566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255453919952272:9206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:20.627575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255453919952272:9206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:20.627577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255453919952272:9206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:20.627581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:20.627763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:20.628439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:20.628450Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:20.628451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:20.628453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:20.628457Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1060 [2:7556255451543075126:8009]
2025-10-01T14:10:20.628465Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:20.628475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:20.628477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.628479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.628480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.628490Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:20.628496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:20.628500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:20.628535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.628540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.628541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.628543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:20.628544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:20.628596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:20.628603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.628614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.628628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.628645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:20.628664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952310:9206], now have 1 active actors on pipe
2025-10-01T14:10:20.628670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952170:2446], now have 1 active actors on pipe
2025-10-01T14:10:20.628675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255451543075121:8009]
2025-10-01T14:10:20.628679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255451543075121:8009]
2025-10-01T14:10:20.628681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255451543075121:8009]
2025-10-01T14:10:20.628679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1060
2025-10-01T14:10:20.628695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:20.628692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1060
2025-10-01T14:10:20.628706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:20.628709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:20.628714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:20.628715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:20.628730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:20.628732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:20.628744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.628751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.628774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255451543075121:8009]
2025-10-01T14:10:20.628782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:20.628792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:20.628792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:20.628799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.628802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.628803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:20.628809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.628817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:20.628844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.628955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.628961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.628970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.629025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1061 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0
2025-10-01T14:10:20.629273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb773abb-dfb0f065-18c089a-9aff2bdb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:20.631419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0] Write session: try to update token
2025-10-01T14:10:20.631432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:20.643047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1061 sessionId: src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:20.645314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:20.645488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.645508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.645542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:20.645624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:20.647516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:20.647536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:20.647538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:20.647540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:20.647548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255451543075121:8009]
2025-10-01T14:10:20.647552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255451543075121:8009]
2025-10-01T14:10:20.647555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255451543075121:8009]
2025-10-01T14:10:20.647600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:20.647610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:20.647611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.647614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:20.647617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:20.647621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:20.647737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:20.713025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255453919952319:8859]
2025-10-01T14:10:20.713266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1060, pipe: [1:7556255453919952319:8859]
2025-10-01T14:10:20.775932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:10:20.775954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-10-01T14:10:20.783004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:20.789516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.789538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.789668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.789720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.789774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.789824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.789866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.789876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.789933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.789984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.790037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.790090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.790134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.790139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.790189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.790235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.790285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.790331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.790388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.790395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.790455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.790511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.790564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.790617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.790655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.790660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.790710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.790753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.790804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.790852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.790887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.790894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.790945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.790992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.791044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.791094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.791135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.791141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.791193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.791243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.791303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.791364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.791408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.791414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.791470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.791521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.791573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.791622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.791659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.791664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.791719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.791767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.791816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.791869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.791906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.791911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.791971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:20.792035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:20.792085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:20.792135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:20.792171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:20.792176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:20.792212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952319:8859], now have 1 active actors on pipe
2025-10-01T14:10:20.792444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:20.792456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:20.792462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255453919952319:8859]
2025-10-01T14:10:20.792475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1061 reason: error at write: Disconnected sessionId: src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0
2025-10-01T14:10:20.792525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:20.792539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 8
2025-10-01T14:10:20.792629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1061 sessionId: src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0 is DEAD
2025-10-01T14:10:20.792780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:20.792790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0] Write session will restart in 0.007436s
2025-10-01T14:10:20.792814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0] Write session: Do CDS request
2025-10-01T14:10:20.792821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:20.793033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:20.800441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:20.801880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.801949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:20.801970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1062
2025-10-01T14:10:20.802054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.802077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:20.802084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:20.802086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:20.802381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1062 sessionId:  describe result for acl check
2025-10-01T14:10:20.802408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:20.802412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:20.802413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:20.802417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255453919952440:9212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:20.802474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:20.802595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:20.802602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:20.802609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:20.802641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:20.802666Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255451543075296:8017]
2025-10-01T14:10:20.802766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255453919952440:9212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:20.803038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:20.803283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:20.803324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:20.803566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:20.803615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.803619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.803620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.803620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.803621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.803621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.803622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.803622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.803623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.803624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.803624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.803625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.803625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.803626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.803629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.803634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.803636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.803638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.803640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.803642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.803644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.803646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.803648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.803650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.803652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.803654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.803656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.803658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.803662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.803666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.803670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.803673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.803675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.803678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.803680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.803682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.803685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.803687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.803689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.803692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.803695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.803697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.803702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.803706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.803710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.803714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.803718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.803723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.803728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.803736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.803744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.803752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.803760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.803764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.803771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.803776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.803812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:20.804004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255453919952440:9212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:20.806749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255453919952440:9212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:20.806768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255453919952440:9212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:20.806770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255453919952440:9212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:20.806775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:20.807020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:20.807761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:20.807772Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:20.807774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:20.807776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:20.807780Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1061 [2:7556255451543075296:8017]
2025-10-01T14:10:20.807789Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:20.807799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:20.807804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.807807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.807808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.807818Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:20.807820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:20.807824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:20.807857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.807861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.807862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.807865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:20.807867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:20.807910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:20.807915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.807922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.807930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.807942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:20.807957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952338:2446], now have 1 active actors on pipe
2025-10-01T14:10:20.807962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952479:9212], now have 1 active actors on pipe
2025-10-01T14:10:20.807967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255451543075291:8017]
2025-10-01T14:10:20.807971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255451543075291:8017]
2025-10-01T14:10:20.807972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255451543075291:8017]
2025-10-01T14:10:20.807981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:20.807992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:20.807993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:20.807995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:20.807996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:20.808002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:20.808004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:20.807993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1061
2025-10-01T14:10:20.807998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1061
2025-10-01T14:10:20.808018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255451543075291:8017]
2025-10-01T14:10:20.808023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:20.808025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:20.808042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.808048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.808078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:20.808087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.808093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.808095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:20.808100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.808108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:20.808149Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:10:20.808175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.808273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.808280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.808289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.808360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1062 partition: 0 MaxSeqNo: 45 sessionId: src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0
2025-10-01T14:10:20.808536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 10 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:10:20.808563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:10:20.808616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a4759e0-e9fc56e1-6d62608-811dee9b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:20.810964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0] Write session: try to update token
2025-10-01T14:10:20.810982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:20.824299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1062 sessionId: src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:20.826415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:20.826786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.826809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.826827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:20.826830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:20.826831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:20.826833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:20.826838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255451543075291:8017]
2025-10-01T14:10:20.826841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255451543075291:8017]
2025-10-01T14:10:20.826843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255451543075291:8017]
2025-10-01T14:10:20.826880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:20.826883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:20.826888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.826890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:20.826891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:20.826894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:20.827000Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:20.892700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255453919952489:8859]
2025-10-01T14:10:20.892947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1061, pipe: [1:7556255453919952489:8859]
2025-10-01T14:10:20.955898Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:20.956092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:20.956134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952489:8859], now have 1 active actors on pipe
2025-10-01T14:10:20.956214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:20.956298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:20.956335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255453919952489:8859]
2025-10-01T14:10:20.963967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:20.964269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:20.964280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:20.964297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1062 reason: error at write: Disconnected sessionId: src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0
2025-10-01T14:10:20.964423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1062 sessionId: src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0 is DEAD
2025-10-01T14:10:20.964585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:20.964592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0] Write session will restart in 0.006204s
2025-10-01T14:10:20.964618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0] Write session: Do CDS request
2025-10-01T14:10:20.964624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:20.967218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:20.967344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:20.967352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:20.967359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:20.967393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:20.967426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255451543075440:8021]
2025-10-01T14:10:20.967800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:20.967988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:20.968016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:20.968243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:20.968283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.968288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.968289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.968289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.968290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.968291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.968291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.968292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.968292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.968293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.968294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.968294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.968295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.968295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.968299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.968304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.968306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.968308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.968310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.968312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.968314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.968316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.968318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.968320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.968322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.968324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.968326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.968328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.968333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.968338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:20.968341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.968344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:20.968346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.968350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:20.968352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.968355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:20.968357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.968360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:20.968362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.968364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:20.968366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.968369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:20.968371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.968374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:20.968376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.968379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:20.968381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.968384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.968386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.968390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.968395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.968398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.968400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.968403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:20.968408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.968411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:20.968431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:20.971567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:20.971824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:20.971835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1063
2025-10-01T14:10:20.971866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.972042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:20.972073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:20.972080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:20.972083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:20.972098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:20.972108Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:20.972109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:20.972111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:20.972115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1062 [2:7556255451543075440:8021]
2025-10-01T14:10:20.972128Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:20.972145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:20.972152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.972155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.972157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.972171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:20.972181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:20.972185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:20.972217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.972222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.972224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.972225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:20.972227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:20.972331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1063 sessionId:  describe result for acl check
2025-10-01T14:10:20.972338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1062
2025-10-01T14:10:20.972358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:20.972363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:20.972364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:20.972367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255453919952605:9216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:20.972270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:20.972276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.972282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:20.972287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:20.972296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:20.972308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952497:2446], now have 1 active actors on pipe
2025-10-01T14:10:20.972314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255451543075435:8021]
2025-10-01T14:10:20.972316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255451543075435:8021]
2025-10-01T14:10:20.972317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255451543075435:8021]
2025-10-01T14:10:20.972329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:20.972339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:20.972341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:20.972342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:20.972343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:20.972354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:20.972357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:20.972381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255451543075435:8021]
2025-10-01T14:10:20.972389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:20.972401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:20.972707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255453919952605:9216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:20.973946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255453919952605:9216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:20.978031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255453919952605:9216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:20.978042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255453919952605:9216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:20.978044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255453919952605:9216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:20.978049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:20.978211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255453919952640:9216], now have 1 active actors on pipe
2025-10-01T14:10:20.978225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1062
2025-10-01T14:10:20.978310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.978323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.978348Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8816066-9f9191ef-e3139768-83e0befd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:20.978359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:20.978363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:20.978365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:20.978387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:20.978402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:20.978419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.978703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.978708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.978718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:20.978771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1063 partition: 0 MaxSeqNo: 45 sessionId: src_id|d8816066-9f9191ef-e3139768-83e0befd_0
2025-10-01T14:10:20.979003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a23e8624-ec0a135d-e5b7b0cb-340e7966_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d8816066-9f9191ef-e3139768-83e0befd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:20.981206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8816066-9f9191ef-e3139768-83e0befd_0] Write session: try to update token
2025-10-01T14:10:20.981218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8816066-9f9191ef-e3139768-83e0befd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:20.981754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:20.981767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:20.981773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255451543075435:8021]
2025-10-01T14:10:20.981799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:20.981800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:20.981936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:20.982047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:20.982155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:20.982259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:20.982446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:20.982472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:20.994440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1063 sessionId: src_id|d8816066-9f9191ef-e3139768-83e0befd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:20.996644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:20.996865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:20.996890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:20.996924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:20.997019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:20.999220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:20.999234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:20.999236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:20.999238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:20.999248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255451543075435:8021]
2025-10-01T14:10:20.999254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255451543075435:8021]
2025-10-01T14:10:20.999260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255451543075435:8021]
2025-10-01T14:10:20.999293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:20.999301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:20.999303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:20.999312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:20.999327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:20.999330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:20.999420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:21.056540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255458214919939:8859]
2025-10-01T14:10:21.056835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1062, pipe: [1:7556255458214919939:8859]
2025-10-01T14:10:21.127456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:21.133968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.133992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.134118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.134165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.134216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.134263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.134302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.134310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.134363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.134435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.134482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.134530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.134567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.134573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.134629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.134680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.134733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.134791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.134829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.134835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.134888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.134935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.134997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.135049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.135088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.135093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.135143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.135193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.135242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.135291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.135329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.135334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.135385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.135435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.135484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.135535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.135572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.135577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.135629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.135678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.135727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.135777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.135821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.135825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.135878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.135927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.135977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.136026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.136062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.136068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.136120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.136169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.136218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.136265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.136301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.136306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.136356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.136404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.136453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.136502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.136539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.136544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.136579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214919939:8859], now have 1 active actors on pipe
2025-10-01T14:10:21.136820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:21.136825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:21.136829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:21.136857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1063 reason: error at write: Disconnected sessionId: src_id|d8816066-9f9191ef-e3139768-83e0befd_0
2025-10-01T14:10:21.136888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255458214919939:8859]
2025-10-01T14:10:21.137064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1063 sessionId: src_id|d8816066-9f9191ef-e3139768-83e0befd_0 is DEAD
2025-10-01T14:10:21.137180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8816066-9f9191ef-e3139768-83e0befd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:21.137185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8816066-9f9191ef-e3139768-83e0befd_0] Write session will restart in 0.005489s
2025-10-01T14:10:21.137204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8816066-9f9191ef-e3139768-83e0befd_0] Write session: Do CDS request
2025-10-01T14:10:21.137208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8816066-9f9191ef-e3139768-83e0befd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:21.137247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:21.143861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8816066-9f9191ef-e3139768-83e0befd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.143875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:21.143889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1064
2025-10-01T14:10:21.144059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.144082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:21.144085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:21.144088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:21.144364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1064 sessionId:  describe result for acl check
2025-10-01T14:10:21.144392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:21.144396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:21.144398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:21.144401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255458214920043:9220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:21.144788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255458214920043:9220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:21.146296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255458214920043:9220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:21.148426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255458214920043:9220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:21.148446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255458214920043:9220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:21.148448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255458214920043:9220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:21.148453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:21.148441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:21.148788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:21.148962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:21.148975Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:21.148987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:21.149042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:21.149078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255455838042880:8023]
2025-10-01T14:10:21.149624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:21.149913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:21.149967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:21.150260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:21.150331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.150338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.150339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.150340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.150341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.150342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.150343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.150344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.150345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.150346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.150347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.150348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.150349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.150350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.150356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.150366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.150386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.150395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.150403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.150407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.150411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.150418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.150421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.150429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.150437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.150441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.150449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.150456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.150463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.150474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.150483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.150492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.150503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.150512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.150520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.150529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.150538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.150546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.150554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.150560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.150568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.150577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.150581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.150586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.150594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.150603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.150607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.150612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.150616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.150626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.150634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.150643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.150651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.150660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.150668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.150676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.150718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:21.154100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:21.154744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:21.154761Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:21.154764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:21.154768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:21.154775Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1063 [2:7556255455838042880:8023]
2025-10-01T14:10:21.154789Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:21.154812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:21.154820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.154824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.154826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.154839Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:21.154844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:21.154854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:21.154908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.154915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.154917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.154920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:21.154922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:21.154984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:21.154992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.155005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.155020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.155039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:21.155060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214919942:2446], now have 1 active actors on pipe
2025-10-01T14:10:21.155070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920079:9220], now have 1 active actors on pipe
2025-10-01T14:10:21.155078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255455838042873:8023]
2025-10-01T14:10:21.155082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255455838042873:8023]
2025-10-01T14:10:21.155084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255455838042873:8023]
2025-10-01T14:10:21.155098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:21.155111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:21.155121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:21.155129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:21.155132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:21.155132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:21.155134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:21.155132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1063
2025-10-01T14:10:21.155156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255455838042873:8023]
2025-10-01T14:10:21.155133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1063
2025-10-01T14:10:21.155163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:21.155165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:21.155187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.155195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.155232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:21.155243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.155246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.155249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:21.155259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.155271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:21.155295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.155475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.155488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.155505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.155582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1064 partition: 0 MaxSeqNo: 45 sessionId: src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0
2025-10-01T14:10:21.155881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8816066-9f9191ef-e3139768-83e0befd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:21.158063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0] Write session: try to update token
2025-10-01T14:10:21.158074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:21.170272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1064 sessionId: src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:21.172313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:21.172455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.172481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.174255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:21.174274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:21.174276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:21.174278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:21.174287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255455838042873:8023]
2025-10-01T14:10:21.174298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255455838042873:8023]
2025-10-01T14:10:21.174306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255455838042873:8023]
2025-10-01T14:10:21.174350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:21.174383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:21.174388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:21.174395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.174397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:21.174399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:21.174403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:21.174448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:21.174522Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:21.237293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255458214920092:8859]
2025-10-01T14:10:21.237524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1063, pipe: [1:7556255458214920092:8859]
2025-10-01T14:10:21.311365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:21.317787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.317809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.317938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.317989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.318042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.318092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.318134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.318142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.318202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.318262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.318315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.318379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.318418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.318423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.318473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.318521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.318570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.318617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.318654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.318658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.318713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.318763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.318810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.318860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.318896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.318901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.318950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.318996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.319044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.319092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.319129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.319134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.319183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.319229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.319290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.319351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.319392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.319397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.319448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.319494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.319544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.319591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.319633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.319639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.319687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.319737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.319784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.319836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.319871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.319876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.319927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.319975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.320027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.320079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.320116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.320121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.320173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.320219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.320270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.320322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.320364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.320372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.320412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920092:8859], now have 1 active actors on pipe
2025-10-01T14:10:21.320604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255458214920092:8859]
2025-10-01T14:10:21.320615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:21.320631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:21.320636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:21.320656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1064 reason: error at write: Disconnected sessionId: src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0
2025-10-01T14:10:21.320842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1064 sessionId: src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0 is DEAD
2025-10-01T14:10:21.320956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:21.320964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0] Write session will restart in 0.008633s
2025-10-01T14:10:21.320981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0] Write session: Do CDS request
2025-10-01T14:10:21.320985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:21.321177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:21.330353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:21.330679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:21.330744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.330793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:21.330801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:21.330809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:21.330840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:21.330869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255455838043022:8025]
2025-10-01T14:10:21.330869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:21.330886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1065
2025-10-01T14:10:21.330994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.331024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:21.331029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:21.331032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:21.331303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:21.331384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1065 sessionId:  describe result for acl check
2025-10-01T14:10:21.331415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:21.331420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:21.331422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:21.331426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255458214920205:9225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:21.331543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:21.331570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:21.331770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:21.331803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.331807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.331808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.331809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.331809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.331810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.331811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.331811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.331812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.331813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.331813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.331814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.331814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.331815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.331818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.331823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.331826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.331828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.331830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.331832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.331834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.331836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.331838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.331840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.331842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.331844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.331846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.331848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.331853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.331857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.331861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.331863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.331866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.331868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.331871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.331888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255458214920205:9225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:21.331873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.331876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.331879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.331881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.331883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.331886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.331889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.331891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.331893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.331896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.331898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.331900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.331903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.331905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.331908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.331911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.331914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.331916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.331919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.331922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.331924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.331952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:21.333956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255458214920205:9225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:21.335265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:21.335810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:21.335820Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:21.335822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:21.335824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:21.335830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1064 [2:7556255455838043022:8025]
2025-10-01T14:10:21.335843Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:21.335856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:21.335859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.335862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.335864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.335874Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:21.335880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:21.335884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:21.335921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.335927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.335928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.335929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:21.335931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:21.335975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:21.335980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.335987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.335992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.336003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:21.336017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920100:2446], now have 1 active actors on pipe
2025-10-01T14:10:21.336026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255455838043017:8025]
2025-10-01T14:10:21.336027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255455838043017:8025]
2025-10-01T14:10:21.336030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255455838043017:8025]
2025-10-01T14:10:21.336038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:21.336035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1064
2025-10-01T14:10:21.336049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:21.336052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:21.336054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:21.336055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:21.336061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:21.336063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:21.336059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255458214920205:9225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:21.336072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255458214920205:9225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:21.336075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255458214920205:9225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:21.336081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255455838043017:8025]
2025-10-01T14:10:21.336087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:21.336082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:21.336092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:21.336256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1064
2025-10-01T14:10:21.336292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920243:9225], now have 1 active actors on pipe
2025-10-01T14:10:21.336305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.336307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.336323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:21.336331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.336333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.336335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:21.336343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.336354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:21.336371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.336505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.336510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.336519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.336570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1065 partition: 0 MaxSeqNo: 45 sessionId: src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0
2025-10-01T14:10:21.336854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c95884d-8684e3d5-bc4738d0-7d889ead_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:21.338992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0] Write session: try to update token
2025-10-01T14:10:21.339003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:21.345566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:21.345584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:21.345593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255455838043017:8025]
2025-10-01T14:10:21.345624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:21.345631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:21.345760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:21.345874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:21.345992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:21.346107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:21.346313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:21.346339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:21.351792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1065 sessionId: src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:21.354035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:21.354179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.354206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.354232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:21.354297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:21.364247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:21.364260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:21.364262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:21.364264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:21.364273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255455838043017:8025]
2025-10-01T14:10:21.364276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255455838043017:8025]
2025-10-01T14:10:21.364279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255455838043017:8025]
2025-10-01T14:10:21.364318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:21.364319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:21.364326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.364328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:21.364331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:21.364335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:21.364432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:21.420585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255458214920254:8859]
2025-10-01T14:10:21.420889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1064, pipe: [1:7556255458214920254:8859]
2025-10-01T14:10:21.494770Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:21.501301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.501320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.501442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.501494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.501545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.501590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.501632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.501639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.501690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.501738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.501785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.501835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.501875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.501882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.501941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.501991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.502040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.502092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.502130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.502135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.502192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.502242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.502294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.502346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.502467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.502473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.502526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.502582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.502634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.502689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.502730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.502735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.502791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.502842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.502897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.502953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.502995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.503000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.503054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.503102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.503154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.503202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.503239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.503244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.503300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.503357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.503419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.503478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.503517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.503524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.503577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.503632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.503691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.503743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.503796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.503801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.503856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.503905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.503958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.504008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.504049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.504058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.504095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920254:8859], now have 1 active actors on pipe
2025-10-01T14:10:21.504188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255458214920254:8859]
2025-10-01T14:10:21.504210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:21.504219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:21.504222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:21.504241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1065 reason: error at write: Disconnected sessionId: src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0
2025-10-01T14:10:21.504436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1065 sessionId: src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0 is DEAD
2025-10-01T14:10:21.504586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:21.504597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0] Write session will restart in 0.009653s
2025-10-01T14:10:21.504621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0] Write session: Do CDS request
2025-10-01T14:10:21.504627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:21.504753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:21.512258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:21.514451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:21.514580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:21.514588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:21.514595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:21.514622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:21.514644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255455838043175:8030]
2025-10-01T14:10:21.515002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:21.515182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:21.515205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:21.515392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:21.515427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.515431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.515432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.515432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.515433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.515434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.515434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.515435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.515435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.515436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.515437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.515437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.515437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.515438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.515441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.515447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.515449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.515451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.515453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.515455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.515457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.515459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.515461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.515463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.515465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.515466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.515468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.515470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.515475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.515478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.515482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.515485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.515487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.515489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.515491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.515494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.515496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.515499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.515505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.515508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.515510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.515516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.515518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.515521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.515527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.515530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.515535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.515538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.515540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.515543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.515548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.515551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.515553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.515556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.515561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.515563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.515583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:21.515825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.515861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:21.515875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1066
2025-10-01T14:10:21.515989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.516009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:21.516016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:21.516019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:21.516263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1066 sessionId:  describe result for acl check
2025-10-01T14:10:21.516289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:21.516294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:21.516295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:21.516298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255458214920393:9236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:21.516646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255458214920393:9236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:21.518240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255458214920393:9236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:21.518741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:21.519262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:21.519279Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:21.519280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:21.519282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:21.519289Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1065 [2:7556255455838043175:8030]
2025-10-01T14:10:21.519297Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:21.519310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:21.519312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.519314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.519315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.519325Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:21.519331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:21.519335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:21.519366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.519371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.519371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.519373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:21.519375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:21.519416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:21.519421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.519427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.519432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.519444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:21.519454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920281:2446], now have 1 active actors on pipe
2025-10-01T14:10:21.519462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255455838043170:8030]
2025-10-01T14:10:21.519466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255455838043170:8030]
2025-10-01T14:10:21.519468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255455838043170:8030]
2025-10-01T14:10:21.519476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:21.519487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:21.519492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:21.519494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:21.519496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:21.519497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:21.519499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:21.519488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1065
2025-10-01T14:10:21.519512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255455838043170:8030]
2025-10-01T14:10:21.519517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:21.519519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:21.523546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255458214920393:9236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:21.523557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255458214920393:9236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:21.523560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255458214920393:9236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:21.523567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:21.523792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920428:9236], now have 1 active actors on pipe
2025-10-01T14:10:21.523828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1065
2025-10-01T14:10:21.523866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.523872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.523900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:21.523909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.523914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.523916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:21.523922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.523928Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:21.523938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.524042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.524047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.524055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.524110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1066 partition: 0 MaxSeqNo: 45 sessionId: src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0
2025-10-01T14:10:21.524370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11834e0-d2fef1a0-251a5246-2b72dfec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:21.526498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0] Write session: try to update token
2025-10-01T14:10:21.526509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:21.528780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:21.528791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:21.528796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255455838043170:8030]
2025-10-01T14:10:21.528820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:21.528825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:21.528951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:21.529065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:21.529183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:21.529294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:21.529452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:21.529475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:21.538193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1066 sessionId: src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:21.540194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:21.540369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.540387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.540424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:21.540506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:21.546092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:21.546112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:21.546115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:21.546116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:21.546127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255455838043170:8030]
2025-10-01T14:10:21.546137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255455838043170:8030]
2025-10-01T14:10:21.546141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255455838043170:8030]
2025-10-01T14:10:21.546176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:21.546185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:21.546187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:21.546190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.546191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:21.546193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:21.546304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:21.604353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255458214920432:8859]
2025-10-01T14:10:21.604574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1065, pipe: [1:7556255458214920432:8859]
2025-10-01T14:10:21.675001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:21.681982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.682004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.682125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.682180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.682238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.682289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.682332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.682338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.682406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.682460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.682512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.682582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.682635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.682642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.682711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.682763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.682815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.682866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.682905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.682910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.682966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.683017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.683072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.683124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.683163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.683168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.683222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.683271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.683320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.683371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.683409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.683417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.683472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.683524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.683577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.683630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.683669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.683674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.683728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.683780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.683833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.683885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.683924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.683929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.683987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.684045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.684113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.684165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.684203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.684207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.684262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.684310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.684365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.684416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.684453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.684458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.684512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:21.684561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:21.684613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:21.684667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:21.684705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:21.684713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:21.684759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920432:8859], now have 1 active actors on pipe
2025-10-01T14:10:21.684949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255458214920432:8859]
2025-10-01T14:10:21.684980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:21.684982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:21.684999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1066 reason: error at write: Disconnected sessionId: src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0
2025-10-01T14:10:21.685099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:21.685161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1066 sessionId: src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0 is DEAD
2025-10-01T14:10:21.685295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:21.685304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0] Write session will restart in 0.008926s
2025-10-01T14:10:21.685322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0] Write session: Do CDS request
2025-10-01T14:10:21.685327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:21.685680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:21.693129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:21.694839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.694892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:21.694905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1067
2025-10-01T14:10:21.695038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.695070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:21.695080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:21.695082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:21.695396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:21.695418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1067 sessionId:  describe result for acl check
2025-10-01T14:10:21.695453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:21.695462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:21.695463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:21.695468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255458214920545:9240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:21.695552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:21.695563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:21.695572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:21.695621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:21.695656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255455838043361:8043]
2025-10-01T14:10:21.696096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255458214920545:9240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:21.696362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:21.696574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:21.696618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:21.696843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:21.696879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.696883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.696884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.696884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.696885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.696886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.696886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.696887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.696888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.696888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.696889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.696889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.696890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.696891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.696894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.696899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.696901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.696903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.696905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.696907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.696909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.696911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.696913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.696916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.696918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.696920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.696922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.696924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.696929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.696933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.696938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.696941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.696944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.696946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.696948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.696951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.696953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.696956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.696958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.696961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.696963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.696966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.696968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.696971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.696973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.696976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.696978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.696980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.696983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.696985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.696987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.696989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.696992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.696994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.696996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.696999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.697019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:21.697907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255458214920545:9240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:21.700099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255458214920545:9240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:21.700109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255458214920545:9240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:21.700112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255458214920545:9240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:21.700118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:21.700259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:21.701002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:21.701015Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:21.701016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:21.701020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:21.701026Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1066 [2:7556255455838043361:8043]
2025-10-01T14:10:21.701037Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:21.701052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:21.701054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.701057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.701059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.701074Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:21.701081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:21.701085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:21.701121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.701127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.701128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.701130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:21.701132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:21.701176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:21.701183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.701189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.701194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.701203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:21.701214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255455838043356:8043]
2025-10-01T14:10:21.701216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255455838043356:8043]
2025-10-01T14:10:21.701217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255455838043356:8043]
2025-10-01T14:10:21.701223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:21.701230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:21.701231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920581:9240], now have 1 active actors on pipe
2025-10-01T14:10:21.701233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:21.701233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920438:2446], now have 1 active actors on pipe
2025-10-01T14:10:21.701235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:21.701239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:21.701246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:21.701248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:21.701262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255455838043356:8043]
2025-10-01T14:10:21.701272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:21.701284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:21.701274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1066
2025-10-01T14:10:21.701281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1066
2025-10-01T14:10:21.701337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.701345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.701366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:21.701377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.701385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.701387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:21.701399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.701410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:21.701423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.701550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.701556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.701567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.701630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1067 partition: 0 MaxSeqNo: 45 sessionId: src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0
2025-10-01T14:10:21.701934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1945fce1-6f3b4be1-bda78ae8-4b4efc2a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:21.704153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0] Write session: try to update token
2025-10-01T14:10:21.704170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:21.716379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1067 sessionId: src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:21.718666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:21.719931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.719956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.719973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:21.719976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:21.719977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:21.719978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:21.719985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255455838043356:8043]
2025-10-01T14:10:21.719988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255455838043356:8043]
2025-10-01T14:10:21.719991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255455838043356:8043]
2025-10-01T14:10:21.720025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:21.720029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:21.720034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.720036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:21.720041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:21.720047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:21.720153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:21.785123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255458214920603:8859]
2025-10-01T14:10:21.785366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1066, pipe: [1:7556255458214920603:8859]
2025-10-01T14:10:21.851129Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:21.851542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:21.851586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920603:8859], now have 1 active actors on pipe
2025-10-01T14:10:21.851665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:21.851715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255458214920603:8859]
2025-10-01T14:10:21.851739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:21.851747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:21.851749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:21.851803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1067 reason: error at write: Disconnected sessionId: src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0
2025-10-01T14:10:21.851941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1067 sessionId: src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0 is DEAD
2025-10-01T14:10:21.852059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:21.852068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0] Write session will restart in 0.005266s
2025-10-01T14:10:21.852085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0] Write session: Do CDS request
2025-10-01T14:10:21.852090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:21.858727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.858797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:21.858810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1068
2025-10-01T14:10:21.858925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:21.858948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:21.858956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:21.858958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:21.859238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1068 sessionId:  describe result for acl check
2025-10-01T14:10:21.859264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:21.859270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:21.859271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:21.859274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255458214920710:9246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:21.859645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255458214920710:9246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:21.860163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:21.861371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255458214920710:9246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:21.862883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:21.863013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:21.863020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:21.863027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:21.863055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:21.863079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255455838043507:8045]
2025-10-01T14:10:21.863376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255458214920710:9246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:21.863386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255458214920710:9246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:21.863389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255458214920710:9246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:21.863394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:21.863449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:21.863637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:21.863662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:21.863845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:21.863879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.863883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.863884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.863884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.863885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.863885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.863886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.863887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.863887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.863888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.863888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.863889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.863889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.863890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.863893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.863899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.863901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.863903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.863905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.863907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.863910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.863912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.863914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.863916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.863918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.863920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.863922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.863924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.863928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.863933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:21.863936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.863939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:21.863942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.863945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:21.863947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.863950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:21.863952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.863955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:21.863959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.863961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:21.863964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.863967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:21.863969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.863973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:21.863979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.863982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:21.863984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.863987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.863993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.863995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.863998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.864000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.864002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.864007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:21.864009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.864012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:21.864033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:21.867333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:21.867859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:21.867869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:21.867870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:21.867873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:21.867877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1067 [2:7556255455838043507:8045]
2025-10-01T14:10:21.867886Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:21.867900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:21.867905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.867908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.867910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.867920Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:21.867926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:21.867931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:21.867964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.867969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.867970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.867972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:21.867974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:21.868018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:21.868024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.868032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:21.868037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:21.868046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:21.868058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920747:9246], now have 1 active actors on pipe
2025-10-01T14:10:21.868064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920605:2446], now have 1 active actors on pipe
2025-10-01T14:10:21.868069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255455838043502:8045]
2025-10-01T14:10:21.868075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255455838043502:8045]
2025-10-01T14:10:21.868077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255455838043502:8045]
2025-10-01T14:10:21.868089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:21.868102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:21.868104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:21.868110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:21.868112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:21.868114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:21.868116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:21.868134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255455838043502:8045]
2025-10-01T14:10:21.868139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:21.868141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:21.868118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1067
2025-10-01T14:10:21.868130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1067
2025-10-01T14:10:21.868159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.868165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.868186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|669437d6-501a811d-6196183a-595c56f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:21.868194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:21.868196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:21.868198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:21.868203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:21.868212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:21.868227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.868340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:21.868343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:21.868353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:21.868435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1068 partition: 0 MaxSeqNo: 45 sessionId: src_id|669437d6-501a811d-6196183a-595c56f5_0
2025-10-01T14:10:21.868693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7405074-30c75c1e-2d6e846d-62b5f1dd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|669437d6-501a811d-6196183a-595c56f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:21.870905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|669437d6-501a811d-6196183a-595c56f5_0] Write session: try to update token
2025-10-01T14:10:21.870923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|669437d6-501a811d-6196183a-595c56f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:21.887167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1068 sessionId: src_id|669437d6-501a811d-6196183a-595c56f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:21.888682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:21.888705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:21.888708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:21.888710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:21.888731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255455838043502:8045]
2025-10-01T14:10:21.888737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255455838043502:8045]
2025-10-01T14:10:21.888742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255455838043502:8045]
2025-10-01T14:10:21.888792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:21.888794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:21.888801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:21.888806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:21.888806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:21.888809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:21.888948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:21.890467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:21.952020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255458214920760:8859]
2025-10-01T14:10:21.952195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1067, pipe: [1:7556255458214920760:8859]
2025-10-01T14:10:22.039969Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:22.040187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.040198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.040231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255458214920760:8859], now have 1 active actors on pipe
2025-10-01T14:10:22.040370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:22.040405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:22.040419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:22.040419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:22.040451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255458214920760:8859]
2025-10-01T14:10:22.040468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1068 reason: error at write: Disconnected sessionId: src_id|669437d6-501a811d-6196183a-595c56f5_0
2025-10-01T14:10:22.040609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1068 sessionId: src_id|669437d6-501a811d-6196183a-595c56f5_0 is DEAD
2025-10-01T14:10:22.040760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669437d6-501a811d-6196183a-595c56f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:22.040769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669437d6-501a811d-6196183a-595c56f5_0] Write session will restart in 0.009319s
2025-10-01T14:10:22.040789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669437d6-501a811d-6196183a-595c56f5_0] Write session: Do CDS request
2025-10-01T14:10:22.040794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669437d6-501a811d-6196183a-595c56f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:22.048473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:22.050646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:22.050752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|669437d6-501a811d-6196183a-595c56f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.050774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:22.050781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:22.050789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:22.050819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:22.050846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255460133010952:8048]
2025-10-01T14:10:22.050822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:22.050838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1069
2025-10-01T14:10:22.050939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.050967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:22.050976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:22.050979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:22.051202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:22.051279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1069 sessionId:  describe result for acl check
2025-10-01T14:10:22.051308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:22.051315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:22.051316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:22.051320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255462509888167:9250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:22.051395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:22.051422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:22.051606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:22.051638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.051642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.051643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.051644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.051644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.051645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.051645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.051646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.051646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.051647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.051647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.051648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.051648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.051649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.051652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.051657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.051659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.051661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.051663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.051665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.051667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.051669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.051671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.051673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.051675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.051677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.051679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.051681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.051685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.051689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.051692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.051695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.051697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.051700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.051702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.051704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.051707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.051710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.051712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.051714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.051716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.051719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.051722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.051724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.051727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.051729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.051731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.051734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.051736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.051738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.051744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.051746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.051749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.051751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.051756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.051760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.051780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:22.051800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255462509888167:9250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:22.053403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255462509888167:9250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:22.054907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:22.055427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:22.055439Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:22.055440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:22.055429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255462509888167:9250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:22.055442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:22.055441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255462509888167:9250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:22.055443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255462509888167:9250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:22.055448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:22.055447Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1068 [2:7556255460133010952:8048]
2025-10-01T14:10:22.055456Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:22.055468Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:22.055469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.055472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.055473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.055484Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:22.055498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:22.055503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:22.055536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.055541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.055542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.055544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:22.055547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:22.055609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:22.055616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.055626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.055635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.055649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:22.055659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1068
2025-10-01T14:10:22.055662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1068
2025-10-01T14:10:22.055668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888058:2446], now have 1 active actors on pipe
2025-10-01T14:10:22.055675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888215:9250], now have 1 active actors on pipe
2025-10-01T14:10:22.055681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255460133010947:8048]
2025-10-01T14:10:22.055683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255460133010947:8048]
2025-10-01T14:10:22.055685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255460133010947:8048]
2025-10-01T14:10:22.055692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:22.055696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:22.055698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:22.055699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:22.055705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:22.055716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:22.055722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:22.055740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.055747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.055768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255460133010947:8048]
2025-10-01T14:10:22.055777Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:22.055786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:22.055790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:22.055796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.055799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.055805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:22.055812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.055823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:22.055854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.056027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.056039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.056060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.056136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1069 partition: 0 MaxSeqNo: 45 sessionId: src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0
2025-10-01T14:10:22.056307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|669437d6-501a811d-6196183a-595c56f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:22.058448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0] Write session: try to update token
2025-10-01T14:10:22.058459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:22.070012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1069 sessionId: src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:22.072152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:22.072340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.072370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.072399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:22.072451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:22.074168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:22.074182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:22.074184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:22.074185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:22.074192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255460133010947:8048]
2025-10-01T14:10:22.074195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255460133010947:8048]
2025-10-01T14:10:22.074197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255460133010947:8048]
2025-10-01T14:10:22.074232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:22.074237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:22.074241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:22.074242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.074243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:22.074243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:22.074364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:22.140458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255462509888223:8859]
2025-10-01T14:10:22.140731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1068, pipe: [1:7556255462509888223:8859]
2025-10-01T14:10:22.205715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:22.212148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.212173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.212313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.212366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.212429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.212497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.212777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.212788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.212846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.212902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.212956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.213200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.213252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.213259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.213372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.213422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.213472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.213527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.213564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.213569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.213622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.213671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.213721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.213770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.213811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.213816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.213865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.213913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.213960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.214010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.214048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.214056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.214106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.214152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.214204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.214262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.214308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.214313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.214364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.214434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.214488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.214540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.214576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.214582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.214633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.214684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.214738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.214792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.214832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.214837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.214895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.214948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.215004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.215059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.215098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.215103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.215159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.215212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.215264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.215314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.215352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.215356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.215393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888223:8859], now have 1 active actors on pipe
2025-10-01T14:10:22.215603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:22.215619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255462509888223:8859]
2025-10-01T14:10:22.215620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:22.215634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:22.215646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1069 reason: error at write: Disconnected sessionId: src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0
2025-10-01T14:10:22.215818Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:22.215881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1069 sessionId: src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0 is DEAD
2025-10-01T14:10:22.215996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:22.216004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0] Write session will restart in 0.007634s
2025-10-01T14:10:22.216023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0] Write session: Do CDS request
2025-10-01T14:10:22.216027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:22.224232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:22.224818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.224874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:22.224886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1070
2025-10-01T14:10:22.224991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.225013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:22.225019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:22.225022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:22.225303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1070 sessionId:  describe result for acl check
2025-10-01T14:10:22.225325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:22.225330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:22.225331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:22.225335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255462509888335:9260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:22.225684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255462509888335:9260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:22.226812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:22.227012Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:22.227021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:22.227031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:22.227074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:22.227111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255460133011100:8050]
2025-10-01T14:10:22.227522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:22.227658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:22.227687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:22.227871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:22.227904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.227908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.227909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.227909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.227910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.227911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.227911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.227912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.227913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.227913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.227914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.227914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.227915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.227916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.227919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.227925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.227927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.227929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.227931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.227933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.227936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.227938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.227940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.227942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.227944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.227946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.227949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.227951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.227955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.227959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.227963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.227966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.227970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.227972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.227975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.227977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.227980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.227983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.227985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.227988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.227994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.227997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.228000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.228005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.228008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.228011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.228016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.228019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.228022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.228024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.228027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.228030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.228032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.228035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.228037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.228040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.228038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255462509888335:9260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:22.228061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:22.231098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255462509888335:9260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:22.231123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255462509888335:9260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:22.231125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255462509888335:9260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:22.231131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:22.231303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:22.231814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:22.231825Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:22.231826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:22.231828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:22.231834Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1069 [2:7556255460133011100:8050]
2025-10-01T14:10:22.231844Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:22.231854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:22.231856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.231858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.231860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.231871Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:22.231874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:22.231878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:22.231910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.231916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.231917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.231919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:22.231921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:22.231965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:22.231970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.231976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.231982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.231990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:22.232004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888374:9260], now have 1 active actors on pipe
2025-10-01T14:10:22.232009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888224:2446], now have 1 active actors on pipe
2025-10-01T14:10:22.232014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255460133011095:8050]
2025-10-01T14:10:22.232016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255460133011095:8050]
2025-10-01T14:10:22.232017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255460133011095:8050]
2025-10-01T14:10:22.232025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:22.232033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1069
2025-10-01T14:10:22.232034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:22.232039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:22.232041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:22.232043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:22.232045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:22.232046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:22.232066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255460133011095:8050]
2025-10-01T14:10:22.232071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:22.232073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:22.232054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1069
2025-10-01T14:10:22.232083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.232089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.232119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:22.232127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.232130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.232131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:22.232137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.232142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:22.232156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.232263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.232268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.232276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.232335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1070 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0
2025-10-01T14:10:22.232663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c9f59e-a57e4c4-60e13c2b-7509bfae_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:22.234762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0] Write session: try to update token
2025-10-01T14:10:22.234777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:22.246239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1070 sessionId: src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:22.248659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:22.248974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.248993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.250704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:22.250732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:22.250738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:22.250739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:22.250741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:22.250747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255460133011095:8050]
2025-10-01T14:10:22.250754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255460133011095:8050]
2025-10-01T14:10:22.250756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255460133011095:8050]
2025-10-01T14:10:22.250789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:22.250791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:22.250797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.250798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:22.250802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:22.250805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:22.250823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:22.250907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:22.315547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255462509888389:8859]
2025-10-01T14:10:22.315716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1069, pipe: [1:7556255462509888389:8859]
2025-10-01T14:10:22.383411Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:22.390332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.390357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.390518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.390571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.390626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.390680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.390721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.390731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.390797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.390848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.390905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.390961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.391001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.391007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.391061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.391108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.391161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.391214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.391253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.391259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.391313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.391364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.391420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.391471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.391510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.391515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.391578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.391642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.391702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.391760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.391799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.391805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.391861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.391913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.391968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.392024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.392063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.392067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.392123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.392174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.392227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.392280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.392325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.392330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.392384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.392433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.392483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.392536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.392575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.392580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.392636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.392689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.392755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.392812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.392851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.392856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.392911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.392963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.393016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.393071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.393109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.393114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.393154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888389:8859], now have 1 active actors on pipe
2025-10-01T14:10:22.393354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255462509888389:8859]
2025-10-01T14:10:22.393358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:22.393361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:22.393381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:22.393385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1070 reason: error at write: Disconnected sessionId: src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0
2025-10-01T14:10:22.393568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1070 sessionId: src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0 is DEAD
2025-10-01T14:10:22.393630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 160 BytesWritten: 85606466 MessagesWritten: 38 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-01T14:10:22.393655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:22.393659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0] Write session will restart in 0.006513s
2025-10-01T14:10:22.393680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0] Write session: Do CDS request
2025-10-01T14:10:22.393684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:22.394092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:22.400822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.400913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:22.400926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1071
2025-10-01T14:10:22.401035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.401060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:22.401065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:22.401068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:22.401370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1071 sessionId:  describe result for acl check
2025-10-01T14:10:22.401397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:22.401402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:22.401403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:22.401407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255462509888502:9265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:22.401759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255462509888502:9265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:22.402746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:22.403794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255462509888502:9265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:22.405239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:22.405405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:22.405415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:22.405425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:22.405464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:22.405488Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255460133011250:8052]
2025-10-01T14:10:22.405864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:22.406107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:22.406137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255462509888502:9265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:22.406148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255462509888502:9265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:22.406151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255462509888502:9265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:22.406155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:22.406149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:22.406433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:22.406482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.406487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.406488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.406489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.406489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.406490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.406491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.406491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.406492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.406492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.406493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.406494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.406494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.406495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.406498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.406504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.406506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.406508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.406510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.406512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.406514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.406516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.406518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.406520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.406522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.406524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.406526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.406528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.406532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.406537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.406541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.406544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.406548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.406563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.406568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.406572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.406577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.406582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.406586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.406591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.406595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.406599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.406603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.406607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.406611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.406615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.406618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.406622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.406626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.406631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.406635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.406639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.406643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.406649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.406653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.406657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.406683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:22.410066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:22.410652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:22.410668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:22.410670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:22.410673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:22.410678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1070 [2:7556255460133011250:8052]
2025-10-01T14:10:22.410689Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:22.410701Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:22.410703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.410705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.410707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.410719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:22.410723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:22.410728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:22.410767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.410773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.410775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.410777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:22.410779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:22.410841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:22.410850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.410860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.410870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.410886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:22.410910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888394:2446], now have 1 active actors on pipe
2025-10-01T14:10:22.410913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888542:9265], now have 1 active actors on pipe
2025-10-01T14:10:22.410920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255460133011244:8052]
2025-10-01T14:10:22.410922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255460133011244:8052]
2025-10-01T14:10:22.410924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255460133011244:8052]
2025-10-01T14:10:22.410938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:22.410953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:22.410955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:22.410962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:22.410965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:22.410965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:22.410967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:22.410990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255460133011244:8052]
2025-10-01T14:10:22.410996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:22.411006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:22.410992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1070
2025-10-01T14:10:22.411091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1070
2025-10-01T14:10:22.411128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.411139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.411169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:22.411179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.411183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.411189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:22.411196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.411205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:22.411219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.411358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.411366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.411378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.411451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1071 partition: 0 MaxSeqNo: 45 sessionId: src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0
2025-10-01T14:10:22.411789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a957d7d-3fb42fba-d3f9fddc-b95fafdb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:22.414268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0] Write session: try to update token
2025-10-01T14:10:22.414283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:22.427159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1071 sessionId: src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:22.429399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:22.430988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.431010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.431028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:22.431031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:22.431032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:22.431034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:22.431039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255460133011244:8052]
2025-10-01T14:10:22.431043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255460133011244:8052]
2025-10-01T14:10:22.431045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255460133011244:8052]
2025-10-01T14:10:22.431082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:22.431088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:22.431094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.431095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:22.431095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:22.431099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:22.431212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:22.493737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255462509888552:8859]
2025-10-01T14:10:22.494011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1070, pipe: [1:7556255462509888552:8859]
2025-10-01T14:10:22.566442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:22.566681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:22.566734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888552:8859], now have 1 active actors on pipe
2025-10-01T14:10:22.566821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:22.566928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255462509888552:8859]
2025-10-01T14:10:22.566966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:22.575746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:22.575762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:22.575782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1071 reason: error at write: Disconnected sessionId: src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0
2025-10-01T14:10:22.575934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1071 sessionId: src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0 is DEAD
2025-10-01T14:10:22.576045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:22.576056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0] Write session will restart in 0.005330s
2025-10-01T14:10:22.576079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0] Write session: Do CDS request
2025-10-01T14:10:22.576084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:22.579279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:22.581764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:22.581892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:22.581900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:22.581909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:22.581940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:22.581970Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255460133011409:8057]
2025-10-01T14:10:22.582623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:22.582760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.582835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:22.582851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1072
2025-10-01T14:10:22.582888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:22.582930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:22.582940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.582962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:22.582970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:22.582972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:22.583161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:22.583204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.583209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.583209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.583210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.583211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.583211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.583212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.583212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.583213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.583213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.583214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.583215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.583215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.583216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.583219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.583225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.583227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.583230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.583269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1072 sessionId:  describe result for acl check
2025-10-01T14:10:22.583232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.583234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.583236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.583238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.583241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.583243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.583292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:22.583245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.583298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:22.583248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.583299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:22.583250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.583302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255462509888693:9276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:22.583252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.583256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.583261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.583266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.583269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.583271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.583274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.583277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.583280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.583282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.583285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.583287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.583290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.583293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.583297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.583299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.583301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.583304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.583306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.583309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.583312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.583315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.583318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.583320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.583323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.583325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.583328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.583330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.583333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.583354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:22.583742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255462509888693:9276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:22.586002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255462509888693:9276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:22.586740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:22.587331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:22.587344Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:22.587345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:22.587348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:22.587352Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1071 [2:7556255460133011409:8057]
2025-10-01T14:10:22.587362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:22.587380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:22.587385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.587388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.587389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.587400Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:22.587404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:22.587408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:22.587450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.587458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.587459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.587462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:22.587466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:22.587515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:22.587521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.587528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.587533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.587546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:22.587562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888578:2446], now have 1 active actors on pipe
2025-10-01T14:10:22.587571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255460133011404:8057]
2025-10-01T14:10:22.587576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255460133011404:8057]
2025-10-01T14:10:22.587577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255460133011404:8057]
2025-10-01T14:10:22.587586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:22.587598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:22.587599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:22.587604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:22.587606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:22.587609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:22.587611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:22.587594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1071
2025-10-01T14:10:22.587627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255460133011404:8057]
2025-10-01T14:10:22.587633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:22.587636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:22.588040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255462509888693:9276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:22.588054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255462509888693:9276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:22.588057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255462509888693:9276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:22.588064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:22.588334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888728:9276], now have 1 active actors on pipe
2025-10-01T14:10:22.588372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1071
2025-10-01T14:10:22.588417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.588426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.588445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|252484c9-b5c29c90-88821114-38086c8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:22.588456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.588460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.588467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:22.588476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.588488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:22.588502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.588614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.588620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.588629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.588688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1072 partition: 0 MaxSeqNo: 45 sessionId: src_id|252484c9-b5c29c90-88821114-38086c8d_0
2025-10-01T14:10:22.588997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6fb1e1e-689c9981-d59c5103-7fe0fff3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|252484c9-b5c29c90-88821114-38086c8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:22.591455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252484c9-b5c29c90-88821114-38086c8d_0] Write session: try to update token
2025-10-01T14:10:22.591469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252484c9-b5c29c90-88821114-38086c8d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:22.597663Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:22.597682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:22.597689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255460133011404:8057]
2025-10-01T14:10:22.597725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:22.597726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:22.597870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:22.597988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:22.598104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:22.598221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:22.598415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:22.598448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:22.604249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1072 sessionId: src_id|252484c9-b5c29c90-88821114-38086c8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:22.606724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:22.606912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.606931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.606960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:22.607032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:22.615733Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:22.615751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:22.615752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:22.615754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:22.615762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255460133011404:8057]
2025-10-01T14:10:22.615764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255460133011404:8057]
2025-10-01T14:10:22.615767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255460133011404:8057]
2025-10-01T14:10:22.615800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:22.615809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.615809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:22.615810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:22.615814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:22.615817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:22.615924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:22.667291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255462509888734:8859]
2025-10-01T14:10:22.667508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1071, pipe: [1:7556255462509888734:8859]
2025-10-01T14:10:22.747118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:22.753783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.753810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.753942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.753995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.754056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.754108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.754152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.754160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.754213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.754261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.754309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.754358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.754412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.754418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.754474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.754530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.754582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.754635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.754674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.754679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.754734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.754788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.754839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.754893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.754931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.754938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.754994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.755043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.755099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.755154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.755192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.755197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.755251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.755302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.755353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.755409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.755448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.755452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.755505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.755553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.755604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.755657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.755697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.755702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.755752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.755801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.755852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.755902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.755937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.755941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.755994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.756043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.756093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.756147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.756193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.756199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.756251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.756298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.756357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.756403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.756439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.756444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.756481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888734:8859], now have 1 active actors on pipe
2025-10-01T14:10:22.756697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:22.756712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:22.756734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255462509888734:8859]
2025-10-01T14:10:22.756743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1072 reason: error at write: Disconnected sessionId: src_id|252484c9-b5c29c90-88821114-38086c8d_0
2025-10-01T14:10:22.756754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:22.756958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1072 sessionId: src_id|252484c9-b5c29c90-88821114-38086c8d_0 is DEAD
2025-10-01T14:10:22.757055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252484c9-b5c29c90-88821114-38086c8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:22.757063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252484c9-b5c29c90-88821114-38086c8d_0] Write session will restart in 0.009569s
2025-10-01T14:10:22.757082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252484c9-b5c29c90-88821114-38086c8d_0] Write session: Do CDS request
2025-10-01T14:10:22.757086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252484c9-b5c29c90-88821114-38086c8d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:22.757207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:22.765831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:22.767816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|252484c9-b5c29c90-88821114-38086c8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.767956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:22.767972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1073
2025-10-01T14:10:22.768075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.768106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:22.768117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:22.768120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:22.768202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:22.768377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:22.768387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:22.768397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:22.768444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:22.768444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1073 sessionId:  describe result for acl check
2025-10-01T14:10:22.768474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:22.768480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:22.768478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255460133011602:8070]
2025-10-01T14:10:22.768482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:22.768489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255462509888855:9281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:22.768998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255462509888855:9281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:22.769017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:22.769246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:22.769283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:22.769568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:22.769617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.769623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.769624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.769626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.769627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.769628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.769629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.769630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.769630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.769631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.769632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.769634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.769634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.769635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.769640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.769648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.769652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.769655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.769658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.769670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.769673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.769677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.769680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.769683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.769687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.769690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.769693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.769696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.769703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.769710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.769716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.769720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.769724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.769728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.769732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.769736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.769745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.769750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.769758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.769762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.769770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.769778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.769786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.769791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.769799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.769806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.769810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.769818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.769826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.769834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.769842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.769846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.769853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.769858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.769865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.769869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.769908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:22.770964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255462509888855:9281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:22.773318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:22.773393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255462509888855:9281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:22.773407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255462509888855:9281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:22.773410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255462509888855:9281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:22.773417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:22.774183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:22.774201Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:22.774203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:22.774206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:22.774211Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1072 [2:7556255460133011602:8070]
2025-10-01T14:10:22.774225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:22.774244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:22.774250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.774254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.774257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.774271Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:22.774280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:22.774290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:22.774342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.774348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.774350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.774352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:22.774355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:22.774446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:22.774458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.774469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.774480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.774495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:22.774512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888890:9281], now have 1 active actors on pipe
2025-10-01T14:10:22.774520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888741:2446], now have 1 active actors on pipe
2025-10-01T14:10:22.774527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255460133011596:8070]
2025-10-01T14:10:22.774529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255460133011596:8070]
2025-10-01T14:10:22.774531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255460133011596:8070]
2025-10-01T14:10:22.774514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1072
2025-10-01T14:10:22.774541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1072
2025-10-01T14:10:22.774539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:22.774544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:22.774546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:22.774548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:22.774556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:22.774567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:22.774574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:22.774590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.774597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.774633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255460133011596:8070]
2025-10-01T14:10:22.774643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:22.774647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:22.774656Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:22.774667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.774671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.774677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:22.774685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.774693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:22.774726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.774843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.774852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.774865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.774934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1073 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0
2025-10-01T14:10:22.775243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|252484c9-b5c29c90-88821114-38086c8d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:22.777406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0] Write session: try to update token
2025-10-01T14:10:22.777423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:22.789383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1073 sessionId: src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:22.791489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:22.791585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.791605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.793269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:22.793298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:22.793305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:22.793306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:22.793308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:22.793316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255460133011596:8070]
2025-10-01T14:10:22.793319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255460133011596:8070]
2025-10-01T14:10:22.793323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255460133011596:8070]
2025-10-01T14:10:22.793342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:22.793351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:22.793352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:22.793355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:22.793355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.793352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:22.793357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:22.793471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:22.856745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255462509888910:8859]
2025-10-01T14:10:22.856974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1072, pipe: [1:7556255462509888910:8859]
2025-10-01T14:10:22.925445Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:22.932403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.932426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.932564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.932617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.932673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.932739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.932781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.932788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.932847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.932900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.932954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.933011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.933057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.933065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.933123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.933170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.933222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.933271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.933309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.933316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.933366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.933413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.933462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.933510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.933554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.933562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.933614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.933663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.933714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.933765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.933806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.933811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.933864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.933911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.933964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.934020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.934061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.934068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.934121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.934170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.934222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.934272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.934310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.934314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.934364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.934436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.934489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.934544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.934589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.934595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.934652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.934703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.934757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.934810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.934853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.934858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.934912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:22.934964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:22.935018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:22.935071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:22.935107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:22.935111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:22.935152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888910:8859], now have 1 active actors on pipe
2025-10-01T14:10:22.935364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255462509888910:8859]
2025-10-01T14:10:22.935386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:22.935395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:22.935397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:22.935419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1073 reason: error at write: Disconnected sessionId: src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0
2025-10-01T14:10:22.935717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1073 sessionId: src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0 is DEAD
2025-10-01T14:10:22.935844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:22.935849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0] Write session will restart in 0.007331s
2025-10-01T14:10:22.935868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0] Write session: Do CDS request
2025-10-01T14:10:22.935872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:22.935870Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:22.943664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:22.943785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.943890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:22.943903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1074
2025-10-01T14:10:22.943983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:22.944005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:22.944011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:22.944014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:22.944285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1074 sessionId:  describe result for acl check
2025-10-01T14:10:22.944313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:22.944357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:22.944361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:22.944366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255462509889026:9286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:22.944706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255462509889026:9286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:22.945762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:22.945889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:22.945897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:22.945905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:22.945937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:22.945961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255460133011755:8073]
2025-10-01T14:10:22.946344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:22.946630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255462509889026:9286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:22.947147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:22.947202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:22.947510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:22.947570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.947576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.947577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.947578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.947579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.947580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.947581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.947582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.947583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.947584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.947585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.947586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.947587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.947588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.947592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.947601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.947603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.947607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.947612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.947616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.947619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.947627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.947630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.947634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.947637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.947640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.947647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.947650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.947656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.947666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:22.947686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.947695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:22.947703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.947707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:22.947714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.947718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:22.947726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.947730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:22.947747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.947756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:22.947764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.947772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:22.947776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.947784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:22.947792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.947801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:22.947809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.947817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.947825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.947833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.947841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.947845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.947852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.947857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:22.947865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.947869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:22.947905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:22.951030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255462509889026:9286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:22.951043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255462509889026:9286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:22.951045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255462509889026:9286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:22.951051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:22.951215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:22.951954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:22.951969Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:22.951971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:22.951975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:22.951979Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1073 [2:7556255460133011755:8073]
2025-10-01T14:10:22.951988Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:22.951999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:22.952001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.952003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.952004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.952015Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:22.952018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:22.952022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:22.952059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.952066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.952067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.952070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:22.952072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:22.952130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:22.952137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.952148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:22.952162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:22.952182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:22.952201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509888912:2446], now have 1 active actors on pipe
2025-10-01T14:10:22.952208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255462509889066:9286], now have 1 active actors on pipe
2025-10-01T14:10:22.952215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255460133011750:8073]
2025-10-01T14:10:22.952217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255460133011750:8073]
2025-10-01T14:10:22.952219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255460133011750:8073]
2025-10-01T14:10:22.952231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:22.952224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1073
2025-10-01T14:10:22.952230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1073
2025-10-01T14:10:22.952243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:22.952247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:22.952249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:22.952250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:22.952254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:22.952256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:22.952287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.952293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.952303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255460133011750:8073]
2025-10-01T14:10:22.952310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:22.952314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:22.952328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:22.952337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:22.952339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:22.952341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:22.952346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:22.952352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:22.952365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.952457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.952462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.952471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:22.952523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1074 partition: 0 MaxSeqNo: 45 sessionId: src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0
2025-10-01T14:10:22.952823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4fff5ad-73fb2acf-2fe54bdc-cdf7027b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:22.954902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0] Write session: try to update token
2025-10-01T14:10:22.954915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:22.966826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1074 sessionId: src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:22.968918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:22.969077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:22.969097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:22.969126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:22.969209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:22.972056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:22.972073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:22.972075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:22.972077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:22.972084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255460133011750:8073]
2025-10-01T14:10:22.972087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255460133011750:8073]
2025-10-01T14:10:22.972091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255460133011750:8073]
2025-10-01T14:10:22.972129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:22.972132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:22.972137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:22.972140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:22.972140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:22.972142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:22.972259Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:23.035418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255466804856369:8859]
2025-10-01T14:10:23.035649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1073, pipe: [1:7556255466804856369:8859]
2025-10-01T14:10:23.104948Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:23.111096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.111118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.111261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.111316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.111372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.111427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.111469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.111476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.111540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.111610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.111676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.111741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.111784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.111793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.111849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.111909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.111966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.112023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.112068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.112076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.112131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.112186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.112241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.112301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.112343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.112351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.112410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.112463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.112517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.112573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.112626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.112636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.112689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.112754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.112811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.112871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.112919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.112927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.112982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.113037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.113096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.113154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.113261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.113269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.113327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.113381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.113435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.113492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.113542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.113550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.113613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.113672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.113731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.113793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.113835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.113842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.113903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.113962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.114023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.114087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.114149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.114157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.114207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856369:8859], now have 1 active actors on pipe
2025-10-01T14:10:23.114446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:23.114459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255466804856369:8859]
2025-10-01T14:10:23.114478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:23.114480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:23.114501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1074 reason: error at write: Disconnected sessionId: src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0
2025-10-01T14:10:23.114677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1074 sessionId: src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0 is DEAD
2025-10-01T14:10:23.114853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:23.114863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0] Write session will restart in 0.006990s
2025-10-01T14:10:23.114883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0] Write session: Do CDS request
2025-10-01T14:10:23.114888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:23.115278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:23.122844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.122953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:23.122970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1075
2025-10-01T14:10:23.123096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.123121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:23.123127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:23.123130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:23.123417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1075 sessionId:  describe result for acl check
2025-10-01T14:10:23.123447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:23.123452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:23.123453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:23.123457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255466804856484:9290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:23.123837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255466804856484:9290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:23.124817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:23.126014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255466804856484:9290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:23.127288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:23.127441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:23.127463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:23.127474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:23.127516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:23.127547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255464427979205:8075]
2025-10-01T14:10:23.127979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:23.128048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255466804856484:9290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:23.128069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255466804856484:9290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:23.128071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255466804856484:9290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:23.128077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:23.128177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:23.128206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:23.128427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:23.128464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.128468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.128469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.128470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.128471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.128471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.128472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.128473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.128473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.128474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.128475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.128475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.128476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.128477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.128480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.128486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.128488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.128491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.128493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.128495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.128497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.128499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.128502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.128505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.128509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.128512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.128516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.128519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.128527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.128534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.128540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.128545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.128549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.128554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.128559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.128563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.128568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.128573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.128577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.128582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.128586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.128591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.128595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.128599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.128604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.128609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.128613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.128617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.128620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.128625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.128629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.128633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.128638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.128643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.128647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.128652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.128691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:23.132025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:23.132596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:23.132608Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:23.132610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:23.132613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:23.132618Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1074 [2:7556255464427979205:8075]
2025-10-01T14:10:23.132628Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:23.132639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:23.132641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.132643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.132644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.132655Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:23.132658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:23.132663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:23.132696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.132702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.132703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.132705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:23.132707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:23.132776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:23.132781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.132788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.132794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.132803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:23.132816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856372:2446], now have 1 active actors on pipe
2025-10-01T14:10:23.132822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856524:9290], now have 1 active actors on pipe
2025-10-01T14:10:23.132828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255464427979199:8075]
2025-10-01T14:10:23.132829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255464427979199:8075]
2025-10-01T14:10:23.132830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255464427979199:8075]
2025-10-01T14:10:23.132838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:23.132846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:23.132856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:23.132858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:23.132859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:23.132860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:23.132861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:23.132875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255464427979199:8075]
2025-10-01T14:10:23.132884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:23.132885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:23.132878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1074
2025-10-01T14:10:23.132902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1074
2025-10-01T14:10:23.132945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.132952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.132969Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:23.132977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.132981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.132982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:23.132987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.132993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:23.133002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.133144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.133157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.133176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.133248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1075 partition: 0 MaxSeqNo: 45 sessionId: src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0
2025-10-01T14:10:23.133552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5560d0e3-6f44c01e-926e1896-9e315f07_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:23.135772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0] Write session: try to update token
2025-10-01T14:10:23.135787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:23.147664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1075 sessionId: src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:23.149707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:23.151388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.151414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.151432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:23.151435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:23.151437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:23.151438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:23.151447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255464427979199:8075]
2025-10-01T14:10:23.151450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255464427979199:8075]
2025-10-01T14:10:23.151453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255464427979199:8075]
2025-10-01T14:10:23.151494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:23.151500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.151498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:23.151505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:23.151505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:23.151508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:23.151620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:23.214657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255466804856533:8859]
2025-10-01T14:10:23.214905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1074, pipe: [1:7556255466804856533:8859]
2025-10-01T14:10:23.281403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:23.281943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:23.281990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856533:8859], now have 1 active actors on pipe
2025-10-01T14:10:23.282067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:23.282211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255466804856533:8859]
2025-10-01T14:10:23.282241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:23.291297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:23.291316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:23.291338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1075 reason: error at write: Disconnected sessionId: src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0
2025-10-01T14:10:23.291494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1075 sessionId: src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0 is DEAD
2025-10-01T14:10:23.291612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:23.291622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0] Write session will restart in 0.006483s
2025-10-01T14:10:23.291639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0] Write session: Do CDS request
2025-10-01T14:10:23.291643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:23.294552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:23.296697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:23.296851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:23.296859Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:23.296877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:23.296914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:23.296941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255464427979359:8077]
2025-10-01T14:10:23.297569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:23.297766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:23.297798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:23.297990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:23.298024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.298028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.298029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.298030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.298031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.298031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.298032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.298033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.298034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.298034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.298035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.298036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.298036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.298037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.298040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.298045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.298047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.298050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.298052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.298054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.298056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.298058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.298060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.298062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.298064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.298066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.298068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.298070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.298074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.298078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.298083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.298086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.298089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.298092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.298094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.298097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.298100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.298103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.298109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.298112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.298114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.298118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.298121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.298126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.298128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.298131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.298133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.298136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.298140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.298143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.298145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.298147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.298149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.298152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.298156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.298158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.298178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:23.298786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.298890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:23.298903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1076
2025-10-01T14:10:23.299017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.299041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:23.299050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:23.299053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:23.299305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1076 sessionId:  describe result for acl check
2025-10-01T14:10:23.299344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:23.299349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:23.299350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:23.299353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255466804856661:9295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:23.299697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255466804856661:9295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:23.301326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:23.301451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255466804856661:9295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:23.301861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:23.301873Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:23.301875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:23.301877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:23.301882Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1075 [2:7556255464427979359:8077]
2025-10-01T14:10:23.301892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:23.301903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:23.301907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.301909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.301911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.301920Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:23.301927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:23.301931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:23.301966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.301971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.301972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.301975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:23.301976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:23.302019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:23.302024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.302031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.302037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.302047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:23.302061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856535:2446], now have 1 active actors on pipe
2025-10-01T14:10:23.302070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255464427979354:8077]
2025-10-01T14:10:23.302071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255464427979354:8077]
2025-10-01T14:10:23.302072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255464427979354:8077]
2025-10-01T14:10:23.302082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:23.302094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:23.302096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:23.302099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:23.302101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:23.302106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:23.302108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:23.302108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1075
2025-10-01T14:10:23.302124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255464427979354:8077]
2025-10-01T14:10:23.302129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:23.302131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:23.306257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255466804856661:9295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:23.306270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255466804856661:9295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:23.306272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255466804856661:9295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:23.306278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:23.306477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856702:9295], now have 1 active actors on pipe
2025-10-01T14:10:23.306532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1075
2025-10-01T14:10:23.306597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.306607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.306625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:23.306637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.306643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.306645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:23.306652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.306665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:23.306680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.306834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.306841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.306852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.306923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1076 partition: 0 MaxSeqNo: 45 sessionId: src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0
2025-10-01T14:10:23.307176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48c6c3e2-d230a586-64d0ffb2-f3f4ae2c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:23.309324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0] Write session: try to update token
2025-10-01T14:10:23.309338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:23.320664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:23.320682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:23.320683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:23.320685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:23.320692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255464427979354:8077]
2025-10-01T14:10:23.320695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255464427979354:8077]
2025-10-01T14:10:23.320697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255464427979354:8077]
2025-10-01T14:10:23.320731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:23.320735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:23.320738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:23.320741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:23.320747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.320748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:23.320857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:23.321498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1076 sessionId: src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:23.323645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:23.336570Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 10 CurrentSessionLifetimeMs: 241354 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:10:23.382569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255466804856708:8859]
2025-10-01T14:10:23.382799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1075, pipe: [1:7556255466804856708:8859]
2025-10-01T14:10:23.455596Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:23.455844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.455858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.455895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856708:8859], now have 1 active actors on pipe
2025-10-01T14:10:23.456110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255466804856708:8859]
2025-10-01T14:10:23.456137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:23.456131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:23.456142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:23.456145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:23.456202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1076 reason: error at write: Disconnected sessionId: src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0
2025-10-01T14:10:23.456408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1076 sessionId: src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0 is DEAD
2025-10-01T14:10:23.456640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:23.456648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0] Write session will restart in 0.008283s
2025-10-01T14:10:23.456669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0] Write session: Do CDS request
2025-10-01T14:10:23.456673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:23.465865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.465953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:23.465968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1077
2025-10-01T14:10:23.466058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.466088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:23.466097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:23.466100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:23.466430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1077 sessionId:  describe result for acl check
2025-10-01T14:10:23.466460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:23.466464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:23.466466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:23.466469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255466804856825:9299] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:23.466864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255466804856825:9299] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:23.467032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:23.468618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255466804856825:9299] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:23.469026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:23.469155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:23.469163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:23.469170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:23.469206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:23.469231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255464427979517:8080]
2025-10-01T14:10:23.469580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:23.469787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:23.469820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:23.470001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:23.470034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.470038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.470038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.470039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.470040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.470040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.470041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.470041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.470042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.470042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.470043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.470043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.470044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.470045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.470047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.470052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.470054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.470057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.470059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.470061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.470063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.470065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.470067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.470069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.470071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.470073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.470075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.470077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.470081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.470085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.470089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.470092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.470095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.470098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.470100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.470103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.470105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.470109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.470114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.470117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.470120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.470124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.470144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.470151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.470153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.470156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.470162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.470164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.470167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.470172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.470175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.470177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.470179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.470185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.470187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.470190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.470212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:23.470510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255466804856825:9299] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:23.470521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255466804856825:9299] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:23.470524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255466804856825:9299] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:23.470531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:23.473390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:23.473894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:23.473904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:23.473906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:23.473908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:23.473912Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1076 [2:7556255464427979517:8080]
2025-10-01T14:10:23.473922Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:23.473937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:23.473942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.473944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.473945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.473957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:23.473964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:23.473972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:23.474006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.474011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.474012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.474014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:23.474015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:23.474057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:23.474061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.474067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.474073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.474081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:23.474094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255464427979510:8080]
2025-10-01T14:10:23.474098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255464427979510:8080]
2025-10-01T14:10:23.474099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255464427979510:8080]
2025-10-01T14:10:23.474105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:23.474112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:23.474116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856867:9299], now have 1 active actors on pipe
2025-10-01T14:10:23.474121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856710:2446], now have 1 active actors on pipe
2025-10-01T14:10:23.474122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:23.474124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:23.474125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:23.474136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:23.474143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:23.474163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255464427979510:8080]
2025-10-01T14:10:23.474173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:23.474183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:23.474179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1076
2025-10-01T14:10:23.474215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.474223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.474225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1076
2025-10-01T14:10:23.474244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:23.474253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.474257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.474258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:23.474266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.474276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:23.474292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.474421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.474427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.474437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.474504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1077 partition: 0 MaxSeqNo: 45 sessionId: src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0
2025-10-01T14:10:23.474769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca74ff3-fce20f02-dfa08ce2-a6d0e852_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:23.476967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0] Write session: try to update token
2025-10-01T14:10:23.476979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:23.489044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1077 sessionId: src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:23.491200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:23.491979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.492002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.492019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:23.492022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:23.492028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255464427979510:8080]
2025-10-01T14:10:23.492059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:23.492087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:23.492252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:23.492378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:23.492501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:23.492624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:23.492815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:23.492848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:23.492865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:23.492921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:23.501724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:23.501740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:23.501742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:23.501743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:23.501751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255464427979510:8080]
2025-10-01T14:10:23.501754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255464427979510:8080]
2025-10-01T14:10:23.501756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255464427979510:8080]
2025-10-01T14:10:23.501792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:23.501796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:23.501797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:23.501799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:23.501804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.501806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:23.501918Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:23.556135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255466804856887:8859]
2025-10-01T14:10:23.556330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1076, pipe: [1:7556255466804856887:8859]
2025-10-01T14:10:23.636781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:23.643028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.643049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.643158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.643204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.643253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.643297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.643335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.643342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.643397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.643445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.643493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.643662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.643701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.643706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.643887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.643940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.644114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.644297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.644334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.644339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.644396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.644445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.644493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.644541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.644581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.644586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.644638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.644684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.644743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.644790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.644830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.644835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.644886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.644934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.644982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.645032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.645071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.645075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.645125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.645171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.645224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.645273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.645309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.645314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.645365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.645415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.645465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.645512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.645547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.645552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.645602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.645648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.645695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.645741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.645776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.645780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.645829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:23.645873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:23.645920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:23.645966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:23.646002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:23.646006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:23.646041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856887:8859], now have 1 active actors on pipe
2025-10-01T14:10:23.646209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255466804856887:8859]
2025-10-01T14:10:23.646236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:23.646685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:23.646694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:23.646714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1077 reason: error at write: Disconnected sessionId: src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0
2025-10-01T14:10:23.646806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:23.646912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1077 sessionId: src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0 is DEAD
2025-10-01T14:10:23.647190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:23.647201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0] Write session will restart in 0.007768s
2025-10-01T14:10:23.647225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0] Write session: Do CDS request
2025-10-01T14:10:23.647231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:23.655097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:23.656826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.656921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:23.656935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1078
2025-10-01T14:10:23.657017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.657039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:23.657046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:23.657049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:23.657416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1078 sessionId:  describe result for acl check
2025-10-01T14:10:23.657412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:23.657453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:23.657454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:23.657456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:23.657461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255466804857017:9310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:23.657553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:23.657561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:23.657568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:23.657599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:23.657623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255464427979691:8085]
2025-10-01T14:10:23.657855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255466804857017:9310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:23.657984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:23.658164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:23.658189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:23.658393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:23.658426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.658429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.658430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.658431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.658431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.658432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.658432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.658433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.658433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.658434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.658434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.658435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.658435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.658436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.658439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.658444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.658446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.658448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.658450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.658453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.658455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.658457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.658459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.658461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.658463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.658465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.658467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.658469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.658472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.658477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.658480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.658483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.658486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.658488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.658490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.658493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.658495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.658498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.658500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.658503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.658506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.658509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.658511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.658513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.658516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.658519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.658521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.658524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.658526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.658529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.658531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.658533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.658536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.658538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.658542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.658544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.658572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:23.659663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255466804857017:9310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:23.661408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255466804857017:9310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:23.661418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255466804857017:9310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:23.661421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255466804857017:9310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:23.661425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:23.661678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:23.662387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:23.662400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:23.662402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:23.662404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:23.662410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1077 [2:7556255464427979691:8085]
2025-10-01T14:10:23.662418Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:23.662428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:23.662430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.662431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.662433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.662443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:23.662445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:23.662449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:23.662480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.662485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.662487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.662488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:23.662490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:23.662536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:23.662542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.662548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.662553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.662562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:23.662574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804856899:2446], now have 1 active actors on pipe
2025-10-01T14:10:23.662580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804857056:9310], now have 1 active actors on pipe
2025-10-01T14:10:23.662585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255464427979686:8085]
2025-10-01T14:10:23.662586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255464427979686:8085]
2025-10-01T14:10:23.662588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255464427979686:8085]
2025-10-01T14:10:23.662595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:23.662604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:23.662604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:23.662606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:23.662607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:23.662615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:23.662617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:23.662632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255464427979686:8085]
2025-10-01T14:10:23.662636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:23.662638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:23.662613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1077
2025-10-01T14:10:23.662647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.662653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.662613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1077
2025-10-01T14:10:23.662683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:23.662691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.662694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.662695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:23.662701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.662707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:23.662723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.662825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.662831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.662839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.662887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1078 partition: 0 MaxSeqNo: 45 sessionId: src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0
2025-10-01T14:10:23.663196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80be62d3-e86158f-de348fb5-cc2c2e98_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:23.665586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0] Write session: try to update token
2025-10-01T14:10:23.665604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:23.678983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1078 sessionId: src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:23.681326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:23.681607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:23.681632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:23.681635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:23.681637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:23.681646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255464427979686:8085]
2025-10-01T14:10:23.681650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255464427979686:8085]
2025-10-01T14:10:23.681653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255464427979686:8085]
2025-10-01T14:10:23.681683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:23.681687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:23.681689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:23.681702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.681710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.681729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:23.681738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.681742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:23.681851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:23.746586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255466804857065:8859]
2025-10-01T14:10:23.746766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1077, pipe: [1:7556255466804857065:8859]
2025-10-01T14:10:23.814271Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:23.814751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804857065:8859], now have 1 active actors on pipe
2025-10-01T14:10:23.814949Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:23.814972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:23.814974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255466804857065:8859]
2025-10-01T14:10:23.814991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:23.815049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1078 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0
2025-10-01T14:10:23.815228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1078 sessionId: src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0 is DEAD
2025-10-01T14:10:23.815391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:23.815401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0] Write session will restart in 0.009732s
2025-10-01T14:10:23.815418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0] Write session: Do CDS request
2025-10-01T14:10:23.815423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:23.825797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.825915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:23.825928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1079
2025-10-01T14:10:23.826015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:23.826037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:23.826044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:23.826047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:23.826530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1079 sessionId:  describe result for acl check
2025-10-01T14:10:23.826572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:23.826595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:23.826602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:23.826607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255466804857199:9316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:23.827114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255466804857199:9316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:23.827344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:23.827757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:23.827919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:23.827930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:23.827941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:23.827993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:23.828031Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255464427979878:8097]
2025-10-01T14:10:23.828339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255466804857199:9316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:23.828582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:23.828791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:23.828830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:23.829104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:23.829168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.829174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.829174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.829175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.829176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.829176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.829177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.829178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.829178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.829179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.829180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.829180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.829181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.829181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.829185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.829190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.829192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.829194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.829197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.829199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.829201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.829203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.829205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.829208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.829210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.829212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.829214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.829216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.829220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.829225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:23.829229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.829231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:23.829234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.829236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:23.829239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.829242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:23.829244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.829247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:23.829249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.829252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:23.829256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.829258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:23.829260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.829263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:23.829266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.829268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:23.829275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.829277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.829280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.829282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.829288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.829291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.829293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.829299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:23.829301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.829304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:23.829324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:23.832526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255466804857199:9316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:23.832538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255466804857199:9316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:23.832540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255466804857199:9316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:23.832546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:23.832779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:23.833356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:23.833371Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:23.833372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:23.833375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:23.833379Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1078 [2:7556255464427979878:8097]
2025-10-01T14:10:23.833390Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:23.833402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:23.833404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.833407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.833409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.833425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:23.833430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:23.833436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:23.833481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.833488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.833490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.833494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:23.833496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:23.833543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:23.833548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.833555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:23.833560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:23.833569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:23.833583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255464427979873:8097]
2025-10-01T14:10:23.833587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255464427979873:8097]
2025-10-01T14:10:23.833589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255464427979873:8097]
2025-10-01T14:10:23.833595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:23.833600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:23.833604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804857238:9316], now have 1 active actors on pipe
2025-10-01T14:10:23.833608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:23.833609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804857079:2446], now have 1 active actors on pipe
2025-10-01T14:10:23.833610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:23.833612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:23.833620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:23.833622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:23.833646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255464427979873:8097]
2025-10-01T14:10:23.833658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:23.833651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1078
2025-10-01T14:10:23.833660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1078
2025-10-01T14:10:23.833677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:23.833708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.833714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.833734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:23.833742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:23.833745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:23.833746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:23.833752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:23.833761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:23.833771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.833875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.833881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.833891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:23.833968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1079 partition: 0 MaxSeqNo: 45 sessionId: src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0
2025-10-01T14:10:23.834353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afdb6a8-798a2fdc-9145c3c9-a5ad1e38_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:23.836767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0] Write session: try to update token
2025-10-01T14:10:23.836785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:23.844184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:23.844212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:23.844226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255464427979873:8097]
2025-10-01T14:10:23.844268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:23.844278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:23.844561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:23.844715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:23.844870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:23.845004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:23.845188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:23.845223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:23.850259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1079 sessionId: src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:23.852590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:23.852774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:23.852794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:23.852824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:23.852905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:23.861265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:23.861286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:23.861289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:23.861291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:23.861301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255464427979873:8097]
2025-10-01T14:10:23.861305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255464427979873:8097]
2025-10-01T14:10:23.861310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255464427979873:8097]
2025-10-01T14:10:23.861338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:23.861344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:23.861346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:23.861351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:23.861359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:23.861361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:23.861487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:23.915049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255466804857245:8859]
2025-10-01T14:10:23.915344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1078, pipe: [1:7556255466804857245:8859]
2025-10-01T14:10:23.995212Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:24.002021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.002046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.002180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.002233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.002290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.002347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.002409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.002417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.002474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.002526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.002583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.002639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.002680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.002685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.002744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.002802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.002856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.002914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.002960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.002965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.003025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.003081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.003134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.003189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.003227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.003232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.003291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.003346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.003401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.003457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.003494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.003500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.003557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.003612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.003666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.003724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.003767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.003772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.003828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.003881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.003935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.003991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.004031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.004036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.004089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.004139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.004193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.004249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.004289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.004294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.004352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.004408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.004464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.004515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.004554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.004560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.004611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.004663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.004728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.004785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.004823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.004830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.004869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255466804857245:8859], now have 1 active actors on pipe
2025-10-01T14:10:24.005094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:24.005112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255466804857245:8859]
2025-10-01T14:10:24.005130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:24.005265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:24.005293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1079 reason: error at write: Disconnected sessionId: src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0
2025-10-01T14:10:24.005459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1079 sessionId: src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0 is DEAD
2025-10-01T14:10:24.005573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:24.005583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0] Write session will restart in 0.008852s
2025-10-01T14:10:24.005607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0] Write session: Do CDS request
2025-10-01T14:10:24.005614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:24.005914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:24.015805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.015900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:24.015912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1080
2025-10-01T14:10:24.016003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.016025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:24.016031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:24.016034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:24.016316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1080 sessionId:  describe result for acl check
2025-10-01T14:10:24.016343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:24.016349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:24.016350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:24.016353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255471099824663:9320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:24.016733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:24.016797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255471099824663:9320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:24.017107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:24.017230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:24.017239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:24.017246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:24.017280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:24.017312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255468722947334:8100]
2025-10-01T14:10:24.017690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:24.017862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:24.017893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:24.018076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:24.018109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.018113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.018114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.018115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.018115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.018116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.018117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.018117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.018118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.018118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.018119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.018119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.018120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.018121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.018124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.018130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.018132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.018134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.018136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.018138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.018140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.018142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.018144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.018146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.018148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.018150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.018153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.018155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.018158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.018162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.018166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.018169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.018171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.018174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.018177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.018179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.018182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.018185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.018187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.018189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.018192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.018195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.018197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.018200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.018202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.018205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.018207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.018210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.018212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.018215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.018217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.018219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.018222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.018224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.018227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.018230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.018250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:24.018839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255471099824663:9320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:24.021174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255471099824663:9320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:24.021187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255471099824663:9320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:24.021191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255471099824663:9320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:24.021199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:24.021387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:24.022086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:24.022098Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:24.022099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:24.022101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:24.022106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1079 [2:7556255468722947334:8100]
2025-10-01T14:10:24.022115Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:24.022130Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:24.022135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.022137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.022138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.022148Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:24.022155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:24.022159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:24.022195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.022199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.022200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.022202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:24.022204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:24.022258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:24.022265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.022274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.022284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.022297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:24.022316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099824703:9320], now have 1 active actors on pipe
2025-10-01T14:10:24.022321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099824544:2446], now have 1 active actors on pipe
2025-10-01T14:10:24.022326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255468722947328:8100]
2025-10-01T14:10:24.022327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255468722947328:8100]
2025-10-01T14:10:24.022328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255468722947328:8100]
2025-10-01T14:10:24.022337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:24.022349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:24.022353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:24.022356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:24.022348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1079
2025-10-01T14:10:24.022358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:24.022362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1079
2025-10-01T14:10:24.022366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:24.022383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:24.022412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.022421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.022435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255468722947328:8100]
2025-10-01T14:10:24.022443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:24.022452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:24.022470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:24.022481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.022489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.022495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:24.022502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.022513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:24.022535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.022634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.022642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.022655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.022707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1080 partition: 0 MaxSeqNo: 45 sessionId: src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0
2025-10-01T14:10:24.022957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9859a-ee8932c1-950cbb83-c42ebfcb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:24.025075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0] Write session: try to update token
2025-10-01T14:10:24.025088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:24.038014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1080 sessionId: src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:24.040153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:24.041138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.041162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.041180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:24.041186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:24.041188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:24.041190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:24.041197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255468722947328:8100]
2025-10-01T14:10:24.041200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255468722947328:8100]
2025-10-01T14:10:24.041203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255468722947328:8100]
2025-10-01T14:10:24.041248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:24.041256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:24.041258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:24.041261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:24.041262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.041265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:24.041389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:24.105495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255471099824710:8859]
2025-10-01T14:10:24.105733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1079, pipe: [1:7556255471099824710:8859]
2025-10-01T14:10:24.173956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:24.174423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:24.174472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099824710:8859], now have 1 active actors on pipe
2025-10-01T14:10:24.174551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:24.174666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255471099824710:8859]
2025-10-01T14:10:24.174713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:24.183713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:24.184070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:24.184081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:24.184098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1080 reason: error at write: Disconnected sessionId: src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0
2025-10-01T14:10:24.184230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1080 sessionId: src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0 is DEAD
2025-10-01T14:10:24.184402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:24.184414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0] Write session will restart in 0.007863s
2025-10-01T14:10:24.184440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0] Write session: Do CDS request
2025-10-01T14:10:24.184446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:24.187218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:24.187371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:24.187379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:24.187386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:24.187420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:24.187456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255468722947493:8102]
2025-10-01T14:10:24.187818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:24.188005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:24.188036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:24.188241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:24.188277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.188281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.188282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.188283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.188284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.188284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.188285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.188285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.188286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.188286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.188287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.188288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.188288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.188289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.188292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.188298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.188300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.188302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.188304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.188306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.188307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.188309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.188311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.188313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.188315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.188317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.188319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.188321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.188326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.188331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.188334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.188338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.188341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.188344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.188346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.188352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.188355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.188358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.188363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.188367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.188370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.188372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.188378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.188380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.188382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.188385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.188389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.188392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.188394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.188397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.188399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.188401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.188406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.188409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.188411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.188414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.188435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:24.191889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:24.192557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:24.192567Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:24.192570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:24.192572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:24.192579Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1080 [2:7556255468722947493:8102]
2025-10-01T14:10:24.192599Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:24.192620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:24.192628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.192631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.192633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.192648Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:24.192657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:24.192667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:24.192733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.192740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.192742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.192745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:24.192747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:24.192813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:24.192820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.192829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.192838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.192855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:24.192876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099824712:2446], now have 1 active actors on pipe
2025-10-01T14:10:24.192888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255468722947487:8102]
2025-10-01T14:10:24.192894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255468722947487:8102]
2025-10-01T14:10:24.192897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255468722947487:8102]
2025-10-01T14:10:24.192909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:24.192924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:24.192926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:24.192932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:24.192933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:24.192938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:24.192941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:24.192915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1080
2025-10-01T14:10:24.192970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255468722947487:8102]
2025-10-01T14:10:24.192982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:24.192998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:24.193819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.193874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:24.193886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1081
2025-10-01T14:10:24.193977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.194023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:24.194033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:24.194036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:24.194411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1081 sessionId:  describe result for acl check
2025-10-01T14:10:24.194442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:24.194448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:24.194450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:24.194454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255471099824843:9324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:24.194950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255471099824843:9324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:24.196957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255471099824843:9324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:24.201863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255471099824843:9324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:24.201876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255471099824843:9324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:24.201879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255471099824843:9324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:24.201886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:24.202090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1080
2025-10-01T14:10:24.202698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099824878:9324], now have 1 active actors on pipe
2025-10-01T14:10:24.202723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.202729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.202742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:24.202748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:24.202753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255468722947487:8102]
2025-10-01T14:10:24.202783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:24.202786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d396e13-fb71748e-d33b765d-329394bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:24.202794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.202798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.202799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:24.202808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.202818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:24.202828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:24.202975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:24.203111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:24.203240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:24.203367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:24.203535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:24.203565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.203589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:24.203715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.203722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.203734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.203787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1081 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d396e13-fb71748e-d33b765d-329394bd_0
2025-10-01T14:10:24.204111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc553e47-d10e7ca6-771c7c27-47e72305_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d396e13-fb71748e-d33b765d-329394bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:24.206246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d396e13-fb71748e-d33b765d-329394bd_0] Write session: try to update token
2025-10-01T14:10:24.206257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d396e13-fb71748e-d33b765d-329394bd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:24.220150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1081 sessionId: src_id|8d396e13-fb71748e-d33b765d-329394bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:24.220471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:24.220489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:24.220491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:24.220493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:24.220501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255468722947487:8102]
2025-10-01T14:10:24.220503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255468722947487:8102]
2025-10-01T14:10:24.220506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255468722947487:8102]
2025-10-01T14:10:24.220543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:24.220546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:24.220551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:24.220553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.220554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:24.220556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:24.220683Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:24.222401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:24.274955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255471099824882:8859]
2025-10-01T14:10:24.275171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1080, pipe: [1:7556255471099824882:8859]
2025-10-01T14:10:24.356298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:24.357023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.357038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.357062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099824882:8859], now have 1 active actors on pipe
2025-10-01T14:10:24.357238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:24.357256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:24.357263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:24.357266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:24.357283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255471099824882:8859]
2025-10-01T14:10:24.357331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1081 reason: error at write: Disconnected sessionId: src_id|8d396e13-fb71748e-d33b765d-329394bd_0
2025-10-01T14:10:24.357547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1081 sessionId: src_id|8d396e13-fb71748e-d33b765d-329394bd_0 is DEAD
2025-10-01T14:10:24.357670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d396e13-fb71748e-d33b765d-329394bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:24.357677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d396e13-fb71748e-d33b765d-329394bd_0] Write session will restart in 0.007898s
2025-10-01T14:10:24.357697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d396e13-fb71748e-d33b765d-329394bd_0] Write session: Do CDS request
2025-10-01T14:10:24.357701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d396e13-fb71748e-d33b765d-329394bd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:24.366820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d396e13-fb71748e-d33b765d-329394bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.367054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:24.367070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1082
2025-10-01T14:10:24.367214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.367246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:24.367255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:24.367258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:24.367477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:24.367660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1082 sessionId:  describe result for acl check
2025-10-01T14:10:24.367696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:24.367702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:24.367703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:24.367708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255471099825014:9329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:24.368200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255471099825014:9329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:24.369827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255471099825014:9329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:24.370557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:24.370716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:24.370724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:24.370733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:24.370777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:24.370807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255468722947653:8104]
2025-10-01T14:10:24.371180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:24.371402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:24.371433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:24.371661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:24.371701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.371705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.371706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.371707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.371707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.371708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.371709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.371710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.371710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.371711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.371711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.371712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.371713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.371714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.371716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.371722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.371724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.371727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.371728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.371731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.371735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.371738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.371741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.371745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.371748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.371751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.371765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.371768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.371778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.371789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.371798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.371807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.371814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.371819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.371827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.371835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.371843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.371852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.371856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.371859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.371865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.371868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.371871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.371874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.371877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.371880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.371882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.371885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.371887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.371889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.371892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.371895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.371897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.371900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.371907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.371911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.371764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255471099825014:9329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:24.371779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255471099825014:9329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:24.371782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255471099825014:9329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:24.371789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:24.371952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:24.375448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:24.376296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:24.376308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:24.376310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:24.376312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:24.376316Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1081 [2:7556255468722947653:8104]
2025-10-01T14:10:24.376328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:24.376344Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:24.376349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.376352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.376353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.376365Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:24.376375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:24.376381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:24.376423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.376428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.376429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.376432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:24.376433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:24.376482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:24.376488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.376498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.376511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.376528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:24.376547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099824889:2446], now have 1 active actors on pipe
2025-10-01T14:10:24.376556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825052:9329], now have 1 active actors on pipe
2025-10-01T14:10:24.376561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255468722947647:8104]
2025-10-01T14:10:24.376563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255468722947647:8104]
2025-10-01T14:10:24.376564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255468722947647:8104]
2025-10-01T14:10:24.376573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:24.376584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:24.376589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:24.376591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:24.376593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:24.376576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1081
2025-10-01T14:10:24.376597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:24.376595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1081
2025-10-01T14:10:24.376599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:24.376622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255468722947647:8104]
2025-10-01T14:10:24.376629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:24.376631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:24.376646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.376654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.376692Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:24.376703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.376707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.376713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:24.376729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.376738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:24.376757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.376868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.376875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.376889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.376936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1082 partition: 0 MaxSeqNo: 45 sessionId: src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0
2025-10-01T14:10:24.377283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d396e13-fb71748e-d33b765d-329394bd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:24.379581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0] Write session: try to update token
2025-10-01T14:10:24.379597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:24.392994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1082 sessionId: src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:24.395111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:24.395776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.395799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.395818Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:24.395824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:24.395825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:24.395827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:24.395833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255468722947647:8104]
2025-10-01T14:10:24.395835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255468722947647:8104]
2025-10-01T14:10:24.395839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255468722947647:8104]
2025-10-01T14:10:24.395880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:24.395888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:24.395893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.395893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:24.395895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:24.395897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:24.396014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:24.457245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255471099825062:8859]
2025-10-01T14:10:24.457448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1081, pipe: [1:7556255471099825062:8859]
2025-10-01T14:10:24.530304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:24.530539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:24.530585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825062:8859], now have 1 active actors on pipe
2025-10-01T14:10:24.530678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:24.530740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255471099825062:8859]
2025-10-01T14:10:24.530765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:24.530774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:24.530777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:24.530843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1082 reason: error at write: Disconnected sessionId: src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0
2025-10-01T14:10:24.531020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1082 sessionId: src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0 is DEAD
2025-10-01T14:10:24.531153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:24.531165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0] Write session will restart in 0.007160s
2025-10-01T14:10:24.531190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0] Write session: Do CDS request
2025-10-01T14:10:24.531199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:24.539777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.539944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:24.539957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1083
2025-10-01T14:10:24.540027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.540048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:24.540055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:24.540057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:24.540392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1083 sessionId:  describe result for acl check
2025-10-01T14:10:24.540419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:24.540420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:24.540421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:24.540424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255471099825185:9333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:24.540792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255471099825185:9333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:24.541030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:24.542211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255471099825185:9333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:24.543565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:24.543701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:24.543708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:24.543716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:24.543752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:24.543782Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255468722947816:8107]
2025-10-01T14:10:24.544189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:24.544223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255471099825185:9333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:24.544235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255471099825185:9333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:24.544245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255471099825185:9333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:24.544287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:24.544393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:24.544428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:24.544624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:24.544658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.544662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.544663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.544663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.544664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.544665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.544665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.544666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.544667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.544667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.544668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.544668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.544669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.544670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.544672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.544678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.544681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.544683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.544685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.544687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.544689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.544691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.544693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.544695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.544697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.544699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.544701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.544703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.544707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.544712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.544716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.544731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.544733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.544736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.544738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.544741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.544743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.544746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.544748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.544751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.544754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.544764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.544769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.544777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.544781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.544790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.544797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.544801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.544806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.544810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.544818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.544822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.544833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.544837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.544841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.544846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.544868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:24.548209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:24.548815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:24.548829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:24.548830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:24.548833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:24.548838Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1082 [2:7556255468722947816:8107]
2025-10-01T14:10:24.548847Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:24.548858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:24.548860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.548862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.548864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.548877Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:24.548887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:24.548897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:24.548946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.548952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.548954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.548956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:24.548958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:24.549006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:24.549011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.549018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.549024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.549032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:24.549046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255468722947810:8107]
2025-10-01T14:10:24.549051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255468722947810:8107]
2025-10-01T14:10:24.549052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255468722947810:8107]
2025-10-01T14:10:24.549061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:24.549148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1082
2025-10-01T14:10:24.549155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1082
2025-10-01T14:10:24.549070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:24.549074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825063:2446], now have 1 active actors on pipe
2025-10-01T14:10:24.549076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825224:9333], now have 1 active actors on pipe
2025-10-01T14:10:24.549078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:24.549080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:24.549082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:24.549090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:24.549092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:24.549110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255468722947810:8107]
2025-10-01T14:10:24.549114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:24.549118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:24.549353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.549363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.549386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:24.549394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.549397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.549400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:24.549407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.549414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:24.549427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.549554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.549559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.549570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.549624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1083 partition: 0 MaxSeqNo: 45 sessionId: src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0
2025-10-01T14:10:24.549928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82f7194b-592d17a7-ba7560ba-6e6fc8ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:24.552243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0] Write session: try to update token
2025-10-01T14:10:24.552260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:24.559534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:24.559558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:24.559569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255468722947810:8107]
2025-10-01T14:10:24.559604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:24.559607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:24.559764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:24.559912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:24.560056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:24.560187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:24.560395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:24.560431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:24.565167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1083 sessionId: src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:24.567229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:24.567401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.567418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.567446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:24.567520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:24.577165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:24.577189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:24.577191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:24.577193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:24.577203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255468722947810:8107]
2025-10-01T14:10:24.577206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255468722947810:8107]
2025-10-01T14:10:24.577210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255468722947810:8107]
2025-10-01T14:10:24.577256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:24.577265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:24.577268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.577270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:24.577271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:24.577274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:24.577398Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:24.630822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255471099825256:8859]
2025-10-01T14:10:24.631068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1082, pipe: [1:7556255471099825256:8859]
2025-10-01T14:10:24.712470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:24.719186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.719208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.719343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.719391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.719448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.719498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.719746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.719755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.719810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.719860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.719909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.719963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.720000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.720006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.720065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.720116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.720176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.720229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.720268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.720273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.720330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.720391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.720451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.720509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.720548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.720553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.720612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.720661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.720711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.720781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.720821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.720827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.720878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.720927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.720988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.721046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.721085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.721090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.721147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.721195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.721248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.721303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.721342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.721347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.721402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.721461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.721524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.721576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.721613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.721618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.721673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.721723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.721773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.721822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.721860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.721865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.721916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.721965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.722022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.722072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.722112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.722117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.722153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825256:8859], now have 1 active actors on pipe
2025-10-01T14:10:24.722343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255471099825256:8859]
2025-10-01T14:10:24.722358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:24.722382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:24.722384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:24.722402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1083 reason: error at write: Disconnected sessionId: src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0
2025-10-01T14:10:24.722568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1083 sessionId: src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0 is DEAD
2025-10-01T14:10:24.722660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:24.722685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:24.722694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0] Write session will restart in 0.006483s
2025-10-01T14:10:24.722713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0] Write session: Do CDS request
2025-10-01T14:10:24.722718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:24.729795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.729880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:24.729894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1084
2025-10-01T14:10:24.729988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.730010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:24.730020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:24.730023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:24.730399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1084 sessionId:  describe result for acl check
2025-10-01T14:10:24.730428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:24.730434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:24.730435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:24.730440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255471099825375:9345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:24.730898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255471099825375:9345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:24.732044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:24.732973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255471099825375:9345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:24.734205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:24.734323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:24.734332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:24.734339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:24.734386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:24.734439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255468722947997:8112]
2025-10-01T14:10:24.734801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:24.734966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:24.734991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:24.735186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:24.735220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.735224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.735225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.735225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.735226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.735227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.735227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.735228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.735229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.735229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.735230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.735230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.735231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.735231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.735235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.735240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.735242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.735244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.735246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.735249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.735251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.735253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.735255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.735257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.735259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.735261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.735263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.735265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.735269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.735274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.735277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.735282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.735287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.735291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.735295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.735305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.735313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.735321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.735326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.735329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.735331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.735334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.735339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.735342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.735345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.735348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.735352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.735354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.735361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.735363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.735366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.735369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.735374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.735376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.735379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.735382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.735405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:24.735477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255471099825375:9345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:24.735490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255471099825375:9345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:24.735493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255471099825375:9345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:24.735499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:24.738670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:24.739511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:24.739524Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:24.739526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:24.739528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:24.739532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1083 [2:7556255468722947997:8112]
2025-10-01T14:10:24.739545Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:24.739559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:24.739566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.739570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.739575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.739587Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:24.739594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:24.739599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:24.739635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.739640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.739641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.739643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:24.739645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:24.739693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:24.739699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.739706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.739712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.739724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:24.739739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825423:9345], now have 1 active actors on pipe
2025-10-01T14:10:24.739745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825260:2446], now have 1 active actors on pipe
2025-10-01T14:10:24.739750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255468722947991:8112]
2025-10-01T14:10:24.739754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255468722947991:8112]
2025-10-01T14:10:24.739756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255468722947991:8112]
2025-10-01T14:10:24.739765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:24.739777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:24.739777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:24.739780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:24.739781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:24.739789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:24.739791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:24.739792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1083
2025-10-01T14:10:24.739798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1083
2025-10-01T14:10:24.739807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255468722947991:8112]
2025-10-01T14:10:24.739813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:24.739816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:24.739831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.739834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.739857Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:24.739866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.739869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.739870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:24.739876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.739882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:24.739894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.739989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.739995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.740005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.740058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1084 partition: 0 MaxSeqNo: 45 sessionId: src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0
2025-10-01T14:10:24.740341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c724e8cb-5e416a1c-d31c08c1-d62cb1f2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:24.742492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0] Write session: try to update token
2025-10-01T14:10:24.742504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:24.754971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1084 sessionId: src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:24.757047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:24.757178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.757204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.759224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:24.759244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:24.759245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:24.759247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:24.759256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255468722947991:8112]
2025-10-01T14:10:24.759261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255468722947991:8112]
2025-10-01T14:10:24.759264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255468722947991:8112]
2025-10-01T14:10:24.759305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:24.759312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:24.759316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:24.759318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:24.759327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:24.759332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.759335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:24.759391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:24.759472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:24.822296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255471099825443:8859]
2025-10-01T14:10:24.822506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1083, pipe: [1:7556255471099825443:8859]
2025-10-01T14:10:24.903839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:24.910333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.910359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.910551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.910626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.910696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.910771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.910823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.910833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.910916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.910987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.911064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.911138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.911188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.911195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.911268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.911332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.911400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.911463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.911508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.911515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.911584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.911921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.911978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.912032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.912072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.912077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.912137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.912191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.912244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.912318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.912359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.912364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.912422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.912476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.912535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.912592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.912634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.912639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.912696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.912761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.912819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.912876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.912914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.912919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.912973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.913026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.913084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.913139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.913179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.913184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.913244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.913298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.913357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.913416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.913458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.913463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.913523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:24.913579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:24.913642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:24.913699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:24.913788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:24.913795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:24.913836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825443:8859], now have 1 active actors on pipe
2025-10-01T14:10:24.914051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255471099825443:8859]
2025-10-01T14:10:24.914074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:24.914077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:24.914078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:24.914103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1084 reason: error at write: Disconnected sessionId: src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0
2025-10-01T14:10:24.914305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1084 sessionId: src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0 is DEAD
2025-10-01T14:10:24.914481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:24.914494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0] Write session will restart in 0.009943s
2025-10-01T14:10:24.914519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0] Write session: Do CDS request
2025-10-01T14:10:24.914525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:24.914548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:24.925813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.925921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:24.925936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1085
2025-10-01T14:10:24.926036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:24.926063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:24.926068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:24.926075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:24.926469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1085 sessionId:  describe result for acl check
2025-10-01T14:10:24.926499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:24.926504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:24.926506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:24.926511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255471099825570:9350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:24.926492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:24.926828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:24.926970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255471099825570:9350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:24.926998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:24.927007Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:24.927014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:24.927045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:24.927072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255468722948191:8125]
2025-10-01T14:10:24.927481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:24.927660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:24.927689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:24.927900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:24.927938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.927943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.927943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.927944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.927945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.927945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.927946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.927947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.927947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.927948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.927949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.927949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.927950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.927950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.927953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.927958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.927961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.927963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.927965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.927967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.927969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.927971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.927973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.927975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.927977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.927979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.927981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.927983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.927988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.927992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:24.927996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.927999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:24.928002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.928005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:24.928007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.928009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:24.928012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.928015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:24.928017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.928020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:24.928022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.928025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:24.928027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.928030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:24.928033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.928035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:24.928037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.928040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.928042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.928045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.928048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.928050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.928053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.928055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:24.928057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.928060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:24.928079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:24.928653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255471099825570:9350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:24.930981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255471099825570:9350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:24.930993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255471099825570:9350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:24.930996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255471099825570:9350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:24.931003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:24.931283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:24.932085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:24.932097Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:24.932099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:24.932101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:24.932106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1084 [2:7556255468722948191:8125]
2025-10-01T14:10:24.932116Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:24.932129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:24.932134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.932137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.932138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.932149Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:24.932156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:24.932160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:24.932201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.932207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.932208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.932211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:24.932213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:24.932262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:24.932269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.932279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:24.932292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:24.932310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:24.932327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825608:9350], now have 1 active actors on pipe
2025-10-01T14:10:24.932332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255471099825445:2446], now have 1 active actors on pipe
2025-10-01T14:10:24.932338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255468722948186:8125]
2025-10-01T14:10:24.932339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255468722948186:8125]
2025-10-01T14:10:24.932340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255468722948186:8125]
2025-10-01T14:10:24.932333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1084
2025-10-01T14:10:24.932348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:24.932336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1084
2025-10-01T14:10:24.932360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:24.932364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:24.932367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:24.932370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:24.932377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:24.932382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:24.932396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.932405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.932435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255468722948186:8125]
2025-10-01T14:10:24.932443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:24.932451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:24.932453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:24.932458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:24.932460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:24.932462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:24.932468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:24.932474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:24.932495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.932599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.932606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.932618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:24.932674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1085 partition: 0 MaxSeqNo: 45 sessionId: src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0
2025-10-01T14:10:24.933003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe839b8-5a0c1f2e-4dadb113-4e511647_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:24.935196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0] Write session: try to update token
2025-10-01T14:10:24.935210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:24.947693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1085 sessionId: src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:24.949961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:24.951767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:24.951794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:24.951816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:24.951819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:24.951821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:24.951824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:24.951834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255468722948186:8125]
2025-10-01T14:10:24.951838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255468722948186:8125]
2025-10-01T14:10:24.951843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255468722948186:8125]
2025-10-01T14:10:24.951876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:24.951882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:24.951885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:24.951895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:24.951901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:24.951903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:24.952033Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:25.014305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255475394792913:8859]
2025-10-01T14:10:25.014632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1084, pipe: [1:7556255475394792913:8859]
2025-10-01T14:10:25.088889Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:25.089253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:25.089302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394792913:8859], now have 1 active actors on pipe
2025-10-01T14:10:25.089374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:25.089515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:25.089573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255475394792913:8859]
2025-10-01T14:10:25.099150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:25.099166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:25.099190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1085 reason: error at write: Disconnected sessionId: src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0
2025-10-01T14:10:25.099395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1085 sessionId: src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0 is DEAD
2025-10-01T14:10:25.099483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:25.099492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0] Write session will restart in 0.007585s
2025-10-01T14:10:25.099527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0] Write session: Do CDS request
2025-10-01T14:10:25.099533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:25.103059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:25.105913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:25.106116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:25.106126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:25.106134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:25.106174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:25.106204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255473017915653:8127]
2025-10-01T14:10:25.106770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:25.107040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:25.107086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:25.107381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:25.107445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.107451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.107452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.107453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.107454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.107456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.107457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.107458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.107459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.107460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.107461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.107462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.107463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.107464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.107469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.107478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.107482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.107486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.107489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.107492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.107495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.107499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.107503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.107507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.107511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.107514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.107517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.107521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.107528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.107536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.107543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.107548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.107552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.107557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.107561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.107566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.107571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.107580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.107584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.107589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.107594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.107599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.107603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.107607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.107612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.107617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.107621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.107626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.107630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.107635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.107639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.107650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.107653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.107656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.107659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.107662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.107682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:25.107943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.107985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:25.108002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1086
2025-10-01T14:10:25.108151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.108184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:25.108196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:25.108204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:25.108600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1086 sessionId:  describe result for acl check
2025-10-01T14:10:25.108633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:25.108640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:25.108642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:25.108647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255475394793047:9354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:25.109126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255475394793047:9354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:25.111432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255475394793047:9354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:25.111575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:25.112169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:25.112188Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:25.112190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:25.112194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:25.112203Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1085 [2:7556255473017915653:8127]
2025-10-01T14:10:25.112218Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:25.112234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:25.112242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.112246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.112248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.112264Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:25.112275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:25.112281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:25.112342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.112349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.112351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.112354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:25.112356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:25.112420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:25.112427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.112437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.112447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.112466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:25.112488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394792915:2446], now have 1 active actors on pipe
2025-10-01T14:10:25.112501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255473017915647:8127]
2025-10-01T14:10:25.112507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255473017915647:8127]
2025-10-01T14:10:25.112510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255473017915647:8127]
2025-10-01T14:10:25.112522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:25.112533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:25.112526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1085
2025-10-01T14:10:25.112539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:25.112547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:25.112549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:25.112554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:25.112557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:25.112589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255473017915647:8127]
2025-10-01T14:10:25.112600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:25.112610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:25.117012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255475394793047:9354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:25.117029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255475394793047:9354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:25.117032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255475394793047:9354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:25.117040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:25.117292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793087:9354], now have 1 active actors on pipe
2025-10-01T14:10:25.117329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1085
2025-10-01T14:10:25.117384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.117394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.117427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:25.117440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.117447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.117450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:25.117459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.117472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:25.117486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.117640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.117651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.117667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.117733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1086 partition: 0 MaxSeqNo: 45 sessionId: src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0
2025-10-01T14:10:25.118092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d19e5b05-6b981dae-89361d3c-4c6c3037_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:25.120486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0] Write session: try to update token
2025-10-01T14:10:25.120506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:25.127136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:25.127153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:25.127161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255473017915647:8127]
2025-10-01T14:10:25.127203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:25.127211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:25.127352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:25.127478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:25.127591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:25.127704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:25.127864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:25.127894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:25.133710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1086 sessionId: src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:25.135813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:25.135994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.136012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.136040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:25.136137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:25.140544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:25.140564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:25.140566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:25.140567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:25.140576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255473017915647:8127]
2025-10-01T14:10:25.140579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255473017915647:8127]
2025-10-01T14:10:25.140581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255473017915647:8127]
2025-10-01T14:10:25.140619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:25.140622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:25.140626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:25.140628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.140629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:25.140630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:25.140767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:25.189917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255475394793093:8859]
2025-10-01T14:10:25.190179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1085, pipe: [1:7556255475394793093:8859]
2025-10-01T14:10:25.273341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:25.280119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.280146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.280275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.280334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.280392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.280445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.280483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.280493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.280552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.280604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.280658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.280715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.280765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.280770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.280833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.280889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.280944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.281001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.281041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.281047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.281104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.281160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.281214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.281270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.281310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.281315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.281369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.281432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.281488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.281541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.281579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.281587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.281644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.281698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.281752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.281808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.281846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.281852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.281906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.281959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.282014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.282073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.282112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.282117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.282174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.282229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.282284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.282340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.282394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.282399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.282455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.282522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.282581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.282634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.282719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.282724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.282780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:25.282833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:25.282887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:25.282944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:25.283029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:25.283035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:25.283075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793093:8859], now have 1 active actors on pipe
2025-10-01T14:10:25.283409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255475394793093:8859]
2025-10-01T14:10:25.283416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:25.283673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:25.283681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:25.283700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1086 reason: error at write: Disconnected sessionId: src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0
2025-10-01T14:10:25.283860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1086 sessionId: src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0 is DEAD
2025-10-01T14:10:25.283993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:25.284003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0] Write session will restart in 0.005965s
2025-10-01T14:10:25.284027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0] Write session: Do CDS request
2025-10-01T14:10:25.284034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:25.284204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:25.290801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.290865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:25.290877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1087
2025-10-01T14:10:25.291005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.291035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:25.291044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:25.291047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:25.291411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1087 sessionId:  describe result for acl check
2025-10-01T14:10:25.291444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:25.291446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:25.291447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:25.291452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255475394793197:9358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:25.291932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255475394793197:9358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:25.294047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255475394793197:9358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:25.296380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:25.296436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255475394793197:9358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:25.296448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255475394793197:9358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:25.296452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255475394793197:9358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:25.296458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:25.296700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:25.296832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:25.296841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:25.296849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:25.296877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:25.296903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255473017915819:8129]
2025-10-01T14:10:25.297303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:25.297538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:25.297568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:25.297772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:25.297810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.297814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.297815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.297816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.297816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.297817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.297817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.297818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.297819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.297819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.297820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.297821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.297821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.297822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.297825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.297831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.297833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.297836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.297838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.297840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.297842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.297845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.297847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.297849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.297851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.297854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.297856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.297858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.297863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.297868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.297872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.297875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.297877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.297881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.297883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.297886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.297889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.297892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.297894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.297897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.297900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.297902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.297905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.297908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.297910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.297913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.297915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.297919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.297921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.297924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.297927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.297929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.297933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.297936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.297938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.297941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.297960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:25.301345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:25.301908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:25.301919Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:25.301921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:25.301923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:25.301928Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1086 [2:7556255473017915819:8129]
2025-10-01T14:10:25.301938Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:25.301954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:25.301959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.301961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.301963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.301973Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:25.301980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:25.301984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:25.302026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.302032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.302033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.302035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:25.302037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:25.302212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1086
2025-10-01T14:10:25.302214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1086
2025-10-01T14:10:25.302409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:25.302416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.302424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.302430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.302440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:25.302458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793258:9358], now have 1 active actors on pipe
2025-10-01T14:10:25.302464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793096:2446], now have 1 active actors on pipe
2025-10-01T14:10:25.302478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.302482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.302498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255473017915813:8129]
2025-10-01T14:10:25.302503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255473017915813:8129]
2025-10-01T14:10:25.302504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255473017915813:8129]
2025-10-01T14:10:25.302517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:25.302532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:25.302533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:25.302535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:25.302537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:25.302544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:25.302546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:25.302558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:25.302563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.302570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.302571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:25.302577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.302584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:25.302604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255473017915813:8129]
2025-10-01T14:10:25.302610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:25.302614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:25.302617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.302771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.302783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.302801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.302874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1087 partition: 0 MaxSeqNo: 45 sessionId: src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0
2025-10-01T14:10:25.303231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ad51ab-6838cf3-cb55d95f-d6ca9255_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:25.305787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0] Write session: try to update token
2025-10-01T14:10:25.305803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:25.318847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1087 sessionId: src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:25.321213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:25.321524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.321548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.321565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:25.321568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:25.321570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:25.321571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:25.321579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255473017915813:8129]
2025-10-01T14:10:25.321582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255473017915813:8129]
2025-10-01T14:10:25.321584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255473017915813:8129]
2025-10-01T14:10:25.321612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:25.321625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:25.321628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:25.321628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:25.321632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.321634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:25.321751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:25.383459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255475394793277:8859]
2025-10-01T14:10:25.383701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1086, pipe: [1:7556255475394793277:8859]
2025-10-01T14:10:25.452959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:25.453365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:25.453416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793277:8859], now have 1 active actors on pipe
2025-10-01T14:10:25.453469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:25.453686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255475394793277:8859]
2025-10-01T14:10:25.453713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:25.461457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:25.461473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:25.461490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1087 reason: error at write: Disconnected sessionId: src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0
2025-10-01T14:10:25.461616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1087 sessionId: src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0 is DEAD
2025-10-01T14:10:25.461732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:25.461740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0] Write session will restart in 0.006677s
2025-10-01T14:10:25.461758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0] Write session: Do CDS request
2025-10-01T14:10:25.461765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:25.469812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.469996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:25.470011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1088
2025-10-01T14:10:25.470101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.470123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:25.470131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:25.470133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:25.470502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1088 sessionId:  describe result for acl check
2025-10-01T14:10:25.470534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:25.470540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:25.470541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:25.470547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255475394793408:9363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:25.470828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:25.471008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255475394793408:9363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:25.471180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:25.471312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:25.471322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:25.471342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:25.471383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:25.471417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255473017915987:8132]
2025-10-01T14:10:25.471958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:25.472115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:25.472141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:25.472324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:25.472358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.472362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.472363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.472363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.472364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.472364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.472365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.472366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.472366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.472367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.472368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.472369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.472369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.472370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.472373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.472378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.472380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.472383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.472385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.472387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.472389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.472391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.472393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.472396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.472398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.472400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.472402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.472404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.472409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.472414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.472417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.472420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.472422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.472425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.472427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.472430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.472432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.472435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.472437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.472440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.472442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.472448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.472451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.472453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.472456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.472459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.472464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.472466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.472469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.472472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.472477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.472479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.472482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.472485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.472487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.472489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.472508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:25.472709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255475394793408:9363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:25.475381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255475394793408:9363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:25.475391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255475394793408:9363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:25.475394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255475394793408:9363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:25.475400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:25.475601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:25.476105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:25.476116Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:25.476117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:25.476119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:25.476124Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1087 [2:7556255473017915987:8132]
2025-10-01T14:10:25.476132Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:25.476142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:25.476147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.476149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.476150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.476170Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:25.476177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:25.476181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:25.476215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.476219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.476220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.476222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:25.476224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:25.476266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:25.476271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.476277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.476285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.476297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:25.476312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793279:2446], now have 1 active actors on pipe
2025-10-01T14:10:25.476317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793447:9363], now have 1 active actors on pipe
2025-10-01T14:10:25.476322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255473017915982:8132]
2025-10-01T14:10:25.476326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255473017915982:8132]
2025-10-01T14:10:25.476327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255473017915982:8132]
2025-10-01T14:10:25.476336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:25.476350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1087
2025-10-01T14:10:25.476366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1087
2025-10-01T14:10:25.476347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:25.476347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:25.476349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:25.476350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:25.476360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:25.476362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:25.476377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255473017915982:8132]
2025-10-01T14:10:25.476378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:25.476380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:25.476393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.476395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.476422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:25.476430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.476433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.476434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:25.476440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.476445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:25.476457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.476567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.476572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.476581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.476629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1088 partition: 0 MaxSeqNo: 45 sessionId: src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0
2025-10-01T14:10:25.476880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a3be0c-47bb8975-8151e8a2-f0af7051_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:25.479136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0] Write session: try to update token
2025-10-01T14:10:25.479150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:25.491249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1088 sessionId: src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:25.493232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:25.494870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.494892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.494909Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:25.494911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:25.494913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:25.494914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:25.494921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255473017915982:8132]
2025-10-01T14:10:25.494924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255473017915982:8132]
2025-10-01T14:10:25.494926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255473017915982:8132]
2025-10-01T14:10:25.494958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:25.494966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:25.494970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:25.494971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.494972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:25.494972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:25.495096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:25.553946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255475394793454:8859]
2025-10-01T14:10:25.554165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1087, pipe: [1:7556255475394793454:8859]
2025-10-01T14:10:25.625534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:25.626015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:25.626057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793454:8859], now have 1 active actors on pipe
2025-10-01T14:10:25.626121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:25.626202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:25.626209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:25.626269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1088 reason: error at write: Disconnected sessionId: src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0
2025-10-01T14:10:25.626432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1088 sessionId: src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0 is DEAD
2025-10-01T14:10:25.626552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:25.626560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0] Write session will restart in 0.007458s
2025-10-01T14:10:25.626559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255475394793454:8859]
2025-10-01T14:10:25.626583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0] Write session: Do CDS request
2025-10-01T14:10:25.626576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:25.626590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:25.634871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.634938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:25.634951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1089
2025-10-01T14:10:25.635073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.635085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:25.635098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:25.635108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:25.635111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:25.635418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1089 sessionId:  describe result for acl check
2025-10-01T14:10:25.635440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:25.635446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:25.635447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:25.635452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255475394793598:9373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:25.635885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255475394793598:9373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:25.637500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255475394793598:9373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:25.637686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:25.637843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:25.637852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:25.637862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:25.637902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:25.637941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255473017916154:8134]
2025-10-01T14:10:25.638300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:25.638535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:25.638576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:25.638778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:25.638814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.638817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.638818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.638819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.638819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.638820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.638820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.638821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.638821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.638822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.638823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.638823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.638824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.638824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.638827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.638832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.638834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.638836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.638838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.638840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.638842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.638844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.638845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.638847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.638849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.638851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.638853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.638855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.638859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.638864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.638877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.638883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.638885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.638888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.638893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.638896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.638898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.638901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.638906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.638909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.638912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.638918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.638920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.638923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.638928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.638930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.638932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.638937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.638939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.638941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.638946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.638949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.638951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.638963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.638971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.638975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.639003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:25.641963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255475394793598:9373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:25.641978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255475394793598:9373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:25.641981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255475394793598:9373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:25.641987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:25.642164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:25.642743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:25.642756Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:25.642758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:25.642761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:25.642766Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1088 [2:7556255473017916154:8134]
2025-10-01T14:10:25.642779Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:25.642793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:25.642799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.642803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.642805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.642820Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:25.642825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:25.642830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:25.642876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.642884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.642886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.642888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:25.642891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:25.642944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:25.642952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.642962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.642976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.642994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:25.643013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793645:9373], now have 1 active actors on pipe
2025-10-01T14:10:25.643020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793469:2446], now have 1 active actors on pipe
2025-10-01T14:10:25.643026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255473017916148:8134]
2025-10-01T14:10:25.643029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255473017916148:8134]
2025-10-01T14:10:25.643031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255473017916148:8134]
2025-10-01T14:10:25.643019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1088
2025-10-01T14:10:25.643033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1088
2025-10-01T14:10:25.643038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:25.643054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:25.643053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:25.643056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:25.643058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:25.643065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:25.643067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:25.643082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.643086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.643122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255473017916148:8134]
2025-10-01T14:10:25.643133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:25.643143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:25.643146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17e5cee8-dff74425-fffc2328-742e4118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:25.643152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.643155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.643157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:25.643166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.643173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:25.643207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.643374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.643381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.643394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.643458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1089 partition: 0 MaxSeqNo: 45 sessionId: src_id|17e5cee8-dff74425-fffc2328-742e4118_0
2025-10-01T14:10:25.643806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e21741a-e2d67e85-7942a634-63dd70e5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|17e5cee8-dff74425-fffc2328-742e4118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:25.645928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17e5cee8-dff74425-fffc2328-742e4118_0] Write session: try to update token
2025-10-01T14:10:25.645939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17e5cee8-dff74425-fffc2328-742e4118_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:25.658748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1089 sessionId: src_id|17e5cee8-dff74425-fffc2328-742e4118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:25.660869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:25.662008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.662032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.662049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:25.662055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:25.662057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:25.662058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:25.662064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255473017916148:8134]
2025-10-01T14:10:25.662070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255473017916148:8134]
2025-10-01T14:10:25.662072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255473017916148:8134]
2025-10-01T14:10:25.662100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:25.662111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:25.662114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:25.662114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:25.662119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.662120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:25.662234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:25.726494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255475394793654:8859]
2025-10-01T14:10:25.726743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1088, pipe: [1:7556255475394793654:8859]
2025-10-01T14:10:25.793388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:25.794021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:25.794062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793654:8859], now have 1 active actors on pipe
2025-10-01T14:10:25.794158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:25.794242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:25.794249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:25.794308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1089 reason: error at write: Disconnected sessionId: src_id|17e5cee8-dff74425-fffc2328-742e4118_0
2025-10-01T14:10:25.794475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1089 sessionId: src_id|17e5cee8-dff74425-fffc2328-742e4118_0 is DEAD
2025-10-01T14:10:25.794548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255475394793654:8859]
2025-10-01T14:10:25.794572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:25.794637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e5cee8-dff74425-fffc2328-742e4118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:25.794648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e5cee8-dff74425-fffc2328-742e4118_0] Write session will restart in 0.008099s
2025-10-01T14:10:25.794671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e5cee8-dff74425-fffc2328-742e4118_0] Write session: Do CDS request
2025-10-01T14:10:25.794680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e5cee8-dff74425-fffc2328-742e4118_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:25.803814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17e5cee8-dff74425-fffc2328-742e4118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.803877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:25.803892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1090
2025-10-01T14:10:25.803979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.804007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:25.804015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:25.804018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:25.804049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:25.804392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1090 sessionId:  describe result for acl check
2025-10-01T14:10:25.804419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:25.804425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:25.804426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:25.804430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255475394793799:9380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:25.804873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255475394793799:9380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:25.805977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255475394793799:9380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:25.806673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:25.806805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:25.806812Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:25.806819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:25.806847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:25.806870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255473017916370:8145]
2025-10-01T14:10:25.807215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:25.807422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:25.807450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:25.807650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:25.807686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.807690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.807691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.807691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.807692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.807692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.807693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.807693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.807694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.807694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.807695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.807695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.807696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.807696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.807699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.807704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.807706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.807708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.807710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.807712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.807714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.807716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.807718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.807720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.807722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.807724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.807726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.807728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.807732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.807736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.807740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.807743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.807745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.807743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255475394793799:9380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:25.807747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.807750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.807752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.807753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255475394793799:9380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:25.807755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.807758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.807755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255475394793799:9380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:25.807760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.807762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.807764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.807767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.807761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:25.807769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.807771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.807774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.807777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.807779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.807781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.807783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.807786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.807788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.807791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.807793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.807795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.807797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.807799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.807819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:25.810933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:25.811728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:25.811740Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:25.811742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:25.811744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:25.811749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1089 [2:7556255473017916370:8145]
2025-10-01T14:10:25.811758Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:25.811768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:25.811774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.811777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.811778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.811791Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:25.811802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:25.811811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:25.811868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.811873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.811875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.811877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:25.811879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:25.811925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:25.811930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.811937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.811947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.811959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:25.811973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793668:2446], now have 1 active actors on pipe
2025-10-01T14:10:25.811979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793834:9380], now have 1 active actors on pipe
2025-10-01T14:10:25.811983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255473017916352:8145]
2025-10-01T14:10:25.811985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255473017916352:8145]
2025-10-01T14:10:25.811986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255473017916352:8145]
2025-10-01T14:10:25.811995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:25.812007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:25.812007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:25.812009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:25.812010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:25.812018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:25.812020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:25.812035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255473017916352:8145]
2025-10-01T14:10:25.812046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:25.812050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:25.812030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1089
2025-10-01T14:10:25.812039Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1089
2025-10-01T14:10:25.812074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.812080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.812098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:25.812106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.812112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.812113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:25.812118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.812126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:25.812138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.812237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.812242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.812251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.812313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1090 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0
2025-10-01T14:10:25.812583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17e5cee8-dff74425-fffc2328-742e4118_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:25.814789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0] Write session: try to update token
2025-10-01T14:10:25.814804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:25.827258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1090 sessionId: src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:25.829366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:25.831071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.831097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.831115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:25.831122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:25.831124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:25.831125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:25.831131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255473017916352:8145]
2025-10-01T14:10:25.831135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255473017916352:8145]
2025-10-01T14:10:25.831139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255473017916352:8145]
2025-10-01T14:10:25.831173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:25.831184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:25.831184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:25.831188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.831189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:25.831189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:25.831312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:25.894952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255475394793845:8859]
2025-10-01T14:10:25.895207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1089, pipe: [1:7556255475394793845:8859]
2025-10-01T14:10:25.962989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:25.963357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:25.963402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793845:8859], now have 1 active actors on pipe
2025-10-01T14:10:25.963498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:25.963534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255475394793845:8859]
2025-10-01T14:10:25.963554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:25.963577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:25.963583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:25.963638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1090 reason: error at write: Disconnected sessionId: src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0
2025-10-01T14:10:25.963769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1090 sessionId: src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0 is DEAD
2025-10-01T14:10:25.963884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:25.963893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0] Write session will restart in 0.009975s
2025-10-01T14:10:25.963910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0] Write session: Do CDS request
2025-10-01T14:10:25.963916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:25.972878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:25.974783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.974915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:25.974929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1091
2025-10-01T14:10:25.975025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:25.975054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:25.975063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:25.975066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:25.975445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1091 sessionId:  describe result for acl check
2025-10-01T14:10:25.975477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:25.975483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:25.975484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:25.975489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255475394794001:9385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:25.975497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:25.975620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:25.975628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:25.975635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:25.975663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:25.975690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255473017916541:8152]
2025-10-01T14:10:25.975961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255475394794001:9385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:25.976050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:25.976223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:25.976248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:25.976429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:25.976462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.976467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.976467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.976468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.976469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.976469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.976470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.976470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.976471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.976471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.976472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.976473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.976473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.976474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.976476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.976482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.976484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.976486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.976488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.976490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.976492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.976494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.976496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.976499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.976501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.976503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.976505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.976507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.976511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.976514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:25.976518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.976521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:25.976523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.976526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:25.976528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.976532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:25.976534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.976537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:25.976539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.976544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:25.976546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.976550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:25.976555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.976558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:25.976560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.976563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:25.976568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.976572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.976574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.976577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.976582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.976585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.976589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.976595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:25.976597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.976600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:25.976622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:25.977434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255475394794001:9385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:25.979555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255475394794001:9385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:25.979564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255475394794001:9385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:25.979567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255475394794001:9385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:25.979573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:25.979845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:25.980629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:25.980644Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:25.980645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:25.980647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:25.980651Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1090 [2:7556255473017916541:8152]
2025-10-01T14:10:25.980661Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:25.980675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:25.980680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.980682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.980683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.980693Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:25.980700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:25.980704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:25.980752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.980756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.980758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.980760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:25.980761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:25.980807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:25.980812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.980818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:25.980827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:25.980835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:25.980850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394794036:9385], now have 1 active actors on pipe
2025-10-01T14:10:25.980855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255475394793869:2446], now have 1 active actors on pipe
2025-10-01T14:10:25.980861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255473017916535:8152]
2025-10-01T14:10:25.980865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255473017916535:8152]
2025-10-01T14:10:25.980866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255473017916535:8152]
2025-10-01T14:10:25.980874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:25.980885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:25.980886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:25.980893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:25.980893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:25.980894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:25.980895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:25.980889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1090
2025-10-01T14:10:25.980892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1090
2025-10-01T14:10:25.980910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255473017916535:8152]
2025-10-01T14:10:25.980915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:25.980917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:25.980926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.980932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.980962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:25.980970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:25.980973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:25.980974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:25.980981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:25.980986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:25.981000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.981101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.981107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.981117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:25.981175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1091 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0
2025-10-01T14:10:25.981493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc4f8536-18f89f5f-3cd15376-e40ca156_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:25.983745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0] Write session: try to update token
2025-10-01T14:10:25.983758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:25.996109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1091 sessionId: src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:25.998137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:25.999597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:25.999624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:25.999642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:25.999645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:25.999646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:25.999647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:25.999653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255473017916535:8152]
2025-10-01T14:10:25.999656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255473017916535:8152]
2025-10-01T14:10:25.999658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255473017916535:8152]
2025-10-01T14:10:25.999691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:25.999701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:25.999703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:25.999705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:25.999706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:25.999708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:25.999822Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:26.063918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255479689761339:8859]
2025-10-01T14:10:26.064159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1090, pipe: [1:7556255479689761339:8859]
2025-10-01T14:10:26.140349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:26.140817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:26.140869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761339:8859], now have 1 active actors on pipe
2025-10-01T14:10:26.140910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:26.141042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255479689761339:8859]
2025-10-01T14:10:26.141073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:26.149070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:26.149080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:26.149097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1091 reason: error at write: Disconnected sessionId: src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0
2025-10-01T14:10:26.149225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1091 sessionId: src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0 is DEAD
2025-10-01T14:10:26.149361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:26.149369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0] Write session will restart in 0.008011s
2025-10-01T14:10:26.149386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0] Write session: Do CDS request
2025-10-01T14:10:26.149390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:26.152243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:26.154859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:26.155022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:26.155032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:26.155042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:26.155080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:26.155118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255477312884007:8154]
2025-10-01T14:10:26.155862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:26.156063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:26.156101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:26.156380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:26.156430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.156435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.156436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.156437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.156438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.156439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.156440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.156441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.156442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.156443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.156444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.156445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.156446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.156447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.156451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.156459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.156463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.156466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.156469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.156472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.156475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.156478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.156481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.156489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.156492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.156499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.156502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.156508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.156515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.156525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.156534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.156543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.156550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.156554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.156562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.156566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.156574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.156578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.156587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.156596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.156604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.156608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.156611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.156619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.156624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.156632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.156639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.156644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.156652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.156659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.156666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.156674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.156684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.156691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.156698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.156702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.156751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:26.158805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.158828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:26.158839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1092
2025-10-01T14:10:26.158969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.158989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:26.158996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:26.158998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:26.159333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1092 sessionId:  describe result for acl check
2025-10-01T14:10:26.159365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:26.159372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:26.159373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:26.159378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255479689761478:9389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:26.159894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255479689761478:9389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:26.160213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:26.161505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:26.161524Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:26.161526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:26.161530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:26.161537Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1091 [2:7556255477312884007:8154]
2025-10-01T14:10:26.161554Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:26.161570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:26.161577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.161581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.161583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.161600Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:26.161611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:26.161619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:26.161684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.161691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.161694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.161698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:26.161701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:26.161770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:26.161777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.161789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.161804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.161826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:26.161847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1091
2025-10-01T14:10:26.161850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761342:2446], now have 1 active actors on pipe
2025-10-01T14:10:26.161866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255477312884002:8154]
2025-10-01T14:10:26.161869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255477312884002:8154]
2025-10-01T14:10:26.161871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255477312884002:8154]
2025-10-01T14:10:26.161883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:26.161899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:26.161907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:26.161910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:26.161912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:26.161914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:26.161918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:26.161950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255477312884002:8154]
2025-10-01T14:10:26.161958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:26.161976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:26.162710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255479689761478:9389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:26.168327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255479689761478:9389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:26.168348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255479689761478:9389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:26.168351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255479689761478:9389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:26.168361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:26.168622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761516:9389], now have 1 active actors on pipe
2025-10-01T14:10:26.168645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1091
2025-10-01T14:10:26.168731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.168746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.168781Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:26.168797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.168808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.168815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:26.168829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.168851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:26.168890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.169056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.169071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.169095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.169184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1092 partition: 0 MaxSeqNo: 45 sessionId: src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0
2025-10-01T14:10:26.169599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4a7bc63-e8581d79-c323bba7-45efba1f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:26.172252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0] Write session: try to update token
2025-10-01T14:10:26.172268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:26.184093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:26.184119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:26.184122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:26.184125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:26.184138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255477312884002:8154]
2025-10-01T14:10:26.184143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255477312884002:8154]
2025-10-01T14:10:26.184147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255477312884002:8154]
2025-10-01T14:10:26.184198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:26.184200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:26.184208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.184211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:26.184214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:26.184218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:26.184412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:26.194494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1092 sessionId: src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:26.197462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:26.241065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255479689761519:8859]
2025-10-01T14:10:26.241297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1091, pipe: [1:7556255479689761519:8859]
2025-10-01T14:10:26.323864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:26.324265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.324277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.324296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761519:8859], now have 1 active actors on pipe
2025-10-01T14:10:26.324481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:26.324494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:26.324496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255479689761519:8859]
2025-10-01T14:10:26.324529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:26.324546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1092 reason: error at write: Disconnected sessionId: src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0
2025-10-01T14:10:26.324726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1092 sessionId: src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0 is DEAD
2025-10-01T14:10:26.324860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:26.324867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0] Write session will restart in 0.005133s
2025-10-01T14:10:26.324885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0] Write session: Do CDS request
2025-10-01T14:10:26.324893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:26.325086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:26.330781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.330818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:26.330832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1093
2025-10-01T14:10:26.330969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.331001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:26.331009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:26.331017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:26.331355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1093 sessionId:  describe result for acl check
2025-10-01T14:10:26.331381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:26.331387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:26.331388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:26.331393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255479689761584:9394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:26.331857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255479689761584:9394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:26.333369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255479689761584:9394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:26.337012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:26.337201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255479689761584:9394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:26.337222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255479689761584:9394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:26.337224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255479689761584:9394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:26.337230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:26.337313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:26.337452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:26.337462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:26.337469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:26.337503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:26.337715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255477312884180:8156]
2025-10-01T14:10:26.338087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:26.338261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:26.338292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:26.338555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:26.338613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.338618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.338619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.338620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.338621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.338623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.338624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.338625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.338626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.338627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.338628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.338629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.338630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.338631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.338636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.338644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.338648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.338651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.338658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.338661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.338668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.338672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.338675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.338678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.338681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.338688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.338692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.338699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.338705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.338716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.338725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.338730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.338737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.338745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.338752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.338756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.338763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.338771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.338774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.338782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.338790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.338798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.338805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.338813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.338820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.338825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.338833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.338842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.338850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.338858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.338865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.338870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.338878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.338887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.338895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.338903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.338940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:26.342395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:26.342933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:26.342950Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:26.342952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:26.342955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:26.342962Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1092 [2:7556255477312884180:8156]
2025-10-01T14:10:26.342978Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:26.342995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:26.343000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.343002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.343003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.343015Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:26.343022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:26.343029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:26.343071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.343076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.343077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.343080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:26.343081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:26.343132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:26.343139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.343146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.343151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.343160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:26.343173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761526:2446], now have 1 active actors on pipe
2025-10-01T14:10:26.343179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761695:9394], now have 1 active actors on pipe
2025-10-01T14:10:26.343184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255477312884174:8156]
2025-10-01T14:10:26.343185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255477312884174:8156]
2025-10-01T14:10:26.343187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255477312884174:8156]
2025-10-01T14:10:26.343252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1092
2025-10-01T14:10:26.343265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1092
2025-10-01T14:10:26.343200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:26.343213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:26.343221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:26.343223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:26.343234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:26.343238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:26.343241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:26.343243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255477312884174:8156]
2025-10-01T14:10:26.343248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:26.343249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:26.343290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.343293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.343311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:26.343316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.343318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.343320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:26.343325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.343331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:26.343340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.343452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.343460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.343474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.343541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1093 partition: 0 MaxSeqNo: 45 sessionId: src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0
2025-10-01T14:10:26.343871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5036a148-b2abe362-f17fa02f-a3cbe418_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:26.346134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0] Write session: try to update token
2025-10-01T14:10:26.346148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:26.354195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:26.354207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:26.354216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255477312884174:8156]
2025-10-01T14:10:26.354254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:26.354268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:26.354850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:26.355244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:26.355375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:26.355503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:26.355674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:26.355709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:26.359391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1093 sessionId: src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:26.361852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:26.362026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.362041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.362071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:26.362135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:26.372876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:26.372893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:26.372894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:26.372895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:26.372903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255477312884174:8156]
2025-10-01T14:10:26.372906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255477312884174:8156]
2025-10-01T14:10:26.372909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255477312884174:8156]
2025-10-01T14:10:26.372945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:26.372950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.372949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:26.372951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:26.372954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:26.372958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:26.373065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:26.424866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255479689761711:8859]
2025-10-01T14:10:26.425096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1092, pipe: [1:7556255479689761711:8859]
2025-10-01T14:10:26.508799Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:26.516270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.516292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.516426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.516482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.516536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.516589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.516830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.516838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.516896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.516946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.517001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.517071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.517109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.517114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.517166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.517213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.517263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.517311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.517433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.517440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.517491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.517544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.517598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.517649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.517684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.517689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.517740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.517788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.517838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.517886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.517924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.517929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.517983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.518031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.518083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.518134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.518171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.518176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.518226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.518273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.518325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.518392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.518522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.518527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.518581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.518634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.518687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.518739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.518780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.518785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.518842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.518893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.518945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.518998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.519051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.519055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.519111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:26.519162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:26.519216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:26.519268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:26.519309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:26.519313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:26.519373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761711:8859], now have 1 active actors on pipe
2025-10-01T14:10:26.519608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:26.519624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255479689761711:8859]
2025-10-01T14:10:26.519650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:26.519655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:26.519676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1093 reason: error at write: Disconnected sessionId: src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0
2025-10-01T14:10:26.519864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1093 sessionId: src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0 is DEAD
2025-10-01T14:10:26.519978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:26.519985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0] Write session will restart in 0.005470s
2025-10-01T14:10:26.519969Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:26.520004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0] Write session: Do CDS request
2025-10-01T14:10:26.520019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:26.526755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.526919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:26.526934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1094
2025-10-01T14:10:26.527058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.527083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:26.527090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:26.527093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:26.527390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1094 sessionId:  describe result for acl check
2025-10-01T14:10:26.527414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:26.527418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:26.527419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:26.527423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255479689761785:9398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:26.527823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255479689761785:9398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:26.529963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255479689761785:9398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:26.531312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:26.534059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:26.534198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:26.534207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:26.534214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:26.534244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:26.534275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255477312884353:8159]
2025-10-01T14:10:26.534310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255479689761785:9398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:26.534327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255479689761785:9398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:26.534330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255479689761785:9398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:26.534338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:26.534729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:26.534972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:26.535028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:26.535260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:26.535298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.535303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.535303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.535304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.535304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.535305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.535306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.535306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.535307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.535307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.535308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.535309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.535309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.535310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.535313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.535319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.535321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.535324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.535326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.535328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.535330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.535332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.535335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.535337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.535339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.535341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.535343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.535345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.535350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.535355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.535358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.535361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.535363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.535366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.535369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.535371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.535374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.535377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.535379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.535381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.535384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.535388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.535392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.535397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.535401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.535407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.535410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.535415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.535419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.535422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.535424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.535426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.535428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.535431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.535433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.535436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.535455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:26.538943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:26.539881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:26.539895Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:26.539897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:26.539901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:26.539907Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1093 [2:7556255477312884353:8159]
2025-10-01T14:10:26.539922Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:26.539939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:26.539942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.539944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.539946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.539958Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:26.539962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:26.539967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:26.540010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.540017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.540018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.540020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:26.540022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:26.540069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:26.540076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.540088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.540098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.540118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:26.540133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255477312884347:8159]
2025-10-01T14:10:26.540138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255477312884347:8159]
2025-10-01T14:10:26.540139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255477312884347:8159]
2025-10-01T14:10:26.540146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:26.540154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:26.540157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761882:9398], now have 1 active actors on pipe
2025-10-01T14:10:26.540159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761713:2446], now have 1 active actors on pipe
2025-10-01T14:10:26.540165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:26.540165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:26.540167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:26.540174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:26.540177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:26.540203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255477312884347:8159]
2025-10-01T14:10:26.540215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:26.540232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:26.540255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1093
2025-10-01T14:10:26.540259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1093
2025-10-01T14:10:26.540331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.540536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.540560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d207781d-75f7780a-e587f2a7-57123a3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:26.540569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.540572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.540573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:26.540580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.540587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:26.540605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.540795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.540801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.540812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.540895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1094 partition: 0 MaxSeqNo: 45 sessionId: src_id|d207781d-75f7780a-e587f2a7-57123a3f_0
2025-10-01T14:10:26.541299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|944eb46d-bfe2ba73-6cfe1602-def4fef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d207781d-75f7780a-e587f2a7-57123a3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:26.543728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d207781d-75f7780a-e587f2a7-57123a3f_0] Write session: try to update token
2025-10-01T14:10:26.543749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d207781d-75f7780a-e587f2a7-57123a3f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:26.557560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1094 sessionId: src_id|d207781d-75f7780a-e587f2a7-57123a3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:26.559959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:26.561190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.561207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.561225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:26.561228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:26.561229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:26.561231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:26.561238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255477312884347:8159]
2025-10-01T14:10:26.561241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255477312884347:8159]
2025-10-01T14:10:26.561243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255477312884347:8159]
2025-10-01T14:10:26.561272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:26.561277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:26.561280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:26.561283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:26.561288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.561294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:26.561418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:26.619929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255479689761894:8859]
2025-10-01T14:10:26.620131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1093, pipe: [1:7556255479689761894:8859]
2025-10-01T14:10:26.696904Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:26.697115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:26.697162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761894:8859], now have 1 active actors on pipe
2025-10-01T14:10:26.697222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:26.697337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255479689761894:8859]
2025-10-01T14:10:26.697359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:26.706620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:26.706633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:26.706654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1094 reason: error at write: Disconnected sessionId: src_id|d207781d-75f7780a-e587f2a7-57123a3f_0
2025-10-01T14:10:26.706786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1094 sessionId: src_id|d207781d-75f7780a-e587f2a7-57123a3f_0 is DEAD
2025-10-01T14:10:26.706936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d207781d-75f7780a-e587f2a7-57123a3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:26.706944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d207781d-75f7780a-e587f2a7-57123a3f_0] Write session will restart in 0.009855s
2025-10-01T14:10:26.706968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d207781d-75f7780a-e587f2a7-57123a3f_0] Write session: Do CDS request
2025-10-01T14:10:26.706994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d207781d-75f7780a-e587f2a7-57123a3f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:26.710470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:26.713161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:26.713310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:26.713318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:26.713329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:26.713370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:26.713406Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255477312884545:8164]
2025-10-01T14:10:26.713856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:26.714074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:26.714117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:26.714410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:26.714473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.714479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.714480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.714481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.714482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.714482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.714483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.714484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.714485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.714486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.714488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.714488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.714490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.714491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.714495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.714504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.714508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.714511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.714514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.714518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.714522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.714526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.714529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.714533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.714536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.714539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.714542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.714544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.714549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.714553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.714558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.714561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.714563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.714566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.714568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.714571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.714574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.714576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.714578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.714581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.714583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.714586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.714588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.714591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.714594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.714597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.714599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.714602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.714604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.714608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.714610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.714613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.714615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.714618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.714620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.714622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.714643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:26.717772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d207781d-75f7780a-e587f2a7-57123a3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.717903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:26.717916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1095
2025-10-01T14:10:26.718003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.718025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:26.718032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:26.718035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:26.718057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:26.718329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1095 sessionId:  describe result for acl check
2025-10-01T14:10:26.718364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:26.718383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:26.718384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:26.718390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255479689762060:9409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:26.718878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255479689762060:9409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:26.719093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:26.719104Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:26.719105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:26.719107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:26.719112Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1094 [2:7556255477312884545:8164]
2025-10-01T14:10:26.719121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:26.719132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:26.719134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.719137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.719138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.719148Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:26.719151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:26.719155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:26.719190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.719196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.719197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.719200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:26.719202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:26.719246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:26.719251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.719257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.719263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.719275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:26.719291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255477312884540:8164]
2025-10-01T14:10:26.719296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255477312884540:8164]
2025-10-01T14:10:26.719298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255477312884540:8164]
2025-10-01T14:10:26.719305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:26.719314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:26.719320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:26.719329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1094
2025-10-01T14:10:26.719333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:26.719333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:26.719335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:26.719338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:26.719345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689761920:2446], now have 1 active actors on pipe
2025-10-01T14:10:26.719363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255477312884540:8164]
2025-10-01T14:10:26.719370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:26.719372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:26.720605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255479689762060:9409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:26.725330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255479689762060:9409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:26.725350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255479689762060:9409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:26.725355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255479689762060:9409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:26.725361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:26.725569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689762097:9409], now have 1 active actors on pipe
2025-10-01T14:10:26.725596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1094
2025-10-01T14:10:26.725649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.725660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.725681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:26.725694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.725698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.725700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:26.725709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.725722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:26.725738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.725863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.725872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.725884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.725942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1095 partition: 0 MaxSeqNo: 45 sessionId: src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0
2025-10-01T14:10:26.726253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d207781d-75f7780a-e587f2a7-57123a3f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:26.728456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0] Write session: try to update token
2025-10-01T14:10:26.728470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:26.739717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:26.739732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:26.739734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:26.739735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:26.739742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255477312884540:8164]
2025-10-01T14:10:26.739747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255477312884540:8164]
2025-10-01T14:10:26.739751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255477312884540:8164]
2025-10-01T14:10:26.739787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:26.739792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.739794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:26.739825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:26.739835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:26.739837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:26.740003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:26.740888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1095 sessionId: src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:26.743132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:26.797578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255479689762113:8859]
2025-10-01T14:10:26.797759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1094, pipe: [1:7556255479689762113:8859]
2025-10-01T14:10:26.875190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:26.875403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.875414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.875449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689762113:8859], now have 1 active actors on pipe
2025-10-01T14:10:26.875661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:26.875684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:26.875688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255479689762113:8859]
2025-10-01T14:10:26.875713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:26.875715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:26.875770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1095 reason: error at write: Disconnected sessionId: src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0
2025-10-01T14:10:26.876013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1095 sessionId: src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0 is DEAD
2025-10-01T14:10:26.876173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:26.876182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0] Write session will restart in 0.006951s
2025-10-01T14:10:26.876202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0] Write session: Do CDS request
2025-10-01T14:10:26.876207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:26.883904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.884011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:26.884027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1096
2025-10-01T14:10:26.884115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:26.884158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:26.884168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:26.884171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:26.884629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1096 sessionId:  describe result for acl check
2025-10-01T14:10:26.884660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:26.884665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:26.884667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:26.884673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255479689762207:9415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:26.885183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255479689762207:9415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:26.887012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255479689762207:9415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:26.888120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:26.891115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:26.891429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255479689762207:9415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:26.891448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255479689762207:9415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:26.891451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255479689762207:9415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:26.891459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:26.891536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:26.891545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:26.891555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:26.891601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:26.891642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255477312884750:8177]
2025-10-01T14:10:26.892155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:26.892417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:26.892456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:26.892697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:26.892766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.892771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.892772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.892772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.892773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.892774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.892775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.892776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.892776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.892777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.892778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.892778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.892779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.892781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.892784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.892790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.892793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.892795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.892797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.892799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.892801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.892803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.892805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.892809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.892813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.892816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.892819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.892822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.892830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.892837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:26.892842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.892845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:26.892848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.892851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:26.892853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.892855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:26.892859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.892861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:26.892863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.892866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:26.892868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.892870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:26.892873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.892875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:26.892879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.892881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:26.892883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.892886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.892888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.892891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.892893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.892895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.892898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.892900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:26.892902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.892905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:26.892925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:26.896644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:26.897235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:26.897260Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:26.897263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:26.897266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:26.897273Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1095 [2:7556255477312884750:8177]
2025-10-01T14:10:26.897289Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:26.897306Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:26.897314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.897318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.897320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.897337Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:26.897347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:26.897353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:26.897413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.897421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.897422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.897425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:26.897428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:26.897494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:26.897504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.897516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:26.897526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:26.897540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:26.897560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689762118:2446], now have 1 active actors on pipe
2025-10-01T14:10:26.897569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689762286:9415], now have 1 active actors on pipe
2025-10-01T14:10:26.897576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255477312884745:8177]
2025-10-01T14:10:26.897578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255477312884745:8177]
2025-10-01T14:10:26.897580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255477312884745:8177]
2025-10-01T14:10:26.897597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:26.897615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:26.897623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:26.897627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:26.897630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:26.897632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:26.897635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:26.897665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255477312884745:8177]
2025-10-01T14:10:26.897672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:26.897652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1095
2025-10-01T14:10:26.897654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1095
2025-10-01T14:10:26.897689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:26.897705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.897715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.897746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:26.897757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:26.897761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:26.897764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:26.897773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:26.897789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:26.897806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.897957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.897966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.897981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:26.898084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1096 partition: 0 MaxSeqNo: 45 sessionId: src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0
2025-10-01T14:10:26.898493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cc4698f-e6fe606d-40cda32-5fa7770d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:26.901045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0] Write session: try to update token
2025-10-01T14:10:26.901063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:26.915320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1096 sessionId: src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:26.917784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:26.918701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:26.918722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:26.918741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:26.918745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:26.918748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:26.918750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:26.918758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255477312884745:8177]
2025-10-01T14:10:26.918762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255477312884745:8177]
2025-10-01T14:10:26.918766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255477312884745:8177]
2025-10-01T14:10:26.918802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:26.918813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:26.918816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:26.918826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:26.918833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:26.918835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:26.918985Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:26.975781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255479689762298:8859]
2025-10-01T14:10:26.975986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1095, pipe: [1:7556255479689762298:8859]
2025-10-01T14:10:27.069417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:27.069879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:27.069949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255479689762298:8859], now have 1 active actors on pipe
2025-10-01T14:10:27.070085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:27.070264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255479689762298:8859]
2025-10-01T14:10:27.070297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:27.082643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:27.082659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:27.082682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1096 reason: error at write: Disconnected sessionId: src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0
2025-10-01T14:10:27.082844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1096 sessionId: src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0 is DEAD
2025-10-01T14:10:27.082987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:27.083001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0] Write session will restart in 0.009365s
2025-10-01T14:10:27.083028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0] Write session: Do CDS request
2025-10-01T14:10:27.083036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:27.094027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.094529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:27.094547Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1097
2025-10-01T14:10:27.094706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.094730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:27.094734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:27.094737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:27.095161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1097 sessionId:  describe result for acl check
2025-10-01T14:10:27.095202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:27.095204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:27.095207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:27.095213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255483984729739:9423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:27.095796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255483984729739:9423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:27.096603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:27.099779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255483984729739:9423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:27.100341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:27.100549Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:27.100564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:27.100577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:27.100633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:27.100689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255481607852221:8179]
2025-10-01T14:10:27.101318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:27.101642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:27.101687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:27.101920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:27.101970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.101975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.101975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.101976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.101978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.101978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.101979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.101980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.101981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.101982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.101986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.101987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.101987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.101988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.101992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.101998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.102000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.102002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.102005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.102007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.102009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.102011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.102013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.102015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.102018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.102020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.102022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.102024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.102029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.102034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.102039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.102042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.102044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.102047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.102050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.102052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.102057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.102060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.102062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.102065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.102067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.102070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.102072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.102075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.102080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.102082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.102084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.102087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.102089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.102092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.102094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.102096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.102098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.102101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.102103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.102105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.102128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:27.102470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255483984729739:9423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:27.102487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255483984729739:9423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:27.102491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255483984729739:9423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:27.102499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:27.106531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:27.107341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:27.107355Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:27.107359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:27.107363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:27.107370Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1096 [2:7556255481607852221:8179]
2025-10-01T14:10:27.107389Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:27.107407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:27.107416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.107420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.107423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.107441Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:27.107451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:27.107462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:27.107527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.107534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.107536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.107539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:27.107542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:27.107622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:27.107630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.107643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.107659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.107680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:27.107704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984729602:2446], now have 1 active actors on pipe
2025-10-01T14:10:27.107713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984729779:9423], now have 1 active actors on pipe
2025-10-01T14:10:27.107720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255481607852216:8179]
2025-10-01T14:10:27.107727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255481607852216:8179]
2025-10-01T14:10:27.107729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255481607852216:8179]
2025-10-01T14:10:27.107747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:27.107764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:27.107782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:27.107784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:27.107822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255481607852216:8179]
2025-10-01T14:10:27.107829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:27.107831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1096
2025-10-01T14:10:27.107864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1096
2025-10-01T14:10:27.107986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:27.107997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:27.107999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:27.108004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:27.108091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.108101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.108130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:27.108143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.108147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.108148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:27.108158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.108171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:27.108183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.108461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.108470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.108480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.108684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1097 partition: 0 MaxSeqNo: 45 sessionId: src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0
2025-10-01T14:10:27.109060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f386578-bc9ec216-c3655e84-848fd6b8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:27.111522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0] Write session: try to update token
2025-10-01T14:10:27.111540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:27.126544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1097 sessionId: src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:27.128984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:27.131447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.131479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.131504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:27.131507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:27.131510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:27.131512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:27.131523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255481607852216:8179]
2025-10-01T14:10:27.131529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255481607852216:8179]
2025-10-01T14:10:27.131534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255481607852216:8179]
2025-10-01T14:10:27.131597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:27.131600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:27.131607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.131611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:27.131611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:27.131616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:27.131783Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:27.169824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255483984729786:8859]
2025-10-01T14:10:27.170042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1096, pipe: [1:7556255483984729786:8859]
2025-10-01T14:10:27.271157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:27.271436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:27.271498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984729786:8859], now have 1 active actors on pipe
2025-10-01T14:10:27.271585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:27.271716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255483984729786:8859]
2025-10-01T14:10:27.271747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:27.282440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:27.282459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:27.282482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1097 reason: error at write: Disconnected sessionId: src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0
2025-10-01T14:10:27.282675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1097 sessionId: src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0 is DEAD
2025-10-01T14:10:27.282860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:27.282871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0] Write session will restart in 0.009014s
2025-10-01T14:10:27.282909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0] Write session: Do CDS request
2025-10-01T14:10:27.282918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:27.292010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:27.292887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.292922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:27.292938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1098
2025-10-01T14:10:27.293090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.293128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:27.293135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:27.293138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:27.293480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1098 sessionId:  describe result for acl check
2025-10-01T14:10:27.293505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:27.293510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:27.293511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:27.293515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255483984729928:9427] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:27.293937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255483984729928:9427] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:27.298557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:27.298846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:27.298852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:27.298877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:27.298943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:27.299011Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255481607852398:8181]
2025-10-01T14:10:27.299628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:27.299991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:27.300038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:27.300413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:27.300507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.300516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.300518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.300519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.300520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.300522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.300523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.300524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.300525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.300527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.300528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.300530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.300531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.300532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.300538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.300549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.300553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.300557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.300561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.300565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.300569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.300573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.300577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.300583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.300587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.300591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.300595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.300599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.300606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.300614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.300621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.300627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.300631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.300637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.300642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.300647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.300652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.300658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.300662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.300667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.300672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.300678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.300682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.300687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.300692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.300698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.300703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.300709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.300714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.300730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.300735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.300740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.300745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.300751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.300754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.300759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.300799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:27.300794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255483984729928:9427] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:27.304951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255483984729928:9427] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:27.304979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255483984729928:9427] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:27.304983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255483984729928:9427] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:27.304992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:27.305447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:27.306774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:27.306790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:27.306793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:27.306796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:27.306803Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1097 [2:7556255481607852398:8181]
2025-10-01T14:10:27.306819Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:27.306837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:27.306840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.306843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.306847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.306865Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:27.306887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:27.306899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:27.306965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.306975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.306977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.306981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:27.306984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:27.307055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:27.307068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.307082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.307096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.307110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:27.307135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984729970:9427], now have 1 active actors on pipe
2025-10-01T14:10:27.307144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984729789:2446], now have 1 active actors on pipe
2025-10-01T14:10:27.307153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255481607852393:8181]
2025-10-01T14:10:27.307156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255481607852393:8181]
2025-10-01T14:10:27.307158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255481607852393:8181]
2025-10-01T14:10:27.307174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:27.307192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:27.307200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:27.307204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:27.307207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:27.307212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:27.307215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:27.307190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1097
2025-10-01T14:10:27.307231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1097
2025-10-01T14:10:27.307258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255481607852393:8181]
2025-10-01T14:10:27.307266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:27.307270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:27.307288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.307301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.307358Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df3290c7-e738f51-e2734926-f3cccc44_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:27.307372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.307377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.307379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:27.307389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.307403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:27.307429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.307703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.307721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.307759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.307878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1098 partition: 0 MaxSeqNo: 45 sessionId: src_id|df3290c7-e738f51-e2734926-f3cccc44_0
2025-10-01T14:10:27.309097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b3d78a8-67710df9-a45b127e-e8247d12_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|df3290c7-e738f51-e2734926-f3cccc44_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:27.312266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3290c7-e738f51-e2734926-f3cccc44_0] Write session: try to update token
2025-10-01T14:10:27.312290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3290c7-e738f51-e2734926-f3cccc44_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:27.331460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:27.331478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:27.331481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:27.331483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:27.331495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255481607852393:8181]
2025-10-01T14:10:27.331500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255481607852393:8181]
2025-10-01T14:10:27.331504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255481607852393:8181]
2025-10-01T14:10:27.331558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:27.331569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.331572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:27.331709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:27.334425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:27.334432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:27.334435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:27.342287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1098 sessionId: src_id|df3290c7-e738f51-e2734926-f3cccc44_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:27.345056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:27.372062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255483984729981:8859]
2025-10-01T14:10:27.372379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1097, pipe: [1:7556255483984729981:8859]
2025-10-01T14:10:27.471322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:27.471655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.471668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.471702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984729981:8859], now have 1 active actors on pipe
2025-10-01T14:10:27.471932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255483984729981:8859]
2025-10-01T14:10:27.471936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:27.471952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:27.471962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:27.471964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:27.472011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1098 reason: error at write: Disconnected sessionId: src_id|df3290c7-e738f51-e2734926-f3cccc44_0
2025-10-01T14:10:27.472184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1098 sessionId: src_id|df3290c7-e738f51-e2734926-f3cccc44_0 is DEAD
2025-10-01T14:10:27.472357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3290c7-e738f51-e2734926-f3cccc44_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:27.472365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3290c7-e738f51-e2734926-f3cccc44_0] Write session will restart in 0.007056s
2025-10-01T14:10:27.472386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3290c7-e738f51-e2734926-f3cccc44_0] Write session: Do CDS request
2025-10-01T14:10:27.472391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3290c7-e738f51-e2734926-f3cccc44_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:27.480856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df3290c7-e738f51-e2734926-f3cccc44_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.480933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:27.480949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1099
2025-10-01T14:10:27.481039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.481077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:27.481087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:27.481091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:27.481516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1099 sessionId:  describe result for acl check
2025-10-01T14:10:27.481549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:27.481554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:27.481555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:27.481558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255483984730120:9432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:27.481925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255483984730120:9432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:27.483639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255483984730120:9432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:27.486063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:27.486214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255483984730120:9432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:27.486224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255483984730120:9432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:27.486226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255483984730120:9432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:27.486233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:27.486423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:27.486541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:27.486548Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:27.486555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:27.486741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:27.486771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255481607852579:8184]
2025-10-01T14:10:27.487134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:27.487380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:27.487409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:27.487599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:27.487632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.487636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.487637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.487638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.487638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.487639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.487640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.487641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.487641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.487642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.487642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.487643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.487644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.487644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.487647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.487653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.487655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.487657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.487659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.487661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.487663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.487665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.487667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.487669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.487671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.487673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.487675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.487677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.487681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.487685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.487689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.487692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.487694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.487697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.487699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.487703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.487705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.487708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.487710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.487713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.487715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.487718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.487720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.487723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.487725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.487728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.487730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.487732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.487734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.487737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.487739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.487741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.487744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.487746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.487749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.487754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.487773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:27.491557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:27.492229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:27.492242Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:27.492244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:27.492247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:27.492253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1098 [2:7556255481607852579:8184]
2025-10-01T14:10:27.492267Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:27.492284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:27.492287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.492290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.492292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.492306Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:27.492312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:27.492323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:27.492377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.492384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.492386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.492389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:27.492394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:27.492463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:27.492470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.492480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.492489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.492506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:27.492529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984729984:2446], now have 1 active actors on pipe
2025-10-01T14:10:27.492538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984730158:9432], now have 1 active actors on pipe
2025-10-01T14:10:27.492546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255481607852573:8184]
2025-10-01T14:10:27.492551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255481607852573:8184]
2025-10-01T14:10:27.492553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255481607852573:8184]
2025-10-01T14:10:27.492566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:27.492579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:27.492583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:27.492565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1098
2025-10-01T14:10:27.492586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:27.492572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1098
2025-10-01T14:10:27.492588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:27.492595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:27.492597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:27.492647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.492656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.492669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255481607852573:8184]
2025-10-01T14:10:27.492679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:27.492696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:27.492711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49fa046d-d63a1a86-16c27da1-19c80192_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:27.492732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.492739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.492741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:27.492750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.492761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:27.492789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.492890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.492897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.492911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.492985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1099 partition: 0 MaxSeqNo: 45 sessionId: src_id|49fa046d-d63a1a86-16c27da1-19c80192_0
2025-10-01T14:10:27.493285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df3290c7-e738f51-e2734926-f3cccc44_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|49fa046d-d63a1a86-16c27da1-19c80192_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:27.495554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49fa046d-d63a1a86-16c27da1-19c80192_0] Write session: try to update token
2025-10-01T14:10:27.495568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49fa046d-d63a1a86-16c27da1-19c80192_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:27.508165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1099 sessionId: src_id|49fa046d-d63a1a86-16c27da1-19c80192_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:27.510436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:27.510655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.510672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.510702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:27.510795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:27.513606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:27.513621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:27.513623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:27.513627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:27.513635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255481607852573:8184]
2025-10-01T14:10:27.513640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255481607852573:8184]
2025-10-01T14:10:27.513642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255481607852573:8184]
2025-10-01T14:10:27.513686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:27.513695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.513697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:27.513714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:27.513725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:27.513728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:27.513838Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:27.572259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255483984730169:8859]
2025-10-01T14:10:27.572514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1098, pipe: [1:7556255483984730169:8859]
2025-10-01T14:10:27.650542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:27.657125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.657144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.657285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.657347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.657405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.657464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.657505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.657512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.657575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.657629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.657684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.657747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.657786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.657792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.657847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.657902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.657957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.658008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.658045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.658050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.658102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.658154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.658205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.658256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.658312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.658318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.658388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.658442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.658495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.658546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.658582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.658586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.658641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.658691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.658747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.658806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.658845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.658850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.658902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.658953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.659008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.659063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.659101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.659106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.659159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.659211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.659264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.659325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.659371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.659380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.659438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.659498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.659554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.659607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.659645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.659652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.659707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.659761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.659816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.659925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.659963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.659968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.660006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984730169:8859], now have 1 active actors on pipe
2025-10-01T14:10:27.660164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:27.660183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255483984730169:8859]
2025-10-01T14:10:27.660203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:27.660205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:27.660224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1099 reason: error at write: Disconnected sessionId: src_id|49fa046d-d63a1a86-16c27da1-19c80192_0
2025-10-01T14:10:27.660384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1099 sessionId: src_id|49fa046d-d63a1a86-16c27da1-19c80192_0 is DEAD
2025-10-01T14:10:27.660526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49fa046d-d63a1a86-16c27da1-19c80192_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:27.660534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49fa046d-d63a1a86-16c27da1-19c80192_0] Write session will restart in 0.009037s
2025-10-01T14:10:27.660552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49fa046d-d63a1a86-16c27da1-19c80192_0] Write session: Do CDS request
2025-10-01T14:10:27.660557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49fa046d-d63a1a86-16c27da1-19c80192_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:27.660734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:27.666611Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:10:27.669785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:27.670687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49fa046d-d63a1a86-16c27da1-19c80192_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.670823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:27.670844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1100
2025-10-01T14:10:27.670970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.670997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:27.671001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:27.671005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:27.671372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1100 sessionId:  describe result for acl check
2025-10-01T14:10:27.671406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:27.671414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:27.671415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:27.671419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255483984730312:9436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:27.671849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255483984730312:9436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:27.672075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:27.672202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:27.672210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:27.672217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:27.672251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:27.672285Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255481607852768:8187]
2025-10-01T14:10:27.672680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:27.672880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:27.672907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:27.673090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:27.673124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.673129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.673130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.673131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.673132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.673133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.673135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.673136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.673137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.673138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.673139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.673140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.673141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.673142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.673146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.673155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.673158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.673160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.673162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.673164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.673166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.673167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.673169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.673171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.673173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.673175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.673177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.673178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.673182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.673187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.673194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.673198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.673203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.673206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.673208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.673214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.673216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.673219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.673224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.673227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.673230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.673233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.673238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.673241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.673243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.673247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.673249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.673253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.673256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.673259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.673261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.673264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.673269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.673272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.673274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.673277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.673298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:27.674077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255483984730312:9436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:27.676480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255483984730312:9436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:27.676494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255483984730312:9436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:27.676498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255483984730312:9436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:27.676503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:27.676659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:27.677368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:27.677376Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:27.677377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:27.677380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:27.677385Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1099 [2:7556255481607852768:8187]
2025-10-01T14:10:27.677394Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:27.677405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:27.677410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.677412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.677413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.677424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:27.677431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:27.677435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:27.677468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.677472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.677473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.677475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:27.677477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:27.677524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:27.677532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.677539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.677544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.677553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:27.677564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255481607852762:8187]
2025-10-01T14:10:27.677566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255481607852762:8187]
2025-10-01T14:10:27.677568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255481607852762:8187]
2025-10-01T14:10:27.677577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:27.677582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:27.677584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:27.677585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:27.677592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984730172:2446], now have 1 active actors on pipe
2025-10-01T14:10:27.677598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:27.677610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:27.677611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:27.677627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255481607852762:8187]
2025-10-01T14:10:27.677635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:27.677652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:27.677652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984730356:9436], now have 1 active actors on pipe
2025-10-01T14:10:27.677659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1099
2025-10-01T14:10:27.677696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1099
2025-10-01T14:10:27.677769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.677778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.677793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|feeb60bf-973a702b-df31eafe-22b717d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:27.677801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.677804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.677805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:27.677811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.677817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:27.677831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.677979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.677986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.677998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.678064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1100 partition: 0 MaxSeqNo: 45 sessionId: src_id|feeb60bf-973a702b-df31eafe-22b717d_0
2025-10-01T14:10:27.678403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49fa046d-d63a1a86-16c27da1-19c80192_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|feeb60bf-973a702b-df31eafe-22b717d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:27.680636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feeb60bf-973a702b-df31eafe-22b717d_0] Write session: try to update token
2025-10-01T14:10:27.680647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feeb60bf-973a702b-df31eafe-22b717d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:27.688623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:27.688641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:27.688653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255481607852762:8187]
2025-10-01T14:10:27.688689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:27.688698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:27.688885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:27.689031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:27.689173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:27.689316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:27.689514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:27.689554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:27.693218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1100 sessionId: src_id|feeb60bf-973a702b-df31eafe-22b717d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:27.695475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:27.695664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.695681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.695719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:27.695788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:27.708980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:27.708997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:27.708999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:27.709001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:27.709009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255481607852762:8187]
2025-10-01T14:10:27.709012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255481607852762:8187]
2025-10-01T14:10:27.709015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255481607852762:8187]
2025-10-01T14:10:27.709058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:27.709058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:27.709065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:27.709069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:27.709069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.709071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:27.709194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:27.760146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255483984730383:8859]
2025-10-01T14:10:27.760414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1099, pipe: [1:7556255483984730383:8859]
2025-10-01T14:10:27.842100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:27.848943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.848964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.849106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.849163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.849219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.849277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.849319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.849328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.849395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.849449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.849507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.849566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.849607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.849611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.849667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.849720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.849778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.849835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.849879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.849884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.849940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.849994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.850047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.850101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.850138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.850143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.850199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.850254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.850306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.850361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.850415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.850420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.850478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.850532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.850586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.850644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.850683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.850688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.850747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.850804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.850867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.850924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.850962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.850966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.851025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.851079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.851134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.851190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.851231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.851235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.851292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.851343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.851397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.851454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.851499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.851503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.851557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:27.851608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:27.851664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:27.851718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:27.851756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:27.851760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:27.851799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984730383:8859], now have 1 active actors on pipe
2025-10-01T14:10:27.852052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:27.852059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255483984730383:8859]
2025-10-01T14:10:27.852065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:27.852083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:27.852086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1100 reason: error at write: Disconnected sessionId: src_id|feeb60bf-973a702b-df31eafe-22b717d_0
2025-10-01T14:10:27.852259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1100 sessionId: src_id|feeb60bf-973a702b-df31eafe-22b717d_0 is DEAD
2025-10-01T14:10:27.852393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeb60bf-973a702b-df31eafe-22b717d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:27.852400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeb60bf-973a702b-df31eafe-22b717d_0] Write session will restart in 0.009675s
2025-10-01T14:10:27.852418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeb60bf-973a702b-df31eafe-22b717d_0] Write session: Do CDS request
2025-10-01T14:10:27.852423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeb60bf-973a702b-df31eafe-22b717d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:27.852792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:27.862010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:27.862761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feeb60bf-973a702b-df31eafe-22b717d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.862858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:27.862874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1101
2025-10-01T14:10:27.862967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:27.862989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:27.862993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:27.862995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:27.863333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1101 sessionId:  describe result for acl check
2025-10-01T14:10:27.863366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:27.863372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:27.863373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:27.863379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255483984730538:9449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:27.863831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255483984730538:9449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:27.865026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:27.865274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:27.865284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:27.865295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:27.865348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:27.865380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255481607852967:8193]
2025-10-01T14:10:27.865880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:27.866007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255483984730538:9449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:27.866135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:27.866172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:27.866452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:27.866504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.866509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.866510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.866511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.866512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.866513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.866514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.866514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.866515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.866516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.866517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.866518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.866519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.866520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.866524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.866532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.866535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.866538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.866541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.866544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.866547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.866550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.866555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.866558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.866561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.866564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.866566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.866570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.866575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.866582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:27.866588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.866593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:27.866596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.866600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:27.866603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.866607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:27.866611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.866614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:27.866619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.866623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:27.866627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.866631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:27.866638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.866642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:27.866646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.866655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:27.866658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.866662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.866669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.866673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.866676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.866680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.866689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.866694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:27.866701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.866705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:27.866735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:27.869967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255483984730538:9449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:27.869979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255483984730538:9449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:27.869982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255483984730538:9449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:27.869989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:27.870151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:27.870860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:27.870873Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:27.870875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:27.870878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:27.870884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1100 [2:7556255481607852967:8193]
2025-10-01T14:10:27.870894Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:27.870907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:27.870914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.870917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.870919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.870933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:27.870941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:27.870946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:27.870990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.870996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.870997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.871000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:27.871002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:27.871056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:27.871062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.871071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:27.871083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:27.871098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:27.871117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984730577:9449], now have 1 active actors on pipe
2025-10-01T14:10:27.871126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255481607852961:8193]
2025-10-01T14:10:27.871129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255481607852961:8193]
2025-10-01T14:10:27.871131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255481607852961:8193]
2025-10-01T14:10:27.871144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:27.871154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984730397:2446], now have 1 active actors on pipe
2025-10-01T14:10:27.871162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:27.871168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:27.871171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:27.871173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:27.871177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:27.871179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:27.871198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255481607852961:8193]
2025-10-01T14:10:27.871207Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:27.871199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1100
2025-10-01T14:10:27.871223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:27.871202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1100
2025-10-01T14:10:27.871249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.871259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.871284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:27.871297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:27.871302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:27.871303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:27.871310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:27.871318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:27.871328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.871478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.871486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.871499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:27.871565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1101 partition: 0 MaxSeqNo: 45 sessionId: src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0
2025-10-01T14:10:27.871866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feeb60bf-973a702b-df31eafe-22b717d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:27.874117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0] Write session: try to update token
2025-10-01T14:10:27.874150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:27.881252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:27.881272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:27.881280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255481607852961:8193]
2025-10-01T14:10:27.881313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:27.881327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:27.881484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:27.881623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:27.881761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:27.881891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:27.882067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:27.882103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:27.887812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1101 sessionId: src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:27.889994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:27.890158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:27.890175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:27.890203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:27.890268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:27.899600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:27.899616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:27.899617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:27.899619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:27.899626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255481607852961:8193]
2025-10-01T14:10:27.899629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255481607852961:8193]
2025-10-01T14:10:27.899631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255481607852961:8193]
2025-10-01T14:10:27.899670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:27.899680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:27.899682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:27.899681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:27.899688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:27.899691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:27.899793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:27.952161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255483984730585:8859]
2025-10-01T14:10:27.952358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1100, pipe: [1:7556255483984730585:8859]
2025-10-01T14:10:28.042823Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:28.051739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.051769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.051932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.051999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.052067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.052134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.052181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.052191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.052257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.052314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.052377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.052462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.052505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.052512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.052576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.052634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.052702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.052773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.052820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.052827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.052894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.052959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.053024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.053086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.053126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.053133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.053194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.053250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.053309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.053369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.053413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.053420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.053476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.053526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.053581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.053636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.053675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.053682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.053734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.053788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.053846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.053899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.053939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.053946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.054000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.054052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.054103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.054161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.054204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.054210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.054270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.054324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.054399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.054456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.054500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.054506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.054566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.054621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.054678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.054765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.054810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.054817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.054875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255483984730585:8859], now have 1 active actors on pipe
2025-10-01T14:10:28.055088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:28.055088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:28.055092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:28.055114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1101 reason: error at write: Disconnected sessionId: src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0
2025-10-01T14:10:28.055139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255483984730585:8859]
2025-10-01T14:10:28.055152Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:10:28.055206Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 11 consumer shared/user session shared/user_1_11_18163181406657330534_v1 is DEAD
2025-10-01T14:10:28.055293Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255410970271678:8856] disconnected; active server actors: 1
2025-10-01T14:10:28.055298Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255410970271678:8856] client user disconnected session shared/user_1_11_18163181406657330534_v1
2025-10-01T14:10:28.055311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1101 sessionId: src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0 is DEAD
2025-10-01T14:10:28.055430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:28.055440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0] Write session will restart in 0.008375s
2025-10-01T14:10:28.055458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0] Write session: Do CDS request
2025-10-01T14:10:28.055462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:28.055473Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:10:28.055499Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:10:28.055502Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:10:28.055507Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.009019s
2025-10-01T14:10:28.056315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:28.064932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.064978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:28.064995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1102
2025-10-01T14:10:28.065123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.065148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:28.065156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:28.065159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:28.065516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1102 sessionId:  describe result for acl check
2025-10-01T14:10:28.065549Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:10:28.065561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:28.065675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:28.065685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:28.065691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255488279698023:9453] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:28.065991Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:10:28.066001Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 12
2025-10-01T14:10:28.066102Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 12 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:10:28.066142Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:10:28.066172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255488279698023:9453] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:28.066210Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 auth for : user
2025-10-01T14:10:28.066300Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 Handle describe topics response
2025-10-01T14:10:28.066324Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 auth is DEAD
2025-10-01T14:10:28.066328Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:10:28.066576Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:10:28.066638Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_12_4423556105642351710_v1
2025-10-01T14:10:28.066645Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255488279698033:9455] connected; active server actors: 1
2025-10-01T14:10:28.066661Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255488279698033:9455] session shared/user_1_12_4423556105642351710_v1
2025-10-01T14:10:28.066670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:10:28.066687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:10:28.066698Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_12_4423556105642351710_v1" (Sender=[1:7556255488279698024:9455], Pipe=[1:7556255488279698033:9455], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:10:28.066708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:10:28.066719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:10:28.066728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_12_4423556105642351710_v1" (Sender=[1:7556255488279698024:9455], Pipe=[1:7556255488279698033:9455], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:10:28.066738Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_12_4423556105642351710_v1" sender [1:7556255488279698024:9455] lock partition 0 for ReadingSession "shared/user_1_12_4423556105642351710_v1" (Sender=[1:7556255488279698024:9455], Pipe=[1:7556255488279698033:9455], Partitions=[], ActiveFamilyCount=1) generation 1 step 12
2025-10-01T14:10:28.066750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:10:28.066755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-01T14:10:28.066923Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 12 Session: "shared/user_1_12_4423556105642351710_v1" ClientId: "user" PipeClient { RawX1: 7556255488279698033 RawX2: 4503603922347247 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:10:28.066948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:10:28.068236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255488279698023:9453] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:28.068380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:28.068692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:28.068889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:28.068897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:28.068907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:28.068946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:28.068979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255485902820462:8204]
2025-10-01T14:10:28.069371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:28.069538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:28.069564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:28.069757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:28.069791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.069795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.069796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.069797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.069797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.069798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.069799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.069799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.069800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.069800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.069801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.069802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.069802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.069803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.069806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.069811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.069813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.069815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.069817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.069819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.069821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.069823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.069826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.069828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.069830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.069832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.069834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.069836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.069841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.069845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.069849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.069852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.069854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.069857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.069860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.069862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.069865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.069868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.069870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.069873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.069875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.069878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.069880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.069883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.069885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.069888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.069890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.069893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.069895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.069899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.069902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.069906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.069910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.069914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.069917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.069922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.069953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:28.070386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255488279698023:9453] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:28.070399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255488279698023:9453] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:28.070404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255488279698023:9453] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:28.070409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:28.073304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:28.073795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:28.073804Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:28.073805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:28.073808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:28.073812Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1101 [2:7556255485902820462:8204]
2025-10-01T14:10:28.073821Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:28.073832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:28.073834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.073836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.073837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.073848Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:28.073851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:28.073855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:28.073890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.073895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.073896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.073898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:28.073899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:28.073943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:28.073948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.073955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.073960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.073969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:28.073985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698039:9460], now have 1 active actors on pipe
2025-10-01T14:10:28.073992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279697883:2446], now have 1 active actors on pipe
2025-10-01T14:10:28.073994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698070:9453], now have 1 active actors on pipe
2025-10-01T14:10:28.074000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255485902820457:8204]
2025-10-01T14:10:28.074002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255485902820457:8204]
2025-10-01T14:10:28.074004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255485902820457:8204]
2025-10-01T14:10:28.074018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:28.074032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:28.074041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:28.074044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:28.074045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:28.074048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:28.074050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:28.074061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1101, pipe: [1:7556255488279698039:9460]
2025-10-01T14:10:28.074072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1101
2025-10-01T14:10:28.074082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1101
2025-10-01T14:10:28.074071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255485902820457:8204]
2025-10-01T14:10:28.074079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:28.074080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:28.074105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.074110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.074120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_12_4423556105642351710_v1 on pipe: [1:7556255488279698039:9460]
2025-10-01T14:10:28.074140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.074144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.074150Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_12_4423556105642351710_v1:1 with generation 1101
2025-10-01T14:10:28.074152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.074155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.074156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:28.074166Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_12_4423556105642351710_v1
2025-10-01T14:10:28.074168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.074198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:28.074207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:10:28.074211Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:10:28.078732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:10:28.078755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:10:28.078761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.078767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.078769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:28.078776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.078786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:28.078790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:10:28.078804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:10:28.078819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.078917Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327828073 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:10:28.078935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:10:28.078958Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 sending to client partition status
2025-10-01T14:10:28.078987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.078998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.079014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.079087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1102 partition: 0 MaxSeqNo: 45 sessionId: src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0
2025-10-01T14:10:28.079300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db579ab8-d4fe03fb-695b6604-6486f61f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:28.081545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0] Write session: try to update token
2025-10-01T14:10:28.081559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:28.094068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1102 sessionId: src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:28.094127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:28.094141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:28.094143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:28.094145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:28.094152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255485902820457:8204]
2025-10-01T14:10:28.094155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255485902820457:8204]
2025-10-01T14:10:28.094160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255485902820457:8204]
2025-10-01T14:10:28.094191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:28.094196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:28.094200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:28.094201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.094202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:28.094203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:28.094310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:28.096339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:28.225219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:28.225812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.225825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.226019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_12_4423556105642351710_v1
2025-10-01T14:10:28.226032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:28.226062Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_12_4423556105642351710_v1
2025-10-01T14:10:28.226111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:28.226118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255488279698039:9460]
2025-10-01T14:10:28.226137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:28.226196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1102 reason: status is not ok: tablet will be restarted right now sessionId: src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0
2025-10-01T14:10:28.226355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1102 sessionId: src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0 is DEAD
2025-10-01T14:10:28.226548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:28.226561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0] Write session will restart in 0.008433s
2025-10-01T14:10:28.226588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0] Write session: Do CDS request
2025-10-01T14:10:28.226594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:28.235829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.235911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:28.235927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1103
2025-10-01T14:10:28.236016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.236047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:28.236056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:28.236060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:28.236371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1103 sessionId:  describe result for acl check
2025-10-01T14:10:28.236401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:28.236402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:28.236403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:28.236407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255488279698221:9461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:28.236783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255488279698221:9461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:28.237430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:28.238711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255488279698221:9461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:28.240163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:28.240315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:28.240323Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:28.240330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:28.240361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:28.240387Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255485902820645:8206]
2025-10-01T14:10:28.240845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:28.240978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255488279698221:9461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:28.240994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255488279698221:9461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:28.240997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255488279698221:9461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:28.241004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:28.241091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:28.241129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:28.241339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:28.241374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.241378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.241379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.241379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.241380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.241381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.241381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.241382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.241383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.241383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.241384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.241385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.241385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.241386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.241389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.241394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.241396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.241399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.241401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.241403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.241405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.241407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.241409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.241411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.241413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.241415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.241417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.241419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.241424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.241428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.241432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.241435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.241437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.241439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.241442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.241445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.241447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.241450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.241452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.241455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.241458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.241460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.241462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.241465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.241467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.241470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.241472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.241475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.241477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.241480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.241484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.241487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.241490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.241492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.241495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.241498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.241517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:28.245242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:28.245744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:28.245754Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:28.245755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:28.245758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:28.245763Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1102 [2:7556255485902820645:8206]
2025-10-01T14:10:28.245772Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:28.245787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:28.245789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.245791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.245793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.245804Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:28.245812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:28.245816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:28.245852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.245856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.245858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.245860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:28.245862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:28.245913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:28.245918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.245924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.245929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.245941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:28.245960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698261:9461], now have 1 active actors on pipe
2025-10-01T14:10:28.245967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698080:2446], now have 1 active actors on pipe
2025-10-01T14:10:28.245974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255485902820639:8206]
2025-10-01T14:10:28.245980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255485902820639:8206]
2025-10-01T14:10:28.245982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255485902820639:8206]
2025-10-01T14:10:28.245994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:28.246008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:28.246010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:28.246015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:28.246017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:28.246021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:28.246024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:28.246010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1102
2025-10-01T14:10:28.246040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1102
2025-10-01T14:10:28.246050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255485902820639:8206]
2025-10-01T14:10:28.246056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:28.246058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:28.246070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.246079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.246121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:28.246132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.246140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.246142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:28.246151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.246160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:28.246175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.246281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.246289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.246301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.246364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1103 partition: 0 MaxSeqNo: 45 sessionId: src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0
2025-10-01T14:10:28.246686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a1efcb-567f7bcf-f888ef18-f751636f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:28.248817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0] Write session: try to update token
2025-10-01T14:10:28.248830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:28.261108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1103 sessionId: src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:28.263374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:28.263571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.263591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.263627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:28.263691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:28.266686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:28.266702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:28.266704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:28.266706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:28.266714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255485902820639:8206]
2025-10-01T14:10:28.266718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255485902820639:8206]
2025-10-01T14:10:28.266722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255485902820639:8206]
2025-10-01T14:10:28.266757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:28.266765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:28.266766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:28.266770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:28.266771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.266774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:28.266902Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:28.326459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255488279698278:9460]
2025-10-01T14:10:28.326703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1102, pipe: [1:7556255488279698278:9460]
2025-10-01T14:10:28.418258Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:28.427032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.427058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.427235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.427302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.427366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.427429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.427482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.427492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.427575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.427644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.427712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.427784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.427831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.427841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.427907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.427966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.428034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.428096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.428143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.428151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.428228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.428310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.428392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.428457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.428501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.428508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.428566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.428624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.428682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.428756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.428800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.428807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.428870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.428926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.428994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.429059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.429106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.429113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.429194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.429265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.429335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.429400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.429448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.429455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.429528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.429595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.429656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.429727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.429777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.429784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.429850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.429911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.429976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.430040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.430089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.430097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.430183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:28.430304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:28.430386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:28.430449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:28.430496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:28.430503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:28.430563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698278:9460], now have 1 active actors on pipe
2025-10-01T14:10:28.430778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:28.430799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:28.430803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:28.430832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1103 reason: error at write: Disconnected sessionId: src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0
2025-10-01T14:10:28.430846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255488279698278:9460]
2025-10-01T14:10:28.431084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1103 sessionId: src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0 is DEAD
2025-10-01T14:10:28.431252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:28.431261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0] Write session will restart in 0.007068s
2025-10-01T14:10:28.431288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0] Write session: Do CDS request
2025-10-01T14:10:28.431295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:28.431984Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:28.439941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.442499Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:28.442520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1104
2025-10-01T14:10:28.446489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.446547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:28.446559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:28.446563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:28.447064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1104 sessionId:  describe result for acl check
2025-10-01T14:10:28.447108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:28.447114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:28.447116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:28.447121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255488279698343:9466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:28.447680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255488279698343:9466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:28.454499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255488279698343:9466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:28.459244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255488279698343:9466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:28.459273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255488279698343:9466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:28.459277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255488279698343:9466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:28.459287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:28.460498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:28.467739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:28.468027Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:28.468041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:28.468052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:28.468184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:28.468228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255485902820831:8209]
2025-10-01T14:10:28.468875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:28.469322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:28.469373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:28.469660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:28.469709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.469711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.469712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.469713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.469714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.469715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.469719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.469720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.469721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.469722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.469724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.469725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.469726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.469727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.469732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.469741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.469747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.469751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.469754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.469758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.469762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.469765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.469769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.469773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.469776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.469780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.469784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.469787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.469793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.469800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.469807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.469811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.469815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.469820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.469824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.469829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.469833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.469838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.469841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.469846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.469851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.469856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.469861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.469866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.469871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.469876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.469880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.469887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.469890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.469895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.469898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.469902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.469906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.469911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.469915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.469920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.469957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:28.474818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:28.475672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:28.475678Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:28.475681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:28.475685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:28.475692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1103 [2:7556255485902820831:8209]
2025-10-01T14:10:28.475708Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:28.475730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:28.475734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.475738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.475741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.475758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:28.475766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:28.475772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:28.475838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.475840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.475842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.475845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:28.475865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:28.475943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:28.475955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.475966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.475976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.475991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:28.476010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255485902820825:8209]
2025-10-01T14:10:28.476012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255485902820825:8209]
2025-10-01T14:10:28.476014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255485902820825:8209]
2025-10-01T14:10:28.476025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:28.476038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:28.476052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:28.476058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:28.476100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255485902820825:8209]
2025-10-01T14:10:28.476102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:28.479840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:28.479854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:28.479857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:28.479864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:28.482120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698462:9466], now have 1 active actors on pipe
2025-10-01T14:10:28.482135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698284:2446], now have 1 active actors on pipe
2025-10-01T14:10:28.483207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1103
2025-10-01T14:10:28.483270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1103
2025-10-01T14:10:28.486731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.486752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.486798Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:28.486810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.486821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.486825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:28.486837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.486859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:28.486886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.487146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.487154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.487168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.487394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1104 partition: 0 MaxSeqNo: 45 sessionId: src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0
2025-10-01T14:10:28.487836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13d8c63-a32451-a0aa2372-4fb0f12f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:28.490449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0] Write session: try to update token
2025-10-01T14:10:28.490466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:28.518610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:28.518626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:28.518629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:28.518632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:28.518644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255485902820825:8209]
2025-10-01T14:10:28.518650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255485902820825:8209]
2025-10-01T14:10:28.518654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255485902820825:8209]
2025-10-01T14:10:28.518710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:28.518720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.518722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:28.519716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1104 sessionId: src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:28.518868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:28.520382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:28.520393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:28.520403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:28.522345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:28.534478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255488279698474:9460]
2025-10-01T14:10:28.538472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1103, pipe: [1:7556255488279698474:9460]
2025-10-01T14:10:28.693297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:28.693644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.693653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.693691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698474:9460], now have 1 active actors on pipe
2025-10-01T14:10:28.695478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:28.695490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0] Write session will restart in 0.005094s
2025-10-01T14:10:28.694920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:28.694988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255488279698474:9460]
2025-10-01T14:10:28.695012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:28.695015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:28.695516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0] Write session: Do CDS request
2025-10-01T14:10:28.695085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1104 reason: error at write: Disconnected sessionId: src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0
2025-10-01T14:10:28.695287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1104 sessionId: src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0 is DEAD
2025-10-01T14:10:28.695523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:28.695399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:28.701980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.702349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:28.702388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1105
2025-10-01T14:10:28.702570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.702608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:28.702624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:28.702634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:28.703093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1105 sessionId:  describe result for acl check
2025-10-01T14:10:28.703127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:28.703129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:28.703131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:28.703136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255488279698492:9470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:28.703956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255488279698492:9470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:28.706861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255488279698492:9470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:28.710584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255488279698492:9470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:28.710605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255488279698492:9470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:28.710609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255488279698492:9470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:28.710618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:28.718083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:28.723560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:28.723924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:28.723937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:28.723947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:28.724004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:28.724054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255485902821027:8212]
2025-10-01T14:10:28.724744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:28.725137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:28.725179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:28.725518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:28.725570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.725572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.725573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.725574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.725576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.725577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.725579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.725580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.725581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.725582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.725584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.725585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.725586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.725587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.725592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.725601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.725605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.725609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.725612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.725616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.725619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.725623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.725626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.725630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.725634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.725636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.725640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.725644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.725650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.725658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.725664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.725669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.725674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.725679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.725683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.725687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.725691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.725696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.725700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.725704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.725708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.725714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.725720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.725725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.725730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.725734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.725738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.725743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.725750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.725755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.725759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.725764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.725768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.725774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.725778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.725783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.725826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:28.730843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:28.731553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:28.731570Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:28.731574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:28.731578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:28.731585Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1104 [2:7556255485902821027:8212]
2025-10-01T14:10:28.731604Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:28.731622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:28.731625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.731629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.731631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.731647Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:28.731660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:28.731667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:28.731732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.731751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.731753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.731757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:28.731759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:28.731828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:28.731831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.731841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.731850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.731863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:28.731880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255485902821022:8212]
2025-10-01T14:10:28.731882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255485902821022:8212]
2025-10-01T14:10:28.731884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255485902821022:8212]
2025-10-01T14:10:28.731897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:28.731911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:28.731925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:28.731928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:28.731963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255485902821022:8212]
2025-10-01T14:10:28.731966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:28.732167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:28.732176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:28.732179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:28.732184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:28.732434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698477:2446], now have 1 active actors on pipe
2025-10-01T14:10:28.732442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698609:9470], now have 1 active actors on pipe
2025-10-01T14:10:28.734427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1104
2025-10-01T14:10:28.734480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1104
2025-10-01T14:10:28.734594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.734605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.734634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e0d5ac4-1775662e-a99692f7-21363982_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:28.734642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.734646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.734649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:28.734660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.734676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:28.734692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.735662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.735672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.735691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.735837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1105 partition: 0 MaxSeqNo: 45 sessionId: src_id|4e0d5ac4-1775662e-a99692f7-21363982_0
2025-10-01T14:10:28.736257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eae50e78-a4c23e31-4b643cbe-f5f09885_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4e0d5ac4-1775662e-a99692f7-21363982_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:28.738683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0d5ac4-1775662e-a99692f7-21363982_0] Write session: try to update token
2025-10-01T14:10:28.738701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0d5ac4-1775662e-a99692f7-21363982_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:28.754571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:28.754597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:28.754599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:28.754601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:28.754610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255485902821022:8212]
2025-10-01T14:10:28.754615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255485902821022:8212]
2025-10-01T14:10:28.754624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255485902821022:8212]
2025-10-01T14:10:28.754677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:28.754686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:28.754688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.754691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:28.754691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:28.754695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:28.754839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:28.759420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1105 sessionId: src_id|4e0d5ac4-1775662e-a99692f7-21363982_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:28.762058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:28.794937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255488279698693:9460]
2025-10-01T14:10:28.795192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1104, pipe: [1:7556255488279698693:9460]
2025-10-01T14:10:28.896937Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:28.897464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.897481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.897515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698693:9460], now have 1 active actors on pipe
2025-10-01T14:10:28.897723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255488279698693:9460]
2025-10-01T14:10:28.897728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:28.897747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:28.897756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:28.897758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:28.897803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1105 reason: error at write: Disconnected sessionId: src_id|4e0d5ac4-1775662e-a99692f7-21363982_0
2025-10-01T14:10:28.898014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1105 sessionId: src_id|4e0d5ac4-1775662e-a99692f7-21363982_0 is DEAD
2025-10-01T14:10:28.898172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0d5ac4-1775662e-a99692f7-21363982_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:28.898183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0d5ac4-1775662e-a99692f7-21363982_0] Write session will restart in 0.007165s
2025-10-01T14:10:28.898209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0d5ac4-1775662e-a99692f7-21363982_0] Write session: Do CDS request
2025-10-01T14:10:28.898215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0d5ac4-1775662e-a99692f7-21363982_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:28.906954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0d5ac4-1775662e-a99692f7-21363982_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.907024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:28.907043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1106
2025-10-01T14:10:28.907146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:28.907186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:28.907196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:28.907200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:28.907653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1106 sessionId:  describe result for acl check
2025-10-01T14:10:28.907686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:28.907692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:28.907694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:28.907699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255488279698786:9483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:28.908174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255488279698786:9483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:28.910201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255488279698786:9483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:28.912644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:28.912962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255488279698786:9483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:28.912977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255488279698786:9483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:28.912980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255488279698786:9483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:28.912988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:28.916858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:28.917059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:28.917067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:28.917075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:28.917123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:28.917154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255485902821233:8223]
2025-10-01T14:10:28.917709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:28.918000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:28.918044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:28.918323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:28.918393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.918398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.918399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.918400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.918401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.918402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.918403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.918405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.918406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.918407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.918408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.918409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.918410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.918411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.918415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.918421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.918423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.918425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.918427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.918429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.918431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.918432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.918435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.918437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.918438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.918440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.918442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.918444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.918449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.918454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:28.918458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.918462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:28.918464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.918467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:28.918469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.918472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:28.918475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.918477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:28.918479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.918482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:28.918486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.918489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:28.918491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.918494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:28.918496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.918499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:28.918501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.918504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.918507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.918510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.918512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.918516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.918518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.918521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:28.918523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.918525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:28.918546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:28.922662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:28.923280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:28.923290Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:28.923291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:28.923293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:28.923298Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1105 [2:7556255485902821233:8223]
2025-10-01T14:10:28.923310Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:28.923322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:28.923324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.923326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.923327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.923340Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:28.923343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:28.923348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:28.923385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.923390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.923391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.923393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:28.923395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:28.923445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:28.923455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.923465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:28.923474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:28.923488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:28.923507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698887:9483], now have 1 active actors on pipe
2025-10-01T14:10:28.923515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698707:2446], now have 1 active actors on pipe
2025-10-01T14:10:28.923522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255485902821227:8223]
2025-10-01T14:10:28.923528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255485902821227:8223]
2025-10-01T14:10:28.923530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255485902821227:8223]
2025-10-01T14:10:28.923544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:28.923559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1105
2025-10-01T14:10:28.923560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:28.923560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:28.923571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1105
2025-10-01T14:10:28.923563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:28.923565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:28.923572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:28.923574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:28.923600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255485902821227:8223]
2025-10-01T14:10:28.923602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:28.923605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:28.923615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.923618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.923665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82727103-56e57f86-ee8e963b-db722858_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:28.923673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:28.923677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:28.923678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:28.923684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:28.923691Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:28.923703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.923831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.923843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.923863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:28.923935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1106 partition: 0 MaxSeqNo: 45 sessionId: src_id|82727103-56e57f86-ee8e963b-db722858_0
2025-10-01T14:10:28.924311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0d5ac4-1775662e-a99692f7-21363982_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82727103-56e57f86-ee8e963b-db722858_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:28.926686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82727103-56e57f86-ee8e963b-db722858_0] Write session: try to update token
2025-10-01T14:10:28.926701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82727103-56e57f86-ee8e963b-db722858_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:28.941547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1106 sessionId: src_id|82727103-56e57f86-ee8e963b-db722858_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:28.944219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:28.944816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:28.944840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:28.944862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:28.944865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:28.944868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:28.944870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:28.944878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255485902821227:8223]
2025-10-01T14:10:28.944882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255485902821227:8223]
2025-10-01T14:10:28.944886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255485902821227:8223]
2025-10-01T14:10:28.944921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:28.944931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:28.944934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:28.944936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:28.944941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:28.944943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:28.945067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:28.997656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255488279698900:9460]
2025-10-01T14:10:28.997901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1105, pipe: [1:7556255488279698900:9460]
2025-10-01T14:10:29.078349Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:29.078555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:29.078597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255488279698900:9460], now have 1 active actors on pipe
2025-10-01T14:10:29.078674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:29.078791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:29.078843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255488279698900:9460]
2025-10-01T14:10:29.086915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:29.086930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:29.086949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1106 reason: error at write: Disconnected sessionId: src_id|82727103-56e57f86-ee8e963b-db722858_0
2025-10-01T14:10:29.087080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1106 sessionId: src_id|82727103-56e57f86-ee8e963b-db722858_0 is DEAD
2025-10-01T14:10:29.087440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82727103-56e57f86-ee8e963b-db722858_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:29.087451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82727103-56e57f86-ee8e963b-db722858_0] Write session will restart in 0.009627s
2025-10-01T14:10:29.087486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82727103-56e57f86-ee8e963b-db722858_0] Write session: Do CDS request
2025-10-01T14:10:29.087495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82727103-56e57f86-ee8e963b-db722858_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:29.096157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:29.096553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:29.096706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:29.096722Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:29.096733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:29.096770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:29.096803Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255490197788729:8229]
2025-10-01T14:10:29.097225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:29.097916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82727103-56e57f86-ee8e963b-db722858_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.097983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:29.097998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1107
2025-10-01T14:10:29.098113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.098135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:29.098142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:29.098145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:29.098441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1107 sessionId:  describe result for acl check
2025-10-01T14:10:29.098469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:29.098470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:29.098472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:29.098476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255492574666347:9487] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:29.099058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255492574666347:9487] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:29.100485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:29.100560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:29.100974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:29.101063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.101073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.101074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.101076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.101077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.101078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.101079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.101080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.101081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.101082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.101083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.101085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.101086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.101087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.101094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.101104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.101107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.101112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.101115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.101119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.101122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.101126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.101130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.101133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.101136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.101140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.101143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.101146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.101154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.101164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.101171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.101176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.101181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.101185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.101189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.101194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.101198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.101204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.101208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.101213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.101217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.101222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.101227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.101232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.101238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.101243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.101246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.101253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.101256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.101261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.101265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.101270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.101273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.101277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.101281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.101286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.101322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:29.101935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255492574666347:9487] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:29.105028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255492574666347:9487] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:29.105046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255492574666347:9487] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:29.105050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255492574666347:9487] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:29.105059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:29.105508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:29.106360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:29.106400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:29.106402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:29.106408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:29.106415Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1106 [2:7556255490197788729:8229]
2025-10-01T14:10:29.106433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:29.106452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:29.106463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.106467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.106470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.106488Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:29.106494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:29.106501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:29.106567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.106576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.106578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.106581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:29.106584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:29.106662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:29.106672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.106686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.106699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.106717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:29.106739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666385:9487], now have 1 active actors on pipe
2025-10-01T14:10:29.106750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666198:2446], now have 1 active actors on pipe
2025-10-01T14:10:29.106757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255490197788724:8229]
2025-10-01T14:10:29.106760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255490197788724:8229]
2025-10-01T14:10:29.106763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255490197788724:8229]
2025-10-01T14:10:29.106778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:29.106796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:29.106799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:29.106803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:29.106805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:29.106820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:29.106824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:29.106858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255490197788724:8229]
2025-10-01T14:10:29.106871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:29.106846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1106
2025-10-01T14:10:29.106879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1106
2025-10-01T14:10:29.106885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:29.107013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.107019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.107048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:29.107062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.107072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.107075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:29.107086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.107100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:29.107120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.107287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.107297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.107312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.107399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1107 partition: 0 MaxSeqNo: 45 sessionId: src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0
2025-10-01T14:10:29.107814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82727103-56e57f86-ee8e963b-db722858_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:29.111092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0] Write session: try to update token
2025-10-01T14:10:29.111113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:29.118400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:29.118418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:29.118429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255490197788724:8229]
2025-10-01T14:10:29.118478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:29.118481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:29.118695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:29.118872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:29.119040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:29.119216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:29.119463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:29.119512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:29.128276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1107 sessionId: src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:29.131824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:29.132249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.132271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.132309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:29.132409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:29.138741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:29.138765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:29.138768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:29.138770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:29.138782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255490197788724:8229]
2025-10-01T14:10:29.138787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255490197788724:8229]
2025-10-01T14:10:29.138791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255490197788724:8229]
2025-10-01T14:10:29.138848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:29.138856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.138859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:29.139047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:29.139242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:29.139261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:29.139265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:29.178917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255492574666392:9460]
2025-10-01T14:10:29.179140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1106, pipe: [1:7556255492574666392:9460]
2025-10-01T14:10:29.285719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:29.293011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.293036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.293189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.293246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.293304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.293361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.293409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.293414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.293472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.293529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.293592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.293652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.293703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.293713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.293776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.293832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.293891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.294126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.294176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.294179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.294244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.294304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.294363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.294441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.294483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.294488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.294550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.294612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.294684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.294747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.294792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.294796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.294855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.294915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.294979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.295041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.295084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.295091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.295154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.295205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.295265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.295325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.295367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.295371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.295442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.295507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.295560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.295619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.295662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.295667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.295734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.295791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.295850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.295913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.295958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.295964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.296024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.296119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.296205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.296314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.296357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.296363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.296417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666392:9460], now have 1 active actors on pipe
2025-10-01T14:10:29.296629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255492574666392:9460]
2025-10-01T14:10:29.296645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:29.296651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:29.296672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:29.296683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1107 reason: error at write: Disconnected sessionId: src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0
2025-10-01T14:10:29.296874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1107 sessionId: src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0 is DEAD
2025-10-01T14:10:29.297086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:29.297096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0] Write session will restart in 0.005165s
2025-10-01T14:10:29.297129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0] Write session: Do CDS request
2025-10-01T14:10:29.297136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:29.297345Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:29.303867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.303957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:29.303979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1108
2025-10-01T14:10:29.304143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.304182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:29.304187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:29.304192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:29.304594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1108 sessionId:  describe result for acl check
2025-10-01T14:10:29.304631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:29.304632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:29.304635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:29.304639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255492574666421:9492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:29.305143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255492574666421:9492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:29.308379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255492574666421:9492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:29.310406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255492574666421:9492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:29.310422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255492574666421:9492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:29.310425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255492574666421:9492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:29.310431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:29.311687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:29.315517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:29.315724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:29.315735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:29.315744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:29.315786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:29.315832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255490197788918:8231]
2025-10-01T14:10:29.316499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:29.316819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:29.316871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:29.317190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:29.317247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.317248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.317249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.317250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.317251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.317252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.317253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.317254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.317255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.317256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.317257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.317258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.317259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.317260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.317265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.317275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.317279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.317283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.317287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.317291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.317293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.317297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.317300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.317303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.317306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.317309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.317311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.317314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.317321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.317328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.317333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.317338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.317342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.317348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.317352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.317357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.317361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.317366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.317370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.317375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.317379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.317384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.317389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.317393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.317398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.317403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.317407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.317412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.317417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.317422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.317427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.317432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.317436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.317441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.317445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.317449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.317488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:29.321254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:29.322272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:29.322285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:29.322287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:29.322291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:29.322298Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1107 [2:7556255490197788918:8231]
2025-10-01T14:10:29.322316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:29.322333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:29.322336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.322340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.322342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.322356Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:29.322367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:29.322387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:29.322442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.322450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.322451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.322455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:29.322457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:29.322521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:29.322529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.322539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.322554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.322567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:29.322583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255490197788912:8231]
2025-10-01T14:10:29.322591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255490197788912:8231]
2025-10-01T14:10:29.322593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255490197788912:8231]
2025-10-01T14:10:29.322604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:29.322616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666582:9492], now have 1 active actors on pipe
2025-10-01T14:10:29.322620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666397:2446], now have 1 active actors on pipe
2025-10-01T14:10:29.322619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:29.322623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:29.322625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:29.322626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:29.322639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:29.322641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:29.322673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255490197788912:8231]
2025-10-01T14:10:29.322683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:29.322689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:29.322708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1107
2025-10-01T14:10:29.322797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1107
2025-10-01T14:10:29.322814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.322824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.322851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:29.322863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.322867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.322870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:29.322879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.322890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:29.322905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.323013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.323020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.323031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.323094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1108 partition: 0 MaxSeqNo: 45 sessionId: src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0
2025-10-01T14:10:29.323493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1c02c0d-36d79c82-9bd7f7eb-3ea76958_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:29.326095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0] Write session: try to update token
2025-10-01T14:10:29.326112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:29.333551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:29.333568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:29.333578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255490197788912:8231]
2025-10-01T14:10:29.333620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:29.333619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:29.333775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:29.333913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:29.334045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:29.334171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:29.334360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:29.334426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:29.340164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1108 sessionId: src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:29.342688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:29.342951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.342969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.342996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:29.343077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:29.352439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:29.352458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:29.352460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:29.352462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:29.352471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255490197788912:8231]
2025-10-01T14:10:29.352475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255490197788912:8231]
2025-10-01T14:10:29.352484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255490197788912:8231]
2025-10-01T14:10:29.352525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:29.352530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.352532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:29.352663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:29.353599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:29.353605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:29.353612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:29.398266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255492574666599:9460]
2025-10-01T14:10:29.398690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1107, pipe: [1:7556255492574666599:9460]
2025-10-01T14:10:29.497979Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:29.505333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.505359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.505501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.505549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.505615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.505667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.505703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.505707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.505769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.505821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.505867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.505915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.505951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.505954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.506013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.506069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.506121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.506177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.506214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.506217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.506276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.506329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.506426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.506505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.506549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.506560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.506632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.506699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.506767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.506843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.506889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.506894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.506960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.507020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.507083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.507149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.507194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.507200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.507266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.507326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.507387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.507447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.507489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.507495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.507555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.507614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.507676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.507738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.507781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.507788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.507851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.507912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.507972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.508031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.508075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.508080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.508143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.508203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.508263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.508322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.508364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.508370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.508424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666599:9460], now have 1 active actors on pipe
2025-10-01T14:10:29.509295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:29.509585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:29.509600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:29.509626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:29.509638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1108 reason: error at write: Disconnected sessionId: src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0
2025-10-01T14:10:29.509659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255492574666599:9460]
2025-10-01T14:10:29.509835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1108 sessionId: src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0 is DEAD
2025-10-01T14:10:29.510290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:29.510301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0] Write session will restart in 0.005316s
2025-10-01T14:10:29.510325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0] Write session: Do CDS request
2025-10-01T14:10:29.510329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:29.516919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.517848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:29.517865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1109
2025-10-01T14:10:29.517991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.518027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:29.518034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:29.518039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:29.518656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1109 sessionId:  describe result for acl check
2025-10-01T14:10:29.518696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:29.518698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:29.518699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:29.518705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255492574666647:9496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:29.519470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255492574666647:9496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:29.524384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255492574666647:9496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:29.527026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:29.527177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255492574666647:9496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:29.527194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255492574666647:9496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:29.527198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255492574666647:9496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:29.527215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:29.530441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:29.530660Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:29.530673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:29.530685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:29.530734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:29.530777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255490197789107:8234]
2025-10-01T14:10:29.531343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:29.531654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:29.531696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:29.531968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:29.532020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.532025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.532026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.532027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.532028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.532029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.532030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.532031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.532032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.532033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.532034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.532035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.532036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.532037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.532042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.532051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.532054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.532058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.532061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.532065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.532068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.532071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.532075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.532078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.532081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.532084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.532087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.532090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.532096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.532102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.532108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.532112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.532116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.532120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.532124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.532128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.532132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.532136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.532139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.532144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.532147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.532151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.532155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.532159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.532163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.532173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.532177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.532181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.532185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.532190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.532197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.532202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.532205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.532209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.532212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.532221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.532251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:29.536022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:29.536740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:29.536752Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:29.536754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:29.536758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:29.536765Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1108 [2:7556255490197789107:8234]
2025-10-01T14:10:29.536780Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:29.536809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:29.536816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.536820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.536821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.536837Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:29.536847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:29.536853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:29.536909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.536915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.536918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.536921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:29.536924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:29.536993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:29.537002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.537013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.537022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.537036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:29.537058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666784:9496], now have 1 active actors on pipe
2025-10-01T14:10:29.537065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666602:2446], now have 1 active actors on pipe
2025-10-01T14:10:29.537072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255490197789101:8234]
2025-10-01T14:10:29.537074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255490197789101:8234]
2025-10-01T14:10:29.537077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255490197789101:8234]
2025-10-01T14:10:29.537089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:29.537107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:29.537108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:29.537111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:29.537113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:29.537122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:29.537125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:29.537153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255490197789101:8234]
2025-10-01T14:10:29.537160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:29.537181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:29.537147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1108
2025-10-01T14:10:29.537190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.537154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1108
2025-10-01T14:10:29.537195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.537224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:29.537235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.537240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.537243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:29.537252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.537264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:29.537284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.537391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.537399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.537411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.537480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1109 partition: 0 MaxSeqNo: 45 sessionId: src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0
2025-10-01T14:10:29.537829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fb3ce40-f66d4ee4-276b2d76-ca64e1b4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:29.540151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0] Write session: try to update token
2025-10-01T14:10:29.540169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:29.553591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1109 sessionId: src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:29.556090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:29.558116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.558157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.558181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:29.558184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:29.558185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:29.558187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:29.558196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255490197789101:8234]
2025-10-01T14:10:29.558200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255490197789101:8234]
2025-10-01T14:10:29.558205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255490197789101:8234]
2025-10-01T14:10:29.558256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:29.558262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.558264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:29.558287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:29.558293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:29.558297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:29.558403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:29.610028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255492574666797:9460]
2025-10-01T14:10:29.610273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1108, pipe: [1:7556255492574666797:9460]
2025-10-01T14:10:29.707025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:29.707483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:29.707541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666797:9460], now have 1 active actors on pipe
2025-10-01T14:10:29.707622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:29.707666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255492574666797:9460]
2025-10-01T14:10:29.707685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:29.707719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:29.707726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:29.707794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1109 reason: error at write: Disconnected sessionId: src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0
2025-10-01T14:10:29.708109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:29.708120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0] Write session will restart in 0.009545s
2025-10-01T14:10:29.707966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1109 sessionId: src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0 is DEAD
2025-10-01T14:10:29.708142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0] Write session: Do CDS request
2025-10-01T14:10:29.708150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:29.718935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.719024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:29.719043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1110
2025-10-01T14:10:29.719186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.719217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:29.719226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:29.719233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:29.719587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1110 sessionId:  describe result for acl check
2025-10-01T14:10:29.719616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:29.719618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:29.719619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:29.719624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255492574666947:9500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:29.720054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255492574666947:9500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:29.721412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:29.721838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255492574666947:9500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:29.724547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:29.724770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:29.724781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:29.724794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:29.724854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:29.724891Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255490197789306:8237]
2025-10-01T14:10:29.724934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255492574666947:9500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:29.724948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255492574666947:9500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:29.724951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255492574666947:9500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:29.724959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:29.725465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:29.725770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:29.725823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:29.726095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:29.726145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.726151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.726152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.726153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.726154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.726155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.726156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.726157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.726158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.726160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.726161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.726162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.726163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.726164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.726169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.726178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.726181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.726183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.726185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.726187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.726189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.726191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.726193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.726195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.726197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.726199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.726201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.726202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.726207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.726211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.726215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.726218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.726220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.726223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.726226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.726228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.726231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.726233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.726236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.726239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.726242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.726245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.726247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.726250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.726252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.726255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.726259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.726263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.726267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.726271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.726275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.726280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.726283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.726287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.726289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.726292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.726312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:29.729867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:29.730463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:29.730478Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:29.730481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:29.730485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:29.730494Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1109 [2:7556255490197789306:8237]
2025-10-01T14:10:29.730508Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:29.730529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:29.730537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.730540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.730543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.730558Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:29.730569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:29.730575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:29.730628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.730635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.730638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.730641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:29.730644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:29.730706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:29.730714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.730726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.730738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.730758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:29.730780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666799:2446], now have 1 active actors on pipe
2025-10-01T14:10:29.730788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574666984:9500], now have 1 active actors on pipe
2025-10-01T14:10:29.730796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255490197789301:8237]
2025-10-01T14:10:29.730802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255490197789301:8237]
2025-10-01T14:10:29.730804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255490197789301:8237]
2025-10-01T14:10:29.730818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:29.730831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:29.730835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:29.730840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:29.730842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:29.730848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:29.730851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:29.730833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1109
2025-10-01T14:10:29.730848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1109
2025-10-01T14:10:29.730880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255490197789301:8237]
2025-10-01T14:10:29.730892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:29.730897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:29.730911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.730920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.730964Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:29.730975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.730979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.730985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:29.730994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.731006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:29.731026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.731280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.731291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.731312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.731389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1110 partition: 0 MaxSeqNo: 45 sessionId: src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0
2025-10-01T14:10:29.731723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d9c1613-54ab63d1-1e3ee2fa-9d026a63_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:29.734007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0] Write session: try to update token
2025-10-01T14:10:29.734021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:29.746881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1110 sessionId: src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:29.749495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:29.749757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.749782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.749836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:29.749916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:29.754880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:29.754901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:29.754904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:29.754907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:29.754916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255490197789301:8237]
2025-10-01T14:10:29.754921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255490197789301:8237]
2025-10-01T14:10:29.754926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255490197789301:8237]
2025-10-01T14:10:29.754982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:29.754995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.755002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:29.755165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:29.758464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:29.758484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:29.758491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:29.807628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255492574667032:9460]
2025-10-01T14:10:29.807838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1109, pipe: [1:7556255492574667032:9460]
2025-10-01T14:10:29.907117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:29.914242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.914272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.914448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.914513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.914577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.914642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.914690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.914701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.914771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.914831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.914894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.914960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.915009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.915016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.915074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.915129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.915188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.915247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.915290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.915297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.915354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.915413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.915471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.915526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.915569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.915576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.915638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.915693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.915749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.915805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.915848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.915855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.915912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.915967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.916029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.916092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.916138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.916145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.916206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.916261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.916319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.916378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.916432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.916440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.916497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.916552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.916609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.916671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.916781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.916792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.916855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.916915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.916977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.917040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.917085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.917093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.917155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:29.917215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:29.917279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:29.917343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:29.917390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:29.917398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:29.917451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574667032:9460], now have 1 active actors on pipe
2025-10-01T14:10:29.917685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:29.917702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255492574667032:9460]
2025-10-01T14:10:29.917728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:29.917730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:29.917756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1110 reason: error at write: Disconnected sessionId: src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0
2025-10-01T14:10:29.917981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1110 sessionId: src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0 is DEAD
2025-10-01T14:10:29.918116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:29.918126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0] Write session will restart in 0.008079s
2025-10-01T14:10:29.918151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0] Write session: Do CDS request
2025-10-01T14:10:29.918158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:29.918784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:29.927900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.928000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:29.928016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1111
2025-10-01T14:10:29.928127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:29.928153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:29.928157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:29.928161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:29.928494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1111 sessionId:  describe result for acl check
2025-10-01T14:10:29.928520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:29.928522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:29.928523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:29.928527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255492574667141:9513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:29.929028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255492574667141:9513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:29.930858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255492574667141:9513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:29.935093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:29.935486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:29.935653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:29.935663Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:29.935674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:29.935726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:29.935765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255490197789517:8242]
2025-10-01T14:10:29.935815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255492574667141:9513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:29.935831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255492574667141:9513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:29.935834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255492574667141:9513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:29.935841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:29.936360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:29.936606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:29.936656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:29.936987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:29.937045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.937050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.937051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.937053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.937054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.937055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.937056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.937057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.937057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.937058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.937059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.937060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.937061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.937062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.937068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.937076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.937079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.937083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.937086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.937089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.937092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.937096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.937099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.937102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.937106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.937109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.937114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.937117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.937123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.937130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:29.937135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.937143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:29.937147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.937151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:29.937156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.937160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:29.937163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.937167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:29.937171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.937175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:29.937183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.937187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:29.937191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.937195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:29.937198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.937207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:29.937210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.937214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.937218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.937226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.937229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.937233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.937237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.937241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:29.937244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.937249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:29.937283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:29.940848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:29.941590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:29.941604Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:29.941606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:29.941610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:29.941616Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1110 [2:7556255490197789517:8242]
2025-10-01T14:10:29.941630Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:29.941650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:29.941657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.941661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.941664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.941681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:29.941690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:29.941696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:29.941747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.941754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.941756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.941759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:29.941762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:29.941823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:29.941831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.941843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:29.941859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:29.941881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:29.941903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574667221:9513], now have 1 active actors on pipe
2025-10-01T14:10:29.941911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255492574667034:2446], now have 1 active actors on pipe
2025-10-01T14:10:29.941918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255490197789512:8242]
2025-10-01T14:10:29.941927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255490197789512:8242]
2025-10-01T14:10:29.941933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255490197789512:8242]
2025-10-01T14:10:29.941948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:29.941964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:29.941964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:29.941968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:29.941969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:29.941982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:29.941985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:29.941945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1110
2025-10-01T14:10:29.941969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1110
2025-10-01T14:10:29.942029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.942037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.942050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255490197789512:8242]
2025-10-01T14:10:29.942061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:29.942076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:29.942091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5e0992-6446a12c-e1ece634-dc463393_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:29.942102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:29.942110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:29.942112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:29.942120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:29.942132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:29.942154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.942281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.942289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.942302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:29.942386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1111 partition: 0 MaxSeqNo: 45 sessionId: src_id|d5e0992-6446a12c-e1ece634-dc463393_0
2025-10-01T14:10:29.942735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da61347c-6ccafa48-e03d95dc-b2b90063_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d5e0992-6446a12c-e1ece634-dc463393_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:29.945108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e0992-6446a12c-e1ece634-dc463393_0] Write session: try to update token
2025-10-01T14:10:29.945123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e0992-6446a12c-e1ece634-dc463393_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:29.958396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1111 sessionId: src_id|d5e0992-6446a12c-e1ece634-dc463393_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:29.960775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:29.961964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:29.961981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:29.961998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:29.962000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:29.962001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:29.962002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:29.962008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255490197789512:8242]
2025-10-01T14:10:29.962010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255490197789512:8242]
2025-10-01T14:10:29.962014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255490197789512:8242]
2025-10-01T14:10:29.962049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:29.962057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:29.962061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:29.962063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:29.962071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:29.962074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:29.962193Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:30.018082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255496869634528:9460]
2025-10-01T14:10:30.018356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1110, pipe: [1:7556255496869634528:9460]
2025-10-01T14:10:30.101364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:30.101705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:30.101767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869634528:9460], now have 1 active actors on pipe
2025-10-01T14:10:30.101825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:30.101995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255496869634528:9460]
2025-10-01T14:10:30.102022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:30.112595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:30.112610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:30.112637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1111 reason: error at write: Disconnected sessionId: src_id|d5e0992-6446a12c-e1ece634-dc463393_0
2025-10-01T14:10:30.112803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1111 sessionId: src_id|d5e0992-6446a12c-e1ece634-dc463393_0 is DEAD
2025-10-01T14:10:30.112977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e0992-6446a12c-e1ece634-dc463393_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:30.112988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e0992-6446a12c-e1ece634-dc463393_0] Write session will restart in 0.007567s
2025-10-01T14:10:30.113014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e0992-6446a12c-e1ece634-dc463393_0] Write session: Do CDS request
2025-10-01T14:10:30.113022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e0992-6446a12c-e1ece634-dc463393_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:30.119153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:30.121909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e0992-6446a12c-e1ece634-dc463393_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.121974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:30.121994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1112
2025-10-01T14:10:30.122115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.122147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:30.122157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:30.122162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:30.122450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:30.122569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1112 sessionId:  describe result for acl check
2025-10-01T14:10:30.122608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:30.122614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:30.122615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:30.122621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255496869634684:9517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:30.122621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:30.122629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:30.122638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:30.122686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:30.122716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255494492757020:8254]
2025-10-01T14:10:30.123133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:30.123142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255496869634684:9517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:30.123350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:30.123387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:30.123648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:30.123700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.123705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.123706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.123707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.123708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.123709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.123709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.123710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.123711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.123712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.123713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.123714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.123715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.123715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.123719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.123728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.123732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.123736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.123740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.123744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.123748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.123751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.123755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.123759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.123762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.123766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.123769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.123773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.123779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.123786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.123792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.123798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.123802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.123806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.123811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.123816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.123820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.123825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.123830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.123839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.123844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.123853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.123860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.123865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.123869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.123878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.123882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.123887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.123892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.123900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.123904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.123913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.123917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.123925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.123929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.123937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.123976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:30.125278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255496869634684:9517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:30.127554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:30.127783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255496869634684:9517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:30.127810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255496869634684:9517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:30.127814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255496869634684:9517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:30.127821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:30.128553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:30.128564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:30.128565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:30.128568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:30.128573Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1111 [2:7556255494492757020:8254]
2025-10-01T14:10:30.128582Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:30.128594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:30.128599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.128601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.128602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.128615Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:30.128621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:30.128626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:30.128662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.128667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.128668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.128671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:30.128673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:30.128733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:30.128737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.128744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.128749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.128758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:30.128773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869634722:9517], now have 1 active actors on pipe
2025-10-01T14:10:30.128779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869634531:2446], now have 1 active actors on pipe
2025-10-01T14:10:30.128783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255494492757015:8254]
2025-10-01T14:10:30.128785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255494492757015:8254]
2025-10-01T14:10:30.128786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255494492757015:8254]
2025-10-01T14:10:30.128795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:30.128807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:30.128810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:30.128813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:30.128814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:30.128817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:30.128819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:30.128837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1111
2025-10-01T14:10:30.128846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1111
2025-10-01T14:10:30.128842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255494492757015:8254]
2025-10-01T14:10:30.128849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:30.128866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:30.128878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.128882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.128915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:30.128925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.128929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.128934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:30.128942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.128955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:30.128968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.129104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.129110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.129122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.129183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1112 partition: 0 MaxSeqNo: 45 sessionId: src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0
2025-10-01T14:10:30.129519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5e0992-6446a12c-e1ece634-dc463393_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:30.131969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0] Write session: try to update token
2025-10-01T14:10:30.131985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:30.146155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1112 sessionId: src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:30.148401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:30.149547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.149575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.149597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:30.149602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:30.149605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:30.149607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:30.149614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255494492757015:8254]
2025-10-01T14:10:30.149618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255494492757015:8254]
2025-10-01T14:10:30.149621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255494492757015:8254]
2025-10-01T14:10:30.149671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:30.149677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:30.149683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.149685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:30.149685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:30.149688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:30.149860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:30.202422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255496869634731:9460]
2025-10-01T14:10:30.202611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1111, pipe: [1:7556255496869634731:9460]
2025-10-01T14:10:30.304142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:30.304634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:30.304690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869634731:9460], now have 1 active actors on pipe
2025-10-01T14:10:30.304775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:30.304884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:30.304938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255496869634731:9460]
2025-10-01T14:10:30.313246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:30.313262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:30.313282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1112 reason: error at write: Disconnected sessionId: src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0
2025-10-01T14:10:30.313433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1112 sessionId: src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0 is DEAD
2025-10-01T14:10:30.313605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:30.313616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0] Write session will restart in 0.007425s
2025-10-01T14:10:30.313641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0] Write session: Do CDS request
2025-10-01T14:10:30.313650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:30.321976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.322041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:30.322066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1113
2025-10-01T14:10:30.322213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.322261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:30.322270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:30.322274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:30.322690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1113 sessionId:  describe result for acl check
2025-10-01T14:10:30.322721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:30.322727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:30.322729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:30.322735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255496869634892:9522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:30.323242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255496869634892:9522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:30.323775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:30.324144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:30.324291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:30.324300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:30.324310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:30.324382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:30.324411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255494492757212:8256]
2025-10-01T14:10:30.324833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:30.325287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255496869634892:9522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:30.327192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:30.327237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:30.327482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255496869634892:9522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:30.327495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255496869634892:9522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:30.327498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255496869634892:9522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:30.327505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:30.327528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:30.327584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.327589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.327590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.327590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.327591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.327591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.327592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.327593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.327593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.327594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.327594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.327595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.327595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.327596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.327600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.327605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.327608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.327610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.327612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.327614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.327616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.327618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.327620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.327622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.327625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.327627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.327629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.327631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.327636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.327641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.327646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.327648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.327651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.327654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.327656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.327658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.327661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.327663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.327666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.327669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.327671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.327673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.327676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.327679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.327681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.327684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.327686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.327689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.327692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.327694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.327697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.327699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.327701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.327704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.327707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.327709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.327730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:30.331218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:30.331794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:30.331807Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:30.331809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:30.331813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:30.331820Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1112 [2:7556255494492757212:8256]
2025-10-01T14:10:30.331832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:30.331849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:30.331853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.331856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.331858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.331870Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:30.331878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:30.331883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:30.331922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.331927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.331928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.331930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:30.331932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:30.331989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:30.331994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.332001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.332006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.332014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:30.332030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255494492757207:8256]
2025-10-01T14:10:30.332034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255494492757207:8256]
2025-10-01T14:10:30.332035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255494492757207:8256]
2025-10-01T14:10:30.332044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:30.332051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:30.332056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:30.332060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:30.332063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:30.332067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:30.332070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:30.332080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869634741:2446], now have 1 active actors on pipe
2025-10-01T14:10:30.332088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869634931:9522], now have 1 active actors on pipe
2025-10-01T14:10:30.332091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1112
2025-10-01T14:10:30.332113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255494492757207:8256]
2025-10-01T14:10:30.332119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:30.332122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:30.332119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1112
2025-10-01T14:10:30.332235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.332247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.332268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:30.332278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.332293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.332298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:30.332306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.332315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:30.332333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.332461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.332466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.332475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.332565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1113 partition: 0 MaxSeqNo: 45 sessionId: src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0
2025-10-01T14:10:30.332964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aaffa2cd-c11cd5db-69ac29d7-ad347f07_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:30.335654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0] Write session: try to update token
2025-10-01T14:10:30.335672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:30.349756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1113 sessionId: src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:30.351967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:30.351986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:30.351988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:30.351990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:30.351997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255494492757207:8256]
2025-10-01T14:10:30.352000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255494492757207:8256]
2025-10-01T14:10:30.352003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255494492757207:8256]
2025-10-01T14:10:30.352040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:30.352042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:30.352049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.352050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:30.352051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:30.352053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:30.352168Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:30.352215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:30.405134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255496869634943:9460]
2025-10-01T14:10:30.405342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1112, pipe: [1:7556255496869634943:9460]
2025-10-01T14:10:30.491018Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:30.491242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.491255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.491295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869634943:9460], now have 1 active actors on pipe
2025-10-01T14:10:30.491429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:30.491496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255496869634943:9460]
2025-10-01T14:10:30.491519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:30.491521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:30.491528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:30.491570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1113 reason: error at write: Disconnected sessionId: src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0
2025-10-01T14:10:30.491780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1113 sessionId: src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0 is DEAD
2025-10-01T14:10:30.491935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:30.491946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0] Write session will restart in 0.009076s
2025-10-01T14:10:30.491970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0] Write session: Do CDS request
2025-10-01T14:10:30.491977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:30.501860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.501945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:30.501962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1114
2025-10-01T14:10:30.502093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.502125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:30.502135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:30.502142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:30.502501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1114 sessionId:  describe result for acl check
2025-10-01T14:10:30.502541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:30.502552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:30.502555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:30.502563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255496869635097:9526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:30.503003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255496869635097:9526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:30.503577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:30.504706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255496869635097:9526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:30.506803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:30.507072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:30.507083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:30.507097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:30.507143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255496869635097:9526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:30.507161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:30.507157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255496869635097:9526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:30.507160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255496869635097:9526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:30.507168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:30.507200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255494492757406:8259]
2025-10-01T14:10:30.507785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:30.508056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:30.508118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:30.508417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:30.508478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.508485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.508486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.508487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.508489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.508490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.508491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.508492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.508493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.508494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.508496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.508497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.508498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.508499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.508505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.508515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.508518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.508522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.508526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.508530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.508533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.508537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.508546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.508550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.508560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.508564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.508568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.508571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.508578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.508585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.508591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.508597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.508601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.508606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.508615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.508621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.508625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.508634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.508639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.508648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.508655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.508664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.508669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.508679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.508683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.508693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.508701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.508724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.508733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.508743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.508752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.508762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.508771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.508781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.508789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.508799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.508841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:30.512363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:30.513401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:30.513415Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:30.513417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:30.513419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:30.513425Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1113 [2:7556255494492757406:8259]
2025-10-01T14:10:30.513439Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:30.513452Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:30.513457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.513460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.513461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.513473Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:30.513477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:30.513481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:30.513524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.513530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.513531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.513534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:30.513536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:30.513587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:30.513593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.513600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.513605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.513618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:30.513634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869634946:2446], now have 1 active actors on pipe
2025-10-01T14:10:30.513641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869635135:9526], now have 1 active actors on pipe
2025-10-01T14:10:30.513648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255494492757401:8259]
2025-10-01T14:10:30.513649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255494492757401:8259]
2025-10-01T14:10:30.513650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255494492757401:8259]
2025-10-01T14:10:30.513661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:30.513673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:30.513677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:30.513679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:30.513681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:30.513686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:30.513689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:30.513693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1113
2025-10-01T14:10:30.513695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1113
2025-10-01T14:10:30.513715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255494492757401:8259]
2025-10-01T14:10:30.513725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:30.513727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:30.513738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.513742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.513778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:30.513787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.513789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.513791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:30.513798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.513805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:30.513821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.513940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.513947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.513956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.514017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1114 partition: 0 MaxSeqNo: 45 sessionId: src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0
2025-10-01T14:10:30.514365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6725d12-656437dc-8c85052b-ece6bcb6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:30.516963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0] Write session: try to update token
2025-10-01T14:10:30.516981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:30.531494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1114 sessionId: src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:30.533381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:30.533401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:30.533404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:30.533406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:30.533416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255494492757401:8259]
2025-10-01T14:10:30.533420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255494492757401:8259]
2025-10-01T14:10:30.533425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255494492757401:8259]
2025-10-01T14:10:30.533472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:30.533478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:30.533486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.533487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:30.533488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:30.533491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:30.533619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:30.534024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:30.591509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255496869635148:9460]
2025-10-01T14:10:30.591774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1113, pipe: [1:7556255496869635148:9460]
2025-10-01T14:10:30.680363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:30.680929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.680945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.680987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869635148:9460], now have 1 active actors on pipe
2025-10-01T14:10:30.681187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:30.681227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:30.681286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255496869635148:9460]
2025-10-01T14:10:30.681307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:30.681381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1114 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0
2025-10-01T14:10:30.681596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1114 sessionId: src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0 is DEAD
2025-10-01T14:10:30.681744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:30.681754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0] Write session will restart in 0.009936s
2025-10-01T14:10:30.681781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0] Write session: Do CDS request
2025-10-01T14:10:30.681787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:30.692972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.694526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:30.694543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1115
2025-10-01T14:10:30.694698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.694740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:30.694750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:30.694754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:30.695172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1115 sessionId:  describe result for acl check
2025-10-01T14:10:30.695210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:30.695212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:30.695215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:30.695221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255496869635307:9530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:30.695763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255496869635307:9530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:30.697943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255496869635307:9530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:30.697834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:30.702945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:30.703177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255496869635307:9530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:30.703207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:30.703197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255496869635307:9530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:30.703200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255496869635307:9530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:30.703209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:30.703221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:30.703232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:30.703327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:30.703422Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255494492757613:8262]
2025-10-01T14:10:30.704079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:30.704394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:30.704445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:30.704793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:30.704875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.704886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.704888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.704889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.704891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.704892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.704893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.704894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.704896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.704897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.704898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.704900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.704901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.704902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.704907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.704917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.704920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.704925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.704929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.704932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.704936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.704940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.704943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.704947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.704951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.704954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.704958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.704962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.704970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.704977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.704983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.704989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.704994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.704999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.705004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.705009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.705015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.705020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.705023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.705029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.705034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.705039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.705044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.705049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.705055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.705060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.705065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.705071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.705076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.705082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.705089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.705094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.705107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.705113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.705117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.705124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.705176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:30.709136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:30.710571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:30.710589Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:30.710592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:30.710596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:30.710607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1114 [2:7556255494492757613:8262]
2025-10-01T14:10:30.710629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:30.710647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:30.710657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.710661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.710663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.710678Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:30.710685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:30.710694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:30.710772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.710784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.710786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.710790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:30.710794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:30.710874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:30.710885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.710897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.710907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.710921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:30.710941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869635154:2446], now have 1 active actors on pipe
2025-10-01T14:10:30.710950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869635344:9530], now have 1 active actors on pipe
2025-10-01T14:10:30.710956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255494492757608:8262]
2025-10-01T14:10:30.710959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255494492757608:8262]
2025-10-01T14:10:30.710962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255494492757608:8262]
2025-10-01T14:10:30.710976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:30.710990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:30.711005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:30.711010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:30.711013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:30.711017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:30.711019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:30.711049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255494492757608:8262]
2025-10-01T14:10:30.711001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1114
2025-10-01T14:10:30.711060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:30.711055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1114
2025-10-01T14:10:30.711077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:30.711204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.711214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.711240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|473c288-ff83a743-95d506c6-f640b1f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:30.711251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.711255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.711256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:30.711265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.711280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:30.711300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.711444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.711456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.711467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.711557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1115 partition: 0 MaxSeqNo: 45 sessionId: src_id|473c288-ff83a743-95d506c6-f640b1f6_0
2025-10-01T14:10:30.711868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88034012-bf1c71e4-1b1413e5-f406f5f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|473c288-ff83a743-95d506c6-f640b1f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:30.715046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473c288-ff83a743-95d506c6-f640b1f6_0] Write session: try to update token
2025-10-01T14:10:30.715061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473c288-ff83a743-95d506c6-f640b1f6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:30.723239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:30.723262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:30.723273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255494492757608:8262]
2025-10-01T14:10:30.723319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:30.723321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:30.723529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:30.723703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:30.723868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:30.724038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:30.724292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:30.724336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:30.734062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1115 sessionId: src_id|473c288-ff83a743-95d506c6-f640b1f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:30.737036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:30.737300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.737327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.737374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:30.737468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:30.742875Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:30.742899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:30.742901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:30.742903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:30.742914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255494492757608:8262]
2025-10-01T14:10:30.742923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255494492757608:8262]
2025-10-01T14:10:30.742928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255494492757608:8262]
2025-10-01T14:10:30.742975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:30.742983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:30.742986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:30.742989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:30.742991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.742993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:30.743149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:30.781500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255496869635358:9460]
2025-10-01T14:10:30.781824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1114, pipe: [1:7556255496869635358:9460]
2025-10-01T14:10:30.889741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:30.897757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.897787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.897968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.898036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.898105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.898182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.898234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.898243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.898307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.898361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.898445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.898509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.898553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.898560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.898622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.898680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.898737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.898790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.898834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.898841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.898895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.898952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.899007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.899065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.899109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.899116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.899173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.899226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.899283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.899338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.899380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.899387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.899444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.899496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.899551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.899607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.899665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.899676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.899740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.899796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.899855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.899917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.899955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.899961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.900019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.900080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.900144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.900203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.900249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.900254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.900317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.900378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.900437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.900494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.900537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.900542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.900601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:30.900657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:30.900732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:30.900796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:30.900848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:30.900853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:30.900913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869635358:9460], now have 1 active actors on pipe
2025-10-01T14:10:30.901260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:30.901278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:30.901293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255496869635358:9460]
2025-10-01T14:10:30.901302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1115 reason: error at write: Disconnected sessionId: src_id|473c288-ff83a743-95d506c6-f640b1f6_0
2025-10-01T14:10:30.901321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:30.901487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1115 sessionId: src_id|473c288-ff83a743-95d506c6-f640b1f6_0 is DEAD
2025-10-01T14:10:30.901656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473c288-ff83a743-95d506c6-f640b1f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:30.901669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473c288-ff83a743-95d506c6-f640b1f6_0] Write session will restart in 0.009212s
2025-10-01T14:10:30.901696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473c288-ff83a743-95d506c6-f640b1f6_0] Write session: Do CDS request
2025-10-01T14:10:30.901703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473c288-ff83a743-95d506c6-f640b1f6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:30.901854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:30.911913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473c288-ff83a743-95d506c6-f640b1f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.912028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:30.912054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1116
2025-10-01T14:10:30.912210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:30.912237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:30.912247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:30.912251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:30.913270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1116 sessionId:  describe result for acl check
2025-10-01T14:10:30.913311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:30.913312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:30.913314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:30.913319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255496869635432:9543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:30.913806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255496869635432:9543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:30.916568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255496869635432:9543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:30.919957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255496869635432:9543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:30.919972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255496869635432:9543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:30.919975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255496869635432:9543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:30.919984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:30.925624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:30.926264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:30.926483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:30.926495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:30.926507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:30.926564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:30.926607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255494492757818:8267]
2025-10-01T14:10:30.927177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:30.927478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:30.927513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:30.927743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:30.927794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.927799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.927800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.927801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.927802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.927803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.927804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.927805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.927805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.927806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.927807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.927808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.927809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.927810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.927813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.927820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.927822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.927825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.927827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.927830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.927832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.927834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.927837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.927839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.927841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.927843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.927846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.927848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.927853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.927858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:30.927862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.927865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:30.927868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.927872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:30.927875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.927878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:30.927881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.927884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:30.927889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.927892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:30.927895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.927898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:30.927900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.927904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:30.927906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.927910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:30.927913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.927916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.927920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.927923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.927926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.927929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.927932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.927936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:30.927941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.927945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:30.927988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:30.932028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:30.932646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:30.932660Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:30.932662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:30.932665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:30.932671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1115 [2:7556255494492757818:8267]
2025-10-01T14:10:30.932683Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:30.932697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:30.932699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.932702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.932704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.932730Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:30.932739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:30.932744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:30.932791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.932797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.932799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.932802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:30.932804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:30.932864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:30.932872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.932882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:30.932892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:30.932910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:30.932930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869635582:9543], now have 1 active actors on pipe
2025-10-01T14:10:30.932938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255496869635396:2446], now have 1 active actors on pipe
2025-10-01T14:10:30.932947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255494492757813:8267]
2025-10-01T14:10:30.932952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255494492757813:8267]
2025-10-01T14:10:30.932953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255494492757813:8267]
2025-10-01T14:10:30.932964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:30.932979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:30.932982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:30.932985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:30.932987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:30.932990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:30.932993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:30.933019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255494492757813:8267]
2025-10-01T14:10:30.933023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:30.933031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:30.933024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1115
2025-10-01T14:10:30.933050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1115
2025-10-01T14:10:30.933096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.933106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.933133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:30.933143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:30.933147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:30.933154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:30.933164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:30.933172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:30.933190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.933343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.933351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.933364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:30.933464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1116 partition: 0 MaxSeqNo: 45 sessionId: src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0
2025-10-01T14:10:30.933862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473c288-ff83a743-95d506c6-f640b1f6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:30.936692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0] Write session: try to update token
2025-10-01T14:10:30.936730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:30.952081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1116 sessionId: src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:30.954645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:30.955106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:30.955140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:30.955163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:30.955172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:30.955191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:30.955201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:30.955210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255494492757813:8267]
2025-10-01T14:10:30.955216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255494492757813:8267]
2025-10-01T14:10:30.955220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255494492757813:8267]
2025-10-01T14:10:30.955253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:30.955264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:30.955269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:30.955283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:30.955295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:30.955297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:30.955436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:31.001630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255501164602892:9460]
2025-10-01T14:10:31.001869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1115, pipe: [1:7556255501164602892:9460]
2025-10-01T14:10:31.100318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:31.100824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:31.100877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164602892:9460], now have 1 active actors on pipe
2025-10-01T14:10:31.100988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:31.101087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:31.101095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:31.101172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1116 reason: error at write: Disconnected sessionId: src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0
2025-10-01T14:10:31.101335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:31.101367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1116 sessionId: src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0 is DEAD
2025-10-01T14:10:31.101402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255501164602892:9460]
2025-10-01T14:10:31.101499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:31.101506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0] Write session will restart in 0.009565s
2025-10-01T14:10:31.101524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0] Write session: Do CDS request
2025-10-01T14:10:31.101532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:31.112008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.112081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:31.112106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1117
2025-10-01T14:10:31.112259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.112310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:31.112322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:31.112328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:31.112831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1117 sessionId:  describe result for acl check
2025-10-01T14:10:31.112891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:31.112899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:31.112901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:31.112907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255501164603030:9547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:31.113448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255501164603030:9547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:31.115689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255501164603030:9547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:31.115796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:31.120539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:31.120819Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:31.120830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:31.120844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:31.120897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:31.120959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255498787725337:8279]
2025-10-01T14:10:31.121396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255501164603030:9547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:31.121440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255501164603030:9547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:31.121450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255501164603030:9547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:31.121469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:31.121794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:31.122140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:31.122191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:31.122527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:31.122587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.122593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.122594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.122596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.122597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.122598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.122599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.122600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.122602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.122603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.122603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.122604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.122606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.122607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.122612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.122620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.122624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.122627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.122630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.122633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.122636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.122640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.122643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.122646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.122649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.122652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.122655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.122658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.122665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.122672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.122678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.122683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.122693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.122697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.122701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.122710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.122714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.122718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.122725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.122730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.122735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.122739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.122742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.122747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.122755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.122759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.122767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.122771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.122775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.122782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.122786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.122790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.122797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.122801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.122806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.122813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.122847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:31.126762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:31.127674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:31.127687Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:31.127689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:31.127692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:31.127699Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1116 [2:7556255498787725337:8279]
2025-10-01T14:10:31.127718Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:31.127736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:31.127738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.127740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.127741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.127756Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:31.127765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:31.127771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:31.127816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.127821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.127823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.127826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:31.127828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:31.127880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:31.127886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.127898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.127911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.127928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:31.127946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603085:9547], now have 1 active actors on pipe
2025-10-01T14:10:31.127952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164602897:2446], now have 1 active actors on pipe
2025-10-01T14:10:31.127958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255498787725332:8279]
2025-10-01T14:10:31.127960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255498787725332:8279]
2025-10-01T14:10:31.127962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255498787725332:8279]
2025-10-01T14:10:31.127972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:31.127983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:31.127992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:31.127997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:31.127999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:31.128002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:31.128005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:31.128041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255498787725332:8279]
2025-10-01T14:10:31.128052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:31.128065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:31.128091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.128101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.128046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1116
2025-10-01T14:10:31.128075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1116
2025-10-01T14:10:31.128124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:31.128132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.128136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.128138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:31.128144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.128155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:31.128172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.128322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.128330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.128343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.128413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1117 partition: 0 MaxSeqNo: 45 sessionId: src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0
2025-10-01T14:10:31.128790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2cc523b-e27d5240-32b665cb-bb386bcc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:31.132247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0] Write session: try to update token
2025-10-01T14:10:31.132265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:31.139240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:31.139256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:31.139263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255498787725332:8279]
2025-10-01T14:10:31.139302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:31.139313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:31.139469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:31.139609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:31.139741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:31.139877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:31.140056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:31.140114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:31.151282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1117 sessionId: src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:31.154560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:31.154793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.154817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.154854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:31.154965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:31.159315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:31.159338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:31.159341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:31.159343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:31.159353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255498787725332:8279]
2025-10-01T14:10:31.159358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255498787725332:8279]
2025-10-01T14:10:31.159363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255498787725332:8279]
2025-10-01T14:10:31.159406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:31.159411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:31.159415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:31.159417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:31.159422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.159425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:31.159554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:31.201374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255501164603097:9460]
2025-10-01T14:10:31.201833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1116, pipe: [1:7556255501164603097:9460]
2025-10-01T14:10:31.302117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:31.309648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.309673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.309837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.309898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.309959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.310019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.310340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.310350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.310421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.310472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.310520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.310573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.310612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.310620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.310676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.310729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.310781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.310833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.310881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.310886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.310947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.310999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.311053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.311106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.311146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.311150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.311206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.311256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.311317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.311370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.311418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.311425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.311481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.311531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.311585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.311644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.311682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.311688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.311744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.311795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.311849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.311903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.311941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.311946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.312003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.312057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.312109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.312163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.312218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.312223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.312282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.312334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.312387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.312442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.312490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.312497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.312556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.312606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.312662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.312727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.312773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.312778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.312830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603097:9460], now have 1 active actors on pipe
2025-10-01T14:10:31.313030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:31.313045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:31.313068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1117 reason: error at write: Disconnected sessionId: src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0
2025-10-01T14:10:31.313179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:31.313268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255501164603097:9460]
2025-10-01T14:10:31.313268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1117 sessionId: src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0 is DEAD
2025-10-01T14:10:31.313376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:31.313419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:31.313429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0] Write session will restart in 0.005681s
2025-10-01T14:10:31.313465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0] Write session: Do CDS request
2025-10-01T14:10:31.313470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:31.319810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.320433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:31.320458Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1118
2025-10-01T14:10:31.320681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.320726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:31.320731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:31.320736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:31.321390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1118 sessionId:  describe result for acl check
2025-10-01T14:10:31.321444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:31.321457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:31.321461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:31.321475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255501164603157:9552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:31.322409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255501164603157:9552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:31.325975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255501164603157:9552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:31.327592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:31.330908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:31.331092Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:31.331102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:31.331112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:31.331156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:31.331193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255498787725534:8281]
2025-10-01T14:10:31.331242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255501164603157:9552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:31.331263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255501164603157:9552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:31.331267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255501164603157:9552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:31.331276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:31.331747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:31.332007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:31.332051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:31.332290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:31.332331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.332335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.332336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.332336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.332337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.332338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.332339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.332339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.332340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.332341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.332342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.332342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.332343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.332343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.332347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.332353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.332355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.332357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.332360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.332362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.332364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.332366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.332368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.332370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.332372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.332374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.332376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.332378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.332384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.332389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.332393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.332396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.332398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.332401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.332405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.332408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.332410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.332413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.332415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.332418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.332420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.332423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.332425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.332428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.332431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.332434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.332436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.332439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.332442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.332444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.332447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.332450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.332461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.332465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.332468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.332470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.332491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:31.336033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:31.336594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:31.336607Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:31.336609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:31.336612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:31.336616Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1117 [2:7556255498787725534:8281]
2025-10-01T14:10:31.336630Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:31.336643Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:31.336648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.336650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.336652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.336663Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:31.336667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:31.336671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:31.336710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.336726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.336727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.336730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:31.336733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:31.336788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:31.336794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.336802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.336808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.336820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:31.336836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603104:2446], now have 1 active actors on pipe
2025-10-01T14:10:31.336842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603297:9552], now have 1 active actors on pipe
2025-10-01T14:10:31.336847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255498787725529:8281]
2025-10-01T14:10:31.336851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255498787725529:8281]
2025-10-01T14:10:31.336852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255498787725529:8281]
2025-10-01T14:10:31.336860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:31.336874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:31.336873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:31.336875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:31.336877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:31.336890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:31.336893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:31.336918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255498787725529:8281]
2025-10-01T14:10:31.336924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:31.336928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:31.336899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1117
2025-10-01T14:10:31.336906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1117
2025-10-01T14:10:31.337112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.337122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.337158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac925767-15e58e52-4c35fd27-e099775d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:31.337168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.337176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.337178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:31.337184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.337192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:31.337210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.337414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.337426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.337446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.337537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1118 partition: 0 MaxSeqNo: 45 sessionId: src_id|ac925767-15e58e52-4c35fd27-e099775d_0
2025-10-01T14:10:31.338011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bee10fb3-19a3be93-176d4117-cc686a0a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ac925767-15e58e52-4c35fd27-e099775d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:31.340864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac925767-15e58e52-4c35fd27-e099775d_0] Write session: try to update token
2025-10-01T14:10:31.340881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac925767-15e58e52-4c35fd27-e099775d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:31.357630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1118 sessionId: src_id|ac925767-15e58e52-4c35fd27-e099775d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:31.359684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:31.359705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:31.359709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:31.359711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:31.359722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255498787725529:8281]
2025-10-01T14:10:31.359727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255498787725529:8281]
2025-10-01T14:10:31.359731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255498787725529:8281]
2025-10-01T14:10:31.359789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:31.359800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.359798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:31.359803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:31.359808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:31.359814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:31.359953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:31.360952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:31.413320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255501164603315:9460]
2025-10-01T14:10:31.413609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1117, pipe: [1:7556255501164603315:9460]
2025-10-01T14:10:31.500710Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:31.501004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.501027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.501092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603315:9460], now have 1 active actors on pipe
2025-10-01T14:10:31.501334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:31.501395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:31.501399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255501164603315:9460]
2025-10-01T14:10:31.501426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:31.501517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1118 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ac925767-15e58e52-4c35fd27-e099775d_0
2025-10-01T14:10:31.501723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1118 sessionId: src_id|ac925767-15e58e52-4c35fd27-e099775d_0 is DEAD
2025-10-01T14:10:31.501874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac925767-15e58e52-4c35fd27-e099775d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:31.501899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac925767-15e58e52-4c35fd27-e099775d_0] Write session will restart in 0.007205s
2025-10-01T14:10:31.501930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac925767-15e58e52-4c35fd27-e099775d_0] Write session: Do CDS request
2025-10-01T14:10:31.501935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac925767-15e58e52-4c35fd27-e099775d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:31.509945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac925767-15e58e52-4c35fd27-e099775d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.510060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:31.510081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1119
2025-10-01T14:10:31.510235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.510270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:31.510280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:31.510284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:31.510850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1119 sessionId:  describe result for acl check
2025-10-01T14:10:31.510895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:31.510902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:31.510903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:31.510908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255501164603412:9556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:31.511471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255501164603412:9556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:31.513623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255501164603412:9556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:31.514990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:31.518320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:31.518511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255501164603412:9556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:31.518530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255501164603412:9556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:31.518532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255501164603412:9556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:31.518539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:31.518789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:31.518805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:31.518818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:31.518881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:31.518920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255498787725733:8284]
2025-10-01T14:10:31.519482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:31.519807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:31.519855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:31.520136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:31.520201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.520207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.520208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.520209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.520210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.520211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.520213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.520214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.520215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.520216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.520217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.520218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.520219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.520220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.520226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.520235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.520238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.520242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.520246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.520253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.520257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.520262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.520265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.520273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.520276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.520280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.520287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.520290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.520297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.520309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.520319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.520324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.520332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.520337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.520349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.520353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.520358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.520363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.520367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.520373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.520378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.520383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.520387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.520392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.520400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.520405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.520414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.520418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.520422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.520430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.520433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.520439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.520446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.520454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.520458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.520466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.520501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:31.524292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:31.524967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:31.524984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:31.524987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:31.524990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:31.524996Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1118 [2:7556255498787725733:8284]
2025-10-01T14:10:31.525013Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:31.525029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:31.525037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.525041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.525045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.525062Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:31.525072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:31.525077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:31.525139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.525145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.525148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.525151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:31.525154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:31.525226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:31.525262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.525274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.525283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.525297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:31.525321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603318:2446], now have 1 active actors on pipe
2025-10-01T14:10:31.525329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603512:9556], now have 1 active actors on pipe
2025-10-01T14:10:31.525336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255498787725728:8284]
2025-10-01T14:10:31.525338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255498787725728:8284]
2025-10-01T14:10:31.525340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255498787725728:8284]
2025-10-01T14:10:31.525363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:31.525367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:31.525371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:31.525372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:31.525388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:31.525403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:31.525406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:31.525438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255498787725728:8284]
2025-10-01T14:10:31.525448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:31.525413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1118
2025-10-01T14:10:31.525420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1118
2025-10-01T14:10:31.525478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:31.525489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.525494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.525524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:31.525536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.525540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.525544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:31.525554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.525566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:31.525585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.525772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.525783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.525797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.525893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1119 partition: 0 MaxSeqNo: 45 sessionId: src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0
2025-10-01T14:10:31.526253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac925767-15e58e52-4c35fd27-e099775d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:31.529218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0] Write session: try to update token
2025-10-01T14:10:31.529238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:31.546196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1119 sessionId: src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:31.548420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:31.548443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:31.548446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:31.548448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:31.548459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255498787725728:8284]
2025-10-01T14:10:31.548465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255498787725728:8284]
2025-10-01T14:10:31.548469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255498787725728:8284]
2025-10-01T14:10:31.548522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:31.548534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:31.548540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:31.548545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:31.548548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.548550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:31.548728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:31.549424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:31.601728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255501164603525:9460]
2025-10-01T14:10:31.602074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1118, pipe: [1:7556255501164603525:9460]
2025-10-01T14:10:31.702070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:31.702830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.702851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.702893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603525:9460], now have 1 active actors on pipe
2025-10-01T14:10:31.703125Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:31.703285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:31.703285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255501164603525:9460]
2025-10-01T14:10:31.703310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:31.703408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1119 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0
2025-10-01T14:10:31.703594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1119 sessionId: src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0 is DEAD
2025-10-01T14:10:31.703756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:31.703768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0] Write session will restart in 0.007900s
2025-10-01T14:10:31.703794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0] Write session: Do CDS request
2025-10-01T14:10:31.703800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:31.712977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.713011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:31.713032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1120
2025-10-01T14:10:31.713303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.713340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:31.713363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:31.713367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:31.713880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1120 sessionId:  describe result for acl check
2025-10-01T14:10:31.713919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:31.713925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:31.713927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:31.713933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255501164603596:9560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:31.714555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255501164603596:9560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:31.716920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255501164603596:9560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:31.719264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:31.719642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255501164603596:9560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:31.719668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255501164603596:9560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:31.719673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255501164603596:9560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:31.719681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:31.722769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:31.722990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:31.723001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:31.723010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:31.723059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:31.723105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255498787725945:8287]
2025-10-01T14:10:31.723599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:31.723889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:31.723921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:31.724198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:31.724242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.724246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.724247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.724248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.724249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.724250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.724250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.724251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.724252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.724252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.724253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.724254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.724255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.724255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.724259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.724266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.724269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.724271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.724273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.724275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.724277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.724280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.724282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.724285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.724287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.724289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.724291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.724293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.724299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.724303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.724308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.724314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.724318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.724323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.724328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.724333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.724338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.724343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.724348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.724354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.724359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.724364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.724369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.724372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.724375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.724378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.724381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.724384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.724387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.724390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.724393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.724396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.724399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.724402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.724404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.724411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.724435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:31.728555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:31.729378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:31.729391Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:31.729393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:31.729397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:31.729403Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1119 [2:7556255498787725945:8287]
2025-10-01T14:10:31.729417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:31.729433Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:31.729437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.729441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.729448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.729464Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:31.729475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:31.729483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:31.730159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.730168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.730170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.730172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:31.730174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:31.730246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:31.730255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.730267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.730280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.730302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:31.730319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603527:2446], now have 1 active actors on pipe
2025-10-01T14:10:31.730325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603722:9560], now have 1 active actors on pipe
2025-10-01T14:10:31.730332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255498787725939:8287]
2025-10-01T14:10:31.730335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255498787725939:8287]
2025-10-01T14:10:31.730337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255498787725939:8287]
2025-10-01T14:10:31.730355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:31.730391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:31.730402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:31.730413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:31.730414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:31.730416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:31.730417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:31.730445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255498787725939:8287]
2025-10-01T14:10:31.730457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:31.730461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:31.730446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1119
2025-10-01T14:10:31.730506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1119
2025-10-01T14:10:31.730582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.730589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.730608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:31.730617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.730623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.730625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:31.730633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.730646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:31.730661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.730859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.730870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.730884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.730972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1120 partition: 0 MaxSeqNo: 45 sessionId: src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0
2025-10-01T14:10:31.731339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f10b0a-514ba8eb-ef17eeb7-1b75bb09_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:31.734489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0] Write session: try to update token
2025-10-01T14:10:31.734506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:31.742862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:31.742889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:31.742900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255498787725939:8287]
2025-10-01T14:10:31.742950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:31.742952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:31.743159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:31.743327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:31.743478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:31.743653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:31.743892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:31.743940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:31.752976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1120 sessionId: src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:31.756033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:31.756256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.756283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.756323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:31.756406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:31.763720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:31.763745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:31.763748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:31.763751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:31.763761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255498787725939:8287]
2025-10-01T14:10:31.763766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255498787725939:8287]
2025-10-01T14:10:31.763770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255498787725939:8287]
2025-10-01T14:10:31.763821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:31.763824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:31.763830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:31.763832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.763834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:31.763835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:31.764001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:31.803459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255501164603736:9460]
2025-10-01T14:10:31.803732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1119, pipe: [1:7556255501164603736:9460]
2025-10-01T14:10:31.902439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:31.910694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.910722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.910872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.910933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.910999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.911062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.911109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.911117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.911183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.911243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.911310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.911385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.911442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.911450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.911515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.911580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.911645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.911706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.911751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.911761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.911836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.911905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.911967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.912044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.912094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.912103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.912166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.912230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.912294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.912371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.912418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.912425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.912486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.912544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.912607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.912672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.912747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.912754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.912818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.912887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.912959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.913023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.913071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.913080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.913147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.913207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.913266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.913328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.913381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.913387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.913449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.913512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.913575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.913638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.913683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.913689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.913753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:31.913817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:31.913874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:31.913938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:31.913985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:31.913992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:31.914043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603736:9460], now have 1 active actors on pipe
2025-10-01T14:10:31.914333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:31.914359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:31.914363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:31.914409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1120 reason: error at write: Disconnected sessionId: src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0
2025-10-01T14:10:31.914418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255501164603736:9460]
2025-10-01T14:10:31.914706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1120 sessionId: src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0 is DEAD
2025-10-01T14:10:31.914898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:31.916557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:31.916572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0] Write session will restart in 0.008331s
2025-10-01T14:10:31.916601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0] Write session: Do CDS request
2025-10-01T14:10:31.916607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:31.926041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.926162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:31.926194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1121
2025-10-01T14:10:31.926361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:31.926399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:31.926404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:31.926410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:31.926878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1121 sessionId:  describe result for acl check
2025-10-01T14:10:31.926912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:31.926919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:31.926921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:31.926926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255501164603872:9573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:31.927511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255501164603872:9573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:31.930016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255501164603872:9573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:31.932165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:31.937491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:31.937848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:31.937862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:31.937876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:31.937944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:31.937992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255498787726153:8292]
2025-10-01T14:10:31.938147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255501164603872:9573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:31.938169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255501164603872:9573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:31.938172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255501164603872:9573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:31.938180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:31.938606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:31.939058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:31.939152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:31.939569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:31.939664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.939665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.939666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.939668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.939669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.939670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.939672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.939674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.939675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.939676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.939677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.939679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.939681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.939682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.939690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.939700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.939703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.939706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.939710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.939714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.939717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.939720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.939723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.939727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.939730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.939733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.939736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.939739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.939751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.939759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:31.939765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.939769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:31.939776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.939781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:31.939785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.939790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:31.939795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.939800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:31.939805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.939809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:31.939814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.939819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:31.939823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.939827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:31.939832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.939837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:31.939841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.939845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.939851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.939858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.939862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.939866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.939871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.939876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:31.939880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.939884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:31.939923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:31.949198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:31.949921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:31.949937Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:31.949939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:31.949943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:31.949950Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1120 [2:7556255498787726153:8292]
2025-10-01T14:10:31.949964Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:31.949980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:31.949983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.949985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.949987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.950000Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:31.950004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:31.950009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:31.950070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.950080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.950082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.950086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:31.950088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:31.950361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1120
2025-10-01T14:10:31.950408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1120
2025-10-01T14:10:31.950151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:31.950157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.950166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:31.950172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:31.950180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:31.950193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255498787726148:8292]
2025-10-01T14:10:31.950195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255498787726148:8292]
2025-10-01T14:10:31.950197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255498787726148:8292]
2025-10-01T14:10:31.950204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:31.950213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:31.950222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:31.950224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:31.950224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:31.950228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:31.950232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:31.950254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255498787726148:8292]
2025-10-01T14:10:31.950256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:31.950263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603774:2446], now have 1 active actors on pipe
2025-10-01T14:10:31.950264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:31.950266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255501164603968:9573], now have 1 active actors on pipe
2025-10-01T14:10:31.950968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.950982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.951019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:31.951028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:31.951033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:31.951035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:31.951046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:31.951059Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:31.951073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.951671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.951684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.951707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:31.951806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1121 partition: 0 MaxSeqNo: 45 sessionId: src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0
2025-10-01T14:10:31.952241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb35075-63aa5ad3-9f364460-7d6dca4a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:31.955399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0] Write session: try to update token
2025-10-01T14:10:31.955417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:31.964918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:31.964939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:31.964950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255498787726148:8292]
2025-10-01T14:10:31.964996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:31.965167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:31.965311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:31.965450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:31.965584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:31.965783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:31.965816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:31.966032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:31.980897Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1121 sessionId: src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:31.983741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:31.984913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:31.984942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:31.985002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:31.985271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:31.995454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:31.995487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:31.995490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:31.995493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:31.995505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255498787726148:8292]
2025-10-01T14:10:31.995515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255498787726148:8292]
2025-10-01T14:10:31.995519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255498787726148:8292]
2025-10-01T14:10:31.995585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:31.995585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:31.995593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:31.995597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:31.995600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:31.995603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:31.995767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:32.014313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255505459571276:9460]
2025-10-01T14:10:32.014938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1120, pipe: [1:7556255505459571276:9460]
2025-10-01T14:10:32.144136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:32.155650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.155700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.155932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.156023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.156110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.156189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.156254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.156259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.156360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.156437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.156520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.156601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.156655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.156658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.156755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.156824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.156897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.156971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.157027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.157031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.157123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.157196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.157273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.157347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.157401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.157404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.157486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.157567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.157645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.157719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.157766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.157769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.157850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.157930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.158016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.158098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.158156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.158160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.158245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.158315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.160308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:32.160374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:32.160376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:32.160412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1121 reason: error at write: Disconnected sessionId: src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0
2025-10-01T14:10:32.160657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1121 sessionId: src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0 is DEAD
2025-10-01T14:10:32.160946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:32.160959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0] Write session will restart in 0.005135s
2025-10-01T14:10:32.160990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0] Write session: Do CDS request
2025-10-01T14:10:32.158623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.160997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:32.158715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.158769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.158772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.158857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.158927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.159005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.159089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.159149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.159153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.159249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.159330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.159407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.159484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.159559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.159562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.159657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.159738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.159824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.159908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.159970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.159974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.160062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571276:9460], now have 1 active actors on pipe
2025-10-01T14:10:32.161246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255505459571276:9460]
2025-10-01T14:10:32.162313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:32.166901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:32.167338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:32.167360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1122
2025-10-01T14:10:32.167528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:32.167554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:32.167558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:32.167561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:32.168076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1122 sessionId:  describe result for acl check
2025-10-01T14:10:32.168144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:32.168151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:32.168153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:32.168159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255505459571300:9579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:32.168734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255505459571300:9579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:32.173347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255505459571300:9579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:32.180155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255505459571300:9579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:32.180179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255505459571300:9579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:32.180182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255505459571300:9579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:32.180205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:32.186610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:32.192392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:32.192711Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:32.192740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:32.192756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:32.192835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:32.192888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255503082693680:8304]
2025-10-01T14:10:32.193493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:32.193964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:32.194030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:32.194404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:32.194505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.194513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.194514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.194515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.194517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.194518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.194519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.194521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.194522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.194524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.194525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.194526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.194528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.194529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.194535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.194545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.194549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.194553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.194557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.194562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.194565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.194569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.194573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.194579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.194582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.194586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.194590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.194594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.194602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.194609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.194616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.194621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.194625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.194630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.194635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.194641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.194645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.194651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.194655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.194661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.194666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.194672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.194682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.194687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.194698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.194703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.194723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.194728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.194739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.194748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.194754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.194764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.194769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.194779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.194784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.194793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.194833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:32.200827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:32.202022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:32.202045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:32.202048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:32.202053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:32.202060Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1121 [2:7556255503082693680:8304]
2025-10-01T14:10:32.202079Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:32.202099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:32.202108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:32.202112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:32.202114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:32.202132Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:32.202143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:32.202150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:32.202225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.202233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.202236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.202240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:32.202243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:32.202325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:32.202334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.202349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.202365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.202404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:32.202425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255503082693674:8304]
2025-10-01T14:10:32.202432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255503082693674:8304]
2025-10-01T14:10:32.202434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255503082693674:8304]
2025-10-01T14:10:32.202446Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:32.202461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:32.202464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:32.202478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:32.202480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:32.202481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:32.202483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:32.202496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571427:9579], now have 1 active actors on pipe
2025-10-01T14:10:32.202500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571285:2446], now have 1 active actors on pipe
2025-10-01T14:10:32.202544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255503082693674:8304]
2025-10-01T14:10:32.202557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:32.202602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:32.204322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1121
2025-10-01T14:10:32.204328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1121
2025-10-01T14:10:32.204542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.204561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.204600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:32.204618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:32.204624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:32.204628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:32.204640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:32.204655Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:32.204677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:32.204997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.205010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.205029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:32.205152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1122 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0
2025-10-01T14:10:32.206499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99cf89fb-6007ebbd-11743aa1-d4e20bcf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:32.209077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0] Write session: try to update token
2025-10-01T14:10:32.209095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:32.218511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:32.218536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:32.218547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255503082693674:8304]
2025-10-01T14:10:32.218599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:32.218602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:32.218780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:32.218933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:32.219071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:32.219211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:32.219423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:32.219466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:32.224912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1122 sessionId: src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:32.227462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:32.227679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.227705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.227744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:32.227824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:32.242204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:32.242230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:32.242233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:32.242235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:32.242246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255503082693674:8304]
2025-10-01T14:10:32.242254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255503082693674:8304]
2025-10-01T14:10:32.242259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255503082693674:8304]
2025-10-01T14:10:32.242314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:32.242321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.242324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:32.242516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:32.242950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:32.242963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:32.242967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:32.261985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255505459571492:9460]
2025-10-01T14:10:32.262455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1121, pipe: [1:7556255505459571492:9460]
2025-10-01T14:10:32.391171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:32.402164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.402209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.402442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.402526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.402607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.402685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.402747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.402761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.402854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.402937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.403014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.403103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.403166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.403175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.403266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.403346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.403430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.403516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.403575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.403583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.403668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.403748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.403827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.403908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.403972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.403980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.404071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.404156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.404245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.404333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.404391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.404399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.404492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.404577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.404671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.404773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.404838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.404845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.404935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.405018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.405106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.405189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.405249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.405258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.405338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.405422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.405506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.405588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.405669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.405678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.405767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.405846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.405929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.406020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.406076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.406086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.406173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.406256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.406336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.406433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.406502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.406510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.406594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571492:9460], now have 1 active actors on pipe
2025-10-01T14:10:32.406911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:32.406966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255505459571492:9460]
2025-10-01T14:10:32.407298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:32.407318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:32.407348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1122 reason: error at write: Disconnected sessionId: src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0
2025-10-01T14:10:32.407563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1122 sessionId: src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0 is DEAD
2025-10-01T14:10:32.407718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:32.407731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0] Write session will restart in 0.007922s
2025-10-01T14:10:32.407750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0] Write session: Do CDS request
2025-10-01T14:10:32.407755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:32.408517Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:32.416959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:32.417046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:32.417062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1123
2025-10-01T14:10:32.417289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:32.417318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:32.417334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:32.417340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:32.417810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1123 sessionId:  describe result for acl check
2025-10-01T14:10:32.417862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:32.417869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:32.417871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:32.417874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255505459571565:9584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:32.418328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255505459571565:9584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:32.421045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255505459571565:9584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:32.423500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255505459571565:9584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:32.423525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255505459571565:9584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:32.423527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255505459571565:9584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:32.423533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:32.423872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:32.428064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:32.428321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:32.428335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:32.428346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:32.428406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:32.428456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255503082693884:8306]
2025-10-01T14:10:32.429106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:32.429421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:32.429468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:32.429801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:32.429881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.429887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.429889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.429890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.429892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.429893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.429894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.429896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.429897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.429898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.429899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.429900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.429901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.429903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.429908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.429918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.429921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.429924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.429928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.429932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.429936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.429940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.429943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.429948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.429951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.429954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.429957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.429961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.429969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.429977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.429983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.429989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.429999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.430004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.430013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.430018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.430024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.430029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.430044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.430049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.430054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.430060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.430065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.430069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.430074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.430079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.430083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.430088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.430095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.430100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.430105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.430114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.430119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.430125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.430135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.430140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.430179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:32.434700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:32.435821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:32.435840Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:32.435843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:32.435847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:32.435854Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1122 [2:7556255503082693884:8306]
2025-10-01T14:10:32.435872Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:32.435889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:32.435899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:32.435903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:32.435906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:32.435924Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:32.435936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:32.435943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:32.436014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.436024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.436026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.436029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:32.436032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:32.436103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:32.436113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.436137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.436152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.436174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:32.436198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571502:2446], now have 1 active actors on pipe
2025-10-01T14:10:32.436202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571699:9584], now have 1 active actors on pipe
2025-10-01T14:10:32.436209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255503082693877:8306]
2025-10-01T14:10:32.436212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255503082693877:8306]
2025-10-01T14:10:32.436214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255503082693877:8306]
2025-10-01T14:10:32.436227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:32.436241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:32.436259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:32.436264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:32.436268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:32.436269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:32.436270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:32.436310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255503082693877:8306]
2025-10-01T14:10:32.436324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:32.436323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1122
2025-10-01T14:10:32.436348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:32.436361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.436369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1122
2025-10-01T14:10:32.436365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.436391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:32.436398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:32.436402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:32.436404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:32.436415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:32.436423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:32.436442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:32.436576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.436586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.436599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:32.436653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1123 partition: 0 MaxSeqNo: 45 sessionId: src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0
2025-10-01T14:10:32.437078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b56b8d6-99719bb2-52fc58ce-629a6c99_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:32.439538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0] Write session: try to update token
2025-10-01T14:10:32.439556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:32.453494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1123 sessionId: src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:32.456163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:32.456374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.456410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.456442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:32.456508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:32.462523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:32.462549Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:32.462554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:32.462556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:32.462567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255503082693877:8306]
2025-10-01T14:10:32.462587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255503082693877:8306]
2025-10-01T14:10:32.462593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255503082693877:8306]
2025-10-01T14:10:32.462655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:32.462670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.462673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:32.462876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:32.466446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:32.466473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:32.466479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:32.506961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255505459571712:9460]
2025-10-01T14:10:32.509694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1122, pipe: [1:7556255505459571712:9460]
2025-10-01T14:10:32.616417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:32.628908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.628947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.629166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.629249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.629336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.629424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.629493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.629508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.629602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.629684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.629767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.629857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.629917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.629925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.630002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.630079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.630159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.630238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.630313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.630321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.630415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.630497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.630576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.630653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.630722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.630731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.630811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.630886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.630962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.631041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.631094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.631102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.631185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.631265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.631353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.631437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.631618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.631627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.631708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.631790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.631877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.631958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.632123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.632131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.632208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.632281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.632361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.632440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.632776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.632799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.632901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.632969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.633032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.633104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.633150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.633157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.633231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:32.633289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:32.633361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:32.633424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:32.633472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:32.633479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:32.633574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571712:9460], now have 1 active actors on pipe
2025-10-01T14:10:32.633807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:32.633814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:32.633826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:32.633861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1123 reason: error at write: Disconnected sessionId: src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0
2025-10-01T14:10:32.633880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255505459571712:9460]
2025-10-01T14:10:32.634102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1123 sessionId: src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0 is DEAD
2025-10-01T14:10:32.634248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:32.634258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0] Write session will restart in 0.006420s
2025-10-01T14:10:32.634277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0] Write session: Do CDS request
2025-10-01T14:10:32.634281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:32.635001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:32.641912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:32.642045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:32.642068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1124
2025-10-01T14:10:32.642180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:32.642213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:32.642226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:32.642230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:32.642697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1124 sessionId:  describe result for acl check
2025-10-01T14:10:32.642736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:32.642742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:32.642745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:32.642750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255505459571777:9588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:32.643297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255505459571777:9588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:32.646309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255505459571777:9588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:32.651491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255505459571777:9588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:32.651508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255505459571777:9588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:32.651510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255505459571777:9588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:32.651521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:32.651553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:32.652161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:32.652332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:32.652345Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:32.652356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:32.652399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:32.652441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255503082694087:8309]
2025-10-01T14:10:32.653100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:32.653374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:32.653418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:32.653750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:32.653811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.653819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.653821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.653822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.653824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.653825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.653826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.653828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.653829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.653830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.653832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.653833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.653835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.653836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.653841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.653852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.653857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.653862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.653867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.653872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.653876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.653881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.653885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.653890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.653894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.653905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.653909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.653913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.653920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.653934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.653945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.653952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.653963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.653969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.653979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.653985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.653995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.654000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.654021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.654032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.654037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.654047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.654052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.654063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.654068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.654078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.654083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.654089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.654096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.654107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.654111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.654122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.654127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.654137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.654142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.654153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.654194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:32.658013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:32.658658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:32.658679Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:32.658682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:32.658687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:32.658695Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1123 [2:7556255503082694087:8309]
2025-10-01T14:10:32.658712Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:32.658728Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:32.658732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:32.658738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:32.658747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:32.658764Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:32.658776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:32.658783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:32.658843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.658852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.658854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.658858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:32.658861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:32.658935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:32.658947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.658959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.658972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.658996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:32.659026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571913:9588], now have 1 active actors on pipe
2025-10-01T14:10:32.659030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571715:2446], now have 1 active actors on pipe
2025-10-01T14:10:32.659038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255503082694081:8309]
2025-10-01T14:10:32.659041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255503082694081:8309]
2025-10-01T14:10:32.659043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255503082694081:8309]
2025-10-01T14:10:32.659058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:32.659069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:32.659072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:32.659072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:32.659073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:32.659087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:32.659095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:32.659095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1123
2025-10-01T14:10:32.659129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255503082694081:8309]
2025-10-01T14:10:32.659140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:32.659097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1123
2025-10-01T14:10:32.659144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:32.659163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.659168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.659215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1321e43e-6618783a-f5ed2358-624e9e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:32.659227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:32.659232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:32.659235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:32.659244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:32.659252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:32.659278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:32.659452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.659460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.659478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:32.659568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1124 partition: 0 MaxSeqNo: 45 sessionId: src_id|1321e43e-6618783a-f5ed2358-624e9e9_0
2025-10-01T14:10:32.659960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e0e3599-e6449bb2-171f07f3-8c1c15b5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1321e43e-6618783a-f5ed2358-624e9e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:32.662620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1321e43e-6618783a-f5ed2358-624e9e9_0] Write session: try to update token
2025-10-01T14:10:32.662640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1321e43e-6618783a-f5ed2358-624e9e9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:32.680092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:32.680111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:32.680112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:32.680114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:32.680123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255503082694081:8309]
2025-10-01T14:10:32.680127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255503082694081:8309]
2025-10-01T14:10:32.680131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255503082694081:8309]
2025-10-01T14:10:32.680171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:32.680177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.680179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:32.680185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:32.680192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:32.680197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:32.680325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:32.680922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1124 sessionId: src_id|1321e43e-6618783a-f5ed2358-624e9e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:32.683244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:32.734272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255505459571927:9460]
2025-10-01T14:10:32.734608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1123, pipe: [1:7556255505459571927:9460]
2025-10-01T14:10:32.825944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:32.825948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:32.825970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:32.826000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255505459571927:9460]
2025-10-01T14:10:32.826034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1124 reason: error at write: Disconnected sessionId: src_id|1321e43e-6618783a-f5ed2358-624e9e9_0
2025-10-01T14:10:32.826244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1124 sessionId: src_id|1321e43e-6618783a-f5ed2358-624e9e9_0 is DEAD
2025-10-01T14:10:32.826415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1321e43e-6618783a-f5ed2358-624e9e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:32.826427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1321e43e-6618783a-f5ed2358-624e9e9_0] Write session will restart in 0.009621s
2025-10-01T14:10:32.824917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:32.825697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.825708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.825752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571927:9460], now have 1 active actors on pipe
2025-10-01T14:10:32.826452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1321e43e-6618783a-f5ed2358-624e9e9_0] Write session: Do CDS request
2025-10-01T14:10:32.826462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1321e43e-6618783a-f5ed2358-624e9e9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:32.826463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:32.836880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1321e43e-6618783a-f5ed2358-624e9e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:32.837001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:32.837021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1125
2025-10-01T14:10:32.837120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:32.837151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:32.837173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:32.837176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:32.837619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1125 sessionId:  describe result for acl check
2025-10-01T14:10:32.837658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:32.837665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:32.837667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:32.837673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255505459572014:9594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:32.838169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255505459572014:9594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:32.840129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255505459572014:9594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:32.854811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:32.854756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255505459572014:9594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:32.854787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255505459572014:9594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:32.854792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255505459572014:9594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:32.854810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:32.866283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:32.866901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:32.866913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:32.866928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:32.867003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:32.867046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255503082694302:8312]
2025-10-01T14:10:32.867756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:32.868092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:32.868135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:32.868508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:32.868579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.868581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.868582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.868584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.868585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.868587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.868588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.868589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.868590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.868592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.868593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.868594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.868595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.868597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.868603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.868613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.868617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.868621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.868624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.868628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.868631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.868635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.868638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.868642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.868646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.868649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.868653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.868656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.868663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.868670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:32.868676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.868681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:32.868685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.868690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:32.868694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.868698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:32.868706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.868711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:32.868728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.868733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:32.868737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.868742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:32.868747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.868752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:32.868756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.868761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:32.868765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.868771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.868776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.868782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.868786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.868792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.868797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.868802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:32.868809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.868814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:32.868852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:32.874851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:32.875724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:32.875738Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:32.875742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:32.875747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:32.875755Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1124 [2:7556255503082694302:8312]
2025-10-01T14:10:32.875773Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:32.875792Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:32.875795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:32.875799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:32.875801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:32.875818Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:32.875823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:32.875830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:32.875906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.875912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.875915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.875919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:32.875922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:32.876006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:32.876009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.876021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:32.876031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:32.876045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:32.876063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255503082694296:8312]
2025-10-01T14:10:32.876065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255503082694296:8312]
2025-10-01T14:10:32.876067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255503082694296:8312]
2025-10-01T14:10:32.876077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:32.876088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:32.876092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:32.876092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:32.876094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:32.876105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:32.876108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:32.876120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459572140:9594], now have 1 active actors on pipe
2025-10-01T14:10:32.876124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459571942:2446], now have 1 active actors on pipe
2025-10-01T14:10:32.876159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255503082694296:8312]
2025-10-01T14:10:32.876166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:32.876178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:32.876679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1124
2025-10-01T14:10:32.876732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1124
2025-10-01T14:10:32.876951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.876966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.876998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:32.877006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:32.877010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:32.877013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:32.877026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:32.877039Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:32.877055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:32.877503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.877511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.877525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:32.877652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1125 partition: 0 MaxSeqNo: 45 sessionId: src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0
2025-10-01T14:10:32.878709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1321e43e-6618783a-f5ed2358-624e9e9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:32.882113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0] Write session: try to update token
2025-10-01T14:10:32.882139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:32.906669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1125 sessionId: src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:32.909569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:32.909794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:32.909815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:32.909849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:32.909976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:32.915281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:32.915304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:32.915307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:32.915309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:32.915318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255503082694296:8312]
2025-10-01T14:10:32.915323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255503082694296:8312]
2025-10-01T14:10:32.915327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255503082694296:8312]
2025-10-01T14:10:32.915382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:32.915395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:32.915397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:32.915406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:32.915415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:32.915419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:32.915551Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:32.926222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255505459572167:9460]
2025-10-01T14:10:32.929685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1124, pipe: [1:7556255505459572167:9460]
2025-10-01T14:10:33.063589Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:33.064487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255505459572167:9460], now have 1 active actors on pipe
2025-10-01T14:10:33.073148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.073181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.073362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.073421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.073482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.073543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.073584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.073589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.073663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.073723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.073785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.073847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.073895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.073898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.073965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.074023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.074083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.074142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.074191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.074195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.074257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.074316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.074411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.074467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.074507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.074511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.074569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.074627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.074682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.074735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.074788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.074791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.074857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.074912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.074974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.075035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.075077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.075080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.075151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.075208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.075272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.075330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.075476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.075479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.075544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.075599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.075655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.075719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.075818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.075821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.075890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.075949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.076010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.076116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.076163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.076166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.076239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.076308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.076377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.076481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.076585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.076591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.079185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:33.079187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255505459572167:9460]
2025-10-01T14:10:33.079205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:33.079209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:33.079233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1125 reason: error at write: Disconnected sessionId: src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0
2025-10-01T14:10:33.079485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1125 sessionId: src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0 is DEAD
2025-10-01T14:10:33.079825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:33.079841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0] Write session will restart in 0.009525s
2025-10-01T14:10:33.079867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0] Write session: Do CDS request
2025-10-01T14:10:33.079873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:33.078719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:33.091190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:33.091255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:33.091274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1126
2025-10-01T14:10:33.094788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:33.094846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:33.094851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:33.094856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:33.095758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1126 sessionId:  describe result for acl check
2025-10-01T14:10:33.095799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:33.095801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:33.095803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:33.095809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255509754539485:9605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:33.096318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255509754539485:9605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:33.100578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255509754539485:9605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:33.110838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255509754539485:9605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:33.110861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255509754539485:9605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:33.110865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255509754539485:9605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:33.110877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:33.165301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:33.170479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:33.170800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:33.170804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:33.170817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:33.170873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:33.170911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255507377661842:8323]
2025-10-01T14:10:33.171533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:33.171992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:33.172035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:33.172361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:33.172407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.172408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.172410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.172411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.172412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.172413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.172414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.172416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.172417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.172418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.172420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.172422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.172423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.172424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.172428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.172438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.172442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.172446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.172449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.172453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.172457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.172460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.172463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.172467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.172470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.172474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.172477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.172481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.172489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.172496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.172502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.172507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.172512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.172517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.172522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.172527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.172531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.172537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.172542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.172548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.172553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.172558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.172563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.172568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.172573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.172580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.172585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.172590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.172596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.172600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.172605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.172610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.172614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.172619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.172623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.172628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.172670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:33.179331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:33.179942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:33.179958Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:33.179961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:33.179966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:33.179973Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1125 [2:7556255507377661842:8323]
2025-10-01T14:10:33.179991Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:33.180010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:33.180014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:33.180017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:33.180020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:33.180038Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:33.180051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:33.180059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:33.180113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.180119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.180122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.180126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:33.180128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:33.180194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:33.180200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.180213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.180229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.180250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:33.180272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255507377661837:8323]
2025-10-01T14:10:33.180278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255507377661837:8323]
2025-10-01T14:10:33.180280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255507377661837:8323]
2025-10-01T14:10:33.180406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255509754539682:9460]
2025-10-01T14:10:33.180295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:33.180313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:33.180326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:33.180329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:33.180329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:33.180331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:33.180333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:33.180370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255507377661837:8323]
2025-10-01T14:10:33.180372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:33.180407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:33.180506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754539532:9605], now have 1 active actors on pipe
2025-10-01T14:10:33.180511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754539475:2446], now have 1 active actors on pipe
2025-10-01T14:10:33.180986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1125
2025-10-01T14:10:33.181013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1125
2025-10-01T14:10:33.181209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.181222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.181240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754539682:9460], now have 1 active actors on pipe
2025-10-01T14:10:33.181255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e92e8312-76ef9482-7140d127-be1547d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:33.181263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:33.181267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:33.181269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:33.181278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:33.181288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:33.181304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:33.181978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1125, pipe: [1:7556255509754539682:9460]
2025-10-01T14:10:33.182175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.182183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.182201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:33.182335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1126 partition: 0 MaxSeqNo: 45 sessionId: src_id|e92e8312-76ef9482-7140d127-be1547d0_0
2025-10-01T14:10:33.186570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72b5c648-71fc90c9-342e49c5-3136cdd0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e92e8312-76ef9482-7140d127-be1547d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:33.189142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e92e8312-76ef9482-7140d127-be1547d0_0] Write session: try to update token
2025-10-01T14:10:33.189161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e92e8312-76ef9482-7140d127-be1547d0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:33.191896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:33.191915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:33.191926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255507377661837:8323]
2025-10-01T14:10:33.191964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:33.191970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:33.192145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:33.192288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:33.192432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:33.192575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:33.192780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:33.192810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:33.211486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1126 sessionId: src_id|e92e8312-76ef9482-7140d127-be1547d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:33.214086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:33.215743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.215768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.215808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:33.218149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:33.218167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:33.218170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:33.218172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:33.218184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255507377661837:8323]
2025-10-01T14:10:33.218189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255507377661837:8323]
2025-10-01T14:10:33.218193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255507377661837:8323]
2025-10-01T14:10:33.218237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:33.218245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.218247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:33.218398Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:33.222586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:33.222599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:33.222604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:33.222573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:33.389089Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:33.397751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.397781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.397946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.398010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.398079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.398147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.398200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.398210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.398281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.398343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.398419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.398489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.398547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.398556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.398630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.398691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.398759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.398824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.398870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.398880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.398948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.399015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.399080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.399149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.399192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.399199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.399265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.399326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.399390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.399454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.399501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.399509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.399583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.399649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.399716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.399784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.399839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.399851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.399924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.399993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.400065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.400139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.400180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.400187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.400256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.400321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.400388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.400457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.400505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.400515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.400588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.400654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.400737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.400809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.400856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.400864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.400937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:33.401008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:33.401077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:33.401141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:33.401188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:33.401196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:33.401510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:33.401524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:33.401548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:33.401549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1126 reason: error at write: Disconnected sessionId: src_id|e92e8312-76ef9482-7140d127-be1547d0_0
2025-10-01T14:10:33.401594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255509754539682:9460]
2025-10-01T14:10:33.401767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1126 sessionId: src_id|e92e8312-76ef9482-7140d127-be1547d0_0 is DEAD
2025-10-01T14:10:33.401902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92e8312-76ef9482-7140d127-be1547d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:33.401913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92e8312-76ef9482-7140d127-be1547d0_0] Write session will restart in 0.006186s
2025-10-01T14:10:33.401937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92e8312-76ef9482-7140d127-be1547d0_0] Write session: Do CDS request
2025-10-01T14:10:33.401943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92e8312-76ef9482-7140d127-be1547d0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:33.402252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:33.409034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e92e8312-76ef9482-7140d127-be1547d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:33.409079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:33.409098Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1127
2025-10-01T14:10:33.409264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:33.409294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:33.409307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:33.409311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:33.409966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1127 sessionId:  describe result for acl check
2025-10-01T14:10:33.410004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:33.410013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:33.410015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:33.410021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255509754539735:9610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:33.410542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255509754539735:9610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:33.414521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255509754539735:9610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:33.417505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:33.417751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255509754539735:9610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:33.417770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255509754539735:9610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:33.417773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255509754539735:9610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:33.417781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:33.421340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:33.421606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:33.421620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:33.421633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:33.421717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:33.421759Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255507377662048:8329]
2025-10-01T14:10:33.422324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:33.422626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:33.422680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:33.423003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:33.423085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.423093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.423094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.423095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.423096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.423097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.423098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.423099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.423101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.423102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.423103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.423104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.423106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.423107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.423113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.423123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.423127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.423131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.423135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.423139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.423142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.423146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.423148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.423152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.423155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.423159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.423162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.423165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.423173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.423180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.423187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.423192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.423195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.423199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.423203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.423207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.423211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.423215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.423219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.423225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.423230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.423235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.423239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.423244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.423250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.423256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.423260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.423265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.423270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.423281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.423290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.423300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.423308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.423313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.423321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.423329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.423367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:33.427193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:33.428321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:33.428337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:33.428340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:33.428344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:33.428352Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1126 [2:7556255507377662048:8329]
2025-10-01T14:10:33.428368Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:33.428394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:33.428397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:33.428400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:33.428403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:33.428420Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:33.428435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:33.428441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:33.428502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.428510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.428512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.428515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:33.428518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:33.428584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:33.428593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.428605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.428620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.428639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:33.428667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754539900:9610], now have 1 active actors on pipe
2025-10-01T14:10:33.428676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754539699:2446], now have 1 active actors on pipe
2025-10-01T14:10:33.428683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255507377662041:8329]
2025-10-01T14:10:33.428690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255507377662041:8329]
2025-10-01T14:10:33.428693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255507377662041:8329]
2025-10-01T14:10:33.428706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:33.428725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:33.428728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:33.428737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:33.428740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:33.428733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1126
2025-10-01T14:10:33.428755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:33.428764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:33.428744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1126
2025-10-01T14:10:33.428802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255507377662041:8329]
2025-10-01T14:10:33.428816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:33.428829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:33.428853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.428863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.428900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:33.428914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:33.428918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:33.428926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:33.428935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:33.428947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:33.428964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:33.429082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.429092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.429109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:33.429193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1127 partition: 0 MaxSeqNo: 45 sessionId: src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0
2025-10-01T14:10:33.429596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e92e8312-76ef9482-7140d127-be1547d0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:33.432051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0] Write session: try to update token
2025-10-01T14:10:33.432070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:33.446315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1127 sessionId: src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:33.449077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:33.449577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.449601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.449620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:33.449622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:33.449624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:33.449626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:33.449633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255507377662041:8329]
2025-10-01T14:10:33.449636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255507377662041:8329]
2025-10-01T14:10:33.449639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255507377662041:8329]
2025-10-01T14:10:33.449677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:33.449686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:33.449690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.449692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:33.449694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:33.449701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:33.449826Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:33.501748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255509754539913:9460]
2025-10-01T14:10:33.502003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1126, pipe: [1:7556255509754539913:9460]
2025-10-01T14:10:33.598465Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:33.599104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:33.599166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754539913:9460], now have 1 active actors on pipe
2025-10-01T14:10:33.599233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:33.599298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255509754539913:9460]
2025-10-01T14:10:33.599316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:33.599321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:33.599324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:33.599390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1127 reason: error at write: Disconnected sessionId: src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0
2025-10-01T14:10:33.599567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1127 sessionId: src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0 is DEAD
2025-10-01T14:10:33.599632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:33.599640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0] Write session will restart in 0.005154s
2025-10-01T14:10:33.599658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0] Write session: Do CDS request
2025-10-01T14:10:33.599666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:33.605782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:33.605923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:33.605939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1128
2025-10-01T14:10:33.606038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:33.606069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:33.606079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:33.606082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:33.606465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1128 sessionId:  describe result for acl check
2025-10-01T14:10:33.606495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:33.606501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:33.606503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:33.606507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255509754539947:9614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:33.606990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255509754539947:9614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:33.609228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255509754539947:9614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:33.611845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255509754539947:9614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:33.611860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255509754539947:9614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:33.611863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255509754539947:9614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:33.611872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:33.615911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:33.616410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:33.616607Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:33.616622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:33.616636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:33.616728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:33.616771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255507377662256:8332]
2025-10-01T14:10:33.617371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:33.617646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:33.617697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:33.618000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:33.618097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.618105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.618106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.618107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.618108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.618110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.618111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.618112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.618113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.618115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.618116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.618117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.618118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.618120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.618126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.618135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.618139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.618143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.618147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.618151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.618154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.618158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.618162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.618166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.618170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.618174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.618177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.618181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.618191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.618198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.618210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.618216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.618220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.618230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.618235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.618241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.618248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.618255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.618263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.618269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.618274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.618279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.618284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.618290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.618295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.618300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.618305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.618315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.618319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.618324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.618329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.618336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.618341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.618350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.618355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.618361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.618417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:33.622228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:33.622875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:33.622893Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:33.622895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:33.622899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:33.622906Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1127 [2:7556255507377662256:8332]
2025-10-01T14:10:33.622922Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:33.622939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:33.622942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:33.622946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:33.622948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:33.622966Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:33.622976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:33.622982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:33.623039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.623046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.623048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.623051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:33.623054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:33.623119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:33.623130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.623144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.623154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.623174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:33.623196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754539916:2446], now have 1 active actors on pipe
2025-10-01T14:10:33.623207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754540117:9614], now have 1 active actors on pipe
2025-10-01T14:10:33.623214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255507377662251:8332]
2025-10-01T14:10:33.623216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255507377662251:8332]
2025-10-01T14:10:33.623218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255507377662251:8332]
2025-10-01T14:10:33.623233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:33.623246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:33.623247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:33.623250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:33.623252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:33.623260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:33.623263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:33.623244Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1127
2025-10-01T14:10:33.623282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1127
2025-10-01T14:10:33.623300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255507377662251:8332]
2025-10-01T14:10:33.623308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:33.623311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:33.623337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.623345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.623374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:33.623385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:33.623389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:33.623396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:33.623404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:33.623416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:33.623435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:33.623602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.623614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.623636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:33.623715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1128 partition: 0 MaxSeqNo: 45 sessionId: src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0
2025-10-01T14:10:33.624124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58fb2f5d-9c983d4a-e5b7c817-4f9f0b85_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:33.626739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0] Write session: try to update token
2025-10-01T14:10:33.626758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:33.641306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1128 sessionId: src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:33.644126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:33.644225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:33.644246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:33.644249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:33.644251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:33.644262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255507377662251:8332]
2025-10-01T14:10:33.644266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255507377662251:8332]
2025-10-01T14:10:33.644270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255507377662251:8332]
2025-10-01T14:10:33.644299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:33.644311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:33.644316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:33.644319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:33.644327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.644334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:33.644479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:33.699466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255509754540130:9460]
2025-10-01T14:10:33.699818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1127, pipe: [1:7556255509754540130:9460]
2025-10-01T14:10:33.806959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:33.807350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.807361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.807405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754540130:9460], now have 1 active actors on pipe
2025-10-01T14:10:33.807753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:33.808030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:33.808081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:33.808150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1128 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0
2025-10-01T14:10:33.808370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1128 sessionId: src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0 is DEAD
2025-10-01T14:10:33.808526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255509754540130:9460]
2025-10-01T14:10:33.808790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:33.808801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0] Write session will restart in 0.008480s
2025-10-01T14:10:33.808829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0] Write session: Do CDS request
2025-10-01T14:10:33.808835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:33.818931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:33.822515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:33.822533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1129
2025-10-01T14:10:33.822750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:33.822779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:33.822785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:33.822788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:33.823382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1129 sessionId:  describe result for acl check
2025-10-01T14:10:33.823412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:33.823414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:33.823416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:33.823421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255509754540154:9620] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:33.823945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255509754540154:9620] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:33.829267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255509754540154:9620] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:33.839147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255509754540154:9620] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:33.839171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255509754540154:9620] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:33.839175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255509754540154:9620] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:33.839185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:33.893672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:33.901923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:33.902207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:33.902212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:33.902227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:33.902300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:33.902341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255507377662478:8335]
2025-10-01T14:10:33.902980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:33.903621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:33.903673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:33.903999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:33.904064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.904066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.904067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.904069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.904070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.904071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.904073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.904074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.904075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.904077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.904078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.904079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.904081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.904082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.904088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.904098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.904102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.904107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.904111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.904115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.904119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.904123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.904127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.904132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.904135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.904139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.904142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.904146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.904154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.904162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:33.904168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.904175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:33.904180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.904185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:33.904189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.904194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:33.904199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.904204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:33.904208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.904212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:33.904217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.904222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:33.904226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.904230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:33.904235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.904239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:33.904244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.904248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.904252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.904257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.904261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.904265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.904269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.904276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:33.904282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.904287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:33.904328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:33.909219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:33.909904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:33.909910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:33.909914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:33.909918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:33.909926Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1128 [2:7556255507377662478:8335]
2025-10-01T14:10:33.909944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:33.909963Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:33.909967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:33.909971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:33.909973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:33.909991Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:33.909998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:33.910005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:33.910074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.910076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.910078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.910082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:33.910085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:33.910161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:33.910163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.910175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:33.910187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:33.910204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:33.910220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255507377662472:8335]
2025-10-01T14:10:33.910223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255507377662472:8335]
2025-10-01T14:10:33.910225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255507377662472:8335]
2025-10-01T14:10:33.910239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:33.910259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:33.910276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:33.910279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:33.910324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255507377662472:8335]
2025-10-01T14:10:33.910327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:33.910804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255509754540356:9460]
2025-10-01T14:10:33.911125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1128
2025-10-01T14:10:33.911148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1128
2025-10-01T14:10:33.910616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:33.910624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:33.910626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:33.910631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:33.911475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1128, pipe: [1:7556255509754540356:9460]
2025-10-01T14:10:33.911530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754540190:9620], now have 1 active actors on pipe
2025-10-01T14:10:33.911540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754540135:2446], now have 1 active actors on pipe
2025-10-01T14:10:33.911556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.911564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.911582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255509754540356:9460], now have 1 active actors on pipe
2025-10-01T14:10:33.911598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:33.911608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:33.911613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:33.911615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:33.911627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:33.911640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:33.911662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:33.911938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:33.911944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:33.911956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:33.912084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1129 partition: 0 MaxSeqNo: 45 sessionId: src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0
2025-10-01T14:10:33.914660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb24faa-568b24ec-e22ad3b0-75a98f22_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:33.917315Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0] Write session: try to update token
2025-10-01T14:10:33.917340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:33.936514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:33.936536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:33.936539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:33.936542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:33.936552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255507377662472:8335]
2025-10-01T14:10:33.936556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255507377662472:8335]
2025-10-01T14:10:33.936560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255507377662472:8335]
2025-10-01T14:10:33.936610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:33.936617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:33.936620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:33.936776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:33.936024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1129 sessionId: src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:33.938673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:33.938892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:33.938905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:33.938909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:34.089200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:34.089421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.089432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.089646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:34.089663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:34.089675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255509754540356:9460]
2025-10-01T14:10:34.089682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:34.089700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:34.089711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1129 reason: error at write: Disconnected sessionId: src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0
2025-10-01T14:10:34.089869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1129 sessionId: src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0 is DEAD
2025-10-01T14:10:34.090042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:34.090050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0] Write session will restart in 0.007622s
2025-10-01T14:10:34.090074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0] Write session: Do CDS request
2025-10-01T14:10:34.090084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:34.098855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.099031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:34.099056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1130
2025-10-01T14:10:34.099179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.099216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:34.099230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:34.099238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:34.099652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1130 sessionId:  describe result for acl check
2025-10-01T14:10:34.099691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:34.099698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:34.099700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:34.099706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255514049507853:9631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:34.100227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255514049507853:9631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:34.102022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255514049507853:9631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:34.104605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:34.104944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:34.105085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:34.105092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:34.105101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:34.105133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:34.105107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255514049507853:9631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:34.105119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255514049507853:9631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:34.105121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255514049507853:9631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:34.105126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:34.105171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255511672629989:8340]
2025-10-01T14:10:34.105564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:34.105751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:34.105777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:34.106019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:34.106057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.106061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.106062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.106063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.106063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.106064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.106065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.106066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.106067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.106067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.106068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.106069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.106069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.106070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.106073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.106079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.106081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.106083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.106085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.106087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.106089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.106091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.106093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.106096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.106097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.106100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.106102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.106104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.106109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.106113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.106117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.106120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.106122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.106126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.106128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.106131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.106134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.106137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.106140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.106143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.106145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.106149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.106153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.106158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.106162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.106167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.106171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.106174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.106176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.106179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.106181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.106184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.106186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.106189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.106192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.106194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.106213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:34.109461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:34.110025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:34.110039Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:34.110041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:34.110045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:34.110052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1129 [2:7556255511672629989:8340]
2025-10-01T14:10:34.110063Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:34.110074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:34.110080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.110082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.110083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.110095Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:34.110098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:34.110102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:34.110138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.110143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.110144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.110146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:34.110148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:34.110196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:34.110201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.110208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.110216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.110229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:34.110249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049507891:9631], now have 1 active actors on pipe
2025-10-01T14:10:34.110256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049507685:2446], now have 1 active actors on pipe
2025-10-01T14:10:34.110264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255511672629984:8340]
2025-10-01T14:10:34.110270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255511672629984:8340]
2025-10-01T14:10:34.110272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255511672629984:8340]
2025-10-01T14:10:34.110283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:34.110297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:34.110298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:34.110299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:34.110301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:34.110312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:34.110313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:34.110295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1129
2025-10-01T14:10:34.110296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1129
2025-10-01T14:10:34.110336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255511672629984:8340]
2025-10-01T14:10:34.110345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:34.110349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:34.110355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.110362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.110415Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:34.110425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.110432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.110435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:34.110447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.110458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:34.110474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.110606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.110615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.110628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.110705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1130 partition: 0 MaxSeqNo: 45 sessionId: src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0
2025-10-01T14:10:34.110997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e2b01b1-3e270a2e-ec1ca78f-5fdf810c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:34.113172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0] Write session: try to update token
2025-10-01T14:10:34.113184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:34.125452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1130 sessionId: src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:34.127869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:34.128040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.128062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.128098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:34.128163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:34.130442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:34.130458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:34.130460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:34.130462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:34.130471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255511672629984:8340]
2025-10-01T14:10:34.130476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255511672629984:8340]
2025-10-01T14:10:34.130479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255511672629984:8340]
2025-10-01T14:10:34.130528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:34.130528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:34.130538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:34.130540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.130542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:34.130543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:34.130696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:34.189884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255514049507902:9460]
2025-10-01T14:10:34.190125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1129, pipe: [1:7556255514049507902:9460]
2025-10-01T14:10:34.267652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:34.275973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.276003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.276178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.276246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.276316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.276385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.276550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.276563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.276637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.276698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.276775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.276844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.276896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.276904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.276968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.277025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.277088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.277150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.277193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.277201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.277261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.277320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.277377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.277437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.277478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.277485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.277546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.277603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.277665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.277730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.277776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.277783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.277843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.277897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.277958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.278035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.278082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.278090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.278149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.278208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.278268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.278330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.278389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.278397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.278460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.278523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.278588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.278649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.278695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.278702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.278769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.278831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.278893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.278958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.279001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.279008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.279076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.279140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.279205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.279271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.279314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.279321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.279377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049507902:9460], now have 1 active actors on pipe
2025-10-01T14:10:34.279576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255514049507902:9460]
2025-10-01T14:10:34.279606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:34.279608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:34.279623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:34.279632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1130 reason: error at write: Disconnected sessionId: src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0
2025-10-01T14:10:34.279832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1130 sessionId: src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0 is DEAD
2025-10-01T14:10:34.279968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:34.279978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0] Write session will restart in 0.005217s
2025-10-01T14:10:34.280003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0] Write session: Do CDS request
2025-10-01T14:10:34.280009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:34.280370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:34.285796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.285893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:34.285908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1131
2025-10-01T14:10:34.285996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.286024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:34.286034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:34.286037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:34.286698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1131 sessionId:  describe result for acl check
2025-10-01T14:10:34.286722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:34.286726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:34.286727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:34.286732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255514049507938:9635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:34.287098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255514049507938:9635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:34.289656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255514049507938:9635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:34.291743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255514049507938:9635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:34.291758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255514049507938:9635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:34.291761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255514049507938:9635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:34.291772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:34.295932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:34.296325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:34.296509Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:34.296519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:34.296531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:34.296580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:34.296622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255511672630228:8352]
2025-10-01T14:10:34.297191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:34.297463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:34.297510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:34.297802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:34.297870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.297876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.297877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.297878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.297879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.297880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.297881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.297882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.297883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.297884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.297885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.297886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.297887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.297888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.297892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.297901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.297905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.297908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.297911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.297915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.297917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.297921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.297924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.297927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.297930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.297934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.297937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.297941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.297948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.297955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.297960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.297965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.297970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.297974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.297978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.297982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.297986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.297994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.297998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.298005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.298010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.298020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.298026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.298031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.298040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.298046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.298054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.298060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.298068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.298073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.298082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.298087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.298096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.298101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.298109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.298115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.298152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:34.301426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:34.302202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:34.302216Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:34.302218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:34.302221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:34.302228Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1130 [2:7556255511672630228:8352]
2025-10-01T14:10:34.302241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:34.302255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:34.302258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.302262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.302264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.302278Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:34.302283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:34.302289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:34.302333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.302340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.302341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.302344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:34.302346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:34.302415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:34.302421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.302432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.302442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.302459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:34.302479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508111:9635], now have 1 active actors on pipe
2025-10-01T14:10:34.302486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049507905:2446], now have 1 active actors on pipe
2025-10-01T14:10:34.302493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255511672630223:8352]
2025-10-01T14:10:34.302499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255511672630223:8352]
2025-10-01T14:10:34.302501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255511672630223:8352]
2025-10-01T14:10:34.302514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:34.302500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1130
2025-10-01T14:10:34.302530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:34.302523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1130
2025-10-01T14:10:34.302530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:34.302532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:34.302542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:34.302548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:34.302550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:34.302583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.302593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.302609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255511672630223:8352]
2025-10-01T14:10:34.302616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:34.302637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:34.302639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|582caa9b-2617625c-ea22307c-5243eb89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:34.302646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.302649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.302651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:34.302659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.302667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:34.302691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.302817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.302823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.302835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.302898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1131 partition: 0 MaxSeqNo: 45 sessionId: src_id|582caa9b-2617625c-ea22307c-5243eb89_0
2025-10-01T14:10:34.303176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fba441f8-f332b5aa-1b27557a-cc9831b7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|582caa9b-2617625c-ea22307c-5243eb89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:34.305633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|582caa9b-2617625c-ea22307c-5243eb89_0] Write session: try to update token
2025-10-01T14:10:34.305649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|582caa9b-2617625c-ea22307c-5243eb89_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:34.323921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1131 sessionId: src_id|582caa9b-2617625c-ea22307c-5243eb89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:34.326291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:34.322778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:34.322801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:34.322804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:34.322806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:34.322816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255511672630223:8352]
2025-10-01T14:10:34.322821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255511672630223:8352]
2025-10-01T14:10:34.322825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255511672630223:8352]
2025-10-01T14:10:34.322870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:34.322877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.322880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:34.323019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:34.326429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:34.326437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:34.326441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:34.379818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255514049508132:9460]
2025-10-01T14:10:34.380042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1130, pipe: [1:7556255514049508132:9460]
2025-10-01T14:10:34.473710Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:34.474588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.474608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.474654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508132:9460], now have 1 active actors on pipe
2025-10-01T14:10:34.474839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:34.474918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:34.474941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:34.474945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:34.474992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255514049508132:9460]
2025-10-01T14:10:34.475004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1131 reason: error at write: Disconnected sessionId: src_id|582caa9b-2617625c-ea22307c-5243eb89_0
2025-10-01T14:10:34.475248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1131 sessionId: src_id|582caa9b-2617625c-ea22307c-5243eb89_0 is DEAD
2025-10-01T14:10:34.475389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582caa9b-2617625c-ea22307c-5243eb89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:34.475401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582caa9b-2617625c-ea22307c-5243eb89_0] Write session will restart in 0.009990s
2025-10-01T14:10:34.475430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582caa9b-2617625c-ea22307c-5243eb89_0] Write session: Do CDS request
2025-10-01T14:10:34.475437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582caa9b-2617625c-ea22307c-5243eb89_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:34.486931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|582caa9b-2617625c-ea22307c-5243eb89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.486975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:34.486993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1132
2025-10-01T14:10:34.487153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.487184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:34.487193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:34.487197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:34.487564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1132 sessionId:  describe result for acl check
2025-10-01T14:10:34.487594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:34.487600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:34.487602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:34.487607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255514049508276:9640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:34.488103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255514049508276:9640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:34.490194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255514049508276:9640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:34.493852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:34.494103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255514049508276:9640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:34.494121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255514049508276:9640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:34.494125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255514049508276:9640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:34.494133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:34.494335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:34.494517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:34.494526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:34.494534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:34.494570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:34.494600Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255511672630441:8355]
2025-10-01T14:10:34.494997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:34.495260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:34.495292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:34.495492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:34.495529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.495534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.495535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.495535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.495537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.495537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.495538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.495539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.495540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.495540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.495541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.495542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.495543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.495543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.495546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.495553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.495556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.495558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.495560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.495563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.495565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.495567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.495569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.495572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.495574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.495576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.495579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.495581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.495585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.495591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.495595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.495598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.495601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.495604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.495607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.495609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.495612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.495615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.495618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.495621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.495624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.495627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.495630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.495633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.495637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.495640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.495642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.495645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.495648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.495650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.495653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.495656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.495659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.495662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.495664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.495667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.495689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:34.499320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:34.499900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:34.499913Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:34.499915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:34.499918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:34.499923Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1131 [2:7556255511672630441:8355]
2025-10-01T14:10:34.499937Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:34.499951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:34.499952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.499955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.499956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.499980Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:34.499988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:34.499998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:34.500041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.500046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.500048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.500051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:34.500053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:34.500105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:34.500112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.500122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.500138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.500152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:34.500167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255511672630435:8355]
2025-10-01T14:10:34.500173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255511672630435:8355]
2025-10-01T14:10:34.500175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255511672630435:8355]
2025-10-01T14:10:34.500184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:34.500193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:34.500197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508342:9640], now have 1 active actors on pipe
2025-10-01T14:10:34.500200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508135:2446], now have 1 active actors on pipe
2025-10-01T14:10:34.500203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:34.500205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:34.500207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:34.500221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:34.500224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:34.500252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255511672630435:8355]
2025-10-01T14:10:34.500265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:34.500279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1131
2025-10-01T14:10:34.500320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1131
2025-10-01T14:10:34.500295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:34.500363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.500370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.500399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77f9c899-48776688-137d78b2-5c72d00e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:34.500407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.500412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.500415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:34.500424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.500440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:34.500458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.500604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.500612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.500624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.500739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1132 partition: 0 MaxSeqNo: 45 sessionId: src_id|77f9c899-48776688-137d78b2-5c72d00e_0
2025-10-01T14:10:34.501175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|582caa9b-2617625c-ea22307c-5243eb89_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|77f9c899-48776688-137d78b2-5c72d00e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:34.503711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f9c899-48776688-137d78b2-5c72d00e_0] Write session: try to update token
2025-10-01T14:10:34.503730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f9c899-48776688-137d78b2-5c72d00e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:34.517671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:34.517695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:34.517706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255511672630435:8355]
2025-10-01T14:10:34.517755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:34.517757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:34.517930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:34.518078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:34.518229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:34.518398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:34.518597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:34.518634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:34.519793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1132 sessionId: src_id|77f9c899-48776688-137d78b2-5c72d00e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:34.522298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:34.522742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:34.522605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.522624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.522658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:34.531385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:34.531404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:34.531407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:34.531410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:34.531420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255511672630435:8355]
2025-10-01T14:10:34.531425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255511672630435:8355]
2025-10-01T14:10:34.531428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255511672630435:8355]
2025-10-01T14:10:34.531475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:34.531481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:34.531483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.531485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:34.531496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:34.531500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:34.531620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:34.575414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255514049508353:9460]
2025-10-01T14:10:34.575659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1131, pipe: [1:7556255514049508353:9460]
2025-10-01T14:10:34.691663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:34.699865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.699896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.700057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.700123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.700187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.700256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.700303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.700312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.700399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.700461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.700515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.700584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.700638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.700645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.700729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.700795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.700865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.700948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.701048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.701056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.701131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.701195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.701259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.701323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.701371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.701381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.701449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.701512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.701577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.701643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.701690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.701697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.701770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.701833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.701904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.701971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.702013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.702020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.702088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.702152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.702216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.702281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.702324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.702330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.702412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.702469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.702534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.702593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.702637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.702644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.702726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.702791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.702851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.702918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.702962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.702969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.703036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.703094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.703159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.703223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.703269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.703276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.703353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508353:9460], now have 1 active actors on pipe
2025-10-01T14:10:34.703529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255514049508353:9460]
2025-10-01T14:10:34.703530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:34.703534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:34.703555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1132 reason: error at write: Disconnected sessionId: src_id|77f9c899-48776688-137d78b2-5c72d00e_0
2025-10-01T14:10:34.703719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:34.703740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1132 sessionId: src_id|77f9c899-48776688-137d78b2-5c72d00e_0 is DEAD
2025-10-01T14:10:34.703865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f9c899-48776688-137d78b2-5c72d00e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:34.703872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f9c899-48776688-137d78b2-5c72d00e_0] Write session will restart in 0.007889s
2025-10-01T14:10:34.703896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f9c899-48776688-137d78b2-5c72d00e_0] Write session: Do CDS request
2025-10-01T14:10:34.703902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f9c899-48776688-137d78b2-5c72d00e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:34.704403Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:34.713015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f9c899-48776688-137d78b2-5c72d00e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.713010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:34.713028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1133
2025-10-01T14:10:34.713230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.713264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:34.713269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:34.713274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:34.713744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1133 sessionId:  describe result for acl check
2025-10-01T14:10:34.713778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:34.713784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:34.713786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:34.713792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255514049508447:9644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:34.714360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255514049508447:9644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:34.717041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255514049508447:9644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:34.721095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:34.721213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255514049508447:9644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:34.721230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255514049508447:9644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:34.721233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255514049508447:9644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:34.721242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:34.721478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:34.721611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:34.721618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:34.721627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:34.721658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:34.721688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255511672630664:8358]
2025-10-01T14:10:34.722064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:34.722292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:34.722316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:34.722519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:34.722559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.722563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.722564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.722564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.722565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.722566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.722566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.722567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.722568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.722568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.722569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.722570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.722570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.722571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.722574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.722579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.722581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.722583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.722585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.722587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.722589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.722591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.722593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.722596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.722598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.722599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.722601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.722603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.722610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.722614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.722617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.722620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.722623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.722625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.722628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.722630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.722633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.722635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.722637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.722640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.722643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.722645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.722647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.722650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.722653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.722656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.722658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.722661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.722664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.722667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.722669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.722672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.722674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.722677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.722679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.722682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.722701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:34.726166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:34.726922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:34.726932Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:34.726933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:34.726936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:34.726942Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1132 [2:7556255511672630664:8358]
2025-10-01T14:10:34.726952Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:34.726965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:34.726971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.726973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.726975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.726986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:34.726990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:34.726994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:34.727031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.727036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.727037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.727039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:34.727041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:34.727090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:34.727097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.727104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.727109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.727117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:34.727129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508564:9644], now have 1 active actors on pipe
2025-10-01T14:10:34.727135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508356:2446], now have 1 active actors on pipe
2025-10-01T14:10:34.727140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255511672630658:8358]
2025-10-01T14:10:34.727141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255511672630658:8358]
2025-10-01T14:10:34.727143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255511672630658:8358]
2025-10-01T14:10:34.727153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:34.727166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:34.727167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:34.727170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:34.727171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:34.727178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:34.727179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:34.727198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255511672630658:8358]
2025-10-01T14:10:34.727205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:34.727216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:34.727248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1132
2025-10-01T14:10:34.727248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1132
2025-10-01T14:10:34.727318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.727328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.727349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:34.727358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.727361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.727363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:34.727369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.727378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:34.727389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.727562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.727569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.727582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.727677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1133 partition: 0 MaxSeqNo: 45 sessionId: src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0
2025-10-01T14:10:34.728048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f9c899-48776688-137d78b2-5c72d00e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:34.730770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0] Write session: try to update token
2025-10-01T14:10:34.730787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:34.737767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:34.737788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:34.737797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255511672630658:8358]
2025-10-01T14:10:34.737836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:34.737842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:34.738012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:34.738158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:34.738299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:34.738447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:34.738649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:34.738698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:34.744108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1133 sessionId: src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:34.746505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:34.746907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.746932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.746973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:34.747069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:34.756703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:34.756729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:34.756730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:34.756732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:34.756741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255511672630658:8358]
2025-10-01T14:10:34.756744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255511672630658:8358]
2025-10-01T14:10:34.756748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255511672630658:8358]
2025-10-01T14:10:34.756785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:34.756785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:34.756789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:34.756793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:34.756795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.756796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:34.756927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:34.803742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255514049508578:9460]
2025-10-01T14:10:34.803939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1132, pipe: [1:7556255514049508578:9460]
2025-10-01T14:10:34.891108Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:34.898037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.898070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.898219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.898277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.898338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.898422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.898466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.898473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.898536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.898589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.898643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.898700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.898740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.898746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.898805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.898861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.898919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.898974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.899016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.899025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.899085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.899140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.899194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.899250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.899290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.899296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.899351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.899403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.899458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.899515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.899554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.899559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.899618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.899672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.899729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.899787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.899828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.899834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.899894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.899947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.900005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.900063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.900111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.900117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.900174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.900224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.900278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.900332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.900372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.900377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.900430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.900482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.900537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.900589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.900629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.900634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.900687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:34.900752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:34.900803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:34.900853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:34.900890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:34.900895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:34.900937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508578:9460], now have 1 active actors on pipe
2025-10-01T14:10:34.901143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:34.901160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:34.901186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:34.901188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1133 reason: error at write: Disconnected sessionId: src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0
2025-10-01T14:10:34.901235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255514049508578:9460]
2025-10-01T14:10:34.901367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1133 sessionId: src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0 is DEAD
2025-10-01T14:10:34.901531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:34.901541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0] Write session will restart in 0.005121s
2025-10-01T14:10:34.901570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0] Write session: Do CDS request
2025-10-01T14:10:34.901574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:34.901961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:34.907889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.907978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:34.907992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1134
2025-10-01T14:10:34.908102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:34.908126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:34.908133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:34.908136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:34.908553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1134 sessionId:  describe result for acl check
2025-10-01T14:10:34.908594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:34.908601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:34.908603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:34.908608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255514049508642:9650] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:34.909135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255514049508642:9650] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:34.911344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255514049508642:9650] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:34.913271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255514049508642:9650] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:34.913285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255514049508642:9650] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:34.913288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255514049508642:9650] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:34.913295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:34.913473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:34.916393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:34.916548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:34.916556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:34.916565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:34.916608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:34.916643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255511672630878:8361]
2025-10-01T14:10:34.917052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:34.917228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:34.917264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:34.917459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:34.917504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.917508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.917509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.917510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.917511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.917512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.917513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.917514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.917515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.917516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.917518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.917519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.917520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.917521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.917526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.917536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.917539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.917543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.917546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.917550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.917553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.917557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.917561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.917565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.917568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.917572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.917576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.917579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.917587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.917596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:34.917602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.917611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:34.917615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.917620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:34.917624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.917633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:34.917637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.917642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:34.917646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.917651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:34.917657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.917662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:34.917667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.917673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:34.917677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.917683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:34.917687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.917692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.917696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.917702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.917706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.917711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.917716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.917721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:34.917725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.917731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:34.917767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:34.921071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:34.921674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:34.921688Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:34.921690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:34.921693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:34.921699Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1133 [2:7556255511672630878:8361]
2025-10-01T14:10:34.921712Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:34.921730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:34.921737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.921741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.921746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.921760Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:34.921769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:34.921779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:34.921830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.921840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.921842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.921844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:34.921847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:34.921902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:34.921910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.921919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:34.921928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:34.921941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:34.921960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508800:9650], now have 1 active actors on pipe
2025-10-01T14:10:34.921967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255514049508592:2446], now have 1 active actors on pipe
2025-10-01T14:10:34.921973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255511672630872:8361]
2025-10-01T14:10:34.921975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255511672630872:8361]
2025-10-01T14:10:34.921977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255511672630872:8361]
2025-10-01T14:10:34.921991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:34.922002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:34.922006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:34.922010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:34.922011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:34.922016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1133
2025-10-01T14:10:34.922045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1133
2025-10-01T14:10:34.922018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:34.922025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:34.922060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.922064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.922076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255511672630872:8361]
2025-10-01T14:10:34.922084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:34.922093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:34.922112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:34.922121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:34.922129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:34.922131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:34.922143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:34.922154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:34.922176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.922272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.922280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.922292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:34.922381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1134 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0
2025-10-01T14:10:34.922725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|703a8af1-c4b0ea5f-e175cc68-cbf8c9c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:34.925331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0] Write session: try to update token
2025-10-01T14:10:34.925346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:34.939105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1134 sessionId: src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:34.941436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:34.942089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:34.942113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:34.942133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:34.942135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:34.942137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:34.942138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:34.942144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255511672630872:8361]
2025-10-01T14:10:34.942147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255511672630872:8361]
2025-10-01T14:10:34.942150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255511672630872:8361]
2025-10-01T14:10:34.942183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:34.942193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:34.942197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:34.942199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:34.942202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:34.942204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:34.942326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:35.001367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255518344476122:9460]
2025-10-01T14:10:35.001619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1133, pipe: [1:7556255518344476122:9460]
2025-10-01T14:10:35.084320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:35.084918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:35.084972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476122:9460], now have 1 active actors on pipe
2025-10-01T14:10:35.085026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:35.085111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:35.085118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:35.085121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:35.085205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1134 reason: error at write: Disconnected sessionId: src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0
2025-10-01T14:10:35.085244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255518344476122:9460]
2025-10-01T14:10:35.085389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1134 sessionId: src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0 is DEAD
2025-10-01T14:10:35.085535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:35.085544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0] Write session will restart in 0.008452s
2025-10-01T14:10:35.085568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0] Write session: Do CDS request
2025-10-01T14:10:35.085577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:35.094914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.094938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:35.094951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1135
2025-10-01T14:10:35.095134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.095162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:35.095168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:35.095171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:35.095546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1135 sessionId:  describe result for acl check
2025-10-01T14:10:35.095572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:35.095574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:35.095576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:35.095580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255518344476228:9661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:35.096038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255518344476228:9661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:35.098102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255518344476228:9661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:35.103150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:35.103816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:35.104016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:35.104027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:35.104038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:35.104085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:35.104124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255515967598395:8365]
2025-10-01T14:10:35.104757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:35.107753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:35.107824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:35.107847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255518344476228:9661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:35.107861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255518344476228:9661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:35.107864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255518344476228:9661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:35.107875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:35.108342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:35.108397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.108403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.108404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.108406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.108407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.108408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.108410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.108411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.108412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.108413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.108414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.108416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.108417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.108418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.108425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.108435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.108440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.108444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.108448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.108452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.108457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.108461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.108465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.108469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.108473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.108477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.108481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.108485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.108493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.108501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.108508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.108514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.108519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.108524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.108528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.108533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.108538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.108544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.108548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.108555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.108559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.108569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.108573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.108578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.108583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.108588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.108596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.108601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.108609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.108614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.108619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.108628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.108632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.108641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.108645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.108649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.108691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:35.112406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:35.113057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:35.113068Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:35.113071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:35.113075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:35.113083Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1134 [2:7556255515967598395:8365]
2025-10-01T14:10:35.113101Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:35.113118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:35.113121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.113125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.113127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.113143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:35.113148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:35.113154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:35.113217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.113224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.113226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.113230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:35.113232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:35.113301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:35.113310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.113321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.113330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.113343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:35.113366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476136:2446], now have 1 active actors on pipe
2025-10-01T14:10:35.113373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476345:9661], now have 1 active actors on pipe
2025-10-01T14:10:35.113380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255515967598390:8365]
2025-10-01T14:10:35.113388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255515967598390:8365]
2025-10-01T14:10:35.113390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255515967598390:8365]
2025-10-01T14:10:35.113403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:35.113396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1134
2025-10-01T14:10:35.113419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:35.113401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1134
2025-10-01T14:10:35.113422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:35.113436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:35.113438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:35.113439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:35.113440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:35.113487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.113496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.113514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255515967598390:8365]
2025-10-01T14:10:35.113526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:35.113537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:35.113559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:35.113571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.113575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.113578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:35.113587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.113599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:35.113623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.113748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.113757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.113771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.113853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1135 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0
2025-10-01T14:10:35.114219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e595c69-162fcc1c-ade30dba-cbe2a1d0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:35.116651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0] Write session: try to update token
2025-10-01T14:10:35.116667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:35.131057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1135 sessionId: src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:35.133482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:35.133818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.133842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.133863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:35.133866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:35.133868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:35.133870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:35.133879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255515967598390:8365]
2025-10-01T14:10:35.133883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255515967598390:8365]
2025-10-01T14:10:35.133887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255515967598390:8365]
2025-10-01T14:10:35.133935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:35.133942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:35.133946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.133948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:35.133948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:35.133951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:35.134061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:35.185225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255518344476359:9460]
2025-10-01T14:10:35.185538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1134, pipe: [1:7556255518344476359:9460]
2025-10-01T14:10:35.284639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:35.285610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:35.285719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255518344476359:9460]
2025-10-01T14:10:35.285744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:35.285447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:35.285501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476359:9460], now have 1 active actors on pipe
2025-10-01T14:10:35.297656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:35.297672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:35.297704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1135 reason: error at write: Disconnected sessionId: src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0
2025-10-01T14:10:35.297892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1135 sessionId: src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0 is DEAD
2025-10-01T14:10:35.298453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:35.298465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0] Write session will restart in 0.007078s
2025-10-01T14:10:35.298492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0] Write session: Do CDS request
2025-10-01T14:10:35.298515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:35.306858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.306969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:35.306981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1136
2025-10-01T14:10:35.307241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.307271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:35.307276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:35.307279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:35.307761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1136 sessionId:  describe result for acl check
2025-10-01T14:10:35.307793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:35.307795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:35.307797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:35.307802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255518344476387:9666] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:35.308296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255518344476387:9666] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:35.311563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255518344476387:9666] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:35.316522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255518344476387:9666] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:35.316537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255518344476387:9666] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:35.316546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255518344476387:9666] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:35.316558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:35.322617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:35.326094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:35.326306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:35.326310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:35.326320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:35.326358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:35.326398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255515967598640:8377]
2025-10-01T14:10:35.326878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:35.327153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:35.327193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:35.327422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:35.327473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.327479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.327481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.327482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.327483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.327484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.327485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.327487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.327488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.327489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.327491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.327492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.327493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.327494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.327499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.327505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.327508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.327510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.327512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.327514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.327517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.327519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.327521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.327523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.327525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.327527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.327530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.327533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.327541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.327549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.327555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.327560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.327565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.327570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.327573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.327578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.327582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.327588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.327592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.327597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.327604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.327609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.327618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.327623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.327631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.327634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.327638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.327642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.327647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.327650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.327653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.327655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.327660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.327663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.327665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.327668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.327691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:35.331450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:35.332569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:35.332583Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:35.332586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:35.332589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:35.332595Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1135 [2:7556255515967598640:8377]
2025-10-01T14:10:35.332610Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:35.332629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:35.332635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.332638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.332640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.332654Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:35.332659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:35.332664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:35.332727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.332734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.332735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.332738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:35.332741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:35.332803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:35.332810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.332819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.332828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.332841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:35.332861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476487:9666], now have 1 active actors on pipe
2025-10-01T14:10:35.332869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476364:2446], now have 1 active actors on pipe
2025-10-01T14:10:35.332876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255515967598635:8377]
2025-10-01T14:10:35.332882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255515967598635:8377]
2025-10-01T14:10:35.332883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255515967598635:8377]
2025-10-01T14:10:35.332895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:35.332907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:35.332910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:35.332917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:35.332920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:35.332922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:35.332924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:35.332908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1135
2025-10-01T14:10:35.332908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1135
2025-10-01T14:10:35.332948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255515967598635:8377]
2025-10-01T14:10:35.332959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:35.332965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:35.332977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.332985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.333029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:35.333039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.333044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.333050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:35.333060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.333071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:35.333089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.333224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.333231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.333244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.333295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1136 partition: 0 MaxSeqNo: 45 sessionId: src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0
2025-10-01T14:10:35.333610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1cba7ba-ffac6744-655baa33-d1148fd4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:35.335973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0] Write session: try to update token
2025-10-01T14:10:35.335987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:35.348548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1136 sessionId: src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:35.350668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:35.350846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.350867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.350900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:35.350978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:35.354052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:35.354072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:35.354075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:35.354076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:35.354086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255515967598635:8377]
2025-10-01T14:10:35.354093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255515967598635:8377]
2025-10-01T14:10:35.354096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255515967598635:8377]
2025-10-01T14:10:35.354142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:35.354150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:35.354155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.354157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:35.354158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:35.354161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:35.354282Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:35.385879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255518344476594:9460]
2025-10-01T14:10:35.386120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1135, pipe: [1:7556255518344476594:9460]
2025-10-01T14:10:35.487965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:35.494800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.494822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.494964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.495017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.495074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.495130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.495169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.495178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.495236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.495288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.495341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.495398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.495439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.495444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.495494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.495544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.495596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.495647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.495692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.495698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.495752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.495802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.495851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.495902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.495939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.495944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.495996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.496047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.496096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.496148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.496187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.496192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.496245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.496294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.496350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.496404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.496445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.496450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.496504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.496558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.496611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.496662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.496703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.496709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.496775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.496827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.496877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.496930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.496969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.496974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.497034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.497093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.497148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.497202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.497240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.497246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.497302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:35.497357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:35.497416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:35.497468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:35.497506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:35.497510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:35.497549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476594:9460], now have 1 active actors on pipe
2025-10-01T14:10:35.497722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255518344476594:9460]
2025-10-01T14:10:35.497726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:35.497729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:35.497745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:35.497753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1136 reason: error at write: Disconnected sessionId: src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0
2025-10-01T14:10:35.497945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1136 sessionId: src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0 is DEAD
2025-10-01T14:10:35.498073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:35.498085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0] Write session will restart in 0.008815s
2025-10-01T14:10:35.498109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0] Write session: Do CDS request
2025-10-01T14:10:35.498115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:35.498597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:35.507869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.507952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:35.507963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1137
2025-10-01T14:10:35.508067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.508093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:35.508097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:35.508099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:35.508419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1137 sessionId:  describe result for acl check
2025-10-01T14:10:35.508441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:35.508445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:35.508447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:35.508451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255518344476770:9670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:35.508842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255518344476770:9670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:35.510719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255518344476770:9670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:35.513385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:35.513610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255518344476770:9670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:35.513618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255518344476770:9670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:35.513621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255518344476770:9670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:35.513629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:35.513811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:35.513936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:35.513943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:35.513952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:35.513984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:35.514012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255515967598857:8380]
2025-10-01T14:10:35.514415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:35.514623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:35.514649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:35.514898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:35.514935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.514940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.514940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.514941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.514942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.514942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.514943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.514944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.514944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.514945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.514946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.514946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.514947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.514947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.514950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.514957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.514959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.514961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.514963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.514965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.514967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.514969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.514971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.514973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.514975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.514977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.514979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.514981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.514985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.514990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.514994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.514997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.514999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.515002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.515005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.515008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.515010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.515013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.515016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.515018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.515021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.515024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.515027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.515030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.515032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.515035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.515038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.515041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.515043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.515046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.515048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.515050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.515052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.515055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.515057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.515059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.515079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:35.518491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:35.519013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:35.519023Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:35.519025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:35.519027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:35.519032Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1136 [2:7556255515967598857:8380]
2025-10-01T14:10:35.519043Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:35.519055Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:35.519060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.519063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.519065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.519076Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:35.519083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:35.519088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:35.519126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.519131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.519132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.519135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:35.519136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:35.519197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:35.519205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.519215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.519228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.519248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:35.519306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1136
2025-10-01T14:10:35.519310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1136
2025-10-01T14:10:35.519267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476808:9670], now have 1 active actors on pipe
2025-10-01T14:10:35.519274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476596:2446], now have 1 active actors on pipe
2025-10-01T14:10:35.519279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255515967598851:8380]
2025-10-01T14:10:35.519280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255515967598851:8380]
2025-10-01T14:10:35.519281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255515967598851:8380]
2025-10-01T14:10:35.519291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:35.519303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:35.519303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:35.519305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:35.519307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:35.519315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:35.519318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:35.519341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255515967598851:8380]
2025-10-01T14:10:35.519347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:35.519351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:35.519362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.519366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.519410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:35.519423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.519426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.519428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:35.519437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.519444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:35.519460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.519623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.519631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.519646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.519716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1137 partition: 0 MaxSeqNo: 45 sessionId: src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0
2025-10-01T14:10:35.520074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48785c0c-2a438bba-4ff7b852-5ad2c0f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:35.522482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0] Write session: try to update token
2025-10-01T14:10:35.522501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:35.535792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1137 sessionId: src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:35.538163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:35.538606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.538631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.538651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:35.538653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:35.538655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:35.538656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:35.538664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255515967598851:8380]
2025-10-01T14:10:35.538667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255515967598851:8380]
2025-10-01T14:10:35.538670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255515967598851:8380]
2025-10-01T14:10:35.538706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:35.538717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:35.538720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:35.538725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:35.538730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.538737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:35.538865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:35.597845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255518344476819:9460]
2025-10-01T14:10:35.598039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1136, pipe: [1:7556255518344476819:9460]
2025-10-01T14:10:35.674790Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:35.675901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:35.675963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476819:9460], now have 1 active actors on pipe
2025-10-01T14:10:35.676099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:35.676237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:35.676244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:35.676330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1137 reason: error at write: Disconnected sessionId: src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0
2025-10-01T14:10:35.676517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1137 sessionId: src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0 is DEAD
2025-10-01T14:10:35.676590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:35.676690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:35.676700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0] Write session will restart in 0.005325s
2025-10-01T14:10:35.676738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0] Write session: Do CDS request
2025-10-01T14:10:35.676746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:35.676638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255518344476819:9460]
2025-10-01T14:10:35.682928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.683015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:35.683028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1138
2025-10-01T14:10:35.683137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.683165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:35.683174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:35.683177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:35.683567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1138 sessionId:  describe result for acl check
2025-10-01T14:10:35.683613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:35.683621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:35.683623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:35.683629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255518344476837:9674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:35.684203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255518344476837:9674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:35.687505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255518344476837:9674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:35.691408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255518344476837:9674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:35.691421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255518344476837:9674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:35.691424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255518344476837:9674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:35.691432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:35.698058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:35.698567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:35.698775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:35.698791Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:35.698802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:35.698849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:35.698887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255515967599085:8383]
2025-10-01T14:10:35.699397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:35.699626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:35.699669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:35.699961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:35.700025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.700026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.700027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.700028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.700029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.700031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.700032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.700033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.700034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.700035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.700036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.700038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.700038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.700040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.700045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.700054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.700058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.700062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.700065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.700069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.700072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.700076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.700080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.700084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.700087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.700091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.700095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.700098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.700105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.700112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.700117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.700122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.700126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.700131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.700135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.700138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.700141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.700144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.700147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.700150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.700153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.700156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.700158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.700161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.700163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.700166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.700168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.700171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.700173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.700176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.700178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.700181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.700183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.700186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.700190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.700196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.700223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:35.704001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:35.704657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:35.704670Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:35.704673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:35.704676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:35.704683Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1137 [2:7556255515967599085:8383]
2025-10-01T14:10:35.704700Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:35.704726Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:35.704730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.704733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.704735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.704748Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:35.704753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:35.704759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:35.704811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.704818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.704820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.704822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:35.704825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:35.704881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:35.704891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.704902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.704911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.704927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:35.704944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344476822:2446], now have 1 active actors on pipe
2025-10-01T14:10:35.704952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344477021:9674], now have 1 active actors on pipe
2025-10-01T14:10:35.704959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255515967599080:8383]
2025-10-01T14:10:35.704960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255515967599080:8383]
2025-10-01T14:10:35.704962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255515967599080:8383]
2025-10-01T14:10:35.704974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:35.704985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:35.704988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:35.704989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:35.704991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:35.705002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:35.705009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:35.704991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1137
2025-10-01T14:10:35.705008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1137
2025-10-01T14:10:35.705035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255515967599080:8383]
2025-10-01T14:10:35.705045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:35.705050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:35.705064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.705072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.705111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbd81008-319f9294-f57d630e-93350f02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:35.705122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.705126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.705128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:35.705137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.705149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:35.705163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.705269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.705276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.705288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.705368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1138 partition: 0 MaxSeqNo: 45 sessionId: src_id|cbd81008-319f9294-f57d630e-93350f02_0
2025-10-01T14:10:35.705734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f642b78f-afaebeee-3a9c2d3d-5a7b1c1a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cbd81008-319f9294-f57d630e-93350f02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:35.712848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd81008-319f9294-f57d630e-93350f02_0] Write session: try to update token
2025-10-01T14:10:35.712861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd81008-319f9294-f57d630e-93350f02_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:35.725925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:35.725952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:35.725955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:35.725957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:35.725966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255515967599080:8383]
2025-10-01T14:10:35.725971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255515967599080:8383]
2025-10-01T14:10:35.725975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255515967599080:8383]
2025-10-01T14:10:35.726011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:35.726015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:35.726017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:35.726023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:35.726030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.726032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:35.726160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:35.729764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1138 sessionId: src_id|cbd81008-319f9294-f57d630e-93350f02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:35.732281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:35.778652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255518344477052:9460]
2025-10-01T14:10:35.778909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1137, pipe: [1:7556255518344477052:9460]
2025-10-01T14:10:35.886578Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:35.886858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.886877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.886918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344477052:9460], now have 1 active actors on pipe
2025-10-01T14:10:35.887592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255518344477052:9460]
2025-10-01T14:10:35.887616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:35.887648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:35.887771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1138 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cbd81008-319f9294-f57d630e-93350f02_0
2025-10-01T14:10:35.887124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:35.887986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1138 sessionId: src_id|cbd81008-319f9294-f57d630e-93350f02_0 is DEAD
2025-10-01T14:10:35.888161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd81008-319f9294-f57d630e-93350f02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:35.888183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd81008-319f9294-f57d630e-93350f02_0] Write session will restart in 0.006089s
2025-10-01T14:10:35.888215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd81008-319f9294-f57d630e-93350f02_0] Write session: Do CDS request
2025-10-01T14:10:35.888221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd81008-319f9294-f57d630e-93350f02_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:35.895891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd81008-319f9294-f57d630e-93350f02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.895990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:35.896003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1139
2025-10-01T14:10:35.896113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:35.896139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:35.896144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:35.896148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:35.896556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1139 sessionId:  describe result for acl check
2025-10-01T14:10:35.896591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:35.896599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:35.896601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:35.896606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255518344477129:9680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:35.897121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255518344477129:9680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:35.899611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255518344477129:9680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:35.901871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255518344477129:9680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:35.901882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255518344477129:9680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:35.901885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255518344477129:9680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:35.901895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:35.902061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:35.905212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:35.905405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:35.905415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:35.905425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:35.905467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:35.905503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255515967599304:8386]
2025-10-01T14:10:35.905998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:35.906236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:35.906276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:35.906555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:35.906603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.906609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.906610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.906611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.906612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.906613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.906614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.906614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.906615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.906616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.906617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.906618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.906618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.906620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.906623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.906631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.906634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.906637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.906640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.906643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.906646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.906649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.906652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.906656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.906659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.906662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.906665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.906668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.906674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.906681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:35.906686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.906693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:35.906696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.906701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:35.906704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.906708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:35.906712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.906716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:35.906719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.906723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:35.906728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.906732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:35.906736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.906740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:35.906744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.906748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:35.906752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.906755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.906764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.906768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.906771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.906775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.906782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.906786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:35.906789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.906793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:35.906824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:35.910435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:35.911507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:35.911522Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:35.911524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:35.911528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:35.911535Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1138 [2:7556255515967599304:8386]
2025-10-01T14:10:35.911550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:35.911570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:35.911577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.911581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.911584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.911600Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:35.911609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:35.911615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:35.911666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.911673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.911674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.911677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:35.911679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:35.911741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:35.911749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.911760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:35.911769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:35.911781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:35.911802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344477067:2446], now have 1 active actors on pipe
2025-10-01T14:10:35.911809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344477279:9680], now have 1 active actors on pipe
2025-10-01T14:10:35.911817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255515967599298:8386]
2025-10-01T14:10:35.911823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255515967599298:8386]
2025-10-01T14:10:35.911824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255515967599298:8386]
2025-10-01T14:10:35.911838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:35.911853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:35.911863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:35.911870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:35.911873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:35.911873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:35.911875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:35.911901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255515967599298:8386]
2025-10-01T14:10:35.911911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:35.911916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:35.911864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1138
2025-10-01T14:10:35.911909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1138
2025-10-01T14:10:35.911988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.911997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.912026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:35.912036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:35.912040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:35.912041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:35.912047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:35.912054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:35.912069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.912226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.912250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.912271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:35.912345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1139 partition: 0 MaxSeqNo: 45 sessionId: src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0
2025-10-01T14:10:35.912692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbd81008-319f9294-f57d630e-93350f02_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:35.915188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0] Write session: try to update token
2025-10-01T14:10:35.915206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:35.930137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1139 sessionId: src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:35.932547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:35.933175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:35.933207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:35.933228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:35.933232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:35.933234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:35.933236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:35.933246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255515967599298:8386]
2025-10-01T14:10:35.933251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255515967599298:8386]
2025-10-01T14:10:35.933255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255515967599298:8386]
2025-10-01T14:10:35.933315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:35.933326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:35.933328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:35.933530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:35.933879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:35.933902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:35.933906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:35.989881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255518344477292:9460]
2025-10-01T14:10:35.990817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1138, pipe: [1:7556255518344477292:9460]
2025-10-01T14:10:36.081817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:36.082058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:36.082109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255518344477292:9460], now have 1 active actors on pipe
2025-10-01T14:10:36.082271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:36.082410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:36.082419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:36.082506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1139 reason: error at write: Disconnected sessionId: src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0
2025-10-01T14:10:36.082698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1139 sessionId: src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0 is DEAD
2025-10-01T14:10:36.082806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:36.082818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0] Write session will restart in 0.005814s
2025-10-01T14:10:36.082843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0] Write session: Do CDS request
2025-10-01T14:10:36.082850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:36.082996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:36.083041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255518344477292:9460]
2025-10-01T14:10:36.091371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.091731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:36.091746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1140
2025-10-01T14:10:36.091865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.091890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:36.091895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:36.091901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:36.092320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1140 sessionId:  describe result for acl check
2025-10-01T14:10:36.092345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:36.092348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:36.092350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:36.092355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255522639444641:9691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:36.092928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255522639444641:9691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:36.096159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255522639444641:9691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:36.099069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255522639444641:9691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:36.099082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255522639444641:9691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:36.099084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255522639444641:9691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:36.099091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:36.100591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:36.104180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:36.104379Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:36.104390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:36.104398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:36.104445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:36.104487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255520262566826:8390]
2025-10-01T14:10:36.105048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:36.105398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:36.105472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:36.105800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:36.105857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.105865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.105866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.105867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.105868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.105869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.105871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.105872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.105873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.105874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.105876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.105877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.105878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.105878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.105883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.105889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.105891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.105893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.105895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.105897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.105899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.105901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.105903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.105905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.105907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.105909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.105911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.105914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.105920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.105925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.105929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.105932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.105934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.105937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.105940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.105943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.105945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.105949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.105951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.105953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.105956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.105959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.105961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.105964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.105967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.105972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.105975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.105978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.105981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.105984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.105986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.105990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.105992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.105995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.105997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.106000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.106035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:36.109912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:36.110528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:36.110547Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:36.110549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:36.110553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:36.110560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1139 [2:7556255520262566826:8390]
2025-10-01T14:10:36.110574Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:36.110590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:36.110593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.110597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.110598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.110614Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:36.110624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:36.110629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:36.110687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.110693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.110695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.110698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:36.110700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:36.110766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:36.110773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.110783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.110793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.110809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:36.110829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639444824:9691], now have 1 active actors on pipe
2025-10-01T14:10:36.110837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639444604:2446], now have 1 active actors on pipe
2025-10-01T14:10:36.110845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255520262566821:8390]
2025-10-01T14:10:36.110847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255520262566821:8390]
2025-10-01T14:10:36.110849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255520262566821:8390]
2025-10-01T14:10:36.110864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:36.110877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:36.110881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:36.110890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:36.110892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:36.110893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:36.110895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:36.110921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255520262566821:8390]
2025-10-01T14:10:36.110934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:36.110943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:36.110927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1139
2025-10-01T14:10:36.110949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1139
2025-10-01T14:10:36.111066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.111079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.111103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:36.111113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.111116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.111119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:36.111128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.111142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:36.111158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.111349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.111358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.111372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.111471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1140 partition: 0 MaxSeqNo: 45 sessionId: src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0
2025-10-01T14:10:36.111905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ac2cf20-40448fdb-1f4156c1-749f148c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:36.115671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0] Write session: try to update token
2025-10-01T14:10:36.115692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:36.130977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:36.130996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:36.130999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:36.131001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:36.131012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255520262566821:8390]
2025-10-01T14:10:36.131017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255520262566821:8390]
2025-10-01T14:10:36.131021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255520262566821:8390]
2025-10-01T14:10:36.131067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:36.131078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.131081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:36.131082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:36.131093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:36.131097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:36.131219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:36.134964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1140 sessionId: src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:36.137910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:36.183110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255522639444839:9460]
2025-10-01T14:10:36.183446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1139, pipe: [1:7556255522639444839:9460]
2025-10-01T14:10:36.296742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:36.296997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.297012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.297053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639444839:9460], now have 1 active actors on pipe
2025-10-01T14:10:36.297229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:36.297264Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:36.297273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:36.297278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:36.297318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255522639444839:9460]
2025-10-01T14:10:36.297472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1140 reason: error at write: Disconnected sessionId: src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0
2025-10-01T14:10:36.297663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1140 sessionId: src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0 is DEAD
2025-10-01T14:10:36.297773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:36.297782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0] Write session will restart in 0.006375s
2025-10-01T14:10:36.297862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0] Write session: Do CDS request
2025-10-01T14:10:36.297875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:36.305847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.306049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:36.306065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1141
2025-10-01T14:10:36.306175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.306210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:36.306221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:36.306226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:36.306673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1141 sessionId:  describe result for acl check
2025-10-01T14:10:36.306707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:36.306710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:36.306712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:36.306716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255522639444978:9696] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:36.307214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255522639444978:9696] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:36.309227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255522639444978:9696] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:36.312662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:36.312871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255522639444978:9696] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:36.312884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255522639444978:9696] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:36.312886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255522639444978:9696] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:36.312935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:36.313014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:36.313178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:36.313188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:36.313198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:36.313240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:36.313277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255520262567074:8402]
2025-10-01T14:10:36.313848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:36.314071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:36.314108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:36.314401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:36.314450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.314456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.314457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.314457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.314458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.314460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.314461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.314461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.314462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.314463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.314464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.314465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.314466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.314467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.314471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.314480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.314484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.314488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.314491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.314494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.314497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.314501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.314504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.314508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.314511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.314514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.314517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.314520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.314528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.314534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.314539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.314544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.314548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.314553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.314556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.314561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.314564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.314568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.314572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.314576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.314580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.314585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.314588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.314592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.314596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.314601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.314605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.314609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.314616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.314620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.314624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.314628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.314632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.314641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.314644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.314649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.314681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:36.318015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:36.318869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:36.318879Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:36.318880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:36.318883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:36.318887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1140 [2:7556255520262567074:8402]
2025-10-01T14:10:36.318896Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:36.318907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:36.318909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.318911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.318912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.318923Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:36.318928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:36.318934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:36.318978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.318983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.318985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.318988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:36.318990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:36.319033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:36.319038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.319045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.319050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.319058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:36.319072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255520262567068:8402]
2025-10-01T14:10:36.319075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255520262567068:8402]
2025-10-01T14:10:36.319076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255520262567068:8402]
2025-10-01T14:10:36.319082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:36.319091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639444847:2446], now have 1 active actors on pipe
2025-10-01T14:10:36.319091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:36.319094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:36.319096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:36.319100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445064:9696], now have 1 active actors on pipe
2025-10-01T14:10:36.319104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:36.319112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:36.319113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:36.319129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255520262567068:8402]
2025-10-01T14:10:36.319135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:36.319142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:36.319157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1140
2025-10-01T14:10:36.319215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1140
2025-10-01T14:10:36.319239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.319246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.319264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:36.319270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.319274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.319279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:36.319284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.319290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:36.319300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.319448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.319454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.319463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.319540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1141 partition: 0 MaxSeqNo: 45 sessionId: src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0
2025-10-01T14:10:36.319915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6e1c4dc-50c099c7-a3b8d63b-18e0273d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:36.322873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0] Write session: try to update token
2025-10-01T14:10:36.322892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:36.333150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:36.333169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:36.333175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255520262567068:8402]
2025-10-01T14:10:36.333214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:36.333216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:36.333380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:36.333508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:36.333624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:36.333737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:36.334000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:36.334027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:36.340403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1141 sessionId: src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:36.343336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:36.343703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.343725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.343755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:36.343855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:36.346657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:36.346673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:36.346675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:36.346677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:36.346684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255520262567068:8402]
2025-10-01T14:10:36.346687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255520262567068:8402]
2025-10-01T14:10:36.346689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255520262567068:8402]
2025-10-01T14:10:36.346721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:36.346729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.346730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:36.346734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:36.346738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:36.346741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:36.346842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:36.397641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255522639445079:9460]
2025-10-01T14:10:36.397945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1140, pipe: [1:7556255522639445079:9460]
2025-10-01T14:10:36.483448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:36.490723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.490751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.490914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.490977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.491043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.491107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.491155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.491165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.491230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.491333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.491397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.491464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.491511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.491519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.491592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.491657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.491722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.491825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.491872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.491879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.491949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.492040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.492104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.492171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.492221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.492228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.492298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.492361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.492425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.492485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.492534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.492541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.492608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.492671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.492749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.492815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.492878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.492886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.492953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.493012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.493077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.493146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.493208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.493215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.493283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.493346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.493412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.493480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.493539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.493547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.493644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.493734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.493798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.493863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.493907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.493915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.493984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.494047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.494110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.494172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.494228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.494235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.494294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445079:9460], now have 1 active actors on pipe
2025-10-01T14:10:36.494564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:36.494630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:36.494633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:36.494665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1141 reason: error at write: Disconnected sessionId: src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0
2025-10-01T14:10:36.494835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1141 sessionId: src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0 is DEAD
2025-10-01T14:10:36.494938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:36.494946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0] Write session will restart in 0.006990s
2025-10-01T14:10:36.494965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0] Write session: Do CDS request
2025-10-01T14:10:36.494969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:36.494972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255522639445079:9460]
2025-10-01T14:10:36.495482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:36.502905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.502999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:36.503015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1142
2025-10-01T14:10:36.503182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.503215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:36.503221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:36.503230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:36.503692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1142 sessionId:  describe result for acl check
2025-10-01T14:10:36.503743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:36.503750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:36.503752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:36.503756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255522639445148:9700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:36.504144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255522639445148:9700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:36.506274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255522639445148:9700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:36.508806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255522639445148:9700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:36.508817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255522639445148:9700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:36.508819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255522639445148:9700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:36.508824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:36.509659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:36.512534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:36.512673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:36.512681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:36.512689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:36.512738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:36.512773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255520262567297:8405]
2025-10-01T14:10:36.513228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:36.513473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:36.513501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:36.513705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:36.513744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.513748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.513749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.513749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.513750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.513751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.513751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.513752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.513753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.513753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.513754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.513755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.513755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.513756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.513759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.513765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.513767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.513769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.513771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.513773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.513775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.513777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.513779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.513781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.513783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.513785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.513787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.513789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.513793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.513797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.513801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.513804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.513806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.513808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.513811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.513813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.513815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.513818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.513820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.513823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.513826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.513828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.513830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.513833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.513835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.513838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.513840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.513843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.513845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.513849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.513851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.513854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.513856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.513858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.513860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.513863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.513884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:36.517231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:36.518026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:36.518038Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:36.518039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:36.518042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:36.518046Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1141 [2:7556255520262567297:8405]
2025-10-01T14:10:36.518058Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:36.518070Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:36.518076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.518078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.518080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.518091Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:36.518095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:36.518099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:36.518144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.518149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.518150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.518152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:36.518154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:36.518200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:36.518205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.518212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.518217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.518226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:36.518240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255520262567292:8405]
2025-10-01T14:10:36.518245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255520262567292:8405]
2025-10-01T14:10:36.518246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255520262567292:8405]
2025-10-01T14:10:36.518254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:36.518263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:36.518266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:36.518270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:36.518274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:36.518275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:36.518276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:36.518283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445297:9700], now have 1 active actors on pipe
2025-10-01T14:10:36.518285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445082:2446], now have 1 active actors on pipe
2025-10-01T14:10:36.518300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255520262567292:8405]
2025-10-01T14:10:36.518310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:36.518330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:36.518346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1141
2025-10-01T14:10:36.518347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1141
2025-10-01T14:10:36.518458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.518475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.518505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:36.518517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.518521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.518523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:36.518532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.518544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:36.518576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.518773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.518782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.518796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.518909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1142 partition: 0 MaxSeqNo: 45 sessionId: src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0
2025-10-01T14:10:36.519272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1043f5f4-b12f5a80-81b27b4d-d16e81fe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:36.522351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0] Write session: try to update token
2025-10-01T14:10:36.522390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:36.528312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:36.528330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:36.528337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255520262567292:8405]
2025-10-01T14:10:36.528372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:36.528386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:36.528512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:36.528620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:36.528744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:36.528859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:36.529073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:36.529101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:36.537723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1142 sessionId: src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:36.539923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:36.540215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.540237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.540267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:36.540330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:36.546044Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:36.546060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:36.546064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:36.546066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:36.546074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255520262567292:8405]
2025-10-01T14:10:36.546076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255520262567292:8405]
2025-10-01T14:10:36.546080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255520262567292:8405]
2025-10-01T14:10:36.546116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:36.546124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.546126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:36.546136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:36.546142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:36.546148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:36.546239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:36.595226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255522639445310:9460]
2025-10-01T14:10:36.595552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1141, pipe: [1:7556255522639445310:9460]
2025-10-01T14:10:36.682293Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:36.689421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.689446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.689587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.689647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.689698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.689749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.690004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.690015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.690073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.690125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.690175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.690226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.690264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.690269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.690327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.690414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.690467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.690529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.690572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.690578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.690642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.690696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.690747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.690799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.690851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.690857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.690910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.690960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.691020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.691076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.691119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.691125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.691181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.691233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.691285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.691337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.691377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.691385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.691440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.691492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.691559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.691612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.691715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.691721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.691779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.691828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.691885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.691949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.692060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.692068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.692121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.692170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.692228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.692280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.692378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.692383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.692436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:36.692486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:36.692547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:36.692602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:36.692642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:36.692646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:36.692683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445310:9460], now have 1 active actors on pipe
2025-10-01T14:10:36.692862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:36.692876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255522639445310:9460]
2025-10-01T14:10:36.692899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:36.692901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:36.692926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1142 reason: error at write: Disconnected sessionId: src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0
2025-10-01T14:10:36.693119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1142 sessionId: src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0 is DEAD
2025-10-01T14:10:36.693196Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:36.693252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:36.693263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0] Write session will restart in 0.008249s
2025-10-01T14:10:36.693283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0] Write session: Do CDS request
2025-10-01T14:10:36.693287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:36.702788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.702924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:36.702939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1143
2025-10-01T14:10:36.703041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.703066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:36.703074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:36.703077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:36.703390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1143 sessionId:  describe result for acl check
2025-10-01T14:10:36.703424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:36.703425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:36.703426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:36.703429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255522639445493:9704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:36.704011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255522639445493:9704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:36.706271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255522639445493:9704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:36.707858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:36.708273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:36.708406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:36.708417Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:36.708426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:36.708467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:36.708502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255520262567529:8408]
2025-10-01T14:10:36.708834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255522639445493:9704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:36.708846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255522639445493:9704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:36.708848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255522639445493:9704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:36.708855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:36.708917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:36.709107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:36.709134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:36.709332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:36.709369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.709376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.709376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.709377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.709378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.709378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.709379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.709380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.709380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.709381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.709381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.709382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.709383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.709383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.709386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.709392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.709394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.709396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.709398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.709400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.709402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.709404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.709406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.709408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.709410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.709412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.709414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.709416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.709421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.709425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.709429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.709431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.709434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.709439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.709443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.709448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.709452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.709457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.709461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.709470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.709473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.709475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.709479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.709484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.709487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.709489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.709491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.709494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.709501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.709504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.709509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.709512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.709514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.709520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.709522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.709525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.709545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:36.712760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:36.713536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:36.713551Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:36.713552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:36.713555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:36.713561Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1142 [2:7556255520262567529:8408]
2025-10-01T14:10:36.713571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:36.713581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:36.713587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.713589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.713591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.713601Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:36.713607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:36.713611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:36.713647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.713651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.713652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.713655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:36.713656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:36.713698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:36.713704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.713710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.713715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.713724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:36.713739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445531:9704], now have 1 active actors on pipe
2025-10-01T14:10:36.713744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445313:2446], now have 1 active actors on pipe
2025-10-01T14:10:36.713750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255520262567524:8408]
2025-10-01T14:10:36.713752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255520262567524:8408]
2025-10-01T14:10:36.713754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255520262567524:8408]
2025-10-01T14:10:36.713764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:36.713771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:36.713776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:36.713780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:36.713781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:36.713788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:36.713790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:36.713807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255520262567524:8408]
2025-10-01T14:10:36.713817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:36.713824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:36.713812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1142
2025-10-01T14:10:36.713815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1142
2025-10-01T14:10:36.713844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.713852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.713874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:36.713882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.713884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.713885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:36.713891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.713898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:36.713914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.714005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.714012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.714023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.714087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1143 partition: 0 MaxSeqNo: 45 sessionId: src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0
2025-10-01T14:10:36.714446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2ab7a85-ba370bc6-24b010a4-f163d899_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:36.717109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0] Write session: try to update token
2025-10-01T14:10:36.717122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:36.732787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:36.732807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:36.732810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:36.732812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:36.732820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255520262567524:8408]
2025-10-01T14:10:36.732825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255520262567524:8408]
2025-10-01T14:10:36.732830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255520262567524:8408]
2025-10-01T14:10:36.732867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:36.732871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:36.732874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:36.732875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:36.732881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.732884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:36.733009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:36.734681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1143 sessionId: src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:36.736909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:36.792881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255522639445545:9460]
2025-10-01T14:10:36.793133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1142, pipe: [1:7556255522639445545:9460]
2025-10-01T14:10:36.875235Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:36.875923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.875944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.875990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445545:9460], now have 1 active actors on pipe
2025-10-01T14:10:36.876225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:36.876218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:36.876230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:36.876250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255522639445545:9460]
2025-10-01T14:10:36.876271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:36.876284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1143 reason: error at write: Disconnected sessionId: src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0
2025-10-01T14:10:36.876517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1143 sessionId: src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0 is DEAD
2025-10-01T14:10:36.876733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:36.876747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0] Write session will restart in 0.006491s
2025-10-01T14:10:36.876771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0] Write session: Do CDS request
2025-10-01T14:10:36.876777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:36.884913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.885111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:36.885124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1144
2025-10-01T14:10:36.885297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:36.885341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:36.885347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:36.885355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:36.885706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1144 sessionId:  describe result for acl check
2025-10-01T14:10:36.885733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:36.885737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:36.885738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:36.885742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255522639445617:9710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:36.886210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255522639445617:9710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:36.888794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255522639445617:9710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:36.891272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255522639445617:9710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:36.891284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255522639445617:9710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:36.891288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255522639445617:9710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:36.891295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:36.891834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:36.895813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:36.896054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:36.896067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:36.896079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:36.896133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:36.896183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255520262567755:8411]
2025-10-01T14:10:36.896773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:36.897118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:36.897178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:36.897517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:36.897579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.897584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.897585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.897587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.897588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.897589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.897591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.897593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.897594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.897595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.897596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.897598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.897599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.897600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.897606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.897617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.897621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.897625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.897629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.897634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.897638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.897642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.897645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.897648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.897652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.897656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.897659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.897663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.897670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.897678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:36.897688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.897694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:36.897702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.897708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:36.897715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.897720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:36.897724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.897729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:36.897734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.897739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:36.897744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.897753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:36.897762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.897768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:36.897776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.897781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:36.897798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.897808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.897816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.897826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.897833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.897838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.897843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.897848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:36.897855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.897863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:36.897902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:36.902069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:36.902774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:36.902788Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:36.902791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:36.902794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:36.902802Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1143 [2:7556255520262567755:8411]
2025-10-01T14:10:36.902819Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:36.902837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:36.902844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.902848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.902850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.902872Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:36.902882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:36.902889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:36.902944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.902951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.902953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.902956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:36.902959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:36.903034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:36.903040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.903053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:36.903068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:36.903088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:36.903111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445559:2446], now have 1 active actors on pipe
2025-10-01T14:10:36.903118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445776:9710], now have 1 active actors on pipe
2025-10-01T14:10:36.903129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255520262567750:8411]
2025-10-01T14:10:36.903135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255520262567750:8411]
2025-10-01T14:10:36.903137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255520262567750:8411]
2025-10-01T14:10:36.903152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:36.903168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:36.903171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:36.903180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:36.903182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:36.903184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:36.903187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:36.903200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1143
2025-10-01T14:10:36.903223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255520262567750:8411]
2025-10-01T14:10:36.903231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:36.903233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:36.903206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1143
2025-10-01T14:10:36.903258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.903266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.903300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:36.903309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:36.903317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:36.903319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:36.903329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:36.903340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:36.903362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.903472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:36.903482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:36.903498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:36.903601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1144 partition: 0 MaxSeqNo: 45 sessionId: src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0
2025-10-01T14:10:36.904039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a76187d-cd3e1ada-1873d169-d3c2cfdc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:36.907207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0] Write session: try to update token
2025-10-01T14:10:36.907226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:36.925694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1144 sessionId: src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:36.927560Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:36.927582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:36.927584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:36.927588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:36.927596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255520262567750:8411]
2025-10-01T14:10:36.927599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255520262567750:8411]
2025-10-01T14:10:36.927602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255520262567750:8411]
2025-10-01T14:10:36.927648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:36.927651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:36.927655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:36.927657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:36.927658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:36.927658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:36.927792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:36.928870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:36.976174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255522639445790:9460]
2025-10-01T14:10:36.976411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1143, pipe: [1:7556255522639445790:9460]
2025-10-01T14:10:37.061676Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:37.062079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.062091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.062313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:37.062326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255522639445790:9460]
2025-10-01T14:10:37.062340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:37.062123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255522639445790:9460], now have 1 active actors on pipe
2025-10-01T14:10:37.062290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:37.062416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1144 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0
2025-10-01T14:10:37.062519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1144 sessionId: src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0 is DEAD
2025-10-01T14:10:37.062597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:37.062605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0] Write session will restart in 0.005509s
2025-10-01T14:10:37.062626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0] Write session: Do CDS request
2025-10-01T14:10:37.062630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:37.068815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.068900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:37.068916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1145
2025-10-01T14:10:37.069086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.069125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:37.069136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:37.069141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:37.069528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1145 sessionId:  describe result for acl check
2025-10-01T14:10:37.069559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:37.069573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:37.069578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:37.069581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255526934413122:9716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:37.070060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255526934413122:9716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:37.073023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255526934413122:9716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:37.075583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255526934413122:9716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:37.075596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255526934413122:9716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:37.075598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255526934413122:9716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:37.075607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:37.080150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:37.080591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:37.080782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:37.080794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:37.080806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:37.080867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:37.080938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255524557535274:8413]
2025-10-01T14:10:37.081491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:37.081767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:37.081820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:37.082110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:37.082189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.082196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.082197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.082198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.082199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.082200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.082202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.082203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.082204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.082205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.082207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.082208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.082209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.082210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.082216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.082226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.082229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.082233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.082237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.082241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.082245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.082254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.082262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.082266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.082275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.082279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.082286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.082290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.082302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.082314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.082324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.082330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.082336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.082346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.082350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.082359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.082364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.082386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.082394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.082399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.082404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.082414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.082418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.082427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.082432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.082440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.082444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.082449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.082459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.082464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.082470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.082475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.082482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.082487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.082493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.082502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.082539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:37.086564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:37.087539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:37.087555Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:37.087557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:37.087561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:37.087568Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1144 [2:7556255524557535274:8413]
2025-10-01T14:10:37.087582Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:37.087601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:37.087608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.087611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.087614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.087629Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:37.087638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:37.087647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:37.087703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.087710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.087713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.087716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:37.087718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:37.087782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:37.087790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.087802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.087814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.087837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:37.087858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413307:9716], now have 1 active actors on pipe
2025-10-01T14:10:37.087866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413091:2446], now have 1 active actors on pipe
2025-10-01T14:10:37.087872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255524557535269:8413]
2025-10-01T14:10:37.087882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255524557535269:8413]
2025-10-01T14:10:37.087884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255524557535269:8413]
2025-10-01T14:10:37.087898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:37.087910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:37.087912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:37.087915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:37.087917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:37.087930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:37.087933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:37.087909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1144
2025-10-01T14:10:37.087955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255524557535269:8413]
2025-10-01T14:10:37.087934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1144
2025-10-01T14:10:37.087962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:37.087964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:37.087979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.087988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.088033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:37.088043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.088047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.088050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:37.088059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.088071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:37.088093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.088213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.088221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.088234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.088303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1145 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0
2025-10-01T14:10:37.088616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a6455bf-b0dbc215-760d24a2-657b5f4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:37.091197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0] Write session: try to update token
2025-10-01T14:10:37.091211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:37.103346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1145 sessionId: src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:37.105442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:37.105812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.105830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.105867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:37.105971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:37.109673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:37.109689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:37.109692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:37.109694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:37.109702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255524557535269:8413]
2025-10-01T14:10:37.109709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255524557535269:8413]
2025-10-01T14:10:37.109713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255524557535269:8413]
2025-10-01T14:10:37.109757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:37.109758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:37.109765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.109766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:37.109768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:37.109770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:37.109904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:37.162524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255526934413345:9460]
2025-10-01T14:10:37.162751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1144, pipe: [1:7556255526934413345:9460]
2025-10-01T14:10:37.246147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:37.253536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.253557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.253680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.253739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.253798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.253859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.253900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.253907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.253970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.254025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.254086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.254146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.254188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.254196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.254254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.254305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.254357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.254441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.254482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.254487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.254543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.254598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.254655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.254709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.254750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.254754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.254809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.254862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.254918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.254972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.255012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.255017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.255073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.255126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.255182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.255243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.255292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.255300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.255366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.255421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.255478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.255537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.255578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.255583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.255640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.255694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.255748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.255820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.255872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.255879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.255950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.256013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.256078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.256149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.256195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.256202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.256263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.256319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.256381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.256443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.256485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.256490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.256534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413345:9460], now have 1 active actors on pipe
2025-10-01T14:10:37.256761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255526934413345:9460]
2025-10-01T14:10:37.256788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:37.256796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:37.256799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:37.256823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1145 reason: error at write: Disconnected sessionId: src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0
2025-10-01T14:10:37.257025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1145 sessionId: src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0 is DEAD
2025-10-01T14:10:37.257181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:37.257193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0] Write session will restart in 0.006118s
2025-10-01T14:10:37.257214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0] Write session: Do CDS request
2025-10-01T14:10:37.257219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:37.257526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:37.265095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.265162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:37.265177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1146
2025-10-01T14:10:37.265299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.265329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:37.265337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:37.265341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:37.265785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1146 sessionId:  describe result for acl check
2025-10-01T14:10:37.265818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:37.265823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:37.265825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:37.265830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255526934413405:9727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:37.266312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255526934413405:9727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:37.269361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255526934413405:9727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:37.271919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255526934413405:9727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:37.271930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255526934413405:9727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:37.271933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255526934413405:9727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:37.271941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:37.272692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:37.275975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:37.276207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:37.276218Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:37.276229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:37.276280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:37.276325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255524557535519:8423]
2025-10-01T14:10:37.276941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:37.277189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:37.277227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:37.277526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:37.277577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.277582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.277583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.277584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.277585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.277587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.277588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.277589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.277590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.277591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.277592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.277594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.277595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.277595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.277600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.277610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.277614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.277619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.277622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.277626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.277629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.277636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.277640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.277647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.277651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.277655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.277662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.277666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.277675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.277687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.277697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.277705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.277713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.277748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.277756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.277767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.277775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.277783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.277791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.277796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.277802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.277811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.277818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.277822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.277830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.277838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.277847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.277854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.277860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.277867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.277874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.277879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.277886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.277890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.277897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.277902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.277943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:37.281655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:37.282470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:37.282483Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:37.282486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:37.282489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:37.282496Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1145 [2:7556255524557535519:8423]
2025-10-01T14:10:37.282511Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:37.282529Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:37.282536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.282539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.282546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.282562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:37.282572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:37.282582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:37.282636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.282642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.282644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.282647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:37.282650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:37.282715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:37.282727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.282739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.282750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.282767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:37.282784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413566:9727], now have 1 active actors on pipe
2025-10-01T14:10:37.282788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413347:2446], now have 1 active actors on pipe
2025-10-01T14:10:37.282795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255524557535514:8423]
2025-10-01T14:10:37.282797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255524557535514:8423]
2025-10-01T14:10:37.282799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255524557535514:8423]
2025-10-01T14:10:37.282813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:37.282825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:37.282829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:37.282829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:37.282831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:37.282842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:37.282849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:37.282875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255524557535514:8423]
2025-10-01T14:10:37.282882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:37.282894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:37.282862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1145
2025-10-01T14:10:37.283116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1145
2025-10-01T14:10:37.283172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.283185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.283212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:37.283225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.283230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.283232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:37.283241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.283251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:37.283266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.283405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.283411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.283423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.283492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1146 partition: 0 MaxSeqNo: 45 sessionId: src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0
2025-10-01T14:10:37.283875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea1ac96-2cc39b31-178e5f2-e904a473_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:37.286696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0] Write session: try to update token
2025-10-01T14:10:37.286713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:37.299301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:37.299320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:37.299332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255524557535514:8423]
2025-10-01T14:10:37.299376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:37.299394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:37.299535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:37.299674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:37.299814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:37.299955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:37.300138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:37.300175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:37.300626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1146 sessionId: src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:37.303217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:37.303402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.303417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.303446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:37.303515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:37.312927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:37.312944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:37.312946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:37.312948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:37.312959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255524557535514:8423]
2025-10-01T14:10:37.312963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255524557535514:8423]
2025-10-01T14:10:37.312970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255524557535514:8423]
2025-10-01T14:10:37.313019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:37.313025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:37.313028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:37.313029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:37.313034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.313036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:37.313321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:37.357091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255526934413585:9460]
2025-10-01T14:10:37.357335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1145, pipe: [1:7556255526934413585:9460]
2025-10-01T14:10:37.470859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:37.480300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.480355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.480565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.480633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.480703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.480802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.480844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.480850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.480923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.480985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.481047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.481115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.481161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.481165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.481246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.481308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.481371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.481437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.481483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.481486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.481564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.481630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.481701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.481780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.481827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.481830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.481904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.481970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.482030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.482095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.482137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.482140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.482213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.482275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.482343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.482609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.482666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.482675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.482768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.482848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.482924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.485847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255526934413585:9460]
2025-10-01T14:10:37.485878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:37.486219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:37.486228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:37.486255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1146 reason: error at write: Disconnected sessionId: src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0
2025-10-01T14:10:37.486528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1146 sessionId: src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0 is DEAD
2025-10-01T14:10:37.482996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.483050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.483053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.483170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.483234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.483298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.483367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.483409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.483412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.483487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.483551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.483619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.483684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.483731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.483734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.483816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:37.483883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:37.483949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:37.484014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:37.484056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:37.484061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:37.484144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413585:9460], now have 1 active actors on pipe
2025-10-01T14:10:37.487461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:37.487476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0] Write session will restart in 0.009868s
2025-10-01T14:10:37.487507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0] Write session: Do CDS request
2025-10-01T14:10:37.487480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:37.487514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:37.498991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.499049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:37.499062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1147
2025-10-01T14:10:37.499301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.499333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:37.499342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:37.499345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:37.499869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1147 sessionId:  describe result for acl check
2025-10-01T14:10:37.499904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:37.499911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:37.499913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:37.499919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255526934413665:9732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:37.500419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255526934413665:9732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:37.503374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255526934413665:9732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:37.506951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255526934413665:9732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:37.506965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255526934413665:9732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:37.506969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255526934413665:9732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:37.506976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:37.511919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:37.512438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:37.512605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:37.512617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:37.512627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:37.512666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:37.512699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255524557535763:8430]
2025-10-01T14:10:37.513298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:37.513580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:37.513620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:37.513904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:37.513954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.513959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.513960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.513961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.513962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.513964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.513965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.513966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.513967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.513968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.513970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.513970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.513972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.513972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.513977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.513986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.513990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.513994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.513997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.514001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.514009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.514012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.514016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.514020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.514023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.514027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.514031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.514034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.514041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.514052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.514063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.514071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.514080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.514088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.514096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.514100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.514108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.514117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.514136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.514145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.514149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.514154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.514161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.514166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.514173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.514178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.514185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.514190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.514198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.514202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.514210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.514215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.514227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.514231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.514235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.514240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.514274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:37.517747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:37.518537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:37.518549Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:37.518552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:37.518555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:37.518561Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1146 [2:7556255524557535763:8430]
2025-10-01T14:10:37.518579Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:37.518598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:37.518606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.518609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.518611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.518626Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:37.518635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:37.518643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:37.518702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.518710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.518712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.518716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:37.518718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:37.518788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:37.518796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.518806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.518822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.518841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:37.518866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413811:9732], now have 1 active actors on pipe
2025-10-01T14:10:37.518873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413591:2446], now have 1 active actors on pipe
2025-10-01T14:10:37.518881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255524557535758:8430]
2025-10-01T14:10:37.518887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255524557535758:8430]
2025-10-01T14:10:37.518889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255524557535758:8430]
2025-10-01T14:10:37.518902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:37.518912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:37.518920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:37.518920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:37.518922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:37.518934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:37.518936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:37.518917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1146
2025-10-01T14:10:37.518918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1146
2025-10-01T14:10:37.518959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255524557535758:8430]
2025-10-01T14:10:37.518969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:37.518973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:37.518995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.519004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.519046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:37.519057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.519061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.519063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:37.519074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.519087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:37.519107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.519222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.519230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.519245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.519298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1147 partition: 0 MaxSeqNo: 45 sessionId: src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0
2025-10-01T14:10:37.519673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96df0bf5-5d822988-37d0f3a8-6e7e3cca_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:37.522275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0] Write session: try to update token
2025-10-01T14:10:37.522288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:37.536477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1147 sessionId: src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:37.538114Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:37.538131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:37.538134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:37.538136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:37.538145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255524557535758:8430]
2025-10-01T14:10:37.538151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255524557535758:8430]
2025-10-01T14:10:37.538155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255524557535758:8430]
2025-10-01T14:10:37.538196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:37.538202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:37.538209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:37.538210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.538212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:37.538213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:37.538347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:37.538558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:37.585950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255526934413824:9460]
2025-10-01T14:10:37.586180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1146, pipe: [1:7556255526934413824:9460]
2025-10-01T14:10:37.678738Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:37.679285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.679296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.679328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413824:9460], now have 1 active actors on pipe
2025-10-01T14:10:37.679542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:37.679553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:37.679549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:37.679562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255526934413824:9460]
2025-10-01T14:10:37.679580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:37.679609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1147 reason: error at write: Disconnected sessionId: src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0
2025-10-01T14:10:37.679807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1147 sessionId: src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0 is DEAD
2025-10-01T14:10:37.679967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:37.679978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0] Write session will restart in 0.008787s
2025-10-01T14:10:37.680000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0] Write session: Do CDS request
2025-10-01T14:10:37.680004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:37.689853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.690005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:37.690019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1148
2025-10-01T14:10:37.690161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.690196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:37.690207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:37.690210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:37.690595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1148 sessionId:  describe result for acl check
2025-10-01T14:10:37.690627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:37.690634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:37.690637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:37.690642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255526934414013:9736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:37.691107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255526934414013:9736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:37.691429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:37.692542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255526934414013:9736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:37.694292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:37.694466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:37.694474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:37.694485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:37.694533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:37.694563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255524557536000:8433]
2025-10-01T14:10:37.694751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255526934414013:9736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:37.694761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255526934414013:9736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:37.694765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255526934414013:9736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:37.694771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:37.694939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:37.695106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:37.695132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:37.695311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:37.695345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.695349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.695349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.695350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.695351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.695351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.695352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.695353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.695353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.695354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.695354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.695355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.695355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.695356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.695359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.695364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.695366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.695368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.695371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.695373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.695375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.695376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.695379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.695381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.695383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.695385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.695387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.695389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.695394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.695399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.695402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.695405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.695407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.695410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.695412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.695415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.695417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.695420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.695422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.695425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.695427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.695430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.695432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.695434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.695438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.695447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.695455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.695460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.695469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.695473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.695478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.695481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.695483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.695486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.695492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.695495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.695514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:37.698785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:37.699770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:37.699783Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:37.699785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:37.699787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:37.699794Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1147 [2:7556255524557536000:8433]
2025-10-01T14:10:37.699803Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:37.699814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:37.699816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.699818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.699819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.699830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:37.699833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:37.699837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:37.699873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.699878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.699879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.699881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:37.699882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:37.699930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:37.699935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.699941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.699947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.699959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:37.699974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255524557535994:8433]
2025-10-01T14:10:37.699979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255524557535994:8433]
2025-10-01T14:10:37.699980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255524557535994:8433]
2025-10-01T14:10:37.699986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:37.699995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:37.699997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934413827:2446], now have 1 active actors on pipe
2025-10-01T14:10:37.699999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934414050:9736], now have 1 active actors on pipe
2025-10-01T14:10:37.700000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:37.700002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:37.700004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:37.700012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:37.700013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:37.700030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255524557535994:8433]
2025-10-01T14:10:37.700038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:37.700045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:37.700055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1147
2025-10-01T14:10:37.700070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1147
2025-10-01T14:10:37.700125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.700134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.700151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:37.700158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.700160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.700162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:37.700167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.700172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:37.700182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.700284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.700289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.700298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.700359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1148 partition: 0 MaxSeqNo: 45 sessionId: src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0
2025-10-01T14:10:37.700701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b37348-b3f0f1b6-f12e45c-7019595e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:37.703450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0] Write session: try to update token
2025-10-01T14:10:37.703469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:37.717998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1148 sessionId: src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:37.718774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:37.718789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:37.718792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:37.718794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:37.718802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255524557535994:8433]
2025-10-01T14:10:37.718807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255524557535994:8433]
2025-10-01T14:10:37.718810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255524557535994:8433]
2025-10-01T14:10:37.718856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:37.718868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.718870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:37.718912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:37.718925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:37.718931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:37.718988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:37.720127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:37.779485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255526934414063:9460]
2025-10-01T14:10:37.779657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1147, pipe: [1:7556255526934414063:9460]
2025-10-01T14:10:37.851732Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:37.851953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.851965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.851999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934414063:9460], now have 1 active actors on pipe
2025-10-01T14:10:37.852207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:37.852250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:37.852264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:37.852294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255526934414063:9460]
2025-10-01T14:10:37.852391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1148 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0
2025-10-01T14:10:37.852554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1148 sessionId: src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0 is DEAD
2025-10-01T14:10:37.852690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:37.852698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0] Write session will restart in 0.008415s
2025-10-01T14:10:37.852725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0] Write session: Do CDS request
2025-10-01T14:10:37.852730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:37.861902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.861947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:37.861957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1149
2025-10-01T14:10:37.862074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:37.862097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:37.862101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:37.862103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:37.862410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1149 sessionId:  describe result for acl check
2025-10-01T14:10:37.862433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:37.862437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:37.862439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:37.862442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255526934414226:9742] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:37.862803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255526934414226:9742] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:37.864510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255526934414226:9742] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:37.864536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:37.867719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:37.867826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255526934414226:9742] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:37.867835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255526934414226:9742] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:37.867840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255526934414226:9742] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:37.867846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:37.867863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:37.867873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:37.867883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:37.867924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:37.867954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255524557536227:8435]
2025-10-01T14:10:37.868351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:37.868582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:37.868626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:37.868873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:37.868909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.868914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.868914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.868915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.868916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.868917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.868918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.868918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.868919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.868920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.868920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.868921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.868921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.868922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.868925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.868931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.868933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.868936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.868938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.868940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.868942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.868944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.868947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.868949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.868951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.868953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.868955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.868958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.868962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.868967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:37.868970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.868973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:37.868977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.868981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:37.868983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.868986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:37.868988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.868991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:37.868993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.868996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:37.868998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.869001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:37.869003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.869006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:37.869008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.869010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:37.869013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.869015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.869018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.869020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.869022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.869025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.869027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.869030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:37.869032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.869034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:37.869053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:37.872296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:37.872820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:37.872831Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:37.872833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:37.872835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:37.872840Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1148 [2:7556255524557536227:8435]
2025-10-01T14:10:37.872849Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:37.872859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:37.872865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.872867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.872868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.872880Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:37.872886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:37.872890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:37.872926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.872930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.872931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.872934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:37.872936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:37.872980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:37.872985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.872991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:37.872996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:37.873008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:37.873022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934414077:2446], now have 1 active actors on pipe
2025-10-01T14:10:37.873028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934414302:9742], now have 1 active actors on pipe
2025-10-01T14:10:37.873035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255524557536222:8435]
2025-10-01T14:10:37.873040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255524557536222:8435]
2025-10-01T14:10:37.873042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255524557536222:8435]
2025-10-01T14:10:37.873054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:37.873063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:37.873068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:37.873069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:37.873071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:37.873079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:37.873085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:37.873091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1148
2025-10-01T14:10:37.873109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255524557536222:8435]
2025-10-01T14:10:37.873104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1148
2025-10-01T14:10:37.873116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:37.873117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:37.873139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.873148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.873180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91144e06-fb8e5305-242e522f-daf2ce85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:37.873190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:37.873197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:37.873199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:37.873206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:37.873217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:37.873239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.873338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.873345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.873359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:37.873419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1149 partition: 0 MaxSeqNo: 45 sessionId: src_id|91144e06-fb8e5305-242e522f-daf2ce85_0
2025-10-01T14:10:37.873679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12457ca-8e5937b1-63aa9c28-37d7d113_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|91144e06-fb8e5305-242e522f-daf2ce85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:37.876215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91144e06-fb8e5305-242e522f-daf2ce85_0] Write session: try to update token
2025-10-01T14:10:37.876230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91144e06-fb8e5305-242e522f-daf2ce85_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:37.888158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1149 sessionId: src_id|91144e06-fb8e5305-242e522f-daf2ce85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:37.890297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:37.890509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:37.890530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:37.892335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:37.892349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:37.892351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:37.892352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:37.892361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255524557536222:8435]
2025-10-01T14:10:37.892365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255524557536222:8435]
2025-10-01T14:10:37.892368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255524557536222:8435]
2025-10-01T14:10:37.892406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:37.892412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:37.892417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:37.892421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:37.892426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:37.892432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:37.892434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:37.892495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:37.892571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:37.952524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255526934414314:9460]
2025-10-01T14:10:37.952738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1148, pipe: [1:7556255526934414314:9460]
2025-10-01T14:10:38.034469Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:38.042636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.042665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.042834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.042897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.042962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.043036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.043082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.043091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.043162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.043226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.043291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.043359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.043406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.043414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.043473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.043527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.043588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.043649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.043692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.043700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.043759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.043824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.043889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.043951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.044004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.044010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.044074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.044129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.044184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.044268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.044314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.044318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.044414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.044471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.044531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.044597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.044723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.044730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.044792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.044851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.044919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.044986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.045031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.045038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.045104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.045164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.045225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.045288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.045333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.045340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.045414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.045477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.045541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.045604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.045654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.045662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.045733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.045794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.045859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.045917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.046031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.046037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.046094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255526934414314:9460], now have 1 active actors on pipe
2025-10-01T14:10:38.046282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:38.046317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255526934414314:9460]
2025-10-01T14:10:38.046336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:38.046346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:38.046384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1149 reason: error at write: Disconnected sessionId: src_id|91144e06-fb8e5305-242e522f-daf2ce85_0
2025-10-01T14:10:38.046608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1149 sessionId: src_id|91144e06-fb8e5305-242e522f-daf2ce85_0 is DEAD
2025-10-01T14:10:38.046748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91144e06-fb8e5305-242e522f-daf2ce85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:38.046757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91144e06-fb8e5305-242e522f-daf2ce85_0] Write session will restart in 0.009573s
2025-10-01T14:10:38.046793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91144e06-fb8e5305-242e522f-daf2ce85_0] Write session: Do CDS request
2025-10-01T14:10:38.046800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91144e06-fb8e5305-242e522f-daf2ce85_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:38.047118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:38.057941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91144e06-fb8e5305-242e522f-daf2ce85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.058060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:38.058080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1150
2025-10-01T14:10:38.058231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.058274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:38.058284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:38.058288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:38.058719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1150 sessionId:  describe result for acl check
2025-10-01T14:10:38.058758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:38.058764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:38.058765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:38.058783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255531229381798:9746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:38.059288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255531229381798:9746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:38.061361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255531229381798:9746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:38.064116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:38.064304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255531229381798:9746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:38.064314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255531229381798:9746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:38.064317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255531229381798:9746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:38.064323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:38.064529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:38.064676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:38.064685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:38.064694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:38.064750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:38.064785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255528852503754:8438]
2025-10-01T14:10:38.065285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:38.065530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:38.065584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:38.065865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:38.065909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.065916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.065917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.065917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.065919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.065919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.065920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.065921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.065922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.065923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.065924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.065925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.065926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.065927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.065932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.065941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.065944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.065947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.065950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.065953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.065957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.065961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.065964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.065968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.065971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.065974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.065977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.065980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.065986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.065993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.065998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.066002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.066007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.066011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.066015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.066019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.066023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.066028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.066033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.066038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.066046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.066050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.066057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.066060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.066064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.066073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.066076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.066080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.066086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.066090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.066097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.066101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.066105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.066108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.066112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.066116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.066145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:38.069618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:38.070235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:38.070247Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:38.070249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:38.070252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:38.070258Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1149 [2:7556255528852503754:8438]
2025-10-01T14:10:38.070270Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:38.070285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:38.070288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.070291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.070293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.070308Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:38.070325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:38.070334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:38.070398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.070403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.070404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.070407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:38.070409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:38.070465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:38.070471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.070481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.070494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.070510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:38.070530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229381612:2446], now have 1 active actors on pipe
2025-10-01T14:10:38.070536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229381837:9746], now have 1 active actors on pipe
2025-10-01T14:10:38.070543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255528852503748:8438]
2025-10-01T14:10:38.070545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255528852503748:8438]
2025-10-01T14:10:38.070547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255528852503748:8438]
2025-10-01T14:10:38.070558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:38.070574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:38.070573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:38.070550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1149
2025-10-01T14:10:38.070577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:38.070561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1149
2025-10-01T14:10:38.070579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:38.070591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:38.070594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:38.070635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.070643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.070656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255528852503748:8438]
2025-10-01T14:10:38.070666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:38.070673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:38.070690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:38.070700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.070707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.070710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:38.070718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.070730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:38.070751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.070888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.070901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.070924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.070995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1150 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0
2025-10-01T14:10:38.071349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91144e06-fb8e5305-242e522f-daf2ce85_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:38.073775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0] Write session: try to update token
2025-10-01T14:10:38.073789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:38.087233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1150 sessionId: src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:38.089667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:38.091023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.091048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.091069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:38.091072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:38.091074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:38.091076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:38.091084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255528852503748:8438]
2025-10-01T14:10:38.091088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255528852503748:8438]
2025-10-01T14:10:38.091092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255528852503748:8438]
2025-10-01T14:10:38.091132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:38.091145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:38.091149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:38.091151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:38.091155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.091158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:38.091284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:38.146605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255531229381862:9460]
2025-10-01T14:10:38.146962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1149, pipe: [1:7556255531229381862:9460]
2025-10-01T14:10:38.233095Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:38.233689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:38.233744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229381862:9460], now have 1 active actors on pipe
2025-10-01T14:10:38.233856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:38.233975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255531229381862:9460]
2025-10-01T14:10:38.233997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:38.245261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:38.245271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:38.245296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1150 reason: error at write: Disconnected sessionId: src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0
2025-10-01T14:10:38.245440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1150 sessionId: src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0 is DEAD
2025-10-01T14:10:38.245537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:38.245548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0] Write session will restart in 0.005610s
2025-10-01T14:10:38.245576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0] Write session: Do CDS request
2025-10-01T14:10:38.245585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:38.251972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.251970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:38.251984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1151
2025-10-01T14:10:38.252266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.252306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:38.252329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:38.252334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:38.252827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1151 sessionId:  describe result for acl check
2025-10-01T14:10:38.252871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:38.252877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:38.252879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:38.252883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255531229382063:9757] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:38.253284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255531229382063:9757] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:38.254993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:38.255347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:38.255516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:38.255528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:38.255540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:38.255601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:38.255646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255528852503989:8442]
2025-10-01T14:10:38.256249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:38.256232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255531229382063:9757] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:38.256452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:38.256507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:38.256815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:38.256890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.256897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.256898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.256899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.256900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.256902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.256903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.256905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.256906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.256907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.256908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.256910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.256911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.256912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.256917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.256926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.256930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.256933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.256936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.256941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.256944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.256947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.256950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.256953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.256956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.256960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.256963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.256967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.256973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.256981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.256989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.256993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.256998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.257003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.257008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.257012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.257016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.257027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.257031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.257035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.257045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.257050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.257077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.257088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.257093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.257103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.257107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.257112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.257124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.257128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.257135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.257141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.257145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.257155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.257159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.257163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.257204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:38.260602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255531229382063:9757] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:38.260614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255531229382063:9757] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:38.260616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255531229382063:9757] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:38.260622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:38.260914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:38.261636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:38.261650Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:38.261651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:38.261655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:38.261660Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1150 [2:7556255528852503989:8442]
2025-10-01T14:10:38.261671Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:38.261683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:38.261685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.261687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.261689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.261699Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:38.261702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:38.261706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:38.261752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.261760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.261761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.261763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:38.261765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:38.261823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:38.261830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.261837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.261843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.261852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:38.261866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255528852503984:8442]
2025-10-01T14:10:38.261872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255528852503984:8442]
2025-10-01T14:10:38.261874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255528852503984:8442]
2025-10-01T14:10:38.261899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:38.261913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:38.261916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:38.261918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:38.261918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229381873:2446], now have 1 active actors on pipe
2025-10-01T14:10:38.261922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382102:9757], now have 1 active actors on pipe
2025-10-01T14:10:38.261929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:38.261937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:38.261945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:38.261939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1150
2025-10-01T14:10:38.261965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255528852503984:8442]
2025-10-01T14:10:38.261972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:38.261975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:38.262001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1150
2025-10-01T14:10:38.262597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.262611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.262632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:38.262644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.262648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.262650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:38.262657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.262672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:38.262693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.262839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.262846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.262859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.262916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1151 partition: 0 MaxSeqNo: 45 sessionId: src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0
2025-10-01T14:10:38.263231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a1a6d5f-d9cc89cd-2e781217-85511e8b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:38.266022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0] Write session: try to update token
2025-10-01T14:10:38.266035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:38.281622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:38.281644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:38.281647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:38.281650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:38.281664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255528852503984:8442]
2025-10-01T14:10:38.281668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255528852503984:8442]
2025-10-01T14:10:38.281673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255528852503984:8442]
2025-10-01T14:10:38.281725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:38.281731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:38.281738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:38.281738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.281741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:38.281742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:38.282076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:38.282976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1151 sessionId: src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:38.286043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:38.334003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255531229382115:9460]
2025-10-01T14:10:38.334289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1150, pipe: [1:7556255531229382115:9460]
2025-10-01T14:10:38.412887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:38.413142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.413155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.413190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382115:9460], now have 1 active actors on pipe
2025-10-01T14:10:38.413350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:38.413418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:38.413426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:38.413471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255531229382115:9460]
2025-10-01T14:10:38.413479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1151 reason: error at write: Disconnected sessionId: src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0
2025-10-01T14:10:38.413492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:38.413643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1151 sessionId: src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0 is DEAD
2025-10-01T14:10:38.413766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:38.413774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0] Write session will restart in 0.005030s
2025-10-01T14:10:38.413795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0] Write session: Do CDS request
2025-10-01T14:10:38.413799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:38.419789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.419921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:38.419930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1152
2025-10-01T14:10:38.420061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.420085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:38.420091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:38.420094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:38.420482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1152 sessionId:  describe result for acl check
2025-10-01T14:10:38.420519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:38.420526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:38.420528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:38.420532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255531229382163:9762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:38.421001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255531229382163:9762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:38.423170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255531229382163:9762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:38.425106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255531229382163:9762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:38.425118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255531229382163:9762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:38.425120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255531229382163:9762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:38.425126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:38.429479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:38.429882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:38.429996Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:38.430004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:38.430010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:38.430038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:38.430065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255528852504251:8454]
2025-10-01T14:10:38.430463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:38.430739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:38.430808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:38.431128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:38.431211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.431219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.431220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.431222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.431223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.431224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.431225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.431226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.431227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.431228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.431229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.431230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.431231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.431232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.431238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.431247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.431251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.431254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.431257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.431260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.431264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.431267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.431270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.431273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.431276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.431280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.431283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.431286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.431296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.431303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.431309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.431314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.431318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.431322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.431326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.431331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.431334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.431339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.431343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.431347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.431352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.431357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.431360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.431365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.431369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.431375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.431378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.431388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.431392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.431396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.431399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.431402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.431409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.431412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.431415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.431419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.431452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:38.434724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:38.435727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:38.435739Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:38.435740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:38.435742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:38.435747Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1151 [2:7556255528852504251:8454]
2025-10-01T14:10:38.435758Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:38.435770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:38.435772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.435774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.435776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.435788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:38.435792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:38.435796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:38.435834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.435840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.435841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.435843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:38.435845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:38.435893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:38.435899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.435906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.435912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.435920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:38.435950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382344:9762], now have 1 active actors on pipe
2025-10-01T14:10:38.435955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382119:2446], now have 1 active actors on pipe
2025-10-01T14:10:38.435961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255528852504246:8454]
2025-10-01T14:10:38.435962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255528852504246:8454]
2025-10-01T14:10:38.435964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255528852504246:8454]
2025-10-01T14:10:38.435973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:38.435984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:38.435985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:38.435987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:38.435989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:38.435996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:38.435998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:38.435989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1151
2025-10-01T14:10:38.436026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255528852504246:8454]
2025-10-01T14:10:38.436037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:38.435993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1151
2025-10-01T14:10:38.436041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:38.436057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.436065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.436098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:38.436106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.436109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.436111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:38.436117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.436123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:38.436135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.436237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.436242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.436251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.436326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1152 partition: 0 MaxSeqNo: 45 sessionId: src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0
2025-10-01T14:10:38.436649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f441d47-dbffdd6-f25bcd0b-d35b251f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:38.439436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0] Write session: try to update token
2025-10-01T14:10:38.439452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:38.453050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1152 sessionId: src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:38.455189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:38.455300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:38.455317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:38.455319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:38.455320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:38.455327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255528852504246:8454]
2025-10-01T14:10:38.455331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255528852504246:8454]
2025-10-01T14:10:38.455333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255528852504246:8454]
2025-10-01T14:10:38.455364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:38.455368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:38.455370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:38.455380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.455387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.455403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:38.455408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.455409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:38.455526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:38.513690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255531229382359:9460]
2025-10-01T14:10:38.513887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1151, pipe: [1:7556255531229382359:9460]
2025-10-01T14:10:38.591925Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:38.592155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382359:9460], now have 1 active actors on pipe
2025-10-01T14:10:38.592347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:38.592396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255531229382359:9460]
2025-10-01T14:10:38.592422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:38.592479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1152 reason: status is not ok: tablet will be restarted right now sessionId: src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0
2025-10-01T14:10:38.592527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:38.592655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1152 sessionId: src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0 is DEAD
2025-10-01T14:10:38.592775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:38.592784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0] Write session will restart in 0.005699s
2025-10-01T14:10:38.592801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0] Write session: Do CDS request
2025-10-01T14:10:38.592805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:38.599771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.599936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:38.599943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1153
2025-10-01T14:10:38.600049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.600072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:38.600078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:38.600080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:38.600472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1153 sessionId:  describe result for acl check
2025-10-01T14:10:38.600493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:38.600494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:38.600495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:38.600498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255531229382477:9766] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:38.600868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255531229382477:9766] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:38.602977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255531229382477:9766] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:38.606905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:38.607224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255531229382477:9766] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:38.607239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255531229382477:9766] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:38.607242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255531229382477:9766] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:38.607250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:38.607337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:38.607512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:38.607523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:38.607535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:38.607587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:38.607623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255528852504483:8457]
2025-10-01T14:10:38.608053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:38.608218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:38.608242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:38.608425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:38.608467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.608472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.608473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.608473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.608474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.608475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.608476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.608476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.608477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.608477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.608478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.608479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.608479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.608480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.608483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.608488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.608491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.608492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.608494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.608496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.608498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.608500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.608501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.608503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.608505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.608507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.608509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.608510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.608515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.608519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.608523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.608526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.608528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.608531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.608534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.608540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.608543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.608546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.608548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.608551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.608557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.608560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.608562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.608565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.608567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.608570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.608572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.608579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.608582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.608584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.608588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.608591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.608595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.608601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.608603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.608606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.608625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:38.612331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:38.613056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:38.613068Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:38.613070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:38.613072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:38.613077Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1152 [2:7556255528852504483:8457]
2025-10-01T14:10:38.613089Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:38.613103Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:38.613107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.613110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.613111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.613122Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:38.613128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:38.613132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:38.613169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.613174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.613175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.613177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:38.613179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:38.613226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:38.613231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.613238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.613243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.613253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:38.613268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382588:9766], now have 1 active actors on pipe
2025-10-01T14:10:38.613273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382361:2446], now have 1 active actors on pipe
2025-10-01T14:10:38.613278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255528852504477:8457]
2025-10-01T14:10:38.613283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255528852504477:8457]
2025-10-01T14:10:38.613284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255528852504477:8457]
2025-10-01T14:10:38.613293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:38.613301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:38.613304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:38.613307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:38.613309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:38.613312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:38.613314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:38.613334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255528852504477:8457]
2025-10-01T14:10:38.613341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:38.613342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:38.613308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1152
2025-10-01T14:10:38.613355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.613363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.613330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1152
2025-10-01T14:10:38.613402Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|417d43cd-a037cb8b-c2f86075-582b8426_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:38.613410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.613417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.613419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:38.613425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.613433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:38.613448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.613532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.613539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.613551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.613764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1153 partition: 0 MaxSeqNo: 45 sessionId: src_id|417d43cd-a037cb8b-c2f86075-582b8426_0
2025-10-01T14:10:38.614092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|595647b1-3e5f596f-646a7a29-aa1e85ef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|417d43cd-a037cb8b-c2f86075-582b8426_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:38.616965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|417d43cd-a037cb8b-c2f86075-582b8426_0] Write session: try to update token
2025-10-01T14:10:38.616982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|417d43cd-a037cb8b-c2f86075-582b8426_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:38.632924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:38.632940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:38.632942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:38.632944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:38.632954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255528852504477:8457]
2025-10-01T14:10:38.632958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255528852504477:8457]
2025-10-01T14:10:38.632961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255528852504477:8457]
2025-10-01T14:10:38.632994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:38.632996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:38.633001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:38.633001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.633004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:38.633004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:38.633123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:38.633554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1153 sessionId: src_id|417d43cd-a037cb8b-c2f86075-582b8426_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:38.635945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:38.692371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255531229382600:9460]
2025-10-01T14:10:38.692573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1152, pipe: [1:7556255531229382600:9460]
2025-10-01T14:10:38.777794Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:38.778076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.778091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.778135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382600:9460], now have 1 active actors on pipe
2025-10-01T14:10:38.778321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:38.778384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255531229382600:9460]
2025-10-01T14:10:38.778367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:38.778389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:38.778412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:38.778447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1153 reason: error at write: Disconnected sessionId: src_id|417d43cd-a037cb8b-c2f86075-582b8426_0
2025-10-01T14:10:38.778669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1153 sessionId: src_id|417d43cd-a037cb8b-c2f86075-582b8426_0 is DEAD
2025-10-01T14:10:38.778777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417d43cd-a037cb8b-c2f86075-582b8426_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:38.778785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417d43cd-a037cb8b-c2f86075-582b8426_0] Write session will restart in 0.007262s
2025-10-01T14:10:38.778802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417d43cd-a037cb8b-c2f86075-582b8426_0] Write session: Do CDS request
2025-10-01T14:10:38.778807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417d43cd-a037cb8b-c2f86075-582b8426_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:38.786966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|417d43cd-a037cb8b-c2f86075-582b8426_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.787107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:38.787122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1154
2025-10-01T14:10:38.787275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.787306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:38.787316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:38.787320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:38.787734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1154 sessionId:  describe result for acl check
2025-10-01T14:10:38.787763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:38.787764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:38.787766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:38.787770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255531229382635:9771] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:38.788218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255531229382635:9771] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:38.790213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255531229382635:9771] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:38.793172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255531229382635:9771] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:38.793188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255531229382635:9771] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:38.793192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255531229382635:9771] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:38.793201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:38.798750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:38.799189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:38.799445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:38.799452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:38.799461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:38.799498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:38.799542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255528852504727:8460]
2025-10-01T14:10:38.799923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:38.800111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:38.800136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:38.800329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:38.800365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.800371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.800372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.800372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.800373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.800374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.800375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.800375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.800376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.800377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.800377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.800378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.800379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.800379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.800382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.800388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.800390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.800392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.800394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.800397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.800399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.800401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.800403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.800405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.800407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.800409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.800412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.800414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.800418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.800422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.800426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.800429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.800432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.800437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.800441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.800446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.800449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.800454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.800457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.800462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.800465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.800468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.800471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.800473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.800477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.800480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.800482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.800485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.800487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.800490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.800492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.800496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.800500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.800504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.800508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.800512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.800548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:38.804031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:38.804574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:38.804584Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:38.804586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:38.804589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:38.804594Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1153 [2:7556255528852504727:8460]
2025-10-01T14:10:38.804604Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:38.804617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:38.804618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.804621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.804622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.804634Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:38.804637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:38.804641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:38.804678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.804684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.804685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.804687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:38.804689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:38.804889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1153
2025-10-01T14:10:38.804890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1153
2025-10-01T14:10:38.805026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:38.805032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.805039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.805045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.805053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:38.805067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382604:2446], now have 1 active actors on pipe
2025-10-01T14:10:38.805069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382816:9771], now have 1 active actors on pipe
2025-10-01T14:10:38.805081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.805088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.805105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255528852504722:8460]
2025-10-01T14:10:38.805109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255528852504722:8460]
2025-10-01T14:10:38.805111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255528852504722:8460]
2025-10-01T14:10:38.805120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:38.805129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:38.805132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:38.805134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:38.805136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:38.805145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:38.805148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:38.805163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aef067b8-b4f48bab-a516ded5-9566776d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:38.805173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:38.805177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:38.805179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:38.805186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:38.805196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:38.805217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255528852504722:8460]
2025-10-01T14:10:38.805226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:38.805233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:38.805234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.805365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.805371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.805386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:38.805455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1154 partition: 0 MaxSeqNo: 45 sessionId: src_id|aef067b8-b4f48bab-a516ded5-9566776d_0
2025-10-01T14:10:38.805818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|417d43cd-a037cb8b-c2f86075-582b8426_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aef067b8-b4f48bab-a516ded5-9566776d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:38.808380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef067b8-b4f48bab-a516ded5-9566776d_0] Write session: try to update token
2025-10-01T14:10:38.808393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef067b8-b4f48bab-a516ded5-9566776d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:38.820074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:38.820088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:38.820097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255528852504722:8460]
2025-10-01T14:10:38.820136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:38.820144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:38.820304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:38.820432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:38.820557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:38.820615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1154 sessionId: src_id|aef067b8-b4f48bab-a516ded5-9566776d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:38.820682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:38.820881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:38.820920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:38.822736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:38.822884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.822895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.822920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:38.822992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:38.833739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:38.833756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:38.833758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:38.833760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:38.833769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255528852504722:8460]
2025-10-01T14:10:38.833773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255528852504722:8460]
2025-10-01T14:10:38.833776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255528852504722:8460]
2025-10-01T14:10:38.833818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:38.833824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.833826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:38.833825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:38.833830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:38.833834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:38.833957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:38.878745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255531229382857:9460]
2025-10-01T14:10:38.879150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1153, pipe: [1:7556255531229382857:9460]
2025-10-01T14:10:38.971762Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:38.978359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:38.978394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:38.978532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.978589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.978639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.978693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.978733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.978741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.978795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.978849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.978901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.978960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.978998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.979003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.979056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.979114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.979167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.979218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.979253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.979258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.979314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.979366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.979413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.979462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.979498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.979503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.979553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.979601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.979652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.979703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.979739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.979743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.979795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.979844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.979895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.979946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.979983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.979988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.980041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.980092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.980144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.980197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.980232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.980237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.980288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.980338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.980392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.980442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.980479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.980483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.980532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.980578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.980627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.980673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.980716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.980721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.980769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:38.980814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:38.980862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:38.980908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:38.980943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:38.980948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:38.980983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382857:9460], now have 1 active actors on pipe
2025-10-01T14:10:38.981233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:38.981234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255531229382857:9460]
2025-10-01T14:10:38.981254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:38.981256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:38.981276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1154 reason: error at write: Disconnected sessionId: src_id|aef067b8-b4f48bab-a516ded5-9566776d_0
2025-10-01T14:10:38.981450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1154 sessionId: src_id|aef067b8-b4f48bab-a516ded5-9566776d_0 is DEAD
2025-10-01T14:10:38.981633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef067b8-b4f48bab-a516ded5-9566776d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:38.981645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef067b8-b4f48bab-a516ded5-9566776d_0] Write session will restart in 0.006865s
2025-10-01T14:10:38.981667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef067b8-b4f48bab-a516ded5-9566776d_0] Write session: Do CDS request
2025-10-01T14:10:38.981672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef067b8-b4f48bab-a516ded5-9566776d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:38.981743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:38.989887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef067b8-b4f48bab-a516ded5-9566776d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.989968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:38.989978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1155
2025-10-01T14:10:38.990158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:38.990183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:38.990189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:38.990192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:38.990535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1155 sessionId:  describe result for acl check
2025-10-01T14:10:38.990562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:38.990568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:38.990569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:38.990573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255531229383035:9776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:38.990956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255531229383035:9776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:38.992481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:38.992694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255531229383035:9776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:38.995444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:38.995599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:38.995606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:38.995614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:38.995620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255531229383035:9776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:38.995630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255531229383035:9776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:38.995650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:38.995632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255531229383035:9776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:38.995638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:38.995678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255528852504962:8463]
2025-10-01T14:10:38.996036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:38.996213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:38.996237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:38.996421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:38.996455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.996459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.996460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.996461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.996461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.996462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.996462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.996463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.996464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.996464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.996465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.996465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.996466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.996466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.996469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.996475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.996477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.996479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.996481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.996483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.996485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.996487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.996489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.996491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.996493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.996495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.996497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.996499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.996503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.996507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:38.996511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.996514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:38.996517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.996520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:38.996522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.996525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:38.996527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.996529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:38.996531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.996534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:38.996537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.996540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:38.996542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.996544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:38.996546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.996549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:38.996551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.996554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:38.996557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.996560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:38.996562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.996564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:38.996566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.996569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:38.996571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.996574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:38.996592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:38.999797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:39.000591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:39.000602Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:39.000604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:39.000606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:39.000611Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1154 [2:7556255528852504962:8463]
2025-10-01T14:10:39.000621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:39.000632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:39.000638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.000640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.000642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.000653Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:39.000657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:39.000661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:39.000699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.000704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.000706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.000717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:39.000720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:39.000768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:39.000774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.000780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.000785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.000797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:39.000812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255528852504957:8463]
2025-10-01T14:10:39.000817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255528852504957:8463]
2025-10-01T14:10:39.000818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255528852504957:8463]
2025-10-01T14:10:39.000824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:39.000921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1154
2025-10-01T14:10:39.000924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1154
2025-10-01T14:10:39.000834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229383097:9776], now have 1 active actors on pipe
2025-10-01T14:10:39.000834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:39.000837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:39.000839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:39.000841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255531229382862:2446], now have 1 active actors on pipe
2025-10-01T14:10:39.000847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:39.000854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:39.000856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:39.000872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255528852504957:8463]
2025-10-01T14:10:39.000877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:39.000882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:39.000973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.000976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.000996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:39.001000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.001003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.001005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:39.001010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.001017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:39.001026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.001183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.001193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.001211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.001279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1155 partition: 0 MaxSeqNo: 45 sessionId: src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0
2025-10-01T14:10:39.001590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef067b8-b4f48bab-a516ded5-9566776d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:39.003786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0] Write session: try to update token
2025-10-01T14:10:39.003800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:39.017254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1155 sessionId: src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:39.019264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:39.019279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:39.019281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:39.019282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:39.019289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255528852504957:8463]
2025-10-01T14:10:39.019294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255528852504957:8463]
2025-10-01T14:10:39.019297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255528852504957:8463]
2025-10-01T14:10:39.019330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:39.019338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:39.019338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:39.019341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:39.019342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.019344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:39.019372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:39.019458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:39.081489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255535524350404:9460]
2025-10-01T14:10:39.081703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1154, pipe: [1:7556255535524350404:9460]
2025-10-01T14:10:39.145792Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:39.146288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.146300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.146334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524350404:9460], now have 1 active actors on pipe
2025-10-01T14:10:39.146514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:39.146544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255535524350404:9460]
2025-10-01T14:10:39.146552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:39.146568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:39.146623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1155 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0
2025-10-01T14:10:39.146783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1155 sessionId: src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0 is DEAD
2025-10-01T14:10:39.146891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:39.146899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0] Write session will restart in 0.009152s
2025-10-01T14:10:39.146919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0] Write session: Do CDS request
2025-10-01T14:10:39.146923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:39.156859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.156984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:39.156997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1156
2025-10-01T14:10:39.157097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.157129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:39.157138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:39.157142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:39.157502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1156 sessionId:  describe result for acl check
2025-10-01T14:10:39.157535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:39.157539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:39.157541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:39.157545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255535524350600:9780] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:39.158020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255535524350600:9780] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:39.158568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:39.159753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255535524350600:9780] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:39.161575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:39.161703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:39.161710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:39.161717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:39.161745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:39.161739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255535524350600:9780] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:39.161747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255535524350600:9780] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:39.161749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255535524350600:9780] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:39.161754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:39.161771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255533147472492:8465]
2025-10-01T14:10:39.162137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:39.162302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:39.162327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:39.162530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:39.162569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.162574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.162575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.162575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.162576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.162577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.162577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.162578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.162579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.162579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.162580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.162580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.162581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.162581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.162584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.162589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.162592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.162594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.162596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.162598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.162600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.162602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.162604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.162607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.162609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.162611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.162613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.162615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.162619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.162623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.162627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.162630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.162632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.162635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.162637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.162639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.162651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.162654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.162656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.162659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.162661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.162663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.162668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.162671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.162673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.162676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.162678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.162681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.162683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.162688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.162690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.162692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.162695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.162697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.162703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.162705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.162725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:39.165838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:39.166365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:39.166393Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:39.166395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:39.166397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:39.166401Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1155 [2:7556255533147472492:8465]
2025-10-01T14:10:39.166411Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:39.166422Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:39.166423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.166425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.166426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.166436Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:39.166438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:39.166442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:39.166476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.166481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.166482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.166484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:39.166486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:39.166540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:39.166547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.166553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.166559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.166567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:39.166581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524350638:9780], now have 1 active actors on pipe
2025-10-01T14:10:39.166587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524350407:2446], now have 1 active actors on pipe
2025-10-01T14:10:39.166591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255533147472487:8465]
2025-10-01T14:10:39.166596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255533147472487:8465]
2025-10-01T14:10:39.166597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255533147472487:8465]
2025-10-01T14:10:39.166606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:39.166614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:39.166617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:39.166621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:39.166623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:39.166625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:39.166626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:39.166641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255533147472487:8465]
2025-10-01T14:10:39.166646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:39.166656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:39.166641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1155
2025-10-01T14:10:39.166666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.166672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.166662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1155
2025-10-01T14:10:39.166690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:39.166698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.166701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.166702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:39.166708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.166716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:39.166728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.166899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.166904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.166914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.166981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1156 partition: 0 MaxSeqNo: 45 sessionId: src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0
2025-10-01T14:10:39.167307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aef308a-905ec0d2-6217497d-a933c6c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:39.170034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0] Write session: try to update token
2025-10-01T14:10:39.170049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:39.184840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1156 sessionId: src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:39.186069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:39.186081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:39.186082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:39.186084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:39.186090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255533147472487:8465]
2025-10-01T14:10:39.186093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255533147472487:8465]
2025-10-01T14:10:39.186095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255533147472487:8465]
2025-10-01T14:10:39.186124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:39.186129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:39.186132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:39.186132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:39.186137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.186138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:39.186255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:39.187000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:39.246867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255535524350671:9460]
2025-10-01T14:10:39.247024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1155, pipe: [1:7556255535524350671:9460]
2025-10-01T14:10:39.315184Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:39.315841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.315852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.315884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524350671:9460], now have 1 active actors on pipe
2025-10-01T14:10:39.316065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:39.316104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:39.316112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:39.316150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255535524350671:9460]
2025-10-01T14:10:39.316157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1156 reason: error at write: Disconnected sessionId: src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0
2025-10-01T14:10:39.316166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:39.316330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1156 sessionId: src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0 is DEAD
2025-10-01T14:10:39.316502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:39.316515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0] Write session will restart in 0.005909s
2025-10-01T14:10:39.316537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0] Write session: Do CDS request
2025-10-01T14:10:39.316543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:39.323776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.323902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:39.323917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1157
2025-10-01T14:10:39.324126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.324163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:39.324175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:39.324178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:39.324495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1157 sessionId:  describe result for acl check
2025-10-01T14:10:39.324522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:39.324528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:39.324530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:39.324533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255535524350760:9792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:39.324933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255535524350760:9792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:39.327124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255535524350760:9792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:39.331843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:39.331948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255535524350760:9792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:39.331959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255535524350760:9792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:39.331961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255535524350760:9792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:39.331966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:39.332187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:39.332307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:39.332314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:39.332322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:39.332350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:39.332538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255533147472748:8469]
2025-10-01T14:10:39.332921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:39.333180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:39.333208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:39.333397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:39.333437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.333443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.333444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.333445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.333446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.333447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.333448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.333449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.333452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.333452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.333453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.333454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.333454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.333455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.333458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.333463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.333465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.333467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.333469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.333471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.333472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.333474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.333476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.333478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.333480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.333482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.333484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.333485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.333490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.333494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.333498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.333501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.333503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.333506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.333508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.333511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.333518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.333521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.333523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.333526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.333532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.333535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.333538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.333543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.333546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.333549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.333554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.333556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.333559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.333562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.333567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.333570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.333572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.333575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.333580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.333583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.333602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:39.337010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:39.337632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:39.337642Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:39.337643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:39.337645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:39.337650Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1156 [2:7556255533147472748:8469]
2025-10-01T14:10:39.337659Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:39.337670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:39.337675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.337678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.337679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.337689Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:39.337697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:39.337701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:39.337735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.337741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.337742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.337743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:39.337745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:39.337793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:39.337799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.337806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.337812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.337821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:39.337832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255533147472742:8469]
2025-10-01T14:10:39.337837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255533147472742:8469]
2025-10-01T14:10:39.337838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255533147472742:8469]
2025-10-01T14:10:39.337844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:39.337850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:39.337855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:39.337859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:39.337861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:39.337863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:39.337864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:39.337872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524350910:9792], now have 1 active actors on pipe
2025-10-01T14:10:39.337875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524350678:2446], now have 1 active actors on pipe
2025-10-01T14:10:39.337889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255533147472742:8469]
2025-10-01T14:10:39.337898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:39.337908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:39.337918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1156
2025-10-01T14:10:39.337965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.337918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1156
2025-10-01T14:10:39.337971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.337990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d53b377b-86969780-aa668697-4a00d44b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:39.337998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.338001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.338003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:39.338008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.338017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:39.338030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.338175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.338181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.338191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.338252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1157 partition: 0 MaxSeqNo: 45 sessionId: src_id|d53b377b-86969780-aa668697-4a00d44b_0
2025-10-01T14:10:39.338609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b199ff8-473e7faa-73aa36de-5ee3c098_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d53b377b-86969780-aa668697-4a00d44b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:39.341402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d53b377b-86969780-aa668697-4a00d44b_0] Write session: try to update token
2025-10-01T14:10:39.341417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d53b377b-86969780-aa668697-4a00d44b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:39.356425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:39.356441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:39.356443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:39.356444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:39.356451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255533147472742:8469]
2025-10-01T14:10:39.356453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255533147472742:8469]
2025-10-01T14:10:39.356455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255533147472742:8469]
2025-10-01T14:10:39.356489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:39.356493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.356495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:39.356512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:39.356526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:39.356529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:39.356612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:39.357021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1157 sessionId: src_id|d53b377b-86969780-aa668697-4a00d44b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:39.359242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:39.416339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255535524350925:9460]
2025-10-01T14:10:39.416579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1156, pipe: [1:7556255535524350925:9460]
2025-10-01T14:10:39.492386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:39.492590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.492603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.492635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524350925:9460], now have 1 active actors on pipe
2025-10-01T14:10:39.492791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:39.492829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255535524350925:9460]
2025-10-01T14:10:39.492830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:39.492854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:39.492908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1157 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d53b377b-86969780-aa668697-4a00d44b_0
2025-10-01T14:10:39.493063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1157 sessionId: src_id|d53b377b-86969780-aa668697-4a00d44b_0 is DEAD
2025-10-01T14:10:39.493226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53b377b-86969780-aa668697-4a00d44b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:39.493240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53b377b-86969780-aa668697-4a00d44b_0] Write session will restart in 0.007176s
2025-10-01T14:10:39.493265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53b377b-86969780-aa668697-4a00d44b_0] Write session: Do CDS request
2025-10-01T14:10:39.493270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53b377b-86969780-aa668697-4a00d44b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:39.501737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d53b377b-86969780-aa668697-4a00d44b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.501848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:39.501857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1158
2025-10-01T14:10:39.501987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.502009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:39.502015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:39.502018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:39.502292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1158 sessionId:  describe result for acl check
2025-10-01T14:10:39.502320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:39.502326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:39.502327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:39.502330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255535524351059:9796] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:39.502711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255535524351059:9796] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:39.504563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255535524351059:9796] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:39.508425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:39.508629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255535524351059:9796] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:39.508639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255535524351059:9796] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:39.508641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255535524351059:9796] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:39.508647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:39.508807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:39.509216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:39.509224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:39.509234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:39.509275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:39.509303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255533147473002:8482]
2025-10-01T14:10:39.509679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:39.509852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:39.509878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:39.510062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:39.510097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.510101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.510101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.510102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.510103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.510103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.510104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.510105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.510106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.510106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.510107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.510108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.510108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.510109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.510112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.510118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.510120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.510123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.510125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.510127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.510129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.510132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.510134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.510136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.510139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.510141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.510143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.510145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.510150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.510155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.510159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.510162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.510164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.510167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.510170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.510172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.510175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.510178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.510182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.510185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.510188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.510191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.510193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.510196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.510200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.510203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.510206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.510209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.510213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.510216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.510218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.510221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.510225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.510228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.510230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.510233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.510253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:39.513634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:39.514174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:39.514185Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:39.514186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:39.514190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:39.514196Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1157 [2:7556255533147473002:8482]
2025-10-01T14:10:39.514207Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:39.514219Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:39.514224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.514227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.514228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.514241Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:39.514247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:39.514252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:39.514293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.514299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.514300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.514303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:39.514304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:39.514351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:39.514356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.514363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.514384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.514397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:39.514413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524350928:2446], now have 1 active actors on pipe
2025-10-01T14:10:39.514419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524351161:9796], now have 1 active actors on pipe
2025-10-01T14:10:39.514424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255533147472996:8482]
2025-10-01T14:10:39.514429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255533147472996:8482]
2025-10-01T14:10:39.514430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255533147472996:8482]
2025-10-01T14:10:39.514441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:39.514454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:39.514458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:39.514461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:39.514463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:39.514466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:39.514468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:39.514488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255533147472996:8482]
2025-10-01T14:10:39.514497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:39.514499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:39.514493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1157
2025-10-01T14:10:39.514508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1157
2025-10-01T14:10:39.514533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.514539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.514557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:39.514565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.514568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.514571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:39.514577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.514586Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:39.514598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.514718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.514723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.514733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.514801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1158 partition: 0 MaxSeqNo: 45 sessionId: src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0
2025-10-01T14:10:39.515102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d53b377b-86969780-aa668697-4a00d44b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:39.517659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0] Write session: try to update token
2025-10-01T14:10:39.517670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:39.524291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:39.524306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:39.524313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255533147472996:8482]
2025-10-01T14:10:39.524344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:39.524349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:39.524488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:39.524606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:39.524739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:39.524857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:39.525021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:39.525050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:39.530940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1158 sessionId: src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:39.533175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:39.533356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.533378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.533413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:39.533508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:39.544417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:39.544431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:39.544433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:39.544435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:39.544449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255533147472996:8482]
2025-10-01T14:10:39.544452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255533147472996:8482]
2025-10-01T14:10:39.544455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255533147472996:8482]
2025-10-01T14:10:39.544496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:39.544497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:39.544504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.544505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:39.544507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:39.544511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:39.544651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:39.592982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255535524351172:9460]
2025-10-01T14:10:39.593196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1157, pipe: [1:7556255535524351172:9460]
2025-10-01T14:10:39.681599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:39.688102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.688125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.688251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.688305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.688362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.688415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.688456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.688466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.688520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.688572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.688624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.688679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.688729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.688735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.688787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.688837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.688893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.688945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.688982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.688987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.689041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.689096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.689146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.689199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.689237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.689242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.689292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.689342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.689390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.689439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.689476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.689482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.689535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.689586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.689639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.689691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.689728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.689733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.689785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.689837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.689891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.689943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.689991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.689997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.690051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.690100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.690151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.690201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.690239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.690244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.690293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.690339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.690405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.690454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.690491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.690496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.690550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.690596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.690646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.690693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.690731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.690736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.690770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524351172:9460], now have 1 active actors on pipe
2025-10-01T14:10:39.690937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:39.690950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:39.690953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:39.690975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1158 reason: error at write: Disconnected sessionId: src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0
2025-10-01T14:10:39.690985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255535524351172:9460]
2025-10-01T14:10:39.691159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1158 sessionId: src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0 is DEAD
2025-10-01T14:10:39.691309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:39.691323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0] Write session will restart in 0.009362s
2025-10-01T14:10:39.691347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0] Write session: Do CDS request
2025-10-01T14:10:39.691352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:39.691497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:39.701715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.701813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:39.701823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1159
2025-10-01T14:10:39.701927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.701955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:39.701965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:39.701968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:39.702237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1159 sessionId:  describe result for acl check
2025-10-01T14:10:39.702261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:39.702266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:39.702267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:39.702270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255535524351372:9800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:39.702603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:39.702675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255535524351372:9800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:39.704383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255535524351372:9800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:39.705371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:39.705493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:39.705501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:39.705508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:39.705538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:39.705566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255533147473250:8485]
2025-10-01T14:10:39.705923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:39.706114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:39.706141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:39.706437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:39.706477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.706482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.706483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.706483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.706484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.706484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.706485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.706485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.706486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.706486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.706487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.706488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.706488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.706489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.706491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.706497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.706499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.706501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.706503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.706505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.706507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.706509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.706523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255535524351372:9800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:39.706531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255535524351372:9800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:39.706511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.706513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.706516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.706534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255535524351372:9800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:39.706518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.706537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:39.706520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.706522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.706526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.706530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.706534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.706537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.706541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.706543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.706546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.706549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.706551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.706554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.706556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.706559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.706561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.706564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.706566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.706569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.706571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.706576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.706578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.706581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.706583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.706586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.706588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.706591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.706593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.706596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.706598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.706601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.706634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:39.709741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:39.710247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:39.710258Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:39.710259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:39.710261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:39.710266Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1158 [2:7556255533147473250:8485]
2025-10-01T14:10:39.710274Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:39.710284Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:39.710286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.710287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.710289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.710299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:39.710302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:39.710305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:39.710336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.710341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.710342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.710345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:39.710346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:39.710404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:39.710410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.710416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.710422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.710435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:39.710450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524351411:9800], now have 1 active actors on pipe
2025-10-01T14:10:39.710455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524351175:2446], now have 1 active actors on pipe
2025-10-01T14:10:39.710461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255533147473244:8485]
2025-10-01T14:10:39.710462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255533147473244:8485]
2025-10-01T14:10:39.710463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255533147473244:8485]
2025-10-01T14:10:39.710472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:39.710480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:39.710482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:39.710483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:39.710484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:39.710492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:39.710498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:39.710513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255533147473244:8485]
2025-10-01T14:10:39.710494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1158
2025-10-01T14:10:39.710519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:39.710495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1158
2025-10-01T14:10:39.710520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:39.710537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.710542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.710562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d99fbb7-6fa1e554-67953edb-5089113_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:39.710570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.710573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.710574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:39.710579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.710588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:39.710603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.710697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.710703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.710711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.710783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1159 partition: 0 MaxSeqNo: 45 sessionId: src_id|9d99fbb7-6fa1e554-67953edb-5089113_0
2025-10-01T14:10:39.711047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c14f8ad-9d8c072e-39afe142-147c67a9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9d99fbb7-6fa1e554-67953edb-5089113_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:39.713500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d99fbb7-6fa1e554-67953edb-5089113_0] Write session: try to update token
2025-10-01T14:10:39.713514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d99fbb7-6fa1e554-67953edb-5089113_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:39.725145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1159 sessionId: src_id|9d99fbb7-6fa1e554-67953edb-5089113_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:39.727280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:39.727455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.727472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.727500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:39.727579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:39.729392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:39.729406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:39.729407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:39.729408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:39.729415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255533147473244:8485]
2025-10-01T14:10:39.729418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255533147473244:8485]
2025-10-01T14:10:39.729423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255533147473244:8485]
2025-10-01T14:10:39.729452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:39.729456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:39.729460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.729461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:39.729462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:39.729465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:39.729570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:39.791112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255535524351423:9460]
2025-10-01T14:10:39.791293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1158, pipe: [1:7556255535524351423:9460]
2025-10-01T14:10:39.862046Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:39.868839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.868858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.868988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.869040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.869096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.869151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.869197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.869205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.869260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.869310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.869363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.869420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.869461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.869468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.869522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.869569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.869619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.869666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.869705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.869712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.869764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.869815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.869862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.869909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.869946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.869951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.870000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.870046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.870094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.870143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.870182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.870186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.870236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.870285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.870336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.870406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.870444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.870449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.870500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.870547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.870597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.870649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.870690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.870695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.870746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.870795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.870844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.870896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.870933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.870938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.870994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.871046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.871096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.871149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.871186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.871190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.871243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:39.871293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:39.871344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:39.871394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:39.871431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:39.871436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:39.871469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524351423:9460], now have 1 active actors on pipe
2025-10-01T14:10:39.871665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255535524351423:9460]
2025-10-01T14:10:39.871684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:39.871687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:39.871693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:39.871707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1159 reason: error at write: Disconnected sessionId: src_id|9d99fbb7-6fa1e554-67953edb-5089113_0
2025-10-01T14:10:39.871883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1159 sessionId: src_id|9d99fbb7-6fa1e554-67953edb-5089113_0 is DEAD
2025-10-01T14:10:39.872033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d99fbb7-6fa1e554-67953edb-5089113_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:39.872046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d99fbb7-6fa1e554-67953edb-5089113_0] Write session will restart in 0.009983s
2025-10-01T14:10:39.872068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d99fbb7-6fa1e554-67953edb-5089113_0] Write session: Do CDS request
2025-10-01T14:10:39.872073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d99fbb7-6fa1e554-67953edb-5089113_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:39.872231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:39.882763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d99fbb7-6fa1e554-67953edb-5089113_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.882851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:39.882861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1160
2025-10-01T14:10:39.882999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:39.883030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:39.883037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:39.883040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:39.883318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1160 sessionId:  describe result for acl check
2025-10-01T14:10:39.883344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:39.883348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:39.883349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:39.883352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255535524351636:9806] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:39.883711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255535524351636:9806] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:39.885203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255535524351636:9806] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:39.887156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:39.887284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255535524351636:9806] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:39.887292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255535524351636:9806] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:39.887295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255535524351636:9806] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:39.887299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:39.887445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:39.887561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:39.887568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:39.887575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:39.887603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:39.887627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255533147473491:8487]
2025-10-01T14:10:39.887985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:39.888180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:39.888203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:39.888397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:39.888440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.888444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.888445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.888445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.888446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.888446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.888447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.888447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.888448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.888448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.888449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.888450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.888450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.888451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.888453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.888459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.888461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.888463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.888465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.888467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.888469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.888471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.888473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.888475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.888477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.888479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.888481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.888483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.888487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.888491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:39.888494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.888497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:39.888500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.888502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:39.888505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.888511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:39.888513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.888516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:39.888518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.888524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:39.888526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.888529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:39.888531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.888534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:39.888538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.888541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:39.888543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.888546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.888549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.888553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.888555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.888558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.888563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.888565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:39.888567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.888570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:39.888588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:39.891743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:39.892222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:39.892233Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:39.892234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:39.892237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:39.892240Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1159 [2:7556255533147473491:8487]
2025-10-01T14:10:39.892250Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:39.892260Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:39.892261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.892263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.892264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.892274Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:39.892280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:39.892285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:39.892553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.892562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.892564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.892566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:39.892568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:39.892615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:39.892620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.892627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:39.892632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:39.892641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:39.892657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524351437:2446], now have 1 active actors on pipe
2025-10-01T14:10:39.892662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524351672:9806], now have 1 active actors on pipe
2025-10-01T14:10:39.892667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255533147473485:8487]
2025-10-01T14:10:39.892669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255533147473485:8487]
2025-10-01T14:10:39.892670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255533147473485:8487]
2025-10-01T14:10:39.892679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:39.892690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:39.892692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:39.892695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:39.892697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:39.892698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:39.892699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:39.892722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255533147473485:8487]
2025-10-01T14:10:39.892731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:39.892737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:39.892726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1159
2025-10-01T14:10:39.892730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1159
2025-10-01T14:10:39.892757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.892763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.892780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:39.892788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:39.892791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:39.892792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:39.892797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:39.892803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:39.892814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.892925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.892930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.892940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:39.893004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1160 partition: 0 MaxSeqNo: 45 sessionId: src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0
2025-10-01T14:10:39.893320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d99fbb7-6fa1e554-67953edb-5089113_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:39.896015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0] Write session: try to update token
2025-10-01T14:10:39.896027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:39.902239Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:39.902254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:39.902262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255533147473485:8487]
2025-10-01T14:10:39.902296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:39.902300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:39.902478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:39.902621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:39.902757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:39.902885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:39.903064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:39.903103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:39.908763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1160 sessionId: src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:39.910741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:39.910904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:39.910921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:39.910950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:39.911028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:39.919395Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:39.919410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:39.919411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:39.919412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:39.919421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255533147473485:8487]
2025-10-01T14:10:39.919424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255533147473485:8487]
2025-10-01T14:10:39.919426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255533147473485:8487]
2025-10-01T14:10:39.919460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:39.919464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:39.919466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:39.919469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:39.919473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:39.919476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:39.919575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:39.971864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255535524351684:9460]
2025-10-01T14:10:39.972109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1159, pipe: [1:7556255535524351684:9460]
2025-10-01T14:10:40.050224Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:40.056887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.056909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.057036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.057087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.057138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.057185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.057222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.057229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.057282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.057336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.057385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.057434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.057473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.057478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.057536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.057585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.057637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.057691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.057729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.057734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.057789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.057841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.057893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.057945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.057983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.057988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.058039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.058088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.058139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.058189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.058228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.058233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.058287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.058336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.058398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.058452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.058488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.058493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.058546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.058594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.058646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.058695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.058731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.058737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.058787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.058833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.058884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.058934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.058971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.058976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.059029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.059075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.059122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.059166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.059201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.059206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.059255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.059302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.059349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.059395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.059436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.059441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.059477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255535524351684:9460], now have 1 active actors on pipe
2025-10-01T14:10:40.059680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255535524351684:9460]
2025-10-01T14:10:40.059686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:40.059689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:40.059705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:40.059712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1160 reason: error at write: Disconnected sessionId: src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0
2025-10-01T14:10:40.059900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1160 sessionId: src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0 is DEAD
2025-10-01T14:10:40.060031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:40.060042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0] Write session will restart in 0.008679s
2025-10-01T14:10:40.060061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0] Write session: Do CDS request
2025-10-01T14:10:40.060066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:40.060145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:40.069971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:40.069980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1161
2025-10-01T14:10:40.070002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.070394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.070417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:40.070422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:40.070425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:40.070750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1161 sessionId:  describe result for acl check
2025-10-01T14:10:40.070778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:40.070779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:40.070780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:40.070784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255539819319180:9810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:40.071155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255539819319180:9810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:40.071877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:40.072917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255539819319180:9810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:40.074843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:40.074997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:40.075004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:40.075012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:40.075042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:40.075069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255537442441025:8490]
2025-10-01T14:10:40.075065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255539819319180:9810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:40.075075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255539819319180:9810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:40.075078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255539819319180:9810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:40.075085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:40.075438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:40.075604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:40.075628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:40.075808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:40.075840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.075844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.075844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.075845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.075846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.075846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.075847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.075848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.075848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.075849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.075849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.075850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.075851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.075851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.075854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.075859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.075861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.075863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.075865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.075868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.075870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.075872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.075874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.075876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.075878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.075880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.075882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.075884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.075889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.075893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.075897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.075900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.075903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.075905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.075908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.075910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.075913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.075915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.075917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.075920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.075923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.075925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.075927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.075930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.075932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.075935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.075938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.075940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.075943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.075945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.075948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.075950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.075953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.075955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.075957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.075959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.075978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:40.079123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:40.079916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:40.079929Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:40.079930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:40.079933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:40.079937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1160 [2:7556255537442441025:8490]
2025-10-01T14:10:40.079946Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:40.079957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:40.079963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.079965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.079966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.079976Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:40.079979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:40.079983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:40.080019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.080024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.080025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.080027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:40.080029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:40.080074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:40.080079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.080085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.080090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.080098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:40.080113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819319218:9810], now have 1 active actors on pipe
2025-10-01T14:10:40.080118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819318982:2446], now have 1 active actors on pipe
2025-10-01T14:10:40.080123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255537442441020:8490]
2025-10-01T14:10:40.080124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255537442441020:8490]
2025-10-01T14:10:40.080126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255537442441020:8490]
2025-10-01T14:10:40.080137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:40.080148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:40.080157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:40.080158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:40.080160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:40.080162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:40.080162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:40.080179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255537442441020:8490]
2025-10-01T14:10:40.080184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:40.080192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:40.080164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1160
2025-10-01T14:10:40.080169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1160
2025-10-01T14:10:40.080209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.080214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.080235Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|542c0121-35ba711e-9f605f19-3322f5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:40.080242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.080246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.080247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:40.080252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.080261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:40.080269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.080357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.080362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.080370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.080422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1161 partition: 0 MaxSeqNo: 45 sessionId: src_id|542c0121-35ba711e-9f605f19-3322f5a_0
2025-10-01T14:10:40.080705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51cfe6a4-4649ca1-a40174c2-ccecc3c0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|542c0121-35ba711e-9f605f19-3322f5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:40.083122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|542c0121-35ba711e-9f605f19-3322f5a_0] Write session: try to update token
2025-10-01T14:10:40.083136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|542c0121-35ba711e-9f605f19-3322f5a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:40.094853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1161 sessionId: src_id|542c0121-35ba711e-9f605f19-3322f5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:40.096878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:40.097054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.097070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.098679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:40.098706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:40.098709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:40.098710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:40.098711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:40.098717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255537442441020:8490]
2025-10-01T14:10:40.098720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255537442441020:8490]
2025-10-01T14:10:40.098725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255537442441020:8490]
2025-10-01T14:10:40.098753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:40.098759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:40.098762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.098763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:40.098765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:40.098769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:40.098771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:40.098875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:40.159757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255539819319230:9460]
2025-10-01T14:10:40.159906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1160, pipe: [1:7556255539819319230:9460]
2025-10-01T14:10:40.226514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:40.232944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.232965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.233097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.233150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.233205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.233258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.233297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.233305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.233359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.233408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.233460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.233513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.233551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.233556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.233609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.233655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.233703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.233749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.233785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.233790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.233838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.233887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.233933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.233983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.234017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.234021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.234071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.234120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.234167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.234214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.234250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.234258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.234309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.234355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.234417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.234472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.234511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.234516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.234566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.234614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.234665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.234714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.234752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.234757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.234806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.234855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.234903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.234956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.234995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.235000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.235055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.235104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.235158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.235210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.235246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.235251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.235304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.235352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.235403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.235452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.235488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.235493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.235527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819319230:9460], now have 1 active actors on pipe
2025-10-01T14:10:40.235737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255539819319230:9460]
2025-10-01T14:10:40.235747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:40.235750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:40.235761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:40.235770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1161 reason: error at write: Disconnected sessionId: src_id|542c0121-35ba711e-9f605f19-3322f5a_0
2025-10-01T14:10:40.235937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1161 sessionId: src_id|542c0121-35ba711e-9f605f19-3322f5a_0 is DEAD
2025-10-01T14:10:40.236124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|542c0121-35ba711e-9f605f19-3322f5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:40.236136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|542c0121-35ba711e-9f605f19-3322f5a_0] Write session will restart in 0.005808s
2025-10-01T14:10:40.236160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|542c0121-35ba711e-9f605f19-3322f5a_0] Write session: Do CDS request
2025-10-01T14:10:40.236166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|542c0121-35ba711e-9f605f19-3322f5a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:40.236488Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:40.242771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|542c0121-35ba711e-9f605f19-3322f5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.243112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:40.243122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1162
2025-10-01T14:10:40.243281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.243312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:40.243322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:40.243325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:40.243693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1162 sessionId:  describe result for acl check
2025-10-01T14:10:40.243719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:40.243724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:40.243725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:40.243728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255539819319334:9821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:40.244079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255539819319334:9821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:40.246029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255539819319334:9821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:40.248034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:40.248618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255539819319334:9821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:40.248627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255539819319334:9821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:40.248629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255539819319334:9821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:40.248634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:40.250735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:40.250860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:40.250868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:40.250875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:40.250903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:40.250928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255537442441273:8494]
2025-10-01T14:10:40.251268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:40.251432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:40.251455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:40.251629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:40.251659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.251663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.251663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.251664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.251664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.251665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.251665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.251666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.251667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.251667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.251668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.251668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.251669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.251670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.251672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.251677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.251680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.251682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.251684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.251686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.251687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.251689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.251691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.251693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.251695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.251697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.251699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.251701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.251705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.251710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.251713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.251716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.251718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.251720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.251722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.251725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.251727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.251732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.251734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.251736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.251739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.251741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.251743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.251750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.251752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.251755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.251757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.251760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.251762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.251765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.251767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.251769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.251774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.251777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.251779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.251781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.251799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:40.254866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:40.255364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:40.255374Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:40.255375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:40.255377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:40.255381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1161 [2:7556255537442441273:8494]
2025-10-01T14:10:40.255389Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:40.255399Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:40.255400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.255402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.255403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.255413Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:40.255416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:40.255420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:40.255453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.255458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.255459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.255461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:40.255462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:40.255502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:40.255507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.255513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.255518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.255527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:40.255538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819319490:9821], now have 1 active actors on pipe
2025-10-01T14:10:40.255544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819319256:2446], now have 1 active actors on pipe
2025-10-01T14:10:40.255549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255537442441267:8494]
2025-10-01T14:10:40.255550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255537442441267:8494]
2025-10-01T14:10:40.255551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255537442441267:8494]
2025-10-01T14:10:40.255559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:40.255568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:40.255570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:40.255572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:40.255574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:40.255579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:40.255580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:40.255593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255537442441267:8494]
2025-10-01T14:10:40.255595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:40.255588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1161
2025-10-01T14:10:40.255607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:40.255616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.255588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1161
2025-10-01T14:10:40.255618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.255636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:40.255644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.255646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.255648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:40.255653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.255658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:40.255667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.255779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.255790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.255808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.255874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1162 partition: 0 MaxSeqNo: 45 sessionId: src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0
2025-10-01T14:10:40.256156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|542c0121-35ba711e-9f605f19-3322f5a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:40.258275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0] Write session: try to update token
2025-10-01T14:10:40.258287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:40.269591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1162 sessionId: src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:40.271798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:40.271923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.271940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.271967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:40.272054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:40.274660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:40.274674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:40.274675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:40.274676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:40.274684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255537442441267:8494]
2025-10-01T14:10:40.274687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255537442441267:8494]
2025-10-01T14:10:40.274689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255537442441267:8494]
2025-10-01T14:10:40.274722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:40.274725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:40.274729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:40.274730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.274732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:40.274733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:40.274854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:40.335877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255539819319509:9460]
2025-10-01T14:10:40.336086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1161, pipe: [1:7556255539819319509:9460]
2025-10-01T14:10:40.405199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:40.412030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.412053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.412181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.412235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.412289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.412343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.412383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.412390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.412448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.412501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.412555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.412610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.412650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.412655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.412745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.412794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.412844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.412892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.412930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.412936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.412990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.413040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.413089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.413143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.413180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.413185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.413234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.413280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.413328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.413375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.413416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.413422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.413473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.413524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.413578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.413633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.413671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.413675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.413727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.413775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.413836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.413891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.413930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.413935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.413988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.414040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.414090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.414139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.414177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.414183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.414240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.414290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.414342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.414406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.414445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.414452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.414509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.414560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.414611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.414662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.414700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.414704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.414744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819319509:9460], now have 1 active actors on pipe
2025-10-01T14:10:40.414969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:40.414981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:40.415009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1162 reason: error at write: Disconnected sessionId: src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0
2025-10-01T14:10:40.415213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1162 sessionId: src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0 is DEAD
2025-10-01T14:10:40.415248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255539819319509:9460]
2025-10-01T14:10:40.415275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:40.415347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:40.415357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0] Write session will restart in 0.007935s
2025-10-01T14:10:40.415380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0] Write session: Do CDS request
2025-10-01T14:10:40.415386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:40.415689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:40.424906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.424991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:40.425003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1163
2025-10-01T14:10:40.425114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.425137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:40.425142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:40.425145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:40.425523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1163 sessionId:  describe result for acl check
2025-10-01T14:10:40.425551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:40.425553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:40.425554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:40.425559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255539819319692:9826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:40.426012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255539819319692:9826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:40.427546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:40.427724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255539819319692:9826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:40.430541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:40.430700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:40.430707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:40.430717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:40.430743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255539819319692:9826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:40.430752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255539819319692:9826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:40.430755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255539819319692:9826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:40.430763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:40.430768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:40.430804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255537442441544:8506]
2025-10-01T14:10:40.431172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:40.431368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:40.431401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:40.431664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:40.431711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.431716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.431717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.431718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.431719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.431720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.431721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.431722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.431723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.431724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.431725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.431726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.431728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.431729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.431733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.431743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.431747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.431751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.431755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.431759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.431762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.431765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.431768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.431772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.431775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.431779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.431783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.431786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.431793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.431800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.431805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.431814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.431822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.431827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.431831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.431836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.431840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.431845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.431850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.431855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.431859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.431864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.431869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.431874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.431878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.431885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.431892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.431896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.431901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.431906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.431911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.431916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.431920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.431925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.431930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.431935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.431971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:40.435148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:40.435678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:40.435686Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:40.435688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:40.435690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:40.435694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1162 [2:7556255537442441544:8506]
2025-10-01T14:10:40.435704Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:40.435716Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:40.435719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.435721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.435723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.435734Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:40.435741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:40.435744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:40.435781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.435786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.435787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.435789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:40.435791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:40.435836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:40.435841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.435848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.435856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.435872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:40.435904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819319750:9826], now have 1 active actors on pipe
2025-10-01T14:10:40.435911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819319516:2446], now have 1 active actors on pipe
2025-10-01T14:10:40.435917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255537442441537:8506]
2025-10-01T14:10:40.435921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255537442441537:8506]
2025-10-01T14:10:40.435923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255537442441537:8506]
2025-10-01T14:10:40.435933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:40.435940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:40.435942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:40.435943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:40.435950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:40.435962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:40.435967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:40.435951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1162
2025-10-01T14:10:40.435951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1162
2025-10-01T14:10:40.436003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.436010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.436019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255537442441537:8506]
2025-10-01T14:10:40.436027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:40.436035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:40.436047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:40.436052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.436058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.436060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:40.436065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.436081Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:40.436101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.436198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.436204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.436216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.436282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1163 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0
2025-10-01T14:10:40.436608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3febc46-a6c4d4c0-bf5f18d8-34930951_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:40.438738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0] Write session: try to update token
2025-10-01T14:10:40.438751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:40.450139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1163 sessionId: src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:40.452372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:40.452533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.452550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.452576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:40.452635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:40.454549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:40.454562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:40.454563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:40.454564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:40.454570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255537442441537:8506]
2025-10-01T14:10:40.454574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255537442441537:8506]
2025-10-01T14:10:40.454576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255537442441537:8506]
2025-10-01T14:10:40.454609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:40.454608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:40.454612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:40.454615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.454616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:40.454616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:40.454728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:40.515611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255539819319762:9460]
2025-10-01T14:10:40.515844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1162, pipe: [1:7556255539819319762:9460]
2025-10-01T14:10:40.580626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:40.587288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.587311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.587452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.587507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.587562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.587618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.587701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.587708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.587768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.587819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.587869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.587925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.587963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.587973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.588024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.588073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.588126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.588174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.588211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.588217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.588266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.588315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.588364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.588412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.588449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.588454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.588505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.588553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.588601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.588646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.588686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.588691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.588755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.588802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.588855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.588907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.588945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.588950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.588999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.589046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.589097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.589143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.589185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.589189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.589239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.589287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.589336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.589384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.589419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.589426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.589478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.589527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.589577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.589630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.589668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.589671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.589724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.589771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.589823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.589890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.590012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.590019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.590054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819319762:9460], now have 1 active actors on pipe
2025-10-01T14:10:40.590267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:40.590267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255539819319762:9460]
2025-10-01T14:10:40.590277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:40.590284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:40.590297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1163 reason: error at write: Disconnected sessionId: src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0
2025-10-01T14:10:40.590502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1163 sessionId: src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0 is DEAD
2025-10-01T14:10:40.590586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:40.590594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0] Write session will restart in 0.009014s
2025-10-01T14:10:40.590617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0] Write session: Do CDS request
2025-10-01T14:10:40.590622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:40.590925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:40.600822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.600915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:40.600925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1164
2025-10-01T14:10:40.601020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.601048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:40.601055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:40.601058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:40.601353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1164 sessionId:  describe result for acl check
2025-10-01T14:10:40.601379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:40.601385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:40.601386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:40.601390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255539819319957:9830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:40.601743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255539819319957:9830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:40.603616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255539819319957:9830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:40.605721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:40.605848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255539819319957:9830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:40.605856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255539819319957:9830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:40.605859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255539819319957:9830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:40.605863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:40.605963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:40.606142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:40.606150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:40.606158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:40.606194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:40.606220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255537442441788:8509]
2025-10-01T14:10:40.606604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:40.606834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:40.606860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:40.607048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:40.607078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.607081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.607082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.607083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.607084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.607085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.607085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.607086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.607086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.607087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.607087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.607088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.607088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.607089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.607092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.607097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.607099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.607101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.607103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.607105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.607107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.607109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.607111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.607113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.607115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.607117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.607119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.607121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.607125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.607130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.607134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.607137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.607140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.607143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.607146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.607152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.607154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.607157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.607162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.607164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.607167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.607169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.607175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.607177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.607179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.607182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.607184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.607187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.607189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.607192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.607198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.607200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.607203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.607205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.607211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.607214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.607232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:40.610432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:40.610954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:40.610964Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:40.610966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:40.610968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:40.610973Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1163 [2:7556255537442441788:8509]
2025-10-01T14:10:40.610981Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:40.610995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:40.611000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.611002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.611003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.611013Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:40.611019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:40.611023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:40.611059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.611064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.611065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.611067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:40.611068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:40.611109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:40.611113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.611120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.611125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.611137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:40.611150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819319764:2446], now have 1 active actors on pipe
2025-10-01T14:10:40.611156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819320007:9830], now have 1 active actors on pipe
2025-10-01T14:10:40.611160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255537442441782:8509]
2025-10-01T14:10:40.611161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255537442441782:8509]
2025-10-01T14:10:40.611162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255537442441782:8509]
2025-10-01T14:10:40.611171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:40.611181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:40.611182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:40.611188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:40.611189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:40.611190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:40.611191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:40.611204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255537442441782:8509]
2025-10-01T14:10:40.611213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:40.611217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:40.611238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.611243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.611213Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1163
2025-10-01T14:10:40.611216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1163
2025-10-01T14:10:40.611262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:40.611269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.611272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.611276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:40.611281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.611290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:40.611301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.611393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.611398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.611406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.611465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1164 partition: 0 MaxSeqNo: 45 sessionId: src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0
2025-10-01T14:10:40.611720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b852e58-d466c28a-4c2c6b64-f24c36a5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:40.613787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0] Write session: try to update token
2025-10-01T14:10:40.613797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:40.624584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1164 sessionId: src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:40.626470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:40.626608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.626626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.626653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:40.626708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:40.629248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:40.629261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:40.629263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:40.629264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:40.629271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255537442441782:8509]
2025-10-01T14:10:40.629273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255537442441782:8509]
2025-10-01T14:10:40.629275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255537442441782:8509]
2025-10-01T14:10:40.629308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:40.629312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:40.629317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:40.629319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.629319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:40.629321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:40.629432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:40.690203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255539819320018:9460]
2025-10-01T14:10:40.690439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1163, pipe: [1:7556255539819320018:9460]
2025-10-01T14:10:40.761628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:40.768533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.768553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.768689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.768765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.768822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.768872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.768919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.768926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.768982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.769032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.769084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.769136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.769173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.769179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.769229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.769275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.769326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.769374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.769414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.769419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.769471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.769518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.769565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.769616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.769653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.769658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.769706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.769752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.769800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.769848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.769883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.769888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.769942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.769995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.770046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.770099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.770139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.770144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.770194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.770243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.770293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.770342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.770391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.770396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.770445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.770493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.770541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.770593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.770644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.770649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.770701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.770750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.770804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.770860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.770919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.770925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.770976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.771024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.771073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.771120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.771158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.771163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.771196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819320018:9460], now have 1 active actors on pipe
2025-10-01T14:10:40.771392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255539819320018:9460]
2025-10-01T14:10:40.771404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:40.771407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:40.771413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:40.771427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1164 reason: error at write: Disconnected sessionId: src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0
2025-10-01T14:10:40.771592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1164 sessionId: src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0 is DEAD
2025-10-01T14:10:40.771740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:40.771749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0] Write session will restart in 0.009482s
2025-10-01T14:10:40.771768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0] Write session: Do CDS request
2025-10-01T14:10:40.771772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:40.771894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:40.781926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.782031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:40.782042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1165
2025-10-01T14:10:40.782132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.782154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:40.782162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:40.782164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:40.782459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1165 sessionId:  describe result for acl check
2025-10-01T14:10:40.782486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:40.782491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:40.782492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:40.782495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255539819320225:9835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:40.782844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255539819320225:9835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:40.783244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:40.784578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255539819320225:9835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:40.786002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:40.786121Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:40.786129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:40.786136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:40.786166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:40.786192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255537442442042:8512]
2025-10-01T14:10:40.786573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:40.786762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:40.786785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:40.786854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255539819320225:9835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:40.786864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255539819320225:9835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:40.786866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255539819320225:9835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:40.786871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:40.786965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:40.786997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.787001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.787002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.787003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.787003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.787004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.787004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.787005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.787005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.787006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.787006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.787007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.787007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.787008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.787011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.787016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.787019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.787021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.787023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.787025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.787027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.787029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.787031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.787033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.787035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.787037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.787039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.787041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.787047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.787051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.787055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.787058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.787060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.787063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.787066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.787068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.787071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.787074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.787076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.787078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.787081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.787083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.787086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.787088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.787091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.787094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.787096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.787099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.787101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.787104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.787106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.787109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.787111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.787114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.787116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.787119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.787140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:40.790291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:40.790812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:40.790822Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:40.790823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:40.790825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:40.790830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1164 [2:7556255537442442042:8512]
2025-10-01T14:10:40.790838Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:40.790847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:40.790853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.790855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.790857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.790867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:40.790876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:40.790880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:40.790914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.790918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.790919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.790921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:40.790923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:40.790963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:40.790967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.790974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.790983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.790995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:40.791009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819320265:9835], now have 1 active actors on pipe
2025-10-01T14:10:40.791015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819320022:2446], now have 1 active actors on pipe
2025-10-01T14:10:40.791019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255537442442037:8512]
2025-10-01T14:10:40.791021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255537442442037:8512]
2025-10-01T14:10:40.791022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255537442442037:8512]
2025-10-01T14:10:40.791030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:40.791042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:40.791043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:40.791047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:40.791049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:40.791052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:40.791054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:40.791068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255537442442037:8512]
2025-10-01T14:10:40.791073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:40.791075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:40.791048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1164
2025-10-01T14:10:40.791052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1164
2025-10-01T14:10:40.791088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.791094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.791122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:40.791130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.791132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.791134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:40.791138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.791143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:40.791156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.791251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.791258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.791267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.791324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1165 partition: 0 MaxSeqNo: 45 sessionId: src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0
2025-10-01T14:10:40.791569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895410f-11f2bf3a-eac19433-2f3abaf4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:40.793953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0] Write session: try to update token
2025-10-01T14:10:40.793966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:40.806191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1165 sessionId: src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:40.808219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:40.808309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.808324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.809921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:40.809947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:40.809949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:40.809951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:40.809952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:40.809959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255537442442037:8512]
2025-10-01T14:10:40.809962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255537442442037:8512]
2025-10-01T14:10:40.809965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255537442442037:8512]
2025-10-01T14:10:40.809981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:40.809985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:40.809988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:40.809992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:40.809997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.809999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:40.810000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:40.810104Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:40.871457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255539819320287:9460]
2025-10-01T14:10:40.871654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1164, pipe: [1:7556255539819320287:9460]
2025-10-01T14:10:40.936300Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:40.943132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.943151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.943286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.943339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.943396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.943448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.943487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.943496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.943554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.943604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.943656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.943711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.943747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.943753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.943801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.943851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.943902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.943952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.943992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.943997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.944050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.944097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.944144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.944193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.944229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.944234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.944283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.944331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.944381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.944429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.944466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.944471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.944524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.944573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.944624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.944678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.944726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.944730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.944782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.944828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.944877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.944929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.944965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.944969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.945019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.945068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.945117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.945166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.945203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.945207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.945259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.945306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.945355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.945406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.945443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.945447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.945501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:40.945551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:40.945602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:40.945651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:40.945687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:40.945692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:40.945727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819320287:9460], now have 1 active actors on pipe
2025-10-01T14:10:40.945936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:40.945941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255539819320287:9460]
2025-10-01T14:10:40.945997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:40.946003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:40.946023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1165 reason: error at write: Disconnected sessionId: src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0
2025-10-01T14:10:40.946194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1165 sessionId: src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0 is DEAD
2025-10-01T14:10:40.946386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:40.946396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0] Write session will restart in 0.009131s
2025-10-01T14:10:40.946416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0] Write session: Do CDS request
2025-10-01T14:10:40.946421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:40.946435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:40.956887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.956991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:40.957004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1166
2025-10-01T14:10:40.957096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:40.957119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:40.957126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:40.957128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:40.957491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1166 sessionId:  describe result for acl check
2025-10-01T14:10:40.957531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:40.957538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:40.957540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:40.957546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255539819320496:9840] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:40.958062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255539819320496:9840] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:40.958399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:40.959524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255539819320496:9840] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:40.961413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:40.961653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:40.961661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:40.961669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:40.961655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255539819320496:9840] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:40.961665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255539819320496:9840] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:40.961668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255539819320496:9840] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:40.961676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:40.961711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:40.961740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255537442442288:8515]
2025-10-01T14:10:40.962099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:40.962250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:40.962274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:40.962475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:40.962508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.962512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.962513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.962514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.962514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.962515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.962516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.962517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.962517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.962518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.962519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.962519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.962520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.962521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.962524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.962529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.962532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.962534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.962536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.962538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.962540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.962542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.962543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.962546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.962548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.962550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.962551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.962553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.962559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.962563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:40.962567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.962570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:40.962572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.962575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:40.962577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.962580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:40.962582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.962585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:40.962587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.962590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:40.962593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.962596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:40.962598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.962601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:40.962603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.962606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:40.962608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.962611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.962614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.962616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.962619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.962622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.962625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.962627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:40.962629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.962633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:40.962653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:40.965791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:40.966314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:40.966324Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:40.966326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:40.966328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:40.966332Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1165 [2:7556255537442442288:8515]
2025-10-01T14:10:40.966342Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:40.966353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:40.966355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.966357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.966358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.966381Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:40.966388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:40.966393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:40.966431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.966435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.966437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.966439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:40.966440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:40.966484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:40.966489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.966496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:40.966501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:40.966513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:40.966528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819320530:9840], now have 1 active actors on pipe
2025-10-01T14:10:40.966536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255537442442283:8515]
2025-10-01T14:10:40.966541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255537442442283:8515]
2025-10-01T14:10:40.966542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255537442442283:8515]
2025-10-01T14:10:40.966551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:40.966560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255539819320289:2446], now have 1 active actors on pipe
2025-10-01T14:10:40.966559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:40.966561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:40.966562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:40.966568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:40.966576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:40.966581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:40.966596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255537442442283:8515]
2025-10-01T14:10:40.966603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:40.966611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:40.966606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1165
2025-10-01T14:10:40.966608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1165
2025-10-01T14:10:40.966646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.966652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.966672Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:40.966680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:40.966683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:40.966687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:40.966693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:40.966702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:40.966714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.966809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.966815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.966824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:40.966898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1166 partition: 0 MaxSeqNo: 45 sessionId: src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0
2025-10-01T14:10:40.967208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8db96051-7f82cd74-9b962f8e-671c1bef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:40.969361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0] Write session: try to update token
2025-10-01T14:10:40.969375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:40.981697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1166 sessionId: src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:40.983770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:40.984915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:40.984935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:40.984952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:40.984955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:40.984956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:40.984957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:40.984963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255537442442283:8515]
2025-10-01T14:10:40.984966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255537442442283:8515]
2025-10-01T14:10:40.984969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255537442442283:8515]
2025-10-01T14:10:40.984996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:40.985005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:40.985008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:40.985012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:40.985016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:40.985018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:40.985139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:41.046067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255544114287837:9460]
2025-10-01T14:10:41.046279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1165, pipe: [1:7556255544114287837:9460]
2025-10-01T14:10:41.113704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:41.114358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:41.114417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114287837:9460], now have 1 active actors on pipe
2025-10-01T14:10:41.114491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:41.114584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255544114287837:9460]
2025-10-01T14:10:41.114621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:41.125860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:41.125869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:41.125889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1166 reason: error at write: Disconnected sessionId: src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0
2025-10-01T14:10:41.126050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1166 sessionId: src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0 is DEAD
2025-10-01T14:10:41.126200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:41.126210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0] Write session will restart in 0.009701s
2025-10-01T14:10:41.126233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0] Write session: Do CDS request
2025-10-01T14:10:41.126239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:41.132860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:41.136279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:41.136414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:41.136422Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:41.136430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:41.136458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:41.136487Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255541737409829:8517]
2025-10-01T14:10:41.136830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.136904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:41.136890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:41.136902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1167
2025-10-01T14:10:41.137024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.137046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:41.137053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:41.137055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:41.137115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:41.137150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:41.137353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:41.137377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1167 sessionId:  describe result for acl check
2025-10-01T14:10:41.137391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.137395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.137396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.137396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.137397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.137397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.137398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.137403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:41.137399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.137407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:41.137400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.137408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:41.137400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.137411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255544114288050:9844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:41.137401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.137402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.137402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.137403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.137406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.137411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.137414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.137416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.137418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.137420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.137422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.137424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.137426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.137428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.137430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.137432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.137434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.137436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.137442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.137446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.137449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.137453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.137455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.137458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.137460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.137463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.137466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.137468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.137471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.137473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.137477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.137480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.137484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.137486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.137489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.137491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.137496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.137499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.137501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.137504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.137509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.137512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.137515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.137517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.137519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.137522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.137542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:41.137778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255544114288050:9844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:41.139407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255544114288050:9844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:41.140632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:41.141166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:41.141177Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:41.141179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:41.141182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:41.141186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1166 [2:7556255541737409829:8517]
2025-10-01T14:10:41.141194Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:41.141204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:41.141206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.141208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.141210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.141224Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:41.141228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:41.141234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:41.141274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.141280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.141281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.141283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:41.141285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:41.141335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:41.141341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.141347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.141352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.141364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:41.141377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114287839:2446], now have 1 active actors on pipe
2025-10-01T14:10:41.141385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255541737409824:8517]
2025-10-01T14:10:41.141386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255541737409824:8517]
2025-10-01T14:10:41.141388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255541737409824:8517]
2025-10-01T14:10:41.141397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:41.141401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:41.141403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:41.141386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1166
2025-10-01T14:10:41.141404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:41.141408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:41.141416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:41.141418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:41.141437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255541737409824:8517]
2025-10-01T14:10:41.141445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:41.141452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:41.141710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255544114288050:9844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:41.141719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255544114288050:9844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:41.141721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255544114288050:9844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:41.141725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:41.141845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288088:9844], now have 1 active actors on pipe
2025-10-01T14:10:41.141867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1166
2025-10-01T14:10:41.141903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.141909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.141925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:41.141932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.141935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.141940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:41.141945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.141955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:41.141967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.142063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.142067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.142075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.142122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1167 partition: 0 MaxSeqNo: 45 sessionId: src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0
2025-10-01T14:10:41.142382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64c84da-aabf7f1d-4302c832-d4b6182e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:41.144873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0] Write session: try to update token
2025-10-01T14:10:41.144889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:41.150942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:41.150958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:41.150967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255541737409824:8517]
2025-10-01T14:10:41.150999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:41.151004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:41.151146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:41.151266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:41.151383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:41.151508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:41.151677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:41.151707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:41.156793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1167 sessionId: src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:41.158799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:41.158942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.158957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.158980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:41.159041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:41.168046Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:41.168059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:41.168061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:41.168062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:41.168071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255541737409824:8517]
2025-10-01T14:10:41.168074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255541737409824:8517]
2025-10-01T14:10:41.168076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255541737409824:8517]
2025-10-01T14:10:41.168107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:41.168114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.168116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:41.168225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:41.168383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:41.168401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:41.168406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:41.214506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255544114288094:9460]
2025-10-01T14:10:41.214740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1166, pipe: [1:7556255544114288094:9460]
2025-10-01T14:10:41.298984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:41.305737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.305759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.305888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.305940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.305991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.306044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.306086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.306096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.306157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.306213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.306266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.306319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.306356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.306361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.306433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.306485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.306539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.306599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.306652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.306657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.306723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.306779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.306832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.306890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.306929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.306934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.306988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.307038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.307089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.307150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.307195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.307203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.307262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.307311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.307365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.307417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.307462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.307468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.307523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.307572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.307627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.307682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.307725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.307732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.307788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.307837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.307890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.307947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.307987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.307992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.308047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.308095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.308155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.308207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.308251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.308257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.308312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.308359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.308415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.308468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.308510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.308515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.308553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288094:9460], now have 1 active actors on pipe
2025-10-01T14:10:41.308831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:41.308836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:41.308841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:41.308862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1167 reason: error at write: Disconnected sessionId: src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0
2025-10-01T14:10:41.308874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255544114288094:9460]
2025-10-01T14:10:41.309083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1167 sessionId: src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0 is DEAD
2025-10-01T14:10:41.309251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:41.309262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0] Write session will restart in 0.009767s
2025-10-01T14:10:41.309288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0] Write session: Do CDS request
2025-10-01T14:10:41.309294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:41.309370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:41.319828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.319893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:41.319904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1168
2025-10-01T14:10:41.320016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.320047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:41.320056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:41.320059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:41.320869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1168 sessionId:  describe result for acl check
2025-10-01T14:10:41.320913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:41.320919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:41.320921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:41.320926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255544114288302:9856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:41.321368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255544114288302:9856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:41.322954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255544114288302:9856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:41.322988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:41.325922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:41.326067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:41.326077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:41.326085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:41.326119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:41.326154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255541737410082:8521]
2025-10-01T14:10:41.326349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255544114288302:9856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:41.326358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255544114288302:9856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:41.326361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255544114288302:9856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:41.326366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:41.326529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:41.326682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:41.326707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:41.326896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:41.326928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.326932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.326932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.326933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.326934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.326934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.326935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.326936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.326936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.326937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.326937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.326938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.326938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.326939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.326942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.326947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.326949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.326951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.326953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.326955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.326957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.326959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.326961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.326963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.326965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.326967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.326969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.326971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.326976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.326981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.326984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.326988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.326990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.326993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.326995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.326998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.327000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.327003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.327005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.327008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.327010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.327012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.327014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.327017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.327020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.327022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.327024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.327027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.327029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.327032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.327034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.327036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.327039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.327041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.327043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.327046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.327066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:41.330130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:41.330655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:41.330668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:41.330669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:41.330672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:41.330678Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1167 [2:7556255541737410082:8521]
2025-10-01T14:10:41.330689Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:41.330702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:41.330706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.330709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.330710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.330720Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:41.330726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:41.330730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:41.330779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.330784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.330786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.330788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:41.330789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:41.330831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:41.330836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.330842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.330851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.330862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:41.330876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288369:9856], now have 1 active actors on pipe
2025-10-01T14:10:41.330881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288126:2446], now have 1 active actors on pipe
2025-10-01T14:10:41.330886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255541737410077:8521]
2025-10-01T14:10:41.330887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255541737410077:8521]
2025-10-01T14:10:41.330888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255541737410077:8521]
2025-10-01T14:10:41.330896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:41.330907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:41.330907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:41.330909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:41.330911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:41.330917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:41.330919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:41.330901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1167
2025-10-01T14:10:41.330904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1167
2025-10-01T14:10:41.330935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255541737410077:8521]
2025-10-01T14:10:41.330939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:41.330950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.330950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:41.330956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.330985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63b88ba-9f44843-e7839168-1bc50b26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:41.330993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.330995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.330997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:41.331002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.331010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:41.331024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.331106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.331111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.331119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.331175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1168 partition: 0 MaxSeqNo: 45 sessionId: src_id|63b88ba-9f44843-e7839168-1bc50b26_0
2025-10-01T14:10:41.331473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da0bbd41-1312f991-1de2bfe2-9694ee8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|63b88ba-9f44843-e7839168-1bc50b26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:41.333639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b88ba-9f44843-e7839168-1bc50b26_0] Write session: try to update token
2025-10-01T14:10:41.333654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b88ba-9f44843-e7839168-1bc50b26_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:41.345474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1168 sessionId: src_id|63b88ba-9f44843-e7839168-1bc50b26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:41.347603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:41.349252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.349273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.349290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:41.349292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:41.349294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:41.349295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:41.349301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255541737410077:8521]
2025-10-01T14:10:41.349304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255541737410077:8521]
2025-10-01T14:10:41.349306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255541737410077:8521]
2025-10-01T14:10:41.349338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:41.349345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:41.349349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:41.349349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.349351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:41.349351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:41.349462Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:41.409060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255544114288383:9460]
2025-10-01T14:10:41.409217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1167, pipe: [1:7556255544114288383:9460]
2025-10-01T14:10:41.479732Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:41.480228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:41.480279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288383:9460], now have 1 active actors on pipe
2025-10-01T14:10:41.480347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:41.480422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:41.480428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:41.480483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1168 reason: error at write: Disconnected sessionId: src_id|63b88ba-9f44843-e7839168-1bc50b26_0
2025-10-01T14:10:41.480625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255544114288383:9460]
2025-10-01T14:10:41.480631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1168 sessionId: src_id|63b88ba-9f44843-e7839168-1bc50b26_0 is DEAD
2025-10-01T14:10:41.480655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:41.480737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b88ba-9f44843-e7839168-1bc50b26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:41.480746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b88ba-9f44843-e7839168-1bc50b26_0] Write session will restart in 0.006574s
2025-10-01T14:10:41.480773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b88ba-9f44843-e7839168-1bc50b26_0] Write session: Do CDS request
2025-10-01T14:10:41.480779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b88ba-9f44843-e7839168-1bc50b26_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:41.488829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63b88ba-9f44843-e7839168-1bc50b26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.488902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:41.488912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1169
2025-10-01T14:10:41.489002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.489024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:41.489031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:41.489033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:41.489363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1169 sessionId:  describe result for acl check
2025-10-01T14:10:41.489400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:41.489406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:41.489408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:41.489411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255544114288497:9860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:41.489759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255544114288497:9860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:41.491703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255544114288497:9860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:41.495735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:41.495748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255544114288497:9860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:41.495759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255544114288497:9860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:41.495762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255544114288497:9860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:41.495797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:41.496045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:41.496155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:41.496162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:41.496169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:41.496198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:41.496224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255541737410362:8534]
2025-10-01T14:10:41.496584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:41.496759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:41.496782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:41.496959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:41.496990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.496995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.496995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.496996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.496996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.496997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.496998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.496999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.496999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.497000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.497001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.497001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.497002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.497002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.497005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.497010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.497012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.497014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.497016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.497018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.497020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.497022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.497024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.497026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.497028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.497030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.497032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.497034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.497038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.497042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.497046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.497049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.497051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.497054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.497056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.497059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.497061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.497064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.497068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.497071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.497075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.497080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.497083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.497086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.497088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.497091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.497096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.497099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.497101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.497104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.497109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.497111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.497114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.497116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.497122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.497125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.497159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:41.500173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:41.500677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:41.500690Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:41.500691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:41.500693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:41.500698Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1168 [2:7556255541737410362:8534]
2025-10-01T14:10:41.500716Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:41.500730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:41.500732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.500736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.500737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.500750Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:41.500758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:41.500763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:41.500795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.500800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.500801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.500804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:41.500805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:41.500848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:41.500853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.500859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.500865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.500876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:41.500891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288629:9860], now have 1 active actors on pipe
2025-10-01T14:10:41.500897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288385:2446], now have 1 active actors on pipe
2025-10-01T14:10:41.500901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255541737410356:8534]
2025-10-01T14:10:41.500903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255541737410356:8534]
2025-10-01T14:10:41.500904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255541737410356:8534]
2025-10-01T14:10:41.500913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:41.500916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:41.500918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:41.500919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:41.500925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:41.500907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1168
2025-10-01T14:10:41.500910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1168
2025-10-01T14:10:41.500933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:41.500938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:41.500962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.500968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.500980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255541737410356:8534]
2025-10-01T14:10:41.500987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:41.500994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:41.501004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:41.501008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.501014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.501015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:41.501020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.501029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:41.501046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.501123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.501128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.501137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.501196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1169 partition: 0 MaxSeqNo: 45 sessionId: src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0
2025-10-01T14:10:41.501463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63b88ba-9f44843-e7839168-1bc50b26_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:41.503665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0] Write session: try to update token
2025-10-01T14:10:41.503678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:41.514706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1169 sessionId: src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:41.516682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:41.516939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.516954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.516974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:41.517029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:41.519059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:41.519074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:41.519075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:41.519077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:41.519083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255541737410356:8534]
2025-10-01T14:10:41.519085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255541737410356:8534]
2025-10-01T14:10:41.519088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255541737410356:8534]
2025-10-01T14:10:41.519117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:41.519119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:41.519123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.519125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:41.519127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:41.519129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:41.519244Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:41.580565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255544114288640:9460]
2025-10-01T14:10:41.580814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1168, pipe: [1:7556255544114288640:9460]
2025-10-01T14:10:41.649568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:41.656188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.656211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.656345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.656399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.656452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.656506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.656545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.656552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.656607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.656657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.656732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.656788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.656826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.656832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.656883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.656940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.656994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.657046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.657083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.657088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.657139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.657189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.657238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.657288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.657329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.657334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.657384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.657430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.657477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.657526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.657563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.657568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.657622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.657670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.657721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.657771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.657810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.657815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.657866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.657914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.657963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.658013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.658051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.658056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.658105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.658153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.658203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.658252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.658287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.658292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.658342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.658403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.658453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.658503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.658539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.658544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.658599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:41.658651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:41.658704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:41.658754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:41.658792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:41.658797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:41.658832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288640:9460], now have 1 active actors on pipe
2025-10-01T14:10:41.659069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:41.659073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:41.659082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:41.659111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1169 reason: error at write: Disconnected sessionId: src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0
2025-10-01T14:10:41.659117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255544114288640:9460]
2025-10-01T14:10:41.659352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1169 sessionId: src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0 is DEAD
2025-10-01T14:10:41.659482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:41.659491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0] Write session will restart in 0.005459s
2025-10-01T14:10:41.659512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0] Write session: Do CDS request
2025-10-01T14:10:41.659516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:41.659611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:41.665892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.665953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:41.665964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1170
2025-10-01T14:10:41.666034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.666056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:41.666063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:41.666065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:41.666390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1170 sessionId:  describe result for acl check
2025-10-01T14:10:41.666417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:41.666421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:41.666422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:41.666425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255544114288693:9864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:41.666783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255544114288693:9864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:41.668717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255544114288693:9864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:41.671021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255544114288693:9864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:41.671028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255544114288693:9864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:41.671030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255544114288693:9864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:41.671035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:41.674579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:41.674831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:41.674960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:41.674966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:41.674973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:41.675003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:41.675037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255541737410610:8536]
2025-10-01T14:10:41.675401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:41.675564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:41.675586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:41.675768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:41.675800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.675804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.675805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.675805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.675806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.675807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.675807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.675808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.675808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.675809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.675810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.675810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.675811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.675811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.675814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.675820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.675822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.675824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.675826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.675828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.675830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.675832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.675834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.675836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.675838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.675840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.675842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.675844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.675849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.675853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.675857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.675860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.675862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.675869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.675871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.675874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.675879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.675882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.675884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.675887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.675890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.675892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.675895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.675897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.675899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.675902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.675904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.675907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.675909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.675912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.675918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.675920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.675923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.675926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.675928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.675931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.675949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:41.679120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:41.679672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:41.679682Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:41.679683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:41.679685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:41.679690Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1169 [2:7556255541737410610:8536]
2025-10-01T14:10:41.679699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:41.679710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:41.679715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.679717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.679718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.679728Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:41.679732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:41.679739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:41.679773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.679778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.679779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.679781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:41.679782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:41.679826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:41.679831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.679837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.679852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.679863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:41.679878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288643:2446], now have 1 active actors on pipe
2025-10-01T14:10:41.679884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288884:9864], now have 1 active actors on pipe
2025-10-01T14:10:41.679888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255541737410605:8536]
2025-10-01T14:10:41.679890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255541737410605:8536]
2025-10-01T14:10:41.679891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255541737410605:8536]
2025-10-01T14:10:41.679900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:41.679912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:41.679911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:41.679913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:41.679915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:41.679923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:41.679924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:41.679940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255541737410605:8536]
2025-10-01T14:10:41.679948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:41.679924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1169
2025-10-01T14:10:41.679934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1169
2025-10-01T14:10:41.679952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:41.679981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.679987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.680005Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:41.680012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.680018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.680020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:41.680025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.680033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:41.680045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.680142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.680148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.680157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.680237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1170 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0
2025-10-01T14:10:41.680562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d91ed44-e0bf5d88-515189c4-5fefcc05_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:41.682764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0] Write session: try to update token
2025-10-01T14:10:41.682779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:41.694360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1170 sessionId: src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:41.696535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:41.698149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.698170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.698187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:41.698194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:41.698195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:41.698196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:41.698203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255541737410605:8536]
2025-10-01T14:10:41.698209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255541737410605:8536]
2025-10-01T14:10:41.698211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255541737410605:8536]
2025-10-01T14:10:41.698251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:41.698253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:41.698258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.698259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:41.698261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:41.698264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:41.698392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:41.759272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255544114288901:9460]
2025-10-01T14:10:41.759526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1169, pipe: [1:7556255544114288901:9460]
2025-10-01T14:10:41.831031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:41.831515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:41.831563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288901:9460], now have 1 active actors on pipe
2025-10-01T14:10:41.831560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:41.831687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:41.831730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255544114288901:9460]
2025-10-01T14:10:41.842225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:41.842235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:41.842260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1170 reason: error at write: Disconnected sessionId: src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0
2025-10-01T14:10:41.842456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1170 sessionId: src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0 is DEAD
2025-10-01T14:10:41.842603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:41.842612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0] Write session will restart in 0.005808s
2025-10-01T14:10:41.842634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0] Write session: Do CDS request
2025-10-01T14:10:41.842638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:41.849751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.849873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:41.849883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1171
2025-10-01T14:10:41.849971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:41.849993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:41.850000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:41.850002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:41.850167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:41.850364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1171 sessionId:  describe result for acl check
2025-10-01T14:10:41.850400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:41.850404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:41.850405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:41.850409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255544114289128:9870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:41.850485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:41.850624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:41.850631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:41.850638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:41.850666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:41.850693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255541737410870:8539]
2025-10-01T14:10:41.850755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255544114289128:9870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:41.851112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:41.851263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:41.851288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:41.851498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:41.851536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.851541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.851541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.851542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.851543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.851543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.851544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.851545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.851545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.851546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.851546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.851547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.851547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.851548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.851551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.851556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.851558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.851560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.851562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.851564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.851566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.851568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.851570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.851572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.851574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.851577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.851579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.851581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.851585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.851589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:41.851593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.851595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:41.851598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.851601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:41.851603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.851605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:41.851608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.851611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:41.851614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.851617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:41.851619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.851622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:41.851624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.851627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:41.851629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.851632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:41.851634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.851637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.851639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.851642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.851644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.851647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.851649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.851652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:41.851654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.851656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:41.851675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:41.852628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255544114289128:9870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:41.855122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255544114289128:9870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:41.855130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255544114289128:9870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:41.855132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255544114289128:9870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:41.855137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:41.855436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:41.855963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:41.855973Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:41.855975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:41.855977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:41.855982Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1170 [2:7556255541737410870:8539]
2025-10-01T14:10:41.855991Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:41.856005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:41.856006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.856008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.856010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.856021Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:41.856028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:41.856034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:41.856073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.856077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.856078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.856081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:41.856082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:41.856127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:41.856131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.856138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:41.856147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:41.856158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:41.856173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114289166:9870], now have 1 active actors on pipe
2025-10-01T14:10:41.856179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114288915:2446], now have 1 active actors on pipe
2025-10-01T14:10:41.856184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255541737410865:8539]
2025-10-01T14:10:41.856188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255541737410865:8539]
2025-10-01T14:10:41.856190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255541737410865:8539]
2025-10-01T14:10:41.856179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1170
2025-10-01T14:10:41.856197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:41.856183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1170
2025-10-01T14:10:41.856208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:41.856208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:41.856210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:41.856211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:41.856217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:41.856219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:41.856230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.856235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.856261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255541737410865:8539]
2025-10-01T14:10:41.856269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:41.856282Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:41.856283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:41.856289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:41.856292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:41.856293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:41.856298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:41.856306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:41.856334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.856431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.856436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.856445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:41.856497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1171 partition: 0 MaxSeqNo: 45 sessionId: src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0
2025-10-01T14:10:41.856761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e9f5463-21bc05bb-1cfb395c-288b8181_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:41.859623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0] Write session: try to update token
2025-10-01T14:10:41.859638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:41.872480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1171 sessionId: src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:41.874447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:41.874603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:41.874622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:41.874648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:41.874866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:41.878040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:41.878054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:41.878055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:41.878056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:41.878064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255541737410865:8539]
2025-10-01T14:10:41.878067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255541737410865:8539]
2025-10-01T14:10:41.878069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255541737410865:8539]
2025-10-01T14:10:41.878093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:41.878103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:41.878103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:41.878106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:41.878108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:41.878110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:41.878225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:41.931807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255544114289173:9460]
2025-10-01T14:10:41.931999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1170, pipe: [1:7556255544114289173:9460]
2025-10-01T14:10:42.006331Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:42.013134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.013157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.013295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.013351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.013408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.013461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.013555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.013563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.013621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.013674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.013728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.013786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.013826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.013831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.013884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.013934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.013988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.014038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.014076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.014081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.014130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.014178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.014230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.014281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.014318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.014323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.014428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.014497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.014547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.014598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.014637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.014642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.014698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.014747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.014802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.014856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.014895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.014900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.014955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.015005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.015054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.015103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.015143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.015148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.015200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.015249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.015299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.015350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.015390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.015395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.015452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.015504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.015561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.015615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.015655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.015659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.015715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.015767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.015821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.015873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.015910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.015915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.015974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255544114289173:9460], now have 1 active actors on pipe
2025-10-01T14:10:42.016147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255544114289173:9460]
2025-10-01T14:10:42.016171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:42.016172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:42.016173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:42.016193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1171 reason: error at write: Disconnected sessionId: src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0
2025-10-01T14:10:42.016362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1171 sessionId: src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0 is DEAD
2025-10-01T14:10:42.016501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:42.016509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0] Write session will restart in 0.006940s
2025-10-01T14:10:42.016527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0] Write session: Do CDS request
2025-10-01T14:10:42.016532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:42.016989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:42.024795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.024847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:42.024859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1172
2025-10-01T14:10:42.024956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.024987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:42.024997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:42.025004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:42.025308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1172 sessionId:  describe result for acl check
2025-10-01T14:10:42.025335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:42.025339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:42.025340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:42.025343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255548409256598:9874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:42.025707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255548409256598:9874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:42.028102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255548409256598:9874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:42.031272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:42.031417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255548409256598:9874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:42.031427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255548409256598:9874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:42.031429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255548409256598:9874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:42.031434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:42.031534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:42.031656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:42.031663Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:42.031671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:42.031696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:42.031723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255546032378420:8542]
2025-10-01T14:10:42.032080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:42.032230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:42.032253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:42.032435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:42.032466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.032470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.032471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.032472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.032472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.032473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.032474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.032474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.032475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.032475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.032476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.032477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.032483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.032484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.032486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.032492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.032493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.032495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.032497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.032499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.032501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.032503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.032505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.032507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.032508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.032510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.032512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.032513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.032518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.032522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.032525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.032528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.032530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.032533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.032535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.032538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.032540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.032543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.032549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.032552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.032554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.032557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.032562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.032564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.032567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.032569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.032574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.032577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.032580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.032583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.032584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.032591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.032593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.032596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.032601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.032604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.032622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:42.035950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:42.036453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:42.036463Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:42.036464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:42.036466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:42.036470Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1171 [2:7556255546032378420:8542]
2025-10-01T14:10:42.036478Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:42.036492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:42.036497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.036499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.036500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.036509Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:42.036516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:42.036519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:42.036553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.036558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.036559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.036562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:42.036563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:42.036602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:42.036607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.036613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.036618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.036629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:42.036643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409256719:9874], now have 1 active actors on pipe
2025-10-01T14:10:42.036649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409256471:2446], now have 1 active actors on pipe
2025-10-01T14:10:42.036653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255546032378414:8542]
2025-10-01T14:10:42.036658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255546032378414:8542]
2025-10-01T14:10:42.036659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255546032378414:8542]
2025-10-01T14:10:42.036667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:42.036678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:42.036686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:42.036690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:42.036691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:42.036694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:42.036695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:42.036682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1171
2025-10-01T14:10:42.036696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1171
2025-10-01T14:10:42.036705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255546032378414:8542]
2025-10-01T14:10:42.036721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:42.036723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:42.036736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.036742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.036764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71d31631-ab44afba-3fbfd12e-87478c87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:42.036772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.036774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.036778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:42.036784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.036789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:42.036805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.036942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.036948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.036957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.037014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1172 partition: 0 MaxSeqNo: 45 sessionId: src_id|71d31631-ab44afba-3fbfd12e-87478c87_0
2025-10-01T14:10:42.037289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|166d89a2-f3ef74-f1297d19-d6d752a0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|71d31631-ab44afba-3fbfd12e-87478c87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:42.039474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d31631-ab44afba-3fbfd12e-87478c87_0] Write session: try to update token
2025-10-01T14:10:42.039489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d31631-ab44afba-3fbfd12e-87478c87_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:42.051878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1172 sessionId: src_id|71d31631-ab44afba-3fbfd12e-87478c87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:42.054095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:42.054273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.054292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.054321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:42.054407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:42.057173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:42.057189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:42.057190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:42.057192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:42.057198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255546032378414:8542]
2025-10-01T14:10:42.057204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255546032378414:8542]
2025-10-01T14:10:42.057206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255546032378414:8542]
2025-10-01T14:10:42.057240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:42.057241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:42.057245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:42.057248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:42.057248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.057250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:42.057368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:42.116117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255548409256734:9460]
2025-10-01T14:10:42.116337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1171, pipe: [1:7556255548409256734:9460]
2025-10-01T14:10:42.189231Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:42.196479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.196504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.196638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.196693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.196754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.196810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.196850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.196857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.196918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.196972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.197050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.197201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.197241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.197246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.197298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.197343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.197394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.197444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.197481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.197487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.197539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.197590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.197642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.197692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.197730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.197736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.197786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.197832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.197880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.197929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.197966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.197971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.198024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.198075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.198129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.198184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.198223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.198228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.198280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.198328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.198394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.198446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.198484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.198489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.198540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.198590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.198638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.198688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.198727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.198731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.198786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.198836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.198892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.198945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.198988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.198993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.199046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.199095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.199154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.199215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.199253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.199260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.199305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409256734:9460], now have 1 active actors on pipe
2025-10-01T14:10:42.199502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255548409256734:9460]
2025-10-01T14:10:42.199509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:42.199530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:42.199533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:42.199554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1172 reason: error at write: Disconnected sessionId: src_id|71d31631-ab44afba-3fbfd12e-87478c87_0
2025-10-01T14:10:42.199719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1172 sessionId: src_id|71d31631-ab44afba-3fbfd12e-87478c87_0 is DEAD
2025-10-01T14:10:42.199866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d31631-ab44afba-3fbfd12e-87478c87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:42.199877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d31631-ab44afba-3fbfd12e-87478c87_0] Write session will restart in 0.009624s
2025-10-01T14:10:42.199902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d31631-ab44afba-3fbfd12e-87478c87_0] Write session: Do CDS request
2025-10-01T14:10:42.199909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d31631-ab44afba-3fbfd12e-87478c87_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:42.200097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:42.210855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71d31631-ab44afba-3fbfd12e-87478c87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.210937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:42.210951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1173
2025-10-01T14:10:42.211046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.211080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:42.211089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:42.211097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:42.211415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1173 sessionId:  describe result for acl check
2025-10-01T14:10:42.211440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:42.211444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:42.211445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:42.211448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255548409256919:9880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:42.211877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255548409256919:9880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:42.213775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255548409256919:9880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:42.216754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:42.216965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255548409256919:9880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:42.216974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255548409256919:9880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:42.216976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255548409256919:9880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:42.216981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:42.217087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:42.217223Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:42.217230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:42.217238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:42.217347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:42.217376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255546032378671:8544]
2025-10-01T14:10:42.217752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:42.217934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:42.217958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:42.218155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:42.218187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.218191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.218191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.218192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.218192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.218193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.218194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.218194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.218195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.218195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.218196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.218197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.218197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.218198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.218201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.218206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.218208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.218210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.218212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.218214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.218216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.218218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.218220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.218222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.218224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.218226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.218228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.218230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.218234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.218238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.218242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.218245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.218247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.218250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.218252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.218255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.218257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.218260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.218262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.218265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.218267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.218270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.218273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.218276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.218278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.218281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.218283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.218285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.218287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.218290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.218292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.218299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.218302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.218304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.218309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.218312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.218331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:42.222113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:42.222651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:42.222661Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:42.222662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:42.222665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:42.222669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1172 [2:7556255546032378671:8544]
2025-10-01T14:10:42.222679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:42.222693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:42.222694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.222697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.222698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.222710Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:42.222717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:42.222722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:42.222762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.222767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.222768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.222770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:42.222772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:42.222814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:42.222819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.222826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.222831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.222839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:42.222855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409256736:2446], now have 1 active actors on pipe
2025-10-01T14:10:42.222860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409256984:9880], now have 1 active actors on pipe
2025-10-01T14:10:42.222865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255546032378665:8544]
2025-10-01T14:10:42.222868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255546032378665:8544]
2025-10-01T14:10:42.222869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255546032378665:8544]
2025-10-01T14:10:42.222878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:42.222890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:42.222891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:42.222893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:42.222894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:42.222901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:42.222903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:42.222920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255546032378665:8544]
2025-10-01T14:10:42.222905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1172
2025-10-01T14:10:42.222925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:42.222922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1172
2025-10-01T14:10:42.222927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:42.222946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.222953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.222973Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:42.222981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.222987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.222989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:42.222994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.223003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:42.223018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.223125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.223131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.223140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.223205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1173 partition: 0 MaxSeqNo: 45 sessionId: src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0
2025-10-01T14:10:42.223505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71d31631-ab44afba-3fbfd12e-87478c87_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:42.225931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0] Write session: try to update token
2025-10-01T14:10:42.225950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:42.238550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1173 sessionId: src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:42.240742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:42.240892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.240910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.240938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:42.241013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:42.243533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:42.243550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:42.243552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:42.243553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:42.243559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255546032378665:8544]
2025-10-01T14:10:42.243562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255546032378665:8544]
2025-10-01T14:10:42.243566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255546032378665:8544]
2025-10-01T14:10:42.243601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:42.243609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.243611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:42.243622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:42.243643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:42.243660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:42.243737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:42.299415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255548409257020:9460]
2025-10-01T14:10:42.299590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1172, pipe: [1:7556255548409257020:9460]
2025-10-01T14:10:42.376152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:42.382959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.382981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.383115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.383165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.383218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.383269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.383309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.383316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.383372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.383421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.383473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.383526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.383566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.383571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.383621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.383672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.383731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.383782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.383819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.383824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.383874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.383923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.383971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.384028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.384066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.384071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.384121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.384170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.384216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.384262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.384297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.384303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.384353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.384400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.384450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.384501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.384541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.384549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.384597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.384644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.384694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.384761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.384798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.384802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.384851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.384897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.384945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.384996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.385032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.385037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.385089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.385140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.385199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.385250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.385286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.385291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.385340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.385388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.385436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.385485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.385520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.385525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.385558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257020:9460], now have 1 active actors on pipe
2025-10-01T14:10:42.385725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:42.385748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255548409257020:9460]
2025-10-01T14:10:42.385759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:42.385761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:42.385779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1173 reason: error at write: Disconnected sessionId: src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0
2025-10-01T14:10:42.385939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1173 sessionId: src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0 is DEAD
2025-10-01T14:10:42.386089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:42.386099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0] Write session will restart in 0.006589s
2025-10-01T14:10:42.386120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0] Write session: Do CDS request
2025-10-01T14:10:42.386126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:42.386356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:42.393867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.393908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:42.393917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1174
2025-10-01T14:10:42.394036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.394058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:42.394063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:42.394066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:42.394343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1174 sessionId:  describe result for acl check
2025-10-01T14:10:42.394366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:42.394381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:42.394382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:42.394386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255548409257120:9892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:42.394726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255548409257120:9892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:42.396689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255548409257120:9892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:42.398999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255548409257120:9892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:42.399008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255548409257120:9892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:42.399010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255548409257120:9892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:42.399015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:42.399252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:42.402067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:42.402212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:42.402220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:42.402230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:42.402271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:42.402307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255546032378930:8548]
2025-10-01T14:10:42.402727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:42.402919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:42.402952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:42.403154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:42.403202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.403207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.403208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.403209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.403210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.403211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.403212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.403213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.403214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.403215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.403216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.403217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.403218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.403219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.403223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.403233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.403237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.403241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.403244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.403247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.403251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.403255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.403259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.403262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.403266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.403269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.403273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.403276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.403282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.403289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.403295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.403300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.403304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.403311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.403320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.403325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.403332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.403337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.403343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.403349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.403356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.403361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.403368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.403373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.403381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.403386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.403393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.403398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.403408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.403413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.403418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.403423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.403429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.403435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.403442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.403447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.403486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:42.406940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:42.407450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:42.407461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:42.407463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:42.407465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:42.407469Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1173 [2:7556255546032378930:8548]
2025-10-01T14:10:42.407482Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:42.407491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:42.407493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.407494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.407495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.407505Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:42.407513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:42.407517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:42.407562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.407566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.407567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.407569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:42.407571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:42.407616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:42.407621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.407628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.407633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.407641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:42.407657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257278:9892], now have 1 active actors on pipe
2025-10-01T14:10:42.407662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257030:2446], now have 1 active actors on pipe
2025-10-01T14:10:42.407667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255546032378925:8548]
2025-10-01T14:10:42.407669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255546032378925:8548]
2025-10-01T14:10:42.407670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255546032378925:8548]
2025-10-01T14:10:42.407678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:42.407688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:42.407692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:42.407694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:42.407696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:42.407699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:42.407700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:42.407716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255546032378925:8548]
2025-10-01T14:10:42.407722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:42.407728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:42.407730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1173
2025-10-01T14:10:42.407736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1173
2025-10-01T14:10:42.407764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.407770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.407788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d79ab8b9-78009943-e7a9d62d-77736260_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:42.407795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.407797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.407799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:42.407804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.407809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:42.407819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.407935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.407940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.407951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.408017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1174 partition: 0 MaxSeqNo: 45 sessionId: src_id|d79ab8b9-78009943-e7a9d62d-77736260_0
2025-10-01T14:10:42.408320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1367df88-e08320d1-72c3f41e-e8a0a3de_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d79ab8b9-78009943-e7a9d62d-77736260_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:42.410700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d79ab8b9-78009943-e7a9d62d-77736260_0] Write session: try to update token
2025-10-01T14:10:42.410725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d79ab8b9-78009943-e7a9d62d-77736260_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:42.422635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1174 sessionId: src_id|d79ab8b9-78009943-e7a9d62d-77736260_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:42.424889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:42.425093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.425117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.425156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:42.425229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:42.429071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:42.429088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:42.429089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:42.429091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:42.429098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255546032378925:8548]
2025-10-01T14:10:42.429101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255546032378925:8548]
2025-10-01T14:10:42.429103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255546032378925:8548]
2025-10-01T14:10:42.429141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:42.429141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:42.429145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:42.429148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:42.429149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.429150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:42.429279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:42.485785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255548409257291:9460]
2025-10-01T14:10:42.486025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1173, pipe: [1:7556255548409257291:9460]
2025-10-01T14:10:42.558092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:42.564546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.564575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.564728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.564784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.564841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.564898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.565236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.565247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.565306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.565358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.565415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.565472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.565510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.565516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.565569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.565622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.565686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.565741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.565778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.565783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.565835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.565888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.565939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.565990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.566028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.566032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.566083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.566137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.566190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.566241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.566279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.566284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.566338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.566405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.566462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.566517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.566556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.566561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.566613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.566667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.566729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.566789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.566826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.566831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.566884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.566935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.566988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.567040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.567079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.567083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.567140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.567193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.567249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.567305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.567342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.567347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.567402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.567454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.567515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.567569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.567606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.567611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.567648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257291:9460], now have 1 active actors on pipe
2025-10-01T14:10:42.567860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:42.567868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:42.567869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:42.567890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1174 reason: error at write: Disconnected sessionId: src_id|d79ab8b9-78009943-e7a9d62d-77736260_0
2025-10-01T14:10:42.567908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255548409257291:9460]
2025-10-01T14:10:42.568055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1174 sessionId: src_id|d79ab8b9-78009943-e7a9d62d-77736260_0 is DEAD
2025-10-01T14:10:42.568151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:42.568185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d79ab8b9-78009943-e7a9d62d-77736260_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:42.568196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d79ab8b9-78009943-e7a9d62d-77736260_0] Write session will restart in 0.006993s
2025-10-01T14:10:42.568214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d79ab8b9-78009943-e7a9d62d-77736260_0] Write session: Do CDS request
2025-10-01T14:10:42.568219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d79ab8b9-78009943-e7a9d62d-77736260_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:42.575847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d79ab8b9-78009943-e7a9d62d-77736260_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.575945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:42.575956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1175
2025-10-01T14:10:42.576043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.576065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:42.576071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:42.576074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:42.576412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1175 sessionId:  describe result for acl check
2025-10-01T14:10:42.576443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:42.576448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:42.576449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:42.576452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255548409257349:9896] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:42.576861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255548409257349:9896] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:42.579649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255548409257349:9896] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:42.582153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255548409257349:9896] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:42.582163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255548409257349:9896] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:42.582165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255548409257349:9896] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:42.582170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:42.583485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:42.586616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:42.586783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:42.586792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:42.586800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:42.586833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:42.586862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255546032379214:8561]
2025-10-01T14:10:42.587238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:42.587425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:42.587452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:42.587639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:42.587670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.587674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.587675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.587676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.587676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.587677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.587677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.587678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.587678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.587679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.587680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.587680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.587681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.587681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.587684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.587690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.587692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.587694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.587696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.587698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.587700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.587702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.587704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.587706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.587708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.587711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.587714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.587717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.587723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.587730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.587736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.587741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.587744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.587746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.587749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.587752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.587754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.587757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.587759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.587761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.587764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.587767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.587769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.587772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.587774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.587777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.587779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.587783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.587785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.587787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.587790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.587792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.587796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.587799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.587801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.587803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.587822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:42.591022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:42.591615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:42.591627Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:42.591628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:42.591630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:42.591635Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1174 [2:7556255546032379214:8561]
2025-10-01T14:10:42.591644Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:42.591654Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:42.591656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.591658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.591659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.591669Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:42.591672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:42.591676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:42.591708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.591713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.591714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.591716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:42.591718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:42.591760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:42.591765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.591771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.591776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.591786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:42.591804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257293:2446], now have 1 active actors on pipe
2025-10-01T14:10:42.591811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257539:9896], now have 1 active actors on pipe
2025-10-01T14:10:42.591817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255546032379209:8561]
2025-10-01T14:10:42.591819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255546032379209:8561]
2025-10-01T14:10:42.591821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255546032379209:8561]
2025-10-01T14:10:42.591833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:42.591843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:42.591847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:42.591851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:42.591855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:42.591859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:42.591861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:42.591879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255546032379209:8561]
2025-10-01T14:10:42.591886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:42.591891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:42.591880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1174
2025-10-01T14:10:42.591891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1174
2025-10-01T14:10:42.591914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.591922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.591942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:42.591951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.591959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.591961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:42.591969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.591980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:42.591995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.592106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.592112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.592123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.592192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1175 partition: 0 MaxSeqNo: 45 sessionId: src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0
2025-10-01T14:10:42.592536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d79ab8b9-78009943-e7a9d62d-77736260_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:42.594638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0] Write session: try to update token
2025-10-01T14:10:42.594651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:42.606099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1175 sessionId: src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:42.608372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:42.608526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.608547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.608583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:42.608649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:42.610599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:42.610619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:42.610622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:42.610623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:42.610632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255546032379209:8561]
2025-10-01T14:10:42.610637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255546032379209:8561]
2025-10-01T14:10:42.610640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255546032379209:8561]
2025-10-01T14:10:42.610684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:42.610696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.610698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:42.610697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:42.610702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:42.610706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:42.610840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:42.668054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255548409257555:9460]
2025-10-01T14:10:42.668306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1174, pipe: [1:7556255548409257555:9460]
2025-10-01T14:10:42.741727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:42.748729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.748752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.748893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.748946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.749004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.749067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.749106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.749113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.749167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.749215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.749267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.749318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.749355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.749360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.749408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.749452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.749498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.749545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.749581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.749586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.749634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.749681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.749727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.749772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.749808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.749813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.749860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.749907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.749955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.750004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.750040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.750044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.750092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.750138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.750188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.750241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.750278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.750284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.750332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.750395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.750443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.750492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.750527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.750532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.750579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.750626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.750673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.750722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.750757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.750762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.750811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.750861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.750910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.750958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.750994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.750999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.751046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.751096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.751144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.751191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.751225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.751230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.751263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257555:9460], now have 1 active actors on pipe
2025-10-01T14:10:42.751455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:42.751505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255548409257555:9460]
2025-10-01T14:10:42.751614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:42.751620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:42.751638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1175 reason: error at write: Disconnected sessionId: src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0
2025-10-01T14:10:42.751812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1175 sessionId: src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0 is DEAD
2025-10-01T14:10:42.751962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:42.751972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0] Write session will restart in 0.008044s
2025-10-01T14:10:42.751996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0] Write session: Do CDS request
2025-10-01T14:10:42.752002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:42.752309Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:42.760773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.760849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:42.760858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1176
2025-10-01T14:10:42.760940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.760970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:42.760976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:42.760981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:42.761244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1176 sessionId:  describe result for acl check
2025-10-01T14:10:42.761264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:42.761268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:42.761269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:42.761273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255548409257664:9901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:42.761822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255548409257664:9901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:42.764231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255548409257664:9901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:42.766224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:42.766257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255548409257664:9901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:42.766266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255548409257664:9901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:42.766268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255548409257664:9901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:42.766273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:42.769245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:42.769374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:42.769381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:42.769389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:42.769417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:42.769446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255546032379480:8564]
2025-10-01T14:10:42.769820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:42.770006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:42.770032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:42.770290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:42.770367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.770390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.770390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.770391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.770392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.770393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.770394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.770395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.770396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.770397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.770398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.770398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.770399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.770400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.770405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.770413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.770416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.770419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.770422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.770425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.770429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.770431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.770435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.770438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.770441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.770445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.770448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.770451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.770457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.770464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.770471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.770475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.770497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.770503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.770507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.770512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.770517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.770521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.770530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.770535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.770544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.770553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.770561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.770570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.770579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.770588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.770596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.770605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.770614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.770623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.770630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.770639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.770646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.770655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.770663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.770671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.770723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:42.774111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:42.774780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:42.774791Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:42.774793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:42.774795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:42.774799Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1175 [2:7556255546032379480:8564]
2025-10-01T14:10:42.774811Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:42.774826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:42.774831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.774833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.774835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.774845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:42.774848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:42.774851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:42.774884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.774889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.774891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.774893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:42.774895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:42.774941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:42.774946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.774952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.774957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.774969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:42.774984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255546032379474:8564]
2025-10-01T14:10:42.774988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255546032379474:8564]
2025-10-01T14:10:42.774989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255546032379474:8564]
2025-10-01T14:10:42.774996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:42.775004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:42.775005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:42.775007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:42.775009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:42.775012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:42.775014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:42.775021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257809:9901], now have 1 active actors on pipe
2025-10-01T14:10:42.775024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257559:2446], now have 1 active actors on pipe
2025-10-01T14:10:42.775039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255546032379474:8564]
2025-10-01T14:10:42.775047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:42.775063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:42.775085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1175
2025-10-01T14:10:42.775090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1175
2025-10-01T14:10:42.775249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.775256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.775276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d83d7abd-da59ea06-4860263b-b0760d95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:42.775284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.775290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.775292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:42.775297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.775306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:42.775319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.775460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.775467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.775475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.775536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1176 partition: 0 MaxSeqNo: 45 sessionId: src_id|d83d7abd-da59ea06-4860263b-b0760d95_0
2025-10-01T14:10:42.775832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d24af4c-d615bd72-44924fae-71ce82f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d83d7abd-da59ea06-4860263b-b0760d95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:42.778036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d7abd-da59ea06-4860263b-b0760d95_0] Write session: try to update token
2025-10-01T14:10:42.778049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d7abd-da59ea06-4860263b-b0760d95_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:42.789549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1176 sessionId: src_id|d83d7abd-da59ea06-4860263b-b0760d95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:42.791741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:42.791896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.791914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.791956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:42.792023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:42.793604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:42.793617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:42.793619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:42.793620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:42.793627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255546032379474:8564]
2025-10-01T14:10:42.793632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255546032379474:8564]
2025-10-01T14:10:42.793635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255546032379474:8564]
2025-10-01T14:10:42.793672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:42.793676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:42.793680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.793681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:42.793684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:42.793686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:42.793788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:42.851861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255548409257834:9460]
2025-10-01T14:10:42.852078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1175, pipe: [1:7556255548409257834:9460]
2025-10-01T14:10:42.922833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:42.929447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.929470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.929608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.929664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.929720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.929776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.929820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.929823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.929881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.929933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.929987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.930045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.930088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.930093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.930143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.930191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.930240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.930290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.930327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.930332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.930404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.930464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.930511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.930560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.930597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.930602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.930654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.930703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.930751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.930805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.930843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.930848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.930902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.930952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.931013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.931068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.931107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.931112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.931163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.931211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.931263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.931315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.931354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.931359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.931411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.931462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.931512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.931566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.931605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.931610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.931665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.931717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.931770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.931827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.931865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.931871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.931927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.931978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.932030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.932082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.932120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.932125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.932162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257834:9460], now have 1 active actors on pipe
2025-10-01T14:10:42.932361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:42.932370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:42.932392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1176 reason: error at write: Disconnected sessionId: src_id|d83d7abd-da59ea06-4860263b-b0760d95_0
2025-10-01T14:10:42.932396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255548409257834:9460]
2025-10-01T14:10:42.932423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:42.932566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1176 sessionId: src_id|d83d7abd-da59ea06-4860263b-b0760d95_0 is DEAD
2025-10-01T14:10:42.932697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d7abd-da59ea06-4860263b-b0760d95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:42.932712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d7abd-da59ea06-4860263b-b0760d95_0] Write session will restart in 0.008918s
2025-10-01T14:10:42.932731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d7abd-da59ea06-4860263b-b0760d95_0] Write session: Do CDS request
2025-10-01T14:10:42.932737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d7abd-da59ea06-4860263b-b0760d95_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:42.933053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:42.942772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d7abd-da59ea06-4860263b-b0760d95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.942866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:42.942875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1177
2025-10-01T14:10:42.942982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:42.943015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:42.943018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:42.943021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:42.943330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1177 sessionId:  describe result for acl check
2025-10-01T14:10:42.943355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:42.943360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:42.943362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:42.943365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255548409257998:9906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:42.943718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255548409257998:9906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:42.945606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255548409257998:9906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:42.948857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:42.949019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255548409257998:9906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:42.949029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255548409257998:9906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:42.949031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255548409257998:9906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:42.949035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:42.949149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:42.949266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:42.949274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:42.949281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:42.949307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:42.949331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255546032379738:8567]
2025-10-01T14:10:42.949725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:42.949937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:42.949976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:42.950249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:42.950304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.950311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.950311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.950312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.950313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.950314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.950315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.950316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.950317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.950318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.950319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.950321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.950322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.950323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.950327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.950336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.950339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.950343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.950350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.950354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.950362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.950386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.950389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.950397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.950401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.950409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.950413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.950420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.950428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.950438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:42.950447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.950456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:42.950464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.950474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:42.950482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.950491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:42.950499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.950508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:42.950516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.950524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:42.950532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.950536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:42.950540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.950549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:42.950557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.950565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:42.950572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.950577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.950587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.950595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.950603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.950611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.950619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.950628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:42.950635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.950643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:42.950663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:42.954016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:42.954718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:42.954733Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:42.954735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:42.954737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:42.954744Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1176 [2:7556255546032379738:8567]
2025-10-01T14:10:42.954754Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:42.954768Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:42.954773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.954775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.954776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.954786Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:42.954792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:42.954796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:42.954830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.954834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.954835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.954838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:42.954839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:42.954881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:42.954887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.954896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:42.954909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:42.954925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:42.954946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409257836:2446], now have 1 active actors on pipe
2025-10-01T14:10:42.954952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255548409258089:9906], now have 1 active actors on pipe
2025-10-01T14:10:42.954957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255546032379732:8567]
2025-10-01T14:10:42.954959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255546032379732:8567]
2025-10-01T14:10:42.954961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255546032379732:8567]
2025-10-01T14:10:42.954969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:42.954981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:42.954983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:42.954986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:42.954987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:42.954992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:42.954994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:42.955007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255546032379732:8567]
2025-10-01T14:10:42.955013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:42.955019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:42.955136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1176
2025-10-01T14:10:42.955145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1176
2025-10-01T14:10:42.955227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.955237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.955261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:42.955271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.955279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.955281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:42.955289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.955300Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:42.955312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.955429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.955436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.955448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:42.955507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1177 partition: 0 MaxSeqNo: 45 sessionId: src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0
2025-10-01T14:10:42.955797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d83d7abd-da59ea06-4860263b-b0760d95_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:42.957929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0] Write session: try to update token
2025-10-01T14:10:42.957943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:42.968938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1177 sessionId: src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:42.969562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:42.969580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:42.969588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255546032379732:8567]
2025-10-01T14:10:42.969624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:42.969627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:42.969764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:42.969888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:42.970004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:42.970129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:42.970295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:42.970324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:42.971008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:42.971133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.971147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.971167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:42.971227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:42.989346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:42.989369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:42.989486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.989534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.989592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.989644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.989682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.989693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.989743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.989790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.989836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.989884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.989919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.989924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.989970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.990015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.990068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.990125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.990163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.990169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.990220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.990267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.990313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.990359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.990412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.990418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.990465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.990512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.990562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.990616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.990667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.990674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.990729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.990775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.990829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.990881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.990915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.990921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.990970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.991016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.991066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.991120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.991169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.991177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.991235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.991287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.991337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.991389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.991427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.991431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.991483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.991532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.991584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.991638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.991674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.991680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.991733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:42.991783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:42.991832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:42.991886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:42.991932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:42.991939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:42.991977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:42.991984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:42.991986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:42.991988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:42.991997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255546032379732:8567]
2025-10-01T14:10:42.992000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255546032379732:8567]
2025-10-01T14:10:42.992005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255546032379732:8567]
2025-10-01T14:10:42.992049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:42.992057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:10:42.992060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:42.992063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:42.992114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:42.992137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:42.992142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:10:42.992159Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992169Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992176Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992180Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992188Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992191Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992198Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992201Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992209Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992217Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992220Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992228Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992236Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992239Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992246Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992250Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992253Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992256Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992260Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992263Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992544Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992550Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992552Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992555Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992557Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992559Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992561Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992563Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992566Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992568Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992692Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992698Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992701Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992704Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992719Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:10:42.992737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:10:42.992748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:10:42.992753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:10:42.992755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:10:42.992757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:10:42.993062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:10:42.993079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:10:42.993086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:10:42.993088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:10:42.993090Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:10:42.993092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:10:42.993498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:10:42.993517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:10:42.993524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:10:42.993526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:10:42.993528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:10:42.993531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:10:42.994005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:10:42.994023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:42.994095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327842993
2025-10-01T14:10:42.994818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:42.994827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:42.994829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:42.994934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:43.032596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255552704225396:9460]
2025-10-01T14:10:43.032786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1176, pipe: [1:7556255552704225396:9460]
2025-10-01T14:10:43.123623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:43.123926Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:10:43.123948Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:10:43.123965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704225396:9460], now have 1 active actors on pipe
2025-10-01T14:10:43.124122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:43.124156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:43.124161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255552704225396:9460]
2025-10-01T14:10:43.124166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:43.124188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1177 reason: error at write: Disconnected sessionId: src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0
2025-10-01T14:10:43.124194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:43.124343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1177 sessionId: src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0 is DEAD
2025-10-01T14:10:43.124471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:43.124479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0] Write session will restart in 0.007394s
2025-10-01T14:10:43.124500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0] Write session: Do CDS request
2025-10-01T14:10:43.124505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:43.132872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.132933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:43.132944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1178
2025-10-01T14:10:43.133049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.133072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:43.133079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:43.133081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:43.133402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1178 sessionId:  describe result for acl check
2025-10-01T14:10:43.133426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:43.133431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:43.133432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:43.133436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255552704225488:9910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:43.133849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255552704225488:9910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:43.136286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255552704225488:9910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:43.138168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:43.141010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:43.141035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255552704225488:9910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:43.141047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255552704225488:9910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:43.141050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255552704225488:9910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:43.141056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:43.141135Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:43.141142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:43.141149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:43.141177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:43.141203Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255550327347289:8569]
2025-10-01T14:10:43.141545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:43.141716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:43.141739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:43.141915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:43.141945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.141949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.141949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.141950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.141950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.141951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.141952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.141952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.141953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.141953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.141954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.141955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.141955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.141956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.141958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.141963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.141965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.141968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.141970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.141972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.141974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.141976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.141978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.141980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.141982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.141984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.141985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.141987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.141991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.141995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.141999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.142002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.142005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.142008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.142010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.142013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.142015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.142017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.142020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.142022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.142025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.142027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.142029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.142032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.142034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.142037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.142043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.142046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.142048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.142050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.142052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.142055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.142059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.142062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.142064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.142070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.142089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:43.145334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:43.146050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:43.146062Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:43.146063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:43.146065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:43.146070Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1177 [2:7556255550327347289:8569]
2025-10-01T14:10:43.146079Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:43.146092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:43.146097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.146099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.146100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.146110Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:43.146116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:43.146119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:43.146153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.146158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.146159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.146161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:43.146163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:43.146204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:43.146209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.146215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.146220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.146231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:43.146246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704225399:2446], now have 1 active actors on pipe
2025-10-01T14:10:43.146251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704225652:9910], now have 1 active actors on pipe
2025-10-01T14:10:43.146256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255550327347284:8569]
2025-10-01T14:10:43.146259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255550327347284:8569]
2025-10-01T14:10:43.146261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255550327347284:8569]
2025-10-01T14:10:43.146269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:43.146276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:43.146287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:43.146287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:43.146289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:43.146290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:43.146291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:43.146278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1177
2025-10-01T14:10:43.146278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1177
2025-10-01T14:10:43.146301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255550327347284:8569]
2025-10-01T14:10:43.146306Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:43.146313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:43.146326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.146330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.146350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:43.146358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.146361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.146362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:43.146368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.146395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:43.146415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.146546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.146552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.146570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.146998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1178 partition: 0 MaxSeqNo: 45 sessionId: src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0
2025-10-01T14:10:43.147294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76fb26dc-fb9eb401-b6cf2675-d0651f05_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:43.149403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0] Write session: try to update token
2025-10-01T14:10:43.149418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:43.160300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1178 sessionId: src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:43.162244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:43.162407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.162427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.162455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:43.162519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:43.164346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:43.164361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:43.164362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:43.164363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:43.164370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255550327347284:8569]
2025-10-01T14:10:43.164373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255550327347284:8569]
2025-10-01T14:10:43.164375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255550327347284:8569]
2025-10-01T14:10:43.164406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:43.164417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.164418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:43.164438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:43.164444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:43.164448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:43.164523Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:43.224078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255552704225663:9460]
2025-10-01T14:10:43.224285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1177, pipe: [1:7556255552704225663:9460]
2025-10-01T14:10:43.291749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:43.297927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.297949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.298065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.298115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.298169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.298220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.298260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.298268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.298323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.298393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.298457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.298527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.298572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.298580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.298642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.298701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.298762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.298822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.298865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.298873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.298934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.298996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.299056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.299115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.299157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.299165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.299225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.299283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.299342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.299402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.299442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.299449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.299511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.299566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.299628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.299692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.299737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.299745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.299805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.299862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.299920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.299981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.300024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.300032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.300093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.300150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.300209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.300271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.300314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.300322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.300387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.300446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.300507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.300570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.300614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.300622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.300688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.300773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.300838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.300899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.300943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.300950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.300998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704225663:9460], now have 1 active actors on pipe
2025-10-01T14:10:43.301306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:43.301316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:43.301351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1178 reason: error at write: Disconnected sessionId: src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0
2025-10-01T14:10:43.301561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1178 sessionId: src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0 is DEAD
2025-10-01T14:10:43.301663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:43.301673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0] Write session will restart in 0.007703s
2025-10-01T14:10:43.301690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0] Write session: Do CDS request
2025-10-01T14:10:43.301694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:43.301702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:43.301745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255552704225663:9460]
2025-10-01T14:10:43.301768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:43.310748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.310831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:43.310841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1179
2025-10-01T14:10:43.310927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.310949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:43.310952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:43.310954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:43.311252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1179 sessionId:  describe result for acl check
2025-10-01T14:10:43.311280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:43.311360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:43.311365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:43.311369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255552704225824:9922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:43.311737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255552704225824:9922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:43.313240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255552704225824:9922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:43.315174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255552704225824:9922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:43.315184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255552704225824:9922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:43.315186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255552704225824:9922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:43.315191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:43.318287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:43.318685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:43.318855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:43.318867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:43.318878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:43.318934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:43.318973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255550327347554:8571]
2025-10-01T14:10:43.319512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:43.319797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:43.319843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:43.320122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:43.320200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.320208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.320209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.320210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.320212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.320213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.320214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.320215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.320216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.320217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.320218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.320219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.320220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.320221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.320227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.320235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.320239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.320243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.320247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.320250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.320253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.320256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.320259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.320263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.320271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.320275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.320278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.320282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.320288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.320296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.320305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.320314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.320322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.320330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.320334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.320343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.320351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.320360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.320367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.320372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.320381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.320387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.320395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.320404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.320412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.320420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.320428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.320432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.320441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.320449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.320456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.320460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.320470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.320478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.320486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.320491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.320528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:43.323799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:43.324362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:43.324380Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:43.324382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:43.324385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:43.324391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1178 [2:7556255550327347554:8571]
2025-10-01T14:10:43.324404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:43.324420Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:43.324427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.324430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.324432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.324445Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:43.324454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:43.324463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:43.324511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.324519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.324520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.324523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:43.324525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:43.324578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:43.324587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.324598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.324608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.324626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:43.324646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704225678:2446], now have 1 active actors on pipe
2025-10-01T14:10:43.324655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704225945:9922], now have 1 active actors on pipe
2025-10-01T14:10:43.324661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255550327347549:8571]
2025-10-01T14:10:43.324663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255550327347549:8571]
2025-10-01T14:10:43.324665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255550327347549:8571]
2025-10-01T14:10:43.324677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:43.324691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:43.324691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:43.324693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:43.324695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:43.324676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1178
2025-10-01T14:10:43.324720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:43.324726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:43.324687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1178
2025-10-01T14:10:43.324762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.324771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.324783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255550327347549:8571]
2025-10-01T14:10:43.324795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:43.324804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:43.324819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|950d4788-3bd89af0-a09617c0-4cb05490_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:43.324830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.324835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.324841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:43.324849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.324861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:43.324887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.324994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.325001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.325012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.325074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1179 partition: 0 MaxSeqNo: 45 sessionId: src_id|950d4788-3bd89af0-a09617c0-4cb05490_0
2025-10-01T14:10:43.325363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63650b33-9fc19217-e2e1715-d4ee3f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|950d4788-3bd89af0-a09617c0-4cb05490_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:43.327610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950d4788-3bd89af0-a09617c0-4cb05490_0] Write session: try to update token
2025-10-01T14:10:43.327624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950d4788-3bd89af0-a09617c0-4cb05490_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:43.339105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1179 sessionId: src_id|950d4788-3bd89af0-a09617c0-4cb05490_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:43.341188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:43.341473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:43.341362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.341386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.341421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:43.343228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:43.343249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:43.343252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:43.343253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:43.343261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255550327347549:8571]
2025-10-01T14:10:43.343266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255550327347549:8571]
2025-10-01T14:10:43.343269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255550327347549:8571]
2025-10-01T14:10:43.343299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:43.343310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:43.343313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:43.343314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:43.343319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.343321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:43.343444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:43.401762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255552704225961:9460]
2025-10-01T14:10:43.401988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1178, pipe: [1:7556255552704225961:9460]
2025-10-01T14:10:43.477281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:43.483530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.483552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.483688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.483739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.483794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.483847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.483886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.483893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.483949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.483999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.484051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.484103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.484141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.484146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.484194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.484240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.484289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.484341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.484383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.484388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.484438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.484487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.484531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.484579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.484614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.484619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.484670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.484723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.484771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.484818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.484868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.484873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.484924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.484969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.485020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.485071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.485107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.485112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.485164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.485213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.485263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.485310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.485348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.485353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.485402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.485447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.485500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.485551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.485589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.485597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.485652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.485703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.485755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.485802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.485840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.485845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.485898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.485947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.485999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.486049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.486083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.486088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.486124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704225961:9460], now have 1 active actors on pipe
2025-10-01T14:10:43.486301Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:43.486324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:43.486328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:43.486341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255552704225961:9460]
2025-10-01T14:10:43.486353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1179 reason: error at write: Disconnected sessionId: src_id|950d4788-3bd89af0-a09617c0-4cb05490_0
2025-10-01T14:10:43.486550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1179 sessionId: src_id|950d4788-3bd89af0-a09617c0-4cb05490_0 is DEAD
2025-10-01T14:10:43.486676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d4788-3bd89af0-a09617c0-4cb05490_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:43.486684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d4788-3bd89af0-a09617c0-4cb05490_0] Write session will restart in 0.009225s
2025-10-01T14:10:43.486703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d4788-3bd89af0-a09617c0-4cb05490_0] Write session: Do CDS request
2025-10-01T14:10:43.486708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d4788-3bd89af0-a09617c0-4cb05490_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:43.486805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:43.496787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950d4788-3bd89af0-a09617c0-4cb05490_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.496841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:43.496856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1180
2025-10-01T14:10:43.497203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.497225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:43.497230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:43.497233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:43.497512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1180 sessionId:  describe result for acl check
2025-10-01T14:10:43.497539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:43.497542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:43.497543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:43.497547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255552704226128:9926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:43.497905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255552704226128:9926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:43.499700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255552704226128:9926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:43.503845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255552704226128:9926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:43.503856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255552704226128:9926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:43.503868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:43.503858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255552704226128:9926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:43.503864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:43.504267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:43.504415Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:43.504427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:43.504436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:43.504472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:43.504507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255550327347844:8586]
2025-10-01T14:10:43.505041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:43.505306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:43.505342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:43.505610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:43.505654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.505660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.505661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.505662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.505663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.505664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.505665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.505666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.505667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.505667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.505668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.505669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.505670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.505671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.505675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.505683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.505687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.505690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.505693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.505696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.505699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.505701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.505705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.505708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.505711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.505713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.505716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.505719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.505726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.505737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.505742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.505751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.505754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.505762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.505766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.505772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.505775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.505779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.505787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.505791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.505795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.505803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.505806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.505815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.505818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.505826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.505829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.505834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.505839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.505843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.505846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.505850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.505861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.505865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.505868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.505872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.505901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:43.509427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:43.510224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:43.510248Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:43.510251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:43.510256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:43.510267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1179 [2:7556255550327347844:8586]
2025-10-01T14:10:43.510282Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:43.510303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:43.510310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.510313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.510315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.510331Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:43.510340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:43.510346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:43.510413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.510421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.510423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.510427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:43.510429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:43.510500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:43.510514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.510529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.510548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.510571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:43.510603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704225966:2446], now have 1 active actors on pipe
2025-10-01T14:10:43.510619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704226217:9926], now have 1 active actors on pipe
2025-10-01T14:10:43.510604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1179
2025-10-01T14:10:43.510620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1179
2025-10-01T14:10:43.510635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255550327347838:8586]
2025-10-01T14:10:43.510648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255550327347838:8586]
2025-10-01T14:10:43.510649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255550327347838:8586]
2025-10-01T14:10:43.510664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:43.510670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:43.510672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:43.510674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:43.510695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:43.510720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:43.510734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:43.510761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.510774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.510831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255550327347838:8586]
2025-10-01T14:10:43.510852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:43.510859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:43.510878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a067f16-186ec120-81b26f72-f5a408a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:43.510892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.510904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.510906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:43.510918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.510938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:43.511003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.511184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.511202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.511230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.511309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1180 partition: 0 MaxSeqNo: 45 sessionId: src_id|4a067f16-186ec120-81b26f72-f5a408a1_0
2025-10-01T14:10:43.511651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d4788-3bd89af0-a09617c0-4cb05490_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4a067f16-186ec120-81b26f72-f5a408a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:43.513902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a067f16-186ec120-81b26f72-f5a408a1_0] Write session: try to update token
2025-10-01T14:10:43.513912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a067f16-186ec120-81b26f72-f5a408a1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:43.525533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1180 sessionId: src_id|4a067f16-186ec120-81b26f72-f5a408a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:43.527839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:43.528000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.528021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.529642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:43.529672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:43.529675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:43.529676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:43.529677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:43.529683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255550327347838:8586]
2025-10-01T14:10:43.529686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255550327347838:8586]
2025-10-01T14:10:43.529688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255550327347838:8586]
2025-10-01T14:10:43.529706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:43.529716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:43.529717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:43.529719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:43.529721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.529723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:43.529734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:43.529828Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:43.586582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255552704226229:9460]
2025-10-01T14:10:43.586793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1179, pipe: [1:7556255552704226229:9460]
2025-10-01T14:10:43.662573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:43.669943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.669971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.670123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.670176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.670236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.670288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.670328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.670334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.670411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.670477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.670532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.670590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.670633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.670638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.670698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.670751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.670806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.670861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.670902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.670907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.670965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.671020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.671073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.671124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.671164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.671169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.671221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.671271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.671326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.671381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.671420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.671425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.671481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.671533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.671590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.671647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.671695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.671700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.671755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.671810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.671864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.671920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.671959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.671966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.672020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.672073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.672129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.672187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.672229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.672234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.672291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.672348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.672406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.672466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.672508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.672514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.672574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:43.672636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:43.672698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:43.672773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:43.672821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:43.672826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:43.672878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704226229:9460], now have 1 active actors on pipe
2025-10-01T14:10:43.673142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:43.673144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255552704226229:9460]
2025-10-01T14:10:43.673168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:43.673170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:43.673196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1180 reason: error at write: Disconnected sessionId: src_id|4a067f16-186ec120-81b26f72-f5a408a1_0
2025-10-01T14:10:43.673388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1180 sessionId: src_id|4a067f16-186ec120-81b26f72-f5a408a1_0 is DEAD
2025-10-01T14:10:43.673540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a067f16-186ec120-81b26f72-f5a408a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:43.673550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a067f16-186ec120-81b26f72-f5a408a1_0] Write session will restart in 0.006333s
2025-10-01T14:10:43.673592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a067f16-186ec120-81b26f72-f5a408a1_0] Write session: Do CDS request
2025-10-01T14:10:43.673599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a067f16-186ec120-81b26f72-f5a408a1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:43.674058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:43.680829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a067f16-186ec120-81b26f72-f5a408a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.680946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:43.680956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1181
2025-10-01T14:10:43.681040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.681063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:43.681066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:43.681070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:43.681381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1181 sessionId:  describe result for acl check
2025-10-01T14:10:43.681409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:43.681410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:43.681412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:43.681415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255552704226293:9930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:43.681796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255552704226293:9930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:43.684256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255552704226293:9930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:43.687062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255552704226293:9930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:43.687078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255552704226293:9930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:43.687081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255552704226293:9930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:43.687089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:43.691705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:43.692137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:43.692278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:43.692286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:43.692295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:43.692327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:43.692363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255550327348115:8588]
2025-10-01T14:10:43.692803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:43.693050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:43.693085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:43.693311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:43.693348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.693353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.693353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.693354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.693355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.693356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.693356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.693357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.693357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.693358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.693359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.693360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.693360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.693361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.693364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.693370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.693373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.693375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.693377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.693379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.693381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.693383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.693385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.693387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.693389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.693391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.693393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.693397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.693403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.693410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.693416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.693426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.693431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.693434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.693437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.693443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.693446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.693449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.693451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.693455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.693459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.693463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.693465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.693469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.693472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.693478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.693480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.693483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.693487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.693490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.693495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.693498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.693500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.693503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.693509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.693512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.693532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:43.697283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:43.697803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:43.697817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:43.697819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:43.697823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:43.697829Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1180 [2:7556255550327348115:8588]
2025-10-01T14:10:43.697840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:43.697855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:43.697860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.697863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.697864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.697875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:43.697882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:43.697886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:43.697920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.697925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.697926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.697928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:43.697930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:43.697974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:43.697979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.697986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.698000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.698016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:43.698034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255550327348110:8588]
2025-10-01T14:10:43.698039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255550327348110:8588]
2025-10-01T14:10:43.698041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255550327348110:8588]
2025-10-01T14:10:43.698048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:43.698056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:43.698061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:43.698066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:43.698068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:43.698073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:43.698076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:43.698090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704226485:9930], now have 1 active actors on pipe
2025-10-01T14:10:43.698095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704226232:2446], now have 1 active actors on pipe
2025-10-01T14:10:43.698109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255550327348110:8588]
2025-10-01T14:10:43.698115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:43.698132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:43.698139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1180
2025-10-01T14:10:43.698297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1180
2025-10-01T14:10:43.698356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.698366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.698400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c93539d9-bb5ce55-b025296-201911df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:43.698413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.698417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.698420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:43.698428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.698436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:43.698450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.698622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.698628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.698639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.698982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1181 partition: 0 MaxSeqNo: 45 sessionId: src_id|c93539d9-bb5ce55-b025296-201911df_0
2025-10-01T14:10:43.699299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a067f16-186ec120-81b26f72-f5a408a1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c93539d9-bb5ce55-b025296-201911df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:43.701434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c93539d9-bb5ce55-b025296-201911df_0] Write session: try to update token
2025-10-01T14:10:43.701446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c93539d9-bb5ce55-b025296-201911df_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:43.712848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1181 sessionId: src_id|c93539d9-bb5ce55-b025296-201911df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:43.715092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:43.716656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.716682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.716700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:43.716717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:43.716719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:43.716721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:43.716726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255550327348110:8588]
2025-10-01T14:10:43.716729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255550327348110:8588]
2025-10-01T14:10:43.716731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255550327348110:8588]
2025-10-01T14:10:43.716763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:43.716770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:43.716774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:43.716775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.716776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:43.716776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:43.716890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:43.773459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255552704226501:9460]
2025-10-01T14:10:43.773674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1180, pipe: [1:7556255552704226501:9460]
2025-10-01T14:10:43.850719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:43.851292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:43.851338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704226501:9460], now have 1 active actors on pipe
2025-10-01T14:10:43.851403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:43.851436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:43.851470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255552704226501:9460]
2025-10-01T14:10:43.851511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:43.851518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:43.851578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1181 reason: error at write: Disconnected sessionId: src_id|c93539d9-bb5ce55-b025296-201911df_0
2025-10-01T14:10:43.851726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1181 sessionId: src_id|c93539d9-bb5ce55-b025296-201911df_0 is DEAD
2025-10-01T14:10:43.851874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93539d9-bb5ce55-b025296-201911df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:43.851883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93539d9-bb5ce55-b025296-201911df_0] Write session will restart in 0.008906s
2025-10-01T14:10:43.851901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93539d9-bb5ce55-b025296-201911df_0] Write session: Do CDS request
2025-10-01T14:10:43.851908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93539d9-bb5ce55-b025296-201911df_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:43.861817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c93539d9-bb5ce55-b025296-201911df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.861897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:43.861909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1182
2025-10-01T14:10:43.862011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:43.862034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:43.862039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:43.862041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:43.862345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1182 sessionId:  describe result for acl check
2025-10-01T14:10:43.862385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:43.862391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:43.862393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:43.862398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255552704226672:9936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:43.862776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255552704226672:9936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:43.864727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255552704226672:9936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:43.869405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:43.869494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255552704226672:9936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:43.869504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255552704226672:9936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:43.869506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255552704226672:9936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:43.869511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:43.869740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:43.869853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:43.869860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:43.869867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:43.869893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:43.869920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255550327348375:8591]
2025-10-01T14:10:43.870274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:43.870464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:43.870492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:43.870686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:43.870721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.870725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.870726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.870726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.870727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.870727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.870728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.870729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.870729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.870730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.870730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.870731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.870732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.870732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.870735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.870740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.870742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.870744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.870746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.870749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.870751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.870752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.870754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.870757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.870759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.870761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.870763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.870765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.870771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.870775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:43.870779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.870782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:43.870784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.870787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:43.870789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.870792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:43.870794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.870797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:43.870799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.870802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:43.870805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.870808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:43.870811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.870814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:43.870816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.870819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:43.870821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.870823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.870826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.870828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.870830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.870833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.870835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.870838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:43.870840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.870842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:43.870862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:43.874120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:43.874644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:43.874657Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:43.874658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:43.874660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:43.874665Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1181 [2:7556255550327348375:8591]
2025-10-01T14:10:43.874674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:43.874686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:43.874688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.874690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.874691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.874702Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:43.874709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:43.874713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:43.874748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.874753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.874754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.874756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:43.874758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:43.874801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:43.874806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.874813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:43.874818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:43.874827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:43.874838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704226773:9936], now have 1 active actors on pipe
2025-10-01T14:10:43.874842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704226516:2446], now have 1 active actors on pipe
2025-10-01T14:10:43.874847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255550327348369:8591]
2025-10-01T14:10:43.874848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255550327348369:8591]
2025-10-01T14:10:43.874850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255550327348369:8591]
2025-10-01T14:10:43.874859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:43.874870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:43.874873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:43.874874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:43.874874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:43.874886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:43.874892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:43.874878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1181
2025-10-01T14:10:43.874910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1181
2025-10-01T14:10:43.874920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255550327348369:8591]
2025-10-01T14:10:43.874926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:43.874927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:43.874937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.874940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.874972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:43.874979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:43.874981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:43.874983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:43.874988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:43.874993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:43.875006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.875119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.875124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.875132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:43.875191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1182 partition: 0 MaxSeqNo: 45 sessionId: src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0
2025-10-01T14:10:43.875502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c93539d9-bb5ce55-b025296-201911df_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:43.877678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0] Write session: try to update token
2025-10-01T14:10:43.877689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:43.889654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1182 sessionId: src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:43.891730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:43.891877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:43.891896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:43.891925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:43.891988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:43.894064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:43.894082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:43.894083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:43.894084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:43.894091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255550327348369:8591]
2025-10-01T14:10:43.894094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255550327348369:8591]
2025-10-01T14:10:43.894096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255550327348369:8591]
2025-10-01T14:10:43.894128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:43.894131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:43.894133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:43.894135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:43.894135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:43.894137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:43.894245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:43.951632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255552704226785:9460]
2025-10-01T14:10:43.951812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1181, pipe: [1:7556255552704226785:9460]
2025-10-01T14:10:44.025736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:44.033508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.033531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.033667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.033720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.033777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.033829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.033869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.033875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.033931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.033981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.034033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.034087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.034125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.034130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.034179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.034229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.034275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.034324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.034362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.034367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.034437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.034484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.034536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.034584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.034623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.034628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.034678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.034726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.034777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.034830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.034867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.034872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.034924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.034972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.035025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.035078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.035117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.035125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.035176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.035226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.035276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.035328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.035371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.035376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.035427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.035476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.035523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.035571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.035609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.035615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.035675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.035733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.035789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.035843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.035879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.035885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.035937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.035988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.036040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.036092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.036128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.036133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.036168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255552704226785:9460], now have 1 active actors on pipe
2025-10-01T14:10:44.036372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:44.036376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255552704226785:9460]
2025-10-01T14:10:44.036405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:44.036406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:44.036428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1182 reason: error at write: Disconnected sessionId: src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0
2025-10-01T14:10:44.036590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1182 sessionId: src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0 is DEAD
2025-10-01T14:10:44.036801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:44.036811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0] Write session will restart in 0.009118s
2025-10-01T14:10:44.036834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0] Write session: Do CDS request
2025-10-01T14:10:44.036839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:44.037157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:44.046769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.046863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:44.046873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1183
2025-10-01T14:10:44.046971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.046992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:44.046996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:44.046999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:44.047405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1183 sessionId:  describe result for acl check
2025-10-01T14:10:44.047438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:44.047444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:44.047446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:44.047450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255556999194244:9940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:44.047884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255556999194244:9940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:44.049879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255556999194244:9940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:44.050416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:44.053344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:44.053498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:44.053508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:44.053518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:44.053568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:44.053582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255556999194244:9940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:44.053594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255556999194244:9940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:44.053605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255554622315933:8594]
2025-10-01T14:10:44.053597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255556999194244:9940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:44.053604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:44.053979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:44.054190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:44.054214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:44.054410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:44.054444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.054448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.054449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.054450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.054450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.054451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.054451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.054452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.054452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.054453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.054453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.054454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.054455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.054455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.054458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.054463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.054465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.054467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.054470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.054472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.054474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.054476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.054477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.054479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.054481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.054483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.054485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.054487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.054492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.054496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.054500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.054503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.054505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.054508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.054510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.054514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.054518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.054522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.054526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.054530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.054534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.054539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.054542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.054547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.054554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.054557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.054561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.054564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.054566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.054568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.054573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.054576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.054578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.054581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.054586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.054589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.054608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:44.057769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:44.058262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:44.058273Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:44.058274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:44.058277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:44.058282Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1182 [2:7556255554622315933:8594]
2025-10-01T14:10:44.058290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:44.058303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:44.058308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.058310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.058311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.058320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:44.058327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:44.058331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:44.058367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.058386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.058387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.058390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:44.058393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:44.058434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:44.058439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.058445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.058451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.058461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:44.058476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194341:9940], now have 1 active actors on pipe
2025-10-01T14:10:44.058482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194083:2446], now have 1 active actors on pipe
2025-10-01T14:10:44.058486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255554622315928:8594]
2025-10-01T14:10:44.058492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255554622315928:8594]
2025-10-01T14:10:44.058494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255554622315928:8594]
2025-10-01T14:10:44.058505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:44.058512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:44.058514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:44.058516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:44.058519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:44.058534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:44.058540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:44.058558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255554622315928:8594]
2025-10-01T14:10:44.058533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1182
2025-10-01T14:10:44.058564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:44.058533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1182
2025-10-01T14:10:44.058565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:44.058581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.058585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.058614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80b37228-300a9224-4919d8cf-e75b09ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:44.058622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.058625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.058626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:44.058631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.058637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:44.058648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.058750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.058755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.058765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.058817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1183 partition: 0 MaxSeqNo: 45 sessionId: src_id|80b37228-300a9224-4919d8cf-e75b09ab_0
2025-10-01T14:10:44.059094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d2fdfe0-a43d0c9f-cddeac33-5131468_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|80b37228-300a9224-4919d8cf-e75b09ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:44.061219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b37228-300a9224-4919d8cf-e75b09ab_0] Write session: try to update token
2025-10-01T14:10:44.061230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b37228-300a9224-4919d8cf-e75b09ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:44.073161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1183 sessionId: src_id|80b37228-300a9224-4919d8cf-e75b09ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:44.075228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:44.075459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.075480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.075515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:44.075571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:44.077643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:44.077657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:44.077659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:44.077660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:44.077667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255554622315928:8594]
2025-10-01T14:10:44.077670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255554622315928:8594]
2025-10-01T14:10:44.077673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255554622315928:8594]
2025-10-01T14:10:44.077708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:44.077717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.077716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:44.077718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:44.077721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:44.077724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:44.077825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:44.136473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255556999194353:9460]
2025-10-01T14:10:44.136877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1182, pipe: [1:7556255556999194353:9460]
2025-10-01T14:10:44.210796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:44.217785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.217809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.217946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.217998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.218050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.218105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.218144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.218154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.218213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.218262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.218313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.218384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.218423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.218429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.218479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.218524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.218574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.218620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.218657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.218661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.218709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.218759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.218810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.218858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.218897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.218902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.218950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.218999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.219046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.219094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.219130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.219134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.219182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.219228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.219279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.219334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.219376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.219384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.219441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.219487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.219535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.219587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.219623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.219628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.219677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.219726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.219775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.219829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.219874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.219879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.219933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.219980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.220030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.220080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.220116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.220121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.220171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.220222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.220273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.220323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.220360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.220365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.220404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194353:9460], now have 1 active actors on pipe
2025-10-01T14:10:44.220628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:44.220629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:44.220638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:44.220659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1183 reason: error at write: Disconnected sessionId: src_id|80b37228-300a9224-4919d8cf-e75b09ab_0
2025-10-01T14:10:44.220671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255556999194353:9460]
2025-10-01T14:10:44.220867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1183 sessionId: src_id|80b37228-300a9224-4919d8cf-e75b09ab_0 is DEAD
2025-10-01T14:10:44.220991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b37228-300a9224-4919d8cf-e75b09ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:44.221000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b37228-300a9224-4919d8cf-e75b09ab_0] Write session will restart in 0.006633s
2025-10-01T14:10:44.221018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b37228-300a9224-4919d8cf-e75b09ab_0] Write session: Do CDS request
2025-10-01T14:10:44.221023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b37228-300a9224-4919d8cf-e75b09ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:44.221150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:44.228826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80b37228-300a9224-4919d8cf-e75b09ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.228857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:44.228867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1184
2025-10-01T14:10:44.229016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.229039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:44.229046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:44.229049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:44.229412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1184 sessionId:  describe result for acl check
2025-10-01T14:10:44.229442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:44.229448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:44.229450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:44.229455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255556999194433:9944] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:44.229934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255556999194433:9944] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:44.232458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255556999194433:9944] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:44.234710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255556999194433:9944] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:44.234721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255556999194433:9944] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:44.234725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255556999194433:9944] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:44.234731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:44.235526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:44.238895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:44.239068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:44.239078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:44.239087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:44.239125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:44.239160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255554622316196:8596]
2025-10-01T14:10:44.239681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:44.239913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:44.239951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:44.240223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:44.240279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.240285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.240286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.240287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.240288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.240290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.240291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.240293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.240294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.240295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.240296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.240297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.240298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.240299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.240304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.240313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.240317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.240321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.240325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.240333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.240341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.240349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.240353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.240361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.240369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.240378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.240382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.240390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.240401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.240407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.240416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.240425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.240430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.240435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.240438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.240445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.240453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.240461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.240468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.240474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.240483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.240492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.240500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.240509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.240513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.240522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.240531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.240535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.240542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.240552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.240560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.240569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.240577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.240586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.240595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.240604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.240646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:44.244022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:44.244974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:44.244988Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:44.244990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:44.244993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:44.244999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1183 [2:7556255554622316196:8596]
2025-10-01T14:10:44.245012Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:44.245031Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:44.245039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.245042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.245044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.245058Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:44.245067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:44.245076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:44.245132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.245139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.245141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.245144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:44.245147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:44.245208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:44.245218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.245229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.245240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.245256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:44.245278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194355:2446], now have 1 active actors on pipe
2025-10-01T14:10:44.245285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194612:9944], now have 1 active actors on pipe
2025-10-01T14:10:44.245292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255554622316191:8596]
2025-10-01T14:10:44.245298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255554622316191:8596]
2025-10-01T14:10:44.245300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255554622316191:8596]
2025-10-01T14:10:44.245308Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:44.245287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1183
2025-10-01T14:10:44.245317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:44.245302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1183
2025-10-01T14:10:44.245325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:44.245326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:44.245327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:44.245339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:44.245341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:44.245361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.245370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.245396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255554622316191:8596]
2025-10-01T14:10:44.245407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:44.245419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:44.245422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb22eef1-49baff92-f834fef7-347d8026_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:44.245428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.245432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.245434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:44.245442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.245454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:44.245487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.245596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.245604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.245619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.245669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1184 partition: 0 MaxSeqNo: 45 sessionId: src_id|fb22eef1-49baff92-f834fef7-347d8026_0
2025-10-01T14:10:44.245996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80b37228-300a9224-4919d8cf-e75b09ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fb22eef1-49baff92-f834fef7-347d8026_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:44.248186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb22eef1-49baff92-f834fef7-347d8026_0] Write session: try to update token
2025-10-01T14:10:44.248198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb22eef1-49baff92-f834fef7-347d8026_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:44.259954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1184 sessionId: src_id|fb22eef1-49baff92-f834fef7-347d8026_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:44.262043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:44.262246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.262263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.262295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:44.262360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:44.264719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:44.264731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:44.264733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:44.264734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:44.264742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255554622316191:8596]
2025-10-01T14:10:44.264745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255554622316191:8596]
2025-10-01T14:10:44.264748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255554622316191:8596]
2025-10-01T14:10:44.264783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:44.264783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:44.264788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:44.264791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:44.264793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.264796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:44.264926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:44.320786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255556999194645:9460]
2025-10-01T14:10:44.321055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1183, pipe: [1:7556255556999194645:9460]
2025-10-01T14:10:44.397318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:44.403835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.403855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.403994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.404048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.404102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.404152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.404191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.404201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.404261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.404309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.404359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.404413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.404451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.404455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.404506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.404550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.404599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.404647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.404684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.404689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.404750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.404798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.404845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.404894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.404937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.404942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.404991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.405038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.405087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.405135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.405171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.405176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.405226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.405271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.405323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.405376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.405415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.405420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.405472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.405522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.405572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.405622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.405658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.405663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.405712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.405759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.405808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.405859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.405897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.405901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.405957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.406007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.406059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.406111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.406149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.406153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.406207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.406254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.406307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.406356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.406410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.406415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.406451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194645:9460], now have 1 active actors on pipe
2025-10-01T14:10:44.406656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:44.406678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:44.406681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:44.406695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255556999194645:9460]
2025-10-01T14:10:44.406703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1184 reason: error at write: Disconnected sessionId: src_id|fb22eef1-49baff92-f834fef7-347d8026_0
2025-10-01T14:10:44.406912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1184 sessionId: src_id|fb22eef1-49baff92-f834fef7-347d8026_0 is DEAD
2025-10-01T14:10:44.407065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb22eef1-49baff92-f834fef7-347d8026_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:44.407071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb22eef1-49baff92-f834fef7-347d8026_0] Write session will restart in 0.005782s
2025-10-01T14:10:44.407094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb22eef1-49baff92-f834fef7-347d8026_0] Write session: Do CDS request
2025-10-01T14:10:44.407099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb22eef1-49baff92-f834fef7-347d8026_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:44.407290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:44.413793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb22eef1-49baff92-f834fef7-347d8026_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.413858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:44.413865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1185
2025-10-01T14:10:44.413955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.413976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:44.413980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:44.413982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:44.414255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1185 sessionId:  describe result for acl check
2025-10-01T14:10:44.414275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:44.414278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:44.414279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:44.414282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255556999194732:9956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:44.414765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255556999194732:9956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:44.417089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255556999194732:9956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:44.419131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255556999194732:9956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:44.419141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255556999194732:9956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:44.419144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255556999194732:9956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:44.419151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:44.423101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:44.423479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:44.423597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:44.423604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:44.423611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:44.423639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:44.423667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255554622316466:8600]
2025-10-01T14:10:44.424046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:44.424222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:44.424248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:44.424445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:44.424478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.424482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.424482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.424483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.424484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.424484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.424485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.424486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.424486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.424487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.424488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.424488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.424489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.424490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.424492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.424498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.424500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.424502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.424504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.424506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.424509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.424511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.424513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.424515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.424517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.424519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.424521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.424523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.424527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.424531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.424535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.424538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.424541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.424543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.424545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.424548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.424550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.424553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.424555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.424558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.424560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.424563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.424565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.424568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.424570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.424572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.424575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.424577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.424579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.424582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.424585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.424588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.424590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.424593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.424595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.424597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.424616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:44.427905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:44.428753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:44.428762Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:44.428763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:44.428766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:44.428771Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1184 [2:7556255554622316466:8600]
2025-10-01T14:10:44.428780Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:44.428793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:44.428795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.428797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.428798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.428809Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:44.428815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:44.428819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:44.428859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.428866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.428868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.428870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:44.428873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:44.428928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:44.428935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.428944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.428958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.428976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:44.428997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194917:9956], now have 1 active actors on pipe
2025-10-01T14:10:44.429000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194659:2446], now have 1 active actors on pipe
2025-10-01T14:10:44.429007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255554622316461:8600]
2025-10-01T14:10:44.429008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255554622316461:8600]
2025-10-01T14:10:44.429010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255554622316461:8600]
2025-10-01T14:10:44.429022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:44.429032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:44.429037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:44.429038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:44.429040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:44.429049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:44.429051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:44.429037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1184
2025-10-01T14:10:44.429070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255554622316461:8600]
2025-10-01T14:10:44.429080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:44.429083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:44.429174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1184
2025-10-01T14:10:44.429210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.429217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.429232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8fff53ce-d31c7625-a1577f27-745835db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:44.429240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.429242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.429244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:44.429249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.429254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:44.429267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.429354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.429358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.429368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.429457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1185 partition: 0 MaxSeqNo: 45 sessionId: src_id|8fff53ce-d31c7625-a1577f27-745835db_0
2025-10-01T14:10:44.429760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb22eef1-49baff92-f834fef7-347d8026_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8fff53ce-d31c7625-a1577f27-745835db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:44.431875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fff53ce-d31c7625-a1577f27-745835db_0] Write session: try to update token
2025-10-01T14:10:44.431888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fff53ce-d31c7625-a1577f27-745835db_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:44.443648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1185 sessionId: src_id|8fff53ce-d31c7625-a1577f27-745835db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:44.445712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:44.445852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.445866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.445895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:44.445957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:44.447923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:44.447935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:44.447937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:44.447938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:44.447945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255554622316461:8600]
2025-10-01T14:10:44.447949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255554622316461:8600]
2025-10-01T14:10:44.447951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255554622316461:8600]
2025-10-01T14:10:44.447978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:44.447983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:44.447985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:44.447989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.447990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:44.447991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:44.448098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:44.506649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255556999194931:9460]
2025-10-01T14:10:44.507040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1184, pipe: [1:7556255556999194931:9460]
2025-10-01T14:10:44.578854Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:44.585481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.585500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.585632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.585684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.585736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.585791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.585831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.585838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.585893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.585944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.586006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.586060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.586098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.586103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.586154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.586202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.586251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.586298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.586332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.586337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.586401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.586451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.586504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.586551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.586586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.586591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.586641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.586688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.586736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.586786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.586824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.586829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.586878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.586924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.586977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.587035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.587080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.587086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.587136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.587183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.587232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.587282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.587318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.587323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.587374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.587421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.587472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.587530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.587567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.587572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.587624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.587673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.587723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.587773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.587814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.587819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.587871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.587921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.587972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.588030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.588069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.588074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.588108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194931:9460], now have 1 active actors on pipe
2025-10-01T14:10:44.588291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255556999194931:9460]
2025-10-01T14:10:44.588303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:44.588307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:44.588314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:44.588330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1185 reason: error at write: Disconnected sessionId: src_id|8fff53ce-d31c7625-a1577f27-745835db_0
2025-10-01T14:10:44.588497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1185 sessionId: src_id|8fff53ce-d31c7625-a1577f27-745835db_0 is DEAD
2025-10-01T14:10:44.588630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fff53ce-d31c7625-a1577f27-745835db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:44.588639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fff53ce-d31c7625-a1577f27-745835db_0] Write session will restart in 0.009346s
2025-10-01T14:10:44.588657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fff53ce-d31c7625-a1577f27-745835db_0] Write session: Do CDS request
2025-10-01T14:10:44.588662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fff53ce-d31c7625-a1577f27-745835db_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:44.588974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:44.598737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8fff53ce-d31c7625-a1577f27-745835db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.598873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:44.598884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1186
2025-10-01T14:10:44.599002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.599031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:44.599039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:44.599041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:44.599385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1186 sessionId:  describe result for acl check
2025-10-01T14:10:44.599413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:44.599417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:44.599419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:44.599423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255556999195119:9960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:44.599791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255556999195119:9960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:44.601513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255556999195119:9960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:44.604908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:44.605061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255556999195119:9960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:44.605070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255556999195119:9960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:44.605072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255556999195119:9960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:44.605078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:44.605188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:44.605323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:44.605330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:44.605337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:44.605364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:44.605389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255554622316761:8613]
2025-10-01T14:10:44.605756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:44.605973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:44.606000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:44.606247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:44.606287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.606291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.606292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.606292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.606293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.606294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.606294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.606295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.606295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.606296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.606296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.606297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.606298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.606298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.606301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.606307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.606309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.606311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.606313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.606315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.606317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.606319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.606321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.606323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.606325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.606327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.606329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.606331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.606335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.606340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.606343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.606346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.606349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.606352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.606355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.606357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.606360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.606367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.606385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.606394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.606399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.606404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.606411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.606415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.606420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.606429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.606433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.606438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.606445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.606450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.606454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.606463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.606466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.606471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.606477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.606479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.606500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:44.609797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:44.610296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:44.610307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:44.610308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:44.610310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:44.610315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1185 [2:7556255554622316761:8613]
2025-10-01T14:10:44.610325Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:44.610339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:44.610344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.610346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.610347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.610357Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:44.610364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:44.610382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:44.610420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.610425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.610426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.610428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:44.610430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:44.610477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:44.610483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.610493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.610505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.610523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:44.610541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999195194:9960], now have 1 active actors on pipe
2025-10-01T14:10:44.610546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999194933:2446], now have 1 active actors on pipe
2025-10-01T14:10:44.610551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255554622316755:8613]
2025-10-01T14:10:44.610552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255554622316755:8613]
2025-10-01T14:10:44.610553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255554622316755:8613]
2025-10-01T14:10:44.610565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:44.610560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1185
2025-10-01T14:10:44.610582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1185
2025-10-01T14:10:44.610575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:44.610578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:44.610579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:44.610582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:44.610594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:44.610596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:44.610610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.610614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.610642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255554622316755:8613]
2025-10-01T14:10:44.610651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:44.610659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:44.610663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:44.610667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.610669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.610671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:44.610676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.610682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:44.610705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.610805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.610811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.610823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.610880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1186 partition: 0 MaxSeqNo: 45 sessionId: src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0
2025-10-01T14:10:44.611203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8fff53ce-d31c7625-a1577f27-745835db_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:44.613558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0] Write session: try to update token
2025-10-01T14:10:44.613573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:44.625646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1186 sessionId: src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:44.627669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:44.628182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.628198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.629892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:44.629923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:44.629930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:44.629933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:44.629934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:44.629942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255554622316755:8613]
2025-10-01T14:10:44.629946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255554622316755:8613]
2025-10-01T14:10:44.629951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255554622316755:8613]
2025-10-01T14:10:44.629965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:44.629975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:44.629984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:44.629986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:44.629989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:44.629994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.629996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:44.630115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:44.688437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255556999195206:9460]
2025-10-01T14:10:44.688679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1185, pipe: [1:7556255556999195206:9460]
2025-10-01T14:10:44.764645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:44.771176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.771196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.771326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.771377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.771431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.771485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.771524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.771531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.771589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.771638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.771690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.771744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.771781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.771787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.771835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.771885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.771932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.771978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.772014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.772020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.772069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.772117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.772165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.772212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.772255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.772259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.772306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.772350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.772398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.772443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.772479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.772484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.772535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.772582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.772634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.772688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.772741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.772746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.772796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.772844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.772893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.772941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.772976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.772981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.773029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.773074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.773120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.773169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.773206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.773211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.773263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.773314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.773364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.773415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.773450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.773456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.773507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.773555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.773606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.773654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.773692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.773697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.773731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999195206:9460], now have 1 active actors on pipe
2025-10-01T14:10:44.773930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255556999195206:9460]
2025-10-01T14:10:44.773943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:44.773947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:44.773961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:44.773970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1186 reason: error at write: Disconnected sessionId: src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0
2025-10-01T14:10:44.774190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1186 sessionId: src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0 is DEAD
2025-10-01T14:10:44.774311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:44.774320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0] Write session will restart in 0.009639s
2025-10-01T14:10:44.774340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0] Write session: Do CDS request
2025-10-01T14:10:44.774346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:44.774600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:44.784878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.784932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:44.784944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1187
2025-10-01T14:10:44.785052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.785080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:44.785089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:44.785093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:44.785521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1187 sessionId:  describe result for acl check
2025-10-01T14:10:44.785551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:44.785557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:44.785559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:44.785562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255556999195381:9965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:44.785929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255556999195381:9965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:44.788345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255556999195381:9965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:44.791575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:44.791622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255556999195381:9965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:44.791632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255556999195381:9965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:44.791634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255556999195381:9965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:44.791647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:44.791901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:44.792047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:44.792059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:44.792068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:44.792108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:44.792141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255554622317038:8616]
2025-10-01T14:10:44.792681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:44.792910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:44.792951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:44.793228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:44.793276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.793282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.793283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.793283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.793284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.793285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.793286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.793287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.793289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.793289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.793290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.793291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.793292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.793293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.793297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.793305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.793309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.793312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.793315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.793318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.793320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.793324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.793327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.793330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.793333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.793336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.793339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.793342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.793348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.793354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.793364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.793372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.793381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.793389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.793397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.793401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.793405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.793413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.793420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.793424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.793428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.793436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.793443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.793449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.793456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.793460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.793467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.793471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.793478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.793483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.793490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.793499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.793506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.793510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.793517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.793521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.793559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:44.796830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:44.797391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:44.797404Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:44.797406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:44.797409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:44.797414Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1186 [2:7556255554622317038:8616]
2025-10-01T14:10:44.797431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:44.797447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:44.797454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.797457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.797459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.797474Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:44.797484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:44.797489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:44.797532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.797538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.797540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.797542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:44.797544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:44.797598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:44.797605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.797615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.797628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.797645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:44.797664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999195473:9965], now have 1 active actors on pipe
2025-10-01T14:10:44.797672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999195210:2446], now have 1 active actors on pipe
2025-10-01T14:10:44.797678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255554622317032:8616]
2025-10-01T14:10:44.797684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255554622317032:8616]
2025-10-01T14:10:44.797686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255554622317032:8616]
2025-10-01T14:10:44.797672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1186
2025-10-01T14:10:44.797680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1186
2025-10-01T14:10:44.797698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:44.797708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:44.797713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:44.797715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:44.797717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:44.797726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:44.797732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:44.797763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.797771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.797787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255554622317032:8616]
2025-10-01T14:10:44.797797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:44.797804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:44.797819Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:44.797829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.797837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.797839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:44.797849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.797861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:44.797882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.798001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.798009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.798023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.798087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1187 partition: 0 MaxSeqNo: 45 sessionId: src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0
2025-10-01T14:10:44.798332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bae8a40b-c655ecdf-89c64067-1c8e9b4f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:44.800515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0] Write session: try to update token
2025-10-01T14:10:44.800528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:44.812127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1187 sessionId: src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:44.814639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:44.814869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.814890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.814924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:44.815033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:44.817030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:44.817048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:44.817050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:44.817052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:44.817059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255554622317032:8616]
2025-10-01T14:10:44.817063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255554622317032:8616]
2025-10-01T14:10:44.817068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255554622317032:8616]
2025-10-01T14:10:44.817111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:44.817122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.817124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:44.817127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:44.817133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:44.817137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:44.817249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:44.874259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255556999195496:9460]
2025-10-01T14:10:44.874509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1186, pipe: [1:7556255556999195496:9460]
2025-10-01T14:10:44.947091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:44.953521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.953539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.953663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.953714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.953765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.953816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.953853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.953860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.953912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.953963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.954012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.954064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.954102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.954107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.954157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.954205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.954253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.954299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.954335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.954340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.954398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.954445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.954491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.954539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.954576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.954580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.954629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.954676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.954722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.954769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.954806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.954812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.954861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.954907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.954958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.955008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.955045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.955050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.955097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.955142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.955188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.955237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.955320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.955325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.955373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.955418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.955464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.955514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.955549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.955554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.955604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.955653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.955703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.955751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.955785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.955790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.955839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:44.955886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:44.955935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:44.955984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:44.956019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:44.956024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:44.956056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999195496:9460], now have 1 active actors on pipe
2025-10-01T14:10:44.956224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:44.956234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:44.956234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:44.956255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1187 reason: error at write: Disconnected sessionId: src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0
2025-10-01T14:10:44.956273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255556999195496:9460]
2025-10-01T14:10:44.956422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1187 sessionId: src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0 is DEAD
2025-10-01T14:10:44.956524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:44.956532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0] Write session will restart in 0.009033s
2025-10-01T14:10:44.956551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0] Write session: Do CDS request
2025-10-01T14:10:44.956555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:44.956627Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:44.966768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.966880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:44.966890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1188
2025-10-01T14:10:44.967026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:44.967060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:44.967069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:44.967073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:44.967389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1188 sessionId:  describe result for acl check
2025-10-01T14:10:44.967415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:44.967420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:44.967421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:44.967424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255556999195717:9970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:44.967783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255556999195717:9970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:44.969545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255556999195717:9970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:44.972175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:44.972251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255556999195717:9970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:44.972265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255556999195717:9970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:44.972267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255556999195717:9970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:44.972274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:44.972496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:44.972608Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:44.972617Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:44.972624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:44.972652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:44.972675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255554622317307:8619]
2025-10-01T14:10:44.973052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:44.973251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:44.973276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:44.973452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:44.973482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.973486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.973487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.973487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.973488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.973489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.973489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.973490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.973490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.973491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.973492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.973492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.973493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.973493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.973496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.973502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.973504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.973506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.973508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.973510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.973512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.973514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.973516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.973518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.973520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.973522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.973524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.973526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.973531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.973535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:44.973538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.973542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:44.973545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.973548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:44.973550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.973553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:44.973555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.973558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:44.973560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.973563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:44.973565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.973568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:44.973570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.973573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:44.973575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.973578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:44.973580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.973583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.973585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.973588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.973590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.973592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.973594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.973597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:44.973599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.973602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:44.973621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:44.976864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:44.977694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:44.977703Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:44.977704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:44.977707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:44.977712Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1187 [2:7556255554622317307:8619]
2025-10-01T14:10:44.977720Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:44.977731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:44.977732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.977734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.977736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.977745Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:44.977748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:44.977752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:44.977785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.977790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.977791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.977793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:44.977795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:44.977837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:44.977842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.977849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:44.977854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:44.977863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:44.977876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255554622317301:8619]
2025-10-01T14:10:44.977882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255554622317301:8619]
2025-10-01T14:10:44.977884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255554622317301:8619]
2025-10-01T14:10:44.977892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:44.977896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:44.977898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:44.977900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:44.977907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999195761:9970], now have 1 active actors on pipe
2025-10-01T14:10:44.977914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255556999195501:2446], now have 1 active actors on pipe
2025-10-01T14:10:44.977920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:44.977931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:44.977937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:44.977933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1187
2025-10-01T14:10:44.977953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255554622317301:8619]
2025-10-01T14:10:44.977959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:44.977953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1187
2025-10-01T14:10:44.977961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:44.977978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.977985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.978007Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:44.978015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:44.978018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:44.978019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:44.978024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:44.978033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:44.978048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.978177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.978183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.978193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:44.978265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1188 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0
2025-10-01T14:10:44.978614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7239d2-6872c921-fbe6f99-6705f8a2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:44.980648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0] Write session: try to update token
2025-10-01T14:10:44.980660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:44.992370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1188 sessionId: src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:44.994681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:44.996538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:44.996563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:44.996584Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:44.996592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:44.996595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:44.996597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:44.996605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255554622317301:8619]
2025-10-01T14:10:44.996614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255554622317301:8619]
2025-10-01T14:10:44.996618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255554622317301:8619]
2025-10-01T14:10:44.996659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:44.996667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:44.996671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:44.996672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:44.996678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:44.996681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:44.996811Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:45.056540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255561294163068:9460]
2025-10-01T14:10:45.056782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1187, pipe: [1:7556255561294163068:9460]
2025-10-01T14:10:45.128565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:45.129015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:45.129064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163068:9460], now have 1 active actors on pipe
2025-10-01T14:10:45.129130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:45.129226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255561294163068:9460]
2025-10-01T14:10:45.129248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:45.139603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:45.139615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:45.139638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1188 reason: error at write: Disconnected sessionId: src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0
2025-10-01T14:10:45.139813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1188 sessionId: src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0 is DEAD
2025-10-01T14:10:45.139907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:45.139917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0] Write session will restart in 0.005685s
2025-10-01T14:10:45.139935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0] Write session: Do CDS request
2025-10-01T14:10:45.139942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:45.145438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:45.146800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.147142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:45.147157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1189
2025-10-01T14:10:45.147256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.147289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:45.147300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:45.147304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:45.147666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1189 sessionId:  describe result for acl check
2025-10-01T14:10:45.147701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:45.147707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:45.147708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:45.147714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255561294163305:9974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:45.148180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255561294163305:9974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:45.148828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:45.148995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:45.149006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:45.149017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:45.149068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:45.149101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255558917284870:8621]
2025-10-01T14:10:45.149645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:45.149844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:45.149882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:45.149972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255561294163305:9974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:45.150169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:45.150226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.150231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.150232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.150233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.150234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.150235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.150236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.150237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.150238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.150239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.150240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.150242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.150243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.150244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.150249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.150258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.150262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.150265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.150268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.150272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.150275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.150279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.150283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.150289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.150293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.150301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.150305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.150313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.150319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.150331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.150341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.150348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.150352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.150361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.150365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.150390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.150404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.150413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.150418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.150422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.150431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.150440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.150447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.150452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.150460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.150469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.150476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.150481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.150490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.150495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.150502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.150507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.150516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.150523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.150531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.150539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.150577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:45.153497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255561294163305:9974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:45.153505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255561294163305:9974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:45.153508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255561294163305:9974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:45.153512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:45.153723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:45.154259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:45.154270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:45.154272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:45.154274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:45.154278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1188 [2:7556255558917284870:8621]
2025-10-01T14:10:45.154287Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:45.154299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:45.154304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.154306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.154308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.154317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:45.154320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:45.154324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:45.154361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.154366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.154367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.154383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:45.154384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:45.154426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:45.154431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.154438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.154444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.154455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:45.154469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163343:9974], now have 1 active actors on pipe
2025-10-01T14:10:45.154474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163075:2446], now have 1 active actors on pipe
2025-10-01T14:10:45.154479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255558917284865:8621]
2025-10-01T14:10:45.154481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255558917284865:8621]
2025-10-01T14:10:45.154482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255558917284865:8621]
2025-10-01T14:10:45.154490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:45.154491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1188
2025-10-01T14:10:45.154493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1188
2025-10-01T14:10:45.154501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:45.154503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:45.154507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:45.154508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:45.154510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:45.154511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:45.154524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255558917284865:8621]
2025-10-01T14:10:45.154529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:45.154531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:45.154540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.154545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.154575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50f623b1-64fe4ac3-98003966-28178b42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:45.154582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.154585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.154588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:45.154594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.154602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:45.154615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.154693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.154698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.154706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.154755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1189 partition: 0 MaxSeqNo: 45 sessionId: src_id|50f623b1-64fe4ac3-98003966-28178b42_0
2025-10-01T14:10:45.154999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ce6806c-477d8dc9-e5b4504e-7184a60a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50f623b1-64fe4ac3-98003966-28178b42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:45.157142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f623b1-64fe4ac3-98003966-28178b42_0] Write session: try to update token
2025-10-01T14:10:45.157155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f623b1-64fe4ac3-98003966-28178b42_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:45.168514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1189 sessionId: src_id|50f623b1-64fe4ac3-98003966-28178b42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:45.170571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:45.170740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.170766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.170800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:45.170868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:45.173170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:45.173186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:45.173188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:45.173191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:45.173199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255558917284865:8621]
2025-10-01T14:10:45.173203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255558917284865:8621]
2025-10-01T14:10:45.173207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255558917284865:8621]
2025-10-01T14:10:45.173245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:45.173247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:45.173253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.173256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:45.173257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:45.173260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:45.173375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:45.229602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255561294163353:9460]
2025-10-01T14:10:45.229797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1188, pipe: [1:7556255561294163353:9460]
2025-10-01T14:10:45.307974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:45.314169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.314189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.314314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.314363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.314432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.314485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.314522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.314529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.314583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.314630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.314682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.314735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.314774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.314779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.314829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.314876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.314924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.314971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.315007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.315011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.315058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.315106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.315152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.315198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.315233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.315238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.315284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.315330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.315387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.315438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.315474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.315479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.315526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.315571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.315622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.315673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.315710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.315715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.315765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.315813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.315861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.315909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.315945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.315950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.315997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.316042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.316091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.316140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.316176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.316181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.316231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.316277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.316326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.316374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.316409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.316413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.316462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.316509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.316562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.316612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.316646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.316651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.316685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163353:9460], now have 1 active actors on pipe
2025-10-01T14:10:45.316838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:45.316847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:45.316849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:45.316869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1189 reason: error at write: Disconnected sessionId: src_id|50f623b1-64fe4ac3-98003966-28178b42_0
2025-10-01T14:10:45.316887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255561294163353:9460]
2025-10-01T14:10:45.317025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1189 sessionId: src_id|50f623b1-64fe4ac3-98003966-28178b42_0 is DEAD
2025-10-01T14:10:45.317208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f623b1-64fe4ac3-98003966-28178b42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:45.317217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f623b1-64fe4ac3-98003966-28178b42_0] Write session will restart in 0.008989s
2025-10-01T14:10:45.317248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f623b1-64fe4ac3-98003966-28178b42_0] Write session: Do CDS request
2025-10-01T14:10:45.317253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f623b1-64fe4ac3-98003966-28178b42_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:45.317534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:45.326750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f623b1-64fe4ac3-98003966-28178b42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.326828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:45.326840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1190
2025-10-01T14:10:45.326934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.326959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:45.326967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:45.326970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:45.327455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1190 sessionId:  describe result for acl check
2025-10-01T14:10:45.327481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:45.327486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:45.327488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:45.327492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255561294163527:9979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:45.327950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255561294163527:9979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:45.330136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:45.330239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255561294163527:9979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:45.333272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:45.333395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:45.333401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:45.333409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:45.333436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:45.333462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255558917285138:8623]
2025-10-01T14:10:45.333498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255561294163527:9979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:45.333507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255561294163527:9979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:45.333509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255561294163527:9979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:45.333514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:45.333829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:45.333995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:45.334019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:45.334192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:45.334221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.334225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.334226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.334226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.334227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.334228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.334229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.334229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.334229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.334230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.334231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.334232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.334232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.334232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.334235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.334240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.334242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.334244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.334246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.334248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.334250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.334252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.334254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.334257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.334259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.334260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.334263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.334264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.334268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.334272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.334276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.334279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.334281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.334283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.334285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.334288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.334290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.334293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.334295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.334298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.334300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.334303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.334305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.334308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.334310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.334313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.334318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.334321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.334324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.334327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.334329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.334334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.334336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.334339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.334341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.334347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.334364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:45.337478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:45.338077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:45.338086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:45.338087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:45.338089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:45.338093Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1189 [2:7556255558917285138:8623]
2025-10-01T14:10:45.338102Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:45.338115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:45.338116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.338118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.338119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.338129Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:45.338135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:45.338139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:45.338168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.338173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.338174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.338176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:45.338177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:45.338223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:45.338229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.338235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.338241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.338249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:45.338261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163361:2446], now have 1 active actors on pipe
2025-10-01T14:10:45.338267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163625:9979], now have 1 active actors on pipe
2025-10-01T14:10:45.338272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255558917285133:8623]
2025-10-01T14:10:45.338273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255558917285133:8623]
2025-10-01T14:10:45.338274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255558917285133:8623]
2025-10-01T14:10:45.338282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:45.338295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:45.338295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:45.338297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:45.338299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:45.338305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:45.338307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:45.338320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255558917285133:8623]
2025-10-01T14:10:45.338325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:45.338337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:45.338319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1189
2025-10-01T14:10:45.338347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1189
2025-10-01T14:10:45.338382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.338391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.338409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63c21ce-aac46331-36468cc0-f6a45390_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:45.338417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.338420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.338423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:45.338429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.338438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:45.338449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.338596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.338600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.338609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.338665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1190 partition: 0 MaxSeqNo: 45 sessionId: src_id|63c21ce-aac46331-36468cc0-f6a45390_0
2025-10-01T14:10:45.338940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f623b1-64fe4ac3-98003966-28178b42_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|63c21ce-aac46331-36468cc0-f6a45390_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:45.341011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c21ce-aac46331-36468cc0-f6a45390_0] Write session: try to update token
2025-10-01T14:10:45.341023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c21ce-aac46331-36468cc0-f6a45390_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:45.352653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1190 sessionId: src_id|63c21ce-aac46331-36468cc0-f6a45390_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:45.354764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:45.355546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.355568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.357375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:45.357406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:45.357409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:45.357411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:45.357414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:45.357424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255558917285133:8623]
2025-10-01T14:10:45.357428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255558917285133:8623]
2025-10-01T14:10:45.357431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255558917285133:8623]
2025-10-01T14:10:45.357454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:45.357463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:45.357467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:45.357468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:45.357474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.357476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:45.357499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:45.357598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:45.416987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255561294163662:9460]
2025-10-01T14:10:45.417218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1189, pipe: [1:7556255561294163662:9460]
2025-10-01T14:10:45.488154Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:45.494619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.494638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.494771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.494824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.494884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.494935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.494973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.494980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.495036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.495087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.495146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.495201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.495372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.495378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.495429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.495475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.495522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.495570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.495606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.495611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.495661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.495712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.495760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.495808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.495843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.495849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.495899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.495948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.495996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.496042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.496078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.496084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.496133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.496182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.496233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.496283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.496320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.496325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.496375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.496421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.496473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.496522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.496559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.496563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.496612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.496664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.496722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.496770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.496806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.496810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.496864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.496913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.496963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.497013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.497049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.497054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.497106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.497153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.497204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.497254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.497290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.497294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.497329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163662:9460], now have 1 active actors on pipe
2025-10-01T14:10:45.497509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:45.497526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255561294163662:9460]
2025-10-01T14:10:45.497544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:45.497546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:45.497564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1190 reason: error at write: Disconnected sessionId: src_id|63c21ce-aac46331-36468cc0-f6a45390_0
2025-10-01T14:10:45.497730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1190 sessionId: src_id|63c21ce-aac46331-36468cc0-f6a45390_0 is DEAD
2025-10-01T14:10:45.497899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c21ce-aac46331-36468cc0-f6a45390_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:45.497908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c21ce-aac46331-36468cc0-f6a45390_0] Write session will restart in 0.008698s
2025-10-01T14:10:45.497927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c21ce-aac46331-36468cc0-f6a45390_0] Write session: Do CDS request
2025-10-01T14:10:45.497931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c21ce-aac46331-36468cc0-f6a45390_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:45.498224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:45.507888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63c21ce-aac46331-36468cc0-f6a45390_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.507964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:45.507975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1191
2025-10-01T14:10:45.508069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.508098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:45.508103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:45.508106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:45.508419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1191 sessionId:  describe result for acl check
2025-10-01T14:10:45.508451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:45.508457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:45.508459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:45.508463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255561294163842:9990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:45.508906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255561294163842:9990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:45.511099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255561294163842:9990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:45.511300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:45.514542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:45.514674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:45.514681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:45.514688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:45.514720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:45.514744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255558917285430:8628]
2025-10-01T14:10:45.514751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255561294163842:9990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:45.514759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255561294163842:9990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:45.514761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255561294163842:9990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:45.514767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:45.515089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:45.515260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:45.515283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:45.515455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:45.515489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.515493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.515493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.515494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.515494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.515495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.515495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.515496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.515496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.515497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.515497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.515498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.515498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.515499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.515502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.515507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.515509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.515511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.515513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.515515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.515517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.515518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.515521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.515523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.515525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.515527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.515529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.515531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.515534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.515539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.515542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.515545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.515548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.515551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.515553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.515555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.515557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.515560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.515562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.515565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.515567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.515569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.515575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.515577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.515579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.515582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.515587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.515590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.515592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.515594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.515598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.515600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.515602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.515608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.515610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.515613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.515631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:45.518833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:45.519384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:45.519395Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:45.519396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:45.519398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:45.519402Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1190 [2:7556255558917285430:8628]
2025-10-01T14:10:45.519410Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:45.519419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:45.519424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.519426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.519427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.519436Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:45.519439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:45.519442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:45.519473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.519478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.519479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.519482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:45.519483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:45.519525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:45.519531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.519537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.519543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.519551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:45.519562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163931:9990], now have 1 active actors on pipe
2025-10-01T14:10:45.519567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163665:2446], now have 1 active actors on pipe
2025-10-01T14:10:45.519572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255558917285425:8628]
2025-10-01T14:10:45.519577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255558917285425:8628]
2025-10-01T14:10:45.519578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255558917285425:8628]
2025-10-01T14:10:45.519586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:45.519594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:45.519598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:45.519600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:45.519601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:45.519605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:45.519607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:45.519595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1190
2025-10-01T14:10:45.519620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255558917285425:8628]
2025-10-01T14:10:45.519602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1190
2025-10-01T14:10:45.519624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:45.519626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:45.519639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.519644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.519671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:45.519678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.519680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.519682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:45.519686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.519694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:45.519707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.520076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.520081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.520090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.520155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1191 partition: 0 MaxSeqNo: 45 sessionId: src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0
2025-10-01T14:10:45.520457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63c21ce-aac46331-36468cc0-f6a45390_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:45.522555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0] Write session: try to update token
2025-10-01T14:10:45.522567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:45.534017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1191 sessionId: src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:45.536052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:45.536201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.536214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.536237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:45.536300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:45.538592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:45.538604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:45.538605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:45.538606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:45.538612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255558917285425:8628]
2025-10-01T14:10:45.538616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255558917285425:8628]
2025-10-01T14:10:45.538618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255558917285425:8628]
2025-10-01T14:10:45.538644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:45.538650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:45.538652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:45.538655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:45.538656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.538657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:45.538763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:45.597703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255561294163946:9460]
2025-10-01T14:10:45.597923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1190, pipe: [1:7556255561294163946:9460]
2025-10-01T14:10:45.668610Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:45.675267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.675288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.675417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.675469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.675520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.675572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.675611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.675619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.675676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.675725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.675779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.675834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.675873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.675879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.675928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.675974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.676024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.676072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.676110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.676114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.676162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.676212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.676260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.676309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.676346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.676350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.676397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.676444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.676488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.676536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.676575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.676579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.676629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.676676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.676739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.676794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.676831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.676835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.676887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.676933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.676982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.677031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.677072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.677077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.677127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.677173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.677221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.677272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.677308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.677313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.677364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.677415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.677464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.677513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.677548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.677552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.677605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.677655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.677706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.677756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.677793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.677798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.677833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163946:9460], now have 1 active actors on pipe
2025-10-01T14:10:45.677997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:45.678041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:45.678046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:45.678067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1191 reason: error at write: Disconnected sessionId: src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0
2025-10-01T14:10:45.678158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255561294163946:9460]
2025-10-01T14:10:45.678241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1191 sessionId: src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0 is DEAD
2025-10-01T14:10:45.678407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:45.678417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0] Write session will restart in 0.007003s
2025-10-01T14:10:45.678440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0] Write session: Do CDS request
2025-10-01T14:10:45.678447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:45.678918Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:45.686771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.686895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:45.686904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1192
2025-10-01T14:10:45.686986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.687008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:45.687014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:45.687016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:45.687294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1192 sessionId:  describe result for acl check
2025-10-01T14:10:45.687320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:45.687325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:45.687326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:45.687329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255561294164071:9994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:45.687681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255561294164071:9994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:45.689760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255561294164071:9994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:45.694043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:45.694105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255561294164071:9994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:45.694115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255561294164071:9994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:45.694118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255561294164071:9994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:45.694123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:45.694317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:45.694430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:45.694437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:45.694444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:45.694469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:45.694492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255558917285734:8642]
2025-10-01T14:10:45.694850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:45.695046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:45.695070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:45.695246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:45.695274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.695278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.695279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.695279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.695280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.695281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.695281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.695282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.695282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.695283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.695283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.695284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.695285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.695285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.695288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.695293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.695295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.695297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.695299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.695301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.695303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.695305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.695307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.695309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.695311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.695313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.695315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.695317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.695321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.695326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.695329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.695332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.695334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.695337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.695339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.695342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.695347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.695350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.695352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.695355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.695360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.695363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.695365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.695368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.695370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.695372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.695375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.695377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.695382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.695385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.695387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.695389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.695394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.695397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.695399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.695402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.695423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:45.698552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:45.699296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:45.699307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:45.699309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:45.699311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:45.699316Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1191 [2:7556255558917285734:8642]
2025-10-01T14:10:45.699325Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:45.699339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:45.699344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.699346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.699348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.699357Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:45.699363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:45.699367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:45.699398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.699402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.699403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.699405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:45.699407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:45.699450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:45.699459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.699465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.699470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.699478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:45.699489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294164217:9994], now have 1 active actors on pipe
2025-10-01T14:10:45.699496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294163950:2446], now have 1 active actors on pipe
2025-10-01T14:10:45.699500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255558917285728:8642]
2025-10-01T14:10:45.699502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255558917285728:8642]
2025-10-01T14:10:45.699503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255558917285728:8642]
2025-10-01T14:10:45.699512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:45.699520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:45.699523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:45.699526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:45.699527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:45.699531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:45.699532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:45.699547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255558917285728:8642]
2025-10-01T14:10:45.699549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:45.699550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:45.699565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1191
2025-10-01T14:10:45.699567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1191
2025-10-01T14:10:45.699578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.699586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.699604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:45.699612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.699614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.699615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:45.699620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.699629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:45.699641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.699784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.699789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.699798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.699875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1192 partition: 0 MaxSeqNo: 45 sessionId: src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0
2025-10-01T14:10:45.700181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b12d982-9b3136a2-fd84d29-60731a4f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:45.702251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0] Write session: try to update token
2025-10-01T14:10:45.702262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:45.713653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:45.713666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:45.713675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255558917285728:8642]
2025-10-01T14:10:45.713707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:45.713710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:45.713707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1192 sessionId: src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:45.713855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:45.713971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:45.714087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:45.714200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:45.714364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:45.714402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:45.715796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:45.715951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.715961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.715984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:45.716049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:45.727356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:45.727368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:45.727370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:45.727371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:45.727378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255558917285728:8642]
2025-10-01T14:10:45.727381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255558917285728:8642]
2025-10-01T14:10:45.727384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255558917285728:8642]
2025-10-01T14:10:45.727414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:45.727418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:45.727422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:45.727423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.727425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:45.727426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:45.727533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:45.778457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255561294164230:9460]
2025-10-01T14:10:45.778658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1191, pipe: [1:7556255561294164230:9460]
2025-10-01T14:10:45.855055Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:45.861823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.861840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.862000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.862057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.862114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.862176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.862219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.862227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.862285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.862338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.862408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.862465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.862512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.862517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.862569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.862616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.862672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.862727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.862808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.862813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.862863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.862915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.862964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.863020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.863056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.863061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.863113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.863162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.863215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.863280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.863317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.863322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.863376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.863424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.863478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.863539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.863576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.863581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.863636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.863686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.863740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.863789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.863826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.863831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.863882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.863929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.863980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.864038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.864077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.864081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.864132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.864180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.864230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.864286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.864328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.864333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.864382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:45.864432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:45.864484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:45.864540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:45.864576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:45.864581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:45.864615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294164230:9460], now have 1 active actors on pipe
2025-10-01T14:10:45.864828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:45.864837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255561294164230:9460]
2025-10-01T14:10:45.864837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:45.864852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:45.864859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1192 reason: error at write: Disconnected sessionId: src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0
2025-10-01T14:10:45.865033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1192 sessionId: src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0 is DEAD
2025-10-01T14:10:45.865183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:45.865197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0] Write session will restart in 0.006845s
2025-10-01T14:10:45.865223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0] Write session: Do CDS request
2025-10-01T14:10:45.865229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:45.865575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:45.872855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.872897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:45.872906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1193
2025-10-01T14:10:45.873025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:45.873046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:45.873052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:45.873054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:45.873359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1193 sessionId:  describe result for acl check
2025-10-01T14:10:45.873384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:45.873389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:45.873390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:45.873394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255561294164314:10000] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:45.873826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255561294164314:10000] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:45.875795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255561294164314:10000] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:45.877955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255561294164314:10000] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:45.877966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255561294164314:10000] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:45.877969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255561294164314:10000] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:45.877975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:45.883492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:45.883848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:45.883958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:45.883966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:45.883975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:45.884011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:45.884037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255558917286007:8645]
2025-10-01T14:10:45.884408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:45.884605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:45.884629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:45.884819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:45.884851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.884855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.884856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.884856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.884857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.884858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.884858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.884859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.884859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.884860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.884861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.884861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.884862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.884862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.884865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.884871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.884874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.884876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.884878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.884880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.884882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.884884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.884886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.884889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.884891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.884893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.884894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.884896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.884901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.884905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:45.884908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.884911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:45.884913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.884916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:45.884918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.884921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:45.884923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.884926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:45.884928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.884931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:45.884933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.884940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:45.884942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.884945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:45.884947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.884954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:45.884956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.884960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.884962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.884965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.884967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.884972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.884975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.884978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:45.884980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.884983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:45.885017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:45.888341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:45.888862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:45.888872Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:45.888873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:45.888876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:45.888880Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1192 [2:7556255558917286007:8645]
2025-10-01T14:10:45.888889Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:45.888902Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:45.888907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.888910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.888911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.888921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:45.888927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:45.888931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:45.888965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.888970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.888971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.888973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:45.888975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:45.889018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:45.889023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.889029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:45.889041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:45.889058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:45.889077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255558917286002:8645]
2025-10-01T14:10:45.889086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255558917286002:8645]
2025-10-01T14:10:45.889088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255558917286002:8645]
2025-10-01T14:10:45.889094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:45.889103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:45.889105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:45.889105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:45.889107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:45.889113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:45.889115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:45.889122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294164245:2446], now have 1 active actors on pipe
2025-10-01T14:10:45.889125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294164483:10000], now have 1 active actors on pipe
2025-10-01T14:10:45.889140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255558917286002:8645]
2025-10-01T14:10:45.889148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:45.889158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1192
2025-10-01T14:10:45.889165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1192
2025-10-01T14:10:45.889156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:45.889205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.889212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.889228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:45.889235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:45.889238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:45.889239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:45.889245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:45.889250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:45.889263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.889383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.889388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.889397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:45.889464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1193 partition: 0 MaxSeqNo: 45 sessionId: src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0
2025-10-01T14:10:45.889739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ae21db3-ffc59763-f1fd8009-7a00b1c8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:45.891852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0] Write session: try to update token
2025-10-01T14:10:45.891865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:45.898904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:45.898922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:45.898931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255558917286002:8645]
2025-10-01T14:10:45.898964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:45.898986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:45.899109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:45.899226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:45.899349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:45.899481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:45.899655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:45.899692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:45.903777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1193 sessionId: src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:45.905848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:45.906030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:45.906045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:45.906071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:45.906142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:45.916184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:45.916200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:45.916202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:45.916204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:45.916214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255558917286002:8645]
2025-10-01T14:10:45.916218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255558917286002:8645]
2025-10-01T14:10:45.916222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255558917286002:8645]
2025-10-01T14:10:45.916258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:45.916258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:45.916262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:45.916265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:45.916267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:45.916268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:45.916372Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:45.964839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255561294164525:9460]
2025-10-01T14:10:45.965017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1192, pipe: [1:7556255561294164525:9460]
2025-10-01T14:10:46.043686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:46.050641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.050661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.050799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.050852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.050909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.050960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.051001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.051008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.051063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.051113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.051165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.051218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.051256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.051261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.051317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.051389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.051446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.051498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.051536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.051541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.051592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.051639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.051690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.051738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.051774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.051779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.051834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.051884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.051937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.051990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.052027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.052032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.052084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.052134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.052185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.052234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.052269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.052274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.052326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.052380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.052437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.052485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.052524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.052531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.052582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.052641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.052694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.052751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.052786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.052792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.052847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.052902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.052953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.053004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.053041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.053046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.053091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.053134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.053184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.053231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.053267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.053271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.053305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255561294164525:9460], now have 1 active actors on pipe
2025-10-01T14:10:46.053512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:46.053517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:46.053522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:46.053544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1193 reason: error at write: Disconnected sessionId: src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0
2025-10-01T14:10:46.053551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255561294164525:9460]
2025-10-01T14:10:46.053697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1193 sessionId: src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0 is DEAD
2025-10-01T14:10:46.053815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:46.053827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0] Write session will restart in 0.006892s
2025-10-01T14:10:46.053862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0] Write session: Do CDS request
2025-10-01T14:10:46.053867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:46.054082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:46.061789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.061875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:46.061883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1194
2025-10-01T14:10:46.061964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.061986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:46.061992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:46.061994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:46.062278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1194 sessionId:  describe result for acl check
2025-10-01T14:10:46.062303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:46.062307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:46.062308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:46.062311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255565589131912:10004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:46.062682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255565589131912:10004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:46.065279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255565589131912:10004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:46.067593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255565589131912:10004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:46.067608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255565589131912:10004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:46.067610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255565589131912:10004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:46.067616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:46.070620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:46.070915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:46.071025Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:46.071032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:46.071040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:46.071065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:46.071090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255563212253575:8648]
2025-10-01T14:10:46.071454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:46.071657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:46.071680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:46.071870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:46.071908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.071912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.071913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.071913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.071914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.071914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.071915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.071915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.071916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.071917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.071917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.071918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.071918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.071919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.071922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.071927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.071929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.071931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.071933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.071934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.071936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.071938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.071940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.071941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.071943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.071945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.071946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.071948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.071953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.071958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.071962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.071965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.071967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.071969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.071975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.071978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.071980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.071982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.071987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.071990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.071992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.071995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.071997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.072000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.072004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.072007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.072009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.072012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.072016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.072019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.072021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.072023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.072026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.072029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.072030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.072033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.072051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:46.075295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:46.076021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:46.076032Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:46.076033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:46.076035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:46.076039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1193 [2:7556255563212253575:8648]
2025-10-01T14:10:46.076049Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:46.076064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:46.076069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.076071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.076072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.076083Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:46.076086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:46.076091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:46.076132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.076136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.076137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.076140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:46.076141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:46.076186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:46.076191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.076197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.076203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.076211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:46.076225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255563212253570:8648]
2025-10-01T14:10:46.076229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255563212253570:8648]
2025-10-01T14:10:46.076230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255563212253570:8648]
2025-10-01T14:10:46.076236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:46.076244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:46.076245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132090:10004], now have 1 active actors on pipe
2025-10-01T14:10:46.076247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589131823:2446], now have 1 active actors on pipe
2025-10-01T14:10:46.076252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:46.076252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:46.076256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:46.076259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:46.076261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:46.076277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255563212253570:8648]
2025-10-01T14:10:46.076285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:46.076296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:46.076319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1193
2025-10-01T14:10:46.076335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1193
2025-10-01T14:10:46.076379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.076389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.076408Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:46.076413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.076415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.076417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:46.076423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.076429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:46.076438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.076557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.076562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.076570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.076662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1194 partition: 0 MaxSeqNo: 45 sessionId: src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0
2025-10-01T14:10:46.076971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d80d102b-6dc279c3-1334187d-c58ddc52_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:46.079327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0] Write session: try to update token
2025-10-01T14:10:46.079342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:46.092243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1194 sessionId: src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:46.094289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:46.094401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.094416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.096035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:46.096059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:46.096065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:46.096066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:46.096068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:46.096074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255563212253570:8648]
2025-10-01T14:10:46.096078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255563212253570:8648]
2025-10-01T14:10:46.096080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255563212253570:8648]
2025-10-01T14:10:46.096110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:46.096118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.096119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:46.096120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:46.096126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:46.096129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:46.096145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:46.096231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:46.153769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255565589132104:9460]
2025-10-01T14:10:46.153967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1193, pipe: [1:7556255565589132104:9460]
2025-10-01T14:10:46.224365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:46.231065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.231083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.231219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.231272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.231325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.231377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.231421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.231429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.231485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.231542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.231599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.231659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.231699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.231709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.231758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.231803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.231855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.231904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.231940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.231946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.231998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.232052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.232104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.232158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.232194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.232199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.232249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.232299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.232346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.232395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.232432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.232437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.232508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.232559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.232617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.232679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.232724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.232729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.232780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.232827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.232876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.232926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.232962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.232967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.233016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.233068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.233124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.233182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.233220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.233225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.233277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.233326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.233378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.233432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.233470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.233475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.233525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.233578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.233631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.233687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.233725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.233730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.233761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132104:9460], now have 1 active actors on pipe
2025-10-01T14:10:46.233992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:46.234001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:46.234023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1194 reason: error at write: Disconnected sessionId: src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0
2025-10-01T14:10:46.234184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255565589132104:9460]
2025-10-01T14:10:46.234204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1194 sessionId: src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0 is DEAD
2025-10-01T14:10:46.234209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:46.234346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:46.234354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0] Write session will restart in 0.005761s
2025-10-01T14:10:46.234387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0] Write session: Do CDS request
2025-10-01T14:10:46.234393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:46.234602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:46.240768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.240854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:46.240865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1195
2025-10-01T14:10:46.240960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.240983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:46.240992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:46.240996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:46.241317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1195 sessionId:  describe result for acl check
2025-10-01T14:10:46.241351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:46.241356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:46.241357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:46.241360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255565589132134:10008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:46.241726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255565589132134:10008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:46.244296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255565589132134:10008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:46.247279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255565589132134:10008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:46.247292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255565589132134:10008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:46.247294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255565589132134:10008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:46.247301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:46.254190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:46.254533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:46.254684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:46.254694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:46.254705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:46.254753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:46.254787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255563212253849:8650]
2025-10-01T14:10:46.255305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:46.255555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:46.255590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:46.255851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:46.255893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.255898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.255899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.255900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.255900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.255901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.255903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.255903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.255904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.255905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.255906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.255907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.255907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.255908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.255912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.255920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.255924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.255927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.255930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.255932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.255935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.255938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.255941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.255944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.255947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.255949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.255952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.255955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.255961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.255968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.255977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.255983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.255990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.255994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.256001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.256005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.256013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.256018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.256024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.256028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.256035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.256039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.256044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.256048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.256055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.256059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.256067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.256070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.256079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.256087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.256094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.256098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.256104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.256108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.256115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.256119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.256152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:46.259301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:46.259855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:46.259868Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:46.259870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:46.259873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:46.259879Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1194 [2:7556255563212253849:8650]
2025-10-01T14:10:46.259897Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:46.259914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:46.259921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.259924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.259931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.259944Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:46.259954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:46.259963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:46.260004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.260011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.260013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.260016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:46.260018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:46.260075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:46.260082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.260094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.260109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.260125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:46.260146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132295:10008], now have 1 active actors on pipe
2025-10-01T14:10:46.260153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132106:2446], now have 1 active actors on pipe
2025-10-01T14:10:46.260160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255563212253844:8650]
2025-10-01T14:10:46.260167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255563212253844:8650]
2025-10-01T14:10:46.260169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255563212253844:8650]
2025-10-01T14:10:46.260181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:46.260166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1194
2025-10-01T14:10:46.260173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1194
2025-10-01T14:10:46.260191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:46.260192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:46.260198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:46.260200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:46.260206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:46.260208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:46.260241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.260250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.260262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255563212253844:8650]
2025-10-01T14:10:46.260273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:46.260283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:46.260300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:46.260310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.260318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.260320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:46.260331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.260342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:46.260364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.260518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.260527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.260540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.260618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1195 partition: 0 MaxSeqNo: 45 sessionId: src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0
2025-10-01T14:10:46.260985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1390e5f4-b7834a1c-4f1e3b3c-b0fb95fb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:46.263282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0] Write session: try to update token
2025-10-01T14:10:46.263297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:46.276451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1195 sessionId: src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:46.278544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:46.280251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.280277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.280298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:46.280306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:46.280308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:46.280310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:46.280318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255563212253844:8650]
2025-10-01T14:10:46.280326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255563212253844:8650]
2025-10-01T14:10:46.280333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255563212253844:8650]
2025-10-01T14:10:46.280374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:46.280383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:46.280387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:46.280394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:46.280401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.280409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:46.280529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:46.334517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255565589132395:9460]
2025-10-01T14:10:46.334732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1194, pipe: [1:7556255565589132395:9460]
2025-10-01T14:10:46.416976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:46.417540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:46.417588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132395:9460], now have 1 active actors on pipe
2025-10-01T14:10:46.417713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:46.417724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255565589132395:9460]
2025-10-01T14:10:46.417740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:46.417780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:46.417787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:46.417841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1195 reason: error at write: Disconnected sessionId: src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0
2025-10-01T14:10:46.418154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:46.418164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0] Write session will restart in 0.009487s
2025-10-01T14:10:46.418187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0] Write session: Do CDS request
2025-10-01T14:10:46.418192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:46.417999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1195 sessionId: src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0 is DEAD
2025-10-01T14:10:46.428829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.428968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:46.428979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1196
2025-10-01T14:10:46.429084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.429106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:46.429113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:46.429116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:46.429390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1196 sessionId:  describe result for acl check
2025-10-01T14:10:46.429418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:46.429424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:46.429426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:46.429430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255565589132649:10020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:46.429819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255565589132649:10020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:46.430952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:46.431092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255565589132649:10020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:46.434037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:46.434151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:46.434158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:46.434165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:46.434192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:46.434217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255563212254129:8654]
2025-10-01T14:10:46.434271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255565589132649:10020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:46.434280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255565589132649:10020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:46.434283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255565589132649:10020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:46.434288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:46.434650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:46.434827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:46.434852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:46.435027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:46.435058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.435062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.435063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.435063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.435064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.435065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.435065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.435066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.435066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.435067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.435067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.435068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.435068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.435069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.435071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.435077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.435079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.435081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.435083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.435085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.435087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.435089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.435091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.435093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.435095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.435097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.435099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.435101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.435105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.435109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.435113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.435115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.435118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.435121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.435123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.435126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.435130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.435133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.435135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.435138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.435140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.435143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.435147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.435149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.435152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.435156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.435158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.435161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.435164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.435167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.435169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.435175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.435178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.435181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.435184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.435187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.435205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:46.438258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:46.439090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:46.439101Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:46.439102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:46.439104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:46.439110Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1195 [2:7556255563212254129:8654]
2025-10-01T14:10:46.439119Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:46.439128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:46.439130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.439132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.439133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.439143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:46.439146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:46.439150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:46.439184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.439189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.439190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.439192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:46.439194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:46.439235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:46.439240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.439246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.439251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.439260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:46.439274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132424:2446], now have 1 active actors on pipe
2025-10-01T14:10:46.439279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132692:10020], now have 1 active actors on pipe
2025-10-01T14:10:46.439284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255563212254124:8654]
2025-10-01T14:10:46.439285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255563212254124:8654]
2025-10-01T14:10:46.439287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255563212254124:8654]
2025-10-01T14:10:46.439296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:46.439307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:46.439313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:46.439315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:46.439317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:46.439318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:46.439319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:46.439334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255563212254124:8654]
2025-10-01T14:10:46.439340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:46.439347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:46.439324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1195
2025-10-01T14:10:46.439332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1195
2025-10-01T14:10:46.439364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.439373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.439396Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:46.439404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.439407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.439408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:46.439413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.439418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:46.439438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.439604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.439610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.439619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.439680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1196 partition: 0 MaxSeqNo: 45 sessionId: src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0
2025-10-01T14:10:46.439964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e778d78a-35f88e56-b55c01b6-2f85e43f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:46.442309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0] Write session: try to update token
2025-10-01T14:10:46.442324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:46.455789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1196 sessionId: src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:46.457860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:46.458052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.458071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.459748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:46.459780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:46.459783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:46.459785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:46.459787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:46.459796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255563212254124:8654]
2025-10-01T14:10:46.459801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255563212254124:8654]
2025-10-01T14:10:46.459804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255563212254124:8654]
2025-10-01T14:10:46.459822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:46.459831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:46.459833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:46.459834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:46.459838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.459839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:46.459885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:46.459959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:46.517789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255565589132704:9460]
2025-10-01T14:10:46.518025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1195, pipe: [1:7556255565589132704:9460]
2025-10-01T14:10:46.594346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:46.600804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.600825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.600953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.601004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.601057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.601109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.601346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.601354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.601408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.601459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.601511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.601564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.601602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.601606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.601656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.601702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.601764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.601811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.601847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.601852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.601899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.601946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.601993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.602040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.602076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.602080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.602127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.602174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.602221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.602266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.602302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.602307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.602358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.602422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.602472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.602523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.602559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.602565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.602613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.602660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.602709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.602760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.602801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.602805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.602852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.602903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.602950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.603003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.603040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.603044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.603095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.603143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.603193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.603243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.603278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.603283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.603333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.603381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.603429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.603479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.603515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.603520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.603555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132704:9460], now have 1 active actors on pipe
2025-10-01T14:10:46.603831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:46.603841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:46.603844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:46.603866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1196 reason: error at write: Disconnected sessionId: src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0
2025-10-01T14:10:46.603871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255565589132704:9460]
2025-10-01T14:10:46.604058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1196 sessionId: src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0 is DEAD
2025-10-01T14:10:46.604198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:46.604207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0] Write session will restart in 0.006979s
2025-10-01T14:10:46.604224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0] Write session: Do CDS request
2025-10-01T14:10:46.604228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:46.604268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:46.611731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.611869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:46.611878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1197
2025-10-01T14:10:46.611973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.611994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:46.611997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:46.611999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:46.612287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1197 sessionId:  describe result for acl check
2025-10-01T14:10:46.612312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:46.612316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:46.612317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:46.612320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255565589132762:10024] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:46.612679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255565589132762:10024] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:46.614717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255565589132762:10024] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:46.617313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255565589132762:10024] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:46.617322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255565589132762:10024] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:46.617324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255565589132762:10024] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:46.617328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:46.619623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:46.622713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:46.622831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:46.622838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:46.622845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:46.622872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:46.622900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255563212254436:8667]
2025-10-01T14:10:46.623249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:46.623429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:46.623454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:46.623631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:46.623662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.623667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.623667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.623668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.623668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.623669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.623669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.623670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.623670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.623671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.623672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.623672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.623673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.623673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.623676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.623681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.623683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.623685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.623687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.623690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.623692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.623694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.623696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.623698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.623700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.623702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.623704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.623706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.623710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.623714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.623718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.623721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.623723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.623725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.623731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.623733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.623736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.623742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.623744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.623747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.623749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.623755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.623757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.623760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.623762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.623765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.623770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.623772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.623774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.623778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.623780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.623785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.623788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.623791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.623796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.623798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.623816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:46.626886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:46.627695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:46.627706Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:46.627707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:46.627709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:46.627713Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1196 [2:7556255563212254436:8667]
2025-10-01T14:10:46.627722Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:46.627733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:46.627738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.627740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.627741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.627751Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:46.627757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:46.627761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:46.627797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.627802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.627803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.627806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:46.627807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:46.627846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:46.627851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.627857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.627863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.627874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:46.627889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132709:2446], now have 1 active actors on pipe
2025-10-01T14:10:46.627895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132942:10024], now have 1 active actors on pipe
2025-10-01T14:10:46.627899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255563212254431:8667]
2025-10-01T14:10:46.627902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255563212254431:8667]
2025-10-01T14:10:46.627904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255563212254431:8667]
2025-10-01T14:10:46.627913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:46.627923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:46.627925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:46.627927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:46.627928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:46.627934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:46.627935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:46.627951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255563212254431:8667]
2025-10-01T14:10:46.627957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:46.627958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:46.627934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1196
2025-10-01T14:10:46.627971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.627979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.627943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1196
2025-10-01T14:10:46.628015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab13da40-55562c3b-ee6569d4-de785110_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:46.628023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.628025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.628029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:46.628035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.628040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:46.628053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.628133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.628139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.628148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.628199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1197 partition: 0 MaxSeqNo: 45 sessionId: src_id|ab13da40-55562c3b-ee6569d4-de785110_0
2025-10-01T14:10:46.628454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3449c20-3e61f679-7f1c1d01-e30cc97_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ab13da40-55562c3b-ee6569d4-de785110_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:46.630461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab13da40-55562c3b-ee6569d4-de785110_0] Write session: try to update token
2025-10-01T14:10:46.630471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab13da40-55562c3b-ee6569d4-de785110_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:46.641352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1197 sessionId: src_id|ab13da40-55562c3b-ee6569d4-de785110_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:46.643396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:46.643567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.643583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.643610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:46.643676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:46.646047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:46.646061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:46.646063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:46.646064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:46.646072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255563212254431:8667]
2025-10-01T14:10:46.646075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255563212254431:8667]
2025-10-01T14:10:46.646077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255563212254431:8667]
2025-10-01T14:10:46.646109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:46.646110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:46.646118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:46.646119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.646121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:46.646121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:46.646232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:46.704160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255565589132990:9460]
2025-10-01T14:10:46.704419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1196, pipe: [1:7556255565589132990:9460]
2025-10-01T14:10:46.774115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:46.780525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.780545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.780677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.780734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.780789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.780843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.780881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.780888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.780942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.780998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.781053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.781107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.781145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.781151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.781201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.781246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.781299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.781346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.781381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.781386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.781436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.781490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.781545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.781592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.781695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.781702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.781749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.781794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.781839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.781886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.781921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.781926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.781974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.782027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.782080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.782131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.782171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.782176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.782225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.782271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.782322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.782382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.782419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.782424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.782471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.782522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.782577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.782628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.782667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.782672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.782724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.782773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.782825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.782876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.782915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.782922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.782973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.783021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.783077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.783127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.783161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.783166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.783200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132990:9460], now have 1 active actors on pipe
2025-10-01T14:10:46.783417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255565589132990:9460]
2025-10-01T14:10:46.783447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:46.783452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:46.783472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1197 reason: error at write: Disconnected sessionId: src_id|ab13da40-55562c3b-ee6569d4-de785110_0
2025-10-01T14:10:46.783630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:46.783659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1197 sessionId: src_id|ab13da40-55562c3b-ee6569d4-de785110_0 is DEAD
2025-10-01T14:10:46.783778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab13da40-55562c3b-ee6569d4-de785110_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:46.783789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab13da40-55562c3b-ee6569d4-de785110_0] Write session will restart in 0.009300s
2025-10-01T14:10:46.783811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab13da40-55562c3b-ee6569d4-de785110_0] Write session: Do CDS request
2025-10-01T14:10:46.783817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab13da40-55562c3b-ee6569d4-de785110_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:46.784126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:46.793829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab13da40-55562c3b-ee6569d4-de785110_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.793905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:46.793915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1198
2025-10-01T14:10:46.794010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.794038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:46.794049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:46.794056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:46.794329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1198 sessionId:  describe result for acl check
2025-10-01T14:10:46.794355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:46.794359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:46.794360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:46.794364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255565589133148:10029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:46.794741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255565589133148:10029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:46.796484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255565589133148:10029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:46.800777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:46.800806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255565589133148:10029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:46.800814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255565589133148:10029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:46.800817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255565589133148:10029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:46.800821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:46.801081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:46.801187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:46.801195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:46.801202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:46.801229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:46.801254Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255563212254725:8670]
2025-10-01T14:10:46.801611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:46.801766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:46.801790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:46.801974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:46.802014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.802018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.802019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.802019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.802020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.802020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.802021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.802022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.802022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.802023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.802024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.802024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.802025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.802025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.802028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.802033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.802035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.802038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.802040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.802042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.802043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.802045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.802047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.802050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.802051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.802053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.802056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.802059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.802064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.802071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.802076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.802081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.802085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.802090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.802094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.802097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.802100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.802103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.802105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.802107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.802110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.802113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.802114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.802117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.802119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.802122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.802124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.802126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.802129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.802132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.802134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.802136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.802140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.802142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.802144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.802147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.802165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:46.805268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:46.805760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:46.805770Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:46.805771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:46.805773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:46.805778Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1197 [2:7556255563212254725:8670]
2025-10-01T14:10:46.805786Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:46.805797Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:46.805802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.805804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.805805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.805815Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:46.805821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:46.805825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:46.805854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.805859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.805860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.805868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:46.805870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:46.805908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:46.805913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.805919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.805924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.805934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:46.805948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589133267:10029], now have 1 active actors on pipe
2025-10-01T14:10:46.805953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589132995:2446], now have 1 active actors on pipe
2025-10-01T14:10:46.805958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255563212254719:8670]
2025-10-01T14:10:46.805960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255563212254719:8670]
2025-10-01T14:10:46.805961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255563212254719:8670]
2025-10-01T14:10:46.805970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:46.805980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:46.805983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:46.805985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:46.805987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:46.805991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:46.805993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:46.806006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255563212254719:8670]
2025-10-01T14:10:46.806010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:46.806009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1197
2025-10-01T14:10:46.806028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:46.806013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1197
2025-10-01T14:10:46.806047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.806054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.806073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:46.806083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.806092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.806094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:46.806101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.806108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:46.806122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.806237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.806244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.806254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.806314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1198 partition: 0 MaxSeqNo: 45 sessionId: src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0
2025-10-01T14:10:46.806629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab13da40-55562c3b-ee6569d4-de785110_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:46.808853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0] Write session: try to update token
2025-10-01T14:10:46.808867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:46.815631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:46.815647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:46.815656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255563212254719:8670]
2025-10-01T14:10:46.815694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:46.815712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:46.815867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:46.815995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:46.816126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:46.816244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:46.816397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:46.816426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:46.819946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1198 sessionId: src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:46.821890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:46.822042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.822055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.822078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:46.822138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:46.832941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:46.832953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:46.832954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:46.832955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:46.832962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255563212254719:8670]
2025-10-01T14:10:46.832964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255563212254719:8670]
2025-10-01T14:10:46.832968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255563212254719:8670]
2025-10-01T14:10:46.832996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:46.833001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.833002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:46.833002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:46.833006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:46.833008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:46.833109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:46.883367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255565589133291:9460]
2025-10-01T14:10:46.883535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1197, pipe: [1:7556255565589133291:9460]
2025-10-01T14:10:46.961457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:46.968236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.968256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.968395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.968447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.968501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.968554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.968592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.968599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.968654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.968716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.968769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.968829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.968870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.968875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.968927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.968974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.969026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.969080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.969118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.969125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.969178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.969227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.969278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.969334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.969374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.969380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.969429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.969480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.969530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.969581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.969618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.969623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.969677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.969727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.969781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.969838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.969881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.969886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.969938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.969987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.970042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.970094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.970131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.970136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.970191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.970242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.970292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.970344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.970396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.970401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.970453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.970500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.970552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.970603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.970639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.970644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.970695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:46.970742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:46.970792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:46.970838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:46.970880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:46.970887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:46.970924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589133291:9460], now have 1 active actors on pipe
2025-10-01T14:10:46.971155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255565589133291:9460]
2025-10-01T14:10:46.971156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:46.971159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:46.971182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1198 reason: error at write: Disconnected sessionId: src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0
2025-10-01T14:10:46.971189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:46.971342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1198 sessionId: src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0 is DEAD
2025-10-01T14:10:46.971503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:46.971514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0] Write session will restart in 0.006028s
2025-10-01T14:10:46.971536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0] Write session: Do CDS request
2025-10-01T14:10:46.971543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:46.971797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:46.978794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.978903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:46.978912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1199
2025-10-01T14:10:46.979008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:46.979030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:46.979035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:46.979038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:46.979328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1199 sessionId:  describe result for acl check
2025-10-01T14:10:46.979352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:46.979353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:46.979355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:46.979357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255565589133390:10034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:46.979694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255565589133390:10034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:46.981309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255565589133390:10034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:46.983574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255565589133390:10034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:46.983583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255565589133390:10034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:46.983585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255565589133390:10034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:46.983589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:46.984111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:46.987225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:46.987352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:46.987361Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:46.987371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:46.987405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:46.987433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255563212255005:8673]
2025-10-01T14:10:46.987785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:46.987964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:46.987988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:46.988177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:46.988209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.988213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.988214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.988215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.988215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.988216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.988216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.988217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.988217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.988218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.988219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.988219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.988220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.988220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.988223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.988228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.988230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.988233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.988234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.988237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.988238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.988240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.988242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.988245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.988246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.988248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.988250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.988252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.988258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.988262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:46.988266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.988268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:46.988271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.988273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:46.988276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.988279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:46.988281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.988284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:46.988286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.988289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:46.988291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.988294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:46.988297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.988299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:46.988302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.988304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:46.988307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.988309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.988311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.988314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.988316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.988321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.988324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.988326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:46.988328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.988332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:46.988354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:46.991516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:46.992032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:46.992044Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:46.992045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:46.992048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:46.992052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1198 [2:7556255563212255005:8673]
2025-10-01T14:10:46.992060Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:46.992071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:46.992073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.992075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.992076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.992086Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:46.992089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:46.992094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:46.992128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.992133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.992134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.992136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:46.992138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:46.992180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:46.992185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:46.992191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:46.992196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:46.992208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:46.992223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589133565:10034], now have 1 active actors on pipe
2025-10-01T14:10:46.992228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255565589133297:2446], now have 1 active actors on pipe
2025-10-01T14:10:46.992233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255563212255000:8673]
2025-10-01T14:10:46.992235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255563212255000:8673]
2025-10-01T14:10:46.992236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255563212255000:8673]
2025-10-01T14:10:46.992244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:46.992255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:46.992261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:46.992263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:46.992266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:46.992267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:46.992267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:46.992282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255563212255000:8673]
2025-10-01T14:10:46.992288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:46.992289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:46.992292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1198
2025-10-01T14:10:46.992297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1198
2025-10-01T14:10:46.992323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.992329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.992347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:46.992354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:46.992357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:46.992361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:46.992367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:46.992376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:46.992390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.992511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:46.992518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:46.992530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:46.992605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1199 partition: 0 MaxSeqNo: 45 sessionId: src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0
2025-10-01T14:10:46.992893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38f559-f6c7b9de-1cb9747c-6e0c36db_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:46.994982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0] Write session: try to update token
2025-10-01T14:10:46.994994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:47.001790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:47.001806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:47.001815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255563212255000:8673]
2025-10-01T14:10:47.001854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:47.001869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:47.002010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:47.002141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:47.002270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:47.002396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:47.002553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:47.002583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:47.005906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1199 sessionId: src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:47.007948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:47.008091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.008102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.008126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:47.008186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:47.019685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:47.019700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:47.019701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:47.019702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:47.019710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255563212255000:8673]
2025-10-01T14:10:47.019713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255563212255000:8673]
2025-10-01T14:10:47.019715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255563212255000:8673]
2025-10-01T14:10:47.019746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:47.019748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:47.019749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:47.019751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:47.019752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.019753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:47.019863Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:47.071293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255569884100878:9460]
2025-10-01T14:10:47.071574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1198, pipe: [1:7556255569884100878:9460]
2025-10-01T14:10:47.147615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:47.158901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.158929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.159123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.159176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.159227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.159281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.159589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.159597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.159652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.159704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.159756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.159811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.159847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.159852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.159904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.159951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.160003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.160058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.160097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.160102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.160154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.160201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.160250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.160300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.160341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.160349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.160400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.160447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.160500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.160552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.160599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.160604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.160658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.160716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.160766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.160818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.160857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.160862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.160916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.160966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.161021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.161070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.161105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.161110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.161159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.161207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.161257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.161306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.161342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.161351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.161405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.161453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.161501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.161552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.161590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.161594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.161643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.161688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.161736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.161787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.161824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.161829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.161877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884100878:9460], now have 1 active actors on pipe
2025-10-01T14:10:47.162104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:47.162113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255569884100878:9460]
2025-10-01T14:10:47.162114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:47.162138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1199 reason: error at write: Disconnected sessionId: src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0
2025-10-01T14:10:47.162138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:47.162298Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:47.162549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1199 sessionId: src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0 is DEAD
2025-10-01T14:10:47.162690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:47.162699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0] Write session will restart in 0.006463s
2025-10-01T14:10:47.162718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0] Write session: Do CDS request
2025-10-01T14:10:47.162723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:47.169836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.169879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:47.169886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1200
2025-10-01T14:10:47.170017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.170041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:47.170044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:47.170047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:47.170427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1200 sessionId:  describe result for acl check
2025-10-01T14:10:47.170453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:47.170455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:47.170456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:47.170460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255569884100958:10040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:47.170972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255569884100958:10040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:47.173179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255569884100958:10040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:47.175387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255569884100958:10040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:47.175396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255569884100958:10040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:47.175398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255569884100958:10040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:47.175402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:47.176844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:47.180389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:47.180525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:47.180532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:47.180540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:47.180570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:47.180597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255567507222579:8675]
2025-10-01T14:10:47.180971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:47.181229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:47.181254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:47.181442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:47.181475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.181479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.181479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.181480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.181481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.181482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.181482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.181483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.181484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.181484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.181485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.181485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.181486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.181486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.181489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.181495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.181498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.181500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.181502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.181504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.181506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.181508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.181510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.181512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.181514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.181516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.181518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.181520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.181524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.181528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.181534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.181537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.181539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.181542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.181544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.181547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.181550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.181552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.181555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.181557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.181560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.181562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.181564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.181567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.181573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.181575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.181577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.181580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.181582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.181585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.181587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.181589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.181592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.181596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.181599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.181601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.181622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:47.185041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:47.185536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:47.185546Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:47.185547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:47.185549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:47.185554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1199 [2:7556255567507222579:8675]
2025-10-01T14:10:47.185563Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:47.185574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:47.185580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.185582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.185583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.185593Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:47.185596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:47.185600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:47.185633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.185638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.185639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.185641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:47.185643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:47.185682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:47.185687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.185693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.185698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.185706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:47.185721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884101153:10040], now have 1 active actors on pipe
2025-10-01T14:10:47.185726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884100881:2446], now have 1 active actors on pipe
2025-10-01T14:10:47.185730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255567507222574:8675]
2025-10-01T14:10:47.185732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255567507222574:8675]
2025-10-01T14:10:47.185733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255567507222574:8675]
2025-10-01T14:10:47.185745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:47.185757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:47.185759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:47.185761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:47.185763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:47.185766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:47.185768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:47.185787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255567507222574:8675]
2025-10-01T14:10:47.185793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:47.185798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:47.185804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1199
2025-10-01T14:10:47.185807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1199
2025-10-01T14:10:47.185827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.185833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.185851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:47.185859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.185861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.185862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:47.185868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.185874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:47.185885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.185997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.186001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.186010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.186083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1200 partition: 0 MaxSeqNo: 45 sessionId: src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0
2025-10-01T14:10:47.186389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b92377-11b6cff9-7710c2ef-fa4d14b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:47.189637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0] Write session: try to update token
2025-10-01T14:10:47.189648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:47.196288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:47.196303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:47.196311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255567507222574:8675]
2025-10-01T14:10:47.196342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:47.196483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:47.196558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:47.196599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:47.196729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:47.196846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:47.197017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:47.197047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:47.203122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1200 sessionId: src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:47.205144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:47.205303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.205320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.205347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:47.205413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:47.216190Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:47.216203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:47.216204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:47.216205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:47.216213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255567507222574:8675]
2025-10-01T14:10:47.216215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255567507222574:8675]
2025-10-01T14:10:47.216218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255567507222574:8675]
2025-10-01T14:10:47.216248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:47.216249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:47.216253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.216255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:47.216257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:47.216259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:47.216365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:47.262218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255569884101167:9460]
2025-10-01T14:10:47.262384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1199, pipe: [1:7556255569884101167:9460]
2025-10-01T14:10:47.345020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:47.352736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.352755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.352910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.352969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.353027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.353092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.353137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.353144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.353207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.353263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.353320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.353379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.353419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.353424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.353479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.353530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.353587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.353647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.353687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.353692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.353750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.353822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.353875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.353929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.353969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.353975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.354030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.354085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.354141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.354198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.354237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.354243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.354301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.354358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.354429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.354486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.354528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.354535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.354593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.354646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.354705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.354762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.354803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.354808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.354867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.354925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.354981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.355038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.355078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.355083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.355136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.355188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.355241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.355296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.355334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.355339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.355394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.355446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.355500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.355555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.355593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.355599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.355638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884101167:9460], now have 1 active actors on pipe
2025-10-01T14:10:47.355851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255569884101167:9460]
2025-10-01T14:10:47.355875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:47.355879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:47.355899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:47.355905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1200 reason: error at write: Disconnected sessionId: src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0
2025-10-01T14:10:47.356122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1200 sessionId: src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0 is DEAD
2025-10-01T14:10:47.356283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:47.356294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0] Write session will restart in 0.007001s
2025-10-01T14:10:47.356318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0] Write session: Do CDS request
2025-10-01T14:10:47.356324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:47.356811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:47.364845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.364933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:47.364944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1201
2025-10-01T14:10:47.365014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.365036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:47.365044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:47.365046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:47.365375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1201 sessionId:  describe result for acl check
2025-10-01T14:10:47.365396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:47.365398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:47.365399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:47.365402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255569884101223:10045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:47.365766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255569884101223:10045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:47.368134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255569884101223:10045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:47.371090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255569884101223:10045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:47.371103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255569884101223:10045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:47.371107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255569884101223:10045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:47.371113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:47.375997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:47.379598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:47.379738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:47.379746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:47.379753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:47.379783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:47.379804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255567507222858:8677]
2025-10-01T14:10:47.380181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:47.380573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:47.380599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:47.380796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:47.380831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.380837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.380838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.380839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.380841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.380841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.380842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.380843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.380844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.380845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.380846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.380847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.380849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.380850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.380855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.380864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.380868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.380871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.380875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.380879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.380883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.380891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.380895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.380901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.380904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.380909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.380912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.380915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.380921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.380932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.380939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.380943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.380948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.380953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.380960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.380965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.380969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.380975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.380979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.380985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.380988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.380995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.380998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.381005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.381009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.381017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.381021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.381026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.381031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.381039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.381043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.381052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.381054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.381058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.381060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.381062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.381083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:47.384449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:47.385207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:47.385219Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:47.385221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:47.385224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:47.385229Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1200 [2:7556255567507222858:8677]
2025-10-01T14:10:47.385240Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:47.385255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:47.385261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.385264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.385266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.385280Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:47.385289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:47.385294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:47.385331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.385336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.385337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.385339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:47.385340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:47.385379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:47.385383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.385390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.385398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.385410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:47.385427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884101177:2446], now have 1 active actors on pipe
2025-10-01T14:10:47.385434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884101368:10045], now have 1 active actors on pipe
2025-10-01T14:10:47.385440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255567507222853:8677]
2025-10-01T14:10:47.385445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255567507222853:8677]
2025-10-01T14:10:47.385447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255567507222853:8677]
2025-10-01T14:10:47.385458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:47.385449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1200
2025-10-01T14:10:47.385471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:47.385473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:47.385462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1200
2025-10-01T14:10:47.385478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:47.385480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:47.385485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:47.385487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:47.385514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.385522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.385532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255567507222853:8677]
2025-10-01T14:10:47.385542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:47.385554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:47.385560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b02055ed-de940004-f2af218c-b8f63f39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:47.385566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.385574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.385576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:47.385583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.385594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:47.385616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.385744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.385750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.385761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.385820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1201 partition: 0 MaxSeqNo: 45 sessionId: src_id|b02055ed-de940004-f2af218c-b8f63f39_0
2025-10-01T14:10:47.386112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9826702-ebf76131-1c63d4c7-9e849ba5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b02055ed-de940004-f2af218c-b8f63f39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:47.388179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b02055ed-de940004-f2af218c-b8f63f39_0] Write session: try to update token
2025-10-01T14:10:47.388191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b02055ed-de940004-f2af218c-b8f63f39_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:47.399555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1201 sessionId: src_id|b02055ed-de940004-f2af218c-b8f63f39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:47.401551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:47.401742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.401758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.401782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:47.401843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:47.405238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:47.405256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:47.405259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:47.405261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:47.405270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255567507222853:8677]
2025-10-01T14:10:47.405277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255567507222853:8677]
2025-10-01T14:10:47.405281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255567507222853:8677]
2025-10-01T14:10:47.405314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:47.405324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:47.405326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:47.405327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:47.405335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.405338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:47.405514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:47.455748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255569884101490:9460]
2025-10-01T14:10:47.455914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1200, pipe: [1:7556255569884101490:9460]
2025-10-01T14:10:47.537465Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:47.547149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.547180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.547373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.547456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.547535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.547614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.547666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.547682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.547764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.547840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.547917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.547996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.548046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.548054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.548129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.548201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.548272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.548339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.548389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.548398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.548473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.548545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.548615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.548688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.548748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.548756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.548825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.548893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.548965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.549033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.549080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.549088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.549165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.549233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.549311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.549385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.549438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.549452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.549525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.549594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.549665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.549738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.549788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.549795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.549871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.549939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.550008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.550081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.550134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.550142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.550208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.550261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.550323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.550388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.550427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.550432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.550491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.550542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.550596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.550649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.550687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.550692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.550739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884101490:9460], now have 1 active actors on pipe
2025-10-01T14:10:47.551297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255569884101490:9460]
2025-10-01T14:10:47.551318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:47.551323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:47.551325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:47.551344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1201 reason: error at write: Disconnected sessionId: src_id|b02055ed-de940004-f2af218c-b8f63f39_0
2025-10-01T14:10:47.551348Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:10:47.551421Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 12 consumer shared/user session shared/user_1_12_4423556105642351710_v1 is DEAD
2025-10-01T14:10:47.551520Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255488279698033:9455] disconnected; active server actors: 1
2025-10-01T14:10:47.551526Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255488279698033:9455] client user disconnected session shared/user_1_12_4423556105642351710_v1
2025-10-01T14:10:47.551541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1201 sessionId: src_id|b02055ed-de940004-f2af218c-b8f63f39_0 is DEAD
2025-10-01T14:10:47.551627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02055ed-de940004-f2af218c-b8f63f39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:47.551637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02055ed-de940004-f2af218c-b8f63f39_0] Write session will restart in 0.008228s
2025-10-01T14:10:47.551659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02055ed-de940004-f2af218c-b8f63f39_0] Write session: Do CDS request
2025-10-01T14:10:47.551663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02055ed-de940004-f2af218c-b8f63f39_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:47.551888Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:47.552051Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:10:47.552147Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:10:47.552150Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:10:47.552154Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.009799s
2025-10-01T14:10:47.560671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b02055ed-de940004-f2af218c-b8f63f39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.560840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:47.560849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1202
2025-10-01T14:10:47.560932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.560958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:47.560966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:47.560969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:47.561283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1202 sessionId:  describe result for acl check
2025-10-01T14:10:47.561308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:47.561314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:47.561315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:47.561319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255569884101626:10056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:47.561787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255569884101626:10056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:47.562588Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:10:47.562683Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:10:47.562690Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 13
2025-10-01T14:10:47.562771Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 13 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:10:47.562808Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:10:47.562872Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 auth for : user
2025-10-01T14:10:47.562940Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 Handle describe topics response
2025-10-01T14:10:47.562957Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 auth is DEAD
2025-10-01T14:10:47.562965Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:10:47.563159Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:10:47.563201Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255569884101720:10060] connected; active server actors: 1
2025-10-01T14:10:47.563212Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255569884101720:10060] session shared/user_1_13_8860083045713042619_v1
2025-10-01T14:10:47.563219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:10:47.563233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:10:47.563242Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_13_8860083045713042619_v1
2025-10-01T14:10:47.563243Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_13_8860083045713042619_v1" (Sender=[1:7556255569884101693:10060], Pipe=[1:7556255569884101720:10060], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:10:47.563251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:10:47.563261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:10:47.563269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_13_8860083045713042619_v1" (Sender=[1:7556255569884101693:10060], Pipe=[1:7556255569884101720:10060], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:10:47.563283Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_13_8860083045713042619_v1" sender [1:7556255569884101693:10060] lock partition 0 for ReadingSession "shared/user_1_13_8860083045713042619_v1" (Sender=[1:7556255569884101693:10060], Pipe=[1:7556255569884101720:10060], Partitions=[], ActiveFamilyCount=1) generation 1 step 13
2025-10-01T14:10:47.563294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:10:47.563298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000035s
2025-10-01T14:10:47.563450Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 13 Session: "shared/user_1_13_8860083045713042619_v1" ClientId: "user" PipeClient { RawX1: 7556255569884101720 RawX2: 4503603922347852 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:10:47.563496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:10:47.563554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255569884101626:10056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:47.568057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:47.568214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255569884101626:10056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:47.568225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255569884101626:10056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:47.568227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255569884101626:10056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:47.568230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:47.568338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:47.568446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:47.568454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:47.568461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:47.568491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:47.568515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255567507223148:8682]
2025-10-01T14:10:47.568866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:47.569040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:47.569063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:47.569235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:47.569265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.569269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.569269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.569270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.569271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.569271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.569272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.569272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.569273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.569273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.569274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.569274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.569275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.569275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.569278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.569283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.569285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.569287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.569289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.569291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.569293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.569295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.569297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.569299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.569301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.569303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.569305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.569307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.569311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.569315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.569319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.569321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.569323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.569326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.569328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.569331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.569333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.569335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.569337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.569340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.569342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.569345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.569351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.569353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.569356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.569359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.569361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.569363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.569366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.569369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.569374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.569376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.569379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.569381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.569386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.569389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.569407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:47.572740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:47.573374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:47.573383Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:47.573385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:47.573386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:47.573391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1201 [2:7556255567507223148:8682]
2025-10-01T14:10:47.573399Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:47.573408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:47.573412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.573415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.573416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.573426Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:47.573432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:47.573435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:47.573465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.573470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.573471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.573473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:47.573474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:47.573512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:47.573516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.573523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.573528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.573536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:47.573548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884101742:10063], now have 1 active actors on pipe
2025-10-01T14:10:47.573559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884101776:10056], now have 1 active actors on pipe
2025-10-01T14:10:47.573561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884101492:2446], now have 1 active actors on pipe
2025-10-01T14:10:47.573567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255567507223142:8682]
2025-10-01T14:10:47.573568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255567507223142:8682]
2025-10-01T14:10:47.573570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255567507223142:8682]
2025-10-01T14:10:47.573582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:47.573593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:47.573600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:47.573587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1201, pipe: [1:7556255569884101742:10063]
2025-10-01T14:10:47.573602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:47.573611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1201
2025-10-01T14:10:47.573604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:47.573609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:47.573615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1201
2025-10-01T14:10:47.573611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:47.573637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.573649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.573660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_13_8860083045713042619_v1 on pipe: [1:7556255569884101742:10063]
2025-10-01T14:10:47.573669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255567507223142:8682]
2025-10-01T14:10:47.573675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:47.573690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.573692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.573697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:47.573698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.573702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.573703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:47.573712Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_13_8860083045713042619_v1
2025-10-01T14:10:47.573713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.573737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:47.573744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:10:47.573747Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:10:47.573814Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_13_8860083045713042619_v1:1 with generation 1201
2025-10-01T14:10:47.577360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:10:47.577375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:10:47.577378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.577380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.577381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:47.577387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.577392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:47.577395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:10:47.577406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:10:47.577416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.577489Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327847572 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:10:47.577499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:10:47.577515Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 sending to client partition status
2025-10-01T14:10:47.577547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.577554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.577566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.577622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1202 partition: 0 MaxSeqNo: 45 sessionId: src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0
2025-10-01T14:10:47.577819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b02055ed-de940004-f2af218c-b8f63f39_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:47.579922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0] Write session: try to update token
2025-10-01T14:10:47.579934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:47.591145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1202 sessionId: src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:47.593088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:47.593426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.593443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.593459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:47.593461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:47.593462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:47.593464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:47.593469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255567507223142:8682]
2025-10-01T14:10:47.593472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255567507223142:8682]
2025-10-01T14:10:47.593474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255567507223142:8682]
2025-10-01T14:10:47.593500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:47.593508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:47.593510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:47.593514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:47.593520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.593521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:47.593629Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:47.719559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:47.720167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:47.720270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:47.720359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255569884101742:10063]
2025-10-01T14:10:47.720379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:47.720308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_13_8860083045713042619_v1
2025-10-01T14:10:47.720346Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_13_8860083045713042619_v1
2025-10-01T14:10:47.727870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:47.727882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:47.727898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1202 reason: error at write: Disconnected sessionId: src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0
2025-10-01T14:10:47.728035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1202 sessionId: src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0 is DEAD
2025-10-01T14:10:47.728179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:47.728190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0] Write session will restart in 0.005405s
2025-10-01T14:10:47.728216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0] Write session: Do CDS request
2025-10-01T14:10:47.728221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:47.734730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.734786Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:47.734799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1203
2025-10-01T14:10:47.734916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.734943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:47.734952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:47.734954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:47.735238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1203 sessionId:  describe result for acl check
2025-10-01T14:10:47.735256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:47.735261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:47.735262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:47.735264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255569884102021:10065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:47.735599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255569884102021:10065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:47.737335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255569884102021:10065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:47.739769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:47.739854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255569884102021:10065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:47.739863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255569884102021:10065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:47.739866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255569884102021:10065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:47.739870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:47.740036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:47.740148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:47.740156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:47.740165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:47.740194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:47.740217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255567507223472:8695]
2025-10-01T14:10:47.740574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:47.740740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:47.740764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:47.740940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:47.740970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.740974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.740974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.740975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.740975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.740976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.740976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.740977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.740977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.740978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.740978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.740979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.740980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.740980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.740983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.740988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.740990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.740992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.740994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.740996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.740998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.741000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.741002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.741004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.741006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.741008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.741010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.741012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.741016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.741020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.741024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.741027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.741029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.741032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.741034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.741037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.741039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.741041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.741044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.741047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.741049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.741052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.741054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.741056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.741060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.741064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.741068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.741072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.741076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.741083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.741087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.741096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.741104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.741109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.741113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.741119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.741139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:47.744321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:47.745140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:47.745151Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:47.745152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:47.745154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:47.745159Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1202 [2:7556255567507223472:8695]
2025-10-01T14:10:47.745166Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:47.745175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:47.745181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.745183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.745184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.745194Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:47.745200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:47.745204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:47.745238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.745242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.745243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.745245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:47.745247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:47.745285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:47.745290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.745300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.745313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.745333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:47.745347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884102070:10065], now have 1 active actors on pipe
2025-10-01T14:10:47.745354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884101789:2446], now have 1 active actors on pipe
2025-10-01T14:10:47.745360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255567507223466:8695]
2025-10-01T14:10:47.745366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255567507223466:8695]
2025-10-01T14:10:47.745368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255567507223466:8695]
2025-10-01T14:10:47.745377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:47.745364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1202
2025-10-01T14:10:47.745368Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1202
2025-10-01T14:10:47.745387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:47.745390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:47.745392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:47.745395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:47.745402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:47.745404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:47.745434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.745442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.745456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255567507223466:8695]
2025-10-01T14:10:47.745467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:47.745476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:47.745493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:47.745503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.745510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.745512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:47.745522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.745533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:47.745567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.745667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.745672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.745681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.745733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1203 partition: 0 MaxSeqNo: 45 sessionId: src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0
2025-10-01T14:10:47.745972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95617a2c-4575a842-fd9c2d33-e229aa00_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:47.747953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0] Write session: try to update token
2025-10-01T14:10:47.747967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:47.758852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1203 sessionId: src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:47.760667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:47.760820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.760836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.760873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:47.760933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:47.764674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:47.764689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:47.764691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:47.764692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:47.764699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255567507223466:8695]
2025-10-01T14:10:47.764702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255567507223466:8695]
2025-10-01T14:10:47.764714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255567507223466:8695]
2025-10-01T14:10:47.764749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:47.764753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:47.764757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.764757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:47.764759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:47.764760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:47.764868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:47.820299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255569884102082:10063]
2025-10-01T14:10:47.820475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1202, pipe: [1:7556255569884102082:10063]
2025-10-01T14:10:47.891847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:47.898347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.898383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.898530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.898602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.898665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.898723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.898761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.898768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.898826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.898879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.898934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.898994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.899033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.899038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.899093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.899144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.899197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.899250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.899287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.899292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.899345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.899396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.899449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.899501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.899538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.899543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.899595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.899645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.899696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.899745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.899781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.899786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.899838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.899887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.899942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.899996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.900040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.900046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.900096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.900146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.900197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.900249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.900288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.900292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.900343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.900396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.900448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.900501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.900541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.900545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.900598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.900650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.900714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.900770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.900807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.900812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.900864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:47.900915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:47.900972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:47.901025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:47.901061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:47.901066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:47.901120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884102082:10063], now have 1 active actors on pipe
2025-10-01T14:10:47.901298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255569884102082:10063]
2025-10-01T14:10:47.901323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:47.901357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:47.901365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:47.901385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1203 reason: error at write: Disconnected sessionId: src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0
2025-10-01T14:10:47.901552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1203 sessionId: src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0 is DEAD
2025-10-01T14:10:47.901670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:47.901675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0] Write session will restart in 0.009825s
2025-10-01T14:10:47.901693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0] Write session: Do CDS request
2025-10-01T14:10:47.901697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:47.902008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:47.912777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.912850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:47.912862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1204
2025-10-01T14:10:47.912945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:47.912966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:47.912973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:47.912976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:47.913277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1204 sessionId:  describe result for acl check
2025-10-01T14:10:47.913300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:47.913304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:47.913305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:47.913309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255569884102321:10070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:47.913652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255569884102321:10070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:47.914890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255569884102321:10070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:47.917990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:47.918292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:47.918417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:47.918424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:47.918431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:47.918423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255569884102321:10070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:47.918432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255569884102321:10070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:47.918435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255569884102321:10070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:47.918440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:47.918461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:47.918485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255567507223755:8698]
2025-10-01T14:10:47.918851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:47.919016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:47.919044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:47.919231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:47.919261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.919265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.919266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.919266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.919267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.919267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.919268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.919268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.919269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.919270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.919270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.919271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.919271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.919272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.919275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.919280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.919282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.919284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.919286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.919288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.919290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.919292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.919294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.919296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.919298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.919300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.919302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.919304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.919308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.919312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:47.919316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.919318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:47.919321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.919323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:47.919325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.919328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:47.919331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.919333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:47.919335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.919341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:47.919344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.919347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:47.919352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.919355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:47.919357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.919360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:47.919365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.919368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.919370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.919373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.919378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.919381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.919384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.919387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:47.919392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.919395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:47.919413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:47.922454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:47.923231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:47.923241Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:47.923243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:47.923245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:47.923250Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1203 [2:7556255567507223755:8698]
2025-10-01T14:10:47.923258Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:47.923267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:47.923273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.923275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.923276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.923290Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:47.923297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:47.923301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:47.923333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.923337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.923338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.923340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:47.923342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:47.923392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:47.923396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.923403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:47.923408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:47.923421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:47.923434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884102375:10070], now have 1 active actors on pipe
2025-10-01T14:10:47.923439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255569884102095:2446], now have 1 active actors on pipe
2025-10-01T14:10:47.923444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255567507223750:8698]
2025-10-01T14:10:47.923446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255567507223750:8698]
2025-10-01T14:10:47.923447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255567507223750:8698]
2025-10-01T14:10:47.923456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:47.923465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:47.923467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:47.923473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:47.923454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1203
2025-10-01T14:10:47.923474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:47.923463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1203
2025-10-01T14:10:47.923475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:47.923476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:47.923498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.923501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.923516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255567507223750:8698]
2025-10-01T14:10:47.923525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:47.923544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:47.923551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:47.923553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:47.923557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:47.923559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:47.923564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:47.923569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:47.923582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.923679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.923685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.923697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:47.923755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1204 partition: 0 MaxSeqNo: 45 sessionId: src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0
2025-10-01T14:10:47.923998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf541e8c-32473a40-a95c7c32-7a9ac92c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:47.926059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0] Write session: try to update token
2025-10-01T14:10:47.926072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:47.937569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1204 sessionId: src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:47.939423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:47.939565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:47.939582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:47.939610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:47.939669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:47.941609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:47.941623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:47.941625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:47.941626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:47.941633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255567507223750:8698]
2025-10-01T14:10:47.941636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255567507223750:8698]
2025-10-01T14:10:47.941640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255567507223750:8698]
2025-10-01T14:10:47.941669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:47.941674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:47.941678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:47.941680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:47.941682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:47.941682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:47.941798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:48.001551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255574179069683:10063]
2025-10-01T14:10:48.001765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1203, pipe: [1:7556255574179069683:10063]
2025-10-01T14:10:48.068649Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:48.074990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.075011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.075142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.075192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.075243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.075295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.075333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.075340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.075395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.075445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.075497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.075553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.075590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.075596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.075649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.075698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.075748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.075794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.075829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.075835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.075885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.075936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.075984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.076031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.076068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.076072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.076121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.076168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.076214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.076260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.076297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.076302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.076353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.076400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.076453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.076518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.076563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.076568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.076619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.076665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.076722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.076773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.076809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.076813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.076863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.076911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.076959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.077011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.077048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.077053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.077106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.077154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.077205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.077256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.077293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.077297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.077347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.077395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.077443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.077492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.077525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.077530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.077566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179069683:10063], now have 1 active actors on pipe
2025-10-01T14:10:48.077756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:48.077767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:48.077776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255574179069683:10063]
2025-10-01T14:10:48.077796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:48.077802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1204 reason: error at write: Disconnected sessionId: src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0
2025-10-01T14:10:48.077983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1204 sessionId: src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0 is DEAD
2025-10-01T14:10:48.078088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:48.078096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0] Write session will restart in 0.006231s
2025-10-01T14:10:48.078114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0] Write session: Do CDS request
2025-10-01T14:10:48.078119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:48.078406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:48.085732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.085817Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:48.085826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1205
2025-10-01T14:10:48.085922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.085949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:48.085958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:48.085965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:48.086240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1205 sessionId:  describe result for acl check
2025-10-01T14:10:48.086265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:48.086270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:48.086271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:48.086274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255574179069775:10074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:48.086631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255574179069775:10074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:48.088399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255574179069775:10074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:48.090992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255574179069775:10074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:48.091001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255574179069775:10074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:48.091004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255574179069775:10074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:48.091008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:48.095147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:48.095479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:48.095616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:48.095623Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:48.095631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:48.095661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:48.095688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255571802191336:8700]
2025-10-01T14:10:48.096039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:48.096233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:48.096260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:48.096442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:48.096471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.096476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.096476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.096477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.096477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.096478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.096479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.096479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.096480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.096480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.096481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.096481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.096482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.096483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.096485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.096491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.096493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.096495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.096497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.096499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.096501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.096503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.096505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.096507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.096509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.096511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.096513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.096515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.096520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.096524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.096528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.096531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.096533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.096536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.096538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.096542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.096544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.096551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.096553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.096556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.096561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.096564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.096566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.096568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.096574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.096577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.096582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.096584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.096587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.096589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.096591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.096594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.096599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.096602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.096604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.096609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.096628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:48.099690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:48.100422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:48.100432Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:48.100433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:48.100435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:48.100439Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1204 [2:7556255571802191336:8700]
2025-10-01T14:10:48.100447Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:48.100457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:48.100458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.100460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.100461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.100471Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:48.100478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:48.100482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:48.100512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.100517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.100518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.100520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:48.100522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:48.100569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:48.100575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.100584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.100597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.100614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:48.100632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179069684:2446], now have 1 active actors on pipe
2025-10-01T14:10:48.100637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179069962:10074], now have 1 active actors on pipe
2025-10-01T14:10:48.100642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255571802191331:8700]
2025-10-01T14:10:48.100646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255571802191331:8700]
2025-10-01T14:10:48.100648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255571802191331:8700]
2025-10-01T14:10:48.100658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:48.100660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1204
2025-10-01T14:10:48.100673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:48.100672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:48.100674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1204
2025-10-01T14:10:48.100674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:48.100676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:48.100689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:48.100691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:48.100728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.100735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.100745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255571802191331:8700]
2025-10-01T14:10:48.100753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:48.100765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:48.100779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:48.100789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.100795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.100797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:48.100805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.100816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:48.100836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.100919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.100926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.100939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.101010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1205 partition: 0 MaxSeqNo: 45 sessionId: src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0
2025-10-01T14:10:48.101299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a622cd7c-dfbb94ff-def65565-ad8ef73_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:48.103433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0] Write session: try to update token
2025-10-01T14:10:48.103446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:48.115150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1205 sessionId: src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:48.117261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:48.117422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.117442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.117470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:48.117546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:48.120483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:48.120499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:48.120500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:48.120502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:48.120509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255571802191331:8700]
2025-10-01T14:10:48.120513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255571802191331:8700]
2025-10-01T14:10:48.120515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255571802191331:8700]
2025-10-01T14:10:48.120548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:48.120552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:48.120559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:48.120560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.120562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:48.120562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:48.120670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:48.177694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255574179069977:10063]
2025-10-01T14:10:48.177893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1204, pipe: [1:7556255574179069977:10063]
2025-10-01T14:10:48.248331Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:48.254647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.254665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.254794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.254844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.254897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.254948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.254986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.254993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.255048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.255097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.255149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.255203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.255244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.255249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.255312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.255373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.255435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.255487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.255604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.255611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.255669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.255726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.255781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.255836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.255875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.255882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.255935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.255987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.256044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.256101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.256141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.256150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.256210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.256262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.256318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.256375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.256420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.256427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.256483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.256535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.256589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.256646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.256710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.256718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.256772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.256824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.256880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.256937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.256979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.256986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.257043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.257097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.257150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.257206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.257327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.257334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.257392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.257445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.257501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.257557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.257597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.257604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.257646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179069977:10063], now have 1 active actors on pipe
2025-10-01T14:10:48.257833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255574179069977:10063]
2025-10-01T14:10:48.257835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:48.257865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:48.257873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:48.257897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1205 reason: error at write: Disconnected sessionId: src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0
2025-10-01T14:10:48.258074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1205 sessionId: src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0 is DEAD
2025-10-01T14:10:48.258214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:48.258224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0] Write session will restart in 0.009050s
2025-10-01T14:10:48.258244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0] Write session: Do CDS request
2025-10-01T14:10:48.258249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:48.258689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:48.268779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.268868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:48.268878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1206
2025-10-01T14:10:48.268980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.269008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:48.269016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:48.269023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:48.269358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1206 sessionId:  describe result for acl check
2025-10-01T14:10:48.269393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:48.269397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:48.269398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:48.269402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255574179070173:10078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:48.269866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255574179070173:10078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:48.272605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255574179070173:10078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:48.275306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:48.275431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255574179070173:10078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:48.275441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255574179070173:10078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:48.275443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255574179070173:10078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:48.275447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:48.275607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:48.275732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:48.275740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:48.275748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:48.275777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:48.275802Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255571802191620:8702]
2025-10-01T14:10:48.276149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:48.276332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:48.276360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:48.276538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:48.276568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.276572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.276573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.276573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.276574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.276574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.276575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.276576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.276577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.276577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.276578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.276579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.276579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.276580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.276582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.276588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.276590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.276592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.276594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.276596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.276598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.276600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.276602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.276604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.276606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.276608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.276609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.276611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.276615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.276620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.276623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.276626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.276630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.276633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.276635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.276638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.276640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.276643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.276645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.276648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.276650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.276653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.276656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.276658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.276662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.276666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.276671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.276673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.276675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.276678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.276680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.276682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.276688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.276690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.276692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.276695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.276723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:48.279869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:48.280487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:48.280497Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:48.280498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:48.280501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:48.280505Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1205 [2:7556255571802191620:8702]
2025-10-01T14:10:48.280514Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:48.280523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:48.280528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.280530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.280531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.280541Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:48.280547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:48.280551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:48.280581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.280588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.280589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.280591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:48.280592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:48.280647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:48.280655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.280664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.280674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.280687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:48.280715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179069979:2446], now have 1 active actors on pipe
2025-10-01T14:10:48.280721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179070260:10078], now have 1 active actors on pipe
2025-10-01T14:10:48.280726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255571802191614:8702]
2025-10-01T14:10:48.280729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255571802191614:8702]
2025-10-01T14:10:48.280730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255571802191614:8702]
2025-10-01T14:10:48.280740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:48.280754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:48.280755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:48.280746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1205
2025-10-01T14:10:48.280760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:48.280762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:48.280748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1205
2025-10-01T14:10:48.280767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:48.280769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:48.280791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255571802191614:8702]
2025-10-01T14:10:48.280800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:48.280810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:48.280811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.280815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.280846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:48.280857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.280860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.280863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:48.280873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.280884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:48.280902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.281011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.281018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.281030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.281091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1206 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0
2025-10-01T14:10:48.281375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba2f82d-1efa574e-a889414a-cccf6a42_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:48.283545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0] Write session: try to update token
2025-10-01T14:10:48.283558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:48.294641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1206 sessionId: src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:48.296714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:48.296833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.296848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.296868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:48.296927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:48.298771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:48.298785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:48.298787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:48.298788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:48.298794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255571802191614:8702]
2025-10-01T14:10:48.298797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255571802191614:8702]
2025-10-01T14:10:48.298799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255571802191614:8702]
2025-10-01T14:10:48.298837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:48.298839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:48.298847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.298849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:48.298855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:48.298859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:48.298962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:48.357904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255574179070279:10063]
2025-10-01T14:10:48.358143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1205, pipe: [1:7556255574179070279:10063]
2025-10-01T14:10:48.423719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:48.430114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.430136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.430255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.430309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.430364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.430437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.430480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.430487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.430546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.430596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.430651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.430705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.430743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.430748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.430799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.430848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.430898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.430948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.430984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.430989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.431039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.431091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.431142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.431191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.431229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.431234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.431285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.431334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.431383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.431431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.431469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.431478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.431528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.431576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.431629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.431681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.431722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.431727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.431778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.431829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.431882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.431934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.431985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.431991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.432042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.432091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.432139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.432194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.432232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.432237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.432290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.432341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.432393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.432443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.432479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.432485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.432537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.432587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.432636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.432686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.432733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.432739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.432775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179070279:10063], now have 1 active actors on pipe
2025-10-01T14:10:48.433046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:48.433107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255574179070279:10063]
2025-10-01T14:10:48.433129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:48.433135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:48.433156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1206 reason: error at write: Disconnected sessionId: src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0
2025-10-01T14:10:48.433554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:48.433561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0] Write session will restart in 0.007322s
2025-10-01T14:10:48.433578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0] Write session: Do CDS request
2025-10-01T14:10:48.433583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:48.433659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1206 sessionId: src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0 is DEAD
2025-10-01T14:10:48.433810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:48.441747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.441897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:48.441908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1207
2025-10-01T14:10:48.442018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.442044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:48.442051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:48.442053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:48.442303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1207 sessionId:  describe result for acl check
2025-10-01T14:10:48.442323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:48.442325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:48.442326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:48.442328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255574179070411:10089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:48.442670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255574179070411:10089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:48.445005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255574179070411:10089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:48.446797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255574179070411:10089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:48.446805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255574179070411:10089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:48.446807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255574179070411:10089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:48.446811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:48.449956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:48.450289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:48.450437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:48.450446Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:48.450457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:48.450498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:48.450529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255571802191914:8704]
2025-10-01T14:10:48.451101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:48.451293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:48.451329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:48.451607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:48.451648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.451653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.451654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.451655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.451656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.451657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.451658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.451659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.451660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.451661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.451662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.451663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.451664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.451665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.451669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.451678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.451682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.451686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.451690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.451694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.451702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.451707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.451711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.451719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.451727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.451730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.451738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.451746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.451751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.451761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.451770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.451778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.451786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.451795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.451803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.451811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.451819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.451828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.451836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.451844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.451852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.451858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.451865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.451870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.451879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.451889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.451896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.451904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.451911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.451916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.451924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.451932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.451940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.451948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.451956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.451961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.452000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:48.455062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:48.455604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:48.455621Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:48.455623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:48.455626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:48.455631Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1206 [2:7556255571802191914:8704]
2025-10-01T14:10:48.455643Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:48.455659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:48.455666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.455669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.455671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.455682Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:48.455692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:48.455700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:48.455747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.455754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.455755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.455758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:48.455760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:48.455808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:48.455817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.455828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.455838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.455851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:48.455871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179070296:2446], now have 1 active actors on pipe
2025-10-01T14:10:48.455879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179070575:10089], now have 1 active actors on pipe
2025-10-01T14:10:48.455885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255571802191909:8704]
2025-10-01T14:10:48.455891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255571802191909:8704]
2025-10-01T14:10:48.455878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1206
2025-10-01T14:10:48.455893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255571802191909:8704]
2025-10-01T14:10:48.455901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:48.455908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:48.455911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:48.455912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:48.455890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1206
2025-10-01T14:10:48.455913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:48.455925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:48.455927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:48.455945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.455953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.455983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255571802191909:8704]
2025-10-01T14:10:48.455994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:48.456004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:48.456011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9050b215-c4d5bf61-17e8567d-323df11b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:48.456016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.456024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.456030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:48.456036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.456047Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:48.456077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.456192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.456202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.456216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.456290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1207 partition: 0 MaxSeqNo: 45 sessionId: src_id|9050b215-c4d5bf61-17e8567d-323df11b_0
2025-10-01T14:10:48.456575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d4784e2-35802f71-a4c33c5f-96aa9424_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9050b215-c4d5bf61-17e8567d-323df11b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:48.458788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9050b215-c4d5bf61-17e8567d-323df11b_0] Write session: try to update token
2025-10-01T14:10:48.458800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9050b215-c4d5bf61-17e8567d-323df11b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:48.470840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1207 sessionId: src_id|9050b215-c4d5bf61-17e8567d-323df11b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:48.472762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:48.473257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.473276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.473303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:48.473367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:48.475730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:48.475744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:48.475746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:48.475747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:48.475754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255571802191909:8704]
2025-10-01T14:10:48.475756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255571802191909:8704]
2025-10-01T14:10:48.475759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255571802191909:8704]
2025-10-01T14:10:48.475791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:48.475793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:48.475797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:48.475799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.475800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:48.475800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:48.475910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:48.533012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255574179070599:10063]
2025-10-01T14:10:48.533221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1206, pipe: [1:7556255574179070599:10063]
2025-10-01T14:10:48.604094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:48.610449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.610468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.610600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.610652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.610711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.610768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.610806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.610814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.610873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.610925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.610978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.611029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.611065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.611070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.611119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.611163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.611210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.611258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.611295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.611299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.611347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.611401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.611449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.611492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.611527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.611532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.611579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.611626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.611672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.611717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.611756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.611763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.611815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.611861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.611917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.611970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.612010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.612017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.612069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.612115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.612163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.612211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.612246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.612252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.612297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.612341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.612384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.612438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.612474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.612480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.612530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.612579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.612628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.612674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.612718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.612724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.612771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.612817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.612876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.612926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.612962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.612967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.612998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179070599:10063], now have 1 active actors on pipe
2025-10-01T14:10:48.613132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255574179070599:10063]
2025-10-01T14:10:48.613147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:48.613156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:48.613158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:48.613177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1207 reason: error at write: Disconnected sessionId: src_id|9050b215-c4d5bf61-17e8567d-323df11b_0
2025-10-01T14:10:48.613333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1207 sessionId: src_id|9050b215-c4d5bf61-17e8567d-323df11b_0 is DEAD
2025-10-01T14:10:48.613470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9050b215-c4d5bf61-17e8567d-323df11b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:48.613478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9050b215-c4d5bf61-17e8567d-323df11b_0] Write session will restart in 0.006684s
2025-10-01T14:10:48.613495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9050b215-c4d5bf61-17e8567d-323df11b_0] Write session: Do CDS request
2025-10-01T14:10:48.613500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9050b215-c4d5bf61-17e8567d-323df11b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:48.613777Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:48.620698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9050b215-c4d5bf61-17e8567d-323df11b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.620794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:48.620802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1208
2025-10-01T14:10:48.620891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.620912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:48.620918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:48.620920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:48.621248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1208 sessionId:  describe result for acl check
2025-10-01T14:10:48.621266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:48.621269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:48.621270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:48.621272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255574179070688:10094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:48.621655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255574179070688:10094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:48.623944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255574179070688:10094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:48.626222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255574179070688:10094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:48.626235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255574179070688:10094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:48.626247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255574179070688:10094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:48.626252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:48.629693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:48.629994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:48.630094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:48.630101Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:48.630108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:48.630132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:48.630155Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255571802192230:8715]
2025-10-01T14:10:48.630531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:48.630713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:48.630740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:48.630942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:48.630972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.630976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.630977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.630978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.630978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.630979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.630979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.630980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.630980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.630981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.630981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.630982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.630982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.630983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.630986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.630991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.630993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.630995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.630996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.630998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.631000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.631002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.631003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.631005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.631007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.631009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.631010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.631012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.631015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.631020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.631023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.631026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.631029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.631032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.631033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.631036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.631038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.631041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.631043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.631045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.631050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.631055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.631057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.631060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.631062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.631066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.631068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.631071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.631073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.631075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.631077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.631080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.631082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.631084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.631089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.631092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.631110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:48.634272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:48.634788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:48.634799Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:48.634800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:48.634802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:48.634805Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1207 [2:7556255571802192230:8715]
2025-10-01T14:10:48.634812Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:48.634821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:48.634822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.634824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.634825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.634834Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:48.634841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:48.634847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:48.634885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.634890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.634891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.634893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:48.634894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:48.634934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:48.634941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.634951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.634958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.634968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:48.634981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179070601:2446], now have 1 active actors on pipe
2025-10-01T14:10:48.634986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179070882:10094], now have 1 active actors on pipe
2025-10-01T14:10:48.634990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255571802192225:8715]
2025-10-01T14:10:48.634991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255571802192225:8715]
2025-10-01T14:10:48.634993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255571802192225:8715]
2025-10-01T14:10:48.635001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:48.635012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:48.635012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:48.635014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:48.635015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:48.635022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:48.635024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:48.635037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255571802192225:8715]
2025-10-01T14:10:48.635042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:48.635043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:48.635029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1207
2025-10-01T14:10:48.635052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1207
2025-10-01T14:10:48.635063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.635069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.635085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:48.635092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.635094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.635096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:48.635100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.635108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:48.635119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.635235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.635242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.635251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.635316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1208 partition: 0 MaxSeqNo: 45 sessionId: src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0
2025-10-01T14:10:48.635578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9050b215-c4d5bf61-17e8567d-323df11b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:48.637622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0] Write session: try to update token
2025-10-01T14:10:48.637632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:48.648684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1208 sessionId: src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:48.651194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:48.651543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.651560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.651586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:48.651911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:48.653917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:48.653931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:48.653932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:48.653934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:48.653940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255571802192225:8715]
2025-10-01T14:10:48.653943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255571802192225:8715]
2025-10-01T14:10:48.653946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255571802192225:8715]
2025-10-01T14:10:48.653973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:48.653976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:48.653977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:48.653978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:48.653982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.653984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:48.654105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:48.713229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255574179070896:10063]
2025-10-01T14:10:48.713445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1207, pipe: [1:7556255574179070896:10063]
2025-10-01T14:10:48.778313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:48.784811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.784831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.784964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.785018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.785070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.785120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.785157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.785164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.785221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.785270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.785323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.785379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.785417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.785422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.785478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.785529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.785586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.785658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.785693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.785698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.785748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.785796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.785846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.785890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.785924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.785929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.785978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.786033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.786077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.786125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.786158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.786163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.786211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.786257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.786305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.786357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.786405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.786411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.786459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.786511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.786561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.786608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.786709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.786715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.786763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.786809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.786853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.786900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.786936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.786941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.786991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.787045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.787094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.787140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.787236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.787241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.787289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.787338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.787387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.787437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.787469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.787474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.787505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179070896:10063], now have 1 active actors on pipe
2025-10-01T14:10:48.787696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:48.787705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:48.787711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:48.787727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1208 reason: error at write: Disconnected sessionId: src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0
2025-10-01T14:10:48.787756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255574179070896:10063]
2025-10-01T14:10:48.787892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1208 sessionId: src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0 is DEAD
2025-10-01T14:10:48.788015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:48.788024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0] Write session will restart in 0.005372s
2025-10-01T14:10:48.788053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0] Write session: Do CDS request
2025-10-01T14:10:48.788058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:48.788200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:48.794670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.794780Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:48.794787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1209
2025-10-01T14:10:48.794893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.794913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:48.794920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:48.794922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:48.795172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1209 sessionId:  describe result for acl check
2025-10-01T14:10:48.795194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:48.795200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:48.795202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:48.795205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255574179070968:10099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:48.795568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255574179070968:10099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:48.797795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255574179070968:10099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:48.800181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255574179070968:10099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:48.800193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255574179070968:10099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:48.800196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255574179070968:10099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:48.800202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:48.804635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:48.804925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:48.805035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:48.805045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:48.805051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:48.805079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:48.805105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255571802192529:8722]
2025-10-01T14:10:48.805479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:48.805649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:48.805679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:48.805862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:48.805892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.805897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.805897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.805898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.805899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.805899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.805900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.805900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.805901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.805901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.805902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.805902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.805903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.805903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.805906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.805912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.805914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.805917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.805919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.805921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.805923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.805925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.805927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.805929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.805933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.805937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.805941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.805944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.805949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.805961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.805968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.805971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.805977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.805980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.805982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.805985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.805990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.805993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.805995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.805998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.806000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.806006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.806008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.806011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.806017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.806020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.806022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.806025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.806027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.806032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.806034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.806037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.806040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.806045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.806048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.806050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.806069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:48.809116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:48.809596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:48.809606Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:48.809607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:48.809609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:48.809613Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1208 [2:7556255571802192529:8722]
2025-10-01T14:10:48.809621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:48.809633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:48.809634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.809636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.809637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.809646Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:48.809652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:48.809656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:48.809683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.809688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.809689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.809690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:48.809692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:48.809729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:48.809734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.809740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.809745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.809756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:48.809770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179071182:10099], now have 1 active actors on pipe
2025-10-01T14:10:48.809775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179070900:2446], now have 1 active actors on pipe
2025-10-01T14:10:48.809779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255571802192524:8722]
2025-10-01T14:10:48.809781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255571802192524:8722]
2025-10-01T14:10:48.809782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255571802192524:8722]
2025-10-01T14:10:48.809790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:48.809801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:48.809802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:48.809803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:48.809804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:48.809812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:48.809813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:48.809801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1208
2025-10-01T14:10:48.809804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1208
2025-10-01T14:10:48.809826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255571802192524:8722]
2025-10-01T14:10:48.809831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:48.809832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:48.809841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.809847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.809873Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:48.809881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.809883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.809887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:48.809892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.809897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:48.809910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.810017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.810021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.810031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.810103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1209 partition: 0 MaxSeqNo: 45 sessionId: src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0
2025-10-01T14:10:48.810321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5b427ea-fe9060c2-4e2def7e-3c3740ad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:48.812433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0] Write session: try to update token
2025-10-01T14:10:48.812445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:48.823604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1209 sessionId: src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:48.825738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:48.825936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.825949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.825965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:48.826022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:48.827895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:48.827909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:48.827910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:48.827912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:48.827918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255571802192524:8722]
2025-10-01T14:10:48.827921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255571802192524:8722]
2025-10-01T14:10:48.827923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255571802192524:8722]
2025-10-01T14:10:48.827957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:48.827956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:48.827960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:48.827962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:48.827966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.827968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:48.828078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:48.887851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255574179071208:10063]
2025-10-01T14:10:48.888064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1208, pipe: [1:7556255574179071208:10063]
2025-10-01T14:10:48.958592Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:48.964875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.964897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.965023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.965073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.965132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.965189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.965226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.965234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.965290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.965339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.965388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.965438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.965476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.965480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.965528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.965573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.965625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.965674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.965713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.965721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.965769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.965815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.965862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.965909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.965944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.965949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.965995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.966040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.966085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.966137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.966174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.966180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.966233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.966284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.966334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.966394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.966431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.966436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.966484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.966529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.966578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.966633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.966672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.966678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.966723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.966770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.966816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.966867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.966902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.966906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.966954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.967000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.967046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.967095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.967129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.967137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.967196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:48.967242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:48.967289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:48.967334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:48.967374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:48.967380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:48.967411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179071208:10063], now have 1 active actors on pipe
2025-10-01T14:10:48.967579Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:48.967584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255574179071208:10063]
2025-10-01T14:10:48.967599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:48.967601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:48.967622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1209 reason: error at write: Disconnected sessionId: src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0
2025-10-01T14:10:48.967788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1209 sessionId: src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0 is DEAD
2025-10-01T14:10:48.967907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:48.967917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0] Write session will restart in 0.005414s
2025-10-01T14:10:48.967939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0] Write session: Do CDS request
2025-10-01T14:10:48.967943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:48.968119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:48.974765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.974834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:48.974842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1210
2025-10-01T14:10:48.974922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:48.974942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:48.974948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:48.974950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:48.975199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1210 sessionId:  describe result for acl check
2025-10-01T14:10:48.975218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:48.975223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:48.975225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:48.975228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255574179071285:10104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:48.975584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255574179071285:10104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:48.977058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255574179071285:10104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:48.979084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255574179071285:10104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:48.979091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255574179071285:10104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:48.979094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255574179071285:10104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:48.979098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:48.981313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:48.984977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:48.985102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:48.985109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:48.985116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:48.985154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:48.985181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255571802192819:8725]
2025-10-01T14:10:48.985522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:48.985709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:48.985733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:48.985909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:48.985938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.985942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.985943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.985943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.985944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.985944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.985945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.985945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.985946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.985946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.985947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.985947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.985948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.985949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.985951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.985957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.985959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.985961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.985963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.985965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.985967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.985969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.985971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.985973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.985975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.985977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.985979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.985981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.985986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.985990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:48.985993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.985996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:48.985999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.986002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:48.986004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.986010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:48.986012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.986015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:48.986017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.986019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:48.986022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.986024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:48.986026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.986029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:48.986032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.986035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:48.986037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.986040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.986046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.986048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.986050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.986054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.986056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.986059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:48.986063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.986066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:48.986095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:48.989226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:48.989728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:48.989739Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:48.989741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:48.989743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:48.989749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1209 [2:7556255571802192819:8725]
2025-10-01T14:10:48.989760Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:48.989782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:48.989788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.989790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.989791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.989800Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:48.989807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:48.989811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:48.989842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.989846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.989847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.989849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:48.989851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:48.989891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:48.989898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:48.989907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:48.989921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:48.989938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:48.989952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179071213:2446], now have 1 active actors on pipe
2025-10-01T14:10:48.989958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255574179071445:10104], now have 1 active actors on pipe
2025-10-01T14:10:48.989962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255571802192814:8725]
2025-10-01T14:10:48.989966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255571802192814:8725]
2025-10-01T14:10:48.989968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255571802192814:8725]
2025-10-01T14:10:48.989976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:48.989988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:48.989989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:48.989991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:48.989992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:48.989998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:48.990000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:48.990013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255571802192814:8725]
2025-10-01T14:10:48.990020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:48.990023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:48.990133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1209
2025-10-01T14:10:48.990168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1209
2025-10-01T14:10:48.990200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.990208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.990226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:48.990234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:48.990237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:48.990241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:48.990247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:48.990252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:48.990265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.990391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:48.990399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:48.990410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:48.990471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1210 partition: 0 MaxSeqNo: 45 sessionId: src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0
2025-10-01T14:10:48.990717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|382eff07-2e9d233b-f39f1e32-d514e87f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:48.992863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0] Write session: try to update token
2025-10-01T14:10:48.992875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:49.004789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:49.004803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:49.004811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255571802192814:8725]
2025-10-01T14:10:49.004840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:49.004847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:49.004982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:49.005096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:49.005206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:49.005320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:49.005483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:49.005511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:49.006997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1210 sessionId: src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:49.009133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:49.009276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.009293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.009319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:49.009376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:49.017518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:49.017531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:49.017533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:49.017534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:49.017541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255571802192814:8725]
2025-10-01T14:10:49.017544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255571802192814:8725]
2025-10-01T14:10:49.017546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255571802192814:8725]
2025-10-01T14:10:49.017576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:49.017584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.017586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:49.017590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:49.017603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:49.017607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:49.017700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:49.067543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255578474038802:10063]
2025-10-01T14:10:49.067730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1209, pipe: [1:7556255578474038802:10063]
2025-10-01T14:10:49.145478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:49.152307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.152329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.152464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.152520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.152579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.152639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.152679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.152686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.152748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.152797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.152850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.152904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.152941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.152946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.152997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.153052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.153106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.153154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.153190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.153196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.153245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.153292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.153340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.153387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.153424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.153429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.153476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.153530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.153578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.153631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.153666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.153670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.153718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.153763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.153813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.153864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.153901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.153906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.153959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.154007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.154065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.154119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.154160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.154165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.154215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.154261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.154311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.154361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.154417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.154422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.154471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.154520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.154656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.154752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.154788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.154793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.154903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.154952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.155002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.155055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.155094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.155099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.155140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474038802:10063], now have 1 active actors on pipe
2025-10-01T14:10:49.155320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:49.155344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255578474038802:10063]
2025-10-01T14:10:49.155365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:49.155367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:49.155388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1210 reason: error at write: Disconnected sessionId: src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0
2025-10-01T14:10:49.155554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1210 sessionId: src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0 is DEAD
2025-10-01T14:10:49.155665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:49.155671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0] Write session will restart in 0.006872s
2025-10-01T14:10:49.155690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0] Write session: Do CDS request
2025-10-01T14:10:49.155695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:49.155844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:49.163766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.163893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:49.163905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1211
2025-10-01T14:10:49.164008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.164031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:49.164038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:49.164041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:49.164310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1211 sessionId:  describe result for acl check
2025-10-01T14:10:49.164334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:49.164338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:49.164340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:49.164343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255578474038909:10108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:49.164693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255578474038909:10108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:49.166993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255578474038909:10108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:49.169268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255578474038909:10108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:49.169277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255578474038909:10108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:49.169279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255578474038909:10108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:49.169283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:49.169763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:49.172934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:49.173060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:49.173067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:49.173074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:49.173101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:49.173124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255576097160404:8727]
2025-10-01T14:10:49.173468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:49.173635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:49.173658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:49.173830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:49.173859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.173863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.173864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.173864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.173865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.173866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.173866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.173867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.173867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.173868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.173869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.173869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.173870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.173870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.173873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.173878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.173881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.173883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.173885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.173887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.173889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.173891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.173892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.173895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.173897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.173899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.173901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.173902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.173906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.173910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.173913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.173916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.173919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.173921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.173924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.173926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.173928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.173931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.173933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.173940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.173942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.173945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.173948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.173950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.173952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.173958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.173960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.173963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.173968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.173971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.173973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.173979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.173982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.173984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.173987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.173989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.174007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:49.177072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:49.177753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:49.177763Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:49.177764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:49.177766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:49.177769Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1210 [2:7556255576097160404:8727]
2025-10-01T14:10:49.177777Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:49.177785Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:49.177790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.177792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.177793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.177803Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:49.177807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:49.177813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:49.177841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.177846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.177847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.177849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:49.177850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:49.177888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:49.177893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.177899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.177904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.177912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:49.177923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255576097160399:8727]
2025-10-01T14:10:49.177927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255576097160399:8727]
2025-10-01T14:10:49.177928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255576097160399:8727]
2025-10-01T14:10:49.177933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:49.177940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:49.177942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:49.177947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:49.177948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:49.177949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:49.177951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:49.177957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039089:10108], now have 1 active actors on pipe
2025-10-01T14:10:49.177959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474038805:2446], now have 1 active actors on pipe
2025-10-01T14:10:49.177974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255576097160399:8727]
2025-10-01T14:10:49.177981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:49.177988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:49.178002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1210
2025-10-01T14:10:49.178023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1210
2025-10-01T14:10:49.178051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.178058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.178075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:49.178082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.178085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.178087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:49.178094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.178105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:49.178119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.178265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.178270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.178279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.178347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1211 partition: 0 MaxSeqNo: 45 sessionId: src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0
2025-10-01T14:10:49.178668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4ed75ab-b71b1635-6d845cde-9560dfbc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:49.180763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0] Write session: try to update token
2025-10-01T14:10:49.180776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:49.192651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1211 sessionId: src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:49.194830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:49.194949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.194965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.196556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:49.196570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:49.196572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:49.196573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:49.196579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255576097160399:8727]
2025-10-01T14:10:49.196583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255576097160399:8727]
2025-10-01T14:10:49.196585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255576097160399:8727]
2025-10-01T14:10:49.196614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:49.196616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:49.196626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:49.196626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:49.196629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:49.196630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.196632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:49.196679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:49.196756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:49.255449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255578474039102:10063]
2025-10-01T14:10:49.255619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1210, pipe: [1:7556255578474039102:10063]
2025-10-01T14:10:49.320421Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:49.326798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.326816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.326935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.326987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.327058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.327126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.327164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.327171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.327226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.327274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.327324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.327379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.327415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.327420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.327482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.327528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.327574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.327626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.327661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.327666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.327712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.327758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.327805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.327851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.327886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.327892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.327954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.328000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.328047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.328096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.328137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.328143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.328194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.328240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.328290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.328338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.328373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.328379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.328426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.328473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.328522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.328571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.328612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.328619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.328670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.328725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.328772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.328821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.328855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.328860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.328908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.328955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.329001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.329051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.329086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.329091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.329149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.329201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.329251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.329298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.329333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.329338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.329369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039102:10063], now have 1 active actors on pipe
2025-10-01T14:10:49.329588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255578474039102:10063]
2025-10-01T14:10:49.329617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:49.329619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:49.329632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:49.329641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1211 reason: error at write: Disconnected sessionId: src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0
2025-10-01T14:10:49.329819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1211 sessionId: src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0 is DEAD
2025-10-01T14:10:49.329935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:49.329944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0] Write session will restart in 0.008921s
2025-10-01T14:10:49.329963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0] Write session: Do CDS request
2025-10-01T14:10:49.329968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:49.330068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:49.339774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.340055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:49.340063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1212
2025-10-01T14:10:49.340156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.340490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:49.340498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:49.340500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:49.340773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1212 sessionId:  describe result for acl check
2025-10-01T14:10:49.340794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:49.340798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:49.340800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:49.340803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255578474039272:10113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:49.341155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255578474039272:10113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:49.343163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255578474039272:10113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:49.347460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255578474039272:10113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:49.347468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255578474039272:10113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:49.347470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255578474039272:10113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:49.347474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:49.347449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:49.347763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:49.347887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:49.347894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:49.347901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:49.347930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:49.347954Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255576097160694:8729]
2025-10-01T14:10:49.348319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:49.348507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:49.348530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:49.348733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:49.348766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.348770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.348770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.348771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.348772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.348772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.348773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.348773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.348774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.348774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.348775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.348775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.348776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.348777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.348779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.348785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.348787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.348789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.348791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.348793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.348795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.348797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.348799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.348801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.348802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.348804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.348806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.348808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.348812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.348816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.348820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.348823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.348825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.348828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.348830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.348832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.348834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.348837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.348839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.348842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.348844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.348847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.348849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.348851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.348853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.348856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.348858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.348861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.348863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.348866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.348868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.348871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.348873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.348875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.348877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.348880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.348898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:49.351983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:49.352495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:49.352507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:49.352508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:49.352510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:49.352513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1211 [2:7556255576097160694:8729]
2025-10-01T14:10:49.352521Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:49.352531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:49.352535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.352537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.352539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.352548Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:49.352551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:49.352556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:49.352585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.352590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.352591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.352592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:49.352594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:49.352632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:49.352637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.352643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.352648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.352660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:49.352674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039395:10113], now have 1 active actors on pipe
2025-10-01T14:10:49.352681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039109:2446], now have 1 active actors on pipe
2025-10-01T14:10:49.352687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255576097160688:8729]
2025-10-01T14:10:49.352691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255576097160688:8729]
2025-10-01T14:10:49.352693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255576097160688:8729]
2025-10-01T14:10:49.352711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:49.352718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:49.352721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:49.352722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:49.352724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:49.352731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:49.352733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:49.352746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255576097160688:8729]
2025-10-01T14:10:49.352753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:49.352756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:49.352765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1211
2025-10-01T14:10:49.352765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1211
2025-10-01T14:10:49.352817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.352824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.352839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:49.352845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.352847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.352849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:49.352854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.352859Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:49.352866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.352982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.352990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.353004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.353083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1212 partition: 0 MaxSeqNo: 45 sessionId: src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0
2025-10-01T14:10:49.353368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|470d4110-d100eb72-6c2d6ba4-362f3a0a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:49.355551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0] Write session: try to update token
2025-10-01T14:10:49.355564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:49.367708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1212 sessionId: src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:49.369883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:49.370065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.370087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.370120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:49.370186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:49.372256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:49.372270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:49.372272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:49.372273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:49.372279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255576097160688:8729]
2025-10-01T14:10:49.372282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255576097160688:8729]
2025-10-01T14:10:49.372284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255576097160688:8729]
2025-10-01T14:10:49.372312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:49.372315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:49.372315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:49.372317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:49.372321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.372322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:49.372429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:49.429543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255578474039411:10063]
2025-10-01T14:10:49.429711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1211, pipe: [1:7556255578474039411:10063]
2025-10-01T14:10:49.499436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:49.506680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.506703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.506855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.506908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.506960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.507015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.507053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.507060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.507117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.507168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.507220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.507274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.507318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.507327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.507381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.507434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.507486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.507532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.507575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.507582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.507638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.507688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.507734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.507787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.507826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.507832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.507881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.507928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.507977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.508028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.508070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.508074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.508127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.508176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.508228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.508284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.508325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.508332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.508389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.508437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.508486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.508534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.508571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.508576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.508630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.508681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.508740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.508793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.508835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.508842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.508908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.508966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.509018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.509074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.509111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.509115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.509170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:49.509220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:49.509274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:49.509323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:49.509359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:49.509364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:49.509401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039411:10063], now have 1 active actors on pipe
2025-10-01T14:10:49.509674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255578474039411:10063]
2025-10-01T14:10:49.509676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:49.509679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:49.509699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1212 reason: error at write: Disconnected sessionId: src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0
2025-10-01T14:10:49.509701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:49.509886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1212 sessionId: src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0 is DEAD
2025-10-01T14:10:49.510045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:49.510057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0] Write session will restart in 0.005977s
2025-10-01T14:10:49.510081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0] Write session: Do CDS request
2025-10-01T14:10:49.510088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:49.510264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:49.516893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.516991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:49.517001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1213
2025-10-01T14:10:49.517105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.517136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:49.517144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:49.517148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:49.517469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1213 sessionId:  describe result for acl check
2025-10-01T14:10:49.517495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:49.517499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:49.517501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:49.517504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255578474039494:10124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:49.517877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255578474039494:10124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:49.520164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255578474039494:10124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:49.522965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255578474039494:10124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:49.522973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255578474039494:10124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:49.522975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255578474039494:10124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:49.522979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:49.525923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:49.529140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:49.529299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:49.529309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:49.529320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:49.529359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:49.529391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255576097160994:8734]
2025-10-01T14:10:49.529968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:49.530207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:49.530235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:49.530466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:49.530500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.530501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.530502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.530502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.530503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.530503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.530504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.530504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.530505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.530506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.530506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.530507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.530507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.530508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.530511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.530516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.530518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.530520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.530522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.530524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.530526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.530528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.530530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.530532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.530534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.530536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.530538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.530540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.530544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.530548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.530552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.530555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.530557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.530560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.530563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.530566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.530568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.530571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.530573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.530576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.530578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.530580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.530583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.530585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.530588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.530590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.530592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.530595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.530598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.530601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.530603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.530606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.530608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.530611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.530612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.530615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.530634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:49.533992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:49.534841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:49.534858Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:49.534861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:49.534863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:49.534869Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1212 [2:7556255576097160994:8734]
2025-10-01T14:10:49.534881Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:49.534894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:49.534896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.534899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.534900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.534914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:49.534918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:49.534924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:49.534969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.534977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.534979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.534982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:49.534985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:49.535041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:49.535047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.535057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.535067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.535087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:49.535105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039668:10124], now have 1 active actors on pipe
2025-10-01T14:10:49.535112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039438:2446], now have 1 active actors on pipe
2025-10-01T14:10:49.535118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255576097160989:8734]
2025-10-01T14:10:49.535120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255576097160989:8734]
2025-10-01T14:10:49.535122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255576097160989:8734]
2025-10-01T14:10:49.535134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:49.535143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:49.535145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:49.535147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:49.535148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:49.535160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:49.535163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:49.535181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255576097160989:8734]
2025-10-01T14:10:49.535191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:49.535197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:49.535189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1212
2025-10-01T14:10:49.535201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1212
2025-10-01T14:10:49.535233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.535242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.535264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|364ff8dd-170668d8-50f31f33-9d156658_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:49.535273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.535276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.535279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:49.535287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.535295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:49.535307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.535432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.535440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.535452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.535524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1213 partition: 0 MaxSeqNo: 45 sessionId: src_id|364ff8dd-170668d8-50f31f33-9d156658_0
2025-10-01T14:10:49.535870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0d1635-58f6d200-c617317d-86b99cf0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|364ff8dd-170668d8-50f31f33-9d156658_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:49.538111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|364ff8dd-170668d8-50f31f33-9d156658_0] Write session: try to update token
2025-10-01T14:10:49.538129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|364ff8dd-170668d8-50f31f33-9d156658_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:49.551454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1213 sessionId: src_id|364ff8dd-170668d8-50f31f33-9d156658_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:49.553865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:49.553883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:49.553884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:49.553885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:49.553892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255576097160989:8734]
2025-10-01T14:10:49.553895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255576097160989:8734]
2025-10-01T14:10:49.553899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255576097160989:8734]
2025-10-01T14:10:49.553926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:49.553930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:49.553933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:49.553941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:49.553946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.553949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:49.553982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:49.554070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:49.609785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255578474039734:10063]
2025-10-01T14:10:49.610014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1212, pipe: [1:7556255578474039734:10063]
2025-10-01T14:10:49.686236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:49.686807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.686820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.686854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039734:10063], now have 1 active actors on pipe
2025-10-01T14:10:49.687018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:49.687124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:49.687159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255578474039734:10063]
2025-10-01T14:10:49.687183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:49.687256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1213 reason: status is not ok: tablet will be restarted right now sessionId: src_id|364ff8dd-170668d8-50f31f33-9d156658_0
2025-10-01T14:10:49.687455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1213 sessionId: src_id|364ff8dd-170668d8-50f31f33-9d156658_0 is DEAD
2025-10-01T14:10:49.687591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364ff8dd-170668d8-50f31f33-9d156658_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:49.687602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364ff8dd-170668d8-50f31f33-9d156658_0] Write session will restart in 0.009045s
2025-10-01T14:10:49.687627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364ff8dd-170668d8-50f31f33-9d156658_0] Write session: Do CDS request
2025-10-01T14:10:49.687633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364ff8dd-170668d8-50f31f33-9d156658_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:49.697974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|364ff8dd-170668d8-50f31f33-9d156658_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.697983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:49.697996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1214
2025-10-01T14:10:49.698158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.698196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:49.698202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:49.698205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:49.698571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1214 sessionId:  describe result for acl check
2025-10-01T14:10:49.698607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:49.698612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:49.698614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:49.698619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255578474039810:10128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:49.699062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255578474039810:10128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:49.700178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255578474039810:10128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:49.702802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255578474039810:10128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:49.702814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255578474039810:10128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:49.702818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255578474039810:10128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:49.702824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:49.708372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:49.712383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:49.712593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:49.712605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:49.712617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:49.712667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:49.712716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255576097161327:8746]
2025-10-01T14:10:49.713277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:49.713554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:49.713594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:49.713866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:49.713922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.713927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.713928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.713930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.713931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.713932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.713934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.713935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.713936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.713937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.713939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.713940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.713941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.713942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.713947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.713958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.713961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.713965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.713968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.713972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.713975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.713978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.713981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.713985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.713988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.713992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.713995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.713998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.714006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.714012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.714018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.714023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.714027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.714032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.714036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.714041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.714046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.714051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.714055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.714060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.714065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.714070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.714074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.714079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.714084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.714088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.714092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.714097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.714101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.714104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.714108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.714117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.714121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.714125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.714129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.714133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.714166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:49.717628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:49.718263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:49.718276Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:49.718278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:49.718281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:49.718288Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1213 [2:7556255576097161327:8746]
2025-10-01T14:10:49.718303Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:49.718318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:49.718321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.718324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.718326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.718340Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:49.718345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:49.718351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:49.718419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.718426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.718428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.718432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:49.718435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:49.718497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:49.718504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.718516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.718528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.718549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:49.718570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039906:10128], now have 1 active actors on pipe
2025-10-01T14:10:49.718578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474039740:2446], now have 1 active actors on pipe
2025-10-01T14:10:49.718585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255576097161322:8746]
2025-10-01T14:10:49.718591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255576097161322:8746]
2025-10-01T14:10:49.718593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255576097161322:8746]
2025-10-01T14:10:49.718607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:49.718624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:49.718625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:49.718634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:49.718637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:49.718638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:49.718641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:49.718613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1213
2025-10-01T14:10:49.718627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1213
2025-10-01T14:10:49.718664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255576097161322:8746]
2025-10-01T14:10:49.718671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:49.718673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:49.718687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.718696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.718738Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:49.718749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.718752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.718755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:49.718763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.718770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:49.718784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.718917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.718926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.718939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.718996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1214 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0
2025-10-01T14:10:49.719393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|364ff8dd-170668d8-50f31f33-9d156658_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:49.721818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0] Write session: try to update token
2025-10-01T14:10:49.721838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:49.735680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1214 sessionId: src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:49.737984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:49.738056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:49.738079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:49.738082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:49.738084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:49.738094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255576097161322:8746]
2025-10-01T14:10:49.738099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255576097161322:8746]
2025-10-01T14:10:49.738102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255576097161322:8746]
2025-10-01T14:10:49.738132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:49.738138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:49.738141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:49.738154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.738163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.738188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:49.738201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.738203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:49.738330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:49.787418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255578474040040:10063]
2025-10-01T14:10:49.787667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1213, pipe: [1:7556255578474040040:10063]
2025-10-01T14:10:49.876459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:49.877295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474040040:10063], now have 1 active actors on pipe
2025-10-01T14:10:49.877451Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:49.877521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:49.877532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:49.877537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255578474040040:10063]
2025-10-01T14:10:49.877588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1214 reason: error at write: Disconnected sessionId: src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0
2025-10-01T14:10:49.877612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:49.877791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1214 sessionId: src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0 is DEAD
2025-10-01T14:10:49.877923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:49.877934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0] Write session will restart in 0.005847s
2025-10-01T14:10:49.877960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0] Write session: Do CDS request
2025-10-01T14:10:49.877966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:49.884846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.884978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:49.884992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1215
2025-10-01T14:10:49.885104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:49.885135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:49.885142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:49.885160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:49.885574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1215 sessionId:  describe result for acl check
2025-10-01T14:10:49.885621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:49.885630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:49.885632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:49.885637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255578474040076:10134] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:49.886196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255578474040076:10134] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:49.888735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255578474040076:10134] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:49.892162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255578474040076:10134] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:49.892176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255578474040076:10134] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:49.892180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255578474040076:10134] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:49.892188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:49.898405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:49.902491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:49.902735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:49.902744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:49.902753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:49.902793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:49.902822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255576097161622:8749]
2025-10-01T14:10:49.903224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:49.903522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:49.903553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:49.903762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:49.903799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.903803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.903804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.903805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.903805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.903806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.903806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.903807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.903808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.903808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.903809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.903809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.903810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.903811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.903814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.903820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.903822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.903825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.903826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.903829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.903831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.903833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.903835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.903837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.903839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.903841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.903843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.903845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.903850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.903855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:49.903859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.903862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:49.903864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.903867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:49.903870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.903874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:49.903876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.903879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:49.903881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.903884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:49.903887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.903889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:49.903891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.903894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:49.903896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.903899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:49.903902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.903905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.903907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.903909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.903912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.903914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.903917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.903920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:49.903922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.903924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:49.903945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:49.907611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:49.908173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:49.908186Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:49.908188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:49.908191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:49.908196Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1214 [2:7556255576097161622:8749]
2025-10-01T14:10:49.908210Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:49.908226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:49.908230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.908233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.908235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.908247Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:49.908255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:49.908259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:49.908303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.908311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.908313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.908316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:49.908319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:49.908371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:49.908376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.908384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:49.908390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:49.908398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:49.908414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255576097161617:8749]
2025-10-01T14:10:49.908419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255576097161617:8749]
2025-10-01T14:10:49.908420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255576097161617:8749]
2025-10-01T14:10:49.908426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:49.908436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:49.908436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:49.908439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:49.908441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:49.908447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:49.908448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:49.908457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474040054:2446], now have 1 active actors on pipe
2025-10-01T14:10:49.908459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474040215:10134], now have 1 active actors on pipe
2025-10-01T14:10:49.908478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255576097161617:8749]
2025-10-01T14:10:49.908486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:49.908501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:49.908531Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1214
2025-10-01T14:10:49.908573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1214
2025-10-01T14:10:49.908588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.908595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.908612Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:49.908620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:49.908623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:49.908625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:49.908632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:49.908641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:49.908650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.908783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.908791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.908802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:49.908956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1215 partition: 0 MaxSeqNo: 45 sessionId: src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0
2025-10-01T14:10:49.909347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d1998e2-83e8ecba-8071a164-f6f4e36c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:49.911767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0] Write session: try to update token
2025-10-01T14:10:49.911787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:49.920966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:49.920993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:49.921003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255576097161617:8749]
2025-10-01T14:10:49.921049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:49.921050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:49.921221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:49.921368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:49.921511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:49.921660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:49.921870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:49.921916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:49.930623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1215 sessionId: src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:49.938092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:49.944358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:49.944388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:49.944410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:49.944414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:49.944416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:49.944418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:49.944429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255576097161617:8749]
2025-10-01T14:10:49.944433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255576097161617:8749]
2025-10-01T14:10:49.944438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255576097161617:8749]
2025-10-01T14:10:49.944494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:49.944503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:49.944508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:49.944511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:49.944512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:49.944514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:49.944657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:49.977937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255578474040356:10063]
2025-10-01T14:10:49.978222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1214, pipe: [1:7556255578474040356:10063]
2025-10-01T14:10:50.098275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:50.099171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:50.099210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255578474040356:10063], now have 1 active actors on pipe
2025-10-01T14:10:50.099321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:50.099345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:50.099390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255578474040356:10063]
2025-10-01T14:10:50.099409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:50.099417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:50.099482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1215 reason: error at write: Disconnected sessionId: src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0
2025-10-01T14:10:50.099656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1215 sessionId: src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0 is DEAD
2025-10-01T14:10:50.099800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:50.099812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0] Write session will restart in 0.007316s
2025-10-01T14:10:50.099836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0] Write session: Do CDS request
2025-10-01T14:10:50.099844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:50.107935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.108047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:50.108061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1216
2025-10-01T14:10:50.108175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.108208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:50.108218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:50.108222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:50.108625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1216 sessionId:  describe result for acl check
2025-10-01T14:10:50.108661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:50.108667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:50.108668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:50.108674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255582769007694:10138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:50.109136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255582769007694:10138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:50.111844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255582769007694:10138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:50.114397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255582769007694:10138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:50.114412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255582769007694:10138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:50.114416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255582769007694:10138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:50.114424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:50.122197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:50.122758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:50.122955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:50.122968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:50.122980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:50.123036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:50.123075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255580392129213:8752]
2025-10-01T14:10:50.123659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:50.123989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:50.124043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:50.124338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:50.124412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.124420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.124421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.124422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.124423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.124424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.124425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.124427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.124428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.124429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.124430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.124431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.124432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.124435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.124441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.124450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.124454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.124458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.124461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.124465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.124468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.124471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.124475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.124479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.124483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.124486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.124490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.124494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.124501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.124509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.124514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.124519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.124523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.124528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.124531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.124543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.124547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.124552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.124556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.124561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.124567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.124572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.124578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.124583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.124591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.124598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.124603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.124612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.124616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.124621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.124629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.124634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.124638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.124646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.124650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.124654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.124692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:50.128299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:50.128866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:50.128881Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:50.128882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:50.128885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:50.128891Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1215 [2:7556255580392129213:8752]
2025-10-01T14:10:50.128901Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:50.128914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:50.128916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.128918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.128919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.128931Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:50.128935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:50.128939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:50.128979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.128984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.128986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.128988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:50.128990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:50.129040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:50.129045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.129052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.129058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.129067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:50.129078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255580392129208:8752]
2025-10-01T14:10:50.129083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255580392129208:8752]
2025-10-01T14:10:50.129085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255580392129208:8752]
2025-10-01T14:10:50.129092Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:50.129100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:50.129101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769007865:10138], now have 1 active actors on pipe
2025-10-01T14:10:50.129103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769007654:2446], now have 1 active actors on pipe
2025-10-01T14:10:50.129107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:50.129108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:50.129109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:50.129116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:50.129118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:50.129136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255580392129208:8752]
2025-10-01T14:10:50.129144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:50.129149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:50.129202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1215
2025-10-01T14:10:50.129211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1215
2025-10-01T14:10:50.129251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.129258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.129274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:50.129282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.129285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.129286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:50.129292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.129298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:50.129313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.129423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.129429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.129438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.129563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1216 partition: 0 MaxSeqNo: 45 sessionId: src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0
2025-10-01T14:10:50.129941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b60e38d9-ebb481a7-a224534c-ee05d422_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:50.132262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0] Write session: try to update token
2025-10-01T14:10:50.132278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:50.140191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:50.140211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:50.140221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255580392129208:8752]
2025-10-01T14:10:50.140265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:50.140283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:50.140420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:50.140546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:50.140733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:50.140872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:50.141061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:50.141104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:50.144982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1216 sessionId: src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:50.147311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:50.147491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.147514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.147556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:50.147656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:50.158211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:50.158228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:50.158229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:50.158231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:50.158239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255580392129208:8752]
2025-10-01T14:10:50.158243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255580392129208:8752]
2025-10-01T14:10:50.158245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255580392129208:8752]
2025-10-01T14:10:50.158284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:50.158289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.158290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:50.158290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:50.158295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:50.158297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:50.158431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:50.199597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255582769007957:10063]
2025-10-01T14:10:50.200155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1215, pipe: [1:7556255582769007957:10063]
2025-10-01T14:10:50.289274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:50.295773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.295796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.295942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.295998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.296055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.296113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.296155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.296162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.296223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.296278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.296337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.296396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.296437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.296442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.296497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.296585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.296639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.296691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.296737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.296743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.296796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.296850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.296903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.296956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.296995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.297000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.297058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.297111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.297163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.297215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.297269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.297275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.297328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.297381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.297437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.297492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.297532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.297536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.297591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.297646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.297701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.297759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.297799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.297804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.297860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.297915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.297970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.298025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.298190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.298197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.298256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.298308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.298361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.298435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.298473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.298478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.298535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.298589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.298643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.298700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.298739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.298744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.298779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769007957:10063], now have 1 active actors on pipe
2025-10-01T14:10:50.298930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:50.298940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:50.298953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:50.298962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1216 reason: error at write: Disconnected sessionId: src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0
2025-10-01T14:10:50.298999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255582769007957:10063]
2025-10-01T14:10:50.299139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1216 sessionId: src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0 is DEAD
2025-10-01T14:10:50.299257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:50.299266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0] Write session will restart in 0.005147s
2025-10-01T14:10:50.299285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0] Write session: Do CDS request
2025-10-01T14:10:50.299290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:50.299843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:50.305738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.305834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:50.305846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1217
2025-10-01T14:10:50.305923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.305945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:50.305951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:50.305954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:50.306264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1217 sessionId:  describe result for acl check
2025-10-01T14:10:50.306295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:50.306300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:50.306302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:50.306307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255582769008015:10142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:50.306771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255582769008015:10142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:50.309452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255582769008015:10142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:50.311867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255582769008015:10142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:50.311877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255582769008015:10142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:50.311880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255582769008015:10142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:50.311885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:50.313769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:50.316618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:50.316752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:50.316759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:50.316766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:50.316794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:50.316820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255580392129509:8754]
2025-10-01T14:10:50.317173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:50.317374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:50.317396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:50.317575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:50.317605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.317609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.317610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.317611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.317611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.317612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.317612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.317613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.317614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.317614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.317615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.317615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.317616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.317616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.317619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.317624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.317626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.317628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.317630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.317632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.317634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.317636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.317638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.317640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.317642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.317644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.317646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.317647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.317652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.317656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.317659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.317662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.317665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.317668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.317670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.317673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.317675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.317678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.317684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.317686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.317688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.317691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.317693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.317696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.317698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.317701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.317706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.317709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.317712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.317717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.317720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.317722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.317729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.317732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.317735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.317740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.317760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:50.320956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:50.321683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:50.321697Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:50.321699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:50.321702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:50.321708Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1216 [2:7556255580392129509:8754]
2025-10-01T14:10:50.321720Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:50.321733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:50.321740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.321743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.321745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.321759Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:50.321766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:50.321771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:50.321807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.321812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.321813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.321815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:50.321816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:50.321860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:50.321864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.321871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.321876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.321888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:50.321902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769008235:10142], now have 1 active actors on pipe
2025-10-01T14:10:50.321908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769007960:2446], now have 1 active actors on pipe
2025-10-01T14:10:50.321912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255580392129504:8754]
2025-10-01T14:10:50.321914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255580392129504:8754]
2025-10-01T14:10:50.321915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255580392129504:8754]
2025-10-01T14:10:50.321923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:50.321936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:50.321941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:50.321943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:50.321945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:50.321951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:50.321954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:50.321975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255580392129504:8754]
2025-10-01T14:10:50.321985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:50.321977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1216
2025-10-01T14:10:50.321998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:50.321977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1216
2025-10-01T14:10:50.322018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.322025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.322046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:50.322053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.322057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.322058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:50.322064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.322071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:50.322087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.322213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.322218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.322227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.322297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1217 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0
2025-10-01T14:10:50.322645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90b52a0-99f906d4-f4288e52-e393d0a2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:50.324965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0] Write session: try to update token
2025-10-01T14:10:50.324979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:50.338670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1217 sessionId: src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:50.340961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:50.342578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.342608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.342628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:50.342631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:50.342634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:50.342636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:50.342646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255580392129504:8754]
2025-10-01T14:10:50.342651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255580392129504:8754]
2025-10-01T14:10:50.342655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255580392129504:8754]
2025-10-01T14:10:50.342705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:50.342712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:50.342719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:50.342720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.342722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:50.342723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:50.342850Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:50.399260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255582769008271:10063]
2025-10-01T14:10:50.399534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1216, pipe: [1:7556255582769008271:10063]
2025-10-01T14:10:50.484934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:50.485118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:50.485164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769008271:10063], now have 1 active actors on pipe
2025-10-01T14:10:50.485240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:50.494181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:50.494193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:50.494211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1217 reason: error at write: Disconnected sessionId: src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0
2025-10-01T14:10:50.494357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1217 sessionId: src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0 is DEAD
2025-10-01T14:10:50.494514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:50.494526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0] Write session will restart in 0.005737s
2025-10-01T14:10:50.494527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255582769008271:10063]
2025-10-01T14:10:50.494544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:50.494550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0] Write session: Do CDS request
2025-10-01T14:10:50.494570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:50.501855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.502267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:50.502281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1218
2025-10-01T14:10:50.502414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.502451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:50.502459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:50.502463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:50.502808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1218 sessionId:  describe result for acl check
2025-10-01T14:10:50.502838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:50.502845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:50.502849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:50.502854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255582769008460:10153] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:50.503306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255582769008460:10153] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:50.505795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255582769008460:10153] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:50.510848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:50.510948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255582769008460:10153] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:50.510963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255582769008460:10153] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:50.510966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255582769008460:10153] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:50.510973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:50.511233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:50.511422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:50.511433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:50.511444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:50.511488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:50.511525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255580392129814:8757]
2025-10-01T14:10:50.511890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:50.512085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:50.512136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:50.512445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:50.512493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.512499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.512500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.512501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.512502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.512503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.512504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.512505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.512506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.512508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.512509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.512510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.512511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.512512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.512518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.512527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.512531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.512535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.512539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.512543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.512547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.512551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.512554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.512559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.512562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.512567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.512570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.512574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.512579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.512587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.512592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.512598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.512601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.512606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.512615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.512620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.512629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.512634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.512642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.512648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.512656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.512662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.512669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.512674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.512683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.512688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.512695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.512700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.512715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.512724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.512728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.512737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.512741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.512749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.512753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.512760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.512796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:50.516043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:50.517094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:50.517107Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:50.517109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:50.517112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:50.517118Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1217 [2:7556255580392129814:8757]
2025-10-01T14:10:50.517131Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:50.517145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:50.517152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.517155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.517157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.517171Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:50.517179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:50.517184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:50.517230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.517236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.517238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.517241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:50.517244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:50.517299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:50.517305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.517316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.517332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.517352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:50.517372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769008585:10153], now have 1 active actors on pipe
2025-10-01T14:10:50.517380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769008326:2446], now have 1 active actors on pipe
2025-10-01T14:10:50.517386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255580392129801:8757]
2025-10-01T14:10:50.517393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255580392129801:8757]
2025-10-01T14:10:50.517396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255580392129801:8757]
2025-10-01T14:10:50.517405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:50.517385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1217
2025-10-01T14:10:50.517412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:50.517397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1217
2025-10-01T14:10:50.517414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:50.517415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:50.517420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:50.517433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:50.517440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:50.517455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.517463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.517493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255580392129801:8757]
2025-10-01T14:10:50.517503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:50.517509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:50.517516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:50.517526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.517534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.517536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:50.517543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.517554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:50.517587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.517685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.517692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.517703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.517765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1218 partition: 0 MaxSeqNo: 45 sessionId: src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0
2025-10-01T14:10:50.518085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae69c06a-e1706fcc-12cc8e7b-c6dfe69f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:50.520224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0] Write session: try to update token
2025-10-01T14:10:50.520236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:50.532546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1218 sessionId: src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:50.534561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:50.536371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.536399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.536421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:50.536430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:50.536433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:50.536435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:50.536444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255580392129801:8757]
2025-10-01T14:10:50.536453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255580392129801:8757]
2025-10-01T14:10:50.536458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255580392129801:8757]
2025-10-01T14:10:50.536513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:50.536517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:50.536524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.536525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:50.536527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:50.536529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:50.536653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:50.594848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255582769008598:10063]
2025-10-01T14:10:50.595093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1217, pipe: [1:7556255582769008598:10063]
2025-10-01T14:10:50.678572Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:50.678950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:50.678992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769008598:10063], now have 1 active actors on pipe
2025-10-01T14:10:50.679099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:50.679143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255582769008598:10063]
2025-10-01T14:10:50.679170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:50.679182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:50.679185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:50.679249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1218 reason: error at write: Disconnected sessionId: src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0
2025-10-01T14:10:50.679416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1218 sessionId: src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0 is DEAD
2025-10-01T14:10:50.679543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:50.679552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0] Write session will restart in 0.007010s
2025-10-01T14:10:50.679574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0] Write session: Do CDS request
2025-10-01T14:10:50.679581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:50.687885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.687993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:50.688007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1219
2025-10-01T14:10:50.688137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.688168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:50.688177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:50.688180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:50.688499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1219 sessionId:  describe result for acl check
2025-10-01T14:10:50.688532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:50.688534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:50.688535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:50.688540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255582769008660:10158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:50.688972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255582769008660:10158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:50.691610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255582769008660:10158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:50.694905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255582769008660:10158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:50.694915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255582769008660:10158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:50.694918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255582769008660:10158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:50.694925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:50.696879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:50.701031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:50.701176Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:50.701184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:50.701192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:50.701224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:50.701249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255580392130152:8767]
2025-10-01T14:10:50.701650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:50.701931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:50.701961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:50.702145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:50.702175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.702179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.702180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.702180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.702181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.702182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.702182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.702183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.702183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.702184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.702184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.702185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.702186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.702186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.702189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.702194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.702196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.702198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.702200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.702202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.702204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.702206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.702208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.702210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.702212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.702214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.702216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.702218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.702222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.702227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.702230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.702232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.702236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.702238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.702241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.702243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.702246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.702248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.702251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.702253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.702256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.702258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.702261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.702263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.702269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.702272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.702274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.702277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.702279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.702285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.702287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.702289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.702291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.702293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.702296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.702300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.702332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:50.705701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:50.706436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:50.706447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:50.706448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:50.706451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:50.706456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1218 [2:7556255580392130152:8767]
2025-10-01T14:10:50.706466Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:50.706478Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:50.706483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.706485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.706487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.706498Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:50.706503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:50.706511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:50.706560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.706567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.706568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.706570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:50.706572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:50.706617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:50.706622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.706630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.706635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.706644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:50.706657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769008879:10158], now have 1 active actors on pipe
2025-10-01T14:10:50.706662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769008601:2446], now have 1 active actors on pipe
2025-10-01T14:10:50.706668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255580392130135:8767]
2025-10-01T14:10:50.706669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255580392130135:8767]
2025-10-01T14:10:50.706670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255580392130135:8767]
2025-10-01T14:10:50.706679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:50.706691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:50.706696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:50.706699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:50.706701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:50.706702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:50.706704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:50.706722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255580392130135:8767]
2025-10-01T14:10:50.706730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:50.706734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:50.706753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1218
2025-10-01T14:10:50.706762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1218
2025-10-01T14:10:50.706836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.706847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.706868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:50.706878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.706882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.706884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:50.706891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.706902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:50.706917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.707084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.707091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.707103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.707194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1219 partition: 0 MaxSeqNo: 45 sessionId: src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0
2025-10-01T14:10:50.707560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e47da127-86fa47c6-44f0ecc2-c38d153f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:50.710079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0] Write session: try to update token
2025-10-01T14:10:50.710095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:50.721671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:50.721686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:50.721694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255580392130135:8767]
2025-10-01T14:10:50.721732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:50.721737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:50.721873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:50.721998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:50.722115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:50.722237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:50.722427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:50.722462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:50.723951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1219 sessionId: src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:50.726232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:50.726441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.726462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.726495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:50.726580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:50.734304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:50.734321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:50.734323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:50.734324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:50.734332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255580392130135:8767]
2025-10-01T14:10:50.734335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255580392130135:8767]
2025-10-01T14:10:50.734337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255580392130135:8767]
2025-10-01T14:10:50.734367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:50.734382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:50.734386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:50.734390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:50.734397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.734400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:50.734518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:50.776064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:10:50.776081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-10-01T14:10:50.779162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255582769008911:10063]
2025-10-01T14:10:50.779348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1218, pipe: [1:7556255582769008911:10063]
2025-10-01T14:10:50.877644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:50.884782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.884807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.884963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.885018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.885079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.885135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.885177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.885187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.885251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.885304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.885362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.885420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.885465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.885473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.885535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.885594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.885647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.885714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.885759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.885768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.885828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.885890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.885946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.886009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.886053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.886058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.886113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.886166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.886233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.886297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.886340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.886347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.886421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.886481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.886543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.886600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.886639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.886644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.886700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.886754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.886811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.886866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.886913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.886923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.886982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.887043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.887100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.887146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.887181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.887182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.887249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.887312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.887370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.887430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.887468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.887473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.887545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:50.887604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:50.887662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:50.887717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:50.887757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:50.887762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:50.887841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769008911:10063], now have 1 active actors on pipe
2025-10-01T14:10:50.888068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:50.888070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255582769008911:10063]
2025-10-01T14:10:50.888079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:50.888088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:50.888099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 9
2025-10-01T14:10:50.888107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1219 reason: error at write: Disconnected sessionId: src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0
2025-10-01T14:10:50.888274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1219 sessionId: src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0 is DEAD
2025-10-01T14:10:50.888408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:50.888417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0] Write session will restart in 0.008995s
2025-10-01T14:10:50.888435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0] Write session: Do CDS request
2025-10-01T14:10:50.888440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:50.888783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:50.898821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.898880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:50.898894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1220
2025-10-01T14:10:50.898994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:50.899027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:50.899037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:50.899040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:50.899483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1220 sessionId:  describe result for acl check
2025-10-01T14:10:50.899519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:50.899523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:50.899524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:50.899528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255582769009030:10164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:50.899981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255582769009030:10164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:50.901953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255582769009030:10164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:50.904103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255582769009030:10164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:50.904116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255582769009030:10164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:50.904120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255582769009030:10164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:50.904127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:50.909653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:50.910071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:50.910342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:50.910354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:50.910366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:50.910439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:50.910478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255580392130453:8776]
2025-10-01T14:10:50.911069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:50.911284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:50.911329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:50.911605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:50.911669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.911675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.911676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.911678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.911679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.911679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.911680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.911681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.911682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.911683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.911684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.911685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.911686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.911687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.911691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.911700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.911704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.911707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.911710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.911713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.911716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.911720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.911722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.911726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.911729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.911733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.911736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.911743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.911749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.911759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:50.911768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.911777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:50.911785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.911790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:50.911793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.911798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:50.911802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.911810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:50.911818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.911822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:50.911830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.911834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:50.911841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.911845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:50.911852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.911856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:50.911863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.911867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.911875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.911879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.911887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.911895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.911899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.911903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:50.911907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.911911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:50.911947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:50.915439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:50.916067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:50.916083Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:50.916085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:50.916089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:50.916095Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1219 [2:7556255580392130453:8776]
2025-10-01T14:10:50.916110Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:50.916125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:50.916132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.916136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.916138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.916153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:50.916166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:50.916173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:50.916227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.916233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.916235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.916239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:50.916241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:50.916303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:50.916313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.916324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:50.916335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:50.916350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:50.916371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769009217:10164], now have 1 active actors on pipe
2025-10-01T14:10:50.916377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769008925:2446], now have 1 active actors on pipe
2025-10-01T14:10:50.916385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255580392130448:8776]
2025-10-01T14:10:50.916391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255580392130448:8776]
2025-10-01T14:10:50.916393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255580392130448:8776]
2025-10-01T14:10:50.916405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:50.916418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:50.916424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:50.916427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:50.916429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:50.916433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:50.916435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:50.916423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1219
2025-10-01T14:10:50.916465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255580392130448:8776]
2025-10-01T14:10:50.916472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:50.916474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:50.916494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1219
2025-10-01T14:10:50.916556Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:10:50.916586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.916594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.916617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:50.916627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:50.916635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:50.916637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:50.916647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:50.916660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:50.916675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.916741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 11 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:10:50.916774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:10:50.916845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.916855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.916870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:50.916937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1220 partition: 0 MaxSeqNo: 45 sessionId: src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0
2025-10-01T14:10:50.917241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|565e1a99-fdd531eb-be22d79c-7e0cca4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:50.919447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0] Write session: try to update token
2025-10-01T14:10:50.919461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:50.932221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1220 sessionId: src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:50.934557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:50.936183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:50.936208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:50.936225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:50.936228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:50.936229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:50.936230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:50.936237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255580392130448:8776]
2025-10-01T14:10:50.936244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255580392130448:8776]
2025-10-01T14:10:50.936247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255580392130448:8776]
2025-10-01T14:10:50.936288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:50.936298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:50.936300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:50.936299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:50.936305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:50.936309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:50.936411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:50.988060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255582769009235:10063]
2025-10-01T14:10:50.988310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1219, pipe: [1:7556255582769009235:10063]
2025-10-01T14:10:51.074819Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:51.075541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:51.075598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255582769009235:10063], now have 1 active actors on pipe
2025-10-01T14:10:51.075677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:51.075751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:51.075788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:51.075791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:51.075804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255582769009235:10063]
2025-10-01T14:10:51.075863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1220 reason: error at write: Disconnected sessionId: src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0
2025-10-01T14:10:51.076048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1220 sessionId: src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0 is DEAD
2025-10-01T14:10:51.076164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:51.076173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0] Write session will restart in 0.006055s
2025-10-01T14:10:51.076190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0] Write session: Do CDS request
2025-10-01T14:10:51.076196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:51.082807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.082828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:51.082840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1221
2025-10-01T14:10:51.083017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.083058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:51.083067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:51.083071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:51.083462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1221 sessionId:  describe result for acl check
2025-10-01T14:10:51.083494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:51.083499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:51.083500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:51.083504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255587063976556:10168] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:51.083956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255587063976556:10168] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:51.085745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255587063976556:10168] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:51.088281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255587063976556:10168] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:51.088294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255587063976556:10168] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:51.088297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255587063976556:10168] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:51.088304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:51.099766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:51.100302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:51.100485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:51.100494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:51.100505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:51.100550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:51.100586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255584687098050:8779]
2025-10-01T14:10:51.101132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:51.101407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:51.101450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:51.101735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:51.101783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.101789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.101790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.101791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.101793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.101794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.101795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.101796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.101797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.101798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.101799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.101800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.101802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.101803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.101807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.101817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.101821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.101825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.101829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.101832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.101836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.101839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.101843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.101847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.101851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.101854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.101858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.101861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.101867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.101874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.101879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.101884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.101889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.101894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.101898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.101903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.101912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.101916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.101920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.101925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.101929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.101938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.101942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.101946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.101952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.101957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.101965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.101969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.101978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.101983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.101991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.101996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.102000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.102005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.102009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.102014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.102052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:51.105571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:51.106158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:51.106174Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:51.106176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:51.106180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:51.106189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1220 [2:7556255584687098050:8779]
2025-10-01T14:10:51.106204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:51.106218Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:51.106225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.106228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.106231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.106243Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:51.106251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:51.106255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:51.106297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.106303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.106305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.106308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:51.106311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:51.106392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:51.106400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.106408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.106413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.106422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:51.106437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255584687098045:8779]
2025-10-01T14:10:51.106443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255584687098045:8779]
2025-10-01T14:10:51.106445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255584687098045:8779]
2025-10-01T14:10:51.106457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:51.106465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:51.106470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063976666:10168], now have 1 active actors on pipe
2025-10-01T14:10:51.106473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:51.106474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063976536:2446], now have 1 active actors on pipe
2025-10-01T14:10:51.106475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:51.106481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:51.106492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:51.106495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:51.106525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255584687098045:8779]
2025-10-01T14:10:51.106538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:51.106556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:51.106540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1220
2025-10-01T14:10:51.106544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1220
2025-10-01T14:10:51.106592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.106600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.106625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54ef9766-2b772d59-740e8b12-f46c084c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:51.106637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.106646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.106648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:51.106656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.106668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:51.106688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.106819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.106828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.106840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.106928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1221 partition: 0 MaxSeqNo: 45 sessionId: src_id|54ef9766-2b772d59-740e8b12-f46c084c_0
2025-10-01T14:10:51.107270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c975033-938a1507-c0681ab6-8b3e0bd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54ef9766-2b772d59-740e8b12-f46c084c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:51.109655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54ef9766-2b772d59-740e8b12-f46c084c_0] Write session: try to update token
2025-10-01T14:10:51.109674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54ef9766-2b772d59-740e8b12-f46c084c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:51.116992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:51.117012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:51.117022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255584687098045:8779]
2025-10-01T14:10:51.117066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:51.117069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:51.117230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:51.117363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:51.117494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:51.117626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:51.117803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:51.117841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:51.122823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1221 sessionId: src_id|54ef9766-2b772d59-740e8b12-f46c084c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:51.125155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:51.125355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.125376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.125404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:51.125487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:51.134936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:51.134955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:51.134958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:51.134959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:51.134970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255584687098045:8779]
2025-10-01T14:10:51.134973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255584687098045:8779]
2025-10-01T14:10:51.134976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255584687098045:8779]
2025-10-01T14:10:51.135018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:51.135019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:51.135025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:51.135028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:51.135029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.135032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:51.135188Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:51.175952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255587063976844:10063]
2025-10-01T14:10:51.176155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1220, pipe: [1:7556255587063976844:10063]
2025-10-01T14:10:51.268094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:51.274766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.274788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.274920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.274969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.275024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.275071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.275113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.275124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.275181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.275231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.275283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.275336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.275457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.275463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.275521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.275571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.275622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.275674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.275712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.275717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.275773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.275827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.275879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.275933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.275972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.275977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.276058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.276126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.276178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.276229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.276266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.276274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.276328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.276378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.276431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.276484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.276522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.276527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.276580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.276630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.276684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.276749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.276787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.276792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.276850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.276902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.276953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.277004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.277041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.277047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.277100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.277150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.277205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.277258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.277295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.277300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.277357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:51.277407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:51.277457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:51.277507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:51.277546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:51.277551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:51.277587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063976844:10063], now have 1 active actors on pipe
2025-10-01T14:10:51.277789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:51.277789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255587063976844:10063]
2025-10-01T14:10:51.277797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:51.277803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:51.277817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1221 reason: error at write: Disconnected sessionId: src_id|54ef9766-2b772d59-740e8b12-f46c084c_0
2025-10-01T14:10:51.277982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1221 sessionId: src_id|54ef9766-2b772d59-740e8b12-f46c084c_0 is DEAD
2025-10-01T14:10:51.278074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ef9766-2b772d59-740e8b12-f46c084c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:51.278082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ef9766-2b772d59-740e8b12-f46c084c_0] Write session will restart in 0.008449s
2025-10-01T14:10:51.278101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ef9766-2b772d59-740e8b12-f46c084c_0] Write session: Do CDS request
2025-10-01T14:10:51.278105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ef9766-2b772d59-740e8b12-f46c084c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:51.278602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:51.287854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54ef9766-2b772d59-740e8b12-f46c084c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.287964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:51.287975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1222
2025-10-01T14:10:51.288055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.288078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:51.288086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:51.288088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:51.288433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1222 sessionId:  describe result for acl check
2025-10-01T14:10:51.288458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:51.288464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:51.288466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:51.288469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255587063976948:10172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:51.288847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255587063976948:10172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:51.291405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255587063976948:10172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:51.293861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255587063976948:10172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:51.293870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255587063976948:10172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:51.293874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255587063976948:10172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:51.293879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:51.295379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:51.298919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:51.299064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:51.299071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:51.299079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:51.299110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:51.299137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255584687098352:8781]
2025-10-01T14:10:51.299510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:51.299715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:51.299740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:51.299932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:51.299977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.299982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.299982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.299983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.299984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.299984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.299985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.299985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.299986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.299987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.299988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.299988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.299989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.299990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.299993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.299998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.300000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.300002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.300004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.300006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.300008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.300010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.300012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.300015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.300017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.300019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.300021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.300023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.300028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.300032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.300037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.300040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.300042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.300044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.300047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.300049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.300053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.300056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.300058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.300060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.300063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.300065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.300068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.300071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.300073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.300076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.300078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.300081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.300083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.300085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.300090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.300092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.300095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.300099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.300101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.300103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.300126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:51.303394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:51.304264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:51.304278Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:51.304279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:51.304281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:51.304286Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1221 [2:7556255584687098352:8781]
2025-10-01T14:10:51.304296Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:51.304308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:51.304313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.304315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.304316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.304327Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:51.304331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:51.304335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:51.304372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.304378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.304379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.304381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:51.304383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:51.304428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:51.304434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.304440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.304449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.304460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:51.304477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063977141:10172], now have 1 active actors on pipe
2025-10-01T14:10:51.304482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063976847:2446], now have 1 active actors on pipe
2025-10-01T14:10:51.304487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255584687098346:8781]
2025-10-01T14:10:51.304488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255584687098346:8781]
2025-10-01T14:10:51.304489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255584687098346:8781]
2025-10-01T14:10:51.304499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:51.304508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:51.304520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:51.304524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:51.304531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:51.304541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:51.304542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255584687098346:8781]
2025-10-01T14:10:51.304543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:51.304547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:51.304554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:51.304543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1221
2025-10-01T14:10:51.304572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1221
2025-10-01T14:10:51.304580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.304587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.304604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:51.304611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.304614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.304619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:51.304624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.304633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:51.304649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.304769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.304774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.304783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.304843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1222 partition: 0 MaxSeqNo: 45 sessionId: src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0
2025-10-01T14:10:51.305115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54ef9766-2b772d59-740e8b12-f46c084c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:51.307292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0] Write session: try to update token
2025-10-01T14:10:51.307307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:51.319454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1222 sessionId: src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:51.321578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:51.323340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.323367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.323387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:51.323391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:51.323393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:51.323396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:51.323403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255584687098346:8781]
2025-10-01T14:10:51.323412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255584687098346:8781]
2025-10-01T14:10:51.323416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255584687098346:8781]
2025-10-01T14:10:51.323478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:51.323482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:51.323488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.323490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:51.323491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:51.323495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:51.323623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:51.377686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255587063977163:10063]
2025-10-01T14:10:51.377906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1221, pipe: [1:7556255587063977163:10063]
2025-10-01T14:10:51.455568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:51.456132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:51.456176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063977163:10063], now have 1 active actors on pipe
2025-10-01T14:10:51.456233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:51.456320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255587063977163:10063]
2025-10-01T14:10:51.456342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:51.463832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:51.463842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:51.463859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1222 reason: error at write: Disconnected sessionId: src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0
2025-10-01T14:10:51.463988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1222 sessionId: src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0 is DEAD
2025-10-01T14:10:51.464092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:51.464101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0] Write session will restart in 0.009809s
2025-10-01T14:10:51.464117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0] Write session: Do CDS request
2025-10-01T14:10:51.464122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:51.473897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:51.474841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.474946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:51.474956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1223
2025-10-01T14:10:51.475060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.475083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:51.475098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:51.475103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:51.475437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1223 sessionId:  describe result for acl check
2025-10-01T14:10:51.475464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:51.475469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:51.475470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:51.475475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255587063977430:10177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:51.475853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255587063977430:10177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:51.477193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:51.477330Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:51.477337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:51.477344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:51.477374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:51.477401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255584687098654:8784]
2025-10-01T14:10:51.477768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:51.477785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255587063977430:10177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:51.477951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:51.477983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:51.478187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:51.478222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.478225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.478226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.478227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.478227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.478228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.478229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.478229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.478230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.478231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.478231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.478232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.478232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.478233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.478236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.478241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.478243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.478246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.478248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.478250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.478252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.478253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.478255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.478257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.478259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.478261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.478263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.478265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.478269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.478274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.478278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.478280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.478283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.478285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.478287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.478290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.478293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.478295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.478298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.478300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.478303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.478309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.478312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.478315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.478317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.478320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.478322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.478325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.478331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.478334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.478336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.478339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.478344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.478347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.478349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.478351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.478381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:51.481351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255587063977430:10177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:51.481361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255587063977430:10177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:51.481363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255587063977430:10177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:51.481370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:51.481619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:51.482269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:51.482281Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:51.482283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:51.482285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:51.482289Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1222 [2:7556255584687098654:8784]
2025-10-01T14:10:51.482300Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:51.482314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:51.482319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.482321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.482322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.482333Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:51.482336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:51.482340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:51.482391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.482396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.482397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.482399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:51.482401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:51.482447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:51.482454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.482461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.482467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.482475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:51.482490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063977468:10177], now have 1 active actors on pipe
2025-10-01T14:10:51.482497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063977166:2446], now have 1 active actors on pipe
2025-10-01T14:10:51.482502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255584687098649:8784]
2025-10-01T14:10:51.482504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255584687098649:8784]
2025-10-01T14:10:51.482505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255584687098649:8784]
2025-10-01T14:10:51.482514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:51.482523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:51.482526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:51.482528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:51.482529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:51.482531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:51.482533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:51.482528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1222
2025-10-01T14:10:51.482551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255584687098649:8784]
2025-10-01T14:10:51.482553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:51.482531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1222
2025-10-01T14:10:51.482554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:51.482567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.482573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.482610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|286a077-caf50ade-9a2680d6-96b5ff20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:51.482620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.482625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.482627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:51.482635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.482646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:51.482661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.482776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.482785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.482800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.482871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1223 partition: 0 MaxSeqNo: 45 sessionId: src_id|286a077-caf50ade-9a2680d6-96b5ff20_0
2025-10-01T14:10:51.483166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|569cb365-b5cd8d91-74d39488-61cdcc4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|286a077-caf50ade-9a2680d6-96b5ff20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:51.485628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|286a077-caf50ade-9a2680d6-96b5ff20_0] Write session: try to update token
2025-10-01T14:10:51.485644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|286a077-caf50ade-9a2680d6-96b5ff20_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:51.499369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1223 sessionId: src_id|286a077-caf50ade-9a2680d6-96b5ff20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:51.501416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:51.503006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.503029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.503047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:51.503050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:51.503051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:51.503052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:51.503059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255584687098649:8784]
2025-10-01T14:10:51.503062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255584687098649:8784]
2025-10-01T14:10:51.503065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255584687098649:8784]
2025-10-01T14:10:51.503103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:51.503116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:51.503117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:51.503120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.503121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:51.503122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:51.503245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:51.556398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255587063977497:10063]
2025-10-01T14:10:51.556652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1222, pipe: [1:7556255587063977497:10063]
2025-10-01T14:10:51.633934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:51.634127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:51.634179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063977497:10063], now have 1 active actors on pipe
2025-10-01T14:10:51.634230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:51.634316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255587063977497:10063]
2025-10-01T14:10:51.634321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:51.634323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:51.634339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:51.634392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1223 reason: error at write: Disconnected sessionId: src_id|286a077-caf50ade-9a2680d6-96b5ff20_0
2025-10-01T14:10:51.634546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1223 sessionId: src_id|286a077-caf50ade-9a2680d6-96b5ff20_0 is DEAD
2025-10-01T14:10:51.634692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a077-caf50ade-9a2680d6-96b5ff20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:51.634703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a077-caf50ade-9a2680d6-96b5ff20_0] Write session will restart in 0.007884s
2025-10-01T14:10:51.634740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a077-caf50ade-9a2680d6-96b5ff20_0] Write session: Do CDS request
2025-10-01T14:10:51.634750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a077-caf50ade-9a2680d6-96b5ff20_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:51.643788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|286a077-caf50ade-9a2680d6-96b5ff20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.643944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:51.643958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1224
2025-10-01T14:10:51.644098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.644129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:51.644138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:51.644141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:51.644499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1224 sessionId:  describe result for acl check
2025-10-01T14:10:51.644539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:51.644543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:51.644545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:51.644548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255587063977595:10188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:51.644919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255587063977595:10188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:51.647497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255587063977595:10188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:51.650100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255587063977595:10188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:51.650113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255587063977595:10188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:51.650116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255587063977595:10188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:51.650121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:51.651323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:51.654577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:51.654719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:51.654728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:51.654737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:51.654772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:51.654801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255584687098964:8788]
2025-10-01T14:10:51.655210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:51.655406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:51.655443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:51.655636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:51.655678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.655682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.655683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.655683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.655684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.655685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.655685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.655686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.655686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.655687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.655688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.655688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.655689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.655689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.655692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.655698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.655700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.655702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.655704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.655706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.655708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.655710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.655712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.655714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.655716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.655719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.655722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.655726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.655732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.655740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.655746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.655750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.655754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.655756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.655758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.655761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.655763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.655766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.655768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.655771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.655777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.655779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.655782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.655785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.655789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.655792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.655794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.655797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.655799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.655801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.655803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.655806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.655808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.655811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.655813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.655816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.655834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:51.659084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:51.659734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:51.659746Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:51.659747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:51.659750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:51.659754Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1223 [2:7556255584687098964:8788]
2025-10-01T14:10:51.659762Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:51.659778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:51.659783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.659785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.659786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.659797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:51.659803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:51.659807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:51.659853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.659859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.659860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.659862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:51.659864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:51.659917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:51.659923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.659932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.659937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.659945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:51.659959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063977499:2446], now have 1 active actors on pipe
2025-10-01T14:10:51.659965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063977796:10188], now have 1 active actors on pipe
2025-10-01T14:10:51.659970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255584687098959:8788]
2025-10-01T14:10:51.659972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255584687098959:8788]
2025-10-01T14:10:51.659973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255584687098959:8788]
2025-10-01T14:10:51.659984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:51.659996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:51.660001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:51.660003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:51.660005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:51.660007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:51.660009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:51.660005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1223
2025-10-01T14:10:51.660026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255584687098959:8788]
2025-10-01T14:10:51.660033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:51.660035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:51.660015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1223
2025-10-01T14:10:51.660057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.660062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.660085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:51.660093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.660096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.660097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:51.660102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.660109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:51.660123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.660250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.660255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.660264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.660336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1224 partition: 0 MaxSeqNo: 45 sessionId: src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0
2025-10-01T14:10:51.660666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a077-caf50ade-9a2680d6-96b5ff20_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:51.662854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0] Write session: try to update token
2025-10-01T14:10:51.662868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:51.675684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1224 sessionId: src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:51.678177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:51.679615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.679641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.679661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:51.679664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:51.679666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:51.679668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:51.679676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255584687098959:8788]
2025-10-01T14:10:51.679681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255584687098959:8788]
2025-10-01T14:10:51.679684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255584687098959:8788]
2025-10-01T14:10:51.679719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:51.679729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:51.679732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:51.679736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:51.679742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.679749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:51.679903Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:51.734562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255587063977810:10063]
2025-10-01T14:10:51.734767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1223, pipe: [1:7556255587063977810:10063]
2025-10-01T14:10:51.819916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:51.820124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:51.820178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063977810:10063], now have 1 active actors on pipe
2025-10-01T14:10:51.820261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:51.820344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:51.820440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255587063977810:10063]
2025-10-01T14:10:51.830422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:51.830433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:51.830455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1224 reason: error at write: Disconnected sessionId: src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0
2025-10-01T14:10:51.830563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1224 sessionId: src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0 is DEAD
2025-10-01T14:10:51.830651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:51.830659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0] Write session will restart in 0.007454s
2025-10-01T14:10:51.830681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0] Write session: Do CDS request
2025-10-01T14:10:51.830690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:51.838835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.839225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:51.839236Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1225
2025-10-01T14:10:51.839324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:51.839348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:51.839355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:51.839358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:51.839672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1225 sessionId:  describe result for acl check
2025-10-01T14:10:51.839700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:51.839705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:51.839708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:51.839712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255587063977996:10193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:51.840103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255587063977996:10193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:51.842138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255587063977996:10193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:51.843819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:51.847484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:51.847542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255587063977996:10193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:51.847555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255587063977996:10193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:51.847557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255587063977996:10193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:51.847563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:51.847963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:51.847976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:51.847987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:51.848034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:51.848061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255584687099308:8801]
2025-10-01T14:10:51.848462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:51.848737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:51.848765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:51.848958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:51.848994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.848998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.848999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.849000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.849000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.849001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.849002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.849002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.849003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.849004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.849004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.849005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.849006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.849006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.849009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.849016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.849018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.849020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.849022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.849024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.849027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.849029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.849031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.849034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.849037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.849039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.849041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.849043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.849048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.849052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:51.849056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.849059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:51.849062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.849065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:51.849068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.849071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:51.849074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.849077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:51.849079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.849082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:51.849085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.849088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:51.849090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.849093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:51.849098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.849101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:51.849104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.849106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.849109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.849111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.849113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.849116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.849118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.849121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:51.849123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.849126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:51.849145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:51.852850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:51.853446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:51.853459Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:51.853461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:51.853464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:51.853470Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1224 [2:7556255584687099308:8801]
2025-10-01T14:10:51.853486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:51.853501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:51.853508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.853510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.853511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.853522Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:51.853526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:51.853531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:51.853580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.853587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.853589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.853592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:51.853594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:51.853653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:51.853660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.853669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:51.853678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:51.853695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:51.853716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063978115:10193], now have 1 active actors on pipe
2025-10-01T14:10:51.853724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063977815:2446], now have 1 active actors on pipe
2025-10-01T14:10:51.853731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255584687099302:8801]
2025-10-01T14:10:51.853733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255584687099302:8801]
2025-10-01T14:10:51.853735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255584687099302:8801]
2025-10-01T14:10:51.853743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:51.853753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:51.853757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:51.853759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:51.853760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:51.853740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1224
2025-10-01T14:10:51.853772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:51.853766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1224
2025-10-01T14:10:51.853778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:51.853793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.853801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.853831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255584687099302:8801]
2025-10-01T14:10:51.853837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:51.853846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:51.853846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:51.853856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:51.853859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:51.853862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:51.853870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:51.853878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:51.853916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.854052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.854058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.854069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:51.854124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1225 partition: 0 MaxSeqNo: 45 sessionId: src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0
2025-10-01T14:10:51.854464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81c7f9b2-37b579e8-8a1f2a8d-7e1be066_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:51.856698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0] Write session: try to update token
2025-10-01T14:10:51.856721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:51.869068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1225 sessionId: src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:51.869182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:51.869197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:51.869206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255584687099302:8801]
2025-10-01T14:10:51.869235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:51.869242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:51.869392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:51.869535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:51.869673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:51.869802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:51.869971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:51.870010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:51.871195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:51.871328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:51.871338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:51.871361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:51.871427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:51.884941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:51.884957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:51.884959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:51.884961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:51.884970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255584687099302:8801]
2025-10-01T14:10:51.884972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255584687099302:8801]
2025-10-01T14:10:51.884975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255584687099302:8801]
2025-10-01T14:10:51.885010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:51.885015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:51.885017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:51.885021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:51.885026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:51.885030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:51.885129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:51.920418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255587063978138:10063]
2025-10-01T14:10:51.920716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1224, pipe: [1:7556255587063978138:10063]
2025-10-01T14:10:52.017138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:52.024418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.024448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.024614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.024680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.024754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.024817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.024866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.024876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.024943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.024995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.025068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.025121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.025161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.025166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.025220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.025277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.025332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.025381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.025419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.025424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.025484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.025545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.025597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.025648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.025690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.025696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.025750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.025803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.025854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.025904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.025941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.025949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.026012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.026062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.026111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.026167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.026211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.026218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.026277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.026358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.026426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.026478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.026516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.026521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.026578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.026629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.026682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.026739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.026779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.026786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.026840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.026893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.026945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.027000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.027056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.027061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.027113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.027161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.027213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.027268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.027308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.027313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.027352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255587063978138:10063], now have 1 active actors on pipe
2025-10-01T14:10:52.027627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:52.027630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255587063978138:10063]
2025-10-01T14:10:52.027638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:52.027660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1225 reason: error at write: Disconnected sessionId: src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0
2025-10-01T14:10:52.027677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:52.027825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1225 sessionId: src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0 is DEAD
2025-10-01T14:10:52.027966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:52.027976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0] Write session will restart in 0.006319s
2025-10-01T14:10:52.028000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0] Write session: Do CDS request
2025-10-01T14:10:52.028006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:52.028243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:52.035847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.035949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:52.035960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1226
2025-10-01T14:10:52.036056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.036077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:52.036083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:52.036085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:52.036537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1226 sessionId:  describe result for acl check
2025-10-01T14:10:52.036565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:52.036566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:52.036568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:52.036571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255591358945486:10198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:52.036982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255591358945486:10198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:52.039919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255591358945486:10198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:52.043435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255591358945486:10198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:52.043448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255591358945486:10198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:52.043451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255591358945486:10198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:52.043459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:52.047701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:52.051824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:52.052185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:52.052194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:52.052201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:52.052231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:52.052257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255588982066919:8804]
2025-10-01T14:10:52.052647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:52.052856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:52.052886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:52.053084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:52.053120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.053124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.053125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.053125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.053126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.053127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.053127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.053128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.053128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.053129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.053130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.053130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.053131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.053132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.053135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.053140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.053143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.053145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.053147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.053149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.053151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.053153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.053155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.053157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.053159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.053161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.053163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.053165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.053169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.053174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.053177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.053180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.053182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.053185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.053188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.053191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.053193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.053195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.053198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.053200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.053203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.053206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.053208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.053210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.053213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.053215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.053217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.053220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.053223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.053225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.053230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.053232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.053234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.053237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.053239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.053242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.053262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:52.056476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:52.057039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:52.057055Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:52.057057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:52.057059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:52.057065Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1225 [2:7556255588982066919:8804]
2025-10-01T14:10:52.057077Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:52.057090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:52.057093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.057096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.057099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.057111Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:52.057121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:52.057126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:52.057170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.057177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.057179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.057182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:52.057185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:52.057242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:52.057249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.057259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.057270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.057289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:52.057308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945666:10198], now have 1 active actors on pipe
2025-10-01T14:10:52.057313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945437:2446], now have 1 active actors on pipe
2025-10-01T14:10:52.057319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255588982066905:8804]
2025-10-01T14:10:52.057322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255588982066905:8804]
2025-10-01T14:10:52.057324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255588982066905:8804]
2025-10-01T14:10:52.057334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:52.057345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:52.057346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:52.057348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:52.057349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:52.057354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:52.057355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:52.057370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255588982066905:8804]
2025-10-01T14:10:52.057373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:52.057375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:52.057366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1225
2025-10-01T14:10:52.057391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.057398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.057376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1225
2025-10-01T14:10:52.057422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6887929c-cc2525f-5c4c5e92-79e03962_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:52.057429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.057432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.057434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:52.057439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.057446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:52.057460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.057558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.057566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.057579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.057666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1226 partition: 0 MaxSeqNo: 45 sessionId: src_id|6887929c-cc2525f-5c4c5e92-79e03962_0
2025-10-01T14:10:52.058005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f4abed3-a46e26ff-ea0804b3-d0892ed_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6887929c-cc2525f-5c4c5e92-79e03962_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:52.060278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6887929c-cc2525f-5c4c5e92-79e03962_0] Write session: try to update token
2025-10-01T14:10:52.060291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6887929c-cc2525f-5c4c5e92-79e03962_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:52.072406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1226 sessionId: src_id|6887929c-cc2525f-5c4c5e92-79e03962_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:52.074494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:52.076050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.076072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.076090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:52.076094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.076095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:52.076096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:52.076102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255588982066905:8804]
2025-10-01T14:10:52.076104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255588982066905:8804]
2025-10-01T14:10:52.076107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255588982066905:8804]
2025-10-01T14:10:52.076135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:52.076144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:52.076147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:52.076155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:52.076166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.076168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:52.076273Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:52.127776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255591358945756:10063]
2025-10-01T14:10:52.128030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1225, pipe: [1:7556255591358945756:10063]
2025-10-01T14:10:52.209784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:52.210196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:52.210254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945756:10063], now have 1 active actors on pipe
2025-10-01T14:10:52.210321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:52.210449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:52.210520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255591358945756:10063]
2025-10-01T14:10:52.216078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:52.217207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:52.217384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:52.217396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:52.217407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:52.217459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:52.217497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255588982066976:8806]
2025-10-01T14:10:52.217972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:52.217980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:52.217994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1226 reason: error at write: Disconnected sessionId: src_id|6887929c-cc2525f-5c4c5e92-79e03962_0
2025-10-01T14:10:52.218050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:52.218122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1226 sessionId: src_id|6887929c-cc2525f-5c4c5e92-79e03962_0 is DEAD
2025-10-01T14:10:52.218269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6887929c-cc2525f-5c4c5e92-79e03962_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:52.218275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6887929c-cc2525f-5c4c5e92-79e03962_0] Write session will restart in 0.009257s
2025-10-01T14:10:52.218294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6887929c-cc2525f-5c4c5e92-79e03962_0] Write session: Do CDS request
2025-10-01T14:10:52.218298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6887929c-cc2525f-5c4c5e92-79e03962_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:52.220816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:52.220877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:52.221192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:52.221270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.221277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.221279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.221280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.221281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.221282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.221283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.221285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.221286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.221289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.221290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.221291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.221292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.221293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.221299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.221309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.221313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.221317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.221320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.221324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.221328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.221332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.221335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.221340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.221348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.221352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.221356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.221360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.221371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.221384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.221394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.221404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.221408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.221413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.221416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.221420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.221429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.221438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.221447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.221456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.221462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.221470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.221475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.221484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.221492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.221501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.221507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.221511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.221520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.221525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.221533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.221538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.221546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.221554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.221562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.221568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.221613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:52.224877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:52.225452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:52.225472Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:52.225474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:52.225477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:52.225483Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1226 [2:7556255588982066976:8806]
2025-10-01T14:10:52.225497Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:52.225517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:52.225524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.225527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.225529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.225544Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:52.225553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:52.225560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:52.225616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.225623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.225625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.225628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:52.225630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:52.225690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:52.225698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.225710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.225721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.225741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:52.225762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945758:2446], now have 1 active actors on pipe
2025-10-01T14:10:52.225774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255588982066971:8806]
2025-10-01T14:10:52.225781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255588982066971:8806]
2025-10-01T14:10:52.225783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255588982066971:8806]
2025-10-01T14:10:52.225758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1226
2025-10-01T14:10:52.225792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:52.225811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:52.225811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:52.225813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:52.225814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:52.225829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:52.225836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:52.225864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255588982066971:8806]
2025-10-01T14:10:52.225876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:52.225885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:52.228844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6887929c-cc2525f-5c4c5e92-79e03962_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.228884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:52.228893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1227
2025-10-01T14:10:52.229022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.229043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:52.229047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:52.229049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:52.229345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1227 sessionId:  describe result for acl check
2025-10-01T14:10:52.229372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:52.229376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:52.229379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:52.229382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255591358945787:10204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:52.229782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255591358945787:10204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:52.231376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255591358945787:10204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:52.234621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255591358945787:10204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:52.234631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255591358945787:10204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:52.234634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255591358945787:10204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:52.234640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:52.234859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1226
2025-10-01T14:10:52.235574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945823:10204], now have 1 active actors on pipe
2025-10-01T14:10:52.235604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.235611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.235628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:52.235632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.235641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255588982066971:8806]
2025-10-01T14:10:52.235673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:52.235689Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:52.235699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.235706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.235708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:52.235718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.235737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:52.235755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:52.235905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:52.236039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.236168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.236295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.236470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:52.236514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.236537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:52.236650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.236659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.236677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.236742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1227 partition: 0 MaxSeqNo: 45 sessionId: src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0
2025-10-01T14:10:52.237004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6887929c-cc2525f-5c4c5e92-79e03962_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:52.239270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0] Write session: try to update token
2025-10-01T14:10:52.239283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:52.251858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1227 sessionId: src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:52.253610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:52.253634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.253636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:52.253638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:52.253650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255588982066971:8806]
2025-10-01T14:10:52.253654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255588982066971:8806]
2025-10-01T14:10:52.253658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255588982066971:8806]
2025-10-01T14:10:52.253705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:52.253710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:52.253720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:52.253720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.253723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:52.253723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:52.253851Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:52.254163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:52.310543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255591358945829:10063]
2025-10-01T14:10:52.310769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1226, pipe: [1:7556255591358945829:10063]
2025-10-01T14:10:52.407649Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:52.408139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.408156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.408178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945829:10063], now have 1 active actors on pipe
2025-10-01T14:10:52.408366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:52.408376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:52.408380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:52.408407Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:52.408429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255591358945829:10063]
2025-10-01T14:10:52.408433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1227 reason: error at write: Disconnected sessionId: src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0
2025-10-01T14:10:52.408592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1227 sessionId: src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0 is DEAD
2025-10-01T14:10:52.408698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:52.408715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0] Write session will restart in 0.007407s
2025-10-01T14:10:52.408736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0] Write session: Do CDS request
2025-10-01T14:10:52.408741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:52.414875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:52.416232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:52.416370Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:52.416377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:52.416385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:52.416415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:52.416444Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255588982067034:8808]
2025-10-01T14:10:52.416823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.416839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:52.416893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:52.416905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1228
2025-10-01T14:10:52.417015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.417042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:52.417050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:52.417056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:52.417062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:52.417096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:52.417279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:52.417313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.417318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.417318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.417319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.417320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.417321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.417321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.417322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.417323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.417324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.417324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.417325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.417326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.417326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.417329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.417335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.417337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.417340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.417379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1228 sessionId:  describe result for acl check
2025-10-01T14:10:52.417342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.417344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.417346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.417348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.417350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.417352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.417354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.417356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.417360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.417406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:52.417411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:52.417412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:52.417416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255591358945859:10209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:52.417362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.417367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.417371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.417374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.417378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.417380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.417382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.417385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.417387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.417391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.417394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.417396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.417399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.417401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.417404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.417406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.417409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.417412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.417414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.417416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.417419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.417421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.417424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.417426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.417429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.417431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.417433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.417435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.417438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.417457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:52.417804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255591358945859:10209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:52.419687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255591358945859:10209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:52.420752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:52.421297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:52.421313Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:52.421315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:52.421318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:52.421325Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1227 [2:7556255588982067034:8808]
2025-10-01T14:10:52.421338Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:52.421352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:52.421359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.421363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.421364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.421375Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:52.421378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:52.421382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:52.421417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.421422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.421423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.421426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:52.421427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:52.421472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:52.421477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.421484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.421489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.421497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:52.421510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945837:2446], now have 1 active actors on pipe
2025-10-01T14:10:52.421517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255588982067029:8808]
2025-10-01T14:10:52.421520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255588982067029:8808]
2025-10-01T14:10:52.421522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255588982067029:8808]
2025-10-01T14:10:52.421530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:52.421543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:52.421547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:52.421549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:52.421551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:52.421542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1227
2025-10-01T14:10:52.421554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:52.421556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:52.421574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255588982067029:8808]
2025-10-01T14:10:52.421582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:52.421588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:52.421723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255591358945859:10209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:52.421734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255591358945859:10209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:52.421739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255591358945859:10209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:52.421749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:52.421927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945898:10209], now have 1 active actors on pipe
2025-10-01T14:10:52.421957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1227
2025-10-01T14:10:52.422005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.422014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.422035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:52.422043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.422047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.422049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:52.422057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.422072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:52.422087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.422196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.422203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.422216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.422295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1228 partition: 0 MaxSeqNo: 45 sessionId: src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0
2025-10-01T14:10:52.422661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52237b1f-358b3091-1d9abf3c-b7ab3b94_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:52.424864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0] Write session: try to update token
2025-10-01T14:10:52.424880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:52.437761Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1228 sessionId: src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:52.440292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:52.440909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.440939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.440960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:52.440964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.440967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:52.440969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:52.440976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255588982067029:8808]
2025-10-01T14:10:52.440984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255588982067029:8808]
2025-10-01T14:10:52.440987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255588982067029:8808]
2025-10-01T14:10:52.441032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:52.441042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:52.441046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:52.441048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.441049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:52.441050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:52.441179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:52.508695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255591358945904:10063]
2025-10-01T14:10:52.509087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1227, pipe: [1:7556255591358945904:10063]
2025-10-01T14:10:52.579403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:52.579696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:52.579761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945904:10063], now have 1 active actors on pipe
2025-10-01T14:10:52.579824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:52.579952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255591358945904:10063]
2025-10-01T14:10:52.579984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:52.585320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:52.586394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:52.586561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:52.586572Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:52.586583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:52.586632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:52.586672Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255588982067102:8813]
2025-10-01T14:10:52.587193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:52.587428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:52.587468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:52.587732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:52.587790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.587796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.587797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.587798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.587799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.587801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.587802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.587803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.587804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.587805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.587806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.587807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.587808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.587809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.587814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.587823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.587827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.587831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.587834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.587837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.587841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.587844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.587850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.587858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.587861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.587864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.587868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.587873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.587880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.587891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.587900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.587905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.587912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.587915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.587917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.587919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.587923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.587926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.587929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.587932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.587934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.587937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.587939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.587942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.587944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.587947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.587949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.587952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.587955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.587958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.587959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.587962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.587964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.587968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.587971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.587973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.587993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:52.588386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:52.588395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:52.588410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1228 reason: error at write: Disconnected sessionId: src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0
2025-10-01T14:10:52.588538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1228 sessionId: src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0 is DEAD
2025-10-01T14:10:52.588677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:52.588685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0] Write session will restart in 0.008239s
2025-10-01T14:10:52.588737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0] Write session: Do CDS request
2025-10-01T14:10:52.588741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:52.591721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:52.592228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:52.592237Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:52.592238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:52.592244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:52.592248Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1228 [2:7556255588982067102:8813]
2025-10-01T14:10:52.592258Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:52.592274Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:52.592279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.592281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.592282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.592293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:52.592299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:52.592303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:52.592339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.592344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.592345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.592347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:52.592349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:52.592391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:52.592396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.592402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.592408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.592418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:52.592430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945930:2446], now have 1 active actors on pipe
2025-10-01T14:10:52.592440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255588982067097:8813]
2025-10-01T14:10:52.592441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255588982067097:8813]
2025-10-01T14:10:52.592442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255588982067097:8813]
2025-10-01T14:10:52.592450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:52.592460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1228
2025-10-01T14:10:52.592460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:52.592461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:52.592465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:52.592466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:52.592471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:52.592473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:52.592495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255588982067097:8813]
2025-10-01T14:10:52.592497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:52.592498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:52.597904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.597938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:52.597949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1229
2025-10-01T14:10:52.598105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.598131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:52.598137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:52.598141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:52.598513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1229 sessionId:  describe result for acl check
2025-10-01T14:10:52.598540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:52.598541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:52.598542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:52.598546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255591358945960:10220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:52.598952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255591358945960:10220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:52.600937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255591358945960:10220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:52.602213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:52.602224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.602231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255588982067097:8813]
2025-10-01T14:10:52.602261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:52.602263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:52.602418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:52.602547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.602664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.602783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.602950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:52.602981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:52.606215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255591358945960:10220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:52.606229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255591358945960:10220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:52.606235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255591358945960:10220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:52.606304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:52.606555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945993:10220], now have 1 active actors on pipe
2025-10-01T14:10:52.606618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1228
2025-10-01T14:10:52.606672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.606681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.606702Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:52.606712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.606722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.606727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:52.606744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.606760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:52.606776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.606922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.606930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.606943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.607006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1229 partition: 0 MaxSeqNo: 45 sessionId: src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0
2025-10-01T14:10:52.607354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6a08fea-c25bf8c1-21ba3d3a-b9966b1a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:52.609607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0] Write session: try to update token
2025-10-01T14:10:52.609622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:52.620269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:52.620289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.620292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:52.620293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:52.620304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255588982067097:8813]
2025-10-01T14:10:52.620309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255588982067097:8813]
2025-10-01T14:10:52.620313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255588982067097:8813]
2025-10-01T14:10:52.620360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:52.620364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:52.620369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:52.620369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.620372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:52.620373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:52.620489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:52.622545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1229 sessionId: src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:52.624724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:52.680213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255591358945995:10063]
2025-10-01T14:10:52.680435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1228, pipe: [1:7556255591358945995:10063]
2025-10-01T14:10:52.751850Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:52.752126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.752138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.752156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945995:10063], now have 1 active actors on pipe
2025-10-01T14:10:52.752377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255591358945995:10063]
2025-10-01T14:10:52.752399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:52.752398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:52.752403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:52.752461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1229 reason: error at write: Disconnected sessionId: src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0
2025-10-01T14:10:52.752511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:52.752677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1229 sessionId: src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0 is DEAD
2025-10-01T14:10:52.752808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:52.752817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0] Write session will restart in 0.007149s
2025-10-01T14:10:52.752837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0] Write session: Do CDS request
2025-10-01T14:10:52.752841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:52.757831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:52.759152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:52.759294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:52.759301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:52.759308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:52.759336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:52.759364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255588982067188:8822]
2025-10-01T14:10:52.759728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:52.759897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:52.759920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:52.760101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:52.760135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.760140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.760141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.760142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.760143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.760144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.760145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.760146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.760148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.760149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.760150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.760151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.760152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.760153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.760157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.760165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.760169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.760172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.760175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.760178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.760181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.760184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.760187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.760193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.760196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.760199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.760202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.760205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.760212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.760217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.760221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.760224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.760226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.760229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.760232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.760234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.760236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.760240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.760242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.760246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.760248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.760251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.760254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.760256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.760258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.760261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.760263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.760265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.760267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.760270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.760272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.760274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.760276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.760279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.760281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.760284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.760303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:52.760854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.760909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:52.760920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1230
2025-10-01T14:10:52.761038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.761072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:52.761078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:52.761081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:52.761347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1230 sessionId:  describe result for acl check
2025-10-01T14:10:52.761366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:52.761371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:52.761372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:52.761375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255591358946027:10225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:52.761752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255591358946027:10225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:52.762848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255591358946027:10225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:52.763569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:52.764092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:52.764101Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:52.764102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:52.764105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:52.764109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1229 [2:7556255588982067188:8822]
2025-10-01T14:10:52.764118Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:52.764129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:52.764131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.764133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.764134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.764145Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:52.764148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:52.764152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:52.764183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.764188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.764189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.764191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:52.764193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:52.764242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:52.764248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.764258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.764268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.764282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:52.764311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255588982067183:8822]
2025-10-01T14:10:52.764316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255588982067183:8822]
2025-10-01T14:10:52.764320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255588982067183:8822]
2025-10-01T14:10:52.764330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:52.764322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1229
2025-10-01T14:10:52.764340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:52.764341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358945999:2446], now have 1 active actors on pipe
2025-10-01T14:10:52.764347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:52.764349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:52.764349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:52.764360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:52.764362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:52.764389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255588982067183:8822]
2025-10-01T14:10:52.764398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:52.764410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:52.764652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255591358946027:10225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:52.764665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255591358946027:10225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:52.764668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255591358946027:10225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:52.764674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:52.764815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358946062:10225], now have 1 active actors on pipe
2025-10-01T14:10:52.764841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1229
2025-10-01T14:10:52.764879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.764887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.764907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abe899be-a36dbfb4-c051d713-929fabeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:52.764917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.764920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.764922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:52.764929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.764939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:52.764951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.765111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.765117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.765128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.765190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1230 partition: 0 MaxSeqNo: 45 sessionId: src_id|abe899be-a36dbfb4-c051d713-929fabeb_0
2025-10-01T14:10:52.765462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|238fa60b-9356bdf6-27fa167d-ad9753fc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|abe899be-a36dbfb4-c051d713-929fabeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:52.767854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe899be-a36dbfb4-c051d713-929fabeb_0] Write session: try to update token
2025-10-01T14:10:52.767868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe899be-a36dbfb4-c051d713-929fabeb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:52.774525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:52.774535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.774543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255588982067183:8822]
2025-10-01T14:10:52.774578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:52.774590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:52.774719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:52.774846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.774977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.775100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.775267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:52.775308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:52.780344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1230 sessionId: src_id|abe899be-a36dbfb4-c051d713-929fabeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:52.782713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:52.782927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.782944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.782975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:52.783053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:52.792527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:52.792542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.792543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:52.792545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:52.792553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255588982067183:8822]
2025-10-01T14:10:52.792556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255588982067183:8822]
2025-10-01T14:10:52.792558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255588982067183:8822]
2025-10-01T14:10:52.792589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:52.792593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:52.792593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:52.792596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:52.792598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.792603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:52.792730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:52.852797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255591358946068:10063]
2025-10-01T14:10:52.853026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1229, pipe: [1:7556255591358946068:10063]
2025-10-01T14:10:52.924144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:52.930640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.930658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.930787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.930839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.930891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.930941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.930980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.930987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.931044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.931096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.931145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.931196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.931237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.931243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.931303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.931356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.931408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.931465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.931503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.931509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.931566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.931621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.931674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.931727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.931766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.931771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.931825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.931876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.931928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.931981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.932019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.932024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.932079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.932131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.932187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.932240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.932278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.932283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.932341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.932401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.932455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.932506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.932544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.932549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.932608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.932658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.932722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.932776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.932813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.932819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.932873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.932927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.932980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.933037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.933076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.933081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.933135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:52.933186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:52.933241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:52.933294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:52.933332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:52.933337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:52.933376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358946068:10063], now have 1 active actors on pipe
2025-10-01T14:10:52.933568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255591358946068:10063]
2025-10-01T14:10:52.933595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:52.933595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:52.933597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:52.933625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1230 reason: error at write: Disconnected sessionId: src_id|abe899be-a36dbfb4-c051d713-929fabeb_0
2025-10-01T14:10:52.933816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1230 sessionId: src_id|abe899be-a36dbfb4-c051d713-929fabeb_0 is DEAD
2025-10-01T14:10:52.933956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe899be-a36dbfb4-c051d713-929fabeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:52.933969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe899be-a36dbfb4-c051d713-929fabeb_0] Write session will restart in 0.007245s
2025-10-01T14:10:52.933997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe899be-a36dbfb4-c051d713-929fabeb_0] Write session: Do CDS request
2025-10-01T14:10:52.934004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe899be-a36dbfb4-c051d713-929fabeb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:52.934147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:52.939399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:52.940506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:52.940626Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:52.940636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:52.940648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:52.940693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:52.940737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255588982067268:8829]
2025-10-01T14:10:52.941162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:52.941388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:52.941416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:52.941609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:52.941642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.941646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.941648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.941649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.941649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.941650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.941650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.941651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.941652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.941652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.941653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.941655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.941655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.941656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.941659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.941664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.941667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.941669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.941670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.941673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.941674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.941676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.941678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.941681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.941682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.941684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.941686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.941688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.941693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.941697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:52.941701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.941704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:52.941706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.941709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:52.941711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.941714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:52.941716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.941723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:52.941725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.941728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:52.941732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.941737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:52.941740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.941742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:52.941748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.941750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:52.941753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.941755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.941757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.941760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.941765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.941768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.941772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.941780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:52.941791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.941798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:52.941817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:52.942858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abe899be-a36dbfb4-c051d713-929fabeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.942873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:52.942886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1231
2025-10-01T14:10:52.943051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:52.943079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:52.943084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:52.943087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:52.943459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1231 sessionId:  describe result for acl check
2025-10-01T14:10:52.943496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:52.943502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:52.943504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:52.943508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255591358946110:10230] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:52.944026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255591358946110:10230] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:52.945214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:52.945594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255591358946110:10230] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:52.945830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:52.945841Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:52.945842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:52.945844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:52.945849Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1230 [2:7556255588982067268:8829]
2025-10-01T14:10:52.945860Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:52.945871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:52.945872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.945874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.945876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.945887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:52.945890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:52.945894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:52.945929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.945934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.945936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.945938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:52.945939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:52.945982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:52.945987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.945993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:52.945999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:52.946007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:52.946020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255588982067263:8829]
2025-10-01T14:10:52.946023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255588982067263:8829]
2025-10-01T14:10:52.946024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255588982067263:8829]
2025-10-01T14:10:52.946029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:52.946038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:52.946039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358946082:2446], now have 1 active actors on pipe
2025-10-01T14:10:52.946045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:52.946046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:52.946048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:52.946052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:52.946054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:52.946071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255588982067263:8829]
2025-10-01T14:10:52.946077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:52.946091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:52.946087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1230
2025-10-01T14:10:52.950258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255591358946110:10230] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:52.950273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255591358946110:10230] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:52.950276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255591358946110:10230] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:52.950283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:52.950524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255591358946149:10230], now have 1 active actors on pipe
2025-10-01T14:10:52.950554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1230
2025-10-01T14:10:52.950632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.950647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.950674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:52.950688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:52.950698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:52.950701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:52.950713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:52.950731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:52.950751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.950921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.950930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.950945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:52.951039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1231 partition: 0 MaxSeqNo: 45 sessionId: src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0
2025-10-01T14:10:52.951360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abe899be-a36dbfb4-c051d713-929fabeb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:52.953784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0] Write session: try to update token
2025-10-01T14:10:52.953801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:52.955863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:52.955881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.955889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255588982067263:8829]
2025-10-01T14:10:52.955928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:52.955932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:52.956093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:52.956232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.956365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.956493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:52.956679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:52.956736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:52.966715Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1231 sessionId: src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:52.969025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:52.969211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:52.969233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:52.969269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:52.969347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:52.973991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:52.974009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:52.974011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:52.974013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:52.974023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255588982067263:8829]
2025-10-01T14:10:52.974027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255588982067263:8829]
2025-10-01T14:10:52.974031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255588982067263:8829]
2025-10-01T14:10:52.974076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:52.974085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:52.974087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:52.974091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:52.974091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:52.974094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:52.974222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:53.034019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255595653913448:10063]
2025-10-01T14:10:53.034282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1230, pipe: [1:7556255595653913448:10063]
2025-10-01T14:10:53.109545Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:53.117001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.117027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.117196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.117252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.117320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.117379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.117421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.117432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.117502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.117558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.117614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.117677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.117808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.117816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.117887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.117948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.118012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.118079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.118126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.118133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.118203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.118259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.118319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.118397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.118439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.118445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.118513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.118573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.118634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.118694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.118786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.118795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.118857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.118913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.118975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.119039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.119083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.119090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.119151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.119206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.119265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.119324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.119363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.119372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.119434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.119492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.119553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.119684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.119730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.119738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.119807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.119865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.119929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.119993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.120036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.120042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.120106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:53.120166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:53.120226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:53.120291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:53.120334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:53.120341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:53.120405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913448:10063], now have 1 active actors on pipe
2025-10-01T14:10:53.120615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:53.120635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255595653913448:10063]
2025-10-01T14:10:53.120662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:53.120664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:53.120690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1231 reason: error at write: Disconnected sessionId: src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0
2025-10-01T14:10:53.120898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1231 sessionId: src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0 is DEAD
2025-10-01T14:10:53.121061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:53.121071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0] Write session will restart in 0.005047s
2025-10-01T14:10:53.121103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0] Write session: Do CDS request
2025-10-01T14:10:53.121109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:53.121461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:53.126873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.127005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:53.127014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1232
2025-10-01T14:10:53.127121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.127151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:53.127156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:53.127160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:53.127505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1232 sessionId:  describe result for acl check
2025-10-01T14:10:53.127538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:53.127544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:53.127546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:53.127551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255595653913474:10234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:53.127621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:53.128071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255595653913474:10234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:53.128937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:53.129140Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:53.129149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:53.129159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:53.129201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:53.129239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255593277034626:8831]
2025-10-01T14:10:53.129834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:53.130087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:53.130130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:53.130275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255595653913474:10234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:53.130444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:53.130493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.130498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.130499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.130500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.130501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.130503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.130504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.130505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.130506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.130507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.130508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.130510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.130511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.130512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.130517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.130525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.130530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.130533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.130537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.130542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.130546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.130549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.130553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.130556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.130560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.130563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.130566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.130570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.130575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.130582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.130588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.130593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.130597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.130601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.130605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.130610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.130614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.130619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.130623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.130628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.130633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.130637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.130641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.130646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.130651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.130655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.130660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.130669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.130673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.130677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.130681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.130686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.130690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.130694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.130702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.130706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.130744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:53.133927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255595653913474:10234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:53.133940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255595653913474:10234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:53.133943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255595653913474:10234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:53.133951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:53.134140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:53.134723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:53.134735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:53.134737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:53.134740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:53.134747Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1231 [2:7556255593277034626:8831]
2025-10-01T14:10:53.134762Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:53.134777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:53.134781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.134785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.134787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.134802Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:53.134812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:53.134818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:53.134869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.134875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.134879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.134882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:53.134884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:53.134940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:53.134946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.134956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.134970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.134990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:53.135012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913514:10234], now have 1 active actors on pipe
2025-10-01T14:10:53.135018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913451:2446], now have 1 active actors on pipe
2025-10-01T14:10:53.135025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255593277034621:8831]
2025-10-01T14:10:53.135028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255593277034621:8831]
2025-10-01T14:10:53.135030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255593277034621:8831]
2025-10-01T14:10:53.135043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:53.135059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:53.135063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:53.135066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:53.135067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:53.135076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:53.135079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:53.135078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1231
2025-10-01T14:10:53.135099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255593277034621:8831]
2025-10-01T14:10:53.135083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1231
2025-10-01T14:10:53.135105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:53.135122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:53.135132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.135140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.135167Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:53.135181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.135188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.135191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:53.135198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.135205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:53.135218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.135361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.135370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.135383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.135461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1232 partition: 0 MaxSeqNo: 45 sessionId: src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0
2025-10-01T14:10:53.135822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2acbf53a-393edd4f-6609e2bf-89a7d9bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:53.138206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0] Write session: try to update token
2025-10-01T14:10:53.138223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:53.151622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1232 sessionId: src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:53.153965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:53.154471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.154491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.154516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:53.154519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:53.154522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:53.154524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:53.154531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255593277034621:8831]
2025-10-01T14:10:53.154535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255593277034621:8831]
2025-10-01T14:10:53.154540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255593277034621:8831]
2025-10-01T14:10:53.154579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:53.154589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:53.154593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:53.154593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:53.154599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.154601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:53.154726Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:53.220914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255595653913521:10063]
2025-10-01T14:10:53.221178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1231, pipe: [1:7556255595653913521:10063]
2025-10-01T14:10:53.310276Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:53.310618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:53.310673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913521:10063], now have 1 active actors on pipe
2025-10-01T14:10:53.310740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:53.310840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255595653913521:10063]
2025-10-01T14:10:53.310892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:53.317336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:53.318755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:53.318875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:53.318883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:53.318890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:53.318916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:53.318943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255593277034690:8833]
2025-10-01T14:10:53.319320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:53.319603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:53.319661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:53.319973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:53.320045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.320053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.320055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.320056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.320057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.320059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.320060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.320061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.320063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.320064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.320065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.320069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.320070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.320071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.320076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.320086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.320089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.320093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.320096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.320100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.320104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.320107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.320111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.320115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.320122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.320125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.320128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.320132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.320139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.320151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.320162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.320167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.320176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.320181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.320186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.320191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.320199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.320204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.320208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.320213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.320223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.320228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.320232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.320237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.320241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.320245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.320249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.320255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.320263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.320268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.320277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.320281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.320284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.320294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.320302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.320306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.320342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:53.321880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:53.321891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:53.321913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1232 reason: error at write: Disconnected sessionId: src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0
2025-10-01T14:10:53.322058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1232 sessionId: src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0 is DEAD
2025-10-01T14:10:53.322149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:53.322159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0] Write session will restart in 0.008053s
2025-10-01T14:10:53.322182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0] Write session: Do CDS request
2025-10-01T14:10:53.322188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:53.326490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:53.327105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:53.327120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:53.327122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:53.327126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:53.327132Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1232 [2:7556255593277034690:8833]
2025-10-01T14:10:53.327150Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:53.327170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:53.327179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.327182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.327184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.327199Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:53.327208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:53.327219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:53.327276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.327282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.327284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.327286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:53.327289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:53.327357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:53.327363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.327375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.327390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.327408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:53.327429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913528:2446], now have 1 active actors on pipe
2025-10-01T14:10:53.327440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255593277034685:8833]
2025-10-01T14:10:53.327447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255593277034685:8833]
2025-10-01T14:10:53.327449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255593277034685:8833]
2025-10-01T14:10:53.327462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:53.327474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:53.327479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:53.327481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:53.327482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:53.327492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:53.327495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:53.327479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1232
2025-10-01T14:10:53.327524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255593277034685:8833]
2025-10-01T14:10:53.327534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:53.327538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:53.331920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.332023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:53.332036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1233
2025-10-01T14:10:53.332154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.332193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:53.332203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:53.332207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:53.332608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1233 sessionId:  describe result for acl check
2025-10-01T14:10:53.332640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:53.332646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:53.332648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:53.332652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255595653913565:10239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:53.333134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255595653913565:10239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:53.335375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255595653913565:10239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:53.337920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:53.337931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:53.337938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255593277034685:8833]
2025-10-01T14:10:53.337970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:53.337971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:53.338123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:53.338257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:53.338407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:53.338539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:53.338722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:53.338758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:53.341449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255595653913565:10239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:53.341463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255595653913565:10239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:53.341466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255595653913565:10239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:53.341474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:53.341698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913601:10239], now have 1 active actors on pipe
2025-10-01T14:10:53.341771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1232
2025-10-01T14:10:53.341827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.341841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.341866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:53.341879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.341888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.341890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:53.341902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.341920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:53.341940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.342057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.342063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.342074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.342207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1233 partition: 0 MaxSeqNo: 45 sessionId: src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0
2025-10-01T14:10:53.342558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e008943-6e22d584-e3d2ec0f-2c7d55fa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:53.344795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0] Write session: try to update token
2025-10-01T14:10:53.344810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:53.356869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:53.356890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:53.356893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:53.356895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:53.356909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255593277034685:8833]
2025-10-01T14:10:53.356913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255593277034685:8833]
2025-10-01T14:10:53.356917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255593277034685:8833]
2025-10-01T14:10:53.356966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:53.356971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:53.356979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.356981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:53.356981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:53.356986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:53.357136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:53.358152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1233 sessionId: src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:53.360588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:53.410845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255595653913605:10063]
2025-10-01T14:10:53.411057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1232, pipe: [1:7556255595653913605:10063]
2025-10-01T14:10:53.504910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:53.505212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.505225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.505243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913605:10063], now have 1 active actors on pipe
2025-10-01T14:10:53.505421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:53.505481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:53.505490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:53.505493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255595653913605:10063]
2025-10-01T14:10:53.505510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:53.505553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1233 reason: error at write: Disconnected sessionId: src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0
2025-10-01T14:10:53.505773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1233 sessionId: src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0 is DEAD
2025-10-01T14:10:53.505910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:53.505918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0] Write session will restart in 0.005140s
2025-10-01T14:10:53.505946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0] Write session: Do CDS request
2025-10-01T14:10:53.505953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:53.511661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:53.511846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.511921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:53.511931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1234
2025-10-01T14:10:53.512037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.512059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:53.512067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:53.512070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:53.512390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1234 sessionId:  describe result for acl check
2025-10-01T14:10:53.512418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:53.512423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:53.512425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:53.512429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255595653913633:5366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:53.512937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255595653913633:5366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:53.512972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:53.513098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:53.513106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:53.513114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:53.513145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:53.513171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255593277034756:8836]
2025-10-01T14:10:53.513539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:53.513730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:53.513754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:53.513934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:53.513967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.513971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.513972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.513973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.513974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.513974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.513975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.513976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.513977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.513977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.513978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.513979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.513979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.513980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.513983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.513988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.513990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.513992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.513994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.513996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.513998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.514000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.514004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.514008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.514010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.514011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.514013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.514016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.514021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.514025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.514029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.514032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.514035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.514039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.514043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.514051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.514055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.514063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.514070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.514077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.514079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.514082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.514084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.514087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.514090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.514093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.514095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.514098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.514101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.514104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.514106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.514108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.514110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.514117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.514119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.514122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.514141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:53.514817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255595653913633:5366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:53.517073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255595653913633:5366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:53.517086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255595653913633:5366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:53.517088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255595653913633:5366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:53.517094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:53.517308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:53.517811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:53.517824Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:53.517826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:53.517828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:53.517833Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1233 [2:7556255593277034756:8836]
2025-10-01T14:10:53.517843Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:53.517854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:53.517859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.517863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.517864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.517875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:53.517881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:53.517894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:53.517930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.517935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.517936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.517939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:53.517941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:53.517985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:53.517989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.517995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.518004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.518015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:53.518028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913608:2446], now have 1 active actors on pipe
2025-10-01T14:10:53.518033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913672:5366], now have 1 active actors on pipe
2025-10-01T14:10:53.518037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255593277034751:8836]
2025-10-01T14:10:53.518039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255593277034751:8836]
2025-10-01T14:10:53.518040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255593277034751:8836]
2025-10-01T14:10:53.518049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:53.518060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:53.518061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:53.518063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:53.518065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:53.518071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:53.518073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:53.518066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1233
2025-10-01T14:10:53.518074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1233
2025-10-01T14:10:53.518090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255593277034751:8836]
2025-10-01T14:10:53.518096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:53.518098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:53.518115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.518118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.518139Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:53.518144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.518147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.518148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:53.518154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.518161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:53.518172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.518270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.518275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.518283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.518342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1234 partition: 0 MaxSeqNo: 45 sessionId: src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0
2025-10-01T14:10:53.518714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c028f75b-dda3bbac-2eaa483d-78b781cb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:53.521062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0] Write session: try to update token
2025-10-01T14:10:53.521079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:53.533823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1234 sessionId: src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:53.536226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:53.537074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.537097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.537117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:53.537119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:53.537121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:53.537122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:53.537131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255593277034751:8836]
2025-10-01T14:10:53.537134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255593277034751:8836]
2025-10-01T14:10:53.537137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255593277034751:8836]
2025-10-01T14:10:53.537165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:53.537174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:53.537177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:53.537180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:53.537185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.537186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:53.537311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:53.605435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255595653913694:10063]
2025-10-01T14:10:53.605731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1233, pipe: [1:7556255595653913694:10063]
2025-10-01T14:10:53.678927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:53.679339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:53.679399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913694:10063], now have 1 active actors on pipe
2025-10-01T14:10:53.679502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:53.680039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255595653913694:10063]
2025-10-01T14:10:53.680071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:53.691872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:53.691883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:53.691906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1234 reason: error at write: Disconnected sessionId: src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0
2025-10-01T14:10:53.692045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1234 sessionId: src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0 is DEAD
2025-10-01T14:10:53.692194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:53.692206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0] Write session will restart in 0.008629s
2025-10-01T14:10:53.692232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0] Write session: Do CDS request
2025-10-01T14:10:53.692238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:53.701884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.701976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:53.701991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1235
2025-10-01T14:10:53.702173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.702212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:53.702222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:53.702225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:53.702250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:53.703538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:53.703712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:53.703723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:53.703733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:53.702612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1235 sessionId:  describe result for acl check
2025-10-01T14:10:53.702651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:53.702654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:53.703797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:53.702655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:53.703831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255593277034829:8840]
2025-10-01T14:10:53.702660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255595653913732:5352] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:53.703155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255595653913732:5352] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:53.704306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:53.704933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:53.704979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:53.705222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:53.705267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.705271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.705272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.705273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.705275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.705276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.705276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.705285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.705286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.705286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.705287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.705287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.705288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.705289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.705292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.705297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.705300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.705302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.705304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.705307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.705309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.705311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.705314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.705316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.705318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.705320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.705322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.705324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.705328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.705333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.705337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.705341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.705343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.705346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.705348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.705353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.705356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.705359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.705361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.705364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.705366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.705369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.705371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.705375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.705378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.705380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.705383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.705385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.705387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.705390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.705392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.705396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.705399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.705401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.705403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.705406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.705427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:53.706057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255595653913732:5352] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:53.710047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:53.710282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255595653913732:5352] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:53.710297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255595653913732:5352] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:53.710310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255595653913732:5352] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:53.710318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:53.710871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:53.710885Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:53.710888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:53.710891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:53.710899Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1234 [2:7556255593277034829:8840]
2025-10-01T14:10:53.710915Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:53.710932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:53.710935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.710938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.710944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.710960Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:53.710973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:53.710978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:53.711037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.711044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.711046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.711049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:53.711052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:53.711118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:53.711125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.711136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.711150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.711170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:53.711193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913704:2446], now have 1 active actors on pipe
2025-10-01T14:10:53.711200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913775:5352], now have 1 active actors on pipe
2025-10-01T14:10:53.711208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255593277034824:8840]
2025-10-01T14:10:53.711214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255593277034824:8840]
2025-10-01T14:10:53.711216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255593277034824:8840]
2025-10-01T14:10:53.711231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:53.711250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:53.711269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:53.711275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:53.711277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1234
2025-10-01T14:10:53.711311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1234
2025-10-01T14:10:53.711308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255593277034824:8840]
2025-10-01T14:10:53.711315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:53.711382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:53.711389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:53.711391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:53.711396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:53.711544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.711554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.711580Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:53.711593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.711598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.711600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:53.711610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.711623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:53.711637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.712277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.712292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.712314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.712457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1235 partition: 0 MaxSeqNo: 45 sessionId: src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0
2025-10-01T14:10:53.714047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f749233-937dabbc-5db9b4f5-ef3c5824_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:53.716420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0] Write session: try to update token
2025-10-01T14:10:53.716436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:53.729607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1235 sessionId: src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:53.732024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:53.732042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:53.732044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:53.732046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:53.732056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255593277034824:8840]
2025-10-01T14:10:53.732061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255593277034824:8840]
2025-10-01T14:10:53.732064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255593277034824:8840]
2025-10-01T14:10:53.732113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:53.732117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:53.732124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.732126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:53.732127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:53.732130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:53.732210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:53.732252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:53.780000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255595653913785:10063]
2025-10-01T14:10:53.780207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1234, pipe: [1:7556255595653913785:10063]
2025-10-01T14:10:53.869659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:53.869951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.869962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.869994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913785:10063], now have 1 active actors on pipe
2025-10-01T14:10:53.870153Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:53.870246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255595653913785:10063]
2025-10-01T14:10:53.870275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:53.870341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:53.870343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1235 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0
2025-10-01T14:10:53.870540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1235 sessionId: src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0 is DEAD
2025-10-01T14:10:53.870689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:53.870700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0] Write session will restart in 0.006170s
2025-10-01T14:10:53.870727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0] Write session: Do CDS request
2025-10-01T14:10:53.870733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:53.877485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:53.877900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.877975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:53.877989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1236
2025-10-01T14:10:53.878301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:53.878336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:53.878341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:53.878344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:53.878756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1236 sessionId:  describe result for acl check
2025-10-01T14:10:53.878791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:53.878797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:53.878798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:53.878804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255595653913827:5342] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:53.878862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:53.879056Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:53.879066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:53.879078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:53.879139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:53.879178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255593277034936:8853]
2025-10-01T14:10:53.879296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255595653913827:5342] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:53.879747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:53.880062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:53.880114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:53.880412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:53.880488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.880495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.880497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.880498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.880499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.880500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.880500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.880501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.880502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.880502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.880503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.880503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.880506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.880507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.880511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.880516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.880518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.880520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.880522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.880524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.880526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.880528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.880530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.880532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.880534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.880536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.880537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.880539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.880545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.880549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:53.880553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.880556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:53.880558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.880561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:53.880564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.880566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:53.880569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.880572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:53.880575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.880577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:53.880581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.880585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:53.880589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.880595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:53.880599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.880603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:53.880607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.880612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.880616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.880621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.880624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.880627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.880631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.880635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:53.880638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.880642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:53.880674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:53.881031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255595653913827:5342] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:53.884107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:53.884696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:53.884720Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:53.884722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:53.884726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:53.884733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1235 [2:7556255593277034936:8853]
2025-10-01T14:10:53.884748Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:53.884763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:53.884770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.884774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.884776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.884791Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:53.884800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:53.884806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:53.884862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.884868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.884871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.884874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:53.884876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:53.884935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:53.884941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.884948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:53.884954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:53.884966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:53.884983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913798:2446], now have 1 active actors on pipe
2025-10-01T14:10:53.884995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255593277034931:8853]
2025-10-01T14:10:53.884998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255593277034931:8853]
2025-10-01T14:10:53.885000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255593277034931:8853]
2025-10-01T14:10:53.885014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:53.885033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:53.885047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:53.885129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1235
2025-10-01T14:10:53.885050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:53.885077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255593277034931:8853]
2025-10-01T14:10:53.885078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:53.885116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:53.885119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:53.885121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:53.885128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:53.885366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255595653913827:5342] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:53.885377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255595653913827:5342] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:53.885381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255595653913827:5342] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:53.885388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:53.885594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913868:5342], now have 1 active actors on pipe
2025-10-01T14:10:53.885653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1235
2025-10-01T14:10:53.885710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.885721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.885745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:53.885758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:53.885762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:53.885765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:53.885776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:53.885790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:53.885806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.885949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.885961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.885981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:53.886047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1236 partition: 0 MaxSeqNo: 45 sessionId: src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0
2025-10-01T14:10:53.886409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2d1fec7-33eff9b8-3a0e25ec-6884ab87_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:53.888718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0] Write session: try to update token
2025-10-01T14:10:53.888734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:53.901706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1236 sessionId: src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:53.904467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:53.905401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:53.905428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:53.905451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:53.905454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:53.905459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:53.905461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:53.905470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255593277034931:8853]
2025-10-01T14:10:53.905481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255593277034931:8853]
2025-10-01T14:10:53.905486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255593277034931:8853]
2025-10-01T14:10:53.905524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:53.905539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:53.905544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:53.905545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:53.905551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:53.905555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:53.905684Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:53.970662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255595653913875:10063]
2025-10-01T14:10:53.971148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1235, pipe: [1:7556255595653913875:10063]
2025-10-01T14:10:54.065459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:54.065798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:54.065865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255595653913875:10063], now have 1 active actors on pipe
2025-10-01T14:10:54.065959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:54.066113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255595653913875:10063]
2025-10-01T14:10:54.066143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:54.073814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:54.075233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:54.075443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:54.075456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:54.075467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:54.075516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:54.075557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255597572002301:8856]
2025-10-01T14:10:54.076165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:54.076261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:54.076272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:54.076295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1236 reason: error at write: Disconnected sessionId: src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0
2025-10-01T14:10:54.076427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1236 sessionId: src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0 is DEAD
2025-10-01T14:10:54.076564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:54.076574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0] Write session will restart in 0.008815s
2025-10-01T14:10:54.076598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0] Write session: Do CDS request
2025-10-01T14:10:54.076604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:54.080077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:54.080142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:54.080507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:54.080558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.080563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.080565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.080566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.080567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.080569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.080570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.080571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.080573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.080574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.080575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.080577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.080578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.080579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.080587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.080598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.080602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.080606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.080611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.080615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.080619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.080623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.080627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.080631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.080635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.080640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.080643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.080647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.080657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.080665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.080671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.080676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.080681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.080686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.080690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.080696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.080711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.080716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.080720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.080725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.080730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.080735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.080741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.080751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.080757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.080762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.080770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.080775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.080779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.080787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.080792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.080797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.080801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.080810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.080814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.080819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.080863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:54.084646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:54.085374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:54.085391Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:54.085397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:54.085401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:54.085408Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1236 [2:7556255597572002301:8856]
2025-10-01T14:10:54.085427Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:54.085445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:54.085455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.085458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.085461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.085477Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:54.085487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:54.085492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:54.085550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.085558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.085560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.085563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:54.085566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:54.085634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:54.085640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.085651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.085660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.085674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:54.085695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881173:2446], now have 1 active actors on pipe
2025-10-01T14:10:54.085706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255597572002296:8856]
2025-10-01T14:10:54.085708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255597572002296:8856]
2025-10-01T14:10:54.085710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255597572002296:8856]
2025-10-01T14:10:54.085725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:54.085736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1236
2025-10-01T14:10:54.085740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:54.085741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:54.085746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:54.085747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:54.085755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:54.085758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:54.085798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255597572002296:8856]
2025-10-01T14:10:54.085808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:54.085814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:54.086894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.086963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:54.086975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1237
2025-10-01T14:10:54.087083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.087103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:54.087106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:54.087109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:54.087421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1237 sessionId:  describe result for acl check
2025-10-01T14:10:54.087444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:54.087445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:54.087447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:54.087452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255599948881211:5335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:54.087909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255599948881211:5335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:54.090616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255599948881211:5335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:54.095348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255599948881211:5335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:54.095366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255599948881211:5335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:54.095370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255599948881211:5335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:54.095379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:54.095725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1236
2025-10-01T14:10:54.096254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881246:5335], now have 1 active actors on pipe
2025-10-01T14:10:54.096292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.096300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.096320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:54.096329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:54.096337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255597572002296:8856]
2025-10-01T14:10:54.096382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:54.096389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:54.096400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.096407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.096414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:54.096427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.096450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:54.096470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:54.096672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:54.096844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.097005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.097169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.097371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:54.097421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.097445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:54.097726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.097739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.097761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.097861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1237 partition: 0 MaxSeqNo: 45 sessionId: src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0
2025-10-01T14:10:54.098245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11bd76b-e6e5fe6a-ff8dd9aa-2cbe9983_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:54.100670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0] Write session: try to update token
2025-10-01T14:10:54.100687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:54.114887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1237 sessionId: src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:54.115884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:54.115906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:54.115908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:54.115910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:54.115921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255597572002296:8856]
2025-10-01T14:10:54.115925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255597572002296:8856]
2025-10-01T14:10:54.115930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255597572002296:8856]
2025-10-01T14:10:54.115978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:54.115981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:54.115988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.115991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:54.115991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:54.115999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:54.116137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:54.117343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:54.166055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255599948881249:10063]
2025-10-01T14:10:54.166313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1236, pipe: [1:7556255599948881249:10063]
2025-10-01T14:10:54.254861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:54.255172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.255189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.255208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881249:10063], now have 1 active actors on pipe
2025-10-01T14:10:54.255378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:54.255442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:54.255442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:54.255455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:54.255496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255599948881249:10063]
2025-10-01T14:10:54.255591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1237 reason: error at write: Disconnected sessionId: src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0
2025-10-01T14:10:54.255775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1237 sessionId: src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0 is DEAD
2025-10-01T14:10:54.255889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:54.255898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0] Write session will restart in 0.009498s
2025-10-01T14:10:54.255918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0] Write session: Do CDS request
2025-10-01T14:10:54.255923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:54.263154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:54.264803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:54.264997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:54.265008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:54.265020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:54.265069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:54.265108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255597572002370:8858]
2025-10-01T14:10:54.265681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:54.265990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:54.266033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:54.266321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:54.266399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.266404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.266406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.266407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.266410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.266411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.266412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.266413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.266415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.266416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.266417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.266418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.266419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.266420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.266425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.266434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.266438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.266441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.266444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.266447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.266451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.266454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.266458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.266462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.266465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.266469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.266472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.266476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.266483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.266489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.266495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.266501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.266505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.266510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.266514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.266519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.266523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.266529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.266532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.266537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.266542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.266546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.266554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.266559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.266563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.266568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.266576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.266582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.266586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.266591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.266594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.266598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.266603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.266612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.266616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.266620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.266659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:54.266958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.267029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:54.267048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1238
2025-10-01T14:10:54.267180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.267217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:54.267222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:54.267226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:54.267597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1238 sessionId:  describe result for acl check
2025-10-01T14:10:54.267628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:54.267636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:54.267638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:54.267643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255599948881286:5329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:54.268142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255599948881286:5329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:54.270163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255599948881286:5329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:54.270446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:54.271100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:54.271113Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:54.271115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:54.271118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:54.271124Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1237 [2:7556255597572002370:8858]
2025-10-01T14:10:54.271140Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:54.271156Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:54.271164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.271168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.271172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.271188Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:54.271197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:54.271203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:54.271254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.271260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.271262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.271265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:54.271267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:54.271329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:54.271335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.271347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.271362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.271424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1237
2025-10-01T14:10:54.271380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:54.271402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881250:2446], now have 1 active actors on pipe
2025-10-01T14:10:54.271409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255597572002365:8858]
2025-10-01T14:10:54.271412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255597572002365:8858]
2025-10-01T14:10:54.271414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255597572002365:8858]
2025-10-01T14:10:54.271426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:54.271438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:54.271439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:54.271442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:54.271443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:54.271451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:54.271454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:54.271484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255597572002365:8858]
2025-10-01T14:10:54.271490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:54.271502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:54.276355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255599948881286:5329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:54.276370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255599948881286:5329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:54.276374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255599948881286:5329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:54.276382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:54.276837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881323:5329], now have 1 active actors on pipe
2025-10-01T14:10:54.276884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1237
2025-10-01T14:10:54.276956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.276967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.276994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:54.277012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.277019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.277026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:54.277037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.277051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:54.277074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.277255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.277263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.277278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.277358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1238 partition: 0 MaxSeqNo: 45 sessionId: src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0
2025-10-01T14:10:54.277719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e48dee8c-9d330c5b-6957c8e4-c92aed46_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:54.280058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0] Write session: try to update token
2025-10-01T14:10:54.280074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:54.282348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:54.282365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:54.282393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255597572002365:8858]
2025-10-01T14:10:54.282420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:54.282433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:54.282607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:54.282749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.282889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.283032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.283233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:54.283276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:54.293011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1238 sessionId: src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:54.295281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:54.295522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.295545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.295584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:54.295693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:54.301397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:54.301418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:54.301420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:54.301422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:54.301438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255597572002365:8858]
2025-10-01T14:10:54.301443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255597572002365:8858]
2025-10-01T14:10:54.301447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255597572002365:8858]
2025-10-01T14:10:54.301491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:54.301495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:54.301498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:54.301502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:54.301503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.301505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:54.301643Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:54.355503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255599948881335:10063]
2025-10-01T14:10:54.355784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1237, pipe: [1:7556255599948881335:10063]
2025-10-01T14:10:54.442269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:54.449766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.449788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.449929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.449981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.450037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.450089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.450130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.450137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.450196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.450250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.450306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.450361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.450425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.450431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.450492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.450549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.450607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.450667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.450706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.450711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.450769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.450825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.450882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.450942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.450984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.450989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.451047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.451101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.451155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.451209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.451250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.451255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.451312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.451368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.451427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.451482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.451525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.451530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.451587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.451641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.451698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.451754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.451795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.451799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.451858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.451912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.451971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.452030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.452070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.452076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.452134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.452187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.452242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.452300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.452339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.452344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.452402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.452456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.452513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.452570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.452609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.452614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.452664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881335:10063], now have 1 active actors on pipe
2025-10-01T14:10:54.452918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:54.452923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:54.452926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:54.452954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1238 reason: error at write: Disconnected sessionId: src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0
2025-10-01T14:10:54.452970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255599948881335:10063]
2025-10-01T14:10:54.453144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1238 sessionId: src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0 is DEAD
2025-10-01T14:10:54.453266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:54.453276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0] Write session will restart in 0.009822s
2025-10-01T14:10:54.453294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0] Write session: Do CDS request
2025-10-01T14:10:54.453299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:54.453595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:54.459097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:54.460377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:54.460502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:54.460513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:54.460523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:54.460564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:54.460594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255597572002441:8861]
2025-10-01T14:10:54.460983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:54.461217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:54.461247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:54.461443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:54.461485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.461491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.461491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.461492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.461493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.461494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.461495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.461496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.461498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.461499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.461500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.461501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.461501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.461502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.461506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.461515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.461518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.461521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.461525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.461528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.461531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.461535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.461538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.461542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.461545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.461548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.461552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.461555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.461562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.461570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.461578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.461583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.461591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.461595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.461601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.461605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.461609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.461614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.461622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.461628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.461634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.461639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.461645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.461650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.461654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.461662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.461668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.461677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.461683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.461692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.461696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.461703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.461708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.461715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.461719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.461725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.461763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:54.463820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.463891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:54.463902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1239
2025-10-01T14:10:54.464023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.464052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:54.464061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:54.464064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:54.464382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1239 sessionId:  describe result for acl check
2025-10-01T14:10:54.464408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:54.464409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:54.464410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:54.464413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255599948881376:5319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:54.464842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255599948881376:5319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:54.465316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:54.465877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:54.465890Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:54.465893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:54.465895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:54.465904Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1238 [2:7556255597572002441:8861]
2025-10-01T14:10:54.465922Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:54.465939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:54.465944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.465947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.465949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.465961Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:54.465967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:54.465971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:54.466007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.466012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.466015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.466017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:54.466018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:54.466065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:54.466074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.466084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.466092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.466108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:54.466126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255597572002436:8861]
2025-10-01T14:10:54.466132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255597572002436:8861]
2025-10-01T14:10:54.466134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255597572002436:8861]
2025-10-01T14:10:54.466147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:54.466162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:54.466163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881341:2446], now have 1 active actors on pipe
2025-10-01T14:10:54.466169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:54.466171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:54.466171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:54.466184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:54.466186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:54.466162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1238
2025-10-01T14:10:54.466213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255597572002436:8861]
2025-10-01T14:10:54.466223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:54.466240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:54.467080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255599948881376:5319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:54.472267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255599948881376:5319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:54.472277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255599948881376:5319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:54.472280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255599948881376:5319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:54.472286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:54.472496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881415:5319], now have 1 active actors on pipe
2025-10-01T14:10:54.472546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1238
2025-10-01T14:10:54.472585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.472594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.472618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc167433-f6fff824-a13b757a-38a50692_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:54.472641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.472646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.472653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:54.472662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.472677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:54.472694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.472840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.472845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.472855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.472930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1239 partition: 0 MaxSeqNo: 45 sessionId: src_id|cc167433-f6fff824-a13b757a-38a50692_0
2025-10-01T14:10:54.473239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aad18b07-a97cb89c-f49f2290-d42d9560_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cc167433-f6fff824-a13b757a-38a50692_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:54.475695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc167433-f6fff824-a13b757a-38a50692_0] Write session: try to update token
2025-10-01T14:10:54.475712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc167433-f6fff824-a13b757a-38a50692_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:54.476525Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:54.476540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:54.476547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255597572002436:8861]
2025-10-01T14:10:54.476577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:54.476600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:54.476734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:54.476859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.476990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.477113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.477278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:54.477306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:54.489369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1239 sessionId: src_id|cc167433-f6fff824-a13b757a-38a50692_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:54.491722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:54.491954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.491977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.492011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:54.492110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:54.494598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:54.494612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:54.494614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:54.494616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:54.494623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255597572002436:8861]
2025-10-01T14:10:54.494627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255597572002436:8861]
2025-10-01T14:10:54.494632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255597572002436:8861]
2025-10-01T14:10:54.494664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:54.494672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.494674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:54.494688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:54.494700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:54.494704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:54.494797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:54.553135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255599948881418:10063]
2025-10-01T14:10:54.553391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1238, pipe: [1:7556255599948881418:10063]
2025-10-01T14:10:54.630070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:54.636997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.637017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.637152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.637204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.637259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.637326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.637453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.637462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.637520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.637577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.637631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.637688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.637735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.637741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.637806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.637862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.637919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.637979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.638022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.638028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.638094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.638151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.638210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.638271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.638319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.638325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.638405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.638463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.638524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.638582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.638628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.638634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.638696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.638750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.638804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.638862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.638914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.638919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.638982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.639039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.639098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.639158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.639198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.639202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.639262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.639314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.639371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.639425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.639472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.639475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.639537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.639598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.639658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.639716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.639758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.639764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.639829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.639887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.639945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.640004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.640047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.640053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.640096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881418:10063], now have 1 active actors on pipe
2025-10-01T14:10:54.640260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:54.640293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:54.640293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255599948881418:10063]
2025-10-01T14:10:54.640295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:54.640313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1239 reason: error at write: Disconnected sessionId: src_id|cc167433-f6fff824-a13b757a-38a50692_0
2025-10-01T14:10:54.640495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1239 sessionId: src_id|cc167433-f6fff824-a13b757a-38a50692_0 is DEAD
2025-10-01T14:10:54.640610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc167433-f6fff824-a13b757a-38a50692_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:54.640620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc167433-f6fff824-a13b757a-38a50692_0] Write session will restart in 0.008627s
2025-10-01T14:10:54.640645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc167433-f6fff824-a13b757a-38a50692_0] Write session: Do CDS request
2025-10-01T14:10:54.640651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc167433-f6fff824-a13b757a-38a50692_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:54.640813Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:54.646496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:54.647848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:54.647985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:54.647993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:54.648000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:54.648028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:54.648055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255597572002519:8865]
2025-10-01T14:10:54.648427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:54.648683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:54.648721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:54.648906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:54.648937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.648940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.648941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.648941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.648942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.648943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.648943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.648944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.648945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.648945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.648946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.648947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.648947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.648948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.648952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.648957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.648959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.648962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.648965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.648967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.648969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.648971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.648973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.648975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.648977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.648979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.648981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.648983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.648987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.648991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.648995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.648998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.649000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.649003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.649005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.649008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.649010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.649013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.649015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.649017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.649020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.649023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.649025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.649027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.649030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.649033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.649035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.649038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.649041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.649044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.649046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.649049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.649052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.649055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.649057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.649059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.649080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:54.650779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc167433-f6fff824-a13b757a-38a50692_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.650887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:54.650898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1240
2025-10-01T14:10:54.651027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.651057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:54.651064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:54.651067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:54.651406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1240 sessionId:  describe result for acl check
2025-10-01T14:10:54.651441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:54.651446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:54.651448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:54.651453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255599948881482:5310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:54.651945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255599948881482:5310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:54.652400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:54.652930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:54.652940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:54.652941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:54.652943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:54.652948Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1239 [2:7556255597572002519:8865]
2025-10-01T14:10:54.652957Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:54.652967Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:54.652972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.652974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.652976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.652986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:54.652992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:54.652996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:54.653042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.653051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.653053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.653055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:54.653061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:54.653123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:54.653129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.653139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.653151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.653170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:54.653187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881445:2446], now have 1 active actors on pipe
2025-10-01T14:10:54.653195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255597572002514:8865]
2025-10-01T14:10:54.653199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255597572002514:8865]
2025-10-01T14:10:54.653200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255597572002514:8865]
2025-10-01T14:10:54.653208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:54.653188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1239
2025-10-01T14:10:54.653223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:54.653222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:54.653225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:54.653227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:54.653239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:54.653241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:54.653267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255597572002514:8865]
2025-10-01T14:10:54.653275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:54.653285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:54.653730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255599948881482:5310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:54.659104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255599948881482:5310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:54.659117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255599948881482:5310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:54.659120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255599948881482:5310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:54.659127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:54.659323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881518:5310], now have 1 active actors on pipe
2025-10-01T14:10:54.659371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1239
2025-10-01T14:10:54.659415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.659427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.659453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:54.659472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.659480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.659483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:54.659490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.659503Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:54.659521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.659629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.659638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.659650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.659719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1240 partition: 0 MaxSeqNo: 45 sessionId: src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0
2025-10-01T14:10:54.660050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc167433-f6fff824-a13b757a-38a50692_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:54.662405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0] Write session: try to update token
2025-10-01T14:10:54.662418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:54.663182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:54.663194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:54.663207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255597572002514:8865]
2025-10-01T14:10:54.663247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:54.663247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:54.663395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:54.663531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.663669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.663800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:54.663976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:54.664009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:54.675228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1240 sessionId: src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:54.677537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:54.677829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.677849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.677888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:54.677959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:54.681018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:54.681034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:54.681036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:54.681038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:54.681047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255597572002514:8865]
2025-10-01T14:10:54.681051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255597572002514:8865]
2025-10-01T14:10:54.681056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255597572002514:8865]
2025-10-01T14:10:54.681100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:54.681112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:54.681114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:54.681116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:54.681120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.681123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:54.681256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:54.740492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255599948881523:10063]
2025-10-01T14:10:54.740682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1239, pipe: [1:7556255599948881523:10063]
2025-10-01T14:10:54.818588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:54.826566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.826589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.826741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.826803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.826865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.826925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.826974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.826983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.827048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.827105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.827164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.827231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.827276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.827283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.827353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.827414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.827471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.827535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.827893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.827902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.827966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.828031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.828093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.828153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.828191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.828200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.828260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.828320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.828378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.828446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.828492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.828498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.828562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.828620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.828680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.828751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.828796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.828803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.828876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.828935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.828997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.829056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.829175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.829182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.829247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.829304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.829365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.829426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.829466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.829472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.829538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.829593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.829654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.829717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.829762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.829768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.829832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:54.829891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:54.829949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:54.830004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:54.830129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:54.830138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:54.830195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881523:10063], now have 1 active actors on pipe
2025-10-01T14:10:54.830409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:54.830424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255599948881523:10063]
2025-10-01T14:10:54.830664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:54.830672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:54.830698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1240 reason: error at write: Disconnected sessionId: src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0
2025-10-01T14:10:54.830800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:54.830935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1240 sessionId: src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0 is DEAD
2025-10-01T14:10:54.831260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:54.831267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0] Write session will restart in 0.009285s
2025-10-01T14:10:54.831291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0] Write session: Do CDS request
2025-10-01T14:10:54.831308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:54.837707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:54.838951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:54.839125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:54.839135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:54.839145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:54.839189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:54.839225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255597572002631:8874]
2025-10-01T14:10:54.839758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:54.839980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:54.840024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:54.840415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:54.840474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.840479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.840480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.840481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.840482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.840483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.840484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.840485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.840486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.840487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.840488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.840489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.840490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.840492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.840497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.840506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.840510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.840513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.840517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.840521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.840524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.840527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.840531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.840535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.840538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.840543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.840547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.840550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.840557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.840564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:54.840569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.840574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:54.840577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.840582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:54.840585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.840590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:54.840595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.840603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:54.840607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.840612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:54.840616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.840621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:54.840624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.840628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:54.840633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.840637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:54.840641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.840645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.840650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.840659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.840663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.840668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.840675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.840680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:54.840684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.840692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:54.840739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:54.841943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.842010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:54.842022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1241
2025-10-01T14:10:54.842177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:54.842217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:54.842224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:54.842228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:54.842630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1241 sessionId:  describe result for acl check
2025-10-01T14:10:54.842653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:54.842655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:54.842656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:54.842660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255599948881567:5289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:54.843155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255599948881567:5289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:54.844393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:54.845046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:54.845060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:54.845062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:54.845066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:54.845073Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1240 [2:7556255597572002631:8874]
2025-10-01T14:10:54.845089Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:54.845105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:54.845114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.845118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.845120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.845137Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:54.845146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:54.845152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:54.845211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.845218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.845220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.845224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:54.845227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:54.845293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:54.845303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.845314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:54.845324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:54.845341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:54.845362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881526:2446], now have 1 active actors on pipe
2025-10-01T14:10:54.845376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255597572002624:8874]
2025-10-01T14:10:54.845378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255597572002624:8874]
2025-10-01T14:10:54.845380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255597572002624:8874]
2025-10-01T14:10:54.845392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:54.845400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:54.845402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:54.845411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:54.845412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:54.845430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:54.845433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:54.845464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255597572002624:8874]
2025-10-01T14:10:54.845474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:54.845484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1240
2025-10-01T14:10:54.845577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:54.846039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255599948881567:5289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:54.851606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255599948881567:5289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:54.851619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255599948881567:5289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:54.851621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255599948881567:5289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:54.851636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:54.851840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881602:5289], now have 1 active actors on pipe
2025-10-01T14:10:54.851890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1240
2025-10-01T14:10:54.851946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.851963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.852002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:54.852018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:54.852028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:54.852031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:54.852046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:54.852065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:54.852090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.852230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:54.852243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:54.852265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:54.852369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1241 partition: 0 MaxSeqNo: 45 sessionId: src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0
2025-10-01T14:10:54.852904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1fe85c1-dc376e90-8a776bf5-872d2ae5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:54.855295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0] Write session: try to update token
2025-10-01T14:10:54.855311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:54.866641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:54.866670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:54.866674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:54.866676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:54.866686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255597572002624:8874]
2025-10-01T14:10:54.866694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255597572002624:8874]
2025-10-01T14:10:54.866704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255597572002624:8874]
2025-10-01T14:10:54.866756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:54.866769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:54.866770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:54.866774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:54.866779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:54.866782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:54.866975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:54.872695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1241 sessionId: src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:54.875054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:54.930490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255599948881617:10063]
2025-10-01T14:10:54.930678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1240, pipe: [1:7556255599948881617:10063]
2025-10-01T14:10:55.029399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:55.029725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.029745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.029771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255599948881617:10063], now have 1 active actors on pipe
2025-10-01T14:10:55.029982Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:55.030030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255599948881617:10063]
2025-10-01T14:10:55.030058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:55.030092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:55.030247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1241 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0
2025-10-01T14:10:55.030768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1241 sessionId: src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0 is DEAD
2025-10-01T14:10:55.032898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:55.032909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0] Write session will restart in 0.005467s
2025-10-01T14:10:55.032939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0] Write session: Do CDS request
2025-10-01T14:10:55.032944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:55.040001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.040083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:55.040097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1242
2025-10-01T14:10:55.040250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.040283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:55.040292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:55.040296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:55.040914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1242 sessionId:  describe result for acl check
2025-10-01T14:10:55.040952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:55.040954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:55.040956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:55.040961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255604243848926:5297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:55.041501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255604243848926:5297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:55.045468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255604243848926:5297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:55.052880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:55.055147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255604243848926:5297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:55.055165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255604243848926:5297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:55.055169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255604243848926:5297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:55.055179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:55.059075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:55.059414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:55.059426Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:55.059442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:55.059514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:55.059580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255601866970003:8881]
2025-10-01T14:10:55.060204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:55.060863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:55.060932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:55.061276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:55.061352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.061357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.061358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.061359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.061360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.061362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.061363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.061364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.061366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.061371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.061372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.061373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.061374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.061375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.061382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.061393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.061397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.061401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.061406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.061410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.061414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.061418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.061421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.061425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.061429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.061432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.061436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.061441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.061448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.061456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.061462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.061468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.061473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.061478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.061485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.061491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.061496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.061501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.061522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.061529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.061542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.061549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.061555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.061560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.061564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.061569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.061573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.061578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.061583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.061588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.061592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.061597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.061602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.061607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.061613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.061618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.061664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:55.070211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1241
2025-10-01T14:10:55.070227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1241
2025-10-01T14:10:55.068421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:55.069720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:55.069726Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:55.069729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:55.069735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:55.069742Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1241 [2:7556255601866970003:8881]
2025-10-01T14:10:55.069763Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:55.069786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:55.069789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.069793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.069796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.069814Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:55.069819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:55.069831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:55.069979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.069981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.069983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.070004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:55.070007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:55.070094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:55.070097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.070111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.070120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.070134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:55.070157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243848916:2446], now have 1 active actors on pipe
2025-10-01T14:10:55.070160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243848984:5297], now have 1 active actors on pipe
2025-10-01T14:10:55.070168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255601866969996:8881]
2025-10-01T14:10:55.070170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255601866969996:8881]
2025-10-01T14:10:55.070173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255601866969996:8881]
2025-10-01T14:10:55.070188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:55.070203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:55.070207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:55.070211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:55.070213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:55.070219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:55.070224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:55.070265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255601866969996:8881]
2025-10-01T14:10:55.070271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:55.070278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:55.070297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.070301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.070351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:55.070359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.070384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.070391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:55.070404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.070413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:55.070439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.070713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.070726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.070742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.070843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1242 partition: 0 MaxSeqNo: 45 sessionId: src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0
2025-10-01T14:10:55.071304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a9ca8-467956f9-10b5c01b-5a94d7a8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:55.073861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0] Write session: try to update token
2025-10-01T14:10:55.073881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:55.104311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:55.104341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:55.104347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:55.104352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:55.104366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255601866969996:8881]
2025-10-01T14:10:55.104374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255601866969996:8881]
2025-10-01T14:10:55.104380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255601866969996:8881]
2025-10-01T14:10:55.104434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:55.104441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:55.104445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:55.104460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:55.104474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.104477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:55.105042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:55.112659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1242 sessionId: src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:55.115233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:55.130170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255604243849001:10063]
2025-10-01T14:10:55.130839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1241, pipe: [1:7556255604243849001:10063]
2025-10-01T14:10:55.265564Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:55.265907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.265917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.265940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849001:10063], now have 1 active actors on pipe
2025-10-01T14:10:55.266454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255604243849001:10063]
2025-10-01T14:10:55.266485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:55.266487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:55.266545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1242 reason: error at write: Disconnected sessionId: src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0
2025-10-01T14:10:55.266663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:55.266731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1242 sessionId: src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0 is DEAD
2025-10-01T14:10:55.267025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:55.267036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0] Write session will restart in 0.008873s
2025-10-01T14:10:55.267062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0] Write session: Do CDS request
2025-10-01T14:10:55.267070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:55.266985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:55.281029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.281239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:55.281254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1243
2025-10-01T14:10:55.285980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.286038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:55.286044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:55.286048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:55.286511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1243 sessionId:  describe result for acl check
2025-10-01T14:10:55.286553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:55.286555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:55.286557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:55.286564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255604243849040:5285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:55.287090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255604243849040:5285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:55.287999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:55.292456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:55.292688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:55.292696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:55.292721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:55.292777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:55.292832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255604243849040:5285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:55.292859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255601866970077:8883]
2025-10-01T14:10:55.293409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:55.293797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:55.293843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:55.294135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:55.294196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.294202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.294203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.294204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.294205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.294206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.294208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.294220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.294221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.294222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.294223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.294224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.294225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.294226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.294231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.294241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.294244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.294250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.294254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.294258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.294263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.294266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.294269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.294275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.294278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.294281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.294287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.294293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.294299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.294310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.294320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.294327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.294331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.294339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.294343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.294349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.294358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.294362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.294366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.294386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.294394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.294400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.294405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.294409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.294414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.294419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.294422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.294429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.294433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.294437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.294442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.294446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.294450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.294458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.294462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.294467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.294507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:55.297266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255604243849040:5285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:55.297281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255604243849040:5285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:55.297285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255604243849040:5285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:55.297293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:55.298908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:55.299617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:55.299635Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:55.299637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:55.299640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:55.299647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1242 [2:7556255601866970077:8883]
2025-10-01T14:10:55.299665Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:55.299682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:55.299690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.299694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.299697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.299714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:55.299723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:55.299729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:55.299791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.299797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.299799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.299802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:55.299804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:55.299868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:55.299874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.299885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.299898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.299917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:55.299938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255601866970072:8883]
2025-10-01T14:10:55.299945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255601866970072:8883]
2025-10-01T14:10:55.299947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255601866970072:8883]
2025-10-01T14:10:55.299958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:55.299976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:55.299993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:55.300001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:55.300004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:55.300006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:55.300008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:55.300037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255601866970072:8883]
2025-10-01T14:10:55.300047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:55.300051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:55.300067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849004:2446], now have 1 active actors on pipe
2025-10-01T14:10:55.300070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849078:5285], now have 1 active actors on pipe
2025-10-01T14:10:55.300262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.300272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.300294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:55.300301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.300305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.300307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:55.300316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.300325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:55.300339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.300731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.300744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.300764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.300175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1242
2025-10-01T14:10:55.300207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1242
2025-10-01T14:10:55.301272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1243 partition: 0 MaxSeqNo: 45 sessionId: src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0
2025-10-01T14:10:55.302469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3c408cc-7276e1f4-4d14bfeb-cef0d7e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:55.305175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0] Write session: try to update token
2025-10-01T14:10:55.305196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:55.327995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:55.328012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:55.328015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:55.328017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:55.328027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255601866970072:8883]
2025-10-01T14:10:55.328032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255601866970072:8883]
2025-10-01T14:10:55.328040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255601866970072:8883]
2025-10-01T14:10:55.328095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:55.328102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.328104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:55.328224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:55.328232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:55.328236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:55.328250Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:55.334689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1243 sessionId: src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:55.337196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:55.367933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255604243849091:10063]
2025-10-01T14:10:55.368349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1242, pipe: [1:7556255604243849091:10063]
2025-10-01T14:10:55.480026Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:55.480261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.480275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.480319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849091:10063], now have 1 active actors on pipe
2025-10-01T14:10:55.480481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:55.480624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:55.480676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255604243849091:10063]
2025-10-01T14:10:55.480692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:55.480764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1243 reason: status is not ok: tablet will be restarted right now sessionId: src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0
2025-10-01T14:10:55.480961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1243 sessionId: src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0 is DEAD
2025-10-01T14:10:55.481322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:55.481329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0] Write session will restart in 0.009498s
2025-10-01T14:10:55.481350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0] Write session: Do CDS request
2025-10-01T14:10:55.481355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:55.488648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:55.490060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:55.490243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:55.490257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:55.490269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:55.490320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:55.490358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255601866970153:8886]
2025-10-01T14:10:55.490984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:55.491281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:55.491323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:55.491557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:55.491598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.491602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.491603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.491604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.491605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.491605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.491606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.491607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.491608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.491609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.491610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.491610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.491611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.491612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.491615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.491623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.491625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.491627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.491630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.491632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.491634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.491636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.491639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.491641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.491643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.491645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.491648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.491650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.491657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.491662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.491667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.491670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.491673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.491676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.491679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.491682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.491685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.491689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.491692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.491696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.491700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.491705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.491709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.491713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.491718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.491723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.491728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.491733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.491736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.491742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.491750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.491755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.491764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.491771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.491778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.491781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.491805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:55.491893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.491961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:55.491974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1244
2025-10-01T14:10:55.492068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.492092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:55.492100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:55.492103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:55.492403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1244 sessionId:  describe result for acl check
2025-10-01T14:10:55.492431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:55.492436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:55.492438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:55.492441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255604243849137:5284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:55.492897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255604243849137:5284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:55.494979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255604243849137:5284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:55.495697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:55.496397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:55.496409Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:55.496413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:55.496418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:55.496423Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1243 [2:7556255601866970153:8886]
2025-10-01T14:10:55.496436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:55.496448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:55.496455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.496458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.496459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.496472Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:55.496479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:55.496483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:55.496527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.496533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.496534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.496536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:55.496538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:55.496589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:55.496594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.496602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.496608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.496617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:55.496635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255601866970148:8886]
2025-10-01T14:10:55.496640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255601866970148:8886]
2025-10-01T14:10:55.496641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255601866970148:8886]
2025-10-01T14:10:55.496652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:55.496664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849097:2446], now have 1 active actors on pipe
2025-10-01T14:10:55.496676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:55.496679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:55.496683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:55.496685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:55.496685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:55.496687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:55.496720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255601866970148:8886]
2025-10-01T14:10:55.496730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:55.496742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:55.496829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1243
2025-10-01T14:10:55.497396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255604243849137:5284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:55.497408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255604243849137:5284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:55.497411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255604243849137:5284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:55.497419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:55.497599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849174:5284], now have 1 active actors on pipe
2025-10-01T14:10:55.497632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1243
2025-10-01T14:10:55.497684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.497692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.497711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:55.497717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.497722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.497724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:55.497731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.497740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:55.497754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.497875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.497881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.497893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.497948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1244 partition: 0 MaxSeqNo: 45 sessionId: src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0
2025-10-01T14:10:55.498266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23fd41a1-5f6a003f-c76e84f8-3bfdaeac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:55.500718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0] Write session: try to update token
2025-10-01T14:10:55.500736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:55.515524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1244 sessionId: src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:55.517296Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:55.517317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:55.517320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:55.517322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:55.517333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255601866970148:8886]
2025-10-01T14:10:55.517339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255601866970148:8886]
2025-10-01T14:10:55.517343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255601866970148:8886]
2025-10-01T14:10:55.517383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:55.517388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:55.517389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:55.517392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:55.517398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.517400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:55.517540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:55.517790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:55.580911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255604243849179:10063]
2025-10-01T14:10:55.581357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1243, pipe: [1:7556255604243849179:10063]
2025-10-01T14:10:55.673022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:55.673270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.673283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.673324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849179:10063], now have 1 active actors on pipe
2025-10-01T14:10:55.673498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:55.673749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255604243849179:10063]
2025-10-01T14:10:55.673782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:55.673852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1244 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0
2025-10-01T14:10:55.674071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1244 sessionId: src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0 is DEAD
2025-10-01T14:10:55.674249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:55.674261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0] Write session will restart in 0.009889s
2025-10-01T14:10:55.674282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0] Write session: Do CDS request
2025-10-01T14:10:55.674289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:55.674291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:55.679895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:55.681212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:55.681390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:55.681403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:55.681413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:55.681457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:55.681500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255601866970236:8890]
2025-10-01T14:10:55.682025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:55.682254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:55.682293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:55.682580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:55.682634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.682640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.682641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.682642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.682643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.682644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.682645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.682646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.682647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.682648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.682649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.682650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.682650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.682652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.682656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.682664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.682667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.682671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.682674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.682677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.682680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.682683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.682686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.682690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.682693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.682697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.682700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.682703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.682709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.682716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.682722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.682727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.682732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.682736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.682740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.682745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.682749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.682753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.682756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.682761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.682765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.682769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.682772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.682777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.682781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.682786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.682789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.682793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.682797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.682802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.682806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.682811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.682815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.682819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.682823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.682827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.682861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:55.684925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.685016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:55.685033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1245
2025-10-01T14:10:55.685167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.685196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:55.685208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:55.685211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:55.685575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1245 sessionId:  describe result for acl check
2025-10-01T14:10:55.685615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:55.685620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:55.685622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:55.685626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255604243849248:5263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:55.686093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255604243849248:5263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:55.686271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:55.687069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:55.687083Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:55.687085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:55.687088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:55.687097Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1244 [2:7556255601866970236:8890]
2025-10-01T14:10:55.687112Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:55.687132Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:55.687139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.687142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.687144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.687156Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:55.687164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:55.687170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:55.687217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.687225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.687227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.687230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:55.687233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:55.687289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:55.687296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.687305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.687312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.687326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:55.687346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849206:2446], now have 1 active actors on pipe
2025-10-01T14:10:55.687356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255601866970231:8890]
2025-10-01T14:10:55.687358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255601866970231:8890]
2025-10-01T14:10:55.687360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255601866970231:8890]
2025-10-01T14:10:55.687378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:55.687379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:55.687381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:55.687383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:55.687364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1244
2025-10-01T14:10:55.687413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:55.687431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:55.687433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:55.687462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255601866970231:8890]
2025-10-01T14:10:55.687472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:55.687478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:55.688257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255604243849248:5263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:55.693983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255604243849248:5263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:55.694006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255604243849248:5263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:55.694009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255604243849248:5263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:55.694017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:55.694230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849283:5263], now have 1 active actors on pipe
2025-10-01T14:10:55.694259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1244
2025-10-01T14:10:55.694304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.694315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.694345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:55.694360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.694395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.694402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:55.694414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.694432Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:55.694454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.694573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.694581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.694611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.694686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1245 partition: 0 MaxSeqNo: 45 sessionId: src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0
2025-10-01T14:10:55.695027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e29b367-5967e109-ab92f106-ed86d0c2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:55.697339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0] Write session: try to update token
2025-10-01T14:10:55.697354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:55.702741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:55.702756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:55.702764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255601866970231:8890]
2025-10-01T14:10:55.702806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:55.702817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:55.702973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:55.703099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:55.703218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:55.703392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:55.703572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:55.703605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:55.711536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1245 sessionId: src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:55.713933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:55.715291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.715313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.715337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:55.715345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:55.715347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:55.715348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:55.715357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255601866970231:8890]
2025-10-01T14:10:55.715363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255601866970231:8890]
2025-10-01T14:10:55.715367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255601866970231:8890]
2025-10-01T14:10:55.715409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:55.715420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:55.715423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:55.715426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:55.715433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.715435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:55.715630Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:55.773721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255604243849288:10063]
2025-10-01T14:10:55.774007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1244, pipe: [1:7556255604243849288:10063]
2025-10-01T14:10:55.857147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:55.857364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:55.857394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849288:10063], now have 1 active actors on pipe
2025-10-01T14:10:55.857506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:55.857544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:55.857587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255604243849288:10063]
2025-10-01T14:10:55.857590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:55.857592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:55.857658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1245 reason: error at write: Disconnected sessionId: src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0
2025-10-01T14:10:55.857827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1245 sessionId: src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0 is DEAD
2025-10-01T14:10:55.857971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:55.857980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0] Write session will restart in 0.008275s
2025-10-01T14:10:55.858004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0] Write session: Do CDS request
2025-10-01T14:10:55.858010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:55.864100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:55.865382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:55.865510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:55.865519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:55.865528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:55.865566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:55.865592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255601866970336:8899]
2025-10-01T14:10:55.865975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:55.866214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:55.866239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:55.866466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:55.866505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.866510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.866510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.866511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.866511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.866512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.866513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.866513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.866514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.866514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.866515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.866515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.866516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.866517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.866520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.866525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.866527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.866530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.866532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.866534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.866536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.866538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.866540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.866542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.866546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.866549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.866552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.866555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.866561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.866569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:55.866574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.866579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:55.866585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.866590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:55.866593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.866596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:55.866599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.866602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:55.866605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.866608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:55.866610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.866613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:55.866615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.866618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:55.866622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.866624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:55.866627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.866629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.866632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.866634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.866637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.866639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.866642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.866645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:55.866647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.866649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:55.866673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:55.867909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.867994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:55.868007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1246
2025-10-01T14:10:55.868109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:55.868134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:55.868142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:55.868146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:55.868447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1246 sessionId:  describe result for acl check
2025-10-01T14:10:55.868473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:55.868477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:55.868478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:55.868481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255604243849345:5256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:55.868856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255604243849345:5256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:55.870114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:55.870641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255604243849345:5256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:55.870722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:55.870736Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:55.870738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:55.870741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:55.870747Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1245 [2:7556255601866970336:8899]
2025-10-01T14:10:55.870760Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:55.870776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:55.870783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.870786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.870788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.870803Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:55.870812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:55.870818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:55.870864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.870870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.870872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.870874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:55.870876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:55.870927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:55.870935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.870945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:55.870956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:55.870974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:55.870993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849291:2446], now have 1 active actors on pipe
2025-10-01T14:10:55.871004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255601866970331:8899]
2025-10-01T14:10:55.871006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255601866970331:8899]
2025-10-01T14:10:55.871008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255601866970331:8899]
2025-10-01T14:10:55.871020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:55.871033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1245
2025-10-01T14:10:55.871037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:55.871039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:55.871041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:55.871043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:55.871052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:55.871055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:55.871079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255601866970331:8899]
2025-10-01T14:10:55.871089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:55.871094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:55.875414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255604243849345:5256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:55.875423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255604243849345:5256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:55.875425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255604243849345:5256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:55.875431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:55.875603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849384:5256], now have 1 active actors on pipe
2025-10-01T14:10:55.875689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1245
2025-10-01T14:10:55.875748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.875756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.875776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:55.875786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:55.875793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:55.875795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:55.875802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:55.875813Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:55.875831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.875956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:55.875962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:55.875972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:55.876027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1246 partition: 0 MaxSeqNo: 45 sessionId: src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0
2025-10-01T14:10:55.876374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66e4d2b8-6c9f4300-440cd116-36954b2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:55.878622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0] Write session: try to update token
2025-10-01T14:10:55.878638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:55.890564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:55.890579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:55.890581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:55.890582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:55.890590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255601866970331:8899]
2025-10-01T14:10:55.890593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255601866970331:8899]
2025-10-01T14:10:55.890596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255601866970331:8899]
2025-10-01T14:10:55.890637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:55.890641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:55.890643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:55.890647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:55.890649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:55.890652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:55.890782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:55.891979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1246 sessionId: src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:55.894332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:55.957562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255604243849388:10063]
2025-10-01T14:10:55.957826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1245, pipe: [1:7556255604243849388:10063]
2025-10-01T14:10:56.032040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:56.032346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.032355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.032397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255604243849388:10063], now have 1 active actors on pipe
2025-10-01T14:10:56.032761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:56.033320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:56.033335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0] Write session will restart in 0.007990s
2025-10-01T14:10:56.033360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0] Write session: Do CDS request
2025-10-01T14:10:56.033365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:56.032891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255604243849388:10063]
2025-10-01T14:10:56.032923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:56.032998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1246 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0
2025-10-01T14:10:56.033179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1246 sessionId: src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0 is DEAD
2025-10-01T14:10:56.033363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:56.039970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:56.041224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:56.041353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:56.041360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:56.041368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:56.041396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:56.041426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255606161937728:8906]
2025-10-01T14:10:56.041795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:56.041971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:56.041995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:56.042184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:56.042220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.042225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.042225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.042226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.042227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.042227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.042228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.042228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.042229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.042229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.042230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.042230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.042231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.042231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.042234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.042240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.042242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.042244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.042246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.042248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.042250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.042252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.042254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.042256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.042260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.042262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.042264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.042265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.042270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.042274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.042278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.042281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.042285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.042288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.042291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.042293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.042296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.042299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.042301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.042305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.042311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.042314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.042316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.042319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.042324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.042326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.042329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.042332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.042337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.042340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.042342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.042348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.042352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.042356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.042360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.042365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.042410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:56.042878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.042930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:56.042943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1247
2025-10-01T14:10:56.043064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.043091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:56.043096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:56.043100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:56.043422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1247 sessionId:  describe result for acl check
2025-10-01T14:10:56.043448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:56.043454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:56.043455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:56.043460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255608538816729:5251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:56.043930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255608538816729:5251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:56.045632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:56.045659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255608538816729:5251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:56.046172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:56.046185Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:56.046187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:56.046190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:56.046194Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1246 [2:7556255606161937728:8906]
2025-10-01T14:10:56.046202Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:56.046214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:56.046219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.046221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.046223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.046232Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:56.046240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:56.046244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:56.046281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.046286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.046288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.046291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:56.046292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:56.046336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:56.046343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.046352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.046361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.046394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:56.046413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816685:2446], now have 1 active actors on pipe
2025-10-01T14:10:56.046424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255606161937723:8906]
2025-10-01T14:10:56.046429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255606161937723:8906]
2025-10-01T14:10:56.046432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255606161937723:8906]
2025-10-01T14:10:56.046445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:56.046460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:56.046459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:56.046462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:56.046463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:56.046436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1246
2025-10-01T14:10:56.046473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:56.046475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:56.046502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255606161937723:8906]
2025-10-01T14:10:56.046511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:56.046526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:56.050771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255608538816729:5251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:56.050783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255608538816729:5251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:56.050785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255608538816729:5251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:56.050790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:56.050967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816767:5251], now have 1 active actors on pipe
2025-10-01T14:10:56.051006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1246
2025-10-01T14:10:56.051052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.051060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.051080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|430ffeda-e478e860-f855efc3-b45759c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:56.051091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.051098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.051101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:56.051109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.051122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:56.051138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.051250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.051256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.051265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.051324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1247 partition: 0 MaxSeqNo: 45 sessionId: src_id|430ffeda-e478e860-f855efc3-b45759c1_0
2025-10-01T14:10:56.051662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e1d7063-39ab9ea9-cc5246a5-1117946e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|430ffeda-e478e860-f855efc3-b45759c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:56.054137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430ffeda-e478e860-f855efc3-b45759c1_0] Write session: try to update token
2025-10-01T14:10:56.054158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430ffeda-e478e860-f855efc3-b45759c1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:56.066527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:56.066551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:56.066554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:56.066556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:56.066567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255606161937723:8906]
2025-10-01T14:10:56.066575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255606161937723:8906]
2025-10-01T14:10:56.066579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255606161937723:8906]
2025-10-01T14:10:56.066627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:56.066619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:56.066635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:56.066638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.066639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:56.066640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:56.066824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:56.066995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1247 sessionId: src_id|430ffeda-e478e860-f855efc3-b45759c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:56.069644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:56.133160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255608538816771:10063]
2025-10-01T14:10:56.133466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1246, pipe: [1:7556255608538816771:10063]
2025-10-01T14:10:56.210587Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:56.210843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.210853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.210900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816771:10063], now have 1 active actors on pipe
2025-10-01T14:10:56.211912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255608538816771:10063]
2025-10-01T14:10:56.211939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:56.211646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:56.212006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1247 reason: status is not ok: tablet will be restarted right now sessionId: src_id|430ffeda-e478e860-f855efc3-b45759c1_0
2025-10-01T14:10:56.212221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1247 sessionId: src_id|430ffeda-e478e860-f855efc3-b45759c1_0 is DEAD
2025-10-01T14:10:56.212381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430ffeda-e478e860-f855efc3-b45759c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:56.212379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:56.212390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430ffeda-e478e860-f855efc3-b45759c1_0] Write session will restart in 0.006064s
2025-10-01T14:10:56.212420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430ffeda-e478e860-f855efc3-b45759c1_0] Write session: Do CDS request
2025-10-01T14:10:56.212426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430ffeda-e478e860-f855efc3-b45759c1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:56.219888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|430ffeda-e478e860-f855efc3-b45759c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.219884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:56.219975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:56.219987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1248
2025-10-01T14:10:56.220075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.220104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:56.220112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:56.220116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:56.220443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1248 sessionId:  describe result for acl check
2025-10-01T14:10:56.220465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:56.220471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:56.220472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:56.220475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255608538816813:5247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:56.220896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255608538816813:5247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:56.221246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:56.221371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:56.221378Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:56.221385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:56.221415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:56.221452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255606161937805:8908]
2025-10-01T14:10:56.221881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:56.222103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:56.222136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:56.222424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:56.222487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.222493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.222496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.222497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.222498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.222499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.222500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.222501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.222502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.222503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.222505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.222506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.222506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.222507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.222512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.222521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.222524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.222528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.222532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.222535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.222539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.222543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.222546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.222550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.222554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.222557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.222561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.222564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.222570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.222577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.222581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.222584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.222587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.222590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.222593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.222596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.222599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.222601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.222603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.222606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.222611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.222613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.222615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.222618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.222620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.222623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.222626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.222629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.222631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.222634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.222636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.222639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.222640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.222644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.222646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.222649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.222667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:56.223038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255608538816813:5247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:56.226077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255608538816813:5247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:56.226100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255608538816813:5247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:56.226104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255608538816813:5247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:56.226113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:56.226290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:56.226859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:56.226869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:56.226870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:56.226875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:56.226880Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1247 [2:7556255606161937805:8908]
2025-10-01T14:10:56.226892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:56.226907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:56.226913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.226916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.226917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.226929Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:56.226936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:56.226940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:56.226979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.226984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.226985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.226987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:56.226989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:56.227037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:56.227043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.227049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.227055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.227066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:56.227083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816852:5247], now have 1 active actors on pipe
2025-10-01T14:10:56.227089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816773:2446], now have 1 active actors on pipe
2025-10-01T14:10:56.227094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255606161937800:8908]
2025-10-01T14:10:56.227099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255606161937800:8908]
2025-10-01T14:10:56.227100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255606161937800:8908]
2025-10-01T14:10:56.227111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:56.227123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:56.227124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:56.227126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:56.227127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:56.227132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:56.227134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:56.227163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255606161937800:8908]
2025-10-01T14:10:56.227170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:56.227172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:56.227138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1247
2025-10-01T14:10:56.227138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1247
2025-10-01T14:10:56.227187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.227195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.227236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:56.227244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.227246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.227249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:56.227255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.227264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:56.227280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.227485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.227491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.227501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.227567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1248 partition: 0 MaxSeqNo: 45 sessionId: src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0
2025-10-01T14:10:56.227881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|430ffeda-e478e860-f855efc3-b45759c1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:56.230140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0] Write session: try to update token
2025-10-01T14:10:56.230157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:56.243453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1248 sessionId: src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:56.245806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:56.246011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.246042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.246081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:56.246149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:56.248023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:56.248038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:56.248041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:56.248043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:56.248051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255606161937800:8908]
2025-10-01T14:10:56.248055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255606161937800:8908]
2025-10-01T14:10:56.248059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255606161937800:8908]
2025-10-01T14:10:56.248105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:56.248109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:56.248117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.248122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:56.248131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:56.248135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:56.248283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:56.311865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255608538816861:10063]
2025-10-01T14:10:56.312107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1247, pipe: [1:7556255608538816861:10063]
2025-10-01T14:10:56.391679Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:56.399867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.399894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.400065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.400116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.400175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.400232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.400270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.400274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.400340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.400395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.400454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.400524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.400566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.400573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.400634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.400686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.400756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.400808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.400844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.400845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.400901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.401064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.401140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.401193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.401234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.401238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.401306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.401385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.401465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.401555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.401605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.401608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.401665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.401718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.401813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.401871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.401923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.401925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.402022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.402074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.402126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.402180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.402221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.402223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.402280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.402334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.402432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.402512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.402572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.402575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.402654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.402724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.402811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.402876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.403009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.403016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.403084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:56.403144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:56.403206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:56.403271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:56.403317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:56.403323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:56.403396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816861:10063], now have 1 active actors on pipe
2025-10-01T14:10:56.403713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255608538816861:10063]
2025-10-01T14:10:56.403742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:56.403748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:56.403753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:56.403793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1248 reason: error at write: Disconnected sessionId: src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0
2025-10-01T14:10:56.403982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1248 sessionId: src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0 is DEAD
2025-10-01T14:10:56.404130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:56.404142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0] Write session will restart in 0.009899s
2025-10-01T14:10:56.404171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0] Write session: Do CDS request
2025-10-01T14:10:56.404178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:56.404537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:56.412506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:56.414347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:56.414574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:56.414586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:56.414597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:56.414649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:56.414690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255606161937884:8910]
2025-10-01T14:10:56.414941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.415034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:56.415051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1249
2025-10-01T14:10:56.415194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.415224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:56.415235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:56.415246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:56.415316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:56.415611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:56.415652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:56.415659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1249 sessionId:  describe result for acl check
2025-10-01T14:10:56.415711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:56.415721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:56.415722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:56.415727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255608538816914:5240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:56.415957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:56.416030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.416040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.416041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.416042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.416043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.416044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.416045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.416046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.416047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.416048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.416049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.416051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.416052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.416053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.416059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.416069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.416073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.416077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.416080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.416086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.416089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.416093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.416097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.416101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.416104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.416108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.416112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.416116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.416122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.416129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.416136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.416141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.416145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.416150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.416154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.416159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.416169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.416174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.416182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.416187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.416192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.416201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.416205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.416214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.416218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.416227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.416231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.416240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.416245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.416254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.416258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.416267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.416274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.416282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.416286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.416289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.416328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255608538816914:5240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:56.416336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:56.418671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255608538816914:5240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:56.420118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:56.420782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:56.420794Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:56.420795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:56.420798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:56.420804Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1248 [2:7556255606161937884:8910]
2025-10-01T14:10:56.420816Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:56.420829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:56.420835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.420837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.420839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.420852Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:56.420855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:56.420860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:56.420913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.420923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.420926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.420930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:56.420932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:56.420991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:56.420997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.421007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.421017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.421031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:56.421100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1248
2025-10-01T14:10:56.421050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255606161937879:8910]
2025-10-01T14:10:56.421057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255606161937879:8910]
2025-10-01T14:10:56.421059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255606161937879:8910]
2025-10-01T14:10:56.421072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:56.421085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816870:2446], now have 1 active actors on pipe
2025-10-01T14:10:56.421088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:56.421091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:56.421092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:56.421094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:56.421100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:56.421102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:56.421131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255606161937879:8910]
2025-10-01T14:10:56.421133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:56.421134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:56.421738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255608538816914:5240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:56.421753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255608538816914:5240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:56.421756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255608538816914:5240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:56.421765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:56.421997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816951:5240], now have 1 active actors on pipe
2025-10-01T14:10:56.422046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1248
2025-10-01T14:10:56.422099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.422107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.422127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|650a92d5-28ef6351-d005d20f-e52f10af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:56.422138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.422141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.422144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:56.422152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.422164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:56.422184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.422308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.422316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.422327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.422406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1249 partition: 0 MaxSeqNo: 45 sessionId: src_id|650a92d5-28ef6351-d005d20f-e52f10af_0
2025-10-01T14:10:56.422829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|333ceeda-ccb06cd8-e4122f96-41486d5a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|650a92d5-28ef6351-d005d20f-e52f10af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:56.425606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|650a92d5-28ef6351-d005d20f-e52f10af_0] Write session: try to update token
2025-10-01T14:10:56.425627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|650a92d5-28ef6351-d005d20f-e52f10af_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:56.442339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:56.442361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:56.442367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:56.442384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:56.442394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255606161937879:8910]
2025-10-01T14:10:56.442398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255606161937879:8910]
2025-10-01T14:10:56.442402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255606161937879:8910]
2025-10-01T14:10:56.442447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:56.442454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:56.442461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:56.442463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.442464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:56.442465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:56.442594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:56.444861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1249 sessionId: src_id|650a92d5-28ef6351-d005d20f-e52f10af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:56.447724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:56.503897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255608538816958:10063]
2025-10-01T14:10:56.504166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1248, pipe: [1:7556255608538816958:10063]
2025-10-01T14:10:56.601306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:56.601854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.601866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.601917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816958:10063], now have 1 active actors on pipe
2025-10-01T14:10:56.602928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:56.602945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:56.603011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1249 reason: error at write: Disconnected sessionId: src_id|650a92d5-28ef6351-d005d20f-e52f10af_0
2025-10-01T14:10:56.603221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1249 sessionId: src_id|650a92d5-28ef6351-d005d20f-e52f10af_0 is DEAD
2025-10-01T14:10:56.603382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:56.603425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255608538816958:10063]
2025-10-01T14:10:56.603902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|650a92d5-28ef6351-d005d20f-e52f10af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:56.603913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|650a92d5-28ef6351-d005d20f-e52f10af_0] Write session will restart in 0.006047s
2025-10-01T14:10:56.603944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|650a92d5-28ef6351-d005d20f-e52f10af_0] Write session: Do CDS request
2025-10-01T14:10:56.603954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|650a92d5-28ef6351-d005d20f-e52f10af_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:56.611524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:56.612529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|650a92d5-28ef6351-d005d20f-e52f10af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.613037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:56.613052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1250
2025-10-01T14:10:56.613396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.613434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:56.613441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:56.613445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:56.613976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1250 sessionId:  describe result for acl check
2025-10-01T14:10:56.614013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:56.614015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:56.614020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:56.614025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255608538816975:5232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:56.614611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255608538816975:5232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:56.624503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:56.627647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:56.627909Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:56.627917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:56.627931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:56.628006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:56.628047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255606161937968:8913]
2025-10-01T14:10:56.628653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:56.629898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255608538816975:5232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:56.631565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:56.631637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:56.631995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:56.632064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.632065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.632066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.632067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.632068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.632070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.632071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.632072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.632074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.632075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.632076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.632078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.632079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.632081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.632088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.632097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.632101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.632105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.632108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.632112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.632117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.632120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.632123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.632127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.632130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.632133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.632136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.632139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.632147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.632154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.632162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.632168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.632172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.632177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.632182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.632186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.632191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.632196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.632199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.632203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.632208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.632213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.632223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.632227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.632231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.632236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.632242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.632246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.632250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.632255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.632258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.632266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.632270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.632274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.632278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.632283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.632317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:56.635154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255608538816975:5232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:56.635170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255608538816975:5232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:56.635173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255608538816975:5232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:56.635183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:56.637296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:56.638168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:56.638183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:56.638186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:56.638190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:56.638197Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1249 [2:7556255606161937968:8913]
2025-10-01T14:10:56.638218Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:56.638237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:56.638248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.638252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.638254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.638272Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:56.638286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:56.638294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:56.638346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.638353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.638355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.638361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:56.638364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:56.638454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:56.638461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.638474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.638488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.638508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:56.638529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255606161937962:8913]
2025-10-01T14:10:56.638535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255606161937962:8913]
2025-10-01T14:10:56.638537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255606161937962:8913]
2025-10-01T14:10:56.638553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:56.638570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:56.638589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:56.638595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:56.638634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255606161937962:8913]
2025-10-01T14:10:56.638639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:56.638926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:56.638934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:56.638936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:56.638942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:56.639245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1249
2025-10-01T14:10:56.639285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1249
2025-10-01T14:10:56.639394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538816960:2446], now have 1 active actors on pipe
2025-10-01T14:10:56.639403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538817041:5232], now have 1 active actors on pipe
2025-10-01T14:10:56.639420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.639426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.639457Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f01aabe4-6fbdce62-c4698033-f312db75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:56.639465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.639471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.639473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:56.639483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.639496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:56.639513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.639845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.639852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.639869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.642238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1250 partition: 0 MaxSeqNo: 45 sessionId: src_id|f01aabe4-6fbdce62-c4698033-f312db75_0
2025-10-01T14:10:56.646558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|650a92d5-28ef6351-d005d20f-e52f10af_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f01aabe4-6fbdce62-c4698033-f312db75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:56.649205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01aabe4-6fbdce62-c4698033-f312db75_0] Write session: try to update token
2025-10-01T14:10:56.649229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01aabe4-6fbdce62-c4698033-f312db75_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:56.669356Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:56.669739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:56.669755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:56.669760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:56.669782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255606161937962:8913]
2025-10-01T14:10:56.669789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255606161937962:8913]
2025-10-01T14:10:56.669799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255606161937962:8913]
2025-10-01T14:10:56.669875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:56.669884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.669887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:56.670223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:56.673183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:56.673194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:56.673199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:56.679075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1250 sessionId: src_id|f01aabe4-6fbdce62-c4698033-f312db75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:56.682171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:56.703735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255608538817061:10063]
2025-10-01T14:10:56.706775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1249, pipe: [1:7556255608538817061:10063]
2025-10-01T14:10:56.838565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:56.838971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.838982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.839029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538817061:10063], now have 1 active actors on pipe
2025-10-01T14:10:56.842899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:56.846763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:56.846826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255608538817061:10063]
2025-10-01T14:10:56.846851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:56.846948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1250 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f01aabe4-6fbdce62-c4698033-f312db75_0
2025-10-01T14:10:56.847169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1250 sessionId: src_id|f01aabe4-6fbdce62-c4698033-f312db75_0 is DEAD
2025-10-01T14:10:56.848789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01aabe4-6fbdce62-c4698033-f312db75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:56.848803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01aabe4-6fbdce62-c4698033-f312db75_0] Write session will restart in 0.006565s
2025-10-01T14:10:56.848835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01aabe4-6fbdce62-c4698033-f312db75_0] Write session: Do CDS request
2025-10-01T14:10:56.848843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01aabe4-6fbdce62-c4698033-f312db75_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:56.857386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01aabe4-6fbdce62-c4698033-f312db75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.857833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:56.857849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1251
2025-10-01T14:10:56.858051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:56.858081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:56.858086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:56.858090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:56.858600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1251 sessionId:  describe result for acl check
2025-10-01T14:10:56.858639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:56.858641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:56.858643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:56.858649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255608538817085:5216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:56.859203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255608538817085:5216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:56.864483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255608538817085:5216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:56.876102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255608538817085:5216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:56.876120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255608538817085:5216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:56.876123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255608538817085:5216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:56.876132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:56.906812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:56.907072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:56.907291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:56.907296Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:56.907309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:56.907359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:56.907396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255606161938086:8918]
2025-10-01T14:10:56.908028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:56.908535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:56.908575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:56.908920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:56.908977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.908978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.908980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.908982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.908983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.908984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.908986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.908987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.908988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.908992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.908993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.908994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.908996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.908997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.909003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.909012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.909016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.909019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.909023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.909026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.909030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.909033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.909037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.909041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.909044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.909048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.909052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.909057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.909063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.909071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:56.909077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.909082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:56.909086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.909091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:56.909094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.909099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:56.909103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.909107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:56.909111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.909116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:56.909125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.909130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:56.909133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.909138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:56.909142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.909162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:56.909166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.909171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.909175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.909180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.909183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.909188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.909192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.909196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:56.909200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.909206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:56.909245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:56.916637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1250
2025-10-01T14:10:56.916668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1250
2025-10-01T14:10:56.914539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:56.915287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:56.915294Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:56.915296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:56.915300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:56.915308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1250 [2:7556255606161938086:8918]
2025-10-01T14:10:56.915326Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:56.915345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:56.915350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.915353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.915355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.915376Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:56.915382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:56.915392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:56.915455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.915456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.915458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.915462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:56.915464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:56.915540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:56.915543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:56.915555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:56.915565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:56.915580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:56.915598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255606161938080:8918]
2025-10-01T14:10:56.915600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255606161938080:8918]
2025-10-01T14:10:56.915602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255606161938080:8918]
2025-10-01T14:10:56.915614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:56.915630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:56.915643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:56.915646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:56.915685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255606161938080:8918]
2025-10-01T14:10:56.915687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:56.915893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:56.915895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:56.915897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:56.915902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:56.930457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538817135:5216], now have 1 active actors on pipe
2025-10-01T14:10:56.930485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538817079:2446], now have 1 active actors on pipe
2025-10-01T14:10:56.930518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.930526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.930569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|677da04-9b7e9de5-5c935307-ab850f1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:56.930585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:56.930592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:56.930594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:56.930608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:56.930627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:56.930651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.931040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.931046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.931058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:56.931172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1251 partition: 0 MaxSeqNo: 45 sessionId: src_id|677da04-9b7e9de5-5c935307-ab850f1a_0
2025-10-01T14:10:56.934508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01aabe4-6fbdce62-c4698033-f312db75_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|677da04-9b7e9de5-5c935307-ab850f1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:56.937578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|677da04-9b7e9de5-5c935307-ab850f1a_0] Write session: try to update token
2025-10-01T14:10:56.937605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|677da04-9b7e9de5-5c935307-ab850f1a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:56.953507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:56.953529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:56.953540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255606161938080:8918]
2025-10-01T14:10:56.953586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:56.954478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255608538817178:10063]
2025-10-01T14:10:56.957612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1250, pipe: [1:7556255608538817178:10063]
2025-10-01T14:10:56.953812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:56.953977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:56.954125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:56.954277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:56.954471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:56.954506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:56.954544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:56.958746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255608538817178:10063], now have 1 active actors on pipe
2025-10-01T14:10:56.990409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1251 sessionId: src_id|677da04-9b7e9de5-5c935307-ab850f1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:56.993101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:56.996863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:56.996885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:56.999902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:56.999932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:56.999936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:56.999939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:56.999942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:56.999954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255606161938080:8918]
2025-10-01T14:10:56.999959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255606161938080:8918]
2025-10-01T14:10:56.999964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255606161938080:8918]
2025-10-01T14:10:57.000055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:57.000059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:57.000064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:57.002053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:57.002061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.002064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:57.002248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:57.002840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:57.179561Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:57.189905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.189939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.190112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.190170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.190228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.190301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.190347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.190353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.190488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.190552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.190613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.190677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.190722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.190726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.190802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.190896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.190968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.191030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.191075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.191078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.191186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.191251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.191314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.191394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.191442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.191448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.191573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.191673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.191774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.191858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.191963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.191966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.192080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.192177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.192242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.192307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.192362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.192365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.192435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.192491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.192560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.192622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.192668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.192671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.192759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.192818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.192881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.192945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.193078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.193082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.193150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.193208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.193268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.193333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.193376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.193381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.193451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.193509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.193568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.193629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.193756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.193759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.195582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:57.196166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255608538817178:10063]
2025-10-01T14:10:57.196207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:57.196230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:57.196271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1251 reason: status is not ok: tablet will be restarted right now sessionId: src_id|677da04-9b7e9de5-5c935307-ab850f1a_0
2025-10-01T14:10:57.196494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1251 sessionId: src_id|677da04-9b7e9de5-5c935307-ab850f1a_0 is DEAD
2025-10-01T14:10:57.196845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677da04-9b7e9de5-5c935307-ab850f1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:57.196858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677da04-9b7e9de5-5c935307-ab850f1a_0] Write session will restart in 0.006346s
2025-10-01T14:10:57.196885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677da04-9b7e9de5-5c935307-ab850f1a_0] Write session: Do CDS request
2025-10-01T14:10:57.196891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677da04-9b7e9de5-5c935307-ab850f1a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:57.210821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|677da04-9b7e9de5-5c935307-ab850f1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.211588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:57.211603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1252
2025-10-01T14:10:57.211758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.211789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:57.211794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:57.211798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:57.212257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1252 sessionId:  describe result for acl check
2025-10-01T14:10:57.212296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:57.212297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:57.212299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:57.212305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255612833784498:5205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:57.212878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255612833784498:5205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:57.218258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255612833784498:5205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:57.223421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:57.226258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:57.226542Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:57.226547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:57.226559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:57.226617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:57.226667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255610456905481:8931]
2025-10-01T14:10:57.227128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255612833784498:5205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:57.227145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255612833784498:5205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:57.227148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255612833784498:5205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:57.227155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:57.227324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:57.227622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:57.227670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:57.228008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:57.228066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.228076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.228077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.228078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.228079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.228081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.228082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.228083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.228084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.228086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.228087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.228088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.228089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.228091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.228097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.228106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.228110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.228114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.228118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.228121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.228125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.228131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.228135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.228140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.228143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.228147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.228150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.228153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.228161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.228169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.228175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.228180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.228185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.228190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.228194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.228200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.228203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.228208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.228214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.228219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.228224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.228229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.228233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.228238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.228243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.228248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.228252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.228257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.228261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.228266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.228270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.228275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.228281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.228286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.228290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.228295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.228333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:57.234125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:57.234897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:57.234906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:57.234909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:57.234913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:57.234921Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1251 [2:7556255610456905481:8931]
2025-10-01T14:10:57.234940Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:57.234959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:57.234963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.234967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.234969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.234988Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:57.234993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:57.235001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:57.235077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.235078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.235081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.235084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:57.235090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:57.235165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:57.235168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.235180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.235193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.235209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:57.235227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255610456905475:8931]
2025-10-01T14:10:57.235229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255610456905475:8931]
2025-10-01T14:10:57.235231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255610456905475:8931]
2025-10-01T14:10:57.235240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:57.235255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:57.235259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:57.235262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:57.235265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:57.235269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:57.235274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:57.235286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784560:5205], now have 1 active actors on pipe
2025-10-01T14:10:57.235290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784485:2446], now have 1 active actors on pipe
2025-10-01T14:10:57.235328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255610456905475:8931]
2025-10-01T14:10:57.235337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:57.235347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:57.237991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1251
2025-10-01T14:10:57.238030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1251
2025-10-01T14:10:57.238540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.238565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.238605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bcbed75-be51b026-c9c3611f-61941776_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:57.238623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.238630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.238633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:57.238647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.238664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:57.238686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.243477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.243501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.243540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.243757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1252 partition: 0 MaxSeqNo: 45 sessionId: src_id|7bcbed75-be51b026-c9c3611f-61941776_0
2025-10-01T14:10:57.246139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677da04-9b7e9de5-5c935307-ab850f1a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7bcbed75-be51b026-c9c3611f-61941776_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:57.248998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bcbed75-be51b026-c9c3611f-61941776_0] Write session: try to update token
2025-10-01T14:10:57.249021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bcbed75-be51b026-c9c3611f-61941776_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:57.267386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:57.267409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:57.267411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:57.267413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:57.267427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255610456905475:8931]
2025-10-01T14:10:57.267432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255610456905475:8931]
2025-10-01T14:10:57.267435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255610456905475:8931]
2025-10-01T14:10:57.267495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:57.267507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.267508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:57.267509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:57.267515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:57.267519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:57.267700Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:57.266927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1252 sessionId: src_id|7bcbed75-be51b026-c9c3611f-61941776_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:57.269583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:57.296400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255612833784573:10063]
2025-10-01T14:10:57.296694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1251, pipe: [1:7556255612833784573:10063]
2025-10-01T14:10:57.421809Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:57.422074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.422085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.422120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784573:10063], now have 1 active actors on pipe
2025-10-01T14:10:57.422289Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:57.422340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:57.422357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:57.422440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1252 reason: error at write: Disconnected sessionId: src_id|7bcbed75-be51b026-c9c3611f-61941776_0
2025-10-01T14:10:57.422443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255612833784573:10063]
2025-10-01T14:10:57.422463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:57.422766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1252 sessionId: src_id|7bcbed75-be51b026-c9c3611f-61941776_0 is DEAD
2025-10-01T14:10:57.422788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bcbed75-be51b026-c9c3611f-61941776_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:57.422806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bcbed75-be51b026-c9c3611f-61941776_0] Write session will restart in 0.009229s
2025-10-01T14:10:57.422829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bcbed75-be51b026-c9c3611f-61941776_0] Write session: Do CDS request
2025-10-01T14:10:57.422834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bcbed75-be51b026-c9c3611f-61941776_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:57.431297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:57.432991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bcbed75-be51b026-c9c3611f-61941776_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.433009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:57.433024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1253
2025-10-01T14:10:57.433071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:57.433220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.433249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:57.433258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:57.433262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:57.433322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:57.433332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:57.433343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:57.433394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:57.433430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255610456905563:8933]
2025-10-01T14:10:57.433625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1253 sessionId:  describe result for acl check
2025-10-01T14:10:57.433667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:57.433672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:57.433675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:57.433679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255612833784629:5200] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:57.433915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:57.434121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255612833784629:5200] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:57.434158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:57.434204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:57.434527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:57.434587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.434592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.434593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.434594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.434596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.434597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.434598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.434599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.434600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.434602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.434603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.434603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.434604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.434605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.434610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.434618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.434622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.434625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.434628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.434631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.434634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.434638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.434641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.434644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.434647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.434652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.434656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.434659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.434665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.434672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.434678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.434682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.434685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.434690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.434693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.434698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.434702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.434707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.434711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.434716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.434720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.434726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.434730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.434734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.434738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.434743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.434746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.434751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.434754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.434758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.434762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.434767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.434772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.434777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.434781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.434793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.434829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:57.436120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255612833784629:5200] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:57.438678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:57.439018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255612833784629:5200] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:57.439034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255612833784629:5200] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:57.439037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255612833784629:5200] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:57.439044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:57.439293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:57.439307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:57.439309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:57.439312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:57.439318Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1252 [2:7556255610456905563:8933]
2025-10-01T14:10:57.439330Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:57.439345Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:57.439350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.439353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.439354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.439371Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:57.439382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:57.439388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:57.439447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.439454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.439456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.439459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:57.439462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:57.439529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:57.439538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.439549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.439561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.439576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:57.439604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784583:2446], now have 1 active actors on pipe
2025-10-01T14:10:57.439612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784667:5200], now have 1 active actors on pipe
2025-10-01T14:10:57.439618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255610456905558:8933]
2025-10-01T14:10:57.439621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255610456905558:8933]
2025-10-01T14:10:57.439622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255610456905558:8933]
2025-10-01T14:10:57.439642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1252
2025-10-01T14:10:57.439654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1252
2025-10-01T14:10:57.439636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:57.439653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:57.439654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:57.439656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:57.439658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:57.439669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:57.439671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:57.439707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255610456905558:8933]
2025-10-01T14:10:57.439714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:57.439719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:57.439735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.439744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.439792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:57.439803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.439807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.439809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:57.439818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.439827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:57.439848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.439977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.439984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.439997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.440061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1253 partition: 0 MaxSeqNo: 45 sessionId: src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0
2025-10-01T14:10:57.440395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bcbed75-be51b026-c9c3611f-61941776_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:57.442988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0] Write session: try to update token
2025-10-01T14:10:57.443012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:57.457920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1253 sessionId: src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:57.460439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:57.461327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.461356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.461379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:57.461383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:57.461387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:57.461389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:57.461402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255610456905558:8933]
2025-10-01T14:10:57.461408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255610456905558:8933]
2025-10-01T14:10:57.461412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255610456905558:8933]
2025-10-01T14:10:57.461452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:57.461465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:57.461470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:57.461475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:57.461483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.461486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:57.461644Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:57.522723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255612833784675:10063]
2025-10-01T14:10:57.522948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1252, pipe: [1:7556255612833784675:10063]
2025-10-01T14:10:57.598505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:57.598798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:57.598846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784675:10063], now have 1 active actors on pipe
2025-10-01T14:10:57.598936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:57.598973Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:57.599031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:57.599034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255612833784675:10063]
2025-10-01T14:10:57.599038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:57.599105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1253 reason: error at write: Disconnected sessionId: src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0
2025-10-01T14:10:57.599245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1253 sessionId: src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0 is DEAD
2025-10-01T14:10:57.599414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:57.599438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0] Write session will restart in 0.008723s
2025-10-01T14:10:57.599465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0] Write session: Do CDS request
2025-10-01T14:10:57.599471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:57.605937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:57.607624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:57.607784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:57.607793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:57.607801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:57.607834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:57.607866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255610456905649:8936]
2025-10-01T14:10:57.608289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:57.608546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:57.608588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:57.608900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:57.608934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.608959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.608965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.608966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.608968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.608969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.608970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.608971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.608972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.608973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.608974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.608976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.608977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.608978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.608979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.608984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.608994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.608998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.609002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.609009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.609013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.609017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.609021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.609025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.609028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.609032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.609036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.609038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:57.609050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1254
2025-10-01T14:10:57.609040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.609044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.609051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.609059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.609065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.609070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.609075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.609080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.609086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.609091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.609096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.609101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.609106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.609112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.609117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.609122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.609127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.609132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.609137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.609142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.609146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.609152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.609163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.609156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.609169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.609177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.609182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.609187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:57.609186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.609196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:57.609196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.609201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.609200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:57.609206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.609249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:57.609523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1254 sessionId:  describe result for acl check
2025-10-01T14:10:57.609549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:57.609553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:57.609554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:57.609558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255612833784727:5195] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:57.610083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255612833784727:5195] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:57.611873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255612833784727:5195] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:57.612837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:57.613404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:57.613418Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:57.613421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:57.613424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:57.613430Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1253 [2:7556255610456905649:8936]
2025-10-01T14:10:57.613443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:57.613458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:57.613461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.613464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.613466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.613481Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:57.613492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:57.613497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:57.613551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.613559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.613561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.613563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:57.613567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:57.613628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:57.613635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.613645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.613660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.613679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:57.613692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1253
2025-10-01T14:10:57.613701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784676:2446], now have 1 active actors on pipe
2025-10-01T14:10:57.613714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255610456905644:8936]
2025-10-01T14:10:57.613716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255610456905644:8936]
2025-10-01T14:10:57.613718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255610456905644:8936]
2025-10-01T14:10:57.613731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:57.613744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:57.613745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:57.613747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:57.613748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:57.613762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:57.613769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:57.613798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255610456905644:8936]
2025-10-01T14:10:57.613808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:57.613819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:57.613924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255612833784727:5195] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:57.613935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255612833784727:5195] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:57.613938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255612833784727:5195] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:57.613943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:57.614092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784763:5195], now have 1 active actors on pipe
2025-10-01T14:10:57.614122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1253
2025-10-01T14:10:57.614176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.614186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.614213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56626bc3-6807341e-3bcb1955-2052deb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:57.614224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.614231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.614234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:57.614247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.614261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:57.614276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.614411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.614424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.614443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.614515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1254 partition: 0 MaxSeqNo: 45 sessionId: src_id|56626bc3-6807341e-3bcb1955-2052deb6_0
2025-10-01T14:10:57.614826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bae9219-354280bb-b246dfc4-a2eb61d8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|56626bc3-6807341e-3bcb1955-2052deb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:57.617249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56626bc3-6807341e-3bcb1955-2052deb6_0] Write session: try to update token
2025-10-01T14:10:57.617266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56626bc3-6807341e-3bcb1955-2052deb6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:57.630531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1254 sessionId: src_id|56626bc3-6807341e-3bcb1955-2052deb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:57.632624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:57.632876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.632899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.632918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:57.632921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:57.632922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:57.632923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:57.632929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255610456905644:8936]
2025-10-01T14:10:57.632938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255610456905644:8936]
2025-10-01T14:10:57.632940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255610456905644:8936]
2025-10-01T14:10:57.632967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:57.632977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:57.632980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:57.632982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:57.632987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.632989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:57.633108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:57.699365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255612833784770:10063]
2025-10-01T14:10:57.699601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1253, pipe: [1:7556255612833784770:10063]
2025-10-01T14:10:57.767117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:57.767334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:57.767377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784770:10063], now have 1 active actors on pipe
2025-10-01T14:10:57.767475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:57.767523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:57.767550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:57.767556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:57.767567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255612833784770:10063]
2025-10-01T14:10:57.767621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1254 reason: error at write: Disconnected sessionId: src_id|56626bc3-6807341e-3bcb1955-2052deb6_0
2025-10-01T14:10:57.767752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1254 sessionId: src_id|56626bc3-6807341e-3bcb1955-2052deb6_0 is DEAD
2025-10-01T14:10:57.767910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56626bc3-6807341e-3bcb1955-2052deb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:57.767922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56626bc3-6807341e-3bcb1955-2052deb6_0] Write session will restart in 0.008903s
2025-10-01T14:10:57.767947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56626bc3-6807341e-3bcb1955-2052deb6_0] Write session: Do CDS request
2025-10-01T14:10:57.767957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56626bc3-6807341e-3bcb1955-2052deb6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:57.774543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:57.776002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:57.776179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:57.776189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:57.776200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:57.776243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:57.776277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255610456905746:8939]
2025-10-01T14:10:57.776868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:57.777159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:57.777194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:57.777502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:57.777553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.777560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.777561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.777562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.777563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.777565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.777566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.777567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.777567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.777569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.777570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.777571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.777572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.777575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.777580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.777589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.777593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.777596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.777599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.777603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.777606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.777608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.777612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.777616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.777619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.777622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.777624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.777627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.777632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.777639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.777644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.777648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.777652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.777656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.777659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.777664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.777668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.777673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.777677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.777681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.777685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.777690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.777694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.777698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.777705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.777709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.777713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.777731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.777741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.777746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.777754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.777758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.777762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.777772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.777775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.777783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.777824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:57.777886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56626bc3-6807341e-3bcb1955-2052deb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.777985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:57.777999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1255
2025-10-01T14:10:57.778104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.778134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:57.778145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:57.778148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:57.778488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1255 sessionId:  describe result for acl check
2025-10-01T14:10:57.778521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:57.778523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:57.778525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:57.778529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255612833784829:5177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:57.778985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255612833784829:5177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:57.780835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255612833784829:5177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:57.781421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:57.782044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:57.782064Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:57.782066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:57.782069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:57.782075Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1254 [2:7556255610456905746:8939]
2025-10-01T14:10:57.782090Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:57.782108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:57.782114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.782116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.782118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.782130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:57.782137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:57.782141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:57.782192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.782198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.782199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.782202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:57.782203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:57.782258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:57.782264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.782275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.782289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.782308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:57.782327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784773:2446], now have 1 active actors on pipe
2025-10-01T14:10:57.782335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1254
2025-10-01T14:10:57.782339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255610456905741:8939]
2025-10-01T14:10:57.782341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255610456905741:8939]
2025-10-01T14:10:57.782342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255610456905741:8939]
2025-10-01T14:10:57.782352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:57.782360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:57.782363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:57.782365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:57.782366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:57.782393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:57.782395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:57.782429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255610456905741:8939]
2025-10-01T14:10:57.782439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:57.782448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:57.782884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255612833784829:5177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:57.782895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255612833784829:5177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:57.782899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255612833784829:5177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:57.782906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:57.783265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784874:5177], now have 1 active actors on pipe
2025-10-01T14:10:57.783291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1254
2025-10-01T14:10:57.783352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.783362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.783389Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:57.783401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.783405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.783408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:57.783417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.783435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:57.783453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.783578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.783585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.783596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.783656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1255 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0
2025-10-01T14:10:57.784049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56626bc3-6807341e-3bcb1955-2052deb6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:57.786575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0] Write session: try to update token
2025-10-01T14:10:57.786592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:57.792681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:57.792706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:57.792716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255610456905741:8939]
2025-10-01T14:10:57.792761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:57.792761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:57.792933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:57.793101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:57.793242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:57.793412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:57.793608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:57.793653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:57.799836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1255 sessionId: src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:57.802228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:57.802441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.802472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.802512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:57.802597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:57.812563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:57.812585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:57.812587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:57.812588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:57.812598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255610456905741:8939]
2025-10-01T14:10:57.812601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255610456905741:8939]
2025-10-01T14:10:57.812603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255610456905741:8939]
2025-10-01T14:10:57.812654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:57.812663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:57.812665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.812667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:57.812675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:57.812679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:57.812830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:57.867834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255612833784890:10063]
2025-10-01T14:10:57.868105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1254, pipe: [1:7556255612833784890:10063]
2025-10-01T14:10:57.958278Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:57.966681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.966706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.966871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.966932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.967001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.967069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.967114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.967123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.967190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.967256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.967310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.967375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.967420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.967427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.967520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.967610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.967671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.967737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.967779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.967785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.967889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.967975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.968057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.968121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.968164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.968172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.968273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.968336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.968399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.968463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.968502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.968508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.968570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.968633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.968710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.968772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.968824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.968830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.968901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.968984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.969047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.969141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.969194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.969202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.969274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.969338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.971765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:57.971778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0] Write session will restart in 0.007267s
2025-10-01T14:10:57.971122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:57.971174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255612833784890:10063]
2025-10-01T14:10:57.971194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:57.971804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0] Write session: Do CDS request
2025-10-01T14:10:57.971197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:57.971434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1255 reason: error at write: Disconnected sessionId: src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0
2025-10-01T14:10:57.971811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:57.969406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.969477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.969584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.969587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.969651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.969707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.969767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.969826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.969926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.969929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.970000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:57.970057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:57.970116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:57.970182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:57.970307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:57.970311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:57.970396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784890:10063], now have 1 active actors on pipe
2025-10-01T14:10:57.971449Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:57.971639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1255 sessionId: src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0 is DEAD
2025-10-01T14:10:57.979900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.980169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:57.980183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1256
2025-10-01T14:10:57.980343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:57.980377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:57.980382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:57.980385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:57.980758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1256 sessionId:  describe result for acl check
2025-10-01T14:10:57.980788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:57.980790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:57.980792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:57.980797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255612833784953:5164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:57.981272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255612833784953:5164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:57.983223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255612833784953:5164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:57.982217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:57.982858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:57.983009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:57.983013Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:57.983024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:57.983067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:57.983099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255610456905843:8944]
2025-10-01T14:10:57.983666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:57.984190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:57.984227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:57.984522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:57.984570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.984570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.984571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.984572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.984573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.984584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.984585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.984586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.984587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.984588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.984589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.984590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.984591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.984592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.984596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.984605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.984609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.984613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.984616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.984620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.984624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.984627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.984631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.984634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.984638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.984641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.984644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.984648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.984653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.984661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:57.984667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.984674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:57.984678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.984682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:57.984687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.984692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:57.984696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.984710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:57.984713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.984718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:57.984722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.984727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:57.984731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.984735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:57.984739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.984743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:57.984747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.984751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.984755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.984759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.984763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.984768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.984772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.984776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:57.984780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.984785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:57.984823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:57.989099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255612833784953:5164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:57.989119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255612833784953:5164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:57.989123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255612833784953:5164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:57.989132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:57.989366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:57.989954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:57.989970Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:57.989973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:57.989977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:57.989984Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1255 [2:7556255610456905843:8944]
2025-10-01T14:10:57.990004Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:57.990025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:57.990032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.990036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.990038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.990055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:57.990064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:57.990073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:57.990126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.990133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.990135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.990137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:57.990140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:57.990205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:57.990211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:57.990224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:57.990239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:57.990259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:57.990325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1255
2025-10-01T14:10:57.990332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1255
2025-10-01T14:10:57.991398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784992:5164], now have 1 active actors on pipe
2025-10-01T14:10:57.991413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255612833784908:2446], now have 1 active actors on pipe
2025-10-01T14:10:57.991422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255610456905836:8944]
2025-10-01T14:10:57.991425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255610456905836:8944]
2025-10-01T14:10:57.991427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255610456905836:8944]
2025-10-01T14:10:57.991442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:57.991457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:57.991459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:57.991461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:57.991470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.991480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.991508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:57.991529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:57.991535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:57.991582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:57.991595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:57.991600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:57.991602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:57.991611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:57.991622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:57.991630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255610456905836:8944]
2025-10-01T14:10:57.991641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:57.991669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.991677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:57.991990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:57.992004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:57.992026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:57.992160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1256 partition: 0 MaxSeqNo: 45 sessionId: src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0
2025-10-01T14:10:57.992536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b9abed0-b655d18-39e66d38-b4be5bbf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:57.995202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0] Write session: try to update token
2025-10-01T14:10:57.995216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:58.005378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:58.005401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:58.005410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255610456905836:8944]
2025-10-01T14:10:58.005456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:58.005637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:58.005785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:58.005924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:58.006060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:58.006456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:58.006494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:58.006644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:58.015151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1256 sessionId: src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:58.017540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:58.017752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.017772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.017808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:58.017896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:58.024696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:58.024723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:58.024726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:58.024729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:58.024740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255610456905836:8944]
2025-10-01T14:10:58.024743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255610456905836:8944]
2025-10-01T14:10:58.024746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255610456905836:8944]
2025-10-01T14:10:58.024794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:58.024805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.024808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:58.024934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:58.025104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:58.025117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:58.025120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:58.069562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255617128752295:10063]
2025-10-01T14:10:58.069846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1255, pipe: [1:7556255617128752295:10063]
2025-10-01T14:10:58.169607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:58.177608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.177641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.177812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.177877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.177945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.178015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.178274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.178284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.178353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.178441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.178504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.178571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.178614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.178621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.178692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.178755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.178826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.178889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.178933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.178940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.179002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.179064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.179127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.179184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.179229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.179235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.179296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.179353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.179413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.179477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.179521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.179529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.179587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.179643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.179709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.179773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.179820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.179826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.179888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.179970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.180032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.180096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.180140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.180147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.180212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.180271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.180345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.180405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.180458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.180464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.180535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.180599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.180665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.180740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.180786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.180792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.180859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.180921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.180988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.181051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.181093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.181099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.181160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752295:10063], now have 1 active actors on pipe
2025-10-01T14:10:58.181440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255617128752295:10063]
2025-10-01T14:10:58.181444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:58.181449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:58.181473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1256 reason: error at write: Disconnected sessionId: src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0
2025-10-01T14:10:58.181476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:58.181675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1256 sessionId: src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0 is DEAD
2025-10-01T14:10:58.181857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:58.181869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0] Write session will restart in 0.008004s
2025-10-01T14:10:58.181895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0] Write session: Do CDS request
2025-10-01T14:10:58.181902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:58.181997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:58.189578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:58.190932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.191024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:58.191038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1257
2025-10-01T14:10:58.191049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:58.191173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.191197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:58.191204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:58.191217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:58.191226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:58.191236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:58.191246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:58.191284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:58.191320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255614751873255:8956]
2025-10-01T14:10:58.191527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1257 sessionId:  describe result for acl check
2025-10-01T14:10:58.191549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:58.191553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:58.191554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:58.191558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255617128752347:5158] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:58.191896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:58.192067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255617128752347:5158] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:58.192175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:58.192209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:58.192485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:58.192533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.192538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.192539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.192540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.192541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.192542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.192543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.192544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.192545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.192546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.192547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.192548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.192549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.192550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.192554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.192562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.192565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.192568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.192572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.192575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.192578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.192581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.192584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.192588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.192591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.192594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.192596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.192599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.192605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.192612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.192618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.192622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.192626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.192630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.192634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.192638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.192643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.192647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.192651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.192655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.192660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.192665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.192668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.192672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.192676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.192681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.192684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.192689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.192693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.192707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.192711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.192715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.192731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.192736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.192740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.192744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.192777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:58.194201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255617128752347:5158] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:58.196303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:58.196552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255617128752347:5158] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:58.196564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255617128752347:5158] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:58.196567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255617128752347:5158] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:58.196575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:58.197447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:58.197461Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:58.197463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:58.197466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:58.197472Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1256 [2:7556255614751873255:8956]
2025-10-01T14:10:58.197488Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:58.197503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:58.197505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.197509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.197511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.197526Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:58.197531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:58.197537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:58.197591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.197598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.197600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.197603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:58.197606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:58.197694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:58.197700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.197710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.197720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.197737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:58.197757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752298:2446], now have 1 active actors on pipe
2025-10-01T14:10:58.197731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1256
2025-10-01T14:10:58.197764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752386:5158], now have 1 active actors on pipe
2025-10-01T14:10:58.197771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255614751873250:8956]
2025-10-01T14:10:58.197744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1256
2025-10-01T14:10:58.197773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255614751873250:8956]
2025-10-01T14:10:58.197775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255614751873250:8956]
2025-10-01T14:10:58.197787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:58.197797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:58.197808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.197812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.197814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:58.197816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:58.197836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:58.197853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:58.197859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:58.197895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:58.197905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.197909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.197911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:58.197919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.197930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:58.197941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255614751873250:8956]
2025-10-01T14:10:58.197948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:58.197954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:58.197974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.198118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.198124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.198138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.198203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1257 partition: 0 MaxSeqNo: 45 sessionId: src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0
2025-10-01T14:10:58.198571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c38eafe1-dbf916a2-c9397604-21ab2e54_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:58.200933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0] Write session: try to update token
2025-10-01T14:10:58.200950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:58.214961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1257 sessionId: src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:58.217416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:58.218314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.218337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.218357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:58.218361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:58.218363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:58.218365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:58.218388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255614751873250:8956]
2025-10-01T14:10:58.218393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255614751873250:8956]
2025-10-01T14:10:58.218398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255614751873250:8956]
2025-10-01T14:10:58.218433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:58.218445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:58.218449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:58.218453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:58.218459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.218461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:58.218595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:58.281463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255617128752393:10063]
2025-10-01T14:10:58.281681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1256, pipe: [1:7556255617128752393:10063]
2025-10-01T14:10:58.374275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:58.374290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0] Write session will restart in 0.005244s
2025-10-01T14:10:58.374317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0] Write session: Do CDS request
2025-10-01T14:10:58.374323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:58.373772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:58.373051Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:58.373874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:58.373877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:58.373612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:58.373962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1257 reason: error at write: Disconnected sessionId: src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0
2025-10-01T14:10:58.373660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752393:10063], now have 1 active actors on pipe
2025-10-01T14:10:58.374103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:58.374139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1257 sessionId: src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0 is DEAD
2025-10-01T14:10:58.374145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255617128752393:10063]
2025-10-01T14:10:58.380965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.381072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:58.381088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1258
2025-10-01T14:10:58.381235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.381263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:58.381268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:58.381272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:58.381687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1258 sessionId:  describe result for acl check
2025-10-01T14:10:58.381721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:58.381723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:58.381725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:58.381730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255617128752438:5147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:58.382388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255617128752438:5147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:58.383744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:58.384203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255617128752438:5147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:58.385375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:58.385585Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:58.385595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:58.385607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:58.385670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:58.385709Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255614751873343:8958]
2025-10-01T14:10:58.386391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:58.386698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:58.386752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:58.386766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255617128752438:5147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:58.386783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255617128752438:5147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:58.386788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255617128752438:5147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:58.386798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:58.387064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:58.387122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.387127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.387129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.387130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.387131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.387133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.387134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.387136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.387137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.387139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.387140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.387141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.387142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.387144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.387150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.387160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.387164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.387168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.387171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.387175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.387180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.387184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.387189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.387194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.387198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.387202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.387218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.387222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.387229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.387240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.387250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.387257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.387265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.387271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.387279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.387285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.387292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.387298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.387304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.387310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.387319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.387330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.387335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.387343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.387348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.387356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.387360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.387365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.387374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.387380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.387388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.387393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.387401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.387406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.387413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.387419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.387459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:58.391211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:58.391785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:58.391797Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:58.391800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:58.391804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:58.391811Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1257 [2:7556255614751873343:8958]
2025-10-01T14:10:58.391829Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:58.391862Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:58.391868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.391872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.391874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.391891Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:58.391901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:58.391911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:58.391963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.391969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.391972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.391975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:58.391978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:58.392042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:58.392050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.392061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.392074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.392094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:58.392115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752492:5147], now have 1 active actors on pipe
2025-10-01T14:10:58.392125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752403:2446], now have 1 active actors on pipe
2025-10-01T14:10:58.392132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255614751873338:8958]
2025-10-01T14:10:58.392135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255614751873338:8958]
2025-10-01T14:10:58.392136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255614751873338:8958]
2025-10-01T14:10:58.392152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:58.392171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:58.392169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1257
2025-10-01T14:10:58.392186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:58.392188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:58.392191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:58.392195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:58.392169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1257
2025-10-01T14:10:58.392198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:58.392222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255614751873338:8958]
2025-10-01T14:10:58.392229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:58.392231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:58.392258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.392266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.392297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12a891f3-f6b52025-12953058-f4a6897f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:58.392306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.392310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.392311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:58.392317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.392327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:58.392339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.392457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.392462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.392473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.392555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1258 partition: 0 MaxSeqNo: 45 sessionId: src_id|12a891f3-f6b52025-12953058-f4a6897f_0
2025-10-01T14:10:58.392991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|746bbf6b-5d321f16-66826054-e2cb5df0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|12a891f3-f6b52025-12953058-f4a6897f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:58.395302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a891f3-f6b52025-12953058-f4a6897f_0] Write session: try to update token
2025-10-01T14:10:58.395317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a891f3-f6b52025-12953058-f4a6897f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:58.410801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1258 sessionId: src_id|12a891f3-f6b52025-12953058-f4a6897f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:58.413086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:58.413105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:58.413107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:58.413109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:58.413117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255614751873338:8958]
2025-10-01T14:10:58.413120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255614751873338:8958]
2025-10-01T14:10:58.413123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255614751873338:8958]
2025-10-01T14:10:58.413173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:58.413185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.413187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:58.413318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:58.413754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:58.413904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:58.413920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:58.413924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:58.474543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255617128752503:10063]
2025-10-01T14:10:58.474877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1257, pipe: [1:7556255617128752503:10063]
2025-10-01T14:10:58.556228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:58.556665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.556678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.556722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752503:10063], now have 1 active actors on pipe
2025-10-01T14:10:58.556943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:58.556945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255617128752503:10063]
2025-10-01T14:10:58.556956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:58.557026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1258 reason: error at write: Disconnected sessionId: src_id|12a891f3-f6b52025-12953058-f4a6897f_0
2025-10-01T14:10:58.557098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:58.556899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:58.557235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1258 sessionId: src_id|12a891f3-f6b52025-12953058-f4a6897f_0 is DEAD
2025-10-01T14:10:58.557378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a891f3-f6b52025-12953058-f4a6897f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:58.557387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a891f3-f6b52025-12953058-f4a6897f_0] Write session will restart in 0.009512s
2025-10-01T14:10:58.557416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a891f3-f6b52025-12953058-f4a6897f_0] Write session: Do CDS request
2025-10-01T14:10:58.557421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a891f3-f6b52025-12953058-f4a6897f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:58.565014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:58.566609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:58.566813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:58.566824Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:58.566835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:58.566906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:58.566945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255614751873434:8961]
2025-10-01T14:10:58.567540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:58.567892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:58.567921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12a891f3-f6b52025-12953058-f4a6897f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.567949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:58.567991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:58.568004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1259
2025-10-01T14:10:58.568119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.568147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:58.568157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:58.568162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:58.568255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:58.568306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.568312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.568313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.568314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.568315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.568317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.568318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.568321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.568322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.568323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.568324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.568325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.568326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.568327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.568332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.568341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.568344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.568348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.568352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.568355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.568359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.568362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.568366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.568370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.568373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.568377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.568388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.568391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.568399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.568406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.568412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.568417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.568421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.568425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.568430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.568434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.568438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.568443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.568460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.568469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.568473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.568478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.568486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.568491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.568500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.568503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.568510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.568515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.568519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.568523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.568526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.568518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1259 sessionId:  describe result for acl check
2025-10-01T14:10:58.568530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.568542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.568546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.568549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.568553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.568551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:58.568557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:58.568558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:58.568564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255617128752558:5144] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:58.568590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:58.569071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255617128752558:5144] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:58.571048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255617128752558:5144] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:58.572180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:58.572788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:58.572800Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:58.572801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:58.572804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:58.572810Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1258 [2:7556255614751873434:8961]
2025-10-01T14:10:58.572824Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:58.572839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:58.572842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.572845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.572848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.572863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:58.572868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:58.572872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:58.572923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.572930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.572932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.572935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:58.572938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:58.572999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:58.573005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.573015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.573024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.573047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:58.573065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752505:2446], now have 1 active actors on pipe
2025-10-01T14:10:58.573073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255614751873429:8961]
2025-10-01T14:10:58.573075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255614751873429:8961]
2025-10-01T14:10:58.573077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255614751873429:8961]
2025-10-01T14:10:58.573088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:58.573100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:58.573101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:58.573103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:58.573105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:58.573080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1258
2025-10-01T14:10:58.573113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:58.573115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:58.573148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255614751873429:8961]
2025-10-01T14:10:58.573159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:58.573175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:58.573482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255617128752558:5144] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:58.573494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255617128752558:5144] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:58.573497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255617128752558:5144] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:58.573516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:58.573693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752597:5144], now have 1 active actors on pipe
2025-10-01T14:10:58.573725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1258
2025-10-01T14:10:58.573764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.573772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.573797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:58.573807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.573817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.573819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:58.573827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.573840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:58.573857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.573953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.573959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.573972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.574033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1259 partition: 0 MaxSeqNo: 45 sessionId: src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0
2025-10-01T14:10:58.574415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12a891f3-f6b52025-12953058-f4a6897f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:58.576962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0] Write session: try to update token
2025-10-01T14:10:58.576983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:58.584441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:58.584460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:58.584471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255614751873429:8961]
2025-10-01T14:10:58.584513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:58.584515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:58.584678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:58.584827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:58.584963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:58.585097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:58.585274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:58.585306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:58.591721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1259 sessionId: src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:58.594578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:58.594758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.594788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.594825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:58.594912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:58.604010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:58.604026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:58.604028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:58.604029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:58.604038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255614751873429:8961]
2025-10-01T14:10:58.604044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255614751873429:8961]
2025-10-01T14:10:58.604046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255614751873429:8961]
2025-10-01T14:10:58.604088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:58.604091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:58.604096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.604096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:58.604098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:58.604100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:58.604227Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:58.657328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255617128752603:10063]
2025-10-01T14:10:58.657575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1258, pipe: [1:7556255617128752603:10063]
2025-10-01T14:10:58.737277Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:58.743657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.743676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.743800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.743848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.743898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.743948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.743986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.743995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.744059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.744108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.744173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.744222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.744260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.744264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.744320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.744371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.744427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.744483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.744519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.744524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.744588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.744642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.744691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.744754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.744792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.744798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.744851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.744901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.744952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.745001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.745039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.745044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.745106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.745156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.745208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.745258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.745296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.745301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.745355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.745423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.745475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.745527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.745568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.745576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.745638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.745688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.745740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.745788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.745841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.745847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.745900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.745950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.746000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.746052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.746095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.746103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.746166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:58.746216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:58.746266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:58.746315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:58.746352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:58.746357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:58.746410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752603:10063], now have 1 active actors on pipe
2025-10-01T14:10:58.746646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:58.746647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255617128752603:10063]
2025-10-01T14:10:58.746670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:58.746672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:58.746697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1259 reason: error at write: Disconnected sessionId: src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0
2025-10-01T14:10:58.746879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1259 sessionId: src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0 is DEAD
2025-10-01T14:10:58.747001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:58.747013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0] Write session will restart in 0.006790s
2025-10-01T14:10:58.747038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0] Write session: Do CDS request
2025-10-01T14:10:58.747045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:58.747189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:58.754070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:58.754859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.754935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:58.754948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1260
2025-10-01T14:10:58.755044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.755072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:58.755081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:58.755088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:58.755395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1260 sessionId:  describe result for acl check
2025-10-01T14:10:58.755423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:58.755428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:58.755430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:58.755434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255617128752659:5139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:58.755496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:58.755672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:58.755682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:58.755690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:58.755723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:58.755750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255614751873536:8963]
2025-10-01T14:10:58.756015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255617128752659:5139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:58.756103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:58.756325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:58.756352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:58.756552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:58.756588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.756592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.756592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.756593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.756594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.756594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.756595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.756596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.756596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.756597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.756598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.756598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.756600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.756601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.756604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.756609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.756611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.756613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.756615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.756617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.756619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.756621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.756624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.756629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.756632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.756635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.756638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.756641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.756646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.756652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.756662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.756670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.756678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.756684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.756688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.756704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.756710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.756715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.756722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.756726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.756733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.756737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.756744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.756750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.756756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.756761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.756768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.756772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.756779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.756783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.756790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.756794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.756800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.756804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.756812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.756820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.756851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:58.758007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255617128752659:5139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:58.759945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:58.760190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255617128752659:5139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:58.760198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255617128752659:5139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:58.760201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255617128752659:5139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:58.760206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:58.760525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:58.760537Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:58.760539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:58.760541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:58.760545Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1259 [2:7556255614751873536:8963]
2025-10-01T14:10:58.760553Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:58.760568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:58.760573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.760575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.760576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.760585Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:58.760592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:58.760595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:58.760632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.760637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.760638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.760640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:58.760641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:58.760684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:58.760690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.760737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.760751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.760769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:58.760767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1259
2025-10-01T14:10:58.760788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752698:5139], now have 1 active actors on pipe
2025-10-01T14:10:58.760794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752607:2446], now have 1 active actors on pipe
2025-10-01T14:10:58.760781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1259
2025-10-01T14:10:58.760801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255614751873531:8963]
2025-10-01T14:10:58.760803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255614751873531:8963]
2025-10-01T14:10:58.760805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255614751873531:8963]
2025-10-01T14:10:58.760811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:58.760818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:58.760820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:58.760820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:58.760822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:58.760828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:58.760830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:58.760841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.760847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.760868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255614751873531:8963]
2025-10-01T14:10:58.760877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:58.760886Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21537f17-1f379d25-236ed654-d34a2065_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:58.760894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.760897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.760898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:58.760899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:58.760904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.760911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:58.760932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.761068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.761075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.761087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.761157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1260 partition: 0 MaxSeqNo: 45 sessionId: src_id|21537f17-1f379d25-236ed654-d34a2065_0
2025-10-01T14:10:58.761443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd9b875-2d5ef957-fd1b4873-c05546a0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|21537f17-1f379d25-236ed654-d34a2065_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:58.763811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21537f17-1f379d25-236ed654-d34a2065_0] Write session: try to update token
2025-10-01T14:10:58.763828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21537f17-1f379d25-236ed654-d34a2065_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:58.776605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1260 sessionId: src_id|21537f17-1f379d25-236ed654-d34a2065_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:58.778990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:58.779748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.779769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.779786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:58.779788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:58.779789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:58.779790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:58.779797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255614751873531:8963]
2025-10-01T14:10:58.779881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255614751873531:8963]
2025-10-01T14:10:58.779887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255614751873531:8963]
2025-10-01T14:10:58.779925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:58.779937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:58.779938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:58.779941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:58.779942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.779944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:58.780070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:58.846771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255617128752719:10063]
2025-10-01T14:10:58.847049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1259, pipe: [1:7556255617128752719:10063]
2025-10-01T14:10:58.925524Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:58.925849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:58.925902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752719:10063], now have 1 active actors on pipe
2025-10-01T14:10:58.926867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21537f17-1f379d25-236ed654-d34a2065_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:58.926886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21537f17-1f379d25-236ed654-d34a2065_0] Write session will restart in 0.007315s
2025-10-01T14:10:58.926385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:58.926911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21537f17-1f379d25-236ed654-d34a2065_0] Write session: Do CDS request
2025-10-01T14:10:58.926433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255617128752719:10063]
2025-10-01T14:10:58.926917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21537f17-1f379d25-236ed654-d34a2065_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:58.926453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:58.926467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:58.926470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:58.926536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1260 reason: error at write: Disconnected sessionId: src_id|21537f17-1f379d25-236ed654-d34a2065_0
2025-10-01T14:10:58.926719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1260 sessionId: src_id|21537f17-1f379d25-236ed654-d34a2065_0 is DEAD
2025-10-01T14:10:58.935956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21537f17-1f379d25-236ed654-d34a2065_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.936072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:58.936093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1261
2025-10-01T14:10:58.936192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:58.936224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:58.936230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:58.936233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:58.936611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1261 sessionId:  describe result for acl check
2025-10-01T14:10:58.936644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:58.936650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:58.936652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:58.936657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255617128752755:5110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:58.937164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255617128752755:5110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:58.939808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255617128752755:5110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:58.943355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255617128752755:5110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:58.943368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255617128752755:5110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:58.943371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255617128752755:5110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:58.943379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:58.943662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:58.945302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:58.945503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:58.945513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:58.945523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:58.945565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:58.945616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255614751873638:8969]
2025-10-01T14:10:58.946182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:58.946458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:58.946497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:58.946790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:58.946844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.946853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.946854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.946855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.946856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.946858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.946859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.946861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.946861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.946862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.946863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.946864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.946865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.946866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.946871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.946881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.946884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.946888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.946891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.946894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.946897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.946901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.946905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.946908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.946911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.946914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.946917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.946920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.946928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.946934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:58.946939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.946943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:58.946947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.946951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:58.946956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.946960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:58.946966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.946971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:58.946974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.946978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:58.946987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.946991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:58.946999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.947003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:58.947010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.947015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:58.947023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.947027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.947036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.947040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.947044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.947048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.947053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.947058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:58.947066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.947071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:58.947104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:58.951090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:58.951769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:58.951782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:58.951788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:58.951791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:58.951799Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1260 [2:7556255614751873638:8969]
2025-10-01T14:10:58.951818Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:58.951840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:58.951849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.951853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.951855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.951873Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:58.951878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:58.951884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:58.951936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.951943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.951945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.951948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:58.951951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:58.952016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:58.952024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.952034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:58.952049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:58.952069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:58.952088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255614751873633:8969]
2025-10-01T14:10:58.952094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255614751873633:8969]
2025-10-01T14:10:58.952096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255614751873633:8969]
2025-10-01T14:10:58.952110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:58.952127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:58.952143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:58.952150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:58.952171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:58.952176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255614751873633:8969]
2025-10-01T14:10:58.952179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:58.952180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:58.952182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:58.952189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:58.952388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752834:5110], now have 1 active actors on pipe
2025-10-01T14:10:58.952403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255617128752742:2446], now have 1 active actors on pipe
2025-10-01T14:10:58.952438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1260
2025-10-01T14:10:58.952438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1260
2025-10-01T14:10:58.952533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.952543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.952571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:58.952583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:58.952589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:58.952592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:58.952602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:58.952615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:58.952632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.952835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:58.952842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:58.952854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:58.952947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1261 partition: 0 MaxSeqNo: 45 sessionId: src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0
2025-10-01T14:10:58.953334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21537f17-1f379d25-236ed654-d34a2065_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:58.956104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0] Write session: try to update token
2025-10-01T14:10:58.956120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:58.972488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1261 sessionId: src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:58.974477Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:58.974495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:58.974497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:58.974498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:58.974510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255614751873633:8969]
2025-10-01T14:10:58.974514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255614751873633:8969]
2025-10-01T14:10:58.974520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255614751873633:8969]
2025-10-01T14:10:58.974568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:58.974579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:58.974582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:58.974756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:58.975023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:58.975039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:58.975043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:58.975274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:59.026995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255621423720144:10063]
2025-10-01T14:10:59.027268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1260, pipe: [1:7556255621423720144:10063]
2025-10-01T14:10:59.131472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:59.131780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.131789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.131830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720144:10063], now have 1 active actors on pipe
2025-10-01T14:10:59.134946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:59.135000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255621423720144:10063]
2025-10-01T14:10:59.135164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:59.135171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:59.135224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1261 reason: error at write: Disconnected sessionId: src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0
2025-10-01T14:10:59.135392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1261 sessionId: src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0 is DEAD
2025-10-01T14:10:59.135736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:59.135748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0] Write session will restart in 0.008741s
2025-10-01T14:10:59.135775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0] Write session: Do CDS request
2025-10-01T14:10:59.135797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:59.136898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:59.146906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:59.147255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:59.147274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1262
2025-10-01T14:10:59.147430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:59.147462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:59.147473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:59.147476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:59.148027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1262 sessionId:  describe result for acl check
2025-10-01T14:10:59.148058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:59.148060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:59.148061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:59.148066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255621423720164:5108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:59.148563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255621423720164:5108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:59.155708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255621423720164:5108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:59.158581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255621423720164:5108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:59.158598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255621423720164:5108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:59.158601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255621423720164:5108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:59.158610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:59.178521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:59.181264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:59.181510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:59.181514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:59.181525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:59.181577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:59.181628Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255619046841057:8981]
2025-10-01T14:10:59.182263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:59.186902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:59.186991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:59.187382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:59.187443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.187444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.187446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.187447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.187448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.187454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.187455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.187456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.187457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.187459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.187459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.187461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.187462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.187463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.187471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.187481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.187484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.187487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.187491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.187495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.187498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.187501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.187505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.187509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.187512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.187516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.187519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.187523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.187531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.187539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.187546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.187551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.187557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.187562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.187567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.187572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.187578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.187584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.187588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.187593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.187597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.187603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.187607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.187612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.187621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.187626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.187631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.187636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.187640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.187645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.187649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.187654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.187658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.187663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.187667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.187672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.187712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:59.199001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:59.199689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:59.199707Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:59.199710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:59.199714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:59.199722Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1261 [2:7556255619046841057:8981]
2025-10-01T14:10:59.199739Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:59.199760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:59.199768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:59.199772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:59.199774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:59.199797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:59.199809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:59.199815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:59.199893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.199900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.199902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.199905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:59.199908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:59.199987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:59.199995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.200007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.200017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.200035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:59.200057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255619046841051:8981]
2025-10-01T14:10:59.200065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255619046841051:8981]
2025-10-01T14:10:59.200067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255619046841051:8981]
2025-10-01T14:10:59.200077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:59.200094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:59.200112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:59.200118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:59.200158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255619046841051:8981]
2025-10-01T14:10:59.200165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:59.200308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:59.200316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:59.200318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:59.200322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:59.200707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1261
2025-10-01T14:10:59.200744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1261
2025-10-01T14:10:59.201557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720231:5108], now have 1 active actors on pipe
2025-10-01T14:10:59.201569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720148:2446], now have 1 active actors on pipe
2025-10-01T14:10:59.201593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.201600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.201631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43752a3d-90231a31-2808c136-cff791b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:59.201642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:59.201647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:59.201650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:59.201660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:59.201672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:59.201693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:59.203168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.203181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.203206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:59.207041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1262 partition: 0 MaxSeqNo: 45 sessionId: src_id|43752a3d-90231a31-2808c136-cff791b8_0
2025-10-01T14:10:59.207559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2323a5f2-7f6fa2e4-3c34985c-455499dd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|43752a3d-90231a31-2808c136-cff791b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:59.210326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43752a3d-90231a31-2808c136-cff791b8_0] Write session: try to update token
2025-10-01T14:10:59.210349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43752a3d-90231a31-2808c136-cff791b8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:59.236444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:59.236467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:59.236471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:59.236473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:59.236484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255619046841051:8981]
2025-10-01T14:10:59.236491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255619046841051:8981]
2025-10-01T14:10:59.236495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255619046841051:8981]
2025-10-01T14:10:59.236545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:59.236554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.236556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:59.236736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:59.238439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255621423720244:10063]
2025-10-01T14:10:59.239518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:59.239532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:59.239536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:59.239742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1261, pipe: [1:7556255621423720244:10063]
2025-10-01T14:10:59.257799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1262 sessionId: src_id|43752a3d-90231a31-2808c136-cff791b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:59.260465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:59.446877Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:59.447152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720244:10063], now have 1 active actors on pipe
2025-10-01T14:10:59.447206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.447214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.450812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:59.451436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:59.451517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1262 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43752a3d-90231a31-2808c136-cff791b8_0
2025-10-01T14:10:59.451708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1262 sessionId: src_id|43752a3d-90231a31-2808c136-cff791b8_0 is DEAD
2025-10-01T14:10:59.451880Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:59.451917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255621423720244:10063]
2025-10-01T14:10:59.453304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43752a3d-90231a31-2808c136-cff791b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:10:59.453314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43752a3d-90231a31-2808c136-cff791b8_0] Write session will restart in 0.007147s
2025-10-01T14:10:59.453333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43752a3d-90231a31-2808c136-cff791b8_0] Write session: Do CDS request
2025-10-01T14:10:59.453338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43752a3d-90231a31-2808c136-cff791b8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:59.462989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43752a3d-90231a31-2808c136-cff791b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:59.463339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:59.463351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1263
2025-10-01T14:10:59.463468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:59.463494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:59.463499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:59.463502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:59.463931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1263 sessionId:  describe result for acl check
2025-10-01T14:10:59.463965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:59.463967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:59.463968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:59.463974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255621423720275:5104] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:59.464462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255621423720275:5104] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:59.467219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255621423720275:5104] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:59.477119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255621423720275:5104] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:59.477135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255621423720275:5104] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:59.477141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255621423720275:5104] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:59.477151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:59.483277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:59.489729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:59.490080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:59.490093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:59.490104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:59.490169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:59.490208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255619046841154:8984]
2025-10-01T14:10:59.490885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:59.491265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:59.491343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:59.491723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:59.491804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.491811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.491812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.491814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.491815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.491816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.491818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.491819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.491820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.491821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.491822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.491824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.491826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.491827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.491832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.491843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.491847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.491851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.491855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.491860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.491863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.491867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.491871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.491875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.491879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.491882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.491886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.491890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.491899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.491908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.491914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.491919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.491924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.491929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.491933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.491937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.491943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.491948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.491952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.491962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.491968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.491973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.491977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.491981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.491985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.491990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.492002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.492007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.492011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.492016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.492020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.492027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.492031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.492036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.492040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.492044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.492088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:59.503513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:59.504232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:59.504250Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:59.504253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:59.504256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:59.504266Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1262 [2:7556255619046841154:8984]
2025-10-01T14:10:59.504287Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:59.504310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:59.504314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:59.504318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:59.504327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:59.504346Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:59.504358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:59.504364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:59.504430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.504438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.504443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.504446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:59.504448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:59.504523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:59.504531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.504543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.504557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.504572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:59.504590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255619046841148:8984]
2025-10-01T14:10:59.504597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255619046841148:8984]
2025-10-01T14:10:59.504600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255619046841148:8984]
2025-10-01T14:10:59.504614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:59.504632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:59.504646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:59.504650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:59.504693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255619046841148:8984]
2025-10-01T14:10:59.504695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:59.506443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:59.506461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:59.506463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:59.506471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:59.506630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720346:5104], now have 1 active actors on pipe
2025-10-01T14:10:59.506646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720262:2446], now have 1 active actors on pipe
2025-10-01T14:10:59.506839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1262
2025-10-01T14:10:59.506871Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1262
2025-10-01T14:10:59.507264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.507280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.507318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:59.507334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:59.507344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:59.507351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:59.507363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:59.507384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:59.507412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:59.510918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.510940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.510972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:59.512886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1263 partition: 0 MaxSeqNo: 45 sessionId: src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0
2025-10-01T14:10:59.513591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43752a3d-90231a31-2808c136-cff791b8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:59.516390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0] Write session: try to update token
2025-10-01T14:10:59.516413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:59.534485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:59.534503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:59.534505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:59.534511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:59.534520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255619046841148:8984]
2025-10-01T14:10:59.534526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255619046841148:8984]
2025-10-01T14:10:59.534530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255619046841148:8984]
2025-10-01T14:10:59.534577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:59.534591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.534593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:59.534746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:59.535381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:59.535398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:59.535402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:59.545884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1263 sessionId: src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:59.548477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:59.552388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255621423720361:10063]
2025-10-01T14:10:59.552753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1262, pipe: [1:7556255621423720361:10063]
2025-10-01T14:10:59.689382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255621423720361:10063]
2025-10-01T14:10:59.689414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:59.689416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:59.689472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1263 reason: error at write: Disconnected sessionId: src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0
2025-10-01T14:10:59.687934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:59.688385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.688396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.688420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720361:10063], now have 1 active actors on pipe
2025-10-01T14:10:59.689066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:59.689674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1263 sessionId: src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0 is DEAD
2025-10-01T14:10:59.689803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:59.692094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:59.692108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0] Write session will restart in 0.008154s
2025-10-01T14:10:59.692141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0] Write session: Do CDS request
2025-10-01T14:10:59.692147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:59.702011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:59.702351Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:59.702383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1264
2025-10-01T14:10:59.702523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:59.702551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:59.702561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:59.702565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:59.703271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1264 sessionId:  describe result for acl check
2025-10-01T14:10:59.703301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:59.703302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:59.703303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:59.703307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255621423720388:5094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:59.703713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255621423720388:5094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:59.707471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255621423720388:5094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:59.708382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:59.710639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:59.710884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:59.710896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:59.710909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:59.710963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:59.710999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255619046841247:8986]
2025-10-01T14:10:59.711681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:59.712228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:59.712281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:59.712620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:59.712672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.712674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.712676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.712677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.712678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.712680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.712682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.712683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.712684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.712686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.712687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.712689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.712690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.712692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.712715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.712727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.712732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.712737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.712741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.712746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.712751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.712756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.712760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.712766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.712770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.712774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.713012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255621423720388:5094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:59.713029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255621423720388:5094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:59.713032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255621423720388:5094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:59.713041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:59.712779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.712783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.712790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.712798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.712805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.712811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.712815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.712821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.712827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.712832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.712837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.712844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.712849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.712855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.712862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.712868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.712873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.712879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.712884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.712890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.712895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.712901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.712907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.712913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.712917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.712923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.712928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.712934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.712939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.712944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.712990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:59.720279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:59.721029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:59.721043Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:59.721046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:59.721049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:59.721056Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1263 [2:7556255619046841247:8986]
2025-10-01T14:10:59.721074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:59.721093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:59.721096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:59.721100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:59.721102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:59.721121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:59.721127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:59.721134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:59.721200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.721204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.721206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.721210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:59.721212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:59.721280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:59.721282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.721293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.721302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.721315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:59.721333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255619046841241:8986]
2025-10-01T14:10:59.721335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255619046841241:8986]
2025-10-01T14:10:59.721337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255619046841241:8986]
2025-10-01T14:10:59.721347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:59.721361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:59.721375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:59.721375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:59.721378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:59.721379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:59.721381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:59.721417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255619046841241:8986]
2025-10-01T14:10:59.721420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:59.721428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:59.721430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720456:5094], now have 1 active actors on pipe
2025-10-01T14:10:59.721434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720366:2446], now have 1 active actors on pipe
2025-10-01T14:10:59.721656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1263
2025-10-01T14:10:59.721676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1263
2025-10-01T14:10:59.721809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.721821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.721849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aea1e017-f04d15a7-4919638-baf994ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:59.721858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:59.721862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:59.721865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:59.721876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:59.721886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:59.721901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:59.723302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.723316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.723343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:59.724326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1264 partition: 0 MaxSeqNo: 45 sessionId: src_id|aea1e017-f04d15a7-4919638-baf994ad_0
2025-10-01T14:10:59.724757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cdcf4d3-4cf75fc7-da23e942-48fbf944_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aea1e017-f04d15a7-4919638-baf994ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:59.727699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1e017-f04d15a7-4919638-baf994ad_0] Write session: try to update token
2025-10-01T14:10:59.727717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1e017-f04d15a7-4919638-baf994ad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:10:59.747829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:10:59.747854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:59.747865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255619046841241:8986]
2025-10-01T14:10:59.747913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:10:59.747921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:10:59.748105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:10:59.748277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:59.748433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:59.748581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:10:59.748821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:10:59.748866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:10:59.751852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1264 sessionId: src_id|aea1e017-f04d15a7-4919638-baf994ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:10:59.754428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:10:59.754680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.754705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.754735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:10:59.754820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:10:59.776092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:10:59.776114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:10:59.776116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:10:59.776119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:10:59.776129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255619046841241:8986]
2025-10-01T14:10:59.776133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255619046841241:8986]
2025-10-01T14:10:59.776138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255619046841241:8986]
2025-10-01T14:10:59.776185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:10:59.776192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.776195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:10:59.776360Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:10:59.778449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:10:59.778456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:10:59.778460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:10:59.789887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255621423720467:10063]
2025-10-01T14:10:59.790247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1263, pipe: [1:7556255621423720467:10063]
2025-10-01T14:10:59.946856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:10:59.955470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.955500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.955677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.955737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.955796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.955861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.955901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.955906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.955972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.956024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.956081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.956158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.956782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.956790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.956882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.956938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.956997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.957056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.957096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.957099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.957166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.957226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.957282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.957341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.957381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.957384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.957447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.957542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.957601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.957663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.957703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.957705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.957775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.957838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.957901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.957966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.958009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.958012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.958083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.958141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.958208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.958271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.958312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.958315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.958581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.958648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.958708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.958772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.958813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.958816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.958882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.958939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.958998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.959058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.959098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.959100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.959164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:10:59.959245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:10:59.959304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:10:59.959363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:10:59.959403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:10:59.959406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:10:59.959479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720467:10063], now have 1 active actors on pipe
2025-10-01T14:10:59.961192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:10:59.961204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:10:59.961233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1264 reason: error at write: Disconnected sessionId: src_id|aea1e017-f04d15a7-4919638-baf994ad_0
2025-10-01T14:10:59.961447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1264 sessionId: src_id|aea1e017-f04d15a7-4919638-baf994ad_0 is DEAD
2025-10-01T14:10:59.961591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255621423720467:10063]
2025-10-01T14:10:59.961635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:10:59.962425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1e017-f04d15a7-4919638-baf994ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:10:59.962437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1e017-f04d15a7-4919638-baf994ad_0] Write session will restart in 0.009171s
2025-10-01T14:10:59.962465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1e017-f04d15a7-4919638-baf994ad_0] Write session: Do CDS request
2025-10-01T14:10:59.962471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1e017-f04d15a7-4919638-baf994ad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:10:59.960427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:10:59.972961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1e017-f04d15a7-4919638-baf994ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:59.973105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:10:59.973120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1265
2025-10-01T14:10:59.973806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:10:59.973854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:10:59.973860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:10:59.973864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:10:59.974318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1265 sessionId:  describe result for acl check
2025-10-01T14:10:59.974349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:10:59.974354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:10:59.974355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:10:59.974359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255621423720562:5070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:10:59.974894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255621423720562:5070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:10:59.976857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255621423720562:5070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:10:59.975739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:10:59.977860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:10:59.978141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:10:59.978145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:10:59.978158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:10:59.978218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:10:59.978253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255619046841364:8992]
2025-10-01T14:10:59.978904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:10:59.979231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:10:59.979281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:10:59.979187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255621423720562:5070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:10:59.979200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255621423720562:5070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:10:59.979203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255621423720562:5070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:10:59.979212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:10:59.979633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:10:59.979712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.979719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.979720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.979722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.979723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.979725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.979726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.979728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.979729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.979730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.979731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.979732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.979734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.979735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.979742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.979755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.979760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.979764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.979768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.979772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.979776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.979779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.979783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.979788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.979791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.979795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.979799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.979803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.979810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.979818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:10:59.979831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.979837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:10:59.979845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.979850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:10:59.979860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.979865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:10:59.979874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.979879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:10:59.979888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.979893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:10:59.979898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.979907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:10:59.979912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.979922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:10:59.979926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.979937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:10:59.979942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.979948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.979957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.979963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.979968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.979974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.979984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.979989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:10:59.979998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.980004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:10:59.980049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:10:59.985364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1264
2025-10-01T14:10:59.985391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1264
2025-10-01T14:10:59.984196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:10:59.984960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:10:59.984965Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:10:59.984968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:10:59.984972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:10:59.984981Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1264 [2:7556255619046841364:8992]
2025-10-01T14:10:59.984997Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:10:59.985014Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:10:59.985018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:59.985022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:59.985024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:59.985042Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:10:59.985048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:10:59.985054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:10:59.985114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.985116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.985118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.985122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:10:59.985125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:10:59.985204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:10:59.985207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:10:59.985221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:10:59.985235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:10:59.985252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:10:59.985270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720597:5070], now have 1 active actors on pipe
2025-10-01T14:10:59.985273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255621423720507:2446], now have 1 active actors on pipe
2025-10-01T14:10:59.985282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255619046841358:8992]
2025-10-01T14:10:59.985285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255619046841358:8992]
2025-10-01T14:10:59.985287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255619046841358:8992]
2025-10-01T14:10:59.985302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:10:59.985319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:10:59.985333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:10:59.985336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:10:59.985340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:10:59.985344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:10:59.985346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:10:59.985368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255619046841358:8992]
2025-10-01T14:10:59.985371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:10:59.985374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:10:59.986203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.986217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.986244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:10:59.986252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:10:59.986257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:10:59.986260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:10:59.986270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:10:59.986281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:10:59.986296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:59.987004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:10:59.987025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:10:59.987046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:10:59.987584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1265 partition: 0 MaxSeqNo: 45 sessionId: src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0
2025-10-01T14:10:59.987973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1e017-f04d15a7-4919638-baf994ad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:10:59.990668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0] Write session: try to update token
2025-10-01T14:10:59.990689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:00.011202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:00.011227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:00.011229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:00.011231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:00.011243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255619046841358:8992]
2025-10-01T14:11:00.011249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255619046841358:8992]
2025-10-01T14:11:00.011253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255619046841358:8992]
2025-10-01T14:11:00.011311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:00.011319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.011324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:00.011477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:00.011545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:00.011555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:00.011559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:00.012302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1265 sessionId: src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:00.014922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:00.062447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255625718687904:10063]
2025-10-01T14:11:00.066287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1264, pipe: [1:7556255625718687904:10063]
2025-10-01T14:11:00.169928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:00.170274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.170290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.170332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718687904:10063], now have 1 active actors on pipe
2025-10-01T14:11:00.171965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:00.171892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:00.171958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255625718687904:10063]
2025-10-01T14:11:00.171981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:00.171984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:00.172049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1265 reason: error at write: Disconnected sessionId: src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0
2025-10-01T14:11:00.172240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1265 sessionId: src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0 is DEAD
2025-10-01T14:11:00.174582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:00.174595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0] Write session will restart in 0.008010s
2025-10-01T14:11:00.174623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0] Write session: Do CDS request
2025-10-01T14:11:00.174629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:00.184214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:00.184643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:00.184656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1266
2025-10-01T14:11:00.184800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:00.184843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:00.184852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:00.184855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:00.185219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1266 sessionId:  describe result for acl check
2025-10-01T14:11:00.185251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:00.185253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:00.185255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:00.185261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255625718687935:5071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:00.185790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255625718687935:5071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:00.189220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255625718687935:5071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:00.189921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:00.192185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:00.192461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:00.192473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:00.192487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:00.192556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:00.192608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255623341808786:9004]
2025-10-01T14:11:00.192781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255625718687935:5071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:00.192801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255625718687935:5071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:00.192806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255625718687935:5071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:00.192817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:00.193254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:00.193936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:00.193987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:00.194288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:00.194343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.194344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.194358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.194359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.194360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.194361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.194362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.194363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.194364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.194366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.194367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.194381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.194382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.194383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.194389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.194399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.194403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.194406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.194410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.194413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.194417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.194421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.194424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.194437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.194440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.194443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.194446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.194450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.194458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.194465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.194471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.194477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.194481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.194487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.194491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.194495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.194500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.194504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.194508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.194513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.194517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.194522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.194526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.194531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.194536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.194541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.194544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.194548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.194552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.194557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.194561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.194566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.194570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.194575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.194578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.194584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.194622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:00.199299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:00.200234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:00.200240Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:00.200243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:00.200246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:00.200254Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1265 [2:7556255623341808786:9004]
2025-10-01T14:11:00.200269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:00.200287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:00.200291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:00.200295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:00.200297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:00.200313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:00.200319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:00.200325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:00.200394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.200396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.200398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.200402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:00.200404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:00.200475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:00.200477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.200489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.200760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1265
2025-10-01T14:11:00.200811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1265
2025-10-01T14:11:00.200499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.200514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:00.200530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255623341808780:9004]
2025-10-01T14:11:00.200532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255623341808780:9004]
2025-10-01T14:11:00.200534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255623341808780:9004]
2025-10-01T14:11:00.200542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:00.200555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:00.200558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:00.200559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:00.200565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:00.200572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:00.200575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:00.200586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718687910:2446], now have 1 active actors on pipe
2025-10-01T14:11:00.200590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718687999:5071], now have 1 active actors on pipe
2025-10-01T14:11:00.200629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255623341808780:9004]
2025-10-01T14:11:00.200638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:00.200947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:00.201185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.201200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.201229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:00.201243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:00.201252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:00.201255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:00.201266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:00.201283Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:00.201305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:00.201754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.201763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.201778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:00.201930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1266 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0
2025-10-01T14:11:00.202346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6d27da2-7a1e0d61-14ae1b8-29537851_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:00.205007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0] Write session: try to update token
2025-10-01T14:11:00.205033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:00.225788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1266 sessionId: src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:00.227930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:00.227963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:00.227966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:00.227969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:00.227983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255623341808780:9004]
2025-10-01T14:11:00.227988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255623341808780:9004]
2025-10-01T14:11:00.227992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255623341808780:9004]
2025-10-01T14:11:00.228056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:00.228070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.228073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:00.228313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:00.228528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:00.228542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:00.228547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:00.228570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:00.272573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255625718688013:10063]
2025-10-01T14:11:00.273377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1265, pipe: [1:7556255625718688013:10063]
2025-10-01T14:11:00.381485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:00.381866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.381880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.381914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688013:10063], now have 1 active actors on pipe
2025-10-01T14:11:00.382172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:00.382194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255625718688013:10063]
2025-10-01T14:11:00.382220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:00.382238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:00.382276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1266 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0
2025-10-01T14:11:00.382458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1266 sessionId: src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0 is DEAD
2025-10-01T14:11:00.382568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:00.382575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0] Write session will restart in 0.007661s
2025-10-01T14:11:00.382599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0] Write session: Do CDS request
2025-10-01T14:11:00.382604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:00.391855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:00.391878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:00.391961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:00.391974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1267
2025-10-01T14:11:00.392056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:00.392081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:00.392088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:00.392091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:00.392423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1267 sessionId:  describe result for acl check
2025-10-01T14:11:00.392455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:00.392456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:00.392459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:00.392462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255625718688084:5059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:00.392880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255625718688084:5059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:00.393512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:00.393677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:00.393688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:00.393695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:00.393728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:00.393769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255623341808882:9006]
2025-10-01T14:11:00.394247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:00.394575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255625718688084:5059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:00.394579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:00.394628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:00.394931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:00.394998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.395006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.395007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.395008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.395010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.395011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.395012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.395013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.395014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.395015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.395016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.395017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.395018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.395019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.395024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.395030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.395032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.395035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.395037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.395039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.395041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.395043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.395045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.395048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.395050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.395052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.395054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.395055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.395060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.395065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.395069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.395072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.395075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.395078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.395081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.395084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.395087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.395090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.395093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.395097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.395101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.395105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.395107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.395111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.395114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.395117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.395119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.395122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.395125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.395128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.395130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.395133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.395136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.395139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.395142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.395145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.395182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:00.398495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255625718688084:5059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:00.398508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255625718688084:5059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:00.398511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255625718688084:5059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:00.398517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:00.398948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:00.399765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:00.399782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:00.399784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:00.399788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:00.399793Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1266 [2:7556255623341808882:9006]
2025-10-01T14:11:00.399805Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:00.399818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:00.399820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:00.399823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:00.399824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:00.399836Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:00.399840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:00.399847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:00.399890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.399898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.399899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.399902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:00.399904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:00.399955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:00.399962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.399970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.399976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.399985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:00.399997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255623341808877:9006]
2025-10-01T14:11:00.400004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255623341808877:9006]
2025-10-01T14:11:00.400006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255623341808877:9006]
2025-10-01T14:11:00.400012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:00.400021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:00.400024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688026:2446], now have 1 active actors on pipe
2025-10-01T14:11:00.400024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:00.400026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688124:5059], now have 1 active actors on pipe
2025-10-01T14:11:00.400026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:00.400032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:00.400041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:00.400043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:00.400069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255623341808877:9006]
2025-10-01T14:11:00.400079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:00.400075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1266
2025-10-01T14:11:00.400092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1266
2025-10-01T14:11:00.400103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:00.400223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.400232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.400249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:00.400258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:00.400262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:00.400264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:00.400270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:00.400278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:00.400293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:00.400458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.400467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.400482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:00.400563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1267 partition: 0 MaxSeqNo: 45 sessionId: src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0
2025-10-01T14:11:00.400889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c6bf5a8-7016b1db-ff091d59-453cc506_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:00.403224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0] Write session: try to update token
2025-10-01T14:11:00.403240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:00.416800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1267 sessionId: src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:00.419316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:00.420052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.420081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.420097Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:00.420099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:00.420101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:00.420102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:00.420109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255623341808877:9006]
2025-10-01T14:11:00.420112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255623341808877:9006]
2025-10-01T14:11:00.420115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255623341808877:9006]
2025-10-01T14:11:00.420157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:00.420164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:00.420169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.420170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:00.420171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:00.420173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:00.420316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:00.482623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255625718688132:10063]
2025-10-01T14:11:00.483006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1266, pipe: [1:7556255625718688132:10063]
2025-10-01T14:11:00.555761Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:00.556089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:00.556147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688132:10063], now have 1 active actors on pipe
2025-10-01T14:11:00.556247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:00.556415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255625718688132:10063]
2025-10-01T14:11:00.556445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:00.565075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:00.566701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:00.566867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:00.566876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:00.566887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:00.566932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:00.566987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255623341808982:9009]
2025-10-01T14:11:00.567156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:00.567168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:00.567193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1267 reason: error at write: Disconnected sessionId: src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0
2025-10-01T14:11:00.567358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1267 sessionId: src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0 is DEAD
2025-10-01T14:11:00.567443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:00.567478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:00.567485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0] Write session will restart in 0.009708s
2025-10-01T14:11:00.567511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0] Write session: Do CDS request
2025-10-01T14:11:00.567517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:00.571659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:00.571719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:00.572015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:00.572062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.572067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.572068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.572069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.572070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.572071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.572072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.572073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.572074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.572075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.572076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.572077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.572078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.572079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.572084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.572091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.572093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.572096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.572098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.572101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.572103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.572107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.572109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.572111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.572114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.572116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.572119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.572121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.572129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.572135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.572140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.572144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.572148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.572151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.572154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.572157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.572160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.572165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.572168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.572171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.572174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.572176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.572179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.572182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.572185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.572188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.572191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.572194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.572198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.572200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.572203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.572206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.572208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.572211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.572214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.572217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.572241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:00.576445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:00.577224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:00.577239Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:00.577242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:00.577247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:00.577254Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1267 [2:7556255623341808982:9009]
2025-10-01T14:11:00.577279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:00.577301Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:00.577309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:00.577312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:00.577314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:00.577331Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:00.577343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:00.577349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:00.577415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.577421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.577424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.577427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:00.577430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:00.577504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:00.577512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.577524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.577534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.577547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:00.577582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255623341808977:9009]
2025-10-01T14:11:00.577590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255623341808977:9009]
2025-10-01T14:11:00.577593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255623341808977:9009]
2025-10-01T14:11:00.577607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:00.577628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688133:2446], now have 1 active actors on pipe
2025-10-01T14:11:00.577641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:00.577660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:00.577663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:00.577651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1267
2025-10-01T14:11:00.577696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255623341808977:9009]
2025-10-01T14:11:00.577702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:00.577705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:00.577711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:00.577713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:00.577719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:00.578130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:00.578515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:00.578527Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1268
2025-10-01T14:11:00.578682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:00.578713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:00.578723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:00.578726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:00.579110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1268 sessionId:  describe result for acl check
2025-10-01T14:11:00.579151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:00.579158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:00.579160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:00.579165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255625718688203:5052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:00.579693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255625718688203:5052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:00.582430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255625718688203:5052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:00.588013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255625718688203:5052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:00.588031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255625718688203:5052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:00.588034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255625718688203:5052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:00.588044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:00.588272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1267
2025-10-01T14:11:00.589358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688240:5052], now have 1 active actors on pipe
2025-10-01T14:11:00.589400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.589411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.589429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:00.589442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:00.589450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255623341808977:9009]
2025-10-01T14:11:00.589502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:00.589504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:00.589518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:00.589523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:00.589525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:00.589543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:00.589567Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:00.589587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:00.589788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:00.590064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:00.590252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:00.590459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:00.590697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:00.590745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:00.590779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:00.591000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.591011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.591030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:00.591165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1268 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0
2025-10-01T14:11:00.591612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47ab5cd1-a0d004e0-8a4f1ea4-75d97620_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:00.594297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0] Write session: try to update token
2025-10-01T14:11:00.594322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:00.609574Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:00.609597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:00.609599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:00.609601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:00.609612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255623341808977:9009]
2025-10-01T14:11:00.609616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255623341808977:9009]
2025-10-01T14:11:00.609620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255623341808977:9009]
2025-10-01T14:11:00.609663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:00.609670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.609676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:00.609687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:00.609709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:00.609715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:00.609841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:00.611502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1268 sessionId: src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:00.614499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:00.656731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255625718688246:10063]
2025-10-01T14:11:00.657235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1267, pipe: [1:7556255625718688246:10063]
2025-10-01T14:11:00.748410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:00.748961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.748979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.748998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688246:10063], now have 1 active actors on pipe
2025-10-01T14:11:00.749319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:00.749852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:00.749867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0] Write session will restart in 0.006340s
2025-10-01T14:11:00.749312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255625718688246:10063]
2025-10-01T14:11:00.749894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0] Write session: Do CDS request
2025-10-01T14:11:00.749339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:00.749378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:00.749901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:00.749461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1268 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0
2025-10-01T14:11:00.749670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1268 sessionId: src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0 is DEAD
2025-10-01T14:11:00.757972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:00.758149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:00.758163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1269
2025-10-01T14:11:00.758589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:00.758623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:00.758628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:00.758631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:00.759304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1269 sessionId:  describe result for acl check
2025-10-01T14:11:00.759332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:00.759334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:00.759335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:00.759338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255625718688310:5038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:00.759759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255625718688310:5038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:00.760385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:00.762098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255625718688310:5038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:00.762181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:00.762412Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:00.762423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:00.762436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:00.762487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:00.762534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255623341809097:9011]
2025-10-01T14:11:00.763191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:00.763518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:00.763562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:00.763904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:00.763965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.763971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.763973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.763974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.763975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.763976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.763978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.763979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.763980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.763981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.763983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.763984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.763985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.763986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.763991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.764001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.764005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.764008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.764012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.764015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.764019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.764022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.764025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.764030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.764033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.764036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.764040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.764043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.764051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.764059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:00.764064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.764069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:00.764074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.764078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:00.764082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.764088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:00.764093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.764099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:00.764103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.764108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:00.764114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.764119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:00.764124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.764130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:00.764135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.764141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:00.764145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.764150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.764155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.764160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.764163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.764168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.764172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.764177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:00.764181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.764186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:00.764225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:00.765107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255625718688310:5038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:00.765121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255625718688310:5038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:00.765128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255625718688310:5038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:00.765137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:00.768534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:00.769280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:00.769297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:00.769300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:00.769304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:00.769311Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1268 [2:7556255623341809097:9011]
2025-10-01T14:11:00.769327Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:00.769343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:00.769347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:00.769351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:00.769353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:00.769372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:00.769385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:00.769391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:00.769446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.769455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.769457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.769460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:00.769463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:00.769533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:00.769542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.769554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:00.769564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:00.769583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:00.769606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255623341809091:9011]
2025-10-01T14:11:00.769613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255623341809091:9011]
2025-10-01T14:11:00.769615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255623341809091:9011]
2025-10-01T14:11:00.769631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:00.769651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:00.769672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:00.769680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:00.769717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255623341809091:9011]
2025-10-01T14:11:00.769723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:00.769727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:00.769727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:00.769729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:00.769737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688250:2446], now have 1 active actors on pipe
2025-10-01T14:11:00.769737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:00.769741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688349:5038], now have 1 active actors on pipe
2025-10-01T14:11:00.769841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1268
2025-10-01T14:11:00.769874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1268
2025-10-01T14:11:00.770012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.770025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.770048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:00.770055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:00.770058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:00.770060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:00.770071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:00.770080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:00.770092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:00.770296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:00.770302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:00.770316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:00.770436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1269 partition: 0 MaxSeqNo: 45 sessionId: src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0
2025-10-01T14:11:00.770847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d12d54b-49ab6def-173d2e36-63d9bace_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:00.773768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0] Write session: try to update token
2025-10-01T14:11:00.773788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:00.792615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:00.792640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:00.792643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:00.792647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:00.792657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255623341809091:9011]
2025-10-01T14:11:00.792663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255623341809091:9011]
2025-10-01T14:11:00.792667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255623341809091:9011]
2025-10-01T14:11:00.792735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:00.792743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:00.792747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:00.792892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:00.794502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:00.794515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:00.794518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:00.792450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1269 sessionId: src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:00.795276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:00.850515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255625718688358:10063]
2025-10-01T14:11:00.858518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1268, pipe: [1:7556255625718688358:10063]
2025-10-01T14:11:01.030194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:01.030778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.030798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.030843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255625718688358:10063], now have 1 active actors on pipe
2025-10-01T14:11:01.031107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:01.031118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255625718688358:10063]
2025-10-01T14:11:01.031162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:01.031164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:01.031246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1269 reason: error at write: Disconnected sessionId: src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0
2025-10-01T14:11:01.031441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1269 sessionId: src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0 is DEAD
2025-10-01T14:11:01.031262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:01.034520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:01.034539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0] Write session will restart in 0.007548s
2025-10-01T14:11:01.034573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0] Write session: Do CDS request
2025-10-01T14:11:01.034581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:01.043468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.043886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:01.043909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1270
2025-10-01T14:11:01.044080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.044114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:01.044124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:01.044129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:01.044786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1270 sessionId:  describe result for acl check
2025-10-01T14:11:01.044827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:01.044834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:01.044836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:01.044842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255630013655753:5026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:01.045511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255630013655753:5026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:01.056315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255630013655753:5026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:01.059965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:01.062898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255630013655753:5026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:01.062928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255630013655753:5026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:01.062932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255630013655753:5026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:01.062943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:01.062943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:01.063188Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:01.063200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:01.063214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:01.063277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:01.063345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255627636776503:9017]
2025-10-01T14:11:01.064029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:01.064354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:01.064411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:01.064762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:01.064850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.064860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.064861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.064863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.064864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.064867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.064868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.064870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.064871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.064873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.064874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.064875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.064877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.064879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.064885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.064896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.064901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.064905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.064908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.064913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.064917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.064921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.064925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.064929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.064933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.064937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.064941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.064944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.064955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.064963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.064971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.064977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.064981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.064986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.064991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.064997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.065002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.065007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.065011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.065016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.065021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.065027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.065031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.065036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.065041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.065046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.065050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.065056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.065061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.065066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.065071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.065083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.065088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.065103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.065108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.065113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.065154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:01.070997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:01.072615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:01.072649Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:01.072654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:01.072658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:01.072667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1269 [2:7556255627636776503:9017]
2025-10-01T14:11:01.072686Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:01.072721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:01.072733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.072736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.072739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.072761Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:01.072774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:01.072781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:01.072856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.072869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.072871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.072874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:01.072877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:01.072972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:01.072982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.072998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.073016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.073045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:01.073069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013655788:5026], now have 1 active actors on pipe
2025-10-01T14:11:01.073074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013655695:2446], now have 1 active actors on pipe
2025-10-01T14:11:01.073171Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1269
2025-10-01T14:11:01.073181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1269
2025-10-01T14:11:01.073083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255627636776497:9017]
2025-10-01T14:11:01.073093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255627636776497:9017]
2025-10-01T14:11:01.073095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255627636776497:9017]
2025-10-01T14:11:01.073112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:01.073128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:01.073135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:01.073138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:01.073141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:01.073144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:01.073148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:01.073201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255627636776497:9017]
2025-10-01T14:11:01.073215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:01.073247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:01.074474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.074497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.074534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38d120ba-92153515-f46b42b3-f8097e61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:01.074547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.074553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.074557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:01.074574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.074591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:01.074612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.078458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.078483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.078526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.079514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1270 partition: 0 MaxSeqNo: 45 sessionId: src_id|38d120ba-92153515-f46b42b3-f8097e61_0
2025-10-01T14:11:01.082511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d0959a6-80f73fe3-38ef8605-1c28795b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|38d120ba-92153515-f46b42b3-f8097e61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:01.085412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38d120ba-92153515-f46b42b3-f8097e61_0] Write session: try to update token
2025-10-01T14:11:01.085438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38d120ba-92153515-f46b42b3-f8097e61_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:01.096163Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:01.096191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:01.096194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:01.096197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:01.096207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255627636776497:9017]
2025-10-01T14:11:01.096212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255627636776497:9017]
2025-10-01T14:11:01.096216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255627636776497:9017]
2025-10-01T14:11:01.096264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:01.096267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:01.096272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.096274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:01.096275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:01.096279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:01.096428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:01.129911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1270 sessionId: src_id|38d120ba-92153515-f46b42b3-f8097e61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:01.133042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:01.134494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255630013655801:10063]
2025-10-01T14:11:01.138296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1269, pipe: [1:7556255630013655801:10063]
2025-10-01T14:11:01.235504Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:01.236422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.236445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.236468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013655801:10063], now have 1 active actors on pipe
2025-10-01T14:11:01.236972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:01.239919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255630013655801:10063]
2025-10-01T14:11:01.239964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:01.240067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1270 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38d120ba-92153515-f46b42b3-f8097e61_0
2025-10-01T14:11:01.240331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:01.245959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1270 sessionId: src_id|38d120ba-92153515-f46b42b3-f8097e61_0 is DEAD
2025-10-01T14:11:01.246675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38d120ba-92153515-f46b42b3-f8097e61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:01.246691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38d120ba-92153515-f46b42b3-f8097e61_0] Write session will restart in 0.005080s
2025-10-01T14:11:01.246719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38d120ba-92153515-f46b42b3-f8097e61_0] Write session: Do CDS request
2025-10-01T14:11:01.246726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38d120ba-92153515-f46b42b3-f8097e61_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:01.254922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38d120ba-92153515-f46b42b3-f8097e61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.258800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:01.258818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1271
2025-10-01T14:11:01.258989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.259024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:01.259030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:01.259035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:01.259434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1271 sessionId:  describe result for acl check
2025-10-01T14:11:01.259472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:01.259475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:01.259477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:01.259482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255630013655865:5020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:01.259998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255630013655865:5020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:01.261734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:01.263931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255630013655865:5020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:01.264576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:01.264841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:01.264855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:01.264866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:01.264925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:01.264977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255627636776635:9025]
2025-10-01T14:11:01.265650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:01.265957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:01.266000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:01.266492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:01.266567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.266573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.266574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.266575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.266577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.266578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.266580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.266581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.266583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.266584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.266585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.266586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.266588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.266588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.266593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.266604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.266608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.266615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.266619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.266623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.266627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.266631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.266634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.266639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.266642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.266646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.266655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.266658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.266666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.266674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.266684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.266690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.266698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.266703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.266709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.266718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.266726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.266736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.266740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.266745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.266754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.266764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.266772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.266781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.266789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.266798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.266807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.266812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.266821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.266826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.266834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.266839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.266847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.266852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.266860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.266864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.266908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:01.270941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:01.271958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:01.271977Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:01.271980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:01.271985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:01.271992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1270 [2:7556255627636776635:9025]
2025-10-01T14:11:01.272009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:01.272028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:01.272037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.272040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.272043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.272060Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:01.272071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:01.272083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:01.272164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.272171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.272173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.272177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:01.272180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:01.272250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:01.272258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.272271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.272284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.272299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:01.272322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013655803:2446], now have 1 active actors on pipe
2025-10-01T14:11:01.272332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255627636776629:9025]
2025-10-01T14:11:01.272335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255627636776629:9025]
2025-10-01T14:11:01.272337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255627636776629:9025]
2025-10-01T14:11:01.272352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:01.272365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:01.272368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:01.272374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:01.272376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:01.272381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:01.272384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:01.272367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1270
2025-10-01T14:11:01.272412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255627636776629:9025]
2025-10-01T14:11:01.272419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:01.272422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:01.280364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255630013655865:5020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:01.280385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255630013655865:5020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:01.280389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255630013655865:5020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:01.280398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:01.280684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013655909:5020], now have 1 active actors on pipe
2025-10-01T14:11:01.280714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1270
2025-10-01T14:11:01.280772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.280786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.280838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:01.280855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.280866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.280874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:01.280887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.280908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:01.280941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.281101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.281111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.281128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.281232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1271 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0
2025-10-01T14:11:01.282311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38d120ba-92153515-f46b42b3-f8097e61_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:01.284895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:01.284911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:01.284922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255627636776629:9025]
2025-10-01T14:11:01.284965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:01.284966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:01.285185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:01.285364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:01.285526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:01.285707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:01.286040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:01.286085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:01.290243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0] Write session: try to update token
2025-10-01T14:11:01.290271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:01.306475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:01.306494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:01.306496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:01.306498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:01.306507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255627636776629:9025]
2025-10-01T14:11:01.306511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255627636776629:9025]
2025-10-01T14:11:01.306518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255627636776629:9025]
2025-10-01T14:11:01.306574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:01.306576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:01.306583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:01.306585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.306587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:01.306588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:01.306791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:01.321857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1271 sessionId: src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:01.324841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:01.338638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255630013655918:10063]
2025-10-01T14:11:01.339473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1270, pipe: [1:7556255630013655918:10063]
2025-10-01T14:11:01.442936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:01.443440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.443463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.443484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013655918:10063], now have 1 active actors on pipe
2025-10-01T14:11:01.444611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255630013655918:10063]
2025-10-01T14:11:01.444640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:01.444644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:01.444648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:01.444331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:01.444745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1271 reason: error at write: Disconnected sessionId: src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0
2025-10-01T14:11:01.444988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1271 sessionId: src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0 is DEAD
2025-10-01T14:11:01.450925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:01.450943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0] Write session will restart in 0.005781s
2025-10-01T14:11:01.450989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0] Write session: Do CDS request
2025-10-01T14:11:01.450996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:01.458398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.458782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:01.458796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1272
2025-10-01T14:11:01.462544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.462601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:01.462607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:01.462612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:01.463678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1272 sessionId:  describe result for acl check
2025-10-01T14:11:01.463727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:01.463729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:01.463731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:01.463738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255630013655985:5014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:01.464328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255630013655985:5014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:01.479964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255630013655985:5014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:01.482630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:01.486662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:01.486910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:01.486914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:01.486926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:01.486984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:01.487029Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255627636776740:9032]
2025-10-01T14:11:01.487779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:01.488721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:01.488794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:01.489168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:01.489240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.489242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.489243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.489244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.489246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.489248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.489250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.489252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.489254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.489255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.489257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.489258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.489260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.489261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.489267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.489278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.489282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.489285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.489289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.489293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.489296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.489300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.489320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.489323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.489327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.489330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.489334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.489337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.489345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.489353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.489359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.489366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.489371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.489377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.489380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.489385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.489391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.489396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.489402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.489407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.489413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.489418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.489422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.489428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.489434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.489440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.489445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.489451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.489456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.489461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.489466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.489471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.489476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.489483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.489488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.489494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.489537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:01.492213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255630013655985:5014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:01.492239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255630013655985:5014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:01.492245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255630013655985:5014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:01.492256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:01.494681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:01.495665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:01.495671Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:01.495675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:01.495680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:01.495689Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1271 [2:7556255627636776740:9032]
2025-10-01T14:11:01.495709Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:01.495729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:01.495733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.495736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.495739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.495758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:01.495766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:01.495773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:01.495839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.495842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.495844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.495847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:01.495850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:01.495932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:01.495935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.495948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.495960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.495976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:01.495995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255627636776735:9032]
2025-10-01T14:11:01.495998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255627636776735:9032]
2025-10-01T14:11:01.496000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255627636776735:9032]
2025-10-01T14:11:01.496016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:01.496030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:01.496048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:01.496052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:01.496090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255627636776735:9032]
2025-10-01T14:11:01.496093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:01.497185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1271
2025-10-01T14:11:01.497235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1271
2025-10-01T14:11:01.496357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:01.496367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:01.496370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:01.496377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:01.501645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013656025:5014], now have 1 active actors on pipe
2025-10-01T14:11:01.501667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013655923:2446], now have 1 active actors on pipe
2025-10-01T14:11:01.501689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.501699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.501745Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:01.501757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.501763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.501766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:01.501789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.501808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:01.501831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.510492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.510522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.510571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.515947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1272 partition: 0 MaxSeqNo: 45 sessionId: src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0
2025-10-01T14:11:01.524956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9c1b8f-383bbb1c-151b2b70-a926fc4a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:01.527644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0] Write session: try to update token
2025-10-01T14:11:01.527667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:01.529889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:01.529921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:01.529924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:01.529928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:01.529940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255627636776735:9032]
2025-10-01T14:11:01.529946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255627636776735:9032]
2025-10-01T14:11:01.529963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255627636776735:9032]
2025-10-01T14:11:01.530019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:01.530028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.530031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:01.530196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:01.530531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:01.530544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:01.530549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:01.546958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255630013656034:10063]
2025-10-01T14:11:01.547416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1271, pipe: [1:7556255630013656034:10063]
2025-10-01T14:11:01.574744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1272 sessionId: src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:01.577936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:01.683673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:01.684175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013656034:10063], now have 1 active actors on pipe
2025-10-01T14:11:01.684237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.684245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.686712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:01.687123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:01.687143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:01.687208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1272 reason: error at write: Disconnected sessionId: src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0
2025-10-01T14:11:01.687461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1272 sessionId: src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0 is DEAD
2025-10-01T14:11:01.687616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255630013656034:10063]
2025-10-01T14:11:01.687633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:01.690836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:01.690852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0] Write session will restart in 0.007227s
2025-10-01T14:11:01.690905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0] Write session: Do CDS request
2025-10-01T14:11:01.690912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:01.700951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.703773Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:01.703790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1273
2025-10-01T14:11:01.704009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.704041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:01.704046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:01.704050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:01.704503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1273 sessionId:  describe result for acl check
2025-10-01T14:11:01.704538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:01.704540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:01.704542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:01.704547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255630013656050:5003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:01.705158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255630013656050:5003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:01.715599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:01.714629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255630013656050:5003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:01.719806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:01.720037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:01.720047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:01.720057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:01.720108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:01.720171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255627636776843:9034]
2025-10-01T14:11:01.720872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:01.721136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:01.721181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:01.721540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:01.721602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.721609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.721611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.721612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.721614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.721615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.721616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.721619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.721620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.721622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.721623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.721625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.721626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.721627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.721632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.721643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.721648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.721653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.721657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.721661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.721665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.721669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.721673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.721678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.721682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.721686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.721690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.721694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.721702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.721710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.721716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.721722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.721733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.721739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.721749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.721755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.721766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.721773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.721781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.721787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.721797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.721803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.721811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.721816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.721822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.721832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.721838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.721847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.721852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.721862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.721871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.721877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.721891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.721900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.721905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.721914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.721958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:01.722827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255630013656050:5003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:01.722844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255630013656050:5003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:01.722846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255630013656050:5003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:01.722853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:01.728166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:01.728903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:01.728922Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:01.728925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:01.728929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:01.728936Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1272 [2:7556255627636776843:9034]
2025-10-01T14:11:01.728954Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:01.728975Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:01.728982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.728987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.728989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.729005Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:01.729011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:01.729017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:01.729085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.729092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.729095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.729098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:01.729101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:01.729177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:01.729187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.729200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.729212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.729228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:01.729246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013656140:5003], now have 1 active actors on pipe
2025-10-01T14:11:01.729255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013656037:2446], now have 1 active actors on pipe
2025-10-01T14:11:01.729262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255627636776838:9034]
2025-10-01T14:11:01.729268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255627636776838:9034]
2025-10-01T14:11:01.729272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255627636776838:9034]
2025-10-01T14:11:01.729289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:01.729306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:01.729326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:01.729334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:01.729303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1272
2025-10-01T14:11:01.729366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255627636776838:9034]
2025-10-01T14:11:01.729375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:01.729377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1272
2025-10-01T14:11:01.729447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:01.729454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:01.729457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:01.729463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:01.729527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.729541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.729569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:01.729582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.729591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.729594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:01.729604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.729614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:01.729631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.729871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.729882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.729900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.730382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb80de-50a00cbc-bbb3811-5fa6f484_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:01.733369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0] Write session: try to update token
2025-10-01T14:11:01.733389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:01.730019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1273 partition: 0 MaxSeqNo: 45 sessionId: src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0
2025-10-01T14:11:01.752762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:01.752786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:01.752790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:01.752792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:01.752803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255627636776838:9034]
2025-10-01T14:11:01.752808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255627636776838:9034]
2025-10-01T14:11:01.752822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255627636776838:9034]
2025-10-01T14:11:01.752881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:01.752882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:01.752888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:01.752893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.752897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:01.752897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:01.753068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:01.763557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1273 sessionId: src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:01.766410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:01.787711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255630013656150:10063]
2025-10-01T14:11:01.788050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1272, pipe: [1:7556255630013656150:10063]
2025-10-01T14:11:01.900721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:01.901271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.901286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.901306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013656150:10063], now have 1 active actors on pipe
2025-10-01T14:11:01.901912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:01.901912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:01.901925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:01.901947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255630013656150:10063]
2025-10-01T14:11:01.901969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:01.901990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1273 reason: error at write: Disconnected sessionId: src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0
2025-10-01T14:11:01.902187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1273 sessionId: src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0 is DEAD
2025-10-01T14:11:01.902313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:01.902319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0] Write session will restart in 0.008757s
2025-10-01T14:11:01.902341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0] Write session: Do CDS request
2025-10-01T14:11:01.902345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:01.910226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:01.911831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.911912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:01.911925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1274
2025-10-01T14:11:01.912034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:01.912069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:01.912080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:01.912083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:01.912137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:01.912343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:01.912376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:01.912398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:01.912454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1274 sessionId:  describe result for acl check
2025-10-01T14:11:01.912458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:01.912488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:01.912494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:01.912495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:01.912501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255630013656232:4997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:01.912504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255627636776960:9038]
2025-10-01T14:11:01.912974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:01.913057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255630013656232:4997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:01.913254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:01.913286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:01.913497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:01.913533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.913538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.913539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.913540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.913541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.913541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.913542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.913543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.913543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.913544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.913544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.913545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.913546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.913546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.913550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.913560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.913563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.913567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.913570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.913573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.913577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.913581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.913584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.913587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.913589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.913590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.913592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.913594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.913598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.913603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:01.913606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.913610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:01.913612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.913615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:01.913618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.913621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:01.913623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.913626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:01.913628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.913631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:01.913634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.913638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:01.913640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.913643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:01.913646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.913649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:01.913651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.913654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.913656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.913659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.913661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.913664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.913666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.913669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:01.913671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.913674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:01.913695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:01.915122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255630013656232:4997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:01.917504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255630013656232:4997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:01.917518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255630013656232:4997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:01.917522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255630013656232:4997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:01.917543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:01.917820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:01.918592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:01.918605Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:01.918608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:01.918612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:01.918618Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1273 [2:7556255627636776960:9038]
2025-10-01T14:11:01.918632Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:01.918646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:01.918654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.918658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.918660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.918674Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:01.918680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:01.918691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:01.918768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.918774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.918778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.918781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:01.918783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:01.918845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:01.918851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.918863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:01.918878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:01.918894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:01.918924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013656271:4997], now have 1 active actors on pipe
2025-10-01T14:11:01.918931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255630013656154:2446], now have 1 active actors on pipe
2025-10-01T14:11:01.918938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255627636776955:9038]
2025-10-01T14:11:01.918949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255627636776955:9038]
2025-10-01T14:11:01.918950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255627636776955:9038]
2025-10-01T14:11:01.918964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:01.918978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:01.918961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1273
2025-10-01T14:11:01.918978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1273
2025-10-01T14:11:01.918993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:01.918996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:01.918999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:01.918999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:01.919001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:01.919038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.919046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.919062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255627636776955:9038]
2025-10-01T14:11:01.919073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:01.919083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:01.919100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:01.919110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:01.919115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:01.919121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:01.919129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:01.919141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:01.919165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.919319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.919325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.919339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:01.919434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1274 partition: 0 MaxSeqNo: 45 sessionId: src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0
2025-10-01T14:11:01.919806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f87858e-86f2e468-7967db2d-12b9f3c7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:01.922444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0] Write session: try to update token
2025-10-01T14:11:01.922459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:01.937740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1274 sessionId: src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:01.940394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:01.940675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:01.940716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:01.940742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:01.940749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:01.940751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:01.940753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:01.940761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255627636776955:9038]
2025-10-01T14:11:01.940766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255627636776955:9038]
2025-10-01T14:11:01.940771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255627636776955:9038]
2025-10-01T14:11:01.940814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:01.940825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:01.940829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:01.940834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:01.940841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:01.940847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:01.940990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:02.002194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255634308623597:10063]
2025-10-01T14:11:02.002944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1273, pipe: [1:7556255634308623597:10063]
2025-10-01T14:11:02.090159Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:02.090624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:02.090683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623597:10063], now have 1 active actors on pipe
2025-10-01T14:11:02.093400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:02.093416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0] Write session will restart in 0.005856s
2025-10-01T14:11:02.093443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0] Write session: Do CDS request
2025-10-01T14:11:02.093449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:02.092734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:02.092782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255634308623597:10063]
2025-10-01T14:11:02.092808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:02.092842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:02.092845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:02.092920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1274 reason: error at write: Disconnected sessionId: src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0
2025-10-01T14:11:02.093067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1274 sessionId: src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0 is DEAD
2025-10-01T14:11:02.100930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:02.106563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:02.106580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1275
2025-10-01T14:11:02.106929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:02.106967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:02.106974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:02.106978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:02.107424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1275 sessionId:  describe result for acl check
2025-10-01T14:11:02.107457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:02.107459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:02.107461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:02.107467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255634308623617:4974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:02.108085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255634308623617:4974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:02.121508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255634308623617:4974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:02.134898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255634308623617:4974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:02.134915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255634308623617:4974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:02.134919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255634308623617:4974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:02.134928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:02.136881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:02.139075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:02.139311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:02.139316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:02.139328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:02.139383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:02.139430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255631931744372:9042]
2025-10-01T14:11:02.140025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:02.140395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:02.140478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:02.140813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:02.140895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.140902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.140903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.140904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.140905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.140906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.140908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.140909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.140910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.140911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.140912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.140913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.140914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.140915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.140921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.140932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.140935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.140941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.140944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.140948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.140951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.140953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.140956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.140960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.140963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.140967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.140970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.140973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.140981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.140987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.140993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.140998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.141002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.141006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.141010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.141014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.141018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.141023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.141026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.141031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.141035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.141039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.141042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.141047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.141051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.141055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.141058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.141062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.141066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.141072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.141075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.141085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.141092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.141096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.141104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.141108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.141144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:02.146615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:02.147341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:02.147359Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:02.147361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:02.147367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:02.147374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1274 [2:7556255631931744372:9042]
2025-10-01T14:11:02.147392Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:02.147410Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:02.147418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:02.147422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:02.147424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:02.147441Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:02.147451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:02.147458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:02.147525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.147535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.147537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.147540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:02.147543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:02.147816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1274
2025-10-01T14:11:02.147818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1274
2025-10-01T14:11:02.147654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:02.147665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.147676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.147685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.147698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:02.147718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623699:4974], now have 1 active actors on pipe
2025-10-01T14:11:02.147721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623602:2446], now have 1 active actors on pipe
2025-10-01T14:11:02.147728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255631931744366:9042]
2025-10-01T14:11:02.147730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255631931744366:9042]
2025-10-01T14:11:02.147732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255631931744366:9042]
2025-10-01T14:11:02.147745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:02.147758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:02.147765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:02.147768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:02.147772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:02.147774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:02.147777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:02.147814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255631931744366:9042]
2025-10-01T14:11:02.147822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:02.147839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:02.147871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.147876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.147901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e62f121a-2c95efd0-ff024422-72f253b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:02.147908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:02.147912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:02.147914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:02.147923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:02.147932Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:02.147947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:02.148077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.148099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.148117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:02.148216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1275 partition: 0 MaxSeqNo: 45 sessionId: src_id|e62f121a-2c95efd0-ff024422-72f253b7_0
2025-10-01T14:11:02.148551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0fa206-e0452a29-7aef4858-b3c085d3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e62f121a-2c95efd0-ff024422-72f253b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:02.151251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f121a-2c95efd0-ff024422-72f253b7_0] Write session: try to update token
2025-10-01T14:11:02.151270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f121a-2c95efd0-ff024422-72f253b7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:02.159638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:02.159665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:02.159676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255631931744366:9042]
2025-10-01T14:11:02.159717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:02.160108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:02.160276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:02.160444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:02.160611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:02.160871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:02.160913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:02.161058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:02.169493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1275 sessionId: src_id|e62f121a-2c95efd0-ff024422-72f253b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:02.172394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:02.174664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.174701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.174752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:02.174893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:02.186549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:02.186572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:02.186575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:02.186578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:02.186590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255631931744366:9042]
2025-10-01T14:11:02.186595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255631931744366:9042]
2025-10-01T14:11:02.186599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255631931744366:9042]
2025-10-01T14:11:02.186644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:02.186651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.186652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:02.186794Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:02.186957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:02.186967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:02.186972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:02.195125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255634308623715:10063]
2025-10-01T14:11:02.202583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1274, pipe: [1:7556255634308623715:10063]
2025-10-01T14:11:02.376067Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:02.376353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623715:10063], now have 1 active actors on pipe
2025-10-01T14:11:02.385971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.386004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.386196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.386256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.386320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.386575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.386623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.386628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.386700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.386763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.386823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.386890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.386943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.386946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.387020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.387080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.387140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.387202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.387242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.387245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.387328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.387394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.387458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.387519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.387558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.387561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.387634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.387697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.387767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.387847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.387887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.387890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.387961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.388022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.388096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.388164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.388211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.388214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.388288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.388352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.388419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.388488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.388535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.388537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.388604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.388664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.388735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.388796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.388836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.388839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.388916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.388976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.389040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.389104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.389150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.389153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.389231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:02.389306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:02.389370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:02.389434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:02.389475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:02.389478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:02.390945Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:02.391564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f121a-2c95efd0-ff024422-72f253b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:02.391574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f121a-2c95efd0-ff024422-72f253b7_0] Write session will restart in 0.005745s
2025-10-01T14:11:02.391601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f121a-2c95efd0-ff024422-72f253b7_0] Write session: Do CDS request
2025-10-01T14:11:02.391607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f121a-2c95efd0-ff024422-72f253b7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:02.390863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:02.390874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:02.390903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1275 reason: error at write: Disconnected sessionId: src_id|e62f121a-2c95efd0-ff024422-72f253b7_0
2025-10-01T14:11:02.391116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1275 sessionId: src_id|e62f121a-2c95efd0-ff024422-72f253b7_0 is DEAD
2025-10-01T14:11:02.391248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255634308623715:10063]
2025-10-01T14:11:02.391262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:02.398886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f121a-2c95efd0-ff024422-72f253b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:02.399295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:02.399311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1276
2025-10-01T14:11:02.399420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:02.399450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:02.399457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:02.399461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:02.399927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1276 sessionId:  describe result for acl check
2025-10-01T14:11:02.399954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:02.399956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:02.399957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:02.399963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255634308623736:4967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:02.400493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255634308623736:4967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:02.404715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255634308623736:4967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:02.416330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255634308623736:4967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:02.416344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255634308623736:4967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:02.416347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255634308623736:4967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:02.416354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:02.433283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:02.436395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:02.436677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:02.436682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:02.436709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:02.436777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:02.436822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255631931744507:9054]
2025-10-01T14:11:02.437741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:02.438187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:02.438228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:02.438637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:02.438727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.438728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.438730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.438732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.438734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.438735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.438737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.438738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.438740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.438741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.438743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.438744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.438746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.438747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.438753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.438764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.438768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.438772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.438775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.438779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.438783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.438786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.438793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.438797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.438801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.438804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.438808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.438811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.438820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.438828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.438834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.438840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.438844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.438849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.438853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.438871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.438877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.438882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.438886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.438891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.438896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.438901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.438905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.438910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.438915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.438920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.438925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.438930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.438935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.438942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.438946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.438951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.438955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.438964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.438968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.438974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.439017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:02.445731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:02.446629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:02.446647Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:02.446651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:02.446656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:02.446664Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1275 [2:7556255631931744507:9054]
2025-10-01T14:11:02.446683Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:02.446703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:02.446707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:02.446711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:02.446714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:02.446734Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:02.446740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:02.446748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:02.446831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.446834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.446840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.446844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:02.446850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:02.446933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:02.446936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.446951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.446961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.446975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:02.446994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255631931744501:9054]
2025-10-01T14:11:02.446995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255631931744501:9054]
2025-10-01T14:11:02.446997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255631931744501:9054]
2025-10-01T14:11:02.447012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:02.447031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:02.447044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:02.447047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:02.447089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255631931744501:9054]
2025-10-01T14:11:02.447091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:02.447197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:02.447202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:02.447204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:02.447213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:02.447752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623729:2446], now have 1 active actors on pipe
2025-10-01T14:11:02.447771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623775:4967], now have 1 active actors on pipe
2025-10-01T14:11:02.451031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.451060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.451098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:02.451116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:02.451122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:02.451126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:02.451139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:02.451177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:02.451199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:02.450501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1275
2025-10-01T14:11:02.450564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1275
2025-10-01T14:11:02.454734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.454758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.454800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:02.454990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1276 partition: 0 MaxSeqNo: 45 sessionId: src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0
2025-10-01T14:11:02.458744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e62f121a-2c95efd0-ff024422-72f253b7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:02.461710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0] Write session: try to update token
2025-10-01T14:11:02.461737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:02.463915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:02.463940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:02.463950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255631931744501:9054]
2025-10-01T14:11:02.464008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:02.464207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:02.464364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:02.464508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:02.464650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:02.464865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:02.464899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:02.466824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:02.493162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:02.493184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:02.493187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:02.493190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:02.493202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255631931744501:9054]
2025-10-01T14:11:02.493206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255631931744501:9054]
2025-10-01T14:11:02.493211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255631931744501:9054]
2025-10-01T14:11:02.493260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:02.493268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.493270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:02.493417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:02.494599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:02.494614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:02.494619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:02.494457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255634308623841:10063]
2025-10-01T14:11:02.495799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1275, pipe: [1:7556255634308623841:10063]
2025-10-01T14:11:02.495814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1276 sessionId: src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:02.498543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:02.673645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:02.674000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623841:10063], now have 1 active actors on pipe
2025-10-01T14:11:02.674031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.674038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.674535Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:02.678482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:02.678494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:02.678565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1276 reason: error at write: Disconnected sessionId: src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0
2025-10-01T14:11:02.678793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1276 sessionId: src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0 is DEAD
2025-10-01T14:11:02.678980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255634308623841:10063]
2025-10-01T14:11:02.678997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:02.679430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:02.679440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0] Write session will restart in 0.008610s
2025-10-01T14:11:02.679469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0] Write session: Do CDS request
2025-10-01T14:11:02.679476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:02.694872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:02.695619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:02.695634Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1277
2025-10-01T14:11:02.695812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:02.695841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:02.695847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:02.695850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:02.702161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1277 sessionId:  describe result for acl check
2025-10-01T14:11:02.702211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:02.702213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:02.702215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:02.702222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255634308623858:4956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:02.702783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255634308623858:4956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:02.706352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255634308623858:4956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:02.714400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255634308623858:4956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:02.714417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255634308623858:4956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:02.714420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255634308623858:4956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:02.714439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:02.716376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:02.718505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:02.718713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:02.718717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:02.718728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:02.718772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:02.718806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255631931744618:9057]
2025-10-01T14:11:02.719374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:02.719701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:02.719737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:02.720035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:02.720083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.720084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.720085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.720086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.720087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.720088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.720089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.720090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.720091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.720092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.720093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.720094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.720095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.720096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.720101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.720110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.720114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.720118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.720121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.720124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.720127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.720131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.720134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.720137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.720140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.720143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.720146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.720149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.720156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.720163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.720169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.720173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.720177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.720181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.720184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.720189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.720192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.720197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.720201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.720205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.720210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.720214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.720218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.720222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.720226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.720231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.720234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.720239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.720243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.720247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.720252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.720256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.720261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.720265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.720271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.720275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.720306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:02.726570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1276
2025-10-01T14:11:02.726596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1276
2025-10-01T14:11:02.724967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:02.725629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:02.725634Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:02.725636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:02.725639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:02.725647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1276 [2:7556255631931744618:9057]
2025-10-01T14:11:02.725662Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:02.725680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:02.725684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:02.725687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:02.725689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:02.725705Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:02.725710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:02.725718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:02.725778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.725780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.725782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.725785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:02.725788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:02.725975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:02.725978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.725988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.725998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.726014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:02.726032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255631931744612:9057]
2025-10-01T14:11:02.726034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255631931744612:9057]
2025-10-01T14:11:02.726036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255631931744612:9057]
2025-10-01T14:11:02.726049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:02.726064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:02.726077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:02.726081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:02.726114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255631931744612:9057]
2025-10-01T14:11:02.726116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:02.726205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:02.726207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:02.726208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:02.726212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:02.727539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623945:4956], now have 1 active actors on pipe
2025-10-01T14:11:02.727552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623846:2446], now have 1 active actors on pipe
2025-10-01T14:11:02.727566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.727571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.727596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:02.727603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:02.727606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:02.727608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:02.727619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:02.727632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:02.727664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:02.731974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.731989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.732019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:02.732220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1277 partition: 0 MaxSeqNo: 45 sessionId: src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0
2025-10-01T14:11:02.734154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f7a48e2-808559d5-91f163cc-1cfe038a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:02.736811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0] Write session: try to update token
2025-10-01T14:11:02.736829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:02.754876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:02.754897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:02.754903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:02.754904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:02.754914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255631931744612:9057]
2025-10-01T14:11:02.754922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255631931744612:9057]
2025-10-01T14:11:02.754925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255631931744612:9057]
2025-10-01T14:11:02.754982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:02.754988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.754988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:02.754990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:02.754995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:02.754999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:02.755127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:02.762413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1277 sessionId: src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:02.765052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:02.779073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255634308623962:10063]
2025-10-01T14:11:02.779503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1276, pipe: [1:7556255634308623962:10063]
2025-10-01T14:11:02.917821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:02.918141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.918151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.918198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623962:10063], now have 1 active actors on pipe
2025-10-01T14:11:02.918416Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:02.919207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255634308623962:10063]
2025-10-01T14:11:02.919240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:02.919304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1277 reason: status is not ok: tablet will be restarted right now sessionId: src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0
2025-10-01T14:11:02.919507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1277 sessionId: src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0 is DEAD
2025-10-01T14:11:02.919599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:02.920300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:02.920310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0] Write session will restart in 0.009122s
2025-10-01T14:11:02.920341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0] Write session: Do CDS request
2025-10-01T14:11:02.920348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:02.930905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:02.931239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:02.931253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1278
2025-10-01T14:11:02.931420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:02.931446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:02.931452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:02.931455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:02.931873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1278 sessionId:  describe result for acl check
2025-10-01T14:11:02.931903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:02.931904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:02.931906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:02.931913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255634308624019:4953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:02.932445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255634308624019:4953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:02.936346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255634308624019:4953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:02.941024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255634308624019:4953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:02.941041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255634308624019:4953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:02.941044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255634308624019:4953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:02.941055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:02.943658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:02.946832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:02.947086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:02.947097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:02.947109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:02.947162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:02.947202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255631931744741:9061]
2025-10-01T14:11:02.947836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:02.948175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:02.948214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:02.948522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:02.948593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.948600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.948601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.948603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.948605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.948606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.948607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.948609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.948610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.948611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.948613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.948614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.948615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.948617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.948623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.948634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.948638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.948643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.948647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.948651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.948654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.948658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.948662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.948666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.948670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.948675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.948679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.948683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.948691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.948709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:02.948716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.948728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:02.948733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.948738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:02.948743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.948749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:02.948759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.948765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:02.948775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.948780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:02.948790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.948800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:02.948805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.948815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:02.948820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.948829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:02.948834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.948844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.948850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.948860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.948870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.948879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.948888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.948894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:02.948902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.948907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:02.948955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:02.954615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:02.955232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:02.955252Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:02.955255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:02.955259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:02.955267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1277 [2:7556255631931744741:9061]
2025-10-01T14:11:02.955285Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:02.955309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:02.955317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:02.955321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:02.955324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:02.955345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:02.955356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:02.955366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:02.955429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.955436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.955438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.955442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:02.955444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:02.955519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:02.955527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.955539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:02.955556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:02.955638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1277
2025-10-01T14:11:02.955692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1277
2025-10-01T14:11:02.955578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:02.955603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308624080:4953], now have 1 active actors on pipe
2025-10-01T14:11:02.955606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255634308623977:2446], now have 1 active actors on pipe
2025-10-01T14:11:02.955614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255631931744736:9061]
2025-10-01T14:11:02.955617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255631931744736:9061]
2025-10-01T14:11:02.955619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255631931744736:9061]
2025-10-01T14:11:02.955635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:02.955652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:02.955668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:02.955668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:02.955671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:02.955672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:02.955678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:02.955724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.955729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.955742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255631931744736:9061]
2025-10-01T14:11:02.955750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:02.955760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:02.955785Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:02.955792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:02.955796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:02.955799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:02.955809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:02.955817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:02.955839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:02.956055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.956066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.956081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:02.956171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1278 partition: 0 MaxSeqNo: 45 sessionId: src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0
2025-10-01T14:11:02.956519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|989609c-6941e1ec-3db8fea6-2fc18cde_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:02.959000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0] Write session: try to update token
2025-10-01T14:11:02.959018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:02.972951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1278 sessionId: src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:02.975387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:02.975648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:02.975672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:02.975712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:02.975779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:02.977824Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:02.977846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:02.977849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:02.977850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:02.977860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255631931744736:9061]
2025-10-01T14:11:02.977866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255631931744736:9061]
2025-10-01T14:11:02.977869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255631931744736:9061]
2025-10-01T14:11:02.977924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:02.977935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:02.977938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:02.977946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:02.977970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:02.977975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:02.978076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:03.021593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255638603591402:10063]
2025-10-01T14:11:03.021969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1277, pipe: [1:7556255638603591402:10063]
2025-10-01T14:11:03.121629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:03.129557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.129595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.129775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.129845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.129902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.129962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.130083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.130094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.130168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.130222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.130275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.130335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.130395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.130403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.130459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.130510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.130563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.130615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.130654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.130659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.130717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.130772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.130824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.130878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.130918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.130924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.130979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.131030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.131080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.131131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.131179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.131186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.131263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.131326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.131395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.131454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.131496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.131501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.131559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.131614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.131668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.131722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.131761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.131765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.131822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.131875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.131926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.131986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.132028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.132033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.132092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.132147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.132202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.132267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.132309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.132314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.132374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.132429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.132487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.132552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.132590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.132595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.132652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591402:10063], now have 1 active actors on pipe
2025-10-01T14:11:03.132874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255638603591402:10063]
2025-10-01T14:11:03.132913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:03.132919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:03.132945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1278 reason: error at write: Disconnected sessionId: src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0
2025-10-01T14:11:03.133119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1278 sessionId: src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0 is DEAD
2025-10-01T14:11:03.133154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:03.133217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:03.133224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0] Write session will restart in 0.005589s
2025-10-01T14:11:03.133248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0] Write session: Do CDS request
2025-10-01T14:11:03.133254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:03.133608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:03.139843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.140043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:03.140057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1279
2025-10-01T14:11:03.140188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.140221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:03.140230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:03.140233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:03.140599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1279 sessionId:  describe result for acl check
2025-10-01T14:11:03.140632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:03.140638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:03.140639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:03.140644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255638603591482:4938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:03.141192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255638603591482:4938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:03.141741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:03.143355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:03.143550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:03.143560Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:03.143572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:03.143621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:03.143659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255636226712152:9065]
2025-10-01T14:11:03.143661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255638603591482:4938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:03.144260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:03.144508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:03.144544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:03.144848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:03.144898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.144903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.144905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.144906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.144907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.144908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.144909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.144910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.144911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.144912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.144913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.144915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.144916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.144917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.144921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.144932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.144935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.144938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.144942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.144945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.144950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.144953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.144957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.144961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.144965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.144973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.144977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.144985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.144991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.145002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.145012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.145021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.145029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.145039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.145046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.145052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.145060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.145065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.145072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.145078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.145086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.145091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.145099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.145108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.145116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.145120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.145128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.145137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.145146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.145154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.145162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.145167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.145175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.145181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.145185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.145194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.145239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:03.148903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255638603591482:4938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:03.148921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255638603591482:4938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:03.148925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255638603591482:4938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:03.148934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:03.149055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:03.149698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:03.149714Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:03.149717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:03.149721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:03.149728Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1278 [2:7556255636226712152:9065]
2025-10-01T14:11:03.149745Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:03.149763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:03.149771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.149774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.149777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.149792Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:03.149798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:03.149809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:03.149868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.149875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.149877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.149882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:03.149889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:03.149967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:03.149975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.149987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.150002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.150022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:03.150043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591414:2446], now have 1 active actors on pipe
2025-10-01T14:11:03.150047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591523:4938], now have 1 active actors on pipe
2025-10-01T14:11:03.150054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255636226712147:9065]
2025-10-01T14:11:03.150103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1278
2025-10-01T14:11:03.150056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255636226712147:9065]
2025-10-01T14:11:03.150058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255636226712147:9065]
2025-10-01T14:11:03.150072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:03.150085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:03.150110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1278
2025-10-01T14:11:03.150090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:03.150093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:03.150095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:03.150100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:03.150103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:03.150134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255636226712147:9065]
2025-10-01T14:11:03.150137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:03.150139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:03.150156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.150161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.150205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:03.150217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.150222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.150224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:03.150233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.150246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:03.150271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.150431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.150443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.150459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.150545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1279 partition: 0 MaxSeqNo: 45 sessionId: src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0
2025-10-01T14:11:03.150930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799b152e-c7931487-3dd8b6a0-80a9d68b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:03.153361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0] Write session: try to update token
2025-10-01T14:11:03.153377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:03.167429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1279 sessionId: src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:03.170162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:03.171592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.171617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.171635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:03.171643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:03.171645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:03.171647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:03.171656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255636226712147:9065]
2025-10-01T14:11:03.171662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255636226712147:9065]
2025-10-01T14:11:03.171666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255636226712147:9065]
2025-10-01T14:11:03.171703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:03.171711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:03.171714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:03.171717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.171717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:03.171718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:03.171842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:03.233077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255638603591531:10063]
2025-10-01T14:11:03.233355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1278, pipe: [1:7556255638603591531:10063]
2025-10-01T14:11:03.308477Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:03.308948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:03.308815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:03.308863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591531:10063], now have 1 active actors on pipe
2025-10-01T14:11:03.309064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:03.309117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255638603591531:10063]
2025-10-01T14:11:03.318492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:03.320501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:03.320789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:03.320801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:03.320820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:03.320883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:03.320927Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255636226712265:9067]
2025-10-01T14:11:03.320956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:03.320969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:03.320990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1279 reason: error at write: Disconnected sessionId: src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0
2025-10-01T14:11:03.321169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1279 sessionId: src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0 is DEAD
2025-10-01T14:11:03.321489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:03.321791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:03.321802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0] Write session will restart in 0.005430s
2025-10-01T14:11:03.321826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0] Write session: Do CDS request
2025-10-01T14:11:03.321832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:03.327444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:03.327533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:03.327893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:03.327947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.327956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.327957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.327958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.327960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.327961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.327962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.327964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.327967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.327969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.327970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.327971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.327972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.327973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.327980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.327990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.327993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.327997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.328001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.328005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.328008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.328012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.328016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.328020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.328023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.328027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.328031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.328035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.328041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.328049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.328060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.328065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.328069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.328074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.328082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.328087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.328095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.328101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.328109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.328116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.328126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.328135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.328139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.328148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.328156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.328160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.328164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.328173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.328181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.328190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.328198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.328203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.328211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.328219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.328224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.328228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.328269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:03.328911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.328917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:03.328931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1280
2025-10-01T14:11:03.329135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.329173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:03.329179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:03.329183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:03.329778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1280 sessionId:  describe result for acl check
2025-10-01T14:11:03.329808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:03.329815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:03.329816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:03.329819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255638603591615:4924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:03.330198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255638603591615:4924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:03.332036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:03.332266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255638603591615:4924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:03.332880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:03.332899Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:03.332901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:03.332904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:03.332911Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1279 [2:7556255636226712265:9067]
2025-10-01T14:11:03.332927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:03.332942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:03.332948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.332951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.332954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.332969Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:03.332982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:03.332991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:03.333039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.333047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.333049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.333052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:03.333054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:03.333119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:03.333128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.333139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.333147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.333160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:03.333177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255636226712256:9067]
2025-10-01T14:11:03.333179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255636226712256:9067]
2025-10-01T14:11:03.333182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255636226712256:9067]
2025-10-01T14:11:03.335312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255638603591615:4924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:03.335325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255638603591615:4924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:03.335328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255638603591615:4924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:03.335334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:03.333195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:03.333211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:03.333223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:03.333226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:03.333257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255636226712256:9067]
2025-10-01T14:11:03.333259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:03.338483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:03.338502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:03.338504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:03.338511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:03.338598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591532:2446], now have 1 active actors on pipe
2025-10-01T14:11:03.338628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591649:4924], now have 1 active actors on pipe
2025-10-01T14:11:03.338732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1279
2025-10-01T14:11:03.338775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1279
2025-10-01T14:11:03.338890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.338913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.338954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:03.338982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.338994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.338996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:03.339010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.339027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:03.339063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.339253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.339262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.339278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.339381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1280 partition: 0 MaxSeqNo: 45 sessionId: src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0
2025-10-01T14:11:03.339818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b09b729e-8dcfe4d7-a3a7592e-fc30bdbb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:03.342476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0] Write session: try to update token
2025-10-01T14:11:03.342500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:03.359451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1280 sessionId: src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:03.360717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:03.360734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:03.360735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:03.360737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:03.360745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255636226712256:9067]
2025-10-01T14:11:03.360749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255636226712256:9067]
2025-10-01T14:11:03.360753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255636226712256:9067]
2025-10-01T14:11:03.360803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:03.360813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.360814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:03.360814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:03.360819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:03.360822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:03.360942Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:03.361930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:03.409187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255638603591660:10063]
2025-10-01T14:11:03.409456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1279, pipe: [1:7556255638603591660:10063]
2025-10-01T14:11:03.506805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:03.507083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.507097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.507138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591660:10063], now have 1 active actors on pipe
2025-10-01T14:11:03.507333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:03.507346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:03.507353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255638603591660:10063]
2025-10-01T14:11:03.507373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:03.507375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:03.507609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1280 reason: error at write: Disconnected sessionId: src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0
2025-10-01T14:11:03.507759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1280 sessionId: src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0 is DEAD
2025-10-01T14:11:03.507885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:03.507894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0] Write session will restart in 0.007355s
2025-10-01T14:11:03.507919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0] Write session: Do CDS request
2025-10-01T14:11:03.507925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:03.516891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.516977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:03.516989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1281
2025-10-01T14:11:03.517093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.517123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:03.517132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:03.517137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:03.517467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1281 sessionId:  describe result for acl check
2025-10-01T14:11:03.517495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:03.517497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:03.517498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:03.517502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255638603591732:4925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:03.517941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255638603591732:4925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:03.521233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:03.524065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255638603591732:4925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:03.523535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:03.523777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:03.523781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:03.523793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:03.523842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:03.523872Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255636226712405:9080]
2025-10-01T14:11:03.524402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:03.524741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:03.524804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:03.525116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:03.525200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.525208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.525209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.525210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.525211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.525212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.525213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.525215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.525216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.525217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.525217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.525218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.525219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.525220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.525225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.525234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.525237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.525241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.525244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.525248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.525252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.525255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.525259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.525262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.525266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.525269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.525273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.525276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.525284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.525292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.525303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.525313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.525317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.525326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.525330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.525339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.525344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.525353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.525357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.525367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.525372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.525381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.525385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.525390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.525398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.525403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.525411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.525415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.525422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.525428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.525432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.525440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.525445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.525453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.525457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.525465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.525502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:03.529707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:03.530322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:03.530326Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:03.530328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:03.530331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:03.530337Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1280 [2:7556255636226712405:9080]
2025-10-01T14:11:03.530354Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:03.530382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:03.530385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.530388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.530390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.530404Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:03.530409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:03.530414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:03.530464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.530467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.530469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.530471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:03.530474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:03.530535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:03.530537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.530547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.530558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.530572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:03.530587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255636226712400:9080]
2025-10-01T14:11:03.530588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255636226712400:9080]
2025-10-01T14:11:03.530590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255636226712400:9080]
2025-10-01T14:11:03.530602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:03.530614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:03.530626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:03.530629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:03.530653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255636226712400:9080]
2025-10-01T14:11:03.530656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:03.530737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:03.530741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:03.530743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:03.530749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:03.531154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591662:2446], now have 1 active actors on pipe
2025-10-01T14:11:03.531009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1280
2025-10-01T14:11:03.531332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255638603591732:4925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:03.531340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255638603591732:4925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:03.531343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255638603591732:4925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:03.531350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:03.531793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591777:4925], now have 1 active actors on pipe
2025-10-01T14:11:03.531801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1280
2025-10-01T14:11:03.531883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.531891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.531913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:03.531924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.531932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.531934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:03.531943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.531956Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:03.531974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.532473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.532483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.532500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.532609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1281 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0
2025-10-01T14:11:03.533414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cad76cf-c1ff17d1-2a7a4737-7436e29f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:03.535899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0] Write session: try to update token
2025-10-01T14:11:03.535916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:03.552868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1281 sessionId: src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:03.555532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:03.571792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.571816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.571840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:03.571843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:03.571854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255636226712400:9080]
2025-10-01T14:11:03.571908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:03.572091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:03.572236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:03.572376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:03.572511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:03.572718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:03.572751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:03.572773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:03.573078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:03.572937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:03.602999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.603024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.603192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.603268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.603332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.603396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.603435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.603446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.603516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.603580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.603638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.603693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.603733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.603735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.603796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.603849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.603912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.603971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.604013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.604016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.604078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.604138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.604190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.604251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.604292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.604294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.604364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.604426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.604490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.604551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.604589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.604591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.604654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.604713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.604771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.604834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.604881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.604883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.604950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.605008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.605072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.605143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.605180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.605182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.605248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.605301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.605359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.605411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.605466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.605468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.605537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.605593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.605657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.605715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.605757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.605760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.605829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:03.605891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:03.605952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:03.606020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:03.606064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:03.606071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:03.606149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:11:03.606209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.606229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.606235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:11:03.606253Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606265Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606268Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606272Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606276Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606280Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606283Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606287Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606289Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606292Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606522Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606528Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606530Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606533Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606536Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606720Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606724Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606728Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606731Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606734Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606736Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606740Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606743Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606746Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606749Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606840Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606849Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606852Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606855Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606858Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606862Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606865Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.607548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255638603591782:10063]
2025-10-01T14:11:03.606869Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606872Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606875Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:03.606899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:11:03.606908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:11:03.606911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:11:03.606914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:11:03.606916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:11:03.607295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:11:03.607308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:11:03.607314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:11:03.607317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:11:03.607319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:11:03.607322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:11:03.608064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1280, pipe: [1:7556255638603591782:10063]
2025-10-01T14:11:03.607828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:11:03.607848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:11:03.607853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:11:03.607856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:11:03.607858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:11:03.607862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:11:03.608370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:11:03.608379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.608472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327863608
2025-10-01T14:11:03.611180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591782:10063], now have 1 active actors on pipe
2025-10-01T14:11:03.611202Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:11:03.611218Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:11:03.611230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:03.611232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:03.611234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:03.611236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:03.611242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255636226712400:9080]
2025-10-01T14:11:03.611245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255636226712400:9080]
2025-10-01T14:11:03.611248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255636226712400:9080]
2025-10-01T14:11:03.611320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:03.611329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.611331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:03.611451Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:03.614410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:03.614420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:03.614423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:03.759687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:03.760559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:03.760562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255638603591782:10063]
2025-10-01T14:11:03.760577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:03.760589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:03.760604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1281 reason: error at write: Disconnected sessionId: src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0
2025-10-01T14:11:03.760835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1281 sessionId: src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0 is DEAD
2025-10-01T14:11:03.760976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:03.760987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0] Write session will restart in 0.006629s
2025-10-01T14:11:03.761013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0] Write session: Do CDS request
2025-10-01T14:11:03.761019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:03.760589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:03.768935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.769053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:03.769068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1282
2025-10-01T14:11:03.769230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.769260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:03.769266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:03.769269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:03.769728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1282 sessionId:  describe result for acl check
2025-10-01T14:11:03.769764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:03.769770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:03.769772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:03.769778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255638603591811:4917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:03.770301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255638603591811:4917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:03.772830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:03.773071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255638603591811:4917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:03.774851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:03.775048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:03.775056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:03.775067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:03.775106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:03.775139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255636226712531:9082]
2025-10-01T14:11:03.775278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255638603591811:4917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:03.775291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255638603591811:4917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:03.775295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255638603591811:4917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:03.775303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:03.775678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:03.775920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:03.775953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:03.776217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:03.776271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.776278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.776279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.776280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.776281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.776281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.776282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.776283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.776284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.776285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.776286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.776287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.776287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.776288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.776292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.776300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.776303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.776306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.776310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.776313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.776315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.776318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.776320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.776324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.776327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.776330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.776333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.776336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.776341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.776347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.776353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.776357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.776361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.776365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.776368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.776371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.776375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.776379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.776383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.776398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.776410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.776414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.776418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.776421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.776425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.776429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.776432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.776436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.776439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.776443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.776446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.776460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.776463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.776467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.776470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.776473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.776502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:03.781230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:03.781914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:03.781926Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:03.781928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:03.781932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:03.781938Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1281 [2:7556255636226712531:9082]
2025-10-01T14:11:03.781952Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:03.781971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:03.781978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.781981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.781983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.781998Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:03.782006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:03.782011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:03.782068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.782074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.782076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.782079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:03.782081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:03.782264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:03.782272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.782281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.782290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.782309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:03.782330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591787:2446], now have 1 active actors on pipe
2025-10-01T14:11:03.782336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591897:4917], now have 1 active actors on pipe
2025-10-01T14:11:03.782344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255636226712525:9082]
2025-10-01T14:11:03.782349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255636226712525:9082]
2025-10-01T14:11:03.782351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255636226712525:9082]
2025-10-01T14:11:03.782365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:03.782322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1281
2025-10-01T14:11:03.782393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:03.782359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1281
2025-10-01T14:11:03.782410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:03.782411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:03.782414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:03.782416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:03.782417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:03.782453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255636226712525:9082]
2025-10-01T14:11:03.782464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:03.782476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:03.782501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.782509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.782532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:03.782542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.782546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.782552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:03.782560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.782571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:03.782586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.782762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.782768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.782779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.782852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1282 partition: 0 MaxSeqNo: 45 sessionId: src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0
2025-10-01T14:11:03.783247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ec61d20-e7962a7d-d81742fc-276e58a4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:03.785978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0] Write session: try to update token
2025-10-01T14:11:03.785996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:03.799762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1282 sessionId: src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:03.802044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:03.803448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.803478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.803499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:03.803504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:03.803507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:03.803509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:03.803518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255636226712525:9082]
2025-10-01T14:11:03.803524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255636226712525:9082]
2025-10-01T14:11:03.803528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255636226712525:9082]
2025-10-01T14:11:03.803571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:03.803582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:03.803585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:03.803588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:03.803595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.803597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:03.803721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:03.860767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255638603591909:10063]
2025-10-01T14:11:03.860968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1281, pipe: [1:7556255638603591909:10063]
2025-10-01T14:11:03.957689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:03.958007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:03.958067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591909:10063], now have 1 active actors on pipe
2025-10-01T14:11:03.958143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:03.958275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:03.958330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255638603591909:10063]
2025-10-01T14:11:03.968150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:03.969887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:03.970088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:03.970096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:03.970104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:03.970150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:03.970181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255636226712647:9086]
2025-10-01T14:11:03.970783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:03.970883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:03.970899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:03.970926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1282 reason: error at write: Disconnected sessionId: src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0
2025-10-01T14:11:03.971079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1282 sessionId: src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0 is DEAD
2025-10-01T14:11:03.971208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:03.971220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0] Write session will restart in 0.006698s
2025-10-01T14:11:03.971247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0] Write session: Do CDS request
2025-10-01T14:11:03.971254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:03.978250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:03.978330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:03.978633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:03.978703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.978707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.978708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.978709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.978710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.978711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.978712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.978713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.978714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.978715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.978716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.978716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.978717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.978718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.978723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.978730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.978733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.978735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.978738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.978740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.978742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.978745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.978747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.978750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.978752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.978756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.978760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.978763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.978772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.978780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:03.978792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.978799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:03.978804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.978810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:03.978814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.978820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:03.978824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.978830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:03.978834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.978839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:03.978844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.978849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:03.978853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.978858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:03.978863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.978868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:03.978873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.978878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.978883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.978888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.978892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.978896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.978901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.978904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:03.978906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.978909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:03.978933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:03.978985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.979061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:03.979076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1283
2025-10-01T14:11:03.979234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:03.979279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:03.979290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:03.979294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:03.979682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1283 sessionId:  describe result for acl check
2025-10-01T14:11:03.979726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:03.979733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:03.979735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:03.979740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255638603592006:4909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:03.980295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255638603592006:4909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:03.982876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:03.983042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255638603592006:4909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:03.983559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:03.983576Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:03.983578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:03.983581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:03.983588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1282 [2:7556255636226712647:9086]
2025-10-01T14:11:03.983603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:03.983617Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:03.983625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.983628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.983630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.983647Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:03.983656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:03.983662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:03.983721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.983729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.983731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.983734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:03.983737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:03.983802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:03.983809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:03.983820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:03.983829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:03.983846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:03.983868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603591926:2446], now have 1 active actors on pipe
2025-10-01T14:11:03.983879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255636226712641:9086]
2025-10-01T14:11:03.983885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255636226712641:9086]
2025-10-01T14:11:03.983887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255636226712641:9086]
2025-10-01T14:11:03.983902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:03.983930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1282
2025-10-01T14:11:03.983917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:03.983919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:03.983931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:03.983934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:03.983939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:03.983942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:03.983968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255636226712641:9086]
2025-10-01T14:11:03.983971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:03.983973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:03.988598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255638603592006:4909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:03.988614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255638603592006:4909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:03.988619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255638603592006:4909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:03.988627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:03.988874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255638603592041:4909], now have 1 active actors on pipe
2025-10-01T14:11:03.988908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1282
2025-10-01T14:11:03.988972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.988985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.989012Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d88c80e-fbb73295-9270a016-db023cad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:03.989027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:03.989036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:03.989038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:03.989050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:03.989073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:03.989096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.989310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:03.989318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:03.989331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:03.989418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1283 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d88c80e-fbb73295-9270a016-db023cad_0
2025-10-01T14:11:03.989769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6699c512-584a146a-411f2e6b-24e1e9f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d88c80e-fbb73295-9270a016-db023cad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:03.992380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d88c80e-fbb73295-9270a016-db023cad_0] Write session: try to update token
2025-10-01T14:11:03.992397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d88c80e-fbb73295-9270a016-db023cad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:03.994248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:03.994262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:03.994270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255636226712641:9086]
2025-10-01T14:11:03.994304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:03.994317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:03.994479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:03.994612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:03.994741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:03.994867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:03.995037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:03.995069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:04.006666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1283 sessionId: src_id|4d88c80e-fbb73295-9270a016-db023cad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:04.009365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:04.009581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.009608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.009651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:04.009733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:04.012927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:04.012944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:04.012946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:04.012947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:04.012956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255636226712641:9086]
2025-10-01T14:11:04.012960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255636226712641:9086]
2025-10-01T14:11:04.012964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255636226712641:9086]
2025-10-01T14:11:04.013006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:04.013012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:04.013015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.013017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:04.013018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:04.013027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:04.013147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:04.058432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255642898559354:10063]
2025-10-01T14:11:04.058709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1282, pipe: [1:7556255642898559354:10063]
2025-10-01T14:11:04.156943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:04.164285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.164310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.164460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.164515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.164570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.164626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.164667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.164674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.164746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.164802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.164861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.164917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.164961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.164968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.165030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.165092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.165150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.165212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.165252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.165258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.165320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.165390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.165454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.165523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.165565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.165570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.165628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.165683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.165744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.165803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.165845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.165851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.165926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.165993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.166056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.166118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.166184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.166192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.166253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.166313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.166389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.166457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.166503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.166510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.166575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.166628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.166686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.166741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.166782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.166788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.166851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.166917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.166981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.167047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.167097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.167103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.167162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.167218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.167281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.167339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.167460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.167467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.167528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559354:10063], now have 1 active actors on pipe
2025-10-01T14:11:04.167775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:04.167791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:04.167821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1283 reason: error at write: Disconnected sessionId: src_id|4d88c80e-fbb73295-9270a016-db023cad_0
2025-10-01T14:11:04.168063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1283 sessionId: src_id|4d88c80e-fbb73295-9270a016-db023cad_0 is DEAD
2025-10-01T14:11:04.168234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d88c80e-fbb73295-9270a016-db023cad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:04.168245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d88c80e-fbb73295-9270a016-db023cad_0] Write session will restart in 0.009797s
2025-10-01T14:11:04.168271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d88c80e-fbb73295-9270a016-db023cad_0] Write session: Do CDS request
2025-10-01T14:11:04.168276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d88c80e-fbb73295-9270a016-db023cad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:04.168304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:04.168311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255642898559354:10063]
2025-10-01T14:11:04.168559Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:04.177500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:04.178895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d88c80e-fbb73295-9270a016-db023cad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.179022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:04.179036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1284
2025-10-01T14:11:04.179152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.179185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:04.179195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:04.179199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:04.179422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:04.179582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1284 sessionId:  describe result for acl check
2025-10-01T14:11:04.179595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:04.179609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:04.179604Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:04.179614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:04.179650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:04.179658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:04.179663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:04.179667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255642898559443:4882] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:04.179687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255640521680064:9090]
2025-10-01T14:11:04.180044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255642898559443:4882] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:04.180313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:04.180551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:04.180586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:04.180894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:04.180939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.180945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.180946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.180947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.180948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.180949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.180950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.180951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.180953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.180954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.180955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.180956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.180957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.180958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.180963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.180972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.180976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.180979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.180983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.180987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.180990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.180994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.180997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.181001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.181004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.181008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.181011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.181014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.181020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.181027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.181033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.181038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.181043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.181048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.181052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.181056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.181061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.181065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.181069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.181074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.181083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.181088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.181092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.181101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.181106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.181111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.181119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.181124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.181128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.181136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.181140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.181145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.181149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.181153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.181161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.181165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.181201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:04.181882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255642898559443:4882] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:04.184495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255642898559443:4882] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:04.184506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255642898559443:4882] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:04.184508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255642898559443:4882] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:04.184515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:04.184714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:04.185417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:04.185433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:04.185435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:04.185438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:04.185445Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1283 [2:7556255640521680064:9090]
2025-10-01T14:11:04.185458Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:04.185474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:04.185481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.185485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.185487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.185501Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:04.185509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:04.185515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:04.185563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.185570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.185571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.185575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:04.185577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:04.185636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:04.185641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.185651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.185666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.185691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:04.185711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559367:2446], now have 1 active actors on pipe
2025-10-01T14:11:04.185718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559479:4882], now have 1 active actors on pipe
2025-10-01T14:11:04.185725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255640521680059:9090]
2025-10-01T14:11:04.185727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255640521680059:9090]
2025-10-01T14:11:04.185729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255640521680059:9090]
2025-10-01T14:11:04.185726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1283
2025-10-01T14:11:04.185734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1283
2025-10-01T14:11:04.185746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:04.185762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:04.185769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:04.185772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:04.185774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:04.185775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:04.185778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:04.185806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255640521680059:9090]
2025-10-01T14:11:04.185818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:04.185828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:04.185831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.185835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.185874Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e636537c-455557c1-11817f66-7ccc33de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:04.185885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.185889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.185891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:04.185897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.185904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:04.185922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.186032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.186039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.186050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.186103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1284 partition: 0 MaxSeqNo: 45 sessionId: src_id|e636537c-455557c1-11817f66-7ccc33de_0
2025-10-01T14:11:04.186477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d88c80e-fbb73295-9270a016-db023cad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e636537c-455557c1-11817f66-7ccc33de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:04.188785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e636537c-455557c1-11817f66-7ccc33de_0] Write session: try to update token
2025-10-01T14:11:04.188800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e636537c-455557c1-11817f66-7ccc33de_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:04.201532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1284 sessionId: src_id|e636537c-455557c1-11817f66-7ccc33de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:04.203766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:04.204345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.204366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.206105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:04.206132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:04.206135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:04.206137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:04.206138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:04.206144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255640521680059:9090]
2025-10-01T14:11:04.206150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255640521680059:9090]
2025-10-01T14:11:04.206152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255640521680059:9090]
2025-10-01T14:11:04.206178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:04.206184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:04.206192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.206193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:04.206193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:04.206197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:04.206216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:04.206308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:04.268325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255642898559488:10063]
2025-10-01T14:11:04.268574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1283, pipe: [1:7556255642898559488:10063]
2025-10-01T14:11:04.346088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:04.353032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.353058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.353206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.353260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.353318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.353381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.353575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.353583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.353645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.353699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.353753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.353812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.353852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.353859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.353914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.353966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.354022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.354074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.354112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.354117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.354176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.354457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.354511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.354564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.354601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.354608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.354662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.354724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.354793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.354854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.354893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.354897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.354953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.355004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.355063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.355125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.355166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.355171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.355231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.355285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.355349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.355408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.355455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.355460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.355514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.355568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.355620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.355690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.355733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.355738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.355796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.355851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.355911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.355974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.356013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.356018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.356076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.356130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.356213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.356273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.356311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.356316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.356362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559488:10063], now have 1 active actors on pipe
2025-10-01T14:11:04.356633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255642898559488:10063]
2025-10-01T14:11:04.356670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:04.356673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:04.356707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1284 reason: error at write: Disconnected sessionId: src_id|e636537c-455557c1-11817f66-7ccc33de_0
2025-10-01T14:11:04.356850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:04.356905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1284 sessionId: src_id|e636537c-455557c1-11817f66-7ccc33de_0 is DEAD
2025-10-01T14:11:04.357030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e636537c-455557c1-11817f66-7ccc33de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:04.357042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e636537c-455557c1-11817f66-7ccc33de_0] Write session will restart in 0.007926s
2025-10-01T14:11:04.357065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e636537c-455557c1-11817f66-7ccc33de_0] Write session: Do CDS request
2025-10-01T14:11:04.357071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e636537c-455557c1-11817f66-7ccc33de_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:04.357101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:04.365911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e636537c-455557c1-11817f66-7ccc33de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.365964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:04.365978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1285
2025-10-01T14:11:04.366105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.366149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:04.366158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:04.366164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:04.366599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1285 sessionId:  describe result for acl check
2025-10-01T14:11:04.366632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:04.366640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:04.366642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:04.366647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255642898559572:4891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:04.367151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255642898559572:4891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:04.367392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:04.369012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:04.369190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:04.369213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:04.369228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:04.369272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:04.369308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255640521680180:9092]
2025-10-01T14:11:04.369556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255642898559572:4891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:04.369876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:04.370129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:04.370165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:04.370463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:04.370542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.370549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.370550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.370551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.370552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.370553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.370555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.370556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.370557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.370559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.370560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.370561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.370562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.370563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.370568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.370576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.370580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.370584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.370588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.370591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.370595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.370599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.370602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.370606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.370610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.370614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.370618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.370622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.370628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.370635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.370644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.370650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.370658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.370662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.370666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.370675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.370679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.370688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.370692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.370702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.370706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.370714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.370719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.370727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.370731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.370736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.370740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.370744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.370749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.370754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.370758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.370762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.370766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.370772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.370775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.370786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.370823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:04.374407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255642898559572:4891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:04.374425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255642898559572:4891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:04.374428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255642898559572:4891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:04.374438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:04.374622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:04.375345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:04.375365Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:04.375369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:04.375372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:04.375378Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1284 [2:7556255640521680180:9092]
2025-10-01T14:11:04.375393Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:04.375409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:04.375417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.375420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.375430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.375451Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:04.375460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:04.375467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:04.375524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.375531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.375532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.375536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:04.375538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:04.375600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:04.375611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.375623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.375634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.375650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:04.375675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559496:2446], now have 1 active actors on pipe
2025-10-01T14:11:04.375683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559613:4891], now have 1 active actors on pipe
2025-10-01T14:11:04.375690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255640521680174:9092]
2025-10-01T14:11:04.375692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255640521680174:9092]
2025-10-01T14:11:04.375694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255640521680174:9092]
2025-10-01T14:11:04.375707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:04.375721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:04.375725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:04.375730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:04.375732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:04.375740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:04.375742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:04.375743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1284
2025-10-01T14:11:04.375758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1284
2025-10-01T14:11:04.375776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255640521680174:9092]
2025-10-01T14:11:04.375784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:04.375786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:04.375800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.375809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.375858Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c5fde17-41917968-ab586023-dd3a19e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:04.375869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.375873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.375875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:04.375883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.375891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:04.375912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.376055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.376066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.376082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.376168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1285 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c5fde17-41917968-ab586023-dd3a19e2_0
2025-10-01T14:11:04.376553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e636537c-455557c1-11817f66-7ccc33de_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c5fde17-41917968-ab586023-dd3a19e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:04.379091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5fde17-41917968-ab586023-dd3a19e2_0] Write session: try to update token
2025-10-01T14:11:04.379108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5fde17-41917968-ab586023-dd3a19e2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:04.392964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1285 sessionId: src_id|1c5fde17-41917968-ab586023-dd3a19e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:04.396134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:04.396637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.396658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.396680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:04.396683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:04.396684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:04.396686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:04.396703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255640521680174:9092]
2025-10-01T14:11:04.396707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255640521680174:9092]
2025-10-01T14:11:04.396710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255640521680174:9092]
2025-10-01T14:11:04.396742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:04.396758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:04.396761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:04.396765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:04.396772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.396774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:04.396907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:04.456756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255642898559623:10063]
2025-10-01T14:11:04.457027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1284, pipe: [1:7556255642898559623:10063]
2025-10-01T14:11:04.541356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:04.541612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:04.541671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559623:10063], now have 1 active actors on pipe
2025-10-01T14:11:04.541755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:04.541798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:04.541844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255642898559623:10063]
2025-10-01T14:11:04.541850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:04.541852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:04.541925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1285 reason: error at write: Disconnected sessionId: src_id|1c5fde17-41917968-ab586023-dd3a19e2_0
2025-10-01T14:11:04.542086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1285 sessionId: src_id|1c5fde17-41917968-ab586023-dd3a19e2_0 is DEAD
2025-10-01T14:11:04.542227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5fde17-41917968-ab586023-dd3a19e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:04.542238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5fde17-41917968-ab586023-dd3a19e2_0] Write session will restart in 0.006001s
2025-10-01T14:11:04.542263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5fde17-41917968-ab586023-dd3a19e2_0] Write session: Do CDS request
2025-10-01T14:11:04.542283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5fde17-41917968-ab586023-dd3a19e2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:04.550005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5fde17-41917968-ab586023-dd3a19e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.550080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:04.550106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1286
2025-10-01T14:11:04.550250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.550292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:04.550298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:04.550302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:04.551061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1286 sessionId:  describe result for acl check
2025-10-01T14:11:04.551095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:04.551097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:04.551098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:04.551104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255642898559703:4883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:04.551403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:04.551566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255642898559703:4883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:04.553411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255642898559703:4883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:04.553507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:04.555692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255642898559703:4883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:04.555705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255642898559703:4883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:04.555708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255642898559703:4883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:04.555717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:04.553727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:04.553738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:04.553749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:04.553805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:04.553839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255640521680327:9105]
2025-10-01T14:11:04.554361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:04.554694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:04.554736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:04.555095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:04.555137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.555139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.555140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.555141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.555142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.555144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.555145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.555146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.555147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.555148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.555149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.555150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.555152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.555153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.555158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.555167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.555170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.555175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.555178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.555182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.555185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.555188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.555192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.555196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.555200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.555203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.555207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.555210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.555217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.555223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.555229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.555234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.555238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.555243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.555247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.555252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.555256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.555261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.555266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.555271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.555276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.555281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.555285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.555290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.555295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.555300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.555304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.555309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.555313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.555318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.555322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.555327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.555331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.555335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.555339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.555344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.555382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:04.559406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:04.560348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:04.560363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:04.560365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:04.560368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:04.560374Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1285 [2:7556255640521680327:9105]
2025-10-01T14:11:04.560390Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:04.560407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:04.560409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.560413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.560415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.560430Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:04.560442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:04.560447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:04.560502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.560509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.560511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.560514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:04.560516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:04.560584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:04.560590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.560602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.560611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.560624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:04.560642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559626:2446], now have 1 active actors on pipe
2025-10-01T14:11:04.560645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559742:4883], now have 1 active actors on pipe
2025-10-01T14:11:04.560652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255640521680321:9105]
2025-10-01T14:11:04.560654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255640521680321:9105]
2025-10-01T14:11:04.560656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255640521680321:9105]
2025-10-01T14:11:04.560671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:04.560786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1285
2025-10-01T14:11:04.560786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1285
2025-10-01T14:11:04.560684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:04.560686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:04.560690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:04.560692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:04.560718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:04.560720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:04.560756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255640521680321:9105]
2025-10-01T14:11:04.560763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:04.560836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:04.561024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.561038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.561065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:04.561072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.561077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.561079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:04.561088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.561109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:04.561128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.561284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.561290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.561302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.561413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1286 partition: 0 MaxSeqNo: 45 sessionId: src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0
2025-10-01T14:11:04.561802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c5fde17-41917968-ab586023-dd3a19e2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:04.564384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0] Write session: try to update token
2025-10-01T14:11:04.564400Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:04.579709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1286 sessionId: src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:04.582478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:04.582919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.582941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.582978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:04.583339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:04.586434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:04.586454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:04.586457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:04.586459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:04.586468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255640521680321:9105]
2025-10-01T14:11:04.586473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255640521680321:9105]
2025-10-01T14:11:04.586476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255640521680321:9105]
2025-10-01T14:11:04.586520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:04.586527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.586529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:04.586665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:04.590531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:04.590551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:04.590555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:04.644493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255642898559750:10063]
2025-10-01T14:11:04.644799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1285, pipe: [1:7556255642898559750:10063]
2025-10-01T14:11:04.756675Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:04.765968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.766005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.766195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.766273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.766334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.766424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.766478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.766483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.766582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.766647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.766722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.766796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.766851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.766861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.766929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.766991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.767050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.767114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.767159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.767167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.767233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.767299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.767358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.767438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.767481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.767489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.767554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.767616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.767679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.767743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.767792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.767800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.767862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.767919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.767988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.768055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.768106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.768116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.768188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.768249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.768314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.768378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.768444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.768452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.768518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.768586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.768645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.768722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.768768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.768772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.768847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.768910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.768973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.769030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.769081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.769097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.769167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:04.769232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:04.769302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:04.769360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:04.769399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:04.769683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:04.769760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559750:10063], now have 1 active actors on pipe
2025-10-01T14:11:04.770712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:04.770776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:04.770784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:04.770811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1286 reason: error at write: Disconnected sessionId: src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0
2025-10-01T14:11:04.771394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:04.771404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0] Write session will restart in 0.006404s
2025-10-01T14:11:04.771430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0] Write session: Do CDS request
2025-10-01T14:11:04.771435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:04.771058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:04.771032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1286 sessionId: src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0 is DEAD
2025-10-01T14:11:04.771178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255642898559750:10063]
2025-10-01T14:11:04.778863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.779257Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:04.779277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1287
2025-10-01T14:11:04.779716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.779767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:04.779779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:04.779784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:04.780597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1287 sessionId:  describe result for acl check
2025-10-01T14:11:04.780635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:04.780642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:04.780648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:04.780654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255642898559767:4877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:04.781270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255642898559767:4877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:04.788028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255642898559767:4877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:04.792148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:04.792182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255642898559767:4877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:04.792199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255642898559767:4877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:04.792202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255642898559767:4877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:04.792210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:04.794655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:04.794888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:04.794902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:04.794912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:04.794968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:04.795022Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255640521680458:9108]
2025-10-01T14:11:04.796031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:04.796792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:04.796846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:04.797193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:04.797249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.797250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.797251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.797252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.797253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.797255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.797256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.797258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.797260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.797260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.797262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.797263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.797264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.797265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.797272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.797281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.797284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.797289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.797293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.797296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.797300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.797304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.797308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.797312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.797316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.797319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.797323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.797326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.797334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.797343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.797349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.797354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.797358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.797363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.797367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.797372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.797377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.797383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.797387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.797391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.797397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.797403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.797410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.797416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.797422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.797427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.797431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.797436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.797440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.797446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.797450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.797455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.797460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.797465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.797470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.797475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.797515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:04.803443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:04.804197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:04.804203Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:04.804207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:04.804212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:04.804221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1286 [2:7556255640521680458:9108]
2025-10-01T14:11:04.804241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:04.804261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:04.804264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.804268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.804271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.804287Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:04.804297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:04.804304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:04.804377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.804379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.804381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.804384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:04.804387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:04.804465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:04.804467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.804478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.804488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.804502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:04.804520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255640521680451:9108]
2025-10-01T14:11:04.804523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255640521680451:9108]
2025-10-01T14:11:04.804526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255640521680451:9108]
2025-10-01T14:11:04.804541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:04.804554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:04.804568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:04.804572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:04.804608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255640521680451:9108]
2025-10-01T14:11:04.804611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:04.805325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1286
2025-10-01T14:11:04.805372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1286
2025-10-01T14:11:04.804866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:04.804876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:04.804878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:04.804883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:04.805882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559867:4877], now have 1 active actors on pipe
2025-10-01T14:11:04.805893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559755:2446], now have 1 active actors on pipe
2025-10-01T14:11:04.805907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.805913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.805944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:04.805954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.805959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.805961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:04.805973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.805985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:04.806001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.806319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.806327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.806342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.807431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d73e377-ec12eb12-7da0b837-d5d1efc9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:04.806771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1287 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0
2025-10-01T14:11:04.810684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0] Write session: try to update token
2025-10-01T14:11:04.810699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:04.826444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1287 sessionId: src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:04.827284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:04.827313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:04.827316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:04.827319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:04.827328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255640521680451:9108]
2025-10-01T14:11:04.827333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255640521680451:9108]
2025-10-01T14:11:04.827338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255640521680451:9108]
2025-10-01T14:11:04.827392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:04.827396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:04.827404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:04.827404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.827407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:04.827409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:04.827577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:04.829280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:04.871551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255642898559881:10063]
2025-10-01T14:11:04.871846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1286, pipe: [1:7556255642898559881:10063]
2025-10-01T14:11:04.974186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:04.974662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.974682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.974720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559881:10063], now have 1 active actors on pipe
2025-10-01T14:11:04.974961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:04.974986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:04.974989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:04.975012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255642898559881:10063]
2025-10-01T14:11:04.974978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:04.975050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1287 reason: error at write: Disconnected sessionId: src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0
2025-10-01T14:11:04.975220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1287 sessionId: src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0 is DEAD
2025-10-01T14:11:04.975365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:04.975379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0] Write session will restart in 0.009297s
2025-10-01T14:11:04.975418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0] Write session: Do CDS request
2025-10-01T14:11:04.975424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:04.984811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:04.985964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.986010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:04.986026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1288
2025-10-01T14:11:04.986205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:04.986231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:04.986238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:04.986241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:04.986701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1288 sessionId:  describe result for acl check
2025-10-01T14:11:04.986741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:04.986748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:04.986750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:04.986755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255642898559978:4871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:04.987214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:04.987257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255642898559978:4871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:04.987424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:04.987436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:04.987447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:04.987497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:04.987542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255640521680577:9111]
2025-10-01T14:11:04.988204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:04.988493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:04.988538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:04.988768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255642898559978:4871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:04.988796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:04.988839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.988845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.988845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.988847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.988848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.988848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.988849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.988850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.988851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.988852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.988853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.988854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.988855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.988856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.988860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.988866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.988869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.988871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.988874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.988876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.988879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.988881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.988883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.988886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.988888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.988891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.988894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.988896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.988901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.988906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:04.988910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.988914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:04.988916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.988920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:04.988923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.988926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:04.988929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.988946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:04.988955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.988966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:04.988975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.988984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:04.988988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.988998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:04.989002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.989007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:04.989016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.989025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.989034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.989042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.989052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.989058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.989064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.989072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:04.989081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.989090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:04.989132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:04.992603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255642898559978:4871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:04.992618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255642898559978:4871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:04.992621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255642898559978:4871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:04.992630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:04.992998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:04.993696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:04.993713Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:04.993716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:04.993719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:04.993726Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1287 [2:7556255640521680577:9111]
2025-10-01T14:11:04.993750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:04.993770Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:04.993777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.993781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.993783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.993798Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:04.993808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:04.993814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:04.993877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.993884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.993886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.993889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:04.993891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:04.993959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:04.993969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:04.993980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:04.993991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:04.994007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:04.994033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898559897:2446], now have 1 active actors on pipe
2025-10-01T14:11:04.994043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255642898560013:4871], now have 1 active actors on pipe
2025-10-01T14:11:04.994049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255640521680571:9111]
2025-10-01T14:11:04.994052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255640521680571:9111]
2025-10-01T14:11:04.994054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255640521680571:9111]
2025-10-01T14:11:04.994061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1287
2025-10-01T14:11:04.994075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1287
2025-10-01T14:11:04.994069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:04.994088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:04.994089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:04.994091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:04.994093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:04.994104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:04.994107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:04.994146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.994156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.994168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255640521680571:9111]
2025-10-01T14:11:04.994180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:04.994191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:04.994212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:04.994224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:04.994232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:04.994238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:04.994247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:04.994256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:04.994278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.994496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:04.994508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:04.994523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:04.994606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1288 partition: 0 MaxSeqNo: 45 sessionId: src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0
2025-10-01T14:11:04.995012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc9b87f9-84434e69-8f6c058d-96de31bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:04.997568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0] Write session: try to update token
2025-10-01T14:11:04.997588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:05.011489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1288 sessionId: src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:05.013613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:05.015673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.015708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.015729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:05.015732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:05.015736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:05.015738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:05.015747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255640521680571:9111]
2025-10-01T14:11:05.015752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255640521680571:9111]
2025-10-01T14:11:05.015757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255640521680571:9111]
2025-10-01T14:11:05.015809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:05.015820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:05.015827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:05.015827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.015829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:05.015832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:05.016065Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:05.075260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255647193527318:10063]
2025-10-01T14:11:05.075904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1287, pipe: [1:7556255647193527318:10063]
2025-10-01T14:11:05.157245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:05.157480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:05.157538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527318:10063], now have 1 active actors on pipe
2025-10-01T14:11:05.157621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:05.157703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255647193527318:10063]
2025-10-01T14:11:05.157710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:05.157713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:05.157735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:05.157783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1288 reason: error at write: Disconnected sessionId: src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0
2025-10-01T14:11:05.157940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1288 sessionId: src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0 is DEAD
2025-10-01T14:11:05.158091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:05.158101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0] Write session will restart in 0.008889s
2025-10-01T14:11:05.158127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0] Write session: Do CDS request
2025-10-01T14:11:05.158136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:05.167925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.168020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:05.168045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1289
2025-10-01T14:11:05.168167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.168207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:05.168213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:05.168217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:05.168631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1289 sessionId:  describe result for acl check
2025-10-01T14:11:05.168659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:05.168661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:05.168663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:05.168668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255647193527358:4854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:05.169370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255647193527358:4854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:05.171170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255647193527358:4854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:05.173826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255647193527358:4854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:05.173842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255647193527358:4854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:05.173846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255647193527358:4854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:05.173852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:05.175176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:05.177338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:05.177508Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:05.177518Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:05.177529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:05.177575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:05.177611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255644816648002:9115]
2025-10-01T14:11:05.178027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:05.178362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:05.178416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:05.178635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:05.178683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.178688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.178690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.178691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.178692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.178694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.178695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.178696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.178697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.178698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.178700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.178701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.178702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.178703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.178708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.178716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.178721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.178725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.178729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.178732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.178736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.178740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.178744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.178749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.178753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.178757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.178760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.178764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.178771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.178779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.178789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.178794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.178803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.178808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.178814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.178823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.178828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.178837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.178841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.178850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.178855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.178861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.178869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.178874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.178880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.178888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.178893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.178902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.178906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.178911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.178918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.178924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.178931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.178936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.178942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.178947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.178985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:05.182508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:05.183093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:05.183113Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:05.183115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:05.183117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:05.183122Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1288 [2:7556255644816648002:9115]
2025-10-01T14:11:05.183133Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:05.183149Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:05.183154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:05.183157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:05.183158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:05.183169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:05.183175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:05.183180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:05.183221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.183225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.183226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.183229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:05.183231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:05.183292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:05.183297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.183304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.183311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.183323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:05.183338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527455:4854], now have 1 active actors on pipe
2025-10-01T14:11:05.183344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527348:2446], now have 1 active actors on pipe
2025-10-01T14:11:05.183349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255644816647997:9115]
2025-10-01T14:11:05.183353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255644816647997:9115]
2025-10-01T14:11:05.183355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255644816647997:9115]
2025-10-01T14:11:05.183370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:05.183382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:05.183393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:05.183398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:05.183414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255644816647997:9115]
2025-10-01T14:11:05.183420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:05.183426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:05.183442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:05.183445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:05.183452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:05.183419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1288
2025-10-01T14:11:05.183420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1288
2025-10-01T14:11:05.183487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.183494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.183517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:05.183525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:05.183528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:05.183530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:05.183535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:05.183544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:05.183557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:05.183682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.183688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.183699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:05.183774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1289 partition: 0 MaxSeqNo: 45 sessionId: src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0
2025-10-01T14:11:05.184108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7a406ca-a038da9-b2b672f5-5e90cc0b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:05.186539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0] Write session: try to update token
2025-10-01T14:11:05.186554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:05.199401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:05.199436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:05.199446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255644816647997:9115]
2025-10-01T14:11:05.199493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:05.199506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:05.199690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:05.199853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:05.200010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:05.200172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:05.200396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:05.200442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:05.203389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1289 sessionId: src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:05.206123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:05.206320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.206352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.206404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:05.206487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:05.213228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:05.213254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:05.213256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:05.213259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:05.213269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255644816647997:9115]
2025-10-01T14:11:05.213274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255644816647997:9115]
2025-10-01T14:11:05.213284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255644816647997:9115]
2025-10-01T14:11:05.213336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:05.213348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.213350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:05.213353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:05.213375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:05.213385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:05.213583Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:05.258040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255647193527474:10063]
2025-10-01T14:11:05.258388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1288, pipe: [1:7556255647193527474:10063]
2025-10-01T14:11:05.351030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:05.358271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.358296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.358457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.358518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.358584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.358639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.358682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.358689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.358749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.358804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.358859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.358918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.358971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.358977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.359037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.359097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.359161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.359222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.359265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.359274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.359333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.359389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.359451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.359514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.359598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.359603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.359667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.359727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.359781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.359837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.359929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.359936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.360004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.360061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.360117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.360179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.360260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.360266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.360325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.360377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.360438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.360502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.360541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.360546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.360603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.360654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.360723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.360779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.360816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.360824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.360883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.360941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.361011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.361072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.361110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.361117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.361176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:05.361233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:05.361299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:05.361357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:05.361398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:05.361402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:05.361456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527474:10063], now have 1 active actors on pipe
2025-10-01T14:11:05.361680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:05.361686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:05.361692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:05.361722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1289 reason: error at write: Disconnected sessionId: src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0
2025-10-01T14:11:05.361741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255647193527474:10063]
2025-10-01T14:11:05.361918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1289 sessionId: src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0 is DEAD
2025-10-01T14:11:05.362113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:05.362124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0] Write session will restart in 0.006885s
2025-10-01T14:11:05.362145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0] Write session: Do CDS request
2025-10-01T14:11:05.362150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:05.362213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:05.369855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.369946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:05.369961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1290
2025-10-01T14:11:05.370119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.370151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:05.370174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:05.370179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:05.371106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1290 sessionId:  describe result for acl check
2025-10-01T14:11:05.371145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:05.371151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:05.371156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:05.371161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255647193527536:4851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:05.371684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255647193527536:4851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:05.374434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255647193527536:4851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:05.374720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:05.375576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:05.375808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:05.375820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:05.375832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:05.375886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:05.375928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255644816648121:9117]
2025-10-01T14:11:05.376486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:05.377302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:05.377363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:05.377683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:05.377746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.377747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.377748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.377749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.377750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.377751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.377752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.377754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.377755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.377756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.377757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.377758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.377759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.377760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.377766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.377775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.377779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.377782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.377786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.377790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.377793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.377797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.377800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.377804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.377807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.377811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.377814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.377817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.377841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.377848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.377854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.377858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.377862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.377866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.377870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.377874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.377878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.377882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.377886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.377890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.377895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.377899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.377902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.377907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.377910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.377915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.377919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.377923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.377927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.377932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.377936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.377940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.377944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.377948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.377952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.377956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.377989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:05.380046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255647193527536:4851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:05.380065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255647193527536:4851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:05.380068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255647193527536:4851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:05.380076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:05.381870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:05.382463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:05.382478Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:05.382481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:05.382485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:05.382492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1289 [2:7556255644816648121:9117]
2025-10-01T14:11:05.382510Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:05.382526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:05.382533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:05.382537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:05.382539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:05.382555Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:05.382567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:05.382573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:05.382628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.382634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.382637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.382640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:05.382643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:05.382713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:05.382720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.382731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.382742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.382761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:05.382783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527605:4851], now have 1 active actors on pipe
2025-10-01T14:11:05.382791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527484:2446], now have 1 active actors on pipe
2025-10-01T14:11:05.382798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255644816648116:9117]
2025-10-01T14:11:05.382804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255644816648116:9117]
2025-10-01T14:11:05.382806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255644816648116:9117]
2025-10-01T14:11:05.382821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:05.382836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:05.382853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:05.382860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:05.382895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255644816648116:9117]
2025-10-01T14:11:05.382901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:05.382870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1289
2025-10-01T14:11:05.382906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1289
2025-10-01T14:11:05.382912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:05.382924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:05.382926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:05.382933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:05.382934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.382939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.382962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:05.382969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:05.382972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:05.382975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:05.382982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:05.382989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:05.383006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:05.383148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.383165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.383188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:05.383289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1290 partition: 0 MaxSeqNo: 45 sessionId: src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0
2025-10-01T14:11:05.383677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd61485-7cc09acb-7f4b157e-f3ec49f2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:05.386310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0] Write session: try to update token
2025-10-01T14:11:05.386329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:05.403567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:05.403593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:05.403595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:05.403597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:05.403606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255644816648116:9117]
2025-10-01T14:11:05.403614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255644816648116:9117]
2025-10-01T14:11:05.403618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255644816648116:9117]
2025-10-01T14:11:05.403669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:05.403670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:05.403676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:05.403681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:05.403683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.403686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:05.403859Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:05.405144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1290 sessionId: src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:05.408058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:05.461835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255647193527615:10063]
2025-10-01T14:11:05.462146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1289, pipe: [1:7556255647193527615:10063]
2025-10-01T14:11:05.552150Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:05.552456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.552469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.552505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527615:10063], now have 1 active actors on pipe
2025-10-01T14:11:05.552689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:05.552765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255647193527615:10063]
2025-10-01T14:11:05.552802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:05.552853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:05.552886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1290 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0
2025-10-01T14:11:05.553075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1290 sessionId: src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0 is DEAD
2025-10-01T14:11:05.553441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:05.553462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0] Write session will restart in 0.006079s
2025-10-01T14:11:05.553493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0] Write session: Do CDS request
2025-10-01T14:11:05.553499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:05.561027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.561369Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:05.561382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1291
2025-10-01T14:11:05.561528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.561559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:05.561577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:05.561580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:05.562140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1291 sessionId:  describe result for acl check
2025-10-01T14:11:05.562170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:05.562172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:05.562173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:05.562178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255647193527698:4845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:05.562729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255647193527698:4845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:05.566343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:05.568055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255647193527698:4845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:05.569618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:05.569902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:05.569906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:05.569918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:05.569974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:05.570010Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255644816648273:9130]
2025-10-01T14:11:05.570627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:05.571034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:05.571085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:05.571426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:05.571484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.571485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.571486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.571487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.571489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.571490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.571491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.571492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.571493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.571495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.571496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.571497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.571498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.571499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.571505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.571515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.571519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.571523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.571526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.571531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.571535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.571538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.571541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.571546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.571549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.571553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.571556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.571560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.571568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.571576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.571583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.571587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.571592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.571597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.571601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.571606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.571611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.571616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.571620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.571625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.571632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.571638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.571642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.571647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.571651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.571656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.571659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.571664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.571671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.571675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.571679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.571684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.571688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.571692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.571696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.571701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.571752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:05.575232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255647193527698:4845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:05.575250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255647193527698:4845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:05.575253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255647193527698:4845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:05.575263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:05.579855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:05.580494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:05.580508Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:05.580511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:05.580515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:05.580523Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1290 [2:7556255644816648273:9130]
2025-10-01T14:11:05.580540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:05.580558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:05.580561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:05.580565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:05.580567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:05.580584Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:05.580598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:05.580604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:05.580684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.580704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.580707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.580710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:05.580714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:05.580786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:05.580798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.580810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.580826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.580899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1290
2025-10-01T14:11:05.580930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1290
2025-10-01T14:11:05.580842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:05.580866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527739:4845], now have 1 active actors on pipe
2025-10-01T14:11:05.580869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527618:2446], now have 1 active actors on pipe
2025-10-01T14:11:05.580877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255644816648268:9130]
2025-10-01T14:11:05.580879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255644816648268:9130]
2025-10-01T14:11:05.580883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255644816648268:9130]
2025-10-01T14:11:05.580894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:05.580908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:05.580911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:05.580911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:05.580913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:05.580925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:05.580928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:05.580982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.580988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.581002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255644816648268:9130]
2025-10-01T14:11:05.581010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:05.581024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:05.581044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:05.581056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:05.581061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:05.581063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:05.581073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:05.581085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:05.581118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:05.581306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.581322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.581344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:05.581477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1291 partition: 0 MaxSeqNo: 45 sessionId: src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0
2025-10-01T14:11:05.581876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0e197df-db4743d2-1d972e2f-11c5d4b9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:05.584449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0] Write session: try to update token
2025-10-01T14:11:05.584468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:05.603838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:05.603858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:05.603860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:05.603862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:05.603872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255644816648268:9130]
2025-10-01T14:11:05.603877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255644816648268:9130]
2025-10-01T14:11:05.603881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255644816648268:9130]
2025-10-01T14:11:05.603935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:05.603947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.603950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:05.604097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:05.606437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:05.606456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:05.606461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:05.607681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1291 sessionId: src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:05.610122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:05.652821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255647193527747:10063]
2025-10-01T14:11:05.656404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1290, pipe: [1:7556255647193527747:10063]
2025-10-01T14:11:05.750465Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:05.750950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.750966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.751002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527747:10063], now have 1 active actors on pipe
2025-10-01T14:11:05.751200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:05.751226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:05.751282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255647193527747:10063]
2025-10-01T14:11:05.751315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:05.751326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:05.751379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1291 reason: error at write: Disconnected sessionId: src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0
2025-10-01T14:11:05.751582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1291 sessionId: src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0 is DEAD
2025-10-01T14:11:05.751710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:05.751720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0] Write session will restart in 0.007355s
2025-10-01T14:11:05.751748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0] Write session: Do CDS request
2025-10-01T14:11:05.751754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:05.759919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.759943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:05.759955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1292
2025-10-01T14:11:05.760154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.760200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:05.760211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:05.760215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:05.760563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:05.760625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1292 sessionId:  describe result for acl check
2025-10-01T14:11:05.760663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:05.760665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:05.760681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:05.760692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255647193527835:4828] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:05.761214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255647193527835:4828] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:05.762728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:05.762924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:05.762934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:05.762945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:05.762989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:05.763030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255644816648394:9132]
2025-10-01T14:11:05.763138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255647193527835:4828] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:05.763640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:05.763834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:05.763874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:05.764159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:05.764214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.764221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.764222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.764223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.764224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.764226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.764227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.764228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.764229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.764230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.764232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.764233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.764235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.764236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.764241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.764252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.764255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.764259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.764262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.764266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.764269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.764273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.764276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.764280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.764284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.764288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.764292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.764296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.764302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.764309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:05.764318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.764322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:05.764327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.764332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:05.764337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.764347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:05.764352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.764362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:05.764367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.764374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:05.764384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.764390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:05.764395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.764404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:05.764410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.764416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:05.764425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.764431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.764437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.764442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.764448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.764453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.764457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.764464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:05.764468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.764472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:05.764513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:05.767963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255647193527835:4828] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:05.767979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255647193527835:4828] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:05.767983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255647193527835:4828] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:05.767991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:05.768125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:05.768789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:05.768806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:05.768808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:05.768812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:05.768819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1291 [2:7556255644816648394:9132]
2025-10-01T14:11:05.768835Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:05.768851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:05.768856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:05.768859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:05.768862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:05.768876Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:05.768887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:05.768892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:05.768947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.768954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.768956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.768959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:05.768961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:05.769037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:05.769043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.769053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:05.769066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:05.769083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:05.769105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527752:2446], now have 1 active actors on pipe
2025-10-01T14:11:05.769111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527875:4828], now have 1 active actors on pipe
2025-10-01T14:11:05.769118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255644816648389:9132]
2025-10-01T14:11:05.769125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255644816648389:9132]
2025-10-01T14:11:05.769128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255644816648389:9132]
2025-10-01T14:11:05.769136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:05.769123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1291
2025-10-01T14:11:05.769152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:05.769123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1291
2025-10-01T14:11:05.769157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:05.769161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:05.769163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:05.769171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:05.769174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:05.769216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.769225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.769240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255644816648389:9132]
2025-10-01T14:11:05.769255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:05.769265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:05.769289Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11854c09-47f372be-43dca023-5d5c24f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:05.769300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:05.769304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:05.769308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:05.769315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:05.769328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:05.769352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:05.769510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.769517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.769531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:05.769650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1292 partition: 0 MaxSeqNo: 45 sessionId: src_id|11854c09-47f372be-43dca023-5d5c24f3_0
2025-10-01T14:11:05.769988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6caef5d7-3721f35d-faacb1ce-7ac5f39d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|11854c09-47f372be-43dca023-5d5c24f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:05.772875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11854c09-47f372be-43dca023-5d5c24f3_0] Write session: try to update token
2025-10-01T14:11:05.772897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11854c09-47f372be-43dca023-5d5c24f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:05.799668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1292 sessionId: src_id|11854c09-47f372be-43dca023-5d5c24f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:05.800480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:05.800506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:05.800512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:05.800514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:05.800525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255644816648389:9132]
2025-10-01T14:11:05.800530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255644816648389:9132]
2025-10-01T14:11:05.800535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255644816648389:9132]
2025-10-01T14:11:05.800590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:05.800597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:05.800599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:05.800785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:05.803498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:05.803514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:05.803518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:05.802740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:05.851476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255647193527885:10063]
2025-10-01T14:11:05.854723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1291, pipe: [1:7556255647193527885:10063]
2025-10-01T14:11:05.967837Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:05.968329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:05.968341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:05.968391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527885:10063], now have 1 active actors on pipe
2025-10-01T14:11:05.969196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255647193527885:10063]
2025-10-01T14:11:05.969226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:05.969258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:05.969261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:05.969319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1292 reason: error at write: Disconnected sessionId: src_id|11854c09-47f372be-43dca023-5d5c24f3_0
2025-10-01T14:11:05.969544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1292 sessionId: src_id|11854c09-47f372be-43dca023-5d5c24f3_0 is DEAD
2025-10-01T14:11:05.969395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:05.971682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11854c09-47f372be-43dca023-5d5c24f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:05.971696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11854c09-47f372be-43dca023-5d5c24f3_0] Write session will restart in 0.006551s
2025-10-01T14:11:05.971735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11854c09-47f372be-43dca023-5d5c24f3_0] Write session: Do CDS request
2025-10-01T14:11:05.971743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11854c09-47f372be-43dca023-5d5c24f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:05.984135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11854c09-47f372be-43dca023-5d5c24f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.984472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:05.984485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1293
2025-10-01T14:11:05.984662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:05.984691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:05.984714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:05.984717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:05.985139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1293 sessionId:  describe result for acl check
2025-10-01T14:11:05.985165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:05.985166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:05.985168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:05.985173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255647193527915:4823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:05.985661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255647193527915:4823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:05.989740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255647193527915:4823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:05.999240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255647193527915:4823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:05.999259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255647193527915:4823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:05.999265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255647193527915:4823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:05.999274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:06.019774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:06.035071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:06.035367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:06.035372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:06.035385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:06.035444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:06.035507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255649111615831:9136]
2025-10-01T14:11:06.036115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:06.036657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:06.036739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:06.037053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:06.037114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.037115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.037116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.037117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.037119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.037120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.037122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.037123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.037124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.037125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.037126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.037128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.037129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.037130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.037136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.037146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.037149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.037153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.037156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.037160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.037164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.037167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.037170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.037174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.037177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.037180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.037183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.037186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.037194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.037201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.037206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.037210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.037214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.037219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.037223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.037228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.037232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.037236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.037241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.037245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.037249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.037254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.037258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.037263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.037267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.037271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.037275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.037280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.037284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.037289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.037293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.037297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.037318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.037322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.037327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.037331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.037367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:06.053283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:06.054129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:06.054136Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:06.054140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:06.054144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:06.054152Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1292 [2:7556255649111615831:9136]
2025-10-01T14:11:06.054172Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:06.054195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:06.054200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:06.054204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:06.054207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:06.054228Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:06.054235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:06.054242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:06.054311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.054313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.054315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.054322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:06.054325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:06.054432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:06.054435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.054447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.054456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.054470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:06.054488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255649111615825:9136]
2025-10-01T14:11:06.054491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255649111615825:9136]
2025-10-01T14:11:06.054493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255649111615825:9136]
2025-10-01T14:11:06.054503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:06.054522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:06.054522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:06.054526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:06.054529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:06.054537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:06.054541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:06.054552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527958:4823], now have 1 active actors on pipe
2025-10-01T14:11:06.054556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255647193527903:2446], now have 1 active actors on pipe
2025-10-01T14:11:06.054600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255649111615825:9136]
2025-10-01T14:11:06.054607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:06.054963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:06.057748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1292
2025-10-01T14:11:06.057791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1292
2025-10-01T14:11:06.060263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:06.060285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:06.060324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68c0d266-b674cec1-34387bbe-6269680c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:06.060337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:06.060343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:06.060346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:06.060360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:06.060378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:06.060402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:06.060764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:06.060772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:06.060787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:06.060930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1293 partition: 0 MaxSeqNo: 45 sessionId: src_id|68c0d266-b674cec1-34387bbe-6269680c_0
2025-10-01T14:11:06.061422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11854c09-47f372be-43dca023-5d5c24f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|68c0d266-b674cec1-34387bbe-6269680c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:06.064369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c0d266-b674cec1-34387bbe-6269680c_0] Write session: try to update token
2025-10-01T14:11:06.064393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c0d266-b674cec1-34387bbe-6269680c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:06.069227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255651488495325:10063]
2025-10-01T14:11:06.069685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255651488495325:10063], now have 1 active actors on pipe
2025-10-01T14:11:06.069800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1292, pipe: [1:7556255651488495325:10063]
2025-10-01T14:11:06.110393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1293 sessionId: src_id|68c0d266-b674cec1-34387bbe-6269680c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:06.113409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:06.113844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:06.113866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:06.113905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:06.114439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:06.129233Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:06.129257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:06.129259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:06.129265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:06.129276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255649111615825:9136]
2025-10-01T14:11:06.129282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255649111615825:9136]
2025-10-01T14:11:06.129285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255649111615825:9136]
2025-10-01T14:11:06.129338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:06.129344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.129348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:06.129565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:06.129573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:06.129577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:06.129735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:06.476542Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:06.499603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:06.499637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:06.499851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.499928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.500007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.500086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.500137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.500142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.500237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.500309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.500386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.500468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.500513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.500516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.500596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.500665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.500757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.500829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.500874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.500879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.500951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.501021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.501094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.501161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.501336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.501339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.501416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.501490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.501602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.501710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.501756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.501758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.501831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.501895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.501967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.502040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.502093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.502096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.502172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.502244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.502315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.506454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.506534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.506539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.506623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.506695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.506769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.506842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.507026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.507030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.507112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.507185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.507261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.507336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.507387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.507390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.507494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:06.507556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:06.507629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:06.507710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:06.507754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:06.507757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:06.510278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:06.510293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:06.510321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1293 reason: error at write: Disconnected sessionId: src_id|68c0d266-b674cec1-34387bbe-6269680c_0
2025-10-01T14:11:06.510956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c0d266-b674cec1-34387bbe-6269680c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:06.510969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c0d266-b674cec1-34387bbe-6269680c_0] Write session will restart in 0.009147s
2025-10-01T14:11:06.510996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c0d266-b674cec1-34387bbe-6269680c_0] Write session: Do CDS request
2025-10-01T14:11:06.511002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c0d266-b674cec1-34387bbe-6269680c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:06.510561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1293 sessionId: src_id|68c0d266-b674cec1-34387bbe-6269680c_0 is DEAD
2025-10-01T14:11:06.510592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255651488495325:10063]
2025-10-01T14:11:06.510624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:06.511225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:06.521628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c0d266-b674cec1-34387bbe-6269680c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:06.522089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:06.522103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1294
2025-10-01T14:11:06.522289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:06.522321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:06.522328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:06.522332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:06.522778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1294 sessionId:  describe result for acl check
2025-10-01T14:11:06.522806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:06.522808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:06.522811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:06.522817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255651488495393:4808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:06.523386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255651488495393:4808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:06.533164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255651488495393:4808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:06.539404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255651488495393:4808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:06.539422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255651488495393:4808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:06.539426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255651488495393:4808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:06.539436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:06.544566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:06.545774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:06.546057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:06.546063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:06.546077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:06.546133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:06.546182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255649111615981:9147]
2025-10-01T14:11:06.546995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:06.547575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:06.547633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:06.547982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:06.548037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.548038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.548040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.548041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.548042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.548044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.548045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.548046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.548047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.548048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.548050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.548051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.548052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.548053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.548059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.548069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.548074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.548079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.548083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.548087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.548091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.548094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.548099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.548103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.548107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.548111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.548114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.548118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.548126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.548135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.548142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.548148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.548153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.548159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.548163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.548168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.548190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.548196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.548202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.548207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.548212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.548218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.548222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.548227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.548233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.548238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.548242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.548246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.548251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.548256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.548261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.548267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.548272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.548278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.548283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.548289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.548328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:06.559035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:06.559843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:06.559848Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:06.559851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:06.559856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:06.559865Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1293 [2:7556255649111615981:9147]
2025-10-01T14:11:06.559886Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:06.559908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:06.559912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:06.559916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:06.559919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:06.559936Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:06.559943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:06.559952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:06.560017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.560019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.560021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.560024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:06.560027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:06.560114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:06.560117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.560130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.560140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.560157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:06.560174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255649111615976:9147]
2025-10-01T14:11:06.560176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255649111615976:9147]
2025-10-01T14:11:06.560178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255649111615976:9147]
2025-10-01T14:11:06.560192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:06.560208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:06.560224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:06.560227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:06.560274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255649111615976:9147]
2025-10-01T14:11:06.560276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:06.561438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1293
2025-10-01T14:11:06.561475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1293
2025-10-01T14:11:06.560536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:06.560546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:06.560549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:06.560554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:06.566172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255651488495486:4808], now have 1 active actors on pipe
2025-10-01T14:11:06.566190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255651488495369:2446], now have 1 active actors on pipe
2025-10-01T14:11:06.566214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:06.566223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:06.566264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8b42ee9-a4f53394-40222069-36f1490d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:06.566278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:06.566284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:06.566287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:06.566300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:06.566318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:06.566342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:06.566777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:06.566792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:06.566814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:06.566977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1294 partition: 0 MaxSeqNo: 45 sessionId: src_id|b8b42ee9-a4f53394-40222069-36f1490d_0
2025-10-01T14:11:06.567559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c0d266-b674cec1-34387bbe-6269680c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b8b42ee9-a4f53394-40222069-36f1490d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:06.571082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b42ee9-a4f53394-40222069-36f1490d_0] Write session: try to update token
2025-10-01T14:11:06.571105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b42ee9-a4f53394-40222069-36f1490d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:06.611826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255651488495498:10063]
2025-10-01T14:11:06.612367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255651488495498:10063], now have 1 active actors on pipe
2025-10-01T14:11:06.612499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1293, pipe: [1:7556255651488495498:10063]
2025-10-01T14:11:06.631217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:06.631239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:06.631242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:06.631243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:06.631254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255649111615976:9147]
2025-10-01T14:11:06.631259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255649111615976:9147]
2025-10-01T14:11:06.631262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255649111615976:9147]
2025-10-01T14:11:06.631313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:06.631321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.631323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:06.631491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:06.632299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:06.632305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:06.632308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:06.642427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1294 sessionId: src_id|b8b42ee9-a4f53394-40222069-36f1490d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:06.645507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:06.837901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:06.839854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b42ee9-a4f53394-40222069-36f1490d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:06.839867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b42ee9-a4f53394-40222069-36f1490d_0] Write session will restart in 0.006346s
2025-10-01T14:11:06.839894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b42ee9-a4f53394-40222069-36f1490d_0] Write session: Do CDS request
2025-10-01T14:11:06.839901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b42ee9-a4f53394-40222069-36f1490d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:06.838507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:06.838532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:06.839086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:06.839189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255651488495498:10063]
2025-10-01T14:11:06.839214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:06.839245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:06.839247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:06.839295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1294 reason: error at write: Disconnected sessionId: src_id|b8b42ee9-a4f53394-40222069-36f1490d_0
2025-10-01T14:11:06.839491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1294 sessionId: src_id|b8b42ee9-a4f53394-40222069-36f1490d_0 is DEAD
2025-10-01T14:11:06.849009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b42ee9-a4f53394-40222069-36f1490d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:06.850671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:06.850689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1295
2025-10-01T14:11:06.850876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:06.850906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:06.850913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:06.850917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:06.851416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1295 sessionId:  describe result for acl check
2025-10-01T14:11:06.851449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:06.851451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:06.851454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:06.851459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255651488495514:4802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:06.851979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255651488495514:4802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:06.860481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255651488495514:4802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:06.867377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255651488495514:4802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:06.867396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255651488495514:4802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:06.867399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255651488495514:4802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:06.867408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:06.874788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:06.880567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:06.880876Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:06.880899Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:06.880916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:06.881002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:06.881065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255649111616137:9154]
2025-10-01T14:11:06.881681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:06.882249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:06.882308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:06.882631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:06.882691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.882697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.882699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.882700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.882701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.882703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.882704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.882705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.882706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.882708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.882709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.882710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.882711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.882713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.882718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.882728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.882732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.882736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.882740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.882743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.882747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.882751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.882754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.882758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.882762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.882765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.882769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.882772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.882779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.882786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:06.882795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.882800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:06.882805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.882810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:06.882816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.882821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:06.882826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.882831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:06.882835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.882839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:06.882849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.882854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:06.882863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.882868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:06.882872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.882879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:06.882887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.882892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.882897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.882902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.882910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.882915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.882924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.882929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:06.882935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.882940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:06.882979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:06.888024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:06.888855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:06.888874Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:06.888877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:06.888881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:06.888889Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1294 [2:7556255649111616137:9154]
2025-10-01T14:11:06.888907Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:06.888928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:06.888931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:06.888935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:06.888938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:06.888957Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:06.888964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:06.888972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:06.889050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.889053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.889055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.889058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:06.889061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:06.889145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:06.889147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.889160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:06.889170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:06.889184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:06.889204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255649111616131:9154]
2025-10-01T14:11:06.889207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255649111616131:9154]
2025-10-01T14:11:06.889209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255649111616131:9154]
2025-10-01T14:11:06.889228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:06.889245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:06.889259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:06.889262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:06.889299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255649111616131:9154]
2025-10-01T14:11:06.889301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:06.889392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:06.889394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:06.889399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:06.889406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:06.889927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1294
2025-10-01T14:11:06.889964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1294
2025-10-01T14:11:06.892018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255651488495591:4802], now have 1 active actors on pipe
2025-10-01T14:11:06.892032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255651488495506:2446], now have 1 active actors on pipe
2025-10-01T14:11:06.895216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1295 partition: 0 MaxSeqNo: 45 sessionId: src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0
2025-10-01T14:11:06.895704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8b42ee9-a4f53394-40222069-36f1490d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:06.894610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:06.894629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:06.894668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:06.894680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:06.894686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:06.894690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:06.894702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:06.894719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:06.894739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:06.895059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:06.895066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:06.895088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:06.898851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0] Write session: try to update token
2025-10-01T14:11:06.898869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:06.916435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1295 sessionId: src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:06.919163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:06.918593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:06.918609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:06.918612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:06.918614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:06.918625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255649111616131:9154]
2025-10-01T14:11:06.918630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255649111616131:9154]
2025-10-01T14:11:06.918635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255649111616131:9154]
2025-10-01T14:11:06.918685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:06.918691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:06.918694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:06.918845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:06.919506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:06.919512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:06.919515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:06.939908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255651488495651:10063]
2025-10-01T14:11:06.940317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1294, pipe: [1:7556255651488495651:10063]
2025-10-01T14:11:06.950052Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:11:07.080110Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:07.080463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.080476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.080511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255651488495651:10063], now have 1 active actors on pipe
2025-10-01T14:11:07.080671Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:07.080753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255651488495651:10063]
2025-10-01T14:11:07.080768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:07.080771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:07.080782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:07.080837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1295 reason: error at write: Disconnected sessionId: src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0
2025-10-01T14:11:07.080991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1295 sessionId: src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0 is DEAD
2025-10-01T14:11:07.081133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:07.081142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0] Write session will restart in 0.006352s
2025-10-01T14:11:07.081169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0] Write session: Do CDS request
2025-10-01T14:11:07.081175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:07.088895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.088977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:07.088991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1296
2025-10-01T14:11:07.089072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.089096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:07.089103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:07.089106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:07.089420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1296 sessionId:  describe result for acl check
2025-10-01T14:11:07.089448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:07.089459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:07.089460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:07.089464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255655783463039:4792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:07.089839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255655783463039:4792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:07.090064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:07.091744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255655783463039:4792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:07.091945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:07.092146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:07.092159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:07.092171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:07.092227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:07.092261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255653406583559:9157]
2025-10-01T14:11:07.092805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:07.093076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:07.093121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:07.093399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:07.093448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.093463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.093464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.093465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.093466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.093467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.093468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.093469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.093470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.093471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.093472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.093473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.093474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.093475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.093479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.093487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.093491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.093494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.093497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.093500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.093503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.093506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.093509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.093512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.093515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.093517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.093520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.093523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.093530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.093537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.093542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.093546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.093549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.093553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.093556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.093560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.093564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.093568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.093585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.093592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.093597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.093600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.093604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.093612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.093616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.093620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.093628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.093632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.093637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.093645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.093648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.093652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.093656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.093664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.093668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.093676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.093714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:07.094125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255655783463039:4792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:07.094137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255655783463039:4792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:07.094140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255655783463039:4792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:07.094146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:07.097279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:07.097834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:07.097845Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:07.097847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:07.097850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:07.097855Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1295 [2:7556255653406583559:9157]
2025-10-01T14:11:07.097866Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:07.097878Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:07.097879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.097881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.097883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.097896Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:07.097903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:07.097907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:07.097945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.097950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.097952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.097954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:07.097955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:07.098106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:07.098112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.098123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.098135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.098104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1295
2025-10-01T14:11:07.098105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1295
2025-10-01T14:11:07.098153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:07.098174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463080:4792], now have 1 active actors on pipe
2025-10-01T14:11:07.098180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783462953:2446], now have 1 active actors on pipe
2025-10-01T14:11:07.098196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.098202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.098215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255653406583554:9157]
2025-10-01T14:11:07.098216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255653406583554:9157]
2025-10-01T14:11:07.098218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255653406583554:9157]
2025-10-01T14:11:07.098226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:07.098238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:07.098240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:07.098243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:07.098244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:07.098250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:07.098251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:07.098263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:07.098268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.098275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.098276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:07.098282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.098288Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:07.098315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255653406583554:9157]
2025-10-01T14:11:07.098323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:07.098330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:07.098331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.098448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.098454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.098463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.098513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1296 partition: 0 MaxSeqNo: 45 sessionId: src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0
2025-10-01T14:11:07.098802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa2884ea-1bb0f4d-b2b692ac-9810bff1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:07.101000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0] Write session: try to update token
2025-10-01T14:11:07.101015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:07.114115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1296 sessionId: src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:07.116388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:07.116643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.116657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.118411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:07.118444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:07.118447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:07.118450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:07.118452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:07.118460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255653406583554:9157]
2025-10-01T14:11:07.118465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255653406583554:9157]
2025-10-01T14:11:07.118469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255653406583554:9157]
2025-10-01T14:11:07.118491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:07.118502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:07.118507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:07.118507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:07.118514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.118516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:07.118525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:07.118656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:07.181085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255655783463088:10063]
2025-10-01T14:11:07.181259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1295, pipe: [1:7556255655783463088:10063]
2025-10-01T14:11:07.261124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:07.268529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.268550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.268712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.268768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.268825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.268883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.268925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.268934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.269002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.269061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.269124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.269189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.269233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.269239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.269299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.269353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.269409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.269461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.269498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.269503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.269561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.269623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.269680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.269730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.269768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.269773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.269823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.269871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.269937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.269989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.270028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.270032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.270088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.270148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.270209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.270268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.270314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.270321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.270397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.270453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.270505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.270558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.270603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.270610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.270669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.270725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.270784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.270847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.270893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.270899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.270967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.271026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.271092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.271153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.271198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.271205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.271274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:07.271335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:07.271396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:07.271456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:07.271496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:07.271503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:07.271564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463088:10063], now have 1 active actors on pipe
2025-10-01T14:11:07.272211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:07.272220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0] Write session will restart in 0.006799s
2025-10-01T14:11:07.272244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0] Write session: Do CDS request
2025-10-01T14:11:07.272250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:07.272587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:07.271813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255655783463088:10063]
2025-10-01T14:11:07.271850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:07.271852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:07.271876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1296 reason: error at write: Disconnected sessionId: src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0
2025-10-01T14:11:07.272072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1296 sessionId: src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0 is DEAD
2025-10-01T14:11:07.272401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:07.279977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.280018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:07.280035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1297
2025-10-01T14:11:07.280228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.280263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:07.280267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:07.280271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:07.280622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1297 sessionId:  describe result for acl check
2025-10-01T14:11:07.280650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:07.280656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:07.280657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:07.280661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255655783463184:4772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:07.281145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255655783463184:4772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:07.282091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:07.283220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255655783463184:4772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:07.284080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:07.284253Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:07.284262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:07.284271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:07.284317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:07.284352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255653406583687:9159]
2025-10-01T14:11:07.284917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:07.285279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:07.285319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:07.285594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:07.285639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.285644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.285624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255655783463184:4772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:07.285645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.285635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255655783463184:4772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:07.285645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.285646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.285637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255655783463184:4772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:07.285648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.285645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:07.285649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.285650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.285651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.285652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.285653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.285654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.285654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.285655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.285660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.285668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.285672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.285675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.285678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.285682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.285685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.285688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.285691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.285695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.285698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.285702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.285705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.285709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.285714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.285722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.285727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.285732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.285736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.285740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.285745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.285754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.285762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.285766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.285774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.285779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.285788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.285793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.285800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.285804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.285812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.285817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.285824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.285828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.285836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.285841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.285849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.285857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.285865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.285869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.285877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.285881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.285921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:07.289334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:07.289900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:07.289909Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:07.289911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:07.289913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:07.289917Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1296 [2:7556255653406583687:9159]
2025-10-01T14:11:07.289927Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:07.289939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:07.289941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.289943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.289944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.289955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:07.289962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:07.289966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:07.290003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.290007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.290009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.290011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:07.290013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:07.290059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:07.290063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.290071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.290077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.290089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:07.290102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463236:4772], now have 1 active actors on pipe
2025-10-01T14:11:07.290111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255653406583682:9159]
2025-10-01T14:11:07.290113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255653406583682:9159]
2025-10-01T14:11:07.290114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255653406583682:9159]
2025-10-01T14:11:07.290122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:07.290131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463103:2446], now have 1 active actors on pipe
2025-10-01T14:11:07.290135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:07.290137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:07.290139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:07.290142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:07.290152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:07.290159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:07.290183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255653406583682:9159]
2025-10-01T14:11:07.290193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:07.290188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1296
2025-10-01T14:11:07.290213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:07.290202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1296
2025-10-01T14:11:07.290226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.290234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.290253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c157952a-e9074d39-2233117e-f8feb5ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:07.290264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.290267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.290268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:07.290275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.290281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:07.290291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.290408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.290414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.290423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.290499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1297 partition: 0 MaxSeqNo: 45 sessionId: src_id|c157952a-e9074d39-2233117e-f8feb5ba_0
2025-10-01T14:11:07.290839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8789d7-5980c982-78e66e2b-1f7f660b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c157952a-e9074d39-2233117e-f8feb5ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:07.293227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c157952a-e9074d39-2233117e-f8feb5ba_0] Write session: try to update token
2025-10-01T14:11:07.293244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c157952a-e9074d39-2233117e-f8feb5ba_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:07.307311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1297 sessionId: src_id|c157952a-e9074d39-2233117e-f8feb5ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:07.309716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:07.309981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.310002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.310022Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:07.310025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:07.310027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:07.310029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:07.310038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255653406583682:9159]
2025-10-01T14:11:07.310045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255653406583682:9159]
2025-10-01T14:11:07.310048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255653406583682:9159]
2025-10-01T14:11:07.310103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:07.310104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:07.310110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.310112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:07.310112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:07.310116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:07.310229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:07.372042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255655783463252:10063]
2025-10-01T14:11:07.372354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1296, pipe: [1:7556255655783463252:10063]
2025-10-01T14:11:07.452894Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:07.453246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:07.453303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463252:10063], now have 1 active actors on pipe
2025-10-01T14:11:07.453363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:07.453517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255655783463252:10063]
2025-10-01T14:11:07.453544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:07.463014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:07.464533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:07.464543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:07.464560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1297 reason: error at write: Disconnected sessionId: src_id|c157952a-e9074d39-2233117e-f8feb5ba_0
2025-10-01T14:11:07.464731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1297 sessionId: src_id|c157952a-e9074d39-2233117e-f8feb5ba_0 is DEAD
2025-10-01T14:11:07.464856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c157952a-e9074d39-2233117e-f8feb5ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:07.464863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c157952a-e9074d39-2233117e-f8feb5ba_0] Write session will restart in 0.009968s
2025-10-01T14:11:07.464885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c157952a-e9074d39-2233117e-f8feb5ba_0] Write session: Do CDS request
2025-10-01T14:11:07.464890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c157952a-e9074d39-2233117e-f8feb5ba_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:07.469853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:07.470053Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:07.470063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:07.470071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:07.470109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:07.470149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255653406583824:9163]
2025-10-01T14:11:07.470545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:07.470826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:07.470854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:07.471054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:07.471104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.471108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.471108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.471109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.471110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.471111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.471111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.471112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.471113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.471114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.471114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.471115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.471115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.471116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.471119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.471124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.471127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.471129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.471131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.471133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.471135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.471138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.471140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.471142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.471144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.471146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.471148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.471150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.471154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.471159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.471163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.471165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.471169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.471172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.471174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.471177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.471180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.471183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.471185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.471188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.471190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.471193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.471196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.471199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.471201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.471204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.471206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.471209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.471211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.471214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.471217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.471219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.471221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.471224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.471226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.471228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.471254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:07.474901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:07.475508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:07.475519Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:07.475522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:07.475525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:07.475532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1297 [2:7556255653406583824:9163]
2025-10-01T14:11:07.475545Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:07.475561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:07.475565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.475568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.475570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.475587Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:07.475596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:07.475602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:07.475655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.475662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.475664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.475667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:07.475669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:07.475735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:07.475741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.475751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.475759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.475776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:07.475797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463257:2446], now have 1 active actors on pipe
2025-10-01T14:11:07.475808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255653406583818:9163]
2025-10-01T14:11:07.475816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255653406583818:9163]
2025-10-01T14:11:07.475818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255653406583818:9163]
2025-10-01T14:11:07.475830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:07.475843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:07.475845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:07.475848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:07.475850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:07.475858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:07.475861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:07.475857Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1297
2025-10-01T14:11:07.475888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255653406583818:9163]
2025-10-01T14:11:07.475899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:07.475905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:07.475937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c157952a-e9074d39-2233117e-f8feb5ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.475985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:07.475993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1298
2025-10-01T14:11:07.476140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.476167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:07.476175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:07.476179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:07.476590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1298 sessionId:  describe result for acl check
2025-10-01T14:11:07.476620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:07.476626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:07.476628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:07.476632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255655783463355:4762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:07.477109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255655783463355:4762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:07.478982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255655783463355:4762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:07.485457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255655783463355:4762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:07.485471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255655783463355:4762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:07.485475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255655783463355:4762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:07.485482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:07.485708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1297
2025-10-01T14:11:07.492221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463393:4762], now have 1 active actors on pipe
2025-10-01T14:11:07.492269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.492277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.492298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:07.492307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:07.492316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255653406583818:9163]
2025-10-01T14:11:07.492364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:07.492374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:07.492378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.492384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.492388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:07.492400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.492416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:07.492435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:07.492617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:07.492777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:07.492919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:07.493058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:07.493264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:07.493306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.493328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:07.493561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.493575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.493592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.493690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1298 partition: 0 MaxSeqNo: 45 sessionId: src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0
2025-10-01T14:11:07.494087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c157952a-e9074d39-2233117e-f8feb5ba_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:07.496646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0] Write session: try to update token
2025-10-01T14:11:07.496662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:07.505604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:07.505643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:07.505649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:07.505653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:07.505669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255653406583818:9163]
2025-10-01T14:11:07.505679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255653406583818:9163]
2025-10-01T14:11:07.505686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255653406583818:9163]
2025-10-01T14:11:07.505755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:07.505766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:07.505770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:07.505772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:07.505782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.505796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:07.506064Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:07.513970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1298 sessionId: src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:07.516566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:07.553802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255655783463394:10063]
2025-10-01T14:11:07.554119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1297, pipe: [1:7556255655783463394:10063]
2025-10-01T14:11:07.669441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:07.669759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.669780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.669804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463394:10063], now have 1 active actors on pipe
2025-10-01T14:11:07.670293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:07.670291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255655783463394:10063]
2025-10-01T14:11:07.670296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:07.670300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:07.670326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:07.670360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1298 reason: error at write: Disconnected sessionId: src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0
2025-10-01T14:11:07.670586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1298 sessionId: src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0 is DEAD
2025-10-01T14:11:07.670804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:07.670820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0] Write session will restart in 0.007377s
2025-10-01T14:11:07.670848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0] Write session: Do CDS request
2025-10-01T14:11:07.670854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:07.679933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.680262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:07.680275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1299
2025-10-01T14:11:07.680388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.680413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:07.680418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:07.680422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:07.680892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1299 sessionId:  describe result for acl check
2025-10-01T14:11:07.680932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:07.680938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:07.680939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:07.680945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255655783463418:4759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:07.681458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255655783463418:4759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:07.683616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255655783463418:4759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:07.684907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:07.686892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:07.687087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:07.687095Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:07.687104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:07.687139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:07.687173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255653406583984:9172]
2025-10-01T14:11:07.687471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255655783463418:4759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:07.687483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255655783463418:4759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:07.687487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255655783463418:4759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:07.687496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:07.687727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:07.687926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:07.687958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:07.688219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:07.688261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.688267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.688268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.688269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.688271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.688272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.688273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.688274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.688275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.688276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.688277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.688278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.688279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.688280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.688284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.688293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.688296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.688300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.688304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.688307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.688311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.688314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.688318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.688321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.688325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.688328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.688332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.688335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.688341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.688348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.688353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.688358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.688362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.688367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.688370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.688374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.688378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.688382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.688385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.688390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.688394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.688398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.688401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.688405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.688410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.688415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.688419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.688424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.688428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.688432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.688436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.688441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.688445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.688450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.688458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.688463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.688497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:07.692136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:07.692883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:07.692903Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:07.692905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:07.692908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:07.692915Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1298 [2:7556255653406583984:9172]
2025-10-01T14:11:07.692931Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:07.692951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:07.692958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.692962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.692968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.692983Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:07.692994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:07.693001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:07.693056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.693063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.693065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.693068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:07.693070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:07.693137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:07.693146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.693157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.693166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.693182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:07.693202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463523:4759], now have 1 active actors on pipe
2025-10-01T14:11:07.693213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463397:2446], now have 1 active actors on pipe
2025-10-01T14:11:07.693221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255653406583979:9172]
2025-10-01T14:11:07.693223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255653406583979:9172]
2025-10-01T14:11:07.693225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255653406583979:9172]
2025-10-01T14:11:07.693239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:07.693224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1298
2025-10-01T14:11:07.693259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:07.693240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1298
2025-10-01T14:11:07.693263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:07.693266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:07.693268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:07.693277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:07.693280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:07.693325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.693334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.693352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255653406583979:9172]
2025-10-01T14:11:07.693364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:07.693381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:07.693400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:07.693412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.693421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.693424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:07.693433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.693446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:07.693472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.693741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.693751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.693768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.693835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1299 partition: 0 MaxSeqNo: 45 sessionId: src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0
2025-10-01T14:11:07.694213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dffbfd52-a6cb5b72-b21e4b65-f6f63935_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:07.696638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0] Write session: try to update token
2025-10-01T14:11:07.696656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:07.711140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1299 sessionId: src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:07.713715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:07.714360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.714404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.714428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:07.714431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:07.714434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:07.714436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:07.714446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255653406583979:9172]
2025-10-01T14:11:07.714450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255653406583979:9172]
2025-10-01T14:11:07.714454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255653406583979:9172]
2025-10-01T14:11:07.714499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:07.714508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:07.714510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:07.714516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:07.714523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.714525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:07.714670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:07.770413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255655783463536:10063]
2025-10-01T14:11:07.771137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1298, pipe: [1:7556255655783463536:10063]
2025-10-01T14:11:07.874284Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:07.874751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:07.874811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463536:10063], now have 1 active actors on pipe
2025-10-01T14:11:07.874925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:07.875025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255655783463536:10063]
2025-10-01T14:11:07.875054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:07.887048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:07.887062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:07.887089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1299 reason: error at write: Disconnected sessionId: src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0
2025-10-01T14:11:07.887270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1299 sessionId: src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0 is DEAD
2025-10-01T14:11:07.887631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:07.887642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0] Write session will restart in 0.005186s
2025-10-01T14:11:07.887681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0] Write session: Do CDS request
2025-10-01T14:11:07.887691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:07.891840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:07.893935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.893997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:07.894011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1300
2025-10-01T14:11:07.894159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:07.894194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:07.894203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:07.894206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:07.894750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:07.894956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:07.894966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:07.894977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:07.895026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:07.895063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255653406584126:9179]
2025-10-01T14:11:07.894600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1300 sessionId:  describe result for acl check
2025-10-01T14:11:07.894631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:07.894633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:07.894634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:07.894639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255655783463632:4745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:07.895233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255655783463632:4745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:07.895703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:07.896022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:07.896063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:07.896353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:07.896399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.896404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.896405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.896407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.896408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.896409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.896410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.896412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.896413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.896413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.896415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.896416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.896417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.896418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.896423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.896432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.896435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.896439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.896442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.896446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.896449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.896453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.896457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.896461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.896464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.896468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.896472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.896475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.896481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.896488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:07.896495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.896500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:07.896504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.896508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:07.896512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.896516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:07.896521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.896526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:07.896531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.896535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:07.896543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.896548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:07.896552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.896560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:07.896564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.896569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:07.896572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.896576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.896581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.896585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.896592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.896596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.896600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.896609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:07.896613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.896617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:07.896650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:07.898877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255655783463632:4745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:07.900442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:07.901112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:07.901127Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:07.901129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:07.901132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:07.901139Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1299 [2:7556255653406584126:9179]
2025-10-01T14:11:07.901154Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:07.901169Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:07.901177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.901181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.901184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.901200Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:07.901208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:07.901215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:07.901268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.901273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.901276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.901278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:07.901281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:07.901342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:07.901350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.901360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:07.901369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:07.901382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:07.901399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463539:2446], now have 1 active actors on pipe
2025-10-01T14:11:07.901410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255653406584121:9179]
2025-10-01T14:11:07.901413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255653406584121:9179]
2025-10-01T14:11:07.901415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255653406584121:9179]
2025-10-01T14:11:07.901427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:07.901445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:07.901445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:07.901448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:07.901450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:07.901458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:07.901462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:07.901495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1299
2025-10-01T14:11:07.901488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255653406584121:9179]
2025-10-01T14:11:07.901679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255655783463632:4745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:07.901495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:07.901691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255655783463632:4745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:07.901514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:07.901705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255655783463632:4745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:07.901712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:07.901869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463672:4745], now have 1 active actors on pipe
2025-10-01T14:11:07.901897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1299
2025-10-01T14:11:07.901980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.901987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.902005Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:07.902015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:07.902018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:07.902020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:07.902026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:07.902036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:07.902047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.902189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.902199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.902230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:07.902309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1300 partition: 0 MaxSeqNo: 45 sessionId: src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0
2025-10-01T14:11:07.902693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be0524dd-7be95a17-ad7e00bc-31dd4f31_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:07.905040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0] Write session: try to update token
2025-10-01T14:11:07.905054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:07.918835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1300 sessionId: src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:07.921224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:07.922225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:07.922247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:07.922266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:07.922269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:07.922272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:07.922274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:07.922282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255653406584121:9179]
2025-10-01T14:11:07.922286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255653406584121:9179]
2025-10-01T14:11:07.922290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255653406584121:9179]
2025-10-01T14:11:07.922322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:07.922332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:07.922338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:07.922343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:07.922356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:07.922362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:07.922504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:07.975871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255655783463690:10063]
2025-10-01T14:11:07.976343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1299, pipe: [1:7556255655783463690:10063]
2025-10-01T14:11:08.073960Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:08.074388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:08.074462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255655783463690:10063], now have 1 active actors on pipe
2025-10-01T14:11:08.074732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:08.075227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255655783463690:10063]
2025-10-01T14:11:08.075257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:08.086499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:08.086515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:08.086539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1300 reason: error at write: Disconnected sessionId: src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0
2025-10-01T14:11:08.086920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1300 sessionId: src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0 is DEAD
2025-10-01T14:11:08.087410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:08.087418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0] Write session will restart in 0.005055s
2025-10-01T14:11:08.087444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0] Write session: Do CDS request
2025-10-01T14:11:08.087452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:08.093377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:08.093879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:08.093943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:08.093957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1301
2025-10-01T14:11:08.094075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:08.094098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:08.094102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:08.094106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:08.094494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1301 sessionId:  describe result for acl check
2025-10-01T14:11:08.094532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:08.094535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:08.094537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:08.094542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255660078431081:4751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:08.095059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255660078431081:4751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:08.096462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:08.096688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:08.096705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:08.096716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:08.096760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:08.096796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255657701551555:9182]
2025-10-01T14:11:08.096803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255660078431081:4751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:08.097375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:08.097699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:08.097752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:08.098047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:08.098112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.098119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.098120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.098121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.098123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.098124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.098125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.098127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.098128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.098129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.098130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.098131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.098132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.098133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.098139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.098148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.098151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.098155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.098158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.098162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.098166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.098169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.098172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.098175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.098178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.098182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.098185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.098188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.098195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.098203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.098207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.098212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.098216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.098220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.098229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.098234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.098244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.098248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.098254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.098260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.098270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.098278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.098282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.098291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.098295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.098303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.098310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.098316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.098323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.098331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.098338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.098342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.098349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.098353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.098360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.098364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.098413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:08.101865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255660078431081:4751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:08.101881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255660078431081:4751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:08.101884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255660078431081:4751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:08.101891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:08.102047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:08.102716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:08.102729Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:08.102732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:08.102735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:08.102741Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1300 [2:7556255657701551555:9182]
2025-10-01T14:11:08.102755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:08.102771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:08.102774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.102778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.102780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.102796Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:08.102806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:08.102812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:08.102866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.102874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.102876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.102879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:08.102882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:08.103118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1300
2025-10-01T14:11:08.103142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1300
2025-10-01T14:11:08.102943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:08.102949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.102960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.102970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.102986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:08.103003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431120:4751], now have 1 active actors on pipe
2025-10-01T14:11:08.103006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078430988:2446], now have 1 active actors on pipe
2025-10-01T14:11:08.103013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255657701551550:9182]
2025-10-01T14:11:08.103015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255657701551550:9182]
2025-10-01T14:11:08.103017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255657701551550:9182]
2025-10-01T14:11:08.103029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:08.103041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:08.103055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:08.103058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:08.103089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255657701551550:9182]
2025-10-01T14:11:08.103091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:08.103135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:08.103138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:08.103143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:08.103148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:08.103294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.103304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.103333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:08.103340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.103344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.103346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:08.103354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.103363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:08.103377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:08.103554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.103562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.103595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:08.103691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1301 partition: 0 MaxSeqNo: 45 sessionId: src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0
2025-10-01T14:11:08.104020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36625b46-8dbe4341-1d899055-36fdf9ee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:08.106431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0] Write session: try to update token
2025-10-01T14:11:08.106448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:08.122105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1301 sessionId: src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:08.124023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:08.124043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:08.124046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:08.124047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:08.124059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255657701551550:9182]
2025-10-01T14:11:08.124064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255657701551550:9182]
2025-10-01T14:11:08.124067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255657701551550:9182]
2025-10-01T14:11:08.124117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:08.124128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:08.124130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.124132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:08.124134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:08.124138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:08.124261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:08.124703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:08.176056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255660078431128:10063]
2025-10-01T14:11:08.176258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1300, pipe: [1:7556255660078431128:10063]
2025-10-01T14:11:08.271962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:08.272249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.272263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.272304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431128:10063], now have 1 active actors on pipe
2025-10-01T14:11:08.272699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:08.273173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:08.273185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0] Write session will restart in 0.009896s
2025-10-01T14:11:08.273210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0] Write session: Do CDS request
2025-10-01T14:11:08.273215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:08.273429Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:11:08.273496Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:11:08.273499Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:11:08.273506Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.005600s
2025-10-01T14:11:08.272751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255660078431128:10063]
2025-10-01T14:11:08.272770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:08.272773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:08.272827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1301 reason: error at write: Disconnected sessionId: src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0
2025-10-01T14:11:08.273022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1301 sessionId: src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0 is DEAD
2025-10-01T14:11:08.273156Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:11:08.273224Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 13 consumer shared/user session shared/user_1_13_8860083045713042619_v1 is DEAD
2025-10-01T14:11:08.272709Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:08.273699Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255569884101720:10060] disconnected; active server actors: 1
2025-10-01T14:11:08.273710Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255569884101720:10060] client user disconnected session shared/user_1_13_8860083045713042619_v1
2025-10-01T14:11:08.279789Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:11:08.279987Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:11:08.279997Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 14
2025-10-01T14:11:08.280225Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 14 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:11:08.280277Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:11:08.280351Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 auth for : user
2025-10-01T14:11:08.280515Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 Handle describe topics response
2025-10-01T14:11:08.280536Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 auth is DEAD
2025-10-01T14:11:08.280540Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:11:08.280810Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:11:08.280885Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_14_4131961218445180696_v1
2025-10-01T14:11:08.281033Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255660078431138:4738] connected; active server actors: 1
2025-10-01T14:11:08.281050Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255660078431138:4738] session shared/user_1_14_4131961218445180696_v1
2025-10-01T14:11:08.281060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:11:08.281072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:11:08.281079Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_14_4131961218445180696_v1" (Sender=[1:7556255660078431135:4738], Pipe=[1:7556255660078431138:4738], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:11:08.281084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:11:08.281095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:11:08.281103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_14_4131961218445180696_v1" (Sender=[1:7556255660078431135:4738], Pipe=[1:7556255660078431138:4738], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:11:08.281114Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_14_4131961218445180696_v1" sender [1:7556255660078431135:4738] lock partition 0 for ReadingSession "shared/user_1_14_4131961218445180696_v1" (Sender=[1:7556255660078431135:4738], Pipe=[1:7556255660078431138:4738], Partitions=[], ActiveFamilyCount=1) generation 1 step 14
2025-10-01T14:11:08.281128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:11:08.281131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000035s
2025-10-01T14:11:08.281307Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 14 Session: "shared/user_1_14_4131961218445180696_v1" ClientId: "user" PipeClient { RawX1: 7556255660078431138 RawX2: 4503603922342530 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:11:08.281319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:11:08.283777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:08.284189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:08.284199Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1302
2025-10-01T14:11:08.284367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:08.284403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:08.284408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:08.284411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:08.284816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1302 sessionId:  describe result for acl check
2025-10-01T14:11:08.284848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:08.284849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:08.284851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:08.284855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255660078431146:4739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:08.285312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255660078431146:4739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:08.288725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255660078431146:4739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:08.298392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255660078431146:4739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:08.298406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255660078431146:4739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:08.298410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255660078431146:4739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:08.298418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:08.312671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:08.314833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:08.315014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:08.315023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:08.315033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:08.315074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:08.315106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255657701551689:9184]
2025-10-01T14:11:08.315673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:08.315925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:08.315961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:08.316248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:08.316295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.316301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.316302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.316303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.316304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.316305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.316306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.316307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.316309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.316310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.316311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.316311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.316313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.316314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.316318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.316326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.316330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.316334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.316337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.316341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.316344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.316348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.316351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.316365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.316369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.316372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.316375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.316378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.316384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.316390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.316396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.316400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.316405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.316409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.316413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.316418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.316421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.316426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.316430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.316435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.316446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.316452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.316456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.316488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.316496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.316501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.316505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.316510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.316515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.316520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.316528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.316532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.316536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.316541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.316548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.316552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.316588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:08.322626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:08.323209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:08.323213Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:08.323215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:08.323219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:08.323225Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1301 [2:7556255657701551689:9184]
2025-10-01T14:11:08.323240Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:08.323255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:08.323258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.323262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.323264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.323279Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:08.323283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:08.323304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:08.323351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.323353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.323355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.323358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:08.323360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:08.323424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:08.323426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.323436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.323447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.323463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:08.323479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255657701551684:9184]
2025-10-01T14:11:08.323481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255657701551684:9184]
2025-10-01T14:11:08.323483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255657701551684:9184]
2025-10-01T14:11:08.323491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:08.323499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:08.323502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:08.323504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:08.323504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431200:4739], now have 1 active actors on pipe
2025-10-01T14:11:08.323508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431141:4741], now have 1 active actors on pipe
2025-10-01T14:11:08.323513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431130:2446], now have 1 active actors on pipe
2025-10-01T14:11:08.323518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:08.323531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:08.323535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:08.323559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255657701551684:9184]
2025-10-01T14:11:08.323571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:08.323577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:08.323894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1301
2025-10-01T14:11:08.323928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1301, pipe: [1:7556255660078431141:4741]
2025-10-01T14:11:08.323944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1301
2025-10-01T14:11:08.324174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.324185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.324200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.324202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.324209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_14_4131961218445180696_v1 on pipe: [1:7556255660078431141:4741]
2025-10-01T14:11:08.324231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:08.324238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.324245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.324248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:08.324257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.324266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:08.324275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.324279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.324281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:08.324295Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_14_4131961218445180696_v1
2025-10-01T14:11:08.324297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.324323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:08.324337Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:11:08.324428Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_14_4131961218445180696_v1:1 with generation 1301
2025-10-01T14:11:08.325069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1302 partition: 0 MaxSeqNo: 45 sessionId: src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0
2025-10-01T14:11:08.324965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.324970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.324984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:08.327175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29953db9-b4b8bea4-390d85f8-af5d88f2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:08.329324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:11:08.329353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:11:08.329362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.329365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.329367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.329376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:11:08.329399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:11:08.329535Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327868324 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:11:08.329554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:11:08.329576Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 sending to client partition status
2025-10-01T14:11:08.329649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0] Write session: try to update token
2025-10-01T14:11:08.329668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:08.347134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:08.347155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:08.347158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:08.347160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:08.347171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255657701551684:9184]
2025-10-01T14:11:08.347177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255657701551684:9184]
2025-10-01T14:11:08.347184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255657701551684:9184]
2025-10-01T14:11:08.347238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:08.347245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.347248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:08.347391Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:08.350569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:08.350587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:08.350592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:08.354837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1302 sessionId: src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:08.357407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:08.525673Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:08.525944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.525954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.526598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_14_4131961218445180696_v1
2025-10-01T14:11:08.526614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:08.526925Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_14_4131961218445180696_v1
2025-10-01T14:11:08.527157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:08.527164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255660078431141:4741]
2025-10-01T14:11:08.527186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:08.527234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1302 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0
2025-10-01T14:11:08.527432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1302 sessionId: src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0 is DEAD
2025-10-01T14:11:08.528182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:08.528193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0] Write session will restart in 0.008054s
2025-10-01T14:11:08.528220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0] Write session: Do CDS request
2025-10-01T14:11:08.528226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:08.538059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:08.538164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:08.538178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1303
2025-10-01T14:11:08.538538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:08.538563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:08.538568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:08.538572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:08.538952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1303 sessionId:  describe result for acl check
2025-10-01T14:11:08.538978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:08.538980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:08.538981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:08.538985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255660078431328:4714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:08.539478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255660078431328:4714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:08.544281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255660078431328:4714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:08.547948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:08.550086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:08.550243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:08.550245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:08.550254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:08.550286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:08.550311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255657701551834:9189]
2025-10-01T14:11:08.550782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:08.551123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:08.551162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:08.551449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:08.551506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.551511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.551512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.551513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.551514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.551515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.551516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.551517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.551519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.551520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.551521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.551522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.551523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.551524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.551529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.551540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.551544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.551548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.551552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.551557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.551560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.551564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.551568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.551572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.551576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.551580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.551584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.551588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.551595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.551606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.551615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.551620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.551626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.551630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.551634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.551639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.551643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.551648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.551652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.551657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.551661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.551667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.551671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.551676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.551681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.551686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.551691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.551696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.551700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.551706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.551710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.551715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.551719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.551733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.551742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.551746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.551784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:08.552703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255660078431328:4714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:08.552718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255660078431328:4714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:08.552721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255660078431328:4714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:08.552731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:08.555713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:08.556319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:08.556329Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:08.556331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:08.556334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:08.556343Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1302 [2:7556255657701551834:9189]
2025-10-01T14:11:08.556359Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:08.556378Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:08.556386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.556389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.556391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.556406Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:08.556415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:08.556422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:08.556466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.556471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.556474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.556477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:08.556479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:08.556534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:08.556539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.556551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.556563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.556582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:08.556601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255657701551829:9189]
2025-10-01T14:11:08.556606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255657701551829:9189]
2025-10-01T14:11:08.556608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255657701551829:9189]
2025-10-01T14:11:08.556620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:08.556637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:08.556653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:08.556659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:08.556682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255657701551829:9189]
2025-10-01T14:11:08.556688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:08.556761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:08.556767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:08.556769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:08.556774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:08.557105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1302
2025-10-01T14:11:08.556990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431312:2446], now have 1 active actors on pipe
2025-10-01T14:11:08.556996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431445:4714], now have 1 active actors on pipe
2025-10-01T14:11:08.557144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1302
2025-10-01T14:11:08.557253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.557261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.557287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:08.557294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.557300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.557302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:08.557435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.557446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:08.557467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:08.557690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.557695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.557707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:08.557842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1303 partition: 0 MaxSeqNo: 45 sessionId: src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0
2025-10-01T14:11:08.558239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4dacf990-36529148-9b4b6900-cbd65ea9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:08.560647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0] Write session: try to update token
2025-10-01T14:11:08.560663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:08.589666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1303 sessionId: src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:08.591999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:08.592306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.592325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.592363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:08.593304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:08.601536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:08.601555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:08.601558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:08.601560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:08.601569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255657701551829:9189]
2025-10-01T14:11:08.601574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255657701551829:9189]
2025-10-01T14:11:08.601578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255657701551829:9189]
2025-10-01T14:11:08.601620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:08.601627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.601629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:08.601767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:08.602422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:08.602426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:08.602430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:08.630425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255660078431453:4741]
2025-10-01T14:11:08.634689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1302, pipe: [1:7556255660078431453:4741]
2025-10-01T14:11:08.791401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:08.802215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.802237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.802813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.802896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.802972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.803054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.803105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.803112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.803194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.803273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.803349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.803428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.803476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.803478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.803553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.803624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.803697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.803771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.803821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.803823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.803900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.803970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.804047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.804129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.804181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.804183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.804262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.804334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.804403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.804482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.804535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.804538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.804614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.804690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.804779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.804856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.804910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.804915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.804993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.805076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.805154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.805228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.805280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.805283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.805359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.805433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.805521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.805602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.805664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.805668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.805749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.805841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.805921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.805999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.806077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.806079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.806158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:08.806233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:08.806303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:08.806588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:08.806639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:08.806641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:08.806690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431453:4741], now have 1 active actors on pipe
2025-10-01T14:11:08.808212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:08.810429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:08.810477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255660078431453:4741]
2025-10-01T14:11:08.810496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:08.810531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1303 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0
2025-10-01T14:11:08.810693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1303 sessionId: src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0 is DEAD
2025-10-01T14:11:08.813264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:08.813276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0] Write session will restart in 0.009076s
2025-10-01T14:11:08.813302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0] Write session: Do CDS request
2025-10-01T14:11:08.813311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:08.823831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:08.826480Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:08.826494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1304
2025-10-01T14:11:08.830855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:08.830896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:08.830901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:08.830904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:08.831705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1304 sessionId:  describe result for acl check
2025-10-01T14:11:08.831731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:08.831733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:08.831734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:08.831741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255660078431473:4711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:08.832212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255660078431473:4711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:08.837889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255660078431473:4711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:08.848042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255660078431473:4711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:08.848058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255660078431473:4711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:08.848062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255660078431473:4711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:08.848071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:08.861510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:08.864380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:08.864577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:08.864581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:08.864590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:08.864629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:08.864661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255657701552013:9202]
2025-10-01T14:11:08.865315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:08.866593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:08.866640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:08.866940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:08.866979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.866980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.866981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.866982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.866984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.866985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.866986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.866987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.866989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.866990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.866991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.866992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.866993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.866994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.866999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.867009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.867012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.867016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.867020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.867024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.867027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.867031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.867034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.867039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.867042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.867045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.867049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.867052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.867058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.867065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:08.867070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.867075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:08.867079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.867084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:08.867088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.867092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:08.867097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.867101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:08.867106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.867111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:08.867115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.867120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:08.867124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.867129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:08.867133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.867137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:08.867141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.867147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.867152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.867156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.867160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.867165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.867169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.867174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:08.867178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.867182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:08.867218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:08.882826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:08.883523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:08.883527Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:08.883530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:08.883534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:08.883541Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1303 [2:7556255657701552013:9202]
2025-10-01T14:11:08.883557Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:08.883572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:08.883575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.883579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.883581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.883597Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:08.883601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:08.883607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:08.883660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.883662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.883664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.883667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:08.883670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:08.883732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:08.883735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.883747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:08.883759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:08.883774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:08.883789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255657701552006:9202]
2025-10-01T14:11:08.883791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255657701552006:9202]
2025-10-01T14:11:08.883793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255657701552006:9202]
2025-10-01T14:11:08.883807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:08.883820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:08.883835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:08.883837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:08.883867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255657701552006:9202]
2025-10-01T14:11:08.883869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:08.885902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1303
2025-10-01T14:11:08.885928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1303
2025-10-01T14:11:08.885524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:08.885529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:08.885531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:08.885536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:08.890658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431571:4711], now have 1 active actors on pipe
2025-10-01T14:11:08.890666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431461:2446], now have 1 active actors on pipe
2025-10-01T14:11:08.890683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.890689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.890720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:08.890729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:08.890734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:08.890737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:08.890748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:08.890761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:08.890778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:08.894454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.894468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.894502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:08.894864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1304 partition: 0 MaxSeqNo: 45 sessionId: src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0
2025-10-01T14:11:08.898697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1719566a-63d7b3c4-f5ca78f4-87add691_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:08.902051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0] Write session: try to update token
2025-10-01T14:11:08.902068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:08.914447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255660078431601:4741]
2025-10-01T14:11:08.914956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1303, pipe: [1:7556255660078431601:4741]
2025-10-01T14:11:08.929419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255660078431601:4741], now have 1 active actors on pipe
2025-10-01T14:11:08.929438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:08.929441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:08.929449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255657701552006:9202]
2025-10-01T14:11:08.929489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:08.929652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:08.929783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:08.929905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:08.930027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:08.930196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:08.930226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:08.930315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:08.937992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1304 sessionId: src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:08.940464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:08.941174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:08.941194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:08.941229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:08.941817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:08.946506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:08.946521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:08.946524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:08.946526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:08.946536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255657701552006:9202]
2025-10-01T14:11:08.946539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255657701552006:9202]
2025-10-01T14:11:08.946545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255657701552006:9202]
2025-10-01T14:11:08.946586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:08.946596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:08.946598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:08.946601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:08.946610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:08.946622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:08.946714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:09.099690Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:09.108511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.108534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.108728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.108792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.108856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.108919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.108963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.108968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.109041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.109111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.109179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.109245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.109291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.109294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.109369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.109439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.109514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.109594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.109642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.109646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.109738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.109811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.109880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.109953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.110001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.110004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.110079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.110143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.110209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.110274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.110318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.110321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.110562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.110629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.110692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.110758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.110796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.110799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.110867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.110923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.110987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.111051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.111093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.111096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.111160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.111214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.111275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.111331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.111370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.111376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.111443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.111504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.111566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.111623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.111673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.111676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.111750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:09.111813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:09.111879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:09.111944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:09.111983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:09.111985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:09.114033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:09.114045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0] Write session will restart in 0.006178s
2025-10-01T14:11:09.114071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0] Write session: Do CDS request
2025-10-01T14:11:09.114078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:09.113517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:09.113527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:09.113550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1304 reason: error at write: Disconnected sessionId: src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0
2025-10-01T14:11:09.113568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255660078431601:4741]
2025-10-01T14:11:09.113590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:09.113740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1304 sessionId: src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0 is DEAD
2025-10-01T14:11:09.114694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:09.121925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:09.122221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:09.122233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1305
2025-10-01T14:11:09.123049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:09.123086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:09.123091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:09.123094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:09.124677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1305 sessionId:  describe result for acl check
2025-10-01T14:11:09.124723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:09.124725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:09.124726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:09.124732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255664373398924:4704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:09.125218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255664373398924:4704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:09.128480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255664373398924:4704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:09.139566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255664373398924:4704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:09.139582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255664373398924:4704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:09.139586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255664373398924:4704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:09.139595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:09.162243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:09.169061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:09.169316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:09.169321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:09.169333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:09.169392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:09.169428Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255661996519446:9205]
2025-10-01T14:11:09.170050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:09.172867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:09.172936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:09.173233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:09.173274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.173275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.173276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.173276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.173277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.173278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.173279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.173280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.173281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.173282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.173282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.173283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.173284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.173285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.173289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.173295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.173298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.173301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.173303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.173306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.173310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.173313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.173317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.173321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.173323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.173327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.173330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.173333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.173342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.173349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.173355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.173359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.173364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.173369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.173373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.173377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.173382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.173388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.173393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.173411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.173416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.173422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.173426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.173431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.173436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.173442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.173447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.173450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.173454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.173457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.173459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.173463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.173465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.173469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.173474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.173477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.173501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:09.183750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:09.185998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1304
2025-10-01T14:11:09.186034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1304
2025-10-01T14:11:09.188188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1305 partition: 0 MaxSeqNo: 45 sessionId: src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0
2025-10-01T14:11:09.188614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|508c52f6-ae3f85ce-5dfca5c0-2be77098_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:09.184552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:09.184564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:09.184567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:09.184570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:09.184577Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1304 [2:7556255661996519446:9205]
2025-10-01T14:11:09.184593Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:09.184610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:09.184614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:09.184618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:09.184620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:09.184636Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:09.184642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:09.184648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:09.184716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.184719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.184721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.184724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:09.184726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:09.184803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:09.184806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.184818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.184829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.184843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:09.184859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255661996519440:9205]
2025-10-01T14:11:09.184862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255661996519440:9205]
2025-10-01T14:11:09.184864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255661996519440:9205]
2025-10-01T14:11:09.184873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:09.184887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:09.184901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:09.184904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:09.184940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255661996519440:9205]
2025-10-01T14:11:09.184942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:09.185062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:09.185063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:09.185065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:09.185070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:09.185197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373398915:2446], now have 1 active actors on pipe
2025-10-01T14:11:09.185204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399001:4704], now have 1 active actors on pipe
2025-10-01T14:11:09.186633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.186641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.186669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:09.186679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:09.186684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:09.186687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:09.186697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:09.186710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:09.186726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:09.188040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.188046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.188067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:09.191737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0] Write session: try to update token
2025-10-01T14:11:09.191752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:09.216662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255664373399058:4741]
2025-10-01T14:11:09.217852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399058:4741], now have 1 active actors on pipe
2025-10-01T14:11:09.217971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1304, pipe: [1:7556255664373399058:4741]
2025-10-01T14:11:09.238392Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:09.238405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:09.238407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:09.238409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:09.238419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255661996519440:9205]
2025-10-01T14:11:09.238424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255661996519440:9205]
2025-10-01T14:11:09.238428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255661996519440:9205]
2025-10-01T14:11:09.238474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:09.238481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.238485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:09.238687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:09.240973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:09.240983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:09.240987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:09.248824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1305 sessionId: src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:09.251041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:09.452193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:09.452705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.452723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.453904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255664373399058:4741]
2025-10-01T14:11:09.453927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:09.453936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:09.453939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:09.453997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1305 reason: error at write: Disconnected sessionId: src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0
2025-10-01T14:11:09.454198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1305 sessionId: src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0 is DEAD
2025-10-01T14:11:09.454342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:09.454351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0] Write session will restart in 0.009254s
2025-10-01T14:11:09.454391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0] Write session: Do CDS request
2025-10-01T14:11:09.454398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:09.454120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:09.464916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:09.465059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:09.465074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1306
2025-10-01T14:11:09.465218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:09.465253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:09.465259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:09.465262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:09.465650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1306 sessionId:  describe result for acl check
2025-10-01T14:11:09.465687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:09.465688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:09.465690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:09.465695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255664373399191:4680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:09.466214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255664373399191:4680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:09.466726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:09.468556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255664373399191:4680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:09.468836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:09.469031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:09.469041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:09.469051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:09.469094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:09.469139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255661996519592:9209]
2025-10-01T14:11:09.469725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:09.469961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:09.469993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:09.470251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:09.470307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.470312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.470313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.470314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.470315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.470316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.470317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.470318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.470319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.470320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.470321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.470322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.470323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.470324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.470328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.470336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.470340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.470343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.470347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.470350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.470353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.470356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.470359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.470363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.470366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.470391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.470394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.470397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.470404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.470410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.470417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.470421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.470426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.470430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.470434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.470439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.470442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.470446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.470450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.470456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.470460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.470465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.470470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.470474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.470479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.470483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.470487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.470491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.470495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.470500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.470505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.470515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.470519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.470523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.470531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.470536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.470574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:09.470907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255664373399191:4680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:09.470921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255664373399191:4680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:09.470924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255664373399191:4680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:09.470945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:09.476165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:09.476787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:09.476802Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:09.476805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:09.476809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:09.476817Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1305 [2:7556255661996519592:9209]
2025-10-01T14:11:09.476836Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:09.476855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:09.476864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:09.476868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:09.476871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:09.476890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:09.476901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:09.476907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:09.476973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.476980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.476982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.476986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:09.476989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:09.477085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:09.477091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.477104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.477125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.477143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:09.477165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399228:4680], now have 1 active actors on pipe
2025-10-01T14:11:09.477169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399096:2446], now have 1 active actors on pipe
2025-10-01T14:11:09.477176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255661996519587:9209]
2025-10-01T14:11:09.477179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255661996519587:9209]
2025-10-01T14:11:09.477181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255661996519587:9209]
2025-10-01T14:11:09.477195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:09.477208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:09.477217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:09.477220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:09.477221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:09.477223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:09.477226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:09.477266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255661996519587:9209]
2025-10-01T14:11:09.477273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:09.477285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:09.479919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.479941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.479976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:09.479992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:09.480002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:09.480007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:09.480033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:09.480053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:09.480078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:09.479751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1305
2025-10-01T14:11:09.479790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1305
2025-10-01T14:11:09.480724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.480737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.480755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:09.480879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1306 partition: 0 MaxSeqNo: 45 sessionId: src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0
2025-10-01T14:11:09.481268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2bc87bfa-a6576242-6d029157-3a6efaf9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:09.483780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0] Write session: try to update token
2025-10-01T14:11:09.483800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:09.498384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1306 sessionId: src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:09.500593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:09.500612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:09.500614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:09.500616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:09.500626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255661996519587:9209]
2025-10-01T14:11:09.500635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255661996519587:9209]
2025-10-01T14:11:09.500640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255661996519587:9209]
2025-10-01T14:11:09.500703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:09.500709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:09.500714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.500716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:09.500717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:09.500721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:09.500870Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:09.500986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:09.554254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255664373399237:4741]
2025-10-01T14:11:09.554528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1305, pipe: [1:7556255664373399237:4741]
2025-10-01T14:11:09.658053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:09.658474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.658489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.658529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399237:4741], now have 1 active actors on pipe
2025-10-01T14:11:09.658719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:09.659307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:09.659316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0] Write session will restart in 0.008150s
2025-10-01T14:11:09.659341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0] Write session: Do CDS request
2025-10-01T14:11:09.659347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:09.658839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255664373399237:4741]
2025-10-01T14:11:09.658872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:09.658904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:09.658969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1306 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0
2025-10-01T14:11:09.659162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1306 sessionId: src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0 is DEAD
2025-10-01T14:11:09.669032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:09.669321Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:09.669332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1307
2025-10-01T14:11:09.670540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:09.670578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:09.670584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:09.670588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:09.670974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1307 sessionId:  describe result for acl check
2025-10-01T14:11:09.671003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:09.671004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:09.671006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:09.671010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255664373399256:4672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:09.671469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255664373399256:4672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:09.676296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255664373399256:4672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:09.678979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255664373399256:4672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:09.678991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255664373399256:4672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:09.678994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255664373399256:4672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:09.679002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:09.679404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:09.681488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:09.681678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:09.681682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:09.681692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:09.681737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:09.681766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255661996519731:9212]
2025-10-01T14:11:09.682424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:09.682780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:09.682809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:09.683089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:09.683126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.683127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.683128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.683129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.683130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.683132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.683133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.683133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.683134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.683135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.683136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.683137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.683139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.683140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.683144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.683154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.683157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.683161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.683172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.683176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.683179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.683183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.683186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.683190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.683194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.683197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.683200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.683204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.683210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.683216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.683223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.683228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.683232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.683237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.683248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.683253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.683257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.683262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.683266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.683271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.683275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.683279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.683283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.683288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.683292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.683297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.683301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.683306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.683310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.683314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.683317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.683323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.683327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.683331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.683335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.683339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.683374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:09.687375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:09.687940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:09.687944Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:09.687947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:09.687950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:09.687956Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1306 [2:7556255661996519731:9212]
2025-10-01T14:11:09.687970Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:09.687983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:09.687986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:09.687989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:09.687991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:09.688004Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:09.688009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:09.688014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:09.688060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.688062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.688064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.688067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:09.688069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:09.688129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:09.688132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.688142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.688152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.688167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:09.688184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399375:4672], now have 1 active actors on pipe
2025-10-01T14:11:09.688187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399240:2446], now have 1 active actors on pipe
2025-10-01T14:11:09.688193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255661996519723:9212]
2025-10-01T14:11:09.688195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255661996519723:9212]
2025-10-01T14:11:09.688197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255661996519723:9212]
2025-10-01T14:11:09.688209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:09.688219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:09.688220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:09.688224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:09.688226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:09.688234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:09.688236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:09.688255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255661996519723:9212]
2025-10-01T14:11:09.688263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:09.688263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:09.688289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.688293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.688320Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:09.688326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:09.688330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:09.688332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:09.688341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:09.688349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:09.688361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:09.688492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.688506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.688531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:09.688259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1306
2025-10-01T14:11:09.688273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1306
2025-10-01T14:11:09.688619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1307 partition: 0 MaxSeqNo: 45 sessionId: src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0
2025-10-01T14:11:09.688979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e7cfbe-70ef6adb-ea9c0a09-6d348a31_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:09.691322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0] Write session: try to update token
2025-10-01T14:11:09.691338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:09.712072Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:09.712090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:09.712093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:09.712095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:09.712105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255661996519723:9212]
2025-10-01T14:11:09.712110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255661996519723:9212]
2025-10-01T14:11:09.712114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255661996519723:9212]
2025-10-01T14:11:09.712167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:09.712166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:09.712172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:09.712178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.712179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:09.712180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:09.712324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:09.712878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1307 sessionId: src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:09.715237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:09.758777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255664373399389:4741]
2025-10-01T14:11:09.759022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1306, pipe: [1:7556255664373399389:4741]
2025-10-01T14:11:09.890584Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:09.890904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.890919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.890966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399389:4741], now have 1 active actors on pipe
2025-10-01T14:11:09.891157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:09.891569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:09.891660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1307 reason: status is not ok: tablet will be restarted right now sessionId: src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0
2025-10-01T14:11:09.891770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:09.891811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255664373399389:4741]
2025-10-01T14:11:09.891858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1307 sessionId: src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0 is DEAD
2025-10-01T14:11:09.893669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:09.893679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0] Write session will restart in 0.009561s
2025-10-01T14:11:09.893710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0] Write session: Do CDS request
2025-10-01T14:11:09.893716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:09.904902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:09.906076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:09.906093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1308
2025-10-01T14:11:09.906240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:09.906271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:09.906277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:09.906282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:09.907049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1308 sessionId:  describe result for acl check
2025-10-01T14:11:09.907085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:09.907087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:09.907089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:09.907094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255664373399470:4663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:09.907647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255664373399470:4663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:09.910947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:09.911429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255664373399470:4663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:09.915595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:09.915882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:09.915895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:09.915520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255664373399470:4663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:09.915536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255664373399470:4663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:09.915540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255664373399470:4663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:09.915551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:09.916270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:09.916352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:09.916390Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255661996519912:9225]
2025-10-01T14:11:09.917037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:09.917361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:09.917408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:09.917710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:09.917767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.917768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.917770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.917772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.917773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.917774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.917776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.917778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.917779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.917780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.917781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.917782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.917784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.917785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.917791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.917802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.917807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.917811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.917815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.917819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.917823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.917827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.917832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.917836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.917840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.917845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.917849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.917854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.917860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.917868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:09.917874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.917880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:09.917886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.917895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:09.917899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.917904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:09.917909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.917913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:09.917917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.917922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:09.917927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.917932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:09.917936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.917942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:09.917947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.917953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:09.917957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.917963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.917967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.917971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.917976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.917981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.917986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.917991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:09.917997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.918002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:09.918046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:09.924241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:09.924934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:09.924950Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:09.924953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:09.924957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:09.924964Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1307 [2:7556255661996519912:9225]
2025-10-01T14:11:09.924982Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:09.925000Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:09.925004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:09.925008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:09.925011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:09.925028Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:09.925039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:09.925044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:09.925105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.925110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.925112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.925115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:09.925117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:09.925184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:09.925194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.925205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:09.925214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:09.925229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:09.925247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255661996519907:9225]
2025-10-01T14:11:09.925250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255661996519907:9225]
2025-10-01T14:11:09.925252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255661996519907:9225]
2025-10-01T14:11:09.925260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:09.925266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:09.925268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:09.925270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:09.925274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:09.925287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:09.925290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:09.925300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399525:4663], now have 1 active actors on pipe
2025-10-01T14:11:09.925303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399394:2446], now have 1 active actors on pipe
2025-10-01T14:11:09.925338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255661996519907:9225]
2025-10-01T14:11:09.925344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:09.925350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:09.925659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1307
2025-10-01T14:11:09.925700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1307
2025-10-01T14:11:09.926515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.926529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.926560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fce43426-e607f873-96e4d76b-b8185b07_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:09.926573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:09.926581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:09.926584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:09.926610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:09.926625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:09.926643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:09.926895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:09.926903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:09.926918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:09.927034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1308 partition: 0 MaxSeqNo: 45 sessionId: src_id|fce43426-e607f873-96e4d76b-b8185b07_0
2025-10-01T14:11:09.927476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fb734b-d04ee673-a2c00c2d-1b800e16_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fce43426-e607f873-96e4d76b-b8185b07_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:09.930013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fce43426-e607f873-96e4d76b-b8185b07_0] Write session: try to update token
2025-10-01T14:11:09.930032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fce43426-e607f873-96e4d76b-b8185b07_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:09.952081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:09.952102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:09.952105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:09.952107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:09.952117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255661996519907:9225]
2025-10-01T14:11:09.952122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255661996519907:9225]
2025-10-01T14:11:09.952127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255661996519907:9225]
2025-10-01T14:11:09.952177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:09.952191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:09.952198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:09.952344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:09.953175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1308 sessionId: src_id|fce43426-e607f873-96e4d76b-b8185b07_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:09.955952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:09.953457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:09.953471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:09.953475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:09.992139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255664373399553:4741]
2025-10-01T14:11:09.992440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1307, pipe: [1:7556255664373399553:4741]
2025-10-01T14:11:10.183157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255664373399553:4741]
2025-10-01T14:11:10.183189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:10.180244Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:10.180788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.180797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.180838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255664373399553:4741], now have 1 active actors on pipe
2025-10-01T14:11:10.182240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:10.183248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1308 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fce43426-e607f873-96e4d76b-b8185b07_0
2025-10-01T14:11:10.186644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce43426-e607f873-96e4d76b-b8185b07_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:10.186654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce43426-e607f873-96e4d76b-b8185b07_0] Write session will restart in 0.007084s
2025-10-01T14:11:10.186678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce43426-e607f873-96e4d76b-b8185b07_0] Write session: Do CDS request
2025-10-01T14:11:10.186683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce43426-e607f873-96e4d76b-b8185b07_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:10.183408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1308 sessionId: src_id|fce43426-e607f873-96e4d76b-b8185b07_0 is DEAD
2025-10-01T14:11:10.183549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:10.194891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fce43426-e607f873-96e4d76b-b8185b07_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:10.195166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:10.195177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1309
2025-10-01T14:11:10.195313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:10.195338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:10.195343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:10.195347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:10.195820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1309 sessionId:  describe result for acl check
2025-10-01T14:11:10.195847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:10.195849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:10.195850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:10.195855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255668668366867:4656] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:10.196448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255668668366867:4656] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:10.211293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255668668366867:4656] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:10.215217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:10.218916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:10.219160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:10.219167Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:10.219178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:10.219221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:10.219252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255666291487349:9228]
2025-10-01T14:11:10.220051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:10.220918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:10.220958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:10.221257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:10.221305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.221306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.221307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.221308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.221309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.221311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.221312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.221313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.221314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.221315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.221316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.221317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.221318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.221319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.221323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.221332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.221336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.221339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.221343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.221347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.221350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.221361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.221365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.221369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.221372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.221376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.221379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.221382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.221389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.221396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.221401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.221406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.221410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.221415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.221419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.221423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.221428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.221432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.221436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.221441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.221445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.221450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.221454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.221458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.221462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.221467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.221471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.221476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.221480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.221484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.221488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.221494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.221498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.221503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.221507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.221512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.221550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:10.227046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:10.228026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:10.228031Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:10.228033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:10.228037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:10.228043Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1308 [2:7556255666291487349:9228]
2025-10-01T14:11:10.228057Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:10.228071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:10.228074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:10.228078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:10.228080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:10.228093Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:10.228099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:10.228105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:10.228152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.228154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.228156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.228159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:10.228162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:10.228227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:10.228229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.228239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.228249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.228262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:10.228276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255666291487343:9228]
2025-10-01T14:11:10.228278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255666291487343:9228]
2025-10-01T14:11:10.228280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255666291487343:9228]
2025-10-01T14:11:10.228290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:10.228302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:10.228314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:10.228316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:10.228340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255666291487343:9228]
2025-10-01T14:11:10.228343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:10.228626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:10.228632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:10.228633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:10.228638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:10.228032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255668668366867:4656] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:10.228047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255668668366867:4656] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:10.228050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255668668366867:4656] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:10.228058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:10.229194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1308
2025-10-01T14:11:10.229643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1308
2025-10-01T14:11:10.233549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255668668366854:2446], now have 1 active actors on pipe
2025-10-01T14:11:10.233571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255668668366990:4656], now have 1 active actors on pipe
2025-10-01T14:11:10.233584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.233592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.233620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:10.233630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:10.233634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:10.233636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:10.233656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:10.233668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:10.233681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:10.234004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.234008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.234019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:10.234150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1309 partition: 0 MaxSeqNo: 45 sessionId: src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0
2025-10-01T14:11:10.234618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fce43426-e607f873-96e4d76b-b8185b07_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:10.237473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0] Write session: try to update token
2025-10-01T14:11:10.237487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:10.256819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:10.256835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:10.256843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255666291487343:9228]
2025-10-01T14:11:10.256881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:10.257142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:10.257286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:10.257423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:10.257557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:10.257761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:10.257792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:10.258621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:10.286500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255668668366998:4741]
2025-10-01T14:11:10.289097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1309 sessionId: src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:10.292088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:10.295929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.295947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.295968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255668668366998:4741], now have 1 active actors on pipe
2025-10-01T14:11:10.295991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:10.296900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1308, pipe: [1:7556255668668366998:4741]
2025-10-01T14:11:10.296915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:10.308374Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:10.308387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:10.308390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:10.308392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:10.308401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255666291487343:9228]
2025-10-01T14:11:10.308407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255666291487343:9228]
2025-10-01T14:11:10.308410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255666291487343:9228]
2025-10-01T14:11:10.308452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:10.308459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.308462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:10.308600Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:10.309020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:10.309026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:10.309029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:10.528089Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:10.544880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.544911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.545085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.545150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.545213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.545274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.545323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.545328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.545399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.545461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.545522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.545915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.545962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.545965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.546037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.546101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.546166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.549746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.549801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.549805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.549887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.549953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.550015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.550085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.550126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.550129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.550195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.550250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.550309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.550388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.550429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.550434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.550501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.550559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.550615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.550678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.550718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.550721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.550792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.550848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.550908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.550967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.551006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.551010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.551071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.551125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.551181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.551241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.551282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.551285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.551352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.551406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.551460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.551513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.551551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.551554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.551619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:10.551667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:10.551723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:10.551777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:10.551817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:10.551820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:10.553410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:10.556207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:10.556220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255668668366998:4741]
2025-10-01T14:11:10.556248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:10.556282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1309 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0
2025-10-01T14:11:10.556519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1309 sessionId: src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0 is DEAD
2025-10-01T14:11:10.556642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:10.556653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0] Write session will restart in 0.007184s
2025-10-01T14:11:10.556679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0] Write session: Do CDS request
2025-10-01T14:11:10.556685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:10.566858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:10.566918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:10.566933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1310
2025-10-01T14:11:10.568145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:10.568182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:10.568187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:10.568191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:10.568593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1310 sessionId:  describe result for acl check
2025-10-01T14:11:10.568633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:10.568635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:10.568636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:10.568641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255668668367062:4634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:10.569173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255668668367062:4634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:10.575774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255668668367062:4634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:10.583176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255668668367062:4634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:10.583195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255668668367062:4634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:10.583199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255668668367062:4634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:10.583209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:10.589969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:10.598355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:10.598632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:10.598636Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:10.598648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:10.598702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:10.598743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255666291487501:9233]
2025-10-01T14:11:10.599307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:10.599826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:10.599878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:10.600181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:10.600251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.600252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.600254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.600255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.600256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.600257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.600258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.600259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.600260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.600261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.600262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.600263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.600264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.600266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.600271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.600280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.600283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.600287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.600290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.600293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.600297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.600300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.600304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.600310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.600313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.600316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.600319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.600322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.600332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.600338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.600344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.600349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.600353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.600358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.600361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.600366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.600370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.600374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.600378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.600383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.600387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.600391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.600397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.600402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.600406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.600410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.600414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.600419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.600424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.600428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.600432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.600436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.600440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.600444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.600448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.600452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.600486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:10.607586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:10.608291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:10.608303Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:10.608306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:10.608309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:10.608315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1309 [2:7556255666291487501:9233]
2025-10-01T14:11:10.608332Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:10.608347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:10.608350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:10.608355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:10.608357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:10.608372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:10.608377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:10.608383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:10.608437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.608439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.608441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.608445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:10.608447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:10.608506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:10.608508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.608519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.608530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.608545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:10.608561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255666291487495:9233]
2025-10-01T14:11:10.608563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255666291487495:9233]
2025-10-01T14:11:10.608566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255666291487495:9233]
2025-10-01T14:11:10.608576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:10.608589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:10.608604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:10.608607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:10.608636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255666291487495:9233]
2025-10-01T14:11:10.608638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:10.608722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:10.608723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:10.608725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:10.608729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:10.609128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1309
2025-10-01T14:11:10.609176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1309
2025-10-01T14:11:10.609372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255668668367037:2446], now have 1 active actors on pipe
2025-10-01T14:11:10.609381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255668668367169:4634], now have 1 active actors on pipe
2025-10-01T14:11:10.609400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.609405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.609430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:10.609438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:10.609442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:10.609444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:10.609455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:10.609465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:10.609479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:10.609697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.609704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.609724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:10.609832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1310 partition: 0 MaxSeqNo: 45 sessionId: src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0
2025-10-01T14:11:10.610178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c6a006-34e845ca-eefc4f10-5cd871a1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:10.612529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0] Write session: try to update token
2025-10-01T14:11:10.612545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:10.633268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:10.633283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:10.633288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:10.633290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:10.633298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255666291487495:9233]
2025-10-01T14:11:10.633301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255666291487495:9233]
2025-10-01T14:11:10.633303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255666291487495:9233]
2025-10-01T14:11:10.633343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:10.633349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.633350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:10.633481Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:10.634328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:10.634338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:10.634341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:10.634902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1310 sessionId: src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:10.637239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:10.656898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255668668367182:4741]
2025-10-01T14:11:10.657526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1309, pipe: [1:7556255668668367182:4741]
2025-10-01T14:11:10.826527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:10.826889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.826908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.826948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255668668367182:4741], now have 1 active actors on pipe
2025-10-01T14:11:10.827163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:10.827482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255668668367182:4741]
2025-10-01T14:11:10.827511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:10.827539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:10.827599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1310 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0
2025-10-01T14:11:10.827804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1310 sessionId: src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0 is DEAD
2025-10-01T14:11:10.827939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:10.827950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0] Write session will restart in 0.005092s
2025-10-01T14:11:10.827975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0] Write session: Do CDS request
2025-10-01T14:11:10.827982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:10.833995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:10.834275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:10.834288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1311
2025-10-01T14:11:10.834431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:10.834461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:10.834467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:10.834469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:10.834804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1311 sessionId:  describe result for acl check
2025-10-01T14:11:10.834830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:10.834833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:10.834834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:10.834840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255668668367194:4629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:10.835280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255668668367194:4629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:10.842691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255668668367194:4629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:10.850908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255668668367194:4629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:10.850925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255668668367194:4629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:10.850928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255668668367194:4629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:10.850936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:10.859843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:10.862822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:10.863480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:10.863492Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:10.863505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:10.863561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:10.863593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255666291487672:9242]
2025-10-01T14:11:10.864171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:10.864523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:10.864581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:10.864919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:10.864980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.864982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.864983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.864984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.864985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.864986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.864987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.864988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.864990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.864991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.864992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.864994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.864994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.864996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.865001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.865010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.865014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.865018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.865022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.865026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.865029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.865033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.865036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.865040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.865044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.865047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.865051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.865054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.865061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.865069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:10.865074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.865079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:10.865083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.865087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:10.865091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.865095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:10.865100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.865105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:10.865109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.865114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:10.865119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.865123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:10.865127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.865132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:10.865137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.865142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:10.865146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.865150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.865155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.865160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.865164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.865168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.865172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.865177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:10.865180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.865185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:10.865221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:10.870719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:10.871769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:10.871781Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:10.871783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:10.871787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:10.871793Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1310 [2:7556255666291487672:9242]
2025-10-01T14:11:10.871806Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:10.871821Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:10.871824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:10.871827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:10.871829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:10.871845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:10.871849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:10.871854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:10.871906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.871908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.871910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.871913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:10.871915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:10.871977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:10.871979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.871991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:10.872001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:10.872017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:10.872034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255666291487663:9242]
2025-10-01T14:11:10.872036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255666291487663:9242]
2025-10-01T14:11:10.872038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255666291487663:9242]
2025-10-01T14:11:10.872049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:10.872064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:10.872066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255668668367270:4629], now have 1 active actors on pipe
2025-10-01T14:11:10.872068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:10.872069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255668668367187:2446], now have 1 active actors on pipe
2025-10-01T14:11:10.872070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:10.872076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:10.872089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:10.872092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:10.872122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255666291487663:9242]
2025-10-01T14:11:10.872128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:10.872134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:10.872822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1310
2025-10-01T14:11:10.872851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1310
2025-10-01T14:11:10.873658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.873669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.873698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aec9e81c-719677c8-e3050587-62dbed6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:10.873710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:10.873714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:10.873716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:10.873725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:10.873735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:10.873753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:10.873930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.873939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.873955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:10.874241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1311 partition: 0 MaxSeqNo: 45 sessionId: src_id|aec9e81c-719677c8-e3050587-62dbed6d_0
2025-10-01T14:11:10.874682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14b58411-1b12b712-7d2887e5-5dbdf1be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aec9e81c-719677c8-e3050587-62dbed6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:10.877280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec9e81c-719677c8-e3050587-62dbed6d_0] Write session: try to update token
2025-10-01T14:11:10.877298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec9e81c-719677c8-e3050587-62dbed6d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:10.889821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:10.889842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:10.889852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255666291487663:9242]
2025-10-01T14:11:10.889899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:10.890106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:10.890269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:10.890441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:10.890596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:10.890847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:10.890883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:10.891192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:10.914421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1311 sessionId: src_id|aec9e81c-719677c8-e3050587-62dbed6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:10.917425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:10.917729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:10.917756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:10.917795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:10.917974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:10.927397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255668668367337:4741]
2025-10-01T14:11:10.929272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1310, pipe: [1:7556255668668367337:4741]
2025-10-01T14:11:10.929220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255668668367337:4741], now have 1 active actors on pipe
2025-10-01T14:11:10.931232Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:10.931238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:10.931240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:10.931242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:10.931252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255666291487663:9242]
2025-10-01T14:11:10.931257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255666291487663:9242]
2025-10-01T14:11:10.931264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255666291487663:9242]
2025-10-01T14:11:10.931314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:10.931320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:10.931322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:10.931460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:10.932681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:10.932702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:10.932706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:11.082919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:11.091060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.091084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.091244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.091296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.091350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.091403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.091789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.091803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.091865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.091919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.091978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.092042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.092094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.092100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.092166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.092231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.092293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.092355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.092397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.092408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.092471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.092532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.092597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.092662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.092718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.092725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.092790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.092855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.092919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.092981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.093021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.093028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.093090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.093153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.093213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.093274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.093320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.093327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.093388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.093446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.093508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.093566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.093608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.093616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.093684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.093743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.093805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.093869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.093908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.093911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.093977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.094042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.094101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.094164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.094203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.094205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.094263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:11.094316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:11.094387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:11.094447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:11.094491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:11.094497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:11.095605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:11.096095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255668668367337:4741]
2025-10-01T14:11:11.096132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:11.096170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1311 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aec9e81c-719677c8-e3050587-62dbed6d_0
2025-10-01T14:11:11.096384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1311 sessionId: src_id|aec9e81c-719677c8-e3050587-62dbed6d_0 is DEAD
2025-10-01T14:11:11.096517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:11.097243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec9e81c-719677c8-e3050587-62dbed6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:11.097254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec9e81c-719677c8-e3050587-62dbed6d_0] Write session will restart in 0.009759s
2025-10-01T14:11:11.097279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec9e81c-719677c8-e3050587-62dbed6d_0] Write session: Do CDS request
2025-10-01T14:11:11.097285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec9e81c-719677c8-e3050587-62dbed6d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:11.108117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aec9e81c-719677c8-e3050587-62dbed6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:11.108591Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:11.108607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1312
2025-10-01T14:11:11.108755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:11.108788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:11.108793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:11.108797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:11.109264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1312 sessionId:  describe result for acl check
2025-10-01T14:11:11.109297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:11.109298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:11.109300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:11.109305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255672963334656:4619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:11.109812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255672963334656:4619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:11.115175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255672963334656:4619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:11.125230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255672963334656:4619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:11.125252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255672963334656:4619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:11.125255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255672963334656:4619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:11.125264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:11.134024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:11.135111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:11.135326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:11.135330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:11.135342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:11.135395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:11.135431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255670586455125:9249]
2025-10-01T14:11:11.135962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:11.138391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:11.138450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:11.138782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:11.138825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.138827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.138828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.138829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.138831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.138832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.138834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.138835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.138837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.138839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.138840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.138841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.138843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.138844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.138850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.138860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.138864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.138868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.138872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.138876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.138880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.138884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.138888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.138892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.138895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.138899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.138902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.138905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.138912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.138919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.138926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.138931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.138935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.138940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.138945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.138950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.138955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.138960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.138963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.138968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.138973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.138979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.138983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.138988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.138993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.138998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.139003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.139009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.139012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.139017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.139022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.139027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.139032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.139037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.139042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.139047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.139090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:11.145673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:11.146413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:11.146418Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:11.146421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:11.146424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:11.146432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1311 [2:7556255670586455125:9249]
2025-10-01T14:11:11.146447Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:11.146465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:11.146468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:11.146471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:11.146474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:11.146491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:11.146498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:11.146505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:11.146561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.146563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.146565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.146568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:11.146570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:11.146647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:11.146650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.146662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.146679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.146693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:11.146710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255670586455119:9249]
2025-10-01T14:11:11.146714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255670586455119:9249]
2025-10-01T14:11:11.146716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255670586455119:9249]
2025-10-01T14:11:11.146730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:11.147576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1311
2025-10-01T14:11:11.147613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1311
2025-10-01T14:11:11.146750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:11.146769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:11.146772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:11.146806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255670586455119:9249]
2025-10-01T14:11:11.146809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:11.146843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:11.146847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:11.146850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:11.146856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:11.147726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963334648:2446], now have 1 active actors on pipe
2025-10-01T14:11:11.147732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963334785:4619], now have 1 active actors on pipe
2025-10-01T14:11:11.149817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1312 partition: 0 MaxSeqNo: 45 sessionId: src_id|8ca5a20f-e454a946-93061206-c58eadd7_0
2025-10-01T14:11:11.150280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aec9e81c-719677c8-e3050587-62dbed6d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8ca5a20f-e454a946-93061206-c58eadd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:11.149169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.149180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.149209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ca5a20f-e454a946-93061206-c58eadd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:11.149219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:11.149224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:11.149227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:11.149239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:11.149255Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:11.149271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:11.149519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.149522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.149537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:11.152799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca5a20f-e454a946-93061206-c58eadd7_0] Write session: try to update token
2025-10-01T14:11:11.152817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca5a20f-e454a946-93061206-c58eadd7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:11.199243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:11.199259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:11.199261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:11.199264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:11.199275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255670586455119:9249]
2025-10-01T14:11:11.199280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255670586455119:9249]
2025-10-01T14:11:11.199284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255670586455119:9249]
2025-10-01T14:11:11.199331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:11.199337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.199340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:11.199474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:11.197204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255672963334797:4741]
2025-10-01T14:11:11.200811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1312 sessionId: src_id|8ca5a20f-e454a946-93061206-c58eadd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:11.202789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:11.202801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:11.202805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:11.203489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:11.206861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1311, pipe: [1:7556255672963334797:4741]
2025-10-01T14:11:11.359228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:11.359607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.359619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.359638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963334797:4741], now have 1 active actors on pipe
2025-10-01T14:11:11.359803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:11.359804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255672963334797:4741]
2025-10-01T14:11:11.359819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:11.359820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:11.359867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1312 reason: error at write: Disconnected sessionId: src_id|8ca5a20f-e454a946-93061206-c58eadd7_0
2025-10-01T14:11:11.359871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:11.360043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1312 sessionId: src_id|8ca5a20f-e454a946-93061206-c58eadd7_0 is DEAD
2025-10-01T14:11:11.360192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca5a20f-e454a946-93061206-c58eadd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:11.360204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca5a20f-e454a946-93061206-c58eadd7_0] Write session will restart in 0.006749s
2025-10-01T14:11:11.360246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca5a20f-e454a946-93061206-c58eadd7_0] Write session: Do CDS request
2025-10-01T14:11:11.360253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca5a20f-e454a946-93061206-c58eadd7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:11.367972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca5a20f-e454a946-93061206-c58eadd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:11.368299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:11.368313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1313
2025-10-01T14:11:11.369238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:11.369275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:11.369280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:11.369284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:11.369612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1313 sessionId:  describe result for acl check
2025-10-01T14:11:11.369635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:11.369636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:11.369638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:11.369643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255672963334818:4618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:11.370119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255672963334818:4618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:11.375256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255672963334818:4618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:11.383053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255672963334818:4618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:11.383071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255672963334818:4618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:11.383074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255672963334818:4618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:11.383083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:11.382684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:11.385062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:11.385241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:11.385244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:11.385254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:11.385294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:11.385323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255670586455269:9251]
2025-10-01T14:11:11.385924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:11.386327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:11.386359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:11.386647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:11.386698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.386704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.386705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.386706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.386707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.386708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.386709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.386710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.386711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.386712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.386714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.386715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.386716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.386717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.386722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.386731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.386735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.386739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.386743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.386747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.386750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.386754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.386758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.386762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.386765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.386769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.386773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.386776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.386782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.386790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.386796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.386801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.386805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.386810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.386814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.386819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.386824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.386833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.386838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.386842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.386847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.386856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.386860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.386865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.386869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.386874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.386886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.386891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.386895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.386900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.386904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.386909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.386914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.386919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.386923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.386928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.386965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:11.399710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:11.400328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:11.400333Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:11.400336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:11.400340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:11.400348Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1312 [2:7556255670586455269:9251]
2025-10-01T14:11:11.400367Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:11.400385Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:11.400388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:11.400391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:11.400394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:11.400411Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:11.400417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:11.400424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:11.400485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.400488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.400491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.400494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:11.400498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:11.400570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:11.400572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.400586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.400597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.400614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:11.400631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255670586455263:9251]
2025-10-01T14:11:11.400634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255670586455263:9251]
2025-10-01T14:11:11.400636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255670586455263:9251]
2025-10-01T14:11:11.400650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:11.400666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:11.400680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:11.400683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:11.400731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255670586455263:9251]
2025-10-01T14:11:11.400733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:11.401371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1312
2025-10-01T14:11:11.401408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1312
2025-10-01T14:11:11.401009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:11.401016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:11.401018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:11.401024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:11.406430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963334949:4618], now have 1 active actors on pipe
2025-10-01T14:11:11.406445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963334809:2446], now have 1 active actors on pipe
2025-10-01T14:11:11.406465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.406473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.406510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7adb680-d593226b-2d439b87-602f2345_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:11.406521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:11.406527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:11.406530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:11.406543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:11.406559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:11.406582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:11.407508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.407516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.407532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:11.407663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1313 partition: 0 MaxSeqNo: 45 sessionId: src_id|a7adb680-d593226b-2d439b87-602f2345_0
2025-10-01T14:11:11.408052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca5a20f-e454a946-93061206-c58eadd7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a7adb680-d593226b-2d439b87-602f2345_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:11.410393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7adb680-d593226b-2d439b87-602f2345_0] Write session: try to update token
2025-10-01T14:11:11.410408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7adb680-d593226b-2d439b87-602f2345_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:11.428028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:11.428049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:11.428052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:11.428054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:11.428065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255670586455263:9251]
2025-10-01T14:11:11.428070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255670586455263:9251]
2025-10-01T14:11:11.428074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255670586455263:9251]
2025-10-01T14:11:11.428124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:11.428131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.428134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:11.428273Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:11.432397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:11.432415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:11.432421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:11.430950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1313 sessionId: src_id|a7adb680-d593226b-2d439b87-602f2345_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:11.433437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:11.462552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255672963334963:4741]
2025-10-01T14:11:11.463018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1312, pipe: [1:7556255672963334963:4741]
2025-10-01T14:11:11.589821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:11.590278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.590295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.590335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963334963:4741], now have 1 active actors on pipe
2025-10-01T14:11:11.590622Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:11.590985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255672963334963:4741]
2025-10-01T14:11:11.591024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:11.591325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:11.591405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1313 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7adb680-d593226b-2d439b87-602f2345_0
2025-10-01T14:11:11.591579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1313 sessionId: src_id|a7adb680-d593226b-2d439b87-602f2345_0 is DEAD
2025-10-01T14:11:11.591725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7adb680-d593226b-2d439b87-602f2345_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:11.591736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7adb680-d593226b-2d439b87-602f2345_0] Write session will restart in 0.007796s
2025-10-01T14:11:11.591761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7adb680-d593226b-2d439b87-602f2345_0] Write session: Do CDS request
2025-10-01T14:11:11.591767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7adb680-d593226b-2d439b87-602f2345_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:11.604508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7adb680-d593226b-2d439b87-602f2345_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:11.604867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:11.604883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1314
2025-10-01T14:11:11.604997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:11.605027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:11.605036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:11.605042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:11.609493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1314 sessionId:  describe result for acl check
2025-10-01T14:11:11.609535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:11.609540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:11.609544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:11.609550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255672963335006:4597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:11.610062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255672963335006:4597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:11.617000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255672963335006:4597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:11.622799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255672963335006:4597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:11.622819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255672963335006:4597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:11.622822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255672963335006:4597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:11.622831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:11.635271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:11.639223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:11.639462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:11.639468Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:11.639481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:11.639547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:11.639611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255670586455424:9256]
2025-10-01T14:11:11.640160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:11.640704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:11.640748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:11.641071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:11.641142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.641143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.641144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.641145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.641147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.641148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.641149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.641151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.641152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.641154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.641155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.641156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.641158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.641159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.641164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.641174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.641178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.641182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.641185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.641189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.641193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.641197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.641200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.641204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.641208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.641211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.641215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.641219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.641226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.641233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.641240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.641245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.641249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.641254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.641258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.641264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.641269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.641274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.641278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.641283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.641287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.641292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.641296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.641301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.641306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.641311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.641315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.641321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.641325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.641330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.641334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.641355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.641359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.641364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.641368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.641373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.641412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:11.658321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:11.658959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:11.658964Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:11.658966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:11.658969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:11.658977Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1313 [2:7556255670586455424:9256]
2025-10-01T14:11:11.658994Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:11.659013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:11.659015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:11.659018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:11.659020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:11.659033Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:11.659037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:11.659044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:11.659090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.659091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.659093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.659095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:11.659097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:11.659155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:11.659157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.659164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.659170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.659180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:11.659192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255670586455418:9256]
2025-10-01T14:11:11.659193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255670586455418:9256]
2025-10-01T14:11:11.659195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255670586455418:9256]
2025-10-01T14:11:11.659203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:11.659214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:11.659223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:11.659225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:11.659256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255670586455418:9256]
2025-10-01T14:11:11.659258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:11.659421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:11.659426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:11.659428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:11.659431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:11.659715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963335072:4597], now have 1 active actors on pipe
2025-10-01T14:11:11.659721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963334991:2446], now have 1 active actors on pipe
2025-10-01T14:11:11.660152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1313
2025-10-01T14:11:11.660208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1313
2025-10-01T14:11:11.660412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.660428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.660460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f682345d-c07a57e4-ee629129-7e68e652_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:11.660470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:11.660475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:11.660478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:11.660495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:11.660523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:11.660547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:11.661249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.661266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.661296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:11.661433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1314 partition: 0 MaxSeqNo: 45 sessionId: src_id|f682345d-c07a57e4-ee629129-7e68e652_0
2025-10-01T14:11:11.661863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7adb680-d593226b-2d439b87-602f2345_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f682345d-c07a57e4-ee629129-7e68e652_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:11.664198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f682345d-c07a57e4-ee629129-7e68e652_0] Write session: try to update token
2025-10-01T14:11:11.664214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f682345d-c07a57e4-ee629129-7e68e652_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:11.682600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1314 sessionId: src_id|f682345d-c07a57e4-ee629129-7e68e652_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:11.684964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:11.686168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.686191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.686211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:11.686214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:11.686216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:11.686218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:11.686226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255670586455418:9256]
2025-10-01T14:11:11.686231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255670586455418:9256]
2025-10-01T14:11:11.686235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255670586455418:9256]
2025-10-01T14:11:11.686286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:11.686293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.686295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:11.686436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:11.686574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:11.686580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:11.686583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:11.694518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255672963335139:4741]
2025-10-01T14:11:11.701801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1313, pipe: [1:7556255672963335139:4741]
2025-10-01T14:11:11.852115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:11.852399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:11.852431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963335139:4741], now have 1 active actors on pipe
2025-10-01T14:11:11.853042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:11.853117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:11.853119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:11.853192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1314 reason: error at write: Disconnected sessionId: src_id|f682345d-c07a57e4-ee629129-7e68e652_0
2025-10-01T14:11:11.853332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1314 sessionId: src_id|f682345d-c07a57e4-ee629129-7e68e652_0 is DEAD
2025-10-01T14:11:11.853446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:11.853480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255672963335139:4741]
2025-10-01T14:11:11.856723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f682345d-c07a57e4-ee629129-7e68e652_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:11.856732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f682345d-c07a57e4-ee629129-7e68e652_0] Write session will restart in 0.005428s
2025-10-01T14:11:11.856751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f682345d-c07a57e4-ee629129-7e68e652_0] Write session: Do CDS request
2025-10-01T14:11:11.856758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f682345d-c07a57e4-ee629129-7e68e652_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:11.863085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f682345d-c07a57e4-ee629129-7e68e652_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:11.863381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:11.863397Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1315
2025-10-01T14:11:11.863499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:11.863532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:11.863541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:11.863544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:11.864003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1315 sessionId:  describe result for acl check
2025-10-01T14:11:11.864040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:11.864046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:11.864048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:11.864053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255672963335153:4595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:11.864559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255672963335153:4595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:11.870600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255672963335153:4595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:11.882704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255672963335153:4595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:11.882719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255672963335153:4595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:11.882722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255672963335153:4595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:11.882739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:11.896884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:11.897096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:11.897272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:11.897276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:11.897293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:11.897338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:11.897371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255670586455595:9259]
2025-10-01T14:11:11.897981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:11.908618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:11.908710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:11.909070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:11.909137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.909141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.909141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.909142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.909143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.909144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.909146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.909147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.909148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.909149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.909150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.909152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.909153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.909154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.909161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.909171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.909175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.909179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.909184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.909188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.909192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.909195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.909199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.909204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.909207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.909211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.909215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.909219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.909226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.909234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:11.909241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.909246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:11.909257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.909262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:11.909266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.909271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:11.909276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.909281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:11.909285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.909292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:11.909297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.909305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:11.909311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.909316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:11.909326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.909331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:11.909336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.909344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.909349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.909357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.909362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.909370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.909379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.909385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:11.909393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.909398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:11.909437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:11.919342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:11.920480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:11.920485Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:11.920488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:11.920492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:11.920500Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1314 [2:7556255670586455595:9259]
2025-10-01T14:11:11.920515Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:11.920530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:11.920534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:11.920537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:11.920539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:11.920555Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:11.920560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:11.920565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:11.920625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.920628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.920630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.920633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:11.920636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:11.920717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:11.920721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.920733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:11.920745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:11.920762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:11.920776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255670586455589:9259]
2025-10-01T14:11:11.920780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255670586455589:9259]
2025-10-01T14:11:11.920781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255670586455589:9259]
2025-10-01T14:11:11.920789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:11.920802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:11.920816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:11.920819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:11.920853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255670586455589:9259]
2025-10-01T14:11:11.920855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:11.921106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:11.921112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:11.921114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:11.921119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:11.922426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963335146:2446], now have 1 active actors on pipe
2025-10-01T14:11:11.922438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963335204:4595], now have 1 active actors on pipe
2025-10-01T14:11:11.922464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.922469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.922493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:11.922500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:11.922503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:11.922505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:11.922513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:11.922524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:11.922538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:11.925165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.925174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.925190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:11.921825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1314
2025-10-01T14:11:11.921864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1314
2025-10-01T14:11:11.925366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1315 partition: 0 MaxSeqNo: 45 sessionId: src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0
2025-10-01T14:11:11.927220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f682345d-c07a57e4-ee629129-7e68e652_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:11.930314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0] Write session: try to update token
2025-10-01T14:11:11.930328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:11.958428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255672963335309:4741]
2025-10-01T14:11:11.958903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1314, pipe: [1:7556255672963335309:4741]
2025-10-01T14:11:11.962659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255672963335309:4741], now have 1 active actors on pipe
2025-10-01T14:11:11.962452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1315 sessionId: src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:11.965032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:11.970878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:11.970903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:11.970946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:11.971903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:11.977330Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:11.977349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:11.977353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:11.977355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:11.977365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255670586455589:9259]
2025-10-01T14:11:11.977370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255670586455589:9259]
2025-10-01T14:11:11.977374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255670586455589:9259]
2025-10-01T14:11:11.977428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:11.977435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:11.977437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:11.977579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:11.978236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:11.978243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:11.978247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:12.151577Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:12.164348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.164379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.164564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.164625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.164719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.164783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.164826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.164831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.164910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.164971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.165031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.165098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.165141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.165144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.165212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.165268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.165326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.165381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.165423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.165426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.165488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.165550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.165613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.165678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.165724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.165727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.165792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.165853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.165910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.165968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.166011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.166015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.166084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.166142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.166213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.166284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.166332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.166336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.166628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.166690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.166747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.166812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.166858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.166861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.166932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.166991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.167048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.167111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.167156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.167159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.167230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.167291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.167357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.167422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.167475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.167480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.167554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.167615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.167679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.167741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.167863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.167866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.170446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:12.170455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255672963335309:4741]
2025-10-01T14:11:12.170494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:12.175836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:12.175852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:12.175891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1315 reason: error at write: Disconnected sessionId: src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0
2025-10-01T14:11:12.176086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1315 sessionId: src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0 is DEAD
2025-10-01T14:11:12.178493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:12.178507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0] Write session will restart in 0.005606s
2025-10-01T14:11:12.178537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0] Write session: Do CDS request
2025-10-01T14:11:12.178545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:12.186886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:12.188047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:12.188064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1316
2025-10-01T14:11:12.188259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:12.188290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:12.188295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:12.188299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:12.188729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1316 sessionId:  describe result for acl check
2025-10-01T14:11:12.188757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:12.188758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:12.188762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:12.188769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255677258302622:4584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:12.189425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255677258302622:4584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:12.206355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255677258302622:4584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:12.214968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255677258302622:4584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:12.214988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255677258302622:4584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:12.214991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255677258302622:4584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:12.215000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:12.217137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:12.221115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:12.221383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:12.221387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:12.221400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:12.221457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:12.221497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255674881423057:9272]
2025-10-01T14:11:12.222152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:12.225983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:12.226064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:12.226473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:12.226549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.226550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.226552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.226553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.226555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.226556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.226557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.226558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.226560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.226561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.226562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.226563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.226565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.226567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.226573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.226584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.226587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.226591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.226594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.226599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.226603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.226607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.226611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.226615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.226618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.226622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.226626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.226630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.226638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.226646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.226652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.226657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.226664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.226669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.226673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.226679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.226684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.226690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.226694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.226700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.226705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.226710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.226714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.226720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.226725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.226730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.226735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.226740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.226745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.226750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.226755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.226760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.226765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.226770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.226775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.226783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.226824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:12.235149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:12.236185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:12.236191Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:12.236194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:12.236198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:12.236205Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1315 [2:7556255674881423057:9272]
2025-10-01T14:11:12.236221Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:12.236240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:12.236246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:12.236251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:12.236253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:12.236271Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:12.236277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:12.236284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:12.236345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.236347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.236349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.236352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:12.236354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:12.236431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:12.236433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.236446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.236457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.236472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:12.236489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255674881423052:9272]
2025-10-01T14:11:12.236492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255674881423052:9272]
2025-10-01T14:11:12.236494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255674881423052:9272]
2025-10-01T14:11:12.236508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:12.236523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:12.236539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:12.236542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:12.236581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255674881423052:9272]
2025-10-01T14:11:12.236584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:12.239615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:12.239629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:12.239632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:12.239639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:12.240189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1315
2025-10-01T14:11:12.240224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1315
2025-10-01T14:11:12.246626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255677258302755:4584], now have 1 active actors on pipe
2025-10-01T14:11:12.246644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255677258302613:2446], now have 1 active actors on pipe
2025-10-01T14:11:12.246668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.246678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.246716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:12.246728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:12.246733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:12.246737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:12.246750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:12.246766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:12.246792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:12.250577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.250593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.250629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:12.254459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1316 partition: 0 MaxSeqNo: 45 sessionId: src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0
2025-10-01T14:11:12.258645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8101fbd-62eaf5aa-897cc9c8-8c2aad45_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:12.261163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0] Write session: try to update token
2025-10-01T14:11:12.261184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:12.269795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255677258302766:4741]
2025-10-01T14:11:12.270336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1315, pipe: [1:7556255677258302766:4741]
2025-10-01T14:11:12.270422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255677258302766:4741], now have 1 active actors on pipe
2025-10-01T14:11:12.274361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:12.274396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:12.274399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:12.274401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:12.274411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255674881423052:9272]
2025-10-01T14:11:12.274416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255674881423052:9272]
2025-10-01T14:11:12.274420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255674881423052:9272]
2025-10-01T14:11:12.274480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:12.274491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.274494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:12.274637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:12.277210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:12.277227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:12.277232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:12.289414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1316 sessionId: src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:12.291937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:12.448099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:12.448424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.448434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.449144Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:12.454445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:12.454450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:12.454505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255677258302766:4741]
2025-10-01T14:11:12.454535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1316 reason: status is not ok: tablet will be restarted right now sessionId: src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0
2025-10-01T14:11:12.454736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1316 sessionId: src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0 is DEAD
2025-10-01T14:11:12.458739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:12.458749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0] Write session will restart in 0.009211s
2025-10-01T14:11:12.458776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0] Write session: Do CDS request
2025-10-01T14:11:12.458782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:12.471186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:12.472413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:12.472428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1317
2025-10-01T14:11:12.472700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:12.472727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:12.472733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:12.472737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:12.473169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1317 sessionId:  describe result for acl check
2025-10-01T14:11:12.473197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:12.473198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:12.473200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:12.473205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255677258302797:4579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:12.473675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255677258302797:4579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:12.479121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255677258302797:4579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:12.488620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255677258302797:4579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:12.488645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255677258302797:4579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:12.488648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255677258302797:4579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:12.488658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:12.500867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:12.502867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:12.503063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:12.503066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:12.503077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:12.503121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:12.503156Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255674881423207:9274]
2025-10-01T14:11:12.503905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:12.505677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:12.505740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:12.506063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:12.506123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.506124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.506125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.506126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.506127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.506128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.506130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.506132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.506133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.506133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.506135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.506136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.506137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.506138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.506144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.506154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.506157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.506161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.506165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.506168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.506172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.506175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.506178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.506182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.506185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.506188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.506192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.506195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.506203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.506210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.506216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.506220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.506225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.506230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.506235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.506240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.506245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.506249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.506254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.506258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.506263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.506269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.506273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.506278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.506282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.506287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.506291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.506296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.506301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.506305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.506309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.506314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.506319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.506324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.506328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.506333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.506387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:12.512013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:12.512648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:12.512654Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:12.512657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:12.512660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:12.512667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1316 [2:7556255674881423207:9274]
2025-10-01T14:11:12.512682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:12.512712Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:12.512715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:12.512719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:12.512721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:12.512737Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:12.512742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:12.512751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:12.512807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.512809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.512810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.512814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:12.512816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:12.512888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:12.512890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.512902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.512911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.512924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:12.512940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255674881423202:9274]
2025-10-01T14:11:12.512942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255674881423202:9274]
2025-10-01T14:11:12.512944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255674881423202:9274]
2025-10-01T14:11:12.512957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:12.512971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:12.512983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:12.512986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:12.513020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255674881423202:9274]
2025-10-01T14:11:12.513023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:12.513210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:12.513221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:12.513224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:12.513229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:12.513689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1316
2025-10-01T14:11:12.513729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1316
2025-10-01T14:11:12.513845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255677258302783:2446], now have 1 active actors on pipe
2025-10-01T14:11:12.513855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255677258302855:4579], now have 1 active actors on pipe
2025-10-01T14:11:12.513876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.513886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.513916Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:12.513929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:12.513934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:12.513936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:12.513945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:12.513955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:12.513973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:12.514178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.514184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.514197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:12.514695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24dfecd9-f8c0321f-c7e6f3f1-2a1a1c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:12.514327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1317 partition: 0 MaxSeqNo: 45 sessionId: src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0
2025-10-01T14:11:12.516900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0] Write session: try to update token
2025-10-01T14:11:12.516916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:12.535532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1317 sessionId: src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:12.537945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:12.540671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.540701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.540741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:12.541245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:12.554330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255677258302935:4741]
2025-10-01T14:11:12.555214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255677258302935:4741], now have 1 active actors on pipe
2025-10-01T14:11:12.556560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1316, pipe: [1:7556255677258302935:4741]
2025-10-01T14:11:12.556984Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:12.556998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:12.557002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:12.557004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:12.557012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255674881423202:9274]
2025-10-01T14:11:12.557017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255674881423202:9274]
2025-10-01T14:11:12.557021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255674881423202:9274]
2025-10-01T14:11:12.557069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:12.557072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:12.557079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:12.557081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.557083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:12.557084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:12.557229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:12.729704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:12.737675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.737703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.737870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.737923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.737981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.738034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.738497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.738509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.738580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.738634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.738695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.738754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.738794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.738797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.738865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.738922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.738981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.739044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.739084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.739086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.739157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.739218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.739278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.739337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.739378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.739380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.739450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.739506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.739564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.739623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.739665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.739667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.739731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.739787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.739844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.739902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.739943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.739946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.740019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.741804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:12.741852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:12.741854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:12.741873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1317 reason: error at write: Disconnected sessionId: src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0
2025-10-01T14:11:12.740079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.740151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.740209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.740253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.740256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.740320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.740374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.740432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.740537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.740577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.740579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.740644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.740714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.740772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.740830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.740871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.740874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.740944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.741005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.741066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.741129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.741173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.741176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.741854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:12.742442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1317 sessionId: src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0 is DEAD
2025-10-01T14:11:12.742562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255677258302935:4741]
2025-10-01T14:11:12.742740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:12.742750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0] Write session will restart in 0.005445s
2025-10-01T14:11:12.742774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0] Write session: Do CDS request
2025-10-01T14:11:12.742779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:12.751194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:12.751311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:12.751323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1318
2025-10-01T14:11:12.752951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:12.752995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:12.753003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:12.753006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:12.753341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1318 sessionId:  describe result for acl check
2025-10-01T14:11:12.753368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:12.753369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:12.753370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:12.753373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255677258302978:4556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:12.753847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255677258302978:4556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:12.759911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255677258302978:4556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:12.763861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255677258302978:4556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:12.763873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255677258302978:4556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:12.763876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255677258302978:4556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:12.763884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:12.765835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:12.768187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:12.768403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:12.768416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:12.768428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:12.768477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:12.768520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255674881423364:9279]
2025-10-01T14:11:12.769130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:12.769420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:12.769466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:12.769763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:12.769821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.769822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.769823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.769825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.769826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.769827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.769828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.769830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.769831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.769832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.769834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.769835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.769836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.769838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.769843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.769853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.769857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.769861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.769865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.769869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.769873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.769877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.769881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.769885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.769889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.769893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.769897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.769900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.769909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.769916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:12.769923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.769929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:12.769935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.769940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:12.769944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.769949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:12.769954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.769959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:12.769963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.769968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:12.769973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.769979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:12.769983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.769988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:12.769992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.769997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:12.770002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.770007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.770012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.770017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.770021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.770026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.770031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.770036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:12.770040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.770045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:12.770083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:12.776401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:12.777014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:12.777040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:12.777043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:12.777046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:12.777053Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1317 [2:7556255674881423364:9279]
2025-10-01T14:11:12.777068Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:12.777088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:12.777097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:12.777100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:12.777102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:12.777119Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:12.777129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:12.777136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:12.777193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.777201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.777203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.777206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:12.777209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:12.777278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:12.777286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.777298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:12.777312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:12.777330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:12.777350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255674881423359:9279]
2025-10-01T14:11:12.777356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255674881423359:9279]
2025-10-01T14:11:12.777359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255674881423359:9279]
2025-10-01T14:11:12.777368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:12.777385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:12.777403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:12.777409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:12.777447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255674881423359:9279]
2025-10-01T14:11:12.777453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:12.777583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:12.777589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:12.777592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:12.777597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:12.778078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1317
2025-10-01T14:11:12.778104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1317
2025-10-01T14:11:12.778286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255677258303106:4556], now have 1 active actors on pipe
2025-10-01T14:11:12.778296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255677258302964:2446], now have 1 active actors on pipe
2025-10-01T14:11:12.778308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.778313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.778336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:12.778347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:12.778351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:12.778355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:12.778363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:12.778386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:12.778404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:12.778639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.778647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.778659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:12.778741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1318 partition: 0 MaxSeqNo: 45 sessionId: src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0
2025-10-01T14:11:12.779185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72232e21-ccae504b-26f424ec-c1f5f4bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:12.781958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0] Write session: try to update token
2025-10-01T14:11:12.781974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:12.796786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:12.796802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:12.796811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255674881423359:9279]
2025-10-01T14:11:12.796852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:12.796855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:12.797010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:12.797143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:12.797272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:12.797392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:12.797555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:12.797581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:12.796460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1318 sessionId: src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:12.798732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:12.799190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.799207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.799239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:12.799314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:12.831180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:12.831206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:12.831356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.831417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.831479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.831536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.831574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.831578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.831642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.831693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.831747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.831805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.831851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.831853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.831913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.831969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.832023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.832076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.832112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.832115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.832176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.832234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.832289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.832348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.832383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.832386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.832446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.832500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.832550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.832600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.832635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.832638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.832704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.832749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.832796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.832847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.832900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.832903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.832961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.833006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.833059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.833111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.833200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.833203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.833259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.833303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.833352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.833403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.833440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.833442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.833494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.833539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.833585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.833630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.833663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.833666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.833726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:12.833773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:12.833819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:12.833866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:12.833901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:12.833903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:12.833965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:11:12.834025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:12.834044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:12.834046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:11:12.834065Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.834073Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.834077Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.834081Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.834084Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.834088Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.834092Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.834095Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.834099Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.834104Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836051Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836061Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836066Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836069Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836073Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836356Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836361Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836365Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836369Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836373Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836376Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836380Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836383Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836387Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836390Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836540Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836544Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836549Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836552Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836556Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836560Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836649Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836653Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836658Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836661Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:11:12.836685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:11:12.836705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:11:12.836708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:11:12.836711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:11:12.836714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:11:12.837099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:11:12.837113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:11:12.837118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:11:12.837120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:11:12.837124Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:11:12.837127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:11:12.837583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:11:12.837595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:11:12.837599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:11:12.837602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:11:12.837605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:11:12.837608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:11:12.838053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:11:12.838064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:12.838165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327872836
2025-10-01T14:11:12.838932Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:11:12.838945Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:11:12.840751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:12.840754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:12.840755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:12.840757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:12.840765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255674881423359:9279]
2025-10-01T14:11:12.840768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255674881423359:9279]
2025-10-01T14:11:12.840775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255674881423359:9279]
2025-10-01T14:11:12.840814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:12.840819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:12.840822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:12.841704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:12.841716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:12.841719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:12.841842Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:12.842536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255677258303123:4741]
2025-10-01T14:11:12.843131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1317, pipe: [1:7556255677258303123:4741]
2025-10-01T14:11:13.026405Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:13.026825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255677258303123:4741], now have 1 active actors on pipe
2025-10-01T14:11:13.027294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:13.031401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255677258303123:4741]
2025-10-01T14:11:13.031432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:13.031467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1318 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0
2025-10-01T14:11:13.031675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1318 sessionId: src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0 is DEAD
2025-10-01T14:11:13.031786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:13.034462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:13.034475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0] Write session will restart in 0.007357s
2025-10-01T14:11:13.034503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0] Write session: Do CDS request
2025-10-01T14:11:13.034511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:13.043442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:13.043790Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:13.043804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1319
2025-10-01T14:11:13.044116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:13.044145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:13.044150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:13.044154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:13.050804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1319 sessionId:  describe result for acl check
2025-10-01T14:11:13.050839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:13.050840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:13.050842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:13.050846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255681553270448:4552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:13.051328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255681553270448:4552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:13.063994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255681553270448:4552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:13.067693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255681553270448:4552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:13.067703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255681553270448:4552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:13.067705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255681553270448:4552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:13.067712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:13.087669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:13.093002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:13.093224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:13.093228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:13.093240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:13.093295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:13.093330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255679176390856:9293]
2025-10-01T14:11:13.093919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:13.100810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:13.100868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:13.101210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:13.101257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.101258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.101259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.101260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.101261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.101262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.101263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.101265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.101266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.101267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.101269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.101270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.101271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.101272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.101277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.101287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.101290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.101294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.101296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.101300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.101304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.101308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.101312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.101316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.101318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.101321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.101324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.101328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.101336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.101343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.101348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.101354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.101357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.101362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.101365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.101369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.101373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.101378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.101381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.101385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.101389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.101394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.101397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.101401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.101408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.101413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.101419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.101424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.101428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.101432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.101435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.101440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.101444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.101449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.101452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.101455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.101485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:13.115771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:13.116622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:13.116627Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:13.116630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:13.116633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:13.116639Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1318 [2:7556255679176390856:9293]
2025-10-01T14:11:13.116655Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:13.116669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:13.116672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:13.116675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:13.116677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:13.116701Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:13.116706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:13.116711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:13.116763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.116765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.116766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.116769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:13.116771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:13.116838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:13.116840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.116850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.116859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.116875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:13.116890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255679176390850:9293]
2025-10-01T14:11:13.116892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255679176390850:9293]
2025-10-01T14:11:13.116893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255679176390850:9293]
2025-10-01T14:11:13.116907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:13.116919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:13.116933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:13.116935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:13.116963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255679176390850:9293]
2025-10-01T14:11:13.116965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:13.117591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:13.117593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:13.117596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:13.117600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:13.118258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270547:4552], now have 1 active actors on pipe
2025-10-01T14:11:13.118262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270439:2446], now have 1 active actors on pipe
2025-10-01T14:11:13.118580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1318
2025-10-01T14:11:13.118610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1318
2025-10-01T14:11:13.118817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.118826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.118852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:13.118859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:13.118863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:13.118865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:13.118873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:13.118883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:13.118897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:13.119121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.119123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.119133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:13.119297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1319 partition: 0 MaxSeqNo: 45 sessionId: src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0
2025-10-01T14:11:13.121111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b697fb6-e93f8442-3d01e7cc-2b00e34b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:13.124150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0] Write session: try to update token
2025-10-01T14:11:13.124166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:13.134402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255681553270591:4741]
2025-10-01T14:11:13.137707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270591:4741], now have 1 active actors on pipe
2025-10-01T14:11:13.137818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1318, pipe: [1:7556255681553270591:4741]
2025-10-01T14:11:13.158001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1319 sessionId: src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:13.160713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:13.161036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.161051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.161082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:13.168626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:13.168641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:13.168643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:13.168647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:13.168656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255679176390850:9293]
2025-10-01T14:11:13.168661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255679176390850:9293]
2025-10-01T14:11:13.168665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255679176390850:9293]
2025-10-01T14:11:13.168717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:13.168723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.168726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:13.168867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:13.166613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:13.169928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:13.169940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:13.169944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:13.313368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:13.320896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.320920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.321080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.321134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.321195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.321253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.321296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.321301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.321370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.321426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.321487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.321542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.321580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.321582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.321636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.321679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.321731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.321777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.321810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.321811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.321860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.321905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.321950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.321995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.322029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.322031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.322080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.322124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.322169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.322214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.322248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.322250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.322303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.322350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.322435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.322499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.322540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.322543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.322611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.322661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.322720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.322775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.322813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.322816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.322876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.322926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.322976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.323032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.323074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.323078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.323144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.323214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.323268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.323322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.324993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:13.325003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0] Write session will restart in 0.005325s
2025-10-01T14:11:13.325027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0] Write session: Do CDS request
2025-10-01T14:11:13.325034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:13.323365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.323380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.323439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.324413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:13.323488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.323538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.324426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:13.323590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.323629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.324459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1319 reason: error at write: Disconnected sessionId: src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0
2025-10-01T14:11:13.323632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.324652Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:13.324634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1319 sessionId: src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0 is DEAD
2025-10-01T14:11:13.324758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:13.324787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255681553270591:4741]
2025-10-01T14:11:13.334827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:13.334981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:13.335000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1320
2025-10-01T14:11:13.335263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:13.335292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:13.335297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:13.335302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:13.336132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1320 sessionId:  describe result for acl check
2025-10-01T14:11:13.336172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:13.336173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:13.336175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:13.336180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255681553270611:4545] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:13.336632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255681553270611:4545] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:13.346140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255681553270611:4545] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:13.363404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255681553270611:4545] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:13.363429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255681553270611:4545] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:13.363432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255681553270611:4545] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:13.363441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:13.366259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:13.369069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:13.369311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:13.369316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:13.369328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:13.369377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:13.369416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255679176391006:9295]
2025-10-01T14:11:13.369985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:13.370404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:13.370443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:13.370833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:13.370891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.370893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.370894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.370895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.370897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.370898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.370899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.370900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.370901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.370903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.370904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.370905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.370906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.370907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.370912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.370923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.370927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.370931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.370935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.370938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.370942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.370945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.370949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.370954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.370958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.370962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.370966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.370969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.370976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.370984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.370990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.370996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.371000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.371005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.371009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.371015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.371019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.371024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.371028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.371033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.371039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.371044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.371048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.371053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.371059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.371064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.371068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.371073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.371078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.371084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.371088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.371093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.371097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.371102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.371106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.371112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.371148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:13.379302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:13.380188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:13.380195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:13.380198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:13.380201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:13.380208Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1319 [2:7556255679176391006:9295]
2025-10-01T14:11:13.380224Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:13.380239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:13.380243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:13.380246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:13.380249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:13.380268Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:13.380274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:13.380280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:13.380337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.380340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.380342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.380345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:13.380348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:13.380408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:13.380411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.380423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.380434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.380449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:13.380465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255679176391000:9295]
2025-10-01T14:11:13.380467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255679176391000:9295]
2025-10-01T14:11:13.380470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255679176391000:9295]
2025-10-01T14:11:13.380479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:13.380495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:13.380510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:13.380513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:13.380545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255679176391000:9295]
2025-10-01T14:11:13.380547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:13.380790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:13.380797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:13.380799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:13.380805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:13.381205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1319
2025-10-01T14:11:13.381235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1319
2025-10-01T14:11:13.381206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270743:4545], now have 1 active actors on pipe
2025-10-01T14:11:13.381217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270596:2446], now have 1 active actors on pipe
2025-10-01T14:11:13.381836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.381842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.381871Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:13.381881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:13.381885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:13.381888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:13.381898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:13.381909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:13.381926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:13.382399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.382407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.382426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:13.382584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1320 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0
2025-10-01T14:11:13.383068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bf8d1f6-f38ce1c0-e651e846-ca5ed1c1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:13.390885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0] Write session: try to update token
2025-10-01T14:11:13.390908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:13.396789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:13.396801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:13.396810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255679176391000:9295]
2025-10-01T14:11:13.396841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:13.396979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:13.397095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:13.397362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:13.397475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:13.397626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:13.397654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:13.397895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:13.411590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1320 sessionId: src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:13.413860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:13.414174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.414191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.414224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:13.418614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:13.424175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255681553270762:4741]
2025-10-01T14:11:13.424621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1319, pipe: [1:7556255681553270762:4741]
2025-10-01T14:11:13.424352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:13.424369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:13.424372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:13.424374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:13.424383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255679176391000:9295]
2025-10-01T14:11:13.424388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255679176391000:9295]
2025-10-01T14:11:13.424392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255679176391000:9295]
2025-10-01T14:11:13.424433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:13.424443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.424445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:13.424452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:13.424457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:13.424464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:13.424565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:13.600880Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:13.601278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270762:4741], now have 1 active actors on pipe
2025-10-01T14:11:13.608016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.608037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.608191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.608247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.608304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.608363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.608407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.608415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.608476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.608531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.608585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.608650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.608702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.608709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.608764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.608813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.608865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.608918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.608956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.608965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.609020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.609076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.609126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.609178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.609217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.609223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.609277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.609328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.609381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.609438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.609477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.609485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.609542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.609600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.609654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.609774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.609898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.609905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.610285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.611894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:13.611935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255681553270762:4741]
2025-10-01T14:11:13.611942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:13.611945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:13.611971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1320 reason: error at write: Disconnected sessionId: src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0
2025-10-01T14:11:13.612141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1320 sessionId: src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0 is DEAD
2025-10-01T14:11:13.612555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:13.612565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0] Write session will restart in 0.006362s
2025-10-01T14:11:13.612593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0] Write session: Do CDS request
2025-10-01T14:11:13.612598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:13.610677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.610734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.610785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.610818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.610821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.610878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.610927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.610975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.611024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.611132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.611135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.611190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.611235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.611282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.611330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.611365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.611367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.611419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.611463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.611509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.611562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.611656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.611659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.612336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:13.619915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:13.620009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:13.620021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1321
2025-10-01T14:11:13.620119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:13.620143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:13.620148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:13.620151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:13.620466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1321 sessionId:  describe result for acl check
2025-10-01T14:11:13.620488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:13.620490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:13.620491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:13.620496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255681553270776:4540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:13.621324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255681553270776:4540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:13.623673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255681553270776:4540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:13.628850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255681553270776:4540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:13.628863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255681553270776:4540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:13.628866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255681553270776:4540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:13.628874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:13.631641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:13.637040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:13.637312Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:13.637316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:13.637327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:13.637392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:13.637477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255679176391161:9298]
2025-10-01T14:11:13.637995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:13.638804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:13.639218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:13.639558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:13.639611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.639616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.639617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.639619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.639620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.639621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.639622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.639624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.639625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.639626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.639627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.639628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.639630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.639631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.639636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.639645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.639649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.639652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.639656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.639660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.639663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.639667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.639670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.639674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.639678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.639681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.639684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.639688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.639696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.639703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.639714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.639720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.639728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.639733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.639737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.639742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.639746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.639751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.639758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.639763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.639767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.639772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.639777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.639781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.639786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.639790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.639794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.639801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.639805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.639810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.639818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.639823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.639827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.639835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.639839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.639844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.639900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:13.646861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1320
2025-10-01T14:11:13.646910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1320
2025-10-01T14:11:13.645597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:13.646524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:13.646530Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:13.646532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:13.646536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:13.646544Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1320 [2:7556255679176391161:9298]
2025-10-01T14:11:13.646559Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:13.646575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:13.646579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:13.646582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:13.646585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:13.646603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:13.646609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:13.646615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:13.646679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.646680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.646684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.646688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:13.646690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:13.646769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:13.646771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.646784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.646795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.646811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:13.646830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270765:2446], now have 1 active actors on pipe
2025-10-01T14:11:13.646833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270922:4540], now have 1 active actors on pipe
2025-10-01T14:11:13.646840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255679176391155:9298]
2025-10-01T14:11:13.646843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255679176391155:9298]
2025-10-01T14:11:13.646845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255679176391155:9298]
2025-10-01T14:11:13.646859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:13.646872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:13.646875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:13.646878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:13.646880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:13.646886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:13.646889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:13.646933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255679176391155:9298]
2025-10-01T14:11:13.646936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:13.646944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:13.646962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.646968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.646999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:13.647005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:13.647009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:13.647012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:13.647021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:13.647031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:13.647049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:13.647156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.647161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.647179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:13.647321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1321 partition: 0 MaxSeqNo: 45 sessionId: src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0
2025-10-01T14:11:13.647671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a2f3e05-ab462b3f-26ee5467-6098ac4f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:13.649887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0] Write session: try to update token
2025-10-01T14:11:13.649901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:13.664798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1321 sessionId: src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:13.667105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:13.667272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.667289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.667323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:13.667416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:13.670724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:13.670740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:13.670742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:13.670743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:13.670751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255679176391155:9298]
2025-10-01T14:11:13.670754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255679176391155:9298]
2025-10-01T14:11:13.670757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255679176391155:9298]
2025-10-01T14:11:13.670793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:13.670799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:13.670804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.670806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:13.670806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:13.670810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:13.670923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:13.711204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255681553270946:4741]
2025-10-01T14:11:13.714217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1320, pipe: [1:7556255681553270946:4741]
2025-10-01T14:11:13.841260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:13.850767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.850792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.850980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.851042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.851108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.851173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.851215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.851220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.851291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.851384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.851472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.851570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.851612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.851615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.851712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.851797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.851852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.851911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.851948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.851953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.852042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.852103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.852163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.852225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.852268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.852272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.852344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.852414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.852484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.852553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.852596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.852599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.852671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.852748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.852817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.852885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.852933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.852935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.853009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.853124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.853196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.853266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.853334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.853337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.853413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.853477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.853541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.853608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.853671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.853676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.853747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.853816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.853885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.853955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.854002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.854004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.854080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:13.854150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:13.854222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:13.854294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:13.854356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:13.854358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:13.854768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270946:4741], now have 1 active actors on pipe
2025-10-01T14:11:13.855786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:13.855828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:13.855893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255681553270946:4741]
2025-10-01T14:11:13.855917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:13.855920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:13.855948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1321 reason: error at write: Disconnected sessionId: src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0
2025-10-01T14:11:13.856235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1321 sessionId: src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0 is DEAD
2025-10-01T14:11:13.857258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:13.857270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0] Write session will restart in 0.005895s
2025-10-01T14:11:13.857296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0] Write session: Do CDS request
2025-10-01T14:11:13.857302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:13.865465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:13.866485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:13.866497Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1322
2025-10-01T14:11:13.866671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:13.866701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:13.866706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:13.866708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:13.867228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1322 sessionId:  describe result for acl check
2025-10-01T14:11:13.867249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:13.867251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:13.867253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:13.867258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255681553270973:4525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:13.867799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255681553270973:4525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:13.871772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255681553270973:4525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:13.876356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255681553270973:4525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:13.876372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255681553270973:4525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:13.876375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255681553270973:4525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:13.877008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:13.887387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:13.889946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:13.890206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:13.890217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:13.890229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:13.890281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:13.890321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255679176391333:9303]
2025-10-01T14:11:13.891184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:13.893034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:13.893086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:13.893541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:13.893613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.893619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.893620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.893622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.893624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.893625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.893627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.893628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.893629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.893631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.893632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.893634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.893635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.893636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.893643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.893654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.893658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.893662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.893666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.893670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.893674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.893678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.893682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.893687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.893695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.893702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.893710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.893714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.893728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.893739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:13.893750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.893760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:13.893768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.893775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:13.893787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.893792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:13.893797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.893803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:13.893808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.893814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:13.893819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.893825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:13.893830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.893840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:13.893846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.893853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:13.893858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.893865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.893870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.893875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.893885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.893892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.893901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.893907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:13.893913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.893923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:13.893964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:13.905577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:13.906429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:13.906443Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:13.906446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:13.906450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:13.906458Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1321 [2:7556255679176391333:9303]
2025-10-01T14:11:13.906476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:13.906501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:13.906508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:13.906511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:13.906514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:13.906530Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:13.906541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:13.906547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:13.906635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.906642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.906644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.906647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:13.906650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:13.906720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:13.906727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.906739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:13.906750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:13.906770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:13.907218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255679176391327:9303]
2025-10-01T14:11:13.907226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255679176391327:9303]
2025-10-01T14:11:13.907229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255679176391327:9303]
2025-10-01T14:11:13.907831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1321
2025-10-01T14:11:13.907858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1321
2025-10-01T14:11:13.907244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:13.907265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:13.907283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:13.907287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:13.907293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:13.907296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:13.907299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:13.907328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255679176391327:9303]
2025-10-01T14:11:13.907330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:13.907377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:13.907636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553271037:4525], now have 1 active actors on pipe
2025-10-01T14:11:13.907641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553270951:2446], now have 1 active actors on pipe
2025-10-01T14:11:13.908253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.908269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.908301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6616bd33-a63eed21-16320978-5f9b10b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:13.908314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:13.908320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:13.908323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:13.908333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:13.908346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:13.908366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:13.908548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:13.908557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:13.908574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:13.909122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81e4ab81-fbd128a8-1a6714b5-776fc4ed_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6616bd33-a63eed21-16320978-5f9b10b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:13.911814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6616bd33-a63eed21-16320978-5f9b10b_0] Write session: try to update token
2025-10-01T14:11:13.911832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6616bd33-a63eed21-16320978-5f9b10b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:13.908680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1322 partition: 0 MaxSeqNo: 45 sessionId: src_id|6616bd33-a63eed21-16320978-5f9b10b_0
2025-10-01T14:11:13.947483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:13.947502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:13.947505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:13.947507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:13.947518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255679176391327:9303]
2025-10-01T14:11:13.947523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255679176391327:9303]
2025-10-01T14:11:13.947528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255679176391327:9303]
2025-10-01T14:11:13.947576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:13.947583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:13.947585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:13.947745Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:13.948356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:13.948368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:13.948372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:13.956938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255681553271121:4741]
2025-10-01T14:11:13.957385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1321, pipe: [1:7556255681553271121:4741]
2025-10-01T14:11:13.963492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1322 sessionId: src_id|6616bd33-a63eed21-16320978-5f9b10b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:13.966126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:14.114200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:14.114503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255681553271121:4741], now have 1 active actors on pipe
2025-10-01T14:11:14.114552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.114558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.115165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:14.116147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6616bd33-a63eed21-16320978-5f9b10b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:14.116158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6616bd33-a63eed21-16320978-5f9b10b_0] Write session will restart in 0.005434s
2025-10-01T14:11:14.116181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6616bd33-a63eed21-16320978-5f9b10b_0] Write session: Do CDS request
2025-10-01T14:11:14.116187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6616bd33-a63eed21-16320978-5f9b10b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:14.115713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:14.115786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1322 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6616bd33-a63eed21-16320978-5f9b10b_0
2025-10-01T14:11:14.115969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1322 sessionId: src_id|6616bd33-a63eed21-16320978-5f9b10b_0 is DEAD
2025-10-01T14:11:14.116084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255681553271121:4741]
2025-10-01T14:11:14.116096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:14.125124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6616bd33-a63eed21-16320978-5f9b10b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:14.125950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:14.125967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1323
2025-10-01T14:11:14.126301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:14.126332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:14.126338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:14.126342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:14.126942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1323 sessionId:  describe result for acl check
2025-10-01T14:11:14.126969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:14.126971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:14.126973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:14.126979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255685848238442:4517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:14.127511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255685848238442:4517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:14.145473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255685848238442:4517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:14.155006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255685848238442:4517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:14.155022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255685848238442:4517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:14.155025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255685848238442:4517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:14.155039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:14.171338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:14.174507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:14.174732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:14.174744Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:14.174757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:14.174834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:14.174876Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255683471358814:9316]
2025-10-01T14:11:14.175452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:14.175788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:14.175833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:14.176111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:14.176205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.176210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.176212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.176213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.176214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.176216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.176217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.176219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.176220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.176221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.176223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.176224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.176226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.176227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.176232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.176243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.176247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.176252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.176256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.176262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.176266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.176269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.176272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.176277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.176282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.176287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.176291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.176295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.176303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.176311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.176318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.176324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.176331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.176337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.176342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.176347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.176352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.176358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.176363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.176370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.176375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.176379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.176384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.176389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.176393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.176398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.176402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.176406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.176410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.176415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.176419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.176424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.176428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.176432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.176436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.176441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.176476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:14.185413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:14.185985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:14.185990Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:14.185991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:14.185994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:14.186000Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1322 [2:7556255683471358814:9316]
2025-10-01T14:11:14.186012Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:14.186025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:14.186027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:14.186031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:14.186032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:14.186045Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:14.186050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:14.186054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:14.186095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.186097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.186099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.186102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:14.186104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:14.186163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:14.186166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.186177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.186187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.186201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:14.186215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255683471358809:9316]
2025-10-01T14:11:14.186217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255683471358809:9316]
2025-10-01T14:11:14.186219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255683471358809:9316]
2025-10-01T14:11:14.186228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:14.186238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:14.186246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:14.186249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:14.186274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255683471358809:9316]
2025-10-01T14:11:14.186276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:14.186438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:14.186440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:14.186442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:14.186447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:14.186626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238435:2446], now have 1 active actors on pipe
2025-10-01T14:11:14.186635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238481:4517], now have 1 active actors on pipe
2025-10-01T14:11:14.186809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1322
2025-10-01T14:11:14.186851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1322
2025-10-01T14:11:14.186959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.186971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.186994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:14.187003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:14.187006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:14.187008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:14.187015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:14.187023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:14.187033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:14.189768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.189784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.189803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:14.189911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1323 partition: 0 MaxSeqNo: 45 sessionId: src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0
2025-10-01T14:11:14.194866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6616bd33-a63eed21-16320978-5f9b10b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:14.197129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0] Write session: try to update token
2025-10-01T14:11:14.197147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:14.211972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:14.211990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:14.212001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255683471358809:9316]
2025-10-01T14:11:14.212047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:14.212203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:14.212346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:14.212487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:14.212631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:14.212643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:14.212912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:14.212953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:14.218495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255685848238593:4741]
2025-10-01T14:11:14.221010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1323 sessionId: src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:14.223195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:14.224004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1322, pipe: [1:7556255685848238593:4741]
2025-10-01T14:11:14.225220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.225238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.225260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238593:4741], now have 1 active actors on pipe
2025-10-01T14:11:14.225286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:14.226904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:14.243544Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:14.243565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:14.243568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:14.243570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:14.243580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255683471358809:9316]
2025-10-01T14:11:14.243584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255683471358809:9316]
2025-10-01T14:11:14.243588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255683471358809:9316]
2025-10-01T14:11:14.243638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:14.243645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.243648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:14.243794Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:14.243987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:14.243992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:14.243996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:14.390617Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:14.398583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.398604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.398779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.398834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.398891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.398950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.399319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.399324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.399389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.399437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.399494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.399560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.399597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.399601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.399661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.399710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.399760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.399812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.399848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.399852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.399908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.399962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.400013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.400061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.400152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.400155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.400213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.400261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.400313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.400368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.400420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.400422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.400480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.400528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.400580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.400634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.400680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.400683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.400748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.400801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.400857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.402274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:14.402282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:14.402287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:14.402316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1323 reason: error at write: Disconnected sessionId: src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0
2025-10-01T14:11:14.402328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255685848238593:4741]
2025-10-01T14:11:14.400911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.400948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.400951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.401009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.401064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.401117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.401174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.401214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.401217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.401279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.401333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.401420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.401478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.401520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.401523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.401584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.401639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.401691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.401830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.401943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.401946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.402546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1323 sessionId: src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0 is DEAD
2025-10-01T14:11:14.402930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:14.402943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0] Write session will restart in 0.005424s
2025-10-01T14:11:14.402968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0] Write session: Do CDS request
2025-10-01T14:11:14.402975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:14.403004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:14.411673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:14.411752Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:14.411766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1324
2025-10-01T14:11:14.411869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:14.411898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:14.411904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:14.411908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:14.412272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1324 sessionId:  describe result for acl check
2025-10-01T14:11:14.412293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:14.412294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:14.412296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:14.412299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255685848238613:4508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:14.412674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255685848238613:4508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:14.414842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255685848238613:4508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:14.419293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255685848238613:4508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:14.419308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255685848238613:4508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:14.419311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255685848238613:4508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:14.419318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:14.444448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:14.449847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:14.450084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:14.450088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:14.450098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:14.450154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:14.450195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255683471358970:9318]
2025-10-01T14:11:14.450845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:14.452677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:14.452744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:14.453101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:14.453162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.453163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.453164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.453166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.453167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.453168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.453169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.453171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.453172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.453173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.453175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.453176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.453178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.453179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.453184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.453193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.453197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.453201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.453204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.453208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.453211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.453215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.453219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.453223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.453226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.453230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.453233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.453237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.453247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.453254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.453260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.453265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.453269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.453274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.453278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.453283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.453287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.453292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.453297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.453302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.453307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.453311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.453315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.453320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.453325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.453331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.453335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.453340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.453345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.453350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.453353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.453358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.453364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.453369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.453374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.453379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.453494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:14.459966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:14.461001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:14.461007Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:14.461010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:14.461015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:14.461022Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1323 [2:7556255683471358970:9318]
2025-10-01T14:11:14.461038Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:14.461054Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:14.461058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:14.461061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:14.461063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:14.461078Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:14.461086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:14.461092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:14.461151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.461154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.461157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.461160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:14.461163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:14.461235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:14.461238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.461249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.461259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.461272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:14.461290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255683471358964:9318]
2025-10-01T14:11:14.461292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255683471358964:9318]
2025-10-01T14:11:14.461294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255683471358964:9318]
2025-10-01T14:11:14.461311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:14.461324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:14.461342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:14.461346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:14.461378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255683471358964:9318]
2025-10-01T14:11:14.461381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:14.461604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:14.461609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:14.461611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:14.461616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:14.461836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238669:4508], now have 1 active actors on pipe
2025-10-01T14:11:14.461847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238602:2446], now have 1 active actors on pipe
2025-10-01T14:11:14.462082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1323
2025-10-01T14:11:14.462114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1323
2025-10-01T14:11:14.462356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.462388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.462424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:14.462433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:14.462438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:14.462441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:14.462453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:14.462467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:14.462487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:14.462753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.462762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.462784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:14.462931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1324 partition: 0 MaxSeqNo: 45 sessionId: src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0
2025-10-01T14:11:14.466688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e30ca9d0-6e15e829-1c9bc99c-1205a130_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:14.469220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0] Write session: try to update token
2025-10-01T14:11:14.469241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:14.483920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1324 sessionId: src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:14.486110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:14.487840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.487868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.487907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:14.488307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:14.502771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255685848238765:4741]
2025-10-01T14:11:14.503104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1323, pipe: [1:7556255685848238765:4741]
2025-10-01T14:11:14.506576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238765:4741], now have 1 active actors on pipe
2025-10-01T14:11:14.508425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:14.508441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:14.508444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:14.508446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:14.508455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255683471358964:9318]
2025-10-01T14:11:14.508459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255683471358964:9318]
2025-10-01T14:11:14.508463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255683471358964:9318]
2025-10-01T14:11:14.508521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:14.508529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.508531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:14.508656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:14.508684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:14.508701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:14.508706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:14.662172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:14.669713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.669743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.669916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.669974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.670035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.670093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.670132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.670139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.670208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.670272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.670327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.670484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.670722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.670726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.670786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.670839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.670898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.670952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.670990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.670994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.671150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.671209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.671265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.671324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.671360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.671363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.671422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.671474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.671529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.671587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.671625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.671628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.671689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.671743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.671803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.671860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.671899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.671905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.671967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.672021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.672082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.672139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.672288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.672293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.672356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.672407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.672462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.672518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.672556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.672559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.672623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.672678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.672747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.672809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.672925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.672928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.672996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.673054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.673114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.673168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.673205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.673208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.675248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:14.675962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255685848238765:4741]
2025-10-01T14:11:14.676004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:14.677047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:14.677060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0] Write session will restart in 0.007404s
2025-10-01T14:11:14.677083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0] Write session: Do CDS request
2025-10-01T14:11:14.677089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:14.676051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1324 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0
2025-10-01T14:11:14.676228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1324 sessionId: src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0 is DEAD
2025-10-01T14:11:14.676384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:14.689483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:14.689545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:14.689565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1325
2025-10-01T14:11:14.689714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:14.689746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:14.689751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:14.689755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:14.690270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1325 sessionId:  describe result for acl check
2025-10-01T14:11:14.690297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:14.690299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:14.690301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:14.690307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255685848238790:4488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:14.690819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255685848238790:4488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:14.695610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255685848238790:4488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:14.709832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255685848238790:4488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:14.709852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255685848238790:4488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:14.709855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255685848238790:4488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:14.709865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:14.724968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:14.726651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:14.727050Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:14.727057Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:14.727069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:14.727128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:14.727175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255683471359134:9321]
2025-10-01T14:11:14.727833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:14.728321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:14.728363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:14.728684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:14.728745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.728746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.728748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.728749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.728751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.728752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.728754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.728755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.728756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.728757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.728758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.728760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.728761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.728762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.728768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.728779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.728783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.728787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.728790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.728794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.728797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.728801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.728805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.728809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.728812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.728816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.728820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.728824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.728830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.728837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:14.728843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.728848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:14.728853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.728858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:14.728863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.728868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:14.728873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.728878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:14.728883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.728888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:14.728893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.728899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:14.728903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.728908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:14.728912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.728917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:14.728924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.728929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.728933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.728939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.728943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.728948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.728953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.728958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:14.728963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.728968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:14.729011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:14.734081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:14.735358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1324
2025-10-01T14:11:14.735402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1324
2025-10-01T14:11:14.735729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1325 partition: 0 MaxSeqNo: 45 sessionId: src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0
2025-10-01T14:11:14.734767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:14.734787Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:14.734789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:14.734793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:14.734810Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1324 [2:7556255683471359134:9321]
2025-10-01T14:11:14.734825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:14.734845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:14.734848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:14.734852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:14.734854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:14.734871Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:14.734876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:14.734884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:14.734945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.734947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.734949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.734951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:14.734954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:14.735025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:14.735027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.735041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:14.735051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:14.735068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:14.735083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255683471359129:9321]
2025-10-01T14:11:14.735086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255683471359129:9321]
2025-10-01T14:11:14.735088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255683471359129:9321]
2025-10-01T14:11:14.735104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:14.735116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:14.735130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:14.735132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:14.735158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:14.735161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:14.735164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:14.735167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255683471359129:9321]
2025-10-01T14:11:14.735170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:14.735231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:14.735293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238774:2446], now have 1 active actors on pipe
2025-10-01T14:11:14.735298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238895:4488], now have 1 active actors on pipe
2025-10-01T14:11:14.735454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.735460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.735488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:14.735497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:14.735501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:14.735503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:14.735513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:14.735524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:14.735540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:14.735646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.735649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.735672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:14.738535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cde02d76-b10d290e-31d3f33f-ec311f1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:14.740870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0] Write session: try to update token
2025-10-01T14:11:14.740891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:14.760911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1325 sessionId: src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:14.763450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:14.765749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.765773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.765810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:14.766121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:14.774560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255685848238958:4741]
2025-10-01T14:11:14.774864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1324, pipe: [1:7556255685848238958:4741]
2025-10-01T14:11:14.776352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238958:4741], now have 1 active actors on pipe
2025-10-01T14:11:14.776376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:14.776379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:14.776381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:14.776383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:14.776392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255683471359129:9321]
2025-10-01T14:11:14.776397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255683471359129:9321]
2025-10-01T14:11:14.776402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255683471359129:9321]
2025-10-01T14:11:14.776446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:14.776453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:14.776455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:14.776590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:14.781424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:14.781439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:14.781444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:14.982139Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:14.988572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:14.988597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:14.988760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.988819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.988879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.988937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.988983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.988987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.989050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.989106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.989170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.989267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.989309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.989318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.989378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.989431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.989482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.989531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.989569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.989575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.989632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.989681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.989730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.989778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.989815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.989818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.989878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.989931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.989986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.990040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.990087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.990089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.990146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.990198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.990264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.990326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.990383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.990385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.990498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.990548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.990600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.990651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.990691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.990694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.990751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.990795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.990839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.990889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.990924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.990927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.990983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.991036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.991088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.991139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.991176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.991179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.991236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:14.991285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:14.991338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:14.991390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:14.991428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:14.991430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:14.991843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:14.991874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255685848238958:4741]
2025-10-01T14:11:14.991887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:14.991888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:14.991909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1325 reason: error at write: Disconnected sessionId: src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0
2025-10-01T14:11:14.992115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1325 sessionId: src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0 is DEAD
2025-10-01T14:11:14.992370Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:14.992429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:14.992439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0] Write session will restart in 0.009885s
2025-10-01T14:11:14.992462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0] Write session: Do CDS request
2025-10-01T14:11:14.992468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:15.003886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.004063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:15.004077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1326
2025-10-01T14:11:15.004200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.004236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:15.004241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:15.004245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:15.004744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1326 sessionId:  describe result for acl check
2025-10-01T14:11:15.004775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:15.004778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:15.004780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:15.004785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255690143206341:4473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:15.005261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255690143206341:4473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:15.008654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255690143206341:4473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:15.009840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:15.012810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255690143206341:4473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:15.012829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255690143206341:4473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:15.012832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255690143206341:4473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:15.012841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:15.013224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:15.013437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:15.013448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:15.013459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:15.013512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:15.013551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255687766326602:9327]
2025-10-01T14:11:15.014121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:15.017404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:15.017472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:15.017841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:15.017891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.017897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.017898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.017900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.017901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.017903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.017904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.017905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.017906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.017907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.017909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.017910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.017912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.017913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.017920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.017928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.017932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.017936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.017940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.017943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.017947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.017951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.017954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.017959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.017962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.017966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.017969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.017973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.017980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.017987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.017993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.018003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.018008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.018013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.018017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.018022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.018027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.018032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.018036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.018041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.018046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.018052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.018062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.018067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.018072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.018076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.018080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.018085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.018090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.018096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.018100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.018105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.018110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.018115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.018119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.018123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.018162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:15.022963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:15.023697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:15.023710Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:15.023712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:15.023716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:15.023723Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1325 [2:7556255687766326602:9327]
2025-10-01T14:11:15.023737Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:15.023753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:15.023756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.023760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.023762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.023777Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:15.023783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:15.023794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:15.023850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.023857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.023859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.023863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:15.023865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:15.023930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:15.023942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.023953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.023964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.023979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:15.023996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206420:4473], now have 1 active actors on pipe
2025-10-01T14:11:15.024004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255685848238976:2446], now have 1 active actors on pipe
2025-10-01T14:11:15.024012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255687766326596:9327]
2025-10-01T14:11:15.024014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255687766326596:9327]
2025-10-01T14:11:15.024016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255687766326596:9327]
2025-10-01T14:11:15.024030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:15.024047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:15.024062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:15.024068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:15.024078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:15.024087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:15.024089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:15.024099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255687766326596:9327]
2025-10-01T14:11:15.024106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:15.024112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:15.024107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1325
2025-10-01T14:11:15.024147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1325
2025-10-01T14:11:15.024291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.024303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.024330Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57f1965c-891472ad-136a582c-32af041_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:15.024338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.024343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.024345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:15.024357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.024369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:15.024383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.024534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.024544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.024556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.027249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1326 partition: 0 MaxSeqNo: 45 sessionId: src_id|57f1965c-891472ad-136a582c-32af041_0
2025-10-01T14:11:15.033622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3104369-20baf5c8-e1095d8e-bf0fe2ae_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|57f1965c-891472ad-136a582c-32af041_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:15.035915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57f1965c-891472ad-136a582c-32af041_0] Write session: try to update token
2025-10-01T14:11:15.035931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57f1965c-891472ad-136a582c-32af041_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:15.050054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:15.050072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:15.050075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:15.050077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:15.050089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255687766326596:9327]
2025-10-01T14:11:15.050094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255687766326596:9327]
2025-10-01T14:11:15.050101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255687766326596:9327]
2025-10-01T14:11:15.050148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:15.050155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.050158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:15.050996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:15.054578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:15.054593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:15.054597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:15.057296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1326 sessionId: src_id|57f1965c-891472ad-136a582c-32af041_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:15.059672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:15.091995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255690143206434:4741]
2025-10-01T14:11:15.092218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1325, pipe: [1:7556255690143206434:4741]
2025-10-01T14:11:15.208651Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:15.209137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.209156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.209181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206434:4741], now have 1 active actors on pipe
2025-10-01T14:11:15.209500Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:15.209913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f1965c-891472ad-136a582c-32af041_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:15.209924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f1965c-891472ad-136a582c-32af041_0] Write session will restart in 0.008653s
2025-10-01T14:11:15.209952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f1965c-891472ad-136a582c-32af041_0] Write session: Do CDS request
2025-10-01T14:11:15.209957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f1965c-891472ad-136a582c-32af041_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:15.209481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:15.209495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:15.209497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255690143206434:4741]
2025-10-01T14:11:15.209520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:15.209570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1326 reason: error at write: Disconnected sessionId: src_id|57f1965c-891472ad-136a582c-32af041_0
2025-10-01T14:11:15.209796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1326 sessionId: src_id|57f1965c-891472ad-136a582c-32af041_0 is DEAD
2025-10-01T14:11:15.219872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57f1965c-891472ad-136a582c-32af041_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.219951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:15.219961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1327
2025-10-01T14:11:15.220087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.220119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:15.220127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:15.220131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:15.220845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1327 sessionId:  describe result for acl check
2025-10-01T14:11:15.220877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:15.220883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:15.220884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:15.220889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255690143206482:4466] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:15.221378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255690143206482:4466] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:15.223565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255690143206482:4466] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:15.224535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:15.226487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:15.226643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:15.226653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:15.226661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:15.226711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:15.226748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255687766326788:9339]
2025-10-01T14:11:15.226863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255690143206482:4466] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:15.226880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255690143206482:4466] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:15.226883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255690143206482:4466] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:15.226890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:15.227238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:15.227458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:15.227493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:15.227759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:15.227805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.227810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.227811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.227812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.227813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.227814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.227815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.227816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.227818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.227819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.227820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.227821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.227822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.227823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.227827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.227836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.227840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.227843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.227847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.227851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.227854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.227858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.227861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.227865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.227869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.227872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.227876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.227879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.227886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.227893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.227899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.227908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.227912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.227917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.227925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.227930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.227934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.227942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.227946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.227950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.227954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.227958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.227962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.227968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.227972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.227977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.227984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.227989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.227993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.228001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.228005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.228010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.228018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.228022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.228026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.228033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.228069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:15.231446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:15.232017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:15.232030Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:15.232032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:15.232036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:15.232042Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1326 [2:7556255687766326788:9339]
2025-10-01T14:11:15.232058Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:15.232075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:15.232077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.232080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.232081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.232093Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:15.232096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:15.232103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:15.232139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.232144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.232145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.232147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:15.232149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:15.232194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:15.232199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.232206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.232211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.232221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:15.232243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206446:2446], now have 1 active actors on pipe
2025-10-01T14:11:15.232251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255687766326783:9339]
2025-10-01T14:11:15.232252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255687766326783:9339]
2025-10-01T14:11:15.232254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255687766326783:9339]
2025-10-01T14:11:15.232266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:15.232275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206597:4466], now have 1 active actors on pipe
2025-10-01T14:11:15.232279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:15.232282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:15.232282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:15.232285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:15.232295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:15.232300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:15.232323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255687766326783:9339]
2025-10-01T14:11:15.232337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:15.232362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:15.232396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1326
2025-10-01T14:11:15.232398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1326
2025-10-01T14:11:15.232451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.232459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.232481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a3e6dae-ff987d71-33597f05-279a1285_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:15.232491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.232497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.232499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:15.232509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.232520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:15.232536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.232698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.232705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.232719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.232791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1327 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a3e6dae-ff987d71-33597f05-279a1285_0
2025-10-01T14:11:15.233142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f1965c-891472ad-136a582c-32af041_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a3e6dae-ff987d71-33597f05-279a1285_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:15.235421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3e6dae-ff987d71-33597f05-279a1285_0] Write session: try to update token
2025-10-01T14:11:15.235435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3e6dae-ff987d71-33597f05-279a1285_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:15.249111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:15.249126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:15.249134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255687766326783:9339]
2025-10-01T14:11:15.249175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:15.249183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:15.249187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1327 sessionId: src_id|1a3e6dae-ff987d71-33597f05-279a1285_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:15.249345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:15.249483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:15.249611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:15.249750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:15.249934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:15.249968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:15.251869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:15.252096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.252117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.252151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:15.252250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:15.263449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:15.263464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:15.263466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:15.263468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:15.263479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255687766326783:9339]
2025-10-01T14:11:15.263484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255687766326783:9339]
2025-10-01T14:11:15.263488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255687766326783:9339]
2025-10-01T14:11:15.263536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:15.263548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.263551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:15.263682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:15.265702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:15.265715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:15.265719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:15.309109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255690143206609:4741]
2025-10-01T14:11:15.309542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1326, pipe: [1:7556255690143206609:4741]
2025-10-01T14:11:15.423624Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:15.432009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.432036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.432203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.432265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.432326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.432390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.432434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.432443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.432526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.432588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.432649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.432728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.432775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.432783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.432848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.432906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.432968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.433030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.433072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.433078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.433138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.433195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.433252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.433317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.433364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.433367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.433429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.433482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.433544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.433613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.433652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.433654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.433722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.433779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.433840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.433900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.433936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.433939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.433997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.434045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.434108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.434169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.434233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.434236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.434297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.434351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.434546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.434617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.434657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.434659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.434729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.434787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.434850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.434914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.434956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.434959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.435028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:15.435082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:15.435142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:15.435201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:15.435242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:15.435245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:15.435322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206609:4741], now have 1 active actors on pipe
2025-10-01T14:11:15.436378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:15.437127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255690143206609:4741]
2025-10-01T14:11:15.437152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:15.437182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:15.437217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1327 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1a3e6dae-ff987d71-33597f05-279a1285_0
2025-10-01T14:11:15.437439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1327 sessionId: src_id|1a3e6dae-ff987d71-33597f05-279a1285_0 is DEAD
2025-10-01T14:11:15.437653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3e6dae-ff987d71-33597f05-279a1285_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:15.437665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3e6dae-ff987d71-33597f05-279a1285_0] Write session will restart in 0.008936s
2025-10-01T14:11:15.437690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3e6dae-ff987d71-33597f05-279a1285_0] Write session: Do CDS request
2025-10-01T14:11:15.437701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3e6dae-ff987d71-33597f05-279a1285_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:15.448805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3e6dae-ff987d71-33597f05-279a1285_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.449012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:15.449030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1328
2025-10-01T14:11:15.449356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.449391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:15.449409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:15.449418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:15.449833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1328 sessionId:  describe result for acl check
2025-10-01T14:11:15.449870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:15.449877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:15.449879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:15.449884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255690143206737:4468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:15.450420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255690143206737:4468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:15.451041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:15.452615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255690143206737:4468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:15.452921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:15.453141Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:15.453152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:15.453160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:15.453196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:15.453226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255687766326948:9341]
2025-10-01T14:11:15.453718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:15.453945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:15.453983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:15.454258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:15.454297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.454301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.454301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.454302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.454303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.454304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.454304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.454305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.454305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.454306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.454306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.454308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.454308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.454309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.454312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.454318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.454321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.454323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.454325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.454327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.454329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.454331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.454333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.454335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.454337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.454339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.454342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.454345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.454351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.454358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.454365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.454384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.454388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.454392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.454396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.454402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.454405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.454410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.454414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.454419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.454423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.454428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.454432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.454436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.454440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.454446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.454450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.454456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.454461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.454466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.454477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.454481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.454486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.454491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.454494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.454501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.454538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:15.455169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255690143206737:4468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:15.455184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255690143206737:4468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:15.455187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255690143206737:4468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:15.455195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:15.458203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:15.459036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:15.459054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:15.459057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:15.459061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:15.459068Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1327 [2:7556255687766326948:9341]
2025-10-01T14:11:15.459084Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:15.459101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:15.459109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.459113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.459115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.459130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:15.459137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:15.459143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:15.459204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.459211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.459213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.459216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:15.459218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:15.459433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1327
2025-10-01T14:11:15.459464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1327
2025-10-01T14:11:15.459290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:15.459300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.459313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.459324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.459341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:15.459361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206777:4468], now have 1 active actors on pipe
2025-10-01T14:11:15.459365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206622:2446], now have 1 active actors on pipe
2025-10-01T14:11:15.459373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255687766326943:9341]
2025-10-01T14:11:15.459375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255687766326943:9341]
2025-10-01T14:11:15.459377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255687766326943:9341]
2025-10-01T14:11:15.459391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:15.459406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:15.459420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:15.459424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:15.459451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:15.459455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255687766326943:9341]
2025-10-01T14:11:15.459455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:15.459457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:15.459458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:15.459463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:15.459573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.459582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.459621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:15.459634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.459638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.459641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:15.459651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.459664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:15.459680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.459839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.459851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.459870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.459966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1328 partition: 0 MaxSeqNo: 45 sessionId: src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0
2025-10-01T14:11:15.460359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a3e6dae-ff987d71-33597f05-279a1285_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:15.462720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0] Write session: try to update token
2025-10-01T14:11:15.462737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:15.480433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:15.480451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:15.480454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:15.480456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:15.480466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255687766326943:9341]
2025-10-01T14:11:15.480471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255687766326943:9341]
2025-10-01T14:11:15.480475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255687766326943:9341]
2025-10-01T14:11:15.480523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:15.480529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:15.480533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:15.480544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:15.480551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.480554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:15.480710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:15.479112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1328 sessionId: src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:15.481763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:15.537453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255690143206788:4741]
2025-10-01T14:11:15.537865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1327, pipe: [1:7556255690143206788:4741]
2025-10-01T14:11:15.627666Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:15.628148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.628158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.628199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206788:4741], now have 1 active actors on pipe
2025-10-01T14:11:15.628594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:15.630479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:15.630490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0] Write session will restart in 0.006132s
2025-10-01T14:11:15.630506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0] Write session: Do CDS request
2025-10-01T14:11:15.630511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:15.629780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:15.629858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1328 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0
2025-10-01T14:11:15.630049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1328 sessionId: src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0 is DEAD
2025-10-01T14:11:15.630167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255690143206788:4741]
2025-10-01T14:11:15.630181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:15.640169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.642716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:15.642731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1329
2025-10-01T14:11:15.643077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.643114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:15.643120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:15.643124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:15.646539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1329 sessionId:  describe result for acl check
2025-10-01T14:11:15.646577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:15.646585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:15.646589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:15.646594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255690143206838:4460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:15.647085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255690143206838:4460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:15.652248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255690143206838:4460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:15.657815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255690143206838:4460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:15.657827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255690143206838:4460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:15.657831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255690143206838:4460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:15.657839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:15.660868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:15.666685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:15.666919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:15.666930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:15.666939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:15.666980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:15.667015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255687766327113:9344]
2025-10-01T14:11:15.667585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:15.669208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:15.669256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:15.669586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:15.669638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.669639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.669640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.669641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.669643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.669644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.669645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.669647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.669648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.669649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.669650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.669652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.669653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.669654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.669660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.669670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.669674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.669678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.669682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.669685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.669690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.669693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.669697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.669701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.669705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.669708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.669712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.669716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.669723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.669730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.669738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.669743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.669748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.669753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.669757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.669763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.669767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.669772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.669776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.669781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.669786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.669791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.669796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.669801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.669814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.669819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.669824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.669829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.669833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.669844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.669848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.669854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.669858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.669863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.669866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.669871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.669909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:15.677033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:15.677662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:15.677676Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:15.677679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:15.677683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:15.677691Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1328 [2:7556255687766327113:9344]
2025-10-01T14:11:15.677711Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:15.677729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:15.677731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.677735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.677738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.677754Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:15.677760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:15.677766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:15.677824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.677826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.677828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.677832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:15.677835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:15.677902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:15.677907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.677918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.677926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.677940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:15.677957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206796:2446], now have 1 active actors on pipe
2025-10-01T14:11:15.677960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206948:4460], now have 1 active actors on pipe
2025-10-01T14:11:15.677966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255687766327108:9344]
2025-10-01T14:11:15.677968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255687766327108:9344]
2025-10-01T14:11:15.677971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255687766327108:9344]
2025-10-01T14:11:15.677978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:15.677984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:15.677986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:15.677990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:15.677991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:15.678003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:15.678006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:15.678042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255687766327108:9344]
2025-10-01T14:11:15.678049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:15.678055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:15.678988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.679001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.679028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|462012de-af591606-b0f908b5-67dc5e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:15.679039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.679048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.679051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:15.679060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.679075Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:15.679094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.679223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.679229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.679240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.679791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c250870-8034d01d-b0ea7e4a-e366ef1d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|462012de-af591606-b0f908b5-67dc5e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:15.678407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1328
2025-10-01T14:11:15.678453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1328
2025-10-01T14:11:15.679405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1329 partition: 0 MaxSeqNo: 45 sessionId: src_id|462012de-af591606-b0f908b5-67dc5e0_0
2025-10-01T14:11:15.682587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|462012de-af591606-b0f908b5-67dc5e0_0] Write session: try to update token
2025-10-01T14:11:15.682603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|462012de-af591606-b0f908b5-67dc5e0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:15.700783Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:15.700801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:15.700803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:15.700805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:15.700814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255687766327108:9344]
2025-10-01T14:11:15.700818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255687766327108:9344]
2025-10-01T14:11:15.700821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255687766327108:9344]
2025-10-01T14:11:15.700864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:15.700870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.700872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:15.701042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:15.703028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:15.703044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:15.703047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:15.708620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1329 sessionId: src_id|462012de-af591606-b0f908b5-67dc5e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:15.711694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:15.732463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255690143206973:4741]
2025-10-01T14:11:15.738479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1328, pipe: [1:7556255690143206973:4741]
2025-10-01T14:11:15.865847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:15.866129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.866139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.866180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206973:4741], now have 1 active actors on pipe
2025-10-01T14:11:15.866713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255690143206973:4741]
2025-10-01T14:11:15.866745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:15.866746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:15.866746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:15.866797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1329 reason: error at write: Disconnected sessionId: src_id|462012de-af591606-b0f908b5-67dc5e0_0
2025-10-01T14:11:15.866966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1329 sessionId: src_id|462012de-af591606-b0f908b5-67dc5e0_0 is DEAD
2025-10-01T14:11:15.867125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462012de-af591606-b0f908b5-67dc5e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:15.867137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462012de-af591606-b0f908b5-67dc5e0_0] Write session will restart in 0.005636s
2025-10-01T14:11:15.867163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462012de-af591606-b0f908b5-67dc5e0_0] Write session: Do CDS request
2025-10-01T14:11:15.867172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462012de-af591606-b0f908b5-67dc5e0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:15.867015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:15.874361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|462012de-af591606-b0f908b5-67dc5e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.874650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:15.874666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1330
2025-10-01T14:11:15.874779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:15.874805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:15.874811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:15.874814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:15.875202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1330 sessionId:  describe result for acl check
2025-10-01T14:11:15.875239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:15.875240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:15.875243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:15.875247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255690143207000:4441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:15.875707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255690143207000:4441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:15.877640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255690143207000:4441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:15.883146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255690143207000:4441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:15.883168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255690143207000:4441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:15.883171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255690143207000:4441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:15.883181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:15.895447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:15.900872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:15.901094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:15.901098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:15.901107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:15.901149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:15.901182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255687766327292:9349]
2025-10-01T14:11:15.901757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:15.902168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:15.902226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:15.902571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:15.902630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.902631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.902632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.902634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.902635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.902636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.902638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.902639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.902640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.902642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.902643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.902644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.902645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.902647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.902652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.902662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.902666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.902670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.902674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.902678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.902681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.902685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.902689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.902693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.902697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.902701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.902705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.902708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.902716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.902723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:15.902729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.902735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:15.902739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.902745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:15.902749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.902754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:15.902759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.902765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:15.902769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.902775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:15.902780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.902785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:15.902791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.902796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:15.902801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.902807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:15.902811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.902816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.902820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.902825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.902829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.902835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.902850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.902855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:15.902860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.902865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:15.902905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:15.912432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:15.913072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:15.913078Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:15.913081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:15.913084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:15.913091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1329 [2:7556255687766327292:9349]
2025-10-01T14:11:15.913108Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:15.913126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:15.913129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.913133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.913135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.913152Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:15.913157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:15.913164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:15.913224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.913226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.913228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.913231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:15.913233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:15.913312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:15.913315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.913326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:15.913334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:15.913347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:15.913363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255687766327286:9349]
2025-10-01T14:11:15.913365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255687766327286:9349]
2025-10-01T14:11:15.913367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255687766327286:9349]
2025-10-01T14:11:15.913376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:15.913392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:15.913407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:15.913410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:15.913450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255687766327286:9349]
2025-10-01T14:11:15.913453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:15.913747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:15.913754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:15.913756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:15.913760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:15.914124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1329
2025-10-01T14:11:15.914164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1329
2025-10-01T14:11:15.914364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143207038:4441], now have 1 active actors on pipe
2025-10-01T14:11:15.914391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143206992:2446], now have 1 active actors on pipe
2025-10-01T14:11:15.915286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.915296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.915323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abc8c35a-b4944595-5d1095e-74822980_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:15.915332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:15.915337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:15.915340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:15.915351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:15.915363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:15.915378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.915879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:15.915887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:15.915905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:15.916043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1330 partition: 0 MaxSeqNo: 45 sessionId: src_id|abc8c35a-b4944595-5d1095e-74822980_0
2025-10-01T14:11:15.916521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|462012de-af591606-b0f908b5-67dc5e0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|abc8c35a-b4944595-5d1095e-74822980_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:15.918789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abc8c35a-b4944595-5d1095e-74822980_0] Write session: try to update token
2025-10-01T14:11:15.918803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abc8c35a-b4944595-5d1095e-74822980_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:15.935819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:15.935840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:15.935843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:15.935844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:15.935855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255687766327286:9349]
2025-10-01T14:11:15.935860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255687766327286:9349]
2025-10-01T14:11:15.935864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255687766327286:9349]
2025-10-01T14:11:15.935912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:15.935918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:15.935921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:15.936083Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:15.938708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:15.938718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:15.938722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:15.948084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1330 sessionId: src_id|abc8c35a-b4944595-5d1095e-74822980_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:15.950515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:15.968882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255690143207162:4741]
2025-10-01T14:11:15.969251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1329, pipe: [1:7556255690143207162:4741]
2025-10-01T14:11:16.089724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:16.090040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.090049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.090088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255690143207162:4741], now have 1 active actors on pipe
2025-10-01T14:11:16.091367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:16.092742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255690143207162:4741]
2025-10-01T14:11:16.092770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:16.092782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:16.092822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1330 reason: status is not ok: tablet will be restarted right now sessionId: src_id|abc8c35a-b4944595-5d1095e-74822980_0
2025-10-01T14:11:16.092980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1330 sessionId: src_id|abc8c35a-b4944595-5d1095e-74822980_0 is DEAD
2025-10-01T14:11:16.094743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc8c35a-b4944595-5d1095e-74822980_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:16.094754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc8c35a-b4944595-5d1095e-74822980_0] Write session will restart in 0.007657s
2025-10-01T14:11:16.094779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc8c35a-b4944595-5d1095e-74822980_0] Write session: Do CDS request
2025-10-01T14:11:16.094785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc8c35a-b4944595-5d1095e-74822980_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:16.106794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abc8c35a-b4944595-5d1095e-74822980_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:16.109090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:16.109105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1331
2025-10-01T14:11:16.109301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:16.109334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:16.109339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:16.109343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:16.110571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1331 sessionId:  describe result for acl check
2025-10-01T14:11:16.110605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:16.110608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:16.110609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:16.110615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255694438174497:4436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:16.111092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255694438174497:4436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:16.113873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255694438174497:4436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:16.117830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255694438174497:4436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:16.117844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255694438174497:4436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:16.117847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255694438174497:4436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:16.117854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:16.124365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:16.125102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:16.125284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:16.125289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:16.125300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:16.125346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:16.125380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255692061294753:9352]
2025-10-01T14:11:16.125770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:16.126073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:16.126112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:16.126394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:16.126452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.126453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.126454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.126454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.126455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.126456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.126457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.126457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.126458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.126459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.126460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.126460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.126461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.126461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.126464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.126470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.126472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.126474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.126476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.126478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.126480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.126481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.126483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.126486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.126487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.126489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.126491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.126493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.126498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.126502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.126506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.126509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.126511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.126514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.126516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.126519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.126521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.126524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.126527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.126529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.126532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.126535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.126537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.126540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.126543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.126546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.126548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.126551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.126554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.126557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.126559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.126562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.126564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.126567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.126569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.126573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.126592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:16.130805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:16.131617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:16.131622Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:16.131625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:16.131629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:16.131636Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1330 [2:7556255692061294753:9352]
2025-10-01T14:11:16.131652Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:16.131669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:16.131672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:16.131675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:16.131678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:16.131693Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:16.131699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:16.131704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:16.131758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.131760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.131762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.131765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:16.131768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:16.131821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:16.131824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.131835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.131845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.131859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:16.131874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255692061294748:9352]
2025-10-01T14:11:16.131876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255692061294748:9352]
2025-10-01T14:11:16.131877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255692061294748:9352]
2025-10-01T14:11:16.131892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:16.131905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:16.131918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:16.131921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:16.131922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:16.131924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:16.131926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:16.131947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255692061294748:9352]
2025-10-01T14:11:16.131949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:16.131994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:16.132157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438174472:2446], now have 1 active actors on pipe
2025-10-01T14:11:16.132165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438174610:4436], now have 1 active actors on pipe
2025-10-01T14:11:16.132356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1330
2025-10-01T14:11:16.132400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1330
2025-10-01T14:11:16.132783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.132798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.132823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:16.132836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:16.132843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:16.132845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:16.132854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:16.132865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:16.132882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:16.133143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.133154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.133172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:16.133272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1331 partition: 0 MaxSeqNo: 45 sessionId: src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0
2025-10-01T14:11:16.133674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abc8c35a-b4944595-5d1095e-74822980_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:16.135833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0] Write session: try to update token
2025-10-01T14:11:16.135853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:16.155850Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:16.155872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:16.155875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:16.155877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:16.155886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255692061294748:9352]
2025-10-01T14:11:16.155891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255692061294748:9352]
2025-10-01T14:11:16.155895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255692061294748:9352]
2025-10-01T14:11:16.155939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:16.155941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:16.155947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.155950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:16.155951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:16.155954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:16.156078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:16.153920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1331 sessionId: src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:16.156212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:16.190967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255694438174641:4741]
2025-10-01T14:11:16.191370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1330, pipe: [1:7556255694438174641:4741]
2025-10-01T14:11:16.304858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:16.305162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.305174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.305215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438174641:4741], now have 1 active actors on pipe
2025-10-01T14:11:16.305466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:16.305948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:16.305997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255694438174641:4741]
2025-10-01T14:11:16.306016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:16.306078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1331 reason: status is not ok: tablet will be restarted right now sessionId: src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0
2025-10-01T14:11:16.306273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1331 sessionId: src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0 is DEAD
2025-10-01T14:11:16.306610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:16.306620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0] Write session will restart in 0.009556s
2025-10-01T14:11:16.306649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0] Write session: Do CDS request
2025-10-01T14:11:16.306655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:16.318475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:16.318612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:16.318630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1332
2025-10-01T14:11:16.318791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:16.318830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:16.318835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:16.318839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:16.319264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1332 sessionId:  describe result for acl check
2025-10-01T14:11:16.319305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:16.319307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:16.319309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:16.319313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255694438174661:4428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:16.319825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255694438174661:4428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:16.322399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255694438174661:4428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:16.324420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255694438174661:4428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:16.324433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255694438174661:4428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:16.324435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255694438174661:4428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:16.324442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:16.336343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:16.338784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:16.338993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:16.338996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:16.339009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:16.339055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:16.339089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255692061294945:9364]
2025-10-01T14:11:16.339639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:16.339934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:16.339978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:16.340280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:16.340320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.340321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.340322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.340324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.340325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.340326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.340327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.340328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.340330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.340331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.340332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.340333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.340334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.340335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.340339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.340349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.340352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.340355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.340358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.340361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.340364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.340368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.340372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.340376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.340379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.340383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.340386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.340390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.340396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.340404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.340409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.340414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.340419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.340423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.340428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.340433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.340437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.340441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.340445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.340450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.340455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.340459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.340463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.340468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.340472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.340477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.340481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.340485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.340489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.340494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.340498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.340503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.340506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.340511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.340515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.340519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.340557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:16.344312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:16.345078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:16.345092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:16.345093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:16.345095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:16.345101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1331 [2:7556255692061294945:9364]
2025-10-01T14:11:16.345111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:16.345123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:16.345125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:16.345128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:16.345130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:16.345142Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:16.345146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:16.345150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:16.345190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.345195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.345196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.345199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:16.345200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:16.345247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:16.345256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.345266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.345275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.345290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:16.345306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438174694:4428], now have 1 active actors on pipe
2025-10-01T14:11:16.345314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255692061294940:9364]
2025-10-01T14:11:16.345316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255692061294940:9364]
2025-10-01T14:11:16.345317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255692061294940:9364]
2025-10-01T14:11:16.345330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:16.345338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438174645:2446], now have 1 active actors on pipe
2025-10-01T14:11:16.345342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:16.345346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:16.345346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:16.345348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:16.345356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:16.345359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:16.345374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1331
2025-10-01T14:11:16.345395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1331
2025-10-01T14:11:16.345385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255692061294940:9364]
2025-10-01T14:11:16.345392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:16.345401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:16.345421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.345425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.345454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|764c2528-34088fb-1bac814d-77ea0ee0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:16.345460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:16.345464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:16.345466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:16.345475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:16.345484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:16.345500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:16.345623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.345635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.345649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:16.345731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1332 partition: 0 MaxSeqNo: 45 sessionId: src_id|764c2528-34088fb-1bac814d-77ea0ee0_0
2025-10-01T14:11:16.346097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389a6fc-b957fff4-7f0dd4e1-31f7d66a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|764c2528-34088fb-1bac814d-77ea0ee0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:16.348350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|764c2528-34088fb-1bac814d-77ea0ee0_0] Write session: try to update token
2025-10-01T14:11:16.348366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|764c2528-34088fb-1bac814d-77ea0ee0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:16.363004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1332 sessionId: src_id|764c2528-34088fb-1bac814d-77ea0ee0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:16.365272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:16.365955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.365981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.366001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:16.366006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:16.366009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:16.366011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:16.366019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255692061294940:9364]
2025-10-01T14:11:16.366029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255692061294940:9364]
2025-10-01T14:11:16.366033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255692061294940:9364]
2025-10-01T14:11:16.366070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:16.366081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:16.366084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:16.366091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:16.366098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.366101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:16.366229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:16.405781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255694438174825:4741]
2025-10-01T14:11:16.406005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1331, pipe: [1:7556255694438174825:4741]
2025-10-01T14:11:16.534632Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:16.534913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:16.534972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438174825:4741], now have 1 active actors on pipe
2025-10-01T14:11:16.536798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:16.536890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:16.536893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:16.536952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1332 reason: error at write: Disconnected sessionId: src_id|764c2528-34088fb-1bac814d-77ea0ee0_0
2025-10-01T14:11:16.537058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:16.537106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1332 sessionId: src_id|764c2528-34088fb-1bac814d-77ea0ee0_0 is DEAD
2025-10-01T14:11:16.537106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255694438174825:4741]
2025-10-01T14:11:16.537420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764c2528-34088fb-1bac814d-77ea0ee0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:16.537430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764c2528-34088fb-1bac814d-77ea0ee0_0] Write session will restart in 0.007051s
2025-10-01T14:11:16.537455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764c2528-34088fb-1bac814d-77ea0ee0_0] Write session: Do CDS request
2025-10-01T14:11:16.537465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764c2528-34088fb-1bac814d-77ea0ee0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:16.545976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|764c2528-34088fb-1bac814d-77ea0ee0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:16.546047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:16.546060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1333
2025-10-01T14:11:16.546221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:16.546259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:16.546269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:16.546272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:16.550874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1333 sessionId:  describe result for acl check
2025-10-01T14:11:16.550914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:16.550916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:16.550917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:16.550924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255694438174841:4417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:16.551506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255694438174841:4417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:16.553443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255694438174841:4417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:16.562984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255694438174841:4417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:16.562999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255694438174841:4417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:16.563001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255694438174841:4417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:16.563007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:16.573164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:16.575166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:16.575351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:16.575360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:16.575371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:16.575418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:16.575453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255692061295110:9367]
2025-10-01T14:11:16.576026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:16.576239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:16.576270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:16.576463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:16.576497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.576498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.576499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.576499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.576500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.576501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.576502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.576502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.576503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.576503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.576504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.576505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.576505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.576506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.576509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.576514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.576517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.576519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.576521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.576523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.576525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.576527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.576529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.576532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.576534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.576536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.576538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.576540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.576545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.576550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.576554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.576556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.576559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.576562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.576564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.576567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.576569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.576572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.576575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.576577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.576580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.576583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.576585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.576588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.576591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.576594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.576596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.576599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.576601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.576604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.576606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.576609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.576611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.576614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.576616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.576619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.576639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:16.581420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:16.582020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:16.582024Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:16.582026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:16.582029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:16.582034Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1332 [2:7556255692061295110:9367]
2025-10-01T14:11:16.582045Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:16.582059Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:16.582061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:16.582063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:16.582065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:16.582078Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:16.582081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:16.582086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:16.582130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.582131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.582133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.582136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:16.582137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:16.582193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:16.582195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.582201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.582207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.582215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:16.582229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438174896:4417], now have 1 active actors on pipe
2025-10-01T14:11:16.582231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438174828:2446], now have 1 active actors on pipe
2025-10-01T14:11:16.582236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255692061295105:9367]
2025-10-01T14:11:16.582238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255692061295105:9367]
2025-10-01T14:11:16.582240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255692061295105:9367]
2025-10-01T14:11:16.582248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:16.582257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:16.582260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:16.582262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:16.582426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:16.582444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:16.582447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:16.582479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255692061295105:9367]
2025-10-01T14:11:16.582488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:16.582496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:16.582532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1332
2025-10-01T14:11:16.582561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1332
2025-10-01T14:11:16.582700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.582709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.582733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c07275ef-4a12c521-a7a10450-a7e9734_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:16.582740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:16.582743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:16.582746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:16.582756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:16.582766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:16.582779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:16.582968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.582977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.582996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:16.583115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1333 partition: 0 MaxSeqNo: 45 sessionId: src_id|c07275ef-4a12c521-a7a10450-a7e9734_0
2025-10-01T14:11:16.586681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|764c2528-34088fb-1bac814d-77ea0ee0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c07275ef-4a12c521-a7a10450-a7e9734_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:16.589054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c07275ef-4a12c521-a7a10450-a7e9734_0] Write session: try to update token
2025-10-01T14:11:16.589068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c07275ef-4a12c521-a7a10450-a7e9734_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:16.604339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1333 sessionId: src_id|c07275ef-4a12c521-a7a10450-a7e9734_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:16.606693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:16.616871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.616894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.616916Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:16.616919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:16.616930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255692061295105:9367]
2025-10-01T14:11:16.616978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:16.616986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:16.617212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:16.617385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:16.617551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:16.617711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:16.617932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:16.617977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:16.618001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:16.618286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:16.624785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:16.624804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:16.624806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:16.624807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:16.624818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255692061295105:9367]
2025-10-01T14:11:16.624822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255692061295105:9367]
2025-10-01T14:11:16.624825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255692061295105:9367]
2025-10-01T14:11:16.624871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:16.624878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.624884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:16.625034Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:16.626581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:16.626597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:16.626601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:16.640932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255694438175000:4741]
2025-10-01T14:11:16.643650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1332, pipe: [1:7556255694438175000:4741]
2025-10-01T14:11:16.799600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:16.807532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.807559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.807715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.807767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.807820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.807878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.807918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.807926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.807990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.808044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.808099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.808155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.808194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.808197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.808326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.808377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.808435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.808487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.808522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.808524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.808578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.808633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.808684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.808753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.808788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.808792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.808847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.808898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.808949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.809002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.809037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.809039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.809100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.809152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.809210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.809269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.809314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.809317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.809376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.809429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.809480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.809548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.809583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.809591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.809683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.809738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.809791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.809849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.809887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.809890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.809953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.810007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.810062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.810117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.810157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.810162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.810221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:16.810272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:16.810326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:16.810408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:16.810447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:16.810451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:16.810518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438175000:4741], now have 1 active actors on pipe
2025-10-01T14:11:16.811143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255694438175000:4741]
2025-10-01T14:11:16.811170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:16.811173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:16.811194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1333 reason: error at write: Disconnected sessionId: src_id|c07275ef-4a12c521-a7a10450-a7e9734_0
2025-10-01T14:11:16.811412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1333 sessionId: src_id|c07275ef-4a12c521-a7a10450-a7e9734_0 is DEAD
2025-10-01T14:11:16.811568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:16.811479Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:16.814676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07275ef-4a12c521-a7a10450-a7e9734_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:16.814686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07275ef-4a12c521-a7a10450-a7e9734_0] Write session will restart in 0.005229s
2025-10-01T14:11:16.814710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07275ef-4a12c521-a7a10450-a7e9734_0] Write session: Do CDS request
2025-10-01T14:11:16.814716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07275ef-4a12c521-a7a10450-a7e9734_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:16.826845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c07275ef-4a12c521-a7a10450-a7e9734_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:16.827156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:16.827170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1334
2025-10-01T14:11:16.829895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:16.829933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:16.829938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:16.829942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:16.830417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1334 sessionId:  describe result for acl check
2025-10-01T14:11:16.830455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:16.830456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:16.830458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:16.830463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255694438175088:4409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:16.830960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255694438175088:4409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:16.843335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255694438175088:4409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:16.849624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:16.853475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:16.853692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:16.853702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:16.853713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:16.853763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:16.853799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255692061295295:9369]
2025-10-01T14:11:16.854349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:16.852045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255694438175088:4409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:16.852063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255694438175088:4409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:16.852067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255694438175088:4409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:16.852076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:16.854634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:16.854688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:16.854991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:16.855065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.855071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.855072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.855073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.855074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.855075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.855076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.855077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.855078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.855080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.855081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.855082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.855084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.855085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.855090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.855100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.855104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.855107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.855111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.855115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.855119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.857044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.857063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.857069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.857074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.857078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.857082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.857087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.857101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.857111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:16.857118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.857125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:16.857131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.857136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:16.857142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.857148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:16.857153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.857159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:16.857164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.857171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:16.857176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.857181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:16.857186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.857192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:16.857197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.857202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:16.857207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.857214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.857219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.857225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.857230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.857236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.857241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.857247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:16.857252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.857257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:16.857302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:16.862699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:16.863395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:16.863402Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:16.863405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:16.863409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:16.863416Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1333 [2:7556255692061295295:9369]
2025-10-01T14:11:16.863433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:16.863453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:16.863457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:16.863461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:16.863464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:16.863483Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:16.863488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:16.863495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:16.863562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.863564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.863566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.863569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:16.863572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:16.863645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:16.863648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.863661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:16.863672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:16.863687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:16.863704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255692061295289:9369]
2025-10-01T14:11:16.863707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255692061295289:9369]
2025-10-01T14:11:16.863709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255692061295289:9369]
2025-10-01T14:11:16.863726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:16.863742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:16.863758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:16.863761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:16.863803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255692061295289:9369]
2025-10-01T14:11:16.863805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:16.863921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:16.863933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:16.863936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:16.863941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:16.865480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438175187:4409], now have 1 active actors on pipe
2025-10-01T14:11:16.865498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438175018:2446], now have 1 active actors on pipe
2025-10-01T14:11:16.867477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.867496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.867534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:16.867551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:16.867093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1333
2025-10-01T14:11:16.867129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1333
2025-10-01T14:11:16.867589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:16.867596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:16.867608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:16.867626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:16.867653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:16.870420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:16.870440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:16.870479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:16.870775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1334 partition: 0 MaxSeqNo: 45 sessionId: src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0
2025-10-01T14:11:16.871186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c07275ef-4a12c521-a7a10450-a7e9734_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:16.873698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0] Write session: try to update token
2025-10-01T14:11:16.873717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:16.888416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:16.888439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:16.888442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:16.888444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:16.888455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255692061295289:9369]
2025-10-01T14:11:16.888460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255692061295289:9369]
2025-10-01T14:11:16.888463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255692061295289:9369]
2025-10-01T14:11:16.888516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:16.888528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:16.888530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:16.888668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:16.889099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:16.889118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:16.889124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:16.900573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1334 sessionId: src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:16.903169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:16.911160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255694438175199:4741]
2025-10-01T14:11:16.911432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1333, pipe: [1:7556255694438175199:4741]
2025-10-01T14:11:17.041674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:17.041760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1334 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0
2025-10-01T14:11:17.042124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1334 sessionId: src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0 is DEAD
2025-10-01T14:11:17.042281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:17.042291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0] Write session will restart in 0.009971s
2025-10-01T14:11:17.042329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0] Write session: Do CDS request
2025-10-01T14:11:17.042336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:17.042318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255694438175199:4741]
2025-10-01T14:11:17.042340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:17.040283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:17.040838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.040848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.040870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255694438175199:4741], now have 1 active actors on pipe
2025-10-01T14:11:17.041077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:17.054925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:17.055010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:17.055028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1335
2025-10-01T14:11:17.055156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:17.055191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:17.055197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:17.055201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:17.055660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1335 sessionId:  describe result for acl check
2025-10-01T14:11:17.055704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:17.055706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:17.055708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:17.055713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255698733142520:4400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:17.056276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255698733142520:4400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:17.062064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255698733142520:4400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:17.080685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255698733142520:4400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:17.080720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255698733142520:4400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:17.080723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255698733142520:4400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:17.080730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:17.095395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:17.101281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:17.101493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:17.101498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:17.101508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:17.101553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:17.101584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255696356262759:9375]
2025-10-01T14:11:17.102036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:17.102489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:17.102539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:17.102765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:17.102801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.102802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.102803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.102803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.102804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.102806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.102807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.102808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.102809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.102809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.102810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.102811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.102812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.102813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.102816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.102822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.102824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.102826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.102829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.102831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.102834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.102836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.102839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.102842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.102844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.102847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.102849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.102851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.102856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.102861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.102865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.102869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.102874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.102879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.102884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.102889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.102894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.102899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.102904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.102910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.102914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.102917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.102919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.102922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.102925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.102928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.102931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.102934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.102937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.102940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.102943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.102945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.102948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.102951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.102953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.102956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.102977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:17.111330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:17.111998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:17.112003Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:17.112006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:17.112010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:17.112021Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1334 [2:7556255696356262759:9375]
2025-10-01T14:11:17.112039Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:17.112058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:17.112063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:17.112067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:17.112069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:17.112087Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:17.112094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:17.112101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:17.112164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.112167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.112169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.112172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:17.112175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:17.112252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:17.112255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.112266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.112276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.112292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:17.112309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255696356262754:9375]
2025-10-01T14:11:17.112311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255696356262754:9375]
2025-10-01T14:11:17.112313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255696356262754:9375]
2025-10-01T14:11:17.112327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:17.112344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:17.112358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:17.112361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:17.112401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255696356262754:9375]
2025-10-01T14:11:17.112403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:17.112618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:17.112624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:17.112627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:17.112633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:17.112958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733142512:2446], now have 1 active actors on pipe
2025-10-01T14:11:17.112966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733142623:4400], now have 1 active actors on pipe
2025-10-01T14:11:17.113164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1334
2025-10-01T14:11:17.113205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1334
2025-10-01T14:11:17.113543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.113553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.113583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:17.113590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:17.113595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:17.113598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:17.113609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:17.113622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:17.113638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:17.114891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.114902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.114927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:17.116036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1335 partition: 0 MaxSeqNo: 45 sessionId: src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0
2025-10-01T14:11:17.118634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4acaa3ac-4f6a72e1-ef1bbe49-d46eaa7f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:17.121299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0] Write session: try to update token
2025-10-01T14:11:17.121322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:17.143597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255698733142684:4741]
2025-10-01T14:11:17.141973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:17.141995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:17.141998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:17.142002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:17.142015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255696356262754:9375]
2025-10-01T14:11:17.142023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255696356262754:9375]
2025-10-01T14:11:17.142030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255696356262754:9375]
2025-10-01T14:11:17.142095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:17.142104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.142107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:17.142318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:17.145017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:17.145028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:17.145032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:17.146973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1334, pipe: [1:7556255698733142684:4741]
2025-10-01T14:11:17.146992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1335 sessionId: src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:17.149553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:17.296704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:17.297592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255698733142684:4741]
2025-10-01T14:11:17.297620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:17.297654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:17.297656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:17.297712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1335 reason: error at write: Disconnected sessionId: src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0
2025-10-01T14:11:17.297922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1335 sessionId: src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0 is DEAD
2025-10-01T14:11:17.299374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:17.299384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0] Write session will restart in 0.007357s
2025-10-01T14:11:17.299411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0] Write session: Do CDS request
2025-10-01T14:11:17.299417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:17.297073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733142684:4741], now have 1 active actors on pipe
2025-10-01T14:11:17.297109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.297115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.297501Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:17.308370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:17.308759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:17.308774Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1336
2025-10-01T14:11:17.308947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:17.308975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:17.308980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:17.308984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:17.309459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1336 sessionId:  describe result for acl check
2025-10-01T14:11:17.309483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:17.309485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:17.309486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:17.309492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255698733142698:4391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:17.309999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255698733142698:4391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:17.312280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255698733142698:4391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:17.317953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255698733142698:4391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:17.317971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255698733142698:4391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:17.317974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255698733142698:4391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:17.317983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:17.348905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:17.351521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:17.351744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:17.351749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:17.351761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:17.351810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:17.351844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255696356262955:9387]
2025-10-01T14:11:17.352494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:17.353705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:17.353758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:17.354070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:17.354124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.354125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.354126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.354127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.354129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.354130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.354131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.354132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.354133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.354135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.354136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.354137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.354138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.354139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.354145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.354155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.354159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.354163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.354167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.354171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.354174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.354178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.354182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.354185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.354189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.354193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.354197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.354200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.354208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.354216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.354223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.354228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.354233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.354237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.354241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.354246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.354251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.354257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.354261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.354266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.354272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.354277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.354281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.354286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.354291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.354296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.354301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.354306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.354310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.354315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.354320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.354325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.354330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.354335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.354339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.354344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.354399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:17.366128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:17.366775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:17.366782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:17.366785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:17.366789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:17.366797Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1335 [2:7556255696356262955:9387]
2025-10-01T14:11:17.366815Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:17.366833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:17.366837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:17.366841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:17.366843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:17.366862Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:17.366868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:17.366875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:17.366939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.366942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.366944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.366948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:17.366951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:17.367392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:17.367396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.367414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.367431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.367454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:17.367474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255696356262949:9387]
2025-10-01T14:11:17.367477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255696356262949:9387]
2025-10-01T14:11:17.367480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255696356262949:9387]
2025-10-01T14:11:17.367500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:17.367518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:17.367536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:17.367539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:17.367580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255696356262949:9387]
2025-10-01T14:11:17.367583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:17.367931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:17.367937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:17.367939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:17.367944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:17.368533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1335
2025-10-01T14:11:17.368570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1335
2025-10-01T14:11:17.369037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733142691:2446], now have 1 active actors on pipe
2025-10-01T14:11:17.369048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733142734:4391], now have 1 active actors on pipe
2025-10-01T14:11:17.369068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.369074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.369101Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:17.369110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:17.369115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:17.369118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:17.369131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:17.369146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:17.369166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:17.370277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.370288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.370316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:17.370513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1336 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0
2025-10-01T14:11:17.371190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b22acf9c-8749ebe5-1acbe968-14f05da7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:17.373555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0] Write session: try to update token
2025-10-01T14:11:17.373572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:17.396459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255698733142867:4741]
2025-10-01T14:11:17.396983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733142867:4741], now have 1 active actors on pipe
2025-10-01T14:11:17.397119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1335, pipe: [1:7556255698733142867:4741]
2025-10-01T14:11:17.411469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1336 sessionId: src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:17.414464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:17.414972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.414991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.415025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:17.415314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:17.420836Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:17.420853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:17.420855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:17.420857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:17.420866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255696356262949:9387]
2025-10-01T14:11:17.420870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255696356262949:9387]
2025-10-01T14:11:17.420874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255696356262949:9387]
2025-10-01T14:11:17.420916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:17.420924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.420926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:17.421080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:17.422798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:17.422807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:17.422810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:17.617408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:17.625492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.625516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.625669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.625724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.625784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.625855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.625893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.625897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.625961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.626016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.626073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.626129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.626178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.626180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.626235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.626281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.626400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.626454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.626492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.626495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.626553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.626610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.626660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.626710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.626750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.626754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.626816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.626870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.626931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.626990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.627030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.627032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.627145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.627199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.627258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.627319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.627360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.627364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.627427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.627487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.627547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.627604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.627641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.627643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.627706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.627766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.627822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.627883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.627922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.627925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.627992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.628052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.628116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.628174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.628213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.628215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.628276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:17.628331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:17.628386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:17.628439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:17.628482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:17.628485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:17.634788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:17.636357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:17.636399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:17.636437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1336 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0
2025-10-01T14:11:17.636634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1336 sessionId: src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0 is DEAD
2025-10-01T14:11:17.636783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255698733142867:4741]
2025-10-01T14:11:17.638574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:17.638585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0] Write session will restart in 0.009257s
2025-10-01T14:11:17.638610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0] Write session: Do CDS request
2025-10-01T14:11:17.638616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:17.651806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:17.652146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:17.652160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1337
2025-10-01T14:11:17.652363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:17.652388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:17.652393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:17.652396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:17.652818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1337 sessionId:  describe result for acl check
2025-10-01T14:11:17.652845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:17.652846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:17.652848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:17.652852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255698733142893:4379] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:17.653342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255698733142893:4379] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:17.657477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255698733142893:4379] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:17.665755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255698733142893:4379] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:17.665769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255698733142893:4379] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:17.665774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255698733142893:4379] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:17.665782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:17.672766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:17.676137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:17.676410Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:17.676414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:17.676424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:17.676474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:17.676506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255696356263126:9390]
2025-10-01T14:11:17.677203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:17.677469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:17.677508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:17.677834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:17.677881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.677881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.677882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.677883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.677884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.677885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.677886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.677887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.677888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.677889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.677890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.677891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.677892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.677892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.677896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.677904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.677908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.677912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.677915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.677918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.677922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.677925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.677928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.677932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.677935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.677939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.677942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.677945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.677951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.677957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.677962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.677966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.677970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.677974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.677978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.677983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.677988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.677991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.677995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.677999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.678002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.678006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.678010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.678013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.678017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.678021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.678024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.678029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.678032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.678036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.678040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.678044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.678049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.678053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.678057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.678061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.678091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:17.687787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:17.688586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:17.688590Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:17.688593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:17.688596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:17.688603Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1336 [2:7556255696356263126:9390]
2025-10-01T14:11:17.688618Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:17.688635Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:17.688638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:17.688641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:17.688643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:17.688659Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:17.688664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:17.688670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:17.688742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.688743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.688745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.688749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:17.688752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:17.688821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:17.688823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.688833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.688841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.688854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:17.688869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255696356263120:9390]
2025-10-01T14:11:17.688871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255696356263120:9390]
2025-10-01T14:11:17.688874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255696356263120:9390]
2025-10-01T14:11:17.688885Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:17.688897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:17.688909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:17.688912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:17.688948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255696356263120:9390]
2025-10-01T14:11:17.688950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:17.689179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:17.689187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:17.689189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:17.689194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:17.689606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733142972:4379], now have 1 active actors on pipe
2025-10-01T14:11:17.689613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733142877:2446], now have 1 active actors on pipe
2025-10-01T14:11:17.689808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1336
2025-10-01T14:11:17.689847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1336
2025-10-01T14:11:17.694538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.694561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.694603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6084e15-369b3845-fe607542-da60e31c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:17.694617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:17.694624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:17.694627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:17.694640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:17.694656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:17.694678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:17.700499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.700516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.700548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:17.700683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1337 partition: 0 MaxSeqNo: 45 sessionId: src_id|6084e15-369b3845-fe607542-da60e31c_0
2025-10-01T14:11:17.702608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d236f7b-f59313a0-e0a1e5b5-58826e56_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6084e15-369b3845-fe607542-da60e31c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:17.705202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e15-369b3845-fe607542-da60e31c_0] Write session: try to update token
2025-10-01T14:11:17.705218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e15-369b3845-fe607542-da60e31c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:17.716244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:17.716263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:17.716266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:17.716268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:17.716278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255696356263120:9390]
2025-10-01T14:11:17.716282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255696356263120:9390]
2025-10-01T14:11:17.716286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255696356263120:9390]
2025-10-01T14:11:17.716344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:17.716350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.716353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:17.716833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:17.716837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:17.716840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:17.717030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:17.738441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255698733143052:4741]
2025-10-01T14:11:17.738915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1336, pipe: [1:7556255698733143052:4741]
2025-10-01T14:11:17.753472Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1337 sessionId: src_id|6084e15-369b3845-fe607542-da60e31c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:17.756342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:17.908645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:17.909122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733143052:4741], now have 1 active actors on pipe
2025-10-01T14:11:17.909151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.909157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.909366Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:17.909953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255698733143052:4741]
2025-10-01T14:11:17.909982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:17.910036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1337 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6084e15-369b3845-fe607542-da60e31c_0
2025-10-01T14:11:17.910151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:17.910448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e15-369b3845-fe607542-da60e31c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:17.910457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e15-369b3845-fe607542-da60e31c_0] Write session will restart in 0.005877s
2025-10-01T14:11:17.910482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e15-369b3845-fe607542-da60e31c_0] Write session: Do CDS request
2025-10-01T14:11:17.910488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e15-369b3845-fe607542-da60e31c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:17.910233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1337 sessionId: src_id|6084e15-369b3845-fe607542-da60e31c_0 is DEAD
2025-10-01T14:11:17.919191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e15-369b3845-fe607542-da60e31c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:17.919494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:17.919507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1338
2025-10-01T14:11:17.920939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:17.920978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:17.920983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:17.920987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:17.921388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1338 sessionId:  describe result for acl check
2025-10-01T14:11:17.921416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:17.921418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:17.921419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:17.921424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255698733143103:4367] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:17.921888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255698733143103:4367] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:17.926581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255698733143103:4367] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:17.930454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255698733143103:4367] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:17.930471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255698733143103:4367] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:17.930474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255698733143103:4367] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:17.930482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:17.937730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:17.939098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:17.939303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:17.939314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:17.939326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:17.939379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:17.939418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255696356263315:9395]
2025-10-01T14:11:17.940051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:17.940439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:17.940484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:17.940839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:17.940892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.940893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.940894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.940895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.940896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.940897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.940899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.940900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.940902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.940902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.940904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.940905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.940906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.940907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.940912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.940921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.940925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.940928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.940932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.940936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.940940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.940943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.940947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.940951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.940954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.940957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.940961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.940964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.940972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.940979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:17.940985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.940991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:17.940995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.941000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:17.941004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.941009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:17.941013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.941017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:17.941022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.941026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:17.941031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.941035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:17.941039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.941044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:17.941048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.941053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:17.941057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.941062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.941067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.941071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.941075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.941079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.941083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.941088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:17.941092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.941097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:17.941134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:17.944855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:17.945573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:17.945588Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:17.945591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:17.945596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:17.945603Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1337 [2:7556255696356263315:9395]
2025-10-01T14:11:17.945618Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:17.945634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:17.945644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:17.945648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:17.945655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:17.945672Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:17.945683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:17.945690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:17.945750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.945756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.945759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.945762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:17.945765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:17.945831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:17.945840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.945852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:17.945863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:17.945880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:17.945897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733143075:2446], now have 1 active actors on pipe
2025-10-01T14:11:17.945900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255698733143226:4367], now have 1 active actors on pipe
2025-10-01T14:11:17.945908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1337
2025-10-01T14:11:17.945908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255696356263310:9395]
2025-10-01T14:11:17.945910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255696356263310:9395]
2025-10-01T14:11:17.945952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1337
2025-10-01T14:11:17.945912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255696356263310:9395]
2025-10-01T14:11:17.945928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:17.945941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:17.945948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:17.945950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:17.945952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:17.945955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:17.945958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:17.945992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255696356263310:9395]
2025-10-01T14:11:17.946000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:17.946001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:17.946030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.946035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.946060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:17.946066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:17.946070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:17.946072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:17.946080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:17.946089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:17.946101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:17.946257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:17.946266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:17.946280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:17.946361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1338 partition: 0 MaxSeqNo: 45 sessionId: src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0
2025-10-01T14:11:17.950160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6084e15-369b3845-fe607542-da60e31c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:17.952453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0] Write session: try to update token
2025-10-01T14:11:17.952472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:17.977227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1338 sessionId: src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:17.979416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:17.978451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:17.978469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:17.978472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:17.978474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:17.978484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255696356263310:9395]
2025-10-01T14:11:17.978491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255696356263310:9395]
2025-10-01T14:11:17.978495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255696356263310:9395]
2025-10-01T14:11:17.978545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:17.978552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:17.978555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:17.978707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:17.979557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:17.979561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:17.979563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:18.014431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255703028110563:4741]
2025-10-01T14:11:18.014819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1337, pipe: [1:7556255703028110563:4741]
2025-10-01T14:11:18.135470Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:18.135801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.135814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.135857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028110563:4741], now have 1 active actors on pipe
2025-10-01T14:11:18.136171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:18.136741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:18.136814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1338 reason: status is not ok: tablet will be restarted right now sessionId: src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0
2025-10-01T14:11:18.137018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1338 sessionId: src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0 is DEAD
2025-10-01T14:11:18.137136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:18.137275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255703028110563:4741]
2025-10-01T14:11:18.138634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:18.138645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0] Write session will restart in 0.008891s
2025-10-01T14:11:18.138672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0] Write session: Do CDS request
2025-10-01T14:11:18.138678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:18.150885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:18.151156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:18.151174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1339
2025-10-01T14:11:18.151291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:18.151317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:18.151323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:18.151327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:18.151701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1339 sessionId:  describe result for acl check
2025-10-01T14:11:18.151731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:18.151733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:18.151735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:18.151740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255703028110582:4360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:18.152247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255703028110582:4360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:18.157497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255703028110582:4360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:18.176009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255703028110582:4360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:18.176025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255703028110582:4360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:18.176028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255703028110582:4360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:18.176037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:18.175713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:18.184882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:18.185130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:18.185135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:18.185145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:18.185196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:18.185236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255700651230782:9398]
2025-10-01T14:11:18.185755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:18.186595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:18.186642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:18.186929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:18.186984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.186985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.186987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.186988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.186989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.186990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.186992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.186993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.186994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.186995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.186997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.186998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.186999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.187000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.187006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.187015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.187019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.187023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.187027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.187031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.187035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.187039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.187043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.187046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.187050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.187053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.187056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.187059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.187066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.187074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.187080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.187084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.187089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.187094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.187098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.187102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.187106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.187111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.187115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.187120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.187125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.187130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.187133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.187138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.187143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.187147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.187151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.187157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.187160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.187166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.187170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.187175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.187182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.187186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.187189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.187195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.187233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:18.191125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:18.192842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1338
2025-10-01T14:11:18.192874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1338
2025-10-01T14:11:18.191797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:18.191810Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:18.191813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:18.191817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:18.191823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1338 [2:7556255700651230782:9398]
2025-10-01T14:11:18.191840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:18.191855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:18.191858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:18.191861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:18.191863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:18.191878Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:18.191884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:18.191889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:18.191949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.191951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.191953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.191956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:18.191958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:18.192023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:18.192026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.192038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.192049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.192065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:18.192080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255700651230775:9398]
2025-10-01T14:11:18.192083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255700651230775:9398]
2025-10-01T14:11:18.192085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255700651230775:9398]
2025-10-01T14:11:18.192095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:18.192108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:18.192121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:18.192125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:18.192153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255700651230775:9398]
2025-10-01T14:11:18.192155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:18.192245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:18.192247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:18.192249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:18.192254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:18.193266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028110566:2446], now have 1 active actors on pipe
2025-10-01T14:11:18.193270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028110730:4360], now have 1 active actors on pipe
2025-10-01T14:11:18.193285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.193291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.193313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:18.193320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:18.193324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:18.193326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:18.193336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:18.193346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:18.193359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:18.196749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1339 partition: 0 MaxSeqNo: 45 sessionId: src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0
2025-10-01T14:11:18.197234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93974c6d-7d47f21d-bda37ecc-2a032ad1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:18.196536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.196551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.196583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:18.201968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0] Write session: try to update token
2025-10-01T14:11:18.202425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:18.231078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:18.231096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:18.231099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:18.231101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:18.231112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255700651230775:9398]
2025-10-01T14:11:18.231118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255700651230775:9398]
2025-10-01T14:11:18.231122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255700651230775:9398]
2025-10-01T14:11:18.231168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:18.231177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.231180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:18.231311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:18.236263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1339 sessionId: src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:18.238611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:18.238694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255703028110743:4741]
2025-10-01T14:11:18.239968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:18.239985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:18.239990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:18.243708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1338, pipe: [1:7556255703028110743:4741]
2025-10-01T14:11:18.406304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:18.410140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.410159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.410180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028110743:4741], now have 1 active actors on pipe
2025-10-01T14:11:18.410677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:18.411384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:18.411438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:18.411441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:18.411493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1339 reason: error at write: Disconnected sessionId: src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0
2025-10-01T14:11:18.411680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1339 sessionId: src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0 is DEAD
2025-10-01T14:11:18.411807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255703028110743:4741]
2025-10-01T14:11:18.414142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:18.414153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0] Write session will restart in 0.005654s
2025-10-01T14:11:18.414181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0] Write session: Do CDS request
2025-10-01T14:11:18.414187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:18.422018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:18.422334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:18.422350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1340
2025-10-01T14:11:18.424205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:18.424248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:18.424253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:18.424257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:18.425161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1340 sessionId:  describe result for acl check
2025-10-01T14:11:18.425197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:18.425198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:18.425200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:18.425205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255703028110767:4356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:18.425692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255703028110767:4356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:18.428216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255703028110767:4356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:18.430668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255703028110767:4356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:18.430679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255703028110767:4356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:18.430683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255703028110767:4356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:18.430691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:18.448324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:18.451605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:18.451843Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:18.451848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:18.451858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:18.451909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:18.451937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255700651230981:9410]
2025-10-01T14:11:18.452531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:18.452898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:18.452945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:18.453250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:18.453318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.453319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.453320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.453321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.453322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.453324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.453325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.453326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.453327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.453328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.453330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.453331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.453332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.453333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.453337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.453346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.453350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.453353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.453357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.453360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.453363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.453367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.453370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.453373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.453377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.453380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.453384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.453387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.453394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.453401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.453407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.453412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.453417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.453422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.453427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.453432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.453437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.453443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.453447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.453452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.453459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.453464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.453468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.453473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.453477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.453483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.453487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.453492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.453497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.453502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.453510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.453515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.453520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.453524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.453528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.453534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.453571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:18.457531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:18.458194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:18.458207Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:18.458209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:18.458214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:18.458221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1339 [2:7556255700651230981:9410]
2025-10-01T14:11:18.458236Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:18.458252Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:18.458259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:18.458263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:18.458266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:18.458280Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:18.458290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:18.458295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:18.458346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.458353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.458356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.458359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:18.458361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:18.458444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:18.458451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.458462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.458474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.458490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:18.458508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255700651230976:9410]
2025-10-01T14:11:18.458510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255700651230976:9410]
2025-10-01T14:11:18.458512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255700651230976:9410]
2025-10-01T14:11:18.458527Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:18.458540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:18.458554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:18.458557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:18.458583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255700651230976:9410]
2025-10-01T14:11:18.458586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:18.458743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:18.458745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:18.458746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:18.458750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:18.459391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028110755:2446], now have 1 active actors on pipe
2025-10-01T14:11:18.459395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028110813:4356], now have 1 active actors on pipe
2025-10-01T14:11:18.462258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1339
2025-10-01T14:11:18.462300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1339
2025-10-01T14:11:18.462958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.462975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.463004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:18.463014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:18.463019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:18.463022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:18.463034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:18.463049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:18.463066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:18.466443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.466462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.466507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:18.467098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1340 partition: 0 MaxSeqNo: 45 sessionId: src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0
2025-10-01T14:11:18.467538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dba5aa-bd1be7d1-b6898c00-f3830892_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:18.469793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0] Write session: try to update token
2025-10-01T14:11:18.469810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:18.486917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:18.486936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:18.486939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:18.486941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:18.486950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255700651230976:9410]
2025-10-01T14:11:18.486954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255700651230976:9410]
2025-10-01T14:11:18.486958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255700651230976:9410]
2025-10-01T14:11:18.487006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:18.487013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.487015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:18.487150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:18.491045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:18.491062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:18.491067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:18.489299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1340 sessionId: src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:18.491741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:18.513858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255703028110935:4741]
2025-10-01T14:11:18.520134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1339, pipe: [1:7556255703028110935:4741]
2025-10-01T14:11:18.697101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:18.706674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.706691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.706727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028110935:4741], now have 1 active actors on pipe
2025-10-01T14:11:18.710722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:18.710736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:18.710805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1340 reason: error at write: Disconnected sessionId: src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0
2025-10-01T14:11:18.710983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255703028110935:4741]
2025-10-01T14:11:18.710999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:18.711015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1340 sessionId: src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0 is DEAD
2025-10-01T14:11:18.711430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:18.711438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0] Write session will restart in 0.009865s
2025-10-01T14:11:18.711473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0] Write session: Do CDS request
2025-10-01T14:11:18.711482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:18.714529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:18.726279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:18.726674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:18.726688Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1341
2025-10-01T14:11:18.727329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:18.727364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:18.727369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:18.727372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:18.728243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1341 sessionId:  describe result for acl check
2025-10-01T14:11:18.728272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:18.728273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:18.728274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:18.728279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255703028111011:4348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:18.728771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255703028111011:4348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:18.737924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255703028111011:4348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:18.746410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255703028111011:4348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:18.746428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255703028111011:4348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:18.746431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255703028111011:4348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:18.746440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:18.747155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:18.749495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:18.749698Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:18.749702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:18.749709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:18.749744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:18.749773Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255700651231156:9413]
2025-10-01T14:11:18.750158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:18.750554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:18.750608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:18.750868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:18.750923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.750929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.750930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.750931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.750932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.750934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.750936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.750937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.750938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.750939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.750940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.750941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.750942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.750943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.750948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.750958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.750962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.750966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.750970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.750974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.750978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.750984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.750988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.750991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.750995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.750999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.751003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.751011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.751018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.751029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:18.751038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.751044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:18.751050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.751055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:18.751062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.751067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:18.751077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.751082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:18.751088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.751093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:18.751102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.751106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:18.751111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.751117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:18.751122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.751128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:18.751132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.751140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.751143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.751148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.751152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.751157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.751162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.751167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:18.751185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.751189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:18.751220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:18.757616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:18.758200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:18.758206Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:18.758209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:18.758213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:18.758221Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1340 [2:7556255700651231156:9413]
2025-10-01T14:11:18.758238Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:18.758256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:18.758259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:18.758263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:18.758265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:18.758283Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:18.758288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:18.758294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:18.758351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.758353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.758355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.758358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:18.758361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:18.758449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:18.758452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.758464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:18.758476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:18.758490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:18.758506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255700651231149:9413]
2025-10-01T14:11:18.758509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255700651231149:9413]
2025-10-01T14:11:18.758511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255700651231149:9413]
2025-10-01T14:11:18.758523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:18.758536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:18.758551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:18.758554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:18.758592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255700651231149:9413]
2025-10-01T14:11:18.758595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:18.761652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:18.761655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:18.761657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:18.761665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:18.762561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1340
2025-10-01T14:11:18.762593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1340
2025-10-01T14:11:18.762799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028111104:4348], now have 1 active actors on pipe
2025-10-01T14:11:18.762814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028110938:2446], now have 1 active actors on pipe
2025-10-01T14:11:18.762836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.762843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.762876Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:18.762887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:18.762892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:18.762895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:18.762907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:18.762923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:18.762942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:18.766193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.766210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.766243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:18.766329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1341 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0
2025-10-01T14:11:18.771595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3be8da1-ecc3cca7-96cbc53-1f73f309_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:18.774096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0] Write session: try to update token
2025-10-01T14:11:18.774115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:18.792459Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:18.792493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:18.792495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:18.792497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:18.792507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255700651231149:9413]
2025-10-01T14:11:18.792513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255700651231149:9413]
2025-10-01T14:11:18.792517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255700651231149:9413]
2025-10-01T14:11:18.792566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:18.792578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:18.792581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:18.792733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:18.794196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:18.794209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:18.794213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:18.815589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255703028111120:4741]
2025-10-01T14:11:18.816434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1340, pipe: [1:7556255703028111120:4741]
2025-10-01T14:11:18.825902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1341 sessionId: src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:18.828650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:18.975846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:18.976355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028111120:4741], now have 1 active actors on pipe
2025-10-01T14:11:18.976411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:18.976418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:18.977670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:18.979659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:18.979670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0] Write session will restart in 0.005318s
2025-10-01T14:11:18.979692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0] Write session: Do CDS request
2025-10-01T14:11:18.979698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:18.978930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255703028111120:4741]
2025-10-01T14:11:18.978967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:18.978997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:18.979069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1341 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0
2025-10-01T14:11:18.979254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1341 sessionId: src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0 is DEAD
2025-10-01T14:11:18.986011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:18.986557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:18.986570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1342
2025-10-01T14:11:18.990129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:18.990167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:18.990171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:18.990175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:18.990605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1342 sessionId:  describe result for acl check
2025-10-01T14:11:18.990633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:18.990635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:18.990637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:18.990641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255703028111154:4336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:18.991070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255703028111154:4336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:19.001998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255703028111154:4336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:19.017533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255703028111154:4336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:19.017550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255703028111154:4336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:19.017554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255703028111154:4336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:19.017561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:19.016501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:19.019468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:19.019699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:19.019703Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:19.019714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:19.019756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:19.019785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255704946198647:9417]
2025-10-01T14:11:19.020324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:19.020799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:19.020836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:19.021135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:19.021177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.021179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.021180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.021181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.021182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.021184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.021186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.021187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.021188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.021189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.021191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.021192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.021193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.021195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.021200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.021209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.021214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.021218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.021222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.021226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.021230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.021234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.021238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.021242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.021247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.021251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.021255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.021259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.021266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.021274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.021279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.021285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.021289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.021294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.021298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.021304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.021309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.021314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.021318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.021323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.021328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.021333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.021338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.021343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.021348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.021353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.021358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.021363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.021368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.021373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.021377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.021383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.021388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.021393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.021397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.021403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.021458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:19.029864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:19.030668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:19.030673Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:19.030676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:19.030680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:19.030688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1341 [2:7556255704946198647:9417]
2025-10-01T14:11:19.030704Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:19.030719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:19.030722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:19.030726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:19.030729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:19.030745Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:19.030751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:19.030757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:19.030830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.030832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.030835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.030838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:19.030840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:19.030906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:19.030908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.030919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.030929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.030945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:19.030961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255704946198640:9417]
2025-10-01T14:11:19.030963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255704946198640:9417]
2025-10-01T14:11:19.030965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255704946198640:9417]
2025-10-01T14:11:19.030978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:19.030992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:19.031004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:19.031006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:19.031044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255704946198640:9417]
2025-10-01T14:11:19.031046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:19.031328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:19.031334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:19.031336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:19.031340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:19.031927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323078616:4336], now have 1 active actors on pipe
2025-10-01T14:11:19.031936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255703028111139:2446], now have 1 active actors on pipe
2025-10-01T14:11:19.032284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.032296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.032336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:19.032344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:19.032349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:19.032351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:19.032362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:19.032374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:19.032392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:19.032898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.032905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.032921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:19.033423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1ca48b-7e63b17-40df38c9-b3e4e14f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:19.031927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1341
2025-10-01T14:11:19.031951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1341
2025-10-01T14:11:19.033060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1342 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0
2025-10-01T14:11:19.036014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0] Write session: try to update token
2025-10-01T14:11:19.036029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:19.067186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1342 sessionId: src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:19.069541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:19.070591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.070614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.070632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:19.070635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:19.070636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:19.070638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:19.070643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255704946198640:9417]
2025-10-01T14:11:19.070647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255704946198640:9417]
2025-10-01T14:11:19.070650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255704946198640:9417]
2025-10-01T14:11:19.070692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:19.070694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:19.070701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.070702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:19.070704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:19.070708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:19.070829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:19.074772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255707323078633:4741]
2025-10-01T14:11:19.075955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1341, pipe: [1:7556255707323078633:4741]
2025-10-01T14:11:19.227356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:19.227957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:19.227787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:19.227819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323078633:4741], now have 1 active actors on pipe
2025-10-01T14:11:19.232415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255707323078633:4741]
2025-10-01T14:11:19.232454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:19.238994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:19.239007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:19.239030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1342 reason: error at write: Disconnected sessionId: src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0
2025-10-01T14:11:19.239166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1342 sessionId: src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0 is DEAD
2025-10-01T14:11:19.239369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:19.239380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0] Write session will restart in 0.005282s
2025-10-01T14:11:19.239405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0] Write session: Do CDS request
2025-10-01T14:11:19.239413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:19.245834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:19.246936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:19.246950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1343
2025-10-01T14:11:19.247093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:19.247121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:19.247130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:19.247133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:19.247519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1343 sessionId:  describe result for acl check
2025-10-01T14:11:19.247548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:19.247549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:19.247551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:19.247556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255707323078650:4321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:19.248024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255707323078650:4321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:19.250624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255707323078650:4321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:19.254121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255707323078650:4321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:19.254134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255707323078650:4321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:19.254138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255707323078650:4321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:19.254145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:19.273444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:19.276242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:19.276449Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:19.276467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:19.276476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:19.276519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:19.276548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255704946198820:9421]
2025-10-01T14:11:19.277159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:19.277798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:19.277850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:19.278182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:19.278234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.278235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.278236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.278237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.278239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.278240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.278241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.278242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.278243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.278244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.278245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.278247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.278248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.278249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.278254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.278263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.278266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.278269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.278273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.278276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.278281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.278284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.278288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.278292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.278295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.278299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.278303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.278306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.278314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.278321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.278327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.278332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.278336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.278341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.278347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.278352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.278356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.278360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.278364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.278380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.278385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.278389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.278393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.278397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.278401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.278405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.278411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.278423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.278427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.278432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.278436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.278440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.278444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.278449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.278452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.278459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.278497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:19.289407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:19.290392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:19.290405Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:19.290408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:19.290411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:19.290418Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1342 [2:7556255704946198820:9421]
2025-10-01T14:11:19.290434Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:19.290450Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:19.290453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:19.290456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:19.290459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:19.290476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:19.290483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:19.290493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:19.290549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.290556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.290558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.290561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:19.290564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:19.290633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:19.290641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.290653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.290664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.290680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:19.290697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323078636:2446], now have 1 active actors on pipe
2025-10-01T14:11:19.290701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323078685:4321], now have 1 active actors on pipe
2025-10-01T14:11:19.290708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255704946198815:9421]
2025-10-01T14:11:19.290710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255704946198815:9421]
2025-10-01T14:11:19.290712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255704946198815:9421]
2025-10-01T14:11:19.290724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:19.290736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:19.290738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:19.290741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:19.290743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:19.290749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:19.290752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:19.290795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255704946198815:9421]
2025-10-01T14:11:19.290807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:19.290831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1342
2025-10-01T14:11:19.290881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1342
2025-10-01T14:11:19.291058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:19.291179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.291189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.291212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:19.291222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:19.291226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:19.291229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:19.291237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:19.291249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:19.291266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:19.291428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.291436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.291450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:19.291548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1343 partition: 0 MaxSeqNo: 45 sessionId: src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0
2025-10-01T14:11:19.291862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c88685b-5507d0d-c55b61a8-4d69c587_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:19.294096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0] Write session: try to update token
2025-10-01T14:11:19.294113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:19.313158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1343 sessionId: src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:19.317217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:19.316972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:19.316991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:19.316994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:19.316995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:19.317004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255704946198815:9421]
2025-10-01T14:11:19.317007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255704946198815:9421]
2025-10-01T14:11:19.317010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255704946198815:9421]
2025-10-01T14:11:19.317050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:19.317054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:19.317057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:19.317057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:19.317064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.317067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:19.317194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:19.332450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255707323078818:4741]
2025-10-01T14:11:19.333048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1342, pipe: [1:7556255707323078818:4741]
2025-10-01T14:11:19.475485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:19.475903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.475918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.475956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323078818:4741], now have 1 active actors on pipe
2025-10-01T14:11:19.476145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:19.476483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255707323078818:4741]
2025-10-01T14:11:19.476511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:19.476540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:19.476602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1343 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0
2025-10-01T14:11:19.476794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1343 sessionId: src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0 is DEAD
2025-10-01T14:11:19.477293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:19.477301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0] Write session will restart in 0.008688s
2025-10-01T14:11:19.477326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0] Write session: Do CDS request
2025-10-01T14:11:19.477332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:19.486818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:19.489146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:19.489161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1344
2025-10-01T14:11:19.489267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:19.489292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:19.489297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:19.489301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:19.489918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1344 sessionId:  describe result for acl check
2025-10-01T14:11:19.489948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:19.489950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:19.489951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:19.489956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255707323078845:4312] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:19.490532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255707323078845:4312] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:19.506743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255707323078845:4312] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:19.509722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:19.512421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255707323078845:4312] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:19.512435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255707323078845:4312] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:19.512437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255707323078845:4312] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:19.512444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:19.513129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:19.513391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:19.513396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:19.513408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:19.513459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:19.513492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255704946199025:9433]
2025-10-01T14:11:19.514040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:19.514308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:19.514350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:19.514643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:19.514709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.514710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.514712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.514713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.514714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.514715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.514717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.514718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.514719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.514721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.514722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.514723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.514724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.514725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.514730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.514740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.514744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.514747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.514750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.514753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.514757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.514761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.514764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.514768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.514771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.514774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.514777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.514781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.514789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.514795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.514801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.514806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.514811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.514815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.514820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.514825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.514829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.514834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.514838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.514843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.514848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.514852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.514856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.514861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.514867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.514871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.514875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.514880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.514884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.514888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.514892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.514896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.514901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.514905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.514908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.514913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.514949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:19.531374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:19.532074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:19.533203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1343
2025-10-01T14:11:19.533232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1343
2025-10-01T14:11:19.533871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1344 partition: 0 MaxSeqNo: 45 sessionId: src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0
2025-10-01T14:11:19.532080Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:19.532083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:19.532087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:19.532095Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1343 [2:7556255704946199025:9433]
2025-10-01T14:11:19.532111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:19.532129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:19.532132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:19.532135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:19.532137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:19.532153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:19.532158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:19.532165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:19.532223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.532225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.532227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.532230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:19.532233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:19.532305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:19.532308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.532318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.532329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.532344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:19.532360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255704946199019:9433]
2025-10-01T14:11:19.532363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255704946199019:9433]
2025-10-01T14:11:19.532365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255704946199019:9433]
2025-10-01T14:11:19.532374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:19.532389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:19.532403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:19.532406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:19.532441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255704946199019:9433]
2025-10-01T14:11:19.532443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:19.532626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:19.532628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:19.532630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:19.532634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:19.533408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323078999:4312], now have 1 active actors on pipe
2025-10-01T14:11:19.533412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323078829:2446], now have 1 active actors on pipe
2025-10-01T14:11:19.533424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.533429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.533454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:19.533493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:19.533497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:19.533501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:19.533512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:19.533522Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:19.533536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:19.533747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.533750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.533762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:19.538485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e77159cd-13c7e0f1-a123e6b-e3aeaadb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:19.541190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0] Write session: try to update token
2025-10-01T14:11:19.541205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:19.578446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255707323079009:4741]
2025-10-01T14:11:19.578773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323079009:4741], now have 1 active actors on pipe
2025-10-01T14:11:19.578874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1343, pipe: [1:7556255707323079009:4741]
2025-10-01T14:11:19.598305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1344 sessionId: src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:19.600748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:19.601576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.601596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.601631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:19.606698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:19.634685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:19.634699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:19.634702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:19.637502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:19.637514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:19.637517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:19.637519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:19.637527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255704946199019:9433]
2025-10-01T14:11:19.637532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255704946199019:9433]
2025-10-01T14:11:19.637536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255704946199019:9433]
2025-10-01T14:11:19.637577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:19.637583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.637585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:19.637720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:19.642571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:19.642584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:19.642588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:19.807863Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:19.816026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.816051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.816210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.816264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.816317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.816371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.816413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.816418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.816481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.816534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.816598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.816657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.816704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.816707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.816768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.816816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.816870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.816929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.816971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.816974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.817032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.817085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.817135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.817202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.817244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.817252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.817312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.817369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.817426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.817486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.817530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.817537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.817600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.817658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.817717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.817774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.819599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:19.819645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255707323079009:4741]
2025-10-01T14:11:19.819663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:19.819666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:19.819689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1344 reason: error at write: Disconnected sessionId: src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0
2025-10-01T14:11:19.819878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1344 sessionId: src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0 is DEAD
2025-10-01T14:11:19.820727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:19.820737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0] Write session will restart in 0.008339s
2025-10-01T14:11:19.820762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0] Write session: Do CDS request
2025-10-01T14:11:19.820768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:19.817819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.817829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.817890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.817942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.818000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.818057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.818101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.818103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.818161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.818214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.818270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.818325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.818361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.818363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.818449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.818503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.818557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.818613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.818652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.818655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.818713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:19.818763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:19.818813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:19.818865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:19.818904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:19.818907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:19.820071Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:19.835161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:19.835474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:19.835495Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1345
2025-10-01T14:11:19.835693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:19.835732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:19.835737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:19.835740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:19.836901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1345 sessionId:  describe result for acl check
2025-10-01T14:11:19.836935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:19.836937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:19.836938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:19.836943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255707323079042:4307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:19.837420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255707323079042:4307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:19.851838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255707323079042:4307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:19.859786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:19.862697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:19.862868Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:19.862872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:19.862881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:19.862935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:19.862962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255704946199213:9436]
2025-10-01T14:11:19.863483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:19.863589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255707323079042:4307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:19.863603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255707323079042:4307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:19.863607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255707323079042:4307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:19.863614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:19.863968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:19.864007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:19.864242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:19.864301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.864307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.864308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.864310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.864311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.864313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.864314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.864315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.864316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.864317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.864318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.864319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.864320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.864322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.864327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.864336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.864341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.864345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.864349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.864352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.864356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.864371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.864378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.864382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.864386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.864392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.864396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.864402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.864410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.864420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:19.864426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.864434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:19.864438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.864443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:19.864450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.864455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:19.864461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.864465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:19.864471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.864476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:19.864481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.864485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:19.864493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.864498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:19.864505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.864510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:19.864514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.864522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.864527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.864535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.864539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.864547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.864551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.864555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:19.864562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.864567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:19.864601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:19.868533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:19.869276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:19.869280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:19.869283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:19.869286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:19.869291Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1344 [2:7556255704946199213:9436]
2025-10-01T14:11:19.869304Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:19.869318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:19.869321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:19.869323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:19.869326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:19.869338Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:19.869344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:19.869348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:19.869396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.869397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.869399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.869402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:19.869404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:19.869458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:19.869461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.869471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:19.869481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:19.869497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:19.869510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255704946199201:9436]
2025-10-01T14:11:19.869513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255704946199201:9436]
2025-10-01T14:11:19.869515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255704946199201:9436]
2025-10-01T14:11:19.869522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:19.869534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:19.869548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:19.869550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:19.869570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255704946199201:9436]
2025-10-01T14:11:19.869572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:19.869637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:19.869639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:19.869641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:19.869644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:19.870248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1344
2025-10-01T14:11:19.870278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1344
2025-10-01T14:11:19.870557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323079017:2446], now have 1 active actors on pipe
2025-10-01T14:11:19.870566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323079189:4307], now have 1 active actors on pipe
2025-10-01T14:11:19.872197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.872209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.872238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:19.872257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:19.872262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:19.872265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:19.872275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:19.872287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:19.872303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:19.873132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.873141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.873156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:19.873282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1345 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0
2025-10-01T14:11:19.874613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a8e77fc-5b3aa67e-c6e1e5a9-451c8210_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:19.876907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0] Write session: try to update token
2025-10-01T14:11:19.876922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:19.897489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1345 sessionId: src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:19.899614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:19.901419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:19.901436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:19.901471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:19.901631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:19.913497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:19.913514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:19.913516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:19.913518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:19.913527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255704946199201:9436]
2025-10-01T14:11:19.913532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255704946199201:9436]
2025-10-01T14:11:19.913536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255704946199201:9436]
2025-10-01T14:11:19.913579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:19.913586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:19.913588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:19.913713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:19.914422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:19.914427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:19.914432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:19.922465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255707323079201:4741]
2025-10-01T14:11:19.926108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1344, pipe: [1:7556255707323079201:4741]
2025-10-01T14:11:20.078613Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:20.079120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255707323079201:4741], now have 1 active actors on pipe
2025-10-01T14:11:20.091012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.091036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.091213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.091269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.091328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.091394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.091434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.091453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.091522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.091579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.091636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.091700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.091741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.091744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.091821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.091872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.091931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.091986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.092021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.092024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.092082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.092137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.092190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.092242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.092279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.092282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.092338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.092390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.092441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.092498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.092536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.092539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.092597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.092649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.092717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.092774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.092813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.092817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.092876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.092930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.092986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.093044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.093083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.093086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.093143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.093197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.093251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.093305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.093344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.093347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.093408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.093465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.093523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.093582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.093621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.093623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.093685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.093741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.093799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.093857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.093896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.093898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.095006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:20.095018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0] Write session will restart in 0.008627s
2025-10-01T14:11:20.095041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0] Write session: Do CDS request
2025-10-01T14:11:20.095047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:20.094425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:20.094438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:20.094464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1345 reason: error at write: Disconnected sessionId: src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0
2025-10-01T14:11:20.094679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255707323079201:4741]
2025-10-01T14:11:20.094694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1345 sessionId: src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0 is DEAD
2025-10-01T14:11:20.094695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:20.095857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:20.105091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:20.105287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:20.105302Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1346
2025-10-01T14:11:20.107330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:20.107363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:20.107368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:20.107372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:20.108177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1346 sessionId:  describe result for acl check
2025-10-01T14:11:20.108205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:20.108207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:20.108209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:20.108214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255711618046546:4291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:20.108716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255711618046546:4291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:20.111808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255711618046546:4291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:20.116418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255711618046546:4291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:20.116434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255711618046546:4291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:20.116438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255711618046546:4291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:20.116446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:20.135888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:20.138940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:20.139130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:20.139134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:20.139145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:20.139186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:20.139219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255709241166697:9442]
2025-10-01T14:11:20.139801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:20.140161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:20.140193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:20.140457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:20.140497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.140498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.140499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.140500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.140502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.140503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.140504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.140505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.140506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.140508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.140509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.140510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.140511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.140512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.140517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.140526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.140530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.140534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.140538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.140541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.140545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.140548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.140552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.140556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.140559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.140563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.140566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.140570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.140576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.140582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.140588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.140593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.140598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.140603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.140607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.140612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.140616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.140620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.140624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.140629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.140634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.140639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.140642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.140647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.140651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.140656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.140660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.140665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.140669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.140674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.140678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.140682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.140698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.140702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.140705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.140711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.140748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:20.150445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:20.151085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:20.151091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:20.151095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:20.151098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:20.151106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1345 [2:7556255709241166697:9442]
2025-10-01T14:11:20.151123Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:20.151141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:20.151145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:20.151149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:20.151152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:20.151169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:20.151175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:20.151181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:20.151244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.151247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.151249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.151253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:20.151256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:20.151328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:20.151332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.151344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.151354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.151369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:20.151386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255709241166691:9442]
2025-10-01T14:11:20.151388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255709241166691:9442]
2025-10-01T14:11:20.151391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255709241166691:9442]
2025-10-01T14:11:20.151405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:20.151419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:20.151433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:20.151436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:20.151475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255709241166691:9442]
2025-10-01T14:11:20.151478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:20.152528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:20.152531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:20.152533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:20.152539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:20.153223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1345
2025-10-01T14:11:20.153247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1345
2025-10-01T14:11:20.153985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1346 partition: 0 MaxSeqNo: 45 sessionId: src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0
2025-10-01T14:11:20.154464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a559fe6-d2069539-a27dddb6-aeb5b503_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:20.153478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255711618046584:4291], now have 1 active actors on pipe
2025-10-01T14:11:20.153489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255711618046537:2446], now have 1 active actors on pipe
2025-10-01T14:11:20.153504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.153510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.153538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:20.153547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:20.153552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:20.153555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:20.153566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:20.153579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:20.153597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:20.153846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.153850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.153866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:20.156896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0] Write session: try to update token
2025-10-01T14:11:20.156915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:20.187966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1346 sessionId: src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:20.190526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:20.190748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.190768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.190806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:20.190936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:20.196503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:20.196520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:20.196522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:20.196524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:20.196533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255709241166691:9442]
2025-10-01T14:11:20.196537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255709241166691:9442]
2025-10-01T14:11:20.196541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255709241166691:9442]
2025-10-01T14:11:20.196583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:20.196590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.196592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:20.196731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:20.199033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:20.199043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:20.199047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:20.194826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255711618046717:4741]
2025-10-01T14:11:20.199294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1345, pipe: [1:7556255711618046717:4741]
2025-10-01T14:11:20.370985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:20.371399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255711618046717:4741], now have 1 active actors on pipe
2025-10-01T14:11:20.378270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.378288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.378441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.378488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.378538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.378593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.378630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.378633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.378693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.378741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.378791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.378844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.378880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.378882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.378941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.378995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.379044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.379090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.379126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.379128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.379181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.379229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.379274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.379322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.379357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.379359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.379408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.379458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.379510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.379556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.379592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.379594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.379648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.379693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.379743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.379795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.379835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.379838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.379889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.379949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.380017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.380073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.380124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.380131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.380188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.380241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.380294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.380348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.380394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.380401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.380463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.380524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.380583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.380638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.380683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.380700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.380768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.380824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.380889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.380953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.380995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.380998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.381999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:20.382775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:20.382821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1346 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0
2025-10-01T14:11:20.382877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255711618046717:4741]
2025-10-01T14:11:20.382892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:20.383025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1346 sessionId: src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0 is DEAD
2025-10-01T14:11:20.384190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:20.384201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0] Write session will restart in 0.006064s
2025-10-01T14:11:20.384225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0] Write session: Do CDS request
2025-10-01T14:11:20.384231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:20.394083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:20.398768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:20.398785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1347
2025-10-01T14:11:20.398994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:20.399028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:20.399033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:20.399037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:20.399484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1347 sessionId:  describe result for acl check
2025-10-01T14:11:20.399521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:20.399523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:20.399525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:20.399530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255711618046743:4289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:20.400029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255711618046743:4289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:20.404551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255711618046743:4289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:20.428264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255711618046743:4289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:20.428280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255711618046743:4289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:20.428285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255711618046743:4289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:20.428293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:20.440107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:20.444749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:20.445000Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:20.445004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:20.445015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:20.445060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:20.445092Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255709241166905:9450]
2025-10-01T14:11:20.445635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:20.448482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:20.448538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:20.449557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:20.449637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.449638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.449640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.449641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.449642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.449643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.449644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.449646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.449647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.449648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.449649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.449650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.449651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.449653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.449659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.449668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.449672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.449676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.449680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.449684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.449687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.449691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.449695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.449699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.449702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.449705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.449709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.449712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.449720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.449727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.449733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.449739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.449743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.449748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.449752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.449757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.449761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.449766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.449771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.449775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.449780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.449784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.449789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.449794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.449798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.449803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.449807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.449812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.449816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.449821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.449825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.449829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.449834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.449838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.449842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.449846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.449886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:20.480079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:20.481083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:20.481088Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:20.481091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:20.481094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:20.481101Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1346 [2:7556255709241166905:9450]
2025-10-01T14:11:20.481115Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:20.481131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:20.481135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:20.481139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:20.481141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:20.481157Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:20.481162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:20.481167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:20.481224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.481226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.481228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.481231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:20.481233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:20.481305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:20.481307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.481317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.481325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.481338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:20.481352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255709241166899:9450]
2025-10-01T14:11:20.481354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255709241166899:9450]
2025-10-01T14:11:20.481355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255709241166899:9450]
2025-10-01T14:11:20.481366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:20.481379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:20.481390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:20.481392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:20.481426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255709241166899:9450]
2025-10-01T14:11:20.481427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:20.481641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:20.481647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:20.481649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:20.481653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:20.482010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255711618046727:2446], now have 1 active actors on pipe
2025-10-01T14:11:20.482017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255711618046897:4289], now have 1 active actors on pipe
2025-10-01T14:11:20.482846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1346
2025-10-01T14:11:20.482882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1346
2025-10-01T14:11:20.485343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.485367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.485394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:20.485410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:20.485414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:20.485417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:20.485426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:20.485438Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:20.485454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:20.485513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255711618046913:4741]
2025-10-01T14:11:20.490720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1346, pipe: [1:7556255711618046913:4741]
2025-10-01T14:11:20.492291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255711618046913:4741], now have 1 active actors on pipe
2025-10-01T14:11:20.492314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.492319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.492346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:20.492546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1347 partition: 0 MaxSeqNo: 45 sessionId: src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0
2025-10-01T14:11:20.492987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1b5ef9d-46714a6e-67da0d46-98ebf79b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:20.496256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0] Write session: try to update token
2025-10-01T14:11:20.496271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:20.533764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1347 sessionId: src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:20.536832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:20.538548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.538569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.538613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:20.542418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:20.552359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:20.552374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:20.552377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:20.552378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:20.552389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255709241166899:9450]
2025-10-01T14:11:20.552393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255709241166899:9450]
2025-10-01T14:11:20.552396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255709241166899:9450]
2025-10-01T14:11:20.552440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:20.552446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.552448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:20.552615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:20.554407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:20.554415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:20.554419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:20.729441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:20.738110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.738140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.738355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.738433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.738507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.738582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.738625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.738635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.738709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.738773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.738840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.738911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.738957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.738966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.739031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.739090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.739151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.739207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.739247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.739253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.739315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.739379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.739462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.739522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.739564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.739572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.739628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.739682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.739739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.739795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.739838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.739845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.739905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.739961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.740023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.740090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.740245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.740255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.740322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.740379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.740445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.740504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.740547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.740555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.740619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.740674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.740743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.740804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.740847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.740853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.740918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.740976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.741038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.741098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.741141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.741148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.741211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:20.741273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:20.741344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:20.741404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:20.741446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:20.741454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:20.742743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:20.746738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255711618046913:4741]
2025-10-01T14:11:20.746771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:20.746816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:20.746858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1347 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0
2025-10-01T14:11:20.747044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1347 sessionId: src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0 is DEAD
2025-10-01T14:11:20.747603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:20.747614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0] Write session will restart in 0.008870s
2025-10-01T14:11:20.747645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0] Write session: Do CDS request
2025-10-01T14:11:20.747651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:20.760041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:20.760370Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:20.760386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1348
2025-10-01T14:11:20.760509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:20.760535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:20.760542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:20.760546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:20.761109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1348 sessionId:  describe result for acl check
2025-10-01T14:11:20.761142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:20.761146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:20.761148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:20.761153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255711618046928:4286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:20.761667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255711618046928:4286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:20.769764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255711618046928:4286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:20.777697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:11:20.777724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 10
2025-10-01T14:11:20.781236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255711618046928:4286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:20.781252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255711618046928:4286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:20.781255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255711618046928:4286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:20.781265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:20.811294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:20.816396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:20.816591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:20.816594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:20.816614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:20.816663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:20.816717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255709241167087:9457]
2025-10-01T14:11:20.817225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:20.817796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:20.817841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:20.818161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:20.818228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.818234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.818235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.818236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.818238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.818239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.818241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.818242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.818243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.818244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.818246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.818247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.818248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.818249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.818255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.818264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.818268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.818272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.818276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.818279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.818283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.818287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.818290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.818294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.818298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.818302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.818305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.818309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.818317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.818324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:20.818335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.818340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:20.818344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.818350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:20.818358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.818363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:20.818367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.818385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:20.818390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.818395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:20.818400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.818405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:20.818409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.818413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:20.818418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.818423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:20.818427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.818432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.818436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.818441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.818451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.818456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.818460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.818465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:20.818469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.818474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:20.818523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:20.823702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:20.824302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:20.824318Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:20.824321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:20.824324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:20.824331Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1347 [2:7556255709241167087:9457]
2025-10-01T14:11:20.824346Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:20.824362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:20.824365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:20.824369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:20.824371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:20.824387Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:20.824394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:20.824401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:20.824457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.824463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.824465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.824469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:20.824471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:20.824539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:20.824544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.824554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:20.824564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:20.824578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:20.824595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255709241167081:9457]
2025-10-01T14:11:20.824598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255709241167081:9457]
2025-10-01T14:11:20.824600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255709241167081:9457]
2025-10-01T14:11:20.824614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:20.824623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:20.824626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:20.824629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:20.824633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:20.824648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:20.824655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:20.824667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255711618046921:2446], now have 1 active actors on pipe
2025-10-01T14:11:20.824674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255711618046973:4286], now have 1 active actors on pipe
2025-10-01T14:11:20.824798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1347
2025-10-01T14:11:20.824818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1347
2025-10-01T14:11:20.824708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255709241167081:9457]
2025-10-01T14:11:20.824720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:20.824781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:20.824982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.824991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.825033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c99187d-47495b5a-ffad6874-aac48a11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:20.825040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:20.825044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:20.825047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:20.825056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:20.825065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:20.825113Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:11:20.825131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:20.825445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 12 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:11:20.825479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:11:20.830445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.830458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.830488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:20.831811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1348 partition: 0 MaxSeqNo: 45 sessionId: src_id|9c99187d-47495b5a-ffad6874-aac48a11_0
2025-10-01T14:11:20.832288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2d7ed5-8315ccd2-627d148d-2a3ecd3d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9c99187d-47495b5a-ffad6874-aac48a11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:20.836770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c99187d-47495b5a-ffad6874-aac48a11_0] Write session: try to update token
2025-10-01T14:11:20.836789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c99187d-47495b5a-ffad6874-aac48a11_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:20.853011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255711618047115:4741]
2025-10-01T14:11:20.853479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1347, pipe: [1:7556255711618047115:4741]
2025-10-01T14:11:20.857917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255711618047115:4741], now have 1 active actors on pipe
2025-10-01T14:11:20.857936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:20.857939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:20.857948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255709241167081:9457]
2025-10-01T14:11:20.857993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:20.858161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:20.858295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:20.858436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:20.858565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:20.858748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:20.858779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:20.862243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1348 sessionId: src_id|9c99187d-47495b5a-ffad6874-aac48a11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:20.865190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:20.865286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:20.866669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:20.866678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:20.866714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:20.866824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:20.883887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:20.883903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:20.883906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:20.883907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:20.883916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255709241167081:9457]
2025-10-01T14:11:20.883923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255709241167081:9457]
2025-10-01T14:11:20.883926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255709241167081:9457]
2025-10-01T14:11:20.883964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:20.883968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:20.883970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:20.884087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:20.885373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:20.885379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:20.885382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:21.038559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:21.046144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.046164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.046293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.046341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.046437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.046501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.046775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.046787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.055241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:21.055283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255711618047115:4741]
2025-10-01T14:11:21.055300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:21.055302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:21.055323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1348 reason: error at write: Disconnected sessionId: src_id|9c99187d-47495b5a-ffad6874-aac48a11_0
2025-10-01T14:11:21.055531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1348 sessionId: src_id|9c99187d-47495b5a-ffad6874-aac48a11_0 is DEAD
2025-10-01T14:11:21.058621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c99187d-47495b5a-ffad6874-aac48a11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:21.058702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c99187d-47495b5a-ffad6874-aac48a11_0] Write session will restart in 0.005278s
2025-10-01T14:11:21.058731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c99187d-47495b5a-ffad6874-aac48a11_0] Write session: Do CDS request
2025-10-01T14:11:21.058738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c99187d-47495b5a-ffad6874-aac48a11_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:21.046953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.047020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.047091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.047154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.047195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.047197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.047266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.047323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.047394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.047471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.047520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.047523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.047598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.047676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.047746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.047820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.047874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.047877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.047953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.048027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.048102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.048176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.048245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.048247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.048328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.048406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.048498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.048575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.048644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.048648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.048738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.048813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.048892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.048968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.049049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.049051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.049132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.049207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.049278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.049353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.049406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.049408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.049481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.049555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.049626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.049699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.049753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.049755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.049828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.049896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.049966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.050037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.050089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.050091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.055868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:21.066820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c99187d-47495b5a-ffad6874-aac48a11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:21.067821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:21.067833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1349
2025-10-01T14:11:21.070479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:21.070517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:21.070521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:21.070527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:21.074804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1349 sessionId:  describe result for acl check
2025-10-01T14:11:21.074852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:21.074854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:21.074857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:21.074862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255715913014444:4280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:21.075315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255715913014444:4280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:21.103124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255715913014444:4280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:21.132736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255715913014444:4280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:21.132753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255715913014444:4280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:21.132756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255715913014444:4280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:21.132765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:21.144115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:21.146506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:21.146728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:21.146733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:21.146745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:21.146795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:21.146826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255713536134580:9462]
2025-10-01T14:11:21.147402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:21.147799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:21.147838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:21.148123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:21.148163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.148164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.148166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.148167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.148168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.148169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.148170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.148171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.148172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.148173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.148174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.148175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.148176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.148177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.148181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.148188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.148191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.148195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.148199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.148202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.148206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.148209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.148212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.148216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.148219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.148223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.148225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.148228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.148234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.148241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.148246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.148250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.148254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.148257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.148261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.148265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.148268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.148273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.148276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.148281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.148285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.148290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.148293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.148297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.148300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.148304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.148308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.148312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.148316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.148320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.148323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.148328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.148330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.148335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.148337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.148343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.148371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:21.159672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255715913014628:4741]
2025-10-01T14:11:21.163057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:21.163707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:21.163712Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:21.163714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:21.163717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:21.163724Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1348 [2:7556255713536134580:9462]
2025-10-01T14:11:21.163739Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:21.163757Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:21.163760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:21.163763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:21.163765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:21.163779Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:21.163785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:21.163790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:21.163866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.163869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.163871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.163875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:21.163878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:21.164002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:21.164005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.164021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.164032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.164050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:21.164073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255713536134574:9462]
2025-10-01T14:11:21.164075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255713536134574:9462]
2025-10-01T14:11:21.164077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255713536134574:9462]
2025-10-01T14:11:21.164100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:21.164123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:21.164141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:21.164144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:21.164181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255713536134574:9462]
2025-10-01T14:11:21.164184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:21.164466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:21.164476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:21.164478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:21.164485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:21.164769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255715913014594:4280], now have 1 active actors on pipe
2025-10-01T14:11:21.164776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255715913014432:2446], now have 1 active actors on pipe
2025-10-01T14:11:21.171298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.171309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.171327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255715913014628:4741], now have 1 active actors on pipe
2025-10-01T14:11:21.171343Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|294cd62c-d3b774e5-857788db-858a7904_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:21.171351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:21.171355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:21.171357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:21.171366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:21.171379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:21.171394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:21.170438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1348
2025-10-01T14:11:21.170469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1348
2025-10-01T14:11:21.172294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1348, pipe: [1:7556255715913014628:4741]
2025-10-01T14:11:21.178209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.178231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.178270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:21.178561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1349 partition: 0 MaxSeqNo: 45 sessionId: src_id|294cd62c-d3b774e5-857788db-858a7904_0
2025-10-01T14:11:21.181357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c99187d-47495b5a-ffad6874-aac48a11_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|294cd62c-d3b774e5-857788db-858a7904_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:21.190044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|294cd62c-d3b774e5-857788db-858a7904_0] Write session: try to update token
2025-10-01T14:11:21.190063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|294cd62c-d3b774e5-857788db-858a7904_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:21.254495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1349 sessionId: src_id|294cd62c-d3b774e5-857788db-858a7904_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:21.257109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:21.254268Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:21.254285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:21.254287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:21.254289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:21.254298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255713536134574:9462]
2025-10-01T14:11:21.254302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255713536134574:9462]
2025-10-01T14:11:21.254305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255713536134574:9462]
2025-10-01T14:11:21.254347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:21.254353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.254355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:21.254505Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:21.257402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:21.257408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:21.257411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:21.404373Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:21.404729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.404738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.406129Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:21.406792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255715913014628:4741]
2025-10-01T14:11:21.406818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:21.406871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1349 reason: status is not ok: tablet will be restarted right now sessionId: src_id|294cd62c-d3b774e5-857788db-858a7904_0
2025-10-01T14:11:21.407026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1349 sessionId: src_id|294cd62c-d3b774e5-857788db-858a7904_0 is DEAD
2025-10-01T14:11:21.407126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:21.409142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|294cd62c-d3b774e5-857788db-858a7904_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:21.409151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|294cd62c-d3b774e5-857788db-858a7904_0] Write session will restart in 0.006956s
2025-10-01T14:11:21.409174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|294cd62c-d3b774e5-857788db-858a7904_0] Write session: Do CDS request
2025-10-01T14:11:21.409179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|294cd62c-d3b774e5-857788db-858a7904_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:21.416986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|294cd62c-d3b774e5-857788db-858a7904_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:21.418226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:21.418239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1350
2025-10-01T14:11:21.418817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:21.418847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:21.418853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:21.418856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:21.419356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1350 sessionId:  describe result for acl check
2025-10-01T14:11:21.419381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:21.419383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:21.419384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:21.419389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255715913014679:4262] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:21.419892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255715913014679:4262] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:21.427842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255715913014679:4262] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:21.432065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255715913014679:4262] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:21.432080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255715913014679:4262] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:21.432083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255715913014679:4262] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:21.432092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:21.435461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:21.437634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:21.437823Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:21.437827Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:21.437838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:21.437886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:21.437917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255713536134773:9466]
2025-10-01T14:11:21.438480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:21.438825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:21.438864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:21.439073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:21.439116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.439117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.439118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.439118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.439119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.439120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.439121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.439121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.439122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.439122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.439123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.439124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.439124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.439125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.439128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.439133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.439135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.439138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.439140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.439142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.439144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.439147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.439151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.439154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.439157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.439160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.439163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.439166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.439172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.439179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.439185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.439190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.439194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.439199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.439202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.439206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.439210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.439215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.439219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.439223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.439228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.439232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.439237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.439241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.439245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.439249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.439252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.439256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.439260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.439264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.439268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.439271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.439276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.439281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.439284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.439288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.439323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:21.446817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:21.447422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:21.447440Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:21.447443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:21.447447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:21.447455Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1349 [2:7556255713536134773:9466]
2025-10-01T14:11:21.447471Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:21.447487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:21.447490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:21.447494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:21.447498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:21.447516Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:21.447521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:21.447526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:21.447583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.447585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.447586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.447589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:21.447592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:21.447657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:21.447660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.447672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.447682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.447697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:21.447713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255713536134767:9466]
2025-10-01T14:11:21.447715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255713536134767:9466]
2025-10-01T14:11:21.447716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255713536134767:9466]
2025-10-01T14:11:21.447727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:21.447740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:21.447753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:21.447755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:21.447790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255713536134767:9466]
2025-10-01T14:11:21.447792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:21.447871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:21.447882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:21.447884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:21.447888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:21.448179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1349
2025-10-01T14:11:21.448190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1349
2025-10-01T14:11:21.448469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255715913014654:2446], now have 1 active actors on pipe
2025-10-01T14:11:21.448481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255715913014801:4262], now have 1 active actors on pipe
2025-10-01T14:11:21.449211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.449228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.449254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ed73c4b-df26545f-e465e835-f6637699_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:21.449266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:21.449270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:21.449274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:21.449288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:21.449303Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:21.449317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:21.449568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.449576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.449589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:21.450088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|294cd62c-d3b774e5-857788db-858a7904_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5ed73c4b-df26545f-e465e835-f6637699_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:21.452267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed73c4b-df26545f-e465e835-f6637699_0] Write session: try to update token
2025-10-01T14:11:21.452284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed73c4b-df26545f-e465e835-f6637699_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:21.449704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1350 partition: 0 MaxSeqNo: 45 sessionId: src_id|5ed73c4b-df26545f-e465e835-f6637699_0
2025-10-01T14:11:21.471448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1350 sessionId: src_id|5ed73c4b-df26545f-e465e835-f6637699_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:21.474090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:21.478037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.478056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.478090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:21.478195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:21.483482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:21.483497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:21.483500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:21.483501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:21.483510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255713536134767:9466]
2025-10-01T14:11:21.483514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255713536134767:9466]
2025-10-01T14:11:21.483516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255713536134767:9466]
2025-10-01T14:11:21.483561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:21.483567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.483570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:21.483696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:21.484109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:21.484115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:21.484122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:21.509222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255715913014847:4741]
2025-10-01T14:11:21.509623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1349, pipe: [1:7556255715913014847:4741]
2025-10-01T14:11:21.637413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:21.656618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.656646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.656863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.656953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.657050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.657145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.657200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.657205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.657303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.657391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.657474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.657562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.657614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.657618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.657705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.657789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.657870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.657959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.658017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.658020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.658108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.662787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.662875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.662947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.662997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.663000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.663077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.663147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.663221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.663302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.663356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.663359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.663437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.663513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.663589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.663671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.663756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.663759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.663841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.663920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.663998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.664079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.664134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.664137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.664217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.664293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.664366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.664446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.664499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.664501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.664583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.664664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.664755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.664836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.664894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.664897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.664978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:21.665057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:21.665136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:21.665216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:21.665270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:21.665274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:21.665373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255715913014847:4741], now have 1 active actors on pipe
2025-10-01T14:11:21.666703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:21.667891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:21.667938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:21.667977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1350 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ed73c4b-df26545f-e465e835-f6637699_0
2025-10-01T14:11:21.668186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1350 sessionId: src_id|5ed73c4b-df26545f-e465e835-f6637699_0 is DEAD
2025-10-01T14:11:21.668806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed73c4b-df26545f-e465e835-f6637699_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:21.668814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed73c4b-df26545f-e465e835-f6637699_0] Write session will restart in 0.009694s
2025-10-01T14:11:21.668836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed73c4b-df26545f-e465e835-f6637699_0] Write session: Do CDS request
2025-10-01T14:11:21.668842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed73c4b-df26545f-e465e835-f6637699_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:21.668579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255715913014847:4741]
2025-10-01T14:11:21.679970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed73c4b-df26545f-e465e835-f6637699_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:21.680249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:21.680262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1351
2025-10-01T14:11:21.680441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:21.680468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:21.680475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:21.680478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:21.686315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1351 sessionId:  describe result for acl check
2025-10-01T14:11:21.686349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:21.686351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:21.686353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:21.686358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255715913014858:4255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:21.686833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255715913014858:4255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:21.705325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255715913014858:4255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:21.723112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255715913014858:4255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:21.723127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255715913014858:4255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:21.723130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255715913014858:4255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:21.723138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:21.750114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:21.758976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:21.759233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:21.759238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:21.759250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:21.759310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:21.759346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255713536134983:9479]
2025-10-01T14:11:21.759977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:21.760440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:21.760483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:21.760808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:21.760879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.760880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.760882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.760883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.760885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.760886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.760888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.760889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.760891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.760892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.760893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.760894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.760896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.760897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.760903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.760913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.760917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.760921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.760925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.760930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.760933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.760937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.760941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.760945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.760949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.760952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.760956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.760960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.760968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.760975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:21.760981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.760987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:21.760992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.760998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:21.761002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.761008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:21.761012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.761017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:21.761022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.761027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:21.761032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.761037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:21.761041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.761047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:21.761052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.761057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:21.761062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.761067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.761074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.761079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.761083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.761089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.761094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.761099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:21.761103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.761109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:21.761151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:21.766858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:21.767433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:21.767448Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:21.767451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:21.767455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:21.767461Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1350 [2:7556255713536134983:9479]
2025-10-01T14:11:21.767478Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:21.767494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:21.767502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:21.767506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:21.767508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:21.767524Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:21.767529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:21.767535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:21.767587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.767594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.767596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.767600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:21.767602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:21.767669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:21.767677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.767687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:21.767699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:21.767714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:21.767730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255713536134978:9479]
2025-10-01T14:11:21.767733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255713536134978:9479]
2025-10-01T14:11:21.767736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255713536134978:9479]
2025-10-01T14:11:21.767748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:21.767762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:21.767776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:21.767778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:21.767808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255713536134978:9479]
2025-10-01T14:11:21.767811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:21.770426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:21.770437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:21.770439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:21.770446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:21.770749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255715913014918:4255], now have 1 active actors on pipe
2025-10-01T14:11:21.770756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255715913014850:2446], now have 1 active actors on pipe
2025-10-01T14:11:21.770665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255715913015033:4741]
2025-10-01T14:11:21.771121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1350
2025-10-01T14:11:21.771148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1350
2025-10-01T14:11:21.774584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.774598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.774622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255715913015033:4741], now have 1 active actors on pipe
2025-10-01T14:11:21.774640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:21.774650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:21.774655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:21.774658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:21.774672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:21.774688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:21.774708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:21.775181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1350, pipe: [1:7556255715913015033:4741]
2025-10-01T14:11:21.775381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.775388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.775404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:21.775983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ed73c4b-df26545f-e465e835-f6637699_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:21.778563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0] Write session: try to update token
2025-10-01T14:11:21.778578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:21.775543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1351 partition: 0 MaxSeqNo: 45 sessionId: src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0
2025-10-01T14:11:21.801508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1351 sessionId: src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:21.804834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:21.806300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:21.806323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:21.808962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:21.808988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:21.808991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:21.808994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:21.808996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:21.809008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255713536134978:9479]
2025-10-01T14:11:21.809012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255713536134978:9479]
2025-10-01T14:11:21.809016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255713536134978:9479]
2025-10-01T14:11:21.809057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:21.809064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:21.809067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:21.809233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:21.810908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:21.810918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:21.810923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:21.811023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:22.059714Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:22.067968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.067992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.068170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.068245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.068358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.068429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.068477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.068482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.068558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.068623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.068699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.068772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.068825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.068828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.068896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.068956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.069022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.069082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.069125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.069128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.069195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.069257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.069322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.069388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.069428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.069430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.069497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.069554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.069615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.069677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.069719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.069722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.069790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.069855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.069921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.069989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.070039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.070042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.070108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.070169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.070234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.070302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.070353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.070356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.070629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.070696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.070756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.070819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.070863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.070866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.070938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.071001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.071068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.071137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.071181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.071183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.071252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.071314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.071382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.071450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.071531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.071534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.074835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:22.076914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:22.076923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0] Write session will restart in 0.006791s
2025-10-01T14:11:22.076945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0] Write session: Do CDS request
2025-10-01T14:11:22.076951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:22.075611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255715913015033:4741]
2025-10-01T14:11:22.075634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:22.075660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:22.075662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:22.075683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1351 reason: error at write: Disconnected sessionId: src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0
2025-10-01T14:11:22.075855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1351 sessionId: src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0 is DEAD
2025-10-01T14:11:22.107408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:22.108209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:22.108225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1352
2025-10-01T14:11:22.108320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:22.108356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:22.108361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:22.108365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:22.109215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1352 sessionId:  describe result for acl check
2025-10-01T14:11:22.109254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:22.109256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:22.109257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:22.109262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255720207982381:4236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:22.109818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255720207982381:4236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:22.113255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255720207982381:4236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:22.120130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255720207982381:4236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:22.120145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255720207982381:4236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:22.120148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255720207982381:4236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:22.120156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:22.131262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:22.136508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:22.136774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:22.136779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:22.136792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:22.136850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:22.136886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255717831102477:9483]
2025-10-01T14:11:22.137480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:22.137818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:22.137869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:22.138173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:22.138229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.138230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.138231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.138232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.138233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.138234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.138236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.138237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.138238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.138240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.138241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.138242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.138243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.138245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.138250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.138259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.138263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.138266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.138270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.138273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.138276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.138279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.138283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.138286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.138289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.138292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.138295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.138298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.138305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.138312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.138317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.138322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.138326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.138331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.138335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.138340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.138344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.138349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.138353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.138357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.138362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.138366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.138383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.138387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.138391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.138396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.138399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.138404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.138409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.138414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.138418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.138423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.138428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.138432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.138436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.138443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.138478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:22.143062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:22.143621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:22.143636Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:22.143639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:22.143642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:22.143649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1351 [2:7556255717831102477:9483]
2025-10-01T14:11:22.143667Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:22.143687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:22.143695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:22.143698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:22.143701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:22.143717Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:22.143727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:22.143732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:22.143789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.143795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.143798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.143802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:22.143804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:22.143867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:22.143874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.143885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.143900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.143920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:22.143942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255720207982356:2446], now have 1 active actors on pipe
2025-10-01T14:11:22.143949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255720207982489:4236], now have 1 active actors on pipe
2025-10-01T14:11:22.143957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255717831102471:9483]
2025-10-01T14:11:22.143963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255717831102471:9483]
2025-10-01T14:11:22.143965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255717831102471:9483]
2025-10-01T14:11:22.143980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:22.143992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:22.143996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:22.144001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:22.144003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:22.144010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:22.144014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:22.144041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255717831102471:9483]
2025-10-01T14:11:22.144051Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:22.144056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:22.144653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1351
2025-10-01T14:11:22.144701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1351
2025-10-01T14:11:22.145441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.145455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.145481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:22.145491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:22.145495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:22.145498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:22.145505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:22.145517Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:22.145530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:22.146167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1352 partition: 0 MaxSeqNo: 45 sessionId: src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0
2025-10-01T14:11:22.146026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.146035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.146052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:22.146680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c58ad8bc-c64ff124-49fcdd67-182e3a7e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:22.148916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0] Write session: try to update token
2025-10-01T14:11:22.148932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:22.182437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255720207982554:4741]
2025-10-01T14:11:22.182845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255720207982554:4741], now have 1 active actors on pipe
2025-10-01T14:11:22.182957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1351, pipe: [1:7556255720207982554:4741]
2025-10-01T14:11:22.204903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:22.204924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:22.204927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:22.204930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:22.204942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255717831102471:9483]
2025-10-01T14:11:22.204947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255717831102471:9483]
2025-10-01T14:11:22.204951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255717831102471:9483]
2025-10-01T14:11:22.205001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:22.205013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.205016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:22.205143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:22.206431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:22.206444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:22.206447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:22.210974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1352 sessionId: src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:22.213324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:22.363409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:22.363958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.363973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.366612Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:22.367161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:22.367213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255720207982554:4741]
2025-10-01T14:11:22.367232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:22.367303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1352 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0
2025-10-01T14:11:22.367545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1352 sessionId: src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0 is DEAD
2025-10-01T14:11:22.367975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:22.367985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0] Write session will restart in 0.005375s
2025-10-01T14:11:22.368009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0] Write session: Do CDS request
2025-10-01T14:11:22.368016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:22.374940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:22.375008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:22.375022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1353
2025-10-01T14:11:22.375304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:22.375334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:22.375340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:22.375342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:22.375774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1353 sessionId:  describe result for acl check
2025-10-01T14:11:22.375802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:22.375807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:22.375809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:22.375814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255720207982596:4223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:22.376306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255720207982596:4223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:22.379238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255720207982596:4223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:22.391024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255720207982596:4223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:22.391038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255720207982596:4223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:22.391041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255720207982596:4223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:22.391050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:22.412574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:22.416061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:22.416286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:22.416298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:22.416307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:22.416352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:22.416385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255717831102669:9487]
2025-10-01T14:11:22.417067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:22.419177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:22.419221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:22.419543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:22.419587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.419588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.419590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.419591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.419592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.419593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.419594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.419596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.419598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.419599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.419600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.419601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.419602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.419602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.419607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.419616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.419619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.419622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.419625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.419628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.419631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.419634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.419638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.419641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.419643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.419646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.419649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.419652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.419658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.419664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.419670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.419675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.419679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.419683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.419687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.419692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.419696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.419700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.419704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.419708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.419712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.419716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.419721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.419725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.419729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.419733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.419737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.419741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.419745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.419749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.419753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.419757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.419761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.419765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.419769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.419773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.419805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:22.426765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1352
2025-10-01T14:11:22.426806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1352
2025-10-01T14:11:22.425229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:22.425969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:22.425974Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:22.425977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:22.425980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:22.425987Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1352 [2:7556255717831102669:9487]
2025-10-01T14:11:22.426002Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:22.426020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:22.426026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:22.426029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:22.426032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:22.426050Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:22.426057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:22.426066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:22.426138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.426140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.426142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.426145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:22.426147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:22.426222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:22.426227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.426237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.426246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.426261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:22.426277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255717831102664:9487]
2025-10-01T14:11:22.426279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255717831102664:9487]
2025-10-01T14:11:22.426284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255717831102664:9487]
2025-10-01T14:11:22.426298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:22.426311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:22.426325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:22.426328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:22.426361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255717831102664:9487]
2025-10-01T14:11:22.426363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:22.426502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:22.426504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:22.426506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:22.426506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255720207982589:2446], now have 1 active actors on pipe
2025-10-01T14:11:22.426511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:22.430009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255720207982634:4223], now have 1 active actors on pipe
2025-10-01T14:11:22.430038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.430043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.430072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|296dfc42-ae759034-4d5963e2-3b31d858_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:22.430080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:22.430084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:22.430086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:22.430096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:22.430108Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:22.430123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:22.430842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.430850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.430867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:22.430998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1353 partition: 0 MaxSeqNo: 45 sessionId: src_id|296dfc42-ae759034-4d5963e2-3b31d858_0
2025-10-01T14:11:22.431369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 284 BytesWritten: 85606466 MessagesWritten: 38 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-01T14:11:22.431403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3189678-fc6bce51-7ec9ce48-16c589d7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|296dfc42-ae759034-4d5963e2-3b31d858_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:22.433838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|296dfc42-ae759034-4d5963e2-3b31d858_0] Write session: try to update token
2025-10-01T14:11:22.433857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|296dfc42-ae759034-4d5963e2-3b31d858_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:22.455855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:22.455871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:22.455879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255717831102664:9487]
2025-10-01T14:11:22.455919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:22.456085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:22.456213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:22.456349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:22.456479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:22.456656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:22.456698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:22.458381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:22.470501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255720207982783:4741]
2025-10-01T14:11:22.475114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255720207982783:4741], now have 1 active actors on pipe
2025-10-01T14:11:22.473605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1353 sessionId: src_id|296dfc42-ae759034-4d5963e2-3b31d858_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:22.475055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1352, pipe: [1:7556255720207982783:4741]
2025-10-01T14:11:22.475996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:22.477370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.477386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.477421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:22.477633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:22.508264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:22.508295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:22.508297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:22.508299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:22.508311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255717831102664:9487]
2025-10-01T14:11:22.508315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255717831102664:9487]
2025-10-01T14:11:22.508319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255717831102664:9487]
2025-10-01T14:11:22.508368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:22.508368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:22.508375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:22.508376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.508378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:22.508378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:22.508518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:22.713347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:22.724887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.724915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.725104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.725187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.725270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.725353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.725408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.725416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.725507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.725589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.725669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.725756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.725847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.725850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.725930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.726010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.726095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.726183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.726237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.726239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.726323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.726531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.726613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.726695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.726745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.726747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.726822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.726896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.726990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.727063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.727113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.727115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.727194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.727268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.727341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.727423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.727476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.727478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.727556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.727632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.727709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.727783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.727833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.727836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.727915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.727994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.728072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.728149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.728201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.728203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.728285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.728362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.728433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.728508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.728571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.728575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.728646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:22.728730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:22.728802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:22.728880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:22.728936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:22.728939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:22.730424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:22.730428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:22.730432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:22.730457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1353 reason: error at write: Disconnected sessionId: src_id|296dfc42-ae759034-4d5963e2-3b31d858_0
2025-10-01T14:11:22.730483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255720207982783:4741]
2025-10-01T14:11:22.730645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1353 sessionId: src_id|296dfc42-ae759034-4d5963e2-3b31d858_0 is DEAD
2025-10-01T14:11:22.730979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:22.733266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296dfc42-ae759034-4d5963e2-3b31d858_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:22.733279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296dfc42-ae759034-4d5963e2-3b31d858_0] Write session will restart in 0.006347s
2025-10-01T14:11:22.733304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296dfc42-ae759034-4d5963e2-3b31d858_0] Write session: Do CDS request
2025-10-01T14:11:22.733309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296dfc42-ae759034-4d5963e2-3b31d858_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:22.745560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|296dfc42-ae759034-4d5963e2-3b31d858_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:22.746715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:22.746729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1354
2025-10-01T14:11:22.746839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:22.746873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:22.746880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:22.746883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:22.747794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1354 sessionId:  describe result for acl check
2025-10-01T14:11:22.747825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:22.747826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:22.747828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:22.747833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255720207982804:4211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:22.748299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255720207982804:4211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:22.757019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255720207982804:4211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:22.772116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255720207982804:4211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:22.772132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255720207982804:4211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:22.772136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255720207982804:4211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:22.772143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:22.779081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:22.779539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:22.779703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:22.779721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:22.779735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:22.779784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:22.779817Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255717831102886:9500]
2025-10-01T14:11:22.780381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:22.781462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:22.781499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:22.781801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:22.781856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.781861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.781862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.781863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.781864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.781865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.781866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.781867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.781869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.781870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.781871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.781872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.781873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.781874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.781878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.781888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.781891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.781895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.781898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.781901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.781905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.781908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.781912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.781916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.781920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.781923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.781927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.781930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.781938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.781945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:22.781951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.781956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:22.781959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.781964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:22.781968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.781976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:22.781980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.781985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:22.781989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.781994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:22.782000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.782005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:22.782008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.782016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:22.782020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.782025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:22.782029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.782034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.782043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.782047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.782051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.782059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.782063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.782068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:22.782072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.782078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:22.782114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:22.790340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:22.791079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:22.791084Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:22.791087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:22.791090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:22.791096Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1353 [2:7556255717831102886:9500]
2025-10-01T14:11:22.791112Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:22.791129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:22.791133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:22.791136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:22.791138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:22.791152Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:22.791159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:22.791164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:22.791215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.791217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.791219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.791221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:22.791224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:22.791288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:22.791291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.791301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:22.791312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:22.791327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:22.791343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255717831102880:9500]
2025-10-01T14:11:22.791345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255717831102880:9500]
2025-10-01T14:11:22.791347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255717831102880:9500]
2025-10-01T14:11:22.791358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:22.791371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:22.791384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:22.791387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:22.791418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255717831102880:9500]
2025-10-01T14:11:22.791420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:22.792139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1353
2025-10-01T14:11:22.792167Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1353
2025-10-01T14:11:22.791662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:22.791669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:22.791671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:22.791676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:22.792358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255720207982902:4211], now have 1 active actors on pipe
2025-10-01T14:11:22.792365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255720207982790:2446], now have 1 active actors on pipe
2025-10-01T14:11:22.792377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.792382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.792405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:22.792411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:22.792415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:22.792417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:22.792426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:22.792436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:22.792451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:22.792772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:22.792777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:22.792790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:22.792915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1354 partition: 0 MaxSeqNo: 45 sessionId: src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0
2025-10-01T14:11:22.793277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296dfc42-ae759034-4d5963e2-3b31d858_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:22.795497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0] Write session: try to update token
2025-10-01T14:11:22.795515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:22.828505Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:22.828531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:22.828533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:22.828535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:22.828545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255717831102880:9500]
2025-10-01T14:11:22.828549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255717831102880:9500]
2025-10-01T14:11:22.828552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255717831102880:9500]
2025-10-01T14:11:22.828601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:22.828604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:22.828608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:22.828612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:22.828612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:22.828614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:22.828758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:22.830425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1354 sessionId: src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:22.833198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:22.838459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255720207982985:4741]
2025-10-01T14:11:22.839044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1353, pipe: [1:7556255720207982985:4741]
2025-10-01T14:11:23.069837Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:23.070287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.070298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.070319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255720207982985:4741], now have 1 active actors on pipe
2025-10-01T14:11:23.070754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:23.071099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:23.071114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:23.071170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1354 reason: error at write: Disconnected sessionId: src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0
2025-10-01T14:11:23.071370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1354 sessionId: src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0 is DEAD
2025-10-01T14:11:23.071497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255720207982985:4741]
2025-10-01T14:11:23.071509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:23.074835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:23.074849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0] Write session will restart in 0.008125s
2025-10-01T14:11:23.074880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0] Write session: Do CDS request
2025-10-01T14:11:23.074885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:23.094823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:23.095206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:23.095227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1355
2025-10-01T14:11:23.095344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:23.095376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:23.095385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:23.095389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:23.095771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1355 sessionId:  describe result for acl check
2025-10-01T14:11:23.095799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:23.095804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:23.095808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:23.095812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255724502950315:4204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:23.096334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255724502950315:4204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:23.105965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255724502950315:4204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:23.110878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255724502950315:4204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:23.110890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255724502950315:4204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:23.110893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255724502950315:4204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:23.110901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:23.114572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:23.116657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:23.116793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:23.116796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:23.116803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:23.116831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:23.116854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255722126070383:9504]
2025-10-01T14:11:23.117227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:23.117433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:23.117456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:23.117653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:23.117682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.117683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.117683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.117684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.117685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.117685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.117686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.117687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.117687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.117688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.117689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.117689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.117690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.117690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.117693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.117699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.117701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.117703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.117705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.117707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.117709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.117711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.117713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.117716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.117718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.117720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.117722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.117724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.117729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.117733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.117737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.117739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.117742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.117745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.117747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.117750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.117752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.117755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.117757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.117760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.117762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.117765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.117768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.117770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.117773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.117776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.117779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.117782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.117784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.117787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.117789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.117791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.117794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.117796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.117798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.117801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.117820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:23.121181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:23.121702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:23.121705Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:23.121706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:23.121709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:23.121713Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1354 [2:7556255722126070383:9504]
2025-10-01T14:11:23.121723Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:23.121736Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:23.121738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:23.121740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:23.121741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:23.121751Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:23.121755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:23.121759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:23.121808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.121809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.121811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.121813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:23.121815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:23.121867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:23.121868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.121876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.121881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.121889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:23.121901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255722126070378:9504]
2025-10-01T14:11:23.121902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255722126070378:9504]
2025-10-01T14:11:23.121904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255722126070378:9504]
2025-10-01T14:11:23.121910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:23.121919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950459:4204], now have 1 active actors on pipe
2025-10-01T14:11:23.121924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950299:2446], now have 1 active actors on pipe
2025-10-01T14:11:23.121925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:23.121927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:23.121928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:23.121930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:23.121935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:23.121937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:23.121952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255722126070378:9504]
2025-10-01T14:11:23.121954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:23.121956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:23.122244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1354
2025-10-01T14:11:23.122274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1354
2025-10-01T14:11:23.122478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.122484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.122505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:23.122510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:23.122514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:23.122515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:23.122522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:23.122529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:23.122538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:23.122970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.122981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.123000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:23.123105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1355 partition: 0 MaxSeqNo: 45 sessionId: src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0
2025-10-01T14:11:23.125324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fca7cde9-69f0bd52-da4ff157-552eaa1d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:23.127726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0] Write session: try to update token
2025-10-01T14:11:23.127746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:23.142150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1355 sessionId: src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:23.144625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:23.143243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:23.143262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:23.143265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:23.143266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:23.143276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255722126070378:9504]
2025-10-01T14:11:23.143281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255722126070378:9504]
2025-10-01T14:11:23.143285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255722126070378:9504]
2025-10-01T14:11:23.143329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:23.143337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.143339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:23.143474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:23.145120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:23.145125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:23.145129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:23.172716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255724502950493:4741]
2025-10-01T14:11:23.173049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1354, pipe: [1:7556255724502950493:4741]
2025-10-01T14:11:23.300872Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:23.301327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.301335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.301378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950493:4741], now have 1 active actors on pipe
2025-10-01T14:11:23.302095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:23.306437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:23.306514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1355 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0
2025-10-01T14:11:23.306717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1355 sessionId: src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0 is DEAD
2025-10-01T14:11:23.306856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:23.306890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255724502950493:4741]
2025-10-01T14:11:23.307427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:23.307436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0] Write session will restart in 0.009500s
2025-10-01T14:11:23.307462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0] Write session: Do CDS request
2025-10-01T14:11:23.307468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:23.322824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:23.323136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:23.323151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1356
2025-10-01T14:11:23.323318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:23.323347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:23.323352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:23.323355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:23.326100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1356 sessionId:  describe result for acl check
2025-10-01T14:11:23.326133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:23.326135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:23.326136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:23.326140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255724502950522:4193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:23.326821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255724502950522:4193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:23.334686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255724502950522:4193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:23.353542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255724502950522:4193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:23.353555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255724502950522:4193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:23.353558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255724502950522:4193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:23.353565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:23.364722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:23.368628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:23.368871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:23.368875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:23.368886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:23.368929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:23.368963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255722126070576:9506]
2025-10-01T14:11:23.369546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:23.370388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:23.370437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:23.370760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:23.370818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.370819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.370820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.370822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.370823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.370824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.370825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.370827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.370828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.370829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.370830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.370831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.370832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.370833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.370839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.370848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.370852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.370855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.370859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.370862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.370866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.370869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.370873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.370877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.370880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.370883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.370886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.370889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.370897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.370904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.370911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.370916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.370919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.370924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.370928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.370932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.370937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.370941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.370945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.370949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.370954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.370959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.370962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.370967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.370971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.370976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.370980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.370985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.370989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.370993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.370998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.371002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.371007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.371011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.371016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.371021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.371061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:23.378246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1355
2025-10-01T14:11:23.378278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1355
2025-10-01T14:11:23.376664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:23.377415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:23.377420Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:23.377423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:23.377427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:23.377434Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1355 [2:7556255722126070576:9506]
2025-10-01T14:11:23.377448Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:23.377465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:23.377468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:23.377472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:23.377474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:23.377493Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:23.377499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:23.377504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:23.377565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.377567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.377568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.377572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:23.377574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:23.377640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:23.377642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.377654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.377666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.377686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:23.377703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255722126070570:9506]
2025-10-01T14:11:23.377706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255722126070570:9506]
2025-10-01T14:11:23.377709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255722126070570:9506]
2025-10-01T14:11:23.377726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:23.377739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:23.377752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:23.377755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:23.377756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:23.377760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:23.377762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:23.377787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255722126070570:9506]
2025-10-01T14:11:23.377790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:23.377825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:23.383828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1356 partition: 0 MaxSeqNo: 45 sessionId: src_id|87d953b4-e481437f-4225dada-413ad87c_0
2025-10-01T14:11:23.385048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c8da4c-504a173e-3cab4c5d-dc3cb8f2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|87d953b4-e481437f-4225dada-413ad87c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:23.382526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950510:2446], now have 1 active actors on pipe
2025-10-01T14:11:23.382540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950638:4193], now have 1 active actors on pipe
2025-10-01T14:11:23.382566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.382573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.382604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87d953b4-e481437f-4225dada-413ad87c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:23.382614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:23.382619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:23.382622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:23.382634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:23.382650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:23.382668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:23.383654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.383659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.383677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:23.389325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d953b4-e481437f-4225dada-413ad87c_0] Write session: try to update token
2025-10-01T14:11:23.389348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d953b4-e481437f-4225dada-413ad87c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:23.407353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255724502950717:4741]
2025-10-01T14:11:23.408054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:23.408072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:23.408074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:23.408076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:23.408085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255722126070570:9506]
2025-10-01T14:11:23.408089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255722126070570:9506]
2025-10-01T14:11:23.408094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255722126070570:9506]
2025-10-01T14:11:23.408138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:23.408144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.408147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:23.408306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:23.409636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:23.409651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:23.409655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:23.409810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1355, pipe: [1:7556255724502950717:4741]
2025-10-01T14:11:23.415019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1356 sessionId: src_id|87d953b4-e481437f-4225dada-413ad87c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:23.417212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:23.430491Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 13 CurrentSessionLifetimeMs: 301448 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:11:23.567891Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:23.568295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950717:4741], now have 1 active actors on pipe
2025-10-01T14:11:23.568636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:23.568326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.568332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.568584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:23.568715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255724502950717:4741]
2025-10-01T14:11:23.568730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:23.568733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:23.568788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1356 reason: error at write: Disconnected sessionId: src_id|87d953b4-e481437f-4225dada-413ad87c_0
2025-10-01T14:11:23.568996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1356 sessionId: src_id|87d953b4-e481437f-4225dada-413ad87c_0 is DEAD
2025-10-01T14:11:23.574764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d953b4-e481437f-4225dada-413ad87c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:23.574775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d953b4-e481437f-4225dada-413ad87c_0] Write session will restart in 0.006629s
2025-10-01T14:11:23.574802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d953b4-e481437f-4225dada-413ad87c_0] Write session: Do CDS request
2025-10-01T14:11:23.574807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d953b4-e481437f-4225dada-413ad87c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:23.583568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d953b4-e481437f-4225dada-413ad87c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:23.583617Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:23.583633Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1357
2025-10-01T14:11:23.584380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:23.584414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:23.584419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:23.584422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:23.585189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1357 sessionId:  describe result for acl check
2025-10-01T14:11:23.585223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:23.585225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:23.585226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:23.585230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255724502950734:4183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:23.585812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255724502950734:4183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:23.588701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255724502950734:4183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:23.593369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255724502950734:4183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:23.593388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255724502950734:4183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:23.593392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255724502950734:4183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:23.593400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:23.601040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:23.603848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:23.604072Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:23.604077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:23.604088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:23.604137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:23.604169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255722126070780:9517]
2025-10-01T14:11:23.604790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:23.606844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:23.606882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:23.607115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:23.607146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.607147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.607148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.607148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.607149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.607150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.607150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.607151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.607152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.607152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.607153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.607154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.607154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.607155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.607159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.607164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.607167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.607169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.607171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.607173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.607175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.607177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.607180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.607182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.607184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.607186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.607188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.607190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.607195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.607199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.607204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.607207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.607209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.607213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.607216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.607219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.607222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.607224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.607227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.607229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.607232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.607235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.607237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.607240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.607242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.607245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.607248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.607250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.607253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.607256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.607258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.607260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.607263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.607265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.607268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.607271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.607291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:23.613771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:23.614904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:23.614920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:23.614922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:23.614925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:23.614931Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1356 [2:7556255722126070780:9517]
2025-10-01T14:11:23.614955Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:23.614970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:23.614976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:23.614979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:23.614981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:23.614999Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:23.615005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:23.615014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:23.615071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.615077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.615079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.615082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:23.615084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:23.615146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:23.615152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.615163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.615174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.615193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:23.615213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255722126070774:9517]
2025-10-01T14:11:23.615220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255722126070774:9517]
2025-10-01T14:11:23.615222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255722126070774:9517]
2025-10-01T14:11:23.615231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:23.615287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1356
2025-10-01T14:11:23.615329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1356
2025-10-01T14:11:23.615240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:23.615247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950814:4183], now have 1 active actors on pipe
2025-10-01T14:11:23.615250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:23.615252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:23.615252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:23.615265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:23.615267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:23.615272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950725:2446], now have 1 active actors on pipe
2025-10-01T14:11:23.615303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255722126070774:9517]
2025-10-01T14:11:23.615311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:23.615322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:23.615508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.615521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.615552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eca3b89-2050140d-a978831-9811c924_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:23.615564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:23.615568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:23.615572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:23.615581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:23.615594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:23.615611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:23.615757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.615764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.615776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:23.615879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1357 partition: 0 MaxSeqNo: 45 sessionId: src_id|eca3b89-2050140d-a978831-9811c924_0
2025-10-01T14:11:23.618462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d953b4-e481437f-4225dada-413ad87c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eca3b89-2050140d-a978831-9811c924_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:23.624350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca3b89-2050140d-a978831-9811c924_0] Write session: try to update token
2025-10-01T14:11:23.624372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca3b89-2050140d-a978831-9811c924_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:23.638705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1357 sessionId: src_id|eca3b89-2050140d-a978831-9811c924_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:23.640986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:23.641309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.641332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.643214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:23.643259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:23.643262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:23.643265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:23.643267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:23.643277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255722126070774:9517]
2025-10-01T14:11:23.643281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255722126070774:9517]
2025-10-01T14:11:23.643285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255722126070774:9517]
2025-10-01T14:11:23.643329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:23.643341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.643344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:23.643428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:23.643443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:23.643446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:23.643475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:23.643521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:23.669030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255724502950921:4741]
2025-10-01T14:11:23.669687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1356, pipe: [1:7556255724502950921:4741]
2025-10-01T14:11:23.798597Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:23.807777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.807805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.807985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.808046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.808107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.808169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.808211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.808216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.808290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.808352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.808413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.808475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.808519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.808522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.808586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.808638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.808708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.808764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.808803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.808808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.808873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.808933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.808994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.809053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.809092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.809095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.809165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.809222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.809278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.809335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.809375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.809378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.809449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.809505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.809568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.809630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.809672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.809675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.809745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.809800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.809859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.809917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.809959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.809962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.810022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.810084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.810145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.810205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.810247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.810250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.810320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.811689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:23.811751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255724502950921:4741]
2025-10-01T14:11:23.811777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:23.811785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:23.811810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1357 reason: error at write: Disconnected sessionId: src_id|eca3b89-2050140d-a978831-9811c924_0
2025-10-01T14:11:23.812008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1357 sessionId: src_id|eca3b89-2050140d-a978831-9811c924_0 is DEAD
2025-10-01T14:11:23.810618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.810688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.810752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.810796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.810798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.810872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:23.810929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:23.810989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:23.811054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:23.811097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:23.811100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:23.811167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950921:4741], now have 1 active actors on pipe
2025-10-01T14:11:23.812357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:23.814626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca3b89-2050140d-a978831-9811c924_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:23.814637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca3b89-2050140d-a978831-9811c924_0] Write session will restart in 0.006418s
2025-10-01T14:11:23.814670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca3b89-2050140d-a978831-9811c924_0] Write session: Do CDS request
2025-10-01T14:11:23.814676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca3b89-2050140d-a978831-9811c924_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:23.822849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eca3b89-2050140d-a978831-9811c924_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:23.824734Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:23.824748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1358
2025-10-01T14:11:23.825417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:23.825459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:23.825469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:23.825473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:23.826257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1358 sessionId:  describe result for acl check
2025-10-01T14:11:23.826292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:23.826295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:23.826297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:23.826303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255724502951008:4173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:23.826820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255724502951008:4173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:23.829848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255724502951008:4173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:23.832411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:23.835188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255724502951008:4173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:23.835212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255724502951008:4173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:23.835216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255724502951008:4173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:23.835224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:23.835156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:23.835372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:23.835376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:23.835388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:23.835432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:23.835462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255722126070983:9523]
2025-10-01T14:11:23.836034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:23.836320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:23.836357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:23.836637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:23.836695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.836701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.836702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.836704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.836705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.836706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.836707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.836708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.836710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.836711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.836711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.836712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.836713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.836714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.836719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.836729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.836733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.836737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.836740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.836744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.836748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.836751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.836755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.836759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.836762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.836766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.836769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.836772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.836779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.836786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:23.836791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.836796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:23.836800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.836805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:23.836808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.836813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:23.836817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.836822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:23.836826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.836831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:23.836835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.836840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:23.836844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.836848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:23.836853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.836858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:23.836862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.836867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.836871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.836875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.836880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.836884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.836889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.836893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:23.836897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.836906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:23.836945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:23.841095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:23.841687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:23.841698Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:23.841700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:23.841703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:23.841709Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1357 [2:7556255722126070983:9523]
2025-10-01T14:11:23.841721Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:23.841733Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:23.841735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:23.841737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:23.841739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:23.841749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:23.841758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:23.841763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:23.841814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.841822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.841823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.841826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:23.841829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:23.841883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:23.841888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.841895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:23.841901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:23.841911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:23.841926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255722126070978:9523]
2025-10-01T14:11:23.841931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255722126070978:9523]
2025-10-01T14:11:23.841932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255722126070978:9523]
2025-10-01T14:11:23.841942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:23.841952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:23.841964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:23.841969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:23.841989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255722126070978:9523]
2025-10-01T14:11:23.841993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:23.842069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:23.842074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:23.842076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:23.842079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:23.842244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502951111:4173], now have 1 active actors on pipe
2025-10-01T14:11:23.842254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502950925:2446], now have 1 active actors on pipe
2025-10-01T14:11:23.842304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1357
2025-10-01T14:11:23.842337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1357
2025-10-01T14:11:23.842494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.842506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.842535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:23.842548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:23.842552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:23.842554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:23.842563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:23.842573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:23.842587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:23.842748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:23.842759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:23.842787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:23.842922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1358 partition: 0 MaxSeqNo: 45 sessionId: src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0
2025-10-01T14:11:23.846488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eca3b89-2050140d-a978831-9811c924_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:23.848787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0] Write session: try to update token
2025-10-01T14:11:23.848802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:23.869490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:23.869511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:23.869514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:23.869516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:23.869525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255722126070978:9523]
2025-10-01T14:11:23.869531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255722126070978:9523]
2025-10-01T14:11:23.869535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255722126070978:9523]
2025-10-01T14:11:23.869582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:23.869593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:23.869595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:23.869720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:23.871769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:23.871783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:23.871795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:23.880183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1358 sessionId: src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:23.882518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:23.911746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255724502951122:4741]
2025-10-01T14:11:23.911972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1357, pipe: [1:7556255724502951122:4741]
2025-10-01T14:11:24.027786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255724502951122:4741]
2025-10-01T14:11:24.027819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:24.027846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:24.027939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1358 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0
2025-10-01T14:11:24.028102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1358 sessionId: src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0 is DEAD
2025-10-01T14:11:24.028474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:24.028488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0] Write session will restart in 0.005379s
2025-10-01T14:11:24.028515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0] Write session: Do CDS request
2025-10-01T14:11:24.028521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:24.027081Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:24.027412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.027423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.027445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255724502951122:4741], now have 1 active actors on pipe
2025-10-01T14:11:24.027646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:24.034801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:24.035106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:24.035119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1359
2025-10-01T14:11:24.035281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:24.035309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:24.035315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:24.035318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:24.035740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1359 sessionId:  describe result for acl check
2025-10-01T14:11:24.035773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:24.035775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:24.035777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:24.035781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255728797918430:4169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:24.036270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255728797918430:4169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:24.038810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255728797918430:4169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:24.044692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255728797918430:4169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:24.044709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255728797918430:4169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:24.044712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255728797918430:4169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:24.044722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:24.063983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:24.067150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:24.067377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:24.067382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:24.067394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:24.067483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:24.067518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255726421038483:9527]
2025-10-01T14:11:24.068086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:24.068432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:24.068476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:24.068768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:24.068830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.068832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.068833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.068834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.068835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.068836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.068837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.068838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.068839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.068840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.068841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.068842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.068843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.068844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.068849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.068859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.068862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.068865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.068869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.068872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.068876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.068879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.068882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.068886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.068889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.068892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.068895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.068899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.068906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.068913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.068919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.068924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.068928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.068933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.068937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.068942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.068946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.068951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.068957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.068962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.068967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.068972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.068976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.068980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.068984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.068989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.068993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.068998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.069000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.069005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.069007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.069010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.069013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.069016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.069018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.069021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.069043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:24.078324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:24.078889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:24.078904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:24.078906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:24.078909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:24.078915Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1358 [2:7556255726421038483:9527]
2025-10-01T14:11:24.078925Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:24.078938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:24.078940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:24.078943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:24.078945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:24.078958Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:24.078962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:24.078966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:24.079017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.079024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.079025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.079028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:24.079030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:24.079087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:24.079092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.079101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.079107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.079119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:24.079131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255726421038477:9527]
2025-10-01T14:11:24.079137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255726421038477:9527]
2025-10-01T14:11:24.079138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255726421038477:9527]
2025-10-01T14:11:24.079144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:24.079155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:24.079158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:24.079166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:24.079168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:24.079170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:24.079173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:24.079184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797918423:2446], now have 1 active actors on pipe
2025-10-01T14:11:24.079187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797918469:4169], now have 1 active actors on pipe
2025-10-01T14:11:24.079218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255726421038477:9527]
2025-10-01T14:11:24.079229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:24.079426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:24.080774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1358
2025-10-01T14:11:24.080811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1358
2025-10-01T14:11:24.080930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.080939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.080959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8e43559-930314ce-3eb774c9-dae3777c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:24.080970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:24.080973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:24.080974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:24.080982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:24.080994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:24.081009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:24.081941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.081947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.081957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:24.082069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1359 partition: 0 MaxSeqNo: 45 sessionId: src_id|c8e43559-930314ce-3eb774c9-dae3777c_0
2025-10-01T14:11:24.082467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a70975d-d91d92ec-ff49b4b1-edf92dd3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c8e43559-930314ce-3eb774c9-dae3777c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:24.084736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e43559-930314ce-3eb774c9-dae3777c_0] Write session: try to update token
2025-10-01T14:11:24.084752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e43559-930314ce-3eb774c9-dae3777c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:24.101650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1359 sessionId: src_id|c8e43559-930314ce-3eb774c9-dae3777c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:24.102299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:24.102317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:24.102318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:24.102320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:24.102327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255726421038477:9527]
2025-10-01T14:11:24.102330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255726421038477:9527]
2025-10-01T14:11:24.102334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255726421038477:9527]
2025-10-01T14:11:24.102391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:24.102391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:24.102397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:24.102398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.102400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:24.102400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:24.104016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:24.102527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:24.127790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255728797918630:4741]
2025-10-01T14:11:24.128045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1358, pipe: [1:7556255728797918630:4741]
2025-10-01T14:11:24.254045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:24.254334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.254348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.254431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797918630:4741], now have 1 active actors on pipe
2025-10-01T14:11:24.254593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:24.254911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:24.254960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255728797918630:4741]
2025-10-01T14:11:24.254979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:24.255039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1359 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c8e43559-930314ce-3eb774c9-dae3777c_0
2025-10-01T14:11:24.255383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e43559-930314ce-3eb774c9-dae3777c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:24.255393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e43559-930314ce-3eb774c9-dae3777c_0] Write session will restart in 0.006565s
2025-10-01T14:11:24.255416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e43559-930314ce-3eb774c9-dae3777c_0] Write session: Do CDS request
2025-10-01T14:11:24.255421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e43559-930314ce-3eb774c9-dae3777c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:24.255217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1359 sessionId: src_id|c8e43559-930314ce-3eb774c9-dae3777c_0 is DEAD
2025-10-01T14:11:24.262754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e43559-930314ce-3eb774c9-dae3777c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:24.262837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:24.262849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1360
2025-10-01T14:11:24.262994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:24.263021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:24.263025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:24.263029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:24.263714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1360 sessionId:  describe result for acl check
2025-10-01T14:11:24.263747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:24.263752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:24.263754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:24.263759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255728797918647:4161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:24.264510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255728797918647:4161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:24.266494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255728797918647:4161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:24.276792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:24.280424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:24.280624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:24.280634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:24.280644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:24.280694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:24.280727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255726421038674:9529]
2025-10-01T14:11:24.281325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:24.281885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:24.281927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:24.282214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:24.282255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.282257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.282258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.282259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.282260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.282261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.282262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.282263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.282265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.282266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.282267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.282268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.282269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.282270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.282274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.282283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.282287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.282291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.282294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.282298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.282302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.282305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.282309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.282313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.282317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.282320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.282324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.282327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.282333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.282340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.282346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.282351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.282357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.282362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.282366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.282387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.282391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.282396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.282400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.282404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.282409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.282414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.282418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.282423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.282427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.282432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.282436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.282441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.282446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.282451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.282455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.282459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.282464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.282469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.282473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.282477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.282516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:24.287105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:24.288006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:24.288020Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:24.288023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:24.288026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:24.288033Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1359 [2:7556255726421038674:9529]
2025-10-01T14:11:24.288051Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:24.288069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:24.288077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:24.288081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:24.288083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:24.288097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:24.288103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:24.288108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:24.288161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.288162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.288164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.288166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:24.288169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:24.288217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:24.288218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.288283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.288296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.288309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:24.288325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255726421038669:9529]
2025-10-01T14:11:24.288327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255726421038669:9529]
2025-10-01T14:11:24.288329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255726421038669:9529]
2025-10-01T14:11:24.288336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:24.288342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:24.288346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:24.288348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:24.288349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:24.288361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:24.288364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:24.288381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797918632:2446], now have 1 active actors on pipe
2025-10-01T14:11:24.288408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255726421038669:9529]
2025-10-01T14:11:24.288414Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:24.288426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:24.288695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1359
2025-10-01T14:11:24.294043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255728797918647:4161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:24.294058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255728797918647:4161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:24.294061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255728797918647:4161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:24.294071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:24.296266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797918828:4161], now have 1 active actors on pipe
2025-10-01T14:11:24.296418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.296430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.296458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:24.296471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:24.296479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:24.296482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:24.296494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:24.296511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:24.296532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:24.296678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.296695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.296708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:24.297176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e43559-930314ce-3eb774c9-dae3777c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:24.299625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0] Write session: try to update token
2025-10-01T14:11:24.299645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:24.296312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1359
2025-10-01T14:11:24.296785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1360 partition: 0 MaxSeqNo: 45 sessionId: src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0
2025-10-01T14:11:24.306979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:24.306997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:24.307007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255726421038669:9529]
2025-10-01T14:11:24.307054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:24.307162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:24.307303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:24.307435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:24.307559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:24.307700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:24.307925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:24.307962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:24.320673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1360 sessionId: src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:24.323160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:24.323502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:24.323365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.323395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.323430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:24.329280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:24.329299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:24.329302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:24.329304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:24.329314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255726421038669:9529]
2025-10-01T14:11:24.329318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255726421038669:9529]
2025-10-01T14:11:24.329321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255726421038669:9529]
2025-10-01T14:11:24.329363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:24.329369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:24.329376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:24.329376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.329378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:24.329379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:24.329515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:24.356949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255728797918835:4741]
2025-10-01T14:11:24.357471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1359, pipe: [1:7556255728797918835:4741]
2025-10-01T14:11:24.490005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:24.498678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.498705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.498892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.498958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.499021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.499083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.499125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.499133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.499212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.499279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.499338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.499422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.499462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.499464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.499549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.499617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.499681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.499748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.499791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.499794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.499870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.499935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.499999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.500067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.500110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.500113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.500185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.500249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.500315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.500384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.500429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.500433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.500513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.500572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.500635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.500711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.500753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.500756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.500823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.500881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.500942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.501005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.501044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.501047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.501116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.501175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.501237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.501298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.501337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.501340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.501413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.501474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.501534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.501594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.501638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.501641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.501710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:24.501770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:24.501830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:24.501892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:24.501939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:24.501943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:24.502015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797918835:4741], now have 1 active actors on pipe
2025-10-01T14:11:24.505234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:24.505248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0] Write session will restart in 0.009524s
2025-10-01T14:11:24.505274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0] Write session: Do CDS request
2025-10-01T14:11:24.505282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:24.504831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:24.504872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1360 reason: status is not ok: tablet will be restarted right now sessionId: src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0
2025-10-01T14:11:24.505080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1360 sessionId: src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0 is DEAD
2025-10-01T14:11:24.505248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255728797918835:4741]
2025-10-01T14:11:24.505261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:24.504357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:24.518828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:24.520035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:24.520054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1361
2025-10-01T14:11:24.520213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:24.520245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:24.520255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:24.520262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:24.521524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1361 sessionId:  describe result for acl check
2025-10-01T14:11:24.521559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:24.521561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:24.521565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:24.521570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255728797918903:4140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:24.522074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255728797918903:4140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:24.529908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255728797918903:4140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:24.535453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255728797918903:4140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:24.535469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255728797918903:4140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:24.535475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255728797918903:4140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:24.535485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:24.546475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:24.549223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:24.549487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:24.549491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:24.549502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:24.549555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:24.549591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255726421038875:9534]
2025-10-01T14:11:24.550222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:24.550682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:24.550722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:24.551076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:24.551127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.551129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.551129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.551130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.551131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.551132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.551134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.551135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.551136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.551136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.551138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.551139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.551140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.551142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.551147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.551156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.551160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.551164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.551168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.551172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.551175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.551178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.551182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.551186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.551189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.551193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.551196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.551199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.551206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.551214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.551219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.551225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.551229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.551234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.551239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.551244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.551248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.551253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.551257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.551262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.551266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.551272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.551276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.551281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.551285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.551290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.551294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.551299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.551303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.551308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.551313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.551318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.551325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.551331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.551336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.551340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.551373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:24.559589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:24.560157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:24.560163Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:24.560166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:24.560169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:24.560176Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1360 [2:7556255726421038875:9534]
2025-10-01T14:11:24.560192Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:24.560208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:24.560211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:24.560215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:24.560218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:24.560235Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:24.560240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:24.560246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:24.560304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.560306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.560308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.560311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:24.560314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:24.560381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:24.560384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.560394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.560405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.560421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:24.560439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255726421038870:9534]
2025-10-01T14:11:24.560444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255726421038870:9534]
2025-10-01T14:11:24.560449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255726421038870:9534]
2025-10-01T14:11:24.560471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:24.560495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:24.560521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:24.560526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:24.560582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255726421038870:9534]
2025-10-01T14:11:24.560588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:24.560838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:24.560845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:24.560847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:24.560853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:24.562197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797919016:4140], now have 1 active actors on pipe
2025-10-01T14:11:24.562208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797918870:2446], now have 1 active actors on pipe
2025-10-01T14:11:24.562225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.562230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.562257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|611cf394-793fe6c7-683233c5-8342cccb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:24.562265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:24.562269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:24.562272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:24.562280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:24.562291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:24.562307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:24.561518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1360
2025-10-01T14:11:24.561547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1360
2025-10-01T14:11:24.568830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.568849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.568881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:24.570037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1361 partition: 0 MaxSeqNo: 45 sessionId: src_id|611cf394-793fe6c7-683233c5-8342cccb_0
2025-10-01T14:11:24.570415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|604de91a-b0df06b5-dd6ab8c3-cfb668f6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|611cf394-793fe6c7-683233c5-8342cccb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:24.573087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611cf394-793fe6c7-683233c5-8342cccb_0] Write session: try to update token
2025-10-01T14:11:24.573109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611cf394-793fe6c7-683233c5-8342cccb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:24.593102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:24.593121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:24.593124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:24.593127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:24.593136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255726421038870:9534]
2025-10-01T14:11:24.593141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255726421038870:9534]
2025-10-01T14:11:24.593145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255726421038870:9534]
2025-10-01T14:11:24.593199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:24.593207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.593206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:24.593210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:24.593212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:24.593216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:24.593748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:24.607089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255728797919068:4741]
2025-10-01T14:11:24.612907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1360, pipe: [1:7556255728797919068:4741]
2025-10-01T14:11:24.623882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1361 sessionId: src_id|611cf394-793fe6c7-683233c5-8342cccb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:24.626276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:24.835671Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:24.836121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797919068:4741], now have 1 active actors on pipe
2025-10-01T14:11:24.836174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.836188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.841550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:24.842820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255728797919068:4741]
2025-10-01T14:11:24.842847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:24.842913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1361 reason: status is not ok: tablet will be restarted right now sessionId: src_id|611cf394-793fe6c7-683233c5-8342cccb_0
2025-10-01T14:11:24.843114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1361 sessionId: src_id|611cf394-793fe6c7-683233c5-8342cccb_0 is DEAD
2025-10-01T14:11:24.843221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:24.843580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611cf394-793fe6c7-683233c5-8342cccb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:24.843588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611cf394-793fe6c7-683233c5-8342cccb_0] Write session will restart in 0.008493s
2025-10-01T14:11:24.843614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611cf394-793fe6c7-683233c5-8342cccb_0] Write session: Do CDS request
2025-10-01T14:11:24.843621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611cf394-793fe6c7-683233c5-8342cccb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:24.854893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611cf394-793fe6c7-683233c5-8342cccb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:24.855201Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:24.855215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1362
2025-10-01T14:11:24.855367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:24.855394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:24.855399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:24.855402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:24.856851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1362 sessionId:  describe result for acl check
2025-10-01T14:11:24.856894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:24.856897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:24.856899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:24.856905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255728797919085:4135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:24.857417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255728797919085:4135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:24.868517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255728797919085:4135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:24.871835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255728797919085:4135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:24.871848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255728797919085:4135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:24.871851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255728797919085:4135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:24.871861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:24.912526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:24.925578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:24.925826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:24.925830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:24.925842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:24.925896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:24.925937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255726421039112:9546]
2025-10-01T14:11:24.926582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:24.927207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:24.927260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:24.927591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:24.927642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.927644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.927645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.927647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.927648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.927649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.927651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.927652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.927653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.927655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.927656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.927657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.927659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.927660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.927666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.927676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.927681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.927685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.927689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.927693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.927697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.927701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.927705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.927710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.927713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.927717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.927721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.927724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.927731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.927739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:24.927745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.927750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:24.927767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.927772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:24.927776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.927781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:24.927787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.927792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:24.927797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.927802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:24.927808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.927812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:24.927817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.927822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:24.927827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.927832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:24.927836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.927841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.927846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.927851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.927856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.927862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.927869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.927874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:24.927878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.927884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:24.927923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:24.944763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:24.945538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:24.945544Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:24.945546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:24.945550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:24.945557Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1361 [2:7556255726421039112:9546]
2025-10-01T14:11:24.945575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:24.945592Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:24.945595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:24.945599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:24.945602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:24.945618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:24.945625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:24.945633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:24.945691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.945693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.945695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.945698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:24.945701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:24.945773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:24.945775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.945787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:24.945797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:24.945813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:24.945830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255726421039104:9546]
2025-10-01T14:11:24.945833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255726421039104:9546]
2025-10-01T14:11:24.945835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255726421039104:9546]
2025-10-01T14:11:24.945848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:24.945863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:24.945877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:24.945879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:24.945920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255726421039104:9546]
2025-10-01T14:11:24.945922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:24.946572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255728797919271:4741]
2025-10-01T14:11:24.946632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1361
2025-10-01T14:11:24.946634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1361
2025-10-01T14:11:24.946298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:24.946304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:24.946305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:24.946310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:24.950357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797919126:4135], now have 1 active actors on pipe
2025-10-01T14:11:24.950384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797919076:2446], now have 1 active actors on pipe
2025-10-01T14:11:24.950411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.950417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.950450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:24.950460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:24.950466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:24.950469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:24.950481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:24.950496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:24.950516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:24.951313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1361, pipe: [1:7556255728797919271:4741]
2025-10-01T14:11:24.951463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255728797919271:4741], now have 1 active actors on pipe
2025-10-01T14:11:24.951477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:24.951482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:24.951501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:24.951992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1362 partition: 0 MaxSeqNo: 45 sessionId: src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0
2025-10-01T14:11:24.966301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611cf394-793fe6c7-683233c5-8342cccb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:24.968957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0] Write session: try to update token
2025-10-01T14:11:24.968982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:24.984178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:24.984198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:24.984200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:24.984203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:24.984213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255726421039104:9546]
2025-10-01T14:11:24.984218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255726421039104:9546]
2025-10-01T14:11:24.984223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255726421039104:9546]
2025-10-01T14:11:24.984273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:24.984280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:24.984283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:24.984420Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:24.987135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:24.987147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:24.987151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:24.998435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1362 sessionId: src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:25.000855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:25.222072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:25.222677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.222690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.223484Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:25.226551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:25.226565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0] Write session will restart in 0.005049s
2025-10-01T14:11:25.226593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0] Write session: Do CDS request
2025-10-01T14:11:25.226600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:25.225162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255728797919271:4741]
2025-10-01T14:11:25.225195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:25.225266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1362 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0
2025-10-01T14:11:25.225487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1362 sessionId: src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0 is DEAD
2025-10-01T14:11:25.225605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:25.234855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:25.235166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:25.235181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1363
2025-10-01T14:11:25.235362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:25.235391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:25.235396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:25.235399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:25.242754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1363 sessionId:  describe result for acl check
2025-10-01T14:11:25.242795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:25.242798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:25.242800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:25.242806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255733092886619:4113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:25.243322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255733092886619:4113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:25.254647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255733092886619:4113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:25.273237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255733092886619:4113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:25.273254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255733092886619:4113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:25.273260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255733092886619:4113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:25.273270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:25.277169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:25.279743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:25.279952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:25.279957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:25.279967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:25.280013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:25.280052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255730716006606:9550]
2025-10-01T14:11:25.280629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:25.281122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:25.281166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:25.281475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:25.281536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.281537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.281538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.281539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.281540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.281542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.281543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.281544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.281545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.281547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.281548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.281549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.281550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.281551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.281556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.281565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.281569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.281573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.281577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.281580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.281584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.281588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.281591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.281595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.281599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.281603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.281606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.281610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.281618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.281625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.281631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.281636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.281641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.281646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.281651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.281656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.281660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.281665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.281670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.281675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.281679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.281685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.281689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.281694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.281698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.281703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.281707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.281713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.281717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.281722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.281727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.281732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.281736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.281741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.281746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.281751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.281790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:25.291335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:25.291949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:25.291964Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:25.291967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:25.291971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:25.291978Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1362 [2:7556255730716006606:9550]
2025-10-01T14:11:25.292001Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:25.292022Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:25.292030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:25.292034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:25.292036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:25.292053Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:25.292064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:25.292070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:25.292135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.292143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.292145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.292148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:25.292151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:25.292226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:25.292234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.292245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.292257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.292278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:25.292298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255730716006601:9550]
2025-10-01T14:11:25.292305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255730716006601:9550]
2025-10-01T14:11:25.292308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255730716006601:9550]
2025-10-01T14:11:25.292322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:25.292342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:25.292361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:25.292368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:25.292368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:25.292372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:25.292376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:25.292404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255730716006601:9550]
2025-10-01T14:11:25.292413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:25.292461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:25.292540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092886603:2446], now have 1 active actors on pipe
2025-10-01T14:11:25.292548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092886751:4113], now have 1 active actors on pipe
2025-10-01T14:11:25.292913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1362
2025-10-01T14:11:25.292954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1362
2025-10-01T14:11:25.293285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.293293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.293319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b72a06f-dd647850-88461d8d-95d0603c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:25.293327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:25.293332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:25.293334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:25.293344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:25.293354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:25.293369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:25.296025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.296035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.296058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:25.296156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1363 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b72a06f-dd647850-88461d8d-95d0603c_0
2025-10-01T14:11:25.296579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c131772b-534f8a05-a19bd5ff-869f3dad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b72a06f-dd647850-88461d8d-95d0603c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:25.298942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b72a06f-dd647850-88461d8d-95d0603c_0] Write session: try to update token
2025-10-01T14:11:25.298961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b72a06f-dd647850-88461d8d-95d0603c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:25.315110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1363 sessionId: src_id|6b72a06f-dd647850-88461d8d-95d0603c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:25.317664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:25.318201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.318222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.318256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:25.325792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092886803:4741], now have 1 active actors on pipe
2025-10-01T14:11:25.320804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:25.325354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255733092886803:4741]
2025-10-01T14:11:25.325797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1362, pipe: [1:7556255733092886803:4741]
2025-10-01T14:11:25.334291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:25.334308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:25.334311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:25.334313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:25.334322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255730716006601:9550]
2025-10-01T14:11:25.334327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255730716006601:9550]
2025-10-01T14:11:25.334331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255730716006601:9550]
2025-10-01T14:11:25.334383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:25.334389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:25.334392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:25.334874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:25.334886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.334888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:25.335026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:25.485853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:25.494004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.494029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.494174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.494232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.494303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.494424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.494637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.494643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.494718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.494784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.494871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.494945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.494990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.494994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.495071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.495147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.495213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.495284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.495325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.495329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.495396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.495460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.495526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.495593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.495636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.495639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.495708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.495768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.495830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.495890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.495932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.495935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.496004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.496064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.496132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.496200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.496244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.496247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.496319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.496378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.496440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.496542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.496592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.496599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.496667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.496743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.496815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.496890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.496940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.496948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.497023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.497094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.497168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.497241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.497288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.497296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.497366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.497436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.497507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.497575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.497620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.497627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.498580Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:25.500077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b72a06f-dd647850-88461d8d-95d0603c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:25.500088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b72a06f-dd647850-88461d8d-95d0603c_0] Write session will restart in 0.008319s
2025-10-01T14:11:25.500113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b72a06f-dd647850-88461d8d-95d0603c_0] Write session: Do CDS request
2025-10-01T14:11:25.500119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b72a06f-dd647850-88461d8d-95d0603c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:25.498594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:25.498651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:25.498653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:25.498676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1363 reason: error at write: Disconnected sessionId: src_id|6b72a06f-dd647850-88461d8d-95d0603c_0
2025-10-01T14:11:25.498865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1363 sessionId: src_id|6b72a06f-dd647850-88461d8d-95d0603c_0 is DEAD
2025-10-01T14:11:25.498994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255733092886803:4741]
2025-10-01T14:11:25.509907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b72a06f-dd647850-88461d8d-95d0603c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:25.510439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:25.510455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1364
2025-10-01T14:11:25.510585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:25.510624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:25.510630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:25.510633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:25.511433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1364 sessionId:  describe result for acl check
2025-10-01T14:11:25.511475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:25.511477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:25.511479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:25.511484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255733092886889:4096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:25.512017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255733092886889:4096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:25.514199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255733092886889:4096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:25.517204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:25.517610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255733092886889:4096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:25.517623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255733092886889:4096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:25.517627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255733092886889:4096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:25.517635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:25.517844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:25.518029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:25.518040Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:25.518050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:25.518089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:25.518123Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255730716006809:9554]
2025-10-01T14:11:25.518693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:25.519645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:25.519693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:25.520112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:25.520172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.520178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.520179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.520180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.520181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.520182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.520183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.520184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.520185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.520186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.520187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.520188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.520189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.520190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.520196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.520205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.520208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.520211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.520215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.520218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.520221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.520224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.520228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.520231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.520235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.520238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.520241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.520244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.520251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.520257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.520263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.520268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.520272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.520277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.520280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.520285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.520289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.520301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.520304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.520309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.520313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.520317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.520320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.520325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.520328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.520333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.520337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.520341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.520346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.520350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.520355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.520359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.520364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.520368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.520372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.520377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.520412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:25.523949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:25.524866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:25.524878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:25.524880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:25.524884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:25.524890Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1363 [2:7556255730716006809:9554]
2025-10-01T14:11:25.524904Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:25.524918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:25.524925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:25.524928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:25.524930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:25.524945Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:25.524953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:25.524959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:25.525023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.525029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.525031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.525035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:25.525037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:25.525103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:25.525111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.525123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.525133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.525149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:25.525165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255730716006803:9554]
2025-10-01T14:11:25.525167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255730716006803:9554]
2025-10-01T14:11:25.525169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255730716006803:9554]
2025-10-01T14:11:25.525177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:25.525185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:25.525187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:25.525189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:25.525196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092887029:4096], now have 1 active actors on pipe
2025-10-01T14:11:25.525200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092886841:2446], now have 1 active actors on pipe
2025-10-01T14:11:25.525207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:25.525220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:25.525223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:25.525249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255730716006803:9554]
2025-10-01T14:11:25.525258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:25.525268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:25.525259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1363
2025-10-01T14:11:25.525287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1363
2025-10-01T14:11:25.525401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.525417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.525447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:25.525454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:25.525459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:25.525462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:25.525472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:25.525483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:25.525497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:25.525864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.525873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.525888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:25.525959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1364 partition: 0 MaxSeqNo: 45 sessionId: src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0
2025-10-01T14:11:25.526315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b72a06f-dd647850-88461d8d-95d0603c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:25.528828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0] Write session: try to update token
2025-10-01T14:11:25.528845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:25.547122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1364 sessionId: src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:25.549696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:25.549895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.549916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.549952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:25.550023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:25.552803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:25.552817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:25.552820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:25.552822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:25.552832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255730716006803:9554]
2025-10-01T14:11:25.552836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255730716006803:9554]
2025-10-01T14:11:25.552840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255730716006803:9554]
2025-10-01T14:11:25.552880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:25.552883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:25.552891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.552893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:25.552895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:25.552899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:25.553020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:25.602451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255733092887041:4741]
2025-10-01T14:11:25.607256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1363, pipe: [1:7556255733092887041:4741]
2025-10-01T14:11:25.703249Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:25.714094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.714122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.714289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.714357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.714461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.714522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.714700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.714705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.714771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.714825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.714886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.714944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.714983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.714986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.715045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.715095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.715151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.715203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.715243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.715245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.715305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.715356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.715405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.715453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.715488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.715491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.715556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.715606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.715660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.715711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.715750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.715752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.715819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.715868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.715923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.715983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.716027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.716030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.716092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.716145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.716200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.716255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.716296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.716301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.716361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.716415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.716468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.716524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.716566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.716569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.716633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.716705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.716767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.716829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.716872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.716875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.716942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:25.717004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:25.717067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:25.717127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:25.717165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:25.717168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:25.717372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092887041:4741], now have 1 active actors on pipe
2025-10-01T14:11:25.718860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:25.719060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255733092887041:4741]
2025-10-01T14:11:25.719108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:25.719110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:25.719133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1364 reason: error at write: Disconnected sessionId: src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0
2025-10-01T14:11:25.719325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1364 sessionId: src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0 is DEAD
2025-10-01T14:11:25.719441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:25.725617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:25.725654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0] Write session will restart in 0.006273s
2025-10-01T14:11:25.725680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0] Write session: Do CDS request
2025-10-01T14:11:25.725687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:25.733217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:25.737027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:25.737045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1365
2025-10-01T14:11:25.737183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:25.737215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:25.737220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:25.737223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:25.738740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1365 sessionId:  describe result for acl check
2025-10-01T14:11:25.738778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:25.738780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:25.738782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:25.738788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255733092887060:4092] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:25.739299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255733092887060:4092] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:25.742757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255733092887060:4092] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:25.762900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255733092887060:4092] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:25.762917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255733092887060:4092] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:25.762921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255733092887060:4092] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:25.762929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:25.769207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:25.770011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:25.770232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:25.770243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:25.770256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:25.770331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:25.770446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255730716007033:9563]
2025-10-01T14:11:25.771051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:25.771570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:25.771611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:25.772028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:25.772069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.772070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.772071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.772072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.772073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.772075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.772076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.772077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.772078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.772079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.772080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.772081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.772082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.772084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.772089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.772098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.772102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.772105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.772108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.772112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.772116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.772119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.772122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.772147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.772150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.772154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.772157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.772160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.772167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.772173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:25.772179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.772185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:25.772188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.772193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:25.772196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.772201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:25.772206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.772211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:25.772215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.772220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:25.772225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.772229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:25.772233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.772238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:25.772242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.772247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:25.772251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.772256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.772260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.772265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.772269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.772273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.772278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.772283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:25.772287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.772291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:25.772327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:25.776836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:25.777715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:25.777720Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:25.777722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:25.777725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:25.777731Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1364 [2:7556255730716007033:9563]
2025-10-01T14:11:25.777746Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:25.777761Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:25.777764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:25.777768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:25.777770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:25.777786Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:25.777791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:25.777797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:25.777850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.777852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.777853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.777857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:25.777860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:25.777930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:25.777932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.777943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:25.777953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:25.777966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:25.777981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255730716007028:9563]
2025-10-01T14:11:25.777983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255730716007028:9563]
2025-10-01T14:11:25.777985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255730716007028:9563]
2025-10-01T14:11:25.777993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:25.778001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:25.778004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:25.778004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:25.778006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:25.778016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:25.778019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:25.778029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092887044:2446], now have 1 active actors on pipe
2025-10-01T14:11:25.778033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092887233:4092], now have 1 active actors on pipe
2025-10-01T14:11:25.778056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255730716007028:9563]
2025-10-01T14:11:25.778063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:25.778068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:25.778489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1364
2025-10-01T14:11:25.778526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1364
2025-10-01T14:11:25.778786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.778796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.778820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:25.778827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:25.778831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:25.778833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:25.778843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:25.778852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:25.778866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:25.781523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.781532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.781551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:25.781707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1365 partition: 0 MaxSeqNo: 45 sessionId: src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0
2025-10-01T14:11:25.782138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f79d3e-e545a1f4-c386f6ef-a10137a8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:25.792205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0] Write session: try to update token
2025-10-01T14:11:25.792230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:25.817552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:25.819573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:25.819579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:25.819582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:25.819592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255730716007028:9563]
2025-10-01T14:11:25.819597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255730716007028:9563]
2025-10-01T14:11:25.819601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255730716007028:9563]
2025-10-01T14:11:25.819660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:25.819668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:25.819671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:25.819793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:25.820024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:25.820033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:25.820036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:25.817635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1365 sessionId: src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:25.819325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255733092887247:4741]
2025-10-01T14:11:25.820193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1364, pipe: [1:7556255733092887247:4741]
2025-10-01T14:11:25.822167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:25.976378Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:25.976894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092887247:4741], now have 1 active actors on pipe
2025-10-01T14:11:25.976931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:25.976939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:25.977513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:25.981659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:25.981718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255733092887247:4741]
2025-10-01T14:11:25.981751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:25.981831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1365 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0
2025-10-01T14:11:25.982030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1365 sessionId: src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0 is DEAD
2025-10-01T14:11:25.986480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:25.986496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0] Write session will restart in 0.007542s
2025-10-01T14:11:25.986523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0] Write session: Do CDS request
2025-10-01T14:11:25.986528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:25.995012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:25.998554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:25.998572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1366
2025-10-01T14:11:25.998780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:25.998824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:25.998830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:25.998834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:26.001170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1366 sessionId:  describe result for acl check
2025-10-01T14:11:26.001204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:26.001208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:26.001210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:26.001214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255737387854564:4082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:26.001686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255737387854564:4082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:26.003990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255737387854564:4082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:26.006969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255737387854564:4082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:26.006982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255737387854564:4082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:26.006985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255737387854564:4082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:26.006993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:26.028301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:26.030741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:26.030966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:26.030970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:26.030980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:26.031025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:26.031055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255735010974541:9571]
2025-10-01T14:11:26.031634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:26.031911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:26.031945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:26.032233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:26.032273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.032274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.032275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.032276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.032278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.032279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.032280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.032281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.032282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.032283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.032284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.032285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.032287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.032288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.032292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.032301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.032305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.032309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.032312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.032316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.032319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.032323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.032326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.032330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.032334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.032337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.032341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.032344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.032351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.032358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.032364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.032369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.032373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.032378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.032382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.032386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.032391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.032395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.032399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.032404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.032408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.032413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.032417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.032422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.032426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.032431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.032435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.032440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.032444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.032449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.032452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.032458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.032463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.032468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.032471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.032476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.032514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:26.038171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:26.042735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1365
2025-10-01T14:11:26.042774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1365
2025-10-01T14:11:26.038819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:26.038834Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:26.038837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:26.038841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:26.038848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1365 [2:7556255735010974541:9571]
2025-10-01T14:11:26.038864Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:26.038881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:26.038885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:26.038888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:26.038890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:26.038906Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:26.038912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:26.038918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:26.038979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.038981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.038983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.038987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:26.038990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:26.039058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:26.039061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.039072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.039081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.039095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:26.039111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255735010974536:9571]
2025-10-01T14:11:26.039114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255735010974536:9571]
2025-10-01T14:11:26.039116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255735010974536:9571]
2025-10-01T14:11:26.039131Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:26.039144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:26.039158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:26.039161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:26.039196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255735010974536:9571]
2025-10-01T14:11:26.039198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:26.039381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:26.039383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:26.039384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:26.039388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:26.039392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387854597:4082], now have 1 active actors on pipe
2025-10-01T14:11:26.039400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255733092887255:2446], now have 1 active actors on pipe
2025-10-01T14:11:26.042889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.042898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.042927Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:26.042938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:26.042944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:26.042947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:26.042958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:26.042972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:26.042986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:26.043278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1366 partition: 0 MaxSeqNo: 45 sessionId: src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0
2025-10-01T14:11:26.043923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d24e2baf-deeff68c-8b2f9d17-ddbb4d68_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:26.043158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.043169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.043183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:26.046439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0] Write session: try to update token
2025-10-01T14:11:26.046456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:26.073195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1366 sessionId: src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:26.075833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:26.076360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.076382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.076420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:26.077302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:26.082434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255737387854763:4741]
2025-10-01T14:11:26.082836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387854763:4741], now have 1 active actors on pipe
2025-10-01T14:11:26.082856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1365, pipe: [1:7556255737387854763:4741]
2025-10-01T14:11:26.105307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:26.105333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:26.105336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:26.105339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:26.105349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255735010974536:9571]
2025-10-01T14:11:26.105354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255735010974536:9571]
2025-10-01T14:11:26.105358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255735010974536:9571]
2025-10-01T14:11:26.105408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:26.105418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.105426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:26.105552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:26.106887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:26.106892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:26.106896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:26.271813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:26.280554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.280580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.280771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.280832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.280894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.280954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.281006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.281011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.281079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.281149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.281213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.281273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.281317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.281326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.281390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.281446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.281512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.281573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.281617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.281621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.281685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.281750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.281810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.281873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.281916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.281923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.281990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.282050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.282114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.282171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.282210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.282214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.282281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.282345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.282428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.282490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.282534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.282541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.282612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.282674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.282736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.282798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.282841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.282849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.282913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.282976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.283035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.283092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.283135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.283138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.283204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.283263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.283334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.283395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.283433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.283436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.283495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.283548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.283612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.283671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.283711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.283713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.285260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:26.285374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:26.285387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:26.285412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1366 reason: error at write: Disconnected sessionId: src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0
2025-10-01T14:11:26.285623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1366 sessionId: src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0 is DEAD
2025-10-01T14:11:26.285751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:26.285784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255737387854763:4741]
2025-10-01T14:11:26.285967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:26.285978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0] Write session will restart in 0.006455s
2025-10-01T14:11:26.286003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0] Write session: Do CDS request
2025-10-01T14:11:26.286009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:26.293929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:26.294847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:26.294862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1367
2025-10-01T14:11:26.295017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:26.295050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:26.295056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:26.295060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:26.296325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1367 sessionId:  describe result for acl check
2025-10-01T14:11:26.296362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:26.296366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:26.296370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:26.296376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255737387854793:4076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:26.296892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255737387854793:4076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:26.302427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255737387854793:4076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:26.314691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255737387854793:4076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:26.314711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255737387854793:4076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:26.314714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255737387854793:4076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:26.314723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:26.318744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:26.320913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:26.321241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:26.321246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:26.321263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:26.321334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:26.321376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255735010974740:9573]
2025-10-01T14:11:26.321934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:26.322577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:26.322632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:26.322950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:26.323017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.323018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.323019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.323020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.323021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.323023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.323024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.323025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.323026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.323027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.323028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.323029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.323031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.323032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.323037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.323047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.323051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.323055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.323058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.323061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.323065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.323068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.323072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.323076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.323079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.323082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.323086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.323089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.323097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.323106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.323112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.323117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.323122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.323127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.323130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.323136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.323140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.323146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.323150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.323155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.323160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.323165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.323168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.323173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.323178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.323183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.323188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.323193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.323197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.323202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.323206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.323211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.323216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.323221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.323226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.323231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.323269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:26.327741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:26.328340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:26.328345Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:26.328347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:26.328350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:26.328357Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1366 [2:7556255735010974740:9573]
2025-10-01T14:11:26.328373Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:26.328390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:26.328393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:26.328397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:26.328400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:26.328414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:26.328420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:26.328426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:26.328483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.328486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.328488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.328491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:26.328494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:26.328560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:26.328562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.328573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.328583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.328598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:26.328613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255735010974735:9573]
2025-10-01T14:11:26.328615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255735010974735:9573]
2025-10-01T14:11:26.328617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255735010974735:9573]
2025-10-01T14:11:26.328629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:26.328643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:26.328656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:26.328658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:26.328697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255735010974735:9573]
2025-10-01T14:11:26.328699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:26.329211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1366
2025-10-01T14:11:26.329261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1366
2025-10-01T14:11:26.328896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:26.328903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:26.328905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:26.328910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:26.329636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387854768:2446], now have 1 active actors on pipe
2025-10-01T14:11:26.329646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387854952:4076], now have 1 active actors on pipe
2025-10-01T14:11:26.329665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.329671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.329698Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:26.329706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:26.329710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:26.329713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:26.329723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:26.329734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:26.329749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:26.330346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.330356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.330397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:26.331303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1367 partition: 0 MaxSeqNo: 45 sessionId: src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0
2025-10-01T14:11:26.331733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e37dbd-7749013e-fb8a7913-1d740206_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:26.334535Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0] Write session: try to update token
2025-10-01T14:11:26.334553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:26.352839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1367 sessionId: src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:26.355263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:26.355454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.355470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.355501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:26.355593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:26.361497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:26.361510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:26.361513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:26.361514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:26.361522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255735010974735:9573]
2025-10-01T14:11:26.361526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255735010974735:9573]
2025-10-01T14:11:26.361529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255735010974735:9573]
2025-10-01T14:11:26.361569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:26.361575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.361577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:26.361694Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:26.362475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:26.362485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:26.362490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:26.385689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255737387854979:4741]
2025-10-01T14:11:26.386010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1366, pipe: [1:7556255737387854979:4741]
2025-10-01T14:11:26.522741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:26.523281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387854979:4741], now have 1 active actors on pipe
2025-10-01T14:11:26.531794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.531822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.532002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.532074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.532141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.532204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.532260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.532265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.532336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.532401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.532465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.532533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.532577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.532583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.532646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.532716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.532776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.532835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.532877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.532884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.532947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.533004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.533061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.533123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.533166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.533170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.533234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.533292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.533355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.533417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.533459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.533462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.533530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.533594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.533661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.533813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.533857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.533867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.533931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.533988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.534052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.534114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.534159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.534166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.534233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.534291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.534354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.534444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.534494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.534497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.534571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.534632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.534696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.534763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.534808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.534812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.534885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:26.534942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:26.535009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:26.535076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:26.535121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:26.535124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:26.536894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:26.536942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:26.536946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:26.536972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1367 reason: error at write: Disconnected sessionId: src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0
2025-10-01T14:11:26.537227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255737387854979:4741]
2025-10-01T14:11:26.537260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1367 sessionId: src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0 is DEAD
2025-10-01T14:11:26.537740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:26.538486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:26.538514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0] Write session will restart in 0.005212s
2025-10-01T14:11:26.538539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0] Write session: Do CDS request
2025-10-01T14:11:26.538545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:26.549690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:26.549821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:26.549838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1368
2025-10-01T14:11:26.550832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:26.550875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:26.550880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:26.550884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:26.551381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1368 sessionId:  describe result for acl check
2025-10-01T14:11:26.551412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:26.551414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:26.551416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:26.551422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255737387855169:4062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:26.551953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255737387855169:4062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:26.555969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:26.558498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255737387855169:4062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:26.561833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:26.562090Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:26.562094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:26.562104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:26.562150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:26.562178Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255735010974946:9578]
2025-10-01T14:11:26.562755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:26.563352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:26.563396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:26.563744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:26.563805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.563811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.563812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.563814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.563815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.563816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.563818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.563819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.563820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.563822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.563824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.563825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.563826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.563827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.563834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.563847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.563851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.563855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.563859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.563863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.563867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.563870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.563874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.563878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.563882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.563886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.563890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.563893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.563901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.563908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.563915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.563925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.563931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.563941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.563946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.563955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.563959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.563964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.563972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.563978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.563983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.563988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.563997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.564002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.564013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.564023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.564027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.564036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.564040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.564049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.564053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.564058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.564065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.564069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.564072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.564076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.564116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:26.570287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255737387855169:4062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:26.570305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255737387855169:4062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:26.570309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255737387855169:4062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:26.570320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:26.571805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:26.573229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1367
2025-10-01T14:11:26.573258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1367
2025-10-01T14:11:26.572480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:26.572497Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:26.572500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:26.572504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:26.572513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1367 [2:7556255735010974946:9578]
2025-10-01T14:11:26.572531Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:26.572549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:26.572552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:26.572556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:26.572559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:26.572577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:26.572583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:26.572591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:26.572659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.572662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.572664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.572668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:26.572670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:26.572757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:26.572759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.572772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.572785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.572802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:26.572819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255735010974940:9578]
2025-10-01T14:11:26.572822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255735010974940:9578]
2025-10-01T14:11:26.572824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255735010974940:9578]
2025-10-01T14:11:26.572840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:26.572856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:26.572873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:26.572875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:26.572914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255735010974940:9578]
2025-10-01T14:11:26.572917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:26.572925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:26.572929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:26.572931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:26.572937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:26.573051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387855207:4062], now have 1 active actors on pipe
2025-10-01T14:11:26.573056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387855011:2446], now have 1 active actors on pipe
2025-10-01T14:11:26.574089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.574102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.574133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:26.574142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:26.574146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:26.574149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:26.574160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:26.574171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:26.574189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:26.576211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.576224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.576249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:26.576361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1368 partition: 0 MaxSeqNo: 45 sessionId: src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0
2025-10-01T14:11:26.576795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d957d83-ceaea1fc-ed449e5a-15ef970a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:26.579026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0] Write session: try to update token
2025-10-01T14:11:26.579043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:26.597473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1368 sessionId: src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:26.600174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:26.600276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:26.600295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:26.600298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:26.600300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:26.600310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255735010974940:9578]
2025-10-01T14:11:26.600315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255735010974940:9578]
2025-10-01T14:11:26.600319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255735010974940:9578]
2025-10-01T14:11:26.600344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:26.600349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:26.600351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:26.600374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.600384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.600406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:26.600413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.600416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:26.600546Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:26.637666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255737387855214:4741]
2025-10-01T14:11:26.640050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1367, pipe: [1:7556255737387855214:4741]
2025-10-01T14:11:26.752566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:26.753077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387855214:4741], now have 1 active actors on pipe
2025-10-01T14:11:26.753803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:26.753816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:26.753871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1368 reason: error at write: Disconnected sessionId: src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0
2025-10-01T14:11:26.754057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1368 sessionId: src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0 is DEAD
2025-10-01T14:11:26.754222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255737387855214:4741]
2025-10-01T14:11:26.754235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:26.754632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:26.756801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:26.756813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0] Write session will restart in 0.006537s
2025-10-01T14:11:26.756837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0] Write session: Do CDS request
2025-10-01T14:11:26.756843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:26.766791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:26.770705Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:26.770721Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1369
2025-10-01T14:11:26.774516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:26.774566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:26.774571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:26.774575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:26.775025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1369 sessionId:  describe result for acl check
2025-10-01T14:11:26.775061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:26.775070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:26.775072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:26.775077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255737387855225:4054] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:26.775594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255737387855225:4054] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:26.780636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255737387855225:4054] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:26.799014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255737387855225:4054] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:26.799031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255737387855225:4054] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:26.799034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255737387855225:4054] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:26.799042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:26.807162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:26.809934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:26.810103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:26.810112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:26.810123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:26.810184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:26.810221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255735010975177:9586]
2025-10-01T14:11:26.810800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:26.811137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:26.811192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:26.811417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:26.811526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.811532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.811533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.811534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.811535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.811536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.811536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.811537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.811538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.811539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.811540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.811540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.811541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.811542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.811546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.811551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.811554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.811556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.811558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.811560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.811562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.811564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.811566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.811569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.811570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.811573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.811575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.811577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.811582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.811586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:26.811590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.811594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:26.811596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.811599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:26.811601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.811604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:26.811607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.811609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:26.811621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.811625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:26.811627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.811630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:26.811632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.811635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:26.811638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.811641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:26.811643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.811646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.811648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.811651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.811653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.811656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.811659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.811662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:26.811664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.811668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:26.811689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:26.815191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:26.816305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:26.816309Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:26.816311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:26.816315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:26.816320Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1368 [2:7556255735010975177:9586]
2025-10-01T14:11:26.816335Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:26.816350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:26.816353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:26.816357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:26.816359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:26.816372Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:26.816377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:26.816383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:26.816437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.816438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.816440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.816443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:26.816446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:26.816510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:26.816512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.816522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:26.816532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:26.816545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:26.816563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387855217:2446], now have 1 active actors on pipe
2025-10-01T14:11:26.816566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387855364:4054], now have 1 active actors on pipe
2025-10-01T14:11:26.816572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255735010975172:9586]
2025-10-01T14:11:26.816574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255735010975172:9586]
2025-10-01T14:11:26.816576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255735010975172:9586]
2025-10-01T14:11:26.816589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:26.816597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:26.816599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:26.816600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:26.816601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:26.816613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:26.816615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:26.816639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255735010975172:9586]
2025-10-01T14:11:26.816645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:26.816644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1368
2025-10-01T14:11:26.816656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1368
2025-10-01T14:11:26.816649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:26.816833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.816845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.816869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88981229-34a45a4e-6d574920-58b7cc50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:26.816879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:26.816883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:26.816887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:26.816896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:26.816904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:26.816916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:26.817035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.817041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.817053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:26.817141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1369 partition: 0 MaxSeqNo: 45 sessionId: src_id|88981229-34a45a4e-6d574920-58b7cc50_0
2025-10-01T14:11:26.817477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ad1730-1c122ddc-c50dd6df-7b3a185d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|88981229-34a45a4e-6d574920-58b7cc50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:26.819831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88981229-34a45a4e-6d574920-58b7cc50_0] Write session: try to update token
2025-10-01T14:11:26.819848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88981229-34a45a4e-6d574920-58b7cc50_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:26.842145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1369 sessionId: src_id|88981229-34a45a4e-6d574920-58b7cc50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:26.839040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:26.839059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:26.839061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:26.839064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:26.839075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255735010975172:9586]
2025-10-01T14:11:26.839080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255735010975172:9586]
2025-10-01T14:11:26.839083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255735010975172:9586]
2025-10-01T14:11:26.839131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:26.839139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:26.839142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:26.839303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:26.839517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:26.839524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:26.839528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:26.844723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:26.850686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255737387855427:4741]
2025-10-01T14:11:26.852501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1368, pipe: [1:7556255737387855427:4741]
2025-10-01T14:11:26.996626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:26.997407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:26.997420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:26.997458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387855427:4741], now have 1 active actors on pipe
2025-10-01T14:11:26.997821Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:26.998675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:26.998730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255737387855427:4741]
2025-10-01T14:11:26.998751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:26.998815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1369 reason: status is not ok: tablet will be restarted right now sessionId: src_id|88981229-34a45a4e-6d574920-58b7cc50_0
2025-10-01T14:11:26.998974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1369 sessionId: src_id|88981229-34a45a4e-6d574920-58b7cc50_0 is DEAD
2025-10-01T14:11:26.999439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88981229-34a45a4e-6d574920-58b7cc50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:26.999448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88981229-34a45a4e-6d574920-58b7cc50_0] Write session will restart in 0.005531s
2025-10-01T14:11:26.999468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88981229-34a45a4e-6d574920-58b7cc50_0] Write session: Do CDS request
2025-10-01T14:11:26.999473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88981229-34a45a4e-6d574920-58b7cc50_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:27.005821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88981229-34a45a4e-6d574920-58b7cc50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.006065Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:27.006078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1370
2025-10-01T14:11:27.006231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.006259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:27.006264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:27.006267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:27.006721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1370 sessionId:  describe result for acl check
2025-10-01T14:11:27.006760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:27.006762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:27.006763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:27.006769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255741682822744:4053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:27.007244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255741682822744:4053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:27.011451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255741682822744:4053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:27.019137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255741682822744:4053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:27.019154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255741682822744:4053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:27.019157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255741682822744:4053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:27.019165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:27.026448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:27.036917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:27.037160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:27.037170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:27.037181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:27.037224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:27.037263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255739305942688:9594]
2025-10-01T14:11:27.037863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:27.038141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:27.038191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:27.038485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:27.038550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.038551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.038553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.038554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.038555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.038556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.038557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.038558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.038560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.038561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.038563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.038564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.038565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.038566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.038571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.038581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.038585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.038588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.038591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.038595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.038598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.038602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.038606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.038610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.038614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.038618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.038621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.038625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.038631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.038639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.038644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.038649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.038653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.038658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.038662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.038666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.038671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.038676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.038679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.038684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.038689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.038694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.038698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.038702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.038707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.038712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.038716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.038720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.038726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.038730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.038734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.038738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.038742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.038746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.038750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.038754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.038792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:27.043729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1369
2025-10-01T14:11:27.043729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1369
2025-10-01T14:11:27.042641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:27.043340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:27.043345Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:27.043348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:27.043351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:27.043358Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1369 [2:7556255739305942688:9594]
2025-10-01T14:11:27.043374Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:27.043391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:27.043394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.043397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.043399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.043414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:27.043419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:27.043425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:27.043481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.043483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.043485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.043488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:27.043490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:27.043556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:27.043558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.043569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.043580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.043596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:27.043614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255737387855433:2446], now have 1 active actors on pipe
2025-10-01T14:11:27.043617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682822921:4053], now have 1 active actors on pipe
2025-10-01T14:11:27.043624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255739305942682:9594]
2025-10-01T14:11:27.043626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255739305942682:9594]
2025-10-01T14:11:27.043628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255739305942682:9594]
2025-10-01T14:11:27.043644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:27.043657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:27.043660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:27.043663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:27.043665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:27.043670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:27.043672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:27.043701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255739305942682:9594]
2025-10-01T14:11:27.043707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:27.043714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:27.043817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.043825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.043856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:27.043866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.043871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.043873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:27.043885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.043896Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:27.043912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.044073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.044076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.044089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.044169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1370 partition: 0 MaxSeqNo: 45 sessionId: src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0
2025-10-01T14:11:27.044580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88981229-34a45a4e-6d574920-58b7cc50_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:27.046983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0] Write session: try to update token
2025-10-01T14:11:27.047001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:27.066214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1370 sessionId: src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:27.068744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:27.072793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.072813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.072848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:27.075364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:27.081656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:27.081673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:27.081675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:27.081676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:27.081684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255739305942682:9594]
2025-10-01T14:11:27.081687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255739305942682:9594]
2025-10-01T14:11:27.081690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255739305942682:9594]
2025-10-01T14:11:27.081725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:27.081731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.081732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:27.081848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:27.082419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:27.082426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:27.082430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:27.099504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255741682822953:4741]
2025-10-01T14:11:27.100030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1369, pipe: [1:7556255741682822953:4741]
2025-10-01T14:11:27.238891Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:27.239329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682822953:4741], now have 1 active actors on pipe
2025-10-01T14:11:27.247248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.247275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.247447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.247520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.247585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.247655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.248212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.248233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.248303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.248367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.248427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.248495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.248538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.248545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.248602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.248656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.248727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.248787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.248829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.248836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.248892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.249040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.249142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.249199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.249240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.249249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.249305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.249365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.249423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.249479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.249523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.249530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.249588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.249645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.249705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.249771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.249818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.249826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.249888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.249948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.250011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.250071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.250114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.250122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.250187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.250244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.250302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.250362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.250421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.250428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.250494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.250553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.250615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.250676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.250722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.250725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.250792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.250851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.250913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.250974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.251015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.251022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.251478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:27.251344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:27.251425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255741682822953:4741]
2025-10-01T14:11:27.251451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:27.251453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:27.251487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1370 reason: error at write: Disconnected sessionId: src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0
2025-10-01T14:11:27.251767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1370 sessionId: src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0 is DEAD
2025-10-01T14:11:27.251893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:27.251905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0] Write session will restart in 0.007200s
2025-10-01T14:11:27.251928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0] Write session: Do CDS request
2025-10-01T14:11:27.251934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:27.259949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.260008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:27.260021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1371
2025-10-01T14:11:27.260177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.260217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:27.260222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:27.260225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:27.260570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1371 sessionId:  describe result for acl check
2025-10-01T14:11:27.260604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:27.260612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:27.260614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:27.260619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255741682822997:4034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:27.261126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255741682822997:4034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:27.264271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255741682822997:4034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:27.266709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:27.266910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255741682822997:4034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:27.266929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255741682822997:4034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:27.266933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255741682822997:4034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:27.266941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:27.268985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:27.269162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:27.269171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:27.269182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:27.269223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:27.269260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255739305942889:9596]
2025-10-01T14:11:27.269901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:27.270149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:27.270181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:27.270491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:27.270540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.270545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.270546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.270547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.270548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.270550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.270551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.270552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.270553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.270555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.270556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.270557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.270559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.270560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.270564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.270574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.270578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.270581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.270585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.270589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.270592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.270596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.270600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.270604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.270607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.270611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.270615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.270618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.270624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.270631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.270636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.270641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.270645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.270650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.270654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.270659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.270663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.270668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.270673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.270680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.270685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.270694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.270698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.270707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.270713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.270722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.270726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.270731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.270739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.270744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.270752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.270757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.270761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.270767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.270775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.270779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.270818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:27.274747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:27.275443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:27.275457Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:27.275461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:27.275464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:27.275471Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1370 [2:7556255739305942889:9596]
2025-10-01T14:11:27.275486Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:27.275504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:27.275510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.275515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.275517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.275532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:27.275542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:27.275550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:27.275605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.275612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.275614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.275617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:27.275620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:27.275687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:27.275699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.275710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.275721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.275736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:27.275753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682822956:2446], now have 1 active actors on pipe
2025-10-01T14:11:27.275761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823154:4034], now have 1 active actors on pipe
2025-10-01T14:11:27.275767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255739305942883:9596]
2025-10-01T14:11:27.275770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255739305942883:9596]
2025-10-01T14:11:27.275772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255739305942883:9596]
2025-10-01T14:11:27.275786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:27.275802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:27.275815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:27.275815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:27.275819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:27.275821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:27.275822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:27.275830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1370
2025-10-01T14:11:27.275849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255739305942883:9596]
2025-10-01T14:11:27.275836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1370
2025-10-01T14:11:27.275858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:27.275860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:27.275887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.275895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.275924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc8e554-8248757d-18ffc402-90b88dd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:27.275934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.275937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.275940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:27.275948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.275955Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:27.275979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.276122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.276129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.276142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.276248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1371 partition: 0 MaxSeqNo: 45 sessionId: src_id|bc8e554-8248757d-18ffc402-90b88dd9_0
2025-10-01T14:11:27.276631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ed8f078-879d020d-7a66904a-52aec5bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bc8e554-8248757d-18ffc402-90b88dd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:27.278950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e554-8248757d-18ffc402-90b88dd9_0] Write session: try to update token
2025-10-01T14:11:27.278967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e554-8248757d-18ffc402-90b88dd9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:27.294334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1371 sessionId: src_id|bc8e554-8248757d-18ffc402-90b88dd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:27.296752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:27.298445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.298468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.298489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:27.298493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:27.298495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:27.298498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:27.298506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255739305942883:9596]
2025-10-01T14:11:27.298512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255739305942883:9596]
2025-10-01T14:11:27.298516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255739305942883:9596]
2025-10-01T14:11:27.298557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:27.298571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:27.298573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:27.298577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:27.298579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.298581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:27.298709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:27.351315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255741682823165:4741]
2025-10-01T14:11:27.351792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1370, pipe: [1:7556255741682823165:4741]
2025-10-01T14:11:27.456901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:27.457502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:27.457558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823165:4741], now have 1 active actors on pipe
2025-10-01T14:11:27.457678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:27.458168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255741682823165:4741]
2025-10-01T14:11:27.458197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:27.469286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:27.469301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:27.469327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1371 reason: error at write: Disconnected sessionId: src_id|bc8e554-8248757d-18ffc402-90b88dd9_0
2025-10-01T14:11:27.469519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1371 sessionId: src_id|bc8e554-8248757d-18ffc402-90b88dd9_0 is DEAD
2025-10-01T14:11:27.470977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e554-8248757d-18ffc402-90b88dd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:27.470986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e554-8248757d-18ffc402-90b88dd9_0] Write session will restart in 0.005273s
2025-10-01T14:11:27.471005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e554-8248757d-18ffc402-90b88dd9_0] Write session: Do CDS request
2025-10-01T14:11:27.471012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e554-8248757d-18ffc402-90b88dd9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:27.478032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e554-8248757d-18ffc402-90b88dd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.478399Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:27.478414Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1372
2025-10-01T14:11:27.478606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.478636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:27.478643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:27.478647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:27.479152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1372 sessionId:  describe result for acl check
2025-10-01T14:11:27.479183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:27.479185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:27.479186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:27.479192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255741682823269:4029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:27.479696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255741682823269:4029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:27.483498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:27.483256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255741682823269:4029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:27.486167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:27.486407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:27.486418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:27.486431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:27.486487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:27.486529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255739305943092:9598]
2025-10-01T14:11:27.486560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255741682823269:4029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:27.486576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255741682823269:4029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:27.486579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255741682823269:4029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:27.486588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:27.487103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:27.487592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:27.487646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:27.487959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:27.488021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.488022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.488023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.488024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.488025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.488027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.488028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.488029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.488030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.488031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.488032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.488033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.488034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.488036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.488041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.488050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.488054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.488058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.488061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.488065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.488068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.488071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.488075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.488078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.488081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.488084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.488088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.488092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.488098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.488106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.488112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.488117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.488121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.488126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.488130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.488135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.488139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.488143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.488148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.488152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.488156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.488160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.488166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.488170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.488174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.488179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.488182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.488187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.488191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.488196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.488200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.488203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.488207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.488212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.488215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.488220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.488256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:27.492282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:27.493214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:27.493231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:27.493234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:27.493237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:27.493243Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1371 [2:7556255739305943092:9598]
2025-10-01T14:11:27.493258Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:27.493271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:27.493277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.493279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.493280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.493293Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:27.493300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:27.493304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:27.493347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.493355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.493357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.493359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:27.493361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:27.493421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:27.493428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.493440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.493454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.493473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:27.493491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823374:4029], now have 1 active actors on pipe
2025-10-01T14:11:27.493494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823176:2446], now have 1 active actors on pipe
2025-10-01T14:11:27.493500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255739305943087:9598]
2025-10-01T14:11:27.493502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255739305943087:9598]
2025-10-01T14:11:27.493504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255739305943087:9598]
2025-10-01T14:11:27.493517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:27.493528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:27.493529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:27.493530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:27.493532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:27.493541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:27.493544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:27.493573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255739305943087:9598]
2025-10-01T14:11:27.493582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:27.493566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1371
2025-10-01T14:11:27.493568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1371
2025-10-01T14:11:27.493598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:27.493627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.493632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.493658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c35051d-471d0285-bd4054ec-54b3a677_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:27.493670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.493677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.493680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:27.493690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.493702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:27.493719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.493865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.493876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.493895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.494000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1372 partition: 0 MaxSeqNo: 45 sessionId: src_id|3c35051d-471d0285-bd4054ec-54b3a677_0
2025-10-01T14:11:27.494407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc8e554-8248757d-18ffc402-90b88dd9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3c35051d-471d0285-bd4054ec-54b3a677_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:27.496791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35051d-471d0285-bd4054ec-54b3a677_0] Write session: try to update token
2025-10-01T14:11:27.496809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35051d-471d0285-bd4054ec-54b3a677_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:27.513283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:27.513309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:27.513322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255739305943087:9598]
2025-10-01T14:11:27.513366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:27.513377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:27.514176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:27.514512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:27.514727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:27.514887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:27.515183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:27.515265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:27.523894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1372 sessionId: src_id|3c35051d-471d0285-bd4054ec-54b3a677_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:27.525177Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:27.525198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:27.525200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:27.525202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:27.525213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255739305943087:9598]
2025-10-01T14:11:27.525216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255739305943087:9598]
2025-10-01T14:11:27.525220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255739305943087:9598]
2025-10-01T14:11:27.525268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:27.525272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:27.525279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.525281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:27.525284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:27.525289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:27.525412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:27.526417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:27.557878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255741682823399:4741]
2025-10-01T14:11:27.558260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1371, pipe: [1:7556255741682823399:4741]
2025-10-01T14:11:27.677865Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:27.678348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.678361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.678398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823399:4741], now have 1 active actors on pipe
2025-10-01T14:11:27.678728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:27.678742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:27.678804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1372 reason: error at write: Disconnected sessionId: src_id|3c35051d-471d0285-bd4054ec-54b3a677_0
2025-10-01T14:11:27.679025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:27.679040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1372 sessionId: src_id|3c35051d-471d0285-bd4054ec-54b3a677_0 is DEAD
2025-10-01T14:11:27.679179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35051d-471d0285-bd4054ec-54b3a677_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:27.679190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35051d-471d0285-bd4054ec-54b3a677_0] Write session will restart in 0.005050s
2025-10-01T14:11:27.679229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35051d-471d0285-bd4054ec-54b3a677_0] Write session: Do CDS request
2025-10-01T14:11:27.679235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35051d-471d0285-bd4054ec-54b3a677_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:27.678623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:27.679266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255741682823399:4741]
2025-10-01T14:11:27.685892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35051d-471d0285-bd4054ec-54b3a677_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.685977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:27.685992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1373
2025-10-01T14:11:27.686707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.686748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:27.686758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:27.686762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:27.687153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1373 sessionId:  describe result for acl check
2025-10-01T14:11:27.687186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:27.687188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:27.687189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:27.687194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255741682823422:4010] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:27.687672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255741682823422:4010] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:27.689533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255741682823422:4010] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:27.692368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255741682823422:4010] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:27.692383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255741682823422:4010] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:27.692388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255741682823422:4010] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:27.692396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:27.699422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:27.704271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:27.704504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:27.704519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:27.704531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:27.704603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:27.704650Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255739305943305:9603]
2025-10-01T14:11:27.705146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:27.705475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:27.705535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:27.705861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:27.705931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.705937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.705938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.705939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.705941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.705942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.705943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.705945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.705946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.705947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.705948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.705950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.705951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.705952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.705958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.705967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.705971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.705975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.705980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.705984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.705987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.705991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.705994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.705998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.706001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.706004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.706008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.706011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.706018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.706026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.706032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.706037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.706041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.706047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.706051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.706056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.706061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.706066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.706071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.706081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.706085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.706091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.706100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.706105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.706110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.706119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.706123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.706132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.706137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.706146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.706150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.706155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.706163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.706168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.706176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.706181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.706224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:27.710490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:27.711334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:27.711351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:27.711353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:27.711357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:27.711363Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1372 [2:7556255739305943305:9603]
2025-10-01T14:11:27.711381Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:27.711400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:27.711404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.711408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.711410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.711428Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:27.711438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:27.711442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:27.711497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.711504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.711506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.711509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:27.711512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:27.711578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:27.711585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.711597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.711608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.711627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:27.711648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823410:2446], now have 1 active actors on pipe
2025-10-01T14:11:27.711656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823469:4010], now have 1 active actors on pipe
2025-10-01T14:11:27.711663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255739305943300:9603]
2025-10-01T14:11:27.711669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255739305943300:9603]
2025-10-01T14:11:27.711671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255739305943300:9603]
2025-10-01T14:11:27.711683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:27.711700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:27.711703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:27.711707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:27.711710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:27.711716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:27.711718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:27.711752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255739305943300:9603]
2025-10-01T14:11:27.711761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:27.711766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:27.711860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1372
2025-10-01T14:11:27.711918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.711932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.711959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:27.711971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.711981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.711987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:27.711997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.712012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:27.712032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.712044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1372
2025-10-01T14:11:27.712202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.712210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.712224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.712303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1373 partition: 0 MaxSeqNo: 45 sessionId: src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0
2025-10-01T14:11:27.712638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c35051d-471d0285-bd4054ec-54b3a677_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:27.715100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0] Write session: try to update token
2025-10-01T14:11:27.715120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:27.723433Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:27.723452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:27.723462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255739305943300:9603]
2025-10-01T14:11:27.723507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:27.723514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:27.723671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:27.723808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:27.723979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:27.724108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:27.724288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:27.724332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:27.733611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1373 sessionId: src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:27.736076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:27.736550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.736573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.736613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:27.736705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:27.742688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:27.742706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:27.742709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:27.742710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:27.742721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255739305943300:9603]
2025-10-01T14:11:27.742725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255739305943300:9603]
2025-10-01T14:11:27.742729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255739305943300:9603]
2025-10-01T14:11:27.742779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:27.742783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:27.742789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:27.742793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:27.742793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.742796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:27.742926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:27.779412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255741682823622:4741]
2025-10-01T14:11:27.779657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1372, pipe: [1:7556255741682823622:4741]
2025-10-01T14:11:27.896146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:27.904587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.904616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.904790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.904853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.904917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.904977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.905025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.905036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.905096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.905161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.905221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.905320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.905376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.905383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.905450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.905514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.905576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.905643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.905689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.905698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.905764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.905827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.905892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.905999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.906048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.906055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.906179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.906586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.906704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.906823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.906868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.906882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.906981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.907105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.907204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.907328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.907391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.907399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.907499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.907596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.907715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.907785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.907844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.907851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.907911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.907968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.908032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.908094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.908153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.908160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.908225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.908285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.908345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.908411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.908538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.908545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.908608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:27.908666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:27.908747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:27.908808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:27.908856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:27.908864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:27.908934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823622:4741], now have 1 active actors on pipe
2025-10-01T14:11:27.909155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:27.909184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255741682823622:4741]
2025-10-01T14:11:27.909207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:27.909217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:27.909243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1373 reason: error at write: Disconnected sessionId: src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0
2025-10-01T14:11:27.909441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1373 sessionId: src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0 is DEAD
2025-10-01T14:11:27.909598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:27.909607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0] Write session will restart in 0.008062s
2025-10-01T14:11:27.909626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0] Write session: Do CDS request
2025-10-01T14:11:27.909631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:27.910001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:27.918825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.918894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:27.918911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1374
2025-10-01T14:11:27.919049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:27.919082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:27.919091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:27.919095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:27.919525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1374 sessionId:  describe result for acl check
2025-10-01T14:11:27.919577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:27.919583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:27.919585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:27.919590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255741682823723:4005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:27.920069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255741682823723:4005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:27.922004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255741682823723:4005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:27.922619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:27.924891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:27.925109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:27.925118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:27.925129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:27.925194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:27.925231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255739305943549:9616]
2025-10-01T14:11:27.925286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255741682823723:4005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:27.925302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255741682823723:4005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:27.925305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255741682823723:4005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:27.925315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:27.925841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:27.926112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:27.926170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:27.926433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:27.926479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.926480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.926481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.926481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.926482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.926482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.926483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.926484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.926485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.926485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.926486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.926487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.926488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.926489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.926492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.926498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.926501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.926503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.926505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.926508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.926510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.926512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.926514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.926516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.926519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.926521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.926523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.926525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.926530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.926534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:27.926539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.926542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:27.926545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.926548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:27.926550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.926553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:27.926556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.926558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:27.926561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.926564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:27.926567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.926570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:27.926572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.926575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:27.926579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.926582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:27.926584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.926587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.926589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.926593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.926596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.926598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.926601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.926604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:27.926615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.926618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:27.926639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:27.930401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:27.930988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:27.931002Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:27.931005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:27.931009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:27.931015Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1373 [2:7556255739305943549:9616]
2025-10-01T14:11:27.931029Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:27.931049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:27.931056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.931059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.931062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.931077Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:27.931086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:27.931092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:27.931145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.931152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.931153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.931156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:27.931159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:27.931221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:27.931229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.931240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:27.931252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:27.931272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:27.931293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823827:4005], now have 1 active actors on pipe
2025-10-01T14:11:27.931300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255741682823629:2446], now have 1 active actors on pipe
2025-10-01T14:11:27.931308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255739305943544:9616]
2025-10-01T14:11:27.931310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255739305943544:9616]
2025-10-01T14:11:27.931313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255739305943544:9616]
2025-10-01T14:11:27.931325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:27.931333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1373
2025-10-01T14:11:27.931341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1373
2025-10-01T14:11:27.931337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:27.931341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:27.931346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:27.931348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:27.931356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:27.931360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:27.931389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255739305943544:9616]
2025-10-01T14:11:27.931392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:27.931394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:27.931410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.931419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.931460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:27.931469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:27.931473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:27.931477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:27.931484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:27.931496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:27.931514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.931649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.931658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.931672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:27.931752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1374 partition: 0 MaxSeqNo: 45 sessionId: src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0
2025-10-01T14:11:27.932082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1a10845-2a403413-9eafcead-d29e6fa7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:27.934483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0] Write session: try to update token
2025-10-01T14:11:27.934497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:27.947972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1374 sessionId: src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:27.950397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:27.951370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:27.951393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:27.951414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:27.951417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:27.951419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:27.951421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:27.951429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255739305943544:9616]
2025-10-01T14:11:27.951434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255739305943544:9616]
2025-10-01T14:11:27.951439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255739305943544:9616]
2025-10-01T14:11:27.951469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:27.951479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:27.951484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:27.951498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:27.951510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:27.951517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:27.951646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:28.009256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255745977791135:4741]
2025-10-01T14:11:28.009497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1373, pipe: [1:7556255745977791135:4741]
2025-10-01T14:11:28.105963Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:28.106460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:28.106516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791135:4741], now have 1 active actors on pipe
2025-10-01T14:11:28.106609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:28.106686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:28.106729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255745977791135:4741]
2025-10-01T14:11:28.117017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:28.117030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:28.117051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1374 reason: error at write: Disconnected sessionId: src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0
2025-10-01T14:11:28.117202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1374 sessionId: src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0 is DEAD
2025-10-01T14:11:28.117333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:28.117341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0] Write session will restart in 0.009456s
2025-10-01T14:11:28.117370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0] Write session: Do CDS request
2025-10-01T14:11:28.117377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:28.123893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:28.125930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:28.126070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:28.126078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:28.126085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:28.126114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:28.126144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255743600911054:9619]
2025-10-01T14:11:28.126548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:28.126811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:28.126845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:28.127040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:28.127075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.127079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.127080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.127081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.127082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.127083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.127083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.127084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.127084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.127085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.127086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.127086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.127087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.127087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.127091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.127097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.127099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.127101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.127103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.127105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.127107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.127109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.127111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.127113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.127115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.127117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.127119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.127121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.127127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.127131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.127135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.127138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.127140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.127143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.127146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.127149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.127151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.127154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.127156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.127159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.127162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.127165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.127167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.127170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.127172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.127175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.127177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.127180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.127183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.127186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.127188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.127191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.127193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.127196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.127198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.127201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.127219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:28.127924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.127989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:28.128023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1375
2025-10-01T14:11:28.128132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.128161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:28.128170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:28.128174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:28.128563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1375 sessionId:  describe result for acl check
2025-10-01T14:11:28.128597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:28.128599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:28.128602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:28.128606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255745977791321:3997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:28.129104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255745977791321:3997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:28.130702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:28.131094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255745977791321:3997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:28.131384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:28.131400Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:28.131402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:28.131405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:28.131411Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1374 [2:7556255743600911054:9619]
2025-10-01T14:11:28.131421Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:28.131435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:28.131446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.131448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.131449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.131461Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:28.131465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:28.131469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:28.131507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.131508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.131509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.131512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:28.131513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:28.131571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:28.131577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.131587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.131597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.131615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:28.131636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791149:2446], now have 1 active actors on pipe
2025-10-01T14:11:28.131647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255743600911049:9619]
2025-10-01T14:11:28.131648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255743600911049:9619]
2025-10-01T14:11:28.131649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255743600911049:9619]
2025-10-01T14:11:28.131660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:28.131692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1374
2025-10-01T14:11:28.131674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:28.131676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:28.131679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:28.131681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:28.131695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:28.131698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:28.131724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255743600911049:9619]
2025-10-01T14:11:28.131727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:28.131729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:28.136225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255745977791321:3997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:28.136243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255745977791321:3997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:28.136247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255745977791321:3997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:28.136255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:28.136469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791359:3997], now have 1 active actors on pipe
2025-10-01T14:11:28.136515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1374
2025-10-01T14:11:28.136574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.136587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.136608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:28.136620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.136624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.136630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:28.136641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.136653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:28.136670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.136820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.136830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.136842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.136913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1375 partition: 0 MaxSeqNo: 45 sessionId: src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0
2025-10-01T14:11:28.137263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac553c81-5f9d3216-ef2aac65-e2fceddd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:28.139790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0] Write session: try to update token
2025-10-01T14:11:28.139809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:28.152404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:28.152425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:28.152428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:28.152430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:28.152439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255743600911049:9619]
2025-10-01T14:11:28.152445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255743600911049:9619]
2025-10-01T14:11:28.152449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255743600911049:9619]
2025-10-01T14:11:28.152504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:28.152502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:28.152509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:28.152514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:28.152517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.152520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:28.152673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:28.154348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1375 sessionId: src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:28.156738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:28.206896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255745977791363:4741]
2025-10-01T14:11:28.207177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1374, pipe: [1:7556255745977791363:4741]
2025-10-01T14:11:28.304847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:28.305482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.305499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.305545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791363:4741], now have 1 active actors on pipe
2025-10-01T14:11:28.305744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:28.305819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:28.305828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255745977791363:4741]
2025-10-01T14:11:28.305850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:28.305922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1375 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0
2025-10-01T14:11:28.306183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1375 sessionId: src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0 is DEAD
2025-10-01T14:11:28.306335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:28.306346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0] Write session will restart in 0.008821s
2025-10-01T14:11:28.306390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0] Write session: Do CDS request
2025-10-01T14:11:28.306397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:28.317554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.317854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:28.317874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1376
2025-10-01T14:11:28.317993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.318033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:28.318044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:28.318047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:28.318516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1376 sessionId:  describe result for acl check
2025-10-01T14:11:28.318554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:28.318561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:28.318562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:28.318568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255745977791441:3991] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:28.319179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255745977791441:3991] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:28.321909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255745977791441:3991] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:28.323383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:28.325626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:28.325796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255745977791441:3991] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:28.325812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255745977791441:3991] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:28.325815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255745977791441:3991] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:28.325823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:28.325846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:28.325868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:28.325879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:28.325925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:28.325964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255743600911260:9621]
2025-10-01T14:11:28.326603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:28.326952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:28.327008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:28.327357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:28.327416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.327422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.327423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.327424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.327425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.327427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.327428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.327429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.327430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.327431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.327433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.327433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.327434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.327436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.327441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.327450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.327454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.327458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.327461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.327465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.327468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.327472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.327476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.327480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.327484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.327487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.327491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.327494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.327502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.327509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.327515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.327520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.327524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.327530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.327534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.327539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.327544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.327549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.327553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.327558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.327567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.327573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.327581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.327586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.327591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.327600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.327604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.327609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.327613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.327622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.327626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.327636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.327641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.327649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.327653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.327658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.327701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:28.331550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:28.332191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:28.332205Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:28.332208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:28.332212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:28.332218Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1375 [2:7556255743600911260:9621]
2025-10-01T14:11:28.332232Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:28.332249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:28.332257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.332260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.332263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.332278Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:28.332284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:28.332293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:28.332351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.332358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.332360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.332363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:28.332365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:28.332431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:28.332437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.332448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.332463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.332483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:28.332503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791365:2446], now have 1 active actors on pipe
2025-10-01T14:11:28.332512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791568:3991], now have 1 active actors on pipe
2025-10-01T14:11:28.332519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255743600911255:9621]
2025-10-01T14:11:28.332522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255743600911255:9621]
2025-10-01T14:11:28.332524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255743600911255:9621]
2025-10-01T14:11:28.332539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:28.332553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:28.332557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:28.332560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:28.332562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:28.332569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:28.332573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:28.332555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1375
2025-10-01T14:11:28.332558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1375
2025-10-01T14:11:28.332610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255743600911255:9621]
2025-10-01T14:11:28.332623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:28.332639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:28.332743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.332753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.332801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25597863-340127b0-3f961c58-eef6bf96_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:28.332811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.332815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.332818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:28.332828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.332837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:28.332852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.333031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.333040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.333054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.333129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1376 partition: 0 MaxSeqNo: 45 sessionId: src_id|25597863-340127b0-3f961c58-eef6bf96_0
2025-10-01T14:11:28.333551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f62f6476-655dc1e8-96864bb8-d9db30d3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|25597863-340127b0-3f961c58-eef6bf96_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:28.336085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25597863-340127b0-3f961c58-eef6bf96_0] Write session: try to update token
2025-10-01T14:11:28.336104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25597863-340127b0-3f961c58-eef6bf96_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:28.352858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:28.352877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:28.352880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:28.352882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:28.352892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255743600911255:9621]
2025-10-01T14:11:28.352898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255743600911255:9621]
2025-10-01T14:11:28.352902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255743600911255:9621]
2025-10-01T14:11:28.352949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:28.352955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:28.352960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:28.352963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.352964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:28.352965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:28.353089Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:28.353480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1376 sessionId: src_id|25597863-340127b0-3f961c58-eef6bf96_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:28.355810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:28.406192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255745977791587:4741]
2025-10-01T14:11:28.406433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1375, pipe: [1:7556255745977791587:4741]
2025-10-01T14:11:28.499518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:28.500086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.500103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.500142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791587:4741], now have 1 active actors on pipe
2025-10-01T14:11:28.500334Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:28.500383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:28.500423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:28.500428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255745977791587:4741]
2025-10-01T14:11:28.500480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1376 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25597863-340127b0-3f961c58-eef6bf96_0
2025-10-01T14:11:28.500691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1376 sessionId: src_id|25597863-340127b0-3f961c58-eef6bf96_0 is DEAD
2025-10-01T14:11:28.500822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25597863-340127b0-3f961c58-eef6bf96_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:28.500829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25597863-340127b0-3f961c58-eef6bf96_0] Write session will restart in 0.007950s
2025-10-01T14:11:28.500853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25597863-340127b0-3f961c58-eef6bf96_0] Write session: Do CDS request
2025-10-01T14:11:28.500858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25597863-340127b0-3f961c58-eef6bf96_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:28.509990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25597863-340127b0-3f961c58-eef6bf96_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.510007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:28.510023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1377
2025-10-01T14:11:28.510197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.510228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:28.510237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:28.510241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:28.510663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1377 sessionId:  describe result for acl check
2025-10-01T14:11:28.510702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:28.510704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:28.510705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:28.510710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255745977791748:3984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:28.511198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255745977791748:3984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:28.512141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:28.513187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255745977791748:3984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:28.514603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:28.514845Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:28.514857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:28.514871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:28.514935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:28.514975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255743600911469:9623]
2025-10-01T14:11:28.515546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:28.515765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255745977791748:3984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:28.515779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255745977791748:3984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:28.515783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255745977791748:3984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:28.515792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:28.515790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:28.515838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:28.516149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:28.516220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.516227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.516228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.516229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.516230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.516231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.516232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.516233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.516234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.516235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.516237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.516238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.516239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.516240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.516245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.516254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.516257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.516261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.516264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.516268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.516271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.516275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.516278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.516283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.516287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.516290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.516293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.516297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.516304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.516316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.516326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.516334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.516342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.516346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.516356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.516361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.516366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.516370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.516375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.516379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.516384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.516389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.516393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.516397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.516400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.516404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.516409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.516418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.516422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.516431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.516434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.516439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.516443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.516453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.516457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.516461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.516500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:28.520101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:28.520784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:28.520796Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:28.520798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:28.520802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:28.520808Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1376 [2:7556255743600911469:9623]
2025-10-01T14:11:28.520826Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:28.520842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:28.520850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.520853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.520855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.520872Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:28.520880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:28.520886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:28.520948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.520954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.520956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.520959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:28.520961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:28.521023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:28.521031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.521042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.521053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.521073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:28.521091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791592:2446], now have 1 active actors on pipe
2025-10-01T14:11:28.521096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791798:3984], now have 1 active actors on pipe
2025-10-01T14:11:28.521102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255743600911463:9623]
2025-10-01T14:11:28.521103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255743600911463:9623]
2025-10-01T14:11:28.521104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255743600911463:9623]
2025-10-01T14:11:28.521113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:28.521125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:28.521128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:28.521132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:28.521134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:28.521135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:28.521138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:28.521161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255743600911463:9623]
2025-10-01T14:11:28.521168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:28.521174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:28.521195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1376
2025-10-01T14:11:28.521215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.521224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.521246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:28.521248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1376
2025-10-01T14:11:28.521252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.521256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.521259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:28.521268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.521280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:28.521303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.521421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.521434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.521454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.521549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1377 partition: 0 MaxSeqNo: 45 sessionId: src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0
2025-10-01T14:11:28.521886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25597863-340127b0-3f961c58-eef6bf96_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:28.524266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0] Write session: try to update token
2025-10-01T14:11:28.524280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:28.537944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:28.537965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:28.537977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255743600911463:9623]
2025-10-01T14:11:28.538027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:28.538037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:28.538298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:28.538546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:28.538701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:28.538859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:28.539092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:28.539140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:28.544649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1377 sessionId: src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:28.547137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:28.547343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.547364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.547411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:28.547497Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:28.552088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:28.552108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:28.552111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:28.552113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:28.552126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255743600911463:9623]
2025-10-01T14:11:28.552131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255743600911463:9623]
2025-10-01T14:11:28.552135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255743600911463:9623]
2025-10-01T14:11:28.552184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:28.552184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:28.552191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:28.552194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:28.552198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.552200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:28.552399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:28.600631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255745977791821:4741]
2025-10-01T14:11:28.601048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1376, pipe: [1:7556255745977791821:4741]
2025-10-01T14:11:28.696521Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:28.703914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.703939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.704094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.704165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.704239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.704308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.704350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.704359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.704422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.704479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.704543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.704604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.704646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.704654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.704724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.704800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.704866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.704926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.704968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.704976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.705040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.705097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.705182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.705236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.705283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.705291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.705377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.705474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.705538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.705591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.705629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.705635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.705694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.705753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.705829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.705973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.706069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.706075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.706179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.706276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.706339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.706416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.706520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.706528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.706599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.706729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.706856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.706925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.706984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.706992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.707060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.707125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.707191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.707249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.707330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.707336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.707395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:28.707461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:28.707535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:28.707605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:28.707709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:28.707715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:28.707770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791821:4741], now have 1 active actors on pipe
2025-10-01T14:11:28.708005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:28.708034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255745977791821:4741]
2025-10-01T14:11:28.708055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:28.708058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:28.708083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1377 reason: error at write: Disconnected sessionId: src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0
2025-10-01T14:11:28.708286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1377 sessionId: src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0 is DEAD
2025-10-01T14:11:28.708457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:28.708469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0] Write session will restart in 0.007770s
2025-10-01T14:11:28.708495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0] Write session: Do CDS request
2025-10-01T14:11:28.708500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:28.708793Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:28.717956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.718000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:28.718017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1378
2025-10-01T14:11:28.718174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.718208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:28.718218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:28.718222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:28.718598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1378 sessionId:  describe result for acl check
2025-10-01T14:11:28.718630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:28.718636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:28.718638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:28.718643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255745977791981:3969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:28.719112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255745977791981:3969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:28.720470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:28.721432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255745977791981:3969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:28.722787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:28.722990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:28.723003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:28.723015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:28.723066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:28.723102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255743600911684:9628]
2025-10-01T14:11:28.723668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:28.723961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:28.724003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:28.724227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255745977791981:3969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:28.724241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255745977791981:3969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:28.724244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255745977791981:3969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:28.724252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:28.724301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:28.724355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.724361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.724362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.724364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.724365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.724366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.724367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.724368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.724370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.724371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.724372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.724373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.724374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.724375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.724379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.724388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.724391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.724395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.724398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.724402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.724406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.724409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.724412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.724416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.724419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.724422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.724425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.724428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.724434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.724442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.724448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.724453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.724457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.724461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.724466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.724470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.724475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.724479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.724483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.724487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.724493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.724498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.724502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.724506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.724510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.724518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.724521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.724526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.724530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.724535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.724544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.724549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.724553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.724560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.724564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.724572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.724608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:28.728375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:28.729063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:28.729077Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:28.729080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:28.729084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:28.729090Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1377 [2:7556255743600911684:9628]
2025-10-01T14:11:28.729104Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:28.729121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:28.729128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.729132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.729134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.729150Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:28.729155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:28.729162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:28.729221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.729228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.729230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.729233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:28.729236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:28.729299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:28.729307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.729317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.729327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.729340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:28.729363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977791833:2446], now have 1 active actors on pipe
2025-10-01T14:11:28.729369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977792040:3969], now have 1 active actors on pipe
2025-10-01T14:11:28.729376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255743600911679:9628]
2025-10-01T14:11:28.729378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255743600911679:9628]
2025-10-01T14:11:28.729380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255743600911679:9628]
2025-10-01T14:11:28.729394Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:28.729406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:28.729411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:28.729416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:28.729418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:28.729423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:28.729426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:28.729451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255743600911679:9628]
2025-10-01T14:11:28.729458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:28.729460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:28.729486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.729491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.729525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:28.729532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.729535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.729538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:28.729546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.729554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:28.729570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.729759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.729773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.729795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.730242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd4d0459-7417e5fb-855ccfb9-1dfc100e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:28.729429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1377
2025-10-01T14:11:28.729436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1377
2025-10-01T14:11:28.729867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1378 partition: 0 MaxSeqNo: 45 sessionId: src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0
2025-10-01T14:11:28.732977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0] Write session: try to update token
2025-10-01T14:11:28.732995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:28.749132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1378 sessionId: src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:28.749781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:28.749800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:28.749801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:28.749803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:28.749810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255743600911679:9628]
2025-10-01T14:11:28.749813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255743600911679:9628]
2025-10-01T14:11:28.749816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255743600911679:9628]
2025-10-01T14:11:28.749861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:28.749870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.749878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:28.749946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:28.749957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:28.749959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:28.750026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:28.751496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:28.808003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255745977792051:4741]
2025-10-01T14:11:28.808253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1377, pipe: [1:7556255745977792051:4741]
2025-10-01T14:11:28.887475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:28.888034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.888047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.888079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977792051:4741], now have 1 active actors on pipe
2025-10-01T14:11:28.888319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:28.888326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:28.888339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:28.888390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1378 reason: error at write: Disconnected sessionId: src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0
2025-10-01T14:11:28.888479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255745977792051:4741]
2025-10-01T14:11:28.888509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:28.888541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1378 sessionId: src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0 is DEAD
2025-10-01T14:11:28.888672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:28.888693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0] Write session will restart in 0.009575s
2025-10-01T14:11:28.888714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0] Write session: Do CDS request
2025-10-01T14:11:28.888719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:28.899886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.899857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:28.899997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:28.900010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1379
2025-10-01T14:11:28.900099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:28.900128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:28.900137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:28.900140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:28.900483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1379 sessionId:  describe result for acl check
2025-10-01T14:11:28.900516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:28.900524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:28.900525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:28.900531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255745977792228:3964] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:28.900991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255745977792228:3964] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:28.902157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:28.902311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:28.902320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:28.902331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:28.902366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:28.902407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255743600911934:9640]
2025-10-01T14:11:28.902666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255745977792228:3964] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:28.902778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:28.902993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:28.903022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:28.903223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:28.903260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.903265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.903266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.903267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.903267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.903268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.903269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.903270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.903270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.903271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.903272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.903272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.903273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.903274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.903277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.903282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.903284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.903286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.903288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.903290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.903292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.903294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.903297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.903299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.903301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.903303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.903305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.903307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.903313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.903317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:28.903321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.903324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:28.903327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.903329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:28.903332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.903335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:28.903339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.903344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:28.903348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.903353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:28.903356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.903361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:28.903366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.903371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:28.903373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.903376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:28.903379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.903382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.903384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.903387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.903389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.903392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.903395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.903398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:28.903400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.903402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:28.903422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:28.906631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255745977792228:3964] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:28.906643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255745977792228:3964] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:28.906645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255745977792228:3964] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:28.906651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:28.906798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:28.907397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:28.907411Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:28.907412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:28.907415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:28.907420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1378 [2:7556255743600911934:9640]
2025-10-01T14:11:28.907431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:28.907445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:28.907446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.907449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.907450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.907461Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:28.907465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:28.907469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:28.907510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.907516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.907517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.907520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:28.907522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:28.907583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:28.907590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.907599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:28.907621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:28.907640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:28.907661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977792056:2446], now have 1 active actors on pipe
2025-10-01T14:11:28.907663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977792263:3964], now have 1 active actors on pipe
2025-10-01T14:11:28.907668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255743600911928:9640]
2025-10-01T14:11:28.907674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255743600911928:9640]
2025-10-01T14:11:28.907676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255743600911928:9640]
2025-10-01T14:11:28.907685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:28.907699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:28.907699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:28.907701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:28.907703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:28.907717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:28.907719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:28.907716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1378
2025-10-01T14:11:28.907733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1378
2025-10-01T14:11:28.907744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255743600911928:9640]
2025-10-01T14:11:28.907750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:28.907752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:28.907764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.907771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.907814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:28.907826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:28.907830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:28.907832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:28.907841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:28.907853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:28.907873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.908011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.908019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.908034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:28.908107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1379 partition: 0 MaxSeqNo: 45 sessionId: src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0
2025-10-01T14:11:28.908416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f13bde0b-a3b2471a-332d406c-5688ce36_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:28.910641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0] Write session: try to update token
2025-10-01T14:11:28.910655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:28.924358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1379 sessionId: src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:28.926822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:28.927336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:28.927360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:28.927382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:28.927385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:28.927387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:28.927389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:28.927399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255743600911928:9640]
2025-10-01T14:11:28.927404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255743600911928:9640]
2025-10-01T14:11:28.927407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255743600911928:9640]
2025-10-01T14:11:28.927442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:28.927453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:28.927456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:28.927463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:28.927469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:28.927471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:28.927675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:28.988714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255745977792270:4741]
2025-10-01T14:11:28.988979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1378, pipe: [1:7556255745977792270:4741]
2025-10-01T14:11:29.061913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:29.062536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:29.062589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255745977792270:4741], now have 1 active actors on pipe
2025-10-01T14:11:29.062690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:29.062737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:29.062773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:29.062778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:29.062790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255745977792270:4741]
2025-10-01T14:11:29.062831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1379 reason: error at write: Disconnected sessionId: src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0
2025-10-01T14:11:29.062966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1379 sessionId: src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0 is DEAD
2025-10-01T14:11:29.063120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:29.063129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0] Write session will restart in 0.006117s
2025-10-01T14:11:29.063146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0] Write session: Do CDS request
2025-10-01T14:11:29.063153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:29.070771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.070905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:29.070919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1380
2025-10-01T14:11:29.071038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.071070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:29.071076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:29.071079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:29.071447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1380 sessionId:  describe result for acl check
2025-10-01T14:11:29.071483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:29.071485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:29.071486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:29.071491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255750272759649:3959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:29.071925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255750272759649:3959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:29.074276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255750272759649:3959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:29.075440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:29.077422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:29.077515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255750272759649:3959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:29.077535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255750272759649:3959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:29.077537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255750272759649:3959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:29.077542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:29.077582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:29.077591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:29.077599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:29.077641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:29.077677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255747895879442:9644]
2025-10-01T14:11:29.078045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:29.078236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:29.078265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:29.078494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:29.078553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.078559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.078560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.078561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.078561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.078563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.078564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.078565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.078566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.078567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.078568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.078569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.078570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.078571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.078578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.078585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.078588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.078591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.078594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.078597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.078600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.078603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.078606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.078609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.078617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.078620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.078628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.078631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.078638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.078649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.078659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.078664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.078671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.078675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.078679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.078683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.078687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.078695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.078699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.078703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.078707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.078714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.078718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.078722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.078730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.078734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.078742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.078747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.078751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.078758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.078763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.078772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.078776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.078784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.078788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.078791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.078811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:29.082099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:29.082723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:29.082737Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:29.082739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:29.082743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:29.082749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1379 [2:7556255747895879442:9644]
2025-10-01T14:11:29.082764Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:29.082783Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:29.082790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.082793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.082795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.082811Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:29.082821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:29.082829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:29.082883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.082890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.082893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.082895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:29.082898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:29.082966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:29.082977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.082988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.082998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.083013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:29.083037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272759569:2446], now have 1 active actors on pipe
2025-10-01T14:11:29.083045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272759776:3959], now have 1 active actors on pipe
2025-10-01T14:11:29.083052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255747895879437:9644]
2025-10-01T14:11:29.083058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255747895879437:9644]
2025-10-01T14:11:29.083061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255747895879437:9644]
2025-10-01T14:11:29.083074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:29.083067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1379
2025-10-01T14:11:29.083086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:29.083075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1379
2025-10-01T14:11:29.083088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:29.083089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:29.083093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:29.083106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:29.083109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:29.083144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.083153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.083170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255747895879437:9644]
2025-10-01T14:11:29.083182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:29.083189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:29.083207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:29.083217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.083225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.083229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:29.083238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.083251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:29.083280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.083389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.083394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.083406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.083470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1380 partition: 0 MaxSeqNo: 45 sessionId: src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0
2025-10-01T14:11:29.083760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab04f7c2-5506a9e4-4c5b92da-b029fa06_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:29.085895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0] Write session: try to update token
2025-10-01T14:11:29.085907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:29.098832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1380 sessionId: src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:29.100999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:29.102845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.102871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.102891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:29.102895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:29.102897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:29.102899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:29.102908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255747895879437:9644]
2025-10-01T14:11:29.102912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255747895879437:9644]
2025-10-01T14:11:29.102917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255747895879437:9644]
2025-10-01T14:11:29.102951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:29.102961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:29.102963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:29.102970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:29.102976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.102978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:29.103110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:29.162820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255750272759799:4741]
2025-10-01T14:11:29.163069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1379, pipe: [1:7556255750272759799:4741]
2025-10-01T14:11:29.237411Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:29.237898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:29.237944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272759799:4741], now have 1 active actors on pipe
2025-10-01T14:11:29.238042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:29.238146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:29.238199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255750272759799:4741]
2025-10-01T14:11:29.247484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:29.247501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:29.247524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1380 reason: error at write: Disconnected sessionId: src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0
2025-10-01T14:11:29.247656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1380 sessionId: src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0 is DEAD
2025-10-01T14:11:29.247763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:29.247772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0] Write session will restart in 0.006968s
2025-10-01T14:11:29.247789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0] Write session: Do CDS request
2025-10-01T14:11:29.247796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:29.255354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:29.255870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.255953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:29.255966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1381
2025-10-01T14:11:29.256081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.256106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:29.256113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:29.256115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:29.256421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1381 sessionId:  describe result for acl check
2025-10-01T14:11:29.256450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:29.256454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:29.256456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:29.256460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255750272759976:3952] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:29.256846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255750272759976:3952] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:29.257781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:29.257958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:29.257968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:29.257988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:29.258036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:29.258075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255747895879653:9646]
2025-10-01T14:11:29.258671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:29.258987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:29.259043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:29.259153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255750272759976:3952] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:29.259356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:29.259415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.259420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.259421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.259422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.259423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.259424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.259425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.259427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.259427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.259428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.259429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.259430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.259431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.259433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.259438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.259446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.259449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.259452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.259455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.259460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.259463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.259466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.259469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.259473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.259476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.259480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.259484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.259487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.259493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.259500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.259505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.259509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.259513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.259518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.259521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.259525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.259530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.259536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.259539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.259543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.259547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.259552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.259558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.259562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.259567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.259571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.259575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.259579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.259584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.259588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.259595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.259599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.259602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.259607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.259611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.259620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.259653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:29.263112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255750272759976:3952] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:29.263127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255750272759976:3952] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:29.263130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255750272759976:3952] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:29.263138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:29.263369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:29.264271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:29.264284Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:29.264286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:29.264290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:29.264295Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1380 [2:7556255747895879653:9646]
2025-10-01T14:11:29.264309Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:29.264325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:29.264330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.264333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.264336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.264351Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:29.264360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:29.264366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:29.264406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.264411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.264413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.264415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:29.264416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:29.264466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:29.264473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.264485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.264501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.264521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:29.264541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760013:3952], now have 1 active actors on pipe
2025-10-01T14:11:29.264547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272759801:2446], now have 1 active actors on pipe
2025-10-01T14:11:29.264553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255747895879648:9646]
2025-10-01T14:11:29.264556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255747895879648:9646]
2025-10-01T14:11:29.264558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255747895879648:9646]
2025-10-01T14:11:29.264569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:29.264584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:29.264583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:29.264586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:29.264587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:29.264600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:29.264603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:29.264634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255747895879648:9646]
2025-10-01T14:11:29.264602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1380
2025-10-01T14:11:29.264640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:29.264642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:29.264609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1380
2025-10-01T14:11:29.264668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.264674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.264715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:29.264728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.264733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.264735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:29.264742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.264751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:29.264774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.264888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.264895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.264908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.264977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1381 partition: 0 MaxSeqNo: 45 sessionId: src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0
2025-10-01T14:11:29.265319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3766186f-75dbd0d5-b383b22b-c5e9b183_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:29.267724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0] Write session: try to update token
2025-10-01T14:11:29.267740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:29.280167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1381 sessionId: src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:29.282213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:29.282386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.282405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.282435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:29.282508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:29.284484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:29.284500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:29.284502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:29.284503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:29.284510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255747895879648:9646]
2025-10-01T14:11:29.284513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255747895879648:9646]
2025-10-01T14:11:29.284516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255747895879648:9646]
2025-10-01T14:11:29.284551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:29.284556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.284558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:29.284559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:29.284565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:29.284568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:29.284674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:29.338424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255750272760023:4741]
2025-10-01T14:11:29.338686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1380, pipe: [1:7556255750272760023:4741]
2025-10-01T14:11:29.423614Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:29.430794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.430819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.430967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.431021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.431075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.431129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.431176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.431184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.431257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.431315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.431370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.431436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.431476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.431482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.431539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.431592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.431647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.431696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.431741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.431749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.431811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.431865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.431924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.431989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.432097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.432107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.432166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.432216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.432277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.432337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.432379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.432385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.432442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.432488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.432543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.432603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.432648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.432657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.432726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.432783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.432846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.432904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.432945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.432952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.433010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.433062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.433124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.433188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.433251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.433256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.433311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.433363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.433420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.433482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.433522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.433529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.433591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.433653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.433714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.433770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.433811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.433817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.433865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760023:4741], now have 1 active actors on pipe
2025-10-01T14:11:29.434183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:29.434198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:29.434198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:29.434225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1381 reason: error at write: Disconnected sessionId: src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0
2025-10-01T14:11:29.434247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255750272760023:4741]
2025-10-01T14:11:29.434467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1381 sessionId: src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0 is DEAD
2025-10-01T14:11:29.434570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:29.434576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0] Write session will restart in 0.005920s
2025-10-01T14:11:29.434594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0] Write session: Do CDS request
2025-10-01T14:11:29.434599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:29.434692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:29.441762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.441847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:29.441858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1382
2025-10-01T14:11:29.441940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.441962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:29.441969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:29.441971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:29.442298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1382 sessionId:  describe result for acl check
2025-10-01T14:11:29.442321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:29.442325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:29.442326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:29.442330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255750272760099:3945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:29.442712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255750272760099:3945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:29.445239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255750272760099:3945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:29.447133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:29.449000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:29.448996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255750272760099:3945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:29.449009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255750272760099:3945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:29.449012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255750272760099:3945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:29.449020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:29.449241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:29.449253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:29.449265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:29.449319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:29.449359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255747895879866:9648]
2025-10-01T14:11:29.449855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:29.450127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:29.450169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:29.450446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:29.450489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.450494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.450495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.450495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.450496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.450497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.450497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.450498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.450498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.450499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.450500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.450500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.450501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.450501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.450505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.450510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.450512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.450514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.450516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.450518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.450520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.450522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.450524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.450527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.450528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.450530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.450533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.450534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.450541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.450545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.450549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.450552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.450554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.450557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.450562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.450567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.450571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.450576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.450579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.450583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.450587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.450592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.450596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.450600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.450604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.450608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.450612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.450617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.450621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.450625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.450629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.450633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.450637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.450642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.450646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.450651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.450685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:29.453979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:29.454757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:29.454770Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:29.454773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:29.454776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:29.454783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1381 [2:7556255747895879866:9648]
2025-10-01T14:11:29.454797Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:29.454811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:29.454819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.454822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.454824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.454838Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:29.454847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:29.454852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:29.454903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.454908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.454909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.454911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:29.454913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:29.454958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:29.454963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.454973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.454987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.455005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:29.455026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760243:3945], now have 1 active actors on pipe
2025-10-01T14:11:29.455039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255747895879860:9648]
2025-10-01T14:11:29.455042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255747895879860:9648]
2025-10-01T14:11:29.455044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255747895879860:9648]
2025-10-01T14:11:29.455056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:29.455065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760031:2446], now have 1 active actors on pipe
2025-10-01T14:11:29.455071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:29.455072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:29.455074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:29.455076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:29.455085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:29.455087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:29.455108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255747895879860:9648]
2025-10-01T14:11:29.455120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:29.455101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1381
2025-10-01T14:11:29.455126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:29.455106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1381
2025-10-01T14:11:29.455155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.455164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.455187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:29.455197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.455201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.455203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:29.455211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.455220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:29.455234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.455339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.455344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.455354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.455443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1382 partition: 0 MaxSeqNo: 45 sessionId: src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0
2025-10-01T14:11:29.455752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2c4f297d-ba5b19f2-a0a0c51f-6296cd3b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:29.458112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0] Write session: try to update token
2025-10-01T14:11:29.458125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:29.469946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:29.469969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:29.469978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255747895879860:9648]
2025-10-01T14:11:29.470024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:29.470034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:29.470198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:29.470367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:29.470394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1382 sessionId: src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:29.470588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:29.470724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:29.470903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:29.470944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:29.472649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:29.472868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.472884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.472911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:29.472985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:29.485134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:29.485151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:29.485153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:29.485154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:29.485163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255747895879860:9648]
2025-10-01T14:11:29.485166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255747895879860:9648]
2025-10-01T14:11:29.485168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255747895879860:9648]
2025-10-01T14:11:29.485214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:29.485214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:29.485220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:29.485223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:29.485225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.485227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:29.485356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:29.534490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255750272760255:4741]
2025-10-01T14:11:29.534718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1381, pipe: [1:7556255750272760255:4741]
2025-10-01T14:11:29.616419Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:29.622984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.623010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.623170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.623231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.623288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.623349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.623402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.623411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.623474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.623533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.623593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.623654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.623696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.623704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.623763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.623818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.623879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.623938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.623983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.623989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.624082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.624132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.624178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.624226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.624262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.624267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.624318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.624364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.624415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.624465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.624514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.624522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.624575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.624622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.624674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.624733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.624772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.624777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.624842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.624892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.624944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.624993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.625064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.625069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.625122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.625174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.625227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.625279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.625331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.625336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.625393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.625445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.625542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.625642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.625684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.625689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.625740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.625790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.625838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.625889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.625942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.625947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.625986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760255:4741], now have 1 active actors on pipe
2025-10-01T14:11:29.626216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255750272760255:4741]
2025-10-01T14:11:29.626249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:29.626251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:29.626273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1382 reason: error at write: Disconnected sessionId: src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0
2025-10-01T14:11:29.626459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1382 sessionId: src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0 is DEAD
2025-10-01T14:11:29.626599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:29.626595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:29.626607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0] Write session will restart in 0.007617s
2025-10-01T14:11:29.626625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0] Write session: Do CDS request
2025-10-01T14:11:29.626630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:29.626747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:29.635858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.635906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:29.635917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1383
2025-10-01T14:11:29.636028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.636049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:29.636053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:29.636055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:29.636295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1383 sessionId:  describe result for acl check
2025-10-01T14:11:29.636317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:29.636323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:29.636324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:29.636328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255750272760443:3929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:29.636671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255750272760443:3929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:29.636767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:29.638474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255750272760443:3929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:29.638557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:29.638741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:29.638751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:29.638759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:29.638793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:29.638826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255747895880082:9651]
2025-10-01T14:11:29.639201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:29.639379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:29.639405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:29.639624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:29.639660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.639664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.639665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.639666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.639667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.639667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.639668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.639669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.639669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.639670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.639670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.639671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.639672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.639672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.639675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.639681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.639683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.639685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.639687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.639689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.639691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.639693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.639695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.639697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.639699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.639701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.639703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.639705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.639709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.639713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.639718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.639720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.639723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.639726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.639728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.639731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.639733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.639736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.639738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.639741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.639747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.639749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.639752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.639758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.639760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.639763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.639766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.639770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.639772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.639775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.639781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.639784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.639786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.639789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.639791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.639793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.639815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:29.642908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255750272760443:3929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:29.642922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255750272760443:3929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:29.642925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255750272760443:3929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:29.642931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:29.643171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:29.644217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:29.644233Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:29.644235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:29.644238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:29.644244Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1382 [2:7556255747895880082:9651]
2025-10-01T14:11:29.644258Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:29.644278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:29.644285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.644288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.644290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.644305Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:29.644315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:29.644325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:29.644384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.644391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.644393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.644396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:29.644398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:29.644459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:29.644468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.644479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.644489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.644505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:29.644531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1382
2025-10-01T14:11:29.644544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760270:2446], now have 1 active actors on pipe
2025-10-01T14:11:29.644535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1382
2025-10-01T14:11:29.644551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760492:3929], now have 1 active actors on pipe
2025-10-01T14:11:29.644558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255747895880077:9651]
2025-10-01T14:11:29.644561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255747895880077:9651]
2025-10-01T14:11:29.644562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255747895880077:9651]
2025-10-01T14:11:29.644574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:29.644575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:29.644577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:29.644578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:29.644588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:29.644607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:29.644613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:29.644633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.644640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.644675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255747895880077:9651]
2025-10-01T14:11:29.644696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:29.644702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:29.644712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:29.644720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.644724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.644726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:29.644736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.644749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:29.644788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.644912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.644923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.644940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.644998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1383 partition: 0 MaxSeqNo: 45 sessionId: src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0
2025-10-01T14:11:29.645296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff214d7f-23cd6c80-3b835b6a-7a3e1e59_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:29.647803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0] Write session: try to update token
2025-10-01T14:11:29.647818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:29.654912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:29.654933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:29.654941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255747895880077:9651]
2025-10-01T14:11:29.654986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:29.654991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:29.655175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:29.655321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:29.655472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:29.656014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:29.656192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:29.656229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:29.660500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1383 sessionId: src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:29.662949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:29.663150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.663168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.663203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:29.663283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:29.672165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:29.672179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:29.672181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:29.672182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:29.672189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255747895880077:9651]
2025-10-01T14:11:29.672192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255747895880077:9651]
2025-10-01T14:11:29.672194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255747895880077:9651]
2025-10-01T14:11:29.672226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:29.672230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.672230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:29.672232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:29.672235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:29.672238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:29.672338Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:29.726493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255750272760500:4741]
2025-10-01T14:11:29.726771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1382, pipe: [1:7556255750272760500:4741]
2025-10-01T14:11:29.801439Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:29.807557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.807577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.807706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.807754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.807805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.807854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.807897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.807904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.807964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.808015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.808060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.808108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.808144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.808150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.808205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.808255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.808359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.808413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.808455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.808466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.808524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.808615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.808665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.808724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.808764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.808769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.808821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.808868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.808916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.808977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.809013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.809019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.809072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.809120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.809169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.809218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.809259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.809265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.809366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.809413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.809533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.809585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.809624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.809631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.809688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.809738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.809790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.809837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.809942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.809947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.810001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.810049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.810096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.810143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.810177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.810181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.810232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.810280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.810331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.810396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.810504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.810511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.810546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760500:4741], now have 1 active actors on pipe
2025-10-01T14:11:29.810773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:29.810794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255750272760500:4741]
2025-10-01T14:11:29.810817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:29.810827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:29.810853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1383 reason: error at write: Disconnected sessionId: src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0
2025-10-01T14:11:29.811075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1383 sessionId: src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0 is DEAD
2025-10-01T14:11:29.811197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:29.811180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:29.811207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0] Write session will restart in 0.007388s
2025-10-01T14:11:29.811244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0] Write session: Do CDS request
2025-10-01T14:11:29.811251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:29.819886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.820006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:29.820023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1384
2025-10-01T14:11:29.820128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:29.820163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:29.820173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:29.820176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:29.820535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1384 sessionId:  describe result for acl check
2025-10-01T14:11:29.820566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:29.820571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:29.820572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:29.820576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255750272760621:3927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:29.821009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255750272760621:3927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:29.822940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:29.823503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255750272760621:3927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:29.824841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:29.825011Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:29.825019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:29.825027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:29.825059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:29.825086Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255747895880303:9655]
2025-10-01T14:11:29.825489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:29.825672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:29.825710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:29.825716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255750272760621:3927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:29.825726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255750272760621:3927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:29.825728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255750272760621:3927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:29.825734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:29.825968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:29.826024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.826030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.826031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.826031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.826032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.826033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.826033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.826034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.826034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.826035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.826036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.826037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.826037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.826038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.826041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.826046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.826048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.826050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.826052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.826053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.826055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.826057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.826059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.826061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.826062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.826064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.826066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.826068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.826072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.826077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:29.826081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.826084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:29.826086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.826089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:29.826091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.826093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:29.826095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.826098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:29.826100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.826102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:29.826104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.826107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:29.826109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.826111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:29.826113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.826116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:29.826119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.826122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.826124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.826126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.826128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.826130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.826133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.826136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:29.826140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.826142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:29.826161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:29.829393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:29.829924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:29.829937Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:29.829939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:29.829942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:29.829946Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1383 [2:7556255747895880303:9655]
2025-10-01T14:11:29.829956Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:29.829967Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:29.829970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.829972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.829973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.829984Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:29.829990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:29.829994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:29.830029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.830034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.830035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.830039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:29.830041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:29.830084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:29.830088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.830095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:29.830100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:29.830113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:29.830125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760716:3927], now have 1 active actors on pipe
2025-10-01T14:11:29.830131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760504:2446], now have 1 active actors on pipe
2025-10-01T14:11:29.830135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255747895880298:9655]
2025-10-01T14:11:29.830136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255747895880298:9655]
2025-10-01T14:11:29.830138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255747895880298:9655]
2025-10-01T14:11:29.830148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:29.830163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:29.830164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:29.830166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:29.830167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:29.830176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:29.830178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:29.830199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255747895880298:9655]
2025-10-01T14:11:29.830188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1383
2025-10-01T14:11:29.830194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1383
2025-10-01T14:11:29.830206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:29.830207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:29.830226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.830230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.830255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|697596ed-c38cd046-e49ff433-d0c797c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:29.830264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:29.830267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:29.830269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:29.830274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:29.830284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:29.830298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.830438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.830444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.830454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:29.830523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1384 partition: 0 MaxSeqNo: 45 sessionId: src_id|697596ed-c38cd046-e49ff433-d0c797c9_0
2025-10-01T14:11:29.830883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74c3f77b-201ec29c-dcf1f12c-f0fb554b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|697596ed-c38cd046-e49ff433-d0c797c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:29.833102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|697596ed-c38cd046-e49ff433-d0c797c9_0] Write session: try to update token
2025-10-01T14:11:29.833114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|697596ed-c38cd046-e49ff433-d0c797c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:29.845008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1384 sessionId: src_id|697596ed-c38cd046-e49ff433-d0c797c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:29.847071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:29.847238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.847258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.847287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:29.847345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:29.850057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:29.850078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:29.850080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:29.850082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:29.850092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255747895880298:9655]
2025-10-01T14:11:29.850097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255747895880298:9655]
2025-10-01T14:11:29.850101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255747895880298:9655]
2025-10-01T14:11:29.850139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:29.850152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:29.850153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:29.850157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:29.850160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:29.850163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:29.850411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:29.910813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255750272760727:4741]
2025-10-01T14:11:29.911067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1383, pipe: [1:7556255750272760727:4741]
2025-10-01T14:11:29.984817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:29.990965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:29.990989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:29.991126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.991177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.991233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.991318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.991358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.991365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.991421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.991473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.991527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.991582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.991621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.991630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.991681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.991727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.991777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.991828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.991866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.991871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.991922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.991980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.992029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.992078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.992113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.992119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.992171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.992217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.992265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.992314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.992401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.992407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.992456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.992505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.992558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.992612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.992649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.992654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.992714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.992763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.992813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.992864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.992902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.992907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.992959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.993006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.993055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.993106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.993145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.993150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.993259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.993309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.993361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.993412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.993449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.993455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.993509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:29.993559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:29.993624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:29.993673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:29.993709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:29.993714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:29.993749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760727:4741], now have 1 active actors on pipe
2025-10-01T14:11:29.994008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255750272760727:4741]
2025-10-01T14:11:29.994017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:29.994021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:29.994038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:29.994047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1384 reason: error at write: Disconnected sessionId: src_id|697596ed-c38cd046-e49ff433-d0c797c9_0
2025-10-01T14:11:29.994261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1384 sessionId: src_id|697596ed-c38cd046-e49ff433-d0c797c9_0 is DEAD
2025-10-01T14:11:29.994302Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:29.994403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697596ed-c38cd046-e49ff433-d0c797c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:29.994414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697596ed-c38cd046-e49ff433-d0c797c9_0] Write session will restart in 0.006909s
2025-10-01T14:11:29.994439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697596ed-c38cd046-e49ff433-d0c797c9_0] Write session: Do CDS request
2025-10-01T14:11:29.994446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697596ed-c38cd046-e49ff433-d0c797c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:30.002773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|697596ed-c38cd046-e49ff433-d0c797c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.002861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:30.002873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1385
2025-10-01T14:11:30.002972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.002995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:30.003002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:30.003004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:30.003303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1385 sessionId:  describe result for acl check
2025-10-01T14:11:30.003332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:30.003336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:30.003338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:30.003342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255754567728136:3923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:30.003725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255754567728136:3923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:30.005776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255754567728136:3923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:30.005966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:30.008223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:30.008372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:30.008381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:30.008389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:30.008431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:30.008458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255752190847857:9669]
2025-10-01T14:11:30.008514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255754567728136:3923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:30.008524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255754567728136:3923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:30.008527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255754567728136:3923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:30.008542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:30.008864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:30.009108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:30.009159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:30.009382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:30.009422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.009426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.009427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.009428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.009429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.009429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.009430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.009431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.009432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.009433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.009434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.009434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.009435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.009436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.009439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.009445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.009447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.009449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.009452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.009454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.009456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.009458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.009460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.009463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.009464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.009467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.009469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.009471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.009484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.009492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.009499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.009503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.009509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.009512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.009514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.009517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.009519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.009522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.009525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.009528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.009533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.009536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.009546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.009552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.009555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.009561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.009563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.009566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.009569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.009575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.009577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.009580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.009586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.009588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.009591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.009594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.009616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:30.012936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:30.013822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:30.013836Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:30.013838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:30.013841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:30.013846Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1384 [2:7556255752190847857:9669]
2025-10-01T14:11:30.013863Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:30.013879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:30.013884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.013887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.013889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.013902Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:30.013909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:30.013913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:30.013956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.013961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.013962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.013965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:30.013966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:30.014014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:30.014020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.014027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.014036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.014048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:30.014063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255752190847852:9669]
2025-10-01T14:11:30.014068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255752190847852:9669]
2025-10-01T14:11:30.014069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255752190847852:9669]
2025-10-01T14:11:30.014076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:30.014086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:30.014096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:30.014098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:30.014101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:30.014111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:30.014116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:30.014123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255750272760731:2446], now have 1 active actors on pipe
2025-10-01T14:11:30.014129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728236:3923], now have 1 active actors on pipe
2025-10-01T14:11:30.014153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255752190847852:9669]
2025-10-01T14:11:30.014161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:30.014152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1384
2025-10-01T14:11:30.014187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:30.014206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.014158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1384
2025-10-01T14:11:30.014209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.014226Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:30.014233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.014236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.014240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:30.014246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.014253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:30.014266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.014405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.014411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.014422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.014478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1385 partition: 0 MaxSeqNo: 45 sessionId: src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0
2025-10-01T14:11:30.014847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|697596ed-c38cd046-e49ff433-d0c797c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:30.017176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0] Write session: try to update token
2025-10-01T14:11:30.017192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:30.024242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:30.024260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.024268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255752190847852:9669]
2025-10-01T14:11:30.024300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:30.024317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:30.024456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:30.024581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.024716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.024831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.025011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:30.025046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:30.030697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1385 sessionId: src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:30.032987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:30.033182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.033201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.033230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:30.033296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:30.042307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:30.042325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.042327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:30.042328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:30.042335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255752190847852:9669]
2025-10-01T14:11:30.042338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255752190847852:9669]
2025-10-01T14:11:30.042342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255752190847852:9669]
2025-10-01T14:11:30.042402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:30.042413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.042415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:30.042417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:30.042423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:30.042440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:30.042534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:30.094125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255754567728260:4741]
2025-10-01T14:11:30.094640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1384, pipe: [1:7556255754567728260:4741]
2025-10-01T14:11:30.183155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:30.189758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.189784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.189918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.189968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.190024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.190075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.190114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.190121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.190179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.190233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.190285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.190343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.190465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.190471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.190529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.190581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.190634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.190690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.190728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.190733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.190790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.190842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.190897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.190954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.190993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.190998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.191053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.191106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.191158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.191212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.191251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.191256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.191313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.191380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.191434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.191489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.191534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.191540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.191596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.191645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.191698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.191752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.191790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.191796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.191847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.191895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.191948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.191999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.192039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.192044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.192100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.192155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.192208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.192263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.192357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.192363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.192420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.192470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.192523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.192574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.192613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.192618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.192660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728260:4741], now have 1 active actors on pipe
2025-10-01T14:11:30.192926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:30.192929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:30.192940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:30.192962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1385 reason: error at write: Disconnected sessionId: src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0
2025-10-01T14:11:30.193052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255754567728260:4741]
2025-10-01T14:11:30.193111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1385 sessionId: src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0 is DEAD
2025-10-01T14:11:30.193312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:30.193299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:30.193326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0] Write session will restart in 0.006257s
2025-10-01T14:11:30.193352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0] Write session: Do CDS request
2025-10-01T14:11:30.193356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:30.200874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.200985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:30.200998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1386
2025-10-01T14:11:30.201108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.201143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:30.201151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:30.201154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:30.201467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1386 sessionId:  describe result for acl check
2025-10-01T14:11:30.201489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:30.201494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:30.201497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:30.201500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255754567728319:3918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:30.201915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255754567728319:3918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:30.204600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255754567728319:3918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:30.206631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:30.206772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255754567728319:3918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:30.206786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255754567728319:3918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:30.206789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255754567728319:3918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:30.206797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:30.208724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:30.208917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:30.208928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:30.208939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:30.208982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:30.209022Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255752190848074:9671]
2025-10-01T14:11:30.209615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:30.209889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:30.209932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:30.210232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:30.210287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.210294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.210295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.210297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.210298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.210299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.210300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.210302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.210303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.210304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.210305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.210306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.210308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.210309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.210314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.210324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.210328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.210332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.210336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.210340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.210344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.210348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.210351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.210355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.210363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.210383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.210392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.210396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.210403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.210414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.210424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.210429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.210437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.210442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.210450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.210455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.210464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.210473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.210481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.210486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.210492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.210501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.210509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.210518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.210527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.210535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.210543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.210549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.210557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.210566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.210573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.210577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.210584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.210589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.210596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.210601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.210640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:30.214162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:30.214988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:30.215005Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:30.215007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:30.215011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:30.215018Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1385 [2:7556255752190848074:9671]
2025-10-01T14:11:30.215033Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:30.215053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:30.215060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.215063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.215066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.215081Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:30.215090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:30.215102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:30.215157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.215164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.215166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.215170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:30.215172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:30.215242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:30.215251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.215263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.215275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.215291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:30.215318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728262:2446], now have 1 active actors on pipe
2025-10-01T14:11:30.215321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728476:3918], now have 1 active actors on pipe
2025-10-01T14:11:30.215329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255752190848068:9671]
2025-10-01T14:11:30.215334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1385
2025-10-01T14:11:30.215332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255752190848068:9671]
2025-10-01T14:11:30.215334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255752190848068:9671]
2025-10-01T14:11:30.215346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:30.215358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:30.215379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1385
2025-10-01T14:11:30.215360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:30.215360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:30.215373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:30.215373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:30.215377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:30.215410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255752190848068:9671]
2025-10-01T14:11:30.215417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:30.215431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:30.215432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.215437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.215475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|add73311-e0bd6553-1457d633-2cc5ab03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:30.215490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.215494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.215497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:30.215505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.215513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:30.215529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.215736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.215746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.215761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.215845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1386 partition: 0 MaxSeqNo: 45 sessionId: src_id|add73311-e0bd6553-1457d633-2cc5ab03_0
2025-10-01T14:11:30.216175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d704755c-af48cae0-8ef2a8e8-200da1b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|add73311-e0bd6553-1457d633-2cc5ab03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:30.218438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add73311-e0bd6553-1457d633-2cc5ab03_0] Write session: try to update token
2025-10-01T14:11:30.218453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add73311-e0bd6553-1457d633-2cc5ab03_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:30.231518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1386 sessionId: src_id|add73311-e0bd6553-1457d633-2cc5ab03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:30.233939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:30.234995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.235018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.235036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:30.235038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.235039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:30.235041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:30.235046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255752190848068:9671]
2025-10-01T14:11:30.235050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255752190848068:9671]
2025-10-01T14:11:30.235054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255752190848068:9671]
2025-10-01T14:11:30.235089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:30.235097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:30.235100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:30.235101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.235103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:30.235104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:30.235218Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:30.293283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255754567728489:4741]
2025-10-01T14:11:30.293519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1385, pipe: [1:7556255754567728489:4741]
2025-10-01T14:11:30.376508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:30.376905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:30.376952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728489:4741], now have 1 active actors on pipe
2025-10-01T14:11:30.377046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:30.377124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:30.377164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255754567728489:4741]
2025-10-01T14:11:30.385654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:30.385669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:30.385689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1386 reason: error at write: Disconnected sessionId: src_id|add73311-e0bd6553-1457d633-2cc5ab03_0
2025-10-01T14:11:30.385845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1386 sessionId: src_id|add73311-e0bd6553-1457d633-2cc5ab03_0 is DEAD
2025-10-01T14:11:30.385969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add73311-e0bd6553-1457d633-2cc5ab03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:30.385978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add73311-e0bd6553-1457d633-2cc5ab03_0] Write session will restart in 0.005337s
2025-10-01T14:11:30.385996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add73311-e0bd6553-1457d633-2cc5ab03_0] Write session: Do CDS request
2025-10-01T14:11:30.386001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add73311-e0bd6553-1457d633-2cc5ab03_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:30.392560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:30.392885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|add73311-e0bd6553-1457d633-2cc5ab03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.392939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:30.392950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1387
2025-10-01T14:11:30.393069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.393092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:30.393095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:30.393097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:30.393399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1387 sessionId:  describe result for acl check
2025-10-01T14:11:30.393427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:30.393432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:30.393433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:30.393437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255754567728679:3904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:30.393794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255754567728679:3904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:30.394620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:30.394749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:30.394757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:30.394764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:30.394794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:30.394820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255752190848290:9673]
2025-10-01T14:11:30.395189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:30.395362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:30.395387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:30.395417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255754567728679:3904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:30.395572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:30.395605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.395610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.395610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.395611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.395612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.395612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.395613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.395614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.395614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.395615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.395616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.395616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.395617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.395618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.395621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.395627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.395629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.395631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.395633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.395635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.395637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.395639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.395642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.395644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.395646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.395648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.395650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.395652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.395656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.395661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.395664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.395668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.395670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.395673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.395676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.395679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.395681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.395684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.395686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.395689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.395692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.395695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.395697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.395700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.395703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.395705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.395709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.395712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.395714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.395717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.395719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.395722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.395724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.395727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.395734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.395737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.395757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:30.398883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255754567728679:3904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:30.398896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255754567728679:3904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:30.398899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255754567728679:3904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:30.398906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:30.399089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:30.399683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:30.399698Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:30.399700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:30.399702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:30.399708Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1386 [2:7556255752190848290:9673]
2025-10-01T14:11:30.399717Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:30.399729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:30.399735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.399737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.399739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.399749Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:30.399752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:30.399756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:30.399792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.399797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.399798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.399801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:30.399802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:30.399846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:30.399851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.399858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.399863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.399872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:30.399887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728497:2446], now have 1 active actors on pipe
2025-10-01T14:11:30.399892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728717:3904], now have 1 active actors on pipe
2025-10-01T14:11:30.399897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255752190848285:9673]
2025-10-01T14:11:30.399898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255752190848285:9673]
2025-10-01T14:11:30.399899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255752190848285:9673]
2025-10-01T14:11:30.399908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:30.399917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:30.399919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:30.399920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:30.399921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:30.399928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:30.399930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:30.399943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255752190848285:9673]
2025-10-01T14:11:30.399948Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:30.399944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1386
2025-10-01T14:11:30.399950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1386
2025-10-01T14:11:30.399967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:30.399971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.399973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.399992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:30.400000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.400003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.400004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:30.400009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.400018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:30.400028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.400148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.400154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.400162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.400222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1387 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0
2025-10-01T14:11:30.400459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|add73311-e0bd6553-1457d633-2cc5ab03_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:30.402730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0] Write session: try to update token
2025-10-01T14:11:30.402743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:30.410050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:30.410076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.410087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255752190848285:9673]
2025-10-01T14:11:30.410117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:30.410136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:30.410423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:30.410614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.410790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.410921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.411082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:30.411113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:30.414693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1387 sessionId: src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:30.416898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:30.417057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.417073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.417099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:30.417171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:30.429083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:30.429103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.429104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:30.429106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:30.429114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255752190848285:9673]
2025-10-01T14:11:30.429116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255752190848285:9673]
2025-10-01T14:11:30.429119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255752190848285:9673]
2025-10-01T14:11:30.429154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:30.429154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:30.429157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:30.429159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:30.429163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.429164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:30.429272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:30.477095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255754567728727:4741]
2025-10-01T14:11:30.477350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1386, pipe: [1:7556255754567728727:4741]
2025-10-01T14:11:30.564030Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:30.570673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.570695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.570837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.570896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.570954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.571008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.571054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.571062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.571119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.571170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.571226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.571281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.571320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.571326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.571382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.571433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.571487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.571540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.571581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.571586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.571641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.571697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.571749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.571802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.571840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.571844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.571907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.571968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.572021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.572072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.572113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.572119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.572176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.572230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.572284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.572339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.572378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.572383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.572438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.572491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.572550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.572605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.572646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.572652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.572722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.572777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.572831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.572882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.572939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.572945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.572998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.573050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.573101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.573158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.573196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.573203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.573259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.573315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.573365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.573416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.573452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.573458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.573497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728727:4741], now have 1 active actors on pipe
2025-10-01T14:11:30.573723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:30.573740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255754567728727:4741]
2025-10-01T14:11:30.573766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:30.573768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:30.573788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1387 reason: error at write: Disconnected sessionId: src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0
2025-10-01T14:11:30.573958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1387 sessionId: src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0 is DEAD
2025-10-01T14:11:30.574134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:30.574144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0] Write session will restart in 0.008495s
2025-10-01T14:11:30.574163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0] Write session: Do CDS request
2025-10-01T14:11:30.574168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:30.574161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:30.583854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.583933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:30.583945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1388
2025-10-01T14:11:30.584055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.584079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:30.584087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:30.584090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:30.584409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1388 sessionId:  describe result for acl check
2025-10-01T14:11:30.584438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:30.584443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:30.584444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:30.584448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255754567728899:3891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:30.584878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255754567728899:3891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:30.587192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255754567728899:3891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:30.587960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:30.588334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:30.588454Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:30.588462Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:30.588470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:30.588498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:30.588524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255752190848512:9676]
2025-10-01T14:11:30.588931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:30.589071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255754567728899:3891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:30.589082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:30.589083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255754567728899:3891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:30.589085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255754567728899:3891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:30.589091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:30.589108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:30.589311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:30.589348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.589354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.589355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.589356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.589357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.589358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.589358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.589359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.589359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.589360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.589361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.589361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.589362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.589362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.589366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.589371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.589373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.589376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.589378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.589380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.589382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.589384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.589386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.589388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.589390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.589392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.589394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.589396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.589401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.589405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.589409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.589413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.589415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.589418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.589421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.589424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.589427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.589429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.589431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.589434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.589437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.589440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.589442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.589444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.589446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.589449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.589451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.589454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.589456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.589459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.589461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.589463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.589465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.589468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.589470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.589472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.589492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:30.592646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:30.593194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:30.593208Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:30.593209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:30.593212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:30.593216Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1387 [2:7556255752190848512:9676]
2025-10-01T14:11:30.593225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:30.593236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:30.593238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.593240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.593241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.593252Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:30.593255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:30.593259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:30.593300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.593306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.593308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.593311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:30.593314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:30.593370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:30.593375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.593382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.593387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.593395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:30.593413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728730:2446], now have 1 active actors on pipe
2025-10-01T14:11:30.593420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728947:3891], now have 1 active actors on pipe
2025-10-01T14:11:30.593426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255752190848507:9676]
2025-10-01T14:11:30.593432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255752190848507:9676]
2025-10-01T14:11:30.593434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255752190848507:9676]
2025-10-01T14:11:30.593445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:30.593456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:30.593461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:30.593464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:30.593465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:30.593469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:30.593471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:30.593468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1387
2025-10-01T14:11:30.593487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255752190848507:9676]
2025-10-01T14:11:30.593499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1387
2025-10-01T14:11:30.593493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:30.593495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:30.593518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.593524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.593542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:30.593550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.593553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.593555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:30.593560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.593570Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:30.593580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.593671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.593676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.593685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.593938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1388 partition: 0 MaxSeqNo: 45 sessionId: src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0
2025-10-01T14:11:30.594256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d48ce5d-578f155d-c3dacd07-2512e58b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:30.596715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0] Write session: try to update token
2025-10-01T14:11:30.596731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:30.610129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1388 sessionId: src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:30.612424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:30.613636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.613664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.613684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:30.613687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.613689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:30.613691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:30.613698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255752190848507:9676]
2025-10-01T14:11:30.613703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255752190848507:9676]
2025-10-01T14:11:30.613713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255752190848507:9676]
2025-10-01T14:11:30.613746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:30.613756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:30.613759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:30.613767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:30.613776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.613783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:30.613894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:30.673678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255754567728983:4741]
2025-10-01T14:11:30.673865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1387, pipe: [1:7556255754567728983:4741]
2025-10-01T14:11:30.746111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:30.746616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:30.746674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728983:4741], now have 1 active actors on pipe
2025-10-01T14:11:30.746733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:30.746890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:30.746972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255754567728983:4741]
2025-10-01T14:11:30.755762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:30.755785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:30.755803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1388 reason: error at write: Disconnected sessionId: src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0
2025-10-01T14:11:30.755943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1388 sessionId: src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0 is DEAD
2025-10-01T14:11:30.756071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:30.756082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0] Write session will restart in 0.009058s
2025-10-01T14:11:30.756105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0] Write session: Do CDS request
2025-10-01T14:11:30.756115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:30.762098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:30.764014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:30.764138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:30.764145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:30.764152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:30.764180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:30.764207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255752190848740:9680]
2025-10-01T14:11:30.764576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:30.764803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:30.764830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:30.765011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:30.765042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.765047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.765047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.765048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.765049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.765049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.765050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.765050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.765051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.765052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.765053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.765053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.765054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.765054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.765057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.765062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.765064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.765066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.765068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.765071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.765073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.765075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.765076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.765079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.765081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.765083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.765084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.765086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.765092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.765096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.765100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.765103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.765105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.765108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.765110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.765113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.765115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.765121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.765124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.765126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.765129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.765135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.765138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.765140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.765146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.765149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.765151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.765153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.765160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.765163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.765168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.765171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.765173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.765176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.765178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.765184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.765204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:30.765830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.765926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:30.765938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1389
2025-10-01T14:11:30.766011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.766039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:30.766048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:30.766054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:30.766314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1389 sessionId:  describe result for acl check
2025-10-01T14:11:30.766336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:30.766341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:30.766342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:30.766345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255754567729172:3878] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:30.766864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255754567729172:3878] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:30.768522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:30.769025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255754567729172:3878] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:30.769068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:30.769081Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:30.769082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:30.769084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:30.769089Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1388 [2:7556255752190848740:9680]
2025-10-01T14:11:30.769100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:30.769111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:30.769116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.769118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.769119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.769130Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:30.769136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:30.769140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:30.769174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.769179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.769180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.769182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:30.769184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:30.769243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:30.769249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.769255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.769261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.769272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:30.769289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567728985:2446], now have 1 active actors on pipe
2025-10-01T14:11:30.769301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255752190848735:9680]
2025-10-01T14:11:30.769307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255752190848735:9680]
2025-10-01T14:11:30.769309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255752190848735:9680]
2025-10-01T14:11:30.769307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1388
2025-10-01T14:11:30.769321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:30.769329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:30.769331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:30.769332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:30.769334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:30.769342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:30.769347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:30.769368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255752190848735:9680]
2025-10-01T14:11:30.769375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:30.769379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:30.773987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255754567729172:3878] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:30.773999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255754567729172:3878] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:30.774002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255754567729172:3878] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:30.774009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:30.774194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567729210:3878], now have 1 active actors on pipe
2025-10-01T14:11:30.774223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1388
2025-10-01T14:11:30.774264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.774273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.774292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:30.774302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.774307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.774308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:30.774317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.774328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:30.774343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.774527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.774542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.774564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.774691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1389 partition: 0 MaxSeqNo: 45 sessionId: src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0
2025-10-01T14:11:30.774998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60f1aa12-270a2a8b-c16953dc-310ff5ac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:30.777331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0] Write session: try to update token
2025-10-01T14:11:30.777345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:30.779510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:30.779529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.779536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255752190848735:9680]
2025-10-01T14:11:30.779565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:30.779579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:30.779730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:30.779860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.779975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.780121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.780396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:30.780445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:30.789401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1389 sessionId: src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:30.791399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:30.791872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.791892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.791920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:30.792003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:30.797502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:30.797516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.797518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:30.797519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:30.797527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255752190848735:9680]
2025-10-01T14:11:30.797530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255752190848735:9680]
2025-10-01T14:11:30.797532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255752190848735:9680]
2025-10-01T14:11:30.797561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:30.797564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:30.797565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:30.797569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.797570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:30.797570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:30.797677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:30.847253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255754567729215:4741]
2025-10-01T14:11:30.847479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1388, pipe: [1:7556255754567729215:4741]
2025-10-01T14:11:30.928382Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:30.935668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.935698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.935835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.935896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.935956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.936008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.936046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.936053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.936108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.936160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.936211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.936263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.936302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.936308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.936371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.936442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.936502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.936556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.936596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.936602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.936665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.936728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.936781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.936837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.936878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.936887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.936954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.937007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.937059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.937113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.937150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.937159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.937222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.937275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.937328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.937385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.937433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.937443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.937502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.937553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.937675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.937732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.937776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.937781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.937839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.937894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.937954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.938008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.938059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.938065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.938122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.938174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.938228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.938332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.938397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.938402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.938470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:30.938525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:30.938581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:30.938636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:30.938683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:30.938688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:30.938732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567729215:4741], now have 1 active actors on pipe
2025-10-01T14:11:30.939037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:30.939046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:30.939053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:30.939080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1389 reason: error at write: Disconnected sessionId: src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0
2025-10-01T14:11:30.939085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255754567729215:4741]
2025-10-01T14:11:30.939286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1389 sessionId: src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0 is DEAD
2025-10-01T14:11:30.939417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:30.939426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0] Write session will restart in 0.007446s
2025-10-01T14:11:30.939453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0] Write session: Do CDS request
2025-10-01T14:11:30.939458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:30.939683Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:30.947915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.948041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:30.948056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1390
2025-10-01T14:11:30.948191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:30.948215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:30.948222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:30.948225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:30.948580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1390 sessionId:  describe result for acl check
2025-10-01T14:11:30.948621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:30.948627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:30.948629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:30.948634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255754567729305:3868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:30.949129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255754567729305:3868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:30.951187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255754567729305:3868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:30.952042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:30.954071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:30.954201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:30.954209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:30.954216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:30.954245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:30.954271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255752190849003:9689]
2025-10-01T14:11:30.954341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255754567729305:3868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:30.954352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255754567729305:3868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:30.954355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255754567729305:3868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:30.954360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:30.954660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:30.954866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:30.954894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:30.955082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:30.955113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.955118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.955118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.955119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.955120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.955120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.955121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.955122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.955122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.955123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.955124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.955124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.955126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.955126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.955129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.955135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.955137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.955139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.955141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.955143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.955145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.955147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.955149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.955152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.955154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.955156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.955158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.955160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.955165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.955170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:30.955174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.955177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:30.955179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.955182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:30.955184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.955187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:30.955190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.955193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:30.955195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.955197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:30.955200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.955203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:30.955205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.955208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:30.955210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.955213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:30.955215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.955219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.955222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.955228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.955231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.955233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.955236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.955241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:30.955244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.955247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:30.955268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:30.958525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:30.959077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:30.959090Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:30.959092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:30.959095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:30.959100Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1389 [2:7556255752190849003:9689]
2025-10-01T14:11:30.959111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:30.959126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:30.959131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.959133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.959135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.959145Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:30.959153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:30.959157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:30.959195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.959200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.959201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.959203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:30.959205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:30.959252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:30.959258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.959264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:30.959273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:30.959286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:30.959301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567729435:3868], now have 1 active actors on pipe
2025-10-01T14:11:30.959307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255754567729218:2446], now have 1 active actors on pipe
2025-10-01T14:11:30.959312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255752190848998:9689]
2025-10-01T14:11:30.959313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255752190848998:9689]
2025-10-01T14:11:30.959315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255752190848998:9689]
2025-10-01T14:11:30.959325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:30.959334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:30.959339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:30.959342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:30.959343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:30.959345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:30.959347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:30.959364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255752190848998:9689]
2025-10-01T14:11:30.959372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:30.959377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:30.959375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1389
2025-10-01T14:11:30.959382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1389
2025-10-01T14:11:30.959455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.959465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.959481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:30.959486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:30.959489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:30.959491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:30.959498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:30.959504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:30.959514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.959629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.959640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.959653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:30.959732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1390 partition: 0 MaxSeqNo: 45 sessionId: src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0
2025-10-01T14:11:30.960068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cee12383-43bf702d-27bdd2bc-19069cbf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:30.962321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0] Write session: try to update token
2025-10-01T14:11:30.962334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:30.969708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:30.969732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.969744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255752190848998:9689]
2025-10-01T14:11:30.969786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:30.969793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:30.970025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:30.970215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.970431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.970590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:30.970830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:30.970878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:30.975311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1390 sessionId: src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:30.977539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:30.977733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:30.977753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:30.977788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:30.977862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:30.987001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:30.987018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:30.987020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:30.987022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:30.987029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255752190848998:9689]
2025-10-01T14:11:30.987031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255752190848998:9689]
2025-10-01T14:11:30.987034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255752190848998:9689]
2025-10-01T14:11:30.987071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:30.987074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:30.987080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:30.987082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:30.987083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:30.987084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:30.987194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:31.039273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255758862696744:4741]
2025-10-01T14:11:31.039501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1389, pipe: [1:7556255758862696744:4741]
2025-10-01T14:11:31.118910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:31.125436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.125460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.125591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.125643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.125698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.125749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.125787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.125794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.125857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.125910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.125964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.126017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.126059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.126065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.126146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.126196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.126247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.126300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.126345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.126352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.126418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.126471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.126522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.126576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.126622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.126627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.126682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.126732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.126786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.126845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.126889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.126894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.126949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.126999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.127050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.127100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.127138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.127143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.127193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.127242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.127293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.127343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.127387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.127392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.127441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.127488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.127539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.127588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.127692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.127698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.127745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.127793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.127842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.127902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.127940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.127945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.127995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.128042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.128089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.128136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.128176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.128182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.128218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862696744:4741], now have 1 active actors on pipe
2025-10-01T14:11:31.128369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:31.128372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255758862696744:4741]
2025-10-01T14:11:31.128380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:31.128393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:31.128400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1390 reason: error at write: Disconnected sessionId: src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0
2025-10-01T14:11:31.128567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1390 sessionId: src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0 is DEAD
2025-10-01T14:11:31.128705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:31.128715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0] Write session will restart in 0.008668s
2025-10-01T14:11:31.128733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0] Write session: Do CDS request
2025-10-01T14:11:31.128738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:31.128859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:31.138883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.139097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:31.139111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1391
2025-10-01T14:11:31.139214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.139245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:31.139255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:31.139265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:31.139598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1391 sessionId:  describe result for acl check
2025-10-01T14:11:31.139628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:31.139632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:31.139633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:31.139651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255758862696938:3857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:31.140029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255758862696938:3857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:31.140938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:31.141687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255758862696938:3857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:31.142908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:31.143034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:31.143042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:31.143049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:31.143077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:31.143102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255756485816522:9696]
2025-10-01T14:11:31.143486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:31.143583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255758862696938:3857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:31.143595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255758862696938:3857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:31.143598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255758862696938:3857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:31.143605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:31.143677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:31.143701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:31.143903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:31.143940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.143944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.143945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.143946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.143946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.143947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.143947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.143948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.143949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.143949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.143950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.143951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.143951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.143952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.143955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.143960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.143962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.143964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.143966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.143969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.143971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.143973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.143975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.143977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.143979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.143981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.143983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.143985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.143989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.143994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.143998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.144002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.144007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.144010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.144013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.144018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.144021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.144024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.144026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.144029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.144031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.144034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.144039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.144042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.144044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.144050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.144053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.144055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.144058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.144061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.144066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.144069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.144071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.144074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.144076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.144081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.144101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:31.147332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:31.147867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:31.147882Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:31.147884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:31.147886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:31.147891Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1390 [2:7556255756485816522:9696]
2025-10-01T14:11:31.147900Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:31.147912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:31.147913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.147915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.147916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.147927Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:31.147930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:31.147935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:31.147987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.147995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.147997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.148000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:31.148003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:31.148065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:31.148072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.148083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.148091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.148104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:31.148121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862696758:2446], now have 1 active actors on pipe
2025-10-01T14:11:31.148130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862696978:3857], now have 1 active actors on pipe
2025-10-01T14:11:31.148137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255756485816517:9696]
2025-10-01T14:11:31.148138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255756485816517:9696]
2025-10-01T14:11:31.148140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255756485816517:9696]
2025-10-01T14:11:31.148153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:31.148161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:31.148163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:31.148164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:31.148152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1390
2025-10-01T14:11:31.148170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:31.148158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1390
2025-10-01T14:11:31.148182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:31.148189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:31.148224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.148233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.148244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255756485816517:9696]
2025-10-01T14:11:31.148252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:31.148265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:31.148280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:31.148290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.148297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.148299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:31.148306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.148318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:31.148340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.148428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.148434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.148444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.148510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1391 partition: 0 MaxSeqNo: 45 sessionId: src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0
2025-10-01T14:11:31.148835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|780f00b3-b0b6cc25-3c35cce4-2274c112_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:31.151063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0] Write session: try to update token
2025-10-01T14:11:31.151078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:31.163437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1391 sessionId: src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:31.165535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:31.167064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.167085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.167102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:31.167105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:31.167107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:31.167108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:31.167115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255756485816517:9696]
2025-10-01T14:11:31.167119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255756485816517:9696]
2025-10-01T14:11:31.167124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255756485816517:9696]
2025-10-01T14:11:31.167161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:31.167172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:31.167176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:31.167176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.167178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:31.167178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:31.167345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:31.228722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255758862696988:4741]
2025-10-01T14:11:31.228991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1390, pipe: [1:7556255758862696988:4741]
2025-10-01T14:11:31.301275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:31.301649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:31.301693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862696988:4741], now have 1 active actors on pipe
2025-10-01T14:11:31.301781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:31.301902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255758862696988:4741]
2025-10-01T14:11:31.301934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:31.310138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:31.310154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:31.310172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1391 reason: error at write: Disconnected sessionId: src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0
2025-10-01T14:11:31.310293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1391 sessionId: src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0 is DEAD
2025-10-01T14:11:31.310466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:31.310478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0] Write session will restart in 0.009731s
2025-10-01T14:11:31.310504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0] Write session: Do CDS request
2025-10-01T14:11:31.310511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:31.318996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:31.320847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:31.320982Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:31.320991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:31.320998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:31.321028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:31.321056Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255756485816744:9698]
2025-10-01T14:11:31.321451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:31.321671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:31.321700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:31.321839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.321956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:31.322013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.322018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.322019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.322020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.322020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.322021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.322022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.322022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.322023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.322024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.322024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.322025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.322026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.322026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.322029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.322035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.322037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.322039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.322041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.322043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.322045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.322047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.322050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.322060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.322063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.322067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.322070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.322073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.322080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.322087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.322092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.322097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.322101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.322105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.322110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.322116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.322121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.322126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.322129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.322135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.322139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.322144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.322148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.322153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.322163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.322167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.322171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.322175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.322184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.322188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.322192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.322200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.322204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.322208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.322216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.322220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.322253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:31.322677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:31.322693Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1392
2025-10-01T14:11:31.322795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.322823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:31.322832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:31.322835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:31.323191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1392 sessionId:  describe result for acl check
2025-10-01T14:11:31.323221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:31.323227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:31.323229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:31.323233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255758862697179:3850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:31.323696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255758862697179:3850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:31.325818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:31.325920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255758862697179:3850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:31.326557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:31.326575Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:31.326577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:31.326580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:31.326587Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1391 [2:7556255756485816744:9698]
2025-10-01T14:11:31.326601Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:31.326618Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:31.326620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.326624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.326626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.326643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:31.326649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:31.326655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:31.326715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.326724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.326726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.326729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:31.326732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:31.326803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:31.326811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.326823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.326831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.326844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:31.326866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862696989:2446], now have 1 active actors on pipe
2025-10-01T14:11:31.326879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255756485816739:9698]
2025-10-01T14:11:31.326883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255756485816739:9698]
2025-10-01T14:11:31.326885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255756485816739:9698]
2025-10-01T14:11:31.326898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:31.326911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:31.326915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:31.326919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:31.326921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:31.326926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:31.326929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:31.326955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255756485816739:9698]
2025-10-01T14:11:31.326965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:31.326967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:31.326917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1391
2025-10-01T14:11:31.331449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255758862697179:3850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:31.331464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255758862697179:3850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:31.331466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255758862697179:3850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:31.331473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:31.331673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697217:3850], now have 1 active actors on pipe
2025-10-01T14:11:31.331724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1391
2025-10-01T14:11:31.331782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.331792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.331811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:31.331823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.331827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.331833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:31.331841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.331853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:31.331870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.332012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.332019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.332028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.332219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1392 partition: 0 MaxSeqNo: 45 sessionId: src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0
2025-10-01T14:11:31.332527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c8c5ab4-9f7a0a52-d990c28b-857e98ea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:31.334956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0] Write session: try to update token
2025-10-01T14:11:31.334975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:31.336965Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:31.336984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:31.336993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255756485816739:9698]
2025-10-01T14:11:31.337024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:31.337035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:31.337188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:31.337321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:31.337464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:31.337594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:31.337783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:31.337824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:31.348461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1392 sessionId: src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:31.350982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:31.351228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.351253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.351293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:31.351397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:31.355087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:31.355113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:31.355116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:31.355118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:31.355132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255756485816739:9698]
2025-10-01T14:11:31.355138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255756485816739:9698]
2025-10-01T14:11:31.355144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255756485816739:9698]
2025-10-01T14:11:31.355203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:31.355217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.355223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:31.355344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:31.355362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:31.355367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:31.355394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:31.402298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255758862697226:4741]
2025-10-01T14:11:31.402639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1391, pipe: [1:7556255758862697226:4741]
2025-10-01T14:11:31.500700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:31.507946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.507980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.508156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.508222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.508288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.508349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.508392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.508406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.508471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.508532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.508592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.508663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.508789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.508807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.508880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.508945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.509011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.509080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.509124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.509131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.509204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.509269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.509331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.509395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.509439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.509446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.509549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.509607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.509660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.509711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.509756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.509762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.509827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.509882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.509933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.509984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.510021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.510026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.510081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.510132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.510186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.510240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.510305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.510311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.510366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.510429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.510483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.510537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.510576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.510578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.510633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.510686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.510741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.510794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.511441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.511450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.511507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:31.511558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:31.511619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:31.511675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:31.511764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:31.511769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:31.511817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697226:4741], now have 1 active actors on pipe
2025-10-01T14:11:31.512051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:31.512066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:31.512080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255758862697226:4741]
2025-10-01T14:11:31.512092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1392 reason: error at write: Disconnected sessionId: src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0
2025-10-01T14:11:31.512108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:31.512311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1392 sessionId: src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0 is DEAD
2025-10-01T14:11:31.512617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:31.512626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0] Write session will restart in 0.006356s
2025-10-01T14:11:31.512651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0] Write session: Do CDS request
2025-10-01T14:11:31.512656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:31.512745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:31.519851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.520031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:31.520057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1393
2025-10-01T14:11:31.520194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.520232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:31.520241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:31.520244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:31.520670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1393 sessionId:  describe result for acl check
2025-10-01T14:11:31.520720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:31.520726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:31.520728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:31.520733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255758862697273:3837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:31.521246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255758862697273:3837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:31.523842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255758862697273:3837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:31.526324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255758862697273:3837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:31.526339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255758862697273:3837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:31.526342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255758862697273:3837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:31.526356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:31.528401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:31.530804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:31.530984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:31.530991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:31.531000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:31.531034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:31.531126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255756485816970:9701]
2025-10-01T14:11:31.531520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:31.531892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:31.531952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:31.532266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:31.532337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.532349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.532350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.532351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.532352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.532353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.532354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.532355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.532356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.532358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.532359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.532360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.532361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.532362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.532368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.532377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.532381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.532385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.532388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.532392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.532395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.532399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.532403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.532407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.532411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.532414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.532418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.532422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.532430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.532437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.532443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.532448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.532454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.532459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.532463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.532467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.532471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.532476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.532480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.532484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.532489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.532494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.532498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.532503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.532507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.532512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.532517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.532522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.532526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.532531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.532541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.532546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.532552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.532557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.532561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.532568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.532606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:31.536334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:31.536950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:31.536969Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:31.536972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:31.536976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:31.536983Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1392 [2:7556255756485816970:9701]
2025-10-01T14:11:31.536999Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:31.537018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:31.537021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.537024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.537027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.537043Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:31.537056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:31.537062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:31.537116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.537124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.537126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.537132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:31.537135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:31.537209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:31.537217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.537229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.537241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.537263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:31.537285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697231:2446], now have 1 active actors on pipe
2025-10-01T14:11:31.537294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697449:3837], now have 1 active actors on pipe
2025-10-01T14:11:31.537302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255756485816965:9701]
2025-10-01T14:11:31.537304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255756485816965:9701]
2025-10-01T14:11:31.537306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255756485816965:9701]
2025-10-01T14:11:31.537319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:31.537336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:31.537345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:31.537348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:31.537349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:31.537350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:31.537326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1392
2025-10-01T14:11:31.537341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1392
2025-10-01T14:11:31.537352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:31.537386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255756485816965:9701]
2025-10-01T14:11:31.537389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:31.537391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:31.537410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.537414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.537459Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:31.537473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.537478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.537480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:31.537489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.537499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:31.537521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.537679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.537690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.537706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.537798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1393 partition: 0 MaxSeqNo: 45 sessionId: src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0
2025-10-01T14:11:31.538182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|503e00ce-94a6c8f8-99c8d89b-2e25f1e1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:31.540642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0] Write session: try to update token
2025-10-01T14:11:31.540659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:31.566735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:31.566758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:31.566760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:31.566761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:31.566770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255756485816965:9701]
2025-10-01T14:11:31.566775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255756485816965:9701]
2025-10-01T14:11:31.566779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255756485816965:9701]
2025-10-01T14:11:31.566821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:31.566829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.566831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:31.566994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:31.564624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1393 sessionId: src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:31.567834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:31.568496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:31.568514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:31.568523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:31.612192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255758862697463:4741]
2025-10-01T14:11:31.612585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1392, pipe: [1:7556255758862697463:4741]
2025-10-01T14:11:31.710681Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:31.711263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.711283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.711322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697463:4741], now have 1 active actors on pipe
2025-10-01T14:11:31.711589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:31.711584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:31.711591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255758862697463:4741]
2025-10-01T14:11:31.711600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:31.711613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:31.711676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1393 reason: error at write: Disconnected sessionId: src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0
2025-10-01T14:11:31.711842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1393 sessionId: src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0 is DEAD
2025-10-01T14:11:31.711990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:31.712000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0] Write session will restart in 0.008171s
2025-10-01T14:11:31.712021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0] Write session: Do CDS request
2025-10-01T14:11:31.712026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:31.720896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.720986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:31.721005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1394
2025-10-01T14:11:31.721628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.721668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:31.721679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:31.721683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:31.722240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1394 sessionId:  describe result for acl check
2025-10-01T14:11:31.722268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:31.722274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:31.722276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:31.722280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255758862697544:3824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:31.722775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255758862697544:3824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:31.726117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255758862697544:3824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:31.728919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255758862697544:3824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:31.728936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255758862697544:3824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:31.728940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255758862697544:3824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:31.728949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:31.730144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:31.734064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:31.734286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:31.734302Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:31.734312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:31.734364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:31.734430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255756485817201:9705]
2025-10-01T14:11:31.735055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:31.735354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:31.735422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:31.735769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:31.735854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.735862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.735863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.735864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.735865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.735867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.735868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.735870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.735872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.735873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.735875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.735877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.735878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.735879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.735886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.735897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.735901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.735905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.735915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.735923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.735928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.735932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.735941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.735950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.735958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.735962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.735971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.735979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.735992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.736016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.736028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.736039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.736050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.736060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.736068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.736079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.736088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.736098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.736106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.736115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.736125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.736135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.736144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.736152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.736161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.736171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.736180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.736189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.736197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.736206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.736215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.736220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.736225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.736234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.736243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.736252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.736297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:31.740713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:31.741447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:31.741473Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:31.741476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:31.741479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:31.741486Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1393 [2:7556255756485817201:9705]
2025-10-01T14:11:31.741501Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:31.741518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:31.741520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.741523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.741525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.741538Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:31.741543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:31.741547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:31.741601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.741609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.741610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.741613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:31.741615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:31.741676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:31.741686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.741701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.741709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.741727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:31.741744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697491:2446], now have 1 active actors on pipe
2025-10-01T14:11:31.741755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697706:3824], now have 1 active actors on pipe
2025-10-01T14:11:31.741762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255756485817196:9705]
2025-10-01T14:11:31.741765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255756485817196:9705]
2025-10-01T14:11:31.741767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255756485817196:9705]
2025-10-01T14:11:31.741780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:31.741791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:31.741803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:31.741806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:31.741807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:31.741809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:31.741810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:31.741840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255756485817196:9705]
2025-10-01T14:11:31.741822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1393
2025-10-01T14:11:31.741854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:31.741858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:31.741850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1393
2025-10-01T14:11:31.741882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.741886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.741913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:31.741923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.741927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.741929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:31.741935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.741947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:31.741963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.742144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.742152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.742163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.742252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1394 partition: 0 MaxSeqNo: 45 sessionId: src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0
2025-10-01T14:11:31.742638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb8034e-b1287f9a-f38a6c39-5f53e50e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:31.745077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0] Write session: try to update token
2025-10-01T14:11:31.745095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:31.758409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1394 sessionId: src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:31.761105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:31.762843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.762870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.762888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:31.762891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:31.762892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:31.762893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:31.762899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255756485817196:9705]
2025-10-01T14:11:31.762902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255756485817196:9705]
2025-10-01T14:11:31.762905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255756485817196:9705]
2025-10-01T14:11:31.762953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:31.762963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.762968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:31.762970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:31.762978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:31.762998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:31.763107Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:31.811897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255758862697722:4741]
2025-10-01T14:11:31.812177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1393, pipe: [1:7556255758862697722:4741]
2025-10-01T14:11:31.913886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:31.914521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:31.914579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697722:4741], now have 1 active actors on pipe
2025-10-01T14:11:31.914666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:31.914730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255758862697722:4741]
2025-10-01T14:11:31.914763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:31.924658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:31.924675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:31.924722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1394 reason: error at write: Disconnected sessionId: src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0
2025-10-01T14:11:31.924868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1394 sessionId: src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0 is DEAD
2025-10-01T14:11:31.924971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:31.924983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0] Write session will restart in 0.008219s
2025-10-01T14:11:31.925006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0] Write session: Do CDS request
2025-10-01T14:11:31.925013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:31.932213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:31.933901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.934023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:31.934040Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1395
2025-10-01T14:11:31.934167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:31.934199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:31.934209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:31.934216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:31.934576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1395 sessionId:  describe result for acl check
2025-10-01T14:11:31.934609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:31.934615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:31.934617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:31.934622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255758862697913:3819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:31.934639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:31.934846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:31.934856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:31.934867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:31.934921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:31.934957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255756485817438:9708]
2025-10-01T14:11:31.935307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255758862697913:3819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:31.935520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:31.935802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:31.935851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:31.936148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:31.936212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.936218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.936220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.936221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.936222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.936224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.936225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.936226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.936228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.936229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.936230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.936231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.936232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.936233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.936238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.936247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.936251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.936255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.936263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.936267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.936271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.936274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.936278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.936283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.936290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.936294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.936298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.936301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.936308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.936315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:31.936320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.936325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:31.936334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.936339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:31.936347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.936356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:31.936365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.936374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:31.936382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.936391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:31.936400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.936409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:31.936417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.936426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:31.936434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.936443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:31.936451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.936459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.936467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.936475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.936483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.936492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.936500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.936509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:31.936517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.936526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:31.936567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:31.937326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255758862697913:3819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:31.940158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255758862697913:3819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:31.940180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255758862697913:3819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:31.940184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255758862697913:3819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:31.940193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:31.940275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:31.941111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:31.941130Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:31.941132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:31.941136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:31.941143Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1394 [2:7556255756485817438:9708]
2025-10-01T14:11:31.941158Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:31.941180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:31.941188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.941191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.941197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.941212Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:31.941222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:31.941228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:31.941292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.941300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.941303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.941306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:31.941308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:31.941374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:31.941381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.941393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:31.941408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:31.941428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:31.941452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697951:3819], now have 1 active actors on pipe
2025-10-01T14:11:31.941458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255758862697725:2446], now have 1 active actors on pipe
2025-10-01T14:11:31.941459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1394
2025-10-01T14:11:31.941466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255756485817433:9708]
2025-10-01T14:11:31.941474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255756485817433:9708]
2025-10-01T14:11:31.941476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255756485817433:9708]
2025-10-01T14:11:31.941488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:31.941501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:31.941501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:31.941503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:31.941492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1394
2025-10-01T14:11:31.941505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:31.941515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:31.941518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:31.941536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.941546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.941589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255756485817433:9708]
2025-10-01T14:11:31.941605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:31.941614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:31.941620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:31.941627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:31.941631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:31.941639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:31.941648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:31.941661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:31.941705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.941829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.941838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.941854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:31.941922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1395 partition: 0 MaxSeqNo: 45 sessionId: src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0
2025-10-01T14:11:31.942264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75f0db3e-37470f1c-8c94a1e6-81363ef7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:31.944699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0] Write session: try to update token
2025-10-01T14:11:31.944718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:31.958264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1395 sessionId: src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:31.960455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:31.960699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:31.960722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:31.962357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:31.962405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:31.962413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:31.962415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:31.962416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:31.962423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255756485817433:9708]
2025-10-01T14:11:31.962430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255756485817433:9708]
2025-10-01T14:11:31.962433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255756485817433:9708]
2025-10-01T14:11:31.962452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:31.962462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:31.962464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:31.962465Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:31.962469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:31.962470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:31.962509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:31.962576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:32.014626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255763157665254:4741]
2025-10-01T14:11:32.014956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1394, pipe: [1:7556255763157665254:4741]
2025-10-01T14:11:32.098838Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:32.105613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.105636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.105774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.105830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.105885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.105937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.106134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.106142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.106198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.106252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.106305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.106361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.106421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.106427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.106480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.106527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.106579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.106628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.106664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.106669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.106719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.106857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.106909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.106975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.107018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.107022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.107074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.107119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.107170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.107220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.107257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.107262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.107323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.107372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.107426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.107481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.107521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.107526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.107580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.107629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.107682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.107732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.107769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.107773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.107824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.107876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.107927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.107983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.108024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.108030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.108086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.108140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.108194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.108248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.108288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.108292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.108348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.108399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.108452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.108504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.108544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.108550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.108593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665254:4741], now have 1 active actors on pipe
2025-10-01T14:11:32.108910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:32.108923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:32.108940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255763157665254:4741]
2025-10-01T14:11:32.108950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1395 reason: error at write: Disconnected sessionId: src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0
2025-10-01T14:11:32.108971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:32.108979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:32.109149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1395 sessionId: src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0 is DEAD
2025-10-01T14:11:32.109320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:32.109332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0] Write session will restart in 0.009579s
2025-10-01T14:11:32.109357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0] Write session: Do CDS request
2025-10-01T14:11:32.109363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:32.119967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.120227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:32.120244Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1396
2025-10-01T14:11:32.120368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.120398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:32.120404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:32.120408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:32.120791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1396 sessionId:  describe result for acl check
2025-10-01T14:11:32.120821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:32.120828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:32.120830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:32.120834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255763157665337:3802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:32.121299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255763157665337:3802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:32.124457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255763157665337:3802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:32.127438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255763157665337:3802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:32.127455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255763157665337:3802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:32.127458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255763157665337:3802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:32.127466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:32.130338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:32.133641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:32.133853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:32.133864Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:32.133871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:32.133916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:32.133958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255760780784992:9721]
2025-10-01T14:11:32.134467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:32.134786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:32.134822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:32.135053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:32.135096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.135101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.135102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.135103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.135104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.135105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.135106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.135107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.135107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.135108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.135109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.135110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.135111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.135112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.135115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.135121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.135123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.135126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.135128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.135131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.135133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.135135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.135138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.135140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.135142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.135144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.135147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.135150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.135155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.135160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.135164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.135167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.135170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.135173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.135175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.135179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.135183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.135186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.135189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.135192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.135195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.135198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.135201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.135205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.135208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.135211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.135214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.135218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.135224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.135228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.135234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.135238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.135243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.135249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.135253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.135259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.135284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:32.139398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:32.140294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:32.140310Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:32.140312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:32.140317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:32.140323Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1395 [2:7556255760780784992:9721]
2025-10-01T14:11:32.140340Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:32.140362Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:32.140370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.140373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.140375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.140390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:32.140400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:32.140411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:32.140473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.140481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.140483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.140486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:32.140490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:32.140559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:32.140567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.140580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.140596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.140618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:32.140640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665492:3802], now have 1 active actors on pipe
2025-10-01T14:11:32.140648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665272:2446], now have 1 active actors on pipe
2025-10-01T14:11:32.140655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255760780784987:9721]
2025-10-01T14:11:32.140662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255760780784987:9721]
2025-10-01T14:11:32.140664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255760780784987:9721]
2025-10-01T14:11:32.140691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:32.140708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:32.140708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:32.140713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:32.140716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:32.140722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:32.140728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:32.140753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255760780784987:9721]
2025-10-01T14:11:32.140763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:32.140775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:32.140786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1395
2025-10-01T14:11:32.140788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1395
2025-10-01T14:11:32.140895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.140903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.140925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:32.140936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.140946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.140948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:32.140958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.140972Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:32.140992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.141927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.141942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.141962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.142109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1396 partition: 0 MaxSeqNo: 45 sessionId: src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0
2025-10-01T14:11:32.142486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b86fbd1f-4f8befaf-192446bf-1fbab09e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:32.144824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0] Write session: try to update token
2025-10-01T14:11:32.144839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:32.158331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1396 sessionId: src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:32.160925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:32.162166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.162192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.162210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:32.162213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:32.162214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:32.162216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:32.162222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255760780784987:9721]
2025-10-01T14:11:32.162225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255760780784987:9721]
2025-10-01T14:11:32.162228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255760780784987:9721]
2025-10-01T14:11:32.162275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:32.162280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:32.162286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:32.162287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.162288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:32.162289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:32.162429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:32.209199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255763157665507:4741]
2025-10-01T14:11:32.209443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1395, pipe: [1:7556255763157665507:4741]
2025-10-01T14:11:32.300841Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:32.301474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:32.301520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665507:4741], now have 1 active actors on pipe
2025-10-01T14:11:32.301596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:32.301677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255763157665507:4741]
2025-10-01T14:11:32.301706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:32.301731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:32.301738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:32.301749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1396 reason: error at write: Disconnected sessionId: src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0
2025-10-01T14:11:32.301903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1396 sessionId: src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0 is DEAD
2025-10-01T14:11:32.302013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:32.302021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0] Write session will restart in 0.009795s
2025-10-01T14:11:32.302046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0] Write session: Do CDS request
2025-10-01T14:11:32.302055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:32.312912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.313024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:32.313041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1397
2025-10-01T14:11:32.313163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.313198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:32.313210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:32.313215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:32.313566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1397 sessionId:  describe result for acl check
2025-10-01T14:11:32.313601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:32.313607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:32.313609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:32.313614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255763157665664:3797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:32.314147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255763157665664:3797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:32.315787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255763157665664:3797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:32.316429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:32.320215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:32.320415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255763157665664:3797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:32.320429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255763157665664:3797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:32.320433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255763157665664:3797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:32.320434Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:32.320449Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:32.320460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:32.320441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:32.320506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:32.320545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255760780785219:9723]
2025-10-01T14:11:32.321151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:32.321435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:32.321463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:32.321675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:32.321730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.321737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.321738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.321739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.321740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.321742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.321743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.321744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.321745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.321747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.321748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.321749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.321750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.321751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.321755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.321765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.321768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.321772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.321776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.321779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.321783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.321787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.321791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.321795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.321800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.321803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.321807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.321811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.321817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.321825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.321835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.321840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.321845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.321854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.321862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.321872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.321881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.321887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.321892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.321897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.321901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.321910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.321918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.321926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.321934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.321943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.321952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.321961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.321969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.321978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.321985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.321994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.322002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.322011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.322017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.322022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.322063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:32.326100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:32.326885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:32.326897Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:32.326899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:32.326902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:32.326906Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1396 [2:7556255760780785219:9723]
2025-10-01T14:11:32.326917Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:32.326930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:32.326935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.326937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.326939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.326951Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:32.326959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:32.326963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:32.327016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.327024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.327025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.327029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:32.327031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:32.327093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:32.327099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.327110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.327116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.327128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:32.327147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665509:2446], now have 1 active actors on pipe
2025-10-01T14:11:32.327156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665733:3797], now have 1 active actors on pipe
2025-10-01T14:11:32.327165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255760780785213:9723]
2025-10-01T14:11:32.327170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255760780785213:9723]
2025-10-01T14:11:32.327172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255760780785213:9723]
2025-10-01T14:11:32.327186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:32.327201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:32.327206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:32.327209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:32.327212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:32.327219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:32.327222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:32.327254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255760780785213:9723]
2025-10-01T14:11:32.327264Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:32.327278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:32.327269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1396
2025-10-01T14:11:32.327319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.327326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.327275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1396
2025-10-01T14:11:32.327344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:32.327353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.327357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.327359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:32.327365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.327375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:32.327388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.327547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.327553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.327563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.327636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1397 partition: 0 MaxSeqNo: 45 sessionId: src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0
2025-10-01T14:11:32.327987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd4e3964-4ba2dd27-f052552c-708b247d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:32.330288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0] Write session: try to update token
2025-10-01T14:11:32.330303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:32.343388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1397 sessionId: src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:32.345630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:32.345858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.345881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.345932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:32.346034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:32.350017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:32.350039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:32.350041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:32.350043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:32.350051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255760780785213:9723]
2025-10-01T14:11:32.350056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255760780785213:9723]
2025-10-01T14:11:32.350059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255760780785213:9723]
2025-10-01T14:11:32.350107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:32.350113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:32.350119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.350120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:32.350122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:32.350124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:32.350248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:32.401699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255763157665750:4741]
2025-10-01T14:11:32.402071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1396, pipe: [1:7556255763157665750:4741]
2025-10-01T14:11:32.490089Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:32.497630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.497657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.497818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.497889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.497956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.498056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.498100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.498108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.498180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.498244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.498307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.498396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.498450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.498461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.498531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.498606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.498681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.498749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.498796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.498805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.498874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.498943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.499011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.499080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.499315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.499326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.499395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.499516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.499585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.499651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.499696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.499704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.499767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.499823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.499883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.499952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.499994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.499999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.500059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.500113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.500170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.500229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.500272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.500280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.500339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.500393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.500459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.500520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.500565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.500570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.500631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.500701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.500767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.500834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.500880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.500887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.500964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.501028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.501093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.501155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.501197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.501203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.501264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665750:4741], now have 1 active actors on pipe
2025-10-01T14:11:32.501522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255763157665750:4741]
2025-10-01T14:11:32.501535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:32.501561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:32.501564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:32.501596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1397 reason: error at write: Disconnected sessionId: src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0
2025-10-01T14:11:32.501947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:32.501958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0] Write session will restart in 0.006802s
2025-10-01T14:11:32.501982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0] Write session: Do CDS request
2025-10-01T14:11:32.501989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:32.502124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1397 sessionId: src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0 is DEAD
2025-10-01T14:11:32.502411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:32.509857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.509983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:32.509997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1398
2025-10-01T14:11:32.510102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.510126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:32.510133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:32.510136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:32.510470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1398 sessionId:  describe result for acl check
2025-10-01T14:11:32.510497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:32.510501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:32.510502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:32.510507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255763157665770:3794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:32.510892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255763157665770:3794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:32.513718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255763157665770:3794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:32.518819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255763157665770:3794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:32.518833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255763157665770:3794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:32.518837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255763157665770:3794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:32.518845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:32.521023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:32.523928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:32.524133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:32.524144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:32.524154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:32.524197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:32.524229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255760780785450:9725]
2025-10-01T14:11:32.524903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:32.525291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:32.525352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:32.525714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:32.525796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.525797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.525798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.525800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.525801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.525802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.525804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.525822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.525824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.525825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.525826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.525827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.525828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.525830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.525836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.525846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.525851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.525854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.525858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.525862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.525866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.525869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.525874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.525878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.525881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.525885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.525889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.525892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.525900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.525908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.525914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.525919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.525924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.525929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.525934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.525939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.525944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.525949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.525953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.525958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.525963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.525968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.525972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.525977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.525982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.525987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.525994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.525999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.526008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.526014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.526018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.526023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.526027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.526033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.526038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.526043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.526081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:32.532574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:32.533646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:32.533671Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:32.533675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:32.533681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:32.533688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1397 [2:7556255760780785450:9725]
2025-10-01T14:11:32.533706Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:32.533731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:32.533740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.533744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.533751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.533771Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:32.533781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:32.533790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:32.533869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.533880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.533883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.533886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:32.533890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:32.533969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:32.533984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.533997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.534008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.534030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:32.534056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665961:3794], now have 1 active actors on pipe
2025-10-01T14:11:32.534067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665755:2446], now have 1 active actors on pipe
2025-10-01T14:11:32.534076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255760780785445:9725]
2025-10-01T14:11:32.534078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255760780785445:9725]
2025-10-01T14:11:32.534080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255760780785445:9725]
2025-10-01T14:11:32.534100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:32.534121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:32.534119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:32.534123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:32.534126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:32.534140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:32.534110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1397
2025-10-01T14:11:32.534145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:32.534120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1397
2025-10-01T14:11:32.534186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255760780785445:9725]
2025-10-01T14:11:32.534200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:32.534207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:32.534224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.534235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.534293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:32.534304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.534309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.534312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:32.534325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.534341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:32.534365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.534570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.534582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.534599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.534690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1398 partition: 0 MaxSeqNo: 45 sessionId: src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0
2025-10-01T14:11:32.535046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd72a-fee9668d-28f316e4-9c9d2372_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:32.537601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0] Write session: try to update token
2025-10-01T14:11:32.537620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:32.551662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1398 sessionId: src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:32.554008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:32.554232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.554260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.554298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:32.554414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:32.557777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:32.557797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:32.557800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:32.557802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:32.557810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255760780785445:9725]
2025-10-01T14:11:32.557818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255760780785445:9725]
2025-10-01T14:11:32.557822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255760780785445:9725]
2025-10-01T14:11:32.557872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:32.557878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.557881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:32.557881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:32.557887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:32.557890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:32.558013Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:32.601869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255763157665992:4741]
2025-10-01T14:11:32.602226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1397, pipe: [1:7556255763157665992:4741]
2025-10-01T14:11:32.704009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:32.712768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.712796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.712963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.713029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.713090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.713155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.713199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.713214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.713289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.713350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.713415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.713479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.713528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.713540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.713616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.713671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.713730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.713786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.713827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.713835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.713895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.713953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.714013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.714069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.714110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.714117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.714170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.714223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.714281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.714339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.714393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.714401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.714460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.714514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.714578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.714646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.714690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.714697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.714758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.714815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.714878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.714937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.714980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.714987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.715046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.715105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.715164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.715226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.715269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.715276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.715342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.715403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.715466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.715529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.715572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.715579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.715647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:32.715707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:32.715768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:32.715827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:32.715870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:32.715877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:32.715941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157665992:4741], now have 1 active actors on pipe
2025-10-01T14:11:32.716219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255763157665992:4741]
2025-10-01T14:11:32.716283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:32.716293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:32.716326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1398 reason: error at write: Disconnected sessionId: src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0
2025-10-01T14:11:32.716512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1398 sessionId: src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0 is DEAD
2025-10-01T14:11:32.716685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:32.716696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0] Write session will restart in 0.007530s
2025-10-01T14:11:32.716722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0] Write session: Do CDS request
2025-10-01T14:11:32.716729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:32.716860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:32.717121Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:32.726019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.726113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:32.726130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1399
2025-10-01T14:11:32.726229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.726260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:32.726270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:32.726274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:32.726888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1399 sessionId:  describe result for acl check
2025-10-01T14:11:32.726930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:32.726936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:32.726938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:32.726943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255763157666087:3777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:32.727391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255763157666087:3777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:32.729560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255763157666087:3777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:32.732309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255763157666087:3777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:32.732322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255763157666087:3777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:32.732325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255763157666087:3777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:32.732333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:32.732383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:32.735213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:32.735415Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:32.735425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:32.735436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:32.735478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:32.735518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255760780785679:9728]
2025-10-01T14:11:32.736119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:32.736387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:32.736428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:32.736736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:32.736788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.736794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.736795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.736797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.736798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.736799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.736800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.736801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.736802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.736803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.736804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.736805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.736806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.736807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.736813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.736821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.736825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.736829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.736832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.736835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.736839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.736843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.736847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.736851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.736855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.736858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.736862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.736866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.736876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.736883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.736889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.736895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.736899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.736910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.736914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.736918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.736927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.736932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.736941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.736946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.736951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.736956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.736964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.736969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.736978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.736982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.736985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.736990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.736998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.737003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.737007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.737016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.737020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.737030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.737034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.737039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.737083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:32.740866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:32.741460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:32.741474Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:32.741476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:32.741480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:32.741487Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1398 [2:7556255760780785679:9728]
2025-10-01T14:11:32.741501Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:32.741517Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:32.741524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.741528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.741530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.741545Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:32.741556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:32.741562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:32.741616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.741623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.741625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.741629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:32.741632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:32.741701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:32.741710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.741722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.741733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.741751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:32.741777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157666232:3777], now have 1 active actors on pipe
2025-10-01T14:11:32.741787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157666008:2446], now have 1 active actors on pipe
2025-10-01T14:11:32.741794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255760780785673:9728]
2025-10-01T14:11:32.741796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255760780785673:9728]
2025-10-01T14:11:32.741799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255760780785673:9728]
2025-10-01T14:11:32.741811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:32.741825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:32.741833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:32.741836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:32.741839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:32.741844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:32.741847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:32.741830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1398
2025-10-01T14:11:32.741865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1398
2025-10-01T14:11:32.741886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.741896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.741910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255760780785673:9728]
2025-10-01T14:11:32.741921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:32.741928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:32.741949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:32.741961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.741966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.741968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:32.741976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.741986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:32.742012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.742341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.742350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.742363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.742454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1399 partition: 0 MaxSeqNo: 45 sessionId: src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0
2025-10-01T14:11:32.742840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8938904f-ca2a1742-f31cdead-bd106f8f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:32.745284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0] Write session: try to update token
2025-10-01T14:11:32.745302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:32.762843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1399 sessionId: src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:32.765031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:32.765051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:32.765053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:32.765055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:32.765062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255760780785673:9728]
2025-10-01T14:11:32.765066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255760780785673:9728]
2025-10-01T14:11:32.765069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255760780785673:9728]
2025-10-01T14:11:32.765116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:32.765117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:32.765120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:32.765123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:32.765124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.765127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:32.765257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:32.765409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:32.816435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255763157666260:4741]
2025-10-01T14:11:32.817368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1398, pipe: [1:7556255763157666260:4741]
2025-10-01T14:11:32.916152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:32.916948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.916964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.917006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157666260:4741], now have 1 active actors on pipe
2025-10-01T14:11:32.917206Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:32.918048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:32.918086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255763157666260:4741]
2025-10-01T14:11:32.918102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:32.918165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1399 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0
2025-10-01T14:11:32.918351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1399 sessionId: src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0 is DEAD
2025-10-01T14:11:32.918503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:32.918514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0] Write session will restart in 0.006905s
2025-10-01T14:11:32.918542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0] Write session: Do CDS request
2025-10-01T14:11:32.918549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:32.926867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.926891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:32.926906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1400
2025-10-01T14:11:32.927063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:32.927098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:32.927107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:32.927111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:32.927496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1400 sessionId:  describe result for acl check
2025-10-01T14:11:32.927548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:32.927555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:32.927557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:32.927564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255763157666338:3124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:32.928094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255763157666338:3124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:32.931300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255763157666338:3124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:32.933758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:32.936084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:32.936277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:32.936288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:32.936299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:32.936325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255763157666338:3124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:32.936357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:32.936342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255763157666338:3124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:32.936346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255763157666338:3124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:32.936355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:32.936395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255760780785928:9733]
2025-10-01T14:11:32.936996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:32.937248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:32.937297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:32.937603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:32.937676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.937685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.937686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.937687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.937688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.937689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.937690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.937691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.937693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.937694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.937695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.937696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.937697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.937698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.937704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.937714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.937718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.937722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.937726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.937729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.937733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.937737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.937741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.937745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.937749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.937752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.937761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.937765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.937775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.937783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:32.937792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.937802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:32.937806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.937815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:32.937823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.937828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:32.937838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.937843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:32.937851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.937856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:32.937861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.937870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:32.937879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.937888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:32.937897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.937906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:32.937914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.937923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.937932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.937941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.937949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.937958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.937967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.937976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:32.937985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.937994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:32.938034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:32.941744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:32.942458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:32.942476Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:32.942479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:32.942482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:32.942491Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1399 [2:7556255760780785928:9733]
2025-10-01T14:11:32.942507Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:32.942526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:32.942529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.942532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.942536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.942554Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:32.942565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:32.942572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:32.942633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.942642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.942645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.942648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:32.942651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:32.942730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:32.942739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.942751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:32.942765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:32.942780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:32.942821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157666263:2446], now have 1 active actors on pipe
2025-10-01T14:11:32.942829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255763157666491:3124], now have 1 active actors on pipe
2025-10-01T14:11:32.942837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255760780785923:9733]
2025-10-01T14:11:32.942844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255760780785923:9733]
2025-10-01T14:11:32.942846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255760780785923:9733]
2025-10-01T14:11:32.942859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:32.942877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:32.942878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:32.942887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:32.942890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:32.942891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:32.942894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:32.942873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1399
2025-10-01T14:11:32.942928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255760780785923:9733]
2025-10-01T14:11:32.942940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:32.942936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1399
2025-10-01T14:11:32.942950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:32.943470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1400 partition: 0 MaxSeqNo: 45 sessionId: src_id|c1c1371-55720ecd-5b689467-6c8a982a_0
2025-10-01T14:11:32.943093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.943106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.943132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1c1371-55720ecd-5b689467-6c8a982a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:32.943140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:32.943144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:32.943147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:32.943157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:32.943168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:32.943183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.943368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.943372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.943388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:32.943887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f51e7a6f-7b994f0e-470dcb63-8d008299_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c1c1371-55720ecd-5b689467-6c8a982a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:32.946735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c1371-55720ecd-5b689467-6c8a982a_0] Write session: try to update token
2025-10-01T14:11:32.946760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c1371-55720ecd-5b689467-6c8a982a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:32.964837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:32.964873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:32.964883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255760780785923:9733]
2025-10-01T14:11:32.964940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:32.964958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:32.965132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:32.965280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:32.965448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:32.965588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:32.965598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1400 sessionId: src_id|c1c1371-55720ecd-5b689467-6c8a982a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:32.965786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:32.965828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:32.968094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:32.968309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:32.968329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:32.968366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:32.968457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:32.980026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:32.980048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:32.980051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:32.980053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:32.980064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255760780785923:9733]
2025-10-01T14:11:32.980069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255760780785923:9733]
2025-10-01T14:11:32.980074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255760780785923:9733]
2025-10-01T14:11:32.980122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:32.980130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:32.980136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:32.980142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:32.980159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:32.980165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:32.980265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:33.018137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255767452633798:4741]
2025-10-01T14:11:33.018399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1399, pipe: [1:7556255767452633798:4741]
2025-10-01T14:11:33.130219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:33.139401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.139440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.139628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.139707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.139786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.139860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.139915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.139927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.140008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.140073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.140148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.140216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.140268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.140279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.140353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.140417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.140485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.140553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.140600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.140609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.140692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.140760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.140826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.140893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.140963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.140973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.141041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.141103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.141168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.141231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.141278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.141286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.141357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.141423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.141495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.141571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.141628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.141637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.141706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.141775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.141842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.141910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.141958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.141966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.142034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.142098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.142166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.142232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.142282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.142289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.142358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.142449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.142516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.142586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.142636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.142644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.142717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.142784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.142856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.142930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.142978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.142986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.143065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452633798:4741], now have 1 active actors on pipe
2025-10-01T14:11:33.143310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:33.143341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255767452633798:4741]
2025-10-01T14:11:33.143357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:33.143362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:33.143390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1400 reason: error at write: Disconnected sessionId: src_id|c1c1371-55720ecd-5b689467-6c8a982a_0
2025-10-01T14:11:33.143610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1400 sessionId: src_id|c1c1371-55720ecd-5b689467-6c8a982a_0 is DEAD
2025-10-01T14:11:33.143704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c1371-55720ecd-5b689467-6c8a982a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:33.143712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c1371-55720ecd-5b689467-6c8a982a_0] Write session will restart in 0.008760s
2025-10-01T14:11:33.143738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c1371-55720ecd-5b689467-6c8a982a_0] Write session: Do CDS request
2025-10-01T14:11:33.143744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c1371-55720ecd-5b689467-6c8a982a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:33.144623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:33.154014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c1371-55720ecd-5b689467-6c8a982a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.153996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:33.154022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1401
2025-10-01T14:11:33.154257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.154304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:33.154314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:33.154317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:33.154758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1401 sessionId:  describe result for acl check
2025-10-01T14:11:33.154793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:33.154799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:33.154801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:33.154807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255767452633884:3754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:33.155343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255767452633884:3754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:33.158431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255767452633884:3754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:33.161036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:33.161082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255767452633884:3754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:33.161095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255767452633884:3754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:33.161100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255767452633884:3754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:33.161107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:33.163605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:33.163790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:33.163799Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:33.163807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:33.163842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:33.163869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255765075753488:9746]
2025-10-01T14:11:33.164277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:33.164580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:33.164611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:33.164836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:33.164880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.164886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.164887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.164889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.164890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.164891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.164892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.164893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.164894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.164895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.164896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.164898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.164899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.164900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.164905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.164912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.164914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.164916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.164918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.164921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.164922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.164924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.164926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.164928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.164930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.164932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.164934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.164936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.164943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.164947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.164951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.164954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.164956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.164960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.164962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.164965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.164968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.164971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.164974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.164977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.164979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.164982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.164987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.164990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.164992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.164995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.164998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.165001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.165004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.165009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.165012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.165014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.165017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.165019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.165022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.165025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.165050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:33.168779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:33.169313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:33.169327Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:33.169328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:33.169331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:33.169336Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1400 [2:7556255765075753488:9746]
2025-10-01T14:11:33.169346Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:33.169359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:33.169361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.169363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.169365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.169376Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:33.169380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:33.169384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:33.169423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.169428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.169430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.169432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:33.169434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:33.169495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:33.169501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.169512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.169524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.169542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:33.169564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634040:3754], now have 1 active actors on pipe
2025-10-01T14:11:33.169572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452633813:2446], now have 1 active actors on pipe
2025-10-01T14:11:33.169577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255765075753482:9746]
2025-10-01T14:11:33.169579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255765075753482:9746]
2025-10-01T14:11:33.169580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255765075753482:9746]
2025-10-01T14:11:33.169591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:33.169603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:33.169609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:33.169609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:33.169611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:33.169622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:33.169629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:33.169657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255765075753482:9746]
2025-10-01T14:11:33.169667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:33.169675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:33.169667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1400
2025-10-01T14:11:33.169668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1400
2025-10-01T14:11:33.169984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.169999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.170027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:33.170039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.170044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.170046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:33.170056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.170065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:33.170083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.170224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.170231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.170244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.170324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1401 partition: 0 MaxSeqNo: 45 sessionId: src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0
2025-10-01T14:11:33.170662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1c1371-55720ecd-5b689467-6c8a982a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:33.172871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0] Write session: try to update token
2025-10-01T14:11:33.172882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:33.181159Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:33.181181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:33.181192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255765075753482:9746]
2025-10-01T14:11:33.181239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:33.181241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:33.181425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:33.181560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:33.181705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:33.181845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:33.182046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:33.182093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:33.186347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1401 sessionId: src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:33.188844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:33.189104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.189128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.189179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:33.189269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:33.200807Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:33.200825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:33.200827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:33.200829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:33.200837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255765075753482:9746]
2025-10-01T14:11:33.200841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255765075753482:9746]
2025-10-01T14:11:33.200843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255765075753482:9746]
2025-10-01T14:11:33.200879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:33.200883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:33.200885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.200886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:33.200888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:33.200891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:33.201004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:33.243453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255767452634053:4741]
2025-10-01T14:11:33.243728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1400, pipe: [1:7556255767452634053:4741]
2025-10-01T14:11:33.345667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:33.352784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.352810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.352949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.353002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.353057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.353116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.353166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.353176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.353250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.353310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.353366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.353424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.353470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.353477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.353531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.353584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.353645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.353710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.353754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.353762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.353825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.353887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.353942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.353992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.354031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.354036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.354088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.354134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.354187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.354239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.354277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.354284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.354338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.354409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.354469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.354525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.354572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.354583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.354653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.354712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.354779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.354843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.354890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.354898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.354955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.355050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.355113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.355183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.355243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.355250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.355326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.355392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.355452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.355516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.355577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.355584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.355659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:33.355729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:33.355793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:33.355859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:33.355903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:33.355914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:33.355970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634053:4741], now have 1 active actors on pipe
2025-10-01T14:11:33.356351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255767452634053:4741]
2025-10-01T14:11:33.356378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:33.356382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:33.356397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:33.356412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1401 reason: error at write: Disconnected sessionId: src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0
2025-10-01T14:11:33.356434Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:11:33.356534Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 14 consumer shared/user session shared/user_1_14_4131961218445180696_v1 is DEAD
2025-10-01T14:11:33.356605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1401 sessionId: src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0 is DEAD
2025-10-01T14:11:33.356749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:33.356759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0] Write session will restart in 0.008558s
2025-10-01T14:11:33.356777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0] Write session: Do CDS request
2025-10-01T14:11:33.356783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:33.356840Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:11:33.356945Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:11:33.356950Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:11:33.356954Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.009821s
2025-10-01T14:11:33.357053Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255660078431138:4738] disconnected; active server actors: 1
2025-10-01T14:11:33.357064Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255660078431138:4738] client user disconnected session shared/user_1_14_4131961218445180696_v1
2025-10-01T14:11:33.357151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:33.366810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.366905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:33.366922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1402
2025-10-01T14:11:33.367043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.367075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:33.367085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:33.367088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:33.367558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1402 sessionId:  describe result for acl check
2025-10-01T14:11:33.367593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:33.367599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:33.367600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:33.367607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255767452634148:3755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:33.367640Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:11:33.367731Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:11:33.367738Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 15
2025-10-01T14:11:33.367852Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 15 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:11:33.367900Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:11:33.367976Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 auth for : user
2025-10-01T14:11:33.368065Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 Handle describe topics response
2025-10-01T14:11:33.368073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255767452634148:3755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:33.368087Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 auth is DEAD
2025-10-01T14:11:33.368106Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:11:33.368339Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:11:33.368401Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255767452634176:3752] connected; active server actors: 1
2025-10-01T14:11:33.368416Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255767452634176:3752] session shared/user_1_15_13077327908926673721_v1
2025-10-01T14:11:33.368431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:11:33.368445Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_15_13077327908926673721_v1
2025-10-01T14:11:33.368445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:11:33.368452Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_15_13077327908926673721_v1" (Sender=[1:7556255767452634151:3752], Pipe=[1:7556255767452634176:3752], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:11:33.368457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:11:33.368467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:11:33.368476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_15_13077327908926673721_v1" (Sender=[1:7556255767452634151:3752], Pipe=[1:7556255767452634176:3752], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:11:33.368490Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_15_13077327908926673721_v1" sender [1:7556255767452634151:3752] lock partition 0 for ReadingSession "shared/user_1_15_13077327908926673721_v1" (Sender=[1:7556255767452634151:3752], Pipe=[1:7556255767452634176:3752], Partitions=[], ActiveFamilyCount=1) generation 1 step 15
2025-10-01T14:11:33.368508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:11:33.368517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000046s
2025-10-01T14:11:33.368737Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 15 Session: "shared/user_1_15_13077327908926673721_v1" ClientId: "user" PipeClient { RawX1: 7556255767452634176 RawX2: 4503603922341544 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:11:33.368769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:11:33.370751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255767452634148:3755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:33.372154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:33.374497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:33.374685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:33.374697Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:33.374708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:33.374754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:33.374790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255765075753720:9748]
2025-10-01T14:11:33.374882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255767452634148:3755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:33.374893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255767452634148:3755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:33.374895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255767452634148:3755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:33.374900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:33.375355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:33.375599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:33.375637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:33.375919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:33.375970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.375975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.375977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.375978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.375979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.375980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.375981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.375982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.375983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.375984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.375986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.375986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.375987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.375988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.375992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.376001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.376003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.376007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.376010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.376013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.376015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.376018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.376021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.376025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.376027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.376030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.376032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.376035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.376041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.376047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.376052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.376058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.376066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.376070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.376077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.376081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.376088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.376092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.376095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.376099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.376106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.376112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.376115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.376123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.376131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.376138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.376145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.376149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.376157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.376165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.376173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.376182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.376190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.376198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.376206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.376214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.376254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:33.379784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:33.380741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:33.380758Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:33.380761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:33.380764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:33.380771Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1401 [2:7556255765075753720:9748]
2025-10-01T14:11:33.380784Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:33.380800Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:33.380808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.380812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.380814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.380830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:33.380839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:33.380845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:33.380902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.380908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.380910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.380913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:33.380915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:33.380976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:33.380982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.380992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.381002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.381021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:33.381044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255765075753715:9748]
2025-10-01T14:11:33.381045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255765075753715:9748]
2025-10-01T14:11:33.381048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255765075753715:9748]
2025-10-01T14:11:33.381061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:33.381072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:33.381074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634295:3755], now have 1 active actors on pipe
2025-10-01T14:11:33.381077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634198:3745], now have 1 active actors on pipe
2025-10-01T14:11:33.381079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634055:2446], now have 1 active actors on pipe
2025-10-01T14:11:33.381082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:33.381084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:33.381086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:33.381099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:33.381101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:33.381126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255765075753715:9748]
2025-10-01T14:11:33.381135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:33.381137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:33.381112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1401
2025-10-01T14:11:33.381151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.381159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.381133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1401
2025-10-01T14:11:33.381149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1401, pipe: [1:7556255767452634198:3745]
2025-10-01T14:11:33.381201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.381208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.381215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_15_13077327908926673721_v1 on pipe: [1:7556255767452634198:3745]
2025-10-01T14:11:33.381242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|316d8634-8fa75a39-dc518fe-b461fb36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:33.381253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.381254Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_15_13077327908926673721_v1:1 with generation 1401
2025-10-01T14:11:33.381256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.381258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:33.381268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.381280Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:33.381299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.381307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.381309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:33.381324Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_15_13077327908926673721_v1
2025-10-01T14:11:33.381333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.381358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.381374Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:11:33.381469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.381475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.381487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.381552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1402 partition: 0 MaxSeqNo: 45 sessionId: src_id|316d8634-8fa75a39-dc518fe-b461fb36_0
2025-10-01T14:11:33.381878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dfa7da4-bbab5cec-39d1c66a-dfdce163_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|316d8634-8fa75a39-dc518fe-b461fb36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:33.384225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316d8634-8fa75a39-dc518fe-b461fb36_0] Write session: try to update token
2025-10-01T14:11:33.384246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316d8634-8fa75a39-dc518fe-b461fb36_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:33.385593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:11:33.385625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:11:33.385636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.385637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.385639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.385645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:11:33.385655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:11:33.385788Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327893381 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:11:33.385809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:11:33.385845Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 sending to client partition status
2025-10-01T14:11:33.397337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1402 sessionId: src_id|316d8634-8fa75a39-dc518fe-b461fb36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:33.399749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:33.401473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.401499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.401523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:33.401527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:33.401529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:33.401531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:33.401540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255765075753715:9748]
2025-10-01T14:11:33.401545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255765075753715:9748]
2025-10-01T14:11:33.401549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255765075753715:9748]
2025-10-01T14:11:33.401592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:33.401606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:33.401607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:33.401611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:33.401614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.401616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:33.401747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:33.535641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:33.535946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:33.536052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:33.536091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_15_13077327908926673721_v1
2025-10-01T14:11:33.536131Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_15_13077327908926673721_v1
2025-10-01T14:11:33.536147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:33.536153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:33.536170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:33.536194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255767452634198:3745]
2025-10-01T14:11:33.536238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1402 reason: error at write: Disconnected sessionId: src_id|316d8634-8fa75a39-dc518fe-b461fb36_0
2025-10-01T14:11:33.536386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1402 sessionId: src_id|316d8634-8fa75a39-dc518fe-b461fb36_0 is DEAD
2025-10-01T14:11:33.536476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d8634-8fa75a39-dc518fe-b461fb36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:33.536483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d8634-8fa75a39-dc518fe-b461fb36_0] Write session will restart in 0.006840s
2025-10-01T14:11:33.536501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d8634-8fa75a39-dc518fe-b461fb36_0] Write session: Do CDS request
2025-10-01T14:11:33.536505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d8634-8fa75a39-dc518fe-b461fb36_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:33.545144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|316d8634-8fa75a39-dc518fe-b461fb36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.545209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:33.545228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1403
2025-10-01T14:11:33.545351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.545383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:33.545392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:33.545396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:33.545796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1403 sessionId:  describe result for acl check
2025-10-01T14:11:33.545828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:33.545835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:33.545836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:33.545842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255767452634370:3739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:33.546342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255767452634370:3739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:33.548829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255767452634370:3739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:33.551230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255767452634370:3739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:33.551258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255767452634370:3739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:33.551261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255767452634370:3739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:33.551269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:33.551687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:33.553789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:33.553981Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:33.554006Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:33.554016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:33.554060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:33.554101Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255765075753958:9751]
2025-10-01T14:11:33.554657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:33.554951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:33.555000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:33.555312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:33.555367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.555368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.555369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.555370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.555371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.555372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.555373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.555374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.555375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.555376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.555377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.555378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.555379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.555380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.555385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.555395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.555398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.555401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.555405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.555408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.555411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.555414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.555417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.555421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.555424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.555427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.555431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.555434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.555440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.555447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.555453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.555458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.555463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.555468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.555472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.555476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.555480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.555485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.555489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.555494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.555498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.555503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.555508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.555512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.555516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.555521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.555525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.555529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.555533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.555537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.555541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.555545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.555549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.555553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.555556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.555560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.555591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:33.559218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:33.559782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:33.559798Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:33.559801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:33.559805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:33.559811Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1402 [2:7556255765075753958:9751]
2025-10-01T14:11:33.559825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:33.559842Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:33.559850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.559854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.559856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.559871Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:33.559880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:33.559886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:33.559936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.559943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.559945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.559948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:33.559951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:33.560013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:33.560020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.560032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.560048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.560066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:33.560194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1402
2025-10-01T14:11:33.560212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1402
2025-10-01T14:11:33.560087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634542:3739], now have 1 active actors on pipe
2025-10-01T14:11:33.560094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634312:2446], now have 1 active actors on pipe
2025-10-01T14:11:33.560101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255765075753953:9751]
2025-10-01T14:11:33.560102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255765075753953:9751]
2025-10-01T14:11:33.560104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255765075753953:9751]
2025-10-01T14:11:33.560116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:33.560131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:33.560144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:33.560146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:33.560149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:33.560153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:33.560155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:33.560177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255765075753953:9751]
2025-10-01T14:11:33.560179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:33.560182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:33.560269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.560274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.560301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:33.560307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.560310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.560312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:33.560321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.560331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:33.560350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.560554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.560569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.560591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.560719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1403 partition: 0 MaxSeqNo: 45 sessionId: src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0
2025-10-01T14:11:33.561253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|316d8634-8fa75a39-dc518fe-b461fb36_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:33.563686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0] Write session: try to update token
2025-10-01T14:11:33.563705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:33.577393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1403 sessionId: src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:33.580051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:33.580294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.580323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.580344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:33.580348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:33.580351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:33.580352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:33.580360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255765075753953:9751]
2025-10-01T14:11:33.580365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255765075753953:9751]
2025-10-01T14:11:33.580374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255765075753953:9751]
2025-10-01T14:11:33.580402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:33.580415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:33.580417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:33.580426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:33.580433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.580440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:33.580559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:33.636156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255767452634555:3745]
2025-10-01T14:11:33.636413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1402, pipe: [1:7556255767452634555:3745]
2025-10-01T14:11:33.723043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:33.723476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:33.723527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634555:3745], now have 1 active actors on pipe
2025-10-01T14:11:33.723593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:33.723751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255767452634555:3745]
2025-10-01T14:11:33.723781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:33.732798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:33.732812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:33.732834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1403 reason: error at write: Disconnected sessionId: src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0
2025-10-01T14:11:33.732982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1403 sessionId: src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0 is DEAD
2025-10-01T14:11:33.733135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:33.733145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0] Write session will restart in 0.009088s
2025-10-01T14:11:33.733175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0] Write session: Do CDS request
2025-10-01T14:11:33.733182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:33.742776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:33.743920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.744015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:33.744033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1404
2025-10-01T14:11:33.744234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.744278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:33.744289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:33.744295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:33.744699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1404 sessionId:  describe result for acl check
2025-10-01T14:11:33.744736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:33.744741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:33.744743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:33.744748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255767452634755:3736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:33.745244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255767452634755:3736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:33.745569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:33.745817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:33.745832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:33.745844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:33.745900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:33.745939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255765075754191:9753]
2025-10-01T14:11:33.746542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:33.746833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:33.746887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:33.747202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:33.747266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.747271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.747273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.747274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.747275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.747276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.747277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.747278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.747280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.747281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.747282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.747284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.747285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.747286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.747292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.747301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.747305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.747309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.747313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.747317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.747321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.747324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.747328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.747332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.747336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.747340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.747349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.747352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.747360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.747373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.747384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.747389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.747394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.747399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.747403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.747408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.747412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.747417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.747426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.747431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.747437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.747442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.747447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.747452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.747457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.747462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.747442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255767452634755:3736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:33.747466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.747474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.747478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.747481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.747484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.747487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.747489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.747492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.747494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.747497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.747518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:33.751322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255767452634755:3736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:33.751341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255767452634755:3736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:33.751345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255767452634755:3736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:33.751353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:33.751454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:33.752393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:33.752410Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:33.752412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:33.752415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:33.752422Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1403 [2:7556255765075754191:9753]
2025-10-01T14:11:33.752438Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:33.752453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:33.752461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.752464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.752466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.752481Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:33.752487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:33.752497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:33.752551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.752563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.752565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.752568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:33.752570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:33.752638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:33.752646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.752657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.752673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.752704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:33.752725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634558:2446], now have 1 active actors on pipe
2025-10-01T14:11:33.752734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634805:3736], now have 1 active actors on pipe
2025-10-01T14:11:33.752740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255765075754186:9753]
2025-10-01T14:11:33.752745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255765075754186:9753]
2025-10-01T14:11:33.752747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255765075754186:9753]
2025-10-01T14:11:33.752759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:33.752772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:33.752779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:33.752782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:33.752759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1403
2025-10-01T14:11:33.752787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:33.752792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1403
2025-10-01T14:11:33.752787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:33.752790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:33.752825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255765075754186:9753]
2025-10-01T14:11:33.752832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:33.752836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:33.752853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.752862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.752905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:33.752919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.752923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.752925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:33.752934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.752943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:33.752959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.753110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.753118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.753130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.753204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1404 partition: 0 MaxSeqNo: 45 sessionId: src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0
2025-10-01T14:11:33.753537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84a17cf8-3349f86c-338b9043-b7ab65f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:33.755986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0] Write session: try to update token
2025-10-01T14:11:33.756005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:33.772578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1404 sessionId: src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:33.773247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:33.773271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:33.773274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:33.773275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:33.773283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255765075754186:9753]
2025-10-01T14:11:33.773288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255765075754186:9753]
2025-10-01T14:11:33.773292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255765075754186:9753]
2025-10-01T14:11:33.773342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:33.773343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:33.773349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:33.773350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.773352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:33.773353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:33.773484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:33.774877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:33.824039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255767452634824:3745]
2025-10-01T14:11:33.824263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1403, pipe: [1:7556255767452634824:3745]
2025-10-01T14:11:33.930987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:33.931427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.931437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.931478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634824:3745], now have 1 active actors on pipe
2025-10-01T14:11:33.931761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:33.931780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255767452634824:3745]
2025-10-01T14:11:33.931803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:33.931806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:33.931861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1404 reason: error at write: Disconnected sessionId: src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0
2025-10-01T14:11:33.932242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:33.932254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0] Write session will restart in 0.005103s
2025-10-01T14:11:33.932081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1404 sessionId: src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0 is DEAD
2025-10-01T14:11:33.932281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0] Write session: Do CDS request
2025-10-01T14:11:33.932287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:33.932223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:33.938937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.939068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:33.939084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1405
2025-10-01T14:11:33.939569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:33.939614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:33.939619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:33.939623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:33.940074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1405 sessionId:  describe result for acl check
2025-10-01T14:11:33.940112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:33.940119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:33.940121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:33.940126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255767452634846:3711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:33.940986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255767452634846:3711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:33.943787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255767452634846:3711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:33.946985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255767452634846:3711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:33.947000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255767452634846:3711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:33.947003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255767452634846:3711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:33.947012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:33.949348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:33.952190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:33.952643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:33.952654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:33.952667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:33.952735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:33.952768Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255765075754449:9758]
2025-10-01T14:11:33.953442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:33.953737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:33.953774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:33.954049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:33.954160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.954168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.954169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.954170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.954171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.954173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.954174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.954175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.954177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.954178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.954179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.954180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.954182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.954183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.954189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.954199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.954203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.954207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.954210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.954214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.954217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.954220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.954223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.954227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.954230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.954234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.954238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.954241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.954249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.954256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:33.954261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.954266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:33.954270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.954275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:33.954279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.954283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:33.954288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.954293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:33.954297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.954300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:33.954303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.954306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:33.954310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.954312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:33.954315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.954318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:33.954323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.954326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.954328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.954331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.954333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.954336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.954340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.954343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:33.954346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.954348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:33.954381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:33.958046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:33.958944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:33.958960Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:33.958963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:33.958966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:33.958972Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1404 [2:7556255765075754449:9758]
2025-10-01T14:11:33.958989Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:33.959010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:33.959017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.959020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.959026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.959042Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:33.959056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:33.959069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:33.959132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.959141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.959143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.959147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:33.959150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:33.959219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:33.959230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.959240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:33.959251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:33.959267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:33.959286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452635047:3711], now have 1 active actors on pipe
2025-10-01T14:11:33.959295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255767452634827:2446], now have 1 active actors on pipe
2025-10-01T14:11:33.959302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255765075754444:9758]
2025-10-01T14:11:33.959307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255765075754444:9758]
2025-10-01T14:11:33.959309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255765075754444:9758]
2025-10-01T14:11:33.959323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:33.959337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:33.959341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:33.959350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:33.959352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:33.959355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:33.959357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:33.959349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1404
2025-10-01T14:11:33.959382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255765075754444:9758]
2025-10-01T14:11:33.959390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:33.959392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:33.959407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.959352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1404
2025-10-01T14:11:33.959412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.959452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1edf158-4a3161a7-fc59cc30-da37599b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:33.959461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:33.959464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:33.959466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:33.959472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:33.959483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:33.959501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.959670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.959681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.959698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:33.959781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1405 partition: 0 MaxSeqNo: 45 sessionId: src_id|1edf158-4a3161a7-fc59cc30-da37599b_0
2025-10-01T14:11:33.960085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35f38fea-e7402b11-66b159a3-1d0c6fee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1edf158-4a3161a7-fc59cc30-da37599b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:33.962451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1edf158-4a3161a7-fc59cc30-da37599b_0] Write session: try to update token
2025-10-01T14:11:33.962466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1edf158-4a3161a7-fc59cc30-da37599b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:33.976408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1405 sessionId: src_id|1edf158-4a3161a7-fc59cc30-da37599b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:33.978813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:33.979067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:33.979090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:33.979130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:33.979201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:33.984343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:33.984366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:33.984369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:33.984371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:33.984381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255765075754444:9758]
2025-10-01T14:11:33.984385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255765075754444:9758]
2025-10-01T14:11:33.984389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255765075754444:9758]
2025-10-01T14:11:33.984439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:33.984447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:33.984450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:33.984453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:33.984454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:33.984457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:33.984598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:34.031929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255771747602366:3745]
2025-10-01T14:11:34.032232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1404, pipe: [1:7556255771747602366:3745]
2025-10-01T14:11:34.128560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:34.135773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.135804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.135972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.136034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.136104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.136161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.136209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.136214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.136289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.136393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.136453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.136518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.136557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.136560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.136641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.136708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.136770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.136829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.137394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.137402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.137466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.137518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.137570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.137622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.137658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.137660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.137714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.137767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.137823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.137880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.137922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.137927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.137988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.138039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.138091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.138148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.138200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.138202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.138259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.138308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.138364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.138572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.138620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.138622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.138680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.138736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.138792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.138851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.138894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.138900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.138968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.139026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.139085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.139145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.139189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.139195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.139262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.139323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.139381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.139444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.139495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.139502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.139558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747602366:3745], now have 1 active actors on pipe
2025-10-01T14:11:34.139859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:34.139874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:34.139882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:34.139901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1405 reason: error at write: Disconnected sessionId: src_id|1edf158-4a3161a7-fc59cc30-da37599b_0
2025-10-01T14:11:34.139950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255771747602366:3745]
2025-10-01T14:11:34.140093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1405 sessionId: src_id|1edf158-4a3161a7-fc59cc30-da37599b_0 is DEAD
2025-10-01T14:11:34.140135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:34.140236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edf158-4a3161a7-fc59cc30-da37599b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:34.140248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edf158-4a3161a7-fc59cc30-da37599b_0] Write session will restart in 0.007401s
2025-10-01T14:11:34.140275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edf158-4a3161a7-fc59cc30-da37599b_0] Write session: Do CDS request
2025-10-01T14:11:34.140281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edf158-4a3161a7-fc59cc30-da37599b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:34.148961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1edf158-4a3161a7-fc59cc30-da37599b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.149026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:34.149041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1406
2025-10-01T14:11:34.149194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.149227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:34.149233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:34.149237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:34.149642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1406 sessionId:  describe result for acl check
2025-10-01T14:11:34.149681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:34.149689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:34.149690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:34.149707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255771747602417:3707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:34.150216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255771747602417:3707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:34.152251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255771747602417:3707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:34.155250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255771747602417:3707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:34.155264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255771747602417:3707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:34.155267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255771747602417:3707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:34.155274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:34.157238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:34.159745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:34.159967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:34.159981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:34.159992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:34.160045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:34.160085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255769370722011:9771]
2025-10-01T14:11:34.160691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:34.160992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:34.161041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:34.161333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:34.161394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.161401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.161402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.161403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.161404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.161405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.161406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.161408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.161409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.161410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.161411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.161413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.161414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.161415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.161420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.161430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.161433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.161437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.161441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.161444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.161448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.161451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.161454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.161458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.161461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.161464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.161468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.161471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.161479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.161486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.161492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.161498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.161502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.161507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.161512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.161517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.161522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.161527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.161531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.161537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.161542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.161547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.161551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.161555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.161559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.161564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.161568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.161574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.161578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.161589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.161593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.161598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.161607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.161612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.161616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.161620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.161663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:34.165959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:34.166882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:34.166901Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:34.166904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:34.166907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:34.166913Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1405 [2:7556255769370722011:9771]
2025-10-01T14:11:34.166934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:34.166952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:34.166961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:34.166964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:34.166966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:34.166979Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:34.166983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:34.166987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:34.167045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.167051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.167053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.167055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:34.167058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:34.167116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:34.167124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.167132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.167137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.167146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:34.167167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255769370722006:9771]
2025-10-01T14:11:34.167174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255769370722006:9771]
2025-10-01T14:11:34.167176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255769370722006:9771]
2025-10-01T14:11:34.167190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:34.167202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:34.167207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747602383:2446], now have 1 active actors on pipe
2025-10-01T14:11:34.167213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:34.167214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747602601:3707], now have 1 active actors on pipe
2025-10-01T14:11:34.167215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:34.167219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:34.167231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:34.167235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:34.167265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255769370722006:9771]
2025-10-01T14:11:34.167277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:34.167282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:34.167261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1405
2025-10-01T14:11:34.167311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1405
2025-10-01T14:11:34.167340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.167349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.167372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:34.167383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:34.167386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:34.167388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:34.167397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:34.167406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:34.167424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:34.167584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.167593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.167608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:34.167689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1406 partition: 0 MaxSeqNo: 45 sessionId: src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0
2025-10-01T14:11:34.168068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1edf158-4a3161a7-fc59cc30-da37599b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:34.170511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0] Write session: try to update token
2025-10-01T14:11:34.170529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:34.185051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1406 sessionId: src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:34.187376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:34.187597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.187621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.187653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:34.187732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:34.189823Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:34.189850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:34.189853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:34.189854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:34.189866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255769370722006:9771]
2025-10-01T14:11:34.189871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255769370722006:9771]
2025-10-01T14:11:34.189875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255769370722006:9771]
2025-10-01T14:11:34.189915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:34.189920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:34.189927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.189929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:34.189930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:34.189935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:34.190054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:34.240306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255771747602625:3745]
2025-10-01T14:11:34.240556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1405, pipe: [1:7556255771747602625:3745]
2025-10-01T14:11:34.332889Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:34.340629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.340657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.340836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.340898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.340956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.341023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.341072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.341082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.341154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.341218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.341281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.341351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.341396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.341403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.341464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.341522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.341582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.341639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.341687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.341699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.341765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.341833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.341898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.341974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.342027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.342036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.342105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.342181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.342261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.342353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.342415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.342423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.342485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.342553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.342623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.342691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.344302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:34.344315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:34.344342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1406 reason: error at write: Disconnected sessionId: src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0
2025-10-01T14:11:34.344375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255771747602625:3745]
2025-10-01T14:11:34.344410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:34.344509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1406 sessionId: src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0 is DEAD
2025-10-01T14:11:34.344668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:34.344712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0] Write session will restart in 0.007914s
2025-10-01T14:11:34.344738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0] Write session: Do CDS request
2025-10-01T14:11:34.344744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:34.342739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.342751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.342816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.342867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.342930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.343004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.343048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.343053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.343118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.343177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.343234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.343293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.343333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.343335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.343409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.343470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.343531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.343601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.343648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.343651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.343721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.343785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.343846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.343905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.343948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.343951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.344027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747602625:3745], now have 1 active actors on pipe
2025-10-01T14:11:34.345161Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:34.354271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.354359Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:34.354418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1407
2025-10-01T14:11:34.354577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.354616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:34.354626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:34.354638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:34.355049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1407 sessionId:  describe result for acl check
2025-10-01T14:11:34.355084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:34.355090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:34.355092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:34.355097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255771747602691:3705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:34.355593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255771747602691:3705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:34.358764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255771747602691:3705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:34.361804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255771747602691:3705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:34.361815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255771747602691:3705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:34.361817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255771747602691:3705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:34.361823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:34.363017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:34.365739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:34.365921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:34.365930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:34.365938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:34.365979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:34.366016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255769370722248:9773]
2025-10-01T14:11:34.366459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:34.366733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:34.366782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:34.367012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:34.367058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.367065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.367066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.367067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.367068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.367069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.367070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.367071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.367072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.367073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.367074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.367075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.367076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.367077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.367081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.367091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.367094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.367098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.367101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.367104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.367107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.367110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.367114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.367118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.367120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.367124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.367127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.367130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.367137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.367144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.367149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.367154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.367158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.367163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.367167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.367172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.367177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.367181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.367185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.367190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.367200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.367203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.367205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.367208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.367211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.367214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.367216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.367219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.367221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.367225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.367228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.367230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.367233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.367235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.367238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.367241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.367265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:34.370719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:34.371318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:34.371332Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:34.371334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:34.371337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:34.371342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1406 [2:7556255769370722248:9773]
2025-10-01T14:11:34.371352Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:34.371365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:34.371367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:34.371369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:34.371371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:34.371385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:34.371391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:34.371402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:34.371449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.371454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.371456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.371459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:34.371461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:34.371511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:34.371516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.371523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.371529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.371542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:34.371556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255769370722243:9773]
2025-10-01T14:11:34.371562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255769370722243:9773]
2025-10-01T14:11:34.371563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255769370722243:9773]
2025-10-01T14:11:34.371572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:34.371581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:34.371584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:34.371585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:34.371586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:34.371593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:34.371595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:34.371603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747602860:3705], now have 1 active actors on pipe
2025-10-01T14:11:34.371613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747602629:2446], now have 1 active actors on pipe
2025-10-01T14:11:34.371632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255769370722243:9773]
2025-10-01T14:11:34.371637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:34.371649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:34.371653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1406
2025-10-01T14:11:34.371661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1406
2025-10-01T14:11:34.371699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.371706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.371728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|560679d3-f16a245d-efdf429c-4300cff7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:34.371738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:34.371742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:34.371745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:34.371753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:34.371761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:34.371775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:34.371907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.371914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.371926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:34.372018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1407 partition: 0 MaxSeqNo: 45 sessionId: src_id|560679d3-f16a245d-efdf429c-4300cff7_0
2025-10-01T14:11:34.372390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aceffb88-d2819e70-36baee4-f4e7c6f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|560679d3-f16a245d-efdf429c-4300cff7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:34.374822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|560679d3-f16a245d-efdf429c-4300cff7_0] Write session: try to update token
2025-10-01T14:11:34.374841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|560679d3-f16a245d-efdf429c-4300cff7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:34.389651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1407 sessionId: src_id|560679d3-f16a245d-efdf429c-4300cff7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:34.391896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:34.393072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.393099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.393119Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:34.393123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:34.393125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:34.393127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:34.393135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255769370722243:9773]
2025-10-01T14:11:34.393140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255769370722243:9773]
2025-10-01T14:11:34.393145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255769370722243:9773]
2025-10-01T14:11:34.393187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:34.393200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:34.393203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:34.393204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:34.393208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.393211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:34.393356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:34.444588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255771747602883:3745]
2025-10-01T14:11:34.444896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1406, pipe: [1:7556255771747602883:3745]
2025-10-01T14:11:34.545013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:34.545479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:34.545538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747602883:3745], now have 1 active actors on pipe
2025-10-01T14:11:34.545628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:34.545691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255771747602883:3745]
2025-10-01T14:11:34.545705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:34.545707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:34.545721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:34.545770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1407 reason: error at write: Disconnected sessionId: src_id|560679d3-f16a245d-efdf429c-4300cff7_0
2025-10-01T14:11:34.545929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1407 sessionId: src_id|560679d3-f16a245d-efdf429c-4300cff7_0 is DEAD
2025-10-01T14:11:34.546046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560679d3-f16a245d-efdf429c-4300cff7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:34.546055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560679d3-f16a245d-efdf429c-4300cff7_0] Write session will restart in 0.005243s
2025-10-01T14:11:34.546074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560679d3-f16a245d-efdf429c-4300cff7_0] Write session: Do CDS request
2025-10-01T14:11:34.546081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560679d3-f16a245d-efdf429c-4300cff7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:34.552895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|560679d3-f16a245d-efdf429c-4300cff7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.552980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:34.552996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1408
2025-10-01T14:11:34.553104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.553143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:34.553154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:34.553157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:34.553594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1408 sessionId:  describe result for acl check
2025-10-01T14:11:34.553632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:34.553640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:34.553642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:34.553647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255771747602907:3698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:34.554189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255771747602907:3698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:34.556542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255771747602907:3698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:34.559775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255771747602907:3698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:34.559790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255771747602907:3698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:34.559794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255771747602907:3698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:34.559802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:34.562335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:34.564769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:34.564962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:34.564972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:34.564984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:34.565027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:34.565073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255769370722488:9776]
2025-10-01T14:11:34.565462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:34.565692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:34.565728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:34.565980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:34.566045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.566052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.566053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.566054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.566056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.566057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.566059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.566060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.566061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.566062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.566072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.566073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.566073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.566074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.566078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.566084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.566086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.566088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.566090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.566093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.566095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.566097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.566099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.566101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.566104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.566106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.566108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.566110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.566117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.566121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.566125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.566136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.566139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.566142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.566144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.566147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.566151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.566154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.566157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.566160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.566162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.566165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.566168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.566171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.566174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.566177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.566180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.566182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.566185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.566188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.566191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.566194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.566197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.566200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.566202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.566205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.566227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:34.570160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:34.570955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:34.570980Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:34.570984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:34.570989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:34.570997Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1407 [2:7556255769370722488:9776]
2025-10-01T14:11:34.571015Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:34.571033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:34.571036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:34.571041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:34.571043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:34.571058Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:34.571072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:34.571080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:34.571143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.571151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.571152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.571156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:34.571158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:34.571229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:34.571237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.571250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.571262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.571281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:34.571305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747603081:3698], now have 1 active actors on pipe
2025-10-01T14:11:34.571313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747602886:2446], now have 1 active actors on pipe
2025-10-01T14:11:34.571320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255769370722483:9776]
2025-10-01T14:11:34.571322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255769370722483:9776]
2025-10-01T14:11:34.571324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255769370722483:9776]
2025-10-01T14:11:34.571337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:34.571357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:34.571357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:34.571360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:34.571362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:34.571375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:34.571379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:34.571412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255769370722483:9776]
2025-10-01T14:11:34.571427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:34.571433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:34.571452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1407
2025-10-01T14:11:34.571470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1407
2025-10-01T14:11:34.571544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.571562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.571593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:34.571607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:34.571620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:34.571628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:34.571643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:34.571658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:34.571691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:34.571848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.571860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.571884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:34.571966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1408 partition: 0 MaxSeqNo: 45 sessionId: src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0
2025-10-01T14:11:34.572328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|560679d3-f16a245d-efdf429c-4300cff7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:34.574890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0] Write session: try to update token
2025-10-01T14:11:34.574906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:34.587245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:34.587265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:34.587274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255769370722483:9776]
2025-10-01T14:11:34.587322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:34.587341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:34.587490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:34.587628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:34.587756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:34.587887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:34.588132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:34.588179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:34.591295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1408 sessionId: src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:34.593699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:34.593895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.593919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.593957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:34.594066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:34.601559Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:34.601582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:34.601585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:34.601587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:34.601596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255769370722483:9776]
2025-10-01T14:11:34.601600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255769370722483:9776]
2025-10-01T14:11:34.601603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255769370722483:9776]
2025-10-01T14:11:34.601647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:34.601653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:34.601658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.601659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:34.601660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:34.601663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:34.601776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:34.645819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255771747603132:3745]
2025-10-01T14:11:34.646103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1407, pipe: [1:7556255771747603132:3745]
2025-10-01T14:11:34.754112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:34.763178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.763215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.763381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.763449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.763505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.763564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.763608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.763614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.763678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.763736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.763790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.763956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.763998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.764001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.764070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.764132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.764197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.764260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.764302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.764305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.764375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.764438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.764499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.764558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.764729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.764733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.764802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.764857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.764913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.764969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.765006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.765010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.765075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.765133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.765198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.765262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.765396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.765402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.765467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.765521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.765579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.765638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.765675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.765678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.765744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.765799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.765852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.765910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.766043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.766047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.766113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.766169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.766226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.766285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.766321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.766324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.766410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:34.766466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:34.766521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:34.766576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:34.766615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:34.766618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:34.766682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747603132:3745], now have 1 active actors on pipe
2025-10-01T14:11:34.766888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:34.766899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255771747603132:3745]
2025-10-01T14:11:34.766901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:34.766915Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:34.766924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1408 reason: error at write: Disconnected sessionId: src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0
2025-10-01T14:11:34.767083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1408 sessionId: src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0 is DEAD
2025-10-01T14:11:34.767521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:34.767533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0] Write session will restart in 0.006257s
2025-10-01T14:11:34.767558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0] Write session: Do CDS request
2025-10-01T14:11:34.767564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:34.767750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:34.774882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.774967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:34.774983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1409
2025-10-01T14:11:34.779032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.779084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:34.779091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:34.779096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:34.779506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1409 sessionId:  describe result for acl check
2025-10-01T14:11:34.779545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:34.779551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:34.779553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:34.779561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255771747603254:3693] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:34.780068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255771747603254:3693] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:34.783353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255771747603254:3693] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:34.784275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:34.787224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:34.787486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:34.787499Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:34.787512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:34.787565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:34.787609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255769370722727:9778]
2025-10-01T14:11:34.788120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:34.788422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:34.788410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255771747603254:3693] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:34.788428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255771747603254:3693] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:34.788431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255771747603254:3693] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:34.788439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:34.788476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:34.788771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:34.788828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.788835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.788836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.788837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.788838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.788839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.788840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.788840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.788841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.788842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.788843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.788843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.788844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.788845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.788849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.788855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.788858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.788860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.788863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.788865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.788867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.788870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.788872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.788875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.788877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.788879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.788881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.788883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.788889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.788894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:34.788897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.788900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:34.788903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.788906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:34.788908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.788912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:34.788914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.788918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:34.788920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.788923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:34.788926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.788929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:34.788931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.788934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:34.788936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.788939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:34.788942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.788944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.788947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.788950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.788952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.788955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.788958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.788961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:34.788964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.788967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:34.788988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:34.793022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:34.794140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:34.794157Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:34.794159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:34.794163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:34.794172Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1408 [2:7556255769370722727:9778]
2025-10-01T14:11:34.794186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:34.794202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:34.794205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:34.794209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:34.794211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:34.794228Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:34.794238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:34.794243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:34.794301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.794308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.794311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.794314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:34.794316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:34.794395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:34.794402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.794415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:34.794429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:34.794448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:34.794468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255769370722722:9778]
2025-10-01T14:11:34.794474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255769370722722:9778]
2025-10-01T14:11:34.794476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255769370722722:9778]
2025-10-01T14:11:34.794490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:34.794501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:34.794511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747603376:3693], now have 1 active actors on pipe
2025-10-01T14:11:34.794512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:34.794514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:34.794516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747603135:2446], now have 1 active actors on pipe
2025-10-01T14:11:34.794523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:34.794537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:34.794540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:34.794572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255769370722722:9778]
2025-10-01T14:11:34.794584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:34.794589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:34.798470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1408
2025-10-01T14:11:34.798507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1408
2025-10-01T14:11:34.798692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.798712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.798743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:34.798758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:34.798763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:34.798765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:34.798776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:34.798790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:34.798812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:34.802276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.802297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.802325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:34.806745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1409 partition: 0 MaxSeqNo: 45 sessionId: src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0
2025-10-01T14:11:34.807112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb589bc1-ee8b415-d18a59d8-c6cbe376_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:34.808699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:34.808725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:34.808736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255769370722722:9778]
2025-10-01T14:11:34.808785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:34.808793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:34.809110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:34.809328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:34.809585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:34.809607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0] Write session: try to update token
2025-10-01T14:11:34.809625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:34.809843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:34.810197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:34.810255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:34.826596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1409 sessionId: src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:34.827613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:34.827634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:34.827637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:34.827639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:34.827648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255769370722722:9778]
2025-10-01T14:11:34.827654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255769370722722:9778]
2025-10-01T14:11:34.827657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255769370722722:9778]
2025-10-01T14:11:34.827702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:34.827707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:34.827714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:34.827716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:34.827718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:34.827722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:34.827847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:34.828904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:34.867003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255771747603406:3745]
2025-10-01T14:11:34.870703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1408, pipe: [1:7556255771747603406:3745]
2025-10-01T14:11:34.986189Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:34.986515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:34.986531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:34.986552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747603406:3745], now have 1 active actors on pipe
2025-10-01T14:11:34.986748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:34.986773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:34.986808Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:34.986810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255771747603406:3745]
2025-10-01T14:11:34.986816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:34.986874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1409 reason: error at write: Disconnected sessionId: src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0
2025-10-01T14:11:34.987093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1409 sessionId: src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0 is DEAD
2025-10-01T14:11:34.987239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:34.987250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0] Write session will restart in 0.007325s
2025-10-01T14:11:34.987279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0] Write session: Do CDS request
2025-10-01T14:11:34.987285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:34.995873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.995989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:34.996006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1410
2025-10-01T14:11:34.996116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:34.996147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:34.996156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:34.996159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:34.996579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1410 sessionId:  describe result for acl check
2025-10-01T14:11:34.996623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:34.996629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:34.996631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:34.996637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255771747603436:3677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:34.997358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255771747603436:3677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:34.999587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255771747603436:3677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:35.002523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255771747603436:3677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:35.002536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255771747603436:3677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:35.002538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255771747603436:3677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:35.002544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:35.004751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:35.007284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:35.007486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:35.007498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:35.007509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:35.007555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:35.007592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255773665690286:9784]
2025-10-01T14:11:35.008139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:35.008463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:35.008515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:35.008842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:35.008925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.008932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.008933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.008934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.008936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.008937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.008938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.008939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.008940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.008941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.008942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.008943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.008944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.008945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.008952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.008962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.008966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.008971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.008974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.008978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.008982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.008985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.008989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.008993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.008997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.009001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.009009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.009016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.009024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.009035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.009046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.009056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.009064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.009070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.009079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.009088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.009097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.009102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.009110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.009119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.009126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.009135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.009143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.009149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.009154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.009161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.009170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.009179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.009188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.009196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.009205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.009214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.009220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.009228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.009236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.009242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.009282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:35.013068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:35.013751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:35.013766Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:35.013769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:35.013773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:35.013780Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1409 [2:7556255773665690286:9784]
2025-10-01T14:11:35.013804Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:35.013825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:35.013832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.013836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.013843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.013859Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:35.013868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:35.013875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:35.013934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.013944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.013946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.013950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:35.013953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:35.014023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:35.014031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.014043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.014055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.014076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:35.014098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255771747603412:2446], now have 1 active actors on pipe
2025-10-01T14:11:35.014104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042570912:3677], now have 1 active actors on pipe
2025-10-01T14:11:35.014111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255773665690281:9784]
2025-10-01T14:11:35.014113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255773665690281:9784]
2025-10-01T14:11:35.014115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255773665690281:9784]
2025-10-01T14:11:35.014129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:35.014143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:35.014144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:35.014146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:35.014148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:35.014158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:35.014161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:35.014190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255773665690281:9784]
2025-10-01T14:11:35.014202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:35.014190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1409
2025-10-01T14:11:35.014222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:35.014194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1409
2025-10-01T14:11:35.014241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.014250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.014277Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:35.014289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.014293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.014295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:35.014305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.014315Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:35.014333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.014519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.014530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.014548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.014642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1410 partition: 0 MaxSeqNo: 45 sessionId: src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0
2025-10-01T14:11:35.015006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|340501c4-d3c4b3a5-53f28bf6-73f4a69d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:35.017516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0] Write session: try to update token
2025-10-01T14:11:35.017534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:35.025174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:35.025199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:35.025210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255773665690281:9784]
2025-10-01T14:11:35.025252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:35.025256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:35.025613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:35.025818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:35.025959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:35.026096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:35.026389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:35.026441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:35.031813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1410 sessionId: src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:35.034443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:35.034640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.034660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.034693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:35.034772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:35.043575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:35.043590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:35.043592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:35.043593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:35.043603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255773665690281:9784]
2025-10-01T14:11:35.043607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255773665690281:9784]
2025-10-01T14:11:35.043611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255773665690281:9784]
2025-10-01T14:11:35.043664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:35.043675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.043677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:35.043799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:35.045639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:35.045652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:35.045655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:35.087132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255776042570954:3745]
2025-10-01T14:11:35.087349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1409, pipe: [1:7556255776042570954:3745]
2025-10-01T14:11:35.191181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:35.199652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.199686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.199880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.199951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.200022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.200092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.200147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.200153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.200225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.200286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.200347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.200410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.200457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.200460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.200541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.200673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.200760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.200830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.200875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.200878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.200957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.201024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.201086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.201155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.201199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.201202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.201276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.201341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.201403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.201468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.201513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.201517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.201591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.201659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.201734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.201804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.201942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.201946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.202023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.202089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.202157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.202226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.202270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.202273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.202352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.202630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.202709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.202780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.202975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.202988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.203059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.203129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.203202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.203275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.203324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.203333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.203407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:35.203478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:35.203546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:35.203621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:35.203668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:35.203676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:35.203744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042570954:3745], now have 1 active actors on pipe
2025-10-01T14:11:35.203965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:35.203968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255776042570954:3745]
2025-10-01T14:11:35.203993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:35.203996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:35.204022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1410 reason: error at write: Disconnected sessionId: src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0
2025-10-01T14:11:35.204207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1410 sessionId: src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0 is DEAD
2025-10-01T14:11:35.204356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:35.204367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0] Write session will restart in 0.007041s
2025-10-01T14:11:35.204391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0] Write session: Do CDS request
2025-10-01T14:11:35.204396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:35.205088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:35.214847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:35.214978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:35.214998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1411
2025-10-01T14:11:35.215113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:35.215142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:35.215163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:35.215168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:35.215867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1411 sessionId:  describe result for acl check
2025-10-01T14:11:35.215906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:35.215908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:35.215909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:35.215915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255776042571021:3667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:35.216646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255776042571021:3667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:35.218750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255776042571021:3667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:35.221679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255776042571021:3667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:35.221694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255776042571021:3667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:35.221698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255776042571021:3667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:35.221706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:35.224194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:35.227082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:35.227431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:35.227445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:35.227460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:35.227523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:35.227568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255773665690557:9796]
2025-10-01T14:11:35.228162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:35.228478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:35.228518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:35.228836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:35.228901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.228907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.228908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.228909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.228911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.228912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.228913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.228914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.228915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.228916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.228918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.228919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.228920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.228922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.228927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.228938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.228942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.228946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.228950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.228954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.228957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.228961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.228965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.228970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.228974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.228977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.228981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.228984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.228991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.228999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.229005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.229010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.229016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.229021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.229025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.229031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.229038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.229043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.229052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.229056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.229061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.229066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.229072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.229081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.229085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.229090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.229094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.229102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.229106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.229111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.229116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.229121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.229124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.229133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.229137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.229141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.229176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:35.233352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:35.234317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:35.234333Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:35.234336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:35.234339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:35.234347Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1410 [2:7556255773665690557:9796]
2025-10-01T14:11:35.234362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:35.234397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:35.234400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.234404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.234407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.234423Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:35.234428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:35.234435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:35.234503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.234511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.234513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.234517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:35.234520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:35.234588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:35.234594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.234607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.234620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.234641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:35.234665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042570975:2446], now have 1 active actors on pipe
2025-10-01T14:11:35.234672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042571188:3667], now have 1 active actors on pipe
2025-10-01T14:11:35.234680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255773665690552:9796]
2025-10-01T14:11:35.234687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255773665690552:9796]
2025-10-01T14:11:35.234690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255773665690552:9796]
2025-10-01T14:11:35.234705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:35.234723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:35.234743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:35.234750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:35.234778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255773665690552:9796]
2025-10-01T14:11:35.234786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:35.234832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:35.234842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:35.234844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:35.234851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:35.234812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1410
2025-10-01T14:11:35.234936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1410
2025-10-01T14:11:35.234961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.234973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.235019Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:35.235032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.235040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.235045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:35.235057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.235071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:35.235091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.235610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.235620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.235642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.235781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1411 partition: 0 MaxSeqNo: 45 sessionId: src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0
2025-10-01T14:11:35.236150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f63a969-57a48bf6-184ab7ea-a8f92254_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:35.238742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0] Write session: try to update token
2025-10-01T14:11:35.238758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:35.254267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1411 sessionId: src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:35.256884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:35.256901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:35.256904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:35.256905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:35.256915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255773665690552:9796]
2025-10-01T14:11:35.256919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255773665690552:9796]
2025-10-01T14:11:35.256922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255773665690552:9796]
2025-10-01T14:11:35.256970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:35.256973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:35.256978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.256980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:35.256981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:35.256984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:35.257122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:35.257419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:35.304247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255776042571223:3745]
2025-10-01T14:11:35.308592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1410, pipe: [1:7556255776042571223:3745]
2025-10-01T14:11:35.407125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:35.407435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.407451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.407495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042571223:3745], now have 1 active actors on pipe
2025-10-01T14:11:35.407850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:35.407861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255776042571223:3745]
2025-10-01T14:11:35.407888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:35.407891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:35.407944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1411 reason: error at write: Disconnected sessionId: src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0
2025-10-01T14:11:35.408123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1411 sessionId: src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0 is DEAD
2025-10-01T14:11:35.407823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:35.408563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:35.408575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0] Write session will restart in 0.007730s
2025-10-01T14:11:35.408602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0] Write session: Do CDS request
2025-10-01T14:11:35.408608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:35.418059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:35.418152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:35.418169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1412
2025-10-01T14:11:35.418465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:35.418510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:35.418522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:35.418526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:35.418967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1412 sessionId:  describe result for acl check
2025-10-01T14:11:35.419005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:35.419012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:35.419014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:35.419020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255776042571266:3655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:35.419570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255776042571266:3655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:35.422420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255776042571266:3655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:35.426173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255776042571266:3655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:35.426201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255776042571266:3655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:35.426205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255776042571266:3655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:35.426214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:35.429072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:35.432131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:35.432402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:35.432411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:35.432423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:35.432472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:35.432519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255773665690799:9798]
2025-10-01T14:11:35.433133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:35.433395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:35.433427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:35.433650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:35.433689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.433693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.433694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.433695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.433696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.433696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.433697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.433698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.433700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.433700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.433701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.433702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.433702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.433703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.433707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.433714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.433716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.433719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.433721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.433724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.433726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.433728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.433730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.433733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.433736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.433738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.433740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.433742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.433748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.433761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.433766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.433769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.433772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.433775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.433777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.433780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.433782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.433785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.433788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.433791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.433794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.433797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.433799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.433802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.433806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.433809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.433811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.433814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.433819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.433822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.433825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.433828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.433830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.433834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.433836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.433839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.433860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:35.437848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:35.438712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:35.438727Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:35.438730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:35.438735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:35.438742Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1411 [2:7556255773665690799:9798]
2025-10-01T14:11:35.438760Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:35.438780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:35.438788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.438793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.438796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.438815Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:35.438827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:35.438833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:35.438902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.438910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.438913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.438917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:35.438920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:35.438997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:35.439007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.439020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.439034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.439053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:35.439073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042571435:3655], now have 1 active actors on pipe
2025-10-01T14:11:35.439078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042571232:2446], now have 1 active actors on pipe
2025-10-01T14:11:35.439085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255773665690794:9798]
2025-10-01T14:11:35.439093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255773665690794:9798]
2025-10-01T14:11:35.439096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255773665690794:9798]
2025-10-01T14:11:35.439112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:35.439116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:35.439119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:35.439122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:35.439130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:35.439146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:35.439153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:35.439212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.439222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.439236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255773665690794:9798]
2025-10-01T14:11:35.439248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:35.439254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:35.439279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:35.439291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.439300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.439303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:35.439312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.439322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:35.439349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.439529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.439539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.439558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.439993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f6839b-f40ecb60-1f626da0-ed5a97ec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:35.439104Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1411
2025-10-01T14:11:35.439116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1411
2025-10-01T14:11:35.439638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1412 partition: 0 MaxSeqNo: 45 sessionId: src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0
2025-10-01T14:11:35.442522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0] Write session: try to update token
2025-10-01T14:11:35.442539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:35.462812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:35.462830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:35.462832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:35.462835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:35.462845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255773665690794:9798]
2025-10-01T14:11:35.462853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255773665690794:9798]
2025-10-01T14:11:35.462857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255773665690794:9798]
2025-10-01T14:11:35.462914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:35.462920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:35.462926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:35.462928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.462930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:35.462930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:35.463073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:35.463520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1412 sessionId: src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:35.465995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:35.508013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255776042571485:3745]
2025-10-01T14:11:35.508467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1411, pipe: [1:7556255776042571485:3745]
2025-10-01T14:11:35.614568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:35.615183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.615200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.615244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042571485:3745], now have 1 active actors on pipe
2025-10-01T14:11:35.615478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:35.615492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255776042571485:3745]
2025-10-01T14:11:35.615519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:35.615532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:35.615502Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:35.615595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1412 reason: error at write: Disconnected sessionId: src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0
2025-10-01T14:11:35.615806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1412 sessionId: src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0 is DEAD
2025-10-01T14:11:35.615992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:35.616004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0] Write session will restart in 0.005980s
2025-10-01T14:11:35.616033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0] Write session: Do CDS request
2025-10-01T14:11:35.616039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:35.625413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:35.625474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:35.625491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1413
2025-10-01T14:11:35.625622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:35.625655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:35.625664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:35.625668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:35.626111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1413 sessionId:  describe result for acl check
2025-10-01T14:11:35.626149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:35.626154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:35.626156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:35.626161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255776042571555:3651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:35.626705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255776042571555:3651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:35.629271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255776042571555:3651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:35.631673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255776042571555:3651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:35.631689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255776042571555:3651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:35.631692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255776042571555:3651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:35.631700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:35.635639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:35.636123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:35.636273Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:35.636284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:35.636292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:35.636324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:35.636352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255773665691045:9801]
2025-10-01T14:11:35.636776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:35.637027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:35.637062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:35.637293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:35.637335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.637341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.637342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.637343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.637343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.637344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.637345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.637346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.637346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.637347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.637348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.637348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.637349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.637349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.637352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.637359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.637361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.637363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.637365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.637367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.637370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.637372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.637374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.637377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.637379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.637381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.637383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.637385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.637390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.637395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.637399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.637402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.637405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.637408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.637410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.637412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.637415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.637419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.637421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.637424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.637427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.637430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.637433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.637436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.637439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.637442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.637444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.637447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.637450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.637456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.637459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.637462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.637464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.637468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.637470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.637473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.637495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:35.641807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:35.642464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:35.642479Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:35.642482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:35.642486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:35.642493Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1412 [2:7556255773665691045:9801]
2025-10-01T14:11:35.642510Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:35.642527Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:35.642530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.642534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.642537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.642554Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:35.642559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:35.642565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:35.642624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.642626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.642628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.642631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:35.642634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:35.642842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:35.642844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.642856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.642868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.642882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:35.642903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042571488:2446], now have 1 active actors on pipe
2025-10-01T14:11:35.642907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042571725:3651], now have 1 active actors on pipe
2025-10-01T14:11:35.642914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255773665691040:9801]
2025-10-01T14:11:35.642916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255773665691040:9801]
2025-10-01T14:11:35.642918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255773665691040:9801]
2025-10-01T14:11:35.642928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:35.642939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:35.642941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:35.642943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:35.642944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:35.642950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:35.642952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:35.642966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.642971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.643020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255773665691040:9801]
2025-10-01T14:11:35.643027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:35.643039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:35.643044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.643048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.643049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:35.643057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.643064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:35.643095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.643170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:35.643766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.643771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.643784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.644246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5eae5069-48cd1668-bc6d881d-cfe24952_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:35.642878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1412
2025-10-01T14:11:35.642880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1412
2025-10-01T14:11:35.643911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1413 partition: 0 MaxSeqNo: 45 sessionId: src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0
2025-10-01T14:11:35.646673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0] Write session: try to update token
2025-10-01T14:11:35.646689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:35.662158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1413 sessionId: src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:35.664771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:35.666078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.666107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.666129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:35.666132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:35.666136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:35.666138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:35.666147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255773665691040:9801]
2025-10-01T14:11:35.666152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255773665691040:9801]
2025-10-01T14:11:35.666156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255773665691040:9801]
2025-10-01T14:11:35.666214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:35.666216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:35.666222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:35.666225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:35.666226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.666229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:35.666365Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:35.715849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255776042571740:3745]
2025-10-01T14:11:35.716076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1412, pipe: [1:7556255776042571740:3745]
2025-10-01T14:11:35.829383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:35.829725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255776042571740:3745]
2025-10-01T14:11:35.829756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:35.829015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:35.829254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:35.829302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042571740:3745], now have 1 active actors on pipe
2025-10-01T14:11:35.841124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:35.841142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:35.841168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1413 reason: error at write: Disconnected sessionId: src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0
2025-10-01T14:11:35.841319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1413 sessionId: src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0 is DEAD
2025-10-01T14:11:35.841464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:35.841475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0] Write session will restart in 0.009396s
2025-10-01T14:11:35.841496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0] Write session: Do CDS request
2025-10-01T14:11:35.841505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:35.851906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:35.852357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:35.852372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1414
2025-10-01T14:11:35.852478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:35.852521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:35.852531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:35.852535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:35.852917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1414 sessionId:  describe result for acl check
2025-10-01T14:11:35.852946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:35.852953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:35.852955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:35.852959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255776042571964:3634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:35.853402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255776042571964:3634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:35.854089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:35.855559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255776042571964:3634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:35.857074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:35.857315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:35.857325Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:35.857337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:35.857395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:35.857438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255773665691289:9803]
2025-10-01T14:11:35.857896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255776042571964:3634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:35.857915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255776042571964:3634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:35.857918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255776042571964:3634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:35.857926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:35.858071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:35.858357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:35.858437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:35.858753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:35.858806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.858812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.858814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.858815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.858816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.858818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.858819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.858821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.858822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.858824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.858825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.858826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.858828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.858829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.858834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.858845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.858849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.858853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.858857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.858862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.858866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.858870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.858875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.858879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.858883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.858887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.858891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.858895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.858906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.858914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:35.858920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.858931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:35.858936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.858946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:35.858951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.858962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:35.858971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.858977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:35.858985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.858991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:35.859001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.859006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:35.859015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.859020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:35.859025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.859031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:35.859035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.859041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.859045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.859051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.859055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.859060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.859065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.859071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:35.859090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.859099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:35.859145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:35.862905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:35.863842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:35.863854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:35.863856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:35.863860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:35.863868Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1413 [2:7556255773665691289:9803]
2025-10-01T14:11:35.863885Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:35.863901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:35.863904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.863906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.863908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.863921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:35.863925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:35.863931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:35.863994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.864001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.864003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.864006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:35.864009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:35.864082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:35.864089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.864100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:35.864110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:35.864128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:35.864151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042572000:3634], now have 1 active actors on pipe
2025-10-01T14:11:35.864158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042571747:2446], now have 1 active actors on pipe
2025-10-01T14:11:35.864165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255773665691284:9803]
2025-10-01T14:11:35.864172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255773665691284:9803]
2025-10-01T14:11:35.864174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255773665691284:9803]
2025-10-01T14:11:35.864186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:35.864194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:35.864196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:35.864198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:35.864203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:35.864217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:35.864224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:35.864262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255773665691284:9803]
2025-10-01T14:11:35.864274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:35.864291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:35.864264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1413
2025-10-01T14:11:35.864296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1413
2025-10-01T14:11:35.864324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.864333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.864357Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd13308d-272cf293-5e799a4c-305e6836_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:35.864368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:35.864372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:35.864378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:35.864387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:35.864399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:35.864426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.864574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:35.864586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:35.864603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:35.864692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1414 partition: 0 MaxSeqNo: 45 sessionId: src_id|fd13308d-272cf293-5e799a4c-305e6836_0
2025-10-01T14:11:35.865072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70a4665-1b1e5848-4aa46e04-3eb6712c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fd13308d-272cf293-5e799a4c-305e6836_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:35.867769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd13308d-272cf293-5e799a4c-305e6836_0] Write session: try to update token
2025-10-01T14:11:35.867790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd13308d-272cf293-5e799a4c-305e6836_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:35.884787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1414 sessionId: src_id|fd13308d-272cf293-5e799a4c-305e6836_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:35.887029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:35.887047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:35.887049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:35.887051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:35.887060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255773665691284:9803]
2025-10-01T14:11:35.887064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255773665691284:9803]
2025-10-01T14:11:35.887069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255773665691284:9803]
2025-10-01T14:11:35.887114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:35.887119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:35.887125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:35.887126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:35.887128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:35.887130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:35.887271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:35.887405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:35.929908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255776042572021:3745]
2025-10-01T14:11:35.930219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1413, pipe: [1:7556255776042572021:3745]
2025-10-01T14:11:36.041969Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:36.042393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.042409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.042448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255776042572021:3745], now have 1 active actors on pipe
2025-10-01T14:11:36.042667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:36.042688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255776042572021:3745]
2025-10-01T14:11:36.042717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:36.042727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:36.042784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1414 reason: error at write: Disconnected sessionId: src_id|fd13308d-272cf293-5e799a4c-305e6836_0
2025-10-01T14:11:36.042682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:36.042970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1414 sessionId: src_id|fd13308d-272cf293-5e799a4c-305e6836_0 is DEAD
2025-10-01T14:11:36.043114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd13308d-272cf293-5e799a4c-305e6836_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:36.043124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd13308d-272cf293-5e799a4c-305e6836_0] Write session will restart in 0.006613s
2025-10-01T14:11:36.043154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd13308d-272cf293-5e799a4c-305e6836_0] Write session: Do CDS request
2025-10-01T14:11:36.043161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd13308d-272cf293-5e799a4c-305e6836_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:36.050916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd13308d-272cf293-5e799a4c-305e6836_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.051000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:36.051016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1415
2025-10-01T14:11:36.051119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.051152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:36.051162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:36.051166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:36.051591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1415 sessionId:  describe result for acl check
2025-10-01T14:11:36.051628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:36.051634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:36.051636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:36.051643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255780337539365:3627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:36.052141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255780337539365:3627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:36.054796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255780337539365:3627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:36.058051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255780337539365:3627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:36.058067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255780337539365:3627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:36.058070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255780337539365:3627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:36.058078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:36.059128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:36.062189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:36.062383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:36.062393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:36.062403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:36.062445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:36.062480Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255777960658852:9809]
2025-10-01T14:11:36.062939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:36.063223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:36.063259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:36.063493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:36.063545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.063552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.063553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.063554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.063555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.063556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.063557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.063559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.063560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.063561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.063562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.063564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.063565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.063566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.063571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.063581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.063585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.063589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.063592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.063594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.063596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.063598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.063600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.063603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.063605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.063607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.063609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.063611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.063616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.063621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.063625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.063628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.063631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.063634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.063636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.063639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.063642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.063645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.063648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.063651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.063653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.063656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.063659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.063662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.063665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.063671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.063675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.063680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.063684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.063689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.063693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.063698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.063703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.063708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.063713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.063717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.063741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:36.067535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:36.068296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:36.068310Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:36.068313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:36.068316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:36.068323Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1414 [2:7556255777960658852:9809]
2025-10-01T14:11:36.068341Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:36.068359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:36.068367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.068371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.068373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.068390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:36.068400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:36.068405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:36.068469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.068475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.068477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.068481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:36.068484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:36.068549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:36.068555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.068565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.068577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.068590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:36.068613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337539559:3627], now have 1 active actors on pipe
2025-10-01T14:11:36.068620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337539320:2446], now have 1 active actors on pipe
2025-10-01T14:11:36.068627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255777960658847:9809]
2025-10-01T14:11:36.068629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255777960658847:9809]
2025-10-01T14:11:36.068632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255777960658847:9809]
2025-10-01T14:11:36.068646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:36.068663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:36.068669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:36.068673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:36.068686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:36.068687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:36.068690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:36.068722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255777960658847:9809]
2025-10-01T14:11:36.068734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:36.068717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1414
2025-10-01T14:11:36.068749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:36.068755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1414
2025-10-01T14:11:36.068790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.068799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.068826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:36.068838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.068846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.068849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:36.068858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.068872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:36.068893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.069041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.069047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.069061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.069146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1415 partition: 0 MaxSeqNo: 45 sessionId: src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0
2025-10-01T14:11:36.069499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd13308d-272cf293-5e799a4c-305e6836_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:36.072005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0] Write session: try to update token
2025-10-01T14:11:36.072022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:36.080104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:36.080120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:36.080131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255777960658847:9809]
2025-10-01T14:11:36.080181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:36.080196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:36.080362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:36.080509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:36.080777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:36.080912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:36.081107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:36.081148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:36.089106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1415 sessionId: src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:36.091760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:36.092328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.092350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.092389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:36.092584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:36.100064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:36.100082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:36.100084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:36.100086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:36.100098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255777960658847:9809]
2025-10-01T14:11:36.100103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255777960658847:9809]
2025-10-01T14:11:36.100107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255777960658847:9809]
2025-10-01T14:11:36.100153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:36.100153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:36.100159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:36.100163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:36.100167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.100169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:36.100305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:36.142900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255780337539586:3745]
2025-10-01T14:11:36.143152Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1414, pipe: [1:7556255780337539586:3745]
2025-10-01T14:11:36.246094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:36.254713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.254742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.254917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.254984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.255048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.255114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.255160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.255176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.255245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.255308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.255367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.255426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.255475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.255479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.255551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.255618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.255680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.255747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.255795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.255805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.255877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.255941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.256009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.256072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.256119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.256127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.256193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.256258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.256324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.256391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.256443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.256456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.256525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.256588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.256653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.256736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.256787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.256796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.256867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.256930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.256996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.257063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.257109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.257117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.257188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.257258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.257318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.257380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.257425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.257428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.257503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.257575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.257635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.257694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.257742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.257745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.257817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:36.257878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:36.257939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:36.258432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:36.258005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:36.258500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255780337539586:3745]
2025-10-01T14:11:36.258048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:36.258051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:36.258133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337539586:3745], now have 1 active actors on pipe
2025-10-01T14:11:36.258831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:36.258842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:36.258881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1415 reason: error at write: Disconnected sessionId: src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0
2025-10-01T14:11:36.259078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1415 sessionId: src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0 is DEAD
2025-10-01T14:11:36.259204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:36.259213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0] Write session will restart in 0.009134s
2025-10-01T14:11:36.259238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0] Write session: Do CDS request
2025-10-01T14:11:36.259243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:36.259546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:36.269937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.269984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:36.270002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1416
2025-10-01T14:11:36.270146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.270184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:36.270194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:36.270198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:36.270562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1416 sessionId:  describe result for acl check
2025-10-01T14:11:36.270592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:36.270593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:36.270594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:36.270598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255780337539688:3618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:36.271083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255780337539688:3618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:36.274316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255780337539688:3618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:36.275814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:36.278618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:36.278839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:36.278848Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:36.278860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:36.278906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:36.278944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255777960659126:9821]
2025-10-01T14:11:36.278988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255780337539688:3618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:36.279005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255780337539688:3618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:36.279009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255780337539688:3618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:36.279018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:36.279527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:36.279786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:36.279826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:36.280127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:36.280178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.280183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.280184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.280185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.280187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.280188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.280189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.280190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.280191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.280192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.280193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.280194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.280195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.280197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.280201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.280212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.280216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.280220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.280223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.280227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.280231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.280234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.280238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.280243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.280247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.280250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.280254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.280257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.280264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.280271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.280276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.280282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.280286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.280290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.280294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.280298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.280301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.280304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.280307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.280309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.280312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.280315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.280318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.280321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.280324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.280327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.280329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.280332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.280334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.280337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.280339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.280342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.280344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.280346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.280349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.280351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.280371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:36.284198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:36.285103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:36.285117Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:36.285120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:36.285124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:36.285131Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1415 [2:7556255777960659126:9821]
2025-10-01T14:11:36.285150Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:36.285166Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:36.285169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.285173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.285175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.285190Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:36.285197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:36.285203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:36.285261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.285268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.285270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.285273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:36.285276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:36.285346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:36.285353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.285364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.285376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.285413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:36.285435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337539831:3618], now have 1 active actors on pipe
2025-10-01T14:11:36.285439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337539588:2446], now have 1 active actors on pipe
2025-10-01T14:11:36.285446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255777960659121:9821]
2025-10-01T14:11:36.285448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255777960659121:9821]
2025-10-01T14:11:36.285451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255777960659121:9821]
2025-10-01T14:11:36.285465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:36.285478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:36.285484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:36.285486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:36.285490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:36.285498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:36.285500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:36.285478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1415
2025-10-01T14:11:36.285536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255777960659121:9821]
2025-10-01T14:11:36.285550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:36.285559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:36.285547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1415
2025-10-01T14:11:36.285581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.285590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.285617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|980e009-c086d660-c6b40cbb-c2d976a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:36.285628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.285632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.285634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:36.285644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.285651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:36.285665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.285897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.285906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.285918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.285992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1416 partition: 0 MaxSeqNo: 45 sessionId: src_id|980e009-c086d660-c6b40cbb-c2d976a0_0
2025-10-01T14:11:36.286268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58c5d11f-edb9b4b8-f6a5294e-25113146_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|980e009-c086d660-c6b40cbb-c2d976a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:36.288742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|980e009-c086d660-c6b40cbb-c2d976a0_0] Write session: try to update token
2025-10-01T14:11:36.288760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|980e009-c086d660-c6b40cbb-c2d976a0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:36.301867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1416 sessionId: src_id|980e009-c086d660-c6b40cbb-c2d976a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:36.304069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:36.305613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.305637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.305657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:36.305661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:36.305663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:36.305665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:36.305674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255777960659121:9821]
2025-10-01T14:11:36.305678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255777960659121:9821]
2025-10-01T14:11:36.305682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255777960659121:9821]
2025-10-01T14:11:36.305727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:36.305739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:36.305740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:36.305744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:36.305746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.305749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:36.305876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:36.358492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255780337539845:3745]
2025-10-01T14:11:36.358788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1415, pipe: [1:7556255780337539845:3745]
2025-10-01T14:11:36.454167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:36.454717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:36.454773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337539845:3745], now have 1 active actors on pipe
2025-10-01T14:11:36.454843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:36.454958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255780337539845:3745]
2025-10-01T14:11:36.454984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:36.466598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:36.466615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:36.466640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1416 reason: error at write: Disconnected sessionId: src_id|980e009-c086d660-c6b40cbb-c2d976a0_0
2025-10-01T14:11:36.466802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1416 sessionId: src_id|980e009-c086d660-c6b40cbb-c2d976a0_0 is DEAD
2025-10-01T14:11:36.466942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980e009-c086d660-c6b40cbb-c2d976a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:36.466952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980e009-c086d660-c6b40cbb-c2d976a0_0] Write session will restart in 0.007503s
2025-10-01T14:11:36.466971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980e009-c086d660-c6b40cbb-c2d976a0_0] Write session: Do CDS request
2025-10-01T14:11:36.466975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980e009-c086d660-c6b40cbb-c2d976a0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:36.476030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|980e009-c086d660-c6b40cbb-c2d976a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.478295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:36.478836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:36.479005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:36.479014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:36.479022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:36.479058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:36.479085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255777960659374:9823]
2025-10-01T14:11:36.479541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:36.481539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:36.481602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:36.481938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:36.482014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.482015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.482016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.482017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.482018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.482019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.482020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.482021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.482022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.482023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.482024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.482024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.482025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.482026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.482033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.482042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.482046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.482050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.482054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.482058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.482062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.482066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.482070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.482075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.482078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.482082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.482085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.482089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.482095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.482103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.482109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.482114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.482118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.482122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.482126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.482130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.482134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.482139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.482143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.482148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.482153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.482158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.482162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.482168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.482172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.482177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.482181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.482186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.482190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.482195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.482199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.482204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.482208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.482213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.482217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.482222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.482246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:36.478805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:36.478820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1417
2025-10-01T14:11:36.478979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.479005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:36.479010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:36.479013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:36.479343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1417 sessionId:  describe result for acl check
2025-10-01T14:11:36.479368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:36.479370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:36.479373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:36.479378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255780337540067:3611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:36.479873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255780337540067:3611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:36.481768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255780337540067:3611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:36.485838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255780337540067:3611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:36.485857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255780337540067:3611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:36.485862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255780337540067:3611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:36.485870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:36.486083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:36.486650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:36.486668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:36.486671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:36.486674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:36.486680Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1416 [2:7556255777960659374:9823]
2025-10-01T14:11:36.486692Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:36.486706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:36.486711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.486714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.486715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.486727Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:36.486732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:36.486738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:36.486778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.486784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.486785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.486788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:36.486789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:36.486852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:36.486859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.486871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.486885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.486903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:36.486924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337539857:2446], now have 1 active actors on pipe
2025-10-01T14:11:36.486932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337540105:3611], now have 1 active actors on pipe
2025-10-01T14:11:36.486938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255777960659369:9823]
2025-10-01T14:11:36.486946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255777960659369:9823]
2025-10-01T14:11:36.486949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255777960659369:9823]
2025-10-01T14:11:36.486961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:36.486975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:36.486990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:36.486993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:36.486980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1416
2025-10-01T14:11:36.487005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:36.486981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1416
2025-10-01T14:11:36.487015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:36.487017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:36.487026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255777960659369:9823]
2025-10-01T14:11:36.487029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:36.487032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:36.487058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.487068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.487099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:36.487109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.487113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.487118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:36.487126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.487137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:36.487156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.487308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.487315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.487328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.487397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1417 partition: 0 MaxSeqNo: 45 sessionId: src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0
2025-10-01T14:11:36.487754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|980e009-c086d660-c6b40cbb-c2d976a0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:36.490132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0] Write session: try to update token
2025-10-01T14:11:36.490153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:36.503612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1417 sessionId: src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:36.506035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:36.507077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.507101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.507123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:36.507126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:36.507129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:36.507130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:36.507139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255777960659369:9823]
2025-10-01T14:11:36.507144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255777960659369:9823]
2025-10-01T14:11:36.507148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255777960659369:9823]
2025-10-01T14:11:36.507188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:36.507204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:36.507204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:36.507208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:36.507210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.507213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:36.507337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:36.555056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255780337540112:3745]
2025-10-01T14:11:36.555300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1416, pipe: [1:7556255780337540112:3745]
2025-10-01T14:11:36.649444Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:36.650134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:36.650188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337540112:3745], now have 1 active actors on pipe
2025-10-01T14:11:36.650258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:36.650429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:36.650483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255780337540112:3745]
2025-10-01T14:11:36.660921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:36.660935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:36.660960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1417 reason: error at write: Disconnected sessionId: src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0
2025-10-01T14:11:36.661106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1417 sessionId: src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0 is DEAD
2025-10-01T14:11:36.661242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:36.661255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0] Write session will restart in 0.009351s
2025-10-01T14:11:36.661282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0] Write session: Do CDS request
2025-10-01T14:11:36.661291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:36.671879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.672029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:36.672045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1418
2025-10-01T14:11:36.672157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.672189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:36.672198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:36.672202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:36.672644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1418 sessionId:  describe result for acl check
2025-10-01T14:11:36.672693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:36.672699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:36.672701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:36.672707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255780337540302:3606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:36.673215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255780337540302:3606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:36.674996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:36.675722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255780337540302:3606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:36.677601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:36.677851Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:36.677868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:36.677879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:36.677938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:36.677989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255777960659625:9826]
2025-10-01T14:11:36.678034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255780337540302:3606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:36.678050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255780337540302:3606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:36.678053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255780337540302:3606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:36.678061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:36.678614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:36.678997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:36.679052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:36.679352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:36.679417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.679424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.679425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.679426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.679428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.679429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.679430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.679431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.679432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.679433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.679434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.679436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.679437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.679438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.679444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.679453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.679457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.679461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.679464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.679468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.679472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.679476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.679481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.679485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.679489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.679494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.679497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.679501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.679510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.679518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.679524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.679534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.679543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.679553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.679562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.679572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.679581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.679590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.679599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.679604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.679609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.679614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.679622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.679627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.679635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.679645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.679655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.679662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.679666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.679671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.679675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.679680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.679685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.679689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.679692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.679697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.679740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:36.683341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:36.684275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:36.684293Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:36.684295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:36.684298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:36.684305Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1417 [2:7556255777960659625:9826]
2025-10-01T14:11:36.684319Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:36.684335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:36.684338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.684341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.684344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.684358Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:36.684364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:36.684371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:36.684439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.684446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.684448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.684452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:36.684454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:36.684516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:36.684524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.684536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.684547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.684564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:36.684588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337540115:2446], now have 1 active actors on pipe
2025-10-01T14:11:36.684597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337540358:3606], now have 1 active actors on pipe
2025-10-01T14:11:36.684603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255777960659620:9826]
2025-10-01T14:11:36.684610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255777960659620:9826]
2025-10-01T14:11:36.684612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255777960659620:9826]
2025-10-01T14:11:36.684629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:36.684646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:36.684645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:36.684648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:36.684650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:36.684665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:36.684672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:36.684653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1417
2025-10-01T14:11:36.684691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1417
2025-10-01T14:11:36.684712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255777960659620:9826]
2025-10-01T14:11:36.684722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:36.684738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:36.684946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.684959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.684988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:36.685000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.685009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.685011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:36.685020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.685034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:36.685054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.685283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.685295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.685316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.685397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1418 partition: 0 MaxSeqNo: 45 sessionId: src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0
2025-10-01T14:11:36.685755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8465bf1-d23421ee-74bbf6ab-201fdc39_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:36.688183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0] Write session: try to update token
2025-10-01T14:11:36.688202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:36.702113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1418 sessionId: src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:36.704498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:36.705030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.705054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.705073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:36.705076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:36.705079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:36.705081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:36.705091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255777960659620:9826]
2025-10-01T14:11:36.705095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255777960659620:9826]
2025-10-01T14:11:36.705100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255777960659620:9826]
2025-10-01T14:11:36.705143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:36.705155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:36.705155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:36.705159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:36.705161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.705163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:36.705286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:36.750651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255780337540369:3745]
2025-10-01T14:11:36.750934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1417, pipe: [1:7556255780337540369:3745]
2025-10-01T14:11:36.853033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:36.853307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:36.853366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337540369:3745], now have 1 active actors on pipe
2025-10-01T14:11:36.853452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:36.853626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:36.853634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:36.853660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1418 reason: error at write: Disconnected sessionId: src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0
2025-10-01T14:11:36.853963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:36.853973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0] Write session will restart in 0.005845s
2025-10-01T14:11:36.853998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0] Write session: Do CDS request
2025-10-01T14:11:36.854004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:36.853826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1418 sessionId: src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0 is DEAD
2025-10-01T14:11:36.853938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:36.853983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255780337540369:3745]
2025-10-01T14:11:36.860919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.861074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:36.861090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1419
2025-10-01T14:11:36.861184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:36.861215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:36.861220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:36.861224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:36.862039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1419 sessionId:  describe result for acl check
2025-10-01T14:11:36.862102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:36.862108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:36.862111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:36.862116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255780337540389:3588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:36.862784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255780337540389:3588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:36.869757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255780337540389:3588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:36.876029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255780337540389:3588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:36.876051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255780337540389:3588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:36.876054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255780337540389:3588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:36.876065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:36.906526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:36.914563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:36.914806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:36.914811Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:36.914821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:36.914874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:36.914926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255777960659875:9828]
2025-10-01T14:11:36.915668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:36.918095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:36.918161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:36.918937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:36.919014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.919016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.919017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.919019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.919020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.919021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.919023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.919025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.919026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.919028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.919029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.919030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.919032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.919034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.919040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.919050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.919054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.919059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.919063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.919068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.919072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.919076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.919080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.919086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.919090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.919095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.919099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.919103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.919111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.919120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:36.919126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.919133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:36.919138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.919144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:36.919149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.919155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:36.919161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.919166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:36.924589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.924627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:36.924637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.924644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:36.924650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.924657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:36.924667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.924673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:36.924693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.924699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.924707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.924713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.924719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.924725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.924742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.924747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:36.924753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.924759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:36.924805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:36.938481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:36.939302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:36.939308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:36.939311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:36.939314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:36.939322Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1418 [2:7556255777960659875:9828]
2025-10-01T14:11:36.939337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:36.939356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:36.939360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.939364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.939367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.939386Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:36.939393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:36.939399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:36.939467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.939470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.939472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.939475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:36.939478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:36.939567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:36.939571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.939586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:36.939597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:36.939614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:36.939634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337540507:3588], now have 1 active actors on pipe
2025-10-01T14:11:36.939638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337540374:2446], now have 1 active actors on pipe
2025-10-01T14:11:36.939646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255777960659869:9828]
2025-10-01T14:11:36.939649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255777960659869:9828]
2025-10-01T14:11:36.939651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255777960659869:9828]
2025-10-01T14:11:36.939667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:36.939675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:36.939678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:36.939679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:36.939682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:36.939696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:36.939699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:36.939743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255777960659869:9828]
2025-10-01T14:11:36.939751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:36.939757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:36.941228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1418
2025-10-01T14:11:36.942501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1418
2025-10-01T14:11:36.942610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.942622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.942648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b38460a-2de559b9-52e13c59-38491f91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:36.942668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:36.942674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:36.942677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:36.942687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:36.942702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:36.942721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.942980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:36.942982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:36.942993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:36.943258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1419 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b38460a-2de559b9-52e13c59-38491f91_0
2025-10-01T14:11:36.943707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fc99cd1-5d8b1726-9fe8e89e-2b28efd9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b38460a-2de559b9-52e13c59-38491f91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:36.946468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b38460a-2de559b9-52e13c59-38491f91_0] Write session: try to update token
2025-10-01T14:11:36.946490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b38460a-2de559b9-52e13c59-38491f91_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:36.954448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255780337540652:3745]
2025-10-01T14:11:36.954912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1418, pipe: [1:7556255780337540652:3745]
2025-10-01T14:11:36.954813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255780337540652:3745], now have 1 active actors on pipe
2025-10-01T14:11:36.970137Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:36.970157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:36.970159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:36.970162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:36.970172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255777960659869:9828]
2025-10-01T14:11:36.970178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255777960659869:9828]
2025-10-01T14:11:36.970182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255777960659869:9828]
2025-10-01T14:11:36.970241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:36.970251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:36.970253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:36.970406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:36.971147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:36.971168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:36.971174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:36.970807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1419 sessionId: src_id|6b38460a-2de559b9-52e13c59-38491f91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:36.973789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:37.132423Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:37.132796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.132807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.133551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:37.133572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:37.133631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1419 reason: error at write: Disconnected sessionId: src_id|6b38460a-2de559b9-52e13c59-38491f91_0
2025-10-01T14:11:37.133847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1419 sessionId: src_id|6b38460a-2de559b9-52e13c59-38491f91_0 is DEAD
2025-10-01T14:11:37.133981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:37.134026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255780337540652:3745]
2025-10-01T14:11:37.134621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b38460a-2de559b9-52e13c59-38491f91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:37.134636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b38460a-2de559b9-52e13c59-38491f91_0] Write session will restart in 0.008841s
2025-10-01T14:11:37.134663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b38460a-2de559b9-52e13c59-38491f91_0] Write session: Do CDS request
2025-10-01T14:11:37.134669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b38460a-2de559b9-52e13c59-38491f91_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:37.134234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:37.146920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b38460a-2de559b9-52e13c59-38491f91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:37.148685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:37.148706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1420
2025-10-01T14:11:37.148885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:37.148927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:37.148933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:37.148937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:37.149331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1420 sessionId:  describe result for acl check
2025-10-01T14:11:37.149374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:37.149376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:37.149378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:37.149383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255784632507984:3573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:37.149978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255784632507984:3573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:37.155762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255784632507984:3573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:37.163061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255784632507984:3573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:37.163082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255784632507984:3573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:37.163085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255784632507984:3573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:37.163094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:37.186420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:37.186938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:37.187127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:37.187131Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:37.187141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:37.187181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:37.187212Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255782255627458:9834]
2025-10-01T14:11:37.187779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:37.194538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:37.194625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:37.194973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:37.195019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.195020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.195021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.195022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.195023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.195025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.195026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.195027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.195028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.195029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.195030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.195032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.195033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.195034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.195040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.195050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.195054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.195057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.195061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.195064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.195067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.195071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.195074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.195077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.195080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.195084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.195087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.195090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.195097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.195105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.195111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.195116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.195121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.195126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.195130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.195135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.195140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.195145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.195148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.195153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.195158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.195162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.195166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.195171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.195176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.195182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.195186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.195191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.195195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.195200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.195203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.195208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.195212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.195217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.195221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.195225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.195263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:37.204102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1419
2025-10-01T14:11:37.204135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1419
2025-10-01T14:11:37.202855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:37.203671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:37.203677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:37.203679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:37.203682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:37.203690Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1419 [2:7556255782255627458:9834]
2025-10-01T14:11:37.203706Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:37.203722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:37.203725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:37.203729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:37.203731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:37.203748Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:37.203754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:37.203759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:37.203816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.203818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.203820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.203823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:37.203825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:37.203897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:37.203900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.203911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.203921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.203935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:37.203952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255782255627452:9834]
2025-10-01T14:11:37.203954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255782255627452:9834]
2025-10-01T14:11:37.203957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255782255627452:9834]
2025-10-01T14:11:37.203965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:37.203975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:37.203978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:37.203979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508160:3573], now have 1 active actors on pipe
2025-10-01T14:11:37.203980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:37.203982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632507968:2446], now have 1 active actors on pipe
2025-10-01T14:11:37.203990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:37.204003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:37.204005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:37.204042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255782255627452:9834]
2025-10-01T14:11:37.204049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:37.204056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:37.204511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.204522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.204549Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:37.204557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:37.204562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:37.204564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:37.204573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:37.204584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:37.204601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:37.210460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.210481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.210522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:37.211734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b38460a-2de559b9-52e13c59-38491f91_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:37.211056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1420 partition: 0 MaxSeqNo: 45 sessionId: src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0
2025-10-01T14:11:37.214227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0] Write session: try to update token
2025-10-01T14:11:37.214243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:37.219179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:37.219203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:37.219215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255782255627452:9834]
2025-10-01T14:11:37.219268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:37.219268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:37.219452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:37.219598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:37.219740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:37.219887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:37.220100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:37.220153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:37.228030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1420 sessionId: src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:37.230461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:37.230678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.230699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.230737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:37.230841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:37.234468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255784632508226:3745]
2025-10-01T14:11:37.234746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508226:3745], now have 1 active actors on pipe
2025-10-01T14:11:37.234810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1419, pipe: [1:7556255784632508226:3745]
2025-10-01T14:11:37.237112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:37.237132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:37.237135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:37.237138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:37.237148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255782255627452:9834]
2025-10-01T14:11:37.237152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255782255627452:9834]
2025-10-01T14:11:37.237156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255782255627452:9834]
2025-10-01T14:11:37.237218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:37.237225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.237228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:37.237370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:37.238554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:37.238577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:37.238581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:37.379887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:37.388765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.388794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.388950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.389005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.389064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.389125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.389173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.389181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.389240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.389292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.389346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.389415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.389463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.389469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.389542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.389598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.389664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.389727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.389956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.389963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.390027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.390083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.390138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.390207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.390246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.390251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.390314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.390398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.390465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.390519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.390559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.390565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.390624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.390685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.390745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.390805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.390853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.390860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.390933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.391000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.391071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.391142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.391191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.391197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.391301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.391378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.391434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.391490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.391532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.391537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.391596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.391651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.391726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.391785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.391824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.391829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.391888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:37.391943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:37.392004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:37.392071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:37.392117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:37.392123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:37.392356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:37.392367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:37.392389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1420 reason: error at write: Disconnected sessionId: src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0
2025-10-01T14:11:37.392392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255784632508226:3745]
2025-10-01T14:11:37.392410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:37.392558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1420 sessionId: src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0 is DEAD
2025-10-01T14:11:37.392699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:37.392711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0] Write session will restart in 0.009633s
2025-10-01T14:11:37.392734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0] Write session: Do CDS request
2025-10-01T14:11:37.392739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:37.392995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:37.403880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:37.403886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:37.403900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1421
2025-10-01T14:11:37.404074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:37.404101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:37.404107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:37.404109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:37.404367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1421 sessionId:  describe result for acl check
2025-10-01T14:11:37.404391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:37.404395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:37.404396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:37.404399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255784632508387:3571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:37.404823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255784632508387:3571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:37.407004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255784632508387:3571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:37.407254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:37.409798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:37.409980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:37.409991Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:37.410001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:37.410044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:37.410025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255784632508387:3571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:37.410038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255784632508387:3571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:37.410041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255784632508387:3571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:37.410048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:37.410076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255782255627724:9846]
2025-10-01T14:11:37.410507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:37.410756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:37.410784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:37.410978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:37.411013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.411016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.411017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.411018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.411018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.411019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.411020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.411020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.411021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.411022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.411022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.411023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.411024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.411024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.411027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.411033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.411035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.411037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.411039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.411041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.411044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.411046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.411048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.411050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.411052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.411054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.411056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.411058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.411064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.411068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.411072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.411075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.411077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.411080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.411082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.411085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.411088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.411091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.411093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.411096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.411098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.411101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.411103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.411106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.411108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.411111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.411113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.411117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.411120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.411123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.411125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.411128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.411130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.411133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.411135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.411138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.411157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:37.414606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:37.415430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:37.415443Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:37.415446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:37.415450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:37.415456Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1420 [2:7556255782255627724:9846]
2025-10-01T14:11:37.415475Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:37.415491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:37.415497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:37.415501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:37.415503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:37.415519Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:37.415529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:37.415536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:37.415602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.415609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.415611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.415614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:37.415617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:37.415683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:37.415689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.415700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.415714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.415732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:37.415758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508234:2446], now have 1 active actors on pipe
2025-10-01T14:11:37.415761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508482:3571], now have 1 active actors on pipe
2025-10-01T14:11:37.415769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255782255627719:9846]
2025-10-01T14:11:37.415771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255782255627719:9846]
2025-10-01T14:11:37.415772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255782255627719:9846]
2025-10-01T14:11:37.415787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:37.415797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:37.415800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:37.415801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:37.415802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:37.415814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:37.415816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:37.415869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.415879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.415890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255782255627719:9846]
2025-10-01T14:11:37.415897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:37.415913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:37.415922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8a66d65-90287562-625572da-c01898b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:37.415928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:37.415932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:37.415933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:37.415940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:37.415950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:37.415966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:37.415778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1420
2025-10-01T14:11:37.415799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1420
2025-10-01T14:11:37.416091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.416097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.416107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:37.416175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1421 partition: 0 MaxSeqNo: 45 sessionId: src_id|a8a66d65-90287562-625572da-c01898b_0
2025-10-01T14:11:37.416499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|572c5f12-ddd0a46d-ca683f4a-bdc16c94_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a8a66d65-90287562-625572da-c01898b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:37.418942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a66d65-90287562-625572da-c01898b_0] Write session: try to update token
2025-10-01T14:11:37.418960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a66d65-90287562-625572da-c01898b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:37.435728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1421 sessionId: src_id|a8a66d65-90287562-625572da-c01898b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:37.436520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:37.436536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:37.436539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:37.436541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:37.436553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255782255627719:9846]
2025-10-01T14:11:37.436558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255782255627719:9846]
2025-10-01T14:11:37.436563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255782255627719:9846]
2025-10-01T14:11:37.436615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:37.436619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:37.436626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.436628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:37.436628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:37.436631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:37.436806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:37.438270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:37.492523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255784632508497:3745]
2025-10-01T14:11:37.492821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1420, pipe: [1:7556255784632508497:3745]
2025-10-01T14:11:37.579374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:37.579800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.579815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.579858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508497:3745], now have 1 active actors on pipe
2025-10-01T14:11:37.580098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:37.580594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a66d65-90287562-625572da-c01898b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:37.580606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a66d65-90287562-625572da-c01898b_0] Write session will restart in 0.007539s
2025-10-01T14:11:37.580633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a66d65-90287562-625572da-c01898b_0] Write session: Do CDS request
2025-10-01T14:11:37.580639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a66d65-90287562-625572da-c01898b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:37.580152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:37.580172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:37.580191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255784632508497:3745]
2025-10-01T14:11:37.580216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:37.580232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1421 reason: error at write: Disconnected sessionId: src_id|a8a66d65-90287562-625572da-c01898b_0
2025-10-01T14:11:37.580435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1421 sessionId: src_id|a8a66d65-90287562-625572da-c01898b_0 is DEAD
2025-10-01T14:11:37.588903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a66d65-90287562-625572da-c01898b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:37.589003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:37.589021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1422
2025-10-01T14:11:37.589130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:37.589161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:37.589171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:37.589175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:37.589583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1422 sessionId:  describe result for acl check
2025-10-01T14:11:37.589621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:37.589627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:37.589629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:37.589634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255784632508525:3563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:37.590121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255784632508525:3563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:37.592767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255784632508525:3563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:37.595574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255784632508525:3563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:37.595587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255784632508525:3563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:37.595591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255784632508525:3563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:37.595599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:37.598961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:37.601712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:37.601926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:37.601938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:37.601949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:37.601993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:37.602032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255782255627979:9849]
2025-10-01T14:11:37.602667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:37.602938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:37.602978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:37.603273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:37.603319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.603324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.603325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.603327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.603328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.603329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.603331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.603332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.603333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.603334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.603335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.603337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.603338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.603339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.603344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.603355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.603359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.603363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.603367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.603371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.603375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.603379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.603383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.603387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.603392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.603396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.603400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.603404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.603410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.603422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.603432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.603439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.603449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.603454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.603463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.603469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.603478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.603483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.603488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.603493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.603503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.603509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.603517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.603522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.603531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.603536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.603545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.603551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.603560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.603565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.603574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.603579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.603588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.603593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.603599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.603604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.603647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:37.607260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:37.608234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:37.608250Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:37.608253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:37.608256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:37.608264Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1421 [2:7556255782255627979:9849]
2025-10-01T14:11:37.608279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:37.608295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:37.608299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:37.608303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:37.608306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:37.608321Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:37.608325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:37.608332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:37.608386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.608396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.608398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.608401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:37.608403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:37.608465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:37.608473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.608485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.608500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.608522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:37.608544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508499:2446], now have 1 active actors on pipe
2025-10-01T14:11:37.608551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508701:3563], now have 1 active actors on pipe
2025-10-01T14:11:37.608559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255782255627974:9849]
2025-10-01T14:11:37.608564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255782255627974:9849]
2025-10-01T14:11:37.608567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255782255627974:9849]
2025-10-01T14:11:37.608581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:37.608593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:37.608597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:37.608599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:37.608601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:37.608611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:37.608618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:37.608600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1421
2025-10-01T14:11:37.608647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255782255627974:9849]
2025-10-01T14:11:37.608614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1421
2025-10-01T14:11:37.608657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:37.608661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:37.608685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.608694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.608740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:37.608752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:37.608757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:37.608759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:37.608769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:37.608777Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:37.608796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:37.608946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.608955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.608969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:37.609022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1422 partition: 0 MaxSeqNo: 45 sessionId: src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0
2025-10-01T14:11:37.609362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a66d65-90287562-625572da-c01898b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:37.611724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0] Write session: try to update token
2025-10-01T14:11:37.611743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:37.627443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1422 sessionId: src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:37.629094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:37.629111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:37.629113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:37.629114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:37.629123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255782255627974:9849]
2025-10-01T14:11:37.629128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255782255627974:9849]
2025-10-01T14:11:37.629132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255782255627974:9849]
2025-10-01T14:11:37.629183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:37.629186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:37.629189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:37.629192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.629193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:37.629194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:37.629326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:37.630249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:37.679413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255784632508760:3745]
2025-10-01T14:11:37.679726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1421, pipe: [1:7556255784632508760:3745]
2025-10-01T14:11:37.775545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255784632508760:3745]
2025-10-01T14:11:37.775579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:37.775582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:37.775644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1422 reason: error at write: Disconnected sessionId: src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0
2025-10-01T14:11:37.775868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1422 sessionId: src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0 is DEAD
2025-10-01T14:11:37.775884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:37.776454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:37.776463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0] Write session will restart in 0.006252s
2025-10-01T14:11:37.776490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0] Write session: Do CDS request
2025-10-01T14:11:37.776498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:37.774887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:37.775199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.775210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.775257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508760:3745], now have 1 active actors on pipe
2025-10-01T14:11:37.776786Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:37.784259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:37.786538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:37.786554Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1423
2025-10-01T14:11:37.790142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:37.790245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:37.790252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:37.790258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:37.790842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1423 sessionId:  describe result for acl check
2025-10-01T14:11:37.790906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:37.790916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:37.790918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:37.790929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255784632508842:3552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:37.791434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255784632508842:3552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:37.793647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255784632508842:3552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:37.797385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255784632508842:3552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:37.797401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255784632508842:3552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:37.797404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255784632508842:3552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:37.797412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:37.801023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:37.803644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:37.803833Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:37.803842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:37.803853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:37.803898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:37.803930Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255782255628233:9851]
2025-10-01T14:11:37.804332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:37.804586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:37.804617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:37.804832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:37.804878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.804885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.804886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.804887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.804888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.804889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.804890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.804892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.804893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.804894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.804895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.804896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.804897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.804898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.804903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.804912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.804915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.804919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.804923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.804927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.804931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.804935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.804939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.804943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.804946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.804950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.804954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.804958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.804965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.804972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:37.804978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.804983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:37.804989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.804995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:37.804999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.805009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:37.805013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.805019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:37.805027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.805032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:37.805040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.805044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:37.805049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.805054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:37.805062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.805068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:37.805075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.805081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.805088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.805094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.805101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.805106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.805113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.805118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:37.805125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.805130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:37.805161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:37.808997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:37.809907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:37.809922Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:37.809925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:37.809928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:37.809935Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1422 [2:7556255782255628233:9851]
2025-10-01T14:11:37.809951Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:37.809968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:37.809975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:37.809979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:37.809981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:37.809997Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:37.810007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:37.810018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:37.810082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.810089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.810090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.810094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:37.810096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:37.810162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:37.810169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.810180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:37.810193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:37.810210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:37.810235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508965:3552], now have 1 active actors on pipe
2025-10-01T14:11:37.810239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632508762:2446], now have 1 active actors on pipe
2025-10-01T14:11:37.810246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255782255628228:9851]
2025-10-01T14:11:37.810248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255782255628228:9851]
2025-10-01T14:11:37.810251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255782255628228:9851]
2025-10-01T14:11:37.810263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:37.810277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:37.810290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:37.810290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:37.810294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:37.810296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:37.810298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:37.810304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1422
2025-10-01T14:11:37.810334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1422
2025-10-01T14:11:37.810332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255782255628228:9851]
2025-10-01T14:11:37.810343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:37.810357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:37.810359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.810364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.810433Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:37.810445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:37.810449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:37.810451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:37.810460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:37.810473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:37.810496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:37.810647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.810657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.810671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:37.810757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1423 partition: 0 MaxSeqNo: 45 sessionId: src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0
2025-10-01T14:11:37.811105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8050da0-9819fc6d-f3ea1a76-5ee019e8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:37.813485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0] Write session: try to update token
2025-10-01T14:11:37.813502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:37.827027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1423 sessionId: src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:37.829574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:37.831729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:37.831756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:37.831780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:37.831783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:37.831785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:37.831788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:37.831798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255782255628228:9851]
2025-10-01T14:11:37.831802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255782255628228:9851]
2025-10-01T14:11:37.831808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255782255628228:9851]
2025-10-01T14:11:37.831866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:37.831865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:37.831872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:37.831876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:37.831881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:37.831884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:37.832019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:37.875018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255784632509037:3745]
2025-10-01T14:11:37.875300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1422, pipe: [1:7556255784632509037:3745]
2025-10-01T14:11:37.989513Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:37.989744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:37.989804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632509037:3745], now have 1 active actors on pipe
2025-10-01T14:11:37.989869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:37.990014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255784632509037:3745]
2025-10-01T14:11:37.990048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:38.002759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:38.002777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:38.002801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1423 reason: error at write: Disconnected sessionId: src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0
2025-10-01T14:11:38.003031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1423 sessionId: src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0 is DEAD
2025-10-01T14:11:38.003176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:38.003188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0] Write session will restart in 0.009578s
2025-10-01T14:11:38.003214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0] Write session: Do CDS request
2025-10-01T14:11:38.003223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:38.013932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.014103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:38.014559Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:38.014575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1424
2025-10-01T14:11:38.014704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.014740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:38.014750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:38.014758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:38.015338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1424 sessionId:  describe result for acl check
2025-10-01T14:11:38.015372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:38.015374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:38.015376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:38.015382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255788927476578:3542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:38.015911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255788927476578:3542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:38.016914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:38.017098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:38.017106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:38.017114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:38.017151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:38.017181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255786550595804:9857]
2025-10-01T14:11:38.017636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:38.017934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:38.017973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:38.018093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255788927476578:3542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:38.018230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:38.018293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.018299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.018300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.018301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.018303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.018304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.018306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.018307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.018308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.018309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.018311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.018312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.018313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.018315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.018320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.018330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.018334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.018338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.018341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.018354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.018358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.018362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.018366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.018385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.018389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.018393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.018397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.018401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.018407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.018414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.018420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.018425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.018429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.018434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.018438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.018442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.018447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.018451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.018455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.018460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.018465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.018470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.018474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.018480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.018484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.018488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.018492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.018496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.018500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.018505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.018509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.018515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.018520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.018526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.018533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.018538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.018582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:38.022319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255788927476578:3542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:38.022343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255788927476578:3542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:38.022347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255788927476578:3542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:38.022386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:38.022534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:38.023313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:38.023328Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:38.023331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:38.023333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:38.023339Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1423 [2:7556255786550595804:9857]
2025-10-01T14:11:38.023351Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:38.023364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:38.023368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.023371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.023372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.023385Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:38.023392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:38.023397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:38.023455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.023464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.023466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.023468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:38.023471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:38.023539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:38.023541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.023552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.023567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.023585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:38.023608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255784632509065:2446], now have 1 active actors on pipe
2025-10-01T14:11:38.023619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927476613:3542], now have 1 active actors on pipe
2025-10-01T14:11:38.023626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255786550595799:9857]
2025-10-01T14:11:38.023628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255786550595799:9857]
2025-10-01T14:11:38.023630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255786550595799:9857]
2025-10-01T14:11:38.023646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:38.023663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:38.023673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1423
2025-10-01T14:11:38.023680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1423
2025-10-01T14:11:38.023683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:38.023692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:38.023723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255786550595799:9857]
2025-10-01T14:11:38.023725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:38.023790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:38.023791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.023796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.023800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:38.023802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:38.023808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:38.023820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:38.023827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.023831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.023833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:38.023842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.023852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:38.023866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.024206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.024219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.024241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.024354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1424 partition: 0 MaxSeqNo: 45 sessionId: src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0
2025-10-01T14:11:38.024742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8889cef0-bf5cfdaf-29a17792-abbd9637_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:38.027437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0] Write session: try to update token
2025-10-01T14:11:38.027457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:38.049474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1424 sessionId: src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:38.052251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:38.052479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.052499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.052542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:38.053051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:38.061096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:38.061119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:38.061123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:38.061126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:38.061138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255786550595799:9857]
2025-10-01T14:11:38.061144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255786550595799:9857]
2025-10-01T14:11:38.061149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255786550595799:9857]
2025-10-01T14:11:38.061222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:38.061230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.061234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:38.061392Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:38.062434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:38.062454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:38.062459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:38.090068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255788927476620:3745]
2025-10-01T14:11:38.090420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1423, pipe: [1:7556255788927476620:3745]
2025-10-01T14:11:38.223580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:38.232648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.232690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.232865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.232928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.232993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.233057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.233146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.233176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.233651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.233730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.233797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.233880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.233932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.233940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.234011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.234074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.234138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.234200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.234247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.234255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.234318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.234401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.234465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.234529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.234587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.234590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.234653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.234704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.234769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.234834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.234880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.234887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.234952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.235017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.235078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.235150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.235202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.235210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.235280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.235345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.235413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.235480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.235528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.235535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.235600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.235662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.235730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.235799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.235844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.235851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.235925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.235999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.236066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.236131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.236260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.236268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.236336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.236397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.236462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.236549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.236593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.236600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.237048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:38.237107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255788927476620:3745]
2025-10-01T14:11:38.237132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:38.237139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:38.237166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1424 reason: error at write: Disconnected sessionId: src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0
2025-10-01T14:11:38.237409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1424 sessionId: src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0 is DEAD
2025-10-01T14:11:38.237524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:38.237535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0] Write session will restart in 0.005027s
2025-10-01T14:11:38.237560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0] Write session: Do CDS request
2025-10-01T14:11:38.237567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:38.236665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927476620:3745], now have 1 active actors on pipe
2025-10-01T14:11:38.237406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:38.243946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.244032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:38.244046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1425
2025-10-01T14:11:38.244214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.244240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:38.244246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:38.244248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:38.244685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1425 sessionId:  describe result for acl check
2025-10-01T14:11:38.244723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:38.244726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:38.244727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:38.244732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255788927476648:3535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:38.245203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255788927476648:3535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:38.247087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255788927476648:3535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:38.252768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255788927476648:3535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:38.252788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255788927476648:3535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:38.252793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255788927476648:3535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:38.252806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:38.259863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:38.263142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:38.263381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:38.263387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:38.263400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:38.263461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:38.263684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255786550596073:9865]
2025-10-01T14:11:38.264280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:38.264835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:38.264889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:38.265215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:38.265267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.265273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.265274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.265275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.265276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.265277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.265279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.265280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.265281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.265282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.265284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.265285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.265286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.265287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.265294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.265303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.265307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.265311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.265315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.265318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.265322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.265325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.265329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.265334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.265338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.265341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.265345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.265349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.265355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.265362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.265369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.265374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.265382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.265387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.265391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.265396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.265400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.265404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.265412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.265417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.265421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.265429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.265433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.265438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.265442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.265450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.265454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.265457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.265459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.265462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.265464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.265467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.265469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.265471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.265474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.265476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.265496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:38.269268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:38.270175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:38.270189Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:38.270191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:38.270194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:38.270200Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1424 [2:7556255786550596073:9865]
2025-10-01T14:11:38.270214Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:38.270229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:38.270232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.270236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.270237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.270252Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:38.270258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:38.270263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:38.270313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.270320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.270322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.270325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:38.270328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:38.270403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:38.270411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.270421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.270431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.270443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:38.270461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927476635:2446], now have 1 active actors on pipe
2025-10-01T14:11:38.270464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927476757:3535], now have 1 active actors on pipe
2025-10-01T14:11:38.270471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255786550596068:9865]
2025-10-01T14:11:38.270473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255786550596068:9865]
2025-10-01T14:11:38.270475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255786550596068:9865]
2025-10-01T14:11:38.270490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:38.270507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:38.270516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:38.270523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:38.270526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:38.270527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:38.270530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:38.270553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255786550596068:9865]
2025-10-01T14:11:38.270567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:38.270575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:38.270552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1424
2025-10-01T14:11:38.270591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1424
2025-10-01T14:11:38.270741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.270751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.270779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|282e5215-57c9abf3-cb82ba8-965032a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:38.270785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.270789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.270791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:38.270801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.270809Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:38.270824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.271002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.271008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.271022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.271095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1425 partition: 0 MaxSeqNo: 45 sessionId: src_id|282e5215-57c9abf3-cb82ba8-965032a7_0
2025-10-01T14:11:38.272033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3cac7d57-60dbfb70-40b79b89-b9940476_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|282e5215-57c9abf3-cb82ba8-965032a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:38.274532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|282e5215-57c9abf3-cb82ba8-965032a7_0] Write session: try to update token
2025-10-01T14:11:38.274548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|282e5215-57c9abf3-cb82ba8-965032a7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:38.289917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:38.289937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:38.289950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255786550596068:9865]
2025-10-01T14:11:38.290003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:38.290007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:38.290188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:38.290359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:38.290542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:38.290707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:38.290915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:38.290975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:38.295904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1425 sessionId: src_id|282e5215-57c9abf3-cb82ba8-965032a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:38.298331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:38.298872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.298893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.298947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:38.299036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:38.307339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:38.307359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:38.307362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:38.307364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:38.307376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255786550596068:9865]
2025-10-01T14:11:38.307380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255786550596068:9865]
2025-10-01T14:11:38.307384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255786550596068:9865]
2025-10-01T14:11:38.307433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:38.307441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.307443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:38.307569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:38.307576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:38.307582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:38.307586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:38.337342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255788927476899:3745]
2025-10-01T14:11:38.337745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1424, pipe: [1:7556255788927476899:3745]
2025-10-01T14:11:38.459596Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:38.468294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.468323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.468501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.468565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.468626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.468697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.468744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.468748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.468816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.468869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.468924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.468988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.469032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.469035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.469095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.469146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.469212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.469267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.469616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.469625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.469690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.469751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.469806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.469869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.469913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.469928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.469994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.470050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.470106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.470168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.470283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.470292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.470365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.470440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.470500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.470559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.470598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.470601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.470668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.470721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.470775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.470829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.470870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.470872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.470936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.470989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.471042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.471101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.471164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.471167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.471233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.471290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.471349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.471405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.471444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.471448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.471516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:38.471576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:38.471636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:38.471692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:38.471730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:38.471743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:38.471813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927476899:3745], now have 1 active actors on pipe
2025-10-01T14:11:38.472517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255788927476899:3745]
2025-10-01T14:11:38.472552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:38.472590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:38.472593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:38.472621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1425 reason: error at write: Disconnected sessionId: src_id|282e5215-57c9abf3-cb82ba8-965032a7_0
2025-10-01T14:11:38.472849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1425 sessionId: src_id|282e5215-57c9abf3-cb82ba8-965032a7_0 is DEAD
2025-10-01T14:11:38.473058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282e5215-57c9abf3-cb82ba8-965032a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:38.473073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282e5215-57c9abf3-cb82ba8-965032a7_0] Write session will restart in 0.009291s
2025-10-01T14:11:38.472664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:38.473100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282e5215-57c9abf3-cb82ba8-965032a7_0] Write session: Do CDS request
2025-10-01T14:11:38.473108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282e5215-57c9abf3-cb82ba8-965032a7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:38.484052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|282e5215-57c9abf3-cb82ba8-965032a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.484403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:38.484420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1426
2025-10-01T14:11:38.484552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.484585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:38.484590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:38.484593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:38.485152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1426 sessionId:  describe result for acl check
2025-10-01T14:11:38.485189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:38.485190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:38.485192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:38.485197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255788927476963:3528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:38.485690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255788927476963:3528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:38.488817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255788927476963:3528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:38.493139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255788927476963:3528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:38.493168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255788927476963:3528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:38.493173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255788927476963:3528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:38.493184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:38.494444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:38.497285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:38.497494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:38.497503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:38.497514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:38.497558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:38.497610Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255786550596346:9871]
2025-10-01T14:11:38.498151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:38.498439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:38.498483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:38.498771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:38.498828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.498834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.498835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.498835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.498836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.498837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.498838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.498839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.498839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.498840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.498840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.498841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.498842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.498843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.498846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.498852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.498854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.498856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.498858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.498860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.498862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.498863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.498865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.498868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.498869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.498871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.498873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.498875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.498882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.498887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.498890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.498893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.498895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.498899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.498901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.498903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.498906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.498908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.498911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.498917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.498921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.498923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.498929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.498932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.498934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.498937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.498942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.498946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.498949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.498955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.498958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.498962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.498967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.498971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.498973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.498976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.498999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:38.505060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:38.505827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:38.505841Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:38.505843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:38.505848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:38.505855Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1425 [2:7556255786550596346:9871]
2025-10-01T14:11:38.505872Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:38.505891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:38.505899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.505903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.505905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.505922Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:38.505931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:38.505937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:38.505997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.506003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.506006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.506009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:38.506012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:38.506084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:38.506091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.506101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.506115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.506134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:38.506156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927477161:3528], now have 1 active actors on pipe
2025-10-01T14:11:38.506164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927476910:2446], now have 1 active actors on pipe
2025-10-01T14:11:38.506171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255786550596341:9871]
2025-10-01T14:11:38.506178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255786550596341:9871]
2025-10-01T14:11:38.506180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255786550596341:9871]
2025-10-01T14:11:38.506195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:38.506214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:38.506215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:38.506224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:38.506226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:38.506228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:38.506231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:38.506258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1425
2025-10-01T14:11:38.506258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1425
2025-10-01T14:11:38.506274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255786550596341:9871]
2025-10-01T14:11:38.506290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:38.506354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:38.506514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.506527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.506560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|711297de-415d4704-700c4316-2b69274d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:38.506576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.506585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.506588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:38.506604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.506621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:38.506648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.507118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.507130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.507152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.507234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1426 partition: 0 MaxSeqNo: 45 sessionId: src_id|711297de-415d4704-700c4316-2b69274d_0
2025-10-01T14:11:38.507636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282e5215-57c9abf3-cb82ba8-965032a7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|711297de-415d4704-700c4316-2b69274d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:38.510332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|711297de-415d4704-700c4316-2b69274d_0] Write session: try to update token
2025-10-01T14:11:38.510352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|711297de-415d4704-700c4316-2b69274d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:38.528660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:38.528688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:38.528691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:38.528693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:38.528704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255786550596341:9871]
2025-10-01T14:11:38.528711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255786550596341:9871]
2025-10-01T14:11:38.528715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255786550596341:9871]
2025-10-01T14:11:38.528757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:38.528764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:38.528765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:38.528772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.528774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:38.528774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:38.528921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:38.529859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1426 sessionId: src_id|711297de-415d4704-700c4316-2b69274d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:38.532595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:38.574438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255788927477174:3745]
2025-10-01T14:11:38.578675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1425, pipe: [1:7556255788927477174:3745]
2025-10-01T14:11:38.671901Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:38.672108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.672120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.672154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927477174:3745], now have 1 active actors on pipe
2025-10-01T14:11:38.672301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:38.672399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:38.672414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255788927477174:3745]
2025-10-01T14:11:38.672555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:38.672621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1426 reason: status is not ok: tablet will be restarted right now sessionId: src_id|711297de-415d4704-700c4316-2b69274d_0
2025-10-01T14:11:38.672812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1426 sessionId: src_id|711297de-415d4704-700c4316-2b69274d_0 is DEAD
2025-10-01T14:11:38.673010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711297de-415d4704-700c4316-2b69274d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:38.673024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711297de-415d4704-700c4316-2b69274d_0] Write session will restart in 0.009625s
2025-10-01T14:11:38.673048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711297de-415d4704-700c4316-2b69274d_0] Write session: Do CDS request
2025-10-01T14:11:38.673054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711297de-415d4704-700c4316-2b69274d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:38.683978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|711297de-415d4704-700c4316-2b69274d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.684024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:38.684039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1427
2025-10-01T14:11:38.684178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.684207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:38.684216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:38.684220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:38.684660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1427 sessionId:  describe result for acl check
2025-10-01T14:11:38.684709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:38.684711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:38.684712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:38.684718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255788927477301:3525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:38.685220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255788927477301:3525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:38.687381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255788927477301:3525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:38.689149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:38.691759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:38.691948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255788927477301:3525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:38.691964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255788927477301:3525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:38.691967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255788927477301:3525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:38.691975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:38.691978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:38.691995Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:38.692007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:38.692062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:38.692102Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255786550596605:9874]
2025-10-01T14:11:38.692663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:38.692973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:38.693020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:38.693317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:38.693397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.693404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.693405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.693406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.693408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.693409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.693410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.693411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.693413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.693414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.693415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.693416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.693417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.693418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.693424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.693433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.693436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.693458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.693466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.693470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.693474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.693481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.693485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.693489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.693493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.693496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.693499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.693508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.693517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.693528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.693539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.693548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.693552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.693557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.693565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.693570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.693578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.693583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.693591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.693596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.693601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.693610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.693618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.693626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.693634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.693639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.693646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.693650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.693654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.693661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.693669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.693673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.693677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.693683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.693686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.693691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.693729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:38.697390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:38.697953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:38.697966Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:38.697968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:38.697971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:38.697976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1426 [2:7556255786550596605:9874]
2025-10-01T14:11:38.697988Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:38.698002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:38.698004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.698007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.698008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.698020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:38.698024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:38.698029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:38.698072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.698080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.698081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.698083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:38.698085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:38.698136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:38.698142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.698149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.698155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.698163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:38.698179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255786550596600:9874]
2025-10-01T14:11:38.698184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255786550596600:9874]
2025-10-01T14:11:38.698186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255786550596600:9874]
2025-10-01T14:11:38.698194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:38.698203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:38.698204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927477177:2446], now have 1 active actors on pipe
2025-10-01T14:11:38.698211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:38.698212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:38.698214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:38.698219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:38.698221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:38.698225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927477431:3525], now have 1 active actors on pipe
2025-10-01T14:11:38.698252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255786550596600:9874]
2025-10-01T14:11:38.698262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:38.698273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:38.698284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1426
2025-10-01T14:11:38.698314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1426
2025-10-01T14:11:38.698330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.698341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.698359Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:38.698364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.698387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.698390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:38.698399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.698407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:38.698420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.698544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.698552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.698563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.698653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1427 partition: 0 MaxSeqNo: 45 sessionId: src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0
2025-10-01T14:11:38.699002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|711297de-415d4704-700c4316-2b69274d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:38.701487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0] Write session: try to update token
2025-10-01T14:11:38.701504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:38.718657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1427 sessionId: src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:38.719586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:38.719607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:38.719610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:38.719613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:38.719623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255786550596600:9874]
2025-10-01T14:11:38.719627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255786550596600:9874]
2025-10-01T14:11:38.719633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255786550596600:9874]
2025-10-01T14:11:38.719696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:38.719707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.719710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:38.719845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:38.721312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:38.721505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:38.721520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:38.721523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:38.772518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255788927477442:3745]
2025-10-01T14:11:38.772783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1426, pipe: [1:7556255788927477442:3745]
2025-10-01T14:11:38.860297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:38.860822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.860836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.860869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927477442:3745], now have 1 active actors on pipe
2025-10-01T14:11:38.861087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:38.861101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:38.861158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1427 reason: error at write: Disconnected sessionId: src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0
2025-10-01T14:11:38.861329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1427 sessionId: src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0 is DEAD
2025-10-01T14:11:38.861354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:38.861489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:38.861489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255788927477442:3745]
2025-10-01T14:11:38.861502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0] Write session will restart in 0.005062s
2025-10-01T14:11:38.861508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:38.861528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0] Write session: Do CDS request
2025-10-01T14:11:38.861551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:38.867932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.868032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:38.868047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1428
2025-10-01T14:11:38.868137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:38.868168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:38.868177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:38.868180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:38.868517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1428 sessionId:  describe result for acl check
2025-10-01T14:11:38.868549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:38.868555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:38.868559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:38.868564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255788927477473:3514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:38.869033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255788927477473:3514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:38.872295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255788927477473:3514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:38.875854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255788927477473:3514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:38.875877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255788927477473:3514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:38.875881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255788927477473:3514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:38.875889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:38.877438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:38.880040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:38.880279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:38.880290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:38.880300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:38.880343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:38.880379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255786550596864:9876]
2025-10-01T14:11:38.880809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:38.881035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:38.881070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:38.881337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:38.881379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.881383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.881384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.881384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.881385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.881386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.881386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.881387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.881387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.881388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.881389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.881389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.881390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.881390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.881394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.881400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.881402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.881404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.881406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.881409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.881410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.881413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.881415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.881417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.881419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.881421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.881423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.881425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.881429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.881434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:38.881437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.881441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:38.881443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.881446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:38.881448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.881451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:38.881454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.881457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:38.881460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.881462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:38.881465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.881471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:38.881474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.881477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:38.881479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.881482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:38.881484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.881487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.881489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.881492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.881494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.881497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.881501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.881510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:38.881518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.881525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:38.881546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:38.885254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:38.886204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:38.886219Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:38.886221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:38.886224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:38.886230Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1427 [2:7556255786550596864:9876]
2025-10-01T14:11:38.886244Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:38.886259Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:38.886260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.886263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.886265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.886276Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:38.886283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:38.886289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:38.886334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.886342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.886344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.886346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:38.886348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:38.886421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:38.886428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.886438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:38.886447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:38.886460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:38.886482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927477698:3514], now have 1 active actors on pipe
2025-10-01T14:11:38.886489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927477447:2446], now have 1 active actors on pipe
2025-10-01T14:11:38.886495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255786550596859:9876]
2025-10-01T14:11:38.886501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255786550596859:9876]
2025-10-01T14:11:38.886503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255786550596859:9876]
2025-10-01T14:11:38.886515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:38.886530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:38.886530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:38.886536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:38.886538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:38.886543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:38.886546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:38.886542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1427
2025-10-01T14:11:38.886554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1427
2025-10-01T14:11:38.886572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255786550596859:9876]
2025-10-01T14:11:38.886582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:38.886583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:38.886599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.886604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.886640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ca47172-949470e1-a35f8047-c6530e1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:38.886648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:38.886651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:38.886653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:38.886659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:38.886665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:38.886680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.886806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:38.886820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:38.886845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:38.886933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1428 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ca47172-949470e1-a35f8047-c6530e1d_0
2025-10-01T14:11:38.887297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da66306e-fcfed4f1-f4ca534e-96d79f1a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ca47172-949470e1-a35f8047-c6530e1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:38.889475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca47172-949470e1-a35f8047-c6530e1d_0] Write session: try to update token
2025-10-01T14:11:38.889489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca47172-949470e1-a35f8047-c6530e1d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:38.904958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1428 sessionId: src_id|9ca47172-949470e1-a35f8047-c6530e1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:38.906594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:38.906610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:38.906612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:38.906614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:38.906622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255786550596859:9876]
2025-10-01T14:11:38.906626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255786550596859:9876]
2025-10-01T14:11:38.906631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255786550596859:9876]
2025-10-01T14:11:38.906670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:38.906680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:38.906682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:38.906681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:38.906700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:38.906714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:38.906817Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:38.907501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:38.961449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255788927477713:3745]
2025-10-01T14:11:38.961666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1427, pipe: [1:7556255788927477713:3745]
2025-10-01T14:11:39.054075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:39.054383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.054398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.054439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255788927477713:3745], now have 1 active actors on pipe
2025-10-01T14:11:39.054661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:39.054679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:39.054694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:39.054709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255788927477713:3745]
2025-10-01T14:11:39.054737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:39.054752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1428 reason: error at write: Disconnected sessionId: src_id|9ca47172-949470e1-a35f8047-c6530e1d_0
2025-10-01T14:11:39.054946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1428 sessionId: src_id|9ca47172-949470e1-a35f8047-c6530e1d_0 is DEAD
2025-10-01T14:11:39.055206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca47172-949470e1-a35f8047-c6530e1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:39.055218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca47172-949470e1-a35f8047-c6530e1d_0] Write session will restart in 0.008899s
2025-10-01T14:11:39.055245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca47172-949470e1-a35f8047-c6530e1d_0] Write session: Do CDS request
2025-10-01T14:11:39.055251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca47172-949470e1-a35f8047-c6530e1d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:39.065825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca47172-949470e1-a35f8047-c6530e1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.065952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:39.065971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1429
2025-10-01T14:11:39.066110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.066145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:39.066156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:39.066160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:39.066633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1429 sessionId:  describe result for acl check
2025-10-01T14:11:39.066676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:39.066684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:39.066686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:39.066692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255793222445132:3501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:39.067229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255793222445132:3501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:39.070013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255793222445132:3501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:39.072203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:39.072770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255793222445132:3501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:39.072783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255793222445132:3501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:39.072787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255793222445132:3501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:39.072795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:39.075374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:39.075598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:39.075616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:39.075628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:39.075688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:39.075731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255790845564440:9882]
2025-10-01T14:11:39.076335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:39.076687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:39.076740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:39.077056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:39.077110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.077116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.077117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.077118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.077119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.077120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.077121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.077123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.077124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.077125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.077126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.077127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.077129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.077129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.077134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.077143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.077146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.077150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.077153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.077157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.077160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.077163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.077167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.077173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.077176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.077179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.077183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.077186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.077193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.077199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.077205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.077210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.077216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.077220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.077224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.077228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.077232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.077237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.077241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.077246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.077250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.077255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.077258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.077268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.077272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.077281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.077285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.077289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.077293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.077302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.077307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.077315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.077319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.077323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.077331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.077336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.077382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:39.081054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:39.081741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:39.081756Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:39.081758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:39.081762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:39.081769Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1428 [2:7556255790845564440:9882]
2025-10-01T14:11:39.081784Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:39.081806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:39.081813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.081817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.081819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.081835Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:39.081845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:39.081851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:39.081915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.081923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.081925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.081929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:39.081932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:39.081998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:39.082005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.082014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.082022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.082036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:39.082057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445288:3501], now have 1 active actors on pipe
2025-10-01T14:11:39.082065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445035:2446], now have 1 active actors on pipe
2025-10-01T14:11:39.082072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255790845564434:9882]
2025-10-01T14:11:39.082078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255790845564434:9882]
2025-10-01T14:11:39.082080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255790845564434:9882]
2025-10-01T14:11:39.082094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:39.082107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:39.082115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:39.082118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:39.082121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:39.082125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:39.082132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:39.082135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1428
2025-10-01T14:11:39.082135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1428
2025-10-01T14:11:39.082160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255790845564434:9882]
2025-10-01T14:11:39.082170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:39.082174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:39.082196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.082201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.082234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:39.082247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.082256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.082258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:39.082266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.082277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:39.082297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.082432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.082438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.082453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.082534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1429 partition: 0 MaxSeqNo: 45 sessionId: src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0
2025-10-01T14:11:39.082920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ca47172-949470e1-a35f8047-c6530e1d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:39.085355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0] Write session: try to update token
2025-10-01T14:11:39.085375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:39.102089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:39.102109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:39.102112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:39.102114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:39.102124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255790845564434:9882]
2025-10-01T14:11:39.102129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255790845564434:9882]
2025-10-01T14:11:39.103138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1429 sessionId: src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:39.102133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255790845564434:9882]
2025-10-01T14:11:39.102181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:39.102186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:39.102187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:39.102191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:39.102195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.102198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:39.102332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:39.105937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:39.155000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255793222445312:3745]
2025-10-01T14:11:39.155376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1428, pipe: [1:7556255793222445312:3745]
2025-10-01T14:11:39.260155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:39.260482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.260501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.260547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445312:3745], now have 1 active actors on pipe
2025-10-01T14:11:39.260813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255793222445312:3745]
2025-10-01T14:11:39.260826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:39.260830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:39.260851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:39.260888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1429 reason: error at write: Disconnected sessionId: src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0
2025-10-01T14:11:39.260959Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:39.261072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1429 sessionId: src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0 is DEAD
2025-10-01T14:11:39.261214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:39.261223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0] Write session will restart in 0.009531s
2025-10-01T14:11:39.261243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0] Write session: Do CDS request
2025-10-01T14:11:39.261248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:39.271966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.274507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:39.274521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1430
2025-10-01T14:11:39.274665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.274698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:39.274708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:39.274711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:39.275063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1430 sessionId:  describe result for acl check
2025-10-01T14:11:39.275099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:39.275101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:39.275103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:39.275109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255793222445415:3495] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:39.275636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255793222445415:3495] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:39.277725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255793222445415:3495] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:39.280947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255793222445415:3495] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:39.280961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255793222445415:3495] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:39.280965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255793222445415:3495] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:39.280976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:39.283459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:39.286336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:39.286616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:39.286630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:39.286642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:39.286704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:39.286741Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255790845564713:9884]
2025-10-01T14:11:39.287289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:39.287609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:39.287653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:39.287931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:39.287996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.288002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.288003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.288004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.288005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.288006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.288007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.288008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.288009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.288010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.288011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.288012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.288013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.288014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.288019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.288042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.288045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.288049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.288051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.288054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.288057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.288060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.288063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.288066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.288069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.288072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.288074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.288077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.288085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.288092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.288097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.288101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.288107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.288111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.288114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.288118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.288122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.288134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.288143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.288147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.288151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.288155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.288159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.288162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.288167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.288170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.288178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.288182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.288185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.288189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.288191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.288195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.288198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.288202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.288209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.288213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.288242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:39.291936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:39.292975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:39.292990Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:39.292993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:39.292997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:39.293003Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1429 [2:7556255790845564713:9884]
2025-10-01T14:11:39.293020Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:39.293036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:39.293040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.293044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.293051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.293067Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:39.293073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:39.293079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:39.293139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.293146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.293149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.293152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:39.293155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:39.293227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:39.293234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.293246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.293255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.293274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:39.293297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445561:3495], now have 1 active actors on pipe
2025-10-01T14:11:39.293307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445314:2446], now have 1 active actors on pipe
2025-10-01T14:11:39.293314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255790845564708:9884]
2025-10-01T14:11:39.293316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255790845564708:9884]
2025-10-01T14:11:39.293318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255790845564708:9884]
2025-10-01T14:11:39.293334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:39.293346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:39.293361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:39.293363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:39.293386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1429
2025-10-01T14:11:39.293386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1429
2025-10-01T14:11:39.293394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255790845564708:9884]
2025-10-01T14:11:39.293401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:39.293407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:39.293411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:39.293413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:39.293419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:39.293506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.293517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.293543Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:39.293550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.293554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.293556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:39.293563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.293572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:39.293585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.293798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.293806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.293823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.293912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1430 partition: 0 MaxSeqNo: 45 sessionId: src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0
2025-10-01T14:11:39.294289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdcd1f7-13a57fec-7ff11a60-bb45d8ff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:39.297171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0] Write session: try to update token
2025-10-01T14:11:39.297190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:39.312233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1430 sessionId: src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:39.313944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:39.313966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:39.313969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:39.313972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:39.313983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255790845564708:9884]
2025-10-01T14:11:39.313987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255790845564708:9884]
2025-10-01T14:11:39.313990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255790845564708:9884]
2025-10-01T14:11:39.314032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:39.314037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:39.314044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.314045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:39.314047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:39.314050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:39.314172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:39.314687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:39.360827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255793222445583:3745]
2025-10-01T14:11:39.361081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1429, pipe: [1:7556255793222445583:3745]
2025-10-01T14:11:39.470426Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:39.470953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.470972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.471017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445583:3745], now have 1 active actors on pipe
2025-10-01T14:11:39.471359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:39.471849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255793222445583:3745]
2025-10-01T14:11:39.471879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:39.471954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1430 reason: status is not ok: tablet will be restarted right now sessionId: src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0
2025-10-01T14:11:39.472185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1430 sessionId: src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0 is DEAD
2025-10-01T14:11:39.472326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:39.472341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0] Write session will restart in 0.009641s
2025-10-01T14:11:39.472314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:39.472369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0] Write session: Do CDS request
2025-10-01T14:11:39.472377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:39.482937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.483047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:39.483066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1431
2025-10-01T14:11:39.483165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.483197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:39.483209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:39.483212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:39.483597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1431 sessionId:  describe result for acl check
2025-10-01T14:11:39.483631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:39.483636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:39.483637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:39.483643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255793222445666:3483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:39.484140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255793222445666:3483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:39.486917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255793222445666:3483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:39.489948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255793222445666:3483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:39.489961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255793222445666:3483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:39.489963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255793222445666:3483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:39.489970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:39.492076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:39.494597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:39.494892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:39.494908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:39.494922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:39.494986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:39.495028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255790845564991:9896]
2025-10-01T14:11:39.495595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:39.495900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:39.495948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:39.496257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:39.496328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.496333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.496335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.496336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.496337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.496338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.496339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.496340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.496341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.496343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.496343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.496345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.496346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.496347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.496353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.496364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.496368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.496372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.496375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.496379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.496383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.496387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.496390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.496394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.496398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.496401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.496405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.496408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.496417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.496424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.496430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.496435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.496444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.496449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.496453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.496462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.496467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.496477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.496484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.496489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.496494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.496503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.496507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.496516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.496520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.496525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.496532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.496537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.496541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.496546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.496554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.496559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.496567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.496572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.496577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.496582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.496619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:39.500199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:39.501099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:39.501118Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:39.501121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:39.501125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:39.501132Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1430 [2:7556255790845564991:9896]
2025-10-01T14:11:39.501145Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:39.501165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:39.501171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.501175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.501177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.501193Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:39.501203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:39.501209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:39.501267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.501274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.501277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.501280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:39.501282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:39.501348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:39.501358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.501370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.501381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.501397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:39.501419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445594:2446], now have 1 active actors on pipe
2025-10-01T14:11:39.501427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445844:3483], now have 1 active actors on pipe
2025-10-01T14:11:39.501435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255790845564986:9896]
2025-10-01T14:11:39.501441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255790845564986:9896]
2025-10-01T14:11:39.501444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255790845564986:9896]
2025-10-01T14:11:39.501458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:39.501472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:39.501487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:39.501493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:39.501496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:39.501499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:39.501501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:39.501476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1430
2025-10-01T14:11:39.501489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1430
2025-10-01T14:11:39.501521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255790845564986:9896]
2025-10-01T14:11:39.501524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:39.501526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:39.501552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.501556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.501588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:39.501601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.501610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.501613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:39.501621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.501634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:39.501655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.501813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.501822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.501837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.501932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1431 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0
2025-10-01T14:11:39.502282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74a15bc-f4ce9391-92f78721-fd416ca9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:39.504793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0] Write session: try to update token
2025-10-01T14:11:39.504810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:39.522796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:39.522825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:39.522831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:39.522837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:39.522847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255790845564986:9896]
2025-10-01T14:11:39.522857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255790845564986:9896]
2025-10-01T14:11:39.522863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255790845564986:9896]
2025-10-01T14:11:39.522935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:39.523177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1431 sessionId: src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:39.525700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:39.522964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.522973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:39.523508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:39.525856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:39.525864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:39.525867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:39.572306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255793222445862:3745]
2025-10-01T14:11:39.572561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1430, pipe: [1:7556255793222445862:3745]
2025-10-01T14:11:39.678927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:39.679528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.679547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.679594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445862:3745], now have 1 active actors on pipe
2025-10-01T14:11:39.679773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:39.679878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255793222445862:3745]
2025-10-01T14:11:39.679913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:39.679922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:39.679978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0
2025-10-01T14:11:39.680160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1431 sessionId: src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0 is DEAD
2025-10-01T14:11:39.680335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:39.680342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0] Write session will restart in 0.005263s
2025-10-01T14:11:39.680365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0] Write session: Do CDS request
2025-10-01T14:11:39.680370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:39.686873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.686978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:39.686994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1432
2025-10-01T14:11:39.687084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.687108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:39.687116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:39.687118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:39.687510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1432 sessionId:  describe result for acl check
2025-10-01T14:11:39.687548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:39.687555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:39.687556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:39.687561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255793222445886:3479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:39.688009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255793222445886:3479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:39.690351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255793222445886:3479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:39.693301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255793222445886:3479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:39.693315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255793222445886:3479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:39.693318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255793222445886:3479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:39.693326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:39.699169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:39.702106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:39.702420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:39.702429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:39.702438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:39.702482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:39.702515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255790845565256:9899]
2025-10-01T14:11:39.703045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:39.703313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:39.703345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:39.703546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:39.703582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.703588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.703589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.703590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.703591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.703591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.703592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.703592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.703593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.703594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.703595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.703595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.703596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.703596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.703599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.703606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.703608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.703610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.703612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.703614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.703616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.703618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.703620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.703622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.703623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.703625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.703627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.703629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.703634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.703638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.703642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.703645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.703648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.703651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.703653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.703656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.703659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.703662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.703664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.703667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.703669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.703672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.703675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.703678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.703680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.703683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.703686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.703688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.703691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.703694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.703696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.703700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.703702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.703705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.703707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.703710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.703733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:39.707129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:39.708529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:39.708539Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:39.708541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:39.708543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:39.708549Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1431 [2:7556255790845565256:9899]
2025-10-01T14:11:39.708560Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:39.708573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:39.708578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.708580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.708582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.708593Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:39.708600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:39.708604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:39.708647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.708655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.708656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.708658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:39.708660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:39.708722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:39.708728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.708735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.708740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.708750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:39.708782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222445865:2446], now have 1 active actors on pipe
2025-10-01T14:11:39.708790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222446002:3479], now have 1 active actors on pipe
2025-10-01T14:11:39.708796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255790845565251:9899]
2025-10-01T14:11:39.708803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255790845565251:9899]
2025-10-01T14:11:39.708805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255790845565251:9899]
2025-10-01T14:11:39.708818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:39.708832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:39.708834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:39.708841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:39.708843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:39.708847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:39.708850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:39.708879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255790845565251:9899]
2025-10-01T14:11:39.708886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:39.708888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:39.708866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1431
2025-10-01T14:11:39.708874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1431
2025-10-01T14:11:39.708918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.708926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.708959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:39.708968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.708970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.708972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:39.708979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.708991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:39.709009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.709117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.709121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.709130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.709199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1432 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0
2025-10-01T14:11:39.709546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d93a694-e70843df-423b1d89-7b9ecd2a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:39.717650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0] Write session: try to update token
2025-10-01T14:11:39.717672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:39.728900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:39.728924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:39.728927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:39.728929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:39.728939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255790845565251:9899]
2025-10-01T14:11:39.728944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255790845565251:9899]
2025-10-01T14:11:39.728948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255790845565251:9899]
2025-10-01T14:11:39.729002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:39.729008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:39.729012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:39.729013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:39.729022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.729024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:39.729165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:39.731540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1432 sessionId: src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:39.734153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:39.780208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255793222446135:3745]
2025-10-01T14:11:39.780498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1431, pipe: [1:7556255793222446135:3745]
2025-10-01T14:11:39.890936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:39.891388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.891402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.891441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222446135:3745], now have 1 active actors on pipe
2025-10-01T14:11:39.891632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:39.892290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:39.892300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0] Write session will restart in 0.008611s
2025-10-01T14:11:39.892318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0] Write session: Do CDS request
2025-10-01T14:11:39.892323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:39.891698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255793222446135:3745]
2025-10-01T14:11:39.891734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:39.891804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1432 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0
2025-10-01T14:11:39.891998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1432 sessionId: src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0 is DEAD
2025-10-01T14:11:39.892088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:39.902099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.902469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:39.902485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1433
2025-10-01T14:11:39.902635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:39.902667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:39.902672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:39.902676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:39.903148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1433 sessionId:  describe result for acl check
2025-10-01T14:11:39.903185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:39.903187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:39.903189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:39.903194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255793222446183:3468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:39.903697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255793222446183:3468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:39.911106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255793222446183:3468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:39.913238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:39.916220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:39.916597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:39.916608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:39.916620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:39.916452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255793222446183:3468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:39.916471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255793222446183:3468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:39.916475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255793222446183:3468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:39.916484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:39.916686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:39.916731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255790845565518:9901]
2025-10-01T14:11:39.917457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:39.917757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:39.917799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:39.918177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:39.918231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.918237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.918238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.918239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.918241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.918242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.918243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.918244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.918245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.918247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.918248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.918249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.918250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.918251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.918257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.918267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.918271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.918275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.918278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.918282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.918286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.918289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.918293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.918298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.918302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.918305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.918309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.918312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.918320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.918327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:39.918334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.918339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:39.918364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.918401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:39.918410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.918415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:39.918419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.918425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:39.918433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.918438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:39.918447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.918452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:39.918460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.918465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:39.918474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.918478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:39.918487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.918492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.918497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.918502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.918510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.918516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.918524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.918529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:39.918533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.918544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:39.918584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:39.922715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:39.923760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:39.923776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:39.923779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:39.923783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:39.923790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1432 [2:7556255790845565518:9901]
2025-10-01T14:11:39.923807Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:39.923827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:39.923835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.923839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.923842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.923871Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:39.923881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:39.923887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:39.923950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.923962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.923964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.923968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:39.923971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:39.924044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:39.924052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.924065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:39.924075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:39.924092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:39.924116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222446140:2446], now have 1 active actors on pipe
2025-10-01T14:11:39.924124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222446399:3468], now have 1 active actors on pipe
2025-10-01T14:11:39.924131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255790845565513:9901]
2025-10-01T14:11:39.924138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255790845565513:9901]
2025-10-01T14:11:39.924140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255790845565513:9901]
2025-10-01T14:11:39.924152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:39.924171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:39.924171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:39.924174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:39.924176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:39.924189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:39.924192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:39.924228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255790845565513:9901]
2025-10-01T14:11:39.924238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:39.924246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:39.925152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.925167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.925198Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:39.925209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:39.925214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:39.925216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:39.925228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:39.925241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:39.924875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1432
2025-10-01T14:11:39.925264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.924922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1432
2025-10-01T14:11:39.925567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.925577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.925596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:39.925697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1433 partition: 0 MaxSeqNo: 45 sessionId: src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0
2025-10-01T14:11:39.926145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cbc213-de1f2c2d-491bcfda-93aaaa25_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:39.928957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0] Write session: try to update token
2025-10-01T14:11:39.928979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:39.938798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:39.938819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:39.938828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255790845565513:9901]
2025-10-01T14:11:39.938855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:39.938868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:39.939046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:39.939196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:39.939339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:39.939573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:39.939880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:39.939924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:39.947919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1433 sessionId: src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:39.950649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:39.950683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:39.950720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:39.950409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:39.950900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:39.963387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:39.963412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:39.963415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:39.963417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:39.963428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255790845565513:9901]
2025-10-01T14:11:39.963432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255790845565513:9901]
2025-10-01T14:11:39.963436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255790845565513:9901]
2025-10-01T14:11:39.963487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:39.963503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:39.963506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:39.963516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:39.963525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:39.963529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:39.963675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:39.992112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255793222446412:3745]
2025-10-01T14:11:39.992394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1432, pipe: [1:7556255793222446412:3745]
2025-10-01T14:11:40.118715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:40.125398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.125424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.125565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.125619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.125676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.125734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.125774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.125781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.125839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.125896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.125976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.126032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.126072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.126077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.126129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.126178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.126229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.126279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.126319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.126324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.126430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.126493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.126540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.126610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.126648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.126653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.126728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.126801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.126851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.126903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.126943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.126949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.127001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.127060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.127116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.127169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.127208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.127213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.127268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.127327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.127384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.127437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.127479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.127481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.127542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.127597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.127647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.127699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.127741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.127747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.127802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.127864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.127917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.127973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.128069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.128074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.128135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.128193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.128248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.128303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.128346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.128353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.128395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255793222446412:3745], now have 1 active actors on pipe
2025-10-01T14:11:40.128574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:40.128583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:40.128586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:40.128618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255793222446412:3745]
2025-10-01T14:11:40.128619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1433 reason: error at write: Disconnected sessionId: src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0
2025-10-01T14:11:40.128832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1433 sessionId: src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0 is DEAD
2025-10-01T14:11:40.128947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:40.128954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0] Write session will restart in 0.009215s
2025-10-01T14:11:40.128973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0] Write session: Do CDS request
2025-10-01T14:11:40.128977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:40.129232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:40.138856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:40.138911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:40.138922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1434
2025-10-01T14:11:40.139071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:40.139102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:40.139109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:40.139111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:40.139362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1434 sessionId:  describe result for acl check
2025-10-01T14:11:40.139384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:40.139386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:40.139386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:40.139389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255797517413856:3452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:40.139687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255797517413856:3452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:40.141540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255797517413856:3452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:40.143831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255797517413856:3452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:40.143843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255797517413856:3452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:40.143847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255797517413856:3452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:40.143853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:40.144323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:40.146881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:40.147082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:40.147092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:40.147100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:40.147138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:40.147175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255795140533101:9907]
2025-10-01T14:11:40.147701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:40.148004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:40.148066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:40.148324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:40.148364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.148365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.148365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.148366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.148367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.148368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.148368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.148369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.148370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.148370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.148371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.148372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.148372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.148373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.148377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.148382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.148384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.148386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.148389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.148391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.148393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.148395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.148397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.148399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.148402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.148404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.148406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.148407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.148412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.148417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.148421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.148424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.148426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.148429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.148432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.148434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.148437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.148440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.148444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.148448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.148452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.148457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.148461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.148465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.148469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.148475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.148479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.148483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.148485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.148488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.148490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.148492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.148495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.148499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.148502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.148507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.148540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:40.152198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:40.152965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:40.152976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:40.152978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:40.152980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:40.152985Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1433 [2:7556255795140533101:9907]
2025-10-01T14:11:40.152998Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:40.153008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:40.153010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:40.153013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:40.153014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:40.153028Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:40.153034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:40.153040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:40.153097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.153104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.153106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.153109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:40.153112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:40.153164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:40.153169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.153177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.153182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.153192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:40.153207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255795140533096:9907]
2025-10-01T14:11:40.153211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255795140533096:9907]
2025-10-01T14:11:40.153212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255795140533096:9907]
2025-10-01T14:11:40.153220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:40.153229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:40.153232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:40.153232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414003:3452], now have 1 active actors on pipe
2025-10-01T14:11:40.153234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:40.153238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:40.153249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:40.153256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:40.153261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517413735:2446], now have 1 active actors on pipe
2025-10-01T14:11:40.153284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255795140533096:9907]
2025-10-01T14:11:40.153294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:40.153305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:40.153301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1433
2025-10-01T14:11:40.153308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1433
2025-10-01T14:11:40.153358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.153366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.153393Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:40.153405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:40.153410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:40.153412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:40.153420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:40.153429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:40.153442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:40.153570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.153580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.153595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:40.153727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1434 partition: 0 MaxSeqNo: 45 sessionId: src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0
2025-10-01T14:11:40.154068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f9fbceb-9816b4a0-d11ad99-b3fff692_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:40.156504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0] Write session: try to update token
2025-10-01T14:11:40.156523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:40.164242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:40.164258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:40.164267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255795140533096:9907]
2025-10-01T14:11:40.164303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:40.164308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:40.164458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:40.164653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:40.164864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:40.165067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:40.165367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:40.165423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:40.170812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1434 sessionId: src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:40.173319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:40.173480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.173500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.173538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:40.173606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:40.182673Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:40.182693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:40.182696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:40.182698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:40.182711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255795140533096:9907]
2025-10-01T14:11:40.182715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255795140533096:9907]
2025-10-01T14:11:40.182719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255795140533096:9907]
2025-10-01T14:11:40.182765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:40.182769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:40.182773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.182775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:40.182782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:40.182785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:40.182904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:40.228644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255797517414016:3745]
2025-10-01T14:11:40.228978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1433, pipe: [1:7556255797517414016:3745]
2025-10-01T14:11:40.338714Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:40.346691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.346717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.346855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.346907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.346964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.347017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.347057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.347064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.347118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.347167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.347216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.347268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.347310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.347315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.347377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.347433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.347500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.347556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.347594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.347599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.347656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.347710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.347764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.347819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.347860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.347865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.347923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.347986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.348041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.348095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.348138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.348147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.348209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.348268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.348320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.348375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.348414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.348420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.348482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.348535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.348590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.348646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.348715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.348721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.348778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.348831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.348886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.348945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.348989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.348997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.349055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.349105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.349164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.349246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.349292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.349297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.349382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.349437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.349490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.349550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.349589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.349598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.349662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414016:3745], now have 1 active actors on pipe
2025-10-01T14:11:40.349896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255797517414016:3745]
2025-10-01T14:11:40.349905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:40.349908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:40.349926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:40.349948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1434 reason: error at write: Disconnected sessionId: src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0
2025-10-01T14:11:40.350180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1434 sessionId: src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0 is DEAD
2025-10-01T14:11:40.350274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:40.350283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0] Write session will restart in 0.007903s
2025-10-01T14:11:40.350308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0] Write session: Do CDS request
2025-10-01T14:11:40.350314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:40.350806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:40.359936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:40.359973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:40.359990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1435
2025-10-01T14:11:40.360143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:40.360173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:40.360182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:40.360185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:40.360514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1435 sessionId:  describe result for acl check
2025-10-01T14:11:40.360539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:40.360544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:40.360545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:40.360550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255797517414102:3450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:40.361040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255797517414102:3450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:40.364017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255797517414102:3450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:40.366420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255797517414102:3450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:40.366435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255797517414102:3450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:40.366438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255797517414102:3450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:40.366446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:40.366821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:40.369021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:40.369195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:40.369206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:40.369216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:40.369268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:40.369305Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255795140533396:9915]
2025-10-01T14:11:40.369921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:40.370187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:40.370223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:40.370527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:40.370576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.370581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.370583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.370584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.370585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.370586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.370587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.370588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.370590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.370591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.370592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.370594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.370595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.370596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.370602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.370612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.370617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.370621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.370630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.370636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.370644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.370647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.370656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.370664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.370673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.370677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.370681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.370685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.370695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.370706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.370716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.370723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.370731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.370740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.370748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.370757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.370763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.370772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.370780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.370791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.370797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.370803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.370812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.370821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.370829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.370838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.370846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.370852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.370860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.370869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.370877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.370885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.370895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.370904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.370912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.370917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.370956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:40.374478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:40.375064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:40.375080Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:40.375083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:40.375086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:40.375093Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1434 [2:7556255795140533396:9915]
2025-10-01T14:11:40.375107Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:40.375128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:40.375135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:40.375138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:40.375140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:40.375155Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:40.375164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:40.375175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:40.375231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.375239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.375241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.375244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:40.375247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:40.375309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:40.375317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.375328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.375339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.375354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:40.375370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414021:2446], now have 1 active actors on pipe
2025-10-01T14:11:40.375378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414282:3450], now have 1 active actors on pipe
2025-10-01T14:11:40.375385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255795140533391:9915]
2025-10-01T14:11:40.375388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255795140533391:9915]
2025-10-01T14:11:40.375390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255795140533391:9915]
2025-10-01T14:11:40.375405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:40.375423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:40.375430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:40.375420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1434
2025-10-01T14:11:40.375434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:40.375427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1434
2025-10-01T14:11:40.375436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:40.375442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:40.375444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:40.375468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255795140533391:9915]
2025-10-01T14:11:40.375475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:40.375477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:40.375494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.375504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.375547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:40.375558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:40.375562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:40.375568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:40.375576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:40.375584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:40.375604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:40.375740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.375748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.375764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:40.375834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1435 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0
2025-10-01T14:11:40.376175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f55e1ad8-a0488038-49ab6994-e1d8a48d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:40.378590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0] Write session: try to update token
2025-10-01T14:11:40.378606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:40.392661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1435 sessionId: src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:40.394989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:40.396400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.396424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.396444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:40.396447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:40.396449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:40.396452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:40.396460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255795140533391:9915]
2025-10-01T14:11:40.396469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255795140533391:9915]
2025-10-01T14:11:40.396473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255795140533391:9915]
2025-10-01T14:11:40.396529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:40.396542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.396544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:40.396546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:40.396553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:40.396557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:40.396664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:40.449830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255797517414302:3745]
2025-10-01T14:11:40.450105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1434, pipe: [1:7556255797517414302:3745]
2025-10-01T14:11:40.546912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:40.547590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:40.547648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414302:3745], now have 1 active actors on pipe
2025-10-01T14:11:40.547961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:40.548054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:40.548062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:40.548133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1435 reason: error at write: Disconnected sessionId: src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0
2025-10-01T14:11:40.548350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1435 sessionId: src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0 is DEAD
2025-10-01T14:11:40.548488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:40.548499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0] Write session will restart in 0.009704s
2025-10-01T14:11:40.548524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0] Write session: Do CDS request
2025-10-01T14:11:40.548530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:40.548538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255797517414302:3745]
2025-10-01T14:11:40.548557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:40.559888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:40.560053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:40.560067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1436
2025-10-01T14:11:40.560157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:40.560179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:40.560186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:40.560189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:40.560507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1436 sessionId:  describe result for acl check
2025-10-01T14:11:40.560533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:40.560537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:40.560539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:40.560543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255797517414362:3443] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:40.560965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255797517414362:3443] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:40.562625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255797517414362:3443] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:40.565904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255797517414362:3443] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:40.565920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255797517414362:3443] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:40.565923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255797517414362:3443] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:40.565931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:40.570431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:40.573013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:40.573239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:40.573253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:40.573265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:40.573318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:40.573363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255795140533664:9922]
2025-10-01T14:11:40.573967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:40.574281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:40.574328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:40.574637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:40.574702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.574708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.574710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.574710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.574712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.574713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.574714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.574715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.574716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.574717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.574718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.574719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.574720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.574721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.574727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.574737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.574740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.574744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.574747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.574751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.574754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.574757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.574761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.574765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.574768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.574771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.574775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.574778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.574785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.574792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.574798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.574804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.574808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.574813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.574817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.574822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.574827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.574831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.574835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.574840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.574845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.574850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.574854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.574859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.574870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.574874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.574878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.574887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.574891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.574896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.574904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.574909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.574918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.574924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.574932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.574936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.574976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:40.579195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:40.579929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:40.579951Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:40.579954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:40.579958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:40.579966Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1435 [2:7556255795140533664:9922]
2025-10-01T14:11:40.579983Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:40.580002Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:40.580011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:40.580015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:40.580017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:40.580034Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:40.580044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:40.580050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:40.580119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.580127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.580129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.580133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:40.580136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:40.580203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:40.580211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.580223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.580239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.580264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:40.580283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414305:2446], now have 1 active actors on pipe
2025-10-01T14:11:40.580291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414477:3443], now have 1 active actors on pipe
2025-10-01T14:11:40.580299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255795140533659:9922]
2025-10-01T14:11:40.580305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255795140533659:9922]
2025-10-01T14:11:40.580307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255795140533659:9922]
2025-10-01T14:11:40.580321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:40.580335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:40.580353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:40.580361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:40.580365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1435
2025-10-01T14:11:40.580378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:40.580389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:40.580391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1435
2025-10-01T14:11:40.580391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:40.580397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255795140533659:9922]
2025-10-01T14:11:40.580400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:40.580403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:40.580452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.580463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.580488Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6632572b-601432b7-a66512a6-9b394f3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:40.580499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:40.580505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:40.580512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:40.580521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:40.580534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:40.580551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:40.580705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.580713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.580727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:40.580793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1436 partition: 0 MaxSeqNo: 45 sessionId: src_id|6632572b-601432b7-a66512a6-9b394f3e_0
2025-10-01T14:11:40.581209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a75d62b-b49c7d30-646596eb-9e21d25b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6632572b-601432b7-a66512a6-9b394f3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:40.583788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6632572b-601432b7-a66512a6-9b394f3e_0] Write session: try to update token
2025-10-01T14:11:40.583803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6632572b-601432b7-a66512a6-9b394f3e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:40.592378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:40.592401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:40.592412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255795140533659:9922]
2025-10-01T14:11:40.592462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:40.592466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:40.592663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:40.592835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:40.592990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:40.593144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:40.593434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:40.593478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:40.601552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1436 sessionId: src_id|6632572b-601432b7-a66512a6-9b394f3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:40.603912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:40.604085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.604105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.604140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:40.604213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:40.612471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:40.612489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:40.612492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:40.612494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:40.612504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255795140533659:9922]
2025-10-01T14:11:40.612509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255795140533659:9922]
2025-10-01T14:11:40.612512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255795140533659:9922]
2025-10-01T14:11:40.612557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:40.612558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:40.612563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:40.612567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:40.612568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.612571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:40.612741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:40.648514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255797517414579:3745]
2025-10-01T14:11:40.648864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1435, pipe: [1:7556255797517414579:3745]
2025-10-01T14:11:40.759628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:40.767551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.767574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.767719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.767774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.767834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.767892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.767938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.767945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.768003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.768058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.768116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.768178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.768218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.768224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.768279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.768332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.768666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.768731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.768773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.768778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.768835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.768886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.768938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.768988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.769026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.769031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.769085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.769134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.769185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.769236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.769280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.769286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.769342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.769410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.769469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.769526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.769578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.769586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.769642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.769694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.769750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.769809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.769849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.769855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.769919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.769974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.770028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.770084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.770186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.770192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.770252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.770304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.770360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.770443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.770487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.770495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.770559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:40.770615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:40.770682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:40.770739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:40.770779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:40.770784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:40.770837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414579:3745], now have 1 active actors on pipe
2025-10-01T14:11:40.771095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255797517414579:3745]
2025-10-01T14:11:40.771144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:40.771146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:40.771173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1436 reason: error at write: Disconnected sessionId: src_id|6632572b-601432b7-a66512a6-9b394f3e_0
2025-10-01T14:11:40.771210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:40.771402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1436 sessionId: src_id|6632572b-601432b7-a66512a6-9b394f3e_0 is DEAD
2025-10-01T14:11:40.771546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6632572b-601432b7-a66512a6-9b394f3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:40.771559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6632572b-601432b7-a66512a6-9b394f3e_0] Write session will restart in 0.009026s
2025-10-01T14:11:40.771585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6632572b-601432b7-a66512a6-9b394f3e_0] Write session: Do CDS request
2025-10-01T14:11:40.771591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6632572b-601432b7-a66512a6-9b394f3e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:40.772016Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:40.781953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6632572b-601432b7-a66512a6-9b394f3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:40.782046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:40.782062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1437
2025-10-01T14:11:40.782177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:40.782210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:40.782225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:40.782231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:40.783115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1437 sessionId:  describe result for acl check
2025-10-01T14:11:40.783164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:40.783166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:40.783167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:40.783173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255797517414624:3439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:40.783690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255797517414624:3439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:40.789875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255797517414624:3439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:40.793378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255797517414624:3439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:40.793407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255797517414624:3439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:40.793410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255797517414624:3439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:40.793418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:40.803230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:40.806009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:40.806228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:40.806238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:40.806248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:40.806288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:40.806325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255795140533932:9924]
2025-10-01T14:11:40.806994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:40.807295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:40.807331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:40.807625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:40.807671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.807672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.807673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.807674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.807675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.807677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.807678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.807680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.807681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.807682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.807683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.807684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.807685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.807687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.807691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.807701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.807705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.807709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.807713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.807717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.807721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.807724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.807728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.807732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.807735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.807738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.807742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.807745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.807752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.807758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:40.807764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.807769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:40.807774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.807779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:40.807783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.807788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:40.807793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.807798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:40.807802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.807807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:40.807812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.807817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:40.807821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.807826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:40.807830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.807835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:40.807839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.807844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.807851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.807862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.807866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.807876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.807880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.807885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:40.807893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.807898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:40.807935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:40.814134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:40.814979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:40.814998Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:40.815001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:40.815005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:40.815012Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1436 [2:7556255795140533932:9924]
2025-10-01T14:11:40.815030Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:40.815053Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:40.815061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:40.815064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:40.815067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:40.815086Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:40.815101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:40.815108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:40.815175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.815183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.815186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.815190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:40.815194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:40.815265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:40.815273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.815287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:40.815304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:40.815327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:40.815351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255795140533927:9924]
2025-10-01T14:11:40.815358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255795140533927:9924]
2025-10-01T14:11:40.815360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255795140533927:9924]
2025-10-01T14:11:40.815377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:40.815397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:40.815418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:40.815422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:40.815461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255795140533927:9924]
2025-10-01T14:11:40.815469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:40.815500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414581:2446], now have 1 active actors on pipe
2025-10-01T14:11:40.815509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414774:3439], now have 1 active actors on pipe
2025-10-01T14:11:40.815523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:40.815533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:40.815535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:40.815544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:40.815603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1436
2025-10-01T14:11:40.815653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1436
2025-10-01T14:11:40.815863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.815878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.815906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|510b84f7-f647f4d0-e9cd742-4e393559_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:40.815919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:40.815924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:40.815927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:40.815936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:40.815948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:40.815964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:40.816163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.816172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.816189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:40.816283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1437 partition: 0 MaxSeqNo: 45 sessionId: src_id|510b84f7-f647f4d0-e9cd742-4e393559_0
2025-10-01T14:11:40.816736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6632572b-601432b7-a66512a6-9b394f3e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|510b84f7-f647f4d0-e9cd742-4e393559_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:40.819246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|510b84f7-f647f4d0-e9cd742-4e393559_0] Write session: try to update token
2025-10-01T14:11:40.819266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|510b84f7-f647f4d0-e9cd742-4e393559_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:40.836465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1437 sessionId: src_id|510b84f7-f647f4d0-e9cd742-4e393559_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:40.836800Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:40.836824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:40.836827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:40.836829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:40.836839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255795140533927:9924]
2025-10-01T14:11:40.836844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255795140533927:9924]
2025-10-01T14:11:40.836848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255795140533927:9924]
2025-10-01T14:11:40.836899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:40.836911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:40.836914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:40.837018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:40.837029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:40.837033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:40.837101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:40.840164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:40.871219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255797517414859:3745]
2025-10-01T14:11:40.871541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1436, pipe: [1:7556255797517414859:3745]
2025-10-01T14:11:40.992734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:40.993042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:40.993057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:40.993103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414859:3745], now have 1 active actors on pipe
2025-10-01T14:11:40.993321Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:40.993331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:40.993348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:40.993352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:40.993375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255797517414859:3745]
2025-10-01T14:11:40.993409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1437 reason: error at write: Disconnected sessionId: src_id|510b84f7-f647f4d0-e9cd742-4e393559_0
2025-10-01T14:11:40.993601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1437 sessionId: src_id|510b84f7-f647f4d0-e9cd742-4e393559_0 is DEAD
2025-10-01T14:11:40.993735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510b84f7-f647f4d0-e9cd742-4e393559_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:40.993744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510b84f7-f647f4d0-e9cd742-4e393559_0] Write session will restart in 0.009296s
2025-10-01T14:11:40.993777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510b84f7-f647f4d0-e9cd742-4e393559_0] Write session: Do CDS request
2025-10-01T14:11:40.993783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510b84f7-f647f4d0-e9cd742-4e393559_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:41.003942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|510b84f7-f647f4d0-e9cd742-4e393559_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.003981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:41.004011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1438
2025-10-01T14:11:41.004203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.004237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:41.004247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:41.004254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:41.004637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1438 sessionId:  describe result for acl check
2025-10-01T14:11:41.004686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:41.004688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:41.004689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:41.004694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255801812382253:3431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:41.005227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255801812382253:3431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:41.008228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255801812382253:3431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:41.010825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255801812382253:3431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:41.010844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255801812382253:3431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:41.010848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255801812382253:3431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:41.010857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:41.011185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:41.014015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:41.014244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:41.014257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:41.014268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:41.014322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:41.014365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255799435501510:9928]
2025-10-01T14:11:41.014983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:41.015295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:41.015345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:41.015655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:41.015715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.015722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.015723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.015725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.015726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.015727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.015728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.015731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.015732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.015733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.015734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.015736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.015737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.015738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.015744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.015754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.015758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.015762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.015765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.015769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.015773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.015776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.015780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.015784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.015793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.015797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.015805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.015809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.015820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.015831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.015841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.015850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.015858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.015869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.015877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.015882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.015887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.015892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.015896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.015906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.015914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.015924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.015932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.015942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.015950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.015960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.015969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.015977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.015985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.015993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.016001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.016006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.016014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.016023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.016031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.016036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.016077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:41.019924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:41.020550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:41.020568Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:41.020571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:41.020574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:41.020582Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1437 [2:7556255799435501510:9928]
2025-10-01T14:11:41.020599Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:41.020621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:41.020628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.020632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.020635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.020652Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:41.020661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:41.020668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:41.020740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.020747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.020750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.020769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:41.020772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:41.020846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:41.020855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.020863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.020873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.020887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:41.020907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812382421:3431], now have 1 active actors on pipe
2025-10-01T14:11:41.020914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255797517414864:2446], now have 1 active actors on pipe
2025-10-01T14:11:41.020921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255799435501505:9928]
2025-10-01T14:11:41.020927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255799435501505:9928]
2025-10-01T14:11:41.020929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255799435501505:9928]
2025-10-01T14:11:41.020943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:41.020959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:41.020959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:41.020963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:41.020965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:41.020980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:41.020984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:41.020974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1437
2025-10-01T14:11:41.021019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255799435501505:9928]
2025-10-01T14:11:41.021029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1437
2025-10-01T14:11:41.021030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:41.021049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:41.021074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.021083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.021108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:41.021118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.021122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.021125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:41.021134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.021147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:41.021166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.021323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.021337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.021362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.021465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1438 partition: 0 MaxSeqNo: 45 sessionId: src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0
2025-10-01T14:11:41.021821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|510b84f7-f647f4d0-e9cd742-4e393559_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:41.024325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0] Write session: try to update token
2025-10-01T14:11:41.024342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:41.039288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:41.039312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:41.039324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255799435501505:9928]
2025-10-01T14:11:41.039373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:41.039377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:41.039547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:41.039693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:41.039833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:41.039966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:41.040203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:41.040207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1438 sessionId: src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:41.040257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:41.042689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:41.042876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.042895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.042931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:41.043008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:41.052410Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:41.052428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:41.052430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:41.052432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:41.052445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255799435501505:9928]
2025-10-01T14:11:41.052449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255799435501505:9928]
2025-10-01T14:11:41.052453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255799435501505:9928]
2025-10-01T14:11:41.052499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:41.052509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:41.052510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.052513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:41.052514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:41.052521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:41.052645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:41.093376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255801812382447:3745]
2025-10-01T14:11:41.093639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1437, pipe: [1:7556255801812382447:3745]
2025-10-01T14:11:41.195569Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:41.203843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.203876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.204045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.204106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.204167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.204226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.204270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.204280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.204342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.204395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.204456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.204515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.204563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.204571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.204637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.204796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.204870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.204944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.204995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.205004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.205071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.205133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.205192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.205257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.205310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.205317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.205384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.205445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.205507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.205571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.205614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.205621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.205687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.205747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.205809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.205875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.205917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.205924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.205999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.206065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.206136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.206207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.206257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.206265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.206334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.206412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.206477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.206534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.206588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.206593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.206652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.206706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.206763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.206818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.206857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.206862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.206919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.206978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.207039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.207096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.207135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.207140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.207201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812382447:3745], now have 1 active actors on pipe
2025-10-01T14:11:41.207449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255801812382447:3745]
2025-10-01T14:11:41.207479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:41.207509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:41.207530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:41.207568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1438 reason: error at write: Disconnected sessionId: src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0
2025-10-01T14:11:41.207844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1438 sessionId: src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0 is DEAD
2025-10-01T14:11:41.207942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:41.207952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0] Write session will restart in 0.009648s
2025-10-01T14:11:41.207977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0] Write session: Do CDS request
2025-10-01T14:11:41.207983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:41.208233Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:41.218932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.219056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:41.219073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1439
2025-10-01T14:11:41.219180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.219208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:41.219217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:41.219220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:41.219547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1439 sessionId:  describe result for acl check
2025-10-01T14:11:41.219570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:41.219575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:41.219576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:41.219579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255801812382557:3409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:41.220018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255801812382557:3409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:41.222993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255801812382557:3409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:41.225741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255801812382557:3409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:41.225753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255801812382557:3409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:41.225756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255801812382557:3409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:41.225762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:41.227001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:41.227395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:41.227594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:41.227608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:41.227621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:41.227685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:41.227729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255799435501787:9932]
2025-10-01T14:11:41.228268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:41.230061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:41.230120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:41.230461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:41.230535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.230540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.230541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.230542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.230543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.230544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.230545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.230546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.230547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.230548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.230549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.230550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.230551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.230552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.230558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.230567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.230570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.230573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.230577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.230580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.230583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.230587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.230590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.230593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.230596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.230599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.230603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.230606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.230613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.230620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.230625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.230630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.230633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.230638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.230642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.230646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.230651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.230655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.230675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.230679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.230683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.230688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.230696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.230701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.230705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.230710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.230718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.230722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.230726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.230732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.230740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.230744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.230748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.230753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.230761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.230765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.230806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:41.234442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:41.235110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:41.235122Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:41.235123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:41.235126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:41.235130Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1438 [2:7556255799435501787:9932]
2025-10-01T14:11:41.235142Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:41.235157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:41.235159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.235161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.235162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.235174Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:41.235178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:41.235183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:41.235225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.235232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.235233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.235236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:41.235238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:41.235293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:41.235299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.235306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.235312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.235321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:41.235333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255799435501782:9932]
2025-10-01T14:11:41.235338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255799435501782:9932]
2025-10-01T14:11:41.235340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255799435501782:9932]
2025-10-01T14:11:41.235346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:41.235355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:41.235356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:41.235359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:41.235363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:41.235364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:41.235365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:41.235372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812382473:2446], now have 1 active actors on pipe
2025-10-01T14:11:41.235375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812382733:3409], now have 1 active actors on pipe
2025-10-01T14:11:41.235391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255799435501782:9932]
2025-10-01T14:11:41.235398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:41.235406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:41.235460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1438
2025-10-01T14:11:41.235489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1438
2025-10-01T14:11:41.235543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.235551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.235569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:41.235575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.235578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.235580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:41.235588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.235595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:41.235604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.235751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.235756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.235766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.235836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1439 partition: 0 MaxSeqNo: 45 sessionId: src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0
2025-10-01T14:11:41.236149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b40c007-80b6e278-6d47c864-f4e864e4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:41.238705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0] Write session: try to update token
2025-10-01T14:11:41.238722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:41.246088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:41.246110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:41.246120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255799435501782:9932]
2025-10-01T14:11:41.246161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:41.246164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:41.246310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:41.246462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:41.246612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:41.246759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:41.246952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:41.246991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:41.254153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1439 sessionId: src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:41.257049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:41.257254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.257290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.257326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:41.257414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:41.266193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:41.266214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:41.266217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:41.266219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:41.266229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255799435501782:9932]
2025-10-01T14:11:41.266234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255799435501782:9932]
2025-10-01T14:11:41.266243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255799435501782:9932]
2025-10-01T14:11:41.266286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:41.266292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:41.266299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:41.266300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.266302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:41.266303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:41.266468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:41.307444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255801812382749:3745]
2025-10-01T14:11:41.307731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1438, pipe: [1:7556255801812382749:3745]
2025-10-01T14:11:41.421203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:41.430098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.430132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.430308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.430399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.430467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.430537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.430581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.430591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.430657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.430719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.430780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.430855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.430903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.430911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.430984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.431051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.431120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.431192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.431238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.431248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.433897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255801812382749:3745]
2025-10-01T14:11:41.433934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:41.433938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:41.433941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:41.433972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1439 reason: error at write: Disconnected sessionId: src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0
2025-10-01T14:11:41.434173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1439 sessionId: src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0 is DEAD
2025-10-01T14:11:41.434283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:41.434294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0] Write session will restart in 0.008613s
2025-10-01T14:11:41.434319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0] Write session: Do CDS request
2025-10-01T14:11:41.434325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:41.431326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.431396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.431462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.431530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.431663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.431666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.431739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.431801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.431864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.431929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.431973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.431976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.432051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.432117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.432182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.432247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.432288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.432292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.432367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.432427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.432492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.432558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.432604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.432607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.432690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.432748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.432811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.432877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.432917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.432920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.432996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.433059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.433123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.433193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.433239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.433243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.433317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:41.433377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:41.433436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:41.433499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:41.433540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:41.433542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:41.433624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812382749:3745], now have 1 active actors on pipe
2025-10-01T14:11:41.434905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:41.446925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.447295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:41.447328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1440
2025-10-01T14:11:41.447452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.447487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:41.447500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:41.447506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:41.447976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1440 sessionId:  describe result for acl check
2025-10-01T14:11:41.448009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:41.448011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:41.448013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:41.448019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255801812382779:3404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:41.448581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255801812382779:3404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:41.453793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255801812382779:3404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:41.458617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255801812382779:3404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:41.458635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255801812382779:3404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:41.458638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255801812382779:3404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:41.458648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:41.463885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:41.466017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:41.466244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:41.466258Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:41.466269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:41.466325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:41.466366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255799435502087:9944]
2025-10-01T14:11:41.466948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:41.467251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:41.467299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:41.467630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:41.467694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.467701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.467702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.467704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.467705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.467706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.467707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.467708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.467709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.467710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.467712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.467713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.467714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.467715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.467720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.467730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.467734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.467738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.467742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.467745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.467749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.467752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.467756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.467759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.467763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.467766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.467770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.467773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.467781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.467788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.467794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.467800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.467804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.467808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.467812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.467817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.467821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.467826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.467829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.467834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.467840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.467844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.467851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.467856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.467868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.467873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.467878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.467887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.467892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.467896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.467900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.467905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.467910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.467915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.467919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.467925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.467963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:41.471895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:41.472773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:41.472790Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:41.472793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:41.472797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:41.472804Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1439 [2:7556255799435502087:9944]
2025-10-01T14:11:41.472820Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:41.472839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:41.472842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.472846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.472849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.472864Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:41.472870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:41.472882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:41.472936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.472942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.472944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.472947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:41.472951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:41.473016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:41.473023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.473035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.473051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.473070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:41.473092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812382760:2446], now have 1 active actors on pipe
2025-10-01T14:11:41.473099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812382970:3404], now have 1 active actors on pipe
2025-10-01T14:11:41.473107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255799435502081:9944]
2025-10-01T14:11:41.473112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255799435502081:9944]
2025-10-01T14:11:41.473115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255799435502081:9944]
2025-10-01T14:11:41.473128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:41.473145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:41.473145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:41.473148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:41.473151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:41.473164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:41.473169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:41.473204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255799435502081:9944]
2025-10-01T14:11:41.473210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:41.473175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1439
2025-10-01T14:11:41.473212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:41.473187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1439
2025-10-01T14:11:41.473238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.473247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.473284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d12d9da0-62212133-d8a633fd-fb790578_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:41.473293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.473302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.473306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:41.473315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.473327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:41.473353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.473472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.473477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.473492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.473560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1440 partition: 0 MaxSeqNo: 45 sessionId: src_id|d12d9da0-62212133-d8a633fd-fb790578_0
2025-10-01T14:11:41.473995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33b9f0c6-e6ddf119-bb367868-4c24c221_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d12d9da0-62212133-d8a633fd-fb790578_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:41.476524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d12d9da0-62212133-d8a633fd-fb790578_0] Write session: try to update token
2025-10-01T14:11:41.476543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d12d9da0-62212133-d8a633fd-fb790578_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:41.493308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1440 sessionId: src_id|d12d9da0-62212133-d8a633fd-fb790578_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:41.494747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:41.494773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:41.494776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:41.494778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:41.494787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255799435502081:9944]
2025-10-01T14:11:41.494792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255799435502081:9944]
2025-10-01T14:11:41.494796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255799435502081:9944]
2025-10-01T14:11:41.494848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:41.494848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:41.494855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:41.494859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.494861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:41.494862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:41.495001Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:41.495876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:41.534265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255801812383039:3745]
2025-10-01T14:11:41.534517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1439, pipe: [1:7556255801812383039:3745]
2025-10-01T14:11:41.640057Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:41.640585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.640601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.640639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812383039:3745], now have 1 active actors on pipe
2025-10-01T14:11:41.640848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:41.641320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255801812383039:3745]
2025-10-01T14:11:41.641360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:41.641430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1440 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d12d9da0-62212133-d8a633fd-fb790578_0
2025-10-01T14:11:41.641636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1440 sessionId: src_id|d12d9da0-62212133-d8a633fd-fb790578_0 is DEAD
2025-10-01T14:11:41.641766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12d9da0-62212133-d8a633fd-fb790578_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:41.641783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12d9da0-62212133-d8a633fd-fb790578_0] Write session will restart in 0.006167s
2025-10-01T14:11:41.641807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12d9da0-62212133-d8a633fd-fb790578_0] Write session: Do CDS request
2025-10-01T14:11:41.641814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12d9da0-62212133-d8a633fd-fb790578_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:41.641813Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:41.648937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d12d9da0-62212133-d8a633fd-fb790578_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.649110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:41.649128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1441
2025-10-01T14:11:41.649231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.649263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:41.649275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:41.649278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:41.649706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1441 sessionId:  describe result for acl check
2025-10-01T14:11:41.649741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:41.649745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:41.649746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:41.649752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255801812383073:3396] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:41.650274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255801812383073:3396] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:41.653507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255801812383073:3396] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:41.656505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255801812383073:3396] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:41.656524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255801812383073:3396] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:41.656527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255801812383073:3396] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:41.656535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:41.659443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:41.662389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:41.662643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:41.662657Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:41.662670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:41.662732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:41.662778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255799435502360:9947]
2025-10-01T14:11:41.663364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:41.663705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:41.663763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:41.664106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:41.664176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.664184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.664185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.664186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.664187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.664188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.664189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.664190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.664192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.664193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.664194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.664195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.664196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.664197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.664203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.664214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.664218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.664222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.664226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.664231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.664235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.664238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.664242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.664247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.664250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.664254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.664258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.664262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.664271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.664279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.664285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.664290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.664294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.664299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.664303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.664308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.664313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.664318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.664324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.664329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.664335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.664339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.664343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.664347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.664352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.664357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.664360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.664364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.664369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.664374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.664378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.664383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.664387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.664392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.664397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.664402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.664443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:41.668493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:41.669123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:41.669140Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:41.669143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:41.669147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:41.669154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1440 [2:7556255799435502360:9947]
2025-10-01T14:11:41.669169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:41.669192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:41.669200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.669204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.669206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.669222Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:41.669232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:41.669243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:41.669302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.669310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.669312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.669315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:41.669318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:41.669387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:41.669394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.669407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.669423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.669440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:41.669467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812383044:2446], now have 1 active actors on pipe
2025-10-01T14:11:41.669473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812383279:3396], now have 1 active actors on pipe
2025-10-01T14:11:41.669481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255799435502355:9947]
2025-10-01T14:11:41.669488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255799435502355:9947]
2025-10-01T14:11:41.669491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255799435502355:9947]
2025-10-01T14:11:41.669507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:41.669524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:41.669524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:41.669527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:41.669528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:41.669542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:41.669501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1440
2025-10-01T14:11:41.669546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:41.669511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1440
2025-10-01T14:11:41.669598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.669606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.669624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255799435502355:9947]
2025-10-01T14:11:41.669637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:41.669647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:41.669664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:41.669675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.669680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.669682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:41.669691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.669704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:41.669735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.669923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.669931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.669947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.670009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1441 partition: 0 MaxSeqNo: 45 sessionId: src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0
2025-10-01T14:11:41.670411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d12d9da0-62212133-d8a633fd-fb790578_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:41.672773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0] Write session: try to update token
2025-10-01T14:11:41.672789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:41.687102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1441 sessionId: src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:41.689562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:41.690103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.690135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.690156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:41.690164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:41.690167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:41.690169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:41.690178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255799435502355:9947]
2025-10-01T14:11:41.690189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255799435502355:9947]
2025-10-01T14:11:41.690193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255799435502355:9947]
2025-10-01T14:11:41.690225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:41.690236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:41.690240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:41.690250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:41.690262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.690269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:41.690415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:41.741611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255801812383320:3745]
2025-10-01T14:11:41.741880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1440, pipe: [1:7556255801812383320:3745]
2025-10-01T14:11:41.849900Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:41.850396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:41.850470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812383320:3745], now have 1 active actors on pipe
2025-10-01T14:11:41.850576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:41.850752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:41.850828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255801812383320:3745]
2025-10-01T14:11:41.861604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:41.861620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0] Write session will restart in 0.009979s
2025-10-01T14:11:41.861652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0] Write session: Do CDS request
2025-10-01T14:11:41.861658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:41.861234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:41.861247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:41.861272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1441 reason: error at write: Disconnected sessionId: src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0
2025-10-01T14:11:41.861432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1441 sessionId: src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0 is DEAD
2025-10-01T14:11:41.872960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.873051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:41.873070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1442
2025-10-01T14:11:41.873202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:41.873237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:41.873248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:41.873251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:41.873832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1442 sessionId:  describe result for acl check
2025-10-01T14:11:41.873880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:41.873889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:41.873891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:41.873896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255801812383558:3392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:41.874305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255801812383558:3392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:41.875928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:41.877237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255801812383558:3392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:41.878428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:41.878636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:41.878645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:41.878653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:41.878689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:41.878716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255799435502633:9949]
2025-10-01T14:11:41.879274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:41.879617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:41.879675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:41.880113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255801812383558:3392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:41.880129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255801812383558:3392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:41.880133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255801812383558:3392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:41.880141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:41.880013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:41.880096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.880098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.880099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.880099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.880100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.880102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.880103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.880104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.880105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.880106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.880107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.880108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.880109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.880111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.880116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.880125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.880128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.880132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.880136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.880140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.880144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.880147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.880151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.880154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.880158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.880162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.880166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.880170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.880177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.880185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:41.880191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.880196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:41.880200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.880206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:41.880210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.880215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:41.880220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.880226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:41.880230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.880234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:41.880239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.880244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:41.880248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.880253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:41.880257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.880262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:41.880266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.880272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.880276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.880281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.880286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.880292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.880296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.880301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:41.880305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.880309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:41.880361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:41.884815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:41.885410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:41.885438Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:41.885442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:41.885445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:41.885452Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1441 [2:7556255799435502633:9949]
2025-10-01T14:11:41.885468Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:41.885487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:41.885496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.885500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.885502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.885520Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:41.885532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:41.885539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:41.885603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.885611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.885614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.885617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:41.885620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:41.885774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:41.885782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.885795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:41.885811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:41.885835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:41.885853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812383326:2446], now have 1 active actors on pipe
2025-10-01T14:11:41.885858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812383597:3392], now have 1 active actors on pipe
2025-10-01T14:11:41.885865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255799435502628:9949]
2025-10-01T14:11:41.885840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1441
2025-10-01T14:11:41.885843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1441
2025-10-01T14:11:41.885872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255799435502628:9949]
2025-10-01T14:11:41.885874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255799435502628:9949]
2025-10-01T14:11:41.885888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:41.885898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:41.885902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:41.885902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:41.885904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:41.885916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:41.885919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:41.885940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.885949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.886001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255799435502628:9949]
2025-10-01T14:11:41.886013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:41.886025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:41.886028Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:41.886035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:41.886039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:41.886041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:41.886049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:41.886057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:41.886096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.886254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.886263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.886277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:41.886349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1442 partition: 0 MaxSeqNo: 45 sessionId: src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0
2025-10-01T14:11:41.886735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83adddd7-3150863c-e6ba0181-dc0415ac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:41.890017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0] Write session: try to update token
2025-10-01T14:11:41.890033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:41.899496Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:41.899519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:41.899531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255799435502628:9949]
2025-10-01T14:11:41.899575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:41.899578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:41.899751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:41.899890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:41.900036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:41.900175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:41.900363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:41.900409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:41.904843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1442 sessionId: src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:41.907072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:41.907282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:41.907305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:41.907342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:41.907429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:41.925429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:41.925455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:41.925457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:41.925459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:41.925470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255799435502628:9949]
2025-10-01T14:11:41.925474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255799435502628:9949]
2025-10-01T14:11:41.925479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255799435502628:9949]
2025-10-01T14:11:41.925526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:41.925530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:41.925540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:41.925541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:41.925542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:41.925545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:41.925676Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:41.951027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255801812383606:3745]
2025-10-01T14:11:41.951238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1441, pipe: [1:7556255801812383606:3745]
2025-10-01T14:11:42.081827Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:42.089854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.089885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.090046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.090113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.090177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.090238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.090285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.090295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.090360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.090434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.090525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.090589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.090636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.090644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.090705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.090762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.090826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.090891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.090933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.090945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.091011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.091069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.091130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.091190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.091236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.091244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.091306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.091364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.091421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.091487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.091537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.091544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.091609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.091673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.091732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.091793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.091834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.091842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.091909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.091965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.092035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.092096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.092138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.092146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.092207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.092264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.092322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.092382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.092428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.092435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.092495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.092552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.092611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.092684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.092727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.092734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.092795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.092850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.092910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.092969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.093092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.093101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.093162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255801812383606:3745], now have 1 active actors on pipe
2025-10-01T14:11:42.093452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255801812383606:3745]
2025-10-01T14:11:42.093460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:42.093484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:42.093486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:42.093507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1442 reason: error at write: Disconnected sessionId: src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0
2025-10-01T14:11:42.093718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1442 sessionId: src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0 is DEAD
2025-10-01T14:11:42.093843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:42.093854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0] Write session will restart in 0.005694s
2025-10-01T14:11:42.093881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0] Write session: Do CDS request
2025-10-01T14:11:42.093887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:42.094306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:42.100898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.101042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:42.101059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1443
2025-10-01T14:11:42.101178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.101213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:42.101223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:42.101227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:42.101769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1443 sessionId:  describe result for acl check
2025-10-01T14:11:42.101804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:42.101810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:42.101812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:42.101817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255806107350932:3385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:42.102295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255806107350932:3385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:42.105289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255806107350932:3385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:42.108617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255806107350932:3385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:42.108634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255806107350932:3385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:42.108637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255806107350932:3385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:42.108645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:42.112217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:42.114873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:42.115061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:42.115070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:42.115080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:42.115120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:42.115152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255803730470217:9953]
2025-10-01T14:11:42.115806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:42.116062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:42.116105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:42.116332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:42.116371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.116376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.116376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.116377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.116378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.116382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.116383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.116383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.116384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.116385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.116385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.116386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.116387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.116387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.116401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.116408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.116411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.116413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.116415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.116417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.116419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.116421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.116423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.116426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.116428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.116430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.116432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.116434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.116440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.116445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.116449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.116452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.116455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.116457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.116460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.116462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.116465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.116468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.116470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.116473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.116475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.116478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.116480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.116483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.116486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.116489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.116491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.116494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.116497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.116502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.116511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.116516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.116520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.116524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.116527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.116532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.116556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:42.120428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:42.121193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:42.121209Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:42.121210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:42.121212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:42.121216Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1442 [2:7556255803730470217:9953]
2025-10-01T14:11:42.121225Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:42.121236Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:42.121238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.121240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.121241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.121253Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:42.121256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:42.121260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:42.121296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.121302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.121304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.121306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:42.121307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:42.121353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:42.121361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.121368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.121373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.121381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:42.121392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255803730470212:9953]
2025-10-01T14:11:42.121394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255803730470212:9953]
2025-10-01T14:11:42.121395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255803730470212:9953]
2025-10-01T14:11:42.121400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:42.121409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107350908:2446], now have 1 active actors on pipe
2025-10-01T14:11:42.121411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:42.121415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:42.121415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:42.121417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:42.121422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:42.121424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:42.121427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107351115:3385], now have 1 active actors on pipe
2025-10-01T14:11:42.121450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255803730470212:9953]
2025-10-01T14:11:42.121457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:42.121480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:42.121485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1442
2025-10-01T14:11:42.121535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1442
2025-10-01T14:11:42.122428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.122442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.122467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:42.122479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.122488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.122491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:42.122499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.122509Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:42.122527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.122723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.122731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.122745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.122838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1443 partition: 0 MaxSeqNo: 45 sessionId: src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0
2025-10-01T14:11:42.123195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fa9b9-a1fe1d0c-2e55b8b5-fc063daf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:42.125372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0] Write session: try to update token
2025-10-01T14:11:42.125387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:42.138254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1443 sessionId: src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:42.140584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:42.140803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.140830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.140867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:42.140947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:42.145723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:42.145741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:42.145744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:42.145746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:42.145756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255803730470212:9953]
2025-10-01T14:11:42.145762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255803730470212:9953]
2025-10-01T14:11:42.145765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255803730470212:9953]
2025-10-01T14:11:42.145813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:42.145827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.145830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:42.145862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:42.145877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:42.145880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:42.145959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:42.193723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255806107351224:3745]
2025-10-01T14:11:42.193950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1442, pipe: [1:7556255806107351224:3745]
2025-10-01T14:11:42.304822Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:42.313040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.313070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.313236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.313295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.313356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.313414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.313459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.313464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.313529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.313583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.313643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.313707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.313748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.313756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.313812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.313865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.313922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.313982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.314023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.314030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.314087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.314146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.314201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.314256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.314296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.314304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.314359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.314435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.314491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.314550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.314595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.314603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.314663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.314721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.314782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.314847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.314888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.314895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.314955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.315008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.315070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.315129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.315174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.315181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.315240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.315296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.315355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.315414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.315473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.315480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.315546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.315606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.315665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.315730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.315771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.315778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.315841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.315896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.315956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.316011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.316050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.316056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.316143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107351224:3745], now have 1 active actors on pipe
2025-10-01T14:11:42.316524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:42.316563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255806107351224:3745]
2025-10-01T14:11:42.316574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:42.316577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:42.316602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1443 reason: error at write: Disconnected sessionId: src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0
2025-10-01T14:11:42.316775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1443 sessionId: src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0 is DEAD
2025-10-01T14:11:42.316879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:42.316886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0] Write session will restart in 0.007623s
2025-10-01T14:11:42.316905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0] Write session: Do CDS request
2025-10-01T14:11:42.316909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:42.317252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:42.325941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.326010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:42.326025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1444
2025-10-01T14:11:42.326197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.326238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:42.326247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:42.326250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:42.326636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1444 sessionId:  describe result for acl check
2025-10-01T14:11:42.326682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:42.326688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:42.326690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:42.326695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255806107351277:3364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:42.327217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255806107351277:3364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:42.329853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255806107351277:3364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:42.333218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255806107351277:3364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:42.333236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255806107351277:3364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:42.333239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255806107351277:3364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:42.333247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:42.335979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:42.338780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:42.338936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:42.338944Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:42.338952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:42.338987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:42.339013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255803730470499:9957]
2025-10-01T14:11:42.339426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:42.339715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:42.339757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:42.340050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:42.340115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.340124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.340125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.340126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.340127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.340128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.340129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.340130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.340131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.340132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.340133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.340134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.340135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.340136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.340141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.340150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.340153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.340156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.340160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.340163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.340166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.340170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.340173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.340177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.340180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.340183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.340187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.340190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.340199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.340206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.340212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.340216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.340220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.340224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.340227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.340232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.340236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.340241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.340246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.340250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.340255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.340260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.340269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.340273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.340278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.340290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.340294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.340299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.340305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.340315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.340323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.340327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.340335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.340340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.340345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.340353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.340382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:42.344743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:42.345362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:42.345375Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:42.345377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:42.345379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:42.345384Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1443 [2:7556255803730470499:9957]
2025-10-01T14:11:42.345394Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:42.345406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:42.345408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.345410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.345412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.345424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:42.345428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:42.345433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:42.345482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.345490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.345492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.345495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:42.345498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:42.345562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:42.345568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.345578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.345588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.345607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:42.345627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107351227:2446], now have 1 active actors on pipe
2025-10-01T14:11:42.345634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107351448:3364], now have 1 active actors on pipe
2025-10-01T14:11:42.345641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255803730470494:9957]
2025-10-01T14:11:42.345644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255803730470494:9957]
2025-10-01T14:11:42.345646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255803730470494:9957]
2025-10-01T14:11:42.345658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:42.345672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:42.345673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:42.345676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:42.345678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:42.345683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:42.345684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:42.345665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1443
2025-10-01T14:11:42.345708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255803730470494:9957]
2025-10-01T14:11:42.345716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:42.345722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:42.345823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1443
2025-10-01T14:11:42.345867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.345875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.345893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41a7827e-3cae852a-a6ce6378-8979333f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:42.345901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.345904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.345906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:42.345913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.345919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:42.345933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.346075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.346088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.346110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.346189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1444 partition: 0 MaxSeqNo: 45 sessionId: src_id|41a7827e-3cae852a-a6ce6378-8979333f_0
2025-10-01T14:11:42.346529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d7aea0d-3995763-3c3b74f1-eb3870c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|41a7827e-3cae852a-a6ce6378-8979333f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:42.348698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a7827e-3cae852a-a6ce6378-8979333f_0] Write session: try to update token
2025-10-01T14:11:42.348712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a7827e-3cae852a-a6ce6378-8979333f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:42.362323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1444 sessionId: src_id|41a7827e-3cae852a-a6ce6378-8979333f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:42.364827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:42.365020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.365044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.365084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:42.365164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:42.369277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:42.369300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:42.369302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:42.369305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:42.369315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255803730470494:9957]
2025-10-01T14:11:42.369320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255803730470494:9957]
2025-10-01T14:11:42.369326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255803730470494:9957]
2025-10-01T14:11:42.369374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:42.369380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:42.369386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:42.369387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.369389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:42.369391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:42.369520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:42.416926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255806107351516:3745]
2025-10-01T14:11:42.417207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1443, pipe: [1:7556255806107351516:3745]
2025-10-01T14:11:42.520574Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:42.528526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.528556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.528714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.528774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.528831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.528891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.528933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.528942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.529001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.529052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.529108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.529166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.529207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.529213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.529265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.529315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.529369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.529418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.529462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.529477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.529540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.529593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.529644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.529695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.529733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.529737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.529788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.529836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.529889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.529940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.529978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.529983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.530037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.530085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.530142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.530197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.530240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.530246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.530296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.530345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.530425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.530484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.530522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.530527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.530580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.530628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.530679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.530732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.530772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.530777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.530831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.530884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.530941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.530996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.531039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.531044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.531098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.531149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.531203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.531253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.531291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.531296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.531347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107351516:3745], now have 1 active actors on pipe
2025-10-01T14:11:42.531560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:42.531570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255806107351516:3745]
2025-10-01T14:11:42.531597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:42.531599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:42.531624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1444 reason: error at write: Disconnected sessionId: src_id|41a7827e-3cae852a-a6ce6378-8979333f_0
2025-10-01T14:11:42.531824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1444 sessionId: src_id|41a7827e-3cae852a-a6ce6378-8979333f_0 is DEAD
2025-10-01T14:11:42.531935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a7827e-3cae852a-a6ce6378-8979333f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:42.531945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a7827e-3cae852a-a6ce6378-8979333f_0] Write session will restart in 0.007669s
2025-10-01T14:11:42.531973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a7827e-3cae852a-a6ce6378-8979333f_0] Write session: Do CDS request
2025-10-01T14:11:42.531979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a7827e-3cae852a-a6ce6378-8979333f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:42.532245Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:42.540830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41a7827e-3cae852a-a6ce6378-8979333f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.541577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:42.541594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1445
2025-10-01T14:11:42.541720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.541750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:42.541755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:42.541759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:42.542208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1445 sessionId:  describe result for acl check
2025-10-01T14:11:42.542241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:42.542246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:42.542249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:42.542253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255806107351566:3357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:42.542815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255806107351566:3357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:42.545477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255806107351566:3357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:42.549192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255806107351566:3357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:42.549209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255806107351566:3357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:42.549212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255806107351566:3357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:42.549221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:42.552172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:42.554871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:42.555114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:42.555124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:42.555138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:42.555190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:42.555230Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255803730470806:9970]
2025-10-01T14:11:42.555886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:42.556113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:42.556160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:42.556450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:42.556510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.556516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.556517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.556518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.556520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.556521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.556522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.556523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.556524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.556525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.556526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.556527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.556529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.556530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.556535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.556545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.556549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.556553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.556557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.556560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.556569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.556573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.556580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.556584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.556590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.556598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.556601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.556605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.556613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.556625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.556631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.556641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.556651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.556660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.556669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.556691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.556699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.556708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.556716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.556724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.556733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.556742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.556746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.556751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.556759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.556764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.556769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.556778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.556786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.556795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.556802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.556811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.556820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.556828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.556837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.556846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.556890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:42.561230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:42.561796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:42.561820Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:42.561823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:42.561827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:42.561834Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1444 [2:7556255803730470806:9970]
2025-10-01T14:11:42.561851Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:42.561869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:42.561870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.561872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.561874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.561886Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:42.561891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:42.561895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:42.561945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.561950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.561952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.561954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:42.561956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:42.562004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:42.562008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.562015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.562021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.562033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:42.562048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255803730470801:9970]
2025-10-01T14:11:42.562053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255803730470801:9970]
2025-10-01T14:11:42.562054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255803730470801:9970]
2025-10-01T14:11:42.562061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:42.562071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:42.562071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:42.562074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:42.562076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:42.562087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:42.562089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:42.562099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107351756:3357], now have 1 active actors on pipe
2025-10-01T14:11:42.562106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107351524:2446], now have 1 active actors on pipe
2025-10-01T14:11:42.562140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255803730470801:9970]
2025-10-01T14:11:42.562146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:42.562152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:42.562193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.562197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.562150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1444
2025-10-01T14:11:42.562153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1444
2025-10-01T14:11:42.562223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|420e53a-5d126254-d81b4e24-accb25a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:42.562233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.562238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.562244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:42.562254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.562262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:42.562281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.562413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.562421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.562434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.562492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1445 partition: 0 MaxSeqNo: 45 sessionId: src_id|420e53a-5d126254-d81b4e24-accb25a5_0
2025-10-01T14:11:42.562820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41a7827e-3cae852a-a6ce6378-8979333f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|420e53a-5d126254-d81b4e24-accb25a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:42.565037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420e53a-5d126254-d81b4e24-accb25a5_0] Write session: try to update token
2025-10-01T14:11:42.565052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420e53a-5d126254-d81b4e24-accb25a5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:42.578103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1445 sessionId: src_id|420e53a-5d126254-d81b4e24-accb25a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:42.580307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:42.580931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.580953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.580971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:42.580973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:42.580980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255803730470801:9970]
2025-10-01T14:11:42.581020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:42.581019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:42.581169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:42.581303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:42.581421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:42.581537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:42.581701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:42.581733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:42.581751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:42.581794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:42.597908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:42.597928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:42.597929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:42.597931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:42.597940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255803730470801:9970]
2025-10-01T14:11:42.597943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255803730470801:9970]
2025-10-01T14:11:42.597946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255803730470801:9970]
2025-10-01T14:11:42.597984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:42.597984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:42.597988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:42.597991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:42.597994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.597996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:42.598105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:42.631944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255806107351806:3745]
2025-10-01T14:11:42.632166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1444, pipe: [1:7556255806107351806:3745]
2025-10-01T14:11:42.738138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:42.745761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.745784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.745920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.745972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.746021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.746081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.746125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.746134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.746193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.746250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.746311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.746366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.746421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.746427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.746482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.746534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.746587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.746641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.746679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.746685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.746744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.746797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.746852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.748702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255806107351806:3745]
2025-10-01T14:11:42.748728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:42.748731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:42.748734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:42.748766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1445 reason: error at write: Disconnected sessionId: src_id|420e53a-5d126254-d81b4e24-accb25a5_0
2025-10-01T14:11:42.748945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1445 sessionId: src_id|420e53a-5d126254-d81b4e24-accb25a5_0 is DEAD
2025-10-01T14:11:42.749071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420e53a-5d126254-d81b4e24-accb25a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:42.749082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420e53a-5d126254-d81b4e24-accb25a5_0] Write session will restart in 0.008976s
2025-10-01T14:11:42.749106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420e53a-5d126254-d81b4e24-accb25a5_0] Write session: Do CDS request
2025-10-01T14:11:42.749112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420e53a-5d126254-d81b4e24-accb25a5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:42.746905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.746942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.746944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.746999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.747044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.747094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.747153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.747187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.747189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.747251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.747298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.747345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.747390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.747425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.747427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.747480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.747526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.747576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.747624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.747669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.747671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.747730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.747782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.747832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.747883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.747919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.747921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.747984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.748042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.748093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.748142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.748177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.748180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.748234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:42.748282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:42.748330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:42.748378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:42.748413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:42.748415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:42.748454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107351806:3745], now have 1 active actors on pipe
2025-10-01T14:11:42.749372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:42.761156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|420e53a-5d126254-d81b4e24-accb25a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.761268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:42.761283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1446
2025-10-01T14:11:42.761476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.761517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:42.761523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:42.761527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:42.762048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1446 sessionId:  describe result for acl check
2025-10-01T14:11:42.762092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:42.762094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:42.762096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:42.762102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255806107351929:3350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:42.762668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255806107351929:3350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:42.765445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255806107351929:3350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:42.770401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:42.770703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255806107351929:3350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:42.770721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255806107351929:3350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:42.770724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255806107351929:3350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:42.770732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:42.770893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:42.771080Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:42.771085Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:42.771096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:42.771141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:42.771174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255803730471082:9972]
2025-10-01T14:11:42.771756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:42.772056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:42.772110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:42.772404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:42.772468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.772474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.772476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.772477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.772478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.772479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.772480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.772481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.772483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.772484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.772485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.772486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.772487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.772488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.772494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.772504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.772508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.772512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.772520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.772524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.772528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.772532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.772536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.772544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.772548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.772556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.772564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.772571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.772578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.772590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.772601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.772610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.772619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.772627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.772636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.772645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.772649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.772654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.772662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.772682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.772687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.772692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.772700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.772706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.772710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.772719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.772723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.772732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.772736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.772741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.772748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.772753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.772762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.772766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.772772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.772776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.772829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:42.776450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:42.777075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:42.777093Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:42.777095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:42.777099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:42.777106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1445 [2:7556255803730471082:9972]
2025-10-01T14:11:42.777121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:42.777137Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:42.777139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.777143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.777145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.777161Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:42.777166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:42.777172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:42.777228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.777242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.777244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.777247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:42.777250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:42.777315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:42.777325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.777338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.777349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.777369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:42.777392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107352080:3350], now have 1 active actors on pipe
2025-10-01T14:11:42.777395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107351807:2446], now have 1 active actors on pipe
2025-10-01T14:11:42.777403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255803730471076:9972]
2025-10-01T14:11:42.777405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255803730471076:9972]
2025-10-01T14:11:42.777407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255803730471076:9972]
2025-10-01T14:11:42.777420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:42.777433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:42.777421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1445
2025-10-01T14:11:42.777447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:42.777422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1445
2025-10-01T14:11:42.777452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:42.777455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:42.777456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:42.777458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:42.777484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255803730471076:9972]
2025-10-01T14:11:42.777491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:42.777501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:42.777507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.777512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.777552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1af11c77-4777e868-1139a4f6-83648b74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:42.777563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.777566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.777569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:42.777577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.777590Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:42.777611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.777761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.777772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.777786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.777917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1446 partition: 0 MaxSeqNo: 45 sessionId: src_id|1af11c77-4777e868-1139a4f6-83648b74_0
2025-10-01T14:11:42.778278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|420e53a-5d126254-d81b4e24-accb25a5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1af11c77-4777e868-1139a4f6-83648b74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:42.780810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af11c77-4777e868-1139a4f6-83648b74_0] Write session: try to update token
2025-10-01T14:11:42.780828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af11c77-4777e868-1139a4f6-83648b74_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:42.794232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1446 sessionId: src_id|1af11c77-4777e868-1139a4f6-83648b74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:42.796788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:42.797945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.797975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.797995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:42.798005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:42.798008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:42.798010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:42.798018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255803730471076:9972]
2025-10-01T14:11:42.798022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255803730471076:9972]
2025-10-01T14:11:42.798027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255803730471076:9972]
2025-10-01T14:11:42.798082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:42.798084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:42.798090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.798092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:42.798099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:42.798103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:42.798219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:42.849066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255806107352094:3745]
2025-10-01T14:11:42.849415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1445, pipe: [1:7556255806107352094:3745]
2025-10-01T14:11:42.953804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:42.954063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:42.954117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107352094:3745], now have 1 active actors on pipe
2025-10-01T14:11:42.954191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:42.954312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255806107352094:3745]
2025-10-01T14:11:42.954340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:42.964781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:42.964793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:42.964811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1446 reason: error at write: Disconnected sessionId: src_id|1af11c77-4777e868-1139a4f6-83648b74_0
2025-10-01T14:11:42.964937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1446 sessionId: src_id|1af11c77-4777e868-1139a4f6-83648b74_0 is DEAD
2025-10-01T14:11:42.965082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af11c77-4777e868-1139a4f6-83648b74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:42.965090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af11c77-4777e868-1139a4f6-83648b74_0] Write session will restart in 0.006902s
2025-10-01T14:11:42.965115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af11c77-4777e868-1139a4f6-83648b74_0] Write session: Do CDS request
2025-10-01T14:11:42.965126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af11c77-4777e868-1139a4f6-83648b74_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:42.972910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af11c77-4777e868-1139a4f6-83648b74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.973047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:42.973063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1447
2025-10-01T14:11:42.973180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:42.973212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1447 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:42.973222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1447 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:42.973225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:42.973618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1447 sessionId:  describe result for acl check
2025-10-01T14:11:42.973654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:42.973656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:42.973657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:42.973660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255806107352333:3333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:42.974097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255806107352333:3333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:42.975701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:42.976516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255806107352333:3333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:42.978220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:42.978408Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:42.978418Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:42.978429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:42.978474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:42.978502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255803730471373:9976]
2025-10-01T14:11:42.978945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:42.979096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255806107352333:3333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:42.979111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255806107352333:3333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:42.979115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255806107352333:3333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:42.979122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1447 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:42.979184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:42.979215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:42.979429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:42.979479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.979486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.979487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.979488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.979489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.979490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.979491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.979492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.979493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.979494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.979495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.979497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.979498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.979499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.979504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.979513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.979516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.979518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.979520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.979522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.979524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.979526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.979527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.979530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.979532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.979534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.979536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.979538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.979543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.979547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:42.979551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.979555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:42.979557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.979560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:42.979562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.979565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:42.979568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.979570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:42.979573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.979576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:42.979578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.979581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:42.979583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.979586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:42.979589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.979592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:42.979594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.979597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.979600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.979603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.979605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.979608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.979610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.979613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:42.979615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.979618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:42.979638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:42.983054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:42.983582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:42.983595Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:42.983597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:42.983600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:42.983604Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1446 [2:7556255803730471373:9976]
2025-10-01T14:11:42.983614Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:42.983630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:42.983639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.983642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.983644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.983658Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:42.983666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:42.983671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:42.983707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.983711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.983713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.983715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:42.983717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:42.983774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:42.983782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:42.983792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:42.983805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:42.983823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:42.983843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107352099:2446], now have 1 active actors on pipe
2025-10-01T14:11:42.983848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255806107352373:3333], now have 1 active actors on pipe
2025-10-01T14:11:42.983853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255803730471368:9976]
2025-10-01T14:11:42.983855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255803730471368:9976]
2025-10-01T14:11:42.983857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255803730471368:9976]
2025-10-01T14:11:42.983869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:42.983859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1446
2025-10-01T14:11:42.983885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:42.983886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:42.983876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1446
2025-10-01T14:11:42.983890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:42.983895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:42.983902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:42.983905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:42.983939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.983947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.983956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255803730471368:9976]
2025-10-01T14:11:42.983962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:42.983976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:42.983988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:42.983997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:42.984001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:42.984003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:42.984010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:42.984023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:42.984045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.984166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:42.984173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:42.984186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:42.984282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1447 partition: 0 MaxSeqNo: 45 sessionId: src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0
2025-10-01T14:11:42.984620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af11c77-4777e868-1139a4f6-83648b74_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:42.987074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0] Write session: try to update token
2025-10-01T14:11:42.987090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:43.001664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1447 sessionId: src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:43.003545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:43.003567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:43.003569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:43.003571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:43.003581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255803730471368:9976]
2025-10-01T14:11:43.003589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255803730471368:9976]
2025-10-01T14:11:43.003593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255803730471368:9976]
2025-10-01T14:11:43.003641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:43.003643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:43.003650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.003652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:43.003670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:43.003673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:43.003803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:43.004111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:43.054407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255810402319678:3745]
2025-10-01T14:11:43.054659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1446, pipe: [1:7556255810402319678:3745]
2025-10-01T14:11:43.141843Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:43.142217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.142231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.142266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402319678:3745], now have 1 active actors on pipe
2025-10-01T14:11:43.142726Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:43.143077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:43.142589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:43.143087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0] Write session will restart in 0.008945s
2025-10-01T14:11:43.142629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255810402319678:3745]
2025-10-01T14:11:43.142637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:43.142640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:43.142691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1447 reason: error at write: Disconnected sessionId: src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0
2025-10-01T14:11:43.143121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0] Write session: Do CDS request
2025-10-01T14:11:43.142896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1447 sessionId: src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0 is DEAD
2025-10-01T14:11:43.143133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:43.152917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:43.153003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:43.153018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1448
2025-10-01T14:11:43.153144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:43.153176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1448 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:43.153185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1448 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:43.153188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:43.153506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1448 sessionId:  describe result for acl check
2025-10-01T14:11:43.153533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:43.153538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:43.153540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:43.153544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255810402319763:3324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:43.153872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255810402319763:3324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:43.156362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255810402319763:3324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:43.159189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255810402319763:3324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:43.159212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255810402319763:3324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:43.159215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255810402319763:3324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:43.159222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1448 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:43.161042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:43.163825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:43.164081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:43.164096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:43.164111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:43.164180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:43.164220Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255808025438948:9978]
2025-10-01T14:11:43.164784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:43.165065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:43.165118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:43.165426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:43.165504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.165511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.165512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.165512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.165513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.165514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.165515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.165516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.165517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.165519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.165520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.165521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.165522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.165523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.165529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.165538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.165541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.165544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.165547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.165551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.165554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.165557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.165560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.165564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.165567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.165570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.165573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.165576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.165586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.165593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.165598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.165604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.165608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.165613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.165617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.165621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.165625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.165630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.165634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.165639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.165644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.165648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.165652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.165657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.165661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.165665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.165669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.165674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.165678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.165683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.165686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.165691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.165702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.165707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.165711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.165720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.165754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:43.169624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:43.170126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:43.170138Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:43.170139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:43.170142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:43.170147Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1447 [2:7556255808025438948:9978]
2025-10-01T14:11:43.170156Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:43.170168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:43.170173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:43.170176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:43.170178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:43.170189Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:43.170196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:43.170201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:43.170242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.170248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.170249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.170251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:43.170254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:43.170311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:43.170317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.170324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.170329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.170341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:43.170361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402319968:3324], now have 1 active actors on pipe
2025-10-01T14:11:43.170386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255808025438943:9978]
2025-10-01T14:11:43.170393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255808025438943:9978]
2025-10-01T14:11:43.170395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255808025438943:9978]
2025-10-01T14:11:43.170407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:43.170423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402319681:2446], now have 1 active actors on pipe
2025-10-01T14:11:43.170424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:43.170427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:43.170429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:43.170434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:43.170443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:43.170445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:43.170469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255808025438943:9978]
2025-10-01T14:11:43.170478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:43.170485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:43.170472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1447
2025-10-01T14:11:43.170512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.170512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1447
2025-10-01T14:11:43.170526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.170555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|473cad36-698f39c6-fa66dec8-97886cd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:43.170566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:43.170571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:43.170576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:43.170585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:43.170596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:43.170619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:43.170744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.170751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.170760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:43.170830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1448 partition: 0 MaxSeqNo: 45 sessionId: src_id|473cad36-698f39c6-fa66dec8-97886cd5_0
2025-10-01T14:11:43.171200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6562dbe3-47e4ff9e-ac1bbb84-99490c02_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|473cad36-698f39c6-fa66dec8-97886cd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:43.173493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473cad36-698f39c6-fa66dec8-97886cd5_0] Write session: try to update token
2025-10-01T14:11:43.173510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473cad36-698f39c6-fa66dec8-97886cd5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:43.187157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1448 sessionId: src_id|473cad36-698f39c6-fa66dec8-97886cd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:43.189402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:43.190509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.190534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.190557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:43.190560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:43.190562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:43.190564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:43.190573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255808025438943:9978]
2025-10-01T14:11:43.190577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255808025438943:9978]
2025-10-01T14:11:43.190581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255808025438943:9978]
2025-10-01T14:11:43.190633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:43.190636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:43.190642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.190645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:43.190647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:43.190650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:43.190775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:43.242811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255810402320001:3745]
2025-10-01T14:11:43.243110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1447, pipe: [1:7556255810402320001:3745]
2025-10-01T14:11:43.334357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:43.335154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:43.335214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320001:3745], now have 1 active actors on pipe
2025-10-01T14:11:43.335299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:43.335389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255810402320001:3745]
2025-10-01T14:11:43.335390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:43.335392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:43.335424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:43.335462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1448 reason: error at write: Disconnected sessionId: src_id|473cad36-698f39c6-fa66dec8-97886cd5_0
2025-10-01T14:11:43.335650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1448 sessionId: src_id|473cad36-698f39c6-fa66dec8-97886cd5_0 is DEAD
2025-10-01T14:11:43.335734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473cad36-698f39c6-fa66dec8-97886cd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:43.335742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473cad36-698f39c6-fa66dec8-97886cd5_0] Write session will restart in 0.005021s
2025-10-01T14:11:43.335760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473cad36-698f39c6-fa66dec8-97886cd5_0] Write session: Do CDS request
2025-10-01T14:11:43.335767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473cad36-698f39c6-fa66dec8-97886cd5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:43.341952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|473cad36-698f39c6-fa66dec8-97886cd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:43.342041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:43.342058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1449
2025-10-01T14:11:43.342170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:43.342200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1449 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:43.342208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1449 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:43.342212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:43.342671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1449 sessionId:  describe result for acl check
2025-10-01T14:11:43.342704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:43.342706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:43.342707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:43.342713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255810402320019:3320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:43.343214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255810402320019:3320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:43.345993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255810402320019:3320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:43.349332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255810402320019:3320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:43.349348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255810402320019:3320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:43.349351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255810402320019:3320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:43.349361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1449 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:43.357138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:43.360682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:43.360969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:43.360984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:43.360997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:43.361065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:43.361116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255808025439235:9982]
2025-10-01T14:11:43.361834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:43.362224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:43.362280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:43.362648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:43.362740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.362748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.362749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.362750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.362752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.362753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.362755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.362756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.362758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.362759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.362760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.362761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.362763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.362764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.362770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.362782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.362786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.362790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.362794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.362799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.362803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.362807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.362811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.362816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.362820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.362824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.362828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.362832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.362841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.362850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.362863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.362874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.362879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.362890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.362900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.362906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.362917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.362927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.362933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.362943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.362949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.362959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.362964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.362974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.362984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.362991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.363000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.363007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.363013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.363019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.363024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.363031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.363040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.363045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.363050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.363058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.363103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:43.367359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:43.368213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:43.368231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:43.368235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:43.368239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:43.368251Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1448 [2:7556255808025439235:9982]
2025-10-01T14:11:43.368270Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:43.368295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:43.368303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:43.368307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:43.368310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:43.368328Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:43.368339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:43.368351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:43.368418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.368426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.368429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.368432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:43.368435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:43.368521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:43.368529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.368542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.368558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.368581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:43.368607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320145:3320], now have 1 active actors on pipe
2025-10-01T14:11:43.368614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320004:2446], now have 1 active actors on pipe
2025-10-01T14:11:43.368623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255808025439230:9982]
2025-10-01T14:11:43.368630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255808025439230:9982]
2025-10-01T14:11:43.368632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255808025439230:9982]
2025-10-01T14:11:43.368649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:43.368666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:43.368692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:43.368696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:43.368700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:43.368705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:43.368707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:43.368687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1448
2025-10-01T14:11:43.368692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1448
2025-10-01T14:11:43.368745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255808025439230:9982]
2025-10-01T14:11:43.368752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:43.368759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:43.368775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.368785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.368837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1ec989b-dca12cda-76fdb369-9115f810_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:43.368848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:43.368853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:43.368860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:43.368872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:43.368884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:43.368907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:43.369104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.369118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.369140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:43.369234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1449 partition: 0 MaxSeqNo: 45 sessionId: src_id|a1ec989b-dca12cda-76fdb369-9115f810_0
2025-10-01T14:11:43.369639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|473cad36-698f39c6-fa66dec8-97886cd5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a1ec989b-dca12cda-76fdb369-9115f810_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:43.372647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ec989b-dca12cda-76fdb369-9115f810_0] Write session: try to update token
2025-10-01T14:11:43.372666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ec989b-dca12cda-76fdb369-9115f810_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:43.390575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1449 sessionId: src_id|a1ec989b-dca12cda-76fdb369-9115f810_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:43.391821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:43.391842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:43.391845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:43.391848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:43.391856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255808025439230:9982]
2025-10-01T14:11:43.391861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255808025439230:9982]
2025-10-01T14:11:43.391864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255808025439230:9982]
2025-10-01T14:11:43.391915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:43.391917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:43.391923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:43.391927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:43.391930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.391932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:43.392062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:43.393029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:43.435334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255810402320296:3745]
2025-10-01T14:11:43.435669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1448, pipe: [1:7556255810402320296:3745]
2025-10-01T14:11:43.540880Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:43.541511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.541528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.541568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320296:3745], now have 1 active actors on pipe
2025-10-01T14:11:43.542243Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ec989b-dca12cda-76fdb369-9115f810_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:43.542255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ec989b-dca12cda-76fdb369-9115f810_0] Write session will restart in 0.006903s
2025-10-01T14:11:43.542278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ec989b-dca12cda-76fdb369-9115f810_0] Write session: Do CDS request
2025-10-01T14:11:43.542284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ec989b-dca12cda-76fdb369-9115f810_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:43.541774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:43.541784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:43.541788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:43.541823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255810402320296:3745]
2025-10-01T14:11:43.541841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1449 reason: error at write: Disconnected sessionId: src_id|a1ec989b-dca12cda-76fdb369-9115f810_0
2025-10-01T14:11:43.542059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1449 sessionId: src_id|a1ec989b-dca12cda-76fdb369-9115f810_0 is DEAD
2025-10-01T14:11:43.541763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:43.549870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ec989b-dca12cda-76fdb369-9115f810_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:43.550007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:43.550022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1450
2025-10-01T14:11:43.550162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:43.550193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1450 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:43.550198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1450 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:43.550201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:43.550992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1450 sessionId:  describe result for acl check
2025-10-01T14:11:43.551030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:43.551031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:43.551033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:43.551038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255810402320345:3313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:43.551502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255810402320345:3313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:43.554325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255810402320345:3313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:43.558334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255810402320345:3313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:43.558348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255810402320345:3313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:43.558352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255810402320345:3313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:43.558360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1450 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:43.562955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:43.565911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:43.566127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:43.566138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:43.566149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:43.566194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:43.566229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255808025439546:9995]
2025-10-01T14:11:43.566803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:43.567080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:43.567134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:43.567436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:43.567500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.567506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.567507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.567508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.567509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.567510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.567511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.567512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.567513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.567513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.567515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.567516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.567517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.567518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.567525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.567534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.567537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.567541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.567545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.567549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.567552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.567556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.567559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.567562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.567566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.567569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.567572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.567575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.567582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.567588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.567594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.567599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.567602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.567606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.567610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.567621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.567625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.567630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.567638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.567643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.567653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.567661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.567665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.567674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.567677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.567682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.567689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.567693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.567697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.567706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.567710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.567718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.567722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.567731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.567735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.567739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.567779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:43.571469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:43.572074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:43.572089Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:43.572092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:43.572096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:43.572102Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1449 [2:7556255808025439546:9995]
2025-10-01T14:11:43.572119Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:43.572136Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:43.572143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:43.572146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:43.572149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:43.572164Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:43.572172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:43.572179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:43.572236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.572246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.572248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.572251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:43.572253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:43.572318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:43.572325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.572336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.572351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.572371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:43.572392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320485:3313], now have 1 active actors on pipe
2025-10-01T14:11:43.572400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320304:2446], now have 1 active actors on pipe
2025-10-01T14:11:43.572407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255808025439541:9995]
2025-10-01T14:11:43.572412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255808025439541:9995]
2025-10-01T14:11:43.572416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255808025439541:9995]
2025-10-01T14:11:43.572429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:43.572448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:43.572464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:43.572467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:43.572466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:43.572470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:43.572472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:43.572497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255808025439541:9995]
2025-10-01T14:11:43.572506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:43.572513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:43.572487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1449
2025-10-01T14:11:43.572490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1449
2025-10-01T14:11:43.572897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.572910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.572930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f44ff778-71dd478c-37a087ad-f5344438_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:43.572936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:43.572939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:43.572941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:43.572948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:43.572961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:43.572983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:43.573128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.573136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.573151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:43.573236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1450 partition: 0 MaxSeqNo: 45 sessionId: src_id|f44ff778-71dd478c-37a087ad-f5344438_0
2025-10-01T14:11:43.573644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ec989b-dca12cda-76fdb369-9115f810_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f44ff778-71dd478c-37a087ad-f5344438_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:43.576122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ff778-71dd478c-37a087ad-f5344438_0] Write session: try to update token
2025-10-01T14:11:43.576139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ff778-71dd478c-37a087ad-f5344438_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:43.589821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1450 sessionId: src_id|f44ff778-71dd478c-37a087ad-f5344438_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:43.592135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:43.594141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.594166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.594189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:43.594192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:43.594195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:43.594197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:43.594206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255808025439541:9995]
2025-10-01T14:11:43.594211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255808025439541:9995]
2025-10-01T14:11:43.594215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255808025439541:9995]
2025-10-01T14:11:43.594269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:43.594275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:43.594280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:43.594282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.594283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:43.594285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:43.594433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:43.642604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255810402320590:3745]
2025-10-01T14:11:43.643086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1449, pipe: [1:7556255810402320590:3745]
2025-10-01T14:11:43.751190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:43.751454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:43.751510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320590:3745], now have 1 active actors on pipe
2025-10-01T14:11:43.751586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:43.751689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255810402320590:3745]
2025-10-01T14:11:43.751715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:43.760431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:43.760445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:43.760465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1450 reason: error at write: Disconnected sessionId: src_id|f44ff778-71dd478c-37a087ad-f5344438_0
2025-10-01T14:11:43.760591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1450 sessionId: src_id|f44ff778-71dd478c-37a087ad-f5344438_0 is DEAD
2025-10-01T14:11:43.760705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ff778-71dd478c-37a087ad-f5344438_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:43.760715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ff778-71dd478c-37a087ad-f5344438_0] Write session will restart in 0.008356s
2025-10-01T14:11:43.760738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ff778-71dd478c-37a087ad-f5344438_0] Write session: Do CDS request
2025-10-01T14:11:43.760747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ff778-71dd478c-37a087ad-f5344438_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:43.771088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ff778-71dd478c-37a087ad-f5344438_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:43.771677Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:43.771706Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1451
2025-10-01T14:11:43.772051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:43.772088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1451 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:43.772111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1451 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:43.772118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:43.772619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1451 sessionId:  describe result for acl check
2025-10-01T14:11:43.772668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:43.772731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:43.772739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:43.772744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255810402320634:3310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:43.773242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255810402320634:3310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:43.777530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255810402320634:3310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:43.781073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255810402320634:3310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:43.781090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255810402320634:3310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:43.781094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255810402320634:3310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:43.781103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1451 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:43.783450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:43.786464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:43.786683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:43.786696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:43.786705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:43.786746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:43.786777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255808025439827:9997]
2025-10-01T14:11:43.787190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:43.787543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:43.787606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:43.787926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:43.788002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.788008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.788010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.788011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.788012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.788013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.788014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.788015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.788017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.788018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.788020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.788021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.788022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.788023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.788029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.788039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.788044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.788048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.788051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.788055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.788059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.788062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.788066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.788070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.788074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.788077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.788081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.788085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.788092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.788100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:43.788106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.788112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:43.788117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.788122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:43.788126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.788131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:43.788136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.788141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:43.788145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.788163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:43.788168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.788173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:43.788178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.788183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:43.788188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.788194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:43.788199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.788204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.788208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.788213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.788217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.788222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.788227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.788232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:43.788235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.788241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:43.788278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:43.792224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:43.792847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:43.792862Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:43.792866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:43.792869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:43.792877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1450 [2:7556255808025439827:9997]
2025-10-01T14:11:43.792892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:43.792912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:43.792922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:43.792926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:43.792929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:43.792945Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:43.792953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:43.792958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:43.793001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.793006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.793008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.793010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:43.793012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:43.793081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:43.793088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.793101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:43.793108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:43.793122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:43.793139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320592:2446], now have 1 active actors on pipe
2025-10-01T14:11:43.793145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320842:3310], now have 1 active actors on pipe
2025-10-01T14:11:43.793151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255808025439822:9997]
2025-10-01T14:11:43.793152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255808025439822:9997]
2025-10-01T14:11:43.793154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255808025439822:9997]
2025-10-01T14:11:43.793164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:43.793177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:43.793189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:43.793195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:43.793269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1450
2025-10-01T14:11:43.793269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1450
2025-10-01T14:11:43.793203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:43.793217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:43.793220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:43.793221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255808025439822:9997]
2025-10-01T14:11:43.793223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:43.793227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:43.793339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.793348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.793368Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:43.793373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:43.793376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:43.793377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:43.793384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:43.793391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:43.793405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:43.793532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.793537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.793546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:43.793625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1451 partition: 0 MaxSeqNo: 45 sessionId: src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0
2025-10-01T14:11:43.794033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f44ff778-71dd478c-37a087ad-f5344438_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:43.796515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0] Write session: try to update token
2025-10-01T14:11:43.796533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:43.804240Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:43.804265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:43.804276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255808025439822:9997]
2025-10-01T14:11:43.804326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:43.804330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:43.804514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:43.804702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:43.804860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:43.805010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:43.805219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:43.805254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:43.812302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1451 sessionId: src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:43.815073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:43.815747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.815774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.815811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:43.815903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:43.831664Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:43.831688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:43.831690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:43.831693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:43.831703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255808025439822:9997]
2025-10-01T14:11:43.831707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255808025439822:9997]
2025-10-01T14:11:43.831711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255808025439822:9997]
2025-10-01T14:11:43.831755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:43.831757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:43.831764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:43.831766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:43.831768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:43.831772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:43.831893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:43.852111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255810402320884:3745]
2025-10-01T14:11:43.852368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1450, pipe: [1:7556255810402320884:3745]
2025-10-01T14:11:43.987413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:43.995723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:43.995753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:43.995940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.996007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.996072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.996138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.996467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.996480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.996550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.996609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.996688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.996753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.996794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.996802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.996863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.996929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.996995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.997057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.997105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.997114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.997176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.997243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.997309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.997372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.997417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.997426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.997486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.997544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.997603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.997688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.997730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.997737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.997800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.997859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.997943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.998005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.998056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.998063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.998126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.998189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.998255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.998319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.998361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.998368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.998448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.998512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.998580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.998648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.998699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.998708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.998777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.998841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.998904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.998967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.999011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.999018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.999081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:43.999141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:43.999207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:43.999271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:43.999314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:43.999321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:43.999395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320884:3745], now have 1 active actors on pipe
2025-10-01T14:11:43.999665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:43.999662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:43.999686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:43.999718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1451 reason: error at write: Disconnected sessionId: src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0
2025-10-01T14:11:43.999731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255810402320884:3745]
2025-10-01T14:11:43.999942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1451 sessionId: src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0 is DEAD
2025-10-01T14:11:44.000125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:44.000138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0] Write session will restart in 0.008549s
2025-10-01T14:11:44.000164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0] Write session: Do CDS request
2025-10-01T14:11:44.000172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:44.000197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:44.009972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.010324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:44.010340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1452
2025-10-01T14:11:44.010733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.010767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1452 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:44.010779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1452 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:44.010782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:44.011281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1452 sessionId:  describe result for acl check
2025-10-01T14:11:44.011315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:44.011321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:44.011323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:44.011328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255814697288274:3302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:44.011753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255814697288274:3302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:44.014480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255814697288274:3302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:44.017102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255814697288274:3302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:44.017116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255814697288274:3302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:44.017119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255814697288274:3302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:44.017127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1452 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:44.020165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:44.020612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:44.020775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:44.020784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:44.020792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:44.020826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:44.020855Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255812320407420:10001]
2025-10-01T14:11:44.021263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:44.021469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:44.021501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:44.021712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:44.021747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.021751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.021752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.021753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.021753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.021754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.021755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.021756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.021756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.021757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.021758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.021758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.021759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.021759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.021762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.021768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.021771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.021773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.021775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.021778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.021780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.021782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.021784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.021786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.021788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.021791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.021793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.021795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.021809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.021813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.021817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.021820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.021823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.021826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.021829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.021831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.021834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.021836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.021840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.021845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.021849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.021854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.021857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.021862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.021868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.021872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.021877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.021882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.021887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.021889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.021892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.021895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.021898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.021901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.021903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.021906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.021925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:44.025384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:44.026135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:44.026152Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:44.026154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:44.026158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:44.026164Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1451 [2:7556255812320407420:10001]
2025-10-01T14:11:44.026180Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:44.026197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:44.026200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.026204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.026206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.026221Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:44.026227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:44.026238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:44.026289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.026297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.026299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.026302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:44.026304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:44.026386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:44.026394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.026404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.026418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.026437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:44.026458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697288460:3302], now have 1 active actors on pipe
2025-10-01T14:11:44.026466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255810402320890:2446], now have 1 active actors on pipe
2025-10-01T14:11:44.026474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255812320407415:10001]
2025-10-01T14:11:44.026481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255812320407415:10001]
2025-10-01T14:11:44.026483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255812320407415:10001]
2025-10-01T14:11:44.026497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:44.026513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:44.026519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1451
2025-10-01T14:11:44.026524Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1451
2025-10-01T14:11:44.026530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:44.026537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:44.026555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:44.026559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:44.026562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:44.026905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255812320407415:10001]
2025-10-01T14:11:44.026925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:44.026947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:44.026969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.026975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.027014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:44.027028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.027033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.027036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:44.027044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.027057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:44.027080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.027232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.027241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.027255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.027324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1452 partition: 0 MaxSeqNo: 45 sessionId: src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0
2025-10-01T14:11:44.027730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a313c9a-bba8fb64-b4c06d12-c75e7bfc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:44.030213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0] Write session: try to update token
2025-10-01T14:11:44.030233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:44.048691Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:44.048712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:44.048714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:44.048716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:44.048728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255812320407415:10001]
2025-10-01T14:11:44.048733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255812320407415:10001]
2025-10-01T14:11:44.048738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255812320407415:10001]
2025-10-01T14:11:44.048772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:44.048776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:44.048778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:44.048788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:44.048795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.048797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:44.048921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:44.047057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1452 sessionId: src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:44.049284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:44.099919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255814697288473:3745]
2025-10-01T14:11:44.102691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1451, pipe: [1:7556255814697288473:3745]
2025-10-01T14:11:44.206210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:44.206549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.206567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.206612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697288473:3745], now have 1 active actors on pipe
2025-10-01T14:11:44.207031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:44.211002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:44.211015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0] Write session will restart in 0.008432s
2025-10-01T14:11:44.211041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0] Write session: Do CDS request
2025-10-01T14:11:44.211047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:44.210497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255814697288473:3745]
2025-10-01T14:11:44.210530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:44.210598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1452 reason: status is not ok: tablet will be restarted right now sessionId: src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0
2025-10-01T14:11:44.210808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1452 sessionId: src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0 is DEAD
2025-10-01T14:11:44.211001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:44.220964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.221076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:44.221096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1453
2025-10-01T14:11:44.221311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.221348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1453 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:44.221358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1453 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:44.221362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:44.221778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1453 sessionId:  describe result for acl check
2025-10-01T14:11:44.221807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:44.221812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:44.221817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:44.221821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255814697288514:3287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:44.222364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255814697288514:3287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:44.224515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255814697288514:3287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:44.228788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255814697288514:3287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:44.228816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255814697288514:3287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:44.228821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255814697288514:3287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:44.228828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1453 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:44.242612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:44.246639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:44.246807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:44.246810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:44.246817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:44.246851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:44.246886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255812320407711:10003]
2025-10-01T14:11:44.247342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:44.247674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:44.247720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:44.248031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:44.248171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.248173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.248174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.248175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.248177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.248178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.248179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.248180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.248181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.248183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.248184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.248186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.248187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.248188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.248194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.248204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.248208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.248211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.248215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.248218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.248221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.248225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.248228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.248232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.248235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.248239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.248242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.248245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.248253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.248260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.248265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.248271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.248276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.248280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.248284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.248289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.248294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.248298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.248303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.248307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.248311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.248317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.248320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.248324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.248328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.248333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.248337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.248341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.248346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.248352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.248393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.248399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.248404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.248410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.248414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.248418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.248458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:44.252548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:44.254474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:44.254505Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:44.254507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:44.254512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:44.254520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1452 [2:7556255812320407711:10003]
2025-10-01T14:11:44.254540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:44.254560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:44.254564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.254568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.254570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.254589Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:44.254600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:44.254606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:44.254679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.254689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.254691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.254694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:44.254696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:44.254776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:44.254783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.254799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.254813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.254836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:44.254855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697288503:2446], now have 1 active actors on pipe
2025-10-01T14:11:44.254864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697288606:3287], now have 1 active actors on pipe
2025-10-01T14:11:44.254871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255812320407706:10003]
2025-10-01T14:11:44.254878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255812320407706:10003]
2025-10-01T14:11:44.254880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255812320407706:10003]
2025-10-01T14:11:44.254899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:44.255107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1452
2025-10-01T14:11:44.255148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1452
2025-10-01T14:11:44.254917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:44.254938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:44.254941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:44.254981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255812320407706:10003]
2025-10-01T14:11:44.254983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:44.255111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:44.255116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:44.255118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:44.255126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:44.255574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.255586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.255618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:44.255631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.255636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.255638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:44.255648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.255662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:44.255684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.255888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.255895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.255909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.256006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1453 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0
2025-10-01T14:11:44.256357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|749b8510-d48d4aab-afbc3566-fc7019c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:44.258817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0] Write session: try to update token
2025-10-01T14:11:44.258833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:44.274070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1453 sessionId: src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:44.276345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:44.277909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.277949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.277971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:44.277974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:44.277978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:44.277980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:44.277989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255812320407706:10003]
2025-10-01T14:11:44.277994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255812320407706:10003]
2025-10-01T14:11:44.277999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255812320407706:10003]
2025-10-01T14:11:44.278044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:44.278060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:44.278064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:44.278064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:44.278071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.278074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:44.278228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:44.310818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255814697288802:3745]
2025-10-01T14:11:44.311254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1452, pipe: [1:7556255814697288802:3745]
2025-10-01T14:11:44.330697Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:11:44.420447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:44.420488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:44.420521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:44.420529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:44.420533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255814697288802:3745]
2025-10-01T14:11:44.420594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1453 reason: error at write: Disconnected sessionId: src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0
2025-10-01T14:11:44.420786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1453 sessionId: src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0 is DEAD
2025-10-01T14:11:44.421007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:44.421023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0] Write session will restart in 0.008184s
2025-10-01T14:11:44.421058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0] Write session: Do CDS request
2025-10-01T14:11:44.421064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:44.419599Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:44.419839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:44.419887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697288802:3745], now have 1 active actors on pipe
2025-10-01T14:11:44.430819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.430899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:44.430917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1454
2025-10-01T14:11:44.431029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.431062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1454 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:44.431068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1454 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:44.431071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:44.431494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1454 sessionId:  describe result for acl check
2025-10-01T14:11:44.431534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:44.431538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:44.431540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:44.431545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255814697288824:3272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:44.432055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255814697288824:3272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:44.434103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255814697288824:3272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:44.437954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255814697288824:3272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:44.437971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255814697288824:3272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:44.437974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255814697288824:3272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:44.437982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1454 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:44.444543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:44.448050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:44.448282Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:44.448293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:44.448302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:44.448363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:44.448410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255812320407995:10007]
2025-10-01T14:11:44.449074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:44.449397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:44.449444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:44.449893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:44.450058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.450066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.450067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.450067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.450068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.450069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.450070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.450071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.450072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.450073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.450074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.450074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.450075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.450076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.450082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.450096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.450098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.450101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.450103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.450105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.450108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.450110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.450112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.450116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.450119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.450123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.450127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.450130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.450140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.450150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.450157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.450163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.450167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.450171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.450174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.450177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.450181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.450184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.450187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.450190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.450194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.450197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.450199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.450203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.450206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.450209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.450212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.450218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.450222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.450227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.450231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.450236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.450241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.450246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.450250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.450256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.450294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:44.454033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:44.455076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:44.455094Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:44.455096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:44.455099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:44.455107Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1453 [2:7556255812320407995:10007]
2025-10-01T14:11:44.455124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:44.455140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:44.455142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.455144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.455146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.455159Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:44.455163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:44.455167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:44.455213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.455222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.455223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.455226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:44.455228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:44.455284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:44.455292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.455299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.455305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.455314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:44.455338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697288809:2446], now have 1 active actors on pipe
2025-10-01T14:11:44.455347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697288953:3272], now have 1 active actors on pipe
2025-10-01T14:11:44.455354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255812320407990:10007]
2025-10-01T14:11:44.455356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255812320407990:10007]
2025-10-01T14:11:44.455359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255812320407990:10007]
2025-10-01T14:11:44.455368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:44.455374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:44.455377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:44.455378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:44.455383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:44.455397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:44.455400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:44.455435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255812320407990:10007]
2025-10-01T14:11:44.455448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:44.455453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:44.456034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1453
2025-10-01T14:11:44.456048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1453
2025-10-01T14:11:44.456113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.456125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.456147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c05422da-194608b7-304a5c94-bd703a5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:44.456153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.456156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.456158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:44.456167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.456175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:44.456190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.456329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.456343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.456357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.456427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1454 partition: 0 MaxSeqNo: 45 sessionId: src_id|c05422da-194608b7-304a5c94-bd703a5c_0
2025-10-01T14:11:44.456760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d7c66c0-1c8bb14c-a0bba245-235061f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c05422da-194608b7-304a5c94-bd703a5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:44.459475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c05422da-194608b7-304a5c94-bd703a5c_0] Write session: try to update token
2025-10-01T14:11:44.459492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c05422da-194608b7-304a5c94-bd703a5c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:44.477236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:44.477263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:44.477265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:44.477267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:44.477277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255812320407990:10007]
2025-10-01T14:11:44.477282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255812320407990:10007]
2025-10-01T14:11:44.477285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255812320407990:10007]
2025-10-01T14:11:44.477331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:44.477332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:44.477338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.477339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:44.477341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:44.477353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:44.477469Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:44.484429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1454 sessionId: src_id|c05422da-194608b7-304a5c94-bd703a5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:44.486780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:44.520758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255814697289105:3745]
2025-10-01T14:11:44.521041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1453, pipe: [1:7556255814697289105:3745]
2025-10-01T14:11:44.617494Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:44.617751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.617772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.617790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697289105:3745], now have 1 active actors on pipe
2025-10-01T14:11:44.617973Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:44.617988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:44.618003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:44.618021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:44.618055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1454 reason: error at write: Disconnected sessionId: src_id|c05422da-194608b7-304a5c94-bd703a5c_0
2025-10-01T14:11:44.618065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255814697289105:3745]
2025-10-01T14:11:44.618220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1454 sessionId: src_id|c05422da-194608b7-304a5c94-bd703a5c_0 is DEAD
2025-10-01T14:11:44.618353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c05422da-194608b7-304a5c94-bd703a5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:44.618364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c05422da-194608b7-304a5c94-bd703a5c_0] Write session will restart in 0.009775s
2025-10-01T14:11:44.618407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c05422da-194608b7-304a5c94-bd703a5c_0] Write session: Do CDS request
2025-10-01T14:11:44.618412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c05422da-194608b7-304a5c94-bd703a5c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:44.628895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c05422da-194608b7-304a5c94-bd703a5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.628966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:44.628980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1455
2025-10-01T14:11:44.629113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.629144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1455 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:44.629151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1455 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:44.629154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:44.629463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1455 sessionId:  describe result for acl check
2025-10-01T14:11:44.629487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:44.629491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:44.629492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:44.629496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255814697289211:3265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:44.629873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255814697289211:3265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:44.632123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255814697289211:3265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:44.634510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255814697289211:3265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:44.634525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255814697289211:3265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:44.634528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255814697289211:3265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:44.634537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1455 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:44.635319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:44.637890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:44.638083Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:44.638096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:44.638105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:44.638146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:44.638175Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255812320408311:10020]
2025-10-01T14:11:44.638683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:44.638939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:44.638979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:44.639241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:44.639290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.639297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.639298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.639298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.639299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.639300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.639300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.639301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.639302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.639303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.639304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.639304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.639305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.639305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.639309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.639315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.639317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.639319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.639322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.639326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.639330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.639334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.639337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.639341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.639345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.639349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.639352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.639356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.639362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.639378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.639385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.639390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.639394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.639399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.639404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.639409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.639413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.639418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.639431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.639436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.639441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.639446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.639450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.639454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.639458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.639464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.639468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.639474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.639479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.639484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.639488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.639493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.639503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.639508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.639512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.639517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.639552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:44.643264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:44.644037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:44.644052Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:44.644054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:44.644058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:44.644065Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1454 [2:7556255812320408311:10020]
2025-10-01T14:11:44.644078Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:44.644094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:44.644097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.644100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.644102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.644117Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:44.644123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:44.644128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:44.644186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.644188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.644190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.644193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:44.644196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:44.644261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:44.644268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.644278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.644295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.644309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:44.644326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697289387:3265], now have 1 active actors on pipe
2025-10-01T14:11:44.644332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697289107:2446], now have 1 active actors on pipe
2025-10-01T14:11:44.644339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255812320408306:10020]
2025-10-01T14:11:44.644345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255812320408306:10020]
2025-10-01T14:11:44.644347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255812320408306:10020]
2025-10-01T14:11:44.644359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:44.644368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:44.644371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:44.644373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:44.644375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:44.644387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:44.644390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:44.644382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1454
2025-10-01T14:11:44.644396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1454
2025-10-01T14:11:44.644419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255812320408306:10020]
2025-10-01T14:11:44.644426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:44.644429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:44.644443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.644451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.644493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:44.644503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.644507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.644509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:44.644517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.644529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:44.644550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.644684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.644692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.644706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.644782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1455 partition: 0 MaxSeqNo: 45 sessionId: src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0
2025-10-01T14:11:44.645124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c05422da-194608b7-304a5c94-bd703a5c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:44.647458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0] Write session: try to update token
2025-10-01T14:11:44.647476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:44.660228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1455 sessionId: src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:44.662396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:44.662524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.662546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.664472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:44.664509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:44.664513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:44.664515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:44.664517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:44.664529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255812320408306:10020]
2025-10-01T14:11:44.664534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255812320408306:10020]
2025-10-01T14:11:44.664545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255812320408306:10020]
2025-10-01T14:11:44.664584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:44.664594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:44.664595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:44.664598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:44.664601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.664604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:44.664594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:44.664748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:44.718426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255814697289401:3745]
2025-10-01T14:11:44.718692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1454, pipe: [1:7556255814697289401:3745]
2025-10-01T14:11:44.803186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:44.810714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.810743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.810907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.810971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.811037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.811105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.811152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.811161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.811228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.811290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.811356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.811420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.811467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.811474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.811534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.811594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.811657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.811717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.811760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.811769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.811829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.811891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.811955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.812017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.812061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.812069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.812131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.812187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.812251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.812310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.812354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.812363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.812424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.812484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.812551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.812616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.812664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.812681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.812751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.812812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.812877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.812945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.812990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.812997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.813062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.813121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.813184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.813251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.813294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.813301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.813372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.813439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.813504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.813569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.813614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.813623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.813694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:44.813757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:44.813822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:44.813885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:44.813928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:44.813936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:44.813995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697289401:3745], now have 1 active actors on pipe
2025-10-01T14:11:44.814250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255814697289401:3745]
2025-10-01T14:11:44.814253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:44.814288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:44.814290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:44.814317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1455 reason: error at write: Disconnected sessionId: src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0
2025-10-01T14:11:44.814531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1455 sessionId: src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0 is DEAD
2025-10-01T14:11:44.814667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:44.814675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0] Write session will restart in 0.008107s
2025-10-01T14:11:44.814700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0] Write session: Do CDS request
2025-10-01T14:11:44.814706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:44.815165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:44.823908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.823949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:44.823963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1456
2025-10-01T14:11:44.824116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:44.824150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1456 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:44.824158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1456 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:44.824161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:44.824532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1456 sessionId:  describe result for acl check
2025-10-01T14:11:44.824565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:44.824571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:44.824572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:44.824577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255814697289484:3261] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:44.825021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255814697289484:3261] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:44.827460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255814697289484:3261] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:44.830083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255814697289484:3261] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:44.830093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255814697289484:3261] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:44.830095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255814697289484:3261] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:44.830101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1456 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:44.833960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:44.834413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:44.834604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:44.834614Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:44.834626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:44.834685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:44.834728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255812320408598:10022]
2025-10-01T14:11:44.835325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:44.835589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:44.835634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:44.835929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:44.835991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.835998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.835999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.836000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.836004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.836005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.836006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.836007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.836008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.836010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.836011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.836012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.836013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.836014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.836019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.836029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.836032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.836036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.836039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.836043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.836047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.836050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.836053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.836056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.836060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.836063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.836066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.836069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.836076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.836082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:44.836089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.836093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:44.836098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.836103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:44.836112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.836117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:44.836126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.836130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:44.836138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.836147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:44.836151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.836157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:44.836165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.836170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:44.836178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.836183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:44.836191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.836195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.836200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.836210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.836214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.836223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.836227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.836236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:44.836240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.836245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:44.836287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:44.840044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:44.840903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:44.840920Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:44.840923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:44.840926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:44.840932Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1455 [2:7556255812320408598:10022]
2025-10-01T14:11:44.840947Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:44.840962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:44.840969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.840973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.840975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.840990Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:44.840999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:44.841006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:44.841060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.841066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.841068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.841071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:44.841074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:44.841135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:44.841142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.841154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:44.841169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:44.841189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:44.841210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697289406:2446], now have 1 active actors on pipe
2025-10-01T14:11:44.841217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697289686:3261], now have 1 active actors on pipe
2025-10-01T14:11:44.841224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255812320408593:10022]
2025-10-01T14:11:44.841226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255812320408593:10022]
2025-10-01T14:11:44.841228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255812320408593:10022]
2025-10-01T14:11:44.841214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1455
2025-10-01T14:11:44.841238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:44.841227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1455
2025-10-01T14:11:44.841251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:44.841256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:44.841261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:44.841263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:44.841270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:44.841273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:44.841293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.841302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.841333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255812320408593:10022]
2025-10-01T14:11:44.841347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:44.841359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:44.841366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:44.841372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:44.841376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:44.841378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:44.841386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:44.841398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:44.841431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.841559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.841567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.841582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:44.841680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1456 partition: 0 MaxSeqNo: 45 sessionId: src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0
2025-10-01T14:11:44.841988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f740390c-d1806ad3-56e7bc02-eaaee26c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:44.844263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0] Write session: try to update token
2025-10-01T14:11:44.844279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:44.857713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1456 sessionId: src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:44.859879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:44.860582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:44.860614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:44.860635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:44.860637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:44.860640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:44.860642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:44.860651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255812320408593:10022]
2025-10-01T14:11:44.860655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255812320408593:10022]
2025-10-01T14:11:44.860661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255812320408593:10022]
2025-10-01T14:11:44.860708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:44.860723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:44.860727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:44.860728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:44.860735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:44.860743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:44.860874Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:44.914458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255814697289700:3745]
2025-10-01T14:11:44.914729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1455, pipe: [1:7556255814697289700:3745]
2025-10-01T14:11:45.004759Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:45.005356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:45.005424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255814697289700:3745], now have 1 active actors on pipe
2025-10-01T14:11:45.005511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:45.005633Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255814697289700:3745]
2025-10-01T14:11:45.005669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:45.016879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:45.016893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:45.016912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1456 reason: error at write: Disconnected sessionId: src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0
2025-10-01T14:11:45.017033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1456 sessionId: src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0 is DEAD
2025-10-01T14:11:45.017159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:45.017168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0] Write session will restart in 0.006780s
2025-10-01T14:11:45.017189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0] Write session: Do CDS request
2025-10-01T14:11:45.017197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:45.024897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.025078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:45.025090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1457
2025-10-01T14:11:45.025194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.025225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1457 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:45.025235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1457 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:45.025238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:45.025632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1457 sessionId:  describe result for acl check
2025-10-01T14:11:45.025666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:45.025671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:45.025672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:45.025677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255818992257201:3257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:45.026055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255818992257201:3257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:45.028252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255818992257201:3257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:45.028686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:45.031502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:45.031678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:45.031688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:45.031698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:45.031739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:45.031781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255816615376194:10026]
2025-10-01T14:11:45.031790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255818992257201:3257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:45.031804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255818992257201:3257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:45.031807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255818992257201:3257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:45.031815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1457 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:45.032201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:45.032392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:45.032424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:45.032640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:45.032695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.032701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.032702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.032703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.032703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.032704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.032705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.032705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.032706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.032707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.032707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.032708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.032709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.032709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.032712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.032718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.032721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.032723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.032725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.032727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.032729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.032731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.032733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.032735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.032737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.032739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.032742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.032744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.032751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.032758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.032764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.032769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.032772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.032777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.032781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.032786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.032791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.032801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.032804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.032813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.032818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.032826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.032835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.032843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.032847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.032855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.032858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.032866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.032870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.032878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.032881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.032889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.032897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.032900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.032908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.032912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.032950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:45.036309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:45.037271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:45.037285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:45.037287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:45.037291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:45.037299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1456 [2:7556255816615376194:10026]
2025-10-01T14:11:45.037313Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:45.037328Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:45.037332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.037335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.037337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.037352Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:45.037361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:45.037367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:45.037416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.037423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.037425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.037428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:45.037430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:45.037491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:45.037496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.037503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.037512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.037530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:45.037549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257001:2446], now have 1 active actors on pipe
2025-10-01T14:11:45.037556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257281:3257], now have 1 active actors on pipe
2025-10-01T14:11:45.037564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255816615376189:10026]
2025-10-01T14:11:45.037570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255816615376189:10026]
2025-10-01T14:11:45.037572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255816615376189:10026]
2025-10-01T14:11:45.037585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:45.037598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:45.037602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:45.037609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:45.037611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:45.037615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:45.037618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:45.037611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1456
2025-10-01T14:11:45.037645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255816615376189:10026]
2025-10-01T14:11:45.037644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1456
2025-10-01T14:11:45.037653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:45.037666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:45.037686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.037695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.037720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7b447f7-3be2635-a3537929-169d2c98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:45.037732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.037740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.037742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:45.037751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.037762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:45.037778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.037959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.037967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.037980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.038048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1457 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7b447f7-3be2635-a3537929-169d2c98_0
2025-10-01T14:11:45.038430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e7f87d9-31ebfc18-708a70a3-238c18f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7b447f7-3be2635-a3537929-169d2c98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:45.040749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b447f7-3be2635-a3537929-169d2c98_0] Write session: try to update token
2025-10-01T14:11:45.040767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b447f7-3be2635-a3537929-169d2c98_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:45.053764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1457 sessionId: src_id|d7b447f7-3be2635-a3537929-169d2c98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:45.056132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:45.057339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.057362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.057380Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:45.057382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:45.057384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:45.057385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:45.057392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255816615376189:10026]
2025-10-01T14:11:45.057395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255816615376189:10026]
2025-10-01T14:11:45.057398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255816615376189:10026]
2025-10-01T14:11:45.057441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:45.057445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:45.057450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.057452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:45.057456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:45.057459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:45.057593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:45.105956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255818992257293:3745]
2025-10-01T14:11:45.106153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1456, pipe: [1:7556255818992257293:3745]
2025-10-01T14:11:45.204001Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:45.204465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:45.204525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257293:3745], now have 1 active actors on pipe
2025-10-01T14:11:45.204575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:45.204649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:45.204723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255818992257293:3745]
2025-10-01T14:11:45.214175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:45.214197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:45.214220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1457 reason: error at write: Disconnected sessionId: src_id|d7b447f7-3be2635-a3537929-169d2c98_0
2025-10-01T14:11:45.214360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1457 sessionId: src_id|d7b447f7-3be2635-a3537929-169d2c98_0 is DEAD
2025-10-01T14:11:45.214488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b447f7-3be2635-a3537929-169d2c98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:45.214498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b447f7-3be2635-a3537929-169d2c98_0] Write session will restart in 0.008862s
2025-10-01T14:11:45.214516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b447f7-3be2635-a3537929-169d2c98_0] Write session: Do CDS request
2025-10-01T14:11:45.214522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b447f7-3be2635-a3537929-169d2c98_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:45.224904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b447f7-3be2635-a3537929-169d2c98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.225000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:45.225017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1458
2025-10-01T14:11:45.225160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.225191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1458 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:45.225202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1458 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:45.225206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:45.225629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1458 sessionId:  describe result for acl check
2025-10-01T14:11:45.225665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:45.225671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:45.225672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:45.225678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255818992257517:3250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:45.226071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255818992257517:3250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:45.228268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255818992257517:3250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:45.228732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:45.231517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:45.231752Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:45.231764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:45.231774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:45.231822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:45.231858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255816615376484:10028]
2025-10-01T14:11:45.231993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255818992257517:3250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:45.232005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255818992257517:3250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:45.232007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255818992257517:3250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:45.232013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1458 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:45.232388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:45.232644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:45.232688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:45.232940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:45.232990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.232995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.232996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.232997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.232999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.233000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.233001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.233002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.233003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.233004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.233005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.233007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.233008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.233009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.233014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.233023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.233027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.233031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.233035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.233038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.233042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.233045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.233054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.233057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.233061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.233064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.233068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.233071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.233077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.233088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.233098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.233107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.233111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.233116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.233120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.233130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.233138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.233143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.233147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.233155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.233162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.233171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.233179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.233183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.233188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.233193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.233197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.233201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.233206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.233210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.233214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.233222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.233229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.233237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.233245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.233252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.233271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:45.236759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:45.237687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:45.237703Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:45.237706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:45.237709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:45.237715Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1457 [2:7556255816615376484:10028]
2025-10-01T14:11:45.237731Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:45.237746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:45.237748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.237752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.237759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.237774Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:45.237784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:45.237795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:45.237851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.237858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.237860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.237863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:45.237866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:45.237927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:45.237934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.237945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.237962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.238055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1457
2025-10-01T14:11:45.238101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1457
2025-10-01T14:11:45.238409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1458 partition: 0 MaxSeqNo: 45 sessionId: src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0
2025-10-01T14:11:45.237977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:45.238001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257312:2446], now have 1 active actors on pipe
2025-10-01T14:11:45.238004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257602:3250], now have 1 active actors on pipe
2025-10-01T14:11:45.238011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255816615376479:10028]
2025-10-01T14:11:45.238013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255816615376479:10028]
2025-10-01T14:11:45.238015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255816615376479:10028]
2025-10-01T14:11:45.238031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:45.238045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:45.238050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:45.238054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:45.238059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:45.238062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:45.238064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:45.238085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255816615376479:10028]
2025-10-01T14:11:45.238087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:45.238090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:45.238125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.238130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.238154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:45.238160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.238164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.238166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:45.238174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.238182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:45.238195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.238308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.238311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.238325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.238824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7b447f7-3be2635-a3537929-169d2c98_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:45.241230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0] Write session: try to update token
2025-10-01T14:11:45.241246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:45.253408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:45.253428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:45.253437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255816615376479:10028]
2025-10-01T14:11:45.253476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:45.253481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:45.253626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:45.253754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:45.253875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:45.254002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:45.254190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:45.254223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:45.254810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1458 sessionId: src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:45.257475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:45.257672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.257691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.257718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:45.257807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:45.267341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:45.267365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:45.267367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:45.267369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:45.267378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255816615376479:10028]
2025-10-01T14:11:45.267382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255816615376479:10028]
2025-10-01T14:11:45.267385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255816615376479:10028]
2025-10-01T14:11:45.267418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:45.267422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:45.267425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:45.267441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:45.267447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.267449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:45.267575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:45.305126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255818992257633:3745]
2025-10-01T14:11:45.305383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1457, pipe: [1:7556255818992257633:3745]
2025-10-01T14:11:45.404029Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:45.411488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.411520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.411678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.411737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.411800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.411857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.411906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.411916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.411976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.412037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.412092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.412152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.412198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.412205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.412271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.412330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.412391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.412459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.412506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.412513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.412582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.412649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.412725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.412792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.412840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.412850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.412926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.412986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.413050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.413110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.413154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.413161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.413224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.413281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.413344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.413406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.413447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.413454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.413517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.413571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.413631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.413693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.413734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.413741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.413797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.413852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.413909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.413966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.414006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.414012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.414073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.414131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.414190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.414246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.414287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.414293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.414353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.414427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.414485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.414542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.414580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.414586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.414649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257633:3745], now have 1 active actors on pipe
2025-10-01T14:11:45.414909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255818992257633:3745]
2025-10-01T14:11:45.414937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:45.414939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:45.414942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:45.414964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1458 reason: error at write: Disconnected sessionId: src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0
2025-10-01T14:11:45.415199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1458 sessionId: src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0 is DEAD
2025-10-01T14:11:45.415331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:45.415342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0] Write session will restart in 0.006479s
2025-10-01T14:11:45.415364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0] Write session: Do CDS request
2025-10-01T14:11:45.415371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:45.415847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:45.422886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.422992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:45.423009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1459
2025-10-01T14:11:45.423113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.423144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1459 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:45.423153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1459 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:45.423156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:45.423529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1459 sessionId:  describe result for acl check
2025-10-01T14:11:45.423559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:45.423561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:45.423562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:45.423567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255818992257682:3228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:45.424059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255818992257682:3228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:45.428103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255818992257682:3228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:45.431509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255818992257682:3228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:45.431530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255818992257682:3228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:45.431533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255818992257682:3228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:45.431542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1459 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:45.437097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:45.437601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:45.437805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:45.437816Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:45.437828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:45.437888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:45.437926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255816615376781:10032]
2025-10-01T14:11:45.438395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:45.438656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:45.438687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:45.438924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:45.438968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.438973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.438974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.438975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.438976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.438977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.438978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.438978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.438979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.438979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.438980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.438981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.438982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.438983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.438986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.438992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.438994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.438997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.438999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.439001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.439003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.439006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.439008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.439010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.439013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.439015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.439017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.439019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.439024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.439029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.439033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.439037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.439039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.439042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.439045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.439048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.439050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.439053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.439056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.439058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.439061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.439064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.439067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.439069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.439072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.439075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.439081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.439084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.439087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.439091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.439096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.439100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.439102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.439105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.439111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.439114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.439135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:45.442720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:45.443431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:45.443446Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:45.443447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:45.443450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:45.443455Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1458 [2:7556255816615376781:10032]
2025-10-01T14:11:45.443468Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:45.443483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:45.443491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.443495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.443501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.443516Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:45.443525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:45.443534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:45.443572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.443576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.443578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.443580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:45.443583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:45.443636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:45.443642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.443649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.443657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.443676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:45.443697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257640:2446], now have 1 active actors on pipe
2025-10-01T14:11:45.443705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257922:3228], now have 1 active actors on pipe
2025-10-01T14:11:45.443713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255816615376776:10032]
2025-10-01T14:11:45.443721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255816615376776:10032]
2025-10-01T14:11:45.443723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255816615376776:10032]
2025-10-01T14:11:45.443737Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:45.443750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:45.443753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:45.443755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:45.443809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1458
2025-10-01T14:11:45.443809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1458
2025-10-01T14:11:45.444060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:45.444077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:45.444082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:45.444101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.444108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.444142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255816615376776:10032]
2025-10-01T14:11:45.444151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:45.444161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:45.444172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcfed09f-3e5d7158-7d930512-92791f33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:45.444182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.444188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.444190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:45.444197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.444206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:45.444239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.444359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.444366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.444380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.444447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1459 partition: 0 MaxSeqNo: 45 sessionId: src_id|fcfed09f-3e5d7158-7d930512-92791f33_0
2025-10-01T14:11:45.444880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2af9fc7d-fe2b633a-367933c3-c9b87c54_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fcfed09f-3e5d7158-7d930512-92791f33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:45.447445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfed09f-3e5d7158-7d930512-92791f33_0] Write session: try to update token
2025-10-01T14:11:45.447461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfed09f-3e5d7158-7d930512-92791f33_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:45.454526Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:45.454548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:45.454558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255816615376776:10032]
2025-10-01T14:11:45.454596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:45.454606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:45.454768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:45.454903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:45.455039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:45.455180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:45.455369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:45.455411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:45.461510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1459 sessionId: src_id|fcfed09f-3e5d7158-7d930512-92791f33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:45.464011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:45.464219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.464242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.464275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:45.464348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:45.473487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:45.473511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:45.473513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:45.473515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:45.473525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255816615376776:10032]
2025-10-01T14:11:45.473529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255816615376776:10032]
2025-10-01T14:11:45.473533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255816615376776:10032]
2025-10-01T14:11:45.473579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:45.473577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:45.473584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:45.473587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:45.473589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.473592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:45.473723Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:45.515042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255818992257941:3745]
2025-10-01T14:11:45.515297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1458, pipe: [1:7556255818992257941:3745]
2025-10-01T14:11:45.615635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:45.623541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.623572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.623731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.623797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.623864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.623925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.624199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.624211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.624274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.624323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.624377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.624436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.624483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.624490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.624565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.624618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.624693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.624750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.624789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.624794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.624852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.624906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.624960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.625017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.625066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.625071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.625127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.625186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.625243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.625301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.625343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.625349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.625416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.625484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.625549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.625609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.625657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.625664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.625728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.625782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.625842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.625896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.625937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.625942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.626000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.626051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.626106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.626163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.626208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.626216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.626274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.626339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.626419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.626480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.626526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.626537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.626607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:45.626674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:45.626742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:45.626808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:45.626860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:45.626868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:45.626934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257941:3745], now have 1 active actors on pipe
2025-10-01T14:11:45.627935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:45.629779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:45.629834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:45.629881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1459 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fcfed09f-3e5d7158-7d930512-92791f33_0
2025-10-01T14:11:45.630008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255818992257941:3745]
2025-10-01T14:11:45.630141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1459 sessionId: src_id|fcfed09f-3e5d7158-7d930512-92791f33_0 is DEAD
2025-10-01T14:11:45.630269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfed09f-3e5d7158-7d930512-92791f33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:45.630294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfed09f-3e5d7158-7d930512-92791f33_0] Write session will restart in 0.007957s
2025-10-01T14:11:45.630321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfed09f-3e5d7158-7d930512-92791f33_0] Write session: Do CDS request
2025-10-01T14:11:45.630328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfed09f-3e5d7158-7d930512-92791f33_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:45.639914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfed09f-3e5d7158-7d930512-92791f33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.639976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:45.639999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1460
2025-10-01T14:11:45.640147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.640177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1460 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:45.640186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1460 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:45.640189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:45.640550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1460 sessionId:  describe result for acl check
2025-10-01T14:11:45.640584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:45.640590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:45.640591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:45.640597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255818992258068:3224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:45.641097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255818992258068:3224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:45.643363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255818992258068:3224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:45.645673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255818992258068:3224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:45.645686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255818992258068:3224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:45.645690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255818992258068:3224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:45.645697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1460 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:45.646494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:45.649272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:45.649505Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:45.649521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:45.649532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:45.649584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:45.649619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255816615377105:10047]
2025-10-01T14:11:45.650227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:45.650534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:45.650585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:45.650925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:45.650986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.650992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.650993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.650995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.650996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.650997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.650998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.650999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.651001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.651002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.651003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.651004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.651005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.651006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.651011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.651021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.651025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.651029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.651033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.651037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.651041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.651044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.651048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.651051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.651055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.651058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.651062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.651065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.651072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.651085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.651095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.651100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.651109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.651113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.651117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.651124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.651129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.651138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.651142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.651151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.651157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.651170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.651174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.651180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.651185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.651194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.651199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.651204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.651213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.651219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.651228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.651232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.651241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.651247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.651251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.651256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.651296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:45.654957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:45.655916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:45.655932Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:45.655934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:45.655937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:45.655943Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1459 [2:7556255816615377105:10047]
2025-10-01T14:11:45.655958Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:45.655970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:45.655971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.655973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.655974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.655986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:45.655989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:45.655994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:45.656045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.656051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.656052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.656055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:45.656056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:45.656111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:45.656118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.656129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.656144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.656162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:45.656180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992258229:3224], now have 1 active actors on pipe
2025-10-01T14:11:45.656186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992257947:2446], now have 1 active actors on pipe
2025-10-01T14:11:45.656192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255816615377100:10047]
2025-10-01T14:11:45.656193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255816615377100:10047]
2025-10-01T14:11:45.656195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255816615377100:10047]
2025-10-01T14:11:45.656203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:45.656218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:45.656227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:45.656229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:45.656231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:45.656234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:45.656237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:45.656262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255816615377100:10047]
2025-10-01T14:11:45.656269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:45.656271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:45.656247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1459
2025-10-01T14:11:45.656295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.656247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1459
2025-10-01T14:11:45.656305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.656336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b520378-9a6a8efc-8879cbec-f0160151_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:45.656346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.656350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.656353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:45.656361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.656372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:45.656392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.656545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.656561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.656584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.656662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1460 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b520378-9a6a8efc-8879cbec-f0160151_0
2025-10-01T14:11:45.657032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfed09f-3e5d7158-7d930512-92791f33_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b520378-9a6a8efc-8879cbec-f0160151_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:45.659514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b520378-9a6a8efc-8879cbec-f0160151_0] Write session: try to update token
2025-10-01T14:11:45.659534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b520378-9a6a8efc-8879cbec-f0160151_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:45.673499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1460 sessionId: src_id|4b520378-9a6a8efc-8879cbec-f0160151_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:45.675911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:45.676005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:45.676033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:45.676036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:45.676039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:45.676048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255816615377100:10047]
2025-10-01T14:11:45.676053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255816615377100:10047]
2025-10-01T14:11:45.676057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255816615377100:10047]
2025-10-01T14:11:45.676080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:45.676085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:45.676089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:45.676107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.676123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.676143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:45.676155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.676158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:45.676285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:45.730126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255818992258243:3745]
2025-10-01T14:11:45.730412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1459, pipe: [1:7556255818992258243:3745]
2025-10-01T14:11:45.822979Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:45.823492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992258243:3745], now have 1 active actors on pipe
2025-10-01T14:11:45.823704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:45.823704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:45.823718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:45.823751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255818992258243:3745]
2025-10-01T14:11:45.823775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1460 reason: error at write: Disconnected sessionId: src_id|4b520378-9a6a8efc-8879cbec-f0160151_0
2025-10-01T14:11:45.824028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1460 sessionId: src_id|4b520378-9a6a8efc-8879cbec-f0160151_0 is DEAD
2025-10-01T14:11:45.823716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:45.824188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b520378-9a6a8efc-8879cbec-f0160151_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:45.824198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b520378-9a6a8efc-8879cbec-f0160151_0] Write session will restart in 0.006740s
2025-10-01T14:11:45.824223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b520378-9a6a8efc-8879cbec-f0160151_0] Write session: Do CDS request
2025-10-01T14:11:45.824230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b520378-9a6a8efc-8879cbec-f0160151_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:45.831959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b520378-9a6a8efc-8879cbec-f0160151_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.832036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:45.832053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1461
2025-10-01T14:11:45.832204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:45.832236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1461 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:45.832241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1461 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:45.832244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:45.832658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1461 sessionId:  describe result for acl check
2025-10-01T14:11:45.832717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:45.832727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:45.832729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:45.832734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255818992258263:3223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:45.833267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255818992258263:3223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:45.835293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255818992258263:3223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:45.838788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255818992258263:3223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:45.838804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255818992258263:3223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:45.838807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255818992258263:3223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:45.838814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1461 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:45.848790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:45.851636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:45.851827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:45.851836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:45.851845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:45.851896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:45.851933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255816615377397:10049]
2025-10-01T14:11:45.852367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:45.852703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:45.852758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:45.853032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:45.853107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.853119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.853120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.853121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.853122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.853124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.853125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.853126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.853127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.853128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.853129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.853131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.853132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.853133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.853138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.853147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.853151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.853154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.853158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.853161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.853165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.853168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.853172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.853178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.853182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.853185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.853189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.853192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.853200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.853208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:45.853214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.853219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:45.853223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.853228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:45.853232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.853236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:45.853240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.853244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:45.853248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.853252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:45.853256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.853261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:45.853265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.853270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:45.853274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.853278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:45.853282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.853286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.853290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.853295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.853300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.853305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.853309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.853312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:45.853316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.853321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:45.853355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:45.857080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:45.857720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:45.857735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:45.857738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:45.857742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:45.857749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1460 [2:7556255816615377397:10049]
2025-10-01T14:11:45.857765Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:45.857786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:45.857794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.857797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.857799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.857817Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:45.857826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:45.857832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:45.857895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.857903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.857905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.857908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:45.857911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:45.858107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1460
2025-10-01T14:11:45.858115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:45.858114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1460
2025-10-01T14:11:45.858124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.858135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:45.858145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:45.858161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:45.858179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992258248:2446], now have 1 active actors on pipe
2025-10-01T14:11:45.858182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992258333:3223], now have 1 active actors on pipe
2025-10-01T14:11:45.858201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.858206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.858225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255816615377392:10049]
2025-10-01T14:11:45.858238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255816615377392:10049]
2025-10-01T14:11:45.858240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255816615377392:10049]
2025-10-01T14:11:45.858253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:45.858262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:45.858264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:45.858266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:45.858267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:45.858280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:45.858282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:45.858298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d796a901-c618a545-e0ac5469-2b15d23e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:45.858309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:45.858313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:45.858315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:45.858324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:45.858332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:45.858363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255816615377392:10049]
2025-10-01T14:11:45.858386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:45.858386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:45.858397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.858562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.858576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.858612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:45.858679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1461 partition: 0 MaxSeqNo: 45 sessionId: src_id|d796a901-c618a545-e0ac5469-2b15d23e_0
2025-10-01T14:11:45.859094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b520378-9a6a8efc-8879cbec-f0160151_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d796a901-c618a545-e0ac5469-2b15d23e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:45.861524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d796a901-c618a545-e0ac5469-2b15d23e_0] Write session: try to update token
2025-10-01T14:11:45.861545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d796a901-c618a545-e0ac5469-2b15d23e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:45.875211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:45.875237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:45.875248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255816615377392:10049]
2025-10-01T14:11:45.875297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:45.875304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:45.875512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:45.875717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:45.875877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:45.876035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:45.876232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:45.876275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:45.877839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1461 sessionId: src_id|d796a901-c618a545-e0ac5469-2b15d23e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:45.880368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:45.880603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:45.880624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:45.880658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:45.880736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:45.891136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:45.891164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:45.891167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:45.891169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:45.891181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255816615377392:10049]
2025-10-01T14:11:45.891185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255816615377392:10049]
2025-10-01T14:11:45.891189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255816615377392:10049]
2025-10-01T14:11:45.891240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:45.891254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:45.891257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:45.891385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:45.891538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:45.891552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:45.891555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:45.923099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255818992258548:3745]
2025-10-01T14:11:45.923395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1460, pipe: [1:7556255818992258548:3745]
2025-10-01T14:11:46.047959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:46.056425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.056461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.056634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.056706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.056771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.056832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.056870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.056878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.056943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.057000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.057057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.057116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.057159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.057162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.057240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.057299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.057359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.057427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.057473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.057476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.057545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.057606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.057669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.057730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.057770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.057773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.057837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.057898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.057958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.058018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.058068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.058071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.058134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.058192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.058250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.058308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.058353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.058358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.058451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.058515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.058580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.058650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.058714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.058717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.058787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.058845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.058906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.058982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.059021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.059023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.059092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.059149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.059207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.059266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.059306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.059308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.059376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.059431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.059500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.059558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.059597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.059599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.059692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255818992258548:3745], now have 1 active actors on pipe
2025-10-01T14:11:46.059957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:46.059986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:46.060016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1461 reason: error at write: Disconnected sessionId: src_id|d796a901-c618a545-e0ac5469-2b15d23e_0
2025-10-01T14:11:46.060268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1461 sessionId: src_id|d796a901-c618a545-e0ac5469-2b15d23e_0 is DEAD
2025-10-01T14:11:46.060447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255818992258548:3745]
2025-10-01T14:11:46.060463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:46.060626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d796a901-c618a545-e0ac5469-2b15d23e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:46.060637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d796a901-c618a545-e0ac5469-2b15d23e_0] Write session will restart in 0.007462s
2025-10-01T14:11:46.060663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d796a901-c618a545-e0ac5469-2b15d23e_0] Write session: Do CDS request
2025-10-01T14:11:46.060679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d796a901-c618a545-e0ac5469-2b15d23e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:46.061217Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:46.069064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d796a901-c618a545-e0ac5469-2b15d23e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.069169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:46.069190Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1462
2025-10-01T14:11:46.069795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.069836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1462 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:46.069846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1462 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:46.069855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:46.071025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1462 sessionId:  describe result for acl check
2025-10-01T14:11:46.071064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:46.071066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:46.071067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:46.071074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255823287225860:3206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:46.071634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255823287225860:3206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:46.078123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255823287225860:3206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:46.084988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255823287225860:3206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:46.085004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255823287225860:3206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:46.085006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255823287225860:3206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:46.085013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1462 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:46.092734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:46.097213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:46.097460Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:46.097464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:46.097473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:46.097515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:46.097543Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255820910345001:10053]
2025-10-01T14:11:46.098059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:46.098539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:46.098588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:46.098860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:46.098910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.098911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.098912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.098913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.098913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.098914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.098915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.098916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.098916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.098917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.098918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.098918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.098919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.098920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.098924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.098930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.098932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.098934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.098937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.098939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.098941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.098943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.098945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.098948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.098950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.098952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.098954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.098956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.098962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.098967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.098971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.098974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.098976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.098979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.098981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.098984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.098987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.098990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.098992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.098995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.098999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.099002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.099004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.099007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.099009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.099013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.099015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.099018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.099021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.099024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.099026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.099029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.099031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.099034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.099037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.099042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.099079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:46.104144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1461
2025-10-01T14:11:46.104172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1461
2025-10-01T14:11:46.105181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d796a901-c618a545-e0ac5469-2b15d23e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:46.103156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:46.103724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:46.103728Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:46.103729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:46.103732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:46.103737Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1461 [2:7556255820910345001:10053]
2025-10-01T14:11:46.103748Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:46.103762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:46.103764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.103767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.103768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.103780Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:46.103784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:46.103788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:46.103828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.103830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.103831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.103834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:46.103836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:46.103908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:46.103910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.103921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.103930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.103944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:46.103960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255820910344996:10053]
2025-10-01T14:11:46.103963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255820910344996:10053]
2025-10-01T14:11:46.103965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255820910344996:10053]
2025-10-01T14:11:46.103973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:46.103977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:46.103979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:46.103982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:46.103986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287226005:3206], now have 1 active actors on pipe
2025-10-01T14:11:46.103991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287225847:2446], now have 1 active actors on pipe
2025-10-01T14:11:46.103996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:46.104009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:46.104011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:46.104040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255820910344996:10053]
2025-10-01T14:11:46.104048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:46.104077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:46.104309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.104315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.104342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:46.104349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.104353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.104355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:46.104365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.104375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:46.104389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.104597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.104600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.104612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.107781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0] Write session: try to update token
2025-10-01T14:11:46.107799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:46.104710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1462 partition: 0 MaxSeqNo: 45 sessionId: src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0
2025-10-01T14:11:46.135934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1462 sessionId: src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:46.141866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:46.146547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.146590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.146614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:46.146617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:46.146620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:46.146622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:46.146632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255820910344996:10053]
2025-10-01T14:11:46.146640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255820910344996:10053]
2025-10-01T14:11:46.146645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255820910344996:10053]
2025-10-01T14:11:46.146710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:46.146714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:46.146717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:46.146720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:46.146725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.146728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:46.146881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:46.160713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255823287226160:3745]
2025-10-01T14:11:46.160959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1461, pipe: [1:7556255823287226160:3745]
2025-10-01T14:11:46.290334Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:46.291034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:46.291090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287226160:3745], now have 1 active actors on pipe
2025-10-01T14:11:46.291177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:46.291272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:46.291279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:46.291349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1462 reason: error at write: Disconnected sessionId: src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0
2025-10-01T14:11:46.291525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1462 sessionId: src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0 is DEAD
2025-10-01T14:11:46.291633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:46.291643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0] Write session will restart in 0.007929s
2025-10-01T14:11:46.291666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0] Write session: Do CDS request
2025-10-01T14:11:46.291671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:46.291679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:46.291723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255823287226160:3745]
2025-10-01T14:11:46.300930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.301009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:46.301023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1463
2025-10-01T14:11:46.301163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.301191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1463 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:46.301200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1463 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:46.301204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:46.301570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1463 sessionId:  describe result for acl check
2025-10-01T14:11:46.301608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:46.301613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:46.301614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:46.301618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255823287226272:3184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:46.301974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255823287226272:3184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:46.304190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255823287226272:3184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:46.307188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255823287226272:3184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:46.307213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255823287226272:3184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:46.307217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255823287226272:3184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:46.307225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1463 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:46.308031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:46.310952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:46.311166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:46.311174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:46.311182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:46.311232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:46.311274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255820910345301:10055]
2025-10-01T14:11:46.311818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:46.312089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:46.312118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:46.312335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:46.312384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.312390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.312392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.312393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.312394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.312395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.312396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.312398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.312399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.312400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.312401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.312402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.312403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.312405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.312410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.312416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.312418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.312420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.312422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.312424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.312426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.312428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.312430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.312432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.312434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.312435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.312437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.312439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.312444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.312448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.312452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.312455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.312458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.312461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.312464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.312467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.312469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.312472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.312478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.312481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.312485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.312491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.312494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.312499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.312507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.312512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.312521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.312530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.312538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.312543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.312550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.312558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.312561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.312564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.312566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.312569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.312594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:46.316082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:46.316636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:46.316650Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:46.316651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:46.316654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:46.316659Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1462 [2:7556255820910345301:10055]
2025-10-01T14:11:46.316682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:46.316695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:46.316698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.316702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.316705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.316720Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:46.316731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:46.316738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:46.316783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.316788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.316790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.316792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:46.316794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:46.316847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:46.316853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.316863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.316873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.316890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:46.316907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287226471:3184], now have 1 active actors on pipe
2025-10-01T14:11:46.316913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287226175:2446], now have 1 active actors on pipe
2025-10-01T14:11:46.316918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255820910345296:10055]
2025-10-01T14:11:46.316920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255820910345296:10055]
2025-10-01T14:11:46.316922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255820910345296:10055]
2025-10-01T14:11:46.316932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:46.316941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:46.316944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:46.316946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:46.316948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:46.316956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:46.316958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:46.316984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255820910345296:10055]
2025-10-01T14:11:46.316994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:46.316998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:46.317002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1462
2025-10-01T14:11:46.317004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1462
2025-10-01T14:11:46.317404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.317413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.317430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:46.317435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.317438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.317440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:46.317446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.317457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:46.317467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.317603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.317609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.317619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.317680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1463 partition: 0 MaxSeqNo: 45 sessionId: src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0
2025-10-01T14:11:46.318039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2975b0be-e26b0cf1-be8e4d5d-ae0f053c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:46.320245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0] Write session: try to update token
2025-10-01T14:11:46.320258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:46.333696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1463 sessionId: src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:46.336074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:46.337587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.337614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.337633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:46.337637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:46.337640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:46.337642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:46.337650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255820910345296:10055]
2025-10-01T14:11:46.337655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255820910345296:10055]
2025-10-01T14:11:46.337659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255820910345296:10055]
2025-10-01T14:11:46.337696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:46.337710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:46.337710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:46.337713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:46.337717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.337720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:46.337838Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:46.392084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255823287226491:3745]
2025-10-01T14:11:46.392354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1462, pipe: [1:7556255823287226491:3745]
2025-10-01T14:11:46.483022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:46.483237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:46.483291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287226491:3745], now have 1 active actors on pipe
2025-10-01T14:11:46.483553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:46.483590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255823287226491:3745]
2025-10-01T14:11:46.483608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:46.483645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:46.483657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:46.483727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1463 reason: error at write: Disconnected sessionId: src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0
2025-10-01T14:11:46.483911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1463 sessionId: src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0 is DEAD
2025-10-01T14:11:46.484052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:46.484058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0] Write session will restart in 0.007373s
2025-10-01T14:11:46.484082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0] Write session: Do CDS request
2025-10-01T14:11:46.484091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:46.492959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.493055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:46.493072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1464
2025-10-01T14:11:46.493169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.493200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1464 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:46.493206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1464 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:46.493211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:46.493939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1464 sessionId:  describe result for acl check
2025-10-01T14:11:46.493971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:46.493973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:46.493974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:46.493979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255823287226547:3187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:46.494465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255823287226547:3187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:46.497660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255823287226547:3187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:46.501102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255823287226547:3187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:46.501113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255823287226547:3187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:46.501116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255823287226547:3187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:46.501123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1464 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:46.504256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:46.507581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:46.507803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:46.507814Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:46.507834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:46.507885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:46.507926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255820910345596:10059]
2025-10-01T14:11:46.508582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:46.508868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:46.508914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:46.509218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:46.509275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.509281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.509282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.509283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.509284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.509285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.509286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.509287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.509288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.509289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.509290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.509291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.509292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.509293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.509299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.509309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.509313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.509317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.509320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.509324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.509328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.509331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.509335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.509339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.509342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.509346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.509349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.509353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.509360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.509368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.509374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.509380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.509384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.509389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.509393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.509398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.509402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.509408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.509412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.509416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.509421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.509425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.509429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.509435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.509439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.509444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.509453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.509458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.509462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.509467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.509472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.509481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.509485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.509490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.509493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.509498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.509537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:46.513677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:46.514408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:46.514423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:46.514426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:46.514429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:46.514437Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1463 [2:7556255820910345596:10059]
2025-10-01T14:11:46.514455Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:46.514472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:46.514479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.514483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.514485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.514503Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:46.514517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:46.514524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:46.514568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.514575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.514577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.514581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:46.514584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:46.514656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:46.514663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.514677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.514691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.514711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:46.514733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287226499:2446], now have 1 active actors on pipe
2025-10-01T14:11:46.514740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287226739:3187], now have 1 active actors on pipe
2025-10-01T14:11:46.514748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255820910345591:10059]
2025-10-01T14:11:46.514750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255820910345591:10059]
2025-10-01T14:11:46.514752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255820910345591:10059]
2025-10-01T14:11:46.514769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:46.514789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:46.514807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:46.514811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:46.514812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:46.514813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:46.514815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:46.514774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1463
2025-10-01T14:11:46.514778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1463
2025-10-01T14:11:46.514868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.514879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.514891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255820910345591:10059]
2025-10-01T14:11:46.514903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:46.514917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:46.514930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:46.514935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.514939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.514944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:46.514953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.514959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:46.514976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.515118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.515128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.515144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.515236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1464 partition: 0 MaxSeqNo: 45 sessionId: src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0
2025-10-01T14:11:46.515634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed72822f-337d5764-f5006ec1-c59bcd60_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:46.518124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0] Write session: try to update token
2025-10-01T14:11:46.518144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:46.531290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1464 sessionId: src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:46.533685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:46.533907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.533930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.533965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:46.534048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:46.536365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:46.536384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:46.536386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:46.536388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:46.536395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255820910345591:10059]
2025-10-01T14:11:46.536398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255820910345591:10059]
2025-10-01T14:11:46.536401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255820910345591:10059]
2025-10-01T14:11:46.536439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:46.536440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:46.536445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:46.536448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:46.536450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.536451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:46.536568Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:46.583577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255823287226801:3745]
2025-10-01T14:11:46.583805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1463, pipe: [1:7556255823287226801:3745]
2025-10-01T14:11:46.676866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:46.684274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.684299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.684440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.684500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.684555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.684617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.684665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.684683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.684745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.684795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.684848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.684904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.684943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.684949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.685001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.685049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.685098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.685149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.685189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.685195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.685249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.685312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.685363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.685412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.685450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.685455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.685507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.685558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.685622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.685679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.685722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.685728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.685779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.685828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.685882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.685939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.685979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.685983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.686038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.686087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.686139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.686193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.686232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.686237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.686289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.686338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.686418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.686479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.686519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.686524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.686580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.686634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.686688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.686744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.686784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.686788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.686846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:46.686897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:46.686951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:46.687019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:46.687062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:46.687068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:46.687118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287226801:3745], now have 1 active actors on pipe
2025-10-01T14:11:46.687383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255823287226801:3745]
2025-10-01T14:11:46.687388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:46.687391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:46.687415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1464 reason: error at write: Disconnected sessionId: src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0
2025-10-01T14:11:46.687419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:46.687634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1464 sessionId: src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0 is DEAD
2025-10-01T14:11:46.687763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:46.687774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0] Write session will restart in 0.007979s
2025-10-01T14:11:46.687799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0] Write session: Do CDS request
2025-10-01T14:11:46.687805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:46.688277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:46.696949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.697076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:46.697096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1465
2025-10-01T14:11:46.697487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.697522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1465 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:46.697531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1465 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:46.697536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:46.697943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1465 sessionId:  describe result for acl check
2025-10-01T14:11:46.697976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:46.697979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:46.697983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:46.697988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255823287226843:3175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:46.698462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255823287226843:3175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:46.701128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255823287226843:3175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:46.705252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255823287226843:3175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:46.705268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255823287226843:3175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:46.705271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255823287226843:3175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:46.705278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1465 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:46.707956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:46.711257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:46.711603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:46.711625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:46.711637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:46.711694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:46.711731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255820910345923:10072]
2025-10-01T14:11:46.712319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:46.712602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:46.712647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:46.712953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:46.713011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.713017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.713018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.713019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.713020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.713022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.713023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.713024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.713026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.713027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.713028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.713030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.713031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.713032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.713037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.713047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.713051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.713054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.713058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.713061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.713064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.713067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.713070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.713074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.713076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.713080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.713083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.713087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.713093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.713101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.713106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.713110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.713116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.713120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.713124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.713129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.713133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.713138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.713143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.713148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.713153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.713157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.713162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.713166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.713170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.713175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.713179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.713184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.713193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.713199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.713207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.713212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.713221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.713226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.713234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.713239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.713284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:46.717250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:46.717821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:46.717836Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:46.717838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:46.717842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:46.717849Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1464 [2:7556255820910345923:10072]
2025-10-01T14:11:46.717864Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:46.717879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:46.717886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.717889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.717891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.717905Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:46.717909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:46.717914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:46.717957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.717963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.717965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.717967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:46.717969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:46.718027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:46.718035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.718046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.718059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.718078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:46.718098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287227062:3175], now have 1 active actors on pipe
2025-10-01T14:11:46.718106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287226804:2446], now have 1 active actors on pipe
2025-10-01T14:11:46.718113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255820910345918:10072]
2025-10-01T14:11:46.718120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255820910345918:10072]
2025-10-01T14:11:46.718122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255820910345918:10072]
2025-10-01T14:11:46.718135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:46.718153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:46.718164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:46.718167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:46.718169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:46.718170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:46.718173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:46.718201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255820910345918:10072]
2025-10-01T14:11:46.718205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:46.718206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:46.718220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.718225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.718157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1464
2025-10-01T14:11:46.718178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1464
2025-10-01T14:11:46.718272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:46.718282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.718287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.718289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:46.718296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.718304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:46.718322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.718450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.718458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.718472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.718551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1465 partition: 0 MaxSeqNo: 45 sessionId: src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0
2025-10-01T14:11:46.718949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebef395-5217e2b2-37e1d863-e6ccecb7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:46.721447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0] Write session: try to update token
2025-10-01T14:11:46.721465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:46.738009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1465 sessionId: src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:46.740463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:46.742437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.742460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.742479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:46.742482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:46.742484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:46.742486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:46.742492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255820910345918:10072]
2025-10-01T14:11:46.742496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255820910345918:10072]
2025-10-01T14:11:46.742499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255820910345918:10072]
2025-10-01T14:11:46.742544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:46.742549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:46.742555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.742556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:46.742557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:46.742560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:46.742672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:46.787406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255823287227107:3745]
2025-10-01T14:11:46.787698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1464, pipe: [1:7556255823287227107:3745]
2025-10-01T14:11:46.891510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:46.892378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:46.892437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287227107:3745], now have 1 active actors on pipe
2025-10-01T14:11:46.892520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:46.892607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:46.892607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:46.892614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:46.892643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255823287227107:3745]
2025-10-01T14:11:46.892706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1465 reason: error at write: Disconnected sessionId: src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0
2025-10-01T14:11:46.892893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1465 sessionId: src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0 is DEAD
2025-10-01T14:11:46.893048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:46.893058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0] Write session will restart in 0.006978s
2025-10-01T14:11:46.893084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0] Write session: Do CDS request
2025-10-01T14:11:46.893093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:46.906920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.906994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:46.907008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1466
2025-10-01T14:11:46.907185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:46.907227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1466 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:46.907232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1466 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:46.907247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:46.907655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1466 sessionId:  describe result for acl check
2025-10-01T14:11:46.907695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:46.907704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:46.907709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:46.907714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255823287227265:3172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:46.908237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255823287227265:3172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:46.911306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255823287227265:3172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:46.912727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:46.915625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:46.915801Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:46.915809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:46.915817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:46.915850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:46.915878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255820910346218:10074]
2025-10-01T14:11:46.916009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255823287227265:3172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:46.916026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255823287227265:3172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:46.916029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255823287227265:3172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:46.916037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1466 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:46.916274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:46.916501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:46.916527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:46.916731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:46.916767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.916772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.916773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.916773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.916774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.916774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.916775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.916776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.916776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.916777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.916777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.916778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.916778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.916779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.916782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.916787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.916789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.916791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.916793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.916795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.916797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.916799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.916801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.916804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.916806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.916808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.916810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.916812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.916816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.916821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:46.916824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.916827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:46.916830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.916833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:46.916835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.916838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:46.916840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.916843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:46.916846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.916848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:46.916851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.916854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:46.916856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.916859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:46.916861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.916864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:46.916866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.916869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.916871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.916873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.916877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.916879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.916881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.916884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:46.916886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.916888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:46.916907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:46.920834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:46.921400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:46.921418Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:46.921420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:46.921424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:46.921431Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1465 [2:7556255820910346218:10074]
2025-10-01T14:11:46.921445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:46.921461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:46.921468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.921471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.921474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.921491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:46.921500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:46.921506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:46.921567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.921574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.921577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.921580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:46.921582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:46.921647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:46.921654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.921666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:46.921677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:46.921697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:46.921718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287227405:3172], now have 1 active actors on pipe
2025-10-01T14:11:46.921726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287227112:2446], now have 1 active actors on pipe
2025-10-01T14:11:46.921734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255820910346213:10074]
2025-10-01T14:11:46.921736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255820910346213:10074]
2025-10-01T14:11:46.921739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255820910346213:10074]
2025-10-01T14:11:46.921751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:46.921765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:46.921768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:46.921776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:46.921778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:46.921781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:46.921784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:46.921816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255820910346213:10074]
2025-10-01T14:11:46.921798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1465
2025-10-01T14:11:46.921824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:46.921825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:46.921835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1465
2025-10-01T14:11:46.921852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.921861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.921892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d35e01cf-e93362ac-e38faed-482a3e02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:46.921902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:46.921906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:46.921912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:46.921921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:46.921933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:46.921954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.922105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.922115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.922132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:46.922223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1466 partition: 0 MaxSeqNo: 45 sessionId: src_id|d35e01cf-e93362ac-e38faed-482a3e02_0
2025-10-01T14:11:46.922585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac75d6b3-403f9bf0-e5f6f19f-e1085fc6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d35e01cf-e93362ac-e38faed-482a3e02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:46.924975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35e01cf-e93362ac-e38faed-482a3e02_0] Write session: try to update token
2025-10-01T14:11:46.924993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35e01cf-e93362ac-e38faed-482a3e02_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:46.940271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1466 sessionId: src_id|d35e01cf-e93362ac-e38faed-482a3e02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:46.942821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:46.945117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:46.945154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:46.945179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:46.945188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:46.945191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:46.945193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:46.945201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255820910346213:10074]
2025-10-01T14:11:46.945206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255820910346213:10074]
2025-10-01T14:11:46.945209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255820910346213:10074]
2025-10-01T14:11:46.945252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:46.945265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:46.945268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:46.945278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:46.945288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:46.945290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:46.945449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:46.992698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255823287227417:3745]
2025-10-01T14:11:46.993023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1465, pipe: [1:7556255823287227417:3745]
2025-10-01T14:11:47.094045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:47.094897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:47.094960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255823287227417:3745], now have 1 active actors on pipe
2025-10-01T14:11:47.095030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:47.095098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:47.095150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255823287227417:3745]
2025-10-01T14:11:47.104890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:47.104905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:47.104924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1466 reason: error at write: Disconnected sessionId: src_id|d35e01cf-e93362ac-e38faed-482a3e02_0
2025-10-01T14:11:47.105065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1466 sessionId: src_id|d35e01cf-e93362ac-e38faed-482a3e02_0 is DEAD
2025-10-01T14:11:47.105206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35e01cf-e93362ac-e38faed-482a3e02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:47.105213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35e01cf-e93362ac-e38faed-482a3e02_0] Write session will restart in 0.006168s
2025-10-01T14:11:47.105237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35e01cf-e93362ac-e38faed-482a3e02_0] Write session: Do CDS request
2025-10-01T14:11:47.105247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35e01cf-e93362ac-e38faed-482a3e02_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:47.112866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35e01cf-e93362ac-e38faed-482a3e02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.112956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:47.112971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1467
2025-10-01T14:11:47.113088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.113118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1467 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:47.113128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1467 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:47.113136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:47.113543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1467 sessionId:  describe result for acl check
2025-10-01T14:11:47.113582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:47.113591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:47.113593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:47.113599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255827582194855:3154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:47.114127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255827582194855:3154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:47.117572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255827582194855:3154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:47.119373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:47.119656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255827582194855:3154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:47.119668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255827582194855:3154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:47.119671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255827582194855:3154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:47.119679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1467 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:47.122217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:47.122446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:47.122459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:47.122471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:47.122525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:47.122572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255825205313826:10078]
2025-10-01T14:11:47.123175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:47.123456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:47.123500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:47.123879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:47.123948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.123955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.123956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.123957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.123958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.123960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.123961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.123962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.123963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.123964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.123965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.123966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.123968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.123969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.123975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.123985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.123990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.123993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.123997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.124000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.124004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.124008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.124012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.124020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.124023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.124027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.124031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.124036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.124043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.124054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.124064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.124070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.124074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.124079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.124084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.124093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.124098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.124108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.124112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.124121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.124126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.124130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.124137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.124142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.124147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.124156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.124160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.124169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.124173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.124180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.124190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.124195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.124199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.124208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.124212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.124221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.124260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:47.128037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:47.128699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:47.128716Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:47.128718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:47.128721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:47.128728Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1466 [2:7556255825205313826:10078]
2025-10-01T14:11:47.128744Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:47.128762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:47.128765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.128768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.128771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.128787Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:47.128793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:47.128804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:47.128860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.128867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.128869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.128873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:47.128875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:47.129100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1466
2025-10-01T14:11:47.129101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1466
2025-10-01T14:11:47.129328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:47.129340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.129351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.129360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.129375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:47.129395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582194718:2446], now have 1 active actors on pipe
2025-10-01T14:11:47.129403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195012:3154], now have 1 active actors on pipe
2025-10-01T14:11:47.129422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.129427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.129444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255825205313820:10078]
2025-10-01T14:11:47.129450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255825205313820:10078]
2025-10-01T14:11:47.129452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255825205313820:10078]
2025-10-01T14:11:47.129466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:47.129483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:47.129484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:47.129491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:47.129493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:47.129498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:47.129501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:47.129516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54661369-e81ddff8-df448bb3-4a45bdf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:47.129527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.129531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.129537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:47.129546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.129557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:47.129602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255825205313820:10078]
2025-10-01T14:11:47.129613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:47.129624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:47.129625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.129772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.129780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.129795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.129879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1467 partition: 0 MaxSeqNo: 45 sessionId: src_id|54661369-e81ddff8-df448bb3-4a45bdf_0
2025-10-01T14:11:47.130233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35e01cf-e93362ac-e38faed-482a3e02_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54661369-e81ddff8-df448bb3-4a45bdf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:47.132656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54661369-e81ddff8-df448bb3-4a45bdf_0] Write session: try to update token
2025-10-01T14:11:47.132683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54661369-e81ddff8-df448bb3-4a45bdf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:47.145905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:47.145925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:47.145936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255825205313820:10078]
2025-10-01T14:11:47.145986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:47.146004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:47.146141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:47.146264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:47.146403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:47.146477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1467 sessionId: src_id|54661369-e81ddff8-df448bb3-4a45bdf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:47.146533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:47.146716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:47.146758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:47.148959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:47.149175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.149189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.149217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:47.149296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:47.159943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:47.159957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:47.159959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:47.159961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:47.159969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255825205313820:10078]
2025-10-01T14:11:47.159971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255825205313820:10078]
2025-10-01T14:11:47.159976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255825205313820:10078]
2025-10-01T14:11:47.160018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:47.160027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.160029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:47.160030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:47.160035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:47.160038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:47.160154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:47.195441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255827582195036:3745]
2025-10-01T14:11:47.195683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1466, pipe: [1:7556255827582195036:3745]
2025-10-01T14:11:47.304806Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:47.311866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.311889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.312017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.312067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.312120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.312175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.312224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.312232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.312288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.312336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.312386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.312440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.312482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.312488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.312548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.312601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.312654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.312722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.312764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.312770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.312829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.312883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.312937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.312992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.313032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.313037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.313092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.313143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.313199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.313254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.313293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.313299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.313356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.313411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.313468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.313526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.313564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.313569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.313625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.313674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.313725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.313781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.313820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.313827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.313882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.313932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.313988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.314048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.314095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.314102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.314176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.314240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.314296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.314349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.314409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.314417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.314478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:47.314543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:47.314607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:47.314671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:47.314782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:47.314788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:47.314831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195036:3745], now have 1 active actors on pipe
2025-10-01T14:11:47.315035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:47.315085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:47.315088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:47.315115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1467 reason: error at write: Disconnected sessionId: src_id|54661369-e81ddff8-df448bb3-4a45bdf_0
2025-10-01T14:11:47.315376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1467 sessionId: src_id|54661369-e81ddff8-df448bb3-4a45bdf_0 is DEAD
2025-10-01T14:11:47.315530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54661369-e81ddff8-df448bb3-4a45bdf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:47.315540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54661369-e81ddff8-df448bb3-4a45bdf_0] Write session will restart in 0.006754s
2025-10-01T14:11:47.315564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54661369-e81ddff8-df448bb3-4a45bdf_0] Write session: Do CDS request
2025-10-01T14:11:47.315570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54661369-e81ddff8-df448bb3-4a45bdf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:47.315561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255827582195036:3745]
2025-10-01T14:11:47.315912Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:47.323934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54661369-e81ddff8-df448bb3-4a45bdf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.324043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:47.324060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1468
2025-10-01T14:11:47.324164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.324196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1468 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:47.324205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1468 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:47.324209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:47.324720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1468 sessionId:  describe result for acl check
2025-10-01T14:11:47.324755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:47.324761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:47.324778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:47.324784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255827582195103:3149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:47.325266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255827582195103:3149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:47.328245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255827582195103:3149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:47.331742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255827582195103:3149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:47.331775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255827582195103:3149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:47.331778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255827582195103:3149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:47.331785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1468 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:47.335248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:47.338034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:47.338327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:47.338336Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:47.338348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:47.338421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:47.338459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255825205314132:10080]
2025-10-01T14:11:47.339019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:47.339246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:47.339277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:47.339488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:47.339525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.339529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.339530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.339530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.339531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.339532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.339532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.339533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.339533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.339534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.339534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.339535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.339536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.339536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.339540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.339545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.339547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.339549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.339551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.339552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.339554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.339556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.339558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.339560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.339562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.339563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.339565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.339567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.339571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.339576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.339580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.339583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.339585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.339587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.339589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.339592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.339594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.339597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.339599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.339602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.339605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.339611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.339613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.339616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.339618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.339623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.339630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.339634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.339642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.339650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.339658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.339663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.339671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.339675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.339680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.339688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.339709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:47.343365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:47.344323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:47.344342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:47.344344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:47.344348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:47.344354Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1467 [2:7556255825205314132:10080]
2025-10-01T14:11:47.344368Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:47.344386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:47.344390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.344393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.344395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.344410Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:47.344420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:47.344426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:47.344491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.344497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.344499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.344503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:47.344506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:47.344574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:47.344580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.344592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.344604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.344628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:47.344645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195287:3149], now have 1 active actors on pipe
2025-10-01T14:11:47.344652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195051:2446], now have 1 active actors on pipe
2025-10-01T14:11:47.344661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255825205314127:10080]
2025-10-01T14:11:47.344678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255825205314127:10080]
2025-10-01T14:11:47.344681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255825205314127:10080]
2025-10-01T14:11:47.344696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:47.344711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:47.344720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:47.344724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:47.344726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:47.344729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:47.344731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:47.344762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255825205314127:10080]
2025-10-01T14:11:47.344769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:47.344738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1467
2025-10-01T14:11:47.344771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:47.344776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1467
2025-10-01T14:11:47.344796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.344803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.344829Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:47.344839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.344843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.344844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:47.344850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.344857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:47.344877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.345025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.345031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.345041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.345102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1468 partition: 0 MaxSeqNo: 45 sessionId: src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0
2025-10-01T14:11:47.345467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54661369-e81ddff8-df448bb3-4a45bdf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:47.347802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0] Write session: try to update token
2025-10-01T14:11:47.347820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:47.361632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1468 sessionId: src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:47.364074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:47.365932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.365965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.365987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:47.365991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:47.365993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:47.365995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:47.366003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255825205314127:10080]
2025-10-01T14:11:47.366008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255825205314127:10080]
2025-10-01T14:11:47.366019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255825205314127:10080]
2025-10-01T14:11:47.366056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:47.366066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:47.366068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:47.366070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:47.366073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.366074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:47.366189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:47.415585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255827582195374:3745]
2025-10-01T14:11:47.415840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1467, pipe: [1:7556255827582195374:3745]
2025-10-01T14:11:47.506635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:47.506837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:47.506882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195374:3745], now have 1 active actors on pipe
2025-10-01T14:11:47.506969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:47.507044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255827582195374:3745]
2025-10-01T14:11:47.507058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:47.507060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:47.507072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:47.507127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1468 reason: error at write: Disconnected sessionId: src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0
2025-10-01T14:11:47.507314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1468 sessionId: src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0 is DEAD
2025-10-01T14:11:47.507427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:47.507436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0] Write session will restart in 0.007287s
2025-10-01T14:11:47.507454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0] Write session: Do CDS request
2025-10-01T14:11:47.507461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:47.515900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.515969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:47.515985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1469
2025-10-01T14:11:47.516121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.516145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1469 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:47.516152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1469 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:47.516155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:47.516503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1469 sessionId:  describe result for acl check
2025-10-01T14:11:47.516526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:47.516531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:47.516531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:47.516535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255827582195442:3146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:47.516922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255827582195442:3146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:47.519384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255827582195442:3146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:47.522338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255827582195442:3146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:47.522353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255827582195442:3146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:47.522356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255827582195442:3146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:47.522363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1469 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:47.525244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:47.528300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:47.528541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:47.528553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:47.528565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:47.528619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:47.528658Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255825205314431:10084]
2025-10-01T14:11:47.529247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:47.529565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:47.529611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:47.529908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:47.529970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.529976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.529977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.529978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.529979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.529980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.529981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.529983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.529984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.529985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.529986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.529987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.529988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.529989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.529995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.530004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.530008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.530012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.530016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.530021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.530025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.530029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.530033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.530039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.530043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.530047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.530050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.530054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.530062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.530069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.530075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.530085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.530092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.530101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.530106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.530115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.530119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.530129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.530133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.530138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.530147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.530153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.530161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.530165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.530170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.530179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.530183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.530192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.530196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.530206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.530210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.530218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.530223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.530228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.530237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.530243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.530284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:47.533958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:47.534570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:47.534585Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:47.534588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:47.534591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:47.534598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1468 [2:7556255825205314431:10084]
2025-10-01T14:11:47.534611Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:47.534627Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:47.534631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.534634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.534642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.534656Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:47.534667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:47.534674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:47.534725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.534731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.534733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.534736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:47.534739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:47.534799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:47.534809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.534819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.534830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.534845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:47.534867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195380:2446], now have 1 active actors on pipe
2025-10-01T14:11:47.534874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195631:3146], now have 1 active actors on pipe
2025-10-01T14:11:47.534881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255825205314426:10084]
2025-10-01T14:11:47.534887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255825205314426:10084]
2025-10-01T14:11:47.534889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255825205314426:10084]
2025-10-01T14:11:47.534905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:47.534916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:47.534921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:47.534893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1468
2025-10-01T14:11:47.534924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:47.534926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:47.534933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:47.534936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:47.534961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255825205314426:10084]
2025-10-01T14:11:47.534950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1468
2025-10-01T14:11:47.534972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:47.534977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:47.534994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.535002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.535045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:47.535057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.535061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.535063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:47.535071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.535080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:47.535096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.535246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.535256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.535278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.535355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1469 partition: 0 MaxSeqNo: 45 sessionId: src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0
2025-10-01T14:11:47.535690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f115b1-414ec445-7f4a5a2d-b2e12d2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:47.538147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0] Write session: try to update token
2025-10-01T14:11:47.538165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:47.551261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1469 sessionId: src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:47.553537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:47.554538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.554559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.554581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:47.554584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:47.554586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:47.554588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:47.554596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255825205314426:10084]
2025-10-01T14:11:47.554601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255825205314426:10084]
2025-10-01T14:11:47.554605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255825205314426:10084]
2025-10-01T14:11:47.554644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:47.554656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:47.554659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:47.554661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:47.554669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.554671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:47.554791Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:47.607108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255827582195687:3745]
2025-10-01T14:11:47.607374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1468, pipe: [1:7556255827582195687:3745]
2025-10-01T14:11:47.696576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:47.697442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:47.697496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195687:3745], now have 1 active actors on pipe
2025-10-01T14:11:47.697565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:47.697692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255827582195687:3745]
2025-10-01T14:11:47.697727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:47.707219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:47.707232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:47.707250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1469 reason: error at write: Disconnected sessionId: src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0
2025-10-01T14:11:47.707440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1469 sessionId: src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0 is DEAD
2025-10-01T14:11:47.707549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:47.707559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0] Write session will restart in 0.009852s
2025-10-01T14:11:47.707591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0] Write session: Do CDS request
2025-10-01T14:11:47.707600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:47.718873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.718994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:47.719018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1470
2025-10-01T14:11:47.719116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.719146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1470 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:47.719156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1470 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:47.719161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:47.719658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1470 sessionId:  describe result for acl check
2025-10-01T14:11:47.719693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:47.719699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:47.719703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:47.719708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255827582195884:3141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:47.720200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255827582195884:3141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:47.722480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255827582195884:3141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:47.722938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:47.725794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:47.726131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:47.726143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:47.726158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:47.726180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255827582195884:3141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:47.726201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255827582195884:3141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:47.726204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255827582195884:3141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:47.726211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1470 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:47.726219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:47.726264Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255825205314762:10097]
2025-10-01T14:11:47.726781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:47.727029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:47.727063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:47.727263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:47.727295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.727299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.727299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.727300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.727301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.727301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.727302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.727302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.727303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.727304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.727304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.727305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.727305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.727306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.727310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.727318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.727322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.727325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.727328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.727331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.727333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.727336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.727339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.727342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.727345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.727347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.727350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.727353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.727360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.727378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.727384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.727390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.727394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.727398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.727400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.727402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.727405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.727409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.727413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.727416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.727420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.727425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.727429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.727434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.727438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.727441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.727443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.727446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.727448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.727450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.727452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.727455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.727460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.727464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.727468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.727471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.727501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:47.731353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:47.732281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:47.732292Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:47.732294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:47.732296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:47.732301Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1469 [2:7556255825205314762:10097]
2025-10-01T14:11:47.732312Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:47.732325Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:47.732327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.732329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.732330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.732342Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:47.732346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:47.732350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:47.732393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.732399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.732401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.732404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:47.732407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:47.732472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:47.732481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.732492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.732503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.732518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:47.732534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195985:3141], now have 1 active actors on pipe
2025-10-01T14:11:47.732537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195692:2446], now have 1 active actors on pipe
2025-10-01T14:11:47.732544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255825205314757:10097]
2025-10-01T14:11:47.732551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255825205314757:10097]
2025-10-01T14:11:47.732553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255825205314757:10097]
2025-10-01T14:11:47.732566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:47.732579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:47.732582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:47.732585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:47.732587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:47.732595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:47.732598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:47.732625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255825205314757:10097]
2025-10-01T14:11:47.732637Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:47.732642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:47.732650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1469
2025-10-01T14:11:47.732651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1469
2025-10-01T14:11:47.732729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.732738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.732764Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:47.732775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.732780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.732782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:47.732789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.732798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:47.732818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.732962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.732969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.732982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.733059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1470 partition: 0 MaxSeqNo: 45 sessionId: src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0
2025-10-01T14:11:47.733442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b46896fb-b7a1434-100ff62b-47f58b7c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:47.735739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0] Write session: try to update token
2025-10-01T14:11:47.735757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:47.749620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1470 sessionId: src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:47.751944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:47.753103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.753123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.753142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:47.753144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:47.753146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:47.753147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:47.753155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255825205314757:10097]
2025-10-01T14:11:47.753158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255825205314757:10097]
2025-10-01T14:11:47.753161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255825205314757:10097]
2025-10-01T14:11:47.753195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:47.753204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:47.753205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:47.753208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:47.753210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.753211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:47.753350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:47.798062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255827582195997:3745]
2025-10-01T14:11:47.798314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1469, pipe: [1:7556255827582195997:3745]
2025-10-01T14:11:47.889626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:47.889997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:47.890039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582195997:3745], now have 1 active actors on pipe
2025-10-01T14:11:47.890122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:47.890181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255827582195997:3745]
2025-10-01T14:11:47.890196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:47.890198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:47.890210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:47.890263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1470 reason: error at write: Disconnected sessionId: src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0
2025-10-01T14:11:47.890444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1470 sessionId: src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0 is DEAD
2025-10-01T14:11:47.890557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:47.890566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0] Write session will restart in 0.007401s
2025-10-01T14:11:47.890583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0] Write session: Do CDS request
2025-10-01T14:11:47.890589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:47.898902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.899009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:47.899026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1471
2025-10-01T14:11:47.899133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:47.899166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1471 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:47.899175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1471 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:47.899178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:47.899583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1471 sessionId:  describe result for acl check
2025-10-01T14:11:47.899614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:47.899620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:47.899622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:47.899627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255827582196043:3120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:47.900140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255827582196043:3120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:47.902859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255827582196043:3120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:47.906190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255827582196043:3120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:47.906204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255827582196043:3120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:47.906207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255827582196043:3120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:47.906213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1471 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:47.909839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:47.912493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:47.912666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:47.912684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:47.912692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:47.912727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:47.912754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255825205315064:10099]
2025-10-01T14:11:47.913153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:47.913390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:47.913420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:47.913608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:47.913642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.913647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.913647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.913648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.913649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.913649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.913650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.913651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.913651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.913652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.913653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.913653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.913654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.913655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.913658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.913663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.913666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.913668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.913670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.913682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.913684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.913686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.913688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.913691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.913693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.913695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.913697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.913699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.913704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.913708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:47.913712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.913715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:47.913718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.913720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:47.913723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.913727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:47.913729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.913732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:47.913735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.913737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:47.913740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.913742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:47.913745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.913747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:47.913750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.913753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:47.913760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.913762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.913765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.913767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.913772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.913774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.913777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.913779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:47.913783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.913785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:47.913807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:47.917339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:47.917995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:47.918005Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:47.918007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:47.918009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:47.918015Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1470 [2:7556255825205315064:10099]
2025-10-01T14:11:47.918027Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:47.918039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:47.918042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.918045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.918047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.918057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:47.918064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:47.918069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:47.918120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.918127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.918128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.918132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:47.918134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:47.918186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:47.918192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.918199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:47.918205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:47.918215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:47.918229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255825205315059:10099]
2025-10-01T14:11:47.918234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255825205315059:10099]
2025-10-01T14:11:47.918235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255825205315059:10099]
2025-10-01T14:11:47.918242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:47.918251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:47.918254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582196229:3120], now have 1 active actors on pipe
2025-10-01T14:11:47.918258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582196002:2446], now have 1 active actors on pipe
2025-10-01T14:11:47.918259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:47.918261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:47.918263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:47.918270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:47.918272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:47.918298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255825205315059:10099]
2025-10-01T14:11:47.918309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:47.918319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:47.918355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1470
2025-10-01T14:11:47.918358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1470
2025-10-01T14:11:47.918426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.918443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.918467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|442cf469-53176219-9d18a9c8-991f601b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:47.918476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:47.918479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:47.918480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:47.918488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:47.918496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:47.918508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.918651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.918656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.918666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:47.918743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1471 partition: 0 MaxSeqNo: 45 sessionId: src_id|442cf469-53176219-9d18a9c8-991f601b_0
2025-10-01T14:11:47.919132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c68bde5a-cc249a58-8331a556-4657bc2b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|442cf469-53176219-9d18a9c8-991f601b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:47.921398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442cf469-53176219-9d18a9c8-991f601b_0] Write session: try to update token
2025-10-01T14:11:47.921414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442cf469-53176219-9d18a9c8-991f601b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:47.933893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1471 sessionId: src_id|442cf469-53176219-9d18a9c8-991f601b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:47.936325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:47.937689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:47.937710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:47.937726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:47.937729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:47.937731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:47.937732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:47.937738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255825205315059:10099]
2025-10-01T14:11:47.937742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255825205315059:10099]
2025-10-01T14:11:47.937744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255825205315059:10099]
2025-10-01T14:11:47.937791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:47.937791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:47.937797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:47.937800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:47.937803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:47.937805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:47.937917Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:47.990557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255827582196312:3745]
2025-10-01T14:11:47.990792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1470, pipe: [1:7556255827582196312:3745]
2025-10-01T14:11:48.079227Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:48.079467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:48.079514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255827582196312:3745], now have 1 active actors on pipe
2025-10-01T14:11:48.079603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:48.079752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255827582196312:3745]
2025-10-01T14:11:48.079792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:48.091815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:48.091828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:48.091860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1471 reason: error at write: Disconnected sessionId: src_id|442cf469-53176219-9d18a9c8-991f601b_0
2025-10-01T14:11:48.092046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1471 sessionId: src_id|442cf469-53176219-9d18a9c8-991f601b_0 is DEAD
2025-10-01T14:11:48.092175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442cf469-53176219-9d18a9c8-991f601b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:48.092185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442cf469-53176219-9d18a9c8-991f601b_0] Write session will restart in 0.006307s
2025-10-01T14:11:48.092204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442cf469-53176219-9d18a9c8-991f601b_0] Write session: Do CDS request
2025-10-01T14:11:48.092211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442cf469-53176219-9d18a9c8-991f601b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:48.099923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|442cf469-53176219-9d18a9c8-991f601b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.100035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:48.100052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1472
2025-10-01T14:11:48.100159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.100184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1472 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:48.100192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1472 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:48.100196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:48.101127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1472 sessionId:  describe result for acl check
2025-10-01T14:11:48.101166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:48.101167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:48.101168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:48.101173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255831877163748:3122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:48.101655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255831877163748:3122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:48.104393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255831877163748:3122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:48.106704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255831877163748:3122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:48.106718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255831877163748:3122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:48.106725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255831877163748:3122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:48.106734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1472 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:48.108720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:48.111148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:48.111345Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:48.111355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:48.111366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:48.111422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:48.111467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255829500282676:10103]
2025-10-01T14:11:48.112049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:48.112297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:48.112340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:48.112629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:48.112685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.112690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.112692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.112692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.112694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.112695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.112696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.112697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.112698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.112699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.112700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.112701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.112702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.112704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.112708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.112718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.112721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.112725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.112728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.112731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.112734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.112738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.112741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.112744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.112748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.112751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.112754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.112757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.112764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.112770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.112775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.112780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.112784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.112789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.112793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.112802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.112806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.112815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.112818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.112822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.112826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.112835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.112839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.112843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.112848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.112856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.112860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.112864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.112873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.112878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.112885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.112889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.112897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.112901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.112905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.112912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.112948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:48.116656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:48.117747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:48.117764Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:48.117766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:48.117770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:48.117777Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1471 [2:7556255829500282676:10103]
2025-10-01T14:11:48.117794Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:48.117811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:48.117814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.117817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.117820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.117836Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:48.117842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:48.117848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:48.117909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.117911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.117913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.117916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:48.117919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:48.117991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:48.117994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.118006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.118017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.118034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:48.118051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877163907:3122], now have 1 active actors on pipe
2025-10-01T14:11:48.118054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877163610:2446], now have 1 active actors on pipe
2025-10-01T14:11:48.118061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255829500282671:10103]
2025-10-01T14:11:48.118063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255829500282671:10103]
2025-10-01T14:11:48.118065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255829500282671:10103]
2025-10-01T14:11:48.118080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:48.118093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:48.118106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:48.118110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:48.118109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:48.118128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:48.118130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:48.118144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255829500282671:10103]
2025-10-01T14:11:48.118147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:48.118149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:48.118156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1471
2025-10-01T14:11:48.118159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1471
2025-10-01T14:11:48.118203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.118208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.118236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:48.118243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.118247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.118249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:48.118260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.118273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:48.118289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.118427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.118435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.118450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.118529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1472 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0
2025-10-01T14:11:48.118920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|442cf469-53176219-9d18a9c8-991f601b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:48.121292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0] Write session: try to update token
2025-10-01T14:11:48.121308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:48.129161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:48.129178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:48.129187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255829500282671:10103]
2025-10-01T14:11:48.129231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:48.129240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:48.129388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:48.129520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:48.129974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:48.130466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:48.130690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:48.130735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:48.135313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1472 sessionId: src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:48.137706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:48.137906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.137926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.137963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:48.138088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:48.148152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:48.148169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:48.148171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:48.148173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:48.148184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255829500282671:10103]
2025-10-01T14:11:48.148188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255829500282671:10103]
2025-10-01T14:11:48.148193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255829500282671:10103]
2025-10-01T14:11:48.148231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:48.148236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:48.148237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:48.148240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:48.148242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.148245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:48.148368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:48.180014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255831877163933:3745]
2025-10-01T14:11:48.180255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1471, pipe: [1:7556255831877163933:3745]
2025-10-01T14:11:48.293596Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:48.300806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.300830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.300976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.301027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.301080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.301132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.301173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.301180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.301243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.301294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.301352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.301422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.301462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.301467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.301524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.301579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.301637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.301689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.301730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.301735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.301787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.301837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.301893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.301950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.301991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.301997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.302052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.302103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.302159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.302214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.302259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.302266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.302327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.302405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.302470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.302533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.302576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.302581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.302638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.302698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.302751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.302806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.302846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.302855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.302908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.302968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.303031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.303089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.303127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.303132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.303195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.303246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.303300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.303364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.303411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.303417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.303469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.303517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.303571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.303621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.303661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.303665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.303709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877163933:3745], now have 1 active actors on pipe
2025-10-01T14:11:48.303991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:48.304002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:48.304011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255831877163933:3745]
2025-10-01T14:11:48.304024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1472 reason: error at write: Disconnected sessionId: src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0
2025-10-01T14:11:48.304036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:48.304192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1472 sessionId: src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0 is DEAD
2025-10-01T14:11:48.304313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:48.304321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0] Write session will restart in 0.007391s
2025-10-01T14:11:48.304339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0] Write session: Do CDS request
2025-10-01T14:11:48.304344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:48.304538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:48.312997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.313062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:48.313077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1473
2025-10-01T14:11:48.313228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.313259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1473 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:48.313267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1473 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:48.313270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:48.313696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1473 sessionId:  describe result for acl check
2025-10-01T14:11:48.313735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:48.313741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:48.313743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:48.313748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255831877163981:3110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:48.314231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255831877163981:3110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:48.317417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255831877163981:3110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:48.320046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255831877163981:3110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:48.320060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255831877163981:3110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:48.320062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255831877163981:3110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:48.320068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1473 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:48.323790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:48.326345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:48.326574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:48.326583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:48.326593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:48.326642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:48.326678Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255829500282979:10105]
2025-10-01T14:11:48.327241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:48.327691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:48.327746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:48.328096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:48.328145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.328146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.328147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.328148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.328149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.328151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.328152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.328153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.328154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.328155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.328157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.328158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.328159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.328160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.328165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.328175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.328179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.328183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.328187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.328191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.328195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.328199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.328203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.328208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.328212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.328216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.328220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.328224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.328233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.328240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.328247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.328252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.328258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.328263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.328268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.328273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.328278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.328283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.328288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.328293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.328298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.328303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.328307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.328312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.328316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.328321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.328327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.328332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.328336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.328341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.328345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.328351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.328355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.328360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.328364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.328369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.328410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:48.332311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:48.333354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:48.333368Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:48.333371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:48.333374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:48.333381Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1472 [2:7556255829500282979:10105]
2025-10-01T14:11:48.333402Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:48.333417Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:48.333420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.333424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.333426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.333443Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:48.333448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:48.333454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:48.333510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.333517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.333519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.333523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:48.333525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:48.333590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:48.333597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.333608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.333620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.333640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:48.333661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164160:3110], now have 1 active actors on pipe
2025-10-01T14:11:48.333669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877163935:2446], now have 1 active actors on pipe
2025-10-01T14:11:48.333676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255829500282974:10105]
2025-10-01T14:11:48.333678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255829500282974:10105]
2025-10-01T14:11:48.333680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255829500282974:10105]
2025-10-01T14:11:48.333697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:48.333713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:48.333714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:48.333717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:48.333719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:48.333731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:48.333734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:48.333723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1472
2025-10-01T14:11:48.333761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1472
2025-10-01T14:11:48.333764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255829500282974:10105]
2025-10-01T14:11:48.333774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:48.333784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:48.333790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.333794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.333837Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:48.333846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.333850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.333858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:48.333866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.333874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:48.333894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.334024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.334031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.334043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.334137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1473 partition: 0 MaxSeqNo: 45 sessionId: src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0
2025-10-01T14:11:48.334550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f01b504-e504a46c-7ecd4c37-e4bc11f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:48.337097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0] Write session: try to update token
2025-10-01T14:11:48.337118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:48.351631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1473 sessionId: src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:48.354012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:48.355615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.355637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.355658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:48.355661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:48.355664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:48.355665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:48.355672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255829500282974:10105]
2025-10-01T14:11:48.355675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255829500282974:10105]
2025-10-01T14:11:48.355677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255829500282974:10105]
2025-10-01T14:11:48.355712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:48.355719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:48.355723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:48.355725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.355726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:48.355727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:48.355839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:48.404254Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255831877164285:3745]
2025-10-01T14:11:48.404540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1472, pipe: [1:7556255831877164285:3745]
2025-10-01T14:11:48.500116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:48.500308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:48.500354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164285:3745], now have 1 active actors on pipe
2025-10-01T14:11:48.500459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:48.500516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255831877164285:3745]
2025-10-01T14:11:48.500548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:48.500559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:48.500562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:48.500628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1473 reason: error at write: Disconnected sessionId: src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0
2025-10-01T14:11:48.500809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1473 sessionId: src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0 is DEAD
2025-10-01T14:11:48.500941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:48.500950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0] Write session will restart in 0.006556s
2025-10-01T14:11:48.500969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0] Write session: Do CDS request
2025-10-01T14:11:48.500978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:48.508899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.509014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:48.509030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1474
2025-10-01T14:11:48.509144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.509175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1474 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:48.509185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1474 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:48.509189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:48.509591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1474 sessionId:  describe result for acl check
2025-10-01T14:11:48.509621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:48.509627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:48.509628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:48.509631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255831877164333:3099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:48.510009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255831877164333:3099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:48.512248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255831877164333:3099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:48.515358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255831877164333:3099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:48.515371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255831877164333:3099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:48.515374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255831877164333:3099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:48.515382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1474 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:48.518992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:48.521762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:48.521966Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:48.521976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:48.521989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:48.522034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:48.522072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255829500283291:10109]
2025-10-01T14:11:48.522681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:48.522947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:48.522984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:48.523273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:48.523318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.523323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.523324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.523325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.523326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.523327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.523328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.523329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.523330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.523331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.523332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.523333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.523334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.523335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.523340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.523349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.523352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.523356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.523359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.523362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.523366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.523369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.523372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.523376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.523380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.523383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.523391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.523394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.523404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.523416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.523426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.523434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.523442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.523447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.523454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.523459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.523467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.523471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.523479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.523483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.523491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.523500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.523503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.523507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.523511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.523520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.523527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.523531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.523538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.523544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.523551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.523556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.523563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.523567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.523571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.523575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.523607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:48.527348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:48.528292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:48.528306Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:48.528308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:48.528310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:48.528315Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1473 [2:7556255829500283291:10109]
2025-10-01T14:11:48.528326Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:48.528339Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:48.528341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.528344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.528345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.528357Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:48.528361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:48.528366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:48.528406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.528411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.528412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.528415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:48.528417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:48.528466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:48.528471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.528478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.528484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.528493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:48.528507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255829500283286:10109]
2025-10-01T14:11:48.528514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255829500283286:10109]
2025-10-01T14:11:48.528516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255829500283286:10109]
2025-10-01T14:11:48.528525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:48.528530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:48.528533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:48.528534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:48.528541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164291:2446], now have 1 active actors on pipe
2025-10-01T14:11:48.528546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:48.528554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:48.528559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:48.528563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164503:3099], now have 1 active actors on pipe
2025-10-01T14:11:48.528581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255829500283286:10109]
2025-10-01T14:11:48.528592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:48.528610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:48.528619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1473
2025-10-01T14:11:48.528639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1473
2025-10-01T14:11:48.528691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.528701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.528724Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|820af887-ae86a358-132b77d8-da182d2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:48.528736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.528738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.528740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:48.528746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.528758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:48.528771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.528918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.528923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.528933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.529007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1474 partition: 0 MaxSeqNo: 45 sessionId: src_id|820af887-ae86a358-132b77d8-da182d2e_0
2025-10-01T14:11:48.529389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28c23c26-d8e03dff-a6bd9d2e-42c84da4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|820af887-ae86a358-132b77d8-da182d2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:48.534035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820af887-ae86a358-132b77d8-da182d2e_0] Write session: try to update token
2025-10-01T14:11:48.534051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820af887-ae86a358-132b77d8-da182d2e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:48.550203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1474 sessionId: src_id|820af887-ae86a358-132b77d8-da182d2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:48.552653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:48.552679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:48.552682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:48.552684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:48.552694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255829500283286:10109]
2025-10-01T14:11:48.552698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255829500283286:10109]
2025-10-01T14:11:48.552703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255829500283286:10109]
2025-10-01T14:11:48.552746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:48.552751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:48.552754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:48.552756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:48.552762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.552764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:48.552898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:48.554998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:48.600887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255831877164603:3745]
2025-10-01T14:11:48.601174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1473, pipe: [1:7556255831877164603:3745]
2025-10-01T14:11:48.693310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:48.693485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.693497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.693525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164603:3745], now have 1 active actors on pipe
2025-10-01T14:11:48.693751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255831877164603:3745]
2025-10-01T14:11:48.693776Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:48.693762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:48.693766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:48.693776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:48.693818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1474 reason: error at write: Disconnected sessionId: src_id|820af887-ae86a358-132b77d8-da182d2e_0
2025-10-01T14:11:48.694014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1474 sessionId: src_id|820af887-ae86a358-132b77d8-da182d2e_0 is DEAD
2025-10-01T14:11:48.694157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820af887-ae86a358-132b77d8-da182d2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:48.694164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820af887-ae86a358-132b77d8-da182d2e_0] Write session will restart in 0.006875s
2025-10-01T14:11:48.694191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820af887-ae86a358-132b77d8-da182d2e_0] Write session: Do CDS request
2025-10-01T14:11:48.694197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820af887-ae86a358-132b77d8-da182d2e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:48.701832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|820af887-ae86a358-132b77d8-da182d2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.701953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:48.701968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1475
2025-10-01T14:11:48.702065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.702095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1475 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:48.702101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1475 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:48.702108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:48.702530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1475 sessionId:  describe result for acl check
2025-10-01T14:11:48.702565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:48.702574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:48.702575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:48.702579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255831877164661:3091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:48.703092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255831877164661:3091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:48.705371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255831877164661:3091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:48.708382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255831877164661:3091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:48.708394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255831877164661:3091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:48.708397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255831877164661:3091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:48.708403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1475 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:48.712011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:48.714733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:48.714905Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:48.714913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:48.714924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:48.715220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:48.715268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255829500283633:10122]
2025-10-01T14:11:48.715678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:48.715917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:48.715946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:48.716167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:48.716220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.716225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.716226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.716228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.716229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.716230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.716231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.716232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.716233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.716234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.716235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.716236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.716237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.716238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.716242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.716248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.716250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.716252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.716254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.716256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.716258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.716260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.716262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.716264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.716266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.716268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.716270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.716272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.716277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.716282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.716285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.716289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.716291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.716294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.716296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.716299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.716303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.716306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.716308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.716311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.716313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.716316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.716318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.716321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.716324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.716326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.716329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.716331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.716334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.716336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.716339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.716341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.716344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.716347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.716349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.716352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.716373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:48.719836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:48.720725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:48.720738Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:48.720740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:48.720743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:48.720749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1474 [2:7556255829500283633:10122]
2025-10-01T14:11:48.720762Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:48.720780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:48.720788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.720791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.720793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.720806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:48.720815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:48.720820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:48.720867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.720873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.720875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.720878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:48.720881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:48.720939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:48.720946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.720958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.720973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.720988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:48.721005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164842:3091], now have 1 active actors on pipe
2025-10-01T14:11:48.721011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164609:2446], now have 1 active actors on pipe
2025-10-01T14:11:48.721016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255829500283623:10122]
2025-10-01T14:11:48.721017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255829500283623:10122]
2025-10-01T14:11:48.721018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255829500283623:10122]
2025-10-01T14:11:48.721029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:48.721041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:48.721044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:48.721047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:48.721049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:48.721059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:48.721066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:48.721086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255829500283623:10122]
2025-10-01T14:11:48.721096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:48.721106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:48.721105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1474
2025-10-01T14:11:48.721121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1474
2025-10-01T14:11:48.721195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.721207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.721231Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|40eb77b2-15a90663-d0617979-64aed6cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:48.721239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.721242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.721244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:48.721250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.721257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:48.721270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.721396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.721404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.721418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.721501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1475 partition: 0 MaxSeqNo: 45 sessionId: src_id|40eb77b2-15a90663-d0617979-64aed6cf_0
2025-10-01T14:11:48.721868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|820af887-ae86a358-132b77d8-da182d2e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|40eb77b2-15a90663-d0617979-64aed6cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:48.724250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40eb77b2-15a90663-d0617979-64aed6cf_0] Write session: try to update token
2025-10-01T14:11:48.724266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40eb77b2-15a90663-d0617979-64aed6cf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:48.736738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:48.736751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:48.736759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255829500283623:10122]
2025-10-01T14:11:48.736795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:48.736809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:48.736938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:48.737063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:48.737181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:48.737303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:48.737482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:48.737523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:48.737854Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1475 sessionId: src_id|40eb77b2-15a90663-d0617979-64aed6cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:48.740430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:48.740657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.740683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.740713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:48.740799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:48.752773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:48.752791Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:48.752794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:48.752796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:48.752808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255829500283623:10122]
2025-10-01T14:11:48.752812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255829500283623:10122]
2025-10-01T14:11:48.752816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255829500283623:10122]
2025-10-01T14:11:48.752864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:48.752863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:48.752867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:48.752870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:48.752876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.752878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:48.753008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:48.793896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255831877164922:3745]
2025-10-01T14:11:48.794135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1474, pipe: [1:7556255831877164922:3745]
2025-10-01T14:11:48.887666Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:48.894446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.894466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.894612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.894665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.894729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.894786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.894828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.894834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.894892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.894945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.895004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.895057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.895097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.895102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.895160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.895223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.895289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.895360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.895400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.895405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.895462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.895515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.895572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.895628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.895668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.895674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.895730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.895789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.895841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.895895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.895935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.895940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.895996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.896051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.896120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.896176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.896218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.896224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.896285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.896334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.896393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.896443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.896481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.896486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.896545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.896599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.896651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.896714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.896751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.896756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.896809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.896866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.896921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.896975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.897018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.897023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.897084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:48.897140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:48.897196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:48.897246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:48.897292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:48.897297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:48.897340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164922:3745], now have 1 active actors on pipe
2025-10-01T14:11:48.897543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:48.897552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255831877164922:3745]
2025-10-01T14:11:48.897556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:48.897576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:48.897581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1475 reason: error at write: Disconnected sessionId: src_id|40eb77b2-15a90663-d0617979-64aed6cf_0
2025-10-01T14:11:48.897790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1475 sessionId: src_id|40eb77b2-15a90663-d0617979-64aed6cf_0 is DEAD
2025-10-01T14:11:48.897911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40eb77b2-15a90663-d0617979-64aed6cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:48.897922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40eb77b2-15a90663-d0617979-64aed6cf_0] Write session will restart in 0.007817s
2025-10-01T14:11:48.897946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40eb77b2-15a90663-d0617979-64aed6cf_0] Write session: Do CDS request
2025-10-01T14:11:48.897952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40eb77b2-15a90663-d0617979-64aed6cf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:48.898177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:48.904840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:48.906237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:48.906477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:48.906489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:48.906501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:48.906573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:48.906613Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255829500283694:10124]
2025-10-01T14:11:48.906903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|40eb77b2-15a90663-d0617979-64aed6cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.906983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:48.906999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1476
2025-10-01T14:11:48.907127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:48.907156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1476 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:48.907166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1476 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:48.907170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:48.907202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:48.907491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:48.907521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1476 sessionId:  describe result for acl check
2025-10-01T14:11:48.907541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:48.907556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:48.907562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:48.907564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:48.907569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255831877164949:3080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:48.907852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:48.907918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.907923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.907925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.907926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.907927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.907928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.907930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.907931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.907932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.907933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.907935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.907936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.907937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.907939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.907944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.907954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.907958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.907962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.907966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.907969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.907973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.907977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.907980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.907984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.907987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.907990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.907993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.907997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.908003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.908011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:48.908021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.908026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:48.908034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.908039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:48.908043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.908049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:48.908053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.908059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:48.908065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.908067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255831877164949:3080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:48.908069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:48.908077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.908082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:48.908086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.908090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:48.908095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.908100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:48.908104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.908108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.908112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.908117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.908121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.908126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.908134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.908138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:48.908142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.908147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:48.908186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:48.909853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255831877164949:3080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:48.911923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:48.912555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:48.912572Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:48.912577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:48.912582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:48.912588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1475 [2:7556255829500283694:10124]
2025-10-01T14:11:48.912603Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:48.912625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:48.912632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.912636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.912638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.912656Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:48.912666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:48.912686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:48.912751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.912758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.912761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.912764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:48.912769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:48.912834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:48.912843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.912856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:48.912868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:48.912890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:48.912915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164927:2446], now have 1 active actors on pipe
2025-10-01T14:11:48.912923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255829500283689:10124]
2025-10-01T14:11:48.912926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255829500283689:10124]
2025-10-01T14:11:48.912928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255829500283689:10124]
2025-10-01T14:11:48.912900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1475
2025-10-01T14:11:48.912937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:48.912953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:48.912958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:48.912961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:48.912963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:48.912972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:48.912975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:48.913015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255829500283689:10124]
2025-10-01T14:11:48.913028Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:48.913020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255831877164949:3080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:48.913034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255831877164949:3080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:48.913040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255831877164949:3080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:48.913041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:48.913049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1476 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:48.913212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164986:3080], now have 1 active actors on pipe
2025-10-01T14:11:48.913278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1475
2025-10-01T14:11:48.913312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.913321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.913345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:48.913358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:48.913362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:48.913364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:48.913373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:48.913386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:48.913403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.913550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.913558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.913572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:48.913658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1476 partition: 0 MaxSeqNo: 45 sessionId: src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0
2025-10-01T14:11:48.914046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|40eb77b2-15a90663-d0617979-64aed6cf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:48.916645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0] Write session: try to update token
2025-10-01T14:11:48.916663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:48.923482Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:48.923503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:48.923513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255829500283689:10124]
2025-10-01T14:11:48.923559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:48.923563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:48.923732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:48.923877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:48.924014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:48.924157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:48.924357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:48.924403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:48.931070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1476 sessionId: src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:48.934505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:48.934767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:48.934790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:48.934828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:48.934946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:48.943882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:48.943901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:48.943903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:48.943905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:48.943917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255829500283689:10124]
2025-10-01T14:11:48.943921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255829500283689:10124]
2025-10-01T14:11:48.943925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255829500283689:10124]
2025-10-01T14:11:48.943979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:48.943979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:48.943985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:48.943988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:48.943991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:48.943994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:48.944118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:48.997698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255831877164994:3745]
2025-10-01T14:11:48.997960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1475, pipe: [1:7556255831877164994:3745]
2025-10-01T14:11:49.098859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:49.106766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.106799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.106972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.107034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.107100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.107165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.107214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.107229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.107291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.107345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.107405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.107471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.107516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.107522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.107588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.107654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.107719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.107783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.107833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.107841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.107912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.107981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.108047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.108117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.108166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.108175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.108237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.108299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.108364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.108425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.108470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.108477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.108545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.108611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.108689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.108756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.108812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.108819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.108888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.108949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.109012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.109083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.109132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.109139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.109205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.109267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.109328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.109395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.109440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.109448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.109518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.109578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.109640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.109701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.109748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.109755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.109820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.109881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.109945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.110005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.110048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.110055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.110118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255831877164994:3745], now have 1 active actors on pipe
2025-10-01T14:11:49.110390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255831877164994:3745]
2025-10-01T14:11:49.110391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:49.110395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:49.110417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:49.110425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1476 reason: error at write: Disconnected sessionId: src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0
2025-10-01T14:11:49.110672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1476 sessionId: src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0 is DEAD
2025-10-01T14:11:49.110815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:49.110826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0] Write session will restart in 0.008341s
2025-10-01T14:11:49.110862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0] Write session: Do CDS request
2025-10-01T14:11:49.110868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:49.111197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:49.117615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:49.118933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:49.119131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:49.119144Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:49.119157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:49.119220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:49.119259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255833795251062:10128]
2025-10-01T14:11:49.119826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:49.119930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.120088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:49.120106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1477
2025-10-01T14:11:49.120172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:49.120226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:49.120259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.120293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1477 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:49.120303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1477 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:49.120307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:49.120553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:49.120621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.120628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.120629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.120630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.120631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.120632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.120633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.120635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.120611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1477 sessionId:  describe result for acl check
2025-10-01T14:11:49.120636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.120637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.120638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.120640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:49.120639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.120642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:49.120640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.120643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:49.120641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.120647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255836172132314:3081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:49.120648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.120658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.120662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.120677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.120681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.120686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.120689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.120692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.120695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.120699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.120702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.120708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.120716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.120719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.120732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.120744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.120754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.120763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.120772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.120777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.120786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.120794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.120803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.120812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.120820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.120827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.120835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.120844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.120853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.120861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.120869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.120878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.120886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.120896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.120904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.120912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.120921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.120930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.120938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.120946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.120954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.120964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.121005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:49.121034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255836172132314:3081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:49.123193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255836172132314:3081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:49.124476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:49.125080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:49.125099Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:49.125105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:49.125107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:49.125114Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1476 [2:7556255833795251062:10128]
2025-10-01T14:11:49.125128Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:49.125148Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:49.125155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.125159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.125162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.125177Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:49.125181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:49.125191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:49.125246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.125253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.125257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.125260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:49.125262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:49.125323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:49.125330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.125342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.125353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.125368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:49.125388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132292:2446], now have 1 active actors on pipe
2025-10-01T14:11:49.125400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255833795251057:10128]
2025-10-01T14:11:49.125402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255833795251057:10128]
2025-10-01T14:11:49.125404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255833795251057:10128]
2025-10-01T14:11:49.125416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:49.125429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:49.125431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:49.125434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:49.125435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:49.125446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:49.125450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:49.125479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255833795251057:10128]
2025-10-01T14:11:49.125489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:49.125473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1476
2025-10-01T14:11:49.125489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:49.127400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255836172132314:3081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:49.127417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255836172132314:3081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:49.127420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255836172132314:3081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:49.127427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1477 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:49.127673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132354:3081], now have 1 active actors on pipe
2025-10-01T14:11:49.127697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1476
2025-10-01T14:11:49.127804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.127817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.127843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:49.127857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.127867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.127869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:49.127880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.127897Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:49.127916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.128062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.128070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.128084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.128146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1477 partition: 0 MaxSeqNo: 45 sessionId: src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0
2025-10-01T14:11:49.128533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98aa405c-75252a1-6d6b08f-f2825e8a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:49.131049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0] Write session: try to update token
2025-10-01T14:11:49.131066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:49.141359Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:49.141383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:49.141398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255833795251057:10128]
2025-10-01T14:11:49.141446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:49.141450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:49.141610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:49.141760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.141904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.142039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.142232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:49.142275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:49.144451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1477 sessionId: src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:49.146843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:49.147056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.147080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.147116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:49.147186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:49.153828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:49.153845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:49.153848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:49.153850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:49.153861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255833795251057:10128]
2025-10-01T14:11:49.153865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255833795251057:10128]
2025-10-01T14:11:49.153868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255833795251057:10128]
2025-10-01T14:11:49.153911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:49.153915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:49.153918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:49.153922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:49.153921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.153924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:49.154055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:49.210656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255836172132371:3745]
2025-10-01T14:11:49.210919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1476, pipe: [1:7556255836172132371:3745]
2025-10-01T14:11:49.292352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:49.299473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.299500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.299659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.299722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.299791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.299854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.299894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.299901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.299959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.300014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.300065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.300118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.300159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.300164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.300226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.300280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.300340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.300401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.300450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.300456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.300522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.300575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.300630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.300709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.300758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.300765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.300824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.300878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.300932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.300985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.301024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.301032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.301099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.301164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.301224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.301281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.301337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.301344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.301404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.301467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.301530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.301589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.301637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.301642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.301698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.301753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.301807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.301861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.301908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.301913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.301967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.302018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.302072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.302128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.302176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.302184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.302247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.302303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.302363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.302442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.302492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.302499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.302545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132371:3745], now have 1 active actors on pipe
2025-10-01T14:11:49.302794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255836172132371:3745]
2025-10-01T14:11:49.302831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:49.302872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:49.302876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:49.302911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1477 reason: error at write: Disconnected sessionId: src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0
2025-10-01T14:11:49.303120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1477 sessionId: src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0 is DEAD
2025-10-01T14:11:49.303238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:49.303249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0] Write session will restart in 0.008989s
2025-10-01T14:11:49.303274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0] Write session: Do CDS request
2025-10-01T14:11:49.303279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:49.303424Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:49.310001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:49.311552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:49.311741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:49.311750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:49.311761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:49.311798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:49.311829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255833795251121:10130]
2025-10-01T14:11:49.312322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:49.312579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:49.312619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:49.312847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:49.312897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.312903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.312904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.312905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.312906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.312908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.312909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.312910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.312911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.312912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.312914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.312916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.312917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.312918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.312923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.312931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.312936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.312940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.312943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.312946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.312950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.312954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.312958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.312962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.312965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.312969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.312973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.312977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.312985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.313004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.313012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.313018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.313027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.313036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.313042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.313050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.313054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.313063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.313067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.313075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.313079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.313084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.313087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.313092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.313096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.313101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.313104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.313109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.313113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.313118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.313125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.313130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.313138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.313143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.313147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.313153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.313184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:49.314035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.314124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:49.314140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1478
2025-10-01T14:11:49.314278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.314309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1478 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:49.314319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1478 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:49.314322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:49.314726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1478 sessionId:  describe result for acl check
2025-10-01T14:11:49.314764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:49.314769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:49.314771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:49.314776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255836172132399:3071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:49.315330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255836172132399:3071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:49.316877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:49.317451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:49.317468Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:49.317469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:49.317472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:49.317477Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1477 [2:7556255833795251121:10130]
2025-10-01T14:11:49.317488Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:49.317502Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:49.317503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.317492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255836172132399:3071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:49.317506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.317507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.317519Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:49.317522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:49.317527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:49.317564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.317570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.317571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.317573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:49.317574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:49.317624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:49.317629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.317637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.317644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.317660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:49.317682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132373:2446], now have 1 active actors on pipe
2025-10-01T14:11:49.317693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255833795251116:10130]
2025-10-01T14:11:49.317695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255833795251116:10130]
2025-10-01T14:11:49.317698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255833795251116:10130]
2025-10-01T14:11:49.317711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:49.317726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:49.317728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:49.317734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:49.317736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:49.317741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:49.317743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:49.317734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1477
2025-10-01T14:11:49.317771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255833795251116:10130]
2025-10-01T14:11:49.317783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:49.317812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:49.322596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255836172132399:3071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:49.322613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255836172132399:3071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:49.322617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255836172132399:3071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:49.322625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1478 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:49.322868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132438:3071], now have 1 active actors on pipe
2025-10-01T14:11:49.322901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1477
2025-10-01T14:11:49.322952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.322967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.322996Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad336936-d478fc9c-87450a4e-290e23f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:49.323012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.323021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.323024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:49.323036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.323053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:49.323076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.323249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.323262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.323283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.323374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1478 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad336936-d478fc9c-87450a4e-290e23f0_0
2025-10-01T14:11:49.323710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a04f87b2-6deacb15-bac47057-4eed18ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad336936-d478fc9c-87450a4e-290e23f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:49.326058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad336936-d478fc9c-87450a4e-290e23f0_0] Write session: try to update token
2025-10-01T14:11:49.326075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad336936-d478fc9c-87450a4e-290e23f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:49.328455Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:49.328475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:49.328485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255833795251116:10130]
2025-10-01T14:11:49.328525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:49.328533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:49.328693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:49.328827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.328949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.329075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.329275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:49.329313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:49.338736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1478 sessionId: src_id|ad336936-d478fc9c-87450a4e-290e23f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:49.340913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:49.341072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.341089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.341118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:49.341217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:49.347104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:49.347126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:49.347128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:49.347131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:49.347142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255833795251116:10130]
2025-10-01T14:11:49.347148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255833795251116:10130]
2025-10-01T14:11:49.347152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255833795251116:10130]
2025-10-01T14:11:49.347198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:49.347200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:49.347206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:49.347206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.347209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:49.347210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:49.347344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:49.403141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255836172132459:3745]
2025-10-01T14:11:49.403405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1477, pipe: [1:7556255836172132459:3745]
2025-10-01T14:11:49.502816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:49.509849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.509872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.510010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.510062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.510119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.510177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.510541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.510554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.510607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.510666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.510722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.510783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.510823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.510833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.510897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.510954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.511008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.511060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.511099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.511105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.511161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.511219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.511286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.511341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.511390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.511395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.511450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.511510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.511563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.511616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.511658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.511663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.511728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.511790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.511849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.511909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.511951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.511957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.512016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.512073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.512133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.512193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.512237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.512244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.512313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.512386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.512453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.512513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.512556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.512563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.512627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.512702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.512764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.512829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.512877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.512883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.512945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.513005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.513069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.513137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.513180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.513186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.513248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132459:3745], now have 1 active actors on pipe
2025-10-01T14:11:49.513482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:49.513483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255836172132459:3745]
2025-10-01T14:11:49.513498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:49.513503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:49.513527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1478 reason: error at write: Disconnected sessionId: src_id|ad336936-d478fc9c-87450a4e-290e23f0_0
2025-10-01T14:11:49.513673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:49.513780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1478 sessionId: src_id|ad336936-d478fc9c-87450a4e-290e23f0_0 is DEAD
2025-10-01T14:11:49.513887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad336936-d478fc9c-87450a4e-290e23f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:49.513898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad336936-d478fc9c-87450a4e-290e23f0_0] Write session will restart in 0.006125s
2025-10-01T14:11:49.513936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad336936-d478fc9c-87450a4e-290e23f0_0] Write session: Do CDS request
2025-10-01T14:11:49.513943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad336936-d478fc9c-87450a4e-290e23f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:49.520921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad336936-d478fc9c-87450a4e-290e23f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.520954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:49.520969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1479
2025-10-01T14:11:49.521007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:49.521130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.521175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1479 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:49.521186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1479 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:49.521190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:49.521966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1479 sessionId:  describe result for acl check
2025-10-01T14:11:49.521999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:49.522001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:49.522003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:49.522008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255836172132496:3055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:49.522338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:49.522487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255836172132496:3055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:49.522500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:49.522519Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:49.522528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:49.522577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:49.522608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255833795251188:10134]
2025-10-01T14:11:49.522987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:49.523270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:49.523298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:49.523522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:49.523562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.523566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.523567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.523568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.523568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.523569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.523580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.523581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.523582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.523583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.523584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.523585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.523586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.523587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.523591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.523599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.523602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.523606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.523610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.523614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.523617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.523621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.523624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.523632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.523636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.523639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.523643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.523646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.523652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.523659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.523665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.523670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.523674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.523679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.523681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.523683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.523686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.523688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.523691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.523694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.523696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.523699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.523701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.523703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.523706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.523709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.523711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.523714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.523716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.523719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.523722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.523725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.523727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.523730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.523733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.523736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.523755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:49.524114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255836172132496:3055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:49.527159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:49.527365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255836172132496:3055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:49.527379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255836172132496:3055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:49.527383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255836172132496:3055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:49.527391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1479 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:49.527755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:49.527770Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:49.527773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:49.527776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:49.527782Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1478 [2:7556255833795251188:10134]
2025-10-01T14:11:49.527793Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:49.527808Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:49.527813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.527816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.527818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.527830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:49.527836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:49.527841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:49.527888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.527894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.527895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.527898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:49.527899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:49.527945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:49.527950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.527957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.527962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.527976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:49.527992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132534:3055], now have 1 active actors on pipe
2025-10-01T14:11:49.527997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132474:2446], now have 1 active actors on pipe
2025-10-01T14:11:49.528002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255833795251183:10134]
2025-10-01T14:11:49.528003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255833795251183:10134]
2025-10-01T14:11:49.528004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255833795251183:10134]
2025-10-01T14:11:49.528013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:49.528022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:49.528026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:49.528028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:49.528030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:49.528033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:49.528035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:49.528053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255833795251183:10134]
2025-10-01T14:11:49.528064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:49.528065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:49.528062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1478
2025-10-01T14:11:49.528065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1478
2025-10-01T14:11:49.528104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.528113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.528132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|897b3876-b8b2c946-11e7892a-53580d8b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:49.528141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.528144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.528145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:49.528151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.528157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:49.528168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.528263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.528268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.528277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.528336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1479 partition: 0 MaxSeqNo: 45 sessionId: src_id|897b3876-b8b2c946-11e7892a-53580d8b_0
2025-10-01T14:11:49.528686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad336936-d478fc9c-87450a4e-290e23f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|897b3876-b8b2c946-11e7892a-53580d8b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:49.531065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897b3876-b8b2c946-11e7892a-53580d8b_0] Write session: try to update token
2025-10-01T14:11:49.531083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897b3876-b8b2c946-11e7892a-53580d8b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:49.538683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:49.538703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:49.538712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255833795251183:10134]
2025-10-01T14:11:49.538745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:49.538756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:49.538934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:49.539071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.539589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.540073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.540766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:49.540818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:49.545397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1479 sessionId: src_id|897b3876-b8b2c946-11e7892a-53580d8b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:49.547959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:49.548186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.548213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.548252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:49.548347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:49.557887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:49.557910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:49.557914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:49.557917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:49.557927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255833795251183:10134]
2025-10-01T14:11:49.557932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255833795251183:10134]
2025-10-01T14:11:49.557936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255833795251183:10134]
2025-10-01T14:11:49.557984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:49.557984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:49.557990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:49.557994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:49.557996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.557998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:49.558141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:49.613627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255836172132542:3745]
2025-10-01T14:11:49.613877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1478, pipe: [1:7556255836172132542:3745]
2025-10-01T14:11:49.713687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:49.722043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.722071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.722233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.722296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.722363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.722437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.722483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.722498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.722562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.722621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.722680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.722739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.722791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.722803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.722868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.722941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.723005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.723078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.723124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.723132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.723199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.723262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.723330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.723398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.723446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.723455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.723528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.723588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.723649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.723714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.723859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.723868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.723932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.723992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.724052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.724121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.724168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.724176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.724244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.724303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.724368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.724429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.724476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.724484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.724558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.724622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.724700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.724768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.724816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.724822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.724889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.724951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.725016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.725080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.725130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.725141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.725204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:49.725265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:49.725325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:49.725385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:49.725427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:49.725435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:49.725504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132542:3745], now have 1 active actors on pipe
2025-10-01T14:11:49.725717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:49.725723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:49.725726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:49.725753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1479 reason: error at write: Disconnected sessionId: src_id|897b3876-b8b2c946-11e7892a-53580d8b_0
2025-10-01T14:11:49.725773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255836172132542:3745]
2025-10-01T14:11:49.725967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1479 sessionId: src_id|897b3876-b8b2c946-11e7892a-53580d8b_0 is DEAD
2025-10-01T14:11:49.726088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897b3876-b8b2c946-11e7892a-53580d8b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:49.726097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897b3876-b8b2c946-11e7892a-53580d8b_0] Write session will restart in 0.005365s
2025-10-01T14:11:49.726116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897b3876-b8b2c946-11e7892a-53580d8b_0] Write session: Do CDS request
2025-10-01T14:11:49.726122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897b3876-b8b2c946-11e7892a-53580d8b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:49.726465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:49.732973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|897b3876-b8b2c946-11e7892a-53580d8b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.733032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:49.733050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1480
2025-10-01T14:11:49.733184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.733185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:49.733222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1480 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:49.733233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1480 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:49.733236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:49.733809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1480 sessionId:  describe result for acl check
2025-10-01T14:11:49.733863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:49.733870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:49.733871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:49.733876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255836172132571:3049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:49.734336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255836172132571:3049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:49.734671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:49.734874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:49.734888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:49.734901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:49.734960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:49.735000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255833795251282:10143]
2025-10-01T14:11:49.735455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:49.735689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:49.735719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:49.735957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:49.736008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.736014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.736015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.736016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.736017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.736018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.736020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.736021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.736022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.736023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.736024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.736025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.736026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.736027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.736032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.736053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.736057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.736061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.736065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.736068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.736070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.736072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.736075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.736077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.736079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.736081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.736083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.736084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.736090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.736095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.736099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.736106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.736109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.736112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.736114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.736120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.736122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.736126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.736131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.736133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.736136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.736142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.736144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.736146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.736152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.736155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.736157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.736160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.736166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.736169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.736171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.736174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.736176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.736178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.736181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.736184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.736203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:49.736780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255836172132571:3049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:49.739487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255836172132571:3049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:49.739502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255836172132571:3049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:49.739505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255836172132571:3049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:49.739511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1480 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:49.739746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:49.740361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:49.740378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:49.740380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:49.740386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:49.740392Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1479 [2:7556255833795251282:10143]
2025-10-01T14:11:49.740410Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:49.740430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:49.740437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.740441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.740447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.740462Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:49.740472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:49.740481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:49.740534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.740541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.740543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.740547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:49.740553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:49.740617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:49.740626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.740638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.740651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.740681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:49.740702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132545:2446], now have 1 active actors on pipe
2025-10-01T14:11:49.740710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132607:3049], now have 1 active actors on pipe
2025-10-01T14:11:49.740717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255833795251277:10143]
2025-10-01T14:11:49.740723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255833795251277:10143]
2025-10-01T14:11:49.740724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255833795251277:10143]
2025-10-01T14:11:49.740742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:49.740763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:49.740740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1479
2025-10-01T14:11:49.740743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1479
2025-10-01T14:11:49.740766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:49.740776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:49.740777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:49.740779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:49.740779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:49.740824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.740833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.740850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255833795251277:10143]
2025-10-01T14:11:49.740861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:49.740867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:49.740892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:49.740903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.740910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.740913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:49.740921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.740933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:49.740959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.741102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.741115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.741131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.741204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1480 partition: 0 MaxSeqNo: 45 sessionId: src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0
2025-10-01T14:11:49.741551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|897b3876-b8b2c946-11e7892a-53580d8b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:49.744081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0] Write session: try to update token
2025-10-01T14:11:49.744098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:49.761534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:49.761570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1480 sessionId: src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:49.761558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:49.761561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:49.761563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:49.761572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255833795251277:10143]
2025-10-01T14:11:49.761577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255833795251277:10143]
2025-10-01T14:11:49.761584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255833795251277:10143]
2025-10-01T14:11:49.761628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:49.761635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:49.761639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:49.761642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:49.761649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.761652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:49.761788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:49.764024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:49.826092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255836172132617:3745]
2025-10-01T14:11:49.826346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1479, pipe: [1:7556255836172132617:3745]
2025-10-01T14:11:49.917269Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:49.917561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.917578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.917630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132617:3745], now have 1 active actors on pipe
2025-10-01T14:11:49.917836Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:49.917901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:49.917917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:49.917924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:49.917975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255836172132617:3745]
2025-10-01T14:11:49.917979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1480 reason: error at write: Disconnected sessionId: src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0
2025-10-01T14:11:49.918231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1480 sessionId: src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0 is DEAD
2025-10-01T14:11:49.918424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:49.918437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0] Write session will restart in 0.008397s
2025-10-01T14:11:49.918472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0] Write session: Do CDS request
2025-10-01T14:11:49.918480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:49.925792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:49.927135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:49.927343Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:49.927353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:49.927364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:49.927408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:49.927450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255833795251344:10149]
2025-10-01T14:11:49.927949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.928049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:49.928093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:49.928111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1481
2025-10-01T14:11:49.928237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:49.928271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1481 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:49.928282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1481 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:49.928285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:49.928325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:49.928360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:49.928643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:49.928687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1481 sessionId:  describe result for acl check
2025-10-01T14:11:49.928705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.928711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.928712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.928713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.928714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.928715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.928716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.928717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.928718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.928719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.928719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:49.928721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.928722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.928725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:49.928723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.928727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:49.928724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.928732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255836172132645:3043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:49.928729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.928738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.928741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.928744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.928747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.928750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.928753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.928757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.928761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.928765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.928768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.928771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.928774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.928777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.928784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.928792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:49.928798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.928802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:49.928806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.928810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:49.928814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.928818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:49.928822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.928827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:49.928829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.928834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:49.928838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.928842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:49.928845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.928849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:49.928854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.928859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:49.928869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.928873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.928877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.928886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.928890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.928898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.928902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.928906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:49.928913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.928917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:49.928949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:49.929263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255836172132645:3043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:49.932906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:49.933139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255836172132645:3043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:49.933502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:49.933517Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:49.933520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:49.933523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:49.933532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1480 [2:7556255833795251344:10149]
2025-10-01T14:11:49.933550Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:49.933568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:49.933575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.933579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.933580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.933598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:49.933608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:49.933619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:49.933683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.933690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.933692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.933696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:49.933699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:49.933759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:49.933764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.933773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:49.933778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:49.933786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:49.933799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132619:2446], now have 1 active actors on pipe
2025-10-01T14:11:49.933808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255833795251339:10149]
2025-10-01T14:11:49.933810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255833795251339:10149]
2025-10-01T14:11:49.933811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255833795251339:10149]
2025-10-01T14:11:49.933820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:49.933832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:49.933833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:49.933836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:49.933838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:49.933841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:49.933843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:49.933867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255833795251339:10149]
2025-10-01T14:11:49.933873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:49.933892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:49.933898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1480
2025-10-01T14:11:49.938739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255836172132645:3043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:49.938773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255836172132645:3043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:49.938777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255836172132645:3043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:49.938786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1481 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:49.939007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255836172132686:3043], now have 1 active actors on pipe
2025-10-01T14:11:49.939062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1480
2025-10-01T14:11:49.939099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.939112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.939145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:49.939182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:49.939192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:49.939196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:49.939209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:49.939229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:49.939258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.939387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.939393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.939407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:49.939489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1481 partition: 0 MaxSeqNo: 45 sessionId: src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0
2025-10-01T14:11:49.939895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|167b278f-a88eb504-2df1127c-e2e08eb4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:49.942354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0] Write session: try to update token
2025-10-01T14:11:49.942391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:49.948983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:49.949004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:49.949015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255833795251339:10149]
2025-10-01T14:11:49.949068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:49.949075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:49.949252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:49.949401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.949527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.949665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:49.949851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:49.949889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:49.956479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1481 sessionId: src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:49.958889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:49.959105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:49.959131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:49.959173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:49.959287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:49.962950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:49.962967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:49.962969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:49.962970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:49.962979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255833795251339:10149]
2025-10-01T14:11:49.962981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255833795251339:10149]
2025-10-01T14:11:49.962985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255833795251339:10149]
2025-10-01T14:11:49.963020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:49.963031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:49.963032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:49.963039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:49.963046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:49.963050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:49.963160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:50.018108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255840467099986:3745]
2025-10-01T14:11:50.018426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1480, pipe: [1:7556255840467099986:3745]
2025-10-01T14:11:50.110751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:50.119117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.119142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.119290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.119345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.119402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.119452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.119495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.119508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.119568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.119621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.119674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.119727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.119768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.119776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.119838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.119893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.119952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.120012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.120055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.120060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.120125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.120179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.120247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.120313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.120356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.120359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.120433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.120491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.120552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.120615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.120656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.120659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.120742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.120798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.120862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.120923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.120965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.120968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.121042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.121098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.121149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.121203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.121242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.121245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.121321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.121380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.121444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.121503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.121543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.121546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.121617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.121675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.121730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.121785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.121822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.121824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.121900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.121963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.122025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.122090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.122193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.122195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.122255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467099986:3745], now have 1 active actors on pipe
2025-10-01T14:11:50.122524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:50.122554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:50.122572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:50.122583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1481 reason: error at write: Disconnected sessionId: src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0
2025-10-01T14:11:50.122621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255840467099986:3745]
2025-10-01T14:11:50.122781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1481 sessionId: src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0 is DEAD
2025-10-01T14:11:50.123248Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:50.123886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:50.123898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0] Write session will restart in 0.008828s
2025-10-01T14:11:50.123926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0] Write session: Do CDS request
2025-10-01T14:11:50.123933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:50.131377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:50.132938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:50.133171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:50.133198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:50.133210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:50.133273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:50.133316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255838090218717:10153]
2025-10-01T14:11:50.133907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:50.133940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.134028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:50.134044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1482
2025-10-01T14:11:50.134224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.134239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:50.134264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1482 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:50.134273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1482 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:50.134277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:50.134297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:50.134626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1482 sessionId:  describe result for acl check
2025-10-01T14:11:50.134659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:50.134661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:50.134666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:50.134671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255840467100016:3040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:50.134679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:50.134750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.134759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.134760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.134761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.134762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.134763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.134765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.134766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.134767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.134768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.134769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.134770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.134772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.134773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.134780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.134788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.134791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.134795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.134798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.134801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.134804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.134807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.134810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.134814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.134818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.134820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.134823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.134827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.134832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.134840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.134846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.134850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.134854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.134859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.134862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.134866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.134872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.134876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.134880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.134885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.134889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.134893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.134897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.134901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.134906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.134911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.134914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.134919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.134923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.134933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.134937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.134943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.134951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.134955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.134959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.134963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.134999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:50.135163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255840467100016:3040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:50.138017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255840467100016:3040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:50.138829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:50.139459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:50.139488Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:50.139491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:50.139495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:50.139502Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1481 [2:7556255838090218717:10153]
2025-10-01T14:11:50.139519Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:50.139535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:50.139538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.139542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.139544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.139563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:50.139569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:50.139577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:50.139633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.139643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.139645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.139649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:50.139652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:50.139725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:50.139736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.139749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.139758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.139781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:50.139806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467099988:2446], now have 1 active actors on pipe
2025-10-01T14:11:50.139820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255838090218712:10153]
2025-10-01T14:11:50.139822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255838090218712:10153]
2025-10-01T14:11:50.139824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255838090218712:10153]
2025-10-01T14:11:50.139840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:50.139859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:50.139878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:50.139886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:50.139919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255838090218712:10153]
2025-10-01T14:11:50.139929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:50.139968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:50.139994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:50.140003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:50.140010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:50.140253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1481
2025-10-01T14:11:50.145346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255840467100016:3040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:50.145364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255840467100016:3040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:50.145367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255840467100016:3040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:50.145375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1482 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:50.145664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1481
2025-10-01T14:11:50.145636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100056:3040], now have 1 active actors on pipe
2025-10-01T14:11:50.145714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.145722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.145751Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:50.145769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.145775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.145778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:50.145790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.145812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:50.145838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.146026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.146038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.146052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.146167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1482 partition: 0 MaxSeqNo: 45 sessionId: src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0
2025-10-01T14:11:50.146720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f88940-9b1d9abf-91f2f473-ebd0f3da_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:50.149170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0] Write session: try to update token
2025-10-01T14:11:50.149188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:50.151600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:50.151621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:50.151631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255838090218712:10153]
2025-10-01T14:11:50.151676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:50.151691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:50.151852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:50.152005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:50.152145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:50.152292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:50.152495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:50.152545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:50.162996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1482 sessionId: src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:50.165516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:50.165985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.166009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.166040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:50.166143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:50.171294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:50.171315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:50.171318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:50.171320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:50.171332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255838090218712:10153]
2025-10-01T14:11:50.171335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255838090218712:10153]
2025-10-01T14:11:50.171339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255838090218712:10153]
2025-10-01T14:11:50.171390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:50.171398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.171400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:50.171413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:50.171421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:50.171425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:50.171548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:50.222907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255840467100072:3745]
2025-10-01T14:11:50.223238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1481, pipe: [1:7556255840467100072:3745]
2025-10-01T14:11:50.320424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:50.328804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.328838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.329019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.329090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.329160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.329225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.329273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.329285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.329362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.329432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.329501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.329571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.329624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.329635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.329709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.329778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.329846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.329930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.329976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.329985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.330061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.330129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.330193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.330261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.330308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.330317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.330402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.330469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.330536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.330604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.330658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.330668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.330735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.330802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.330867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.330937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.330984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.330993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.331067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.331131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.331205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.331275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.331332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.331342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.331413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.331477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.331544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.331614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.331662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.331669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.331737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.331802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.331871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.331940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.331991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.331999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.332071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:50.332134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:50.332199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:50.332266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:50.332314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:50.332322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:50.332389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100072:3745], now have 1 active actors on pipe
2025-10-01T14:11:50.332616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:50.332630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:50.332641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:50.332664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1482 reason: error at write: Disconnected sessionId: src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0
2025-10-01T14:11:50.332694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255840467100072:3745]
2025-10-01T14:11:50.332830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1482 sessionId: src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0 is DEAD
2025-10-01T14:11:50.333018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:50.333030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0] Write session will restart in 0.005405s
2025-10-01T14:11:50.333057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0] Write session: Do CDS request
2025-10-01T14:11:50.333063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:50.333595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:50.339862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.339920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:50.339935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1483
2025-10-01T14:11:50.340047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.340078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1483 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:50.340084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1483 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:50.340087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:50.340469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1483 sessionId:  describe result for acl check
2025-10-01T14:11:50.340504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:50.340510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:50.340512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:50.340517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255840467100100:3030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:50.340599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:50.341019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255840467100100:3030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:50.342060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:50.342254Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:50.342265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:50.342276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:50.342330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:50.342365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255838090218781:10155]
2025-10-01T14:11:50.342827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255840467100100:3030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:50.342987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:50.343241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:50.343295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:50.343627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:50.343684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.343685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.343687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.343688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.343689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.343690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.343691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.343692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.343694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.343695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.343696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.343697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.343698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.343700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.343705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.343715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.343719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.343722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.343726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.343730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.343733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.343737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.343742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.343746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.343749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.343752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.343755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.343758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.343764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.343771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.343776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.343781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.343784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.343789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.343792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.343797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.343801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.343807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.343811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.343816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.343821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.343825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.343829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.343834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.343841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.343855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.343863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.343873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.343881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.343886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.343890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.343894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.343903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.343908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.343915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.343919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.343954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:50.347282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255840467100100:3030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:50.347300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255840467100100:3030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:50.347305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255840467100100:3030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:50.347320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1483 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:50.347499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:50.348113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:50.348127Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:50.348129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:50.348134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:50.348141Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1482 [2:7556255838090218781:10155]
2025-10-01T14:11:50.348155Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:50.348185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:50.348190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.348193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.348194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.348206Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:50.348209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:50.348214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:50.348254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.348259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.348260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.348263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:50.348264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:50.348317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:50.348322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.348330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.348339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.348354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:50.348372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100139:3030], now have 1 active actors on pipe
2025-10-01T14:11:50.348391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100075:2446], now have 1 active actors on pipe
2025-10-01T14:11:50.348398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255838090218776:10155]
2025-10-01T14:11:50.348400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255838090218776:10155]
2025-10-01T14:11:50.348401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255838090218776:10155]
2025-10-01T14:11:50.348415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:50.348429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:50.348417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1482
2025-10-01T14:11:50.348431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:50.348435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:50.348437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:50.348446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:50.348448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:50.348459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1482
2025-10-01T14:11:50.348470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255838090218776:10155]
2025-10-01T14:11:50.348475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:50.348478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:50.348489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.348496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.348555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:50.348565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.348572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.348573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:50.348579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.348588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:50.348604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.348742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.348747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.348757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.348815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1483 partition: 0 MaxSeqNo: 45 sessionId: src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0
2025-10-01T14:11:50.349185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da0d324-52c0b232-cabef125-4fb4a27f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:50.351588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0] Write session: try to update token
2025-10-01T14:11:50.351607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:50.366631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1483 sessionId: src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:50.369514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:50.369537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:50.369541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:50.369543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:50.369559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255838090218776:10155]
2025-10-01T14:11:50.369566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255838090218776:10155]
2025-10-01T14:11:50.369571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255838090218776:10155]
2025-10-01T14:11:50.369617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:50.369635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:50.369639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:50.369643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.369643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:50.369645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:50.369832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:50.370018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:50.432798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255840467100165:3745]
2025-10-01T14:11:50.433256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1482, pipe: [1:7556255840467100165:3745]
2025-10-01T14:11:50.510438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:50.510749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.510765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.510805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100165:3745], now have 1 active actors on pipe
2025-10-01T14:11:50.511004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:50.510995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:50.510997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:50.511001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:50.511052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255840467100165:3745]
2025-10-01T14:11:50.511063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1483 reason: error at write: Disconnected sessionId: src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0
2025-10-01T14:11:50.511284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1483 sessionId: src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0 is DEAD
2025-10-01T14:11:50.511456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:50.511469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0] Write session will restart in 0.007148s
2025-10-01T14:11:50.511492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0] Write session: Do CDS request
2025-10-01T14:11:50.511498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:50.518887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:50.519914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.519909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:50.519987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:50.520004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1484
2025-10-01T14:11:50.520087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:50.520096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:50.520106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:50.520148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:50.520144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.520172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1484 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:50.520186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255838090218853:10159]
2025-10-01T14:11:50.520193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1484 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:50.520200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:50.520538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1484 sessionId:  describe result for acl check
2025-10-01T14:11:50.520574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:50.520580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:50.520582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:50.520587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255840467100207:3014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:50.520780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:50.521066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255840467100207:3014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:50.521089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:50.521144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:50.521448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:50.521509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.521514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.521515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.521516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.521517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.521519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.521520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.521521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.521522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.521524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.521524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.521526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.521527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.521529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.521535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.521543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.521547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.521551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.521554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.521558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.521562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.521565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.521569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.521572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.521576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.521579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.521583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.521586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.521592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.521601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.521607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.521612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.521618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.521626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.521629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.521633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.521641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.521645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.521650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.521659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.521663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.521670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.521673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.521677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.521685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.521689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.521693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.521697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.521701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.521705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.521713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.521716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.521720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.521725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.521732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.521736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.521775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:50.523827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255840467100207:3014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:50.525369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:50.525921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:50.525936Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:50.525939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:50.525942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:50.525948Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1483 [2:7556255838090218853:10159]
2025-10-01T14:11:50.525962Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:50.525977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:50.525980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.525983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.525986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.526001Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:50.526012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:50.526018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:50.526073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.526079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.526081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.526084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:50.526087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:50.526144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:50.526152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.526162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.526171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.526183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:50.526201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100180:2446], now have 1 active actors on pipe
2025-10-01T14:11:50.526208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255838090218848:10159]
2025-10-01T14:11:50.526214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255838090218848:10159]
2025-10-01T14:11:50.526216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255838090218848:10159]
2025-10-01T14:11:50.526227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:50.526237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:50.526240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:50.526241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:50.526245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:50.526257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:50.526261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:50.526237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1483
2025-10-01T14:11:50.526295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255838090218848:10159]
2025-10-01T14:11:50.526305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:50.526322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:50.526670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255840467100207:3014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:50.526682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255840467100207:3014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:50.526685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255840467100207:3014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:50.526692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1484 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:50.526885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100248:3014], now have 1 active actors on pipe
2025-10-01T14:11:50.526936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1483
2025-10-01T14:11:50.526990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.527001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.527027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:50.527040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.527044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.527046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:50.527054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.527066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:50.527084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.527210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.527219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.527230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.527314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1484 partition: 0 MaxSeqNo: 45 sessionId: src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0
2025-10-01T14:11:50.527708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbbc834e-c4432b49-eebab177-d6cf0f27_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:50.529939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0] Write session: try to update token
2025-10-01T14:11:50.529953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:50.543672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1484 sessionId: src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:50.546447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:50.546517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:50.546533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:50.546535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:50.546537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:50.546547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255838090218848:10159]
2025-10-01T14:11:50.546552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255838090218848:10159]
2025-10-01T14:11:50.546556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255838090218848:10159]
2025-10-01T14:11:50.546605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:50.546612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:50.546616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.546616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:50.546625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.546644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:50.546651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.546656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:50.546790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:50.610995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255840467100253:3745]
2025-10-01T14:11:50.611227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1483, pipe: [1:7556255840467100253:3745]
2025-10-01T14:11:50.683615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:50.683865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100253:3745], now have 1 active actors on pipe
2025-10-01T14:11:50.684060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:50.684090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:50.684105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255840467100253:3745]
2025-10-01T14:11:50.684128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:50.684200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1484 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0
2025-10-01T14:11:50.684415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1484 sessionId: src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0 is DEAD
2025-10-01T14:11:50.684579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:50.684589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0] Write session will restart in 0.006200s
2025-10-01T14:11:50.684614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0] Write session: Do CDS request
2025-10-01T14:11:50.684620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:50.691171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:50.691922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.692008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:50.692021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1485
2025-10-01T14:11:50.692128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.692152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1485 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:50.692160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1485 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:50.692163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:50.692441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:50.692521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1485 sessionId:  describe result for acl check
2025-10-01T14:11:50.692546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:50.692547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:50.692548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:50.692551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255840467100284:2997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:50.692588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:50.692596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:50.692603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:50.692640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:50.692692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255838090218922:10162]
2025-10-01T14:11:50.692944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255840467100284:2997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:50.693227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:50.693459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:50.693505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:50.693791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:50.693852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.693859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.693860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.693861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.693862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.693863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.693865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.693866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.693867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.693868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.693869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.693871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.693872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.693873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.693878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.693886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.693891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.693895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.693898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.693902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.693906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.693909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.693913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.693916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.693920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.693924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.693927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.693931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.693937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.693945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.693955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.693960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.693969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.693974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.693981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.693986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.693993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.693998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.694006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.694011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.694019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.694023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.694031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.694036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.694040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.694045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.694049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.694055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.694063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.694068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.694071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.694079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.694085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.694093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.694097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.694104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.694141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:50.694485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255840467100284:2997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:50.697206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255840467100284:2997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:50.697218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255840467100284:2997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:50.697220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255840467100284:2997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:50.697225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1485 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:50.697482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:50.698025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:50.698035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:50.698037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:50.698039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:50.698044Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1484 [2:7556255838090218922:10162]
2025-10-01T14:11:50.698059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:50.698078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:50.698084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.698087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.698088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.698099Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:50.698105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:50.698108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:50.698143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.698148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.698149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.698153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:50.698154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:50.698200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:50.698206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.698214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.698223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.698236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:50.698255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100323:2997], now have 1 active actors on pipe
2025-10-01T14:11:50.698262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100255:2446], now have 1 active actors on pipe
2025-10-01T14:11:50.698268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255838090218916:10162]
2025-10-01T14:11:50.698273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255838090218916:10162]
2025-10-01T14:11:50.698275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255838090218916:10162]
2025-10-01T14:11:50.698286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:50.698299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:50.698302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:50.698305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:50.698306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:50.698314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:50.698316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:50.698312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1484
2025-10-01T14:11:50.698320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1484
2025-10-01T14:11:50.698335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255838090218916:10162]
2025-10-01T14:11:50.698342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:50.698343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:50.698359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.698367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.698424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:50.698436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.698439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.698442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:50.698450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.698456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:50.698470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.698619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.698627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.698641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.698711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1485 partition: 0 MaxSeqNo: 45 sessionId: src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0
2025-10-01T14:11:50.699003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95379f59-dad9b866-1fbac55f-8fed6a2a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:50.701438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0] Write session: try to update token
2025-10-01T14:11:50.701453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:50.715249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1485 sessionId: src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:50.717491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:50.717719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.717748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.717771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:50.717780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:50.717782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:50.717785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:50.717795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255838090218916:10162]
2025-10-01T14:11:50.717805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255838090218916:10162]
2025-10-01T14:11:50.717810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255838090218916:10162]
2025-10-01T14:11:50.717841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:50.717853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:50.717856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:50.717870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:50.717881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.717888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:50.718014Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:50.777866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:11:50.777889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-01T14:11:50.784043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255840467100333:3745]
2025-10-01T14:11:50.784282Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1484, pipe: [1:7556255840467100333:3745]
2025-10-01T14:11:50.859815Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:50.860127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:50.860492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100333:3745], now have 1 active actors on pipe
2025-10-01T14:11:50.861185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:50.861200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0] Write session will restart in 0.008384s
2025-10-01T14:11:50.861228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0] Write session: Do CDS request
2025-10-01T14:11:50.861234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:50.860623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:50.860723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:50.860726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:50.860794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1485 reason: error at write: Disconnected sessionId: src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0
2025-10-01T14:11:50.860951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1485 sessionId: src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0 is DEAD
2025-10-01T14:11:50.861071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:50.861081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 11
2025-10-01T14:11:50.861107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255840467100333:3745]
2025-10-01T14:11:50.871123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.871226Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:50.871243Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1486
2025-10-01T14:11:50.871474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:50.871516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1486 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:50.871522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1486 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:50.871526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:50.871917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1486 sessionId:  describe result for acl check
2025-10-01T14:11:50.871941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:50.871943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:50.871945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:50.871953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255840467100352:3001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:50.872485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255840467100352:3001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:50.875104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255840467100352:3001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:50.883623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:50.884156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255840467100352:3001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:50.884175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255840467100352:3001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:50.884180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255840467100352:3001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:50.884190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1486 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:50.888303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:50.888599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:50.888603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:50.888614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:50.888689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:50.888726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255838090219021:10175]
2025-10-01T14:11:50.889384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:50.889845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:50.889898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:50.890246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:50.890313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.890314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.890315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.890317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.890318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.890321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.890322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.890323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.890324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.890325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.890326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.890326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.890327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.890328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.890334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.890343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.890347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.890350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.890353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.890356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.890359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.890362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.890366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.890389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.890393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.890396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.890399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.890402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.890410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.890416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:50.890422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.890427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:50.890431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.890435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:50.890441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.890446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:50.890452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.890457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:50.890461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.890465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:50.890469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.890474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:50.890480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.890484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:50.890488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.890492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:50.890496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.890501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.890505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.890509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.890513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.890517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.890521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.890526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:50.890529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.890534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:50.890585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:50.895949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:50.896617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:50.896633Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:50.896636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:50.896640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:50.896647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1485 [2:7556255838090219021:10175]
2025-10-01T14:11:50.896679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:50.896699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:50.896711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.896717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.896723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.896741Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:50.896750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:50.896757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:50.896827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.896834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.896836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.896840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:50.896843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:50.896914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:50.896921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.896933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:50.896948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:50.896967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:50.896989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255838090219014:10175]
2025-10-01T14:11:50.896995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255838090219014:10175]
2025-10-01T14:11:50.896997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255838090219014:10175]
2025-10-01T14:11:50.897006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:50.897025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:50.897044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:50.897050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:50.897074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:50.897085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:50.897087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:50.897089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255838090219014:10175]
2025-10-01T14:11:50.897093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:50.897094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:50.897105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100336:2446], now have 1 active actors on pipe
2025-10-01T14:11:50.897114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100399:3001], now have 1 active actors on pipe
2025-10-01T14:11:50.897291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1485
2025-10-01T14:11:50.897336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1485
2025-10-01T14:11:50.897550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.897567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.897647Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:11:50.897683Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:50.897694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:50.897701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:50.897713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:50.897726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:50.897742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:50.897764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.898283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:50.898293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:50.898311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:50.898309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 13 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:11:50.898352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:11:50.898403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1486 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0
2025-10-01T14:11:50.898794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6fd4b62-5fd99874-ea15ea1e-46c54938_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:50.901289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0] Write session: try to update token
2025-10-01T14:11:50.901307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:50.922581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:50.922609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:50.922611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:50.922614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:50.922624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255838090219014:10175]
2025-10-01T14:11:50.922638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255838090219014:10175]
2025-10-01T14:11:50.922643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255838090219014:10175]
2025-10-01T14:11:50.922704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:50.922705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:50.922713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:50.922718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:50.922719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:50.922721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:50.922898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:50.923538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1486 sessionId: src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:50.926029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:50.961893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255840467100416:3745]
2025-10-01T14:11:50.962436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1485, pipe: [1:7556255840467100416:3745]
2025-10-01T14:11:51.058821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:51.059339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.059356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.059390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255840467100416:3745], now have 1 active actors on pipe
2025-10-01T14:11:51.059656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:51.059661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:51.059691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:51.059695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:51.059737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255840467100416:3745]
2025-10-01T14:11:51.059771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1486 reason: error at write: Disconnected sessionId: src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0
2025-10-01T14:11:51.059977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1486 sessionId: src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0 is DEAD
2025-10-01T14:11:51.060323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:51.060333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0] Write session will restart in 0.007769s
2025-10-01T14:11:51.060361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0] Write session: Do CDS request
2025-10-01T14:11:51.060368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:51.068997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.073978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:51.075614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:51.075534Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:51.075553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1487
2025-10-01T14:11:51.075792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.075819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1487 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:51.075825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1487 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:51.075829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:51.075841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:51.075857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:51.075869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:51.075925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:51.075969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255842385186400:10180]
2025-10-01T14:11:51.076568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:51.077024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:51.076285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1487 sessionId:  describe result for acl check
2025-10-01T14:11:51.076320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:51.076322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:51.076324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:51.076328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255844762067748:2996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:51.077078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:51.076860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255844762067748:2996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:51.077416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:51.077488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.077497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.077498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.077499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.077501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.077503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.077504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.077505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.077509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.077510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.077511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.077512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.077513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.077514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.077520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.077531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.077535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.077539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.077544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.077548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.077552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.077556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.077560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.077564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.077568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.077572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.077575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.077579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.077586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.077596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.077602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.077608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.077612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.077617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.077621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.077627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.077631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.077637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.077641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.077649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.077654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.077660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.077664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.077670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.077675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.077680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.077685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.077690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.077697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.077702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.077706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.077711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.077717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.077722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.077726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.077732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.077780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:51.082314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:51.083024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:51.083041Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:51.083047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:51.083051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:51.083058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1486 [2:7556255842385186400:10180]
2025-10-01T14:11:51.083075Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:51.083094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:51.083097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.083101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.083103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.083121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:51.083129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:51.083135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:51.083196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.083205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.083207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.083210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:51.083213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:51.083287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:51.083296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.083308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.083323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.083337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:51.083359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255842385186393:10180]
2025-10-01T14:11:51.083366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255842385186393:10180]
2025-10-01T14:11:51.083368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255842385186393:10180]
2025-10-01T14:11:51.083382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:51.083402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:51.083420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:51.083428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:51.083462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255842385186393:10180]
2025-10-01T14:11:51.083471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:51.084216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:51.084222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:51.084225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:51.084231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:51.085164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1486
2025-10-01T14:11:51.086344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762067717:2446], now have 1 active actors on pipe
2025-10-01T14:11:51.088730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255844762067748:2996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:51.103292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255844762067748:2996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:51.103315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255844762067748:2996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:51.103321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255844762067748:2996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:51.103331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1487 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:51.104036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762067789:2996], now have 1 active actors on pipe
2025-10-01T14:11:51.104111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1486
2025-10-01T14:11:51.104230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.104246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.104280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a09528b8-62977284-eb55d1c5-718534f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:51.104297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.104307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.104313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:51.104327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.104350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:51.104376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.106642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.106664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.106700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.106799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1487 partition: 0 MaxSeqNo: 45 sessionId: src_id|a09528b8-62977284-eb55d1c5-718534f8_0
2025-10-01T14:11:51.107236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca6b0f80-7a87c8ce-dc30c89-abfbde8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a09528b8-62977284-eb55d1c5-718534f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:51.109800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a09528b8-62977284-eb55d1c5-718534f8_0] Write session: try to update token
2025-10-01T14:11:51.109818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a09528b8-62977284-eb55d1c5-718534f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:51.116213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:51.116236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:51.116239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:51.116241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:51.116251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255842385186393:10180]
2025-10-01T14:11:51.116258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255842385186393:10180]
2025-10-01T14:11:51.116261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255842385186393:10180]
2025-10-01T14:11:51.116316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:51.116329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.116332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:51.116464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:51.118423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:51.118441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:51.118445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:51.130921Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1487 sessionId: src_id|a09528b8-62977284-eb55d1c5-718534f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:51.133423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:51.159843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255844762067794:3745]
2025-10-01T14:11:51.160234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1486, pipe: [1:7556255844762067794:3745]
2025-10-01T14:11:51.269404Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:51.269726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.269742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.269764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762067794:3745], now have 1 active actors on pipe
2025-10-01T14:11:51.269977Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:51.270005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:51.270009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255844762067794:3745]
2025-10-01T14:11:51.270020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:51.270025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:51.270074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1487 reason: error at write: Disconnected sessionId: src_id|a09528b8-62977284-eb55d1c5-718534f8_0
2025-10-01T14:11:51.270238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1487 sessionId: src_id|a09528b8-62977284-eb55d1c5-718534f8_0 is DEAD
2025-10-01T14:11:51.270434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09528b8-62977284-eb55d1c5-718534f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:51.270451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09528b8-62977284-eb55d1c5-718534f8_0] Write session will restart in 0.009778s
2025-10-01T14:11:51.270483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09528b8-62977284-eb55d1c5-718534f8_0] Write session: Do CDS request
2025-10-01T14:11:51.270489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09528b8-62977284-eb55d1c5-718534f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:51.276838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:51.278066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:51.278231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:51.278241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:51.278251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:51.278290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:51.278326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255842385186468:10182]
2025-10-01T14:11:51.278931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:51.279213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:51.279262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:51.279551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:51.279601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.279606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.279607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.279608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.279609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.279610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.279612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.279613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.279614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.279615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.279616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.279617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.279618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.279619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.279625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.279635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.279639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.279643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.279646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.279650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.279653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.279657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.279660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.279664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.279668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.279671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.279674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.279678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.279685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.279692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.279698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.279702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.279707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.279711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.279715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.279719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.279723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.279734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.279738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.279742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.279746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.279754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.279758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.279763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.279771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.279775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.279779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.279784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.279792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.279797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.279801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.279809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.279813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.279817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.279825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.279830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.279870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:51.281924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a09528b8-62977284-eb55d1c5-718534f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.281946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:51.281960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1488
2025-10-01T14:11:51.282185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.282208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1488 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:51.282216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1488 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:51.282218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:51.282513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1488 sessionId:  describe result for acl check
2025-10-01T14:11:51.282541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:51.282547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:51.282549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:51.282552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255844762067856:2990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:51.282936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255844762067856:2990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:51.283145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:51.283664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:51.283676Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:51.283677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:51.283680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:51.283687Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1487 [2:7556255842385186468:10182]
2025-10-01T14:11:51.283697Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:51.283709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:51.283716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.283719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.283721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.283735Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:51.283745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:51.283749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:51.283786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.283791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.283792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.283794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:51.283796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:51.283863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:51.283872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.283878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.283884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.283893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:51.283904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762067808:2446], now have 1 active actors on pipe
2025-10-01T14:11:51.283910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255842385186463:10182]
2025-10-01T14:11:51.283911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255842385186463:10182]
2025-10-01T14:11:51.283912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255842385186463:10182]
2025-10-01T14:11:51.283922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:51.283924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1487
2025-10-01T14:11:51.283934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:51.283936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:51.283943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:51.283944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:51.283945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:51.283946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:51.283961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255842385186463:10182]
2025-10-01T14:11:51.283963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:51.283965Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:51.284944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255844762067856:2990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:51.290236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255844762067856:2990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:51.290249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255844762067856:2990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:51.290252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255844762067856:2990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:51.290258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1488 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:51.290477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762067893:2990], now have 1 active actors on pipe
2025-10-01T14:11:51.290533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1487
2025-10-01T14:11:51.290589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.290601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.290629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:51.290644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.290651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.290653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:51.290664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.290679Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:51.290697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.290824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.290835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.290848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.290922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1488 partition: 0 MaxSeqNo: 45 sessionId: src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0
2025-10-01T14:11:51.291288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a09528b8-62977284-eb55d1c5-718534f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:51.293778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0] Write session: try to update token
2025-10-01T14:11:51.293794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:51.293932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:51.293947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:51.293955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255842385186463:10182]
2025-10-01T14:11:51.293985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:51.293995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:51.294137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:51.294255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:51.294395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:51.294520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:51.294715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:51.294754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:51.309995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1488 sessionId: src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:51.312393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:51.312601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:51.312620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:51.312624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:51.312628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:51.312638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255842385186463:10182]
2025-10-01T14:11:51.312642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255842385186463:10182]
2025-10-01T14:11:51.312645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255842385186463:10182]
2025-10-01T14:11:51.312705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:51.312716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.312719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:51.312727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:51.312742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:51.312748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:51.312840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:51.370252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255844762067897:3745]
2025-10-01T14:11:51.370638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1487, pipe: [1:7556255844762067897:3745]
2025-10-01T14:11:51.466175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:51.466550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.466565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.466591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762067897:3745], now have 1 active actors on pipe
2025-10-01T14:11:51.466810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:51.467317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:51.467405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1488 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0
2025-10-01T14:11:51.467809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:51.467820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0] Write session will restart in 0.005455s
2025-10-01T14:11:51.467845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0] Write session: Do CDS request
2025-10-01T14:11:51.467852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:51.467631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1488 sessionId: src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0 is DEAD
2025-10-01T14:11:51.467794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:51.467833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255844762067897:3745]
2025-10-01T14:11:51.475039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.478864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:51.478882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1489
2025-10-01T14:11:51.480070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:51.482444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.482504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1489 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:51.482510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1489 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:51.482514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:51.482894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1489 sessionId:  describe result for acl check
2025-10-01T14:11:51.482923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:51.482929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:51.482930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:51.482935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255844762067954:2976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:51.483408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255844762067954:2976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:51.483112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:51.483342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:51.483347Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:51.483358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:51.483412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:51.483447Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255842385186540:10184]
2025-10-01T14:11:51.484088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:51.484420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:51.484469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:51.484793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:51.484860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.484861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.484863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.484864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.484865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.484866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.484867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.484873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.484874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.484875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.484876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.484877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.484878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.484879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.484884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.484894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.484898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.484901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.484905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.484909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.484913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.484916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.484919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.484923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.484926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.484929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.484932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.484936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.484942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.484949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.484955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.484960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.484964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.484969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.484973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.484977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.484983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.484987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.484994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.484998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.485002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.485006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.485010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.485014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.485018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.485022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.485027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.485031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.485035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.485041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.485045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.485049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.485054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.485058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.485061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.485065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.485103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:51.488837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255844762067954:2976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:51.491828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:51.491667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255844762067954:2976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:51.491683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255844762067954:2976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:51.491686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255844762067954:2976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:51.491694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1489 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:51.492914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1488
2025-10-01T14:11:51.492940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1488
2025-10-01T14:11:51.492572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:51.492586Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:51.492589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:51.492593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:51.492600Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1488 [2:7556255842385186540:10184]
2025-10-01T14:11:51.492615Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:51.492630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:51.492633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.492637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.492639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.492658Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:51.492664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:51.492686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:51.492743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.492745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.492747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.492750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:51.492754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:51.492825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:51.492828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.492840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.492850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.492864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:51.492882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762067991:2976], now have 1 active actors on pipe
2025-10-01T14:11:51.492885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762067921:2446], now have 1 active actors on pipe
2025-10-01T14:11:51.492892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255842385186534:10184]
2025-10-01T14:11:51.492894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255842385186534:10184]
2025-10-01T14:11:51.492896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255842385186534:10184]
2025-10-01T14:11:51.492910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:51.492920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:51.492922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:51.492922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:51.492924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:51.492935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:51.492938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:51.492974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255842385186534:10184]
2025-10-01T14:11:51.492981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:51.492984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:51.492996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.493001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.493050Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54b80c12-9ae83d08-f0537eff-56a66929_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:51.493057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.493061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.493063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:51.493071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.493080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:51.493103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.493324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.493332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.493347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.493417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1489 partition: 0 MaxSeqNo: 45 sessionId: src_id|54b80c12-9ae83d08-f0537eff-56a66929_0
2025-10-01T14:11:51.493878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1ac5bd5-4338e0b0-dbe79ad6-bf963210_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|54b80c12-9ae83d08-f0537eff-56a66929_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:51.496432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b80c12-9ae83d08-f0537eff-56a66929_0] Write session: try to update token
2025-10-01T14:11:51.496449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b80c12-9ae83d08-f0537eff-56a66929_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:51.514600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:51.514619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:51.514620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:51.514622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:51.514629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255842385186534:10184]
2025-10-01T14:11:51.514632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255842385186534:10184]
2025-10-01T14:11:51.514635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255842385186534:10184]
2025-10-01T14:11:51.514690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:51.514698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:51.514701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.514707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:51.514708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:51.514710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:51.514846Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:51.520090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1489 sessionId: src_id|54b80c12-9ae83d08-f0537eff-56a66929_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:51.522671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:51.567901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255844762068008:3745]
2025-10-01T14:11:51.568173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1488, pipe: [1:7556255844762068008:3745]
2025-10-01T14:11:51.668350Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:51.668737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.668745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.668764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762068008:3745], now have 1 active actors on pipe
2025-10-01T14:11:51.669266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:51.669283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:51.669354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1489 reason: error at write: Disconnected sessionId: src_id|54b80c12-9ae83d08-f0537eff-56a66929_0
2025-10-01T14:11:51.669356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:51.669406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255844762068008:3745]
2025-10-01T14:11:51.669059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:51.669569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1489 sessionId: src_id|54b80c12-9ae83d08-f0537eff-56a66929_0 is DEAD
2025-10-01T14:11:51.670462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b80c12-9ae83d08-f0537eff-56a66929_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:51.670474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b80c12-9ae83d08-f0537eff-56a66929_0] Write session will restart in 0.009249s
2025-10-01T14:11:51.670503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b80c12-9ae83d08-f0537eff-56a66929_0] Write session: Do CDS request
2025-10-01T14:11:51.670509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b80c12-9ae83d08-f0537eff-56a66929_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:51.681224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54b80c12-9ae83d08-f0537eff-56a66929_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.682252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:51.682731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:51.682749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1490
2025-10-01T14:11:51.683533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.683571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1490 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:51.683579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1490 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:51.683582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:51.683954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1490 sessionId:  describe result for acl check
2025-10-01T14:11:51.683989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:51.683996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:51.683998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:51.684005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255844762068045:2962] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:51.684520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255844762068045:2962] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:51.685671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:51.685892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:51.685896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:51.685909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:51.685959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:51.685995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255842385186620:10189]
2025-10-01T14:11:51.686572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:51.686867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:51.686910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:51.686620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255844762068045:2962] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:51.687139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:51.687174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.687175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.687176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.687176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.687177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.687179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.687179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.687180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.687180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.687181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.687182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.687182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.687183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.687183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.687187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.687193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.687195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.687198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.687200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.687202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.687204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.687206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.687209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.687211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.687214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.687216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.687218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.687220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.687225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.687229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.687232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.687235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.687239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.687241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.687244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.687247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.687250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.687253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.687255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.687258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.687261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.687264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.687266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.687269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.687271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.687274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.687276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.687279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.687282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.687284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.687287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.687289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.687292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.687295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.687298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.687300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.687322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:51.691980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:51.691955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255844762068045:2962] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:51.691971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255844762068045:2962] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:51.691975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255844762068045:2962] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:51.691983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1490 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:51.693123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:51.693134Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:51.693136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:51.693138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:51.693143Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1489 [2:7556255842385186620:10189]
2025-10-01T14:11:51.693154Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:51.693170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:51.693171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.693173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.693175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.693187Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:51.693195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:51.693198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:51.693249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.693261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.693262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.693265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:51.693267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:51.693323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:51.693329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.693335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.693342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.693351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:51.693364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762068011:2446], now have 1 active actors on pipe
2025-10-01T14:11:51.693370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255842385186615:10189]
2025-10-01T14:11:51.693371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255842385186615:10189]
2025-10-01T14:11:51.693372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255842385186615:10189]
2025-10-01T14:11:51.693381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:51.693387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762068083:2962], now have 1 active actors on pipe
2025-10-01T14:11:51.693391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:51.693392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:51.693394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:51.693395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:51.693400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:51.693402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:51.693425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255842385186615:10189]
2025-10-01T14:11:51.693432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:51.693454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:51.693526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.693536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.693558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6e10349-d19e0594-96072e57-f6305312_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:51.693568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.693576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.693578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:51.693587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.693599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:51.693614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.693440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1489
2025-10-01T14:11:51.693475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1489
2025-10-01T14:11:51.693846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.693855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.693869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.693941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1490 partition: 0 MaxSeqNo: 45 sessionId: src_id|f6e10349-d19e0594-96072e57-f6305312_0
2025-10-01T14:11:51.695293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54b80c12-9ae83d08-f0537eff-56a66929_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f6e10349-d19e0594-96072e57-f6305312_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:51.697600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e10349-d19e0594-96072e57-f6305312_0] Write session: try to update token
2025-10-01T14:11:51.697616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e10349-d19e0594-96072e57-f6305312_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:51.713707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:51.713734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:51.713737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:51.713739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:51.713750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255842385186615:10189]
2025-10-01T14:11:51.713755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255842385186615:10189]
2025-10-01T14:11:51.713758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255842385186615:10189]
2025-10-01T14:11:51.713803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:51.713806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:51.713813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.713815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:51.713817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:51.713820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:51.714362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:51.722356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1490 sessionId: src_id|f6e10349-d19e0594-96072e57-f6305312_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:51.724790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:51.769638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255844762068090:3745]
2025-10-01T14:11:51.769937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1489, pipe: [1:7556255844762068090:3745]
2025-10-01T14:11:51.866928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:51.867245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.867262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.867284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762068090:3745], now have 1 active actors on pipe
2025-10-01T14:11:51.867472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:51.867497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255844762068090:3745]
2025-10-01T14:11:51.867519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:51.867521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:51.867570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1490 reason: error at write: Disconnected sessionId: src_id|f6e10349-d19e0594-96072e57-f6305312_0
2025-10-01T14:11:51.867481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:51.867766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1490 sessionId: src_id|f6e10349-d19e0594-96072e57-f6305312_0 is DEAD
2025-10-01T14:11:51.867963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e10349-d19e0594-96072e57-f6305312_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:51.867976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e10349-d19e0594-96072e57-f6305312_0] Write session will restart in 0.005781s
2025-10-01T14:11:51.868004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e10349-d19e0594-96072e57-f6305312_0] Write session: Do CDS request
2025-10-01T14:11:51.868011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e10349-d19e0594-96072e57-f6305312_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:51.874872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e10349-d19e0594-96072e57-f6305312_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.874945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:51.874958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1491
2025-10-01T14:11:51.875082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:51.875110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1491 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:51.875119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1491 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:51.875123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:51.875171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:51.875473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1491 sessionId:  describe result for acl check
2025-10-01T14:11:51.875501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:51.875502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:51.875504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:51.875508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255844762068129:2961] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:51.875994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255844762068129:2961] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:51.876503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:51.876663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:51.876694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:51.876704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:51.876746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:51.876780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255842385186721:10201]
2025-10-01T14:11:51.877280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:51.877517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:51.877551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:51.877802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:51.877848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.877854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.877855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.877856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.877857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.877859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.877860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.877861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.877862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.877863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.877864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.877865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.877866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.877867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.877871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.877879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.877882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.877885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.877883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255844762068129:2961] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:51.877888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.877891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.877896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.877899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.877902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.877906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.877908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.877911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.877914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.877917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.877922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.877929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:51.877934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.877938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:51.877942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.877946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:51.877950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.877954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:51.877958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.877962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:51.877965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.877970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:51.877973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.877977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:51.877980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.877984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:51.877987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.877991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:51.877995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.877999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.878003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.878006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.878010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.878014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.878017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.878021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:51.878024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.878028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:51.878061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:51.881160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255844762068129:2961] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:51.881177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255844762068129:2961] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:51.881180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255844762068129:2961] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:51.881187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1491 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:51.881397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:51.882287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:51.882302Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:51.882305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:51.882308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:51.882314Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1490 [2:7556255842385186721:10201]
2025-10-01T14:11:51.882326Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:51.882340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:51.882343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.882345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.882347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.882361Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:51.882366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:51.882385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:51.882434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.882441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.882443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.882447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:51.882450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:51.882514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:51.882521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.882532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:51.882545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:51.882562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:51.882580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255842385186716:10201]
2025-10-01T14:11:51.882585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255842385186716:10201]
2025-10-01T14:11:51.882587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255842385186716:10201]
2025-10-01T14:11:51.882599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:51.882612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:51.882628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:51.882633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:51.882637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:51.882640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:51.882642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:51.882654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255842385186716:10201]
2025-10-01T14:11:51.882660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:51.882681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:51.882705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762068169:2961], now have 1 active actors on pipe
2025-10-01T14:11:51.882712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762068096:2446], now have 1 active actors on pipe
2025-10-01T14:11:51.882789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1490
2025-10-01T14:11:51.882798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1490
2025-10-01T14:11:51.882858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.882869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.882902Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:51.882913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:51.882921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:51.882923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:51.882932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:51.882946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:51.882968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.883210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:51.883220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:51.883239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:51.883705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1491 partition: 0 MaxSeqNo: 45 sessionId: src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0
2025-10-01T14:11:51.884141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e10349-d19e0594-96072e57-f6305312_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:51.887310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0] Write session: try to update token
2025-10-01T14:11:51.887330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:51.902083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1491 sessionId: src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:51.903423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:51.903445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:51.903447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:51.903451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:51.903463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255842385186716:10201]
2025-10-01T14:11:51.903469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255842385186716:10201]
2025-10-01T14:11:51.903472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255842385186716:10201]
2025-10-01T14:11:51.903520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:51.903528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:51.903530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:51.903533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:51.903534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:51.903538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:51.903701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:51.904491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:51.969058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255844762068177:3745]
2025-10-01T14:11:51.969344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1490, pipe: [1:7556255844762068177:3745]
2025-10-01T14:11:52.047265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:52.047630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.047647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.047686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255844762068177:3745], now have 1 active actors on pipe
2025-10-01T14:11:52.048082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:52.048069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255844762068177:3745]
2025-10-01T14:11:52.048104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:52.048107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:52.048521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:52.048532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0] Write session will restart in 0.005042s
2025-10-01T14:11:52.048557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0] Write session: Do CDS request
2025-10-01T14:11:52.048564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:52.048163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1491 reason: error at write: Disconnected sessionId: src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0
2025-10-01T14:11:52.048239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:52.048412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1491 sessionId: src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0 is DEAD
2025-10-01T14:11:52.054875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.054964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:52.054979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1492
2025-10-01T14:11:52.055107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.055136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1492 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:52.055145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1492 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:52.055149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:52.055536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1492 sessionId:  describe result for acl check
2025-10-01T14:11:52.055573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:52.055579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:52.055581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:52.055586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255849057035484:2955] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:52.056082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255849057035484:2955] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:52.058179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255849057035484:2955] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:52.058956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:52.060268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:52.060437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:52.060447Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:52.060471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:52.060509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:52.060548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255846680154105:10205]
2025-10-01T14:11:52.060828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255849057035484:2955] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:52.060841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255849057035484:2955] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:52.060844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255849057035484:2955] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:52.060851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1492 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:52.061062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:52.061294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:52.061344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:52.061656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:52.061703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.061708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.061709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.061710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.061710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.061711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.061712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.061712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.061713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.061714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.061714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.061715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.061717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.061718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.061723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.061740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.061744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.061747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.061750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.061753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.061756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.061759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.061761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.061764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.061767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.061771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.061774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.061778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.061785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.061791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.061796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.061805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.061809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.061817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.061821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.061831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.061835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.061842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.061845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.061850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.061860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.061865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.061872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.061875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.061878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.061880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.061883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.061885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.061887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.061890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.061892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.061895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.061900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.061903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.061906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.061908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.061943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:52.065398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:52.066022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:52.066038Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:52.066040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:52.066043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:52.066049Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1491 [2:7556255846680154105:10205]
2025-10-01T14:11:52.066064Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:52.066079Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:52.066081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.066085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.066087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.066101Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:52.066106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:52.066111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:52.066156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.066158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.066159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.066162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:52.066164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:52.066235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:52.066237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.066246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.066255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.066267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:52.066282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035475:2446], now have 1 active actors on pipe
2025-10-01T14:11:52.066294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035545:2955], now have 1 active actors on pipe
2025-10-01T14:11:52.066300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255846680154099:10205]
2025-10-01T14:11:52.066302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255846680154099:10205]
2025-10-01T14:11:52.066304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255846680154099:10205]
2025-10-01T14:11:52.066316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:52.066329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:52.066330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:52.066337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:52.066339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:52.066342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:52.066345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:52.066389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1491
2025-10-01T14:11:52.066427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1491
2025-10-01T14:11:52.066383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255846680154099:10205]
2025-10-01T14:11:52.066391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:52.066401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:52.066530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.066545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.066571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44a617d0-681506f0-2de24be9-85161133_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:52.066583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.066591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.066593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:52.066613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.066627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:52.066645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.066805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.066811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.066823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.066901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1492 partition: 0 MaxSeqNo: 45 sessionId: src_id|44a617d0-681506f0-2de24be9-85161133_0
2025-10-01T14:11:52.067304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|609f49a8-32ba1cc0-54089906-c4fae76c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|44a617d0-681506f0-2de24be9-85161133_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:52.070166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44a617d0-681506f0-2de24be9-85161133_0] Write session: try to update token
2025-10-01T14:11:52.070187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44a617d0-681506f0-2de24be9-85161133_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:52.088197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:52.088220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:52.088222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:52.088226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:52.088237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255846680154099:10205]
2025-10-01T14:11:52.088241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255846680154099:10205]
2025-10-01T14:11:52.088248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255846680154099:10205]
2025-10-01T14:11:52.088289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:52.088294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:52.088300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.088302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:52.088302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:52.088306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:52.088500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:52.089733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1492 sessionId: src_id|44a617d0-681506f0-2de24be9-85161133_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:52.092435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:52.148010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255849057035560:3745]
2025-10-01T14:11:52.148258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1491, pipe: [1:7556255849057035560:3745]
2025-10-01T14:11:52.233379Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:52.233664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.233677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.233717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035560:3745], now have 1 active actors on pipe
2025-10-01T14:11:52.233893Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:52.234142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:52.234195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:52.234262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1492 reason: status is not ok: tablet will be restarted right now sessionId: src_id|44a617d0-681506f0-2de24be9-85161133_0
2025-10-01T14:11:52.234328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255849057035560:3745]
2025-10-01T14:11:52.234454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1492 sessionId: src_id|44a617d0-681506f0-2de24be9-85161133_0 is DEAD
2025-10-01T14:11:52.234625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a617d0-681506f0-2de24be9-85161133_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:52.234637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a617d0-681506f0-2de24be9-85161133_0] Write session will restart in 0.007965s
2025-10-01T14:11:52.234663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a617d0-681506f0-2de24be9-85161133_0] Write session: Do CDS request
2025-10-01T14:11:52.234670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a617d0-681506f0-2de24be9-85161133_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:52.241851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:52.243137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:52.243307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:52.243316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:52.243326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:52.243370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:52.243405Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255846680154179:10207]
2025-10-01T14:11:52.243871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44a617d0-681506f0-2de24be9-85161133_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.243927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:52.244167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:52.244200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:52.244443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:52.244485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.244490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.244490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.244491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.244492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.244493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.244494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.244495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.244497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.244497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.244498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.244499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.244500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.244501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.244505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.244513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.244516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.244519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.244524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.244527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.244530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.244533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.244536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.244540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.244543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.244546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.244549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.244552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.244558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.244565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.244570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.244574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.244578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.244582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.244585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.244590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.244594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.244599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.244603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.244608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.244617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.244621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.244624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.244628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.244634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.244638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.244643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.244647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.244651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.244655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.244658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.244662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.244677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.244681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.244684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.244688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.244718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:52.248510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:52.249188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:52.249202Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:52.249206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:52.249209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:52.249215Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1492 [2:7556255846680154179:10207]
2025-10-01T14:11:52.249229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:52.249245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:52.249248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.249252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.249254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.249270Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:52.249274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:52.249279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:52.249329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.249337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.249339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.249342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:52.249344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:52.249327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:52.249350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1493
2025-10-01T14:11:52.249402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:52.249408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.249417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.249425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.249441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:52.249461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035574:2446], now have 1 active actors on pipe
2025-10-01T14:11:52.249471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255846680154174:10207]
2025-10-01T14:11:52.249473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255846680154174:10207]
2025-10-01T14:11:52.249475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255846680154174:10207]
2025-10-01T14:11:52.249485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:52.249501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:52.249503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:52.249506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:52.249508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:52.249515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:52.249518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:52.249517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1492
2025-10-01T14:11:52.249542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255846680154174:10207]
2025-10-01T14:11:52.249551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:52.249561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:52.249561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.249597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1493 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:52.249611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1493 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:52.249617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:52.250004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1493 sessionId:  describe result for acl check
2025-10-01T14:11:52.250044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:52.250052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:52.250054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:52.250063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255849057035617:2940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:52.250640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255849057035617:2940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:52.252822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255849057035617:2940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:52.257962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255849057035617:2940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:52.257977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255849057035617:2940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:52.257979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255849057035617:2940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:52.257997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1493 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:52.258253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035653:2940], now have 1 active actors on pipe
2025-10-01T14:11:52.258343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1492
2025-10-01T14:11:52.258417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.258430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.258455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:52.258467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.258471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.258477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:52.258485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.258499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:52.258517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.258677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.258682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.258692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.258751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1493 partition: 0 MaxSeqNo: 45 sessionId: src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0
2025-10-01T14:11:52.259150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44a617d0-681506f0-2de24be9-85161133_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:52.259769Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:52.259783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:52.259791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255846680154174:10207]
2025-10-01T14:11:52.259822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:52.259823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:52.259972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:52.260094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:52.260221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:52.260352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:52.260529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:52.260556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:52.261849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0] Write session: try to update token
2025-10-01T14:11:52.261867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:52.275961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1493 sessionId: src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:52.278530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:52.279527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.279553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.279577Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:52.279580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:52.279583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:52.279585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:52.279594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255846680154174:10207]
2025-10-01T14:11:52.279599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255846680154174:10207]
2025-10-01T14:11:52.279602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255846680154174:10207]
2025-10-01T14:11:52.279643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:52.279649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:52.279653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:52.279660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:52.279667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.279675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:52.279814Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:52.334358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255849057035657:3745]
2025-10-01T14:11:52.334804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1492, pipe: [1:7556255849057035657:3745]
2025-10-01T14:11:52.425810Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:52.426178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:52.426215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035657:3745], now have 1 active actors on pipe
2025-10-01T14:11:52.426323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:52.426382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255849057035657:3745]
2025-10-01T14:11:52.426410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:52.426428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:52.426431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:52.426521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1493 reason: error at write: Disconnected sessionId: src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0
2025-10-01T14:11:52.426700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1493 sessionId: src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0 is DEAD
2025-10-01T14:11:52.427016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:52.427023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0] Write session will restart in 0.009421s
2025-10-01T14:11:52.427044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0] Write session: Do CDS request
2025-10-01T14:11:52.427051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:52.435129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:52.436697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:52.436922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:52.436932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:52.436946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:52.437006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:52.437047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255846680154254:10209]
2025-10-01T14:11:52.437659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:52.437944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.438533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:52.438587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:52.438910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:52.438991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.438992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.438993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.438994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.438995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.438996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.438997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.438998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.438999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.439000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.439001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.439002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.439003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.439004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.439010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.439019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.439023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.439028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.439032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.439035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.439039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.439043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.439047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.439051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.439054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.439057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.439061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.439064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.439071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.439078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.439085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.439090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.439094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.439099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.439103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.439108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.439113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.439118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.439121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.439127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.439132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.439136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.439142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.439147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.439151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.439156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.439160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.439165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.439170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.439175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.439179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.439184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.439188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.439192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.439196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.439200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.439237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:52.442553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:52.442580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1494
2025-10-01T14:11:52.442748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.442779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1494 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:52.442789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1494 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:52.442793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:52.443180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1494 sessionId:  describe result for acl check
2025-10-01T14:11:52.443218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:52.443219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:52.443221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:52.443226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255849057035708:2934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:52.443765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255849057035708:2934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:52.444447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1493
2025-10-01T14:11:52.443455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:52.444100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:52.444105Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:52.444109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:52.444112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:52.444119Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1493 [2:7556255846680154254:10209]
2025-10-01T14:11:52.444135Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:52.444153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:52.444156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.444160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.444162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.444179Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:52.444185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:52.444191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:52.444250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.444252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.444254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.444257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:52.444259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:52.444345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:52.444347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.444358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.444369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.444385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:52.444402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035666:2446], now have 1 active actors on pipe
2025-10-01T14:11:52.444409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255846680154249:10209]
2025-10-01T14:11:52.444411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255846680154249:10209]
2025-10-01T14:11:52.444414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255846680154249:10209]
2025-10-01T14:11:52.444438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:52.444438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:52.444442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:52.444445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:52.444451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:52.444465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:52.444467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:52.444496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255846680154249:10209]
2025-10-01T14:11:52.444499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:52.444501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:52.445808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255849057035708:2934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:52.450592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255849057035708:2934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:52.450623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255849057035708:2934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:52.450626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255849057035708:2934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:52.450635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1494 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:52.451282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1493
2025-10-01T14:11:52.451912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1494 partition: 0 MaxSeqNo: 45 sessionId: src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0
2025-10-01T14:11:52.452345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db6579d2-5fac809e-d571b634-ee7c48b4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:52.451182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035745:2934], now have 1 active actors on pipe
2025-10-01T14:11:52.451374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.451386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.451424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:52.451435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.451441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.451444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:52.451456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.451471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:52.451491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.451755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.451761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.451783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.454797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0] Write session: try to update token
2025-10-01T14:11:52.454814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:52.466999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:52.467022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:52.467024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:52.467026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:52.467037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255846680154249:10209]
2025-10-01T14:11:52.467041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255846680154249:10209]
2025-10-01T14:11:52.467045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255846680154249:10209]
2025-10-01T14:11:52.467096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:52.467099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:52.467103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:52.467105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.467107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:52.467110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:52.467256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:52.476626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1494 sessionId: src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:52.479137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:52.526401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255849057035766:3745]
2025-10-01T14:11:52.526669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1493, pipe: [1:7556255849057035766:3745]
2025-10-01T14:11:52.614585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:52.614888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.614903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.614924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035766:3745], now have 1 active actors on pipe
2025-10-01T14:11:52.615158Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:52.615195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:52.615250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255849057035766:3745]
2025-10-01T14:11:52.615270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:52.615339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1494 reason: status is not ok: tablet will be restarted right now sessionId: src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0
2025-10-01T14:11:52.615541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1494 sessionId: src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0 is DEAD
2025-10-01T14:11:52.615690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:52.615700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0] Write session will restart in 0.007900s
2025-10-01T14:11:52.615729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0] Write session: Do CDS request
2025-10-01T14:11:52.615734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:52.623528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:52.624967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.624932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:52.625055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:52.625072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1495
2025-10-01T14:11:52.625108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:52.625122Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:52.625133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:52.625171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:52.625197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.625240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1495 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:52.625251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1495 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:52.625235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255846680154339:10214]
2025-10-01T14:11:52.625255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:52.625612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1495 sessionId:  describe result for acl check
2025-10-01T14:11:52.625647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:52.625654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:52.625655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:52.625660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255849057035816:2913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:52.625801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:52.626098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:52.626137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:52.626391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255849057035816:2913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:52.626420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:52.626468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.626476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.626477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.626478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.626479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.626480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.626481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.626482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.626482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.626483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.626485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.626485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.626486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.626487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.626492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.626501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.626504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.626507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.626510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.626513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.626517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.626520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.626523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.626527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.626530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.626533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.626536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.626539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.626545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.626551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.626556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.626561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.626565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.626569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.626572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.626578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.626582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.626586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.626590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.626594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.626598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.626602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.626606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.626610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.626614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.626618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.626624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.626628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.626632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.626636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.626640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.626646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.626650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.626654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.626658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.626662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.626694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:52.628545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255849057035816:2913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:52.630779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:52.631065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255849057035816:2913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:52.631082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255849057035816:2913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:52.631085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255849057035816:2913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:52.631094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1495 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:52.631680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:52.631699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:52.631702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:52.631706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:52.631713Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1494 [2:7556255846680154339:10214]
2025-10-01T14:11:52.631727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:52.631747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:52.631750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.631754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.631756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.631773Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:52.631779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:52.631786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:52.631849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.631858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.631860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.631865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:52.631868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:52.631934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:52.631943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.631953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.631962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.631980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:52.632003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035777:2446], now have 1 active actors on pipe
2025-10-01T14:11:52.632012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035855:2913], now have 1 active actors on pipe
2025-10-01T14:11:52.632021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255846680154334:10214]
2025-10-01T14:11:52.632031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255846680154334:10214]
2025-10-01T14:11:52.632033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255846680154334:10214]
2025-10-01T14:11:52.632053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:52.632056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:52.632059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:52.632029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1494
2025-10-01T14:11:52.632060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:52.632077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:52.632094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:52.632033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1494
2025-10-01T14:11:52.632097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:52.632145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.632159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.632181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255846680154334:10214]
2025-10-01T14:11:52.632196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:52.632207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:52.632236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:52.632254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.632267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.632269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:52.632279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.632296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:52.632391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.632682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.632694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.632711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.632790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1495 partition: 0 MaxSeqNo: 45 sessionId: src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0
2025-10-01T14:11:52.633158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62b0474f-959cff3e-70ef8af0-4cde390b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:52.635687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0] Write session: try to update token
2025-10-01T14:11:52.635705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:52.649853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1495 sessionId: src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:52.652250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:52.652276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:52.652279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:52.652287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:52.652297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255846680154334:10214]
2025-10-01T14:11:52.652301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255846680154334:10214]
2025-10-01T14:11:52.652305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255846680154334:10214]
2025-10-01T14:11:52.652354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:52.652361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.652363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:52.652365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:52.652371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:52.652374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:52.652354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:52.652562Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:52.715332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255849057035862:3745]
2025-10-01T14:11:52.715621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1494, pipe: [1:7556255849057035862:3745]
2025-10-01T14:11:52.806895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:52.807185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.807202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.807243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035862:3745], now have 1 active actors on pipe
2025-10-01T14:11:52.807466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:52.807487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:52.807489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255849057035862:3745]
2025-10-01T14:11:52.807499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:52.807508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:52.807664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1495 reason: error at write: Disconnected sessionId: src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0
2025-10-01T14:11:52.807836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1495 sessionId: src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0 is DEAD
2025-10-01T14:11:52.808007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:52.808020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0] Write session will restart in 0.005117s
2025-10-01T14:11:52.808046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0] Write session: Do CDS request
2025-10-01T14:11:52.808052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:52.813900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.813954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:52.813969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1496
2025-10-01T14:11:52.814119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.814148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1496 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:52.814158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1496 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:52.814161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:52.814519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1496 sessionId:  describe result for acl check
2025-10-01T14:11:52.814546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:52.814547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:52.814549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:52.814554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255849057035905:2916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:52.814754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:52.815016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255849057035905:2916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:52.816139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:52.816323Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:52.816334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:52.816345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:52.816390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:52.816421Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255846680154429:10218]
2025-10-01T14:11:52.816825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255849057035905:2916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:52.816962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:52.817205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:52.817247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:52.817493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:52.817535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.817541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.817542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.817542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.817543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.817544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.817545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.817545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.817546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.817546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.817547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.817547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.817548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.817549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.817552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.817559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.817561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.817563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.817566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.817568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.817570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.817572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.817574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.817576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.817592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.817595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.817599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.817603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.817608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.817615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.817619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.817622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.817625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.817627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.817630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.817633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.817636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.817639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.817641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.817644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.817647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.817650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.817652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.817655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.817657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.817659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.817663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.817665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.817668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.817670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.817673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.817676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.817678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.817681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.817683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.817686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.817717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:52.821115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255849057035905:2916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:52.821128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255849057035905:2916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:52.821131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255849057035905:2916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:52.821138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1496 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:52.821319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:52.821950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:52.821963Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:52.821964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:52.821967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:52.821972Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1495 [2:7556255846680154429:10218]
2025-10-01T14:11:52.821982Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:52.821994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:52.821996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.821998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.821999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.822009Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:52.822012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:52.822016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:52.822052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.822053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.822055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.822058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:52.822059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:52.822103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:52.822110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.822116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.822121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.822129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:52.822140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255846680154424:10218]
2025-10-01T14:11:52.822143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255846680154424:10218]
2025-10-01T14:11:52.822145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255846680154424:10218]
2025-10-01T14:11:52.822153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:52.822160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:52.822163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:52.822165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:52.822174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035945:2916], now have 1 active actors on pipe
2025-10-01T14:11:52.822179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:52.822191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:52.822194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:52.822200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035865:2446], now have 1 active actors on pipe
2025-10-01T14:11:52.822187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1495
2025-10-01T14:11:52.822217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255846680154424:10218]
2025-10-01T14:11:52.822225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:52.822227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:52.822236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.822239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.822241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1495
2025-10-01T14:11:52.822269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89967c38-3dc22769-79840164-25493a32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:52.822282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.822286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.822288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:52.822295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.822301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:52.822317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.822431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.822441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.822454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.822534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1496 partition: 0 MaxSeqNo: 45 sessionId: src_id|89967c38-3dc22769-79840164-25493a32_0
2025-10-01T14:11:52.822950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cab631ab-90e0aef7-472c4c37-cdf7efdd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|89967c38-3dc22769-79840164-25493a32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:52.825355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89967c38-3dc22769-79840164-25493a32_0] Write session: try to update token
2025-10-01T14:11:52.825372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89967c38-3dc22769-79840164-25493a32_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:52.838353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1496 sessionId: src_id|89967c38-3dc22769-79840164-25493a32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:52.840691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:52.841011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.841035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.841053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:52.841056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:52.841058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:52.841059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:52.841065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255846680154424:10218]
2025-10-01T14:11:52.841068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255846680154424:10218]
2025-10-01T14:11:52.841070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255846680154424:10218]
2025-10-01T14:11:52.841109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:52.841115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:52.841115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:52.841118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:52.841121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.841122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:52.841242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:52.907833Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255849057035952:3745]
2025-10-01T14:11:52.908063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1495, pipe: [1:7556255849057035952:3745]
2025-10-01T14:11:52.976103Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:52.976427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:52.976566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:52.976641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255849057035952:3745]
2025-10-01T14:11:52.976661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:52.976680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:52.976686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:52.976751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1496 reason: error at write: Disconnected sessionId: src_id|89967c38-3dc22769-79840164-25493a32_0
2025-10-01T14:11:52.976478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035952:3745], now have 1 active actors on pipe
2025-10-01T14:11:52.976923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1496 sessionId: src_id|89967c38-3dc22769-79840164-25493a32_0 is DEAD
2025-10-01T14:11:52.977102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89967c38-3dc22769-79840164-25493a32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:52.977113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89967c38-3dc22769-79840164-25493a32_0] Write session will restart in 0.008805s
2025-10-01T14:11:52.977140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89967c38-3dc22769-79840164-25493a32_0] Write session: Do CDS request
2025-10-01T14:11:52.977150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89967c38-3dc22769-79840164-25493a32_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:52.984105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:52.985429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:52.985567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:52.985575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:52.985583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:52.985617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:52.985685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255846680154537:10230]
2025-10-01T14:11:52.986089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:52.986333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:52.986367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:52.986631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:52.986698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.986708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.986709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.986710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.986711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.986712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.986713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.986714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.986717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.986720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.986721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.986723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.986726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.986727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.986731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.986740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.986745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.986750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.986756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.986761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.986766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.986770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.986775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.986780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.986784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.986787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.986791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.986795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.986801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.986813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:52.986819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.986824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:52.986827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.986830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:52.986832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.986835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:52.986837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.986840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:52.986842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.986845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:52.986848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.986864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89967c38-3dc22769-79840164-25493a32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.986850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:52.986852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.986855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:52.986857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.986860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:52.986862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.986865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.986867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.986870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.986872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.986875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.986877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.986879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:52.986899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.986904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:52.986940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:52.986982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:52.986998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1497
2025-10-01T14:11:52.987117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:52.987148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1497 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:52.987157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1497 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:52.987160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:52.987454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1497 sessionId:  describe result for acl check
2025-10-01T14:11:52.987484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:52.987490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:52.987491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:52.987494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255849057036001:2909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:52.987856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255849057036001:2909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:52.989789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255849057036001:2909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:52.990309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:52.991287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:52.991299Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:52.991301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:52.991304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:52.991309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1496 [2:7556255846680154537:10230]
2025-10-01T14:11:52.991320Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:52.991333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:52.991335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.991337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.991338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.991348Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:52.991352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:52.991356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:52.991397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.991404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.991405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.991408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:52.991409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:52.991469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:52.991476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:52.991483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:52.991488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:52.991497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:52.991508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057035957:2446], now have 1 active actors on pipe
2025-10-01T14:11:52.991517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255846680154532:10230]
2025-10-01T14:11:52.991519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255846680154532:10230]
2025-10-01T14:11:52.991520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255846680154532:10230]
2025-10-01T14:11:52.991530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:52.991540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:52.991542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:52.991548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:52.991549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:52.991549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:52.991551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:52.991569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255846680154532:10230]
2025-10-01T14:11:52.991576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:52.991578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:52.991550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1496
2025-10-01T14:11:52.991825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255849057036001:2909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:52.991842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255849057036001:2909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:52.991845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255849057036001:2909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:52.991849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1497 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:52.991985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255849057036035:2909], now have 1 active actors on pipe
2025-10-01T14:11:52.991997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1496
2025-10-01T14:11:52.992019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.992029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.992056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:52.992066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:52.992070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:52.992076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:52.992082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:52.992089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:52.992103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.992213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:52.992218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:52.992227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:52.992289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1497 partition: 0 MaxSeqNo: 45 sessionId: src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0
2025-10-01T14:11:52.992565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89967c38-3dc22769-79840164-25493a32_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:52.994739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0] Write session: try to update token
2025-10-01T14:11:52.994752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:53.010071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1497 sessionId: src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:53.010701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:53.010721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:53.010723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:53.010724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:53.010734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255846680154532:10230]
2025-10-01T14:11:53.010737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255846680154532:10230]
2025-10-01T14:11:53.010740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255846680154532:10230]
2025-10-01T14:11:53.010786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:53.010788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:53.010790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:53.010792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:53.010796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.010798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:53.010967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:53.012609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:53.076777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255853352003336:3745]
2025-10-01T14:11:53.077003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1496, pipe: [1:7556255853352003336:3745]
2025-10-01T14:11:53.147079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:53.147387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.147399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.147434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003336:3745], now have 1 active actors on pipe
2025-10-01T14:11:53.147831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:53.147834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:53.147849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:53.147872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255853352003336:3745]
2025-10-01T14:11:53.147901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1497 reason: error at write: Disconnected sessionId: src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0
2025-10-01T14:11:53.148053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:53.148098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1497 sessionId: src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0 is DEAD
2025-10-01T14:11:53.148250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:53.148259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0] Write session will restart in 0.006952s
2025-10-01T14:11:53.148279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0] Write session: Do CDS request
2025-10-01T14:11:53.148284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:53.154149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:53.155367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:53.155513Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:53.155522Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:53.155533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:53.155578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:53.155615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255850975121912:10232]
2025-10-01T14:11:53.155924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.155938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:53.155952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1498
2025-10-01T14:11:53.156069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:53.156111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.156148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1498 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:53.156160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1498 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:53.156163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:53.156339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:53.156400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:53.156418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1498 sessionId:  describe result for acl check
2025-10-01T14:11:53.156445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:53.156450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:53.156451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:53.156454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255853352003382:2905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:53.156711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:53.156784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.156791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.156792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.156793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.156794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.156795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.156796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.156797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.156798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.156799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.156800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.156801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.156802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.156803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.156810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.156819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.156822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.156826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.156829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.156833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.156850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255853352003382:2905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:53.156837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.156840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.156844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.156848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.156852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.156856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.156859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.156862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.156869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.156876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.156882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.156888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.156892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.156897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.156901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.156905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.156909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.156914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.156918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.156922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.156934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.156938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.156948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.156952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.156961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.156965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.156969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.156978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.156983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.156992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.156996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.157006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.157010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.157016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.157023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.157029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.157075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:53.158722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255853352003382:2905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:53.160310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:53.160606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255853352003382:2905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:53.160618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255853352003382:2905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:53.160620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255853352003382:2905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:53.160625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1498 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:53.161043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:53.161054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:53.161055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:53.161059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:53.161064Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1497 [2:7556255850975121912:10232]
2025-10-01T14:11:53.161078Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:53.161091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:53.161096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.161099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.161100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.161109Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:53.161117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:53.161121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:53.161159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.161163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.161164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.161166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:53.161167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:53.161211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:53.161216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.161223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.161228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.161237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:53.161252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003419:2905], now have 1 active actors on pipe
2025-10-01T14:11:53.161257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003339:2446], now have 1 active actors on pipe
2025-10-01T14:11:53.161261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255850975121907:10232]
2025-10-01T14:11:53.161263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255850975121907:10232]
2025-10-01T14:11:53.161264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255850975121907:10232]
2025-10-01T14:11:53.161273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:53.161268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1497
2025-10-01T14:11:53.161281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:53.161290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:53.161293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:53.161295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:53.161299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:53.161300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:53.161283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1497
2025-10-01T14:11:53.161322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.161328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.161338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255850975121907:10232]
2025-10-01T14:11:53.161346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:53.161355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:53.161367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:53.161375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.161381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.161382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:53.161387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.161395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:53.161411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.161534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.161540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.161553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.161627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1498 partition: 0 MaxSeqNo: 45 sessionId: src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0
2025-10-01T14:11:53.161905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46ff3bd0-1200058d-363b1a7-f03926bb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:53.164229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0] Write session: try to update token
2025-10-01T14:11:53.164246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:53.176351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1498 sessionId: src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:53.178581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:53.180092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.180116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.180133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:53.180135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:53.180137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:53.180138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:53.180143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255850975121907:10232]
2025-10-01T14:11:53.180148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255850975121907:10232]
2025-10-01T14:11:53.180150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255850975121907:10232]
2025-10-01T14:11:53.180190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:53.180191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:53.180195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:53.180197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:53.180198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.180200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:53.180308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:53.248569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255853352003438:3745]
2025-10-01T14:11:53.250405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1497, pipe: [1:7556255853352003438:3745]
2025-10-01T14:11:53.327461Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:53.327779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:53.327828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003438:3745], now have 1 active actors on pipe
2025-10-01T14:11:53.329079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:53.329132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255853352003438:3745]
2025-10-01T14:11:53.329162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:53.329169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:53.329171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:53.329239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1498 reason: error at write: Disconnected sessionId: src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0
2025-10-01T14:11:53.329398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1498 sessionId: src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0 is DEAD
2025-10-01T14:11:53.330450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:53.330462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0] Write session will restart in 0.008050s
2025-10-01T14:11:53.330488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0] Write session: Do CDS request
2025-10-01T14:11:53.330496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:53.338994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:53.339932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.339976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:53.339991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1499
2025-10-01T14:11:53.340180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.340225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1499 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:53.340231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1499 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:53.340235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:53.340845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1499 sessionId:  describe result for acl check
2025-10-01T14:11:53.340881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:53.340888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:53.340890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:53.340895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255853352003485:2898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:53.340908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:53.341119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:53.341131Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:53.341143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:53.341200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:53.341244Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255850975121992:10234]
2025-10-01T14:11:53.341404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255853352003485:2898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:53.341886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:53.342133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:53.342180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:53.342497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:53.342567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.342574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.342575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.342576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.342577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.342578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.342579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.342580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.342581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.342582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.342583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.342584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.342585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.342586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.342592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.342601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.342607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.342611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.342614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.342618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.342621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.342624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.342628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.342632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.342635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.342638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.342642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.342645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.342651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.342658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.342664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.342669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.342673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.342678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.342682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.342687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.342691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.342696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.342700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.342705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.342714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.342719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.342722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.342727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.342739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.342748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.342752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.342758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.342785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.342790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.342795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.342800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.342805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.342812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.342816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.342826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.342868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:53.343453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255853352003485:2898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:53.346646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255853352003485:2898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:53.346663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255853352003485:2898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:53.346666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255853352003485:2898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:53.346674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1499 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:53.346826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:53.347507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:53.347524Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:53.347527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:53.347530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:53.347537Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1498 [2:7556255850975121992:10234]
2025-10-01T14:11:53.347638Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:53.347661Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:53.347664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.347668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.347670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.347688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:53.347699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:53.347706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:53.347776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.347784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.347785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.347788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:53.347790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:53.347859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:53.347867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.347879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.347890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.347906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:53.347929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003524:2898], now have 1 active actors on pipe
2025-10-01T14:11:53.347938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003441:2446], now have 1 active actors on pipe
2025-10-01T14:11:53.347945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255850975121986:10234]
2025-10-01T14:11:53.347948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255850975121986:10234]
2025-10-01T14:11:53.347950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255850975121986:10234]
2025-10-01T14:11:53.347962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:53.347975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:53.347975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:53.347978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:53.347980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:53.347995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:53.347998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:53.348042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.348050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.348063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255850975121986:10234]
2025-10-01T14:11:53.348070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:53.348076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:53.348100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:53.348112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.348121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.348123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:53.348132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.348146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:53.348168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.348348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.348355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.348369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.348807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c2a1765-c1f9a14b-42c6e08c-fdc8c651_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:53.347982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1498
2025-10-01T14:11:53.348008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1498
2025-10-01T14:11:53.348451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1499 partition: 0 MaxSeqNo: 45 sessionId: src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0
2025-10-01T14:11:53.351213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0] Write session: try to update token
2025-10-01T14:11:53.351229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:53.364085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1499 sessionId: src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:53.366359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:53.366573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.366597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.366640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:53.366684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:53.368352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:53.368380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:53.368382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:53.368385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:53.368395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255850975121986:10234]
2025-10-01T14:11:53.368400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255850975121986:10234]
2025-10-01T14:11:53.368404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255850975121986:10234]
2025-10-01T14:11:53.368442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:53.368448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:53.368454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:53.368456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.368458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:53.368458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:53.368579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:53.429040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255853352003536:3745]
2025-10-01T14:11:53.429354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1498, pipe: [1:7556255853352003536:3745]
2025-10-01T14:11:53.506084Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:53.512816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.512839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.512990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.513053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.513284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.513344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.513482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.513490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.513552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.513637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.513732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.513805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.513843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.513848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.513905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.513983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.514065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.514143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.514232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.514240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.514330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.514428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.514485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.514542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.514644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.514650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.514732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.514787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.514855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.514911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.514999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.515004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.515077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.515193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.515259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.515386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.515437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.515444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.515632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.515805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.515989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.516043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.516082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.516087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.516140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.516191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.516252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.516310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.516422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.516427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.516484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.516549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.516606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.516675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.516730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.516735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.516798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:53.516851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:53.516907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:53.516965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:53.517016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:53.517021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:53.517070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003536:3745], now have 1 active actors on pipe
2025-10-01T14:11:53.517241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:53.517256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:53.517259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:53.517282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1499 reason: error at write: Disconnected sessionId: src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0
2025-10-01T14:11:53.517302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255853352003536:3745]
2025-10-01T14:11:53.517432Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:53.517472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1499 sessionId: src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0 is DEAD
2025-10-01T14:11:53.517630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:53.517641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0] Write session will restart in 0.005126s
2025-10-01T14:11:53.517664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0] Write session: Do CDS request
2025-10-01T14:11:53.517670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:53.523758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.523871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:53.523885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1500
2025-10-01T14:11:53.523998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.524027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1500 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:53.524038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1500 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:53.524045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:53.524389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1500 sessionId:  describe result for acl check
2025-10-01T14:11:53.524417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:53.524421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:53.524423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:53.524425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255853352003584:2891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:53.524829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255853352003584:2891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:53.524820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:53.526259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:53.526433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:53.526443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:53.526453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:53.526492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:53.526522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255850975122073:10236]
2025-10-01T14:11:53.526770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255853352003584:2891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:53.526880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:53.527109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:53.527134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:53.527355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:53.527398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.527404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.527404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.527405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.527406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.527407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.527409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.527410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.527411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.527412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.527413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.527414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.527415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.527416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.527421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.527428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.527430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.527431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.527433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.527435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.527437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.527439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.527440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.527443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.527445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.527447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.527449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.527451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.527455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.527459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.527463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.527466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.527470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.527474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.527477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.527481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.527486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.527491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.527494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.527498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.527501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.527506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.527510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.527515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.527519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.527523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.527531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.527534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.527537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.527540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.527541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.527544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.527546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.527548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.527554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.527557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.527576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:53.530735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255853352003584:2891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:53.530753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255853352003584:2891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:53.530757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255853352003584:2891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:53.530767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1500 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:53.530858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:53.531489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:53.531501Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:53.531502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:53.531511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:53.531518Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1499 [2:7556255850975122073:10236]
2025-10-01T14:11:53.531526Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:53.531542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:53.531544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.531546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.531547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.531558Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:53.531565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:53.531569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:53.531615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.531621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.531622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.531626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:53.531628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:53.531689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:53.531696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.531706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.531715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.531734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:53.531754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003542:2446], now have 1 active actors on pipe
2025-10-01T14:11:53.531760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003623:2891], now have 1 active actors on pipe
2025-10-01T14:11:53.531767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255850975122068:10236]
2025-10-01T14:11:53.531768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255850975122068:10236]
2025-10-01T14:11:53.531770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255850975122068:10236]
2025-10-01T14:11:53.531783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:53.531792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:53.531794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:53.531795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:53.531798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:53.531784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1499
2025-10-01T14:11:53.531810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:53.531817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1499
2025-10-01T14:11:53.531815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:53.531851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255850975122068:10236]
2025-10-01T14:11:53.531859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:53.531863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:53.531869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.531874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.531903Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:53.531915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.531918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.531919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:53.531925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.531931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:53.531944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.532080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.532086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.532098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.532185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1500 partition: 0 MaxSeqNo: 45 sessionId: src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0
2025-10-01T14:11:53.532457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e6c4f5-af9a4db5-790ee279-607fa417_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:53.534986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0] Write session: try to update token
2025-10-01T14:11:53.535001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:53.549287Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1500 sessionId: src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:53.551565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:53.551764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.551786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.551803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:53.551808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:53.551810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:53.551812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:53.551818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255850975122068:10236]
2025-10-01T14:11:53.551824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255850975122068:10236]
2025-10-01T14:11:53.551828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255850975122068:10236]
2025-10-01T14:11:53.551860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:53.551864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:53.551869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:53.551874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:53.551879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.551880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:53.552007Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:53.617427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255853352003653:3745]
2025-10-01T14:11:53.617666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1499, pipe: [1:7556255853352003653:3745]
2025-10-01T14:11:53.693370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:53.693733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:53.693789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003653:3745], now have 1 active actors on pipe
2025-10-01T14:11:53.693870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:53.693917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:53.693967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255853352003653:3745]
2025-10-01T14:11:53.693969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:53.693972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:53.694035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1500 reason: error at write: Disconnected sessionId: src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0
2025-10-01T14:11:53.694228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1500 sessionId: src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0 is DEAD
2025-10-01T14:11:53.694398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:53.694406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0] Write session will restart in 0.007096s
2025-10-01T14:11:53.694430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0] Write session: Do CDS request
2025-10-01T14:11:53.694439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:53.701490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:53.702873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.702936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:53.702951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1501
2025-10-01T14:11:53.703091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.703124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1501 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:53.703131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1501 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:53.703134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:53.703172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:53.703341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:53.703348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:53.703358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:53.703395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:53.703424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1501 sessionId:  describe result for acl check
2025-10-01T14:11:53.703453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:53.703454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:53.703456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:53.703459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255853352003700:2871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:53.703481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255850975122165:5879]
2025-10-01T14:11:53.703849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:53.703876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255853352003700:2871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:53.704143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:53.704205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:53.704541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:53.704620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.704631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.704632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.704633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.704634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.704635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.704636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.704637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.704638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.704639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.704640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.704641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.704642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.704643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.704649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.704658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.704662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.704680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.704683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.704687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.704690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.704693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.704697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.704702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.704706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.704710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.704714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.704717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.704724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.704731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.704737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.704743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.704748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.704752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.704755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.704759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.704765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.704769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.704774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.704779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.704789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.704793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.704798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.704807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.704811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.704815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.704823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.704827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.704835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.704840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.704848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.704853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.704860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.704864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.704868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.704874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.704912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:53.705453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255853352003700:2871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:53.708134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255853352003700:2871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:53.708148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255853352003700:2871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:53.708151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255853352003700:2871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:53.708159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1501 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:53.708270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:53.708873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:53.708886Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:53.708889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:53.708894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:53.708900Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1500 [2:7556255850975122165:5879]
2025-10-01T14:11:53.708914Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:53.708931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:53.708934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.708938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.708940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.708955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:53.708965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:53.708970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:53.709016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.709022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.709025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.709028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:53.709030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:53.709093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:53.709099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.709110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.709121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.709140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:53.709160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003656:2446], now have 1 active actors on pipe
2025-10-01T14:11:53.709167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003739:2871], now have 1 active actors on pipe
2025-10-01T14:11:53.709174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255850975122160:5879]
2025-10-01T14:11:53.709179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255850975122160:5879]
2025-10-01T14:11:53.709181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255850975122160:5879]
2025-10-01T14:11:53.709194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:53.709190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1500
2025-10-01T14:11:53.709210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:53.709205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1500
2025-10-01T14:11:53.709212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:53.709215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:53.709217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:53.709226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:53.709228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:53.709272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.709279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.709292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255850975122160:5879]
2025-10-01T14:11:53.709303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:53.709313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:53.709336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:53.709346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.709351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.709354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:53.709365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.709375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:53.709398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.709534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.709545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.709563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.709629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1501 partition: 0 MaxSeqNo: 45 sessionId: src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0
2025-10-01T14:11:53.709939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88b6fccc-631caca6-e05f546b-1c8394d3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:53.712333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0] Write session: try to update token
2025-10-01T14:11:53.712348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:53.725679Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1501 sessionId: src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:53.728046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:53.729196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.729215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.729238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:53.729241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:53.729243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:53.729244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:53.729256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255850975122160:5879]
2025-10-01T14:11:53.729260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255850975122160:5879]
2025-10-01T14:11:53.729263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255850975122160:5879]
2025-10-01T14:11:53.729304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:53.729317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:53.729321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:53.729321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:53.729327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.729329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:53.729448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:53.794085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255853352003747:3745]
2025-10-01T14:11:53.794312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1500, pipe: [1:7556255853352003747:3745]
2025-10-01T14:11:53.870614Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:53.870863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:53.870911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003747:3745], now have 1 active actors on pipe
2025-10-01T14:11:53.870998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:53.871116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255853352003747:3745]
2025-10-01T14:11:53.871148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:53.871186Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:11:53.871435Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 15 consumer shared/user session shared/user_1_15_13077327908926673721_v1 is DEAD
2025-10-01T14:11:53.871540Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:11:53.871611Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255767452634176:3752] disconnected; active server actors: 1
2025-10-01T14:11:53.871620Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255767452634176:3752] client user disconnected session shared/user_1_15_13077327908926673721_v1
2025-10-01T14:11:53.871663Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:11:53.871666Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:11:53.871674Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.007773s
2025-10-01T14:11:53.878848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:53.879725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:53.879737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:53.879753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1501 reason: error at write: Disconnected sessionId: src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0
2025-10-01T14:11:53.879883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1501 sessionId: src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0 is DEAD
2025-10-01T14:11:53.880078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:53.880088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0] Write session will restart in 0.009611s
2025-10-01T14:11:53.880111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0] Write session: Do CDS request
2025-10-01T14:11:53.880117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:53.880747Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:11:53.880889Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:11:53.880900Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 16
2025-10-01T14:11:53.881181Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 16 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:11:53.881228Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:11:53.881289Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 auth for : user
2025-10-01T14:11:53.881423Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 Handle describe topics response
2025-10-01T14:11:53.881453Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 auth is DEAD
2025-10-01T14:11:53.881456Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:11:53.881613Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:11:53.881687Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_16_4227458134858331545_v1
2025-10-01T14:11:53.881695Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255853352003797:2867] connected; active server actors: 1
2025-10-01T14:11:53.881707Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255853352003797:2867] session shared/user_1_16_4227458134858331545_v1
2025-10-01T14:11:53.881720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:11:53.881733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:11:53.881741Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_16_4227458134858331545_v1" (Sender=[1:7556255853352003794:2867], Pipe=[1:7556255853352003797:2867], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:11:53.881744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:11:53.881753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:11:53.881766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_16_4227458134858331545_v1" (Sender=[1:7556255853352003794:2867], Pipe=[1:7556255853352003797:2867], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:11:53.881777Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_16_4227458134858331545_v1" sender [1:7556255853352003794:2867] lock partition 0 for ReadingSession "shared/user_1_16_4227458134858331545_v1" (Sender=[1:7556255853352003794:2867], Pipe=[1:7556255853352003797:2867], Partitions=[], ActiveFamilyCount=1) generation 1 step 16
2025-10-01T14:11:53.881786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:11:53.881792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-01T14:11:53.881992Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 16 Session: "shared/user_1_16_4227458134858331545_v1" ClientId: "user" PipeClient { RawX1: 7556255853352003797 RawX2: 4503603922340659 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:11:53.882015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:11:53.883851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:53.884069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:53.884082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:53.884094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:53.884156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:53.884257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255850975122263:5868]
2025-10-01T14:11:53.884838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:53.885180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:53.885236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:53.885552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:53.885622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.885629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.885630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.885631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.885633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.885634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.885635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.885636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.885637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.885638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.885639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.885640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.885641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.885642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.885652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.885662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.885666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.885670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.885674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.885678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.885682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.885685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.885690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.885693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.885698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.885702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.885706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.885709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.885715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.885723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:53.885729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.885734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:53.885738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.885743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:53.885748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.885753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:53.885757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.885766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:53.885770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.885775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:53.885781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.885792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:53.885796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.885801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:53.885807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.885812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:53.885816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.885821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.885827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.885832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.885837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.885843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.885847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.885853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:53.885859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.885865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:53.885911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:53.889762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:53.890461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:53.890480Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:53.890482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:53.890485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:53.890492Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1501 [2:7556255850975122263:5868]
2025-10-01T14:11:53.890507Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:53.890522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:53.890527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.890536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.890538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.890554Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:53.890562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:53.890568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:53.890624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.890631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.890633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.890635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:53.890638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:53.890702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:53.890710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.890722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:53.890731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:53.890751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:53.890773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003750:2446], now have 1 active actors on pipe
2025-10-01T14:11:53.890780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003800:2856], now have 1 active actors on pipe
2025-10-01T14:11:53.890787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255850975122256:5868]
2025-10-01T14:11:53.890789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255850975122256:5868]
2025-10-01T14:11:53.890791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255850975122256:5868]
2025-10-01T14:11:53.890803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:53.890810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:53.890814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:53.890816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:53.890820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:53.890835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:53.890841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:53.890848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1501
2025-10-01T14:11:53.890870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255850975122256:5868]
2025-10-01T14:11:53.890850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1501, pipe: [1:7556255853352003800:2856]
2025-10-01T14:11:53.890882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:53.890888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:53.890900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.890906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.890914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.890925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_16_4227458134858331545_v1 on pipe: [1:7556255853352003800:2856]
2025-10-01T14:11:53.890966Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_16_4227458134858331545_v1:1 with generation 1501
2025-10-01T14:11:53.890980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.890986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.890988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:53.890992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:53.891006Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_16_4227458134858331545_v1
2025-10-01T14:11:53.891001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1502
2025-10-01T14:11:53.891010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.891036Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:11:53.891108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:53.891140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1502 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:53.891149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1502 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:53.891154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:53.891498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1502 sessionId:  describe result for acl check
2025-10-01T14:11:53.891532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:53.891538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:53.891539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:53.891544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255853352003814:2862] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:53.892020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255853352003814:2862] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:53.893188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:11:53.893218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:11:53.893225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.893227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.893229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.893234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:11:53.893246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:11:53.893348Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327913890 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:11:53.893365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:11:53.893386Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 sending to client partition status
2025-10-01T14:11:53.893854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255853352003814:2862] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:53.899283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255853352003814:2862] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:53.899299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255853352003814:2862] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:53.899302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255853352003814:2862] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:53.899310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1502 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:53.899554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255853352003846:2862], now have 1 active actors on pipe
2025-10-01T14:11:53.899592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1501
2025-10-01T14:11:53.899673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.899689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.899718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a25fbafe-7316687a-dda5d3a-19177865_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:53.899732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:53.899743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:53.899752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:53.899764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:53.899783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:53.899803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.899963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:53.899976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:53.899993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:53.900065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1502 partition: 0 MaxSeqNo: 45 sessionId: src_id|a25fbafe-7316687a-dda5d3a-19177865_0
2025-10-01T14:11:53.900363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50438e7c-5cdd7031-5edf0d55-9e4437bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a25fbafe-7316687a-dda5d3a-19177865_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:53.902709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a25fbafe-7316687a-dda5d3a-19177865_0] Write session: try to update token
2025-10-01T14:11:53.902724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a25fbafe-7316687a-dda5d3a-19177865_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:53.909971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:53.909993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:53.909995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:53.909997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:53.910007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255850975122256:5868]
2025-10-01T14:11:53.910013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255850975122256:5868]
2025-10-01T14:11:53.910018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255850975122256:5868]
2025-10-01T14:11:53.910065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:53.910073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:53.910079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:53.910081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:53.910084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:53.910084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:53.910269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:53.915624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1502 sessionId: src_id|a25fbafe-7316687a-dda5d3a-19177865_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:53.918067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:54.052224Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:54.052471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.052482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.052650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_16_4227458134858331545_v1
2025-10-01T14:11:54.052677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:54.052686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:54.052711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:54.052715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:54.052709Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_16_4227458134858331545_v1
2025-10-01T14:11:54.052743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255853352003800:2856]
2025-10-01T14:11:54.052772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1502 reason: error at write: Disconnected sessionId: src_id|a25fbafe-7316687a-dda5d3a-19177865_0
2025-10-01T14:11:54.052968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1502 sessionId: src_id|a25fbafe-7316687a-dda5d3a-19177865_0 is DEAD
2025-10-01T14:11:54.053100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25fbafe-7316687a-dda5d3a-19177865_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:54.053110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25fbafe-7316687a-dda5d3a-19177865_0] Write session will restart in 0.008364s
2025-10-01T14:11:54.053133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25fbafe-7316687a-dda5d3a-19177865_0] Write session: Do CDS request
2025-10-01T14:11:54.053138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25fbafe-7316687a-dda5d3a-19177865_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:54.061106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:54.062826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:54.062926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a25fbafe-7316687a-dda5d3a-19177865_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.063047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:54.063060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:54.063041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:54.063072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:54.063060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1503
2025-10-01T14:11:54.063130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:54.063166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.063168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255855270089674:5852]
2025-10-01T14:11:54.063196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1503 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:54.063206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1503 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:54.063210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:54.063660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:54.063651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1503 sessionId:  describe result for acl check
2025-10-01T14:11:54.063690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:54.063696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:54.063697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:54.063702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255857646971194:2850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:54.063940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:54.063981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:54.064215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255857646971194:2850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:54.064244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:54.064304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.064310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.064311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.064312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.064313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.064314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.064315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.064316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.064317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.064318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.064319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.064320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.064321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.064322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.064327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.064335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.064339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.064342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.064345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.064349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.064352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.064355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.064358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.064362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.064366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.064369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.064373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.064378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.064383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.064390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.064395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.064400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.064404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.064408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.064412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.064417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.064422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.064428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.064432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.064437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.064442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.064446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.064451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.064456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.064461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.064466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.064470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.064476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.064485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.064490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.064498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.064502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.064513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.064518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.064526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.064530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.064571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:54.066130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255857646971194:2850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:54.068107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:54.068594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255857646971194:2850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:54.068607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255857646971194:2850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:54.068609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255857646971194:2850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:54.068618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1503 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:54.068827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:54.068842Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:54.068844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:54.068848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:54.068854Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1502 [2:7556255855270089674:5852]
2025-10-01T14:11:54.068869Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:54.068884Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:54.068891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.068894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.068896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.068911Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:54.068920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:54.068929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:54.068979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.068986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.068988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.068990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:54.068993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:54.069053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:54.069063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.069074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.069084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.069099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:54.069117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971233:2850], now have 1 active actors on pipe
2025-10-01T14:11:54.069124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971147:2446], now have 1 active actors on pipe
2025-10-01T14:11:54.069130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255855270089669:5852]
2025-10-01T14:11:54.069134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255855270089669:5852]
2025-10-01T14:11:54.069135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255855270089669:5852]
2025-10-01T14:11:54.069148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:54.069159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:54.069164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:54.069168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:54.069170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:54.069176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:54.069179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:54.069170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1502
2025-10-01T14:11:54.069174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1502
2025-10-01T14:11:54.069206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255855270089669:5852]
2025-10-01T14:11:54.069214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:54.069216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:54.069232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.069240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.069281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75d3b475-78112789-337cbd87-9498edd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:54.069292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.069296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.069298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:54.069306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.069317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:54.069337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.069489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.069498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.069512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.069594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1503 partition: 0 MaxSeqNo: 45 sessionId: src_id|75d3b475-78112789-337cbd87-9498edd0_0
2025-10-01T14:11:54.069953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a25fbafe-7316687a-dda5d3a-19177865_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|75d3b475-78112789-337cbd87-9498edd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:54.072283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75d3b475-78112789-337cbd87-9498edd0_0] Write session: try to update token
2025-10-01T14:11:54.072298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75d3b475-78112789-337cbd87-9498edd0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:54.085252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1503 sessionId: src_id|75d3b475-78112789-337cbd87-9498edd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:54.087605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:54.088923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.088949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.088968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:54.088971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:54.088974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:54.088976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:54.088984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255855270089669:5852]
2025-10-01T14:11:54.088989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255855270089669:5852]
2025-10-01T14:11:54.088998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255855270089669:5852]
2025-10-01T14:11:54.089030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:54.089040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:54.089043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:54.089052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:54.089059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.089061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:54.089189Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:54.153008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255857646971241:2856]
2025-10-01T14:11:54.153260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1502, pipe: [1:7556255857646971241:2856]
2025-10-01T14:11:54.224337Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:54.224561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:54.224615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971241:2856], now have 1 active actors on pipe
2025-10-01T14:11:54.224719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:54.224813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255857646971241:2856]
2025-10-01T14:11:54.224843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:54.232476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:54.234127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:54.234277Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:54.234285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:54.234293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:54.234323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:54.234351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255855270089759:5850]
2025-10-01T14:11:54.234743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:54.234956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:54.234982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:54.235179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:54.235213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.235217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.235218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.235218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.235219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.235220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.235220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.235221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.235221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.235222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.235223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.235223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.235224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.235224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.235228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.235233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.235235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.235237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.235239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.235241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.235243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.235245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.235247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.235256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:54.235271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:54.235293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1503 reason: error at write: Disconnected sessionId: src_id|75d3b475-78112789-337cbd87-9498edd0_0
2025-10-01T14:11:54.235249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.235251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.235253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.235255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.235257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.235262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.235266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.235271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.235274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.235277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.235279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.235281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.235284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.235287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.235290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.235292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.235294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.235297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.235299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.235301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.235305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.235307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.235310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.235312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.235315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.235317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.235320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.235322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.235325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.235327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.235329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.235332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.235335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.235355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:54.235459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1503 sessionId: src_id|75d3b475-78112789-337cbd87-9498edd0_0 is DEAD
2025-10-01T14:11:54.235595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d3b475-78112789-337cbd87-9498edd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:54.235607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d3b475-78112789-337cbd87-9498edd0_0] Write session will restart in 0.007339s
2025-10-01T14:11:54.235632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d3b475-78112789-337cbd87-9498edd0_0] Write session: Do CDS request
2025-10-01T14:11:54.235638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d3b475-78112789-337cbd87-9498edd0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:54.243941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75d3b475-78112789-337cbd87-9498edd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.244029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:54.244046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1504
2025-10-01T14:11:54.244187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.244217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1504 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:54.244226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1504 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:54.244229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:54.244362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:54.244572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1504 sessionId:  describe result for acl check
2025-10-01T14:11:54.244599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:54.244604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:54.244605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:54.244609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255857646971307:2845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:54.245016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:54.245030Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:54.245031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:54.245036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:54.245041Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1503 [2:7556255855270089759:5850]
2025-10-01T14:11:54.245052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:54.245066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:54.245069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.245072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.245074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.245090Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:54.245094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:54.245098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:54.245141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.245131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255857646971307:2845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:54.245148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.245149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.245151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:54.245153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:54.245216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:54.245223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.245231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.245236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.245255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:54.245276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971254:2446], now have 1 active actors on pipe
2025-10-01T14:11:54.245288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255855270089754:5850]
2025-10-01T14:11:54.245293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255855270089754:5850]
2025-10-01T14:11:54.245295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255855270089754:5850]
2025-10-01T14:11:54.245291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1503
2025-10-01T14:11:54.245311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:54.245320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:54.245322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:54.245327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:54.245330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:54.245347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:54.245353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:54.245393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255855270089754:5850]
2025-10-01T14:11:54.245404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:54.245412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:54.247749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255857646971307:2845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:54.254010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255857646971307:2845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:54.254029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255857646971307:2845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:54.254033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255857646971307:2845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:54.254041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1504 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:54.254277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971345:2845], now have 1 active actors on pipe
2025-10-01T14:11:54.254310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1503
2025-10-01T14:11:54.254396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.254409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.254448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:54.254465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.254473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.254475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:54.254487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.254507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:54.254531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.254687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.254696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.254708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.254780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1504 partition: 0 MaxSeqNo: 45 sessionId: src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0
2025-10-01T14:11:54.255111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75d3b475-78112789-337cbd87-9498edd0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:54.257325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0] Write session: try to update token
2025-10-01T14:11:54.257337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:54.261628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:54.261651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:54.261661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255855270089754:5850]
2025-10-01T14:11:54.261703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:54.261707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:54.261881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:54.262027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:54.262173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:54.262315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:54.262581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:54.262628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:54.270026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1504 sessionId: src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:54.272200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:54.272388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.272410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.272445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:54.272521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:54.274499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:54.274514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:54.274517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:54.274518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:54.274529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255855270089754:5850]
2025-10-01T14:11:54.274533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255855270089754:5850]
2025-10-01T14:11:54.274541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255855270089754:5850]
2025-10-01T14:11:54.274586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:54.274586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:54.274592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:54.274595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:54.274598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.274601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:54.274740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:54.325026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255857646971349:2856]
2025-10-01T14:11:54.325239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1503, pipe: [1:7556255857646971349:2856]
2025-10-01T14:11:54.410517Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:54.417232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.417256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.417393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.417447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.417504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.417563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.417847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.417855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.417914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.417967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.418028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.418098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.418138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.418143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.418197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.418250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.418304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.418356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.418412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.418419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.418481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.418541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.418595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.418660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.418699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.418704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.418759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.418810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.418861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.418923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.418963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.418968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.419024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.419074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.419159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.419217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.419265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.419270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.419326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.419377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.419460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.419530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.419569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.419574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.419626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.419677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.419737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.419820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.419859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.419865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.419921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.420001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.420081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.420140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.420180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.420185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.420241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.420328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.420399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.420453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.420491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.420496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.420531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971349:2856], now have 1 active actors on pipe
2025-10-01T14:11:54.420709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:54.420713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:54.420716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:54.420740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1504 reason: error at write: Disconnected sessionId: src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0
2025-10-01T14:11:54.420751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255857646971349:2856]
2025-10-01T14:11:54.420940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1504 sessionId: src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0 is DEAD
2025-10-01T14:11:54.421006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:54.421036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:54.421046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0] Write session will restart in 0.007870s
2025-10-01T14:11:54.421070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0] Write session: Do CDS request
2025-10-01T14:11:54.421076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:54.428070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:54.429113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:54.429233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:54.429240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:54.429247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:54.429275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:54.429302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255855270089846:5844]
2025-10-01T14:11:54.429681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:54.429876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:54.429883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.429902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:54.429953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:54.429968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1505
2025-10-01T14:11:54.430087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.430114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1505 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:54.430124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1505 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:54.430130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:54.430127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:54.430173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.430177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.430178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.430178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.430179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.430179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.430180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.430181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.430181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.430182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.430182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.430183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.430184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.430185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.430188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.430193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.430196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.430198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.430200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.430202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.430204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.430207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.430209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.430211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.430213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.430215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.430217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.430219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.430224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.430229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.430233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.430236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.430238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.430241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.430243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.430246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.430249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.430251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.430254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.430257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.430260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.430262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.430264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.430267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.430269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.430272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.430275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.430277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.430279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.430282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.430284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.430287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.430289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.430292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.430294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.430296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.430316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:54.430479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1505 sessionId:  describe result for acl check
2025-10-01T14:11:54.430518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:54.430526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:54.430528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:54.430532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255857646971409:2834] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:54.430950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255857646971409:2834] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:54.432972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255857646971409:2834] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:54.433829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:54.434569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:54.434589Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:54.434591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:54.434595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:54.434602Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1504 [2:7556255855270089846:5844]
2025-10-01T14:11:54.434619Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:54.434634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:54.434642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.434645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.434647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.434663Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:54.434675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:54.434684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:54.434741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.434753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.434754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.434758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:54.434761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:54.434832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:54.434840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.434852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.434867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.434886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:54.434908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971358:2446], now have 1 active actors on pipe
2025-10-01T14:11:54.434919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255855270089841:5844]
2025-10-01T14:11:54.434925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255855270089841:5844]
2025-10-01T14:11:54.434927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255855270089841:5844]
2025-10-01T14:11:54.434924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1504
2025-10-01T14:11:54.434940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:54.434957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:54.434966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:54.434969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:54.434969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:54.434972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:54.434973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:54.435004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255855270089841:5844]
2025-10-01T14:11:54.435011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:54.435022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:54.435205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255857646971409:2834] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:54.435218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255857646971409:2834] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:54.435221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255857646971409:2834] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:54.435228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1505 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:54.435402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971447:2834], now have 1 active actors on pipe
2025-10-01T14:11:54.435429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1504
2025-10-01T14:11:54.435475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.435484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.435506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c958975c-79d128b8-2db83629-1f946722_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:54.435519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.435525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.435527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:54.435534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.435546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:54.435560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.435668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.435676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.435685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.435734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1505 partition: 0 MaxSeqNo: 45 sessionId: src_id|c958975c-79d128b8-2db83629-1f946722_0
2025-10-01T14:11:54.436073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a136c5-c4c3cfac-6e383e0c-cd1a9231_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c958975c-79d128b8-2db83629-1f946722_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:54.438612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c958975c-79d128b8-2db83629-1f946722_0] Write session: try to update token
2025-10-01T14:11:54.438625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c958975c-79d128b8-2db83629-1f946722_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:54.445104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:54.445124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:54.445134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255855270089841:5844]
2025-10-01T14:11:54.445178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:54.445179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:54.445370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:54.445514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:54.445645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:54.445796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:54.445995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:54.446038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:54.451359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1505 sessionId: src_id|c958975c-79d128b8-2db83629-1f946722_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:54.453663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:54.453867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.453889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.453928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:54.454000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:54.463171Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:54.463190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:54.463192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:54.463194Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:54.463203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255855270089841:5844]
2025-10-01T14:11:54.463206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255855270089841:5844]
2025-10-01T14:11:54.463211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255855270089841:5844]
2025-10-01T14:11:54.463246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:54.463251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:54.463257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:54.463259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.463260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:54.463260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:54.463403Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:54.521097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255857646971456:2856]
2025-10-01T14:11:54.521308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1504, pipe: [1:7556255857646971456:2856]
2025-10-01T14:11:54.605425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:54.611956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.611979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.612106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.612162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.612217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.612267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.612601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.612611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.612679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.612736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.612786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.612841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.612880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.612885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.612943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.612995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.613048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.613109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.613147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.613152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.613211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.613271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.613325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.613381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.613421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.613431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.613499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.613557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.613618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.613677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.613737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.613743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.613826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.613888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.613949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.614009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.614051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.614058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.614122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.614177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.614241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.614306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.614361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.614381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.614440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.614495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.614554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.614612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.614654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.614660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.614724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.614786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.614845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.614922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.614966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.614972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.615036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.615094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.615185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.615243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.615298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.615306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.615356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971456:2856], now have 1 active actors on pipe
2025-10-01T14:11:54.615583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255857646971456:2856]
2025-10-01T14:11:54.615607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:54.615611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:54.615614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:54.615637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1505 reason: error at write: Disconnected sessionId: src_id|c958975c-79d128b8-2db83629-1f946722_0
2025-10-01T14:11:54.615862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1505 sessionId: src_id|c958975c-79d128b8-2db83629-1f946722_0 is DEAD
2025-10-01T14:11:54.615866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:54.616022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c958975c-79d128b8-2db83629-1f946722_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:54.616031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c958975c-79d128b8-2db83629-1f946722_0] Write session will restart in 0.005108s
2025-10-01T14:11:54.616056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c958975c-79d128b8-2db83629-1f946722_0] Write session: Do CDS request
2025-10-01T14:11:54.616063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c958975c-79d128b8-2db83629-1f946722_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:54.621918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c958975c-79d128b8-2db83629-1f946722_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.621942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:54.621957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1506
2025-10-01T14:11:54.622206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.622233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1506 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:54.622240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1506 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:54.622243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:54.622543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1506 sessionId:  describe result for acl check
2025-10-01T14:11:54.622567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:54.622573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:54.622575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:54.622592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255857646971524:2821] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:54.622957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255857646971524:2821] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:54.623820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:54.624751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255857646971524:2821] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:54.625046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:54.625208Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:54.625216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:54.625224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:54.625258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:54.625284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255855270089942:5842]
2025-10-01T14:11:54.625657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:54.625878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:54.625903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:54.626106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:54.626138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.626142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.626143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.626144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.626144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.626145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.626145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.626146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.626147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.626147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.626148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.626148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.626149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.626149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.626152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.626157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.626160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.626164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.626168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.626171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.626174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.626179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.626182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.626185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.626189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.626192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.626196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.626199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.626204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.626208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.626212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.626215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.626217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.626220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.626222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.626225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.626228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.626230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.626233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.626235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.626238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.626240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.626242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.626245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.626247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.626250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.626252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.626255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.626258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.626260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.626263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.626265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.626269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.626272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.626274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.626277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.626297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:54.629658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255857646971524:2821] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:54.629674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255857646971524:2821] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:54.629677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255857646971524:2821] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:54.629685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1506 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:54.629863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:54.630427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:54.630438Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:54.630440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:54.630442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:54.630448Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1505 [2:7556255855270089942:5842]
2025-10-01T14:11:54.630458Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:54.630470Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:54.630472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.630474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.630475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.630486Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:54.630493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:54.630497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:54.630534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.630538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.630540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.630542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:54.630544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:54.630590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:54.630596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.630602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.630607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.630616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:54.630631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255855270089937:5842]
2025-10-01T14:11:54.630635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255855270089937:5842]
2025-10-01T14:11:54.630636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255855270089937:5842]
2025-10-01T14:11:54.630642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:54.630651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:54.630650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:54.630654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:54.630655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:54.630662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:54.630663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:54.630671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971483:2446], now have 1 active actors on pipe
2025-10-01T14:11:54.630673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971569:2821], now have 1 active actors on pipe
2025-10-01T14:11:54.630690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255855270089937:5842]
2025-10-01T14:11:54.630697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:54.630709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:54.630743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1505
2025-10-01T14:11:54.630744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1505
2025-10-01T14:11:54.630801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.630809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.630827Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|235447d4-447262da-9e61af61-6ba15717_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:54.630835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.630838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.630839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:54.630844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.630850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:54.630864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.630989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.630994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.631003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.631089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1506 partition: 0 MaxSeqNo: 45 sessionId: src_id|235447d4-447262da-9e61af61-6ba15717_0
2025-10-01T14:11:54.631451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c958975c-79d128b8-2db83629-1f946722_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|235447d4-447262da-9e61af61-6ba15717_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:54.633571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|235447d4-447262da-9e61af61-6ba15717_0] Write session: try to update token
2025-10-01T14:11:54.633584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|235447d4-447262da-9e61af61-6ba15717_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:54.645512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1506 sessionId: src_id|235447d4-447262da-9e61af61-6ba15717_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:54.647765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:54.647958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.647975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.648010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:54.648057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:54.649752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:54.649766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:54.649770Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:54.649772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:54.649778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255855270089937:5842]
2025-10-01T14:11:54.649781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255855270089937:5842]
2025-10-01T14:11:54.649783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255855270089937:5842]
2025-10-01T14:11:54.649817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:54.649826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.649828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:54.649839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:54.649844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:54.649848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:54.649936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:54.715951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255857646971576:2856]
2025-10-01T14:11:54.716206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1505, pipe: [1:7556255857646971576:2856]
2025-10-01T14:11:54.781997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:54.788741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.788769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.788913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.788968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.789024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.789078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.789118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.789128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.789186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.789237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.789294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.789348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.789387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.789389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.789442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.789492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.789544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.789593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.789632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.789637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.789690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.789741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.789791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.789840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.789877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.789883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.789936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.789987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.790036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.790113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.790152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.790157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.790229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.790290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.790356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.790435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.790496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.790503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.790561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.790618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.790679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.790742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.790786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.790792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.790856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.790919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.790979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.791040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.791091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.791098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.791164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.791222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.791285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.791350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.791406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.791412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.791478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.791536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.791598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.791658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.791767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.791775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.791824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971576:2856], now have 1 active actors on pipe
2025-10-01T14:11:54.792087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:54.792128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255857646971576:2856]
2025-10-01T14:11:54.792228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:54.792239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:54.792257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1506 reason: error at write: Disconnected sessionId: src_id|235447d4-447262da-9e61af61-6ba15717_0
2025-10-01T14:11:54.792426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1506 sessionId: src_id|235447d4-447262da-9e61af61-6ba15717_0 is DEAD
2025-10-01T14:11:54.792573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235447d4-447262da-9e61af61-6ba15717_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:54.792586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235447d4-447262da-9e61af61-6ba15717_0] Write session will restart in 0.009915s
2025-10-01T14:11:54.792614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235447d4-447262da-9e61af61-6ba15717_0] Write session: Do CDS request
2025-10-01T14:11:54.792620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235447d4-447262da-9e61af61-6ba15717_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:54.792650Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:54.799417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:54.800759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:54.800878Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:54.800886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:54.800893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:54.800919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:54.800945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255855270090030:5838]
2025-10-01T14:11:54.801305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:54.801523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:54.801547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:54.801727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:54.801758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.801762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.801763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.801764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.801764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.801765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.801766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.801767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.801767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.801768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.801770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.801770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.801771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.801771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.801774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.801780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.801782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.801784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.801786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.801788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.801790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.801792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.801794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.801796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.801798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.801800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.801802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.801804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.801808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.801812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:54.801815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.801818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:54.801820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.801823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:54.801826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.801829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:54.801831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.801834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:54.801836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.801838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:54.801841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.801845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:54.801847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.801849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:54.801852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.801854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:54.801856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.801859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.801861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.801863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.801865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.801868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.801871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.801874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:54.801876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.801878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:54.801899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:54.803883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|235447d4-447262da-9e61af61-6ba15717_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.803969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:54.803983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1507
2025-10-01T14:11:54.804075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.804102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1507 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:54.804106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1507 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:54.804109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:54.804387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1507 sessionId:  describe result for acl check
2025-10-01T14:11:54.804410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:54.804411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:54.804412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:54.804416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255857646971634:2815] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:54.804773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255857646971634:2815] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:54.805279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:54.805827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:54.805838Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:54.805840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:54.805842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:54.805847Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1506 [2:7556255855270090030:5838]
2025-10-01T14:11:54.805856Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:54.805868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:54.805870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.805872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.805873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.805883Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:54.805886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:54.805891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:54.805927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.805932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.805934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.805936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:54.805938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:54.805995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:54.806001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.806007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:54.806013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:54.806025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:54.806040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971578:2446], now have 1 active actors on pipe
2025-10-01T14:11:54.806048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255855270090025:5838]
2025-10-01T14:11:54.806050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255855270090025:5838]
2025-10-01T14:11:54.806051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255855270090025:5838]
2025-10-01T14:11:54.806060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:54.806071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:54.806072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:54.806075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:54.806077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:54.806081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:54.806083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:54.806101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255855270090025:5838]
2025-10-01T14:11:54.806106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:54.806109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:54.806087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1506
2025-10-01T14:11:54.806509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255857646971634:2815] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:54.811862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255857646971634:2815] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:54.811877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255857646971634:2815] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:54.811880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255857646971634:2815] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:54.811888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1507 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:54.812084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971672:2815], now have 1 active actors on pipe
2025-10-01T14:11:54.812138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1506
2025-10-01T14:11:54.812182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.812192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.812213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:54.812231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:54.812237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:54.812240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:54.812248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:54.812261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:54.812273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.812430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.812441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.812458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:54.812555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1507 partition: 0 MaxSeqNo: 45 sessionId: src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0
2025-10-01T14:11:54.812886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|235447d4-447262da-9e61af61-6ba15717_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:54.815244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0] Write session: try to update token
2025-10-01T14:11:54.815260Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:54.815727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:54.815743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:54.815749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255855270090025:5838]
2025-10-01T14:11:54.815778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:54.815782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:54.815929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:54.816042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:54.816162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:54.816279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:54.816433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:54.816460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:54.827919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1507 sessionId: src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:54.830124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:54.830514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.830533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.830564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:54.830637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:54.833518Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:54.833535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:54.833536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:54.833538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:54.833545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255855270090025:5838]
2025-10-01T14:11:54.833550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255855270090025:5838]
2025-10-01T14:11:54.833552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255855270090025:5838]
2025-10-01T14:11:54.833585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:54.833593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:54.833593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:54.833598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:54.833598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:54.833600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:54.833704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:54.892307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255857646971677:2856]
2025-10-01T14:11:54.892515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1506, pipe: [1:7556255857646971677:2856]
2025-10-01T14:11:54.972401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:54.982243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:54.982276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:54.982485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.982562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.982641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.982724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.982776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.982788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.982866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.982944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.983020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.983097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.983148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.983159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.983241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.983314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.983394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.983463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.983509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.983513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.983599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.983672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.983750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.983825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.983872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.983876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.983953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.984021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.984095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.984167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.984210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.984213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.984284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.984344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.984450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.984516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.984561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.984567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.984637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.984714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.984782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.984853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.984897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.984900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.984971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.985030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.985100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.985165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.985207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.985210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.985281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.985344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.985409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.985474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.985517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.985521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.985593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:54.985654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:54.985722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:54.985787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:54.985829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:54.985832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:54.985901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971677:2856], now have 1 active actors on pipe
2025-10-01T14:11:54.986235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:54.986247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255857646971677:2856]
2025-10-01T14:11:54.986252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:54.986275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:54.986278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1507 reason: error at write: Disconnected sessionId: src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0
2025-10-01T14:11:54.986496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1507 sessionId: src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0 is DEAD
2025-10-01T14:11:54.986900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:54.986912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0] Write session will restart in 0.006081s
2025-10-01T14:11:54.986938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0] Write session: Do CDS request
2025-10-01T14:11:54.986946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:54.987417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:54.993942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.994100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:54.994121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1508
2025-10-01T14:11:54.994281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:54.994327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1508 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:54.994338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1508 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:54.994342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:54.994797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1508 sessionId:  describe result for acl check
2025-10-01T14:11:54.994830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:54.994838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:54.994841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:54.994845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255857646971693:2810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:54.995407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255857646971693:2810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:54.997467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255857646971693:2810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:55.000307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255857646971693:2810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:55.000325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255857646971693:2810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:55.000329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255857646971693:2810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:55.000338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1508 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:55.000778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:55.002631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:55.002884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:55.002895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:55.002909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:55.002971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:55.003015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255859565057459:5821]
2025-10-01T14:11:55.003705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:55.004061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:55.004114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:55.004507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:55.004589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.004597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.004599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.004600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.004601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.004603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.004604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.004605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.004607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.004609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.004610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.004612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.004613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.004614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.004621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.004632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.004636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.004641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.004648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.004651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.004656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.004660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.004677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.004682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.004687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.004691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.004695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.004700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.004710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.004719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.004728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.004741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.004747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.004753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.004763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.004769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.004775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.004787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.004792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.004803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.004808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.004815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.004824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.004830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.004835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.004845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.004850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.004856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.004868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.004874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.004879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.004890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.004897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.004904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.004909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.004914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.004959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:55.009346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:55.010017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:55.010036Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:55.010039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:55.010044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:55.010052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1507 [2:7556255859565057459:5821]
2025-10-01T14:11:55.010069Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:55.010089Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:55.010092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.010096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.010098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.010116Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:55.010122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:55.010128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:55.010199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.010213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.010215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.010219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:55.010221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:55.010299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:55.010310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.010323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.010333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.010348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:55.010387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255859565057454:5821]
2025-10-01T14:11:55.010395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255859565057454:5821]
2025-10-01T14:11:55.010397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255859565057454:5821]
2025-10-01T14:11:55.010408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:55.010418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:55.010421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:55.010424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:55.010425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:55.010439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:55.010442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:55.010455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255857646971682:2446], now have 1 active actors on pipe
2025-10-01T14:11:55.010458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939058:2810], now have 1 active actors on pipe
2025-10-01T14:11:55.010494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255859565057454:5821]
2025-10-01T14:11:55.010502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:55.010820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1507
2025-10-01T14:11:55.010881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1507
2025-10-01T14:11:55.010922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:55.011081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.011094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.011121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:55.011134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.011139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.011141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:55.011152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.011165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:55.011183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.011418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.011427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.011442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.021382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1508 partition: 0 MaxSeqNo: 45 sessionId: src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0
2025-10-01T14:11:55.021785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46ff68c-7de6fbfd-1b92d795-a7181b35_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:55.024340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0] Write session: try to update token
2025-10-01T14:11:55.024357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:55.032790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:55.032815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:55.032817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:55.032819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:55.032830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255859565057454:5821]
2025-10-01T14:11:55.032835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255859565057454:5821]
2025-10-01T14:11:55.032838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255859565057454:5821]
2025-10-01T14:11:55.032878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:55.032888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:55.032890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:55.032893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:55.032894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.032897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:55.033032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:55.037507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1508 sessionId: src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:55.040176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:55.086380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255861941939073:2856]
2025-10-01T14:11:55.086537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1507, pipe: [1:7556255861941939073:2856]
2025-10-01T14:11:55.186753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:55.187105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.187120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.187156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939073:2856], now have 1 active actors on pipe
2025-10-01T14:11:55.187300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:55.187314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:55.187333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:55.187365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1508 reason: error at write: Disconnected sessionId: src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0
2025-10-01T14:11:55.187400Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:55.187445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255861941939073:2856]
2025-10-01T14:11:55.187535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1508 sessionId: src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0 is DEAD
2025-10-01T14:11:55.187671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:55.187688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0] Write session will restart in 0.005505s
2025-10-01T14:11:55.187714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0] Write session: Do CDS request
2025-10-01T14:11:55.187720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:55.193928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.194023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:55.194042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1509
2025-10-01T14:11:55.194162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.194192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1509 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:55.194202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1509 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:55.194205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:55.194577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1509 sessionId:  describe result for acl check
2025-10-01T14:11:55.194603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:55.194608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:55.194609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:55.194612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255861941939140:2804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:55.195036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255861941939140:2804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:55.195566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:55.196576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255861941939140:2804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:55.197607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:55.197792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:55.197803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:55.197814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:55.197861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:55.197901Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255859565057549:5815]
2025-10-01T14:11:55.198402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:55.198688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:55.198728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:55.198957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:55.199002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.199007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.199008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.199009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.199010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.199011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.199013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.199014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.199017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.199018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.199019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.199020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.199020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.199021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.199026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.199035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.199038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.199042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.199045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.199048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.199052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.199043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255861941939140:2804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:55.199064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.199055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255861941939140:2804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:55.199058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255861941939140:2804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:55.199065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1509 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:55.199080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.199091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.199095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.199098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.199102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.199105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.199111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.199118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.199123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.199127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.199137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.199142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.199149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.199153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.199158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.199162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.199166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.199174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.199178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.199182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.199190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.199195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.199203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.199207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.199214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.199219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.199223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.199231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.199235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.199243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.199248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.199253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.199260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.199265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.199294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:55.202848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:55.203391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:55.203401Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:55.203402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:55.203405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:55.203410Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1508 [2:7556255859565057549:5815]
2025-10-01T14:11:55.203421Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:55.203436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:55.203438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.203445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.203446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.203458Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:55.203466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:55.203474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:55.203512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.203517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.203518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.203520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:55.203522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:55.203575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:55.203585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.203596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.203605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.203619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:55.203635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939091:2446], now have 1 active actors on pipe
2025-10-01T14:11:55.203638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939181:2804], now have 1 active actors on pipe
2025-10-01T14:11:55.203644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255859565057544:5815]
2025-10-01T14:11:55.203646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255859565057544:5815]
2025-10-01T14:11:55.203648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255859565057544:5815]
2025-10-01T14:11:55.203657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:55.203666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:55.203672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:55.203674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:55.203675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:55.203676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1508
2025-10-01T14:11:55.203678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:55.203680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:55.203702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255859565057544:5815]
2025-10-01T14:11:55.203689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1508
2025-10-01T14:11:55.203704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:55.203705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:55.203719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.203723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.203771Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a484bbce-1d443f6e-be43cb91-db071fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:55.203784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.203788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.203790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:55.203800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.203808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:55.203830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.203942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.203947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.203956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.204015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1509 partition: 0 MaxSeqNo: 45 sessionId: src_id|a484bbce-1d443f6e-be43cb91-db071fa_0
2025-10-01T14:11:55.204378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57184fe7-b312ab96-cc6dab6f-8dee56c1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a484bbce-1d443f6e-be43cb91-db071fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:55.206713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a484bbce-1d443f6e-be43cb91-db071fa_0] Write session: try to update token
2025-10-01T14:11:55.206730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a484bbce-1d443f6e-be43cb91-db071fa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:55.219468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1509 sessionId: src_id|a484bbce-1d443f6e-be43cb91-db071fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:55.221872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:55.221998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.222021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.224075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:55.224093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:55.224095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:55.224097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:55.224106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255859565057544:5815]
2025-10-01T14:11:55.224110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255859565057544:5815]
2025-10-01T14:11:55.224115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255859565057544:5815]
2025-10-01T14:11:55.224165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:55.224168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:55.224174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:55.224178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:55.224183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:55.224189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.224192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:55.224273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:55.224328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:55.287626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255861941939190:2856]
2025-10-01T14:11:55.287881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1508, pipe: [1:7556255861941939190:2856]
2025-10-01T14:11:55.360361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:55.367055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.367084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.367231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.367284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.367343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.367398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.367437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.367448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.367520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.367575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.367634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.367689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.367730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.367738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.367791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.367838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.367887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.367934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.367973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.367982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.368042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.368094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.368148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.368195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.368289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.368296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.368346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.368392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.368440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.368487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.368531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.368539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.368593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.368646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.368709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.368767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.368805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.368810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.368864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.368917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.368990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.369047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.369087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.369092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.369150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.369279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.369331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.369382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.369420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.369425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.369494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.369552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.369603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.369664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.369705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.369709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.369764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.369813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.369886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.369938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.370126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.370134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.370183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939190:2856], now have 1 active actors on pipe
2025-10-01T14:11:55.370475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:55.370480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255861941939190:2856]
2025-10-01T14:11:55.370508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:55.370512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:55.370552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1509 reason: error at write: Disconnected sessionId: src_id|a484bbce-1d443f6e-be43cb91-db071fa_0
2025-10-01T14:11:55.370769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1509 sessionId: src_id|a484bbce-1d443f6e-be43cb91-db071fa_0 is DEAD
2025-10-01T14:11:55.370905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484bbce-1d443f6e-be43cb91-db071fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:55.370917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484bbce-1d443f6e-be43cb91-db071fa_0] Write session will restart in 0.008800s
2025-10-01T14:11:55.370942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484bbce-1d443f6e-be43cb91-db071fa_0] Write session: Do CDS request
2025-10-01T14:11:55.370961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484bbce-1d443f6e-be43cb91-db071fa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:55.370988Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:55.380798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:55.380957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a484bbce-1d443f6e-be43cb91-db071fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.381061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:55.381079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1510
2025-10-01T14:11:55.381192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.381224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1510 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:55.381235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1510 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:55.381238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:55.381291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:55.381446Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:55.381455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:55.381463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:55.381496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:55.381526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255859565057642:5810]
2025-10-01T14:11:55.381646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1510 sessionId:  describe result for acl check
2025-10-01T14:11:55.381682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:55.381689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:55.381691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:55.381696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255861941939245:2799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:55.381954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:55.382190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:55.382196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255861941939245:2799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:55.382217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:55.382453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:55.382502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.382506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.382507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.382508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.382509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.382509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.382510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.382511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.382511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.382512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.382512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.382513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.382514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.382514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.382518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.382523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.382526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.382528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.382530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.382532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.382534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.382536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.382539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.382541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.382543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.382545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.382548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.382550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.382554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.382559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.382562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.382565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.382568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.382571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.382573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.382575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.382579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.382582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.382584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.382586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.382589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.382592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.382594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.382596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.382599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.382602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.382604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.382606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.382609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.382611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.382614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.382616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.382618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.382621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.382623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.382626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.382646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:55.384982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255861941939245:2799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:55.386037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:55.386620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:55.386631Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:55.386632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:55.386635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:55.386640Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1509 [2:7556255859565057642:5810]
2025-10-01T14:11:55.386651Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:55.386664Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:55.386666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.386668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.386669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.386681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:55.386685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:55.386689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:55.386728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.386734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.386736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.386738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:55.386740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:55.386811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:55.386819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.386831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.386841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.386860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:55.386879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939193:2446], now have 1 active actors on pipe
2025-10-01T14:11:55.386889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255859565057637:5810]
2025-10-01T14:11:55.386892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255859565057637:5810]
2025-10-01T14:11:55.386893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255859565057637:5810]
2025-10-01T14:11:55.386904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:55.386915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:55.386919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:55.386922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:55.386924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:55.386932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:55.386934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:55.386925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1509
2025-10-01T14:11:55.386960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255859565057637:5810]
2025-10-01T14:11:55.386970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:55.386976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:55.387549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255861941939245:2799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:55.387564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255861941939245:2799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:55.387567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255861941939245:2799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:55.387575Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1510 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:55.387741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939285:2799], now have 1 active actors on pipe
2025-10-01T14:11:55.387777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1509
2025-10-01T14:11:55.387820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.387829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.387849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67a1003a-2e265650-2157cee6-7f513e69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:55.387859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.387862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.387863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:55.387870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.387878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:55.387891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.388093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.388102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.388116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.388188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1510 partition: 0 MaxSeqNo: 45 sessionId: src_id|67a1003a-2e265650-2157cee6-7f513e69_0
2025-10-01T14:11:55.388574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484bbce-1d443f6e-be43cb91-db071fa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67a1003a-2e265650-2157cee6-7f513e69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:55.391175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a1003a-2e265650-2157cee6-7f513e69_0] Write session: try to update token
2025-10-01T14:11:55.391195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a1003a-2e265650-2157cee6-7f513e69_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:55.402853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:55.402877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:55.402887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255859565057637:5810]
2025-10-01T14:11:55.402934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:55.402943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:55.403085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:55.403214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:55.403334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:55.403470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:55.403642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:55.403677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:55.406306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1510 sessionId: src_id|67a1003a-2e265650-2157cee6-7f513e69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:55.408722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:55.409348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.409370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.409399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:55.409491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:55.415530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:55.415550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:55.415551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:55.415553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:55.415562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255859565057637:5810]
2025-10-01T14:11:55.415565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255859565057637:5810]
2025-10-01T14:11:55.415568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255859565057637:5810]
2025-10-01T14:11:55.415604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:55.415610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.415612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:55.415626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:55.415631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:55.415634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:55.415725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:55.470864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255861941939300:2856]
2025-10-01T14:11:55.471138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1509, pipe: [1:7556255861941939300:2856]
2025-10-01T14:11:55.555722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:55.562345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.562390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.562532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.562586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.562644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.562694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.562737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.562745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.562801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.562852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.562905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.562956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.562995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.563002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.563057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.563117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.563183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.563251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.563295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.563301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.563365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.563419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.563473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.563526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.563566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.563571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.563626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.563681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.563732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.563784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.563821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.563827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.563881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.563932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.563987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.564041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.564081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.564087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.564142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.564193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.564248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.564302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.564342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.564347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.564402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.564454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.564508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.564565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.564621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.564626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.564693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.564745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.564797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.564851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.564889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.564894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.564947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.564997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.565051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.565104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.565144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.565152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.565198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939300:2856], now have 1 active actors on pipe
2025-10-01T14:11:55.565422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255861941939300:2856]
2025-10-01T14:11:55.565440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:55.565445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:55.565453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:55.565472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1510 reason: error at write: Disconnected sessionId: src_id|67a1003a-2e265650-2157cee6-7f513e69_0
2025-10-01T14:11:55.565651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1510 sessionId: src_id|67a1003a-2e265650-2157cee6-7f513e69_0 is DEAD
2025-10-01T14:11:55.565752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a1003a-2e265650-2157cee6-7f513e69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:55.565761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a1003a-2e265650-2157cee6-7f513e69_0] Write session will restart in 0.007492s
2025-10-01T14:11:55.565781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a1003a-2e265650-2157cee6-7f513e69_0] Write session: Do CDS request
2025-10-01T14:11:55.565786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a1003a-2e265650-2157cee6-7f513e69_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:55.565942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:55.574834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67a1003a-2e265650-2157cee6-7f513e69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.574941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:55.574931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:55.574951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1511
2025-10-01T14:11:55.575070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.575114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1511 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:55.575129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1511 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:55.575136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:55.575542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1511 sessionId:  describe result for acl check
2025-10-01T14:11:55.575577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:55.575582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:55.575584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:55.575590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255861941939356:2785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:55.576106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255861941939356:2785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:55.576412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:55.576577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:55.576586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:55.576593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:55.576627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:55.576655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255859565057736:5806]
2025-10-01T14:11:55.577080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:55.577314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:55.577357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:55.577599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:55.577637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.577642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.577643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.577643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.577644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.577644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.577645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.577646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.577647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.577648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.577648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.577649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.577649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.577650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.577653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.577658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.577661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.577663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.577665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.577667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.577669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.577671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.577673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.577676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.577678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.577680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.577682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.577684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.577689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.577693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.577697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.577699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.577702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.577704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.577711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.577714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.577717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.577719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.577724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.577727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.577729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.577735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.577738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.577740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.577743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.577745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.577748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.577753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.577756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.577758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.577764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.577767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.577769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.577772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.577777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.577779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.577799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:55.578585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255861941939356:2785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:55.581093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255861941939356:2785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:55.581108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255861941939356:2785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:55.581111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255861941939356:2785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:55.581119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1511 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:55.581194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:55.581736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:55.581750Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:55.581755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:55.581759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:55.581765Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1510 [2:7556255859565057736:5806]
2025-10-01T14:11:55.581779Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:55.581796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:55.581805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.581808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.581810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.581824Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:55.581829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:55.581835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:55.581886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.581892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.581894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.581897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:55.581899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:55.581963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:55.581970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.581980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.581990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.582004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:55.582025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939302:2446], now have 1 active actors on pipe
2025-10-01T14:11:55.582032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939395:2785], now have 1 active actors on pipe
2025-10-01T14:11:55.582038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255859565057731:5806]
2025-10-01T14:11:55.582040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255859565057731:5806]
2025-10-01T14:11:55.582041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255859565057731:5806]
2025-10-01T14:11:55.582054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:55.582066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:55.582071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:55.582074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:55.582077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:55.582082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:55.582085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:55.582071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1510
2025-10-01T14:11:55.582082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1510
2025-10-01T14:11:55.582107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255859565057731:5806]
2025-10-01T14:11:55.582114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:55.582116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:55.582132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.582141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.582179Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:55.582188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.582192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.582193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:55.582201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.582212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:55.582230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.582366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.582390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.582402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.582483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1511 partition: 0 MaxSeqNo: 45 sessionId: src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0
2025-10-01T14:11:55.582820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67a1003a-2e265650-2157cee6-7f513e69_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:55.585078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0] Write session: try to update token
2025-10-01T14:11:55.585096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:55.598632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1511 sessionId: src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:55.600815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:55.601690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.601719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.601741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:55.601744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:55.601746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:55.601750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:55.601758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255859565057731:5806]
2025-10-01T14:11:55.601761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255859565057731:5806]
2025-10-01T14:11:55.601768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255859565057731:5806]
2025-10-01T14:11:55.601800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:55.601812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:55.601814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:55.601819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:55.601826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.601828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:55.602159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:55.665442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255861941939425:2856]
2025-10-01T14:11:55.665704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1510, pipe: [1:7556255861941939425:2856]
2025-10-01T14:11:55.740553Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:55.740760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:55.740806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939425:2856], now have 1 active actors on pipe
2025-10-01T14:11:55.740900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:55.740947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255861941939425:2856]
2025-10-01T14:11:55.740965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:55.740985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:55.740992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:55.741058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1511 reason: error at write: Disconnected sessionId: src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0
2025-10-01T14:11:55.741207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1511 sessionId: src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0 is DEAD
2025-10-01T14:11:55.741326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:55.741337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0] Write session will restart in 0.006315s
2025-10-01T14:11:55.741356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0] Write session: Do CDS request
2025-10-01T14:11:55.741363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:55.748633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:55.748865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.748931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:55.748945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1512
2025-10-01T14:11:55.749050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.749079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1512 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:55.749088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1512 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:55.749091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:55.749418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1512 sessionId:  describe result for acl check
2025-10-01T14:11:55.749446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:55.749451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:55.749452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:55.749456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255861941939482:2774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:55.749836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255861941939482:2774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:55.750052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:55.750186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:55.750193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:55.750204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:55.750245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:55.750278Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255859565057836:5803]
2025-10-01T14:11:55.750834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:55.751058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:55.751088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:55.751305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:55.751345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.751349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.751350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.751350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.751351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.751351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.751352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.751353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.751354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.751354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.751355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.751355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.751356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.751356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.751361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.751369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.751373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.751377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.751380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.751384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.751388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.751392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.751397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.751401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.751404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.751407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.751411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.751414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.751420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.751426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.751432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.751437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.751442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.751447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.751455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.751439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255861941939482:2774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:55.751460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.751466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.751469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.751471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.751474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.751476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.751479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.751481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.751484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.751487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.751490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.751493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.751495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.751497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.751501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.751505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.751513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.751522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.751531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.751535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.751543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.751578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:55.754559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255861941939482:2774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:55.754572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255861941939482:2774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:55.754576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255861941939482:2774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:55.754582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1512 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:55.754749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:55.755356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:55.755371Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:55.755373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:55.755375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:55.755379Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1511 [2:7556255859565057836:5803]
2025-10-01T14:11:55.755388Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:55.755398Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:55.755403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.755405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.755407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.755418Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:55.755424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:55.755427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:55.755461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.755467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.755469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.755472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:55.755475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:55.755525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:55.755531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.755537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.755542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.755553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:55.755567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255859565057831:5803]
2025-10-01T14:11:55.755568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255859565057831:5803]
2025-10-01T14:11:55.755569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255859565057831:5803]
2025-10-01T14:11:55.755575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:55.755581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:55.755583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:55.755590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:55.755592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:55.755592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:55.755593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:55.755600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939521:2774], now have 1 active actors on pipe
2025-10-01T14:11:55.755604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939426:2446], now have 1 active actors on pipe
2025-10-01T14:11:55.755620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255859565057831:5803]
2025-10-01T14:11:55.755631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:55.755649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:55.755651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1511
2025-10-01T14:11:55.755749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1511
2025-10-01T14:11:55.755796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.755805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.755820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:55.755825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.755828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.755830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:55.755836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.755845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:55.755858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.755987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.755992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.756002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.756064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1512 partition: 0 MaxSeqNo: 45 sessionId: src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0
2025-10-01T14:11:55.756315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b47e4d12-198a31c8-7362a9db-25f50f98_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:55.758668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0] Write session: try to update token
2025-10-01T14:11:55.758682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:55.766094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:55.766118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:55.766131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255859565057831:5803]
2025-10-01T14:11:55.766179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:55.766191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:55.766493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:55.766660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:55.766829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:55.766968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:55.767154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:55.767192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:55.771013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1512 sessionId: src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:55.773222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:55.773560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.773576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.773609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:55.773689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:55.784206Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:55.784221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:55.784223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:55.784225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:55.784236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255859565057831:5803]
2025-10-01T14:11:55.784240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255859565057831:5803]
2025-10-01T14:11:55.784244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255859565057831:5803]
2025-10-01T14:11:55.784277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:55.784281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:55.784285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:55.784289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:55.784295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.784297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:55.784440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:55.841059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255861941939531:2856]
2025-10-01T14:11:55.841303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1511, pipe: [1:7556255861941939531:2856]
2025-10-01T14:11:55.921804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:55.928205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.928226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.928359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.928410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.928466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.928518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.928563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.928570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.928627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.928694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.928749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.928802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.928840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.928844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.928896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.928944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.929006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.929072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.929120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.929125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.929182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.929230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.929281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.929332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.929369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.929374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.929426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.929472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.929522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.929575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.929613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.929618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.929679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.929732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.929785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.929837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.929875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.929879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.929936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.929987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.930042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.930092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.930129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.930134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.930189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.930237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.930286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.930334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.930447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.930454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.930508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.930557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.930607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.930661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.930703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.930710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.930771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:55.930825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:55.930876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:55.930929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:55.930966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:55.930971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:55.931012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939531:2856], now have 1 active actors on pipe
2025-10-01T14:11:55.931250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:55.931306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255861941939531:2856]
2025-10-01T14:11:55.931320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:55.931323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:55.931345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1512 reason: error at write: Disconnected sessionId: src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0
2025-10-01T14:11:55.931511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1512 sessionId: src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0 is DEAD
2025-10-01T14:11:55.931648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:55.931659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0] Write session will restart in 0.008611s
2025-10-01T14:11:55.931682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0] Write session: Do CDS request
2025-10-01T14:11:55.931687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:55.931679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:55.940297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:55.941741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:55.941797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.941873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:55.941903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:55.941885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1513
2025-10-01T14:11:55.941912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:55.941922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:55.941966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:55.941983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:55.942002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255859565057944:5791]
2025-10-01T14:11:55.942013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1513 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:55.942019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1513 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:55.942021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:55.942270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1513 sessionId:  describe result for acl check
2025-10-01T14:11:55.942291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:55.942295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:55.942296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:55.942299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255861941939589:2762] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:55.942500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:55.942667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255861941939589:2762] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:55.942773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:55.942806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:55.943111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:55.943147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.943151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.943152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.943153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.943153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.943154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.943155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.943155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.943156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.943156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.943157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.943159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.943160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.943160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.943163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.943168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.943170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.943172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.943174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.943177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.943178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.943180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.943182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.943185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.943187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.943188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.943190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.943192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.943196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.943201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:55.943205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.943207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:55.943210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.943212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:55.943214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.943217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:55.943220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.943223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:55.943225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.943228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:55.943234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.943236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:55.943239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.943241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:55.943247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.943249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:55.943251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.943257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.943259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.943262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.943264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.943269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.943273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.943277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:55.943279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.943284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:55.943309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:55.944738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255861941939589:2762] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:55.946488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255861941939589:2762] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:55.946500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255861941939589:2762] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:55.946503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255861941939589:2762] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:55.946509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1513 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:55.946598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:55.947128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:55.947138Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:55.947140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:55.947142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:55.947146Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1512 [2:7556255859565057944:5791]
2025-10-01T14:11:55.947155Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:55.947165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:55.947167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.947169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.947170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.947179Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:55.947182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:55.947186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:55.947222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.947226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.947227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.947229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:55.947231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:55.947283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:55.947290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.947299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:55.947313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:55.947331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:55.947350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939627:2762], now have 1 active actors on pipe
2025-10-01T14:11:55.947357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255861941939533:2446], now have 1 active actors on pipe
2025-10-01T14:11:55.947363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255859565057939:5791]
2025-10-01T14:11:55.947371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255859565057939:5791]
2025-10-01T14:11:55.947373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255859565057939:5791]
2025-10-01T14:11:55.947381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:55.947358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1512
2025-10-01T14:11:55.947368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1512
2025-10-01T14:11:55.947388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:55.947391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:55.947394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:55.947396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:55.947404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:55.947410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:55.947422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.947428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.947452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255859565057939:5791]
2025-10-01T14:11:55.947460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:55.947465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:55.947469Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:55.947473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:55.947476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:55.947479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:55.947484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:55.947495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:55.947525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.947637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.947649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.947661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:55.947712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1513 partition: 0 MaxSeqNo: 45 sessionId: src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0
2025-10-01T14:11:55.947977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea9c42b-782c86b2-56c9d3c3-9db05237_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:55.950240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0] Write session: try to update token
2025-10-01T14:11:55.950254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:55.963016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1513 sessionId: src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:55.965828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:55.966707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:55.966729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:55.966746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:55.966748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:55.966751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:55.966752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:55.966759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255859565057939:5791]
2025-10-01T14:11:55.966761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255859565057939:5791]
2025-10-01T14:11:55.966764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255859565057939:5791]
2025-10-01T14:11:55.966804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:55.966809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:55.966813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:55.966815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:55.966816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:55.966817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:55.966936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:56.031544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255866236906932:2856]
2025-10-01T14:11:56.031826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1512, pipe: [1:7556255866236906932:2856]
2025-10-01T14:11:56.102594Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:56.102825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:56.102871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236906932:2856], now have 1 active actors on pipe
2025-10-01T14:11:56.102970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:56.102996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:56.103047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:56.103050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255866236906932:2856]
2025-10-01T14:11:56.103054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:56.103125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1513 reason: error at write: Disconnected sessionId: src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0
2025-10-01T14:11:56.103284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1513 sessionId: src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0 is DEAD
2025-10-01T14:11:56.103406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:56.103417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0] Write session will restart in 0.009102s
2025-10-01T14:11:56.103441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0] Write session: Do CDS request
2025-10-01T14:11:56.103447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:56.109872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:56.111483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:56.111651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:56.111658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:56.111667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:56.111702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:56.111728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255863860025365:5758]
2025-10-01T14:11:56.112093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:56.112313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:56.112336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:56.112523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:56.112563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.112567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.112568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.112569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.112569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.112570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.112570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.112571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.112571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.112572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.112573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.112573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.112574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.112575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.112578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.112583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.112585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.112588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.112589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.112591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.112593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.112595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.112597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.112599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.112601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.112603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.112605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.112607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.112611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.112616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.112619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.112623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.112625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.112628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.112631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.112633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.112636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.112639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.112641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.112644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.112646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.112652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.112654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.112658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.112673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.112676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.112678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.112680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.112683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.112685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.112687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.112690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.112696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.112698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.112700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.112703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.112722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:56.113776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.113863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:56.113876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1514
2025-10-01T14:11:56.113950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.113971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1514 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:56.113979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1514 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:56.113982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:56.114244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1514 sessionId:  describe result for acl check
2025-10-01T14:11:56.114271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:56.114275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:56.114276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:56.114279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255866236906995:2759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:56.114655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255866236906995:2759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:56.115945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255866236906995:2759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:56.115983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:56.116487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:56.116497Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:56.116499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:56.116501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:56.116505Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1513 [2:7556255863860025365:5758]
2025-10-01T14:11:56.116515Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:56.116526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:56.116527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.116529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.116530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.116540Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:56.116547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:56.116552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:56.116588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.116593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.116594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.116596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:56.116598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:56.116642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:56.116648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.116655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.116660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.116683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:56.116697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255863860025360:5758]
2025-10-01T14:11:56.116701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255863860025360:5758]
2025-10-01T14:11:56.116702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255863860025360:5758]
2025-10-01T14:11:56.116712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:56.116724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236906933:2446], now have 1 active actors on pipe
2025-10-01T14:11:56.116729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:56.116731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:56.116733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:56.116734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:56.116742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:56.116744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:56.116759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255863860025360:5758]
2025-10-01T14:11:56.116764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:56.116766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:56.116742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1513
2025-10-01T14:11:56.121029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255866236906995:2759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:56.121044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255866236906995:2759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:56.121047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255866236906995:2759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:56.121054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1514 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:56.121280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907034:2759], now have 1 active actors on pipe
2025-10-01T14:11:56.121296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1513
2025-10-01T14:11:56.121341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.121349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.121367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:56.121378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.121384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.121386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:56.121393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.121407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:56.121422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.121565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.121569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.121577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.121636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1514 partition: 0 MaxSeqNo: 45 sessionId: src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0
2025-10-01T14:11:56.121914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55742bb7-7bcf94a8-ea08cb38-f4c952fc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:56.124282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0] Write session: try to update token
2025-10-01T14:11:56.124296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:56.135741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:56.135756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:56.135758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:56.135760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:56.135770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255863860025360:5758]
2025-10-01T14:11:56.135774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255863860025360:5758]
2025-10-01T14:11:56.135778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255863860025360:5758]
2025-10-01T14:11:56.135815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:56.135818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:56.135824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.135824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:56.135826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:56.135827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:56.135941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:56.136065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1514 sessionId: src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:56.138191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:56.203041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255866236907050:2856]
2025-10-01T14:11:56.203426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1513, pipe: [1:7556255866236907050:2856]
2025-10-01T14:11:56.270989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:56.271318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.271330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.271365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907050:2856], now have 1 active actors on pipe
2025-10-01T14:11:56.271528Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:56.271588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255866236907050:2856]
2025-10-01T14:11:56.271612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:56.271622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:56.271686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1514 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0
2025-10-01T14:11:56.271873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1514 sessionId: src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0 is DEAD
2025-10-01T14:11:56.272012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:56.272022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0] Write session will restart in 0.008564s
2025-10-01T14:11:56.272047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0] Write session: Do CDS request
2025-10-01T14:11:56.272052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:56.279488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:56.280944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:56.281067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:56.281074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:56.281081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:56.281109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:56.281135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255863860025462:5756]
2025-10-01T14:11:56.281512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:56.281700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:56.281729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:56.281745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.281820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:56.281837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1515
2025-10-01T14:11:56.281925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:56.281938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.281958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1515 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:56.281965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1515 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:56.281960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.281968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:56.281964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.281965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.281965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.281966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.281967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.281968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.281968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.281969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.281970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.281970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.281971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.281971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.281972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.281975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.281981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.281983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.281985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.281988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.281990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.281992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.281994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.281996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.281998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.282000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.282002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.282004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.282006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.282012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.282016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.282019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.282023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.282028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.282032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.282036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.282039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.282043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.282048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.282051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.282055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.282059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.282063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.282067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.282072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.282076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.282081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.282084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.282089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.282093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.282097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.282099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.282102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.282104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.282107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.282109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.282111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.282130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:56.282285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1515 sessionId:  describe result for acl check
2025-10-01T14:11:56.282322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:56.282329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:56.282331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:56.282335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255866236907114:2746] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:56.282856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255866236907114:2746] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:56.284359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255866236907114:2746] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:56.285312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:56.285843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:56.285856Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:56.285858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:56.285861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:56.285867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1514 [2:7556255863860025462:5756]
2025-10-01T14:11:56.285879Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:56.285895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:56.285902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.285906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.285908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.285921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:56.285931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:56.285936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:56.285978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.285983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.285985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.285989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:56.285991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:56.286047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:56.286055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.286065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.286080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.286081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1514
2025-10-01T14:11:56.286098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:56.286114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907051:2446], now have 1 active actors on pipe
2025-10-01T14:11:56.286122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255863860025457:5756]
2025-10-01T14:11:56.286123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255863860025457:5756]
2025-10-01T14:11:56.286124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255863860025457:5756]
2025-10-01T14:11:56.286130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:56.286137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:56.286139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:56.286143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:56.286144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:56.286150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:56.286153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:56.286178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255863860025457:5756]
2025-10-01T14:11:56.286188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:56.286190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:56.286568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255866236907114:2746] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:56.286577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255866236907114:2746] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:56.286580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255866236907114:2746] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:56.286585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1515 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:56.286849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907150:2746], now have 1 active actors on pipe
2025-10-01T14:11:56.286872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1514
2025-10-01T14:11:56.286917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.286926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.286948Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:56.286958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.286962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.286964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:56.286972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.286984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:56.287000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.287111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.287118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.287129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.287189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1515 partition: 0 MaxSeqNo: 45 sessionId: src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0
2025-10-01T14:11:56.287450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de38ee0a-f6910c37-6b317e68-6316f17b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:56.289671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0] Write session: try to update token
2025-10-01T14:11:56.289683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:56.301606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1515 sessionId: src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:56.303712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:56.304947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.304968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.304988Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:56.304991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:56.304994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:56.304996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:56.305008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255863860025457:5756]
2025-10-01T14:11:56.305013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255863860025457:5756]
2025-10-01T14:11:56.305017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255863860025457:5756]
2025-10-01T14:11:56.305056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:56.305069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:56.305072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:56.305073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:56.305077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.305081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:56.305210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:56.371970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255866236907158:2856]
2025-10-01T14:11:56.372199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1514, pipe: [1:7556255866236907158:2856]
2025-10-01T14:11:56.439441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:56.439734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:56.439807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907158:2856], now have 1 active actors on pipe
2025-10-01T14:11:56.439890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:56.439949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:56.439982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:56.439991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:56.440003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255866236907158:2856]
2025-10-01T14:11:56.440073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1515 reason: error at write: Disconnected sessionId: src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0
2025-10-01T14:11:56.440261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1515 sessionId: src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0 is DEAD
2025-10-01T14:11:56.440382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:56.440391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0] Write session will restart in 0.008086s
2025-10-01T14:11:56.440408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0] Write session: Do CDS request
2025-10-01T14:11:56.440415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:56.449465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:56.449883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.450011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:56.450026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1516
2025-10-01T14:11:56.451129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:56.451291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:56.451305Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:56.451315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:56.451356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:56.451394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255863860025559:5755]
2025-10-01T14:11:56.451820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:56.451868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.451923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1516 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:56.451933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1516 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:56.451937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:56.452146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:56.452181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:56.452279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1516 sessionId:  describe result for acl check
2025-10-01T14:11:56.452308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:56.452313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:56.452315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:56.452319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255866236907227:2745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:56.452385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:56.452440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.452444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.452445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.452446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.452446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.452447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.452448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.452448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.452449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.452449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.452450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.452450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.452451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.452452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.452457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.452465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.452468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.452471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.452475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.452479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.452481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.452485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.452488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.452493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.452496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.452499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.452502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.452505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.452511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.452517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.452524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.452529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.452533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.452536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.452538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.452541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.452544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.452547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.452549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.452552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.452558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.452561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.452563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.452569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.452571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.452574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.452577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.452583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.452585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.452588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.452593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.452596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.452599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.452606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.452608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.452614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.452634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:56.452826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255866236907227:2745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:56.454474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255866236907227:2745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:56.456123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:56.456551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255866236907227:2745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:56.456566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255866236907227:2745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:56.456569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255866236907227:2745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:56.456576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1516 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:56.456713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:56.456725Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:56.456726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:56.456729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:56.456735Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1515 [2:7556255863860025559:5755]
2025-10-01T14:11:56.456750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:56.456766Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:56.456768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.456770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.456771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.456783Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:56.456786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:56.456791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:56.456826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.456832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.456833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.456835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:56.456837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:56.456886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:56.456891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.456899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.456905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.456914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:56.456929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907164:2446], now have 1 active actors on pipe
2025-10-01T14:11:56.456935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907266:2745], now have 1 active actors on pipe
2025-10-01T14:11:56.456940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255863860025554:5755]
2025-10-01T14:11:56.456941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255863860025554:5755]
2025-10-01T14:11:56.456947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255863860025554:5755]
2025-10-01T14:11:56.456959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:56.456968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:56.456971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:56.456973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:56.456975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:56.456979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:56.456981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:56.456972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1515
2025-10-01T14:11:56.456991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1515
2025-10-01T14:11:56.457002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255863860025554:5755]
2025-10-01T14:11:56.457007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:56.457012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:56.457022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.457027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.457057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da045da0-c33cf387-e07d1602-3847e5e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:56.457066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.457069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.457070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:56.457077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.457083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:56.457095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.457191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.457197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.457205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.457255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1516 partition: 0 MaxSeqNo: 45 sessionId: src_id|da045da0-c33cf387-e07d1602-3847e5e3_0
2025-10-01T14:11:56.457565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a85dd83-2eff71c3-5d598301-634d4ee4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da045da0-c33cf387-e07d1602-3847e5e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:56.459878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da045da0-c33cf387-e07d1602-3847e5e3_0] Write session: try to update token
2025-10-01T14:11:56.459895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da045da0-c33cf387-e07d1602-3847e5e3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:56.472454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1516 sessionId: src_id|da045da0-c33cf387-e07d1602-3847e5e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:56.474649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:56.474787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.474804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.476383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:56.476398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:56.476400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:56.476402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:56.476411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255863860025554:5755]
2025-10-01T14:11:56.476414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255863860025554:5755]
2025-10-01T14:11:56.476416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255863860025554:5755]
2025-10-01T14:11:56.476450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:56.476450Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:56.476462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:56.476466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:56.476467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.476468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:56.476470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:56.476549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:56.476575Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:56.539915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255866236907274:2856]
2025-10-01T14:11:56.540146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1515, pipe: [1:7556255866236907274:2856]
2025-10-01T14:11:56.610968Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:56.617357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.617376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.617525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.617577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.617629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.617684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.617733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.617742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.617838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.617889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.617945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.618001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.618042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.618047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.618098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.618143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.618192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.618250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.618288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.618296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.618354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.618416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.618468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.618522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.618564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.618570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.618627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.618679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.618732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.618792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.618839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.618844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.618904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.618965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.619027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.619088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.619126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.619133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.619187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.619236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.619292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.619349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.619390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.619394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.619447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.619493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.619541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.619589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.619627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.619630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.619685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.619734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.619792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.619847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.619890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.619895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.619950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.619998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.620050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.620101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.620204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.620209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.620249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907274:2856], now have 1 active actors on pipe
2025-10-01T14:11:56.620455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:56.620482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:56.620486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:56.620499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255866236907274:2856]
2025-10-01T14:11:56.620510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1516 reason: error at write: Disconnected sessionId: src_id|da045da0-c33cf387-e07d1602-3847e5e3_0
2025-10-01T14:11:56.620703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1516 sessionId: src_id|da045da0-c33cf387-e07d1602-3847e5e3_0 is DEAD
2025-10-01T14:11:56.620865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da045da0-c33cf387-e07d1602-3847e5e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:56.620876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da045da0-c33cf387-e07d1602-3847e5e3_0] Write session will restart in 0.006424s
2025-10-01T14:11:56.620901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da045da0-c33cf387-e07d1602-3847e5e3_0] Write session: Do CDS request
2025-10-01T14:11:56.620907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da045da0-c33cf387-e07d1602-3847e5e3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:56.620972Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:56.628776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:56.628844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da045da0-c33cf387-e07d1602-3847e5e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.628959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:56.628978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1517
2025-10-01T14:11:56.629092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.629126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1517 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:56.629136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1517 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:56.629142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:56.629490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1517 sessionId:  describe result for acl check
2025-10-01T14:11:56.629523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:56.629529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:56.629530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:56.629535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255866236907337:2741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:56.630019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255866236907337:2741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:56.630187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:56.630359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:56.631937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255866236907337:2741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:56.630389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:56.630406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:56.630459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:56.630492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255863860025659:5752]
2025-10-01T14:11:56.631034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:56.631256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:56.631284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:56.631524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:56.631559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.631560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.631561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.631562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.631563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.631564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.631565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.631567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.631568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.631568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.631569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.631570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.631571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.631572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.631578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.631587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.631591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.631594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.631598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.631602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.631605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.631609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.631612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.631616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.631620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.631623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.631627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.631630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.631636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.631643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.631649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.631655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.631659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.631664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.631668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.631673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.631677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.631681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.631685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.631690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.631695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.631699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.631705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.631709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.631714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.631718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.631723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.631727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.631733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.631737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.631741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.631746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.631751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.631756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.631760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.631764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.631803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:56.635224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255866236907337:2741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:56.635243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255866236907337:2741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:56.635246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255866236907337:2741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:56.635255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1517 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:56.635433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:56.636025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:56.636037Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:56.636039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:56.636042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:56.636047Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1516 [2:7556255863860025659:5752]
2025-10-01T14:11:56.636059Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:56.636072Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:56.636074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.636076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.636077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.636090Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:56.636094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:56.636098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:56.636141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.636147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.636148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.636150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:56.636152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:56.636212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:56.636221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.636232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.636241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.636255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:56.636271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907376:2741], now have 1 active actors on pipe
2025-10-01T14:11:56.636274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907275:2446], now have 1 active actors on pipe
2025-10-01T14:11:56.636280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255863860025654:5752]
2025-10-01T14:11:56.636285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255863860025654:5752]
2025-10-01T14:11:56.636287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255863860025654:5752]
2025-10-01T14:11:56.636299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:56.636315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:56.636316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:56.636320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:56.636322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:56.636327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:56.636329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:56.636329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1516
2025-10-01T14:11:56.636337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1516
2025-10-01T14:11:56.636354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255863860025654:5752]
2025-10-01T14:11:56.636359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:56.636362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:56.636378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.636382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.636406Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33456933-5a7e5cb-60f9eae-9a52c289_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:56.636415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.636420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.636422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:56.636429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.636436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:56.636458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.636589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.636594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.636604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.636688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1517 partition: 0 MaxSeqNo: 45 sessionId: src_id|33456933-5a7e5cb-60f9eae-9a52c289_0
2025-10-01T14:11:56.637074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da045da0-c33cf387-e07d1602-3847e5e3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|33456933-5a7e5cb-60f9eae-9a52c289_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:56.639392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33456933-5a7e5cb-60f9eae-9a52c289_0] Write session: try to update token
2025-10-01T14:11:56.639409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33456933-5a7e5cb-60f9eae-9a52c289_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:56.651651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1517 sessionId: src_id|33456933-5a7e5cb-60f9eae-9a52c289_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:56.653927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:56.654129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.654148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.656031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:56.656060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:56.656063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:56.656065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:56.656067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:56.656074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255863860025654:5752]
2025-10-01T14:11:56.656078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255863860025654:5752]
2025-10-01T14:11:56.656082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255863860025654:5752]
2025-10-01T14:11:56.656101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:56.656105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:56.656108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:56.656119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:56.656127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.656129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:56.656145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:56.656245Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:56.720694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255866236907405:2856]
2025-10-01T14:11:56.720927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1516, pipe: [1:7556255866236907405:2856]
2025-10-01T14:11:56.794848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:56.801466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.801490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.801629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.801687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.801743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.801802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.801842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.801849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.801909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.801964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.802024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.802088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.802136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.802141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.802196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.802246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.802299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.802351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.802410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.802412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.802469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.802524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.802576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.802629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.802669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.802674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.802726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.802776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.802832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.802886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.802923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.802928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.802983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.803036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.803092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.803149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.803190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.803196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.803250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.803302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.803356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.803413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.803454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.803459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.803513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.803564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.803617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.803673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.803714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.803718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.803773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.803827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.803883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.803938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.803976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.803980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.804036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.804089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.804145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.804202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.804240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.804244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.804285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907405:2856], now have 1 active actors on pipe
2025-10-01T14:11:56.804494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:56.804512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:56.804516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:56.804541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1517 reason: error at write: Disconnected sessionId: src_id|33456933-5a7e5cb-60f9eae-9a52c289_0
2025-10-01T14:11:56.804542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255866236907405:2856]
2025-10-01T14:11:56.804715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1517 sessionId: src_id|33456933-5a7e5cb-60f9eae-9a52c289_0 is DEAD
2025-10-01T14:11:56.804895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33456933-5a7e5cb-60f9eae-9a52c289_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:56.804903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33456933-5a7e5cb-60f9eae-9a52c289_0] Write session will restart in 0.005336s
2025-10-01T14:11:56.804920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33456933-5a7e5cb-60f9eae-9a52c289_0] Write session: Do CDS request
2025-10-01T14:11:56.804924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33456933-5a7e5cb-60f9eae-9a52c289_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:56.805200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:56.810778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33456933-5a7e5cb-60f9eae-9a52c289_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.810853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:56.810867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1518
2025-10-01T14:11:56.811311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:56.811342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1518 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:56.811350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1518 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:56.811354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:56.811697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1518 sessionId:  describe result for acl check
2025-10-01T14:11:56.811730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:56.811736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:56.811737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:56.811742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255866236907467:2717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:56.812079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:56.812218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255866236907467:2717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:56.813601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:56.813727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:56.813735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:56.813742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:56.813773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:56.813800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255863860025765:5739]
2025-10-01T14:11:56.814002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255866236907467:2717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:56.814195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:56.814430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:56.814460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:56.814643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:56.814676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.814680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.814680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.814681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.814682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.814682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.814683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.814684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.814686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.814686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.814688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.814688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.814689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.814690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.814695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.814703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.814706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.814710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.814713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.814715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.814717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.814719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.814720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.814722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.814724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.814726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.814728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.814729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.814734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.814738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:56.814742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.814745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:56.814747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.814750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:56.814752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.814754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:56.814757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.814759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:56.814762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.814766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:56.814768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.814771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:56.814773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.814780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:56.814782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.814785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:56.814791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.814794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.814796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.814799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.814801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.814804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.814807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.814812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:56.814815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.814820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:56.814855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:56.818030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255866236907467:2717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:56.818043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255866236907467:2717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:56.818045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255866236907467:2717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:56.818051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1518 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:56.818165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:56.818842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:56.818853Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:56.818855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:56.818857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:56.818861Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1517 [2:7556255863860025765:5739]
2025-10-01T14:11:56.818871Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:56.818883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:56.818884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.818887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.818888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.818900Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:56.818908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:56.818916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:56.818950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.818955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.818956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.818958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:56.818960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:56.819008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:56.819014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.819024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:56.819039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:56.819052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:56.819067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907408:2446], now have 1 active actors on pipe
2025-10-01T14:11:56.819073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907509:2717], now have 1 active actors on pipe
2025-10-01T14:11:56.819079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255863860025760:5739]
2025-10-01T14:11:56.819080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255863860025760:5739]
2025-10-01T14:11:56.819081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255863860025760:5739]
2025-10-01T14:11:56.819090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:56.819098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:56.819099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:56.819101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:56.819103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:56.819109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:56.819111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:56.819131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255863860025760:5739]
2025-10-01T14:11:56.819146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:56.819164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:56.819173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1517
2025-10-01T14:11:56.819193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1517
2025-10-01T14:11:56.819231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.819237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.819253Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:56.819262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:56.819264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:56.819266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:56.819272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:56.819278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:56.819292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.819410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.819415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.819423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:56.819492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1518 partition: 0 MaxSeqNo: 45 sessionId: src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0
2025-10-01T14:11:56.819796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33456933-5a7e5cb-60f9eae-9a52c289_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:56.822121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0] Write session: try to update token
2025-10-01T14:11:56.822138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:56.834735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1518 sessionId: src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:56.837122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:56.837325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.837344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.837400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:56.837476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:56.840115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:56.840137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:56.840140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:56.840141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:56.840152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255863860025760:5739]
2025-10-01T14:11:56.840157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255863860025760:5739]
2025-10-01T14:11:56.840163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255863860025760:5739]
2025-10-01T14:11:56.840204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:56.840215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:56.840215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:56.840219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:56.840223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:56.840225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:56.840441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:56.904493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255866236907517:2856]
2025-10-01T14:11:56.904764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1517, pipe: [1:7556255866236907517:2856]
2025-10-01T14:11:56.985821Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:56.992680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:56.992702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:56.992835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.992890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.992946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.993004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.993045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.993056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.993122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.993178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.993235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.993293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.993334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.993339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.993393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.993444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.993499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.993553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.993592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.993597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.993650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.993704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.993756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.993810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.993851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.993857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.993911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.993962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.994018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.994072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.994111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.994116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.994169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.994222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.994281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.994340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.994400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.994408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.994465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.994521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.994578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.994636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.994675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.994677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.994731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.994785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.994838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.994893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.994934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.994940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.994997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.995052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.995107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.995163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.995203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.995209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.995265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:56.995319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:56.995377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:56.995433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:56.995489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:56.995495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:56.995534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907517:2856], now have 1 active actors on pipe
2025-10-01T14:11:56.995738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255866236907517:2856]
2025-10-01T14:11:56.995757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:56.995770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:56.995772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:56.995793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1518 reason: error at write: Disconnected sessionId: src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0
2025-10-01T14:11:56.995944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1518 sessionId: src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0 is DEAD
2025-10-01T14:11:56.996077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:56.996086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0] Write session will restart in 0.008299s
2025-10-01T14:11:56.996104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0] Write session: Do CDS request
2025-10-01T14:11:56.996109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:56.996239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:57.003847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:57.005311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:57.005455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:57.005464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:57.005472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:57.005503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:57.005528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255868154993204:5701]
2025-10-01T14:11:57.005754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.005955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:57.006145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:57.006175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:57.006157Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1519
2025-10-01T14:11:57.006200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:57.006259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.006281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1519 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:57.006289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1519 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:57.006302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:57.006477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:57.006525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.006530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.006531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.006532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.006533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.006534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.006535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.006536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.006537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.006538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.006539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.006541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.006541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.006543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.006547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.006555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.006557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.006559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.006561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.006563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.006565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.006566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.006568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.006570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.006572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.006574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.006576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.006577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.006582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.006586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.006590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.006592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.006595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.006597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.006601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.006603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.006606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.006608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.006611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.006613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.006615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.006618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.006620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.006623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.006625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.006628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.006630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.006633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.006653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1519 sessionId:  describe result for acl check
2025-10-01T14:11:57.006635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.006638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.006681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:57.006640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.006682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:57.006683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:57.006686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255870531874882:2713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:57.006642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.006645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.006648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.006650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.006653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.006672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:57.007060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255870531874882:2713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:57.009232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255870531874882:2713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:57.010183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:57.010797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:57.010811Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:57.010814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:57.010817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:57.010823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1518 [2:7556255868154993204:5701]
2025-10-01T14:11:57.010837Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:57.010852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:57.010854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.010860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.010862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.010877Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:57.010886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:57.010892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:57.010945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.010952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.010953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.010956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:57.010959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:57.011020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:57.011026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.011036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.011050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.011070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:57.011091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255866236907522:2446], now have 1 active actors on pipe
2025-10-01T14:11:57.011075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1518
2025-10-01T14:11:57.011102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255868154993199:5701]
2025-10-01T14:11:57.011108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255868154993199:5701]
2025-10-01T14:11:57.011110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255868154993199:5701]
2025-10-01T14:11:57.011119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:57.011125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:57.011128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:57.011129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:57.011133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:57.011147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:57.011153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:57.011184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255868154993199:5701]
2025-10-01T14:11:57.011195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:57.011204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:57.011752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255870531874882:2713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:57.011765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255870531874882:2713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:57.011769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255870531874882:2713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:57.011776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1519 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:57.011947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531874918:2713], now have 1 active actors on pipe
2025-10-01T14:11:57.012012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1518
2025-10-01T14:11:57.012066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.012074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.012098Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:57.012105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.012110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.012112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:57.012121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.012130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:57.012143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.012271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.012278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.012290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.012343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1519 partition: 0 MaxSeqNo: 45 sessionId: src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0
2025-10-01T14:11:57.012564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7768913-9f34a3b-c8c2c1d2-3665b993_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:57.014833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0] Write session: try to update token
2025-10-01T14:11:57.014847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:57.021370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:57.021388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:57.021398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255868154993199:5701]
2025-10-01T14:11:57.021435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:57.021442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:57.021618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:57.021759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:57.021903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:57.022046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:57.022249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:57.022289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:57.027425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1519 sessionId: src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:57.029547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:57.029713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.029732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.029766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:57.029838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:57.038867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:57.038882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:57.038884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:57.038886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:57.038898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255868154993199:5701]
2025-10-01T14:11:57.038900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255868154993199:5701]
2025-10-01T14:11:57.038902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255868154993199:5701]
2025-10-01T14:11:57.038937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:57.038939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:57.038944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:57.038946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.038946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:57.038947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:57.039061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:57.095964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255870531874926:2856]
2025-10-01T14:11:57.096202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1518, pipe: [1:7556255870531874926:2856]
2025-10-01T14:11:57.170563Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:57.176944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.176967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.177106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.177161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.177219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.177277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.177320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.177327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.177383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.177437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.177491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.177551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.177591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.177596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.177655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.177709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.177766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.177823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.177863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.177868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.177927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.177984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.178039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.178096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.178135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.178139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.178193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.178246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.178301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.178355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.178414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.178420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.178477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.178531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.178586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.178641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.178683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.178688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.178743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.178793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.178848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.178899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.178935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.178944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.179000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.179061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.179124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.179177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.179216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.179221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.179275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.179327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.179381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.179439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.179478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.179483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.179538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.179591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.179647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.179699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.179736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.179741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.179779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531874926:2856], now have 1 active actors on pipe
2025-10-01T14:11:57.180035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:57.180050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:57.180090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1519 reason: error at write: Disconnected sessionId: src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0
2025-10-01T14:11:57.180246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1519 sessionId: src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0 is DEAD
2025-10-01T14:11:57.180296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:57.180362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:57.180350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255870531874926:2856]
2025-10-01T14:11:57.180378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0] Write session will restart in 0.006295s
2025-10-01T14:11:57.180403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0] Write session: Do CDS request
2025-10-01T14:11:57.180409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:57.180556Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:57.187818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.187904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:57.187918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1520
2025-10-01T14:11:57.188032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1520 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.188062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1520 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:57.188072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1520 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:57.188075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:57.188300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:57.188423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1520 sessionId:  describe result for acl check
2025-10-01T14:11:57.188456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:57.188463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:57.188464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:57.188469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255870531874992:2705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:57.188984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255870531874992:2705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:57.189886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:57.190047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:57.190058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:57.190068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:57.190110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:57.190144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255868154993305:5703]
2025-10-01T14:11:57.190609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255870531874992:2705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:57.190702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:57.190907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:57.190948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:57.191230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:57.191281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.191286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.191287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.191288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.191290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.191291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.191292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.191293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.191294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.191295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.191296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.191298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.191299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.191300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.191304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.191314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.191318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.191321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.191325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.191329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.191332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.191336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.191340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.191344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.191347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.191351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.191355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.191358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.191368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.191375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.191385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.191394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.191403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.191408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.191416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.191421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.191430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.191438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.191443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.191447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.191456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.191464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.191472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.191481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.191486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.191495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.191502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.191508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.191516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.191521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.191528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.191534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.191542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.191550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.191557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.191562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.191602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:57.194685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255870531874992:2705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:57.194698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255870531874992:2705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:57.194702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255870531874992:2705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:57.194709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1520 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:57.194942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:57.195496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:57.195506Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:57.195507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:57.195510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:57.195514Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1519 [2:7556255868154993305:5703]
2025-10-01T14:11:57.195523Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:57.195535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:57.195536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.195538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.195540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.195551Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:57.195554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:57.195558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:57.195592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.195597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.195598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.195602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:57.195604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:57.195651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:57.195655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.195662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.195671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.195684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:57.195705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875043:2705], now have 1 active actors on pipe
2025-10-01T14:11:57.195712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531874929:2446], now have 1 active actors on pipe
2025-10-01T14:11:57.195719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255868154993300:5703]
2025-10-01T14:11:57.195722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255868154993300:5703]
2025-10-01T14:11:57.195724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255868154993300:5703]
2025-10-01T14:11:57.195736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:57.195749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:57.195742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1519
2025-10-01T14:11:57.195751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:57.195744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1519
2025-10-01T14:11:57.195756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:57.195758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:57.195763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:57.195766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:57.195788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255868154993300:5703]
2025-10-01T14:11:57.195798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:57.195803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:57.195809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.195812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.195840Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d723279-b89d12b-2edfbac9-75cdaca6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:57.195849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.195852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.195853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:57.195858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.195864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:57.195879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.196010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.196024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.196046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.196104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1520 partition: 0 MaxSeqNo: 45 sessionId: src_id|d723279-b89d12b-2edfbac9-75cdaca6_0
2025-10-01T14:11:57.196416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c493007f-c4da53ce-1add3689-edbe3bd6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d723279-b89d12b-2edfbac9-75cdaca6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:57.198927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d723279-b89d12b-2edfbac9-75cdaca6_0] Write session: try to update token
2025-10-01T14:11:57.198943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d723279-b89d12b-2edfbac9-75cdaca6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:57.211789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1520 sessionId: src_id|d723279-b89d12b-2edfbac9-75cdaca6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:57.214185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:57.215348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.215377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.215398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:57.215410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:57.215417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:57.215419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:57.215428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255868154993300:5703]
2025-10-01T14:11:57.215437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255868154993300:5703]
2025-10-01T14:11:57.215443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255868154993300:5703]
2025-10-01T14:11:57.215481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:57.215490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:57.215493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:57.215503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:57.215512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.215519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:57.215654Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:57.280297Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255870531875050:2856]
2025-10-01T14:11:57.280552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1519, pipe: [1:7556255870531875050:2856]
2025-10-01T14:11:57.353653Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:57.353887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:57.353930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875050:2856], now have 1 active actors on pipe
2025-10-01T14:11:57.354023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:57.354105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:57.354149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255870531875050:2856]
2025-10-01T14:11:57.354215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:57.354221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:57.354275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1520 reason: error at write: Disconnected sessionId: src_id|d723279-b89d12b-2edfbac9-75cdaca6_0
2025-10-01T14:11:57.354421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1520 sessionId: src_id|d723279-b89d12b-2edfbac9-75cdaca6_0 is DEAD
2025-10-01T14:11:57.354550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d723279-b89d12b-2edfbac9-75cdaca6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:57.354559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d723279-b89d12b-2edfbac9-75cdaca6_0] Write session will restart in 0.005048s
2025-10-01T14:11:57.354582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d723279-b89d12b-2edfbac9-75cdaca6_0] Write session: Do CDS request
2025-10-01T14:11:57.354591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d723279-b89d12b-2edfbac9-75cdaca6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:57.360807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d723279-b89d12b-2edfbac9-75cdaca6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.360864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:57.360878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1521
2025-10-01T14:11:57.360954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.360976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1521 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:57.360980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1521 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:57.360983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:57.361363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1521 sessionId:  describe result for acl check
2025-10-01T14:11:57.361393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:57.361399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:57.361401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:57.361405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255870531875116:2698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:57.361494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:57.361806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255870531875116:2698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:57.362998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:57.363125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:57.363133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:57.363140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:57.363173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:57.363198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255868154993407:5698]
2025-10-01T14:11:57.363203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255870531875116:2698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:57.363626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:57.363836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:57.363870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:57.364151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:57.364196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.364201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.364202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.364203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.364204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.364205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.364206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.364207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.364208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.364209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.364210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.364211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.364212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.364213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.364217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.364225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.364228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.364231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.364234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.364238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.364241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.364244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.364247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.364251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.364258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.364261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.364268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.364271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.364278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.364289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.364299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.364308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.364315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.364319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.364326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.364330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.364339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.364343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.364350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.364354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.364358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.364362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.364370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.364374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.364383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.364390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.364397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.364402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.364409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.364413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.364419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.364423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.364430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.364434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.364441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.364445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.364479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:57.367617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255870531875116:2698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:57.367636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255870531875116:2698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:57.367639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255870531875116:2698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:57.367644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1521 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:57.367818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:57.368346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:57.368357Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:57.368358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:57.368360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:57.368365Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1520 [2:7556255868154993407:5698]
2025-10-01T14:11:57.368375Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:57.368389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:57.368393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.368396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.368397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.368410Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:57.368416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:57.368420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:57.368455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.368459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.368460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.368463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:57.368464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:57.368511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:57.368516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.368523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.368529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.368540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:57.368555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875156:2698], now have 1 active actors on pipe
2025-10-01T14:11:57.368561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875052:2446], now have 1 active actors on pipe
2025-10-01T14:11:57.368566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255868154993402:5698]
2025-10-01T14:11:57.368567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255868154993402:5698]
2025-10-01T14:11:57.368569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255868154993402:5698]
2025-10-01T14:11:57.368577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:57.368588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:57.368589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:57.368591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:57.368593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:57.368600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:57.368601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:57.368592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1520
2025-10-01T14:11:57.368593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1520
2025-10-01T14:11:57.368618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255868154993402:5698]
2025-10-01T14:11:57.368623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:57.368624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:57.368637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.368643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.368686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:57.368695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.368697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.368702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:57.368708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.368717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:57.368731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.368820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.368825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.368834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.368882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1521 partition: 0 MaxSeqNo: 45 sessionId: src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0
2025-10-01T14:11:57.369169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d723279-b89d12b-2edfbac9-75cdaca6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:57.371587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0] Write session: try to update token
2025-10-01T14:11:57.371608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:57.384439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1521 sessionId: src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:57.386647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:57.388258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.388276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.388292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:57.388294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:57.388296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:57.388297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:57.388303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255868154993402:5698]
2025-10-01T14:11:57.388306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255868154993402:5698]
2025-10-01T14:11:57.388309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255868154993402:5698]
2025-10-01T14:11:57.388350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:57.388359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.388360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:57.388361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:57.388366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:57.388369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:57.388469Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:57.454390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255870531875171:2856]
2025-10-01T14:11:57.454634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1520, pipe: [1:7556255870531875171:2856]
2025-10-01T14:11:57.525604Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:57.525974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:57.526032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875171:2856], now have 1 active actors on pipe
2025-10-01T14:11:57.526103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:57.526177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255870531875171:2856]
2025-10-01T14:11:57.526192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:57.526197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:57.526207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:57.526257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1521 reason: error at write: Disconnected sessionId: src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0
2025-10-01T14:11:57.526405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1521 sessionId: src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0 is DEAD
2025-10-01T14:11:57.526560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:57.526571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0] Write session will restart in 0.009050s
2025-10-01T14:11:57.526595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0] Write session: Do CDS request
2025-10-01T14:11:57.526601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:57.534054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:57.535542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:57.535735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:57.535748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:57.535759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:57.535809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:57.535845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255868154993510:5694]
2025-10-01T14:11:57.536426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:57.536652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:57.536703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:57.536824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.536934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:57.536947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1522
2025-10-01T14:11:57.536996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:57.537029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.537050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1522 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:57.537058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1522 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:57.537060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:57.537059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.537065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.537066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.537067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.537068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.537069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.537070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.537071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.537072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.537073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.537074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.537075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.537076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.537078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.537083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.537093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.537097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.537101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.537105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.537109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.537113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.537116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.537120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.537123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.537127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.537131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.537137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.537145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.537153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.537163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.537172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.537182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.537190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.537199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.537207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.537215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.537224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.537233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.537241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.537247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.537252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.537257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.537265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.537273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.537277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.537282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.537291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.537299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.537307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.537317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.537325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.537331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.537339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.537344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.537352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.537357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.537388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1522 sessionId:  describe result for acl check
2025-10-01T14:11:57.537398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:57.537423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:57.537428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:57.537432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:57.537436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255870531875241:2688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:57.537913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255870531875241:2688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:57.539364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255870531875241:2688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:57.540796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:57.541489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255870531875241:2688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:57.541502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255870531875241:2688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:57.541504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255870531875241:2688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:57.541510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1522 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:57.541544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:57.541560Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:57.541563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:57.541566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:57.541573Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1521 [2:7556255868154993510:5694]
2025-10-01T14:11:57.541589Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:57.541610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:57.541616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.541620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.541625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.541639Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:57.541649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:57.541659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:57.541723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.541730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.541732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.541735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:57.541738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:57.541799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:57.541806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.541816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.541831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.541853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:57.541869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875173:2446], now have 1 active actors on pipe
2025-10-01T14:11:57.541876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875278:2688], now have 1 active actors on pipe
2025-10-01T14:11:57.541882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255868154993505:5694]
2025-10-01T14:11:57.541888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255868154993505:5694]
2025-10-01T14:11:57.541890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255868154993505:5694]
2025-10-01T14:11:57.541882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1521
2025-10-01T14:11:57.541895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1521
2025-10-01T14:11:57.541905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:57.541910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:57.541912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:57.541914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:57.541921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:57.541934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:57.541937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:57.541979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.541987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.542002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255868154993505:5694]
2025-10-01T14:11:57.542011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:57.542021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:57.542039Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:57.542049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.542056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.542060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:57.542071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.542083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:57.542108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.542217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.542233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.542255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.542314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1522 partition: 0 MaxSeqNo: 45 sessionId: src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0
2025-10-01T14:11:57.542658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8b9d125-4dd05d74-b2ea11a2-ec019f4e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:57.544917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0] Write session: try to update token
2025-10-01T14:11:57.544931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:57.557605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1522 sessionId: src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:57.559810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:57.560899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.560921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.560938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:57.560940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:57.560942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:57.560943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:57.560948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255868154993505:5694]
2025-10-01T14:11:57.560952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255868154993505:5694]
2025-10-01T14:11:57.560955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255868154993505:5694]
2025-10-01T14:11:57.560989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:57.560999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:57.561000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:57.561003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:57.561005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.561007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:57.561137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:57.626603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255870531875285:2856]
2025-10-01T14:11:57.626838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1521, pipe: [1:7556255870531875285:2856]
2025-10-01T14:11:57.692300Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:57.692513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:57.692562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875285:2856], now have 1 active actors on pipe
2025-10-01T14:11:57.692648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:57.700618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:57.701545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:57.701560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:57.701582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1522 reason: error at write: Disconnected sessionId: src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0
2025-10-01T14:11:57.701744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1522 sessionId: src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0 is DEAD
2025-10-01T14:11:57.701816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:57.701825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0] Write session will restart in 0.006224s
2025-10-01T14:11:57.701841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0] Write session: Do CDS request
2025-10-01T14:11:57.701846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:57.701891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:57.701924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255870531875285:2856]
2025-10-01T14:11:57.705720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:57.705882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:57.705889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:57.705897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:57.705937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:57.705963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255868154993617:5674]
2025-10-01T14:11:57.706337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:57.706587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:57.706616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:57.706826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:57.706862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.706866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.706867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.706867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.706868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.706869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.706869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.706870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.706871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.706871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.706872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.706872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.706873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.706874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.706877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.706883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.706885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.706887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.706889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.706892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.706893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.706896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.706897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.706900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.706902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.706904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.706906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.706908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.706912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.706916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.706920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.706923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.706926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.706929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.706931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.706934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.706936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.706940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.706943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.706945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.706948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.706956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.706958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.706961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.706964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.706966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.706970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.706972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.706975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.706978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.706980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.706983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.706985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.706987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.706990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.706992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.707013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:57.708873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.708916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:57.708929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1523
2025-10-01T14:11:57.709073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.709097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1523 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:57.709104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1523 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:57.709106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:57.709352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1523 sessionId:  describe result for acl check
2025-10-01T14:11:57.709374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:57.709380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:57.709381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:57.709385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255870531875370:2670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:57.710053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255870531875370:2670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:57.710396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:57.710926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:57.710940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:57.710942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:57.710945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:57.710951Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1522 [2:7556255868154993617:5674]
2025-10-01T14:11:57.710965Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:57.710977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:57.710982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.710985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.710986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.710997Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:57.711005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:57.711009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:57.711049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.711054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.711056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.711059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:57.711062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:57.711114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:57.711122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.711129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.711134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.711143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:57.711155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875361:2446], now have 1 active actors on pipe
2025-10-01T14:11:57.711164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255868154993611:5674]
2025-10-01T14:11:57.711168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255868154993611:5674]
2025-10-01T14:11:57.711170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255868154993611:5674]
2025-10-01T14:11:57.711181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:57.711192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:57.711193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:57.711200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:57.711200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:57.711202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:57.711202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:57.711218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255868154993611:5674]
2025-10-01T14:11:57.711223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:57.711225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:57.711450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1522
2025-10-01T14:11:57.711790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255870531875370:2670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:57.717210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255870531875370:2670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:57.717220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255870531875370:2670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:57.717223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255870531875370:2670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:57.717228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1523 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:57.717430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1522
2025-10-01T14:11:57.717408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875416:2670], now have 1 active actors on pipe
2025-10-01T14:11:57.717469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.717477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.717496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:57.717507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.717511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.717512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:57.717520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.717530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:57.717546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.717673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.717678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.717688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.717751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1523 partition: 0 MaxSeqNo: 45 sessionId: src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0
2025-10-01T14:11:57.718048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e94e512-8fd8e85c-c8d0250d-11e97eb6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:57.720498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0] Write session: try to update token
2025-10-01T14:11:57.720515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:57.721115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:57.721128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:57.721133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255868154993611:5674]
2025-10-01T14:11:57.721166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:57.721171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:57.721312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:57.721436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:57.721549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:57.721708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:57.721871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:57.721898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:57.733372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1523 sessionId: src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:57.735725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:57.735897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.735913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.735941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:57.736017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:57.739013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:57.739028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:57.739029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:57.739031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:57.739039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255868154993611:5674]
2025-10-01T14:11:57.739043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255868154993611:5674]
2025-10-01T14:11:57.739046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255868154993611:5674]
2025-10-01T14:11:57.739079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:57.739083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:57.739084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:57.739089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.739090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:57.739096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:57.739210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:57.801995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255870531875421:2856]
2025-10-01T14:11:57.802213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1522, pipe: [1:7556255870531875421:2856]
2025-10-01T14:11:57.873049Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:57.880233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.880258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.880452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.880518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.880593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.880670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.880727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.880741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.880822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.880891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.880972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.881053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.881302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.881309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.881384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.881456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.881530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.881605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.881653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.881657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.881723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.881784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.881843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.881904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.881945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.881950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.882009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.882067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.882130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.882195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.882245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.882250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.882321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.882405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.882501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.882574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.882627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.882633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.882709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.882778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.882848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.882913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.882960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.882964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.883034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.883101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.883173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.883248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.883309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.883316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.883435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.883548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.883622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.883698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.883751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.883756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.883838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:57.883907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:57.883982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:57.884066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:57.884121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:57.884126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:57.884191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875421:2856], now have 1 active actors on pipe
2025-10-01T14:11:57.884403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:57.884470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255870531875421:2856]
2025-10-01T14:11:57.884499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:57.884506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:57.884538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1523 reason: error at write: Disconnected sessionId: src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0
2025-10-01T14:11:57.884792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1523 sessionId: src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0 is DEAD
2025-10-01T14:11:57.884937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:57.884947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0] Write session will restart in 0.009139s
2025-10-01T14:11:57.884976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0] Write session: Do CDS request
2025-10-01T14:11:57.884984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:57.885214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:57.894051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:57.894977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.895077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:57.895095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1524
2025-10-01T14:11:57.895243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:57.895274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1524 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:57.895284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1524 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:57.895289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:57.895722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1524 sessionId:  describe result for acl check
2025-10-01T14:11:57.895745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:57.895766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:57.895773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:57.895774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:57.895780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255870531875492:2665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:57.895955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:57.895965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:57.895978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:57.896029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:57.896066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255868154993729:5684]
2025-10-01T14:11:57.896372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255870531875492:2665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:57.896655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:57.896937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:57.896975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:57.897277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:57.897326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.897333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.897334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.897335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.897337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.897338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.897339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.897340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.897341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.897342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.897343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.897344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.897345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.897347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.897351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.897362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.897367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.897371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.897375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.897379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.897383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.897387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.897391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.897395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.897399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.897403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.897406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.897410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.897416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.897424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:57.897430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.897435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:57.897440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.897445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:57.897449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.897454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:57.897459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.897464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:57.897469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.897474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:57.897478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.897483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:57.897487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.897492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:57.897496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.897501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:57.897505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.897510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.897515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.897520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.897533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.897539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.897543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.897548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:57.897552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.897557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:57.897598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:57.899355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255870531875492:2665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:57.901209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:57.901981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:57.901992Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:57.901994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:57.901996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:57.902001Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1523 [2:7556255868154993729:5684]
2025-10-01T14:11:57.902012Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:57.902024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:57.902031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.902033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.902035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.902048Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:57.902055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:57.902059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:57.902100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.902104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.902105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.902108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:57.902110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:57.902116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255870531875492:2665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:57.902133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255870531875492:2665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:57.902136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255870531875492:2665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:57.902147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1524 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:57.902161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:57.902166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.902173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:57.902179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:57.902191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:57.902206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255868154993724:5684]
2025-10-01T14:11:57.902211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255868154993724:5684]
2025-10-01T14:11:57.902213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255868154993724:5684]
2025-10-01T14:11:57.902219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:57.902230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:57.902241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:57.902248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:57.902249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:57.902251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:57.902253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:57.902274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255868154993724:5684]
2025-10-01T14:11:57.902280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:57.902283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:57.902299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875425:2446], now have 1 active actors on pipe
2025-10-01T14:11:57.902320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1523
2025-10-01T14:11:57.902708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875531:2665], now have 1 active actors on pipe
2025-10-01T14:11:57.902735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1523
2025-10-01T14:11:57.902776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.902786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.902827Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eab718b8-49258e92-5a64080e-ccf052fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:57.902839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:57.902847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:57.902851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:57.902863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:57.902876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:57.902894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.903019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.903024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.903036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:57.903090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1524 partition: 0 MaxSeqNo: 45 sessionId: src_id|eab718b8-49258e92-5a64080e-ccf052fe_0
2025-10-01T14:11:57.903545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d0a7609-cca32920-2d7a0efb-2d253762_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eab718b8-49258e92-5a64080e-ccf052fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:57.906289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab718b8-49258e92-5a64080e-ccf052fe_0] Write session: try to update token
2025-10-01T14:11:57.906304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab718b8-49258e92-5a64080e-ccf052fe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:57.919465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1524 sessionId: src_id|eab718b8-49258e92-5a64080e-ccf052fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:57.921850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:57.922792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:57.922813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:57.922834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:57.922837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:57.922840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:57.922842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:57.922850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255868154993724:5684]
2025-10-01T14:11:57.922858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255868154993724:5684]
2025-10-01T14:11:57.922861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255868154993724:5684]
2025-10-01T14:11:57.922902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:57.922911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:57.922913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:57.922917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:57.922917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:57.922920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:57.923045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:57.984812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255870531875539:2856]
2025-10-01T14:11:57.985093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1523, pipe: [1:7556255870531875539:2856]
2025-10-01T14:11:58.063699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:58.063949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:58.063997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255870531875539:2856], now have 1 active actors on pipe
2025-10-01T14:11:58.064094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:58.064231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:58.064278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255870531875539:2856]
2025-10-01T14:11:58.072872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:58.074325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:58.074472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:58.074480Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:58.074488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:58.074520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:58.074551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255872449961174:5660]
2025-10-01T14:11:58.074838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:58.074852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:58.074873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1524 reason: error at write: Disconnected sessionId: src_id|eab718b8-49258e92-5a64080e-ccf052fe_0
2025-10-01T14:11:58.074940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:58.075003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1524 sessionId: src_id|eab718b8-49258e92-5a64080e-ccf052fe_0 is DEAD
2025-10-01T14:11:58.075140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab718b8-49258e92-5a64080e-ccf052fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:58.075150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab718b8-49258e92-5a64080e-ccf052fe_0] Write session will restart in 0.006942s
2025-10-01T14:11:58.075176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab718b8-49258e92-5a64080e-ccf052fe_0] Write session: Do CDS request
2025-10-01T14:11:58.075182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab718b8-49258e92-5a64080e-ccf052fe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:58.078026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:58.078062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:58.078290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:58.078324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.078328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.078329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.078330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.078330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.078331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.078332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.078333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.078333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.078334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.078334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.078335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.078335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.078337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.078340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.078346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.078348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.078350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.078352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.078354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.078357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.078358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.078361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.078363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.078365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.078368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.078383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.078386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.078392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.078399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.078404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.078407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.078410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.078412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.078415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.078418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.078420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.078423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.078425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.078428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.078431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.078434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.078436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.078439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.078446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.078449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.078451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.078457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.078460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.078462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.078465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.078470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.078473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.078476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.078482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.078485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.078510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:58.081965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:58.082700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:58.082713Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:58.082716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:58.082719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:58.082725Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1524 [2:7556255872449961174:5660]
2025-10-01T14:11:58.082738Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:58.082754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:58.082757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.082761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.082763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.082777Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:58.082782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:58.082788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:58.082836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.082842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.082843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.082845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:58.082847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:58.082908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab718b8-49258e92-5a64080e-ccf052fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.082908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:58.082915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.082925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.082935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.082955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:58.082974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826842839:2446], now have 1 active actors on pipe
2025-10-01T14:11:58.082986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255872449961169:5660]
2025-10-01T14:11:58.082991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255872449961169:5660]
2025-10-01T14:11:58.082993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255872449961169:5660]
2025-10-01T14:11:58.083008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:58.082987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:58.083015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:58.083019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:58.083021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:58.083001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1524
2025-10-01T14:11:58.083025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:58.083039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:58.083041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:58.083006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1525
2025-10-01T14:11:58.083069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255872449961169:5660]
2025-10-01T14:11:58.083080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:58.083100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:58.083181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.083218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1525 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:58.083228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1525 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:58.083233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:58.083591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1525 sessionId:  describe result for acl check
2025-10-01T14:11:58.083620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:58.083626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:58.083627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:58.083631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255874826842914:2661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:58.084085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255874826842914:2661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:58.086241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255874826842914:2661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:58.092249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255874826842914:2661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:58.092263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255874826842914:2661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:58.092266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255874826842914:2661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:58.092273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1525 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:58.092493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1524
2025-10-01T14:11:58.093021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826842949:2661], now have 1 active actors on pipe
2025-10-01T14:11:58.093049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.093056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.093074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:58.093077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:58.093087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255872449961169:5660]
2025-10-01T14:11:58.093117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:58.093131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:58.093141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.093150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.093153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:58.093165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.093183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:58.093200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:58.093364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:58.093503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:58.093644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:58.093797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:58.093981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:58.094023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.094046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:58.094194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.094203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.094217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.094306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1525 partition: 0 MaxSeqNo: 45 sessionId: src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0
2025-10-01T14:11:58.094621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab718b8-49258e92-5a64080e-ccf052fe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:58.096877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0] Write session: try to update token
2025-10-01T14:11:58.096890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:58.109160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1525 sessionId: src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:58.111333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:58.111696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.111721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.111742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:58.111745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:58.111748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:58.111750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:58.111760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255872449961169:5660]
2025-10-01T14:11:58.111765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255872449961169:5660]
2025-10-01T14:11:58.111770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255872449961169:5660]
2025-10-01T14:11:58.111804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:58.111814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:58.111817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:58.111829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:58.111834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.111837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:58.111976Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:58.164526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255874826842951:2856]
2025-10-01T14:11:58.164756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1524, pipe: [1:7556255874826842951:2856]
2025-10-01T14:11:58.252422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:58.252739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:58.252782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826842951:2856], now have 1 active actors on pipe
2025-10-01T14:11:58.252900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:58.252970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255874826842951:2856]
2025-10-01T14:11:58.253001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:58.253008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:58.253008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:58.253089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1525 reason: error at write: Disconnected sessionId: src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0
2025-10-01T14:11:58.253275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1525 sessionId: src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0 is DEAD
2025-10-01T14:11:58.253436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:58.253448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0] Write session will restart in 0.005089s
2025-10-01T14:11:58.253476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0] Write session: Do CDS request
2025-10-01T14:11:58.253487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:58.259987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.260109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:58.260125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1526
2025-10-01T14:11:58.260252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.260285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1526 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:58.260295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1526 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:58.260298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:58.260747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1526 sessionId:  describe result for acl check
2025-10-01T14:11:58.260779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:58.260786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:58.260787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:58.260792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255874826842980:2652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:58.261333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255874826842980:2652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:58.263239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255874826842980:2652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:58.264055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:58.265721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:58.265877Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:58.265884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:58.265892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:58.265892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255874826842980:2652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:58.265906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255874826842980:2652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:58.265909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255874826842980:2652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:58.265925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:58.265957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1526 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:58.265959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255872449961283:5649]
2025-10-01T14:11:58.266332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:58.266552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:58.266577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:58.266763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:58.266795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.266799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.266799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.266800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.266801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.266801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.266802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.266802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.266803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.266804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.266804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.266805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.266806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.266806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.266809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.266815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.266817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.266819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.266821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.266823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.266825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.266827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.266829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.266831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.266833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.266835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.266837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.266839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.266843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.266847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.266851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.266854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.266856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.266859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.266861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.266864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.266866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.266869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.266871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.266873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.266876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.266878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.266881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.266883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.266885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.266888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.266891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.266893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.266897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.266899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.266901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.266903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.266906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.266908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.266910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.266913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.266932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:58.270339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:58.270906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:58.270916Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:58.270918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:58.270920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:58.270924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1525 [2:7556255872449961283:5649]
2025-10-01T14:11:58.270935Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:58.270946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:58.270948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.270950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.270955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.270967Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:58.270974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:58.270978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:58.271020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.271026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.271027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.271029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:58.271033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:58.271080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:58.271082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.271089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.271095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.271104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:58.271117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826842965:2446], now have 1 active actors on pipe
2025-10-01T14:11:58.271126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255872449961277:5649]
2025-10-01T14:11:58.271127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255872449961277:5649]
2025-10-01T14:11:58.271129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255872449961277:5649]
2025-10-01T14:11:58.271138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:58.271143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843069:2652], now have 1 active actors on pipe
2025-10-01T14:11:58.271147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:58.271149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:58.271149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:58.271151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:58.271157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:58.271158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:58.271176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255872449961277:5649]
2025-10-01T14:11:58.271161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1525
2025-10-01T14:11:58.271182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:58.271178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1525
2025-10-01T14:11:58.271184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:58.271203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.271206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.271283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:58.271291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.271294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.271296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:58.271302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.271308Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:58.271323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.271830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.271844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.271864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.271942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1526 partition: 0 MaxSeqNo: 45 sessionId: src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0
2025-10-01T14:11:58.272258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2995bcfe-14f2264b-2de4f58d-cd028e98_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:58.274630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0] Write session: try to update token
2025-10-01T14:11:58.274647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:58.287850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1526 sessionId: src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:58.290155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:58.290996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.291021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.291043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:58.291046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:58.291052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:58.291054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:58.291062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255872449961277:5649]
2025-10-01T14:11:58.291074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255872449961277:5649]
2025-10-01T14:11:58.291082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255872449961277:5649]
2025-10-01T14:11:58.291113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:58.291121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:58.291124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:58.291138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:58.291149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.291152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:58.291283Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:58.352926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255874826843083:2856]
2025-10-01T14:11:58.353189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1525, pipe: [1:7556255874826843083:2856]
2025-10-01T14:11:58.429749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:58.429994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:58.430044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843083:2856], now have 1 active actors on pipe
2025-10-01T14:11:58.430114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:58.430217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255874826843083:2856]
2025-10-01T14:11:58.430250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:58.438481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:58.438495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:58.438514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1526 reason: error at write: Disconnected sessionId: src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0
2025-10-01T14:11:58.438629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1526 sessionId: src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0 is DEAD
2025-10-01T14:11:58.438764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:58.438775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0] Write session will restart in 0.006555s
2025-10-01T14:11:58.438801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0] Write session: Do CDS request
2025-10-01T14:11:58.438806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:58.442303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:58.443835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:58.444022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:58.444031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:58.444041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:58.444083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:58.444118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255872449961391:5652]
2025-10-01T14:11:58.444609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:58.444829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:58.444857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:58.445041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:58.445076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.445080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.445081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.445082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.445083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.445083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.445084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.445085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.445085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.445086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.445087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.445088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.445088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.445089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.445092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.445098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.445100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.445102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.445104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.445106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.445109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.445111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.445113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.445115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.445117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.445119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.445121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.445123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.445128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.445135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.445140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.445145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.445149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.445154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.445158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.445163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.445166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.445169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.445171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.445174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.445176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.445179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.445181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.445183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.445186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.445189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.445191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.445194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.445197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.445200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.445201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.445204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.445207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.445209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.445211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.445214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.445236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:58.446812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.446962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:58.446987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1527
2025-10-01T14:11:58.447109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.447143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1527 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:58.447154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1527 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:58.447157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:58.447655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1527 sessionId:  describe result for acl check
2025-10-01T14:11:58.447691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:58.447697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:58.447699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:58.447706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255874826843165:2647] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:58.448192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255874826843165:2647] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:58.448511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:58.449367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:58.449379Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:58.449382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:58.449385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:58.449391Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1526 [2:7556255872449961391:5652]
2025-10-01T14:11:58.449406Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:58.449427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:58.449435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.449438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.449440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.449455Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:58.449464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:58.449474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:58.449512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.449517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.449518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.449520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:58.449522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:58.449577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:58.449584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.449596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.449610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.449626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:58.449642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843090:2446], now have 1 active actors on pipe
2025-10-01T14:11:58.449647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255872449961386:5652]
2025-10-01T14:11:58.449652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255872449961386:5652]
2025-10-01T14:11:58.449654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255872449961386:5652]
2025-10-01T14:11:58.449665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:58.449675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:58.449677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:58.449678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:58.449684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:58.449696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:58.449704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:58.449694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1526
2025-10-01T14:11:58.449730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255872449961386:5652]
2025-10-01T14:11:58.449736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:58.449740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:58.450115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255874826843165:2647] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:58.455779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255874826843165:2647] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:58.455798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255874826843165:2647] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:58.455801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255874826843165:2647] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:58.455812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1527 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:58.456043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843206:2647], now have 1 active actors on pipe
2025-10-01T14:11:58.456095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1526
2025-10-01T14:11:58.456146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.456156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.456177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:58.456185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.456192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.456195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:58.456202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.456213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:58.456232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.456369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.456378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.456387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.456468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1527 partition: 0 MaxSeqNo: 45 sessionId: src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0
2025-10-01T14:11:58.456781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bec3a3ef-3be9a638-4eb55665-df57ad8f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:58.459049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0] Write session: try to update token
2025-10-01T14:11:58.459063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:58.469950Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:58.469970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:58.469973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:58.469976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:58.469986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255872449961386:5652]
2025-10-01T14:11:58.469992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255872449961386:5652]
2025-10-01T14:11:58.469996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255872449961386:5652]
2025-10-01T14:11:58.470030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:58.470035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:58.470038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:58.470043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:58.470050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.470053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:58.470198Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:58.471959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1527 sessionId: src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:58.474261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:58.530585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255874826843210:2856]
2025-10-01T14:11:58.530868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1526, pipe: [1:7556255874826843210:2856]
2025-10-01T14:11:58.610555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:58.610870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.610882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.610918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843210:2856], now have 1 active actors on pipe
2025-10-01T14:11:58.611082Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:58.611131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:58.611141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255874826843210:2856]
2025-10-01T14:11:58.611160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:58.611218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1527 reason: status is not ok: tablet will be restarted right now sessionId: src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0
2025-10-01T14:11:58.611385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1527 sessionId: src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0 is DEAD
2025-10-01T14:11:58.611564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:11:58.611575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0] Write session will restart in 0.007596s
2025-10-01T14:11:58.611603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0] Write session: Do CDS request
2025-10-01T14:11:58.611609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:58.619058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:58.619892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.619942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:58.619957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1528
2025-10-01T14:11:58.620156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.620215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1528 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:58.620226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1528 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:58.620230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:58.620620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1528 sessionId:  describe result for acl check
2025-10-01T14:11:58.620653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:58.620658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:58.620660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:58.620675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255874826843283:2636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:58.620632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:58.620789Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:58.620796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:58.620804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:58.620836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:58.620864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255872449961501:5654]
2025-10-01T14:11:58.621105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255874826843283:2636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:58.621239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:58.621423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:58.621456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:58.621698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:58.621758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.621763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.621764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.621765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.621766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.621767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.621768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.621769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.621770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.621771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.621772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.621773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.621774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.621775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.621780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.621788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.621791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.621794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.621797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.621800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.621802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.621805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.621808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.621811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.621813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.621816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.621819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.621822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.621827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.621835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.621841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.621845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.621849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.621853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.621857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.621861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.621865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.621870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.621874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.621880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.621885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.621890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.621893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.621898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.621903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.621915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.621919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.621923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.621932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.621937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.621944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.621949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.621958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.621963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.621969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.621978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.622009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:58.622881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255874826843283:2636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:58.625306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:58.625312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255874826843283:2636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:58.625324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255874826843283:2636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:58.625327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255874826843283:2636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:58.625332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1528 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:58.625900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:58.625917Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:58.625919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:58.625923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:58.625930Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1527 [2:7556255872449961501:5654]
2025-10-01T14:11:58.625944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:58.625958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:58.625961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.625965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.625967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.625982Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:58.625994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:58.625999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:58.626056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.626063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.626064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.626067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:58.626069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:58.626133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:58.626140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.626152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.626166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.626185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:58.626206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843322:2636], now have 1 active actors on pipe
2025-10-01T14:11:58.626213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843211:2446], now have 1 active actors on pipe
2025-10-01T14:11:58.626220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255872449961496:5654]
2025-10-01T14:11:58.626227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255872449961496:5654]
2025-10-01T14:11:58.626229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255872449961496:5654]
2025-10-01T14:11:58.626242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:58.626231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1527
2025-10-01T14:11:58.626254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:58.626257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:58.626232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1527
2025-10-01T14:11:58.626259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:58.626259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:58.626272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:58.626280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:58.626316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.626325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.626342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255872449961496:5654]
2025-10-01T14:11:58.626353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:58.626364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:58.626395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1c965e2-6328f522-f1335922-593f11f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:58.626406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.626415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.626420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:58.626428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.626442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:58.626469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.626581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.626590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.626605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.626683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1528 partition: 0 MaxSeqNo: 45 sessionId: src_id|f1c965e2-6328f522-f1335922-593f11f7_0
2025-10-01T14:11:58.626977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db97d5fd-2fe95e4b-cac7877b-e2f788a8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f1c965e2-6328f522-f1335922-593f11f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:58.629177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c965e2-6328f522-f1335922-593f11f7_0] Write session: try to update token
2025-10-01T14:11:58.629191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c965e2-6328f522-f1335922-593f11f7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:58.642208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1528 sessionId: src_id|f1c965e2-6328f522-f1335922-593f11f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:58.644357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:58.644571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.644592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.644629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:58.644688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:58.646502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:58.646515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:58.646517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:58.646518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:58.646527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255872449961496:5654]
2025-10-01T14:11:58.646530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255872449961496:5654]
2025-10-01T14:11:58.646533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255872449961496:5654]
2025-10-01T14:11:58.646569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:58.646574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.646576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:58.646582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:58.646588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:58.646592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:58.646696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:58.711348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255874826843330:2856]
2025-10-01T14:11:58.711601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1527, pipe: [1:7556255874826843330:2856]
2025-10-01T14:11:58.786347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:58.795173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.795207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.795373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.795434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.795498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.795558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.795602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.795615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.795684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.795745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.795803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.795865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.795906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.795915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.795981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.796035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.796098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.796170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.796212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.796220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.796279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.796339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.796399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.796458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.796499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.796506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.796579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.796636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.796707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.796770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.796813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.796820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.796879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.796936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.796996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.797057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.797100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.797107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.797166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.797224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.797285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.797343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.797385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.797391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.797448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.797507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.797561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.797619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.797663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.797669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.797731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.797791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.797851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.797908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.797950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.797956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.798017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:58.798071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:58.798127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:58.798184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:58.798225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:58.798233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:58.798294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843330:2856], now have 1 active actors on pipe
2025-10-01T14:11:58.798524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:58.798533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:58.798538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:58.798563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1528 reason: error at write: Disconnected sessionId: src_id|f1c965e2-6328f522-f1335922-593f11f7_0
2025-10-01T14:11:58.798568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255874826843330:2856]
2025-10-01T14:11:58.798740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1528 sessionId: src_id|f1c965e2-6328f522-f1335922-593f11f7_0 is DEAD
2025-10-01T14:11:58.798866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c965e2-6328f522-f1335922-593f11f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:58.798876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c965e2-6328f522-f1335922-593f11f7_0] Write session will restart in 0.007764s
2025-10-01T14:11:58.798910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c965e2-6328f522-f1335922-593f11f7_0] Write session: Do CDS request
2025-10-01T14:11:58.798916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c965e2-6328f522-f1335922-593f11f7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:58.799250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:58.806080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:58.807680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:58.807858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c965e2-6328f522-f1335922-593f11f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.807890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:58.807900Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:58.807910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:58.807935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:58.807956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:58.807948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1529
2025-10-01T14:11:58.808016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255872449961618:5642]
2025-10-01T14:11:58.808051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.808078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1529 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:58.808086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1529 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:58.808089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:58.808377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1529 sessionId:  describe result for acl check
2025-10-01T14:11:58.808406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:58.808411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:58.808412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:58.808415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255874826843429:2622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:58.808467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:58.808763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:58.808787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255874826843429:2622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:58.808820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:58.809147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:58.809199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.809203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.809204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.809205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.809205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.809206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.809207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.809207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.809208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.809208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.809209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.809210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.809211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.809211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.809214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.809220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.809222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.809224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.809226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.809229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.809231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.809233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.809235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.809237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.809239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.809241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.809243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.809245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.809250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.809255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.809259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.809262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.809266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.809269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.809271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.809274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.809276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.809279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.809282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.809284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.809287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.809295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.809298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.809300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.809305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.809307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.809310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.809312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.809315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.809318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.809324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.809327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.809332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.809335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.809337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.809343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.809362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:58.810520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255874826843429:2622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:58.812627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:58.812733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255874826843429:2622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:58.812746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255874826843429:2622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:58.812748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255874826843429:2622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:58.812757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1529 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:58.813163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:58.813177Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:58.813179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:58.813182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:58.813188Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1528 [2:7556255872449961618:5642]
2025-10-01T14:11:58.813198Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:58.813214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:58.813216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.813218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.813220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.813232Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:58.813239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:58.813243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:58.813278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.813282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.813283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.813285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:58.813286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:58.813331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:58.813336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.813343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.813348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.813357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:58.813375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843465:2622], now have 1 active actors on pipe
2025-10-01T14:11:58.813383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843356:2446], now have 1 active actors on pipe
2025-10-01T14:11:58.813389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255872449961613:5642]
2025-10-01T14:11:58.813391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255872449961613:5642]
2025-10-01T14:11:58.813393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255872449961613:5642]
2025-10-01T14:11:58.813402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:58.813412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:58.813414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:58.813415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:58.813415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:58.813411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1528
2025-10-01T14:11:58.813423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:58.813428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:58.813416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1528
2025-10-01T14:11:58.813446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255872449961613:5642]
2025-10-01T14:11:58.813452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:58.813454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:58.813466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.813471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.813499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:58.813507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.813513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.813515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:58.813522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.813531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:58.813546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.813629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.813634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.813643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.813694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1529 partition: 0 MaxSeqNo: 45 sessionId: src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0
2025-10-01T14:11:58.813958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c965e2-6328f522-f1335922-593f11f7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:58.816245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0] Write session: try to update token
2025-10-01T14:11:58.816259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:58.829692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1529 sessionId: src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:58.832015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:58.833473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.833493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.833512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:58.833515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:58.833519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:58.833521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:58.833529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255872449961613:5642]
2025-10-01T14:11:58.833536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255872449961613:5642]
2025-10-01T14:11:58.833540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255872449961613:5642]
2025-10-01T14:11:58.833582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:58.833594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:58.833598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:58.833609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:58.833619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.833624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:58.833744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:58.898670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255874826843474:2856]
2025-10-01T14:11:58.898900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1528, pipe: [1:7556255874826843474:2856]
2025-10-01T14:11:58.967908Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:58.968265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:58.968309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843474:2856], now have 1 active actors on pipe
2025-10-01T14:11:58.968383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:58.968435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255874826843474:2856]
2025-10-01T14:11:58.968454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:58.968471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:58.968473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:58.968539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1529 reason: error at write: Disconnected sessionId: src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0
2025-10-01T14:11:58.968686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1529 sessionId: src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0 is DEAD
2025-10-01T14:11:58.968770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:58.968776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0] Write session will restart in 0.009826s
2025-10-01T14:11:58.968794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0] Write session: Do CDS request
2025-10-01T14:11:58.968800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:58.976368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:58.977589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:58.977720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:58.977728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:58.977736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:58.977769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:58.977797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255872449961729:5640]
2025-10-01T14:11:58.978197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:58.978460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:58.978501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:58.978800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:58.978855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.978861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.978862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.978863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.978864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.978865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.978866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.978868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.978868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.978869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.978870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.978871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.978873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.978874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.978879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.978889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.978893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.978897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.978900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.978904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.978907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.978911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.978914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.978919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.978922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.978926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.978932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.978935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.978942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.978955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:58.978965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.978970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:58.978979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.978984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:58.978992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.978997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:58.979003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.979008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:58.979017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.979021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:58.979028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.979032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:58.979038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.979043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:58.979048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.979055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:58.979059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.979064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.979073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.979078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.979086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.979091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.979100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.979105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:58.979111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.979116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:58.979156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:58.979871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.979953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:58.979968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1530
2025-10-01T14:11:58.980061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:58.980089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1530 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:58.980102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1530 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:58.980105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:58.980391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1530 sessionId:  describe result for acl check
2025-10-01T14:11:58.980419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:58.980424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:58.980426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:58.980430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255874826843558:2617] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:58.980828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255874826843558:2617] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:58.982066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255874826843558:2617] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:58.982685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:58.983221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:58.983233Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:58.983236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:58.983239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:58.983244Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1529 [2:7556255872449961729:5640]
2025-10-01T14:11:58.983253Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:58.983266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:58.983271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.983273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.983274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.983285Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:58.983288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:58.983292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:58.983329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.983334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.983335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.983337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:58.983339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:58.983385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:58.983391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:58.983398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:58.983407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:58.983419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:58.983437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843480:2446], now have 1 active actors on pipe
2025-10-01T14:11:58.983445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255872449961724:5640]
2025-10-01T14:11:58.983450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255872449961724:5640]
2025-10-01T14:11:58.983451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255872449961724:5640]
2025-10-01T14:11:58.983462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:58.983470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:58.983475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:58.983477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:58.983478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:58.983487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:58.983494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:58.983465Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1529
2025-10-01T14:11:58.983524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255872449961724:5640]
2025-10-01T14:11:58.983533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:58.983536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:58.985237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255874826843558:2617] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:58.985248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255874826843558:2617] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:58.985251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255874826843558:2617] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:58.985256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1530 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:58.985432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255874826843593:2617], now have 1 active actors on pipe
2025-10-01T14:11:58.985447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1529
2025-10-01T14:11:58.985490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.985500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.985519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:58.985530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:58.985536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:58.985538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:58.985544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:58.985556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:58.985569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.985673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:58.985678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:58.985686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:58.985738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1530 partition: 0 MaxSeqNo: 45 sessionId: src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0
2025-10-01T14:11:58.986003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2da8c20f-cbcc5b8a-7386535b-28910adf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:58.988340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0] Write session: try to update token
2025-10-01T14:11:58.988355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:58.998483Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:11:58.998498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:58.998509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255872449961724:5640]
2025-10-01T14:11:58.998551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:11:58.998550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:11:58.998714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:11:58.998865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:58.998989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:58.999120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:11:58.999290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:11:58.999320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:11:59.001084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1530 sessionId: src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:59.003188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:59.003452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.003465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.003489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:59.003544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:59.010964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:59.010986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:59.010990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:59.010992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:59.011007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255872449961724:5640]
2025-10-01T14:11:59.011011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255872449961724:5640]
2025-10-01T14:11:59.011014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255872449961724:5640]
2025-10-01T14:11:59.011051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:59.011056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:59.011058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:59.011061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:59.011067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.011070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:59.011216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:59.068955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255879121810892:2856]
2025-10-01T14:11:59.069183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1529, pipe: [1:7556255879121810892:2856]
2025-10-01T14:11:59.154660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:59.161020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.161041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.161174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.161223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.161279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.161329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.161367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.161374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.161428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.161482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.161529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.161580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.161620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.161626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.161679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.161733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.161886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.161942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.161982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.161987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.162043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.162094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.162146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.162198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.162237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.162242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.162297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.162345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.162419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.162478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.162521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.162526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.162583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.162633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.162685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.162739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.162777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.162781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.162836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.162884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.162937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.162989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.163026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.163033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.163092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.163153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.163216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.163289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.163325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.163330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.163383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.163432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.163487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.163538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.163576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.163580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.163633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.163682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.163733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.163782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.163963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.163971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.164011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121810892:2856], now have 1 active actors on pipe
2025-10-01T14:11:59.164496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:59.164503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:59.164509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:59.164531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1530 reason: error at write: Disconnected sessionId: src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0
2025-10-01T14:11:59.164538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255879121810892:2856]
2025-10-01T14:11:59.164746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1530 sessionId: src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0 is DEAD
2025-10-01T14:11:59.164853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:59.164859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0] Write session will restart in 0.006937s
2025-10-01T14:11:59.164878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0] Write session: Do CDS request
2025-10-01T14:11:59.164862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:59.164883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:59.172851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.172912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:59.172930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1531
2025-10-01T14:11:59.173012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.173035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1531 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:59.173042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1531 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:59.173045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:59.173360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:59.173364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1531 sessionId:  describe result for acl check
2025-10-01T14:11:59.173395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:59.173396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:59.173397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:59.173401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255879121810968:2611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:59.173761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255879121810968:2611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:59.174823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:59.174967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:59.174977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:59.174986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:59.175026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:59.175059Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255876744929180:5608]
2025-10-01T14:11:59.175595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255879121810968:2611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:59.175600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:59.175853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:59.175898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:59.176124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:59.176171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.176176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.176177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.176178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.176179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.176179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.176180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.176181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.176181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.176182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.176183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.176184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.176184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.176185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.176189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.176194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.176196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.176199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.176201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.176203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.176205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.176207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.176210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.176213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.176215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.176217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.176219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.176221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.176226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.176230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.176235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.176241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.176245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.176249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.176254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.176259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.176263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.176268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.176271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.176273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.176276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.176279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.176282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.176284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.176287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.176290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.176292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.176295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.176298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.176301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.176303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.176306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.176308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.176311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.176313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.176315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.176335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:59.179507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255879121810968:2611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:59.179520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255879121810968:2611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:59.179522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255879121810968:2611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:59.179528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1531 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:59.179728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:59.180301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:59.180312Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:59.180314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:59.180317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:59.180324Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1530 [2:7556255876744929180:5608]
2025-10-01T14:11:59.180338Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:59.180353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:59.180360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.180363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.180365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.180380Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:59.180389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:59.180395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:59.180447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.180454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.180456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.180459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:59.180461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:59.180522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:59.180528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.180539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.180554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.180572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:59.180593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121810895:2446], now have 1 active actors on pipe
2025-10-01T14:11:59.180600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811008:2611], now have 1 active actors on pipe
2025-10-01T14:11:59.180606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255876744929175:5608]
2025-10-01T14:11:59.180612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255876744929175:5608]
2025-10-01T14:11:59.180614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255876744929175:5608]
2025-10-01T14:11:59.180605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1530
2025-10-01T14:11:59.180626Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:59.180611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1530
2025-10-01T14:11:59.180642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:59.180633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:59.180645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:59.180647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:59.180659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:59.180672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:59.180717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.180725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.180741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255876744929175:5608]
2025-10-01T14:11:59.180751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:59.180757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:59.180775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9e21456-3411bd31-94ba2787-99d7596_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:59.180786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.180793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.180796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:59.180803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.180815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:59.180837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.180958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.180964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.180976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.181049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1531 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9e21456-3411bd31-94ba2787-99d7596_0
2025-10-01T14:11:59.181348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f38e3e2-e7a1fa3a-2b5bddbf-3cafc483_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9e21456-3411bd31-94ba2787-99d7596_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:59.183644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e21456-3411bd31-94ba2787-99d7596_0] Write session: try to update token
2025-10-01T14:11:59.183658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e21456-3411bd31-94ba2787-99d7596_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:59.196019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1531 sessionId: src_id|f9e21456-3411bd31-94ba2787-99d7596_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:59.198387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:59.198678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.198697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.198727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:59.198786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:59.200481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:59.200495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:59.200496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:59.200498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:59.200504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255876744929175:5608]
2025-10-01T14:11:59.200507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255876744929175:5608]
2025-10-01T14:11:59.200509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255876744929175:5608]
2025-10-01T14:11:59.200539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:59.200543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:59.200543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:59.200546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:59.200547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.200549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:59.200672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:59.264814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255879121811027:2856]
2025-10-01T14:11:59.265011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1530, pipe: [1:7556255879121811027:2856]
2025-10-01T14:11:59.334653Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:59.344740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.344773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.344976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.345059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.345144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.345226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.345776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.345791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.345883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.345970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.346053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.346135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.346188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.346197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.346283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.346360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.346457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.346538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.346594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.346603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.346683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.346762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.346840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.346918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.346971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.346979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.347057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.347137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.347217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.347295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.347348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.347357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.347441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.347521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.347602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.347687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.347768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.347777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.347857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.347936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.348017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.348098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.348151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.348158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.348237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.348312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.348390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.348465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.348516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.348525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.348606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.348692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.348773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.348857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.348913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.348921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.349003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:11:59.349081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:11:59.349164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:11:59.349242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:11:59.349293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:11:59.349300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:11:59.349373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811027:2856], now have 1 active actors on pipe
2025-10-01T14:11:59.349643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:59.349681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:59.349685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:59.349711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255879121811027:2856]
2025-10-01T14:11:59.349718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1531 reason: error at write: Disconnected sessionId: src_id|f9e21456-3411bd31-94ba2787-99d7596_0
2025-10-01T14:11:59.349962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1531 sessionId: src_id|f9e21456-3411bd31-94ba2787-99d7596_0 is DEAD
2025-10-01T14:11:59.350123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e21456-3411bd31-94ba2787-99d7596_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:59.350132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e21456-3411bd31-94ba2787-99d7596_0] Write session will restart in 0.006556s
2025-10-01T14:11:59.350159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e21456-3411bd31-94ba2787-99d7596_0] Write session: Do CDS request
2025-10-01T14:11:59.350166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e21456-3411bd31-94ba2787-99d7596_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:59.350172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:59.357971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e21456-3411bd31-94ba2787-99d7596_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.358047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:59.358075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1532
2025-10-01T14:11:59.358660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.358701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1532 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:59.358711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1532 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:59.358714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:59.359088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1532 sessionId:  describe result for acl check
2025-10-01T14:11:59.359116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:59.359120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:59.359124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:59.359127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255879121811083:2600] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:59.359560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255879121811083:2600] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:59.362309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255879121811083:2600] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:59.362331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:59.364059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:59.364296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:59.364309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:59.364323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:59.364385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:59.364433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255876744929294:5606]
2025-10-01T14:11:59.364688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255879121811083:2600] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:59.364703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255879121811083:2600] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:59.364707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255879121811083:2600] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:59.364719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1532 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:59.365139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:59.365442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:59.365495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:59.365846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:59.365920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.365926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.365928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.365929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.365931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.365932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.365933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.365935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.365936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.365938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.365939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.365940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.365942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.365943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.365949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.365959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.365964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.365968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.365972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.365976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.365980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.365984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.365988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.365992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.365996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.366004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.366008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.366018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.366026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.366039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.366049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.366055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.366066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.366076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.366083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.366089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.366098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.366103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.366112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.366117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.366127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.366132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.366141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.366146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.366155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.366160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.366168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.366173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.366177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.366187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.366191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.366196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.366201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.366206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.366210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.366220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.366260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:59.370145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:59.370908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:59.370927Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:59.370929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:59.370933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:59.370940Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1531 [2:7556255876744929294:5606]
2025-10-01T14:11:59.370957Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:59.370976Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:59.370997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.371008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.371016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.371033Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:59.371044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:59.371050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:59.371112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.371118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.371121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.371124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:59.371127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:59.371197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:59.371208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.371218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.371224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.371233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:59.371247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811142:2600], now have 1 active actors on pipe
2025-10-01T14:11:59.371250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811032:2446], now have 1 active actors on pipe
2025-10-01T14:11:59.371255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255876744929289:5606]
2025-10-01T14:11:59.371257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255876744929289:5606]
2025-10-01T14:11:59.371258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255876744929289:5606]
2025-10-01T14:11:59.371268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:59.371277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:59.371283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:59.371286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:59.371288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:59.371290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:59.371293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:59.371315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255876744929289:5606]
2025-10-01T14:11:59.371322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:59.371292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1531
2025-10-01T14:11:59.371323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:59.371328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1531
2025-10-01T14:11:59.371337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.371342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.371391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:59.371400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.371404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.371405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:59.371412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.371418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:59.371432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.371592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.371600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.371611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.371679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1532 partition: 0 MaxSeqNo: 45 sessionId: src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0
2025-10-01T14:11:59.372018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e21456-3411bd31-94ba2787-99d7596_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:59.374289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0] Write session: try to update token
2025-10-01T14:11:59.374305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:59.387835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1532 sessionId: src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:59.390270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:59.391262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.391287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.391309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:59.391312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:59.391314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:59.391316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:59.391322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255876744929289:5606]
2025-10-01T14:11:59.391325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255876744929289:5606]
2025-10-01T14:11:59.391328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255876744929289:5606]
2025-10-01T14:11:59.391363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:59.391374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:59.391377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:59.391381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:59.391387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.391390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:59.391509Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:59.449627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255879121811158:2856]
2025-10-01T14:11:59.449879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1531, pipe: [1:7556255879121811158:2856]
2025-10-01T14:11:59.527613Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:59.527946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:59.527989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811158:2856], now have 1 active actors on pipe
2025-10-01T14:11:59.528052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:59.528125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:59.528179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255879121811158:2856]
2025-10-01T14:11:59.536352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:59.536370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:59.536388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1532 reason: error at write: Disconnected sessionId: src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0
2025-10-01T14:11:59.536508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1532 sessionId: src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0 is DEAD
2025-10-01T14:11:59.536681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:59.536700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0] Write session will restart in 0.008765s
2025-10-01T14:11:59.536720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0] Write session: Do CDS request
2025-10-01T14:11:59.536727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:59.541302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:59.542874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:59.542997Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:59.543004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:59.543012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:59.543039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:59.543070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255876744929410:5605]
2025-10-01T14:11:59.543510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:59.543790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:59.543828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:59.544060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:59.544095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.544099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.544100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.544101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.544101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.544102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.544103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.544104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.544105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.544105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.544106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.544107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.544107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.544108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.544111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.544117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.544119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.544121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.544123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.544125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.544127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.544129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.544131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.544134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.544136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.544138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.544139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.544142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.544146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.544151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.544155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.544158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.544161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.544163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.544166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.544169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.544171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.544174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.544177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.544180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.544182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.544185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.544188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.544191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.544194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.544197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.544199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.544202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.544204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.544207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.544208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.544211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.544213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.544216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.544218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.544221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.544243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:59.546809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.546875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:59.546890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1533
2025-10-01T14:11:59.546984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.547015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1533 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:59.547022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1533 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:59.547025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:59.547330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1533 sessionId:  describe result for acl check
2025-10-01T14:11:59.547360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:59.547366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:59.547367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:59.547372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255879121811245:2587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:59.547630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:59.547754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255879121811245:2587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:59.548174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:59.548186Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:59.548188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:59.548190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:59.548195Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1532 [2:7556255876744929410:5605]
2025-10-01T14:11:59.548206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:59.548217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:59.548218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.548221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.548222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.548233Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:59.548240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:59.548244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:59.548282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.548287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.548288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.548291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:59.548292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:59.548336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:59.548342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.548348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.548357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.548370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:59.548388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811164:2446], now have 1 active actors on pipe
2025-10-01T14:11:59.548398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255876744929403:5605]
2025-10-01T14:11:59.548404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255876744929403:5605]
2025-10-01T14:11:59.548405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255876744929403:5605]
2025-10-01T14:11:59.548416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:59.548423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:59.548425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:59.548427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:59.548432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:59.548430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1532
2025-10-01T14:11:59.548449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:59.548455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:59.548487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255876744929403:5605]
2025-10-01T14:11:59.548499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:59.548504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:59.549841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255879121811245:2587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:59.554851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255879121811245:2587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:59.554864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255879121811245:2587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:59.554867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255879121811245:2587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:59.554872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1533 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:59.555066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811282:2587], now have 1 active actors on pipe
2025-10-01T14:11:59.555096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1532
2025-10-01T14:11:59.555154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.555163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.555188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:59.555200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.555208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.555210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:59.555219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.555232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:59.555250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.555369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.555375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.555384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.555452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1533 partition: 0 MaxSeqNo: 45 sessionId: src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0
2025-10-01T14:11:59.555731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abcdacc-a3b49f73-da2d5a5a-1822d462_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:59.558089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0] Write session: try to update token
2025-10-01T14:11:59.558106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:59.567918Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:59.567938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:59.567940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:59.567942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:59.567953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255876744929403:5605]
2025-10-01T14:11:59.567962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255876744929403:5605]
2025-10-01T14:11:59.567965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255876744929403:5605]
2025-10-01T14:11:59.568007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:59.568006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:59.568011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:59.568013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:59.568018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.568019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:59.568142Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:59.570441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1533 sessionId: src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:59.572604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:59.628328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255879121811286:2856]
2025-10-01T14:11:59.628540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1532, pipe: [1:7556255879121811286:2856]
2025-10-01T14:11:59.699809Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:59.700254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.700267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.700365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811286:2856], now have 1 active actors on pipe
2025-10-01T14:11:59.700589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:11:59.700588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:59.700597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255879121811286:2856]
2025-10-01T14:11:59.700621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:59.700623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:59.700683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1533 reason: error at write: Disconnected sessionId: src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0
2025-10-01T14:11:59.700863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1533 sessionId: src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0 is DEAD
2025-10-01T14:11:59.700983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:59.700991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0] Write session will restart in 0.007397s
2025-10-01T14:11:59.701016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0] Write session: Do CDS request
2025-10-01T14:11:59.701022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:59.708745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:59.709788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.709887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:59.709905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1534
2025-10-01T14:11:59.710018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.710051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1534 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:59.710056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1534 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:59.710060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:59.710461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1534 sessionId:  describe result for acl check
2025-10-01T14:11:59.710501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:59.710507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:59.710509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:59.710514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255879121811365:2582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:59.710495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:59.710654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:59.710662Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:59.710670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:59.710706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:59.710745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255876744929524:5599]
2025-10-01T14:11:59.711031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255879121811365:2582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:59.711161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:59.711392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:59.711435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:59.711647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:59.711684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.711690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.711691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.711692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.711692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.711693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.711694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.711695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.711695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.711696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.711697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.711697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.711698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.711699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.711702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.711708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.711711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.711713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.711715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.711717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.711719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.711721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.711723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.711727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.711729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.711731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.711733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.711735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.711740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.711744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.711749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.711752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.711762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.711765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.711768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.711771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.711773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.711776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.711779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.711781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.711784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.711787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.711789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.711792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.711795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.711800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.711804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.711808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.711814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.711818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.711822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.711827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.711833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.711836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.711839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.711852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.711876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:59.712862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255879121811365:2582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:59.714940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255879121811365:2582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:59.714951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255879121811365:2582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:59.714953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255879121811365:2582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:59.714959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1534 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:59.715242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:59.715803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:59.715815Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:59.715817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:59.715819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:59.715824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1533 [2:7556255876744929524:5599]
2025-10-01T14:11:59.715834Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:59.715847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:59.715852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.715855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.715856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.715867Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:59.715875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:59.715879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:59.715934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.715938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.715939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.715941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:59.715943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:59.715985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:59.715990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.715997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.716007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.716026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:59.716046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811288:2446], now have 1 active actors on pipe
2025-10-01T14:11:59.716052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811404:2582], now have 1 active actors on pipe
2025-10-01T14:11:59.716057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255876744929519:5599]
2025-10-01T14:11:59.716058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255876744929519:5599]
2025-10-01T14:11:59.716060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255876744929519:5599]
2025-10-01T14:11:59.716068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:59.716080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:59.716083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:59.716071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1533
2025-10-01T14:11:59.716086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:59.716088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:59.716090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:59.716092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:59.716098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1533
2025-10-01T14:11:59.716113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255876744929519:5599]
2025-10-01T14:11:59.716118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:59.716125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:59.716128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.716131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.716157Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:59.716165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.716167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.716169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:59.716174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.716183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:59.716199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.716300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.716306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.716317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.716396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1534 partition: 0 MaxSeqNo: 45 sessionId: src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0
2025-10-01T14:11:59.716688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3981e6f-d466a2a5-170b553c-a11a544b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:59.718948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0] Write session: try to update token
2025-10-01T14:11:59.718964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:59.731251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1534 sessionId: src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:59.733440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:59.734853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.734877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.734894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:59.734896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:59.734897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:59.734899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:59.734904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255876744929519:5599]
2025-10-01T14:11:59.734910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255876744929519:5599]
2025-10-01T14:11:59.734912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255876744929519:5599]
2025-10-01T14:11:59.734944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:59.734953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:59.734956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:59.734956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:59.734961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.734962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:59.735112Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:59.800836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255879121811434:2856]
2025-10-01T14:11:59.801018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1533, pipe: [1:7556255879121811434:2856]
2025-10-01T14:11:59.867907Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:11:59.868223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:11:59.868359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:11:59.868274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811434:2856], now have 1 active actors on pipe
2025-10-01T14:11:59.868411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255879121811434:2856]
2025-10-01T14:11:59.868449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:11:59.868896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:11:59.868903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:11:59.868958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1534 reason: error at write: Disconnected sessionId: src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0
2025-10-01T14:11:59.869091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1534 sessionId: src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0 is DEAD
2025-10-01T14:11:59.869193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:11:59.869210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0] Write session will restart in 0.009858s
2025-10-01T14:11:59.869235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0] Write session: Do CDS request
2025-10-01T14:11:59.869241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:11:59.876786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:11:59.878486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:11:59.878668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:11:59.878677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:11:59.878688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:11:59.878746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:11:59.878774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255876744929647:5587]
2025-10-01T14:11:59.879138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:11:59.879349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:11:59.879382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:11:59.879590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:11:59.879624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.879630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.879631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.879632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.879632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.879633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.879633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.879634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.879634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.879635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.879635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.879636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.879636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.879637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.879640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.879646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.879648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.879650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.879652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.879654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.879656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.879658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.879660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.879662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.879664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.879666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.879668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.879670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.879675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.879679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:11:59.879683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.879686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:11:59.879689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.879691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:11:59.879693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.879696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:11:59.879698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.879701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:11:59.879703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.879706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:11:59.879708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.879711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:11:59.879713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.879716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:11:59.879719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.879722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:11:59.879725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.879728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.879730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.879733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.879735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.879737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.879740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.879742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:11:59.879744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.879747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:11:59.879766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:11:59.879861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.879921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:11:59.879935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1535
2025-10-01T14:11:59.880026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:11:59.880054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1535 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:11:59.880063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1535 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:11:59.880066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:11:59.880376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1535 sessionId:  describe result for acl check
2025-10-01T14:11:59.880403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:11:59.880409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:11:59.880411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:11:59.880415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255879121811521:2561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:11:59.880866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255879121811521:2561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:11:59.882229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255879121811521:2561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:11:59.883097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:11:59.883671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:11:59.883679Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:11:59.883681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:11:59.883683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:11:59.883688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1534 [2:7556255876744929647:5587]
2025-10-01T14:11:59.883698Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:11:59.883709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:11:59.883713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.883716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.883717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.883729Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:11:59.883735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:11:59.883740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:11:59.883845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.883852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.883853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.883856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:11:59.883858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:11:59.883924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:11:59.883930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.883939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:11:59.883953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:11:59.883970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:11:59.883986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811437:2446], now have 1 active actors on pipe
2025-10-01T14:11:59.883997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255876744929642:5587]
2025-10-01T14:11:59.883999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255876744929642:5587]
2025-10-01T14:11:59.884001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255876744929642:5587]
2025-10-01T14:11:59.884011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:11:59.883999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1534
2025-10-01T14:11:59.884020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:11:59.884026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:11:59.884027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:11:59.884028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:11:59.884040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:11:59.884046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:11:59.884073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255876744929642:5587]
2025-10-01T14:11:59.884083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:11:59.884087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:11:59.884344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255879121811521:2561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:11:59.884357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255879121811521:2561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:11:59.884359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255879121811521:2561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:11:59.884366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1535 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:11:59.884482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811556:2561], now have 1 active actors on pipe
2025-10-01T14:11:59.884522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1534
2025-10-01T14:11:59.884567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.884574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.884591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:11:59.884600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:11:59.884606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:11:59.884608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:11:59.884616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:11:59.884625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:11:59.884641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.884798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.884806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.884824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:11:59.884880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1535 partition: 0 MaxSeqNo: 45 sessionId: src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0
2025-10-01T14:11:59.885127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f783ac75-1e31d25-6bc5326d-1f3d9438_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:11:59.887403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0] Write session: try to update token
2025-10-01T14:11:59.887416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:11:59.899993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1535 sessionId: src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:11:59.902426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:11:59.903846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:11:59.903867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:11:59.903896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:11:59.903902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:11:59.903905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:11:59.903906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:11:59.903913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255876744929642:5587]
2025-10-01T14:11:59.903919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255876744929642:5587]
2025-10-01T14:11:59.903923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255876744929642:5587]
2025-10-01T14:11:59.903961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:11:59.903968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:11:59.903972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:11:59.903973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:11:59.903974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:11:59.903975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:11:59.904097Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:11:59.968801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255879121811563:2856]
2025-10-01T14:11:59.969029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1534, pipe: [1:7556255879121811563:2856]
2025-10-01T14:12:00.039797Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:00.040100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:00.040147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255879121811563:2856], now have 1 active actors on pipe
2025-10-01T14:12:00.040240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:00.040289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:00.040330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:00.040335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255879121811563:2856]
2025-10-01T14:12:00.040338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:00.040404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1535 reason: error at write: Disconnected sessionId: src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0
2025-10-01T14:12:00.040584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1535 sessionId: src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0 is DEAD
2025-10-01T14:12:00.040714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:00.040722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0] Write session will restart in 0.007510s
2025-10-01T14:12:00.040741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0] Write session: Do CDS request
2025-10-01T14:12:00.040747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:00.049919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.050005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:00.050021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1536
2025-10-01T14:12:00.050122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.050151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1536 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:00.050161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1536 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:00.050164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:00.050207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:00.050557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1536 sessionId:  describe result for acl check
2025-10-01T14:12:00.050595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:00.050601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:00.050602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:00.050608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255883416778940:2559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:00.051099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255883416778940:2559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:00.051931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:00.052137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:00.052149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:00.052160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:00.052229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:00.052276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255881039897074:5584]
2025-10-01T14:12:00.052813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:00.052849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255883416778940:2559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:00.053078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:00.053125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:00.053452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:00.053502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.053508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.053509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.053509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.053510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.053512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.053513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.053514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.053515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.053516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.053517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.053518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.053519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.053520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.053525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.053535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.053538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.053542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.053546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.053549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.053551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.053552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.053554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.053556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.053558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.053560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.053562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.053564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.053568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.053573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.053577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.053579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.053582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.053585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.053587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.053592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.053596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.053600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.053604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.053608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.053612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.053616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.053621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.053625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.053629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.053634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.053641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.053646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.053656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.053658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.053661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.053663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.053666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.053669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.053671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.053675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.053696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:00.056846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255883416778940:2559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:00.056863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255883416778940:2559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:00.056865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255883416778940:2559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:00.056871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1536 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:00.057122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:00.057686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:00.057695Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:00.057697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:00.057699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:00.057705Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1535 [2:7556255881039897074:5584]
2025-10-01T14:12:00.057716Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:00.057729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:00.057731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.057733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.057734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.057746Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:00.057753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:00.057757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:00.057797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.057802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.057803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.057805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:00.057807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:00.057853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:00.057858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.057864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.057870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.057879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:00.057896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255881039897069:5584]
2025-10-01T14:12:00.057902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255881039897069:5584]
2025-10-01T14:12:00.057904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255881039897069:5584]
2025-10-01T14:12:00.057913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:00.057919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:00.057922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:00.057924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:00.057932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416778979:2559], now have 1 active actors on pipe
2025-10-01T14:12:00.057941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416778860:2446], now have 1 active actors on pipe
2025-10-01T14:12:00.057946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:00.057963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:00.057969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:00.057994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255881039897069:5584]
2025-10-01T14:12:00.058005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:00.058007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:00.057996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1535
2025-10-01T14:12:00.058004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1535
2025-10-01T14:12:00.058046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.058054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.058076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:00.058086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.058109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.058112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:00.058119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.058130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:00.058146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.058296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.058310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.058333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.058418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1536 partition: 0 MaxSeqNo: 45 sessionId: src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0
2025-10-01T14:12:00.058764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89985e3a-e187e2cd-31e7ed47-2956f36a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:00.061119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0] Write session: try to update token
2025-10-01T14:12:00.061134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:00.074176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:00.074195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:00.074205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255881039897069:5584]
2025-10-01T14:12:00.074252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:00.074256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:00.074398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1536 sessionId: src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:00.074584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:00.074739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.074884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.075034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.075244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:00.075286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:00.076926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:00.077083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.077097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.077127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:00.078988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:00.087275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:00.087289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:00.087291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:00.087293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:00.087300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255881039897069:5584]
2025-10-01T14:12:00.087303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255881039897069:5584]
2025-10-01T14:12:00.087306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255881039897069:5584]
2025-10-01T14:12:00.087342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:00.087347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.087348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:00.087359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:00.087365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:00.087369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:00.087472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:00.140301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255883416778987:2856]
2025-10-01T14:12:00.140541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1535, pipe: [1:7556255883416778987:2856]
2025-10-01T14:12:00.227200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:00.234489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.234514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.234664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.234716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.234784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.237710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:00.237740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:00.237744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:00.237768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255883416778987:2856]
2025-10-01T14:12:00.237772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1536 reason: error at write: Disconnected sessionId: src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0
2025-10-01T14:12:00.237946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1536 sessionId: src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0 is DEAD
2025-10-01T14:12:00.238116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:00.238124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0] Write session will restart in 0.005990s
2025-10-01T14:12:00.238151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0] Write session: Do CDS request
2025-10-01T14:12:00.238168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:00.234842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.234889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.234893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.234957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.235004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.235054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.235111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.235154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.235162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.235235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.235299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.235360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.235426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.235469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.235472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.235536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.235596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.235653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.235711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.235748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.235750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.235812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.235864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.235916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.235967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.236055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.236058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.236124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.236182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.236241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.236296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.236331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.236333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.236390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.236439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.236493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.236551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.236596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.236599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.236675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.236738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.236790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.236842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.236877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.236879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.236941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.236989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.237041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.237100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.237141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.237143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.237207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.237257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.237315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.237373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.237409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.237411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.237456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416778987:2856], now have 1 active actors on pipe
2025-10-01T14:12:00.238507Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:00.244913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.244997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:00.245012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1537
2025-10-01T14:12:00.245157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.245194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1537 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:00.245203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1537 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:00.245206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:00.245590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1537 sessionId:  describe result for acl check
2025-10-01T14:12:00.245626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:00.245628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:00.245629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:00.245634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255883416779076:2554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:00.246067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255883416779076:2554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:00.246926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:00.248064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255883416779076:2554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:00.248413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:00.248611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:00.248621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:00.248631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:00.248691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:00.248731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255881039897222:5564]
2025-10-01T14:12:00.249289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:00.249613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:00.249654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:00.249929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:00.249983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.249988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.249990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.249991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.249992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.249993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.249995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.249996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.249997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.249998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.249999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.250000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.250001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.250002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.250007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.250017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.250021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.250025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.250028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.250032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.250036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.250039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.250043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.250047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.250050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.250054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.250061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.250065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.250075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.250088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.250097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.250106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.250114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.250118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.250126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.250134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.250139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.250143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.250151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.250156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.250162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.250167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.250175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.250180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.250184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.250192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.250197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.250205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.250225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.250234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.250238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.250243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.250250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.250254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.250258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.250266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.250306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:00.250488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255883416779076:2554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:00.250501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255883416779076:2554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:00.250503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255883416779076:2554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:00.250511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1537 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:00.254084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:00.254682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:00.254694Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:00.254697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:00.254701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:00.254708Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1536 [2:7556255881039897222:5564]
2025-10-01T14:12:00.254727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:00.254748Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:00.254755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.254758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.254761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.254777Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:00.254786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:00.254792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:00.254851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.254858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.254862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.254865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:00.254867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:00.254929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:00.254935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.254947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.254961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.254981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:00.255006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779121:2554], now have 1 active actors on pipe
2025-10-01T14:12:00.255017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255881039897217:5564]
2025-10-01T14:12:00.255020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255881039897217:5564]
2025-10-01T14:12:00.255021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255881039897217:5564]
2025-10-01T14:12:00.255034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:00.255048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779003:2446], now have 1 active actors on pipe
2025-10-01T14:12:00.255053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:00.255056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:00.255059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:00.255059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:00.255071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:00.255077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:00.255110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255881039897217:5564]
2025-10-01T14:12:00.255120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:00.255113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1536
2025-10-01T14:12:00.255131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:00.255259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1536
2025-10-01T14:12:00.255298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.255308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.255333Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c84a7479-f595241c-bb3078fa-2993621c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:00.255344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.255352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.255354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:00.255362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.255374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:00.255390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.255529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.255535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.255548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.255608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1537 partition: 0 MaxSeqNo: 45 sessionId: src_id|c84a7479-f595241c-bb3078fa-2993621c_0
2025-10-01T14:12:00.255977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6361e13-d255ea3-9d16c6ec-b83fc217_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c84a7479-f595241c-bb3078fa-2993621c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:00.258904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c84a7479-f595241c-bb3078fa-2993621c_0] Write session: try to update token
2025-10-01T14:12:00.258923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c84a7479-f595241c-bb3078fa-2993621c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:00.265339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:00.265356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:00.265369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255881039897217:5564]
2025-10-01T14:12:00.265403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:00.265409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:00.265569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:00.265702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.265830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.265952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.266123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:00.266158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:00.272229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1537 sessionId: src_id|c84a7479-f595241c-bb3078fa-2993621c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:00.274546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:00.274697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.274715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.274743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:00.274817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:00.283169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:00.283189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:00.283191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:00.283193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:00.283204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255881039897217:5564]
2025-10-01T14:12:00.283207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255881039897217:5564]
2025-10-01T14:12:00.283211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255881039897217:5564]
2025-10-01T14:12:00.283256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:00.283257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:00.283261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:00.283264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:00.283266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.283268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:00.283378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:00.337944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255883416779130:2856]
2025-10-01T14:12:00.338224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1536, pipe: [1:7556255883416779130:2856]
2025-10-01T14:12:00.419413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:00.425948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.425969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.426101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.426147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.426201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.426245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.426287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.426297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.426352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.426418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.426476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.426527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.426565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.426570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.426626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.426676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.426734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.426791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.426829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.426835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.426892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.426952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.427005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.427058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.427096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.427101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.427154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.427203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.427253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.427304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.427349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.427354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.427408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.427468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.427528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.427582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.427620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.427624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.427682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.427732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.427786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.427839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.427877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.427882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.427931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.427978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.428026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.428075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.428112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.428117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.428175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.428240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.428298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.428352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.428389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.428394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.428454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.428518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.428570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.428621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.428669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.428674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.428720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779130:2856], now have 1 active actors on pipe
2025-10-01T14:12:00.428939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:00.428943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255883416779130:2856]
2025-10-01T14:12:00.428954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:00.428966Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:00.428979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1537 reason: error at write: Disconnected sessionId: src_id|c84a7479-f595241c-bb3078fa-2993621c_0
2025-10-01T14:12:00.429189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1537 sessionId: src_id|c84a7479-f595241c-bb3078fa-2993621c_0 is DEAD
2025-10-01T14:12:00.429324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c84a7479-f595241c-bb3078fa-2993621c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:00.429332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c84a7479-f595241c-bb3078fa-2993621c_0] Write session will restart in 0.006177s
2025-10-01T14:12:00.429349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c84a7479-f595241c-bb3078fa-2993621c_0] Write session: Do CDS request
2025-10-01T14:12:00.429354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c84a7479-f595241c-bb3078fa-2993621c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:00.429513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:00.436779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c84a7479-f595241c-bb3078fa-2993621c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.436904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:00.436922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1538
2025-10-01T14:12:00.437026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.437058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1538 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:00.437069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1538 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:00.437073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:00.437460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1538 sessionId:  describe result for acl check
2025-10-01T14:12:00.437497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:00.437506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:00.437508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:00.437513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255883416779219:2549] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:00.437683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:00.438016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255883416779219:2549] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:00.439355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:00.439524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:00.439533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:00.439543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:00.439590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:00.439626Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255881039897342:5563]
2025-10-01T14:12:00.440144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:00.440389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:00.440410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255883416779219:2549] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:00.440430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:00.440719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:00.440771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.440778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.440779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.440781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.440782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.440783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.440784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.440785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.440786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.440787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.440788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.440789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.440790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.440792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.440797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.440806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.440810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.440814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.440817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.440822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.440825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.440829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.440833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.440836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.440839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.440842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.440845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.440849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.440856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.440862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.440868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.440874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.440877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.440882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.440885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.440891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.440895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.440899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.440903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.440907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.440912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.440917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.440921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.440926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.440930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.440935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.440939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.440945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.440955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.440959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.440968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.440974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.440978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.440988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.440993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.440997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.441038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:00.444483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255883416779219:2549] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:00.444501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255883416779219:2549] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:00.444504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255883416779219:2549] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:00.444513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1538 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:00.444590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:00.445230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:00.445244Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:00.445246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:00.445249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:00.445253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1537 [2:7556255881039897342:5563]
2025-10-01T14:12:00.445263Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:00.445276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:00.445278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.445280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.445281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.445298Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:00.445309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:00.445319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:00.445374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.445381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.445382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.445385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:00.445388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:00.445465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:00.445472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.445482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.445491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.445504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:00.445524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779139:2446], now have 1 active actors on pipe
2025-10-01T14:12:00.445531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779259:2549], now have 1 active actors on pipe
2025-10-01T14:12:00.445538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255881039897337:5563]
2025-10-01T14:12:00.445540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255881039897337:5563]
2025-10-01T14:12:00.445542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255881039897337:5563]
2025-10-01T14:12:00.445550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:00.445536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1537
2025-10-01T14:12:00.445567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:00.445569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:00.445551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1537
2025-10-01T14:12:00.445572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:00.445573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:00.445584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:00.445587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:00.445629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.445637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.445648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255881039897337:5563]
2025-10-01T14:12:00.445658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:00.445670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:00.445686Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:00.445695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.445701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.445703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:00.445709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.445719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:00.445741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.445850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.445856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.445867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.445941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1538 partition: 0 MaxSeqNo: 45 sessionId: src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0
2025-10-01T14:12:00.446242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c84a7479-f595241c-bb3078fa-2993621c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:00.448806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0] Write session: try to update token
2025-10-01T14:12:00.448823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:00.461951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1538 sessionId: src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:00.464323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:00.465219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.465242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.465261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:00.465265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:00.465267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:00.465270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:00.465278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255881039897337:5563]
2025-10-01T14:12:00.465281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255881039897337:5563]
2025-10-01T14:12:00.465285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255881039897337:5563]
2025-10-01T14:12:00.465325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:00.465339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:00.465339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:00.465347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.465350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:00.465360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:00.465499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:00.528934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255883416779270:2856]
2025-10-01T14:12:00.529205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1537, pipe: [1:7556255883416779270:2856]
2025-10-01T14:12:00.605015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:00.605426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:00.605484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779270:2856], now have 1 active actors on pipe
2025-10-01T14:12:00.605548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:00.605718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255883416779270:2856]
2025-10-01T14:12:00.605761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:00.615082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:00.615093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:00.615114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1538 reason: error at write: Disconnected sessionId: src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0
2025-10-01T14:12:00.615266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1538 sessionId: src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0 is DEAD
2025-10-01T14:12:00.615417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:00.615423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0] Write session will restart in 0.008494s
2025-10-01T14:12:00.615448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0] Write session: Do CDS request
2025-10-01T14:12:00.615457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:00.621161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:00.623001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:00.623158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:00.623168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:00.623178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:00.623221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:00.623263Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255881039897465:5560]
2025-10-01T14:12:00.623780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:00.624018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:00.624053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:00.624266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:00.624315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.624320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.624321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.624322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.624323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.624325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.624327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.624328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.624329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.624331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.624332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.624333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.624334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.624335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.624340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.624350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.624355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.624359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.624362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.624366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.624370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.624374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.624378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.624384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.624387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.624391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.624394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.624398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.624405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.624413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.624422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.624432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.624437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.624445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.624453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.624459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.624466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.624472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.624478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.624484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.624489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.624494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.624498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.624504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.624508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.624513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.624519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.624525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.624532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.624537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.624544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.624549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.624556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.624562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.624569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.624575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.624616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:00.624934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.624980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:00.625001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1539
2025-10-01T14:12:00.625119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.625147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1539 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:00.625153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1539 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:00.625159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:00.625454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1539 sessionId:  describe result for acl check
2025-10-01T14:12:00.625481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:00.625487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:00.625488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:00.625491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255883416779359:2543] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:00.625902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255883416779359:2543] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:00.627731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255883416779359:2543] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:00.628130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:00.628827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:00.628837Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:00.628839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:00.628841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:00.628845Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1538 [2:7556255881039897465:5560]
2025-10-01T14:12:00.628855Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:00.628866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:00.628872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.628875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.628876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.628887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:00.628894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:00.628898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:00.628936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.628941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.628942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.628945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:00.628947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:00.628991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:00.628996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.629003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.629009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.629017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:00.629032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255881039897460:5560]
2025-10-01T14:12:00.629035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255881039897460:5560]
2025-10-01T14:12:00.629037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255881039897460:5560]
2025-10-01T14:12:00.629042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:00.629051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:00.629052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:00.629060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:00.629060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:00.629061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:00.629062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:00.629070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779272:2446], now have 1 active actors on pipe
2025-10-01T14:12:00.629089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255881039897460:5560]
2025-10-01T14:12:00.629100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:00.629100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1538
2025-10-01T14:12:00.629114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:00.631352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255883416779359:2543] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:00.631363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255883416779359:2543] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:00.631365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255883416779359:2543] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:00.631371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1539 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:00.631575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779396:2543], now have 1 active actors on pipe
2025-10-01T14:12:00.631609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1538
2025-10-01T14:12:00.631665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.631675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.631700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e0a3fe7-7587879a-97712568-223c4445_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:00.631714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.631722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.631724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:00.631736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.631750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:00.631766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.631891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.631898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.631910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.631964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1539 partition: 0 MaxSeqNo: 45 sessionId: src_id|2e0a3fe7-7587879a-97712568-223c4445_0
2025-10-01T14:12:00.632272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f84d58b3-3ccab82e-81efcc7b-162f1d20_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2e0a3fe7-7587879a-97712568-223c4445_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:00.634672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0a3fe7-7587879a-97712568-223c4445_0] Write session: try to update token
2025-10-01T14:12:00.634687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0a3fe7-7587879a-97712568-223c4445_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:00.639284Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:00.639303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:00.639318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255881039897460:5560]
2025-10-01T14:12:00.639359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:00.639365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:00.639554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:00.639713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.639863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.639993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.640171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:00.640203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:00.647666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1539 sessionId: src_id|2e0a3fe7-7587879a-97712568-223c4445_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:00.650298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:00.650514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.650534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.650567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:00.650642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:00.657052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:00.657065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:00.657067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:00.657069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:00.657077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255881039897460:5560]
2025-10-01T14:12:00.657081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255881039897460:5560]
2025-10-01T14:12:00.657084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255881039897460:5560]
2025-10-01T14:12:00.657121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:00.657133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.657135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:00.657141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:00.657156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:00.657160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:00.657255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:00.706099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255883416779401:2856]
2025-10-01T14:12:00.706425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1538, pipe: [1:7556255883416779401:2856]
2025-10-01T14:12:00.791979Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:00.798300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.798322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.798467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.798520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.798573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.798622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.798662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.798669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.798730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.798785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.798842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.798894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.799053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.799060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.799128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.799179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.799230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.799284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.799322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.799328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.799385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.799438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.799492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.799543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.799578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.799583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.799638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.799689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.799743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.799796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.799834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.799839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.799895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.799944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.799996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.800054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.800097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.800102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.800156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.800214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.800270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.800325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.800361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.800366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.800422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.800477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.800532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.800584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.800637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.800641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.800705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.800757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.800811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.800865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.800903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.800908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.800962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:00.801010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:00.801061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:00.801114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:00.801163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:00.801168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:00.801212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779401:2856], now have 1 active actors on pipe
2025-10-01T14:12:00.801415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:00.801456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255883416779401:2856]
2025-10-01T14:12:00.801471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:00.801476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:00.801494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1539 reason: error at write: Disconnected sessionId: src_id|2e0a3fe7-7587879a-97712568-223c4445_0
2025-10-01T14:12:00.801690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1539 sessionId: src_id|2e0a3fe7-7587879a-97712568-223c4445_0 is DEAD
2025-10-01T14:12:00.801805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:00.801865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0a3fe7-7587879a-97712568-223c4445_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:00.801878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0a3fe7-7587879a-97712568-223c4445_0] Write session will restart in 0.007487s
2025-10-01T14:12:00.801903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0a3fe7-7587879a-97712568-223c4445_0] Write session: Do CDS request
2025-10-01T14:12:00.801908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0a3fe7-7587879a-97712568-223c4445_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:00.808953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:00.810412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:00.810606Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:00.810616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:00.810628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:00.810679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:00.810715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255881039897585:5558]
2025-10-01T14:12:00.810772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0a3fe7-7587879a-97712568-223c4445_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.810866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:00.810884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1540
2025-10-01T14:12:00.810977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.811006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1540 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:00.811015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1540 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:00.811019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:00.811276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1540 sessionId:  describe result for acl check
2025-10-01T14:12:00.811298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:00.811302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:00.811297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:00.811304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:00.811306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255883416779500:2527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:00.811543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:00.811583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:00.811641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255883416779500:2527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:00.811867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:00.811919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.811925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.811926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.811927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.811928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.811929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.811930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.811931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.811932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.811933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.811934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.811935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.811936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.811937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.811942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.811951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.811954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.811958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.811962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.811965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.811968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.811972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.811975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.811978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.811982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.811985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.811988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.811991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.811999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.812006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.812012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.812017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.812021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.812026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.812030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.812034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.812039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.812049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.812052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.812057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.812061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.812066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.812069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.812074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.812083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.812087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.812091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.812095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.812099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.812104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.812112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.812117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.812121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.812125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.812130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.812136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.812172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:00.812873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255883416779500:2527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:00.815350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255883416779500:2527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:00.815362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255883416779500:2527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:00.815365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255883416779500:2527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:00.815370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1540 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:00.815582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:00.816273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:00.816286Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:00.816288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:00.816291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:00.816297Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1539 [2:7556255881039897585:5558]
2025-10-01T14:12:00.816312Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:00.816331Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:00.816338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.816342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.816348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.816365Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:00.816375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:00.816381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:00.816432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.816438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.816440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.816443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:00.816446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:00.816506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:00.816515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.816526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.816535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.816553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:00.816564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1539
2025-10-01T14:12:00.816574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779538:2527], now have 1 active actors on pipe
2025-10-01T14:12:00.816582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779416:2446], now have 1 active actors on pipe
2025-10-01T14:12:00.816589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255881039897580:5558]
2025-10-01T14:12:00.816591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255881039897580:5558]
2025-10-01T14:12:00.816587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1539
2025-10-01T14:12:00.816594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255881039897580:5558]
2025-10-01T14:12:00.816603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:00.816615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:00.816620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:00.816622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:00.816623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:00.816639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:00.816646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:00.816673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.816680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.816719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255881039897580:5558]
2025-10-01T14:12:00.816730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:00.816734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:00.816747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|747c80f0-72b97092-e4307ed3-7dbee233_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:00.816757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.816762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.816768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:00.816777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.816788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:00.816825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.816955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.816966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.816984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.817041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1540 partition: 0 MaxSeqNo: 45 sessionId: src_id|747c80f0-72b97092-e4307ed3-7dbee233_0
2025-10-01T14:12:00.817348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e0a3fe7-7587879a-97712568-223c4445_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|747c80f0-72b97092-e4307ed3-7dbee233_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:00.819623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|747c80f0-72b97092-e4307ed3-7dbee233_0] Write session: try to update token
2025-10-01T14:12:00.819638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|747c80f0-72b97092-e4307ed3-7dbee233_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:00.831753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1540 sessionId: src_id|747c80f0-72b97092-e4307ed3-7dbee233_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:00.833883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:00.835418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.835440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.835457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:00.835460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:00.835461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:00.835462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:00.835467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255881039897580:5558]
2025-10-01T14:12:00.835472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255881039897580:5558]
2025-10-01T14:12:00.835474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255881039897580:5558]
2025-10-01T14:12:00.835510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:00.835516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:00.835520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:00.835520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.835522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:00.835522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:00.835638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:00.901639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255883416779561:2856]
2025-10-01T14:12:00.901860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1539, pipe: [1:7556255883416779561:2856]
2025-10-01T14:12:00.967586Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:00.967857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:00.967905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779561:2856], now have 1 active actors on pipe
2025-10-01T14:12:00.967975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:00.968128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255883416779561:2856]
2025-10-01T14:12:00.968162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:00.977031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:00.977043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:00.977064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1540 reason: error at write: Disconnected sessionId: src_id|747c80f0-72b97092-e4307ed3-7dbee233_0
2025-10-01T14:12:00.977171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1540 sessionId: src_id|747c80f0-72b97092-e4307ed3-7dbee233_0 is DEAD
2025-10-01T14:12:00.977316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|747c80f0-72b97092-e4307ed3-7dbee233_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:00.977327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|747c80f0-72b97092-e4307ed3-7dbee233_0] Write session will restart in 0.007550s
2025-10-01T14:12:00.977351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|747c80f0-72b97092-e4307ed3-7dbee233_0] Write session: Do CDS request
2025-10-01T14:12:00.977356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|747c80f0-72b97092-e4307ed3-7dbee233_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:00.982054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:00.983810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:00.983943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:00.983951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:00.983958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:00.983987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:00.984012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255881039897715:5551]
2025-10-01T14:12:00.984374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:00.984580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:00.984603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:00.984796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:00.984828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.984832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.984832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.984833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.984834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.984834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.984835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.984836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.984836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.984837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.984838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.984838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.984839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.984839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.984842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.984847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.984850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.984852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.984854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.984856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.984858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.984860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.984862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.984864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.984866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.984868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.984870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.984872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.984877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.984881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:00.984884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.984887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:00.984890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.984893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:00.984895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.984897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:00.984900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.984902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:00.984905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.984907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:00.984909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.984912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:00.984915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.984917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:00.984919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.984926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:00.984929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.984931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.984934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.984936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.984938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.984941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.984943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.984949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:00.984952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.984954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:00.984976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:00.985794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|747c80f0-72b97092-e4307ed3-7dbee233_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.985819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:00.985830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1541
2025-10-01T14:12:00.985979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:00.985999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1541 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:00.986007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1541 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:00.986009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:00.986327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1541 sessionId:  describe result for acl check
2025-10-01T14:12:00.986357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:00.986363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:00.986365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:00.986382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255883416779656:2525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:00.986841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255883416779656:2525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:00.988349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:00.988712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255883416779656:2525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:00.988942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:00.988955Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:00.988956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:00.988959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:00.988963Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1540 [2:7556255881039897715:5551]
2025-10-01T14:12:00.988973Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:00.988983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:00.988985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.988988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.988989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.988999Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:00.989006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:00.989010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:00.989045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.989050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.989051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.989053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:00.989055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:00.989102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:00.989107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:00.989113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:00.989122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:00.989130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:00.989145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779565:2446], now have 1 active actors on pipe
2025-10-01T14:12:00.989153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255881039897710:5551]
2025-10-01T14:12:00.989154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255881039897710:5551]
2025-10-01T14:12:00.989156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255881039897710:5551]
2025-10-01T14:12:00.989166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:00.989174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:00.989176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:00.989180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:00.989181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:00.989194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:00.989200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:00.989222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255881039897710:5551]
2025-10-01T14:12:00.989228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:00.989211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1540
2025-10-01T14:12:00.989250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:00.993505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255883416779656:2525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:00.993519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255883416779656:2525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:00.993523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255883416779656:2525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:00.993530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1541 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:00.993708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255883416779690:2525], now have 1 active actors on pipe
2025-10-01T14:12:00.993769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1540
2025-10-01T14:12:00.993805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.993813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.993833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:00.993854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:00.993862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:00.993864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:00.993872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:00.993882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:00.993899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.994025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:00.994033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:00.994045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:00.994219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1541 partition: 0 MaxSeqNo: 45 sessionId: src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0
2025-10-01T14:12:00.994528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|747c80f0-72b97092-e4307ed3-7dbee233_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:00.996784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0] Write session: try to update token
2025-10-01T14:12:00.996798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:00.999024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:00.999041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:00.999048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255881039897710:5551]
2025-10-01T14:12:00.999074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:00.999080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:00.999212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:00.999328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.999439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.999552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:00.999709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:00.999737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:01.009156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1541 sessionId: src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:01.011508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:01.011774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.011794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.011828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:01.011901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:01.017353Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:01.017367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:01.017369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:01.017370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:01.017378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255881039897710:5551]
2025-10-01T14:12:01.017380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255881039897710:5551]
2025-10-01T14:12:01.017383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255881039897710:5551]
2025-10-01T14:12:01.017418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:01.017424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.017422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:01.017425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:01.017427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:01.017430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:01.017549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:01.068099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255887711746990:2856]
2025-10-01T14:12:01.068330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1540, pipe: [1:7556255887711746990:2856]
2025-10-01T14:12:01.150991Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:01.157562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.157588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.157719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.157767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.157825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.157877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.157914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.157921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.157974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.158032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.158090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.158148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.158195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.158201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.158263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.158326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.158397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.158451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.158493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.158498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.158553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.158606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.158657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.158709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.158746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.158751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.158805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.158866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.158919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.158970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.159007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.159011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.159066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.159116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.159169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.159221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.159258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.159262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.159318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.159376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.159429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.159482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.159520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.159524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.159583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.159634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.159689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.159741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.159779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.159783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.159835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.159894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.159949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.159999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.160037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.160041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.160096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.160148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.160201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.160256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.160293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.160298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.160339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711746990:2856], now have 1 active actors on pipe
2025-10-01T14:12:01.160582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:01.160596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:01.160614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255887711746990:2856]
2025-10-01T14:12:01.160618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1541 reason: error at write: Disconnected sessionId: src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0
2025-10-01T14:12:01.160643Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:01.160820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1541 sessionId: src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0 is DEAD
2025-10-01T14:12:01.160947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:01.160956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0] Write session will restart in 0.009639s
2025-10-01T14:12:01.160974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0] Write session: Do CDS request
2025-10-01T14:12:01.160978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:01.161188Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:01.169349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:01.170871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:01.171085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:01.171094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:01.171106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:01.171157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:01.171193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255885334865177:5524]
2025-10-01T14:12:01.171749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:01.171816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.171926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:01.171940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1542
2025-10-01T14:12:01.171968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:01.172007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:01.172047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.172079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1542 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:01.172086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1542 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:01.172090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:01.172290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:01.172344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.172349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.172351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.172352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.172353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.172354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.172355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.172356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.172357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.172358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.172359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.172360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.172358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1542 sessionId:  describe result for acl check
2025-10-01T14:12:01.172361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.172363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.172367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.172376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.172380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.172383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.172387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.172390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.172394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.172397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.172387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:01.172401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.172391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:01.172405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.172392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:01.172396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255887711747083:2514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:01.172408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.172411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.172414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.172418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.172425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.172437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.172446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.172472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.172475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.172480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.172488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.172492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.172500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.172510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.172514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.172519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.172523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.172527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.172531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.172536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.172541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.172545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.172549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.172554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.172559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.172563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.172567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.172572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.172576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.172584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.172588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.172592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.172630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:01.172788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255887711747083:2514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:01.174985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255887711747083:2514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:01.176036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:01.176651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:01.176675Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:01.176677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:01.176680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:01.176685Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1541 [2:7556255885334865177:5524]
2025-10-01T14:12:01.176694Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:01.176707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:01.176715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.176719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.176725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.176740Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:01.176750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:01.176755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:01.176805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.176812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.176814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.176816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:01.176820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:01.176881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:01.176889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.176899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.176910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.176923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:01.176939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711746996:2446], now have 1 active actors on pipe
2025-10-01T14:12:01.176947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255885334865172:5524]
2025-10-01T14:12:01.176949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255885334865172:5524]
2025-10-01T14:12:01.176950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255885334865172:5524]
2025-10-01T14:12:01.176959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:01.176971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:01.176975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:01.176978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:01.176979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:01.176982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:01.176971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1541
2025-10-01T14:12:01.176984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:01.177004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255885334865172:5524]
2025-10-01T14:12:01.177006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:01.177008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:01.178216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255887711747083:2514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:01.178230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255887711747083:2514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:01.178233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255887711747083:2514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:01.178239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1542 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:01.178423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747121:2514], now have 1 active actors on pipe
2025-10-01T14:12:01.178472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1541
2025-10-01T14:12:01.178508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.178514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.178532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:01.178540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.178543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.178545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:01.178551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.178562Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:01.178575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.178689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.178700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.178722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.178793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1542 partition: 0 MaxSeqNo: 45 sessionId: src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0
2025-10-01T14:12:01.179135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|342775b3-b20dcb40-c5f9e4ca-9c059fdb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:01.181309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0] Write session: try to update token
2025-10-01T14:12:01.181321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:01.187437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:01.187452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:01.187462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255885334865172:5524]
2025-10-01T14:12:01.187496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:01.187509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:01.187675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:01.187841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:01.188008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:01.188164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:01.188386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:01.188432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:01.193576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1542 sessionId: src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:01.195730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:01.195888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.195904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.195931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:01.196005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:01.205629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:01.205646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:01.205648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:01.205649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:01.205657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255885334865172:5524]
2025-10-01T14:12:01.205660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255885334865172:5524]
2025-10-01T14:12:01.205663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255885334865172:5524]
2025-10-01T14:12:01.205697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:01.205697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:01.205701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:01.205702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.205704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:01.205703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:01.205821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:01.260595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255887711747136:2856]
2025-10-01T14:12:01.260835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1541, pipe: [1:7556255887711747136:2856]
2025-10-01T14:12:01.347969Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:01.354686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.354708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.354858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.354914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.354969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.355021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.355494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.355504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.355561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.355611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.355665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.355721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.355759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.355764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.355823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.355889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.355944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.355999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.356034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.356036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.356097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.356161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.356218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.356273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.356313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.356318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.356379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.356434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.356494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.356551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.356590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.356596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.356654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.356721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.356778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.356837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.356880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.356889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.356949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.357003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.357060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.357126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.357166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.357170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.357224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.357274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.357327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.357384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.357430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.357436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.357490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.357551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.357607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.357662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.357700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.357705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.357757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.357807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.357863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.357924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.357968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.357973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.358012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747136:2856], now have 1 active actors on pipe
2025-10-01T14:12:01.358249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:01.358256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255887711747136:2856]
2025-10-01T14:12:01.358295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:01.358299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:01.358320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1542 reason: error at write: Disconnected sessionId: src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0
2025-10-01T14:12:01.358437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:01.358502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1542 sessionId: src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0 is DEAD
2025-10-01T14:12:01.358643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:01.358652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0] Write session will restart in 0.007854s
2025-10-01T14:12:01.358670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0] Write session: Do CDS request
2025-10-01T14:12:01.358675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:01.367219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:01.367681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:01.367831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:01.367839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:01.367847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:01.367883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:01.367915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.367911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255885334865301:5519]
2025-10-01T14:12:01.367979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:01.367995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1543
2025-10-01T14:12:01.368121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1543 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.368149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1543 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:01.368161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1543 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:01.368176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:01.368307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:01.368544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1543 sessionId:  describe result for acl check
2025-10-01T14:12:01.368577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:01.368583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:01.368584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:01.368589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255887711747225:2507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:01.369101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255887711747225:2507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:01.369243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:01.369293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:01.369532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:01.369569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.369573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.369574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.369575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.369575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.369576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.369577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.369577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.369578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.369579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.369579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.369580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.369580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.369581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.369585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.369591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.369593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.369595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.369597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.369599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.369601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.369603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.369605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.369608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.369610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.369612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.369614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.369616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.369622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.369629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.369634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.369639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.369642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.369649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.369653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.369656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.369659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.369662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.369664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.369667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.369669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.369672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.369674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.369677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.369680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.369684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.369687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.369692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.369697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.369701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.369705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.369710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.369714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.369718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.369721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.369723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.369746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:01.371190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255887711747225:2507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:01.373134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:01.373721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:01.373735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:01.373737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:01.373740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:01.373746Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1542 [2:7556255885334865301:5519]
2025-10-01T14:12:01.373760Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:01.373774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:01.373777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.373780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.373782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.373796Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:01.373806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:01.373812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:01.373836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255887711747225:2507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:01.373851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255887711747225:2507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:01.373858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.373866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.373854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255887711747225:2507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:01.373867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.373862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1543 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:01.373870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:01.373872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:01.373927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:01.373934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.373944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.373958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.373975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:01.373994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747139:2446], now have 1 active actors on pipe
2025-10-01T14:12:01.374004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255885334865296:5519]
2025-10-01T14:12:01.374006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255885334865296:5519]
2025-10-01T14:12:01.374008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255885334865296:5519]
2025-10-01T14:12:01.374019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:01.374012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1542
2025-10-01T14:12:01.374035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:01.374041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:01.374044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:01.374046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:01.374049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:01.374051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:01.374082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747264:2507], now have 1 active actors on pipe
2025-10-01T14:12:01.374087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255885334865296:5519]
2025-10-01T14:12:01.374083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1542
2025-10-01T14:12:01.374094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:01.374104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:01.374127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.374134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.374154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:01.374164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.374169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.374175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:01.374183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.374193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:01.374208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.374333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.374340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.374351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.374433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1543 partition: 0 MaxSeqNo: 45 sessionId: src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0
2025-10-01T14:12:01.374757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ecd9685a-8e56b708-2b91bc54-48646c1c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:01.376947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0] Write session: try to update token
2025-10-01T14:12:01.376960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:01.388633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1543 sessionId: src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:01.390850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:01.391029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.391048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.391079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:01.391173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:01.393264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:01.393280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:01.393281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:01.393282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:01.393290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255885334865296:5519]
2025-10-01T14:12:01.393293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255885334865296:5519]
2025-10-01T14:12:01.393295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255885334865296:5519]
2025-10-01T14:12:01.393332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:01.393341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.393342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:01.393347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:01.393352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:01.393356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:01.393454Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:01.458194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255887711747279:2856]
2025-10-01T14:12:01.458433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1542, pipe: [1:7556255887711747279:2856]
2025-10-01T14:12:01.527011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:01.533712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.533738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.533906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.533967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.534029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.534091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.534138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.534149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.534217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.534276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.534336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.534419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.534461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.534469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.534525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.534580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.534635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.534691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.534737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.534744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.534802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.534853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.534904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.534957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.534996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.535001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.535052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.535101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.535150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.535198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.535235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.535241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.535292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.535343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.535394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.535449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.535487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.535493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.535544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.535595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.535648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.535696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.535736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.535741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.535791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.535838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.535890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.535941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.535993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.535999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.536054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.536104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.536157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.536211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.536254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.536259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.536315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.536369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.536423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.536475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.536564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.536570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.536608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747279:2856], now have 1 active actors on pipe
2025-10-01T14:12:01.536790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255887711747279:2856]
2025-10-01T14:12:01.536790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:01.536794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:01.536816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1543 reason: error at write: Disconnected sessionId: src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0
2025-10-01T14:12:01.536820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:01.536963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1543 sessionId: src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0 is DEAD
2025-10-01T14:12:01.537086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:01.537096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0] Write session will restart in 0.007940s
2025-10-01T14:12:01.537114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0] Write session: Do CDS request
2025-10-01T14:12:01.537119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:01.537423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:01.545668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:01.545875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.545947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:01.545965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1544
2025-10-01T14:12:01.546053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.546077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1544 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:01.546086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1544 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:01.546088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:01.546389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1544 sessionId:  describe result for acl check
2025-10-01T14:12:01.546419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:01.546424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:01.546426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:01.546430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255887711747369:2491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:01.546804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255887711747369:2491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:01.547325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:01.547467Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:01.547478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:01.547486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:01.547517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:01.547548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255885334865428:5515]
2025-10-01T14:12:01.547941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:01.548165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:01.548196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:01.548414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:01.548453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.548458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.548459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.548460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.548461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.548462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.548463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.548464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.548465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.548466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.548468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.548469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.548470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.548471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.548475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.548483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.548485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.548487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.548489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.548491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.548493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.548495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.548497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.548498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.548500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.548502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.548504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.548506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.548510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.548514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.548518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.548521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.548523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.548526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.548528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.548531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.548534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.548537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.548538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255887711747369:2491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:01.548540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.548542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.548545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.548548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.548550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.548553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.548555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.548558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.548561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.548564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.548566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.548569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.548572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.548574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.548577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.548580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.548583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.548586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.548605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:01.551872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255887711747369:2491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:01.551893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255887711747369:2491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:01.551896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255887711747369:2491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:01.551906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1544 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:01.552144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:01.553054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:01.553069Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:01.553071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:01.553075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:01.553083Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1543 [2:7556255885334865428:5515]
2025-10-01T14:12:01.553099Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:01.553118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:01.553125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.553129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.553132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.553150Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:01.553160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:01.553166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:01.553234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.553246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.553249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.553252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:01.553256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:01.553323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:01.553331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.553341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.553354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.553365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:01.553385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747282:2446], now have 1 active actors on pipe
2025-10-01T14:12:01.553392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747408:2491], now have 1 active actors on pipe
2025-10-01T14:12:01.553398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255885334865423:5515]
2025-10-01T14:12:01.553399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255885334865423:5515]
2025-10-01T14:12:01.553400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255885334865423:5515]
2025-10-01T14:12:01.553410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:01.553420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:01.553432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:01.553435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:01.553437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:01.553438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:01.553440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:01.553465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255885334865423:5515]
2025-10-01T14:12:01.553477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:01.553456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1543
2025-10-01T14:12:01.553477Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1543
2025-10-01T14:12:01.553496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:01.553568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.553575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.553595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:01.553605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.553609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.553615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:01.553624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.553638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:01.553655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.553808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.553819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.553836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.553912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1544 partition: 0 MaxSeqNo: 45 sessionId: src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0
2025-10-01T14:12:01.554215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7704d85b-9aa46742-fa742cfb-13fa9701_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:01.556521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0] Write session: try to update token
2025-10-01T14:12:01.556536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:01.564384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:01.564409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:01.564420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255885334865423:5515]
2025-10-01T14:12:01.564466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:01.564470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:01.564679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:01.564811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:01.564945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:01.565071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:01.565236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:01.565272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:01.569265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1544 sessionId: src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:01.571605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:01.571788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.571805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.571833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:01.571895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:01.583636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:01.583657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:01.583659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:01.583661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:01.583673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255885334865423:5515]
2025-10-01T14:12:01.583676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255885334865423:5515]
2025-10-01T14:12:01.583680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255885334865423:5515]
2025-10-01T14:12:01.583713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:01.583723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:01.583724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:01.583725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:01.583731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.583733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:01.583861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:01.636865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255887711747416:2856]
2025-10-01T14:12:01.637209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1543, pipe: [1:7556255887711747416:2856]
2025-10-01T14:12:01.717475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:01.724081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.724107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.724254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.724308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.724362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.724432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.724479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.724487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.724558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.724618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.724686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.724742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.724782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.724786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.724841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.724894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.724952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.725010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.725048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.725054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.725109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.725159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.725210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.725263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.725304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.725310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.725362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.725412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.725461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.725512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.725550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.725555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.725609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.725663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.725717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.725772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.725814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.725819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.725873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.725926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.725982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.726035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.726075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.726080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.726134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.726185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.726238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.726291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.726328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.726333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.726407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.726470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.726533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.726595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.726638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.726645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.726706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.726756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.726811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.726867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.726903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.726909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.726947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747416:2856], now have 1 active actors on pipe
2025-10-01T14:12:01.727161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:01.727202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:01.727205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:01.727206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255887711747416:2856]
2025-10-01T14:12:01.727226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1544 reason: error at write: Disconnected sessionId: src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0
2025-10-01T14:12:01.727363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1544 sessionId: src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0 is DEAD
2025-10-01T14:12:01.727475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:01.727483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0] Write session will restart in 0.007389s
2025-10-01T14:12:01.727501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0] Write session: Do CDS request
2025-10-01T14:12:01.727506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:01.727653Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:01.735241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:01.735830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.735921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:01.735940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1545
2025-10-01T14:12:01.736046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.736078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1545 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:01.736090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1545 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:01.736093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:01.736431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1545 sessionId:  describe result for acl check
2025-10-01T14:12:01.736459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:01.736464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:01.736465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:01.736469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255887711747506:2486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:01.736679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:01.736834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:01.736843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:01.736852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:01.736900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:01.736937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255885334865555:5509]
2025-10-01T14:12:01.736942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255887711747506:2486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:01.737399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:01.737615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:01.737651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:01.737923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:01.737967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.737972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.737973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.737975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.737976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.737977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.737978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.737980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.737981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.737982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.737983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.737984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.737985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.737986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.737991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.738000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.738004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.738008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.738011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.738015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.738018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.738022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.738026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.738030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.738033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.738036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.738039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.738043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.738048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.738054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.738059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.738065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.738069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.738075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.738079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.738084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.738088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.738093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.738097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.738101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.738107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.738114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.738118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.738121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.738125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.738129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.738137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.738141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.738146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.738154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.738158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.738163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.738171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.738175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.738179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.738188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.738225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:01.739475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255887711747506:2486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:01.741690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:01.741946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255887711747506:2486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:01.741960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255887711747506:2486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:01.741963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255887711747506:2486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:01.741969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1545 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:01.742285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:01.742297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:01.742300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:01.742302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:01.742306Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1544 [2:7556255885334865555:5509]
2025-10-01T14:12:01.742317Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:01.742329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:01.742331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.742333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.742334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.742346Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:01.742350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:01.742355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:01.742416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.742423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.742424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.742428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:01.742430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:01.742476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:01.742481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.742488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.742493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.742502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:01.742517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747418:2446], now have 1 active actors on pipe
2025-10-01T14:12:01.742526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255885334865550:5509]
2025-10-01T14:12:01.742527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255885334865550:5509]
2025-10-01T14:12:01.742528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255885334865550:5509]
2025-10-01T14:12:01.742537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:01.742543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747545:2486], now have 1 active actors on pipe
2025-10-01T14:12:01.742545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:01.742547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:01.742548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:01.742553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:01.742561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:01.742562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:01.742584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255885334865550:5509]
2025-10-01T14:12:01.742580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1544
2025-10-01T14:12:01.742591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:01.742590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1544
2025-10-01T14:12:01.742603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:01.742614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.742618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.742639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:01.742648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.742651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.742652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:01.742660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.742670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:01.742680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.742793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.742805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.742825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.742902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1545 partition: 0 MaxSeqNo: 45 sessionId: src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0
2025-10-01T14:12:01.743210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32c19f38-e2bf09-5cca9768-9a3c81e3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:01.745377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0] Write session: try to update token
2025-10-01T14:12:01.745391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:01.757898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1545 sessionId: src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:01.760050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:01.760172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.760189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.760240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:01.760302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:01.762001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:01.762014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:01.762016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:01.762018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:01.762024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255885334865550:5509]
2025-10-01T14:12:01.762028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255885334865550:5509]
2025-10-01T14:12:01.762031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255885334865550:5509]
2025-10-01T14:12:01.762066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:01.762070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:01.762075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.762076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:01.762077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:01.762080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:01.762226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:01.827372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255887711747555:2856]
2025-10-01T14:12:01.827652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1544, pipe: [1:7556255887711747555:2856]
2025-10-01T14:12:01.894808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:01.901534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.901559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.901709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.901766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.901823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.901878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.901918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.901926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.901999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.902052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.902108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.902173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.902214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.902220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.902274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.902320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.902390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.902443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.902480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.902485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.902537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.902589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.902641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.902699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.902739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.902743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.902800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.902849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.902900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.902951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.902992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.902997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.903050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.903100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.903163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.903225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.903267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.903273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.903328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.903379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.903432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.903484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.903523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.903528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.903581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.903631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.903692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.903750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.903790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.903795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.903853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.903907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.903963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.904016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.904055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.904060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.904117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:01.904167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:01.904235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:01.904288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:01.904326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:01.904331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:01.904372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747555:2856], now have 1 active actors on pipe
2025-10-01T14:12:01.904788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:01.904834Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255887711747555:2856]
2025-10-01T14:12:01.905030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:01.905041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:01.905064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1545 reason: error at write: Disconnected sessionId: src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0
2025-10-01T14:12:01.905234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1545 sessionId: src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0 is DEAD
2025-10-01T14:12:01.905354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:01.905360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0] Write session will restart in 0.006812s
2025-10-01T14:12:01.905378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0] Write session: Do CDS request
2025-10-01T14:12:01.905383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:01.905414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:01.912780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.912874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:01.912890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1546
2025-10-01T14:12:01.912977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:01.913001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1546 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:01.913005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1546 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:01.913008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:01.913281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1546 sessionId:  describe result for acl check
2025-10-01T14:12:01.913313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:01.913317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:01.913319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:01.913322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255887711747667:2463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:01.913670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255887711747667:2463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:01.913940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:01.915354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:01.915393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255887711747667:2463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:01.915550Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:01.915561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:01.915572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:01.915620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:01.915655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255885334865689:5501]
2025-10-01T14:12:01.916207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:01.916472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:01.916514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:01.916821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:01.916872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.916878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.916879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.916880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.916882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.916883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.916884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.916885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.916886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.916887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.916888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.916889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.916890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.916891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.916896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.916906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.916910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.916914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.916917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.916921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.916925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.916929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.916933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.916938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.916946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.916950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.916954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.916961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.916969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.916981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:01.916987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.916997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:01.917006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.917015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:01.917022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.917027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:01.917036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.917044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:01.917053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.917062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:01.917070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.917079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:01.917087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.917096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:01.917104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.917113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:01.917121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.917126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.917134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.917142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.917150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.917159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.917164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.917172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:01.917176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.917185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:01.917225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:01.917782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255887711747667:2463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:01.917796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255887711747667:2463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:01.917799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255887711747667:2463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:01.917807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1546 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:01.920588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:01.921163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:01.921175Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:01.921178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:01.921181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:01.921186Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1545 [2:7556255885334865689:5501]
2025-10-01T14:12:01.921196Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:01.921212Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:01.921213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.921216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.921217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.921229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:01.921233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:01.921237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:01.921276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.921282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.921285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.921287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:01.921289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:01.921339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:01.921345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.921351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:01.921357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:01.921365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:01.921380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255885334865684:5501]
2025-10-01T14:12:01.921385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255885334865684:5501]
2025-10-01T14:12:01.921386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255885334865684:5501]
2025-10-01T14:12:01.921397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:01.921409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:01.921424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:01.921431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:01.921436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:01.921443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:01.921445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:01.921452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255885334865684:5501]
2025-10-01T14:12:01.921458Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:01.921509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:01.921539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747580:2446], now have 1 active actors on pipe
2025-10-01T14:12:01.921547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255887711747708:2463], now have 1 active actors on pipe
2025-10-01T14:12:01.921627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1545
2025-10-01T14:12:01.921630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1545
2025-10-01T14:12:01.921752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.921762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.921786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdb4f318-70d75874-cdba944b-be584064_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:01.921794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:01.921797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:01.921799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:01.921808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:01.921817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:01.921830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.922001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.922008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.922020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:01.922085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1546 partition: 0 MaxSeqNo: 45 sessionId: src_id|cdb4f318-70d75874-cdba944b-be584064_0
2025-10-01T14:12:01.922416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16f32aaa-15392088-f2c7ec3d-7d650ce9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cdb4f318-70d75874-cdba944b-be584064_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:01.924826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb4f318-70d75874-cdba944b-be584064_0] Write session: try to update token
2025-10-01T14:12:01.924842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb4f318-70d75874-cdba944b-be584064_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:01.937953Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1546 sessionId: src_id|cdb4f318-70d75874-cdba944b-be584064_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:01.940170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:01.941505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:01.941530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:01.941551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:01.941554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:01.941556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:01.941559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:01.941571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255885334865684:5501]
2025-10-01T14:12:01.941576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255885334865684:5501]
2025-10-01T14:12:01.941579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255885334865684:5501]
2025-10-01T14:12:01.941618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:01.941627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:01.941629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:01.941631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:01.941633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:01.941635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:01.941752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:02.005025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255892006715012:2856]
2025-10-01T14:12:02.005396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1545, pipe: [1:7556255892006715012:2856]
2025-10-01T14:12:02.074433Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:02.074817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:02.074871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715012:2856], now have 1 active actors on pipe
2025-10-01T14:12:02.074976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:02.075064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:02.075071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:02.075137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1546 reason: error at write: Disconnected sessionId: src_id|cdb4f318-70d75874-cdba944b-be584064_0
2025-10-01T14:12:02.075275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1546 sessionId: src_id|cdb4f318-70d75874-cdba944b-be584064_0 is DEAD
2025-10-01T14:12:02.075284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:02.075321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255892006715012:2856]
2025-10-01T14:12:02.075423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb4f318-70d75874-cdba944b-be584064_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:02.075434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb4f318-70d75874-cdba944b-be584064_0] Write session will restart in 0.006879s
2025-10-01T14:12:02.075458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb4f318-70d75874-cdba944b-be584064_0] Write session: Do CDS request
2025-10-01T14:12:02.075467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb4f318-70d75874-cdba944b-be584064_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:02.083837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb4f318-70d75874-cdba944b-be584064_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.083928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:02.083944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1547
2025-10-01T14:12:02.084102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.084125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1547 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:02.084132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1547 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:02.084135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:02.084451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:02.084482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1547 sessionId:  describe result for acl check
2025-10-01T14:12:02.084507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:02.084511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:02.084512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:02.084516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255892006715103:2456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:02.084994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255892006715103:2456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:02.086355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:02.086455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255892006715103:2456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:02.086502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:02.086509Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:02.086516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:02.086547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:02.086571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255889629833127:5495]
2025-10-01T14:12:02.087033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:02.087231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:02.087256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:02.087451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:02.087485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.087490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.087491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.087491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.087492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.087492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.087493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.087494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.087494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.087495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.087495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.087496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.087496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.087497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.087501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.087506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.087508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.087510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.087512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.087514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.087516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.087518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.087520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.087522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.087524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.087526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.087528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.087530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.087534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.087538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.087542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.087545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.087547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.087550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.087552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.087555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.087557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.087560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.087562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.087565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.087567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.087570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.087572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.087576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.087578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.087581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.087584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.087586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.087588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.087591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.087593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.087596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.087600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.087605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.087608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.087612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.087644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:02.090937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255892006715103:2456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:02.090950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255892006715103:2456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:02.090953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255892006715103:2456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:02.090959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1547 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:02.091345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:02.091919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:02.091936Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:02.091939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:02.091942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:02.091949Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1546 [2:7556255889629833127:5495]
2025-10-01T14:12:02.091968Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:02.091988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:02.091991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.091999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.092001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.092016Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:02.092025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:02.092035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:02.092092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.092099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.092101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.092104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:02.092106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:02.092169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:02.092178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.092190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.092199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.092213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:02.092234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715013:2446], now have 1 active actors on pipe
2025-10-01T14:12:02.092242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715146:2456], now have 1 active actors on pipe
2025-10-01T14:12:02.092249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255889629833122:5495]
2025-10-01T14:12:02.092255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255889629833122:5495]
2025-10-01T14:12:02.092257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255889629833122:5495]
2025-10-01T14:12:02.092239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1546
2025-10-01T14:12:02.092240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1546
2025-10-01T14:12:02.092266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:02.092270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:02.092272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:02.092273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:02.092283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:02.092296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:02.092303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:02.092325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.092332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.092360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255889629833122:5495]
2025-10-01T14:12:02.092372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:02.092382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:02.092390Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:02.092396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.092405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.092407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:02.092415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.092427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:02.092462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.092578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.092586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.092599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.092656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1547 partition: 0 MaxSeqNo: 45 sessionId: src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0
2025-10-01T14:12:02.092913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb4f318-70d75874-cdba944b-be584064_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:02.095161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0] Write session: try to update token
2025-10-01T14:12:02.095178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:02.107564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1547 sessionId: src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:02.109685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:02.109890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.109908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.109939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:02.110011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:02.112181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:02.112193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:02.112195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:02.112196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:02.112203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255889629833122:5495]
2025-10-01T14:12:02.112207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255889629833122:5495]
2025-10-01T14:12:02.112210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255889629833122:5495]
2025-10-01T14:12:02.112244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:02.112246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:02.112251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.112252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:02.112253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:02.112256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:02.112368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:02.175514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255892006715154:2856]
2025-10-01T14:12:02.175806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1546, pipe: [1:7556255892006715154:2856]
2025-10-01T14:12:02.246089Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:02.252769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.252789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.252926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.252983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.253039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.253092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.253136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.253144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.253201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.253255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.253308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.253371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.253421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.253429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.253481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.253531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.253584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.253632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.253670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.253675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.253730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.253797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.253848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.253900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.253940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.253945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.253996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.254046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.254098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.254151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.254189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.254194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.254251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.254301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.254357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.254430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.254470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.254476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.254533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.254584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.254637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.254690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.254733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.254738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.254791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.254846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.254904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.254959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.254999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.255004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.255062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.255120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.255174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.255228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.255267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.255272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.255328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.255381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.255439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.255494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.255532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.255538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.255577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715154:2856], now have 1 active actors on pipe
2025-10-01T14:12:02.255782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:02.255804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255892006715154:2856]
2025-10-01T14:12:02.255920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:02.255932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:02.255952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1547 reason: error at write: Disconnected sessionId: src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0
2025-10-01T14:12:02.256100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1547 sessionId: src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0 is DEAD
2025-10-01T14:12:02.256194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:02.256202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0] Write session will restart in 0.008111s
2025-10-01T14:12:02.256221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0] Write session: Do CDS request
2025-10-01T14:12:02.256225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:02.256476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:02.263629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:02.263988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:02.264122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:02.264130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:02.264139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:02.264170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:02.264198Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255889629833285:5461]
2025-10-01T14:12:02.264553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:02.265236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:02.265275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:02.265473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:02.265505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.265510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.265510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.265511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.265511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.265512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.265512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.265513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.265513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.265514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.265515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.265515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.265515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.265516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.265519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.265524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.265527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.265529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.265531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.265533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.265535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.265537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.265539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.265541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.265543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.265545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.265547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.265549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.265553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.265557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.265561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.265564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.265566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.265569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.265571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.265574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.265577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.265579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.265582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.265584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.265587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.265589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.265592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.265594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.265600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.265603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.265605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.265608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.265610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.265615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.265617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.265620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.265624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.265630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.265632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.265635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.265658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:02.265802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.265868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:02.265881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1548
2025-10-01T14:12:02.265968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.265987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1548 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:02.265994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1548 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:02.265996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:02.266254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1548 sessionId:  describe result for acl check
2025-10-01T14:12:02.266274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:02.266278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:02.266280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:02.266283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255892006715263:2441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:02.266659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255892006715263:2441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:02.268278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255892006715263:2441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:02.268871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:02.269513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:02.269525Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:02.269526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:02.269527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:02.269532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1547 [2:7556255889629833285:5461]
2025-10-01T14:12:02.269543Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:02.269556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:02.269563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.269566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.269568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.269578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:02.269582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:02.269587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:02.269617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.269622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.269623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.269625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:02.269627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:02.269676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:02.269682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.269691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.269701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.269719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:02.269730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715168:2446], now have 1 active actors on pipe
2025-10-01T14:12:02.269740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255889629833280:5461]
2025-10-01T14:12:02.269743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255889629833280:5461]
2025-10-01T14:12:02.269746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255889629833280:5461]
2025-10-01T14:12:02.269757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:02.269764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:02.269767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:02.269768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:02.269772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:02.269739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1547
2025-10-01T14:12:02.269784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:02.269791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:02.269817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255889629833280:5461]
2025-10-01T14:12:02.269827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:02.269839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:02.270231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255892006715263:2441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:02.270243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255892006715263:2441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:02.270245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255892006715263:2441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:02.270251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1548 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:02.270411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715300:2441], now have 1 active actors on pipe
2025-10-01T14:12:02.270441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1547
2025-10-01T14:12:02.270484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.270492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.270513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6542a8e8-b242b893-e04d4af3-4271b099_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:02.270525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.270529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.270531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:02.270541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.270553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:02.270570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.270687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.270695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.270710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.270757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1548 partition: 0 MaxSeqNo: 45 sessionId: src_id|6542a8e8-b242b893-e04d4af3-4271b099_0
2025-10-01T14:12:02.271013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31b0a85f-c20d62a3-afa663b3-8947943e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6542a8e8-b242b893-e04d4af3-4271b099_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:02.273600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6542a8e8-b242b893-e04d4af3-4271b099_0] Write session: try to update token
2025-10-01T14:12:02.273614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6542a8e8-b242b893-e04d4af3-4271b099_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:02.279385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:02.279400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:02.279408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255889629833280:5461]
2025-10-01T14:12:02.279444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:02.279448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:02.279593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:02.279727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:02.279862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:02.279995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:02.280226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:02.280276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:02.285288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1548 sessionId: src_id|6542a8e8-b242b893-e04d4af3-4271b099_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:02.287578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:02.287732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.287750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.287776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:02.287841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:02.296608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:02.296625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:02.296627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:02.296629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:02.296638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255889629833280:5461]
2025-10-01T14:12:02.296642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255889629833280:5461]
2025-10-01T14:12:02.296646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255889629833280:5461]
2025-10-01T14:12:02.296688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:02.296697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:02.296700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:02.296702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:02.296711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.296715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:02.296844Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:02.355751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255892006715306:2856]
2025-10-01T14:12:02.355985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1547, pipe: [1:7556255892006715306:2856]
2025-10-01T14:12:02.430363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:02.436532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.436557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.436704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.436756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.436812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.436866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.436907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.436914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.436974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.437026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.437077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.437132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.437263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.437269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.437326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.437378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.437431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.437486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.437526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.437531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.437589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.437654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.437710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.437768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.437808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.437816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.437875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.437929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.437984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.438038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.438083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.438088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.438144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.438197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.438251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.438307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.438348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.438354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.438433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.438487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.438540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.438594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.438633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.438640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.438692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.438742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.438795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.438847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.438884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.438889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.438946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.438998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.439051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.439104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.439144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.439151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.439204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:02.439253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:02.439304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:02.439356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:02.439395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:02.439400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:02.439441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715306:2856], now have 1 active actors on pipe
2025-10-01T14:12:02.439637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255892006715306:2856]
2025-10-01T14:12:02.439653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:02.439666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:02.439668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:02.439690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1548 reason: error at write: Disconnected sessionId: src_id|6542a8e8-b242b893-e04d4af3-4271b099_0
2025-10-01T14:12:02.439869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1548 sessionId: src_id|6542a8e8-b242b893-e04d4af3-4271b099_0 is DEAD
2025-10-01T14:12:02.439989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6542a8e8-b242b893-e04d4af3-4271b099_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:02.439998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6542a8e8-b242b893-e04d4af3-4271b099_0] Write session will restart in 0.009123s
2025-10-01T14:12:02.440015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6542a8e8-b242b893-e04d4af3-4271b099_0] Write session: Do CDS request
2025-10-01T14:12:02.440020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6542a8e8-b242b893-e04d4af3-4271b099_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:02.440055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:02.448315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:02.449852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6542a8e8-b242b893-e04d4af3-4271b099_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.450075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:02.450239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:02.450246Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:02.450254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:02.450290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:02.450317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255889629833416:5465]
2025-10-01T14:12:02.450314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:02.450331Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1549
2025-10-01T14:12:02.450473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.450504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1549 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:02.450514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1549 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:02.450517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:02.450742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:02.450869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1549 sessionId:  describe result for acl check
2025-10-01T14:12:02.450900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:02.450907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:02.450908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:02.450913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255892006715407:2433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:02.450954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:02.450981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:02.451175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:02.451208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.451212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.451213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.451213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.451214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.451215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.451216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.451217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.451217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.451218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.451219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.451219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.451220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.451220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.451224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.451229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.451231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.451233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.451235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.451237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.451239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.451241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.451243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.451246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.451248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.451250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.451252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.451254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.451258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.451263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.451266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.451269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.451272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.451274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.451277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.451287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.451289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.451292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.451297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.451300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.451303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.451306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.451309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.451314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.451317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.451320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.451325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.451328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.451330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.451336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.451339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.451341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.451344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.451347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.451352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.451355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.451357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255892006715407:2433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:02.451374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:02.453074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255892006715407:2433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:02.454658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:02.455222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:02.455234Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:02.455236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:02.455239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:02.455245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1548 [2:7556255889629833416:5465]
2025-10-01T14:12:02.455259Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:02.455276Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:02.455282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.455286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.455289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.455307Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:02.455314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:02.455318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:02.455357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.455364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.455366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.455369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:02.455372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:02.455432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:02.455439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.455449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.455462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.455480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:02.455503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715313:2446], now have 1 active actors on pipe
2025-10-01T14:12:02.455500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1548
2025-10-01T14:12:02.455514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255889629833411:5465]
2025-10-01T14:12:02.455519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255889629833411:5465]
2025-10-01T14:12:02.455521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255889629833411:5465]
2025-10-01T14:12:02.455530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:02.455534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:02.455537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:02.455538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:02.455549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:02.455567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:02.455573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:02.455600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255889629833411:5465]
2025-10-01T14:12:02.455612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:02.455615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:02.455847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255892006715407:2433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:02.455863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255892006715407:2433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:02.455866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255892006715407:2433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:02.455876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1549 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:02.456018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715449:2433], now have 1 active actors on pipe
2025-10-01T14:12:02.456060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1548
2025-10-01T14:12:02.456094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.456103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.456126Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:02.456137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.456145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.456147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:02.456155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.456165Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:02.456182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.456296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.456303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.456315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.456369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1549 partition: 0 MaxSeqNo: 45 sessionId: src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0
2025-10-01T14:12:02.456650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6542a8e8-b242b893-e04d4af3-4271b099_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:02.458797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0] Write session: try to update token
2025-10-01T14:12:02.458811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:02.470855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1549 sessionId: src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:02.473368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:02.475374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.475396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.475416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:02.475419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:02.475427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:02.475436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:02.475444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255889629833411:5465]
2025-10-01T14:12:02.475448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255889629833411:5465]
2025-10-01T14:12:02.475452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255889629833411:5465]
2025-10-01T14:12:02.475487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:02.475500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:02.475503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:02.475511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:02.475517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.475519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:02.475637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:02.539592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255892006715455:2856]
2025-10-01T14:12:02.539849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1548, pipe: [1:7556255892006715455:2856]
2025-10-01T14:12:02.615726Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:02.615995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:02.616040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715455:2856], now have 1 active actors on pipe
2025-10-01T14:12:02.616141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:02.616166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255892006715455:2856]
2025-10-01T14:12:02.616185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:02.616231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:02.616239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:02.616303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1549 reason: error at write: Disconnected sessionId: src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0
2025-10-01T14:12:02.616468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1549 sessionId: src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0 is DEAD
2025-10-01T14:12:02.616573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:02.616581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0] Write session will restart in 0.007098s
2025-10-01T14:12:02.616598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0] Write session: Do CDS request
2025-10-01T14:12:02.616603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:02.624903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.625011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:02.625016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:02.625033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1550
2025-10-01T14:12:02.625129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.625158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1550 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:02.625168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1550 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:02.625171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:02.625530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1550 sessionId:  describe result for acl check
2025-10-01T14:12:02.625560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:02.625566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:02.625569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:02.625575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255892006715550:2422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:02.626111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255892006715550:2422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:02.626755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:02.626885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:02.626893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:02.626901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:02.626938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:02.626969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255889629833549:5459]
2025-10-01T14:12:02.627343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:02.627590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:02.627624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:02.627877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:02.627938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.627944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.627945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.627946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.627947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.627948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.627949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.627950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.627951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.627952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.627954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.627954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.627955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.627956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.627961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.627969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.627972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.627976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.627979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.627982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.627985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.627988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.627991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.627994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.627997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.628000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.628002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.628005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.628011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.628018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.628023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.628032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.628039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.628024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255892006715550:2422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:02.628043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.628051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.628056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.628064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.628069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.628073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.628082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.628089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.628097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.628101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.628109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.628113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.628121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.628125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.628130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.628141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.628145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.628149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.628154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.628158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.628161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.628165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.628169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.628202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:02.631363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255892006715550:2422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:02.631382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255892006715550:2422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:02.631386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255892006715550:2422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:02.631397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1550 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:02.631568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:02.632109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:02.632122Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:02.632124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:02.632127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:02.632132Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1549 [2:7556255889629833549:5459]
2025-10-01T14:12:02.632142Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:02.632153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:02.632155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.632157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.632158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.632169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:02.632176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:02.632180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:02.632220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.632226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.632227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.632230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:02.632232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:02.632292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:02.632299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.632309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.632322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.632341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:02.632360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715456:2446], now have 1 active actors on pipe
2025-10-01T14:12:02.632367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715589:2422], now have 1 active actors on pipe
2025-10-01T14:12:02.632373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255889629833544:5459]
2025-10-01T14:12:02.632376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255889629833544:5459]
2025-10-01T14:12:02.632378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255889629833544:5459]
2025-10-01T14:12:02.632390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:02.632403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:02.632385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1549
2025-10-01T14:12:02.632409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:02.632390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1549
2025-10-01T14:12:02.632411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:02.632414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:02.632421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:02.632424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:02.632456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.632462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.632473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255889629833544:5459]
2025-10-01T14:12:02.632483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:02.632487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:02.632510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:02.632520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.632527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.632529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:02.632539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.632551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:02.632573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.632688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.632698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.632711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.632775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1550 partition: 0 MaxSeqNo: 45 sessionId: src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0
2025-10-01T14:12:02.633136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0ee8495-a7b1cf72-f39ea81d-3a4dcbe2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:02.635328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0] Write session: try to update token
2025-10-01T14:12:02.635343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:02.647859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1550 sessionId: src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:02.650062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:02.651507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.651531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.651550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:02.651553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:02.651555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:02.651556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:02.651563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255889629833544:5459]
2025-10-01T14:12:02.651567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255889629833544:5459]
2025-10-01T14:12:02.651569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255889629833544:5459]
2025-10-01T14:12:02.651616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:02.651619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:02.651625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:02.651628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.651629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:02.651631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:02.651758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:02.716233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255892006715597:2856]
2025-10-01T14:12:02.717036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1549, pipe: [1:7556255892006715597:2856]
2025-10-01T14:12:02.795122Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:02.795477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:02.795522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715597:2856], now have 1 active actors on pipe
2025-10-01T14:12:02.795738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:02.795762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:02.795794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255892006715597:2856]
2025-10-01T14:12:02.795812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:02.795814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:02.795866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1550 reason: error at write: Disconnected sessionId: src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0
2025-10-01T14:12:02.795994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1550 sessionId: src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0 is DEAD
2025-10-01T14:12:02.796150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:02.796157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0] Write session will restart in 0.006234s
2025-10-01T14:12:02.796174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0] Write session: Do CDS request
2025-10-01T14:12:02.796182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:02.803818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.803926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:02.803941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1551
2025-10-01T14:12:02.804022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.804044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1551 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:02.804051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1551 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:02.804053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:02.804423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1551 sessionId:  describe result for acl check
2025-10-01T14:12:02.804447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:02.804449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:02.804450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:02.804454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255892006715663:2414] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:02.804845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255892006715663:2414] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:02.806179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:02.806305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255892006715663:2414] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:02.808211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:02.808353Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:02.808360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:02.808368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:02.808399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:02.808425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255889629833682:5456]
2025-10-01T14:12:02.808455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255892006715663:2414] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:02.808469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255892006715663:2414] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:02.808473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255892006715663:2414] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:02.808489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1551 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:02.808833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:02.809004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:02.809031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:02.809218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:02.809254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.809258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.809258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.809259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.809260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.809260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.809261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.809261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.809262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.809263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.809263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.809264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.809264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.809265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.809268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.809274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.809276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.809278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.809280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.809282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.809284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.809286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.809289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.809291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.809293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.809295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.809297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.809299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.809303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.809308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.809311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.809314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.809316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.809320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.809322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.809325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.809327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.809330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.809332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.809335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.809337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.809340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.809342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.809345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.809347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.809350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.809353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.809356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.809358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.809361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.809363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.809366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.809368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.809371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.809373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.809375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.809396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:02.812836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:02.813388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:02.813404Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:02.813407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:02.813409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:02.813414Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1550 [2:7556255889629833682:5456]
2025-10-01T14:12:02.813424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:02.813436Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:02.813437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.813439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.813441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.813453Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:02.813456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:02.813461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:02.813499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.813506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.813509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.813512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:02.813514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:02.813571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:02.813578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.813588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.813598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.813616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:02.813637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715730:2414], now have 1 active actors on pipe
2025-10-01T14:12:02.813643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715599:2446], now have 1 active actors on pipe
2025-10-01T14:12:02.813651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255889629833676:5456]
2025-10-01T14:12:02.813657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255889629833676:5456]
2025-10-01T14:12:02.813659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255889629833676:5456]
2025-10-01T14:12:02.813671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:02.813669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1550
2025-10-01T14:12:02.813688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:02.813676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1550
2025-10-01T14:12:02.813694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:02.813698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:02.813699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:02.813704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:02.813707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:02.813742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.813749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.813761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255889629833676:5456]
2025-10-01T14:12:02.813769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:02.813780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:02.813791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:02.813796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.813798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.813800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:02.813805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.813812Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:02.813945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.814077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.814084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.814097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:02.814159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1551 partition: 0 MaxSeqNo: 45 sessionId: src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0
2025-10-01T14:12:02.814526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76bd9235-8131a4fd-3fc50c63-b5f5312b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:02.816794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0] Write session: try to update token
2025-10-01T14:12:02.816807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:02.829208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1551 sessionId: src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:02.836297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:02.838873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:02.838895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:02.838914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:02.838916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:02.838918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:02.838919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:02.838925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255889629833676:5456]
2025-10-01T14:12:02.838929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255889629833676:5456]
2025-10-01T14:12:02.838931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255889629833676:5456]
2025-10-01T14:12:02.838963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:02.838976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:02.838980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.838982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:02.838982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:02.838987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:02.839123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:02.895890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255892006715767:2856]
2025-10-01T14:12:02.896116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1550, pipe: [1:7556255892006715767:2856]
2025-10-01T14:12:02.978732Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:02.979018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:02.979080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715767:2856], now have 1 active actors on pipe
2025-10-01T14:12:02.979144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:02.979245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255892006715767:2856]
2025-10-01T14:12:02.979273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:02.988101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:02.988115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:02.988133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1551 reason: error at write: Disconnected sessionId: src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0
2025-10-01T14:12:02.988246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1551 sessionId: src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0 is DEAD
2025-10-01T14:12:02.988376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:02.988382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0] Write session will restart in 0.005260s
2025-10-01T14:12:02.988404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0] Write session: Do CDS request
2025-10-01T14:12:02.988411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:02.991697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:02.992176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:02.992341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:02.992351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:02.992360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:02.992403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:02.992440Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255889629833824:5437]
2025-10-01T14:12:02.993009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:02.993283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:02.993319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:02.993515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:02.993547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.993551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.993551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.993552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.993553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.993554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.993554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.993555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.993556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.993556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.993557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.993557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.993558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.993559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.993562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.993570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.993574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.993577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.993580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.993584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.993588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.993591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.993594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.993596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.993597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.993599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.993601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.993603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.993609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.993613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:02.993617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.993620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:02.993623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.993625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:02.993628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.993630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:02.993633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.993636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:02.993638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.993641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:02.993648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.993651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:02.993653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.993656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:02.993658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.993661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:02.993663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.993666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.993668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.993671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.993673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.993676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.993682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.993685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:02.993687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.993690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:02.993709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:02.994764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.995117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:02.995131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1552
2025-10-01T14:12:02.995227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:02.995248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1552 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:02.995255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1552 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:02.995258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:02.995526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1552 sessionId:  describe result for acl check
2025-10-01T14:12:02.995548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:02.995554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:02.995556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:02.995559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255892006715951:2394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:02.995898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255892006715951:2394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:02.997833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255892006715951:2394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:02.998031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:02.998869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:02.998884Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:02.998886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:02.998889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:02.998895Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1551 [2:7556255889629833824:5437]
2025-10-01T14:12:02.998907Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:02.998921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:02.998924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:02.998928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:02.998934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:02.998950Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:02.998959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:02.998965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:02.999014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.999022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.999023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.999026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:02.999028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:02.999085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:02.999091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:02.999101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:02.999113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:02.999129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:02.999150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255892006715772:2446], now have 1 active actors on pipe
2025-10-01T14:12:02.999162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255889629833819:5437]
2025-10-01T14:12:02.999167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255889629833819:5437]
2025-10-01T14:12:02.999168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255889629833819:5437]
2025-10-01T14:12:02.999180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:02.999196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:02.999201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:02.999203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:02.999204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:02.999212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:02.999214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:02.999190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1551
2025-10-01T14:12:02.999248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255889629833819:5437]
2025-10-01T14:12:02.999258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:02.999275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:03.003966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255892006715951:2394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:03.003983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255892006715951:2394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:03.003987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255892006715951:2394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:03.003994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1552 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:03.004258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1551
2025-10-01T14:12:03.004248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683282:2394], now have 1 active actors on pipe
2025-10-01T14:12:03.004323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.004335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.004366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:03.004382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.004392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.004399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:03.004410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.004431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:03.004455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.004609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.004617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.004632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.004745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1552 partition: 0 MaxSeqNo: 45 sessionId: src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0
2025-10-01T14:12:03.005113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a98adb5-832c12a-abe8d587-b0a0c633_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:03.007616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0] Write session: try to update token
2025-10-01T14:12:03.007638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:03.010025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:03.010048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:03.010059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255889629833819:5437]
2025-10-01T14:12:03.010100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:03.010109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:03.010344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:03.010497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:03.010626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:03.010759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:03.010947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:03.010991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:03.020722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1552 sessionId: src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:03.022920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:03.023098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.023119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.023148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:03.023214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:03.028501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:03.028518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:03.028519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:03.028523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:03.028531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255889629833819:5437]
2025-10-01T14:12:03.028535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255889629833819:5437]
2025-10-01T14:12:03.028537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255889629833819:5437]
2025-10-01T14:12:03.028580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:03.028586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.028588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:03.028600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:03.028605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:03.028608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:03.028712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:03.079204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255896301683285:2856]
2025-10-01T14:12:03.079413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1551, pipe: [1:7556255896301683285:2856]
2025-10-01T14:12:03.169449Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:03.177466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.177495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.177649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.177714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.177771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.177830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.177878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.177883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.177943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.177999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.178057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.178120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.178163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.178171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.178241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.178300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.181630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:03.181643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0] Write session will restart in 0.007068s
2025-10-01T14:12:03.181667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0] Write session: Do CDS request
2025-10-01T14:12:03.181672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:03.178366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.178455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.178499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.178502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.178565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.178623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.178678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.178736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.178774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.178777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.178837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.178892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.178949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.179003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.179042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.179045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.179107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.179164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.179221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.179280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.179315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.179319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.179380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.179431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.179488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.179544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.179586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.179589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.179655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.179708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.179766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.179821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.179857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.179860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.179922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.179979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.180037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.180096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.180134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.180137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.180196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.180248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.180306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.180367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.180406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.180409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.180800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683285:2856], now have 1 active actors on pipe
2025-10-01T14:12:03.181902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:03.181053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:03.181134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255896301683285:2856]
2025-10-01T14:12:03.181287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:03.181291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:03.181316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1552 reason: error at write: Disconnected sessionId: src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0
2025-10-01T14:12:03.181520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1552 sessionId: src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0 is DEAD
2025-10-01T14:12:03.189902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.189971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:03.189990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1553
2025-10-01T14:12:03.190107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.190139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1553 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:03.190147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1553 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:03.190150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:03.190518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1553 sessionId:  describe result for acl check
2025-10-01T14:12:03.190555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:03.190562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:03.190564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:03.190570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255896301683441:2383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:03.191502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255896301683441:2383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:03.192406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:03.193206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:03.193418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:03.193427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:03.193437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:03.193492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:03.193526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255893924801280:5436]
2025-10-01T14:12:03.194104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:03.194173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255896301683441:2383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:03.194414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:03.194463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:03.194687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:03.194731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.194735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.194736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.194737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.194737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.194738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.194739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.194739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.194740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.194741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.194742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.194743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.194743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.194744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.194748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.194754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.194756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.194758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.194760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.194763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.194765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.194767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.194769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.194773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.194776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.194780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.194783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.194787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.194792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.194800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.194806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.194817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.194824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.194829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.194837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.194840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.194860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.194870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.194878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.194885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.194891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.194894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.194897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.194900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.194905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.194909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.194912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.194918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.194921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.194923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.194925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.194928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.194932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.194935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.194937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.194940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.194968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:03.198475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255896301683441:2383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:03.198494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255896301683441:2383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:03.198498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255896301683441:2383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:03.198506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1553 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:03.198582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:03.199348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:03.199364Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:03.199366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:03.199370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:03.199377Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1552 [2:7556255893924801280:5436]
2025-10-01T14:12:03.199391Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:03.199407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:03.199414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.199418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.199421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.199438Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:03.199447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:03.199453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:03.199501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.199507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.199508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.199510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:03.199512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:03.199564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:03.199569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.199576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.199583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.199595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:03.199611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255893924801274:5436]
2025-10-01T14:12:03.199619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255893924801274:5436]
2025-10-01T14:12:03.199620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255893924801274:5436]
2025-10-01T14:12:03.199628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:03.199636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:03.199640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683500:2383], now have 1 active actors on pipe
2025-10-01T14:12:03.199640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:03.199642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:03.199645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683288:2446], now have 1 active actors on pipe
2025-10-01T14:12:03.199649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:03.199657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:03.199659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:03.199681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255893924801274:5436]
2025-10-01T14:12:03.199690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:03.199702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:03.199722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1552
2025-10-01T14:12:03.199807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1552
2025-10-01T14:12:03.199857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.199865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.199884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57b7e046-da1822e7-699360eb-a4857a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:03.199893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.199896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.199897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:03.199903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.199912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:03.199923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.200110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.200126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.200148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.200237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1553 partition: 0 MaxSeqNo: 45 sessionId: src_id|57b7e046-da1822e7-699360eb-a4857a6_0
2025-10-01T14:12:03.200583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abf0b996-3fc90f79-d6454ca3-b97e4bef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|57b7e046-da1822e7-699360eb-a4857a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:03.203078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57b7e046-da1822e7-699360eb-a4857a6_0] Write session: try to update token
2025-10-01T14:12:03.203097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57b7e046-da1822e7-699360eb-a4857a6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:03.214421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:03.214444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:03.214456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255893924801274:5436]
2025-10-01T14:12:03.214503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:03.214507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:03.214675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:03.214822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:03.214959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:03.215106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:03.215375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:03.215423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:03.217250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1553 sessionId: src_id|57b7e046-da1822e7-699360eb-a4857a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:03.219548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:03.219735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.219757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.219790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:03.219867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:03.233419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:03.233441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:03.233443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:03.233445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:03.233456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255893924801274:5436]
2025-10-01T14:12:03.233459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255893924801274:5436]
2025-10-01T14:12:03.233463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255893924801274:5436]
2025-10-01T14:12:03.233513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:03.233515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:03.233521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:03.233524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.233525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:03.233529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:03.233653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:03.281428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255896301683519:2856]
2025-10-01T14:12:03.281641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1552, pipe: [1:7556255896301683519:2856]
2025-10-01T14:12:03.383303Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:03.391195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.391227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.391395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.391464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.391526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.391599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.391646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.391655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.391726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.391784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.391851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.391918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.391963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.391973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.392033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.392090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.392154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.392223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.392321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.392329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.392391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.392456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.392519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.392584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.392630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.392637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.392712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.392773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.392836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.392904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.392954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.392962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.393030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.393090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.393158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.393226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.393269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.393277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.393346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.393405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.393469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.393531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.393575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.393582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.393646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.393710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.393770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.393825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.393869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.393877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.393938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.394003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.394055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.394104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.394140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.394143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.394211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:03.394265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:03.394320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:03.394465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:03.394511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:03.394514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:03.394584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683519:2856], now have 1 active actors on pipe
2025-10-01T14:12:03.394959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255896301683519:2856]
2025-10-01T14:12:03.394981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:03.394985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:03.394994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:03.395013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1553 reason: error at write: Disconnected sessionId: src_id|57b7e046-da1822e7-699360eb-a4857a6_0
2025-10-01T14:12:03.395214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1553 sessionId: src_id|57b7e046-da1822e7-699360eb-a4857a6_0 is DEAD
2025-10-01T14:12:03.395350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57b7e046-da1822e7-699360eb-a4857a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:03.395359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57b7e046-da1822e7-699360eb-a4857a6_0] Write session will restart in 0.007937s
2025-10-01T14:12:03.395385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57b7e046-da1822e7-699360eb-a4857a6_0] Write session: Do CDS request
2025-10-01T14:12:03.395391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57b7e046-da1822e7-699360eb-a4857a6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:03.395595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:03.404894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57b7e046-da1822e7-699360eb-a4857a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.404991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:03.405012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1554
2025-10-01T14:12:03.405463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.405504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1554 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:03.405513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1554 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:03.405517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:03.405837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:03.405856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1554 sessionId:  describe result for acl check
2025-10-01T14:12:03.405890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:03.405895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:03.405897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:03.405901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255896301683698:2373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:03.406307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255896301683698:2373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:03.406746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:03.406929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:03.406940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:03.406951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:03.407000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:03.407032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255893924801431:5425]
2025-10-01T14:12:03.407432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:03.407655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:03.407687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:03.407885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:03.407921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.407925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.407925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.407926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.407927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.407927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.407928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.407928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.407929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.407929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.407930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.407931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.407931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.407932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.407936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.407941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.407943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.407945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.407947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.407949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.407951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.407953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.407955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.407957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.407959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.407961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.407963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.407965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.407969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.407973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.407977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.407980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.407983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.407985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.407988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.407991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.407996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.408000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.408004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.408009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.408012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.408016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.408020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.408024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.408027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.408031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.408035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.408039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.408043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.408047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.408051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.408055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.408059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.408064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.408068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.408071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.408101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:03.408125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255896301683698:2373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:03.411428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255896301683698:2373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:03.411446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255896301683698:2373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:03.411449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255896301683698:2373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:03.411456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1554 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:03.411701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:03.412253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:03.412265Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:03.412267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:03.412269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:03.412276Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1553 [2:7556255893924801431:5425]
2025-10-01T14:12:03.412286Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:03.412297Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:03.412299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.412302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.412303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.412314Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:03.412317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:03.412320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:03.412363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.412371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.412372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.412374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:03.412376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:03.412422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:03.412427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.412436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.412450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.412466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:03.412485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255893924801426:5425]
2025-10-01T14:12:03.412491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255893924801426:5425]
2025-10-01T14:12:03.412494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255893924801426:5425]
2025-10-01T14:12:03.412507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:03.412518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:03.412524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683525:2446], now have 1 active actors on pipe
2025-10-01T14:12:03.412527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683740:2373], now have 1 active actors on pipe
2025-10-01T14:12:03.412534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:03.412543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:03.412545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:03.412546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:03.412549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:03.412547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1553
2025-10-01T14:12:03.412552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1553
2025-10-01T14:12:03.412576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255893924801426:5425]
2025-10-01T14:12:03.412583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:03.412585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:03.412610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.412618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.412647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:03.412667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.412675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.412677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:03.412685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.412693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:03.412708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.412842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.412849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.412861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.412936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1554 partition: 0 MaxSeqNo: 45 sessionId: src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0
2025-10-01T14:12:03.413259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57b7e046-da1822e7-699360eb-a4857a6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:03.415673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0] Write session: try to update token
2025-10-01T14:12:03.415690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:03.430611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1554 sessionId: src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:03.433055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:03.433639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.433662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.433681Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:03.433683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:03.433684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:03.433686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:03.433694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255893924801426:5425]
2025-10-01T14:12:03.433697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255893924801426:5425]
2025-10-01T14:12:03.433699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255893924801426:5425]
2025-10-01T14:12:03.433743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:03.433742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:03.433750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:03.433751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.433753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:03.433753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:03.433868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:03.494988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255896301683751:2856]
2025-10-01T14:12:03.495376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1553, pipe: [1:7556255896301683751:2856]
2025-10-01T14:12:03.571892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:03.572124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:03.572176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683751:2856], now have 1 active actors on pipe
2025-10-01T14:12:03.572249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:03.572325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255896301683751:2856]
2025-10-01T14:12:03.572351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:03.572353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:03.572356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:03.572422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1554 reason: error at write: Disconnected sessionId: src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0
2025-10-01T14:12:03.572583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1554 sessionId: src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0 is DEAD
2025-10-01T14:12:03.572733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:03.572743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0] Write session will restart in 0.005671s
2025-10-01T14:12:03.572766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0] Write session: Do CDS request
2025-10-01T14:12:03.572771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:03.579869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.579934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:03.579949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1555
2025-10-01T14:12:03.580068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.580096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1555 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:03.580105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1555 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:03.580108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:03.580477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1555 sessionId:  describe result for acl check
2025-10-01T14:12:03.580516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:03.580523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:03.580525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:03.580530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255896301683925:2372] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:03.581020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255896301683925:2372] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:03.581142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:03.581801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:03.581919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:03.581926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:03.581934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:03.581960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:03.581984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255893924801569:5422]
2025-10-01T14:12:03.582347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:03.582596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:03.582643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:03.582655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255896301683925:2372] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:03.582875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:03.582928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.582934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.582935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.582936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.582937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.582938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.582939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.582939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.582940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.582941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.582942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.582943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.582944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.582945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.582949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.582958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.582961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.582965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.582968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.582971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.582974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.582977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.582981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.582984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.582987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.582990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.582993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.582996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.583002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.583009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.583014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.583019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.583022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.583027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.583031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.583035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.583039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.583043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.583047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.583053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.583057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.583062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.583065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.583069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.583073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.583078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.583081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.583085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.583089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.583094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.583097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.583101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.583105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.583109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.583112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.583116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.583149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:03.586494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255896301683925:2372] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:03.586510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255896301683925:2372] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:03.586513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255896301683925:2372] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:03.586521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1555 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:03.586622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:03.587187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:03.587200Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:03.587202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:03.587205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:03.587209Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1554 [2:7556255893924801569:5422]
2025-10-01T14:12:03.587220Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:03.587234Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:03.587239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.587242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.587244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.587254Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:03.587261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:03.587265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:03.587318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.587325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.587327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.587330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:03.587332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:03.587391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:03.587398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.587408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.587421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.587440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:03.587461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683967:2372], now have 1 active actors on pipe
2025-10-01T14:12:03.587468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683752:2446], now have 1 active actors on pipe
2025-10-01T14:12:03.587475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255893924801564:5422]
2025-10-01T14:12:03.587482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255893924801564:5422]
2025-10-01T14:12:03.587483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255893924801564:5422]
2025-10-01T14:12:03.587483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1554
2025-10-01T14:12:03.587497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:03.587513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:03.587513Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1554
2025-10-01T14:12:03.587515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:03.587516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:03.587519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:03.587527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:03.587530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:03.587562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.587570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.587586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255893924801564:5422]
2025-10-01T14:12:03.587595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:03.587603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:03.587619Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:03.587629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.587633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.587635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:03.587642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.587649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:03.587672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.587781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.587789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.587803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.587856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1555 partition: 0 MaxSeqNo: 45 sessionId: src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0
2025-10-01T14:12:03.588188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80736d69-476ae4a9-3f912fd6-80a5e0e0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:03.590446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0] Write session: try to update token
2025-10-01T14:12:03.590462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:03.604644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1555 sessionId: src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:03.606955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:03.607492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.607518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.607537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:03.607539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:03.607541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:03.607542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:03.607549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255893924801564:5422]
2025-10-01T14:12:03.607552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255893924801564:5422]
2025-10-01T14:12:03.607555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255893924801564:5422]
2025-10-01T14:12:03.607590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:03.607603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:03.607610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:03.607610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:03.607617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.607619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:03.607750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:03.672629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255896301683975:2856]
2025-10-01T14:12:03.672926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1554, pipe: [1:7556255896301683975:2856]
2025-10-01T14:12:03.747801Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:03.748223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:03.748286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683975:2856], now have 1 active actors on pipe
2025-10-01T14:12:03.748356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:03.748473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255896301683975:2856]
2025-10-01T14:12:03.748508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:03.757408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:03.757901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:03.758050Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:03.758059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:03.758068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:03.758105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:03.758139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255893924801706:5418]
2025-10-01T14:12:03.758652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:03.758668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:03.758687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1555 reason: error at write: Disconnected sessionId: src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0
2025-10-01T14:12:03.758693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:03.758829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1555 sessionId: src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0 is DEAD
2025-10-01T14:12:03.758938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:03.758949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0] Write session will restart in 0.009235s
2025-10-01T14:12:03.758972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0] Write session: Do CDS request
2025-10-01T14:12:03.758978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:03.762118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:03.762166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:03.762434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:03.762473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.762477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.762478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.762478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.762479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.762480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.762480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.762481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.762482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.762482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.762483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.762483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.762484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.762484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.762489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.762494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.762496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.762498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.762501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.762503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.762505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.762507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.762509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.762511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.762513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.762515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.762517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.762519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.762525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.762530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.762534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.762536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.762539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.762542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.762544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.762547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.762549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.762552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.762556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.762559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.762562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.762564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.762570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.762573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.762575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.762578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.762580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.762584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.762589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.762592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.762594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.762597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.762599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.762605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.762607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.762609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.762631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:03.765962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:03.766692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:03.766705Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:03.766706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:03.766709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:03.766714Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1555 [2:7556255893924801706:5418]
2025-10-01T14:12:03.766726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:03.766738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:03.766740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.766742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.766744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.766755Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:03.766763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:03.766767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:03.766812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.766819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.766821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.766823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:03.766825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:03.766882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:03.766888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.766896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.766902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.766915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:03.766931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301683977:2446], now have 1 active actors on pipe
2025-10-01T14:12:03.766941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255893924801701:5418]
2025-10-01T14:12:03.766948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255893924801701:5418]
2025-10-01T14:12:03.766949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255893924801701:5418]
2025-10-01T14:12:03.766961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:03.766977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:03.766980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:03.766983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:03.766986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:03.766995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:03.766998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:03.766993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1555
2025-10-01T14:12:03.767024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255893924801701:5418]
2025-10-01T14:12:03.767034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:03.767039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:03.768893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.769249Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:03.769262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1556
2025-10-01T14:12:03.769364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.769387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1556 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:03.769395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1556 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:03.769397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:03.769711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1556 sessionId:  describe result for acl check
2025-10-01T14:12:03.769735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:03.769740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:03.769741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:03.769744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255896301684162:2366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:03.770117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255896301684162:2366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:03.772464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255896301684162:2366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:03.777902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255896301684162:2366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:03.777920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255896301684162:2366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:03.777923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255896301684162:2366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:03.777930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1556 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:03.778154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301684196:2366], now have 1 active actors on pipe
2025-10-01T14:12:03.778185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1555
2025-10-01T14:12:03.778225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.778235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.778255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab25289e-e70e861d-f9d3d357-3145374d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:03.778268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.778272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.778274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:03.778283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.778297Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:03.778314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.778430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.778435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.778445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.778513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1556 partition: 0 MaxSeqNo: 45 sessionId: src_id|ab25289e-e70e861d-f9d3d357-3145374d_0
2025-10-01T14:12:03.778836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|351b9e82-3a39ac6a-b7318050-a634fe6c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ab25289e-e70e861d-f9d3d357-3145374d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:03.781072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab25289e-e70e861d-f9d3d357-3145374d_0] Write session: try to update token
2025-10-01T14:12:03.781097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab25289e-e70e861d-f9d3d357-3145374d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:03.786251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:03.786268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:03.786270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:03.786271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:03.786278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255893924801701:5418]
2025-10-01T14:12:03.786282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255893924801701:5418]
2025-10-01T14:12:03.786284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255893924801701:5418]
2025-10-01T14:12:03.786319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:03.786324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.786326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:03.786326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:03.786331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:03.786334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:03.786452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:03.793695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1556 sessionId: src_id|ab25289e-e70e861d-f9d3d357-3145374d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:03.796009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:03.848748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255896301684202:2856]
2025-10-01T14:12:03.848977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1555, pipe: [1:7556255896301684202:2856]
2025-10-01T14:12:03.925343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:03.925614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.925630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.925649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301684202:2856], now have 1 active actors on pipe
2025-10-01T14:12:03.925752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:03.925791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:03.925795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:03.925842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1556 reason: error at write: Disconnected sessionId: src_id|ab25289e-e70e861d-f9d3d357-3145374d_0
2025-10-01T14:12:03.926018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255896301684202:2856]
2025-10-01T14:12:03.926024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1556 sessionId: src_id|ab25289e-e70e861d-f9d3d357-3145374d_0 is DEAD
2025-10-01T14:12:03.926114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:03.926147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab25289e-e70e861d-f9d3d357-3145374d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:03.926157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab25289e-e70e861d-f9d3d357-3145374d_0] Write session will restart in 0.009823s
2025-10-01T14:12:03.926183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab25289e-e70e861d-f9d3d357-3145374d_0] Write session: Do CDS request
2025-10-01T14:12:03.926189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab25289e-e70e861d-f9d3d357-3145374d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:03.933857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:03.934387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:03.934553Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:03.934564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:03.934578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:03.934653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:03.934689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255893924801851:5386]
2025-10-01T14:12:03.935132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:03.935387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:03.935417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:03.935671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:03.935732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.935738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.935739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.935740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.935741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.935741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.935742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.935743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.935744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.935745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.935746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.935747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.935748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.935749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.935753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.935762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.935765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.935769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.935772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.935775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.935779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.935782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.935786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.935790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.935798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.935802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.935809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.935812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.935819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.935830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:03.935840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.935849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:03.935857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.935862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:03.935866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.935871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:03.935876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.935881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:03.935886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.935891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:03.935899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.935904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:03.935912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.935921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:03.935929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.935938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:03.935946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.935955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.935960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.935969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.935978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.935987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.935996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.936005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:03.936012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.936017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:03.936059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:03.936866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab25289e-e70e861d-f9d3d357-3145374d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.936942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:03.936960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1557
2025-10-01T14:12:03.937050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:03.937079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1557 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:03.937089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1557 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:03.937096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:03.937457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1557 sessionId:  describe result for acl check
2025-10-01T14:12:03.937496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:03.937503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:03.937505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:03.937510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255896301684410:2331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:03.937980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255896301684410:2331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:03.939372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255896301684410:2331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:03.939522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:03.940337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:03.940358Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:03.940360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:03.940364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:03.940370Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1556 [2:7556255893924801851:5386]
2025-10-01T14:12:03.940386Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:03.940400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:03.940408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.940411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.940414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.940430Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:03.940439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:03.940445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:03.940504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.940511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.940513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.940516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:03.940519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:03.940582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:03.940589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.940601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:03.940617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:03.940637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:03.940684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301684228:2446], now have 1 active actors on pipe
2025-10-01T14:12:03.940696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255893924801846:5386]
2025-10-01T14:12:03.940703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255893924801846:5386]
2025-10-01T14:12:03.940705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255893924801846:5386]
2025-10-01T14:12:03.940719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:03.940702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1556
2025-10-01T14:12:03.940730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:03.940733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:03.940735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:03.940738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:03.940751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:03.940759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:03.940792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255893924801846:5386]
2025-10-01T14:12:03.940803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:03.940814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:03.942588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255896301684410:2331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:03.942604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255896301684410:2331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:03.942607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255896301684410:2331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:03.942614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1557 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:03.942808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255896301684445:2331], now have 1 active actors on pipe
2025-10-01T14:12:03.942857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1556
2025-10-01T14:12:03.942904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.942913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.942936Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43c9054d-90e584f0-83641295-226fb911_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:03.942947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:03.942951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:03.942952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:03.942960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:03.942973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:03.942988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.943118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.943125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.943137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:03.943219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1557 partition: 0 MaxSeqNo: 45 sessionId: src_id|43c9054d-90e584f0-83641295-226fb911_0
2025-10-01T14:12:03.943527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab25289e-e70e861d-f9d3d357-3145374d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|43c9054d-90e584f0-83641295-226fb911_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:03.945832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c9054d-90e584f0-83641295-226fb911_0] Write session: try to update token
2025-10-01T14:12:03.945847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c9054d-90e584f0-83641295-226fb911_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:03.952111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:03.952133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:03.952143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255893924801846:5386]
2025-10-01T14:12:03.952176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:03.952184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:03.952351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:03.952494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:03.952632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:03.952796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:03.953130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:03.953173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:03.958753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1557 sessionId: src_id|43c9054d-90e584f0-83641295-226fb911_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:03.961163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:03.961386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:03.961413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:03.961452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:03.961537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:03.970454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:03.970474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:03.970476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:03.970478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:03.970489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255893924801846:5386]
2025-10-01T14:12:03.970492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255893924801846:5386]
2025-10-01T14:12:03.970496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255893924801846:5386]
2025-10-01T14:12:03.970542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:03.970546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:03.970548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:03.970552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:03.970553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:03.970555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:03.970692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:04.026428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255900596651745:2856]
2025-10-01T14:12:04.026681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1556, pipe: [1:7556255900596651745:2856]
2025-10-01T14:12:04.117024Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:04.125197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.125230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.125406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.125471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.125535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.125593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.125998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.126008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.126065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.126115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.126166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.126217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.126268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.126274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.126335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.126416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.126476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.126528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.126566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.126571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.126631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.126682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.126740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.126797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.126837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.126842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.126901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.126952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.127004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.127055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.127093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.127098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.127152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.127203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.127256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.127312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.127352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.127357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.127415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.127463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.127520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.127573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.127612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.127617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.127668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.127718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.127778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.127834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.127877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.127881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.127937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.127988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.128039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.128091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.128129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.128134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.128185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.128233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.128283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.128334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.128372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.128377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.128437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596651745:2856], now have 1 active actors on pipe
2025-10-01T14:12:04.128644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:04.128684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255900596651745:2856]
2025-10-01T14:12:04.128702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:04.128708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:04.128729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1557 reason: error at write: Disconnected sessionId: src_id|43c9054d-90e584f0-83641295-226fb911_0
2025-10-01T14:12:04.128899Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:04.128937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1557 sessionId: src_id|43c9054d-90e584f0-83641295-226fb911_0 is DEAD
2025-10-01T14:12:04.129059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c9054d-90e584f0-83641295-226fb911_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:04.129065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c9054d-90e584f0-83641295-226fb911_0] Write session will restart in 0.006149s
2025-10-01T14:12:04.129083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c9054d-90e584f0-83641295-226fb911_0] Write session: Do CDS request
2025-10-01T14:12:04.129088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c9054d-90e584f0-83641295-226fb911_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:04.135877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43c9054d-90e584f0-83641295-226fb911_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.135935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:04.135952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1558
2025-10-01T14:12:04.136086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.136124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1558 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:04.136135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1558 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:04.136138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:04.136481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1558 sessionId:  describe result for acl check
2025-10-01T14:12:04.136518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:04.136527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:04.136529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:04.136534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255900596651922:2322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:04.137259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255900596651922:2322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:04.137654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:04.138326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:04.138518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:04.138529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:04.138539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:04.138584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:04.138617Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255898219769301:5368]
2025-10-01T14:12:04.139200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:04.139430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:04.139472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:04.139612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255900596651922:2322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:04.139752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:04.139815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.139834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.139838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.139839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.139840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.139841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.139843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.139844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.139845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.139846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.139847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.139848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.139849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.139850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.139856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.139865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.139869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.139873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.139876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.139880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.139884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.139888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.139891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.139895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.139899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.139903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.139907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.139910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.139917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.139925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.139932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.139937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.139941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.139951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.139956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.139962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.139971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.139978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.139983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.139988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.139992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.140002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.140007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.140020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.140024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.140029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.140037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.140043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.140051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.140056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.140064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.140069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.140073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.140082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.140086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.140092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.140134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:04.143461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255900596651922:2322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:04.143479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255900596651922:2322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:04.143483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255900596651922:2322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:04.143492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1558 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:04.143701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:04.144330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:04.144346Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:04.144349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:04.144352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:04.144358Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1557 [2:7556255898219769301:5368]
2025-10-01T14:12:04.144373Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:04.144389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:04.144392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.144397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.144399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.144415Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:04.144420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:04.144425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:04.144486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.144493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.144495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.144499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:04.144501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:04.144562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:04.144570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.144581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.144594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.144611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:04.144633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596651965:2322], now have 1 active actors on pipe
2025-10-01T14:12:04.144641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596651747:2446], now have 1 active actors on pipe
2025-10-01T14:12:04.144648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255898219769296:5368]
2025-10-01T14:12:04.144654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255898219769296:5368]
2025-10-01T14:12:04.144656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255898219769296:5368]
2025-10-01T14:12:04.144683Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:04.144667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1557
2025-10-01T14:12:04.144667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1557
2025-10-01T14:12:04.144700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:04.144718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:04.144718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:04.144725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:04.144730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:04.144732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:04.144768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.144777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.144789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255898219769296:5368]
2025-10-01T14:12:04.144800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:04.144810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:04.144832Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:04.144843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.144847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.144849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:04.144858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.144870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:04.144897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.145207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.145219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.145236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.145359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1558 partition: 0 MaxSeqNo: 45 sessionId: src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0
2025-10-01T14:12:04.145706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43c9054d-90e584f0-83641295-226fb911_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:04.147957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0] Write session: try to update token
2025-10-01T14:12:04.147974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:04.160711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1558 sessionId: src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:04.163195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:04.164575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.164599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.164617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:04.164619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:04.164620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:04.164622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:04.164628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255898219769296:5368]
2025-10-01T14:12:04.164631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255898219769296:5368]
2025-10-01T14:12:04.164634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255898219769296:5368]
2025-10-01T14:12:04.164670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:04.164676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:04.164679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:04.164695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:04.164706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.164707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:04.164827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:04.228648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255900596651984:2856]
2025-10-01T14:12:04.228929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1557, pipe: [1:7556255900596651984:2856]
2025-10-01T14:12:04.301538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:04.301815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:04.301860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596651984:2856], now have 1 active actors on pipe
2025-10-01T14:12:04.301954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:04.302000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:04.302044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255900596651984:2856]
2025-10-01T14:12:04.302045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:04.302048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:04.302109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1558 reason: error at write: Disconnected sessionId: src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0
2025-10-01T14:12:04.302272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1558 sessionId: src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0 is DEAD
2025-10-01T14:12:04.302417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:04.302427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0] Write session will restart in 0.007785s
2025-10-01T14:12:04.302451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0] Write session: Do CDS request
2025-10-01T14:12:04.302457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:04.310721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:04.310906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.310961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:04.310976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1559
2025-10-01T14:12:04.311105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.311137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1559 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:04.311146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1559 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:04.311150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:04.311320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:04.311492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1559 sessionId:  describe result for acl check
2025-10-01T14:12:04.311530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:04.311537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:04.311539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:04.311544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255900596652166:2327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:04.311520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:04.311532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:04.311543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:04.311594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:04.311627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255898219769470:5363]
2025-10-01T14:12:04.312026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255900596652166:2327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:04.312174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:04.312439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:04.312478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:04.312727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:04.312780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.312784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.312785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.312786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.312786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.312787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.312788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.312788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.312789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.312790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.312790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.312791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.312791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.312792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.312796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.312801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.312803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.312805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.312807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.312810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.312812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.312814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.312816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.312818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.312820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.312822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.312824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.312826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.312831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.312835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.312839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.312842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.312846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.312851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.312854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.312859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.312863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.312868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.312871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.312876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.312880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.312885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.312889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.312894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.312899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.312904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.312907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.312910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.312912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.312915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.312917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.312920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.312923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.312925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.312927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.312930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.312951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:04.313617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255900596652166:2327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:04.316115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255900596652166:2327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:04.316135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255900596652166:2327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:04.316139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255900596652166:2327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:04.316150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1559 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:04.316311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:04.316996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:04.317009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:04.317011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:04.317014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:04.317019Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1558 [2:7556255898219769470:5363]
2025-10-01T14:12:04.317029Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:04.317040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:04.317042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.317044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.317045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.317055Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:04.317061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:04.317065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:04.317101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.317107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.317108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.317110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:04.317112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:04.317157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:04.317162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.317169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.317175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.317183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:04.317194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255898219769465:5363]
2025-10-01T14:12:04.317198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255898219769465:5363]
2025-10-01T14:12:04.317200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255898219769465:5363]
2025-10-01T14:12:04.317206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:04.317212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:04.317214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:04.317215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:04.317216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596651985:2446], now have 1 active actors on pipe
2025-10-01T14:12:04.317218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652205:2327], now have 1 active actors on pipe
2025-10-01T14:12:04.317224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:04.317232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:04.317234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:04.317258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255898219769465:5363]
2025-10-01T14:12:04.317269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:04.317273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:04.317262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1558
2025-10-01T14:12:04.317315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1558
2025-10-01T14:12:04.317373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.317382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.317399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:04.317409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.317412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.317417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:04.317424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.317431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:04.317444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.317554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.317561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.317571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.317626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1559 partition: 0 MaxSeqNo: 45 sessionId: src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0
2025-10-01T14:12:04.317942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efae322e-aa6dba11-329f37aa-aaea8a7f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:04.320266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0] Write session: try to update token
2025-10-01T14:12:04.320285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:04.333501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1559 sessionId: src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:04.335672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:04.336983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.337007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.337024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:04.337026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:04.337028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:04.337030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:04.337036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255898219769465:5363]
2025-10-01T14:12:04.337039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255898219769465:5363]
2025-10-01T14:12:04.337041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255898219769465:5363]
2025-10-01T14:12:04.337083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:04.337090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:04.337093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.337095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:04.337095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:04.337099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:04.337222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:04.402225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255900596652217:2856]
2025-10-01T14:12:04.402497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1558, pipe: [1:7556255900596652217:2856]
2025-10-01T14:12:04.471543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:04.471760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:04.471818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652217:2856], now have 1 active actors on pipe
2025-10-01T14:12:04.471895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:04.472004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:04.472052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255900596652217:2856]
2025-10-01T14:12:04.480048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:04.480063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:04.480079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1559 reason: error at write: Disconnected sessionId: src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0
2025-10-01T14:12:04.480139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:04.480207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1559 sessionId: src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0 is DEAD
2025-10-01T14:12:04.480328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:04.480338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0] Write session will restart in 0.005753s
2025-10-01T14:12:04.480358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0] Write session: Do CDS request
2025-10-01T14:12:04.480363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:04.483476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:04.483631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:04.483648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:04.483656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:04.483690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:04.483726Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255898219769611:5364]
2025-10-01T14:12:04.484105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:04.484294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:04.484321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:04.484509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:04.484544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.484548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.484549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.484549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.484550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.484551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.484551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.484552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.484552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.484553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.484554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.484555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.484555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.484556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.484559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.484564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.484567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.484569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.484571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.484573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.484575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.484578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.484580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.484582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.484584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.484586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.484588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.484590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.484595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.484599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.484604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.484607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.484609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.484613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.484615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.484618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.484620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.484623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.484625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.484628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.484631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.484634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.484636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.484640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.484642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.484645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.484647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.484650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.484653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.484655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.484668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.484672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.484674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.484677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.484679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.484682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.484702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:04.486837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.486942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:04.486954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1560
2025-10-01T14:12:04.487052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.487076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1560 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:04.487083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1560 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:04.487086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:04.487386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1560 sessionId:  describe result for acl check
2025-10-01T14:12:04.487413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:04.487416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:04.487417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:04.487425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255900596652410:2320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:04.487802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255900596652410:2320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:04.488095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:04.488817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:04.488832Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:04.488834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:04.488837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:04.488844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1559 [2:7556255898219769611:5364]
2025-10-01T14:12:04.488857Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:04.488871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:04.488874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.488877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.488880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.488894Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:04.488904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:04.488911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:04.488957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.488970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.488973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.488976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:04.488979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:04.489044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:04.489052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.489064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.489075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.489097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:04.489118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652223:2446], now have 1 active actors on pipe
2025-10-01T14:12:04.489129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255898219769606:5364]
2025-10-01T14:12:04.489131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255898219769606:5364]
2025-10-01T14:12:04.489134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255898219769606:5364]
2025-10-01T14:12:04.489128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1559
2025-10-01T14:12:04.489148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:04.489148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:04.489151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:04.489152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:04.489164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:04.489178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:04.489181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:04.489216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255898219769606:5364]
2025-10-01T14:12:04.489230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:04.489238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:04.489631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255900596652410:2320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:04.495073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255900596652410:2320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:04.495085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255900596652410:2320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:04.495088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255900596652410:2320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:04.495093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1560 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:04.495268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652448:2320], now have 1 active actors on pipe
2025-10-01T14:12:04.495308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1559
2025-10-01T14:12:04.495343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.495355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.495377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:04.495388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.495393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.495398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:04.495406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.495421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:04.495438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.495569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.495575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.495584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.495633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1560 partition: 0 MaxSeqNo: 45 sessionId: src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0
2025-10-01T14:12:04.495972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f25c0ffe-ae77ff33-f8f0fa18-993f02df_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:04.498148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0] Write session: try to update token
2025-10-01T14:12:04.498160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:04.498992Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:04.499006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:04.499013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255898219769606:5364]
2025-10-01T14:12:04.499040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:04.499042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:04.499182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:04.499299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:04.499414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:04.499531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:04.499689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:04.499716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:04.510175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1560 sessionId: src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:04.512730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:04.512907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.512931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.512968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:04.513064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:04.516693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:04.516709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:04.516711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:04.516712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:04.516721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255898219769606:5364]
2025-10-01T14:12:04.516723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255898219769606:5364]
2025-10-01T14:12:04.516726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255898219769606:5364]
2025-10-01T14:12:04.516755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:04.516758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:04.516761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:04.516763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:04.516766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.516768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:04.516879Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:04.572232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255900596652451:2856]
2025-10-01T14:12:04.572516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1559, pipe: [1:7556255900596652451:2856]
2025-10-01T14:12:04.648546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:04.655559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.655584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.655722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.655776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.655832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.655883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.655924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.655931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.655986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.656043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.656103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.656156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.656201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.656208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.656269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.656330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.656389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.656452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.656491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.656497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.656557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.656618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.656702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.656763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.656803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.656808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.656867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.656925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.656985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.657043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.657083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.657088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.657149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.657203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.657258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.657315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.657355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.657360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.657418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.657469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.657525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.657582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.657626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.657631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.657688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.657743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.657805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.657861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.657916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.657926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.657988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.658044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.658101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.658155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.658194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.658200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.658265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.658325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.658398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.658460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.658500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.658506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.658552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652451:2856], now have 1 active actors on pipe
2025-10-01T14:12:04.658794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:04.658809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:04.658818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255900596652451:2856]
2025-10-01T14:12:04.658839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1560 reason: error at write: Disconnected sessionId: src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0
2025-10-01T14:12:04.658849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:04.659002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1560 sessionId: src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0 is DEAD
2025-10-01T14:12:04.659170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:04.659179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0] Write session will restart in 0.007701s
2025-10-01T14:12:04.659204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0] Write session: Do CDS request
2025-10-01T14:12:04.659210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:04.659412Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:04.667893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.667964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:04.667980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1561
2025-10-01T14:12:04.668104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.668129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1561 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:04.668136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1561 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:04.668138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:04.668433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1561 sessionId:  describe result for acl check
2025-10-01T14:12:04.668464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:04.668470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:04.668471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:04.668475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255900596652634:8358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:04.668703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:04.668873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255900596652634:8358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:04.669479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:04.669637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:04.669645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:04.669653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:04.669688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:04.669715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255898219769755:5356]
2025-10-01T14:12:04.670109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:04.670324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:04.670351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:04.670582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:04.670623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.670628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.670628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.670629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.670630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.670631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.670631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.670632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.670633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.670633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.670634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.670634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.670635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.670636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.670639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.670645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.670647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.670649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.670652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.670654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.670656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.670658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.670660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.670663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.670665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.670667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.670669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.670671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.670676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.670680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.670684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.670687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.670690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.670693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.670695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.670697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.670700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.670702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.670704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.670707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.670709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.670712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.670714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.670717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.670720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.670723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.670725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.670727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.670733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.670736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.670738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.670741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.670744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.670750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.670752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.670755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.670777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:04.670970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255900596652634:8358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:04.673997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255900596652634:8358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:04.674013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255900596652634:8358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:04.674016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255900596652634:8358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:04.674024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1561 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:04.674205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:04.674788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:04.674803Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:04.674805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:04.674807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:04.674816Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1560 [2:7556255898219769755:5356]
2025-10-01T14:12:04.674825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:04.674838Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:04.674843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.674846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.674847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.674859Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:04.674866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:04.674871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:04.674914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.674919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.674920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.674923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:04.674924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:04.674974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:04.674979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.674986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.674995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.675007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:04.675022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255898219769750:5356]
2025-10-01T14:12:04.675027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255898219769750:5356]
2025-10-01T14:12:04.675029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255898219769750:5356]
2025-10-01T14:12:04.675035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:04.675043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:04.675047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652454:2446], now have 1 active actors on pipe
2025-10-01T14:12:04.675052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:04.675053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:04.675055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:04.675060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:04.675061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:04.675064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652673:8358], now have 1 active actors on pipe
2025-10-01T14:12:04.675081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255898219769750:5356]
2025-10-01T14:12:04.675088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:04.675074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1560
2025-10-01T14:12:04.675079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1560
2025-10-01T14:12:04.675099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:04.675116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.675123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.675145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e1aa377-3bc6e709-522f670d-37291037_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:04.675156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.675165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.675170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:04.675176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.675186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:04.675196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.675319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.675327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.675341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.675405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1561 partition: 0 MaxSeqNo: 45 sessionId: src_id|4e1aa377-3bc6e709-522f670d-37291037_0
2025-10-01T14:12:04.675729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|289fc086-43249d55-a3d4be64-3bf49aaf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4e1aa377-3bc6e709-522f670d-37291037_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:04.678150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1aa377-3bc6e709-522f670d-37291037_0] Write session: try to update token
2025-10-01T14:12:04.678166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1aa377-3bc6e709-522f670d-37291037_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:04.686315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:04.686335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:04.686344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255898219769750:5356]
2025-10-01T14:12:04.686398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:04.686398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:04.686558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:04.686688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:04.686817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:04.686954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:04.687123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:04.687155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:04.691229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1561 sessionId: src_id|4e1aa377-3bc6e709-522f670d-37291037_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:04.693288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:04.693455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.693481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.693514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:04.693604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:04.706160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:04.706182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:04.706184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:04.706185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:04.706195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255898219769750:5356]
2025-10-01T14:12:04.706199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255898219769750:5356]
2025-10-01T14:12:04.706202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255898219769750:5356]
2025-10-01T14:12:04.706241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:04.706250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.706249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:04.706251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:04.706255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:04.706259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:04.706388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:04.759078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255900596652681:2856]
2025-10-01T14:12:04.759534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1560, pipe: [1:7556255900596652681:2856]
2025-10-01T14:12:04.839130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:04.846305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.846332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.846497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.846554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.846612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.846682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.846733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.846745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.846810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.846864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.846918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.846977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.847016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.847021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.847076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.847125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.847184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.847241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.847282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.847289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.847343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.847398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.847455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.847509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.847548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.847553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.847608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.847660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.847713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.847769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.847810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.847816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.847875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.847928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.847985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.848043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.848083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.848087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.848145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.848204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.848265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.848320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.848359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.848364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.848422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.848479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.848533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.848591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.848631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.848636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.848704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.848756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.848809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.848862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.848902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.848907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.848962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:04.849015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:04.849067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:04.849119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:04.849158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:04.849162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:04.849208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652681:2856], now have 1 active actors on pipe
2025-10-01T14:12:04.849438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:04.849444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255900596652681:2856]
2025-10-01T14:12:04.849464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:04.849466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:04.849490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1561 reason: error at write: Disconnected sessionId: src_id|4e1aa377-3bc6e709-522f670d-37291037_0
2025-10-01T14:12:04.849685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1561 sessionId: src_id|4e1aa377-3bc6e709-522f670d-37291037_0 is DEAD
2025-10-01T14:12:04.849837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1aa377-3bc6e709-522f670d-37291037_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:04.849849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1aa377-3bc6e709-522f670d-37291037_0] Write session will restart in 0.006120s
2025-10-01T14:12:04.849875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1aa377-3bc6e709-522f670d-37291037_0] Write session: Do CDS request
2025-10-01T14:12:04.849881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1aa377-3bc6e709-522f670d-37291037_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:04.850140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:04.856968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1aa377-3bc6e709-522f670d-37291037_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.856973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:04.856987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1562
2025-10-01T14:12:04.857154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:04.857184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:04.857193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:04.857198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:04.857484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1562 sessionId:  describe result for acl check
2025-10-01T14:12:04.857507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:04.857511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:04.857512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:04.857516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255900596652855:8345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:04.857887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255900596652855:8345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:04.858925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:04.859646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:04.859793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:04.859802Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:04.859810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:04.859814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255900596652855:8345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:04.859844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:04.859870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255898219769898:5340]
2025-10-01T14:12:04.860266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:04.860501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:04.860542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:04.860800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:04.860847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.860852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.860853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.860854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.860855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.860856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.860857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.860858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.860859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.860860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.860861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.860862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.860863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.860864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.860869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.860878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.860882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.860886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.860890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.860903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.860908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.860912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.860916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.860920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.860924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.860928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.860932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.860935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.860942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.860953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:04.860962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.860971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:04.860976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.860984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:04.860990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.860998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:04.861006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.861019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:04.861026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.861032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:04.861038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.861047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:04.861051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.861059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:04.861063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.861068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:04.861073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.861081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.861085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.861094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.861100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.861105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.861112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.861117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:04.861124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.861129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:04.861164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:04.864336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255900596652855:8345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:04.864351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255900596652855:8345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:04.864354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255900596652855:8345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:04.864360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:04.864418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:04.865089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:04.865103Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:04.865106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:04.865109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:04.865116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1561 [2:7556255898219769898:5340]
2025-10-01T14:12:04.865133Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:04.865153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:04.865160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.865164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.865167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.865186Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:04.865195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:04.865204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:04.865255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.865261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.865263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.865267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:04.865270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:04.865330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:04.865336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.865349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:04.865364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:04.865384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:04.865406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652907:8345], now have 1 active actors on pipe
2025-10-01T14:12:04.865413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652686:2446], now have 1 active actors on pipe
2025-10-01T14:12:04.865420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255898219769893:5340]
2025-10-01T14:12:04.865426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255898219769893:5340]
2025-10-01T14:12:04.865428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255898219769893:5340]
2025-10-01T14:12:04.865441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:04.865459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:04.865463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:04.865438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1561
2025-10-01T14:12:04.865467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:04.865469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:04.865441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1561
2025-10-01T14:12:04.865476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:04.865479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:04.865525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.865533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.865550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255898219769893:5340]
2025-10-01T14:12:04.865560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:04.865571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:04.865591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:04.865602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:04.865610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:04.865616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:04.865625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:04.865636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:04.865662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.865752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:04.865758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:04.865771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:04.865815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1562 partition: 0 MaxSeqNo: 45 sessionId: src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0
2025-10-01T14:12:04.866137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e1aa377-3bc6e709-522f670d-37291037_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:04.868780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0] Write session: try to update token
2025-10-01T14:12:04.868800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:04.882588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1562 sessionId: src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:04.884859Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:04.884861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:04.884882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:04.884885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:04.884887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:04.884897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255898219769893:5340]
2025-10-01T14:12:04.884901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255898219769893:5340]
2025-10-01T14:12:04.884907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255898219769893:5340]
2025-10-01T14:12:04.884957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:04.884960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:04.884962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:04.884964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:04.884966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:04.884969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:04.885114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:04.949531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255900596652927:2856]
2025-10-01T14:12:04.949813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1561, pipe: [1:7556255900596652927:2856]
2025-10-01T14:12:05.018093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:05.018467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.018479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.018514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255900596652927:2856], now have 1 active actors on pipe
2025-10-01T14:12:05.018675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:05.018761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:05.018776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255900596652927:2856]
2025-10-01T14:12:05.018792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:05.018849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1562 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0
2025-10-01T14:12:05.019011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1562 sessionId: src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0 is DEAD
2025-10-01T14:12:05.019160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:05.019171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0] Write session will restart in 0.005180s
2025-10-01T14:12:05.019197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0] Write session: Do CDS request
2025-10-01T14:12:05.019203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:05.025858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.026205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:05.026219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1563
2025-10-01T14:12:05.026340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.026387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:05.026400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:05.026403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:05.026778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1563 sessionId:  describe result for acl check
2025-10-01T14:12:05.026811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:05.026818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:05.026819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:05.026825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255904891620400:8338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:05.027312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255904891620400:8338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:05.028424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:05.029041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255904891620400:8338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:05.029628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:05.029830Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:05.029841Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:05.029852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:05.029900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:05.029939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255902514737359:5329]
2025-10-01T14:12:05.030529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:05.030742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:05.030785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:05.031055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:05.031117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.031123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.031124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.031125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.031125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.031126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.031127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.031127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.031128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.031129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.031130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.031130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.031131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.031132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.031138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.031147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.031150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.031153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.031156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.031159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.031163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.031166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.031169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.031173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.031175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.031180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.031183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.031186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.031192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.031199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.031210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.031219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.031226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.031229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.031235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.031238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.031241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.031244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.031249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.031252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.031255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.031261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.031263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.031266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.031268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.031271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.031277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.031280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.031282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.031285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.031291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.031294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.031297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.031303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.031305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.031308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.031333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:05.031467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255904891620400:8338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:05.031478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255904891620400:8338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:05.031481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255904891620400:8338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:05.031493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:05.034747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:05.035318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:05.035336Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:05.035338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:05.035341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:05.035347Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1562 [2:7556255902514737359:5329]
2025-10-01T14:12:05.035359Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:05.035375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:05.035381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.035383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.035385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.035397Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:05.035401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:05.035409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:05.035450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.035455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.035457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.035459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:05.035461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:05.035518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:05.035526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.035537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.035547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.035560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:05.035577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620234:2446], now have 1 active actors on pipe
2025-10-01T14:12:05.035584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620456:8338], now have 1 active actors on pipe
2025-10-01T14:12:05.035590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255902514737354:5329]
2025-10-01T14:12:05.035594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255902514737354:5329]
2025-10-01T14:12:05.035596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255902514737354:5329]
2025-10-01T14:12:05.035606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:05.035618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:05.035619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:05.035627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:05.035628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:05.035628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:05.035630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:05.035660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255902514737354:5329]
2025-10-01T14:12:05.035671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:05.035675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:05.035655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1562
2025-10-01T14:12:05.035666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1562
2025-10-01T14:12:05.035699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.035707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.035728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b8dc8ea-95268e12-662b3891-2c945469_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:05.035733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.035735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.035737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:05.035743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.035750Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:05.035760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.035884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.035890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.035900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.035955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1563 partition: 0 MaxSeqNo: 45 sessionId: src_id|9b8dc8ea-95268e12-662b3891-2c945469_0
2025-10-01T14:12:05.036272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e97f85f9-b2af18c-b36dd1b4-a23a1cbf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9b8dc8ea-95268e12-662b3891-2c945469_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:05.038900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8dc8ea-95268e12-662b3891-2c945469_0] Write session: try to update token
2025-10-01T14:12:05.038922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8dc8ea-95268e12-662b3891-2c945469_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:05.052993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1563 sessionId: src_id|9b8dc8ea-95268e12-662b3891-2c945469_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:05.055244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:05.055262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:05.055264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:05.055265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:05.055273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255902514737354:5329]
2025-10-01T14:12:05.055277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255902514737354:5329]
2025-10-01T14:12:05.055279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255902514737354:5329]
2025-10-01T14:12:05.055320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:05.055326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.055328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:05.055327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:05.055333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:05.055337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:05.055286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:05.055448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:05.119011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255904891620465:2856]
2025-10-01T14:12:05.119270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1562, pipe: [1:7556255904891620465:2856]
2025-10-01T14:12:05.191225Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:05.191650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.191663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.191698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620465:2856], now have 1 active actors on pipe
2025-10-01T14:12:05.191871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:05.191952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255904891620465:2856]
2025-10-01T14:12:05.191989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:05.191991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:05.192044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1563 reason: error at write: Disconnected sessionId: src_id|9b8dc8ea-95268e12-662b3891-2c945469_0
2025-10-01T14:12:05.192074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:05.192221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1563 sessionId: src_id|9b8dc8ea-95268e12-662b3891-2c945469_0 is DEAD
2025-10-01T14:12:05.192361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8dc8ea-95268e12-662b3891-2c945469_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:05.192369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8dc8ea-95268e12-662b3891-2c945469_0] Write session will restart in 0.007983s
2025-10-01T14:12:05.192393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8dc8ea-95268e12-662b3891-2c945469_0] Write session: Do CDS request
2025-10-01T14:12:05.192399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8dc8ea-95268e12-662b3891-2c945469_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:05.199134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:05.199964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:05.200084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:05.200092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:05.200099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:05.200126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:05.200151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255902514737506:5327]
2025-10-01T14:12:05.200541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:05.200794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:05.200835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:05.201029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:05.201060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.201064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.201065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.201066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.201066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.201067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.201067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.201068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.201068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.201069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.201069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.201070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.201070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.201071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.201074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.201079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.201081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.201083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.201085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.201087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.201089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.201091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.201093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.201096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.201098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.201100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.201102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.201104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.201109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.201113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.201117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.201120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.201122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.201124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.201127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.201129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.201132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.201135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.201141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.201144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.201146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.201149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.201155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.201158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.201164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.201166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.201169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.201171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.201174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.201179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.201181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.201184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.201186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.201189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.201191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.201194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.201217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:05.201806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8dc8ea-95268e12-662b3891-2c945469_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.201889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:05.201903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1564
2025-10-01T14:12:05.201996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.202017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:05.202024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:05.202027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:05.202276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1564 sessionId:  describe result for acl check
2025-10-01T14:12:05.202303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:05.202307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:05.202308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:05.202311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255904891620660:8332] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:05.202683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255904891620660:8332] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:05.204373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255904891620660:8332] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:05.204523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:05.205113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:05.205129Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:05.205131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:05.205134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:05.205140Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1563 [2:7556255902514737506:5327]
2025-10-01T14:12:05.205151Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:05.205163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:05.205168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.205170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.205172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.205182Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:05.205189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:05.205193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:05.205226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.205230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.205232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.205234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:05.205235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:05.205293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:05.205300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.205311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.205327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.205342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:05.205358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620470:2446], now have 1 active actors on pipe
2025-10-01T14:12:05.205370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255902514737501:5327]
2025-10-01T14:12:05.205372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255902514737501:5327]
2025-10-01T14:12:05.205374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255902514737501:5327]
2025-10-01T14:12:05.205371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1563
2025-10-01T14:12:05.205386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:05.205388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:05.205390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:05.205392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:05.205398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:05.205405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:05.205407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:05.205426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255902514737501:5327]
2025-10-01T14:12:05.205434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:05.205438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:05.209979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255904891620660:8332] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:05.209993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255904891620660:8332] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:05.209996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255904891620660:8332] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:05.210003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:05.210203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620698:8332], now have 1 active actors on pipe
2025-10-01T14:12:05.210242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1563
2025-10-01T14:12:05.210308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.210319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.210349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:05.210363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.210383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.210386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:05.210396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.210414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:05.210436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.210574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.210581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.210593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.210652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1564 partition: 0 MaxSeqNo: 45 sessionId: src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0
2025-10-01T14:12:05.210978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b8dc8ea-95268e12-662b3891-2c945469_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:05.213374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0] Write session: try to update token
2025-10-01T14:12:05.213391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:05.226059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1564 sessionId: src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:05.226537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:05.226559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:05.226562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:05.226564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:05.226574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255902514737501:5327]
2025-10-01T14:12:05.226579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255902514737501:5327]
2025-10-01T14:12:05.226583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255902514737501:5327]
2025-10-01T14:12:05.226624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:05.226630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:05.226632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:05.226637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:05.226637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.226639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:05.226759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:05.228395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:05.292074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255904891620713:2856]
2025-10-01T14:12:05.292290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1563, pipe: [1:7556255904891620713:2856]
2025-10-01T14:12:05.361336Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:05.361579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.361590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.361626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620713:2856], now have 1 active actors on pipe
2025-10-01T14:12:05.361866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:05.361878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255904891620713:2856]
2025-10-01T14:12:05.361903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:05.361906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:05.361960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1564 reason: error at write: Disconnected sessionId: src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0
2025-10-01T14:12:05.362155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:05.362177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1564 sessionId: src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0 is DEAD
2025-10-01T14:12:05.362305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:05.362315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0] Write session will restart in 0.009146s
2025-10-01T14:12:05.362336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0] Write session: Do CDS request
2025-10-01T14:12:05.362340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:05.370267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:05.370882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:05.371016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:05.371022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:05.371031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:05.371066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:05.371099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255902514737680:5302]
2025-10-01T14:12:05.371465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:05.371722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:05.371766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:05.372014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:05.372074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.372082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.372083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.372084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.372085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.372086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.372087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.372088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.372089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.372090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.372091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.372092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.372093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.372094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.372098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.372106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.372109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.372112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.372115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.372118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.372120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.372123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.372126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.372130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.372133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.372136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.372138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.372141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.372148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.372155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.372160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.372169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.372176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.372181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.372187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.372191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.372198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.372202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.372209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.372214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.372222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.372226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.372233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.372237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.372244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.372249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.372256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.372260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.372267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.372271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.372277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.372281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.372288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.372293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.372300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.372304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.372343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:05.372794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.372909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:05.372931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1565
2025-10-01T14:12:05.373043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.373075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:05.373085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:05.373088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:05.373436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1565 sessionId:  describe result for acl check
2025-10-01T14:12:05.373467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:05.373468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:05.373469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:05.373473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255904891620907:8321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:05.373999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255904891620907:8321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:05.375669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:05.375670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255904891620907:8321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:05.376227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:05.376240Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:05.376243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:05.376246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:05.376253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1564 [2:7556255902514737680:5302]
2025-10-01T14:12:05.376271Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:05.376290Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:05.376296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.376300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.376306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.376322Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:05.376332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:05.376343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:05.376398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.376404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.376406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.376409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:05.376412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:05.376471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:05.376478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.376490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.376506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.376524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:05.376540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620717:2446], now have 1 active actors on pipe
2025-10-01T14:12:05.376551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255902514737675:5302]
2025-10-01T14:12:05.376557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255902514737675:5302]
2025-10-01T14:12:05.376559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255902514737675:5302]
2025-10-01T14:12:05.376572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:05.376561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1564
2025-10-01T14:12:05.376584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:05.376589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:05.376597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:05.376601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:05.376605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:05.376608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:05.376640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255902514737675:5302]
2025-10-01T14:12:05.376651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:05.376676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:05.381137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255904891620907:8321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:05.381151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255904891620907:8321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:05.381153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255904891620907:8321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:05.381159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:05.381382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620945:8321], now have 1 active actors on pipe
2025-10-01T14:12:05.381411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1564
2025-10-01T14:12:05.381480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.381492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.381521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:05.381535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.381544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.381546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:05.381558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.381575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:05.381596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.381753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.381761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.381774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.381844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1565 partition: 0 MaxSeqNo: 45 sessionId: src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0
2025-10-01T14:12:05.382153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1f62f0-c4b65bb0-88fe8778-76706a37_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:05.384527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0] Write session: try to update token
2025-10-01T14:12:05.384547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:05.395412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:05.395428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:05.395429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:05.395431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:05.395438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255902514737675:5302]
2025-10-01T14:12:05.395441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255902514737675:5302]
2025-10-01T14:12:05.395444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255902514737675:5302]
2025-10-01T14:12:05.395481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:05.395482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:05.395485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:05.395487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.395488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:05.395489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:05.395602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:05.397243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1565 sessionId: src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:05.399575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:05.462070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255904891620957:2856]
2025-10-01T14:12:05.462329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1564, pipe: [1:7556255904891620957:2856]
2025-10-01T14:12:05.528088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:05.528371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.528386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.528426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620957:2856], now have 1 active actors on pipe
2025-10-01T14:12:05.528630Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:05.528683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:05.528692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255904891620957:2856]
2025-10-01T14:12:05.528714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:05.528782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1565 reason: status is not ok: tablet will be restarted right now sessionId: src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0
2025-10-01T14:12:05.528953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1565 sessionId: src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0 is DEAD
2025-10-01T14:12:05.529102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:05.529112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0] Write session will restart in 0.007895s
2025-10-01T14:12:05.529132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0] Write session: Do CDS request
2025-10-01T14:12:05.529137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:05.537774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:05.537907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.538012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:05.538030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1566
2025-10-01T14:12:05.538155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.538187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:05.538197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:05.538201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:05.538418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:05.538575Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:05.538587Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:05.538598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:05.538581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1566 sessionId:  describe result for acl check
2025-10-01T14:12:05.538617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:05.538624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:05.538625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:05.538631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255904891621145:8314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:05.538647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:05.538687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255902514737827:5300]
2025-10-01T14:12:05.539158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255904891621145:8314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:05.539227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:05.539501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:05.539545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:05.539834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:05.539894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.539901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.539902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.539903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.539904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.539905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.539906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.539907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.539908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.539909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.539910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.539911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.539912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.539913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.539918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.539927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.539931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.539935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.539939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.539943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.539946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.539950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.539954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.539958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.539962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.539965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.539969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.539983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.539993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.540004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.540014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.540020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.540029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.540038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.540042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.540049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.540054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.540060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.540069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.540075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.540080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.540091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.540095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.540099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.540104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.540108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.540116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.540125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.540133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.540138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.540145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.540150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.540160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.540168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.540176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.540182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.540223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:05.541049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255904891621145:8314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:05.543525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:05.543545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255904891621145:8314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:05.543559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255904891621145:8314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:05.543563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255904891621145:8314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:05.543570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:05.544259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:05.544274Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:05.544276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:05.544279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:05.544285Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1565 [2:7556255902514737827:5300]
2025-10-01T14:12:05.544297Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:05.544308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:05.544314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.544316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.544317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.544329Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:05.544336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:05.544340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:05.544377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.544382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.544383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.544385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:05.544387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:05.544434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:05.544442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.544449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.544454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.544462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:05.544474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255902514737822:5300]
2025-10-01T14:12:05.544479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255902514737822:5300]
2025-10-01T14:12:05.544480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255902514737822:5300]
2025-10-01T14:12:05.544486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:05.544495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:05.544499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:05.544501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:05.544502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:05.544507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:05.544509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:05.544517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891620959:2446], now have 1 active actors on pipe
2025-10-01T14:12:05.544519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891621184:8314], now have 1 active actors on pipe
2025-10-01T14:12:05.544539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255902514737822:5300]
2025-10-01T14:12:05.544549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:05.544566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:05.544584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1565
2025-10-01T14:12:05.544605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.544612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.544586Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1565
2025-10-01T14:12:05.544630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67122d53-d0190bca-f360ecca-1bf09baa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:05.544638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.544641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.544643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:05.544648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.544670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:05.544686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.544823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.544829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.544838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.544917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1566 partition: 0 MaxSeqNo: 45 sessionId: src_id|67122d53-d0190bca-f360ecca-1bf09baa_0
2025-10-01T14:12:05.545291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38f45e81-7a4c6a59-cb0739a5-a79091d5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67122d53-d0190bca-f360ecca-1bf09baa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:05.547355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67122d53-d0190bca-f360ecca-1bf09baa_0] Write session: try to update token
2025-10-01T14:12:05.547370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67122d53-d0190bca-f360ecca-1bf09baa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:05.560023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1566 sessionId: src_id|67122d53-d0190bca-f360ecca-1bf09baa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:05.562561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:05.563773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.563793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.563812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:05.563814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:05.563816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:05.563818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:05.563823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255902514737822:5300]
2025-10-01T14:12:05.563826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255902514737822:5300]
2025-10-01T14:12:05.563829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255902514737822:5300]
2025-10-01T14:12:05.563863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:05.563870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:05.563872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:05.563874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.563875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:05.563876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:05.563995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:05.628942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255904891621191:2856]
2025-10-01T14:12:05.629143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1565, pipe: [1:7556255904891621191:2856]
2025-10-01T14:12:05.696805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:05.697103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:05.697161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891621191:2856], now have 1 active actors on pipe
2025-10-01T14:12:05.697222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:05.697306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255904891621191:2856]
2025-10-01T14:12:05.697334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:05.706196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:05.706211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:05.706229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1566 reason: error at write: Disconnected sessionId: src_id|67122d53-d0190bca-f360ecca-1bf09baa_0
2025-10-01T14:12:05.706346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1566 sessionId: src_id|67122d53-d0190bca-f360ecca-1bf09baa_0 is DEAD
2025-10-01T14:12:05.706520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67122d53-d0190bca-f360ecca-1bf09baa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:05.706532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67122d53-d0190bca-f360ecca-1bf09baa_0] Write session will restart in 0.005381s
2025-10-01T14:12:05.706557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67122d53-d0190bca-f360ecca-1bf09baa_0] Write session: Do CDS request
2025-10-01T14:12:05.706565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67122d53-d0190bca-f360ecca-1bf09baa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:05.710750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:05.711486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:05.711610Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:05.711618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:05.711625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:05.711654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:05.711681Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255902514737978:5299]
2025-10-01T14:12:05.712091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:05.712294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:05.712322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:05.712526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:05.712567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.712571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.712572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.712573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.712573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.712574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.712575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.712576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.712576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.712577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.712578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.712579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.712579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.712580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.712583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.712589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.712592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.712594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.712596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.712598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.712601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.712603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.712605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.712607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.712609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.712611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.712614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.712616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.712620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.712625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.712629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.712632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.712635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.712638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.712640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.712643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.712646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.712649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.712652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.712655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.712669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.712672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.712675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.712677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.712680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.712683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.712685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.712688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.712691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.712696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.712700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.712703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.712705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.712708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.712715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.712718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.712739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:05.712759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67122d53-d0190bca-f360ecca-1bf09baa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.712871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:05.712887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1567
2025-10-01T14:12:05.712972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.712993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:05.712998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:05.713000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:05.713356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1567 sessionId:  describe result for acl check
2025-10-01T14:12:05.713390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:05.713391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:05.713393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:05.713399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255904891621386:8308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:05.713870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255904891621386:8308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:05.715569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255904891621386:8308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:05.716151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:05.716839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:05.716849Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:05.716851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:05.716854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:05.716858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1566 [2:7556255902514737978:5299]
2025-10-01T14:12:05.716868Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:05.716880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:05.716883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.716886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.716887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.716898Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:05.716904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:05.716908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:05.716952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.716959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.716961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.716964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:05.716967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:05.717027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:05.717036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.717046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.717056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.717071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:05.717093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891621193:2446], now have 1 active actors on pipe
2025-10-01T14:12:05.717103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255902514737973:5299]
2025-10-01T14:12:05.717111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255902514737973:5299]
2025-10-01T14:12:05.717091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1566
2025-10-01T14:12:05.717113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255902514737973:5299]
2025-10-01T14:12:05.717121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:05.717127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:05.717130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:05.717131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:05.717132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:05.717147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:05.717151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:05.717182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255902514737973:5299]
2025-10-01T14:12:05.717194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:05.717200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:05.721986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255904891621386:8308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:05.722003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255904891621386:8308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:05.722006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255904891621386:8308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:05.722014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:05.722213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891621424:8308], now have 1 active actors on pipe
2025-10-01T14:12:05.722243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1566
2025-10-01T14:12:05.722296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.722307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.722335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77d14009-837d2b03-5a52adad-714130d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:05.722350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.722358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.722361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:05.722386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.722399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:05.722416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.722592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.722603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.722618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.722722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1567 partition: 0 MaxSeqNo: 45 sessionId: src_id|77d14009-837d2b03-5a52adad-714130d_0
2025-10-01T14:12:05.723015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67122d53-d0190bca-f360ecca-1bf09baa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|77d14009-837d2b03-5a52adad-714130d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:05.725334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d14009-837d2b03-5a52adad-714130d_0] Write session: try to update token
2025-10-01T14:12:05.725349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d14009-837d2b03-5a52adad-714130d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:05.727732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:05.727744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:05.727751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255902514737973:5299]
2025-10-01T14:12:05.727784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:05.727787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:05.727935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:05.728048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:05.728183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:05.728352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:05.728627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:05.728708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:05.737825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1567 sessionId: src_id|77d14009-837d2b03-5a52adad-714130d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:05.740143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:05.740314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.740330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.740359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:05.740440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:05.746349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:05.746362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:05.746365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:05.746366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:05.746394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255902514737973:5299]
2025-10-01T14:12:05.746399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255902514737973:5299]
2025-10-01T14:12:05.746406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255902514737973:5299]
2025-10-01T14:12:05.746449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:05.746454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.746455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:05.746460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:05.746473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:05.746478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:05.746569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:05.797423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255904891621430:2856]
2025-10-01T14:12:05.797652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1566, pipe: [1:7556255904891621430:2856]
2025-10-01T14:12:05.878811Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:05.885448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.885472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.885614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.885666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.885720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.885776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.885815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.885825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.885879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.885929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.885979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.886235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.886275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.886281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.886340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.886421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.886488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.886554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.886743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.886750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.886808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.886863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.886915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.886970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.887011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.887017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.887076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.887133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.887187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.887242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.887281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.887286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.887344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.887394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.887450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.887505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.887547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.887552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.887616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.887667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.887723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.887779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.887817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.887824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.887875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.887926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.887978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.888032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.888071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.888082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.888145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.888196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.888251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.888304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.888344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.888349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.888405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:05.888459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:05.888515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:05.888570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:05.888615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:05.888625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:05.888679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891621430:2856], now have 1 active actors on pipe
2025-10-01T14:12:05.888877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255904891621430:2856]
2025-10-01T14:12:05.888895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:05.888899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:05.888904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:05.888925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1567 reason: error at write: Disconnected sessionId: src_id|77d14009-837d2b03-5a52adad-714130d_0
2025-10-01T14:12:05.889055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:05.889141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1567 sessionId: src_id|77d14009-837d2b03-5a52adad-714130d_0 is DEAD
2025-10-01T14:12:05.889251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d14009-837d2b03-5a52adad-714130d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:05.889262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d14009-837d2b03-5a52adad-714130d_0] Write session will restart in 0.006995s
2025-10-01T14:12:05.889288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d14009-837d2b03-5a52adad-714130d_0] Write session: Do CDS request
2025-10-01T14:12:05.889294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d14009-837d2b03-5a52adad-714130d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:05.897929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d14009-837d2b03-5a52adad-714130d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.897973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:05.897989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1568
2025-10-01T14:12:05.898121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:05.898145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:05.898154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:05.898157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:05.898499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1568 sessionId:  describe result for acl check
2025-10-01T14:12:05.898527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:05.898532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:05.898534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:05.898537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255904891621619:8301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:05.898910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255904891621619:8301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:05.899691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:05.900433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:05.900587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255904891621619:8301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:05.900602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:05.900612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:05.900623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:05.900683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:05.900718Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255902514738127:5292]
2025-10-01T14:12:05.901233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:05.901505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:05.901536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:05.901733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:05.901768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.901773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.901773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.901774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.901775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.901775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.901776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.901777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.901777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.901778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.901779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.901780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.901780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.901781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.901784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.901790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.901792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.901794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.901797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.901799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.901801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.901803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.901806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.901808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.901810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.901813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.901815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.901817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.901824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.901831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:05.901837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.901841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:05.901846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.901852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:05.901856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.901859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:05.901862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.901869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:05.901872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.901875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:05.901878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.901880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:05.901883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.901886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:05.901889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.901892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:05.901895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.901899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.901901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.901904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.901907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.901910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.901915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.901918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:05.901920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.901923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:05.901946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:05.905318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255904891621619:8301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:05.905333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255904891621619:8301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:05.905336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255904891621619:8301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:05.905343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:05.905522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:05.906079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:05.906091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:05.906093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:05.906097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:05.906103Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1567 [2:7556255902514738127:5292]
2025-10-01T14:12:05.906112Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:05.906127Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:05.906128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.906130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.906132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.906142Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:05.906148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:05.906152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:05.906190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.906194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.906196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.906198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:05.906200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:05.906246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:05.906251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.906258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:05.906264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:05.906276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:05.906290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255902514738121:5292]
2025-10-01T14:12:05.906295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255902514738121:5292]
2025-10-01T14:12:05.906296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255902514738121:5292]
2025-10-01T14:12:05.906302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:05.906312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:05.906312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:05.906316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:05.906318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:05.906324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:05.906326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:05.906334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891621434:2446], now have 1 active actors on pipe
2025-10-01T14:12:05.906340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891621661:8301], now have 1 active actors on pipe
2025-10-01T14:12:05.906355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255902514738121:5292]
2025-10-01T14:12:05.906364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:05.906351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1567
2025-10-01T14:12:05.906358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1567
2025-10-01T14:12:05.906393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:05.906416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.906423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.906441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31997c19-230a66c2-cb5a944d-77196441_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:05.906449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:05.906452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:05.906455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:05.906461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:05.906470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:05.906481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.906627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.906633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.906643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:05.906714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1568 partition: 0 MaxSeqNo: 45 sessionId: src_id|31997c19-230a66c2-cb5a944d-77196441_0
2025-10-01T14:12:05.906989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d14009-837d2b03-5a52adad-714130d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31997c19-230a66c2-cb5a944d-77196441_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:05.909300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31997c19-230a66c2-cb5a944d-77196441_0] Write session: try to update token
2025-10-01T14:12:05.909314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31997c19-230a66c2-cb5a944d-77196441_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:05.916758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:05.916769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:05.916777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255902514738121:5292]
2025-10-01T14:12:05.916811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:05.916822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:05.916956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:05.917073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:05.917190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:05.917311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:05.917474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:05.917507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:05.920787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1568 sessionId: src_id|31997c19-230a66c2-cb5a944d-77196441_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:05.922756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:05.923120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:05.923139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:05.923173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:05.923241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:05.935971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:05.935987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:05.935989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:05.935991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:05.936002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255902514738121:5292]
2025-10-01T14:12:05.936005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255902514738121:5292]
2025-10-01T14:12:05.936008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255902514738121:5292]
2025-10-01T14:12:05.936054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:05.936063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:05.936066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:05.936082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:05.936097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:05.936104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:05.936184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:05.988898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255904891621682:2856]
2025-10-01T14:12:05.989198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1567, pipe: [1:7556255904891621682:2856]
2025-10-01T14:12:06.070511Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:06.076712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.076733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.076879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.076938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.076995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.077055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.077099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.077107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.077172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.077239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.077300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.077361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.077402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.077408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.077466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.077515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.077569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.077623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.077660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.077666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.077723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.077777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.077832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.077886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.077929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.077938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.077997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.078050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.078104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.078155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.078194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.078199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.078255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.078305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.078359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.078430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.078472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.078478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.078535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.078586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.078642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.078696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.078740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.078746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.078829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.078883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.078940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.078997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.079038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.079044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.079105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.079159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.079214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.079270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.079311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.079317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.079374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.079425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.079480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.079540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.079579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.079585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.079634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255904891621682:2856], now have 1 active actors on pipe
2025-10-01T14:12:06.079873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255904891621682:2856]
2025-10-01T14:12:06.079911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:06.079947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:06.079954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:06.079978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1568 reason: error at write: Disconnected sessionId: src_id|31997c19-230a66c2-cb5a944d-77196441_0
2025-10-01T14:12:06.080200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1568 sessionId: src_id|31997c19-230a66c2-cb5a944d-77196441_0 is DEAD
2025-10-01T14:12:06.080327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31997c19-230a66c2-cb5a944d-77196441_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:06.080336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31997c19-230a66c2-cb5a944d-77196441_0] Write session will restart in 0.008450s
2025-10-01T14:12:06.080354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31997c19-230a66c2-cb5a944d-77196441_0] Write session: Do CDS request
2025-10-01T14:12:06.080358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31997c19-230a66c2-cb5a944d-77196441_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:06.080422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:06.089126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:06.089814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31997c19-230a66c2-cb5a944d-77196441_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.089822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:06.089969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:06.089958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:06.089974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1569
2025-10-01T14:12:06.089976Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:06.089983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:06.090013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:06.090038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255906809705594:5269]
2025-10-01T14:12:06.090097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.090126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:06.090135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:06.090143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:06.090435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:06.090445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1569 sessionId:  describe result for acl check
2025-10-01T14:12:06.090476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:06.090477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:06.090478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:06.090481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255909186589179:8285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:06.090629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:06.090655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:06.090834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255909186589179:8285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:06.090848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:06.090878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.090881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.090882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.090883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.090883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.090884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.090884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.090885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.090885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.090886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.090887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.090887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.090888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.090888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.090891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.090896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.090898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.090900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.090902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.090904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.090906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.090908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.090910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.090913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.090915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.090916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.090918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.090920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.090925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.090928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.090932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.090935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.090937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.090940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.090942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.090945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.090947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.090950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.090952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.090955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.090959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.090965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.090967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.090970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.090978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.090982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.090990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.090998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.091001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.091005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.091009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.091013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.091022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.091029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.091033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.091040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.091069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:06.092637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255909186589179:8285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:06.094394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:06.094927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255909186589179:8285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:06.094940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255909186589179:8285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:06.094944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255909186589179:8285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:06.094950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:06.095144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:06.095156Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:06.095158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:06.095161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:06.095167Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1568 [2:7556255906809705594:5269]
2025-10-01T14:12:06.095178Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:06.095196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:06.095203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.095206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.095208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.095221Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:06.095230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:06.095239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:06.095289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.095295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.095296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.095299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:06.095301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:06.095376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:06.095383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.095392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.095401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.095414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:06.095433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186588990:2446], now have 1 active actors on pipe
2025-10-01T14:12:06.095439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589218:8285], now have 1 active actors on pipe
2025-10-01T14:12:06.095446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255906809705589:5269]
2025-10-01T14:12:06.095448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255906809705589:5269]
2025-10-01T14:12:06.095450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255906809705589:5269]
2025-10-01T14:12:06.095438Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1568
2025-10-01T14:12:06.095464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:06.095442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1568
2025-10-01T14:12:06.095475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:06.095479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:06.095480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:06.095481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:06.095491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:06.095494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:06.095527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.095535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.095546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255906809705589:5269]
2025-10-01T14:12:06.095557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:06.095572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:06.095582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:06.095592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.095600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.095601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:06.095610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.095621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:06.095641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.095771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.095778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.095789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.095849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1569 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0
2025-10-01T14:12:06.096116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31997c19-230a66c2-cb5a944d-77196441_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:06.098292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0] Write session: try to update token
2025-10-01T14:12:06.098308Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:06.110682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1569 sessionId: src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:06.113249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:06.113443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.113460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.113489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:06.113531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:06.115318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:06.115333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:06.115335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:06.115342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:06.115352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255906809705589:5269]
2025-10-01T14:12:06.115360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255906809705589:5269]
2025-10-01T14:12:06.115364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255906809705589:5269]
2025-10-01T14:12:06.115401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:06.115409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:06.115412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:06.115415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:06.115415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.115417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:06.115541Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:06.179880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255909186589226:2856]
2025-10-01T14:12:06.180117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1568, pipe: [1:7556255909186589226:2856]
2025-10-01T14:12:06.253600Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:06.261449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.261478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.261650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.261712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.261781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.261852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.261898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.261912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.261984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.262044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.262108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.262175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.262222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.262233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.262293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.262351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.262434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.262496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.262538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.262545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.262609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.262668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.262729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.262791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.262842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.262850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.262911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.262967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.263028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.263086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.263129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.263136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.263197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.263254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.263320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.263392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.263438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.263445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.263508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.263566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.263623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.263681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.263731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.263737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.263795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.263852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.263909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.263968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.264011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.264017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.264081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.264140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.264201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.264265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.264310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.264317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.264386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.264448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.264511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.264573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.264614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.264621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.264705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589226:2856], now have 1 active actors on pipe
2025-10-01T14:12:06.264951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:06.265000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255909186589226:2856]
2025-10-01T14:12:06.265007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:06.265010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:06.265031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1569 reason: error at write: Disconnected sessionId: src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0
2025-10-01T14:12:06.265219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1569 sessionId: src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0 is DEAD
2025-10-01T14:12:06.265324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:06.265330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0] Write session will restart in 0.008987s
2025-10-01T14:12:06.265348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0] Write session: Do CDS request
2025-10-01T14:12:06.265353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:06.265844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:06.275883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.275972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:06.275888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:06.275992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1570
2025-10-01T14:12:06.276114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.276149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:06.276159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:06.276164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:06.276279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:06.276466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:06.276474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:06.276483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:06.276517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:06.276548Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255906809705745:5280]
2025-10-01T14:12:06.276553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1570 sessionId:  describe result for acl check
2025-10-01T14:12:06.276584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:06.276592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:06.276594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:06.276598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255909186589430:8273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:06.276962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:06.277098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255909186589430:8273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:06.277201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:06.277236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:06.277490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:06.277536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.277541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.277542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.277542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.277543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.277544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.277544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.277545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.277546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.277547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.277548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.277548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.277549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.277550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.277553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.277558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.277560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.277563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.277565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.277567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.277569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.277571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.277573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.277575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.277577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.277579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.277581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.277583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.277588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.277592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.277596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.277598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.277601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.277605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.277607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.277609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.277612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.277614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.277616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.277619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.277622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.277624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.277630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.277633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.277636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.277638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.277642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.277645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.277648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.277654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.277656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.277659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.277663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.277665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.277671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.277674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.277694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:06.278993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255909186589430:8273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:06.281118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:06.281267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255909186589430:8273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:06.281285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255909186589430:8273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:06.281287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255909186589430:8273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:06.281294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:06.281674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:06.281685Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:06.281687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:06.281689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:06.281694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1569 [2:7556255906809705745:5280]
2025-10-01T14:12:06.281705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:06.281718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:06.281720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.281722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.281724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.281736Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:06.281743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:06.281747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:06.281783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.281793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.281795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.281797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:06.281800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:06.281862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:06.281864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.281875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.281891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.281912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:06.281930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589240:2446], now have 1 active actors on pipe
2025-10-01T14:12:06.281938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589470:8273], now have 1 active actors on pipe
2025-10-01T14:12:06.281946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255906809705740:5280]
2025-10-01T14:12:06.281951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255906809705740:5280]
2025-10-01T14:12:06.281953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255906809705740:5280]
2025-10-01T14:12:06.281966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:06.281982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:06.281983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:06.281990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:06.281992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:06.281996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:06.281998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:06.281983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1569
2025-10-01T14:12:06.282029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255906809705740:5280]
2025-10-01T14:12:06.282039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:06.282030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1569
2025-10-01T14:12:06.282044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:06.282076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.282083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.282109Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ea242e0-48a34658-36651001-668779a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:06.282119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.282123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.282128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:06.282137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.282148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:06.282162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.282310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.282316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.282330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.282412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1570 partition: 0 MaxSeqNo: 45 sessionId: src_id|7ea242e0-48a34658-36651001-668779a4_0
2025-10-01T14:12:06.282778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae624a57-1d1c7a89-2d0a199d-24974c4c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7ea242e0-48a34658-36651001-668779a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:06.285159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea242e0-48a34658-36651001-668779a4_0] Write session: try to update token
2025-10-01T14:12:06.285179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea242e0-48a34658-36651001-668779a4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:06.298266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1570 sessionId: src_id|7ea242e0-48a34658-36651001-668779a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:06.300743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:06.301980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.302006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.302027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:06.302030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:06.302033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:06.302034Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:06.302043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255906809705740:5280]
2025-10-01T14:12:06.302047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255906809705740:5280]
2025-10-01T14:12:06.302050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255906809705740:5280]
2025-10-01T14:12:06.302092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:06.302103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:06.302105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:06.302107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:06.302112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.302115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:06.302249Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:06.365265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255909186589479:2856]
2025-10-01T14:12:06.365513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1569, pipe: [1:7556255909186589479:2856]
2025-10-01T14:12:06.444351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:06.444707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:06.444768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589479:2856], now have 1 active actors on pipe
2025-10-01T14:12:06.444944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:06.444965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:06.445019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255909186589479:2856]
2025-10-01T14:12:06.454676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:06.455727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:06.455744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:06.455766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1570 reason: error at write: Disconnected sessionId: src_id|7ea242e0-48a34658-36651001-668779a4_0
2025-10-01T14:12:06.455751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:06.455923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1570 sessionId: src_id|7ea242e0-48a34658-36651001-668779a4_0 is DEAD
2025-10-01T14:12:06.455875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:06.455883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:06.455890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:06.455918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:06.455941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255906809705926:5262]
2025-10-01T14:12:06.456063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea242e0-48a34658-36651001-668779a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:06.456072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea242e0-48a34658-36651001-668779a4_0] Write session will restart in 0.008009s
2025-10-01T14:12:06.456090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea242e0-48a34658-36651001-668779a4_0] Write session: Do CDS request
2025-10-01T14:12:06.456095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea242e0-48a34658-36651001-668779a4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:06.456363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:06.459089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:06.459137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:06.459373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:06.459413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.459418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.459419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.459420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.459421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.459422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.459423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.459423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.459424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.459425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.459426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.459426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.459427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.459428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.459432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.459438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.459441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.459443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.459445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.459448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.459450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.459452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.459454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.459456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.459458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.459461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.459463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.459465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.459471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.459476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.459480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.459483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.459486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.459489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.459492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.459495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.459497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.459501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.459503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.459506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.459509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.459513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.459515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.459518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.459520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.459524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.459526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.459529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.459532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.459534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.459536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.459540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.459542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.459545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.459548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.459551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.459573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:06.463297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:06.463925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:06.463937Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:06.463939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:06.463942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:06.463947Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1570 [2:7556255906809705926:5262]
2025-10-01T14:12:06.463959Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:06.463973Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:06.463979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.463981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.463982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.463995Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:06.464002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:06.464006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:06.464049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.464055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.464056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.464059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:06.464061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:06.464112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:06.464119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.464127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.464137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.464150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:06.464167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589486:2446], now have 1 active actors on pipe
2025-10-01T14:12:06.464175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255906809705921:5262]
2025-10-01T14:12:06.464177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255906809705921:5262]
2025-10-01T14:12:06.464179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255906809705921:5262]
2025-10-01T14:12:06.464192Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:06.464202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:06.464206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:06.464207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:06.464212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:06.464223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:06.464226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:06.464253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255906809705921:5262]
2025-10-01T14:12:06.464261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:06.464263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:06.464247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1570
2025-10-01T14:12:06.464912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea242e0-48a34658-36651001-668779a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.464963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:06.464973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1571
2025-10-01T14:12:06.465123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.465163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:06.465184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:06.465191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:06.465504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1571 sessionId:  describe result for acl check
2025-10-01T14:12:06.465542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:06.465548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:06.465550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:06.465554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255909186589690:8272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:06.466020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255909186589690:8272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:06.468016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255909186589690:8272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:06.474141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255909186589690:8272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:06.474158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255909186589690:8272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:06.474160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255909186589690:8272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:06.474166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:06.474392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589723:8272], now have 1 active actors on pipe
2025-10-01T14:12:06.474437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1570
2025-10-01T14:12:06.474485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.474497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.474524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31a3b12f-edec6520-f28fe90a-26736e89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:06.474539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.474548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.474551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:06.474559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.474572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:06.474591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.474728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.474735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.474747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.474820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1571 partition: 0 MaxSeqNo: 45 sessionId: src_id|31a3b12f-edec6520-f28fe90a-26736e89_0
2025-10-01T14:12:06.475169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea242e0-48a34658-36651001-668779a4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31a3b12f-edec6520-f28fe90a-26736e89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:06.477359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a3b12f-edec6520-f28fe90a-26736e89_0] Write session: try to update token
2025-10-01T14:12:06.477376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a3b12f-edec6520-f28fe90a-26736e89_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:06.484454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:06.484468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:06.484470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:06.484472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:06.484479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255906809705921:5262]
2025-10-01T14:12:06.484482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255906809705921:5262]
2025-10-01T14:12:06.484485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255906809705921:5262]
2025-10-01T14:12:06.484517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:06.484523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:06.484527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:06.484528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.484530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:06.484530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:06.484640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:06.489256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1571 sessionId: src_id|31a3b12f-edec6520-f28fe90a-26736e89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:06.491771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:06.544962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255909186589727:2856]
2025-10-01T14:12:06.545255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1570, pipe: [1:7556255909186589727:2856]
2025-10-01T14:12:06.622324Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:06.622606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.622618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.622653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589727:2856], now have 1 active actors on pipe
2025-10-01T14:12:06.622902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:06.622941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:06.622962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255909186589727:2856]
2025-10-01T14:12:06.622981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:06.623044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1571 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31a3b12f-edec6520-f28fe90a-26736e89_0
2025-10-01T14:12:06.623212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1571 sessionId: src_id|31a3b12f-edec6520-f28fe90a-26736e89_0 is DEAD
2025-10-01T14:12:06.623354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a3b12f-edec6520-f28fe90a-26736e89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:06.623365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a3b12f-edec6520-f28fe90a-26736e89_0] Write session will restart in 0.007166s
2025-10-01T14:12:06.623392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a3b12f-edec6520-f28fe90a-26736e89_0] Write session: Do CDS request
2025-10-01T14:12:06.623399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a3b12f-edec6520-f28fe90a-26736e89_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:06.631830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a3b12f-edec6520-f28fe90a-26736e89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.631997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:06.632013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1572
2025-10-01T14:12:06.632106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.632129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:06.632137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:06.632139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:06.632462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1572 sessionId:  describe result for acl check
2025-10-01T14:12:06.632487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:06.632489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:06.632490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:06.632493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255909186589848:8265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:06.632959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255909186589848:8265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:06.634964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255909186589848:8265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:06.635953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:06.636868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:06.636991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:06.636998Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:06.637006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:06.637034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:06.637037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255909186589848:8265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:06.637064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255909186589848:8265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:06.637063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255906809706083:5244]
2025-10-01T14:12:06.637067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255909186589848:8265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:06.637075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:06.637514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:06.637760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:06.637786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:06.637967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:06.638002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.638005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.638006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.638007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.638008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.638009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.638009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.638010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.638011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.638011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.638012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.638013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.638013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.638014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.638017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.638022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.638024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.638027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.638029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.638031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.638033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.638035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.638037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.638039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.638041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.638043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.638045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.638047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.638052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.638056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.638059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.638062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.638065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.638068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.638070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.638073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.638075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.638078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.638082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.638085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.638088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.638091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.638093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.638096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.638098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.638101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.638105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.638107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.638109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.638112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.638114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.638116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.638118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.638121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.638123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.638126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.638146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:06.641427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:06.642062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:06.642074Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:06.642075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:06.642077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:06.642082Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1571 [2:7556255906809706083:5244]
2025-10-01T14:12:06.642092Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:06.642104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:06.642106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.642108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.642109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.642120Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:06.642123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:06.642128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:06.642165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.642170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.642171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.642173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:06.642175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:06.642220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:06.642225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.642232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.642237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.642246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:06.642258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255906809706078:5244]
2025-10-01T14:12:06.642259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255906809706078:5244]
2025-10-01T14:12:06.642261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255906809706078:5244]
2025-10-01T14:12:06.642268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:06.642276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:06.642279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:06.642281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589957:8265], now have 1 active actors on pipe
2025-10-01T14:12:06.642281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:06.642285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:06.642296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:06.642304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:06.642309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589729:2446], now have 1 active actors on pipe
2025-10-01T14:12:06.642328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255906809706078:5244]
2025-10-01T14:12:06.642338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:06.642344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:06.642345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1571
2025-10-01T14:12:06.642352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1571
2025-10-01T14:12:06.642421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.642429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.642451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:06.642459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.642462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.642463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:06.642469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.642475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:06.642488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.642630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.642637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.642651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.642719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1572 partition: 0 MaxSeqNo: 45 sessionId: src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0
2025-10-01T14:12:06.643175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a3b12f-edec6520-f28fe90a-26736e89_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:06.645468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0] Write session: try to update token
2025-10-01T14:12:06.645483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:06.657582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1572 sessionId: src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:06.659989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:06.660112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.660141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.660181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:06.660293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:06.662007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:06.662021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:06.662023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:06.662025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:06.662033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255906809706078:5244]
2025-10-01T14:12:06.662037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255906809706078:5244]
2025-10-01T14:12:06.662039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255906809706078:5244]
2025-10-01T14:12:06.662073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:06.662079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.662080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:06.662079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:06.662085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:06.662089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:06.662194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:06.723150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255909186589968:2856]
2025-10-01T14:12:06.723430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1571, pipe: [1:7556255909186589968:2856]
2025-10-01T14:12:06.799257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:06.805692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.805717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.805867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.805929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.805988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.806050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.806098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.806106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.806174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.806231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.806291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.806350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.806409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.806416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.806477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.806526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.806581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.806638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.806684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.806692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.806747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.806798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.806855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.806907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.806943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.806949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.807005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.807056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.807114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.807168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.807206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.807212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.807270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.807333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.807395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.807455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.807501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.807506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.807572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.807627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.807687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.807741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.807780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.807786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.807851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.807909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.807963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.808021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.808064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.808070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.808133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.808189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.808247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.808306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.808349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.808355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.808421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:06.808479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:06.808539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:06.808598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:06.808641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:06.808653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:06.808718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589968:2856], now have 1 active actors on pipe
2025-10-01T14:12:06.808930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:06.808930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:06.808945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:06.808977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1572 reason: error at write: Disconnected sessionId: src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0
2025-10-01T14:12:06.808977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255909186589968:2856]
2025-10-01T14:12:06.809185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1572 sessionId: src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0 is DEAD
2025-10-01T14:12:06.809321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:06.809332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0] Write session will restart in 0.008925s
2025-10-01T14:12:06.809359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0] Write session: Do CDS request
2025-10-01T14:12:06.809364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:06.809503Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:06.819523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:06.819822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.819889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:06.819904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1573
2025-10-01T14:12:06.820025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.820056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:06.820067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:06.820070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:06.820367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1573 sessionId:  describe result for acl check
2025-10-01T14:12:06.820398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:06.820403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:06.820406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:06.820411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255909186590166:8258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:06.820666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:06.820846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255909186590166:8258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:06.820857Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:06.820868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:06.820880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:06.820946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:06.820982Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255906809706237:5255]
2025-10-01T14:12:06.821515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:06.821765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:06.821807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:06.822059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:06.822104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.822109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.822110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.822111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.822112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.822113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.822114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.822115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.822116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.822117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.822118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.822119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.822120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.822121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.822125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.822133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.822136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.822139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.822143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.822146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.822149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.822152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.822154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.822157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.822160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.822164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.822167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.822169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.822176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.822182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:06.822187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.822191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:06.822194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.822199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:06.822202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.822206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:06.822210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.822214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:06.822217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.822221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:06.822225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.822229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:06.822232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.822236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:06.822239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.822244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:06.822247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.822252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.822256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.822260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.822264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.822268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.822272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.822276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:06.822279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.822283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:06.822312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:06.823174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255909186590166:8258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:06.825659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255909186590166:8258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:06.825672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255909186590166:8258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:06.825674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255909186590166:8258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:06.825680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:06.825799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:06.826600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:06.826611Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:06.826613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:06.826615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:06.826621Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1572 [2:7556255906809706237:5255]
2025-10-01T14:12:06.826632Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:06.826644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:06.826646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.826649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.826650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.826662Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:06.826665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:06.826669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:06.826707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.826711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.826713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.826716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:06.826718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:06.826768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:06.826773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.826780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:06.826785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:06.826794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:06.826812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186589971:2446], now have 1 active actors on pipe
2025-10-01T14:12:06.826818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186590204:8258], now have 1 active actors on pipe
2025-10-01T14:12:06.826823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255906809706231:5255]
2025-10-01T14:12:06.826825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255906809706231:5255]
2025-10-01T14:12:06.826826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255906809706231:5255]
2025-10-01T14:12:06.826839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:06.826852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:06.826868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:06.826874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:06.826889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1572
2025-10-01T14:12:06.826900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1572
2025-10-01T14:12:06.826888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:06.826903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:06.826905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:06.826906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255906809706231:5255]
2025-10-01T14:12:06.826908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:06.826912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:06.826935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.826940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.826963Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:06.826974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:06.826977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:06.826978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:06.826984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:06.826990Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:06.827000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.827131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.827137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.827147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:06.827216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1573 partition: 0 MaxSeqNo: 45 sessionId: src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0
2025-10-01T14:12:06.827567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9447c5be-5979516c-d8782dc1-a6caddf6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:06.829981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0] Write session: try to update token
2025-10-01T14:12:06.829998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:06.843255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1573 sessionId: src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:06.845621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:06.847257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:06.847284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:06.847305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:06.847309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:06.847311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:06.847314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:06.847323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255906809706231:5255]
2025-10-01T14:12:06.847328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255906809706231:5255]
2025-10-01T14:12:06.847333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255906809706231:5255]
2025-10-01T14:12:06.847378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:06.847390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:06.847390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:06.847394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:06.847397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:06.847404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:06.847530Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:06.908966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255909186590212:2856]
2025-10-01T14:12:06.909244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1572, pipe: [1:7556255909186590212:2856]
2025-10-01T14:12:06.988290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:06.988548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:06.988609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186590212:2856], now have 1 active actors on pipe
2025-10-01T14:12:06.988700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:06.988812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:06.988819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:06.988855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255909186590212:2856]
2025-10-01T14:12:06.988879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:06.988882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1573 reason: error at write: Disconnected sessionId: src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0
2025-10-01T14:12:06.988999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1573 sessionId: src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0 is DEAD
2025-10-01T14:12:06.989114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:06.989124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0] Write session will restart in 0.008993s
2025-10-01T14:12:06.989148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0] Write session: Do CDS request
2025-10-01T14:12:06.989157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:06.997824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:06.998796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.998820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:06.998902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:06.998916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1574
2025-10-01T14:12:06.998992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:06.999002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:06.999012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:06.999022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:06.999050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:06.999060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:06.999062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:06.999063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:06.999095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255906809706394:5253]
2025-10-01T14:12:06.999407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1574 sessionId:  describe result for acl check
2025-10-01T14:12:06.999432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:06.999433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:06.999435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:06.999439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255909186590411:8244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:06.999638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:06.999806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255909186590411:8244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:06.999872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:06.999915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:07.000214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:07.000274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.000280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.000281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.000282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.000283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.000284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.000285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.000286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.000288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.000289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.000290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.000291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.000292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.000293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.000298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.000306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.000310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.000314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.000317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.000321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.000326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.000329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.000337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.000340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.000343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.000351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.000354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.000362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.000368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.000379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.000389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.000398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.000406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.000411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.000415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.000420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.000427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.000431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.000439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.000443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.000451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.000460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.000468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.000472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.000477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.000485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.000488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.000496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.000504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.000512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.000517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.000525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.000532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.000536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.000543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.000547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.000582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:07.001147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255909186590411:8244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:07.003789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255909186590411:8244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:07.003807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255909186590411:8244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:07.003809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255909186590411:8244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:07.003815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:07.004053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:07.004624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:07.004637Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:07.004639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:07.004643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:07.004649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1573 [2:7556255906809706394:5253]
2025-10-01T14:12:07.004676Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:07.004690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:07.004697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.004700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.004702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.004716Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:07.004722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:07.004726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:07.004764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.004769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.004770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.004773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:07.004775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:07.004828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:07.004833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.004840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.004846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.004859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:07.004880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255906809706389:5253]
2025-10-01T14:12:07.004886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255906809706389:5253]
2025-10-01T14:12:07.004888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255906809706389:5253]
2025-10-01T14:12:07.004898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:07.004910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:07.004911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481557755:8244], now have 1 active actors on pipe
2025-10-01T14:12:07.004914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255909186590217:2446], now have 1 active actors on pipe
2025-10-01T14:12:07.004920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:07.004921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:07.004922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:07.004933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:07.004936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:07.004970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255906809706389:5253]
2025-10-01T14:12:07.004943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1573
2025-10-01T14:12:07.004977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:07.004974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1573
2025-10-01T14:12:07.004988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:07.004994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.004998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.005044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:07.005053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.005056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.005058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:07.005065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.005078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:07.005103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.005219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.005227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.005239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.005324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1574 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0
2025-10-01T14:12:07.005622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb1be3b3-f0e66d9b-7b018159-9475c164_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:07.008059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0] Write session: try to update token
2025-10-01T14:12:07.008076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:07.021356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1574 sessionId: src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:07.023851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:07.024566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.024592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.024614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:07.024617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:07.024619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:07.024621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:07.024629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255906809706389:5253]
2025-10-01T14:12:07.024634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255906809706389:5253]
2025-10-01T14:12:07.024638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255906809706389:5253]
2025-10-01T14:12:07.024679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:07.024707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:07.024714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:07.024718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:07.024731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.024739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:07.024878Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:07.089165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255913481557775:2856]
2025-10-01T14:12:07.089383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1573, pipe: [1:7556255913481557775:2856]
2025-10-01T14:12:07.177206Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:07.177758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:07.177818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481557775:2856], now have 1 active actors on pipe
2025-10-01T14:12:07.177918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:07.177953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255913481557775:2856]
2025-10-01T14:12:07.177969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:07.178014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:07.178021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:07.178093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1574 reason: error at write: Disconnected sessionId: src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0
2025-10-01T14:12:07.178272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1574 sessionId: src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0 is DEAD
2025-10-01T14:12:07.178407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:07.178414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0] Write session will restart in 0.009307s
2025-10-01T14:12:07.178434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0] Write session: Do CDS request
2025-10-01T14:12:07.178438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:07.188782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:07.188902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.188994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:07.189011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1575
2025-10-01T14:12:07.189155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.189188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:07.189198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:07.189202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:07.189576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1575 sessionId:  describe result for acl check
2025-10-01T14:12:07.189610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:07.189616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:07.189618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:07.189623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255913481557974:8224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:07.189912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:07.190054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:07.190060Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:07.190070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:07.190110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:07.190138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255911104673866:5249]
2025-10-01T14:12:07.190150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255913481557974:8224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:07.190517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:07.190768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:07.190800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:07.191014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:07.191072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.191078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.191079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.191079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.191080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.191081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.191082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.191082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.191083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.191084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.191084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.191085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.191085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.191086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.191089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.191095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.191096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.191100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.191103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.191107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.191110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.191113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.191117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.191121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.191124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.191128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.191131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.191135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.191141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.191149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.191155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.191160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.191164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.191169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.191172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.191177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.191181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.191186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.191190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.191194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.191199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.191203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.191218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.191222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.191225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.191227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.191230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.191233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.191235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.191238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.191240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.191242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.191245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.191248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.191251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.191253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.191275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:07.192136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255913481557974:8224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:07.194894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255913481557974:8224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:07.194915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255913481557974:8224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:07.194918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255913481557974:8224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:07.194926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:07.194916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:07.195530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:07.195543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:07.195545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:07.195548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:07.195554Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1574 [2:7556255911104673866:5249]
2025-10-01T14:12:07.195567Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:07.195580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:07.195582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.195584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.195586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.195601Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:07.195605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:07.195609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:07.195653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.195658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.195660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.195662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:07.195664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:07.195854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1574
2025-10-01T14:12:07.195858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1574
2025-10-01T14:12:07.195931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:07.195939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.195946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.195952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.195962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:07.195980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558012:8224], now have 1 active actors on pipe
2025-10-01T14:12:07.195986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481557778:2446], now have 1 active actors on pipe
2025-10-01T14:12:07.195995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.195998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.196015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255911104673860:5249]
2025-10-01T14:12:07.196021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255911104673860:5249]
2025-10-01T14:12:07.196022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255911104673860:5249]
2025-10-01T14:12:07.196032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:07.196046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:07.196050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:07.196052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:07.196054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:07.196058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:07.196061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:07.196072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:07.196080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.196084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.196085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:07.196091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.196099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:07.196133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255911104673860:5249]
2025-10-01T14:12:07.196143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:07.196152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.196163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:07.196304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.196312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.196326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.196404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1575 partition: 0 MaxSeqNo: 45 sessionId: src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0
2025-10-01T14:12:07.196777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a719c2d-8f699569-a76321a-e9ccef0a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:07.199475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0] Write session: try to update token
2025-10-01T14:12:07.199497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:07.211721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:07.211737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:07.211745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255911104673860:5249]
2025-10-01T14:12:07.211790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:07.211793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:07.211950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:07.212074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:07.212200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:07.212324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:07.212500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:07.212536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:07.214040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1575 sessionId: src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:07.216749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:07.217107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.217128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.217160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:07.217237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:07.225157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:07.225175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:07.225177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:07.225179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:07.225190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255911104673860:5249]
2025-10-01T14:12:07.225195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255911104673860:5249]
2025-10-01T14:12:07.225199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255911104673860:5249]
2025-10-01T14:12:07.225245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:07.225252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:07.225256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.225258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:07.225258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:07.225262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:07.225384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:07.278137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255913481558031:2856]
2025-10-01T14:12:07.278426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1574, pipe: [1:7556255913481558031:2856]
2025-10-01T14:12:07.364151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:07.371256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.371282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.371429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.371487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.371545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.371599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.371641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.371649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.371711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.371767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.371819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.371877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.371920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.371926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.371990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.372045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.372103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.372163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.372204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.372210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.372276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.372335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.372395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.372461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.372505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.372511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.372576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.372638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.372709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.372771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.372811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.372816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.372886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.372944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.373003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.373061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.373105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.373110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.373176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.373234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.373293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.373352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.373395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.373401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.373461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.373515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.373575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.373635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.373677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.373683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.373745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.373803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.373864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.373923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.373972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.373980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.374041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.374096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.374151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.374206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.374254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.374260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.374306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558031:2856], now have 1 active actors on pipe
2025-10-01T14:12:07.374505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:07.374530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255913481558031:2856]
2025-10-01T14:12:07.374563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:07.374573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:07.374598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1575 reason: error at write: Disconnected sessionId: src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0
2025-10-01T14:12:07.374838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1575 sessionId: src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0 is DEAD
2025-10-01T14:12:07.374903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:07.374913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0] Write session will restart in 0.009866s
2025-10-01T14:12:07.374938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0] Write session: Do CDS request
2025-10-01T14:12:07.374943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:07.375410Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:07.384492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:07.385517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:07.385667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:07.385675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:07.385683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:07.385718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:07.385754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255911104674051:5222]
2025-10-01T14:12:07.385837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.385991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:07.386008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1576
2025-10-01T14:12:07.386113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.386143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:07.386155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:07.386158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:07.386214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:07.386430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:07.386469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:07.386540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1576 sessionId:  describe result for acl check
2025-10-01T14:12:07.386576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:07.386578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:07.386579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:07.386584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255913481558236:8213] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:07.386742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:07.386804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.386809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.386810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.386811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.386812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.386813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.386814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.386815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.386816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.386817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.386818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.386819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.386820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.386820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.386825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.386833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.386836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.386839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.386842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.386846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.386848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.386852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.386855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.386858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.386861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.386865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.386868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.386871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.386877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.386885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.386893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.386898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.386905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.386909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.386917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.386922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.386929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.386937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.386944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.386949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.386956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.386964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.386972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.386976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.386983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.386988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.386995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.386999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.387003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.387007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.387014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.387019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.387026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.387030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.387034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.387041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.387075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:07.387405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255913481558236:8213] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:07.389436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255913481558236:8213] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:07.390694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:07.391536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:07.391551Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:07.391552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:07.391554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:07.391560Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1575 [2:7556255911104674051:5222]
2025-10-01T14:12:07.391571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:07.391583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:07.391585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.391587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.391588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.391602Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:07.391609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:07.391615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:07.391656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.391661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.391662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.391664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:07.391666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:07.391737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:07.391750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.391760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.391770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.391784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:07.391802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558034:2446], now have 1 active actors on pipe
2025-10-01T14:12:07.391816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255911104674046:5222]
2025-10-01T14:12:07.391822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255911104674046:5222]
2025-10-01T14:12:07.391823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255911104674046:5222]
2025-10-01T14:12:07.391836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1575
2025-10-01T14:12:07.391838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:07.391859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:07.391859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:07.391864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:07.391866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:07.391872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:07.391875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:07.391918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255911104674046:5222]
2025-10-01T14:12:07.391930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:07.391943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:07.392591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255913481558236:8213] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:07.392605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255913481558236:8213] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:07.392610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255913481558236:8213] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:07.392617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:07.392853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558271:8213], now have 1 active actors on pipe
2025-10-01T14:12:07.392882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1575
2025-10-01T14:12:07.392970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.392986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.393015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:07.393054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.393064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.393067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:07.393078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.393097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:07.393133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.393270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.393279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.393295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.393383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1576 partition: 0 MaxSeqNo: 45 sessionId: src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0
2025-10-01T14:12:07.393684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|766a0b0e-eeac774d-e6e76e22-9b661211_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:07.396048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0] Write session: try to update token
2025-10-01T14:12:07.396064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:07.403218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:07.403238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:07.403249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255911104674046:5222]
2025-10-01T14:12:07.403289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:07.403295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:07.403460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:07.403606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:07.403752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:07.403897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:07.404093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:07.404136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:07.409244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1576 sessionId: src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:07.411799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:07.412001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.412024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.412063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:07.412144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:07.423400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:07.423425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:07.423433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:07.423435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:07.423446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255911104674046:5222]
2025-10-01T14:12:07.423451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255911104674046:5222]
2025-10-01T14:12:07.423454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255911104674046:5222]
2025-10-01T14:12:07.423492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:07.423496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:07.423499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:07.423508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:07.423523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.423530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:07.423702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:07.474724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255913481558285:2856]
2025-10-01T14:12:07.474977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1575, pipe: [1:7556255913481558285:2856]
2025-10-01T14:12:07.565113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:07.572468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.572494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.572652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.572737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.572794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.572849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.572892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.572899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.572959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.573024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.573091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.573158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.573199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.573207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.573267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.573328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.573400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.573469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.573519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.573526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.573598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.573670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.573742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.573809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.573854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.573862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.573924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.573977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.574032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.574090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.574128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.574136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.574195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.574250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.574305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.574360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.574424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.574430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.574488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.574540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.574597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.574654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.574694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.574700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.574758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.574810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.574865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.574919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.574958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.574963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.575018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.575070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.575125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.575176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.575215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.575220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.575276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:07.575326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:07.575377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:07.575429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:07.575467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:07.575472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:07.575531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558285:2856], now have 1 active actors on pipe
2025-10-01T14:12:07.575784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255913481558285:2856]
2025-10-01T14:12:07.575808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:07.575821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:07.575824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:07.575853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1576 reason: error at write: Disconnected sessionId: src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0
2025-10-01T14:12:07.576085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1576 sessionId: src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0 is DEAD
2025-10-01T14:12:07.576219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:07.576231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0] Write session will restart in 0.007668s
2025-10-01T14:12:07.576257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0] Write session: Do CDS request
2025-10-01T14:12:07.576263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:07.576526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:07.584951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.585315Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:07.585348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1577
2025-10-01T14:12:07.585477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.585508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:07.585520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:07.585524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:07.585907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1577 sessionId:  describe result for acl check
2025-10-01T14:12:07.585949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:07.585966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:07.585968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:07.585973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255913481558482:8209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:07.586532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255913481558482:8209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:07.586626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:07.587636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:07.587860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:07.587875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:07.587888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:07.587945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:07.587988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255911104674213:5210]
2025-10-01T14:12:07.588561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:07.588835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:07.588886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:07.589138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255913481558482:8209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:07.589197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:07.589270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.589277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.589278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.589280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.589281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.589282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.589283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.589284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.589285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.589287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.589288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.589289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.589290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.589291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.589297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.589307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.589311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.589314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.589318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.589322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.589326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.589330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.589334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.589338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.589341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.589345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.589348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.589352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.589358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.589366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.589371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.589378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.589382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.589387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.589391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.589397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.589401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.589406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.589410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.589414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.589420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.589425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.589429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.589434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.589439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.589445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.589455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.589460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.589464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.589469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.589473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.589477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.589483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.589488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.589492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.589502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.589540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:07.593085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255913481558482:8209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:07.593103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255913481558482:8209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:07.593106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255913481558482:8209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:07.593115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:07.593143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:07.593826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:07.593842Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:07.593845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:07.593849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:07.593856Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1576 [2:7556255911104674213:5210]
2025-10-01T14:12:07.593872Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:07.593888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:07.593891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.593895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.593898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.593915Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:07.593925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:07.593931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:07.593985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.593992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.593995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.593999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:07.594001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:07.594070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:07.594080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.594091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.594102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.594118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:07.594143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558523:8209], now have 1 active actors on pipe
2025-10-01T14:12:07.594151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558287:2446], now have 1 active actors on pipe
2025-10-01T14:12:07.594158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255911104674207:5210]
2025-10-01T14:12:07.594161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255911104674207:5210]
2025-10-01T14:12:07.594163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255911104674207:5210]
2025-10-01T14:12:07.594176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:07.594193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:07.594195Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:07.594198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:07.594200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:07.594211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:07.594214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:07.594181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1576
2025-10-01T14:12:07.594191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1576
2025-10-01T14:12:07.594258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.594268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.594283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255911104674207:5210]
2025-10-01T14:12:07.594290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:07.594301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:07.594323Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:07.594334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.594340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.594344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:07.594354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.594363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:07.594418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.594569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.594578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.594595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.594677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1577 partition: 0 MaxSeqNo: 45 sessionId: src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0
2025-10-01T14:12:07.595035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a48c74d7-ee66e1c9-a1206196-c108d470_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:07.597625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0] Write session: try to update token
2025-10-01T14:12:07.597649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:07.611736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1577 sessionId: src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:07.614101Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:07.614119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:07.614120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:07.614122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:07.614130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255911104674207:5210]
2025-10-01T14:12:07.614134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255911104674207:5210]
2025-10-01T14:12:07.614138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255911104674207:5210]
2025-10-01T14:12:07.614180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:07.614188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.614190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:07.614190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:07.614197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:07.614200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:07.614219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:07.614311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:07.675985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255913481558531:2856]
2025-10-01T14:12:07.676268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1576, pipe: [1:7556255913481558531:2856]
2025-10-01T14:12:07.751847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:07.752315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.752331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.752372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558531:2856], now have 1 active actors on pipe
2025-10-01T14:12:07.752494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:07.752545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:07.752565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:07.752566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:07.752616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255913481558531:2856]
2025-10-01T14:12:07.752623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1577 reason: error at write: Disconnected sessionId: src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0
2025-10-01T14:12:07.752832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1577 sessionId: src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0 is DEAD
2025-10-01T14:12:07.752968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:07.752980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0] Write session will restart in 0.007179s
2025-10-01T14:12:07.753008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0] Write session: Do CDS request
2025-10-01T14:12:07.753013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:07.760931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.761079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:07.761100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1578
2025-10-01T14:12:07.761216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.761253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:07.761267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:07.761270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:07.761757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1578 sessionId:  describe result for acl check
2025-10-01T14:12:07.761808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:07.761815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:07.761817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:07.761823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255913481558728:8197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:07.762348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255913481558728:8197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:07.762813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:07.763759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:07.763939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:07.763949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:07.763960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:07.764009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:07.764051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255911104674371:5205]
2025-10-01T14:12:07.764631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:07.764968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:07.765009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:07.765295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:07.765349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.765354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.765355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.765356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.765357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.765358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.765359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.765360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.765362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.765363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.765364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.765365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.765366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.765367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.765372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.765381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.765384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.765391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.765395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.765402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.765406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.765409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.765412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.765416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.765420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.765427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.765430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.765437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.765444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.765452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.765461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.765466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.765470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.765475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.765483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.765491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.765499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.765507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.765517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.765522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.765529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.765534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.765541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.765545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.765553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.765562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.765569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.765574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.765578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.765582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.765586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.765591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.765595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.765603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.765607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.765614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.765649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:07.765881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255913481558728:8197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:07.768937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255913481558728:8197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:07.768956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255913481558728:8197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:07.768959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255913481558728:8197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:07.768968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:07.769116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:07.769761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:07.769776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:07.769778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:07.769782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:07.769789Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1577 [2:7556255911104674371:5205]
2025-10-01T14:12:07.769803Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:07.769823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:07.769831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.769834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.769840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.769855Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:07.769865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:07.769874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:07.769936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.769943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.769945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.769948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:07.769951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:07.770018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:07.770025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.770035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.770047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.770066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:07.770089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558770:8197], now have 1 active actors on pipe
2025-10-01T14:12:07.770093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558532:2446], now have 1 active actors on pipe
2025-10-01T14:12:07.770100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255911104674366:5205]
2025-10-01T14:12:07.770102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255911104674366:5205]
2025-10-01T14:12:07.770104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255911104674366:5205]
2025-10-01T14:12:07.770117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:07.770130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:07.770135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:07.770139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:07.770142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:07.770149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:07.770152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:07.770134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1577
2025-10-01T14:12:07.770136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1577
2025-10-01T14:12:07.770185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255911104674366:5205]
2025-10-01T14:12:07.770196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:07.770204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:07.770221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.770230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.770276Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:07.770287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.770295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.770298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:07.770306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.770319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:07.770339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.770479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.770493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.770509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.770570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1578 partition: 0 MaxSeqNo: 45 sessionId: src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0
2025-10-01T14:12:07.770921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32519c9-ed5f8392-d9310ed3-fc7dea87_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:07.773228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0] Write session: try to update token
2025-10-01T14:12:07.773242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:07.789121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1578 sessionId: src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:07.789491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:07.789509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:07.789512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:07.789514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:07.789524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255911104674366:5205]
2025-10-01T14:12:07.789529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255911104674366:5205]
2025-10-01T14:12:07.789533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255911104674366:5205]
2025-10-01T14:12:07.789574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:07.789580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:07.789582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:07.789586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:07.789587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.789588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:07.789722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:07.791548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:07.852609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255913481558780:2856]
2025-10-01T14:12:07.852886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1577, pipe: [1:7556255913481558780:2856]
2025-10-01T14:12:07.941266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:07.941573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.941589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.941631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558780:2856], now have 1 active actors on pipe
2025-10-01T14:12:07.941894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:07.941883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:07.941883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:07.941899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:07.941934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255913481558780:2856]
2025-10-01T14:12:07.941958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1578 reason: error at write: Disconnected sessionId: src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0
2025-10-01T14:12:07.942123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1578 sessionId: src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0 is DEAD
2025-10-01T14:12:07.942310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:07.942329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0] Write session will restart in 0.008749s
2025-10-01T14:12:07.942361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0] Write session: Do CDS request
2025-10-01T14:12:07.942367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:07.951887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.951971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:07.951992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1579
2025-10-01T14:12:07.952105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:07.952139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:07.952144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:07.952148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:07.952632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1579 sessionId:  describe result for acl check
2025-10-01T14:12:07.952682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:07.952688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:07.952691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:07.952696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255913481558982:8199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:07.953222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255913481558982:8199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:07.953596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:07.955186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:07.955199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255913481558982:8199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:07.955341Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:07.955349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:07.955356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:07.955387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:07.955419Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255911104674532:5193]
2025-10-01T14:12:07.955900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:07.956181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:07.956217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:07.956497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:07.956547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.956553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.956554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.956555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.956556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.956557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.956558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.956559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.956561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.956562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.956563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.956564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.956565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.956565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.956570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.956578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.956582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.956585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.956588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.956592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.956595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.956598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.956602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.956605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.956609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.956612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.956615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.956618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.956624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.956630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:07.956636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.956640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:07.956645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.956649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:07.956652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.956666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:07.956670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.956674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:07.956678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.956682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:07.956687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.956691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:07.956694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.956699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:07.956702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.956706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:07.956710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.956714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.956717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.956721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.956731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.956735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.956739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.956742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:07.956750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.956753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:07.956784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:07.959339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255913481558982:8199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:07.959358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255913481558982:8199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:07.959361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255913481558982:8199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:07.959371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:07.960379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:07.961276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:07.961289Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:07.961292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:07.961295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:07.961302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1578 [2:7556255911104674532:5193]
2025-10-01T14:12:07.961316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:07.961333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:07.961341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.961344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.961346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.961362Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:07.961372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:07.961378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:07.961438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.961446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.961447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.961451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:07.961455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:07.961520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:07.961527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.961539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:07.961555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:07.961571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:07.961592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255911104674526:5193]
2025-10-01T14:12:07.961598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255911104674526:5193]
2025-10-01T14:12:07.961600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255911104674526:5193]
2025-10-01T14:12:07.961616Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:07.961632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:07.961634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481558782:2446], now have 1 active actors on pipe
2025-10-01T14:12:07.961638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255913481559021:8199], now have 1 active actors on pipe
2025-10-01T14:12:07.961640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:07.961643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:07.961647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:07.961660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:07.961662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:07.961693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255911104674526:5193]
2025-10-01T14:12:07.961709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:07.961719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:07.961688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1578
2025-10-01T14:12:07.961747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.961757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.961694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1578
2025-10-01T14:12:07.961792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:07.961806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:07.961815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:07.961817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:07.961826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:07.961839Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:07.961858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.961986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.961993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.962007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:07.962102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1579 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0
2025-10-01T14:12:07.962450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccb1e33d-731703f2-10eac411-cec7bfeb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:07.964927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0] Write session: try to update token
2025-10-01T14:12:07.964944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:07.979090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1579 sessionId: src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:07.981493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:07.982334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:07.982361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:07.982404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:07.982413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:07.982416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:07.982418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:07.982426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255911104674526:5193]
2025-10-01T14:12:07.982431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255911104674526:5193]
2025-10-01T14:12:07.982435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255911104674526:5193]
2025-10-01T14:12:07.982485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:07.982495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:07.982497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:07.982501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:07.982501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:07.982504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:07.982635Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:08.042015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255917776526337:2856]
2025-10-01T14:12:08.042278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1578, pipe: [1:7556255917776526337:2856]
2025-10-01T14:12:08.130092Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:08.130341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:08.130412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776526337:2856], now have 1 active actors on pipe
2025-10-01T14:12:08.130508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:08.130625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:08.130688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255917776526337:2856]
2025-10-01T14:12:08.141238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:08.141251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:08.141271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1579 reason: error at write: Disconnected sessionId: src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0
2025-10-01T14:12:08.141499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1579 sessionId: src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0 is DEAD
2025-10-01T14:12:08.141526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:08.141538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0] Write session will restart in 0.006656s
2025-10-01T14:12:08.141565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0] Write session: Do CDS request
2025-10-01T14:12:08.141572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:08.149942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.150043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:08.150069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1580
2025-10-01T14:12:08.149952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:08.150175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.150210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:08.150220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:08.150223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:08.150599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1580 sessionId:  describe result for acl check
2025-10-01T14:12:08.150628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:08.150635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:08.150636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:08.150642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255917776526550:8186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:08.151143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255917776526550:8186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:08.151375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:08.151564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:08.151577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:08.151588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:08.151645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:08.151694Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255915399642011:5197]
2025-10-01T14:12:08.152195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:08.152462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:08.152501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:08.152799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:08.152844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.152848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.152849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.152850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.152851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.152851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.152852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.152853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.152853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.152854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.152854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.152855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.152856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.152857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.152860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.152866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.152869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.152871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.152873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.152875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.152877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.152879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.152881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.152884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.152886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.152888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.152890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.152892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.152898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.152902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.152907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.152910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.152912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.152915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.152918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.152921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.152924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.152926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.152929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.152932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.152934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.152937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.152940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.152943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.152946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.152949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.152952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.152955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.152958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.152960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.152963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.152966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.152980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.152985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.152988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.152993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.153026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:08.153413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255917776526550:8186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:08.156638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255917776526550:8186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:08.156653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255917776526550:8186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:08.156664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255917776526550:8186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:08.156671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:08.156885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:08.157466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:08.157479Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:08.157481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:08.157484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:08.157490Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1579 [2:7556255915399642011:5197]
2025-10-01T14:12:08.157500Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:08.157514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:08.157516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:08.157518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:08.157519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:08.157532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:08.157536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:08.157540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:08.157579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.157585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.157586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.157589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:08.157590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:08.157804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1579
2025-10-01T14:12:08.157805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1579
2025-10-01T14:12:08.157877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:08.157887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.157897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.157908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.157926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:08.157949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776526349:2446], now have 1 active actors on pipe
2025-10-01T14:12:08.157957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776526587:8186], now have 1 active actors on pipe
2025-10-01T14:12:08.157975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.157983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.158002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255915399642006:5197]
2025-10-01T14:12:08.158008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255915399642006:5197]
2025-10-01T14:12:08.158011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255915399642006:5197]
2025-10-01T14:12:08.158024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:08.158038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:08.158042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:08.158046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:08.158047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:08.158050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:08.158052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:08.158064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:08.158072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:08.158076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:08.158077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:08.158084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:08.158091Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:08.158122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255915399642006:5197]
2025-10-01T14:12:08.158130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:08.158139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:08.158141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:08.158304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.158323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.158338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:08.158429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1580 partition: 0 MaxSeqNo: 45 sessionId: src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0
2025-10-01T14:12:08.158785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d5c6e2-a927d5c2-e45613e6-30d0be18_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:08.161454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0] Write session: try to update token
2025-10-01T14:12:08.161475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:08.169692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:08.169712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:08.169722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255915399642006:5197]
2025-10-01T14:12:08.169771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:08.169770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:08.169948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:08.170087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:08.170228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:08.170392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:08.170582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:08.170638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:08.176610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1580 sessionId: src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:08.179485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:08.179702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.179721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.179755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:08.179850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:08.191246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:08.191268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:08.191270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:08.191272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:08.191285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255915399642006:5197]
2025-10-01T14:12:08.191289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255915399642006:5197]
2025-10-01T14:12:08.191293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255915399642006:5197]
2025-10-01T14:12:08.191340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:08.191343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:08.191351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:08.191355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:08.191356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.191359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:08.191484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:08.230982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255917776526607:2856]
2025-10-01T14:12:08.231269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1579, pipe: [1:7556255917776526607:2856]
2025-10-01T14:12:08.331666Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:08.339433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.339459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.339628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.339692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.339753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.339811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.339852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.339860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.339924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.339991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.340055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.340119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.340159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.340166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.340230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.340284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.340337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.340387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.340430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.340435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.340497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.340563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.340619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.340688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.340736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.340743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.340798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.340848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.340900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.340954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.340999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.341006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.341073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.341134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.341209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.341283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.341329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.341336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.341398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.341449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.341513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.341581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.341627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.341635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.341693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.341749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.341803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.341860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.341904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.341910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.341972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.342041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.342110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.342174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.342222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.342231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.342309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.342404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.342474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.342546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.342594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.342600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.342671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776526607:2856], now have 1 active actors on pipe
2025-10-01T14:12:08.342944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:08.342973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255917776526607:2856]
2025-10-01T14:12:08.342999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:08.343002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:08.343030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1580 reason: error at write: Disconnected sessionId: src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0
2025-10-01T14:12:08.343232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1580 sessionId: src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0 is DEAD
2025-10-01T14:12:08.343331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:08.343340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0] Write session will restart in 0.008805s
2025-10-01T14:12:08.343362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0] Write session: Do CDS request
2025-10-01T14:12:08.343367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:08.343647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:08.352929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.353012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:08.353030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1581
2025-10-01T14:12:08.353149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.353183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:08.353193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:08.353197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:08.353634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1581 sessionId:  describe result for acl check
2025-10-01T14:12:08.353677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:08.353684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:08.353686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:08.353695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255917776526805:8173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:08.354239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255917776526805:8173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:08.356522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255917776526805:8173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:08.356388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:08.357162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:08.357386Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:08.357397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:08.357409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:08.357474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:08.357512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255915399642173:5196]
2025-10-01T14:12:08.357936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:08.358227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:08.358266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:08.358560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:08.358622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.358627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.358629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.358630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.358631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.358632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.358634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.358635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.358636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.358637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.358639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.358640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.358641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.358642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.358647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.358656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.358660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.358664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.358668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.358672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.358675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.358679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.358683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.358687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.358690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.358694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.358698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.358701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.358708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.358713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.358718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.358721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.358725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.358730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.358734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.358738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.358744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.358754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.358758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.358763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.358767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.358771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.358775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.358779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.358784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.358788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.358796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.358801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.358805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.358809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.358814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.358818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.358828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.358833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.358841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.358846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.358895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:08.359096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255917776526805:8173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:08.359112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255917776526805:8173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:08.359115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255917776526805:8173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:08.359123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:08.362806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:08.363436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:08.363453Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:08.363456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:08.363460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:08.363467Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1580 [2:7556255915399642173:5196]
2025-10-01T14:12:08.363483Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:08.363499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:08.363508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:08.363512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:08.363515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:08.363531Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:08.363540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:08.363546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:08.363611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.363617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.363619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.363623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:08.363625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:08.363693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:08.363702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.363713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.363723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.363736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:08.363755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776526610:2446], now have 1 active actors on pipe
2025-10-01T14:12:08.363763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776526850:8173], now have 1 active actors on pipe
2025-10-01T14:12:08.363771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255915399642168:5196]
2025-10-01T14:12:08.363774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255915399642168:5196]
2025-10-01T14:12:08.363776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255915399642168:5196]
2025-10-01T14:12:08.363789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:08.363804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:08.363807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:08.363813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:08.363816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:08.363821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:08.363823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:08.363858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255915399642168:5196]
2025-10-01T14:12:08.363873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:08.363879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:08.363872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1580
2025-10-01T14:12:08.363874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1580
2025-10-01T14:12:08.363934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.363942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.363970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:08.363982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:08.363990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:08.363996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:08.364008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:08.364017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:08.364034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:08.364221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.364228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.364244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:08.364339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1581 partition: 0 MaxSeqNo: 45 sessionId: src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0
2025-10-01T14:12:08.364737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd0bd2b4-160372c1-f2c1da12-3015ee7b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:08.367355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0] Write session: try to update token
2025-10-01T14:12:08.367376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:08.375384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:08.375404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:08.375416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255915399642168:5196]
2025-10-01T14:12:08.375457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:08.375463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:08.375641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:08.376112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:08.376273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:08.376428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:08.376632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:08.376695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:08.382236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1581 sessionId: src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:08.384969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:08.385172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.385193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.385234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:08.385306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:08.395422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:08.395442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:08.395445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:08.395446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:08.395456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255915399642168:5196]
2025-10-01T14:12:08.395460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255915399642168:5196]
2025-10-01T14:12:08.395463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255915399642168:5196]
2025-10-01T14:12:08.395506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:08.395511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:08.395517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.395518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:08.395519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:08.395522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:08.395646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:08.442917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255917776526862:2856]
2025-10-01T14:12:08.443182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1580, pipe: [1:7556255917776526862:2856]
2025-10-01T14:12:08.538007Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:08.545473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.545496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.545648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.545702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.545757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.545821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.546052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.546062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.546119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.546172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.546224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.546280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.546328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.546333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.546421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.546477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.546538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.546601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.546647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.546654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.546718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.546773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.546838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.546904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.546946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.546954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.547018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.547077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.547135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.547193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.547239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.547246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.547311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.547376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.547444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.547513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.547558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.547564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.547629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.547702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.547764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.547824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.547870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.547876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.547939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.547995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.548057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.548120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.548473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.548482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.548545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.548610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.548680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.548739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.548781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.548787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.548854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.548912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.548975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.549034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.549075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.549083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.549149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776526862:2856], now have 1 active actors on pipe
2025-10-01T14:12:08.549447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:08.549451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:08.549455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:08.549485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1581 reason: error at write: Disconnected sessionId: src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0
2025-10-01T14:12:08.549523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255917776526862:2856]
2025-10-01T14:12:08.549687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1581 sessionId: src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0 is DEAD
2025-10-01T14:12:08.549682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:08.549851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:08.549861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0] Write session will restart in 0.005430s
2025-10-01T14:12:08.549881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0] Write session: Do CDS request
2025-10-01T14:12:08.549886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:08.556964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.557042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:08.557060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1582
2025-10-01T14:12:08.557206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.557238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:08.557249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:08.557252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:08.557670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1582 sessionId:  describe result for acl check
2025-10-01T14:12:08.557707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:08.557713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:08.557715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:08.557720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255917776526951:8161] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:08.558176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255917776526951:8161] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:08.560393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255917776526951:8161] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:08.561764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:08.562987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:08.563124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:08.563132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:08.563139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:08.563171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:08.563204Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255915399642367:5177]
2025-10-01T14:12:08.563247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255917776526951:8161] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:08.563262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255917776526951:8161] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:08.563265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255917776526951:8161] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:08.563273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:08.563599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:08.563828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:08.563865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:08.564054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:08.564096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.564101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.564102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.564103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.564104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.564105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.564106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.564108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.564109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.564110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.564111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.564112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.564113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.564114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.564117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.564123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.564125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.564127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.564129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.564131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.564133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.564134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.564136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.564138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.564140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.564142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.564143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.564145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.564151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.564156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.564160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.564163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.564165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.564168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.564170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.564173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.564176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.564179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.564181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.564184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.564187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.564190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.564192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.564195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.564197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.564200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.564203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.564205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.564208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.564210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.564213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.564216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.564218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.564221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.564223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.564226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.564258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:08.567670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:08.568453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:08.568469Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:08.568471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:08.568475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:08.568482Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1581 [2:7556255915399642367:5177]
2025-10-01T14:12:08.568497Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:08.568513Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:08.568517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:08.568521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:08.568523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:08.568538Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:08.568543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:08.568551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:08.568620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.568626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.568628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.568630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:08.568634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:08.568704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:08.568711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.568722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.568737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.568752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:08.568769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776527105:8161], now have 1 active actors on pipe
2025-10-01T14:12:08.568774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776526868:2446], now have 1 active actors on pipe
2025-10-01T14:12:08.568780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255915399642362:5177]
2025-10-01T14:12:08.568782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255915399642362:5177]
2025-10-01T14:12:08.568783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255915399642362:5177]
2025-10-01T14:12:08.568792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:08.568804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:08.568809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:08.568812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:08.568814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:08.568815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:08.568817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:08.568836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255915399642362:5177]
2025-10-01T14:12:08.568841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:08.568843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:08.568865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.568843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1581
2025-10-01T14:12:08.568871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.568874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1581
2025-10-01T14:12:08.568895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b35c815c-6d782347-92f6e231-d423625f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:08.568906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:08.568910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:08.568913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:08.568921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:08.568936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:08.568952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:08.569077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.569082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.569091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:08.569157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1582 partition: 0 MaxSeqNo: 45 sessionId: src_id|b35c815c-6d782347-92f6e231-d423625f_0
2025-10-01T14:12:08.569562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72c7e9bc-9cfbe009-540dbbe5-1c0fef1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b35c815c-6d782347-92f6e231-d423625f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:08.572101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35c815c-6d782347-92f6e231-d423625f_0] Write session: try to update token
2025-10-01T14:12:08.572118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35c815c-6d782347-92f6e231-d423625f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:08.589140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1582 sessionId: src_id|b35c815c-6d782347-92f6e231-d423625f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:08.589549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:08.589572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:08.589575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:08.589577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:08.589590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255915399642362:5177]
2025-10-01T14:12:08.589595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255915399642362:5177]
2025-10-01T14:12:08.589599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255915399642362:5177]
2025-10-01T14:12:08.589651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:08.589663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.589665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:08.589808Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:08.589811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:08.589818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:08.589822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:08.591911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:08.649817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255917776527117:2856]
2025-10-01T14:12:08.650119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1581, pipe: [1:7556255917776527117:2856]
2025-10-01T14:12:08.746584Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:08.746979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.747016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.747061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776527117:2856], now have 1 active actors on pipe
2025-10-01T14:12:08.747283Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:08.747454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:08.747514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:08.747541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1582 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b35c815c-6d782347-92f6e231-d423625f_0
2025-10-01T14:12:08.747572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255917776527117:2856]
2025-10-01T14:12:08.747748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1582 sessionId: src_id|b35c815c-6d782347-92f6e231-d423625f_0 is DEAD
2025-10-01T14:12:08.748423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35c815c-6d782347-92f6e231-d423625f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:08.748430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35c815c-6d782347-92f6e231-d423625f_0] Write session will restart in 0.006916s
2025-10-01T14:12:08.748457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35c815c-6d782347-92f6e231-d423625f_0] Write session: Do CDS request
2025-10-01T14:12:08.748462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35c815c-6d782347-92f6e231-d423625f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:08.756927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b35c815c-6d782347-92f6e231-d423625f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.757009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:08.757027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1583
2025-10-01T14:12:08.757146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.757179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:08.757189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:08.757193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:08.757646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1583 sessionId:  describe result for acl check
2025-10-01T14:12:08.757672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:08.757677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:08.757680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:08.757684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255917776527188:8162] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:08.758151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255917776527188:8162] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:08.760477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255917776527188:8162] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:08.762695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:08.763094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255917776527188:8162] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:08.763111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255917776527188:8162] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:08.763114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255917776527188:8162] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:08.763123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:08.764115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:08.764311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:08.764322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:08.764334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:08.764379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:08.764417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255915399642533:5175]
2025-10-01T14:12:08.765038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:08.765304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:08.765346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:08.765654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:08.765708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.765715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.765716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.765717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.765719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.765720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.765721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.765723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.765724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.765725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.765726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.765728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.765729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.765730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.765735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.765745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.765750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.765754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.765758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.765763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.765767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.765771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.765775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.765781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.765785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.765789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.765793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.765797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.765809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.765821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:08.765833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.765843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:08.765852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.765858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:08.765866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.765872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:08.765877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.765887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:08.765892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.765901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:08.765907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.765917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:08.765921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.765931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:08.765935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.765945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:08.765949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.765954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.765958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.765964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.765969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.765978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.765983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.765993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:08.765997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.766002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:08.766047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:08.769882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:08.770491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:08.770506Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:08.770509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:08.770514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:08.770521Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1582 [2:7556255915399642533:5175]
2025-10-01T14:12:08.770537Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:08.770556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:08.770565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:08.770569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:08.770572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:08.770589Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:08.770599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:08.770607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:08.770673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.770682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.770685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.770688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:08.770691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:08.770761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:08.770770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.770783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:08.770795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:08.770817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:08.770841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776527357:8162], now have 1 active actors on pipe
2025-10-01T14:12:08.770849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776527119:2446], now have 1 active actors on pipe
2025-10-01T14:12:08.770856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255915399642527:5175]
2025-10-01T14:12:08.770861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255915399642527:5175]
2025-10-01T14:12:08.770865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255915399642527:5175]
2025-10-01T14:12:08.770877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:08.770889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:08.770897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:08.770899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:08.770901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:08.770912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:08.770915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:08.770912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1582
2025-10-01T14:12:08.770949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1582
2025-10-01T14:12:08.770951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255915399642527:5175]
2025-10-01T14:12:08.770956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:08.770973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:08.770991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.770996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.771029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:08.771036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:08.771041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:08.771043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:08.771052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:08.771061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:08.771077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:08.771248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.771257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.771271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:08.771366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1583 partition: 0 MaxSeqNo: 45 sessionId: src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0
2025-10-01T14:12:08.771763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b35c815c-6d782347-92f6e231-d423625f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:08.774477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0] Write session: try to update token
2025-10-01T14:12:08.774496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:08.782609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:08.782631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:08.782642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255915399642527:5175]
2025-10-01T14:12:08.782682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:08.782689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:08.782880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:08.783038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:08.783182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:08.783336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:08.783554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:08.783605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:08.789597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1583 sessionId: src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:08.792345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:08.792573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.792596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.792636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:08.792743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:08.804310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:08.804329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:08.804332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:08.804334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:08.804345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255915399642527:5175]
2025-10-01T14:12:08.804349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255915399642527:5175]
2025-10-01T14:12:08.804353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255915399642527:5175]
2025-10-01T14:12:08.804401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:08.804412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:08.804415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:08.804419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:08.804430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:08.804433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:08.804548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:08.847479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255917776527371:2856]
2025-10-01T14:12:08.847830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1582, pipe: [1:7556255917776527371:2856]
2025-10-01T14:12:08.970222Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:08.978474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:08.978505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:08.978653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.978709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.978766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.978819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.978864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.978880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.978954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.982048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:08.982066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:08.982094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1583 reason: error at write: Disconnected sessionId: src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0
2025-10-01T14:12:08.982173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:08.982237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255917776527371:2856]
2025-10-01T14:12:08.982324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1583 sessionId: src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0 is DEAD
2025-10-01T14:12:08.979022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.979088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.979153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.979204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.979207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.979286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.979349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.979420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.979488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.979532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.979536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.979614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.979681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.979746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.979816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.979858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.979861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.979934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.979996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.980057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.980119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.980170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.980172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.980246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.982501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:08.980309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.982520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0] Write session will restart in 0.005702s
2025-10-01T14:12:08.980372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.980442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.980484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.980487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.980564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.980627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.980708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.980780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.982548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0] Write session: Do CDS request
2025-10-01T14:12:08.982559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:08.980824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.980826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.980892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.980950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.981008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.981071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.981112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.981115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.981190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.981254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.981322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.981388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.981425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.981433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.981494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:08.981551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:08.981619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:08.981682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:08.981722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:08.981724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:08.981814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776527371:2856], now have 1 active actors on pipe
2025-10-01T14:12:08.983234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:08.990845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.994740Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:08.994756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1584
2025-10-01T14:12:08.994894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:08.994930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:08.994936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:08.994940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:08.995293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1584 sessionId:  describe result for acl check
2025-10-01T14:12:08.995324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:08.995325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:08.995326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:08.995332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255917776527471:8151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:08.995845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255917776527471:8151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:08.999232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255917776527471:8151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:09.004302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:09.004337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255917776527471:8151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:09.004357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255917776527471:8151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:09.004360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255917776527471:8151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:09.004367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:09.006651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:09.006967Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:09.006972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:09.006986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:09.007061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:09.007099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255919694609997:5169]
2025-10-01T14:12:09.007698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:09.008127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:09.008208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:09.008552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:09.008620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.008629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.008630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.008631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.008633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.008634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.008635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.008636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.008637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.008638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.008640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.008641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.008642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.008644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.008651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.008674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.008679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.008683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.008687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.008691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.008695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.008699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.008703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.008708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.008712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.008716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.008720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.008724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.008733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.008742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.008749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.008755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.008761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.008767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.008772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.008778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.008784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.008789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.008794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.008799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.008805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.008811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.008815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.008821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.008826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.008830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.008835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.008841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.008846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.008852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.008858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.008872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.008876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.008886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.008891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.008900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.008947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:09.013837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:09.014716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:09.014733Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:09.014736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:09.014739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:09.014747Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1583 [2:7556255919694609997:5169]
2025-10-01T14:12:09.014764Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:09.014782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:09.014786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.014791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.014793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.014811Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:09.014822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:09.014829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:09.014895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.014902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.014904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.014907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:09.014910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:09.014977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:09.014984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.014997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.015014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.015035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:09.015058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255919694609990:5169]
2025-10-01T14:12:09.015063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255919694609990:5169]
2025-10-01T14:12:09.015066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255919694609990:5169]
2025-10-01T14:12:09.015701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1583
2025-10-01T14:12:09.015751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1583
2025-10-01T14:12:09.015076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:09.015096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:09.015114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:09.015117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:09.015161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255919694609990:5169]
2025-10-01T14:12:09.015164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:09.015262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:09.015266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:09.015268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:09.015274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:09.015423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255917776527377:2446], now have 1 active actors on pipe
2025-10-01T14:12:09.015431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071494908:8151], now have 1 active actors on pipe
2025-10-01T14:12:09.016248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.016263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.016293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:09.016308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.016317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.016321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:09.016331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.016349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:09.016374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.017162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.017172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.017191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.017301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1584 partition: 0 MaxSeqNo: 45 sessionId: src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0
2025-10-01T14:12:09.017711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8894d71b-6897c62-a17eec4-a51c2a4f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:09.020469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0] Write session: try to update token
2025-10-01T14:12:09.020491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:09.042292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:09.042312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:09.042315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:09.042317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:09.042329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255919694609990:5169]
2025-10-01T14:12:09.042335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255919694609990:5169]
2025-10-01T14:12:09.042339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255919694609990:5169]
2025-10-01T14:12:09.042399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:09.042409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:09.042413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:09.042416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.042418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:09.042419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:09.042563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:09.048786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1584 sessionId: src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:09.051559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:09.082411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255922071494933:2856]
2025-10-01T14:12:09.082811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1583, pipe: [1:7556255922071494933:2856]
2025-10-01T14:12:09.204785Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:09.205268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.205285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.205332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071494933:2856], now have 1 active actors on pipe
2025-10-01T14:12:09.205694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:09.205934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:09.205987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:09.206051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1584 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0
2025-10-01T14:12:09.206240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1584 sessionId: src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0 is DEAD
2025-10-01T14:12:09.206343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255922071494933:2856]
2025-10-01T14:12:09.206445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:09.206457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0] Write session will restart in 0.007256s
2025-10-01T14:12:09.206496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0] Write session: Do CDS request
2025-10-01T14:12:09.206503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:09.214969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:09.216060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:09.216079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1585
2025-10-01T14:12:09.216457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:09.216493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:09.216498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:09.216503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:09.217381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1585 sessionId:  describe result for acl check
2025-10-01T14:12:09.217429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:09.217431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:09.217433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:09.217439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255922071494999:8138] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:09.217965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255922071494999:8138] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:09.221023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255922071494999:8138] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:09.226341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255922071494999:8138] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:09.226363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255922071494999:8138] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:09.226367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255922071494999:8138] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:09.226389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:09.235950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:09.237708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:09.237884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:09.237887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:09.237897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:09.237931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:09.237959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255919694610182:5161]
2025-10-01T14:12:09.238402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:09.238717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:09.238751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:09.238962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:09.239006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.239011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.239011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.239012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.239013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.239014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.239015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.239016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.239016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.239017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.239017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.239018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.239019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.239020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.239023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.239029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.239031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.239034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.239036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.239038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.239040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.239043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.239045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.239047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.239049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.239052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.239054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.239056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.239062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.239066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.239071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.239075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.239077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.239081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.239085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.239090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.239094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.239099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.239103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.239108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.239113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.239118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.239121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.239124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.239126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.239129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.239133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.239135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.239138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.239141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.239144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.239147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.239149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.239152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.239154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.239157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.239197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:09.244162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:09.245162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:09.245181Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:09.245184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:09.245187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:09.245195Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1584 [2:7556255919694610182:5161]
2025-10-01T14:12:09.245217Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:09.245237Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:09.245241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.245245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.245247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.245268Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:09.245273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:09.245280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:09.245342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.245344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.245346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.245349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:09.245351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:09.245423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:09.245426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.245437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.245447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.245460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:09.245478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255919694610176:5161]
2025-10-01T14:12:09.245482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255919694610176:5161]
2025-10-01T14:12:09.245484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255919694610176:5161]
2025-10-01T14:12:09.245493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:09.245507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:09.245516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:09.245519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:09.245522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:09.245522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:09.245524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:09.245568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255919694610176:5161]
2025-10-01T14:12:09.245577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:09.245590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071494948:2446], now have 1 active actors on pipe
2025-10-01T14:12:09.245594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495160:8138], now have 1 active actors on pipe
2025-10-01T14:12:09.245844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:09.245799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1584
2025-10-01T14:12:09.245854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1584
2025-10-01T14:12:09.246053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.246064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.246095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:09.246106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.246111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.246113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:09.246124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.246135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:09.246154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.248863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.248884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.248923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.249089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1585 partition: 0 MaxSeqNo: 45 sessionId: src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0
2025-10-01T14:12:09.249954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a29c7758-fb69bb54-1474ce51-aa6674f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:09.252716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0] Write session: try to update token
2025-10-01T14:12:09.252739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:09.270110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:09.270129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:09.270130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:09.270133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:09.270142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255919694610176:5161]
2025-10-01T14:12:09.270148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255919694610176:5161]
2025-10-01T14:12:09.270152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255919694610176:5161]
2025-10-01T14:12:09.270200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:09.270205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:09.270212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:09.270213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.270216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:09.270217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:09.270747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:09.275114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1585 sessionId: src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:09.277576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:09.307191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255922071495210:2856]
2025-10-01T14:12:09.307630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1584, pipe: [1:7556255922071495210:2856]
2025-10-01T14:12:09.424458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:09.424710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.424720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.424759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495210:2856], now have 1 active actors on pipe
2025-10-01T14:12:09.425001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:09.425451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:09.425516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1585 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0
2025-10-01T14:12:09.425698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1585 sessionId: src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0 is DEAD
2025-10-01T14:12:09.425800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255922071495210:2856]
2025-10-01T14:12:09.425986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:09.425997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0] Write session will restart in 0.006024s
2025-10-01T14:12:09.426025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0] Write session: Do CDS request
2025-10-01T14:12:09.426032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:09.427461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:09.433007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:09.436089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:09.436110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1586
2025-10-01T14:12:09.436302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:09.436348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:09.436354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:09.436357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:09.436834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1586 sessionId:  describe result for acl check
2025-10-01T14:12:09.436869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:09.436870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:09.436872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:09.436878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255922071495265:8127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:09.437431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255922071495265:8127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:09.440265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255922071495265:8127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:09.443457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255922071495265:8127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:09.443476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255922071495265:8127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:09.443480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255922071495265:8127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:09.443490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:09.455672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:09.456209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:09.456622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:09.456627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:09.456642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:09.456717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:09.456754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255919694610363:5139]
2025-10-01T14:12:09.457394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:09.457729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:09.457768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:09.458068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:09.458118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.458119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.458120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.458121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.458122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.458123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.458124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.458126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.458127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.458128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.458129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.458130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.458131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.458132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.458138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.458147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.458151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.458155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.458158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.458162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.458166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.458169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.458173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.458176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.458180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.458184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.458187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.458190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.458197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.458205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.458212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.458218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.458222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.458227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.458232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.458237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.458241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.458247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.458251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.458257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.458262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.458267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.458271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.458276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.458282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.458287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.458291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.458296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.458300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.458305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.458309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.458314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.458318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.458323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.458326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.458331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.458391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:09.463770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:09.464641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:09.464668Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:09.464670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:09.464674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:09.464682Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1585 [2:7556255919694610363:5139]
2025-10-01T14:12:09.464700Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:09.464719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:09.464727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.464732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.464738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.464757Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:09.464771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:09.464779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:09.464843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.464845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.464847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.464851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:09.464854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:09.464932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:09.464935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.464950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.464962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.464981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:09.464998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255919694610357:5139]
2025-10-01T14:12:09.465002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255919694610357:5139]
2025-10-01T14:12:09.465005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255919694610357:5139]
2025-10-01T14:12:09.465014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:09.465030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:09.465046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:09.465049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:09.465052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:09.465056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:09.465058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:09.465092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255919694610357:5139]
2025-10-01T14:12:09.465100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:09.465104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:09.465112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495218:2446], now have 1 active actors on pipe
2025-10-01T14:12:09.465116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495409:8127], now have 1 active actors on pipe
2025-10-01T14:12:09.465648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1585
2025-10-01T14:12:09.465686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1585
2025-10-01T14:12:09.467060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.467084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.467120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66b5d248-92a86167-6977858b-b7a92eec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:09.467136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.467147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.467149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:09.467164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.467188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:09.467212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.467749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.467759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.467781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.468636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d54f1ed-7c166332-e5eb8f5d-fe71b92e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|66b5d248-92a86167-6977858b-b7a92eec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:09.468153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1586 partition: 0 MaxSeqNo: 45 sessionId: src_id|66b5d248-92a86167-6977858b-b7a92eec_0
2025-10-01T14:12:09.471637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b5d248-92a86167-6977858b-b7a92eec_0] Write session: try to update token
2025-10-01T14:12:09.471657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b5d248-92a86167-6977858b-b7a92eec_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:09.496512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1586 sessionId: src_id|66b5d248-92a86167-6977858b-b7a92eec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:09.497487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:09.497508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:09.497510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:09.497512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:09.497523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255919694610357:5139]
2025-10-01T14:12:09.497527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255919694610357:5139]
2025-10-01T14:12:09.497530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255919694610357:5139]
2025-10-01T14:12:09.497587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:09.497593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.497595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:09.497647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:09.497656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:09.497660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:09.497743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:09.499848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:09.525822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255922071495471:2856]
2025-10-01T14:12:09.526101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1585, pipe: [1:7556255922071495471:2856]
2025-10-01T14:12:09.655742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:09.656032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.656045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.656084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495471:2856], now have 1 active actors on pipe
2025-10-01T14:12:09.656366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:09.656398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255922071495471:2856]
2025-10-01T14:12:09.656434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:09.656445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:09.656507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1586 reason: error at write: Disconnected sessionId: src_id|66b5d248-92a86167-6977858b-b7a92eec_0
2025-10-01T14:12:09.656745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1586 sessionId: src_id|66b5d248-92a86167-6977858b-b7a92eec_0 is DEAD
2025-10-01T14:12:09.656880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b5d248-92a86167-6977858b-b7a92eec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:09.656893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b5d248-92a86167-6977858b-b7a92eec_0] Write session will restart in 0.007811s
2025-10-01T14:12:09.656922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b5d248-92a86167-6977858b-b7a92eec_0] Write session: Do CDS request
2025-10-01T14:12:09.656932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b5d248-92a86167-6977858b-b7a92eec_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:09.656442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:09.666046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b5d248-92a86167-6977858b-b7a92eec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:09.667683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:09.667703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1587
2025-10-01T14:12:09.667853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:09.667889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:09.667899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:09.667904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:09.668248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1587 sessionId:  describe result for acl check
2025-10-01T14:12:09.668284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:09.668285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:09.668286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:09.668291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255922071495680:8124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:09.668510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:09.668831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255922071495680:8124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:09.670132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:09.670346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:09.670358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:09.670382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:09.670434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:09.670474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255919694610549:5135]
2025-10-01T14:12:09.671051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:09.671229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255922071495680:8124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:09.671398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:09.671445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:09.671781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:09.671839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.671840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.671841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.671842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.671843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.671844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.671845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.671846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.671847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.671848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.671849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.671850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.671851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.671852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.671858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.671866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.671870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.671873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.671876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.671880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.671883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.671886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.671889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.671893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.671896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.671900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.671903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.671905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.671913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.671920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.671926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.671930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.671934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.671939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.671944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.671948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.671952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.671956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.671960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.671965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.671969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.671973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.671978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.671982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.671986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.671991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.671995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.672000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.672004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.672008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.672012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.672016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.672020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.672024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.672028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.672032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.672066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:09.675881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255922071495680:8124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:09.675902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255922071495680:8124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:09.675906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255922071495680:8124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:09.675915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:09.675923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:09.676612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:09.676626Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:09.676628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:09.676632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:09.676641Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1586 [2:7556255919694610549:5135]
2025-10-01T14:12:09.676668Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:09.676683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:09.676690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.676692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.676694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.676708Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:09.676716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:09.676721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:09.676766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.676771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.676773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.676775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:09.676777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:09.676840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:09.676846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.676857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.676870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.676887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:09.676905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495720:8124], now have 1 active actors on pipe
2025-10-01T14:12:09.676913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495474:2446], now have 1 active actors on pipe
2025-10-01T14:12:09.676920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255919694610543:5135]
2025-10-01T14:12:09.676922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255919694610543:5135]
2025-10-01T14:12:09.676924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255919694610543:5135]
2025-10-01T14:12:09.676938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:09.676948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:09.676951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:09.676953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:09.676955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:09.676969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:09.676978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:09.677015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255919694610543:5135]
2025-10-01T14:12:09.677022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:09.677024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:09.677049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.677058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.677091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96de93a2-a7363171-56827b2c-f6db02bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:09.677103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.677111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.677113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:09.677119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.677126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:09.676994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1586
2025-10-01T14:12:09.677030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1586
2025-10-01T14:12:09.677147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.677314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.677323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.677336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.677416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1587 partition: 0 MaxSeqNo: 45 sessionId: src_id|96de93a2-a7363171-56827b2c-f6db02bb_0
2025-10-01T14:12:09.677812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b5d248-92a86167-6977858b-b7a92eec_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|96de93a2-a7363171-56827b2c-f6db02bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:09.680468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96de93a2-a7363171-56827b2c-f6db02bb_0] Write session: try to update token
2025-10-01T14:12:09.680486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96de93a2-a7363171-56827b2c-f6db02bb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:09.696310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1587 sessionId: src_id|96de93a2-a7363171-56827b2c-f6db02bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:09.698900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:09.699100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.699121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.699159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:09.699255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:09.701293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:09.701310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:09.701312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:09.701314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:09.701321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255919694610543:5135]
2025-10-01T14:12:09.701325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255919694610543:5135]
2025-10-01T14:12:09.701329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255919694610543:5135]
2025-10-01T14:12:09.701364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:09.701367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:09.701370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.701371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:09.701372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:09.701376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:09.701507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:09.756753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255922071495727:2856]
2025-10-01T14:12:09.757066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1586, pipe: [1:7556255922071495727:2856]
2025-10-01T14:12:09.846677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:09.855075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.855101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.855275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.855342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.855414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.855479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.855522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.855528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.855611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.855679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.855738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.855796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.855836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.855838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.855906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.855964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.856027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.856087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.856124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.856126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.856187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.856239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.856298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.856362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.856401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.856403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.856459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.856514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.856570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.856632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.856689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.856695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.856758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.856813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.856873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.856961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.857004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.857007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.857072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.857136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.857203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.857265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.857306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.857309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.857373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.857428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.857487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.857551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.857591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.857594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.857660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.857713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.857769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.857823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.857860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.857862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.857931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:09.857992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:09.858057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:09.858119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:09.858164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:09.858166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:09.858240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495727:2856], now have 1 active actors on pipe
2025-10-01T14:12:09.859099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:09.859116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255922071495727:2856]
2025-10-01T14:12:09.859143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:09.859146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:09.859172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1587 reason: error at write: Disconnected sessionId: src_id|96de93a2-a7363171-56827b2c-f6db02bb_0
2025-10-01T14:12:09.859390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1587 sessionId: src_id|96de93a2-a7363171-56827b2c-f6db02bb_0 is DEAD
2025-10-01T14:12:09.859611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:09.862601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96de93a2-a7363171-56827b2c-f6db02bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:09.862614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96de93a2-a7363171-56827b2c-f6db02bb_0] Write session will restart in 0.007535s
2025-10-01T14:12:09.862639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96de93a2-a7363171-56827b2c-f6db02bb_0] Write session: Do CDS request
2025-10-01T14:12:09.862645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96de93a2-a7363171-56827b2c-f6db02bb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:09.874819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96de93a2-a7363171-56827b2c-f6db02bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:09.878556Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:09.878573Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1588
2025-10-01T14:12:09.878865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:09.878898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:09.878904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:09.878907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:09.879726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:09.880302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:09.879334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1588 sessionId:  describe result for acl check
2025-10-01T14:12:09.879371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:09.879373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:09.879375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:09.879379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255922071495939:8118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:09.879936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255922071495939:8118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:09.880473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:09.880482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:09.880492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:09.880530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:09.880565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255919694610718:5130]
2025-10-01T14:12:09.881104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:09.881455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:09.881508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:09.881840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:09.881899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.881905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.881906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.881907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.881908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.881909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.881910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.881912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.881912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.881913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.881914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.881915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.881916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.881917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.881923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.881932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.881937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.881941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.881944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.881947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.881951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.881955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.881959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.881962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.881966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.881969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.881972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.881975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.881981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.881989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:09.881996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.882000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:09.882004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.882009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:09.882013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.882017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:09.882021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.882026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:09.882036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.882041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:09.882045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.882050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:09.882057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.882063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:09.882072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.882076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:09.882082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.882086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.882091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.882096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.882107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.882112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.882116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.882121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:09.882124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.882128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:09.882159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:09.885237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255922071495939:8118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:09.889644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255922071495939:8118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:09.889662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255922071495939:8118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:09.889665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255922071495939:8118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:09.889673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:09.890828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1587
2025-10-01T14:12:09.890878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1587
2025-10-01T14:12:09.889713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:09.890449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:09.890454Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:09.890456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:09.890460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:09.890468Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1587 [2:7556255919694610718:5130]
2025-10-01T14:12:09.890484Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:09.890535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:09.890538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.890542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.890544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.890562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:09.890567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:09.890572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:09.890623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.890625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.890626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.890630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:09.890632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:09.890699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:09.890703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.890712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:09.890720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:09.890733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:09.890750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495732:2446], now have 1 active actors on pipe
2025-10-01T14:12:09.890753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495978:8118], now have 1 active actors on pipe
2025-10-01T14:12:09.890760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255919694610713:5130]
2025-10-01T14:12:09.890762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255919694610713:5130]
2025-10-01T14:12:09.890764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255919694610713:5130]
2025-10-01T14:12:09.890773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:09.890779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:09.890782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:09.890784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:09.890785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:09.890797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:09.890800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:09.890835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255919694610713:5130]
2025-10-01T14:12:09.890841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:09.890927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:09.892323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.892338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.892375Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d278941c-fda4438a-15c56d12-7892e593_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:09.892390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:09.892399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:09.892402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:09.892411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:09.892423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:09.892440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.893492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.893505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.893525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:09.894466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1588 partition: 0 MaxSeqNo: 45 sessionId: src_id|d278941c-fda4438a-15c56d12-7892e593_0
2025-10-01T14:12:09.894914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96de93a2-a7363171-56827b2c-f6db02bb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d278941c-fda4438a-15c56d12-7892e593_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:09.897816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d278941c-fda4438a-15c56d12-7892e593_0] Write session: try to update token
2025-10-01T14:12:09.897836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d278941c-fda4438a-15c56d12-7892e593_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:09.903298Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:09.903321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:09.903330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255919694610713:5130]
2025-10-01T14:12:09.903376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:09.903551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:09.903692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:09.903835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:09.903978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:09.904175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:09.904218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:09.904579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:09.915237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1588 sessionId: src_id|d278941c-fda4438a-15c56d12-7892e593_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:09.917617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:09.917874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:09.917897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:09.917937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:09.918077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:09.928529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:09.928548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:09.928551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:09.928553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:09.928579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255919694610713:5130]
2025-10-01T14:12:09.928582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255919694610713:5130]
2025-10-01T14:12:09.928586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255919694610713:5130]
2025-10-01T14:12:09.928632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:09.928641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:09.928646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:09.928650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:09.928666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:09.928670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:09.928816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:09.958450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255922071495986:2856]
2025-10-01T14:12:09.958776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1587, pipe: [1:7556255922071495986:2856]
2025-10-01T14:12:10.085958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:10.095214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.095245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.095429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.095507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.095583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.095649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.095706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.095716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.095792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.095858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.095933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.095998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.096053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.096063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.096142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.096219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.096302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.096384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.096443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.096452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.096536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.096607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.096692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.096776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.096832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.096835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.096916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.096987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.097053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.097132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.097180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.097183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.097267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.097342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.097412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.097489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.097537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.097539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.097625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.097693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.097764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.097832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.097878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.097881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.097957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.098044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.098111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.098180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.098225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.098229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.098308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.099620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:10.099696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:10.099711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:10.099743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1588 reason: error at write: Disconnected sessionId: src_id|d278941c-fda4438a-15c56d12-7892e593_0
2025-10-01T14:12:10.100343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d278941c-fda4438a-15c56d12-7892e593_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:10.100354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d278941c-fda4438a-15c56d12-7892e593_0] Write session will restart in 0.007797s
2025-10-01T14:12:10.100385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d278941c-fda4438a-15c56d12-7892e593_0] Write session: Do CDS request
2025-10-01T14:12:10.100390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d278941c-fda4438a-15c56d12-7892e593_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:10.099968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1588 sessionId: src_id|d278941c-fda4438a-15c56d12-7892e593_0 is DEAD
2025-10-01T14:12:10.099975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255922071495986:2856]
2025-10-01T14:12:10.098527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.098606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.098682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.098731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.098734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.098818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.098889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.098964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.099042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.099091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.099094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.099173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255922071495986:2856], now have 1 active actors on pipe
2025-10-01T14:12:10.100484Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:10.108950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d278941c-fda4438a-15c56d12-7892e593_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:10.109039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:10.109059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1589
2025-10-01T14:12:10.109200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:10.109233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:10.109239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:10.109242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:10.109659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1589 sessionId:  describe result for acl check
2025-10-01T14:12:10.109694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:10.109700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:10.109705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:10.109710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255926366463296:8112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:10.110252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255926366463296:8112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:10.113147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255926366463296:8112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:10.116577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255926366463296:8112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:10.116602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255926366463296:8112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:10.116606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255926366463296:8112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:10.116615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:10.128700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:10.130219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:10.130523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:10.130537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:10.130555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:10.130638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:10.130682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255923989578200:5126]
2025-10-01T14:12:10.131385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:10.131785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:10.131846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:10.132227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:10.132297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.132298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.132300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.132301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.132302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.132303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.132304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.132305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.132306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.132307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.132308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.132309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.132311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.132312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.132318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.132327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.132330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.132333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.132337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.132340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.132342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.132345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.132349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.132353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.132355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.132359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.132361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.132364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.132371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.132377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.132387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.132393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.132398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.132402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.132407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.132412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.132418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.132423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.132427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.132432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.132437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.132442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.132446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.132450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.132455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.132460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.132463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.132468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.132475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.132480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.132484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.132488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.132493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.132499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.132504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.132509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.132569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:10.137603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:10.138558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:10.138572Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:10.138575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:10.138578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:10.138587Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1588 [2:7556255923989578200:5126]
2025-10-01T14:12:10.138604Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:10.138623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:10.138627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:10.138630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:10.138632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:10.138651Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:10.138657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:10.138668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:10.138726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.138735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.138736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.138740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:10.138743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:10.138826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:10.138833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.138848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.138864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.138882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:10.138905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255923989578195:5126]
2025-10-01T14:12:10.138911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255923989578195:5126]
2025-10-01T14:12:10.138913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255923989578195:5126]
2025-10-01T14:12:10.138927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:10.138946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:10.138965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:10.138972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:10.139004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:10.139012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:10.139014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255923989578195:5126]
2025-10-01T14:12:10.139015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:10.139017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:10.139021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:10.139027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366463284:2446], now have 1 active actors on pipe
2025-10-01T14:12:10.139030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366463333:8112], now have 1 active actors on pipe
2025-10-01T14:12:10.139105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1588
2025-10-01T14:12:10.139151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1588
2025-10-01T14:12:10.139314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.139329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.139361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:10.139371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:10.139377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:10.139379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:10.139393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:10.139406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:10.139428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:10.139914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.139928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.139956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:10.140053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1589 partition: 0 MaxSeqNo: 45 sessionId: src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0
2025-10-01T14:12:10.140469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d278941c-fda4438a-15c56d12-7892e593_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:10.143228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0] Write session: try to update token
2025-10-01T14:12:10.143249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:10.152932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:10.152949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:10.152961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255923989578195:5126]
2025-10-01T14:12:10.153009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:10.153022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:10.153178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:10.153320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:10.153443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:10.153590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:10.153772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:10.153804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:10.173267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1589 sessionId: src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:10.176984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:10.177508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.177537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.177580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:10.177685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:10.184243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:10.184267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:10.184270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:10.184273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:10.184286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255923989578195:5126]
2025-10-01T14:12:10.184290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255923989578195:5126]
2025-10-01T14:12:10.184293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255923989578195:5126]
2025-10-01T14:12:10.184352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:10.184365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.184368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:10.184515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:10.184619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:10.184631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:10.184635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:10.200576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255926366463562:2856]
2025-10-01T14:12:10.202433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1588, pipe: [1:7556255926366463562:2856]
2025-10-01T14:12:10.340827Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:10.341129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366463562:2856], now have 1 active actors on pipe
2025-10-01T14:12:10.349112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.349140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.349310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.349379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.349454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.349521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.349570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.349579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.349654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.349717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.349785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.349870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.349920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.349929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.350002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.350071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.350145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.350216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.350272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.350281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.350348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.350430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.350491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.350551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.350597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.350604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.350669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.350730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.350794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.350859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.350902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.350909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.350980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.351041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.351110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.351181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.351242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.351249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.351314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.351380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.351458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.351526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.351568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.351574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.351638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.351699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.351764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.351831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.351878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.351885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.351958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.352026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.352096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.352166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.352218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.352224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.352293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:10.352361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:10.352430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:10.352495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:10.352541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:10.352549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:10.352850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:10.352861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:10.352865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:10.352897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1589 reason: error at write: Disconnected sessionId: src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0
2025-10-01T14:12:10.352906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255926366463562:2856]
2025-10-01T14:12:10.353143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1589 sessionId: src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0 is DEAD
2025-10-01T14:12:10.353286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:10.353297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0] Write session will restart in 0.006029s
2025-10-01T14:12:10.353321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0] Write session: Do CDS request
2025-10-01T14:12:10.353326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:10.353745Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:10.360918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:10.361056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:10.361069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1590
2025-10-01T14:12:10.361172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:10.361205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:10.361215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:10.361218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:10.361616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1590 sessionId:  describe result for acl check
2025-10-01T14:12:10.361650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:10.361656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:10.361658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:10.361663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255926366463710:8096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:10.362182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255926366463710:8096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:10.364464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255926366463710:8096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:10.365223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:10.366551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:10.366821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:10.366836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:10.366849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:10.366907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:10.366949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255923989578378:5122]
2025-10-01T14:12:10.367516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:10.367826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:10.367870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:10.368170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:10.368225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.368231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.368232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.368233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.368234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.368235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.368236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.368237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.368239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.368240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.368241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.368242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.368243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.368244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.368249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.368257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.368261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.368264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.368268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.368271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.368275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.368278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.368281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.368285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.368288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.368291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.368294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.368297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.368304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.368311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.368317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.368322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.368327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.368332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.368336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.368341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.368345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.368353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.368362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.368367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.368375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.368379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.368387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.368391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.368399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.368403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.368411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.368415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.368423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.368427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.368435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.368440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.368443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.368452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.368456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.368465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.368500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:10.371199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255926366463710:8096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:10.371216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255926366463710:8096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:10.371221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255926366463710:8096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:10.371231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:10.373943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:10.374551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:10.374562Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:10.374565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:10.374567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:10.374573Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1589 [2:7556255923989578378:5122]
2025-10-01T14:12:10.374585Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:10.374599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:10.374601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:10.374603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:10.374604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:10.374618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:10.374626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:10.374631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:10.374676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.374681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.374683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.374685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:10.374687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:10.374753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:10.374761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.374772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.374789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.374809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:10.374831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366463579:2446], now have 1 active actors on pipe
2025-10-01T14:12:10.374837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366463833:8096], now have 1 active actors on pipe
2025-10-01T14:12:10.374843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255923989578373:5122]
2025-10-01T14:12:10.374845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255923989578373:5122]
2025-10-01T14:12:10.374846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255923989578373:5122]
2025-10-01T14:12:10.374861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:10.374878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:10.374880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:10.374882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:10.374884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:10.374861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1589
2025-10-01T14:12:10.374895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:10.374878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1589
2025-10-01T14:12:10.374902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:10.374954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.374963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.374976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255923989578373:5122]
2025-10-01T14:12:10.374990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:10.375006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:10.375027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:10.375038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:10.375045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:10.375047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:10.375056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:10.375070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:10.375096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:10.375255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.375262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.375277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:10.375352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1590 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0
2025-10-01T14:12:10.375702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d84239ad-4abfe79b-bfa2ee54-4b24d043_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:10.378211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0] Write session: try to update token
2025-10-01T14:12:10.378228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:10.392675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1590 sessionId: src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:10.395379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:10.395929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.395952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.395973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:10.395976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:10.395978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:10.395979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:10.395986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255923989578373:5122]
2025-10-01T14:12:10.395990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255923989578373:5122]
2025-10-01T14:12:10.395993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255923989578373:5122]
2025-10-01T14:12:10.396039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:10.396051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:10.396053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:10.396054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:10.396060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.396063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:10.396210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:10.453060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255926366463849:2856]
2025-10-01T14:12:10.453374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1589, pipe: [1:7556255926366463849:2856]
2025-10-01T14:12:10.551579Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:10.552220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:10.552285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366463849:2856], now have 1 active actors on pipe
2025-10-01T14:12:10.554940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:10.555636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255926366463849:2856]
2025-10-01T14:12:10.555653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:10.569448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:10.569462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:10.569489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1590 reason: error at write: Disconnected sessionId: src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0
2025-10-01T14:12:10.569651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1590 sessionId: src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0 is DEAD
2025-10-01T14:12:10.570471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:10.570486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0] Write session will restart in 0.007707s
2025-10-01T14:12:10.570514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0] Write session: Do CDS request
2025-10-01T14:12:10.570522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:10.579863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:10.582701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:10.582715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1591
2025-10-01T14:12:10.582850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:10.582881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:10.582891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:10.582899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:10.583438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1591 sessionId:  describe result for acl check
2025-10-01T14:12:10.583487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:10.583494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:10.583495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:10.583501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255926366463891:8088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:10.584056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255926366463891:8088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:10.587493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255926366463891:8088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:10.595367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255926366463891:8088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:10.595391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255926366463891:8088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:10.595394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255926366463891:8088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:10.595403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:10.610333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:10.612040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:10.612265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:10.612277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:10.612307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:10.612359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:10.612408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255923989578583:5106]
2025-10-01T14:12:10.613016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:10.613319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:10.613360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:10.613688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:10.613749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.613750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.613751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.613752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.613754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.613755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.613756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.613757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.613758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.613759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.613760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.613761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.613762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.613763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.613768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.613777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.613781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.613784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.613788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.613791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.613795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.613798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.613801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.613805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.613808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.613811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.613814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.613818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.613824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.613832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.613837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.613842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.613846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.613850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.613854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.613859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.613864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.613868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.613872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.613877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.613882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.613886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.613890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.613895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.613899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.613903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.613909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.613913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.613917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.613921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.613924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.613929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.613935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.613939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.613943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.613947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.613982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:10.618837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:10.619929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:10.619946Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:10.619949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:10.619954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:10.619962Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1590 [2:7556255923989578583:5106]
2025-10-01T14:12:10.619979Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:10.619998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:10.620006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:10.620010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:10.620013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:10.620031Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:10.620045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:10.620051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:10.620121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.620129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.620131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.620135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:10.620137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:10.620211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:10.620218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.620231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.620242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.620257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:10.620274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255923989578577:5106]
2025-10-01T14:12:10.620281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255923989578577:5106]
2025-10-01T14:12:10.620283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255923989578577:5106]
2025-10-01T14:12:10.620292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:10.620301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:10.620303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:10.620307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:10.620312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:10.620328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:10.620335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:10.620348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366463939:8088], now have 1 active actors on pipe
2025-10-01T14:12:10.620357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366463857:2446], now have 1 active actors on pipe
2025-10-01T14:12:10.620395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255923989578577:5106]
2025-10-01T14:12:10.620406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:10.620412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:10.621478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.621493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.621531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:10.621541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:10.621546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:10.621548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:10.621561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:10.621573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:10.621593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:10.621912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.621918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.621933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:10.621166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1590
2025-10-01T14:12:10.621198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1590
2025-10-01T14:12:10.622067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1591 partition: 0 MaxSeqNo: 45 sessionId: src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0
2025-10-01T14:12:10.625186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae5837c7-ecebd125-6790412d-b81b0c53_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:10.641793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0] Write session: try to update token
2025-10-01T14:12:10.641822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:10.645485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:10.645506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:10.645510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:10.645512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:10.645523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255923989578577:5106]
2025-10-01T14:12:10.645529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255923989578577:5106]
2025-10-01T14:12:10.645533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255923989578577:5106]
2025-10-01T14:12:10.645562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:10.645582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:10.645583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:10.645589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.645592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:10.645592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:10.645864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:10.655819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255926366464111:2856]
2025-10-01T14:12:10.656411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1590, pipe: [1:7556255926366464111:2856]
2025-10-01T14:12:10.661640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1591 sessionId: src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:10.664279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:10.815492Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:10.815768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366464111:2856], now have 1 active actors on pipe
2025-10-01T14:12:10.815793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.815800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.817404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:10.817738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255926366464111:2856]
2025-10-01T14:12:10.817762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:10.817764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:10.817812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1591 reason: error at write: Disconnected sessionId: src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0
2025-10-01T14:12:10.817999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1591 sessionId: src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0 is DEAD
2025-10-01T14:12:10.818089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:10.818535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:10.818543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0] Write session will restart in 0.009254s
2025-10-01T14:12:10.818576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0] Write session: Do CDS request
2025-10-01T14:12:10.818583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:10.830233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:10.830457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:10.830472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1592
2025-10-01T14:12:10.830615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:10.830660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:10.830670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:10.830674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:10.831207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1592 sessionId:  describe result for acl check
2025-10-01T14:12:10.831243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:10.831249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:10.831251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:10.831256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255926366464313:8084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:10.831876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255926366464313:8084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:10.834294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:10.834925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255926366464313:8084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:10.835967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:10.836183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:10.836187Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:10.836198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:10.836240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:10.836266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255923989578756:5100]
2025-10-01T14:12:10.836854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:10.837146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:10.837182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:10.837453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:10.837495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.837496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.837497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.837498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.837499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.837499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.837501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.837502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.837502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.837504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.837504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.837506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.837507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.837508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.837512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.837521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.837524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.837528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.837531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.837534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.837537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.837540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.837543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.837546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.837549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.837552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.837555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.837558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.837565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.837572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:10.837577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.837582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:10.837588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.837592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:10.837596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.837602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:10.837606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.837610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:10.837613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.837617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:10.837622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.837626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:10.837630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.837634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:10.837778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255926366464313:8084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:10.837793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255926366464313:8084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:10.837638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.837797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255926366464313:8084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:10.837806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:10.837643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:10.837647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.837651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.837655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.837659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.837662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.837666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.837670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.837674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:10.837678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.837682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:10.837713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:10.843052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:10.843733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:10.843747Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:10.843750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:10.843754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:10.843761Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1591 [2:7556255923989578756:5100]
2025-10-01T14:12:10.843775Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:10.843792Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:10.843800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:10.843803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:10.843806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:10.843820Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:10.843826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:10.843834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:10.843895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.843901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.843904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.843907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:10.843909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:10.843980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:10.843988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.844000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:10.844012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:10.844030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:10.844051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366464115:2446], now have 1 active actors on pipe
2025-10-01T14:12:10.844058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366464365:8084], now have 1 active actors on pipe
2025-10-01T14:12:10.844064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255923989578751:5100]
2025-10-01T14:12:10.844068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255923989578751:5100]
2025-10-01T14:12:10.844070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255923989578751:5100]
2025-10-01T14:12:10.844084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:10.844096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:10.844101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:10.844105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:10.844108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:10.844113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:10.844116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:10.844155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255923989578751:5100]
2025-10-01T14:12:10.844164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:10.844172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:10.844317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1591
2025-10-01T14:12:10.844349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1591
2025-10-01T14:12:10.844586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.844595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.844617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:10.844625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:10.844630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:10.844632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:10.844642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:10.844651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:10.844678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:10.844844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:10.844850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:10.844863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:10.845503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1592 partition: 0 MaxSeqNo: 45 sessionId: src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0
2025-10-01T14:12:10.845850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70413e6-23d240-cb5de4d7-74b58fd7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:10.848409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0] Write session: try to update token
2025-10-01T14:12:10.848426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:10.864166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1592 sessionId: src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:10.865003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:10.865026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:10.865029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:10.865031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:10.865041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255923989578751:5100]
2025-10-01T14:12:10.865047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255923989578751:5100]
2025-10-01T14:12:10.865052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255923989578751:5100]
2025-10-01T14:12:10.865096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:10.865102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:10.865107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:10.865109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:10.865113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:10.865116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:10.865290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:10.866839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:10.914487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255926366464375:2856]
2025-10-01T14:12:10.918464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1591, pipe: [1:7556255926366464375:2856]
2025-10-01T14:12:11.024158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:11.024733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.024748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.024787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255926366464375:2856], now have 1 active actors on pipe
2025-10-01T14:12:11.025047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:11.025015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255926366464375:2856]
2025-10-01T14:12:11.025055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:11.025092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:11.025094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:11.025149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1592 reason: error at write: Disconnected sessionId: src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0
2025-10-01T14:12:11.025376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1592 sessionId: src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0 is DEAD
2025-10-01T14:12:11.026596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:11.026608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0] Write session will restart in 0.005412s
2025-10-01T14:12:11.026636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0] Write session: Do CDS request
2025-10-01T14:12:11.026642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:11.033255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:11.036282Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:11.036530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1593
2025-10-01T14:12:11.037325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:11.037364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:11.037369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:11.037373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:11.037827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1593 sessionId:  describe result for acl check
2025-10-01T14:12:11.037872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:11.037879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:11.037881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:11.037887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255930661431707:8073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:11.038517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255930661431707:8073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:11.044429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255930661431707:8073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:11.053489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255930661431707:8073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:11.053506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255930661431707:8073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:11.053509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255930661431707:8073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:11.053518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:11.061439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:11.063459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:11.063705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:11.063719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:11.063732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:11.063792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:11.063836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255928284546241:5088]
2025-10-01T14:12:11.064447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:11.064917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:11.064973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:11.065292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:11.065366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.065373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.065374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.065375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.065376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.065378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.065379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.065380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.065381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.065382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.065384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.065385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.065386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.065388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.065395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.065405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.065409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.065413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.065417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.065422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.065426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.065431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.065435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.065439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.065443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.065448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.065452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.065456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.065464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.065474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.065481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.065487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.065496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.065507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.065512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.065522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.065531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.065536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.065541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.065550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.065555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.065560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.065570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.065576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.065581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.065591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.065596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.065603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.065607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.065617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.065622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.065632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.065638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.065647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.065652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.065661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.065701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:11.073761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:11.074485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:11.074503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:11.074507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:11.074512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:11.074519Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1592 [2:7556255928284546241:5088]
2025-10-01T14:12:11.074539Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:11.074558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:11.074567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:11.074571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:11.074574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:11.074593Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:11.074604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:11.074611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:11.074682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.074691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.074693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.074697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:11.074700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:11.074777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:11.074785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.074800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.074811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.074833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:11.074856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255928284546236:5088]
2025-10-01T14:12:11.074864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255928284546236:5088]
2025-10-01T14:12:11.074867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255928284546236:5088]
2025-10-01T14:12:11.074882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:11.074904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:11.074925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:11.074932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:11.074977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255928284546236:5088]
2025-10-01T14:12:11.074984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:11.075086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:11.075094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:11.075096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:11.075102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:11.075511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1592
2025-10-01T14:12:11.075554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1592
2025-10-01T14:12:11.075968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661431871:8073], now have 1 active actors on pipe
2025-10-01T14:12:11.075984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661431673:2446], now have 1 active actors on pipe
2025-10-01T14:12:11.076000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.076007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.076043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:11.076058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:11.076064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:11.076071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:11.076083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:11.076101Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:11.076126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:11.076393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.076403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.076420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:11.076546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1593 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0
2025-10-01T14:12:11.082490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73533f26-b4bf697b-61bee165-8ddcdc12_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:11.085265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0] Write session: try to update token
2025-10-01T14:12:11.085286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:11.105158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:11.105182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:11.105185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:11.105187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:11.105200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255928284546236:5088]
2025-10-01T14:12:11.105205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255928284546236:5088]
2025-10-01T14:12:11.105212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255928284546236:5088]
2025-10-01T14:12:11.105273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:11.105272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:11.105280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.105282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:11.105282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:11.105286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:11.105437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:11.108408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1593 sessionId: src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:11.111017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:11.125277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255930661431933:2856]
2025-10-01T14:12:11.125766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1592, pipe: [1:7556255930661431933:2856]
2025-10-01T14:12:11.289250Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:11.289922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.289940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.289988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661431933:2856], now have 1 active actors on pipe
2025-10-01T14:12:11.290320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:11.291856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:11.291869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0] Write session will restart in 0.009450s
2025-10-01T14:12:11.291893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0] Write session: Do CDS request
2025-10-01T14:12:11.291899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:11.291059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:11.291140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1593 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0
2025-10-01T14:12:11.291336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1593 sessionId: src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0 is DEAD
2025-10-01T14:12:11.291471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255930661431933:2856]
2025-10-01T14:12:11.291484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:11.304007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:11.304446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:11.304463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1594
2025-10-01T14:12:11.304618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:11.304647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:11.304664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:11.304668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:11.306021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1594 sessionId:  describe result for acl check
2025-10-01T14:12:11.306053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:11.306055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:11.306056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:11.306062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255930661431983:8066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:11.306686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255930661431983:8066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:11.314091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255930661431983:8066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:11.318966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255930661431983:8066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:11.318979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255930661431983:8066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:11.318982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255930661431983:8066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:11.318992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:11.374262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:11.386801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:11.387088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:11.387093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:11.387105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:11.387163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:11.387200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255928284546425:5094]
2025-10-01T14:12:11.387806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:11.388312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:11.388360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:11.388689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:11.388749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.388750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.388751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.388753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.388755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.388756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.388757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.388759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.388760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.388761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.388762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.388763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.388764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.388765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.388772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.388784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.388788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.388792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.388796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.388800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.388803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.388807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.388811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.388815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.388818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.388822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.388826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.388829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.388837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.388844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.388851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.388856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.388860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.388866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.388871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.388876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.388881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.388886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.388890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.388895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.388900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.388905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.388908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.388914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.388920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.388926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.388930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.388935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.388940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.388945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.388949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.388954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.388958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.388963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.388968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.388973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.389012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:11.392050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255930661432227:2856]
2025-10-01T14:12:11.399849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:11.401427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1593
2025-10-01T14:12:11.401455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1593, pipe: [1:7556255930661432227:2856]
2025-10-01T14:12:11.401481Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1593
2025-10-01T14:12:11.402349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1594 partition: 0 MaxSeqNo: 45 sessionId: src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0
2025-10-01T14:12:11.402802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b96c606-fcfd88b3-7941fd94-31eb0525_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:11.405520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0] Write session: try to update token
2025-10-01T14:12:11.405540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:11.400529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:11.400542Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:11.400546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:11.400550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:11.400558Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1593 [2:7556255928284546425:5094]
2025-10-01T14:12:11.400575Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:11.400594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:11.400598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:11.400601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:11.400603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:11.400622Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:11.400628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:11.400634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:11.400713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.400716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.400718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.400722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:11.400724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:11.400799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:11.400802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.400814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.400825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.400841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:11.400858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255928284546419:5094]
2025-10-01T14:12:11.400861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255928284546419:5094]
2025-10-01T14:12:11.400864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255928284546419:5094]
2025-10-01T14:12:11.400875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:11.400891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:11.400891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:11.400894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:11.400896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:11.400907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:11.400910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:11.400922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661432037:8066], now have 1 active actors on pipe
2025-10-01T14:12:11.400926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661432227:2856], now have 1 active actors on pipe
2025-10-01T14:12:11.400931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661431973:2446], now have 1 active actors on pipe
2025-10-01T14:12:11.400971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255928284546419:5094]
2025-10-01T14:12:11.400980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:11.401205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:11.401930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.401938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.401970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:11.401979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:11.401984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:11.401987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:11.401997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:11.402009Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:11.402027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:11.402202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.402208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.402232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:11.432802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1594 sessionId: src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:11.435613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:11.435931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.435952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.435989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:11.436225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:11.458318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:11.458336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:11.458340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:11.458342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:11.458352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255928284546419:5094]
2025-10-01T14:12:11.458357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255928284546419:5094]
2025-10-01T14:12:11.458361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255928284546419:5094]
2025-10-01T14:12:11.458429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:11.458437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.458440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:11.458615Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:11.460051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:11.460058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:11.460066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:11.627137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:11.635909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.635941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.636118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.636185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.636249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.636309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.636351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.636359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.636430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.636493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.636555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.636752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.636794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.636797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.636885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.636957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.637022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.637135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.637178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.637181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.637264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.637330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.637428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.637495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.637541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.637544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.637651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.637714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.637775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.637870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.637925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.637928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.638000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.638074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.638144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.638220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.638278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.638283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.638356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.638442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.638506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.638572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.638613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.638616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.638693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.638752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.638825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.638890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.638930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.638932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.639004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.639067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.639131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.639218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.639338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.639347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.639421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:11.639491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:11.639559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:11.639630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:11.639673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:11.639676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:11.640833Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:11.641344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:11.641361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0] Write session will restart in 0.008009s
2025-10-01T14:12:11.641390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0] Write session: Do CDS request
2025-10-01T14:12:11.641397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:11.640360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:11.640382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:11.640409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1594 reason: error at write: Disconnected sessionId: src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0
2025-10-01T14:12:11.640601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1594 sessionId: src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0 is DEAD
2025-10-01T14:12:11.641005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255930661432227:2856]
2025-10-01T14:12:11.641019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:11.651072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:11.652595Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:11.652612Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1595
2025-10-01T14:12:11.652786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:11.652817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:11.652828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:11.652831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:11.653474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1595 sessionId:  describe result for acl check
2025-10-01T14:12:11.653512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:11.653520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:11.653522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:11.653528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255930661432282:8051] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:11.654096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255930661432282:8051] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:11.658401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255930661432282:8051] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:11.662077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255930661432282:8051] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:11.662092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255930661432282:8051] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:11.662096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255930661432282:8051] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:11.662106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:11.666060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:11.667801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:11.668054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:11.668064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:11.668079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:11.668149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:11.668191Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255928284546635:5074]
2025-10-01T14:12:11.668801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:11.669155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:11.669207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:11.669555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:11.669604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.669610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.669611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.669612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.669613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.669614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.669616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.669617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.669618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.669619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.669621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.669622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.669623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.669624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.669630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.669640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.669644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.669648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.669651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.669655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.669658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.669662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.669666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.669670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.669673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.669677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.669681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.669684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.669692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.669699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.669706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.669710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.669714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.669719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.669723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.669728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.669739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.669761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.669773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.669789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.669801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.669807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.669811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.669816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.669820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.669825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.669829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.669833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.669840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.669844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.669848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.669852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.669856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.669861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.669865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.669869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.669925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:11.674778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:11.675492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:11.675498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:11.675502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:11.675506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:11.675513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1594 [2:7556255928284546635:5074]
2025-10-01T14:12:11.675530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:11.675550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:11.675553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:11.675558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:11.675561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:11.675579Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:11.675585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:11.675593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:11.675656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.675658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.675661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.675664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:11.675667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:11.675741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:11.675744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.675755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.675765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.675780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:11.675797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255928284546630:5074]
2025-10-01T14:12:11.675799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255928284546630:5074]
2025-10-01T14:12:11.675801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255928284546630:5074]
2025-10-01T14:12:11.675810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:11.675825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:11.675838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:11.675839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:11.675841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:11.675843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:11.675846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:11.675884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255928284546630:5074]
2025-10-01T14:12:11.675887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:11.675898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661432476:8051], now have 1 active actors on pipe
2025-10-01T14:12:11.675908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:11.676118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661432249:2446], now have 1 active actors on pipe
2025-10-01T14:12:11.676269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1594
2025-10-01T14:12:11.676298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1594
2025-10-01T14:12:11.679585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.679609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.679648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:11.679659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:11.679665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:11.679668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:11.679682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:11.679700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:11.679719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:11.684506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.684529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.684571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:11.684859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1595 partition: 0 MaxSeqNo: 45 sessionId: src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0
2025-10-01T14:12:11.686483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96dab96a-a5b9dde9-2e3f7b28-1add32e1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:11.689142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0] Write session: try to update token
2025-10-01T14:12:11.689158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:11.701688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:11.701712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:11.701715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:11.701717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:11.701728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255928284546630:5074]
2025-10-01T14:12:11.701734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255928284546630:5074]
2025-10-01T14:12:11.701738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255928284546630:5074]
2025-10-01T14:12:11.701792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:11.701800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.701803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:11.701948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:11.707691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:11.707708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:11.707713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:11.715083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1595 sessionId: src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:11.718061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:11.741222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255930661432508:2856]
2025-10-01T14:12:11.741479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1594, pipe: [1:7556255930661432508:2856]
2025-10-01T14:12:11.871502Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:11.871979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.871990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.872036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661432508:2856], now have 1 active actors on pipe
2025-10-01T14:12:11.872713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255930661432508:2856]
2025-10-01T14:12:11.872737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:11.872768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:11.872771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:11.872823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1595 reason: error at write: Disconnected sessionId: src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0
2025-10-01T14:12:11.873029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1595 sessionId: src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0 is DEAD
2025-10-01T14:12:11.873878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:11.874608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:11.874620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0] Write session will restart in 0.007700s
2025-10-01T14:12:11.874660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0] Write session: Do CDS request
2025-10-01T14:12:11.874667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:11.884011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:11.884224Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:11.884239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1596
2025-10-01T14:12:11.884718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:11.884772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:11.884784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:11.884788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:11.885274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1596 sessionId:  describe result for acl check
2025-10-01T14:12:11.885315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:11.885322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:11.885323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:11.885328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255930661432521:8050] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:11.885908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255930661432521:8050] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:11.891027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255930661432521:8050] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:11.899304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255930661432521:8050] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:11.899318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255930661432521:8050] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:11.899322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255930661432521:8050] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:11.899330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:11.939174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:11.942043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:11.942402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:11.942407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:11.942423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:11.942485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:11.942530Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255928284546813:5060]
2025-10-01T14:12:11.943186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:11.943646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:11.943693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:11.944007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:11.944071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.944072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.944074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.944075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.944076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.944077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.944078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.944079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.944080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.944081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.944082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.944083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.944085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.944086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.944090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.944100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.944103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.944107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.944110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.944113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.944117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.944120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.944124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.944127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.944130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.944134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.944137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.944140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.944148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.944155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:11.944161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.944167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:11.944171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.944175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:11.944179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.944185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:11.944188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.944193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:11.944197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.944202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:11.944207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.944211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:11.944216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.944220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:11.944224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.944228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:11.944234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.944238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.944242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.944246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.944250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.944255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.944259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.944264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:11.944268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.944272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:11.944310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:11.950522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:11.951234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:11.951250Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:11.951253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:11.951257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:11.951267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1595 [2:7556255928284546813:5060]
2025-10-01T14:12:11.951283Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:11.951300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:11.951303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:11.951307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:11.951310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:11.951327Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:11.951338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:11.951345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:11.951406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.951413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.951415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.951419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:11.951421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:11.951494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:11.951501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.951514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:11.951529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:11.951546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:11.951567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255928284546807:5060]
2025-10-01T14:12:11.951573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255928284546807:5060]
2025-10-01T14:12:11.951576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255928284546807:5060]
2025-10-01T14:12:11.951589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:11.951610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:11.951629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:11.951637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:11.951677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255928284546807:5060]
2025-10-01T14:12:11.951684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:11.951789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:11.951796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:11.951798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:11.951804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:11.952442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661432512:2446], now have 1 active actors on pipe
2025-10-01T14:12:11.952452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661432563:8050], now have 1 active actors on pipe
2025-10-01T14:12:11.952472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.952477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.952504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:11.952513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:11.952517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:11.952519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:11.952530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:11.952543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:11.952559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:11.952840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:11.952850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:11.952869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:11.954477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97e3d981-45a938e5-aa279e6-4c84b2c5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:11.952160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1595
2025-10-01T14:12:11.952203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1595
2025-10-01T14:12:11.953245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1596 partition: 0 MaxSeqNo: 45 sessionId: src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0
2025-10-01T14:12:11.957237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0] Write session: try to update token
2025-10-01T14:12:11.957257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:11.974804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255930661432773:2856]
2025-10-01T14:12:11.977166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255930661432773:2856], now have 1 active actors on pipe
2025-10-01T14:12:11.977313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1595, pipe: [1:7556255930661432773:2856]
2025-10-01T14:12:11.979629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:11.979650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:11.979653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:11.979655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:11.979667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255928284546807:5060]
2025-10-01T14:12:11.979672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255928284546807:5060]
2025-10-01T14:12:11.979677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255928284546807:5060]
2025-10-01T14:12:11.979726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:11.979734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:11.979736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:11.979892Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:11.982661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:11.982672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:11.982680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:11.996743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1596 sessionId: src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:11.999941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:12.162436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:12.163010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.163021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.164095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:12.163521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255930661432773:2856]
2025-10-01T14:12:12.163562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:12.163601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:12.163604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:12.163674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1596 reason: error at write: Disconnected sessionId: src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0
2025-10-01T14:12:12.163900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1596 sessionId: src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0 is DEAD
2025-10-01T14:12:12.166653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:12.166666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0] Write session will restart in 0.005195s
2025-10-01T14:12:12.166694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0] Write session: Do CDS request
2025-10-01T14:12:12.166703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:12.178891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:12.179106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:12.179121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1597
2025-10-01T14:12:12.179334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:12.179362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:12.179367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:12.179371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:12.179746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1597 sessionId:  describe result for acl check
2025-10-01T14:12:12.179782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:12.179784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:12.179786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:12.179791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255934956400202:8042] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:12.180306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255934956400202:8042] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:12.185452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255934956400202:8042] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:12.187044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:12.189596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:12.190035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255934956400202:8042] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:12.190052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255934956400202:8042] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:12.190055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255934956400202:8042] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:12.190063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:12.189890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:12.189902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:12.189917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:12.189981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:12.190020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255932579514301:5068]
2025-10-01T14:12:12.190638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:12.190999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:12.191056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:12.191378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:12.191462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.191463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.191464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.191465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.191466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.191467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.191469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.191470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.191471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.191472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.191473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.191475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.191476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.191477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.191484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.191495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.191500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.191504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.191508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.191512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.191516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.191520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.191524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.191529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.191533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.191536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.191541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.191545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.191553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.191561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.191568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.191573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.191578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.191582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.191588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.191594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.191599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.191604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.191608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.191613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.191619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.191626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.191631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.191636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.191644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.191650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.191655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.191660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.191667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.191671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.191675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.191680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.191684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.191690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.191694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.191699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.191736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:12.199559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:12.200232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:12.200239Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:12.200244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:12.200248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:12.200256Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1596 [2:7556255932579514301:5068]
2025-10-01T14:12:12.200276Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:12.200295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:12.200299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:12.200304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:12.200307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:12.200327Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:12.200333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:12.200340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:12.200407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.200409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.200412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.200416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:12.200419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:12.200515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:12.200518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.200532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.200544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.200561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:12.200579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255932579514296:5068]
2025-10-01T14:12:12.200582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255932579514296:5068]
2025-10-01T14:12:12.200584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255932579514296:5068]
2025-10-01T14:12:12.200604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:12.200621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:12.200637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:12.200640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:12.200647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:12.200651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:12.200662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:12.200698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255932579514296:5068]
2025-10-01T14:12:12.200701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:12.200744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:12.200985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400328:8042], now have 1 active actors on pipe
2025-10-01T14:12:12.200996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400077:2446], now have 1 active actors on pipe
2025-10-01T14:12:12.201797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.201812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.201846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b17c2466-46243e32-21197fc6-1cabe53d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:12.201856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:12.201862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:12.201865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:12.201879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:12.201892Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:12.201913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:12.202244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.202253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.202272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:12.203836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e717e047-966fb4c5-86ac732c-7e43d9ee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b17c2466-46243e32-21197fc6-1cabe53d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:12.206357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17c2466-46243e32-21197fc6-1cabe53d_0] Write session: try to update token
2025-10-01T14:12:12.206392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17c2466-46243e32-21197fc6-1cabe53d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:12.201420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1596
2025-10-01T14:12:12.201445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1596
2025-10-01T14:12:12.202405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1597 partition: 0 MaxSeqNo: 45 sessionId: src_id|b17c2466-46243e32-21197fc6-1cabe53d_0
2025-10-01T14:12:12.232601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1597 sessionId: src_id|b17c2466-46243e32-21197fc6-1cabe53d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:12.235205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:12.233947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:12.233968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:12.233970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:12.233972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:12.233982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255932579514296:5068]
2025-10-01T14:12:12.233986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255932579514296:5068]
2025-10-01T14:12:12.233990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255932579514296:5068]
2025-10-01T14:12:12.234039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:12.234046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:12.234047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:12.234051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:12.234054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.234056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:12.234240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:12.261942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255934956400366:2856]
2025-10-01T14:12:12.263727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1596, pipe: [1:7556255934956400366:2856]
2025-10-01T14:12:12.395190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:12.395483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.395494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.395537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400366:2856], now have 1 active actors on pipe
2025-10-01T14:12:12.396411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:12.397680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:12.397754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1597 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b17c2466-46243e32-21197fc6-1cabe53d_0
2025-10-01T14:12:12.397958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1597 sessionId: src_id|b17c2466-46243e32-21197fc6-1cabe53d_0 is DEAD
2025-10-01T14:12:12.397966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255934956400366:2856]
2025-10-01T14:12:12.397984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:12.398411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17c2466-46243e32-21197fc6-1cabe53d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:12.398422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17c2466-46243e32-21197fc6-1cabe53d_0] Write session will restart in 0.006138s
2025-10-01T14:12:12.398446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17c2466-46243e32-21197fc6-1cabe53d_0] Write session: Do CDS request
2025-10-01T14:12:12.398452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17c2466-46243e32-21197fc6-1cabe53d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:12.409967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b17c2466-46243e32-21197fc6-1cabe53d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:12.410751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:12.410767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1598
2025-10-01T14:12:12.410913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:12.410941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:12.410947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:12.410950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:12.411384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1598 sessionId:  describe result for acl check
2025-10-01T14:12:12.411409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:12.411411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:12.411412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:12.411416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255934956400392:8021] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:12.411869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255934956400392:8021] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:12.429626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255934956400392:8021] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:12.437002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255934956400392:8021] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:12.437015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255934956400392:8021] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:12.437018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255934956400392:8021] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:12.437027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:12.451359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:12.453439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:12.453594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:12.453597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:12.453605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:12.453635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:12.453663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255932579514489:5065]
2025-10-01T14:12:12.454088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:12.454359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:12.454409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:12.454643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:12.454686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.454686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.454687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.454688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.454688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.454689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.454691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.454691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.454692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.454693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.454694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.454694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.454695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.454695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.454699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.454704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.454706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.454709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.454711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.454713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.454716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.454718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.454720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.454724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.454726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.454728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.454731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.454733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.454738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.454742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.454746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.454749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.454753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.454756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.454758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.454762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.454764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.454767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.454770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.454773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.454776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.454779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.454801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.454804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.454807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.454810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.454812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.454815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.454818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.454822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.454824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.454827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.454829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.454832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.454835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.454837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.454861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:12.462398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b17c2466-46243e32-21197fc6-1cabe53d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:12.459523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:12.460432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:12.460436Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:12.460438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:12.460440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:12.460446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1597 [2:7556255932579514489:5065]
2025-10-01T14:12:12.460456Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:12.460469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:12.460471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:12.460473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:12.460474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:12.460486Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:12.460489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:12.460493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:12.460535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.460536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.460537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.460540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:12.460542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:12.460603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:12.460605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.460612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.460618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.460627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:12.460639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255932579514483:5065]
2025-10-01T14:12:12.460642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255932579514483:5065]
2025-10-01T14:12:12.460643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255932579514483:5065]
2025-10-01T14:12:12.460668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:12.460679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:12.460687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:12.460689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:12.460714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255932579514483:5065]
2025-10-01T14:12:12.460716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:12.460778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:12.460780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:12.460781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:12.460784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:12.461465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400512:8021], now have 1 active actors on pipe
2025-10-01T14:12:12.461470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400380:2446], now have 1 active actors on pipe
2025-10-01T14:12:12.461484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.461490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.461519Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:12.461528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:12.461533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:12.461536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:12.461547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:12.461557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:12.461575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:12.461820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.461822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.461835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:12.461122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1597
2025-10-01T14:12:12.461150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1597
2025-10-01T14:12:12.461947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1598 partition: 0 MaxSeqNo: 45 sessionId: src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0
2025-10-01T14:12:12.465129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0] Write session: try to update token
2025-10-01T14:12:12.465148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:12.494748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1598 sessionId: src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:12.495016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255934956400652:2856]
2025-10-01T14:12:12.495409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1597, pipe: [1:7556255934956400652:2856]
2025-10-01T14:12:12.496608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400652:2856], now have 1 active actors on pipe
2025-10-01T14:12:12.496634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:12.496638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:12.496640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:12.496643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:12.496651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255932579514483:5065]
2025-10-01T14:12:12.496670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255932579514483:5065]
2025-10-01T14:12:12.496674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255932579514483:5065]
2025-10-01T14:12:12.496726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:12.496733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.496735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:12.496900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:12.497648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:12.506502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:12.506518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:12.506523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:12.683990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:12.684496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.684507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.686337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:12.686348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:12.686438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1598 reason: error at write: Disconnected sessionId: src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0
2025-10-01T14:12:12.686466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:12.686515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255934956400652:2856]
2025-10-01T14:12:12.686662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1598 sessionId: src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0 is DEAD
2025-10-01T14:12:12.687562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:12.690743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:12.690756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0] Write session will restart in 0.005156s
2025-10-01T14:12:12.690784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0] Write session: Do CDS request
2025-10-01T14:12:12.690794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:12.698920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:12.699472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:12.699484Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1599
2025-10-01T14:12:12.702491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:12.702539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:12.702545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:12.702550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:12.703018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1599 sessionId:  describe result for acl check
2025-10-01T14:12:12.703051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:12.703053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:12.703056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:12.703061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255934956400793:8001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:12.703601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255934956400793:8001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:12.709686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255934956400793:8001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:12.711561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:12.713785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:12.714006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:12.714011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:12.714023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:12.714068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:12.714105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255932579514700:5031]
2025-10-01T14:12:12.714796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:12.715061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:12.715102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:12.715422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:12.715473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.715479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.715481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.715482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.715484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.715485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.715486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.715488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.715489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.715490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.715491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.715493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.715494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.715495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.715500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.715511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.715515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.715520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.715525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.715529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.715533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.715537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.715541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.715545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.715549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.715553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.715557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.715560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.715567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.715576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.715583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.715589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.715598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.715604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.715608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.715619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.715624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.715629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.715638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.715644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.715649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.715654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.715662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.715668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.715673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.715679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.715688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.715694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.715702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.715707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.715716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.715722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.715730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.715735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.715739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.715748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.715788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:12.720603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:12.721487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:12.721494Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:12.721497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:12.721501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:12.721510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1598 [2:7556255932579514700:5031]
2025-10-01T14:12:12.721528Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:12.721547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:12.721551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:12.721555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:12.721557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:12.721576Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:12.721582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:12.721589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:12.721656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.721659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.721661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.721665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:12.721669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:12.721749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:12.721752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.721764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.721776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.721794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:12.721815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400658:2446], now have 1 active actors on pipe
2025-10-01T14:12:12.721824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255932579514694:5031]
2025-10-01T14:12:12.721827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255932579514694:5031]
2025-10-01T14:12:12.721830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255932579514694:5031]
2025-10-01T14:12:12.721843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:12.721858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:12.721858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:12.721861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:12.721871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:12.721880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:12.721883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:12.721926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255932579514694:5031]
2025-10-01T14:12:12.721938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:12.721944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:12.722664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1598
2025-10-01T14:12:12.728898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255934956400793:8001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:12.728913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255934956400793:8001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:12.728918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255934956400793:8001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:12.728928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:12.730425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1598
2025-10-01T14:12:12.730557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400916:8001], now have 1 active actors on pipe
2025-10-01T14:12:12.730599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.730608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.730640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:12.730653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:12.730659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:12.730663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:12.730677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:12.730695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:12.730720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:12.734239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.734257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.734294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:12.734453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1599 partition: 0 MaxSeqNo: 45 sessionId: src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0
2025-10-01T14:12:12.734949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2aa2dda2-9d3c732d-d8fd8ed2-ad12d17c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:12.737623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0] Write session: try to update token
2025-10-01T14:12:12.737643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:12.744538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:12.744557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:12.744568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255932579514694:5031]
2025-10-01T14:12:12.744612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:12.744833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:12.744969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:12.745107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:12.745253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:12.745460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:12.745497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:12.747393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:12.773165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:12.773187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:12.773190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:12.773192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:12.773204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255932579514694:5031]
2025-10-01T14:12:12.773210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255932579514694:5031]
2025-10-01T14:12:12.773214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255932579514694:5031]
2025-10-01T14:12:12.773264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:12.773270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.773273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:12.773339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:12.773349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:12.773354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:12.773419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:12.780895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1599 sessionId: src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:12.783571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:12.792573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255934956400920:2856]
2025-10-01T14:12:12.794937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1598, pipe: [1:7556255934956400920:2856]
2025-10-01T14:12:12.930632Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:12.931209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:12.931219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:12.931243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400920:2856], now have 1 active actors on pipe
2025-10-01T14:12:12.934798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:12.935247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:12.935323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1599 reason: status is not ok: tablet will be restarted right now sessionId: src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0
2025-10-01T14:12:12.935381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:12.935421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255934956400920:2856]
2025-10-01T14:12:12.935531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1599 sessionId: src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0 is DEAD
2025-10-01T14:12:12.935922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:12.935930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0] Write session will restart in 0.009335s
2025-10-01T14:12:12.935959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0] Write session: Do CDS request
2025-10-01T14:12:12.935966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:12.946954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:12.949908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:12.949922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1600
2025-10-01T14:12:12.950258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:12.950295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:12.950302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:12.950310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:12.951680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1600 sessionId:  describe result for acl check
2025-10-01T14:12:12.951719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:12.951725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:12.951727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:12.951732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255934956400942:8006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:12.952302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255934956400942:8006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:12.960737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255934956400942:8006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:12.971625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255934956400942:8006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:12.971643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255934956400942:8006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:12.971647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255934956400942:8006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:12.971656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:12.990171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:12.990474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:12.990661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:12.990665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:12.990678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:12.990732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:12.990770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255932579514883:5029]
2025-10-01T14:12:12.991463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:12.992019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:12.992073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:12.992407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:12.992464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.992465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.992467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.992468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.992469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.992471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.992472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.992474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.992475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.992476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.992478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.992479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.992480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.992481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.992488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.992498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.992501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.992505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.992509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.992514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.992517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.992521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.992525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.992529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.992532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.992536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.992540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.992543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.992550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.992558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:12.992564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.992569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:12.992574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.992578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:12.992583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.992588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:12.992592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.992598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:12.992603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.992608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:12.992614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.992619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:12.992623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.992628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:12.992633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.992638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:12.992642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.992648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:12.992671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.992676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:12.992682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.992686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:12.992691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.992696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:12.992700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.992704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:12.992742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:12.999099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:12.999840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:12.999861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:12.999864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:12.999867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:12.999877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1599 [2:7556255932579514883:5029]
2025-10-01T14:12:12.999895Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:12.999920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:12.999927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:12.999931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:12.999934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:12.999952Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:12.999964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:12.999972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:13.000036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.000043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.000046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.000050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:13.000053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:13.000126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:13.000133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.000148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.000163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.000184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:13.000207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255932579514877:5029]
2025-10-01T14:12:13.000214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255932579514877:5029]
2025-10-01T14:12:13.000217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255932579514877:5029]
2025-10-01T14:12:13.000227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:13.000244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:13.000263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:13.000270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:13.000313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255932579514877:5029]
2025-10-01T14:12:13.000320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:13.000463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:13.000472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:13.000474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:13.000479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:13.000846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956401064:8006], now have 1 active actors on pipe
2025-10-01T14:12:13.000858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255934956400925:2446], now have 1 active actors on pipe
2025-10-01T14:12:13.000958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1599
2025-10-01T14:12:13.001007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1599
2025-10-01T14:12:13.001243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.001257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.001281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bac5172-667e8997-642e17dd-b26c08b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:13.001293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:13.001298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:13.001301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:13.001311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:13.001323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:13.001339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:13.004629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.004643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.004689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:13.004852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1600 partition: 0 MaxSeqNo: 45 sessionId: src_id|9bac5172-667e8997-642e17dd-b26c08b_0
2025-10-01T14:12:13.006639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17602756-8fdef18a-9280d61e-fe7f9e4c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9bac5172-667e8997-642e17dd-b26c08b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:13.009398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bac5172-667e8997-642e17dd-b26c08b_0] Write session: try to update token
2025-10-01T14:12:13.009423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bac5172-667e8997-642e17dd-b26c08b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:13.032508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255939251368487:2856]
2025-10-01T14:12:13.034399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251368487:2856], now have 1 active actors on pipe
2025-10-01T14:12:13.034426Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:13.034430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:13.034433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:13.034435Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:13.034444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255932579514877:5029]
2025-10-01T14:12:13.034469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1599, pipe: [1:7556255939251368487:2856]
2025-10-01T14:12:13.034449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255932579514877:5029]
2025-10-01T14:12:13.034453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255932579514877:5029]
2025-10-01T14:12:13.034502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:13.034508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.034511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:13.034560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:13.034582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:13.034587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:13.034661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:13.037218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1600 sessionId: src_id|9bac5172-667e8997-642e17dd-b26c08b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:13.039995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:13.206432Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:13.206760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.206772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.207560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:13.210491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255939251368487:2856]
2025-10-01T14:12:13.210511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:13.210515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:13.210525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:13.210585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1600 reason: error at write: Disconnected sessionId: src_id|9bac5172-667e8997-642e17dd-b26c08b_0
2025-10-01T14:12:13.210826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1600 sessionId: src_id|9bac5172-667e8997-642e17dd-b26c08b_0 is DEAD
2025-10-01T14:12:13.214496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bac5172-667e8997-642e17dd-b26c08b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:13.214511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bac5172-667e8997-642e17dd-b26c08b_0] Write session will restart in 0.005968s
2025-10-01T14:12:13.214539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bac5172-667e8997-642e17dd-b26c08b_0] Write session: Do CDS request
2025-10-01T14:12:13.214549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bac5172-667e8997-642e17dd-b26c08b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:13.223743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bac5172-667e8997-642e17dd-b26c08b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:13.224580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:13.224593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1601
2025-10-01T14:12:13.225190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:13.225223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:13.225229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:13.225232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:13.225574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1601 sessionId:  describe result for acl check
2025-10-01T14:12:13.225610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:13.225616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:13.225618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:13.225624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255939251368575:7997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:13.226210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255939251368575:7997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:13.231340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255939251368575:7997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:13.235373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255939251368575:7997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:13.235387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255939251368575:7997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:13.235391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255939251368575:7997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:13.235407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:13.235656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:13.237759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:13.238008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:13.238014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:13.238029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:13.238096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:13.238131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255936874482376:5022]
2025-10-01T14:12:13.238729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:13.239161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:13.239215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:13.239516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:13.239592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.239600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.239600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.239601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.239603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.239604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.239605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.239606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.239608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.239608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.239610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.239610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.239612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.239613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.239619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.239627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.239630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.239634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.239636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.239640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.239643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.239646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.239649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.239653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.239655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.239658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.239661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.239664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.239670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.239676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.239682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.239686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.239690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.239695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.239698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.239703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.239707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.239711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.239715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.239718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.239722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.239726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.239730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.239734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.239738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.239743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.239747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.239750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.239755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.239760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.239763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.239767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.239771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.239775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.239779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.239783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.239820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:13.245681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:13.246363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:13.246386Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:13.246390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:13.246394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:13.246401Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1600 [2:7556255936874482376:5022]
2025-10-01T14:12:13.246421Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:13.246443Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:13.246448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:13.246451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:13.246454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:13.246476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:13.246483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:13.246490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:13.246573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.246575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.246578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.246583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:13.246586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:13.246660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:13.246663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.246676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.246686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.246702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:13.246722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255936874482370:5022]
2025-10-01T14:12:13.246726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255936874482370:5022]
2025-10-01T14:12:13.246728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255936874482370:5022]
2025-10-01T14:12:13.246742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:13.246760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:13.246774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:13.246777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:13.246824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255936874482370:5022]
2025-10-01T14:12:13.246827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:13.247556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1600
2025-10-01T14:12:13.247585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1600
2025-10-01T14:12:13.247048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:13.247057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:13.247059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:13.247063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:13.247947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251368745:7997], now have 1 active actors on pipe
2025-10-01T14:12:13.247956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251368490:2446], now have 1 active actors on pipe
2025-10-01T14:12:13.247974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.247981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.248013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:13.248025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:13.248030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:13.248033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:13.248044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:13.248057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:13.248078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:13.248372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.248378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.248391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:13.248518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1601 partition: 0 MaxSeqNo: 45 sessionId: src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0
2025-10-01T14:12:13.250771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bac5172-667e8997-642e17dd-b26c08b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:13.253389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0] Write session: try to update token
2025-10-01T14:12:13.253411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:13.274847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:13.274872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:13.274875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:13.274878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:13.274888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255936874482370:5022]
2025-10-01T14:12:13.274893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255936874482370:5022]
2025-10-01T14:12:13.274897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255936874482370:5022]
2025-10-01T14:12:13.274954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:13.274958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:13.274965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:13.274965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.274968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:13.274969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:13.275113Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:13.280259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1601 sessionId: src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:13.283011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:13.311577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255939251368783:2856]
2025-10-01T14:12:13.311979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1600, pipe: [1:7556255939251368783:2856]
2025-10-01T14:12:13.444351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:13.444710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.444730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.444782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251368783:2856], now have 1 active actors on pipe
2025-10-01T14:12:13.445286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:13.445442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:13.445525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0
2025-10-01T14:12:13.445753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1601 sessionId: src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0 is DEAD
2025-10-01T14:12:13.445882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:13.445918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255939251368783:2856]
2025-10-01T14:12:13.445930Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:12:13.446001Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 16 consumer shared/user session shared/user_1_16_4227458134858331545_v1 is DEAD
2025-10-01T14:12:13.446105Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255853352003797:2867] disconnected; active server actors: 1
2025-10-01T14:12:13.446110Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255853352003797:2867] client user disconnected session shared/user_1_16_4227458134858331545_v1
2025-10-01T14:12:13.446651Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:12:13.446810Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:12:13.446815Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:12:13.446823Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.009990s
2025-10-01T14:12:13.447686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:13.447698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0] Write session will restart in 0.009484s
2025-10-01T14:12:13.447726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0] Write session: Do CDS request
2025-10-01T14:12:13.447733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:13.460960Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:12:13.461097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:13.462455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:13.462463Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:12:13.462468Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 17
2025-10-01T14:12:13.462470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1602
2025-10-01T14:12:13.462600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:13.462632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:13.462638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:13.462642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:13.462680Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 17 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:12:13.462726Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:12:13.462814Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 auth for : user
2025-10-01T14:12:13.462905Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 Handle describe topics response
2025-10-01T14:12:13.462921Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 auth is DEAD
2025-10-01T14:12:13.462934Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:12:13.462969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1602 sessionId:  describe result for acl check
2025-10-01T14:12:13.462993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:13.462994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:13.462996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:13.463821Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_17_12045885967793899549_v1
2025-10-01T14:12:13.463002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255939251368841:7979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:13.463186Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:12:13.463262Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255939251368849:7974] connected; active server actors: 1
2025-10-01T14:12:13.463275Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556255939251368849:7974] session shared/user_1_17_12045885967793899549_v1
2025-10-01T14:12:13.463285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:12:13.463296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:12:13.463306Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_17_12045885967793899549_v1" (Sender=[1:7556255939251368835:7974], Pipe=[1:7556255939251368849:7974], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:12:13.463311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:12:13.463323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:12:13.463332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_17_12045885967793899549_v1" (Sender=[1:7556255939251368835:7974], Pipe=[1:7556255939251368849:7974], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:12:13.463343Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_17_12045885967793899549_v1" sender [1:7556255939251368835:7974] lock partition 0 for ReadingSession "shared/user_1_17_12045885967793899549_v1" (Sender=[1:7556255939251368835:7974], Pipe=[1:7556255939251368849:7974], Partitions=[], ActiveFamilyCount=1) generation 1 step 17
2025-10-01T14:12:13.463350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:12:13.463355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000030s
2025-10-01T14:12:13.463536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255939251368841:7979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:13.463560Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 17 Session: "shared/user_1_17_12045885967793899549_v1" ClientId: "user" PipeClient { RawX1: 7556255939251368849 RawX2: 4503603922345766 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:12:13.463574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:12:13.466550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255939251368841:7979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:13.475894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255939251368841:7979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:13.475909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255939251368841:7979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:13.475913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255939251368841:7979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:13.475922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:13.491555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:13.493389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:13.493614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:13.493618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:13.493631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:13.493676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:13.493731Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255936874482568:5016]
2025-10-01T14:12:13.494275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:13.494660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:13.494701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:13.494943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:13.494987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.494987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.494988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.494989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.494990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.494990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.494991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.494992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.494992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.494993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.494994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.494995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.494995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.494996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.495000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.495006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.495008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.495011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.495013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.495015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.495017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.495019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.495021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.495024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.495026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.495028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.495030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.495032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.495038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.495042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.495047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.495050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.495053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.495055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.495058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.495061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.495064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.495066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.495069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.495071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.495074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.495077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.495079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.495082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.495085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.495088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.495092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.495095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.495098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.495100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.495102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.495105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.495107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.495110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.495112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.495114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.495134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:13.501770Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1601
2025-10-01T14:12:13.501799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1601
2025-10-01T14:12:13.501825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1601, pipe: [1:7556255939251368853:7971]
2025-10-01T14:12:13.500424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:13.501373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:13.501378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:13.501379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:13.501383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:13.501390Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1601 [2:7556255936874482568:5016]
2025-10-01T14:12:13.501406Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:13.501425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:13.501428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:13.501431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:13.501434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:13.501450Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:13.501456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:13.501462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:13.501523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.501525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.501526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.501530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:13.501532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:13.501605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:13.501608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.501619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.501629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.501644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:13.501663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251368800:2446], now have 1 active actors on pipe
2025-10-01T14:12:13.501666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251368917:7979], now have 1 active actors on pipe
2025-10-01T14:12:13.501668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251368853:7971], now have 1 active actors on pipe
2025-10-01T14:12:13.501676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255936874482563:5016]
2025-10-01T14:12:13.501678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255936874482563:5016]
2025-10-01T14:12:13.501680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255936874482563:5016]
2025-10-01T14:12:13.501704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:13.501719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:13.501734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:13.501737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:13.501737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:13.501744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:13.501746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:13.501776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255936874482563:5016]
2025-10-01T14:12:13.501779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:13.501786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:13.501969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.501974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.501992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.501994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.502001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_17_12045885967793899549_v1 on pipe: [1:7556255939251368853:7971]
2025-10-01T14:12:13.502023Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:13.502030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:13.502034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:13.502036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:13.502039Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_17_12045885967793899549_v1:1 with generation 1601
2025-10-01T14:12:13.502044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:13.502053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:13.502066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:13.502071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:13.502073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:13.502088Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_17_12045885967793899549_v1
2025-10-01T14:12:13.502090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:13.502117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:13.502134Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:12:13.502295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.502297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.502314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:13.502555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1602 partition: 0 MaxSeqNo: 45 sessionId: src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0
2025-10-01T14:12:13.502918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73f90f6-63565d93-1e2bb9b4-d3b98d2e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:13.505538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0] Write session: try to update token
2025-10-01T14:12:13.505556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:13.509494Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327933501 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:12:13.509512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:12:13.509548Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 sending to client partition status
2025-10-01T14:12:13.509128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:12:13.509171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:12:13.509181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:13.509185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:13.509187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:13.509199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:12:13.509218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:12:13.528170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:13.528193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:13.528196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:13.528197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:13.528207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255936874482563:5016]
2025-10-01T14:12:13.528212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255936874482563:5016]
2025-10-01T14:12:13.528216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255936874482563:5016]
2025-10-01T14:12:13.528263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:13.528271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.528273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:13.528422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:13.534566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:13.534585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:13.534589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:13.540552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1602 sessionId: src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:13.543345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:13.705433Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:13.705886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.705898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.706191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_17_12045885967793899549_v1
2025-10-01T14:12:13.706212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:13.706628Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_17_12045885967793899549_v1
2025-10-01T14:12:13.706690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:13.706702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:13.706764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1602 reason: error at write: Disconnected sessionId: src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0
2025-10-01T14:12:13.706968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1602 sessionId: src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0 is DEAD
2025-10-01T14:12:13.707041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:13.707084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255939251368853:7971]
2025-10-01T14:12:13.710631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:13.710647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0] Write session will restart in 0.009876s
2025-10-01T14:12:13.710676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0] Write session: Do CDS request
2025-10-01T14:12:13.710682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:13.725171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:13.727125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:13.727138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1603
2025-10-01T14:12:13.727281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:13.727302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:13.727306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:13.727310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:13.727780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1603 sessionId:  describe result for acl check
2025-10-01T14:12:13.727806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:13.727808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:13.727810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:13.727815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255939251369101:7968] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:13.728220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255939251369101:7968] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:13.733027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255939251369101:7968] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:13.739959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255939251369101:7968] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:13.739980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255939251369101:7968] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:13.739984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255939251369101:7968] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:13.739995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:13.780469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:13.783247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:13.783496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:13.783501Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:13.783513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:13.783569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:13.783607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255936874482786:4999]
2025-10-01T14:12:13.784266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:13.784846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:13.784900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:13.785225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:13.785281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.785282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.785283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.785284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.785286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.785287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.785288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.785290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.785291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.785293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.785294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.785295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.785296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.785297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.785302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.785312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.785315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.785319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.785322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.785325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.785330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.785333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.785337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.785342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.785346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.785350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.785354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.785357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.785365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.785374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:13.785380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.785388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:13.785394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.785399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:13.785405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.785411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:13.785416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.785422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:13.785426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.785432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:13.785437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.785442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:13.785447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.785470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:13.785475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.785481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:13.785485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.785489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.785495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.785500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.785504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.785510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.785516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.785523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:13.785527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.785533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:13.785577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:13.790929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:13.791848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:13.791855Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:13.791858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:13.791861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:13.791869Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1602 [2:7556255936874482786:4999]
2025-10-01T14:12:13.791888Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:13.791905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:13.791909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:13.791913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:13.791915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:13.791933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:13.791940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:13.791947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:13.792011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.792013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.792017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.792020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:13.792023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:13.792100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:13.792103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.792116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:13.792128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:13.792145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:13.792163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255936874482780:4999]
2025-10-01T14:12:13.792165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255936874482780:4999]
2025-10-01T14:12:13.792167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255936874482780:4999]
2025-10-01T14:12:13.792180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:13.792194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:13.792208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:13.792211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:13.792250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255936874482780:4999]
2025-10-01T14:12:13.792253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:13.792493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:13.792501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:13.792503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:13.792508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:13.793277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1602
2025-10-01T14:12:13.793315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1602
2025-10-01T14:12:13.794418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251369084:2446], now have 1 active actors on pipe
2025-10-01T14:12:13.794437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251369149:7968], now have 1 active actors on pipe
2025-10-01T14:12:13.794462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.794469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.794500Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:13.794511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:13.794517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:13.794520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:13.794533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:13.794548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:13.794567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:13.798537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.798557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.798597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:13.798792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1603 partition: 0 MaxSeqNo: 45 sessionId: src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0
2025-10-01T14:12:13.799244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82bce574-d8d29ab2-c3ff099c-407bbf70_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:13.801916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0] Write session: try to update token
2025-10-01T14:12:13.801940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:13.806724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255939251369349:7971]
2025-10-01T14:12:13.807134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1602, pipe: [1:7556255939251369349:7971]
2025-10-01T14:12:13.807112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255939251369349:7971], now have 1 active actors on pipe
2025-10-01T14:12:13.829785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1603 sessionId: src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:13.832563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:13.832872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:13.832896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:13.832936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:13.833082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:13.835435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:13.835453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:13.835455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:13.835457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:13.835467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255936874482780:4999]
2025-10-01T14:12:13.835472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255936874482780:4999]
2025-10-01T14:12:13.835475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255936874482780:4999]
2025-10-01T14:12:13.835526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:13.835533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:13.835535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:13.835687Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:13.836109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:13.836115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:13.836119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:14.009292Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:14.018300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.018331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.018555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.018632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.018703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.018776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.018825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.018829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.018912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.018976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.019037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.019104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.019151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.019154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.019224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.019283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.019349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.019413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.019457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.019460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.019531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.019599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.019661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.019724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.019768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.019771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.019842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.019902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.019967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.020031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.020077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.020080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.020151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.020235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.020313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.020382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.020432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.020435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.020501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.020557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.020626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.020707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.020754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.020757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.020826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.020889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.020959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.021027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.021077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.021081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.021171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.021240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.021310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.021379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.021430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.021433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.021512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:14.021583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:14.021655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:14.021725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:14.021772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:14.021775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:14.022751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:14.026117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:14.026127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0] Write session will restart in 0.008648s
2025-10-01T14:12:14.026147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0] Write session: Do CDS request
2025-10-01T14:12:14.026152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:14.025654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255939251369349:7971]
2025-10-01T14:12:14.025679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:14.025714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:14.025757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1603 reason: status is not ok: tablet will be restarted right now sessionId: src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0
2025-10-01T14:12:14.026022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1603 sessionId: src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0 is DEAD
2025-10-01T14:12:14.036117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:14.038526Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:14.038538Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1604
2025-10-01T14:12:14.038690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:14.038721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:14.038726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:14.038730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:14.039227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1604 sessionId:  describe result for acl check
2025-10-01T14:12:14.039260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:14.039262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:14.039263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:14.039268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255943546336662:7958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:14.039743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255943546336662:7958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:14.042780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255943546336662:7958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:14.059828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255943546336662:7958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:14.059846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255943546336662:7958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:14.059851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255943546336662:7958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:14.059861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:14.089790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:14.090420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:14.090713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:14.090740Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:14.090755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:14.090816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:14.090856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255941169450283:4993]
2025-10-01T14:12:14.091385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:14.091786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:14.091832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:14.092108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:14.092152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.092153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.092154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.092155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.092156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.092157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.092158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.092160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.092161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.092162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.092163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.092164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.092165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.092166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.092170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.092179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.092182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.092185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.092188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.092192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.092195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.092198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.092201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.092204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.092207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.092209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.092212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.092215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.092222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.092228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.092234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.092240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.092245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.092249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.092253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.092257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.092262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.092266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.092270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.092274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.092278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.092282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.092286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.092293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.092297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.092301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.092304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.092310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.092314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.092318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.092321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.092325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.092329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.092332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.092336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.092340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.092371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:14.097424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:14.098349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:14.098355Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:14.098357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:14.098361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:14.098386Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1603 [2:7556255941169450283:4993]
2025-10-01T14:12:14.098406Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:14.098425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:14.098428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:14.098432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:14.098434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:14.098452Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:14.098458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:14.098464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:14.098523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.098525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.098528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.098531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:14.098533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:14.098611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:14.098614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.098627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.098636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.098650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:14.098668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255941169450278:4993]
2025-10-01T14:12:14.098671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255941169450278:4993]
2025-10-01T14:12:14.098673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255941169450278:4993]
2025-10-01T14:12:14.098687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:14.098706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:14.098720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:14.098724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:14.098765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255941169450278:4993]
2025-10-01T14:12:14.098768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:14.099713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1603
2025-10-01T14:12:14.099758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1603
2025-10-01T14:12:14.099089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:14.099096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:14.099098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:14.099104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:14.102912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546336719:7958], now have 1 active actors on pipe
2025-10-01T14:12:14.102926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546336655:2446], now have 1 active actors on pipe
2025-10-01T14:12:14.102955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.102962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.102994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:14.103005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:14.103011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:14.103014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:14.103027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:14.103044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:14.103064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:14.105076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.105091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.105123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:14.105297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1604 partition: 0 MaxSeqNo: 45 sessionId: src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0
2025-10-01T14:12:14.106590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|664a2f0c-e94870f7-d87a9986-2de6d428_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:14.109575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0] Write session: try to update token
2025-10-01T14:12:14.109593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:14.127385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255943546336922:7971]
2025-10-01T14:12:14.130749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546336922:7971], now have 1 active actors on pipe
2025-10-01T14:12:14.133208Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:14.133213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:14.133216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:14.133218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:14.133228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255941169450278:4993]
2025-10-01T14:12:14.133233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255941169450278:4993]
2025-10-01T14:12:14.133237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255941169450278:4993]
2025-10-01T14:12:14.133291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:14.133298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.133300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:14.133465Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:14.134686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:14.134702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:14.134706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:14.135030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1603, pipe: [1:7556255943546336922:7971]
2025-10-01T14:12:14.137907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1604 sessionId: src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:14.140626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:14.335009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:14.335529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.335539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.342228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:14.342287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255943546336922:7971]
2025-10-01T14:12:14.337675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:14.355347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:14.355465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1604 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0
2025-10-01T14:12:14.355701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1604 sessionId: src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0 is DEAD
2025-10-01T14:12:14.356192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:14.356201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0] Write session will restart in 0.007492s
2025-10-01T14:12:14.356230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0] Write session: Do CDS request
2025-10-01T14:12:14.356236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:14.366605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:14.366935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:14.366948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1605
2025-10-01T14:12:14.367094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:14.367121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:14.367126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:14.367130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:14.367509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1605 sessionId:  describe result for acl check
2025-10-01T14:12:14.367538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:14.367541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:14.367542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:14.367547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255943546336961:7950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:14.368130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255943546336961:7950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:14.372694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255943546336961:7950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:14.383473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255943546336961:7950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:14.383489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255943546336961:7950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:14.383492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255943546336961:7950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:14.383501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:14.423956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:14.429864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:14.430237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:14.430242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:14.430258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:14.430321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:14.430362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255941169450478:4983]
2025-10-01T14:12:14.430998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:14.432309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:14.432361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:14.432722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:14.432924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.432926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.432927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.432929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.432930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.432931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.432933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.432934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.432935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.432936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.432937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.432938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.432939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.432940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.432946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.432957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.432960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.432964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.432967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.432970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.432973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.432977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.432980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.432985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.432988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.432991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.432994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.432997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.433007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.433014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.433021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.433025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.433029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.433034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.433040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.433044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.433048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.433051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.433055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.433059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.433065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.433070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.433073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.433077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.433081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.433085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.433090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.433093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.433097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.433102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.433105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.433111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.433115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.433119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.433123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.433127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.433160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:14.439368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:14.440238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:14.440245Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:14.440247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:14.440251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:14.440259Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1604 [2:7556255941169450478:4983]
2025-10-01T14:12:14.440277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:14.440297Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:14.440301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:14.440305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:14.440307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:14.440328Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:14.440333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:14.440341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:14.440409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.440411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.440413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.440416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:14.440419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:14.440499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:14.440502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.440516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.440527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.440540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:14.440557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255941169450472:4983]
2025-10-01T14:12:14.440560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255941169450472:4983]
2025-10-01T14:12:14.440562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255941169450472:4983]
2025-10-01T14:12:14.440576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:14.440590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:14.440603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:14.440607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:14.440650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255941169450472:4983]
2025-10-01T14:12:14.440669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:14.441069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:14.441078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:14.441080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:14.441085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:14.441842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546337019:7950], now have 1 active actors on pipe
2025-10-01T14:12:14.441853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546336945:2446], now have 1 active actors on pipe
2025-10-01T14:12:14.439783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255943546337232:7971]
2025-10-01T14:12:14.444048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1604
2025-10-01T14:12:14.444081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1604
2025-10-01T14:12:14.446139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.446163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.446192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546337232:7971], now have 1 active actors on pipe
2025-10-01T14:12:14.446213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:14.446229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:14.446235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:14.446238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:14.446252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:14.446272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:14.446298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:14.446074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1604, pipe: [1:7556255943546337232:7971]
2025-10-01T14:12:14.451519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.451541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.451581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:14.451804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1605 partition: 0 MaxSeqNo: 45 sessionId: src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0
2025-10-01T14:12:14.452277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ebc9263c-e470eaf9-5ff2f489-4cb3b41e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:14.455387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0] Write session: try to update token
2025-10-01T14:12:14.455410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:14.485328Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:14.485350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:14.485353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:14.485355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:14.485365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255941169450472:4983]
2025-10-01T14:12:14.485370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255941169450472:4983]
2025-10-01T14:12:14.485380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255941169450472:4983]
2025-10-01T14:12:14.485433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:14.485440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.485442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:14.485596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:14.487359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:14.487373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:14.487379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:14.490460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1605 sessionId: src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:14.493418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:14.667817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:14.668166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.668185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.670686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:14.674716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:14.674758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:14.674778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255943546337232:7971]
2025-10-01T14:12:14.674842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1605 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0
2025-10-01T14:12:14.675013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1605 sessionId: src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0 is DEAD
2025-10-01T14:12:14.679217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:14.679229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0] Write session will restart in 0.006794s
2025-10-01T14:12:14.679256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0] Write session: Do CDS request
2025-10-01T14:12:14.679262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:14.691626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:14.698453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:14.698467Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1606
2025-10-01T14:12:14.698740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:14.698769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:14.698776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:14.698780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:14.702725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1606 sessionId:  describe result for acl check
2025-10-01T14:12:14.702764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:14.702766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:14.702767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:14.702773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255943546337311:7940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:14.703293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255943546337311:7940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:14.713512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255943546337311:7940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:14.719895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255943546337311:7940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:14.719912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255943546337311:7940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:14.719916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255943546337311:7940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:14.719925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:14.732566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:14.733626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:14.733839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:14.733844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:14.733855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:14.733913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:14.733950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255941169450682:4976]
2025-10-01T14:12:14.734576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:14.735101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:14.735148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:14.735589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:14.735663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.735664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.735666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.735667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.735668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.735669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.735671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.735672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.735673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.735674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.735675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.735676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.735677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.735678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.735684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.735693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.735697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.735701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.735704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.735708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.735711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.735715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.735718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.735722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.735725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.735729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.735732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.735736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.735755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.735763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.735769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.735774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.735778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.735783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.735841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.735846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.735850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.735855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.735859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.735864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.735869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.735874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.735878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.735883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.735887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.735893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.735897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.735902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.735906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.735911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.735914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.735919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.735923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.735928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.735931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.735936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.735974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:14.746278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:14.746959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:14.746975Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:14.746978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:14.746981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:14.746988Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1605 [2:7556255941169450682:4976]
2025-10-01T14:12:14.747009Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:14.747027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:14.747030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:14.747034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:14.747037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:14.747054Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:14.747060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:14.747065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:14.747122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.747124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.747126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.747129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:14.747131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:14.747737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:14.747742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.747757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.747767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.747783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:14.747803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255941169450677:4976]
2025-10-01T14:12:14.747805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255941169450677:4976]
2025-10-01T14:12:14.747807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255941169450677:4976]
2025-10-01T14:12:14.747817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:14.747833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:14.747847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:14.747850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:14.747889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255941169450677:4976]
2025-10-01T14:12:14.747890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:14.747892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:14.747892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:14.747893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:14.747898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:14.747921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546337246:2446], now have 1 active actors on pipe
2025-10-01T14:12:14.747924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546337461:7940], now have 1 active actors on pipe
2025-10-01T14:12:14.748217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1605
2025-10-01T14:12:14.748261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1605
2025-10-01T14:12:14.748780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.748794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.748823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|531cd39c-13687316-c03c3009-ed66d4e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:14.748831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:14.748836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:14.748839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:14.748849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:14.748863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:14.748880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:14.752236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.752251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.752286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:14.754279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1606 partition: 0 MaxSeqNo: 45 sessionId: src_id|531cd39c-13687316-c03c3009-ed66d4e7_0
2025-10-01T14:12:14.755523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18ea854d-1b4e654f-3dba64d8-5f372e71_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|531cd39c-13687316-c03c3009-ed66d4e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:14.758415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|531cd39c-13687316-c03c3009-ed66d4e7_0] Write session: try to update token
2025-10-01T14:12:14.758433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|531cd39c-13687316-c03c3009-ed66d4e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:14.773300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255943546337515:7971]
2025-10-01T14:12:14.774345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546337515:7971], now have 1 active actors on pipe
2025-10-01T14:12:14.774472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1605, pipe: [1:7556255943546337515:7971]
2025-10-01T14:12:14.783448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:14.783468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:14.783471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:14.783476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:14.783487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255941169450677:4976]
2025-10-01T14:12:14.783492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255941169450677:4976]
2025-10-01T14:12:14.783496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255941169450677:4976]
2025-10-01T14:12:14.783546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:14.783553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.783556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:14.783695Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:14.786526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:14.786543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:14.786549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:14.792726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1606 sessionId: src_id|531cd39c-13687316-c03c3009-ed66d4e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:14.795411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:14.946020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:14.946853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.946881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.947383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:14.951115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:14.951170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255943546337515:7971]
2025-10-01T14:12:14.951192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:14.951273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1606 reason: status is not ok: tablet will be restarted right now sessionId: src_id|531cd39c-13687316-c03c3009-ed66d4e7_0
2025-10-01T14:12:14.951450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1606 sessionId: src_id|531cd39c-13687316-c03c3009-ed66d4e7_0 is DEAD
2025-10-01T14:12:14.953260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531cd39c-13687316-c03c3009-ed66d4e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:14.953276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531cd39c-13687316-c03c3009-ed66d4e7_0] Write session will restart in 0.007217s
2025-10-01T14:12:14.953308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531cd39c-13687316-c03c3009-ed66d4e7_0] Write session: Do CDS request
2025-10-01T14:12:14.953316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531cd39c-13687316-c03c3009-ed66d4e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:14.963131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|531cd39c-13687316-c03c3009-ed66d4e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:14.963566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:14.963584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1607
2025-10-01T14:12:14.963738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:14.963770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:14.963784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:14.963788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:14.964168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1607 sessionId:  describe result for acl check
2025-10-01T14:12:14.964211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:14.964213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:14.964215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:14.964220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255943546337539:7939] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:14.964843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255943546337539:7939] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:14.968072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255943546337539:7939] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:14.972260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255943546337539:7939] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:14.972276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255943546337539:7939] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:14.972279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255943546337539:7939] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:14.972288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:14.980768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:14.982619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:14.982826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:14.982830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:14.982841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:14.982882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:14.982919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255941169450887:4951]
2025-10-01T14:12:14.983572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:14.984732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:14.984785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:14.985109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:14.985161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.985163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.985164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.985165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.985166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.985167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.985168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.985170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.985171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.985173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.985174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.985175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.985176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.985177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.985182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.985193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.985197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.985201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.985205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.985209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.985212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.985216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.985220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.985224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.985228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.985231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.985235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.985239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.985246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.985253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:14.985259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.985265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:14.985269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.985274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:14.985278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.985284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:14.985289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.985294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:14.985298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.985303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:14.985308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.985313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:14.985317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.985322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:14.985329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.985335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:14.985340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.985345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.985350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.985354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.985358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.985362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.985365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.985370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:14.985374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.985379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:14.985417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:14.990518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:14.991145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:14.991150Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:14.991153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:14.991157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:14.991165Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1606 [2:7556255941169450887:4951]
2025-10-01T14:12:14.991183Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:14.991203Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:14.991207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:14.991210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:14.991213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:14.991230Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:14.991236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:14.991243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:14.991311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.991314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.991317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.991321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:14.991324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:14.991405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:14.991418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:14.991431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:14.991442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:14.991460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:14.991478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255941169450882:4951]
2025-10-01T14:12:14.991480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255941169450882:4951]
2025-10-01T14:12:14.991483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255941169450882:4951]
2025-10-01T14:12:14.991496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:14.991503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:14.991507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:14.991510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:14.991526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546337525:2446], now have 1 active actors on pipe
2025-10-01T14:12:14.991540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:14.991569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:14.991575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:14.991582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255943546337641:7939], now have 1 active actors on pipe
2025-10-01T14:12:14.991625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255941169450882:4951]
2025-10-01T14:12:14.991636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:14.991647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:14.991791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1606
2025-10-01T14:12:14.991833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1606
2025-10-01T14:12:14.992018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.992029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.992056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|970fc15d-6346a057-200a6568-c38069da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:14.992064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:14.992068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:14.992072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:14.992083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:14.992100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:14.992117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:14.992354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:14.992357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:14.992371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:14.993887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1607 partition: 0 MaxSeqNo: 45 sessionId: src_id|970fc15d-6346a057-200a6568-c38069da_0
2025-10-01T14:12:14.994277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|531cd39c-13687316-c03c3009-ed66d4e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|970fc15d-6346a057-200a6568-c38069da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:14.997219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|970fc15d-6346a057-200a6568-c38069da_0] Write session: try to update token
2025-10-01T14:12:14.997239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|970fc15d-6346a057-200a6568-c38069da_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:15.011293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:15.011318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:15.011331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255941169450882:4951]
2025-10-01T14:12:15.011385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:15.012403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:15.013123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:15.013293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:15.013446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:15.013659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:15.013729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:15.013847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:15.030745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1607 sessionId: src_id|970fc15d-6346a057-200a6568-c38069da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:15.033875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:15.035558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:15.035586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:15.035589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:15.035591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:15.035603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255941169450882:4951]
2025-10-01T14:12:15.035608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255941169450882:4951]
2025-10-01T14:12:15.035613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255941169450882:4951]
2025-10-01T14:12:15.035664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:15.035672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.035674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:15.035824Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:15.038532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:15.038539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:15.038542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:15.053112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255947841305091:7971]
2025-10-01T14:12:15.053620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1606, pipe: [1:7556255947841305091:7971]
2025-10-01T14:12:15.199958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:15.200583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.200606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.200634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305091:7971], now have 1 active actors on pipe
2025-10-01T14:12:15.200897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:15.201981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:15.202065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1607 reason: status is not ok: tablet will be restarted right now sessionId: src_id|970fc15d-6346a057-200a6568-c38069da_0
2025-10-01T14:12:15.202261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1607 sessionId: src_id|970fc15d-6346a057-200a6568-c38069da_0 is DEAD
2025-10-01T14:12:15.202407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970fc15d-6346a057-200a6568-c38069da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:15.202420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970fc15d-6346a057-200a6568-c38069da_0] Write session will restart in 0.009953s
2025-10-01T14:12:15.202457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970fc15d-6346a057-200a6568-c38069da_0] Write session: Do CDS request
2025-10-01T14:12:15.202464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970fc15d-6346a057-200a6568-c38069da_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:15.202474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:15.202516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255947841305091:7971]
2025-10-01T14:12:15.214027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|970fc15d-6346a057-200a6568-c38069da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:15.214335Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:15.214348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1608
2025-10-01T14:12:15.214469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:15.214502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:15.214512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:15.214516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:15.215076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1608 sessionId:  describe result for acl check
2025-10-01T14:12:15.215116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:15.215118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:15.215120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:15.215127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255947841305173:7935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:15.215686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255947841305173:7935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:15.217412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255947841305173:7935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:15.219937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255947841305173:7935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:15.219949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255947841305173:7935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:15.219953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255947841305173:7935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:15.219962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:15.226853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:15.228514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:15.228787Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:15.228801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:15.228815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:15.228882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:15.228938Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255945464418388:4943]
2025-10-01T14:12:15.229607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:15.230072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:15.230138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:15.230516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:15.230602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.230603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.230604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.230605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.230607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.230608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.230610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.230611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.230612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.230613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.230614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.230616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.230617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.230618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.230626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.230638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.230642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.230646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.230649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.230653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.230657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.230661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.230665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.230670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.230675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.230679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.230683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.230687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.230696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.230705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.230711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.230717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.230724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.230730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.230735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.230740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.230745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.230750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.230755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.230760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.230766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.230771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.230775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.230781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.230803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.230809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.230813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.230818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.230825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.230831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.230835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.230840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.230844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.230849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.230854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.230858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.230899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:15.237911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:15.238565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:15.238582Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:15.238587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:15.238591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:15.238599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1607 [2:7556255945464418388:4943]
2025-10-01T14:12:15.238621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:15.238644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:15.238647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:15.238651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:15.238669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:15.238688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:15.238699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:15.238706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:15.238769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.238775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.238778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.238781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:15.238784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:15.238860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:15.238868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.238881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.238892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.238914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:15.238937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255945464418383:4943]
2025-10-01T14:12:15.238943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255945464418383:4943]
2025-10-01T14:12:15.238946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255945464418383:4943]
2025-10-01T14:12:15.238964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:15.238985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305289:7935], now have 1 active actors on pipe
2025-10-01T14:12:15.238993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305099:2446], now have 1 active actors on pipe
2025-10-01T14:12:15.239002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:15.239020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:15.239027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:15.239072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255945464418383:4943]
2025-10-01T14:12:15.239079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:15.239106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1607
2025-10-01T14:12:15.239137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1607
2025-10-01T14:12:15.239291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:15.239298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:15.239300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:15.239306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:15.239499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.239510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.239540Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:15.239553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:15.239562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:15.239569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:15.239579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:15.239592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:15.239613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:15.239851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.239857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.239873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:15.240172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1608 partition: 0 MaxSeqNo: 45 sessionId: src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0
2025-10-01T14:12:15.240572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|970fc15d-6346a057-200a6568-c38069da_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:15.243122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0] Write session: try to update token
2025-10-01T14:12:15.243143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:15.265581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:15.265603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:15.265606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:15.265608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:15.265618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255945464418383:4943]
2025-10-01T14:12:15.265623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255945464418383:4943]
2025-10-01T14:12:15.265630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255945464418383:4943]
2025-10-01T14:12:15.265680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:15.265688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.265698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:15.265721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:15.265727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:15.265731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:15.265909Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:15.269858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1608 sessionId: src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:15.273226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:15.306470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255947841305388:7971]
2025-10-01T14:12:15.307594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1607, pipe: [1:7556255947841305388:7971]
2025-10-01T14:12:15.416475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:15.416900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.416916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.416959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305388:7971], now have 1 active actors on pipe
2025-10-01T14:12:15.417109Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:15.417204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:15.417217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:15.417274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1608 reason: error at write: Disconnected sessionId: src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0
2025-10-01T14:12:15.417482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1608 sessionId: src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0 is DEAD
2025-10-01T14:12:15.417655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255947841305388:7971]
2025-10-01T14:12:15.417674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:15.417686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:15.417701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0] Write session will restart in 0.006710s
2025-10-01T14:12:15.417731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0] Write session: Do CDS request
2025-10-01T14:12:15.417738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:15.425979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:15.426060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:15.426076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1609
2025-10-01T14:12:15.426226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:15.426261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:15.426270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:15.426274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:15.426638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1609 sessionId:  describe result for acl check
2025-10-01T14:12:15.426673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:15.426682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:15.426683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:15.426689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255947841305558:7919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:15.427210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255947841305558:7919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:15.430502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255947841305558:7919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:15.432939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:15.434539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255947841305558:7919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:15.434552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255947841305558:7919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:15.434555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255947841305558:7919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:15.434553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:15.434561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:15.434759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:15.434772Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:15.434785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:15.434856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:15.434896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255945464418579:4941]
2025-10-01T14:12:15.435440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:15.435711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:15.435758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:15.436046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:15.436116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.436123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.436124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.436125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.436126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.436127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.436129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.436130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.436131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.436132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.436133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.436134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.436135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.436136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.436140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.436149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.436152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.436155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.436158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.436161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.436164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.436167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.436170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.436173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.436177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.436180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.436183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.436186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.436193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.436200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.436206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.436210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.436214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.436218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.436222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.436226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.436229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.436233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.436237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.436241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.436245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.436250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.436254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.436258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.436262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.436266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.436270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.436277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.436281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.436286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.436294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.436298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.436302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.436305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.436309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.436313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.436349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:15.440235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:15.441065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:15.441080Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:15.441082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:15.441085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:15.441093Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1608 [2:7556255945464418579:4941]
2025-10-01T14:12:15.441109Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:15.441124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:15.441133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:15.441136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:15.441138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:15.441154Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:15.441165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:15.441171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:15.441233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.441240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.441242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.441245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:15.441247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:15.441311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:15.441319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.441329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.441337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.441351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:15.441369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305398:2446], now have 1 active actors on pipe
2025-10-01T14:12:15.441381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255945464418572:4941]
2025-10-01T14:12:15.441383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255945464418572:4941]
2025-10-01T14:12:15.441385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255945464418572:4941]
2025-10-01T14:12:15.441401Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:15.441410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305671:7919], now have 1 active actors on pipe
2025-10-01T14:12:15.441419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:15.441426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:15.441429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:15.441431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:15.441437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:15.441439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:15.441470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255945464418572:4941]
2025-10-01T14:12:15.441481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:15.441493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1608
2025-10-01T14:12:15.441531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1608
2025-10-01T14:12:15.441516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:15.441603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.441611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.441637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:15.441647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:15.441651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:15.441653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:15.441663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:15.441674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:15.441690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:15.441872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.441884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.441906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:15.441994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1609 partition: 0 MaxSeqNo: 45 sessionId: src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0
2025-10-01T14:12:15.442496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e63d128d-c35c9ce3-4eff547c-c9a75dc8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:15.445764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0] Write session: try to update token
2025-10-01T14:12:15.445787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:15.461709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:15.461729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:15.461732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:15.461733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:15.461744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255945464418572:4941]
2025-10-01T14:12:15.461749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255945464418572:4941]
2025-10-01T14:12:15.461752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255945464418572:4941]
2025-10-01T14:12:15.461801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:15.461805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:15.461808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.461811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:15.461810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:15.461814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:15.461977Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:15.473752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1609 sessionId: src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:15.476839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:15.517742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255947841305700:7971]
2025-10-01T14:12:15.518002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1608, pipe: [1:7556255947841305700:7971]
2025-10-01T14:12:15.605800Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:15.606152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.606164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.606183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305700:7971], now have 1 active actors on pipe
2025-10-01T14:12:15.606413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:15.606519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255947841305700:7971]
2025-10-01T14:12:15.606540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:15.606559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:15.606638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1609 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0
2025-10-01T14:12:15.606857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1609 sessionId: src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0 is DEAD
2025-10-01T14:12:15.606990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:15.607001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0] Write session will restart in 0.008708s
2025-10-01T14:12:15.607028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0] Write session: Do CDS request
2025-10-01T14:12:15.607033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:15.616836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:15.616974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:15.617005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1610
2025-10-01T14:12:15.617216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:15.617254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:15.617266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:15.617271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:15.617788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1610 sessionId:  describe result for acl check
2025-10-01T14:12:15.617836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:15.617838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:15.617839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:15.617844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255947841305910:7899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:15.618408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255947841305910:7899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:15.620180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:15.621114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255947841305910:7899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:15.622251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:15.622476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:15.622486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:15.622497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:15.622546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:15.622585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255945464418779:4928]
2025-10-01T14:12:15.623062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:15.623317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:15.623353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:15.623616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:15.623683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.623689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.623690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.623691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.623692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.623694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.623695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.623696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.623697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.623698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.623700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.623701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.623702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.623703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.623708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.623719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.623723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.623726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.623730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.623734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.623738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.623741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.623745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.623748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.623751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.623755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.623758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.623761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.623768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.623775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.623781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.623787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.623792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.623797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.623802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.623807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.623812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.623822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.623826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.623831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.623837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.623841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.623846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.623850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.623855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.623860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.623864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.623869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.623874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.623881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.623886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.623891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.623895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.623900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.623905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.623910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.623920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255947841305910:7899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:15.623947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:15.623934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255947841305910:7899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:15.623937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255947841305910:7899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:15.623947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:15.627964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:15.629120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:15.629139Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:15.629142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:15.629146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:15.629153Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1609 [2:7556255945464418779:4928]
2025-10-01T14:12:15.629169Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:15.629185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:15.629192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:15.629196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:15.629199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:15.629216Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:15.629225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:15.629232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:15.629316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.629325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.629327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.629330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:15.629332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:15.629403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:15.629411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.629421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.629431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.629449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:15.629473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305970:7899], now have 1 active actors on pipe
2025-10-01T14:12:15.629481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305703:2446], now have 1 active actors on pipe
2025-10-01T14:12:15.629488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255945464418774:4928]
2025-10-01T14:12:15.629490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255945464418774:4928]
2025-10-01T14:12:15.629492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255945464418774:4928]
2025-10-01T14:12:15.629507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:15.629523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:15.629525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:15.629540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:15.629540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:15.629543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:15.629536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1609
2025-10-01T14:12:15.629544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:15.629580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255945464418774:4928]
2025-10-01T14:12:15.629589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:15.629584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1609
2025-10-01T14:12:15.629593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:15.629634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.629638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.629665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:15.629680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:15.629684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:15.629687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:15.629697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:15.629707Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:15.629725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:15.629894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.629902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.629914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:15.630009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1610 partition: 0 MaxSeqNo: 45 sessionId: src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0
2025-10-01T14:12:15.630322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7381f7a2-a3988ddb-8542ea04-c18d3e3c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:15.633656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0] Write session: try to update token
2025-10-01T14:12:15.633677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:15.652773Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:15.652792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:15.652794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:15.652796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:15.652805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255945464418774:4928]
2025-10-01T14:12:15.652810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255945464418774:4928]
2025-10-01T14:12:15.652813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255945464418774:4928]
2025-10-01T14:12:15.652852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:15.652858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.652860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:15.652864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:15.652870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:15.652873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:15.652893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1610 sessionId: src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:15.653008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:15.655181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:15.706664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255947841305979:7971]
2025-10-01T14:12:15.707012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1609, pipe: [1:7556255947841305979:7971]
2025-10-01T14:12:15.800061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:15.800074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:15.800137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1610 reason: error at write: Disconnected sessionId: src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0
2025-10-01T14:12:15.800343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1610 sessionId: src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0 is DEAD
2025-10-01T14:12:15.799545Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:15.799799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.799807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.799853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305979:7971], now have 1 active actors on pipe
2025-10-01T14:12:15.800228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:15.800412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255947841305979:7971]
2025-10-01T14:12:15.800447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:15.800531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:15.800544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0] Write session will restart in 0.005406s
2025-10-01T14:12:15.800573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0] Write session: Do CDS request
2025-10-01T14:12:15.800579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:15.810989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:15.812031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:15.812049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1611
2025-10-01T14:12:15.812222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:15.812262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:15.812268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:15.812272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:15.812714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1611 sessionId:  describe result for acl check
2025-10-01T14:12:15.812748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:15.812754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:15.812756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:15.812763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255947841306001:7904] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:15.813220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255947841306001:7904] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:15.819192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255947841306001:7904] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:15.827970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255947841306001:7904] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:15.827988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255947841306001:7904] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:15.827992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255947841306001:7904] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:15.828001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:15.857527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:15.860434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:15.860719Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:15.860724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:15.860737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:15.860801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:15.860852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255945464419002:4916]
2025-10-01T14:12:15.861592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:15.861981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:15.862047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:15.862448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:15.862542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.862549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.862551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.862553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.862554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.862556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.862558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.862560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.862561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.862563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.862564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.862565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.862567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.862568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.862575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.862585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.862588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.862592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.862595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.862599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.862603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.862607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.862611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.862615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.862619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.862623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.862626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.862630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.862642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.862651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:15.862658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.862665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:15.862670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.862675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:15.862680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.862686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:15.862692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.862699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:15.862703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.862708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:15.862713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.862720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:15.862724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.862737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:15.862743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.862753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:15.862757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.862770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.862781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.862789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.862799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.862804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.862810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.862819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:15.862824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.862835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:15.862883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:15.868906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:15.869977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:15.870002Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:15.870005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:15.870009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:15.870018Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1610 [2:7556255945464419002:4916]
2025-10-01T14:12:15.870036Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:15.870058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:15.870062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:15.870066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:15.870068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:15.870090Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:15.870103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:15.870109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:15.870203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.870212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.870215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.870218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:15.870222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:15.870296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:15.870307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.870320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:15.870326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:15.870335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:15.870351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841306076:7904], now have 1 active actors on pipe
2025-10-01T14:12:15.870354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841305985:2446], now have 1 active actors on pipe
2025-10-01T14:12:15.870360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255945464418997:4916]
2025-10-01T14:12:15.870362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255945464418997:4916]
2025-10-01T14:12:15.870364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255945464418997:4916]
2025-10-01T14:12:15.870397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:15.870412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:15.870423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:15.870426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:15.870463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255945464418997:4916]
2025-10-01T14:12:15.870471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:15.870499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1610
2025-10-01T14:12:15.870549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1610
2025-10-01T14:12:15.870500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:15.870514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:15.870520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:15.870529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:15.870715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.870737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.870786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:15.870803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:15.870815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:15.870824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:15.870837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:15.870860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:15.870885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:15.872406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:15.872426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:15.872454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:15.872590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1611 partition: 0 MaxSeqNo: 45 sessionId: src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0
2025-10-01T14:12:15.872966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab65af23-b78fa9da-c6518f90-48c0a15_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:15.875798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0] Write session: try to update token
2025-10-01T14:12:15.875822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:15.900748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255947841306261:7971]
2025-10-01T14:12:15.902465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1610, pipe: [1:7556255947841306261:7971]
2025-10-01T14:12:15.903035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255947841306261:7971], now have 1 active actors on pipe
2025-10-01T14:12:15.903063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:15.903067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:15.903079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255945464418997:4916]
2025-10-01T14:12:15.903132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:15.903133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:15.903621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:15.903795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:15.904180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:15.904702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:15.905201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:15.905253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:15.916213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:15.916236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:15.916239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:15.916241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:15.916257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255945464418997:4916]
2025-10-01T14:12:15.916261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255945464418997:4916]
2025-10-01T14:12:15.916265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255945464418997:4916]
2025-10-01T14:12:15.916324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:15.916331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:15.916333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:15.916492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:15.917605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:15.917623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:15.917627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:15.928832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1611 sessionId: src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:15.932666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:16.067291Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:16.067603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.067614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.068510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:16.068522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0] Write session will restart in 0.005894s
2025-10-01T14:12:16.067998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:16.068012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:16.068049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:16.068548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0] Write session: Do CDS request
2025-10-01T14:12:16.068564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:16.068097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255947841306261:7971]
2025-10-01T14:12:16.068111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1611 reason: error at write: Disconnected sessionId: src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0
2025-10-01T14:12:16.068307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1611 sessionId: src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0 is DEAD
2025-10-01T14:12:16.068146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:16.075919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.076042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:16.076055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1612
2025-10-01T14:12:16.076216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.076254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:16.076265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:16.076269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:16.076781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1612 sessionId:  describe result for acl check
2025-10-01T14:12:16.076830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:16.076837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:16.076839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:16.076845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255952136273651:7890] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:16.077655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255952136273651:7890] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:16.080013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255952136273651:7890] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:16.082444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:16.082660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255952136273651:7890] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:16.082671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255952136273651:7890] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:16.082674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255952136273651:7890] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:16.082682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:16.089432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:16.089630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:16.089639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:16.089648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:16.089686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:16.089718Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255949759386507:4914]
2025-10-01T14:12:16.090130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:16.090403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:16.090436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:16.090644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:16.090686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.090691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.090691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.090692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.090693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.090694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.090695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.090696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.090697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.090697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.090698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.090699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.090700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.090700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.090704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.090709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.090711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.090714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.090716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.090718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.090721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.090723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.090725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.090731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.090735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.090738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.090741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.090744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.090753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.090760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.090766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.090771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.090774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.090777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.090780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.090783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.090787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.090792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.090796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.090800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.090805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.090810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.090814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.090818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.090822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.090828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.090831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.090836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.090840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.090845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.090849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.090854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.090860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.090864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.090868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.090871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.090891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:16.095526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:16.096141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:16.096158Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:16.096161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:16.096166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:16.096173Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1611 [2:7556255949759386507:4914]
2025-10-01T14:12:16.096191Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:16.096209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:16.096216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.096220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.096222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.096239Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:16.096248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:16.096255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:16.096323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.096331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.096333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.096336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:16.096338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:16.096407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:16.096415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.096426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.096438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.096458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:16.096478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255949759386501:4914]
2025-10-01T14:12:16.096485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255949759386501:4914]
2025-10-01T14:12:16.096487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255949759386501:4914]
2025-10-01T14:12:16.096501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:16.096520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:16.096539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:16.096545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:16.096547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:16.096551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:16.096553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:16.096579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255949759386501:4914]
2025-10-01T14:12:16.096585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:16.096631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:16.096703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136273563:2446], now have 1 active actors on pipe
2025-10-01T14:12:16.096712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136273830:7890], now have 1 active actors on pipe
2025-10-01T14:12:16.096805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1611
2025-10-01T14:12:16.096854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1611
2025-10-01T14:12:16.096907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.096917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.096939Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a79761c4-582fc8aa-614a645c-3661bbea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:16.096946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.096951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.096953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:16.096965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.096974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:16.096989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.097203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.097214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.097238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.097378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1612 partition: 0 MaxSeqNo: 45 sessionId: src_id|a79761c4-582fc8aa-614a645c-3661bbea_0
2025-10-01T14:12:16.097728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db24db39-4de8fe5d-ae43b7e-e4e2a545_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a79761c4-582fc8aa-614a645c-3661bbea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:16.100204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a79761c4-582fc8aa-614a645c-3661bbea_0] Write session: try to update token
2025-10-01T14:12:16.100221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a79761c4-582fc8aa-614a645c-3661bbea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:16.118007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1612 sessionId: src_id|a79761c4-582fc8aa-614a645c-3661bbea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:16.120181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:16.120682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.120714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.120758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:16.120856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:16.125977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:16.126007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:16.126009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:16.126011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:16.126022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255949759386501:4914]
2025-10-01T14:12:16.126028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255949759386501:4914]
2025-10-01T14:12:16.126032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255949759386501:4914]
2025-10-01T14:12:16.126096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:16.126102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:16.126110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.126110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:16.126112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:16.126119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:16.126281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:16.168514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255952136273842:7971]
2025-10-01T14:12:16.168805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1611, pipe: [1:7556255952136273842:7971]
2025-10-01T14:12:16.263411Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:16.270220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.270249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.270415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.270470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.270532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.270591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.270641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.270650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.270709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.270761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.270813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.270868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.270909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.270916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.270968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.271017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.271069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.271118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.271155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.271161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.271216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.271277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.271337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.271399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.271446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.271461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.271524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.271577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.271629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.271679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.271734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.271740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.271793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.271845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.271900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.271955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.272000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.272006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.272063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.272112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.272163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.272218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.272267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.272275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.272335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.272393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.272448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.272506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.272550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.272559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.272625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.272694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.272754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.272817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.272864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.272873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.272941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.273001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.273059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.273117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.273164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.273172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.273228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136273842:7971], now have 1 active actors on pipe
2025-10-01T14:12:16.273504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255952136273842:7971]
2025-10-01T14:12:16.273520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:16.273533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:16.273536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:16.273556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1612 reason: error at write: Disconnected sessionId: src_id|a79761c4-582fc8aa-614a645c-3661bbea_0
2025-10-01T14:12:16.273751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1612 sessionId: src_id|a79761c4-582fc8aa-614a645c-3661bbea_0 is DEAD
2025-10-01T14:12:16.273896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a79761c4-582fc8aa-614a645c-3661bbea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:16.273906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a79761c4-582fc8aa-614a645c-3661bbea_0] Write session will restart in 0.005521s
2025-10-01T14:12:16.273931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a79761c4-582fc8aa-614a645c-3661bbea_0] Write session: Do CDS request
2025-10-01T14:12:16.273936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a79761c4-582fc8aa-614a645c-3661bbea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:16.274317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:16.280978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a79761c4-582fc8aa-614a645c-3661bbea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.281057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:16.281071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1613
2025-10-01T14:12:16.281266Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.281309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:16.281320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:16.281324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:16.281696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1613 sessionId:  describe result for acl check
2025-10-01T14:12:16.281728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:16.281734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:16.281736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:16.281742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255952136273986:7889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:16.282257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255952136273986:7889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:16.284354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255952136273986:7889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:16.285984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:16.287528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:16.287706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:16.287719Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:16.287729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:16.287774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:16.287813Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255949759386700:4911]
2025-10-01T14:12:16.287860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255952136273986:7889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:16.287872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255952136273986:7889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:16.287876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255952136273986:7889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:16.287883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:16.288419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:16.288642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:16.288689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:16.288976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:16.289025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.289031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.289032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.289033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.289034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.289039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.289040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.289041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.289043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.289044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.289045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.289047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.289048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.289049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.289055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.289064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.289068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.289077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.289081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.289090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.289094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.289102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.289106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.289114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.289122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.289126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.289130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.289134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.289142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.289153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.289163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.289169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.289177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.289183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.289191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.289200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.289208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.289217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.289226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.289231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.289239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.289248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.289256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.289264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.289273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.289281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.289289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.289294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.289302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.289311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.289319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.289328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.289333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.289338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.289342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.289352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.289389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:16.295412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:16.296027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:16.296043Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:16.296046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:16.296049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:16.296057Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1612 [2:7556255949759386700:4911]
2025-10-01T14:12:16.296072Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:16.296095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:16.296098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.296102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.296105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.296121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:16.296131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:16.296138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:16.296193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.296200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.296202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.296206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:16.296209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:16.296420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1612
2025-10-01T14:12:16.296430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1612
2025-10-01T14:12:16.296555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:16.296563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.296576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.296593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.296616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:16.296638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136273857:2446], now have 1 active actors on pipe
2025-10-01T14:12:16.296645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136274125:7889], now have 1 active actors on pipe
2025-10-01T14:12:16.296679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.296688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.296706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255949759386695:4911]
2025-10-01T14:12:16.296712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255949759386695:4911]
2025-10-01T14:12:16.296715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255949759386695:4911]
2025-10-01T14:12:16.296728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:16.296745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:16.296746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:16.296754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:16.296756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:16.296762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:16.296765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:16.296784Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f57ea90-651c1bc3-e74a345c-db431405_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:16.296794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.296798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.296800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:16.296809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.296818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:16.296859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255949759386695:4911]
2025-10-01T14:12:16.296871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:16.296876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:16.296882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.297047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.297055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.297069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.297139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1613 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f57ea90-651c1bc3-e74a345c-db431405_0
2025-10-01T14:12:16.297600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a79761c4-582fc8aa-614a645c-3661bbea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f57ea90-651c1bc3-e74a345c-db431405_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:16.300227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f57ea90-651c1bc3-e74a345c-db431405_0] Write session: try to update token
2025-10-01T14:12:16.300248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f57ea90-651c1bc3-e74a345c-db431405_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:16.311575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:16.311598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:16.311608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255949759386695:4911]
2025-10-01T14:12:16.311647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:16.311674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:16.311815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:16.311961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:16.312090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:16.312222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:16.312444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:16.312495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:16.314458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1613 sessionId: src_id|2f57ea90-651c1bc3-e74a345c-db431405_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:16.317109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:16.317321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.317344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.317378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:16.317493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:16.334801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:16.334822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:16.334824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:16.334826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:16.334838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255949759386695:4911]
2025-10-01T14:12:16.334842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255949759386695:4911]
2025-10-01T14:12:16.334846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255949759386695:4911]
2025-10-01T14:12:16.334887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:16.334898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:16.334904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:16.334906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.334909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:16.334909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:16.335038Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:16.373794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255952136274138:7971]
2025-10-01T14:12:16.374041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1612, pipe: [1:7556255952136274138:7971]
2025-10-01T14:12:16.481629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:16.488410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.488433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.488566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.488619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.488699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.488763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.488804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.488811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.488873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.488925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.488974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.489027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.489073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.489081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.489135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.489184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.489235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.489287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.489327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.489332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.489389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.489464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.489530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.489597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.489644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.489651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.489707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.489758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.489837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.489891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.489951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.489957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.490012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.490070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.490140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.490200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.490241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.490246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.490301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.490351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.490428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.490485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.490531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.490537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.490600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.490652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.490708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.490771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.490820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.490825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.490885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.491003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.491114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.491170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.491222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.491227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.491280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.491328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.491378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.491429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.491475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.491480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.491521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136274138:7971], now have 1 active actors on pipe
2025-10-01T14:12:16.491744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:16.491792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:16.491800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:16.491824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1613 reason: error at write: Disconnected sessionId: src_id|2f57ea90-651c1bc3-e74a345c-db431405_0
2025-10-01T14:12:16.492012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1613 sessionId: src_id|2f57ea90-651c1bc3-e74a345c-db431405_0 is DEAD
2025-10-01T14:12:16.492132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f57ea90-651c1bc3-e74a345c-db431405_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:16.492141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f57ea90-651c1bc3-e74a345c-db431405_0] Write session will restart in 0.009248s
2025-10-01T14:12:16.492159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f57ea90-651c1bc3-e74a345c-db431405_0] Write session: Do CDS request
2025-10-01T14:12:16.492164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f57ea90-651c1bc3-e74a345c-db431405_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:16.492215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255952136274138:7971]
2025-10-01T14:12:16.492369Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:16.502716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:16.502824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f57ea90-651c1bc3-e74a345c-db431405_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.503096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:16.503107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1614
2025-10-01T14:12:16.503208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.503238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:16.503246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:16.503249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:16.503648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1614 sessionId:  describe result for acl check
2025-10-01T14:12:16.503677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:16.503683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:16.503685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:16.503689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255952136274409:7867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:16.504043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:16.504154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255952136274409:7867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:16.504164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:16.504171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:16.504178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:16.504205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:16.504239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255949759386903:4905]
2025-10-01T14:12:16.504630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:16.504826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:16.504851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:16.505052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:16.505087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.505091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.505092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.505093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.505093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.505094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.505095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.505095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.505096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.505096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.505097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.505097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.505098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.505099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.505102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.505107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.505109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.505111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.505113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.505116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.505118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.505120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.505122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.505124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.505126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.505128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.505130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.505132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.505136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.505140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.505144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.505147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.505149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.505152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.505155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.505157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.505160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.505162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.505164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.505167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.505169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.505172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.505175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.505177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.505180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.505182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.505185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.505188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.505190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.505192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.505195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.505198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.505200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.505203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.505206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.505208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.505229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:16.505884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255952136274409:7867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:16.508516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255952136274409:7867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:16.508528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255952136274409:7867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:16.508530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255952136274409:7867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:16.508536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:16.508679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:16.509295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:16.509312Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:16.509314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:16.509318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:16.509324Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1613 [2:7556255949759386903:4905]
2025-10-01T14:12:16.509337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:16.509352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:16.509356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.509359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.509361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.509375Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:16.509382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:16.509403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:16.509451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.509458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.509460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.509463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:16.509465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:16.509527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:16.509535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.509546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.509557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.509573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:16.509591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255949759386897:4905]
2025-10-01T14:12:16.509597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255949759386897:4905]
2025-10-01T14:12:16.509599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255949759386897:4905]
2025-10-01T14:12:16.509611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:16.509619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:16.509623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136274443:7867], now have 1 active actors on pipe
2025-10-01T14:12:16.509627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136274162:2446], now have 1 active actors on pipe
2025-10-01T14:12:16.509627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:16.509628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:16.509634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:16.509647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:16.509655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:16.509653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1613
2025-10-01T14:12:16.509666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1613
2025-10-01T14:12:16.509684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255949759386897:4905]
2025-10-01T14:12:16.509694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:16.509698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:16.509708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.509716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.509754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b551b27b-f0f24743-a5111941-f66ed65e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:16.509762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.509765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.509767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:16.509775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.509787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:16.509809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.509935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.509942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.509953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.510014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1614 partition: 0 MaxSeqNo: 45 sessionId: src_id|b551b27b-f0f24743-a5111941-f66ed65e_0
2025-10-01T14:12:16.510331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f57ea90-651c1bc3-e74a345c-db431405_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b551b27b-f0f24743-a5111941-f66ed65e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:16.512622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b551b27b-f0f24743-a5111941-f66ed65e_0] Write session: try to update token
2025-10-01T14:12:16.512642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b551b27b-f0f24743-a5111941-f66ed65e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:16.525705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1614 sessionId: src_id|b551b27b-f0f24743-a5111941-f66ed65e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:16.528173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:16.528358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.528378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.528415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:16.528485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:16.530192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:16.530211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:16.530213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:16.530215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:16.530221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255949759386897:4905]
2025-10-01T14:12:16.530225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255949759386897:4905]
2025-10-01T14:12:16.530229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255949759386897:4905]
2025-10-01T14:12:16.530262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:16.530266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.530268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:16.530284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:16.530296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:16.530300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:16.530414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:16.592436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255952136274452:7971]
2025-10-01T14:12:16.592714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1613, pipe: [1:7556255952136274452:7971]
2025-10-01T14:12:16.674207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:16.682646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.682680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.685963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:16.685995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:16.686001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:16.686018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255952136274452:7971]
2025-10-01T14:12:16.686047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1614 reason: error at write: Disconnected sessionId: src_id|b551b27b-f0f24743-a5111941-f66ed65e_0
2025-10-01T14:12:16.686274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1614 sessionId: src_id|b551b27b-f0f24743-a5111941-f66ed65e_0 is DEAD
2025-10-01T14:12:16.682857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.682922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.682979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.683039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.683079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.683087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.683161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.683227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.683290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.683384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.683426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.683429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.683491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.683541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.683593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.683645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.683681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.683684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.683745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.683801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.683853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.683919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.683960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.683963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.686511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551b27b-f0f24743-a5111941-f66ed65e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:16.686534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551b27b-f0f24743-a5111941-f66ed65e_0] Write session will restart in 0.006557s
2025-10-01T14:12:16.686561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551b27b-f0f24743-a5111941-f66ed65e_0] Write session: Do CDS request
2025-10-01T14:12:16.686568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551b27b-f0f24743-a5111941-f66ed65e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:16.684021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.684073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.684130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.684188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.684226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.684229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.684288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.684339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.684400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.684465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.684506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.684509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.684578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.684638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.684712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.684768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.684807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.684809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.684873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.684925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.684979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.685039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.685079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.685082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.685148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.685206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.685265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.685330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.685378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.685380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.685443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:16.685498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:16.685558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:16.685619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:16.685667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:16.685670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:16.685752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136274452:7971], now have 1 active actors on pipe
2025-10-01T14:12:16.687170Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:16.693931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b551b27b-f0f24743-a5111941-f66ed65e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.694696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:16.694710Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1615
2025-10-01T14:12:16.694801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.694840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:16.694851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:16.694856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:16.695283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1615 sessionId:  describe result for acl check
2025-10-01T14:12:16.695318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:16.695323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:16.695326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:16.695332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255952136274484:7864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:16.696903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255952136274484:7864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:16.699035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255952136274484:7864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:16.702340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255952136274484:7864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:16.702367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255952136274484:7864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:16.702386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255952136274484:7864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:16.702398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:16.708842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:16.710782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:16.711064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:16.711075Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:16.711098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:16.711160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:16.711203Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255949759387102:4897]
2025-10-01T14:12:16.711801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:16.712106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:16.712139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:16.712431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:16.712487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.712493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.712494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.712496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.712497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.712498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.712499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.712501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.712502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.712503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.712505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.712506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.712507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.712508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.712513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.712523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.712527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.712532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.712536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.712540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.712544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.712548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.712552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.712557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.712561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.712564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.712569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.712573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.712580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.712589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.712594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.712605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.712613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.712619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.712627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.712632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.712638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.712647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.712662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.712671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.712676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.712686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.712691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.712697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.712702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.712707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.712712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.712717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.712721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.712726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.712730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.712736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.712740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.712745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.712749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.712755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.712794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:16.717097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:16.717745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:16.717760Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:16.717763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:16.717768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:16.717775Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1614 [2:7556255949759387102:4897]
2025-10-01T14:12:16.717791Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:16.717810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:16.717813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.717817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.717821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.717837Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:16.717843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:16.717849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:16.717907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.717909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.717911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.717915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:16.717918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:16.717989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:16.717991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.718002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.718013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.718029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:16.718046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136274454:2446], now have 1 active actors on pipe
2025-10-01T14:12:16.718050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136274624:7864], now have 1 active actors on pipe
2025-10-01T14:12:16.718058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255949759387097:4897]
2025-10-01T14:12:16.718060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255949759387097:4897]
2025-10-01T14:12:16.718063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255949759387097:4897]
2025-10-01T14:12:16.718079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:16.718099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:16.718113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:16.718115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:16.718139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:16.718142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:16.718146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:16.718147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255949759387097:4897]
2025-10-01T14:12:16.718149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:16.718153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:16.718325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.718335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.718108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1614
2025-10-01T14:12:16.718179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1614
2025-10-01T14:12:16.718364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:16.718408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.718412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.718420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:16.718430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.718447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:16.718468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.726137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.726165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.726211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.726406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1615 partition: 0 MaxSeqNo: 45 sessionId: src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0
2025-10-01T14:12:16.726859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b551b27b-f0f24743-a5111941-f66ed65e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:16.729362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0] Write session: try to update token
2025-10-01T14:12:16.729381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:16.731817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:16.731839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:16.731849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255949759387097:4897]
2025-10-01T14:12:16.731898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:16.731909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:16.732100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:16.732266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:16.732426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:16.732587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:16.732833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:16.732878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:16.750211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1615 sessionId: src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:16.753424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:16.753446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:16.753449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:16.753452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:16.753466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255949759387097:4897]
2025-10-01T14:12:16.753471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255949759387097:4897]
2025-10-01T14:12:16.753475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255949759387097:4897]
2025-10-01T14:12:16.753531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:16.753544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.753547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:16.753547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:16.753554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:16.753558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:16.753649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:16.753705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:16.789679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255952136274736:7971]
2025-10-01T14:12:16.790002Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1614, pipe: [1:7556255952136274736:7971]
2025-10-01T14:12:16.918216Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:16.918704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.918717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.918736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136274736:7971], now have 1 active actors on pipe
2025-10-01T14:12:16.918885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:16.918989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:16.918989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:16.918994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:16.919045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255952136274736:7971]
2025-10-01T14:12:16.919067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1615 reason: error at write: Disconnected sessionId: src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0
2025-10-01T14:12:16.919241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1615 sessionId: src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0 is DEAD
2025-10-01T14:12:16.919412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:16.919423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0] Write session will restart in 0.007298s
2025-10-01T14:12:16.919446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0] Write session: Do CDS request
2025-10-01T14:12:16.919450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:16.927816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.927976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:16.927991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1616
2025-10-01T14:12:16.928120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:16.928143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:16.928150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:16.928153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:16.928530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1616 sessionId:  describe result for acl check
2025-10-01T14:12:16.928560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:16.928565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:16.928567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:16.928571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255952136274876:7859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:16.929043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255952136274876:7859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:16.931426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255952136274876:7859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:16.933432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:16.933535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255952136274876:7859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:16.933546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255952136274876:7859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:16.933549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255952136274876:7859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:16.933557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:16.935842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:16.936023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:16.936034Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:16.936044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:16.936085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:16.936125Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255949759387329:4880]
2025-10-01T14:12:16.936676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:16.937035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:16.937078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:16.937353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:16.937408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.937416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.937417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.937418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.937419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.937420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.937421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.937422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.937424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.937425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.937425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.937426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.937427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.937428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.937432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.937441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.937445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.937448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.937451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.937455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.937458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.937460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.937464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.937467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.937470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.937473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.937476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.937480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.937486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.937493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:16.937499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.937503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:16.937507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.937511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:16.937515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.937519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:16.937524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.937530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:16.937533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.937537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:16.937541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.937548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:16.937552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.937556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:16.937566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.937571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:16.937574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.937579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.937583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.937589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.937592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.937598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.937602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.937609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:16.937614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.937620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:16.937653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:16.941496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:16.942051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:16.942068Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:16.942070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:16.942073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:16.942080Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1615 [2:7556255949759387329:4880]
2025-10-01T14:12:16.942094Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:16.942110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:16.942113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.942116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.942120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.942134Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:16.942143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:16.942149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:16.942197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.942204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.942206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.942209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:16.942212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:16.942274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:16.942280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.942289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:16.942298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:16.942315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:16.942334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255949759387323:4880]
2025-10-01T14:12:16.942341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255949759387323:4880]
2025-10-01T14:12:16.942342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255949759387323:4880]
2025-10-01T14:12:16.942351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:16.942364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:16.942367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136274743:2446], now have 1 active actors on pipe
2025-10-01T14:12:16.942391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255952136275009:7859], now have 1 active actors on pipe
2025-10-01T14:12:16.942395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:16.942396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:16.942399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:16.942408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:16.942411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:16.942433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255949759387323:4880]
2025-10-01T14:12:16.942405Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1615
2025-10-01T14:12:16.942442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:16.942428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1615
2025-10-01T14:12:16.942446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:16.942478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.942487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.942525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:16.942535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:16.942543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:16.942545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:16.942557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:16.942568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:16.942583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.942759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.942769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.942783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:16.942902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1616 partition: 0 MaxSeqNo: 45 sessionId: src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0
2025-10-01T14:12:16.943232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce9e5702-29bd9d4b-5711a71e-e0e616ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:16.945419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0] Write session: try to update token
2025-10-01T14:12:16.945433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:16.958026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1616 sessionId: src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:16.960966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:16.962465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:16.962492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:16.962514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:16.962517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:16.962520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:16.962522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:16.962530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255949759387323:4880]
2025-10-01T14:12:16.962536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255949759387323:4880]
2025-10-01T14:12:16.962540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255949759387323:4880]
2025-10-01T14:12:16.962581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:16.962597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:16.962598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:16.962601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:16.962604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:16.962607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:16.962737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:17.019438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255956431242319:7971]
2025-10-01T14:12:17.019697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1615, pipe: [1:7556255956431242319:7971]
2025-10-01T14:12:17.097557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:17.098028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:17.098073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431242319:7971], now have 1 active actors on pipe
2025-10-01T14:12:17.098186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:17.098262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:17.098301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:17.098304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:17.098314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255956431242319:7971]
2025-10-01T14:12:17.098360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1616 reason: error at write: Disconnected sessionId: src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0
2025-10-01T14:12:17.098507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1616 sessionId: src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0 is DEAD
2025-10-01T14:12:17.098632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:17.098644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0] Write session will restart in 0.005697s
2025-10-01T14:12:17.098668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0] Write session: Do CDS request
2025-10-01T14:12:17.098674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:17.105979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.106055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:17.106067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1617
2025-10-01T14:12:17.106247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.106278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:17.106287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:17.106293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:17.106730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1617 sessionId:  describe result for acl check
2025-10-01T14:12:17.106760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:17.106763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:17.106765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:17.106770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255956431242429:7851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:17.107257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255956431242429:7851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:17.109741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255956431242429:7851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:17.112122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:17.112333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255956431242429:7851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:17.112347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255956431242429:7851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:17.112350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255956431242429:7851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:17.112360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:17.114693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:17.114897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:17.114907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:17.114918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:17.114971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:17.115021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255954054354837:4874]
2025-10-01T14:12:17.115696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:17.116037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:17.116080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:17.116369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:17.116426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.116432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.116433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.116435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.116453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.116455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.116457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.116459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.116460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.116462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.116463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.116465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.116467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.116468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.116473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.116484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.116488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.116492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.116495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.116500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.116504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.116508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.116512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.116517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.116521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.116525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.116529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.116533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.116549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.116562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.116571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.116575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.116578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.116581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.116584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.116587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.116596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.116600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.116603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.116611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.116614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.116617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.116620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.116625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.116630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.116641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.116645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.116663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.116668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.116679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.116685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.116690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.116695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.116701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.116711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.116716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.116763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:17.120818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:17.121490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:17.121505Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:17.121507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:17.121510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:17.121516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1616 [2:7556255954054354837:4874]
2025-10-01T14:12:17.121529Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:17.121552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:17.121555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.121558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.121561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.121577Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:17.121583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:17.121590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:17.121639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.121647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.121649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.121654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:17.121657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:17.121723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:17.121732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.121740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.121751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.121768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:17.121792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431242595:7851], now have 1 active actors on pipe
2025-10-01T14:12:17.121803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431242324:2446], now have 1 active actors on pipe
2025-10-01T14:12:17.121809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255954054354831:4874]
2025-10-01T14:12:17.121812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255954054354831:4874]
2025-10-01T14:12:17.121814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255954054354831:4874]
2025-10-01T14:12:17.121826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:17.121838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:17.121842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:17.121844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:17.121845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:17.121857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:17.121866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:17.121900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255954054354831:4874]
2025-10-01T14:12:17.121908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:17.121910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:17.121873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1616
2025-10-01T14:12:17.121931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.121943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.121877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1616
2025-10-01T14:12:17.121974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:17.121985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.121990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.121992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:17.122001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.122019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:17.122034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.122177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.122185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.122194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.122277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1617 partition: 0 MaxSeqNo: 45 sessionId: src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0
2025-10-01T14:12:17.122636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3d6d251-c11c60bd-b5f210d3-5a0afb45_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:17.124924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0] Write session: try to update token
2025-10-01T14:12:17.124937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:17.137842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1617 sessionId: src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:17.140238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:17.141037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.141064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.142981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:17.143025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:17.143032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:17.143043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:17.143045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:17.143053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255954054354831:4874]
2025-10-01T14:12:17.143058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255954054354831:4874]
2025-10-01T14:12:17.143062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255954054354831:4874]
2025-10-01T14:12:17.143088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:17.143099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:17.143100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:17.143102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:17.143107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.143109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:17.143147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:17.143238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:17.198666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255956431242607:7971]
2025-10-01T14:12:17.198967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1616, pipe: [1:7556255956431242607:7971]
2025-10-01T14:12:17.283719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:17.290653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.290675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.290820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.290886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.290944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.291002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.291249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.291260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.291319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.291381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.291437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.291498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.291544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.291547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.291608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.291656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.291709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.291763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.291800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.291803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.291868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.291916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.291964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.292011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.292049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.292051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.292104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.292150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.292201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.292253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.292286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.292288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.292343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.292400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.292455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.292506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.292547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.292549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.292605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.292668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.292721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.292780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.292823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.292828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.292884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.292942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.292994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.293045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.293084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.293089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.293146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.293202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.293259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.293314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.293353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.293358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.293416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.293468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.293523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.293575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.293613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.293618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.293659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431242607:7971], now have 1 active actors on pipe
2025-10-01T14:12:17.293925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:17.293927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:17.293941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:17.293975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1617 reason: error at write: Disconnected sessionId: src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0
2025-10-01T14:12:17.293977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255956431242607:7971]
2025-10-01T14:12:17.294148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1617 sessionId: src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0 is DEAD
2025-10-01T14:12:17.294259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:17.294640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:17.294649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0] Write session will restart in 0.006791s
2025-10-01T14:12:17.294668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0] Write session: Do CDS request
2025-10-01T14:12:17.294673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:17.302950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.302961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:17.302981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1618
2025-10-01T14:12:17.303286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.303333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:17.303341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:17.303347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:17.303842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1618 sessionId:  describe result for acl check
2025-10-01T14:12:17.303876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:17.303882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:17.303886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:17.303891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255956431242724:7839] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:17.304415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255956431242724:7839] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:17.307197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255956431242724:7839] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:17.310126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255956431242724:7839] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:17.310141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255956431242724:7839] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:17.310144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255956431242724:7839] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:17.310152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:17.311078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:17.312764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:17.312955Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:17.312964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:17.312974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:17.313029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:17.313077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255954054355036:4872]
2025-10-01T14:12:17.313703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:17.314008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:17.314060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:17.314347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:17.314435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.314441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.314442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.314444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.314445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.314446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.314447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.314448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.314449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.314450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.314451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.314452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.314453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.314454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.314459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.314476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.314479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.314483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.314486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.314490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.314493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.314496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.314499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.314504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.314507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.314510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.314515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.314518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.314525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.314531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.314537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.314541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.314546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.314550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.314554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.314558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.314562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.314567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.314571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.314575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.314579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.314583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.314587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.314597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.314600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.314604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.314608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.314612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.314620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.314625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.314628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.314636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.314640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.314644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.314652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.314656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.314691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:17.318468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:17.319105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:17.319119Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:17.319121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:17.319125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:17.319132Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1617 [2:7556255954054355036:4872]
2025-10-01T14:12:17.319146Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:17.319162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:17.319165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.319168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.319171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.319186Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:17.319191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:17.319202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:17.319254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.319260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.319262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.319265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:17.319267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:17.319328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:17.319334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.319343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.319353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.319366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:17.319384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431242622:2446], now have 1 active actors on pipe
2025-10-01T14:12:17.319392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431242893:7839], now have 1 active actors on pipe
2025-10-01T14:12:17.319398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255954054355031:4872]
2025-10-01T14:12:17.319405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255954054355031:4872]
2025-10-01T14:12:17.319406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255954054355031:4872]
2025-10-01T14:12:17.319419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:17.319434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:17.319436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:17.319439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:17.319441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:17.319449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:17.319452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:17.319475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255954054355031:4872]
2025-10-01T14:12:17.319489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:17.319511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:17.319635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.319652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.319682Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:17.319695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.319706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.319713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:17.319727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.319741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:17.319760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.320141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.320150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.320167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.320700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75a8ac72-96ed5d73-68f4eb15-7e18042d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:17.319541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1617
2025-10-01T14:12:17.319539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1617
2025-10-01T14:12:17.320311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1618 partition: 0 MaxSeqNo: 45 sessionId: src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0
2025-10-01T14:12:17.323718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0] Write session: try to update token
2025-10-01T14:12:17.323734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:17.330915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:17.330938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:17.330948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255954054355031:4872]
2025-10-01T14:12:17.330989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:17.330995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:17.331255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:17.331401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:17.331544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:17.331683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:17.331876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:17.331910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:17.344360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1618 sessionId: src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:17.348059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:17.348471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.348501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.350646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:17.350689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:17.350692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:17.350695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:17.350696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:17.350706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255954054355031:4872]
2025-10-01T14:12:17.350711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255954054355031:4872]
2025-10-01T14:12:17.350716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255954054355031:4872]
2025-10-01T14:12:17.350744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:17.350751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:17.350757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:17.350760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:17.350762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.350764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:17.350810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:17.350908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:17.394241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255956431242906:7971]
2025-10-01T14:12:17.394592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1617, pipe: [1:7556255956431242906:7971]
2025-10-01T14:12:17.506736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:17.514903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.514939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.515104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.515170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.515236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.515299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.515348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.515359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.515426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.515488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.515548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.515610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.515661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.515675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.515743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.515807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.515869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.515936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.515985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.515995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.516065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.516133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.516198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.516263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.516433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.516444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.516507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.516569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.516631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.516707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.516753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.516762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.516829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.516891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.516955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.517019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.517075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.517088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.517151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.517212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.517278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.517344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.517395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.517404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.517471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.517534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.517600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.517667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.517716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.517727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.517794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.517859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.517925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.517989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.518038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.518048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.518656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:17.518713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:17.518716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:17.518744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1618 reason: error at write: Disconnected sessionId: src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0
2025-10-01T14:12:17.518110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.518169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.518221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.518273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.518313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.518316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.518410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431242906:7971], now have 1 active actors on pipe
2025-10-01T14:12:17.519125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:17.519138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0] Write session will restart in 0.008947s
2025-10-01T14:12:17.519019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1618 sessionId: src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0 is DEAD
2025-10-01T14:12:17.519165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0] Write session: Do CDS request
2025-10-01T14:12:17.519173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:17.519327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255956431242906:7971]
2025-10-01T14:12:17.519623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:17.528930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.529066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:17.529085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1619
2025-10-01T14:12:17.529257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.529299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:17.529305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:17.529310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:17.529782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1619 sessionId:  describe result for acl check
2025-10-01T14:12:17.529820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:17.529822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:17.529824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:17.529830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255956431243104:7826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:17.530398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255956431243104:7826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:17.533010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255956431243104:7826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:17.532733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:17.534230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:17.534486Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:17.534498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:17.534510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:17.534563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:17.534599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255954054355236:4870]
2025-10-01T14:12:17.535158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:17.535165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255956431243104:7826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:17.535178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255956431243104:7826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:17.535180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255956431243104:7826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:17.535187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:17.535475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:17.535514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:17.535801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:17.535841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.535846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.535847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.535848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.535848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.535849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.535850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.535850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.535851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.535852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.535852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.535853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.535854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.535854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.535858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.535864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.535866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.535868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.535870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.535873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.535875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.535877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.535879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.535882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.535884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.535886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.535888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.535890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.535894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.535898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.535902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.535906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.535908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.535911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.535914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.535916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.535919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.535922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.535925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.535928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.535931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.535934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.535936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.535939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.535942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.535944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.535947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.535950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.535952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.535955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.535958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.535961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.535964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.535966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.535972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.535975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.535995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:17.539968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:17.540631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:17.540648Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:17.540661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:17.540664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:17.540671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1618 [2:7556255954054355236:4870]
2025-10-01T14:12:17.540685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:17.540700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:17.540710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.540714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.540716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.540731Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:17.540744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:17.540750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:17.540803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.540804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.540806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.540810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:17.540812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:17.540876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:17.540886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.540897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.540908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.540921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:17.540944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431243205:7826], now have 1 active actors on pipe
2025-10-01T14:12:17.540953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431242932:2446], now have 1 active actors on pipe
2025-10-01T14:12:17.540961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255954054355231:4870]
2025-10-01T14:12:17.540963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255954054355231:4870]
2025-10-01T14:12:17.540965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255954054355231:4870]
2025-10-01T14:12:17.540979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:17.540987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:17.540969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1618
2025-10-01T14:12:17.540992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:17.540997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:17.541001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1618
2025-10-01T14:12:17.540998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:17.541004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:17.541007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:17.541043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.541054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.541067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255954054355231:4870]
2025-10-01T14:12:17.541077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:17.541101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:17.541119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|827accbc-f24c821e-177241f5-f04792e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:17.541127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.541137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.541139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:17.541148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.541157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:17.541176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.541292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.541304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.541316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.541386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1619 partition: 0 MaxSeqNo: 45 sessionId: src_id|827accbc-f24c821e-177241f5-f04792e6_0
2025-10-01T14:12:17.541777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaf62b8-a4468b2f-17f2089e-6b3481a7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|827accbc-f24c821e-177241f5-f04792e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:17.544712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|827accbc-f24c821e-177241f5-f04792e6_0] Write session: try to update token
2025-10-01T14:12:17.544735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|827accbc-f24c821e-177241f5-f04792e6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:17.558874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1619 sessionId: src_id|827accbc-f24c821e-177241f5-f04792e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:17.561430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:17.562290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.562323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.562345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:17.562349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:17.562352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:17.562354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:17.562362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255954054355231:4870]
2025-10-01T14:12:17.562367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255954054355231:4870]
2025-10-01T14:12:17.562388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255954054355231:4870]
2025-10-01T14:12:17.562421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:17.562426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:17.562429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:17.562446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:17.562452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.562455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:17.562579Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:17.618453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255956431243227:7971]
2025-10-01T14:12:17.618710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1618, pipe: [1:7556255956431243227:7971]
2025-10-01T14:12:17.700451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:17.700679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:17.700732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431243227:7971], now have 1 active actors on pipe
2025-10-01T14:12:17.700825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:17.701477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255956431243227:7971]
2025-10-01T14:12:17.701501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:17.711395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:17.711407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:17.711431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1619 reason: error at write: Disconnected sessionId: src_id|827accbc-f24c821e-177241f5-f04792e6_0
2025-10-01T14:12:17.711561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1619 sessionId: src_id|827accbc-f24c821e-177241f5-f04792e6_0 is DEAD
2025-10-01T14:12:17.711700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827accbc-f24c821e-177241f5-f04792e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:17.711711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827accbc-f24c821e-177241f5-f04792e6_0] Write session will restart in 0.009021s
2025-10-01T14:12:17.711743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827accbc-f24c821e-177241f5-f04792e6_0] Write session: Do CDS request
2025-10-01T14:12:17.711751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827accbc-f24c821e-177241f5-f04792e6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:17.720560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:17.721888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|827accbc-f24c821e-177241f5-f04792e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.721976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:17.721990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1620
2025-10-01T14:12:17.722120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.722093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:17.722150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:17.722161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:17.722164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:17.722290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:17.722302Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:17.722313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:17.722399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:17.722445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255954054355447:4864]
2025-10-01T14:12:17.722558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1620 sessionId:  describe result for acl check
2025-10-01T14:12:17.722590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:17.722595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:17.722597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:17.722603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255956431243470:7824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:17.723075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:17.723386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:17.723427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:17.723532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255956431243470:7824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:17.723708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:17.723783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.723791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.723792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.723793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.723794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.723795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.723796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.723797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.723798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.723799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.723800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.723801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.723802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.723803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.723808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.723815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.723819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.723823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.723826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.723830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.723834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.723838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.723841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.723846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.723849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.723853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.723857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.723861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.723869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.723877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.723887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.723893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.723897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.723902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.723907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.723913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.723917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.723923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.723929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.723935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.723939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.723944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.723948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.723954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.723958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.723964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.723969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.723975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.723979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.723985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.723989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.723995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.723999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.724004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.724009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.724014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.724053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:17.725847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255956431243470:7824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:17.727654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:17.728242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:17.728258Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:17.728261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:17.728264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:17.728269Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1619 [2:7556255954054355447:4864]
2025-10-01T14:12:17.728279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:17.728291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:17.728293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.728295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.728297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.728308Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:17.728313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:17.728317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:17.728355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.728362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.728363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.728365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:17.728367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:17.728416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:17.728422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.728429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.728435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.728443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:17.728456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255954054355442:4864]
2025-10-01T14:12:17.728462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255954054355442:4864]
2025-10-01T14:12:17.728464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255954054355442:4864]
2025-10-01T14:12:17.728471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:17.728480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:17.728480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:17.728484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:17.728487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:17.728488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:17.728490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:17.728498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431243229:2446], now have 1 active actors on pipe
2025-10-01T14:12:17.728515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255954054355442:4864]
2025-10-01T14:12:17.728523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:17.728530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:17.728546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1619
2025-10-01T14:12:17.728669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255956431243470:7824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:17.728681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255956431243470:7824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:17.728684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255956431243470:7824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:17.728690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:17.728864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431243510:7824], now have 1 active actors on pipe
2025-10-01T14:12:17.728933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1619
2025-10-01T14:12:17.728997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.729011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.729036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:17.729049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.729053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.729056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:17.729064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.729074Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:17.729094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.729266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.729278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.729293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.729361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1620 partition: 0 MaxSeqNo: 45 sessionId: src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0
2025-10-01T14:12:17.729721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827accbc-f24c821e-177241f5-f04792e6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:17.732221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0] Write session: try to update token
2025-10-01T14:12:17.732242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:17.739982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:17.740017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:17.740030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255954054355442:4864]
2025-10-01T14:12:17.740080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:17.740091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:17.740379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:17.740589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:17.740756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:17.740902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:17.741121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:17.741161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:17.746523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1620 sessionId: src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:17.748964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:17.749150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.749173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.749211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:17.749276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:17.757738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:17.757755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:17.757757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:17.757759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:17.757769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255954054355442:4864]
2025-10-01T14:12:17.757774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255954054355442:4864]
2025-10-01T14:12:17.757778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255954054355442:4864]
2025-10-01T14:12:17.757814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:17.757819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:17.757823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:17.757823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:17.757828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.757831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:17.757967Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:17.801800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255956431243516:7971]
2025-10-01T14:12:17.802038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1619, pipe: [1:7556255956431243516:7971]
2025-10-01T14:12:17.899835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:17.907102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.907130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.907270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.907328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.907387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.907445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.907490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.907499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.907557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.907620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.907676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.907738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.907784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.907791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.907853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.907914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.907973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.908035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.908080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.908086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.908149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.908224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.908283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.908342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.908382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.908387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.908447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.908504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.908563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.908623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.908679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.908689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.908752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.908810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.908871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.908932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.908975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.908980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.909041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.909097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.909159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.909220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.909261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.909265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.909321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.909375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.909437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.909493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.909549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.909554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.909616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.909674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.909731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.909788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.909835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.909842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.909911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:17.909963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:17.910018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:17.910075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:17.910114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:17.910119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:17.910160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431243516:7971], now have 1 active actors on pipe
2025-10-01T14:12:17.910327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:17.910354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255956431243516:7971]
2025-10-01T14:12:17.910398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:17.910405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:17.910432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1620 reason: error at write: Disconnected sessionId: src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0
2025-10-01T14:12:17.910657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1620 sessionId: src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0 is DEAD
2025-10-01T14:12:17.910812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:17.910824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0] Write session will restart in 0.006743s
2025-10-01T14:12:17.910850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0] Write session: Do CDS request
2025-10-01T14:12:17.910856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:17.911133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:17.918881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.918966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:17.918981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1621
2025-10-01T14:12:17.919119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:17.919151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:17.919160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:17.919163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:17.919538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1621 sessionId:  describe result for acl check
2025-10-01T14:12:17.919574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:17.919580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:17.919582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:17.919586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255956431243657:7810] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:17.920114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255956431243657:7810] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:17.922631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255956431243657:7810] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:17.923888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:17.925294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:17.925461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:17.925470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:17.925482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:17.925523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:17.925561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255954054355678:4832]
2025-10-01T14:12:17.925674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255956431243657:7810] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:17.925685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255956431243657:7810] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:17.925688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255956431243657:7810] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:17.925696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:17.926187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:17.926458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:17.926519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:17.926848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:17.926921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.926927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.926928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.926928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.926929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.926930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.926931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.926932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.926932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.926933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.926933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.926934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.926935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.926935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.926939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.926945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.926947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.926949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.926951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.926953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.926955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.926957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.926959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.926961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.926963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.926965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.926966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.926968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.926974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.926978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:17.926982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.926986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:17.926988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.926990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:17.926993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.926996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:17.926998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.927001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:17.927010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.927014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:17.927016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.927020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:17.927022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.927026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:17.927028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.927031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:17.927034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.927037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.927040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.927042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.927044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.927047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.927049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.927052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:17.927056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.927058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:17.927080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:17.930697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:17.931434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:17.931447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:17.931448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:17.931451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:17.931455Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1620 [2:7556255954054355678:4832]
2025-10-01T14:12:17.931469Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:17.931486Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:17.931490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.931493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.931495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.931510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:17.931518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:17.931523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:17.931572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.931578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.931579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.931581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:17.931583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:17.931642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:17.931649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.931660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:17.931673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:17.931691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:17.931713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431243796:7810], now have 1 active actors on pipe
2025-10-01T14:12:17.931721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255956431243523:2446], now have 1 active actors on pipe
2025-10-01T14:12:17.931728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255954054355673:4832]
2025-10-01T14:12:17.931735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255954054355673:4832]
2025-10-01T14:12:17.931738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255954054355673:4832]
2025-10-01T14:12:17.931750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:17.931762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:17.931765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:17.931766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:17.931767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:17.931781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:17.931784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:17.931800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1620
2025-10-01T14:12:17.931819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255954054355673:4832]
2025-10-01T14:12:17.931801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1620
2025-10-01T14:12:17.931826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:17.931830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:17.931860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.931868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.931896Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:17.931915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:17.931923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:17.931925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:17.931935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:17.931948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:17.931965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.932133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.932140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.932154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:17.932240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1621 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0
2025-10-01T14:12:17.932606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc3f5a1-81b0ea5d-e41636e1-e34e61d9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:17.935053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0] Write session: try to update token
2025-10-01T14:12:17.935073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:17.949006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1621 sessionId: src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:17.952026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:17.952593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:17.952618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:17.952638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:17.952641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:17.952643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:17.952645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:17.952669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255954054355673:4832]
2025-10-01T14:12:17.952674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255954054355673:4832]
2025-10-01T14:12:17.952678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255954054355673:4832]
2025-10-01T14:12:17.952725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:17.952736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:17.952737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:17.952740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:17.952742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:17.952744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:17.952882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:18.010663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255960726211103:7971]
2025-10-01T14:12:18.010863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1620, pipe: [1:7556255960726211103:7971]
2025-10-01T14:12:18.096284Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:18.096510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:18.096565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726211103:7971], now have 1 active actors on pipe
2025-10-01T14:12:18.096645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:18.096726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:18.096749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:18.096756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:18.096775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255960726211103:7971]
2025-10-01T14:12:18.096825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1621 reason: error at write: Disconnected sessionId: src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0
2025-10-01T14:12:18.097003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1621 sessionId: src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0 is DEAD
2025-10-01T14:12:18.097119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:18.097128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0] Write session will restart in 0.006258s
2025-10-01T14:12:18.097147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0] Write session: Do CDS request
2025-10-01T14:12:18.097153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:18.104932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.105023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:18.105035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1622
2025-10-01T14:12:18.105162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.105191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:18.105200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:18.105204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:18.105632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1622 sessionId:  describe result for acl check
2025-10-01T14:12:18.105660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:18.105666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:18.105667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:18.105672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255960726211246:7808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:18.106143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255960726211246:7808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:18.108590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255960726211246:7808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:18.109669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:18.111081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:18.111227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:18.111235Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:18.111243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:18.111275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:18.111302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255958349323191:4811]
2025-10-01T14:12:18.111381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255960726211246:7808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:18.111395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255960726211246:7808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:18.111398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255960726211246:7808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:18.111405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:18.111715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:18.111932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:18.111967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:18.112165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:18.112198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.112202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.112203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.112204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.112204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.112205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.112205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.112206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.112207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.112207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.112208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.112208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.112209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.112210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.112213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.112218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.112220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.112222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.112224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.112227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.112229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.112231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.112233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.112236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.112238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.112240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.112242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.112244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.112250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.112254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.112258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.112261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.112264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.112267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.112269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.112271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.112274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.112277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.112279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.112282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.112285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.112287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.112290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.112292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.112295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.112297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.112300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.112302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.112304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.112307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.112309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.112312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.112314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.112317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.112319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.112322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.112341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:18.116019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:18.116632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:18.116645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:18.116647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:18.116658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:18.116665Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1621 [2:7556255958349323191:4811]
2025-10-01T14:12:18.116678Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:18.116690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:18.116692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.116694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.116696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.116707Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:18.116715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:18.116720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:18.116759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.116764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.116765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.116767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:18.116769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:18.116827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:18.116834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.116844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.116853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.116867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:18.116886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726211383:7808], now have 1 active actors on pipe
2025-10-01T14:12:18.116893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726211106:2446], now have 1 active actors on pipe
2025-10-01T14:12:18.116901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255958349323186:4811]
2025-10-01T14:12:18.116906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255958349323186:4811]
2025-10-01T14:12:18.116908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255958349323186:4811]
2025-10-01T14:12:18.116918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:18.116932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:18.116934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:18.116939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:18.116941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:18.116946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:18.116950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:18.116974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255958349323186:4811]
2025-10-01T14:12:18.116985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:18.116994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:18.116977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1621
2025-10-01T14:12:18.116978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1621
2025-10-01T14:12:18.117091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.117100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.117124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:18.117135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.117138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.117140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:18.117149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.117157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:18.117172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.117509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.117515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.117530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.117615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1622 partition: 0 MaxSeqNo: 45 sessionId: src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0
2025-10-01T14:12:18.117971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c1b5c0-f371965e-b3cfb5e3-b0fa48cf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:18.120636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0] Write session: try to update token
2025-10-01T14:12:18.120664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:18.127167Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:18.127183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:18.127191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255958349323186:4811]
2025-10-01T14:12:18.127231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:18.127233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:18.127395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:18.127531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:18.127659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:18.127785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:18.127961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:18.127994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:18.134040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1622 sessionId: src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:18.136500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:18.136689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.136708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.136745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:18.136813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:18.145377Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:18.145398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:18.145400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:18.145402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:18.145412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255958349323186:4811]
2025-10-01T14:12:18.145415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255958349323186:4811]
2025-10-01T14:12:18.145419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255958349323186:4811]
2025-10-01T14:12:18.145454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:18.145461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:18.145466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:18.145468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.145470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:18.145470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:18.145601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:18.202493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255960726211394:7971]
2025-10-01T14:12:18.202900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1621, pipe: [1:7556255960726211394:7971]
2025-10-01T14:12:18.294785Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:18.302098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.302123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.302269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.302325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.302393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.302443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.302490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.302503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.302567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.302623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.302681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.302743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.302785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.302794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.302855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.302906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.302959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.303021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.303062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.303069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.303136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.303189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.303247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.303312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.303353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.303360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.303419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.303473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.303532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.303587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.303630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.303635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.303693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.303753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.303808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.303863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.303903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.303908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.303968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.304026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.304083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.304144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.304185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.304190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.304244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.304300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.304357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.304411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.304465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.304470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.304532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.304585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.304659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.304716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.304754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.304759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.304825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:18.304877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:18.304927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:18.304976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:18.305015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:18.305023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:18.305069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726211394:7971], now have 1 active actors on pipe
2025-10-01T14:12:18.305249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:18.305262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:18.305261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:18.305282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1622 reason: error at write: Disconnected sessionId: src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0
2025-10-01T14:12:18.305308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255960726211394:7971]
2025-10-01T14:12:18.305453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1622 sessionId: src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0 is DEAD
2025-10-01T14:12:18.305586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:18.305597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0] Write session will restart in 0.006259s
2025-10-01T14:12:18.305621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0] Write session: Do CDS request
2025-10-01T14:12:18.305627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:18.306033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:18.312904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.313051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:18.313066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1623
2025-10-01T14:12:18.313155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.313190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:18.313200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:18.313203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:18.313633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1623 sessionId:  describe result for acl check
2025-10-01T14:12:18.313671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:18.313679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:18.313681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:18.313686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255960726211502:7801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:18.314290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255960726211502:7801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:18.316377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255960726211502:7801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:18.318981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255960726211502:7801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:18.318991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255960726211502:7801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:18.318993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255960726211502:7801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:18.318998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:18.319299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:18.320499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:18.320707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:18.320717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:18.320728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:18.320771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:18.320806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255958349323396:4812]
2025-10-01T14:12:18.321292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:18.321573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:18.321607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:18.321812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:18.321860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.321865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.321867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.321868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.321869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.321870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.321871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.321873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.321874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.321875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.321876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.321877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.321878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.321879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.321884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.321893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.321897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.321905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.321909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.321916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.321920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.321926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.321928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.321930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.321932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.321934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.321936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.321938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.321943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.321950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.321958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.321962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.321965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.321968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.321970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.321973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.321975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.321978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.321980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.321983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.321985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.321988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.321990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.321993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.321996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.321999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.322001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.322003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.322010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.322012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.322015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.322018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.322020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.322023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.322025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.322028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.322046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:18.325641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:18.326253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:18.326270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:18.326272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:18.326276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:18.326282Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1622 [2:7556255958349323396:4812]
2025-10-01T14:12:18.326295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:18.326315Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:18.326322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.326325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.326327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.326357Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:18.326382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:18.326388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:18.326443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.326452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.326455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.326458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:18.326460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:18.326521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:18.326527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.326536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.326550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.326568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:18.326588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726211409:2446], now have 1 active actors on pipe
2025-10-01T14:12:18.326590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726211686:7801], now have 1 active actors on pipe
2025-10-01T14:12:18.326597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255958349323391:4812]
2025-10-01T14:12:18.326598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255958349323391:4812]
2025-10-01T14:12:18.326600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255958349323391:4812]
2025-10-01T14:12:18.326613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:18.326625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:18.326631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:18.326634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:18.326636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:18.326643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:18.326646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:18.326668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255958349323391:4812]
2025-10-01T14:12:18.326676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:18.326635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1622
2025-10-01T14:12:18.326678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:18.326641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1622
2025-10-01T14:12:18.326696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.326705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.326746Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:18.326758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.326763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.326765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:18.326774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.326783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:18.326804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.326940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.326949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.326962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.327049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1623 partition: 0 MaxSeqNo: 45 sessionId: src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0
2025-10-01T14:12:18.327405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c19102-1d29b15b-d5ac2b7f-b9dd161f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:18.329706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0] Write session: try to update token
2025-10-01T14:12:18.329720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:18.342464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1623 sessionId: src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:18.344840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:18.345891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.345914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.345936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:18.345939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:18.345942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:18.345944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:18.345953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255958349323391:4812]
2025-10-01T14:12:18.345957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255958349323391:4812]
2025-10-01T14:12:18.345960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255958349323391:4812]
2025-10-01T14:12:18.345995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:18.346006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:18.346009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:18.346014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:18.346020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.346028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:18.346153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:18.405384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255960726211703:7971]
2025-10-01T14:12:18.405609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1622, pipe: [1:7556255960726211703:7971]
2025-10-01T14:12:18.492628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:18.493299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:18.493350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726211703:7971], now have 1 active actors on pipe
2025-10-01T14:12:18.493455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:18.493491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255960726211703:7971]
2025-10-01T14:12:18.493518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:18.493540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:18.493548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:18.493617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1623 reason: error at write: Disconnected sessionId: src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0
2025-10-01T14:12:18.493787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1623 sessionId: src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0 is DEAD
2025-10-01T14:12:18.493947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:18.493958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0] Write session will restart in 0.007929s
2025-10-01T14:12:18.493981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0] Write session: Do CDS request
2025-10-01T14:12:18.493999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:18.502890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.503016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:18.503031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1624
2025-10-01T14:12:18.503196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.503233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:18.503244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:18.503248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:18.503648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1624 sessionId:  describe result for acl check
2025-10-01T14:12:18.503693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:18.503700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:18.503701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:18.503706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255960726211824:7792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:18.504255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255960726211824:7792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:18.506507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255960726211824:7792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:18.509125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255960726211824:7792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:18.509140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255960726211824:7792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:18.509144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255960726211824:7792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:18.509152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:18.509472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:18.511132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:18.511344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:18.511356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:18.511367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:18.511442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:18.511490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255958349323602:4820]
2025-10-01T14:12:18.512025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:18.512358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:18.512399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:18.512693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:18.512759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.512766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.512767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.512769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.512770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.512771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.512772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.512773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.512774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.512775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.512776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.512777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.512778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.512779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.512785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.512793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.512797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.512800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.512803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.512806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.512809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.512813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.512816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.512819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.512822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.512825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.512828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.512831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.512838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.512845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.512850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.512854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.512858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.512862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.512866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.512871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.512876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.512880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.512884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.512888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.512892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.512897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.512901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.512907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.512911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.512916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.512919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.512923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.512928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.512932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.512936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.512940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.512944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.512948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.512952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.512956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.512989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:18.516806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:18.517518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:18.517533Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:18.517536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:18.517540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:18.517548Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1623 [2:7556255958349323602:4820]
2025-10-01T14:12:18.517564Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:18.517582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:18.517590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.517594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.517596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.517612Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:18.517623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:18.517630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:18.517695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.517705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.517707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.517710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:18.517713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:18.517788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:18.517795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.517807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.517822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.517842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:18.517871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726211989:7792], now have 1 active actors on pipe
2025-10-01T14:12:18.517875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726211711:2446], now have 1 active actors on pipe
2025-10-01T14:12:18.517886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255958349323597:4820]
2025-10-01T14:12:18.517888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255958349323597:4820]
2025-10-01T14:12:18.517890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255958349323597:4820]
2025-10-01T14:12:18.517907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:18.517921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:18.517926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:18.517931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:18.517933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:18.517943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:18.517947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:18.517955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1623
2025-10-01T14:12:18.517982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255958349323597:4820]
2025-10-01T14:12:18.517991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:18.517992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:18.517962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1623
2025-10-01T14:12:18.518025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.518036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.518070Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62be0cb7-249072c5-101e40d9-5897cff6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:18.518086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.518090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.518092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:18.518103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.518117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:18.518142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.518320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.518338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.518365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.519099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1624 partition: 0 MaxSeqNo: 45 sessionId: src_id|62be0cb7-249072c5-101e40d9-5897cff6_0
2025-10-01T14:12:18.519509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70f0ef15-5a6169d0-67c06bd3-391a8595_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|62be0cb7-249072c5-101e40d9-5897cff6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:18.522220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62be0cb7-249072c5-101e40d9-5897cff6_0] Write session: try to update token
2025-10-01T14:12:18.522239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62be0cb7-249072c5-101e40d9-5897cff6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:18.541052Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:18.541079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:18.541082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:18.541084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:18.541095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255958349323597:4820]
2025-10-01T14:12:18.541100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255958349323597:4820]
2025-10-01T14:12:18.541106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255958349323597:4820]
2025-10-01T14:12:18.541161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:18.541174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.541177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:18.541332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:18.541370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:18.541387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:18.541391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:18.545562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1624 sessionId: src_id|62be0cb7-249072c5-101e40d9-5897cff6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:18.548150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:18.593805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255960726212023:7971]
2025-10-01T14:12:18.594084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1623, pipe: [1:7556255960726212023:7971]
2025-10-01T14:12:18.687873Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:18.688109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.688138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.688179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726212023:7971], now have 1 active actors on pipe
2025-10-01T14:12:18.688386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:18.688380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:18.688386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255960726212023:7971]
2025-10-01T14:12:18.688406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:18.688408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:18.688456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1624 reason: error at write: Disconnected sessionId: src_id|62be0cb7-249072c5-101e40d9-5897cff6_0
2025-10-01T14:12:18.688607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1624 sessionId: src_id|62be0cb7-249072c5-101e40d9-5897cff6_0 is DEAD
2025-10-01T14:12:18.688789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62be0cb7-249072c5-101e40d9-5897cff6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:18.688797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62be0cb7-249072c5-101e40d9-5897cff6_0] Write session will restart in 0.007669s
2025-10-01T14:12:18.688825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62be0cb7-249072c5-101e40d9-5897cff6_0] Write session: Do CDS request
2025-10-01T14:12:18.688830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62be0cb7-249072c5-101e40d9-5897cff6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:18.697871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62be0cb7-249072c5-101e40d9-5897cff6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.697927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:18.697941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1625
2025-10-01T14:12:18.698073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.698105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:18.698110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:18.698113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:18.698552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1625 sessionId:  describe result for acl check
2025-10-01T14:12:18.698582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:18.698588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:18.698589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:18.698595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255960726212267:7772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:18.699395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255960726212267:7772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:18.700263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:18.700971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255960726212267:7772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:18.701777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:18.701933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:18.701941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:18.701950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:18.701984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:18.702014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255958349323816:4817]
2025-10-01T14:12:18.702464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:18.702907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:18.702948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:18.703164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:18.703201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.703205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.703206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.703207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.703207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.703208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.703209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.703210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.703210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.703211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.703212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.703212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.703213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.703214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.703217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.703223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.703225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.703227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.703229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.703231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.703233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.703235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.703237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.703240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.703242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.703244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.703246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.703248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.703252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.703256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.703260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.703263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.703267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.703269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.703272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.703274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.703277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.703280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.703282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.703285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.703287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.703290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.703293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.703295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.703298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.703301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.703303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.703306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.703308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.703311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.703313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.703316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.703318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.703320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.703324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.703326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.703345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:18.703422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255960726212267:7772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:18.703435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255960726212267:7772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:18.703439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255960726212267:7772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:18.703446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:18.706766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:18.707333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:18.707346Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:18.707348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:18.707352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:18.707357Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1624 [2:7556255958349323816:4817]
2025-10-01T14:12:18.707372Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:18.707390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:18.707397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.707400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.707402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.707415Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:18.707420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:18.707429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:18.707481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.707487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.707489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.707492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:18.707495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:18.707569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:18.707577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.707587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.707597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.707618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:18.707639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726212308:7772], now have 1 active actors on pipe
2025-10-01T14:12:18.707646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726212026:2446], now have 1 active actors on pipe
2025-10-01T14:12:18.707653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255958349323810:4817]
2025-10-01T14:12:18.707659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255958349323810:4817]
2025-10-01T14:12:18.707661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255958349323810:4817]
2025-10-01T14:12:18.707674Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:18.707684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:18.707687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:18.707689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:18.707691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:18.707703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:18.707706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:18.707691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1624
2025-10-01T14:12:18.707697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1624
2025-10-01T14:12:18.707728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255958349323810:4817]
2025-10-01T14:12:18.707739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:18.707744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:18.707758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.707762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.708069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c85fe1a-d980e939-ca43c971-3178856b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:18.708081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.708084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.708087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:18.708097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.708109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:18.708128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.708277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.708284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.708296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.708362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1625 partition: 0 MaxSeqNo: 45 sessionId: src_id|6c85fe1a-d980e939-ca43c971-3178856b_0
2025-10-01T14:12:18.708729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62be0cb7-249072c5-101e40d9-5897cff6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6c85fe1a-d980e939-ca43c971-3178856b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:18.711110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c85fe1a-d980e939-ca43c971-3178856b_0] Write session: try to update token
2025-10-01T14:12:18.711129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c85fe1a-d980e939-ca43c971-3178856b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:18.724397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1625 sessionId: src_id|6c85fe1a-d980e939-ca43c971-3178856b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:18.727034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:18.728480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.728507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.728530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:18.728534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:18.728537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:18.728540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:18.728550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255958349323810:4817]
2025-10-01T14:12:18.728555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255958349323810:4817]
2025-10-01T14:12:18.728559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255958349323810:4817]
2025-10-01T14:12:18.728624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:18.728630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:18.728637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:18.728640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.728641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:18.728643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:18.728796Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:18.788408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255960726212318:7971]
2025-10-01T14:12:18.788756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1624, pipe: [1:7556255960726212318:7971]
2025-10-01T14:12:18.873728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:18.874102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:18.874174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726212318:7971], now have 1 active actors on pipe
2025-10-01T14:12:18.874228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:18.874410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255960726212318:7971]
2025-10-01T14:12:18.874447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:18.883149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:18.883158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:18.883182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1625 reason: error at write: Disconnected sessionId: src_id|6c85fe1a-d980e939-ca43c971-3178856b_0
2025-10-01T14:12:18.883337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1625 sessionId: src_id|6c85fe1a-d980e939-ca43c971-3178856b_0 is DEAD
2025-10-01T14:12:18.883490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c85fe1a-d980e939-ca43c971-3178856b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:18.883500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c85fe1a-d980e939-ca43c971-3178856b_0] Write session will restart in 0.005144s
2025-10-01T14:12:18.883529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c85fe1a-d980e939-ca43c971-3178856b_0] Write session: Do CDS request
2025-10-01T14:12:18.883536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c85fe1a-d980e939-ca43c971-3178856b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:18.889829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c85fe1a-d980e939-ca43c971-3178856b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.889917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:18.889928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1626
2025-10-01T14:12:18.890034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:18.890064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:18.890073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:18.890077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:18.890613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1626 sessionId:  describe result for acl check
2025-10-01T14:12:18.890649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:18.890656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:18.890658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:18.890663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255960726212540:7764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:18.891198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255960726212540:7764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:18.893098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:18.893596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255960726212540:7764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:18.894958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:18.895201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:18.895212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:18.895225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:18.895274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:18.895308Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255958349324037:4814]
2025-10-01T14:12:18.896013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:18.896257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:18.896301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:18.896631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:18.896645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255960726212540:7764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:18.896678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255960726212540:7764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:18.896681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255960726212540:7764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:18.896689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:18.896716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.896723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.896724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.896726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.896727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.896728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.896730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.896731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.896732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.896733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.896735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.896736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.896737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.896738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.896744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.896754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.896759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.896763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.896767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.896771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.896775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.896779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.896783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.896787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.896791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.896794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.896798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.896802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.896809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.896816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:18.896823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.896834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:18.896839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.896849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:18.896854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.896864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:18.896869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.896875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:18.896880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.896890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:18.896895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.896905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:18.896909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.896919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:18.896923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.896934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:18.896937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.896946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.896950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.896954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.896961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.896966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.896970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.896978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:18.896983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.896988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:18.897032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:18.901941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:18.902769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:18.902783Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:18.902784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:18.902787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:18.902792Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1625 [2:7556255958349324037:4814]
2025-10-01T14:12:18.902805Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:18.902819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:18.902821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.902823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.902824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.902837Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:18.902840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:18.902845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:18.902891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.902897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.902898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.902901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:18.902903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:18.902956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:18.902962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.902971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:18.902976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:18.902986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:18.903006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726212322:2446], now have 1 active actors on pipe
2025-10-01T14:12:18.903013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726212605:7764], now have 1 active actors on pipe
2025-10-01T14:12:18.903020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255958349324032:4814]
2025-10-01T14:12:18.903028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255958349324032:4814]
2025-10-01T14:12:18.903030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255958349324032:4814]
2025-10-01T14:12:18.903046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:18.903062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:18.903071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:18.903074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:18.903075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:18.903076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:18.903077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:18.903104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255958349324032:4814]
2025-10-01T14:12:18.903115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:18.903137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:18.903122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1625
2025-10-01T14:12:18.903151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1625
2025-10-01T14:12:18.903306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.903316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.903341Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:18.903354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:18.903361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:18.903362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:18.903368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:18.903377Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:18.903395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.903515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.903522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.903536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:18.903623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1626 partition: 0 MaxSeqNo: 45 sessionId: src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0
2025-10-01T14:12:18.903998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c85fe1a-d980e939-ca43c971-3178856b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:18.907118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0] Write session: try to update token
2025-10-01T14:12:18.907134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:18.925474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1626 sessionId: src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:18.928306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:18.928613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:18.928633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:18.928688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:18.929033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:18.932212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:18.932232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:18.932234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:18.932235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:18.932244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255958349324032:4814]
2025-10-01T14:12:18.932248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255958349324032:4814]
2025-10-01T14:12:18.932252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255958349324032:4814]
2025-10-01T14:12:18.932297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:18.932299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:18.932304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:18.932306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:18.932308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:18.932309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:18.932491Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:18.974754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255960726212615:7971]
2025-10-01T14:12:18.975028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1625, pipe: [1:7556255960726212615:7971]
2025-10-01T14:12:19.084272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:19.092098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.092127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.092291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.092355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.092423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.092485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.092923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.092935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.093005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.093064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.093128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.093197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.093246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.093251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.093309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.093360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.093417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.093477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.093518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.093523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.093589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.093654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.093713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.093775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.093814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.093819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.093875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.093932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.093994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.094054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.094101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.094108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.094175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.094236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.094303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.094382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.094431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.094438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.094505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.094566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.094630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.094692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.094747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.094755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.094816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.094879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.094938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.095002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.095047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.095052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.095117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.095180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.095241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.095320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.095372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.095379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.095450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.095516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.095590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.095774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.095820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.095825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.095881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255960726212615:7971], now have 1 active actors on pipe
2025-10-01T14:12:19.096128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255960726212615:7971]
2025-10-01T14:12:19.096149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:19.096175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:19.096181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:19.096208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1626 reason: error at write: Disconnected sessionId: src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0
2025-10-01T14:12:19.096429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1626 sessionId: src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0 is DEAD
2025-10-01T14:12:19.096569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:19.096580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0] Write session will restart in 0.009815s
2025-10-01T14:12:19.096610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0] Write session: Do CDS request
2025-10-01T14:12:19.096616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:19.096885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:19.107904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.107973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:19.107985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1627
2025-10-01T14:12:19.108114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.108137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:19.108144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:19.108147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:19.108535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1627 sessionId:  describe result for acl check
2025-10-01T14:12:19.108568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:19.108570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:19.108572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:19.108578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255965021180160:7760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:19.109131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255965021180160:7760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:19.109325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:19.110961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:19.111165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:19.111175Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:19.111188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:19.111236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:19.111291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255962644291571:4793]
2025-10-01T14:12:19.111589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255965021180160:7760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:19.111894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:19.112160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:19.112200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:19.112497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:19.112592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.112604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.112605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.112606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.112607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.112608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.112609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.112610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.112611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.112612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.112613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.112615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.112616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.112617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.112623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.112632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.112635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.112639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.112642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.112646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.112661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.112665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.112668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.112672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.112675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.112678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.112681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.112686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.112694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.112702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.112708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.112713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.112717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.112722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.112726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.112730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.112734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.112739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.112745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.112749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.112754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.112758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.112762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.112767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.112771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.112775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.112779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.112783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.112788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.112793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.112797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.112801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.112805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.112809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.112813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.112819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.112850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:19.117090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255965021180160:7760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:19.117106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255965021180160:7760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:19.117110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255965021180160:7760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:19.117118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:19.117388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:19.118474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:19.118494Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:19.118497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:19.118502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:19.118510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1626 [2:7556255962644291571:4793]
2025-10-01T14:12:19.118526Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:19.118556Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:19.118571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.118576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.118578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.118597Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:19.118603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:19.118611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:19.118683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.118693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.118695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.118698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:19.118702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:19.118789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:19.118804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.118816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.118833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.118855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:19.118878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021180200:7760], now have 1 active actors on pipe
2025-10-01T14:12:19.118889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021179914:2446], now have 1 active actors on pipe
2025-10-01T14:12:19.118898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255962644291566:4793]
2025-10-01T14:12:19.118900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255962644291566:4793]
2025-10-01T14:12:19.118903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255962644291566:4793]
2025-10-01T14:12:19.118908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1626
2025-10-01T14:12:19.118909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1626
2025-10-01T14:12:19.118919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:19.118947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:19.118958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:19.118961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:19.118961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:19.118962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:19.118965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:19.119027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.119044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.119065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255962644291566:4793]
2025-10-01T14:12:19.119081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:19.119098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:19.119124Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:19.119140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.119150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.119153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:19.119163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.119193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:19.119235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.119424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.119440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.119463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.119565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1627 partition: 0 MaxSeqNo: 45 sessionId: src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0
2025-10-01T14:12:19.119931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e01d2386-57c46c7c-cc7f4db4-200c5ea3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:19.122540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0] Write session: try to update token
2025-10-01T14:12:19.122557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:19.137496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1627 sessionId: src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:19.140248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:19.140458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.140482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.140521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:19.140605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:19.143384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:19.143411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:19.143415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:19.143417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:19.143428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255962644291566:4793]
2025-10-01T14:12:19.143434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255962644291566:4793]
2025-10-01T14:12:19.143438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255962644291566:4793]
2025-10-01T14:12:19.143487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:19.143492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:19.143499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.143502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:19.143505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:19.143508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:19.143652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:19.196475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255965021180207:7971]
2025-10-01T14:12:19.197096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1626, pipe: [1:7556255965021180207:7971]
2025-10-01T14:12:19.292152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:19.299981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.300007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.300151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.300217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.300281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.300352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.300393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.300401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.300468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.300525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.300583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.300646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.300701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.300709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.300768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.300824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.300883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.300937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.300976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.300990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.301050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.301102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.301158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.301211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.301257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.301265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.301329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.301385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.301438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.301493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.301538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.301547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.301606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.301658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.301722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.301784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.301828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.301836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.301896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.301953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.302011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.302065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.302106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.302112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.302167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.302219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.302270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.302329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.302397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.302405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.302464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.302519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.302577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.302640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.302683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.302688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.302749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.302809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.302874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.302933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.302974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.302979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.303035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021180207:7971], now have 1 active actors on pipe
2025-10-01T14:12:19.303246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255965021180207:7971]
2025-10-01T14:12:19.303259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:19.303262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:19.303275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:19.303287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1627 reason: error at write: Disconnected sessionId: src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0
2025-10-01T14:12:19.303521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1627 sessionId: src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0 is DEAD
2025-10-01T14:12:19.303634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:19.303644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0] Write session will restart in 0.009452s
2025-10-01T14:12:19.303669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0] Write session: Do CDS request
2025-10-01T14:12:19.303674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:19.303847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:19.313911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.314014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:19.314028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1628
2025-10-01T14:12:19.314134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.314167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:19.314174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:19.314176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:19.314566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1628 sessionId:  describe result for acl check
2025-10-01T14:12:19.314602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:19.314608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:19.314610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:19.314616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255965021180317:7755] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:19.315106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255965021180317:7755] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:19.317394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255965021180317:7755] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:19.319879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255965021180317:7755] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:19.319891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255965021180317:7755] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:19.319894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255965021180317:7755] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:19.319901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:19.319966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:19.321459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:19.321587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:19.321595Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:19.321602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:19.321630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:19.321657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255962644291781:4786]
2025-10-01T14:12:19.322022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:19.322195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:19.322223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:19.322456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:19.322492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.322497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.322497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.322498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.322498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.322499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.322499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.322500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.322501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.322501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.322502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.322502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.322503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.322503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.322506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.322511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.322514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.322516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.322518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.322520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.322522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.322524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.322526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.322528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.322530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.322532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.322534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.322536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.322540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.322544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.322548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.322551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.322553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.322556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.322559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.322562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.322564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.322567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.322569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.322572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.322574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.322577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.322579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.322582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.322584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.322587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.322589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.322591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.322594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.322596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.322598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.322601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.322603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.322606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.322608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.322612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.322631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:19.325812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:19.326477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:19.326487Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:19.326488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:19.326490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:19.326495Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1627 [2:7556255962644291781:4786]
2025-10-01T14:12:19.326503Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:19.326515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:19.326517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.326519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.326520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.326533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:19.326537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:19.326544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:19.326585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.326590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.326592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.326594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:19.326596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:19.326643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:19.326651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.326658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.326664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.326672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:19.326685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255962644291775:4786]
2025-10-01T14:12:19.326690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255962644291775:4786]
2025-10-01T14:12:19.326691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255962644291775:4786]
2025-10-01T14:12:19.326697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:19.326706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021180504:7755], now have 1 active actors on pipe
2025-10-01T14:12:19.326705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:19.326708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:19.326710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:19.326715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021180222:2446], now have 1 active actors on pipe
2025-10-01T14:12:19.326720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:19.326731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:19.326738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:19.326759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255962644291775:4786]
2025-10-01T14:12:19.326769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:19.326778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:19.326778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1627
2025-10-01T14:12:19.326786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1627
2025-10-01T14:12:19.326865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.326875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.326901Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:19.326913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.326917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.326919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:19.326928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.326935Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:19.326948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.327089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.327098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.327110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.327175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1628 partition: 0 MaxSeqNo: 45 sessionId: src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0
2025-10-01T14:12:19.327561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e731c255-ad6f76eb-244f5807-4fdee81f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:19.329968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0] Write session: try to update token
2025-10-01T14:12:19.329983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:19.337124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:19.337144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:19.337154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255962644291775:4786]
2025-10-01T14:12:19.337196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:19.337204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:19.337400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:19.337576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:19.337735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:19.337906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:19.338132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:19.338180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:19.343545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1628 sessionId: src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:19.346526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:19.346786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.346810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.346843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:19.346950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:19.361025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:19.361047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:19.361050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:19.361052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:19.361064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255962644291775:4786]
2025-10-01T14:12:19.361068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255962644291775:4786]
2025-10-01T14:12:19.361072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255962644291775:4786]
2025-10-01T14:12:19.361119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:19.361123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:19.361125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:19.361129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:19.361133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.361136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:19.361299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:19.403301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255965021180516:7971]
2025-10-01T14:12:19.403566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1627, pipe: [1:7556255965021180516:7971]
2025-10-01T14:12:19.508179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:19.515683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.515713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.515877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.515945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.516014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.516081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.516123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.516136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.516204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.516263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.516325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.516391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.516439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.516447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.516525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.516586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.516675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.516743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.516787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.516793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.516858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.516921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.516987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.517059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.517115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.517124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.517201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.517270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.517347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.517421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.517464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.517470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.517536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.517597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.517661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.517744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.517795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.517803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.517867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.517922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.517986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.518054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.518097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.518102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.518162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.518216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.518274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.518336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.518479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.518489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.518562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.518637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.518714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.518791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.518837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.518845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.518914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.518988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.519066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.519145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.519197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.519205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.519284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021180516:7971], now have 1 active actors on pipe
2025-10-01T14:12:19.519493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255965021180516:7971]
2025-10-01T14:12:19.519510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:19.519514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:19.519528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:19.519551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1628 reason: error at write: Disconnected sessionId: src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0
2025-10-01T14:12:19.519763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1628 sessionId: src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0 is DEAD
2025-10-01T14:12:19.519910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:19.519917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0] Write session will restart in 0.009330s
2025-10-01T14:12:19.519946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0] Write session: Do CDS request
2025-10-01T14:12:19.519952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:19.520396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:19.530985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.531386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:19.531400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1629
2025-10-01T14:12:19.531514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.531538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:19.531545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:19.531548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:19.532023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1629 sessionId:  describe result for acl check
2025-10-01T14:12:19.532058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:19.532061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:19.532063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:19.532070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255965021180774:7744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:19.532626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255965021180774:7744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:19.533641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:19.535027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255965021180774:7744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:19.535375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:19.535600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:19.535608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:19.535617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:19.535656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:19.535685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255962644291991:4784]
2025-10-01T14:12:19.536275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:19.536564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:19.536603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:19.536900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:19.536954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.536960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.536961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.536962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.536963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.536964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.536966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.536967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.536968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.536969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.536970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.536972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.536973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.536974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.536979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.536988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.536992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.536996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.536999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.537003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.537007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.537010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.537014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.537018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.537021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.537025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.537028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.537031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.537038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.537046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.537052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.537058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.537063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.537068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.537073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.537077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.537086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.537090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.537094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.537103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.537108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.537117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.537121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.537126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.537135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.537140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.537144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.537152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.537157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.537163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.537167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.537172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.537177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.537181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.537190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.537194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.537228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:19.537599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255965021180774:7744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:19.537613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255965021180774:7744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:19.537617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255965021180774:7744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:19.537625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:19.541004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:19.541802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:19.541814Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:19.541815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:19.541818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:19.541823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1628 [2:7556255962644291991:4784]
2025-10-01T14:12:19.541834Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:19.541846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:19.541848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.541850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.541851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.541864Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:19.541867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:19.541873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:19.541917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.541923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.541924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.541927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:19.541928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:19.541988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:19.541993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.542001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.542006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.542019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:19.542033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255962644291986:4784]
2025-10-01T14:12:19.542037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255962644291986:4784]
2025-10-01T14:12:19.542039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255962644291986:4784]
2025-10-01T14:12:19.542046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:19.542057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:19.542060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021180527:2446], now have 1 active actors on pipe
2025-10-01T14:12:19.542067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:19.542068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:19.542069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:19.542079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:19.542082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:19.542087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021180815:7744], now have 1 active actors on pipe
2025-10-01T14:12:19.542114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1628
2025-10-01T14:12:19.542120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255962644291986:4784]
2025-10-01T14:12:19.542130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1628
2025-10-01T14:12:19.542128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:19.542134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:19.542161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.542165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.542189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:19.542201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.542205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.542212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:19.542220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.542229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:19.542242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.542351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.542361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.542388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.542441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1629 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0
2025-10-01T14:12:19.542838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25fd38e1-545db98a-749dfe0a-82dc431a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:19.545234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0] Write session: try to update token
2025-10-01T14:12:19.545248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:19.559864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1629 sessionId: src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:19.562310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:19.562540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.562566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.562617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:19.562732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:19.564856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:19.564872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:19.564874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:19.564875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:19.564884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255962644291986:4784]
2025-10-01T14:12:19.564887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255962644291986:4784]
2025-10-01T14:12:19.564893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255962644291986:4784]
2025-10-01T14:12:19.564940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:19.564939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:19.564946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:19.564950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:19.564952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.564954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:19.565103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:19.619896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255965021180836:7971]
2025-10-01T14:12:19.620151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1628, pipe: [1:7556255965021180836:7971]
2025-10-01T14:12:19.709348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:19.716627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.716665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.716820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.716875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.716932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.716990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.717032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.717039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.717103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.717158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.717223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.717283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.717322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.717327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.717381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.717433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.717486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.717538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.717577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.717582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.717639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.717692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.717754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.717805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.717847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.717852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.717905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.717956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.718013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.718066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.718104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.718108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.718164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.718221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.718284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.718340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.718396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.718399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.718466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.718515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.718567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.718621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.718665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.718668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.718728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.718783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.718842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.718905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.718946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.718955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.719018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.719075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.719132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.719188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.719228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.719235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.719298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.719348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.719400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.719454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.719498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.719506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.719554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021180836:7971], now have 1 active actors on pipe
2025-10-01T14:12:19.719768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:19.719781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:19.719803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1629 reason: error at write: Disconnected sessionId: src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0
2025-10-01T14:12:19.719995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1629 sessionId: src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0 is DEAD
2025-10-01T14:12:19.720104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:19.720115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0] Write session will restart in 0.008193s
2025-10-01T14:12:19.720138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0] Write session: Do CDS request
2025-10-01T14:12:19.720144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:19.720173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:19.720324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255965021180836:7971]
2025-10-01T14:12:19.721037Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:19.729913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.730035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:19.730049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1630
2025-10-01T14:12:19.730144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.730173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:19.730183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:19.730189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:19.730540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1630 sessionId:  describe result for acl check
2025-10-01T14:12:19.730568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:19.730569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:19.730569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:19.730573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255965021181044:7731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:19.731050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255965021181044:7731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:19.732793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255965021181044:7731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:19.733631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:19.735228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:19.735456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255965021181044:7731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:19.735465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255965021181044:7731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:19.735470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255965021181044:7731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:19.735476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:19.735546Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:19.735561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:19.735574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:19.735632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:19.735670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255962644292212:4757]
2025-10-01T14:12:19.736133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:19.736381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:19.736408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:19.736713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:19.736748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.736752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.736752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.736753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.736754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.736755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.736756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.736756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.736757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.736758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.736759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.736759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.736760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.736761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.736764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.736769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.736772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.736774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.736776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.736778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.736781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.736783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.736785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.736787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.736789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.736791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.736796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.736798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.736803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.736807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.736811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.736814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.736816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.736820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.736822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.736825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.736827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.736830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.736833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.736835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.736838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.736841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.736843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.736845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.736848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.736851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.736853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.736856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.736858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.736861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.736863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.736866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.736868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.736871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.736873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.736876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.736897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:19.740333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:19.740933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:19.740951Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:19.740954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:19.740958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:19.740963Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1629 [2:7556255962644292212:4757]
2025-10-01T14:12:19.740974Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:19.740986Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:19.740988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.740990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.740992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.741001Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:19.741005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:19.741014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:19.741059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.741064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.741065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.741068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:19.741069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:19.741113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:19.741118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.741125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.741131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.741142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:19.741156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255962644292207:4757]
2025-10-01T14:12:19.741160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255962644292207:4757]
2025-10-01T14:12:19.741162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255962644292207:4757]
2025-10-01T14:12:19.741168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:19.741177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:19.741178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:19.741181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:19.741184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:19.741187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:19.741190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:19.741197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021181132:7731], now have 1 active actors on pipe
2025-10-01T14:12:19.741203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021180847:2446], now have 1 active actors on pipe
2025-10-01T14:12:19.741216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255962644292207:4757]
2025-10-01T14:12:19.741224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:19.741253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:19.741274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1629
2025-10-01T14:12:19.741278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1629
2025-10-01T14:12:19.741341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.741348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.741366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aae62e66-68100394-c7720276-438df8f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:19.741374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.741376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.741381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:19.741387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.741392Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:19.741404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.741563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.741571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.741580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.741664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1630 partition: 0 MaxSeqNo: 45 sessionId: src_id|aae62e66-68100394-c7720276-438df8f6_0
2025-10-01T14:12:19.741989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ea923-31c8e0b4-3b4e0fd3-237219e3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aae62e66-68100394-c7720276-438df8f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:19.744255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae62e66-68100394-c7720276-438df8f6_0] Write session: try to update token
2025-10-01T14:12:19.744267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae62e66-68100394-c7720276-438df8f6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:19.751487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:19.751504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:19.751513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255962644292207:4757]
2025-10-01T14:12:19.751548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:19.751550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:19.751690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:19.751818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:19.751938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:19.752055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:19.752520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:19.752557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:19.757280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1630 sessionId: src_id|aae62e66-68100394-c7720276-438df8f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:19.759880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:19.760093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.760113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.760156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:19.760258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:19.777977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:19.777993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:19.777995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:19.777996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:19.778004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255962644292207:4757]
2025-10-01T14:12:19.778007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255962644292207:4757]
2025-10-01T14:12:19.778010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255962644292207:4757]
2025-10-01T14:12:19.778046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:19.778053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.778054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:19.778064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:19.778081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:19.778088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:19.778185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:19.820585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255965021181144:7971]
2025-10-01T14:12:19.820866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1629, pipe: [1:7556255965021181144:7971]
2025-10-01T14:12:19.928406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:19.936919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.936953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.937151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.937256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.937351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.937450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.937509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.937521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.937613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.937706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.937797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.937897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.937959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.937971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.938073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.938171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.938272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.938391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.938446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.938453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.938512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.938573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.938660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.938756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.938817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.938826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.938919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.938987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.939072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.939171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.939227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.939237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.939328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.939422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.939522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.939623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.939680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.939692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.939780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.939873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.939968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.940079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.940139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.940149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.940263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.940372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.940489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.940602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.940671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.940681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.940783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.940868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.940963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.941066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.941128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.941137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.941228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:19.941318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:19.941412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:19.941504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:19.941559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:19.941569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:19.941633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021181144:7971], now have 1 active actors on pipe
2025-10-01T14:12:19.941884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:19.941887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:19.941891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:19.941916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1630 reason: error at write: Disconnected sessionId: src_id|aae62e66-68100394-c7720276-438df8f6_0
2025-10-01T14:12:19.941938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255965021181144:7971]
2025-10-01T14:12:19.942139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1630 sessionId: src_id|aae62e66-68100394-c7720276-438df8f6_0 is DEAD
2025-10-01T14:12:19.942269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae62e66-68100394-c7720276-438df8f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:19.942277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae62e66-68100394-c7720276-438df8f6_0] Write session will restart in 0.005832s
2025-10-01T14:12:19.942303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae62e66-68100394-c7720276-438df8f6_0] Write session: Do CDS request
2025-10-01T14:12:19.942308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae62e66-68100394-c7720276-438df8f6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:19.942569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:19.948936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae62e66-68100394-c7720276-438df8f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.948956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:19.948968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1631
2025-10-01T14:12:19.949168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:19.949197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:19.949206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:19.949209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:19.949577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1631 sessionId:  describe result for acl check
2025-10-01T14:12:19.949611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:19.949618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:19.949620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:19.949625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255965021181200:7727] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:19.950129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255965021181200:7727] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:19.953082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255965021181200:7727] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:19.956347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255965021181200:7727] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:19.956362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255965021181200:7727] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:19.956365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255965021181200:7727] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:19.956374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:19.957421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:19.959136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:19.959388Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:19.959411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:19.959428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:19.959492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:19.959538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255962644292438:4748]
2025-10-01T14:12:19.960158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:19.960463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:19.960507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:19.960844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:19.960911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.960918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.960919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.960920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.960921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.960923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.960924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.960925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.960926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.960928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.960929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.960930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.960931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.960933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.960938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.960949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.960954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.960959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.960963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.960967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.960972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.960976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.960980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.960985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.960989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.960994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.960998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.961002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.961013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.961026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:19.961037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.961047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:19.961056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.961065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:19.961074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.961080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:19.961088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.961098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:19.961107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.961117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:19.961122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.961131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:19.961140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.961149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:19.961159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.961168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:19.961177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.961183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.961191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.961200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.961208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.961212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.961219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.961225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:19.961234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.961244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:19.961291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:19.965050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:19.965862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:19.965877Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:19.965879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:19.965883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:19.965889Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1630 [2:7556255962644292438:4748]
2025-10-01T14:12:19.965903Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:19.965924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:19.965932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.965935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.965938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.965954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:19.965964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:19.965970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:19.966025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.966032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.966034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.966038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:19.966041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:19.966102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:19.966112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.966124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:19.966136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:19.966155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:19.966178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021181432:7727], now have 1 active actors on pipe
2025-10-01T14:12:19.966185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255965021181149:2446], now have 1 active actors on pipe
2025-10-01T14:12:19.966193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255962644292433:4748]
2025-10-01T14:12:19.966200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255962644292433:4748]
2025-10-01T14:12:19.966202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255962644292433:4748]
2025-10-01T14:12:19.966232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:19.966242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:19.966246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:19.966251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:19.966269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:19.966254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1630
2025-10-01T14:12:19.966272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1630
2025-10-01T14:12:19.966288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:19.966296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:19.966357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.966366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.966398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255962644292433:4748]
2025-10-01T14:12:19.966407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:19.966417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:19.966439Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:19.966451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:19.966459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:19.966462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:19.966470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:19.966483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:19.966509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.966700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.966710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.966725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:19.966805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1631 partition: 0 MaxSeqNo: 45 sessionId: src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0
2025-10-01T14:12:19.967187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae62e66-68100394-c7720276-438df8f6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:19.969505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0] Write session: try to update token
2025-10-01T14:12:19.969521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:19.983673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1631 sessionId: src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:19.986244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:19.986468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:19.986506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:19.986547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:19.986625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:19.989023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:19.989040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:19.989042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:19.989044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:19.989051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255962644292433:4748]
2025-10-01T14:12:19.989055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255962644292433:4748]
2025-10-01T14:12:19.989058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255962644292433:4748]
2025-10-01T14:12:19.989100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:19.989110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:19.989111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:19.989114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:19.989120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:19.989124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:19.989258Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:20.042305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255969316148742:7971]
2025-10-01T14:12:20.042585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1630, pipe: [1:7556255969316148742:7971]
2025-10-01T14:12:20.131210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:20.141859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.141891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.142103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.142192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.142279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.142364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.142438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.142449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.142537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.142625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.142710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.142796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.142852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.142860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.142939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.143013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.143096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.143178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.143231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.143239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.143324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.143402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.143483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.143568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.143620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.143627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.143706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.143781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.143859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.143937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.143986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.143993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.144070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.144140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.144217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.144306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.144366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.144374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.144457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.144536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.144624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.144721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.144781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.144788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.144873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.144956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.145043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.145128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.145197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.145206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.145298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.145384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.145471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.145563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.145620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.145628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.145716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.145799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.145885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.145973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.146029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.146037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.146112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316148742:7971], now have 1 active actors on pipe
2025-10-01T14:12:20.146354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255969316148742:7971]
2025-10-01T14:12:20.146395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:20.146401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:20.146402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:20.146431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1631 reason: error at write: Disconnected sessionId: src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0
2025-10-01T14:12:20.146698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1631 sessionId: src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0 is DEAD
2025-10-01T14:12:20.146780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:20.146790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0] Write session will restart in 0.008473s
2025-10-01T14:12:20.146814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0] Write session: Do CDS request
2025-10-01T14:12:20.146819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:20.148031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:20.156949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.157101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:20.157115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1632
2025-10-01T14:12:20.157237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.157267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:20.157290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:20.157293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:20.157691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1632 sessionId:  describe result for acl check
2025-10-01T14:12:20.157732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:20.157739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:20.157741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:20.157747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255969316148980:7722] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:20.158269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255969316148980:7722] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:20.159971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:20.160969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255969316148980:7722] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:20.161916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:20.162133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:20.162142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:20.162162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:20.162215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:20.162255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255966939259976:4738]
2025-10-01T14:12:20.162841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:20.163199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:20.163244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:20.163492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:20.163528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.163534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.163535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.163536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.163537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.163539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.163540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.163541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.163542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.163543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.163544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.163545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.163546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.163547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.163552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.163562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.163566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.163568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.163570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.163573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.163575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.163577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.163582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.163590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.163594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.163602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.163606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.163614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.163619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.163625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.163640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.163647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.163650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.163654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.163660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.163663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.163666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.163673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.163675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.163678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.163684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.163688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.163690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.163697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.163700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.163706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.163709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.163712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.163715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.163720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.163728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.163733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.163745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.163750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.163753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.163759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.163794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:20.164309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255969316148980:7722] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:20.164321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255969316148980:7722] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:20.164323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255969316148980:7722] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:20.164330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:20.167612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:20.168201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:20.168216Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:20.168218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:20.168221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:20.168226Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1631 [2:7556255966939259976:4738]
2025-10-01T14:12:20.168235Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:20.168247Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:20.168254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.168258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.168260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.168275Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:20.168295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:20.168307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:20.168358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.168366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.168367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.168370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:20.168372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:20.168523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1631
2025-10-01T14:12:20.168523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1631
2025-10-01T14:12:20.168635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:20.168644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.168663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.168679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.168698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:20.168722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149036:7722], now have 1 active actors on pipe
2025-10-01T14:12:20.168729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316148745:2446], now have 1 active actors on pipe
2025-10-01T14:12:20.168747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.168756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.168777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255966939259971:4738]
2025-10-01T14:12:20.168784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255966939259971:4738]
2025-10-01T14:12:20.168786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255966939259971:4738]
2025-10-01T14:12:20.168800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:20.168815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:20.168817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:20.168825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:20.168827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:20.168831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:20.168834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:20.168848Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69c1a861-be0592bc-fac92324-82127a8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:20.168859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.168867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.168869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:20.168877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.168891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:20.168929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255966939259971:4738]
2025-10-01T14:12:20.168943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:20.168950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:20.168954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.169070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.169078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.169095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.169163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1632 partition: 0 MaxSeqNo: 45 sessionId: src_id|69c1a861-be0592bc-fac92324-82127a8e_0
2025-10-01T14:12:20.169539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|281e5804-9a233c3e-e175bf3-5b5c20fc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|69c1a861-be0592bc-fac92324-82127a8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:20.172042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c1a861-be0592bc-fac92324-82127a8e_0] Write session: try to update token
2025-10-01T14:12:20.172061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c1a861-be0592bc-fac92324-82127a8e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:20.180243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:20.180259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:20.180268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255966939259971:4738]
2025-10-01T14:12:20.180307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:20.180313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:20.180474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:20.180611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:20.180779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:20.180934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:20.181129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:20.181170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:20.186083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1632 sessionId: src_id|69c1a861-be0592bc-fac92324-82127a8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:20.188477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:20.188671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.188695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.188732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:20.188945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:20.202735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:20.202760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:20.202762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:20.202765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:20.202775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255966939259971:4738]
2025-10-01T14:12:20.202779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255966939259971:4738]
2025-10-01T14:12:20.202783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255966939259971:4738]
2025-10-01T14:12:20.202834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:20.202837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:20.202845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.202847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:20.202848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:20.202851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:20.202989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:20.246578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255969316149043:7971]
2025-10-01T14:12:20.246881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1631, pipe: [1:7556255969316149043:7971]
2025-10-01T14:12:20.342627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:20.349504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.349530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.349664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.349725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.349780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.349831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.349873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.349880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.349940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.349993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.350047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.350098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.350143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.350149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.350203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.350257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.350310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.350364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.350425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.350430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.350483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.350537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.350593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.350648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.350688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.350694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.350750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.350810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.350863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.350915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.350957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.350965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.351023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.351074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.351143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.351203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.351247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.351252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.351330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.351379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.351431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.351488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.351532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.351538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.351595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.351648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.351702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.351755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.351791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.351797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.351858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.351909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.351963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.352023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.352064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.352071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.352132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:20.352187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:20.352240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:20.352295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:20.352332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:20.352337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:20.352376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149043:7971], now have 1 active actors on pipe
2025-10-01T14:12:20.352653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:20.352663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:20.352686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1632 reason: error at write: Disconnected sessionId: src_id|69c1a861-be0592bc-fac92324-82127a8e_0
2025-10-01T14:12:20.352841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1632 sessionId: src_id|69c1a861-be0592bc-fac92324-82127a8e_0 is DEAD
2025-10-01T14:12:20.352871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255969316149043:7971]
2025-10-01T14:12:20.352896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:20.352976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c1a861-be0592bc-fac92324-82127a8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:20.352985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c1a861-be0592bc-fac92324-82127a8e_0] Write session will restart in 0.007290s
2025-10-01T14:12:20.353004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c1a861-be0592bc-fac92324-82127a8e_0] Write session: Do CDS request
2025-10-01T14:12:20.353009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c1a861-be0592bc-fac92324-82127a8e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:20.353234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:20.361856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69c1a861-be0592bc-fac92324-82127a8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.361902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:20.361912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1633
2025-10-01T14:12:20.362050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.362073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:20.362079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:20.362082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:20.362508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1633 sessionId:  describe result for acl check
2025-10-01T14:12:20.362549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:20.362551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:20.362552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:20.362557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255969316149268:7710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:20.363052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255969316149268:7710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:20.364941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:20.365118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255969316149268:7710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:20.366891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:20.367063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:20.367074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:20.367086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:20.367136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:20.367171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255966939260191:4736]
2025-10-01T14:12:20.367497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255969316149268:7710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:20.367508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255969316149268:7710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:20.367513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255969316149268:7710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:20.367521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:20.367850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:20.368082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:20.368115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:20.368333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:20.368369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.368374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.368374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.368375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.368376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.368377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.368377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.368378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.368379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.368379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.368380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.368381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.368382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.368382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.368386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.368394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.368398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.368401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.368404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.368408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.368412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.368416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.368419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.368423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.368427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.368430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.368434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.368437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.368445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.368452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.368457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.368460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.368464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.368467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.368469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.368472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.368475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.368478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.368480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.368483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.368486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.368489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.368491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.368494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.368496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.368498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.368501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.368503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.368506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.368509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.368511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.368515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.368519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.368524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.368528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.368533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.368571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:20.372064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:20.372693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:20.372711Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:20.372714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:20.372718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:20.372725Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1632 [2:7556255966939260191:4736]
2025-10-01T14:12:20.372739Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:20.372759Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:20.372766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.372770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.372772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.372786Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:20.372795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:20.372802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:20.372860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.372866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.372867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.372870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:20.372873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:20.372937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:20.372945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.372957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.372972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.372989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:20.373007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149058:2446], now have 1 active actors on pipe
2025-10-01T14:12:20.373016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149345:7710], now have 1 active actors on pipe
2025-10-01T14:12:20.373024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255966939260186:4736]
2025-10-01T14:12:20.373030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255966939260186:4736]
2025-10-01T14:12:20.373032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255966939260186:4736]
2025-10-01T14:12:20.373047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:20.373060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:20.373069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:20.373072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:20.373073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:20.373079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:20.373083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:20.373076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1632
2025-10-01T14:12:20.373080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1632
2025-10-01T14:12:20.373113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255966939260186:4736]
2025-10-01T14:12:20.373125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:20.373129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:20.373140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.373149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.373192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ca2e777-47ee120c-348a47a2-7369000f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:20.373203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.373212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.373217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:20.373226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.373238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:20.373256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.373377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.373383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.373395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.373451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1633 partition: 0 MaxSeqNo: 45 sessionId: src_id|8ca2e777-47ee120c-348a47a2-7369000f_0
2025-10-01T14:12:20.373755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69c1a861-be0592bc-fac92324-82127a8e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8ca2e777-47ee120c-348a47a2-7369000f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:20.376000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca2e777-47ee120c-348a47a2-7369000f_0] Write session: try to update token
2025-10-01T14:12:20.376015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca2e777-47ee120c-348a47a2-7369000f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:20.389152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1633 sessionId: src_id|8ca2e777-47ee120c-348a47a2-7369000f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:20.391536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:20.392694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.392721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.392744Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:20.392747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:20.392750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:20.392752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:20.392760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255966939260186:4736]
2025-10-01T14:12:20.392764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255966939260186:4736]
2025-10-01T14:12:20.392768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255966939260186:4736]
2025-10-01T14:12:20.392802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:20.392814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:20.392817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:20.392829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:20.392835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.392838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:20.392975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:20.452904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255969316149363:7971]
2025-10-01T14:12:20.453185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1632, pipe: [1:7556255969316149363:7971]
2025-10-01T14:12:20.529918Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:20.530246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:20.530289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149363:7971], now have 1 active actors on pipe
2025-10-01T14:12:20.530361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:20.530482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255969316149363:7971]
2025-10-01T14:12:20.530502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:20.541405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:20.541419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:20.541444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1633 reason: error at write: Disconnected sessionId: src_id|8ca2e777-47ee120c-348a47a2-7369000f_0
2025-10-01T14:12:20.541607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1633 sessionId: src_id|8ca2e777-47ee120c-348a47a2-7369000f_0 is DEAD
2025-10-01T14:12:20.541764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca2e777-47ee120c-348a47a2-7369000f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:20.541772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca2e777-47ee120c-348a47a2-7369000f_0] Write session will restart in 0.007478s
2025-10-01T14:12:20.541809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca2e777-47ee120c-348a47a2-7369000f_0] Write session: Do CDS request
2025-10-01T14:12:20.541819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca2e777-47ee120c-348a47a2-7369000f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:20.549517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:20.550966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca2e777-47ee120c-348a47a2-7369000f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.550997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:20.551016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1634
2025-10-01T14:12:20.551201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.551242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:20.551252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:20.551266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:20.551298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:20.551481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:20.551493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:20.551504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:20.551546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:20.551585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255966939260406:4727]
2025-10-01T14:12:20.551649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1634 sessionId:  describe result for acl check
2025-10-01T14:12:20.551676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:20.551678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:20.551679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:20.551684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255969316149623:7701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:20.552212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255969316149623:7701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:20.552412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:20.552677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:20.552715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:20.553017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:20.553066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.553071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.553072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.553074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.553075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.553076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.553077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.553079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.553080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.553081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.553082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.553083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.553085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.553086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.553091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.553101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.553104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.553108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.553111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.553115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.553118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.553121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.553125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.553128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.553132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.553135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.553139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.553142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.553148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.553155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.553160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.553165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.553169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.553174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.553178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.553183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.553188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.553197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.553201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.553206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.553212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.553216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.553221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.553225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.553229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.553234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.553238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.553244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.553248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.553252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.553258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.553262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.553267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.553271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.553275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.553283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.553319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:20.554095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255969316149623:7701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:20.556911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:20.557095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255969316149623:7701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:20.557107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255969316149623:7701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:20.557111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255969316149623:7701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:20.557119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:20.557864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:20.557881Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:20.557884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:20.557887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:20.557894Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1633 [2:7556255966939260406:4727]
2025-10-01T14:12:20.557908Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:20.557924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:20.557932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.557936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.557938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.557954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:20.557962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:20.557968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:20.558019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.558026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.558028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.558031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:20.558034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:20.558196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1633
2025-10-01T14:12:20.558202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1633
2025-10-01T14:12:20.558096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:20.558109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.558121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.558131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.558146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:20.558164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149661:7701], now have 1 active actors on pipe
2025-10-01T14:12:20.558167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149367:2446], now have 1 active actors on pipe
2025-10-01T14:12:20.558174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255966939260401:4727]
2025-10-01T14:12:20.558176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255966939260401:4727]
2025-10-01T14:12:20.558178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255966939260401:4727]
2025-10-01T14:12:20.558193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:20.558206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:20.558215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:20.558217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:20.558218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:20.558219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:20.558221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:20.558253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255966939260401:4727]
2025-10-01T14:12:20.558261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:20.558280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:20.558281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.558286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.558332Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72967174-984a982b-26e28875-7e992eb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:20.558339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.558343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.558345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:20.558354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.558363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:20.558404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.558561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.558572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.558593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.558673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1634 partition: 0 MaxSeqNo: 45 sessionId: src_id|72967174-984a982b-26e28875-7e992eb3_0
2025-10-01T14:12:20.559024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ca2e777-47ee120c-348a47a2-7369000f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72967174-984a982b-26e28875-7e992eb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:20.561527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72967174-984a982b-26e28875-7e992eb3_0] Write session: try to update token
2025-10-01T14:12:20.561548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72967174-984a982b-26e28875-7e992eb3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:20.577701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1634 sessionId: src_id|72967174-984a982b-26e28875-7e992eb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:20.580020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:20.580043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:20.580045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:20.580047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:20.580057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255966939260401:4727]
2025-10-01T14:12:20.580061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255966939260401:4727]
2025-10-01T14:12:20.580065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255966939260401:4727]
2025-10-01T14:12:20.580108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:20.580113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:20.580115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:20.580119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:20.580120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.580122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:20.580284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:20.580451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:20.631003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255969316149669:7971]
2025-10-01T14:12:20.631443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1633, pipe: [1:7556255969316149669:7971]
2025-10-01T14:12:20.725923Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:20.726152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.726164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.726200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149669:7971], now have 1 active actors on pipe
2025-10-01T14:12:20.726451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255969316149669:7971]
2025-10-01T14:12:20.726587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:20.726788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:20.726406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:20.726867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1634 reason: status is not ok: tablet will be restarted right now sessionId: src_id|72967174-984a982b-26e28875-7e992eb3_0
2025-10-01T14:12:20.727051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1634 sessionId: src_id|72967174-984a982b-26e28875-7e992eb3_0 is DEAD
2025-10-01T14:12:20.727177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72967174-984a982b-26e28875-7e992eb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:20.727185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72967174-984a982b-26e28875-7e992eb3_0] Write session will restart in 0.007887s
2025-10-01T14:12:20.727214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72967174-984a982b-26e28875-7e992eb3_0] Write session: Do CDS request
2025-10-01T14:12:20.727220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72967174-984a982b-26e28875-7e992eb3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:20.735937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72967174-984a982b-26e28875-7e992eb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.736007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:20.736023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1635
2025-10-01T14:12:20.736128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.736156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:20.736165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:20.736169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:20.736693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1635 sessionId:  describe result for acl check
2025-10-01T14:12:20.736726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:20.736732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:20.736734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:20.736739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255969316149798:7684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:20.737285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255969316149798:7684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:20.739499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255969316149798:7684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:20.741862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255969316149798:7684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:20.741874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255969316149798:7684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:20.741878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255969316149798:7684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:20.741885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:20.742477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:20.752319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:20.752574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:20.752584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:20.752596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:20.752643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:20.752695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255966939260633:4723]
2025-10-01T14:12:20.753392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:20.753671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:20.753715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:20.754036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:20.754088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.754093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.754095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.754096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.754097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.754099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.754100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.754102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.754103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.754105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.754106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.754107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.754108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.754110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.754114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.754125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.754129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.754133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.754138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.754143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.754146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.754150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.754154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.754158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.754161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.754165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.754168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.754172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.754179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.754186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.754192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.754197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.754201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.754207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.754212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.754218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.754222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.754228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.754232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.754237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.754242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.754247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.754254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.754259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.754268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.754274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.754283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.754288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.754299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.754307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.754311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.754321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.754328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.754337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.754341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.754346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.754405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:20.758347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:20.759126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:20.759143Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:20.759146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:20.759150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:20.759158Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1634 [2:7556255966939260633:4723]
2025-10-01T14:12:20.759173Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:20.759190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:20.759198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.759201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.759204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.759221Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:20.759231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:20.759237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:20.759298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.759304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.759307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.759310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:20.759313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:20.759382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:20.759390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.759402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.759417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.759437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:20.759459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149695:2446], now have 1 active actors on pipe
2025-10-01T14:12:20.759467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316149980:7684], now have 1 active actors on pipe
2025-10-01T14:12:20.759475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255966939260628:4723]
2025-10-01T14:12:20.759481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255966939260628:4723]
2025-10-01T14:12:20.759484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255966939260628:4723]
2025-10-01T14:12:20.759497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:20.759506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:20.759509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:20.759511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:20.759515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:20.759529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:20.759538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:20.759548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1634
2025-10-01T14:12:20.759569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1634
2025-10-01T14:12:20.759572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255966939260628:4723]
2025-10-01T14:12:20.759582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:20.759604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:20.759623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.759628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.759657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:20.759668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.759673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.759675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:20.759684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.759697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:20.759712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.759880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.759895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.759910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.760011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1635 partition: 0 MaxSeqNo: 45 sessionId: src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0
2025-10-01T14:12:20.760381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72967174-984a982b-26e28875-7e992eb3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:20.762964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0] Write session: try to update token
2025-10-01T14:12:20.762983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:20.777872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1635 sessionId: src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:20.778038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:12:20.778074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 12
2025-10-01T14:12:20.778400Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:12:20.778700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 14 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:12:20.778739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:12:20.780588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:20.781140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.781165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.781184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:20.781187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:20.781190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:20.781191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:20.781200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255966939260628:4723]
2025-10-01T14:12:20.781204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255966939260628:4723]
2025-10-01T14:12:20.781209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255966939260628:4723]
2025-10-01T14:12:20.781243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:20.781256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:20.781260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:20.781265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:20.781271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.781274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:20.781411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:20.826671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255969316150000:7971]
2025-10-01T14:12:20.827116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1634, pipe: [1:7556255969316150000:7971]
2025-10-01T14:12:20.937197Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:20.937641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:20.937688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316150000:7971], now have 1 active actors on pipe
2025-10-01T14:12:20.937813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:20.938704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255969316150000:7971]
2025-10-01T14:12:20.938726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:20.938739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-01T14:12:20.950069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:20.950081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:20.950104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1635 reason: error at write: Disconnected sessionId: src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0
2025-10-01T14:12:20.950280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1635 sessionId: src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0 is DEAD
2025-10-01T14:12:20.952615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:20.952626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0] Write session will restart in 0.009600s
2025-10-01T14:12:20.952663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0] Write session: Do CDS request
2025-10-01T14:12:20.952669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:20.963749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:20.963854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.964180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:20.964194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1636
2025-10-01T14:12:20.964301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:20.964333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:20.964344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:20.964371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:20.964771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1636 sessionId:  describe result for acl check
2025-10-01T14:12:20.964804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:20.964810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:20.964811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:20.964816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255969316150268:7676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:20.965305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255969316150268:7676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:20.965522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:20.965670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:20.965679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:20.965686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:20.965721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:20.965748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255966939260850:4720]
2025-10-01T14:12:20.966172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:20.966416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:20.966451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:20.966676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:20.966715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.966720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.966720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.966721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.966722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.966723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.966723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.966724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.966725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.966725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.966726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.966726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.966727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.966728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.966731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.966737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.966739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.966741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.966744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.966746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.966747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.966749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.966752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.966754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.966756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.966758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.966761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.966762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.966766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.966771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:20.966774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.966777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:20.966780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.966782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:20.966785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.966788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:20.966790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.966793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:20.966795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.966798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:20.966801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.966807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:20.966810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.966813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:20.966819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.966821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:20.966824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.966826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.966832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.966835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.966837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.966839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.966844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.966847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:20.966849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.966852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:20.966876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:20.967403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255969316150268:7676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:20.970182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255969316150268:7676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:20.970194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255969316150268:7676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:20.970197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255969316150268:7676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:20.970204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:20.970358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:20.971389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:20.971407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:20.971409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:20.971412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:20.971419Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1635 [2:7556255966939260850:4720]
2025-10-01T14:12:20.971436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:20.971456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:20.971464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.971468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.971470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.971485Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:20.971494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:20.971500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:20.971560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.971567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.971568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.971571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:20.971574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:20.971643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:20.971650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.971661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:20.971671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:20.971685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:20.971710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316150303:7676], now have 1 active actors on pipe
2025-10-01T14:12:20.971717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255969316150007:2446], now have 1 active actors on pipe
2025-10-01T14:12:20.971723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255966939260845:4720]
2025-10-01T14:12:20.971725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255966939260845:4720]
2025-10-01T14:12:20.971727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255966939260845:4720]
2025-10-01T14:12:20.971741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:20.971760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:20.971760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:20.971762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:20.971764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:20.971777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:20.971783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:20.971779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1635
2025-10-01T14:12:20.971780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1635
2025-10-01T14:12:20.971810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255966939260845:4720]
2025-10-01T14:12:20.971818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:20.971819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:20.971866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.971876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.971932Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:12:20.971962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:20.971973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:20.971981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:20.971983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:20.971992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:20.972001Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:20.972031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.972107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 15 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:12:20.972140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:12:20.972187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.972195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.972211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:20.972299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1636 partition: 0 MaxSeqNo: 45 sessionId: src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0
2025-10-01T14:12:20.972666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d0340fa-b1f79cba-399878cc-7b76400c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:20.975191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0] Write session: try to update token
2025-10-01T14:12:20.975214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:20.988319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1636 sessionId: src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:20.990928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:20.992014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:20.992036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:20.992058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:20.992063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:20.992065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:20.992066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:20.992075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255966939260845:4720]
2025-10-01T14:12:20.992079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255966939260845:4720]
2025-10-01T14:12:20.992085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255966939260845:4720]
2025-10-01T14:12:20.992125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:20.992133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:20.992137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:20.992147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:20.992158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:20.992161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:20.992281Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:21.038653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255973611117610:7971]
2025-10-01T14:12:21.039011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1635, pipe: [1:7556255973611117610:7971]
2025-10-01T14:12:21.151895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:21.152385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:21.152442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611117610:7971], now have 1 active actors on pipe
2025-10-01T14:12:21.152537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:21.152612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255973611117610:7971]
2025-10-01T14:12:21.152635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:21.152641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:21.152644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:21.152724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1636 reason: error at write: Disconnected sessionId: src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0
2025-10-01T14:12:21.153028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1636 sessionId: src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0 is DEAD
2025-10-01T14:12:21.153115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:21.153127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0] Write session will restart in 0.008002s
2025-10-01T14:12:21.153153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0] Write session: Do CDS request
2025-10-01T14:12:21.153164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:21.161976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.162125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:21.162140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1637
2025-10-01T14:12:21.162296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.162338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:21.162348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:21.162382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:21.162883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1637 sessionId:  describe result for acl check
2025-10-01T14:12:21.162923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:21.162929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:21.162932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:21.162938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255973611117735:7671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:21.163483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255973611117735:7671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:21.166152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255973611117735:7671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:21.168802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255973611117735:7671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:21.168816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255973611117735:7671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:21.168820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255973611117735:7671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:21.168829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:21.169361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:21.170940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:21.171164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:21.171173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:21.171187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:21.171237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:21.171280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255971234228409:4700]
2025-10-01T14:12:21.171882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:21.172114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:21.172144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:21.172378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:21.172434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.172439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.172441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.172442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.172443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.172444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.172445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.172446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.172446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.172447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.172448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.172449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.172450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.172451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.172457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.172467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.172471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.172475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.172479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.172483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.172487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.172491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.172495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.172498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.172501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.172504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.172507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.172511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.172517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.172524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.172529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.172535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.172539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.172544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.172553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.172559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.172567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.172573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.172581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.172586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.172594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.172599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.172603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.172608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.172615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.172618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.172620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.172623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.172625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.172628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.172631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.172637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.172640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.172642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.172644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.172658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.172687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:21.176216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:21.176868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:21.176879Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:21.176882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:21.176885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:21.176892Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1636 [2:7556255971234228409:4700]
2025-10-01T14:12:21.176907Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:21.176923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:21.176928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.176930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.176932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.176943Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:21.176947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:21.176955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:21.176997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.177001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.177002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.177005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:21.177007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:21.177181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1636
2025-10-01T14:12:21.177193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1636
2025-10-01T14:12:21.177206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:21.177215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.177222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.177229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.177239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:21.177253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611117907:7671], now have 1 active actors on pipe
2025-10-01T14:12:21.177255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611117616:2446], now have 1 active actors on pipe
2025-10-01T14:12:21.177271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.177278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.177292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255971234228404:4700]
2025-10-01T14:12:21.177297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255971234228404:4700]
2025-10-01T14:12:21.177299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255971234228404:4700]
2025-10-01T14:12:21.177309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:21.177320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:21.177322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:21.177327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:21.177328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:21.177331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:21.177333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:21.177344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:21.177349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.177351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.177353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:21.177359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.177365Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:21.177387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255971234228404:4700]
2025-10-01T14:12:21.177399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:21.177410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.177423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:21.177538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.177546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.177557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.177628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1637 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0
2025-10-01T14:12:21.178017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|649d86f7-6814d411-7cc95e09-f4c2d977_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:21.180397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0] Write session: try to update token
2025-10-01T14:12:21.180414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:21.194652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:21.194667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:21.194676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255971234228404:4700]
2025-10-01T14:12:21.194726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:21.194734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:21.194914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:21.195080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:21.195226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:21.195356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:21.195555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:21.195590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:21.195635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1637 sessionId: src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:21.198109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:21.198288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.198304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.198340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:21.198425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:21.209402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:21.209417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:21.209419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:21.209421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:21.209430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255971234228404:4700]
2025-10-01T14:12:21.209434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255971234228404:4700]
2025-10-01T14:12:21.209437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255971234228404:4700]
2025-10-01T14:12:21.209480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:21.209480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:21.209484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:21.209486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.209488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:21.209489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:21.209621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:21.254434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255973611117919:7971]
2025-10-01T14:12:21.254810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1636, pipe: [1:7556255973611117919:7971]
2025-10-01T14:12:21.376140Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:21.385248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.385280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.385462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.385529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.385599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.385667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.385714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.385727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.385799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.385863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.385925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.385996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.386041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.386049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.386113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.386169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.386230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.386321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.386362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.386386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.386454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.386513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.386577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.386638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.386685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.386697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.386766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.386828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.386895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.386959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.387009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.387012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.387084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.387140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.387197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.387258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.387303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.387306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.387367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.387426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.387483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.387536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.387574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.387577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.387647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.387712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.387791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.387865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.387909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.387916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.387986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.388052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.388119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.388181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.388224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.388235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.388299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.388357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.388425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.388486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.388532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.388539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.388612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611117919:7971], now have 1 active actors on pipe
2025-10-01T14:12:21.389268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:21.389287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0] Write session will restart in 0.007217s
2025-10-01T14:12:21.389313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0] Write session: Do CDS request
2025-10-01T14:12:21.389319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:21.388880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:21.388893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:21.388933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1637 reason: error at write: Disconnected sessionId: src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0
2025-10-01T14:12:21.389134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1637 sessionId: src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0 is DEAD
2025-10-01T14:12:21.389296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:21.389334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255973611117919:7971]
2025-10-01T14:12:21.389143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:21.397915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.397976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:21.397988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1638
2025-10-01T14:12:21.398236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.398274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:21.398284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:21.398288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:21.398680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1638 sessionId:  describe result for acl check
2025-10-01T14:12:21.398714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:21.398723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:21.398725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:21.398741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255973611118049:7665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:21.399291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255973611118049:7665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:21.402876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255973611118049:7665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:21.406507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255973611118049:7665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:21.406525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255973611118049:7665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:21.406528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255973611118049:7665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:21.406537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:21.407941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:21.409820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:21.410020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:21.410029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:21.410041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:21.410089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:21.410132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255971234228631:4694]
2025-10-01T14:12:21.410717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:21.411028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:21.411071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:21.411375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:21.411750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.411756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.411758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.411759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.411760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.411761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.411763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.411764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.411765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.411766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.411767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.411768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.411769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.411770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.411775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.411785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.411789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.411793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.411796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.411800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.411804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.411808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.411811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.411815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.411819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.411823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.411826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.411830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.411837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.411849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.411858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.411864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.411868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.411873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.411880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.411885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.411894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.411899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.411907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.411911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.411920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.411929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.411933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.411937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.411942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.411947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.411951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.411956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.411962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.411971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.411976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.411985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.411993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.411997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.412005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.412010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.412051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:21.415551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:21.416140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:21.416152Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:21.416155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:21.416158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:21.416167Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1637 [2:7556255971234228631:4694]
2025-10-01T14:12:21.416181Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:21.416199Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:21.416205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.416207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.416209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.416220Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:21.416227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:21.416231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:21.416269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.416274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.416276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.416279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:21.416281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:21.416333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:21.416337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.416344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.416350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.416359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:21.416377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611117936:2446], now have 1 active actors on pipe
2025-10-01T14:12:21.416379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611118228:7665], now have 1 active actors on pipe
2025-10-01T14:12:21.416384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255971234228626:4694]
2025-10-01T14:12:21.416389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255971234228626:4694]
2025-10-01T14:12:21.416391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255971234228626:4694]
2025-10-01T14:12:21.416399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:21.416409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:21.416411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:21.416413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:21.416415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:21.416421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:21.416423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:21.416446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255971234228626:4694]
2025-10-01T14:12:21.416455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:21.416461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:21.416515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1637
2025-10-01T14:12:21.416572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.416581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.416590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1637
2025-10-01T14:12:21.416601Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:21.416611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.416617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.416623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:21.416631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.416643Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:21.416671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.417159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.417168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.417185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.417285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1638 partition: 0 MaxSeqNo: 45 sessionId: src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0
2025-10-01T14:12:21.417651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc83d28d-43ce5270-153d0f7d-51da4ca3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:21.420123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0] Write session: try to update token
2025-10-01T14:12:21.420143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:21.434255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1638 sessionId: src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:21.436816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:21.437777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.437800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.437820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:21.437823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:21.437826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:21.437827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:21.437835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255971234228626:4694]
2025-10-01T14:12:21.437840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255971234228626:4694]
2025-10-01T14:12:21.437844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255971234228626:4694]
2025-10-01T14:12:21.437879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:21.437882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:21.437889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:21.437894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:21.437901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.437905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:21.438029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:21.489700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255973611118248:7971]
2025-10-01T14:12:21.489943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1637, pipe: [1:7556255973611118248:7971]
2025-10-01T14:12:21.574409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:21.574885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:21.574944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611118248:7971], now have 1 active actors on pipe
2025-10-01T14:12:21.575015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:21.575129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:21.575179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255973611118248:7971]
2025-10-01T14:12:21.585186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:21.585196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:21.585217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1638 reason: error at write: Disconnected sessionId: src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0
2025-10-01T14:12:21.585376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1638 sessionId: src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0 is DEAD
2025-10-01T14:12:21.585511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:21.585520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0] Write session will restart in 0.009825s
2025-10-01T14:12:21.585538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0] Write session: Do CDS request
2025-10-01T14:12:21.585544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:21.592742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:21.594526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:21.594708Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:21.594732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:21.594743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:21.594783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:21.594821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255971234228852:4698]
2025-10-01T14:12:21.595261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:21.595517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:21.595555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:21.595803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:21.595851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.595856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.595857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.595859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.595860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.595861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.595862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.595863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.595864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.595865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.595866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.595868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.595868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.595870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.595874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.595884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.595888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.595892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.595895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.595899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.595903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.595906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.595910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.595914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.595917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.595921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.595924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.595928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.595934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.595941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.595946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.595951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.595957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.595962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.595967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.595971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.595976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.595981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.595984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.595989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.595995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.595999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.596001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.596003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.596006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.596008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.596011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.596013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.596016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.596018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.596021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.596024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.596026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.596029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.596031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.596033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.596062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:21.596895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.596987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:21.597003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1639
2025-10-01T14:12:21.597295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.597329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:21.597338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:21.597342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:21.597734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1639 sessionId:  describe result for acl check
2025-10-01T14:12:21.597770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:21.597775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:21.597777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:21.597783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255973611118514:7659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:21.598217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255973611118514:7659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:21.599732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:21.600350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:21.600365Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:21.600367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:21.600370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:21.600376Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1638 [2:7556255971234228852:4698]
2025-10-01T14:12:21.600389Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:21.600403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:21.600406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.600409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.600411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.600425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:21.600435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:21.600440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:21.600487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.600495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.600497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.600500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:21.600502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:21.600562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:21.600569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.600579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.600592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.600609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:21.600628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611118250:2446], now have 1 active actors on pipe
2025-10-01T14:12:21.600611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255973611118514:7659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:21.600636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255971234228847:4698]
2025-10-01T14:12:21.600641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255971234228847:4698]
2025-10-01T14:12:21.600643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255971234228847:4698]
2025-10-01T14:12:21.600671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:21.600669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1638
2025-10-01T14:12:21.600685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:21.600688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:21.600690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:21.600690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:21.600701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:21.600704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:21.600733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255971234228847:4698]
2025-10-01T14:12:21.600739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:21.600745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:21.605629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255973611118514:7659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:21.605641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255973611118514:7659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:21.605644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255973611118514:7659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:21.605651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:21.605879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611118552:7659], now have 1 active actors on pipe
2025-10-01T14:12:21.605922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1638
2025-10-01T14:12:21.605977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.605999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.606027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:21.606037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.606044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.606048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:21.606061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.606078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:21.606097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.606593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.606617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.606639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.606785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1639 partition: 0 MaxSeqNo: 45 sessionId: src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0
2025-10-01T14:12:21.607171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a12ab002-fbfd173f-7fbbaebd-7b966770_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:21.609603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0] Write session: try to update token
2025-10-01T14:12:21.609618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:21.611438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:21.611452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:21.611460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255971234228847:4698]
2025-10-01T14:12:21.611502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:21.611502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:21.611661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:21.611799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:21.611930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:21.612060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:21.612238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:21.612274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:21.622853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1639 sessionId: src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:21.625460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:21.625665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.625685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.625723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:21.625800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:21.633739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:21.633757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:21.633759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:21.633761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:21.633772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255971234228847:4698]
2025-10-01T14:12:21.633776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255971234228847:4698]
2025-10-01T14:12:21.633780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255971234228847:4698]
2025-10-01T14:12:21.633819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:21.633824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:21.633824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:21.633828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:21.633831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.633834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:21.633960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:21.675558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255973611118556:7971]
2025-10-01T14:12:21.675802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1638, pipe: [1:7556255973611118556:7971]
2025-10-01T14:12:21.777503Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:21.784706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.784726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.784868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.784928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.784991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.785048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.785087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.785095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.785156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.785222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.785275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.785336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.785377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.785382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.785452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.785512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.785570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.785628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.785674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.785682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.785745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.785803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.785865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.785933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.785977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.785982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.786039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.786095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.786164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.786234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.786282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.786289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.786359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.786433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.786491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.786555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.786597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.786602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.786660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.786718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.786779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.786844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.786888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.786893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.786960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.787015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.787076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.787135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.787181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.787190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.787258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.787313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.787385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.787442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.787489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.787494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.787550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:21.787615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:21.787676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:21.787733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:21.787779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:21.787786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:21.787828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611118556:7971], now have 1 active actors on pipe
2025-10-01T14:12:21.788040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:21.788052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:21.788054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255973611118556:7971]
2025-10-01T14:12:21.788078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1639 reason: error at write: Disconnected sessionId: src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0
2025-10-01T14:12:21.788079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:21.788277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1639 sessionId: src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0 is DEAD
2025-10-01T14:12:21.788392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:21.788400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0] Write session will restart in 0.009787s
2025-10-01T14:12:21.788424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0] Write session: Do CDS request
2025-10-01T14:12:21.788430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:21.788824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:21.798850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.798919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:21.798932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1640
2025-10-01T14:12:21.799045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.799089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:21.799098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:21.799101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:21.799517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1640 sessionId:  describe result for acl check
2025-10-01T14:12:21.799549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:21.799551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:21.799553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:21.799558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255973611118775:7643] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:21.800017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255973611118775:7643] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:21.801854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255973611118775:7643] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:21.803311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:21.804941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:21.805145Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:21.805158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:21.805169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:21.805212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:21.805245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255971234229080:4688]
2025-10-01T14:12:21.805271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255973611118775:7643] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:21.805282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255973611118775:7643] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:21.805285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255973611118775:7643] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:21.805293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:21.805701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:21.805936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:21.805973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:21.806261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:21.806309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.806314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.806315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.806316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.806317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.806318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.806319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.806320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.806321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.806322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.806324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.806325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.806326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.806327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.806331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.806340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.806344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.806347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.806350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.806354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.806357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.806360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.806363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.806366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.806384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.806387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.806390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.806393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.806399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.806406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.806411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.806415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.806419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.806424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.806428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.806432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.806437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.806442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.806448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.806452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.806456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.806461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.806466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.806471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.806475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.806482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.806486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.806490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.806496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.806500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.806504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.806508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.806513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.806521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.806524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.806533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.806565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:21.810273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:21.810920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:21.810931Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:21.810933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:21.810936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:21.810942Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1639 [2:7556255971234229080:4688]
2025-10-01T14:12:21.810955Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:21.810970Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:21.810973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.810977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.810982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.810997Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:21.811006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:21.811011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:21.811222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.811234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.811236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.811239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:21.811242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:21.811303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:21.811308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.811318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.811327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.811341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:21.811357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611118875:7643], now have 1 active actors on pipe
2025-10-01T14:12:21.811360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611118583:2446], now have 1 active actors on pipe
2025-10-01T14:12:21.811367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255971234229075:4688]
2025-10-01T14:12:21.811369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255971234229075:4688]
2025-10-01T14:12:21.811372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255971234229075:4688]
2025-10-01T14:12:21.811385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:21.811397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:21.811400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:21.811402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:21.811405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:21.811410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:21.811413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:21.811424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1639
2025-10-01T14:12:21.811429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1639
2025-10-01T14:12:21.811436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255971234229075:4688]
2025-10-01T14:12:21.811444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:21.811446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:21.811462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.811466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.811505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:21.811511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.811515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.811517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:21.811524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.811531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:21.811545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.811662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.811674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.811696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.811758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1640 partition: 0 MaxSeqNo: 45 sessionId: src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0
2025-10-01T14:12:21.812078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9fce3e3-a913386c-9ab7858b-26e3a548_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:21.814458Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0] Write session: try to update token
2025-10-01T14:12:21.814476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:21.828362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1640 sessionId: src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:21.830807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:21.831540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.831562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.831583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:21.831585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:21.831588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:21.831590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:21.831597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255971234229075:4688]
2025-10-01T14:12:21.831602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255971234229075:4688]
2025-10-01T14:12:21.831607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255971234229075:4688]
2025-10-01T14:12:21.831640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:21.831651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:21.831654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:21.831663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:21.831672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.831674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:21.831819Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:21.888021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255973611118888:7971]
2025-10-01T14:12:21.888243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1639, pipe: [1:7556255973611118888:7971]
2025-10-01T14:12:21.963087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:21.963469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:21.963514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611118888:7971], now have 1 active actors on pipe
2025-10-01T14:12:21.963588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:21.963672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255973611118888:7971]
2025-10-01T14:12:21.963695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:21.971576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:21.971585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:21.971603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1640 reason: error at write: Disconnected sessionId: src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0
2025-10-01T14:12:21.971746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1640 sessionId: src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0 is DEAD
2025-10-01T14:12:21.971896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:21.971906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0] Write session will restart in 0.009899s
2025-10-01T14:12:21.971924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0] Write session: Do CDS request
2025-10-01T14:12:21.971931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:21.978127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:21.979733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:21.979864Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:21.979872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:21.979880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:21.979920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:21.979947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255971234229302:4684]
2025-10-01T14:12:21.980314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:21.980540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:21.980574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:21.980786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:21.980822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.980827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.980827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.980828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.980829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.980829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.980830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.980830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.980831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.980831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.980832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.980833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.980833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.980834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.980837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.980843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.980845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.980847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.980849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.980851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.980853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.980855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.980857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.980860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.980862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.980864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.980866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.980868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.980873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.980877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:21.980881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.980884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:21.980888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.980890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:21.980892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.980895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:21.980898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.980901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:21.980903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.980905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:21.980908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.980910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:21.980913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.980915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:21.980918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.980921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:21.980923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.980926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.980928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.980931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.980934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.980937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.980939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.980942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:21.980944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.980948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:21.980968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:21.982814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.982904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:21.982914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1641
2025-10-01T14:12:21.983016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:21.983038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:21.983046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:21.983048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:21.983346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1641 sessionId:  describe result for acl check
2025-10-01T14:12:21.983380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:21.983386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:21.983387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:21.983392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255973611119160:7632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:21.983778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255973611119160:7632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:21.984366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:21.984988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:21.984999Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:21.985001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:21.985003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:21.985008Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1640 [2:7556255971234229302:4684]
2025-10-01T14:12:21.985016Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:21.985027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:21.985032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.985035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.985036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.985046Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:21.985053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:21.985057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:21.985093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.985098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.985099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.985101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:21.985103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:21.985148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:21.985153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:21.985160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:21.985165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:21.985174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:21.985189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611118894:2446], now have 1 active actors on pipe
2025-10-01T14:12:21.985198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255971234229297:4684]
2025-10-01T14:12:21.985203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255971234229297:4684]
2025-10-01T14:12:21.985204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255971234229297:4684]
2025-10-01T14:12:21.985213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:21.985225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:21.985228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:21.985231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:21.985233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:21.985236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:21.985238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:21.985254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255971234229297:4684]
2025-10-01T14:12:21.985259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:21.985261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:21.985242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1640
2025-10-01T14:12:21.985564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255973611119160:7632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:21.991259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255973611119160:7632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:21.991268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255973611119160:7632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:21.991284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255973611119160:7632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:21.991290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:21.991458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255973611119195:7632], now have 1 active actors on pipe
2025-10-01T14:12:21.991493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1640
2025-10-01T14:12:21.991544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.991552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.991572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9654912-6433216a-50106f88-92c9964b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:21.991583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:21.991602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:21.991604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:21.991612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:21.991628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:21.991644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.991765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:21.991777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:21.991786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:21.991839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1641 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9654912-6433216a-50106f88-92c9964b_0
2025-10-01T14:12:21.992091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|162d3aa5-39190ef3-7ccb512e-6c28daff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9654912-6433216a-50106f88-92c9964b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:21.994293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9654912-6433216a-50106f88-92c9964b_0] Write session: try to update token
2025-10-01T14:12:21.994306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9654912-6433216a-50106f88-92c9964b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:21.999813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:21.999828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:21.999836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255971234229297:4684]
2025-10-01T14:12:21.999874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:21.999901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:22.000024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:22.000150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:22.000280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:22.000404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:22.000581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:22.000617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:22.007517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1641 sessionId: src_id|f9654912-6433216a-50106f88-92c9964b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:22.009802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:22.009973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.009990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.010020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:22.010086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:22.013091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:22.013105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:22.013107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:22.013109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:22.013118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255971234229297:4684]
2025-10-01T14:12:22.013121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255971234229297:4684]
2025-10-01T14:12:22.013123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255971234229297:4684]
2025-10-01T14:12:22.013158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:22.013165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:22.013167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.013169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:22.013170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:22.013174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:22.013284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:22.063970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255977906086494:7971]
2025-10-01T14:12:22.064148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1640, pipe: [1:7556255977906086494:7971]
2025-10-01T14:12:22.150356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:22.158319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.158343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.158521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.158586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.158654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.158721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.158765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.158774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.158842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.158905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.158967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.159026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.159079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.159086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.159154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.159216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.159277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.159340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.159384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.159391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.159457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.159517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.159580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.159643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.159689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.159696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.159765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.159832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.159899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.159964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.160009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.160017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.160085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.160152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.160220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.160290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.160346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.160356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.160425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.160487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.160556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.160624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.160688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.160695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.160766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.160825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.160888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.160950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.160996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.161006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.161080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.161144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.161212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.161276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.161325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.161332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.161401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.161467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.161534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.161600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.161645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.161652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.161720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906086494:7971], now have 1 active actors on pipe
2025-10-01T14:12:22.161951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:22.161962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:22.161962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:22.161988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1641 reason: error at write: Disconnected sessionId: src_id|f9654912-6433216a-50106f88-92c9964b_0
2025-10-01T14:12:22.161993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255977906086494:7971]
2025-10-01T14:12:22.162138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1641 sessionId: src_id|f9654912-6433216a-50106f88-92c9964b_0 is DEAD
2025-10-01T14:12:22.162229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9654912-6433216a-50106f88-92c9964b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:22.162237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9654912-6433216a-50106f88-92c9964b_0] Write session will restart in 0.008455s
2025-10-01T14:12:22.162259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9654912-6433216a-50106f88-92c9964b_0] Write session: Do CDS request
2025-10-01T14:12:22.162264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9654912-6433216a-50106f88-92c9964b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:22.162807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:22.171774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9654912-6433216a-50106f88-92c9964b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:22.171874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:22.171884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1642
2025-10-01T14:12:22.171974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:22.171996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:22.172003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:22.172005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:22.172284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1642 sessionId:  describe result for acl check
2025-10-01T14:12:22.172309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:22.172314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:22.172316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:22.172322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255977906086756:7626] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:22.172758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255977906086756:7626] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:22.173722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:22.174649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255977906086756:7626] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:22.175378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:22.175582Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:22.175589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:22.175598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:22.175633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:22.175659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255975529196864:4665]
2025-10-01T14:12:22.176037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:22.176242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:22.176273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:22.176473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:22.176509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.176514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.176514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.176515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.176516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.176516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.176517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.176518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.176519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.176519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.176520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.176521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.176521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.176522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.176525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.176531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.176533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.176536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.176538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.176540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.176542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.176544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.176546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.176548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.176551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.176553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.176555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.176557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.176561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.176566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.176570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.176573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.176576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.176579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.176581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.176584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.176587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.176590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.176592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.176595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.176598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.176601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.176603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.176606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.176608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.176611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.176614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.176617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.176619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.176623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.176625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.176628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.176630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.176633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.176636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.176638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.176670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:22.176812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255977906086756:7626] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:22.176825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255977906086756:7626] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:22.176828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255977906086756:7626] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:22.176835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:22.180036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:22.180563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:22.180574Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:22.180575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:22.180578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:22.180583Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1641 [2:7556255975529196864:4665]
2025-10-01T14:12:22.180593Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:22.180607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:22.180612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:22.180615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:22.180616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:22.180627Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:22.180634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:22.180638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:22.180687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.180692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.180693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.180696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:22.180697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:22.180750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:22.180757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.180767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.180781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.180800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:22.180820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906086500:2446], now have 1 active actors on pipe
2025-10-01T14:12:22.180825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906086801:7626], now have 1 active actors on pipe
2025-10-01T14:12:22.180830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255975529196858:4665]
2025-10-01T14:12:22.180832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255975529196858:4665]
2025-10-01T14:12:22.180833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255975529196858:4665]
2025-10-01T14:12:22.180843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:22.180845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1641
2025-10-01T14:12:22.180857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:22.180859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:22.180862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:22.180863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:22.180873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:22.180876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:22.180868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1641
2025-10-01T14:12:22.180895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255975529196858:4665]
2025-10-01T14:12:22.180902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:22.180904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:22.180922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.180930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.180966Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:22.180975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:22.180984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:22.180990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:22.180998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:22.181011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:22.181030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:22.181144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.181150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.181164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:22.181230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1642 partition: 0 MaxSeqNo: 45 sessionId: src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0
2025-10-01T14:12:22.181544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9654912-6433216a-50106f88-92c9964b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:22.183827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0] Write session: try to update token
2025-10-01T14:12:22.183841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:22.198338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1642 sessionId: src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:22.200539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:22.200554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:22.200556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:22.200558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:22.200566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255975529196858:4665]
2025-10-01T14:12:22.200569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255975529196858:4665]
2025-10-01T14:12:22.200574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255975529196858:4665]
2025-10-01T14:12:22.200609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:22.200616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.200616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:22.200618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:22.200623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:22.200627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:22.200763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:22.200772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:22.262331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255977906086808:7971]
2025-10-01T14:12:22.262668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1641, pipe: [1:7556255977906086808:7971]
2025-10-01T14:12:22.347649Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:22.348340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.348350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.348396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906086808:7971], now have 1 active actors on pipe
2025-10-01T14:12:22.348625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:22.348677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255977906086808:7971]
2025-10-01T14:12:22.348715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:22.348717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:22.348642Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:22.348762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1642 reason: error at write: Disconnected sessionId: src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0
2025-10-01T14:12:22.348964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1642 sessionId: src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0 is DEAD
2025-10-01T14:12:22.350525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:22.350537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0] Write session will restart in 0.008388s
2025-10-01T14:12:22.350569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0] Write session: Do CDS request
2025-10-01T14:12:22.350575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:22.359910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:22.359972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:22.359983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1643
2025-10-01T14:12:22.360313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:22.360343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:22.360349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:22.360352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:22.360767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1643 sessionId:  describe result for acl check
2025-10-01T14:12:22.360800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:22.360801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:22.360803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:22.360807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255977906086939:7611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:22.361264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255977906086939:7611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:22.363141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255977906086939:7611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:22.365625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255977906086939:7611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:22.365632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255977906086939:7611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:22.365636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255977906086939:7611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:22.365644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:22.372067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:22.373797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:22.373995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:22.374008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:22.374020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:22.374084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:22.374124Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255975529197090:4658]
2025-10-01T14:12:22.374725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:22.375043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:22.375084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:22.375298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:22.375336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.375340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.375341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.375342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.375342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.375343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.375344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.375345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.375346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.375346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.375347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.375348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.375348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.375349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.375353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.375359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.375362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.375365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.375369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.375373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.375376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.375380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.375383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.375388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.375392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.375395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.375398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.375402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.375410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.375418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.375424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.375433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.375440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.375443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.375447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.375453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.375455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.375458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.375461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.375463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.375477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.375480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.375482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.375485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.375487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.375490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.375492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.375496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.375499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.375501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.375504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.375506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.375509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.375512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.375514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.375517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.375538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:22.379151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:22.379730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:22.379751Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:22.379754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:22.379757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:22.379764Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1642 [2:7556255975529197090:4658]
2025-10-01T14:12:22.379778Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:22.379799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:22.379806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:22.379810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:22.379812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:22.379830Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:22.379839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:22.379848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:22.379907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.379915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.379918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.379921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:22.379924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:22.379993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:22.380001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.380015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.380032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.380054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:22.380076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906087028:7611], now have 1 active actors on pipe
2025-10-01T14:12:22.380079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906086823:2446], now have 1 active actors on pipe
2025-10-01T14:12:22.380109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1642
2025-10-01T14:12:22.380087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255975529197085:4658]
2025-10-01T14:12:22.380125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1642
2025-10-01T14:12:22.380089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255975529197085:4658]
2025-10-01T14:12:22.380091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255975529197085:4658]
2025-10-01T14:12:22.380105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:22.380121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:22.380132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:22.380136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:22.380136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:22.380137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:22.380139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:22.380168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255975529197085:4658]
2025-10-01T14:12:22.380172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:22.380173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:22.380188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.380198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.380246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:22.380257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:22.380266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:22.380273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:22.380282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:22.380296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:22.380322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:22.380454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.380463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.380478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:22.380578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1643 partition: 0 MaxSeqNo: 45 sessionId: src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0
2025-10-01T14:12:22.380909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7008b7ef-2d7462c2-8366d367-45c678fa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:22.383272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0] Write session: try to update token
2025-10-01T14:12:22.383288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:22.396374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1643 sessionId: src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:22.398638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:22.398929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.398949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.400779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:22.400811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:22.400814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:22.400816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:22.400818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:22.400827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255975529197085:4658]
2025-10-01T14:12:22.400835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255975529197085:4658]
2025-10-01T14:12:22.400838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255975529197085:4658]
2025-10-01T14:12:22.400866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:22.400879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:22.400879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:22.400883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:22.400881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:22.400885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.400888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:22.401009Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:22.446642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255977906087137:7971]
2025-10-01T14:12:22.446920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1642, pipe: [1:7556255977906087137:7971]
2025-10-01T14:12:22.558241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:22.565299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.565323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.565485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.565551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.565624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.565689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.565736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.565746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.565819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.565879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.565939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.566002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.566047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.566056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.566117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.566169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.566225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.566285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.566328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.566332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.566409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.566468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.566526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.566584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.566636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.566645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.566703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.566755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.566812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.566869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.566934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.566941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.567000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.567051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.567112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.567177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.567222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.567228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.567288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.567340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.567400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.567467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.567510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.567518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.567578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.567631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.567683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.567740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.567778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.567783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.567840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.567895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.567950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.568004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.568044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.568050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.568109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:22.568168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:22.568229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:22.568283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:22.568321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:22.568327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:22.568368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906087137:7971], now have 1 active actors on pipe
2025-10-01T14:12:22.568616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255977906087137:7971]
2025-10-01T14:12:22.568628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:22.568666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:22.568669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:22.568695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1643 reason: error at write: Disconnected sessionId: src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0
2025-10-01T14:12:22.568882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1643 sessionId: src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0 is DEAD
2025-10-01T14:12:22.569017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 188 BytesWritten: 85606466 MessagesWritten: 38 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-01T14:12:22.569048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:22.569053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0] Write session will restart in 0.009619s
2025-10-01T14:12:22.569078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0] Write session: Do CDS request
2025-10-01T14:12:22.569084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:22.569347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:22.579952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:22.580010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:22.580022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1644
2025-10-01T14:12:22.580178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:22.580211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:22.580217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:22.580220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:22.580664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1644 sessionId:  describe result for acl check
2025-10-01T14:12:22.580700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:22.580707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:22.580709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:22.580714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255977906087317:7604] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:22.581221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255977906087317:7604] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:22.585272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255977906087317:7604] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:22.587862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:22.590024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:22.590266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:22.590278Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:22.590290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:22.590315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255977906087317:7604] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:22.590332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255977906087317:7604] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:22.590336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255977906087317:7604] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:22.590345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:22.590354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:22.590420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255975529197317:4643]
2025-10-01T14:12:22.591042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:22.591329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:22.591377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:22.591729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:22.591777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.591784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.591785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.591786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.591787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.591789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.591789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.591790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.591791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.591792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.591793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.591793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.591794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.591795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.591799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.591806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.591808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.591810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.591813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.591815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.591817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.591819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.591822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.591824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.591826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.591828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.591830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.591832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.591839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.591844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.591848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.591852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.591854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.591858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.591860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.591863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.591866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.591870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.591872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.591875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.591878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.591881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.591884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.591887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.591889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.591892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.591895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.591899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.591901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.591904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.591907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.591909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.591912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.591914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.591917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.591920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.591940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:22.595639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:22.596266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:22.596289Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:22.596292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:22.596296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:22.596303Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1643 [2:7556255975529197317:4643]
2025-10-01T14:12:22.596318Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:22.596336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:22.596339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:22.596342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:22.596345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:22.596363Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:22.596368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:22.596374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:22.596434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.596444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.596447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.596450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:22.596453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:22.596519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:22.596527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.596540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.596560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.596580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:22.596601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906087442:7604], now have 1 active actors on pipe
2025-10-01T14:12:22.596610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906087143:2446], now have 1 active actors on pipe
2025-10-01T14:12:22.596676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1643
2025-10-01T14:12:22.596617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255975529197312:4643]
2025-10-01T14:12:22.596683Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1643
2025-10-01T14:12:22.596619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255975529197312:4643]
2025-10-01T14:12:22.596622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255975529197312:4643]
2025-10-01T14:12:22.596635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:22.596662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:22.596668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:22.596670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:22.596672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:22.596677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:22.596681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:22.596718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255975529197312:4643]
2025-10-01T14:12:22.596725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:22.596745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.596750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.596749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:22.596800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a85ed834-c235f8f6-3732202d-128fae9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:22.596807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:22.596812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:22.596815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:22.596825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:22.596836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:22.596854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:22.597274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.597288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.597308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:22.597425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1644 partition: 0 MaxSeqNo: 45 sessionId: src_id|a85ed834-c235f8f6-3732202d-128fae9c_0
2025-10-01T14:12:22.597830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feffb7ac-44f4a4d7-56af4c8e-d8a274fd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a85ed834-c235f8f6-3732202d-128fae9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:22.600352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ed834-c235f8f6-3732202d-128fae9c_0] Write session: try to update token
2025-10-01T14:12:22.600373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ed834-c235f8f6-3732202d-128fae9c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:22.615749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1644 sessionId: src_id|a85ed834-c235f8f6-3732202d-128fae9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:22.618155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:22.618423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.618445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.618465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:22.618469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:22.618472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:22.618474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:22.618483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255975529197312:4643]
2025-10-01T14:12:22.618487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255975529197312:4643]
2025-10-01T14:12:22.618491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255975529197312:4643]
2025-10-01T14:12:22.618531Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:22.618544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:22.618546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:22.618548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:22.618553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.618555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:22.618685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:22.668867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255977906087454:7971]
2025-10-01T14:12:22.672464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1643, pipe: [1:7556255977906087454:7971]
2025-10-01T14:12:22.772046Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:22.772446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:22.772487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906087454:7971], now have 1 active actors on pipe
2025-10-01T14:12:22.772699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:22.772841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255977906087454:7971]
2025-10-01T14:12:22.772863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:22.784291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:22.784303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:22.784327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1644 reason: error at write: Disconnected sessionId: src_id|a85ed834-c235f8f6-3732202d-128fae9c_0
2025-10-01T14:12:22.784455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1644 sessionId: src_id|a85ed834-c235f8f6-3732202d-128fae9c_0 is DEAD
2025-10-01T14:12:22.784873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ed834-c235f8f6-3732202d-128fae9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:22.784879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ed834-c235f8f6-3732202d-128fae9c_0] Write session will restart in 0.008010s
2025-10-01T14:12:22.784899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ed834-c235f8f6-3732202d-128fae9c_0] Write session: Do CDS request
2025-10-01T14:12:22.784906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ed834-c235f8f6-3732202d-128fae9c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:22.794043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ed834-c235f8f6-3732202d-128fae9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:22.794388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:22.794400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1645
2025-10-01T14:12:22.794491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:22.794524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:22.794535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:22.794538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:22.794983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1645 sessionId:  describe result for acl check
2025-10-01T14:12:22.795033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:22.795038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:22.795040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:22.795045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255977906087498:7587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:22.795576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255977906087498:7587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:22.806180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255977906087498:7587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:22.819064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255977906087498:7587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:22.819083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255977906087498:7587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:22.819087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255977906087498:7587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:22.819097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:22.826624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:22.827341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:22.827520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:22.827530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:22.827541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:22.827590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:22.827632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255975529197551:4633]
2025-10-01T14:12:22.828203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:22.828834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:22.828887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:22.829215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:22.829276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.829281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.829283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.829284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.829285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.829286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.829287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.829288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.829289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.829290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.829291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.829293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.829294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.829295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.829301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.829311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.829314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.829318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.829321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.829325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.829328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.829331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.829334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.829337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.829340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.829344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.829347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.829350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.829358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.829365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:22.829370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.829375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:22.829386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.829391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:22.829394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.829399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:22.829405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.829412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:22.829433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.829441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:22.829445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.829452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:22.829455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.829460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:22.829468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.829473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:22.829476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.829485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.829489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.829497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.829501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.829505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.829509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.829513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:22.829517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.829522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:22.829561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:22.833655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:22.834522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:22.834526Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:22.834955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1644
2025-10-01T14:12:22.834993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1644
2025-10-01T14:12:22.834527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:22.834530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:22.834536Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1644 [2:7556255975529197551:4633]
2025-10-01T14:12:22.834553Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:22.834570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:22.834574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:22.834578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:22.834580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:22.834597Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:22.834604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:22.834609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:22.834675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.834677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.834679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.834682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:22.834684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:22.834754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:22.834758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.834769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:22.834778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:22.834792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:22.834809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255975529197546:4633]
2025-10-01T14:12:22.834814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255975529197546:4633]
2025-10-01T14:12:22.834815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255975529197546:4633]
2025-10-01T14:12:22.834826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:22.834835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:22.834839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:22.834840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:22.834841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:22.834854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:22.834856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:22.834868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906087613:7587], now have 1 active actors on pipe
2025-10-01T14:12:22.834871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906087480:2446], now have 1 active actors on pipe
2025-10-01T14:12:22.834911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255975529197546:4633]
2025-10-01T14:12:22.834919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:22.834931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:22.835064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.835070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.835108Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:22.835115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:22.835119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:22.835121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:22.835131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:22.835140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:22.835157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:22.835359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.835366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.835381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:22.835471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1645 partition: 0 MaxSeqNo: 45 sessionId: src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0
2025-10-01T14:12:22.835951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85ed834-c235f8f6-3732202d-128fae9c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:22.838564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0] Write session: try to update token
2025-10-01T14:12:22.838582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:22.853765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1645 sessionId: src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:22.855680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:22.855700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:22.855702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:22.855705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:22.855716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255975529197546:4633]
2025-10-01T14:12:22.855721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255975529197546:4633]
2025-10-01T14:12:22.855725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255975529197546:4633]
2025-10-01T14:12:22.855764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:22.855774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:22.855774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:22.855777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:22.855781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:22.855783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:22.855907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:22.856113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:22.873123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255977906087792:7971]
2025-10-01T14:12:22.873334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1644, pipe: [1:7556255977906087792:7971]
2025-10-01T14:12:22.990162Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:22.990673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:22.990689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:22.990733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906087792:7971], now have 1 active actors on pipe
2025-10-01T14:12:22.990922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:22.990937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255977906087792:7971]
2025-10-01T14:12:22.990955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:22.990957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:22.990946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:22.991000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1645 reason: error at write: Disconnected sessionId: src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0
2025-10-01T14:12:22.991163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1645 sessionId: src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0 is DEAD
2025-10-01T14:12:22.991323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:22.991334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0] Write session will restart in 0.008910s
2025-10-01T14:12:22.991359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0] Write session: Do CDS request
2025-10-01T14:12:22.991365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:23.001779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.001895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:23.001907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1646
2025-10-01T14:12:23.002018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.002047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:23.002055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:23.002063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:23.002402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1646 sessionId:  describe result for acl check
2025-10-01T14:12:23.002432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:23.002439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:23.002440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:23.002445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255982201055359:7581] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:23.002678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:23.002888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255982201055359:7581] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:23.004178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:23.004339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:23.004349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:23.004359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:23.004399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:23.004427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255979824165073:4617]
2025-10-01T14:12:23.004743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255982201055359:7581] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:23.004844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:23.005083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:23.005117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:23.005362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:23.005409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.005414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.005415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.005415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.005416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.005417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.005417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.005418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.005419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.005419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.005420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.005420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.005421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.005421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.005424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.005432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.005435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.005438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.005441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.005445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.005447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.005451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.005454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.005457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.005460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.005463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.005466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.005470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.005477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.005483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.005491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.005495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.005504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.005509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.005517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.005521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.005527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.005532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.005539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.005544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.005552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.005557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.005564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.005569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.005575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.005579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.005586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.005592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.005595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.005601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.005603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.005606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.005609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.005611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.005614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.005620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.005640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:23.008741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255982201055359:7581] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:23.008753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255982201055359:7581] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:23.008756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255982201055359:7581] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:23.008763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:23.008914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:23.009572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:23.009586Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:23.009588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:23.009591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:23.009597Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1645 [2:7556255979824165073:4617]
2025-10-01T14:12:23.009610Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:23.009629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:23.009636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.009639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.009641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.009655Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:23.009663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:23.009668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:23.009705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.009710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.009711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.009714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:23.009715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:23.009768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:23.009774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.009785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.009797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.009815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:23.009834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201055396:7581], now have 1 active actors on pipe
2025-10-01T14:12:23.009840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255977906087798:2446], now have 1 active actors on pipe
2025-10-01T14:12:23.009847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255979824165067:4617]
2025-10-01T14:12:23.009854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255979824165067:4617]
2025-10-01T14:12:23.009856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255979824165067:4617]
2025-10-01T14:12:23.009868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:23.009874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:23.009876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:23.009878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:23.009883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:23.009890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1645
2025-10-01T14:12:23.009899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1645
2025-10-01T14:12:23.009900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:23.009908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:23.009928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255979824165067:4617]
2025-10-01T14:12:23.009935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:23.009937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:23.009947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.009955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.009993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:23.010004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.010008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.010010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:23.010019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.010029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:23.010045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.010148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.010155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.010168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.010242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1646 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0
2025-10-01T14:12:23.010585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e2190aa-691fe855-5c8e72d9-ba87164d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:23.012996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0] Write session: try to update token
2025-10-01T14:12:23.013013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:23.026002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1646 sessionId: src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:23.028236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:23.029181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.029205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.029222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:23.029225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:23.029227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:23.029228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:23.029234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255979824165067:4617]
2025-10-01T14:12:23.029237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255979824165067:4617]
2025-10-01T14:12:23.029240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255979824165067:4617]
2025-10-01T14:12:23.029284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:23.029290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.029291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:23.029292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:23.029299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:23.029303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:23.029411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:23.091318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255982201055406:7971]
2025-10-01T14:12:23.091547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1645, pipe: [1:7556255982201055406:7971]
2025-10-01T14:12:23.167471Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:23.167708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:23.167755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201055406:7971], now have 1 active actors on pipe
2025-10-01T14:12:23.167839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:23.167917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255982201055406:7971]
2025-10-01T14:12:23.167940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:23.177990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:23.178001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:23.178022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1646 reason: error at write: Disconnected sessionId: src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0
2025-10-01T14:12:23.178156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1646 sessionId: src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0 is DEAD
2025-10-01T14:12:23.178250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:23.178261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0] Write session will restart in 0.009172s
2025-10-01T14:12:23.178284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0] Write session: Do CDS request
2025-10-01T14:12:23.178292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:23.188921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.188999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:23.189013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1647
2025-10-01T14:12:23.189146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.189185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:23.189195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:23.189199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:23.189639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1647 sessionId:  describe result for acl check
2025-10-01T14:12:23.189677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:23.189683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:23.189684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:23.189690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255982201055669:7579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:23.190235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255982201055669:7579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:23.191585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:23.192768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255982201055669:7579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:23.193451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:23.193646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:23.193653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:23.193664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:23.193716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:23.193749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255979824165345:4608]
2025-10-01T14:12:23.194272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:23.194569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:23.195124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255982201055669:7579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:23.195135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255982201055669:7579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:23.195138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255982201055669:7579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:23.195144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:23.194620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:23.194966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:23.195008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.195009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.195009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.195010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.195010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.195011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.195012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.195012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.195013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.195013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.195014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.195015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.195015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.195016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.195019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.195025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.195027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.195029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.195030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.195032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.195034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.195036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.195038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.195040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.195041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.195043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.195045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.195047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.195052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.195057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.195061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.195064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.195066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.195069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.195071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.195074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.195076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.195079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.195081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.195084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.195087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.195090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.195092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.195095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.195097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.195100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.195102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.195105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.195107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.195111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.195121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.195124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.195126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.195129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.195131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.195134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.195153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:23.198628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:23.199215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:23.199230Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:23.199232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:23.199235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:23.199240Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1646 [2:7556255979824165345:4608]
2025-10-01T14:12:23.199252Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:23.199266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:23.199268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.199271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.199273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.199287Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:23.199292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:23.199301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:23.199347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.199356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.199358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.199361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:23.199363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:23.199419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:23.199425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.199434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.199443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.199456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:23.199468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255979824165340:4608]
2025-10-01T14:12:23.199474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255979824165340:4608]
2025-10-01T14:12:23.199476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255979824165340:4608]
2025-10-01T14:12:23.199485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:23.199496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:23.199511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:23.199515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:23.199517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:23.199517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:23.199519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:23.199541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255979824165340:4608]
2025-10-01T14:12:23.199547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:23.199549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:23.199554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201055709:7579], now have 1 active actors on pipe
2025-10-01T14:12:23.199557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201055408:2446], now have 1 active actors on pipe
2025-10-01T14:12:23.199673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.199685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.199711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:23.199723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.199727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.199729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:23.199738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.199748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:23.199763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.199943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.199950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.199965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.199602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1646
2025-10-01T14:12:23.199603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1646
2025-10-01T14:12:23.200077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1647 partition: 0 MaxSeqNo: 45 sessionId: src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0
2025-10-01T14:12:23.200411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc91ad1e-fb0f3f20-dc1035be-7ff17c19_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:23.202898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0] Write session: try to update token
2025-10-01T14:12:23.202914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:23.211790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:23.211809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:23.211819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255979824165340:4608]
2025-10-01T14:12:23.211867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:23.211870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:23.212048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:23.212201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:23.212353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:23.212506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:23.212737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:23.212774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:23.229650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.229673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.229712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:23.226727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1647 sessionId: src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:23.229415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:23.229803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:23.246385Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:23.246401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:23.246403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:23.246406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:23.246417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255979824165340:4608]
2025-10-01T14:12:23.246420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255979824165340:4608]
2025-10-01T14:12:23.246427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255979824165340:4608]
2025-10-01T14:12:23.246470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:23.246476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.246479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:23.246480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:23.246487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:23.246490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:23.246614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:23.267886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255982201055719:7971]
2025-10-01T14:12:23.268187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1646, pipe: [1:7556255982201055719:7971]
2025-10-01T14:12:23.317786Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:12:23.396866Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:23.403400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.403421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.403566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.403621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.403676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.403730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.403774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.403781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.403838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.403891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.403944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.403998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.404037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.404043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.404098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.404146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.404197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.404248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.404284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.404291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.404345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.404399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.404448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.404498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.404537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.404542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.404599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.404661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.404716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.404770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.404807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.404813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.404866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.404916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.404965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.405013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.405055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.405064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.405123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.405178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.405232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.405283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.405320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.405325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.405379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.405430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.405482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.405535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.405575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.405581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.405632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.405683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.405736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.405786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.405822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.405827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.405877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.405924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.405973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.406025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.406063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.406068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.406103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201055719:7971], now have 1 active actors on pipe
2025-10-01T14:12:23.406317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:23.406320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:23.406327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:23.406349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1647 reason: error at write: Disconnected sessionId: src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0
2025-10-01T14:12:23.406360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255982201055719:7971]
2025-10-01T14:12:23.406537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1647 sessionId: src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0 is DEAD
2025-10-01T14:12:23.406664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:23.406672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0] Write session will restart in 0.005057s
2025-10-01T14:12:23.406689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0] Write session: Do CDS request
2025-10-01T14:12:23.406694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:23.406815Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:23.412804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.412885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:23.412905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1648
2025-10-01T14:12:23.412999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.413027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:23.413036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:23.413038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:23.413414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1648 sessionId:  describe result for acl check
2025-10-01T14:12:23.413444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:23.413451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:23.413453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:23.413458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255982201055845:7569] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:23.413897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255982201055845:7569] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:23.415705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255982201055845:7569] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:23.417888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255982201055845:7569] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:23.417899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255982201055845:7569] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:23.417902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255982201055845:7569] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:23.417908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:23.418861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:23.420252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:23.420380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:23.420388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:23.420397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:23.420437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:23.420462Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255979824165576:4600]
2025-10-01T14:12:23.420855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:23.421031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:23.421056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:23.421242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:23.421274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.421278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.421279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.421279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.421280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.421281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.421281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.421282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.421282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.421283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.421284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.421284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.421285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.421285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.421289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.421294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.421296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.421298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.421300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.421302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.421304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.421305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.421307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.421309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.421311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.421313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.421314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.421316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.421321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.421325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.421328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.421331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.421334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.421336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.421338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.421341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.421343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.421346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.421348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.421351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.421353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.421355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.421358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.421360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.421363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.421366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.421368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.421371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.421374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.421376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.421379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.421381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.421384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.421386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.421388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.421390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.421410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:23.424792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:23.425524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:23.425534Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:23.425535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:23.425537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:23.425543Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1647 [2:7556255979824165576:4600]
2025-10-01T14:12:23.425551Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:23.425566Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:23.425570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.425572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.425573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.425583Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:23.425589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:23.425593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:23.425628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.425633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.425634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.425636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:23.425637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:23.425689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:23.425696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.425703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.425709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.425720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:23.425737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201056038:7569], now have 1 active actors on pipe
2025-10-01T14:12:23.425740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201055735:2446], now have 1 active actors on pipe
2025-10-01T14:12:23.425747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255979824165571:4600]
2025-10-01T14:12:23.425749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255979824165571:4600]
2025-10-01T14:12:23.425753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255979824165571:4600]
2025-10-01T14:12:23.425764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:23.425773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:23.425776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:23.425779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:23.425781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:23.425783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:23.425785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:23.425800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255979824165571:4600]
2025-10-01T14:12:23.425805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:23.425809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:23.425809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1647
2025-10-01T14:12:23.425828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1647
2025-10-01T14:12:23.425854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.425865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.425888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:23.425899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.425903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.425905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:23.425913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.425922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:23.425937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.426086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.426094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.426110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.426208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1648 partition: 0 MaxSeqNo: 45 sessionId: src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0
2025-10-01T14:12:23.426555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2a6143f-9168bc21-f2d75b87-40671a45_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:23.428914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0] Write session: try to update token
2025-10-01T14:12:23.428933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:23.436236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:23.436252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:23.436259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255979824165571:4600]
2025-10-01T14:12:23.436292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:23.436297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:23.436441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:23.436594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:23.436733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:23.436859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:23.437078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:23.437112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:23.441683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1648 sessionId: src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:23.443789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:23.443983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.444000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.444028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:23.444120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:23.456620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:23.456637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:23.456639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:23.456641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:23.456657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255979824165571:4600]
2025-10-01T14:12:23.456662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255979824165571:4600]
2025-10-01T14:12:23.456665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255979824165571:4600]
2025-10-01T14:12:23.456707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:23.456717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.456718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:23.456720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:23.456725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:23.456728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:23.456843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:23.506439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255982201056058:7971]
2025-10-01T14:12:23.506742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1647, pipe: [1:7556255982201056058:7971]
2025-10-01T14:12:23.511528Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 16 CurrentSessionLifetimeMs: 361529 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:12:23.592662Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:23.599505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.599528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.599669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.599725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.599785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.599839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.599882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.599894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.599952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.600003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.600055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.600109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.600157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.600166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.600225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.600282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.600334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.600385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.600431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.600437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.600488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.600540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.600595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.600661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.600704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.600713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.600774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.600830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.600880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.600940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.600983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.600990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.601047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.601100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.601159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.601221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.601263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.601269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.601331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.601381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.601436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.601490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.601531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.601536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.601597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.601657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.601728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.601791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.601834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.601839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.601900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.601962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.602021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.602077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.602117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.602122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.602181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.602239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.602296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.602353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.602413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.602419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.602461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201056058:7971], now have 1 active actors on pipe
2025-10-01T14:12:23.602653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:23.602668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:23.602670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:23.602695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1648 reason: error at write: Disconnected sessionId: src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0
2025-10-01T14:12:23.602716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255982201056058:7971]
2025-10-01T14:12:23.602921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1648 sessionId: src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0 is DEAD
2025-10-01T14:12:23.603041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:23.603047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0] Write session will restart in 0.006976s
2025-10-01T14:12:23.603065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0] Write session: Do CDS request
2025-10-01T14:12:23.603070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:23.603354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:23.610916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.610959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:23.610973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1649
2025-10-01T14:12:23.611124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.611157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:23.611163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:23.611169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:23.611618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1649 sessionId:  describe result for acl check
2025-10-01T14:12:23.611654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:23.611659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:23.611661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:23.611666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255982201056183:7565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:23.612176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255982201056183:7565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:23.615223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255982201056183:7565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:23.617660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255982201056183:7565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:23.617674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255982201056183:7565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:23.617677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255982201056183:7565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:23.617686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:23.617974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:23.619893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:23.620081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:23.620092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:23.620102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:23.620148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:23.620187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255979824165808:4590]
2025-10-01T14:12:23.620753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:23.621000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:23.621039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:23.621325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:23.621379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.621385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.621386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.621387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.621388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.621388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.621390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.621391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.621392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.621393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.621394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.621396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.621397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.621398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.621402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.621410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.621414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.621417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.621420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.621424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.621427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.621431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.621434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.621438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.621441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.621444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.621447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.621450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.621457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.621464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.621469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.621474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.621479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.621483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.621486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.621490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.621494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.621499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.621504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.621508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.621517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.621522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.621529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.621533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.621536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.621540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.621545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.621549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.621556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.621560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.621564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.621572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.621575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.621581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.621589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.621593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.621628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:23.625262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:23.626117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:23.626130Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:23.626133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:23.626136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:23.626142Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1648 [2:7556255979824165808:4590]
2025-10-01T14:12:23.626154Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:23.626170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:23.626174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.626178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.626180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.626195Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:23.626204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:23.626210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:23.626261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.626268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.626270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.626273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:23.626276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:23.626339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:23.626346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.626356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.626365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.626396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:23.626417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201056060:2446], now have 1 active actors on pipe
2025-10-01T14:12:23.626424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201056362:7565], now have 1 active actors on pipe
2025-10-01T14:12:23.626431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255979824165803:4590]
2025-10-01T14:12:23.626433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255979824165803:4590]
2025-10-01T14:12:23.626435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255979824165803:4590]
2025-10-01T14:12:23.626451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:23.626464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:23.626470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1648
2025-10-01T14:12:23.626477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:23.626479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:23.626483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:23.626485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:23.626486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:23.626513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255979824165803:4590]
2025-10-01T14:12:23.626516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:23.626530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1648
2025-10-01T14:12:23.626526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:23.626557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.626564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.626586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:23.626597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.626603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.626605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:23.626614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.626622Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:23.626634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.626788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.626796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.626810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.626884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1649 partition: 0 MaxSeqNo: 45 sessionId: src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0
2025-10-01T14:12:23.627265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60d500dd-6ceffa49-9a4f2561-1295f4e9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:23.629886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0] Write session: try to update token
2025-10-01T14:12:23.629903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:23.638031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:23.638047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:23.638058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255979824165803:4590]
2025-10-01T14:12:23.638103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:23.638125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:23.638274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:23.638436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:23.638574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:23.638722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:23.638918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:23.638959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:23.643766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1649 sessionId: src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:23.646065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:23.646257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.646277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.646312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:23.646389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:23.656883Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:23.656902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:23.656905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:23.656906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:23.656918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255979824165803:4590]
2025-10-01T14:12:23.656922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255979824165803:4590]
2025-10-01T14:12:23.656925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255979824165803:4590]
2025-10-01T14:12:23.656970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:23.656971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:23.656978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:23.656980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.656982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:23.656984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:23.657129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:23.703064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255982201056376:7971]
2025-10-01T14:12:23.703324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1648, pipe: [1:7556255982201056376:7971]
2025-10-01T14:12:23.793977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:23.800773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.800796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.800942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.800999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.801055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.801112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.801160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.801168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.801230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.801285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.801339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.801407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.801454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.801459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.801515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.801565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.801621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.801689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.801732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.801740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.801801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.801865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.801927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.801988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.802031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.802038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.802097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.802150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.802206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.802270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.802312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.802318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.802394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.802451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.802510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.802564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.802606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.802612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.802674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.802728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.802789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.802850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.802898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.802905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.802966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.803021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.803079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.803134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.803174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.803179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.803234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.803287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.803341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.803405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.803445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.803451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.803511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.803561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.803612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.803663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.803701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.803706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.803747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201056376:7971], now have 1 active actors on pipe
2025-10-01T14:12:23.803966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255982201056376:7971]
2025-10-01T14:12:23.804000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:23.804034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:23.804040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:23.804063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1649 reason: error at write: Disconnected sessionId: src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0
2025-10-01T14:12:23.804269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1649 sessionId: src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0 is DEAD
2025-10-01T14:12:23.804404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:23.804430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0] Write session will restart in 0.007389s
2025-10-01T14:12:23.804454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0] Write session: Do CDS request
2025-10-01T14:12:23.804460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:23.804569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:23.812905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.812999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:23.813013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1650
2025-10-01T14:12:23.813125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.813153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:23.813161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:23.813164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:23.813463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1650 sessionId:  describe result for acl check
2025-10-01T14:12:23.813487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:23.813488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:23.813489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:23.813492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255982201056544:7547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:23.813875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255982201056544:7547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:23.816071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255982201056544:7547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:23.818288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:23.818326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255982201056544:7547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:23.818337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255982201056544:7547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:23.818340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255982201056544:7547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:23.818348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:23.820001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:23.820152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:23.820160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:23.820167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:23.820203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:23.820228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255979824166046:4585]
2025-10-01T14:12:23.820673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:23.820931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:23.820978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:23.821334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:23.821385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.821392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.821393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.821394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.821395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.821396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.821397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.821398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.821399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.821401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.821402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.821403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.821405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.821406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.821411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.821421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.821425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.821429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.821434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.821438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.821441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.821445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.821449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.821453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.821461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.821464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.821468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.821472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.821487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.821494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:23.821504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.821515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:23.821524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.821533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:23.821541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.821551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:23.821559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.821568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:23.821577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.821582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:23.821590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.821599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:23.821607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.821612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:23.821621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.821630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:23.821640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.821649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.821658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.821663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.821671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.821680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.821686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.821694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:23.821699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.821708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:23.821751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:23.825326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:23.825912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:23.825926Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:23.825928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:23.825932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:23.825938Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1649 [2:7556255979824166046:4585]
2025-10-01T14:12:23.825953Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:23.825972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:23.825979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.825982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.825984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.826000Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:23.826010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:23.826019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:23.826069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.826075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.826077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.826080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:23.826084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:23.826145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:23.826154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.826165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:23.826177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:23.826195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:23.826216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201056704:7547], now have 1 active actors on pipe
2025-10-01T14:12:23.826223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201056392:2446], now have 1 active actors on pipe
2025-10-01T14:12:23.826231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255979824166040:4585]
2025-10-01T14:12:23.826238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255979824166040:4585]
2025-10-01T14:12:23.826241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255979824166040:4585]
2025-10-01T14:12:23.826256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:23.826233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1649
2025-10-01T14:12:23.826246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1649
2025-10-01T14:12:23.826272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:23.826274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:23.826278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:23.826280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:23.826290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:23.826296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:23.826339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.826347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.826359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255979824166040:4585]
2025-10-01T14:12:23.826386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:23.826400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:23.826417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:23.826427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:23.826431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:23.826437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:23.826447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:23.826455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:23.826477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.826604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.826615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.826631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:23.826705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1650 partition: 0 MaxSeqNo: 45 sessionId: src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0
2025-10-01T14:12:23.827064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd12a182-24c05630-69cfd1fd-ba4faf3c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:23.829344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0] Write session: try to update token
2025-10-01T14:12:23.829360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:23.842417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1650 sessionId: src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:23.844516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:23.844616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.844633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.846301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:23.846329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:23.846332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:23.846334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:23.846335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:23.846341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255979824166040:4585]
2025-10-01T14:12:23.846344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255979824166040:4585]
2025-10-01T14:12:23.846347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255979824166040:4585]
2025-10-01T14:12:23.846389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:23.846396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:23.846401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:23.846403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:23.846405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:23.846406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:23.846411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:23.846532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:23.904280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255982201056719:7971]
2025-10-01T14:12:23.904508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1649, pipe: [1:7556255982201056719:7971]
2025-10-01T14:12:23.978352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:23.984860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:23.984881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:23.985021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.985072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.985125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.985178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.985217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.985224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.985279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.985331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.985382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.985440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.985478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.985483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.985537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.985582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.985632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.985685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.985729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.985739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.985797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.985847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.985894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.985943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.985980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.985985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.986038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.986087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.986138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.986188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.986230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.986236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.986287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.986338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.986405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.986460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.986498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.986503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.986555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.986602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.986653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.986706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.986744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.986749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.986800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.986851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.986904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.986958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.986997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.987001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.987056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.987110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.987162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.987215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.987254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.987258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.987310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:23.987362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:23.987413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:23.987465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:23.987503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:23.987508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:23.987547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201056719:7971], now have 1 active actors on pipe
2025-10-01T14:12:23.987779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255982201056719:7971]
2025-10-01T14:12:23.987799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:23.987803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:23.987806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:23.987829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1650 reason: error at write: Disconnected sessionId: src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0
2025-10-01T14:12:23.988026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1650 sessionId: src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0 is DEAD
2025-10-01T14:12:23.988192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:23.988203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0] Write session will restart in 0.007615s
2025-10-01T14:12:23.988228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0] Write session: Do CDS request
2025-10-01T14:12:23.988234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:23.988287Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:23.996909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.996960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:23.996974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1651
2025-10-01T14:12:23.997098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:23.997122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:23.997125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:23.997128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:23.997698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1651 sessionId:  describe result for acl check
2025-10-01T14:12:23.997731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:23.997737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:23.997738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:23.997746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255982201056905:7539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:23.998222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255982201056905:7539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:24.000484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255982201056905:7539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:24.001358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:24.002652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:24.002770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:24.002778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:24.002785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:24.002812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:24.002846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255984119133573:4559]
2025-10-01T14:12:24.002945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255982201056905:7539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:24.002956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255982201056905:7539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:24.002960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255982201056905:7539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:24.002966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:24.003265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:24.003466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:24.003493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:24.003705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:24.003739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.003743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.003744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.003745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.003745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.003746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.003747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.003747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.003748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.003748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.003749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.003749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.003750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.003750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.003754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.003759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.003761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.003763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.003765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.003767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.003770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.003772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.003774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.003776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.003778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.003780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.003782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.003784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.003788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.003792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.003796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.003799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.003801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.003803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.003805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.003808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.003811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.003813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.003816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.003818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.003821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.003823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.003826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.003829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.003831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.003834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.003836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.003839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.003842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.003844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.003848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.003850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.003852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.003855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.003858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.003861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.003883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:24.007113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:24.007809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:24.007821Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:24.007823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:24.007826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:24.007830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1650 [2:7556255984119133573:4559]
2025-10-01T14:12:24.007839Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:24.007849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:24.007852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.007855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.007857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.007871Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:24.007875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:24.007881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:24.007921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.007927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.007928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.007931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:24.007932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:24.007975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:24.007980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.007986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.007992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.008000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:24.008015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496024323:7539], now have 1 active actors on pipe
2025-10-01T14:12:24.008022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255982201056724:2446], now have 1 active actors on pipe
2025-10-01T14:12:24.008029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255984119133568:4559]
2025-10-01T14:12:24.008031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255984119133568:4559]
2025-10-01T14:12:24.008033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255984119133568:4559]
2025-10-01T14:12:24.008043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:24.008050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:24.008052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:24.008053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:24.008059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:24.008070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:24.008052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1650
2025-10-01T14:12:24.008052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1650
2025-10-01T14:12:24.008076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:24.008108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.008115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.008128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255984119133568:4559]
2025-10-01T14:12:24.008139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:24.008146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:24.008160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:24.008171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.008178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.008180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:24.008187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.008195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:24.008217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.008326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.008333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.008346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.008429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1651 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0
2025-10-01T14:12:24.008712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f08024d1-dfbda4cb-54dc5913-f5e6366c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:24.010944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0] Write session: try to update token
2025-10-01T14:12:24.010957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:24.022963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1651 sessionId: src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:24.024927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:24.025097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.025113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.026855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:24.026870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:24.026872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:24.026874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:24.026882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255984119133568:4559]
2025-10-01T14:12:24.026886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255984119133568:4559]
2025-10-01T14:12:24.026890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255984119133568:4559]
2025-10-01T14:12:24.026927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:24.026934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:24.026937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:24.026941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:24.026950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:24.026958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.026961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:24.027001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:24.027084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:24.088083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255986496024334:7971]
2025-10-01T14:12:24.088253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1650, pipe: [1:7556255986496024334:7971]
2025-10-01T14:12:24.163918Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:24.172622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.172657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.172831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.172896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.172965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.173025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.173073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.173083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.173154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.173213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.173272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.173345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.173395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.173402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.173462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.173514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.173578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.173641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.173684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.173693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.173755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.173822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.173880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.173942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.173987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.173992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.174049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.174104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.174166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.174225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.174268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.174276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.174346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.174415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.174476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.174542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.174585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.174590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.174658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.174724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.174785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.174846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.174886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.174892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.174948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.175006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.175070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.175132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.175176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.175183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.175258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.175325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.175390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.175456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.175508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.175516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.175589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.175646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.175707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.175769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.175818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.175826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.175890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496024334:7971], now have 1 active actors on pipe
2025-10-01T14:12:24.176159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255986496024334:7971]
2025-10-01T14:12:24.176167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:24.176170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:24.176199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:24.176209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1651 reason: error at write: Disconnected sessionId: src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0
2025-10-01T14:12:24.176396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1651 sessionId: src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0 is DEAD
2025-10-01T14:12:24.176523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:24.176531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0] Write session will restart in 0.006936s
2025-10-01T14:12:24.176549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0] Write session: Do CDS request
2025-10-01T14:12:24.176554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:24.176842Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:24.184807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.184924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:24.184934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1652
2025-10-01T14:12:24.185024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.185051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:24.185060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:24.185064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:24.185431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1652 sessionId:  describe result for acl check
2025-10-01T14:12:24.185460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:24.185465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:24.185467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:24.185472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255986496024530:7535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:24.185901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255986496024530:7535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:24.187890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255986496024530:7535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:24.188400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:24.190137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:24.190271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:24.190279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:24.190287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:24.190318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:24.190340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255984119133850:4543]
2025-10-01T14:12:24.190429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255986496024530:7535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:24.190441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255986496024530:7535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:24.190444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255986496024530:7535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:24.190451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:24.190806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:24.191045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:24.191089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:24.191366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:24.191407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.191413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.191413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.191414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.191415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.191415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.191416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.191416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.191417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.191417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.191418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.191418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.191419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.191420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.191423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.191428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.191431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.191433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.191435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.191437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.191439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.191440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.191443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.191445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.191447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.191449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.191451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.191453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.191457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.191464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.191468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.191473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.191477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.191482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.191485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.191490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.191493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.191498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.191502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.191507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.191511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.191514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.191520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.191523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.191525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.191528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.191530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.191532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.191535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.191541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.191544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.191547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.191560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.191562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.191565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.191568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.191587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:24.194801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:24.195519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:24.195531Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:24.195532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:24.195534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:24.195539Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1651 [2:7556255984119133850:4543]
2025-10-01T14:12:24.195549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:24.195568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:24.195575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.195577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.195578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.195590Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:24.195598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:24.195603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:24.195647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.195654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.195655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.195657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:24.195659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:24.195706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:24.195708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.195715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.195720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.195729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:24.195743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496024339:2446], now have 1 active actors on pipe
2025-10-01T14:12:24.195746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496024643:7535], now have 1 active actors on pipe
2025-10-01T14:12:24.195752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255984119133845:4543]
2025-10-01T14:12:24.195754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255984119133845:4543]
2025-10-01T14:12:24.195756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255984119133845:4543]
2025-10-01T14:12:24.195768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:24.195779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:24.195787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:24.195790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:24.195791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:24.195792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:24.195794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:24.195812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255984119133845:4543]
2025-10-01T14:12:24.195819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:24.195821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:24.195800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1651
2025-10-01T14:12:24.195817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1651
2025-10-01T14:12:24.195856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.195863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.195892Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:24.195902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.195910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.195912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:24.195920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.195929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:24.195948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.196076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.196086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.196100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.196171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1652 partition: 0 MaxSeqNo: 45 sessionId: src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0
2025-10-01T14:12:24.196517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca0ef075-5b49e2ee-9366d4d5-5355897f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:24.198829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0] Write session: try to update token
2025-10-01T14:12:24.198844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:24.210951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1652 sessionId: src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:24.213129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:24.213298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.213319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.213353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:24.213412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:24.215176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:24.215190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:24.215191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:24.215193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:24.215199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255984119133845:4543]
2025-10-01T14:12:24.215202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255984119133845:4543]
2025-10-01T14:12:24.215204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255984119133845:4543]
2025-10-01T14:12:24.215238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:24.215242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:24.215245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:24.215250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:24.215256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.215262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:24.215376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:24.276486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255986496024665:7971]
2025-10-01T14:12:24.276685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1651, pipe: [1:7556255986496024665:7971]
2025-10-01T14:12:24.348535Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:24.355217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.355241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.355376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.355443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.355503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.355562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.355604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.355611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.355672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.355729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.355783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.355839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.355886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.355894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.355953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.356001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.356052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.356102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.356140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.356145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.356198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.356250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.356302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.356354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.356397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.356408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.356477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.356532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.356581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.356635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.356682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.356687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.356743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.356791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.356849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.356905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.356951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.356960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.357017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.357065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.357118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.357169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.357210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.357215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.357271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.357325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.357379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.357435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.357483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.357488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.357544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.357600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.357656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.357712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.357751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.357756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.357816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.357867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.357923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.357988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.358028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.358034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.358073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496024665:7971], now have 1 active actors on pipe
2025-10-01T14:12:24.358306Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:24.358325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:24.358328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:24.358349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1652 reason: error at write: Disconnected sessionId: src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0
2025-10-01T14:12:24.358357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255986496024665:7971]
2025-10-01T14:12:24.358527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1652 sessionId: src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0 is DEAD
2025-10-01T14:12:24.358677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:24.358686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0] Write session will restart in 0.007675s
2025-10-01T14:12:24.358703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0] Write session: Do CDS request
2025-10-01T14:12:24.358708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:24.358938Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:24.367878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.367925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:24.367937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1653
2025-10-01T14:12:24.368108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.368141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:24.368147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:24.368150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:24.368546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1653 sessionId:  describe result for acl check
2025-10-01T14:12:24.368573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:24.368575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:24.368575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:24.368580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255986496024852:7527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:24.368976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255986496024852:7527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:24.371450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255986496024852:7527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:24.372510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:24.374049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:24.374180Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:24.374188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:24.374196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:24.374226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:24.374253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255984119134084:4537]
2025-10-01T14:12:24.374287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255986496024852:7527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:24.374296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255986496024852:7527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:24.374298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255986496024852:7527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:24.374304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:24.374661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:24.374847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:24.374879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:24.375066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:24.375098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.375103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.375103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.375104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.375104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.375105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.375106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.375106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.375107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.375108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.375108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.375109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.375110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.375110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.375113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.375118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.375121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.375123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.375125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.375127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.375129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.375131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.375133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.375135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.375137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.375139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.375141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.375143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.375147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.375151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.375155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.375159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.375161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.375164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.375166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.375169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.375171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.375174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.375176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.375178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.375181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.375183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.375185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.375188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.375190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.375193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.375195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.375197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.375200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.375202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.375212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.375216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.375224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.375232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.375237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.375244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.375263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:24.378447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:24.379038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:24.379054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:24.379057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:24.379060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:24.379066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1652 [2:7556255984119134084:4537]
2025-10-01T14:12:24.379078Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:24.379092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:24.379095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.379098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.379100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.379113Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:24.379123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:24.379128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:24.379183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.379190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.379193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.379196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:24.379198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:24.379257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:24.379264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.379273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.379282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.379299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:24.379319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496024671:2446], now have 1 active actors on pipe
2025-10-01T14:12:24.379326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496024978:7527], now have 1 active actors on pipe
2025-10-01T14:12:24.379332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255984119134079:4537]
2025-10-01T14:12:24.379338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255984119134079:4537]
2025-10-01T14:12:24.379340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255984119134079:4537]
2025-10-01T14:12:24.379352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:24.379362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:24.379363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:24.379369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:24.379371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:24.379374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:24.379376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:24.379371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1652
2025-10-01T14:12:24.379383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1652
2025-10-01T14:12:24.379393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255984119134079:4537]
2025-10-01T14:12:24.379400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:24.379402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:24.379424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.379432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.379461Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78932394-c04bc6a2-1bbde621-4f237a91_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:24.379474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.379478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.379481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:24.379488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.379497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:24.379516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.379645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.379650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.379659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.379722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1653 partition: 0 MaxSeqNo: 45 sessionId: src_id|78932394-c04bc6a2-1bbde621-4f237a91_0
2025-10-01T14:12:24.380041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6f5ed74-447906c1-b8cbc6a7-4abead49_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|78932394-c04bc6a2-1bbde621-4f237a91_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:24.382185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78932394-c04bc6a2-1bbde621-4f237a91_0] Write session: try to update token
2025-10-01T14:12:24.382196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78932394-c04bc6a2-1bbde621-4f237a91_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:24.394415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1653 sessionId: src_id|78932394-c04bc6a2-1bbde621-4f237a91_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:24.396414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:24.396663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.396682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.398471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:24.398483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:24.398485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:24.398487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:24.398495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255984119134079:4537]
2025-10-01T14:12:24.398500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255984119134079:4537]
2025-10-01T14:12:24.398504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255984119134079:4537]
2025-10-01T14:12:24.398538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:24.398548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:24.398550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:24.398550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:24.398565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:24.398571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.398573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:24.398664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:24.398703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:24.458249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255986496025005:7971]
2025-10-01T14:12:24.458487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1652, pipe: [1:7556255986496025005:7971]
2025-10-01T14:12:24.534045Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:24.540620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.540643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.540790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.540844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.540900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.540952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.541002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.541012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.541088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.541147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.541198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.541255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.541299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.541306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.541360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.541410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.541463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.541513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.541550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.541555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.541606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.541654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.541703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.541752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.541792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.541797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.541848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.541899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.541952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.542003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.542047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.542052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.542102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.542153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.542206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.542261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.542308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.542313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.542386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.542436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.542486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.542540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.542579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.542586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.542641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.542690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.542743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.542803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.542843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.542849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.542906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.542960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.543014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.543068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.543109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.543114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.543171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:24.543222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:24.543277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:24.543335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:24.543374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:24.543379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:24.543420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496025005:7971], now have 1 active actors on pipe
2025-10-01T14:12:24.543658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255986496025005:7971]
2025-10-01T14:12:24.543662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:24.543694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:24.543700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:24.543725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1653 reason: error at write: Disconnected sessionId: src_id|78932394-c04bc6a2-1bbde621-4f237a91_0
2025-10-01T14:12:24.543953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1653 sessionId: src_id|78932394-c04bc6a2-1bbde621-4f237a91_0 is DEAD
2025-10-01T14:12:24.544064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78932394-c04bc6a2-1bbde621-4f237a91_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:24.544073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78932394-c04bc6a2-1bbde621-4f237a91_0] Write session will restart in 0.008495s
2025-10-01T14:12:24.544091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78932394-c04bc6a2-1bbde621-4f237a91_0] Write session: Do CDS request
2025-10-01T14:12:24.544096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78932394-c04bc6a2-1bbde621-4f237a91_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:24.544105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:24.553845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78932394-c04bc6a2-1bbde621-4f237a91_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.553920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:24.553932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1654
2025-10-01T14:12:24.554056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.554084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:24.554091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:24.554095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:24.554396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1654 sessionId:  describe result for acl check
2025-10-01T14:12:24.554419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:24.554424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:24.554425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:24.554428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255986496025214:7515] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:24.555176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255986496025214:7515] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:24.557249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255986496025214:7515] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:24.557664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:24.559492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:24.559618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:24.559625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:24.559632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:24.559660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:24.559688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255984119134319:4535]
2025-10-01T14:12:24.559694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255986496025214:7515] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:24.559702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255986496025214:7515] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:24.559705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255986496025214:7515] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:24.559710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:24.560043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:24.560219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:24.560243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:24.560432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:24.560469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.560473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.560474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.560475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.560475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.560476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.560476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.560477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.560477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.560478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.560479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.560479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.560480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.560481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.560483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.560489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.560491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.560493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.560495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.560497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.560499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.560501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.560503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.560505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.560508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.560509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.560511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.560513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.560517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.560522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.560525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.560528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.560531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.560533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.560536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.560539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.560541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.560544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.560546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.560548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.560551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.560554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.560556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.560559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.560561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.560564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.560567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.560569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.560571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.560574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.560576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.560579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.560582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.560585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.560587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.560589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.560607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:24.564105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:24.564760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:24.564776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:24.564778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:24.564782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:24.564788Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1653 [2:7556255984119134319:4535]
2025-10-01T14:12:24.564805Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:24.564820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:24.564828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.564832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.564834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.564849Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:24.564860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:24.564865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:24.564927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.564933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.564935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.564938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:24.564940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:24.565000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:24.565008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.565019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.565031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.565050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:24.565072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496025319:7515], now have 1 active actors on pipe
2025-10-01T14:12:24.565080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496025010:2446], now have 1 active actors on pipe
2025-10-01T14:12:24.565086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255984119134314:4535]
2025-10-01T14:12:24.565092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255984119134314:4535]
2025-10-01T14:12:24.565095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255984119134314:4535]
2025-10-01T14:12:24.565111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:24.565121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1653
2025-10-01T14:12:24.565121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1653
2025-10-01T14:12:24.565129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:24.565145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:24.565148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:24.565149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:24.565151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:24.565151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:24.565180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255984119134314:4535]
2025-10-01T14:12:24.565187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:24.565193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:24.565208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.565213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.565254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:24.565265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.565269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.565271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:24.565279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.565292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:24.565316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.565495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.565505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.565520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.565587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1654 partition: 0 MaxSeqNo: 45 sessionId: src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0
2025-10-01T14:12:24.565945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78932394-c04bc6a2-1bbde621-4f237a91_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:24.569082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0] Write session: try to update token
2025-10-01T14:12:24.569102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:24.582164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1654 sessionId: src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:24.584053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:24.584070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:24.584072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:24.584073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:24.584080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255984119134314:4535]
2025-10-01T14:12:24.584084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255984119134314:4535]
2025-10-01T14:12:24.584087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255984119134314:4535]
2025-10-01T14:12:24.584122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:24.584127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.584128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:24.584151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:24.584167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:24.584170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:24.584206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:24.584257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:24.643779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255986496025331:7971]
2025-10-01T14:12:24.644001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1653, pipe: [1:7556255986496025331:7971]
2025-10-01T14:12:24.717808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:24.718030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.718041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.718075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496025331:7971], now have 1 active actors on pipe
2025-10-01T14:12:24.718210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:24.718314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:24.718324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:24.718326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255986496025331:7971]
2025-10-01T14:12:24.718341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:24.718400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1654 reason: error at write: Disconnected sessionId: src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0
2025-10-01T14:12:24.718588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1654 sessionId: src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0 is DEAD
2025-10-01T14:12:24.718714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:24.718723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0] Write session will restart in 0.008192s
2025-10-01T14:12:24.718742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0] Write session: Do CDS request
2025-10-01T14:12:24.718747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:24.727924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.728012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:24.728026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1655
2025-10-01T14:12:24.728155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.728184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:24.728196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:24.728203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:24.728586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1655 sessionId:  describe result for acl check
2025-10-01T14:12:24.728614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:24.728618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:24.728620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:24.728623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255986496025525:7509] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:24.729050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255986496025525:7509] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:24.731102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255986496025525:7509] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:24.732161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:24.733758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:24.733907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:24.733916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:24.733925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:24.733944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255986496025525:7509] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:24.733952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255986496025525:7509] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:24.733954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255986496025525:7509] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:24.733968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:24.733959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:24.734000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255984119134557:4522]
2025-10-01T14:12:24.734450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:24.734711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:24.734748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:24.735018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:24.735067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.735072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.735073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.735074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.735075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.735076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.735077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.735078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.735079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.735080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.735081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.735082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.735083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.735084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.735089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.735099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.735103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.735106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.735110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.735114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.735117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.735121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.735125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.735129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.735133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.735137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.735141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.735144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.735154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.735165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.735173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.735179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.735186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.735191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.735196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.735201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.735208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.735213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.735219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.735224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.735232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.735237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.735244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.735250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.735257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.735261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.735268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.735273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.735280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.735285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.735290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.735295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.735307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.735311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.735316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.735324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.735358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:24.738702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:24.739288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:24.739301Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:24.739303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:24.739306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:24.739312Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1654 [2:7556255984119134557:4522]
2025-10-01T14:12:24.739328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:24.739347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:24.739353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.739356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.739358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.739373Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:24.739383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:24.739392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:24.739446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.739451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.739453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.739456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:24.739458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:24.739519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:24.739526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.739536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.739544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.739557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:24.739575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496025643:7509], now have 1 active actors on pipe
2025-10-01T14:12:24.739578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496025332:2446], now have 1 active actors on pipe
2025-10-01T14:12:24.739584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255984119134552:4522]
2025-10-01T14:12:24.739586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255984119134552:4522]
2025-10-01T14:12:24.739588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255984119134552:4522]
2025-10-01T14:12:24.739601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:24.739612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:24.739615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:24.739616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:24.739617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:24.739630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:24.739632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:24.739628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1654
2025-10-01T14:12:24.739630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1654
2025-10-01T14:12:24.739655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255984119134552:4522]
2025-10-01T14:12:24.739662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:24.739664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:24.739691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.739698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.739723Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:24.739733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.739737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.739739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:24.739746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.739754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:24.739770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.739911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.739917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.739927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.739991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1655 partition: 0 MaxSeqNo: 45 sessionId: src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0
2025-10-01T14:12:24.740362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a62faeb-2178eadf-80c016f2-639a10fe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:24.742677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0] Write session: try to update token
2025-10-01T14:12:24.742693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:24.755428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1655 sessionId: src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:24.757456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:24.758860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.758882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.758905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:24.758908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:24.758910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:24.758912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:24.758920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255984119134552:4522]
2025-10-01T14:12:24.758924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255984119134552:4522]
2025-10-01T14:12:24.758929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255984119134552:4522]
2025-10-01T14:12:24.758964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:24.758975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:24.758979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:24.758980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:24.758985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.758987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:24.759110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:24.818702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255986496025668:7971]
2025-10-01T14:12:24.818936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1654, pipe: [1:7556255986496025668:7971]
2025-10-01T14:12:24.895641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:24.895894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:24.895943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496025668:7971], now have 1 active actors on pipe
2025-10-01T14:12:24.896027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:24.896102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:24.896102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255986496025668:7971]
2025-10-01T14:12:24.896110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:24.896121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:24.896164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1655 reason: error at write: Disconnected sessionId: src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0
2025-10-01T14:12:24.896293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1655 sessionId: src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0 is DEAD
2025-10-01T14:12:24.896447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:24.896458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0] Write session will restart in 0.009575s
2025-10-01T14:12:24.896483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0] Write session: Do CDS request
2025-10-01T14:12:24.896491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:24.906666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.906746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:24.906754Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1656
2025-10-01T14:12:24.906856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:24.906878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:24.906885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:24.906887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:24.907170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1656 sessionId:  describe result for acl check
2025-10-01T14:12:24.907197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:24.907201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:24.907202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:24.907206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255986496025956:7496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:24.907425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:24.907577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255986496025956:7496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:24.909056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:24.909207Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:24.909216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:24.909224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:24.909262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:24.909292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255984119134801:4528]
2025-10-01T14:12:24.909387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255986496025956:7496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:24.909839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:24.910088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:24.910130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:24.910424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:24.910472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.910477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.910479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.910480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.910481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.910482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.910482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.910483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.910484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.910485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.910486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.910487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.910487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.910488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.910492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.910501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.910504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.910507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.910511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.910515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.910519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.910523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.910527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.910531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.910535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.910538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.910542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.910545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.910551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.910558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:24.910563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.910568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:24.910575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.910579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:24.910583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.910587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:24.910592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.910597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:24.910601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.910606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:24.910611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.910616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:24.910620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.910625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:24.910641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.910646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:24.910654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.910659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.910666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.910671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.910677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.910683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.910690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.910695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:24.910702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.910707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:24.910745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:24.913943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255986496025956:7496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:24.913955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255986496025956:7496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:24.913958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255986496025956:7496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:24.913965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:24.914131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:24.914711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:24.914723Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:24.914725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:24.914729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:24.914735Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1655 [2:7556255984119134801:4528]
2025-10-01T14:12:24.914749Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:24.914763Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:24.914769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.914772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.914774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.914788Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:24.914800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:24.914806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:24.914852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.914858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.914860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.914863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:24.914866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:24.914925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:24.914931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.914942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:24.914954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:24.914974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:24.914994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496025996:7496], now have 1 active actors on pipe
2025-10-01T14:12:24.914997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496025680:2446], now have 1 active actors on pipe
2025-10-01T14:12:24.915003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255984119134795:4528]
2025-10-01T14:12:24.915005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255984119134795:4528]
2025-10-01T14:12:24.915007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255984119134795:4528]
2025-10-01T14:12:24.914993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1655
2025-10-01T14:12:24.915001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1655
2025-10-01T14:12:24.915016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:24.915022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:24.915025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:24.915026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:24.915030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:24.915044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:24.915050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:24.915069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.915076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.915101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255984119134795:4528]
2025-10-01T14:12:24.915112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:24.915119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:24.915127Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:24.915133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:24.915136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:24.915138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:24.915146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:24.915155Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:24.915181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.915277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.915283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.915293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:24.915342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1656 partition: 0 MaxSeqNo: 45 sessionId: src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0
2025-10-01T14:12:24.915635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c252849a-b95cf105-97b92d67-1dbd3f74_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:24.917882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0] Write session: try to update token
2025-10-01T14:12:24.917897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:24.930447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1656 sessionId: src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:24.932554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:24.932732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:24.932751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:24.934473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:24.934499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:24.934503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:24.934506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:24.934507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:24.934517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255984119134795:4528]
2025-10-01T14:12:24.934522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255984119134795:4528]
2025-10-01T14:12:24.934526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255984119134795:4528]
2025-10-01T14:12:24.934549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:24.934560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:24.934560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:24.934563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:24.934565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:24.934566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:24.934566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:24.934681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:24.996374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255986496026004:7971]
2025-10-01T14:12:24.996591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1655, pipe: [1:7556255986496026004:7971]
2025-10-01T14:12:25.074808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:25.082013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.082037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.082173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.082227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.082281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.082336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.082390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.082402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.082470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.082528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.082588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.082654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.082696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.082702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.082758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.082810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.082866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.082918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.082958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.082964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.083025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.083079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.083132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.083193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.083235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.083241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.083298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.083350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.083407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.083460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.083502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.083508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.083567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.083621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.083682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.083744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.083789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.083794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.083853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.083906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.083964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.084023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.084063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.084069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.084131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.084186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.084242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.084300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.084342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.084348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.084412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.084469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.084529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.084586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.084628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.084634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.084703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.084760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.084817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.084879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.084921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.084925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.084968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255986496026004:7971], now have 1 active actors on pipe
2025-10-01T14:12:25.085115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255986496026004:7971]
2025-10-01T14:12:25.085118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:25.085121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:25.085134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:25.085140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1656 reason: error at write: Disconnected sessionId: src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0
2025-10-01T14:12:25.085283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1656 sessionId: src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0 is DEAD
2025-10-01T14:12:25.085431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:25.085441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0] Write session will restart in 0.008512s
2025-10-01T14:12:25.085466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0] Write session: Do CDS request
2025-10-01T14:12:25.085471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:25.085849Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:25.094803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.094878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:25.094887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1657
2025-10-01T14:12:25.094985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.095007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:25.095014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:25.095016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:25.095311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1657 sessionId:  describe result for acl check
2025-10-01T14:12:25.095334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:25.095335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:25.095336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:25.095339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255990790993536:7489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:25.095672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255990790993536:7489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:25.097493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255990790993536:7489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:25.099120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:25.099301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255990790993536:7489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:25.099321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255990790993536:7489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:25.099324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255990790993536:7489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:25.099329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:25.099435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:25.099587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:25.099598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:25.099609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:25.099662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:25.099695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255988414102352:4524]
2025-10-01T14:12:25.100211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:25.100452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:25.100492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:25.100714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:25.100759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.100764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.100765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.100766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.100767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.100768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.100770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.100770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.100771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.100772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.100773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.100774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.100775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.100776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.100780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.100791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.100794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.100798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.100802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.100806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.100810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.100814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.100817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.100822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.100825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.100829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.100833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.100837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.100843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.100851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.100857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.100866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.100871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.100879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.100883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.100887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.100891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.100895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.100899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.100905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.100909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.100917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.100924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.100930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.100936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.100941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.100948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.100953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.100959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.100964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.100971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.100976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.100983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.100987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.100995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.101000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.101034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:25.104336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:25.105052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:25.105063Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:25.105065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:25.105068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:25.105074Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1656 [2:7556255988414102352:4524]
2025-10-01T14:12:25.105088Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:25.105100Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:25.105108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.105111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.105113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.105128Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:25.105137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:25.105142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:25.105191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.105197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.105199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.105202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:25.105205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:25.105262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:25.105269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.105279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.105287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.105300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:25.105315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790993615:7489], now have 1 active actors on pipe
2025-10-01T14:12:25.105323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790993303:2446], now have 1 active actors on pipe
2025-10-01T14:12:25.105329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255988414102346:4524]
2025-10-01T14:12:25.105332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255988414102346:4524]
2025-10-01T14:12:25.105334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255988414102346:4524]
2025-10-01T14:12:25.105345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:25.105339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1656
2025-10-01T14:12:25.105356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:25.105364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:25.105367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:25.105374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1656
2025-10-01T14:12:25.105369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:25.105371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:25.105374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:25.105395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255988414102346:4524]
2025-10-01T14:12:25.105398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:25.105400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:25.105416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.105425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.105453Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:25.105464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.105467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.105469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:25.105477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.105485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:25.105500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.105609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.105616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.105628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.105693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1657 partition: 0 MaxSeqNo: 45 sessionId: src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0
2025-10-01T14:12:25.105979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f38ab5a1-c9d7170d-cc1a7057-c3bbc45a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:25.108357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0] Write session: try to update token
2025-10-01T14:12:25.108372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:25.121067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1657 sessionId: src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:25.123235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:25.124676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.124696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.124713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:25.124716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:25.124717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:25.124718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:25.124726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255988414102346:4524]
2025-10-01T14:12:25.124729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255988414102346:4524]
2025-10-01T14:12:25.124731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255988414102346:4524]
2025-10-01T14:12:25.124776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:25.124781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:25.124786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.124787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:25.124790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:25.124797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:25.124906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:25.185308Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255990790993630:7971]
2025-10-01T14:12:25.185530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1656, pipe: [1:7556255990790993630:7971]
2025-10-01T14:12:25.256583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:25.257057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:25.257105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790993630:7971], now have 1 active actors on pipe
2025-10-01T14:12:25.257190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:25.257301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255990790993630:7971]
2025-10-01T14:12:25.257329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:25.266276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:25.266289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:25.266310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1657 reason: error at write: Disconnected sessionId: src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0
2025-10-01T14:12:25.266467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1657 sessionId: src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0 is DEAD
2025-10-01T14:12:25.266597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:25.266606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0] Write session will restart in 0.005802s
2025-10-01T14:12:25.266623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0] Write session: Do CDS request
2025-10-01T14:12:25.266628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:25.272509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:25.273743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.273865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:25.273877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1658
2025-10-01T14:12:25.273981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.274004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:25.274012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:25.274014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:25.274012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:25.274137Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:25.274145Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:25.274152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:25.274180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:25.274208Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255988414102619:4504]
2025-10-01T14:12:25.274291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1658 sessionId:  describe result for acl check
2025-10-01T14:12:25.274316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:25.274321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:25.274322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:25.274325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255990790993912:7480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:25.274579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:25.274693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255990790993912:7480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:25.274778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:25.274806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:25.275016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:25.275055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.275056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.275056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.275057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.275057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.275058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.275058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.275059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.275059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.275060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.275060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.275061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.275061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.275062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.275065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.275073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.275077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.275080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.275083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.275086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.275089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.275092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.275095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.275098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.275101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.275105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.275108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.275112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.275119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.275125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.275131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.275135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.275139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.275144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.275148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.275150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.275153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.275155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.275158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.275160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.275163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.275165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.275168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.275170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.275172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.275175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.275177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.275180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.275182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.275184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.275187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.275189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.275192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.275194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.275196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.275199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.275217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:25.276587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255990790993912:7480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:25.278359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255990790993912:7480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:25.278389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255990790993912:7480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:25.278395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255990790993912:7480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:25.278357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:25.278399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:25.278892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:25.278905Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:25.278906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:25.278908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:25.278912Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1657 [2:7556255988414102619:4504]
2025-10-01T14:12:25.278920Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:25.278931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:25.278933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.278935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.278936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.278946Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:25.278949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:25.278953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:25.278985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.278988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.278989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.278991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:25.278993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:25.279047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:25.279054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.279063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.279073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.279087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:25.279103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790993632:2446], now have 1 active actors on pipe
2025-10-01T14:12:25.279109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790993962:7480], now have 1 active actors on pipe
2025-10-01T14:12:25.279113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255988414102614:4504]
2025-10-01T14:12:25.279115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255988414102614:4504]
2025-10-01T14:12:25.279116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255988414102614:4504]
2025-10-01T14:12:25.279119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1657
2025-10-01T14:12:25.279121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1657
2025-10-01T14:12:25.279128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:25.279143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:25.279146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:25.279155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:25.279155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:25.279157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:25.279158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:25.279187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.279196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.279208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255988414102614:4504]
2025-10-01T14:12:25.279215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:25.279227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:25.279236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89495caf-5b42a63c-649c3703-c56fdf24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:25.279242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.279248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.279249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:25.279256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.279264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:25.279287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.279385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.279392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.279404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.279456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1658 partition: 0 MaxSeqNo: 45 sessionId: src_id|89495caf-5b42a63c-649c3703-c56fdf24_0
2025-10-01T14:12:25.279699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f3b51673-21154c53-38a06f8f-a0ee5987_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|89495caf-5b42a63c-649c3703-c56fdf24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:25.281928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89495caf-5b42a63c-649c3703-c56fdf24_0] Write session: try to update token
2025-10-01T14:12:25.281946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89495caf-5b42a63c-649c3703-c56fdf24_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:25.294843Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1658 sessionId: src_id|89495caf-5b42a63c-649c3703-c56fdf24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:25.297035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:25.298042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.298066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.298082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:25.298085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:25.298086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:25.298087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:25.298093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255988414102614:4504]
2025-10-01T14:12:25.298096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255988414102614:4504]
2025-10-01T14:12:25.298098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255988414102614:4504]
2025-10-01T14:12:25.298145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:25.298148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:25.298151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.298153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:25.298153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:25.298157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:25.298267Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:25.357334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255990790993970:7971]
2025-10-01T14:12:25.357502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1657, pipe: [1:7556255990790993970:7971]
2025-10-01T14:12:25.431417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:25.431620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:25.431664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790993970:7971], now have 1 active actors on pipe
2025-10-01T14:12:25.431771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:25.431838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255990790993970:7971]
2025-10-01T14:12:25.431869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:25.441359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:25.441373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:25.441391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1658 reason: error at write: Disconnected sessionId: src_id|89495caf-5b42a63c-649c3703-c56fdf24_0
2025-10-01T14:12:25.441539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1658 sessionId: src_id|89495caf-5b42a63c-649c3703-c56fdf24_0 is DEAD
2025-10-01T14:12:25.441683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89495caf-5b42a63c-649c3703-c56fdf24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:25.441693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89495caf-5b42a63c-649c3703-c56fdf24_0] Write session will restart in 0.007861s
2025-10-01T14:12:25.441718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89495caf-5b42a63c-649c3703-c56fdf24_0] Write session: Do CDS request
2025-10-01T14:12:25.441727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89495caf-5b42a63c-649c3703-c56fdf24_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:25.448361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:25.449757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:25.449890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:25.449898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:25.449905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:25.449935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:25.449960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255988414102859:4505]
2025-10-01T14:12:25.450476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:25.450686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:25.450723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:25.450866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89495caf-5b42a63c-649c3703-c56fdf24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.450948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:25.450942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:25.450953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1659
2025-10-01T14:12:25.450983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.450990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.450991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.450992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.450993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.450994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.450995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.450996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.450997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.450998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.450999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.451000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.451001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.451002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.451007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.451015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.451018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.451022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.451025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.451029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.451032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.451036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.451040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.451044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.451076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.451047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.451051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.451097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:25.451054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.451058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.451064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.451071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.451102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:25.451076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.451108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:25.451081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.451085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.451090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.451094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.451099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.451103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.451108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.451112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.451117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.451121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.451126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.451130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.451135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.451139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.451144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.451148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.451153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.451157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.451162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.451165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.451175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.451180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.451185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.451192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.451197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.451236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:25.451429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1659 sessionId:  describe result for acl check
2025-10-01T14:12:25.451460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:25.451466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:25.451467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:25.451471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255990790994260:7470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:25.451937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255990790994260:7470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:25.453818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255990790994260:7470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:25.454507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:25.455286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:25.455298Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:25.455300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:25.455302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:25.455307Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1658 [2:7556255988414102859:4505]
2025-10-01T14:12:25.455320Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:25.455335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:25.455338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.455341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.455342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.455354Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:25.455361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:25.455365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:25.455408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.455412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.455413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.455416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:25.455417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:25.455458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:25.455463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.455470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.455479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.455490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:25.455503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255988414102854:4505]
2025-10-01T14:12:25.455508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255988414102854:4505]
2025-10-01T14:12:25.455509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255988414102854:4505]
2025-10-01T14:12:25.455514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:25.455523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:25.455523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:25.455526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:25.455528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:25.455533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:25.455535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:25.455542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790993974:2446], now have 1 active actors on pipe
2025-10-01T14:12:25.455558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255988414102854:4505]
2025-10-01T14:12:25.455568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:25.455571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1658
2025-10-01T14:12:25.455583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:25.456092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255990790994260:7470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:25.456103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255990790994260:7470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:25.456106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255990790994260:7470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:25.456111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:25.456279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790994297:7470], now have 1 active actors on pipe
2025-10-01T14:12:25.456308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1658
2025-10-01T14:12:25.456385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.456404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.456432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:25.456459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.456470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.456473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:25.456484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.456499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:25.456520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.456663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.456669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.456679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.456733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1659 partition: 0 MaxSeqNo: 45 sessionId: src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0
2025-10-01T14:12:25.456971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89495caf-5b42a63c-649c3703-c56fdf24_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:25.459153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0] Write session: try to update token
2025-10-01T14:12:25.459167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:25.465416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:25.465428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:25.465435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255988414102854:4505]
2025-10-01T14:12:25.465466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:25.465490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:25.465617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:25.465767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:25.465917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:25.466038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:25.466229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:25.466270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:25.470707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1659 sessionId: src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:25.472803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:25.472952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.472973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.473019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:25.473068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:25.482775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:25.482796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:25.482798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:25.482800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:25.482811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255988414102854:4505]
2025-10-01T14:12:25.482816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255988414102854:4505]
2025-10-01T14:12:25.482820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255988414102854:4505]
2025-10-01T14:12:25.482846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:25.482851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:25.482854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:25.482864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:25.482870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.482876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:25.483003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:25.531923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255990790994306:7971]
2025-10-01T14:12:25.532097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1658, pipe: [1:7556255990790994306:7971]
2025-10-01T14:12:25.621169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:25.628377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.628400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.628525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.628576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.628627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.628684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.629110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.629120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.629172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.629232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.629280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.629333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.629372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.629377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.629433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.629485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.629537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.629589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.629627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.629632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.629689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.629742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.629796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.629851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.629890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.629895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.629950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.630001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.630055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.630108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.630146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.630151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.630206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.630257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.630309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.630365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.630423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.630429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.630489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.630538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.630593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.630647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.630684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.630688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.630742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.630791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.630859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.630923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.630968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.630974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.631035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.631093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.631151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.631224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.631268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.631275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.631337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.631391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.631450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.631509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.631550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.631555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.631611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790994306:7971], now have 1 active actors on pipe
2025-10-01T14:12:25.631821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255990790994306:7971]
2025-10-01T14:12:25.631841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:25.631851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:25.631854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:25.631876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1659 reason: error at write: Disconnected sessionId: src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0
2025-10-01T14:12:25.632055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1659 sessionId: src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0 is DEAD
2025-10-01T14:12:25.632105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:25.632214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:25.632224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0] Write session will restart in 0.008187s
2025-10-01T14:12:25.632259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0] Write session: Do CDS request
2025-10-01T14:12:25.632266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:25.641822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.641873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:25.641884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1660
2025-10-01T14:12:25.641989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.642011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:25.642019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:25.642021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:25.642430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1660 sessionId:  describe result for acl check
2025-10-01T14:12:25.642457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:25.642463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:25.642464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:25.642470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255990790994542:7465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:25.642926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255990790994542:7465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:25.644726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:25.644903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255990790994542:7465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:25.646231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:25.646407Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:25.646414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:25.646423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:25.646456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:25.646479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255988414103102:4501]
2025-10-01T14:12:25.646880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:25.646991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255990790994542:7465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:25.647001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255990790994542:7465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:25.647005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255990790994542:7465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:25.647011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:25.647072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:25.647101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:25.647280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:25.647311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.647315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.647316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.647316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.647317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.647318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.647318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.647319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.647319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.647320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.647320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.647321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.647322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.647322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.647325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.647330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.647333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.647335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.647337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.647339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.647341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.647343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.647345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.647347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.647350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.647354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.647357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.647360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.647365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.647371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.647376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.647381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.647385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.647390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.647393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.647398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.647402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.647407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.647411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.647416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.647423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.647427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.647437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.647441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.647445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.647454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.647458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.647461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.647464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.647470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.647472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.647475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.647478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.647480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.647482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.647485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.647505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:25.650584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:25.651245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:25.651255Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:25.651257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:25.651259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:25.651263Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1659 [2:7556255988414103102:4501]
2025-10-01T14:12:25.651271Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:25.651281Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:25.651283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.651285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.651286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.651295Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:25.651298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:25.651303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:25.651335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.651340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.651341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.651343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:25.651345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:25.651386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:25.651391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.651398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.651403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.651415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:25.651431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255988414103097:4501]
2025-10-01T14:12:25.651436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255988414103097:4501]
2025-10-01T14:12:25.651438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255988414103097:4501]
2025-10-01T14:12:25.651448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:25.651451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:25.651453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:25.651455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:25.651461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790994626:7465], now have 1 active actors on pipe
2025-10-01T14:12:25.651468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790994309:2446], now have 1 active actors on pipe
2025-10-01T14:12:25.651472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:25.651484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:25.651490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:25.651505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255988414103097:4501]
2025-10-01T14:12:25.651515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:25.651518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:25.651530Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1659
2025-10-01T14:12:25.651559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1659
2025-10-01T14:12:25.651612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.651620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.651641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:25.651651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.651658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.651661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:25.651668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.651678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:25.651693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.651810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.651816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.651825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.651883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1660 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0
2025-10-01T14:12:25.652142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2e77dc1-9b7df6f6-38aaac89-711fbd55_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:25.654320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0] Write session: try to update token
2025-10-01T14:12:25.654335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:25.666744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1660 sessionId: src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:25.669037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:25.670331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.670352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.670384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:25.670387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:25.670389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:25.670390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:25.670395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255988414103097:4501]
2025-10-01T14:12:25.670400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255988414103097:4501]
2025-10-01T14:12:25.670403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255988414103097:4501]
2025-10-01T14:12:25.670430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:25.670433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:25.670436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:25.670442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:25.670446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.670448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:25.670553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:25.732121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255990790994635:7971]
2025-10-01T14:12:25.732358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1659, pipe: [1:7556255990790994635:7971]
2025-10-01T14:12:25.800934Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:25.801246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:25.801291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790994635:7971], now have 1 active actors on pipe
2025-10-01T14:12:25.801364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:25.801425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255990790994635:7971]
2025-10-01T14:12:25.801438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:25.801444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:25.801445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:25.801500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1660 reason: error at write: Disconnected sessionId: src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0
2025-10-01T14:12:25.801624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1660 sessionId: src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0 is DEAD
2025-10-01T14:12:25.801742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:25.801751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0] Write session will restart in 0.008885s
2025-10-01T14:12:25.801775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0] Write session: Do CDS request
2025-10-01T14:12:25.801784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:25.811809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.811883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:25.811894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1661
2025-10-01T14:12:25.811985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.812008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:25.812012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:25.812014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:25.812288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1661 sessionId:  describe result for acl check
2025-10-01T14:12:25.812310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:25.812314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:25.812316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:25.812320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255990790994916:7461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:25.812743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255990790994916:7461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:25.813173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:25.814484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255990790994916:7461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:25.814671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:25.814821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:25.814828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:25.814836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:25.814868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:25.814892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255988414103344:4500]
2025-10-01T14:12:25.815290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:25.815467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:25.815504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:25.815734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:25.815790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.815796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.815797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.815798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.815798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.815799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.815800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.815801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.815802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.815803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.815804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.815804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.815805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.815807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.815811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.815820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.815823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.815826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.815829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.815832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.815835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.815839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.815842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.815845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.815847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.815850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.815853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.815856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.815862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.815868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.815873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.815877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.815881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.815885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.815888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.815893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.815897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.815901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.815905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.815909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.815913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.815917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.815920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.815924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.815928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.815933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.815936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.815941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.815951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.815955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.815958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.815963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.815971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.815975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.815980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.815987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.816019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:25.816575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255990790994916:7461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:25.816589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255990790994916:7461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:25.816592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255990790994916:7461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:25.816599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:25.819211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:25.819808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:25.819815Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:25.819816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:25.819819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:25.819823Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1660 [2:7556255988414103344:4500]
2025-10-01T14:12:25.819833Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:25.819847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:25.819855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.819858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.819860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.819874Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:25.819877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:25.819881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:25.819914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.819920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.819921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.819923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:25.819925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:25.819969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:25.819974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.819981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.819986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.819994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:25.820005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790994958:7461], now have 1 active actors on pipe
2025-10-01T14:12:25.820011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790994637:2446], now have 1 active actors on pipe
2025-10-01T14:12:25.820016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255988414103339:4500]
2025-10-01T14:12:25.820017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255988414103339:4500]
2025-10-01T14:12:25.820018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255988414103339:4500]
2025-10-01T14:12:25.820026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:25.820035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:25.820034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:25.820036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:25.820038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:25.820046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:25.820048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:25.820064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255988414103339:4500]
2025-10-01T14:12:25.820069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:25.820076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:25.820061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1660
2025-10-01T14:12:25.820067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1660
2025-10-01T14:12:25.820090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.820096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.820117Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:25.820124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.820127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.820128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:25.820134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.820139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:25.820153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.820238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.820242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.820251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.820310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1661 partition: 0 MaxSeqNo: 45 sessionId: src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0
2025-10-01T14:12:25.820543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4b10e2-9796a652-1ea63ed4-c880111_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:25.822673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0] Write session: try to update token
2025-10-01T14:12:25.822686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:25.834150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1661 sessionId: src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:25.836165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:25.836349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.836375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.836414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:25.836478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:25.838759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:25.838773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:25.838775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:25.838776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:25.838784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255988414103339:4500]
2025-10-01T14:12:25.838787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255988414103339:4500]
2025-10-01T14:12:25.838789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255988414103339:4500]
2025-10-01T14:12:25.838820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:25.838823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:25.838825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:25.838828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.838828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:25.838829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:25.838949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:25.901596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255990790994989:7971]
2025-10-01T14:12:25.901799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1660, pipe: [1:7556255990790994989:7971]
2025-10-01T14:12:25.968171Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:25.974554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.974575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.974708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.974762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.974817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.974877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.974922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.974930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.974986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.975035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.975090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.975144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.975184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.975189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.975239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.975286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.975335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.975386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.975429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.975435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.975488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.975536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.975591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.975638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.975675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.975680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.975730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.975778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.975825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.975874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.975920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.975928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.975980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.976027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.976077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.976131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.976168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.976174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.976223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.976272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.976323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.976374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.976414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.976422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.976475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.976523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.976573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.976624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.976678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.976684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.976736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.976785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.976836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.976887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.976927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.976935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.976991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:25.977041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:25.977092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:25.977142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:25.977178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:25.977183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:25.977218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790994989:7971], now have 1 active actors on pipe
2025-10-01T14:12:25.977402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:25.977410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:25.977420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:25.977431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1661 reason: error at write: Disconnected sessionId: src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0
2025-10-01T14:12:25.977459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255990790994989:7971]
2025-10-01T14:12:25.977572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1661 sessionId: src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0 is DEAD
2025-10-01T14:12:25.977717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:25.977726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0] Write session will restart in 0.005030s
2025-10-01T14:12:25.977746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0] Write session: Do CDS request
2025-10-01T14:12:25.977751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:25.977994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:25.983747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.983813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:25.983823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1662
2025-10-01T14:12:25.983909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:25.983932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:25.983936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:25.983942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:25.984203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1662 sessionId:  describe result for acl check
2025-10-01T14:12:25.984222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:25.984226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:25.984227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:25.984231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255990790995090:7436] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:25.984578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255990790995090:7436] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:25.986527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255990790995090:7436] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:25.988597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255990790995090:7436] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:25.988606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255990790995090:7436] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:25.988608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255990790995090:7436] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:25.988613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:25.989768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:25.991125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:25.991346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:25.991355Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:25.991366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:25.991410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:25.991441Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255988414103595:4493]
2025-10-01T14:12:25.992008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:25.992196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:25.992227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:25.992443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:25.992479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.992483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.992484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.992484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.992485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.992486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.992486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.992487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.992487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.992488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.992488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.992489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.992489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.992490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.992494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.992503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.992506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.992510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.992514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.992517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.992521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.992524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.992527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.992531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.992535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.992538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.992541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.992545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.992550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.992557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:25.992561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.992564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:25.992567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.992570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:25.992572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.992575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:25.992577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.992580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:25.992582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.992585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:25.992587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.992590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:25.992592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.992595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:25.992597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.992600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:25.992602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.992605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.992607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.992611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.992615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.992619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.992623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.992628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:25.992632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.992636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:25.992682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:25.995810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:25.996347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:25.996358Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:25.996360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:25.996362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:25.996366Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1661 [2:7556255988414103595:4493]
2025-10-01T14:12:25.996375Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:25.996388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:25.996389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.996391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.996393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.996404Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:25.996412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:25.996418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:25.996455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.996460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.996461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.996463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:25.996465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:25.996585Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1661
2025-10-01T14:12:25.996589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1661
2025-10-01T14:12:25.996699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:25.996706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:25.996713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:25.996719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:25.996728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:25.996746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790994994:2446], now have 1 active actors on pipe
2025-10-01T14:12:25.996754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255990790995303:7436], now have 1 active actors on pipe
2025-10-01T14:12:25.996772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.996780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.996795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255988414103590:4493]
2025-10-01T14:12:25.996801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255988414103590:4493]
2025-10-01T14:12:25.996802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255988414103590:4493]
2025-10-01T14:12:25.996814Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:25.996824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:25.996831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:25.996832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:25.996832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:25.996845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:25.996851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:25.996865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f94dc55a-faed3a1f-d332d469-6367b050_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:25.996875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:25.996878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:25.996884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:25.996891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:25.996901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:25.996921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255988414103590:4493]
2025-10-01T14:12:25.996929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:25.996935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:25.996939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.997039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:25.997046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:25.997060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:25.997113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1662 partition: 0 MaxSeqNo: 45 sessionId: src_id|f94dc55a-faed3a1f-d332d469-6367b050_0
2025-10-01T14:12:25.997401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d25cecd-2b5c98f1-afa5024f-d0019566_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f94dc55a-faed3a1f-d332d469-6367b050_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:25.999525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94dc55a-faed3a1f-d332d469-6367b050_0] Write session: try to update token
2025-10-01T14:12:25.999538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94dc55a-faed3a1f-d332d469-6367b050_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:26.012457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1662 sessionId: src_id|f94dc55a-faed3a1f-d332d469-6367b050_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:26.014650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:26.015796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.015817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.015834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:26.015836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:26.015838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:26.015839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:26.015845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255988414103590:4493]
2025-10-01T14:12:26.015847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255988414103590:4493]
2025-10-01T14:12:26.015852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255988414103590:4493]
2025-10-01T14:12:26.015889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:26.015897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:26.015902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:26.015904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.015906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:26.015906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:26.016023Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:26.077750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255995085962615:7971]
2025-10-01T14:12:26.077999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1661, pipe: [1:7556255995085962615:7971]
2025-10-01T14:12:26.152272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:26.152471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:26.152514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085962615:7971], now have 1 active actors on pipe
2025-10-01T14:12:26.152595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:26.152693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:26.152699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:26.152756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1662 reason: error at write: Disconnected sessionId: src_id|f94dc55a-faed3a1f-d332d469-6367b050_0
2025-10-01T14:12:26.152883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255995085962615:7971]
2025-10-01T14:12:26.152907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:26.152916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1662 sessionId: src_id|f94dc55a-faed3a1f-d332d469-6367b050_0 is DEAD
2025-10-01T14:12:26.153052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94dc55a-faed3a1f-d332d469-6367b050_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:26.153062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94dc55a-faed3a1f-d332d469-6367b050_0] Write session will restart in 0.007245s
2025-10-01T14:12:26.153085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94dc55a-faed3a1f-d332d469-6367b050_0] Write session: Do CDS request
2025-10-01T14:12:26.153094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94dc55a-faed3a1f-d332d469-6367b050_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:26.161870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94dc55a-faed3a1f-d332d469-6367b050_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.161918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:26.161929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1663
2025-10-01T14:12:26.162092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.162128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:26.162137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:26.162140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:26.162599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1663 sessionId:  describe result for acl check
2025-10-01T14:12:26.162640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:26.162647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:26.162650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:26.162659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255995085962828:7439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:26.163144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255995085962828:7439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:26.165036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255995085962828:7439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:26.165903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:26.167485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:26.167697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:26.167706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:26.167714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:26.167749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:26.167775Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255992709071161:4484]
2025-10-01T14:12:26.167861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255995085962828:7439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:26.167875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255995085962828:7439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:26.167878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255995085962828:7439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:26.167885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:26.168229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:26.168482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:26.168525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:26.168750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:26.168803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.168808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.168808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.168809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.168810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.168810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.168811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.168811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.168812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.168813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.168813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.168814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.168814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.168815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.168819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.168824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.168826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.168828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.168830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.168832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.168835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.168837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.168839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.168841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.168843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.168845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.168847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.168849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.168853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.168858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.168861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.168865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.168867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.168870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.168872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.168875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.168877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.168880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.168882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.168885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.168887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.168890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.168893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.168896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.168901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.168905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.168909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.168913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.168926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.168929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.168932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.168934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.168936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.168939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.168941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.168943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.168962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:26.172373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:26.173045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:26.173056Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:26.173057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:26.173060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:26.173065Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1662 [2:7556255992709071161:4484]
2025-10-01T14:12:26.173074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:26.173088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:26.173090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.173092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.173093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.173105Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:26.173108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:26.173113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:26.173151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.173156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.173157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.173159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:26.173161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:26.173207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:26.173212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.173218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.173224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.173232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:26.173246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255992709071156:4484]
2025-10-01T14:12:26.173251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255992709071156:4484]
2025-10-01T14:12:26.173252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255992709071156:4484]
2025-10-01T14:12:26.173258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:26.173265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:26.173268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:26.173273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:26.173274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:26.173276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:26.173279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:26.173329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085962934:7439], now have 1 active actors on pipe
2025-10-01T14:12:26.173337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085962618:2446], now have 1 active actors on pipe
2025-10-01T14:12:26.173358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255992709071156:4484]
2025-10-01T14:12:26.173363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:26.173374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:26.173362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1662
2025-10-01T14:12:26.173397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.173380Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1662
2025-10-01T14:12:26.173400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.173420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:26.173429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.173432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.173433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:26.173438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.173445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:26.173455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.173561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.173566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.173576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.173625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1663 partition: 0 MaxSeqNo: 45 sessionId: src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0
2025-10-01T14:12:26.173932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94dc55a-faed3a1f-d332d469-6367b050_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:26.176242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0] Write session: try to update token
2025-10-01T14:12:26.176261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:26.189703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1663 sessionId: src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:26.191966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:26.192100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:26.192119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:26.192121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:26.192123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:26.192131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255992709071156:4484]
2025-10-01T14:12:26.192136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255992709071156:4484]
2025-10-01T14:12:26.192139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255992709071156:4484]
2025-10-01T14:12:26.192167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:26.192171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:26.192173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:26.192188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.192198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.192215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:26.192223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.192224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:26.192333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:26.252842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255995085962946:7971]
2025-10-01T14:12:26.253070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1662, pipe: [1:7556255995085962946:7971]
2025-10-01T14:12:26.325548Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:26.326422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085962946:7971], now have 1 active actors on pipe
2025-10-01T14:12:26.326642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:26.326646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255995085962946:7971]
2025-10-01T14:12:26.326657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:26.326675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:26.326702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:26.326717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1663 reason: error at write: Disconnected sessionId: src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0
2025-10-01T14:12:26.326884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1663 sessionId: src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0 is DEAD
2025-10-01T14:12:26.326980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:26.326991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0] Write session will restart in 0.008373s
2025-10-01T14:12:26.327013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0] Write session: Do CDS request
2025-10-01T14:12:26.327018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:26.336906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.337024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:26.337036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1664
2025-10-01T14:12:26.337160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.337189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:26.337198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:26.337201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:26.337569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1664 sessionId:  describe result for acl check
2025-10-01T14:12:26.337597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:26.337602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:26.337604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:26.337609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255995085963166:7433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:26.338116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255995085963166:7433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:26.340044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255995085963166:7433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:26.341427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:26.343325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:26.343457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:26.343464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:26.343471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:26.343504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:26.343539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255992709071422:4474]
2025-10-01T14:12:26.343607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255995085963166:7433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:26.343618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255995085963166:7433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:26.343620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255995085963166:7433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:26.343626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:26.343906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:26.344159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:26.344183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:26.344361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:26.344395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.344399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.344400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.344400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.344401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.344402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.344402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.344403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.344404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.344404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.344405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.344405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.344406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.344406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.344409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.344416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.344418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.344420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.344422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.344424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.344426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.344428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.344430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.344433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.344434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.344436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.344438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.344440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.344444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.344449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.344452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.344455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.344458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.344462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.344464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.344467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.344469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.344472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.344479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.344481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.344484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.344486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.344488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.344491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.344493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.344496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.344498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.344501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.344503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.344506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.344521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.344527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.344529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.344532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.344537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.344540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.344559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:26.347935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:26.348473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:26.348485Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:26.348487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:26.348489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:26.348495Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1663 [2:7556255992709071422:4474]
2025-10-01T14:12:26.348505Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:26.348516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:26.348518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.348520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.348522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.348532Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:26.348536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:26.348540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:26.348581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.348587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.348588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.348591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:26.348593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:26.348640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:26.348657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.348663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.348669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.348681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:26.348695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255992709071417:4474]
2025-10-01T14:12:26.348699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255992709071417:4474]
2025-10-01T14:12:26.348701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255992709071417:4474]
2025-10-01T14:12:26.348708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:26.348718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:26.348722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:26.348725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:26.348726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:26.348729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:26.348731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:26.348738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085963280:7433], now have 1 active actors on pipe
2025-10-01T14:12:26.348756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085962960:2446], now have 1 active actors on pipe
2025-10-01T14:12:26.348762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255992709071417:4474]
2025-10-01T14:12:26.348766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:26.348779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:26.348802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1663
2025-10-01T14:12:26.348836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1663
2025-10-01T14:12:26.348859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.348866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.348885Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39e5a89-72015f5b-7947d850-78f347b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:26.348893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.348900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.348901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:26.348907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.348916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:26.348931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.349098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.349103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.349112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.349170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1664 partition: 0 MaxSeqNo: 45 sessionId: src_id|39e5a89-72015f5b-7947d850-78f347b6_0
2025-10-01T14:12:26.349526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddaf8a1a-f54b48bf-9d1a030d-2a282f7b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|39e5a89-72015f5b-7947d850-78f347b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:26.351822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39e5a89-72015f5b-7947d850-78f347b6_0] Write session: try to update token
2025-10-01T14:12:26.351838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39e5a89-72015f5b-7947d850-78f347b6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:26.364812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1664 sessionId: src_id|39e5a89-72015f5b-7947d850-78f347b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:26.366881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:26.367912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.367934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.367949Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:26.367952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:26.367953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:26.367955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:26.367961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255992709071417:4474]
2025-10-01T14:12:26.367964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255992709071417:4474]
2025-10-01T14:12:26.367966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255992709071417:4474]
2025-10-01T14:12:26.368007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:26.368015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.368014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:26.368016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:26.368020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:26.368024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:26.368135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:26.426911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255995085963294:7971]
2025-10-01T14:12:26.427180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1663, pipe: [1:7556255995085963294:7971]
2025-10-01T14:12:26.502499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:26.502864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:26.502909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085963294:7971], now have 1 active actors on pipe
2025-10-01T14:12:26.502985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:26.503023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255995085963294:7971]
2025-10-01T14:12:26.503040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:26.503063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:26.503065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:26.503128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1664 reason: error at write: Disconnected sessionId: src_id|39e5a89-72015f5b-7947d850-78f347b6_0
2025-10-01T14:12:26.503296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1664 sessionId: src_id|39e5a89-72015f5b-7947d850-78f347b6_0 is DEAD
2025-10-01T14:12:26.503482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e5a89-72015f5b-7947d850-78f347b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:26.503494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e5a89-72015f5b-7947d850-78f347b6_0] Write session will restart in 0.008991s
2025-10-01T14:12:26.503519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e5a89-72015f5b-7947d850-78f347b6_0] Write session: Do CDS request
2025-10-01T14:12:26.503528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e5a89-72015f5b-7947d850-78f347b6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:26.513820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39e5a89-72015f5b-7947d850-78f347b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.513924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:26.513938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1665
2025-10-01T14:12:26.514047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.514077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:26.514086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:26.514089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:26.514524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1665 sessionId:  describe result for acl check
2025-10-01T14:12:26.514554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:26.514560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:26.514561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:26.514566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255995085963527:7416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:26.514950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255995085963527:7416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:26.516593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255995085963527:7416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:26.517049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:26.518477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:26.518618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:26.518625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:26.518633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:26.518662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:26.518689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255992709071668:4466]
2025-10-01T14:12:26.518808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255995085963527:7416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:26.518818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255995085963527:7416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:26.518820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255995085963527:7416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:26.518825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:26.519070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:26.519275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:26.519311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:26.519531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:26.519570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.519575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.519575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.519576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.519577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.519577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.519578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.519579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.519579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.519580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.519581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.519581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.519582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.519582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.519585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.519591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.519593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.519595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.519598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.519600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.519602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.519604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.519606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.519608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.519610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.519612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.519614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.519616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.519621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.519625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.519628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.519631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.519634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.519637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.519639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.519642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.519645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.519647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.519649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.519652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.519655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.519658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.519660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.519663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.519666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.519669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.519671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.519673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.519676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.519678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.519680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.519683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.519685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.519688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.519690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.519692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.519711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:26.523050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:26.523592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:26.523605Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:26.523606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:26.523609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:26.523616Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1664 [2:7556255992709071668:4466]
2025-10-01T14:12:26.523629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:26.523644Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:26.523651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.523655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.523656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.523667Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:26.523674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:26.523678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:26.523727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.523733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.523735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.523738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:26.523741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:26.523789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:26.523795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.523802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.523808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.523820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:26.523835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085963301:2446], now have 1 active actors on pipe
2025-10-01T14:12:26.523840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085963622:7416], now have 1 active actors on pipe
2025-10-01T14:12:26.523845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255992709071663:4466]
2025-10-01T14:12:26.523847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255992709071663:4466]
2025-10-01T14:12:26.523848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255992709071663:4466]
2025-10-01T14:12:26.523856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:26.523865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:26.523868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:26.523873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:26.523874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:26.523878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:26.523880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:26.523895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255992709071663:4466]
2025-10-01T14:12:26.523903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:26.523907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:26.523918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1664
2025-10-01T14:12:26.523934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1664
2025-10-01T14:12:26.523952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.523959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.523978Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:26.523986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.523989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.523991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:26.523996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.524006Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:26.524019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.524136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.524141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.524149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.524211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1665 partition: 0 MaxSeqNo: 45 sessionId: src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0
2025-10-01T14:12:26.524504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39e5a89-72015f5b-7947d850-78f347b6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:26.526812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0] Write session: try to update token
2025-10-01T14:12:26.526830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:26.539932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1665 sessionId: src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:26.542236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:26.543094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.543121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.543142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:26.543144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:26.543146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:26.543147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:26.543153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255992709071663:4466]
2025-10-01T14:12:26.543156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255992709071663:4466]
2025-10-01T14:12:26.543159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255992709071663:4466]
2025-10-01T14:12:26.543192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:26.543201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:26.543204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:26.543211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:26.543221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.543227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:26.543353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:26.603027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255995085963633:7971]
2025-10-01T14:12:26.603249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1664, pipe: [1:7556255995085963633:7971]
2025-10-01T14:12:26.680361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:26.680898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:26.680949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085963633:7971], now have 1 active actors on pipe
2025-10-01T14:12:26.681041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:26.681163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255995085963633:7971]
2025-10-01T14:12:26.681195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:26.691540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:26.691552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:26.691570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1665 reason: error at write: Disconnected sessionId: src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0
2025-10-01T14:12:26.691697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1665 sessionId: src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0 is DEAD
2025-10-01T14:12:26.691839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:26.691848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0] Write session will restart in 0.005542s
2025-10-01T14:12:26.691872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0] Write session: Do CDS request
2025-10-01T14:12:26.691879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:26.696835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:26.698248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:26.698415Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:26.698424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:26.698432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:26.698468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:26.698563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255992709071918:4467]
2025-10-01T14:12:26.698744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.698782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:26.698793Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1666
2025-10-01T14:12:26.698941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.698966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:26.698975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:26.698962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:26.698978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:26.699184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:26.699226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:26.699235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1666 sessionId:  describe result for acl check
2025-10-01T14:12:26.699255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:26.699259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:26.699260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:26.699263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255995085963925:7418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:26.699512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:26.699576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.699581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.699583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.699584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.699585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.699586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.699587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.699588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.699589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.699590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.699591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.699592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.699593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.699595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.699600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.699609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.699612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.699620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.699624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.699631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.699635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.699642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.699650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.699653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.699656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.699659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.699666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.699669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.699679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.699691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.699701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.699710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.699718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.699726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.699735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.699735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255995085963925:7418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:26.699743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.699751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.699760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.699767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.699776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.699784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.699792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.699800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.699808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.699813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.699821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.699825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.699829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.699835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.699839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.699846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.699851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.699858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.699864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.699872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.699877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.699904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:26.701597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255995085963925:7418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:26.703244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:26.703853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255995085963925:7418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:26.703862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255995085963925:7418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:26.703864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255995085963925:7418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:26.703870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:26.704070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:26.704081Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:26.704084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:26.704087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:26.704092Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1665 [2:7556255992709071918:4467]
2025-10-01T14:12:26.704104Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:26.704117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:26.704123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.704126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.704128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.704141Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:26.704150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:26.704159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:26.704201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.704206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.704207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.704209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:26.704212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:26.704263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:26.704272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.704281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.704291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.704308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:26.704327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085963961:7418], now have 1 active actors on pipe
2025-10-01T14:12:26.704332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085963635:2446], now have 1 active actors on pipe
2025-10-01T14:12:26.704337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255992709071913:4467]
2025-10-01T14:12:26.704338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255992709071913:4467]
2025-10-01T14:12:26.704339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255992709071913:4467]
2025-10-01T14:12:26.704350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:26.704343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1665
2025-10-01T14:12:26.704367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:26.704350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1665
2025-10-01T14:12:26.704367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:26.704369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:26.704371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:26.704384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:26.704386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:26.704413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255992709071913:4467]
2025-10-01T14:12:26.704423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:26.704428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:26.704438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.704442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.704484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59540aa1-2bd60adf-31816f74-69465790_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:26.704496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.704499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.704502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:26.704510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.704521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:26.704539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.704661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.704668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.704680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.704744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1666 partition: 0 MaxSeqNo: 45 sessionId: src_id|59540aa1-2bd60adf-31816f74-69465790_0
2025-10-01T14:12:26.705005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce8d1743-9bd553d2-6af3e066-9ecf647d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|59540aa1-2bd60adf-31816f74-69465790_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:26.707201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59540aa1-2bd60adf-31816f74-69465790_0] Write session: try to update token
2025-10-01T14:12:26.707214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59540aa1-2bd60adf-31816f74-69465790_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:26.719414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1666 sessionId: src_id|59540aa1-2bd60adf-31816f74-69465790_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:26.721609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:26.721767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.721788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.721824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:26.721880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:26.724535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:26.724558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:26.724560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:26.724562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:26.724573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255992709071913:4467]
2025-10-01T14:12:26.724581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255992709071913:4467]
2025-10-01T14:12:26.724586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255992709071913:4467]
2025-10-01T14:12:26.724633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:26.724642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:26.724654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:26.724657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:26.724661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.724664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:26.724837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:26.781234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255995085963968:7971]
2025-10-01T14:12:26.781477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1665, pipe: [1:7556255995085963968:7971]
2025-10-01T14:12:26.861291Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:26.867926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.867948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.868079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.868131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.868187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.868253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.868301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.868311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.868369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.868421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.868473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.868529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.868568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.868573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.868623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.868683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.868738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.868788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.868827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.868832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.868882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.868931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.868981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.869027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.869069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.869074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.869132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.869184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.869235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.869293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.869336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.869342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.869404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.869462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.869524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.869585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.869630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.869636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.869697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.869753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.869814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.869873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.869915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.869922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.869978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.870035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.870090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.870151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.870198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.870205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.870269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.870330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.870410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.870472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.870524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.870532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.870598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:26.870660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:26.870722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:26.870782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:26.870822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:26.870829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:26.870873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085963968:7971], now have 1 active actors on pipe
2025-10-01T14:12:26.871018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255995085963968:7971]
2025-10-01T14:12:26.871040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:26.871043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:26.871059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1666 reason: error at write: Disconnected sessionId: src_id|59540aa1-2bd60adf-31816f74-69465790_0
2025-10-01T14:12:26.871212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1666 sessionId: src_id|59540aa1-2bd60adf-31816f74-69465790_0 is DEAD
2025-10-01T14:12:26.871362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59540aa1-2bd60adf-31816f74-69465790_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:26.871373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59540aa1-2bd60adf-31816f74-69465790_0] Write session will restart in 0.008146s
2025-10-01T14:12:26.871397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59540aa1-2bd60adf-31816f74-69465790_0] Write session: Do CDS request
2025-10-01T14:12:26.871403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59540aa1-2bd60adf-31816f74-69465790_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:26.871435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:26.871847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:26.880819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59540aa1-2bd60adf-31816f74-69465790_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.880860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:26.880872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1667
2025-10-01T14:12:26.881000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:26.881027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:26.881035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:26.881038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:26.881389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1667 sessionId:  describe result for acl check
2025-10-01T14:12:26.881413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:26.881419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:26.881420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:26.881424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255995085964158:7388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:26.881823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255995085964158:7388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:26.884191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255995085964158:7388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:26.886782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255995085964158:7388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:26.886797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255995085964158:7388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:26.886800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255995085964158:7388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:26.886808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:26.886985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:26.888921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:26.889059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:26.889066Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:26.889073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:26.889102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:26.889129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255992709072168:4460]
2025-10-01T14:12:26.889567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:26.889814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:26.889874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:26.890123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:26.890161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.890167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.890168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.890168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.890169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.890170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.890170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.890171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.890172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.890173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.890173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.890174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.890174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.890182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.890186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.890192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.890193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.890196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.890197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.890200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.890201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.890203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.890205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.890207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.890209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.890211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.890213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.890215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.890220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.890224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:26.890228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.890242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:26.890244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.890247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:26.890249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.890252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:26.890254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.890257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:26.890260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.890263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:26.890265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.890268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:26.890271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.890273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:26.890276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.890278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:26.890281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.890284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.890286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.890289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.890291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.890294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.890296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.890299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:26.890302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.890305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:26.890325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:26.893804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:26.894365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:26.894407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:26.894409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:26.894413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:26.894420Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1666 [2:7556255992709072168:4460]
2025-10-01T14:12:26.894450Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:26.894471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:26.894479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.894482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.894485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.894501Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:26.894512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:26.894518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:26.894575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.894582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.894585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.894587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:26.894590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:26.894656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:26.894664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.894675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:26.894691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:26.894712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:26.894735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085964306:7388], now have 1 active actors on pipe
2025-10-01T14:12:26.894743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085963987:2446], now have 1 active actors on pipe
2025-10-01T14:12:26.894752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255992709072162:4460]
2025-10-01T14:12:26.894759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255992709072162:4460]
2025-10-01T14:12:26.894761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255992709072162:4460]
2025-10-01T14:12:26.894775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:26.894782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:26.894785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:26.894786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:26.894794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:26.894776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1666
2025-10-01T14:12:26.894808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:26.894816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:26.894807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1666
2025-10-01T14:12:26.894864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.894874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.894888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255992709072162:4460]
2025-10-01T14:12:26.894896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:26.894901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:26.894929Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79831129-492f3c02-984f2fe6-c12fc247_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:26.894944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:26.894949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:26.894952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:26.894961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:26.894969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:26.894992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.895137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.895145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.895158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:26.895223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1667 partition: 0 MaxSeqNo: 45 sessionId: src_id|79831129-492f3c02-984f2fe6-c12fc247_0
2025-10-01T14:12:26.895555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59540aa1-2bd60adf-31816f74-69465790_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|79831129-492f3c02-984f2fe6-c12fc247_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:26.897795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79831129-492f3c02-984f2fe6-c12fc247_0] Write session: try to update token
2025-10-01T14:12:26.897810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79831129-492f3c02-984f2fe6-c12fc247_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:26.910511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1667 sessionId: src_id|79831129-492f3c02-984f2fe6-c12fc247_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:26.912533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:26.912722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:26.912743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:26.912776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:26.912852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:26.914964Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:26.914978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:26.914979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:26.914981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:26.914988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255992709072162:4460]
2025-10-01T14:12:26.914992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255992709072162:4460]
2025-10-01T14:12:26.914996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255992709072162:4460]
2025-10-01T14:12:26.915041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:26.915047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:26.915050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:26.915051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:26.915056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:26.915060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:26.915184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:26.971168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255995085964329:7971]
2025-10-01T14:12:26.971447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1666, pipe: [1:7556255995085964329:7971]
2025-10-01T14:12:27.049400Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:27.056083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.056108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.056252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.056311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.056370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.056432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.056475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.056485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.056549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.056606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.056676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.056738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.056779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.056785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.056843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.056893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.056947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.057001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.057041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.057047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.057102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.057154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.057209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.057260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.057299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.057305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.057357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.057409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.057462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.057513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.057552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.057557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.057610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.057663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.057722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.057778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.057824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.057830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.057884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.057935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.057988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.058106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.058156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.058161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.058219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.058271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.058323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.058401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.058444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.058453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.058513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.058571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.058627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.058690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.058739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.058748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.058805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.058858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.058913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.058971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.059008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.059013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.059055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255995085964329:7971], now have 1 active actors on pipe
2025-10-01T14:12:27.059322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:27.059366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255995085964329:7971]
2025-10-01T14:12:27.059393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:27.059402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:27.059423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1667 reason: error at write: Disconnected sessionId: src_id|79831129-492f3c02-984f2fe6-c12fc247_0
2025-10-01T14:12:27.059586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1667 sessionId: src_id|79831129-492f3c02-984f2fe6-c12fc247_0 is DEAD
2025-10-01T14:12:27.059702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79831129-492f3c02-984f2fe6-c12fc247_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:27.059710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79831129-492f3c02-984f2fe6-c12fc247_0] Write session will restart in 0.005680s
2025-10-01T14:12:27.059730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79831129-492f3c02-984f2fe6-c12fc247_0] Write session: Do CDS request
2025-10-01T14:12:27.059734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79831129-492f3c02-984f2fe6-c12fc247_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:27.059961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:27.066801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79831129-492f3c02-984f2fe6-c12fc247_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.066914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:27.066936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1668
2025-10-01T14:12:27.067027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.067049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:27.067055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:27.067058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:27.067345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1668 sessionId:  describe result for acl check
2025-10-01T14:12:27.067370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:27.067377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:27.067378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:27.067381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255999380931753:7377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:27.067748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255999380931753:7377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:27.070461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255999380931753:7377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:27.072997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:27.073114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255999380931753:7377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:27.073127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255999380931753:7377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:27.073130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255999380931753:7377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:27.073138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:27.075077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:27.075299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:27.075310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:27.075319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:27.075362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:27.075392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255997004039722:4456]
2025-10-01T14:12:27.075772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:27.075992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:27.076019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:27.076207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:27.076240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.076244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.076244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.076245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.076246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.076247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.076247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.076248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.076248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.076249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.076250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.076251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.076252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.076253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.076256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.076262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.076264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.076266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.076268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.076271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.076272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.076275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.076277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.076279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.076281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.076283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.076285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.076287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.076292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.076297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.076301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.076304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.076306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.076309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.076311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.076314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.076316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.076319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.076321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.076324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.076326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.076330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.076332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.076334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.076337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.076340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.076342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.076344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.076347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.076349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.076352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.076355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.076357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.076360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.076362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.076364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.076383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:27.079928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:27.080676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:27.080687Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:27.080688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:27.080691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:27.080696Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1667 [2:7556255997004039722:4456]
2025-10-01T14:12:27.080706Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:27.080719Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:27.080721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.080723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.080724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.080735Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:27.080738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:27.080742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:27.080782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.080787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.080788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.080790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:27.080792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:27.080839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:27.080845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.080852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.080857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.080866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:27.080878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380931952:7377], now have 1 active actors on pipe
2025-10-01T14:12:27.080884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380931627:2446], now have 1 active actors on pipe
2025-10-01T14:12:27.080889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255997004039716:4456]
2025-10-01T14:12:27.080891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255997004039716:4456]
2025-10-01T14:12:27.080892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255997004039716:4456]
2025-10-01T14:12:27.080901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:27.080911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:27.080916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:27.080919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:27.080921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:27.080922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:27.080924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:27.080944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255997004039716:4456]
2025-10-01T14:12:27.080953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:27.080956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:27.080976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.080982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.080954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1667
2025-10-01T14:12:27.081004Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:27.080970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1667
2025-10-01T14:12:27.081013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.081016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.081017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:27.081023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.081029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:27.081042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.081129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.081135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.081144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.081187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1668 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0
2025-10-01T14:12:27.081481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79831129-492f3c02-984f2fe6-c12fc247_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:27.083640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0] Write session: try to update token
2025-10-01T14:12:27.083653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:27.095859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1668 sessionId: src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:27.098222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:27.100045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.100071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.100093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:27.100096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:27.100098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:27.100100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:27.100109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255997004039716:4456]
2025-10-01T14:12:27.100114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255997004039716:4456]
2025-10-01T14:12:27.100118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255997004039716:4456]
2025-10-01T14:12:27.100154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:27.100164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:27.100167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:27.100169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:27.100175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.100177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:27.100317Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:27.159623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255999380931974:7971]
2025-10-01T14:12:27.159904Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1667, pipe: [1:7556255999380931974:7971]
2025-10-01T14:12:27.238651Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:27.238852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:27.238907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380931974:7971], now have 1 active actors on pipe
2025-10-01T14:12:27.238995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:27.239080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:27.239108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:27.239116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:27.239126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255999380931974:7971]
2025-10-01T14:12:27.239182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1668 reason: error at write: Disconnected sessionId: src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0
2025-10-01T14:12:27.239323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1668 sessionId: src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0 is DEAD
2025-10-01T14:12:27.239484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:27.239494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0] Write session will restart in 0.007448s
2025-10-01T14:12:27.239511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0] Write session: Do CDS request
2025-10-01T14:12:27.239518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:27.247908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.247951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:27.247966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1669
2025-10-01T14:12:27.248135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.248179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:27.248190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:27.248194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:27.248699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1669 sessionId:  describe result for acl check
2025-10-01T14:12:27.248739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:27.248747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:27.248749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:27.248753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255999380932114:7364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:27.249358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255999380932114:7364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:27.251087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255999380932114:7364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:27.253417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255999380932114:7364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:27.253426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255999380932114:7364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:27.253429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255999380932114:7364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:27.253433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:27.254572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:27.256597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:27.256798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:27.256810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:27.256821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:27.256879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:27.256920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255997004040014:4434]
2025-10-01T14:12:27.257447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:27.257726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:27.257775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:27.258063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:27.258142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.258150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.258151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.258152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.258153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.258154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.258155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.258157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.258158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.258159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.258160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.258161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.258162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.258163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.258168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.258177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.258181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.258185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.258189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.258192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.258196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.258199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.258203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.258207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.258211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.258214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.258217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.258220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.258227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.258234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.258240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.258245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.258248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.258253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.258257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.258261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.258265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.258269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.258274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.258278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.258282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.258286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.258290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.258295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.258299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.258304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.258309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.258314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.258323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.258329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.258333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.258339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.258343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.258348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.258352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.258356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.258406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:27.261791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:27.262358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:27.262391Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:27.262394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:27.262397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:27.262403Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1668 [2:7556255997004040014:4434]
2025-10-01T14:12:27.262417Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:27.262435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:27.262444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.262447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.262449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.262465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:27.262471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:27.262477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:27.262531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.262540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.262542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.262544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:27.262547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:27.262608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:27.262618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.262629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.262639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.262658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:27.262680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380932296:7364], now have 1 active actors on pipe
2025-10-01T14:12:27.262689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380931978:2446], now have 1 active actors on pipe
2025-10-01T14:12:27.262696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255997004040009:4434]
2025-10-01T14:12:27.262702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255997004040009:4434]
2025-10-01T14:12:27.262705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255997004040009:4434]
2025-10-01T14:12:27.262717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:27.262737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:27.262740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:27.262743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:27.262745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:27.262755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:27.262758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:27.262753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1668
2025-10-01T14:12:27.262762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1668
2025-10-01T14:12:27.262779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255997004040009:4434]
2025-10-01T14:12:27.262789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:27.262790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:27.262803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.262809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.262853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:27.262863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.262868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.262870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:27.262879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.262893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:27.262916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.263055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.263065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.263081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.263245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1669 partition: 0 MaxSeqNo: 45 sessionId: src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0
2025-10-01T14:12:27.263562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e932ccc-93bd8e73-5899de4f-3b05b22e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:27.265777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0] Write session: try to update token
2025-10-01T14:12:27.265791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:27.277791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1669 sessionId: src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:27.279884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:27.280062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.280081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.280111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:27.280180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:27.281829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:27.281845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:27.281847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:27.281849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:27.281857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255997004040009:4434]
2025-10-01T14:12:27.281860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255997004040009:4434]
2025-10-01T14:12:27.281863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255997004040009:4434]
2025-10-01T14:12:27.281898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:27.281907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.281908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:27.281910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:27.281915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:27.281919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:27.282019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:27.339323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255999380932323:7971]
2025-10-01T14:12:27.339604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1668, pipe: [1:7556255999380932323:7971]
2025-10-01T14:12:27.419178Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:27.425715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.425741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.425877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.425930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.425987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.426042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.426081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.426089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.426145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.426194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.426248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.426303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.426341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.426347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.426419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.426467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.426522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.426570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.426607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.426613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.426667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.426720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.426774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.426839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.426888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.426896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.426949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.426995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.427050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.427098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.427136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.427141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.427196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.427248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.427302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.427354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.427395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.427400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.427449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.427497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.427545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.427593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.427630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.427634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.427684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.427732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.427784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.427837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.427877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.427883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.427938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.427988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.428040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.428092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.428130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.428136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.428188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.428239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.428291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.428341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.428377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.428383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.428419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380932323:7971], now have 1 active actors on pipe
2025-10-01T14:12:27.428633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:27.428661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255999380932323:7971]
2025-10-01T14:12:27.428680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:27.428686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:27.428706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1669 reason: error at write: Disconnected sessionId: src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0
2025-10-01T14:12:27.428878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1669 sessionId: src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0 is DEAD
2025-10-01T14:12:27.429004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:27.429013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0] Write session will restart in 0.008379s
2025-10-01T14:12:27.429031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0] Write session: Do CDS request
2025-10-01T14:12:27.429036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:27.429279Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:27.438796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.438860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:27.438873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1670
2025-10-01T14:12:27.438978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.439007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:27.439015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:27.439018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:27.439364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1670 sessionId:  describe result for acl check
2025-10-01T14:12:27.439397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:27.439403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:27.439405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:27.439410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255999380932539:7360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:27.439878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255999380932539:7360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:27.442584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:27.442633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255999380932539:7360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:27.444103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:27.444240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:27.444249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:27.444257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:27.444289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:27.444315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255997004040264:4423]
2025-10-01T14:12:27.444771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255999380932539:7360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:27.444783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255999380932539:7360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:27.444786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255999380932539:7360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:27.444793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:27.444840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:27.445071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:27.445102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:27.445364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:27.445400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.445405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.445405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.445406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.445407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.445408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.445408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.445409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.445410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.445411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.445411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.445412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.445412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.445413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.445416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.445421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.445424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.445426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.445428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.445430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.445432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.445435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.445437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.445439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.445441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.445443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.445445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.445447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.445452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.445456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.445460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.445463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.445466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.445469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.445471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.445474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.445476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.445479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.445482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.445485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.445487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.445490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.445492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.445495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.445501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.445504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.445507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.445510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.445512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.445515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.445517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.445520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.445523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.445529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.445531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.445535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.445557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:27.448948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:27.449488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:27.449498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:27.449500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:27.449502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:27.449507Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1669 [2:7556255997004040264:4423]
2025-10-01T14:12:27.449517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:27.449528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:27.449533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.449536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.449537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.449549Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:27.449556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:27.449560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:27.449600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.449605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.449607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.449609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:27.449611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:27.449656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:27.449672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.449680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.449689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.449698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:27.449714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380932330:2446], now have 1 active actors on pipe
2025-10-01T14:12:27.449719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380932657:7360], now have 1 active actors on pipe
2025-10-01T14:12:27.449724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255997004040259:4423]
2025-10-01T14:12:27.449726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255997004040259:4423]
2025-10-01T14:12:27.449727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255997004040259:4423]
2025-10-01T14:12:27.449736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:27.449748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:27.449749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:27.449751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:27.449753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:27.449760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:27.449763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:27.449749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1669
2025-10-01T14:12:27.449768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1669
2025-10-01T14:12:27.449783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255997004040259:4423]
2025-10-01T14:12:27.449788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:27.449790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:27.449809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.449816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.449839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:27.449846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.449850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.449852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:27.449857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.449863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:27.449874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.449984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.449990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.450000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.450065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1670 partition: 0 MaxSeqNo: 45 sessionId: src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0
2025-10-01T14:12:27.450394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8c91e30-1a802e7-5fdcb68b-9554b208_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:27.452637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0] Write session: try to update token
2025-10-01T14:12:27.452665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:27.466069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1670 sessionId: src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:27.468529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:27.469255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.469277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.469295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:27.469301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:27.469302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:27.469304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:27.469309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255997004040259:4423]
2025-10-01T14:12:27.469313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255997004040259:4423]
2025-10-01T14:12:27.469319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255997004040259:4423]
2025-10-01T14:12:27.469343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:27.469360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:27.469365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.469366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:27.469366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:27.469370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:27.469482Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:27.528847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255999380932672:7971]
2025-10-01T14:12:27.529080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1669, pipe: [1:7556255999380932672:7971]
2025-10-01T14:12:27.601501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:27.601688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:27.601731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380932672:7971], now have 1 active actors on pipe
2025-10-01T14:12:27.601807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:27.601865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:27.601932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255999380932672:7971]
2025-10-01T14:12:27.611204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:27.611221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:27.611243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1670 reason: error at write: Disconnected sessionId: src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0
2025-10-01T14:12:27.611383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1670 sessionId: src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0 is DEAD
2025-10-01T14:12:27.611541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:27.611552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0] Write session will restart in 0.009269s
2025-10-01T14:12:27.611578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0] Write session: Do CDS request
2025-10-01T14:12:27.611584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:27.617875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:27.619483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:27.619649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:27.619659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:27.619669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:27.619713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:27.619750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255997004040518:4430]
2025-10-01T14:12:27.620337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:27.620547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:27.620575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:27.620774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:27.620807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.620811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.620812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.620812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.620813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.620813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.620814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.620815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.620815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.620816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.620816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.620817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.620817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.620818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.620821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.620826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.620828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.620830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.620832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.620834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.620836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.620838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.620840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.620842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.620844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.620846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.620848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.620850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.620854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.620859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.620862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.620865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.620868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.620871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.620873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.620876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.620878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.620881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.620883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.620886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.620888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.620891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.620893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.620896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.620898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.620901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.620903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.620905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.620909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.620911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.620913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.620916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.620918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.620921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.620923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.620926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.620945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:27.621806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.621869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:27.621879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1671
2025-10-01T14:12:27.621967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.621990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:27.621997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:27.622000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:27.622317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1671 sessionId:  describe result for acl check
2025-10-01T14:12:27.622351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:27.622356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:27.622357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:27.622362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255999380932970:7348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:27.622859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255999380932970:7348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:27.624107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:27.624667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:27.624677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:27.624679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:27.624682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:27.624686Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1670 [2:7556255997004040518:4430]
2025-10-01T14:12:27.624696Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:27.624706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:27.624711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.624713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.624714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.624724Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:27.624731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:27.624735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:27.624773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.624778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.624779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.624781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:27.624782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:27.624827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:27.624833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.624839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.624848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.624860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:27.624875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380932673:2446], now have 1 active actors on pipe
2025-10-01T14:12:27.624883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255997004040513:4430]
2025-10-01T14:12:27.624865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255999380932970:7348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:27.624884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255997004040513:4430]
2025-10-01T14:12:27.624886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255997004040513:4430]
2025-10-01T14:12:27.624894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:27.624893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1670
2025-10-01T14:12:27.624905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:27.624906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:27.624912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:27.624914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:27.624914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:27.624916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:27.624935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255997004040513:4430]
2025-10-01T14:12:27.624943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:27.624955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:27.629321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255999380932970:7348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:27.629333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255999380932970:7348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:27.629336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255999380932970:7348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:27.629343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:27.629538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380933009:7348], now have 1 active actors on pipe
2025-10-01T14:12:27.629591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1670
2025-10-01T14:12:27.629632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.629645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.629665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b84e64f-2f4c1891-8c161554-16222261_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:27.629675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.629679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.629681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:27.629690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.629703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:27.629720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.629862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.629868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.629876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.629941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1671 partition: 0 MaxSeqNo: 45 sessionId: src_id|5b84e64f-2f4c1891-8c161554-16222261_0
2025-10-01T14:12:27.630232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|270c8c2-5d054f96-25640e73-b6a53e2b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5b84e64f-2f4c1891-8c161554-16222261_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:27.632618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b84e64f-2f4c1891-8c161554-16222261_0] Write session: try to update token
2025-10-01T14:12:27.632635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b84e64f-2f4c1891-8c161554-16222261_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:27.643669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:27.643687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:27.643689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:27.643691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:27.643698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255997004040513:4430]
2025-10-01T14:12:27.643702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255997004040513:4430]
2025-10-01T14:12:27.643706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255997004040513:4430]
2025-10-01T14:12:27.643740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:27.643745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.643746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:27.643786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:27.643806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:27.643819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:27.643862Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:27.644794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1671 sessionId: src_id|5b84e64f-2f4c1891-8c161554-16222261_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:27.646917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:27.702309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255999380933012:7971]
2025-10-01T14:12:27.702548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1670, pipe: [1:7556255999380933012:7971]
2025-10-01T14:12:27.779020Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:27.779361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.779374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.779407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380933012:7971], now have 1 active actors on pipe
2025-10-01T14:12:27.779562Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:27.779614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:27.779621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255999380933012:7971]
2025-10-01T14:12:27.779642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:27.779702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1671 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b84e64f-2f4c1891-8c161554-16222261_0
2025-10-01T14:12:27.779874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1671 sessionId: src_id|5b84e64f-2f4c1891-8c161554-16222261_0 is DEAD
2025-10-01T14:12:27.779981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b84e64f-2f4c1891-8c161554-16222261_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:27.779990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b84e64f-2f4c1891-8c161554-16222261_0] Write session will restart in 0.007054s
2025-10-01T14:12:27.780010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b84e64f-2f4c1891-8c161554-16222261_0] Write session: Do CDS request
2025-10-01T14:12:27.780015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b84e64f-2f4c1891-8c161554-16222261_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:27.787786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b84e64f-2f4c1891-8c161554-16222261_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.787845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:27.787858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1672
2025-10-01T14:12:27.787954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.787983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:27.787993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:27.787996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:27.788332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1672 sessionId:  describe result for acl check
2025-10-01T14:12:27.788363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:27.788369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:27.788370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:27.788374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255999380933177:7349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:27.788853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255999380933177:7349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:27.790856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255999380933177:7349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:27.792822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255999380933177:7349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:27.792831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255999380933177:7349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:27.792833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255999380933177:7349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:27.792840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:27.793138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:27.794699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:27.794846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:27.794861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:27.794872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:27.794916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:27.794943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255997004040772:4424]
2025-10-01T14:12:27.795326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:27.795512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:27.795537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:27.795733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:27.795769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.795773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.795774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.795775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.795775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.795776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.795776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.795777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.795778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.795778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.795779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.795779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.795780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.795780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.795783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.795789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.795791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.795793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.795795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.795797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.795799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.795801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.795803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.795805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.795807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.795809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.795811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.795813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.795819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.795824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.795828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.795831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.795833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.795835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.795838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.795840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.795843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.795845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.795848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.795850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.795853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.795856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.795858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.795862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.795864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.795867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.795870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.795872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.795875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.795877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.795879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.795882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.795887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.795890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.795894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.795902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.795934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:27.799470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:27.800024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:27.800037Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:27.800038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:27.800040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:27.800045Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1671 [2:7556255997004040772:4424]
2025-10-01T14:12:27.800055Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:27.800080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:27.800085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.800088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.800089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.800101Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:27.800108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:27.800115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:27.800165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.800170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.800172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.800174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:27.800184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:27.800229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:27.800233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.800240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.800248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.800260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:27.800276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380933340:7349], now have 1 active actors on pipe
2025-10-01T14:12:27.800281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380933013:2446], now have 1 active actors on pipe
2025-10-01T14:12:27.800287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255997004040767:4424]
2025-10-01T14:12:27.800288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255997004040767:4424]
2025-10-01T14:12:27.800289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255997004040767:4424]
2025-10-01T14:12:27.800300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:27.800308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:27.800313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:27.800316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:27.800318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:27.800319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:27.800320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:27.800340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255997004040767:4424]
2025-10-01T14:12:27.800341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:27.800344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:27.800366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1671
2025-10-01T14:12:27.800373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1671
2025-10-01T14:12:27.800440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.800448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.800464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:27.800472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.800476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.800480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:27.800487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.800496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:27.800508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.800654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.800660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.800669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.800747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1672 partition: 0 MaxSeqNo: 45 sessionId: src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0
2025-10-01T14:12:27.801069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b84e64f-2f4c1891-8c161554-16222261_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:27.803292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0] Write session: try to update token
2025-10-01T14:12:27.803306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:27.817261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1672 sessionId: src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:27.818452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:27.818474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:27.818484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255997004040767:4424]
2025-10-01T14:12:27.818526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:27.818528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:27.818689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:27.818817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:27.818946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:27.819071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:27.819246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:27.819277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:27.819567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:27.819855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.819873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.819897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:27.819963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:27.828315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:27.828331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:27.828333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:27.828335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:27.828343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255997004040767:4424]
2025-10-01T14:12:27.828345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255997004040767:4424]
2025-10-01T14:12:27.828348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255997004040767:4424]
2025-10-01T14:12:27.828380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:27.828381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:27.828387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.828389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:27.828391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:27.828394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:27.828500Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:27.879997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556255999380933354:7971]
2025-10-01T14:12:27.880234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1671, pipe: [1:7556255999380933354:7971]
2025-10-01T14:12:27.963856Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:27.970654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.970677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.970814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.970867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.970921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.970976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.971021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.971028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.971083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.971137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.971192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.971248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.971291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.971296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.971352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.971407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.971463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.971521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.971562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.971567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.971625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.971679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.971737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.971798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.971841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.971846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.971901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.971952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.972008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.972065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.972107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.972112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.972169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.972225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.972283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.972341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.972381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.972386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.972444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.972496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.972552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.972607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.972657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.972664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.972720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.972774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.972829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.972887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.972926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.972932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.972987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.973041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.973098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.973154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.973194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.973200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.973255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:27.973312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:27.973369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:27.973422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:27.973469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:27.973475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:27.973522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380933354:7971], now have 1 active actors on pipe
2025-10-01T14:12:27.973774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:27.973790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556255999380933354:7971]
2025-10-01T14:12:27.973810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:27.973812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:27.973833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1672 reason: error at write: Disconnected sessionId: src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0
2025-10-01T14:12:27.973979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1672 sessionId: src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0 is DEAD
2025-10-01T14:12:27.974103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:27.974120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0] Write session will restart in 0.009836s
2025-10-01T14:12:27.974138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0] Write session: Do CDS request
2025-10-01T14:12:27.974142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:27.974269Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:27.984810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.984858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:27.984871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1673
2025-10-01T14:12:27.985326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:27.985353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:27.985360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:27.985362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:27.985640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1673 sessionId:  describe result for acl check
2025-10-01T14:12:27.985660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:27.985664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:27.985665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:27.985668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556255999380933673:7333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:27.986028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556255999380933673:7333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:27.986150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:27.987240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556255999380933673:7333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:27.987841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:27.987958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:27.987966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:27.987974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:27.988002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:27.988027Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556255997004041032:4425]
2025-10-01T14:12:27.988373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:27.988613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:27.988656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:27.988867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:27.988906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.988910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.988911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.988912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.988912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.988913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.988913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.988914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.988915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.988915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.988916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.988916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.988917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.988917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.988920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.988926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.988928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.988930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.988932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.988935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.988938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.988942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.988945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.988948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.988952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.988955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.988959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.988962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.988968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.988974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:27.988979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.988984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:27.988988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.988992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:27.988996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.989001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:27.989003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.989006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:27.989008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.989011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:27.989013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.989016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:27.989019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.989021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:27.989024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.989026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:27.989028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.989032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.989034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.989036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.989038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.989041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.989043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.989045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:27.989048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.989050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:27.989070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:27.989136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556255999380933673:7333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:27.989144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556255999380933673:7333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:27.989147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556255999380933673:7333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:27.989151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:27.992175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:27.992793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:27.992804Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:27.992805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:27.992807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:27.992812Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1672 [2:7556255997004041032:4425]
2025-10-01T14:12:27.992820Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:27.992829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:27.992831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.992832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.992834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.992843Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:27.992846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:27.992851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:27.992882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.992887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.992888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.992890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:27.992892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:27.992932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:27.992937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:27.992944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:27.992949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:27.992957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:27.992969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556255997004041027:4425]
2025-10-01T14:12:27.992974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556255997004041027:4425]
2025-10-01T14:12:27.992975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556255997004041027:4425]
2025-10-01T14:12:27.992981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:27.992988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:27.992998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:27.993000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:27.993002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:27.993006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:27.993008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:27.993026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380933381:2446], now have 1 active actors on pipe
2025-10-01T14:12:27.993034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556255999380933708:7333], now have 1 active actors on pipe
2025-10-01T14:12:27.993035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556255997004041027:4425]
2025-10-01T14:12:27.993040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:27.993058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:27.993060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1672
2025-10-01T14:12:27.993066Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1672
2025-10-01T14:12:27.993134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.993142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.993159Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:27.993166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:27.993169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:27.993170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:27.993175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:27.993181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:27.993190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.993335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:27.993341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:27.993350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:27.993404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1673 partition: 0 MaxSeqNo: 45 sessionId: src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0
2025-10-01T14:12:27.993647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abb35eeb-fcdec09b-8b697140-a3fa963b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:27.995925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0] Write session: try to update token
2025-10-01T14:12:27.995938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:28.003254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:28.003278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:28.003289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556255997004041027:4425]
2025-10-01T14:12:28.003335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:28.003337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:28.003511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:28.003656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:28.003800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:28.003937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:28.004134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:28.004176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:28.008801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1673 sessionId: src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:28.011010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:28.011205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.011229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.011266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:28.011336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:28.020856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:28.020871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:28.020872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:28.020874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:28.020883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556255997004041027:4425]
2025-10-01T14:12:28.020887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556255997004041027:4425]
2025-10-01T14:12:28.020890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556255997004041027:4425]
2025-10-01T14:12:28.020925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:28.020927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:28.020932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:28.020934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.020935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:28.020937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:28.021040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:28.074037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256003675901013:7971]
2025-10-01T14:12:28.074528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1672, pipe: [1:7556256003675901013:7971]
2025-10-01T14:12:28.151608Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:28.157890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.157911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.158040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.158089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.158139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.158187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.158223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.158231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.158283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.158327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.158391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.158455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.158503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.158510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.158567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.158622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.158679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.158735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.158776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.158784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.158847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.158909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.158969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.159031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.159076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.159084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.159139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.159187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.159236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.159285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.159320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.159325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.159379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.159428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.159476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.159527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.159563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.159567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.159619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.159663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.159715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.159769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.159803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.159808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.159853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.159897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.159944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.159989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.160024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.160029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.160077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.160121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.160166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.160211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.160246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.160250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.160292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.160337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.160381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.160426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.160465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.160470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.160503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675901013:7971], now have 1 active actors on pipe
2025-10-01T14:12:28.160728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:28.160731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:28.160734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:28.160761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1673 reason: error at write: Disconnected sessionId: src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0
2025-10-01T14:12:28.160781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256003675901013:7971]
2025-10-01T14:12:28.160923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1673 sessionId: src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0 is DEAD
2025-10-01T14:12:28.161072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:28.161095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0] Write session will restart in 0.006743s
2025-10-01T14:12:28.161118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0] Write session: Do CDS request
2025-10-01T14:12:28.161123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:28.161212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:28.168823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.168958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:28.168971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1674
2025-10-01T14:12:28.169083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.169114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:28.169124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:28.169128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:28.169482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1674 sessionId:  describe result for acl check
2025-10-01T14:12:28.169516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:28.169522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:28.169523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:28.169528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256003675901192:7329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:28.170040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256003675901192:7329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:28.172865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256003675901192:7329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:28.174534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:28.176245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:28.176402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:28.176412Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:28.176421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:28.176476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:28.176503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256003675901192:7329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:28.176512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256003675901192:7329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:28.176514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256003675901192:7329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:28.176519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:28.176516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256001299008597:4415]
2025-10-01T14:12:28.176928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:28.177128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:28.177155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:28.177336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:28.177367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.177371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.177372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.177372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.177373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.177373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.177374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.177375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.177375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.177376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.177376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.177377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.177378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.177378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.177381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.177386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.177389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.177391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.177393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.177395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.177397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.177399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.177401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.177403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.177405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.177407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.177409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.177411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.177415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.177419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.177423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.177426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.177428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.177431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.177433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.177435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.177438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.177440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.177443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.177445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.177448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.177454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.177456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.177459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.177461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.177464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.177469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.177472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.177474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.177477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.177479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.177482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.177484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.177486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.177489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.177492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.177511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:28.180745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:28.181257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:28.181268Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:28.181270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:28.181272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:28.181276Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1673 [2:7556256001299008597:4415]
2025-10-01T14:12:28.181285Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:28.181299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:28.181303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.181306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.181317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.181327Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:28.181333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:28.181338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:28.181372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.181376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.181377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.181379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:28.181381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:28.181423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:28.181427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.181434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.181439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.181448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:28.181462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675901345:7329], now have 1 active actors on pipe
2025-10-01T14:12:28.181469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256001299008592:4415]
2025-10-01T14:12:28.181471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256001299008592:4415]
2025-10-01T14:12:28.181472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256001299008592:4415]
2025-10-01T14:12:28.181479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:28.181485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675901016:2446], now have 1 active actors on pipe
2025-10-01T14:12:28.181493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:28.181493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:28.181496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:28.181498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:28.181504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:28.181511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:28.181533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256001299008592:4415]
2025-10-01T14:12:28.181546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:28.181559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:28.181542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1673
2025-10-01T14:12:28.181544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1673
2025-10-01T14:12:28.181576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.181583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.181602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:28.181610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.181613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.181614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:28.181619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.181625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:28.181635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.181730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.181735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.181744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.181809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1674 partition: 0 MaxSeqNo: 45 sessionId: src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0
2025-10-01T14:12:28.182119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ef9793f-5253bacb-82b1ecd6-28e3b29_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:28.184443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0] Write session: try to update token
2025-10-01T14:12:28.184456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:28.191120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:28.191132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:28.191139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256001299008592:4415]
2025-10-01T14:12:28.191169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:28.191184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:28.191326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:28.191731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:28.192109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:28.192527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:28.192700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:28.192731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:28.197725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1674 sessionId: src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:28.200117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:28.200270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.200286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.200313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:28.200380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:28.209782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:28.209798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:28.209801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:28.209802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:28.209812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256001299008592:4415]
2025-10-01T14:12:28.209815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256001299008592:4415]
2025-10-01T14:12:28.209818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256001299008592:4415]
2025-10-01T14:12:28.209848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:28.209851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:28.209856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.209857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:28.209858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:28.209861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:28.209962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:28.260922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256003675901356:7971]
2025-10-01T14:12:28.261136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1673, pipe: [1:7556256003675901356:7971]
2025-10-01T14:12:28.342490Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:28.349024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.349047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.349181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.349244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.349297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.349345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.349386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.349393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.349447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.349495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.349544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.349594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.349632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.349637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.349692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.349749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.349816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.349873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.349912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.349918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.349973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.350024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.350075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.350127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.350166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.350171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.350229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.350295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.350353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.350422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.350467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.350474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.350536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.350588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.350690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.350850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.350890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.350895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.350950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.350998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.351048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.351104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.351147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.351152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.351203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.351254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.351305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.351354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.351397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.351405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.351477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.351532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.351584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.351636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.351674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.351679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.351733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:28.351781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:28.351840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:28.351888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:28.351925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:28.351930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:28.351969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675901356:7971], now have 1 active actors on pipe
2025-10-01T14:12:28.352207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:28.352215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:28.352217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:28.352243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1674 reason: error at write: Disconnected sessionId: src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0
2025-10-01T14:12:28.352250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256003675901356:7971]
2025-10-01T14:12:28.352391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1674 sessionId: src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0 is DEAD
2025-10-01T14:12:28.352533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:28.352539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0] Write session will restart in 0.009126s
2025-10-01T14:12:28.352560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0] Write session: Do CDS request
2025-10-01T14:12:28.352566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:28.352704Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:28.362746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.362827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:28.362839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1675
2025-10-01T14:12:28.362947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.362969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:28.362977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:28.362980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:28.363289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1675 sessionId:  describe result for acl check
2025-10-01T14:12:28.363321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:28.363322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:28.363324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:28.363328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256003675901589:7322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:28.363845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256003675901589:7322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:28.365493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256003675901589:7322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:28.366319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:28.368241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:28.368368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:28.368375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:28.368383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:28.368413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:28.368453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256001299008882:4402]
2025-10-01T14:12:28.368476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256003675901589:7322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:28.368486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256003675901589:7322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:28.368490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256003675901589:7322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:28.368495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:28.368884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:28.369095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:28.369122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:28.369305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:28.369336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.369340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.369341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.369341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.369342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.369343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.369343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.369344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.369344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.369345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.369345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.369346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.369347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.369347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.369350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.369356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.369358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.369360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.369362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.369364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.369366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.369368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.369370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.369373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.369375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.369377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.369379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.369381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.369385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.369390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.369393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.369396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.369399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.369401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.369404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.369406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.369409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.369412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.369414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.369416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.369419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.369422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.369424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.369426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.369429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.369431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.369433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.369436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.369438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.369441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.369443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.369446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.369448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.369452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.369457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.369461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.369488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:28.372626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:28.373178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:28.373188Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:28.373189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:28.373191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:28.373195Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1674 [2:7556256001299008882:4402]
2025-10-01T14:12:28.373204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:28.373214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:28.373216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.373218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.373219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.373229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:28.373231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:28.373236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:28.373268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.373273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.373275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.373277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:28.373278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:28.373320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:28.373325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.373332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.373337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.373345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:28.373356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675901371:2446], now have 1 active actors on pipe
2025-10-01T14:12:28.373362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675901701:7322], now have 1 active actors on pipe
2025-10-01T14:12:28.373366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256001299008877:4402]
2025-10-01T14:12:28.373368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256001299008877:4402]
2025-10-01T14:12:28.373369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256001299008877:4402]
2025-10-01T14:12:28.373375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:28.373383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:28.373383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:28.373386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:28.373388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:28.373395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:28.373397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:28.373410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256001299008877:4402]
2025-10-01T14:12:28.373418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:28.373435Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1674
2025-10-01T14:12:28.373436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1674
2025-10-01T14:12:28.373469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:28.373481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.373483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.373499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:28.373508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.373511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.373513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:28.373518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.373523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:28.373536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.373659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.373665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.373674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.373744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1675 partition: 0 MaxSeqNo: 45 sessionId: src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0
2025-10-01T14:12:28.374060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dfb41ec-be62495f-66b4f2d0-8dc9f994_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:28.376321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0] Write session: try to update token
2025-10-01T14:12:28.376335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:28.391718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1675 sessionId: src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:28.392616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:28.392637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:28.392639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:28.392641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:28.392659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256001299008877:4402]
2025-10-01T14:12:28.392663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256001299008877:4402]
2025-10-01T14:12:28.392665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256001299008877:4402]
2025-10-01T14:12:28.392705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:28.392710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.392712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:28.392724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:28.392731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:28.392735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:28.392825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:28.394127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:28.452379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256003675901717:7971]
2025-10-01T14:12:28.452602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1674, pipe: [1:7556256003675901717:7971]
2025-10-01T14:12:28.524008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:28.524536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.524548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.524582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675901717:7971], now have 1 active actors on pipe
2025-10-01T14:12:28.524805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256003675901717:7971]
2025-10-01T14:12:28.524816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:28.524820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:28.524846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:28.524874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1675 reason: error at write: Disconnected sessionId: src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0
2025-10-01T14:12:28.525038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1675 sessionId: src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0 is DEAD
2025-10-01T14:12:28.525130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:28.525136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0] Write session will restart in 0.006239s
2025-10-01T14:12:28.525162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0] Write session: Do CDS request
2025-10-01T14:12:28.525170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:28.525329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:28.532803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.532899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:28.532910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1676
2025-10-01T14:12:28.533005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.533033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:28.533039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:28.533042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:28.533335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1676 sessionId:  describe result for acl check
2025-10-01T14:12:28.533361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:28.533366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:28.533367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:28.533370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256003675901829:7308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:28.533728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256003675901829:7308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:28.535712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256003675901829:7308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:28.537969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256003675901829:7308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:28.537980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256003675901829:7308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:28.537982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256003675901829:7308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:28.537987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:28.538956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:28.540909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:28.541041Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:28.541048Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:28.541056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:28.541086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:28.541110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256001299009140:4396]
2025-10-01T14:12:28.541462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:28.541742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:28.541785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:28.541993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:28.542038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.542043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.542043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.542044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.542045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.542045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.542046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.542046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.542047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.542047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.542048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.542049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.542049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.542050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.542053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.542059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.542061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.542063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.542066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.542068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.542070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.542072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.542074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.542076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.542078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.542080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.542082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.542084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.542088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.542093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.542096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.542099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.542102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.542104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.542106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.542109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.542112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.542115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.542117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.542121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.542123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.542126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.542128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.542130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.542133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.542144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.542150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.542153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.542155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.542158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.542160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.542164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.542166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.542169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.542171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.542174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.542200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:28.545468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:28.545976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:28.545987Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:28.545988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:28.545990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:28.545995Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1675 [2:7556256001299009140:4396]
2025-10-01T14:12:28.546004Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:28.546015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:28.546017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.546020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.546022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.546034Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:28.546040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:28.546044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:28.546078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.546083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.546084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.546086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:28.546087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:28.546130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:28.546135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.546141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.546146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.546157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:28.546171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675901722:2446], now have 1 active actors on pipe
2025-10-01T14:12:28.546177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675902051:7308], now have 1 active actors on pipe
2025-10-01T14:12:28.546181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256001299009135:4396]
2025-10-01T14:12:28.546184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256001299009135:4396]
2025-10-01T14:12:28.546185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256001299009135:4396]
2025-10-01T14:12:28.546194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:28.546202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:28.546204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:28.546204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:28.546206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:28.546212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:28.546214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:28.546234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256001299009135:4396]
2025-10-01T14:12:28.546241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:28.546245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:28.546285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1675
2025-10-01T14:12:28.546310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1675
2025-10-01T14:12:28.546354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.546365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.546398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83448f82-381c1b3a-db872680-fee98a03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:28.546407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.546410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.546412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:28.546418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.546430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:28.546441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.546583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.546590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.546604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.546669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1676 partition: 0 MaxSeqNo: 45 sessionId: src_id|83448f82-381c1b3a-db872680-fee98a03_0
2025-10-01T14:12:28.546987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e37d012a-97fbdd76-e6c346e3-58ea2f1a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83448f82-381c1b3a-db872680-fee98a03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:28.549219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83448f82-381c1b3a-db872680-fee98a03_0] Write session: try to update token
2025-10-01T14:12:28.549233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83448f82-381c1b3a-db872680-fee98a03_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:28.561261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1676 sessionId: src_id|83448f82-381c1b3a-db872680-fee98a03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:28.563203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:28.564634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.564664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.564680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:28.564682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:28.564684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:28.564685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:28.564691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256001299009135:4396]
2025-10-01T14:12:28.564694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256001299009135:4396]
2025-10-01T14:12:28.564696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256001299009135:4396]
2025-10-01T14:12:28.564736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:28.564741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:28.564745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.564746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:28.564746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:28.564749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:28.564856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:28.624913Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256003675902065:7971]
2025-10-01T14:12:28.625169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1675, pipe: [1:7556256003675902065:7971]
2025-10-01T14:12:28.701047Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:28.701249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:28.701292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675902065:7971], now have 1 active actors on pipe
2025-10-01T14:12:28.701384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:28.701446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256003675902065:7971]
2025-10-01T14:12:28.701478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:28.701520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:28.701530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:28.701549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1676 reason: error at write: Disconnected sessionId: src_id|83448f82-381c1b3a-db872680-fee98a03_0
2025-10-01T14:12:28.701722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1676 sessionId: src_id|83448f82-381c1b3a-db872680-fee98a03_0 is DEAD
2025-10-01T14:12:28.701846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83448f82-381c1b3a-db872680-fee98a03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:28.701854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83448f82-381c1b3a-db872680-fee98a03_0] Write session will restart in 0.007065s
2025-10-01T14:12:28.701871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83448f82-381c1b3a-db872680-fee98a03_0] Write session: Do CDS request
2025-10-01T14:12:28.701875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83448f82-381c1b3a-db872680-fee98a03_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:28.709829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83448f82-381c1b3a-db872680-fee98a03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.709914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:28.709927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1677
2025-10-01T14:12:28.710062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.710095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:28.710106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:28.710109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:28.710433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1677 sessionId:  describe result for acl check
2025-10-01T14:12:28.710462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:28.710469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:28.710471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:28.710475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256003675902205:7309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:28.710884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256003675902205:7309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:28.713349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256003675902205:7309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:28.716563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256003675902205:7309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:28.716588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256003675902205:7309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:28.716594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256003675902205:7309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:28.716601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:28.718461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:28.720996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:28.721189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:28.721198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:28.721207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:28.721245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:28.721274Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256001299009401:4392]
2025-10-01T14:12:28.721703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:28.721972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:28.721998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:28.722188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:28.722224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.722229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.722229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.722230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.722231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.722232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.722232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.722233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.722234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.722234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.722235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.722235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.722236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.722237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.722240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.722245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.722248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.722250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.722252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.722254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.722256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.722259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.722261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.722263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.722265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.722267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.722270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.722272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.722277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.722281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.722285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.722288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.722290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.722293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.722296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.722298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.722301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.722304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.722306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.722310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.722312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.722315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.722317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.722320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.722323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.722326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.722329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.722334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.722336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.722339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.722342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.722344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.722347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.722350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.722352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.722355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.722402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:28.726754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:28.727340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:28.727351Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:28.727353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:28.727355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:28.727362Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1676 [2:7556256001299009401:4392]
2025-10-01T14:12:28.727372Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:28.727384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:28.727386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.727388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.727390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.727401Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:28.727405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:28.727409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:28.727445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.727451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.727453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.727455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:28.727457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:28.727501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:28.727506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.727512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.727517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.727525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:28.727537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256001299009396:4392]
2025-10-01T14:12:28.727542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256001299009396:4392]
2025-10-01T14:12:28.727543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256001299009396:4392]
2025-10-01T14:12:28.727555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:28.727564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:28.727566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675902068:2446], now have 1 active actors on pipe
2025-10-01T14:12:28.727568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675902391:7309], now have 1 active actors on pipe
2025-10-01T14:12:28.727572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:28.727573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:28.727573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:28.727580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:28.727582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:28.727600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256001299009396:4392]
2025-10-01T14:12:28.727608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:28.727612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:28.727631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1676
2025-10-01T14:12:28.727652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1676
2025-10-01T14:12:28.727694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.727707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.727728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:28.727739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.727745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.727747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:28.727754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.727766Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:28.727787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.728025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.728033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.728046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.728115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1677 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0
2025-10-01T14:12:28.728450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83448f82-381c1b3a-db872680-fee98a03_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:28.733724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0] Write session: try to update token
2025-10-01T14:12:28.733739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:28.746066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1677 sessionId: src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:28.748084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:28.748858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.748880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.748896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:28.748899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:28.748900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:28.748901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:28.748907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256001299009396:4392]
2025-10-01T14:12:28.748910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256001299009396:4392]
2025-10-01T14:12:28.748913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256001299009396:4392]
2025-10-01T14:12:28.748945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:28.748956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:28.748959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:28.748964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:28.748968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.748970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:28.749092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:28.801526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256003675902412:7971]
2025-10-01T14:12:28.801747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1676, pipe: [1:7556256003675902412:7971]
2025-10-01T14:12:28.880943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:28.881169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:28.881213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675902412:7971], now have 1 active actors on pipe
2025-10-01T14:12:28.881303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:28.881375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:28.881395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:28.881396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:28.881432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256003675902412:7971]
2025-10-01T14:12:28.881446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1677 reason: error at write: Disconnected sessionId: src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0
2025-10-01T14:12:28.881581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1677 sessionId: src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0 is DEAD
2025-10-01T14:12:28.881713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:28.881722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0] Write session will restart in 0.008593s
2025-10-01T14:12:28.881741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0] Write session: Do CDS request
2025-10-01T14:12:28.881748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:28.891852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.891918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:28.891929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1678
2025-10-01T14:12:28.892072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:28.892102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:28.892112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:28.892115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:28.892573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1678 sessionId:  describe result for acl check
2025-10-01T14:12:28.892616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:28.892622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:28.892623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:28.892629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256003675902661:7298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:28.893236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256003675902661:7298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:28.894825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256003675902661:7298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:28.895426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:28.897250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:28.897422Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:28.897433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:28.897443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:28.897488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:28.897507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256003675902661:7298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:28.897523Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256001299009659:4389]
2025-10-01T14:12:28.897518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256003675902661:7298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:28.897521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256003675902661:7298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:28.897526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:28.898097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:28.898314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:28.898350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:28.898649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:28.898711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.898717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.898718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.898719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.898720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.898721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.898722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.898723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.898724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.898724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.898725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.898726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.898727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.898728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.898733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.898741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.898745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.898748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.898752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.898755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.898758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.898762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.898765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.898768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.898771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.898775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.898778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.898780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.898787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.898794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:28.898798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.898803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:28.898807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.898812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:28.898818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.898822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:28.898826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.898831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:28.898834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.898838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:28.898843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.898848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:28.898851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.898864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:28.898873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.898877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:28.898881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.898885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.898894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.898898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.898906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.898910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.898913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.898917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:28.898921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.898929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:28.898960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:28.902324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:28.902861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:28.902875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:28.902877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:28.902879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:28.902883Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1677 [2:7556256001299009659:4389]
2025-10-01T14:12:28.902893Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:28.902907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:28.902912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.902914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.902916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.902926Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:28.902933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:28.902937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:28.902974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.902978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.902980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.902982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:28.902983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:28.903030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:28.903035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.903041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:28.903047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:28.903060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:28.903078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256001299009654:4389]
2025-10-01T14:12:28.903085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256001299009654:4389]
2025-10-01T14:12:28.903086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256001299009654:4389]
2025-10-01T14:12:28.903096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:28.903108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675902749:7298], now have 1 active actors on pipe
2025-10-01T14:12:28.903110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:28.903114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675902416:2446], now have 1 active actors on pipe
2025-10-01T14:12:28.903114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:28.903116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:28.903120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:28.903129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:28.903131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:28.903145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256001299009654:4389]
2025-10-01T14:12:28.903152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:28.903157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:28.903177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1677
2025-10-01T14:12:28.903205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1677
2025-10-01T14:12:28.903248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.903259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.903278Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:28.903283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:28.903289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:28.903291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:28.903297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:28.903306Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:28.903320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.903423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.903430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.903439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:28.903494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1678 partition: 0 MaxSeqNo: 45 sessionId: src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0
2025-10-01T14:12:28.903761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae35ff74-693cadcf-16a2beab-185a25f2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:28.906048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0] Write session: try to update token
2025-10-01T14:12:28.906060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:28.918539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1678 sessionId: src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:28.918575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:28.918596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:28.918606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256001299009654:4389]
2025-10-01T14:12:28.918651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:28.918652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:28.918815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:28.918959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:28.919099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:28.919231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:28.919418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:28.919460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:28.920746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:28.920943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:28.920962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:28.920993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:28.921076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:28.934834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:28.934854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:28.934856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:28.934858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:28.934869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256001299009654:4389]
2025-10-01T14:12:28.934872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256001299009654:4389]
2025-10-01T14:12:28.934875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256001299009654:4389]
2025-10-01T14:12:28.934921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:28.934922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:28.934926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:28.934929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:28.934932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:28.934935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:28.935063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:28.981794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256003675902783:7971]
2025-10-01T14:12:28.982119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1677, pipe: [1:7556256003675902783:7971]
2025-10-01T14:12:29.066040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:29.072774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.072798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.072932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.072985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.073040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.073092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.073133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.073140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.073197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.073249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.073302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.073359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.073398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.073403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.073456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.073504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.073555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.073609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.073646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.073650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.073702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.073752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.073848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.073944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.073993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.074001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.074104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.074152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.074200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.074246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.074281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.074286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.074337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.074405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.074460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.074508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.074552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.074558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.074609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.074660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.074718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.074773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.074812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.074820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.074873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.074925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.074978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.075033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.075075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.075081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.075134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.075184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.075233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.075286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.075323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.075328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.075384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.075435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.075486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.075538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.075574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.075579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.075616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256003675902783:7971], now have 1 active actors on pipe
2025-10-01T14:12:29.075786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256003675902783:7971]
2025-10-01T14:12:29.075809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:29.075819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:29.075822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:29.075846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1678 reason: error at write: Disconnected sessionId: src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0
2025-10-01T14:12:29.076044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1678 sessionId: src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0 is DEAD
2025-10-01T14:12:29.076190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:29.076200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0] Write session will restart in 0.005060s
2025-10-01T14:12:29.076218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0] Write session: Do CDS request
2025-10-01T14:12:29.076224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:29.076376Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:29.082722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.082794Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:29.082801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1679
2025-10-01T14:12:29.082889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.082910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:29.082916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:29.082919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:29.083325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1679 sessionId:  describe result for acl check
2025-10-01T14:12:29.083356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:29.083361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:29.083363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:29.083369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256007970870188:7289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:29.083784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256007970870188:7289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:29.085780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256007970870188:7289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:29.088580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256007970870188:7289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:29.088590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256007970870188:7289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:29.088592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256007970870188:7289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:29.088596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:29.089882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:29.091489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:29.091622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:29.091629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:29.091636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:29.091666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:29.091714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256005593977237:4383]
2025-10-01T14:12:29.092077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:29.092274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:29.092311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:29.092516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:29.092546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.092550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.092550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.092551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.092551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.092552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.092552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.092553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.092554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.092554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.092555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.092555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.092556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.092557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.092560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.092565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.092568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.092570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.092572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.092574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.092576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.092578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.092580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.092582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.092584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.092586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.092588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.092590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.092594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.092598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.092602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.092605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.092607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.092609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.092612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.092614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.092617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.092619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.092621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.092624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.092627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.092630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.092636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.092639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.092649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.092656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.092659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.092661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.092663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.092666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.092671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.092673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.092675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.092678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.092683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.092686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.092705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:29.096181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:29.096869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:29.096885Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:29.096887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:29.096890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:29.096896Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1678 [2:7556256005593977237:4383]
2025-10-01T14:12:29.096909Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:29.096924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:29.096926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.096929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.096932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.096947Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:29.096952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:29.096957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:29.097003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.097013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.097014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.097017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:29.097019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:29.097082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:29.097089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.097099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.097108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.097126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:29.097147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970870081:2446], now have 1 active actors on pipe
2025-10-01T14:12:29.097155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970870411:7289], now have 1 active actors on pipe
2025-10-01T14:12:29.097162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256005593977221:4383]
2025-10-01T14:12:29.097169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256005593977221:4383]
2025-10-01T14:12:29.097170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256005593977221:4383]
2025-10-01T14:12:29.097184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:29.097201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:29.097200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:29.097203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:29.097204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:29.097182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1678
2025-10-01T14:12:29.097217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:29.097220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:29.097189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1678
2025-10-01T14:12:29.097260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.097269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.097280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256005593977221:4383]
2025-10-01T14:12:29.097290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:29.097304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:29.097319Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:29.097326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.097335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.097337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:29.097345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.097357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:29.097381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.097491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.097498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.097512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.097581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1679 partition: 0 MaxSeqNo: 45 sessionId: src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0
2025-10-01T14:12:29.097882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1430a773-c938a19c-c81b8a87-5df5fe6d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:29.100108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0] Write session: try to update token
2025-10-01T14:12:29.100122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:29.112677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1679 sessionId: src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:29.114955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:29.115353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.115372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.115404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:29.115463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:29.117363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:29.117380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:29.117383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:29.117385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:29.117393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256005593977221:4383]
2025-10-01T14:12:29.117397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256005593977221:4383]
2025-10-01T14:12:29.117401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256005593977221:4383]
2025-10-01T14:12:29.117444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:29.117456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.117457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:29.117459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:29.117463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:29.117468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:29.117596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:29.175837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256007970870427:7971]
2025-10-01T14:12:29.176065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1678, pipe: [1:7556256007970870427:7971]
2025-10-01T14:12:29.247909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:29.254115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.254136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.254261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.254312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.254365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.254446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.254490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.254498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.254555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.254606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.254656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.254709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.254746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.254753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.254806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.254853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.254901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.254947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.254983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.254988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.255041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.255090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.255139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.255190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.255287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.255293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.255341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.255388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.255435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.255482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.255522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.255527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.255579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.255627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.255680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.255733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.255773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.255778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.255828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.255875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.255925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.255976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.256014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.256020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.256070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.256120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.256169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.256221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.256258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.256263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.256317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.256370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.256421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.256473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.256513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.256519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.256570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.256619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.256700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.256748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.256784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.256789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.256823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970870427:7971], now have 1 active actors on pipe
2025-10-01T14:12:29.257009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256007970870427:7971]
2025-10-01T14:12:29.257033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:29.257035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:29.257040Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:29.257053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1679 reason: error at write: Disconnected sessionId: src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0
2025-10-01T14:12:29.257242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1679 sessionId: src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0 is DEAD
2025-10-01T14:12:29.257334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:29.257341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0] Write session will restart in 0.007129s
2025-10-01T14:12:29.257358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0] Write session: Do CDS request
2025-10-01T14:12:29.257363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:29.257374Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:29.265786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.265905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:29.265915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1680
2025-10-01T14:12:29.266020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.266042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:29.266050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:29.266052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:29.266414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1680 sessionId:  describe result for acl check
2025-10-01T14:12:29.266446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:29.266452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:29.266454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:29.266458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256007970870606:7276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:29.266923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256007970870606:7276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:29.269167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256007970870606:7276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:29.271506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:29.271572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256007970870606:7276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:29.271583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256007970870606:7276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:29.271586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256007970870606:7276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:29.271599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:29.273425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:29.273658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:29.273667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:29.273677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:29.273730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:29.273762Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256005593977512:4369]
2025-10-01T14:12:29.274319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:29.274615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:29.274653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:29.274925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:29.274969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.274974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.274975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.274976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.274977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.274978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.274979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.274980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.274981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.274982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.274983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.274984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.274985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.274986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.274990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.274998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.275002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.275004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.275007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.275011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.275014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.275017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.275020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.275024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.275027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.275030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.275033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.275036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.275042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.275048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.275053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.275058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.275061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.275066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.275069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.275073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.275077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.275081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.275084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.275088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.275092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.275096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.275100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.275104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.275107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.275112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.275115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.275120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.275124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.275128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.275132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.275136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.275140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.275149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.275152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.275157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.275189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:29.278541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:29.279287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:29.279298Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:29.279300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:29.279302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:29.279307Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1679 [2:7556256005593977512:4369]
2025-10-01T14:12:29.279316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:29.279327Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:29.279328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.279330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.279331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.279342Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:29.279345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:29.279349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:29.279383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.279387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.279388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.279391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:29.279392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:29.279432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:29.279439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.279445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.279453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.279467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:29.279486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256005593977506:4369]
2025-10-01T14:12:29.279492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256005593977506:4369]
2025-10-01T14:12:29.279494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256005593977506:4369]
2025-10-01T14:12:29.279504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:29.279513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970870763:7276], now have 1 active actors on pipe
2025-10-01T14:12:29.279518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970870429:2446], now have 1 active actors on pipe
2025-10-01T14:12:29.279520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:29.279522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:29.279524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:29.279524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:29.279532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:29.279534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:29.279551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256005593977506:4369]
2025-10-01T14:12:29.279558Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:29.279565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:29.279573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1679
2025-10-01T14:12:29.279578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1679
2025-10-01T14:12:29.279622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.279629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.279648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:29.279656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.279658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.279662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:29.279667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.279674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:29.279687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.279827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.279838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.279855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.279915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1680 partition: 0 MaxSeqNo: 45 sessionId: src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0
2025-10-01T14:12:29.280196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d02632e7-ae7e22e5-c5fe9dd1-aba55531_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:29.282291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0] Write session: try to update token
2025-10-01T14:12:29.282305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:29.295145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1680 sessionId: src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:29.297191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:29.299149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.299172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.299187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:29.299190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:29.299191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:29.299193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:29.299198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256005593977506:4369]
2025-10-01T14:12:29.299201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256005593977506:4369]
2025-10-01T14:12:29.299204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256005593977506:4369]
2025-10-01T14:12:29.299234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:29.299244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:29.299245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:29.299248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:29.299249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.299251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:29.299369Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:29.357078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256007970870788:7971]
2025-10-01T14:12:29.357299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1679, pipe: [1:7556256007970870788:7971]
2025-10-01T14:12:29.434053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:29.434419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:29.434465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970870788:7971], now have 1 active actors on pipe
2025-10-01T14:12:29.434562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:29.434709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256007970870788:7971]
2025-10-01T14:12:29.434742Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:29.445210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:29.445222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:29.445244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1680 reason: error at write: Disconnected sessionId: src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0
2025-10-01T14:12:29.445407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1680 sessionId: src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0 is DEAD
2025-10-01T14:12:29.445567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:29.445576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0] Write session will restart in 0.008127s
2025-10-01T14:12:29.445594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0] Write session: Do CDS request
2025-10-01T14:12:29.445598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:29.454811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.455192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:29.455206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1681
2025-10-01T14:12:29.455320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.455350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:29.455359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:29.455363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:29.455711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1681 sessionId:  describe result for acl check
2025-10-01T14:12:29.455747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:29.455753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:29.455754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:29.455762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256007970871097:7275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:29.456200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256007970871097:7275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:29.456560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:29.458319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:29.458459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256007970871097:7275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:29.458473Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:29.458481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:29.458489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:29.458520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:29.458545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256005593977789:4359]
2025-10-01T14:12:29.458920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:29.459086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:29.459110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:29.459293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:29.459327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.459331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.459331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.459332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.459332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.459333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.459334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.459334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.459335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.459335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.459336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.459337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.459337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.459338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.459341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.459346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.459348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.459351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.459353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.459355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.459356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.459358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.459360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.459362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.459364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.459366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.459368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.459370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.459374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.459377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.459381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.459384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.459386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.459389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.459391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.459394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.459396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.459399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.459402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.459405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.459407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.459410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.459412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.459414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.459416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.459419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.459421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.459424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.459426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.459428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.459431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.459434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.459436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.459438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.459441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.459443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.459461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:29.462505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256007970871097:7275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:29.462517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256007970871097:7275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:29.462521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256007970871097:7275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:29.462529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:29.462714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:29.463226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:29.463239Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:29.463240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:29.463242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:29.463246Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1680 [2:7556256005593977789:4359]
2025-10-01T14:12:29.463256Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:29.463267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:29.463268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.463271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.463272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.463283Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:29.463286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:29.463290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:29.463325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.463330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.463331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.463333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:29.463335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:29.463377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:29.463385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.463392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.463397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.463405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:29.463415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970870794:2446], now have 1 active actors on pipe
2025-10-01T14:12:29.463417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970871138:7275], now have 1 active actors on pipe
2025-10-01T14:12:29.463434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256005593977784:4359]
2025-10-01T14:12:29.463438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256005593977784:4359]
2025-10-01T14:12:29.463439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256005593977784:4359]
2025-10-01T14:12:29.463447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:29.463457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:29.463464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:29.463467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:29.463467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:29.463468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:29.463469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:29.463483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256005593977784:4359]
2025-10-01T14:12:29.463485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:29.463471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1680
2025-10-01T14:12:29.463484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1680
2025-10-01T14:12:29.463492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:29.463509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.463514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.463532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:29.463542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.463545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.463546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:29.463556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.463564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:29.463574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.463700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.463705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.463713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.463779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1681 partition: 0 MaxSeqNo: 45 sessionId: src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0
2025-10-01T14:12:29.464069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1373d272-5bbfbe78-a480bbc0-505a4d35_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:29.466223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0] Write session: try to update token
2025-10-01T14:12:29.466236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:29.478142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1681 sessionId: src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:29.480274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:29.480571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.480599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.480629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:29.480730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:29.483550Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:29.483575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:29.483578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:29.483580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:29.483589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256005593977784:4359]
2025-10-01T14:12:29.483594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256005593977784:4359]
2025-10-01T14:12:29.483599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256005593977784:4359]
2025-10-01T14:12:29.483648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:29.483656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:29.483661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:29.483662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.483664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:29.483664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:29.483843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:29.534787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256007970871148:7971]
2025-10-01T14:12:29.535078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1680, pipe: [1:7556256007970871148:7971]
2025-10-01T14:12:29.618889Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:29.626741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.626771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.626936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.627007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.627067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.627128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.627178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.627187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.627261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.627326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.627384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.627450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.627494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.627501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.627561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.627617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.627672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.627725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.627769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.627776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.627836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.627894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.627954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.628015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.628063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.628071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.628130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.628189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.628242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.628297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.628344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.628351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.628413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.628470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.628531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.628594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.628652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.628659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.628723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.628780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.628839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.628901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.628946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.628954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.629010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.629085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.629210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.629326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.629377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.629385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.629451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.629514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.629578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.629644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.629688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.629696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.629759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.629820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.629879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.629936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.629985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.629992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.630046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970871148:7971], now have 1 active actors on pipe
2025-10-01T14:12:29.630230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256007970871148:7971]
2025-10-01T14:12:29.630254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:29.630256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:29.630258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:29.630288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1681 reason: error at write: Disconnected sessionId: src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0
2025-10-01T14:12:29.630455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1681 sessionId: src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0 is DEAD
2025-10-01T14:12:29.630567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:29.630576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0] Write session will restart in 0.008590s
2025-10-01T14:12:29.630594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0] Write session: Do CDS request
2025-10-01T14:12:29.630599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:29.631072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:29.639846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.639911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:29.639924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1682
2025-10-01T14:12:29.640089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.640118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:29.640129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:29.640131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:29.640501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1682 sessionId:  describe result for acl check
2025-10-01T14:12:29.640530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:29.640535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:29.640537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:29.640542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256007970871345:7266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:29.640934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256007970871345:7266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:29.643397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256007970871345:7266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:29.645300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256007970871345:7266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:29.645312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256007970871345:7266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:29.645315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256007970871345:7266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:29.645322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:29.645639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:29.647451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:29.647602Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:29.647611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:29.647618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:29.647656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:29.647685Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256005593978055:4352]
2025-10-01T14:12:29.648184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:29.648390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:29.648415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:29.648610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:29.648655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.648659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.648660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.648660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.648661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.648662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.648662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.648663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.648664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.648664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.648665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.648665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.648666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.648667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.648670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.648676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.648678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.648680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.648683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.648685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.648687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.648689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.648691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.648693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.648695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.648697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.648699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.648701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.648705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.648709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.648715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.648718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.648720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.648723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.648725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.648732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.648735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.648737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.648742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.648745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.648748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.648750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.648753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.648758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.648761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.648763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.648766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.648772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.648774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.648777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.648785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.648790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.648797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.648802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.648810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.648818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.648839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:29.652081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:29.652761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:29.652773Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:29.652775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:29.652777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:29.652782Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1681 [2:7556256005593978055:4352]
2025-10-01T14:12:29.652791Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:29.652802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:29.652803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.652805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.652807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.652817Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:29.652824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:29.652828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:29.652867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.652873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.652874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.652876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:29.652878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:29.652923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:29.652928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.652934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.652940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.652948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:29.652962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256005593978050:4352]
2025-10-01T14:12:29.652964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256005593978050:4352]
2025-10-01T14:12:29.652966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256005593978050:4352]
2025-10-01T14:12:29.652972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:29.652978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:29.652980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:29.652982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:29.652986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:29.652993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:29.652998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:29.653005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970871151:2446], now have 1 active actors on pipe
2025-10-01T14:12:29.653010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970871487:7266], now have 1 active actors on pipe
2025-10-01T14:12:29.653025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256005593978050:4352]
2025-10-01T14:12:29.653033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:29.653071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:29.653082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1681
2025-10-01T14:12:29.653108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1681
2025-10-01T14:12:29.653144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.653157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.653188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:29.653198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.653201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.653203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:29.653210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.653223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:29.653237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.653360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.653366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.653375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.653439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1682 partition: 0 MaxSeqNo: 45 sessionId: src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0
2025-10-01T14:12:29.653750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8825c6b-59fcddf5-2feca378-4c0b95aa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:29.655951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0] Write session: try to update token
2025-10-01T14:12:29.655966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:29.668275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1682 sessionId: src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:29.670402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:29.670608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.670632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.670668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:29.670760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:29.673388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:29.673405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:29.673407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:29.673409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:29.673417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256005593978050:4352]
2025-10-01T14:12:29.673422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256005593978050:4352]
2025-10-01T14:12:29.673428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256005593978050:4352]
2025-10-01T14:12:29.673470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:29.673480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.673482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:29.673528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:29.673538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:29.673541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:29.673608Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:29.730344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256007970871503:7971]
2025-10-01T14:12:29.731202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1681, pipe: [1:7556256007970871503:7971]
2025-10-01T14:12:29.804972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:29.811740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.811763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.811902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.811953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.812004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.812060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.812106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.812118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.812191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.812250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.812306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.812359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.812406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.812412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.812470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.812520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.812568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.812616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.812668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.812677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.812737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.812785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.812830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.812876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.812911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.812916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.812971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.813018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.813063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.813111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.813148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.813153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.813213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.813268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.813329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.813388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.813434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.813440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.813500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.813552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.813601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.813650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.813688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.813696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.813751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.813804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.813855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.813905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.813943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.813948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.814002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.814059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.814112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.814162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.814200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.814205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.814260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:29.814310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:29.814362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:29.814440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:29.814486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:29.814494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:29.814546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970871503:7971], now have 1 active actors on pipe
2025-10-01T14:12:29.814755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256007970871503:7971]
2025-10-01T14:12:29.814763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:29.814789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:29.814795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:29.814824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1682 reason: error at write: Disconnected sessionId: src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0
2025-10-01T14:12:29.815053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1682 sessionId: src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0 is DEAD
2025-10-01T14:12:29.815169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:29.815175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0] Write session will restart in 0.008637s
2025-10-01T14:12:29.815193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0] Write session: Do CDS request
2025-10-01T14:12:29.815198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:29.815645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:29.824837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.824953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:29.824966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1683
2025-10-01T14:12:29.825078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.825109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:29.825118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:29.825123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:29.825399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1683 sessionId:  describe result for acl check
2025-10-01T14:12:29.825422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:29.825426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:29.825427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:29.825430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256007970871747:7259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:29.825832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256007970871747:7259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:29.828218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256007970871747:7259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:29.829682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:29.829998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:29.830195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:29.830206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:29.830217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:29.830263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:29.830300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256005593978318:4356]
2025-10-01T14:12:29.830709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:29.830728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256007970871747:7259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:29.830743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256007970871747:7259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:29.830747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256007970871747:7259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:29.830754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:29.830934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:29.830962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:29.831144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:29.831175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.831180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.831180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.831181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.831181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.831182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.831183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.831183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.831184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.831185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.831185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.831186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.831186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.831187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.831190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.831195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.831197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.831199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.831201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.831203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.831205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.831208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.831210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.831212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.831214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.831216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.831218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.831220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.831224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.831228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:29.831232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.831235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:29.831238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.831241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:29.831243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.831247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:29.831249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.831252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:29.831254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.831257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:29.831259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.831262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:29.831264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.831267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:29.831269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.831272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:29.831274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.831277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.831279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.831282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.831285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.831288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.831290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.831293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:29.831295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.831297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:29.831315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:29.834558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:29.835130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:29.835149Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:29.835151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:29.835154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:29.835160Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1682 [2:7556256005593978318:4356]
2025-10-01T14:12:29.835171Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:29.835184Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:29.835192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.835195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.835196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.835218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:29.835224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:29.835230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:29.835278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.835284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.835286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.835289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:29.835291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:29.835347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:29.835355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.835365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:29.835373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:29.835385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:29.835403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970871506:2446], now have 1 active actors on pipe
2025-10-01T14:12:29.835410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970871845:7259], now have 1 active actors on pipe
2025-10-01T14:12:29.835416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256005593978313:4356]
2025-10-01T14:12:29.835417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256005593978313:4356]
2025-10-01T14:12:29.835419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256005593978313:4356]
2025-10-01T14:12:29.835427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:29.835414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1682
2025-10-01T14:12:29.835439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1682
2025-10-01T14:12:29.835437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:29.835438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:29.835441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:29.835442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:29.835452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:29.835454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:29.835486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.835493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.835504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256005593978313:4356]
2025-10-01T14:12:29.835514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:29.835526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:29.835537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:29.835542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:29.835547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:29.835549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:29.835557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:29.835566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:29.835581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.835711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.835718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.835729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:29.835780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1683 partition: 0 MaxSeqNo: 45 sessionId: src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0
2025-10-01T14:12:29.836075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02220d8-9e58a1d2-8a31c8e-a3a009d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:29.838234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0] Write session: try to update token
2025-10-01T14:12:29.838249Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:29.851937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1683 sessionId: src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:29.854042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:29.855547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:29.855576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:29.855596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:29.855599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:29.855602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:29.855604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:29.855612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256005593978313:4356]
2025-10-01T14:12:29.855617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256005593978313:4356]
2025-10-01T14:12:29.855621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256005593978313:4356]
2025-10-01T14:12:29.855657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:29.855670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:29.855673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:29.855676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:29.855684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:29.855686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:29.855812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:29.914648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256007970871858:7971]
2025-10-01T14:12:29.914864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1682, pipe: [1:7556256007970871858:7971]
2025-10-01T14:12:29.988364Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:29.988679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:29.988724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970871858:7971], now have 1 active actors on pipe
2025-10-01T14:12:29.988812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:29.988899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:29.988907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:29.988977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1683 reason: error at write: Disconnected sessionId: src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0
2025-10-01T14:12:29.989144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1683 sessionId: src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0 is DEAD
2025-10-01T14:12:29.989252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:29.989259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0] Write session will restart in 0.006702s
2025-10-01T14:12:29.989280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0] Write session: Do CDS request
2025-10-01T14:12:29.989285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:29.989303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:29.989345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256007970871858:7971]
2025-10-01T14:12:29.996883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.997000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:29.997013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1684
2025-10-01T14:12:29.997140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:29.997171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:29.997180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:29.997184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:29.997506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1684 sessionId:  describe result for acl check
2025-10-01T14:12:29.997550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:29.997555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:29.997557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:29.997561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256007970872029:7240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:29.997981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256007970872029:7240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:29.999975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256007970872029:7240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:30.002456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256007970872029:7240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:30.002468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256007970872029:7240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:30.002471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256007970872029:7240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:30.002477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:30.003557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:30.005344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:30.005477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:30.005485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:30.005492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:30.005522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:30.005553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256009888945887:4354]
2025-10-01T14:12:30.005973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:30.006189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:30.006216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:30.006465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:30.006516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.006521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.006522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.006523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.006524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.006525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.006525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.006526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.006526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.006527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.006528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.006528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.006529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.006529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.006533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.006539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.006541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.006544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.006546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.006548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.006551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.006553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.006555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.006557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.006560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.006562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.006564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.006566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.006571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.006576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.006582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.006585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.006587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.006590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.006593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.006596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.006598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.006601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.006604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.006607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.006609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.006612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.006614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.006618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.006620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.006623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.006625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.006629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.006632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.006635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.006637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.006639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.006642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.006645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.006647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.006650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.006672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:30.010566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:30.011113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:30.011125Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:30.011127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:30.011129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:30.011135Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1683 [2:7556256009888945887:4354]
2025-10-01T14:12:30.011145Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:30.011161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:30.011163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.011165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.011166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.011179Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:30.011188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:30.011195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:30.011234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.011240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.011241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.011243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:30.011246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:30.011296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:30.011301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.011309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.011315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.011326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:30.011341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256007970871873:2446], now have 1 active actors on pipe
2025-10-01T14:12:30.011351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256009888945882:4354]
2025-10-01T14:12:30.011354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256009888945882:4354]
2025-10-01T14:12:30.011356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256009888945882:4354]
2025-10-01T14:12:30.011362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:30.011371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:30.011373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:30.011374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:30.011375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:30.011383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:30.011385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:30.011389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265839512:7240], now have 1 active actors on pipe
2025-10-01T14:12:30.011412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256009888945882:4354]
2025-10-01T14:12:30.011417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:30.011392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1683
2025-10-01T14:12:30.011419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:30.011441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.011415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1683
2025-10-01T14:12:30.011446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.011470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:30.011478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.011481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.011483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:30.011488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.011510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:30.011526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.011627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.011633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.011642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.011698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1684 partition: 0 MaxSeqNo: 45 sessionId: src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0
2025-10-01T14:12:30.012031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdde6aac-3c1ccded-3a3a7e50-b3769e7a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:30.014241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0] Write session: try to update token
2025-10-01T14:12:30.014255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:30.026936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1684 sessionId: src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:30.029333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:30.030747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.030774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.030793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:30.030796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:30.030799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:30.030802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:30.030810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256009888945882:4354]
2025-10-01T14:12:30.030815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256009888945882:4354]
2025-10-01T14:12:30.030825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256009888945882:4354]
2025-10-01T14:12:30.030865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:30.030878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:30.030881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:30.030894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:30.030901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.030904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:30.031021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:30.089758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256012265839527:7971]
2025-10-01T14:12:30.090023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1683, pipe: [1:7556256012265839527:7971]
2025-10-01T14:12:30.165039Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:30.165566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:30.165614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265839527:7971], now have 1 active actors on pipe
2025-10-01T14:12:30.165681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:30.165815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:30.165857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256012265839527:7971]
2025-10-01T14:12:30.176895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:30.176907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:30.176927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1684 reason: error at write: Disconnected sessionId: src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0
2025-10-01T14:12:30.177089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1684 sessionId: src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0 is DEAD
2025-10-01T14:12:30.177284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:30.177301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0] Write session will restart in 0.009881s
2025-10-01T14:12:30.177329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0] Write session: Do CDS request
2025-10-01T14:12:30.177337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:30.184405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:30.186391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:30.186597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:30.186611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:30.186623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:30.186679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:30.186722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256009888946166:4340]
2025-10-01T14:12:30.187286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:30.187521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:30.187568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:30.187850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.187864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:30.187932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.187939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.187940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.187941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.187942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.187943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.187944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.187945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.187946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.187947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.187948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.187949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.187951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.187952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.187956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.187967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.187970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.187975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.187978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.187981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.187984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.187987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.187989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.187993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.187997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.188001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.188005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.188008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.188020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.188032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.188041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.188051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.188059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.188068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.188076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.188085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:30.188096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1685
2025-10-01T14:12:30.188086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.188094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.188099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.188103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.188108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.188113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.188117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.188121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.188126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.188130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.188135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.188139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.188144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.188148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.188155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.188159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.188164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.188168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.188172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.188176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.188180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.188186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.188208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:30.188216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:30.188218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:30.188216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:30.188605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1685 sessionId:  describe result for acl check
2025-10-01T14:12:30.188632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:30.188636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:30.188637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:30.188640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256012265839840:7239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:30.188997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256012265839840:7239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:30.190986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256012265839840:7239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:30.191688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:30.192307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:30.192323Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:30.192326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:30.192329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:30.192336Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1684 [2:7556256009888946166:4340]
2025-10-01T14:12:30.192351Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:30.192369Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:30.192376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.192380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.192383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.192397Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:30.192408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:30.192417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:30.192472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.192479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.192481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.192484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:30.192487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:30.192551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:30.192558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.192570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.192585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.192605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:30.192626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265839530:2446], now have 1 active actors on pipe
2025-10-01T14:12:30.192638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256009888946161:4340]
2025-10-01T14:12:30.192653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256009888946161:4340]
2025-10-01T14:12:30.192656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256009888946161:4340]
2025-10-01T14:12:30.192638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1684
2025-10-01T14:12:30.192665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:30.192675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:30.192682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:30.192683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:30.192684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:30.192697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:30.192704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:30.192734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256009888946161:4340]
2025-10-01T14:12:30.192746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:30.192755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:30.193132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256012265839840:7239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:30.193142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256012265839840:7239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:30.193144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256012265839840:7239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:30.193149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:30.193312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265839876:7239], now have 1 active actors on pipe
2025-10-01T14:12:30.193342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1684
2025-10-01T14:12:30.193380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.193386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.193404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:30.193413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.193419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.193421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:30.193428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.193440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:30.193453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.193553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.193558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.193567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.193614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1685 partition: 0 MaxSeqNo: 45 sessionId: src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0
2025-10-01T14:12:30.193901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67e86cbb-6489d388-17bdc390-9ec4b20b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:30.196132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0] Write session: try to update token
2025-10-01T14:12:30.196147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:30.208496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1685 sessionId: src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:30.210950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:30.212155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.212178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.212195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:30.212197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:30.212199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:30.212200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:30.212206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256009888946161:4340]
2025-10-01T14:12:30.212208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256009888946161:4340]
2025-10-01T14:12:30.212212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256009888946161:4340]
2025-10-01T14:12:30.212252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:30.212254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:30.212259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.212260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:30.212261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:30.212264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:30.212385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:30.265899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256012265839883:7971]
2025-10-01T14:12:30.266159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1684, pipe: [1:7556256012265839883:7971]
2025-10-01T14:12:30.349612Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:30.350132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:30.350183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265839883:7971], now have 1 active actors on pipe
2025-10-01T14:12:30.350271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:30.350321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256012265839883:7971]
2025-10-01T14:12:30.350337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:30.350357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:30.350365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:30.350430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1685 reason: error at write: Disconnected sessionId: src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0
2025-10-01T14:12:30.350547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1685 sessionId: src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0 is DEAD
2025-10-01T14:12:30.350671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:30.350681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0] Write session will restart in 0.006589s
2025-10-01T14:12:30.350705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0] Write session: Do CDS request
2025-10-01T14:12:30.350715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:30.358867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.358944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:30.358958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1686
2025-10-01T14:12:30.359071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.359102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:30.359111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:30.359115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:30.359423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1686 sessionId:  describe result for acl check
2025-10-01T14:12:30.359452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:30.359457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:30.359458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:30.359462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256012265840012:7233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:30.359850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256012265840012:7233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:30.362336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256012265840012:7233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:30.364983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256012265840012:7233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:30.364993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256012265840012:7233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:30.364996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256012265840012:7233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:30.365002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:30.366533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:30.368640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:30.368882Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:30.368891Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:30.368899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:30.368951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:30.368979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256009888946463:4317]
2025-10-01T14:12:30.369667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:30.369901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:30.369927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:30.370127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:30.370171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.370176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.370177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.370178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.370178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.370179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.370180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.370180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.370181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.370182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.370182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.370183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.370183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.370184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.370187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.370203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.370205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.370207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.370209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.370211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.370213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.370215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.370217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.370219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.370222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.370224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.370226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.370228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.370232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.370236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.370240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.370243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.370246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.370248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.370250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.370253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.370256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.370259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.370261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.370268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.370274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.370279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.370283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.370288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.370292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.370297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.370301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.370308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.370311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.370315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.370317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.370320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.370322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.370325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.370327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.370331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.370350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:30.373748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:30.374285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:30.374297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:30.374299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:30.374302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:30.374309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1685 [2:7556256009888946463:4317]
2025-10-01T14:12:30.374319Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:30.374332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:30.374338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.374340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.374342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.374353Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:30.374356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:30.374360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:30.374425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.374431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.374432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.374435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:30.374437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:30.374488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:30.374496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.374503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.374509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.374519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:30.374531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256009888946458:4317]
2025-10-01T14:12:30.374536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256009888946458:4317]
2025-10-01T14:12:30.374537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256009888946458:4317]
2025-10-01T14:12:30.374543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:30.374550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:30.374553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265840237:7233], now have 1 active actors on pipe
2025-10-01T14:12:30.374559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:30.374560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:30.374561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:30.374568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:30.374570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:30.374574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265839900:2446], now have 1 active actors on pipe
2025-10-01T14:12:30.374592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256009888946458:4317]
2025-10-01T14:12:30.374601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:30.374606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:30.374640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1685
2025-10-01T14:12:30.374641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1685
2025-10-01T14:12:30.374708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.374716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.374737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:30.374746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.374749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.374750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:30.374757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.374764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:30.374780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.374902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.374915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.374934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.375016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1686 partition: 0 MaxSeqNo: 45 sessionId: src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0
2025-10-01T14:12:30.375353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fa1dd-9f964fea-37c9dd25-86d81066_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:30.378157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0] Write session: try to update token
2025-10-01T14:12:30.378178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:30.390747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1686 sessionId: src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:30.392927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:30.393356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.393376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.395054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:30.395085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:30.395087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:30.395089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:30.395090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:30.395097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256009888946458:4317]
2025-10-01T14:12:30.395100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256009888946458:4317]
2025-10-01T14:12:30.395103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256009888946458:4317]
2025-10-01T14:12:30.395122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:30.395133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:30.395135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:30.395136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:30.395140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.395141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:30.395161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:30.395252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:30.450716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256012265840256:7971]
2025-10-01T14:12:30.451035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1685, pipe: [1:7556256012265840256:7971]
2025-10-01T14:12:30.532221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:30.542456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.542484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.542655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.542733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.542805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.542876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.542930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.542942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.543022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.543091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.543157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.543223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.543271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.543279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.543351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.543416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.543477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.543543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.543586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.543595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.543657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.543722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.543785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.543837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.543874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.543879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.543933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.543982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.544035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.544089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.544127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.544132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.544184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.544230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.544283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.544337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.544378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.544383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.544434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.544483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.544537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.544587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.544626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.544631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.544696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.544748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.544802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.544856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.544895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.544900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.544959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.545012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.545069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.545125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.545166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.545171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.545228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.545279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.545333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.545462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.545509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.545512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.545568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265840256:7971], now have 1 active actors on pipe
2025-10-01T14:12:30.545760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:30.545769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:30.545771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:30.545794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1686 reason: error at write: Disconnected sessionId: src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0
2025-10-01T14:12:30.545810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256012265840256:7971]
2025-10-01T14:12:30.545964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1686 sessionId: src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0 is DEAD
2025-10-01T14:12:30.546078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:30.546087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0] Write session will restart in 0.007073s
2025-10-01T14:12:30.546113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0] Write session: Do CDS request
2025-10-01T14:12:30.546118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:30.546696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:30.553852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.553928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:30.553940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1687
2025-10-01T14:12:30.554062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.554087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:30.554091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:30.554093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:30.554448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1687 sessionId:  describe result for acl check
2025-10-01T14:12:30.554699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:30.554708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:30.554709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:30.554714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256012265840385:7219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:30.555125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256012265840385:7219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:30.557329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256012265840385:7219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:30.560075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256012265840385:7219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:30.560088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256012265840385:7219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:30.560091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256012265840385:7219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:30.560098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:30.562143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:30.564270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:30.564455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:30.564469Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:30.564479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:30.564530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:30.564567Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256009888946732:4315]
2025-10-01T14:12:30.565006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:30.565311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:30.565341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:30.565543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:30.565579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.565584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.565584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.565585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.565586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.565586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.565587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.565588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.565589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.565589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.565590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.565591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.565591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.565592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.565595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.565601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.565604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.565606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.565608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.565610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.565612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.565614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.565616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.565618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.565620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.565622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.565624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.565626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.565631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.565636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.565640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.565642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.565645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.565648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.565650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.565652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.565655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.565658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.565660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.565663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.565665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.565668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.565670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.565672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.565675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.565677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.565681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.565683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.565685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.565688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.565690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.565693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.565695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.565697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.565699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.565702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.565721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:30.569239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:30.569997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:30.570011Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:30.570012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:30.570014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:30.570019Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1686 [2:7556256009888946732:4315]
2025-10-01T14:12:30.570032Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:30.570044Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:30.570049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.570052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.570053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.570065Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:30.570070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:30.570075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:30.570112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.570117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.570119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.570121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:30.570123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:30.570172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:30.570178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.570184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.570190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.570199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:30.570214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256009888946727:4315]
2025-10-01T14:12:30.570219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256009888946727:4315]
2025-10-01T14:12:30.570220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256009888946727:4315]
2025-10-01T14:12:30.570227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:30.570236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265840262:2446], now have 1 active actors on pipe
2025-10-01T14:12:30.570236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:30.570239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:30.570241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:30.570242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265840582:7219], now have 1 active actors on pipe
2025-10-01T14:12:30.570248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:30.570255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:30.570259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:30.570277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256009888946727:4315]
2025-10-01T14:12:30.570284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:30.570291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:30.570341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.570350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.570311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1686
2025-10-01T14:12:30.570326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1686
2025-10-01T14:12:30.570391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:30.570402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.570406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.570412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:30.570421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.570431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:30.570444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.570564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.570570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.570580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.570647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1687 partition: 0 MaxSeqNo: 45 sessionId: src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0
2025-10-01T14:12:30.570964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39a1794b-5550ff92-62eb7dce-ee8270d5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:30.575756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0] Write session: try to update token
2025-10-01T14:12:30.575775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:30.589653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1687 sessionId: src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:30.592810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:30.592830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:30.592832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:30.592834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:30.592844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256009888946727:4315]
2025-10-01T14:12:30.592849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256009888946727:4315]
2025-10-01T14:12:30.592853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256009888946727:4315]
2025-10-01T14:12:30.592900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:30.592906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.592908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:30.593031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:30.593361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:30.593371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:30.593375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:30.594492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:30.645801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256012265840616:7971]
2025-10-01T14:12:30.646010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1686, pipe: [1:7556256012265840616:7971]
2025-10-01T14:12:30.727588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:30.728012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.728026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.728057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265840616:7971], now have 1 active actors on pipe
2025-10-01T14:12:30.728212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:30.728301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256012265840616:7971]
2025-10-01T14:12:30.728318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:30.728328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:30.728384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1687 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0
2025-10-01T14:12:30.728586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1687 sessionId: src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0 is DEAD
2025-10-01T14:12:30.728701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:30.728711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0] Write session will restart in 0.006988s
2025-10-01T14:12:30.728732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0] Write session: Do CDS request
2025-10-01T14:12:30.728737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:30.736912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.736979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:30.736992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1688
2025-10-01T14:12:30.737123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.737147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:30.737154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:30.737157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:30.737536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1688 sessionId:  describe result for acl check
2025-10-01T14:12:30.737570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:30.737576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:30.737577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:30.737582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256012265840736:7214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:30.738061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256012265840736:7214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:30.740278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256012265840736:7214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:30.742765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256012265840736:7214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:30.742779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256012265840736:7214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:30.742782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256012265840736:7214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:30.742790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:30.744404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:30.746598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:30.746734Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:30.746743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:30.746750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:30.746782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:30.746809Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256009888947003:4310]
2025-10-01T14:12:30.747190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:30.747437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:30.747482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:30.747732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:30.747791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.747798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.747799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.747800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.747802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.747803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.747804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.747805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.747806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.747808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.747809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.747811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.747812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.747813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.747818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.747823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.747826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.747828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.747830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.747832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.747834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.747836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.747838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.747843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.747846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.747850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.747854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.747857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.747864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.747872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.747883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.747892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.747900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.747904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.747912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.747917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.747926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.747931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.747939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.747944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.747953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.747958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.747967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.747972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.747978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.747981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.747985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.747988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.747990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.747994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.747996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.747999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.748002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.748005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.748007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.748010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.748030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:30.751425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:30.751981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:30.751995Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:30.751998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:30.752001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:30.752007Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1687 [2:7556256009888947003:4310]
2025-10-01T14:12:30.752022Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:30.752038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:30.752043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.752045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.752047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.752059Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:30.752066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:30.752071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:30.752107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.752112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.752114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.752116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:30.752118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:30.752166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:30.752171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.752178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.752184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.752193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:30.752209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265840950:7214], now have 1 active actors on pipe
2025-10-01T14:12:30.752215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265840618:2446], now have 1 active actors on pipe
2025-10-01T14:12:30.752221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256009888946998:4310]
2025-10-01T14:12:30.752228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256009888946998:4310]
2025-10-01T14:12:30.752230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256009888946998:4310]
2025-10-01T14:12:30.752243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:30.752256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:30.752257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:30.752265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:30.752265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:30.752267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:30.752267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:30.752260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1687
2025-10-01T14:12:30.752289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256009888946998:4310]
2025-10-01T14:12:30.752261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1687
2025-10-01T14:12:30.752294Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:30.752296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:30.752321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.752325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.752350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:30.752358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.752361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.752363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:30.752368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.752374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:30.752389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.752494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.752500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.752509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.752569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1688 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0
2025-10-01T14:12:30.752880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd50fb0c-5de4f523-b6403a1d-120c2e8d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:30.754971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0] Write session: try to update token
2025-10-01T14:12:30.754984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:30.767665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1688 sessionId: src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:30.769892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:30.770063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.770083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.770129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:30.770191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:30.774751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:30.774769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:30.774771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:30.774773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:30.774781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256009888946998:4310]
2025-10-01T14:12:30.774784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256009888946998:4310]
2025-10-01T14:12:30.774789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256009888946998:4310]
2025-10-01T14:12:30.774831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:30.774836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.774838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:30.774843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:30.774852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:30.774854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:30.774953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:30.828559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256012265840973:7971]
2025-10-01T14:12:30.828848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1687, pipe: [1:7556256012265840973:7971]
2025-10-01T14:12:30.910574Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:30.917149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.917170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.917297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.917345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.917397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.917448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.917493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.917500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.917555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.917603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.917656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.917708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.917744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.917749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.917798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.917841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.917887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.917933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.917969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.917976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.918024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.918072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.918117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.918161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.918202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.918210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.918264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.918312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.918358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.918419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.918453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.918458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.918508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.918552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.918602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.918653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.918690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.918695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.918744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.918792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.918839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.918887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.918923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.918928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.918977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.919024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.919070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.919118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.919156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.919160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.919213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.919262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.919325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.919378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.919419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.919424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.919474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:30.919521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:30.919572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:30.919632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:30.919666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:30.919671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:30.919705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265840973:7971], now have 1 active actors on pipe
2025-10-01T14:12:30.919926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:30.919936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:30.919940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:30.919967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1688 reason: error at write: Disconnected sessionId: src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0
2025-10-01T14:12:30.919968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256012265840973:7971]
2025-10-01T14:12:30.920201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1688 sessionId: src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0 is DEAD
2025-10-01T14:12:30.920288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:30.920297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0] Write session will restart in 0.005946s
2025-10-01T14:12:30.920314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0] Write session: Do CDS request
2025-10-01T14:12:30.920319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:30.920673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:30.927762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.927865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:30.927877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1689
2025-10-01T14:12:30.927974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:30.927996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:30.928004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:30.928006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:30.928350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1689 sessionId:  describe result for acl check
2025-10-01T14:12:30.928371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:30.928376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:30.928377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:30.928380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256012265841132:7212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:30.928760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256012265841132:7212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:30.931175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256012265841132:7212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:30.933516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256012265841132:7212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:30.933526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256012265841132:7212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:30.933528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256012265841132:7212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:30.933532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:30.934299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:30.936264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:30.936386Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:30.936393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:30.936401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:30.936429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:30.936457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256009888947274:4307]
2025-10-01T14:12:30.936858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:30.937281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:30.937323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:30.937531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:30.937563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.937567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.937568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.937568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.937569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.937569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.937570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.937571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.937571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.937572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.937573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.937573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.937574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.937575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.937578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.937584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.937586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.937588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.937590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.937592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.937595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.937597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.937599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.937601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.937604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.937606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.937608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.937610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.937615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.937620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:30.937623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.937626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:30.937629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.937632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:30.937634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.937641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:30.937644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.937647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:30.937653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.937655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:30.937658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.937661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:30.937666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.937668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:30.937671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.937674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:30.937679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.937682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.937684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.937687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.937689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.937692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.937697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.937700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:30.937702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.937706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:30.937731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:30.941020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:30.941532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:30.941544Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:30.941545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:30.941548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:30.941553Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1688 [2:7556256009888947274:4307]
2025-10-01T14:12:30.941561Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:30.941573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:30.941574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.941576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.941578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.941588Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:30.941594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:30.941598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:30.941630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.941636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.941637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.941639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:30.941641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:30.941683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:30.941688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.941695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:30.941701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:30.941709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:30.941723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265840977:2446], now have 1 active actors on pipe
2025-10-01T14:12:30.941728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256012265841318:7212], now have 1 active actors on pipe
2025-10-01T14:12:30.941733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256009888947269:4307]
2025-10-01T14:12:30.941735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256009888947269:4307]
2025-10-01T14:12:30.941737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256009888947269:4307]
2025-10-01T14:12:30.941749Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:30.941756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:30.941759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:30.941760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:30.941764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:30.941777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:30.941784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:30.941800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256009888947269:4307]
2025-10-01T14:12:30.941807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:30.941812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:30.941798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1688
2025-10-01T14:12:30.941831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.941806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1688
2025-10-01T14:12:30.941840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.941867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:30.941876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:30.941882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:30.941884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:30.941893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:30.941904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:30.941915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.942055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.942063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.942074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:30.942157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1689 partition: 0 MaxSeqNo: 45 sessionId: src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0
2025-10-01T14:12:30.942446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1c19dbf-f87a1df8-caa738e-da92c8b0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:30.944622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0] Write session: try to update token
2025-10-01T14:12:30.944636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:30.956849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1689 sessionId: src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:30.959173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:30.959316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:30.959335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:30.960948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:30.960976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:30.960978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:30.960980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:30.960981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:30.960987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256009888947269:4307]
2025-10-01T14:12:30.960993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256009888947269:4307]
2025-10-01T14:12:30.960995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256009888947269:4307]
2025-10-01T14:12:30.961013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:30.961023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:30.961024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:30.961026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:30.961028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:30.961030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:30.961064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:30.961140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:31.020048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256016560808642:7971]
2025-10-01T14:12:31.020274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1688, pipe: [1:7556256016560808642:7971]
2025-10-01T14:12:31.097260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:31.105300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.105329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.105486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.105545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.105605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.105664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.105706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.105718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.105787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.105840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.105897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.105963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.106005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.106013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.106069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.106119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.106175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.106233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.106272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.106279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.106334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.106405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.106459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.106511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.106552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.106560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.106613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.106665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.106717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.106771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.106812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.106818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.106874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.106924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.106980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.107042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.107085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.107093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.107148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.107203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.107259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.107316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.107357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.107365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.107422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.107480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.107531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.107588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.107630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.107637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.107697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.107754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.107810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.107865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.107915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.107923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.107984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.108036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.108097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.108153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.108197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.108205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.108260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560808642:7971], now have 1 active actors on pipe
2025-10-01T14:12:31.108508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:31.108520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:31.108545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1689 reason: error at write: Disconnected sessionId: src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0
2025-10-01T14:12:31.108688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:31.108725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1689 sessionId: src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0 is DEAD
2025-10-01T14:12:31.108733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256016560808642:7971]
2025-10-01T14:12:31.108820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:31.108827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0] Write session will restart in 0.007605s
2025-10-01T14:12:31.108843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0] Write session: Do CDS request
2025-10-01T14:12:31.108848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:31.109364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:31.117806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.117905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:31.117917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1690
2025-10-01T14:12:31.118015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.118043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:31.118052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:31.118055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:31.118366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1690 sessionId:  describe result for acl check
2025-10-01T14:12:31.118408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:31.118414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:31.118416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:31.118420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256016560808809:7203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:31.118852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256016560808809:7203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:31.120878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256016560808809:7203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:31.123178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256016560808809:7203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:31.123187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256016560808809:7203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:31.123189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256016560808809:7203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:31.123194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:31.126205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:31.126598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:31.126717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:31.126725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:31.126732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:31.126762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:31.126790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256014183914863:4280]
2025-10-01T14:12:31.127161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:31.127376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:31.127403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:31.127671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:31.127708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.127713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.127713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.127714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.127715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.127715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.127716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.127716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.127717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.127717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.127718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.127719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.127719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.127720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.127723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.127729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.127731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.127733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.127735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.127737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.127739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.127741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.127743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.127745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.127747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.127749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.127751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.127753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.127757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.127762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.127766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.127769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.127771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.127774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.127776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.127779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.127782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.127784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.127787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.127790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.127792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.127795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.127797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.127800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.127802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.127805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.127807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.127809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.127812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.127815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.127817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.127820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.127822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.127824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.127827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.127829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.127847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:31.131053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:31.131579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:31.131590Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:31.131591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:31.131594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:31.131598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1689 [2:7556256014183914863:4280]
2025-10-01T14:12:31.131607Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:31.131619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:31.131626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.131630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.131632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.131646Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:31.131655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:31.131662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:31.131713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.131719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.131721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.131724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:31.131727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:31.131777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:31.131783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.131790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.131795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.131805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:31.131821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560808996:7203], now have 1 active actors on pipe
2025-10-01T14:12:31.131827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560808654:2446], now have 1 active actors on pipe
2025-10-01T14:12:31.131832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256014183914858:4280]
2025-10-01T14:12:31.131834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256014183914858:4280]
2025-10-01T14:12:31.131835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256014183914858:4280]
2025-10-01T14:12:31.131845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:31.131858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:31.131867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:31.131868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:31.131872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:31.131873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:31.131873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:31.131889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256014183914858:4280]
2025-10-01T14:12:31.131894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:31.131885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1689
2025-10-01T14:12:31.131908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:31.131895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1689
2025-10-01T14:12:31.131936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.131942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.131958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57984096-f599ae8f-ce805051-9ffbe99a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:31.131966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.131968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.131970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:31.131977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.131984Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:31.131993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.132116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.132126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.132144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.132233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1690 partition: 0 MaxSeqNo: 45 sessionId: src_id|57984096-f599ae8f-ce805051-9ffbe99a_0
2025-10-01T14:12:31.132538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d621ea3-c47dacd4-ffedab31-a4ae7110_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|57984096-f599ae8f-ce805051-9ffbe99a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:31.134739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57984096-f599ae8f-ce805051-9ffbe99a_0] Write session: try to update token
2025-10-01T14:12:31.134754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57984096-f599ae8f-ce805051-9ffbe99a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:31.146874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1690 sessionId: src_id|57984096-f599ae8f-ce805051-9ffbe99a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:31.149046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:31.149227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.149246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.149276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:31.149345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:31.151506Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:31.151521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:31.151523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:31.151524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:31.151531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256014183914858:4280]
2025-10-01T14:12:31.151535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256014183914858:4280]
2025-10-01T14:12:31.151539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256014183914858:4280]
2025-10-01T14:12:31.151574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:31.151579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.151578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:31.151580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:31.151583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:31.151586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:31.151707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:31.209006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256016560809011:7971]
2025-10-01T14:12:31.209275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1689, pipe: [1:7556256016560809011:7971]
2025-10-01T14:12:31.284434Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:31.292510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.292534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.292681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.292734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.292788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.292845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.292885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.292892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.292951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.293002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.293055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.293112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.293150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.293155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.293207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.293254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.293305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.293354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.293391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.293398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.293449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.293501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.293551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.293600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.293640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.293645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.293701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.293759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.293819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.293877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.293915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.293920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.293974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.294024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.294076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.294130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.294170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.294175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.294228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.294277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.294332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.294400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.294440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.294446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.294499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.294549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.294601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.294654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.294694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.294699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.294766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.294825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.294878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.294933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.294972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.294979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.295043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.295097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.295151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.295204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.295240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.295246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.295294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560809011:7971], now have 1 active actors on pipe
2025-10-01T14:12:31.295468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:31.295480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:31.295490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:31.295504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1690 reason: error at write: Disconnected sessionId: src_id|57984096-f599ae8f-ce805051-9ffbe99a_0
2025-10-01T14:12:31.295550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256016560809011:7971]
2025-10-01T14:12:31.295700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1690 sessionId: src_id|57984096-f599ae8f-ce805051-9ffbe99a_0 is DEAD
2025-10-01T14:12:31.295812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57984096-f599ae8f-ce805051-9ffbe99a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:31.295822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57984096-f599ae8f-ce805051-9ffbe99a_0] Write session will restart in 0.006904s
2025-10-01T14:12:31.295847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57984096-f599ae8f-ce805051-9ffbe99a_0] Write session: Do CDS request
2025-10-01T14:12:31.295853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57984096-f599ae8f-ce805051-9ffbe99a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:31.296081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:31.303782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57984096-f599ae8f-ce805051-9ffbe99a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.303923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:31.303935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1691
2025-10-01T14:12:31.304033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.304061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:31.304069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:31.304072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:31.304396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1691 sessionId:  describe result for acl check
2025-10-01T14:12:31.304425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:31.304432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:31.304433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:31.304437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256016560809173:7189] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:31.304900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256016560809173:7189] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:31.307295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256016560809173:7189] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:31.309788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256016560809173:7189] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:31.309798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256016560809173:7189] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:31.309800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256016560809173:7189] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:31.309805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:31.310146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:31.311928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:31.312120Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:31.312128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:31.312136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:31.312173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:31.312200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256014183915135:4289]
2025-10-01T14:12:31.312566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:31.312752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:31.312778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:31.312963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:31.312994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.312998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.312999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.312999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.313000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.313001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.313001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.313002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.313002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.313003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.313004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.313004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.313005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.313005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.313008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.313014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.313016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.313018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.313020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.313022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.313024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.313026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.313028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.313030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.313032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.313034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.313036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.313038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.313042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.313047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.313050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.313054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.313056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.313059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.313061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.313064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.313066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.313069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.313071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.313074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.313080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.313083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.313085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.313087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.313089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.313095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.313097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.313100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.313102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.313106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.313111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.313113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.313115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.313118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.313120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.313122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.313142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:31.316340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:31.316901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:31.316915Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:31.316917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:31.316921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:31.316927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1690 [2:7556256014183915135:4289]
2025-10-01T14:12:31.316939Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:31.316957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:31.316966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.316970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.316976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.316986Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:31.316992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:31.316996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:31.317031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.317038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.317040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.317043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:31.317045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:31.317119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:31.317127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.317139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.317152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.317165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:31.317180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560809359:7189], now have 1 active actors on pipe
2025-10-01T14:12:31.317185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560809013:2446], now have 1 active actors on pipe
2025-10-01T14:12:31.317189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256014183915130:4289]
2025-10-01T14:12:31.317190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256014183915130:4289]
2025-10-01T14:12:31.317191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256014183915130:4289]
2025-10-01T14:12:31.317182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1690
2025-10-01T14:12:31.317201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:31.317211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:31.317203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1690
2025-10-01T14:12:31.317213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:31.317215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:31.317216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:31.317219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:31.317221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:31.317240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256014183915130:4289]
2025-10-01T14:12:31.317249Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:31.317254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:31.317263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.317265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.317293Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:31.317301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.317303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.317304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:31.317320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.317329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:31.317348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.317460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.317465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.317474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.317555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1691 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0
2025-10-01T14:12:31.317896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57984096-f599ae8f-ce805051-9ffbe99a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:31.320026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0] Write session: try to update token
2025-10-01T14:12:31.320039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:31.331948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1691 sessionId: src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:31.334001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:31.334187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.334206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.334235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:31.334302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:31.337075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:31.337091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:31.337092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:31.337094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:31.337101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256014183915130:4289]
2025-10-01T14:12:31.337105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256014183915130:4289]
2025-10-01T14:12:31.337107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256014183915130:4289]
2025-10-01T14:12:31.337143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:31.337148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:31.337151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.337152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:31.337153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:31.337155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:31.337271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:31.395868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256016560809383:7971]
2025-10-01T14:12:31.396095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1690, pipe: [1:7556256016560809383:7971]
2025-10-01T14:12:31.469153Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:31.475500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.475522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.475661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.475709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.475762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.475819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.476159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.476166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.476226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.476279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.476333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.476393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.476575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.476581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.476631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.476686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.476740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.476789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.476826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.476832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.476880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.476931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.476980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.477036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.477074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.477082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.477131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.477178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.477227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.477278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.477315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.477319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.477377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.477439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.477502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.477566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.477604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.477609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.477661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.477708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.477756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.477806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.477845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.477850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.477902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.477950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.478000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.478051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.478089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.478095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.478147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.478195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.478247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.478299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.478340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.478346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.478419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.478482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.478554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.478616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.478657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.478664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.478710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560809383:7971], now have 1 active actors on pipe
2025-10-01T14:12:31.478915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:31.478924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256016560809383:7971]
2025-10-01T14:12:31.478926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:31.478943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:31.478948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1691 reason: error at write: Disconnected sessionId: src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0
2025-10-01T14:12:31.479133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1691 sessionId: src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0 is DEAD
2025-10-01T14:12:31.479160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:31.479293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:31.479302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0] Write session will restart in 0.008040s
2025-10-01T14:12:31.479319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0] Write session: Do CDS request
2025-10-01T14:12:31.479324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:31.488837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.488930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:31.488945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1692
2025-10-01T14:12:31.489050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.489092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:31.489102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:31.489109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:31.489579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1692 sessionId:  describe result for acl check
2025-10-01T14:12:31.489615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:31.489621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:31.489622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:31.489630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256016560809598:7187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:31.490078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256016560809598:7187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:31.492735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256016560809598:7187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:31.493457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:31.495182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:31.495320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:31.495327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:31.495336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:31.495369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:31.495397Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256014183915436:4257]
2025-10-01T14:12:31.495472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256016560809598:7187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:31.495482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256016560809598:7187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:31.495485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256016560809598:7187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:31.495492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:31.495782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:31.495981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:31.496007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:31.496212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:31.496247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.496251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.496252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.496252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.496253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.496254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.496254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.496255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.496256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.496256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.496257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.496258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.496258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.496259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.496262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.496268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.496270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.496272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.496273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.496275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.496277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.496279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.496280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.496282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.496284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.496286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.496288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.496289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.496294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.496298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.496302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.496307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.496311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.496316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.496319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.496323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.496332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.496339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.496341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.496345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.496348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.496350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.496355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.496358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.496360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.496363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.496369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.496371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.496374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.496380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.496382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.496384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.496387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.496389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.496391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.496394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.496415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:31.499791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:31.500433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:31.500447Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:31.500448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:31.500450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:31.500455Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1691 [2:7556256014183915436:4257]
2025-10-01T14:12:31.500464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:31.500475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:31.500477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.500479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.500480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.500491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:31.500494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:31.500502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:31.500540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.500545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.500546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.500549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:31.500551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:31.500592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:31.500597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.500603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.500612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.500624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:31.500638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560809741:7187], now have 1 active actors on pipe
2025-10-01T14:12:31.500653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560809394:2446], now have 1 active actors on pipe
2025-10-01T14:12:31.500659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256014183915431:4257]
2025-10-01T14:12:31.500660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256014183915431:4257]
2025-10-01T14:12:31.500661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256014183915431:4257]
2025-10-01T14:12:31.500669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:31.500678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:31.500679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:31.500681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:31.500682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:31.500689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:31.500691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:31.500707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1691
2025-10-01T14:12:31.500716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1691
2025-10-01T14:12:31.500710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256014183915431:4257]
2025-10-01T14:12:31.500720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:31.500722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:31.500748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.500754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.500773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:31.500778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.500780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.500782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:31.500787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.500793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:31.500802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.500939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.500945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.500954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.501012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1692 partition: 0 MaxSeqNo: 45 sessionId: src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0
2025-10-01T14:12:31.501333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a0b2a20-ecf36a76-5d34dce1-dbf5104a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:31.503487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0] Write session: try to update token
2025-10-01T14:12:31.503500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:31.516051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1692 sessionId: src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:31.516045Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:31.516062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:31.516072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256014183915431:4257]
2025-10-01T14:12:31.516115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:31.516118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:31.516288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:31.516425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:31.516559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:31.516702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:31.516891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:31.516924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:31.518719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:31.518967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.518993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.519029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:31.519150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:31.529857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:31.529877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:31.529879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:31.529880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:31.529890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256014183915431:4257]
2025-10-01T14:12:31.529894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256014183915431:4257]
2025-10-01T14:12:31.529898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256014183915431:4257]
2025-10-01T14:12:31.529942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:31.529944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:31.529950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:31.529954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:31.529954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.529956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:31.530073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:31.579174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256016560809752:7971]
2025-10-01T14:12:31.579408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1691, pipe: [1:7556256016560809752:7971]
2025-10-01T14:12:31.661984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:31.668275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.668306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.668442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.668495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.668551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.668604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.668656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.668664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.668724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.668776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.668838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.668895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.668937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.668942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.668999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.669048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.669099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.669154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.669194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.669199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.669249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.669299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.669361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.669413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.669450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.669454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.669505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.669553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.669601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.669650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.669689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.669699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.669756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.669804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.669850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.669899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.669936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.669942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.669994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.670042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.670089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.670138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.670178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.670184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.670234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.670281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.670332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.670405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.670447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.670452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.670502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.670552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.670603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.670650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.670686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.670691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.670797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.670849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.670896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.670943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.670982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.670987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.671024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560809752:7971], now have 1 active actors on pipe
2025-10-01T14:12:31.671227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:31.671235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256016560809752:7971]
2025-10-01T14:12:31.671255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:31.671258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:31.671284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1692 reason: error at write: Disconnected sessionId: src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0
2025-10-01T14:12:31.671460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1692 sessionId: src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0 is DEAD
2025-10-01T14:12:31.671602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:31.671611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0] Write session will restart in 0.009946s
2025-10-01T14:12:31.671632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0] Write session: Do CDS request
2025-10-01T14:12:31.671637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:31.671723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:31.682843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.682928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:31.682941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1693
2025-10-01T14:12:31.683063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.683093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:31.683102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:31.683105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:31.683465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1693 sessionId:  describe result for acl check
2025-10-01T14:12:31.683492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:31.683499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:31.683501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:31.683505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256016560810011:7181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:31.683959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256016560810011:7181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:31.685846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256016560810011:7181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:31.685866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:31.687700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:31.687885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:31.687898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:31.687908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:31.687960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:31.687995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256014183915712:4264]
2025-10-01T14:12:31.688363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256016560810011:7181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:31.688374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256016560810011:7181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:31.688379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256016560810011:7181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:31.688385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:31.688406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:31.688584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:31.688612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:31.688813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:31.688848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.688852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.688853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.688854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.688854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.688855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.688856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.688856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.688857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.688857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.688858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.688858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.688859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.688860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.688862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.688868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.688870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.688872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.688874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.688877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.688878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.688880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.688883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.688885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.688887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.688888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.688890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.688892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.688897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.688901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.688905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.688908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.688911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.688914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.688916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.688919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.688921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.688924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.688926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.688929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.688931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.688933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.688936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.688938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.688940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.688943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.688949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.688952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.688954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.688957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.688959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.688962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.688964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.688968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.688970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.688974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.688995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:31.692324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:31.692903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:31.692916Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:31.692918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:31.692921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:31.692927Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1692 [2:7556256014183915712:4264]
2025-10-01T14:12:31.692940Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:31.692958Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:31.692963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.692965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.692968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.692981Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:31.692986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:31.692992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:31.693031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.693038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.693040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.693042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:31.693045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:31.693101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:31.693107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.693118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.693129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.693148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:31.693166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560810103:7181], now have 1 active actors on pipe
2025-10-01T14:12:31.693173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560809755:2446], now have 1 active actors on pipe
2025-10-01T14:12:31.693179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256014183915707:4264]
2025-10-01T14:12:31.693181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256014183915707:4264]
2025-10-01T14:12:31.693184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256014183915707:4264]
2025-10-01T14:12:31.693195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:31.693200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:31.693203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:31.693204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:31.693209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:31.693193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1692
2025-10-01T14:12:31.693217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:31.693224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:31.693195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1692
2025-10-01T14:12:31.693254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.693263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.693280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256014183915707:4264]
2025-10-01T14:12:31.693290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:31.693293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:31.693309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c04cd773-389c9682-946063e6-139158f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:31.693319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.693325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.693327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:31.693335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.693348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:31.693373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.693529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.693538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.693551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.693630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1693 partition: 0 MaxSeqNo: 45 sessionId: src_id|c04cd773-389c9682-946063e6-139158f4_0
2025-10-01T14:12:31.693947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e14f2f91-8ba2a973-1462224e-4c9b9d61_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c04cd773-389c9682-946063e6-139158f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:31.696350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04cd773-389c9682-946063e6-139158f4_0] Write session: try to update token
2025-10-01T14:12:31.696364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04cd773-389c9682-946063e6-139158f4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:31.709028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1693 sessionId: src_id|c04cd773-389c9682-946063e6-139158f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:31.711266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:31.711565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.711584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.713262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:31.713278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:31.713280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:31.713282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:31.713290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256014183915707:4264]
2025-10-01T14:12:31.713295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256014183915707:4264]
2025-10-01T14:12:31.713298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256014183915707:4264]
2025-10-01T14:12:31.713336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:31.713338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:31.713341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:31.713344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:31.713353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:31.713357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.713359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:31.713420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:31.713480Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:31.771191Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256016560810114:7971]
2025-10-01T14:12:31.771474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1692, pipe: [1:7556256016560810114:7971]
2025-10-01T14:12:31.847026Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:31.853871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.853895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.854028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.854083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.854137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.854190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.854229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.854236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.854295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.854347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.854424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.854576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.854620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.854627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.854687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.854743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.854804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.854860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.854899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.854906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.854966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.855026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.855083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.855141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.855182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.855189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.855249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.855304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.855358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.855416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.855460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.855467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.855530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.855585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.855649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.855713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.855756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.855764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.855825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.855880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.855938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.855999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.856040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.856047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.856107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.856163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.856221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.856282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.856330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.856337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.856401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.856461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.856521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.856583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.856625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.856631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.856703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:31.856761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:31.856824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:31.856890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:31.856931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:31.856938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:31.856984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560810114:7971], now have 1 active actors on pipe
2025-10-01T14:12:31.857195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:31.857206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:31.857230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1693 reason: error at write: Disconnected sessionId: src_id|c04cd773-389c9682-946063e6-139158f4_0
2025-10-01T14:12:31.857231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256016560810114:7971]
2025-10-01T14:12:31.857258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:31.857429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1693 sessionId: src_id|c04cd773-389c9682-946063e6-139158f4_0 is DEAD
2025-10-01T14:12:31.857552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04cd773-389c9682-946063e6-139158f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:31.857563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04cd773-389c9682-946063e6-139158f4_0] Write session will restart in 0.005004s
2025-10-01T14:12:31.857587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04cd773-389c9682-946063e6-139158f4_0] Write session: Do CDS request
2025-10-01T14:12:31.857593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04cd773-389c9682-946063e6-139158f4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:31.857740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:31.863920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c04cd773-389c9682-946063e6-139158f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.864034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:31.864055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1694
2025-10-01T14:12:31.864188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:31.864234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:31.864249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:31.864260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:31.864721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1694 sessionId:  describe result for acl check
2025-10-01T14:12:31.864779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:31.864788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:31.864791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:31.864798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256016560810158:7171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:31.865209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256016560810158:7171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:31.868220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256016560810158:7171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:31.871703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256016560810158:7171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:31.871715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256016560810158:7171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:31.871718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256016560810158:7171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:31.871727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:31.874632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:31.876656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:31.876795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:31.876804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:31.876811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:31.876841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:31.876868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256014183915988:4258]
2025-10-01T14:12:31.877274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:31.877555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:31.877583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:31.877779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:31.877816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.877819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.877820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.877822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.877822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.877823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.877823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.877824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.877825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.877825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.877826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.877827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.877827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.877828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.877831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.877837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.877839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.877841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.877843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.877845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.877847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.877849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.877852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.877854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.877856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.877858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.877860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.877862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.877867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.877871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:31.877875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.877878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:31.877882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.877885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:31.877887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.877890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:31.877892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.877896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:31.877898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.877900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:31.877903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.877906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:31.877908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.877911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:31.877914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.877917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:31.877919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.877922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.877924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.877927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.877929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.877932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.877934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.877937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:31.877940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.877942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:31.877962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:31.881302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:31.881827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:31.881841Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:31.881843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:31.881846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:31.881852Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1693 [2:7556256014183915988:4258]
2025-10-01T14:12:31.881862Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:31.881876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:31.881881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.881884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.881885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.881895Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:31.881898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:31.881907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:31.881946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.881951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.881952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.881955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:31.881956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:31.882014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:31.882019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.882026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:31.882031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:31.882039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:31.882054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256014183915983:4258]
2025-10-01T14:12:31.882059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256014183915983:4258]
2025-10-01T14:12:31.882060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256014183915983:4258]
2025-10-01T14:12:31.882066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:31.882076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:31.882078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:31.882085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:31.882086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:31.882087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:31.882088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:31.882094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560810407:7171], now have 1 active actors on pipe
2025-10-01T14:12:31.882096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560810119:2446], now have 1 active actors on pipe
2025-10-01T14:12:31.882113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256014183915983:4258]
2025-10-01T14:12:31.882120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:31.882130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:31.882180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1693
2025-10-01T14:12:31.882242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1693
2025-10-01T14:12:31.882297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.882313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.882336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:31.882347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:31.882356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:31.882359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:31.882388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:31.882404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:31.882420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.882611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.882620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.882636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:31.882723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1694 partition: 0 MaxSeqNo: 45 sessionId: src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0
2025-10-01T14:12:31.883074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c04cd773-389c9682-946063e6-139158f4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:31.885501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0] Write session: try to update token
2025-10-01T14:12:31.885521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:31.892717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:31.892736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:31.892745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256014183915983:4258]
2025-10-01T14:12:31.892790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:31.892789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:31.892973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:31.893085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:31.893208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:31.893351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:31.893564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:31.893595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:31.898446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1694 sessionId: src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:31.900677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:31.900846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:31.900871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:31.900902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:31.900976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:31.911293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:31.911317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:31.911320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:31.911322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:31.911332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256014183915983:4258]
2025-10-01T14:12:31.911335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256014183915983:4258]
2025-10-01T14:12:31.911340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256014183915983:4258]
2025-10-01T14:12:31.911366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:31.911376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:31.911378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:31.911381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:31.911388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:31.911390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:31.911512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:31.957534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256016560810479:7971]
2025-10-01T14:12:31.957770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1693, pipe: [1:7556256016560810479:7971]
2025-10-01T14:12:32.047374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:32.054100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.054125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.054260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.054311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.054363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.054439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.054480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.054489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.054545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.054600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.054652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.054707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.054748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.054754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.054814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.054868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.054923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.054978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.055018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.055023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.055076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.055131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.055186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.055239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.055278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.055286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.055340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.055388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.055438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.055490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.055529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.055534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.055586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.055636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.055684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.055734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.055775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.055779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.055832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.055881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.055933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.055984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.056023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.056026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.056083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.056135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.056188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.056240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.056279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.056284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.056338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.056388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.056439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.056493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.056531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.056537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.056591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.056652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.056703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.056752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.056795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.056800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.056840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256016560810479:7971], now have 1 active actors on pipe
2025-10-01T14:12:32.057015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:32.057026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:32.057047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1694 reason: error at write: Disconnected sessionId: src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0
2025-10-01T14:12:32.057203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1694 sessionId: src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0 is DEAD
2025-10-01T14:12:32.057355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:32.057361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0] Write session will restart in 0.009340s
2025-10-01T14:12:32.057356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256016560810479:7971]
2025-10-01T14:12:32.057378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0] Write session: Do CDS request
2025-10-01T14:12:32.057393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:32.057396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:32.057806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:32.067786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.067878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:32.067890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1695
2025-10-01T14:12:32.068205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.068237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:32.068245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:32.068248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:32.068592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1695 sessionId:  describe result for acl check
2025-10-01T14:12:32.068622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:32.068628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:32.068629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:32.068633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256020855777998:7154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:32.069082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256020855777998:7154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:32.071083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256020855777998:7154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:32.073202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:32.073315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256020855777998:7154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:32.073326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256020855777998:7154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:32.073329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256020855777998:7154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:32.073335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:32.075112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:32.075255Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:32.075264Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:32.075275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:32.075316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:32.075351Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256018478883570:4260]
2025-10-01T14:12:32.075707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:32.075907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:32.075932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:32.076129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:32.076162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.076167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.076167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.076168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.076169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.076169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.076170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.076170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.076171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.076172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.076172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.076173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.076173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.076174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.076176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.076182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.076184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.076186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.076188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.076190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.076192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.076194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.076196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.076198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.076200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.076202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.076204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.076206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.076210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.076215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.076219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.076222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.076225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.076230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.076234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.076238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.076246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.076255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.076260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.076263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.076266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.076268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.076270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.076273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.076276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.076279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.076287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.076292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.076300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.076305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.076312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.076315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.076321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.076323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.076326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.076330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.076348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:32.079749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:32.080368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:32.080384Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:32.080386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:32.080390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:32.080396Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1694 [2:7556256018478883570:4260]
2025-10-01T14:12:32.080410Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:32.080427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:32.080430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.080433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.080435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.080449Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:32.080459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:32.080465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:32.080516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.080524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.080526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.080529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:32.080531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:32.080593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:32.080600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.080611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.080624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.080653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:32.080678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855778149:7154], now have 1 active actors on pipe
2025-10-01T14:12:32.080681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855777791:2446], now have 1 active actors on pipe
2025-10-01T14:12:32.080688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256018478883564:4260]
2025-10-01T14:12:32.080693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256018478883564:4260]
2025-10-01T14:12:32.080695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256018478883564:4260]
2025-10-01T14:12:32.080707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:32.080723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:32.080726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:32.080728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:32.080730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:32.080740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:32.080748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:32.080771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256018478883564:4260]
2025-10-01T14:12:32.080782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:32.080774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1694
2025-10-01T14:12:32.080795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:32.080774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1694
2025-10-01T14:12:32.080824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.080832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.080855Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:32.080864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.080868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.080870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:32.080878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.080886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:32.080900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.081036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.081047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.081065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.081139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1695 partition: 0 MaxSeqNo: 45 sessionId: src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0
2025-10-01T14:12:32.081469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2471544a-6c34c871-458c7bd1-f3fa3a2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:32.083820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0] Write session: try to update token
2025-10-01T14:12:32.083841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:32.096154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:32.096172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:32.096180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256018478883564:4260]
2025-10-01T14:12:32.096215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:32.096217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:32.096374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:32.096524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:32.096659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:32.096791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:32.096915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1695 sessionId: src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:32.096970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:32.097007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:32.099246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:32.099429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.099448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.099480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:32.099550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:32.109018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:32.109037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:32.109038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:32.109040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:32.109047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256018478883564:4260]
2025-10-01T14:12:32.109049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256018478883564:4260]
2025-10-01T14:12:32.109052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256018478883564:4260]
2025-10-01T14:12:32.109085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:32.109088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:32.109092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:32.109094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.109095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:32.109097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:32.109219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:32.157733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256020855778164:7971]
2025-10-01T14:12:32.157992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1694, pipe: [1:7556256020855778164:7971]
2025-10-01T14:12:32.243299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:32.250139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.250166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.250306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.250358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.250433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.250486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.250525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.250533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.250591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.250643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.250697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.250750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.250791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.250799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.250870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.250925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.250980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.251036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.251075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.251081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.251139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.251194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.251250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.251306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.251347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.251352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.251408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.251459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.251518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.251572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.251613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.251619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.251675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.251729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.251787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.251845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.251883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.251889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.251945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.251996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.252049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.252109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.252160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.252165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.252224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.252277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.252329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.252384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.252461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.252467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.252520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.252570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.252621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.252687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.252727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.252732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.252784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.252836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.252888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.252938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.252977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.252983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.253027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855778164:7971], now have 1 active actors on pipe
2025-10-01T14:12:32.253258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256020855778164:7971]
2025-10-01T14:12:32.253287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:32.253317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:32.253326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:32.253347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1695 reason: error at write: Disconnected sessionId: src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0
2025-10-01T14:12:32.253498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1695 sessionId: src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0 is DEAD
2025-10-01T14:12:32.253628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:32.253634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0] Write session will restart in 0.006409s
2025-10-01T14:12:32.253653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0] Write session: Do CDS request
2025-10-01T14:12:32.253658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:32.254000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:32.260922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.260992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:32.261004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1696
2025-10-01T14:12:32.261129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.261167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:32.261188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:32.261195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:32.261525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1696 sessionId:  describe result for acl check
2025-10-01T14:12:32.261553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:32.261558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:32.261559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:32.261564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256020855778299:7150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:32.262029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256020855778299:7150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:32.264636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256020855778299:7150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:32.267219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256020855778299:7150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:32.267233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256020855778299:7150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:32.267236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256020855778299:7150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:32.267242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:32.267701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:32.269459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:32.269581Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:32.269588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:32.269595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:32.269624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:32.269652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256018478883860:4252]
2025-10-01T14:12:32.270027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:32.270208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:32.270241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:32.270503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:32.270539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.270544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.270545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.270545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.270546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.270547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.270547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.270548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.270549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.270549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.270550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.270551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.270551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.270552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.270555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.270561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.270563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.270565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.270567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.270569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.270571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.270573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.270575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.270578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.270580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.270581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.270583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.270585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.270591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.270595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.270598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.270601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.270603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.270606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.270608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.270615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.270618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.270620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.270626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.270629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.270632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.270638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.270640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.270644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.270649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.270652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.270654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.270657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.270659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.270662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.270667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.270670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.270673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.270676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.270681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.270684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.270704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:32.274076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:32.274743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:32.274758Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:32.274759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:32.274762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:32.274767Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1695 [2:7556256018478883860:4252]
2025-10-01T14:12:32.274778Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:32.274790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:32.274791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.274793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.274795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.274806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:32.274813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:32.274818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:32.274860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.274865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.274867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.274869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:32.274871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:32.274931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:32.274938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.274949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.274965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.274983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:32.275005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855778166:2446], now have 1 active actors on pipe
2025-10-01T14:12:32.275018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855778515:7150], now have 1 active actors on pipe
2025-10-01T14:12:32.275025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256018478883855:4252]
2025-10-01T14:12:32.275027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256018478883855:4252]
2025-10-01T14:12:32.275029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256018478883855:4252]
2025-10-01T14:12:32.275044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:32.275058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:32.275059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:32.275062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:32.275064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:32.275071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:32.275047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1695
2025-10-01T14:12:32.275073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:32.275054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1695
2025-10-01T14:12:32.275094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256018478883855:4252]
2025-10-01T14:12:32.275100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:32.275103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:32.275124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.275131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.275152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:32.275161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.275167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.275169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:32.275176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.275185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:32.275200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.275312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.275318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.275328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.275393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1696 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0
2025-10-01T14:12:32.275732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9c7736f-b3c1637e-17f68812-5aaa7764_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:32.277927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0] Write session: try to update token
2025-10-01T14:12:32.277940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:32.289353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1696 sessionId: src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:32.291338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:32.291544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.291568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.291605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:32.291670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:32.293710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:32.293731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:32.293733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:32.293735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:32.293745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256018478883855:4252]
2025-10-01T14:12:32.293749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256018478883855:4252]
2025-10-01T14:12:32.293752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256018478883855:4252]
2025-10-01T14:12:32.293782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:32.293787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:32.293793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.293794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:32.293794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:32.293796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:32.293911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:32.353314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256020855778541:7971]
2025-10-01T14:12:32.353548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1695, pipe: [1:7556256020855778541:7971]
2025-10-01T14:12:32.426534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:32.439951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.439978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.440123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.440181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.440238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.440438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.440551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.440559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.440620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.440820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.440880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.440945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.440991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.440996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.441162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.441351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.441543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.441736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.441776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.441782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.441839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.441892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.441948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.441999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.442038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.442043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.442102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.442153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.442211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.442263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.442302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.442309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.442391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.442450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.442520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.442715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.442768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.442776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.442838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.442896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.442957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.443016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.443129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.443138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.443220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.443294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.443537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.443782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.443901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.443906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.444093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.444279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.444464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.444669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.444774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.444780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.444969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:32.445156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:32.445215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:32.445270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:32.445309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:32.445315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:32.445368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855778541:7971], now have 1 active actors on pipe
2025-10-01T14:12:32.445582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:32.445605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256020855778541:7971]
2025-10-01T14:12:32.445617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:32.445619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:32.445640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1696 reason: error at write: Disconnected sessionId: src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0
2025-10-01T14:12:32.445785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1696 sessionId: src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0 is DEAD
2025-10-01T14:12:32.445910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:32.445920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0] Write session will restart in 0.006445s
2025-10-01T14:12:32.445944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0] Write session: Do CDS request
2025-10-01T14:12:32.445950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:32.446480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:32.453853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.453888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:32.453901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1697
2025-10-01T14:12:32.454055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.454083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:32.454092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:32.454095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:32.454515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1697 sessionId:  describe result for acl check
2025-10-01T14:12:32.454552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:32.454558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:32.454560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:32.454565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256020855778684:7142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:32.455057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256020855778684:7142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:32.457093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256020855778684:7142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:32.459400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256020855778684:7142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:32.459408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256020855778684:7142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:32.459411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256020855778684:7142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:32.459416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:32.461368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:32.463994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:32.464164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:32.464172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:32.464181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:32.464219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:32.464252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256018478884167:4235]
2025-10-01T14:12:32.464617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:32.464808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:32.464833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:32.465015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:32.465047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.465051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.465052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.465052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.465053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.465054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.465054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.465055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.465055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.465056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.465057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.465057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.465058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.465058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.465061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.465067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.465069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.465072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.465074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.465076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.465078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.465080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.465082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.465084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.465086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.465088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.465090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.465092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.465097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.465102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.465105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.465108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.465111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.465113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.465115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.465118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.465121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.465123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.465128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.465130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.465137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.465140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.465142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.465148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.465150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.465153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.465155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.465158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.465164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.465167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.465169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.465172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.465175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.465178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.465180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.465184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.465204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:32.468367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:32.469061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:32.469074Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:32.469075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:32.469078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:32.469085Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1696 [2:7556256018478884167:4235]
2025-10-01T14:12:32.469097Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:32.469114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:32.469120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.469123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.469125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.469138Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:32.469148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:32.469152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:32.469193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.469200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.469202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.469205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:32.469208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:32.469263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:32.469269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.469280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.469295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.469315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:32.469330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855778871:7142], now have 1 active actors on pipe
2025-10-01T14:12:32.469338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855778548:2446], now have 1 active actors on pipe
2025-10-01T14:12:32.469345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256018478884162:4235]
2025-10-01T14:12:32.469347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256018478884162:4235]
2025-10-01T14:12:32.469349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256018478884162:4235]
2025-10-01T14:12:32.469361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:32.469352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1696
2025-10-01T14:12:32.469370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:32.469376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:32.469378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:32.469379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:32.469353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1696
2025-10-01T14:12:32.469388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:32.469392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:32.469420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.469429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.469440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256018478884162:4235]
2025-10-01T14:12:32.469447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:32.469455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:32.469473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:32.469483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.469490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.469492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:32.469503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.469514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:32.469536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.469646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.469652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.469665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.469738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1697 partition: 0 MaxSeqNo: 45 sessionId: src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0
2025-10-01T14:12:32.470016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9598831-af991412-7ae44d1b-c3ab5dc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:32.472299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0] Write session: try to update token
2025-10-01T14:12:32.472311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:32.489054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:32.489079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:32.489082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:32.489083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:32.489094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256018478884162:4235]
2025-10-01T14:12:32.489099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256018478884162:4235]
2025-10-01T14:12:32.489103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256018478884162:4235]
2025-10-01T14:12:32.489142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:32.489155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:32.489156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:32.489157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:32.489162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.489165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:32.489301Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:32.490958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1697 sessionId: src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:32.493220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:32.545831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256020855778915:7971]
2025-10-01T14:12:32.546074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1696, pipe: [1:7556256020855778915:7971]
2025-10-01T14:12:32.625574Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:32.625799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.625815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.625851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855778915:7971], now have 1 active actors on pipe
2025-10-01T14:12:32.625998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:32.626079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:32.626091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:32.626101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:32.626147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256020855778915:7971]
2025-10-01T14:12:32.626149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1697 reason: error at write: Disconnected sessionId: src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0
2025-10-01T14:12:32.626366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1697 sessionId: src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0 is DEAD
2025-10-01T14:12:32.626530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:32.626539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0] Write session will restart in 0.007772s
2025-10-01T14:12:32.626559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0] Write session: Do CDS request
2025-10-01T14:12:32.626563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:32.635863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.635933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:32.635945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1698
2025-10-01T14:12:32.636057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.636087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:32.636096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:32.636098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:32.636483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1698 sessionId:  describe result for acl check
2025-10-01T14:12:32.636517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:32.636523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:32.636525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:32.636531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256020855779082:7127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:32.637052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256020855779082:7127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:32.639015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256020855779082:7127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:32.641601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256020855779082:7127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:32.641614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256020855779082:7127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:32.641617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256020855779082:7127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:32.641624Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:32.642515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:32.644543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:32.644766Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:32.644778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:32.644791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:32.644853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:32.644894Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256018478884448:4230]
2025-10-01T14:12:32.645455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:32.645740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:32.645799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:32.646102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:32.646183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.646190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.646191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.646192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.646193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.646194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.646195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.646196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.646197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.646199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.646200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.646201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.646203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.646204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.646210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.646220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.646223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.646227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.646230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.646233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.646236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.646239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.646243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.646251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.646254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.646262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.646266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.646273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.646282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.646293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.646303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.646312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.646320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.646329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.646338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.646346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.646358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.646363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.646387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.646392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.646399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.646408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.646416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.646420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.646429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.646438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.646445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.646450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.646459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.646468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.646476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.646482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.646490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.646499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.646509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.646518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.646560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:32.650286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:32.650955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:32.650972Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:32.650975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:32.650979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:32.650986Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1697 [2:7556256018478884448:4230]
2025-10-01T14:12:32.651002Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:32.651022Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:32.651029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.651033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.651036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.651053Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:32.651062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:32.651069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:32.651126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.651134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.651136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.651139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:32.651142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:32.651209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:32.651219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.651230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.651241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.651257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:32.651284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855779268:7127], now have 1 active actors on pipe
2025-10-01T14:12:32.651287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855778917:2446], now have 1 active actors on pipe
2025-10-01T14:12:32.651293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256018478884443:4230]
2025-10-01T14:12:32.651294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256018478884443:4230]
2025-10-01T14:12:32.651297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256018478884443:4230]
2025-10-01T14:12:32.651307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:32.651321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:32.651333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:32.651339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:32.651346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:32.651364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:32.651361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1697
2025-10-01T14:12:32.651367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256018478884443:4230]
2025-10-01T14:12:32.651369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:32.651378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:32.651386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:32.651419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1697
2025-10-01T14:12:32.651484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.651491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.651509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:32.651517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.651520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.651521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:32.651528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.651538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:32.651553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.651996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.652010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.652026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.652139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1698 partition: 0 MaxSeqNo: 45 sessionId: src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0
2025-10-01T14:12:32.652437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4be8bda2-a10a19d-a5874a15-e68bdf84_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:32.654606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0] Write session: try to update token
2025-10-01T14:12:32.654620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:32.670087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1698 sessionId: src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:32.670648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:32.670671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:32.670674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:32.670675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:32.670684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256018478884443:4230]
2025-10-01T14:12:32.670689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256018478884443:4230]
2025-10-01T14:12:32.670693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256018478884443:4230]
2025-10-01T14:12:32.670733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:32.670740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:32.670746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.670746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:32.670748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:32.670749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:32.670869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:32.672124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:32.726577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256020855779282:7971]
2025-10-01T14:12:32.726819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1697, pipe: [1:7556256020855779282:7971]
2025-10-01T14:12:32.811211Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:32.811895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.811912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.811952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855779282:7971], now have 1 active actors on pipe
2025-10-01T14:12:32.812170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256020855779282:7971]
2025-10-01T14:12:32.812185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:32.812189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:32.812199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:32.812247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1698 reason: error at write: Disconnected sessionId: src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0
2025-10-01T14:12:32.812346Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:32.812452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1698 sessionId: src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0 is DEAD
2025-10-01T14:12:32.812585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:32.812591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0] Write session will restart in 0.005747s
2025-10-01T14:12:32.812610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0] Write session: Do CDS request
2025-10-01T14:12:32.812614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:32.819843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.819934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:32.819947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1699
2025-10-01T14:12:32.820076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:32.820111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:32.820120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:32.820123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:32.820412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1699 sessionId:  describe result for acl check
2025-10-01T14:12:32.820436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:32.820440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:32.820441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:32.820444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256020855779377:7130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:32.820924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256020855779377:7130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:32.822659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256020855779377:7130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:32.825776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256020855779377:7130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:32.825790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256020855779377:7130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:32.825795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256020855779377:7130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:32.825802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:32.827921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:32.829665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:32.829818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:32.829827Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:32.829835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:32.829864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:32.829890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256018478884728:4228]
2025-10-01T14:12:32.830266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:32.830552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:32.830604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:32.830910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:32.830965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.830971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.830971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.830972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.830973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.830974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.830975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.830976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.830977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.830978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.830979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.830980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.830980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.830981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.830986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.830995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.830998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.831001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.831004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.831007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.831010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.831013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.831016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.831020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.831023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.831026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.831029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.831032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.831038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.831045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:32.831050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.831054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:32.831058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.831063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:32.831066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.831070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:32.831075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.831079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:32.831085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.831089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:32.831093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.831097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:32.831100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.831104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:32.831108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.831113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:32.831116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.831120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.831123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.831127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.831130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.831134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.831137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.831141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:32.831145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.831148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:32.831180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:32.834661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:32.835245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:32.835262Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:32.835265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:32.835269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:32.835275Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1698 [2:7556256018478884728:4228]
2025-10-01T14:12:32.835290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:32.835311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:32.835319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.835322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.835324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.835343Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:32.835353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:32.835359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:32.835412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.835418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.835420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.835423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:32.835426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:32.835488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:32.835496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.835506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:32.835520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:32.835539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:32.835561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855779613:7130], now have 1 active actors on pipe
2025-10-01T14:12:32.835565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855779285:2446], now have 1 active actors on pipe
2025-10-01T14:12:32.835573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256018478884723:4228]
2025-10-01T14:12:32.835580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256018478884723:4228]
2025-10-01T14:12:32.835582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256018478884723:4228]
2025-10-01T14:12:32.835598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:32.835614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:32.835615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:32.835623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:32.835626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:32.835629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:32.835632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:32.835664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256018478884723:4228]
2025-10-01T14:12:32.835677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:32.835664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1698
2025-10-01T14:12:32.835694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:32.835666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1698
2025-10-01T14:12:32.835708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.835717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.835748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7cb1d62-cea103c9-da307f30-d473646_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:32.835758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:32.835767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:32.835770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:32.835779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:32.835791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:32.835813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.835953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.835962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.835976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:32.836045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1699 partition: 0 MaxSeqNo: 45 sessionId: src_id|e7cb1d62-cea103c9-da307f30-d473646_0
2025-10-01T14:12:32.836400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea96a6c-a8554352-7e747ac7-5819b5b8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e7cb1d62-cea103c9-da307f30-d473646_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:32.838614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cb1d62-cea103c9-da307f30-d473646_0] Write session: try to update token
2025-10-01T14:12:32.838628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cb1d62-cea103c9-da307f30-d473646_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:32.852337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1699 sessionId: src_id|e7cb1d62-cea103c9-da307f30-d473646_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:32.854747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:32.855800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:32.855824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:32.855842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:32.855845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:32.855848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:32.855849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:32.855857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256018478884723:4228]
2025-10-01T14:12:32.855861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256018478884723:4228]
2025-10-01T14:12:32.855865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256018478884723:4228]
2025-10-01T14:12:32.855911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:32.855912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:32.855918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:32.855920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:32.855921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:32.855921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:32.856043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:32.912423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256020855779652:7971]
2025-10-01T14:12:32.912681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1698, pipe: [1:7556256020855779652:7971]
2025-10-01T14:12:32.994899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:32.995577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:32.995633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855779652:7971], now have 1 active actors on pipe
2025-10-01T14:12:32.995718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:32.995772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:32.995803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:32.995810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256020855779652:7971]
2025-10-01T14:12:32.995811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:32.995879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1699 reason: error at write: Disconnected sessionId: src_id|e7cb1d62-cea103c9-da307f30-d473646_0
2025-10-01T14:12:32.996028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1699 sessionId: src_id|e7cb1d62-cea103c9-da307f30-d473646_0 is DEAD
2025-10-01T14:12:32.996110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cb1d62-cea103c9-da307f30-d473646_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:32.996116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cb1d62-cea103c9-da307f30-d473646_0] Write session will restart in 0.007090s
2025-10-01T14:12:32.996134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cb1d62-cea103c9-da307f30-d473646_0] Write session: Do CDS request
2025-10-01T14:12:32.996140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cb1d62-cea103c9-da307f30-d473646_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:33.003868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cb1d62-cea103c9-da307f30-d473646_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.003895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:33.003908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1700
2025-10-01T14:12:33.004143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.004177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:33.004188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:33.004191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:33.004617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1700 sessionId:  describe result for acl check
2025-10-01T14:12:33.004666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:33.004672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:33.004673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:33.004679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256025150747066:7125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:33.005168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256025150747066:7125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:33.007425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256025150747066:7125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:33.010557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256025150747066:7125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:33.010573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256025150747066:7125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:33.010576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256025150747066:7125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:33.010584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:33.012281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:33.014721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:33.014923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:33.014931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:33.014939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:33.014973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:33.015003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256022773852305:4222]
2025-10-01T14:12:33.015384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:33.015632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:33.015657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:33.015841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:33.015877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.015881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.015882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.015882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.015883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.015884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.015884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.015885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.015886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.015887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.015888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.015888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.015889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.015890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.015892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.015898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.015901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.015903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.015905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.015907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.015909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.015912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.015914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.015916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.015918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.015920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.015922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.015925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.015931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.015935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.015939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.015942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.015944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.015947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.015950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.015953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.015955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.015958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.015960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.015963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.015966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.015969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.015971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.015974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.015976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.015979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.015981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.015984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.015986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.015990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.015992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.015995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.015997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.016000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.016002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.016005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.016025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:33.019527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:33.020136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:33.020155Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:33.020158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:33.020162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:33.020169Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1699 [2:7556256022773852305:4222]
2025-10-01T14:12:33.020200Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:33.020220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:33.020227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.020230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.020232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.020248Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:33.020257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:33.020263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:33.020321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.020330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.020333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.020336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:33.020339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:33.020404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:33.020411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.020423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.020435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.020455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:33.020474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150747302:7125], now have 1 active actors on pipe
2025-10-01T14:12:33.020482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256020855779657:2446], now have 1 active actors on pipe
2025-10-01T14:12:33.020489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256022773852300:4222]
2025-10-01T14:12:33.020495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256022773852300:4222]
2025-10-01T14:12:33.020497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256022773852300:4222]
2025-10-01T14:12:33.020509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:33.020519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:33.020525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:33.020526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:33.020528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:33.020538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:33.020541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:33.020533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1699
2025-10-01T14:12:33.020535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1699
2025-10-01T14:12:33.020568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256022773852300:4222]
2025-10-01T14:12:33.020580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:33.020584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:33.020599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.020608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.020680Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18451641-9619a66b-53b6af60-93da1c85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:33.020691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.020695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.020697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:33.020708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.020721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:33.020746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.020869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.020878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.020891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.020966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1700 partition: 0 MaxSeqNo: 45 sessionId: src_id|18451641-9619a66b-53b6af60-93da1c85_0
2025-10-01T14:12:33.021283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7cb1d62-cea103c9-da307f30-d473646_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|18451641-9619a66b-53b6af60-93da1c85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:33.023656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18451641-9619a66b-53b6af60-93da1c85_0] Write session: try to update token
2025-10-01T14:12:33.023671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18451641-9619a66b-53b6af60-93da1c85_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:33.036360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1700 sessionId: src_id|18451641-9619a66b-53b6af60-93da1c85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:33.038512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:33.038636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.038657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.040408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:33.040423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:33.040426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:33.040428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:33.040437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256022773852300:4222]
2025-10-01T14:12:33.040443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256022773852300:4222]
2025-10-01T14:12:33.040449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256022773852300:4222]
2025-10-01T14:12:33.040495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:33.040494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:33.040499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:33.040501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:33.040513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:33.040523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.040530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:33.040567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:33.040668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:33.095705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256025150747329:7971]
2025-10-01T14:12:33.095941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1699, pipe: [1:7556256025150747329:7971]
2025-10-01T14:12:33.179397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:33.185996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.186016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.186148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.186198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.186249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.186301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.186355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.186366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.186445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.186504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.186567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.186636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.186678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.186684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.186745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.186800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.186859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.186921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.186966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.186972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.187024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.187103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.187149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.187195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.187230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.187234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.187283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.187330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.187380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.187432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.187471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.187476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.187524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.187618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.187693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.187766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.187805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.187810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.187885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.187934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.187985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.188034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.188071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.188076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.188127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.188174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.188220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.188305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.188346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.188352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.188436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.188513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.188592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.188656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.188702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.188707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.188760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.188811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.188862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.188912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.188948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.188953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.188992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150747329:7971], now have 1 active actors on pipe
2025-10-01T14:12:33.189211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256025150747329:7971]
2025-10-01T14:12:33.189237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:33.189655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:33.189663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:33.189681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1700 reason: error at write: Disconnected sessionId: src_id|18451641-9619a66b-53b6af60-93da1c85_0
2025-10-01T14:12:33.189885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1700 sessionId: src_id|18451641-9619a66b-53b6af60-93da1c85_0 is DEAD
2025-10-01T14:12:33.189979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18451641-9619a66b-53b6af60-93da1c85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:33.189987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18451641-9619a66b-53b6af60-93da1c85_0] Write session will restart in 0.009461s
2025-10-01T14:12:33.190005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18451641-9619a66b-53b6af60-93da1c85_0] Write session: Do CDS request
2025-10-01T14:12:33.190011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18451641-9619a66b-53b6af60-93da1c85_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:33.190003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:33.200893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18451641-9619a66b-53b6af60-93da1c85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.200952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:33.200963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1701
2025-10-01T14:12:33.201117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.201155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:33.201177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:33.201184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:33.201580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1701 sessionId:  describe result for acl check
2025-10-01T14:12:33.201615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:33.201617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:33.201619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:33.201624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256025150747589:7109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:33.202107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256025150747589:7109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:33.204000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256025150747589:7109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:33.204825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:33.206627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:33.206795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:33.206807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:33.206817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:33.206861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:33.206895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256022773852607:4215]
2025-10-01T14:12:33.206925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256025150747589:7109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:33.206936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256025150747589:7109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:33.206938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256025150747589:7109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:33.206943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:33.207485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:33.207694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:33.207730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:33.208018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:33.208063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.208069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.208070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.208071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.208072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.208073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.208075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.208076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.208077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.208078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.208079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.208080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.208082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.208083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.208087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.208098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.208102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.208106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.208110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.208115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.208123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.208131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.208141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.208149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.208157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.208165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.208169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.208176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.208183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.208194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.208203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.208209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.208217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.208222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.208231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.208236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.208244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.208249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.208258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.208263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.208271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.208277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.208281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.208286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.208294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.208299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.208307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.208316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.208324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.208330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.208338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.208343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.208351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.208357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.208365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.208370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.208413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:33.211701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:33.212567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:33.212582Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:33.212584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:33.212589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:33.212595Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1700 [2:7556256022773852607:4215]
2025-10-01T14:12:33.212608Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:33.212628Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:33.212635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.212638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.212651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.212665Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:33.212671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:33.212677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:33.212727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.212734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.212736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.212739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:33.212741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:33.212801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:33.212810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.212822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.212834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.212851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:33.212871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150747343:2446], now have 1 active actors on pipe
2025-10-01T14:12:33.212879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150747696:7109], now have 1 active actors on pipe
2025-10-01T14:12:33.212887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256022773852602:4215]
2025-10-01T14:12:33.212893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256022773852602:4215]
2025-10-01T14:12:33.212894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256022773852602:4215]
2025-10-01T14:12:33.212909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:33.212922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:33.212927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1700
2025-10-01T14:12:33.212931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1700
2025-10-01T14:12:33.212931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:33.212937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:33.212939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:33.212940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:33.212942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:33.212963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256022773852602:4215]
2025-10-01T14:12:33.212966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:33.212968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:33.212985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.212990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.213034Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:33.213046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.213050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.213052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:33.213060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.213069Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:33.213090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.213224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.213232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.213247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.213328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1701 partition: 0 MaxSeqNo: 45 sessionId: src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0
2025-10-01T14:12:33.213652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18451641-9619a66b-53b6af60-93da1c85_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:33.215851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0] Write session: try to update token
2025-10-01T14:12:33.215865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:33.229037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1701 sessionId: src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:33.231218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:33.232773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.232799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.232821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:33.232825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:33.232827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:33.232830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:33.232839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256022773852602:4215]
2025-10-01T14:12:33.232848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256022773852602:4215]
2025-10-01T14:12:33.232852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256022773852602:4215]
2025-10-01T14:12:33.232886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:33.232896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:33.232900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:33.232907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:33.232918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.232925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:33.233061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:33.289217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256025150747708:7971]
2025-10-01T14:12:33.289465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1700, pipe: [1:7556256025150747708:7971]
2025-10-01T14:12:33.387132Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:33.387591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:33.387651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150747708:7971], now have 1 active actors on pipe
2025-10-01T14:12:33.387717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:33.387819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:33.387878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256025150747708:7971]
2025-10-01T14:12:33.387892Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:12:33.388126Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 17 consumer shared/user session shared/user_1_17_12045885967793899549_v1 is DEAD
2025-10-01T14:12:33.388252Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:12:33.388254Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255939251368849:7974] disconnected; active server actors: 1
2025-10-01T14:12:33.388261Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556255939251368849:7974] client user disconnected session shared/user_1_17_12045885967793899549_v1
2025-10-01T14:12:33.388371Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:12:33.388377Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:12:33.388393Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.005744s
2025-10-01T14:12:33.394726Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:12:33.394925Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:12:33.394933Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 18
2025-10-01T14:12:33.395061Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 18 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:12:33.395094Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:12:33.395185Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 auth for : user
2025-10-01T14:12:33.395305Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 Handle describe topics response
2025-10-01T14:12:33.395326Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 auth is DEAD
2025-10-01T14:12:33.395340Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:12:33.395558Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:12:33.395621Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256025150747774:7100] connected; active server actors: 1
2025-10-01T14:12:33.395635Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256025150747774:7100] session shared/user_1_18_3064411298515694733_v1
2025-10-01T14:12:33.395644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:12:33.395647Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_18_3064411298515694733_v1
2025-10-01T14:12:33.395650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:12:33.395656Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_18_3064411298515694733_v1" (Sender=[1:7556256025150747755:7100], Pipe=[1:7556256025150747774:7100], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:12:33.395660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:12:33.395669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:12:33.395678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_18_3064411298515694733_v1" (Sender=[1:7556256025150747755:7100], Pipe=[1:7556256025150747774:7100], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:12:33.395692Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_18_3064411298515694733_v1" sender [1:7556256025150747755:7100] lock partition 0 for ReadingSession "shared/user_1_18_3064411298515694733_v1" (Sender=[1:7556256025150747755:7100], Pipe=[1:7556256025150747774:7100], Partitions=[], ActiveFamilyCount=1) generation 1 step 18
2025-10-01T14:12:33.395701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:12:33.395705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-01T14:12:33.395906Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 18 Session: "shared/user_1_18_3064411298515694733_v1" ClientId: "user" PipeClient { RawX1: 7556256025150747774 RawX2: 4503603922344892 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:12:33.395925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:12:33.396976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:33.396991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:33.397017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1701 reason: error at write: Disconnected sessionId: src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0
2025-10-01T14:12:33.397122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1701 sessionId: src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0 is DEAD
2025-10-01T14:12:33.397215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:33.397219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0] Write session will restart in 0.007277s
2025-10-01T14:12:33.397235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0] Write session: Do CDS request
2025-10-01T14:12:33.397251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:33.405819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.405882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:33.405895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1702
2025-10-01T14:12:33.405990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.406019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:33.406027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:33.406030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:33.406341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1702 sessionId:  describe result for acl check
2025-10-01T14:12:33.406379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:33.406384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:33.406385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:33.406388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256025150748050:7094] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:33.406738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256025150748050:7094] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:33.407659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:33.408995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256025150748050:7094] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:33.409625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:33.409740Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:33.409748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:33.409755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:33.409784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:33.409811Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256022773852905:4203]
2025-10-01T14:12:33.410198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:33.410403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:33.410433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:33.410617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:33.410651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.410657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.410658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.410658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.410659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.410660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.410660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.410661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.410661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.410662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.410663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.410663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.410664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.410664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.410667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.410673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.410675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.410677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.410680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.410682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.410684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.410686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.410688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.410690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.410693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.410695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.410697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.410699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.410704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.410709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.410713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.410716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.410718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.410721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.410724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.410727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.410729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.410732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.410734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.410737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.410739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.410743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.410745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.410748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.410750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.410753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.410756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.410759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.410761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.410764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.410766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.410769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.410773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.410778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.410782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.410786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.410817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:33.411103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256025150748050:7094] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:33.411114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256025150748050:7094] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:33.411117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256025150748050:7094] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:33.411123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:33.414142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:33.414866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:33.414878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:33.414879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:33.414881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:33.414886Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1701 [2:7556256022773852905:4203]
2025-10-01T14:12:33.414894Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:33.414905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:33.414906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.414909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.414910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.414922Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:33.414925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:33.414929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:33.414959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.414963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.414964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.414966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:33.414968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:33.415009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:33.415014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.415020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.415026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.415038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:33.415054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150747724:2446], now have 1 active actors on pipe
2025-10-01T14:12:33.415059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150748090:7094], now have 1 active actors on pipe
2025-10-01T14:12:33.415061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150747780:7092], now have 1 active actors on pipe
2025-10-01T14:12:33.415066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256022773852900:4203]
2025-10-01T14:12:33.415067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256022773852900:4203]
2025-10-01T14:12:33.415068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256022773852900:4203]
2025-10-01T14:12:33.415081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:33.415093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:33.415102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:33.415104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:33.415105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:33.415110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:33.415112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:33.415120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256022773852900:4203]
2025-10-01T14:12:33.415122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:33.415123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1701
2025-10-01T14:12:33.415145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1701
2025-10-01T14:12:33.415165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1701, pipe: [1:7556256025150747780:7092]
2025-10-01T14:12:33.415141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:33.415183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.415186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.415198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.415199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.415204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_18_3064411298515694733_v1 on pipe: [1:7556256025150747780:7092]
2025-10-01T14:12:33.415224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:33.415229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.415233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.415235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:33.415241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.415249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:33.415253Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_18_3064411298515694733_v1:1 with generation 1701
2025-10-01T14:12:33.415257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.415260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.415262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:33.415273Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_18_3064411298515694733_v1
2025-10-01T14:12:33.415281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.415303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.415322Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:12:33.415445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.415452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.415465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.415537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1702 partition: 0 MaxSeqNo: 45 sessionId: src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0
2025-10-01T14:12:33.415851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e37e6c4-13cd0e53-7b12aba9-7f404e63_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:33.418237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0] Write session: try to update token
2025-10-01T14:12:33.418251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:33.419540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:12:33.419568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:12:33.419575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.419577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.419579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.419585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:12:33.419594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:12:33.419710Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327953415 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:12:33.419726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:12:33.419758Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 sending to client partition status
2025-10-01T14:12:33.425509Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:33.425521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:33.425529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256022773852900:4203]
2025-10-01T14:12:33.425564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:33.425565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:33.425761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:33.425884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:33.426013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:33.426148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:33.426307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:33.426338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:33.431391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1702 sessionId: src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:33.433330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:33.433487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.433507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.433542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:33.433613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:33.443373Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:33.443386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:33.443388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:33.443389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:33.443396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256022773852900:4203]
2025-10-01T14:12:33.443399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256022773852900:4203]
2025-10-01T14:12:33.443401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256022773852900:4203]
2025-10-01T14:12:33.443430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:33.443434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:33.443436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:33.443437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:33.443441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.443442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:33.443555Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:33.573417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:33.580239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.580263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.580399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.580449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.580498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.580554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.580810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.580820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.580876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.580924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.580974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.581030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.581068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.581074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.581139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.581194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.581244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.581293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.581336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.581341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.581393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.581445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.581496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.581545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.581582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.581587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.581642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.581695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.581744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.581797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.581835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.581841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.581891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.581938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.581989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.582039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.582079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.582086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.582138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.582191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.582243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.582291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.582350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.582355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.582426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.582475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.582531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.582586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.582700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.582706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.582762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.582815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.582874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.582925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.582962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.582966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.583019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.583066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.583116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.583171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.583288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.583293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.583566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:33.583586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:33.583589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:33.583609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1702 reason: error at write: Disconnected sessionId: src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0
2025-10-01T14:12:33.583634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256025150747780:7092]
2025-10-01T14:12:33.583792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1702 sessionId: src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0 is DEAD
2025-10-01T14:12:33.583882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:33.583890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0] Write session will restart in 0.007000s
2025-10-01T14:12:33.583907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0] Write session: Do CDS request
2025-10-01T14:12:33.583911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:33.584087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_18_3064411298515694733_v1
2025-10-01T14:12:33.584099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:33.584120Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_18_3064411298515694733_v1
2025-10-01T14:12:33.591826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.591933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:33.591944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1703
2025-10-01T14:12:33.592039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.592067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:33.592076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:33.592079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:33.592444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1703 sessionId:  describe result for acl check
2025-10-01T14:12:33.592476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:33.592481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:33.592484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:33.592488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256025150748274:7089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:33.592946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256025150748274:7089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:33.595369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256025150748274:7089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:33.597400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256025150748274:7089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:33.597409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256025150748274:7089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:33.597411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256025150748274:7089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:33.597416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:33.598129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:33.598432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:33.598598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:33.598606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:33.598617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:33.598660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:33.598693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256022773853211:4180]
2025-10-01T14:12:33.599230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:33.600743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:33.600790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:33.600992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:33.601129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.601134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.601135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.601135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.601136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.601137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.601137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.601138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.601139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.601139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.601140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.601141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.601141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.601142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.601145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.601150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.601152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.601155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.601157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.601159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.601161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.601163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.601165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.601167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.601169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.601171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.601173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.601175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.601181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.601185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.601189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.601192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.601194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.601197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.601199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.601202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.601204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.601207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.601209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.601212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.601214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.601217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.601219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.601222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.601224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.601227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.601229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.601232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.601234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.601237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.601239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.601242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.601244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.601246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.601249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.601251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.601271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:33.604757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:33.605281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:33.605290Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:33.605292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:33.605295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:33.605299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1702 [2:7556256022773853211:4180]
2025-10-01T14:12:33.605308Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:33.605320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:33.605321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.605323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.605325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.605337Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:33.605340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:33.605344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:33.605378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.605383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.605384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.605387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:33.605389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:33.605434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:33.605439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.605446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.605451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.605460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:33.605470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256022773853206:4180]
2025-10-01T14:12:33.605472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256022773853206:4180]
2025-10-01T14:12:33.605473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256022773853206:4180]
2025-10-01T14:12:33.605478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:33.605487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:33.605488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:33.605495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:33.605496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:33.605497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:33.605497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:33.605504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150748464:7089], now have 1 active actors on pipe
2025-10-01T14:12:33.605506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150748109:2446], now have 1 active actors on pipe
2025-10-01T14:12:33.605520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256022773853206:4180]
2025-10-01T14:12:33.605525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:33.605530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:33.605565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1702
2025-10-01T14:12:33.605584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1702
2025-10-01T14:12:33.605612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.605621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.605645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76238fcb-143bca39-1241beef-db6c585a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:33.605650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.605656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.605658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:33.605663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.605669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:33.605681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.605835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.605847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.605867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.605936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1703 partition: 0 MaxSeqNo: 45 sessionId: src_id|76238fcb-143bca39-1241beef-db6c585a_0
2025-10-01T14:12:33.606248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcc67f09-1da7888b-ac5d7d11-e95cd067_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|76238fcb-143bca39-1241beef-db6c585a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:33.608734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76238fcb-143bca39-1241beef-db6c585a_0] Write session: try to update token
2025-10-01T14:12:33.608747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76238fcb-143bca39-1241beef-db6c585a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:33.616006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:33.616020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:33.616027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256022773853206:4180]
2025-10-01T14:12:33.616061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:33.616063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:33.616200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:33.616314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:33.616427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:33.616541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:33.616760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:33.616798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:33.620917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1703 sessionId: src_id|76238fcb-143bca39-1241beef-db6c585a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:33.623160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:33.623351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.623366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.623393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:33.623484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:33.636750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:33.636763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:33.636765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:33.636766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:33.636775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256022773853206:4180]
2025-10-01T14:12:33.636780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256022773853206:4180]
2025-10-01T14:12:33.636782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256022773853206:4180]
2025-10-01T14:12:33.636819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:33.636823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.636825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:33.636852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:33.636872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:33.636875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:33.636939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:33.684044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256025150748479:7092]
2025-10-01T14:12:33.684276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1702, pipe: [1:7556256025150748479:7092]
2025-10-01T14:12:33.772749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:33.780222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.780250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.780406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.780461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.780514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.780574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.780619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.780628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.780707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.780759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.780813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.780868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.780913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.780919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.780974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.781020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.781080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.781151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.781198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.781205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.781261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.781312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.781360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.781417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.781457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.781462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.781516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.781566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.781640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.781693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.781737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.781743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.781797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.781849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.781903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.781959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.782011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.782016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.782072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.782122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.782176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.782230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.782281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.782287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.782342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.782413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.782468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.782520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.782560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.782567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.782622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.782673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.782726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.782779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.782889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.782899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.782952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:33.783002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:33.783053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:33.783104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:33.783144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:33.783148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:33.783192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150748479:7092], now have 1 active actors on pipe
2025-10-01T14:12:33.783445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:33.783454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256025150748479:7092]
2025-10-01T14:12:33.783456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:33.783475Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:33.783477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1703 reason: error at write: Disconnected sessionId: src_id|76238fcb-143bca39-1241beef-db6c585a_0
2025-10-01T14:12:33.783647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1703 sessionId: src_id|76238fcb-143bca39-1241beef-db6c585a_0 is DEAD
2025-10-01T14:12:33.783809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76238fcb-143bca39-1241beef-db6c585a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:33.783819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76238fcb-143bca39-1241beef-db6c585a_0] Write session will restart in 0.005687s
2025-10-01T14:12:33.783845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76238fcb-143bca39-1241beef-db6c585a_0] Write session: Do CDS request
2025-10-01T14:12:33.783851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76238fcb-143bca39-1241beef-db6c585a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:33.784036Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:33.790759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76238fcb-143bca39-1241beef-db6c585a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.790853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:33.790863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1704
2025-10-01T14:12:33.790968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.790997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:33.791008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:33.791011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:33.791315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1704 sessionId:  describe result for acl check
2025-10-01T14:12:33.791340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:33.791345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:33.791346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:33.791349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256025150748582:7084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:33.791846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256025150748582:7084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:33.793938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256025150748582:7084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:33.796721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256025150748582:7084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:33.796731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256025150748582:7084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:33.796733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256025150748582:7084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:33.796738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:33.798517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:33.800080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:33.800196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:33.800203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:33.800210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:33.800237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:33.800267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256022773853496:4171]
2025-10-01T14:12:33.800612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:33.800829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:33.800856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:33.801052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:33.801086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.801090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.801091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.801091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.801092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.801093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.801093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.801094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.801094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.801095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.801096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.801096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.801097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.801097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.801100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.801105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.801107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.801111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.801114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.801117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.801120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.801124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.801127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.801130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.801133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.801135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.801138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.801141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.801147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.801154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.801159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.801162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.801171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.801179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.801183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.801187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.801190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.801196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.801203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.801207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.801215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.801219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.801226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.801231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.801239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.801243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.801249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.801253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.801258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.801261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.801263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.801266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.801268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.801271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.801273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.801276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.801295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:33.804428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:33.805054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:33.805065Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:33.805067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:33.805069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:33.805073Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1703 [2:7556256022773853496:4171]
2025-10-01T14:12:33.805082Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:33.805096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:33.805101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.805103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.805104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.805115Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:33.805121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:33.805125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:33.805156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.805160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.805161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.805164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:33.805166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:33.805222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:33.805229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.805239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.805254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.805268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:33.805280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150748808:7084], now have 1 active actors on pipe
2025-10-01T14:12:33.805286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150748481:2446], now have 1 active actors on pipe
2025-10-01T14:12:33.805291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256022773853491:4171]
2025-10-01T14:12:33.805295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256022773853491:4171]
2025-10-01T14:12:33.805297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256022773853491:4171]
2025-10-01T14:12:33.805304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:33.805313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:33.805318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:33.805321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:33.805323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:33.805324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:33.805326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:33.805340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256022773853491:4171]
2025-10-01T14:12:33.805346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:33.805348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:33.805352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1703
2025-10-01T14:12:33.805353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1703
2025-10-01T14:12:33.805402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.805408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.805427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:33.805435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.805437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.805439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:33.805444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.805454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:33.805464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.805602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.805608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.805620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.805685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1704 partition: 0 MaxSeqNo: 45 sessionId: src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0
2025-10-01T14:12:33.805976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76238fcb-143bca39-1241beef-db6c585a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:33.808105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0] Write session: try to update token
2025-10-01T14:12:33.808117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:33.820294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1704 sessionId: src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:33.822546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:33.824296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.824316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.824336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:33.824339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:33.824340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:33.824341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:33.824349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256022773853491:4171]
2025-10-01T14:12:33.824353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256022773853491:4171]
2025-10-01T14:12:33.824356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256022773853491:4171]
2025-10-01T14:12:33.824390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:33.824399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:33.824400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:33.824402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:33.824405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.824407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:33.824527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:33.883681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256025150748854:7092]
2025-10-01T14:12:33.883947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1703, pipe: [1:7556256025150748854:7092]
2025-10-01T14:12:33.958340Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:33.958868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:33.958913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150748854:7092], now have 1 active actors on pipe
2025-10-01T14:12:33.958990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:33.959044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256025150748854:7092]
2025-10-01T14:12:33.959063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:33.959091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:33.959099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:33.959175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1704 reason: error at write: Disconnected sessionId: src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0
2025-10-01T14:12:33.959328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1704 sessionId: src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0 is DEAD
2025-10-01T14:12:33.959433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:33.959443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0] Write session will restart in 0.006806s
2025-10-01T14:12:33.959481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0] Write session: Do CDS request
2025-10-01T14:12:33.959489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:33.967866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.967948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:33.967960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1705
2025-10-01T14:12:33.968035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:33.968057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:33.968064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:33.968066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:33.968446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1705 sessionId:  describe result for acl check
2025-10-01T14:12:33.968475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:33.968481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:33.968483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:33.968487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256025150748993:7077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:33.968996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256025150748993:7077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:33.971206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256025150748993:7077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:33.973972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256025150748993:7077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:33.973983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256025150748993:7077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:33.973986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256025150748993:7077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:33.973992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:33.976293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:33.978476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:33.978665Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:33.978675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:33.978686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:33.978738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:33.978779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256022773853782:4160]
2025-10-01T14:12:33.979382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:33.979666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:33.979712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:33.980086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:33.980154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.980162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.980163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.980164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.980165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.980166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.980167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.980169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.980170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.980171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.980172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.980173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.980174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.980175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.980180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.980190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.980194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.980198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.980201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.980205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.980207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.980211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.980215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.980219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.980223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.980226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.980230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.980233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.980245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.980256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:33.980262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.980272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:33.980280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.980288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:33.980296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.980301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:33.980309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.980314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:33.980323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.980332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:33.980341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.980350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:33.980358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.980365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:33.980373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.980378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:33.980386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.980391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.980397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.980406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.980410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.980419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.980428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.980437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:33.980445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.980453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:33.980494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:33.984033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:33.984609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:33.984619Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:33.984621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:33.984624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:33.984629Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1704 [2:7556256022773853782:4160]
2025-10-01T14:12:33.984652Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:33.984667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:33.984672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.984675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.984676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.984688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:33.984695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:33.984699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:33.984743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.984748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.984749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.984751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:33.984753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:33.984805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:33.984811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:33.984819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:33.984824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:33.984834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:33.984850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150748858:2446], now have 1 active actors on pipe
2025-10-01T14:12:33.984856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256025150749191:7077], now have 1 active actors on pipe
2025-10-01T14:12:33.984861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256022773853777:4160]
2025-10-01T14:12:33.984862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256022773853777:4160]
2025-10-01T14:12:33.984864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256022773853777:4160]
2025-10-01T14:12:33.984872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:33.984879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:33.984882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:33.984884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:33.984884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:33.984895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:33.984903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:33.984927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256022773853777:4160]
2025-10-01T14:12:33.984938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:33.984948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:33.984949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1704
2025-10-01T14:12:33.984950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1704
2025-10-01T14:12:33.985011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.985019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.985036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a363abc-8708f093-adc87317-29a352ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:33.985045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:33.985049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:33.985050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:33.985056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:33.985067Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:33.985080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.985234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:33.985239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:33.985248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:33.985333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1705 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a363abc-8708f093-adc87317-29a352ee_0
2025-10-01T14:12:33.985692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9d7096e-e82b93c2-10d2bb25-5c8b721f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a363abc-8708f093-adc87317-29a352ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:33.987996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a363abc-8708f093-adc87317-29a352ee_0] Write session: try to update token
2025-10-01T14:12:33.988010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a363abc-8708f093-adc87317-29a352ee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:33.999800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1705 sessionId: src_id|6a363abc-8708f093-adc87317-29a352ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:34.001416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:34.001431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:34.001438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256022773853777:4160]
2025-10-01T14:12:34.001477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:34.001501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:34.001628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:34.001751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:34.001851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:34.001866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:34.001994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:34.002215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:34.002252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.002263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.002278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:34.002306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:34.002398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:34.014790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:34.014804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:34.014807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:34.014808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:34.014819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256022773853777:4160]
2025-10-01T14:12:34.014822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256022773853777:4160]
2025-10-01T14:12:34.014826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256022773853777:4160]
2025-10-01T14:12:34.014869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:34.014876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.014878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:34.014880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:34.014886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:34.014889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:34.014995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:34.059293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256029445716523:7092]
2025-10-01T14:12:34.059509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1704, pipe: [1:7556256029445716523:7092]
2025-10-01T14:12:34.152106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:34.159358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.159383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.159548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.159614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.159677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.159740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.159783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.159792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.159861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.159922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.159982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.160043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.160090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.160098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.160161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.160219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.160280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.160344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.160387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.160394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.160456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.160514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.160573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.160630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.160702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.160708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.160764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.160814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.160864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.160916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.160953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.160959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.161016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.161101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.161155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.161214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.161252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.161257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.161315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.161365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.161431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.161483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.161521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.161526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.161582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.161634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.161686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.161740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.161779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.161784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.161858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.161908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.161956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.162011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.162050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.162055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.162109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:34.162161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:34.162212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:34.162272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:34.162312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:34.162317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:34.162355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445716523:7092], now have 1 active actors on pipe
2025-10-01T14:12:34.162566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256029445716523:7092]
2025-10-01T14:12:34.162576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:34.162579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:34.162590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:34.162601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1705 reason: error at write: Disconnected sessionId: src_id|6a363abc-8708f093-adc87317-29a352ee_0
2025-10-01T14:12:34.162767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1705 sessionId: src_id|6a363abc-8708f093-adc87317-29a352ee_0 is DEAD
2025-10-01T14:12:34.162896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a363abc-8708f093-adc87317-29a352ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:34.162905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a363abc-8708f093-adc87317-29a352ee_0] Write session will restart in 0.008112s
2025-10-01T14:12:34.162933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a363abc-8708f093-adc87317-29a352ee_0] Write session: Do CDS request
2025-10-01T14:12:34.162938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a363abc-8708f093-adc87317-29a352ee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:34.163242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:34.171822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a363abc-8708f093-adc87317-29a352ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.171940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:34.171968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1706
2025-10-01T14:12:34.172070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.172100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:34.172108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:34.172112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:34.172528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1706 sessionId:  describe result for acl check
2025-10-01T14:12:34.172558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:34.172564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:34.172566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:34.172572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256029445716713:7065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:34.173011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256029445716713:7065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:34.175720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256029445716713:7065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:34.178237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256029445716713:7065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:34.178248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256029445716713:7065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:34.178251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256029445716713:7065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:34.178256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:34.179447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:34.181529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:34.181676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:34.181684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:34.181692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:34.181726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:34.181760Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256027068821386:4164]
2025-10-01T14:12:34.182127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:34.182355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:34.182399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:34.182583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:34.182614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.182618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.182619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.182619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.182620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.182620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.182621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.182622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.182622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.182623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.182624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.182624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.182625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.182626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.182629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.182634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.182636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.182639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.182640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.182643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.182645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.182647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.182649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.182651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.182653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.182655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.182657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.182659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.182663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.182667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.182671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.182674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.182676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.182679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.182681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.182684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.182686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.182689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.182691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.182694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.182697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.182699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.182702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.182704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.182707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.182709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.182712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.182714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.182716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.182721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.182723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.182726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.182728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.182731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.182733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.182736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.182754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:34.186039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:34.186648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:34.186663Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:34.186664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:34.186666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:34.186671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1705 [2:7556256027068821386:4164]
2025-10-01T14:12:34.186681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:34.186693Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:34.186695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.186697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.186698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.186709Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:34.186712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:34.186717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:34.186765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.186772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.186774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.186776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:34.186778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:34.186831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:34.186839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.186850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.186855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.186864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:34.186875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256027068821381:4164]
2025-10-01T14:12:34.186877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256027068821381:4164]
2025-10-01T14:12:34.186878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256027068821381:4164]
2025-10-01T14:12:34.186886Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:34.186894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:34.186896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445716551:2446], now have 1 active actors on pipe
2025-10-01T14:12:34.186897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:34.186899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445716906:7065], now have 1 active actors on pipe
2025-10-01T14:12:34.186899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:34.186904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:34.186912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:34.186914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:34.186932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256027068821381:4164]
2025-10-01T14:12:34.186943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:34.186956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:34.186970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1705
2025-10-01T14:12:34.186975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1705
2025-10-01T14:12:34.187036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.187044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.187061Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:34.187069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.187072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.187073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:34.187079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.187085Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:34.187097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.187222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.187229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.187241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.187810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1706 partition: 0 MaxSeqNo: 45 sessionId: src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0
2025-10-01T14:12:34.188169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a363abc-8708f093-adc87317-29a352ee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:34.190427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0] Write session: try to update token
2025-10-01T14:12:34.190441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:34.203156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1706 sessionId: src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:34.205754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:34.205953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.205972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.205989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:34.205992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:34.205993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:34.205995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:34.206002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256027068821381:4164]
2025-10-01T14:12:34.206005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256027068821381:4164]
2025-10-01T14:12:34.206009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256027068821381:4164]
2025-10-01T14:12:34.206037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:34.206046Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:34.206048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:34.206052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:34.206056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.206058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:34.206166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:34.262560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256029445716920:7092]
2025-10-01T14:12:34.262804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1705, pipe: [1:7556256029445716920:7092]
2025-10-01T14:12:34.340812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:34.341290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:34.341338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445716920:7092], now have 1 active actors on pipe
2025-10-01T14:12:34.341438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:34.341522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256029445716920:7092]
2025-10-01T14:12:34.341544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:34.350233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:34.350247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:34.350265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1706 reason: error at write: Disconnected sessionId: src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0
2025-10-01T14:12:34.350411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1706 sessionId: src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0 is DEAD
2025-10-01T14:12:34.350525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:34.350533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0] Write session will restart in 0.006492s
2025-10-01T14:12:34.350550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0] Write session: Do CDS request
2025-10-01T14:12:34.350556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:34.357792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.357943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:34.357956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1707
2025-10-01T14:12:34.358069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.358098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:34.358108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:34.358111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:34.358458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1707 sessionId:  describe result for acl check
2025-10-01T14:12:34.358487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:34.358494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:34.358495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:34.358500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256029445717248:7055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:34.358902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256029445717248:7055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:34.360197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:34.360637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:34.360700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256029445717248:7055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:34.360755Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:34.360762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:34.360769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:34.360796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:34.360827Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256027068821673:4163]
2025-10-01T14:12:34.361193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:34.362653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:34.362694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:34.362916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256029445717248:7055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:34.362927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256029445717248:7055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:34.362906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:34.362929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256029445717248:7055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:34.362935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:34.362952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.362957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.362958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.362959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.362960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.362961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.362962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.362963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.362964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.362965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.362966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.362967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.362968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.362969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.362974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.362983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.362987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.362991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.362994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.362998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.363001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.363005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.363008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.363012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.363016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.363019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.363023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.363026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.363030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.363035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.363039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.363041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.363044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.363047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.363051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.363055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.363059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.363062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.363066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.363070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.363074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.363078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.363082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.363086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.363089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.363094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.363098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.363102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.363106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.363111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.363117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.363122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.363130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.363135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.363143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.363148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.363193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:34.366407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:34.367021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:34.367035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:34.367037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:34.367041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:34.367047Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1706 [2:7556256027068821673:4163]
2025-10-01T14:12:34.367061Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:34.367075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:34.367078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.367081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.367082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.367097Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:34.367102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:34.367108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:34.367155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.367164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.367165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.367168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:34.367171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:34.367230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:34.367237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.367248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.367264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.367282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:34.367300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445716935:2446], now have 1 active actors on pipe
2025-10-01T14:12:34.367307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445717299:7055], now have 1 active actors on pipe
2025-10-01T14:12:34.367314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256027068821668:4163]
2025-10-01T14:12:34.367320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256027068821668:4163]
2025-10-01T14:12:34.367322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256027068821668:4163]
2025-10-01T14:12:34.367316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1706
2025-10-01T14:12:34.367334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:34.367319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1706
2025-10-01T14:12:34.367346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:34.367352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:34.367353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:34.367355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:34.367366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:34.367368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:34.367400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.367409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.367424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256027068821668:4163]
2025-10-01T14:12:34.367434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:34.367445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:34.367462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:34.367474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.367483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.367485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:34.367494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.367505Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:34.367532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.367681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.367690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.367704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.367776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1707 partition: 0 MaxSeqNo: 45 sessionId: src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0
2025-10-01T14:12:34.368062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56d366c8-d2053089-f1f314e6-6d63cbf1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:34.370230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0] Write session: try to update token
2025-10-01T14:12:34.370247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:34.383118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1707 sessionId: src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:34.385619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:34.387037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.387062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.387084Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:34.387087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:34.387090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:34.387092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:34.387100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256027068821668:4163]
2025-10-01T14:12:34.387111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256027068821668:4163]
2025-10-01T14:12:34.387114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256027068821668:4163]
2025-10-01T14:12:34.387161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:34.387171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:34.387173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:34.387175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:34.387184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.387192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:34.387323Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:34.441743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256029445717311:7092]
2025-10-01T14:12:34.442060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1706, pipe: [1:7556256029445717311:7092]
2025-10-01T14:12:34.525308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:34.525801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:34.525846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445717311:7092], now have 1 active actors on pipe
2025-10-01T14:12:34.525919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:34.526033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256029445717311:7092]
2025-10-01T14:12:34.526059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:34.535067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:34.535078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:34.535102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1707 reason: error at write: Disconnected sessionId: src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0
2025-10-01T14:12:34.535267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1707 sessionId: src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0 is DEAD
2025-10-01T14:12:34.535378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:34.535391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0] Write session will restart in 0.009940s
2025-10-01T14:12:34.535416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0] Write session: Do CDS request
2025-10-01T14:12:34.535425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:34.544357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:34.546314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:34.546532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:34.546543Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:34.546554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:34.546605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:34.546844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.546865Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256027068821991:4140]
2025-10-01T14:12:34.546927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:34.546940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1708
2025-10-01T14:12:34.547058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.547086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:34.547095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:34.547099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:34.547441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:34.547466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1708 sessionId:  describe result for acl check
2025-10-01T14:12:34.547497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:34.547502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:34.547506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:34.547510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256029445717648:7043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:34.547693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:34.547740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:34.548001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256029445717648:7043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:34.548035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:34.548094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.548100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.548101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.548103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.548104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.548105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.548107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.548108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.548109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.548110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.548111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.548112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.548113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.548114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.548120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.548129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.548133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.548137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.548141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.548145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.548148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.548152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.548156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.548160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.548163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.548167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.548172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.548175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.548182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.548190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.548201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.548211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.548220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.548226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.548233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.548239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.548247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.548254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.548262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.548267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.548276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.548281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.548290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.548294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.548302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.548307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.548312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.548320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.548326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.548335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.548340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.548348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.548355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.548364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.548368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.548373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.548413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:34.550562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256029445717648:7043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:34.551839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:34.552434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:34.552449Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:34.552452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:34.552456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:34.552462Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1707 [2:7556256027068821991:4140]
2025-10-01T14:12:34.552476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:34.552495Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:34.552503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.552507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.552510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.552526Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:34.552537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:34.552544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:34.552595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.552603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.552605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.552609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:34.552611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:34.552684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:34.552692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.552704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.552721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.552742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:34.552765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445717318:2446], now have 1 active actors on pipe
2025-10-01T14:12:34.552778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256027068821986:4140]
2025-10-01T14:12:34.552784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256027068821986:4140]
2025-10-01T14:12:34.552787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256027068821986:4140]
2025-10-01T14:12:34.552802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:34.552808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:34.552782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1707
2025-10-01T14:12:34.552810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:34.552811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:34.552819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:34.552834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:34.552837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:34.552864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256027068821986:4140]
2025-10-01T14:12:34.552876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:34.552885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:34.553339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256029445717648:7043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:34.553349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256029445717648:7043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:34.553352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256029445717648:7043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:34.553357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:34.553507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445717690:7043], now have 1 active actors on pipe
2025-10-01T14:12:34.553515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1707
2025-10-01T14:12:34.553543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.553552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.553576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|615196d9-e44cfe2-46391c60-9f1d5524_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:34.553589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.553599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.553606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:34.553615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.553629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:34.553647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.553784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.553793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.553809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.553871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1708 partition: 0 MaxSeqNo: 45 sessionId: src_id|615196d9-e44cfe2-46391c60-9f1d5524_0
2025-10-01T14:12:34.554198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90a7c97a-c0ce1454-9689b9fa-264ea9bb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|615196d9-e44cfe2-46391c60-9f1d5524_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:34.558396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|615196d9-e44cfe2-46391c60-9f1d5524_0] Write session: try to update token
2025-10-01T14:12:34.558414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|615196d9-e44cfe2-46391c60-9f1d5524_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:34.572286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1708 sessionId: src_id|615196d9-e44cfe2-46391c60-9f1d5524_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:34.572564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:34.572585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:34.572588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:34.572589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:34.572601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256027068821986:4140]
2025-10-01T14:12:34.572610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256027068821986:4140]
2025-10-01T14:12:34.572614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256027068821986:4140]
2025-10-01T14:12:34.572655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:34.572666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:34.572670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:34.572679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:34.572690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.572694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:34.572827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:34.574526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:34.626083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256029445717693:7092]
2025-10-01T14:12:34.626309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1707, pipe: [1:7556256029445717693:7092]
2025-10-01T14:12:34.707417Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:34.708133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.708146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.708180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445717693:7092], now have 1 active actors on pipe
2025-10-01T14:12:34.708378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:34.708400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256029445717693:7092]
2025-10-01T14:12:34.708427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:34.708431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:34.708435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:34.708492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1708 reason: error at write: Disconnected sessionId: src_id|615196d9-e44cfe2-46391c60-9f1d5524_0
2025-10-01T14:12:34.708699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1708 sessionId: src_id|615196d9-e44cfe2-46391c60-9f1d5524_0 is DEAD
2025-10-01T14:12:34.708859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615196d9-e44cfe2-46391c60-9f1d5524_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:34.708870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615196d9-e44cfe2-46391c60-9f1d5524_0] Write session will restart in 0.008799s
2025-10-01T14:12:34.708897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615196d9-e44cfe2-46391c60-9f1d5524_0] Write session: Do CDS request
2025-10-01T14:12:34.708903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615196d9-e44cfe2-46391c60-9f1d5524_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:34.718914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|615196d9-e44cfe2-46391c60-9f1d5524_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.718982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:34.718991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1709
2025-10-01T14:12:34.719110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.719134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:34.719140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:34.719143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:34.719480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1709 sessionId:  describe result for acl check
2025-10-01T14:12:34.719509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:34.719514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:34.719516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:34.719520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256029445717893:7036] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:34.719983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256029445717893:7036] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:34.722353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256029445717893:7036] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:34.724274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256029445717893:7036] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:34.724285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256029445717893:7036] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:34.724288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256029445717893:7036] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:34.724295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:34.726826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:34.727211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:34.727389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:34.727399Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:34.727410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:34.727451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:34.727490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256027068822285:4139]
2025-10-01T14:12:34.728094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:34.728300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:34.728335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:34.728633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:34.728689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.728694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.728696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.728697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.728698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.728699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.728700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.728701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.728702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.728703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.728704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.728705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.728706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.728707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.728712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.728721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.728725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.728729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.728733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.728737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.728740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.728744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.728747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.728752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.728755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.728759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.728763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.728766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.728772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.728780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.728785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.728791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.728795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.728800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.728809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.728814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.728819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.728828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.728832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.728842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.728847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.728857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.728861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.728870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.728875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.728881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.728889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.728894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.728900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.728905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.728908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.728917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.728921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.728930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.728934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.728938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.728977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:34.732267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:34.733275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:34.733289Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:34.733291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:34.733294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:34.733300Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1708 [2:7556256027068822285:4139]
2025-10-01T14:12:34.733633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:34.733655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:34.733658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.733661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.733663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.733677Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:34.733687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:34.733693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:34.733746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.733753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.733755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.733758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:34.733760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:34.733820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:34.733827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.733838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.733852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.733871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:34.733891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445717695:2446], now have 1 active actors on pipe
2025-10-01T14:12:34.733898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445718058:7036], now have 1 active actors on pipe
2025-10-01T14:12:34.733904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256027068822280:4139]
2025-10-01T14:12:34.733910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256027068822280:4139]
2025-10-01T14:12:34.733912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256027068822280:4139]
2025-10-01T14:12:34.733922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:34.733929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:34.733931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:34.733903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1708
2025-10-01T14:12:34.733934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:34.733938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:34.733952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:34.733955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:34.733963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1708
2025-10-01T14:12:34.733981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256027068822280:4139]
2025-10-01T14:12:34.733987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:34.733994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:34.734003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.734007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.734045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:34.734056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.734061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.734067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:34.734075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.734087Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:34.734107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.734225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.734232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.734244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.734305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1709 partition: 0 MaxSeqNo: 45 sessionId: src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0
2025-10-01T14:12:34.734631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|615196d9-e44cfe2-46391c60-9f1d5524_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:34.736981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0] Write session: try to update token
2025-10-01T14:12:34.736996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:34.751336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1709 sessionId: src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:34.753249Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:34.753268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:34.753271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:34.753272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:34.753282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256027068822280:4139]
2025-10-01T14:12:34.753287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256027068822280:4139]
2025-10-01T14:12:34.753290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256027068822280:4139]
2025-10-01T14:12:34.753323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:34.753327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:34.753330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:34.753337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:34.753343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.753345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:34.753484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:34.753569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:34.808345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256029445718072:7092]
2025-10-01T14:12:34.808608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1708, pipe: [1:7556256029445718072:7092]
2025-10-01T14:12:34.893985Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:34.894190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.894201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.894235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445718072:7092], now have 1 active actors on pipe
2025-10-01T14:12:34.894361Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:34.894441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:34.894456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256029445718072:7092]
2025-10-01T14:12:34.894479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:34.894547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1709 reason: status is not ok: tablet will be restarted right now sessionId: src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0
2025-10-01T14:12:34.894714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1709 sessionId: src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0 is DEAD
2025-10-01T14:12:34.894873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:34.894883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0] Write session will restart in 0.005698s
2025-10-01T14:12:34.894911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0] Write session: Do CDS request
2025-10-01T14:12:34.894917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:34.901795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.901870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:34.901882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1710
2025-10-01T14:12:34.901996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:34.902027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:34.902037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:34.902040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:34.902445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1710 sessionId:  describe result for acl check
2025-10-01T14:12:34.902473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:34.902478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:34.902480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:34.902483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256029445718145:7035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:34.902930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256029445718145:7035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:34.904996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256029445718145:7035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:34.908001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256029445718145:7035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:34.908012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256029445718145:7035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:34.908015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256029445718145:7035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:34.908022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:34.913945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:34.914330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:34.914469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:34.914477Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:34.914486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:34.914519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:34.914547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256027068822576:4133]
2025-10-01T14:12:34.914947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:34.915179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:34.915227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:34.915455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:34.915492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.915496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.915496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.915497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.915498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.915498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.915499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.915500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.915500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.915501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.915501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.915502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.915503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.915503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.915507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.915512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.915514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.915516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.915518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.915521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.915523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.915525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.915527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.915529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.915531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.915533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.915535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.915537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.915541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.915545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:34.915551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.915554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:34.915556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.915559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:34.915561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.915565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:34.915567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.915570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:34.915572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.915575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:34.915577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.915580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:34.915582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.915585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:34.915587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.915590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:34.915592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.915595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.915597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.915599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.915601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.915604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.915606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.915609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:34.915611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.915614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:34.915634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:34.918956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:34.919517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:34.919527Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:34.919529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:34.919531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:34.919536Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1709 [2:7556256027068822576:4133]
2025-10-01T14:12:34.919547Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:34.919561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:34.919566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.919569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.919570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.919583Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:34.919587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:34.919595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:34.919632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.919638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.919639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.919642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:34.919643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:34.919692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:34.919697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.919703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:34.919709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:34.919720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:34.919739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256027068822571:4133]
2025-10-01T14:12:34.919745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256027068822571:4133]
2025-10-01T14:12:34.919746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256027068822571:4133]
2025-10-01T14:12:34.919757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:34.919764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:34.919766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:34.919768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:34.919778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445718076:2446], now have 1 active actors on pipe
2025-10-01T14:12:34.919784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445718349:7035], now have 1 active actors on pipe
2025-10-01T14:12:34.919792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:34.919808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:34.919814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:34.919849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256027068822571:4133]
2025-10-01T14:12:34.919860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:34.919870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:34.919845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1709
2025-10-01T14:12:34.919859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1709
2025-10-01T14:12:34.919893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.919901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.919931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:34.919941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:34.919945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:34.919950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:34.919958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:34.919966Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:34.919983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.920121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.920129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.920141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:34.920208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1710 partition: 0 MaxSeqNo: 45 sessionId: src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0
2025-10-01T14:12:34.920518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cf75b-6cc0560f-125d53eb-2a1d82b4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:34.922687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0] Write session: try to update token
2025-10-01T14:12:34.922700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:34.936123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1710 sessionId: src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:34.938552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:34.939663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:34.939684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:34.939702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:34.939705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:34.939707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:34.939708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:34.939714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256027068822571:4133]
2025-10-01T14:12:34.939717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256027068822571:4133]
2025-10-01T14:12:34.939720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256027068822571:4133]
2025-10-01T14:12:34.939768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:34.939769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:34.939774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:34.939777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:34.939778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:34.939779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:34.939950Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:34.994719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256029445718453:7092]
2025-10-01T14:12:34.994967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1709, pipe: [1:7556256029445718453:7092]
2025-10-01T14:12:35.074415Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:35.074951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:35.074996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256029445718453:7092], now have 1 active actors on pipe
2025-10-01T14:12:35.075081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:35.075188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:35.075241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256029445718453:7092]
2025-10-01T14:12:35.086407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:35.086416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:35.086434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1710 reason: error at write: Disconnected sessionId: src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0
2025-10-01T14:12:35.086578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1710 sessionId: src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0 is DEAD
2025-10-01T14:12:35.086702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:35.086714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0] Write session will restart in 0.005781s
2025-10-01T14:12:35.086739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0] Write session: Do CDS request
2025-10-01T14:12:35.086747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:35.093769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:35.093820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.093922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:35.093933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1711
2025-10-01T14:12:35.094007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.094029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:35.094036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:35.094038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:35.094424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1711 sessionId:  describe result for acl check
2025-10-01T14:12:35.094457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:35.094463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:35.094465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:35.094473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256033740686084:7030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:35.095000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256033740686084:7030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:35.095615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:35.095951Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:35.095964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:35.095979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:35.096046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:35.096081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256031363790166:4120]
2025-10-01T14:12:35.096628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:35.096860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256033740686084:7030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:35.096883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:35.096944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:35.097242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:35.097306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.097312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.097313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.097314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.097316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.097317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.097318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.097319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.097321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.097322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.097323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.097324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.097325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.097327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.097332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.097341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.097345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.097349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.097352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.097356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.097360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.097364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.097368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.097372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.097376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.097380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.097383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.097387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.097394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.097404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.097414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.097419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.097427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.097432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.097440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.097445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.097454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.097459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.097467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.097472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.097481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.097485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.097493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.097498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.097503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.097512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.097518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.097527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.097531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.097539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.097543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.097548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.097555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.097560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.097566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.097571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.097613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:35.100694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256033740686084:7030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:35.100704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256033740686084:7030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:35.100708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256033740686084:7030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:35.100714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:35.100878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:35.101620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:35.101635Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:35.101637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:35.101640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:35.101646Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1710 [2:7556256031363790166:4120]
2025-10-01T14:12:35.101658Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:35.101672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:35.101676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.101678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.101681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.101695Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:35.101700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:35.101705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:35.101753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.101761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.101763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.101766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:35.101769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:35.101829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:35.101837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.101848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.101863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.101883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:35.101903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740686122:7030], now have 1 active actors on pipe
2025-10-01T14:12:35.101910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740685752:2446], now have 1 active actors on pipe
2025-10-01T14:12:35.101918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256031363790161:4120]
2025-10-01T14:12:35.101923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256031363790161:4120]
2025-10-01T14:12:35.101925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256031363790161:4120]
2025-10-01T14:12:35.101899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1710
2025-10-01T14:12:35.101934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:35.101946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:35.101950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:35.101952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:35.101933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1710
2025-10-01T14:12:35.101952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:35.101966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:35.101969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:35.101985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.101993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.102029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256031363790161:4120]
2025-10-01T14:12:35.102041Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:35.102053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:35.102060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26a78851-c8b3e658-167384a3-c18f693c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:35.102067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.102077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.102079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:35.102089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.102102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:35.102140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.102264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.102275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.102294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.102347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1711 partition: 0 MaxSeqNo: 45 sessionId: src_id|26a78851-c8b3e658-167384a3-c18f693c_0
2025-10-01T14:12:35.102710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87c938fe-d0c6cca0-3ee79555-f1159754_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|26a78851-c8b3e658-167384a3-c18f693c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:35.105219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26a78851-c8b3e658-167384a3-c18f693c_0] Write session: try to update token
2025-10-01T14:12:35.105238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26a78851-c8b3e658-167384a3-c18f693c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:35.118552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1711 sessionId: src_id|26a78851-c8b3e658-167384a3-c18f693c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:35.120973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:35.121467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.121495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.121516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:35.121520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:35.121523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:35.121525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:35.121538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256031363790161:4120]
2025-10-01T14:12:35.121547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256031363790161:4120]
2025-10-01T14:12:35.121551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256031363790161:4120]
2025-10-01T14:12:35.121579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:35.121588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:35.121591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:35.121598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:35.121603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.121605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:35.121756Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:35.175475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256033740686155:7092]
2025-10-01T14:12:35.175677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1710, pipe: [1:7556256033740686155:7092]
2025-10-01T14:12:35.259221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:35.259525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:35.259571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740686155:7092], now have 1 active actors on pipe
2025-10-01T14:12:35.259643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:35.259699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256033740686155:7092]
2025-10-01T14:12:35.259719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:35.259720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:35.259723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:35.259778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1711 reason: error at write: Disconnected sessionId: src_id|26a78851-c8b3e658-167384a3-c18f693c_0
2025-10-01T14:12:35.259921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1711 sessionId: src_id|26a78851-c8b3e658-167384a3-c18f693c_0 is DEAD
2025-10-01T14:12:35.260026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26a78851-c8b3e658-167384a3-c18f693c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:35.260036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26a78851-c8b3e658-167384a3-c18f693c_0] Write session will restart in 0.005095s
2025-10-01T14:12:35.260055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26a78851-c8b3e658-167384a3-c18f693c_0] Write session: Do CDS request
2025-10-01T14:12:35.260062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26a78851-c8b3e658-167384a3-c18f693c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:35.265810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26a78851-c8b3e658-167384a3-c18f693c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.265861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:35.265872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1712
2025-10-01T14:12:35.265974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.265997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:35.266003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:35.266006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:35.266381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1712 sessionId:  describe result for acl check
2025-10-01T14:12:35.266406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:35.266407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:35.266409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:35.266412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256033740686193:7012] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:35.266811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256033740686193:7012] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:35.269271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256033740686193:7012] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:35.272379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256033740686193:7012] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:35.272389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256033740686193:7012] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:35.272391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256033740686193:7012] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:35.272396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:35.275630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:35.277601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:35.277742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:35.277751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:35.277758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:35.277788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:35.277814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256031363790480:4115]
2025-10-01T14:12:35.278216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:35.278403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:35.278431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:35.278632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:35.278804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.278809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.278810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.278810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.278811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.278812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.278812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.278813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.278813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.278814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.278815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.278815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.278816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.278816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.278820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.278825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.278828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.278830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.278832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.278834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.278836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.278838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.278841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.278845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.278849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.278852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.278855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.278858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.278864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.278871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.278877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.278880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.278882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.278884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.278887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.278889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.278893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.278895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.278898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.278900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.278903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.278905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.278907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.278910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.278912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.278914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.278916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.278919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.278921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.278924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.278926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.278929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.278931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.278934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.278935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.278939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.278958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:35.282425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:35.283012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:35.283024Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:35.283027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:35.283030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:35.283035Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1711 [2:7556256031363790480:4115]
2025-10-01T14:12:35.283047Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:35.283060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:35.283066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.283068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.283069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.283080Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:35.283092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:35.283097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:35.283134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.283140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.283142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.283145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:35.283147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:35.283202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:35.283208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.283214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.283220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.283229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:35.283244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256031363790474:4115]
2025-10-01T14:12:35.283249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256031363790474:4115]
2025-10-01T14:12:35.283251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256031363790474:4115]
2025-10-01T14:12:35.283259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:35.283267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:35.283270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:35.283272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:35.283273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740686157:2446], now have 1 active actors on pipe
2025-10-01T14:12:35.283278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740686425:7012], now have 1 active actors on pipe
2025-10-01T14:12:35.283283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:35.283296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:35.283303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:35.283327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256031363790474:4115]
2025-10-01T14:12:35.283337Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:35.283332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1711
2025-10-01T14:12:35.283337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1711
2025-10-01T14:12:35.283356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:35.283612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.283621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.283648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:35.283658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.283664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.283666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:35.283674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.283685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:35.283703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.283853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.283860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.283872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.283932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1712 partition: 0 MaxSeqNo: 45 sessionId: src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0
2025-10-01T14:12:35.284261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26a78851-c8b3e658-167384a3-c18f693c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:35.286587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0] Write session: try to update token
2025-10-01T14:12:35.286603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:35.298811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1712 sessionId: src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:35.301364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:35.302494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.302512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.302528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:35.302530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:35.302531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:35.302533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:35.302539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256031363790474:4115]
2025-10-01T14:12:35.302542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256031363790474:4115]
2025-10-01T14:12:35.302546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256031363790474:4115]
2025-10-01T14:12:35.302587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:35.302592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.302594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:35.302597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:35.302603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:35.302607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:35.302743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:35.359798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256033740686549:7092]
2025-10-01T14:12:35.360031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1711, pipe: [1:7556256033740686549:7092]
2025-10-01T14:12:35.441089Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:35.441419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:35.441464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740686549:7092], now have 1 active actors on pipe
2025-10-01T14:12:35.441539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:35.441639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256033740686549:7092]
2025-10-01T14:12:35.441665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:35.451149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:35.451163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:35.451180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1712 reason: error at write: Disconnected sessionId: src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0
2025-10-01T14:12:35.451301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1712 sessionId: src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0 is DEAD
2025-10-01T14:12:35.451430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:35.451448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0] Write session will restart in 0.006253s
2025-10-01T14:12:35.451466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0] Write session: Do CDS request
2025-10-01T14:12:35.451474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:35.458813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.458890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:35.458903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1713
2025-10-01T14:12:35.459026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.459055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:35.459060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:35.459068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:35.459478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1713 sessionId:  describe result for acl check
2025-10-01T14:12:35.459506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:35.459509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:35.459511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:35.459515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256033740686740:7007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:35.459934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256033740686740:7007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:35.462333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256033740686740:7007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:35.464703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256033740686740:7007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:35.464715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256033740686740:7007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:35.464718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256033740686740:7007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:35.464725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:35.467498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:35.467959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:35.468109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:35.468117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:35.468127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:35.468164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:35.468200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256031363790787:4113]
2025-10-01T14:12:35.468813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:35.469067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:35.469101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:35.469388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:35.469429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.469434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.469435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.469436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.469437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.469438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.469439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.469440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.469441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.469442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.469443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.469444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.469445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.469446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.469450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.469459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.469462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.469465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.469469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.469472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.469475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.469478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.469481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.469485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.469488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.469492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.469499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.469502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.469510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.469521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.469531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.469539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.469546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.469554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.469561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.469566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.469573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.469577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.469581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.469588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.469596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.469601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.469609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.469615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.469618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.469626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.469634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.469642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.469649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.469653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.469659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.469665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.469672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.469676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.469682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.469687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.469723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:35.473279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:35.474068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:35.474081Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:35.474083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:35.474088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:35.474094Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1712 [2:7556256031363790787:4113]
2025-10-01T14:12:35.474111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:35.474128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:35.474135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.474138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.474140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.474154Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:35.474163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:35.474168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:35.474216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.474222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.474223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.474226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:35.474228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:35.474288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:35.474293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.474305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.474318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.474336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:35.474357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740686556:2446], now have 1 active actors on pipe
2025-10-01T14:12:35.474364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740686924:7007], now have 1 active actors on pipe
2025-10-01T14:12:35.474388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256031363790782:4113]
2025-10-01T14:12:35.474390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256031363790782:4113]
2025-10-01T14:12:35.474392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256031363790782:4113]
2025-10-01T14:12:35.474406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:35.474421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:35.474437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:35.474439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:35.474443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:35.474443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:35.474445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:35.474464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256031363790782:4113]
2025-10-01T14:12:35.474470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:35.474472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:35.474447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1712
2025-10-01T14:12:35.474496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.474504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.474514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1712
2025-10-01T14:12:35.474527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4c76098-8487e152-84a83dbd-cac85a50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:35.474536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.474540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.474542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:35.474549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.474559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:35.474575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.474721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.474728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.474740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.474812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1713 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4c76098-8487e152-84a83dbd-cac85a50_0
2025-10-01T14:12:35.475121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15e07d4a-a1aaea49-8dfbd551-223ee377_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4c76098-8487e152-84a83dbd-cac85a50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:35.477192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c76098-8487e152-84a83dbd-cac85a50_0] Write session: try to update token
2025-10-01T14:12:35.477204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c76098-8487e152-84a83dbd-cac85a50_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:35.489309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1713 sessionId: src_id|f4c76098-8487e152-84a83dbd-cac85a50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:35.491597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:35.491812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.491832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.491867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:35.491944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:35.494160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:35.494178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:35.494180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:35.494182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:35.494191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256031363790782:4113]
2025-10-01T14:12:35.494196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256031363790782:4113]
2025-10-01T14:12:35.494199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256031363790782:4113]
2025-10-01T14:12:35.494245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:35.494256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.494263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:35.494263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:35.494270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:35.494281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:35.494431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:35.542062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256033740686941:7092]
2025-10-01T14:12:35.542292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1712, pipe: [1:7556256033740686941:7092]
2025-10-01T14:12:35.630527Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:35.637432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.637454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.637598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.637652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.637708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.637763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.637807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.637819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.637878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.637931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.637986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.638077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.638117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.638122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.638177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.638227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.638298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.638397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.638503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.638509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.638589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.638947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.638999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.639050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.639089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.639095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.639154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.639204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.639255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.639308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.639354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.639359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.639418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.639470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.639524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.639577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.639619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.639624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.639687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.639742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.639796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.639849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.639970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.639976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.640032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.640087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.640148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.640203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.640258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.640263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.640321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.640374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.640428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.640479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.640573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.640582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.640652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.640705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.640762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.640815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.640925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.640930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.640978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740686941:7092], now have 1 active actors on pipe
2025-10-01T14:12:35.641169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:35.641220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256033740686941:7092]
2025-10-01T14:12:35.641226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:35.641229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:35.641254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1713 reason: error at write: Disconnected sessionId: src_id|f4c76098-8487e152-84a83dbd-cac85a50_0
2025-10-01T14:12:35.641472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1713 sessionId: src_id|f4c76098-8487e152-84a83dbd-cac85a50_0 is DEAD
2025-10-01T14:12:35.641491Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:35.641584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c76098-8487e152-84a83dbd-cac85a50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:35.641591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c76098-8487e152-84a83dbd-cac85a50_0] Write session will restart in 0.005707s
2025-10-01T14:12:35.641616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c76098-8487e152-84a83dbd-cac85a50_0] Write session: Do CDS request
2025-10-01T14:12:35.641621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c76098-8487e152-84a83dbd-cac85a50_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:35.648891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c76098-8487e152-84a83dbd-cac85a50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.649024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:35.649037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1714
2025-10-01T14:12:35.649155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.649179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:35.649188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:35.649191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:35.649587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1714 sessionId:  describe result for acl check
2025-10-01T14:12:35.649619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:35.649625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:35.649627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:35.649632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256033740687027:7003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:35.650107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256033740687027:7003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:35.652520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256033740687027:7003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:35.655628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256033740687027:7003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:35.655642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256033740687027:7003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:35.655645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256033740687027:7003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:35.655653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:35.659293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:35.661461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:35.661598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:35.661605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:35.661613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:35.661647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:35.661674Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256031363791100:4091]
2025-10-01T14:12:35.662057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:35.662286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:35.662311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:35.662526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:35.662572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.662578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.662578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.662579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.662580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.662580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.662581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.662582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.662582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.662583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.662583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.662584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.662585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.662585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.662588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.662594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.662596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.662598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.662600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.662602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.662604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.662606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.662608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.662610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.662612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.662614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.662616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.662618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.662622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.662627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.662631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.662634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.662637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.662639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.662642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.662645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.662648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.662650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.662653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.662655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.662658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.662661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.662663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.662666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.662668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.662671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.662674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.662677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.662679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.662682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.662685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.662688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.662690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.662692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.662694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.662697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.662717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:35.666285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:35.667026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:35.667040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:35.667042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:35.667046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:35.667052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1713 [2:7556256031363791100:4091]
2025-10-01T14:12:35.667067Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:35.667083Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:35.667090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.667094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.667096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.667110Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:35.667123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:35.667128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:35.667179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.667187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.667189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.667192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:35.667195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:35.667264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:35.667277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.667288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.667303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.667329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:35.667356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740686944:2446], now have 1 active actors on pipe
2025-10-01T14:12:35.667366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740687233:7003], now have 1 active actors on pipe
2025-10-01T14:12:35.667374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256031363791095:4091]
2025-10-01T14:12:35.667382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256031363791095:4091]
2025-10-01T14:12:35.667386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256031363791095:4091]
2025-10-01T14:12:35.667362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1713
2025-10-01T14:12:35.667364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1713
2025-10-01T14:12:35.667404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:35.667409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:35.667412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:35.667413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:35.667432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:35.667463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:35.667468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:35.667495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.667509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.667550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256031363791095:4091]
2025-10-01T14:12:35.667571Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:35.667580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:35.667597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:35.667610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.667621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.667631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:35.667643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.667665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:35.667717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.667873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.667891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.667916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.667998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1714 partition: 0 MaxSeqNo: 45 sessionId: src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0
2025-10-01T14:12:35.668359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4c76098-8487e152-84a83dbd-cac85a50_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:35.670569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0] Write session: try to update token
2025-10-01T14:12:35.670582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:35.682923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1714 sessionId: src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:35.685118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:35.685668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.685695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.687452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:35.687481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:35.687484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:35.687486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:35.687487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:35.687493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256031363791095:4091]
2025-10-01T14:12:35.687498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256031363791095:4091]
2025-10-01T14:12:35.687501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256031363791095:4091]
2025-10-01T14:12:35.687526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:35.687534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:35.687539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:35.687539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.687541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:35.687542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:35.687587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:35.687688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:35.741212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256033740687324:7092]
2025-10-01T14:12:35.741430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1713, pipe: [1:7556256033740687324:7092]
2025-10-01T14:12:35.831151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:35.840290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.840321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.840514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.840585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.840673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.840744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.841187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.841202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.841282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.841349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.841423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.841490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.841535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.841544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.841648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.841713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.841781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.841854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.841905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.841912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.841981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.842041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.842103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.842172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.842225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.842237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.842340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.842439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.842501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.842607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.842656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.842667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.842774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.844779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256033740687324:7092]
2025-10-01T14:12:35.844783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:35.844787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:35.844815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:35.844817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1714 reason: error at write: Disconnected sessionId: src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0
2025-10-01T14:12:35.845080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1714 sessionId: src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0 is DEAD
2025-10-01T14:12:35.845183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:35.845195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0] Write session will restart in 0.005326s
2025-10-01T14:12:35.845223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0] Write session: Do CDS request
2025-10-01T14:12:35.845230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:35.842874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.842949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.843015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.843077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.843080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.843149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.843223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.843295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.843358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.843403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.843406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.843473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.843534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.843595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.843658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.843793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.843797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.843871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.843934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.843994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.844057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.844103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.844107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.844186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:35.844248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:35.844314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:35.844379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:35.844424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:35.844427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:35.844519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740687324:7092], now have 1 active actors on pipe
2025-10-01T14:12:35.845225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:35.851903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.851957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:35.851970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1715
2025-10-01T14:12:35.852098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:35.852128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:35.852138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:35.852141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:35.852477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1715 sessionId:  describe result for acl check
2025-10-01T14:12:35.852505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:35.852512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:35.852513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:35.852517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256033740687365:6994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:35.852910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256033740687365:6994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:35.855745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256033740687365:6994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:35.859202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256033740687365:6994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:35.859217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256033740687365:6994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:35.859222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256033740687365:6994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:35.859229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:35.863294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:35.865990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:35.866165Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:35.866172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:35.866180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:35.866225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:35.866262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256031363791396:4089]
2025-10-01T14:12:35.866815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:35.867130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:35.867175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:35.867502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:35.867561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.867568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.867569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.867570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.867571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.867572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.867573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.867575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.867576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.867577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.867578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.867579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.867580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.867582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.867586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.867595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.867600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.867604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.867608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.867611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.867615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.867620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.867623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.867628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.867631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.867635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.867639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.867643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.867651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.867659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:35.867665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.867670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:35.867675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.867680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:35.867684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.867689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:35.867696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.867702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:35.867707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.867716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:35.867721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.867727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:35.867730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.867735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:35.867742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.867746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:35.867750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.867755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.867762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.867767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.867770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.867775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.867780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.867784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:35.867788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.867792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:35.867823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:35.871485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:35.872244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:35.872261Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:35.872264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:35.872268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:35.872276Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1714 [2:7556256031363791396:4089]
2025-10-01T14:12:35.872658Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:35.872685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:35.872693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.872696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.872699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.872714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:35.872724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:35.872731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:35.872791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.872798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.872800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.872803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:35.872806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:35.872877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:35.872885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.872899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:35.872911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:35.872931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:35.872954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740687594:6994], now have 1 active actors on pipe
2025-10-01T14:12:35.872962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740687329:2446], now have 1 active actors on pipe
2025-10-01T14:12:35.872969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256031363791391:4089]
2025-10-01T14:12:35.872971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256031363791391:4089]
2025-10-01T14:12:35.872973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256031363791391:4089]
2025-10-01T14:12:35.872987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:35.873004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:35.873012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:35.873015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:35.873016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:35.873023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:35.873027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:35.873013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1714
2025-10-01T14:12:35.873014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1714
2025-10-01T14:12:35.873058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256031363791391:4089]
2025-10-01T14:12:35.873070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:35.873074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:35.873090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.873099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.873146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:35.873157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:35.873165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:35.873167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:35.873176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:35.873188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:35.873209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.873347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.873357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.873373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:35.873440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1715 partition: 0 MaxSeqNo: 45 sessionId: src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0
2025-10-01T14:12:35.873820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a792b952-32eb6b8c-ba8d8b1b-5b07ef59_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:35.876045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0] Write session: try to update token
2025-10-01T14:12:35.876061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:35.889954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1715 sessionId: src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:35.892139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:35.893672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:35.893705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:35.893725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:35.893734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:35.893737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:35.893739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:35.893748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256031363791391:4089]
2025-10-01T14:12:35.893752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256031363791391:4089]
2025-10-01T14:12:35.893756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256031363791391:4089]
2025-10-01T14:12:35.893786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:35.893796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:35.893799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:35.893812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:35.893825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:35.893829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:35.893955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:35.944987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256033740687712:7092]
2025-10-01T14:12:35.945146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1714, pipe: [1:7556256033740687712:7092]
2025-10-01T14:12:36.035734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:36.035950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:36.035995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256033740687712:7092], now have 1 active actors on pipe
2025-10-01T14:12:36.036098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:36.036125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:36.036181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256033740687712:7092]
2025-10-01T14:12:36.036182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:36.036185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:36.036252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1715 reason: error at write: Disconnected sessionId: src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0
2025-10-01T14:12:36.036419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1715 sessionId: src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0 is DEAD
2025-10-01T14:12:36.036557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:36.036564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0] Write session will restart in 0.007349s
2025-10-01T14:12:36.036582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0] Write session: Do CDS request
2025-10-01T14:12:36.036589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:36.044857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.044921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:36.044933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1716
2025-10-01T14:12:36.045047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.045071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:36.045078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:36.045080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:36.045452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1716 sessionId:  describe result for acl check
2025-10-01T14:12:36.045492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:36.045499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:36.045501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:36.045506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256038035655097:6989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:36.046035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256038035655097:6989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:36.048039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256038035655097:6989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:36.050983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256038035655097:6989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:36.050999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256038035655097:6989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:36.051002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256038035655097:6989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:36.051010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:36.055066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:36.057483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:36.057631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:36.057641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:36.057651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:36.057695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:36.057722Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256035658758991:4083]
2025-10-01T14:12:36.058153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:36.058412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:36.058458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:36.058692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:36.058738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.058743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.058744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.058745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.058745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.058746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.058747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.058747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.058748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.058749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.058750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.058750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.058751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.058752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.058756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.058766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.058769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.058773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.058777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.058780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.058784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.058787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.058791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.058796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.058800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.058803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.058806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.058814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.058821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.058835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.058841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.058846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.058850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.058856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.058860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.058869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.058878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.058883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.058891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.058896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.058901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.058910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.058918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.058928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.058937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.058944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.058947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.058954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.058956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.058959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.058961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.058967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.058970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.058973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.058975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.058978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.058999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:36.062619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:36.063676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:36.063692Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:36.063695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:36.063698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:36.063706Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1715 [2:7556256035658758991:4083]
2025-10-01T14:12:36.063722Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:36.063747Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:36.063756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.063761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.063763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.063780Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:36.063794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:36.063802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:36.063859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.063869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.063871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.063875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:36.063878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:36.063956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:36.063964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.063974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.063985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.064002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:36.064030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035655294:6989], now have 1 active actors on pipe
2025-10-01T14:12:36.064041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035655011:2446], now have 1 active actors on pipe
2025-10-01T14:12:36.064054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256035658758986:4083]
2025-10-01T14:12:36.064063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256035658758986:4083]
2025-10-01T14:12:36.064065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256035658758986:4083]
2025-10-01T14:12:36.064053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1715
2025-10-01T14:12:36.064053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1715
2025-10-01T14:12:36.064082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:36.064089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:36.064091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:36.064093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:36.064107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:36.064125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:36.064128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:36.064160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256035658758986:4083]
2025-10-01T14:12:36.064170Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:36.064203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:36.064229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.064241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.064270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:36.064287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.064292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.064301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:36.064312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.064328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:36.064344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.064527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.064536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.064551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.064627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1716 partition: 0 MaxSeqNo: 45 sessionId: src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0
2025-10-01T14:12:36.064996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a650c374-45f6d2ec-c5531306-14b3fb23_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:36.067267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0] Write session: try to update token
2025-10-01T14:12:36.067282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:36.080108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1716 sessionId: src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:36.080780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:36.080793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:36.080802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256035658758986:4083]
2025-10-01T14:12:36.080839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:36.080855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:36.081024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:36.081191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:36.081319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:36.081446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:36.081664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:36.081712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:36.082388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:36.082564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.082577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.082602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:36.082673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:36.095502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:36.095521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:36.095524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:36.095526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:36.095536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256035658758986:4083]
2025-10-01T14:12:36.095541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256035658758986:4083]
2025-10-01T14:12:36.095545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256035658758986:4083]
2025-10-01T14:12:36.095590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:36.095603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.095605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:36.095650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:36.095665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:36.095668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:36.095720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:36.136486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256038035655394:7092]
2025-10-01T14:12:36.136804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1715, pipe: [1:7556256038035655394:7092]
2025-10-01T14:12:36.246794Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:36.253567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.253591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.253735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.253791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.253849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.253907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.254085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.254094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.254154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.254207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.254260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.254316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.254354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.254359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.254440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.254509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.254578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.254688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.254746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.254754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.254825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.254896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.254964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.255026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.255072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.255079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.255151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.255217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.255282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.255351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.255399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.255406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.255475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.255540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.255610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.255665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.255706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.255711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.255776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.255833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.255893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.255970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.256021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.256026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.256084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.256157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.256217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.256274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.256312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.256317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.256375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.256454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.256506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.256559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.256611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.256616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.256684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.256734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.256788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.256842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.256888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.256896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.256940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035655394:7092], now have 1 active actors on pipe
2025-10-01T14:12:36.257169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256038035655394:7092]
2025-10-01T14:12:36.257189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:36.257212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:36.257216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:36.257243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1716 reason: error at write: Disconnected sessionId: src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0
2025-10-01T14:12:36.257452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1716 sessionId: src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0 is DEAD
2025-10-01T14:12:36.257559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:36.257567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0] Write session will restart in 0.005900s
2025-10-01T14:12:36.257584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0] Write session: Do CDS request
2025-10-01T14:12:36.257589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:36.257686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:36.264862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.264946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:36.264957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1717
2025-10-01T14:12:36.265176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.265211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:36.265224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:36.265227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:36.265604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1717 sessionId:  describe result for acl check
2025-10-01T14:12:36.265626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:36.265630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:36.265631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:36.265635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256038035655498:6972] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:36.266025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256038035655498:6972] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:36.269018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256038035655498:6972] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:36.271882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256038035655498:6972] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:36.271895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256038035655498:6972] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:36.271898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256038035655498:6972] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:36.271915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:36.275204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:36.277326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:36.277480Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:36.277487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:36.277494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:36.277525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:36.277551Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256035658759310:4063]
2025-10-01T14:12:36.277959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:36.278164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:36.278190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:36.278409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:36.278446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.278450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.278451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.278452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.278452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.278453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.278454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.278454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.278455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.278455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.278456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.278457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.278457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.278458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.278461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.278467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.278469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.278471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.278473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.278475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.278477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.278479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.278482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.278485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.278487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.278489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.278491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.278493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.278498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.278502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.278506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.278509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.278512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.278515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.278517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.278519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.278522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.278525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.278527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.278529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.278532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.278535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.278537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.278539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.278542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.278545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.278547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.278551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.278555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.278557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.278559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.278562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.278564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.278567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.278569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.278572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.278590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:36.281955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:36.282720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:36.282730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:36.282732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:36.282734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:36.282739Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1716 [2:7556256035658759310:4063]
2025-10-01T14:12:36.282750Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:36.282762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:36.282764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.282766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.282767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.282779Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:36.282786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:36.282790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:36.282826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.282830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.282832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.282834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:36.282836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:36.282883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:36.282888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.282895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.282901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.282909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:36.282924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256035658759305:4063]
2025-10-01T14:12:36.282929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256035658759305:4063]
2025-10-01T14:12:36.282931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256035658759305:4063]
2025-10-01T14:12:36.282936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:36.282946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:36.282948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035655420:2446], now have 1 active actors on pipe
2025-10-01T14:12:36.282948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:36.282951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035655715:6972], now have 1 active actors on pipe
2025-10-01T14:12:36.282951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:36.282956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:36.282964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:36.282966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:36.282984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256035658759305:4063]
2025-10-01T14:12:36.282993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:36.283005Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:36.282999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1716
2025-10-01T14:12:36.283327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1716
2025-10-01T14:12:36.283402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.283410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.283428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2179e547-dac29682-82ffa638-32c1ca35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:36.283437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.283440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.283442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:36.283448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.283455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:36.283468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.283597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.283602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.283610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.283675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1717 partition: 0 MaxSeqNo: 45 sessionId: src_id|2179e547-dac29682-82ffa638-32c1ca35_0
2025-10-01T14:12:36.283994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2eb9799f-85052a73-5d7f49ff-e338ba8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2179e547-dac29682-82ffa638-32c1ca35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:36.286234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2179e547-dac29682-82ffa638-32c1ca35_0] Write session: try to update token
2025-10-01T14:12:36.286248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2179e547-dac29682-82ffa638-32c1ca35_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:36.292801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:36.292821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:36.292832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256035658759305:4063]
2025-10-01T14:12:36.292865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:36.292866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:36.293030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:36.293158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:36.293312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:36.293441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:36.293629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:36.293657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:36.299402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1717 sessionId: src_id|2179e547-dac29682-82ffa638-32c1ca35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:36.301594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:36.301775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.301793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.301822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:36.301906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:36.310952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:36.310969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:36.310970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:36.310971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:36.310981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256035658759305:4063]
2025-10-01T14:12:36.310984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256035658759305:4063]
2025-10-01T14:12:36.310987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256035658759305:4063]
2025-10-01T14:12:36.311023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:36.311027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.311029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:36.311038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:36.311044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:36.311058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:36.311147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:36.357162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256038035655814:7092]
2025-10-01T14:12:36.357518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1716, pipe: [1:7556256038035655814:7092]
2025-10-01T14:12:36.452055Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:36.460101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.460131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.460313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.460383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.460461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.460529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.460579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.460590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.460679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.460748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.460813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.460881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.460930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.460939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.461016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.461082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.461154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.461228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.461278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.461285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.461362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.461436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.461508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.461581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.461631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.461638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.461712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.461785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.461860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.461931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.461981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.461988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.462064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.462136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.462207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.462282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.462331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.462340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.462451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.462527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.462605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.462684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.462735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.462744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.462829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.462902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.462979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.463051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.463100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.463108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.463186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.463256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.463334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.463420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.463471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.463479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.463561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.463638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.463713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.463790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.463841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.463849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.463911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035655814:7092], now have 1 active actors on pipe
2025-10-01T14:12:36.464116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:36.464123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:36.464127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:36.464153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1717 reason: error at write: Disconnected sessionId: src_id|2179e547-dac29682-82ffa638-32c1ca35_0
2025-10-01T14:12:36.464162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256038035655814:7092]
2025-10-01T14:12:36.464354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1717 sessionId: src_id|2179e547-dac29682-82ffa638-32c1ca35_0 is DEAD
2025-10-01T14:12:36.464468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2179e547-dac29682-82ffa638-32c1ca35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:36.464478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2179e547-dac29682-82ffa638-32c1ca35_0] Write session will restart in 0.005686s
2025-10-01T14:12:36.464504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2179e547-dac29682-82ffa638-32c1ca35_0] Write session: Do CDS request
2025-10-01T14:12:36.464509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2179e547-dac29682-82ffa638-32c1ca35_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:36.465166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:36.471900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2179e547-dac29682-82ffa638-32c1ca35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.471957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:36.471972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1718
2025-10-01T14:12:36.472165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.472201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:36.472210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:36.472214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:36.472622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1718 sessionId:  describe result for acl check
2025-10-01T14:12:36.472664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:36.472669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:36.472670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:36.472674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256038035655900:6965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:36.473084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256038035655900:6965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:36.475344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256038035655900:6965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:36.477931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256038035655900:6965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:36.477944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256038035655900:6965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:36.477947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256038035655900:6965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:36.477954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:36.483350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:36.485343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:36.485491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:36.485498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:36.485506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:36.485542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:36.485570Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256035658759623:4071]
2025-10-01T14:12:36.485975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:36.486158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:36.486185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:36.486426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:36.486489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.486495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.486496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.486497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.486498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.486499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.486500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.486501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.486502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.486503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.486504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.486505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.486506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.486507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.486512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.486521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.486524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.486528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.486531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.486534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.486537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.486541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.486544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.486548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.486552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.486555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.486558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.486562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.486567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.486574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.486580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.486589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.486593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.486602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.486610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.486614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.486622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.486628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.486632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.486637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.486645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.486654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.486662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.486666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.486675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.486683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.486689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.486693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.486701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.486707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.486714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.486719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.486726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.486731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.486738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.486743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.486781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:36.490178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:36.490728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:36.490740Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:36.490741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:36.490743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:36.490749Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1717 [2:7556256035658759623:4071]
2025-10-01T14:12:36.490766Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:36.490782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:36.490783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.490786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.490787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.490797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:36.490801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:36.490806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:36.490854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.490859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.490861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.490863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:36.490865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:36.490909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:36.490914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.490921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.490926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.490938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:36.490954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256035658759618:4071]
2025-10-01T14:12:36.490958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256035658759618:4071]
2025-10-01T14:12:36.490960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256035658759618:4071]
2025-10-01T14:12:36.490965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:36.490974Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:36.490977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035655824:2446], now have 1 active actors on pipe
2025-10-01T14:12:36.490982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:36.490982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:36.490983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:36.490990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:36.490992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:36.490995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035656077:6965], now have 1 active actors on pipe
2025-10-01T14:12:36.491011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256035658759618:4071]
2025-10-01T14:12:36.491019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:36.491026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:36.491050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1717
2025-10-01T14:12:36.491087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.491095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.491112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:36.491119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.491108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1717
2025-10-01T14:12:36.491124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.491125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:36.491131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.491137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:36.491154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.491264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.491271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.491281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.491349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1718 partition: 0 MaxSeqNo: 45 sessionId: src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0
2025-10-01T14:12:36.491674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2179e547-dac29682-82ffa638-32c1ca35_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:36.493861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0] Write session: try to update token
2025-10-01T14:12:36.493875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:36.506556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1718 sessionId: src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:36.508887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:36.510580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.510610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.510634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:36.510636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:36.510638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:36.510640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:36.510661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256035658759618:4071]
2025-10-01T14:12:36.510671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256035658759618:4071]
2025-10-01T14:12:36.510675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256035658759618:4071]
2025-10-01T14:12:36.510714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:36.510724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:36.510727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:36.510729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:36.510735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.510737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:36.510869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:36.564526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256038035656211:7092]
2025-10-01T14:12:36.564813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1717, pipe: [1:7556256038035656211:7092]
2025-10-01T14:12:36.648663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:36.649356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:36.649404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035656211:7092], now have 1 active actors on pipe
2025-10-01T14:12:36.649625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:36.649655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256038035656211:7092]
2025-10-01T14:12:36.649669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:36.649698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:36.649702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:36.649755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1718 reason: error at write: Disconnected sessionId: src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0
2025-10-01T14:12:36.650039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:36.650051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0] Write session will restart in 0.007661s
2025-10-01T14:12:36.650073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0] Write session: Do CDS request
2025-10-01T14:12:36.650080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:36.649899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1718 sessionId: src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0 is DEAD
2025-10-01T14:12:36.658886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.658954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:36.658968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1719
2025-10-01T14:12:36.659169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.659206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:36.659216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:36.659219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:36.659628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1719 sessionId:  describe result for acl check
2025-10-01T14:12:36.659661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:36.659667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:36.659669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:36.659674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256038035656376:6956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:36.660172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256038035656376:6956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:36.662438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256038035656376:6956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:36.665317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256038035656376:6956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:36.665329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256038035656376:6956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:36.665332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256038035656376:6956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:36.665350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:36.667260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:36.669447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:36.669576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:36.669584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:36.669591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:36.669619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:36.669650Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256035658759941:4052]
2025-10-01T14:12:36.670049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:36.670325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:36.670404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:36.670705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:36.670757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.670763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.670764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.670765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.670766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.670767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.670769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.670770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.670771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.670772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.670773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.670774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.670774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.670776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.670780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.670789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.670792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.670796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.670799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.670802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.670805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.670808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.670811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.670815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.670822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.670825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.670830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.670833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.670844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.670856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.670865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.670874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.670881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.670885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.670892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.670896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.670904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.670908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.670916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.670921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.670929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.670933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.670936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.670941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.670945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.670953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.670957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.670965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.670968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.670973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.670980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.670984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.670991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.670995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.671003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.671007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.671058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:36.674463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:36.675034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:36.675046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:36.675049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:36.675052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:36.675058Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1718 [2:7556256035658759941:4052]
2025-10-01T14:12:36.675076Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:36.675093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:36.675100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.675103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.675109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.675124Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:36.675133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:36.675143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:36.675195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.675201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.675203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.675205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:36.675208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:36.675267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:36.675273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.675282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.675295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.675311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:36.675329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035656581:6956], now have 1 active actors on pipe
2025-10-01T14:12:36.675336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035656214:2446], now have 1 active actors on pipe
2025-10-01T14:12:36.675342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256035658759936:4052]
2025-10-01T14:12:36.675345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256035658759936:4052]
2025-10-01T14:12:36.675351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256035658759936:4052]
2025-10-01T14:12:36.675363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:36.675379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:36.675385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:36.675388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:36.675390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:36.675395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:36.675397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:36.675426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256035658759936:4052]
2025-10-01T14:12:36.675432Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:36.675401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1718
2025-10-01T14:12:36.675434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:36.675407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1718
2025-10-01T14:12:36.675458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.675462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.675490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63f9236d-7cba439b-9c108430-621255ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:36.675500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.675503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.675509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:36.675518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.675529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:36.675547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.675675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.675683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.675695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.675793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1719 partition: 0 MaxSeqNo: 45 sessionId: src_id|63f9236d-7cba439b-9c108430-621255ca_0
2025-10-01T14:12:36.676131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2bc1f95-a806fef4-e786a379-14bafb26_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|63f9236d-7cba439b-9c108430-621255ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:36.678355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f9236d-7cba439b-9c108430-621255ca_0] Write session: try to update token
2025-10-01T14:12:36.678368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f9236d-7cba439b-9c108430-621255ca_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:36.690710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1719 sessionId: src_id|63f9236d-7cba439b-9c108430-621255ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:36.692972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:36.693147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.693168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.693214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:36.693283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:36.694999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:36.695012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:36.695014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:36.695015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:36.695022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256035658759936:4052]
2025-10-01T14:12:36.695025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256035658759936:4052]
2025-10-01T14:12:36.695027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256035658759936:4052]
2025-10-01T14:12:36.695059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:36.695060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:36.695065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.695067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:36.695067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:36.695070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:36.695170Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:36.749872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256038035656599:7092]
2025-10-01T14:12:36.750172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1718, pipe: [1:7556256038035656599:7092]
2025-10-01T14:12:36.842008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:36.850505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.850529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.850683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.850739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.850795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.850852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.850893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.850902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.850961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.851014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.851072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.851128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.851171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.851178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.851240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.851298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.851350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.851402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.851441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.851447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.851501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.851553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.851608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.851662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.851705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.851712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.851765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.851814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.851865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.851917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.851954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.851960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.852015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.852063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.852117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.852176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.852219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.852225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.852284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.852349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.852438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.852510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.852621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.852630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.852702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.852760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.852816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.852878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.852923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.852930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.852993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.853047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.853099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.853155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.853208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.853215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.853277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:36.853329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:36.853385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:36.853440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:36.853482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:36.853488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:36.853543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035656599:7092], now have 1 active actors on pipe
2025-10-01T14:12:36.853742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256038035656599:7092]
2025-10-01T14:12:36.853765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:36.853766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:36.853770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:36.853794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1719 reason: error at write: Disconnected sessionId: src_id|63f9236d-7cba439b-9c108430-621255ca_0
2025-10-01T14:12:36.853995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1719 sessionId: src_id|63f9236d-7cba439b-9c108430-621255ca_0 is DEAD
2025-10-01T14:12:36.854110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f9236d-7cba439b-9c108430-621255ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:36.854119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f9236d-7cba439b-9c108430-621255ca_0] Write session will restart in 0.009394s
2025-10-01T14:12:36.854140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f9236d-7cba439b-9c108430-621255ca_0] Write session: Do CDS request
2025-10-01T14:12:36.854146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f9236d-7cba439b-9c108430-621255ca_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:36.854681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:36.864865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63f9236d-7cba439b-9c108430-621255ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.864961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:36.864974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1720
2025-10-01T14:12:36.865073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:36.865104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:36.865110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:36.865116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:36.865534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1720 sessionId:  describe result for acl check
2025-10-01T14:12:36.865566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:36.865572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:36.865573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:36.865578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256038035656799:6954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:36.866072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256038035656799:6954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:36.868557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256038035656799:6954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:36.871290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256038035656799:6954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:36.871303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256038035656799:6954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:36.871306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256038035656799:6954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:36.871314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:36.871542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:36.871974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:36.872128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:36.872140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:36.872150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:36.872197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:36.872246Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256035658760242:4040]
2025-10-01T14:12:36.872852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:36.874206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:36.874248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:36.874759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:36.874825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.874831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.874832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.874833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.874834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.874835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.874837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.874838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.874839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.874840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.874841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.874842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.874843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.874844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.874849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.874859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.874863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.874867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.874870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.874874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.874877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.874880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.874884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.874887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.874891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.874895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.874898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.874902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.874909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.874916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:36.874926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.874936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:36.874944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.874954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:36.874961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.874971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:36.874978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.874983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:36.874990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.874998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:36.875005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.875010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:36.875017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.875021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:36.875030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.875039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:36.875046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.875055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.875062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.875070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.875079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.875083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.875091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.875096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:36.875103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.875107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:36.875143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:36.878859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:36.879437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:36.879451Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:36.879454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:36.879457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:36.879463Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1719 [2:7556256035658760242:4040]
2025-10-01T14:12:36.879476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:36.879491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:36.879494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.879497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.879500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.879513Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:36.879519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:36.879527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:36.879575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.879583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.879585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.879588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:36.879590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:36.879652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:36.879660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.879670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:36.879681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:36.879701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:36.879722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035656978:6954], now have 1 active actors on pipe
2025-10-01T14:12:36.879729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035656604:2446], now have 1 active actors on pipe
2025-10-01T14:12:36.879736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256035658760237:4040]
2025-10-01T14:12:36.879743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256035658760237:4040]
2025-10-01T14:12:36.879745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256035658760237:4040]
2025-10-01T14:12:36.879758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:36.879769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:36.879772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:36.879774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:36.879757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1719
2025-10-01T14:12:36.879776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:36.879757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1719
2025-10-01T14:12:36.879789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:36.879792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:36.879832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.879841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.879858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256035658760237:4040]
2025-10-01T14:12:36.879870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:36.879880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:36.879899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a86196d8-e2e4292f-f409000a-fc91494_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:36.879909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:36.879917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:36.879920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:36.879927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:36.879939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:36.879963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.880100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.880111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.880127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:36.880208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1720 partition: 0 MaxSeqNo: 45 sessionId: src_id|a86196d8-e2e4292f-f409000a-fc91494_0
2025-10-01T14:12:36.880556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63f9236d-7cba439b-9c108430-621255ca_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a86196d8-e2e4292f-f409000a-fc91494_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:36.882924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a86196d8-e2e4292f-f409000a-fc91494_0] Write session: try to update token
2025-10-01T14:12:36.882939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a86196d8-e2e4292f-f409000a-fc91494_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:36.896667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1720 sessionId: src_id|a86196d8-e2e4292f-f409000a-fc91494_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:36.899053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:36.899498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:36.899519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:36.899536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:36.899539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:36.899540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:36.899541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:36.899548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256035658760237:4040]
2025-10-01T14:12:36.899552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256035658760237:4040]
2025-10-01T14:12:36.899554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256035658760237:4040]
2025-10-01T14:12:36.899598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:36.899601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:36.899607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:36.899608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:36.899608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:36.899611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:36.899733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:36.954123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256038035656991:7092]
2025-10-01T14:12:36.954290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1719, pipe: [1:7556256038035656991:7092]
2025-10-01T14:12:37.045148Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:37.045800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:37.045857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256038035656991:7092], now have 1 active actors on pipe
2025-10-01T14:12:37.045931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:37.046004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256038035656991:7092]
2025-10-01T14:12:37.046016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:37.046019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:37.046030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:37.046071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1720 reason: error at write: Disconnected sessionId: src_id|a86196d8-e2e4292f-f409000a-fc91494_0
2025-10-01T14:12:37.046180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1720 sessionId: src_id|a86196d8-e2e4292f-f409000a-fc91494_0 is DEAD
2025-10-01T14:12:37.046340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86196d8-e2e4292f-f409000a-fc91494_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:37.046351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86196d8-e2e4292f-f409000a-fc91494_0] Write session will restart in 0.007845s
2025-10-01T14:12:37.046385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86196d8-e2e4292f-f409000a-fc91494_0] Write session: Do CDS request
2025-10-01T14:12:37.046391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86196d8-e2e4292f-f409000a-fc91494_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:37.054823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a86196d8-e2e4292f-f409000a-fc91494_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.054945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:37.054960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1721
2025-10-01T14:12:37.055068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.055100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:37.055110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:37.055113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:37.055507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1721 sessionId:  describe result for acl check
2025-10-01T14:12:37.055539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:37.055545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:37.055546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:37.055551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256042330624436:6947] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:37.056010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256042330624436:6947] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:37.058162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256042330624436:6947] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:37.060665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256042330624436:6947] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:37.060675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256042330624436:6947] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:37.060677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256042330624436:6947] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:37.060682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:37.063177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:37.065119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:37.065261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:37.065269Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:37.065277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:37.065308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:37.065332Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256039953727843:4047]
2025-10-01T14:12:37.065690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:37.065861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:37.065895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:37.066079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:37.066110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.066116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.066116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.066117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.066118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.066118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.066119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.066119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.066120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.066121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.066121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.066122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.066122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.066123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.066126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.066132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.066134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.066136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.066138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.066140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.066142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.066144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.066146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.066148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.066150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.066152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.066155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.066156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.066161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.066164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.066168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.066171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.066174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.066176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.066179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.066181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.066183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.066186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.066188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.066191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.066193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.066196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.066198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.066201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.066203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.066207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.066211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.066215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.066219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.066223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.066226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.066231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.066235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.066239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.066244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.066248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.066268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:37.069474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:37.070017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:37.070030Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:37.070031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:37.070033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:37.070038Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1720 [2:7556256039953727843:4047]
2025-10-01T14:12:37.070050Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:37.070062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:37.070067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.070068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.070070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.070081Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:37.070088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:37.070092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:37.070130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.070134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.070135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.070137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:37.070139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:37.070305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1720
2025-10-01T14:12:37.070309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1720
2025-10-01T14:12:37.070460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:37.070468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.070478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.070488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.070511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:37.070530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330624615:6947], now have 1 active actors on pipe
2025-10-01T14:12:37.070536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330624289:2446], now have 1 active actors on pipe
2025-10-01T14:12:37.070547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.070553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.070570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256039953727838:4047]
2025-10-01T14:12:37.070574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256039953727838:4047]
2025-10-01T14:12:37.070576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256039953727838:4047]
2025-10-01T14:12:37.070585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:37.070598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:37.070607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:37.070609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:37.070611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:37.070617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:37.070619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:37.070622Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30730e13-3408f84-56cdedad-8911ebd6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:37.070627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.070634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.070635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:37.070640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.070649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:37.070671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256039953727838:4047]
2025-10-01T14:12:37.070680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:37.070687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.070693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:37.070803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.070812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.070829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.070895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1721 partition: 0 MaxSeqNo: 45 sessionId: src_id|30730e13-3408f84-56cdedad-8911ebd6_0
2025-10-01T14:12:37.071231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a86196d8-e2e4292f-f409000a-fc91494_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|30730e13-3408f84-56cdedad-8911ebd6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:37.073580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30730e13-3408f84-56cdedad-8911ebd6_0] Write session: try to update token
2025-10-01T14:12:37.073595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30730e13-3408f84-56cdedad-8911ebd6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:37.080708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:37.080723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:37.080730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256039953727838:4047]
2025-10-01T14:12:37.080765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:37.080773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:37.080908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:37.081033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:37.081162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:37.081281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:37.081454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:37.081500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:37.086550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1721 sessionId: src_id|30730e13-3408f84-56cdedad-8911ebd6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:37.088661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:37.088815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.088834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.088862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:37.088933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:37.099092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:37.099108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:37.099111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:37.099113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:37.099122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256039953727838:4047]
2025-10-01T14:12:37.099127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256039953727838:4047]
2025-10-01T14:12:37.099130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256039953727838:4047]
2025-10-01T14:12:37.099161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:37.099165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:37.099171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:37.099167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:37.099179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.099182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:37.099305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:37.146163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256042330624684:7092]
2025-10-01T14:12:37.146409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1720, pipe: [1:7556256042330624684:7092]
2025-10-01T14:12:37.234317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:37.241006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.241027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.241161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.241214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.241267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.241324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.241366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.241373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.241442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.241504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.241572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.241641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.241691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.241699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.241765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.241826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.241882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.241933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.241971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.241976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.242031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.242083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.242131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.242183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.242220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.242225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.242284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.242334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.242415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.242476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.242516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.242521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.242582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.242635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.242690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.242741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.242782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.242788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.242842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.242890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.242944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.242993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.243029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.243034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.243116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.243166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.243214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.243264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.243302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.243307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.243356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.243403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.243452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.243499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.243536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.243541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.243590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.243636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.243685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.243734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.243770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.243776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.243809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330624684:7092], now have 1 active actors on pipe
2025-10-01T14:12:37.244022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256042330624684:7092]
2025-10-01T14:12:37.244033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:37.244036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:37.244052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:37.244060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1721 reason: error at write: Disconnected sessionId: src_id|30730e13-3408f84-56cdedad-8911ebd6_0
2025-10-01T14:12:37.244249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1721 sessionId: src_id|30730e13-3408f84-56cdedad-8911ebd6_0 is DEAD
2025-10-01T14:12:37.244343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30730e13-3408f84-56cdedad-8911ebd6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:37.244361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30730e13-3408f84-56cdedad-8911ebd6_0] Write session will restart in 0.007835s
2025-10-01T14:12:37.244380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30730e13-3408f84-56cdedad-8911ebd6_0] Write session: Do CDS request
2025-10-01T14:12:37.244385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30730e13-3408f84-56cdedad-8911ebd6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:37.244508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:37.252861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30730e13-3408f84-56cdedad-8911ebd6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.252957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:37.252972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1722
2025-10-01T14:12:37.253070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.253102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:37.253111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:37.253115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:37.253497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1722 sessionId:  describe result for acl check
2025-10-01T14:12:37.253533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:37.253534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:37.253536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:37.253541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256042330624839:6925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:37.253990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256042330624839:6925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:37.256826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256042330624839:6925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:37.259580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256042330624839:6925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:37.259590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256042330624839:6925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:37.259593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256042330624839:6925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:37.259599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:37.262173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:37.264615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:37.264771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:37.264779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:37.264797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:37.264842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:37.264875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256039953728165:4043]
2025-10-01T14:12:37.265347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:37.265568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:37.265606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:37.265848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:37.265896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.265901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.265901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.265902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.265903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.265904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.265904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.265905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.265905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.265906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.265907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.265907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.265908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.265909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.265912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.265918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.265922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.265926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.265929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.265932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.265936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.265940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.265944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.265948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.265952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.265955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.265959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.265963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.265970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.265977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.265982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.265992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.266001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.266006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.266013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.266018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.266025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.266029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.266036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.266041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.266049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.266057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.266060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.266068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.266072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.266080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.266087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.266091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.266099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.266107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.266114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.266118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.266125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.266131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.266139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.266147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.266187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:37.269734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:37.270476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:37.270491Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:37.270493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:37.270495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:37.270502Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1721 [2:7556256039953728165:4043]
2025-10-01T14:12:37.270517Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:37.270533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:37.270535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.270539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.270541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.270556Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:37.270561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:37.270572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:37.270624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.270633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.270635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.270638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:37.270641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:37.270707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:37.270714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.270726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.270740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.270759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:37.270782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330624712:2446], now have 1 active actors on pipe
2025-10-01T14:12:37.270790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625048:6925], now have 1 active actors on pipe
2025-10-01T14:12:37.270797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256039953728160:4043]
2025-10-01T14:12:37.270804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256039953728160:4043]
2025-10-01T14:12:37.270806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256039953728160:4043]
2025-10-01T14:12:37.270820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:37.270839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:37.270839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:37.270842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:37.270844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:37.270862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:37.270824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1721
2025-10-01T14:12:37.270865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:37.270831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1721
2025-10-01T14:12:37.270912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.270920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.270933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256039953728160:4043]
2025-10-01T14:12:37.270945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:37.270959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:37.270974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|662d179e-69ae5b86-88d11270-c873c786_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:37.270987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.270993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.270997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:37.271006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.271014Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:37.271042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.271197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.271205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.271219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.271299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1722 partition: 0 MaxSeqNo: 45 sessionId: src_id|662d179e-69ae5b86-88d11270-c873c786_0
2025-10-01T14:12:37.271717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30730e13-3408f84-56cdedad-8911ebd6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|662d179e-69ae5b86-88d11270-c873c786_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:37.274106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|662d179e-69ae5b86-88d11270-c873c786_0] Write session: try to update token
2025-10-01T14:12:37.274123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|662d179e-69ae5b86-88d11270-c873c786_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:37.286876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1722 sessionId: src_id|662d179e-69ae5b86-88d11270-c873c786_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:37.289313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:37.290181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.290204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.290225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:37.290228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:37.290231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:37.290233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:37.290242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256039953728160:4043]
2025-10-01T14:12:37.290248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256039953728160:4043]
2025-10-01T14:12:37.290252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256039953728160:4043]
2025-10-01T14:12:37.290297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:37.290301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:37.290305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.290307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:37.290307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:37.290311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:37.290437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:37.344313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256042330625110:7092]
2025-10-01T14:12:37.344602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1721, pipe: [1:7556256042330625110:7092]
2025-10-01T14:12:37.427219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:37.427697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:37.427743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625110:7092], now have 1 active actors on pipe
2025-10-01T14:12:37.427854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:37.427904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:37.427931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:37.427936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:37.427942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256042330625110:7092]
2025-10-01T14:12:37.428005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1722 reason: error at write: Disconnected sessionId: src_id|662d179e-69ae5b86-88d11270-c873c786_0
2025-10-01T14:12:37.428148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1722 sessionId: src_id|662d179e-69ae5b86-88d11270-c873c786_0 is DEAD
2025-10-01T14:12:37.428296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662d179e-69ae5b86-88d11270-c873c786_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:37.428307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662d179e-69ae5b86-88d11270-c873c786_0] Write session will restart in 0.005122s
2025-10-01T14:12:37.428334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662d179e-69ae5b86-88d11270-c873c786_0] Write session: Do CDS request
2025-10-01T14:12:37.428342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662d179e-69ae5b86-88d11270-c873c786_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:37.434729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|662d179e-69ae5b86-88d11270-c873c786_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.434802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:37.434812Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1723
2025-10-01T14:12:37.434915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.434958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:37.434967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:37.434970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:37.435362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1723 sessionId:  describe result for acl check
2025-10-01T14:12:37.435395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:37.435403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:37.435404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:37.435411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256042330625176:6920] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:37.435907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256042330625176:6920] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:37.437918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256042330625176:6920] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:37.440999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256042330625176:6920] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:37.441012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256042330625176:6920] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:37.441015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256042330625176:6920] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:37.441021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:37.444422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:37.446307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:37.446481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:37.446490Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:37.446502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:37.446548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:37.446586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256039953728469:4034]
2025-10-01T14:12:37.446961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:37.447135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:37.447169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:37.447363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:37.447406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.447411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.447412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.447412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.447414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.447415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.447416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.447417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.447418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.447419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.447420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.447421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.447422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.447423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.447428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.447437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.447441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.447446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.447449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.447453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.447457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.447461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.447465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.447469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.447473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.447477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.447480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.447483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.447489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.447496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.447504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.447509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.447514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.447519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.447523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.447527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.447532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.447537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.447542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.447550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.447555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.447560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.447565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.447570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.447574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.447580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.447585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.447592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.447596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.447601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.447608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.447613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.447617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.447624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.447631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.447636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.447673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:37.450948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:37.451564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:37.451573Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:37.451575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:37.451577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:37.451581Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1722 [2:7556256039953728469:4034]
2025-10-01T14:12:37.451590Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:37.451602Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:37.451607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.451609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.451611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.451621Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:37.451628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:37.451632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:37.451669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.451674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.451675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.451677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:37.451679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:37.451721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:37.451726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.451733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.451742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.451751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:37.451762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256039953728464:4034]
2025-10-01T14:12:37.451767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256039953728464:4034]
2025-10-01T14:12:37.451768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256039953728464:4034]
2025-10-01T14:12:37.451774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:37.451782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625115:2446], now have 1 active actors on pipe
2025-10-01T14:12:37.451782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:37.451785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:37.451786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625400:6920], now have 1 active actors on pipe
2025-10-01T14:12:37.451787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:37.451792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:37.451800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:37.451801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:37.451821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256039953728464:4034]
2025-10-01T14:12:37.451831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:37.451837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1722
2025-10-01T14:12:37.451855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:37.451882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1722
2025-10-01T14:12:37.451930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.451937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.451953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:37.451958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.451961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.451962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:37.451968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.451977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:37.451988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.452116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.452126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.452146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.452204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1723 partition: 0 MaxSeqNo: 45 sessionId: src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0
2025-10-01T14:12:37.452550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|662d179e-69ae5b86-88d11270-c873c786_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:37.454851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0] Write session: try to update token
2025-10-01T14:12:37.454870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:37.467938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1723 sessionId: src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:37.470091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:37.470662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.470687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.470707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:37.470711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:37.470713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:37.470715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:37.470724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256039953728464:4034]
2025-10-01T14:12:37.470729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256039953728464:4034]
2025-10-01T14:12:37.470732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256039953728464:4034]
2025-10-01T14:12:37.470767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:37.470779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:37.470782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:37.470787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:37.470794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.470797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:37.470921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:37.528060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256042330625510:7092]
2025-10-01T14:12:37.528345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1722, pipe: [1:7556256042330625510:7092]
2025-10-01T14:12:37.603883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:37.604521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:37.604571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625510:7092], now have 1 active actors on pipe
2025-10-01T14:12:37.604651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:37.604772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256042330625510:7092]
2025-10-01T14:12:37.604799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:37.615026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:37.615038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:37.615061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1723 reason: error at write: Disconnected sessionId: src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0
2025-10-01T14:12:37.615193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1723 sessionId: src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0 is DEAD
2025-10-01T14:12:37.615321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:37.615330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0] Write session will restart in 0.009988s
2025-10-01T14:12:37.615347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0] Write session: Do CDS request
2025-10-01T14:12:37.615354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:37.626791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.626917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:37.626931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1724
2025-10-01T14:12:37.627046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.627078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:37.627087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:37.627090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:37.627453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1724 sessionId:  describe result for acl check
2025-10-01T14:12:37.627486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:37.627492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:37.627496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:37.627501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256042330625855:6913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:37.627981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256042330625855:6913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:37.628183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:37.630072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256042330625855:6913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:37.630154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:37.630599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:37.630609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:37.630620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:37.630668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:37.630702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256039953728814:4004]
2025-10-01T14:12:37.631302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:37.631519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:37.631554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:37.631847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:37.631890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.631895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.631896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.631897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.631898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.631899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.631900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.631901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.631902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.631903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.631904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.631905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.631906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.631907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.631911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.631920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.631923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.631927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.631930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.631934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.631937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.631941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.631939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256042330625855:6913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:37.631944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.631953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256042330625855:6913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:37.631956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256042330625855:6913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:37.631947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.631963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:37.631951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.631954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.631957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.631961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.631966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.631973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.631980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.631984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.631988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.631993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.631997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.632001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.632005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.632010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.632014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.632018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.632023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.632027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.632035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.632040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.632047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.632051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.632059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.632063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.632067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.632075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.632079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.632084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.632091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.632096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.632104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.632108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.632145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:37.635672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:37.636550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:37.636564Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:37.636565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:37.636567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:37.636573Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1723 [2:7556256039953728814:4004]
2025-10-01T14:12:37.636584Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:37.636602Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:37.636608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.636611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.636613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.636626Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:37.636634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:37.636656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:37.636702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.636708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.636710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.636712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:37.636715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:37.636774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:37.636783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.636794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.636804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.636819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:37.636836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625512:2446], now have 1 active actors on pipe
2025-10-01T14:12:37.636844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625896:6913], now have 1 active actors on pipe
2025-10-01T14:12:37.636850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256039953728804:4004]
2025-10-01T14:12:37.636852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256039953728804:4004]
2025-10-01T14:12:37.636854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256039953728804:4004]
2025-10-01T14:12:37.636868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:37.636878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:37.636879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:37.636881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:37.636870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1723
2025-10-01T14:12:37.636882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:37.636875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1723
2025-10-01T14:12:37.636896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:37.636898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:37.636923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256039953728804:4004]
2025-10-01T14:12:37.636933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:37.636938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:37.636945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.636953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.636990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28967a0b-b6590854-d650fce1-f50be2ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:37.637000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.637007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.637009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:37.637018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.637029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:37.637047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.637195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.637206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.637230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.637308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1724 partition: 0 MaxSeqNo: 45 sessionId: src_id|28967a0b-b6590854-d650fce1-f50be2ab_0
2025-10-01T14:12:37.637579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2801a488-c5ce967a-5a7f47fd-4417c458_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|28967a0b-b6590854-d650fce1-f50be2ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:37.639842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28967a0b-b6590854-d650fce1-f50be2ab_0] Write session: try to update token
2025-10-01T14:12:37.639856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28967a0b-b6590854-d650fce1-f50be2ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:37.652359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1724 sessionId: src_id|28967a0b-b6590854-d650fce1-f50be2ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:37.654614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:37.654797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.654818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.654851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:37.654921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:37.657451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:37.657469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:37.657471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:37.657473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:37.657481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256039953728804:4004]
2025-10-01T14:12:37.657486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256039953728804:4004]
2025-10-01T14:12:37.657490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256039953728804:4004]
2025-10-01T14:12:37.657533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:37.657535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:37.657541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:37.657545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:37.657546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.657548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:37.657672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:37.704738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256042330625906:7092]
2025-10-01T14:12:37.704957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1723, pipe: [1:7556256042330625906:7092]
2025-10-01T14:12:37.819862Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:37.827937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.827965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.828130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.828190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.828254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.828316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.828360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.828370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.828436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.828496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.828556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.828621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.828675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.828683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.828744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.828799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.828857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.828914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.828958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.828965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.829020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.829077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.829133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.829187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.829230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.829242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.829298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.829356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.829411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.829465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.829506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.829513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.829571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.829625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.829686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.829747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.829791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.829799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.829856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.829913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.829973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.830032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.830073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.830080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.830141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.830201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.830258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.830320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.830365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.830386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.830455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.830519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.830583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.830647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.830692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.830699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.830766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:37.830827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:37.830891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:37.830953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:37.831020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:37.831027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:37.831086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625906:7092], now have 1 active actors on pipe
2025-10-01T14:12:37.831372Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:37.831414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:37.831419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:37.831440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1724 reason: error at write: Disconnected sessionId: src_id|28967a0b-b6590854-d650fce1-f50be2ab_0
2025-10-01T14:12:37.831616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256042330625906:7092]
2025-10-01T14:12:37.831620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1724 sessionId: src_id|28967a0b-b6590854-d650fce1-f50be2ab_0 is DEAD
2025-10-01T14:12:37.831746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28967a0b-b6590854-d650fce1-f50be2ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:37.831754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28967a0b-b6590854-d650fce1-f50be2ab_0] Write session will restart in 0.008684s
2025-10-01T14:12:37.831772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28967a0b-b6590854-d650fce1-f50be2ab_0] Write session: Do CDS request
2025-10-01T14:12:37.831777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28967a0b-b6590854-d650fce1-f50be2ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:37.832223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:37.837858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:37.839014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:37.839204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:37.839213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:37.839224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:37.839264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:37.839302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256039953728872:4001]
2025-10-01T14:12:37.839926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:37.840177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:37.840213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:37.840528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:37.840572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.840577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.840579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.840580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.840581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.840582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.840583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.840584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.840585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.840587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.840588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.840589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.840590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.840591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.840595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.840604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.840610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.840613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.840617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.840621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.840628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.840631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.840650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.840657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.840660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.840667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.840671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.840678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.840684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.840694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:37.840704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.840713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:37.840721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.840727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:37.840735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.840741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:37.840748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.840755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:37.840762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.840766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:37.840774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.840778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:37.840786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.840794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:37.840802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.840806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:37.840814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.840823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.840828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.840836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.840840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.840848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.840855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.840860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:37.840867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.840871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:37.840911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:37.841886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28967a0b-b6590854-d650fce1-f50be2ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.842003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:37.842019Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1725
2025-10-01T14:12:37.842117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:37.842144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:37.842153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:37.842155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:37.842640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1725 sessionId:  describe result for acl check
2025-10-01T14:12:37.842675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:37.842681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:37.842684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:37.842688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256042330625933:6908] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:37.843220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256042330625933:6908] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:37.844517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:37.845117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:37.845131Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:37.845136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:37.845139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:37.845146Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1724 [2:7556256039953728872:4001]
2025-10-01T14:12:37.845159Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:37.845175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:37.845182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.845185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.845188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.845202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:37.845212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:37.845218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:37.845267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.845273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.845275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.845277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:37.845279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:37.845342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:37.845348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.845358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:37.845369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:37.845387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:37.845407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625909:2446], now have 1 active actors on pipe
2025-10-01T14:12:37.845418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256039953728867:4001]
2025-10-01T14:12:37.845419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256039953728867:4001]
2025-10-01T14:12:37.845421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256039953728867:4001]
2025-10-01T14:12:37.845412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1724
2025-10-01T14:12:37.845435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:37.845430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256042330625933:6908] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:37.845443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:37.845446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:37.845448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:37.845452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:37.845464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:37.845466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:37.845492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256039953728867:4001]
2025-10-01T14:12:37.845501Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:37.845511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:37.849876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256042330625933:6908] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:37.849886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256042330625933:6908] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:37.849888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256042330625933:6908] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:37.849894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:37.850066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625974:6908], now have 1 active actors on pipe
2025-10-01T14:12:37.850109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1724
2025-10-01T14:12:37.850170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.850180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.850203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a94b0954-46ba0421-36284592-c47f208e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:37.850214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:37.850219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:37.850223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:37.850232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:37.850242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:37.850260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.850407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.850416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.850430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:37.850489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1725 partition: 0 MaxSeqNo: 45 sessionId: src_id|a94b0954-46ba0421-36284592-c47f208e_0
2025-10-01T14:12:37.850813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28967a0b-b6590854-d650fce1-f50be2ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a94b0954-46ba0421-36284592-c47f208e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:37.853354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a94b0954-46ba0421-36284592-c47f208e_0] Write session: try to update token
2025-10-01T14:12:37.853367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a94b0954-46ba0421-36284592-c47f208e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:37.860683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:37.860705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:37.860714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256039953728867:4001]
2025-10-01T14:12:37.860752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:37.860764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:37.860917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:37.861049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:37.861184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:37.861316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:37.861492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:37.861529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:37.866722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1725 sessionId: src_id|a94b0954-46ba0421-36284592-c47f208e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:37.868935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:37.869119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:37.869138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:37.869169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:37.869233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:37.874047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:37.874065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:37.874067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:37.874069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:37.874079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256039953728867:4001]
2025-10-01T14:12:37.874084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256039953728867:4001]
2025-10-01T14:12:37.874087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256039953728867:4001]
2025-10-01T14:12:37.874129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:37.874140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:37.874143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:37.874151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:37.874157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:37.874161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:37.874270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:37.931557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256042330625977:7092]
2025-10-01T14:12:37.931819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1724, pipe: [1:7556256042330625977:7092]
2025-10-01T14:12:38.024119Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:38.030344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.030366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.030514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.030564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.030619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.030670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.030708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.030717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.030772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.030825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.030874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.030924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.030963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.030967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.031025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.031076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.031126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.031179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.031217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.031224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.031281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.031335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.031387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.031440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.031478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.031482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.031536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.031586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.031639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.031689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.031727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.031731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.031787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.031840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.031891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.031972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.032010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.032016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.032088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.032155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.032210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.032261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.032310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.032315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.032366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.032416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.032468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.032535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.032584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.032588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.032647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.032696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.032749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.032802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.032838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.032843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.032897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.032946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.032999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.033047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.033095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.033100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.033137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256042330625977:7092], now have 1 active actors on pipe
2025-10-01T14:12:38.033337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:38.033348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:38.033349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256042330625977:7092]
2025-10-01T14:12:38.033366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:38.033369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1725 reason: error at write: Disconnected sessionId: src_id|a94b0954-46ba0421-36284592-c47f208e_0
2025-10-01T14:12:38.033553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1725 sessionId: src_id|a94b0954-46ba0421-36284592-c47f208e_0 is DEAD
2025-10-01T14:12:38.033700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94b0954-46ba0421-36284592-c47f208e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:38.033709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94b0954-46ba0421-36284592-c47f208e_0] Write session will restart in 0.008871s
2025-10-01T14:12:38.033735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94b0954-46ba0421-36284592-c47f208e_0] Write session: Do CDS request
2025-10-01T14:12:38.033741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94b0954-46ba0421-36284592-c47f208e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:38.033823Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:38.038421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:38.039541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:38.039687Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:38.039694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:38.039701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:38.039730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:38.039764Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256044248696228:3998]
2025-10-01T14:12:38.040119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:38.040318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:38.040342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:38.040524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:38.040554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.040558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.040558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.040559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.040560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.040560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.040561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.040562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.040563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.040564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.040564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.040565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.040565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.040566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.040569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.040574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.040576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.040578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.040580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.040582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.040584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.040588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.040590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.040592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.040594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.040595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.040597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.040599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.040603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.040607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.040612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.040614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.040617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.040619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.040621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.040624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.040627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.040630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.040646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.040655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.040657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.040660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.040662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.040664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.040667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.040669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.040672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.040674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.040677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.040682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.040684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.040687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.040689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.040692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.040697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.040699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.040718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:38.043807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a94b0954-46ba0421-36284592-c47f208e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.043881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:38.043921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:38.043933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1726
2025-10-01T14:12:38.044014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.044036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:38.044044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:38.044046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:38.044336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1726 sessionId:  describe result for acl check
2025-10-01T14:12:38.044358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:38.044362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:38.044363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:38.044366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256046625593300:6891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:38.044380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:38.044389Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:38.044391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:38.044392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:38.044396Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1725 [2:7556256044248696228:3998]
2025-10-01T14:12:38.044404Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:38.044414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:38.044416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.044418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.044421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.044431Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:38.044440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:38.044444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:38.044474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.044480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.044481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.044483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:38.044485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:38.044523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:38.044527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.044533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.044541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.044553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:38.044565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256044248696223:3998]
2025-10-01T14:12:38.044570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256044248696223:3998]
2025-10-01T14:12:38.044571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256044248696223:3998]
2025-10-01T14:12:38.044579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:38.044589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:38.044590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:38.044593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:38.044594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:38.044600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:38.044601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:38.044614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256044248696223:3998]
2025-10-01T14:12:38.044618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:38.044621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:38.044737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256046625593300:6891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:38.045313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593276:2446], now have 1 active actors on pipe
2025-10-01T14:12:38.045329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1725
2025-10-01T14:12:38.046464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256046625593300:6891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:38.051110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256046625593300:6891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:38.051120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256046625593300:6891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:38.051122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256046625593300:6891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:38.051127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:38.051290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593338:6891], now have 1 active actors on pipe
2025-10-01T14:12:38.051343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1725
2025-10-01T14:12:38.051395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.051402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.051422Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9e352c9-48022656-3f53830c-b9da61e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:38.051429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.051436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.051438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:38.051444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.051457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:38.051471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.051591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.051601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.051618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.051688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1726 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9e352c9-48022656-3f53830c-b9da61e7_0
2025-10-01T14:12:38.051952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a94b0954-46ba0421-36284592-c47f208e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9e352c9-48022656-3f53830c-b9da61e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:38.054455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e352c9-48022656-3f53830c-b9da61e7_0] Write session: try to update token
2025-10-01T14:12:38.054470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e352c9-48022656-3f53830c-b9da61e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:38.063303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:38.063321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:38.063323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:38.063325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:38.063336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256044248696223:3998]
2025-10-01T14:12:38.063341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256044248696223:3998]
2025-10-01T14:12:38.063344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256044248696223:3998]
2025-10-01T14:12:38.063378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:38.063391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:38.063397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.063398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:38.063402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:38.063404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:38.063531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:38.066510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1726 sessionId: src_id|f9e352c9-48022656-3f53830c-b9da61e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:38.068804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:38.133252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256046625593343:7092]
2025-10-01T14:12:38.133462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1725, pipe: [1:7556256046625593343:7092]
2025-10-01T14:12:38.203193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:38.203584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.203601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.203648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593343:7092], now have 1 active actors on pipe
2025-10-01T14:12:38.203830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:38.203841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:38.203860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256046625593343:7092]
2025-10-01T14:12:38.203879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:38.203890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1726 reason: error at write: Disconnected sessionId: src_id|f9e352c9-48022656-3f53830c-b9da61e7_0
2025-10-01T14:12:38.203881Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:38.204070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1726 sessionId: src_id|f9e352c9-48022656-3f53830c-b9da61e7_0 is DEAD
2025-10-01T14:12:38.204204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e352c9-48022656-3f53830c-b9da61e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:38.204213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e352c9-48022656-3f53830c-b9da61e7_0] Write session will restart in 0.009939s
2025-10-01T14:12:38.204234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e352c9-48022656-3f53830c-b9da61e7_0] Write session: Do CDS request
2025-10-01T14:12:38.204239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e352c9-48022656-3f53830c-b9da61e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:38.209427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:38.210580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:38.210744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:38.210752Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:38.210760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:38.210803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:38.210838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256044248696299:3997]
2025-10-01T14:12:38.211255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:38.211461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:38.211489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:38.211702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:38.211741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.211745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.211746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.211746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.211747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.211747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.211748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.211749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.211749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.211750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.211750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.211751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.211752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.211752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.211755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.211761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.211764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.211768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.211770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.211772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.211774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.211776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.211778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.211781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.211783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.211785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.211787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.211789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.211794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.211799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.211803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.211806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.211809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.211812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.211814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.211817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.211820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.211823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.211826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.211828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.211831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.211834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.211836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.211839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.211842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.211848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.211852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.211855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.211861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.211864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.211869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.211871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.211874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.211877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.211882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.211885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.211905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:38.214842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e352c9-48022656-3f53830c-b9da61e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.214934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:38.214947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1727
2025-10-01T14:12:38.215090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.215133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:38.215144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:38.215147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:38.215510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1727 sessionId:  describe result for acl check
2025-10-01T14:12:38.215544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:38.215526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:38.215550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:38.215554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:38.215557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256046625593370:6887] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:38.216076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:38.216082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256046625593370:6887] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:38.216089Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:38.216091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:38.216093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:38.216097Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1726 [2:7556256044248696299:3997]
2025-10-01T14:12:38.216110Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:38.216122Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:38.216127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.216130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.216131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.216141Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:38.216148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:38.216151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:38.216187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.216193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.216194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.216197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:38.216198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:38.216245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:38.216250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.216257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.216266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.216274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:38.216289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593344:2446], now have 1 active actors on pipe
2025-10-01T14:12:38.216300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256044248696294:3997]
2025-10-01T14:12:38.216302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256044248696294:3997]
2025-10-01T14:12:38.216305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256044248696294:3997]
2025-10-01T14:12:38.216318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:38.216335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:38.216335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:38.216338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:38.216339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:38.216343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:38.216345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:38.216343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1726
2025-10-01T14:12:38.216367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256044248696294:3997]
2025-10-01T14:12:38.216377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:38.216379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:38.217746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256046625593370:6887] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:38.222458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256046625593370:6887] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:38.222468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256046625593370:6887] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:38.222470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256046625593370:6887] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:38.222476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:38.222684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1726
2025-10-01T14:12:38.222708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593409:6887], now have 1 active actors on pipe
2025-10-01T14:12:38.222735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.222747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.222777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:38.222791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.222800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.222808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:38.222818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.222836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:38.222856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.222987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.222995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.223010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.223079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1727 partition: 0 MaxSeqNo: 45 sessionId: src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0
2025-10-01T14:12:38.223360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9e352c9-48022656-3f53830c-b9da61e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:38.225627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0] Write session: try to update token
2025-10-01T14:12:38.225642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:38.226425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:38.226442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:38.226454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256044248696294:3997]
2025-10-01T14:12:38.226495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:38.226498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:38.226658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:38.226785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:38.226904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:38.227023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:38.227251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:38.227283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:38.238080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1727 sessionId: src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:38.240169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:38.240347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.240371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.240407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:38.240468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:38.244493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:38.244512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:38.244514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:38.244516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:38.244526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256044248696294:3997]
2025-10-01T14:12:38.244531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256044248696294:3997]
2025-10-01T14:12:38.244535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256044248696294:3997]
2025-10-01T14:12:38.244571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:38.244579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:38.244581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:38.244586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:38.244586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.244588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:38.244722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:38.303777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256046625593435:7092]
2025-10-01T14:12:38.304029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1726, pipe: [1:7556256046625593435:7092]
2025-10-01T14:12:38.385397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:38.391838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.391860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.392004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.392054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.392108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.392157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.392199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.392207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.392261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.392314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.392364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.392420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.392463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.392471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.392541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.392601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.392668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.392736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.392781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.392789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.392857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.392920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.392980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.393036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.393075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.393080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.393134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.393185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.393240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.393292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.393331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.393336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.393389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.393445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.393502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.393557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.393595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.393600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.393658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.393715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.393779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.393845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.393889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.393896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.393957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.394017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.394075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.394138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.394196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.394204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.394258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.394308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.394360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.394437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.394503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.394511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.394577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.394644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.394708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.394776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.394821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.394832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.394882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593435:7092], now have 1 active actors on pipe
2025-10-01T14:12:38.395097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256046625593435:7092]
2025-10-01T14:12:38.395131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:38.395658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:38.395667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:38.395692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1727 reason: error at write: Disconnected sessionId: src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0
2025-10-01T14:12:38.395760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:38.395867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1727 sessionId: src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0 is DEAD
2025-10-01T14:12:38.396015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:38.396025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0] Write session will restart in 0.008516s
2025-10-01T14:12:38.396050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0] Write session: Do CDS request
2025-10-01T14:12:38.396057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:38.401707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:38.403011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:38.403218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:38.403228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:38.403240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:38.403294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:38.403335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256044248696367:3986]
2025-10-01T14:12:38.403942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:38.404171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:38.404202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:38.404531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:38.404572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.404576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.404577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.404578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.404578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.404579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.404580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.404581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.404581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.404582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.404583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.404583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.404584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.404585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.404588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.404594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.404598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.404600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.404603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.404605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.404607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.404609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.404611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.404613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.404616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.404618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.404620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.404622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.404627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.404631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.404635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.404663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.404666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.404669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.404671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.404674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.404676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.404679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.404685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.404688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.404691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.404698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.404700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.404704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.404709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.404712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.404715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.404718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.404720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.404723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.404726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.404729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.404731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.404734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.404739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.404742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.404764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:38.405872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.405942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:38.405955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1728
2025-10-01T14:12:38.406151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.406181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:38.406191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:38.406194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:38.406597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1728 sessionId:  describe result for acl check
2025-10-01T14:12:38.406633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:38.406639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:38.406641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:38.406646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256046625593475:6858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:38.407150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256046625593475:6858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:38.408278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:38.408865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:38.408878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:38.408879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:38.408884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:38.408889Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1727 [2:7556256044248696367:3986]
2025-10-01T14:12:38.408900Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:38.408920Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:38.408927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.408931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.408937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.408925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256046625593475:6858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:38.408952Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:38.408962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:38.408972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:38.409016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.409021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.409022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.409024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:38.409026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:38.409074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:38.409080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.409092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.409101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.409111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:38.409127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593449:2446], now have 1 active actors on pipe
2025-10-01T14:12:38.409137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256044248696362:3986]
2025-10-01T14:12:38.409138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256044248696362:3986]
2025-10-01T14:12:38.409140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256044248696362:3986]
2025-10-01T14:12:38.409149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:38.409161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:38.409164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:38.409167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:38.409169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:38.409175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:38.409178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:38.409165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1727
2025-10-01T14:12:38.409202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256044248696362:3986]
2025-10-01T14:12:38.409211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:38.409218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:38.413898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256046625593475:6858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:38.413913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256046625593475:6858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:38.413916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256046625593475:6858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:38.413924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:38.414124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593517:6858], now have 1 active actors on pipe
2025-10-01T14:12:38.414161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1727
2025-10-01T14:12:38.414233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.414246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.414271Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:38.414285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.414295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.414297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:38.414307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.414331Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:38.414350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.414509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.414519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.414539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.414615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1728 partition: 0 MaxSeqNo: 45 sessionId: src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0
2025-10-01T14:12:38.414928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed95a351-969ebf99-1e22fe57-52cf32ed_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:38.417288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0] Write session: try to update token
2025-10-01T14:12:38.417302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:38.419012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:38.419030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:38.419040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256044248696362:3986]
2025-10-01T14:12:38.419081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:38.419084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:38.419227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:38.419346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:38.419471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:38.419640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:38.419809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:38.419847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:38.429737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1728 sessionId: src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:38.431885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:38.432180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.432203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.432236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:38.432305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:38.436715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:38.436730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:38.436732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:38.436733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:38.436742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256044248696362:3986]
2025-10-01T14:12:38.436745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256044248696362:3986]
2025-10-01T14:12:38.436747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256044248696362:3986]
2025-10-01T14:12:38.436784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:38.436792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.436795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:38.436808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:38.436822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:38.436827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:38.436915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:38.495283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256046625593526:7092]
2025-10-01T14:12:38.495544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1727, pipe: [1:7556256046625593526:7092]
2025-10-01T14:12:38.573486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:38.580071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.580092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.580216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.580266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.580317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.580366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.580406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.580415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.580473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.580522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.580572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.580624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.580680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.580685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.580743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.580794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.580846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.580902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.580940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.580945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.581001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.581053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.581107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.581158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.581197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.581202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.581278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.581328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.581378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.581430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.581467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.581472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.581527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.581621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.581677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.581758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.581798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.581803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.581859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.581910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.581966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.582020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.582059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.582066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.582122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.582175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.582230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.582284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.582336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.582341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.582407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.582468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.582531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.582599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.582643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.582650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.582713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.582775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.582837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.582903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.582950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.582957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.583002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593526:7092], now have 1 active actors on pipe
2025-10-01T14:12:38.583218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:38.583230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:38.583254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1728 reason: error at write: Disconnected sessionId: src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0
2025-10-01T14:12:38.583363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:38.583415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256046625593526:7092]
2025-10-01T14:12:38.583446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1728 sessionId: src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0 is DEAD
2025-10-01T14:12:38.583647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:38.583655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0] Write session will restart in 0.006893s
2025-10-01T14:12:38.583683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0] Write session: Do CDS request
2025-10-01T14:12:38.583689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:38.583834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:38.589417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:38.590546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:38.590676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:38.590684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:38.590692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:38.590725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:38.590753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256044248696457:3969]
2025-10-01T14:12:38.591117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:38.591325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:38.591357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:38.591625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:38.591687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.591692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.591692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.591693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.591694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.591694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.591695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.591696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.591696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.591697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.591699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.591699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.591700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.591700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.591703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.591709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.591711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.591713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.591715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.591718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.591720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.591722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.591724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.591728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.591730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.591732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.591733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.591735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.591740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.591745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.591749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.591751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.591753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.591757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.591759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.591762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.591764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.591767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.591769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.591772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.591774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.591776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.591779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.591781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.591784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.591786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.591788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.591791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.591793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.591796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.591798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.591800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.591802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.591805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.591838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.591807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.591810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.591829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:38.591894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:38.591906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1729
2025-10-01T14:12:38.592045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.592083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:38.592090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:38.592093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:38.592400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1729 sessionId:  describe result for acl check
2025-10-01T14:12:38.592422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:38.592427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:38.592428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:38.592431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256046625593558:6864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:38.592894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256046625593558:6864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:38.595002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:38.595274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256046625593558:6864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:38.595568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:38.595581Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:38.595583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:38.595586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:38.595592Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1728 [2:7556256044248696457:3969]
2025-10-01T14:12:38.595604Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:38.595621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:38.595628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.595632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.595633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.595647Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:38.595656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:38.595665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:38.595714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.595721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.595723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.595725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:38.595728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:38.595784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:38.595792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.595803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.595817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.595834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:38.595853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593531:2446], now have 1 active actors on pipe
2025-10-01T14:12:38.595847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1728
2025-10-01T14:12:38.595863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256044248696452:3969]
2025-10-01T14:12:38.595865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256044248696452:3969]
2025-10-01T14:12:38.595867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256044248696452:3969]
2025-10-01T14:12:38.595874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:38.595884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:38.595886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:38.595886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:38.595888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:38.595898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:38.595905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:38.595929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256044248696452:3969]
2025-10-01T14:12:38.595938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:38.595952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:38.600173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256046625593558:6864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:38.600184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256046625593558:6864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:38.600187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256046625593558:6864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:38.600194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:38.600372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593594:6864], now have 1 active actors on pipe
2025-10-01T14:12:38.600413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1728
2025-10-01T14:12:38.600462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.600474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.600498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:38.600513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.600522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.600525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:38.600531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.600545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:38.600559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.600685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.600693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.600704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.600761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1729 partition: 0 MaxSeqNo: 45 sessionId: src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0
2025-10-01T14:12:38.601052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50ff63fc-ceca92b6-4a0608b2-4fb220ad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:38.603839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0] Write session: try to update token
2025-10-01T14:12:38.603854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:38.614881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:38.614903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:38.614906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:38.614907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:38.614918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256044248696452:3969]
2025-10-01T14:12:38.614926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256044248696452:3969]
2025-10-01T14:12:38.614930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256044248696452:3969]
2025-10-01T14:12:38.614972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:38.614976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:38.614983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.614985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:38.614987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:38.614988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:38.615130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:38.615831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1729 sessionId: src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:38.618002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:38.683675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256046625593598:7092]
2025-10-01T14:12:38.683917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1728, pipe: [1:7556256046625593598:7092]
2025-10-01T14:12:38.750200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:38.750523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.750537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.750574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593598:7092], now have 1 active actors on pipe
2025-10-01T14:12:38.750763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:38.750779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:38.750781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:38.750828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256046625593598:7092]
2025-10-01T14:12:38.750849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1729 reason: error at write: Disconnected sessionId: src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0
2025-10-01T14:12:38.750850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:38.751067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1729 sessionId: src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0 is DEAD
2025-10-01T14:12:38.751231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:38.751241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0] Write session will restart in 0.006090s
2025-10-01T14:12:38.751265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0] Write session: Do CDS request
2025-10-01T14:12:38.751270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:38.756015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:38.757170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:38.757292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:38.757300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:38.757307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:38.757335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:38.757360Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256044248696521:3960]
2025-10-01T14:12:38.757735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:38.757912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:38.757937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:38.758127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:38.758166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.758170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.758171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.758172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.758172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.758173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.758174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.758174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.758175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.758175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.758176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.758176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.758177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.758178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.758181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.758188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.758190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.758192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.758194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.758196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.758198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.758200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.758202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.758204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.758206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.758208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.758210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.758212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.758216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.758221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.758224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.758228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.758230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.758233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.758235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.758238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.758240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.758243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.758245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.758248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.758251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.758253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.758259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.758262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.758264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.758267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.758274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.758277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.758279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.758282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.758284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.758286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.758289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.758291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.758296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.758298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.758317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:38.758835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.758906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:38.758919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1730
2025-10-01T14:12:38.759061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.759105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:38.759114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:38.759118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:38.759456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1730 sessionId:  describe result for acl check
2025-10-01T14:12:38.759487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:38.759494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:38.759496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:38.759501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256046625593628:6857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:38.759872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256046625593628:6857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:38.761402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256046625593628:6857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:38.761479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:38.762021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:38.762032Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:38.762034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:38.762036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:38.762042Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1729 [2:7556256044248696521:3960]
2025-10-01T14:12:38.762054Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:38.762069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:38.762076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.762080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.762082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.762096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:38.762105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:38.762111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:38.762160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.762166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.762167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.762170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:38.762172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:38.762218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:38.762223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.762229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.762235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.762243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:38.762255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256044248696516:3960]
2025-10-01T14:12:38.762258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256044248696516:3960]
2025-10-01T14:12:38.762260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256044248696516:3960]
2025-10-01T14:12:38.762268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:38.762278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:38.762281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:38.762283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:38.762284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:38.762288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:38.762290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:38.762304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256044248696516:3960]
2025-10-01T14:12:38.762307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:38.762309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:38.762681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593600:2446], now have 1 active actors on pipe
2025-10-01T14:12:38.762726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1729
2025-10-01T14:12:38.766573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256046625593628:6857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:38.766583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256046625593628:6857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:38.766586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256046625593628:6857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:38.766592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:38.766778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1729
2025-10-01T14:12:38.766770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593667:6857], now have 1 active actors on pipe
2025-10-01T14:12:38.766813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.766818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.766839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|638c72e9-a24b32b3-40314665-c766356f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:38.766855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.766864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.766867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:38.766877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.766893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:38.766911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.767071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.767080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.767093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.767148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1730 partition: 0 MaxSeqNo: 45 sessionId: src_id|638c72e9-a24b32b3-40314665-c766356f_0
2025-10-01T14:12:38.767430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e2bca34-6f4b2f3e-7ca0d42-d76f0dcc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|638c72e9-a24b32b3-40314665-c766356f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:38.769731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|638c72e9-a24b32b3-40314665-c766356f_0] Write session: try to update token
2025-10-01T14:12:38.769745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|638c72e9-a24b32b3-40314665-c766356f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:38.772115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:38.772133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:38.772142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256044248696516:3960]
2025-10-01T14:12:38.772180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:38.772179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:38.772329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:38.772464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:38.772598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:38.772748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:38.772935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:38.772973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:38.782691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1730 sessionId: src_id|638c72e9-a24b32b3-40314665-c766356f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:38.784881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:38.785061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.785082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.785119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:38.785205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:38.790566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:38.790583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:38.790584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:38.790586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:38.790594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256044248696516:3960]
2025-10-01T14:12:38.790598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256044248696516:3960]
2025-10-01T14:12:38.790601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256044248696516:3960]
2025-10-01T14:12:38.790632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:38.790636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:38.790639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:38.790639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:38.790644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.790646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:38.790770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:38.851078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256046625593673:7092]
2025-10-01T14:12:38.851278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1729, pipe: [1:7556256046625593673:7092]
2025-10-01T14:12:38.925877Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:38.932698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.932721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.932857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.932910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.932969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.933026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.933237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.933245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.933306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.933359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.933415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.933472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.933513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.933519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.933581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.933637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.933694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.933752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.933797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.933805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.933878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.934107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.934162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.934220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.934263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.934268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.934328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.934400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.934459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.934519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.934558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.934564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.934623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.934678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.934736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.934795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.934837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.934843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.934902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.934961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.935022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.935084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.935143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.935149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.935207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.935262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.935318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.935376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.935416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.935424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.935480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.935533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.935590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.935656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.935696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.935701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.935759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:38.935816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:38.935875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:38.935930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:38.935970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:38.935977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:38.936018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593673:7092], now have 1 active actors on pipe
2025-10-01T14:12:38.936183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:38.936197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256046625593673:7092]
2025-10-01T14:12:38.936222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:38.936224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:38.936250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1730 reason: error at write: Disconnected sessionId: src_id|638c72e9-a24b32b3-40314665-c766356f_0
2025-10-01T14:12:38.936448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1730 sessionId: src_id|638c72e9-a24b32b3-40314665-c766356f_0 is DEAD
2025-10-01T14:12:38.936497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:38.936561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638c72e9-a24b32b3-40314665-c766356f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:38.936569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638c72e9-a24b32b3-40314665-c766356f_0] Write session will restart in 0.005622s
2025-10-01T14:12:38.936595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638c72e9-a24b32b3-40314665-c766356f_0] Write session: Do CDS request
2025-10-01T14:12:38.936601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638c72e9-a24b32b3-40314665-c766356f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:38.942247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:38.943687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:38.943841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|638c72e9-a24b32b3-40314665-c766356f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.943828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:38.943837Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:38.943846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:38.943877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:38.943904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256044248696584:3957]
2025-10-01T14:12:38.943947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:38.943958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1731
2025-10-01T14:12:38.944051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:38.944073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:38.944077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:38.944080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:38.944289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:38.944397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1731 sessionId:  describe result for acl check
2025-10-01T14:12:38.944432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:38.944437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:38.944439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:38.944442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256046625593702:6849] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:38.944485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:38.944509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:38.944708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:38.944742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.944746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.944747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.944748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.944748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.944749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.944749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.944750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.944752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.944753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.944753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.944754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.944755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.944755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.944758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.944764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.944766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.944768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.944770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.944772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.944774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.944776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.944778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.944780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.944782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.944784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.944786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.944788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.944794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.944798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:38.944801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.944805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:38.944807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.944810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:38.944812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.944815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:38.944817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.944820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:38.944822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.944825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:38.944827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.944830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:38.944832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.944834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:38.944836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.944839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:38.944841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.944843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.944846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.944848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.944854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.944857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.944859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.944863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:38.944868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.944871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:38.944892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:38.944947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256046625593702:6849] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:38.946738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256046625593702:6849] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:38.948283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:38.948836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256046625593702:6849] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:38.948847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256046625593702:6849] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:38.948849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256046625593702:6849] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:38.948857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:38.948861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:38.948880Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:38.948885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:38.948888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:38.948893Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1730 [2:7556256044248696584:3957]
2025-10-01T14:12:38.948903Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:38.948918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:38.948920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.948922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.948925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.948935Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:38.948946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:38.948950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:38.949000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.949007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.949008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.949011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:38.949013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:38.949061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:38.949066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.949072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:38.949079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:38.949088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:38.949104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593675:2446], now have 1 active actors on pipe
2025-10-01T14:12:38.949109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256046625593739:6849], now have 1 active actors on pipe
2025-10-01T14:12:38.949115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256044248696579:3957]
2025-10-01T14:12:38.949107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1730
2025-10-01T14:12:38.949116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256044248696579:3957]
2025-10-01T14:12:38.949117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256044248696579:3957]
2025-10-01T14:12:38.949112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1730
2025-10-01T14:12:38.949124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:38.949132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:38.949133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:38.949140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:38.949142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:38.949142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:38.949143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:38.949157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.949159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.949183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256044248696579:3957]
2025-10-01T14:12:38.949191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:38.949199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:38.949200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:38.949205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:38.949207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:38.949209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:38.949214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:38.949220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:38.949241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.949350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.949361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.949381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:38.949438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1731 partition: 0 MaxSeqNo: 45 sessionId: src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0
2025-10-01T14:12:38.949729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|638c72e9-a24b32b3-40314665-c766356f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:38.952002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0] Write session: try to update token
2025-10-01T14:12:38.952018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:38.965445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1731 sessionId: src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:38.967776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:38.969146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:38.969171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:38.969187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:38.969190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:38.969191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:38.969192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:38.969199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256044248696579:3957]
2025-10-01T14:12:38.969203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256044248696579:3957]
2025-10-01T14:12:38.969206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256044248696579:3957]
2025-10-01T14:12:38.969253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:38.969256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:38.969262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:38.969263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:38.969264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:38.969267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:38.969377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:39.036444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256050920561043:7092]
2025-10-01T14:12:39.036724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1730, pipe: [1:7556256050920561043:7092]
2025-10-01T14:12:39.101618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:39.101936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:39.101990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561043:7092], now have 1 active actors on pipe
2025-10-01T14:12:39.102050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:39.102152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:39.102193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256050920561043:7092]
2025-10-01T14:12:39.107884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:39.109027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:39.109168Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:39.109177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:39.109186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:39.109221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:39.109257Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256048543663946:3953]
2025-10-01T14:12:39.109841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:39.110072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:39.110106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:39.110408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:39.110451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.110455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.110456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.110457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.110458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.110459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.110461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.110462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.110464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.110465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.110466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.110467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.110468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.110469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.110474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.110482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.110485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.110489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.110494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.110497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.110504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.110508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.110515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.110518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.110525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.110528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.110531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.110538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.110509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:39.110545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.110555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.110518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:39.110564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.110532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1731 reason: error at write: Disconnected sessionId: src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0
2025-10-01T14:12:39.110569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.110576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.110580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.110587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.110591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.110599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.110603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.110611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.110620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.110627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.110633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.110640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.110644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.110651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.110634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1731 sessionId: src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0 is DEAD
2025-10-01T14:12:39.110655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.110662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.110666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.110670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.110678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.110681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.110686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.110692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.110696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.110700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.110704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.110755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:39.110737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:39.110767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0] Write session will restart in 0.008725s
2025-10-01T14:12:39.110790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0] Write session: Do CDS request
2025-10-01T14:12:39.110796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:39.116294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:39.116822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:39.116834Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:39.116836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:39.116838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:39.116846Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1731 [2:7556256048543663946:3953]
2025-10-01T14:12:39.116858Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:39.116873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:39.116879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.116881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.116882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.116895Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:39.116898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:39.116904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:39.116942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.116946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.116947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.116949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:39.116951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:39.116994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:39.116999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.117006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.117012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.117023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:39.117040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561044:2446], now have 1 active actors on pipe
2025-10-01T14:12:39.117051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256048543663941:3953]
2025-10-01T14:12:39.117052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256048543663941:3953]
2025-10-01T14:12:39.117053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256048543663941:3953]
2025-10-01T14:12:39.117061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:39.117070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:39.117074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:39.117076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:39.117077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:39.117078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:39.117080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:39.117099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256048543663941:3953]
2025-10-01T14:12:39.117104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:39.117105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:39.117095Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1731
2025-10-01T14:12:39.120839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.120903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:39.120913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1732
2025-10-01T14:12:39.121028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.121051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:39.121068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:39.121073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:39.121359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1732 sessionId:  describe result for acl check
2025-10-01T14:12:39.121385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:39.121389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:39.121394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:39.121396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256050920561081:6844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:39.121758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256050920561081:6844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:39.126545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256050920561081:6844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:39.126539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:39.126555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:39.126564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256048543663941:3953]
2025-10-01T14:12:39.126598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:39.126601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:39.126748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:39.126873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:39.126991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:39.127111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:39.127272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:39.127302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:39.131554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256050920561081:6844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:39.131565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256050920561081:6844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:39.131568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256050920561081:6844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:39.131576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:39.131797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1731
2025-10-01T14:12:39.131737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561117:6844], now have 1 active actors on pipe
2025-10-01T14:12:39.131861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.131866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.131888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:39.131899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.131903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.131905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:39.131917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.131931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:39.131944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.132048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.132056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.132066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.132118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1732 partition: 0 MaxSeqNo: 45 sessionId: src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0
2025-10-01T14:12:39.132389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d97ee0c5-5c76fcaa-ccd34b9a-420aed7b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:39.134589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0] Write session: try to update token
2025-10-01T14:12:39.134603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:39.144381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:39.144399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:39.144401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:39.144403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:39.144413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256048543663941:3953]
2025-10-01T14:12:39.144417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256048543663941:3953]
2025-10-01T14:12:39.144421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256048543663941:3953]
2025-10-01T14:12:39.144461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:39.144461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:39.144466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:39.144468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.144470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:39.144470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:39.144604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:39.146644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1732 sessionId: src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:39.148884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:39.202365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256050920561118:7092]
2025-10-01T14:12:39.202619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1731, pipe: [1:7556256050920561118:7092]
2025-10-01T14:12:39.298707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:39.299130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.299148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.299173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561118:7092], now have 1 active actors on pipe
2025-10-01T14:12:39.299386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:39.299416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:39.299428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:39.299485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1732 reason: error at write: Disconnected sessionId: src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0
2025-10-01T14:12:39.299660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1732 sessionId: src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0 is DEAD
2025-10-01T14:12:39.299810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:39.299822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0] Write session will restart in 0.009284s
2025-10-01T14:12:39.299855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0] Write session: Do CDS request
2025-10-01T14:12:39.299861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:39.299848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:39.299888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256050920561118:7092]
2025-10-01T14:12:39.304873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:39.306132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:39.306274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:39.306282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:39.306291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:39.306323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:39.306355Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256048543664032:3951]
2025-10-01T14:12:39.306957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:39.307219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:39.307253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:39.307533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:39.307576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.307582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.307583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.307584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.307585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.307586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.307587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.307588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.307589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.307590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.307591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.307592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.307594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.307595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.307599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.307608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.307612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.307616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.307619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.307622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.307626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.307629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.307632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.307635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.307638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.307642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.307645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.307648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.307654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.307660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.307669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.307673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.307681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.307689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.307697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.307701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.307709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.307716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.307720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.307724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.307729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.307737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.307740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.307744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.307750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.307754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.307762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.307767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.307775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.307781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.307788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.307792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.307796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.307802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.307805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.307811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.307848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:39.309845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.309945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:39.309961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1733
2025-10-01T14:12:39.310067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.310095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:39.310104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:39.310107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:39.310429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1733 sessionId:  describe result for acl check
2025-10-01T14:12:39.310461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:39.310467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:39.310468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:39.310473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256050920561177:6829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:39.310896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256050920561177:6829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:39.311128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:39.311678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:39.311690Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:39.311692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:39.311695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:39.311700Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1732 [2:7556256048543664032:3951]
2025-10-01T14:12:39.311712Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:39.311730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:39.311737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.311740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.311742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.311758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:39.311766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:39.311776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:39.311824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.311829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.311831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.311834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:39.311836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:39.311892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:39.311898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.311907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.311924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.311937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:39.311958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561134:2446], now have 1 active actors on pipe
2025-10-01T14:12:39.311967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256048543664027:3951]
2025-10-01T14:12:39.311973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256048543664027:3951]
2025-10-01T14:12:39.311975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256048543664027:3951]
2025-10-01T14:12:39.311956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1732
2025-10-01T14:12:39.311984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:39.311991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:39.311995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:39.311997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:39.311999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:39.312011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:39.312017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:39.312042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256048543664027:3951]
2025-10-01T14:12:39.312057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:39.312067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:39.312485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256050920561177:6829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:39.318254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256050920561177:6829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:39.318267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256050920561177:6829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:39.318270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256050920561177:6829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:39.318277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:39.318500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561212:6829], now have 1 active actors on pipe
2025-10-01T14:12:39.318550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1732
2025-10-01T14:12:39.318619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.318630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.318654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6685162-4dcb75d-b749c90f-d7f409e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:39.318667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.318677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.318685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:39.318695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.318710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:39.318729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.318868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.318878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.318890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.318950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1733 partition: 0 MaxSeqNo: 45 sessionId: src_id|b6685162-4dcb75d-b749c90f-d7f409e_0
2025-10-01T14:12:39.319238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6308223a-4dcc21ec-be3a208-8d5350e1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b6685162-4dcb75d-b749c90f-d7f409e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:39.321494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6685162-4dcb75d-b749c90f-d7f409e_0] Write session: try to update token
2025-10-01T14:12:39.321507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6685162-4dcb75d-b749c90f-d7f409e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:39.322527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:39.322542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:39.322550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256048543664027:3951]
2025-10-01T14:12:39.322587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:39.322591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:39.322756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:39.322887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:39.323016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:39.323147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:39.323319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:39.323350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:39.334523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1733 sessionId: src_id|b6685162-4dcb75d-b749c90f-d7f409e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:39.337282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:39.337511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.337533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.337567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:39.337623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:39.341702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:39.341726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:39.341728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:39.341730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:39.341743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256048543664027:3951]
2025-10-01T14:12:39.341747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256048543664027:3951]
2025-10-01T14:12:39.341753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256048543664027:3951]
2025-10-01T14:12:39.341806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:39.341816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:39.341821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.341824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:39.341825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:39.341830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:39.342008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:39.399951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256050920561229:7092]
2025-10-01T14:12:39.400187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1732, pipe: [1:7556256050920561229:7092]
2025-10-01T14:12:39.477296Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:39.484114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.484138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.484282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.484330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.484385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.484435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.484475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.484482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.484536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.484587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.484654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.484705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.484741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.484746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.484802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.484853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.484905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.484962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.485241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.485249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.485307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.485357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.485411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.485464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.485508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.485516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.485572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.485621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.485673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.485727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.485764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.485769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.485822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.485872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.485924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.485989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.486030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.486039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.486097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.486152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.486210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.486272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.486312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.486321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.486395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.486454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.486513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.486572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.486615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.486621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.486676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.486724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.486775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.486841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.486880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.486887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.486945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.486995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.487048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.487110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.487149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.487154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.487194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561229:7092], now have 1 active actors on pipe
2025-10-01T14:12:39.487411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256050920561229:7092]
2025-10-01T14:12:39.487437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:39.487439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:39.487444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:39.487459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1733 reason: error at write: Disconnected sessionId: src_id|b6685162-4dcb75d-b749c90f-d7f409e_0
2025-10-01T14:12:39.487665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1733 sessionId: src_id|b6685162-4dcb75d-b749c90f-d7f409e_0 is DEAD
2025-10-01T14:12:39.487680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:39.487763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6685162-4dcb75d-b749c90f-d7f409e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:39.487774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6685162-4dcb75d-b749c90f-d7f409e_0] Write session will restart in 0.005225s
2025-10-01T14:12:39.487799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6685162-4dcb75d-b749c90f-d7f409e_0] Write session: Do CDS request
2025-10-01T14:12:39.487805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6685162-4dcb75d-b749c90f-d7f409e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:39.493810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6685162-4dcb75d-b749c90f-d7f409e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.493933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:39.493945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1734
2025-10-01T14:12:39.493995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:39.494040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.494069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:39.494077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:39.494081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:39.494527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1734 sessionId:  describe result for acl check
2025-10-01T14:12:39.494567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:39.494573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:39.494575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:39.494580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256050920561267:6816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:39.495100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256050920561267:6816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:39.495169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:39.495325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:39.495334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:39.495344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:39.495377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:39.495411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256048543664097:3947]
2025-10-01T14:12:39.496001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:39.496243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:39.496273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:39.496547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:39.496590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.496595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.496597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.496598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.496599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.496600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.496601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.496603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.496605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.496605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.496607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.496608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.496609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.496610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.496614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.496622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.496625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.496629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.496632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.496645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.496648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.496651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.496655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.496658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.496665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.496668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.496671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.496674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.496680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.496686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.496691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.496700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.496707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.496712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.496719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.496723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.496730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.496735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.496743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.496751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.496758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.496766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.496774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.496781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.496789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.496797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.496804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.496812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.496819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.496824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.496830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.496835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.496839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.496843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.496850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.496854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.496888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:39.497006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256050920561267:6816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:39.500138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256050920561267:6816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:39.500149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256050920561267:6816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:39.500152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256050920561267:6816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:39.500159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:39.500376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:39.500936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:39.500949Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:39.500951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:39.500954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:39.500960Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1733 [2:7556256048543664097:3947]
2025-10-01T14:12:39.500971Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:39.500988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:39.500995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.501000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.501006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.501020Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:39.501030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:39.501038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:39.501081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.501087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.501088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.501091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:39.501094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:39.501149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:39.501155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.501165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.501179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.501197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:39.501215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561307:6816], now have 1 active actors on pipe
2025-10-01T14:12:39.501222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561240:2446], now have 1 active actors on pipe
2025-10-01T14:12:39.501228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256048543664092:3947]
2025-10-01T14:12:39.501234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256048543664092:3947]
2025-10-01T14:12:39.501236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256048543664092:3947]
2025-10-01T14:12:39.501247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:39.501246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1733
2025-10-01T14:12:39.501260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:39.501246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1733
2025-10-01T14:12:39.501263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:39.501269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:39.501271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:39.501275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:39.501278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:39.501301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256048543664092:3947]
2025-10-01T14:12:39.501310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:39.501323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:39.501326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.501330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.501362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13e963bf-e58315dc-824c9d8-97105891_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:39.501372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.501375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.501377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:39.501383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.501393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:39.501410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.501523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.501529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.501540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.501596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1734 partition: 0 MaxSeqNo: 45 sessionId: src_id|13e963bf-e58315dc-824c9d8-97105891_0
2025-10-01T14:12:39.501895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6685162-4dcb75d-b749c90f-d7f409e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|13e963bf-e58315dc-824c9d8-97105891_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:39.504190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e963bf-e58315dc-824c9d8-97105891_0] Write session: try to update token
2025-10-01T14:12:39.504206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e963bf-e58315dc-824c9d8-97105891_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:39.517680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1734 sessionId: src_id|13e963bf-e58315dc-824c9d8-97105891_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:39.520113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:39.520242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.520266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.520303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:39.520359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:39.522086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:39.522102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:39.522103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:39.522104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:39.522113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256048543664092:3947]
2025-10-01T14:12:39.522116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256048543664092:3947]
2025-10-01T14:12:39.522119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256048543664092:3947]
2025-10-01T14:12:39.522152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:39.522152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:39.522157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:39.522160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:39.522160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.522162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:39.522279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:39.587368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256050920561314:7092]
2025-10-01T14:12:39.587574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1733, pipe: [1:7556256050920561314:7092]
2025-10-01T14:12:39.656350Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:39.662820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.662846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.662987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.663040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.663100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.663154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.663194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.663204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.663264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.663317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.663369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.663423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.663464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.663470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.663520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.663567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.663617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.663667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.663706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.663711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.663761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.663810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.663863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.663924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.663966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.663972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.664033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.664092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.664161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.664222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.664271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.664278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.664341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.664428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.664494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.664547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.664587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.664592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.664662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.664720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.664779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.664841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.664888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.664895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.664958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.665015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.665076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.665138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.665183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.665189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.665262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.665322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.665382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.665450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.665495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.665502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.665571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.665630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.665689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.665747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.665789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.665796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.665846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561314:7092], now have 1 active actors on pipe
2025-10-01T14:12:39.666028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:39.666055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:39.666057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:39.666076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256050920561314:7092]
2025-10-01T14:12:39.666079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1734 reason: error at write: Disconnected sessionId: src_id|13e963bf-e58315dc-824c9d8-97105891_0
2025-10-01T14:12:39.666260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1734 sessionId: src_id|13e963bf-e58315dc-824c9d8-97105891_0 is DEAD
2025-10-01T14:12:39.666357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e963bf-e58315dc-824c9d8-97105891_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:39.666366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e963bf-e58315dc-824c9d8-97105891_0] Write session will restart in 0.007590s
2025-10-01T14:12:39.666406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e963bf-e58315dc-824c9d8-97105891_0] Write session: Do CDS request
2025-10-01T14:12:39.666413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e963bf-e58315dc-824c9d8-97105891_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:39.666887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:39.671920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:39.673160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:39.673301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:39.673309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:39.673317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:39.673349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:39.673378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256048543664195:3915]
2025-10-01T14:12:39.673735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:39.673929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:39.673961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:39.674149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:39.674180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.674185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.674185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.674186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.674188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.674189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.674189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.674190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.674191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.674191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.674192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.674192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.674193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.674194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.674197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.674202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.674204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.674206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.674208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.674210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.674212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.674214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.674216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.674218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.674220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.674222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.674224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.674226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.674231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.674236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.674239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.674242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.674244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.674247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.674249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.674252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.674255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.674257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.674259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.674263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.674265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.674268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.674272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.674275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.674277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.674280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.674282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.674284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.674286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.674289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.674291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.674294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.674296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.674298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.674300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.674303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.674330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:39.674809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13e963bf-e58315dc-824c9d8-97105891_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.674882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:39.674892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1735
2025-10-01T14:12:39.674985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.675005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:39.675009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:39.675011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:39.675267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1735 sessionId:  describe result for acl check
2025-10-01T14:12:39.675296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:39.675301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:39.675302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:39.675306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256050920561350:6813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:39.675675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256050920561350:6813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:39.677531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:39.677831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256050920561350:6813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:39.678046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:39.678057Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:39.678059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:39.678061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:39.678066Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1734 [2:7556256048543664195:3915]
2025-10-01T14:12:39.678076Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:39.678086Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:39.678088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.678090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.678092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.678106Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:39.678115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:39.678120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:39.678177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.678186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.678188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.678191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:39.678193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:39.678270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:39.678277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.678291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.678311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.678337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:39.678341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1734
2025-10-01T14:12:39.678362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561317:2446], now have 1 active actors on pipe
2025-10-01T14:12:39.678391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256048543664190:3915]
2025-10-01T14:12:39.678398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256048543664190:3915]
2025-10-01T14:12:39.678400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256048543664190:3915]
2025-10-01T14:12:39.678412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:39.678422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:39.678423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:39.678424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:39.678438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:39.678458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:39.678471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:39.678511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256048543664190:3915]
2025-10-01T14:12:39.678541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:39.678548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:39.682965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256050920561350:6813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:39.682981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256050920561350:6813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:39.682984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256050920561350:6813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:39.682994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:39.683228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561389:6813], now have 1 active actors on pipe
2025-10-01T14:12:39.683246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1734
2025-10-01T14:12:39.683319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.683331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.683355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:39.683370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.683378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.683381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:39.683391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.683407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:39.683425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.683569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.683577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.683589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.683686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1735 partition: 0 MaxSeqNo: 45 sessionId: src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0
2025-10-01T14:12:39.683985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13e963bf-e58315dc-824c9d8-97105891_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:39.686346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0] Write session: try to update token
2025-10-01T14:12:39.686360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:39.688462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:39.688480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:39.688487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256048543664190:3915]
2025-10-01T14:12:39.688523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:39.688529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:39.688698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:39.688835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:39.689014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:39.689140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:39.689303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:39.689339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:39.699072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1735 sessionId: src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:39.701527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:39.701749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.701771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.701802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:39.701889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:39.706405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:39.706420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:39.706422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:39.706423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:39.706434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256048543664190:3915]
2025-10-01T14:12:39.706436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256048543664190:3915]
2025-10-01T14:12:39.706439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256048543664190:3915]
2025-10-01T14:12:39.706474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:39.706483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.706484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:39.706491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:39.706506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:39.706510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:39.706598Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:39.766038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256050920561392:7092]
2025-10-01T14:12:39.766275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1734, pipe: [1:7556256050920561392:7092]
2025-10-01T14:12:39.845018Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:39.852052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.852080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.852214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.852265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.852318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.852369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.852409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.852416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.852474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.852528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.852580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.852634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.852686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.852692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.852749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.852802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.852856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.852909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.852947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.852952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.853014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.853076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.853126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.853178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.853216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.853221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.853277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.853331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.853394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.853449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.853491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.853496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.853553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.853605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.853658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.853713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.853754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.853759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.853816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.853868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.853926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.853982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.854022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.854028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.854090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.854146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.854203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.854259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.854301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.854305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.854363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.854437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.854494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.854553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.854593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.854601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.854660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:39.854713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:39.854773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:39.854830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:39.854870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:39.854878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:39.854930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561392:7092], now have 1 active actors on pipe
2025-10-01T14:12:39.855138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:39.855178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256050920561392:7092]
2025-10-01T14:12:39.855208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:39.855218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:39.855247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1735 reason: error at write: Disconnected sessionId: src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0
2025-10-01T14:12:39.855450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1735 sessionId: src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0 is DEAD
2025-10-01T14:12:39.855559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:39.855569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0] Write session will restart in 0.007444s
2025-10-01T14:12:39.855592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0] Write session: Do CDS request
2025-10-01T14:12:39.855599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:39.855737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:39.861693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:39.863364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:39.863554Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:39.863563Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:39.863571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:39.863606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:39.863630Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256048543664263:3897]
2025-10-01T14:12:39.863834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.863970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:39.863981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1736
2025-10-01T14:12:39.864101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:39.864105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:39.864127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:39.864136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:39.864138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:39.864390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:39.864433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:39.864475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1736 sessionId:  describe result for acl check
2025-10-01T14:12:39.864498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:39.864498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:39.864500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:39.864502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256050920561429:6803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:39.864689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:39.864729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.864733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.864734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.864735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.864735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.864736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.864737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.864738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.864739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.864739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.864740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.864741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.864742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.864742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.864746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.864753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.864755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.864757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.864762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.864764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.864766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.864768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.864770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.864772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.864774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.864776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.864778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.864780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.864785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.864789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:39.864793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.864796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:39.864799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.864801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:39.864805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.864810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:39.864819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.864828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:39.864835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.864841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:39.864845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.864850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:39.864853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.864855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:39.864857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.864860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:39.864882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.864891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.864898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.864903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.864910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.864893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256050920561429:6803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:39.864919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.864930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.864938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:39.864943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.864945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:39.864968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:39.866946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256050920561429:6803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:39.868887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:39.868971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256050920561429:6803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:39.868982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256050920561429:6803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:39.868985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256050920561429:6803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:39.868989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:39.869615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:39.869631Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:39.869633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:39.869635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:39.869641Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1735 [2:7556256048543664263:3897]
2025-10-01T14:12:39.869650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:39.869663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:39.869665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.869668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.869669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.869681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:39.869685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:39.869689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:39.869728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.869735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.869738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.869740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:39.869741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:39.869789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:39.869796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.869802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:39.869808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:39.869820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:39.869835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561466:6803], now have 1 active actors on pipe
2025-10-01T14:12:39.869841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561397:2446], now have 1 active actors on pipe
2025-10-01T14:12:39.869846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256048543664258:3897]
2025-10-01T14:12:39.869847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256048543664258:3897]
2025-10-01T14:12:39.869848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256048543664258:3897]
2025-10-01T14:12:39.869857Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:39.869869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:39.869873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:39.869876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:39.869878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:39.869880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:39.869882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:39.869881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1735
2025-10-01T14:12:39.869903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1735
2025-10-01T14:12:39.869903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256048543664258:3897]
2025-10-01T14:12:39.869908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:39.869910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:39.869919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.869928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.869964Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|720583af-607dfcad-82924760-b7763699_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:39.869975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:39.869983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:39.869986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:39.869996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:39.870002Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:39.870018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.870129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.870134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.870144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:39.870200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1736 partition: 0 MaxSeqNo: 45 sessionId: src_id|720583af-607dfcad-82924760-b7763699_0
2025-10-01T14:12:39.870527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14ae510c-c4fde763-300fc89b-c4f7bf6b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|720583af-607dfcad-82924760-b7763699_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:39.872871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|720583af-607dfcad-82924760-b7763699_0] Write session: try to update token
2025-10-01T14:12:39.872889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|720583af-607dfcad-82924760-b7763699_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:39.886362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1736 sessionId: src_id|720583af-607dfcad-82924760-b7763699_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:39.889376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:39.890006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:39.890030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:39.890047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:39.890049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:39.890051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:39.890052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:39.890058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256048543664258:3897]
2025-10-01T14:12:39.890060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256048543664258:3897]
2025-10-01T14:12:39.890063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256048543664258:3897]
2025-10-01T14:12:39.890092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:39.890103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:39.890106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:39.890106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:39.890111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:39.890114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:39.890246Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:39.955472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256050920561474:7092]
2025-10-01T14:12:39.955732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1735, pipe: [1:7556256050920561474:7092]
2025-10-01T14:12:40.029299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:40.029607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:40.029652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256050920561474:7092], now have 1 active actors on pipe
2025-10-01T14:12:40.029851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256050920561474:7092]
2025-10-01T14:12:40.029898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:40.029904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:40.029978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:40.029988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:40.030053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1736 reason: error at write: Disconnected sessionId: src_id|720583af-607dfcad-82924760-b7763699_0
2025-10-01T14:12:40.030185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1736 sessionId: src_id|720583af-607dfcad-82924760-b7763699_0 is DEAD
2025-10-01T14:12:40.030315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720583af-607dfcad-82924760-b7763699_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:40.030326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720583af-607dfcad-82924760-b7763699_0] Write session will restart in 0.009303s
2025-10-01T14:12:40.030350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720583af-607dfcad-82924760-b7763699_0] Write session: Do CDS request
2025-10-01T14:12:40.030359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720583af-607dfcad-82924760-b7763699_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:40.035400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:40.036509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:40.036657Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:40.036665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:40.036673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:40.036708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:40.036738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256052838631630:3904]
2025-10-01T14:12:40.037181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:40.037373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:40.037403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:40.037591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:40.037627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.037631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.037632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.037632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.037633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.037633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.037634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.037635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.037635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.037636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.037636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.037637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.037638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.037638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.037641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.037648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.037650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.037652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.037654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.037656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.037659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.037661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.037663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.037665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.037667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.037669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.037671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.037673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.037680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.037685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.037690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.037692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.037695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.037698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.037701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.037704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.037707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.037711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.037713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.037715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.037718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.037720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.037722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.037729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.037732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.037736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.037744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.037748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.037751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.037759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.037767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.037770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.037777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.037781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.037788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.037792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.037831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:40.040838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|720583af-607dfcad-82924760-b7763699_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.040910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:40.040924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1737
2025-10-01T14:12:40.041041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.041073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:40.041080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:40.041083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:40.041091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:40.041516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1737 sessionId:  describe result for acl check
2025-10-01T14:12:40.041548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:40.041551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:40.041553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:40.041560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256055215528808:6799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:40.041628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:40.041638Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:40.041640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:40.041644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:40.041649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1736 [2:7556256052838631630:3904]
2025-10-01T14:12:40.041658Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:40.041672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:40.041678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.041681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.041682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.041692Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:40.041699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:40.041703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:40.041738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.041743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.041744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.041746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:40.041748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:40.041792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:40.041797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.041804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.041812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.041824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:40.041840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215528771:2446], now have 1 active actors on pipe
2025-10-01T14:12:40.041849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256052838631625:3904]
2025-10-01T14:12:40.041850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256052838631625:3904]
2025-10-01T14:12:40.041851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256052838631625:3904]
2025-10-01T14:12:40.041862Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:40.041870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:40.041873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:40.041878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:40.041879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:40.041881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:40.041882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:40.041870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1736
2025-10-01T14:12:40.041900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256052838631625:3904]
2025-10-01T14:12:40.041909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:40.041913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:40.041973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256055215528808:6799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:40.043527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256055215528808:6799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:40.047673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256055215528808:6799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:40.047685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256055215528808:6799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:40.047688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256055215528808:6799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:40.047694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:40.047871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215528846:6799], now have 1 active actors on pipe
2025-10-01T14:12:40.047915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1736
2025-10-01T14:12:40.047949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.047959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.047980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:40.047991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.047999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.048001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:40.048009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.048024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:40.048042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.048129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.048134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.048143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.048187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1737 partition: 0 MaxSeqNo: 45 sessionId: src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0
2025-10-01T14:12:40.048451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|720583af-607dfcad-82924760-b7763699_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:40.050787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0] Write session: try to update token
2025-10-01T14:12:40.050801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:40.051761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:40.051784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.051791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256052838631625:3904]
2025-10-01T14:12:40.051832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:40.051843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:40.052019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:40.052161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.052295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.052435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.052627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:40.052678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:40.064123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1737 sessionId: src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:40.066285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:40.066476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.066494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.066525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:40.066594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:40.070399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:40.070417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.070419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:40.070421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:40.070431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256052838631625:3904]
2025-10-01T14:12:40.070434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256052838631625:3904]
2025-10-01T14:12:40.070438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256052838631625:3904]
2025-10-01T14:12:40.070482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:40.070481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:40.070485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:40.070488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:40.070491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.070492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:40.070604Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:40.130088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256055215528850:7092]
2025-10-01T14:12:40.130311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1736, pipe: [1:7556256055215528850:7092]
2025-10-01T14:12:40.204326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:40.211391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.211418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.211555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.211609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.211667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.211720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.211762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.211769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.211826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.211882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.211942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.211999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.212040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.212045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.212104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.212157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.212210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.212263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.212364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.212369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.212426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.212475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.212527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.212581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.212623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.212628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.212690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.212743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.212796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.212846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.212883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.212888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.212942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.212992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.213047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.213101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.213139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.213144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.213199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.213249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.213304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.213360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.213397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.213407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.213468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.213518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.213572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.213625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.213663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.213667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.213722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.213772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.213836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.213889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.213928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.213933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.213995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.214051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.214103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.214155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.214197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.214204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.214251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215528850:7092], now have 1 active actors on pipe
2025-10-01T14:12:40.214471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:40.214474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:40.214484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:40.214511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1737 reason: error at write: Disconnected sessionId: src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0
2025-10-01T14:12:40.214525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256055215528850:7092]
2025-10-01T14:12:40.214691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1737 sessionId: src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0 is DEAD
2025-10-01T14:12:40.214854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:40.214865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0] Write session will restart in 0.008542s
2025-10-01T14:12:40.214889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0] Write session: Do CDS request
2025-10-01T14:12:40.214895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:40.215123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:40.220207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:40.221433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:40.221629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:40.221640Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:40.221652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:40.221710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:40.221746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256052838631712:3902]
2025-10-01T14:12:40.222323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:40.222578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:40.222625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:40.222920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:40.222983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.222989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.222990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.222991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.222992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.222993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.222994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.222995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.222996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.222996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.222998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.222999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.223000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.223001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.223006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.223018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.223022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.223025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.223034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.223042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.223044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.223051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.223055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.223062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.223065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.223072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.223075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.223083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.223090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.223101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.223110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.223119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.223127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.223136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.223144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.223154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.223162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.223171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.223182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.223188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.223192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.223197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.223201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.223205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.223210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.223214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.223218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.223223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.223231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.223236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.223240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.223249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.223253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.223261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.223265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.223273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.223316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:40.224896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.224972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:40.224984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1738
2025-10-01T14:12:40.225081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.225109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:40.225117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:40.225121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:40.225454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1738 sessionId:  describe result for acl check
2025-10-01T14:12:40.225484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:40.225488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:40.225490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:40.225493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256055215528888:6792] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:40.225920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256055215528888:6792] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:40.226683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:40.227341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:40.227362Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:40.227367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:40.227370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:40.227377Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1737 [2:7556256052838631712:3902]
2025-10-01T14:12:40.227396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:40.227415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:40.227422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.227426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.227429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.227444Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:40.227454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:40.227460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:40.227514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.227523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.227525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.227528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:40.227531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:40.227595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:40.227602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.227615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.227631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.227651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:40.227672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215528852:2446], now have 1 active actors on pipe
2025-10-01T14:12:40.227660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1737
2025-10-01T14:12:40.227683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256052838631707:3902]
2025-10-01T14:12:40.227689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256052838631707:3902]
2025-10-01T14:12:40.227691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256052838631707:3902]
2025-10-01T14:12:40.227699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:40.227706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:40.227708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:40.227710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:40.227716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:40.227730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:40.227738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:40.227772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256052838631707:3902]
2025-10-01T14:12:40.227783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:40.227791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:40.227878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256055215528888:6792] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:40.233389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256055215528888:6792] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:40.233401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256055215528888:6792] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:40.233403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256055215528888:6792] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:40.233411Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:40.233657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1737
2025-10-01T14:12:40.233640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215528927:6792], now have 1 active actors on pipe
2025-10-01T14:12:40.233718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.233731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.233758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24d98867-b4d83802-ee82e514-4a323476_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:40.233775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.233781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.233783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:40.233796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.233815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:40.233836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.234003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.234013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.234032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.234125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1738 partition: 0 MaxSeqNo: 45 sessionId: src_id|24d98867-b4d83802-ee82e514-4a323476_0
2025-10-01T14:12:40.234419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c48a7f-b69a1df7-6d4e40dd-1ab231f2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|24d98867-b4d83802-ee82e514-4a323476_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:40.236802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d98867-b4d83802-ee82e514-4a323476_0] Write session: try to update token
2025-10-01T14:12:40.236819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d98867-b4d83802-ee82e514-4a323476_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:40.246576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:40.246597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.246599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:40.246600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:40.246608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256052838631707:3902]
2025-10-01T14:12:40.246612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256052838631707:3902]
2025-10-01T14:12:40.246615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256052838631707:3902]
2025-10-01T14:12:40.246654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:40.246657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:40.246661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.246662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:40.246663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:40.246664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:40.246784Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:40.248663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1738 sessionId: src_id|24d98867-b4d83802-ee82e514-4a323476_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:40.251021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:40.314920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256055215528944:7092]
2025-10-01T14:12:40.315166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1737, pipe: [1:7556256055215528944:7092]
2025-10-01T14:12:40.384093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:40.384444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.384456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.384491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215528944:7092], now have 1 active actors on pipe
2025-10-01T14:12:40.384739Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:40.384757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:40.384783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256055215528944:7092]
2025-10-01T14:12:40.384803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:40.384806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:40.384862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1738 reason: error at write: Disconnected sessionId: src_id|24d98867-b4d83802-ee82e514-4a323476_0
2025-10-01T14:12:40.385046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1738 sessionId: src_id|24d98867-b4d83802-ee82e514-4a323476_0 is DEAD
2025-10-01T14:12:40.385165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d98867-b4d83802-ee82e514-4a323476_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:40.385172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d98867-b4d83802-ee82e514-4a323476_0] Write session will restart in 0.005559s
2025-10-01T14:12:40.385194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d98867-b4d83802-ee82e514-4a323476_0] Write session: Do CDS request
2025-10-01T14:12:40.385198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d98867-b4d83802-ee82e514-4a323476_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:40.390172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:40.391510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:40.391699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:40.391711Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:40.391721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:40.391768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:40.391812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256052838631790:3894]
2025-10-01T14:12:40.391817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24d98867-b4d83802-ee82e514-4a323476_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.391889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:40.391901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1739
2025-10-01T14:12:40.391997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.392023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:40.392032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:40.392035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:40.392370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1739 sessionId:  describe result for acl check
2025-10-01T14:12:40.392397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:40.392399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:40.392395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:40.392400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:40.392404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256055215528999:6772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:40.392626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:40.392682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:40.392967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:40.393043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.393050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.393051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.393052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.393052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.393053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.393054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.393055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.393056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.393057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.393058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.393059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.393060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.393061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.393065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.393074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.393078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.393081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.393085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.393089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.393092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.393096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.393099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.393105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.393108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.393112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.393115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.393118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.393125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.393137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.393148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.393156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.393165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.393174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.393183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.393191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.393195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.393203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.393207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.393215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.393218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.393223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.393230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.393235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.393239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.393247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.393251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.393254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.393262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.393266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.393269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.393272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.393275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.393279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.393282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.393286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.393252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256055215528999:6772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:40.393321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:40.394891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256055215528999:6772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:40.396656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:40.396803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256055215528999:6772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:40.396815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256055215528999:6772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:40.396816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256055215528999:6772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:40.396822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:40.397267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:40.397285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:40.397288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:40.397292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:40.397297Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1738 [2:7556256052838631790:3894]
2025-10-01T14:12:40.397316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:40.397335Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:40.397341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.397345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.397351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.397365Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:40.397376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:40.397382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:40.397437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.397443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.397445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.397447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:40.397450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:40.397512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:40.397519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.397530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.397545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.397567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:40.397579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1738
2025-10-01T14:12:40.397587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215528966:2446], now have 1 active actors on pipe
2025-10-01T14:12:40.397582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1738
2025-10-01T14:12:40.397594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529039:6772], now have 1 active actors on pipe
2025-10-01T14:12:40.397602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256052838631785:3894]
2025-10-01T14:12:40.397608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256052838631785:3894]
2025-10-01T14:12:40.397610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256052838631785:3894]
2025-10-01T14:12:40.397618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:40.397624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:40.397627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:40.397628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:40.397635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:40.397654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:40.397660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:40.397677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.397684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.397722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256052838631785:3894]
2025-10-01T14:12:40.397732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:40.397742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:40.397749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e76463d-6a694418-49bf6a7e-baf8529_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:40.397755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.397759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.397765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:40.397773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.397785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:40.397820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.397947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.397957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.397972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.398026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1739 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e76463d-6a694418-49bf6a7e-baf8529_0
2025-10-01T14:12:40.398317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24d98867-b4d83802-ee82e514-4a323476_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e76463d-6a694418-49bf6a7e-baf8529_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:40.400516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76463d-6a694418-49bf6a7e-baf8529_0] Write session: try to update token
2025-10-01T14:12:40.400531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76463d-6a694418-49bf6a7e-baf8529_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:40.413023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1739 sessionId: src_id|6e76463d-6a694418-49bf6a7e-baf8529_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:40.415102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:40.416570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.416600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.416621Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:40.416625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.416628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:40.416633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:40.416655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256052838631785:3894]
2025-10-01T14:12:40.416664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256052838631785:3894]
2025-10-01T14:12:40.416667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256052838631785:3894]
2025-10-01T14:12:40.416716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:40.416715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:40.416722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:40.416726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.416726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:40.416728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:40.416860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:40.484908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256055215529055:7092]
2025-10-01T14:12:40.485111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1738, pipe: [1:7556256055215529055:7092]
2025-10-01T14:12:40.551228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:40.551632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:40.551697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529055:7092], now have 1 active actors on pipe
2025-10-01T14:12:40.551789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:40.552470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:40.552538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256055215529055:7092]
2025-10-01T14:12:40.559724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:40.561112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:40.561267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:40.561276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:40.561285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:40.561323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:40.561352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256052838631862:3886]
2025-10-01T14:12:40.561723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:40.561958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:40.561993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:40.562195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:40.562243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.562248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.562249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.562250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.562251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.562252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.562253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.562254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.562256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.562257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.562258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.562259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.562260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.562261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.562266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.562276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.562279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.562283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.562287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.562291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.562294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.562297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.562301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.562304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.562308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.562312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.562316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.562321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.562328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.562334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.562340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.562344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.562348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.562352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.562358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.562363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.562381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.562386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.562392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.562397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.562406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.562412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.562419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.562424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.562431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.562439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.562443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.562447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.562455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.562460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.562467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.562471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.562479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.562484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.562491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.562496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.562540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:40.565365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:40.565379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:40.565406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1739 reason: error at write: Disconnected sessionId: src_id|6e76463d-6a694418-49bf6a7e-baf8529_0
2025-10-01T14:12:40.565579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1739 sessionId: src_id|6e76463d-6a694418-49bf6a7e-baf8529_0 is DEAD
2025-10-01T14:12:40.565695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76463d-6a694418-49bf6a7e-baf8529_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:40.565706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76463d-6a694418-49bf6a7e-baf8529_0] Write session will restart in 0.007997s
2025-10-01T14:12:40.565735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76463d-6a694418-49bf6a7e-baf8529_0] Write session: Do CDS request
2025-10-01T14:12:40.565741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76463d-6a694418-49bf6a7e-baf8529_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:40.570620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:40.571245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:40.571261Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:40.571266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:40.571272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:40.571278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1739 [2:7556256052838631862:3886]
2025-10-01T14:12:40.571293Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:40.571314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:40.571322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.571325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.571327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.571344Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:40.571350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:40.571357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:40.571421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.571427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.571429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.571432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:40.571435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:40.571504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:40.571511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.571522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.571531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.571545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:40.571569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529056:2446], now have 1 active actors on pipe
2025-10-01T14:12:40.571581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256052838631857:3886]
2025-10-01T14:12:40.571586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256052838631857:3886]
2025-10-01T14:12:40.571589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256052838631857:3886]
2025-10-01T14:12:40.571606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:40.571614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:40.571616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:40.571617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:40.571623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:40.571636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:40.571643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:40.571671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256052838631857:3886]
2025-10-01T14:12:40.571681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:40.571685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:40.571782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1739
2025-10-01T14:12:40.574832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76463d-6a694418-49bf6a7e-baf8529_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.574945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:40.574960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1740
2025-10-01T14:12:40.575071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.575105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:40.575115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:40.575121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:40.575563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1740 sessionId:  describe result for acl check
2025-10-01T14:12:40.575603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:40.575609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:40.575611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:40.575618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256055215529100:6767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:40.576191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256055215529100:6767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:40.579057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256055215529100:6767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:40.581908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256055215529100:6767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:40.581925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256055215529100:6767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:40.581929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256055215529100:6767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:40.581989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:40.582023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:40.582041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.582049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256052838631857:3886]
2025-10-01T14:12:40.582087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:40.582093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:40.582215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1739
2025-10-01T14:12:40.582251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:40.582405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.582546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.582705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.582905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:40.582950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529136:6767], now have 1 active actors on pipe
2025-10-01T14:12:40.582977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.582986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.583003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:40.583036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e23f046b-ec276f48-e1bece68-5d253a79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:40.583051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.583062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.583064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:40.583076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.583095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:40.583116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.583314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.583323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.583338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.583423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1740 partition: 0 MaxSeqNo: 45 sessionId: src_id|e23f046b-ec276f48-e1bece68-5d253a79_0
2025-10-01T14:12:40.583746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76463d-6a694418-49bf6a7e-baf8529_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e23f046b-ec276f48-e1bece68-5d253a79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:40.586124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23f046b-ec276f48-e1bece68-5d253a79_0] Write session: try to update token
2025-10-01T14:12:40.586139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23f046b-ec276f48-e1bece68-5d253a79_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:40.599277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1740 sessionId: src_id|e23f046b-ec276f48-e1bece68-5d253a79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:40.600677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:40.600696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.600699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:40.600701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:40.600712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256052838631857:3886]
2025-10-01T14:12:40.600718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256052838631857:3886]
2025-10-01T14:12:40.600722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256052838631857:3886]
2025-10-01T14:12:40.600763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:40.600764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:40.600769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:40.600772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:40.600772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.600776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:40.600911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:40.601922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:40.652811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256055215529138:7092]
2025-10-01T14:12:40.653017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1739, pipe: [1:7556256055215529138:7092]
2025-10-01T14:12:40.738158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:40.738408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.738434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.738464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529138:7092], now have 1 active actors on pipe
2025-10-01T14:12:40.738635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:40.738709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:40.738712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256055215529138:7092]
2025-10-01T14:12:40.738720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:40.738729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:40.738769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1740 reason: error at write: Disconnected sessionId: src_id|e23f046b-ec276f48-e1bece68-5d253a79_0
2025-10-01T14:12:40.738922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1740 sessionId: src_id|e23f046b-ec276f48-e1bece68-5d253a79_0 is DEAD
2025-10-01T14:12:40.739058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23f046b-ec276f48-e1bece68-5d253a79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:40.739069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23f046b-ec276f48-e1bece68-5d253a79_0] Write session will restart in 0.009468s
2025-10-01T14:12:40.739096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23f046b-ec276f48-e1bece68-5d253a79_0] Write session: Do CDS request
2025-10-01T14:12:40.739101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23f046b-ec276f48-e1bece68-5d253a79_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:40.744370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:40.745574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:40.745705Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:40.745713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:40.745721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:40.745750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:40.745776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256052838631966:3869]
2025-10-01T14:12:40.746165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:40.746359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:40.746409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:40.746673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:40.746722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.746728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.746729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.746730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.746731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.746732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.746733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.746734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.746735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.746736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.746738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.746739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.746741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.746742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.746746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.746755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.746759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.746763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.746766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.746770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.746774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.746777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.746781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.746785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.746788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.746792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.746795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.746799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.746807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.746813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.746819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.746824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.746828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.746833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.746836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.746841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.746845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.746850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.746854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.746858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.746862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.746868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.746872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.746877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.746881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.746886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.746890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.746894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.746898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.746903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.746907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.746912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.746917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.746922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.746925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.746930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.746968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:40.749827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23f046b-ec276f48-e1bece68-5d253a79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.749876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:40.749889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1741
2025-10-01T14:12:40.749993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.750021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:40.750031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:40.750034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:40.750387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1741 sessionId:  describe result for acl check
2025-10-01T14:12:40.750419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:40.750425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:40.750427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:40.750433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256055215529179:6761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:40.750725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:40.750942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256055215529179:6761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:40.751325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:40.751340Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:40.751342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:40.751344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:40.751350Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1740 [2:7556256052838631966:3869]
2025-10-01T14:12:40.751359Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:40.751372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:40.751373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.751376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.751377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.751387Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:40.751394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:40.751399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:40.751450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.751457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.751458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.751461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:40.751463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:40.751524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:40.751529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.751537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.751550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.751569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:40.751590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529139:2446], now have 1 active actors on pipe
2025-10-01T14:12:40.751602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256052838631961:3869]
2025-10-01T14:12:40.751608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256052838631961:3869]
2025-10-01T14:12:40.751610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256052838631961:3869]
2025-10-01T14:12:40.751625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:40.751617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1740
2025-10-01T14:12:40.751640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:40.751641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:40.751649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:40.751653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:40.751654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:40.751656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:40.751687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256052838631961:3869]
2025-10-01T14:12:40.751698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:40.751706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:40.752752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256055215529179:6761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:40.759197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256055215529179:6761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:40.759211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256055215529179:6761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:40.759213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256055215529179:6761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:40.759219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:40.759436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529218:6761], now have 1 active actors on pipe
2025-10-01T14:12:40.759490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1740
2025-10-01T14:12:40.759548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.759557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.759582Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9a16470-d180edf6-371ec91-740d11fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:40.759595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.759602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.759604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:40.759613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.759628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:40.759648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.759778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.759788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.759801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.759863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1741 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9a16470-d180edf6-371ec91-740d11fd_0
2025-10-01T14:12:40.760163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23f046b-ec276f48-e1bece68-5d253a79_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9a16470-d180edf6-371ec91-740d11fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:40.762546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a16470-d180edf6-371ec91-740d11fd_0] Write session: try to update token
2025-10-01T14:12:40.762564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a16470-d180edf6-371ec91-740d11fd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:40.763218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:40.763236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.763243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256052838631961:3869]
2025-10-01T14:12:40.763280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:40.763290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:40.763456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:40.763588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.763729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.763860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.764050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:40.764087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:40.774580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1741 sessionId: src_id|f9a16470-d180edf6-371ec91-740d11fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:40.776923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:40.777128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.777155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.777206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:40.777288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:40.781891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:40.781911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.781913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:40.781914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:40.781923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256052838631961:3869]
2025-10-01T14:12:40.781926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256052838631961:3869]
2025-10-01T14:12:40.781930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256052838631961:3869]
2025-10-01T14:12:40.781965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:40.781970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:40.781972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:40.781977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:40.781983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.781985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:40.782116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:40.838690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256055215529222:7092]
2025-10-01T14:12:40.838952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1740, pipe: [1:7556256055215529222:7092]
2025-10-01T14:12:40.924221Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:40.931125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.931157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.931302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.931358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.931418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.931471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.931510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.931516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.931571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.931627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.931681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.931732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.931771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.931776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.931833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.931887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.931942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.931998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.932086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.932091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.932148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.932203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.932258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.932313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.932358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.932364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.932428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.932485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.932537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.932590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.932629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.932644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.932703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.932756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.932808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.932863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.932901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.932907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.932961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.933013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.933070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.933155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.933202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.933209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.933267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.933316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.933370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.933422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.933459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.933464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.933528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.933580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.933630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.933684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.933724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.933729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.933784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:40.933832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:40.933888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:40.933941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:40.933979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:40.933984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:40.934020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529222:7092], now have 1 active actors on pipe
2025-10-01T14:12:40.934256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:40.934271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:40.934275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:40.934296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1741 reason: error at write: Disconnected sessionId: src_id|f9a16470-d180edf6-371ec91-740d11fd_0
2025-10-01T14:12:40.934310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256055215529222:7092]
2025-10-01T14:12:40.934463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1741 sessionId: src_id|f9a16470-d180edf6-371ec91-740d11fd_0 is DEAD
2025-10-01T14:12:40.934613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a16470-d180edf6-371ec91-740d11fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:40.934623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a16470-d180edf6-371ec91-740d11fd_0] Write session will restart in 0.009877s
2025-10-01T14:12:40.934647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a16470-d180edf6-371ec91-740d11fd_0] Write session: Do CDS request
2025-10-01T14:12:40.934653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a16470-d180edf6-371ec91-740d11fd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:40.934780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:40.940716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:40.941902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:40.942044Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:40.942054Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:40.942063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:40.942103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:40.942141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256052838632041:3866]
2025-10-01T14:12:40.942617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:40.942843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:40.942876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:40.943080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:40.943121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.943126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.943126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.943127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.943128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.943128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.943129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.943130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.943130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.943131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.943131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.943132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.943132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.943133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.943136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.943142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.943144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.943146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.943149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.943151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.943152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.943154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.943156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.943158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.943160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.943162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.943165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.943168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.943174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.943182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:40.943189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.943194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:40.943198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.943203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:40.943207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.943211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:40.943213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.943216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:40.943218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.943221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:40.943225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.943227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:40.943231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.943233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:40.943236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.943238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:40.943240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.943243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.943246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.943248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.943250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.943253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.943255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.943258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:40.943261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.943263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:40.943283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:40.945803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a16470-d180edf6-371ec91-740d11fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.945909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:40.945921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1742
2025-10-01T14:12:40.946010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:40.946031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:40.946037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:40.946040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:40.946362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1742 sessionId:  describe result for acl check
2025-10-01T14:12:40.946405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:40.946411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:40.946412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:40.946417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256055215529267:6751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:40.946588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:40.946845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256055215529267:6751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:40.947176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:40.947192Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:40.947194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:40.947197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:40.947205Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1741 [2:7556256052838632041:3866]
2025-10-01T14:12:40.947215Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:40.947228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:40.947234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.947236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.947237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.947248Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:40.947251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:40.947256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:40.947299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.947303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.947304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.947306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:40.947308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:40.947353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:40.947358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.947365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:40.947374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:40.947386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:40.947401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529226:2446], now have 1 active actors on pipe
2025-10-01T14:12:40.947412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256052838632036:3866]
2025-10-01T14:12:40.947413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256052838632036:3866]
2025-10-01T14:12:40.947414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256052838632036:3866]
2025-10-01T14:12:40.947424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1741
2025-10-01T14:12:40.947424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:40.947432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:40.947440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:40.947442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:40.947442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:40.947445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:40.947447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:40.947458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256052838632036:3866]
2025-10-01T14:12:40.947459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:40.947462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:40.948820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256055215529267:6751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:40.954249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256055215529267:6751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:40.954261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256055215529267:6751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:40.954264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256055215529267:6751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:40.954269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:40.954491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256055215529305:6751], now have 1 active actors on pipe
2025-10-01T14:12:40.954534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1741
2025-10-01T14:12:40.954601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.954619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.954646Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|723d7feb-ac260057-9b0d1655-5128f456_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:40.954660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:40.954669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:40.954676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:40.954686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:40.954703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:40.954725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.954843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.954848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.954857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:40.954923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1742 partition: 0 MaxSeqNo: 45 sessionId: src_id|723d7feb-ac260057-9b0d1655-5128f456_0
2025-10-01T14:12:40.955215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9a16470-d180edf6-371ec91-740d11fd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|723d7feb-ac260057-9b0d1655-5128f456_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:40.957161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:40.957173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.957180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256052838632036:3866]
2025-10-01T14:12:40.957209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:40.957216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:40.957372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:40.957416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723d7feb-ac260057-9b0d1655-5128f456_0] Write session: try to update token
2025-10-01T14:12:40.957430Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723d7feb-ac260057-9b0d1655-5128f456_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:40.957504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.957634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.957755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:40.957923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:40.957957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:40.970296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1742 sessionId: src_id|723d7feb-ac260057-9b0d1655-5128f456_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:40.972771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:40.973020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:40.973046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:40.973098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:40.973184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:40.976507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:40.976517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:40.976520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:40.976522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:40.976530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256052838632036:3866]
2025-10-01T14:12:40.976532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256052838632036:3866]
2025-10-01T14:12:40.976535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256052838632036:3866]
2025-10-01T14:12:40.976573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:40.976577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:40.976579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:40.976580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:40.976581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:40.976584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:40.976716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:41.034262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256059510496605:7092]
2025-10-01T14:12:41.034503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1741, pipe: [1:7556256059510496605:7092]
2025-10-01T14:12:41.118701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:41.125318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.125341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.125478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.125531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.125585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.125641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.125682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.125689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.125748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.125801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.125884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.125938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.125984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.125992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.126050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.126104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.126156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.126241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.126278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.126283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.126340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.126406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.126493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.126547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.126587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.126592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.126648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.126705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.126758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.126812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.126852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.126856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.126917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.126998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.127055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.127112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.127153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.127160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.127219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.127273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.127330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.127389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.127428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.127433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.127492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.127550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.127605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.127661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.127704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.127709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.127764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.127816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.127874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.127934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.127972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.127976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.128052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.128102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.128153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.128213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.128252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.128257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.128294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496605:7092], now have 1 active actors on pipe
2025-10-01T14:12:41.128502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:41.128525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256059510496605:7092]
2025-10-01T14:12:41.128550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:41.128553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:41.128574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1742 reason: error at write: Disconnected sessionId: src_id|723d7feb-ac260057-9b0d1655-5128f456_0
2025-10-01T14:12:41.128732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1742 sessionId: src_id|723d7feb-ac260057-9b0d1655-5128f456_0 is DEAD
2025-10-01T14:12:41.128884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d7feb-ac260057-9b0d1655-5128f456_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:41.128894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d7feb-ac260057-9b0d1655-5128f456_0] Write session will restart in 0.005691s
2025-10-01T14:12:41.128919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d7feb-ac260057-9b0d1655-5128f456_0] Write session: Do CDS request
2025-10-01T14:12:41.128925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d7feb-ac260057-9b0d1655-5128f456_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:41.129032Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:41.135130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:41.135821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|723d7feb-ac260057-9b0d1655-5128f456_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.135842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:41.135854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1743
2025-10-01T14:12:41.136000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.136030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:41.136040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:41.136042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:41.136409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1743 sessionId:  describe result for acl check
2025-10-01T14:12:41.136440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:41.136447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:41.136449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:41.136453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256059510496645:6741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:41.136628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:41.136786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:41.136795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:41.136803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:41.136842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:41.136868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256057133599427:3858]
2025-10-01T14:12:41.136932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256059510496645:6741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:41.137256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:41.137487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:41.137513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:41.137716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:41.137753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.137758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.137759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.137760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.137761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.137761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.137762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.137762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.137763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.137763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.137764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.137765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.137765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.137766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.137769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.137774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.137777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.137781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.137784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.137788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.137791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.137795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.137799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.137802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.137806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.137809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.137813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.137816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.137825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.137830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.137835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.137840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.137850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.137859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.137863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.137872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.137880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.137889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.137895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.137898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.137905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.137908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.137910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.137916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.137919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.137922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.137924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.137927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.137930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.137936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.137938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.137941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.137946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.137949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.137951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.137954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.137974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:41.139429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256059510496645:6741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:41.141250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:41.141794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256059510496645:6741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:41.141803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256059510496645:6741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:41.141806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256059510496645:6741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:41.141811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:41.141848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:41.141866Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:41.141868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:41.141871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:41.141877Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1742 [2:7556256057133599427:3858]
2025-10-01T14:12:41.141892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:41.141908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:41.141916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.141919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.141921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.141936Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:41.141945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:41.141954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:41.142002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.142008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.142010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.142013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:41.142015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:41.142074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:41.142080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.142090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.142100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.142118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:41.142138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496683:6741], now have 1 active actors on pipe
2025-10-01T14:12:41.142130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1742
2025-10-01T14:12:41.142144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496608:2446], now have 1 active actors on pipe
2025-10-01T14:12:41.142151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256057133599422:3858]
2025-10-01T14:12:41.142153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256057133599422:3858]
2025-10-01T14:12:41.142155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256057133599422:3858]
2025-10-01T14:12:41.142163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:41.142168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:41.142169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:41.142156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1742
2025-10-01T14:12:41.142171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:41.142178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:41.142189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:41.142195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:41.142212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.142222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.142254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256057133599422:3858]
2025-10-01T14:12:41.142265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:41.142271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:41.142285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:41.142296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.142300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.142301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:41.142309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.142318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:41.142354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.142500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.142505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.142516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.142587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1743 partition: 0 MaxSeqNo: 45 sessionId: src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0
2025-10-01T14:12:41.142904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|723d7feb-ac260057-9b0d1655-5128f456_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:41.145127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0] Write session: try to update token
2025-10-01T14:12:41.145143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:41.157005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1743 sessionId: src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:41.159199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:41.159400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.159421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.159460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:41.159543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:41.161879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:41.161892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:41.161893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:41.161895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:41.161902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256057133599422:3858]
2025-10-01T14:12:41.161906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256057133599422:3858]
2025-10-01T14:12:41.161909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256057133599422:3858]
2025-10-01T14:12:41.161951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:41.161956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:41.161960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.161962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:41.161962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:41.161966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:41.162079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:41.228828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256059510496691:7092]
2025-10-01T14:12:41.229070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1742, pipe: [1:7556256059510496691:7092]
2025-10-01T14:12:41.297485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:41.304605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.304633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.304808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.304877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.304947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.305014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.305065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.305075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.305143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.305213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.305284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.305356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.305402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.305411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.305471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.305531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.305592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.305654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.305703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.305711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.305776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.305838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.305900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.305962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.306007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.306014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.306076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.306134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.306197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.306260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.306305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.306312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.306394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.306457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.306530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.306596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.306647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.306659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.306725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.306785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.306843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.306908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.306953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.306960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.307020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.307083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.307144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.307207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.307253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.307260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.307328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.307390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.307458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.307529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.307580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.307587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.307655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.307715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.307785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.307849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.307895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.307902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.307961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496691:7092], now have 1 active actors on pipe
2025-10-01T14:12:41.308224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:41.308234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:41.308238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:41.308266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1743 reason: error at write: Disconnected sessionId: src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0
2025-10-01T14:12:41.308283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256059510496691:7092]
2025-10-01T14:12:41.308447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1743 sessionId: src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0 is DEAD
2025-10-01T14:12:41.308560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:41.308571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0] Write session will restart in 0.009951s
2025-10-01T14:12:41.308594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0] Write session: Do CDS request
2025-10-01T14:12:41.308600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:41.308937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:41.314760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:41.315992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:41.316142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:41.316151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:41.316161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:41.316203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:41.316233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256057133599504:3856]
2025-10-01T14:12:41.316618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:41.316845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:41.316872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:41.317064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:41.317112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.317116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.317117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.317118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.317118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.317119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.317119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.317120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.317120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.317121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.317121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.317122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.317122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.317123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.317126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.317132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.317134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.317136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.317138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.317140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.317142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.317144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.317146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.317148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.317150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.317152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.317154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.317156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.317161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.317167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.317171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.317174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.317176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.317179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.317181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.317184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.317186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.317189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.317191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.317193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.317197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.317201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.317205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.317213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.317217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.317226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.317230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.317239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.317244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.317250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.317252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.317255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.317259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.317262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.317264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.317267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.317290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:41.319840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.319938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:41.319952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1744
2025-10-01T14:12:41.320082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.320123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:41.320134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:41.320142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:41.320419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:41.320507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1744 sessionId:  describe result for acl check
2025-10-01T14:12:41.320540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:41.320546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:41.320548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:41.320553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256059510496737:6738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:41.321012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:41.321025Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:41.321027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:41.321030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:41.321039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1743 [2:7556256057133599504:3856]
2025-10-01T14:12:41.321053Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:41.321060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256059510496737:6738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:41.321066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:41.321079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.321082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.321084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.321098Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:41.321103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:41.321107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:41.321140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.321145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.321146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.321148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:41.321150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:41.321198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:41.321202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.321209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.321214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.321227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:41.321246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496694:2446], now have 1 active actors on pipe
2025-10-01T14:12:41.321256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256057133599499:3856]
2025-10-01T14:12:41.321261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256057133599499:3856]
2025-10-01T14:12:41.321262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256057133599499:3856]
2025-10-01T14:12:41.321266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1743
2025-10-01T14:12:41.321277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:41.321282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:41.321284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:41.321285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:41.321290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:41.321302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:41.321309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:41.321329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256057133599499:3856]
2025-10-01T14:12:41.321341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:41.321350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:41.322841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256059510496737:6738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:41.327353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256059510496737:6738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:41.327367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256059510496737:6738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:41.327370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256059510496737:6738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:41.327376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:41.327556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496775:6738], now have 1 active actors on pipe
2025-10-01T14:12:41.327610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1743
2025-10-01T14:12:41.327660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.327671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.327696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:41.327709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.327717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.327718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:41.327725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.327736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:41.327754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.327895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.327903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.327916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.327980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1744 partition: 0 MaxSeqNo: 45 sessionId: src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0
2025-10-01T14:12:41.328269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d604b043-5f943c86-5d6d0d5f-d08c03da_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:41.330481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0] Write session: try to update token
2025-10-01T14:12:41.330495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:41.340947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:41.340962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:41.340964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:41.340965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:41.340974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256057133599499:3856]
2025-10-01T14:12:41.340977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256057133599499:3856]
2025-10-01T14:12:41.340979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256057133599499:3856]
2025-10-01T14:12:41.341013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:41.341017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:41.341017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:41.341020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:41.341021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.341026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:41.341160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:41.343102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1744 sessionId: src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:41.345231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:41.408511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256059510496814:7092]
2025-10-01T14:12:41.408818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1743, pipe: [1:7556256059510496814:7092]
2025-10-01T14:12:41.477298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:41.477575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.477588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.477622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496814:7092], now have 1 active actors on pipe
2025-10-01T14:12:41.477798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:41.477828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:41.477835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256059510496814:7092]
2025-10-01T14:12:41.477855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:41.477916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1744 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0
2025-10-01T14:12:41.478082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1744 sessionId: src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0 is DEAD
2025-10-01T14:12:41.478184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:41.478201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0] Write session will restart in 0.007269s
2025-10-01T14:12:41.478219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0] Write session: Do CDS request
2025-10-01T14:12:41.478224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:41.483456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:41.484624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:41.484759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:41.484767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:41.484775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:41.484810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:41.484835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256057133599588:3853]
2025-10-01T14:12:41.485207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:41.485409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:41.485439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:41.485635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:41.485669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.485673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.485674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.485675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.485675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.485676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.485677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.485677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.485678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.485680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.485681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.485682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.485682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.485683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.485686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.485691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.485694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.485696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.485698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.485700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.485702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.485704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.485706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.485709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.485711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.485713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.485715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.485717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.485723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.485727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.485731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.485734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.485737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.485740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.485742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.485747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.485749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.485752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.485756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.485759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.485769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.485775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.485778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.485781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.485783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.485786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.485789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.485793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.485796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.485799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.485801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.485804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.485806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.485809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.485811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.485814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.485834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:41.486676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.486750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:41.486758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1745
2025-10-01T14:12:41.486862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.486883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:41.486890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:41.486892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:41.487171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1745 sessionId:  describe result for acl check
2025-10-01T14:12:41.487196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:41.487200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:41.487201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:41.487205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256059510496867:6720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:41.487582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256059510496867:6720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:41.488782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256059510496867:6720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:41.489182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:41.489751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:41.489763Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:41.489764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:41.489766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:41.489770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1744 [2:7556256057133599588:3853]
2025-10-01T14:12:41.489782Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:41.489793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:41.489795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.489797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.489799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.489810Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:41.489814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:41.489824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:41.489858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.489863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.489864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.489866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:41.489868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:41.489910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:41.489915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.489922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.489932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.489946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:41.489964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1744
2025-10-01T14:12:41.489965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496824:2446], now have 1 active actors on pipe
2025-10-01T14:12:41.489976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256057133599583:3853]
2025-10-01T14:12:41.489978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256057133599583:3853]
2025-10-01T14:12:41.489981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256057133599583:3853]
2025-10-01T14:12:41.489989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:41.489994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:41.489996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:41.489997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:41.490001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:41.490010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:41.490012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:41.490032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256057133599583:3853]
2025-10-01T14:12:41.490038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:41.490042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:41.494459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256059510496867:6720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:41.494471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256059510496867:6720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:41.494474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256059510496867:6720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:41.494480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:41.494843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496905:6720], now have 1 active actors on pipe
2025-10-01T14:12:41.494879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1744
2025-10-01T14:12:41.494918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.494925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.494943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:41.494953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.494959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.494962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:41.494968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.494979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:41.494993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.495110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.495119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.495139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.495194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1745 partition: 0 MaxSeqNo: 45 sessionId: src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0
2025-10-01T14:12:41.495449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ebab49b-b6e27e2f-93757eeb-dfe8490a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:41.497649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0] Write session: try to update token
2025-10-01T14:12:41.497662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:41.499940Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:41.499953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:41.499958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256057133599583:3853]
2025-10-01T14:12:41.499988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:41.499988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:41.500148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:41.500277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:41.500395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:41.500524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:41.500710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:41.500745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:41.510004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1745 sessionId: src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:41.512504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:41.512679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.512701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.512749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:41.512824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:41.518528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:41.518545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:41.518548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:41.518550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:41.518563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256057133599583:3853]
2025-10-01T14:12:41.518567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256057133599583:3853]
2025-10-01T14:12:41.518571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256057133599583:3853]
2025-10-01T14:12:41.518601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:41.518605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:41.518607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:41.518619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:41.518626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.518628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:41.518755Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:41.578006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256059510496909:7092]
2025-10-01T14:12:41.578229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1744, pipe: [1:7556256059510496909:7092]
2025-10-01T14:12:41.652478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:41.659651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.659676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.659827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.659881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.659936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.659989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.660029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.660037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.660093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.660147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.660206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.660265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.660305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.660314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.660373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.660429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.660486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.660545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.660594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.660600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.660673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.660732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.660788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.660847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.660892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.660898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.660956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.661012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.661071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.661132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.661171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.661177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.661238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.661298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.661356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.661415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.661455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.661461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.661524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.661582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.661645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.661714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.661754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.661760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.661818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.661875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.661933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.661992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.662033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.662039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.662101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.662158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.662213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.662271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.662319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.662325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.662395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.662450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.662503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.662563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.662603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.662610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.662654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496909:7092], now have 1 active actors on pipe
2025-10-01T14:12:41.662834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:41.662848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:41.662850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256059510496909:7092]
2025-10-01T14:12:41.662866Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:41.662876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1745 reason: error at write: Disconnected sessionId: src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0
2025-10-01T14:12:41.663070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1745 sessionId: src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0 is DEAD
2025-10-01T14:12:41.663200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:41.663206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0] Write session will restart in 0.006643s
2025-10-01T14:12:41.663225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0] Write session: Do CDS request
2025-10-01T14:12:41.663230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:41.663474Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:41.669008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:41.670450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:41.670586Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:41.670593Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:41.670600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:41.670629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:41.670655Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256057133599681:3822]
2025-10-01T14:12:41.670802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.670887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:41.670900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1746
2025-10-01T14:12:41.671019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.671046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:41.671052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:41.671055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:41.671145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:41.671408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:41.671441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:41.671462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1746 sessionId:  describe result for acl check
2025-10-01T14:12:41.671487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:41.671489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:41.671490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:41.671493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256059510496954:6714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:41.671714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:41.671759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.671763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.671764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.671765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.671765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.671766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.671766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.671767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.671768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.671768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.671769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.671769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.671770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.671770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.671773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.671778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.671780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.671784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.671787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.671789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.671791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.671793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.671794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.671798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.671800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.671802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.671803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.671806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.671809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.671813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.671820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.671823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.671825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.671828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.671830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.671833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.671835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.671837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.671839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.671842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.671844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.671847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.671849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.671851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.671853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.671856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.671859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.671862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.671865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.671868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.671870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.671872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.671874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.671876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.671878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.671881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.671902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:41.671950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256059510496954:6714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:41.673768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256059510496954:6714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:41.675129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:41.675631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:41.675640Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:41.675641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:41.675644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:41.675648Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1745 [2:7556256057133599681:3822]
2025-10-01T14:12:41.675657Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:41.675667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:41.675668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.675670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.675671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.675681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:41.675684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:41.675688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:41.675721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.675726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.675727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.675729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:41.675730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:41.675771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:41.675777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.675782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.675787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.675796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:41.675811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496912:2446], now have 1 active actors on pipe
2025-10-01T14:12:41.675819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256057133599676:3822]
2025-10-01T14:12:41.675820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256057133599676:3822]
2025-10-01T14:12:41.675821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256057133599676:3822]
2025-10-01T14:12:41.675829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:41.675838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:41.675839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:41.675841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:41.675843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:41.675818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1745
2025-10-01T14:12:41.675845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:41.675847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:41.675860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256057133599676:3822]
2025-10-01T14:12:41.675861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:41.675863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:41.676154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256059510496954:6714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:41.676164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256059510496954:6714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:41.676165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256059510496954:6714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:41.676170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:41.676273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496993:6714], now have 1 active actors on pipe
2025-10-01T14:12:41.676298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1745
2025-10-01T14:12:41.676324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.676330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.676345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:41.676353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.676356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.676357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:41.676363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.676369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:41.676380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.676479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.676483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.676492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.676541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1746 partition: 0 MaxSeqNo: 45 sessionId: src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0
2025-10-01T14:12:41.676801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc8f23d9-ce01c2f3-d2a03ff7-b10ad6f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:41.679250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0] Write session: try to update token
2025-10-01T14:12:41.679266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:41.687421Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:41.687440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:41.687449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256057133599676:3822]
2025-10-01T14:12:41.687494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:41.687500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:41.687683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:41.687833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:41.687980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:41.688121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:41.688319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:41.688354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:41.692901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1746 sessionId: src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:41.696905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:41.697124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.697155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.697187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:41.697316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:41.705196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:41.705213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:41.705215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:41.705217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:41.705228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256057133599676:3822]
2025-10-01T14:12:41.705232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256057133599676:3822]
2025-10-01T14:12:41.705235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256057133599676:3822]
2025-10-01T14:12:41.705279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:41.705284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.705285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:41.705297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:41.705305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:41.705308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:41.705426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:41.762853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256059510496998:7092]
2025-10-01T14:12:41.763137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1745, pipe: [1:7556256059510496998:7092]
2025-10-01T14:12:41.843656Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:41.850796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.850820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.850966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.851018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.851073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.851134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.851176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.851184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.851240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.851295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.851349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.851405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.851449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.851454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.851517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.851569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.851621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.851674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.851714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.851723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.851782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.851837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.851896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.851957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.851998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.852004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.852059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.852113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.852169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.852225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.852269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.852276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.852331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.852380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.852430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.852486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.852533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.852538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.852597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.852661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.852724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.852784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.852823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.852828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.852887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.852938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.852993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.853048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.853086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.853091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.853145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.853196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.853250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.853302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.853342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.853347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.853397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:41.853445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:41.853497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:41.853547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:41.853585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:41.853591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:41.853632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510496998:7092], now have 1 active actors on pipe
2025-10-01T14:12:41.853863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:41.853872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256059510496998:7092]
2025-10-01T14:12:41.853875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:41.853893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:41.853903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1746 reason: error at write: Disconnected sessionId: src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0
2025-10-01T14:12:41.854068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1746 sessionId: src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0 is DEAD
2025-10-01T14:12:41.854211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:41.854220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0] Write session will restart in 0.005225s
2025-10-01T14:12:41.854239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0] Write session: Do CDS request
2025-10-01T14:12:41.854244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:41.854353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:41.860825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.860919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:41.860932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1747
2025-10-01T14:12:41.861035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:41.861067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:41.861077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:41.861080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:41.861240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:41.861489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1747 sessionId:  describe result for acl check
2025-10-01T14:12:41.861525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:41.861531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:41.861532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:41.861535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256059510497044:6709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:41.861959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256059510497044:6709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:41.863179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:41.863308Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:41.863315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:41.863322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:41.863350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:41.863401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256057133599776:3808]
2025-10-01T14:12:41.863755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:41.863995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:41.864019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:41.864219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:41.864260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.864265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.864265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.864266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.864269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.864270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.864271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.864271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.864272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.864273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.864274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.864274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.864275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.864276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.864279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.864285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.864287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.864289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.864291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.864293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.864295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.864297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.864300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.864302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.864304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.864306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.864308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.864310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.864314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.864319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:41.864322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.864326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:41.864329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.864331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:41.864333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.864337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:41.864339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.864341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:41.864343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.864346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:41.864348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.864351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:41.864355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.864357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:41.864359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.864362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:41.864364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.864366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.864369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.864372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.864374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.864377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.864378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.864381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:41.864383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.864386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:41.864406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:41.864934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256059510497044:6709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:41.867467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256059510497044:6709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:41.867478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256059510497044:6709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:41.867480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256059510497044:6709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:41.867487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:41.867652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:41.868168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:41.868178Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:41.868181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:41.868184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:41.868188Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1746 [2:7556256057133599776:3808]
2025-10-01T14:12:41.868197Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:41.868211Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:41.868221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.868225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.868229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.868239Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:41.868242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:41.868246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:41.868278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.868283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.868286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.868289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:41.868290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:41.868336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:41.868342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.868348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:41.868358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:41.868376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:41.868395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510497083:6709], now have 1 active actors on pipe
2025-10-01T14:12:41.868402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510497003:2446], now have 1 active actors on pipe
2025-10-01T14:12:41.868407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256057133599771:3808]
2025-10-01T14:12:41.868408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256057133599771:3808]
2025-10-01T14:12:41.868409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256057133599771:3808]
2025-10-01T14:12:41.868420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:41.868432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:41.868443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:41.868442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:41.868446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:41.868447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:41.868448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:41.868462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256057133599771:3808]
2025-10-01T14:12:41.868467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:41.868470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1746
2025-10-01T14:12:41.868473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1746
2025-10-01T14:12:41.868489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:41.868500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.868504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.868528Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:41.868536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:41.868540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:41.868545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:41.868550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:41.868559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:41.868571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.868760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:41.868766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:41.868776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:41.868887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1747 partition: 0 MaxSeqNo: 45 sessionId: src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0
2025-10-01T14:12:41.869192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3f53b-9d08fd97-fa451dfb-a54c35e6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:41.871515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0] Write session: try to update token
2025-10-01T14:12:41.871531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:41.885934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1747 sessionId: src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:41.887770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:41.887795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:41.887798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:41.887800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:41.887809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256057133599771:3808]
2025-10-01T14:12:41.887814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256057133599771:3808]
2025-10-01T14:12:41.887817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256057133599771:3808]
2025-10-01T14:12:41.887870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:41.887880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:41.887881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:41.887885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:41.887888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:41.887893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:41.888018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:41.888787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:41.953852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256059510497091:7092]
2025-10-01T14:12:41.954016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1746, pipe: [1:7556256059510497091:7092]
2025-10-01T14:12:42.021476Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:42.021691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.021702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.021740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256059510497091:7092], now have 1 active actors on pipe
2025-10-01T14:12:42.021963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:42.022047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:42.022063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:42.022077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:42.022143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256059510497091:7092]
2025-10-01T14:12:42.022147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1747 reason: error at write: Disconnected sessionId: src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0
2025-10-01T14:12:42.022282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1747 sessionId: src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0 is DEAD
2025-10-01T14:12:42.022503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:42.022514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0] Write session will restart in 0.009159s
2025-10-01T14:12:42.022535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0] Write session: Do CDS request
2025-10-01T14:12:42.022539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:42.028895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:42.030455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:42.030633Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:42.030646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:42.030658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:42.030722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:42.030776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256061428567153:3809]
2025-10-01T14:12:42.031316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:42.031645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:42.031695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:42.031988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:42.032057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.032063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.032064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.032065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.032066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.032067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.032069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.032070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.032071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.032072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.032073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.032074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.032075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.032079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.032084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.032093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.032096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.032100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.032104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.032107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.032111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.032114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.032117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.032122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.032125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.032129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.032132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.032138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.032145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.032156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.032165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.032170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.032179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.032184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.032190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.032194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.032199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.032206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.032210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.032216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.032222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.032227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.032236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.032241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.032247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.032252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.032260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.032264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.032271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.032275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.032281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.032285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.032290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.032295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.032300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.032304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.032337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:42.032820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.032923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:42.032940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1748
2025-10-01T14:12:42.033090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.033126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:42.033136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:42.033141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:42.033677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1748 sessionId:  describe result for acl check
2025-10-01T14:12:42.033718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:42.033725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:42.033727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:42.033733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256063805464436:6705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:42.034319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256063805464436:6705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:42.036357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:42.036657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256063805464436:6705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:42.036888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:42.036900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:42.036901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:42.036904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:42.036909Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1747 [2:7556256061428567153:3809]
2025-10-01T14:12:42.036918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:42.036928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:42.036930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.036932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.036933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.036944Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:42.036948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:42.036952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:42.036987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.036992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.036995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.036998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:42.036999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:42.037049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:42.037054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.037061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.037066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.037074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:42.037085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256061428567147:3809]
2025-10-01T14:12:42.037090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256061428567147:3809]
2025-10-01T14:12:42.037091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256061428567147:3809]
2025-10-01T14:12:42.037098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:42.037107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:42.037107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:42.037110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:42.037112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:42.037118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:42.037120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:42.037127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464389:2446], now have 1 active actors on pipe
2025-10-01T14:12:42.037144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256061428567147:3809]
2025-10-01T14:12:42.037154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:42.037162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:42.037166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1747
2025-10-01T14:12:42.042084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256063805464436:6705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:42.042102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256063805464436:6705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:42.042107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256063805464436:6705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:42.042116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:42.042417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464475:6705], now have 1 active actors on pipe
2025-10-01T14:12:42.042454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1747
2025-10-01T14:12:42.042545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.042553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.042576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf1b702c-fb62639b-af440bac-33465cff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:42.042589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.042599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.042602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:42.042610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.042621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:42.042636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.042827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.042832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.042843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.042928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1748 partition: 0 MaxSeqNo: 45 sessionId: src_id|cf1b702c-fb62639b-af440bac-33465cff_0
2025-10-01T14:12:42.043305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d57127a6-40d787e7-6d268e8e-b4bef4c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cf1b702c-fb62639b-af440bac-33465cff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:42.045670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1b702c-fb62639b-af440bac-33465cff_0] Write session: try to update token
2025-10-01T14:12:42.045686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1b702c-fb62639b-af440bac-33465cff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:42.047476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:42.047488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:42.047494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256061428567147:3809]
2025-10-01T14:12:42.047530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:42.047543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:42.047681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:42.047798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:42.047912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:42.048022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:42.048184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:42.048210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:42.058981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1748 sessionId: src_id|cf1b702c-fb62639b-af440bac-33465cff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:42.061930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:42.062147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.062168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.062203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:42.062313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:42.066589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:42.066604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:42.066607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:42.066609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:42.066621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256061428567147:3809]
2025-10-01T14:12:42.066625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256061428567147:3809]
2025-10-01T14:12:42.066630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256061428567147:3809]
2025-10-01T14:12:42.066679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:42.066679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:42.066688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:42.066692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:42.066692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.066695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:42.066857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:42.122273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256063805464481:7092]
2025-10-01T14:12:42.122457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1747, pipe: [1:7556256063805464481:7092]
2025-10-01T14:12:42.201701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:42.208922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.208944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.209089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.209143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.209198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.209250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.209598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.209611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.209667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.209719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.209771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.209827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.209867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.209872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.209933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.209987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.210044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.210100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.210139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.210144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.210203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.210259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.210316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.210397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.210438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.210444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.210503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.210559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.210615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.210668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.210709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.210715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.210772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.210825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.210883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.210937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.210979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.210984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.211041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.211094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.211163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.211219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.211260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.211263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.211319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.211372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.211428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.211487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.211536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.211544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.211605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.211665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.211726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.211787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.211833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.211839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.211902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.211960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.212019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.212085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.212131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.212139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.212210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464481:7092], now have 1 active actors on pipe
2025-10-01T14:12:42.212456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256063805464481:7092]
2025-10-01T14:12:42.212456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:42.212494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:42.212496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:42.212530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1748 reason: error at write: Disconnected sessionId: src_id|cf1b702c-fb62639b-af440bac-33465cff_0
2025-10-01T14:12:42.212696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1748 sessionId: src_id|cf1b702c-fb62639b-af440bac-33465cff_0 is DEAD
2025-10-01T14:12:42.212750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:42.212822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1b702c-fb62639b-af440bac-33465cff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:42.212832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1b702c-fb62639b-af440bac-33465cff_0] Write session will restart in 0.009196s
2025-10-01T14:12:42.212858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1b702c-fb62639b-af440bac-33465cff_0] Write session: Do CDS request
2025-10-01T14:12:42.212862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1b702c-fb62639b-af440bac-33465cff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:42.220470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:42.221753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:42.221887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:42.221896Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:42.221903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:42.221935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:42.221966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256061428567247:3804]
2025-10-01T14:12:42.222444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:42.222707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:42.222752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:42.222844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1b702c-fb62639b-af440bac-33465cff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.222916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:42.222933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1749
2025-10-01T14:12:42.222988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:42.223018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.223039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.223044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.223043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:42.223054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:42.223046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.223047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.223048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.223050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.223051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.223057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:42.223052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.223054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.223055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.223057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.223058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.223059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.223060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.223065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.223076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.223080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.223084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.223087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.223091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.223095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.223099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.223103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.223107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.223111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.223115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.223119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.223123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.223129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.223140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.223149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.223156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.223166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.223175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.223183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.223188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.223197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.223205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.223213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.223230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.223239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.223244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.223247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.223251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.223257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.223262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.223267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.223272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.223277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.223282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.223287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.223289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.223292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.223295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.223298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.223301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.223322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:42.223483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1749 sessionId:  describe result for acl check
2025-10-01T14:12:42.223515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:42.223523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:42.223525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:42.223529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256063805464529:6698] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:42.223991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256063805464529:6698] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:42.226278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256063805464529:6698] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:42.227607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:42.228625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:42.228652Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:42.228656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:42.228660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:42.228669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1748 [2:7556256061428567247:3804]
2025-10-01T14:12:42.228690Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:42.228711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:42.228722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.228728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.228735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.228753Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:42.228764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:42.228770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:42.228848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.228859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.228861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.228867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:42.228870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:42.228973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:42.228981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.228994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.228982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256063805464529:6698] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:42.229006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.228993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256063805464529:6698] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:42.228997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256063805464529:6698] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:42.229004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:42.229026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:42.229053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464484:2446], now have 1 active actors on pipe
2025-10-01T14:12:42.229065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256061428567242:3804]
2025-10-01T14:12:42.229068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256061428567242:3804]
2025-10-01T14:12:42.229070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256061428567242:3804]
2025-10-01T14:12:42.229061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1748
2025-10-01T14:12:42.229081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:42.229106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:42.229114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:42.229115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:42.229118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:42.229131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:42.229136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:42.229156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1748
2025-10-01T14:12:42.229186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464565:6698], now have 1 active actors on pipe
2025-10-01T14:12:42.229197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256061428567242:3804]
2025-10-01T14:12:42.229208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:42.229220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:42.229252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.229262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.229297Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:42.229309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.229314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.229316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:42.229326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.229343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:42.229374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.229541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.229555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.229588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.229674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1749 partition: 0 MaxSeqNo: 45 sessionId: src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0
2025-10-01T14:12:42.229995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf1b702c-fb62639b-af440bac-33465cff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:42.232325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0] Write session: try to update token
2025-10-01T14:12:42.232341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:42.244810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1749 sessionId: src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:42.246881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:42.247058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.247077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.247110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:42.247182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:42.251236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:42.251255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:42.251257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:42.251259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:42.251267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256061428567242:3804]
2025-10-01T14:12:42.251271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256061428567242:3804]
2025-10-01T14:12:42.251274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256061428567242:3804]
2025-10-01T14:12:42.251313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:42.251319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.251320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:42.251321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:42.251325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:42.251327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:42.251439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:42.312740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256063805464574:7092]
2025-10-01T14:12:42.312980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1748, pipe: [1:7556256063805464574:7092]
2025-10-01T14:12:42.385422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:42.391962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.391982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.392124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.392183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.392243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.392299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.392340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.392349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.392410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.392467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.392527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.392585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.392630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.392651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.392705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.392760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.392816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.392883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.392925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.392932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.392986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.393041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.393094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.393149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.393189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.393195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.393245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.393298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.393354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.393409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.393447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.393453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.393507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.393560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.393619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.393677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.393717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.393723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.393776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.393828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.393895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.393964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.394012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.394020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.394084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.394149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.394208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.394262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.394303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.394309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.394366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.394450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.394510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.394568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.394609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.394615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.394671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.394727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.394783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.394851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.394890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.394897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.394952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464574:7092], now have 1 active actors on pipe
2025-10-01T14:12:42.395133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256063805464574:7092]
2025-10-01T14:12:42.395221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:42.395255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:42.395260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:42.395279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1749 reason: error at write: Disconnected sessionId: src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0
2025-10-01T14:12:42.395426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1749 sessionId: src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0 is DEAD
2025-10-01T14:12:42.395586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:42.395598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0] Write session will restart in 0.008134s
2025-10-01T14:12:42.395623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0] Write session: Do CDS request
2025-10-01T14:12:42.395628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:42.395676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:42.401954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:42.403313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:42.403437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:42.403448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:42.403457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:42.403489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:42.403532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256061428567329:3802]
2025-10-01T14:12:42.403901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:42.404107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:42.404132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:42.404413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:42.404481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.404487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.404488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.404488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.404489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.404490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.404490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.404491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.404491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.404492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.404493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.404494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.404495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.404496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.404500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.404509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.404513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.404516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.404519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.404523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.404527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.404532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.404536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.404540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.404542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.404544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.404545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.404547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.404552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.404556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.404560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.404563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.404566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.404568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.404571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.404574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.404576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.404579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.404581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.404584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.404587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.404589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.404592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.404595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.404597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.404599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.404602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.404605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.404609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.404613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.404615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.404618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.404622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.404625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.404627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.404630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.404662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:42.404751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.404815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:42.404825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1750
2025-10-01T14:12:42.404905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.404924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:42.404930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:42.404933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:42.405146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1750 sessionId:  describe result for acl check
2025-10-01T14:12:42.405165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:42.405171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:42.405172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:42.405175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256063805464651:6677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:42.405523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256063805464651:6677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:42.406718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256063805464651:6677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:42.408150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:42.408705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:42.408714Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:42.408716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:42.408718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:42.408723Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1749 [2:7556256061428567329:3802]
2025-10-01T14:12:42.408732Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:42.408743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:42.408744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.408747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.408749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.408762Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:42.408766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:42.408772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:42.408815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.408823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.408824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.408826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:42.408829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:42.408872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:42.408879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.408885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.408891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.408885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256063805464651:6677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:42.408894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256063805464651:6677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:42.408896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256063805464651:6677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:42.408900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:42.408899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:42.408913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464603:2446], now have 1 active actors on pipe
2025-10-01T14:12:42.408923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256061428567324:3802]
2025-10-01T14:12:42.408924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256061428567324:3802]
2025-10-01T14:12:42.408925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256061428567324:3802]
2025-10-01T14:12:42.408934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:42.408942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:42.408950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:42.408952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:42.408954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:42.408955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:42.408957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:42.408967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256061428567324:3802]
2025-10-01T14:12:42.408969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:42.408972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:42.409031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1749
2025-10-01T14:12:42.409161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464685:6677], now have 1 active actors on pipe
2025-10-01T14:12:42.409185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1749
2025-10-01T14:12:42.409221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.409230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.409247Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:42.409257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.409260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.409261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:42.409268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.409279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:42.409295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.409401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.409408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.409417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.409468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1750 partition: 0 MaxSeqNo: 45 sessionId: src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0
2025-10-01T14:12:42.409671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64257c59-50d5cc87-9c533ae5-4e882ee6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:42.411951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0] Write session: try to update token
2025-10-01T14:12:42.411968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:42.424701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1750 sessionId: src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:42.426686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:42.426911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.426934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.426976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:42.427206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:42.430696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:42.430710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:42.430712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:42.430713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:42.430721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256061428567324:3802]
2025-10-01T14:12:42.430724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256061428567324:3802]
2025-10-01T14:12:42.430728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256061428567324:3802]
2025-10-01T14:12:42.430763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:42.430768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.430768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:42.430770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:42.430772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:42.430775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:42.430888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:42.495527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256063805464711:7092]
2025-10-01T14:12:42.495765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1749, pipe: [1:7556256063805464711:7092]
2025-10-01T14:12:42.565312Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:42.572225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.572254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.572427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.572490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.572554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.572617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.572672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.572683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.572751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.572814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.572875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.572957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.573002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.573010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.573073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.573131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.573190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.573245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.573297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.573307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.573365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.573419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.573470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.573521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.573564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.573566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.573616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.573667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.573719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.573772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.573812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.573818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.573875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.573927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.573983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.574043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.574083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.574093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.574146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.574198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.574251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.574310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.574350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.574356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.574422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.574475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.574530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.574586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.574640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.574647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.574706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.574761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.574816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.574872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.574917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.574923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.574978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:42.575032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:42.575087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:42.575142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:42.575184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:42.575190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:42.575229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464711:7092], now have 1 active actors on pipe
2025-10-01T14:12:42.575498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256063805464711:7092]
2025-10-01T14:12:42.575523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:42.575526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:42.575536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:42.575560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1750 reason: error at write: Disconnected sessionId: src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0
2025-10-01T14:12:42.575744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1750 sessionId: src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0 is DEAD
2025-10-01T14:12:42.575865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:42.575874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0] Write session will restart in 0.008623s
2025-10-01T14:12:42.575895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0] Write session: Do CDS request
2025-10-01T14:12:42.575899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:42.575902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:42.582554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:42.583965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:42.584116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:42.584126Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:42.584135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:42.584168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:42.584197Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256061428567420:3795]
2025-10-01T14:12:42.584602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:42.584793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:42.584826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:42.585014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:42.585049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.585058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.585061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.585062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.585063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.585064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.585065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.585066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.585067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.585068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.585069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.585070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.585071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.585072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.585077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.585087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.585091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.585093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.585095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.585097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.585099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.585101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.585103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.585105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.585107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.585109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.585111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.585113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.585117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.585122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.585125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.585129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.585132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.585138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.585141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.585144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.585146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.585150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.585153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.585156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.585159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.585162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.585164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.585167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.585169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.585173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.585175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.585178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.585181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.585184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.585186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.585189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.585191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.585194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.585196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.585200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.585221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:42.585746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.585828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:42.585839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1751
2025-10-01T14:12:42.585927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.585947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:42.585956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:42.585959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:42.586218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1751 sessionId:  describe result for acl check
2025-10-01T14:12:42.586244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:42.586249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:42.586250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:42.586253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256063805464762:6660] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:42.586640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256063805464762:6660] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:42.588418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256063805464762:6660] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:42.588770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:42.589305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:42.589320Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:42.589322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:42.589324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:42.589328Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1750 [2:7556256061428567420:3795]
2025-10-01T14:12:42.589337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:42.589347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:42.589350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.589352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.589353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.589365Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:42.589368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:42.589372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:42.589405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.589412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.589413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.589414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:42.589416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:42.589458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:42.589464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.589471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.589477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.589486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:42.589502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464713:2446], now have 1 active actors on pipe
2025-10-01T14:12:42.589512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256061428567414:3795]
2025-10-01T14:12:42.589513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256061428567414:3795]
2025-10-01T14:12:42.589515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256061428567414:3795]
2025-10-01T14:12:42.589523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:42.589535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:42.589532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1750
2025-10-01T14:12:42.589535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:42.589537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:42.589539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:42.589548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:42.589550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:42.589568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256061428567414:3795]
2025-10-01T14:12:42.589580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:42.589584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:42.594078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256063805464762:6660] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:42.594087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256063805464762:6660] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:42.594089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256063805464762:6660] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:42.594094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:42.594227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464801:6660], now have 1 active actors on pipe
2025-10-01T14:12:42.594251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1750
2025-10-01T14:12:42.594316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.594324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.594342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:42.594353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.594356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.594358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:42.594364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.594384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:42.594394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.594480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.594487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.594496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.594541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1751 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0
2025-10-01T14:12:42.594750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da7d92f2-cf00489e-7d479807-82b5dfba_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:42.596962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0] Write session: try to update token
2025-10-01T14:12:42.596973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:42.609226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1751 sessionId: src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:42.610126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:42.610141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:42.610144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:42.610146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:42.610154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256061428567414:3795]
2025-10-01T14:12:42.610158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256061428567414:3795]
2025-10-01T14:12:42.610164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256061428567414:3795]
2025-10-01T14:12:42.610201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:42.610201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:42.610206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:42.610206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.610208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:42.610209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:42.610316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:42.611442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:42.675740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256063805464805:7092]
2025-10-01T14:12:42.675961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1750, pipe: [1:7556256063805464805:7092]
2025-10-01T14:12:42.744707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:42.745037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.745054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.745086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464805:7092], now have 1 active actors on pipe
2025-10-01T14:12:42.745231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:42.745287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:42.745367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1751 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0
2025-10-01T14:12:42.745492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:42.745507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1751 sessionId: src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0 is DEAD
2025-10-01T14:12:42.745534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256063805464805:7092]
2025-10-01T14:12:42.745972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:42.745983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0] Write session will restart in 0.008976s
2025-10-01T14:12:42.746008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0] Write session: Do CDS request
2025-10-01T14:12:42.746013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:42.751834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:42.752196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:42.752326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:42.752334Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:42.752342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:42.752371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:42.752398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256061428567535:3756]
2025-10-01T14:12:42.752872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:42.753539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:42.753568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:42.753793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:42.753829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.753833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.753834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.753835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.753835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.753836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.753836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.753837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.753840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.753840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.753841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.753841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.753842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.753843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.753846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.753852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.753854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.753856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.753859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.753861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.753863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.753866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.753869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.753873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.753877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.753880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.753883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.753886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.753894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.753901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.753909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.753912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.753918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.753921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.753923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.753926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.753929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.753933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.753935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.753938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.753942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.753948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.753951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.753954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.753956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.753962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.753964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.753967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.753969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.753975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.753979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.753983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.753988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.753991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.753993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.753996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.754021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:42.755849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.755898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:42.755909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1752
2025-10-01T14:12:42.756020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.756042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:42.756049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:42.756052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:42.756336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1752 sessionId:  describe result for acl check
2025-10-01T14:12:42.756362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:42.756367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:42.756369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:42.756372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256063805464859:6667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:42.756792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256063805464859:6667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:42.757759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:42.758125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256063805464859:6667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:42.758327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:42.758342Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:42.758344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:42.758347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:42.758353Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1751 [2:7556256061428567535:3756]
2025-10-01T14:12:42.758366Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:42.758400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:42.758407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.758411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.758418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.758432Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:42.758442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:42.758451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:42.758498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.758504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.758506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.758509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:42.758513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:42.758572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:42.758583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.758593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.758602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.758616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:42.758633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464809:2446], now have 1 active actors on pipe
2025-10-01T14:12:42.758649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256061428567530:3756]
2025-10-01T14:12:42.758651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256061428567530:3756]
2025-10-01T14:12:42.758653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256061428567530:3756]
2025-10-01T14:12:42.758668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1751
2025-10-01T14:12:42.758665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:42.758678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:42.758682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:42.758684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:42.758686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:42.758690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:42.758692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:42.758717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256061428567530:3756]
2025-10-01T14:12:42.758728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:42.758732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:42.763509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256063805464859:6667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:42.763520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256063805464859:6667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:42.763522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256063805464859:6667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:42.763528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:42.763687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464899:6667], now have 1 active actors on pipe
2025-10-01T14:12:42.763783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1751
2025-10-01T14:12:42.763829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.763840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.763864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:42.763878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.763883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.763889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:42.763898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.763913Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:42.763931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.764055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.764062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.764073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.764125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1752 partition: 0 MaxSeqNo: 45 sessionId: src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0
2025-10-01T14:12:42.764376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc65b26c-b456d4af-6f07cf10-ce2c633c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:42.766634Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0] Write session: try to update token
2025-10-01T14:12:42.766648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:42.778717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:42.778735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:42.778737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:42.778739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:42.778749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256061428567530:3756]
2025-10-01T14:12:42.778754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256061428567530:3756]
2025-10-01T14:12:42.778759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256061428567530:3756]
2025-10-01T14:12:42.778791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:42.778801Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:42.778801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:42.778803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:42.778806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.778808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:42.778898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1752 sessionId: src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:42.778937Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:42.781065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:42.845725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256063805464902:7092]
2025-10-01T14:12:42.845933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1751, pipe: [1:7556256063805464902:7092]
2025-10-01T14:12:42.923384Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:42.923778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.923792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.923830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464902:7092], now have 1 active actors on pipe
2025-10-01T14:12:42.924055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:42.924041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:42.924052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:42.924086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256063805464902:7092]
2025-10-01T14:12:42.924108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:42.924113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1752 reason: error at write: Disconnected sessionId: src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0
2025-10-01T14:12:42.924261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1752 sessionId: src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0 is DEAD
2025-10-01T14:12:42.924388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:42.924396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0] Write session will restart in 0.009473s
2025-10-01T14:12:42.924415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0] Write session: Do CDS request
2025-10-01T14:12:42.924420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:42.930314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:42.931621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:42.931748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:42.931757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:42.931767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:42.931799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:42.931828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256061428567620:3755]
2025-10-01T14:12:42.932195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:42.932371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:42.932394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:42.932575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:42.932611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.932615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.932616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.932617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.932619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.932619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.932620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.932620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.932621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.932622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.932622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.932623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.932623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.932623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.932626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.932632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.932647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.932649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.932651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.932653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.932655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.932657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.932659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.932661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.932662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.932664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.932666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.932668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.932672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.932677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:42.932680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.932683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:42.932685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.932688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:42.932691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.932694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:42.932697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.932699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:42.932702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.932704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:42.932708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.932711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:42.932713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.932716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:42.932718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.932722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:42.932724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.932727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.932729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.932731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.932733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.932736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.932738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.932741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:42.932743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.932746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:42.932766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:42.934809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.934896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:42.934909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1753
2025-10-01T14:12:42.935030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:42.935053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:42.935060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:42.935062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:42.935357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1753 sessionId:  describe result for acl check
2025-10-01T14:12:42.935380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:42.935385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:42.935386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:42.935389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256063805464958:6653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:42.935761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256063805464958:6653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:42.936149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:42.936688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:42.936699Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:42.936701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:42.936703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:42.936710Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1752 [2:7556256061428567620:3755]
2025-10-01T14:12:42.936721Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:42.936731Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:42.936733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.936735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.936738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.936748Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:42.936753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:42.936757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:42.936790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.936796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.936797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.936799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:42.936801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:42.936842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:42.936847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.936854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:42.936861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:42.936869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:42.936884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464906:2446], now have 1 active actors on pipe
2025-10-01T14:12:42.936892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256061428567615:3755]
2025-10-01T14:12:42.936894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256061428567615:3755]
2025-10-01T14:12:42.936895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256061428567615:3755]
2025-10-01T14:12:42.936905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:42.936917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:42.936919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:42.936921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:42.936922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:42.936928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:42.936929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:42.936946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256061428567615:3755]
2025-10-01T14:12:42.936927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1752
2025-10-01T14:12:42.936953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:42.936954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:42.937395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256063805464958:6653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:42.943144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256063805464958:6653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:42.943160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256063805464958:6653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:42.943164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256063805464958:6653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:42.943172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:42.943349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256063805464997:6653], now have 1 active actors on pipe
2025-10-01T14:12:42.943387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1752
2025-10-01T14:12:42.943431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.943441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.943463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:42.943474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:42.943478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:42.943479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:42.943488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:42.943501Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:42.943515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.943636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.943642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.943653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:42.943705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1753 partition: 0 MaxSeqNo: 45 sessionId: src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0
2025-10-01T14:12:42.943992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a3f6aa5-325eefe3-b3ef98ce-348e41fb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:42.946329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0] Write session: try to update token
2025-10-01T14:12:42.946343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:42.947038Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:42.947051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:42.947058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256061428567615:3755]
2025-10-01T14:12:42.947093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:42.947096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:42.947232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:42.947349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:42.947464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:42.947590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:42.947762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:42.947790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:42.959830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1753 sessionId: src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:42.961976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:42.962156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:42.962174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:42.962206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:42.962269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:42.965973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:42.965988Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:42.965990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:42.965991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:42.966001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256061428567615:3755]
2025-10-01T14:12:42.966004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256061428567615:3755]
2025-10-01T14:12:42.966006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256061428567615:3755]
2025-10-01T14:12:42.966042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:42.966047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:42.966047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:42.966049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:42.966052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:42.966054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:42.966167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:43.024410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256068100432297:7092]
2025-10-01T14:12:43.024625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1752, pipe: [1:7556256068100432297:7092]
2025-10-01T14:12:43.103512Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:43.110976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.111000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.111165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.111223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.111279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.111335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.111379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.111388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.111448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.111502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.111556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.111614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.111654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.111662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.111721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.111782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.111846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.111904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.111946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.111952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.112009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.112061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.112126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.112189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.112226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.112231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.112283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.112333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.112384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.112437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.112475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.112479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.112533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.112582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.112632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.112691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.112729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.112733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.112786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.112836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.112894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.112946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.113036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.113044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.113099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.113148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.113202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.113262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.113306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.113311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.113363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.113409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.113459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.113506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.113542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.113546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.113597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.113645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.113697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.113761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.113805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.113809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.113859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432297:7092], now have 1 active actors on pipe
2025-10-01T14:12:43.114082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:43.114121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:43.114125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:43.114130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256068100432297:7092]
2025-10-01T14:12:43.114152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1753 reason: error at write: Disconnected sessionId: src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0
2025-10-01T14:12:43.114319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1753 sessionId: src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0 is DEAD
2025-10-01T14:12:43.114481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:43.114493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0] Write session will restart in 0.008023s
2025-10-01T14:12:43.114519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0] Write session: Do CDS request
2025-10-01T14:12:43.114525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:43.114543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:43.121518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:43.122943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:43.123102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:43.123111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:43.123118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:43.123149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:43.123179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256065723535017:3750]
2025-10-01T14:12:43.123535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:43.123769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:43.123795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:43.123908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.123952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:43.123963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1754
2025-10-01T14:12:43.123984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:43.124025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.124029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.124030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.124031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.124031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.124032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.124032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.124033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.124034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.124034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.124035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.124035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.124036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.124036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.124039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.124044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.124047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.124049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.124051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.124053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.124055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.124056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.124058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.124062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.124064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.124065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.124067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.124069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.124074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.124078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.124082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.124085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.124085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.124087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.124089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.124091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.124094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.124096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.124107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:43.124099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.124114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:43.124101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.124116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:43.124103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.124105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.124108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.124110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.124112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.124115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.124117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.124119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.124122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.124124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.124127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.124129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.124132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.124134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.124136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.124139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.124141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.124160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:43.124402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1754 sessionId:  describe result for acl check
2025-10-01T14:12:43.124424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:43.124425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:43.124426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:43.124429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256068100432352:6648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:43.124780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256068100432352:6648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:43.126527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256068100432352:6648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:43.127375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:43.127892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:43.127902Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:43.127903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:43.127905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:43.127910Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1753 [2:7556256065723535017:3750]
2025-10-01T14:12:43.127918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:43.127930Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:43.127931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.127933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.127934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.127944Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:43.127947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:43.127952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:43.127986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.127991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.127992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.127994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:43.128006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:43.128061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:43.128067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.128073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.128079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.128087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:43.128101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432300:2446], now have 1 active actors on pipe
2025-10-01T14:12:43.128109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256065723535011:3750]
2025-10-01T14:12:43.128112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256065723535011:3750]
2025-10-01T14:12:43.128113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256065723535011:3750]
2025-10-01T14:12:43.128120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:43.128133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:43.128133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:43.128136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:43.128138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:43.128144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:43.128145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:43.128123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1753
2025-10-01T14:12:43.128160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256065723535011:3750]
2025-10-01T14:12:43.128165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:43.128168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:43.128434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256068100432352:6648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:43.128448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256068100432352:6648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:43.128451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256068100432352:6648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:43.128457Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:43.128616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432389:6648], now have 1 active actors on pipe
2025-10-01T14:12:43.128658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1753
2025-10-01T14:12:43.128730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.128738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.128758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:43.128768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.128772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.128778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:43.128786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.128797Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:43.128814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.128981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.128992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.129014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.129092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1754 partition: 0 MaxSeqNo: 45 sessionId: src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0
2025-10-01T14:12:43.129366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec2d4354-ec05d5ba-7134dac5-ae260ea4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:43.131936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0] Write session: try to update token
2025-10-01T14:12:43.131955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:43.138161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:43.138174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.138185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256065723535011:3750]
2025-10-01T14:12:43.138217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:43.138227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:43.138405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:43.138578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.138710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.138864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.139056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:43.139090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:43.144717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1754 sessionId: src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:43.147215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:43.147413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.147429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.147466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:43.147530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:43.156025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:43.156038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.156040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:43.156041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:43.156050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256065723535011:3750]
2025-10-01T14:12:43.156054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256065723535011:3750]
2025-10-01T14:12:43.156056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256065723535011:3750]
2025-10-01T14:12:43.156090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:43.156094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.156096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:43.156098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:43.156103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:43.156107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:43.156204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:43.214357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256068100432394:7092]
2025-10-01T14:12:43.214558Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1753, pipe: [1:7556256068100432394:7092]
2025-10-01T14:12:43.290035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:43.296252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.296273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.296400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.296449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.296502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.296546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.296590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.296597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.296666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.296716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.296763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.296811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.296849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.296855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.296910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.296961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.297010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.297067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.297104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.297109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.297164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.297214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.297264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.297314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.297351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.297356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.297408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.297455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.297505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.297553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.297589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.297594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.297647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.297694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.297742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.297792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.297830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.297835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.297888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.297935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.297988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.298038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.298074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.298078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.298129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.298178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.298230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.298284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.298320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.298327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.298396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.298444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.298493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.298540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.298575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.298579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.298628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.298673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.298722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.298767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.298801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.298806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.298843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432394:7092], now have 1 active actors on pipe
2025-10-01T14:12:43.299023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256068100432394:7092]
2025-10-01T14:12:43.299034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:43.299038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:43.299048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:43.299061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1754 reason: error at write: Disconnected sessionId: src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0
2025-10-01T14:12:43.299230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1754 sessionId: src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0 is DEAD
2025-10-01T14:12:43.299395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:43.299405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0] Write session will restart in 0.008795s
2025-10-01T14:12:43.299430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0] Write session: Do CDS request
2025-10-01T14:12:43.299436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:43.299514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:43.305861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:43.307224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:43.307351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:43.307359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:43.307366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:43.307395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:43.307420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256065723535104:3746]
2025-10-01T14:12:43.307788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:43.307983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:43.308010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:43.308211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:43.308245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.308249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.308250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.308251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.308251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.308252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.308253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.308253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.308254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.308255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.308256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.308256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.308257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.308257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.308260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.308266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.308268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.308270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.308272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.308275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.308277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.308279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.308281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.308283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.308285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.308287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.308289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.308291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.308298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.308302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.308306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.308309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.308311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.308314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.308316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.308319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.308322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.308329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.308332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.308334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.308336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.308340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.308346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.308350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.308357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.308366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.308374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.308382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.308384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.308387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.308389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.308392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.308394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.308397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.308399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.308401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.308421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:43.309924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:43.309938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1755
2025-10-01T14:12:43.309979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.310181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.310212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:43.310217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:43.310221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:43.310631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1755 sessionId:  describe result for acl check
2025-10-01T14:12:43.310660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:43.310667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:43.310671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:43.310675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256068100432451:6632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:43.311123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256068100432451:6632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:43.311732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:43.312260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:43.312271Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:43.312275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:43.312279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:43.312283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1754 [2:7556256065723535104:3746]
2025-10-01T14:12:43.312295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:43.312309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:43.312313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.312316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.312317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.312329Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:43.312333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:43.312343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:43.312381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.312386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.312387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.312389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:43.312390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:43.312434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:43.312442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.312449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.312455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.312463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:43.312474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432397:2446], now have 1 active actors on pipe
2025-10-01T14:12:43.312482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256065723535099:3746]
2025-10-01T14:12:43.312487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256065723535099:3746]
2025-10-01T14:12:43.312488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256065723535099:3746]
2025-10-01T14:12:43.312498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:43.312510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:43.312512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:43.312515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:43.312517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:43.312509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1754
2025-10-01T14:12:43.312521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:43.312523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:43.312537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256065723535099:3746]
2025-10-01T14:12:43.312544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:43.312548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:43.312925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256068100432451:6632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:43.318436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256068100432451:6632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:43.318448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256068100432451:6632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:43.318452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256068100432451:6632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:43.318459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:43.318665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432488:6632], now have 1 active actors on pipe
2025-10-01T14:12:43.318719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.318727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.318682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1754
2025-10-01T14:12:43.318754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2780618e-1293c4e8-9528019e-eed91f9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:43.318769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.318774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.318776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:43.318787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.318805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:43.318827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.318993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.319002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.319017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.319087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1755 partition: 0 MaxSeqNo: 45 sessionId: src_id|2780618e-1293c4e8-9528019e-eed91f9c_0
2025-10-01T14:12:43.319418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ad868a6-ef8cb6c6-6ef623d9-7b7ff665_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2780618e-1293c4e8-9528019e-eed91f9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:43.321703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2780618e-1293c4e8-9528019e-eed91f9c_0] Write session: try to update token
2025-10-01T14:12:43.321719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2780618e-1293c4e8-9528019e-eed91f9c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:43.327705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:43.327726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.327736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256065723535099:3746]
2025-10-01T14:12:43.327778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:43.327786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:43.327956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:43.328116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.328270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.328414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.328619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:43.328673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:43.334351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1755 sessionId: src_id|2780618e-1293c4e8-9528019e-eed91f9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:43.336598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:43.336848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.336871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.336912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:43.336991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:43.340305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:43.340325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.340328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:43.340329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:43.340339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256065723535099:3746]
2025-10-01T14:12:43.340343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256065723535099:3746]
2025-10-01T14:12:43.340346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256065723535099:3746]
2025-10-01T14:12:43.340376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:43.340389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:43.340393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:43.340395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.340396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:43.340397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:43.340518Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:43.399190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256068100432504:7092]
2025-10-01T14:12:43.399427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1754, pipe: [1:7556256068100432504:7092]
2025-10-01T14:12:43.481270Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:43.487330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.487352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.487482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.487531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.487580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.487627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.487669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.487676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.487728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.487778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.487826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.487878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.487919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.487927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.487987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.488036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.488085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.488137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.488174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.488179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.488231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.488281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.488328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.488378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.488416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.488420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.488473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.488520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.488572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.488622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.488669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.488675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.488729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.488776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.488826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.488876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.488912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.488917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.488971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.489016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.489065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.489113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.489149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.489154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.489207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.489259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.489308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.489356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.489392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.489397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.489446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.489494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.489544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.489592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.489627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.489631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.489680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.489729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.489778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.489828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.489863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.489868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.489905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432504:7092], now have 1 active actors on pipe
2025-10-01T14:12:43.490100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:43.490119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256068100432504:7092]
2025-10-01T14:12:43.490155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:43.490162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:43.490183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1755 reason: error at write: Disconnected sessionId: src_id|2780618e-1293c4e8-9528019e-eed91f9c_0
2025-10-01T14:12:43.490345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1755 sessionId: src_id|2780618e-1293c4e8-9528019e-eed91f9c_0 is DEAD
2025-10-01T14:12:43.490514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:43.490537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2780618e-1293c4e8-9528019e-eed91f9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:43.490547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2780618e-1293c4e8-9528019e-eed91f9c_0] Write session will restart in 0.008591s
2025-10-01T14:12:43.490566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2780618e-1293c4e8-9528019e-eed91f9c_0] Write session: Do CDS request
2025-10-01T14:12:43.490571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2780618e-1293c4e8-9528019e-eed91f9c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:43.495514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:43.496786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:43.496900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:43.496908Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:43.496914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:43.496948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:43.496975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256065723535199:3736]
2025-10-01T14:12:43.497357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:43.497520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:43.497545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:43.497731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:43.497764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.497769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.497769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.497770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.497770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.497771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.497772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.497772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.497773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.497773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.497774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.497775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.497775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.497776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.497779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.497784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.497786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.497788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.497790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.497792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.497794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.497796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.497798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.497800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.497802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.497804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.497806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.497808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.497815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.497819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.497822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.497825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.497827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.497830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.497832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.497835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.497837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.497840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.497842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.497844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.497847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.497850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.497852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.497854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.497857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.497859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.497861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.497864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.497866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.497869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.497872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.497875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.497877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.497880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.497882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.497884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.497904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:43.499878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2780618e-1293c4e8-9528019e-eed91f9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.499927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:43.499938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1756
2025-10-01T14:12:43.500062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.500095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:43.500103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:43.500105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:43.500384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1756 sessionId:  describe result for acl check
2025-10-01T14:12:43.500418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:43.500422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:43.500423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:43.500426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256068100432593:6622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:43.500829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256068100432593:6622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:43.501139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:43.501668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:43.501683Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:43.501687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:43.501689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:43.501694Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1755 [2:7556256065723535199:3736]
2025-10-01T14:12:43.501703Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:43.501714Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:43.501716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.501718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.501719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.501729Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:43.501732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:43.501736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:43.501769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.501775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.501776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.501778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:43.501780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:43.501831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:43.501837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.501849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.501863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.501881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:43.501899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432539:2446], now have 1 active actors on pipe
2025-10-01T14:12:43.501905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256065723535194:3736]
2025-10-01T14:12:43.501889Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1755
2025-10-01T14:12:43.501906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256065723535194:3736]
2025-10-01T14:12:43.501908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256065723535194:3736]
2025-10-01T14:12:43.501915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:43.501923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:43.501924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:43.501929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:43.501931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:43.501931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:43.501933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:43.501955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256065723535194:3736]
2025-10-01T14:12:43.501962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:43.501966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:43.502800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256068100432593:6622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:43.507166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256068100432593:6622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:43.507176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256068100432593:6622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:43.507178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256068100432593:6622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:43.507184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:43.507378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432629:6622], now have 1 active actors on pipe
2025-10-01T14:12:43.507410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1755
2025-10-01T14:12:43.507456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.507464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.507483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:43.507492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.507499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.507500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:43.507508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.507520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:43.507535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.507679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.507684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.507693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.507749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1756 partition: 0 MaxSeqNo: 45 sessionId: src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0
2025-10-01T14:12:43.508021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2780618e-1293c4e8-9528019e-eed91f9c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:43.510186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0] Write session: try to update token
2025-10-01T14:12:43.510199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:43.511587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:43.511599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.511605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256065723535194:3736]
2025-10-01T14:12:43.511631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:43.511634Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:43.511767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:43.511894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.512012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.512127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.512295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:43.512324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:43.521911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1756 sessionId: src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:43.524395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:43.524560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.524580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.524612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:43.524695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:43.529153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:43.529168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.529170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:43.529172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:43.529181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256065723535194:3736]
2025-10-01T14:12:43.529185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256065723535194:3736]
2025-10-01T14:12:43.529189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256065723535194:3736]
2025-10-01T14:12:43.529221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:43.529229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:43.529232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:43.529235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:43.529242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.529249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:43.529361Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:43.590176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256068100432632:7092]
2025-10-01T14:12:43.590403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1755, pipe: [1:7556256068100432632:7092]
2025-10-01T14:12:43.660131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:43.666689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.666710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.666845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.666895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.666948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.666998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.667044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.667055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.667114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.667168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.667216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.667271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.667310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.667314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.667370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.667421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.667472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.667527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.667565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.667570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.667624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.667681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.667738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.667799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.667841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.667847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.667912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.667962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.668016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.668073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.668111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.668116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.668172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.668223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.668277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.668334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.668375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.668380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.668437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.668489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.668542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.668596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.668645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.668653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.668711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.668762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.668813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.668861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.668898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.668902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.668954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.669002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.669054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.669109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.669148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.669152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.669206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.669255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.669306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.669357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.669393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.669399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.669437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432632:7092], now have 1 active actors on pipe
2025-10-01T14:12:43.669665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:43.669684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:43.669689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:43.669711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256068100432632:7092]
2025-10-01T14:12:43.669713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1756 reason: error at write: Disconnected sessionId: src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0
2025-10-01T14:12:43.669919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1756 sessionId: src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0 is DEAD
2025-10-01T14:12:43.670048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:43.670056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0] Write session will restart in 0.009833s
2025-10-01T14:12:43.670075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0] Write session: Do CDS request
2025-10-01T14:12:43.670080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:43.670202Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:43.676921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:43.678262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:43.678453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:43.678466Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:43.678478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:43.678534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:43.678575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256065723535290:3734]
2025-10-01T14:12:43.679151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:43.679432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:43.679479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:43.679798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:43.679860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.679869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.679870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.679872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.679873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.679874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.679875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.679876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.679877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.679878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.679880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.679881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.679882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.679883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.679888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.679898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.679902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.679906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.679911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.679915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.679919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.679923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.679926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.679931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.679935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.679939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.679947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.679953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.679965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.679977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.679986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.679991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.679996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.680006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.680015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.680025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.680034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.680038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.680043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.680048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.680057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.680066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.680074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.680083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.680088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.680097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.680106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.680115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.680121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.680129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.680137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.680143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.680147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.680153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.680162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.680171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.680215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:43.680826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.680917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:43.680928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1757
2025-10-01T14:12:43.681034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.681056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:43.681063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:43.681066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:43.681330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1757 sessionId:  describe result for acl check
2025-10-01T14:12:43.681355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:43.681361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:43.681363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:43.681366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256068100432691:6611] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:43.681737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256068100432691:6611] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:43.683591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:43.683783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256068100432691:6611] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:43.684175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:43.684195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:43.684198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:43.684208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:43.684214Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1756 [2:7556256065723535290:3734]
2025-10-01T14:12:43.684227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:43.684246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:43.684253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.684256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.684259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.684276Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:43.684285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:43.684294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:43.684345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.684352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.684355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.684358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:43.684360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:43.684421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:43.684428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.684441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.684457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.684482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:43.684499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1756
2025-10-01T14:12:43.684504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432635:2446], now have 1 active actors on pipe
2025-10-01T14:12:43.684516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256065723535285:3734]
2025-10-01T14:12:43.684518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256065723535285:3734]
2025-10-01T14:12:43.684522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256065723535285:3734]
2025-10-01T14:12:43.684529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:43.684536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:43.684538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:43.684540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:43.684544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:43.684557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:43.684568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:43.684597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256065723535285:3734]
2025-10-01T14:12:43.684610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:43.684617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:43.688942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256068100432691:6611] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:43.688956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256068100432691:6611] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:43.688959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256068100432691:6611] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:43.688966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:43.689169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432729:6611], now have 1 active actors on pipe
2025-10-01T14:12:43.689202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1756
2025-10-01T14:12:43.689264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.689277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.689302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:43.689316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.689325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.689331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:43.689342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.689359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:43.689378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.689499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.689507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.689521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.689588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1757 partition: 0 MaxSeqNo: 45 sessionId: src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0
2025-10-01T14:12:43.689866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|549ec7d7-bf5e6d46-261a5140-4431d20b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:43.692046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0] Write session: try to update token
2025-10-01T14:12:43.692059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:43.699702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:43.699724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.699734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256065723535285:3734]
2025-10-01T14:12:43.699778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:43.699779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:43.699945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:43.700084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.700224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.700353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.700542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:43.700582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:43.704135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1757 sessionId: src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:43.706711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:43.706924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.706945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.706979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:43.707038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:43.711911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:43.711929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.711931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:43.711932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:43.711941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256065723535285:3734]
2025-10-01T14:12:43.711943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256065723535285:3734]
2025-10-01T14:12:43.711946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256065723535285:3734]
2025-10-01T14:12:43.711973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:43.711978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:43.711981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:43.711986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:43.711994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.711997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:43.712111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:43.769875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256068100432733:7092]
2025-10-01T14:12:43.770134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1756, pipe: [1:7556256068100432733:7092]
2025-10-01T14:12:43.845357Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:43.851440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.851462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.851590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.851638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.851689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.851740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.851778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.851788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.851840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.851888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.851939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.851991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.852029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.852034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.852090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.852143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.852195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.852247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.852284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.852288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.852343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.852394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.852443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.852495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.852532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.852537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.852590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.852652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.852705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.852754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.852789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.852794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.852847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.852899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.852951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.853000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.853038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.853044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.853094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.853143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.853197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.853247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.853286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.853292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.853339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.853385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.853434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.853485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.853521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.853526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.853577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.853623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.853671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.853719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.853756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.853760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.853807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:43.853852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:43.853900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:43.853945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:43.853979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:43.853984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:43.854020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432733:7092], now have 1 active actors on pipe
2025-10-01T14:12:43.854203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256068100432733:7092]
2025-10-01T14:12:43.854230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:43.854232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:43.854247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:43.854253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1757 reason: error at write: Disconnected sessionId: src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0
2025-10-01T14:12:43.854438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1757 sessionId: src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0 is DEAD
2025-10-01T14:12:43.854552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:43.854561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0] Write session will restart in 0.006936s
2025-10-01T14:12:43.854580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0] Write session: Do CDS request
2025-10-01T14:12:43.854584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:43.854680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:43.860433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:43.861869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:43.861994Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:43.862004Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:43.862012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:43.862044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:43.862065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256065723535409:3715]
2025-10-01T14:12:43.862481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:43.862762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.862757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:43.862797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:43.862855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:43.862868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1758
2025-10-01T14:12:43.862956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:43.862981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:43.862990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:43.862996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:43.863057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:43.863112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.863116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.863117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.863119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.863120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.863121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.863122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.863123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.863123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.863124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.863125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.863126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.863127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.863128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.863132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.863140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.863143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.863146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.863149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.863151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.863154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.863157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.863160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.863164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.863167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.863170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.863174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.863177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.863184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.863191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:43.863196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.863201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:43.863204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.863209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:43.863213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.863217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:43.863220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.863224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:43.863227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.863232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:43.863237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.863241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:43.863245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.863249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:43.863254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.863258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:43.863261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.863270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.863273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.863278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.863286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.863290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.863294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.863298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:43.863304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.863307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:43.863329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:43.863348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1758 sessionId:  describe result for acl check
2025-10-01T14:12:43.863373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:43.863374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:43.863376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:43.863380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256068100432791:6606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:43.863773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256068100432791:6606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:43.865345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256068100432791:6606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:43.866596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:43.867141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:43.867152Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:43.867153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:43.867155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:43.867160Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1757 [2:7556256065723535409:3715]
2025-10-01T14:12:43.867168Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:43.867179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:43.867183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.867185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.867186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.867196Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:43.867199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:43.867205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:43.867240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.867244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.867246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.867247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:43.867249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:43.867295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:43.867302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.867311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:43.867325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:43.867342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:43.867356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432737:2446], now have 1 active actors on pipe
2025-10-01T14:12:43.867365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256065723535404:3715]
2025-10-01T14:12:43.867370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256065723535404:3715]
2025-10-01T14:12:43.867371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256065723535404:3715]
2025-10-01T14:12:43.867380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:43.867392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:43.867394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:43.867396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:43.867398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:43.867379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1757
2025-10-01T14:12:43.867403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:43.867404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:43.867419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256065723535404:3715]
2025-10-01T14:12:43.867421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:43.867423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:43.867616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256068100432791:6606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:43.867626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256068100432791:6606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:43.867628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256068100432791:6606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:43.867633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:43.867772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432830:6606], now have 1 active actors on pipe
2025-10-01T14:12:43.867792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1757
2025-10-01T14:12:43.867834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.867842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.867861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:43.867871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:43.867874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:43.867876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:43.867883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:43.867894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:43.867909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.868022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.868028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.868040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:43.868101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1758 partition: 0 MaxSeqNo: 45 sessionId: src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0
2025-10-01T14:12:43.868389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5abe36-6985a55-df417625-ea1a0bb3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:43.870617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0] Write session: try to update token
2025-10-01T14:12:43.870630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:43.882349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:43.882365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.882388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256065723535404:3715]
2025-10-01T14:12:43.882432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:43.882436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:43.882607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:43.882748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.882890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.883027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:43.883207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:43.883241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:43.883258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1758 sessionId: src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:43.885703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:43.885884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:43.885897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:43.885927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:43.885993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:43.895007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:43.895022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:43.895023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:43.895024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:43.895032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256065723535404:3715]
2025-10-01T14:12:43.895034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256065723535404:3715]
2025-10-01T14:12:43.895037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256065723535404:3715]
2025-10-01T14:12:43.895071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:43.895076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:43.895077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:43.895107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:43.895132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:43.895137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:43.895190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:43.954204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256068100432836:7092]
2025-10-01T14:12:43.954401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1757, pipe: [1:7556256068100432836:7092]
2025-10-01T14:12:44.030493Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:44.036870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.036893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.037026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.037077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.037135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.037187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.037229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.037238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.037292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.037343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.037398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.037451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.037491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.037497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.037552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.037604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.037657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.037720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.037765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.037767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.037821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.037874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.037929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.037980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.038021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.038027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.038081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.038134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.038189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.038243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.038281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.038287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.038341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.038418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.038487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.038552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.038598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.038607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.038679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.038742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.038805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.038873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.038924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.038932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.039003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.039066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.039129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.039194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.039243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.039253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.039318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.039379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.039441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.039501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.039546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.039555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.039611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.039657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.039708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.039758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.039799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.039811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.039849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256068100432836:7092], now have 1 active actors on pipe
2025-10-01T14:12:44.040094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:44.040120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256068100432836:7092]
2025-10-01T14:12:44.040137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:44.040139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:44.040159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1758 reason: error at write: Disconnected sessionId: src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0
2025-10-01T14:12:44.040329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1758 sessionId: src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0 is DEAD
2025-10-01T14:12:44.040465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:44.040476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0] Write session will restart in 0.008168s
2025-10-01T14:12:44.040501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0] Write session: Do CDS request
2025-10-01T14:12:44.040508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:44.040593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:44.048475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:44.049868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.049861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:44.049968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:44.049991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:44.049981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1759
2025-10-01T14:12:44.050001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:44.050008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:44.050037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:44.050056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.050065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256070018502798:3711]
2025-10-01T14:12:44.050076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:44.050083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:44.050085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:44.050388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1759 sessionId:  describe result for acl check
2025-10-01T14:12:44.050412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:44.050416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:44.050417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:44.050422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256072395400187:6593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:44.050466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:44.050690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:44.050718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:44.050786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256072395400187:6593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:44.050903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:44.050937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.050942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.050943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.050944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.050945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.050945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.050946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.050947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.050948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.050949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.050949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.050950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.050950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.050951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.050954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.050962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.050966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.050969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.050972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.050976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.050979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.050982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.050985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.050989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.050993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.050999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.051003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.051005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.051011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.051019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.051026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.051030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.051032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.051035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.051037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.051040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.051043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.051046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.051048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.051051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.051053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.051056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.051058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.051061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.051064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.051066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.051069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.051071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.051074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.051077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.051079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.051081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.051084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.051087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.051089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.051092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.051111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:44.052961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256072395400187:6593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:44.054356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:44.054926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:44.054940Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:44.054942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:44.054944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:44.054948Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1758 [2:7556256070018502798:3711]
2025-10-01T14:12:44.054957Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:44.054968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:44.054970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.054972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.054974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.054984Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:44.054993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:44.054998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:44.055032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.055039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.055032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256072395400187:6593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:44.055044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256072395400187:6593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:44.055041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.055043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:44.055045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:44.055092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:44.055094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.055046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256072395400187:6593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:44.055051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:44.055101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.055111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.055120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:44.055142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400134:2446], now have 1 active actors on pipe
2025-10-01T14:12:44.055153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256070018502793:3711]
2025-10-01T14:12:44.055156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256070018502793:3711]
2025-10-01T14:12:44.055158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256070018502793:3711]
2025-10-01T14:12:44.055171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:44.055187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:44.055174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1758
2025-10-01T14:12:44.055198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:44.055201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:44.055202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:44.055205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:44.055206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:44.055224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256070018502793:3711]
2025-10-01T14:12:44.055233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:44.055235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:44.055239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400226:6593], now have 1 active actors on pipe
2025-10-01T14:12:44.055267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1758
2025-10-01T14:12:44.055335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.055346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.055369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:44.055379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.055383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.055385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:44.055392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.055405Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:44.055417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.055557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.055564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.055573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.055706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1759 partition: 0 MaxSeqNo: 45 sessionId: src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0
2025-10-01T14:12:44.056042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60449c7a-367f8f20-5bc123ab-9e85cdaa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:44.058623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0] Write session: try to update token
2025-10-01T14:12:44.058640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:44.065112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:44.065128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:44.065136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256070018502793:3711]
2025-10-01T14:12:44.065171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:44.065175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:44.065314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:44.065440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:44.065575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:44.065693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:44.065861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:44.065894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:44.071113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1759 sessionId: src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:44.073306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:44.073510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.073529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.073563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:44.073639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:44.082810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:44.082828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:44.082831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:44.082832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:44.082844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256070018502793:3711]
2025-10-01T14:12:44.082848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256070018502793:3711]
2025-10-01T14:12:44.082852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256070018502793:3711]
2025-10-01T14:12:44.082899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:44.082913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.082915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:44.082924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:44.082941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:44.082945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:44.083062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:44.140061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256072395400234:7092]
2025-10-01T14:12:44.140323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1758, pipe: [1:7556256072395400234:7092]
2025-10-01T14:12:44.214143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:44.220292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.220313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.220438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.220490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.220543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.220591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.220642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.220655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.220709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.220760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.220816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.220868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.220906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.220912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.220964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.221012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.221061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.221113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.221155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.221161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.221210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.221258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.221309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.221356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.221392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.221398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.221448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.221495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.221546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.221595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.221633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.221639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.221687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.221735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.221780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.221829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.221865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.221871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.221923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.221972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.222024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.222072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.222114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.222120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.222168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.222216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.222267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.222314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.222352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.222358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.222424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.222484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.222537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.222595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.222638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.222646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.222703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.222751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.222800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.222853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.222896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.222902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.222938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400234:7092], now have 1 active actors on pipe
2025-10-01T14:12:44.223179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256072395400234:7092]
2025-10-01T14:12:44.223191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:44.223469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:44.223474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:44.223493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1759 reason: error at write: Disconnected sessionId: src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0
2025-10-01T14:12:44.223589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:44.223655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1759 sessionId: src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0 is DEAD
2025-10-01T14:12:44.223760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:44.223769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0] Write session will restart in 0.008420s
2025-10-01T14:12:44.223787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0] Write session: Do CDS request
2025-10-01T14:12:44.223791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:44.230186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:44.231415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:44.231539Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:44.231547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:44.231554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:44.231583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:44.231608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256070018502902:3709]
2025-10-01T14:12:44.231959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:44.232135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:44.232161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:44.232345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:44.232381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.232386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.232386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.232387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.232388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.232388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.232389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.232390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.232391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.232391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.232392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.232393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.232394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.232395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.232398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.232403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.232406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.232408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.232410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.232412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.232414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.232416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.232419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.232422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.232425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.232431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.232434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.232437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.232443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.232449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.232454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.232458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.232462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.232467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.232472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.232478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.232481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.232485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.232487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.232492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.232499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.232502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.232504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.232506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.232509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.232511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.232514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.232517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.232519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.232522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.232524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.232527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.232529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.232532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.232534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.232537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.232560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:44.232791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.232874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:44.232885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1760
2025-10-01T14:12:44.233000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.233021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:44.233027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:44.233030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:44.233270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1760 sessionId:  describe result for acl check
2025-10-01T14:12:44.233293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:44.233298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:44.233299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:44.233302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256072395400294:6587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:44.233658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256072395400294:6587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:44.235523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256072395400294:6587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:44.235639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:44.236213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:44.236224Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:44.236226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:44.236228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:44.236232Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1759 [2:7556256070018502902:3709]
2025-10-01T14:12:44.236241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:44.236251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:44.236258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.236260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.236262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.236271Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:44.236274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:44.236279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:44.236308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.236314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.236316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.236318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:44.236319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:44.236360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:44.236367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.236377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.236392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.236404Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1759
2025-10-01T14:12:44.236410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:44.236431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400236:2446], now have 1 active actors on pipe
2025-10-01T14:12:44.236437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256070018502897:3709]
2025-10-01T14:12:44.236445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256070018502897:3709]
2025-10-01T14:12:44.236446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256070018502897:3709]
2025-10-01T14:12:44.236460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:44.236479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:44.236480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:44.236489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:44.236491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:44.236492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:44.236494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:44.236512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256070018502897:3709]
2025-10-01T14:12:44.236514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:44.236515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:44.240617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256072395400294:6587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:44.240626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256072395400294:6587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:44.240628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256072395400294:6587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:44.240642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:44.240793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400332:6587], now have 1 active actors on pipe
2025-10-01T14:12:44.240796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1759
2025-10-01T14:12:44.240829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.240837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.240855Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9f796b7-81765a74-b1542546-c072b32b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:44.240867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.240870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.240872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:44.240879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.240887Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:44.240903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.241015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.241021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.241030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.241113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1760 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9f796b7-81765a74-b1542546-c072b32b_0
2025-10-01T14:12:44.241358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|282ae941-76bdef2d-5b39fe60-b1c50fa1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9f796b7-81765a74-b1542546-c072b32b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:44.243717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f796b7-81765a74-b1542546-c072b32b_0] Write session: try to update token
2025-10-01T14:12:44.243730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f796b7-81765a74-b1542546-c072b32b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:44.255344Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:44.255359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:44.255361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:44.255362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:44.255369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256070018502897:3709]
2025-10-01T14:12:44.255375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256070018502897:3709]
2025-10-01T14:12:44.255378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256070018502897:3709]
2025-10-01T14:12:44.255413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:44.255414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:44.255417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:44.255419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.255419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:44.255420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:44.255535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:44.255865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1760 sessionId: src_id|f9f796b7-81765a74-b1542546-c072b32b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:44.257987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:44.323371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256072395400337:7092]
2025-10-01T14:12:44.323623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1759, pipe: [1:7556256072395400337:7092]
2025-10-01T14:12:44.384059Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:44.384363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.384374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.384409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400337:7092], now have 1 active actors on pipe
2025-10-01T14:12:44.384581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:44.384618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256072395400337:7092]
2025-10-01T14:12:44.384629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:44.384641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:44.384682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:44.384718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1760 reason: error at write: Disconnected sessionId: src_id|f9f796b7-81765a74-b1542546-c072b32b_0
2025-10-01T14:12:44.384876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1760 sessionId: src_id|f9f796b7-81765a74-b1542546-c072b32b_0 is DEAD
2025-10-01T14:12:44.385049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f796b7-81765a74-b1542546-c072b32b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:44.385057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f796b7-81765a74-b1542546-c072b32b_0] Write session will restart in 0.005988s
2025-10-01T14:12:44.385076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f796b7-81765a74-b1542546-c072b32b_0] Write session: Do CDS request
2025-10-01T14:12:44.385083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f796b7-81765a74-b1542546-c072b32b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:44.390883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:44.391808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f796b7-81765a74-b1542546-c072b32b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.391941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:44.391950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1761
2025-10-01T14:12:44.392048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.392069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:44.392076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:44.392079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:44.392374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:44.392372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1761 sessionId:  describe result for acl check
2025-10-01T14:12:44.392397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:44.392398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:44.392400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:44.392403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256072395400405:6590] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:44.392544Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:44.392554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:44.392564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:44.392602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:44.392645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256070018502996:3708]
2025-10-01T14:12:44.392811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256072395400405:6590] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:44.393048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:44.393298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:44.393327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:44.393581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:44.393636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.393642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.393643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.393644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.393645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.393646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.393647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.393647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.393648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.393650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.393651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.393652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.393653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.393654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.393658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.393666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.393669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.393673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.393678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.393681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.393684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.393687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.393690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.393694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.393697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.393703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.393706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.393709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.393717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.393724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.393734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.393739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.393747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.393752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.393759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.393763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.393768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.393773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.393777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.393784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.393788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.393794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.393798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.393803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.393807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.393815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.393819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.393826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.393830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.393840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.393845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.393850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.393857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.393861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.393867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.393871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.393904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:44.394443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256072395400405:6590] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:44.396910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256072395400405:6590] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:44.396919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256072395400405:6590] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:44.396921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256072395400405:6590] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:44.396926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:44.397164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:44.397972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:44.397985Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:44.397986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:44.397989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:44.397993Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1760 [2:7556256070018502996:3708]
2025-10-01T14:12:44.398001Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:44.398012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:44.398013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.398015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.398017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.398031Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:44.398042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:44.398047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:44.398082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.398088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.398089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.398091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:44.398092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:44.398141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:44.398148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.398157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.398170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.398188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:44.398206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400443:6590], now have 1 active actors on pipe
2025-10-01T14:12:44.398212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400350:2446], now have 1 active actors on pipe
2025-10-01T14:12:44.398207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1760
2025-10-01T14:12:44.398220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256070018502991:3708]
2025-10-01T14:12:44.398218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1760
2025-10-01T14:12:44.398226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256070018502991:3708]
2025-10-01T14:12:44.398228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256070018502991:3708]
2025-10-01T14:12:44.398236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:44.398242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:44.398244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:44.398245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:44.398247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:44.398260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:44.398266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:44.398285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.398292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.398320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256070018502991:3708]
2025-10-01T14:12:44.398328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:44.398336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:44.398341Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:44.398349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.398352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.398357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:44.398363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.398386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:44.398420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.398560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.398566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.398579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.398654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1761 partition: 0 MaxSeqNo: 45 sessionId: src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0
2025-10-01T14:12:44.398914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9f796b7-81765a74-b1542546-c072b32b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:44.406309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0] Write session: try to update token
2025-10-01T14:12:44.406326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:44.417739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:44.417757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:44.417758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:44.417759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:44.417766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256070018502991:3708]
2025-10-01T14:12:44.417770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256070018502991:3708]
2025-10-01T14:12:44.417774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256070018502991:3708]
2025-10-01T14:12:44.417805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:44.417808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:44.417809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:44.417811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:44.417812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.417813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:44.417940Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:44.419367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1761 sessionId: src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:44.421426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:44.484607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256072395400481:7092]
2025-10-01T14:12:44.484785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1760, pipe: [1:7556256072395400481:7092]
2025-10-01T14:12:44.552523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:44.552887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.552900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.552933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400481:7092], now have 1 active actors on pipe
2025-10-01T14:12:44.553086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:44.553167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:44.553173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:44.553219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256072395400481:7092]
2025-10-01T14:12:44.553246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1761 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0
2025-10-01T14:12:44.553431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1761 sessionId: src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0 is DEAD
2025-10-01T14:12:44.553564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:44.553572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0] Write session will restart in 0.008791s
2025-10-01T14:12:44.553600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0] Write session: Do CDS request
2025-10-01T14:12:44.553605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:44.561078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:44.562466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:44.562598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:44.562605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:44.562615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:44.562654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:44.562683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256070018503096:3697]
2025-10-01T14:12:44.563073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:44.563346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:44.563374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:44.563581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:44.563617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.563622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.563623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.563624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.563625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.563626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.563627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.563628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.563628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.563629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.563630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.563631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.563632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.563633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.563637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.563646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.563649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.563652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.563655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.563658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.563661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.563664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.563667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.563670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.563673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.563676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.563679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.563686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.563692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.563702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.563710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.563716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.563724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.563729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.563736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.563744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.563753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.563760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.563764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.563772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.563780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.563789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.563788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.563795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.563800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.563804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.563806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.563808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.563811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.563813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.563819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.563823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.563826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.563831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.563834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.563836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.563839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.563863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:44.563873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:44.563888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1762
2025-10-01T14:12:44.563988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.564016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:44.564026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:44.564033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:44.564326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1762 sessionId:  describe result for acl check
2025-10-01T14:12:44.564353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:44.564359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:44.564360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:44.564363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256072395400543:6574] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:44.564737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256072395400543:6574] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:44.566509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256072395400543:6574] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:44.567153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:44.567787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:44.567797Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:44.567799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:44.567801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:44.567805Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1761 [2:7556256070018503096:3697]
2025-10-01T14:12:44.567814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:44.567828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:44.567835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.567837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.567838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.567848Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:44.567854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:44.567858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:44.567905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.567910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.567911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.567913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:44.567914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:44.567957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:44.567962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.567968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.567974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.567986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:44.567999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256070018503091:3697]
2025-10-01T14:12:44.568004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256070018503091:3697]
2025-10-01T14:12:44.568005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256070018503091:3697]
2025-10-01T14:12:44.568012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:44.568019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:44.568024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:44.568029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:44.568031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:44.568037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:44.568043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:44.568053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400482:2446], now have 1 active actors on pipe
2025-10-01T14:12:44.568071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256070018503091:3697]
2025-10-01T14:12:44.568080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:44.568078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1761
2025-10-01T14:12:44.568095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:44.568723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256072395400543:6574] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:44.568731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256072395400543:6574] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:44.568733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256072395400543:6574] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:44.568743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:44.568956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400580:6574], now have 1 active actors on pipe
2025-10-01T14:12:44.568990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1761
2025-10-01T14:12:44.569049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.569059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.569081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c06adc89-e512f4bc-4832074e-f086b808_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:44.569092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.569095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.569096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:44.569103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.569113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:44.569125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.569275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.569281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.569291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.569360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1762 partition: 0 MaxSeqNo: 45 sessionId: src_id|c06adc89-e512f4bc-4832074e-f086b808_0
2025-10-01T14:12:44.569605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2945dcd1-147f0483-9cf17422-9066c7e3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c06adc89-e512f4bc-4832074e-f086b808_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:44.571847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06adc89-e512f4bc-4832074e-f086b808_0] Write session: try to update token
2025-10-01T14:12:44.571860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06adc89-e512f4bc-4832074e-f086b808_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:44.577727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:44.577745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:44.577751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256070018503091:3697]
2025-10-01T14:12:44.577784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:44.577817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:44.577972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:44.578105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:44.578259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:44.578405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:44.578582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:44.578624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:44.583852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1762 sessionId: src_id|c06adc89-e512f4bc-4832074e-f086b808_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:44.586090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:44.586275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.586293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.586319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:44.586407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:44.596430Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:44.596447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:44.596449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:44.596452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:44.596460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256070018503091:3697]
2025-10-01T14:12:44.596462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256070018503091:3697]
2025-10-01T14:12:44.596464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256070018503091:3697]
2025-10-01T14:12:44.596499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:44.596502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:44.596507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.596507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:44.596509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:44.596511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:44.596664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:44.653587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256072395400586:7092]
2025-10-01T14:12:44.653803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1761, pipe: [1:7556256072395400586:7092]
2025-10-01T14:12:44.727170Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:44.733274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.733296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.733429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.733481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.733533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.733584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.733628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.733635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.733720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.733791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.733867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.733951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.733991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.733996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.734057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.734111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.734165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.734221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.734259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.734266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.734322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.734392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.734473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.734530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.734570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.734576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.734631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.734684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.734739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.734796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.734834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.734839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.734896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.734949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.735029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.735085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.735124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.735130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.735186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.735240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.735296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.735351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.735391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.735396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.735451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.735506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.735565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.735620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.735672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.735677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.735732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.735788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.735844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.735897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.735945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.735950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.736001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.736050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.736104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.736159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.736210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.736214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.736251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400586:7092], now have 1 active actors on pipe
2025-10-01T14:12:44.736493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256072395400586:7092]
2025-10-01T14:12:44.736512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:44.736515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:44.736520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:44.736537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1762 reason: error at write: Disconnected sessionId: src_id|c06adc89-e512f4bc-4832074e-f086b808_0
2025-10-01T14:12:44.736695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1762 sessionId: src_id|c06adc89-e512f4bc-4832074e-f086b808_0 is DEAD
2025-10-01T14:12:44.736865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06adc89-e512f4bc-4832074e-f086b808_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:44.736876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06adc89-e512f4bc-4832074e-f086b808_0] Write session will restart in 0.007129s
2025-10-01T14:12:44.736900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06adc89-e512f4bc-4832074e-f086b808_0] Write session: Do CDS request
2025-10-01T14:12:44.736906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06adc89-e512f4bc-4832074e-f086b808_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:44.736939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:44.743639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:44.744851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c06adc89-e512f4bc-4832074e-f086b808_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.744912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:44.744922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1763
2025-10-01T14:12:44.745043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.745064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:44.745071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:44.745073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:44.745096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:44.745261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:44.745274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:44.745284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:44.745326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:44.745362Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256070018503193:3691]
2025-10-01T14:12:44.745524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1763 sessionId:  describe result for acl check
2025-10-01T14:12:44.745551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:44.745555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:44.745556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:44.745559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256072395400645:6571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:44.745876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:44.745920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256072395400645:6571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:44.746146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:44.746189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:44.746466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:44.746521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.746526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.746527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.746528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.746529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.746530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.746530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.746531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.746532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.746533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.746535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.746535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.746536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.746537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.746541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.746550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.746553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.746557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.746560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.746563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.746565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.746568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.746573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.746576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.746579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.746582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.746585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.746588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.746593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.746600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.746606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.746610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.746614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.746619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.746622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.746626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.746629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.746634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.746638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.746642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.746645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.746650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.746653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.746657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.746661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.746665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.746668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.746672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.746676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.746680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.746683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.746687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.746690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.746695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.746698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.746702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.746733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:44.748001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256072395400645:6571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:44.750150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:44.750321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256072395400645:6571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:44.750335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256072395400645:6571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:44.750338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256072395400645:6571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:44.750345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:44.750713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:44.750724Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:44.750725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:44.750727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:44.750732Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1762 [2:7556256070018503193:3691]
2025-10-01T14:12:44.750742Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:44.750753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:44.750754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.750756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.750758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.750768Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:44.750771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:44.750775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:44.750807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.750812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.750813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.750815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:44.750817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:44.750875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:44.750882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.750892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.750901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.750915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:44.750933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400684:6571], now have 1 active actors on pipe
2025-10-01T14:12:44.750940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400588:2446], now have 1 active actors on pipe
2025-10-01T14:12:44.750946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256070018503188:3691]
2025-10-01T14:12:44.750948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256070018503188:3691]
2025-10-01T14:12:44.750950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256070018503188:3691]
2025-10-01T14:12:44.750961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:44.750966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:44.750968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:44.750970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:44.750977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:44.750977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1762
2025-10-01T14:12:44.750984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1762
2025-10-01T14:12:44.750991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:44.750999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:44.751020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256070018503188:3691]
2025-10-01T14:12:44.751022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:44.751024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:44.751034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.751038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.751081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68f9a26c-eda3d75-583006c6-4804fee5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:44.751092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.751095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.751097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:44.751105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.751117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:44.751137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.751235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.751244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.751257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.751317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1763 partition: 0 MaxSeqNo: 45 sessionId: src_id|68f9a26c-eda3d75-583006c6-4804fee5_0
2025-10-01T14:12:44.751604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c06adc89-e512f4bc-4832074e-f086b808_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|68f9a26c-eda3d75-583006c6-4804fee5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:44.753727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f9a26c-eda3d75-583006c6-4804fee5_0] Write session: try to update token
2025-10-01T14:12:44.753739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f9a26c-eda3d75-583006c6-4804fee5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:44.765504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1763 sessionId: src_id|68f9a26c-eda3d75-583006c6-4804fee5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:44.767957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:44.768103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.768122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.769868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:44.769896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:44.769904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:44.769907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:44.769908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:44.769914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256070018503188:3691]
2025-10-01T14:12:44.769917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256070018503188:3691]
2025-10-01T14:12:44.769919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256070018503188:3691]
2025-10-01T14:12:44.769939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:44.769948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:44.769950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:44.769951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:44.769955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.769956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:44.769951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:44.770069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:44.836880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256072395400692:7092]
2025-10-01T14:12:44.837097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1762, pipe: [1:7556256072395400692:7092]
2025-10-01T14:12:44.904504Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:44.910733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.910755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.910887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.910936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.910989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.911040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.911396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.911407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.911464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.911514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.911566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.911627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.911663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.911668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.911721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.911768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.911817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.911865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.911902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.911906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.911958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.912073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.912124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.912174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.912219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.912227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.912288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.912342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.912393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.912441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.912478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.912483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.912580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.912628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.912689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.912740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.912780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.912785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.912836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.912885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.912937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.912987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.913023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.913028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.913078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.913125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.913171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.913223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.913263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.913270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.913322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.913373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.913423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.913475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.913515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.913521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.913575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:44.913625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:44.913676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:44.913727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:44.913765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:44.913770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:44.913804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400692:7092], now have 1 active actors on pipe
2025-10-01T14:12:44.914016Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256072395400692:7092]
2025-10-01T14:12:44.914024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:44.914029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:44.914043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:44.914053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1763 reason: error at write: Disconnected sessionId: src_id|68f9a26c-eda3d75-583006c6-4804fee5_0
2025-10-01T14:12:44.914054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:44.914226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1763 sessionId: src_id|68f9a26c-eda3d75-583006c6-4804fee5_0 is DEAD
2025-10-01T14:12:44.914306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f9a26c-eda3d75-583006c6-4804fee5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:44.914314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f9a26c-eda3d75-583006c6-4804fee5_0] Write session will restart in 0.008945s
2025-10-01T14:12:44.914330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f9a26c-eda3d75-583006c6-4804fee5_0] Write session: Do CDS request
2025-10-01T14:12:44.914334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f9a26c-eda3d75-583006c6-4804fee5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:44.920228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:44.921475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:44.921589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:44.921596Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:44.921603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:44.921633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:44.921659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256070018503319:3674]
2025-10-01T14:12:44.922009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:44.922172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:44.922195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:44.922394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:44.922427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.922431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.922431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.922432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.922433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.922433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.922434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.922434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.922435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.922435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.922436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.922436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.922437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.922438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.922440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.922447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.922449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.922451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.922453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.922455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.922457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.922459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.922462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.922464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.922466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.922468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.922470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.922471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.922476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.922480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:44.922483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.922486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:44.922489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.922491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:44.922494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.922496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:44.922499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.922502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:44.922504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.922506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:44.922509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.922512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:44.922514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.922517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:44.922520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.922523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:44.922525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.922527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.922529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.922532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.922535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.922537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.922539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.922542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:44.922544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.922547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:44.922567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:44.924821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68f9a26c-eda3d75-583006c6-4804fee5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.924857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:44.924875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1764
2025-10-01T14:12:44.924988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:44.925008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:44.925016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:44.925018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:44.925286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1764 sessionId:  describe result for acl check
2025-10-01T14:12:44.925312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:44.925317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:44.925319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:44.925325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256072395400758:6564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:44.925713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256072395400758:6564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:44.925710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:44.926215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:44.926225Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:44.926226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:44.926229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:44.926233Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1763 [2:7556256070018503319:3674]
2025-10-01T14:12:44.926241Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:44.926251Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:44.926252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.926254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.926255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.926265Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:44.926268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:44.926276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:44.926307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.926312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.926313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.926316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:44.926317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:44.926359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:44.926366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.926386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:44.926391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:44.926400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:44.926411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400696:2446], now have 1 active actors on pipe
2025-10-01T14:12:44.926416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256070018503314:3674]
2025-10-01T14:12:44.926418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256070018503314:3674]
2025-10-01T14:12:44.926419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256070018503314:3674]
2025-10-01T14:12:44.926427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:44.926437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:44.926439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:44.926442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:44.926444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:44.926448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:44.926449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:44.926464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256070018503314:3674]
2025-10-01T14:12:44.926469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:44.926471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:44.926458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1763
2025-10-01T14:12:44.927992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256072395400758:6564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:44.932529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256072395400758:6564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:44.932539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256072395400758:6564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:44.932542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256072395400758:6564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:44.932547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:44.932815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256072395400798:6564], now have 1 active actors on pipe
2025-10-01T14:12:44.932854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1763
2025-10-01T14:12:44.932888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.932896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.932915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:44.932922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:44.932928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:44.932930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:44.932937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:44.932949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:44.932963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.933055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:44.933061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:44.933070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:44.933129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1764 partition: 0 MaxSeqNo: 45 sessionId: src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0
2025-10-01T14:12:44.933374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68f9a26c-eda3d75-583006c6-4804fee5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:44.935635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0] Write session: try to update token
2025-10-01T14:12:44.935647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:44.945957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:44.945974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:44.945976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:44.945978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:44.945985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256070018503314:3674]
2025-10-01T14:12:44.945988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256070018503314:3674]
2025-10-01T14:12:44.945991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256070018503314:3674]
2025-10-01T14:12:44.946024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:44.946027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:44.946029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:44.946030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:44.946031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:44.946034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:44.946150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:44.947370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1764 sessionId: src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:44.949515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:45.014044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256076690368097:7092]
2025-10-01T14:12:45.014277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1763, pipe: [1:7556256076690368097:7092]
2025-10-01T14:12:45.082557Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:45.083146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.083158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.083193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368097:7092], now have 1 active actors on pipe
2025-10-01T14:12:45.083386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:45.083457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256076690368097:7092]
2025-10-01T14:12:45.083488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:45.083603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:45.083672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1764 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0
2025-10-01T14:12:45.083855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1764 sessionId: src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0 is DEAD
2025-10-01T14:12:45.083991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:45.084000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0] Write session will restart in 0.005438s
2025-10-01T14:12:45.084025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0] Write session: Do CDS request
2025-10-01T14:12:45.084030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:45.089765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:45.090796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.090873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:45.090883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1765
2025-10-01T14:12:45.090980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.091005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:45.091014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:45.091017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:45.091065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:45.091189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:45.091196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:45.091203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:45.091231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:45.091256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256074313470715:3670]
2025-10-01T14:12:45.091303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1765 sessionId:  describe result for acl check
2025-10-01T14:12:45.091334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:45.091340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:45.091342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:45.091347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256076690368158:6551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:45.091602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:45.091717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256076690368158:6551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:45.091837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:45.091864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:45.092047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:45.092079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.092083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.092084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.092085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.092085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.092086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.092086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.092087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.092087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.092088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.092089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.092089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.092089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.092090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.092093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.092098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.092100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.092102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.092104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.092106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.092108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.092110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.092112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.092114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.092116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.092118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.092120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.092122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.092126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.092130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.092134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.092137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.092140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.092143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.092145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.092148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.092150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.092153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.092155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.092157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.092161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.092163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.092165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.092168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.092170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.092173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.092175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.092178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.092180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.092182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.092185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.092187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.092189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.092192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.092194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.092200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.092218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:45.093369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256076690368158:6551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:45.095365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256076690368158:6551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:45.095377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256076690368158:6551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:45.095382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256076690368158:6551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:45.095388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:45.095384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:45.095899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:45.095910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:45.095911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:45.095913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:45.095918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1764 [2:7556256074313470715:3670]
2025-10-01T14:12:45.095926Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:45.095940Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:45.095945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.095947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.095949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.095958Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:45.095964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:45.095968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:45.096011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.096015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.096016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.096018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:45.096019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:45.096070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:45.096076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.096087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.096099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.096118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:45.096136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368099:2446], now have 1 active actors on pipe
2025-10-01T14:12:45.096129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1764
2025-10-01T14:12:45.096143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368197:6551], now have 1 active actors on pipe
2025-10-01T14:12:45.096139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1764
2025-10-01T14:12:45.096149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256074313470710:3670]
2025-10-01T14:12:45.096155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256074313470710:3670]
2025-10-01T14:12:45.096157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256074313470710:3670]
2025-10-01T14:12:45.096164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:45.096167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:45.096169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:45.096170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:45.096178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:45.096189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:45.096195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:45.096210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.096216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.096237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256074313470710:3670]
2025-10-01T14:12:45.096246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:45.096254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:45.096261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:45.096266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.096273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.096275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:45.096281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.096292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:45.096323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.096409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.096417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.096429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.096469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1765 partition: 0 MaxSeqNo: 45 sessionId: src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0
2025-10-01T14:12:45.096694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f181bc0-ddbbcac2-6babaaab-e80e1726_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:45.098843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0] Write session: try to update token
2025-10-01T14:12:45.098854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:45.109778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:45.109795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:45.109803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256074313470710:3670]
2025-10-01T14:12:45.109846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:45.109846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:45.110303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:45.110403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1765 sessionId: src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:45.110445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.110571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.110695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.110869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:45.110914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:45.112504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:45.112628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.112653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.112676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:45.112741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:45.123134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:45.123152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:45.123155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:45.123156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:45.123165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256074313470710:3670]
2025-10-01T14:12:45.123169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256074313470710:3670]
2025-10-01T14:12:45.123171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256074313470710:3670]
2025-10-01T14:12:45.123205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:45.123206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:45.123210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:45.123213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:45.123214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.123215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:45.123335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:45.183518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256076690368208:7092]
2025-10-01T14:12:45.183750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1764, pipe: [1:7556256076690368208:7092]
2025-10-01T14:12:45.257924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:45.264858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.264881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.265026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.265082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.265139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.265197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.265482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.265490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.265549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.265607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.265663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.265721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.265763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.265769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.265850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.265902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.265957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.266014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.266060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.266065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.266120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.266175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.266227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.266281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.266323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.266329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.266405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.266461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.266511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.266859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.266905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.266914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.266987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.267050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.267121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.267192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.267237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.267244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.267305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.267362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.267430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.267493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.267533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.267538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.267594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.267644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.267697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.267750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.267789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.267795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.267846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.267895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.267947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.267997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.268039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.268051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.268119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.268181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.268239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.268302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.268350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.268357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.268418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368208:7092], now have 1 active actors on pipe
2025-10-01T14:12:45.268669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:45.268683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:45.268691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256076690368208:7092]
2025-10-01T14:12:45.268707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1765 reason: error at write: Disconnected sessionId: src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0
2025-10-01T14:12:45.268713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:45.268893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1765 sessionId: src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0 is DEAD
2025-10-01T14:12:45.268991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:45.269001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0] Write session will restart in 0.007678s
2025-10-01T14:12:45.269019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0] Write session: Do CDS request
2025-10-01T14:12:45.269024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:45.269012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:45.275402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:45.276675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:45.276805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:45.276812Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:45.276819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:45.276848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:45.276873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256074313470825:3667]
2025-10-01T14:12:45.277337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:45.277547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:45.277589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:45.277779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.277836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:45.277847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1766
2025-10-01T14:12:45.277867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:45.277934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.277940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.277941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.277942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.277943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.277944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.277945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.277946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.277947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.277948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.277949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.277950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.277951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.277952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.277952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.277956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.277965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.277968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.277972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.277975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.277976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:45.277982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.277984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:45.277987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:45.277985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.277989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.277992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.277996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.277999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.278002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.278010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.278017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.278023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.278033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.278042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.278051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.278059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.278064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.278071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.278075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.278082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.278091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.278099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.278107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.278115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.278123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.278127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.278135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.278144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.278152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.278159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.278168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.278176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.278181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.278185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.278190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.278198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.278202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.278209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.278217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.278252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:45.278258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1766 sessionId:  describe result for acl check
2025-10-01T14:12:45.278287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:45.278292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:45.278293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:45.278296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256076690368276:6552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:45.278779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256076690368276:6552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:45.280545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256076690368276:6552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:45.281401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:45.281966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:45.281978Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:45.281980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:45.281983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:45.281988Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1765 [2:7556256074313470825:3667]
2025-10-01T14:12:45.281998Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:45.282012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:45.282014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.282016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.282017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.282027Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:45.282034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:45.282038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:45.282074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.282078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.282082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.282084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:45.282085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:45.282135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:45.282140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.282146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.282151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.282159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:45.282171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368214:2446], now have 1 active actors on pipe
2025-10-01T14:12:45.282180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256074313470820:3667]
2025-10-01T14:12:45.282181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256074313470820:3667]
2025-10-01T14:12:45.282182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256074313470820:3667]
2025-10-01T14:12:45.282190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:45.282199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:45.282206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:45.282208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:45.282209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:45.282210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:45.282211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:45.282206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1765
2025-10-01T14:12:45.282225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256074313470820:3667]
2025-10-01T14:12:45.282230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:45.282231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:45.283857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256076690368276:6552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:45.283869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256076690368276:6552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:45.283874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256076690368276:6552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:45.283885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:45.284035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368316:6552], now have 1 active actors on pipe
2025-10-01T14:12:45.284079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1765
2025-10-01T14:12:45.284133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.284140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.284156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:45.284165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.284171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.284172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:45.284179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.284188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:45.284202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.284310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.284314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.284324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.284378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1766 partition: 0 MaxSeqNo: 45 sessionId: src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0
2025-10-01T14:12:45.284667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8cc3c089-7a7b7406-10fbca43-7bad8573_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:45.286895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0] Write session: try to update token
2025-10-01T14:12:45.286907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:45.292242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:45.292258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:45.292268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256074313470820:3667]
2025-10-01T14:12:45.292300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:45.292308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:45.292454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:45.292580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.292705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.292821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.292992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:45.293021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:45.301539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1766 sessionId: src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:45.303617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:45.303766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.303793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.303820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:45.303892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:45.310007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:45.310024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:45.310027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:45.310028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:45.310039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256074313470820:3667]
2025-10-01T14:12:45.310042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256074313470820:3667]
2025-10-01T14:12:45.310048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256074313470820:3667]
2025-10-01T14:12:45.310078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:45.310082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:45.310086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.310088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:45.310088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:45.310091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:45.310201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:45.368867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256076690368332:7092]
2025-10-01T14:12:45.369098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1765, pipe: [1:7556256076690368332:7092]
2025-10-01T14:12:45.443948Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:45.450382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.450407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.450550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.450603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.450656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.450709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.450750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.450763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.450823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.450873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.450930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.450984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.451024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.451029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.451082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.451132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.451183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.451233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.451269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.451276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.451328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.451388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.451437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.451486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.451527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.451532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.451584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.451653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.451703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.451753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.451795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.451800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.451858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.451912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.451962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.452011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.452048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.452053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.452113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.452173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.452226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.452277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.452314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.452319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.452374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.452428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.452477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.452524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.452561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.452566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.452619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.452677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.452726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.452777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.452813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.452818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.452872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.452924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.452986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.453045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.453088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.453095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.453140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368332:7092], now have 1 active actors on pipe
2025-10-01T14:12:45.453352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:45.453376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256076690368332:7092]
2025-10-01T14:12:45.453404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:45.453412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:45.453438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1766 reason: error at write: Disconnected sessionId: src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0
2025-10-01T14:12:45.453640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1766 sessionId: src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0 is DEAD
2025-10-01T14:12:45.453733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:45.453741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0] Write session will restart in 0.006121s
2025-10-01T14:12:45.453759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0] Write session: Do CDS request
2025-10-01T14:12:45.453764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:45.453767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:45.460674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:45.460796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.460862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:45.460873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1767
2025-10-01T14:12:45.460968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.460991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:45.460998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:45.461000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:45.461284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1767 sessionId:  describe result for acl check
2025-10-01T14:12:45.461305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:45.461310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:45.461311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:45.461316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256076690368403:6544] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:45.461679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256076690368403:6544] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:45.462070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:45.462203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:45.462211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:45.462219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:45.462254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:45.462280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256074313470925:3662]
2025-10-01T14:12:45.462699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:45.462883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:45.462910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:45.463046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256076690368403:6544] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:45.463100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:45.463143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.463148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.463148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.463149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.463150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.463150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.463151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.463151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.463152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.463152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.463153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.463154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.463154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.463155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.463158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.463164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.463166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.463168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.463170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.463173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.463175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.463177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.463179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.463182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.463184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.463186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.463188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.463190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.463195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.463199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.463203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.463206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.463209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.463212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.463214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.463217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.463219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.463222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.463225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.463232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.463234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.463237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.463243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.463245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.463248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.463250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.463255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.463258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.463261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.463263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.463266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.463268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.463271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.463273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.463278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.463281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.463301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:45.466583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256076690368403:6544] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:45.466596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256076690368403:6544] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:45.466600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256076690368403:6544] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:45.466607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:45.466827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:45.467427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:45.467441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:45.467443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:45.467447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:45.467453Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1766 [2:7556256074313470925:3662]
2025-10-01T14:12:45.467467Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:45.467481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:45.467484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.467487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.467489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.467505Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:45.467514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:45.467519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:45.467568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.467574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.467576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.467579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:45.467581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:45.467638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:45.467645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.467655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.467669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.467686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:45.467706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368442:6544], now have 1 active actors on pipe
2025-10-01T14:12:45.467709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368342:2446], now have 1 active actors on pipe
2025-10-01T14:12:45.467715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256074313470920:3662]
2025-10-01T14:12:45.467717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256074313470920:3662]
2025-10-01T14:12:45.467719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256074313470920:3662]
2025-10-01T14:12:45.467732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:45.467744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:45.467748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:45.467755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:45.467757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:45.467760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:45.467763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:45.467784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256074313470920:3662]
2025-10-01T14:12:45.467794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:45.467800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:45.467795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1766
2025-10-01T14:12:45.467798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1766
2025-10-01T14:12:45.467865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.467875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.467898Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:45.467908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.467918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.467920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:45.467929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.467940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:45.467952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.468083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.468094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.468115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.468231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1767 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0
2025-10-01T14:12:45.468561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|499cfb52-707f6b5d-4f2cc6ba-7d81baa8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:45.471047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0] Write session: try to update token
2025-10-01T14:12:45.471066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:45.484903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1767 sessionId: src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:45.487052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:45.487626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.487647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.487665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:45.487669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:45.487671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:45.487672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:45.487681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256074313470920:3662]
2025-10-01T14:12:45.487685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256074313470920:3662]
2025-10-01T14:12:45.487689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256074313470920:3662]
2025-10-01T14:12:45.487716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:45.487726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:45.487728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:45.487734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:45.487738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.487741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:45.487858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:45.553659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256076690368474:7092]
2025-10-01T14:12:45.553861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1766, pipe: [1:7556256076690368474:7092]
2025-10-01T14:12:45.621091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:45.621505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:45.621385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:45.621429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368474:7092], now have 1 active actors on pipe
2025-10-01T14:12:45.621591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256076690368474:7092]
2025-10-01T14:12:45.621615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:45.628264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:45.629351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:45.629363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:45.629379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1767 reason: error at write: Disconnected sessionId: src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0
2025-10-01T14:12:45.629508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1767 sessionId: src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0 is DEAD
2025-10-01T14:12:45.629661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:45.629671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0] Write session will restart in 0.009514s
2025-10-01T14:12:45.629692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0] Write session: Do CDS request
2025-10-01T14:12:45.629697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:45.632630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:45.632800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:45.632817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:45.632829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:45.632872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:45.632900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256074313471034:3653]
2025-10-01T14:12:45.633272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:45.633447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:45.633474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:45.633656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:45.633690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.633695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.633695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.633696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.633697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.633697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.633698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.633698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.633699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.633700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.633700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.633701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.633701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.633702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.633705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.633711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.633713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.633715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.633717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.633719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.633721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.633723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.633725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.633727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.633729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.633731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.633733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.633735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.633739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.633743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.633747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.633750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.633752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.633755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.633757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.633760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.633762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.633765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.633770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.633773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.633777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.633783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.633785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.633788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.633794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.633796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.633799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.633804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.633807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.633810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.633815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.633817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.633819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.633822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.633824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.633827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.633846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:45.637216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:45.637743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:45.637755Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:45.637757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:45.637759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:45.637764Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1767 [2:7556256074313471034:3653]
2025-10-01T14:12:45.637773Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:45.637787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:45.637792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.637794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.637795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.637805Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:45.637811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:45.637815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:45.637848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.637853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.637854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.637856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:45.637858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:45.637900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:45.637908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.637915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.637920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.637930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:45.637941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368476:2446], now have 1 active actors on pipe
2025-10-01T14:12:45.637951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256074313471029:3653]
2025-10-01T14:12:45.637954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256074313471029:3653]
2025-10-01T14:12:45.637955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256074313471029:3653]
2025-10-01T14:12:45.637964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:45.637977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:45.637976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:45.637978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:45.637980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:45.637985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:45.637987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:45.638002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256074313471029:3653]
2025-10-01T14:12:45.638007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:45.638009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:45.637983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1767
2025-10-01T14:12:45.639747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.639841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:45.639850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1768
2025-10-01T14:12:45.640530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.640558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:45.640565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:45.640567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:45.640905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1768 sessionId:  describe result for acl check
2025-10-01T14:12:45.640933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:45.640938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:45.640939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:45.640943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256076690368548:6525] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:45.641597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256076690368548:6525] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:45.643454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256076690368548:6525] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:45.646859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256076690368548:6525] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:45.646872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256076690368548:6525] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:45.646875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256076690368548:6525] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:45.646881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:45.647059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1767
2025-10-01T14:12:45.647641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368584:6525], now have 1 active actors on pipe
2025-10-01T14:12:45.647671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.647677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.647693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:45.647701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:45.647707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256074313471029:3653]
2025-10-01T14:12:45.647742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:45.647765Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:45.647779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.647788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.647790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:45.647800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.647818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:45.647836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:45.648011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:45.648150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.648283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.648420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.648598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:45.648629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.648656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:45.648790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.648799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.648808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.648861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1768 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0
2025-10-01T14:12:45.649182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a98658a-26fc7540-d5fbc30f-c9798c05_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:45.651533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0] Write session: try to update token
2025-10-01T14:12:45.651548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:45.663623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1768 sessionId: src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:45.665018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:45.665035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:45.665039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:45.665040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:45.665048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256074313471029:3653]
2025-10-01T14:12:45.665051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256074313471029:3653]
2025-10-01T14:12:45.665053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256074313471029:3653]
2025-10-01T14:12:45.665084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:45.665087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:45.665093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.665094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:45.665098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:45.665102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:45.665205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:45.665734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:45.721636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256076690368585:7092]
2025-10-01T14:12:45.721851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1767, pipe: [1:7556256076690368585:7092]
2025-10-01T14:12:45.799097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:45.799311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.799323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.799340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368585:7092], now have 1 active actors on pipe
2025-10-01T14:12:45.799456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:45.799559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:45.799598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256076690368585:7092]
2025-10-01T14:12:45.799600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:45.799659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1768 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0
2025-10-01T14:12:45.799796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1768 sessionId: src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0 is DEAD
2025-10-01T14:12:45.799930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:45.799936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0] Write session will restart in 0.009293s
2025-10-01T14:12:45.799955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0] Write session: Do CDS request
2025-10-01T14:12:45.799959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:45.805526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:45.806903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:45.807033Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:45.807041Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:45.807048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:45.807078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:45.807107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256074313471158:3641]
2025-10-01T14:12:45.807455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:45.807768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:45.807803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:45.808071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:45.808115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.808120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.808120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.808121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.808121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.808122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.808122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.808123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.808124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.808124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.808125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.808126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.808126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.808127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.808130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.808135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.808137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.808139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.808141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.808143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.808145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.808147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.808149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.808151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.808153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.808155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.808157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.808158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.808164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.808169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:45.808172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.808175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:45.808178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.808181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:45.808183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.808185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:45.808188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.808190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:45.808192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.808195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:45.808198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.808200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:45.808202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.808205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:45.808207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.808209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:45.808211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.808214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.808216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.808219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.808221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.808223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.808225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.808229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:45.808231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.808233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:45.808252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:45.809953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.809993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:45.810008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1769
2025-10-01T14:12:45.810119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:45.810158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:45.810168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:45.810171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:45.810541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1769 sessionId:  describe result for acl check
2025-10-01T14:12:45.810573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:45.810581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:45.810582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:45.810587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256076690368657:6521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:45.811140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256076690368657:6521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:45.811721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:45.812334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:45.812349Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:45.812351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:45.812353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:45.812359Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1768 [2:7556256074313471158:3641]
2025-10-01T14:12:45.812373Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:45.812391Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:45.812397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.812400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.812404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.812417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:45.812422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:45.812431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:45.812470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.812475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.812476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.812478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:45.812480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:45.812524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:45.812529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.812536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:45.812545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:45.812553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:45.812569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256074313471143:3641]
2025-10-01T14:12:45.812575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256074313471143:3641]
2025-10-01T14:12:45.812577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256074313471143:3641]
2025-10-01T14:12:45.812589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:45.812606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368587:2446], now have 1 active actors on pipe
2025-10-01T14:12:45.812616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:45.812631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:45.812643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:45.812646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:45.812647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:45.812648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:45.812630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1768
2025-10-01T14:12:45.812670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256074313471143:3641]
2025-10-01T14:12:45.812676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:45.812678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:45.812856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256076690368657:6521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:45.817149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256076690368657:6521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:45.817162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256076690368657:6521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:45.817164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256076690368657:6521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:45.817170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:45.817399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368692:6521], now have 1 active actors on pipe
2025-10-01T14:12:45.817447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1768
2025-10-01T14:12:45.817490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.817501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.817525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7037cc39-f10dc38c-65530785-59aca2e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:45.817539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:45.817544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:45.817547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:45.817560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:45.817576Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:45.817593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.817753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.817763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.817782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:45.817862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1769 partition: 0 MaxSeqNo: 45 sessionId: src_id|7037cc39-f10dc38c-65530785-59aca2e3_0
2025-10-01T14:12:45.818187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c2f99b5-9fa078c1-b46fb21e-58fec600_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7037cc39-f10dc38c-65530785-59aca2e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:45.820770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7037cc39-f10dc38c-65530785-59aca2e3_0] Write session: try to update token
2025-10-01T14:12:45.820786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7037cc39-f10dc38c-65530785-59aca2e3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:45.822658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:45.822676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:45.822685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256074313471143:3641]
2025-10-01T14:12:45.822730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:45.822732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:45.822899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:45.823036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.823174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.823309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:45.823496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:45.823534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:45.832755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1769 sessionId: src_id|7037cc39-f10dc38c-65530785-59aca2e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:45.835235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:45.835417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.835437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.835465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:45.835521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:45.840384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:45.840403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:45.840404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:45.840406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:45.840414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256074313471143:3641]
2025-10-01T14:12:45.840418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256074313471143:3641]
2025-10-01T14:12:45.840421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256074313471143:3641]
2025-10-01T14:12:45.840456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:45.840464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:45.840466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:45.840473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:45.840479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:45.840482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:45.840580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:45.899800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256076690368699:7092]
2025-10-01T14:12:45.900030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1768, pipe: [1:7556256076690368699:7092]
2025-10-01T14:12:45.984086Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:45.990396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:45.990420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:45.990548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.990597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.990649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.990703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.990742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.990748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.990802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.990856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.990903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.990953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.990992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.991000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.991057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.991108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.991160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.991212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.991247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.991253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.991305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.991358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.991407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.991461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.991499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.991504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.991560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.991609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.991659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.991712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.991751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.991755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.991810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.991861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.991913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.991964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.992001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.992006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.992059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.992106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.992169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.992222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.992259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.992264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.992318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.992368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.992419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.992470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.992506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.992511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.992565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.992617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.992694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.992746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.992783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.992788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.992842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:45.992892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:45.992941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:45.992992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:45.993096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:45.993102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:45.993138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368699:7092], now have 1 active actors on pipe
2025-10-01T14:12:45.993356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256076690368699:7092]
2025-10-01T14:12:45.993372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:45.993375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:45.993382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:45.993395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1769 reason: error at write: Disconnected sessionId: src_id|7037cc39-f10dc38c-65530785-59aca2e3_0
2025-10-01T14:12:45.993547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1769 sessionId: src_id|7037cc39-f10dc38c-65530785-59aca2e3_0 is DEAD
2025-10-01T14:12:45.993683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7037cc39-f10dc38c-65530785-59aca2e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:45.993692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7037cc39-f10dc38c-65530785-59aca2e3_0] Write session will restart in 0.009377s
2025-10-01T14:12:45.993710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7037cc39-f10dc38c-65530785-59aca2e3_0] Write session: Do CDS request
2025-10-01T14:12:45.993715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7037cc39-f10dc38c-65530785-59aca2e3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:45.993905Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:46.000300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:46.001586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:46.001771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:46.001782Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:46.001793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:46.001844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:46.001881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256078608438562:3637]
2025-10-01T14:12:46.002450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:46.002695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:46.002732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:46.003002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:46.003051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.003056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.003057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.003058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.003059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.003060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.003061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.003062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.003063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.003064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.003065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.003066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.003066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.003067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.003071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.003080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.003083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.003086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.003089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.003093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.003097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.003100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.003107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.003110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.003117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.003121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.003127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.003131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.003139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.003148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.003157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.003165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.003173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.003177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.003184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.003189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.003193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.003201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.003207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.003213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.003221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.003225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.003230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.003234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.003242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.003246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.003249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.003254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.003258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.003262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.003266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.003274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.003277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.003286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.003292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.003297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.003336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:46.003806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7037cc39-f10dc38c-65530785-59aca2e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.003901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:46.003911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1770
2025-10-01T14:12:46.003987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.004008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:46.004015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:46.004018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:46.004318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1770 sessionId:  describe result for acl check
2025-10-01T14:12:46.004343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:46.004344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:46.004346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:46.004349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256080985336068:6516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:46.004826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256080985336068:6516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:46.006524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256080985336068:6516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:46.006647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:46.007242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:46.007254Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:46.007255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:46.007257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:46.007262Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1769 [2:7556256078608438562:3637]
2025-10-01T14:12:46.007272Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:46.007282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:46.007287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.007290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.007291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.007304Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:46.007310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:46.007314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:46.007348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.007352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.007353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.007355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:46.007356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:46.007401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:46.007406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.007413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.007418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.007427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:46.007442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256076690368704:2446], now have 1 active actors on pipe
2025-10-01T14:12:46.007451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256078608438557:3637]
2025-10-01T14:12:46.007454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256078608438557:3637]
2025-10-01T14:12:46.007455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256078608438557:3637]
2025-10-01T14:12:46.007464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:46.007477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:46.007477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:46.007485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:46.007485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:46.007487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:46.007487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:46.007479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1769
2025-10-01T14:12:46.007503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256078608438557:3637]
2025-10-01T14:12:46.007510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:46.007513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:46.011880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256080985336068:6516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:46.011892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256080985336068:6516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:46.011896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256080985336068:6516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:46.011902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:46.012047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336104:6516], now have 1 active actors on pipe
2025-10-01T14:12:46.012204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1769
2025-10-01T14:12:46.012255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.012263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.012281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2616de66-4136038b-4293b4e3-64867187_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:46.012291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.012297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.012299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:46.012305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.012318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:46.012332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.012438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.012443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.012452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.012506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1770 partition: 0 MaxSeqNo: 45 sessionId: src_id|2616de66-4136038b-4293b4e3-64867187_0
2025-10-01T14:12:46.012793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7037cc39-f10dc38c-65530785-59aca2e3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2616de66-4136038b-4293b4e3-64867187_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:46.014933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2616de66-4136038b-4293b4e3-64867187_0] Write session: try to update token
2025-10-01T14:12:46.014945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2616de66-4136038b-4293b4e3-64867187_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:46.017552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:46.017562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:46.017568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256078608438557:3637]
2025-10-01T14:12:46.017597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:46.017604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:46.017743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:46.017861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:46.017973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:46.018095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:46.018260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:46.018289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:46.031635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1770 sessionId: src_id|2616de66-4136038b-4293b4e3-64867187_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:46.033787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:46.033975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.033999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.034037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:46.034114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:46.036258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:46.036273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:46.036275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:46.036281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:46.036291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256078608438557:3637]
2025-10-01T14:12:46.036295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256078608438557:3637]
2025-10-01T14:12:46.036297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256078608438557:3637]
2025-10-01T14:12:46.036328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:46.036333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.036335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:46.036344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:46.036349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:46.036352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:46.036449Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:46.093352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256080985336107:7092]
2025-10-01T14:12:46.093602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1769, pipe: [1:7556256080985336107:7092]
2025-10-01T14:12:46.174543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:46.181618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.181660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.181936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.182026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.182120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.182208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.182274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.182288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.182351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.182427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.182483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.182537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.182576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.182586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.182661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.182743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.182795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.182848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.182889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.182895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.182961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.183019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.183068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.183132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.183177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.183183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.183247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.183302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.183361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.183419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.183460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.183466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.183527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.183582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.183641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.183699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.183756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.183763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.183821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.183878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.183936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.183987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.184029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.184034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.184086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.184146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.184208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.184260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.184298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.184303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.184435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.184488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.184542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.184602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.184650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.184655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.184711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.184768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.184823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.184875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.184912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.184920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.184968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336107:7092], now have 1 active actors on pipe
2025-10-01T14:12:46.185167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:46.185177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:46.185203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1770 reason: error at write: Disconnected sessionId: src_id|2616de66-4136038b-4293b4e3-64867187_0
2025-10-01T14:12:46.185203Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:46.185263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256080985336107:7092]
2025-10-01T14:12:46.185370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1770 sessionId: src_id|2616de66-4136038b-4293b4e3-64867187_0 is DEAD
2025-10-01T14:12:46.185532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2616de66-4136038b-4293b4e3-64867187_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:46.185541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2616de66-4136038b-4293b4e3-64867187_0] Write session will restart in 0.009637s
2025-10-01T14:12:46.185578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2616de66-4136038b-4293b4e3-64867187_0] Write session: Do CDS request
2025-10-01T14:12:46.185583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2616de66-4136038b-4293b4e3-64867187_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:46.185898Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:46.191606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:46.192860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:46.193007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:46.193014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:46.193022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:46.193059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:46.193085Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256078608438679:3623]
2025-10-01T14:12:46.193591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:46.193797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:46.193834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:46.194063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:46.194100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.194105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.194106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.194107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.194108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.194109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.194110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.194111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.194111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.194113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.194113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.194114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.194115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.194116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.194120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.194129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.194133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.194135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.194137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.194138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.194140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.194142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.194144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.194146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.194148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.194150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.194151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.194153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.194158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.194162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.194166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.194170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.194172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.194175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.194179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.194182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.194185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.194188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.194190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.194193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.194196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.194203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.194205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.194208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.194211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.194214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.194220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.194223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.194225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.194228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.194233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.194236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.194238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.194241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.194244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.194248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.194282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:46.195836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2616de66-4136038b-4293b4e3-64867187_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.195887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:46.195899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1771
2025-10-01T14:12:46.196030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.196052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:46.196059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:46.196062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:46.196498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1771 sessionId:  describe result for acl check
2025-10-01T14:12:46.196529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:46.196536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:46.196538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:46.196542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256080985336179:6507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:46.197000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256080985336179:6507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:46.198250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:46.198824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:46.198837Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:46.198840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:46.198842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:46.198849Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1770 [2:7556256078608438679:3623]
2025-10-01T14:12:46.198862Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:46.198879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:46.198886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.198889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.198891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.198908Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:46.198916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:46.198921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:46.198967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.198972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.198974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.198975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:46.198979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:46.199032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:46.199039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.199048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.199062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.199081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:46.199100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336110:2446], now have 1 active actors on pipe
2025-10-01T14:12:46.199110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256078608438674:3623]
2025-10-01T14:12:46.199116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256078608438674:3623]
2025-10-01T14:12:46.199118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256078608438674:3623]
2025-10-01T14:12:46.199119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1770
2025-10-01T14:12:46.199133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:46.199149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:46.199150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:46.199157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:46.199158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:46.199162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:46.199165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:46.199191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256078608438674:3623]
2025-10-01T14:12:46.199202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:46.199208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:46.199529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256080985336179:6507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:46.205256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256080985336179:6507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:46.205268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256080985336179:6507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:46.205271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256080985336179:6507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:46.205277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:46.205471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336218:6507], now have 1 active actors on pipe
2025-10-01T14:12:46.205502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1770
2025-10-01T14:12:46.205576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.205590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.205615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:46.205627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.205634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.205636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:46.205652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.205665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:46.205680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.205800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.205809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.205821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.205873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1771 partition: 0 MaxSeqNo: 45 sessionId: src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0
2025-10-01T14:12:46.206187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2616de66-4136038b-4293b4e3-64867187_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:46.208873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0] Write session: try to update token
2025-10-01T14:12:46.208888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:46.222475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1771 sessionId: src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:46.222762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:46.222779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:46.222780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:46.222782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:46.222791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256078608438674:3623]
2025-10-01T14:12:46.222794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256078608438674:3623]
2025-10-01T14:12:46.222796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256078608438674:3623]
2025-10-01T14:12:46.222834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:46.222835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:46.222840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.222841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:46.222844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:46.222847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:46.222956Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:46.224611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:46.285335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256080985336222:7092]
2025-10-01T14:12:46.285552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1770, pipe: [1:7556256080985336222:7092]
2025-10-01T14:12:46.358427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:46.358645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.358658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.358695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336222:7092], now have 1 active actors on pipe
2025-10-01T14:12:46.358937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:46.358943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:46.358951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:46.358942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:46.358991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256080985336222:7092]
2025-10-01T14:12:46.359005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1771 reason: error at write: Disconnected sessionId: src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0
2025-10-01T14:12:46.359212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1771 sessionId: src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0 is DEAD
2025-10-01T14:12:46.359325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:46.359332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0] Write session will restart in 0.006935s
2025-10-01T14:12:46.359351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0] Write session: Do CDS request
2025-10-01T14:12:46.359356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:46.366499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:46.367794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.367892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:46.367905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:46.367915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1772
2025-10-01T14:12:46.368001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.368021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:46.368027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:46.368029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:46.368029Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:46.368037Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:46.368045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:46.368077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:46.368103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256078608438783:3621]
2025-10-01T14:12:46.368363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1772 sessionId:  describe result for acl check
2025-10-01T14:12:46.368401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:46.368419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:46.368425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:46.368430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256080985336302:6501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:46.368496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:46.368680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:46.368714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:46.368893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:46.368923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256080985336302:6501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:46.368924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.368928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.368929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.368929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.368930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.368930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.368931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.368932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.368932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.368933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.368933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.368934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.368934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.368935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.368938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.368943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.368945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.368947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.368949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.368951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.368953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.368955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.368957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.368959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.368961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.368963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.368965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.368967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.368972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.368976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.368980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.368983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.368986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.368988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.368990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.368993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.368996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.368999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.369001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.369004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.369006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.369009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.369011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.369014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.369016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.369019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.369021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.369024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.369027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.369030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.369032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.369035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.369037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.369040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.369042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.369045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.369065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:46.370171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256080985336302:6501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:46.372766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256080985336302:6501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:46.372778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256080985336302:6501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:46.372781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256080985336302:6501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:46.372788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:46.372898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:46.373492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:46.373502Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:46.373504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:46.373506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:46.373510Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1771 [2:7556256078608438783:3621]
2025-10-01T14:12:46.373521Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:46.373531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:46.373533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.373534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.373536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.373548Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:46.373551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:46.373554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:46.373589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.373594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.373595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.373597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:46.373599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:46.373641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:46.373647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.373654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.373659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.373668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:46.373679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336341:6501], now have 1 active actors on pipe
2025-10-01T14:12:46.373685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336235:2446], now have 1 active actors on pipe
2025-10-01T14:12:46.373689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256078608438778:3621]
2025-10-01T14:12:46.373690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256078608438778:3621]
2025-10-01T14:12:46.373692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256078608438778:3621]
2025-10-01T14:12:46.373701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:46.373710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:46.373718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:46.373721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:46.373721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:46.373706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1771
2025-10-01T14:12:46.373723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:46.373734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1771
2025-10-01T14:12:46.373723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:46.373740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256078608438778:3621]
2025-10-01T14:12:46.373741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:46.373744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:46.373753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.373756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.373795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec58f635-b27517e0-da24f841-28dc80b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:46.373803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.373806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.373807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:46.373812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.373817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:46.373831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.373920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.373926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.373935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.373992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1772 partition: 0 MaxSeqNo: 45 sessionId: src_id|ec58f635-b27517e0-da24f841-28dc80b4_0
2025-10-01T14:12:46.374242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97a21c28-28c90316-5aa8aa26-6fbbff82_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ec58f635-b27517e0-da24f841-28dc80b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:46.376521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec58f635-b27517e0-da24f841-28dc80b4_0] Write session: try to update token
2025-10-01T14:12:46.376545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec58f635-b27517e0-da24f841-28dc80b4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:46.389907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1772 sessionId: src_id|ec58f635-b27517e0-da24f841-28dc80b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:46.392260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:46.392899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.392918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.392945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:46.393035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:46.395589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:46.395605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:46.395607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:46.395608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:46.395616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256078608438778:3621]
2025-10-01T14:12:46.395619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256078608438778:3621]
2025-10-01T14:12:46.395623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256078608438778:3621]
2025-10-01T14:12:46.395657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:46.395662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:46.395665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.395666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:46.395666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:46.395669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:46.395776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:46.458908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256080985336354:7092]
2025-10-01T14:12:46.459121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1771, pipe: [1:7556256080985336354:7092]
2025-10-01T14:12:46.528664Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:46.534875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.534898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.535031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.535087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.535139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.535192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.535233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.535241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.535300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.535354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.535408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.535464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.535506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.535511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.535562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.535612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.535666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.535717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.535754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.535760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.535812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.535864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.535913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.535964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.536002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.536010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.536064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.536112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.536162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.536210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.536254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.536260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.536314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.536365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.536438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.536492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.536530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.536535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.536586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.536643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.536698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.536770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.536811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.536819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.536880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.536938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.536998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.537062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.537106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.537113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.537175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.537253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.537312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.537373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.537417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.537423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.537485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.537544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.537606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.537668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.537709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.537715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.537760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336354:7092], now have 1 active actors on pipe
2025-10-01T14:12:46.537943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:46.538365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256080985336354:7092]
2025-10-01T14:12:46.538409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:46.538414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:46.538432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1772 reason: error at write: Disconnected sessionId: src_id|ec58f635-b27517e0-da24f841-28dc80b4_0
2025-10-01T14:12:46.538579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1772 sessionId: src_id|ec58f635-b27517e0-da24f841-28dc80b4_0 is DEAD
2025-10-01T14:12:46.538701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec58f635-b27517e0-da24f841-28dc80b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:46.538707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec58f635-b27517e0-da24f841-28dc80b4_0] Write session will restart in 0.006040s
2025-10-01T14:12:46.538727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec58f635-b27517e0-da24f841-28dc80b4_0] Write session: Do CDS request
2025-10-01T14:12:46.538733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec58f635-b27517e0-da24f841-28dc80b4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:46.538706Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:46.545188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:46.545798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec58f635-b27517e0-da24f841-28dc80b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.545902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:46.545912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1773
2025-10-01T14:12:46.546010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.546037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:46.546045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:46.546048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:46.546322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1773 sessionId:  describe result for acl check
2025-10-01T14:12:46.546348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:46.546353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:46.546354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:46.546358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256080985336451:6486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:46.546696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256080985336451:6486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:46.546749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:46.546896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:46.546903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:46.546925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:46.546963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:46.546998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256078608438895:3619]
2025-10-01T14:12:46.547409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:46.547625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:46.547659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:46.547872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:46.547903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.547907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.547908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.547908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.547909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.547910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.547910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.547911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.547912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.547912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.547913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.547913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.547914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.547915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.547917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.547922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.547924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.547927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.547929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.547931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.547933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.547935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.547937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.547939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.547941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.547943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.547945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.547947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.547951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.547956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.547959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.547963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.547966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.547968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.547971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.547973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.547976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.547978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.547980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.547983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.547985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.547988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.547990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.547993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.547995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.547998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.547995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256080985336451:6486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:46.548000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.548003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.548005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.548007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.548009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.548012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.548014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.548017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.548019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.548021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.548041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:46.551463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256080985336451:6486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:46.551475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256080985336451:6486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:46.551477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256080985336451:6486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:46.551483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:46.551694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:46.552320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:46.552330Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:46.552331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:46.552337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:46.552341Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1772 [2:7556256078608438895:3619]
2025-10-01T14:12:46.552351Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:46.552365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:46.552370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.552372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.552373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.552384Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:46.552387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:46.552395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:46.552432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.552436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.552438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.552440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:46.552441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:46.552487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:46.552491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.552498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.552506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.552518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:46.552533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336372:2446], now have 1 active actors on pipe
2025-10-01T14:12:46.552541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256078608438890:3619]
2025-10-01T14:12:46.552542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256078608438890:3619]
2025-10-01T14:12:46.552543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256078608438890:3619]
2025-10-01T14:12:46.552553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:46.552562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336487:6486], now have 1 active actors on pipe
2025-10-01T14:12:46.552570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:46.552571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:46.552575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:46.552577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:46.552578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:46.552580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:46.552596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256078608438890:3619]
2025-10-01T14:12:46.552605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:46.552620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:46.552646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.552650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.552607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1772
2025-10-01T14:12:46.552613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1772
2025-10-01T14:12:46.552668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:46.552677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.552684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.552685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:46.552692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.552701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:46.552713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.552821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.552825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.552834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.552889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1773 partition: 0 MaxSeqNo: 45 sessionId: src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0
2025-10-01T14:12:46.553171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec58f635-b27517e0-da24f841-28dc80b4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:46.555375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0] Write session: try to update token
2025-10-01T14:12:46.555388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:46.563467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:46.563485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:46.563492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256078608438890:3619]
2025-10-01T14:12:46.563525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:46.563536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:46.563672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:46.563792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:46.563908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:46.564029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:46.564197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:46.564233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:46.567792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1773 sessionId: src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:46.569900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:46.570082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.570100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.570125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:46.570198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:46.585158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:46.585178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:46.585179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:46.585183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:46.585191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256078608438890:3619]
2025-10-01T14:12:46.585194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256078608438890:3619]
2025-10-01T14:12:46.585196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256078608438890:3619]
2025-10-01T14:12:46.585231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:46.585233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:46.585239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.585241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:46.585242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:46.585247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:46.585353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:46.638625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256080985336496:7092]
2025-10-01T14:12:46.639133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1772, pipe: [1:7556256080985336496:7092]
2025-10-01T14:12:46.716481Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:46.722803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.722827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.722966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.723019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.723074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.723127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.723168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.723175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.723233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.723286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.723341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.723396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.723434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.723442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.723494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.723549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.723605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.723658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.723696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.723701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.723753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.723803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.723851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.723902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.723939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.723944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.723993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.724043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.724092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.724144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.724184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.724188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.724245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.724297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.724349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.724401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.724441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.724446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.724501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.724553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.724611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.724678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.724714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.724719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.724771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.724820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.724876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.724927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.724967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.724973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.725026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.725075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.725124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.725174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.725211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.725216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.725265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.725311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.725360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.725408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.725444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.725449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.725486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336496:7092], now have 1 active actors on pipe
2025-10-01T14:12:46.725693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:46.725714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256080985336496:7092]
2025-10-01T14:12:46.725732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:46.725735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:46.725754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1773 reason: error at write: Disconnected sessionId: src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0
2025-10-01T14:12:46.725912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1773 sessionId: src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0 is DEAD
2025-10-01T14:12:46.726046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:46.726055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0] Write session will restart in 0.005170s
2025-10-01T14:12:46.726073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0] Write session: Do CDS request
2025-10-01T14:12:46.726078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:46.726164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:46.731734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.731823Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:46.731834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1774
2025-10-01T14:12:46.731931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.731953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:46.731957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:46.731959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:46.732275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1774 sessionId:  describe result for acl check
2025-10-01T14:12:46.732302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:46.732304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:46.732308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:46.732312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256080985336564:6479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:46.732625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:46.732797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256080985336564:6479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:46.734253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:46.734418Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:46.734422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256080985336564:6479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:46.734425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:46.734433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:46.734464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:46.734502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256078608439003:3615]
2025-10-01T14:12:46.734991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:46.735259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:46.735302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:46.735527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:46.735564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.735569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.735569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.735570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.735571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.735571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.735572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.735572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.735573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.735573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.735574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.735574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.735575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.735576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.735579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.735585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.735587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.735589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.735591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.735593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.735595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.735598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.735600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.735602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.735604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.735606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.735608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.735610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.735614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.735618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.735622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.735624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.735626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.735629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.735631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.735634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.735637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.735640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.735642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.735645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.735647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.735650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.735652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.735655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.735657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.735660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.735662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.735665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.735667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.735669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.735672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.735674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.735677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.735679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.735682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.735685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.735704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:46.739062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256080985336564:6479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:46.739073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256080985336564:6479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:46.739075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256080985336564:6479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:46.739081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:46.739240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:46.739807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:46.739821Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:46.739823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:46.739825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:46.739830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1773 [2:7556256078608439003:3615]
2025-10-01T14:12:46.739839Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:46.739855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:46.739860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.739862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.739864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.739875Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:46.739881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:46.739886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:46.739920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.739925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.739926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.739928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:46.739930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:46.739977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:46.739982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.739989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.740000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.740018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:46.740035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336605:6479], now have 1 active actors on pipe
2025-10-01T14:12:46.740041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336498:2446], now have 1 active actors on pipe
2025-10-01T14:12:46.740046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256078608438998:3615]
2025-10-01T14:12:46.740047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256078608438998:3615]
2025-10-01T14:12:46.740048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256078608438998:3615]
2025-10-01T14:12:46.740058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:46.740069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:46.740070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:46.740072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:46.740073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:46.740080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:46.740082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:46.740074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1773
2025-10-01T14:12:46.740084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1773
2025-10-01T14:12:46.740099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256078608438998:3615]
2025-10-01T14:12:46.740104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:46.740107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:46.740124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.740130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.740151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:46.740159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.740163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.740164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:46.740169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.740175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:46.740186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.740291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.740296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.740305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.740365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1774 partition: 0 MaxSeqNo: 45 sessionId: src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0
2025-10-01T14:12:46.740654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa256e29-4dc9dd40-49160ebc-916e60a8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:46.742806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0] Write session: try to update token
2025-10-01T14:12:46.742818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:46.754533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1774 sessionId: src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:46.756554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:46.756710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.756730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.756760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:46.756814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:46.761825Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:46.761841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:46.761843Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:46.761845Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:46.761851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256078608438998:3615]
2025-10-01T14:12:46.761855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256078608438998:3615]
2025-10-01T14:12:46.761858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256078608438998:3615]
2025-10-01T14:12:46.761892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:46.761903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.761904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:46.761910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:46.761915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:46.761918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:46.762028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:46.825991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256080985336613:7092]
2025-10-01T14:12:46.826215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1773, pipe: [1:7556256080985336613:7092]
2025-10-01T14:12:46.891816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:46.898939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.898968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.899127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.899186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.899250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.899311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.899527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.899538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.899599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.899658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.899717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.899779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.899822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.899829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.899887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.899943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.900005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.900063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.900107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.900114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.900175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.900239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.900306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.900367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.900419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.900430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.900490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.900543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.900596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.900660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.900705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.900713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.900769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.900823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.900886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.900948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.900990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.900996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.901055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.901109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.901162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.901213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.901257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.901262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.901316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.901366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.901417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.901474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.901573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.901581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.901644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.901701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.901761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.901824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.901871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.901877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.901931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:46.901981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:46.902036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:46.902097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:46.902150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:46.902155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:46.902202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336613:7092], now have 1 active actors on pipe
2025-10-01T14:12:46.902396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:46.902408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:46.902409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:46.902429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1774 reason: error at write: Disconnected sessionId: src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0
2025-10-01T14:12:46.902454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256080985336613:7092]
2025-10-01T14:12:46.902593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1774 sessionId: src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0 is DEAD
2025-10-01T14:12:46.902738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:46.902749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0] Write session will restart in 0.007286s
2025-10-01T14:12:46.902782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0] Write session: Do CDS request
2025-10-01T14:12:46.902787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:46.903041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:46.909884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:46.910799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.910860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:46.910873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1775
2025-10-01T14:12:46.910995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:46.911024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:46.911034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:46.911037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:46.911250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:46.911395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:46.911405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:46.911413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:46.911447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:46.911472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256078608439140:3592]
2025-10-01T14:12:46.911508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1775 sessionId:  describe result for acl check
2025-10-01T14:12:46.911540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:46.911544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:46.911546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:46.911549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256080985336686:6473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:46.911858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:46.911937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256080985336686:6473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:46.912096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:46.912128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:46.912338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:46.912374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.912378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.912379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.912380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.912380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.912381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.912382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.912382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.912383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.912383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.912384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.912384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.912385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.912385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.912389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.912394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.912396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.912398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.912400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.912402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.912404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.912406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.912408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.912411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.912413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.912415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.912416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.912418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.912422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.912426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:46.912430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.912433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:46.912435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.912438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:46.912440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.912443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:46.912446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.912449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:46.912451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.912454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:46.912456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.912459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:46.912461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.912464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:46.912466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.912469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:46.912471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.912474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.912476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.912479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.912481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.912484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.912486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.912489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:46.912491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.912494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:46.912514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:46.913852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256080985336686:6473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:46.915975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:46.916160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256080985336686:6473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:46.916172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256080985336686:6473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:46.916176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256080985336686:6473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:46.916182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:46.916505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:46.916515Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:46.916516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:46.916519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:46.916524Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1774 [2:7556256078608439140:3592]
2025-10-01T14:12:46.916533Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:46.916544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:46.916546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.916549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.916550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.916567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:46.916574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:46.916579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:46.916616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.916623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.916624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.916627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:46.916628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:46.916686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:46.916691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.916697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:46.916706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:46.916714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:46.916729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336725:6473], now have 1 active actors on pipe
2025-10-01T14:12:46.916735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256080985336617:2446], now have 1 active actors on pipe
2025-10-01T14:12:46.916741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256078608439135:3592]
2025-10-01T14:12:46.916745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256078608439135:3592]
2025-10-01T14:12:46.916747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256078608439135:3592]
2025-10-01T14:12:46.916755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:46.916767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:46.916770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:46.916773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:46.916775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:46.916779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:46.916780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:46.916769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1774
2025-10-01T14:12:46.916769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1774
2025-10-01T14:12:46.916799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256078608439135:3592]
2025-10-01T14:12:46.916804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:46.916806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:46.916819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.916826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.916860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:46.916867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:46.916873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:46.916875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:46.916882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:46.916891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:46.916907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.917020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.917025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.917040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:46.917107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1775 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0
2025-10-01T14:12:46.917373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfa42a14-6dd89aff-8fd5b095-d5e647d5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:46.919713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0] Write session: try to update token
2025-10-01T14:12:46.919729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:46.931787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1775 sessionId: src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:46.933852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:46.934020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:46.934039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:46.934070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:46.934120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:46.936219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:46.936235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:46.936237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:46.936239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:46.936246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256078608439135:3592]
2025-10-01T14:12:46.936249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256078608439135:3592]
2025-10-01T14:12:46.936253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256078608439135:3592]
2025-10-01T14:12:46.936294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:46.936299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:46.936303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:46.936306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:46.936307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:46.936308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:46.936453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:47.002645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256085280304029:7092]
2025-10-01T14:12:47.002897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1774, pipe: [1:7556256085280304029:7092]
2025-10-01T14:12:47.069554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:47.075732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.075756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.075897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.075951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.076006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.076064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.076106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.076114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.076170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.076222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.076276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.076331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.076370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.076378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.076430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.076480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.076532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.076579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.076615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.076619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.076685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.076736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.076785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.076833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.076871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.076876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.076927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.076974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.077022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.077069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.077106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.077111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.077165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.077214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.077268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.077322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.077360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.077367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.077418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.077469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.077519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.077571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.077609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.077615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.077668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.077718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.077771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.077826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.077863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.077870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.077924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.077974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.078025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.078077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.078114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.078119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.078172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.078223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.078273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.078322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.078360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.078365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.078415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304029:7092], now have 1 active actors on pipe
2025-10-01T14:12:47.078644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256085280304029:7092]
2025-10-01T14:12:47.078670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:47.078692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:47.078694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:47.078714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1775 reason: error at write: Disconnected sessionId: src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0
2025-10-01T14:12:47.078860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1775 sessionId: src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0 is DEAD
2025-10-01T14:12:47.079002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:47.079012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0] Write session will restart in 0.007527s
2025-10-01T14:12:47.079036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0] Write session: Do CDS request
2025-10-01T14:12:47.079042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:47.079164Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:47.085854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:47.087336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:47.087463Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:47.087472Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:47.087479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:47.087507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:47.087533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256082903406546:3594]
2025-10-01T14:12:47.087794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.087913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:47.088093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:47.088117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:47.088138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:47.088149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1776
2025-10-01T14:12:47.088261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.088281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:47.088288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:47.088290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:47.088345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:47.088382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.088387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.088387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.088388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.088388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.088389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.088389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.088390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.088390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.088391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.088391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.088392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.088393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.088393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.088396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.088401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.088403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.088406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.088408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.088410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.088412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.088414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.088416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.088418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.088420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.088422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.088424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.088426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.088430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.088434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.088438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.088441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.088443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.088445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.088447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.088450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.088452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.088455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.088457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.088460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.088462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.088465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.088467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.088470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.088472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.088475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.088477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.088480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.088482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.088484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.088486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.088489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.088492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.088499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.088501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.088503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.088523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:47.088571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1776 sessionId:  describe result for acl check
2025-10-01T14:12:47.088596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:47.088598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:47.088599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:47.088602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256085280304103:6468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:47.088982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256085280304103:6468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:47.090842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256085280304103:6468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:47.091656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:47.092190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:47.092201Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:47.092202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:47.092204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:47.092208Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1775 [2:7556256082903406546:3594]
2025-10-01T14:12:47.092217Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:47.092226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:47.092228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.092230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.092232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.092241Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:47.092244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:47.092247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:47.092283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.092293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.092295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.092298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:47.092303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:47.092359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:47.092367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.092378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.092391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.092408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:47.092411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1775
2025-10-01T14:12:47.092428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304030:2446], now have 1 active actors on pipe
2025-10-01T14:12:47.092449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256082903406541:3594]
2025-10-01T14:12:47.092455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256082903406541:3594]
2025-10-01T14:12:47.092457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256082903406541:3594]
2025-10-01T14:12:47.092467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:47.092473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:47.092474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:47.092476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:47.092482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:47.092495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:47.092506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:47.092532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256082903406541:3594]
2025-10-01T14:12:47.092541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:47.092547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:47.092736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256085280304103:6468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:47.092745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256085280304103:6468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:47.092748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256085280304103:6468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:47.092752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:47.092896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1775
2025-10-01T14:12:47.092886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304141:6468], now have 1 active actors on pipe
2025-10-01T14:12:47.092921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.092926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.092951Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a71d717-787f3fc6-897eb42-96b7c747_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:47.092962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.092966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.092972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:47.092980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.092995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:47.093011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.093128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.093134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.093147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.093198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1776 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a71d717-787f3fc6-897eb42-96b7c747_0
2025-10-01T14:12:47.093435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c8efb13-7690a424-b41dda8a-9d53d757_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a71d717-787f3fc6-897eb42-96b7c747_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:47.095643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a71d717-787f3fc6-897eb42-96b7c747_0] Write session: try to update token
2025-10-01T14:12:47.095655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a71d717-787f3fc6-897eb42-96b7c747_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:47.102027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:47.102044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:47.102051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256082903406541:3594]
2025-10-01T14:12:47.102086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:47.102094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:47.102221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:47.102340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:47.102479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:47.102596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:47.102759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:47.102788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:47.106996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1776 sessionId: src_id|6a71d717-787f3fc6-897eb42-96b7c747_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:47.109160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:47.109335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.109352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.109377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:47.109434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:47.122037Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:47.122052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:47.122054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:47.122055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:47.122063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256082903406541:3594]
2025-10-01T14:12:47.122066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256082903406541:3594]
2025-10-01T14:12:47.122069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256082903406541:3594]
2025-10-01T14:12:47.122103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:47.122102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:47.122106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:47.122108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:47.122110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.122111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:47.122225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:47.178798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256085280304151:7092]
2025-10-01T14:12:47.179046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1775, pipe: [1:7556256085280304151:7092]
2025-10-01T14:12:47.272185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:47.278547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.278571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.278733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.278797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.278855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.278906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.278950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.278961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.279024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.279085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.279149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.279214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.279252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.279258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.279311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.279362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.279412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.279464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.279500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.279505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.279559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.279617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.279683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.279743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.279784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.279792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.279849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.279897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.279951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.279999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.280037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.280042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.280091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.280140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.280191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.280239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.280280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.280285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.280334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.280380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.280434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.280485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.280521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.280526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.280581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.280647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.280716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.280783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.280829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.280835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.280897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.280947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.280998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.281051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.281089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.281094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.281146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.281194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.281246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.281297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.281335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.281340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.281379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304151:7092], now have 1 active actors on pipe
2025-10-01T14:12:47.281618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:47.281632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256085280304151:7092]
2025-10-01T14:12:47.281655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:47.281657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:47.281679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1776 reason: error at write: Disconnected sessionId: src_id|6a71d717-787f3fc6-897eb42-96b7c747_0
2025-10-01T14:12:47.281871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1776 sessionId: src_id|6a71d717-787f3fc6-897eb42-96b7c747_0 is DEAD
2025-10-01T14:12:47.281981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a71d717-787f3fc6-897eb42-96b7c747_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:47.281987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a71d717-787f3fc6-897eb42-96b7c747_0] Write session will restart in 0.007447s
2025-10-01T14:12:47.282005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a71d717-787f3fc6-897eb42-96b7c747_0] Write session: Do CDS request
2025-10-01T14:12:47.282010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a71d717-787f3fc6-897eb42-96b7c747_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:47.282126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:47.289547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:47.290781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a71d717-787f3fc6-897eb42-96b7c747_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.290895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:47.290905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1777
2025-10-01T14:12:47.291005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.291029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:47.291034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:47.291036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:47.291138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:47.291306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1777 sessionId:  describe result for acl check
2025-10-01T14:12:47.291301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:47.291312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:47.291324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:47.291331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:47.291337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:47.291338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:47.291342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256085280304225:6449] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:47.291377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:47.291426Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256082903406668:3581]
2025-10-01T14:12:47.291778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256085280304225:6449] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:47.292006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:47.292212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:47.292243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:47.292462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:47.292496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.292500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.292501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.292501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.292502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.292503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.292503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.292504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.292505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.292505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.292506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.292506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.292507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.292507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.292510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.292516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.292519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.292521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.292523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.292525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.292528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.292530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.292532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.292534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.292536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.292538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.292540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.292542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.292547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.292551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.292555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.292558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.292560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.292564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.292566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.292569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.292571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.292574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.292576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.292579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.292582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.292585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.292589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.292592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.292595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.292598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.292601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.292604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.292606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.292609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.292611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.292614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.292616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.292619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.292621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.292625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.292658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:47.293912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256085280304225:6449] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:47.295978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256085280304225:6449] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:47.295989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256085280304225:6449] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:47.295992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256085280304225:6449] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:47.295997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:47.296110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:47.296640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:47.296652Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:47.296653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:47.296655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:47.296659Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1776 [2:7556256082903406668:3581]
2025-10-01T14:12:47.296670Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:47.296681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:47.296683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.296685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.296686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.296696Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:47.296702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:47.296706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:47.296748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.296753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.296754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.296757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:47.296758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:47.296801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:47.296807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.296813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.296819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.296828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:47.296840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304264:6449], now have 1 active actors on pipe
2025-10-01T14:12:47.296847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304154:2446], now have 1 active actors on pipe
2025-10-01T14:12:47.296852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256082903406663:3581]
2025-10-01T14:12:47.296853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256082903406663:3581]
2025-10-01T14:12:47.296854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256082903406663:3581]
2025-10-01T14:12:47.296863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:47.296871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:47.296872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:47.296879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:47.296880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:47.296875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1776
2025-10-01T14:12:47.296881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:47.296882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:47.296896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256082903406663:3581]
2025-10-01T14:12:47.296897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:47.296877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1776
2025-10-01T14:12:47.296899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:47.296908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.296911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.296941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:47.296949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.296952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.296953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:47.296959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.296965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:47.296977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.297089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.297096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.297106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.297167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1777 partition: 0 MaxSeqNo: 45 sessionId: src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0
2025-10-01T14:12:47.297394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a71d717-787f3fc6-897eb42-96b7c747_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:47.299591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0] Write session: try to update token
2025-10-01T14:12:47.299606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:47.311168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1777 sessionId: src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:47.313384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:47.313554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.313575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.313604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:47.313669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:47.315931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:47.315946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:47.315947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:47.315949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:47.315955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256082903406663:3581]
2025-10-01T14:12:47.315959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256082903406663:3581]
2025-10-01T14:12:47.315962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256082903406663:3581]
2025-10-01T14:12:47.315998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:47.316007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.316008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:47.316007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:47.316014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:47.316017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:47.316119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:47.381555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256085280304285:7092]
2025-10-01T14:12:47.381762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1776, pipe: [1:7556256085280304285:7092]
2025-10-01T14:12:47.445890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:47.453381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.453404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.453540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.453612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.453673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.453726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.454017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.454026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.454089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.454139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.454204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.454264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.454307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.454313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.454397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.454454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.454509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.454562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.454599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.454604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.454655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.454721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.454772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.454823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.454861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.454867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.454921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.454970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.455019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.455068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.455115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.455120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.455175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.455223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.455278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.455330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.455386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.455391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.455453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.455502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.455557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.455606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.455645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.455649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.455703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.455751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.455804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.455857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.455897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.455902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.455962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.456050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.456105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.456190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.456229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.456233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.456291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.456342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.456395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.456445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.456486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.456491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.456539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304285:7092], now have 1 active actors on pipe
2025-10-01T14:12:47.456761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256085280304285:7092]
2025-10-01T14:12:47.456763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:47.456792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:47.456794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:47.456817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1777 reason: error at write: Disconnected sessionId: src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0
2025-10-01T14:12:47.457087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:47.457157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1777 sessionId: src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0 is DEAD
2025-10-01T14:12:47.457282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:47.457293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0] Write session will restart in 0.006080s
2025-10-01T14:12:47.457321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0] Write session: Do CDS request
2025-10-01T14:12:47.457326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:47.464167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:47.464810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.464886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:47.464897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1778
2025-10-01T14:12:47.465002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.465035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:47.465045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:47.465048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:47.465327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1778 sessionId:  describe result for acl check
2025-10-01T14:12:47.465350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:47.465354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:47.465355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:47.465359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256085280304365:6450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:47.465705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:47.465747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256085280304365:6450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:47.465836Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:47.465843Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:47.465850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:47.465880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:47.465906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256082903406778:3567]
2025-10-01T14:12:47.466276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:47.466459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:47.466485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:47.466675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:47.466708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.466713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.466713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.466714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.466715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.466715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.466716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.466717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.466717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.466718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.466719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.466719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.466720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.466720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.466723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.466729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.466731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.466733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.466735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.466737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.466739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.466741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.466743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.466746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.466748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.466750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.466752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.466754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.466758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.466762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.466766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.466769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.466771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.466774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.466776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.466779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.466781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.466784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.466786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.466789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.466792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.466795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.466797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.466800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.466802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.466805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.466807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.466810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.466812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.466815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.466817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.466819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.466823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.466825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.466827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.466830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.466849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:47.467612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256085280304365:6450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:47.470035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256085280304365:6450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:47.470051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256085280304365:6450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:47.470054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256085280304365:6450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:47.470062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:47.470265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:47.470864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:47.470876Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:47.470877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:47.470880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:47.470884Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1777 [2:7556256082903406778:3567]
2025-10-01T14:12:47.470893Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:47.470905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:47.470907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.470909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.470910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.470921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:47.470929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:47.470933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:47.470971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.470976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.470977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.470979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:47.470981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:47.471025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:47.471031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.471038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.471044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.471052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:47.471067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256082903406773:3567]
2025-10-01T14:12:47.471071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256082903406773:3567]
2025-10-01T14:12:47.471073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256082903406773:3567]
2025-10-01T14:12:47.471081Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:47.471090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:47.471092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:47.471093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:47.471095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304292:2446], now have 1 active actors on pipe
2025-10-01T14:12:47.471098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304404:6450], now have 1 active actors on pipe
2025-10-01T14:12:47.471105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:47.471117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:47.471125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:47.471125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1777
2025-10-01T14:12:47.471145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1777
2025-10-01T14:12:47.471151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256082903406773:3567]
2025-10-01T14:12:47.471160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:47.471172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:47.471184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.471187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.471208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:47.471213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.471217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.471219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:47.471226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.471234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:47.471250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.471393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.471401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.471414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.471486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1778 partition: 0 MaxSeqNo: 45 sessionId: src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0
2025-10-01T14:12:47.471814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|106dce7c-ab0d3134-b6be0aab-9e01f1fe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:47.474021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0] Write session: try to update token
2025-10-01T14:12:47.474033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:47.486391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1778 sessionId: src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:47.488707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:47.488883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.488906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.488951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:47.489052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:47.490991Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:47.491008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:47.491011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:47.491012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:47.491023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256082903406773:3567]
2025-10-01T14:12:47.491028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256082903406773:3567]
2025-10-01T14:12:47.491033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256082903406773:3567]
2025-10-01T14:12:47.491072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:47.491082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.491080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:47.491084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:47.491086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:47.491088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:47.491205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:47.557164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256085280304427:7092]
2025-10-01T14:12:47.557456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1777, pipe: [1:7556256085280304427:7092]
2025-10-01T14:12:47.635406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:47.641715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.641744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.641885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.641940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.641996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.642057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.642101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.642109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.642164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.642218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.642273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.642329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.642387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.642395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.642452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.642503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.642552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.642598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.642636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.642640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.642691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.642742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.642791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.642844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.642966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.642973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.643025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.643072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.643123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.643173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.643209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.643214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.643279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.643327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.643380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.643436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.643476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.643483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.643538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.643587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.643637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.643687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.643723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.643728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.643790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.643846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.643898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.643947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.643988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.643993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.644055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.644106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.644159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.644212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.644321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.644327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.644382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:47.644433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:47.644485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:47.644535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:47.644571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:47.644575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:47.644614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304427:7092], now have 1 active actors on pipe
2025-10-01T14:12:47.644887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:47.644901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:47.644904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:47.644927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1778 reason: error at write: Disconnected sessionId: src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0
2025-10-01T14:12:47.644940Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256085280304427:7092]
2025-10-01T14:12:47.645081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1778 sessionId: src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0 is DEAD
2025-10-01T14:12:47.645176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:47.645185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0] Write session will restart in 0.007602s
2025-10-01T14:12:47.645210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0] Write session: Do CDS request
2025-10-01T14:12:47.645217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:47.645276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:47.653872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.653939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:47.653981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:47.653994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1779
2025-10-01T14:12:47.654416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.654442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:47.654451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:47.654454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:47.654774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1779 sessionId:  describe result for acl check
2025-10-01T14:12:47.654801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:47.654811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:47.654813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:47.654818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256085280304512:6439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:47.655181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256085280304512:6439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:47.655742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:47.655885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:47.655895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:47.655906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:47.655950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:47.655997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256082903406899:3576]
2025-10-01T14:12:47.656540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:47.656748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:47.656781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:47.656968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:47.657001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.657005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.657006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.657006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.657007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.657008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.657008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.657009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.657010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.657010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.657011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.657011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.657012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.657013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.657015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.657021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.657023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.657026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.657027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.657030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.657031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.657033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.657036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.657038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.657040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.657042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.657044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.657046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.657051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.657057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.657062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.657067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.657070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.657075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.657078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.657082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.657086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.657091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.657095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.657100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.657105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.657108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.657110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.657113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.657115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.657118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.657120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.657123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.657126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.657129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.657131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.657134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.657136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.657138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.657141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.657144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.657164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:47.657218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256085280304512:6439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:47.660359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256085280304512:6439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:47.660375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256085280304512:6439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:47.660378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256085280304512:6439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:47.660386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:47.660448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:47.660972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:47.660984Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:47.660986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:47.660988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:47.660992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1778 [2:7556256082903406899:3576]
2025-10-01T14:12:47.661002Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:47.661013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:47.661019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.661021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.661022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.661034Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:47.661037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:47.661041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:47.661086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.661092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.661093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.661095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:47.661097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:47.661142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:47.661147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.661154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.661159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.661167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:47.661181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256082903406894:3576]
2025-10-01T14:12:47.661185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256082903406894:3576]
2025-10-01T14:12:47.661187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256082903406894:3576]
2025-10-01T14:12:47.661193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:47.661202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:47.661204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:47.661207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:47.661209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:47.661213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:47.661215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:47.661222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304551:6439], now have 1 active actors on pipe
2025-10-01T14:12:47.661224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304439:2446], now have 1 active actors on pipe
2025-10-01T14:12:47.661238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256082903406894:3576]
2025-10-01T14:12:47.661246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:47.661253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:47.661257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1778
2025-10-01T14:12:47.661260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1778
2025-10-01T14:12:47.661296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.661303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.661321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:47.661329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.661332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.661334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:47.661339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.661344Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:47.661353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.661464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.661469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.661478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.661547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1779 partition: 0 MaxSeqNo: 45 sessionId: src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0
2025-10-01T14:12:47.661831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20df27e5-ce44c97e-ab7f3ded-717cc46a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:47.664120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0] Write session: try to update token
2025-10-01T14:12:47.664134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:47.676574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1779 sessionId: src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:47.678755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:47.680243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.680271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.680291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:47.680294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:47.680297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:47.680299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:47.680307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256082903406894:3576]
2025-10-01T14:12:47.680312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256082903406894:3576]
2025-10-01T14:12:47.680317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256082903406894:3576]
2025-10-01T14:12:47.680344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:47.680354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:47.680357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:47.680370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:47.680382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.680388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:47.680516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:47.745074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256085280304558:7092]
2025-10-01T14:12:47.745323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1778, pipe: [1:7556256085280304558:7092]
2025-10-01T14:12:47.821546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:47.821793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:47.821840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304558:7092], now have 1 active actors on pipe
2025-10-01T14:12:47.821921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:47.822026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:47.822081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256085280304558:7092]
2025-10-01T14:12:47.829822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:47.830355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:47.830364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:47.830399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1779 reason: error at write: Disconnected sessionId: src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0
2025-10-01T14:12:47.830516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1779 sessionId: src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0 is DEAD
2025-10-01T14:12:47.830698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:47.830710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0] Write session will restart in 0.009828s
2025-10-01T14:12:47.830734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0] Write session: Do CDS request
2025-10-01T14:12:47.830739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:47.834048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:47.834252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:47.834262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:47.834272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:47.834318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:47.834352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256082903407012:3574]
2025-10-01T14:12:47.834837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:47.835081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:47.835111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:47.835358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:47.835397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.835401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.835402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.835402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.835403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.835404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.835404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.835405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.835406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.835406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.835407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.835407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.835408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.835409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.835412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.835418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.835420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.835422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.835424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.835426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.835428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.835430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.835432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.835434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.835436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.835438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.835440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.835442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.835447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.835452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:47.835456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.835460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:47.835462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.835465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:47.835467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.835470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:47.835472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.835475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:47.835478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.835480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:47.835483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.835487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:47.835489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.835492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:47.835494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.835497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:47.835500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.835503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.835505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.835508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.835510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.835513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.835515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.835518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:47.835520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.835523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:47.835544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:47.839309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:47.839980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:47.839997Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:47.840001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:47.840004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:47.840011Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1779 [2:7556256082903407012:3574]
2025-10-01T14:12:47.840026Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:47.840046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:47.840052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.840056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.840059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.840074Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:47.840083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:47.840089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:47.840155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.840162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.840163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.840166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:47.840169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:47.840249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:47.840256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.840267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:47.840277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:47.840298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:47.840319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304560:2446], now have 1 active actors on pipe
2025-10-01T14:12:47.840331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256082903407006:3574]
2025-10-01T14:12:47.840337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256082903407006:3574]
2025-10-01T14:12:47.840339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256082903407006:3574]
2025-10-01T14:12:47.840355Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:47.840365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:47.840374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:47.840375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:47.840376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:47.840393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:47.840375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1779
2025-10-01T14:12:47.840401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:47.840436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256082903407006:3574]
2025-10-01T14:12:47.840447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:47.840453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:47.841835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.841997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:47.842007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1780
2025-10-01T14:12:47.842079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:47.842100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:47.842110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:47.842112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:47.842434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1780 sessionId:  describe result for acl check
2025-10-01T14:12:47.842467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:47.842477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:47.842479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:47.842484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256085280304644:6432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:47.842977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256085280304644:6432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:47.844483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256085280304644:6432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:47.849603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256085280304644:6432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:47.849622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256085280304644:6432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:47.849625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256085280304644:6432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:47.849634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:47.849871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1779
2025-10-01T14:12:47.855870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304680:6432], now have 1 active actors on pipe
2025-10-01T14:12:47.855904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.855911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.855927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:47.855933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:47.855939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256082903407006:3574]
2025-10-01T14:12:47.855974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:47.855977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:47.855986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:47.855990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:47.855992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:47.856001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:47.856013Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:47.856024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:47.856186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:47.856307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:47.856426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:47.856543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:47.856719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:47.856753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.856770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:47.856942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:47.856949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:47.856960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:47.857024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1780 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0
2025-10-01T14:12:47.857363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ffa9ae-241ac1b4-a5e6dd4c-6edda983_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:47.859580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0] Write session: try to update token
2025-10-01T14:12:47.859594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:47.869310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:47.869328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:47.869330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:47.869332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:47.869342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256082903407006:3574]
2025-10-01T14:12:47.869345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256082903407006:3574]
2025-10-01T14:12:47.869350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256082903407006:3574]
2025-10-01T14:12:47.869384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:47.869386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:47.869388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:47.869391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:47.869391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:47.869392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:47.869512Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:47.872412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1780 sessionId: src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:47.874766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:47.922235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256085280304683:7092]
2025-10-01T14:12:47.922513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1779, pipe: [1:7556256085280304683:7092]
2025-10-01T14:12:48.007128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:48.007415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.007432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.007453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256085280304683:7092], now have 1 active actors on pipe
2025-10-01T14:12:48.007670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:48.007674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:48.007678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256085280304683:7092]
2025-10-01T14:12:48.007687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:48.007700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:48.007745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1780 reason: error at write: Disconnected sessionId: src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0
2025-10-01T14:12:48.007912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1780 sessionId: src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0 is DEAD
2025-10-01T14:12:48.008071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:48.008083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0] Write session will restart in 0.006614s
2025-10-01T14:12:48.008110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0] Write session: Do CDS request
2025-10-01T14:12:48.008117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:48.014770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:48.015845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.015902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:48.015914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1781
2025-10-01T14:12:48.016017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.016048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:48.016057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:48.016060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:48.016183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:48.016297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:48.016305Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:48.016312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:48.016339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:48.016365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256087198374449:3549]
2025-10-01T14:12:48.016397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1781 sessionId:  describe result for acl check
2025-10-01T14:12:48.016429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:48.016436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:48.016437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:48.016444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256089575272057:6425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:48.016738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:48.016936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:48.016954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256089575272057:6425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:48.016961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:48.017143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:48.017176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.017180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.017180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.017181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.017182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.017182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.017183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.017184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.017184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.017185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.017185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.017186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.017186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.017187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.017190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.017195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.017197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.017199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.017201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.017203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.017205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.017207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.017209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.017212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.017213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.017215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.017217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.017219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.017224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.017228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.017231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.017235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.017237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.017240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.017242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.017245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.017248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.017250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.017253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.017255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.017258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.017260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.017262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.017265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.017267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.017270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.017272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.017275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.017277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.017280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.017282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.017285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.017287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.017290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.017293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.017295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.017314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:48.018438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256089575272057:6425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:48.020549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256089575272057:6425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:48.020559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256089575272057:6425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:48.020562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256089575272057:6425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:48.020566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:48.020734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:48.021430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:48.021444Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:48.021445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:48.021447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:48.021452Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1780 [2:7556256087198374449:3549]
2025-10-01T14:12:48.021462Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:48.021473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:48.021474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.021476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.021477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.021487Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:48.021490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:48.021495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:48.021538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.021544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.021546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.021548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:48.021549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:48.021590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:48.021595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.021601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.021607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.021618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:48.021633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575271981:2446], now have 1 active actors on pipe
2025-10-01T14:12:48.021638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272096:6425], now have 1 active actors on pipe
2025-10-01T14:12:48.021643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256087198374444:3549]
2025-10-01T14:12:48.021645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256087198374444:3549]
2025-10-01T14:12:48.021646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256087198374444:3549]
2025-10-01T14:12:48.021655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:48.021665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:48.021667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:48.021667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:48.021669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:48.021675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:48.021677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:48.021678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1780
2025-10-01T14:12:48.021692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256087198374444:3549]
2025-10-01T14:12:48.021699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:48.021705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:48.021701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1780
2025-10-01T14:12:48.021736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.021743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.021760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:48.021767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.021770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.021771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:48.021776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.021784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:48.021796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.021898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.021904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.021916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.021981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1781 partition: 0 MaxSeqNo: 45 sessionId: src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0
2025-10-01T14:12:48.022244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f444e7a-7cd33d59-b2629b48-5fab797c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:48.024391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0] Write session: try to update token
2025-10-01T14:12:48.024404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:48.036728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1781 sessionId: src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:48.038989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:48.039152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.039173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.039201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:48.039259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:48.041075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:48.041090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:48.041092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:48.041093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:48.041101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256087198374444:3549]
2025-10-01T14:12:48.041104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256087198374444:3549]
2025-10-01T14:12:48.041107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256087198374444:3549]
2025-10-01T14:12:48.041140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:48.041140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:48.041144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:48.041147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:48.041149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.041151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:48.041272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:48.108064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256089575272104:7092]
2025-10-01T14:12:48.108395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1780, pipe: [1:7556256089575272104:7092]
2025-10-01T14:12:48.177515Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:48.184100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.184129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.184275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.184332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.184391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.184449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.184490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.184498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.184557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.184611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.184678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.184735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.184776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.184781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.184841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.184898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.184989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.185050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.185094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.185102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.185166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.185227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.185289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.185361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.185408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.185415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.185477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.185532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.185587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.185643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.185685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.185692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.185760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.185815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.185874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.185935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.185980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.185987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.186047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.186102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.186165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.186225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.186267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.186274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.186335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.186414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.186475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.186539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.186585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.186592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.186660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.186721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.186789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.186850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.186896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.186902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.186967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.187028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.187091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.187150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.187194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.187201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.187252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272104:7092], now have 1 active actors on pipe
2025-10-01T14:12:48.187560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256089575272104:7092]
2025-10-01T14:12:48.187561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:48.187598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:48.187600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:48.187627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1781 reason: error at write: Disconnected sessionId: src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0
2025-10-01T14:12:48.187812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1781 sessionId: src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0 is DEAD
2025-10-01T14:12:48.187984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:48.187996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0] Write session will restart in 0.006735s
2025-10-01T14:12:48.188023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0] Write session: Do CDS request
2025-10-01T14:12:48.188029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:48.188495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:48.195848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.195909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:48.195923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1782
2025-10-01T14:12:48.196041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.196070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:48.196079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:48.196083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:48.196466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1782 sessionId:  describe result for acl check
2025-10-01T14:12:48.196495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:48.196503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:48.196504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:48.196510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256089575272180:6417] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:48.196934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:48.196963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256089575272180:6417] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:48.199304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:48.199397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256089575272180:6417] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:48.199515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:48.199528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:48.199540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:48.199597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:48.199663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256087198374578:3544]
2025-10-01T14:12:48.200230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:48.200560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:48.200609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:48.200930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:48.200993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.201000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.201001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.201003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.201004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.201005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.201006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.201007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.201008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.201009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.201010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.201011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.201012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.201013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.201019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.201028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.201033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.201037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.201040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.201045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.201048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.201052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.201056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.201060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.201064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.201067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.201071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.201074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.201082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.201094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.201105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.201115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.201126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.201136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.201146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.201151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.201156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.201166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.201176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.201186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.201196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.201205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.201214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.201223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.201232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.201238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.201246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.201255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.201264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.201270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.201279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.201283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.201291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.201297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.201305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.201310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.201353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:48.201937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256089575272180:6417] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:48.201951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256089575272180:6417] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:48.201954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256089575272180:6417] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:48.201962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:48.205563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:48.206087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:48.206099Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:48.206101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:48.206104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:48.206109Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1781 [2:7556256087198374578:3544]
2025-10-01T14:12:48.206119Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:48.206134Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:48.206136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.206138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.206140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.206151Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:48.206158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:48.206163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:48.206199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.206204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.206205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.206208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:48.206209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:48.206256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:48.206261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.206268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.206277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.206289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:48.206304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256087198374572:3544]
2025-10-01T14:12:48.206308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256087198374572:3544]
2025-10-01T14:12:48.206312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256087198374572:3544]
2025-10-01T14:12:48.206317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:48.206326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:48.206327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:48.206330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:48.206332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:48.206338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:48.206339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:48.206348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272106:2446], now have 1 active actors on pipe
2025-10-01T14:12:48.206350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272220:6417], now have 1 active actors on pipe
2025-10-01T14:12:48.206387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256087198374572:3544]
2025-10-01T14:12:48.206399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:48.206408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:48.206402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1781
2025-10-01T14:12:48.206414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1781
2025-10-01T14:12:48.206498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.206506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.206526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:48.206536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.206542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.206544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:48.206550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.206556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:48.206570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.206733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.206738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.206748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.206825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1782 partition: 0 MaxSeqNo: 45 sessionId: src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0
2025-10-01T14:12:48.207159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6cdd52b5-109355ef-7d95f9b-e15a2419_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:48.209468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0] Write session: try to update token
2025-10-01T14:12:48.209486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:48.222911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1782 sessionId: src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:48.223633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:48.223654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:48.223665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256087198374572:3544]
2025-10-01T14:12:48.223705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:48.223724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:48.223870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:48.224012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:48.224141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:48.224277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:48.224478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:48.224515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:48.225202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:48.225393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.225406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.225435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:48.225519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:48.240924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:48.240947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:48.240949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:48.240951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:48.240959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256087198374572:3544]
2025-10-01T14:12:48.240962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256087198374572:3544]
2025-10-01T14:12:48.240965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256087198374572:3544]
2025-10-01T14:12:48.241002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:48.241010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.241012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:48.241019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:48.241036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:48.241042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:48.241127Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:48.287778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256089575272229:7092]
2025-10-01T14:12:48.288031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1781, pipe: [1:7556256089575272229:7092]
2025-10-01T14:12:48.381483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:48.388000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.388027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.388174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.388229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.388291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.388355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.388396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.388404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.388467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.388519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.388571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.388644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.388706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.388712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.388764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.388815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.388869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.388922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.388960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.388965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.389017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.389066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.389117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.389168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.389212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.389218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.389272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.389321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.389374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.389429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.389467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.389473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.389525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.389578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.389631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.389688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.389731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.389738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.389795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.389847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.389907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.389962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.390026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.390032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.390088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.390139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.390195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.390258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.390297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.390302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.390354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.390420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.390470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.390519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.390561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.390566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.390624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.390673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.390728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.390797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.390834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.390839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.390879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272229:7092], now have 1 active actors on pipe
2025-10-01T14:12:48.391123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:48.391179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:48.391188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:48.391214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1782 reason: error at write: Disconnected sessionId: src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0
2025-10-01T14:12:48.391218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256089575272229:7092]
2025-10-01T14:12:48.391409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1782 sessionId: src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0 is DEAD
2025-10-01T14:12:48.391496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:48.391554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:48.391565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0] Write session will restart in 0.005745s
2025-10-01T14:12:48.391588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0] Write session: Do CDS request
2025-10-01T14:12:48.391594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:48.398752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.398835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:48.398848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1783
2025-10-01T14:12:48.398948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.398983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:48.398992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:48.398994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:48.399394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1783 sessionId:  describe result for acl check
2025-10-01T14:12:48.399433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:48.399440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:48.399441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:48.399446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256089575272320:6413] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:48.399975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256089575272320:6413] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:48.399976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:48.401595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256089575272320:6413] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:48.402469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:48.402646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:48.402655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:48.402664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:48.402701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:48.402739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256087198374692:3538]
2025-10-01T14:12:48.403184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:48.403437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:48.403476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:48.403756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:48.403818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.403825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.403826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.403827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.403829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.403829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.403831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.403832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.403833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.403834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.403835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.403836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.403837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.403838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.403843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.403853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.403856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.403860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.403863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.403866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.403870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.403874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.403877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.403881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.403884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.403887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.403890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.403893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.403900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.403907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.403912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.403928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.403938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.403945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.403949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.403953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.403958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.403963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.403968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.403973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.403978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.403983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.403987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.403992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.404008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.404013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.404018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.404023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.404028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.404033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.404037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.404042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.404047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.404051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.404054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.404059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.404100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:48.404212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256089575272320:6413] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:48.404227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256089575272320:6413] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:48.404230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256089575272320:6413] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:48.404238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:48.407905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:48.408461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:48.408473Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:48.408475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:48.408477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:48.408482Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1782 [2:7556256087198374692:3538]
2025-10-01T14:12:48.408493Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:48.408505Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:48.408506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.408508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.408510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.408522Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:48.408526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:48.408535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:48.408576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.408581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.408583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.408585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:48.408587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:48.408647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:48.408655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.408662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.408668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.408678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:48.408689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256087198374687:3538]
2025-10-01T14:12:48.408693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256087198374687:3538]
2025-10-01T14:12:48.408696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256087198374687:3538]
2025-10-01T14:12:48.408702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:48.408711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:48.408711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:48.408715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:48.408717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:48.408725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:48.408727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:48.408754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272245:2446], now have 1 active actors on pipe
2025-10-01T14:12:48.408760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272358:6413], now have 1 active actors on pipe
2025-10-01T14:12:48.408762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256087198374687:3538]
2025-10-01T14:12:48.408767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:48.408781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:48.408841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1782
2025-10-01T14:12:48.408855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1782
2025-10-01T14:12:48.408894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.408901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.408919Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a732c4f-835450d0-27798a9f-80d38850_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:48.408927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.408930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.408932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:48.408937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.408944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:48.408956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.409194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.409204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.409220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.409313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1783 partition: 0 MaxSeqNo: 45 sessionId: src_id|4a732c4f-835450d0-27798a9f-80d38850_0
2025-10-01T14:12:48.409632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfb9b30d-6e7a90c4-7b68b41a-9a92086_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4a732c4f-835450d0-27798a9f-80d38850_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:48.412053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a732c4f-835450d0-27798a9f-80d38850_0] Write session: try to update token
2025-10-01T14:12:48.412068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a732c4f-835450d0-27798a9f-80d38850_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:48.419658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:48.419681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:48.419690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256087198374687:3538]
2025-10-01T14:12:48.419730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:48.419733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:48.419906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:48.420043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:48.420175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:48.420307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:48.420561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:48.420609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:48.426008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1783 sessionId: src_id|4a732c4f-835450d0-27798a9f-80d38850_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:48.428628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:48.428881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.428906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.428943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:48.429068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:48.438456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:48.438478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:48.438481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:48.438483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:48.438493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256087198374687:3538]
2025-10-01T14:12:48.438497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256087198374687:3538]
2025-10-01T14:12:48.438501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256087198374687:3538]
2025-10-01T14:12:48.438549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:48.438559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:48.438562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.438565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:48.438583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:48.438591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:48.438699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:48.491565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256089575272377:7092]
2025-10-01T14:12:48.491892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1782, pipe: [1:7556256089575272377:7092]
2025-10-01T14:12:48.572260Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:48.578496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.578520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.578651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.578707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.578760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.578810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.578850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.578857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.578910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.578958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.579007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.579056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.579096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.579100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.579155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.579206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.579262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.579317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.579356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.579359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.579415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.579461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.579515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.579568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.579608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.579614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.579667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.579719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.579774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.579824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.579860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.579865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.579921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.579970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.580025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.580078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.580116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.580120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.580174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.580221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.580272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.580325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.580368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.580373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.580438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.580490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.580541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.580594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.580641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.580645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.580701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.580759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.580820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.580887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.580928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.580933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.580989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.581039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.581088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.581143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.581179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.581184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.581222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272377:7092], now have 1 active actors on pipe
2025-10-01T14:12:48.581455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:48.581483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:48.581488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:48.581517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1783 reason: error at write: Disconnected sessionId: src_id|4a732c4f-835450d0-27798a9f-80d38850_0
2025-10-01T14:12:48.581528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256089575272377:7092]
2025-10-01T14:12:48.581712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1783 sessionId: src_id|4a732c4f-835450d0-27798a9f-80d38850_0 is DEAD
2025-10-01T14:12:48.581842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a732c4f-835450d0-27798a9f-80d38850_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:48.581852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a732c4f-835450d0-27798a9f-80d38850_0] Write session will restart in 0.006572s
2025-10-01T14:12:48.581876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a732c4f-835450d0-27798a9f-80d38850_0] Write session: Do CDS request
2025-10-01T14:12:48.581882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a732c4f-835450d0-27798a9f-80d38850_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:48.581974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:48.589806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a732c4f-835450d0-27798a9f-80d38850_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.589946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:48.589961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1784
2025-10-01T14:12:48.590113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.590139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:48.590144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:48.590147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:48.590562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:48.590588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1784 sessionId:  describe result for acl check
2025-10-01T14:12:48.590634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:48.590641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:48.590642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:48.590648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256089575272456:6400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:48.591182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256089575272456:6400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:48.592414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:48.592644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:48.592655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:48.592664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:48.592708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:48.592743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256087198374809:3520]
2025-10-01T14:12:48.593229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:48.593421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:48.593460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:48.593775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:48.593831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.593841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.593842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.593844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.593845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.593847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.593848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.593849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.593851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.593852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.593854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.593855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.593856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.593857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.593896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256089575272456:6400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:48.593862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.593871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.593875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.593879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.593882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.593886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.593889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.593892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.593895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.593899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.593902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.593905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.593909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.593913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.593920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.593928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.593934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.593940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.593945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.593950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.593954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.593959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.593964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.593969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.593974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.593979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.593983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.594002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.594007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.594012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.594017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.594022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.594027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.594032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.594036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.594041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.594059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.594068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.594077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.594086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.594094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.594099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.594142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:48.597444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256089575272456:6400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:48.597455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256089575272456:6400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:48.597457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256089575272456:6400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:48.597464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:48.597638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:48.598292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:48.598306Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:48.598308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:48.598311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:48.598316Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1783 [2:7556256087198374809:3520]
2025-10-01T14:12:48.598327Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:48.598341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:48.598346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.598349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.598351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.598362Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:48.598385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:48.598396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:48.598449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.598455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.598458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.598461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:48.598463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:48.598516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:48.598521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.598528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.598533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.598546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:48.598567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272379:2446], now have 1 active actors on pipe
2025-10-01T14:12:48.598574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272508:6400], now have 1 active actors on pipe
2025-10-01T14:12:48.598580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256087198374803:3520]
2025-10-01T14:12:48.598582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256087198374803:3520]
2025-10-01T14:12:48.598584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256087198374803:3520]
2025-10-01T14:12:48.598596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:48.598604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:48.598607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:48.598609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:48.598610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:48.598623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:48.598630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:48.598620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1783
2025-10-01T14:12:48.598647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1783
2025-10-01T14:12:48.598654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256087198374803:3520]
2025-10-01T14:12:48.598662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:48.598664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:48.598687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.598694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.598722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:48.598732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.598739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.598740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:48.598748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.598760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:48.598779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.598933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.598943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.598962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.599038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1784 partition: 0 MaxSeqNo: 45 sessionId: src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0
2025-10-01T14:12:48.599323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a732c4f-835450d0-27798a9f-80d38850_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:48.601499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0] Write session: try to update token
2025-10-01T14:12:48.601512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:48.613519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1784 sessionId: src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:48.615621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:48.615845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.615870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.615905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:48.615990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:48.619698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:48.619716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:48.619718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:48.619720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:48.619729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256087198374803:3520]
2025-10-01T14:12:48.619733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256087198374803:3520]
2025-10-01T14:12:48.619737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256087198374803:3520]
2025-10-01T14:12:48.619780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:48.619787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:48.619789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:48.619793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.619799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:48.619800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:48.619949Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:48.681507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256089575272526:7092]
2025-10-01T14:12:48.681850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1783, pipe: [1:7556256089575272526:7092]
2025-10-01T14:12:48.757122Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:48.764771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.764794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.764964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.765034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.765102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.765166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.765213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.765221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.765294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.765359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.765427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.765491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.765537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.765543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.765664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.765724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.765784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.765853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.765893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.765899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.765962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.766018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.766080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.766140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.766182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.766188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.766250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.766304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.766360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.766426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.766467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.766473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.766534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.766588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.766647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.766708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.766753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.766758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.766822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.766875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.766932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.766992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.767033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.767038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.767097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.767154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.767210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.767268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.767310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.767316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.767380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.767438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.767500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.767561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.767605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.767612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.767678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:48.767736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:48.767799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:48.767862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:48.767905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:48.767911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:48.767972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272526:7092], now have 1 active actors on pipe
2025-10-01T14:12:48.768265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:48.768272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256089575272526:7092]
2025-10-01T14:12:48.768279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:48.768298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:48.768306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1784 reason: error at write: Disconnected sessionId: src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0
2025-10-01T14:12:48.768483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1784 sessionId: src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0 is DEAD
2025-10-01T14:12:48.768650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:48.768660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0] Write session will restart in 0.007168s
2025-10-01T14:12:48.768686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0] Write session: Do CDS request
2025-10-01T14:12:48.768693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:48.768907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:48.776851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.776978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:48.776995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1785
2025-10-01T14:12:48.777121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.777155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:48.777166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:48.777169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:48.777602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1785 sessionId:  describe result for acl check
2025-10-01T14:12:48.777640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:48.777647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:48.777652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:48.777658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256089575272589:6387] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:48.778235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256089575272589:6387] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:48.779947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:48.780531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256089575272589:6387] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:48.781922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:48.782148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:48.782161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:48.782174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:48.782238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:48.782292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256087198374936:3531]
2025-10-01T14:12:48.782982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:48.783241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:48.783286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:48.783362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256089575272589:6387] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:48.783375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256089575272589:6387] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:48.783379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256089575272589:6387] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:48.783387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:48.783564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:48.783621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.783628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.783629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.783631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.783632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.783633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.783635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.783636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.783638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.783639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.783641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.783642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.783643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.783644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.783650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.783660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.783664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.783668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.783671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.783675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.783678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.783681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.783685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.783688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.783692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.783696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.783699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.783703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.783710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.783716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.783723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.783727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.783736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.783742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.783748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.783753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.783758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.783762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.783767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.783772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.783777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.783782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.783786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.783791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.783795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.783800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.783804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.783809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.783813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.783817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.783821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.783826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.783830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.783834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.783849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.783854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.783890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:48.787621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:48.788326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:48.788339Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:48.788341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:48.788344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:48.788350Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1784 [2:7556256087198374936:3531]
2025-10-01T14:12:48.788362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:48.788376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:48.788383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.788386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.788388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.788399Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:48.788404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:48.788409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:48.788463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.788474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.788476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.788482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:48.788484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:48.788548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:48.788555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.788563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.788569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.788581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:48.788604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272644:6387], now have 1 active actors on pipe
2025-10-01T14:12:48.788614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272528:2446], now have 1 active actors on pipe
2025-10-01T14:12:48.788620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256087198374930:3531]
2025-10-01T14:12:48.788623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256087198374930:3531]
2025-10-01T14:12:48.788625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256087198374930:3531]
2025-10-01T14:12:48.788650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:48.788667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:48.788669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:48.788675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:48.788677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:48.788682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:48.788685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:48.788711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256087198374930:3531]
2025-10-01T14:12:48.788726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:48.788730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:48.788743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1784
2025-10-01T14:12:48.788749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1784
2025-10-01T14:12:48.788807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.788817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.788847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7c2412-291d1732-dd2d4873-d702510a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:48.788859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.788863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.788865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:48.788874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.788890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:48.788909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.789060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.789071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.789084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.789182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1785 partition: 0 MaxSeqNo: 45 sessionId: src_id|a7c2412-291d1732-dd2d4873-d702510a_0
2025-10-01T14:12:48.789596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8369edf9-a13e8ee1-dc2df6b8-176e2a8f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a7c2412-291d1732-dd2d4873-d702510a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:48.791938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c2412-291d1732-dd2d4873-d702510a_0] Write session: try to update token
2025-10-01T14:12:48.791954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c2412-291d1732-dd2d4873-d702510a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:48.805241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1785 sessionId: src_id|a7c2412-291d1732-dd2d4873-d702510a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:48.808815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:48.809764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.809798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.809821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:48.809825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:48.809828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:48.809831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:48.809840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256087198374930:3531]
2025-10-01T14:12:48.809846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256087198374930:3531]
2025-10-01T14:12:48.809851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256087198374930:3531]
2025-10-01T14:12:48.809893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:48.809907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:48.809909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:48.809920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:48.809928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.809931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:48.810094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:48.868439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256089575272656:7092]
2025-10-01T14:12:48.868965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1784, pipe: [1:7556256089575272656:7092]
2025-10-01T14:12:48.951183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:48.951428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:48.951476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272656:7092], now have 1 active actors on pipe
2025-10-01T14:12:48.952039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:48.952350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:48.952354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:48.952430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1785 reason: error at write: Disconnected sessionId: src_id|a7c2412-291d1732-dd2d4873-d702510a_0
2025-10-01T14:12:48.952620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1785 sessionId: src_id|a7c2412-291d1732-dd2d4873-d702510a_0 is DEAD
2025-10-01T14:12:48.952725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256089575272656:7092]
2025-10-01T14:12:48.952746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:48.953028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c2412-291d1732-dd2d4873-d702510a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:48.953038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c2412-291d1732-dd2d4873-d702510a_0] Write session will restart in 0.008113s
2025-10-01T14:12:48.953063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c2412-291d1732-dd2d4873-d702510a_0] Write session: Do CDS request
2025-10-01T14:12:48.953071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c2412-291d1732-dd2d4873-d702510a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:48.961936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c2412-291d1732-dd2d4873-d702510a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.961998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:48.962012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1786
2025-10-01T14:12:48.962152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:48.962187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:48.962197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:48.962200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:48.962620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1786 sessionId:  describe result for acl check
2025-10-01T14:12:48.962666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:48.962674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:48.962676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:48.962681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256089575272676:6381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:48.963189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256089575272676:6381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:48.964884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256089575272676:6381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:48.967692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256089575272676:6381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:48.967707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256089575272676:6381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:48.967711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256089575272676:6381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:48.967719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:48.968134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:48.970093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:48.970290Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:48.970312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:48.970329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:48.970395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:48.970435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256087198375084:3512]
2025-10-01T14:12:48.971053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:48.971450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:48.971500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:48.971800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:48.971873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.971879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.971880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.971881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.971882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.971884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.971885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.971886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.971887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.971888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.971890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.971891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.971892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.971894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.971900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.971910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.971914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.971918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.971922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.971926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.971930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.971934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.971938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.971942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.971946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.971950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.971954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.971958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.971966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.971974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:48.971980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.971985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:48.971989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.971994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:48.972004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.972009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:48.972016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.972021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:48.972025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.972030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:48.972039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.972044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:48.972047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.972053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:48.972061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.972066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:48.972074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.972079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.972087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.972092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.972101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.972110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.972114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.972123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:48.972127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.972136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:48.972175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:48.975874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:48.976511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:48.976525Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:48.976528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:48.976532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:48.976538Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1785 [2:7556256087198375084:3512]
2025-10-01T14:12:48.976554Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:48.976572Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:48.976940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1785
2025-10-01T14:12:48.976576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.976968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1785
2025-10-01T14:12:48.976580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.976582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.976598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:48.976604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:48.976610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:48.976678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.976680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.976682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.976686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:48.976689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:48.976762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:48.976766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:48.976778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:48.976790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:48.976807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:48.976824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272772:6381], now have 1 active actors on pipe
2025-10-01T14:12:48.976829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256089575272661:2446], now have 1 active actors on pipe
2025-10-01T14:12:48.976836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256087198375078:3512]
2025-10-01T14:12:48.976839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256087198375078:3512]
2025-10-01T14:12:48.976841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256087198375078:3512]
2025-10-01T14:12:48.976854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:48.976866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:48.976867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:48.976869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:48.976872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:48.976882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:48.976885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:48.976917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256087198375078:3512]
2025-10-01T14:12:48.976924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:48.976929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:48.977170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.977182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.977212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:48.977224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:48.977232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:48.977235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:48.977244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:48.977257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:48.977277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.977477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:48.977491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:48.977513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:48.977594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1786 partition: 0 MaxSeqNo: 45 sessionId: src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0
2025-10-01T14:12:48.977963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c2412-291d1732-dd2d4873-d702510a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:48.980418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0] Write session: try to update token
2025-10-01T14:12:48.980437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:48.997081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1786 sessionId: src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:48.999548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:49.001607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.001633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.001656Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:49.001659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:49.001661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:49.001664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:49.001673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256087198375078:3512]
2025-10-01T14:12:49.001678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256087198375078:3512]
2025-10-01T14:12:49.001682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256087198375078:3512]
2025-10-01T14:12:49.001743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:49.001752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.001756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:49.001768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:49.001774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:49.001778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:49.001904Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:49.052776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256093870240080:7092]
2025-10-01T14:12:49.053590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1785, pipe: [1:7556256093870240080:7092]
2025-10-01T14:12:49.165386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:49.164846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:49.165209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:49.165277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240080:7092], now have 1 active actors on pipe
2025-10-01T14:12:49.165931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256093870240080:7092]
2025-10-01T14:12:49.165962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:49.177620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:49.177635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0] Write session will restart in 0.005326s
2025-10-01T14:12:49.177229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:49.177244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:49.177268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1786 reason: error at write: Disconnected sessionId: src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0
2025-10-01T14:12:49.177440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1786 sessionId: src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0 is DEAD
2025-10-01T14:12:49.177661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0] Write session: Do CDS request
2025-10-01T14:12:49.177671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:49.178727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:49.184006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:49.184089Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:49.184105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1787
2025-10-01T14:12:49.184267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:49.184301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:49.184310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:49.184315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:49.184845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1787 sessionId:  describe result for acl check
2025-10-01T14:12:49.184889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:49.184895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:49.184896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:49.184902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256093870240165:6378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:49.185511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256093870240165:6378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:49.187190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:49.187440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:49.187452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:49.187464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:49.187524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:49.187565Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256091493342513:3498]
2025-10-01T14:12:49.188513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256093870240165:6378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:49.188150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:49.188467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:49.188516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:49.188822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:49.188899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.188900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.188901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.188903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.188904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.188905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.188907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.188908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.188909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.188910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.188911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.188912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.188914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.188915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.188920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.188930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.188933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.188936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.188939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.188943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.188946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.188950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.188953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.188957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.188960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.188964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.188968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.188971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.188978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.188986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.188992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.188998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.189003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.189008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.189012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.189017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.189023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.189028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.189032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.189036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.189042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.189046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.189050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.189055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.189059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.189064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.189068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.189073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.189077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.189081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.189085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.189089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.189093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.189098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.189104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.189109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.189143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:49.193939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256093870240165:6378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:49.193958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256093870240165:6378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:49.193961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256093870240165:6378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:49.193970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:49.194850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:49.195489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:49.195505Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:49.195508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:49.195513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:49.195520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1786 [2:7556256091493342513:3498]
2025-10-01T14:12:49.195943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1786
2025-10-01T14:12:49.195970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1786
2025-10-01T14:12:49.195540Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:49.195567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:49.195571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:49.195575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:49.195578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:49.195596Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:49.195603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:49.195611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:49.195676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.195679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.195681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.195684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:49.195687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:49.195760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:49.195763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.195778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.195790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.195807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:49.195826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240203:6378], now have 1 active actors on pipe
2025-10-01T14:12:49.195834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256091493342507:3498]
2025-10-01T14:12:49.195836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256091493342507:3498]
2025-10-01T14:12:49.195838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256091493342507:3498]
2025-10-01T14:12:49.195853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:49.195863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240083:2446], now have 1 active actors on pipe
2025-10-01T14:12:49.195868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:49.195872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:49.195872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:49.195875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:49.195886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:49.195890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:49.195928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256091493342507:3498]
2025-10-01T14:12:49.195936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:49.195947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:49.195991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.195996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.196020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:49.196027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:49.196031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:49.196033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:49.196043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:49.196052Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:49.196072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:49.196274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.196283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.196298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:49.196365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1787 partition: 0 MaxSeqNo: 45 sessionId: src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0
2025-10-01T14:12:49.196796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f2f5e30-8e262d1b-8bf4e99d-746b924_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:49.199515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0] Write session: try to update token
2025-10-01T14:12:49.199538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:49.209027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:49.209045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:49.209054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256091493342507:3498]
2025-10-01T14:12:49.209098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:49.209108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:49.209267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:49.209396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:49.209524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:49.209657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:49.209855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:49.209888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:49.215036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1787 sessionId: src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:49.217661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:49.218490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.218509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.218546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:49.218679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:49.232925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:49.232943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:49.232946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:49.232948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:49.232960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256091493342507:3498]
2025-10-01T14:12:49.232968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256091493342507:3498]
2025-10-01T14:12:49.232972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256091493342507:3498]
2025-10-01T14:12:49.233021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:49.233028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.233031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:49.233037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:49.233044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:49.233049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:49.233175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:49.266231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256093870240210:7092]
2025-10-01T14:12:49.266602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1786, pipe: [1:7556256093870240210:7092]
2025-10-01T14:12:49.396317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:49.404588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.404613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.404802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.404866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.404930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.404995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.405039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.405049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.405116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.405172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.405231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.405295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.405344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.405351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.405417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.405476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.405541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.405605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.405647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.405654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.405720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.405783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.405842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.405906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.405953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.405962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.406021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.406079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.406137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.406199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.406241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.406247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.406308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.406364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.406440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.406498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.406536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.406543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.406604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.406663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.406722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.406783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.406829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.406837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.406897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.406952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.407009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.407067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.407110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.407116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.407175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.407231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.407288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.407344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.407387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.407393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.407451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.407514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.407569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.407625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.407665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.407671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.407729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240210:7092], now have 1 active actors on pipe
2025-10-01T14:12:49.407916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:49.407951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256093870240210:7092]
2025-10-01T14:12:49.407979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:49.407981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:49.408009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1787 reason: error at write: Disconnected sessionId: src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0
2025-10-01T14:12:49.408233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1787 sessionId: src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0 is DEAD
2025-10-01T14:12:49.408386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:49.408396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0] Write session will restart in 0.007903s
2025-10-01T14:12:49.408423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0] Write session: Do CDS request
2025-10-01T14:12:49.408430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:49.408757Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:49.418026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:49.418112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:49.418127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1788
2025-10-01T14:12:49.418220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:49.418252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:49.418262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:49.418265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:49.418776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1788 sessionId:  describe result for acl check
2025-10-01T14:12:49.418823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:49.418829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:49.418830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:49.418836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256093870240306:6371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:49.419392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256093870240306:6371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:49.420888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:49.421510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256093870240306:6371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:49.422910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:49.423077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:49.423086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:49.423097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:49.423134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:49.423173Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256091493342633:3507]
2025-10-01T14:12:49.423808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:49.424038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:49.424071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:49.424106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256093870240306:6371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:49.424123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256093870240306:6371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:49.424127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256093870240306:6371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:49.424136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:49.424362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:49.424424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.424425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.424426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.424427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.424428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.424429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.424430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.424432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.424433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.424434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.424435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.424436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.424437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.424438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.424442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.424452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.424455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.424459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.424463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.424466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.424470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.424473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.424476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.424480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.424484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.424487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.424490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.424494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.424500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.424507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.424513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.424519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.424523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.424527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.424531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.424535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.424539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.424543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.424547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.424551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.424555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.424559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.424563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.424568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.424573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.424578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.424582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.424586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.424590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.424594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.424598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.424603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.424606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.424611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.424615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.424620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.424665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:49.429250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:49.429862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:49.429875Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:49.429879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:49.429883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:49.429890Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1787 [2:7556256091493342633:3507]
2025-10-01T14:12:49.429906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:49.429927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:49.429935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:49.429939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:49.429941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:49.429958Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:49.429968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:49.429975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:49.430042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.430048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.430052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.430056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:49.430059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:49.430131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:49.430139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.430150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.430161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.430177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:49.430201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240347:6371], now have 1 active actors on pipe
2025-10-01T14:12:49.430209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240225:2446], now have 1 active actors on pipe
2025-10-01T14:12:49.430216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256091493342628:3507]
2025-10-01T14:12:49.430219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256091493342628:3507]
2025-10-01T14:12:49.430221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256091493342628:3507]
2025-10-01T14:12:49.430237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:49.430256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:49.430265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:49.430276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:49.430276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:49.430280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:49.430281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:49.430315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256091493342628:3507]
2025-10-01T14:12:49.430325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:49.430334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:49.430318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1787
2025-10-01T14:12:49.430322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1787
2025-10-01T14:12:49.430407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.430417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.430440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cbc0828-87709c45-19f698c2-4715b34c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:49.430450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:49.430454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:49.430456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:49.430465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:49.430476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:49.430494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:49.430630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.430638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.430650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:49.430731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1788 partition: 0 MaxSeqNo: 45 sessionId: src_id|7cbc0828-87709c45-19f698c2-4715b34c_0
2025-10-01T14:12:49.431106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|306b14bb-b47b2ee2-be76ee15-663ecbac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7cbc0828-87709c45-19f698c2-4715b34c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:49.433693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbc0828-87709c45-19f698c2-4715b34c_0] Write session: try to update token
2025-10-01T14:12:49.433709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbc0828-87709c45-19f698c2-4715b34c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:49.443707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:49.443728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:49.443739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256091493342628:3507]
2025-10-01T14:12:49.443787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:49.443795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:49.443962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:49.444112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:49.444249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:49.444391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:49.444579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:49.444617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:49.448438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1788 sessionId: src_id|7cbc0828-87709c45-19f698c2-4715b34c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:49.450772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:49.451031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.451060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.451103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:49.451208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:49.466735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:49.466754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:49.466757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:49.466760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:49.466770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256091493342628:3507]
2025-10-01T14:12:49.466775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256091493342628:3507]
2025-10-01T14:12:49.466779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256091493342628:3507]
2025-10-01T14:12:49.466829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:49.466837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.466840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:49.466840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:49.466848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:49.466852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:49.466984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:49.507919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256093870240362:7092]
2025-10-01T14:12:49.508246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1787, pipe: [1:7556256093870240362:7092]
2025-10-01T14:12:49.623517Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:49.631814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.631841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.632012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.632076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.632141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.632209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.632253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.632262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.632332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.632401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.632469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.632533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.632579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.632587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.632661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.632721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.632784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.632845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.632886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.632892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.632954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.633017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.633082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.633147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.633195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.633202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.633270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.633329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.633387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.633449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.633489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.633496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.633581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.633686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.633799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.633904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.633968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.633978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.634070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.634140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.634214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.634289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.634338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.634346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.634433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.634503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.634573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.634643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.634688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.634695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.634766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.634832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.634904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.634973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.635022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.635032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.635108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.635176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.635245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.635316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.635364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.635370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.635440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240362:7092], now have 1 active actors on pipe
2025-10-01T14:12:49.635726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:49.635845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256093870240362:7092]
2025-10-01T14:12:49.635898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:49.635927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:49.635992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1788 reason: error at write: Disconnected sessionId: src_id|7cbc0828-87709c45-19f698c2-4715b34c_0
2025-10-01T14:12:49.636226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1788 sessionId: src_id|7cbc0828-87709c45-19f698c2-4715b34c_0 is DEAD
2025-10-01T14:12:49.636658Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:49.637310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbc0828-87709c45-19f698c2-4715b34c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:49.637321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbc0828-87709c45-19f698c2-4715b34c_0] Write session will restart in 0.005231s
2025-10-01T14:12:49.637340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbc0828-87709c45-19f698c2-4715b34c_0] Write session: Do CDS request
2025-10-01T14:12:49.637345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbc0828-87709c45-19f698c2-4715b34c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:49.643894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbc0828-87709c45-19f698c2-4715b34c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:49.643998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:49.644017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1789
2025-10-01T14:12:49.644155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:49.644187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:49.644197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:49.644201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:49.644707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1789 sessionId:  describe result for acl check
2025-10-01T14:12:49.644745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:49.644756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:49.644758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:49.644764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256093870240414:6357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:49.645380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256093870240414:6357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:49.648145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256093870240414:6357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:49.649394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:49.651270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:49.651447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:49.651458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:49.651468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:49.651510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:49.651552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256091493342758:3504]
2025-10-01T14:12:49.651663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256093870240414:6357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:49.651682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256093870240414:6357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:49.651685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256093870240414:6357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:49.651692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:49.652160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:49.652444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:49.652475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:49.652770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:49.652818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.652825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.652826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.652827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.652828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.652829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.652830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.652831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.652832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.652833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.652834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.652835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.652836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.652837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.652841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.652850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.652854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.652858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.652861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.652865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.652868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.652872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.652875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.652879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.652882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.652885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.652888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.652891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.652899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.652906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.652911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.652923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.652930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.652935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.652942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.652946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.652954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.652958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.652966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.652972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.652980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.652988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.652995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.653000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.653008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.653012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.653020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.653024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.653032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.653038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.653046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.653050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.653057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.653065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.653069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.653077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.653112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:49.658045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:49.658665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:49.658678Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:49.658681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:49.658684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:49.658690Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1788 [2:7556256091493342758:3504]
2025-10-01T14:12:49.658706Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:49.658723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:49.658731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:49.658734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:49.658737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:49.658753Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:49.658763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:49.658770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:49.658824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.658830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.658834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.658837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:49.658839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:49.658905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:49.658911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.658922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.658931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.658949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:49.658967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256091493342753:3504]
2025-10-01T14:12:49.658973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256091493342753:3504]
2025-10-01T14:12:49.658975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256091493342753:3504]
2025-10-01T14:12:49.658985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:49.658998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:49.659004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240496:6357], now have 1 active actors on pipe
2025-10-01T14:12:49.659010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:49.659014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:49.659016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:49.659022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:49.659024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:49.659030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240379:2446], now have 1 active actors on pipe
2025-10-01T14:12:49.659054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256091493342753:3504]
2025-10-01T14:12:49.659066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:49.659094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:49.659070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1788
2025-10-01T14:12:49.659125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1788
2025-10-01T14:12:49.659226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.659235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.659259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:49.659269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:49.659273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:49.659277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:49.659286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:49.659294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:49.659306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:49.659547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.659555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.659568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:49.659659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1789 partition: 0 MaxSeqNo: 45 sessionId: src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0
2025-10-01T14:12:49.660111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cbc0828-87709c45-19f698c2-4715b34c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:49.662704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0] Write session: try to update token
2025-10-01T14:12:49.662720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:49.676681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1789 sessionId: src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:49.679891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:49.680146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.680170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.680208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:49.680330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:49.684264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:49.684281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:49.684283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:49.684284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:49.684291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256091493342753:3504]
2025-10-01T14:12:49.684295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256091493342753:3504]
2025-10-01T14:12:49.684297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256091493342753:3504]
2025-10-01T14:12:49.684338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:49.684344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.684345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:49.684346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:49.684352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:49.684355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:49.684478Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:49.736236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256093870240517:7092]
2025-10-01T14:12:49.736554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1788, pipe: [1:7556256093870240517:7092]
2025-10-01T14:12:49.821691Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:49.828905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.828930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.829076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.829136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.829191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.829252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.829293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.829300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.829365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.829423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.829484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.829556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.829603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.829609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.829660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.829710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.829761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.829812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.829867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.829871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.829926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.829982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.830050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.830101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.830190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.830196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.830249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.830304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.830354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.830461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.830504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.830509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.830565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.830615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.830670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.830726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.830771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.830779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.830843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.830894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.830968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.831019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.831059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.831065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.831120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.831175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.831228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.831281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.831324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.831329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.831385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.831440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.831493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.831548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.831587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.831592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.831650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:49.831722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:49.831780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:49.831834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:49.831872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:49.831877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:49.831916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240517:7092], now have 1 active actors on pipe
2025-10-01T14:12:49.832104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256093870240517:7092]
2025-10-01T14:12:49.832105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:49.832108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:49.832139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1789 reason: error at write: Disconnected sessionId: src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0
2025-10-01T14:12:49.832142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:49.832319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1789 sessionId: src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0 is DEAD
2025-10-01T14:12:49.832462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:49.832474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0] Write session will restart in 0.006774s
2025-10-01T14:12:49.832505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0] Write session: Do CDS request
2025-10-01T14:12:49.832511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:49.832605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:49.840858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:49.840886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:49.840945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:49.840963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1790
2025-10-01T14:12:49.841072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:49.841106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:49.841117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:49.841120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:49.841438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1790 sessionId:  describe result for acl check
2025-10-01T14:12:49.841463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:49.841467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:49.841468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:49.841471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256093870240603:6349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:49.841841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256093870240603:6349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:49.842445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:49.842570Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:49.842578Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:49.842586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:49.842614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:49.842640Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256091493342886:3501]
2025-10-01T14:12:49.843011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:49.843214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:49.843244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:49.843474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:49.843510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.843514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.843515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.843516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.843516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.843517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.843517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.843518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.843518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.843519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.843520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.843520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.843521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.843521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.843524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.843529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.843531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.843533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.843535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.843538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.843540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.843542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.843544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.843546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.843548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.843550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.843552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.843554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.843558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.843563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:49.843567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.843570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:49.843572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.843575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:49.843577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.843579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:49.843581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.843584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:49.843586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.843590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:49.843593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.843596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:49.843601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.843604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:49.843606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.843609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:49.843611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.843613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.843615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.843618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.843620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.843623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.843625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.843627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:49.843629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.843632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:49.843650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:49.844155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256093870240603:6349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:49.846883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256093870240603:6349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:49.846892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256093870240603:6349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:49.846901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256093870240603:6349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:49.846906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:49.847028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:49.847584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:49.847596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:49.847598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:49.847601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:49.847607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1789 [2:7556256091493342886:3501]
2025-10-01T14:12:49.847620Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:49.847633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:49.847640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:49.847643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:49.847645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:49.847659Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:49.847667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:49.847676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:49.847712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.847717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.847719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.847720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:49.847722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:49.847782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:49.847788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.847799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:49.847810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:49.847828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:49.847846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240643:6349], now have 1 active actors on pipe
2025-10-01T14:12:49.847853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240520:2446], now have 1 active actors on pipe
2025-10-01T14:12:49.847860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1789
2025-10-01T14:12:49.847859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256091493342881:3501]
2025-10-01T14:12:49.847865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1789
2025-10-01T14:12:49.847867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256091493342881:3501]
2025-10-01T14:12:49.847868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256091493342881:3501]
2025-10-01T14:12:49.847880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:49.847891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:49.847893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:49.847898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:49.847899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:49.847904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:49.847908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:49.847927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256091493342881:3501]
2025-10-01T14:12:49.847934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:49.847941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:49.847950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.847957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.847993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:49.848003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:49.848011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:49.848013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:49.848020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:49.848032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:49.848051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:49.848160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.848167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.848179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:49.848243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1790 partition: 0 MaxSeqNo: 45 sessionId: src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0
2025-10-01T14:12:49.848531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f7393bd-f7ea6e43-f221575a-45b57c15_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:49.850757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0] Write session: try to update token
2025-10-01T14:12:49.850770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:49.863181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1790 sessionId: src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:49.865465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:49.865577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:49.865596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:49.867523Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:49.867539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:49.867541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:49.867543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:49.867553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256091493342881:3501]
2025-10-01T14:12:49.867558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256091493342881:3501]
2025-10-01T14:12:49.867562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256091493342881:3501]
2025-10-01T14:12:49.867598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:49.867608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:49.867608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:49.867611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:49.867629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:49.867638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:49.867644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:49.867671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:49.867789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:49.932371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256093870240652:7092]
2025-10-01T14:12:49.932688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1789, pipe: [1:7556256093870240652:7092]
2025-10-01T14:12:50.018718Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:50.031456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.031484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.031712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.031776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.031838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.031901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.031949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.031961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.032030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.032095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.032155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.032220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.032263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.032276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.032340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.032393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.032450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.032508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.032548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.032557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.032617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.032683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.032737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.032794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.032836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.032843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.032902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.032958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.033013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.033069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.033116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.033123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.033185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.033243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.033305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.033368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.033413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.033420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.033485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.033541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.033601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.033661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.033703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.033712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.033771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.033827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.033888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.033951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.033998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.034005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.034068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.034126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.034184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.034245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.034290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.034296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.034362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.034435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.034495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.034553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.034596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.034603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.034666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256093870240652:7092], now have 1 active actors on pipe
2025-10-01T14:12:50.034869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256093870240652:7092]
2025-10-01T14:12:50.034870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:50.034873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:50.034898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1790 reason: error at write: Disconnected sessionId: src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0
2025-10-01T14:12:50.034900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:50.035076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1790 sessionId: src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0 is DEAD
2025-10-01T14:12:50.035216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:50.035225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0] Write session will restart in 0.007591s
2025-10-01T14:12:50.035253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0] Write session: Do CDS request
2025-10-01T14:12:50.035259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:50.035778Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:50.043530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:50.043878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.043966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:50.043981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1791
2025-10-01T14:12:50.044090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.044131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:50.044143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:50.044146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:50.044531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1791 sessionId:  describe result for acl check
2025-10-01T14:12:50.044561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:50.044567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:50.044568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:50.044573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256098165208036:6343] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:50.044979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:50.045159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:50.045170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:50.045167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256098165208036:6343] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:50.045182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:50.045230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:50.045266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256095788310336:3481]
2025-10-01T14:12:50.045836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:50.046056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:50.046095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:50.046413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:50.046464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.046469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.046470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.046471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.046472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.046474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.046475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.046476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.046477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.046478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.046479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.046480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.046481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.046482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.046487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.046496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.046501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.046505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.046509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.046513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.046517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.046521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.046525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.046528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.046531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.046534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.046537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.046540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.046547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.046555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.046561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.046568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.046577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.046582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.046590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.046595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.046599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.046608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.046613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.046617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.046628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.046639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.046644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.046648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.046652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.046657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.046661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.046666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.046670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.046675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.046679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.046683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.046687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.046692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.046696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.046701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.046743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:50.047666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256098165208036:6343] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:50.050086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256098165208036:6343] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:50.050097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256098165208036:6343] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:50.050101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256098165208036:6343] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:50.050108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:50.050333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:50.050944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:50.050959Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:50.050961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:50.050964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:50.050970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1790 [2:7556256095788310336:3481]
2025-10-01T14:12:50.050985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:50.051003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:50.051010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.051013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.051015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.051032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:50.051041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:50.051047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:50.051100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.051106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.051108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.051111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:50.051113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:50.051173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:50.051180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.051191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.051206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.051225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:50.051246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165207951:2446], now have 1 active actors on pipe
2025-10-01T14:12:50.051254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208075:6343], now have 1 active actors on pipe
2025-10-01T14:12:50.051260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256095788310331:3481]
2025-10-01T14:12:50.051266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256095788310331:3481]
2025-10-01T14:12:50.051268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256095788310331:3481]
2025-10-01T14:12:50.051287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:50.051277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1790
2025-10-01T14:12:50.051286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1790
2025-10-01T14:12:50.051302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:50.051304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:50.051311Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:50.051313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:50.051319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:50.051322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:50.051356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.051364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.051376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256095788310331:3481]
2025-10-01T14:12:50.051388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:50.051396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:50.051413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:50.051423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.051426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.051432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:50.051439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.051450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:50.051475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.051614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.051621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.051634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.052221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1791 partition: 0 MaxSeqNo: 45 sessionId: src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0
2025-10-01T14:12:50.052508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7ef0042-e02bb131-c2a252f7-f6446d59_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:50.057739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0] Write session: try to update token
2025-10-01T14:12:50.057755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:50.070706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1791 sessionId: src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:50.072927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:50.073654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.073679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.073699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:50.073703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:50.073705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:50.073707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:50.073715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256095788310331:3481]
2025-10-01T14:12:50.073719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256095788310331:3481]
2025-10-01T14:12:50.073723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256095788310331:3481]
2025-10-01T14:12:50.073762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:50.073773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:50.073776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:50.073777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:50.073784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.073786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:50.073926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:50.135057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256098165208083:7092]
2025-10-01T14:12:50.135267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1790, pipe: [1:7556256098165208083:7092]
2025-10-01T14:12:50.215122Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:50.215331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:50.215376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208083:7092], now have 1 active actors on pipe
2025-10-01T14:12:50.215451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:50.215547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:50.215598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256098165208083:7092]
2025-10-01T14:12:50.224236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:50.225619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:50.225631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:50.225653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1791 reason: error at write: Disconnected sessionId: src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0
2025-10-01T14:12:50.225811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1791 sessionId: src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0 is DEAD
2025-10-01T14:12:50.225948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:50.225958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0] Write session will restart in 0.009641s
2025-10-01T14:12:50.225982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0] Write session: Do CDS request
2025-10-01T14:12:50.225987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:50.230704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:50.230940Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:50.230951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:50.230963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:50.231016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:50.231054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256095788310473:3477]
2025-10-01T14:12:50.231658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:50.231938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:50.231982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:50.232282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:50.232341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.232348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.232349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.232350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.232352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.232353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.232354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.232355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.232356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.232358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.232359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.232361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.232362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.232363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.232367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.232377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.232381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.232384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.232388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.232391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.232395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.232398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.232402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.232405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.232409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.232412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.232416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.232419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.232427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.232434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.232439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.232444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.232449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.232455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.232459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.232464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.232469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.232474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.232479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.232483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.232488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.232493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.232498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.232503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.232510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.232516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.232520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.232525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.232529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.232535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.232539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.232544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.232549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.232555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.232559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.232567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.232608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:50.236836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.236848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:50.236940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:50.236952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1792
2025-10-01T14:12:50.237070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.237099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:50.237104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:50.237107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:50.237453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:50.237470Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:50.237472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:50.237476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:50.237482Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1791 [2:7556256095788310473:3477]
2025-10-01T14:12:50.237488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1792 sessionId:  describe result for acl check
2025-10-01T14:12:50.237497Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:50.237517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:50.237518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:50.237524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:50.237525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:50.237521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.237530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256098165208176:6339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:50.237525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.237527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.237542Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:50.237547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:50.237555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:50.237606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.237613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.237614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.237617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:50.237620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:50.237684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:50.237694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.237704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.237714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.237729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:50.237750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208085:2446], now have 1 active actors on pipe
2025-10-01T14:12:50.237761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256095788310467:3477]
2025-10-01T14:12:50.237767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256095788310467:3477]
2025-10-01T14:12:50.237769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256095788310467:3477]
2025-10-01T14:12:50.237779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:50.237794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:50.237791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1791
2025-10-01T14:12:50.237795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:50.237801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:50.237803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:50.237807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:50.237809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:50.237837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256095788310467:3477]
2025-10-01T14:12:50.237844Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:50.237851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:50.238002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256098165208176:6339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:50.239930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256098165208176:6339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:50.246560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256098165208176:6339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:50.246575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256098165208176:6339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:50.246579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256098165208176:6339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:50.246586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:50.246811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208214:6339], now have 1 active actors on pipe
2025-10-01T14:12:50.246872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1791
2025-10-01T14:12:50.246950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.246966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.246994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:50.247011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.247022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.247025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:50.247037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.247056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:50.247080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.247220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.247227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.247240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.247554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1792 partition: 0 MaxSeqNo: 45 sessionId: src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0
2025-10-01T14:12:50.247896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1fb5bd03-f35dd93d-e65dc08f-6f91b07e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:50.250250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0] Write session: try to update token
2025-10-01T14:12:50.250265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:50.258687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:50.258707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:50.258709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:50.258712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:50.258722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256095788310467:3477]
2025-10-01T14:12:50.258727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256095788310467:3477]
2025-10-01T14:12:50.258730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256095788310467:3477]
2025-10-01T14:12:50.258785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:50.258788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:50.258794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:50.258797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.258798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:50.258800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:50.258929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:50.263668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1792 sessionId: src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:50.265912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:50.315815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256098165208218:7092]
2025-10-01T14:12:50.316050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1791, pipe: [1:7556256098165208218:7092]
2025-10-01T14:12:50.400302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:50.400542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.400554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.400588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208218:7092], now have 1 active actors on pipe
2025-10-01T14:12:50.400754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:50.400867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:50.400886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:50.400915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256098165208218:7092]
2025-10-01T14:12:50.400957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1792 reason: status is not ok: tablet will be restarted right now sessionId: src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0
2025-10-01T14:12:50.401144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1792 sessionId: src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0 is DEAD
2025-10-01T14:12:50.401262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:50.401271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0] Write session will restart in 0.006921s
2025-10-01T14:12:50.401292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0] Write session: Do CDS request
2025-10-01T14:12:50.401297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:50.408821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.408976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:50.408990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1793
2025-10-01T14:12:50.409094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.409123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:50.409132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:50.409135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:50.409381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:50.409487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1793 sessionId:  describe result for acl check
2025-10-01T14:12:50.409512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:50.409518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:50.409520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:50.409524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256098165208318:6333] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:50.410041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256098165208318:6333] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:50.410974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:50.411123Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:50.411132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:50.411142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:50.411185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:50.411217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256095788310597:3472]
2025-10-01T14:12:50.411613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:50.411702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256098165208318:6333] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:50.411811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:50.411841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:50.412032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:50.412065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.412070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.412070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.412071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.412071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.412072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.412073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.412074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.412075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.412075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.412076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.412076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.412077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.412078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.412081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.412086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.412088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.412090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.412093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.412095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.412097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.412099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.412101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.412103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.412105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.412107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.412109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.412111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.412115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.412120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.412124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.412128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.412130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.412133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.412135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.412137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.412140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.412143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.412145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.412148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.412151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.412154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.412156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.412159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.412161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.412165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.412167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.412170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.412173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.412176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.412178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.412181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.412183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.412186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.412188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.412191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.412209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:50.415614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256098165208318:6333] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:50.415625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256098165208318:6333] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:50.415627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256098165208318:6333] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:50.415633Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:50.415862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:50.416403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:50.416412Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:50.416414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:50.416416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:50.416421Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1792 [2:7556256095788310597:3472]
2025-10-01T14:12:50.416430Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:50.416442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:50.416446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.416448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.416449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.416460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:50.416463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:50.416467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:50.416512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.416518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.416520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.416523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:50.416525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:50.416571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:50.416576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.416582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.416587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.416599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:50.416616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208231:2446], now have 1 active actors on pipe
2025-10-01T14:12:50.416623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208358:6333], now have 1 active actors on pipe
2025-10-01T14:12:50.416639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256095788310592:3472]
2025-10-01T14:12:50.416644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256095788310592:3472]
2025-10-01T14:12:50.416647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256095788310592:3472]
2025-10-01T14:12:50.416659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:50.416672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:50.416673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:50.416681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:50.416682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:50.416683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:50.416684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:50.416685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1792
2025-10-01T14:12:50.416692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1792
2025-10-01T14:12:50.416707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256095788310592:3472]
2025-10-01T14:12:50.416715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:50.416716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:50.416743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.416751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.416779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:50.416789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.416797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.416799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:50.416806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.416814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:50.416830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.416933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.416940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.416951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.417036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1793 partition: 0 MaxSeqNo: 45 sessionId: src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0
2025-10-01T14:12:50.417381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a46181-b98a5ed9-88218bfd-a00bbe20_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:50.419620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0] Write session: try to update token
2025-10-01T14:12:50.419635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:50.433660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1793 sessionId: src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:50.435873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:50.436774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.436794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.436812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:50.436816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:50.436818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:50.436823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:50.436831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256095788310592:3472]
2025-10-01T14:12:50.436836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256095788310592:3472]
2025-10-01T14:12:50.436840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256095788310592:3472]
2025-10-01T14:12:50.436877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:50.436887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:50.436889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:50.436890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:50.436894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.436896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:50.437019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:50.501172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256098165208374:7092]
2025-10-01T14:12:50.501388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1792, pipe: [1:7556256098165208374:7092]
2025-10-01T14:12:50.572394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:50.572606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:50.572672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208374:7092], now have 1 active actors on pipe
2025-10-01T14:12:50.572744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:50.572847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:50.572895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256098165208374:7092]
2025-10-01T14:12:50.580301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:50.581717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:50.581853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:50.581860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:50.581869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:50.581900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:50.581925Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256095788310723:3466]
2025-10-01T14:12:50.582308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:50.582339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:50.582319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:50.582336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1793 reason: error at write: Disconnected sessionId: src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0
2025-10-01T14:12:50.582489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1793 sessionId: src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0 is DEAD
2025-10-01T14:12:50.582608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:50.582617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0] Write session will restart in 0.005864s
2025-10-01T14:12:50.582640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0] Write session: Do CDS request
2025-10-01T14:12:50.582645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:50.587423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:50.587465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:50.587701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:50.587735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.587739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.587739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.587740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.587741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.587741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.587742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.587743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.587743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.587744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.587745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.587745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.587746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.587747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.587751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.587756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.587759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.587761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.587763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.587766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.587768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.587770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.587772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.587774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.587776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.587778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.587781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.587783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.587789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.587794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.587798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.587802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.587805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.587808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.587810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.587813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.587815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.587818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.587821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.587823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.587826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.587829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.587831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.587834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.587836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.587839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.587841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.587844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.587846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.587849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.587851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.587854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.587857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.587860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.587862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.587865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.587886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:50.589795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.589877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:50.589898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1794
2025-10-01T14:12:50.589975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.590002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:50.590011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:50.590013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:50.590395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1794 sessionId:  describe result for acl check
2025-10-01T14:12:50.590421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:50.590423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:50.590424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:50.590428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256098165208469:6324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:50.590886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256098165208469:6324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:50.591668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:50.592188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:50.592198Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:50.592199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:50.592201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:50.592206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1793 [2:7556256095788310723:3466]
2025-10-01T14:12:50.592215Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:50.592225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:50.592230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.592233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.592234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.592243Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:50.592247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:50.592250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:50.592284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.592289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.592291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.592293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:50.592295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:50.592339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:50.592344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.592351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.592356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.592365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:50.592380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208375:2446], now have 1 active actors on pipe
2025-10-01T14:12:50.592388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256095788310718:3466]
2025-10-01T14:12:50.592389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256095788310718:3466]
2025-10-01T14:12:50.592390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256095788310718:3466]
2025-10-01T14:12:50.592399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:50.592411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:50.592414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:50.592417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:50.592419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:50.592422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:50.592424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:50.592408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1793
2025-10-01T14:12:50.592440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256095788310718:3466]
2025-10-01T14:12:50.592447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:50.592453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:50.592569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256098165208469:6324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:50.597210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256098165208469:6324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:50.597223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256098165208469:6324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:50.597226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256098165208469:6324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:50.597233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:50.597454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208507:6324], now have 1 active actors on pipe
2025-10-01T14:12:50.597506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1793
2025-10-01T14:12:50.597559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.597570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.597590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:50.597602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.597608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.597610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:50.597618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.597631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:50.597648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.597790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.597802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.597823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.598239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1794 partition: 0 MaxSeqNo: 45 sessionId: src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0
2025-10-01T14:12:50.598524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f0b769-5dc20d7f-b7180a85-2cfa73f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:50.600782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0] Write session: try to update token
2025-10-01T14:12:50.600794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:50.603415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:50.603429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:50.603436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256095788310718:3466]
2025-10-01T14:12:50.603467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:50.603470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:50.603626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:50.603754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:50.603885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:50.604018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:50.604211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:50.604251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:50.612933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1794 sessionId: src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:50.615087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:50.615247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.615267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.615302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:50.615380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:50.622963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:50.622977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:50.622980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:50.622981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:50.622990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256095788310718:3466]
2025-10-01T14:12:50.622994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256095788310718:3466]
2025-10-01T14:12:50.622997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256095788310718:3466]
2025-10-01T14:12:50.623029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:50.623034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:50.623038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:50.623040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.623040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:50.623044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:50.623153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:50.673160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256098165208524:7092]
2025-10-01T14:12:50.673438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1793, pipe: [1:7556256098165208524:7092]
2025-10-01T14:12:50.754365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:50.761088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.761109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.761242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.761291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.761343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.761393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.761431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.761438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.761495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.761544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.761596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.761648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.761692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.761700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.761763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.761814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.761868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.761931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.762019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.762024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.762082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.762133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.762194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.762255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.762294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.762299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.762354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.762418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.762473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.762526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.762566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.762572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.762627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.762678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.762735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.762803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.762845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.762851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.762908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.762960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.763042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.763116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.763158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.763164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.763225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.763280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.763339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.763397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.763439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.763445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.763506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.763568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.763628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.763697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.763743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.763750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.763813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:50.763867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:50.763923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:50.763973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:50.764009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:50.764014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:50.764050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208524:7092], now have 1 active actors on pipe
2025-10-01T14:12:50.764302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:50.764311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:50.764316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:50.764353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256098165208524:7092]
2025-10-01T14:12:50.764357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1794 reason: error at write: Disconnected sessionId: src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0
2025-10-01T14:12:50.764540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1794 sessionId: src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0 is DEAD
2025-10-01T14:12:50.764695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:50.764706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0] Write session will restart in 0.007916s
2025-10-01T14:12:50.764732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0] Write session: Do CDS request
2025-10-01T14:12:50.764738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:50.764760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:50.773448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:50.773866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.773947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:50.773960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1795
2025-10-01T14:12:50.774080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.774113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:50.774123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:50.774126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:50.774449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1795 sessionId:  describe result for acl check
2025-10-01T14:12:50.774475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:50.774480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:50.774481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:50.774485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256098165208625:6306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:50.774905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256098165208625:6306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:50.775364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:50.775540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:50.775550Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:50.775561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:50.775608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:50.775636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256095788310859:3455]
2025-10-01T14:12:50.776000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:50.776240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:50.776273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:50.776461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:50.776492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.776496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.776496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.776497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.776498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.776498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.776499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.776499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.776500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.776500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.776501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.776502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.776502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.776503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.776506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.776511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.776513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.776516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.776518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.776520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.776522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.776524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.776526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.776529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.776532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.776535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.776539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.776542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.776547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.776576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256098165208625:6306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:50.776553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.776559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.776564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.776566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.776569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.776571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.776573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.776576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.776579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.776582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.776584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.776587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.776590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.776592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.776595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.776598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.776601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.776604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.776606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.776609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.776611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.776613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.776616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.776618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.776621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.776623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.776625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.776655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:50.778121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:12:50.778139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 13
2025-10-01T14:12:50.779602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256098165208625:6306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:50.779613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256098165208625:6306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:50.779615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256098165208625:6306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:50.779620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:50.779802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:50.780355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:50.780365Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:50.780366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:50.780369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:50.780373Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1794 [2:7556256095788310859:3455]
2025-10-01T14:12:50.780382Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:50.780393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:50.780394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.780396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.780398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.780407Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:50.780411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:50.780415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:50.780448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.780453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.780454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.780457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:50.780459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:50.780499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:50.780504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.780511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.780516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.780524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:50.780540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208535:2446], now have 1 active actors on pipe
2025-10-01T14:12:50.780546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208664:6306], now have 1 active actors on pipe
2025-10-01T14:12:50.780551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256095788310854:3455]
2025-10-01T14:12:50.780552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256095788310854:3455]
2025-10-01T14:12:50.780553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256095788310854:3455]
2025-10-01T14:12:50.780562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:50.780574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:50.780576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:50.780579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:50.780581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:50.780583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:50.780584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:50.780569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1794
2025-10-01T14:12:50.780599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256095788310854:3455]
2025-10-01T14:12:50.780571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1794
2025-10-01T14:12:50.780604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:50.780607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:50.780615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.780618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.780674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:50.780682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.780685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.780686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:50.780692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.780697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:50.780747Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:12:50.780776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.780906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.780917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.780916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 16 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:12:50.780932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.780948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:12:50.780989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1795 partition: 0 MaxSeqNo: 45 sessionId: src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0
2025-10-01T14:12:50.781261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abaa0ac2-b2c6df2e-4eda7278-427c11f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:50.783600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0] Write session: try to update token
2025-10-01T14:12:50.783617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:50.796456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1795 sessionId: src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:50.798937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:50.800367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.800399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.800418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:50.800420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:50.800425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:50.800427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:50.800432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256095788310854:3455]
2025-10-01T14:12:50.800435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256095788310854:3455]
2025-10-01T14:12:50.800438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256095788310854:3455]
2025-10-01T14:12:50.800481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:50.800480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:50.800486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:50.800490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:50.800489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.800491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:50.800607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:50.864687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256098165208700:7092]
2025-10-01T14:12:50.864985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1794, pipe: [1:7556256098165208700:7092]
2025-10-01T14:12:50.936189Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:50.936442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:50.936586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:50.936496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208700:7092], now have 1 active actors on pipe
2025-10-01T14:12:50.936692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256098165208700:7092]
2025-10-01T14:12:50.936712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:50.936724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-10-01T14:12:50.945720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:50.946234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:50.946245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:50.946260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1795 reason: error at write: Disconnected sessionId: src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0
2025-10-01T14:12:50.946411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1795 sessionId: src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0 is DEAD
2025-10-01T14:12:50.946542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:50.946553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0] Write session will restart in 0.006497s
2025-10-01T14:12:50.946575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0] Write session: Do CDS request
2025-10-01T14:12:50.946580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:50.951166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:50.951357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:50.951364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:50.951373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:50.951415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:50.951452Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256095788310989:3449]
2025-10-01T14:12:50.952106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:50.952364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:50.952402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:50.952712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:50.952760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.952766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.952767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.952768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.952770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.952771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.952773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.952774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.952775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.952776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.952777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.952778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.952779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.952781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.952785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.952795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.952799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.952803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.952807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.952811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.952815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.952818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.952822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.952826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.952830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.952833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.952837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.952840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.952847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.952854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:50.952859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.952864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:50.952870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.952875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:50.952879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.952884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:50.952889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.952894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:50.952899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.952905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:50.952910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.952915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:50.952919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.952924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:50.952929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.952934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:50.952941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.952946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.952951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.952956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.952960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.952965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.952972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.952977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:50.952981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.952985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:50.953022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:50.953821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.953934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:50.953946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1796
2025-10-01T14:12:50.954054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:50.954077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:50.954084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:50.954087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:50.954495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1796 sessionId:  describe result for acl check
2025-10-01T14:12:50.954525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:50.954527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:50.954529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:50.954534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256098165208802:6292] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:50.954941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256098165208802:6292] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:50.956974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:50.957352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256098165208802:6292] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:50.957530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:50.957543Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:50.957544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:50.957547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:50.957552Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1795 [2:7556256095788310989:3449]
2025-10-01T14:12:50.957563Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:50.957574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:50.957575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.957578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.957579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.957590Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:50.957594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:50.957599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:50.957636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.957642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.957643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.957646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:50.957647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:50.957702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:50.957709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.957716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:50.957722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:50.957731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:50.957743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208704:2446], now have 1 active actors on pipe
2025-10-01T14:12:50.957749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256095788310984:3449]
2025-10-01T14:12:50.957750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256095788310984:3449]
2025-10-01T14:12:50.957752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256095788310984:3449]
2025-10-01T14:12:50.957761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:50.957770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:50.957776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:50.957778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:50.957780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:50.957785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:50.957787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:50.957799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256095788310984:3449]
2025-10-01T14:12:50.957801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:50.957808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:50.957805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1795
2025-10-01T14:12:50.957866Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:12:50.958006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 17 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:12:50.958034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:12:50.962405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256098165208802:6292] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:50.962434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256098165208802:6292] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:50.962438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256098165208802:6292] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:50.962446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:50.962648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256098165208840:6292], now have 1 active actors on pipe
2025-10-01T14:12:50.962702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1795
2025-10-01T14:12:50.962747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.962755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.962775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:50.962788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:50.962793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:50.962795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:50.962803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:50.962817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:50.962832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.962970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.962977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.962986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:50.963060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1796 partition: 0 MaxSeqNo: 45 sessionId: src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0
2025-10-01T14:12:50.963344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|261e9978-f95de6a6-bced02fb-89ec4d16_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:50.965674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0] Write session: try to update token
2025-10-01T14:12:50.965691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:50.974920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:50.974938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:50.974946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256095788310984:3449]
2025-10-01T14:12:50.974985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:50.974994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:50.975135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:50.975282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:50.975403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:50.975537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:50.975908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:50.975954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:50.979908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1796 sessionId: src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:50.982359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:50.982549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:50.982567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:50.982596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:50.982680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:50.988512Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:50.988530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:50.988532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:50.988534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:50.988544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256095788310984:3449]
2025-10-01T14:12:50.988548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256095788310984:3449]
2025-10-01T14:12:50.988553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256095788310984:3449]
2025-10-01T14:12:50.988595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:50.988594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:50.988599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:50.988603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:50.988605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:50.988610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:50.988737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:51.036706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256102460176140:7092]
2025-10-01T14:12:51.036931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1795, pipe: [1:7556256102460176140:7092]
2025-10-01T14:12:51.123346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:51.130210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.130231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.130396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.130452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.130513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.130576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.130904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.130915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.130983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.131045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.131096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.131150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.131190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.131198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.131262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.131314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.131375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.131437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.131476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.131481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.131537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.131590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.131641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.131700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.131739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.131744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.131800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.131856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.131925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.131989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.132030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.132036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.132093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.132145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.132209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.132264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.132303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.132308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.132371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.132430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.132501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.132554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.132592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.132597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.132662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.132712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.132764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.132816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.132854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.132859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.132918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.132972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.133033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.133089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.133127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.133132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.133188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.133240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.133291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.133344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.133384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.133388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.133429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176140:7092], now have 1 active actors on pipe
2025-10-01T14:12:51.133615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256102460176140:7092]
2025-10-01T14:12:51.133645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:51.133831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:51.133841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:51.133867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1796 reason: error at write: Disconnected sessionId: src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0
2025-10-01T14:12:51.133957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:51.134023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1796 sessionId: src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0 is DEAD
2025-10-01T14:12:51.134135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:51.134145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0] Write session will restart in 0.005903s
2025-10-01T14:12:51.134168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0] Write session: Do CDS request
2025-10-01T14:12:51.134173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:51.140811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.140917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:51.140933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1797
2025-10-01T14:12:51.141030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.141060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:51.141069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:51.141072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:51.141385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1797 sessionId:  describe result for acl check
2025-10-01T14:12:51.141417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:51.141423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:51.141424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:51.141429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256102460176234:6287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:51.141922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256102460176234:6287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:51.142615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:51.144185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256102460176234:6287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:51.144348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:51.144490Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:51.144497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:51.144505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:51.144535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:51.144562Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256100083278459:3412]
2025-10-01T14:12:51.144985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:51.145250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:51.145293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:51.145492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:51.145528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.145532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.145533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.145533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.145534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.145534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.145535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.145536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.145536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.145537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.145538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.145538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.145539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.145539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.145542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.145547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.145550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.145552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.145554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.145556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.145558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.145559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.145562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.145564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.145566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.145568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.145569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.145572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.145576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.145581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.145585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.145588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.145590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.145593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.145596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.145598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.145601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.145604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.145606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.145609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.145611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.145614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.145616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.145619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.145622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.145624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.145626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.145629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.145631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.145634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.145637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.145639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.145642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.145645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.145647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.145650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.145670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:51.146274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256102460176234:6287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:51.146285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256102460176234:6287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:51.146288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256102460176234:6287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:51.146295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:51.149120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:51.150073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:51.150084Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:51.150086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:51.150088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:51.150092Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1796 [2:7556256100083278459:3412]
2025-10-01T14:12:51.150102Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:51.150114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:51.150116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.150118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.150119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.150129Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:51.150132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:51.150136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:51.150172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.150178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.150180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.150183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:51.150185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:51.150237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:51.150242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.150249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.150255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.150263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:51.150277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256100083278453:3412]
2025-10-01T14:12:51.150282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256100083278453:3412]
2025-10-01T14:12:51.150283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256100083278453:3412]
2025-10-01T14:12:51.150290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:51.150299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:51.150302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:51.150305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:51.150309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:51.150311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:51.150313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:51.150320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176146:2446], now have 1 active actors on pipe
2025-10-01T14:12:51.150322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176276:6287], now have 1 active actors on pipe
2025-10-01T14:12:51.150336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256100083278453:3412]
2025-10-01T14:12:51.150342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:51.150364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:51.150393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1796
2025-10-01T14:12:51.150398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1796
2025-10-01T14:12:51.150424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.150431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.150451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:51.150459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.150462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.150463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:51.150469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.150475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:51.150488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.150631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.150639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.150651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.150731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1797 partition: 0 MaxSeqNo: 45 sessionId: src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0
2025-10-01T14:12:51.151083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8de811-c868cf93-ec2d50ca-eabf3b55_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:51.153223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0] Write session: try to update token
2025-10-01T14:12:51.153236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:51.165483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1797 sessionId: src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:51.167587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:51.167799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.167819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.167857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:51.167926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:51.170188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:51.170208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:51.170211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:51.170212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:51.170221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256100083278453:3412]
2025-10-01T14:12:51.170225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256100083278453:3412]
2025-10-01T14:12:51.170228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256100083278453:3412]
2025-10-01T14:12:51.170273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:51.170265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:51.170282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:51.170285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.170286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:51.170287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:51.170428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:51.233818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256102460176283:7092]
2025-10-01T14:12:51.234045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1796, pipe: [1:7556256102460176283:7092]
2025-10-01T14:12:51.306005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:51.312609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.312644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.312776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.312830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.312881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.312947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.312990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.312997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.313054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.313100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.313161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.313221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.313261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.313266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.313316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.313361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.313411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.313461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.313497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.313504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.313562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.313613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.313659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.313714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.313752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.313757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.313806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.313853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.313900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.313946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.313983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.313988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.314039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.314085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.314136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.314190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.314229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.314234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.314284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.314333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.314405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.314458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.314495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.314500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.314550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.314597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.314646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.314695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.314732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.314738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.314794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.314853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.314911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.314962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.315000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.315004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.315066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.315119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.315171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.315221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.315261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.315266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.315302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176283:7092], now have 1 active actors on pipe
2025-10-01T14:12:51.315491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:51.315496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256102460176283:7092]
2025-10-01T14:12:51.315516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:51.315517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:51.315541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1797 reason: error at write: Disconnected sessionId: src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0
2025-10-01T14:12:51.315750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1797 sessionId: src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0 is DEAD
2025-10-01T14:12:51.316048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:51.316054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0] Write session will restart in 0.005021s
2025-10-01T14:12:51.316070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0] Write session: Do CDS request
2025-10-01T14:12:51.316074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:51.316640Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:51.321827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.321892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:51.321909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1798
2025-10-01T14:12:51.322020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.322041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:51.322048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:51.322050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:51.322339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1798 sessionId:  describe result for acl check
2025-10-01T14:12:51.322364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:51.322379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:51.322380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:51.322383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256102460176373:6286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:51.322750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256102460176373:6286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:51.323367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:51.324822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256102460176373:6286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:51.325105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:51.325240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:51.325247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:51.325254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:51.325282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:51.325323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256100083278589:3410]
2025-10-01T14:12:51.325781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:51.326030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:51.326071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:51.326356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:51.326422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.326427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.326428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.326429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.326430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.326431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.326432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.326433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.326435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.326435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.326436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.326437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.326438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.326439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.326444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.326453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.326457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.326461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.326465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.326469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.326477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.326481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.326485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.326492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.326496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.326503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.326507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.326514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.326521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.326532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.326542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.326551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.326561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.326567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.326571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.326576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.326580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.326587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.326592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.326598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.326606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.326611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.326619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.326624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.326631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.326636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.326644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.326648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.326656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.326661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.326666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.326671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.326678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.326683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.326689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.326694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.326732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:51.326968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256102460176373:6286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:51.326981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256102460176373:6286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:51.326984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256102460176373:6286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:51.326991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:51.330127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:51.330644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:51.330655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:51.330657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:51.330660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:51.330664Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1797 [2:7556256100083278589:3410]
2025-10-01T14:12:51.330672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:51.330683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:51.330685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.330687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.330688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.330698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:51.330705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:51.330709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:51.330740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.330745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.330746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.330749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:51.330751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:51.330794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:51.330800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.330806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.330812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.330820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:51.330832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256100083278584:3410]
2025-10-01T14:12:51.330837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256100083278584:3410]
2025-10-01T14:12:51.330838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256100083278584:3410]
2025-10-01T14:12:51.330843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:51.330851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:51.330853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:51.330856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:51.330858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:51.330862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:51.330864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:51.330871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176286:2446], now have 1 active actors on pipe
2025-10-01T14:12:51.330873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176417:6286], now have 1 active actors on pipe
2025-10-01T14:12:51.330885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256100083278584:3410]
2025-10-01T14:12:51.330894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:51.330905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:51.330917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1797
2025-10-01T14:12:51.330918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1797
2025-10-01T14:12:51.330957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.330963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.330980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:51.330987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.330991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.330996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:51.331001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.331007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:51.331019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.331128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.331133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.331142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.331206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1798 partition: 0 MaxSeqNo: 45 sessionId: src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0
2025-10-01T14:12:51.331516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50b07f5-9cefacbb-f529cfcc-abb3b4f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:51.333649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0] Write session: try to update token
2025-10-01T14:12:51.333662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:51.345982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1798 sessionId: src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:51.348131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:51.348372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.348391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.348425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:51.348495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:51.350414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:51.350428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:51.350430Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:51.350432Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:51.350442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256100083278584:3410]
2025-10-01T14:12:51.350446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256100083278584:3410]
2025-10-01T14:12:51.350451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256100083278584:3410]
2025-10-01T14:12:51.350491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:51.350498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.350500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:51.350515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:51.350521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:51.350525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:51.350620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:51.415608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256102460176438:7092]
2025-10-01T14:12:51.415858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1797, pipe: [1:7556256102460176438:7092]
2025-10-01T14:12:51.485422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:51.491484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.491504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.491645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.491697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.491749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.491800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.491837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.491844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.491902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.491953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.492002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.492055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.492093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.492098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.492150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.492198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.492252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.492299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.492337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.492342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.492390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.492437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.492484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.492531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.492568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.492572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.492622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.492679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.492726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.492772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.492809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.492814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.492863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.492910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.492961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.493013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.493055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.493060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.493110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.493156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.493206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.493253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.493288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.493293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.493342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.493389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.493440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.493490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.493531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.493536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.493589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.493637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.493688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.493738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.493773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.493778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.493829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.493879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.493931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.493990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.494030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.494035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.494071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176438:7092], now have 1 active actors on pipe
2025-10-01T14:12:51.494299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256102460176438:7092]
2025-10-01T14:12:51.494307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:51.494324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:51.494326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:51.494346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1798 reason: error at write: Disconnected sessionId: src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0
2025-10-01T14:12:51.494518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1798 sessionId: src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0 is DEAD
2025-10-01T14:12:51.494610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:51.494618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0] Write session will restart in 0.005664s
2025-10-01T14:12:51.494635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0] Write session: Do CDS request
2025-10-01T14:12:51.494639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:51.494784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:51.501862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.501986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:51.501999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1799
2025-10-01T14:12:51.502129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.502159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:51.502166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:51.502169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:51.502460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1799 sessionId:  describe result for acl check
2025-10-01T14:12:51.502485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:51.502488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:51.502489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:51.502492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256102460176541:6275] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:51.502633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:51.502860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256102460176541:6275] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:51.504137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:51.504204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256102460176541:6275] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:51.504302Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:51.504311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:51.504321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:51.504367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:51.504399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256100083278721:3408]
2025-10-01T14:12:51.504793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:51.505019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:51.505051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:51.505276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:51.505321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.505327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.505328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.505329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.505330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.505331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.505332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.505333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.505334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.505335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.505336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.505337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.505338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.505339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.505344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.505352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.505355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.505358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.505362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.505366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.505369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.505373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.505376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.505380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.505383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.505386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.505390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.505393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.505398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.505404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.505410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.505415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.505419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.505424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.505428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.505432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.505436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.505441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.505445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.505449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.505452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.505454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.505457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.505459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.505461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.505464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.505466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.505469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.505473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.505475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.505477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.505480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.505482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.505486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.505488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.505491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.505509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:51.507709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256102460176541:6275] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:51.507719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256102460176541:6275] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:51.507723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256102460176541:6275] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:51.507728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:51.508830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:51.509334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:51.509345Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:51.509347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:51.509350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:51.509355Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1798 [2:7556256100083278721:3408]
2025-10-01T14:12:51.509367Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:51.509381Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:51.509388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.509391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.509392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.509405Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:51.509414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:51.509420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:51.509463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.509469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.509471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.509474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:51.509477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:51.509532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:51.509538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.509548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.509562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.509581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:51.509599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176580:6275], now have 1 active actors on pipe
2025-10-01T14:12:51.509606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176449:2446], now have 1 active actors on pipe
2025-10-01T14:12:51.509611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256100083278716:3408]
2025-10-01T14:12:51.509613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256100083278716:3408]
2025-10-01T14:12:51.509615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256100083278716:3408]
2025-10-01T14:12:51.509611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1798
2025-10-01T14:12:51.509627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:51.509631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:51.509633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:51.509635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:51.509641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:51.509650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:51.509652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:51.509669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256100083278716:3408]
2025-10-01T14:12:51.509677Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:51.509680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1798
2025-10-01T14:12:51.509689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:51.509714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.509720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.509737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:51.509745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.509748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.509749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:51.509754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.509760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:51.509773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.509897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.509903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.509912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.509985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1799 partition: 0 MaxSeqNo: 45 sessionId: src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0
2025-10-01T14:12:51.510300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b39ecee-f5ca5ed7-bb6b4e32-80473e42_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:51.512375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0] Write session: try to update token
2025-10-01T14:12:51.512388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:51.524654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1799 sessionId: src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:51.526957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:51.527151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.527167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.527213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:51.527276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:51.528891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:51.528905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:51.528907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:51.528909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:51.528917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256100083278716:3408]
2025-10-01T14:12:51.528922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256100083278716:3408]
2025-10-01T14:12:51.528925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256100083278716:3408]
2025-10-01T14:12:51.528964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:51.528973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.528975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:51.529026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:51.529037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:51.529041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:51.529087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:51.594268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256102460176588:7092]
2025-10-01T14:12:51.594521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1798, pipe: [1:7556256102460176588:7092]
2025-10-01T14:12:51.662855Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:51.669366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.669390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.669545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.669606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.669671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.669732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.669780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.669790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.669854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.669917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.669974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.670034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.670083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.670091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.670145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.670198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.670255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.670310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.670349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.670356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.670429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.670484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.670538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.670591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.670635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.670642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.670697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.670749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.670806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.670864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.670905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.670913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.670975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.671033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.671090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.671148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.671200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.671207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.671266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.671318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.671375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.671432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.671478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.671485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.671541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.671596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.671654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.671714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.671756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.671763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.671829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.671882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.671933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.671983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.672020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.672025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.672081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.672130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.672180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.672230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.672265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.672274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.672315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176588:7092], now have 1 active actors on pipe
2025-10-01T14:12:51.672518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:51.672526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:51.672528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:51.672556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1799 reason: error at write: Disconnected sessionId: src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0
2025-10-01T14:12:51.672622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256102460176588:7092]
2025-10-01T14:12:51.672749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1799 sessionId: src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0 is DEAD
2025-10-01T14:12:51.672896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:51.672906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0] Write session will restart in 0.008261s
2025-10-01T14:12:51.672930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0] Write session: Do CDS request
2025-10-01T14:12:51.672936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:51.672937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:51.681304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:51.681845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.681871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:51.681883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1800
2025-10-01T14:12:51.682034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.682063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:51.682072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:51.682074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:51.682366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1800 sessionId:  describe result for acl check
2025-10-01T14:12:51.682404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:51.682409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:51.682411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:51.682416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256102460176685:6269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:51.682820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256102460176685:6269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:51.682846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:51.683016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:51.683025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:51.683035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:51.683095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:51.683121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256100083278855:3406]
2025-10-01T14:12:51.683505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:51.683691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:51.683719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:51.683963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:51.684010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.684015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.684016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.684017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.684018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.684018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.684020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.684021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.684022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.684023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.684024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.684024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.684025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.684026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.684030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.684038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.684042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.684045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.684049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.684052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.684055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.684058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.684061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.684065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.684068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.684072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.684075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.684078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.684083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.684090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.684096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.684101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.684106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.684111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.684115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.684119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.684123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.684128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.684132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.684136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.684140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.684143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.684146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.684150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.684154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.684158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.684167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.684171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.684174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.684179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.684186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.684191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.684195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.684198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.684206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.684210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.684251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:51.684791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256102460176685:6269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:51.687481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256102460176685:6269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:51.687492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256102460176685:6269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:51.687494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256102460176685:6269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:51.687500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:51.687739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:51.688259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:51.688272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:51.688273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:51.688275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:51.688279Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1799 [2:7556256100083278855:3406]
2025-10-01T14:12:51.688290Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:51.688304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:51.688306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.688309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.688310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.688320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:51.688323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:51.688327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:51.688362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.688369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.688371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.688375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:51.688378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:51.688448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:51.688455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.688462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.688472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.688483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:51.688500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176724:6269], now have 1 active actors on pipe
2025-10-01T14:12:51.688507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176591:2446], now have 1 active actors on pipe
2025-10-01T14:12:51.688513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256100083278850:3406]
2025-10-01T14:12:51.688521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256100083278850:3406]
2025-10-01T14:12:51.688523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256100083278850:3406]
2025-10-01T14:12:51.688534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:51.688550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:51.688555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:51.688558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:51.688561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:51.688567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:51.688569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:51.688547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1799
2025-10-01T14:12:51.688552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1799
2025-10-01T14:12:51.688587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256100083278850:3406]
2025-10-01T14:12:51.688594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:51.688596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:51.688608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.688614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.688658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:51.688666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.688669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.688674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:51.688680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.688686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:51.688700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.688825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.688832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.688844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.688913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1800 partition: 0 MaxSeqNo: 45 sessionId: src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0
2025-10-01T14:12:51.689224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84ee89e0-df1ee044-29dbbacb-511ff4fb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:51.691472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0] Write session: try to update token
2025-10-01T14:12:51.691484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:51.703742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1800 sessionId: src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:51.705823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:51.706025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.706043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.706073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:51.706146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:51.708539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:51.708552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:51.708553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:51.708555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:51.708562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256100083278850:3406]
2025-10-01T14:12:51.708565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256100083278850:3406]
2025-10-01T14:12:51.708567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256100083278850:3406]
2025-10-01T14:12:51.708610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:51.708616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:51.708616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:51.708619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:51.708620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.708622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:51.708740Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:51.772950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256102460176753:7092]
2025-10-01T14:12:51.773223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1799, pipe: [1:7556256102460176753:7092]
2025-10-01T14:12:51.848769Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:51.858249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.858270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.858421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.858473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.858533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.858590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.858629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.858636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.858693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.858746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.858800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.858853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.858891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.858896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.858948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.858996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.859054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.859102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.859138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.859143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.859192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.859240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.859289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.859338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.859375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.859380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.859428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.859474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.859523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.859579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.859615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.859624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.859675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.859722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.859791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.859845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.859884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.859889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.859943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.859992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.860051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.860105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.860144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.860149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.860198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.860244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.860292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.860345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.860382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.860387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.860439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.860488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.860540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.860606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.860660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.860666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.860722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:51.860768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:51.860891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:51.860942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:51.860978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:51.860984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:51.861031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176753:7092], now have 1 active actors on pipe
2025-10-01T14:12:51.861221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256102460176753:7092]
2025-10-01T14:12:51.861235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:51.861238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:51.861246Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:51.861259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1800 reason: error at write: Disconnected sessionId: src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0
2025-10-01T14:12:51.861440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1800 sessionId: src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0 is DEAD
2025-10-01T14:12:51.861571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:51.861577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0] Write session will restart in 0.009588s
2025-10-01T14:12:51.861594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0] Write session: Do CDS request
2025-10-01T14:12:51.861599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:51.861830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:51.870107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:51.871480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:51.871663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:51.871673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:51.871684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:51.871729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:51.871766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256100083278995:3395]
2025-10-01T14:12:51.871800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.872262Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:51.872273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1801
2025-10-01T14:12:51.872364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:51.872389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:51.872411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:51.872415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:51.872417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:51.872591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:51.872639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:51.872708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1801 sessionId:  describe result for acl check
2025-10-01T14:12:51.872739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:51.872745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:51.872746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:51.872750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256102460176855:6247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:51.872927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:51.872972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.872977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.872978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.872979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.872981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.872982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.872983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.872984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.872985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.872986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.872987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.872988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.872989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.872990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.872995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.873004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.873009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.873013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.873017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.873021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.873029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.873033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.873041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.873045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.873049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.873056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.873060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.873068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.873074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.873085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:51.873091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.873100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:51.873108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.873117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:51.873125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.873131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:51.873125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256102460176855:6247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:51.873139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.873145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:51.873153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.873158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:51.873166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.873173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:51.873177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.873186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:51.873193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.873202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:51.873210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.873215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.873223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.873231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.873234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.873243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.873248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.873255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:51.873259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.873267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:51.873304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:51.875340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256102460176855:6247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:51.876684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:51.877239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:51.877252Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:51.877254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:51.877256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:51.877261Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1800 [2:7556256100083278995:3395]
2025-10-01T14:12:51.877272Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:51.877285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:51.877287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.877289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.877291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.877302Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:51.877305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:51.877309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:51.877346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.877351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.877352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.877354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:51.877356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:51.877413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:51.877419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.877429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:51.877443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:51.877461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:51.877485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176758:2446], now have 1 active actors on pipe
2025-10-01T14:12:51.877494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256100083278990:3395]
2025-10-01T14:12:51.877495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256100083278990:3395]
2025-10-01T14:12:51.877497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256100083278990:3395]
2025-10-01T14:12:51.877509Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:51.877493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1800
2025-10-01T14:12:51.877525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:51.877535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:51.877538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:51.877538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:51.877540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:51.877540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:51.877559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256100083278990:3395]
2025-10-01T14:12:51.877565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:51.877567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:51.878098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256102460176855:6247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:51.878113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256102460176855:6247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:51.878117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256102460176855:6247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:51.878124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:51.878312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176894:6247], now have 1 active actors on pipe
2025-10-01T14:12:51.878340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1800
2025-10-01T14:12:51.878409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.878421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.878455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:51.878467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:51.878479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:51.878481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:51.878490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:51.878504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:51.878522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.878652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.878660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.878675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:51.878745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1801 partition: 0 MaxSeqNo: 45 sessionId: src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0
2025-10-01T14:12:51.879095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbb6f608-9c65ec20-4bdecec9-dbf4bef7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:51.881930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0] Write session: try to update token
2025-10-01T14:12:51.881943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:51.894122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:51.894150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:51.894167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256100083278990:3395]
2025-10-01T14:12:51.894220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:51.894230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:51.894622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:51.894893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:51.895149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:51.895283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:51.895474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:51.895519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:51.895558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1801 sessionId: src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:51.901017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:51.901198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:51.901216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:51.901249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:51.901334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:51.910025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:51.910045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:51.910047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:51.910048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:51.910057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256100083278990:3395]
2025-10-01T14:12:51.910061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256100083278990:3395]
2025-10-01T14:12:51.910066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256100083278990:3395]
2025-10-01T14:12:51.910104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:51.910109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:51.910113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:51.910116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:51.910123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:51.910126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:51.910257Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:51.961367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256102460176900:7092]
2025-10-01T14:12:51.961556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1800, pipe: [1:7556256102460176900:7092]
2025-10-01T14:12:52.052355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:52.058856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.058878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.059010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.059060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.059110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.059165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.059203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.059210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.059262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.059314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.059367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.059418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.059457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.059462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.059516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.059569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.059621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.059673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.059711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.059716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.059769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.059821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.059872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.059926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.059966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.059970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.060025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.060076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.060128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.060179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.060221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.060226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.060281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.060332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.060384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.060436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.060475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.060483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.060537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.060586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.060657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.060715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.060753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.060758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.060815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.060866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.060919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.060970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.061008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.061012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.061064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.061114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.061167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.061216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.061254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.061261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.061310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:52.061360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:52.061409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:52.061459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:52.061497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:52.061501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:52.061538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256102460176900:7092], now have 1 active actors on pipe
2025-10-01T14:12:52.061722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:52.061732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:52.061754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1801 reason: error at write: Disconnected sessionId: src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0
2025-10-01T14:12:52.061929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1801 sessionId: src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0 is DEAD
2025-10-01T14:12:52.062059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:52.062069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0] Write session will restart in 0.007338s
2025-10-01T14:12:52.062078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:52.062079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256102460176900:7092]
2025-10-01T14:12:52.062098Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:12:52.062094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0] Write session: Do CDS request
2025-10-01T14:12:52.062111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:52.062230Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 18 consumer shared/user session shared/user_1_18_3064411298515694733_v1 is DEAD
2025-10-01T14:12:52.062308Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:12:52.062300Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:52.062361Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256025150747774:7100] disconnected; active server actors: 1
2025-10-01T14:12:52.062382Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256025150747774:7100] client user disconnected session shared/user_1_18_3064411298515694733_v1
2025-10-01T14:12:52.062420Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:12:52.062425Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:12:52.062431Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.009415s
2025-10-01T14:12:52.070690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:52.070818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.070871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:52.070881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1802
2025-10-01T14:12:52.071052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.071075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:52.071081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:52.071084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:52.071358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1802 sessionId:  describe result for acl check
2025-10-01T14:12:52.071385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:52.071389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:52.071390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:52.071395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256106755144297:6248] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:52.071772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256106755144297:6248] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:52.072740Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:12:52.072827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:52.072846Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:12:52.072857Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 19
2025-10-01T14:12:52.073022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:52.073025Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 19 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:12:52.073033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:52.073074Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:12:52.073080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:52.073138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:52.073152Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 auth for : user
2025-10-01T14:12:52.073177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256104378246457:3356]
2025-10-01T14:12:52.073240Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 Handle describe topics response
2025-10-01T14:12:52.073257Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 auth is DEAD
2025-10-01T14:12:52.073264Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:12:52.073506Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:12:52.073604Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_19_46139338470068103_v1
2025-10-01T14:12:52.073602Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256106755144316:6239] connected; active server actors: 1
2025-10-01T14:12:52.073613Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256106755144316:6239] session shared/user_1_19_46139338470068103_v1
2025-10-01T14:12:52.073623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:12:52.073636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:12:52.073646Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_19_46139338470068103_v1" (Sender=[1:7556256106755144308:6239], Pipe=[1:7556256106755144316:6239], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:12:52.073650Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:12:52.073661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:12:52.073673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_19_46139338470068103_v1" (Sender=[1:7556256106755144308:6239], Pipe=[1:7556256106755144316:6239], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:12:52.073686Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_19_46139338470068103_v1" sender [1:7556256106755144308:6239] lock partition 0 for ReadingSession "shared/user_1_19_46139338470068103_v1" (Sender=[1:7556256106755144308:6239], Pipe=[1:7556256106755144316:6239], Partitions=[], ActiveFamilyCount=1) generation 1 step 19
2025-10-01T14:12:52.073693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:12:52.073701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-01T14:12:52.073779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:52.073829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256106755144297:6248] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:52.073894Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 19 Session: "shared/user_1_19_46139338470068103_v1" ClientId: "user" PipeClient { RawX1: 7556256106755144316 RawX2: 4503603922344031 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:12:52.073910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:12:52.074009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:52.074048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:52.074344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:52.074425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.074432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.074433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.074434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.074435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.074437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.074438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.074439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.074440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.074441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.074442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.074443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.074445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.074446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.074451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.074460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.074464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.074467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.074472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.074475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.074479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.074483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.074487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.074491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.074495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.074498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.074502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.074505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.074512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.074518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.074524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.074534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.074539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.074544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.074551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.074556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.074561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.074569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.074573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.074578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.074583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.074588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.074592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.074597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.074601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.074610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.074614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.074621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.074625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.074634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.074638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.074642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.074650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.074654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.074658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.074665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.074700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:52.077972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256106755144297:6248] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:52.077987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256106755144297:6248] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:52.077990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256106755144297:6248] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:52.077998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:52.078088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:52.078667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:52.078680Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:52.078682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:52.078684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:52.078688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1801 [2:7556256104378246457:3356]
2025-10-01T14:12:52.078699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:52.078710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:52.078712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.078715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.078716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.078728Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:52.078735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:52.078740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:52.078779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.078784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.078786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.078788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:52.078791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:52.078835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:52.078842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.078848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.078854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.078863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:52.078878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144321:6233], now have 1 active actors on pipe
2025-10-01T14:12:52.078883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144201:2446], now have 1 active actors on pipe
2025-10-01T14:12:52.078885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144339:6248], now have 1 active actors on pipe
2025-10-01T14:12:52.078890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256104378246452:3356]
2025-10-01T14:12:52.078891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256104378246452:3356]
2025-10-01T14:12:52.078892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256104378246452:3356]
2025-10-01T14:12:52.078901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:52.078914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:52.078915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:52.078917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:52.078919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:52.078925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:52.078926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:52.078945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256104378246452:3356]
2025-10-01T14:12:52.078950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:52.078935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1801
2025-10-01T14:12:52.078941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1801, pipe: [1:7556256106755144321:6233]
2025-10-01T14:12:52.078958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:52.078970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.078978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.078963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1801
2025-10-01T14:12:52.078986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_19_46139338470068103_v1 on pipe: [1:7556256106755144321:6233]
2025-10-01T14:12:52.079012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.079015Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_19_46139338470068103_v1:1 with generation 1801
2025-10-01T14:12:52.079018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.079025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.079029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.079031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:52.079041Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_19_46139338470068103_v1
2025-10-01T14:12:52.079043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.079067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:52.079074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:12:52.079077Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:12:52.083142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:12:52.083172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:12:52.083180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.083186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.083189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:52.083200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.083215Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:52.083227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:12:52.083244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:12:52.083279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.083413Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327972078 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:12:52.083432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:12:52.083460Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 sending to client partition status
2025-10-01T14:12:52.083499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.083511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.083529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.083610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1802 partition: 0 MaxSeqNo: 45 sessionId: src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0
2025-10-01T14:12:52.083882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9b2dfa6-4274e6e0-e76f3765-574c32c3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:52.086192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0] Write session: try to update token
2025-10-01T14:12:52.086206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:52.098003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:52.098024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:52.098027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:52.098029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:52.098039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256104378246452:3356]
2025-10-01T14:12:52.098044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256104378246452:3356]
2025-10-01T14:12:52.098048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256104378246452:3356]
2025-10-01T14:12:52.098094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:52.098093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:52.098100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:52.098101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.098104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:52.098107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:52.098237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:52.098568Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1802 sessionId: src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:52.100841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:52.249112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:52.249337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.249348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.249530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_19_46139338470068103_v1
2025-10-01T14:12:52.249546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:52.249577Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_19_46139338470068103_v1
2025-10-01T14:12:52.249616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:52.249628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256106755144321:6233]
2025-10-01T14:12:52.249653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:52.249719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1802 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0
2025-10-01T14:12:52.249908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1802 sessionId: src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0 is DEAD
2025-10-01T14:12:52.250036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:52.250047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0] Write session will restart in 0.005592s
2025-10-01T14:12:52.250073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0] Write session: Do CDS request
2025-10-01T14:12:52.250078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:52.256779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.256907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:52.256917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1803
2025-10-01T14:12:52.257007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.257029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:52.257035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:52.257038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:52.257433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1803 sessionId:  describe result for acl check
2025-10-01T14:12:52.257462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:52.257468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:52.257469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:52.257474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256106755144447:6226] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:52.257872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:52.257962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256106755144447:6226] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:52.259458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:52.259481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256106755144447:6226] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:52.259584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:52.259591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:52.259598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:52.259628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:52.259654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256104378246606:3366]
2025-10-01T14:12:52.260026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:52.260220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:52.260253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:52.260466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:52.260505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.260509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.260510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.260510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.260511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.260511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.260512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.260513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.260513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.260514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.260514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.260515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.260516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.260516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.260519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.260524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.260526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.260529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.260531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.260533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.260535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.260537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.260539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.260541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.260543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.260545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.260547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.260549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.260554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.260558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.260562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.260565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.260569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.260572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.260574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.260577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.260579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.260582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.260584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.260587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.260589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.260592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.260608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.260611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.260614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.260617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.260620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.260622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.260625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.260637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.260641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.260644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.260646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.260648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.260651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.260654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.260672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:52.263728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256106755144447:6226] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:52.263741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256106755144447:6226] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:52.263744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256106755144447:6226] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:52.263751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:52.263947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:52.264549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:52.264565Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:52.264568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:52.264572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:52.264578Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1802 [2:7556256104378246606:3366]
2025-10-01T14:12:52.264593Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:52.264607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:52.264610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.264614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.264616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.264643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:52.264649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:52.264657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:52.264706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.264712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.264714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.264716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:52.264719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:52.264773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:52.264779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.264786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.264792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.264800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:52.264814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144487:6226], now have 1 active actors on pipe
2025-10-01T14:12:52.264820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144352:2446], now have 1 active actors on pipe
2025-10-01T14:12:52.264825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256104378246601:3366]
2025-10-01T14:12:52.264826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256104378246601:3366]
2025-10-01T14:12:52.264828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256104378246601:3366]
2025-10-01T14:12:52.264836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:52.264848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:52.264854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:52.264857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:52.264859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:52.264859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:52.264860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:52.264879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256104378246601:3366]
2025-10-01T14:12:52.264887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:52.264892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:52.264893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1802
2025-10-01T14:12:52.264906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1802
2025-10-01T14:12:52.264977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.264988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.265014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59639801-35d9a1fe-d1472d3b-c60256df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:52.265027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.265031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.265033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:52.265041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.265048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:52.265061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.265318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.265325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.265337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.265406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1803 partition: 0 MaxSeqNo: 45 sessionId: src_id|59639801-35d9a1fe-d1472d3b-c60256df_0
2025-10-01T14:12:52.265753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6ea2ad6-d190f36d-12d6d53e-b946612d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|59639801-35d9a1fe-d1472d3b-c60256df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:52.268062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59639801-35d9a1fe-d1472d3b-c60256df_0] Write session: try to update token
2025-10-01T14:12:52.268079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59639801-35d9a1fe-d1472d3b-c60256df_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:52.282667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1803 sessionId: src_id|59639801-35d9a1fe-d1472d3b-c60256df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:52.284277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:52.284292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:52.284294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:52.284296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:52.284302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256104378246601:3366]
2025-10-01T14:12:52.284306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256104378246601:3366]
2025-10-01T14:12:52.284308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256104378246601:3366]
2025-10-01T14:12:52.284343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:52.284346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:52.284347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:52.284350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:52.284351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.284352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:52.284486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:52.285149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:52.350013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256106755144496:6233]
2025-10-01T14:12:52.350260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1802, pipe: [1:7556256106755144496:6233]
2025-10-01T14:12:52.417774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:52.418011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.418023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.418058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144496:6233], now have 1 active actors on pipe
2025-10-01T14:12:52.418227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:52.418321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:52.418331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256106755144496:6233]
2025-10-01T14:12:52.418355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:52.418456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1803 reason: status is not ok: tablet will be restarted right now sessionId: src_id|59639801-35d9a1fe-d1472d3b-c60256df_0
2025-10-01T14:12:52.418670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1803 sessionId: src_id|59639801-35d9a1fe-d1472d3b-c60256df_0 is DEAD
2025-10-01T14:12:52.418796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59639801-35d9a1fe-d1472d3b-c60256df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:52.418806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59639801-35d9a1fe-d1472d3b-c60256df_0] Write session will restart in 0.008571s
2025-10-01T14:12:52.418831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59639801-35d9a1fe-d1472d3b-c60256df_0] Write session: Do CDS request
2025-10-01T14:12:52.418836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59639801-35d9a1fe-d1472d3b-c60256df_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:52.427700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:52.428762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59639801-35d9a1fe-d1472d3b-c60256df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.428879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:52.428894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1804
2025-10-01T14:12:52.428994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.429023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:52.429032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:52.429035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:52.429458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1804 sessionId:  describe result for acl check
2025-10-01T14:12:52.429487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:52.429489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:52.429490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:52.429495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256106755144611:6219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:52.429656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:52.429784Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:52.429792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:52.429802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:52.429838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:52.429868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256104378246742:3363]
2025-10-01T14:12:52.429951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256106755144611:6219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:52.430258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:52.430484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:52.430512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:52.430785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:52.430841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.430847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.430848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.430849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.430851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.430852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.430853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.430854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.430855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.430856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.430857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.430858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.430860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.430861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.430866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.430874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.430878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.430882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.430886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.430890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.430893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.430897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.430900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.430904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.430907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.430911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.430914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.430918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.430924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.430931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.430937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.430946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.430950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.430958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.430966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.430971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.430981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.430990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.430997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.430999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.431002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.431005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.431007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.431009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.431011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.431018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.431020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.431023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.431029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.431032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.431034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.431036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.431039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.431042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.431044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.431047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.431069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:52.431473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256106755144611:6219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:52.434065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256106755144611:6219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:52.434075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256106755144611:6219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:52.434078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256106755144611:6219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:52.434086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:52.434253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:52.434806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:52.434818Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:52.434819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:52.434822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:52.434826Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1803 [2:7556256104378246742:3363]
2025-10-01T14:12:52.434835Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:52.434850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:52.434852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.434854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.434855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.434866Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:52.434869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:52.434877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:52.434914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.434919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.434920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.434923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:52.434924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:52.434980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:52.434991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.435000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.435010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.435024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:52.435039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144509:2446], now have 1 active actors on pipe
2025-10-01T14:12:52.435047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144650:6219], now have 1 active actors on pipe
2025-10-01T14:12:52.435051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256104378246737:3363]
2025-10-01T14:12:52.435053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256104378246737:3363]
2025-10-01T14:12:52.435054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256104378246737:3363]
2025-10-01T14:12:52.435064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:52.435077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:52.435079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:52.435085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:52.435087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:52.435090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:52.435093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:52.435113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256104378246737:3363]
2025-10-01T14:12:52.435120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:52.435103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1803
2025-10-01T14:12:52.435102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1803
2025-10-01T14:12:52.435127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:52.435143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.435156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.435183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:52.435193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.435200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.435202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:52.435209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.435221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:52.435239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.435358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.435367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.435381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.435462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1804 partition: 0 MaxSeqNo: 45 sessionId: src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0
2025-10-01T14:12:52.435771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59639801-35d9a1fe-d1472d3b-c60256df_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:52.437903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0] Write session: try to update token
2025-10-01T14:12:52.437918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:52.453070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1804 sessionId: src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:52.454891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:52.454911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:52.454913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:52.454915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:52.454921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256104378246737:3363]
2025-10-01T14:12:52.454925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256104378246737:3363]
2025-10-01T14:12:52.454927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256104378246737:3363]
2025-10-01T14:12:52.454969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:52.454970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:52.454974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:52.454977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:52.454981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.454983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:52.455101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:52.455227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:52.518445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256106755144663:6233]
2025-10-01T14:12:52.518752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1803, pipe: [1:7556256106755144663:6233]
2025-10-01T14:12:52.587235Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:52.587635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.587649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.587679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144663:6233], now have 1 active actors on pipe
2025-10-01T14:12:52.587837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:52.587869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256106755144663:6233]
2025-10-01T14:12:52.587887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:52.587868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:52.587890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:52.587944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1804 reason: error at write: Disconnected sessionId: src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0
2025-10-01T14:12:52.588102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1804 sessionId: src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0 is DEAD
2025-10-01T14:12:52.588230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:52.588240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0] Write session will restart in 0.007019s
2025-10-01T14:12:52.588265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0] Write session: Do CDS request
2025-10-01T14:12:52.588270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:52.595677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:52.596118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:52.596272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:52.596281Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:52.596291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:52.596324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:52.596358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256104378246879:3358]
2025-10-01T14:12:52.596830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.596901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:52.596948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:52.596959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1805
2025-10-01T14:12:52.597052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.597073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:52.597079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:52.597082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:52.597388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1805 sessionId:  describe result for acl check
2025-10-01T14:12:52.597418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:52.597420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:52.597421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:52.597426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256106755144765:6217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:52.597427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:52.597457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:52.597647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:52.597682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.597686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.597687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.597687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.597688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.597688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.597689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.597690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.597690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.597691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.597691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.597692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.597692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.597693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.597696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.597701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.597703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.597705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.597707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.597709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.597711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.597713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.597715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.597717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.597720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.597721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.597723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.597725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.597730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.597734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.597738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.597741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.597743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.597746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.597748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.597751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.597753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.597756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.597758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.597761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.597764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.597768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.597770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.597773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.597775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.597778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.597784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.597787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.597789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.597792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.597797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.597799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.597802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.597805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.597807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.597809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.597842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:52.597913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256106755144765:6217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:52.599400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256106755144765:6217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:52.601349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256106755144765:6217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:52.601361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256106755144765:6217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:52.601364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256106755144765:6217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:52.601361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:52.601371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:52.601949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:52.601963Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:52.601964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:52.601966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:52.601972Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1804 [2:7556256104378246879:3358]
2025-10-01T14:12:52.601982Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:52.601994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:52.601995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.601998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.601999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.602014Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:52.602023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:52.602033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:52.602091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.602096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.602097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.602099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:52.602101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:52.602153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:52.602160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.602169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.602179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.602198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:52.602220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144664:2446], now have 1 active actors on pipe
2025-10-01T14:12:52.602226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144803:6217], now have 1 active actors on pipe
2025-10-01T14:12:52.602231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256104378246874:3358]
2025-10-01T14:12:52.602235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256104378246874:3358]
2025-10-01T14:12:52.602237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256104378246874:3358]
2025-10-01T14:12:52.602238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1804
2025-10-01T14:12:52.602247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:52.602243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1804
2025-10-01T14:12:52.602259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:52.602261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:52.602264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:52.602264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:52.602277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:52.602283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:52.602322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.602331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.602342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256104378246874:3358]
2025-10-01T14:12:52.602347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:52.602365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:52.602384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:52.602390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.602393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.602395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:52.602402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.602409Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:52.602431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.602560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.602567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.602578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.602646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1805 partition: 0 MaxSeqNo: 45 sessionId: src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0
2025-10-01T14:12:52.603027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161ce8d3-f0415e0f-4f30fd37-bf870271_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:52.605329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0] Write session: try to update token
2025-10-01T14:12:52.605345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:52.618514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1805 sessionId: src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:52.620738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:52.622273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.622309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.622329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:52.622335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:52.622338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:52.622340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:52.622348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256104378246874:3358]
2025-10-01T14:12:52.622353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256104378246874:3358]
2025-10-01T14:12:52.622356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256104378246874:3358]
2025-10-01T14:12:52.622402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:52.622414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:52.622416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:52.622420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:52.622427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.622429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:52.622638Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:52.687927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256106755144811:6233]
2025-10-01T14:12:52.688149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1804, pipe: [1:7556256106755144811:6233]
2025-10-01T14:12:52.756842Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:52.757041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:52.757096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144811:6233], now have 1 active actors on pipe
2025-10-01T14:12:52.757204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:52.757288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:52.757295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:52.757356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1805 reason: error at write: Disconnected sessionId: src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0
2025-10-01T14:12:52.757520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1805 sessionId: src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0 is DEAD
2025-10-01T14:12:52.757673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:52.757682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0] Write session will restart in 0.007550s
2025-10-01T14:12:52.757663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256106755144811:6233]
2025-10-01T14:12:52.757685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:52.757699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0] Write session: Do CDS request
2025-10-01T14:12:52.757704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:52.765917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.765961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:52.765975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1806
2025-10-01T14:12:52.766142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.766172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:52.766181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:52.766183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:52.766349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:52.766547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1806 sessionId:  describe result for acl check
2025-10-01T14:12:52.766575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:52.766583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:52.766584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:52.766588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256106755144937:6199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:52.767025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256106755144937:6199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:52.768048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:52.768171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:52.768178Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:52.768185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:52.768215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:52.768251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256104378247027:3360]
2025-10-01T14:12:52.768623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:52.768878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:52.768915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:52.769132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:52.769169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.769173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.769174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.769175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.769176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.769176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.769177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.769178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.769178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.769179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.769179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.769180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.769180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.769181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.769185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.769190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.769191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256106755144937:6199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:52.769193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.769195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.769197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.769199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.769201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.769203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.769205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.769207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.769209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.769211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.769213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.769215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.769219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.769224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.769227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.769230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.769233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.769236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.769239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.769242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.769247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.769251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.769255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.769259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.769263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.769268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.769272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.769275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.769277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.769280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.769283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.769286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.769288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.769290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.769292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.769295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.769297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.769300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.769302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.769304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.769324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:52.772588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256106755144937:6199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:52.772600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256106755144937:6199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:52.772603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256106755144937:6199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:52.772611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:52.772700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:52.773222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:52.773235Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:52.773236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:52.773239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:52.773243Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1805 [2:7556256104378247027:3360]
2025-10-01T14:12:52.773257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:52.773278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:52.773284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.773286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.773287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.773299Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:52.773306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:52.773310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:52.773347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.773351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.773352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.773355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:52.773356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:52.773412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:52.773421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.773428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.773434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.773442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:52.773454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144825:2446], now have 1 active actors on pipe
2025-10-01T14:12:52.773456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144972:6199], now have 1 active actors on pipe
2025-10-01T14:12:52.773462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256104378247022:3360]
2025-10-01T14:12:52.773463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256104378247022:3360]
2025-10-01T14:12:52.773464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256104378247022:3360]
2025-10-01T14:12:52.773473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:52.773482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:52.773485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:52.773488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:52.773490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:52.773491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:52.773493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:52.773518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256104378247022:3360]
2025-10-01T14:12:52.773525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:52.773537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:52.773540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1805
2025-10-01T14:12:52.773545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1805
2025-10-01T14:12:52.773579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.773589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.773608Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:52.773617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.773619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.773621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:52.773626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.773632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:52.773642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.773841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.773851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.773868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.773957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1806 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0
2025-10-01T14:12:52.774302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd7edb0c-9be9716-76540f4e-bb28c22c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:52.776645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0] Write session: try to update token
2025-10-01T14:12:52.776662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:52.790097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1806 sessionId: src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:52.792333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:52.792436Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:52.792457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:52.792458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:52.792459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:52.792466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256104378247022:3360]
2025-10-01T14:12:52.792469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256104378247022:3360]
2025-10-01T14:12:52.792472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256104378247022:3360]
2025-10-01T14:12:52.792500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:52.792506Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:52.792509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:52.792515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.792522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.792539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:52.792544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.792545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:52.792672Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:52.857860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256106755144982:6233]
2025-10-01T14:12:52.858101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1805, pipe: [1:7556256106755144982:6233]
2025-10-01T14:12:52.931105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:52.931514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144982:6233], now have 1 active actors on pipe
2025-10-01T14:12:52.931738Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:52.931729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:52.931759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256106755144982:6233]
2025-10-01T14:12:52.931777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:52.931779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:52.931834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1806 reason: error at write: Disconnected sessionId: src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0
2025-10-01T14:12:52.931996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1806 sessionId: src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0 is DEAD
2025-10-01T14:12:52.932136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:52.932146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0] Write session will restart in 0.005933s
2025-10-01T14:12:52.932171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0] Write session: Do CDS request
2025-10-01T14:12:52.932189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:52.938833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.938933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:52.938947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1807
2025-10-01T14:12:52.939071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:52.939102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:52.939112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:52.939114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:52.939513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1807 sessionId:  describe result for acl check
2025-10-01T14:12:52.939541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:52.939542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:52.939543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:52.939546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256106755145053:6191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:52.939963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256106755145053:6191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:52.941983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:52.942059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256106755145053:6191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:52.943847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:52.944036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:52.944046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:52.944056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:52.944102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:52.944137Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256104378247166:3351]
2025-10-01T14:12:52.944435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256106755145053:6191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:52.944457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256106755145053:6191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:52.944460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256106755145053:6191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:52.944467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:52.944780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:52.945020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:52.945056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:52.945359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:52.945411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.945417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.945418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.945419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.945420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.945421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.945422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.945423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.945425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.945426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.945427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.945428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.945429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.945430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.945436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.945445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.945449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.945453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.945456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.945460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.945464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.945467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.945471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.945475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.945478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.945481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.945485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.945488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.945495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.945502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:52.945508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.945513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:52.945517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.945522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:52.945526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.945531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:52.945537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.945542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:52.945546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.945554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:52.945558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.945563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:52.945572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.945577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:52.945581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.945586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:52.945592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.945597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.945604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.945609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.945614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.945619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.945623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.945631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:52.945636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.945641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:52.945682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:52.949352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:52.949893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:52.949906Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:52.949909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:52.949912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:52.949919Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1806 [2:7556256104378247166:3351]
2025-10-01T14:12:52.949934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:52.949951Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:52.949958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.949962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.949964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.949979Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:52.949988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:52.949994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:52.950044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.950050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.950052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.950056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:52.950058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:52.950125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:52.950133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.950144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:52.950155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:52.950175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:52.950197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755144984:2446], now have 1 active actors on pipe
2025-10-01T14:12:52.950204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256106755145120:6191], now have 1 active actors on pipe
2025-10-01T14:12:52.950212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256104378247160:3351]
2025-10-01T14:12:52.950214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256104378247160:3351]
2025-10-01T14:12:52.950216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256104378247160:3351]
2025-10-01T14:12:52.950228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:52.950244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:52.950247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:52.950250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:52.950252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:52.950263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:52.950266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:52.950298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256104378247160:3351]
2025-10-01T14:12:52.950307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:52.950317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:52.950536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1806
2025-10-01T14:12:52.950555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1806
2025-10-01T14:12:52.950666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.950681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.950708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:52.950724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:52.950729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:52.950731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:52.950743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:52.950754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:52.950772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.950941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.950951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.950965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:52.951040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1807 partition: 0 MaxSeqNo: 45 sessionId: src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0
2025-10-01T14:12:52.951358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a6313c5-fae0ecfe-8984a7d0-2aa13269_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:52.953575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0] Write session: try to update token
2025-10-01T14:12:52.953592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:52.966322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:52.966342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:52.966353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256104378247160:3351]
2025-10-01T14:12:52.966413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:52.966419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:52.966578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:52.966708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:52.966886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:52.966995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1807 sessionId: src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:52.967021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:52.967210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:52.967253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:52.969444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:52.969640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:52.969657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:52.969687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:52.969748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:52.982979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:52.982999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:52.983001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:52.983003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:52.983013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256104378247160:3351]
2025-10-01T14:12:52.983017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256104378247160:3351]
2025-10-01T14:12:52.983021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256104378247160:3351]
2025-10-01T14:12:52.983064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:52.983065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:52.983072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:52.983074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:52.983078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:52.983081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:52.983202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:53.031973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256111050112428:6233]
2025-10-01T14:12:53.032222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1806, pipe: [1:7556256111050112428:6233]
2025-10-01T14:12:53.116736Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:53.123778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.123802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.123989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.124050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.124112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.124178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.124221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.124230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.124292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.124349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.124404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.124461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.124501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.124507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.124563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.124614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.124680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.124737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.124776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.124783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.124838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.124905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.124963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.125023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.125065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.125073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.125129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.125181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.125237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.125297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.125336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.125343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.125399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.125452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.125505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.125561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.125602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.125610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.125665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.125716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.125770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.125823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.125870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.125876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.125933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.125988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.126048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.126107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.126147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.126154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.126213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.126265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.126318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.126391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.126433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.126440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.126495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.126549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.126602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.126657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.126696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.126703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.126746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112428:6233], now have 1 active actors on pipe
2025-10-01T14:12:53.126926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:53.126957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:53.126961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:53.126986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1807 reason: error at write: Disconnected sessionId: src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0
2025-10-01T14:12:53.126990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256111050112428:6233]
2025-10-01T14:12:53.127156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1807 sessionId: src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0 is DEAD
2025-10-01T14:12:53.127267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:53.127277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0] Write session will restart in 0.008855s
2025-10-01T14:12:53.127300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0] Write session: Do CDS request
2025-10-01T14:12:53.127306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:53.127734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:53.135273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:53.136765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:53.136803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.136894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:53.136904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1808
2025-10-01T14:12:53.136996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.137015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:53.137022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:53.137024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:53.137064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:53.137074Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:53.137086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:53.137154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:53.137189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256108673214644:3339]
2025-10-01T14:12:53.137354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1808 sessionId:  describe result for acl check
2025-10-01T14:12:53.137384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:53.137389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:53.137391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:53.137395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256111050112533:6185] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:53.137613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:53.137810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256111050112533:6185] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:53.137848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:53.137897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:53.138208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:53.138252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.138258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.138260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.138261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.138262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.138262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.138263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.138265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.138266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.138267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.138268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.138269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.138270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.138271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.138276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.138285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.138290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.138294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.138298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.138302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.138306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.138310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.138314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.138318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.138322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.138327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.138330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.138334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.138340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.138347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.138355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.138360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.138385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.138391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.138395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.138398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.138403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.138407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.138410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.138415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.138422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.138427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.138432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.138444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.138449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.138454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.138458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.138464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.138468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.138473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.138481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.138487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.138490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.138500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.138508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.138517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.138557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:53.139757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256111050112533:6185] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:53.141723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:53.142015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256111050112533:6185] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:53.142025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256111050112533:6185] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:53.142028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256111050112533:6185] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:53.142034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:53.142410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:53.142421Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:53.142423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:53.142426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:53.142432Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1807 [2:7556256108673214644:3339]
2025-10-01T14:12:53.142445Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:53.142462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:53.142470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.142473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.142475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.142490Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:53.142499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:53.142508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:53.142558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.142564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.142566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.142570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:53.142572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:53.142630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:53.142639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.142650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.142662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.142679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:53.142699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112572:6185], now have 1 active actors on pipe
2025-10-01T14:12:53.142700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1807
2025-10-01T14:12:53.142706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112431:2446], now have 1 active actors on pipe
2025-10-01T14:12:53.142704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1807
2025-10-01T14:12:53.142712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256108673214628:3339]
2025-10-01T14:12:53.142715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256108673214628:3339]
2025-10-01T14:12:53.142717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256108673214628:3339]
2025-10-01T14:12:53.142724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:53.142736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:53.142736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:53.142739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:53.142741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:53.142754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:53.142756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:53.142770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.142778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.142811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256108673214628:3339]
2025-10-01T14:12:53.142822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:53.142826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:53.142834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:53.142845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.142853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.142855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:53.142863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.142874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:53.142907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.143015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.143021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.143033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.143090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1808 partition: 0 MaxSeqNo: 45 sessionId: src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0
2025-10-01T14:12:53.143364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ff6a846-c400c71d-c920dcf6-1c456c79_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:53.145552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0] Write session: try to update token
2025-10-01T14:12:53.145566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:53.157284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1808 sessionId: src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:53.159327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:53.159652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:53.159533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.159554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.159589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:53.161406Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:53.161423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:53.161425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:53.161429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:53.161438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256108673214628:3339]
2025-10-01T14:12:53.161446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256108673214628:3339]
2025-10-01T14:12:53.161450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256108673214628:3339]
2025-10-01T14:12:53.161484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:53.161493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:53.161496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:53.161498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:53.161499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.161501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:53.161618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:53.227043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256111050112579:6233]
2025-10-01T14:12:53.227300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1807, pipe: [1:7556256111050112579:6233]
2025-10-01T14:12:53.306943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:53.314635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.314662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.314832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.314900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.314966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.315030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.315076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.315086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.315187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.315287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.315351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.315414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.315458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.315467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.315527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.315580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.315643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.315702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.315751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.315763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.315834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.315903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.315963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.316024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.316066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.316074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.316133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.316188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.316245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.316311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.316355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.316362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.316425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.316483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.316547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.316614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.316668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.316676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.316736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.316791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.316854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.316915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.316960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.316968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.317030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.317088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.317147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.317207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.317249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.317256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.317319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.317380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.317445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.317511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.317553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.317560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.317624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.317682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.317767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.317835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.317879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.317890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.317944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112579:6233], now have 1 active actors on pipe
2025-10-01T14:12:53.318160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256111050112579:6233]
2025-10-01T14:12:53.318169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:53.318173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:53.318198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1808 reason: error at write: Disconnected sessionId: src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0
2025-10-01T14:12:53.318201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:53.318456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1808 sessionId: src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0 is DEAD
2025-10-01T14:12:53.318549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:53.318557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0] Write session will restart in 0.005650s
2025-10-01T14:12:53.318576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0] Write session: Do CDS request
2025-10-01T14:12:53.318580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:53.318985Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:53.324838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.324940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:53.324954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1809
2025-10-01T14:12:53.325056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.325088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:53.325096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:53.325099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:53.325475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1809 sessionId:  describe result for acl check
2025-10-01T14:12:53.325510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:53.325516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:53.325518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:53.325522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256111050112626:6172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:53.325995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256111050112626:6172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:53.327992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256111050112626:6172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:53.328888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:53.330477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:53.330639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:53.330649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:53.330659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:53.330707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:53.330742Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256108673214788:3333]
2025-10-01T14:12:53.330740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256111050112626:6172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:53.330752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256111050112626:6172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:53.330756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256111050112626:6172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:53.330763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:53.331189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:53.331405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:53.331434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:53.331652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:53.331688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.331692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.331693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.331693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.331694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.331695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.331695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.331696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.331697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.331697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.331698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.331698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.331699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.331700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.331702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.331709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.331711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.331713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.331715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.331717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.331719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.331721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.331723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.331726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.331728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.331730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.331732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.331735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.331739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.331744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.331748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.331751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.331753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.331756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.331758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.331761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.331767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.331770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.331772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.331775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.331777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.331783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.331787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.331793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.331796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.331799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.331801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.331804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.331807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.331813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.331816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.331818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.331824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.331827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.331829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.331835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.331855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:53.335427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:53.336074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:53.336091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:53.336093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:53.336097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:53.336103Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1808 [2:7556256108673214788:3333]
2025-10-01T14:12:53.336120Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:53.336138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:53.336141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.336144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.336146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.336160Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:53.336168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:53.336174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:53.336223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.336230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.336232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.336236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:53.336238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:53.336296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:53.336303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.336315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.336332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.336354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:53.336374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112720:6172], now have 1 active actors on pipe
2025-10-01T14:12:53.336382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112582:2446], now have 1 active actors on pipe
2025-10-01T14:12:53.336389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256108673214782:3333]
2025-10-01T14:12:53.336395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256108673214782:3333]
2025-10-01T14:12:53.336397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256108673214782:3333]
2025-10-01T14:12:53.336392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1808
2025-10-01T14:12:53.336413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:53.336423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:53.336399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1808
2025-10-01T14:12:53.336426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:53.336427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:53.336430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:53.336445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:53.336448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:53.336479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.336487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.336503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256108673214782:3333]
2025-10-01T14:12:53.336515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:53.336531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:53.336542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:53.336548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.336556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.336558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:53.336566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.336579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:53.336603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.336762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.336769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.336781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.336851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1809 partition: 0 MaxSeqNo: 45 sessionId: src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0
2025-10-01T14:12:53.337123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fcfc0538-d54f9c7c-11e145f9-6f42ebf5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:53.339342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0] Write session: try to update token
2025-10-01T14:12:53.339357Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:53.351970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1809 sessionId: src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:53.354282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:53.354501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.354523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.354559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:53.354625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:53.356378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:53.356394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:53.356396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:53.356397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:53.356404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256108673214782:3333]
2025-10-01T14:12:53.356407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256108673214782:3333]
2025-10-01T14:12:53.356412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256108673214782:3333]
2025-10-01T14:12:53.356447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:53.356455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.356456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:53.356461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:53.356466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:53.356473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:53.356566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:53.418540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256111050112745:6233]
2025-10-01T14:12:53.418877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1808, pipe: [1:7556256111050112745:6233]
2025-10-01T14:12:53.495017Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:53.501390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.501416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.501563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.501617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.501676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.501731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.501771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.501779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.501836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.501886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.501940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.501999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.502045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.502054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.502107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.502152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.502204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.502253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.502290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.502295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.502429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.502486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.502538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.502593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.502631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.502636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.502686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.502737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.502786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.502838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.502874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.502878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.502929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.502975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.503027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.503089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.503130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.503135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.503188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.503235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.503285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.503336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.503375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.503382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.503436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.503485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.503545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.503599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.503637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.503642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.503698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.503749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.503804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.503857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.503896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.503900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.503957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.504007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.504061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.504124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.504183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.504188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.504228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112745:6233], now have 1 active actors on pipe
2025-10-01T14:12:53.504468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256111050112745:6233]
2025-10-01T14:12:53.504478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:53.504481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:53.504494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:53.504505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1809 reason: error at write: Disconnected sessionId: src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0
2025-10-01T14:12:53.504738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1809 sessionId: src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0 is DEAD
2025-10-01T14:12:53.504871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:53.504884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0] Write session will restart in 0.007504s
2025-10-01T14:12:53.504909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0] Write session: Do CDS request
2025-10-01T14:12:53.504916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:53.505013Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:53.513930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.513995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:53.514007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1810
2025-10-01T14:12:53.514133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.514163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:53.514172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:53.514175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:53.514578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1810 sessionId:  describe result for acl check
2025-10-01T14:12:53.514608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:53.514613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:53.514614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:53.514617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256111050112858:6166] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:53.515079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256111050112858:6166] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:53.515086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:53.517026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:53.517214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:53.517222Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:53.517232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:53.517286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:53.517323Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256108673214930:3312]
2025-10-01T14:12:53.517328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256111050112858:6166] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:53.517893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:53.518140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:53.518172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:53.518390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:53.518434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.518439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.518439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.518440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.518441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.518442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.518442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.518443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.518443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.518444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.518445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.518445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.518446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.518446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.518450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.518455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.518457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.518460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.518461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.518463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.518465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.518467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.518469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.518471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.518473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.518475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.518477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.518479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.518483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.518488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.518491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.518495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.518497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.518500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.518502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.518505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.518507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.518510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.518512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.518515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.518518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.518520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.518522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.518525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.518527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.518531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.518533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.518536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.518538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.518541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.518544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.518546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.518549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.518552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.518554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.518559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.518581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:53.521844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256111050112858:6166] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:53.521858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256111050112858:6166] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:53.521862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256111050112858:6166] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:53.521870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:53.521999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:53.522605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:53.522616Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:53.522618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:53.522620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:53.522624Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1809 [2:7556256108673214930:3312]
2025-10-01T14:12:53.522633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:53.522646Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:53.522647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.522649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.522651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.522662Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:53.522669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:53.522674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:53.522713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.522717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.522719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.522721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:53.522723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:53.522768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:53.522774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.522781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.522792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.522811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:53.522827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256108673214924:3312]
2025-10-01T14:12:53.522832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256108673214924:3312]
2025-10-01T14:12:53.522834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256108673214924:3312]
2025-10-01T14:12:53.522842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:53.522855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:53.522860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112899:6166], now have 1 active actors on pipe
2025-10-01T14:12:53.522864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112756:2446], now have 1 active actors on pipe
2025-10-01T14:12:53.522865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:53.522867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:53.522871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:53.522882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:53.522890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:53.522913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256108673214924:3312]
2025-10-01T14:12:53.522920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:53.522923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:53.522895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1809
2025-10-01T14:12:53.522913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1809
2025-10-01T14:12:53.522933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.522941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.522985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:53.522995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.523004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.523006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:53.523013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.523022Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:53.523039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.523158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.523166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.523179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.523232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1810 partition: 0 MaxSeqNo: 45 sessionId: src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0
2025-10-01T14:12:53.523558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4b2d2c3-d4ea1b95-82a933a6-d5b5c459_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:53.526005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0] Write session: try to update token
2025-10-01T14:12:53.526021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:53.539112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1810 sessionId: src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:53.541425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:53.541685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.541704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.543524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:53.543540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:53.543543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:53.543545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:53.543554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256108673214924:3312]
2025-10-01T14:12:53.543559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256108673214924:3312]
2025-10-01T14:12:53.543563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256108673214924:3312]
2025-10-01T14:12:53.543608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:53.543621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:53.543627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:53.543627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:53.543630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:53.543634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.543636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:53.543704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:53.543758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:53.604375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256111050112906:6233]
2025-10-01T14:12:53.604607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1809, pipe: [1:7556256111050112906:6233]
2025-10-01T14:12:53.684246Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:53.691127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.691156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.691305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.691362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.691421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.691491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.691543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.691554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.691616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.691677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.691740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.691805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.691850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.691858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.691916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.691969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.692027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.692087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.692127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.692134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.692194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.692246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.692295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.692349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.692389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.692394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.692448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.692507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.692563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.692624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.692674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.692680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.692741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.692799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.692860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.692927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.692971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.692977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.693039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.693101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.693155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.693211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.693249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.693255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.693313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.693365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.693418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.693473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.693519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.693526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.693674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.693733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.693799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.693871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.693920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.693926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.693994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.694057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.694122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.694190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.694234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.694242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.694288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112906:6233], now have 1 active actors on pipe
2025-10-01T14:12:53.694536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:53.694559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:53.694563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256111050112906:6233]
2025-10-01T14:12:53.694586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1810 reason: error at write: Disconnected sessionId: src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0
2025-10-01T14:12:53.694587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:53.694771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1810 sessionId: src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0 is DEAD
2025-10-01T14:12:53.694904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:53.694914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0] Write session will restart in 0.008355s
2025-10-01T14:12:53.694938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0] Write session: Do CDS request
2025-10-01T14:12:53.694944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:53.695151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:53.703666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:53.704899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.704984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:53.704997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1811
2025-10-01T14:12:53.705091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.705119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:53.705129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:53.705132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:53.705380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:53.705500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:53.705508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:53.705515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:53.705508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1811 sessionId:  describe result for acl check
2025-10-01T14:12:53.705545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:53.705545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:53.705552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:53.705554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:53.705559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256111050113014:6155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:53.705575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256108673215074:3323]
2025-10-01T14:12:53.705949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:53.706022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256111050113014:6155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:53.706170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:53.706195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:53.706429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:53.706470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.706475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.706475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.706476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.706477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.706477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.706478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.706479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.706479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.706480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.706480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.706481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.706481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.706482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.706485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.706491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.706493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.706495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.706497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.706500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.706502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.706504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.706506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.706508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.706510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.706513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.706515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.706517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.706522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.706527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.706530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.706533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.706535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.706538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.706541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.706544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.706547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.706550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.706552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.706555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.706558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.706560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.706563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.706566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.706568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.706571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.706573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.706576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.706578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.706581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.706583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.706586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.706589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.706592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.706594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.706597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.706619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:53.708421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256111050113014:6155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:53.710173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:53.710824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:53.710838Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:53.710841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:53.710844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:53.710850Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1810 [2:7556256108673215074:3323]
2025-10-01T14:12:53.710863Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:53.710877Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:53.710879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.710882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.710884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.710899Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:53.710909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:53.710915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:53.710965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.710944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256111050113014:6155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:53.710973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.710975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.710957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256111050113014:6155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:53.710978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:53.710981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:53.710961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256111050113014:6155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:53.710968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:53.711040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:53.711048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.711055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.711061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.711071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:53.711083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050112909:2446], now have 1 active actors on pipe
2025-10-01T14:12:53.711089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256108673215069:3323]
2025-10-01T14:12:53.711090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256108673215069:3323]
2025-10-01T14:12:53.711092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256108673215069:3323]
2025-10-01T14:12:53.711104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:53.711114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:53.711116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:53.711119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:53.711121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:53.711126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:53.711128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:53.711128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1810
2025-10-01T14:12:53.711148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256108673215069:3323]
2025-10-01T14:12:53.711150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:53.711158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:53.711159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050113053:6155], now have 1 active actors on pipe
2025-10-01T14:12:53.711172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1810
2025-10-01T14:12:53.711229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.711236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.711254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:53.711265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.711269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.711271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:53.711279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.711291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:53.711307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.711455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.711467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.711489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.711582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1811 partition: 0 MaxSeqNo: 45 sessionId: src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0
2025-10-01T14:12:53.711912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1d22c-f9bf1ddf-896849b9-300289b8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:53.714410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0] Write session: try to update token
2025-10-01T14:12:53.714423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:53.721318Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:53.721336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:53.721347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256108673215069:3323]
2025-10-01T14:12:53.721390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:53.721391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:53.721557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:53.721700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:53.721835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:53.721958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:53.722126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:53.722158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:53.727352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1811 sessionId: src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:53.729732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:53.729935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.729968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.730008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:53.730088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:53.739464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:53.739480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:53.739481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:53.739483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:53.739490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256108673215069:3323]
2025-10-01T14:12:53.739493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256108673215069:3323]
2025-10-01T14:12:53.739496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256108673215069:3323]
2025-10-01T14:12:53.739528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:53.739532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:53.739535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:53.739536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.739537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:53.739538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:53.739661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:53.794824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256111050113074:6233]
2025-10-01T14:12:53.795034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1810, pipe: [1:7556256111050113074:6233]
2025-10-01T14:12:53.873275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:53.880294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.880317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.880467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.880524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.880582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.880646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.880685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.880694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.880750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.880803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.880852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.880903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.880946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.880951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.881006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.881058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.881111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.881164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.881202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.881207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.881270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.881337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.881405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.881467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.881504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.881511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.881568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.881618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.881670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.881722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.881760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.881765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.881819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.881870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.881922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.881978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.882017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.882022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.882077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.882129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.882184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.882237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.882276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.882281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.882338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.882405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.882461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.882520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.882561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.882566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.882622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.882671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.882724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.882776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.882814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.882819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.882928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:53.882983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:53.883034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:53.883089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:53.883126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:53.883131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:53.883170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050113074:6233], now have 1 active actors on pipe
2025-10-01T14:12:53.883357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:53.883365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:53.883372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:53.883407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256111050113074:6233]
2025-10-01T14:12:53.883407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1811 reason: error at write: Disconnected sessionId: src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0
2025-10-01T14:12:53.883586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1811 sessionId: src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0 is DEAD
2025-10-01T14:12:53.883710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:53.883718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0] Write session will restart in 0.005122s
2025-10-01T14:12:53.883736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0] Write session: Do CDS request
2025-10-01T14:12:53.883741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:53.883989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:53.889810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.889892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:53.889904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1812
2025-10-01T14:12:53.889998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:53.890026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:53.890031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:53.890034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:53.890419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1812 sessionId:  describe result for acl check
2025-10-01T14:12:53.890449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:53.890455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:53.890464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:53.890469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256111050113126:6142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:53.890957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256111050113126:6142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:53.892879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256111050113126:6142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:53.893211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:53.894723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:53.894867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:53.894876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:53.894885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:53.894918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:53.894951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256108673215225:3319]
2025-10-01T14:12:53.895082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256111050113126:6142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:53.895094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256111050113126:6142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:53.895096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256111050113126:6142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:53.895142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:53.895524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:53.895754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:53.895784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:53.896055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:53.896095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.896101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.896102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.896103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.896104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.896105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.896106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.896107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.896108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.896109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.896110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.896111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.896112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.896113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.896117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.896126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.896129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.896133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.896136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.896140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.896143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.896146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.896149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.896153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.896156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.896159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.896162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.896165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.896171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.896177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:53.896182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.896187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:53.896191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.896195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:53.896203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.896208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:53.896212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.896220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:53.896227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.896235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:53.896243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.896247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:53.896255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.896259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:53.896267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.896271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:53.896274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.896279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.896283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.896287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.896293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.896297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.896303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.896307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:53.896312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.896317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:53.896353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:53.899675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:53.900404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:53.900418Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:53.900420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:53.900423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:53.900429Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1811 [2:7556256108673215225:3319]
2025-10-01T14:12:53.900442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:53.900460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:53.900466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.900469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.900472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.900484Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:53.900493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:53.900502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:53.900547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.900553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.900554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.900557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:53.900560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:53.900618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:53.900624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.900646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:53.900660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:53.900674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:53.900694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050113087:2446], now have 1 active actors on pipe
2025-10-01T14:12:53.900702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050113227:6142], now have 1 active actors on pipe
2025-10-01T14:12:53.900709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256108673215220:3319]
2025-10-01T14:12:53.900715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256108673215220:3319]
2025-10-01T14:12:53.900716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256108673215220:3319]
2025-10-01T14:12:53.900728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:53.900743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:53.900746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:53.900749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:53.900752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:53.900739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1811
2025-10-01T14:12:53.900753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1811
2025-10-01T14:12:53.900759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:53.900761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:53.900787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256108673215220:3319]
2025-10-01T14:12:53.900797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:53.900804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:53.900809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.900813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.900847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:53.900856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:53.900860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:53.900873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:53.900880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:53.900889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:53.900904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.901034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.901042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.901055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:53.901136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1812 partition: 0 MaxSeqNo: 45 sessionId: src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0
2025-10-01T14:12:53.901473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f031f310-692c60fa-863e7fc1-cf36ae82_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:53.903643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0] Write session: try to update token
2025-10-01T14:12:53.903656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:53.916081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1812 sessionId: src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:53.918277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:53.920020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:53.920043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:53.920062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:53.920064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:53.920066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:53.920068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:53.920076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256108673215220:3319]
2025-10-01T14:12:53.920081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256108673215220:3319]
2025-10-01T14:12:53.920086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256108673215220:3319]
2025-10-01T14:12:53.920136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:53.920141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:53.920146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:53.920147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:53.920148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:53.920153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:53.920268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:53.983781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256111050113240:6233]
2025-10-01T14:12:53.984039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1811, pipe: [1:7556256111050113240:6233]
2025-10-01T14:12:54.075154Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:54.075433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:54.075480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256111050113240:6233], now have 1 active actors on pipe
2025-10-01T14:12:54.075577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:54.075632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256111050113240:6233]
2025-10-01T14:12:54.075656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:54.075659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:54.075661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:54.075721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1812 reason: error at write: Disconnected sessionId: src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0
2025-10-01T14:12:54.075866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1812 sessionId: src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0 is DEAD
2025-10-01T14:12:54.075988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:54.076000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0] Write session will restart in 0.006666s
2025-10-01T14:12:54.076022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0] Write session: Do CDS request
2025-10-01T14:12:54.076030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:54.083736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.083839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:54.083852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1813
2025-10-01T14:12:54.083943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.083971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:54.083976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:54.083978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:54.084301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:54.084342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1813 sessionId:  describe result for acl check
2025-10-01T14:12:54.084373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:54.084379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:54.084381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:54.084385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256115345080644:6133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:54.084870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256115345080644:6133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:54.085903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:54.086038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:54.086046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:54.086055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:54.086086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:54.086116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256112968182681:3289]
2025-10-01T14:12:54.086708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256115345080644:6133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:54.086710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:54.086926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:54.086959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:54.087239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:54.087281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.087286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.087287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.087288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.087289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.087290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.087290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.087291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.087292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.087293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.087294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.087295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.087296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.087297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.087301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.087308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.087312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.087315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.087318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.087321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.087324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.087327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.087330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.087334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.087337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.087340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.087343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.087346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.087351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.087357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.087362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.087366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.087370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.087374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.087377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.087382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.087385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.087390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.087393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.087397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.087401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.087406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.087410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.087414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.087418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.087422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.087425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.087429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.087433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.087437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.087441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.087445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.087449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.087453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.087457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.087461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.087495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:54.090447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256115345080644:6133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:54.090456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256115345080644:6133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:54.090458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256115345080644:6133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:54.090463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:54.090632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:54.091207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:54.091220Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:54.091222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:54.091225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:54.091230Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1812 [2:7556256112968182681:3289]
2025-10-01T14:12:54.091243Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:54.091255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:54.091258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.091261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.091263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.091276Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:54.091287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:54.091292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:54.091336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.091343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.091345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.091347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:54.091350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:54.091403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:54.091410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.091420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.091429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.091443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:54.091461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345080538:2446], now have 1 active actors on pipe
2025-10-01T14:12:54.091467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345080684:6133], now have 1 active actors on pipe
2025-10-01T14:12:54.091473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256112968182676:3289]
2025-10-01T14:12:54.091475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256112968182676:3289]
2025-10-01T14:12:54.091468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1812
2025-10-01T14:12:54.091477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256112968182676:3289]
2025-10-01T14:12:54.091487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1812
2025-10-01T14:12:54.091491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:54.091502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:54.091508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:54.091510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:54.091512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:54.091519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:54.091522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:54.091557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.091564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.091576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256112968182676:3289]
2025-10-01T14:12:54.091586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:54.091593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:54.091609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:54.091619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.091622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.091624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:54.091631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.091641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:54.091656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.091746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.091752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.091762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.091829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1813 partition: 0 MaxSeqNo: 45 sessionId: src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0
2025-10-01T14:12:54.092139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd4e6ac9-d9bdeaa1-3b46ee09-29fec79d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:54.094522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0] Write session: try to update token
2025-10-01T14:12:54.094537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:54.107860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1813 sessionId: src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:54.110205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:54.111143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.111165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.111184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:54.111188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:54.111190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:54.111192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:54.111200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256112968182676:3289]
2025-10-01T14:12:54.111205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256112968182676:3289]
2025-10-01T14:12:54.111210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256112968182676:3289]
2025-10-01T14:12:54.111250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:54.111263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:54.111266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:54.111272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:54.111278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.111281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:54.111421Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:54.175780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256115345080692:6233]
2025-10-01T14:12:54.176018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1812, pipe: [1:7556256115345080692:6233]
2025-10-01T14:12:54.242159Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:54.242365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:54.242425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345080692:6233], now have 1 active actors on pipe
2025-10-01T14:12:54.242519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:54.242637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256115345080692:6233]
2025-10-01T14:12:54.242697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:54.251941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:54.252560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:54.252570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:54.252596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1813 reason: error at write: Disconnected sessionId: src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0
2025-10-01T14:12:54.252753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1813 sessionId: src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0 is DEAD
2025-10-01T14:12:54.252904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:54.252913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0] Write session will restart in 0.009403s
2025-10-01T14:12:54.252938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0] Write session: Do CDS request
2025-10-01T14:12:54.252944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:54.255952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:54.256163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:54.256179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:54.256192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:54.256253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:54.256288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256112968182856:3297]
2025-10-01T14:12:54.256856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:54.257098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:54.257141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:54.257361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:54.257398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.257403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.257403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.257404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.257405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.257405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.257406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.257406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.257407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.257408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.257408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.257409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.257410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.257410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.257413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.257418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.257421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.257423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.257425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.257427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.257429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.257431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.257433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.257435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.257437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.257439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.257442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.257443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.257448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.257452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.257456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.257459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.257462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.257465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.257467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.257470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.257472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.257474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.257477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.257479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.257482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.257485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.257488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.257491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.257493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.257497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.257499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.257502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.257504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.257507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.257509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.257511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.257513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.257516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.257518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.257521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.257541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:54.260882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:54.261516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:54.261528Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:54.261530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:54.261533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:54.261539Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1813 [2:7556256112968182856:3297]
2025-10-01T14:12:54.261551Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:54.261565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:54.261572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.261575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.261577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.261592Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:54.261601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:54.261607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:54.261654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.261660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.261662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.261665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:54.261667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:54.261712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:54.261717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.261724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.261729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.261738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:54.261757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345080693:2446], now have 1 active actors on pipe
2025-10-01T14:12:54.261768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256112968182850:3297]
2025-10-01T14:12:54.261770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256112968182850:3297]
2025-10-01T14:12:54.261772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256112968182850:3297]
2025-10-01T14:12:54.261784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:54.261800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:54.261806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:54.261809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:54.261811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:54.261819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:54.261822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:54.261842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256112968182850:3297]
2025-10-01T14:12:54.261853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:54.261856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:54.261844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1813
2025-10-01T14:12:54.263889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.263958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:54.263967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1814
2025-10-01T14:12:54.264055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.264081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:54.264089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:54.264092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:54.264433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1814 sessionId:  describe result for acl check
2025-10-01T14:12:54.264461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:54.264466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:54.264467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:54.264470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256115345080811:6120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:54.264874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256115345080811:6120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:54.266934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256115345080811:6120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:54.270827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256115345080811:6120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:54.270837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256115345080811:6120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:54.270839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256115345080811:6120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:54.270845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:54.271046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1813
2025-10-01T14:12:54.271719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345080847:6120], now have 1 active actors on pipe
2025-10-01T14:12:54.271741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.271746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.271760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:54.271765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:54.271770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256112968182850:3297]
2025-10-01T14:12:54.271809Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:54.271820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.271825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.271829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:54.271836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.271850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:54.271862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:54.271996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:54.272021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:54.272115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:54.272229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:54.272338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:54.272487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:54.272518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.272535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:54.272717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.272724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.272735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.272811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1814 partition: 0 MaxSeqNo: 45 sessionId: src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0
2025-10-01T14:12:54.273134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa2577b1-ed87256-a3a9ef1f-56ad25a3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:54.275384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0] Write session: try to update token
2025-10-01T14:12:54.275399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:54.287273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1814 sessionId: src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:54.289525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:54.289669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:54.289683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:54.289685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:54.289686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:54.289695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256112968182850:3297]
2025-10-01T14:12:54.289698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256112968182850:3297]
2025-10-01T14:12:54.289700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256112968182850:3297]
2025-10-01T14:12:54.289738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:54.289739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.289742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:54.289747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.289748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:54.289762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:54.289768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.289773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:54.289880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:54.342690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256115345080849:6233]
2025-10-01T14:12:54.342949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1813, pipe: [1:7556256115345080849:6233]
2025-10-01T14:12:54.424098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:54.424348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345080849:6233], now have 1 active actors on pipe
2025-10-01T14:12:54.424528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:54.424535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256115345080849:6233]
2025-10-01T14:12:54.424539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:54.424549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:54.424553Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:54.424597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1814 reason: error at write: Disconnected sessionId: src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0
2025-10-01T14:12:54.424767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1814 sessionId: src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0 is DEAD
2025-10-01T14:12:54.424898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:54.424907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0] Write session will restart in 0.005127s
2025-10-01T14:12:54.424929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0] Write session: Do CDS request
2025-10-01T14:12:54.424934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:54.430835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.430841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:54.430852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1815
2025-10-01T14:12:54.431031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.431059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:54.431067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:54.431070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:54.431365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1815 sessionId:  describe result for acl check
2025-10-01T14:12:54.431391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:54.431396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:54.431397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:54.431401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256115345080930:6117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:54.431817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256115345080930:6117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:54.433298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256115345080930:6117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:54.433481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:54.435048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:54.435221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:54.435233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:54.435243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:54.435295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:54.435295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256115345080930:6117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:54.435305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256115345080930:6117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:54.435307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256115345080930:6117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:54.435312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:54.435329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256112968183002:3291]
2025-10-01T14:12:54.435871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:54.436083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:54.436123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:54.436414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:54.436467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.436473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.436474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.436475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.436476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.436478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.436479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.436479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.436481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.436482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.436483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.436484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.436485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.436486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.436490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.436500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.436504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.436507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.436515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.436523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.436529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.436534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.436539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.436543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.436550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.436554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.436561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.436564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.436574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.436585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.436594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.436603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.436611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.436615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.436623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.436640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.436648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.436657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.436664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.436673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.436681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.436686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.436694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.436699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.436703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.436711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.436718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.436723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.436731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.436740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.436747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.436755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.436762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.436766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.436773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.436778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.436822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:54.440273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:54.440802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:54.440814Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:54.440817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:54.440819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:54.440824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1814 [2:7556256112968183002:3291]
2025-10-01T14:12:54.440835Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:54.440845Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:54.440847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.440849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.440850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.440861Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:54.440868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:54.440872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:54.440906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.440914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.440915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.440917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:54.440918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:54.440966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:54.440971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.440977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.440983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.440992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:54.441006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256112968182997:3291]
2025-10-01T14:12:54.441011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256112968182997:3291]
2025-10-01T14:12:54.441012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256112968182997:3291]
2025-10-01T14:12:54.441018Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:54.441027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081011:6117], now have 1 active actors on pipe
2025-10-01T14:12:54.441027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:54.441030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:54.441032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:54.441033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345080867:2446], now have 1 active actors on pipe
2025-10-01T14:12:54.441039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:54.441046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:54.441048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:54.441067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256112968182997:3291]
2025-10-01T14:12:54.441075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:54.441083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:54.441088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1814
2025-10-01T14:12:54.441091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1814
2025-10-01T14:12:54.441119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.441125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.441142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:54.441150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.441152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.441154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:54.441160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.441169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:54.441177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.441285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.441290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.441300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.441365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1815 partition: 0 MaxSeqNo: 45 sessionId: src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0
2025-10-01T14:12:54.441649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8587f5c4-4eacd9cd-4209d08d-53d72eae_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:54.443756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0] Write session: try to update token
2025-10-01T14:12:54.443770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:54.455385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1815 sessionId: src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:54.457651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:54.457794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.457811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.457843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:54.457905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:54.459843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:54.459856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:54.459858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:54.459859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:54.459867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256112968182997:3291]
2025-10-01T14:12:54.459870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256112968182997:3291]
2025-10-01T14:12:54.459872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256112968182997:3291]
2025-10-01T14:12:54.459902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:54.459912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:54.459914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:54.459921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.459922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:54.459927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:54.460045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:54.524453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256115345081029:6233]
2025-10-01T14:12:54.524700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1814, pipe: [1:7556256115345081029:6233]
2025-10-01T14:12:54.601650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:54.608079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.608106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.608251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.608304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.608368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.608424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.608668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.608680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.608750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.608810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.608864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.608921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.608966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.608980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.609039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.609086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.609136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.609184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.609222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.609226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.609277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.609327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.609374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.609420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.609459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.609464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.609518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.609570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.609618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.609668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.609705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.609712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.609764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.609812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.609865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.609917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.610021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.610030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.610084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.610130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.610181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.610232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.610268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.610273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.610326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.610389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.610437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.610487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.610531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.610538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.610595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.610646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.610698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.610751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.610792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.610797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.610851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:54.610901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:54.610951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:54.611001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:54.611041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:54.611049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:54.611088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081029:6233], now have 1 active actors on pipe
2025-10-01T14:12:54.611321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:54.611331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256115345081029:6233]
2025-10-01T14:12:54.611334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:54.611347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:54.611359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1815 reason: error at write: Disconnected sessionId: src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0
2025-10-01T14:12:54.611518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1815 sessionId: src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0 is DEAD
2025-10-01T14:12:54.611566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:54.611670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:54.611680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0] Write session will restart in 0.008492s
2025-10-01T14:12:54.611702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0] Write session: Do CDS request
2025-10-01T14:12:54.611708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:54.620361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:54.620822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.620892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:54.620904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1816
2025-10-01T14:12:54.621009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.621034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:54.621043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:54.621046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:54.621329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1816 sessionId:  describe result for acl check
2025-10-01T14:12:54.621356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:54.621360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:54.621361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:54.621365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256115345081141:6109] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:54.621710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256115345081141:6109] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:54.621914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:54.622070Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:54.622079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:54.622088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:54.622131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:54.622203Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256112968183152:3295]
2025-10-01T14:12:54.622693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:54.622878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:54.622907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:54.623153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:54.623187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.623191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.623191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.623192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.623193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.623193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.623194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.623194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.623195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.623195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.623196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.623197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.623197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.623198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.623201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.623206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.623208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.623210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.623212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.623215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.623217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.623219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.623221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.623223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.623225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.623227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.623229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.623231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.623235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.623239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.623243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.623246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.623251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.623255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.623259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.623263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.623267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.623271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.623288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.623292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.623295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.623298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.623300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.623302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.623305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.623307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.623309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.623312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.623314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.623317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.623319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.623322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.623324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.623326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.623328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.623331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.623350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:54.623572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256115345081141:6109] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:54.626292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256115345081141:6109] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:54.626303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256115345081141:6109] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:54.626305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256115345081141:6109] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:54.626310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:54.626590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:54.627131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:54.627141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:54.627143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:54.627145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:54.627149Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1815 [2:7556256112968183152:3295]
2025-10-01T14:12:54.627159Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:54.627173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:54.627175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.627176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.627178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.627187Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:54.627194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:54.627198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:54.627232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.627237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.627238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.627241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:54.627243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:54.627295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:54.627301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.627309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.627321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.627338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:54.627355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081179:6109], now have 1 active actors on pipe
2025-10-01T14:12:54.627361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081031:2446], now have 1 active actors on pipe
2025-10-01T14:12:54.627368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256112968183147:3295]
2025-10-01T14:12:54.627369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256112968183147:3295]
2025-10-01T14:12:54.627370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256112968183147:3295]
2025-10-01T14:12:54.627381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:54.627390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:54.627398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:54.627400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:54.627401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:54.627403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:54.627405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:54.627422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256112968183147:3295]
2025-10-01T14:12:54.627430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:54.627431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:54.627448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1815
2025-10-01T14:12:54.627451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1815
2025-10-01T14:12:54.627503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.627511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.627536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:54.627545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.627549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.627554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:54.627560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.627566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:54.627576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.627700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.627708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.627719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.627779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1816 partition: 0 MaxSeqNo: 45 sessionId: src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0
2025-10-01T14:12:54.628051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dc91ff1-7730e6a3-c7cd9b4a-89af8314_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:54.630326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0] Write session: try to update token
2025-10-01T14:12:54.630340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:54.642681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1816 sessionId: src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:54.644768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:54.646341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.646366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.646400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:54.646408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:54.646414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:54.646420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:54.646428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256112968183147:3295]
2025-10-01T14:12:54.646432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256112968183147:3295]
2025-10-01T14:12:54.646436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256112968183147:3295]
2025-10-01T14:12:54.646473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:54.646484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:54.646488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:54.646488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:54.646493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.646496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:54.646617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:54.711322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256115345081188:6233]
2025-10-01T14:12:54.711542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1815, pipe: [1:7556256115345081188:6233]
2025-10-01T14:12:54.779550Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:54.779953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:54.780003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081188:6233], now have 1 active actors on pipe
2025-10-01T14:12:54.780079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:54.780186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256115345081188:6233]
2025-10-01T14:12:54.780214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:54.788416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:54.788426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:54.788445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1816 reason: error at write: Disconnected sessionId: src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0
2025-10-01T14:12:54.788565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1816 sessionId: src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0 is DEAD
2025-10-01T14:12:54.788768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:54.788779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0] Write session will restart in 0.008980s
2025-10-01T14:12:54.788805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0] Write session: Do CDS request
2025-10-01T14:12:54.788814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:54.791373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:54.792981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:54.793130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:54.793138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:54.793145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:54.793174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:54.793199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256112968183303:3287]
2025-10-01T14:12:54.793576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:54.793760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:54.793784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:54.793960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:54.793994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.793998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.793998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.793999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.794000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.794000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.794001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.794001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.794002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.794003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.794003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.794004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.794004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.794005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.794007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.794013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.794015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.794017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.794019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.794021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.794023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.794025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.794027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.794029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.794031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.794033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.794035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.794037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.794042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.794046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.794050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.794053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.794055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.794058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.794061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.794064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.794066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.794068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.794070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.794073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.794076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.794078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.794081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.794087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.794090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.794092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.794095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.794101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.794103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.794106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.794108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.794111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.794113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.794116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.794118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.794121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.794141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:54.797327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:54.797850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:54.797861Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:54.797863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:54.797865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:54.797870Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1816 [2:7556256112968183303:3287]
2025-10-01T14:12:54.797882Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:54.797893Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:54.797898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.797901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.797902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.797914Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:54.797920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:54.797924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:54.797954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.797958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.797959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.797961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:54.797963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:54.798009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:54.798016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.798022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.798027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.798036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:54.798048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081189:2446], now have 1 active actors on pipe
2025-10-01T14:12:54.798053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256112968183297:3287]
2025-10-01T14:12:54.798054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256112968183297:3287]
2025-10-01T14:12:54.798055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256112968183297:3287]
2025-10-01T14:12:54.798100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1816
2025-10-01T14:12:54.798064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:54.798076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:54.798078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:54.798081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:54.798082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:54.798085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:54.798086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:54.798101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256112968183297:3287]
2025-10-01T14:12:54.798103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:54.798112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:54.798855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.798937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:54.798948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1817
2025-10-01T14:12:54.799040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.799063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:54.799067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:54.799070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:54.799376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1817 sessionId:  describe result for acl check
2025-10-01T14:12:54.799397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:54.799401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:54.799402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:54.799405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256115345081311:6110] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:54.800067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256115345081311:6110] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:54.801557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256115345081311:6110] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:54.806252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256115345081311:6110] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:54.806263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256115345081311:6110] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:54.806266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256115345081311:6110] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:54.806272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:54.806609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081348:6110], now have 1 active actors on pipe
2025-10-01T14:12:54.806645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1816
2025-10-01T14:12:54.806705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.806716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.806761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e280ae6a-e3be1f44-827a4390-8928b462_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:54.806775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.806780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.806783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:54.806797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.806810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:54.807641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.807671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:54.807679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:54.807686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256112968183297:3287]
2025-10-01T14:12:54.807703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:54.807707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:54.807842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:54.807964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:54.808084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:54.808209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:54.808372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:54.808403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.808410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.808419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:54.808439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.808541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1817 partition: 0 MaxSeqNo: 45 sessionId: src_id|e280ae6a-e3be1f44-827a4390-8928b462_0
2025-10-01T14:12:54.808866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f5ddde35-1ae2ebc5-3875cb61-b610f761_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e280ae6a-e3be1f44-827a4390-8928b462_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:54.811080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e280ae6a-e3be1f44-827a4390-8928b462_0] Write session: try to update token
2025-10-01T14:12:54.811095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e280ae6a-e3be1f44-827a4390-8928b462_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:54.823721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1817 sessionId: src_id|e280ae6a-e3be1f44-827a4390-8928b462_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:54.825148Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:54.825163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:54.825165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:54.825166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:54.825173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256112968183297:3287]
2025-10-01T14:12:54.825175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256112968183297:3287]
2025-10-01T14:12:54.825178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256112968183297:3287]
2025-10-01T14:12:54.825213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:54.825221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.825222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:54.825334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:54.825404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:54.825415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:54.825417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:54.825946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:54.880266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256115345081372:6233]
2025-10-01T14:12:54.880525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1816, pipe: [1:7556256115345081372:6233]
2025-10-01T14:12:54.957383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:54.957775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.957787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.957805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081372:6233], now have 1 active actors on pipe
2025-10-01T14:12:54.958001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:54.958027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256115345081372:6233]
2025-10-01T14:12:54.958045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:54.958067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:54.958135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1817 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e280ae6a-e3be1f44-827a4390-8928b462_0
2025-10-01T14:12:54.958321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1817 sessionId: src_id|e280ae6a-e3be1f44-827a4390-8928b462_0 is DEAD
2025-10-01T14:12:54.958441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280ae6a-e3be1f44-827a4390-8928b462_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:54.958449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280ae6a-e3be1f44-827a4390-8928b462_0] Write session will restart in 0.005675s
2025-10-01T14:12:54.958468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280ae6a-e3be1f44-827a4390-8928b462_0] Write session: Do CDS request
2025-10-01T14:12:54.958472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280ae6a-e3be1f44-827a4390-8928b462_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:54.964848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e280ae6a-e3be1f44-827a4390-8928b462_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.964961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:54.964974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1818
2025-10-01T14:12:54.965082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:54.965114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:54.965123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:54.965126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:54.965547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1818 sessionId:  describe result for acl check
2025-10-01T14:12:54.965577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:54.965583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:54.965585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:54.965591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256115345081442:6091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:54.966048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256115345081442:6091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:54.967715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:54.968129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256115345081442:6091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:54.968195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:54.968366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:54.968376Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:54.968388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:54.968434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:54.968473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256112968183459:3276]
2025-10-01T14:12:54.969062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:54.969667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:54.969712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:54.970009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:54.970062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.970069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.970070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.970071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.970072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.970074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.970075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.970076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.970077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.970078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.970079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.970080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.970081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.970082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.970087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.970096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.970101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.970105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.970109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.970113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.970116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.970119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.970122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.970126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.970130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.970133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.970137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.970141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.970147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.970155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:54.970161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.970166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:54.970171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.970176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:54.970180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.970185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:54.970190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.970194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:54.970198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.970204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:54.970208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.970216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:54.970220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.970224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:54.970234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.970240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:54.970248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.970253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.970260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.970265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.970274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.970279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.970288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.970292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:54.970297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.970302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:54.970343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:54.970507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256115345081442:6091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:54.970518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256115345081442:6091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:54.970523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256115345081442:6091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:54.970530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:54.974020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:54.974615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:54.974629Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:54.974631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:54.974634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:54.974639Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1817 [2:7556256112968183459:3276]
2025-10-01T14:12:54.974650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:54.974665Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:54.974672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.974676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.974678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.974694Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:54.974704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:54.974714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:54.974758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.974762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.974764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.974766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:54.974768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:54.974816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:54.974821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:54.974828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:54.974837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:54.974850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:54.974864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256112968183454:3276]
2025-10-01T14:12:54.974869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256112968183454:3276]
2025-10-01T14:12:54.974870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256112968183454:3276]
2025-10-01T14:12:54.974877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:54.974887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:54.974888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:54.974891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:54.974893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:54.974900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:54.974901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:54.974909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081524:6091], now have 1 active actors on pipe
2025-10-01T14:12:54.974912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256115345081376:2446], now have 1 active actors on pipe
2025-10-01T14:12:54.974934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256112968183454:3276]
2025-10-01T14:12:54.974943Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:54.974955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:54.974967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1817
2025-10-01T14:12:54.974977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1817
2025-10-01T14:12:54.975019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.975026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.975044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:54.975053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:54.975056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:54.975057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:54.975064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:54.975070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:54.975083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.975220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.975244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.975261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:54.975355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1818 partition: 0 MaxSeqNo: 45 sessionId: src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0
2025-10-01T14:12:54.975708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e280ae6a-e3be1f44-827a4390-8928b462_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:54.978097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0] Write session: try to update token
2025-10-01T14:12:54.978113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:54.986015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:54.986038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:54.986048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256112968183454:3276]
2025-10-01T14:12:54.986082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:54.986091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:54.986244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:54.986393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:54.986520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:54.986640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:54.986819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:54.986856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:54.990887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1818 sessionId: src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:54.993055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:54.993222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:54.993243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:54.993277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:54.993354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:55.005007Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:55.005025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:55.005027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:55.005028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:55.005036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256112968183454:3276]
2025-10-01T14:12:55.005039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256112968183454:3276]
2025-10-01T14:12:55.005042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256112968183454:3276]
2025-10-01T14:12:55.005083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:55.005085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:55.005088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:55.005091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:55.005094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.005096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:55.005205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:55.057973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256119640048828:6233]
2025-10-01T14:12:55.058251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1817, pipe: [1:7556256119640048828:6233]
2025-10-01T14:12:55.135383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:55.141700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.141723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.141836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.141895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.141950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.142002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.142040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.142047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.142104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.142157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.142211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.142264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.142302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.142307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.142357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.142417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.142467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.142514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.142553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.142559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.142610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.142656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.142707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.142761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.142796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.142801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.142849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.142894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.142946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.143003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.143043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.143048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.143103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.143154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.143203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.143255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.143292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.143297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.143360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.143419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.143474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.143523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.143568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.143575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.143634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.143687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.143737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.143788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.143824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.143829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.143879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.143928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.143979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.144035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.144074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.144079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.144129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.144175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.144223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.144272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.144307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.144312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.144345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640048828:6233], now have 1 active actors on pipe
2025-10-01T14:12:55.144556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:55.144568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:55.144568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256119640048828:6233]
2025-10-01T14:12:55.144590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:55.144592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1818 reason: error at write: Disconnected sessionId: src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0
2025-10-01T14:12:55.144791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1818 sessionId: src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0 is DEAD
2025-10-01T14:12:55.144900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:55.144910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0] Write session will restart in 0.005920s
2025-10-01T14:12:55.144936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0] Write session: Do CDS request
2025-10-01T14:12:55.144941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:55.145050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:55.151838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.151893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:55.151906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1819
2025-10-01T14:12:55.152053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.152084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:55.152096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:55.152099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:55.152387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1819 sessionId:  describe result for acl check
2025-10-01T14:12:55.152409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:55.152410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:55.152413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:55.152416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256119640048948:6083] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:55.152804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256119640048948:6083] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:55.153651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:55.154684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256119640048948:6083] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:55.155048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:55.155218Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:55.155229Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:55.155241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:55.155285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:55.155325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256117263150951:3250]
2025-10-01T14:12:55.155834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:55.156049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:55.156083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:55.156345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:55.156393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.156399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.156399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.156400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.156401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.156402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.156402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.156403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.156404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.156405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.156406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.156407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.156407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.156408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.156412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.156421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.156424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.156427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.156429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.156432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.156435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.156438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.156454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.156457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.156460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.156463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.156466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.156468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.156475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.156481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.156486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.156490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.156493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.156497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.156501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.156505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.156508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.156512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.156515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.156523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.156527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.156531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.156535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.156538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.156546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.156550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.156557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.156561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.156564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.156568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.156571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.156575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.156578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.156581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.156585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.156588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.156618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:55.156614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256119640048948:6083] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:55.156624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256119640048948:6083] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:55.156633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256119640048948:6083] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:55.156639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:55.159902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:55.160428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:55.160441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:55.160443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:55.160446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:55.160452Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1818 [2:7556256117263150951:3250]
2025-10-01T14:12:55.160464Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:55.160481Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:55.160488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.160491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.160495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.160508Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:55.160518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:55.160527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:55.160576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.160582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.160584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.160587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:55.160589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:55.160732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1818
2025-10-01T14:12:55.160756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:55.160737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1818
2025-10-01T14:12:55.160764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.160774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.160784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.160800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:55.160820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640048837:2446], now have 1 active actors on pipe
2025-10-01T14:12:55.160827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640048985:6083], now have 1 active actors on pipe
2025-10-01T14:12:55.160845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.160853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.160869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256117263150946:3250]
2025-10-01T14:12:55.160875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256117263150946:3250]
2025-10-01T14:12:55.160877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256117263150946:3250]
2025-10-01T14:12:55.160888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:55.160900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:55.160903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:55.160905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:55.160907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:55.160917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:55.160924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:55.160938Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:55.160947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.160954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.160956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:55.160964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.160976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:55.160998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256117263150946:3250]
2025-10-01T14:12:55.161008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:55.161020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:55.161022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.161134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.161143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.161157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.161225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1819 partition: 0 MaxSeqNo: 45 sessionId: src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0
2025-10-01T14:12:55.161509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ff24b01-cf508c74-2aa4e005-1e4cdf31_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:55.163783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0] Write session: try to update token
2025-10-01T14:12:55.163796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:55.171191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:55.171204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:55.171211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256117263150946:3250]
2025-10-01T14:12:55.171244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:55.171248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:55.171377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:55.171495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:55.171624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:55.171746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:55.171901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:55.171930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:55.175524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1819 sessionId: src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:55.177831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:55.178074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.178091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.178117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:55.178204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:55.189713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:55.189731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:55.189733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:55.189735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:55.189744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256117263150946:3250]
2025-10-01T14:12:55.189749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256117263150946:3250]
2025-10-01T14:12:55.189754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256117263150946:3250]
2025-10-01T14:12:55.189793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:55.189798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:55.189804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:55.189804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.189806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:55.189806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:55.189927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:55.244845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256119640048995:6233]
2025-10-01T14:12:55.245318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1818, pipe: [1:7556256119640048995:6233]
2025-10-01T14:12:55.324763Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:55.330948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.330971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.331104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.331155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.331207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.331258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.331300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.331309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.331372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.331428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.331479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.331529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.331567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.331572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.331628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.331678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.331727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.331775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.331816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.331827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.331879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.331937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.331994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.332050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.332085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.332090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.332138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.332185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.332232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.332279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.332318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.332326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.332378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.332432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.332479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.332528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.332565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.332569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.332619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.332673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.332720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.332768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.332804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.332809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.332867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.332920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.332974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.333027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.333069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.333075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.333130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.333180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.333232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.333284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.333320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.333325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.333380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.333427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.333476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.333527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.333562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.333567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.333605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640048995:6233], now have 1 active actors on pipe
2025-10-01T14:12:55.333798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:55.333810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256119640048995:6233]
2025-10-01T14:12:55.333847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:55.333855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:55.333885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1819 reason: error at write: Disconnected sessionId: src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0
2025-10-01T14:12:55.334098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1819 sessionId: src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0 is DEAD
2025-10-01T14:12:55.334235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:55.334245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0] Write session will restart in 0.005322s
2025-10-01T14:12:55.334269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0] Write session: Do CDS request
2025-10-01T14:12:55.334275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:55.334305Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:55.340818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.340932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:55.340943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1820
2025-10-01T14:12:55.341035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.341062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:55.341069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:55.341072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:55.341409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1820 sessionId:  describe result for acl check
2025-10-01T14:12:55.341441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:55.341446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:55.341448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:55.341453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256119640049120:6076] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:55.341681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:55.341832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256119640049120:6076] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:55.343222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:55.343411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:55.343423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:55.343434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:55.343485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:55.343518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256117263151104:3248]
2025-10-01T14:12:55.344047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:55.344049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256119640049120:6076] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:55.344305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:55.344342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:55.344604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:55.344677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.344683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.344684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.344685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.344686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.344687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.344688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.344689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.344690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.344691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.344692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.344693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.344694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.344696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.344700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.344708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.344711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.344715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.344718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.344721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.344724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.344727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.344731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.344734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.344737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.344740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.344744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.344747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.344753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.344764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.344773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.344782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.344790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.344799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.344807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.344816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.344824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.344833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.344840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.344844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.344853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.344862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.344869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.344873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.344878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.344886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.344890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.344897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.344901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.344904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.344908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.344916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.344920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.344925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.344932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.344937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.344977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:55.347983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256119640049120:6076] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:55.347997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256119640049120:6076] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:55.347999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256119640049120:6076] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:55.348005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:55.348257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:55.348823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:55.348837Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:55.348839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:55.348842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:55.348848Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1819 [2:7556256117263151104:3248]
2025-10-01T14:12:55.348862Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:55.348880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:55.348886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.348890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.348895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.348909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:55.348918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:55.348927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:55.348979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.348985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.348987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.348990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:55.348993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:55.349050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:55.349057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.349067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.349082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.349103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:55.349113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1819
2025-10-01T14:12:55.349123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049159:6076], now have 1 active actors on pipe
2025-10-01T14:12:55.349130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640048998:2446], now have 1 active actors on pipe
2025-10-01T14:12:55.349137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256117263151099:3248]
2025-10-01T14:12:55.349139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256117263151099:3248]
2025-10-01T14:12:55.349141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256117263151099:3248]
2025-10-01T14:12:55.349149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:55.349154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:55.349156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:55.349158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:55.349160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:55.349162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1819
2025-10-01T14:12:55.349173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:55.349180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:55.349196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.349203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.349235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256117263151099:3248]
2025-10-01T14:12:55.349246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:55.349255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:55.349263Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|46b930f0-f40deaaf-200bb46b-13662441_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:55.349269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.349274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.349276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:55.349284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.349291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:55.349320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.349444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.349454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.349470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.349546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1820 partition: 0 MaxSeqNo: 45 sessionId: src_id|46b930f0-f40deaaf-200bb46b-13662441_0
2025-10-01T14:12:55.349868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37c23d79-1355ca24-3703958d-28cbbfa0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|46b930f0-f40deaaf-200bb46b-13662441_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:55.352225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46b930f0-f40deaaf-200bb46b-13662441_0] Write session: try to update token
2025-10-01T14:12:55.352241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46b930f0-f40deaaf-200bb46b-13662441_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:55.359062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:55.359079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:55.359088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256117263151099:3248]
2025-10-01T14:12:55.359124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:55.359140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:55.359270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:55.359387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:55.359512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:55.359636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:55.359805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:55.359837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:55.365198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1820 sessionId: src_id|46b930f0-f40deaaf-200bb46b-13662441_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:55.367446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:55.367605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.367622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.367650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:55.367719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:55.376447Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:55.376466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:55.376467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:55.376469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:55.376476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256117263151099:3248]
2025-10-01T14:12:55.376479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256117263151099:3248]
2025-10-01T14:12:55.376481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256117263151099:3248]
2025-10-01T14:12:55.376508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:55.376512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:55.376515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:55.376515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:55.376520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.376521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:55.376657Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:55.433724Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256119640049181:6233]
2025-10-01T14:12:55.433961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1819, pipe: [1:7556256119640049181:6233]
2025-10-01T14:12:55.512884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:55.519053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.519077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.519206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.519258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.519309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.519359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.519398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.519409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.519468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.519519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.519568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.519616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.519655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.519660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.519714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.519764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.519813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.519867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.519904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.519909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.519962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.520013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.520066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.520116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.520154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.520160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.520215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.520265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.520313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.520362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.520399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.520404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.520458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.520506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.520559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.520608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.520656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.520661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.520712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.520760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.520811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.520864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.520901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.520905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.520957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.521006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.521055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.521102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.521140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.521144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.521194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.521241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.521289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.521819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:55.521336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.521835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:55.521846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256119640049181:6233]
2025-10-01T14:12:55.521374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.521376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.521857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1820 reason: error at write: Disconnected sessionId: src_id|46b930f0-f40deaaf-200bb46b-13662441_0
2025-10-01T14:12:55.521423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.521467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.521511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.521552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.521582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.521584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.521622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049181:6233], now have 1 active actors on pipe
2025-10-01T14:12:55.521872Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:55.522011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1820 sessionId: src_id|46b930f0-f40deaaf-200bb46b-13662441_0 is DEAD
2025-10-01T14:12:55.522138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46b930f0-f40deaaf-200bb46b-13662441_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:55.522150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46b930f0-f40deaaf-200bb46b-13662441_0] Write session will restart in 0.008886s
2025-10-01T14:12:55.522174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46b930f0-f40deaaf-200bb46b-13662441_0] Write session: Do CDS request
2025-10-01T14:12:55.522181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46b930f0-f40deaaf-200bb46b-13662441_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:55.522344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:55.531476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:55.531819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|46b930f0-f40deaaf-200bb46b-13662441_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.531894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:55.531907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1821
2025-10-01T14:12:55.532017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.532047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:55.532056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:55.532059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:55.532359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1821 sessionId:  describe result for acl check
2025-10-01T14:12:55.532387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:55.532391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:55.532392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:55.532395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256119640049304:6066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:55.532780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256119640049304:6066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:55.533506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:55.533662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:55.533671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:55.533682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:55.533730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:55.533765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256117263151256:3246]
2025-10-01T14:12:55.534307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:55.534559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:55.534587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:55.534785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:55.534818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.534822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.534823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.534823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.534824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.534825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.534825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.534826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.534827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.534827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.534828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.534829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.534829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.534830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.534833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.534838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.534840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.534842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.534844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.534846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.534849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.534851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.534853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.534855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.534857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.534859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.534861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.534863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.534868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.534893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.534879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256119640049304:6066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:55.534897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.534900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.534903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.534905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.534908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.534910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.534912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.534915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.534918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.534920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.534923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.534926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.534929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.534931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.534934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.534937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.534939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.534942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.534944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.534948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.534950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.534952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.534955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.534957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.534960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.534962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.534981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:55.537936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256119640049304:6066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:55.537948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256119640049304:6066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:55.537950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256119640049304:6066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:55.537955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:55.538188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:55.538803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:55.538817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:55.538819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:55.538822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:55.538830Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1820 [2:7556256117263151256:3246]
2025-10-01T14:12:55.538841Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:55.538853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:55.538855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.538857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.538858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.538870Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:55.538873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:55.538877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:55.538913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.538919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.538920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.538922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:55.538924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:55.538972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:55.538977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.538984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.538989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.538998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:55.539012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256117263151251:3246]
2025-10-01T14:12:55.539017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256117263151251:3246]
2025-10-01T14:12:55.539020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256117263151251:3246]
2025-10-01T14:12:55.539031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:55.539039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:55.539045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049189:2446], now have 1 active actors on pipe
2025-10-01T14:12:55.539048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049343:6066], now have 1 active actors on pipe
2025-10-01T14:12:55.539049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:55.539052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:55.539054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:55.539065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:55.539068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:55.539070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1820
2025-10-01T14:12:55.539089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256117263151251:3246]
2025-10-01T14:12:55.539086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1820
2025-10-01T14:12:55.539096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:55.539098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:55.539116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.539119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.539149Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af16c9b4-bb693689-ee4d624-a6489d98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:55.539160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.539164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.539166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:55.539174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.539182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:55.539205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.539305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.539312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.539324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.539390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1821 partition: 0 MaxSeqNo: 45 sessionId: src_id|af16c9b4-bb693689-ee4d624-a6489d98_0
2025-10-01T14:12:55.539658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|46b930f0-f40deaaf-200bb46b-13662441_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|af16c9b4-bb693689-ee4d624-a6489d98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:55.542117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af16c9b4-bb693689-ee4d624-a6489d98_0] Write session: try to update token
2025-10-01T14:12:55.542135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af16c9b4-bb693689-ee4d624-a6489d98_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:55.555018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1821 sessionId: src_id|af16c9b4-bb693689-ee4d624-a6489d98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:55.557257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:55.558063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.558087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.558104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:55.558107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:55.558109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:55.558110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:55.558116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256117263151251:3246]
2025-10-01T14:12:55.558120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256117263151251:3246]
2025-10-01T14:12:55.558125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256117263151251:3246]
2025-10-01T14:12:55.558171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:55.558179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.558180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:55.558185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:55.558194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:55.558198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:55.558296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:55.622198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256119640049350:6233]
2025-10-01T14:12:55.622459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1820, pipe: [1:7556256119640049350:6233]
2025-10-01T14:12:55.690356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:55.690825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:55.690882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049350:6233], now have 1 active actors on pipe
2025-10-01T14:12:55.690993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:55.691116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:55.691158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256119640049350:6233]
2025-10-01T14:12:55.700535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:55.700547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:55.700567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1821 reason: error at write: Disconnected sessionId: src_id|af16c9b4-bb693689-ee4d624-a6489d98_0
2025-10-01T14:12:55.700723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1821 sessionId: src_id|af16c9b4-bb693689-ee4d624-a6489d98_0 is DEAD
2025-10-01T14:12:55.700841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af16c9b4-bb693689-ee4d624-a6489d98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:55.700850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af16c9b4-bb693689-ee4d624-a6489d98_0] Write session will restart in 0.006036s
2025-10-01T14:12:55.700869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af16c9b4-bb693689-ee4d624-a6489d98_0] Write session: Do CDS request
2025-10-01T14:12:55.700876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af16c9b4-bb693689-ee4d624-a6489d98_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:55.705608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:55.707147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:55.707319Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:55.707329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:55.707339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:55.707379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:55.707417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256117263151413:3245]
2025-10-01T14:12:55.707798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af16c9b4-bb693689-ee4d624-a6489d98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.707906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:55.707917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1822
2025-10-01T14:12:55.708015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.708035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:55.708044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:55.708051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:55.708056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:55.708269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:55.708307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:55.708345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1822 sessionId:  describe result for acl check
2025-10-01T14:12:55.708369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:55.708373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:55.708375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:55.708378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256119640049472:6065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:55.708619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:55.708679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.708685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.708686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.708687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.708689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.708690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.708691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.708692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.708693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.708694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.708695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.708696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.708697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.708698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.708703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.708744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256119640049472:6065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:55.708712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.708715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.708719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.708723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.708727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.708731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.708734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.708739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.708743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.708746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.708750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.708753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.708757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.708763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.708770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.708776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.708781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.708785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.708790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.708794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.708799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.708804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.708809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.708812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.708817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.708821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.708826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.708830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.708836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.708840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.708845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.708852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.708857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.708862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.708867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.708873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.708877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.708881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.708886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.708892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.708897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.708938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:55.710711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256119640049472:6065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:55.712215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:55.712751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256119640049472:6065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:55.712763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256119640049472:6065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:55.712766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256119640049472:6065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:55.712771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:55.712924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:55.712935Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:55.712937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:55.712939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:55.712944Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1821 [2:7556256117263151413:3245]
2025-10-01T14:12:55.712954Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:55.712964Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:55.712966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.712968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.712969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.712979Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:55.712982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:55.712986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:55.713022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.713028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.713029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.713031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:55.713033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:55.713078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:55.713083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.713089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.713094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.713103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:55.713116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049508:6065], now have 1 active actors on pipe
2025-10-01T14:12:55.713122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049352:2446], now have 1 active actors on pipe
2025-10-01T14:12:55.713127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256117263151408:3245]
2025-10-01T14:12:55.713128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256117263151408:3245]
2025-10-01T14:12:55.713129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256117263151408:3245]
2025-10-01T14:12:55.713139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:55.713149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:55.713151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:55.713154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:55.713156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:55.713160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:55.713162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:55.713178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256117263151408:3245]
2025-10-01T14:12:55.713185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:55.713175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1821
2025-10-01T14:12:55.713200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:55.713210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.713185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1821
2025-10-01T14:12:55.713215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.713246Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:55.713256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.713260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.713263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:55.713271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.713282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:55.713293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.713411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.713417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.713426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.713487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1822 partition: 0 MaxSeqNo: 45 sessionId: src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0
2025-10-01T14:12:55.713731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af16c9b4-bb693689-ee4d624-a6489d98_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:55.715905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0] Write session: try to update token
2025-10-01T14:12:55.715917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:55.727931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1822 sessionId: src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:55.730038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:55.730175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.730194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.730231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:55.730312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:55.732183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:55.732198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:55.732200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:55.732202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:55.732210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256117263151408:3245]
2025-10-01T14:12:55.732215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256117263151408:3245]
2025-10-01T14:12:55.732221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256117263151408:3245]
2025-10-01T14:12:55.732265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:55.732270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.732273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:55.732264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:55.732282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:55.732286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:55.732402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:55.791135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256119640049515:6233]
2025-10-01T14:12:55.791390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1821, pipe: [1:7556256119640049515:6233]
2025-10-01T14:12:55.874280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:55.880525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.880545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.880702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.880762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.880817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.880871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.880911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.880918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.880980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.881044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.881108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.881166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.881210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.881218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.881273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.881322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.881372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.881419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.881462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.881469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.881519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.881568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.881616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.881664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.881860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.881866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.881917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.881964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.882012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.882064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.882106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.882111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.882164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.882215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.882276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.882332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.882382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.882386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.882440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.882488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.882541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.882593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.882631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.882638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.882691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.882746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.882798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.882848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.882884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.882889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.882946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.882999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.883053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.883106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.883145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.883149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.883206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:55.883261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:55.883318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:55.883368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:55.883407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:55.883411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:55.883452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049515:6233], now have 1 active actors on pipe
2025-10-01T14:12:55.883667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:55.883678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:55.883705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1822 reason: error at write: Disconnected sessionId: src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0
2025-10-01T14:12:55.883704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:55.883758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256119640049515:6233]
2025-10-01T14:12:55.883918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1822 sessionId: src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0 is DEAD
2025-10-01T14:12:55.884015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:55.884025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0] Write session will restart in 0.006404s
2025-10-01T14:12:55.884050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0] Write session: Do CDS request
2025-10-01T14:12:55.884056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:55.884508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:55.891847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.891889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:55.891899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1823
2025-10-01T14:12:55.892035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:55.892074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:55.892087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:55.892089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:55.892408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1823 sessionId:  describe result for acl check
2025-10-01T14:12:55.892430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:55.892432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:55.892433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:55.892436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256119640049658:6046] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:55.893101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256119640049658:6046] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:55.893518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:55.894664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256119640049658:6046] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:55.895291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:55.895485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:55.895494Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:55.895503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:55.895551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:55.895577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256117263151574:3233]
2025-10-01T14:12:55.895966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:55.896212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:55.896241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:55.896482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:55.896519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.896523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.896524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.896524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.896525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.896526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.896526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.896527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.896528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.896528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.896529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.896529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.896530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.896530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.896533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.896539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.896541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.896543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.896545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.896548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.896550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.896552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.896554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.896556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.896558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.896560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.896562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.896564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.896568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.896557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256119640049658:6046] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:55.896573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:55.896577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.896569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256119640049658:6046] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:55.896580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:55.896572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256119640049658:6046] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:55.896582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.896585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:55.896579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:55.896587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.896590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:55.896592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.896595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:55.896598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.896603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:55.896607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.896612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:55.896615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.896620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:55.896624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.896638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:55.896642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.896647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.896651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.896656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.896664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.896667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.896670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.896672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:55.896678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.896681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:55.896702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:55.899975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:55.900513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:55.900525Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:55.900526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:55.900529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:55.900534Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1822 [2:7556256117263151574:3233]
2025-10-01T14:12:55.900544Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:55.900558Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:55.900560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.900562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.900564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.900578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:55.900588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:55.900597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:55.900650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.900655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.900657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.900659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:55.900661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:55.900704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:55.900708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.900715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:55.900720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:55.900729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:55.900742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256117263151569:3233]
2025-10-01T14:12:55.900747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256117263151569:3233]
2025-10-01T14:12:55.900748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256117263151569:3233]
2025-10-01T14:12:55.900754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:55.900763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:55.900764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:55.900771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:55.900772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:55.900773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:55.900773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:55.900781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049544:2446], now have 1 active actors on pipe
2025-10-01T14:12:55.900783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049695:6046], now have 1 active actors on pipe
2025-10-01T14:12:55.900800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256117263151569:3233]
2025-10-01T14:12:55.900808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:55.900821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:55.900808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1822
2025-10-01T14:12:55.900854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1822
2025-10-01T14:12:55.900901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.900913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.900932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:55.900942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:55.900944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:55.900946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:55.900951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:55.900958Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:55.900967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.901090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.901096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.901107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:55.901166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1823 partition: 0 MaxSeqNo: 45 sessionId: src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0
2025-10-01T14:12:55.901469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24c1a43d-d655a37-ded0a7b0-c9af0b26_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:55.903679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0] Write session: try to update token
2025-10-01T14:12:55.903692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:55.915561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1823 sessionId: src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:55.918041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:55.918208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:55.918227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:55.920018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:55.920050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:55.920053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:55.920056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:55.920058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:55.920066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256117263151569:3233]
2025-10-01T14:12:55.920071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256117263151569:3233]
2025-10-01T14:12:55.920074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256117263151569:3233]
2025-10-01T14:12:55.920124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:55.920099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:55.920110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:55.920112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:55.920114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:55.920119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:55.920121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:55.920251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:55.984163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256119640049705:6233]
2025-10-01T14:12:55.984360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1822, pipe: [1:7556256119640049705:6233]
2025-10-01T14:12:56.053281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:56.059708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.059734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.059874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.059928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.059983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.060040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.060082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.060093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.060157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.060210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.060264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.060320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.060359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.060364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.060417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.060471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.060523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.060572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.060609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.060614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.060680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.060727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.060777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.060839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.060881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.060886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.060937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.060983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.061031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.061081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.061120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.061128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.061186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.061234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.061289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.061344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.061382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.061387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.061442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.061493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.061543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.061596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.061638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.061642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.061695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.061742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.061792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.061845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.061883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.061887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.061943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.061995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.062050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.062104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.062144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.062148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.062202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.062253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.062304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.062355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.062412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.062419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.062460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256119640049705:6233], now have 1 active actors on pipe
2025-10-01T14:12:56.062645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:56.062661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:56.062670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:56.062689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1823 reason: error at write: Disconnected sessionId: src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0
2025-10-01T14:12:56.062719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256119640049705:6233]
2025-10-01T14:12:56.062879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1823 sessionId: src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0 is DEAD
2025-10-01T14:12:56.062994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:56.063003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0] Write session will restart in 0.005397s
2025-10-01T14:12:56.063032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0] Write session: Do CDS request
2025-10-01T14:12:56.063038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:56.063174Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:56.069865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.069977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:56.069990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1824
2025-10-01T14:12:56.070092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.070120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:56.070130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:56.070133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:56.070524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1824 sessionId:  describe result for acl check
2025-10-01T14:12:56.070574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:56.070582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:56.070584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:56.070590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256123935017071:6043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:56.071072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256123935017071:6043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:56.072892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:56.072993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256123935017071:6043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:56.074549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:56.074709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:56.074718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:56.074728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:56.074771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:56.074804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256121558119029:3216]
2025-10-01T14:12:56.075355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:56.075395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256123935017071:6043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:56.075407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256123935017071:6043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:56.075409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256123935017071:6043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:56.075415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:56.075579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:56.075603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:56.075798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:56.075835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.075841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.075842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.075842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.075843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.075844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.075844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.075845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.075845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.075846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.075846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.075847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.075848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.075848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.075852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.075857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.075859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.075861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.075863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.075865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.075867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.075869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.075871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.075873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.075875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.075877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.075879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.075881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.075885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.075889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.075893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.075896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.075898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.075901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.075903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.075906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.075908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.075911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.075913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.075916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.075918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.075921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.075923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.075925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.075928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.075931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.075933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.075936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.075938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.075940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.075943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.075945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.075948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.075950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.075953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.075956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.075977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:56.079225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:56.079794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:56.079805Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:56.079806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:56.079808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:56.079812Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1823 [2:7556256121558119029:3216]
2025-10-01T14:12:56.079822Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:56.079832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:56.079837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.079839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.079841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.079851Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:56.079855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:56.079859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:56.079894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.079898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.079900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.079902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:56.079903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:56.079946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:56.079952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.079961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.079973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.079990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:56.080008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017003:2446], now have 1 active actors on pipe
2025-10-01T14:12:56.080015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017156:6043], now have 1 active actors on pipe
2025-10-01T14:12:56.080021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256121558119023:3216]
2025-10-01T14:12:56.080024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256121558119023:3216]
2025-10-01T14:12:56.080025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256121558119023:3216]
2025-10-01T14:12:56.080037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:56.080048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:56.080052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:56.080054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:56.080056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:56.080065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:56.080067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:56.080049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1823
2025-10-01T14:12:56.080070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1823
2025-10-01T14:12:56.080091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256121558119023:3216]
2025-10-01T14:12:56.080101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:56.080105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:56.080114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.080119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.080160Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15faea53-1e330c0f-19e4572c-95563416_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:56.080170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.080173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.080175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:56.080183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.080194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:56.080212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.080310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.080316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.080329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.080393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1824 partition: 0 MaxSeqNo: 45 sessionId: src_id|15faea53-1e330c0f-19e4572c-95563416_0
2025-10-01T14:12:56.080721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8d5edc7-1926caed-c83aeb03-279a9f75_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|15faea53-1e330c0f-19e4572c-95563416_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:56.082910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15faea53-1e330c0f-19e4572c-95563416_0] Write session: try to update token
2025-10-01T14:12:56.082923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15faea53-1e330c0f-19e4572c-95563416_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:56.095000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1824 sessionId: src_id|15faea53-1e330c0f-19e4572c-95563416_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:56.097301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:56.099038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.099060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.099081Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:56.099084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:56.099087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:56.099089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:56.099097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256121558119023:3216]
2025-10-01T14:12:56.099101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256121558119023:3216]
2025-10-01T14:12:56.099105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256121558119023:3216]
2025-10-01T14:12:56.099140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:56.099150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:56.099152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:56.099158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:56.099164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.099166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:56.099292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:56.162865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256123935017168:6233]
2025-10-01T14:12:56.163046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1823, pipe: [1:7556256123935017168:6233]
2025-10-01T14:12:56.233064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:56.233305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:56.233349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017168:6233], now have 1 active actors on pipe
2025-10-01T14:12:56.233434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:56.233552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:56.233616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256123935017168:6233]
2025-10-01T14:12:56.242748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:56.242759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:56.242783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1824 reason: error at write: Disconnected sessionId: src_id|15faea53-1e330c0f-19e4572c-95563416_0
2025-10-01T14:12:56.242955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1824 sessionId: src_id|15faea53-1e330c0f-19e4572c-95563416_0 is DEAD
2025-10-01T14:12:56.243063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15faea53-1e330c0f-19e4572c-95563416_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:56.243075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15faea53-1e330c0f-19e4572c-95563416_0] Write session will restart in 0.006752s
2025-10-01T14:12:56.243110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15faea53-1e330c0f-19e4572c-95563416_0] Write session: Do CDS request
2025-10-01T14:12:56.243117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15faea53-1e330c0f-19e4572c-95563416_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:56.249829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:56.250801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15faea53-1e330c0f-19e4572c-95563416_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.250887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:56.250901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1825
2025-10-01T14:12:56.251025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.251056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:56.251068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:56.251071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:56.251460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1825 sessionId:  describe result for acl check
2025-10-01T14:12:56.251468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:56.251495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:56.251501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:56.251503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:56.251518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256123935017297:6026] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:56.251643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:56.251656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:56.251668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:56.251727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:56.251765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256121558119227:3204]
2025-10-01T14:12:56.251929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256123935017297:6026] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:56.252321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:56.252587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:56.252648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:56.252936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:56.253001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.253007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.253009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.253009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.253011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.253012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.253013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.253014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.253015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.253016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.253018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.253019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.253020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.253021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.253027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.253036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.253040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.253044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.253047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.253051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.253058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.253062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.253070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.253075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.253083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.253087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.253091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.253099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.253105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.253116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.253126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.253131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.253135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.253142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.253150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.253155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.253163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.253171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.253180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.253191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.253199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.253204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.253211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.253216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.253220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.253228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.253233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.253239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.253247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.253251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.253259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.253263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.253271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.253276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.253280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.253285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.253326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:56.254116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256123935017297:6026] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:56.256649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256123935017297:6026] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:56.256663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256123935017297:6026] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:56.256666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256123935017297:6026] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:56.256673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:56.256845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:56.257447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:56.257463Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:56.257465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:56.257470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:56.257481Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1824 [2:7556256121558119227:3204]
2025-10-01T14:12:56.257500Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:56.257519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:56.257526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.257530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.257533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.257548Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:56.257559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:56.257565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:56.257640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.257647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.257649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.257652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:56.257655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:56.257715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:56.257724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.257736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.257747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.257762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:56.257779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017335:6026], now have 1 active actors on pipe
2025-10-01T14:12:56.257787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017169:2446], now have 1 active actors on pipe
2025-10-01T14:12:56.257793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256121558119222:3204]
2025-10-01T14:12:56.257800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256121558119222:3204]
2025-10-01T14:12:56.257802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256121558119222:3204]
2025-10-01T14:12:56.257800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1824
2025-10-01T14:12:56.257821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1824
2025-10-01T14:12:56.257816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:56.257819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:56.257822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:56.257824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:56.257833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:56.257846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:56.257853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:56.257886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.257895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.257910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256121558119222:3204]
2025-10-01T14:12:56.257921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:56.257926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:56.257947Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:56.257958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.257966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.257968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:56.257976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.257989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:56.258016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.258169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.258179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.258194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.258258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1825 partition: 0 MaxSeqNo: 45 sessionId: src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0
2025-10-01T14:12:56.258618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15faea53-1e330c0f-19e4572c-95563416_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:56.260995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0] Write session: try to update token
2025-10-01T14:12:56.261012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:56.273369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1825 sessionId: src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:56.275631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:56.275804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.275828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.275864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:56.275929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:56.277812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:56.277826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:56.277828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:56.277830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:56.277838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256121558119222:3204]
2025-10-01T14:12:56.277841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256121558119222:3204]
2025-10-01T14:12:56.277844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256121558119222:3204]
2025-10-01T14:12:56.277883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:56.277883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:56.277887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.277889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:56.277889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:56.277892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:56.278018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:56.333856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256123935017344:6233]
2025-10-01T14:12:56.334097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1824, pipe: [1:7556256123935017344:6233]
2025-10-01T14:12:56.416309Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:56.422802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.422822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.422959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.423018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.423082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.423138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.423177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.423185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.423244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.423297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.423355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.423414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.423454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.423459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.423522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.423582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.423638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.423696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.423734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.423739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.423793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.423845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.423897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.423947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.424025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.424032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.424085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.424135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.424189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.424242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.424279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.424286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.424354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.424417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.424475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.424538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.424581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.424586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.424653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.424705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.424757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.424810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.424850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.424855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.424910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.424960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.425015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.425081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.425131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.425134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.425197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.425255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.425344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.425406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.425449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.425455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.425522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.425581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.425644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.425704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.425744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.425749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.425797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017344:6233], now have 1 active actors on pipe
2025-10-01T14:12:56.426030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:56.426055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:56.426059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:56.426082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1825 reason: error at write: Disconnected sessionId: src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0
2025-10-01T14:12:56.426109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256123935017344:6233]
2025-10-01T14:12:56.426253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1825 sessionId: src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0 is DEAD
2025-10-01T14:12:56.426397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:56.426407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0] Write session will restart in 0.008796s
2025-10-01T14:12:56.426430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0] Write session: Do CDS request
2025-10-01T14:12:56.426435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:56.426861Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:56.436920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.437004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:56.437018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1826
2025-10-01T14:12:56.437098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.437071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:56.437125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:56.437132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:56.437134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:56.437482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1826 sessionId:  describe result for acl check
2025-10-01T14:12:56.437523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:56.437529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:56.437531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:56.437536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256123935017481:6037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:56.438040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256123935017481:6037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:56.438945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:56.439153Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:56.439162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:56.439175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:56.439233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:56.439267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256121558119385:3202]
2025-10-01T14:12:56.439715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:56.439965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:56.440002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:56.440166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256123935017481:6037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:56.440208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:56.440247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.440251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.440252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.440253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.440254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.440254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.440255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.440256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.440256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.440257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.440257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.440258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.440259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.440260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.440263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.440268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.440271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.440273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.440275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.440277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.440279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.440281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.440283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.440285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.440287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.440289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.440290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.440292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.440298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.440302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.440306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.440309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.440327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.440330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.440333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.440337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.440341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.440346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.440349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.440353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.440357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.440361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.440365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.440370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.440374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.440379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.440382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.440388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.440390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.440392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.440395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.440397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.440400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.440402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.440405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.440408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.440428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:56.443718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256123935017481:6037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:56.443732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256123935017481:6037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:56.443735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256123935017481:6037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:56.443743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:56.443905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:56.444456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:56.444467Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:56.444469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:56.444472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:56.444476Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1825 [2:7556256121558119385:3202]
2025-10-01T14:12:56.444487Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:56.444501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:56.444504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.444507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.444509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.444525Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:56.444530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:56.444534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:56.444569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.444575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.444576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.444579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:56.444580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:56.444644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:56.444650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.444661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.444670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.444679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:56.444698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017520:6037], now have 1 active actors on pipe
2025-10-01T14:12:56.444710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256121558119379:3202]
2025-10-01T14:12:56.444712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256121558119379:3202]
2025-10-01T14:12:56.444714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256121558119379:3202]
2025-10-01T14:12:56.444727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:56.444738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:56.444741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017361:2446], now have 1 active actors on pipe
2025-10-01T14:12:56.444746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:56.444746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:56.444748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:56.444757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:56.444759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:56.444744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1825
2025-10-01T14:12:56.444744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1825
2025-10-01T14:12:56.444785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256121558119379:3202]
2025-10-01T14:12:56.444795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:56.444802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:56.444815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.444824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.444861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28a804be-c318264a-98da6134-7fddcf6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:56.444875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.444881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.444883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:56.444888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.444895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:56.444907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.445035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.445043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.445055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.445145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1826 partition: 0 MaxSeqNo: 45 sessionId: src_id|28a804be-c318264a-98da6134-7fddcf6_0
2025-10-01T14:12:56.445520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe8498-827d8837-d1a8fd28-cc28fab9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|28a804be-c318264a-98da6134-7fddcf6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:56.448028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28a804be-c318264a-98da6134-7fddcf6_0] Write session: try to update token
2025-10-01T14:12:56.448044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28a804be-c318264a-98da6134-7fddcf6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:56.461325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1826 sessionId: src_id|28a804be-c318264a-98da6134-7fddcf6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:56.463521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:56.464971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.464999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.465024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:56.465028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:56.465030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:56.465032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:56.465043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256121558119379:3202]
2025-10-01T14:12:56.465047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256121558119379:3202]
2025-10-01T14:12:56.465050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256121558119379:3202]
2025-10-01T14:12:56.465091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:56.465106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:56.465106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:56.465110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:56.465113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.465116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:56.465255Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:56.526384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256123935017533:6233]
2025-10-01T14:12:56.526647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1825, pipe: [1:7556256123935017533:6233]
2025-10-01T14:12:56.607254Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:56.607452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:56.607497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017533:6233], now have 1 active actors on pipe
2025-10-01T14:12:56.607616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:56.607657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256123935017533:6233]
2025-10-01T14:12:56.607674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:56.607699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:56.607705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:56.607763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1826 reason: error at write: Disconnected sessionId: src_id|28a804be-c318264a-98da6134-7fddcf6_0
2025-10-01T14:12:56.607937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1826 sessionId: src_id|28a804be-c318264a-98da6134-7fddcf6_0 is DEAD
2025-10-01T14:12:56.608106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a804be-c318264a-98da6134-7fddcf6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:56.608117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a804be-c318264a-98da6134-7fddcf6_0] Write session will restart in 0.006901s
2025-10-01T14:12:56.608141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a804be-c318264a-98da6134-7fddcf6_0] Write session: Do CDS request
2025-10-01T14:12:56.608150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a804be-c318264a-98da6134-7fddcf6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:56.615806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28a804be-c318264a-98da6134-7fddcf6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.615870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:56.615883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1827
2025-10-01T14:12:56.615996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.616025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:56.616033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:56.616037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:56.616462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1827 sessionId:  describe result for acl check
2025-10-01T14:12:56.616489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:56.616491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:56.616492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:56.616496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256123935017614:6029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:56.616971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256123935017614:6029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:56.618624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256123935017614:6029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:56.618790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:56.620674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:56.620811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256123935017614:6029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:56.620821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256123935017614:6029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:56.620823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256123935017614:6029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:56.620828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:56.620844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:56.620853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:56.620864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:56.620903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:56.620931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256121558119547:3199]
2025-10-01T14:12:56.621379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:56.621639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:56.621680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:56.621908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:56.621949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.621953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.621953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.621954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.621955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.621955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.621956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.621957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.621957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.621958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.621959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.621959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.621960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.621961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.621964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.621970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.621972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.621974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.621976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.621978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.621980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.621982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.621984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.621986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.621988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.621990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.621992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.621994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.621999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.622003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.622007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.622010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.622013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.622016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.622018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.622020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.622023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.622025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.622027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.622030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.622033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.622035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.622037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.622052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.622056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.622060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.622064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.622069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.622074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.622079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.622083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.622086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.622088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.622091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.622093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.622097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.622118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:56.625601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:56.626185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:56.626197Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:56.626199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:56.626201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:56.626206Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1826 [2:7556256121558119547:3199]
2025-10-01T14:12:56.626215Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:56.626226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:56.626228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.626230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.626231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.626242Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:56.626245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:56.626249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:56.626441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.626447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.626448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.626450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:56.626452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:56.626510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:56.626516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.626526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.626536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.626554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:56.626574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017535:2446], now have 1 active actors on pipe
2025-10-01T14:12:56.626581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017691:6029], now have 1 active actors on pipe
2025-10-01T14:12:56.626587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256121558119539:3199]
2025-10-01T14:12:56.626590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256121558119539:3199]
2025-10-01T14:12:56.626591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256121558119539:3199]
2025-10-01T14:12:56.626608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:56.626598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1826
2025-10-01T14:12:56.626598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1826
2025-10-01T14:12:56.626624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:56.626626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:56.626629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:56.626630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:56.626642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:56.626644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:56.626687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.626696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.626705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256121558119539:3199]
2025-10-01T14:12:56.626710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:56.626721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:56.626731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:56.626737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.626741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.626743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:56.626753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.626764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:56.626789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.626937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.626945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.626959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.627029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1827 partition: 0 MaxSeqNo: 45 sessionId: src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0
2025-10-01T14:12:56.627351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28a804be-c318264a-98da6134-7fddcf6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:56.629682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0] Write session: try to update token
2025-10-01T14:12:56.629694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:56.641732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1827 sessionId: src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:56.643851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:56.644029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.644047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.644078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:56.644154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:56.646305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:56.646321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:56.646323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:56.646325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:56.646334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256121558119539:3199]
2025-10-01T14:12:56.646339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256121558119539:3199]
2025-10-01T14:12:56.646343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256121558119539:3199]
2025-10-01T14:12:56.646397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:56.646402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:56.646405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:56.646410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:56.646416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.646419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:56.646550Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:56.707624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256123935017703:6233]
2025-10-01T14:12:56.707881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1826, pipe: [1:7556256123935017703:6233]
2025-10-01T14:12:56.780607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:56.787061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.787085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.787239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.787293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.787348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.787399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.787449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.787459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.787520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.787576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.787628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.787686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.787726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.787731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.787784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.787830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.787883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.787942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.787985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.787993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.788055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.788105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.788152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.788203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.788242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.788246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.788298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.788348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.788396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.788446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.788491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.788497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.788553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.788605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.788673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.788729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.788770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.788775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.788834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.788894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.788951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.789010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.789050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.789053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.789112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.789163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.789214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.789268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.789309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.789317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.789372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.789422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.789478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.789539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.789582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.789588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.789657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:56.789709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:56.789761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:56.789813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:56.789852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:56.789857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:56.789898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017703:6233], now have 1 active actors on pipe
2025-10-01T14:12:56.790096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:56.790131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256123935017703:6233]
2025-10-01T14:12:56.790147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:56.790149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:56.790173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1827 reason: error at write: Disconnected sessionId: src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0
2025-10-01T14:12:56.790418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1827 sessionId: src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0 is DEAD
2025-10-01T14:12:56.790543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:56.790553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0] Write session will restart in 0.007935s
2025-10-01T14:12:56.790578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0] Write session: Do CDS request
2025-10-01T14:12:56.790584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:56.790763Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:56.799851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.799941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:56.799959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1828
2025-10-01T14:12:56.799965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:56.800080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.800110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:56.800120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:56.800131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:56.800497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1828 sessionId:  describe result for acl check
2025-10-01T14:12:56.800525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:56.800531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:56.800532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:56.800538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256123935017828:6020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:56.801053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256123935017828:6020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:56.801840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:56.801986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:56.801994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:56.802003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:56.802035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:56.802062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256121558119708:3164]
2025-10-01T14:12:56.802495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:56.802900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:56.802946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:56.803234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:56.803297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.803304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.803305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.803306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.803307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.803308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.803309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.803310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.803311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.803312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.803313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.803314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.803315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.803316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.803321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.803329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.803333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.803337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.803340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.803343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.803346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.803349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.803351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.803355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.803358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.803361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.803364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.803367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.803373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.803379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.803384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.803389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.803392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.803396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.803400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.803404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.803408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.803412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.803415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.803420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.803424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.803428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.803432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.803436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.803441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.803446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.803449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.803453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.803457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.803461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.803465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.803469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.803474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.803478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.803483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.803487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.803530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:56.803625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256123935017828:6020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:56.806780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256123935017828:6020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:56.806794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256123935017828:6020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:56.806797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256123935017828:6020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:56.806838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:56.806935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:56.807545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:56.807555Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:56.807557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:56.807559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:56.807564Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1827 [2:7556256121558119708:3164]
2025-10-01T14:12:56.807574Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:56.807586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:56.807588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.807590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.807592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.807603Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:56.807607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:56.807611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:56.807649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.807654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.807655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.807657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:56.807659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:56.807724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:56.807730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.807740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.807752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.807768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:56.807789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017867:6020], now have 1 active actors on pipe
2025-10-01T14:12:56.807796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017705:2446], now have 1 active actors on pipe
2025-10-01T14:12:56.807803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256121558119702:3164]
2025-10-01T14:12:56.807809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256121558119702:3164]
2025-10-01T14:12:56.807811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256121558119702:3164]
2025-10-01T14:12:56.807825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:56.807819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1827
2025-10-01T14:12:56.807836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:56.807823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1827
2025-10-01T14:12:56.807839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:56.807840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:56.807841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:56.807853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:56.807859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:56.807901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.807911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.807923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256121558119702:3164]
2025-10-01T14:12:56.807935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:56.807939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:56.807959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:56.807967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.807970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.807972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:56.807978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.807985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:56.808000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.808142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.808155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.808175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.808278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1828 partition: 0 MaxSeqNo: 45 sessionId: src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0
2025-10-01T14:12:56.808604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a968447e-2817bc70-f35b409d-8bd1fd40_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:56.810897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0] Write session: try to update token
2025-10-01T14:12:56.810911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:56.823316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1828 sessionId: src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:56.825712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:56.827570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.827596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.827617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:56.827620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:56.827623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:56.827625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:56.827634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256121558119702:3164]
2025-10-01T14:12:56.827638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256121558119702:3164]
2025-10-01T14:12:56.827643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256121558119702:3164]
2025-10-01T14:12:56.827679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:56.827689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:56.827693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:56.827696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:56.827703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.827705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:56.827829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:56.890409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256123935017889:6233]
2025-10-01T14:12:56.890697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1827, pipe: [1:7556256123935017889:6233]
2025-10-01T14:12:56.971009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:56.971216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:56.971257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017889:6233], now have 1 active actors on pipe
2025-10-01T14:12:56.971355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:56.971433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:56.971451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:56.971454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:56.971506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256123935017889:6233]
2025-10-01T14:12:56.971525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1828 reason: error at write: Disconnected sessionId: src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0
2025-10-01T14:12:56.971691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1828 sessionId: src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0 is DEAD
2025-10-01T14:12:56.971819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:56.971830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0] Write session will restart in 0.005973s
2025-10-01T14:12:56.971866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0] Write session: Do CDS request
2025-10-01T14:12:56.971874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:56.978785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.978927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:56.978940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1829
2025-10-01T14:12:56.979058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:56.979088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:56.979097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:56.979100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:56.979472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1829 sessionId:  describe result for acl check
2025-10-01T14:12:56.979505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:56.979511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:56.979513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:56.979528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256123935017987:6011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:56.980004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256123935017987:6011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:56.981654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:56.981944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256123935017987:6011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:56.983624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:56.983786Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:56.983792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:56.983800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:56.983832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:56.983861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256121558119876:3150]
2025-10-01T14:12:56.984245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:56.984500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:56.984559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:56.984716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256123935017987:6011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:56.984731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256123935017987:6011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:56.984734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256123935017987:6011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:56.984742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:56.984806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:56.984843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.984847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.984848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.984849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.984849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.984850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.984851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.984851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.984852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.984853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.984853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.984854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.984855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.984855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.984859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.984864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.984866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.984869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.984871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.984873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.984875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.984877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.984879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.984881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.984883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.984885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.984887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.984889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.984895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.984899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:56.984903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.984906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:56.984908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.984911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:56.984914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.984917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:56.984919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.984922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:56.984924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.984927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:56.984930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.984933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:56.984935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.984939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:56.984941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.984943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:56.984947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.984949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.984952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.984954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.984956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.984959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.984961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.984963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:56.984966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.984968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:56.984988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:56.988286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:56.988904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:56.988918Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:56.988921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:56.988924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:56.988930Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1828 [2:7556256121558119876:3150]
2025-10-01T14:12:56.988946Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:56.988961Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:56.988963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.988966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.988968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.988984Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:56.988990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:56.988996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:56.989046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.989055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.989056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.989060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:56.989062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:56.989125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:56.989132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:56.989143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:56.989153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:56.989168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:56.989188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935018060:6011], now have 1 active actors on pipe
2025-10-01T14:12:56.989195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256123935017903:2446], now have 1 active actors on pipe
2025-10-01T14:12:56.989202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256121558119870:3150]
2025-10-01T14:12:56.989208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256121558119870:3150]
2025-10-01T14:12:56.989211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256121558119870:3150]
2025-10-01T14:12:56.989224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:56.989230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1828
2025-10-01T14:12:56.989245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:56.989245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:56.989232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1828
2025-10-01T14:12:56.989248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:56.989249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:56.989257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:56.989259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:56.989305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.989314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.989326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256121558119870:3150]
2025-10-01T14:12:56.989335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:56.989360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:56.989369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af848d27-2d931e31-c35c7916-9047aea9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:56.989376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:56.989380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:56.989382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:56.989391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:56.989400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:56.989425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.989568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:56.989575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:56.989586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:56.989654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1829 partition: 0 MaxSeqNo: 45 sessionId: src_id|af848d27-2d931e31-c35c7916-9047aea9_0
2025-10-01T14:12:56.989987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41f31452-ccbeee6c-16a505a2-5992dfcb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|af848d27-2d931e31-c35c7916-9047aea9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:56.992455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af848d27-2d931e31-c35c7916-9047aea9_0] Write session: try to update token
2025-10-01T14:12:56.992475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af848d27-2d931e31-c35c7916-9047aea9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:57.005984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1829 sessionId: src_id|af848d27-2d931e31-c35c7916-9047aea9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:57.008576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:57.009543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.009572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.009593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:57.009597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:57.009599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:57.009602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:57.009610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256121558119870:3150]
2025-10-01T14:12:57.009620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256121558119870:3150]
2025-10-01T14:12:57.009623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256121558119870:3150]
2025-10-01T14:12:57.009665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:57.009678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:57.009679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:57.009682Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:57.009686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.009688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:57.009813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:57.071660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256128229985365:6233]
2025-10-01T14:12:57.071894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1828, pipe: [1:7556256128229985365:6233]
2025-10-01T14:12:57.158965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:57.159414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:57.159465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985365:6233], now have 1 active actors on pipe
2025-10-01T14:12:57.159528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:57.159681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256128229985365:6233]
2025-10-01T14:12:57.159722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:57.170471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:57.170820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af848d27-2d931e31-c35c7916-9047aea9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:57.170829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af848d27-2d931e31-c35c7916-9047aea9_0] Write session will restart in 0.007872s
2025-10-01T14:12:57.170845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af848d27-2d931e31-c35c7916-9047aea9_0] Write session: Do CDS request
2025-10-01T14:12:57.170574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:57.170850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af848d27-2d931e31-c35c7916-9047aea9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:57.170586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:57.170609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1829 reason: error at write: Disconnected sessionId: src_id|af848d27-2d931e31-c35c7916-9047aea9_0
2025-10-01T14:12:57.170742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1829 sessionId: src_id|af848d27-2d931e31-c35c7916-9047aea9_0 is DEAD
2025-10-01T14:12:57.174149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:57.174359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:57.174383Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:57.174393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:57.174443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:57.174489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256125853087362:3153]
2025-10-01T14:12:57.174993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:57.175223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:57.175256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:57.175505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:57.175551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.175556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.175557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.175558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.175559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.175560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.175562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.175563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.175564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.175565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.175567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.175568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.175569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.175570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.175575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.175584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.175588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.175592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.175603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.175607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.175610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.175614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.175618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.175622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.175626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.175629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.175633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.175637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.175642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.175648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.175654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.175663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.175667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.175674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.175677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.175687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.175692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.175700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.175704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.175711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.175716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.175724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.175728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.175733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.175737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.175746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.175749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.175759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.175763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.175771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.175775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.175782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.175784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.175787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.175791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.175794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.175816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:57.179392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:57.179827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af848d27-2d931e31-c35c7916-9047aea9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.179939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:57.179955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1830
2025-10-01T14:12:57.179998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:57.180009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:57.180012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:57.180015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:57.180037Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1829 [2:7556256125853087362:3153]
2025-10-01T14:12:57.180055Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:57.180073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:57.180080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.180083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.180085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.180088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.180099Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:57.180109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:57.180115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:57.180119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:57.180137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:57.180144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:57.180172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.180180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.180182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.180186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:57.180188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:57.180247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:57.180253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.180264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.180274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.180294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:57.180317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985371:2446], now have 1 active actors on pipe
2025-10-01T14:12:57.180327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256125853087356:3153]
2025-10-01T14:12:57.180334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256125853087356:3153]
2025-10-01T14:12:57.180336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256125853087356:3153]
2025-10-01T14:12:57.180347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:57.180358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:57.180361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:57.180362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:57.180363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:57.180384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:57.180391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:57.180361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1829
2025-10-01T14:12:57.180427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256125853087356:3153]
2025-10-01T14:12:57.180438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:57.180443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:57.180580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1830 sessionId:  describe result for acl check
2025-10-01T14:12:57.180610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:57.180615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:57.180617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:57.180622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256128229985500:5998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:57.181126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256128229985500:5998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:57.183215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256128229985500:5998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:57.188486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256128229985500:5998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:57.188500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256128229985500:5998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:57.188504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256128229985500:5998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:57.188511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:57.188746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985538:5998], now have 1 active actors on pipe
2025-10-01T14:12:57.188789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1829
2025-10-01T14:12:57.188839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.188861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.188890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:57.188904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.188913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.188915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:57.188925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.188943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:57.188965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.189134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.189142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.189157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.189253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1830 partition: 0 MaxSeqNo: 45 sessionId: src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0
2025-10-01T14:12:57.189582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af848d27-2d931e31-c35c7916-9047aea9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:57.190386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:57.190398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:57.190406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256125853087356:3153]
2025-10-01T14:12:57.190441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:57.190440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:57.190601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:57.190733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:57.190857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:57.190979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:57.191163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:57.191196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:57.191886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0] Write session: try to update token
2025-10-01T14:12:57.191901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:57.205023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1830 sessionId: src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:57.207410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:57.208949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.208978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.208999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:57.209002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:57.209004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:57.209006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:57.209014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256125853087356:3153]
2025-10-01T14:12:57.209018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256125853087356:3153]
2025-10-01T14:12:57.209021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256125853087356:3153]
2025-10-01T14:12:57.209057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:57.209069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:57.209072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:57.209074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:57.209080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.209083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:57.209210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:57.260066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256128229985541:6233]
2025-10-01T14:12:57.260400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1829, pipe: [1:7556256128229985541:6233]
2025-10-01T14:12:57.358351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:57.358732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:57.358759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985541:6233], now have 1 active actors on pipe
2025-10-01T14:12:57.358874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:57.358939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256128229985541:6233]
2025-10-01T14:12:57.358967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:57.358975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:57.358977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:57.359041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1830 reason: error at write: Disconnected sessionId: src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0
2025-10-01T14:12:57.359215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1830 sessionId: src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0 is DEAD
2025-10-01T14:12:57.359361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:57.359371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0] Write session will restart in 0.006100s
2025-10-01T14:12:57.359395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0] Write session: Do CDS request
2025-10-01T14:12:57.359403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:57.366840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.366932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:57.366944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1831
2025-10-01T14:12:57.367031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.367060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:57.367069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:57.367073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:57.367425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1831 sessionId:  describe result for acl check
2025-10-01T14:12:57.367459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:57.367466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:57.367468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:57.367473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256128229985635:5993] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:57.367917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256128229985635:5993] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:57.369850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256128229985635:5993] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:57.374330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:57.376103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:57.376239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256128229985635:5993] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:57.376256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256128229985635:5993] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:57.376259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256128229985635:5993] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:57.376268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:57.376289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:57.376300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:57.376311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:57.376360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:57.376393Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256125853087541:3123]
2025-10-01T14:12:57.376958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:57.377224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:57.377279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:57.377604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:57.377662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.377669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.377670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.377671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.377673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.377675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.377676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.377677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.377678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.377679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.377681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.377682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.377683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.377684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.377690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.377699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.377704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.377708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.377712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.377716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.377720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.377724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.377728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.377733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.377736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.377741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.377745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.377748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.377770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.377784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.377790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.377797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.377801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.377806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.377810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.377815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.377819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.377825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.377828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.377835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.377844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.377849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.377852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.377856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.377860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.377864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.377867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.377871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.377874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.377878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.377886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.377891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.377900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.377905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.377913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.377917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.377957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:57.381710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:57.382615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:57.382634Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:57.382636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:57.382640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:57.382649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1830 [2:7556256125853087541:3123]
2025-10-01T14:12:57.382667Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:57.382686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:57.382696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.382699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.382701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.382719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:57.382732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:57.382738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:57.382807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.382815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.382817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.382821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:57.382823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:57.383141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:57.383158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.383170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.383179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.383195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:57.383174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1830
2025-10-01T14:12:57.383179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1830
2025-10-01T14:12:57.383223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985716:5993], now have 1 active actors on pipe
2025-10-01T14:12:57.383232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985544:2446], now have 1 active actors on pipe
2025-10-01T14:12:57.383238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256125853087536:3123]
2025-10-01T14:12:57.383241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256125853087536:3123]
2025-10-01T14:12:57.383243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256125853087536:3123]
2025-10-01T14:12:57.383256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:57.383270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:57.383276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:57.383278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:57.383280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.383285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.383308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:57.383325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:57.383332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:57.383387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:57.383399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.383404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.383410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:57.383421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.383433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:57.383443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256125853087536:3123]
2025-10-01T14:12:57.383458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:57.383459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:57.383491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.383765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.383776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.383795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.383868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1831 partition: 0 MaxSeqNo: 45 sessionId: src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0
2025-10-01T14:12:57.384224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11624e04-6f55c0ce-d102cd23-96e1a01f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:57.386720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0] Write session: try to update token
2025-10-01T14:12:57.386740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:57.399665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:57.399679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:57.399687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256125853087536:3123]
2025-10-01T14:12:57.399727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:57.399740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:57.399884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:57.400027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:57.400159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:57.400277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:57.400452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:57.400485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:57.400621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1831 sessionId: src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:57.402960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:57.403151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.403168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.403194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:57.403273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:57.412475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:57.412491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:57.412493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:57.412495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:57.412505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256125853087536:3123]
2025-10-01T14:12:57.412508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256125853087536:3123]
2025-10-01T14:12:57.412512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256125853087536:3123]
2025-10-01T14:12:57.412541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:57.412546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:57.412549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:57.412553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:57.412558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.412562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:57.412686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:57.459218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256128229985743:6233]
2025-10-01T14:12:57.459481Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1830, pipe: [1:7556256128229985743:6233]
2025-10-01T14:12:57.549938Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:57.556646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.556669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.556800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.556853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.556913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.556965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.557008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.557019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.557079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.557132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.557185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.557242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.557283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.557289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.557351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.557408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.557464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.557526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.557568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.557573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.557635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.557691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.557746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.557807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.557855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.557861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.557921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.557976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.558034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.558089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.558128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.558133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.558193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.558249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.558308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.558364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.558419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.558425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.558486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.558546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.558605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.558664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.558704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.558710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.558769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.558826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.558883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.558943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.558983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.558989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.559050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.559104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.559160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.559215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.559255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.559262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.559319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:57.559382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:57.559446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:57.559511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:57.559552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:57.559559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:57.559606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985743:6233], now have 1 active actors on pipe
2025-10-01T14:12:57.559828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256128229985743:6233]
2025-10-01T14:12:57.559832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:57.559857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:57.559859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:57.559882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1831 reason: error at write: Disconnected sessionId: src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0
2025-10-01T14:12:57.560055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1831 sessionId: src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0 is DEAD
2025-10-01T14:12:57.560227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:57.560236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0] Write session will restart in 0.006588s
2025-10-01T14:12:57.560259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0] Write session: Do CDS request
2025-10-01T14:12:57.560277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:57.560668Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:57.567824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.567927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:57.567940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1832
2025-10-01T14:12:57.568087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.568116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:57.568122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:57.568125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:57.568490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1832 sessionId:  describe result for acl check
2025-10-01T14:12:57.568530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:57.568535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:57.568536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:57.568540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256128229985774:5986] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:57.569021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256128229985774:5986] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:57.572077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256128229985774:5986] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:57.575148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:57.575161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256128229985774:5986] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:57.575176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256128229985774:5986] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:57.575180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256128229985774:5986] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:57.575188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:57.575663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:57.575871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:57.575884Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:57.575896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:57.575956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:57.576002Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256125853087706:3121]
2025-10-01T14:12:57.576549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:57.579333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:57.579386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:57.579732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:57.579791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.579797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.579798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.579799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.579800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.579801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.579803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.579804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.579805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.579806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.579807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.579808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.579809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.579810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.579816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.579827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.579832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.579840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.579844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.579853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.579860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.579866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.579870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.579878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.579882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.579886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.579890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.579894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.579905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.579914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.579924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.579934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.579942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.579951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.579959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.579969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.579977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.579986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.579995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.580004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.580009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.580018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.580023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.580032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.580037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.580046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.580055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.580064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.580072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.580078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.580082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.580087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.580092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.580097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.580102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.580111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.580153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:57.583701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:57.584765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:57.584780Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:57.584782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:57.584786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:57.584792Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1831 [2:7556256125853087706:3121]
2025-10-01T14:12:57.584811Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:57.584827Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:57.584835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.584838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.584841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.584856Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:57.584865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:57.584871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:57.584930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.584936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.584938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.584941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:57.584944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:57.585013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:57.585020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.585030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.585040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.585058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:57.585080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985910:5986], now have 1 active actors on pipe
2025-10-01T14:12:57.585086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985749:2446], now have 1 active actors on pipe
2025-10-01T14:12:57.585093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256125853087700:3121]
2025-10-01T14:12:57.585096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256125853087700:3121]
2025-10-01T14:12:57.585098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256125853087700:3121]
2025-10-01T14:12:57.585110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:57.585126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:57.585130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:57.585133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:57.585135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:57.585143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:57.585146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:57.585133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1831
2025-10-01T14:12:57.585172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256125853087700:3121]
2025-10-01T14:12:57.585182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:57.585188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:57.585212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.585221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.585262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fea9de32-a3d0c728-f910c542-3014a33f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:57.585272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.585276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.585278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:57.585287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.585296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:57.585315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.585326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1831
2025-10-01T14:12:57.585468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.585478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.585493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.585568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1832 partition: 0 MaxSeqNo: 45 sessionId: src_id|fea9de32-a3d0c728-f910c542-3014a33f_0
2025-10-01T14:12:57.585874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9185ed15-474931d3-b21a6d66-4e4500f6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fea9de32-a3d0c728-f910c542-3014a33f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:57.588272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fea9de32-a3d0c728-f910c542-3014a33f_0] Write session: try to update token
2025-10-01T14:12:57.588290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fea9de32-a3d0c728-f910c542-3014a33f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:57.604648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:57.604666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:57.604668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:57.604670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:57.604681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256125853087700:3121]
2025-10-01T14:12:57.604687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256125853087700:3121]
2025-10-01T14:12:57.604691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256125853087700:3121]
2025-10-01T14:12:57.604728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:57.604734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:57.604737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:57.604741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:57.604748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.604751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:57.604897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:57.606333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1832 sessionId: src_id|fea9de32-a3d0c728-f910c542-3014a33f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:57.608679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:57.659951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256128229985922:6233]
2025-10-01T14:12:57.660171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1831, pipe: [1:7556256128229985922:6233]
2025-10-01T14:12:57.748642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:57.749321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.749336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.749374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985922:6233], now have 1 active actors on pipe
2025-10-01T14:12:57.749581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256128229985922:6233]
2025-10-01T14:12:57.749595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:57.749598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:57.749609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:57.749657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1832 reason: error at write: Disconnected sessionId: src_id|fea9de32-a3d0c728-f910c542-3014a33f_0
2025-10-01T14:12:57.749586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:57.749833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1832 sessionId: src_id|fea9de32-a3d0c728-f910c542-3014a33f_0 is DEAD
2025-10-01T14:12:57.749962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea9de32-a3d0c728-f910c542-3014a33f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:57.749969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea9de32-a3d0c728-f910c542-3014a33f_0] Write session will restart in 0.009945s
2025-10-01T14:12:57.749992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea9de32-a3d0c728-f910c542-3014a33f_0] Write session: Do CDS request
2025-10-01T14:12:57.749997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea9de32-a3d0c728-f910c542-3014a33f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:57.760841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:57.760879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fea9de32-a3d0c728-f910c542-3014a33f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.760956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:57.760971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1833
2025-10-01T14:12:57.761088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.761118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:57.761129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:57.761132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:57.761517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1833 sessionId:  describe result for acl check
2025-10-01T14:12:57.761555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:57.761561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:57.761562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:57.761567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256128229986052:5980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:57.762090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256128229986052:5980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:57.762797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:57.763009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:57.763019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:57.763031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:57.763084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:57.763142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256125853087872:3109]
2025-10-01T14:12:57.763649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:57.763914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:57.763958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:57.764069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256128229986052:5980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:57.764241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:57.764301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.764307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.764309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.764310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.764311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.764312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.764313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.764314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.764315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.764316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.764317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.764318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.764319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.764320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.764325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.764333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.764336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.764339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.764342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.764346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.764349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.764352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.764355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.764358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.764361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.764364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.764367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.764370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.764376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.764383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.764389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.764401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.764405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.764410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.764414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.764419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.764423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.764427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.764431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.764435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.764441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.764445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.764448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.764452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.764456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.764460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.764463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.764467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.764471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.764476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.764479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.764484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.764487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.764497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.764500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.764504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.764536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:57.768028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256128229986052:5980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:57.768044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256128229986052:5980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:57.768047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256128229986052:5980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:57.768056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:57.768222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:57.768870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:57.768884Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:57.768887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:57.768890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:57.768897Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1832 [2:7556256125853087872:3109]
2025-10-01T14:12:57.768912Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:57.768927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:57.768933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.768936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.768939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.768955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:57.768965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:57.768971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:57.769025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.769032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.769034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.769037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:57.769039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:57.769104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:57.769111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.769122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.769131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.769150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:57.769172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229985924:2446], now have 1 active actors on pipe
2025-10-01T14:12:57.769179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229986090:5980], now have 1 active actors on pipe
2025-10-01T14:12:57.769187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256125853087866:3109]
2025-10-01T14:12:57.769193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256125853087866:3109]
2025-10-01T14:12:57.769196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256125853087866:3109]
2025-10-01T14:12:57.769208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:57.769226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:57.769226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:57.769230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:57.769233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:57.769240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:57.769243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:57.769242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1832
2025-10-01T14:12:57.769250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1832
2025-10-01T14:12:57.769273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256125853087866:3109]
2025-10-01T14:12:57.769280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:57.769282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:57.769299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.769308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.769351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:57.769362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.769367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.769373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:57.769382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.769395Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:57.769415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.769575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.769589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.769610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.769716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1833 partition: 0 MaxSeqNo: 45 sessionId: src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0
2025-10-01T14:12:57.770095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fea9de32-a3d0c728-f910c542-3014a33f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:57.772382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0] Write session: try to update token
2025-10-01T14:12:57.772399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:57.787620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1833 sessionId: src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:57.789675Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:57.789696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:57.789699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:57.789702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:57.789711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256125853087866:3109]
2025-10-01T14:12:57.789715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256125853087866:3109]
2025-10-01T14:12:57.789719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256125853087866:3109]
2025-10-01T14:12:57.789768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:57.789772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:57.789774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.789777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:57.789778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:57.789783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:57.789948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:57.790099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:57.849884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256128229986098:6233]
2025-10-01T14:12:57.850139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1832, pipe: [1:7556256128229986098:6233]
2025-10-01T14:12:57.925328Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:57.925718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.925734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.925772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229986098:6233], now have 1 active actors on pipe
2025-10-01T14:12:57.926026Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:57.926081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:57.926126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:57.926196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1833 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0
2025-10-01T14:12:57.926400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1833 sessionId: src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0 is DEAD
2025-10-01T14:12:57.926529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:57.926536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0] Write session will restart in 0.006046s
2025-10-01T14:12:57.926553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0] Write session: Do CDS request
2025-10-01T14:12:57.926558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:57.926628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256128229986098:6233]
2025-10-01T14:12:57.933846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.933940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:57.933952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1834
2025-10-01T14:12:57.934052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:57.934084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:57.934093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:57.934097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:57.934523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1834 sessionId:  describe result for acl check
2025-10-01T14:12:57.934563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:57.934569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:57.934570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:57.934574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256128229986185:5956] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:57.935113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256128229986185:5956] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:57.937006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256128229986185:5956] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:57.937824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:57.939865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:57.940024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:57.940033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:57.940042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:57.940089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:57.940119Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256125853088045:3092]
2025-10-01T14:12:57.940519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:57.940588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256128229986185:5956] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:57.940602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256128229986185:5956] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:57.940605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256128229986185:5956] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:57.940612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:57.940790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:57.940826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:57.941113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:57.941154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.941159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.941159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.941160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.941161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.941161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.941162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.941163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.941163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.941164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.941164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.941165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.941165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.941166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.941169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.941175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.941178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.941180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.941182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.941185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.941189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.941193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.941197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.941200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.941203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.941207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.941211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.941215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.941222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.941229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:57.941235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.941240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:57.941244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.941250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:57.941254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.941259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:57.941263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.941268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:57.941272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.941276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:57.941281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.941286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:57.941290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.941295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:57.941299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.941304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:57.941308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.941312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.941323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.941327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.941336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.941341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.941349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.941354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:57.941359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.941368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:57.941392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:57.945123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:57.945766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:57.945778Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:57.945779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:57.945781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:57.945786Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1833 [2:7556256125853088045:3092]
2025-10-01T14:12:57.945796Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:57.945810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:57.945811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.945814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.945815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.945825Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:57.945828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:57.945832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:57.945876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.945881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.945882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.945885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:57.945887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:57.945939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:57.945948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.945957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:57.945967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:57.945986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:57.946007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229986114:2446], now have 1 active actors on pipe
2025-10-01T14:12:57.946014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256128229986289:5956], now have 1 active actors on pipe
2025-10-01T14:12:57.946019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256125853088039:3092]
2025-10-01T14:12:57.946020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256125853088039:3092]
2025-10-01T14:12:57.946021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256125853088039:3092]
2025-10-01T14:12:57.946036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:57.946048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:57.946055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:57.946058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:57.946060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:57.946061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:57.946062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:57.946082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256125853088039:3092]
2025-10-01T14:12:57.946085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:57.946087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:57.946109Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1833
2025-10-01T14:12:57.946124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1833
2025-10-01T14:12:57.946174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.946185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.946208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:57.946215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:57.946218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:57.946220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:57.946229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:57.946238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:57.946251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.946423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:57.946437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:57.946461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:57.946571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1834 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0
2025-10-01T14:12:57.946965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ba43645-2b53f24f-b4d3d538-becf9369_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:57.949281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0] Write session: try to update token
2025-10-01T14:12:57.949300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:57.964381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1834 sessionId: src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:57.965893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:57.965912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:57.965915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:57.965917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:57.965926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256125853088039:3092]
2025-10-01T14:12:57.965935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256125853088039:3092]
2025-10-01T14:12:57.965939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256125853088039:3092]
2025-10-01T14:12:57.965974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:57.965984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:57.965987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:57.965990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:57.965998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:57.966000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:57.966200Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:57.966806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:58.026547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256132524953595:6233]
2025-10-01T14:12:58.026845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1833, pipe: [1:7556256132524953595:6233]
2025-10-01T14:12:58.105613Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:58.106076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.106091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.106133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524953595:6233], now have 1 active actors on pipe
2025-10-01T14:12:58.106325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:58.106355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256132524953595:6233]
2025-10-01T14:12:58.106388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:58.106391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:58.106439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1834 reason: error at write: Disconnected sessionId: src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0
2025-10-01T14:12:58.106615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1834 sessionId: src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0 is DEAD
2025-10-01T14:12:58.106352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:58.106735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:58.106755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0] Write session will restart in 0.006527s
2025-10-01T14:12:58.106781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0] Write session: Do CDS request
2025-10-01T14:12:58.106787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:58.114873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.114983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:58.114997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1835
2025-10-01T14:12:58.115106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.115153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:58.115163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:58.115167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:58.115584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1835 sessionId:  describe result for acl check
2025-10-01T14:12:58.115626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:58.115632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:58.115633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:58.115639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256132524953711:5942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:58.116158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256132524953711:5942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:58.117249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:58.117904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256132524953711:5942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:58.119107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:58.119263Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:58.119270Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:58.119277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:58.119310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:58.119338Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256130148055510:3101]
2025-10-01T14:12:58.119722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:58.119971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:58.120008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:58.120224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256132524953711:5942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:58.120234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256132524953711:5942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:58.120237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256132524953711:5942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:58.120237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:58.120245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:58.120286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.120292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.120293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.120294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.120295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.120296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.120297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.120298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.120299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.120300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.120301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.120302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.120303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.120304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.120309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.120319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.120323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.120326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.120330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.120334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.120337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.120341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.120344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.120348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.120352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.120355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.120359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.120362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.120368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.120374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.120377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.120380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.120383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.120386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.120388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.120391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.120393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.120396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.120398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.120401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.120404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.120406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.120408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.120412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.120414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.120417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.120420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.120422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.120425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.120427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.120430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.120433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.120435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.120437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.120439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.120442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.120463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:58.123935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:58.124523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:58.124536Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:58.124537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:58.124539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:58.124544Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1834 [2:7556256130148055510:3101]
2025-10-01T14:12:58.124553Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:58.124565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:58.124566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.124569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.124570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.124580Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:58.124584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:58.124587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:58.124637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.124643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.124644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.124646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:58.124648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:58.124693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:58.124698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.124705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.124710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.124719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:58.124734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256130148055504:3101]
2025-10-01T14:12:58.124739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256130148055504:3101]
2025-10-01T14:12:58.124740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256130148055504:3101]
2025-10-01T14:12:58.124747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:58.124755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:58.124757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524953763:5942], now have 1 active actors on pipe
2025-10-01T14:12:58.124759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524953597:2446], now have 1 active actors on pipe
2025-10-01T14:12:58.124764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:58.124765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:58.124766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:58.124777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:58.124780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:58.124800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256130148055504:3101]
2025-10-01T14:12:58.124811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:58.124821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:58.124820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1834
2025-10-01T14:12:58.124827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1834
2025-10-01T14:12:58.124882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.124891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.124912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:58.124917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.124920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.124922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:58.124929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.124936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:58.124950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.125075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.125086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.125101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.125164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1835 partition: 0 MaxSeqNo: 45 sessionId: src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0
2025-10-01T14:12:58.125478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a611ce8-8a6087d6-1e6fc229-9e13d1d0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:58.127711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0] Write session: try to update token
2025-10-01T14:12:58.127724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:58.140745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:58.140762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:58.140771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256130148055504:3101]
2025-10-01T14:12:58.140813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:58.140829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:58.140989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:58.141125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:58.141300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:58.141445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:58.141625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:58.141660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:58.143204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1835 sessionId: src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:58.145686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:58.149408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.149432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.149469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:58.149591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:58.155517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:58.155537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:58.155540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:58.155542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:58.155554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256130148055504:3101]
2025-10-01T14:12:58.155559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256130148055504:3101]
2025-10-01T14:12:58.155564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256130148055504:3101]
2025-10-01T14:12:58.155616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:58.155616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:58.155628Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:58.155632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:58.155634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.155638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:58.155812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:58.206760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256132524953773:6233]
2025-10-01T14:12:58.207015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1834, pipe: [1:7556256132524953773:6233]
2025-10-01T14:12:58.302859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:58.309855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.309883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.310023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.310072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.310128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.310174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.310273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.310281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.310338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.310404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.310463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.310516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.310555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.310560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.310621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.310673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.310726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.310781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.310893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.310899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.310986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.311063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.311117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.311171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.311211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.311217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.311270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.311319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.311377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.311430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.311468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.311473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.311569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.311624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.311679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.311736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.311774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.311779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.311836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.311887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.311942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.311994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.312032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.312038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.312115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.312185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.312237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.312287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.312327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.312332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.312389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.312445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.312500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.312556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.312605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.312612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.312681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.312732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.312784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.312836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.312875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.312881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.312923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524953773:6233], now have 1 active actors on pipe
2025-10-01T14:12:58.313116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:58.313135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:58.313137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256132524953773:6233]
2025-10-01T14:12:58.313161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:58.313163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1835 reason: error at write: Disconnected sessionId: src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0
2025-10-01T14:12:58.313366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1835 sessionId: src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0 is DEAD
2025-10-01T14:12:58.313509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:58.313522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0] Write session will restart in 0.008779s
2025-10-01T14:12:58.313546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0] Write session: Do CDS request
2025-10-01T14:12:58.313552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:58.313811Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:58.323897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.323981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:58.323996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1836
2025-10-01T14:12:58.324184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.324218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:58.324228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:58.324231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:58.324588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1836 sessionId:  describe result for acl check
2025-10-01T14:12:58.324621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:58.324637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:58.324639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:58.324642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256132524953906:5932] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:58.325114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256132524953906:5932] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:58.325291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:58.327196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:58.327394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:58.327405Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:58.327415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:58.327458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:58.327492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256130148055721:3082]
2025-10-01T14:12:58.327498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256132524953906:5932] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:58.328046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:58.328297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:58.328329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:58.328531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:58.328583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.328589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.328590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.328591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.328593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.328594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.328595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.328596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.328597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.328598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.328599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.328600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.328601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.328602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.328606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.328615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.328650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.328654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.328657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.328661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.328664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.328667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.328670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.328674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.328677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.328681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.328684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.328687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.328694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.328701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.328713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.328718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.328727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.328732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.328739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.328742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.328745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.328748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.328750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.328753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.328755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.328758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.328761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.328764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.328766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.328770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.328774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.328780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.328784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.328789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.328793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.328799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.328804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.328813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.328817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.328819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.328840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:58.332394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256132524953906:5932] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:58.332409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256132524953906:5932] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:58.332412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256132524953906:5932] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:58.332423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:58.332570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:58.333391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:58.333417Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:58.333418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:58.333422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:58.333428Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1835 [2:7556256130148055721:3082]
2025-10-01T14:12:58.333442Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:58.333458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:58.333461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.333464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.333466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.333482Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:58.333492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:58.333498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:58.333551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.333560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.333562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.333566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:58.333568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:58.333628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:58.333637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.333649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.333667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.333687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:58.333703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524953944:5932], now have 1 active actors on pipe
2025-10-01T14:12:58.333724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524953778:2446], now have 1 active actors on pipe
2025-10-01T14:12:58.333733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256130148055715:3082]
2025-10-01T14:12:58.333736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256130148055715:3082]
2025-10-01T14:12:58.333738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256130148055715:3082]
2025-10-01T14:12:58.333746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:58.333715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1835
2025-10-01T14:12:58.333718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1835
2025-10-01T14:12:58.333759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:58.333770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:58.333773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:58.333775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:58.333778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:58.333782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:58.333818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.333828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.333867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256130148055715:3082]
2025-10-01T14:12:58.333880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:58.333885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:58.333900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:58.333911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.333920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.333922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:58.333931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.333944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:58.333986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.334141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.334151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.334166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.334233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1836 partition: 0 MaxSeqNo: 45 sessionId: src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0
2025-10-01T14:12:58.334610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc5578a-27a0ccc9-e5074c24-6fb8e495_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:58.337099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0] Write session: try to update token
2025-10-01T14:12:58.337115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:58.351498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1836 sessionId: src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:58.354187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:58.355422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.355443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.355463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:58.355465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:58.355481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:58.355488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:58.355495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256130148055715:3082]
2025-10-01T14:12:58.355500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256130148055715:3082]
2025-10-01T14:12:58.355503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256130148055715:3082]
2025-10-01T14:12:58.355534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:58.355543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:58.355546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:58.355557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:58.355564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.355569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:58.355765Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:58.413082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256132524953963:6233]
2025-10-01T14:12:58.413358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1835, pipe: [1:7556256132524953963:6233]
2025-10-01T14:12:58.514023Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:58.514294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:58.514343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524953963:6233], now have 1 active actors on pipe
2025-10-01T14:12:58.514422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:58.514676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:58.514730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256132524953963:6233]
2025-10-01T14:12:58.524080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:58.524093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:58.524116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1836 reason: error at write: Disconnected sessionId: src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0
2025-10-01T14:12:58.524239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1836 sessionId: src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0 is DEAD
2025-10-01T14:12:58.524418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:58.524429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0] Write session will restart in 0.007953s
2025-10-01T14:12:58.524453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0] Write session: Do CDS request
2025-10-01T14:12:58.524461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:58.529437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:58.531400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:58.531568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:58.531576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:58.531586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:58.531623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:58.531651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256130148055890:3059]
2025-10-01T14:12:58.532070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:58.532250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:58.532276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:58.532473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:58.532511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.532515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.532516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.532516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.532517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.532518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.532519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.532519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.532520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.532521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.532522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.532523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.532523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.532524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.532527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.532534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.532536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.532538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.532540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.532543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.532545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.532547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.532549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.532551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.532553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.532555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.532557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.532559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.532564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.532568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.532574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.532579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.532581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.532588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.532591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.532594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.532599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.532602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.532605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.532607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.532610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.532614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.532616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.532619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.532622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.532635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.532640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.532643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.532646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.532648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.532654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.532656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.532659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.532664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.532666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.532669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.532690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:58.533817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.533909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:58.533924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1837
2025-10-01T14:12:58.534075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.534109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:58.534118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:58.534122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:58.534484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1837 sessionId:  describe result for acl check
2025-10-01T14:12:58.534517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:58.534523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:58.534525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:58.534530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256132524954110:5923] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:58.535000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256132524954110:5923] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:58.536133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:58.536818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:58.536840Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:58.536843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:58.536845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:58.536851Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1836 [2:7556256130148055890:3059]
2025-10-01T14:12:58.536866Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:58.536880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:58.536882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.536886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.536892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.536906Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:58.536915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:58.536920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:58.536970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.536976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.536978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.536981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:58.536984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:58.537043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:58.537049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.537034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256132524954110:5923] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:58.537060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.537073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.537090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:58.537110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524953974:2446], now have 1 active actors on pipe
2025-10-01T14:12:58.537120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256130148055885:3059]
2025-10-01T14:12:58.537120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1836
2025-10-01T14:12:58.537126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256130148055885:3059]
2025-10-01T14:12:58.537128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256130148055885:3059]
2025-10-01T14:12:58.537139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:58.537150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:58.537153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:58.537157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:58.537159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:58.537166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:58.537168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:58.537195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256130148055885:3059]
2025-10-01T14:12:58.537203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:58.537215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:58.541573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256132524954110:5923] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:58.541584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256132524954110:5923] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:58.541586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256132524954110:5923] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:58.541591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:58.541772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524954148:5923], now have 1 active actors on pipe
2025-10-01T14:12:58.541798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1836
2025-10-01T14:12:58.541849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.541861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.541884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:58.541895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.541903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.541905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:58.541912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.541927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:58.541943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.542144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.542156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.542177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.542276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1837 partition: 0 MaxSeqNo: 45 sessionId: src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0
2025-10-01T14:12:58.542569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a707c1f-84c126a0-9cc8e94d-dd1fc2c0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:58.545017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0] Write session: try to update token
2025-10-01T14:12:58.545032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:58.547187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:58.547204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:58.547212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256130148055885:3059]
2025-10-01T14:12:58.547253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:58.547258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:58.547410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:58.547548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:58.547681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:58.547814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:58.547986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:58.548022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:58.558727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1837 sessionId: src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:58.561383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:58.561698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.561730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.561767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:58.561870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:58.566266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:58.566289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:58.566292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:58.566294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:58.566306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256130148055885:3059]
2025-10-01T14:12:58.566310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256130148055885:3059]
2025-10-01T14:12:58.566314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256130148055885:3059]
2025-10-01T14:12:58.566344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:58.566349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:58.566352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:58.566360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:58.566384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.566387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:58.566545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:58.614838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256132524954151:6233]
2025-10-01T14:12:58.615131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1836, pipe: [1:7556256132524954151:6233]
2025-10-01T14:12:58.706016Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:58.712367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.712387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.712520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.712570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.712640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.712692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.712732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.712743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.712804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.712855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.712909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.712960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.712998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.713003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.713062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.713116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.713175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.713242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.713281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.713287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.713346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.713403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.713459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.713515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.713555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.713560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.713614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.713668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.713731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.713787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.713843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.713851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.713913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.713981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.714038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.714132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.714177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.714184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.714268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.714319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.714390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.714450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.714501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.714506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.714561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.714612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.714672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.714725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.714771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.714777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.714836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.714887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.714946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.715007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.715118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.715125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.715188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:12:58.715242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:12:58.715293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:12:58.715346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:12:58.715457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:12:58.715467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:12:58.715508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524954151:6233], now have 1 active actors on pipe
2025-10-01T14:12:58.715735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:58.715773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256132524954151:6233]
2025-10-01T14:12:58.715793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:58.715804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:58.715831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1837 reason: error at write: Disconnected sessionId: src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0
2025-10-01T14:12:58.716043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1837 sessionId: src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0 is DEAD
2025-10-01T14:12:58.716210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:58.716222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0] Write session will restart in 0.008990s
2025-10-01T14:12:58.716247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0] Write session: Do CDS request
2025-10-01T14:12:58.716253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:58.716301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:58.726325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:58.726871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.726926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:58.726941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1838
2025-10-01T14:12:58.727095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.727126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:58.727137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:58.727145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:58.727529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1838 sessionId:  describe result for acl check
2025-10-01T14:12:58.727567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:58.727573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:58.727575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:58.727582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256132524954287:5915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:58.728106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256132524954287:5915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:58.728410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:58.728579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:58.728588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:58.728599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:58.728678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:58.728717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256130148056062:3043]
2025-10-01T14:12:58.729328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:58.729577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:58.729617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:58.729914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:58.729957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.729963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.729964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.729965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.729966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.729967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.729968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.729970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.729971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.729972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.729973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.729974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.729975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.729976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.729981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.729991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.729995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.729999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.730003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.730007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.730011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.730015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.730022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.730027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.730034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.730042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.730046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.730053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.730059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.730071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.730080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.730089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.730097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.730107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.730115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.730120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.730128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.730133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.730141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.730116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256132524954287:5915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:58.730146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.730155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.730160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.730168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.730173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.730177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.730186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.730195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.730203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.730208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.730217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.730220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.730229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.730233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.730238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.730246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.730251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.730320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:58.733465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256132524954287:5915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:58.733475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256132524954287:5915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:58.733478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256132524954287:5915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:58.733485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:58.733678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:58.734267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:58.734283Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:58.734285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:58.734289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:58.734295Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1837 [2:7556256130148056062:3043]
2025-10-01T14:12:58.734314Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:58.734333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:58.734339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.734343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.734347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.734360Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:58.734385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:58.734395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:58.734452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.734459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.734461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.734464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:58.734467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:58.734524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:58.734532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.734542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.734551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.734566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:58.734584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524954154:2446], now have 1 active actors on pipe
2025-10-01T14:12:58.734592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524954325:5915], now have 1 active actors on pipe
2025-10-01T14:12:58.734598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256130148056056:3043]
2025-10-01T14:12:58.734600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256130148056056:3043]
2025-10-01T14:12:58.734602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256130148056056:3043]
2025-10-01T14:12:58.734605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1837
2025-10-01T14:12:58.734619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1837
2025-10-01T14:12:58.734614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:58.734631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:58.734631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:58.734634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:58.734635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:58.734649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:58.734652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:58.734676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256130148056056:3043]
2025-10-01T14:12:58.734686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:58.734691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:58.734705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.734712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.734752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:58.734762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.734766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.734769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:58.734779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.734791Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:58.734811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.734960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.734970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.734985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.735066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1838 partition: 0 MaxSeqNo: 45 sessionId: src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0
2025-10-01T14:12:58.735390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7e7e2f9-d1a49bb5-44c33dd2-761c9a4f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:58.737671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0] Write session: try to update token
2025-10-01T14:12:58.737686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:58.750429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1838 sessionId: src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:58.752972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:58.754780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.754806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.754827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:58.754830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:58.754832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:58.754834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:58.754844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256130148056056:3043]
2025-10-01T14:12:58.754849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256130148056056:3043]
2025-10-01T14:12:58.754853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256130148056056:3043]
2025-10-01T14:12:58.754898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:58.754905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:58.754911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:58.754912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.754914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:58.754915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:58.755102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:58.816042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256132524954333:6233]
2025-10-01T14:12:58.816288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1837, pipe: [1:7556256132524954333:6233]
2025-10-01T14:12:58.901914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:58.902463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:58.902518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524954333:6233], now have 1 active actors on pipe
2025-10-01T14:12:58.902610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:58.902655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:58.902704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256132524954333:6233]
2025-10-01T14:12:58.902707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:58.902710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:58.902777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1838 reason: error at write: Disconnected sessionId: src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0
2025-10-01T14:12:58.902974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1838 sessionId: src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0 is DEAD
2025-10-01T14:12:58.903129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:58.903139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0] Write session will restart in 0.006392s
2025-10-01T14:12:58.903163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0] Write session: Do CDS request
2025-10-01T14:12:58.903172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:58.910887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.911035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:58.911050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1839
2025-10-01T14:12:58.911193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:58.911237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:58.911248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:58.911252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:58.911713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1839 sessionId:  describe result for acl check
2025-10-01T14:12:58.911761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:58.911769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:58.911771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:58.911777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256132524954386:5912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:58.912318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256132524954386:5912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:58.914507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256132524954386:5912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:58.916278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:58.918504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:58.918715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:58.918727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:58.918738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:58.918790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:58.918829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256130148056233:3053]
2025-10-01T14:12:58.918845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256132524954386:5912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:58.918858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256132524954386:5912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:58.918862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256132524954386:5912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:58.918870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:58.919405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:58.919681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:58.919729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:58.920028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:58.920090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.920097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.920098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.920099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.920100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.920102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.920103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.920104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.920105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.920106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.920107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.920109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.920110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.920111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.920117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.920127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.920131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.920136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.920139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.920143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.920147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.920151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.920155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.920159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.920162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.920165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.920168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.920171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.920179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.920187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:58.920192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.920198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:58.920207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.920212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:58.920221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.920227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:58.920235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.920240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:58.920245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.920254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:58.920259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.920268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:58.920272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.920279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:58.920288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.920293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:58.920301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.920306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.920314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.920320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.920326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.920331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.920336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.920341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:58.920350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.920355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:58.920397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:58.924083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:58.924739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:58.924754Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:58.924757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:58.924761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:58.924768Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1838 [2:7556256130148056233:3053]
2025-10-01T14:12:58.924783Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:58.924805Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:58.924813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.924816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.924819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.924834Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:58.924844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:58.924851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:58.924912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.924920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.924922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.924926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:58.924929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:58.924999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:58.925006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.925018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:58.925034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:58.925054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:58.925076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524954337:2446], now have 1 active actors on pipe
2025-10-01T14:12:58.925091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256132524954505:5912], now have 1 active actors on pipe
2025-10-01T14:12:58.925099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256130148056228:3053]
2025-10-01T14:12:58.925102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256130148056228:3053]
2025-10-01T14:12:58.925105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256130148056228:3053]
2025-10-01T14:12:58.925118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:58.925129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:58.925134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:58.925138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:58.925140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:58.925147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:58.925150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:58.925150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1838
2025-10-01T14:12:58.925182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256130148056228:3053]
2025-10-01T14:12:58.925187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1838
2025-10-01T14:12:58.925191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:58.925202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:58.925222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.925231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.925264Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98258c9c-58c98f29-c6090904-ef28b07d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:58.925276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:58.925279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:58.925282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:58.925291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:58.925304Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:58.925328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.925472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:58.925480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:58.925496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:58.925584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1839 partition: 0 MaxSeqNo: 45 sessionId: src_id|98258c9c-58c98f29-c6090904-ef28b07d_0
2025-10-01T14:12:58.926008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a192f66d-33c61ae2-fb65b5e4-813a5abe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|98258c9c-58c98f29-c6090904-ef28b07d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:58.928824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98258c9c-58c98f29-c6090904-ef28b07d_0] Write session: try to update token
2025-10-01T14:12:58.928846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98258c9c-58c98f29-c6090904-ef28b07d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:58.944911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1839 sessionId: src_id|98258c9c-58c98f29-c6090904-ef28b07d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:58.946075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:58.946093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:58.946095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:58.946097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:58.946107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256130148056228:3053]
2025-10-01T14:12:58.946113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256130148056228:3053]
2025-10-01T14:12:58.946118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256130148056228:3053]
2025-10-01T14:12:58.946168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:58.946171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:58.946177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:58.946178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:58.946181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:58.946181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:58.946334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:58.947383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:59.002901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256136819921835:6233]
2025-10-01T14:12:59.003151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1838, pipe: [1:7556256136819921835:6233]
2025-10-01T14:12:59.101788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:59.102081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.102095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.102135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819921835:6233], now have 1 active actors on pipe
2025-10-01T14:12:59.102351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:59.102362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256136819921835:6233]
2025-10-01T14:12:59.102404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:59.102414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:59.102499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1839 reason: error at write: Disconnected sessionId: src_id|98258c9c-58c98f29-c6090904-ef28b07d_0
2025-10-01T14:12:59.102588Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:59.102678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1839 sessionId: src_id|98258c9c-58c98f29-c6090904-ef28b07d_0 is DEAD
2025-10-01T14:12:59.102851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98258c9c-58c98f29-c6090904-ef28b07d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:59.102865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98258c9c-58c98f29-c6090904-ef28b07d_0] Write session will restart in 0.008344s
2025-10-01T14:12:59.102902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98258c9c-58c98f29-c6090904-ef28b07d_0] Write session: Do CDS request
2025-10-01T14:12:59.102908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98258c9c-58c98f29-c6090904-ef28b07d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:59.112969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98258c9c-58c98f29-c6090904-ef28b07d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.113107Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:59.113122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1840
2025-10-01T14:12:59.113256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.113290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:59.113299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:59.113303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:59.113381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:59.113684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1840 sessionId:  describe result for acl check
2025-10-01T14:12:59.113720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:59.113724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:59.113725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:59.113730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256136819921971:5900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:59.114239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256136819921971:5900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:59.115362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:59.115568Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:59.115580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:59.115608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:59.115666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:59.115702Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256134443023710:3044]
2025-10-01T14:12:59.116265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256136819921971:5900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:59.116285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:59.116597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:59.116669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:59.116969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:59.117041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.117047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.117048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.117050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.117051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.117052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.117054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.117055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.117056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.117057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.117058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.117059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.117060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.117061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.117068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.117078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.117082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.117086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.117090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.117094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.117097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.117101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.117105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.117109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.117112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.117116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.117120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.117124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.117131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.117139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.117148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.117154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.117163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.117168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.117177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.117182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.117186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.117195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.117198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.117203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.117212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.117218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.117222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.117231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.117237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.117246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.117251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.117260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.117264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.117271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.117280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.117285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.117290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.117299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.117304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.117309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.117351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:59.120841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256136819921971:5900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:59.120857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256136819921971:5900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:59.120860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256136819921971:5900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:59.120868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:59.120934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:59.121613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:59.121628Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:59.121631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:59.121634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:59.121641Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1839 [2:7556256134443023710:3044]
2025-10-01T14:12:59.121654Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:59.121670Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:59.121677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.121681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.121683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.121698Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:59.121708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:59.121718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:59.121773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.121782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.121784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.121787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:59.121790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:59.121845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:59.121853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.121863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.121873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.121892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:59.121914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922010:5900], now have 1 active actors on pipe
2025-10-01T14:12:59.121922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819921837:2446], now have 1 active actors on pipe
2025-10-01T14:12:59.121930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256134443023704:3044]
2025-10-01T14:12:59.121931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256134443023704:3044]
2025-10-01T14:12:59.121933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256134443023704:3044]
2025-10-01T14:12:59.121946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:59.121963Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:59.121964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:59.121966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:59.121968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:59.121977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:59.121980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:59.121958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1839
2025-10-01T14:12:59.121958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1839
2025-10-01T14:12:59.122009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256134443023704:3044]
2025-10-01T14:12:59.122020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:59.122033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:59.122037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.122041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.122281Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67f1d031-2706c49c-734c23a4-84f39e05_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:59.122298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.122303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.122305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:59.122314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.122328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:59.122358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.122540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.122553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.122574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.122650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1840 partition: 0 MaxSeqNo: 45 sessionId: src_id|67f1d031-2706c49c-734c23a4-84f39e05_0
2025-10-01T14:12:59.123008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98258c9c-58c98f29-c6090904-ef28b07d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67f1d031-2706c49c-734c23a4-84f39e05_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:59.125825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67f1d031-2706c49c-734c23a4-84f39e05_0] Write session: try to update token
2025-10-01T14:12:59.125844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67f1d031-2706c49c-734c23a4-84f39e05_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:59.139213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1840 sessionId: src_id|67f1d031-2706c49c-734c23a4-84f39e05_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:59.141439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:59.142176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.142197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.142220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:59.142223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:59.142225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:59.142227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:59.142235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256134443023704:3044]
2025-10-01T14:12:59.142240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256134443023704:3044]
2025-10-01T14:12:59.142243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256134443023704:3044]
2025-10-01T14:12:59.142276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:59.142286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:59.142290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:59.142297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:59.142305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.142307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:59.142463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:59.202620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256136819922018:6233]
2025-10-01T14:12:59.202865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1839, pipe: [1:7556256136819922018:6233]
2025-10-01T14:12:59.277709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:59.277976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:59.278027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922018:6233], now have 1 active actors on pipe
2025-10-01T14:12:59.278135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:59.278220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256136819922018:6233]
2025-10-01T14:12:59.278239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:59.289422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:59.289436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:59.289458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1840 reason: error at write: Disconnected sessionId: src_id|67f1d031-2706c49c-734c23a4-84f39e05_0
2025-10-01T14:12:59.289760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f1d031-2706c49c-734c23a4-84f39e05_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:59.289768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f1d031-2706c49c-734c23a4-84f39e05_0] Write session will restart in 0.009872s
2025-10-01T14:12:59.289606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1840 sessionId: src_id|67f1d031-2706c49c-734c23a4-84f39e05_0 is DEAD
2025-10-01T14:12:59.289793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f1d031-2706c49c-734c23a4-84f39e05_0] Write session: Do CDS request
2025-10-01T14:12:59.289801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f1d031-2706c49c-734c23a4-84f39e05_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:59.296685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:59.299041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:59.299242Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:59.299251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:59.299259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:59.299298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:59.299336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256134443023924:3031]
2025-10-01T14:12:59.299861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:59.300100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:59.300128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:59.300373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:59.300429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.300434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.300435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.300436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.300437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.300438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.300439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.300440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.300440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.300441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.300441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.300442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.300443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.300444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.300447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.300455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.300458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.300462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.300465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.300469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.300473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.300477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.300480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.300484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.300488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.300492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.300495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.300499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.300506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.300513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.300517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.300520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.300522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.300525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.300527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.300530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.300533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.300536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.300538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.300541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.300543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.300546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.300549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.300551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.300554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.300556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.300559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.300561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.300564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.300567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.300569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.300572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.300577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.300580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.300582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.300585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.300604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:59.300836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67f1d031-2706c49c-734c23a4-84f39e05_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.301268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:59.301281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1841
2025-10-01T14:12:59.301397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.301420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:59.301423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:59.301429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:59.301786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1841 sessionId:  describe result for acl check
2025-10-01T14:12:59.301818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:59.301824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:59.301826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:59.301830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256136819922163:5891] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:59.302301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256136819922163:5891] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:59.304228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:59.304424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256136819922163:5891] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:59.305052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:59.305065Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:59.305067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:59.305070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:59.305077Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1840 [2:7556256134443023924:3031]
2025-10-01T14:12:59.305092Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:59.305111Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:59.305118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.305121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.305123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.305138Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:59.305147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:59.305153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:59.305209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.305218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.305220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.305223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:59.305225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:59.305285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:59.305292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.305303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.305317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.305336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:59.305354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922019:2446], now have 1 active actors on pipe
2025-10-01T14:12:59.305365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256134443023918:3031]
2025-10-01T14:12:59.305371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256134443023918:3031]
2025-10-01T14:12:59.305373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256134443023918:3031]
2025-10-01T14:12:59.305361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1840
2025-10-01T14:12:59.305382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:59.305392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:59.305394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:59.305396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:59.305399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:59.305412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:59.305415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:59.305452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256134443023918:3031]
2025-10-01T14:12:59.305463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:59.305487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:59.309969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256136819922163:5891] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:59.309984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256136819922163:5891] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:59.309987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256136819922163:5891] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:59.309996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:59.310228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922198:5891], now have 1 active actors on pipe
2025-10-01T14:12:59.310253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1840
2025-10-01T14:12:59.310311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.310323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.310350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:59.310364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.310383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.310386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:59.310397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.310416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:59.310438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.310587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.310595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.310608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.310682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1841 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0
2025-10-01T14:12:59.311066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67f1d031-2706c49c-734c23a4-84f39e05_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:59.313760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0] Write session: try to update token
2025-10-01T14:12:59.313777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:59.325309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:59.325331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:59.325333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:59.325335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:59.325349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256134443023918:3031]
2025-10-01T14:12:59.325354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256134443023918:3031]
2025-10-01T14:12:59.325357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256134443023918:3031]
2025-10-01T14:12:59.325407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:59.325408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:59.325414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:59.325416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.325417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:59.325419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:59.325561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:59.327177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1841 sessionId: src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:59.329560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:59.378220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256136819922202:6233]
2025-10-01T14:12:59.378472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1840, pipe: [1:7556256136819922202:6233]
2025-10-01T14:12:59.470456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:59.470763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.470775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.470814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922202:6233], now have 1 active actors on pipe
2025-10-01T14:12:59.474594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:59.474990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:59.475007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256136819922202:6233]
2025-10-01T14:12:59.475028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:59.475085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1841 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0
2025-10-01T14:12:59.475297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1841 sessionId: src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0 is DEAD
2025-10-01T14:12:59.475420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:12:59.475430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0] Write session will restart in 0.009478s
2025-10-01T14:12:59.475455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0] Write session: Do CDS request
2025-10-01T14:12:59.475461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:59.485952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.486066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:59.486083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1842
2025-10-01T14:12:59.486196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.486230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:59.486241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:59.486245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:59.486636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1842 sessionId:  describe result for acl check
2025-10-01T14:12:59.486670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:59.486672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:59.486674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:59.486680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256136819922259:5877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:59.487217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256136819922259:5877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:59.489527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256136819922259:5877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:59.492081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256136819922259:5877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:59.492094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256136819922259:5877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:59.492102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256136819922259:5877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:59.492109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:59.492371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:59.494319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:59.494577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:59.494588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:59.494613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:59.494671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:59.494716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256134443024100:3026]
2025-10-01T14:12:59.495334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:59.495773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:59.495821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:59.496144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:59.496216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.496223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.496224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.496225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.496226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.496228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.496229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.496230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.496231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.496233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.496234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.496235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.496236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.496237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.496244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.496255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.496259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.496264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.496268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.496273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.496277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.496281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.496285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.496290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.496295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.496300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.496304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.496308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.496316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.496325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.496336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.496342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.496355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.496366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.496371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.496377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.496386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.496392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.496400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.496406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.496411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.496416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.496425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.496431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.496440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.496445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.496454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.496460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.496469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.496474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.496483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.496488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.496497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.496502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.496507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.496514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.496556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:59.500413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:59.501141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:59.501159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:59.501162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:59.501166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:59.501173Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1841 [2:7556256134443024100:3026]
2025-10-01T14:12:59.501190Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:59.501208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:59.501211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.501215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.501217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.501234Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:59.501245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:59.501251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:59.501316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.501323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.501325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.501329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:59.501332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:59.501401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:59.501408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.501420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.501436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.501455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:59.501477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922224:2446], now have 1 active actors on pipe
2025-10-01T14:12:59.501486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922396:5877], now have 1 active actors on pipe
2025-10-01T14:12:59.501494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256134443024095:3026]
2025-10-01T14:12:59.501500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256134443024095:3026]
2025-10-01T14:12:59.501502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256134443024095:3026]
2025-10-01T14:12:59.501515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:59.501525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:59.501527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:59.501529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:59.501533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:59.501549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:59.501557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:59.501559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1841
2025-10-01T14:12:59.501588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256134443024095:3026]
2025-10-01T14:12:59.501561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1841
2025-10-01T14:12:59.501596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:59.501597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:59.501625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.501635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.501669Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59de076d-88670248-8ed18f23-8beb1ed6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:59.501681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.501690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.501692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:59.501702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.501714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:59.501737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.501869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.501883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.501906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.501988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1842 partition: 0 MaxSeqNo: 45 sessionId: src_id|59de076d-88670248-8ed18f23-8beb1ed6_0
2025-10-01T14:12:59.502381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b2ada69-1a0c2d1f-3ea9c3a3-8aed4ea5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|59de076d-88670248-8ed18f23-8beb1ed6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:59.504660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59de076d-88670248-8ed18f23-8beb1ed6_0] Write session: try to update token
2025-10-01T14:12:59.504676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59de076d-88670248-8ed18f23-8beb1ed6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:59.520502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1842 sessionId: src_id|59de076d-88670248-8ed18f23-8beb1ed6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:59.522805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:59.522828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:59.522831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:59.522835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:59.522845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256134443024095:3026]
2025-10-01T14:12:59.522850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256134443024095:3026]
2025-10-01T14:12:59.522854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256134443024095:3026]
2025-10-01T14:12:59.522910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:59.522916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.522919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:59.523052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:59.523124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:59.523395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:59.523405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:59.523409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:59.574863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256136819922409:6233]
2025-10-01T14:12:59.575168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1841, pipe: [1:7556256136819922409:6233]
2025-10-01T14:12:59.678581Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:59.678934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.678950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.678992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922409:6233], now have 1 active actors on pipe
2025-10-01T14:12:59.679256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:12:59.679261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256136819922409:6233]
2025-10-01T14:12:59.679291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:59.679323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:59.679325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:59.679379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1842 reason: error at write: Disconnected sessionId: src_id|59de076d-88670248-8ed18f23-8beb1ed6_0
2025-10-01T14:12:59.679573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1842 sessionId: src_id|59de076d-88670248-8ed18f23-8beb1ed6_0 is DEAD
2025-10-01T14:12:59.679736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59de076d-88670248-8ed18f23-8beb1ed6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:59.679746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59de076d-88670248-8ed18f23-8beb1ed6_0] Write session will restart in 0.007166s
2025-10-01T14:12:59.679893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59de076d-88670248-8ed18f23-8beb1ed6_0] Write session: Do CDS request
2025-10-01T14:12:59.679899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59de076d-88670248-8ed18f23-8beb1ed6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:59.687872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59de076d-88670248-8ed18f23-8beb1ed6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.687937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:59.687951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1843
2025-10-01T14:12:59.688079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.688119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:59.688128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:59.688132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:59.688607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1843 sessionId:  describe result for acl check
2025-10-01T14:12:59.688657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:59.688662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:59.688664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:59.688669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256136819922519:5867] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:59.689172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256136819922519:5867] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:59.690813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:59.691319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256136819922519:5867] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:59.692721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:59.692898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:59.692907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:59.692916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:59.692972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:59.693005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256134443024277:3023]
2025-10-01T14:12:59.693625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:59.693807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256136819922519:5867] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:59.693819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256136819922519:5867] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:59.693822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256136819922519:5867] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:59.693830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:59.693833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:59.693866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:59.694146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:59.694189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.694194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.694195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.694196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.694197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.694199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.694200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.694201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.694202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.694203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.694204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.694205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.694206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.694207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.694211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.694219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.694223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.694226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.694230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.694233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.694237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.694240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.694243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.694247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.694250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.694253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.694256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.694259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.694264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.694271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.694276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.694281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.694285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.694289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.694295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.694299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.694307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.694313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.694317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.694321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.694330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.694335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.694339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.694347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.694351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.694355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.694362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.694367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.694385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.694390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.694394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.694398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.694402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.694407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.694410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.694414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.694449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:59.697909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:59.698750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:59.698763Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:59.698765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:59.698768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:59.698774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1842 [2:7556256134443024277:3023]
2025-10-01T14:12:59.698786Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:59.698801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:59.698808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.698811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.698813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.698826Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:59.698835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:59.698840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:59.698886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.698892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.698894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.698898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:59.698900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:59.698960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:59.698966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.698975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.698985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.699003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:59.699023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922586:5867], now have 1 active actors on pipe
2025-10-01T14:12:59.699029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922412:2446], now have 1 active actors on pipe
2025-10-01T14:12:59.699036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256134443024271:3023]
2025-10-01T14:12:59.699038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256134443024271:3023]
2025-10-01T14:12:59.699039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256134443024271:3023]
2025-10-01T14:12:59.699056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:59.699071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:59.699072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:59.699075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:59.699076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:59.699087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:59.699089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:59.699073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1842
2025-10-01T14:12:59.699090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1842
2025-10-01T14:12:59.699111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256134443024271:3023]
2025-10-01T14:12:59.699118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:59.699120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:59.699133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.699141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.699182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:59.699191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.699195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.699197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:59.699204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.699211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:59.699226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.699384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.699390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.699400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.699486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1843 partition: 0 MaxSeqNo: 45 sessionId: src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0
2025-10-01T14:12:59.699851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59de076d-88670248-8ed18f23-8beb1ed6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:59.702653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0] Write session: try to update token
2025-10-01T14:12:59.702672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:59.715140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1843 sessionId: src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:59.717527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:59.719046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.719070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.719088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:59.719094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:59.719096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:59.719098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:59.719106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256134443024271:3023]
2025-10-01T14:12:59.719110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256134443024271:3023]
2025-10-01T14:12:59.719113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256134443024271:3023]
2025-10-01T14:12:59.719157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:59.719172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:59.719175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:59.719176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:59.719181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.719187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:59.719326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:59.779662Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256136819922595:6233]
2025-10-01T14:12:59.780083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1842, pipe: [1:7556256136819922595:6233]
2025-10-01T14:12:59.865033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:12:59.865270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:59.865320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922595:6233], now have 1 active actors on pipe
2025-10-01T14:12:59.865405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:59.865541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256136819922595:6233]
2025-10-01T14:12:59.865677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:12:59.877068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:12:59.877083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:12:59.877107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1843 reason: error at write: Disconnected sessionId: src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0
2025-10-01T14:12:59.877272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1843 sessionId: src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0 is DEAD
2025-10-01T14:12:59.877397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:12:59.877409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0] Write session will restart in 0.009102s
2025-10-01T14:12:59.877434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0] Write session: Do CDS request
2025-10-01T14:12:59.877442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:12:59.882645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:12:59.884806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:12:59.885014Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:12:59.885026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:12:59.885038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:12:59.885106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:12:59.885150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256134443024453:3020]
2025-10-01T14:12:59.885763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:12:59.886069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:12:59.886117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:12:59.886427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:12:59.886490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.886497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.886498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.886499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.886500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.886501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.886503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.886504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.886505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.886506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.886508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.886509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.886510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.886511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.886516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.886525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.886529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.886533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.886537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.886540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.886544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.886548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.886552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.886556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.886560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.886564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.886567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.886570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.886577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.886585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:12:59.886592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.886597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:12:59.886602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.886609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:12:59.886619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.886624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:12:59.886629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.886634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:12:59.886643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.886647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:12:59.886652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.886662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:12:59.886666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.886670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:12:59.886675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.886681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:12:59.886689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.886695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.886703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.886709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.886717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.886722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.886727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.886736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:12:59.886740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.886745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:12:59.886785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:12:59.887924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.887939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:12:59.887952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1844
2025-10-01T14:12:59.888102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:12:59.888136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:12:59.888145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:12:59.888149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:12:59.888510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1844 sessionId:  describe result for acl check
2025-10-01T14:12:59.888550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:12:59.888556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:12:59.888558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:12:59.888563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256136819922743:5864] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:12:59.889114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256136819922743:5864] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:12:59.890393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:12:59.891235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256136819922743:5864] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:12:59.891221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:12:59.891234Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:12:59.891237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:12:59.891240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:12:59.891245Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1843 [2:7556256134443024453:3020]
2025-10-01T14:12:59.891259Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:12:59.891273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:12:59.891276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.891279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.891281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.891296Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:12:59.891302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:12:59.891308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:12:59.891357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.891364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.891366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.891370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:12:59.891372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:12:59.891434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:12:59.891443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.891454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:12:59.891464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:12:59.891480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:12:59.891501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922600:2446], now have 1 active actors on pipe
2025-10-01T14:12:59.891512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256134443024448:3020]
2025-10-01T14:12:59.891518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256134443024448:3020]
2025-10-01T14:12:59.891520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256134443024448:3020]
2025-10-01T14:12:59.891532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:12:59.891544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:12:59.891547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:12:59.891550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:12:59.891538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1843
2025-10-01T14:12:59.891553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:12:59.891559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:12:59.891562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:12:59.891593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256134443024448:3020]
2025-10-01T14:12:59.891605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:12:59.891611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:12:59.896257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256136819922743:5864] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:12:59.896284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256136819922743:5864] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:12:59.896287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256136819922743:5864] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:12:59.896295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:12:59.896517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922781:5864], now have 1 active actors on pipe
2025-10-01T14:12:59.896571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1843
2025-10-01T14:12:59.896633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.896644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.896671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1312cc29-3b9cddcc-6156a631-4049883_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:12:59.896683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:12:59.896691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:12:59.896693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:12:59.896703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:12:59.896718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:12:59.896733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.896960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.896980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.897005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:12:59.897080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1844 partition: 0 MaxSeqNo: 45 sessionId: src_id|1312cc29-3b9cddcc-6156a631-4049883_0
2025-10-01T14:12:59.897448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6afc4b41-2e65afcb-d90ba751-df224f5e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1312cc29-3b9cddcc-6156a631-4049883_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:12:59.899893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1312cc29-3b9cddcc-6156a631-4049883_0] Write session: try to update token
2025-10-01T14:12:59.899909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1312cc29-3b9cddcc-6156a631-4049883_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:12:59.909219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:12:59.909238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:59.909248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256134443024448:3020]
2025-10-01T14:12:59.909295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:12:59.909301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:12:59.909485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:12:59.909646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:59.909800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:59.909944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:12:59.910148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:12:59.910190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:12:59.913949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1844 sessionId: src_id|1312cc29-3b9cddcc-6156a631-4049883_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:12:59.916460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:12:59.916781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:12:59.916802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:12:59.916833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:12:59.916919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:12:59.921089Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:12:59.921107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:12:59.921109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:12:59.921112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:12:59.921123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256134443024448:3020]
2025-10-01T14:12:59.921128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256134443024448:3020]
2025-10-01T14:12:59.921131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256134443024448:3020]
2025-10-01T14:12:59.921176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:12:59.921179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:12:59.921186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:12:59.921188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:12:59.921188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:12:59.921192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:12:59.921321Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:12:59.965490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256136819922784:6233]
2025-10-01T14:12:59.965761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1843, pipe: [1:7556256136819922784:6233]
2025-10-01T14:13:00.065055Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:00.072394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.072420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.072575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.072644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.072711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.072772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.072816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.072823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.072886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.072942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.072998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.073062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.073101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.073108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.073174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.073240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.073304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.073362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.073404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.073409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.073473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.073532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.073602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.073662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.073704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.073709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.073780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.073838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.073895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.073951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.073997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.074003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.074069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.074145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.074219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.074296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.074344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.074351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.074445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.074516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.074588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.074657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.074701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.074708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.074829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.074914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.074988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.075051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.075093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.075099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.075165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.075227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.075293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.075369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.075413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.075418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.075482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.075541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.075602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.075666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.075716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.075719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.075790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256136819922784:6233], now have 1 active actors on pipe
2025-10-01T14:13:00.076484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:00.076781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:00.076550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256136819922784:6233]
2025-10-01T14:13:00.076580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:00.076583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:00.076608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1844 reason: error at write: Disconnected sessionId: src_id|1312cc29-3b9cddcc-6156a631-4049883_0
2025-10-01T14:13:00.076829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1844 sessionId: src_id|1312cc29-3b9cddcc-6156a631-4049883_0 is DEAD
2025-10-01T14:13:00.077158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1312cc29-3b9cddcc-6156a631-4049883_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:00.077169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1312cc29-3b9cddcc-6156a631-4049883_0] Write session will restart in 0.006075s
2025-10-01T14:13:00.077195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1312cc29-3b9cddcc-6156a631-4049883_0] Write session: Do CDS request
2025-10-01T14:13:00.077204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1312cc29-3b9cddcc-6156a631-4049883_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:00.090890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1312cc29-3b9cddcc-6156a631-4049883_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:00.091038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:00.091054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1845
2025-10-01T14:13:00.092052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:00.094337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:00.094647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:00.094697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:00.094707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:00.094711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:00.094613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:00.094618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:00.094631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:00.094684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:00.094716Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256138737991935:3012]
2025-10-01T14:13:00.095103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1845 sessionId:  describe result for acl check
2025-10-01T14:13:00.095133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:00.095139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:00.095140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:00.095145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256141114890245:5845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:00.095294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:00.095624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:00.095671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:00.095682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256141114890245:5845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:00.095964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:00.096024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.096030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.096032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.096033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.096034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.096035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.096036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.096037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.096038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.096038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.096040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.096041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.096042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.096043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.096048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.096057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.096060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.096064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.096067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.096071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.096074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.096077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.096081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.096085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.096089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.096092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.096095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.096099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.096105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.096112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.096119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.096124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.096127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.096132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.096136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.096140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.096145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.096149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.096154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.096158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.096164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.096168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.096172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.096177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.096183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.096187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.096195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.096209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.096214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.096232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.096237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.096243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.096249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.096253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.096258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.096267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.096306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:00.097677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256141114890245:5845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:00.101848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:00.102479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:00.102493Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:00.102496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:00.102500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:00.102507Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1844 [2:7556256138737991935:3012]
2025-10-01T14:13:00.102718Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:00.102756Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:00.102759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:00.102763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:00.102766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:00.102784Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:00.102790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:00.102796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:00.102864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.102872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.102874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.102877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:00.102880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:00.102943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:00.102949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.102961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.102974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.102991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:00.103011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256138737991930:3012]
2025-10-01T14:13:00.103017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256138737991930:3012]
2025-10-01T14:13:00.103019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256138737991930:3012]
2025-10-01T14:13:00.103033Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:00.103051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:00.103069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:00.103068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:00.103071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:00.103073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:00.103075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:00.103108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256138737991930:3012]
2025-10-01T14:13:00.103115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:00.103158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:00.103299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890105:2446], now have 1 active actors on pipe
2025-10-01T14:13:00.103290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1844
2025-10-01T14:13:00.103787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256141114890245:5845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:00.103802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256141114890245:5845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:00.103805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256141114890245:5845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:00.103813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:00.104031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890285:5845], now have 1 active actors on pipe
2025-10-01T14:13:00.104052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1844
2025-10-01T14:13:00.104121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.104134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.104171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:00.104183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:00.104188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:00.104191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:00.104201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:00.104217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:00.104238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:00.104470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.104486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.104511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:00.104607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1845 partition: 0 MaxSeqNo: 45 sessionId: src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0
2025-10-01T14:13:00.105025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1312cc29-3b9cddcc-6156a631-4049883_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:00.107659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0] Write session: try to update token
2025-10-01T14:13:00.107682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:00.114932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:00.114946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:00.114956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256138737991930:3012]
2025-10-01T14:13:00.115002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:00.115002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:00.115194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:00.115354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:00.115565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:00.115765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:00.116080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:00.116128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:00.129885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1845 sessionId: src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:00.132769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:00.133308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.133330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.133379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:00.133563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:00.135665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:00.135685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:00.135688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:00.135691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:00.135703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256138737991930:3012]
2025-10-01T14:13:00.135708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256138737991930:3012]
2025-10-01T14:13:00.135711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256138737991930:3012]
2025-10-01T14:13:00.135762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:00.135775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.135778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:00.135926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:00.137871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:00.137886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:00.137890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:00.176955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256141114890291:6233]
2025-10-01T14:13:00.177186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1844, pipe: [1:7556256141114890291:6233]
2025-10-01T14:13:00.291202Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:00.299563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.299592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.299759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.299818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.299881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.299935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.299978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.299988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.300053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.300109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.300164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.300227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.300270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.300278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.300342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.300405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.300471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.300545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.300589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.300596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.300676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.300739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.300799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.300859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.300903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.300911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.300974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.301030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.301092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.301154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.301217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.301225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.301288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.301346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.301407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.301473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.301517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.301524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.301588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.301645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.301710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.301771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.301815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.301824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.301892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.301951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.302013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.302078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.302126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.302134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.302199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.302265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.302337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.302419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.302469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.302476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.302542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.302600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.302658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.302721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.302763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.302770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.302895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890291:6233], now have 1 active actors on pipe
2025-10-01T14:13:00.304004Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:00.306617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:00.306668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1845 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0
2025-10-01T14:13:00.306879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1845 sessionId: src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0 is DEAD
2025-10-01T14:13:00.307278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256141114890291:6233]
2025-10-01T14:13:00.307662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:00.310199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:00.310218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0] Write session will restart in 0.008457s
2025-10-01T14:13:00.310244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0] Write session: Do CDS request
2025-10-01T14:13:00.310250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:00.320571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:00.320658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:00.320675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1846
2025-10-01T14:13:00.320980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:00.321022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:00.321028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:00.321033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:00.322256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1846 sessionId:  describe result for acl check
2025-10-01T14:13:00.322301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:00.322303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:00.322305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:00.322310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256141114890348:5832] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:00.322985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256141114890348:5832] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:00.327393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256141114890348:5832] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:00.332971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256141114890348:5832] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:00.332988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256141114890348:5832] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:00.332992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256141114890348:5832] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:00.333000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:00.337361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:00.340200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:00.340448Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:00.340460Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:00.340474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:00.340540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:00.340593Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256138737992141:2994]
2025-10-01T14:13:00.341176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:00.341567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:00.341627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:00.341966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:00.342032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.342038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.342040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.342041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.342042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.342043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.342045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.342047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.342047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.342049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.342050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.342052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.342053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.342054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.342060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.342070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.342074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.342079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.342083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.342088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.342092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.342095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.342099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.342104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.342107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.342111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.342116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.342119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.342126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.342134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.342140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.342146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.342151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.342155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.342159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.342165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.342170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.342176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.342180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.342185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.342194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.342201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.342210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.342215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.342220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.342229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.342233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.342238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.342243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.342252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.342257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.342262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.342272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.342277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.342285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.342291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.342347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:00.350062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:00.351355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:00.351378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:00.351380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:00.351384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:00.351392Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1845 [2:7556256138737992141:2994]
2025-10-01T14:13:00.351409Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:00.351430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:00.351439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:00.351444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:00.351446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:00.351466Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:00.351476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:00.351483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:00.351548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.351557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.351559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.351562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:00.351565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:00.351643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:00.351652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.351665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.351676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.351697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:00.351719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256138737992135:2994]
2025-10-01T14:13:00.351725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256138737992135:2994]
2025-10-01T14:13:00.351727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256138737992135:2994]
2025-10-01T14:13:00.351742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:00.351760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:00.351779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:00.351786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:00.351798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:00.351809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:00.351812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:00.351828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256138737992135:2994]
2025-10-01T14:13:00.351836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:00.351895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:00.352100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890466:5832], now have 1 active actors on pipe
2025-10-01T14:13:00.352112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890296:2446], now have 1 active actors on pipe
2025-10-01T14:13:00.352131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.352141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.352169Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:00.352181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:00.352186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:00.352188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:00.352198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:00.352208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:00.352235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:00.352010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1845
2025-10-01T14:13:00.352045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1845
2025-10-01T14:13:00.352455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.352465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.352480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:00.352564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1846 partition: 0 MaxSeqNo: 45 sessionId: src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0
2025-10-01T14:13:00.353017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aae778fb-7d6a437c-ed3ac241-7b11dd6b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:00.355771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0] Write session: try to update token
2025-10-01T14:13:00.355788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:00.363814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:00.363830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:00.363840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256138737992135:2994]
2025-10-01T14:13:00.363885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:00.364095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:00.364246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:00.364389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:00.364533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:00.364767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:00.364809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:00.366524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:00.374654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1846 sessionId: src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:00.378261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:00.378552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.378579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.378626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:00.378753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:00.383866Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:00.384464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:00.384475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:00.384476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:00.384486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256138737992135:2994]
2025-10-01T14:13:00.384490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256138737992135:2994]
2025-10-01T14:13:00.384493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256138737992135:2994]
2025-10-01T14:13:00.384547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:00.384558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.384561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:00.384722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:00.386887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:00.386902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:00.386906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:00.410447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256141114890495:6233]
2025-10-01T14:13:00.410677Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1845, pipe: [1:7556256141114890495:6233]
2025-10-01T14:13:00.528015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:00.536584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.536611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.536805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.536863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.536925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.536983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.537024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.537029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.537097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.537157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.537215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.537275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.537316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.537319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.537391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.537451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.537511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.537571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.537611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.537614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.537689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.537793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.537857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.537921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.537961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.537964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.538034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.538099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.538162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.538229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.538272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.538292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.538387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.538456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.538527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.538598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.538647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.538649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.538719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.538776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.538842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.538904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.538948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.538951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.539015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.539070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.539127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.539191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.539230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.539233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.539303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.539364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.539420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.539478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.539517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.539520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.539582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.539638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.539695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.539752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.539794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.539796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.539867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890495:6233], now have 1 active actors on pipe
2025-10-01T14:13:00.541279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256141114890495:6233]
2025-10-01T14:13:00.541283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:00.541287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:00.541310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:00.541315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1846 reason: error at write: Disconnected sessionId: src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0
2025-10-01T14:13:00.541447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:00.541534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1846 sessionId: src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0 is DEAD
2025-10-01T14:13:00.541871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:00.541886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0] Write session will restart in 0.007732s
2025-10-01T14:13:00.541913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0] Write session: Do CDS request
2025-10-01T14:13:00.541920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:00.550821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:00.551431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:00.551447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1847
2025-10-01T14:13:00.551655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:00.551685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:00.551693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:00.551696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:00.552166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1847 sessionId:  describe result for acl check
2025-10-01T14:13:00.552202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:00.552204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:00.552206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:00.552211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256141114890567:5816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:00.552776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256141114890567:5816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:00.556125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256141114890567:5816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:00.560600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:00.560642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256141114890567:5816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:00.560657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256141114890567:5816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:00.560662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256141114890567:5816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:00.560670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:00.563291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:00.563497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:00.563508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:00.563520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:00.563567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:00.563605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256138737992336:2981]
2025-10-01T14:13:00.564107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:00.564435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:00.564476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:00.564752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:00.564798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.564799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.564800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.564801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.564802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.564803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.564804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.564805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.564806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.564807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.564808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.564809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.564810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.564811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.564815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.564823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.564827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.564829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.564833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.564836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.564839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.564842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.564845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.564848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.564851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.564854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.564857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.564860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.564868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.564875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.564880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.564884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.564888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.564891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.564895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.564899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.564902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.564906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.564910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.564913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.564917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.564922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.564925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.564929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.564933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.564936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.564940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.564943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.564948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.564952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.564955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.564958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.564963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.564967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.564971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.564974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.565006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:00.569302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:00.569881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:00.569896Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:00.569899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:00.569902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:00.569909Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1846 [2:7556256138737992336:2981]
2025-10-01T14:13:00.569925Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:00.569943Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:00.569951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:00.569955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:00.569957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:00.569973Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:00.569982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:00.569989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:00.570048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.570054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.570056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.570060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:00.570063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:00.570303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1846
2025-10-01T14:13:00.570347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1846
2025-10-01T14:13:00.570132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:00.570142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.570153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.570164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.570180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:00.570197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890681:5816], now have 1 active actors on pipe
2025-10-01T14:13:00.570201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890506:2446], now have 1 active actors on pipe
2025-10-01T14:13:00.570208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256138737992330:2981]
2025-10-01T14:13:00.570211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256138737992330:2981]
2025-10-01T14:13:00.570213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256138737992330:2981]
2025-10-01T14:13:00.570226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:00.570238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:00.570252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:00.570256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:00.570288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256138737992330:2981]
2025-10-01T14:13:00.570290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:00.570338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:00.570340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:00.570342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:00.570347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:00.570568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.570574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.570604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:00.570616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:00.570621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:00.570624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:00.570633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:00.570641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:00.570656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:00.570870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.570878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.570900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:00.571043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1847 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0
2025-10-01T14:13:00.571473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9e2a7b4-f981c133-17b727d3-a97ea9df_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:00.574171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0] Write session: try to update token
2025-10-01T14:13:00.574188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:00.589819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1847 sessionId: src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:00.592306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:00.592539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.592733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.592780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:00.592889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:00.597191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:00.597213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:00.597215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:00.597217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:00.597226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256138737992330:2981]
2025-10-01T14:13:00.597230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256138737992330:2981]
2025-10-01T14:13:00.597234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256138737992330:2981]
2025-10-01T14:13:00.597281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:00.597291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.597293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:00.597432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:00.597960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:00.597976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:00.597980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:00.641311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256141114890694:6233]
2025-10-01T14:13:00.642011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1846, pipe: [1:7556256141114890694:6233]
2025-10-01T14:13:00.757929Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:00.766696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.766724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.766912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.766982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.767060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.767132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.767183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.767194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.767274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.767340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.767411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.767485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.767535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.767542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.767613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.767680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.767749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.767815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.767867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.767877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.767944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.768021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.768089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.768169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.768217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.768220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.768286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.768381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.768438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.768496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.768535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.768537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.768638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.768697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.768758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.768824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.768868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.768871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.768939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.768995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.769079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.769156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.769196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.769198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.769261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.769319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.769378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.769442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.769484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.769489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.769563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.769624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.769691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.769757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.769813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.769816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.769886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:00.769947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:00.770012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:00.770076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:00.770115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:00.770118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:00.770191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890694:6233], now have 1 active actors on pipe
2025-10-01T14:13:00.770818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:00.770834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:00.770862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1847 reason: error at write: Disconnected sessionId: src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0
2025-10-01T14:13:00.770966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256141114890694:6233]
2025-10-01T14:13:00.770983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:00.771097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1847 sessionId: src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0 is DEAD
2025-10-01T14:13:00.771283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:00.771295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0] Write session will restart in 0.006995s
2025-10-01T14:13:00.771322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0] Write session: Do CDS request
2025-10-01T14:13:00.771328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:00.771680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:00.779977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:00.782766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:00.782779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1848
2025-10-01T14:13:00.782942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:00.782969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:00.782974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:00.782977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:00.783530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1848 sessionId:  describe result for acl check
2025-10-01T14:13:00.783558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:00.783561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:00.783563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:00.783568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256141114890721:5823] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:00.784036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256141114890721:5823] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:00.790009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256141114890721:5823] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:00.795613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256141114890721:5823] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:00.795631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256141114890721:5823] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:00.795634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256141114890721:5823] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:00.795644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:00.797542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:00.800918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:00.801161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:00.801165Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:00.801177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:00.801226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:00.801261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256138737992518:2979]
2025-10-01T14:13:00.801882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:00.802414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:00.802465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:00.802785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:00.802843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.802845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.802846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.802847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.802849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.802850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.802852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.802853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.802854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.802856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.802857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.802858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.802860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.802861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.802867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.802877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.802881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.802885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.802889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.802893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.802898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.802902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.802906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.802911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.802915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.802919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.802923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.802927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.802937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.802946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:00.802953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.802960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:00.802964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.802970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:00.802975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.802980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:00.802984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.802990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:00.802994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.803000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:00.803006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.803011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:00.803017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.803022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:00.803026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.803031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:00.803036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.803042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.803047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.803052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.803057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.803062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.803068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.803074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:00.803078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.803084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:00.803133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:00.808656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:00.809270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:00.809275Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:00.809280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:00.809283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:00.809292Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1847 [2:7556256138737992518:2979]
2025-10-01T14:13:00.809312Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:00.809329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:00.809332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:00.809335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:00.809337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:00.809355Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:00.809360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:00.809365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:00.809454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.809456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.809458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.809461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:00.809463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:00.809544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:00.809548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.809559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:00.809568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:00.809581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:00.809598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256138737992512:2979]
2025-10-01T14:13:00.809601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256138737992512:2979]
2025-10-01T14:13:00.809603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256138737992512:2979]
2025-10-01T14:13:00.809611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:00.809628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:00.809637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:00.809640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:00.809675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256138737992512:2979]
2025-10-01T14:13:00.809676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:00.810000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:00.810002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:00.810003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:00.810006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:00.810552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1847
2025-10-01T14:13:00.810589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1847
2025-10-01T14:13:00.810696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890696:2446], now have 1 active actors on pipe
2025-10-01T14:13:00.810707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890869:5823], now have 1 active actors on pipe
2025-10-01T14:13:00.810724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.810729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.810754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:00.810763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:00.810768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:00.810770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:00.810781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:00.810794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:00.810809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:00.811014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.811020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.811035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:00.812144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1848 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0
2025-10-01T14:13:00.812637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b7719d0-a3b6d2bd-aa11e2d8-512aec12_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:00.815283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0] Write session: try to update token
2025-10-01T14:13:00.815303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:00.834214Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:00.834232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:00.834235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:00.834237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:00.834247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256138737992512:2979]
2025-10-01T14:13:00.834253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256138737992512:2979]
2025-10-01T14:13:00.834260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256138737992512:2979]
2025-10-01T14:13:00.834308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:00.834310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:00.834314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:00.834317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:00.834317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:00.834319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:00.834483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:00.850788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1848 sessionId: src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:00.853143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:00.870190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256141114890887:6233]
2025-10-01T14:13:00.870626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1847, pipe: [1:7556256141114890887:6233]
2025-10-01T14:13:00.992109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:00.992649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:00.992662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:00.992683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890887:6233], now have 1 active actors on pipe
2025-10-01T14:13:00.992892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:00.993215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:00.993250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:00.993273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256141114890887:6233]
2025-10-01T14:13:00.993314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1848 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0
2025-10-01T14:13:00.993500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1848 sessionId: src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0 is DEAD
2025-10-01T14:13:00.994594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:00.994607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0] Write session will restart in 0.006877s
2025-10-01T14:13:00.994646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0] Write session: Do CDS request
2025-10-01T14:13:00.994652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:01.002957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.003159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:01.003173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1849
2025-10-01T14:13:01.003331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.003359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:01.003364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:01.003368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:01.003819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1849 sessionId:  describe result for acl check
2025-10-01T14:13:01.003847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:01.003848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:01.003851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:01.003856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256145409858291:5813] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:01.004354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256145409858291:5813] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:01.006949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:01.009800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:01.010034Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:01.010049Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:01.010064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:01.010131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:01.010172Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256143032959996:2977]
2025-10-01T14:13:01.007024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256145409858291:5813] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:01.010635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:01.010898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:01.010938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:01.011226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:01.011281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.011287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.011288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.011289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.011291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.011292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.011293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.011295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.011296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.011297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.011298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.011299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.011301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.011302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.011307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.011316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.011320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.011324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.011327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.011329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.011331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.011333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.011335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.011337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.011339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.011341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.011343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.011345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.011351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.011355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.011359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.011362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.011365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.011368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.011371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.011374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.011376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.011379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.011381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.011385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.011387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.011390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.011393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.011396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.011398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.011401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.011404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.011407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.011409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.011412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.011414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.011417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.011420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.011423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.011426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.011429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.011469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:01.015072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256145409858291:5813] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:01.015092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256145409858291:5813] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:01.015095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256145409858291:5813] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:01.015104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:01.015222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:01.015838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:01.015854Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:01.015857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:01.015861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:01.015867Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1848 [2:7556256143032959996:2977]
2025-10-01T14:13:01.015884Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:01.015900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:01.015908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.015912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.015914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.015930Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:01.015940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:01.015945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:01.016003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.016011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.016013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.016016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:01.016019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:01.016092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:01.016100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.016111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.016122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.016139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:01.016161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858379:5813], now have 1 active actors on pipe
2025-10-01T14:13:01.016170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256141114890892:2446], now have 1 active actors on pipe
2025-10-01T14:13:01.016177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256143032959990:2977]
2025-10-01T14:13:01.016184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256143032959990:2977]
2025-10-01T14:13:01.016186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256143032959990:2977]
2025-10-01T14:13:01.016201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:01.016216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:01.016218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:01.016226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:01.016230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:01.016186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1848
2025-10-01T14:13:01.016231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:01.016211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1848
2025-10-01T14:13:01.016234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:01.016276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.016285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.016302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256143032959990:2977]
2025-10-01T14:13:01.016314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:01.016329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:01.016346Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b499a-961fbc2c-de53e09b-cb87a99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:01.016356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.016365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.016368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:01.016377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.016390Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:01.016416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.016539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.016547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.016560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.016636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1849 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b499a-961fbc2c-de53e09b-cb87a99_0
2025-10-01T14:13:01.017074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4becc83-b4e61fae-74a82a5a-89ac9c61_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b499a-961fbc2c-de53e09b-cb87a99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:01.020046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b499a-961fbc2c-de53e09b-cb87a99_0] Write session: try to update token
2025-10-01T14:13:01.020066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b499a-961fbc2c-de53e09b-cb87a99_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:01.036250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:01.036270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:01.036273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:01.036275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:01.036283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256143032959990:2977]
2025-10-01T14:13:01.036287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256143032959990:2977]
2025-10-01T14:13:01.036290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256143032959990:2977]
2025-10-01T14:13:01.036338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:01.036349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.036351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:01.036453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:01.036467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:01.036470Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:01.036483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:01.036686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1849 sessionId: src_id|6b499a-961fbc2c-de53e09b-cb87a99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:01.039154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:01.091363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256145409858396:6233]
2025-10-01T14:13:01.091669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1848, pipe: [1:7556256145409858396:6233]
2025-10-01T14:13:01.170693Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:13:01.184368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:01.184883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.184905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.184952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858396:6233], now have 1 active actors on pipe
2025-10-01T14:13:01.185141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:01.185173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:01.185187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:01.185246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1849 reason: error at write: Disconnected sessionId: src_id|6b499a-961fbc2c-de53e09b-cb87a99_0
2025-10-01T14:13:01.185438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1849 sessionId: src_id|6b499a-961fbc2c-de53e09b-cb87a99_0 is DEAD
2025-10-01T14:13:01.185536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256145409858396:6233]
2025-10-01T14:13:01.185552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:01.185628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b499a-961fbc2c-de53e09b-cb87a99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:01.185642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b499a-961fbc2c-de53e09b-cb87a99_0] Write session will restart in 0.009177s
2025-10-01T14:13:01.185667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b499a-961fbc2c-de53e09b-cb87a99_0] Write session: Do CDS request
2025-10-01T14:13:01.185674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b499a-961fbc2c-de53e09b-cb87a99_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:01.195850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b499a-961fbc2c-de53e09b-cb87a99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.196237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:01.196254Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1850
2025-10-01T14:13:01.196366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.196405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:01.196416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:01.196420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:01.196819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1850 sessionId:  describe result for acl check
2025-10-01T14:13:01.196855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:01.196871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:01.196872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:01.196877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256145409858541:5793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:01.197349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256145409858541:5793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:01.197351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:01.199441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256145409858541:5793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:01.199763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:01.199984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:01.199988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:01.200000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:01.200057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:01.200089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256143032960199:2965]
2025-10-01T14:13:01.200650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:01.200923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:01.200975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:01.201317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:01.201383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.201389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.201390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.201391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.201392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.201394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.201394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.201395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.201396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.201397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.201398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.201399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.201400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.201401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.201406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.201415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.201418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.201421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.201424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.201427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.201430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.201434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.201436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.201440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.201442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.201445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.201448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.201451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.201457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.201464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.201469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.201474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.201478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.201482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.201485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.201490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.201494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.201499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.201503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.201508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.201512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.201518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.201522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.201526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.201530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.201534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.201538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.201542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.201546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.201550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.201554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.201558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.201562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.201566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.201570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.201574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.201606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:01.201538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256145409858541:5793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:01.201550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256145409858541:5793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:01.201553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256145409858541:5793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:01.201561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:01.205207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:01.206074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:01.206087Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:01.206089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:01.206092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:01.206098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1849 [2:7556256143032960199:2965]
2025-10-01T14:13:01.206113Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:01.206133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:01.206140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.206143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.206145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.206160Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:01.206169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:01.206175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:01.206227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.206234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.206236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.206239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:01.206242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:01.206300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:01.206306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.206316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.206328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.206344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:01.206366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858580:5793], now have 1 active actors on pipe
2025-10-01T14:13:01.206391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858399:2446], now have 1 active actors on pipe
2025-10-01T14:13:01.206398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256143032960193:2965]
2025-10-01T14:13:01.206400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256143032960193:2965]
2025-10-01T14:13:01.206402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256143032960193:2965]
2025-10-01T14:13:01.206416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:01.206424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:01.206426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:01.206428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:01.206433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:01.206419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1849
2025-10-01T14:13:01.206445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:01.206451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:01.206419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1849
2025-10-01T14:13:01.206502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.206514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.206526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256143032960193:2965]
2025-10-01T14:13:01.206535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:01.206557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:01.206565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:01.206571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.206575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.206577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:01.206585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.206593Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:01.206620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.206762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.206770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.206785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.206869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1850 partition: 0 MaxSeqNo: 45 sessionId: src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0
2025-10-01T14:13:01.207283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b499a-961fbc2c-de53e09b-cb87a99_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:01.210139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0] Write session: try to update token
2025-10-01T14:13:01.210157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:01.227162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:01.227185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:01.227187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:01.227190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:01.227201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256143032960193:2965]
2025-10-01T14:13:01.227206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256143032960193:2965]
2025-10-01T14:13:01.227210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256143032960193:2965]
2025-10-01T14:13:01.227259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:01.227266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.227266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:01.227268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:01.227273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:01.227278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:01.227414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:01.228902Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1850 sessionId: src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:01.231619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:01.285949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256145409858589:6233]
2025-10-01T14:13:01.286290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1849, pipe: [1:7556256145409858589:6233]
2025-10-01T14:13:01.373655Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:01.374094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.374112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.374158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858589:6233], now have 1 active actors on pipe
2025-10-01T14:13:01.374350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:01.374585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256145409858589:6233]
2025-10-01T14:13:01.374616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:01.374686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1850 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0
2025-10-01T14:13:01.374776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:01.374903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1850 sessionId: src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0 is DEAD
2025-10-01T14:13:01.375297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:01.375313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0] Write session will restart in 0.008412s
2025-10-01T14:13:01.375344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0] Write session: Do CDS request
2025-10-01T14:13:01.375351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:01.386813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.386898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:01.386919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1851
2025-10-01T14:13:01.387028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.387055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:01.387059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:01.387062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:01.387444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1851 sessionId:  describe result for acl check
2025-10-01T14:13:01.387478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:01.387483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:01.387485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:01.387490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256145409858670:5788] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:01.387968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256145409858670:5788] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:01.390261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256145409858670:5788] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:01.392325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:01.394316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256145409858670:5788] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:01.394331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256145409858670:5788] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:01.394334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256145409858670:5788] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:01.394341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:01.394401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:01.394646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:01.394656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:01.394668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:01.394725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:01.394761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256143032960412:2953]
2025-10-01T14:13:01.395276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:01.395560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:01.395601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:01.395883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:01.395929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.395930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.395931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.395932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.395933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.395934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.395936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.395937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.395938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.395939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.395940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.395941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.395942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.395943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.395948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.395955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.395959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.395963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.395966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.395969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.395972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.395975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.395978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.395982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.395985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.395987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.395991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.395994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.395999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.396006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.396011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.396015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.396032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.396036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.396040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.396044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.396048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.396052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.396055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.396059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.396063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.396067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.396070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.396074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.396077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.396082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.396085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.396089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.396093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.396097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.396100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.396104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.396108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.396112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.396116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.396121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.396154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:01.399983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:01.400765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:01.400779Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:01.400782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:01.400785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:01.400792Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1850 [2:7556256143032960412:2953]
2025-10-01T14:13:01.400807Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:01.400822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:01.400829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.400833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.400835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.400852Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:01.400858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:01.400863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:01.400920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.400926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.400928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.400932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:01.400934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:01.400997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:01.401004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.401015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.401029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.401049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:01.401072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858592:2446], now have 1 active actors on pipe
2025-10-01T14:13:01.401079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858783:5788], now have 1 active actors on pipe
2025-10-01T14:13:01.401086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256143032960394:2953]
2025-10-01T14:13:01.401092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256143032960394:2953]
2025-10-01T14:13:01.401094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256143032960394:2953]
2025-10-01T14:13:01.401110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:01.401126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:01.401143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:01.401151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:01.401180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256143032960394:2953]
2025-10-01T14:13:01.401186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:01.401225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:01.401236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:01.401238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:01.401244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:01.402239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1850
2025-10-01T14:13:01.402244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1850
2025-10-01T14:13:01.402448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.402460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.402489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92fed58f-113dd49a-d6015f2d-65737372_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:01.402497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.402501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.402503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:01.402513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.402523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:01.402537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.402760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.402767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.402789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.403753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1851 partition: 0 MaxSeqNo: 45 sessionId: src_id|92fed58f-113dd49a-d6015f2d-65737372_0
2025-10-01T14:13:01.404455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c2e2a3c-29cf2bf2-4f51ace0-8744980c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|92fed58f-113dd49a-d6015f2d-65737372_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:01.407716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92fed58f-113dd49a-d6015f2d-65737372_0] Write session: try to update token
2025-10-01T14:13:01.407743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92fed58f-113dd49a-d6015f2d-65737372_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:01.419424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:01.419443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:01.419455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256143032960394:2953]
2025-10-01T14:13:01.419505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:01.419511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:01.419679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:01.419821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:01.419951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:01.420109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:01.420287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:01.420323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:01.433981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:01.434002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:01.434005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:01.434008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:01.434019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256143032960394:2953]
2025-10-01T14:13:01.434023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256143032960394:2953]
2025-10-01T14:13:01.434032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256143032960394:2953]
2025-10-01T14:13:01.434076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:01.434084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:01.434089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:01.434091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.434093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:01.434093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:01.434223Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:01.460084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1851 sessionId: src_id|92fed58f-113dd49a-d6015f2d-65737372_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:01.462585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:01.474853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256145409858800:6233]
2025-10-01T14:13:01.475088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1850, pipe: [1:7556256145409858800:6233]
2025-10-01T14:13:01.598121Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:01.598623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.598640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.598665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858800:6233], now have 1 active actors on pipe
2025-10-01T14:13:01.598863Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:01.599132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:01.599140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256145409858800:6233]
2025-10-01T14:13:01.599161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:01.599240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1851 reason: status is not ok: tablet will be restarted right now sessionId: src_id|92fed58f-113dd49a-d6015f2d-65737372_0
2025-10-01T14:13:01.599437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1851 sessionId: src_id|92fed58f-113dd49a-d6015f2d-65737372_0 is DEAD
2025-10-01T14:13:01.602512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fed58f-113dd49a-d6015f2d-65737372_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:01.602524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fed58f-113dd49a-d6015f2d-65737372_0] Write session will restart in 0.009294s
2025-10-01T14:13:01.602552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fed58f-113dd49a-d6015f2d-65737372_0] Write session: Do CDS request
2025-10-01T14:13:01.602558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fed58f-113dd49a-d6015f2d-65737372_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:01.613015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92fed58f-113dd49a-d6015f2d-65737372_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.618459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:01.618477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1852
2025-10-01T14:13:01.622507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.622567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:01.622572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:01.622577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:01.623101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1852 sessionId:  describe result for acl check
2025-10-01T14:13:01.623140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:01.623146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:01.623148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:01.623153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256145409858904:5778] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:01.623669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256145409858904:5778] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:01.625731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256145409858904:5778] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:01.626896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:01.628886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:01.629101Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:01.629113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:01.629125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:01.629171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:01.629209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256143032960597:2949]
2025-10-01T14:13:01.629251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256145409858904:5778] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:01.629266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256145409858904:5778] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:01.629269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256145409858904:5778] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:01.629277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:01.629840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:01.630138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:01.630180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:01.630539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:01.630601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.630606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.630607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.630608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.630610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.630611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.630612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.630613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.630614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.630615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.630617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.630618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.630619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.630620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.630626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.630636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.630641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.630645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.630649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.630653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.630656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.630660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.630664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.630668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.630672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.630676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.630679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.630683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.630691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.630699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.630705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.630711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.630718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.630725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.630730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.630738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.630747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.630754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.630761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.630771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.630775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.630785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.630790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.630799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.630804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.630813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.630817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.630823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.630832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.630837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.630840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.630845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.630850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.630855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.630860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.630865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.630909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:01.635107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:01.635749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:01.635765Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:01.635768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:01.635772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:01.635779Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1851 [2:7556256143032960597:2949]
2025-10-01T14:13:01.635797Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:01.635815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:01.635825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.635829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.635831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.635848Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:01.635858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:01.635864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:01.636183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.636194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.636196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.636199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:01.636202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:01.636279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:01.636282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.636295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.636312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.636331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:01.636348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256143032960592:2949]
2025-10-01T14:13:01.636351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256143032960592:2949]
2025-10-01T14:13:01.636353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256143032960592:2949]
2025-10-01T14:13:01.636365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:01.636380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:01.636394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:01.636397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:01.636425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:01.636430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:01.636433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:01.636434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256143032960592:2949]
2025-10-01T14:13:01.636436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:01.636443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:01.636457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858987:5778], now have 1 active actors on pipe
2025-10-01T14:13:01.636460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409858806:2446], now have 1 active actors on pipe
2025-10-01T14:13:01.636705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1851
2025-10-01T14:13:01.636739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1851
2025-10-01T14:13:01.636934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.636947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.636979Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a6ad081-3168ea36-259bba46-648db1eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:01.636989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.636994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.636996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:01.637008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.637019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:01.637036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.637668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.637680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.637701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.637893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1852 partition: 0 MaxSeqNo: 45 sessionId: src_id|7a6ad081-3168ea36-259bba46-648db1eb_0
2025-10-01T14:13:01.638489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92fed58f-113dd49a-d6015f2d-65737372_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7a6ad081-3168ea36-259bba46-648db1eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:01.641304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ad081-3168ea36-259bba46-648db1eb_0] Write session: try to update token
2025-10-01T14:13:01.641321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ad081-3168ea36-259bba46-648db1eb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:01.658672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:01.658694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:01.658697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:01.658698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:01.658710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256143032960592:2949]
2025-10-01T14:13:01.658719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256143032960592:2949]
2025-10-01T14:13:01.658723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256143032960592:2949]
2025-10-01T14:13:01.658779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:01.658786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.658790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:01.658938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:01.662665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:01.662688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:01.662693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:01.664961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1852 sessionId: src_id|7a6ad081-3168ea36-259bba46-648db1eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:01.667944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:01.699772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256145409859000:6233]
2025-10-01T14:13:01.700242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1851, pipe: [1:7556256145409859000:6233]
2025-10-01T14:13:01.819072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:01.819493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.819513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.819560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409859000:6233], now have 1 active actors on pipe
2025-10-01T14:13:01.819798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:01.820030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:01.820212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1852 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a6ad081-3168ea36-259bba46-648db1eb_0
2025-10-01T14:13:01.820257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:01.820304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256145409859000:6233]
2025-10-01T14:13:01.820376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1852 sessionId: src_id|7a6ad081-3168ea36-259bba46-648db1eb_0 is DEAD
2025-10-01T14:13:01.820596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ad081-3168ea36-259bba46-648db1eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:01.820611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ad081-3168ea36-259bba46-648db1eb_0] Write session will restart in 0.008843s
2025-10-01T14:13:01.820652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ad081-3168ea36-259bba46-648db1eb_0] Write session: Do CDS request
2025-10-01T14:13:01.820659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ad081-3168ea36-259bba46-648db1eb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:01.830910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ad081-3168ea36-259bba46-648db1eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.831009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:01.831025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1853
2025-10-01T14:13:01.831143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:01.831179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:01.831205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:01.831209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:01.831644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1853 sessionId:  describe result for acl check
2025-10-01T14:13:01.831697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:01.831699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:01.831701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:01.831706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256145409859093:5773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:01.832262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256145409859093:5773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:01.834430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256145409859093:5773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:01.835919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:01.837657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:01.837777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256145409859093:5773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:01.837793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256145409859093:5773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:01.837797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256145409859093:5773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:01.837806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:01.837860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:01.837870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:01.837880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:01.837925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:01.837964Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256143032960784:2940]
2025-10-01T14:13:01.838657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:01.838920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:01.838961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:01.839285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:01.839339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.839345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.839346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.839347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.839348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.839350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.839351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.839352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.839353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.839355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.839356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.839358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.839359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.839361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.839366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.839376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.839380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.839384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.839388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.839392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.839396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.839399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.839403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.839407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.839415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.839418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.839422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.839426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.839438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.839450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:01.839460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.839470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:01.839478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.839483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:01.839491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.839498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:01.839506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.839515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:01.839520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.839528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:01.839533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.839542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:01.839548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.839556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:01.839561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.839570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:01.839574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.839582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.839587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.839597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.839605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.839610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.839618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.839626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:01.839634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.839639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:01.839683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:01.843389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:01.844116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:01.844128Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:01.844131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:01.844135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:01.844142Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1852 [2:7556256143032960784:2940]
2025-10-01T14:13:01.844158Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:01.844179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:01.844187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.844190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.844193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.844209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:01.844219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:01.844229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:01.844291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.844297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.844299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.844302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:01.844305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:01.844375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:01.844387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.844398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:01.844409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:01.844425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:01.844449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409859003:2446], now have 1 active actors on pipe
2025-10-01T14:13:01.844458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409859185:5773], now have 1 active actors on pipe
2025-10-01T14:13:01.844471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256143032960779:2940]
2025-10-01T14:13:01.844474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256143032960779:2940]
2025-10-01T14:13:01.844477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256143032960779:2940]
2025-10-01T14:13:01.844490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:01.844509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:01.844514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:01.844519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:01.844521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:01.844528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:01.844532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:01.844511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1852
2025-10-01T14:13:01.844562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1852
2025-10-01T14:13:01.844564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256143032960779:2940]
2025-10-01T14:13:01.844574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:01.844577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:01.844606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.844615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.844658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:01.844668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:01.844673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:01.844676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:01.844687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:01.844698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:01.844720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.844850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:01.844858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:01.844871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:01.844939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1853 partition: 0 MaxSeqNo: 45 sessionId: src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0
2025-10-01T14:13:01.845282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a6ad081-3168ea36-259bba46-648db1eb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:01.847692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0] Write session: try to update token
2025-10-01T14:13:01.847709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:01.865737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:01.865759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:01.865762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:01.865764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:01.865774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256143032960779:2940]
2025-10-01T14:13:01.865780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256143032960779:2940]
2025-10-01T14:13:01.865788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256143032960779:2940]
2025-10-01T14:13:01.865839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:01.865844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:01.865851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:01.865851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:01.865853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:01.865855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:01.865999Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:01.868302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1853 sessionId: src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:01.872455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:01.920298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256145409859198:6233]
2025-10-01T14:13:01.920619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1852, pipe: [1:7556256145409859198:6233]
2025-10-01T14:13:02.024037Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:02.024554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.024574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.024617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256145409859198:6233], now have 1 active actors on pipe
2025-10-01T14:13:02.025025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:02.025449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:02.025492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:02.025559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1853 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0
2025-10-01T14:13:02.025683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1853 sessionId: src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0 is DEAD
2025-10-01T14:13:02.025889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256145409859198:6233]
2025-10-01T14:13:02.026451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:02.026463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0] Write session will restart in 0.007867s
2025-10-01T14:13:02.026491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0] Write session: Do CDS request
2025-10-01T14:13:02.026498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:02.036779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:02.037996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:02.038030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1854
2025-10-01T14:13:02.038258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:02.038289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:02.038295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:02.038301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:02.038827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1854 sessionId:  describe result for acl check
2025-10-01T14:13:02.038876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:02.038878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:02.038881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:02.038888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256149704826512:5761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:02.039480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256149704826512:5761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:02.044688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256149704826512:5761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:02.055194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256149704826512:5761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:02.055219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256149704826512:5761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:02.055223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256149704826512:5761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:02.055235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:02.071741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:02.074715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:02.074973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:02.074979Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:02.074992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:02.075055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:02.075099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256147327928270:2937]
2025-10-01T14:13:02.075725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:02.076255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:02.076306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:02.076591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:02.076656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.076657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.076658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.076659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.076660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.076662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.076663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.076664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.076665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.076666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.076667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.076669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.076670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.076671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.076676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.076684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.076688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.076692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.076695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.076698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.076701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.076705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.076708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.076712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.076715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.076718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.076721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.076724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.076731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.076738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.076744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.076748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.076752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.076756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.076760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.076765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.076769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.076774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.076777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.076781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.076786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.076790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.076793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.076797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.076801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.076805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.076809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.076813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.076817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.076821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.076824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.076828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.076832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.076836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.076840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.076844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.076877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:02.081596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:02.082225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:02.082230Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:02.082233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:02.082237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:02.082244Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1853 [2:7556256147327928270:2937]
2025-10-01T14:13:02.082262Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:02.082279Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:02.082282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:02.082285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:02.082288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:02.082306Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:02.082314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:02.082320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:02.082416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.082418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.082420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.082423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:02.082426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:02.082497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:02.082512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.082525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.082533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.082548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:02.082567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256147327928265:2937]
2025-10-01T14:13:02.082569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256147327928265:2937]
2025-10-01T14:13:02.082571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256147327928265:2937]
2025-10-01T14:13:02.082583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:02.082597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:02.082597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:02.082600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:02.082603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:02.082611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:02.082614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:02.082625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704826623:5761], now have 1 active actors on pipe
2025-10-01T14:13:02.082629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704826497:2446], now have 1 active actors on pipe
2025-10-01T14:13:02.082668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256147327928265:2937]
2025-10-01T14:13:02.082678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:02.083051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1853
2025-10-01T14:13:02.083089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1853
2025-10-01T14:13:02.083096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:02.083331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.083341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.083366Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50f9a323-182e75a6-e55c2ddb-e431135_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:02.083373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:02.083377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:02.083379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:02.083386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:02.083396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:02.083413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:02.083854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.083861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.083875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:02.083987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1854 partition: 0 MaxSeqNo: 45 sessionId: src_id|50f9a323-182e75a6-e55c2ddb-e431135_0
2025-10-01T14:13:02.085145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fbbbbe4-992176d3-acf49cd-1b5c1d12_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50f9a323-182e75a6-e55c2ddb-e431135_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:02.087595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f9a323-182e75a6-e55c2ddb-e431135_0] Write session: try to update token
2025-10-01T14:13:02.087624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f9a323-182e75a6-e55c2ddb-e431135_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:02.102914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:02.102933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:02.102942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256147327928265:2937]
2025-10-01T14:13:02.102994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:02.103054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:02.103169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:02.103313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:02.103468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:02.103608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:02.103793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:02.103827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:02.102804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1854 sessionId: src_id|50f9a323-182e75a6-e55c2ddb-e431135_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:02.105434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:02.105646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.105665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.105700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:02.105786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:02.126416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256149704826716:6233]
2025-10-01T14:13:02.126589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1853, pipe: [1:7556256149704826716:6233]
2025-10-01T14:13:02.128741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704826716:6233], now have 1 active actors on pipe
2025-10-01T14:13:02.137015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.137044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.137240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.137313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.137388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.137455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.137714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.137735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.137819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.137889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.137963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.138040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.138086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.138094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.138163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.138229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.138303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.138586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.138638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.138647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.138717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.138788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.138857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.138957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.139008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.139017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.139086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.139152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.139231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.139304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.139357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.139365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.139440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.139509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.139585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.139664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.139723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.139731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.139808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.139881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.139956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.140032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.140077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.140084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.140160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.140238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.140311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.140385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.140440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.140443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.140520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.140585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.140682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.140747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.140792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.140795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.140865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.140931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.140994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.141056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.141099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.141102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.141183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:02.141187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:02.141189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:02.141191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:02.141201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256147327928265:2937]
2025-10-01T14:13:02.141205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256147327928265:2937]
2025-10-01T14:13:02.141209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256147327928265:2937]
2025-10-01T14:13:02.141269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:02.141276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:13:02.141277Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:02.141282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:02.141344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:02.141365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:02.141367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:13:02.141390Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141408Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141412Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141416Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141420Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141423Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141427Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141430Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141434Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141439Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141830Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141836Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141839Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141843Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.141847Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142059Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142064Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142068Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142072Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142076Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142080Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142083Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142087Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142091Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142195Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142200Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142203Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142208Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142212Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142215Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142220Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142228Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142232Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142236Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142239Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:02.142317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:13:02.142327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:13:02.142330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:13:02.142333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:13:02.142337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:13:02.142818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:13:02.142850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:13:02.142863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:13:02.142867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:13:02.142875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:13:02.142878Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:13:02.143452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:13:02.143476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:13:02.143482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:13:02.143486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:13:02.143489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:13:02.143492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:13:02.144058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:13:02.144081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:02.144196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327982143
2025-10-01T14:13:02.145141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:02.145158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.145160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:02.145313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:02.310245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:02.310745Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:13:02.310781Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:13:02.311620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:02.311682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:02.311739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1854 reason: status is not ok: tablet will be restarted right now sessionId: src_id|50f9a323-182e75a6-e55c2ddb-e431135_0
2025-10-01T14:13:02.311873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256149704826716:6233]
2025-10-01T14:13:02.312484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f9a323-182e75a6-e55c2ddb-e431135_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:02.311965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1854 sessionId: src_id|50f9a323-182e75a6-e55c2ddb-e431135_0 is DEAD
2025-10-01T14:13:02.312494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f9a323-182e75a6-e55c2ddb-e431135_0] Write session will restart in 0.009733s
2025-10-01T14:13:02.312536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f9a323-182e75a6-e55c2ddb-e431135_0] Write session: Do CDS request
2025-10-01T14:13:02.312543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f9a323-182e75a6-e55c2ddb-e431135_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:02.311054Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:02.325464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50f9a323-182e75a6-e55c2ddb-e431135_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:02.325473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:02.325492Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1855
2025-10-01T14:13:02.325701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:02.325753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:02.325766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:02.325771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:02.326356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1855 sessionId:  describe result for acl check
2025-10-01T14:13:02.326413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:02.326420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:02.326422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:02.326428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256149704826755:5745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:02.326971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256149704826755:5745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:02.334478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256149704826755:5745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:02.341777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:02.345006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:02.345357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:02.345372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:02.345388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:02.345458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:02.345503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256147327928477:2930]
2025-10-01T14:13:02.346154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:02.346834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:02.346900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:02.347541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:02.347602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256149704826755:5745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:02.347620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256149704826755:5745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:02.347623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256149704826755:5745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:02.347632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:02.347636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.347644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.347645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.347646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.347648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.347669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.347671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.347672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.347673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.347674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.347676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.347677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.347678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.347679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.347686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.347696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.347699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.347703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.347706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.347710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.347713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.347717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.347720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.347725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.347728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.347732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.347736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.347740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.347749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.347757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.347765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.347771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.347776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.347783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.347789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.347794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.347800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.347806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.347811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.347816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.347820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.347827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.347832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.347837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.347842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.347847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.347852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.347857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.347862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.347867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.347871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.347876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.347880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.347885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.347889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.347893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.347934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:02.352974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:02.353644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:02.353662Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:02.353666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:02.353670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:02.353679Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1854 [2:7556256147327928477:2930]
2025-10-01T14:13:02.353699Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:02.353721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:02.353724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:02.353728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:02.353731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:02.353751Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:02.353758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:02.353765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:02.353832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.353835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.353837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.353841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:02.353844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:02.354162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1854
2025-10-01T14:13:02.353928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:02.354197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1854
2025-10-01T14:13:02.353931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.353944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.353956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.353975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:02.353994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256147327928472:2930]
2025-10-01T14:13:02.353998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256147327928472:2930]
2025-10-01T14:13:02.354001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256147327928472:2930]
2025-10-01T14:13:02.354011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:02.354026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:02.354029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:02.354031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:02.354037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:02.354046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:02.354049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:02.354101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704826904:5745], now have 1 active actors on pipe
2025-10-01T14:13:02.354105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704826719:2446], now have 1 active actors on pipe
2025-10-01T14:13:02.354107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256147327928472:2930]
2025-10-01T14:13:02.354117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:02.354124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:02.354447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.354453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.354484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b95e0e07-a988b459-5d29fda5-11454068_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:02.354492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:02.354497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:02.354500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:02.354511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:02.354523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:02.354549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:02.355096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.355109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.355133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:02.355313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1855 partition: 0 MaxSeqNo: 45 sessionId: src_id|b95e0e07-a988b459-5d29fda5-11454068_0
2025-10-01T14:13:02.355826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50f9a323-182e75a6-e55c2ddb-e431135_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b95e0e07-a988b459-5d29fda5-11454068_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:02.358542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95e0e07-a988b459-5d29fda5-11454068_0] Write session: try to update token
2025-10-01T14:13:02.358564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95e0e07-a988b459-5d29fda5-11454068_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:02.384272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:02.384300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:02.384303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:02.384306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:02.384317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256147327928472:2930]
2025-10-01T14:13:02.384323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256147327928472:2930]
2025-10-01T14:13:02.384327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256147327928472:2930]
2025-10-01T14:13:02.384385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:02.384397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.384400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:02.384552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:02.385084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1855 sessionId: src_id|b95e0e07-a988b459-5d29fda5-11454068_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:02.386493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:02.386512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:02.386517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:02.387776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:02.412350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256149704826926:6233]
2025-10-01T14:13:02.413272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1854, pipe: [1:7556256149704826926:6233]
2025-10-01T14:13:02.543406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:02.543900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.543912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.543960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704826926:6233], now have 1 active actors on pipe
2025-10-01T14:13:02.544288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256149704826926:6233]
2025-10-01T14:13:02.544319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:02.544322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:02.544383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1855 reason: error at write: Disconnected sessionId: src_id|b95e0e07-a988b459-5d29fda5-11454068_0
2025-10-01T14:13:02.544614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1855 sessionId: src_id|b95e0e07-a988b459-5d29fda5-11454068_0 is DEAD
2025-10-01T14:13:02.544808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:02.544800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:02.546624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95e0e07-a988b459-5d29fda5-11454068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:02.546637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95e0e07-a988b459-5d29fda5-11454068_0] Write session will restart in 0.005539s
2025-10-01T14:13:02.546668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95e0e07-a988b459-5d29fda5-11454068_0] Write session: Do CDS request
2025-10-01T14:13:02.546674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95e0e07-a988b459-5d29fda5-11454068_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:02.553913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b95e0e07-a988b459-5d29fda5-11454068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:02.553971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:02.553985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1856
2025-10-01T14:13:02.554144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:02.554182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:02.554189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:02.554192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:02.554687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1856 sessionId:  describe result for acl check
2025-10-01T14:13:02.554730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:02.554732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:02.554750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:02.554756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256149704826990:5731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:02.555275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256149704826990:5731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:02.559108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256149704826990:5731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:02.559638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:02.562158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:02.562344Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:02.562356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:02.562366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:02.562425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:02.562464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256147327928694:2916]
2025-10-01T14:13:02.562685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256149704826990:5731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:02.562704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256149704826990:5731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:02.562708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256149704826990:5731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:02.562716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:02.563145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:02.563437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:02.563480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:02.563812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:02.563867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.563872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.563873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.563874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.563875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.563876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.563878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.563879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.563880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.563881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.563882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.563884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.563885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.563886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.563890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.563899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.563903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.563907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.563910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.563914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.563917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.563921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.563924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.563928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.563931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.563935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.563938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.563942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.563948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.563955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.563960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.563965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.563969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.563974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.563979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.563983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.563988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.563992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.563996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.564001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.564006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.564011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.564014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.564019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.564023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.564028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.564034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.564038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.564042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.564052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.564056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.564061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.564065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.564070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.564073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.564078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.564116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:02.568122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:02.568796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:02.568812Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:02.568815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:02.568819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:02.568827Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1855 [2:7556256147327928694:2916]
2025-10-01T14:13:02.568843Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:02.568859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:02.568863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:02.568866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:02.568868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:02.568884Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:02.568890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:02.568897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:02.568959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.568967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.568969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.568972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:02.568975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:02.569048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:02.569056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.569069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.569080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.569096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:02.569118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704827122:5731], now have 1 active actors on pipe
2025-10-01T14:13:02.569127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704826937:2446], now have 1 active actors on pipe
2025-10-01T14:13:02.569134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256147327928689:2916]
2025-10-01T14:13:02.569136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256147327928689:2916]
2025-10-01T14:13:02.569138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256147327928689:2916]
2025-10-01T14:13:02.569187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1855
2025-10-01T14:13:02.569223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1855
2025-10-01T14:13:02.569150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:02.569166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:02.569167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:02.569169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:02.569171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:02.569181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:02.569184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:02.569212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256147327928689:2916]
2025-10-01T14:13:02.569215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:02.569217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:02.569231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.569235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.569287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:02.569294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:02.569298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:02.569301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:02.569309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:02.569317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:02.569341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:02.569490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.569504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.569529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:02.569634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1856 partition: 0 MaxSeqNo: 45 sessionId: src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0
2025-10-01T14:13:02.570044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b95e0e07-a988b459-5d29fda5-11454068_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:02.572772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0] Write session: try to update token
2025-10-01T14:13:02.572790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:02.581175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:02.581199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:02.581210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256147327928689:2916]
2025-10-01T14:13:02.581254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:02.581375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:02.581422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:02.581563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:02.581702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:02.581859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:02.582054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:02.582092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:02.589475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1856 sessionId: src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:02.592275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:02.592460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.592483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.592519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:02.592654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:02.601454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:02.601474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:02.601477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:02.601479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:02.601491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256147327928689:2916]
2025-10-01T14:13:02.601496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256147327928689:2916]
2025-10-01T14:13:02.601500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256147327928689:2916]
2025-10-01T14:13:02.601549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:02.601554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:02.601560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.601563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:02.601564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:02.601569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:02.601702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:02.645640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256149704827133:6233]
2025-10-01T14:13:02.646560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1855, pipe: [1:7556256149704827133:6233]
2025-10-01T14:13:02.768407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:02.777919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.777949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.778127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.778193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.778255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.778310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.778351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.778356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.782277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:02.782290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0] Write session will restart in 0.008309s
2025-10-01T14:13:02.782319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0] Write session: Do CDS request
2025-10-01T14:13:02.782327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:02.781802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256149704827133:6233]
2025-10-01T14:13:02.781849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:02.781852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:02.781885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1856 reason: error at write: Disconnected sessionId: src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0
2025-10-01T14:13:02.781894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:02.782115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1856 sessionId: src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0 is DEAD
2025-10-01T14:13:02.778494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.778556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.778612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.778676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.778719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.778722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.778797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.778858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.778920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.778985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.779026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.779029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.779100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.779168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.779236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.779298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.779338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.779341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.779406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.779465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.779525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.779582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.779624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.779627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.779695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.779758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.779820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.779889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.779932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.779937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.780006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.780063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.780127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.780189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.780238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.780240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.780307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.780367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.780426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.780488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.780527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.780529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.780600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.780677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.780741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.780802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.780848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.780851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.780920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:02.780973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:02.781030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:02.781088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:02.781150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:02.781152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:02.781227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704827133:6233], now have 1 active actors on pipe
2025-10-01T14:13:02.782651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:02.792788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:02.793513Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:02.793529Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1857
2025-10-01T14:13:02.793654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:02.793687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:02.793696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:02.793700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:02.794172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1857 sessionId:  describe result for acl check
2025-10-01T14:13:02.794227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:02.794234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:02.794235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:02.794245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256149704827181:5732] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:02.794795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256149704827181:5732] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:02.797819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256149704827181:5732] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:02.800368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:02.800988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256149704827181:5732] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:02.800999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256149704827181:5732] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:02.801002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256149704827181:5732] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:02.801010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:02.803003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:02.803250Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:02.803255Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:02.803267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:02.803321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:02.803361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256147327928886:2907]
2025-10-01T14:13:02.803944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:02.804496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:02.804568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:02.804883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:02.804950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.804956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.804957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.804958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.804959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.804961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.804963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.804964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.804965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.804967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.804968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.804969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.804970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.804971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.804977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.804987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.804991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.804994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.804999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.805003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.805006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.805009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.805013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.805017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.805021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.805025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.805029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.805032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.805042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.805051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:02.805057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.805062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:02.805069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.805075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:02.805080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.805087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:02.805091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.805097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:02.805106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.805110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:02.805115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.805121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:02.805125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.805134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:02.805138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.805143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:02.805146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.805153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.805160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.805164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.805168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.805172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.805179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.805184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:02.805192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.805197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:02.805241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:02.809543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:02.810567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:02.810587Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:02.810589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:02.810593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:02.810601Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1856 [2:7556256147327928886:2907]
2025-10-01T14:13:02.810620Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:02.810640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:02.810643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:02.810648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:02.810651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:02.810670Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:02.810676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:02.810682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:02.810746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.810748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.810751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.810755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:02.810757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:02.810829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:02.810832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.810846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:02.810857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:02.810875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:02.810893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256147327928880:2907]
2025-10-01T14:13:02.810896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256147327928880:2907]
2025-10-01T14:13:02.810899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256147327928880:2907]
2025-10-01T14:13:02.810917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:02.810931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:02.810947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:02.810950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:02.810991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256147327928880:2907]
2025-10-01T14:13:02.810993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:02.811314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:02.811322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:02.811324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:02.811330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:02.811675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704827321:5732], now have 1 active actors on pipe
2025-10-01T14:13:02.811684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704827136:2446], now have 1 active actors on pipe
2025-10-01T14:13:02.811847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.811856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.811887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:02.811895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:02.811900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:02.811902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:02.811913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:02.811925Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:02.811944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:02.811622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1856
2025-10-01T14:13:02.811661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1856
2025-10-01T14:13:02.812415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.812426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.812448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:02.812559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1857 partition: 0 MaxSeqNo: 45 sessionId: src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0
2025-10-01T14:13:02.813065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2868b803-7ed7194d-b4f48c0f-eaad2873_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:02.815957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0] Write session: try to update token
2025-10-01T14:13:02.815978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:02.825750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:02.825784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:02.825805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256147327928880:2907]
2025-10-01T14:13:02.825857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:02.825870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:02.826190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:02.826405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:02.826640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:02.826878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:02.827224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:02.827296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:02.832971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1857 sessionId: src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:02.835573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:02.835794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:02.835816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:02.835850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:02.836263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:02.845820Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:02.845846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:02.845850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:02.845852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:02.845863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256147327928880:2907]
2025-10-01T14:13:02.845867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256147327928880:2907]
2025-10-01T14:13:02.845871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256147327928880:2907]
2025-10-01T14:13:02.845921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:02.845926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:02.845937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:02.845938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:02.845940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:02.845941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:02.846077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:02.880813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256149704827336:6233]
2025-10-01T14:13:02.881142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1856, pipe: [1:7556256149704827336:6233]
2025-10-01T14:13:03.003344Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:03.011801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.011827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.011987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.012044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.012105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.012173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.012216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.012223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.012286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.012340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.012399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.012456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.012500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.012506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.012563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.012619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.012690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.012747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.012783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.012792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.012849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.012906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.012961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.013017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.013057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.013062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.013118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.013168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.013220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.013273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.013322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.013328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.013385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.013440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.013504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.013562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.013600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.013602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.013659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.013709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.013762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.013815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.013858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.013860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.013917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.013969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.014024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.014080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.014121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.014124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.014187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.014240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.014297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.014351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.014462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.014466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.014542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.014607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.014675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.014738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.014784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.014791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.014854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256149704827336:6233], now have 1 active actors on pipe
2025-10-01T14:13:03.016039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:03.016550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:03.016563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0] Write session will restart in 0.009757s
2025-10-01T14:13:03.016591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0] Write session: Do CDS request
2025-10-01T14:13:03.016598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:03.015971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256149704827336:6233]
2025-10-01T14:13:03.016026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:03.016029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:03.016062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1857 reason: error at write: Disconnected sessionId: src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0
2025-10-01T14:13:03.016279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1857 sessionId: src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0 is DEAD
2025-10-01T14:13:03.016439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:03.027922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:03.027963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:03.027980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1858
2025-10-01T14:13:03.028136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:03.028171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:03.028181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:03.028185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:03.028731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1858 sessionId:  describe result for acl check
2025-10-01T14:13:03.028768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:03.028770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:03.028772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:03.028777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256153999794704:5721] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:03.029320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256153999794704:5721] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:03.033572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256153999794704:5721] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:03.034765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:03.037018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:03.037215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:03.037225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:03.037236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:03.037275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:03.037310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256151622896373:2893]
2025-10-01T14:13:03.037327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256153999794704:5721] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:03.037342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256153999794704:5721] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:03.037354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256153999794704:5721] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:03.037363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:03.037940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:03.038202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:03.038238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:03.038578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:03.038628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.038633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.038634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.038635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.038636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.038637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.038638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.038640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.038641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.038642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.038643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.038644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.038645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.038646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.038651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.038660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.038663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.038667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.038670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.038673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.038676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.038680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.038683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.038687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.038690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.038693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.038696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.038700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.038706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.038713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.038719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.038728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.038732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.038737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.038741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.038746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.038750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.038758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.038762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.038766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.038771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.038775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.038779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.038783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.038788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.038797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.038801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.038806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.038809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.038814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.038821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.038826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.038830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.038835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.038839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.038843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.038876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:03.042666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:03.043617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:03.043636Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:03.043639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:03.043643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:03.043649Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1857 [2:7556256151622896373:2893]
2025-10-01T14:13:03.043667Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:03.043685Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:03.043688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:03.043691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:03.043694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:03.043710Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:03.043716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:03.043722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:03.043781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.043791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.043793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.043796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:03.043800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:03.043875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:03.043883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.043896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.043907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.043927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:03.043952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999794821:5721], now have 1 active actors on pipe
2025-10-01T14:13:03.043960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999794637:2446], now have 1 active actors on pipe
2025-10-01T14:13:03.043968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256151622896368:2893]
2025-10-01T14:13:03.043974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256151622896368:2893]
2025-10-01T14:13:03.043976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256151622896368:2893]
2025-10-01T14:13:03.043995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:03.044016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:03.044017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:03.044021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:03.044024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:03.044035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:03.044038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:03.044074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256151622896368:2893]
2025-10-01T14:13:03.044086Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:03.044092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:03.044534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1857
2025-10-01T14:13:03.044681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1857
2025-10-01T14:13:03.044708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.044722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.044749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|429f855e-302f48b2-ed0305de-491e5794_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:03.044762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:03.044771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:03.044774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:03.044784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:03.044799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:03.044830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:03.045006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.045013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.045025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:03.045102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1858 partition: 0 MaxSeqNo: 45 sessionId: src_id|429f855e-302f48b2-ed0305de-491e5794_0
2025-10-01T14:13:03.045506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0acc19e-396f437a-f115f1e9-6c91fc69_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|429f855e-302f48b2-ed0305de-491e5794_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:03.048054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|429f855e-302f48b2-ed0305de-491e5794_0] Write session: try to update token
2025-10-01T14:13:03.048076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|429f855e-302f48b2-ed0305de-491e5794_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:03.063113Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:03.063138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:03.063151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256151622896368:2893]
2025-10-01T14:13:03.063209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:03.063228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:03.063407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:03.063561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:03.063702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:03.063851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:03.064069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:03.064117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:03.064416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1858 sessionId: src_id|429f855e-302f48b2-ed0305de-491e5794_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:03.067254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:03.067469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.067491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.067539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:03.067627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:03.077360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:03.077381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:03.077384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:03.077386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:03.077398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256151622896368:2893]
2025-10-01T14:13:03.077403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256151622896368:2893]
2025-10-01T14:13:03.077407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256151622896368:2893]
2025-10-01T14:13:03.077463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:03.077470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.077473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:03.077610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:03.077845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:03.077855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:03.077862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:03.117343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256153999794845:6233]
2025-10-01T14:13:03.118309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1857, pipe: [1:7556256153999794845:6233]
2025-10-01T14:13:03.246892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:03.255997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.256030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.256217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.256287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.256350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.256412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.256459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.256465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.256539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.256597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.256676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.256741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.256786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.256789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.256855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.256908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.256970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.257030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.257070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.257073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.257142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.257204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.257265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.257326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.257367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.257370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.257435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.257487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.257546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.257608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.257649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.257652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.257722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.257779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.257841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.257900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.257942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.257946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.258015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.258077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.258138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.258196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.258236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.258241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.258310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.258367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.258641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.258712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.258753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.258756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.258823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.258881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.258939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.258998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.259134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.259138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.259201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:03.259256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:03.259313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:03.259368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:03.259409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:03.259411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:03.259484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999794845:6233], now have 1 active actors on pipe
2025-10-01T14:13:03.263086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:03.262606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:03.263144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1858 reason: status is not ok: tablet will be restarted right now sessionId: src_id|429f855e-302f48b2-ed0305de-491e5794_0
2025-10-01T14:13:03.263392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1858 sessionId: src_id|429f855e-302f48b2-ed0305de-491e5794_0 is DEAD
2025-10-01T14:13:03.263485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:03.263524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256153999794845:6233]
2025-10-01T14:13:03.264276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429f855e-302f48b2-ed0305de-491e5794_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:03.264285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429f855e-302f48b2-ed0305de-491e5794_0] Write session will restart in 0.009063s
2025-10-01T14:13:03.264309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429f855e-302f48b2-ed0305de-491e5794_0] Write session: Do CDS request
2025-10-01T14:13:03.264315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429f855e-302f48b2-ed0305de-491e5794_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:03.275518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|429f855e-302f48b2-ed0305de-491e5794_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:03.276187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:03.276203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1859
2025-10-01T14:13:03.276441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:03.276475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:03.276480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:03.276484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:03.279268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1859 sessionId:  describe result for acl check
2025-10-01T14:13:03.279310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:03.279313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:03.279315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:03.279322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256153999794874:5703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:03.279887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256153999794874:5703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:03.287512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256153999794874:5703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:03.299502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256153999794874:5703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:03.299521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256153999794874:5703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:03.299524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256153999794874:5703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:03.299534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:03.306656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:03.310137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:03.310595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:03.310611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:03.310628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:03.310701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:03.310751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256151622896586:2903]
2025-10-01T14:13:03.311408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:03.311840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:03.311895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:03.312217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:03.312289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.312290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.312292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.312293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.312294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.312295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.312297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.312299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.312300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.312301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.312303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.312304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.312305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.312307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.312313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.312324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.312327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.312331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.312335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.312339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.312343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.312347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.312351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.312356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.312359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.312363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.312366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.312370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.312378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.312387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.312392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.312397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.312401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.312406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.312410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.312415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.312420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.312424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.312428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.312432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.312437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.312443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.312448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.312453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.312458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.312463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.312468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.312473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.312477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.312482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.312486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.312492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.312511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.312517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.312520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.312527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.312583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:03.317688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:03.318488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:03.318494Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:03.318497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:03.318502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:03.318509Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1858 [2:7556256151622896586:2903]
2025-10-01T14:13:03.318527Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:03.318545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:03.318549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:03.318552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:03.318555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:03.318572Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:03.318578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:03.318584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:03.318646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.318647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.318649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.318652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:03.318655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:03.318728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:03.318731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.318743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.318753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.318768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:03.318785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256151622896580:2903]
2025-10-01T14:13:03.318787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256151622896580:2903]
2025-10-01T14:13:03.318788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256151622896580:2903]
2025-10-01T14:13:03.318797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:03.318813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:03.318826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:03.318829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:03.318867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256151622896580:2903]
2025-10-01T14:13:03.318868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:03.319106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:03.319116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:03.319118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:03.319123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:03.319498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1858
2025-10-01T14:13:03.319541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1858
2025-10-01T14:13:03.319660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999794860:2446], now have 1 active actors on pipe
2025-10-01T14:13:03.319683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999795044:5703], now have 1 active actors on pipe
2025-10-01T14:13:03.319705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.319711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.319740Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:03.319757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:03.319762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:03.319764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:03.319776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:03.319788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:03.319804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:03.320195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1859 partition: 0 MaxSeqNo: 45 sessionId: src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0
2025-10-01T14:13:03.320054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.320064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.320082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:03.324081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|429f855e-302f48b2-ed0305de-491e5794_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:03.326978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0] Write session: try to update token
2025-10-01T14:13:03.326999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:03.351746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:03.356924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:03.356953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:03.356958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:03.356976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256151622896580:2903]
2025-10-01T14:13:03.356986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256151622896580:2903]
2025-10-01T14:13:03.356996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256151622896580:2903]
2025-10-01T14:13:03.357095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:03.357109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.357113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:03.357415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:03.360140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:03.360152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:03.360156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:03.358408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1859 sessionId: src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:03.360971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:03.366640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256153999795060:6233]
2025-10-01T14:13:03.368804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1858, pipe: [1:7556256153999795060:6233]
2025-10-01T14:13:03.557862Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:03.558487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.558505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.558530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999795060:6233], now have 1 active actors on pipe
2025-10-01T14:13:03.559104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256153999795060:6233]
2025-10-01T14:13:03.559132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:03.559170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:03.559172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:03.559231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1859 reason: error at write: Disconnected sessionId: src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0
2025-10-01T14:13:03.559451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1859 sessionId: src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0 is DEAD
2025-10-01T14:13:03.559156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:03.562631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:03.562644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0] Write session will restart in 0.006513s
2025-10-01T14:13:03.562675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0] Write session: Do CDS request
2025-10-01T14:13:03.562682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:03.570824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:03.571021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:03.571038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1860
2025-10-01T14:13:03.571193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:03.571238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:03.571244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:03.571248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:03.571680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1860 sessionId:  describe result for acl check
2025-10-01T14:13:03.571706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:03.571709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:03.571711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:03.571717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256153999795133:5700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:03.572270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256153999795133:5700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:03.574593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256153999795133:5700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:03.577432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256153999795133:5700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:03.577447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256153999795133:5700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:03.577450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256153999795133:5700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:03.577459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:03.578019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:03.580412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:03.580634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:03.580645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:03.580657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:03.580737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:03.580797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256151622896809:2863]
2025-10-01T14:13:03.581477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:03.581826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:03.581874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:03.582206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:03.582275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.582283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.582284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.582285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.582286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.582287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.582289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.582290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.582291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.582292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.582293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.582294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.582296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.582297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.582303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.582312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.582316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.582320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.582324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.582328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.582332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.582335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.582339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.582345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.582349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.582353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.582358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.582362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.582381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.582393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.582400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.582405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.582409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.582414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.582419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.582424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.582429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.582434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.582440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.582446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.582454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.582459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.582465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.582470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.582475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.582484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.582489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.582498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.582502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.582507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.582514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.582519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.582523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.582530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.582536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.582545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.582584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:03.591265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:03.592145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:03.592159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:03.592161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:03.592164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:03.592170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1859 [2:7556256151622896809:2863]
2025-10-01T14:13:03.592183Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:03.592197Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:03.592199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:03.592202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:03.592204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:03.592218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:03.592226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:03.592231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:03.592278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.592283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.592285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.592288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:03.592290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:03.592349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:03.592355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.592362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.592368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.592379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:03.592395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256151622896804:2863]
2025-10-01T14:13:03.592401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256151622896804:2863]
2025-10-01T14:13:03.592403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256151622896804:2863]
2025-10-01T14:13:03.592409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:03.592418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:03.592421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:03.592421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:03.592423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:03.592429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:03.592431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:03.592439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999795107:2446], now have 1 active actors on pipe
2025-10-01T14:13:03.592443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999795290:5700], now have 1 active actors on pipe
2025-10-01T14:13:03.592480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256151622896804:2863]
2025-10-01T14:13:03.592493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:03.592512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:03.592895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1859
2025-10-01T14:13:03.592931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1859
2025-10-01T14:13:03.593005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.593031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.593067Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:03.593090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:03.593098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:03.593105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:03.593115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:03.593132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:03.593151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:03.593302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.593310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.593323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:03.593392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1860 partition: 0 MaxSeqNo: 45 sessionId: src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0
2025-10-01T14:13:03.593770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f36dca2b-50ead304-140781fe-1e54ff5f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:03.596532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0] Write session: try to update token
2025-10-01T14:13:03.596553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:03.611978Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:03.611998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:03.612009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256151622896804:2863]
2025-10-01T14:13:03.612063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:03.612069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:03.612255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:03.612408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:03.612569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:03.612741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:03.612947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:03.612991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:03.623225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1860 sessionId: src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:03.625626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:03.625649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:03.625651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:03.625654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:03.625666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256151622896804:2863]
2025-10-01T14:13:03.625670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256151622896804:2863]
2025-10-01T14:13:03.625674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256151622896804:2863]
2025-10-01T14:13:03.625724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:03.625725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:03.625731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:03.625735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.625735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:03.625737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:03.625880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:03.625924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:03.660883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256153999795305:6233]
2025-10-01T14:13:03.661290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1859, pipe: [1:7556256153999795305:6233]
2025-10-01T14:13:03.845992Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:03.846990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.847013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.847038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999795305:6233], now have 1 active actors on pipe
2025-10-01T14:13:03.848661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:03.847708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256153999795305:6233]
2025-10-01T14:13:03.847739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:03.847741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:03.847795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1860 reason: error at write: Disconnected sessionId: src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0
2025-10-01T14:13:03.848012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1860 sessionId: src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0 is DEAD
2025-10-01T14:13:03.848134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:03.850680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:03.850692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0] Write session will restart in 0.007167s
2025-10-01T14:13:03.850724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0] Write session: Do CDS request
2025-10-01T14:13:03.850731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:03.866886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:03.867258Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:03.867274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1861
2025-10-01T14:13:03.867474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:03.867506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:03.867511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:03.867515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:03.867943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1861 sessionId:  describe result for acl check
2025-10-01T14:13:03.867978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:03.867980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:03.867982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:03.867986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256153999795327:5682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:03.868521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256153999795327:5682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:03.877576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256153999795327:5682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:03.889015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256153999795327:5682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:03.889033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256153999795327:5682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:03.889037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256153999795327:5682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:03.889046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:03.906343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:03.906549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:03.906748Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:03.906753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:03.906767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:03.906814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:03.906852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256151622897006:2842]
2025-10-01T14:13:03.907485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:03.908076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:03.908125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:03.908440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:03.908498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.908499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.908500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.908501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.908502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.908503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.908505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.908507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.908508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.908509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.908510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.908512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.908513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.908514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.908524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.908534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.908539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.908543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.908547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.908551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.908554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.908558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.908561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.908567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.908571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.908575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.908579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.908583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.908591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.908599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:03.908605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.908611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:03.908615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.908636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:03.908641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.908646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:03.908652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.908658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:03.908677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.908683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:03.908688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.908694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:03.908700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.908705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:03.908711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.908717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:03.908722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.908727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.908733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.908738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.908743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.908748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.908752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.908757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:03.908762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.908767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:03.908808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:03.914123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:03.915067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:03.915072Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:03.915075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:03.915081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:03.915088Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1860 [2:7556256151622897006:2842]
2025-10-01T14:13:03.915105Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:03.915123Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:03.915126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:03.915130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:03.915132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:03.915151Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:03.915156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:03.915162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:03.915228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.915230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.915232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.915235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:03.915238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:03.915309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:03.915312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.915323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:03.915334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:03.915350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:03.915367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256151622897001:2842]
2025-10-01T14:13:03.915370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256151622897001:2842]
2025-10-01T14:13:03.915372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256151622897001:2842]
2025-10-01T14:13:03.915385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:03.915400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:03.915416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:03.915419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:03.915466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256151622897001:2842]
2025-10-01T14:13:03.915469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:03.915693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:03.915702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:03.915703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:03.915708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:03.918551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1860
2025-10-01T14:13:03.918589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1860
2025-10-01T14:13:03.918671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999795423:5682], now have 1 active actors on pipe
2025-10-01T14:13:03.918686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999795308:2446], now have 1 active actors on pipe
2025-10-01T14:13:03.920247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.920263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.920305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:03.920317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:03.920323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:03.920326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:03.920338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:03.920354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:03.920375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:03.923385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:03.923400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:03.923438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:03.926459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1861 partition: 0 MaxSeqNo: 45 sessionId: src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0
2025-10-01T14:13:03.927436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4f71fb6-7b61b6cd-5dc7b4fb-a3c30f52_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:03.934107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0] Write session: try to update token
2025-10-01T14:13:03.934133Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:03.947511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:03.947531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:03.947533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:03.947536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:03.947549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256151622897001:2842]
2025-10-01T14:13:03.947554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256151622897001:2842]
2025-10-01T14:13:03.947559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256151622897001:2842]
2025-10-01T14:13:03.947613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:03.947622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:03.947625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:03.947894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:03.947904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:03.947909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:03.947034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256153999795512:6233]
2025-10-01T14:13:03.948781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:03.951179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1860, pipe: [1:7556256153999795512:6233]
2025-10-01T14:13:03.974172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1861 sessionId: src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:03.976960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:04.127342Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:04.127746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256153999795512:6233], now have 1 active actors on pipe
2025-10-01T14:13:04.127778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.127786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.128659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256153999795512:6233]
2025-10-01T14:13:04.128696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:04.128699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:04.128760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1861 reason: error at write: Disconnected sessionId: src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0
2025-10-01T14:13:04.128793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:04.128954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1861 sessionId: src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0 is DEAD
2025-10-01T14:13:04.129427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:04.129436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0] Write session will restart in 0.008526s
2025-10-01T14:13:04.129463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0] Write session: Do CDS request
2025-10-01T14:13:04.129474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:04.129137Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:04.139185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:04.139543Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:04.139560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1862
2025-10-01T14:13:04.140129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:04.140168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:04.140175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:04.140179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:04.140616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1862 sessionId:  describe result for acl check
2025-10-01T14:13:04.140661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:04.140663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:04.140664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:04.140671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256158294762824:5684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:04.141257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256158294762824:5684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:04.147872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256158294762824:5684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:04.192064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:04.197618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:04.197871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:04.197881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:04.197893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:04.197946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:04.197981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256155917864512:2854]
2025-10-01T14:13:04.194870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256158294762824:5684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:04.194895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256158294762824:5684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:04.194898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256158294762824:5684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:04.194907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:04.198594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:04.206681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:04.206797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:04.207207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:04.207280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.207281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.207282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.207283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.207285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.207286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.207287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.207289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.207291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.207292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.207293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.207294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.207295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.207297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.207304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.207316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.207321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.207325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.207328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.207332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.207337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.207340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.207344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.207348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.207352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.207355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.207359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.207362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.207372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.207381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.207388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.207393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.207399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.207404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.207409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.207415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.207420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.207425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.207431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.207436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.207441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.207447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.207452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.207458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.207463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.207468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.207473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.207478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.207483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.207488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.207498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.207503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.207508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.207513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.207517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.207522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.207562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:04.219474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:04.220242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:04.220247Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:04.220250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:04.220253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:04.220262Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1861 [2:7556256155917864512:2854]
2025-10-01T14:13:04.220280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:04.220299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:04.220303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:04.220307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:04.220309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:04.220327Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:04.220333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:04.220339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:04.220403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.220405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.220407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.220410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:04.220413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:04.220491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:04.220494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.220507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.220517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.220533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:04.220549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256155917864505:2854]
2025-10-01T14:13:04.220552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256155917864505:2854]
2025-10-01T14:13:04.220554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256155917864505:2854]
2025-10-01T14:13:04.220568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:04.220582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:04.220597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:04.220600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:04.220657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256155917864505:2854]
2025-10-01T14:13:04.220658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:04.221045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:04.221052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:04.221054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:04.221059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:04.221885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256158294762811:2446], now have 1 active actors on pipe
2025-10-01T14:13:04.221896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256158294763015:5684], now have 1 active actors on pipe
2025-10-01T14:13:04.222454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1861
2025-10-01T14:13:04.222501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1861
2025-10-01T14:13:04.224748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.224762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.224797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:04.224807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:04.224812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:04.224815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:04.224828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:04.224844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:04.224866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:04.226946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256158294763025:6233]
2025-10-01T14:13:04.229635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.229651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.229689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:04.230343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a60a607d-d2ab3beb-a14eb407-d052c04c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:04.233078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0] Write session: try to update token
2025-10-01T14:13:04.233103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:04.229904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1862 partition: 0 MaxSeqNo: 45 sessionId: src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0
2025-10-01T14:13:04.234724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256158294763025:6233], now have 1 active actors on pipe
2025-10-01T14:13:04.234886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1861, pipe: [1:7556256158294763025:6233]
2025-10-01T14:13:04.264036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1862 sessionId: src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:04.266663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:04.267273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.267292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.267329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:04.267467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:04.285536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:04.285558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:04.285561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:04.285563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:04.285572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256155917864505:2854]
2025-10-01T14:13:04.285578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256155917864505:2854]
2025-10-01T14:13:04.285581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256155917864505:2854]
2025-10-01T14:13:04.285632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:04.285638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.285641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:04.285778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:04.287269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:04.287274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:04.287276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:04.468085Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:04.476841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.476875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.477056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.477120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.477190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.477261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.477399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.477409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.477488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.477551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.477613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.477677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.477724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.477728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.477839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.477892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.477952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.478012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.478054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.478057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.478130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.478190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.478249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.478309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.478348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.478350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.478590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.478662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.478719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.478780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.478820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.478823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.478896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.478960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.479023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.479087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.479131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.479134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.479206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.479267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.479332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.479395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.479439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.479442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.479513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.479595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.479659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.479724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.479767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.479770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.479841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.479898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.479961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.480029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.480070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.480073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.480136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:04.480200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:04.480258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:04.480320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:04.480360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:04.480363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:04.482253Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:04.482304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256158294763025:6233]
2025-10-01T14:13:04.482323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:04.482325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:04.482351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1862 reason: error at write: Disconnected sessionId: src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0
2025-10-01T14:13:04.482880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:04.482890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0] Write session will restart in 0.007924s
2025-10-01T14:13:04.482918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0] Write session: Do CDS request
2025-10-01T14:13:04.482925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:04.482578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1862 sessionId: src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0 is DEAD
2025-10-01T14:13:04.487526Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:04.492039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:04.492295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:04.492309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1863
2025-10-01T14:13:04.492530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:04.492562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:04.492568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:04.492572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:04.493676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1863 sessionId:  describe result for acl check
2025-10-01T14:13:04.493710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:04.493713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:04.493714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:04.493722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256158294763082:5665] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:04.494249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256158294763082:5665] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:04.505807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256158294763082:5665] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:04.511496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256158294763082:5665] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:04.511513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256158294763082:5665] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:04.511519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256158294763082:5665] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:04.511529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:04.525645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:04.530600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:04.530862Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:04.530866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:04.530879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:04.530939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:04.530983Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256155917864720:2845]
2025-10-01T14:13:04.531618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:04.532207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:04.532251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:04.532667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:04.532736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.532737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.532738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.532740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.532741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.532742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.532743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.532744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.532746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.532747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.532748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.532749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.532750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.532751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.532757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.532767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.532771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.532775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.532779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.532783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.532786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.532790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.532794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.532797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.532801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.532805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.532809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.532813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.532824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.532832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.532838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.532843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.532848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.532853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.532874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.532879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.532884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.532889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.532893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.532898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.532903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.532908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.532912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.532918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.532922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.532927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.532931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.532936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.532941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.532948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.532952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.532957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.532962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.532966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.532970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.532975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.533015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:04.540949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1862
2025-10-01T14:13:04.540995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1862
2025-10-01T14:13:04.538405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:04.539098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:04.539104Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:04.539107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:04.539110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:04.539118Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1862 [2:7556256155917864720:2845]
2025-10-01T14:13:04.539134Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:04.539152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:04.539155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:04.539161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:04.539164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:04.539186Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:04.539192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:04.539198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:04.539261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.539263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.539265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.539268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:04.539271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:04.539352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:04.539355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.539368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.539381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.539399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:04.539417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256155917864712:2845]
2025-10-01T14:13:04.539419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256155917864712:2845]
2025-10-01T14:13:04.539421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256155917864712:2845]
2025-10-01T14:13:04.539435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:04.539451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:04.539467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:04.539471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:04.539507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256155917864712:2845]
2025-10-01T14:13:04.539510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:04.540316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:04.540320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:04.540322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:04.540328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:04.542551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256158294763059:2446], now have 1 active actors on pipe
2025-10-01T14:13:04.542568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256158294763227:5665], now have 1 active actors on pipe
2025-10-01T14:13:04.542593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.542599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.542633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:04.542644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:04.542649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:04.542651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:04.542664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:04.542681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:04.542702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:04.543519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.543529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.543553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:04.545766Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1863 partition: 0 MaxSeqNo: 45 sessionId: src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0
2025-10-01T14:13:04.550510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c4164c2-e5c82106-c4933e5-7d94801d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:04.553296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0] Write session: try to update token
2025-10-01T14:13:04.553324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:04.581819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256158294763263:6233]
2025-10-01T14:13:04.582236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1862, pipe: [1:7556256158294763263:6233]
2025-10-01T14:13:04.582216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256158294763263:6233], now have 1 active actors on pipe
2025-10-01T14:13:04.594121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:04.594144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:04.594147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:04.594150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:04.594160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256155917864712:2845]
2025-10-01T14:13:04.594165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256155917864712:2845]
2025-10-01T14:13:04.594169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256155917864712:2845]
2025-10-01T14:13:04.594215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:04.594224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.594227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:04.594394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:04.596439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:04.596447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:04.596452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:04.594326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1863 sessionId: src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:04.597025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:04.768326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:04.768753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.768764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.769299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:04.769845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256158294763263:6233]
2025-10-01T14:13:04.769877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:04.769880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:04.769933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1863 reason: error at write: Disconnected sessionId: src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0
2025-10-01T14:13:04.770330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:04.770341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0] Write session will restart in 0.005552s
2025-10-01T14:13:04.770382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0] Write session: Do CDS request
2025-10-01T14:13:04.770390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:04.770114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:04.770154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1863 sessionId: src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0 is DEAD
2025-10-01T14:13:04.777128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:04.777408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:04.777420Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1864
2025-10-01T14:13:04.777592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:04.777620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:04.777625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:04.777628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:04.778113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1864 sessionId:  describe result for acl check
2025-10-01T14:13:04.778137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:04.778139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:04.778141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:04.778146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256158294763276:5661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:04.778697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256158294763276:5661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:04.782089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256158294763276:5661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:04.785422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256158294763276:5661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:04.785434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256158294763276:5661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:04.785440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256158294763276:5661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:04.785448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:04.804422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:04.811504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:04.811743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:04.811747Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:04.811759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:04.811802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:04.811835Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256155917864943:2817]
2025-10-01T14:13:04.812469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:04.813012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:04.813050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:04.813353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:04.813395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.813396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.813397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.813398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.813400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.813401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.813402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.813403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.813404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.813406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.813407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.813408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.813409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.813410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.813415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.813424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.813427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.813431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.813434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.813438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.813441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.813445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.813448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.813452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.813455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.813459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.813462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.813465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.813471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.813479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:04.813485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.813490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:04.813495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.813500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:04.813504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.813509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:04.813513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.813519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:04.813523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.813528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:04.813532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.813537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:04.813541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.813546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:04.813550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.813554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:04.813558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.813563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.813568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.813572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.813576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.813581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.813585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.813590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:04.813593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.813598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:04.813636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:04.818326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:04.819355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:04.819361Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:04.819364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:04.819367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:04.819375Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1863 [2:7556256155917864943:2817]
2025-10-01T14:13:04.819390Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:04.819409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:04.819413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:04.819416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:04.819419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:04.819436Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:04.819441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:04.819448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:04.819510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.819512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.819514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.819517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:04.819520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:04.819587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:04.819589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.819601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:04.819611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:04.819626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:04.819642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256155917864937:2817]
2025-10-01T14:13:04.819644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256155917864937:2817]
2025-10-01T14:13:04.819646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256155917864937:2817]
2025-10-01T14:13:04.819658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:04.819672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:04.819685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:04.819688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:04.819725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256155917864937:2817]
2025-10-01T14:13:04.819727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:04.821045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1863
2025-10-01T14:13:04.821079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1863
2025-10-01T14:13:04.820369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:04.820376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:04.820378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:04.820383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:04.821312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256158294763268:2446], now have 1 active actors on pipe
2025-10-01T14:13:04.821319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256158294763316:5661], now have 1 active actors on pipe
2025-10-01T14:13:04.821337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.821345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.821384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:04.821394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:04.821399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:04.821401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:04.821413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:04.821426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:04.821444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:04.823400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:04.823412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:04.823438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:04.823627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1864 partition: 0 MaxSeqNo: 45 sessionId: src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0
2025-10-01T14:13:04.824891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c34c7c6-75299c2e-ec8d5551-eab1f175_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:04.827450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0] Write session: try to update token
2025-10-01T14:13:04.827474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:04.848834Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:04.848854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:04.848857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:04.848860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:04.848871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256155917864937:2817]
2025-10-01T14:13:04.848876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256155917864937:2817]
2025-10-01T14:13:04.848881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256155917864937:2817]
2025-10-01T14:13:04.848932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:04.848938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:04.848940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:04.849077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:04.851262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:04.851269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:04.851273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:04.858453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1864 sessionId: src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:04.860923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:04.869969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256158294763474:6233]
2025-10-01T14:13:04.870740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1863, pipe: [1:7556256158294763474:6233]
2025-10-01T14:13:05.018165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:05.018668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.018686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.018732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256158294763474:6233], now have 1 active actors on pipe
2025-10-01T14:13:05.023290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:05.023370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:05.023385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:05.023452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1864 reason: error at write: Disconnected sessionId: src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0
2025-10-01T14:13:05.023854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:05.023866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0] Write session will restart in 0.007961s
2025-10-01T14:13:05.023893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0] Write session: Do CDS request
2025-10-01T14:13:05.023899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:05.023691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1864 sessionId: src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0 is DEAD
2025-10-01T14:13:05.023844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:05.023880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256158294763474:6233]
2025-10-01T14:13:05.032997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:05.034577Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:05.034593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1865
2025-10-01T14:13:05.038511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:05.038561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:05.038565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:05.038570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:05.039057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1865 sessionId:  describe result for acl check
2025-10-01T14:13:05.039093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:05.039099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:05.039101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:05.039107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256162589730785:5657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:05.039667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256162589730785:5657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:05.057172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256162589730785:5657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:05.063493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256162589730785:5657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:05.063517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256162589730785:5657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:05.063521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256162589730785:5657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:05.063531Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:05.075312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:05.078673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:05.078991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:05.079003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:05.079016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:05.079097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:05.079142Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256160212832440:2815]
2025-10-01T14:13:05.079745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:05.080028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:05.080071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:05.080372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:05.080428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.080434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.080436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.080437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.080438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.080440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.080441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.080442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.080443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.080444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.080445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.080447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.080448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.080449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.080453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.080463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.080467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.080470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.080474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.080478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.080482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.080485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.080488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.080492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.080495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.080498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.080502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.080506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.080512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.080520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.080526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.080531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.080535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.080540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.080545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.080550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.080554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.080560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.080564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.080569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.080574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.080579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.080583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.080588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.080598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.080603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.080612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.080617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.080634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.080639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.080647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.080653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.080661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.080666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.080674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.080679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.080735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:05.087670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:05.088698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:05.088712Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:05.088715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:05.088719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:05.088725Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1864 [2:7556256160212832440:2815]
2025-10-01T14:13:05.088744Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:05.088771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:05.088778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:05.088782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:05.088784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:05.088804Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:05.088815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:05.088821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:05.088889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.088896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.088898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.088900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:05.088904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:05.088980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:05.088988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.089000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.089015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.089035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:05.089060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589730776:2446], now have 1 active actors on pipe
2025-10-01T14:13:05.089068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589730906:5657], now have 1 active actors on pipe
2025-10-01T14:13:05.089077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256160212832435:2815]
2025-10-01T14:13:05.089083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256160212832435:2815]
2025-10-01T14:13:05.089085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256160212832435:2815]
2025-10-01T14:13:05.089100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:05.089115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:05.089120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:05.089125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:05.089127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:05.089135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:05.089138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:05.089175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256160212832435:2815]
2025-10-01T14:13:05.089185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:05.089191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:05.089307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1864
2025-10-01T14:13:05.089314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1864
2025-10-01T14:13:05.089438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.089450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.089479Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abac2007-9c391625-3103239d-b3e7747a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:05.089492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:05.089496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:05.089499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:05.089508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:05.089519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:05.089539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:05.089750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.089759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.089772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:05.089872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1865 partition: 0 MaxSeqNo: 45 sessionId: src_id|abac2007-9c391625-3103239d-b3e7747a_0
2025-10-01T14:13:05.090265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|611b27a8-a55ace8b-ceed63c7-4fc7c2a7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|abac2007-9c391625-3103239d-b3e7747a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:05.092743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abac2007-9c391625-3103239d-b3e7747a_0] Write session: try to update token
2025-10-01T14:13:05.092759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abac2007-9c391625-3103239d-b3e7747a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:05.105136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:05.105157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:05.105169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256160212832435:2815]
2025-10-01T14:13:05.105221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:05.105219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:05.105417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:05.105603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:05.105779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:05.105936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:05.106166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:05.106211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:05.109075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1865 sessionId: src_id|abac2007-9c391625-3103239d-b3e7747a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:05.111694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:05.111914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.111939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.111978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:05.112085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:05.118783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256162589730979:6233]
2025-10-01T14:13:05.120054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1864, pipe: [1:7556256162589730979:6233]
2025-10-01T14:13:05.121535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589730979:6233], now have 1 active actors on pipe
2025-10-01T14:13:05.121565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:05.121568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:05.121571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:05.121573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:05.121583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256160212832435:2815]
2025-10-01T14:13:05.121587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256160212832435:2815]
2025-10-01T14:13:05.121593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256160212832435:2815]
2025-10-01T14:13:05.121637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:05.121643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:05.121649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:05.121653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.121652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:05.121655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:05.121790Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:05.287078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:05.296164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.296200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.296396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.296455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.296518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.296576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.296836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.296843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.296913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.296978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.297038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.297100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.297143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.297146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.297220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.297282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.297346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.297422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.297751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.297755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.297831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.298025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.298087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.298151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.298196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.298199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.298274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.298331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.298552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.298631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.298682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.298690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.298764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.298834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.298899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.298968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.299016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.299024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.299098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.299163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.299234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.299312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.299352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.299355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.299427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.299493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.299560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.299626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.299669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.299672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.299785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.299848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.299908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.299973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.300019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.300023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.300092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.300152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.300218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.300279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.300321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.300323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.304787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abac2007-9c391625-3103239d-b3e7747a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:05.304800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abac2007-9c391625-3103239d-b3e7747a_0] Write session will restart in 0.009408s
2025-10-01T14:13:05.304826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abac2007-9c391625-3103239d-b3e7747a_0] Write session: Do CDS request
2025-10-01T14:13:05.304832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abac2007-9c391625-3103239d-b3e7747a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:05.305046Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:05.303201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:05.303257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256162589730979:6233]
2025-10-01T14:13:05.303277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:05.303280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:05.303309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1865 reason: error at write: Disconnected sessionId: src_id|abac2007-9c391625-3103239d-b3e7747a_0
2025-10-01T14:13:05.303521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1865 sessionId: src_id|abac2007-9c391625-3103239d-b3e7747a_0 is DEAD
2025-10-01T14:13:05.316033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abac2007-9c391625-3103239d-b3e7747a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:05.316394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:05.316410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1866
2025-10-01T14:13:05.316562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:05.316592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:05.316597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:05.316600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:05.317063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1866 sessionId:  describe result for acl check
2025-10-01T14:13:05.317097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:05.317099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:05.317101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:05.317106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256162589731024:5641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:05.317631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256162589731024:5641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:05.322512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256162589731024:5641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:05.332002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256162589731024:5641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:05.332026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256162589731024:5641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:05.332029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256162589731024:5641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:05.332038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:05.343628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:05.344991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:05.345233Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:05.345245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:05.345259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:05.345317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:05.345358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256160212832658:2800]
2025-10-01T14:13:05.346076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:05.347027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:05.347093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:05.347424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:05.347493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.347494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.347495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.347496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.347497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.347498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.347499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.347500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.347502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.347503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.347504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.347505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.347507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.347508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.347514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.347523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.347526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.347530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.347533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.347537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.347541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.347544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.347547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.347553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.347556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.347559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.347562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.347565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.347573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.347581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.347586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.347591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.347598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.347602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.347607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.347613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.347617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.347622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.347626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.347631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.347636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.347640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.347644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.347648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.347652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.347657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.347660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.347665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.347669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.347674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.347678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.347682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.347686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.347692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.347696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.347700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.347735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:05.352970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:05.353871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:05.353888Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:05.353891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:05.353895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:05.353902Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1865 [2:7556256160212832658:2800]
2025-10-01T14:13:05.353919Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:05.353939Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:05.353942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:05.353945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:05.353947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:05.353966Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:05.353973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:05.353979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:05.354051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.354058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.354061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.354066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:05.354070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:05.354168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:05.354177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.354190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.354201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.354217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:05.354236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256160212832646:2800]
2025-10-01T14:13:05.354238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256160212832646:2800]
2025-10-01T14:13:05.354240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256160212832646:2800]
2025-10-01T14:13:05.354250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:05.354260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:05.354263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:05.354265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:05.354267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:05.354280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:05.354283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:05.354295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589731147:5641], now have 1 active actors on pipe
2025-10-01T14:13:05.354299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589731000:2446], now have 1 active actors on pipe
2025-10-01T14:13:05.354341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256160212832646:2800]
2025-10-01T14:13:05.354351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:05.354360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:05.355288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1865
2025-10-01T14:13:05.355320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1865
2025-10-01T14:13:05.355662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.355679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.355713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:05.355726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:05.355731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:05.355734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:05.355746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:05.355761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:05.355789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:05.359577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1866 partition: 0 MaxSeqNo: 45 sessionId: src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0
2025-10-01T14:13:05.360356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abac2007-9c391625-3103239d-b3e7747a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:05.359396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.359428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.359466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:05.363164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0] Write session: try to update token
2025-10-01T14:13:05.363184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:05.388879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1866 sessionId: src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:05.391439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:05.394615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.394640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.394681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:05.394860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:05.400280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:05.400301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:05.400303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:05.400304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:05.400312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256160212832646:2800]
2025-10-01T14:13:05.400316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256160212832646:2800]
2025-10-01T14:13:05.400319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256160212832646:2800]
2025-10-01T14:13:05.400360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:05.400365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.400367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:05.400515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:05.400877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:05.400894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:05.400898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:05.403471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256162589731218:6233]
2025-10-01T14:13:05.403735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1865, pipe: [1:7556256162589731218:6233]
2025-10-01T14:13:05.569647Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:05.574187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589731218:6233], now have 1 active actors on pipe
2025-10-01T14:13:05.582970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.583001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.583196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.583259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.583329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.583398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.583928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.583947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.584030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.584092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.584158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.584239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.584606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.584611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.584693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.584749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.584812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.584876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.584923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.584926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.585000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.585066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.585128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.585193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.585235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.585241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.585310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.585368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.585428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.585490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.585530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.585533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.585604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.585663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.585730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.585798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.585846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.585849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.585924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.585984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.586049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.586113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.586160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.586162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.586237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.586299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.586363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.586632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.586689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.586697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.586773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.586842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.586915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.586986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.587038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.587045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.587122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:05.587199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:05.587265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:05.587327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:05.587373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:05.587376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:05.588919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:05.590897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:05.590909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0] Write session will restart in 0.005746s
2025-10-01T14:13:05.590937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0] Write session: Do CDS request
2025-10-01T14:13:05.590945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:05.590411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:05.590469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1866 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0
2025-10-01T14:13:05.590706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1866 sessionId: src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0 is DEAD
2025-10-01T14:13:05.590955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256162589731218:6233]
2025-10-01T14:13:05.590974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:05.597962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:05.598709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:05.598725Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1867
2025-10-01T14:13:05.598845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:05.598874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:05.598879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:05.598884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:05.599950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1867 sessionId:  describe result for acl check
2025-10-01T14:13:05.599988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:05.599990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:05.599992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:05.599998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256162589731255:5629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:05.600523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256162589731255:5629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:05.605278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256162589731255:5629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:05.614429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256162589731255:5629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:05.614448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256162589731255:5629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:05.614452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256162589731255:5629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:05.614461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:05.620887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:05.624032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:05.624297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:05.624306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:05.624317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:05.624371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:05.624408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256160212832872:2794]
2025-10-01T14:13:05.625082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:05.625773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:05.625833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:05.626343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:05.626415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.626421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.626422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.626424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.626426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.626427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.626429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.626430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.626432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.626433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.626434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.626436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.626437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.626438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.626444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.626455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.626459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.626463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.626467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.626472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.626478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.626483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.626487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.626491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.626496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.626499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.626504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.626507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.626515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.626523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.626530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.626535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.626539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.626544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.626548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.626554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.626558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.626563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.626568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.626583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.626588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.626593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.626599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.626605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.626609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.626614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.626619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.626624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.626628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.626633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.626637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.626647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.626652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.626671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.626679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.626684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.626726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:05.631464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:05.632300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:05.632316Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:05.632319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:05.632322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:05.632329Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1866 [2:7556256160212832872:2794]
2025-10-01T14:13:05.632345Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:05.632364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:05.632374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:05.632377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:05.632379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:05.632397Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:05.632407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:05.632413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:05.632472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.632479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.632481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.632484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:05.632487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:05.632554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:05.632561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.632573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.632589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.632608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:05.632642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256160212832867:2794]
2025-10-01T14:13:05.632649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256160212832867:2794]
2025-10-01T14:13:05.632651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256160212832867:2794]
2025-10-01T14:13:05.632660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:05.632670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:05.632675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:05.632682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:05.632684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:05.632691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:05.632696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:05.632708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589731403:5629], now have 1 active actors on pipe
2025-10-01T14:13:05.632746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589731243:2446], now have 1 active actors on pipe
2025-10-01T14:13:05.632753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256160212832867:2794]
2025-10-01T14:13:05.632759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:05.632774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:05.632844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1866
2025-10-01T14:13:05.632873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1866
2025-10-01T14:13:05.633033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.633046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.633077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:05.633089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:05.633094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:05.633096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:05.633108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:05.633122Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:05.633139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:05.633488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.633495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.633508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:05.634932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1867 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0
2025-10-01T14:13:05.637615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bd9a64a-c57dec4d-b42408ac-26c84d25_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:05.640288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0] Write session: try to update token
2025-10-01T14:13:05.640307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:05.658768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:05.658794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:05.658797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:05.658799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:05.658810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256160212832867:2794]
2025-10-01T14:13:05.658815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256160212832867:2794]
2025-10-01T14:13:05.658818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256160212832867:2794]
2025-10-01T14:13:05.658872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:05.658879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.658884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:05.659067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:05.660004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:05.660010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:05.660014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:05.658884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1867 sessionId: src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:05.661692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:05.692979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256162589731447:6233]
2025-10-01T14:13:05.694421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1866, pipe: [1:7556256162589731447:6233]
2025-10-01T14:13:05.825750Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:05.826286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.826302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.826345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589731447:6233], now have 1 active actors on pipe
2025-10-01T14:13:05.826593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:05.827341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256162589731447:6233]
2025-10-01T14:13:05.827372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:05.827440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1867 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0
2025-10-01T14:13:05.827643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1867 sessionId: src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0 is DEAD
2025-10-01T14:13:05.827760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:05.828040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:05.828051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0] Write session will restart in 0.007779s
2025-10-01T14:13:05.828080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0] Write session: Do CDS request
2025-10-01T14:13:05.828086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:05.836879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:05.838132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:05.838146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1868
2025-10-01T14:13:05.838259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:05.838289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:05.838293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:05.838296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:05.838689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1868 sessionId:  describe result for acl check
2025-10-01T14:13:05.838716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:05.838717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:05.838719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:05.838724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256162589731459:5625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:05.839303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256162589731459:5625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:05.842284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256162589731459:5625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:05.847849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256162589731459:5625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:05.847876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256162589731459:5625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:05.847879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256162589731459:5625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:05.847890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:05.865508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:05.865782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:05.865970Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:05.865974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:05.865986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:05.866031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:05.866069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256160212833090:2770]
2025-10-01T14:13:05.866665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:05.867904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:05.867965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:05.868343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:05.868400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.868405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.868407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.868409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.868410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.868412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.868413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.868415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.868416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.868417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.868418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.868419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.868421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.868422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.868428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.868437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.868441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.868444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.868448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.868452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.868455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.868458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.868462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.868466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.868469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.868473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.868476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.868479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.868487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.868495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:05.868501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.868506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:05.868517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.868522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:05.868526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.868531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:05.868536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.868546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:05.868550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.868556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:05.868565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.868570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:05.868578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.868583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:05.868592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.868597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:05.868606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.868610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.868615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.868634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.868643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.868648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.868653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.868658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:05.868665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.868671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:05.868710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:05.873650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:05.874639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:05.874644Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:05.874646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:05.874650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:05.874658Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1867 [2:7556256160212833090:2770]
2025-10-01T14:13:05.874674Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:05.874691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:05.874694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:05.874698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:05.874700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:05.874717Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:05.874723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:05.874729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:05.874796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.874798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.874801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.874804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:05.874806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:05.874884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:05.874886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.874899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:05.874909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:05.874924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:05.874940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256160212833085:2770]
2025-10-01T14:13:05.874943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256160212833085:2770]
2025-10-01T14:13:05.874945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256160212833085:2770]
2025-10-01T14:13:05.874959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:05.874973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:05.874988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:05.874991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:05.875033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256160212833085:2770]
2025-10-01T14:13:05.875035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:05.875243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:05.875252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:05.875254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:05.875260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:05.875926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1867
2025-10-01T14:13:05.875962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1867
2025-10-01T14:13:05.878476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589731522:5625], now have 1 active actors on pipe
2025-10-01T14:13:05.878492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589731452:2446], now have 1 active actors on pipe
2025-10-01T14:13:05.878515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.878522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.878560Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:05.878571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:05.878577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:05.878580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:05.878593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:05.878609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:05.878631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:05.881241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.881262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.881299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:05.881491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1868 partition: 0 MaxSeqNo: 45 sessionId: src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0
2025-10-01T14:13:05.881945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e76b381-6054a536-996cd3c4-ad1bc306_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:05.884777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0] Write session: try to update token
2025-10-01T14:13:05.884796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:05.912693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1868 sessionId: src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:05.915370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:05.915772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:05.915798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:05.915841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:05.916019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:05.927710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256162589731662:6233]
2025-10-01T14:13:05.927900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1867, pipe: [1:7556256162589731662:6233]
2025-10-01T14:13:05.928695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256162589731662:6233], now have 1 active actors on pipe
2025-10-01T14:13:05.928722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:05.928725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:05.928727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:05.928729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:05.928737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256160212833085:2770]
2025-10-01T14:13:05.928741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256160212833085:2770]
2025-10-01T14:13:05.928744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256160212833085:2770]
2025-10-01T14:13:05.928788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:05.928790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:05.928795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:05.928797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:05.928798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:05.928800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:05.928929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:06.072509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:06.080823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.080852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.081009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.081070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.081135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.081192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.081240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.081250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.081324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.081408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.081476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.081545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.081597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.081608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.081678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.081735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.081795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.081856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.081897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.081903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.081965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.082030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.082088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.082146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.082185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.082192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.082252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.082311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.082387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.082448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.082492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.082498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.082562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.082620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.082681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.082739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.082788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.082794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.082860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.082923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.082995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.083065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.083107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.083114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.083181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.083246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.083309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.083373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.083424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.083427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.083489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.083550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.083610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.083668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.083709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.083711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.083766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.083825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.083883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.083941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.083990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.083996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.084381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:06.084408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:06.084442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1868 reason: error at write: Disconnected sessionId: src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0
2025-10-01T14:13:06.084652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1868 sessionId: src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0 is DEAD
2025-10-01T14:13:06.084785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:06.084795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0] Write session will restart in 0.008992s
2025-10-01T14:13:06.084819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0] Write session: Do CDS request
2025-10-01T14:13:06.084825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:06.084879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:06.084914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256162589731662:6233]
2025-10-01T14:13:06.084935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:06.094899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.095058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:06.095085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1869
2025-10-01T14:13:06.095247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.095280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:06.095288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:06.095293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:06.095678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1869 sessionId:  describe result for acl check
2025-10-01T14:13:06.095718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:06.095720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:06.095722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:06.095727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256166884699089:5615] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:06.096322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256166884699089:5615] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:06.098050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:06.098486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256166884699089:5615] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:06.100299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:06.100476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:06.100485Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:06.100495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:06.100536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:06.100573Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256164507800590:2777]
2025-10-01T14:13:06.100800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256166884699089:5615] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:06.100817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256166884699089:5615] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:06.100820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256166884699089:5615] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:06.100828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:06.101127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:06.101362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:06.101398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:06.101709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:06.101748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.101753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.101753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.101754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.101755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.101755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.101756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.101756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.101757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.101757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.101758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.101759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.101759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.101760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.101763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.101769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.101771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.101773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.101775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.101777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.101779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.101781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.101783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.101786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.101788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.101790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.101792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.101794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.101799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.101804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.101808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.101811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.101813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.101816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.101818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.101821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.101823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.101826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.101828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.101831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.101833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.101836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.101838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.101842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.101844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.101847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.101853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.101856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.101859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.101861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.101867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.101869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.101872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.101874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.101879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.101882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.101901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:06.105772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:06.106312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:06.106326Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:06.106327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:06.106330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:06.106335Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1868 [2:7556256164507800590:2777]
2025-10-01T14:13:06.106344Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:06.106357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:06.106362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:06.106364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:06.106366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:06.106399Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:06.106408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:06.106414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:06.106454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.106459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.106461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.106463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:06.106464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:06.106521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:06.106531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.106540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.106550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.106564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:06.106580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884698961:2446], now have 1 active actors on pipe
2025-10-01T14:13:06.106588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699159:5615], now have 1 active actors on pipe
2025-10-01T14:13:06.106595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256164507800585:2777]
2025-10-01T14:13:06.106597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256164507800585:2777]
2025-10-01T14:13:06.106599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256164507800585:2777]
2025-10-01T14:13:06.106609Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:06.106619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:06.106622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:06.106624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:06.106629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:06.106641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:06.106644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:06.106616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1868
2025-10-01T14:13:06.106628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1868
2025-10-01T14:13:06.106663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256164507800585:2777]
2025-10-01T14:13:06.106670Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:06.106671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:06.106693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.106700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.106722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:06.106730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:06.106733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:06.106737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:06.106744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:06.106755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:06.106773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:06.106923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.106930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.106941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:06.107004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1869 partition: 0 MaxSeqNo: 45 sessionId: src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0
2025-10-01T14:13:06.107319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e9f7acd2-9399ed71-58e04e62-b98aef12_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:06.109567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0] Write session: try to update token
2025-10-01T14:13:06.109581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:06.124544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1869 sessionId: src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:06.127927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:06.129293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.129320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.129339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:06.129341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:06.129347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:06.129349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:06.129355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256164507800585:2777]
2025-10-01T14:13:06.129358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256164507800585:2777]
2025-10-01T14:13:06.129361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256164507800585:2777]
2025-10-01T14:13:06.129405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:06.129398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:06.129411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.129412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:06.129413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:06.129417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:06.129537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:06.185241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256166884699171:6233]
2025-10-01T14:13:06.185443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1868, pipe: [1:7556256166884699171:6233]
2025-10-01T14:13:06.274322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:06.274875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:06.274944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699171:6233], now have 1 active actors on pipe
2025-10-01T14:13:06.277960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:06.278047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256166884699171:6233]
2025-10-01T14:13:06.278070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:06.278073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:06.278077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:06.278142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1869 reason: error at write: Disconnected sessionId: src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0
2025-10-01T14:13:06.278328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1869 sessionId: src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0 is DEAD
2025-10-01T14:13:06.279567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:06.279581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0] Write session will restart in 0.009920s
2025-10-01T14:13:06.279610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0] Write session: Do CDS request
2025-10-01T14:13:06.279619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:06.290994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.293354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:06.293371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1870
2025-10-01T14:13:06.293550Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.293600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:06.293613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:06.293617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:06.294033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1870 sessionId:  describe result for acl check
2025-10-01T14:13:06.294068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:06.294074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:06.294076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:06.294081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256166884699204:5609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:06.294644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256166884699204:5609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:06.297118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256166884699204:5609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:06.300193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256166884699204:5609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:06.300208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256166884699204:5609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:06.300211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256166884699204:5609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:06.300219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:06.307360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:06.310016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:06.310225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:06.310237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:06.310246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:06.310291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:06.310341Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256164507800805:2774]
2025-10-01T14:13:06.310976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:06.311340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:06.311380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:06.311818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:06.312015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.312016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.312018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.312019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.312020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.312021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.312022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.312024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.312025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.312026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.312027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.312029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.312030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.312032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.312039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.312048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.312052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.312056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.312060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.312064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.312068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.312072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.312076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.312081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.312084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.312089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.312092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.312095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.312104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.312111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.312117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.312123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.312127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.312132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.312137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.312142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.312147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.312153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.312157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.312162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.312167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.312172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.312177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.312182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.312187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.312192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.312196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.312201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.312217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.312222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.312227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.312232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.312239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.312244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.312249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.312254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.312295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:06.317557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:06.318840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:06.318858Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:06.318861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:06.318864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:06.318871Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1869 [2:7556256164507800805:2774]
2025-10-01T14:13:06.318892Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:06.318911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:06.318924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:06.318928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:06.318929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:06.318947Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:06.318953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:06.318959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:06.319026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.319034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.319036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.319040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:06.319043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:06.319118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:06.319126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.319138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.319153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.319170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:06.319192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699173:2446], now have 1 active actors on pipe
2025-10-01T14:13:06.319201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699321:5609], now have 1 active actors on pipe
2025-10-01T14:13:06.319208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256164507800799:2774]
2025-10-01T14:13:06.319215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256164507800799:2774]
2025-10-01T14:13:06.319217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256164507800799:2774]
2025-10-01T14:13:06.319231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:06.319250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:06.319251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:06.319264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:06.319264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:06.319266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:06.319267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:06.319304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256164507800799:2774]
2025-10-01T14:13:06.319316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:06.319322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:06.319903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1869
2025-10-01T14:13:06.319960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1869
2025-10-01T14:13:06.320080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.320098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.320125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|777b03da-4b314bf-4f8470bd-a8523d78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:06.320139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:06.320143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:06.320146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:06.320160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:06.320175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:06.320196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:06.320485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.320495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.320509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:06.320590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1870 partition: 0 MaxSeqNo: 45 sessionId: src_id|777b03da-4b314bf-4f8470bd-a8523d78_0
2025-10-01T14:13:06.320990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd9d4b0d-dd990d1c-bf5128a0-f4c6f728_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|777b03da-4b314bf-4f8470bd-a8523d78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:06.323493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|777b03da-4b314bf-4f8470bd-a8523d78_0] Write session: try to update token
2025-10-01T14:13:06.323509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|777b03da-4b314bf-4f8470bd-a8523d78_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:06.340398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1870 sessionId: src_id|777b03da-4b314bf-4f8470bd-a8523d78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:06.343225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:06.343642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:06.343446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.343475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.343526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:06.352842Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:06.352862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:06.352864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:06.352867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:06.352877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256164507800799:2774]
2025-10-01T14:13:06.352881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256164507800799:2774]
2025-10-01T14:13:06.352885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256164507800799:2774]
2025-10-01T14:13:06.352936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:06.352949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.352951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:06.353096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:06.353699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:06.353705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:06.353712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:06.374426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256166884699397:6233]
2025-10-01T14:13:06.374880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1869, pipe: [1:7556256166884699397:6233]
2025-10-01T14:13:06.501371Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:06.508093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.508119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.508264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.508317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.508379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.508436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.508699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.508708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.508770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.508825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.508879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.508938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.508976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.508982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.509035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.509088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.509138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.509190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.509227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.509234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.509316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.509386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.509436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.509488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.509527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.509532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.509590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.509642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.509697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.509748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.509786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.509791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.509846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.509897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.509950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.510010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.510049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.510054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.510105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.510156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.510210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.510266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.510308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.510314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.510385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.510443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.510506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.510563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.510602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.510607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.510667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.510720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.510782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.510840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.510880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.510885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.510953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.511019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.511094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.511160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.511210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.511218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.511298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699397:6233], now have 1 active actors on pipe
2025-10-01T14:13:06.511507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256166884699397:6233]
2025-10-01T14:13:06.511534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:06.511536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:06.511561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1870 reason: error at write: Disconnected sessionId: src_id|777b03da-4b314bf-4f8470bd-a8523d78_0
2025-10-01T14:13:06.511734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1870 sessionId: src_id|777b03da-4b314bf-4f8470bd-a8523d78_0 is DEAD
2025-10-01T14:13:06.511856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777b03da-4b314bf-4f8470bd-a8523d78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:06.511865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777b03da-4b314bf-4f8470bd-a8523d78_0] Write session will restart in 0.005049s
2025-10-01T14:13:06.511885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777b03da-4b314bf-4f8470bd-a8523d78_0] Write session: Do CDS request
2025-10-01T14:13:06.511890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777b03da-4b314bf-4f8470bd-a8523d78_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:06.512198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:06.512838Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:06.517901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|777b03da-4b314bf-4f8470bd-a8523d78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.518077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:06.518090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1871
2025-10-01T14:13:06.518221Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.518251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:06.518258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:06.518261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:06.518665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1871 sessionId:  describe result for acl check
2025-10-01T14:13:06.518703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:06.518709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:06.518710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:06.518716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256166884699447:5594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:06.519248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256166884699447:5594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:06.521876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256166884699447:5594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:06.525731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256166884699447:5594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:06.525747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256166884699447:5594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:06.525750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256166884699447:5594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:06.525759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:06.526681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:06.528765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:06.528941Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:06.528950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:06.528959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:06.528999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:06.529044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256164507801015:2766]
2025-10-01T14:13:06.529656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:06.529908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:06.529938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:06.530214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:06.530257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.530262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.530263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.530264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.530266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.530267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.530268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.530269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.530270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.530271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.530272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.530273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.530274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.530275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.530279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.530288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.530291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.530295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.530298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.530301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.530304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.530308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.530311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.530314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.530318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.530321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.530328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.530331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.530341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.530348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.530357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.530365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.530389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.530399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.530403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.530408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.530412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.530416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.530419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.530424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.530428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.530433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.530436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.530441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.530445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.530449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.530452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.530457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.530461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.530465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.530473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.530477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.530481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.530485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.530489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.530495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.530529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:06.535363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:06.535958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:06.535973Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:06.535975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:06.535979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:06.535985Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1870 [2:7556256164507801015:2766]
2025-10-01T14:13:06.535997Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:06.536013Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:06.536015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:06.536019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:06.536022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:06.536036Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:06.536040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:06.536047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:06.536099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.536106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.536108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.536112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:06.536115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:06.536177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:06.536184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.536194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.536205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.536222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:06.536244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699629:5594], now have 1 active actors on pipe
2025-10-01T14:13:06.536253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699434:2446], now have 1 active actors on pipe
2025-10-01T14:13:06.536260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256164507801010:2766]
2025-10-01T14:13:06.536262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256164507801010:2766]
2025-10-01T14:13:06.536264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256164507801010:2766]
2025-10-01T14:13:06.536280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:06.536292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:06.536294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:06.536296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:06.536297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:06.536310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:06.536317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:06.536305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1870
2025-10-01T14:13:06.536353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.536362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.536352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1870
2025-10-01T14:13:06.536374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256164507801010:2766]
2025-10-01T14:13:06.536386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:06.536401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:06.536417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:06.536423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:06.536429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:06.536432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:06.536440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:06.536447Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:06.536468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:06.536631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.536638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.536651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:06.536750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1871 partition: 0 MaxSeqNo: 45 sessionId: src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0
2025-10-01T14:13:06.537150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777b03da-4b314bf-4f8470bd-a8523d78_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:06.539657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0] Write session: try to update token
2025-10-01T14:13:06.539677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:06.553392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1871 sessionId: src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:06.555968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:06.556437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.556462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.558412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:06.558449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:06.558453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:06.558466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:06.558474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:06.558483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256164507801010:2766]
2025-10-01T14:13:06.558492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256164507801010:2766]
2025-10-01T14:13:06.558496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256164507801010:2766]
2025-10-01T14:13:06.558538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:06.558542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:06.558550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.558541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:06.558552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:06.558553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:06.558557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:06.558708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:06.611759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256166884699642:6233]
2025-10-01T14:13:06.612074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1870, pipe: [1:7556256166884699642:6233]
2025-10-01T14:13:06.708644Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:06.717577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.717610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.717792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.717863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.717935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.718012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.718060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.718066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.718146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.718202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.718265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.718331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.718397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.718400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.718472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.718537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.718603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.718670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.719149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.719161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.719231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.719294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.719360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.719425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.719472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.719479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.719549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.719611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.719678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.719744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.719792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.719801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.719868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.719924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.719993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.720064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.720114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.720121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.720187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.720251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.720314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.720379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.720428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.720434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.720501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.720563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.720638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.720704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.720755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.720768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.720841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.720903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.720966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.721028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.721071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.721076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.721142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:06.721199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:06.721264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:06.721335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:06.721377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:06.721382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:06.721448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699642:6233], now have 1 active actors on pipe
2025-10-01T14:13:06.722218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:06.722443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:06.722461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:06.722499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1871 reason: error at write: Disconnected sessionId: src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0
2025-10-01T14:13:06.722561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:06.722636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256166884699642:6233]
2025-10-01T14:13:06.722787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1871 sessionId: src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0 is DEAD
2025-10-01T14:13:06.723391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:06.723405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0] Write session will restart in 0.009012s
2025-10-01T14:13:06.723431Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0] Write session: Do CDS request
2025-10-01T14:13:06.723438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:06.734863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.734959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:06.734991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1872
2025-10-01T14:13:06.735164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.735212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:06.735226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:06.735230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:06.735726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1872 sessionId:  describe result for acl check
2025-10-01T14:13:06.735765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:06.735775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:06.735777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:06.735783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256166884699664:5588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:06.736729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256166884699664:5588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:06.739424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256166884699664:5588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:06.747427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256166884699664:5588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:06.747456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256166884699664:5588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:06.747460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256166884699664:5588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:06.747470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:06.758676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:06.762418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:06.762727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:06.762736Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:06.762747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:06.762798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:06.762840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256164507801253:2721]
2025-10-01T14:13:06.763619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:06.764034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:06.764077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:06.764515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:06.764586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.764587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.764589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.764590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.764592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.764593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.764594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.764596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.764597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.764598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.764599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.764600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.764601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.764602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.764607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.764627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.764632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.764637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.764640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.764644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.764648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.764652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.764656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.764660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.764664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.764668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.764671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.764675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.764682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.764689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:06.764695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.764700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:06.764706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.764711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:06.764716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.764721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:06.764727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.764732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:06.764736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.764741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:06.764747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.764752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:06.764757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.764762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:06.764767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.764773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:06.764777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.764783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.764791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.764798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.764803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.764808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.764812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.764818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:06.764822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.764827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:06.764864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:06.771394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:06.772327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:06.772333Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:06.772336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:06.772341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:06.772349Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1871 [2:7556256164507801253:2721]
2025-10-01T14:13:06.772476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:06.772498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:06.772501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:06.772504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:06.772506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:06.772522Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:06.772527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:06.772534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:06.772602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.772604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.772606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.772610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:06.772684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:06.772755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:06.772758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.772769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:06.772778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:06.772793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:06.772810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256164507801247:2721]
2025-10-01T14:13:06.772812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256164507801247:2721]
2025-10-01T14:13:06.772815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256164507801247:2721]
2025-10-01T14:13:06.772825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:06.772834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:06.772837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:06.772839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:06.772840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:06.772853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:06.772856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:06.772877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699755:5588], now have 1 active actors on pipe
2025-10-01T14:13:06.772881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699648:2446], now have 1 active actors on pipe
2025-10-01T14:13:06.772916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256164507801247:2721]
2025-10-01T14:13:06.772924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:06.773049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:06.773608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.773617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.773645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:06.773278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1871
2025-10-01T14:13:06.773319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1871
2025-10-01T14:13:06.773683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:06.773689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:06.773691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:06.773702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:06.773712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:06.773725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:06.773908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.773914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.773927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:06.774293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1872 partition: 0 MaxSeqNo: 45 sessionId: src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0
2025-10-01T14:13:06.774734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e76bab4-da8a454e-9d8ab585-ca1c4658_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:06.776959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0] Write session: try to update token
2025-10-01T14:13:06.776974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:06.792246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1872 sessionId: src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:06.795882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:06.797466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:06.797497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:06.797517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:06.797520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:06.797523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:06.797525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:06.797533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256164507801247:2721]
2025-10-01T14:13:06.797538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256164507801247:2721]
2025-10-01T14:13:06.797544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256164507801247:2721]
2025-10-01T14:13:06.797596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:06.797604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:06.797610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:06.797611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:06.797613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:06.797614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:06.797782Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:06.821673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256166884699858:6233]
2025-10-01T14:13:06.822096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1871, pipe: [1:7556256166884699858:6233]
2025-10-01T14:13:06.973744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:06.974330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:06.974550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699858:6233], now have 1 active actors on pipe
2025-10-01T14:13:06.980437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:06.980553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:06.980557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:06.980645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1872 reason: error at write: Disconnected sessionId: src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0
2025-10-01T14:13:06.980805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1872 sessionId: src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0 is DEAD
2025-10-01T14:13:06.980973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256166884699858:6233]
2025-10-01T14:13:06.980987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:06.981463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:06.981471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0] Write session will restart in 0.007279s
2025-10-01T14:13:06.981497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0] Write session: Do CDS request
2025-10-01T14:13:06.981506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:06.995408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.995778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:06.995810Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1873
2025-10-01T14:13:06.996001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:06.996039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:06.996045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:06.996050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:06.996636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1873 sessionId:  describe result for acl check
2025-10-01T14:13:06.996675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:06.996677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:06.996680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:06.996685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256166884699875:5575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:06.999152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256166884699875:5575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:07.004041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256166884699875:5575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:07.014990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256166884699875:5575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:07.015011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256166884699875:5575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:07.015019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256166884699875:5575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:07.015029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:07.077296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256171179667361:6233]
2025-10-01T14:13:07.080245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:07.084763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:07.085327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:07.085351Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:07.085383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:07.085534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:07.085579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256168802768759:2732]
2025-10-01T14:13:07.086269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:07.086779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:07.086831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:07.087184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:07.087236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.087237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.087239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.087240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.087241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.087243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.087244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.087245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.087247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.087248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.087250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.087251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.087253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.087254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.087261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.087273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.087278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.087283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.087287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.087292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.087296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.087300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.087305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.087310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.087314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.087318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.087322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.087326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.087334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.087343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.087349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.087355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.087362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.087367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.087373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.087379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.087385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.087391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.087396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.087403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.087409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.087414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.087421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.087426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.087431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.087437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.087442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.087448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.087453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.087459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.087464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.087470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.087475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.087481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.087486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.087492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.087536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:07.095267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:07.095902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:07.095908Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:07.095911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:07.095916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:07.095924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1872 [2:7556256168802768759:2732]
2025-10-01T14:13:07.095943Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:07.095964Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:07.095967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:07.095972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:07.095974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:07.095994Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:07.096000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:07.096007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:07.096071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.096074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.096077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.096081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:07.096084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:07.096162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:07.096165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.096177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.096190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.096208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:07.096225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256168802768753:2732]
2025-10-01T14:13:07.096227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256168802768753:2732]
2025-10-01T14:13:07.096229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256168802768753:2732]
2025-10-01T14:13:07.096243Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:07.096259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:07.096275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:07.096279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:07.096317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256168802768753:2732]
2025-10-01T14:13:07.096320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:07.096553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:07.096561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:07.096564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:07.096569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:07.097378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1872
2025-10-01T14:13:07.097437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1872
2025-10-01T14:13:07.097468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1872, pipe: [1:7556256171179667361:6233]
2025-10-01T14:13:07.101513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256171179667231:5575], now have 1 active actors on pipe
2025-10-01T14:13:07.101533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256166884699866:2446], now have 1 active actors on pipe
2025-10-01T14:13:07.101537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256171179667361:6233], now have 1 active actors on pipe
2025-10-01T14:13:07.101559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.101566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.101605Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:07.101617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:07.101624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:07.101631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:07.101643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:07.101661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:07.101683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:07.102961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.102979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.103010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:07.103133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1873 partition: 0 MaxSeqNo: 45 sessionId: src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0
2025-10-01T14:13:07.103462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab649146-4d22f2a7-d422a659-e47fa26d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:07.106177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0] Write session: try to update token
2025-10-01T14:13:07.106199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:07.134258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1873 sessionId: src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:07.136929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:07.136580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:07.136604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:07.136607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:07.136609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:07.136634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256168802768753:2732]
2025-10-01T14:13:07.136641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256168802768753:2732]
2025-10-01T14:13:07.136646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256168802768753:2732]
2025-10-01T14:13:07.136699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:07.136706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.136709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:07.136860Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:07.137119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:07.137124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:07.137129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:07.297801Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:07.298218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.298226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.298938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:07.299014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1873 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0
2025-10-01T14:13:07.299214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1873 sessionId: src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0 is DEAD
2025-10-01T14:13:07.299334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:07.299367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256171179667361:6233]
2025-10-01T14:13:07.299798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:07.299805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0] Write session will restart in 0.006059s
2025-10-01T14:13:07.299829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0] Write session: Do CDS request
2025-10-01T14:13:07.299834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:07.298480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:07.310899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:07.317024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:07.317041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1874
2025-10-01T14:13:07.317876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:07.317910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:07.317916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:07.317920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:07.319397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1874 sessionId:  describe result for acl check
2025-10-01T14:13:07.319446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:07.319449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:07.319450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:07.319457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256171179667459:5572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:07.319987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256171179667459:5572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:07.336229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:07.338357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256171179667459:5572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:07.339397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:07.339702Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:07.339707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:07.339722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:07.339794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:07.339832Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256168802768975:2722]
2025-10-01T14:13:07.340578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:07.340930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:07.340974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:07.341368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:07.341429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.341431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.341432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.341434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.341436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.341437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.341454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.341456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.341458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.341459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.341461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.341462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.341463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.341465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.341470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.341482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.341486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.341491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.341495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.341499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.341503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.341507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.341511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.341517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.341521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.341525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.341529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.341533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.341542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.341550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.341556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.341562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.341567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.341573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.341578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.341583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.341589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.341595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.341600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.341605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.341611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.341617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.341622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.341628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.341633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.341639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.341644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.341651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.341656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.341662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.341666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.341673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.341678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.341684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.341689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.341694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.341738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:07.351719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:07.352524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:07.352540Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:07.352543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:07.352547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:07.352555Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1873 [2:7556256168802768975:2722]
2025-10-01T14:13:07.352572Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:07.352590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:07.352594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:07.352598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:07.352600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:07.352631Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:07.352638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:07.352645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:07.352707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.352709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.352711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.352715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:07.352718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:07.352792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:07.352796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.352809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.352821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.352839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:07.352856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256168802768970:2722]
2025-10-01T14:13:07.352864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256168802768970:2722]
2025-10-01T14:13:07.352866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256168802768970:2722]
2025-10-01T14:13:07.352876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:07.352891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:07.352905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:07.352908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:07.352927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:07.352930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:07.352932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:07.352953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256168802768970:2722]
2025-10-01T14:13:07.352957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:07.352977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:07.353624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256171179667380:2446], now have 1 active actors on pipe
2025-10-01T14:13:07.353691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256171179667586:5572], now have 1 active actors on pipe
2025-10-01T14:13:07.354033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.354044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.354072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:07.354081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:07.354086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:07.354088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:07.352461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256171179667459:5572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:07.352481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256171179667459:5572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:07.352485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256171179667459:5572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:07.352495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:07.353554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1873
2025-10-01T14:13:07.353927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1873
2025-10-01T14:13:07.354099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:07.354116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:07.354135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:07.357659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.357680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.357717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:07.361683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda2b462-6c5e07c0-79ce90fe-a05a738b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:07.360546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1874 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0
2025-10-01T14:13:07.364526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0] Write session: try to update token
2025-10-01T14:13:07.364547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:07.387803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:07.387827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:07.387830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:07.387833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:07.387844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256168802768970:2722]
2025-10-01T14:13:07.387849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256168802768970:2722]
2025-10-01T14:13:07.387854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256168802768970:2722]
2025-10-01T14:13:07.387903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:07.387911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.387913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:07.388079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:07.397255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1874 sessionId: src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:07.394557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:07.394583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:07.394588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:07.400151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:07.402460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256171179667600:6233]
2025-10-01T14:13:07.410478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1873, pipe: [1:7556256171179667600:6233]
2025-10-01T14:13:07.610893Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:07.611443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.611454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.611499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256171179667600:6233], now have 1 active actors on pipe
2025-10-01T14:13:07.612874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:07.612221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:07.612236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:07.612290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1874 reason: error at write: Disconnected sessionId: src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0
2025-10-01T14:13:07.612489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1874 sessionId: src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0 is DEAD
2025-10-01T14:13:07.612632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:07.612667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256171179667600:6233]
2025-10-01T14:13:07.618481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:07.618497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0] Write session will restart in 0.009836s
2025-10-01T14:13:07.618530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0] Write session: Do CDS request
2025-10-01T14:13:07.618536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:07.630948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:07.631293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:07.631311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1875
2025-10-01T14:13:07.631420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:07.631446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:07.631452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:07.631455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:07.631827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1875 sessionId:  describe result for acl check
2025-10-01T14:13:07.631854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:07.631856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:07.631858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:07.631863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256171179667654:5557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:07.632403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256171179667654:5557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:07.647528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256171179667654:5557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:07.656059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256171179667654:5557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:07.656079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256171179667654:5557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:07.656082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256171179667654:5557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:07.656093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:07.671929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:07.675976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:07.676245Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:07.676249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:07.676262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:07.676315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:07.676352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256168802769194:2723]
2025-10-01T14:13:07.676956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:07.677529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:07.677579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:07.677901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:07.677956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.677957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.677959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.677960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.677961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.677963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.677964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.677965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.677966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.677967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.677969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.677970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.677971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.677972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.677977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.677986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.677990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.677994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.677997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.678000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.678003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.678007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.678010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.678013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.678017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.678021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.678024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.678027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.678035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.678042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:07.678048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.678053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:07.678057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.678061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:07.678066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.678070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:07.678074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.678078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:07.678082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.678087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:07.678090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.678095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:07.678100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.678104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:07.678108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.678112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:07.678117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.678121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.678126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.678130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.678134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.678139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.678144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.678148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:07.678152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.678174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:07.678208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:07.684139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:07.685022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:07.685040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:07.685043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:07.685047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:07.685055Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1874 [2:7556256168802769194:2723]
2025-10-01T14:13:07.685073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:07.685092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:07.685096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:07.685100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:07.685102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:07.685120Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:07.685126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:07.685133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:07.685199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.685201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.685203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.685207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:07.685210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:07.685282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:07.685285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.685296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:07.685307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:07.685324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:07.685342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256168802769188:2723]
2025-10-01T14:13:07.685345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256168802769188:2723]
2025-10-01T14:13:07.685347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256168802769188:2723]
2025-10-01T14:13:07.685362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:07.685377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:07.685392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:07.685394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:07.685449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256168802769188:2723]
2025-10-01T14:13:07.685452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:07.685723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:07.685733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:07.685735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:07.685745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:07.686717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256171179667743:5557], now have 1 active actors on pipe
2025-10-01T14:13:07.686727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256171179667642:2446], now have 1 active actors on pipe
2025-10-01T14:13:07.686743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.686749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.686786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8868f462-6c0793ee-dc39058a-c67496de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:07.686795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:07.686800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:07.686803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:07.686813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:07.686824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:07.686841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:07.686401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1874
2025-10-01T14:13:07.686436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1874
2025-10-01T14:13:07.690291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.690310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.690339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:07.690875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc1b8ee8-1edd87dd-26238829-a32e93c7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8868f462-6c0793ee-dc39058a-c67496de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:07.693456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8868f462-6c0793ee-dc39058a-c67496de_0] Write session: try to update token
2025-10-01T14:13:07.693474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8868f462-6c0793ee-dc39058a-c67496de_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:07.690461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1875 partition: 0 MaxSeqNo: 45 sessionId: src_id|8868f462-6c0793ee-dc39058a-c67496de_0
2025-10-01T14:13:07.710309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:07.710330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:07.710341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256168802769188:2723]
2025-10-01T14:13:07.710401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:07.710656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:07.710827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:07.710968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:07.711109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:07.711306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:07.711337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:07.712239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:07.713651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256171179667856:6233], now have 1 active actors on pipe
2025-10-01T14:13:07.712313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256171179667856:6233]
2025-10-01T14:13:07.713721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1874, pipe: [1:7556256171179667856:6233]
2025-10-01T14:13:07.735527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1875 sessionId: src_id|8868f462-6c0793ee-dc39058a-c67496de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:07.738258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:07.738514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.738541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.738578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:07.738755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:07.748923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:07.748947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:07.748949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:07.748951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:07.748962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256168802769188:2723]
2025-10-01T14:13:07.748966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256168802769188:2723]
2025-10-01T14:13:07.748970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256168802769188:2723]
2025-10-01T14:13:07.749022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:07.749028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:07.749031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:07.749162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:07.750669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:07.750683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:07.750687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:07.973123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:07.984011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:07.984045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:07.984225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.984289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.984352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.984415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.984939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.984946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.985024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.985089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.985153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.985221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.985445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.985448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.985514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.985572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.985639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.985706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.985751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.985753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.985819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.985885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.985946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.986008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.986050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.986052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.986119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.986199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.986257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.986315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.986358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.986362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.995261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.995344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.995403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.995474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.995517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.995522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.995596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.995653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.995715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.995772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.995816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.995820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.995884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.995939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.995995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.996051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.996094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.996096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.996165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.996232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.996286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.996342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.996379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.996382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.996445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:07.996515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:07.996575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:07.996647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:07.996689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:07.996692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:07.998725Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:08.002909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:08.002962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1875 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8868f462-6c0793ee-dc39058a-c67496de_0
2025-10-01T14:13:08.003169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1875 sessionId: src_id|8868f462-6c0793ee-dc39058a-c67496de_0 is DEAD
2025-10-01T14:13:08.003319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256171179667856:6233]
2025-10-01T14:13:08.003333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:08.004923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8868f462-6c0793ee-dc39058a-c67496de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:08.004934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8868f462-6c0793ee-dc39058a-c67496de_0] Write session will restart in 0.009481s
2025-10-01T14:13:08.004962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8868f462-6c0793ee-dc39058a-c67496de_0] Write session: Do CDS request
2025-10-01T14:13:08.004968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8868f462-6c0793ee-dc39058a-c67496de_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:08.019664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8868f462-6c0793ee-dc39058a-c67496de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:08.020779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:08.020797Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1876
2025-10-01T14:13:08.021425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:08.021460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:08.021466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:08.021470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:08.022274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1876 sessionId:  describe result for acl check
2025-10-01T14:13:08.022301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:08.022303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:08.022304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:08.022310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256175474635204:5547] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:08.022843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256175474635204:5547] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:08.033227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256175474635204:5547] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:08.038163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256175474635204:5547] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:08.038180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256175474635204:5547] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:08.038183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256175474635204:5547] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:08.038190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:08.045708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:08.053407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:08.053655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:08.053660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:08.053672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:08.053719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:08.053755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256173097736729:2683]
2025-10-01T14:13:08.054332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:08.054809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:08.054862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:08.055211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:08.055263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.055264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.055265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.055266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.055268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.055269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.055271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.055272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.055273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.055275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.055276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.055277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.055279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.055280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.055286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.055298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.055302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.055307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.055312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.055317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.055321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.055326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.055330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.055335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.055340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.055344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.055348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.055353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.055361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.055369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.055377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.055383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.055388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.055394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.055399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.055405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.055411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.055416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.055421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.055427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.055433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.055438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.055443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.055449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.055455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.055461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.055467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.055472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.055477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.055483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.055488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.055493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.055498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.055504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.055509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.055515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.055561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:08.062095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1875
2025-10-01T14:13:08.062127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1875
2025-10-01T14:13:08.060008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:08.060965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:08.060971Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:08.060974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:08.060978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:08.060985Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1875 [2:7556256173097736729:2683]
2025-10-01T14:13:08.061000Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:08.061017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:08.061020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:08.061024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:08.061026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:08.061043Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:08.061049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:08.061055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:08.061113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.061115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.061118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.061121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:08.061124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:08.061197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:08.061200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.061212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.061225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.061243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:08.061260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256173097736723:2683]
2025-10-01T14:13:08.061262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256173097736723:2683]
2025-10-01T14:13:08.061265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256173097736723:2683]
2025-10-01T14:13:08.061276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:08.061290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:08.061306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:08.061309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:08.061338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256173097736723:2683]
2025-10-01T14:13:08.061340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:08.061421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:08.061424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:08.061427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:08.061432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:08.062645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256175474635318:5547], now have 1 active actors on pipe
2025-10-01T14:13:08.062657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256175474635160:2446], now have 1 active actors on pipe
2025-10-01T14:13:08.062671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.062677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.062713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:08.062721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:08.062726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:08.062728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:08.062741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:08.062753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:08.062768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:08.063071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.063078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.063092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:08.063226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1876 partition: 0 MaxSeqNo: 45 sessionId: src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0
2025-10-01T14:13:08.063649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8868f462-6c0793ee-dc39058a-c67496de_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:08.066463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0] Write session: try to update token
2025-10-01T14:13:08.066482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:08.104821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1876 sessionId: src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:08.107509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:08.107594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256175474635375:6233]
2025-10-01T14:13:08.110853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.110874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.110917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256175474635375:6233], now have 1 active actors on pipe
2025-10-01T14:13:08.114925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1875, pipe: [1:7556256175474635375:6233]
2025-10-01T14:13:08.113664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:08.113703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:08.113706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:08.113709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:08.113711Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:08.113720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256173097736723:2683]
2025-10-01T14:13:08.113725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256173097736723:2683]
2025-10-01T14:13:08.113729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256173097736723:2683]
2025-10-01T14:13:08.113778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:08.113785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.113787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:08.113946Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:08.118596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:08.118612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:08.118616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:08.121015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:08.340152Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:08.349438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.349468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.349656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.349723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.349793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.349860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.349913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.349918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.349992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.350068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.350146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.350231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.350284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.350292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.350516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.350596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.350665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.350733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.350776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.350779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.350845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.350904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.350967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.351033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.351076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.351078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.351150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.351212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.351270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.351336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.351380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.351383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.351451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.351522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.351592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.351657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.351702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.351707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.351783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.351845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.351908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.351972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.352017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.352020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.352086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.352144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.352205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.352269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.352313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.352316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.352386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.352446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.352511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.352577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.352633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.352636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.352711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.352779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.352848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.352911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.352954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.352957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.354703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:08.354776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256175474635375:6233]
2025-10-01T14:13:08.354777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:08.354782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:08.354804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:08.354811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1876 reason: error at write: Disconnected sessionId: src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0
2025-10-01T14:13:08.355036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1876 sessionId: src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0 is DEAD
2025-10-01T14:13:08.357537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:08.357548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0] Write session will restart in 0.006605s
2025-10-01T14:13:08.357568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0] Write session: Do CDS request
2025-10-01T14:13:08.357573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:08.365681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:08.366029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:08.366045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1877
2025-10-01T14:13:08.366256Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:08.366287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:08.366293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:08.366297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:08.366863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1877 sessionId:  describe result for acl check
2025-10-01T14:13:08.366901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:08.366903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:08.366904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:08.366908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256175474635394:5537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:08.367441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256175474635394:5537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:08.372593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256175474635394:5537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:08.383377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256175474635394:5537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:08.383398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256175474635394:5537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:08.383402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256175474635394:5537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:08.383412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:08.401479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:08.404479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:08.404727Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:08.404731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:08.404742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:08.404794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:08.404839Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256173097736954:2680]
2025-10-01T14:13:08.405440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:08.405844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:08.405881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:08.406206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:08.406266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.406267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.406268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.406269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.406270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.406272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.406273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.406274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.406276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.406277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.406278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.406280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.406281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.406282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.406288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.406298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.406301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.406305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.406308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.406311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.406315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.406319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.406323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.406327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.406330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.406333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.406337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.406341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.406350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.406357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.406363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.406381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.406386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.406390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.406394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.406399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.406403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.406408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.406413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.406418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.406423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.406428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.406432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.406437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.406442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.406447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.406452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.406456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.406461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.406466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.406472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.406476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.406480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.406486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.406490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.406494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.406531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:08.412243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:08.413167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:08.413172Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:08.413176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:08.413181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:08.413188Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1876 [2:7556256173097736954:2680]
2025-10-01T14:13:08.413206Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:08.413225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:08.413228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:08.413232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:08.413234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:08.413254Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:08.413259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:08.413267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:08.413336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.413338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.413339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.413342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:08.413345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:08.413421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:08.413424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.413434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.413444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.413457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:08.413474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256173097736948:2680]
2025-10-01T14:13:08.413477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256173097736948:2680]
2025-10-01T14:13:08.413479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256173097736948:2680]
2025-10-01T14:13:08.413492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:08.413507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:08.413522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:08.413525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:08.413559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256173097736948:2680]
2025-10-01T14:13:08.413562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:08.418012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1876
2025-10-01T14:13:08.418062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1876
2025-10-01T14:13:08.417601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:08.417618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:08.417621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:08.417629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:08.417879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256175474635471:5537], now have 1 active actors on pipe
2025-10-01T14:13:08.417885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256175474635381:2446], now have 1 active actors on pipe
2025-10-01T14:13:08.421717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1877 partition: 0 MaxSeqNo: 45 sessionId: src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0
2025-10-01T14:13:08.418501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.418519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.418554Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:08.418566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:08.418573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:08.418576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:08.418596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:08.418612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:08.418633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:08.419060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.419068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.419090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:08.424448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ee57dcd-31da1f9e-ab98f166-a70f4659_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:08.427432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0] Write session: try to update token
2025-10-01T14:13:08.427453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:08.458459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256175474635600:6233]
2025-10-01T14:13:08.461416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1876, pipe: [1:7556256175474635600:6233]
2025-10-01T14:13:08.461316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256175474635600:6233], now have 1 active actors on pipe
2025-10-01T14:13:08.497681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1877 sessionId: src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:08.500700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:08.501411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.501441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.503885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:08.503890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:08.503893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:08.503895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:08.503905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256173097736948:2680]
2025-10-01T14:13:08.503911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256173097736948:2680]
2025-10-01T14:13:08.503915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256173097736948:2680]
2025-10-01T14:13:08.503974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:08.503992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:08.503998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.504001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:08.504172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:08.506430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:08.506453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:08.509128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:08.506458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:08.699362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:08.723314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.723347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.723534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.723603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.723669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.723733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.723781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.723786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.723862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.723927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.723991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.724066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.724112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.724115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.724182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.724238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.724297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.724358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.724402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.724405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.724477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.724540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.724599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.724675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.724718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.724720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.724785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.724839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.724898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.724960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.725006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.725009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.725076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.725133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.725195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.725260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.725304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.725312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.725382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.725445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.725503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.725563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.725607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.725613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.725682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.725741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.725802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.725867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.725915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.725919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.725992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.726053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.726116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.726178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.726224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.726330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.726422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:08.726492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:08.726556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:08.726613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:08.726656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:08.726659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:08.729832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:08.734493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:08.734511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0] Write session will restart in 0.008655s
2025-10-01T14:13:08.734540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0] Write session: Do CDS request
2025-10-01T14:13:08.734547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:08.730328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256175474635600:6233]
2025-10-01T14:13:08.730384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:08.730387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:08.730421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1877 reason: error at write: Disconnected sessionId: src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0
2025-10-01T14:13:08.730462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:08.730629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1877 sessionId: src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0 is DEAD
2025-10-01T14:13:08.747215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:08.747232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1878
2025-10-01T14:13:08.747348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:08.747555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:08.747590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:08.747596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:08.747600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:08.754774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1878 sessionId:  describe result for acl check
2025-10-01T14:13:08.754824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:08.754825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:08.754827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:08.754833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256175474635659:5522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:08.755526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256175474635659:5522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:08.780125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256175474635659:5522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:08.790957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256175474635659:5522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:08.790977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256175474635659:5522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:08.790981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256175474635659:5522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:08.790991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:08.807439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:08.812302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:08.812566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:08.812571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:08.812582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:08.812657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:08.812703Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256173097737177:2675]
2025-10-01T14:13:08.813316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:08.813678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:08.813716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:08.813963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:08.814006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.814007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.814009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.814010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.814011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.814012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.814012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.814013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.814014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.814015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.814016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.814017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.814018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.814019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.814023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.814030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.814032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.814035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.814038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.814041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.814043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.814045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.814048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.814051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.814053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.814055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.814057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.814059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.814064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.814068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:08.814073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.814076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:08.814079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.814082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:08.814085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.814089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:08.814093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.814096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:08.814100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.814103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:08.814107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.814110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:08.814112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.814116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:08.814120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.814123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:08.814127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.814130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.814133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.814136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.814141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.814144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.814148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.814151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:08.814153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.814157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:08.814181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:08.821095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:08.821774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:08.821779Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:08.821783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:08.821787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:08.821795Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1877 [2:7556256173097737177:2675]
2025-10-01T14:13:08.821814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:08.821834Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:08.821839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:08.821842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:08.821845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:08.821863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:08.821869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:08.821877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:08.821930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.821932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.821934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.821937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:08.821939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:08.821999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:08.822002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.822010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:08.822018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:08.822027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:08.822040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256173097737171:2675]
2025-10-01T14:13:08.822043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256173097737171:2675]
2025-10-01T14:13:08.822045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256173097737171:2675]
2025-10-01T14:13:08.822056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:08.822066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:08.822079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:08.822083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:08.822121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256173097737171:2675]
2025-10-01T14:13:08.822123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:08.822297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:08.822305Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:08.822306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:08.822310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:08.822992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256175474635842:5522], now have 1 active actors on pipe
2025-10-01T14:13:08.823001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256175474635648:2446], now have 1 active actors on pipe
2025-10-01T14:13:08.826452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1877
2025-10-01T14:13:08.826492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1877
2025-10-01T14:13:08.826656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.826675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.826715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:08.826727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:08.826733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:08.826736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:08.826750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:08.826768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:08.826786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:08.827612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.827624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.827645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:08.827819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1878 partition: 0 MaxSeqNo: 45 sessionId: src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0
2025-10-01T14:13:08.828344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85a1e6bd-ac4cc4e8-1b48e91f-1b985b7d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:08.830232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256175474635867:6233]
2025-10-01T14:13:08.830648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1877, pipe: [1:7556256175474635867:6233]
2025-10-01T14:13:08.831485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0] Write session: try to update token
2025-10-01T14:13:08.831499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:08.830897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256175474635867:6233], now have 1 active actors on pipe
2025-10-01T14:13:08.861173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1878 sessionId: src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:08.864211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:08.866613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:08.866643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:08.866687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:08.866858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:08.888989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:08.889011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:08.889014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:08.889015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:08.889026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256173097737171:2675]
2025-10-01T14:13:08.889031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256173097737171:2675]
2025-10-01T14:13:08.889036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256173097737171:2675]
2025-10-01T14:13:08.889084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:08.889092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:08.889095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:08.889256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:08.890536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:08.890550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:08.890554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:09.153868Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:09.163185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.163218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.163408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.163471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.163536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.163605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.163650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.163655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.163730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.163792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.163855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.163922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.163964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.163967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.164040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.164101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.164167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.164229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.164270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.164273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.164339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.164397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.164459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.164521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.164570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.164573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.164655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.164711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.164773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.164836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.164876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.164879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.164949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.165010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.165078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.165148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.165194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.165197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.165268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.165329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.165390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.165455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.165502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.165506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.165579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.165639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.165696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.165760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.165805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.165808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.165880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.165941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.166006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.166071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.166115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.166118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.166196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.166258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.166321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.166401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.166444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.166447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.167181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256175474635867:6233]
2025-10-01T14:13:09.167240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:09.167242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:09.167276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1878 reason: error at write: Disconnected sessionId: src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0
2025-10-01T14:13:09.167488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1878 sessionId: src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0 is DEAD
2025-10-01T14:13:09.167670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:09.167978Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:09.170858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:09.170869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0] Write session will restart in 0.008090s
2025-10-01T14:13:09.170897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0] Write session: Do CDS request
2025-10-01T14:13:09.170904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:09.182893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:09.186548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:09.186568Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1879
2025-10-01T14:13:09.186720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:09.186749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:09.186755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:09.186760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:09.187292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1879 sessionId:  describe result for acl check
2025-10-01T14:13:09.187323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:09.187325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:09.187327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:09.187332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256179769603208:5516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:09.187890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256179769603208:5516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:09.197783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256179769603208:5516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:09.207698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256179769603208:5516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:09.207717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256179769603208:5516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:09.207721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256179769603208:5516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:09.207730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:09.220977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:09.234977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:09.235243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:09.235247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:09.235258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:09.235304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:09.235347Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256177392704729:2653]
2025-10-01T14:13:09.236103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:09.242646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:09.242740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:09.243290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:09.243350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.243352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.243353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.243354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.243356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.243358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.243360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.243361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.243363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.243364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.243366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.243368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.243370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.243371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.243378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.243388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.243404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.243408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.243412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.243416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.243420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.243424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.243428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.243432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.243436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.243440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.243444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.243448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.243455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.243463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.243470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.243475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.243480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.243486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.243491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.243496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.243503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.243508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.243512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.243518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.243523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.243529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.243534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.243539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.243546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.243551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.243557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.243563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.243568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.243573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.243578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.243583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.243589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.243594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.243600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.243606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.243649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:09.254001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:09.254839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:09.254856Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:09.254859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:09.254862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:09.254871Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1878 [2:7556256177392704729:2653]
2025-10-01T14:13:09.254886Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:09.254905Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:09.254908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:09.254912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:09.254915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:09.254936Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:09.254941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:09.254947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:09.255013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.255022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.255024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.255027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:09.255030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:09.255107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:09.255110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.255123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.255133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.255147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:09.255165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256177392704723:2653]
2025-10-01T14:13:09.255168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256177392704723:2653]
2025-10-01T14:13:09.255171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256177392704723:2653]
2025-10-01T14:13:09.255180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:09.255188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:09.255191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:09.255194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:09.255197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603174:2446], now have 1 active actors on pipe
2025-10-01T14:13:09.255203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:09.255216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:09.255219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:09.255225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603366:5516], now have 1 active actors on pipe
2025-10-01T14:13:09.255263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256177392704723:2653]
2025-10-01T14:13:09.255272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:09.255277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:09.260387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.260408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.260446Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:09.260457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:09.260462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:09.260468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:09.260483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:09.260500Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:09.260528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:09.258983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1878
2025-10-01T14:13:09.259031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1878
2025-10-01T14:13:09.263965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.263985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.264024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:09.264798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7afcdf1d-1793244d-c19db6e1-518ba4f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:09.264392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1879 partition: 0 MaxSeqNo: 45 sessionId: src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0
2025-10-01T14:13:09.267902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0] Write session: try to update token
2025-10-01T14:13:09.267925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:09.270419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256179769603391:6233]
2025-10-01T14:13:09.270926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1878, pipe: [1:7556256179769603391:6233]
2025-10-01T14:13:09.270832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603391:6233], now have 1 active actors on pipe
2025-10-01T14:13:09.289087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1879 sessionId: src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:09.292813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:09.294435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.294469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.294509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:09.294682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:09.313583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:09.313610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:09.313613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:09.313616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:09.313626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256177392704723:2653]
2025-10-01T14:13:09.313630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256177392704723:2653]
2025-10-01T14:13:09.313634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256177392704723:2653]
2025-10-01T14:13:09.313687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:09.313695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.313698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:09.313853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:09.314519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:09.314525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:09.314530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:09.483102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:09.492312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.492338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.492508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.492573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.492653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.492715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.492954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.492958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.493031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.493093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.493156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.493224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.493263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.493266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.493333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.493390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.493446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.493502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.493543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.493545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.493609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.493667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.493729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.493786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.493826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.493828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.493892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.493949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.494007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.494063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.494104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.494106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.494170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.494228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.494291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.494357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.494575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.494586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.494651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.494710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.494770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.494827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.494867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.494869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.494931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.494987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.495044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.495103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.495146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.495148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.495217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.495277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.495337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.495399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.495441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.495444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.495513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:09.495573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:09.495630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:09.495692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:09.495739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:09.495742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:09.498769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:09.500151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:09.500160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0] Write session will restart in 0.005479s
2025-10-01T14:13:09.500184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0] Write session: Do CDS request
2025-10-01T14:13:09.500189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:09.499031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256179769603391:6233]
2025-10-01T14:13:09.499062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:09.499100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:09.499107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:09.499148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1879 reason: error at write: Disconnected sessionId: src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0
2025-10-01T14:13:09.499338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1879 sessionId: src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0 is DEAD
2025-10-01T14:13:09.507350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:09.507665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:09.507686Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1880
2025-10-01T14:13:09.508559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:09.508600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:09.508627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:09.508632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:09.509098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1880 sessionId:  describe result for acl check
2025-10-01T14:13:09.509132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:09.509134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:09.509136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:09.509142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256179769603426:5505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:09.509631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256179769603426:5505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:09.518381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256179769603426:5505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:09.531418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256179769603426:5505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:09.531445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256179769603426:5505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:09.531449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256179769603426:5505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:09.531459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:09.574778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:09.578925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:09.579151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:09.579155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:09.579165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:09.579211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:09.579255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256177392704943:2650]
2025-10-01T14:13:09.579837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:09.581594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:09.581651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:09.581995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:09.582055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.582056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.582057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.582059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.582060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.582061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.582062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.582063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.582065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.582066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.582067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.582068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.582069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.582070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.582076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.582085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.582088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.582092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.582096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.582111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.582114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.582118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.582121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.582124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.582127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.582130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.582134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.582137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.582144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.582151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.582157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.582161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.582165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.582170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.582174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.582178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.582183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.582187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.582191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.582195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.582200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.582204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.582208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.582212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.582217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.582222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.582226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.582230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.582235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.582239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.582244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.582249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.582255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.582259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.582263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.582267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.582301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:09.588148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:09.588797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:09.588811Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:09.588814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:09.588817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:09.588825Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1879 [2:7556256177392704943:2650]
2025-10-01T14:13:09.588840Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:09.588855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:09.588858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:09.588861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:09.588863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:09.588879Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:09.588884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:09.588889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:09.588940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.588942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.588944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.588947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:09.588949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:09.589015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:09.589017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.589027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.589036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.589049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:09.589064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256177392704937:2650]
2025-10-01T14:13:09.589067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256177392704937:2650]
2025-10-01T14:13:09.589068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256177392704937:2650]
2025-10-01T14:13:09.589079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:09.589091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:09.589102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:09.589105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:09.589137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256177392704937:2650]
2025-10-01T14:13:09.589144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:09.589339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:09.589340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:09.589342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:09.589346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:09.589585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603419:2446], now have 1 active actors on pipe
2025-10-01T14:13:09.589589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603468:5505], now have 1 active actors on pipe
2025-10-01T14:13:09.589938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.589944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.589971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:09.589994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:09.589998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:09.590001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:09.590010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:09.590020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:09.590034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:09.590457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.590471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.590498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:09.589755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1879
2025-10-01T14:13:09.589797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1879
2025-10-01T14:13:09.591066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5daba0a3-a6b42ea-a4bf3db3-fa02ff14_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:09.593622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0] Write session: try to update token
2025-10-01T14:13:09.593639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:09.590698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1880 partition: 0 MaxSeqNo: 45 sessionId: src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0
2025-10-01T14:13:09.600452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256179769603650:6233]
2025-10-01T14:13:09.601032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1879, pipe: [1:7556256179769603650:6233]
2025-10-01T14:13:09.601120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603650:6233], now have 1 active actors on pipe
2025-10-01T14:13:09.612225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1880 sessionId: src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:09.613827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:09.613858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:09.613861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:09.613862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:09.613872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256177392704937:2650]
2025-10-01T14:13:09.613878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256177392704937:2650]
2025-10-01T14:13:09.613882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256177392704937:2650]
2025-10-01T14:13:09.613925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:09.613934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.613936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:09.614062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:09.614167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:09.614188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:09.614194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:09.614591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:09.763796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:09.764033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.764046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.764275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:09.764294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:09.764342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:09.764421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1880 reason: status is not ok: tablet will be restarted right now sessionId: src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0
2025-10-01T14:13:09.764625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1880 sessionId: src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0 is DEAD
2025-10-01T14:13:09.764746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:09.764754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0] Write session will restart in 0.006523s
2025-10-01T14:13:09.764774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0] Write session: Do CDS request
2025-10-01T14:13:09.764778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:09.764885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256179769603650:6233]
2025-10-01T14:13:09.772906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:09.772978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:09.772991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1881
2025-10-01T14:13:09.773123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:09.773152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:09.773161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:09.773164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:09.773512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1881 sessionId:  describe result for acl check
2025-10-01T14:13:09.773540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:09.773545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:09.773547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:09.773550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256179769603793:5492] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:09.773943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256179769603793:5492] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:09.775596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256179769603793:5492] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:09.775587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:09.777296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:09.777502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:09.777512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:09.777522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:09.777549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256179769603793:5492] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:09.777557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:09.777558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256179769603793:5492] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:09.777559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256179769603793:5492] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:09.777564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:09.777590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256177392705166:2640]
2025-10-01T14:13:09.778166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:09.778393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:09.778425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:09.778700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:09.778740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.778745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.778746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.778747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.778748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.778749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.778750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.778751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.778751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.778752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.778753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.778754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.778755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.778756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.778760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.778768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.778772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.778775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.778778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.778781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.778785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.778788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.778791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.778794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.778797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.778800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.778803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.778807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.778812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.778818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.778823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.778828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.778831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.778836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.778840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.778844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.778847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.778852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.778856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.778860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.778864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.778869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.778873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.778881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.778885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.778890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.778898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.778902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.778906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.778914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.778918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.778922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.778931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.778935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.778943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.778947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.778981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:09.782272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:09.783039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:09.783053Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:09.783055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:09.783058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:09.783065Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1880 [2:7556256177392705166:2640]
2025-10-01T14:13:09.783080Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:09.783097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:09.783102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:09.783109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:09.783111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:09.783124Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:09.783132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:09.783141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:09.783188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.783194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.783196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.783199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:09.783201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:09.783258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:09.783264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.783274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.783283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.783301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:09.783321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603874:5492], now have 1 active actors on pipe
2025-10-01T14:13:09.783328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603664:2446], now have 1 active actors on pipe
2025-10-01T14:13:09.783334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256177392705160:2640]
2025-10-01T14:13:09.783340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256177392705160:2640]
2025-10-01T14:13:09.783342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256177392705160:2640]
2025-10-01T14:13:09.783353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:09.783365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:09.783371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:09.783374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:09.783376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:09.783382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:09.783384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:09.783376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1880
2025-10-01T14:13:09.783404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256177392705160:2640]
2025-10-01T14:13:09.783384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1880
2025-10-01T14:13:09.783410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:09.783412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:09.783425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.783433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.783471Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:09.783481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:09.783488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:09.783492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:09.783500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:09.783510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:09.783524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:09.783655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.783663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.783676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:09.783743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1881 partition: 0 MaxSeqNo: 45 sessionId: src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0
2025-10-01T14:13:09.784066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47a23e22-55c8d357-5bd970ba-126fa4f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:09.786316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0] Write session: try to update token
2025-10-01T14:13:09.786330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:09.799552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1881 sessionId: src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:09.801681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:09.803246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.803270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.803285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:09.803288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:09.803290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:09.803292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:09.803299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256177392705160:2640]
2025-10-01T14:13:09.803304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256177392705160:2640]
2025-10-01T14:13:09.803307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256177392705160:2640]
2025-10-01T14:13:09.803357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:09.803360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:09.803366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:09.803367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.803369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:09.803370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:09.803490Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:09.864984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256179769603886:6233]
2025-10-01T14:13:09.865221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1880, pipe: [1:7556256179769603886:6233]
2025-10-01T14:13:09.957547Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:09.957884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:09.957935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603886:6233], now have 1 active actors on pipe
2025-10-01T14:13:09.958006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:09.958059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256179769603886:6233]
2025-10-01T14:13:09.958079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:09.958082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:09.958083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:09.958150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1881 reason: error at write: Disconnected sessionId: src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0
2025-10-01T14:13:09.958327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1881 sessionId: src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0 is DEAD
2025-10-01T14:13:09.958445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:09.958456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0] Write session will restart in 0.007505s
2025-10-01T14:13:09.958478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0] Write session: Do CDS request
2025-10-01T14:13:09.958486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:09.966873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:09.966967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:09.966981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1882
2025-10-01T14:13:09.967092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:09.967115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:09.967119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:09.967121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:09.967467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1882 sessionId:  describe result for acl check
2025-10-01T14:13:09.967503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:09.967508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:09.967510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:09.967515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256179769603971:5486] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:09.967918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256179769603971:5486] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:09.969882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256179769603971:5486] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:09.971670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:09.972073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256179769603971:5486] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:09.972086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256179769603971:5486] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:09.972093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256179769603971:5486] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:09.972100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:09.973996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:09.974177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:09.974185Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:09.974206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:09.974241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:09.974272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256177392705410:2610]
2025-10-01T14:13:09.974896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:09.975144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:09.975180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:09.975464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:09.975507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.975512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.975513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.975514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.975515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.975516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.975517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.975518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.975519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.975520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.975521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.975522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.975523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.975524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.975528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.975537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.975541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.975544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.975547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.975551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.975554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.975557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.975560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.975563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.975567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.975570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.975573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.975576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.975582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.975589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:09.975594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.975599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:09.975603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.975608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:09.975611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.975615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:09.975620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.975624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:09.975629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.975633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:09.975637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.975646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:09.975654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.975658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:09.975662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.975671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:09.975679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.975684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.975691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.975695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.975703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.975707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.975718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.975722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:09.975726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.975730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:09.975769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:09.979280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:09.979971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:09.979985Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:09.979986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:09.979990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:09.979996Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1881 [2:7556256177392705410:2610]
2025-10-01T14:13:09.980011Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:09.980030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:09.980037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:09.980040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:09.980042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:09.980054Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:09.980063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:09.980069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:09.980120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.980126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.980128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.980132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:09.980134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:09.980191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:09.980198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:09.980208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:09.980218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:09.980236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:09.980256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769604101:5486], now have 1 active actors on pipe
2025-10-01T14:13:09.980263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256179769603893:2446], now have 1 active actors on pipe
2025-10-01T14:13:09.980270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256177392705404:2610]
2025-10-01T14:13:09.980276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256177392705404:2610]
2025-10-01T14:13:09.980277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256177392705404:2610]
2025-10-01T14:13:09.980289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:09.980298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:09.980300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:09.980302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:09.980304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:09.980317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:09.980323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:09.980297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1881
2025-10-01T14:13:09.980319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1881
2025-10-01T14:13:09.980355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.980363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.980375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256177392705404:2610]
2025-10-01T14:13:09.980384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:09.980390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:09.980411Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d645352d-403c2ab6-9a42273f-45269abb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:09.980420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:09.980428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:09.980430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:09.980438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:09.980449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:09.980473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:09.980580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:09.980587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:09.980599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:09.980667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1882 partition: 0 MaxSeqNo: 45 sessionId: src_id|d645352d-403c2ab6-9a42273f-45269abb_0
2025-10-01T14:13:09.981108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da81c3c4-64f75737-d4a6d3ea-6b4ec105_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d645352d-403c2ab6-9a42273f-45269abb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:09.983446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d645352d-403c2ab6-9a42273f-45269abb_0] Write session: try to update token
2025-10-01T14:13:09.983462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d645352d-403c2ab6-9a42273f-45269abb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:09.996201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1882 sessionId: src_id|d645352d-403c2ab6-9a42273f-45269abb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:09.998502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:10.000044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.000078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.000100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:10.000103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:10.000107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:10.000108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:10.000118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256177392705404:2610]
2025-10-01T14:13:10.000122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256177392705404:2610]
2025-10-01T14:13:10.000126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256177392705404:2610]
2025-10-01T14:13:10.000187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:10.000200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.000203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:10.000210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:10.000215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:10.000219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:10.000357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:10.058024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256184064571409:6233]
2025-10-01T14:13:10.058643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1881, pipe: [1:7556256184064571409:6233]
2025-10-01T14:13:10.206675Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:10.207286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:10.207339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064571409:6233], now have 1 active actors on pipe
2025-10-01T14:13:10.207448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:10.216187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256184064571409:6233]
2025-10-01T14:13:10.216221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:10.223214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:10.223229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:10.223258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1882 reason: error at write: Disconnected sessionId: src_id|d645352d-403c2ab6-9a42273f-45269abb_0
2025-10-01T14:13:10.223436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1882 sessionId: src_id|d645352d-403c2ab6-9a42273f-45269abb_0 is DEAD
2025-10-01T14:13:10.230849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645352d-403c2ab6-9a42273f-45269abb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:10.230869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645352d-403c2ab6-9a42273f-45269abb_0] Write session will restart in 0.009696s
2025-10-01T14:13:10.230899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645352d-403c2ab6-9a42273f-45269abb_0] Write session: Do CDS request
2025-10-01T14:13:10.230907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645352d-403c2ab6-9a42273f-45269abb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:10.243257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d645352d-403c2ab6-9a42273f-45269abb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:10.243637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:10.243660Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1883
2025-10-01T14:13:10.247665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:10.247721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:10.247727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:10.247732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:10.251322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1883 sessionId:  describe result for acl check
2025-10-01T14:13:10.251368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:10.251371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:10.251376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:10.251383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256184064571427:5480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:10.251999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256184064571427:5480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:10.259126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256184064571427:5480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:10.267676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256184064571427:5480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:10.267696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256184064571427:5480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:10.267702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256184064571427:5480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:10.267712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:10.272084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:10.275208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:10.275692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:10.275710Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:10.275725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:10.275792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:10.275845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256181687672937:2606]
2025-10-01T14:13:10.276635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:10.276934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:10.276984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:10.277346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:10.277397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.277398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.277399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.277401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.277402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.277403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.277405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.277406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.277407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.277408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.277410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.277411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.277413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.277414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.277419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.277432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.277436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.277441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.277445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.277449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.277453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.277457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.277461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.277465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.277469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.277474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.277479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.277483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.277492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.277500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.277506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.277513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.277518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.277523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.277528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.277534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.277539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.277545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.277549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.277554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.277559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.277564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.277570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.277575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.277581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.277587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.277592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.277597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.277602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.277607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.277612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.277618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.277623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.277628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.277633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.277639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.277683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:10.281787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:10.282635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:10.282655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:10.282658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:10.282661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:10.282668Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1882 [2:7556256181687672937:2606]
2025-10-01T14:13:10.282688Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:10.282711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:10.282719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:10.282723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:10.282726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:10.282742Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:10.282749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:10.282755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:10.282821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.282828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.282830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.282834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:10.282837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:10.282909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:10.282916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.282927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.282939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.282956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:10.282974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064571576:5480], now have 1 active actors on pipe
2025-10-01T14:13:10.282978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064571414:2446], now have 1 active actors on pipe
2025-10-01T14:13:10.282985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256181687672932:2606]
2025-10-01T14:13:10.282987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256181687672932:2606]
2025-10-01T14:13:10.282989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256181687672932:2606]
2025-10-01T14:13:10.283003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:10.283017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:10.283031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:10.283034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:10.283063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256181687672932:2606]
2025-10-01T14:13:10.283065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:10.283110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:10.283113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:10.283115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:10.283121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:10.283388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.283394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.283420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:10.283427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:10.283432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:10.283434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:10.283444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:10.283454Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:10.283468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:10.283193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1882
2025-10-01T14:13:10.283222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1882
2025-10-01T14:13:10.283717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.283726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.283741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:10.284809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d645352d-403c2ab6-9a42273f-45269abb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:10.283872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1883 partition: 0 MaxSeqNo: 45 sessionId: src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0
2025-10-01T14:13:10.287939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0] Write session: try to update token
2025-10-01T14:13:10.287959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:10.302548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:10.302572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:10.302582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256181687672932:2606]
2025-10-01T14:13:10.302630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:10.302637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:10.302818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:10.302977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:10.303127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:10.303274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:10.303485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:10.303532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:10.307309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1883 sessionId: src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:10.310215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:10.311042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.311066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.311103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:10.311219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:10.315583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256184064571634:6233]
2025-10-01T14:13:10.315817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1882, pipe: [1:7556256184064571634:6233]
2025-10-01T14:13:10.316653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064571634:6233], now have 1 active actors on pipe
2025-10-01T14:13:10.316677Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:10.316680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:10.316682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:10.316684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:10.316690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256181687672932:2606]
2025-10-01T14:13:10.316693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256181687672932:2606]
2025-10-01T14:13:10.316696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256181687672932:2606]
2025-10-01T14:13:10.316733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:10.316738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.316742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:10.316755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:10.316771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:10.316776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:10.316867Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:10.462871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:10.472432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.472462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.472605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.472678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.472745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.472810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.473557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.473572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.473641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.473699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.473757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.473827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.473878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.473888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.473963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.474027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.474090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.474165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.474212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.474220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.474299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.474391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.474458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.474525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.474572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.474578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.474648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.474715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.474782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.474857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.474905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.474911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.474984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.475050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.475130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.475231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.475283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.475289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.475363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.475429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.475500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.475567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.475617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.475624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.475696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.475758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.475830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.475898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.475945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.475953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.476018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.476077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.476140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.476205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.476253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.476259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.476329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.476391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.476454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.476513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.476561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.476568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.476944Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:10.476869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256184064571634:6233]
2025-10-01T14:13:10.476896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:10.476898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:10.476901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:10.476942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1883 reason: error at write: Disconnected sessionId: src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0
2025-10-01T14:13:10.477173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1883 sessionId: src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0 is DEAD
2025-10-01T14:13:10.478585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:10.478596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0] Write session will restart in 0.008269s
2025-10-01T14:13:10.478624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0] Write session: Do CDS request
2025-10-01T14:13:10.478632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:10.487954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:10.488092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:10.488113Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1884
2025-10-01T14:13:10.488238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:10.488276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:10.488286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:10.488290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:10.488965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1884 sessionId:  describe result for acl check
2025-10-01T14:13:10.489010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:10.489021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:10.489023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:10.489029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256184064571739:5472] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:10.489645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256184064571739:5472] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:10.496679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256184064571739:5472] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:10.499097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256184064571739:5472] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:10.499126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256184064571739:5472] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:10.499129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256184064571739:5472] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:10.499137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:10.500049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:10.502391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:10.502571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:10.502580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:10.502589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:10.502624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:10.502657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256181687673153:2602]
2025-10-01T14:13:10.503057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:10.503270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:10.503297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:10.503506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:10.503548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.503554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.503555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.503556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.503557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.503559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.503560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.503561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.503562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.503563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.503564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.503565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.503566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.503567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.503571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.503580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.503584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.503588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.503593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.503597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.503600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.503603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.503607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.503613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.503617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.503620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.503624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.503628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.503636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.503643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.503649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.503655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.503661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.503666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.503671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.503677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.503684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.503691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.503698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.503705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.503713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.503721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.503730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.503737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.503745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.503750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.503757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.503762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.503767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.503773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.503778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.503787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.503792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.503800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.503804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.503809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.503846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:10.507868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:10.508932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:10.508945Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:10.508947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:10.508950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:10.508957Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1883 [2:7556256181687673153:2602]
2025-10-01T14:13:10.508977Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:10.508997Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:10.509003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:10.509007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:10.509010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:10.509026Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:10.509036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:10.509042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:10.509105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.509114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.509116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.509120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:10.509123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:10.509192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:10.509202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.509213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.509223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.509240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:10.509267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064571869:5472], now have 1 active actors on pipe
2025-10-01T14:13:10.509274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064571654:2446], now have 1 active actors on pipe
2025-10-01T14:13:10.509281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256181687673148:2602]
2025-10-01T14:13:10.509283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256181687673148:2602]
2025-10-01T14:13:10.509286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256181687673148:2602]
2025-10-01T14:13:10.509299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:10.509309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:10.509312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:10.509315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:10.509317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:10.509330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:10.509337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:10.509366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256181687673148:2602]
2025-10-01T14:13:10.509380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:10.509364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1883
2025-10-01T14:13:10.509399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:10.509383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1883
2025-10-01T14:13:10.509420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.509425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.509448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a48e121-7027a413-5f9793f8-91b19b32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:10.509460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:10.509465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:10.509467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:10.509477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:10.509489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:10.509506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:10.509657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.509664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.509739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1884 partition: 0 MaxSeqNo: 45 sessionId: src_id|8a48e121-7027a413-5f9793f8-91b19b32_0
2025-10-01T14:13:10.509678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:10.510156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1c3b32f-e110c38b-994796e6-a3ed3a06_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8a48e121-7027a413-5f9793f8-91b19b32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:10.512846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a48e121-7027a413-5f9793f8-91b19b32_0] Write session: try to update token
2025-10-01T14:13:10.512864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a48e121-7027a413-5f9793f8-91b19b32_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:10.522154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:10.522175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:10.522187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256181687673148:2602]
2025-10-01T14:13:10.522231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:10.522236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:10.522449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:10.522642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:10.522802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:10.522974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:10.523201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:10.523250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:10.529693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1884 sessionId: src_id|8a48e121-7027a413-5f9793f8-91b19b32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:10.532344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:10.532585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.532613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.532676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:10.532811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:10.570213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.570242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.570439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.570495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.570557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.570617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.570658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.570663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.570733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.570787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.570850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.570916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.571364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.571374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.571437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.571490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.571547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.571607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.571647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.571650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.571712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.571769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.571829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.571887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.571926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.571928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.571991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.572046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.572100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.572154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.572193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.572198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.572267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.572324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.572383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.572446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.572489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.572491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.572562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.572630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.572695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.572752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.572793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.572795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.572864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.572920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.572979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.573035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.573077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.573079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.573145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.573201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.573261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.573323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.573372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.573376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.573443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:10.573500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:10.573558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:10.573619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:10.573698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:10.573703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:10.573781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:10.573787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:10.573790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:10.573793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:10.573803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256181687673148:2602]
2025-10-01T14:13:10.573806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256181687673148:2602]
2025-10-01T14:13:10.573810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256181687673148:2602]
2025-10-01T14:13:10.573873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:13:10.573943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:10.573963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:10.573965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:13:10.573991Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574001Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574005Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574008Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574014Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574019Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574025Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574028Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574031Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574035Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574040Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574044Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574048Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574051Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574055Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574058Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574065Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574069Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574073Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574077Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574452Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574457Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574460Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574466Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574469Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574656Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574659Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574663Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574667Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574671Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574674Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574679Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574684Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574687Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574691Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:10.574804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:13:10.574827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:13:10.574830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:13:10.574833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:13:10.574836Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:13:10.574842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:10.574850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:10.574854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:10.575228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:13:10.575251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:13:10.575256Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:13:10.577442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256184064571882:6233]
2025-10-01T14:13:10.575260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:13:10.575263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:13:10.575266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:13:10.575830Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:13:10.575841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:13:10.575845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:13:10.575849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:13:10.575852Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:13:10.575856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:13:10.576317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:13:10.576326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:10.576434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759327990576
2025-10-01T14:13:10.577243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:10.577248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.577251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:10.577394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:10.582781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1883, pipe: [1:7556256184064571882:6233]
2025-10-01T14:13:10.743396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:10.743770Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:13:10.743804Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:13:10.743825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064571882:6233], now have 1 active actors on pipe
2025-10-01T14:13:10.744649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:10.744995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:10.745050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1884 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8a48e121-7027a413-5f9793f8-91b19b32_0
2025-10-01T14:13:10.745309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1884 sessionId: src_id|8a48e121-7027a413-5f9793f8-91b19b32_0 is DEAD
2025-10-01T14:13:10.745420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a48e121-7027a413-5f9793f8-91b19b32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:10.745428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a48e121-7027a413-5f9793f8-91b19b32_0] Write session will restart in 0.008717s
2025-10-01T14:13:10.745451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a48e121-7027a413-5f9793f8-91b19b32_0] Write session: Do CDS request
2025-10-01T14:13:10.745457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a48e121-7027a413-5f9793f8-91b19b32_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:10.745493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:10.745540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256184064571882:6233]
2025-10-01T14:13:10.754878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a48e121-7027a413-5f9793f8-91b19b32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:10.754927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:10.754942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1885
2025-10-01T14:13:10.755115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:10.755140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:10.755147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:10.755150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:10.755494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1885 sessionId:  describe result for acl check
2025-10-01T14:13:10.755529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:10.755533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:10.755534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:10.755538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256184064571926:5451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:10.755974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256184064571926:5451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:10.758254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256184064571926:5451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:10.761939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256184064571926:5451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:10.761955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256184064571926:5451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:10.761959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256184064571926:5451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:10.761968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:10.766808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:10.767732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:10.767950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:10.767955Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:10.767985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:10.768031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:10.768080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256181687673381:2584]
2025-10-01T14:13:10.768757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:10.770276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:10.770353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:10.770780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:10.770870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.770877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.770878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.770879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.770881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.770882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.770883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.770884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.770886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.770887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.770888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.770890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.770891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.770892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.770899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.770907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.770910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.770912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.770914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.770916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.770919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.770921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.770923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.770925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.770927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.770929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.770931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.770933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.770942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.770947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.770952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.770955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.770958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.770961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.770963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.770967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.770970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.770973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.770975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.770979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.770983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.770988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.770992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.770997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.771002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.771007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.771012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.771019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.771024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.771029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.771034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.771039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.771044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.771051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.771062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.771067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.771111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:10.778986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:10.779898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:10.779904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:10.779908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:10.779912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:10.779921Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1884 [2:7556256181687673381:2584]
2025-10-01T14:13:10.779945Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:10.779965Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:10.779970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:10.779974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:10.779977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:10.779999Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:10.780005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:10.780013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:10.780093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.780097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.780099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.780102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:10.780105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:10.780200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:10.780203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.780218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.780231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.780247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:10.780269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256181687673375:2584]
2025-10-01T14:13:10.780272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256181687673375:2584]
2025-10-01T14:13:10.780273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256181687673375:2584]
2025-10-01T14:13:10.780299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:10.780314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:10.780330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:10.780334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:10.780335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:10.780340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:10.780343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:10.780383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256181687673375:2584]
2025-10-01T14:13:10.780387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:10.780443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:10.780558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064572081:5451], now have 1 active actors on pipe
2025-10-01T14:13:10.780568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064571910:2446], now have 1 active actors on pipe
2025-10-01T14:13:10.780635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1884
2025-10-01T14:13:10.780639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1884
2025-10-01T14:13:10.780728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.780747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.780779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|300f63fa-fd417280-fea441e0-97a3cf51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:10.780792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:10.780802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:10.780805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:10.780818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:10.780834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:10.780856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:10.781019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.781032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.781047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:10.781178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1885 partition: 0 MaxSeqNo: 45 sessionId: src_id|300f63fa-fd417280-fea441e0-97a3cf51_0
2025-10-01T14:13:10.784965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a48e121-7027a413-5f9793f8-91b19b32_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|300f63fa-fd417280-fea441e0-97a3cf51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:10.788089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|300f63fa-fd417280-fea441e0-97a3cf51_0] Write session: try to update token
2025-10-01T14:13:10.788112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|300f63fa-fd417280-fea441e0-97a3cf51_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:10.804900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1885 sessionId: src_id|300f63fa-fd417280-fea441e0-97a3cf51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:10.806075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:10.806101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:10.806104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:10.806106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:10.806114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256181687673375:2584]
2025-10-01T14:13:10.806118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256181687673375:2584]
2025-10-01T14:13:10.806124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256181687673375:2584]
2025-10-01T14:13:10.806175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:10.806177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:10.806185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.806187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:10.806191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:10.806197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:10.806337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:10.807588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:10.846497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256184064572134:6233]
2025-10-01T14:13:10.846831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1884, pipe: [1:7556256184064572134:6233]
2025-10-01T14:13:10.962781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:10.963227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.963245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.963288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064572134:6233], now have 1 active actors on pipe
2025-10-01T14:13:10.963490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:10.963484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:10.963525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:10.963527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:10.963584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1885 reason: error at write: Disconnected sessionId: src_id|300f63fa-fd417280-fea441e0-97a3cf51_0
2025-10-01T14:13:10.963778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1885 sessionId: src_id|300f63fa-fd417280-fea441e0-97a3cf51_0 is DEAD
2025-10-01T14:13:10.963954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256184064572134:6233]
2025-10-01T14:13:10.964464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f63fa-fd417280-fea441e0-97a3cf51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:10.964475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f63fa-fd417280-fea441e0-97a3cf51_0] Write session will restart in 0.009971s
2025-10-01T14:13:10.964524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f63fa-fd417280-fea441e0-97a3cf51_0] Write session: Do CDS request
2025-10-01T14:13:10.964530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f63fa-fd417280-fea441e0-97a3cf51_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:10.975994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|300f63fa-fd417280-fea441e0-97a3cf51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:10.976079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:10.976093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1886
2025-10-01T14:13:10.976243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:10.976267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:10.976274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:10.976277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:10.976757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1886 sessionId:  describe result for acl check
2025-10-01T14:13:10.976789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:10.976790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:10.976791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:10.976795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256184064572317:5448] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:10.977184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256184064572317:5448] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:10.978385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:10.978658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256184064572317:5448] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:10.980857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:10.981066Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:10.981080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:10.981093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:10.981141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:10.981181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256181687673611:2565]
2025-10-01T14:13:10.981254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256184064572317:5448] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:10.981266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256184064572317:5448] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:10.981269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256184064572317:5448] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:10.981275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:10.981772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:10.982028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:10.982073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:10.982384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:10.982449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.982455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.982457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.982458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.982459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.982460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.982461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.982462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.982463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.982464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.982465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.982466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.982467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.982468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.982473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.982483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.982487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.982491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.982495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.982498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.982502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.982506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.982509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.982514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.982517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.982521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.982525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.982529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.982536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.982546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:10.982553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.982558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:10.982562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.982566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:10.982570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.982575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:10.982580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.982585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:10.982589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.982594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:10.982604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.982609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:10.982615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.982620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:10.982628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.982633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:10.982642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.982651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.982656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.982661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.982665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.982670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.982679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.982688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:10.982695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.982700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:10.982741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:10.986363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:10.986999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:10.987015Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:10.987017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:10.987021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:10.987029Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1885 [2:7556256181687673611:2565]
2025-10-01T14:13:10.987049Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:10.987069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:10.987077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:10.987080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:10.987086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:10.987103Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:10.987112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:10.987124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:10.987182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.987189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.987191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.987194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:10.987197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:10.987270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:10.987276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:10.987287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:10.987302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:10.987321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:10.987343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064572352:5448], now have 1 active actors on pipe
2025-10-01T14:13:10.987352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256184064572140:2446], now have 1 active actors on pipe
2025-10-01T14:13:10.987359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256181687673606:2565]
2025-10-01T14:13:10.987365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256181687673606:2565]
2025-10-01T14:13:10.987367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256181687673606:2565]
2025-10-01T14:13:10.987380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:10.987388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:10.987390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:10.987392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:10.987398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:10.987411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:10.987419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:10.987412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1885
2025-10-01T14:13:10.987449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256181687673606:2565]
2025-10-01T14:13:10.987416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1885
2025-10-01T14:13:10.987459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:10.987463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:10.987479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.987487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.987534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:10.987544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:10.987553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:10.987559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:10.987568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:10.987580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:10.987600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:10.987753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:10.987763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:10.987778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:10.987881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1886 partition: 0 MaxSeqNo: 45 sessionId: src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0
2025-10-01T14:13:10.988283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|300f63fa-fd417280-fea441e0-97a3cf51_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:10.990992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0] Write session: try to update token
2025-10-01T14:13:10.991009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:11.006331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1886 sessionId: src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:11.007095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:11.007115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:11.007116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:11.007118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:11.007124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256181687673606:2565]
2025-10-01T14:13:11.007127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256181687673606:2565]
2025-10-01T14:13:11.007130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256181687673606:2565]
2025-10-01T14:13:11.007167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:11.007169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:11.007173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.007174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:11.007175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:11.007176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:11.007298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:11.008769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:11.064117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256188359539660:6233]
2025-10-01T14:13:11.064413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1885, pipe: [1:7556256188359539660:6233]
2025-10-01T14:13:11.148521Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:11.148776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.148788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.148824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359539660:6233], now have 1 active actors on pipe
2025-10-01T14:13:11.148999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:11.149070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:11.149083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:11.149088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256188359539660:6233]
2025-10-01T14:13:11.149108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:11.149151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1886 reason: error at write: Disconnected sessionId: src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0
2025-10-01T14:13:11.149342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1886 sessionId: src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0 is DEAD
2025-10-01T14:13:11.149475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:11.149482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0] Write session will restart in 0.006912s
2025-10-01T14:13:11.149503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0] Write session: Do CDS request
2025-10-01T14:13:11.149508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:11.157940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.157964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:11.157977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1887
2025-10-01T14:13:11.158147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.158170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:11.158177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:11.158180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:11.158552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1887 sessionId:  describe result for acl check
2025-10-01T14:13:11.158580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:11.158585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:11.158586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:11.158589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256188359539761:5445] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:11.158988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256188359539761:5445] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:11.161076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256188359539761:5445] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:11.162523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:11.164948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:11.165179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:11.165193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:11.165206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:11.165262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:11.165253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256188359539761:5445] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:11.165268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256188359539761:5445] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:11.165271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256188359539761:5445] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:11.165290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:11.165316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256185982641145:2543]
2025-10-01T14:13:11.165899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:11.166186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:11.166235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:11.166549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:11.166623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.166630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.166631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.166632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.166634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.166635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.166637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.166638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.166639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.166640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.166641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.166642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.166643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.166644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.166650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.166659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.166663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.166666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.166669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.166672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.166675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.166678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.166681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.166684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.166687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.166690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.166693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.166696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.166703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.166710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.166716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.166721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.166725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.166729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.166733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.166737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.166746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.166755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.166759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.166768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.166777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.166786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.166795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.166804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.166817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.166828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.166839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.166844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.166849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.166853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.166859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.166864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.166868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.166872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.166876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.166880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.166917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:11.170576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:11.171172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:11.171187Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:11.171190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:11.171193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:11.171199Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1886 [2:7556256185982641145:2543]
2025-10-01T14:13:11.171222Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:11.171244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:11.171251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.171254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.171257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.171273Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:11.171284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:11.171288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:11.171338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.171343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.171344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.171347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:11.171349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:11.171406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:11.171415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.171426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.171435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.171449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:11.171468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359539662:2446], now have 1 active actors on pipe
2025-10-01T14:13:11.171475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359539878:5445], now have 1 active actors on pipe
2025-10-01T14:13:11.171483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256185982641140:2543]
2025-10-01T14:13:11.171485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256185982641140:2543]
2025-10-01T14:13:11.171488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256185982641140:2543]
2025-10-01T14:13:11.171502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:11.171512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:11.171519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:11.171520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:11.171522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:11.171533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:11.171541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:11.171574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256185982641140:2543]
2025-10-01T14:13:11.171581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:11.171537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1886
2025-10-01T14:13:11.171585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:11.171550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1886
2025-10-01T14:13:11.171599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.171603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.171653Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d80edb4-25410bb0-62030eeb-f066f841_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:11.171665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.171670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.171672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:11.171680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.171693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:11.171711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.171855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.171861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.171871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.171968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1887 partition: 0 MaxSeqNo: 45 sessionId: src_id|3d80edb4-25410bb0-62030eeb-f066f841_0
2025-10-01T14:13:11.172328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a0b7-cfe02ae7-519ed9b6-1af49d13_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3d80edb4-25410bb0-62030eeb-f066f841_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:11.174675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d80edb4-25410bb0-62030eeb-f066f841_0] Write session: try to update token
2025-10-01T14:13:11.174690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d80edb4-25410bb0-62030eeb-f066f841_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:11.188764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1887 sessionId: src_id|3d80edb4-25410bb0-62030eeb-f066f841_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:11.191432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:11.192729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.192755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.192776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:11.192780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:11.192783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:11.192785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:11.192794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256185982641140:2543]
2025-10-01T14:13:11.192799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256185982641140:2543]
2025-10-01T14:13:11.192803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256185982641140:2543]
2025-10-01T14:13:11.192842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:11.192857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:11.192858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:11.192861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:11.192864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.192867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:11.192993Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:11.249474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256188359539890:6233]
2025-10-01T14:13:11.249790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1886, pipe: [1:7556256188359539890:6233]
2025-10-01T14:13:11.335912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:11.336113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:11.336163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359539890:6233], now have 1 active actors on pipe
2025-10-01T14:13:11.336236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:11.336371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256188359539890:6233]
2025-10-01T14:13:11.336393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:11.347249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:11.347261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:11.347280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1887 reason: error at write: Disconnected sessionId: src_id|3d80edb4-25410bb0-62030eeb-f066f841_0
2025-10-01T14:13:11.347437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1887 sessionId: src_id|3d80edb4-25410bb0-62030eeb-f066f841_0 is DEAD
2025-10-01T14:13:11.347552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d80edb4-25410bb0-62030eeb-f066f841_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:11.347562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d80edb4-25410bb0-62030eeb-f066f841_0] Write session will restart in 0.006075s
2025-10-01T14:13:11.347581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d80edb4-25410bb0-62030eeb-f066f841_0] Write session: Do CDS request
2025-10-01T14:13:11.347586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d80edb4-25410bb0-62030eeb-f066f841_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:11.355219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:11.358166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:11.358354Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:11.358363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:11.358387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:11.358427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:11.358458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256185982641377:2551]
2025-10-01T14:13:11.358863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:11.358924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d80edb4-25410bb0-62030eeb-f066f841_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.359189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:11.359214Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:11.359241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:11.359230Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1888
2025-10-01T14:13:11.359335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.359363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:11.359369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:11.359371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:11.359504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:11.359568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.359573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.359574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.359576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.359577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.359577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.359578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.359579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.359580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.359580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.359581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.359582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.359582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.359583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.359587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.359593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.359596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.359598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.359600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.359602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.359604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.359606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.359608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.359610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.359615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.359617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.359619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.359621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.359626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.359631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.359637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.359641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.359645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.359650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.359654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.359658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.359662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.359666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.359670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.359674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.359678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.359684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.359691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.359696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.359700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.359704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.359709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.359739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1888 sessionId:  describe result for acl check
2025-10-01T14:13:11.359714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.359718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.359723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.359727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.359732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.359737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.359741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.359745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.359750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.359786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:11.359768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:11.359773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:11.359777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:11.359782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256188359540078:5440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:11.360210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256188359540078:5440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:11.363046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256188359540078:5440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:11.363464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:11.364164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:11.364179Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:11.364181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:11.364184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:11.364190Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1887 [2:7556256185982641377:2551]
2025-10-01T14:13:11.364205Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:11.364216Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:11.364218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.364221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.364222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.364235Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:11.364245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:11.364250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:11.364301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.364308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.364310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.364313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:11.364315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:11.364380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:11.364386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.364397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.364406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.364422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:11.364443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359539893:2446], now have 1 active actors on pipe
2025-10-01T14:13:11.364454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256185982641372:2551]
2025-10-01T14:13:11.364456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256185982641372:2551]
2025-10-01T14:13:11.364458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256185982641372:2551]
2025-10-01T14:13:11.364472Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:11.364487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:11.364489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:11.364502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:11.364504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:11.364507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:11.364511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:11.364500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1887
2025-10-01T14:13:11.364541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256185982641372:2551]
2025-10-01T14:13:11.364548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:11.364550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:11.369279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256188359540078:5440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:11.369296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256188359540078:5440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:11.369299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256188359540078:5440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:11.369307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:11.369553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540117:5440], now have 1 active actors on pipe
2025-10-01T14:13:11.369599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1887
2025-10-01T14:13:11.369666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.369677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.369700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cefded6-81127134-22437dae-340ea538_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:11.369714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.369732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.369735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:11.369749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.369761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:11.369780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.369905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.369910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.369920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.369977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1888 partition: 0 MaxSeqNo: 45 sessionId: src_id|9cefded6-81127134-22437dae-340ea538_0
2025-10-01T14:13:11.370272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d80edb4-25410bb0-62030eeb-f066f841_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9cefded6-81127134-22437dae-340ea538_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:11.372427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefded6-81127134-22437dae-340ea538_0] Write session: try to update token
2025-10-01T14:13:11.372441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefded6-81127134-22437dae-340ea538_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:11.384464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:11.384486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:11.384488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:11.384489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:11.384497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256185982641372:2551]
2025-10-01T14:13:11.384501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256185982641372:2551]
2025-10-01T14:13:11.384503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256185982641372:2551]
2025-10-01T14:13:11.384549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:11.384550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:11.384556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:11.384560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:11.384561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.384563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:11.384706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:11.385184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1888 sessionId: src_id|9cefded6-81127134-22437dae-340ea538_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:11.387519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:11.436335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256188359540123:6233]
2025-10-01T14:13:11.436587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1887, pipe: [1:7556256188359540123:6233]
2025-10-01T14:13:11.524321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:11.524536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.524549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.524580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540123:6233], now have 1 active actors on pipe
2025-10-01T14:13:11.524754Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:11.524805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:11.524825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256188359540123:6233]
2025-10-01T14:13:11.524846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:11.524902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1888 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cefded6-81127134-22437dae-340ea538_0
2025-10-01T14:13:11.525098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1888 sessionId: src_id|9cefded6-81127134-22437dae-340ea538_0 is DEAD
2025-10-01T14:13:11.525236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefded6-81127134-22437dae-340ea538_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:11.525245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefded6-81127134-22437dae-340ea538_0] Write session will restart in 0.009221s
2025-10-01T14:13:11.525265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefded6-81127134-22437dae-340ea538_0] Write session: Do CDS request
2025-10-01T14:13:11.525270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefded6-81127134-22437dae-340ea538_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:11.535932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefded6-81127134-22437dae-340ea538_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.536048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:11.536066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1889
2025-10-01T14:13:11.536259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.536327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:11.536340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:11.536345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:11.536815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1889 sessionId:  describe result for acl check
2025-10-01T14:13:11.536854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:11.536860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:11.536862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:11.536868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256188359540254:5432] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:11.537414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256188359540254:5432] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:11.539748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256188359540254:5432] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:11.540807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:11.543076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:11.543304Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:11.543319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:11.543331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:11.543397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:11.543436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256185982641598:2549]
2025-10-01T14:13:11.543497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256188359540254:5432] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:11.543513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256188359540254:5432] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:11.543516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256188359540254:5432] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:11.543525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:11.544084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:11.544369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:11.544414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:11.544730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:11.544800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.544809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.544810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.544811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.544812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.544814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.544815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.544816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.544817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.544818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.544819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.544821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.544822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.544822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.544828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.544837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.544841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.544845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.544849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.544852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.544856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.544860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.544863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.544867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.544871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.544875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.544878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.544882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.544889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.544897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.544904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.544908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.544913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.544918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.544922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.544926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.544931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.544936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.544941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.544946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.544951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.544955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.544961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.544966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.544971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.544976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.544980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.544991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.544996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.545005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.545009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.545014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.545022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.545028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.545035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.545040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.545075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:11.548685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:11.549245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:11.549257Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:11.549258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:11.549261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:11.549267Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1888 [2:7556256185982641598:2549]
2025-10-01T14:13:11.549278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:11.549291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:11.549292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.549294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.549296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.549308Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:11.549318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:11.549322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:11.549364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.549369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.549370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.549373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:11.549375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:11.549426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:11.549431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.549437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.549447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.549459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:11.549474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256185982641593:2549]
2025-10-01T14:13:11.549479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256185982641593:2549]
2025-10-01T14:13:11.549481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256185982641593:2549]
2025-10-01T14:13:11.549487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:11.549501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:11.549506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:11.549509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:11.549511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:11.549513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:11.549516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:11.549526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540364:5432], now have 1 active actors on pipe
2025-10-01T14:13:11.549552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540146:2446], now have 1 active actors on pipe
2025-10-01T14:13:11.549557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256185982641593:2549]
2025-10-01T14:13:11.549563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:11.549580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:11.549604Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1888
2025-10-01T14:13:11.549605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1888
2025-10-01T14:13:11.549651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.549658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.549675Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94128f23-7efdd04e-94b76442-22d7c15d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:11.549684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.549690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.549692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:11.549700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.549710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:11.549721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.549835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.549840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.549850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.549920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1889 partition: 0 MaxSeqNo: 45 sessionId: src_id|94128f23-7efdd04e-94b76442-22d7c15d_0
2025-10-01T14:13:11.550303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cefded6-81127134-22437dae-340ea538_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|94128f23-7efdd04e-94b76442-22d7c15d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:11.552660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94128f23-7efdd04e-94b76442-22d7c15d_0] Write session: try to update token
2025-10-01T14:13:11.552677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94128f23-7efdd04e-94b76442-22d7c15d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:11.565527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1889 sessionId: src_id|94128f23-7efdd04e-94b76442-22d7c15d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:11.568184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:11.569240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.569270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.569290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:11.569298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:11.569301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:11.569303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:11.569311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256185982641593:2549]
2025-10-01T14:13:11.569320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256185982641593:2549]
2025-10-01T14:13:11.569324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256185982641593:2549]
2025-10-01T14:13:11.569383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:11.569382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:11.569388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:11.569391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:11.569394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.569396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:11.569521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:11.624762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256188359540376:6233]
2025-10-01T14:13:11.625085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1888, pipe: [1:7556256188359540376:6233]
2025-10-01T14:13:11.705066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:11.705305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:11.705352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540376:6233], now have 1 active actors on pipe
2025-10-01T14:13:11.705474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:11.705575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:11.705584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:11.705668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1889 reason: error at write: Disconnected sessionId: src_id|94128f23-7efdd04e-94b76442-22d7c15d_0
2025-10-01T14:13:11.705840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1889 sessionId: src_id|94128f23-7efdd04e-94b76442-22d7c15d_0 is DEAD
2025-10-01T14:13:11.705953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94128f23-7efdd04e-94b76442-22d7c15d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:11.705961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94128f23-7efdd04e-94b76442-22d7c15d_0] Write session will restart in 0.006447s
2025-10-01T14:13:11.705977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94128f23-7efdd04e-94b76442-22d7c15d_0] Write session: Do CDS request
2025-10-01T14:13:11.705982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94128f23-7efdd04e-94b76442-22d7c15d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:11.706106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256188359540376:6233]
2025-10-01T14:13:11.706127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:11.713958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94128f23-7efdd04e-94b76442-22d7c15d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.714060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:11.714074Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1890
2025-10-01T14:13:11.714180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.714203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:11.714207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:11.714209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:11.714625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1890 sessionId:  describe result for acl check
2025-10-01T14:13:11.714648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:11.714659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:11.714660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:11.714663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256188359540449:5405] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:11.715090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256188359540449:5405] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:11.717395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256188359540449:5405] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:11.720111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256188359540449:5405] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:11.720126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256188359540449:5405] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:11.720130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256188359540449:5405] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:11.720138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:11.721324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:11.723535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:11.723729Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:11.723743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:11.723754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:11.723803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:11.723844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256185982641830:2548]
2025-10-01T14:13:11.724404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:11.724698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:11.724740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:11.725011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:11.725075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.725082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.725083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.725084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.725085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.725086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.725087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.725088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.725089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.725090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.725091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.725093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.725094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.725095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.725099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.725107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.725110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.725113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.725116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.725120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.725124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.725126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.725129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.725132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.725135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.725138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.725141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.725144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.725150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.725161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.725167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.725172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.725180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.725189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.725197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.725202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.725206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.725215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.725218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.725222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.725226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.725230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.725237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.725241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.725246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.725253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.725261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.725264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.725271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.725275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.725283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.725286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.725294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.725303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.725311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.725319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.725352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:11.728921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:11.729661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:11.729676Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:11.729678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:11.729682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:11.729688Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1889 [2:7556256185982641830:2548]
2025-10-01T14:13:11.729705Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:11.729724Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:11.729732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.729735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.729738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.729754Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:11.729759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:11.729765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:11.729818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.729825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.729827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.729830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:11.729833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:11.729898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:11.729904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.729915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.729929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.729947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:11.729970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540392:2446], now have 1 active actors on pipe
2025-10-01T14:13:11.729978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540614:5405], now have 1 active actors on pipe
2025-10-01T14:13:11.729986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256185982641825:2548]
2025-10-01T14:13:11.729992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256185982641825:2548]
2025-10-01T14:13:11.729994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256185982641825:2548]
2025-10-01T14:13:11.730007Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:11.730025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:11.730024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:11.730027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:11.730029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:11.730041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:11.730049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:11.730023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1889
2025-10-01T14:13:11.730023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1889
2025-10-01T14:13:11.730075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256185982641825:2548]
2025-10-01T14:13:11.730085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:11.730094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:11.730106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.730115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.730158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58756920-c3e3ea-11e6b6e2-548d9057_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:11.730168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.730176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.730182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:11.730191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.730204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:11.730225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.730385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.730394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.730409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.730482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1890 partition: 0 MaxSeqNo: 45 sessionId: src_id|58756920-c3e3ea-11e6b6e2-548d9057_0
2025-10-01T14:13:11.730824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94128f23-7efdd04e-94b76442-22d7c15d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58756920-c3e3ea-11e6b6e2-548d9057_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:11.733063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58756920-c3e3ea-11e6b6e2-548d9057_0] Write session: try to update token
2025-10-01T14:13:11.733079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58756920-c3e3ea-11e6b6e2-548d9057_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:11.746982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1890 sessionId: src_id|58756920-c3e3ea-11e6b6e2-548d9057_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:11.749266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:11.750768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.750799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.750822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:11.750830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:11.750833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:11.750835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:11.750842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256185982641825:2548]
2025-10-01T14:13:11.750852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256185982641825:2548]
2025-10-01T14:13:11.750856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256185982641825:2548]
2025-10-01T14:13:11.750903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:11.750916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:11.750922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:11.750925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:11.750927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.750929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:11.751067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:11.806502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256188359540628:6233]
2025-10-01T14:13:11.806826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1889, pipe: [1:7556256188359540628:6233]
2025-10-01T14:13:11.889346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:11.889570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:11.889626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540628:6233], now have 1 active actors on pipe
2025-10-01T14:13:11.889699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:11.889807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:11.889855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256188359540628:6233]
2025-10-01T14:13:11.899304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:11.899320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:11.899345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1890 reason: error at write: Disconnected sessionId: src_id|58756920-c3e3ea-11e6b6e2-548d9057_0
2025-10-01T14:13:11.899486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1890 sessionId: src_id|58756920-c3e3ea-11e6b6e2-548d9057_0 is DEAD
2025-10-01T14:13:11.899629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58756920-c3e3ea-11e6b6e2-548d9057_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:11.899640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58756920-c3e3ea-11e6b6e2-548d9057_0] Write session will restart in 0.007863s
2025-10-01T14:13:11.899666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58756920-c3e3ea-11e6b6e2-548d9057_0] Write session: Do CDS request
2025-10-01T14:13:11.899674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58756920-c3e3ea-11e6b6e2-548d9057_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:11.908084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:11.908936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58756920-c3e3ea-11e6b6e2-548d9057_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.909016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:11.909039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1891
2025-10-01T14:13:11.909139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:11.909170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:11.909180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:11.909183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:11.909578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1891 sessionId:  describe result for acl check
2025-10-01T14:13:11.909613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:11.909619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:11.909621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:11.909628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256188359540819:5401] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:11.910141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256188359540819:5401] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:11.910783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:11.910984Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:11.910992Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:11.911001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:11.911055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:11.911091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256185982642052:2537]
2025-10-01T14:13:11.911589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:11.911815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:11.911850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:11.912056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:11.912051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256188359540819:5401] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:11.912104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.912111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.912112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.912113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.912113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.912114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.912115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.912116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.912116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.912117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.912117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.912118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.912119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.912120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.912123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.912129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.912133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.912137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.912140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.912144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.912147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.912151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.912155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.912158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.912162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.912166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.912169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.912173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.912178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.912183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:11.912187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.912191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:11.912193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.912196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:11.912199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.912202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:11.912205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.912208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:11.912211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.912213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:11.912216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.912219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:11.912222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.912225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:11.912227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.912230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:11.912233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.912236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.912239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.912242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.912244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.912247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.912252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.912254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:11.912257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.912260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:11.912280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:11.915831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256188359540819:5401] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:11.915846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256188359540819:5401] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:11.915850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256188359540819:5401] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:11.915858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:11.916014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:11.917071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:11.917091Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:11.917094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:11.917098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:11.917105Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1890 [2:7556256185982642052:2537]
2025-10-01T14:13:11.917122Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:11.917144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:11.917151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.917155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.917157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.917175Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:11.917181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:11.917191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:11.917252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.917259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.917261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.917264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:11.917267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:11.917336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:11.917343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.917356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:11.917369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:11.917389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:11.917412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540857:5401], now have 1 active actors on pipe
2025-10-01T14:13:11.917419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540633:2446], now have 1 active actors on pipe
2025-10-01T14:13:11.917428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256185982642047:2537]
2025-10-01T14:13:11.917433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256185982642047:2537]
2025-10-01T14:13:11.917436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256185982642047:2537]
2025-10-01T14:13:11.917423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1890
2025-10-01T14:13:11.917428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1890
2025-10-01T14:13:11.917450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:11.917465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:11.917468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:11.917475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:11.917478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:11.917482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:11.917485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:11.917535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.917544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.917556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256185982642047:2537]
2025-10-01T14:13:11.917568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:11.917588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:11.917599Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:11.917606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:11.917610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:11.917619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:11.917630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:11.917638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:11.917666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.917812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.917821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.917837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:11.917902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1891 partition: 0 MaxSeqNo: 45 sessionId: src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0
2025-10-01T14:13:11.918288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58756920-c3e3ea-11e6b6e2-548d9057_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:11.920856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0] Write session: try to update token
2025-10-01T14:13:11.920879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:11.935224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1891 sessionId: src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:11.937596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:11.939013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:11.939040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:11.939062Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:11.939065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:11.939068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:11.939070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:11.939078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256185982642047:2537]
2025-10-01T14:13:11.939082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256185982642047:2537]
2025-10-01T14:13:11.939085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256185982642047:2537]
2025-10-01T14:13:11.939123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:11.939137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:11.939140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:11.939144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:11.939151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:11.939153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:11.939279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:11.989797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256188359540864:6233]
2025-10-01T14:13:11.990048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1890, pipe: [1:7556256188359540864:6233]
2025-10-01T14:13:12.082032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:12.082471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:12.082534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256188359540864:6233], now have 1 active actors on pipe
2025-10-01T14:13:12.082634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:12.082716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:12.082769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256188359540864:6233]
2025-10-01T14:13:12.094103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:12.094117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:12.094139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1891 reason: error at write: Disconnected sessionId: src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0
2025-10-01T14:13:12.094319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1891 sessionId: src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0 is DEAD
2025-10-01T14:13:12.094460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:12.094467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0] Write session will restart in 0.005723s
2025-10-01T14:13:12.094486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0] Write session: Do CDS request
2025-10-01T14:13:12.094511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:12.100934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.101094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:12.101110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1892
2025-10-01T14:13:12.101237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.101271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:12.101280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:12.101284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:12.101743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1892 sessionId:  describe result for acl check
2025-10-01T14:13:12.101776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:12.101781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:12.101783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:12.101788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256192654508319:5395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:12.102352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256192654508319:5395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:12.104679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:12.104899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256192654508319:5395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:12.107269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:12.107492Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:12.107505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:12.107517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:12.107571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:12.107614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256192654508319:5395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:12.107626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256192654508319:5395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:12.107629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256192654508319:5395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:12.107636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:12.107688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256190277609605:2523]
2025-10-01T14:13:12.108244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:12.108550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:12.108601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:12.108925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:12.109002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.109010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.109011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.109012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.109014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.109015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.109016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.109017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.109018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.109019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.109021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.109022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.109023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.109025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.109030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.109040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.109044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.109047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.109050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.109055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.109058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.109063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.109067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.109071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.109075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.109079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.109088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.109092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.109106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.109120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.109130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.109135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.109145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.109156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.109161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.109166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.109171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.109178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.109187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.109198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.109208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.109217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.109221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.109227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.109235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.109242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.109247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.109257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.109268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.109278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.109286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.109296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.109306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.109315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.109324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.109329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.109376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:12.113083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:12.114025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:12.114039Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:12.114041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:12.114045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:12.114052Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1891 [2:7556256190277609605:2523]
2025-10-01T14:13:12.114073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:12.114091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:12.114100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.114104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.114106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.114123Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:12.114129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:12.114137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:12.114197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.114204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.114206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.114210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:12.114212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:12.114285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:12.114298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.114309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.114320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.114335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:12.114360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508385:5395], now have 1 active actors on pipe
2025-10-01T14:13:12.114385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508165:2446], now have 1 active actors on pipe
2025-10-01T14:13:12.114397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256190277609600:2523]
2025-10-01T14:13:12.114401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256190277609600:2523]
2025-10-01T14:13:12.114403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256190277609600:2523]
2025-10-01T14:13:12.114418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:12.114432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:12.114439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:12.114440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:12.114443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:12.114453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:12.114461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:12.114449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1891
2025-10-01T14:13:12.114450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1891
2025-10-01T14:13:12.114504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256190277609600:2523]
2025-10-01T14:13:12.114516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:12.114521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:12.114533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.114544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.114598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84478b68-286e6401-ece5589d-9337eb30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:12.114611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.114620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.114623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:12.114632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.114648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:12.114673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.114862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.114870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.114887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.114969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1892 partition: 0 MaxSeqNo: 45 sessionId: src_id|84478b68-286e6401-ece5589d-9337eb30_0
2025-10-01T14:13:12.115364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|928a26a2-43e67a2b-4ebe191e-1f6fd152_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84478b68-286e6401-ece5589d-9337eb30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:12.117663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84478b68-286e6401-ece5589d-9337eb30_0] Write session: try to update token
2025-10-01T14:13:12.117681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84478b68-286e6401-ece5589d-9337eb30_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:12.132058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1892 sessionId: src_id|84478b68-286e6401-ece5589d-9337eb30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:12.134424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:12.135910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.135934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.135954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:12.135958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:12.135960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:12.135962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:12.135972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256190277609600:2523]
2025-10-01T14:13:12.135976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256190277609600:2523]
2025-10-01T14:13:12.135980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256190277609600:2523]
2025-10-01T14:13:12.136032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:12.136037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:12.136043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.136045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:12.136049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:12.136055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:12.136169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:12.182805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256192654508398:6233]
2025-10-01T14:13:12.183026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1891, pipe: [1:7556256192654508398:6233]
2025-10-01T14:13:12.291924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:12.292296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:12.292347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508398:6233], now have 1 active actors on pipe
2025-10-01T14:13:12.292454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:12.292515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:12.292533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:12.292535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:12.292565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256192654508398:6233]
2025-10-01T14:13:12.292598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1892 reason: error at write: Disconnected sessionId: src_id|84478b68-286e6401-ece5589d-9337eb30_0
2025-10-01T14:13:12.292764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1892 sessionId: src_id|84478b68-286e6401-ece5589d-9337eb30_0 is DEAD
2025-10-01T14:13:12.292894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84478b68-286e6401-ece5589d-9337eb30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:12.292904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84478b68-286e6401-ece5589d-9337eb30_0] Write session will restart in 0.006189s
2025-10-01T14:13:12.292927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84478b68-286e6401-ece5589d-9337eb30_0] Write session: Do CDS request
2025-10-01T14:13:12.292936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84478b68-286e6401-ece5589d-9337eb30_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:12.299901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84478b68-286e6401-ece5589d-9337eb30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.299976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:12.299990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1893
2025-10-01T14:13:12.300165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.300201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:12.300212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:12.300215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:12.300608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1893 sessionId:  describe result for acl check
2025-10-01T14:13:12.300647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:12.300653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:12.300655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:12.300659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256192654508450:5394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:12.301116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256192654508450:5394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:12.303349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256192654508450:5394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:12.307353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:12.307434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256192654508450:5394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:12.307447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256192654508450:5394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:12.307450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256192654508450:5394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:12.307458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:12.307788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:12.307939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:12.307947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:12.307955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:12.307990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:12.308017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256190277609843:2522]
2025-10-01T14:13:12.308420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:12.310069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:12.310103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:12.310309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:12.310360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.310367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.310380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.310381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.310382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.310383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.310384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.310385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.310386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.310387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.310388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.310389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.310391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.310392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.310398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.310406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.310410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.310413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.310415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.310417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.310420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.310423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.310427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.310430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.310433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.310436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.310440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.310443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.310450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.310457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.310462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.310465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.310468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.310471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.310473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.310476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.310479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.310482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.310484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.310486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.310489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.310492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.310494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.310497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.310500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.310503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.310505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.310508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.310510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.310512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.310515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.310517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.310520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.310522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.310524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.310527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.310546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:12.314265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:12.315021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:12.315040Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:12.315042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:12.315045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:12.315053Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1892 [2:7556256190277609843:2522]
2025-10-01T14:13:12.315070Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:12.315091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:12.315098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.315103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.315109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.315126Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:12.315135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:12.315146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:12.315208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.315216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.315218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.315221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:12.315223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:12.315291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:12.315299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.315309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.315319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.315332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:12.315359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508622:5394], now have 1 active actors on pipe
2025-10-01T14:13:12.315366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508400:2446], now have 1 active actors on pipe
2025-10-01T14:13:12.315375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256190277609837:2522]
2025-10-01T14:13:12.315380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256190277609837:2522]
2025-10-01T14:13:12.315382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256190277609837:2522]
2025-10-01T14:13:12.315399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:12.315417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:12.315390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1892
2025-10-01T14:13:12.315419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:12.315406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1892
2025-10-01T14:13:12.315423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:12.315425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:12.315436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:12.315439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:12.315493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.315504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.315720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256190277609837:2522]
2025-10-01T14:13:12.315739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:12.315753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:12.315773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:12.315785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.315794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.315798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:12.315812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.315825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:12.315858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.316014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.316022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.316036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.316117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1893 partition: 0 MaxSeqNo: 45 sessionId: src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0
2025-10-01T14:13:12.316432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84478b68-286e6401-ece5589d-9337eb30_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:12.318534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0] Write session: try to update token
2025-10-01T14:13:12.318551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:12.330326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1893 sessionId: src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:12.332498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:12.332696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.332714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.332743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:12.332821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:12.335122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:12.335142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:12.335144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:12.335147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:12.335157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256190277609837:2522]
2025-10-01T14:13:12.335163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256190277609837:2522]
2025-10-01T14:13:12.335167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256190277609837:2522]
2025-10-01T14:13:12.335200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:12.335209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:12.335212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:12.335212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:12.335218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.335221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:12.335357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:12.392734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256192654508636:6233]
2025-10-01T14:13:12.392933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1892, pipe: [1:7556256192654508636:6233]
2025-10-01T14:13:12.473993Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:12.480577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.480597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.480736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.480793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.480853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.480914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.481170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.481178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.481237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.481292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.481349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.481415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.481452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.481457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.481513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.481564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.481619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.481684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.481723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.481727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.481780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.481837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.481904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.481969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.482131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.482137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.482191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.482245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.482298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.482353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.482408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.482413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.482467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.482517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.482574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.482633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.482673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.482678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.482733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.482785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.482844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.482913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.482961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.482967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.483034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.483093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.483163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.483221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.483268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.483276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.483340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.483468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.483527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.483582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.483623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.483628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.483691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:12.483743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:12.483796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:12.483852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:12.483893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:12.483899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:12.483936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508636:6233], now have 1 active actors on pipe
2025-10-01T14:13:12.484096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:12.484108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:12.484113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256192654508636:6233]
2025-10-01T14:13:12.484126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1893 reason: error at write: Disconnected sessionId: src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0
2025-10-01T14:13:12.484129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:12.484228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:12.484287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1893 sessionId: src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0 is DEAD
2025-10-01T14:13:12.484427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:12.484439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0] Write session will restart in 0.005629s
2025-10-01T14:13:12.484464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0] Write session: Do CDS request
2025-10-01T14:13:12.484469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:12.490716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.490811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:12.490822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1894
2025-10-01T14:13:12.490904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.490924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:12.490931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:12.490934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:12.491376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1894 sessionId:  describe result for acl check
2025-10-01T14:13:12.491407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:12.491413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:12.491415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:12.491419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256192654508720:5375] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:12.491878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256192654508720:5375] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:12.494093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256192654508720:5375] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:12.495582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:12.497455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:12.497576Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:12.497583Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:12.497591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:12.497597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256192654508720:5375] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:12.497609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256192654508720:5375] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:12.497612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256192654508720:5375] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:12.497619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:12.497623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:12.497650Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256190277610068:2520]
2025-10-01T14:13:12.498092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:12.498314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:12.498355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:12.498590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:12.498623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.498628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.498629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.498630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.498630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.498631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.498632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.498632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.498633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.498633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.498634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.498635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.498636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.498636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.498639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.498645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.498647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.498650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.498652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.498654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.498656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.498658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.498660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.498662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.498664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.498666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.498668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.498670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.498675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.498679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.498683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.498686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.498689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.498692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.498694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.498697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.498700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.498703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.498705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.498708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.498710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.498713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.498715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.498718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.498720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.498724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.498726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.498729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.498738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.498741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.498743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.498746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.498748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.498751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.498753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.498756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.498776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:12.502109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:12.502816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:12.502828Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:12.502829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:12.502831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:12.502836Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1893 [2:7556256190277610068:2520]
2025-10-01T14:13:12.502845Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:12.502858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:12.502862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.502865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.502866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.502877Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:12.502884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:12.502889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:12.502925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.502929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.502931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.502933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:12.502934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:12.502989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:12.502994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.503001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.503009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.503021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:12.503035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508655:2446], now have 1 active actors on pipe
2025-10-01T14:13:12.503042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508878:5375], now have 1 active actors on pipe
2025-10-01T14:13:12.503048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256190277610062:2520]
2025-10-01T14:13:12.503054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256190277610062:2520]
2025-10-01T14:13:12.503055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256190277610062:2520]
2025-10-01T14:13:12.503069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:12.503078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:12.503084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:12.503085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:12.503086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:12.503096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:12.503102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:12.503084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1893
2025-10-01T14:13:12.503101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1893
2025-10-01T14:13:12.503131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256190277610062:2520]
2025-10-01T14:13:12.503138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:12.503143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:12.503149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.503156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.503190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:12.503201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.503203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.503205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:12.503210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.503217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:12.503229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.503338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.503345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.503356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.503416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1894 partition: 0 MaxSeqNo: 45 sessionId: src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0
2025-10-01T14:13:12.503713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|255c0e4a-ff381264-6fb7abe5-b6f83e02_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:12.505884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0] Write session: try to update token
2025-10-01T14:13:12.505900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:12.518340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1894 sessionId: src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:12.520556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:12.521997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.522017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.522034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:12.522036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:12.522038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:12.522044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:12.522050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256190277610062:2520]
2025-10-01T14:13:12.522052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256190277610062:2520]
2025-10-01T14:13:12.522055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256190277610062:2520]
2025-10-01T14:13:12.522083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:12.522092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:12.522094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:12.522096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:12.522101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.522102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:12.522221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:12.584228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256192654508893:6233]
2025-10-01T14:13:12.584456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1893, pipe: [1:7556256192654508893:6233]
2025-10-01T14:13:12.655596Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:12.655924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:12.655968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508893:6233], now have 1 active actors on pipe
2025-10-01T14:13:12.656070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:12.656136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256192654508893:6233]
2025-10-01T14:13:12.656147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:12.656149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:12.656162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:12.656201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1894 reason: error at write: Disconnected sessionId: src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0
2025-10-01T14:13:12.656331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1894 sessionId: src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0 is DEAD
2025-10-01T14:13:12.656432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:12.656441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0] Write session will restart in 0.005251s
2025-10-01T14:13:12.656471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0] Write session: Do CDS request
2025-10-01T14:13:12.656476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:12.662865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.662967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:12.662981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1895
2025-10-01T14:13:12.663082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.663110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:12.663117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:12.663120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:12.663431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1895 sessionId:  describe result for acl check
2025-10-01T14:13:12.663468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:12.663474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:12.663475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:12.663479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256192654508939:5377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:12.663867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256192654508939:5377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:12.666582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256192654508939:5377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:12.669254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256192654508939:5377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:12.669273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256192654508939:5377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:12.669277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256192654508939:5377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:12.669285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:12.669878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:12.671914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:12.672048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:12.672056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:12.672064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:12.672091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:12.672120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256190277610298:2512]
2025-10-01T14:13:12.672519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:12.672798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:12.672836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:12.673042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:12.673076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.673080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.673081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.673082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.673083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.673083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.673084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.673085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.673085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.673086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.673086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.673087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.673088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.673088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.673091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.673098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.673100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.673102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.673104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.673106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.673108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.673111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.673113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.673115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.673117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.673119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.673121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.673123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.673129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.673133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.673137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.673140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.673142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.673145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.673147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.673150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.673152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.673155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.673157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.673160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.673165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.673170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.673173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.673178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.673182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.673186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.673191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.673197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.673199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.673202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.673204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.673207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.673209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.673211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.673214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.673216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.673237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:12.676605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:12.677442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:12.677455Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:12.677456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:12.677459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:12.677464Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1894 [2:7556256190277610298:2512]
2025-10-01T14:13:12.677474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:12.677487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:12.677489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.677491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.677492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.677502Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:12.677505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:12.677509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:12.677546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.677551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.677552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.677555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:12.677557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:12.677618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:12.677625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.677634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.677647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.677664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:12.677684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654509117:5377], now have 1 active actors on pipe
2025-10-01T14:13:12.677689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654508894:2446], now have 1 active actors on pipe
2025-10-01T14:13:12.677695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256190277610293:2512]
2025-10-01T14:13:12.677699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256190277610293:2512]
2025-10-01T14:13:12.677700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256190277610293:2512]
2025-10-01T14:13:12.677710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:12.677722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:12.677725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:12.677725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:12.677727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:12.677737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:12.677740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:12.677763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256190277610293:2512]
2025-10-01T14:13:12.677773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:12.677781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:12.677783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1894
2025-10-01T14:13:12.677799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1894
2025-10-01T14:13:12.677856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.677866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.677888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:12.677900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.677904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.677906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:12.677915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.677927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:12.677936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.678052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.678059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.678070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.678162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1895 partition: 0 MaxSeqNo: 45 sessionId: src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0
2025-10-01T14:13:12.678546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4239cb9-1178f44a-4222d1b3-4778324c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:12.680875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0] Write session: try to update token
2025-10-01T14:13:12.680891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:12.693770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1895 sessionId: src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:12.695937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:12.696930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.696949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.696968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:12.696971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:12.696973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:12.696975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:12.696983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256190277610293:2512]
2025-10-01T14:13:12.696991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256190277610293:2512]
2025-10-01T14:13:12.696995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256190277610293:2512]
2025-10-01T14:13:12.697025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:12.697034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:12.697036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:12.697052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:12.697059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.697062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:12.697191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:12.756229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256192654509151:6233]
2025-10-01T14:13:12.756355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1894, pipe: [1:7556256192654509151:6233]
2025-10-01T14:13:12.831618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:12.831818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:12.831860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654509151:6233], now have 1 active actors on pipe
2025-10-01T14:13:12.831939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:12.832033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256192654509151:6233]
2025-10-01T14:13:12.832056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:12.832072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:12.832079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:12.832094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1895 reason: error at write: Disconnected sessionId: src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0
2025-10-01T14:13:12.832257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1895 sessionId: src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0 is DEAD
2025-10-01T14:13:12.832397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:12.832405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0] Write session will restart in 0.008334s
2025-10-01T14:13:12.832423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0] Write session: Do CDS request
2025-10-01T14:13:12.832430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:12.841822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.841931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:12.841941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1896
2025-10-01T14:13:12.842048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:12.842076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:12.842085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:12.842087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:12.842477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1896 sessionId:  describe result for acl check
2025-10-01T14:13:12.842509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:12.842511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:12.842512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:12.842515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256192654509279:10247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:12.842899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256192654509279:10247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:12.844763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256192654509279:10247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:12.848111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:12.848376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256192654509279:10247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:12.848387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256192654509279:10247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:12.848389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256192654509279:10247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:12.848395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:12.848446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:12.848591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:12.848599Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:12.848608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:12.848657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:12.848690Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256190277610533:2499]
2025-10-01T14:13:12.849281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:12.849483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:12.849517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:12.849796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:12.849837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.849842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.849843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.849844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.849846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.849846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.849848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.849848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.849850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.849851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.849852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.849853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.849854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.849855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.849859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.849868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.849871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.849875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.849878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.849881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.849889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.849892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.849899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.849903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.849910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.849913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.849917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.849920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.849926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.849932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:12.849941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.849950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:12.849955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.849964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:12.849972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.849978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:12.849981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.849992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:12.849999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.850004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:12.850011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.850019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:12.850026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.850031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:12.850038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.850043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:12.850050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.850054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.850062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.850066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.850074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.850078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.850085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.850093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:12.850100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.850104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:12.850143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:12.853499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:12.854034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:12.854046Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:12.854048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:12.854052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:12.854059Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1895 [2:7556256190277610533:2499]
2025-10-01T14:13:12.854073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:12.854092Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:12.854098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.854101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.854104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.854118Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:12.854127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:12.854132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:12.854184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.854190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.854192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.854195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:12.854198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:12.854260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:12.854266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.854276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:12.854290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:12.854308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:12.854329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654509154:2446], now have 1 active actors on pipe
2025-10-01T14:13:12.854340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256190277610527:2499]
2025-10-01T14:13:12.854342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256190277610527:2499]
2025-10-01T14:13:12.854344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256190277610527:2499]
2025-10-01T14:13:12.854356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:12.854386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654509380:10247], now have 1 active actors on pipe
2025-10-01T14:13:12.854390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:12.854393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:12.854395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:12.854397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:12.854405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:12.854409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:12.854429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256190277610527:2499]
2025-10-01T14:13:12.854436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:12.854445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:12.854420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1895
2025-10-01T14:13:12.854420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1895
2025-10-01T14:13:12.854471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.854479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.854508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:12.854517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:12.854521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:12.854528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:12.854538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:12.854549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:12.854565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.854706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.854713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.854728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:12.854811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1896 partition: 0 MaxSeqNo: 45 sessionId: src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0
2025-10-01T14:13:12.855140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80aa4671-4bc5fbc3-3e0608a3-c20b5514_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:12.857448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0] Write session: try to update token
2025-10-01T14:13:12.857462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:12.870466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1896 sessionId: src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:12.872796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:12.874081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:12.874103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:12.874123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:12.874126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:12.874128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:12.874130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:12.874137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256190277610527:2499]
2025-10-01T14:13:12.874143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256190277610527:2499]
2025-10-01T14:13:12.874146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256190277610527:2499]
2025-10-01T14:13:12.874187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:12.874196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:12.874199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:12.874203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:12.874203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:12.874206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:12.874326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:12.932384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256192654509393:6233]
2025-10-01T14:13:12.932669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1895, pipe: [1:7556256192654509393:6233]
2025-10-01T14:13:13.012823Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:13.013375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:13.013419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256192654509393:6233], now have 1 active actors on pipe
2025-10-01T14:13:13.013492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:13.013605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256192654509393:6233]
2025-10-01T14:13:13.013627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:13.021303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:13.021314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:13.021331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1896 reason: error at write: Disconnected sessionId: src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0
2025-10-01T14:13:13.021457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1896 sessionId: src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0 is DEAD
2025-10-01T14:13:13.021621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:13.021630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0] Write session will restart in 0.009553s
2025-10-01T14:13:13.021652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0] Write session: Do CDS request
2025-10-01T14:13:13.021661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:13.029233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:13.031900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.031937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:13.031972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:13.031986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1897
2025-10-01T14:13:13.032081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.032109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:13.032118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:13.032116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:13.032121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:13.032124Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:13.032134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:13.032175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:13.032211Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256194572578057:2496]
2025-10-01T14:13:13.032455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1897 sessionId:  describe result for acl check
2025-10-01T14:13:13.032492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:13.032497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:13.032500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:13.032505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256196949476884:10252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:13.032994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256196949476884:10252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:13.033176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:13.033413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:13.033449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:13.033814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:13.033866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.033870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.033872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.033873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.033874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.033875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.033876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.033878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.033879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.033880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.033881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.033882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.033883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.033884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.033889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.033898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.033901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.033905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.033909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.033912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.033916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.033919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.033923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.033926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.033930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.033933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.033936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.033940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.033946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.033952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.033962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.033972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.033979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.033985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.033993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.033998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.034005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.034010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.034018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.034022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.034030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.034035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.034044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.034052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.034060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.034065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.034073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.034078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.034085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.034090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.034097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.034102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.034109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.034115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.034120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.034128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.034169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:13.035087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256196949476884:10252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:13.037216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256196949476884:10252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:13.037225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256196949476884:10252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:13.037227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256196949476884:10252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:13.037232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:13.037443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:13.038232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:13.038246Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:13.038247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:13.038250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:13.038255Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1896 [2:7556256194572578057:2496]
2025-10-01T14:13:13.038269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:13.038283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:13.038289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.038292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.038294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.038306Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:13.038315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:13.038324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:13.038382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.038389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.038391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.038393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:13.038396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:13.038451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:13.038457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.038468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.038483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.038502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:13.038523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949476922:10252], now have 1 active actors on pipe
2025-10-01T14:13:13.038531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949476692:2446], now have 1 active actors on pipe
2025-10-01T14:13:13.038515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1896
2025-10-01T14:13:13.038537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256194572578052:2496]
2025-10-01T14:13:13.038519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1896
2025-10-01T14:13:13.038543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256194572578052:2496]
2025-10-01T14:13:13.038545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256194572578052:2496]
2025-10-01T14:13:13.038553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:13.038558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:13.038560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:13.038561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:13.038566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:13.038579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:13.038581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:13.038598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.038606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.038633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256194572578052:2496]
2025-10-01T14:13:13.038644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:13.038650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:13.038658Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:13.038665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.038672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.038675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:13.038683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.038690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:13.038717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.038822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.038831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.038843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.038889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1897 partition: 0 MaxSeqNo: 45 sessionId: src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0
2025-10-01T14:13:13.039154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbe24137-a5e501f0-c884edf3-fc36723c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:13.041698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0] Write session: try to update token
2025-10-01T14:13:13.041712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:13.055565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1897 sessionId: src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:13.057820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:13.058673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.058693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.058712Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:13.058717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:13.058724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:13.058725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:13.058733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256194572578052:2496]
2025-10-01T14:13:13.058746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256194572578052:2496]
2025-10-01T14:13:13.058752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256194572578052:2496]
2025-10-01T14:13:13.058786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:13.058795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:13.058797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:13.058797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:13.058802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.058803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:13.058916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:13.113646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256196949476929:6233]
2025-10-01T14:13:13.113860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1896, pipe: [1:7556256196949476929:6233]
2025-10-01T14:13:13.189946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:13.190267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:13.190320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949476929:6233], now have 1 active actors on pipe
2025-10-01T14:13:13.190405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:13.190533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:13.190590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256196949476929:6233]
2025-10-01T14:13:13.200655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:13.200669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:13.200692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1897 reason: error at write: Disconnected sessionId: src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0
2025-10-01T14:13:13.200845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1897 sessionId: src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0 is DEAD
2025-10-01T14:13:13.200948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:13.200957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0] Write session will restart in 0.009719s
2025-10-01T14:13:13.200975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0] Write session: Do CDS request
2025-10-01T14:13:13.200981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:13.205426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:13.207373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:13.207525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:13.207532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:13.207540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:13.207571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:13.207605Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256194572578330:2462]
2025-10-01T14:13:13.208325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:13.208556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:13.208592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:13.208880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:13.208937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.208945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.208947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.208948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.208949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.208950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.208951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.208952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.208954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.208955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.208956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.208957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.208958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.208958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.208962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.208970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.208974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.208978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.208981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.208984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.208987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.208990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.208993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.208997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.209001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.209004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.209007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.209010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.209016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.209023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.209033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.209038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.209046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.209051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.209059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.209063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.209070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.209074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.209081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.209085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.209089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.209097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.209100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.209109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.209117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.209122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.209125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.209129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.209137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.209145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.209153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.209157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.209164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.209168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.209175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.209180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.209218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:13.211859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.211991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:13.212005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1898
2025-10-01T14:13:13.212132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.212166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:13.212176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:13.212179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:13.212541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1898 sessionId:  describe result for acl check
2025-10-01T14:13:13.212535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:13.212573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:13.212574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:13.212576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:13.212582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256196949477129:10256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:13.213088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256196949477129:10256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:13.213204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:13.213219Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:13.213221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:13.213225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:13.213231Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1897 [2:7556256194572578330:2462]
2025-10-01T14:13:13.213245Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:13.213258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:13.213266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.213269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.213270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.213281Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:13.213285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:13.213289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:13.213325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.213329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.213330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.213333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:13.213334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:13.213378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:13.213383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.213390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.213407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.213420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:13.213433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949476931:2446], now have 1 active actors on pipe
2025-10-01T14:13:13.213438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256194572578325:2462]
2025-10-01T14:13:13.213440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256194572578325:2462]
2025-10-01T14:13:13.213442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256194572578325:2462]
2025-10-01T14:13:13.213451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:13.213461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:13.213463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:13.213467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:13.213469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:13.213471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:13.213473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:13.213490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256194572578325:2462]
2025-10-01T14:13:13.213474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1897
2025-10-01T14:13:13.213492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:13.213494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:13.214830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256196949477129:10256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:13.219352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256196949477129:10256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:13.219360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256196949477129:10256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:13.219363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256196949477129:10256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:13.219368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:13.219550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477167:10256], now have 1 active actors on pipe
2025-10-01T14:13:13.219578Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1897
2025-10-01T14:13:13.219621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.219630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.219648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:13.219658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.219664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.219666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:13.219673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.219683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:13.219698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.219808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.219813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.219822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.219887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1898 partition: 0 MaxSeqNo: 45 sessionId: src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0
2025-10-01T14:13:13.220173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbf766c7-77303aa-1d4322b6-419fa8ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:13.222451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0] Write session: try to update token
2025-10-01T14:13:13.222464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:13.224388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:13.224407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:13.224417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256194572578325:2462]
2025-10-01T14:13:13.224456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:13.224463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:13.224709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:13.224898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:13.225083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:13.225274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:13.225553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:13.225599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:13.235345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1898 sessionId: src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:13.237569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:13.237908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.237924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.237953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:13.238047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:13.241143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:13.241158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:13.241160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:13.241162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:13.241172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256194572578325:2462]
2025-10-01T14:13:13.241176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256194572578325:2462]
2025-10-01T14:13:13.241179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256194572578325:2462]
2025-10-01T14:13:13.241209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:13.241216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:13.241218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:13.241221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.241221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:13.241223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:13.241336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:13.290787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256196949477170:6233]
2025-10-01T14:13:13.291005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1897, pipe: [1:7556256196949477170:6233]
2025-10-01T14:13:13.374710Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:13.381796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.381816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.381943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.381990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.382037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.382085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.382573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.382582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.382635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.382684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.382733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.382790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.382829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.382835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.382894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.382943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.382995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.383054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.383097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.383103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.383162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.383213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.383265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.383319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.383430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.383436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.383487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.383539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.383591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.383642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.383680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.383685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.383740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.383791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.383848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.383901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.383946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.383953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.384024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.384075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.384131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.384186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.384227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.384232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.384316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.384390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.384456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.384539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.384586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.384592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.384694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.384768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.384837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.384923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.385020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.385026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.385100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.385153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.385210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.385267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.385314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.385321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.385377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477170:6233], now have 1 active actors on pipe
2025-10-01T14:13:13.385624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256196949477170:6233]
2025-10-01T14:13:13.385661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:13.385664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:13.385880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:13.385924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1898 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0
2025-10-01T14:13:13.386097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1898 sessionId: src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0 is DEAD
2025-10-01T14:13:13.386266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:13.386277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0] Write session will restart in 0.008353s
2025-10-01T14:13:13.386304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0] Write session: Do CDS request
2025-10-01T14:13:13.386310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:13.395857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.395989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:13.396005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1899
2025-10-01T14:13:13.396100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.396134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:13.396145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:13.396152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:13.396564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1899 sessionId:  describe result for acl check
2025-10-01T14:13:13.396602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:13.396612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:13.396622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:13.396627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256196949477278:10260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:13.397170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256196949477278:10260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:13.399831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256196949477278:10260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:13.400594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:13.403419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:13.403636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:13.403647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:13.403659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:13.403668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256196949477278:10260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:13.403682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256196949477278:10260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:13.403686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256196949477278:10260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:13.403695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:13.403732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:13.403770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256194572578561:2473]
2025-10-01T14:13:13.404361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:13.404643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:13.404691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:13.405165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:13.405216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.405220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.405221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.405222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.405222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.405223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.405224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.405224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.405225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.405225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.405226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.405227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.405227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.405228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.405231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.405237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.405240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.405242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.405244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.405246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.405248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.405250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.405253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.405255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.405257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.405259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.405261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.405263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.405267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.405272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.405276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.405279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.405283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.405286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.405288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.405291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.405295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.405298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.405300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.405303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.405306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.405308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.405311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.405314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.405316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.405319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.405322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.405324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.405327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.405330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.405333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.405335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.405338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.405341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.405343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.405346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.405372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:13.408847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:13.409405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:13.409416Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:13.409418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:13.409421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:13.409426Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1898 [2:7556256194572578561:2473]
2025-10-01T14:13:13.409436Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:13.409449Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:13.409451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.409453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.409455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.409467Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:13.409474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:13.409480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:13.409520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.409524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.409526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.409528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:13.409530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:13.409572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:13.409577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.409584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.409590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.409602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:13.409617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256194572578556:2473]
2025-10-01T14:13:13.409622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256194572578556:2473]
2025-10-01T14:13:13.409623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256194572578556:2473]
2025-10-01T14:13:13.409630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:13.409639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:13.409640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:13.409645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:13.409647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:13.409648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:13.409649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:13.409657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477401:10260], now have 1 active actors on pipe
2025-10-01T14:13:13.409659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477173:2446], now have 1 active actors on pipe
2025-10-01T14:13:13.409677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256194572578556:2473]
2025-10-01T14:13:13.409686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:13.409707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:13.409721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1898
2025-10-01T14:13:13.409761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.409730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1898
2025-10-01T14:13:13.409768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.409789Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3791b885-64cc40-ef480850-f9faf593_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:13.409797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.409800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.409801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:13.409808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.409817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:13.409828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.409937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.409941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.409952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.410011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1899 partition: 0 MaxSeqNo: 45 sessionId: src_id|3791b885-64cc40-ef480850-f9faf593_0
2025-10-01T14:13:13.410425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1693947-a2c8319d-e1cf5a1d-b7b61a7d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3791b885-64cc40-ef480850-f9faf593_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:13.412964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3791b885-64cc40-ef480850-f9faf593_0] Write session: try to update token
2025-10-01T14:13:13.412983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3791b885-64cc40-ef480850-f9faf593_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:13.426671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1899 sessionId: src_id|3791b885-64cc40-ef480850-f9faf593_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:13.428899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:13.429580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.429602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.429623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:13.429631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:13.429634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:13.429636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:13.429645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256194572578556:2473]
2025-10-01T14:13:13.429653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256194572578556:2473]
2025-10-01T14:13:13.429658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256194572578556:2473]
2025-10-01T14:13:13.429696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:13.429706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:13.429709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:13.429713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:13.429719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.429722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:13.429873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:13.485841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256196949477429:6233]
2025-10-01T14:13:13.486012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1898, pipe: [1:7556256196949477429:6233]
2025-10-01T14:13:13.569861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:13.570285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:13.570349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477429:6233], now have 1 active actors on pipe
2025-10-01T14:13:13.570432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:13.570576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256196949477429:6233]
2025-10-01T14:13:13.570615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:13.582029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:13.582041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:13.582061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1899 reason: error at write: Disconnected sessionId: src_id|3791b885-64cc40-ef480850-f9faf593_0
2025-10-01T14:13:13.582196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1899 sessionId: src_id|3791b885-64cc40-ef480850-f9faf593_0 is DEAD
2025-10-01T14:13:13.582355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3791b885-64cc40-ef480850-f9faf593_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:13.582364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3791b885-64cc40-ef480850-f9faf593_0] Write session will restart in 0.007816s
2025-10-01T14:13:13.582394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3791b885-64cc40-ef480850-f9faf593_0] Write session: Do CDS request
2025-10-01T14:13:13.582402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3791b885-64cc40-ef480850-f9faf593_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:13.588877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:13.590881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3791b885-64cc40-ef480850-f9faf593_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.590916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:13.590931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1900
2025-10-01T14:13:13.591033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:13.591075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.591106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:13.591114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:13.591117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:13.591247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:13.591259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:13.591271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:13.591334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:13.591376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256194572578795:2471]
2025-10-01T14:13:13.591520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1900 sessionId:  describe result for acl check
2025-10-01T14:13:13.591554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:13.591563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:13.591568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:13.591574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256196949477630:10266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:13.591961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:13.592132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256196949477630:10266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:13.592239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:13.592284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:13.592581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:13.592659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.592665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.592666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.592667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.592668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.592669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.592670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.592672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.592673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.592674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.592675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.592676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.592677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.592678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.592685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.592694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.592698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.592701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.592704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.592708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.592711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.592715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.592718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.592723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.592726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.592729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.592733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.592736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.592742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.592751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.592757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.592767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.592771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.592780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.592784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.592789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.592798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.592802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.592811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.592815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.592824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.592828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.592832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.592842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.592849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.592854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.592858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.592862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.592868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.592877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.592881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.592886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.592895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.592900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.592907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.592912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.592947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:13.594564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256196949477630:10266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:13.596446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:13.597091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256196949477630:10266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:13.597105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256196949477630:10266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:13.597108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256196949477630:10266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:13.597115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:13.597917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:13.597928Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:13.597930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:13.597932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:13.597937Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1899 [2:7556256194572578795:2471]
2025-10-01T14:13:13.597949Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:13.597962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:13.597967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.597969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.597970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.597983Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:13.597990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:13.597994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:13.598034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.598038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.598039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.598041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:13.598043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:13.598091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:13.598096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.598103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.598108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.598120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:13.598133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477435:2446], now have 1 active actors on pipe
2025-10-01T14:13:13.598136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477668:10266], now have 1 active actors on pipe
2025-10-01T14:13:13.598141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256194572578788:2471]
2025-10-01T14:13:13.598145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256194572578788:2471]
2025-10-01T14:13:13.598146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256194572578788:2471]
2025-10-01T14:13:13.598157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:13.598167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:13.598169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:13.598174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:13.598176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:13.598177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:13.598178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:13.598200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256194572578788:2471]
2025-10-01T14:13:13.598205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:13.598203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1899
2025-10-01T14:13:13.598215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:13.598205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1899
2025-10-01T14:13:13.598236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.598242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.598259Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca3f61da-11855237-f28b87d2-21150c3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:13.598268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.598274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.598275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:13.598281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.598289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:13.598302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.598428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.598433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.598442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.598504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1900 partition: 0 MaxSeqNo: 45 sessionId: src_id|ca3f61da-11855237-f28b87d2-21150c3d_0
2025-10-01T14:13:13.598797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3791b885-64cc40-ef480850-f9faf593_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ca3f61da-11855237-f28b87d2-21150c3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:13.600894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3f61da-11855237-f28b87d2-21150c3d_0] Write session: try to update token
2025-10-01T14:13:13.600906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3f61da-11855237-f28b87d2-21150c3d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:13.615683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1900 sessionId: src_id|ca3f61da-11855237-f28b87d2-21150c3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:13.617068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:13.617082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:13.617084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:13.617085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:13.617092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256194572578788:2471]
2025-10-01T14:13:13.617095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256194572578788:2471]
2025-10-01T14:13:13.617098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256194572578788:2471]
2025-10-01T14:13:13.617129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:13.617134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:13.617136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:13.617137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:13.617140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.617142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:13.617294Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:13.617832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:13.670704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256196949477675:6233]
2025-10-01T14:13:13.670936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1899, pipe: [1:7556256196949477675:6233]
2025-10-01T14:13:13.750440Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:13.750653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.750667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.750701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477675:6233], now have 1 active actors on pipe
2025-10-01T14:13:13.750862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:13.750926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:13.750933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256196949477675:6233]
2025-10-01T14:13:13.750989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:13.751057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1900 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca3f61da-11855237-f28b87d2-21150c3d_0
2025-10-01T14:13:13.751236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1900 sessionId: src_id|ca3f61da-11855237-f28b87d2-21150c3d_0 is DEAD
2025-10-01T14:13:13.751380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3f61da-11855237-f28b87d2-21150c3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:13.751395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3f61da-11855237-f28b87d2-21150c3d_0] Write session will restart in 0.005427s
2025-10-01T14:13:13.751415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3f61da-11855237-f28b87d2-21150c3d_0] Write session: Do CDS request
2025-10-01T14:13:13.751420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3f61da-11855237-f28b87d2-21150c3d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:13.757728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3f61da-11855237-f28b87d2-21150c3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.757853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:13.757865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1901
2025-10-01T14:13:13.757967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.757994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:13.758000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:13.758003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:13.758401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1901 sessionId:  describe result for acl check
2025-10-01T14:13:13.758427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:13.758430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:13.758431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:13.758435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256196949477739:10272] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:13.758720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256196949477739:10272] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:13.760860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256196949477739:10272] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:13.763010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256196949477739:10272] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:13.763024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256196949477739:10272] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:13.763026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256196949477739:10272] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:13.763031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:13.764506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:13.766525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:13.766700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:13.766708Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:13.766718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:13.766760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:13.766862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256194572579032:2464]
2025-10-01T14:13:13.767448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:13.767670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:13.767707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:13.767991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:13.768037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.768042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.768043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.768044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.768045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.768046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.768048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.768049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.768050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.768051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.768053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.768054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.768055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.768056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.768060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.768070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.768074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.768078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.768082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.768085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.768089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.768093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.768096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.768100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.768103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.768107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.768114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.768117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.768127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.768137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.768147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.768156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.768163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.768173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.768180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.768185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.768193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.768198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.768205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.768210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.768219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.768227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.768235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.768244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.768252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.768261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.768268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.768273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.768280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.768288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.768296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.768304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.768311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.768316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.768323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.768328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.768372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:13.771713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:13.772553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:13.772567Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:13.772569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:13.772573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:13.772579Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1900 [2:7556256194572579032:2464]
2025-10-01T14:13:13.772594Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:13.772609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:13.772612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.772625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.772631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.772645Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:13.772653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:13.772658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:13.772706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.772712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.772714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.772717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:13.772719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:13.772776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:13.772781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.772792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.772806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.772826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:13.772846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477677:2446], now have 1 active actors on pipe
2025-10-01T14:13:13.772853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477916:10272], now have 1 active actors on pipe
2025-10-01T14:13:13.772860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256194572579026:2464]
2025-10-01T14:13:13.772865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256194572579026:2464]
2025-10-01T14:13:13.772867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256194572579026:2464]
2025-10-01T14:13:13.772879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:13.772893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:13.772897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:13.772900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:13.772902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:13.772909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:13.772915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:13.772907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1900
2025-10-01T14:13:13.772944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1900
2025-10-01T14:13:13.773040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256194572579026:2464]
2025-10-01T14:13:13.773052Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:13.773068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:13.773081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.773090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.773120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:13.773129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.773133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.773139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:13.773146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.773157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:13.773178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.773320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.773327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.773340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.773400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1901 partition: 0 MaxSeqNo: 45 sessionId: src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0
2025-10-01T14:13:13.773695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca3f61da-11855237-f28b87d2-21150c3d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:13.775853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0] Write session: try to update token
2025-10-01T14:13:13.775868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:13.788273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1901 sessionId: src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:13.790424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:13.790586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.790608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.790644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:13.790717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:13.792607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:13.792632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:13.792634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:13.792636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:13.792643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256194572579026:2464]
2025-10-01T14:13:13.792650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256194572579026:2464]
2025-10-01T14:13:13.792654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256194572579026:2464]
2025-10-01T14:13:13.792688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:13.792690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:13.792693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:13.792695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.792696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:13.792696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:13.792858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:13.850889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256196949477940:6233]
2025-10-01T14:13:13.851115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 1900, pipe: [1:7556256196949477940:6233]
2025-10-01T14:13:13.926308Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:13.932793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.932817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.932966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.933017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.933078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.933130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.933465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.933474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.933531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.933584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.933747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.933801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.933897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.933902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.933957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.934028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.934104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.934152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.934189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.934194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.934259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.934382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.934486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.934532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.934567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.934572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.934622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.934666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.934713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.934763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.934814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.934820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.934869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.934913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.934963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.935025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.935117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.935122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.935175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.935222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.935279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.935333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.935369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.935374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.935426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.935479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.935530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.935584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.935623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.935628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.935681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.935731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.935783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.935835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.935873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.935878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.935934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:13.935984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:13.936036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:13.936089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:13.936130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:13.936135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:13.936173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477940:6233], now have 1 active actors on pipe
2025-10-01T14:13:13.936422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:13.936442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256196949477940:6233]
2025-10-01T14:13:13.936466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:13.936469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:13.936473Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:13:13.936493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1901 reason: error at write: Disconnected sessionId: src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0
2025-10-01T14:13:13.936571Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 19 consumer shared/user session shared/user_1_19_46139338470068103_v1 is DEAD
2025-10-01T14:13:13.936583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1901 sessionId: src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0 is DEAD
2025-10-01T14:13:13.936598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:13.936684Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256106755144316:6239] disconnected; active server actors: 1
2025-10-01T14:13:13.936692Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256106755144316:6239] client user disconnected session shared/user_1_19_46139338470068103_v1
2025-10-01T14:13:13.936867Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:13:13.936868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:13.936885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0] Write session will restart in 0.009770s
2025-10-01T14:13:13.936905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0] Write session: Do CDS request
2025-10-01T14:13:13.936910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:13.936991Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:13:13.936995Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:13:13.937004Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.008477s
2025-10-01T14:13:13.946785Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:13:13.946954Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:13:13.946965Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 20
2025-10-01T14:13:13.947088Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 20 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:13:13.947126Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:13:13.947188Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 auth for : user
2025-10-01T14:13:13.947314Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 Handle describe topics response
2025-10-01T14:13:13.947345Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 auth is DEAD
2025-10-01T14:13:13.947349Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:13:13.947514Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:13:13.947581Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_20_11504260435889637302_v1
2025-10-01T14:13:13.947720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.947755Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256196949478059:10282] connected; active server actors: 1
2025-10-01T14:13:13.947755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:13.947759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1902
2025-10-01T14:13:13.947768Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256196949478059:10282] session shared/user_1_20_11504260435889637302_v1
2025-10-01T14:13:13.947776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:13:13.947785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:13:13.947793Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_20_11504260435889637302_v1" (Sender=[1:7556256196949478043:10282], Pipe=[1:7556256196949478059:10282], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:13:13.947796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:13:13.947805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:13:13.947823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_20_11504260435889637302_v1" (Sender=[1:7556256196949478043:10282], Pipe=[1:7556256196949478059:10282], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:13:13.947837Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_20_11504260435889637302_v1" sender [1:7556256196949478043:10282] lock partition 0 for ReadingSession "shared/user_1_20_11504260435889637302_v1" (Sender=[1:7556256196949478043:10282], Pipe=[1:7556256196949478059:10282], Partitions=[], ActiveFamilyCount=1) generation 1 step 20
2025-10-01T14:13:13.947849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:13:13.947852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000042s
2025-10-01T14:13:13.947862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:13.947889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:13.947897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:13.947900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:13.947988Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 20 Session: "shared/user_1_20_11504260435889637302_v1" ClientId: "user" PipeClient { RawX1: 7556256196949478059 RawX2: 4503603922348074 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:13:13.948004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:13:13.948134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1902 sessionId:  describe result for acl check
2025-10-01T14:13:13.948155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:13.948160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:13.948162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:13.948166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256196949478092:10285] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:13.948644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256196949478092:10285] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:13.950970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:13.951108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256196949478092:10285] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:13.952970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:13.953109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:13.953117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:13.953124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:13.953156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:13.953179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256194572579273:2465]
2025-10-01T14:13:13.953248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256196949478092:10285] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:13.953260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256196949478092:10285] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:13.953263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256196949478092:10285] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:13.953270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:13.953561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:13.953762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:13.953789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:13.954000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:13.954038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.954042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.954043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.954044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.954044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.954045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.954046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.954046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.954047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.954047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.954048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.954048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.954049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.954050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.954053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.954058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.954061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.954063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.954065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.954067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.954069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.954071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.954073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.954075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.954077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.954079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.954081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.954083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.954088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.954093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:13.954097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.954100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:13.954102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.954105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:13.954107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.954111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:13.954113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.954116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:13.954118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.954121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:13.954123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.954126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:13.954128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.954131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:13.954133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.954140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:13.954143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.954146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.954151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.954153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.954156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.954159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.954161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.954164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:13.954167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.954169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:13.954188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:13.957469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:13.958327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:13.958338Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:13.958340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:13.958343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:13.958347Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1901 [2:7556256194572579273:2465]
2025-10-01T14:13:13.958362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:13.958387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:13.958390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.958393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.958396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.958411Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:13.958419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:13.958425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:13.958469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.958475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.958476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.958479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:13.958481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:13.958537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:13.958543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.958555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:13.958568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:13.958583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:13.958603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949477944:2446], now have 1 active actors on pipe
2025-10-01T14:13:13.958609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949478182:10285], now have 1 active actors on pipe
2025-10-01T14:13:13.958612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256196949478084:10286], now have 1 active actors on pipe
2025-10-01T14:13:13.958619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256194572579268:2465]
2025-10-01T14:13:13.958623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256194572579268:2465]
2025-10-01T14:13:13.958625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256194572579268:2465]
2025-10-01T14:13:13.958638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:13.958652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:13.958658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:13.958661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:13.958663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:13.958668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:13.958639Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1901
2025-10-01T14:13:13.958671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:13.958676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1901
2025-10-01T14:13:13.958680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1901, pipe: [1:7556256196949478084:10286]
2025-10-01T14:13:13.958698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256194572579268:2465]
2025-10-01T14:13:13.958704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:13.958710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:13.958718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.958722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.958734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_20_11504260435889637302_v1 on pipe: [1:7556256196949478084:10286]
2025-10-01T14:13:13.958752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.958757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.958773Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_20_11504260435889637302_v1:1 with generation 1901
2025-10-01T14:13:13.958785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.958789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.958792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:13.958806Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_20_11504260435889637302_v1
2025-10-01T14:13:13.958812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.958838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:13.958846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:13:13.958853Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:13:13.962860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:13:13.962886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:13:13.962893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:13.962898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:13.962902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:13.962910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:13.962923Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:13.962932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:13:13.962947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:13:13.962963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.963080Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759327993958 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:13:13.963097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:13:13.963124Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 sending to client partition status
2025-10-01T14:13:13.963147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:13.963155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:13.963182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:13.963241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1902 partition: 0 MaxSeqNo: 45 sessionId: src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0
2025-10-01T14:13:13.963555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34fe9ef0-f3c32dcc-a5458b20-4a205685_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:13.965942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0] Write session: try to update token
2025-10-01T14:13:13.965956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:13.979040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:13.979055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:13.979057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:13.979059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:13.979069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256194572579268:2465]
2025-10-01T14:13:13.979073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256194572579268:2465]
2025-10-01T14:13:13.979077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256194572579268:2465]
2025-10-01T14:13:13.979120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:13.979123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:13.979129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:13.979132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:13.979132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:13.979136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:13.979265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:13.979396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1902 sessionId: src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:13.981583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:14.109805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:14.109982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.109994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.110186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_20_11504260435889637302_v1
2025-10-01T14:13:14.110201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:14.110177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:14.110189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:14.110232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1902 reason: error at write: Disconnected sessionId: src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0
2025-10-01T14:13:14.110278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:14.110325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256196949478084:10286]
2025-10-01T14:13:14.110451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1902 sessionId: src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0 is DEAD
2025-10-01T14:13:14.110562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:14.110571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0] Write session will restart in 0.006359s
2025-10-01T14:13:14.110560Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_20_11504260435889637302_v1
2025-10-01T14:13:14.110602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0] Write session: Do CDS request
2025-10-01T14:13:14.110609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:14.117806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.117916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:14.117929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1903
2025-10-01T14:13:14.118048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.118078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:14.118088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:14.118091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:14.118472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1903 sessionId:  describe result for acl check
2025-10-01T14:13:14.118501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:14.118502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:14.118504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:14.118508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256201244445590:10290] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:14.118963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256201244445590:10290] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:14.120977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256201244445590:10290] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:14.122363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:14.124885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:14.125037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:14.125044Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:14.125052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:14.125050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256201244445590:10290] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:14.125065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256201244445590:10290] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:14.125068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256201244445590:10290] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:14.125076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:14.125097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:14.125121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256198867546837:2430]
2025-10-01T14:13:14.125527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:14.125736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:14.125762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:14.125990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:14.126032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.126036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.126037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.126037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.126038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.126038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.126039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.126040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.126040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.126041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.126041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.126042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.126042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.126043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.126046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.126051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.126053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.126056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.126058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.126060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.126062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.126064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.126066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.126069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.126071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.126072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.126074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.126076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.126081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.126085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.126089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.126092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.126094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.126097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.126099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.126102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.126104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.126108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.126110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.126113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.126116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.126119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.126122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.126127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.126129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.126133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.126138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.126140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.126143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.126145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.126147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.126153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.126155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.126158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.126160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.126163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.126182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:14.129487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:14.130288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:14.130300Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:14.130301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:14.130303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:14.130308Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1902 [2:7556256198867546837:2430]
2025-10-01T14:13:14.130318Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:14.130329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:14.130331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.130333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.130334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.130345Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:14.130348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:14.130352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:14.130409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.130417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.130418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.130421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:14.130424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:14.130485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:14.130494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.130506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.130516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.130532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:14.130553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244445723:10290], now have 1 active actors on pipe
2025-10-01T14:13:14.130560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244445491:2446], now have 1 active actors on pipe
2025-10-01T14:13:14.130567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256198867546832:2430]
2025-10-01T14:13:14.130573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256198867546832:2430]
2025-10-01T14:13:14.130575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256198867546832:2430]
2025-10-01T14:13:14.130582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1902
2025-10-01T14:13:14.130587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:14.130602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:14.130603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:14.130605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:14.130607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:14.130615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:14.130617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:14.130612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1902
2025-10-01T14:13:14.130652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.130660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.130675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256198867546832:2430]
2025-10-01T14:13:14.130686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:14.130704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:14.130714Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95e46c87-296c9238-b5d9358e-50bafe19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:14.130723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.130731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.130737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:14.130745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.130758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:14.130784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.130899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.130907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.130920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.131030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1903 partition: 0 MaxSeqNo: 45 sessionId: src_id|95e46c87-296c9238-b5d9358e-50bafe19_0
2025-10-01T14:13:14.131437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5efe9ba-a57cf36b-b9f96d1f-4fa970a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|95e46c87-296c9238-b5d9358e-50bafe19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:14.133832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95e46c87-296c9238-b5d9358e-50bafe19_0] Write session: try to update token
2025-10-01T14:13:14.133848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95e46c87-296c9238-b5d9358e-50bafe19_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:14.146423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1903 sessionId: src_id|95e46c87-296c9238-b5d9358e-50bafe19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:14.148507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:14.149628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.149652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.149672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:14.149675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:14.149678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:14.149679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:14.149687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256198867546832:2430]
2025-10-01T14:13:14.149691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256198867546832:2430]
2025-10-01T14:13:14.149695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256198867546832:2430]
2025-10-01T14:13:14.149732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:14.149742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:14.149744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:14.149745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:14.149749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.149751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:14.149876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:14.210328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256201244445735:10286]
2025-10-01T14:13:14.210548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 1902, pipe: [1:7556256201244445735:10286]
2025-10-01T14:13:14.281653Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:14.281842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:14.281883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244445735:10286], now have 1 active actors on pipe
2025-10-01T14:13:14.281957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:14.282045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256201244445735:10286]
2025-10-01T14:13:14.282076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:14.291605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:14.291618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:14.291636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1903 reason: error at write: Disconnected sessionId: src_id|95e46c87-296c9238-b5d9358e-50bafe19_0
2025-10-01T14:13:14.291763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1903 sessionId: src_id|95e46c87-296c9238-b5d9358e-50bafe19_0 is DEAD
2025-10-01T14:13:14.291886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e46c87-296c9238-b5d9358e-50bafe19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:14.291896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e46c87-296c9238-b5d9358e-50bafe19_0] Write session will restart in 0.008635s
2025-10-01T14:13:14.291918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e46c87-296c9238-b5d9358e-50bafe19_0] Write session: Do CDS request
2025-10-01T14:13:14.291924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e46c87-296c9238-b5d9358e-50bafe19_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:14.296685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:14.298714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:14.298855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:14.298862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:14.298869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:14.298902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:14.298926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256198867547085:2420]
2025-10-01T14:13:14.299294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:14.299530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:14.299587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:14.299802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:14.299838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.299842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.299842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.299843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.299843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.299844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.299845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.299845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.299846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.299846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.299847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.299847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.299848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.299848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.299852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.299857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.299859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.299861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.299863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.299865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.299867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.299869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.299871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.299873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.299875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.299877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.299879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.299881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.299885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.299889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.299893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.299903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.299905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.299909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.299911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.299914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.299916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.299919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.299921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.299924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.299926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.299929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.299931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.299933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.299936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.299938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.299940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.299943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.299946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.299948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.299959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.299967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.299970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.299973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.299975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.299977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.299997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:14.301795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95e46c87-296c9238-b5d9358e-50bafe19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.301914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:14.301928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1904
2025-10-01T14:13:14.302046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.302074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:14.302086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:14.302092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:14.302385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1904 sessionId:  describe result for acl check
2025-10-01T14:13:14.302415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:14.302421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:14.302423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:14.302427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256201244445940:10294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:14.302843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256201244445940:10294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:14.303301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:14.303886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:14.303898Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:14.303899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:14.303901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:14.303905Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1903 [2:7556256198867547085:2420]
2025-10-01T14:13:14.303916Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:14.303926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:14.303930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.303933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.303934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.303946Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:14.303952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:14.303958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:14.304004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.304010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.304012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.304015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:14.304017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:14.304075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:14.304084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.304094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.304102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.304115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:14.304134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244445737:2446], now have 1 active actors on pipe
2025-10-01T14:13:14.304145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256198867547080:2420]
2025-10-01T14:13:14.304150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256198867547080:2420]
2025-10-01T14:13:14.304152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256198867547080:2420]
2025-10-01T14:13:14.304141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1903
2025-10-01T14:13:14.304159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:14.304167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:14.304172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:14.304175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:14.304176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:14.304185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:14.304187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:14.304212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256198867547080:2420]
2025-10-01T14:13:14.304222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:14.304232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:14.304728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256201244445940:10294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:14.310264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256201244445940:10294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:14.310275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256201244445940:10294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:14.310278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256201244445940:10294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:14.310284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:14.310471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244445978:10294], now have 1 active actors on pipe
2025-10-01T14:13:14.310504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1903
2025-10-01T14:13:14.310557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.310564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.310583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6044703b-66b5d23e-b70c47d1-b7202084_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:14.310592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.310598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.310600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:14.310607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.310617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:14.310631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.310755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.310767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.310785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.310843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1904 partition: 0 MaxSeqNo: 45 sessionId: src_id|6044703b-66b5d23e-b70c47d1-b7202084_0
2025-10-01T14:13:14.311116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e46c87-296c9238-b5d9358e-50bafe19_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6044703b-66b5d23e-b70c47d1-b7202084_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:14.313311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6044703b-66b5d23e-b70c47d1-b7202084_0] Write session: try to update token
2025-10-01T14:13:14.313328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6044703b-66b5d23e-b70c47d1-b7202084_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:14.314083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:14.314093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:14.314098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256198867547080:2420]
2025-10-01T14:13:14.314128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:14.314132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:14.314262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:14.314430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:14.314545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:14.314657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:14.314814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:14.314839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:14.325179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1904 sessionId: src_id|6044703b-66b5d23e-b70c47d1-b7202084_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:14.327230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:14.327518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.327534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.327572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:14.327631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:14.331645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:14.331661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:14.331663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:14.331664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:14.331671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256198867547080:2420]
2025-10-01T14:13:14.331675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256198867547080:2420]
2025-10-01T14:13:14.331677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256198867547080:2420]
2025-10-01T14:13:14.331710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:14.331715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.331717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:14.331716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:14.331720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:14.331723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:14.331839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:14.382424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256201244445982:10286]
2025-10-01T14:13:14.382732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 1903, pipe: [1:7556256201244445982:10286]
2025-10-01T14:13:14.474302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:14.480953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.480975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.481110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.481164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.481216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.481266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.481308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.481315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.481371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.481418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.481469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.481522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.481564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.481569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.481627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.481679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.481733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.481821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.481859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.481864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.481921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.481975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.482029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.482100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.482138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.482144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.482200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.482257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.482311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.482366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.482421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.482427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.482504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.482557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.482612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.482666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.482719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.482724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.482782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.482832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.482888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.482977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.483016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.483022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.483112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.483176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.483243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.483302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.483342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.483347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.483403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.483456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.483510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.483562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.483603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.483608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.483663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:14.483718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:14.483774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:14.483830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:14.483881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:14.483888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:14.483925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244445982:10286], now have 1 active actors on pipe
2025-10-01T14:13:14.484073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:14.484120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256201244445982:10286]
2025-10-01T14:13:14.484142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:14.484149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:14.484170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1904 reason: error at write: Disconnected sessionId: src_id|6044703b-66b5d23e-b70c47d1-b7202084_0
2025-10-01T14:13:14.484367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1904 sessionId: src_id|6044703b-66b5d23e-b70c47d1-b7202084_0 is DEAD
2025-10-01T14:13:14.484498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6044703b-66b5d23e-b70c47d1-b7202084_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:14.484508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6044703b-66b5d23e-b70c47d1-b7202084_0] Write session will restart in 0.005435s
2025-10-01T14:13:14.484530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6044703b-66b5d23e-b70c47d1-b7202084_0] Write session: Do CDS request
2025-10-01T14:13:14.484536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6044703b-66b5d23e-b70c47d1-b7202084_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:14.484736Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:14.490788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6044703b-66b5d23e-b70c47d1-b7202084_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.490891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:14.490903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1905
2025-10-01T14:13:14.491015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.491037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:14.491045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:14.491047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:14.491347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1905 sessionId:  describe result for acl check
2025-10-01T14:13:14.491382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:14.491388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:14.491389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:14.491393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256201244446041:10300] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:14.491773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256201244446041:10300] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:14.494087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256201244446041:10300] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:14.496536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256201244446041:10300] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:14.496546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256201244446041:10300] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:14.496548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256201244446041:10300] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:14.496561Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:14.497460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:14.499679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:14.499834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:14.499842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:14.499850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:14.499882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:14.499910Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256198867547323:2412]
2025-10-01T14:13:14.500281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:14.500508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:14.500546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:14.500778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:14.500815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.500819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.500820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.500820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.500821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.500822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.500822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.500823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.500824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.500825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.500825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.500826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.500827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.500827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.500831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.500836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.500839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.500841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.500843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.500845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.500847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.500849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.500852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.500854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.500856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.500858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.500860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.500862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.500867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.500872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.500877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.500880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.500882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.500885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.500888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.500890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.500893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.500896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.500898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.500901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.500903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.500906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.500908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.500911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.500914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.500916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.500919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.500922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.500924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.500927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.500929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.500933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.500935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.500938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.500940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.500943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.500966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:14.504320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:14.504855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:14.504866Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:14.504867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:14.504869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:14.504874Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1904 [2:7556256198867547323:2412]
2025-10-01T14:13:14.504883Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:14.504896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:14.504901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.504904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.504905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.504916Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:14.504923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:14.504927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:14.504960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.504965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.504966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.504968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:14.504970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:14.505013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:14.505018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.505026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.505031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.505043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:14.505058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244446000:2446], now have 1 active actors on pipe
2025-10-01T14:13:14.505067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256198867547318:2412]
2025-10-01T14:13:14.505069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256198867547318:2412]
2025-10-01T14:13:14.505070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256198867547318:2412]
2025-10-01T14:13:14.505079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:14.505087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244446232:10300], now have 1 active actors on pipe
2025-10-01T14:13:14.505087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:14.505089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:14.505091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:14.505092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:14.505100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:14.505101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:14.505118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256198867547318:2412]
2025-10-01T14:13:14.505125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:14.505129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:14.505145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1904
2025-10-01T14:13:14.505161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1904
2025-10-01T14:13:14.505170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.505179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.505195Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:14.505199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.505202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.505203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:14.505208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.505214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:14.505223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.505360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.505367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.505377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.505467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1905 partition: 0 MaxSeqNo: 45 sessionId: src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0
2025-10-01T14:13:14.505824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6044703b-66b5d23e-b70c47d1-b7202084_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:14.508130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0] Write session: try to update token
2025-10-01T14:13:14.508145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:14.520785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1905 sessionId: src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:14.523034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:14.524367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.524391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.524412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:14.524417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:14.524421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:14.524423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:14.524431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256198867547318:2412]
2025-10-01T14:13:14.524436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256198867547318:2412]
2025-10-01T14:13:14.524439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256198867547318:2412]
2025-10-01T14:13:14.524467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:14.524476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:14.524479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:14.524492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:14.524505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.524511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:14.524652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:14.584091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256201244446250:10286]
2025-10-01T14:13:14.584312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 1904, pipe: [1:7556256201244446250:10286]
2025-10-01T14:13:14.660077Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:14.660704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:14.660758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244446250:10286], now have 1 active actors on pipe
2025-10-01T14:13:14.660819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:14.660948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256201244446250:10286]
2025-10-01T14:13:14.660971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:14.668759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:14.668769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:14.668786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1905 reason: error at write: Disconnected sessionId: src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0
2025-10-01T14:13:14.668889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1905 sessionId: src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0 is DEAD
2025-10-01T14:13:14.669015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:14.669022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0] Write session will restart in 0.007097s
2025-10-01T14:13:14.669049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0] Write session: Do CDS request
2025-10-01T14:13:14.669058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:14.676797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.676871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:14.676883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1906
2025-10-01T14:13:14.676982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.677004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:14.677011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:14.677013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:14.676997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:14.677290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1906 sessionId:  describe result for acl check
2025-10-01T14:13:14.677315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:14.677320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:14.677321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:14.677325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256201244446454:10304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:14.677729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256201244446454:10304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:14.678876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:14.678991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:14.678999Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:14.679006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:14.679035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:14.679061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256198867547562:2407]
2025-10-01T14:13:14.679419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:14.679601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:14.679626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:14.679677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256201244446454:10304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:14.679803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:14.679836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.679840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.679840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.679841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.679842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.679842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.679843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.679843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.679844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.679844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.679845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.679846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.679846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.679847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.679849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.679856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.679859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.679863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.679866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.679869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.679872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.679875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.679879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.679882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.679885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.679889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.679892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.679896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.679900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.679904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.679908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.679910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.679913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.679915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.679917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.679920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.679923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.679926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.679928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.679931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.679934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.679936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.679938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.679941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.679943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.679946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.679948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.679951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.679953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.679955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.679957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.679960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.679964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.679966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.679969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.679971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.679989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:14.682839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256201244446454:10304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:14.682848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256201244446454:10304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:14.682852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256201244446454:10304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:14.682857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:14.683036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:14.683544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:14.683554Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:14.683556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:14.683558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:14.683562Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1905 [2:7556256198867547562:2407]
2025-10-01T14:13:14.683571Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:14.683581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:14.683586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.683588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.683589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.683598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:14.683605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:14.683609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:14.683642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.683647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.683648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.683650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:14.683652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:14.683693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:14.683700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.683706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.683712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.683720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:14.683730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244446252:2446], now have 1 active actors on pipe
2025-10-01T14:13:14.683734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244446492:10304], now have 1 active actors on pipe
2025-10-01T14:13:14.683742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256198867547557:2407]
2025-10-01T14:13:14.683743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256198867547557:2407]
2025-10-01T14:13:14.683744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256198867547557:2407]
2025-10-01T14:13:14.683752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:14.683764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:14.683764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:14.683766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:14.683767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:14.683772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:14.683773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:14.683757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1905
2025-10-01T14:13:14.683762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1905
2025-10-01T14:13:14.683788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256198867547557:2407]
2025-10-01T14:13:14.683793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:14.683795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:14.683806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.683812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.683838Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c436a781-7ba11e47-52a9a30-d5488622_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:14.683846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.683849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.683850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:14.683856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.683864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:14.683878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.683966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.683973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.683985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.684039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1906 partition: 0 MaxSeqNo: 45 sessionId: src_id|c436a781-7ba11e47-52a9a30-d5488622_0
2025-10-01T14:13:14.684264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eadca38-ae8e5c52-4c1ba6b6-7714ac5d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c436a781-7ba11e47-52a9a30-d5488622_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:14.686507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c436a781-7ba11e47-52a9a30-d5488622_0] Write session: try to update token
2025-10-01T14:13:14.686520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c436a781-7ba11e47-52a9a30-d5488622_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:14.699408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1906 sessionId: src_id|c436a781-7ba11e47-52a9a30-d5488622_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:14.701670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:14.702783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.702801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.702817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:14.702819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:14.702821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:14.702822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:14.702828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256198867547557:2407]
2025-10-01T14:13:14.702831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256198867547557:2407]
2025-10-01T14:13:14.702834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256198867547557:2407]
2025-10-01T14:13:14.702863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:14.702873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:14.702875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:14.702876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:14.702880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.702881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:14.703004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:14.761273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256201244446499:10286]
2025-10-01T14:13:14.761503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 1905, pipe: [1:7556256201244446499:10286]
2025-10-01T14:13:14.834441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:14.834856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:14.834901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244446499:10286], now have 1 active actors on pipe
2025-10-01T14:13:14.835001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:14.835076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256201244446499:10286]
2025-10-01T14:13:14.835102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:14.844412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:14.844427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:14.844445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1906 reason: error at write: Disconnected sessionId: src_id|c436a781-7ba11e47-52a9a30-d5488622_0
2025-10-01T14:13:14.844564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1906 sessionId: src_id|c436a781-7ba11e47-52a9a30-d5488622_0 is DEAD
2025-10-01T14:13:14.844685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c436a781-7ba11e47-52a9a30-d5488622_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:14.844694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c436a781-7ba11e47-52a9a30-d5488622_0] Write session will restart in 0.009205s
2025-10-01T14:13:14.844717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c436a781-7ba11e47-52a9a30-d5488622_0] Write session: Do CDS request
2025-10-01T14:13:14.844725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c436a781-7ba11e47-52a9a30-d5488622_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:14.850143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:14.852168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:14.852288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:14.852295Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:14.852302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:14.852335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:14.852370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256198867547808:2396]
2025-10-01T14:13:14.852762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:14.852949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:14.852973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:14.853154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:14.853187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.853191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.853192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.853193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.853193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.853194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.853194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.853195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.853196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.853196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.853197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.853197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.853198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.853198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.853201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.853207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.853209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.853211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.853213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.853215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.853217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.853219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.853221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.853223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.853225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.853227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.853228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.853230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.853234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.853239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:14.853242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.853245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:14.853247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.853249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:14.853252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.853254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:14.853257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.853259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:14.853261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.853264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:14.853267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.853270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:14.853272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.853275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:14.853277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.853280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:14.853283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.853286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.853288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.853291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.853293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.853296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.853302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.853304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:14.853306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.853309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:14.853331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:14.854715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c436a781-7ba11e47-52a9a30-d5488622_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.854784Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:14.854796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1907
2025-10-01T14:13:14.854882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:14.854902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:14.854909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:14.854911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:14.855205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1907 sessionId:  describe result for acl check
2025-10-01T14:13:14.855230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:14.855235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:14.855236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:14.855239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256201244446732:10315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:14.855599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256201244446732:10315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:14.856602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:14.857016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256201244446732:10315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:14.857496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:14.857510Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:14.857512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:14.857514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:14.857520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1906 [2:7556256198867547808:2396]
2025-10-01T14:13:14.857535Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:14.857549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:14.857556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.857559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.857561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.857579Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:14.857587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:14.857594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:14.857647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.857653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.857655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.857658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:14.857661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:14.857721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:14.857728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.857738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:14.857751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:14.857769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:14.857789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244446525:2446], now have 1 active actors on pipe
2025-10-01T14:13:14.857799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256198867547803:2396]
2025-10-01T14:13:14.857804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256198867547803:2396]
2025-10-01T14:13:14.857806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256198867547803:2396]
2025-10-01T14:13:14.857778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1906
2025-10-01T14:13:14.857816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:14.857818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:14.857820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:14.857821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:14.857831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:14.857843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:14.857849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:14.857878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256198867547803:2396]
2025-10-01T14:13:14.857889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:14.857892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:14.862791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256201244446732:10315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:14.862804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256201244446732:10315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:14.862807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256201244446732:10315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:14.862812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:14.863015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244446767:10315], now have 1 active actors on pipe
2025-10-01T14:13:14.863046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1906
2025-10-01T14:13:14.863100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.863110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.863134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6444096e-a800b186-4cb43e76-e0e91add_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:14.863145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:14.863151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:14.863152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:14.863161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:14.863173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:14.863189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.863316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.863322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.863334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:14.863401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1907 partition: 0 MaxSeqNo: 45 sessionId: src_id|6444096e-a800b186-4cb43e76-e0e91add_0
2025-10-01T14:13:14.863717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c436a781-7ba11e47-52a9a30-d5488622_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6444096e-a800b186-4cb43e76-e0e91add_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:14.865942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6444096e-a800b186-4cb43e76-e0e91add_0] Write session: try to update token
2025-10-01T14:13:14.865956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6444096e-a800b186-4cb43e76-e0e91add_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:14.868789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:14.868809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:14.868821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256198867547803:2396]
2025-10-01T14:13:14.868853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:14.868870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:14.869064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:14.869223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:14.869384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:14.869538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:14.869759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:14.869805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:14.878861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1907 sessionId: src_id|6444096e-a800b186-4cb43e76-e0e91add_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:14.880927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:14.881106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:14.881123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:14.881151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:14.881200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:14.886920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:14.886943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:14.886945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:14.886948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:14.886959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256198867547803:2396]
2025-10-01T14:13:14.886964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256198867547803:2396]
2025-10-01T14:13:14.886968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256198867547803:2396]
2025-10-01T14:13:14.887002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:14.887012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:14.887015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:14.887018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:14.887026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:14.887034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:14.887209Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:14.935334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256201244446772:10286]
2025-10-01T14:13:14.935653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 1906, pipe: [1:7556256201244446772:10286]
2025-10-01T14:13:15.027159Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:15.033960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.033983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.034110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.034161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.034226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.034277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.034318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.034325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.034401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.034458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.034512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.034561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.034605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.034611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.034668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.034729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.034780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.034833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.034871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.034877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.034934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.034992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.035044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.035097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.035137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.035142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.035200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.035259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.035313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.035367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.035406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.035412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.035467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.035518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.035572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.035625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.035664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.035669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.035733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.035784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.035838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.035895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.035932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.035937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.035993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.036043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.036093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.036144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.036182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.036187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.036249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.036303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.036355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.036407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.036444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.036449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.036505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.036559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.036611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.036678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.036721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.036728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.036771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256201244446772:10286], now have 1 active actors on pipe
2025-10-01T14:13:15.037037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:15.037040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256201244446772:10286]
2025-10-01T14:13:15.037050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:15.037054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:15.037072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1907 reason: error at write: Disconnected sessionId: src_id|6444096e-a800b186-4cb43e76-e0e91add_0
2025-10-01T14:13:15.037230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1907 sessionId: src_id|6444096e-a800b186-4cb43e76-e0e91add_0 is DEAD
2025-10-01T14:13:15.037342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6444096e-a800b186-4cb43e76-e0e91add_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:15.037351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6444096e-a800b186-4cb43e76-e0e91add_0] Write session will restart in 0.007140s
2025-10-01T14:13:15.037371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6444096e-a800b186-4cb43e76-e0e91add_0] Write session: Do CDS request
2025-10-01T14:13:15.037386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6444096e-a800b186-4cb43e76-e0e91add_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:15.037545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:15.045783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6444096e-a800b186-4cb43e76-e0e91add_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.045863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:15.045875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1908
2025-10-01T14:13:15.045966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.045999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:15.046006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:15.046009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:15.046350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1908 sessionId:  describe result for acl check
2025-10-01T14:13:15.046394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:15.046399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:15.046401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:15.046406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256205539414168:10320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:15.046864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256205539414168:10320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:15.049140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256205539414168:10320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:15.050036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:15.050304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:15.050440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:15.050448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:15.050460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:15.050507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:15.050545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256203162515344:2393]
2025-10-01T14:13:15.051081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:15.052457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:15.052500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:15.052659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256205539414168:10320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:15.052670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256205539414168:10320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:15.052673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256205539414168:10320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:15.052680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:15.052786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:15.052839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.052845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.052846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.052847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.052848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.052849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.052850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.052851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.052851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.052852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.052853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.052854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.052856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.052857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.052861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.052869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.052873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.052876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.052879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.052882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.052885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.052889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.052896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.052899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.052902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.052909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.052913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.052916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.052926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.052936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.052946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.052951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.052958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.052964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.052972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.052981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.052989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.052995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.053003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.053011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.053020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.053027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.053033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.053037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.053045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.053053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.053056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.053060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.053064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.053073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.053080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.053084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.053092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.053100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.053107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.053116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.053154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:15.056314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:15.057000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:15.057012Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:15.057013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:15.057016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:15.057020Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1907 [2:7556256203162515344:2393]
2025-10-01T14:13:15.057031Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:15.057041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:15.057043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.057045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.057047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.057057Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:15.057060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:15.057066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:15.057101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.057106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.057107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.057110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:15.057111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:15.057158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:15.057164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.057174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.057184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.057203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:15.057218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414309:10320], now have 1 active actors on pipe
2025-10-01T14:13:15.057224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414073:2446], now have 1 active actors on pipe
2025-10-01T14:13:15.057229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256203162515339:2393]
2025-10-01T14:13:15.057230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256203162515339:2393]
2025-10-01T14:13:15.057232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256203162515339:2393]
2025-10-01T14:13:15.057241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:15.057250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:15.057253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:15.057255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:15.057257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:15.057261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:15.057263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:15.057280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256203162515339:2393]
2025-10-01T14:13:15.057282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:15.057270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1907
2025-10-01T14:13:15.057277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1907
2025-10-01T14:13:15.057299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:15.057306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.057309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.057328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:15.057336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.057339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.057340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:15.057346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.057352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:15.057362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.057464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.057469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.057478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.057545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1908 partition: 0 MaxSeqNo: 45 sessionId: src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0
2025-10-01T14:13:15.057911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6444096e-a800b186-4cb43e76-e0e91add_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:15.060300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0] Write session: try to update token
2025-10-01T14:13:15.060312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:15.067646Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:15.067660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:15.067668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256203162515339:2393]
2025-10-01T14:13:15.067698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:15.067701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:15.067846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:15.067970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:15.068084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:15.068197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:15.068357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:15.068386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:15.072851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1908 sessionId: src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:15.075075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:15.075245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.075263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.075289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:15.075362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:15.086915Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:15.086928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:15.086930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:15.086933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:15.086942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256203162515339:2393]
2025-10-01T14:13:15.086946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256203162515339:2393]
2025-10-01T14:13:15.086951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256203162515339:2393]
2025-10-01T14:13:15.086989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:15.086995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:15.086998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.087000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:15.087000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:15.087003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:15.087110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:15.137330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256205539414320:10286]
2025-10-01T14:13:15.137527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 1907, pipe: [1:7556256205539414320:10286]
2025-10-01T14:13:15.223591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:15.230441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.230462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.230604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.230656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.230708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.230765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.230813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.230825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.230885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.230936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.230989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.231042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.231080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.231085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.231164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.231212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.231262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.231320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.231362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.231369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.231431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.231480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.231528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.231579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.231706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.231711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.231763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.231815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.231873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.231922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.231962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.231967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.232017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.232064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.232114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.232166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.232205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.232209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.232260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.232308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.232367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.232417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.232456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.232462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.232515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.232563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.232629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.232683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.232721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.232727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.232782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.232835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.232895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.232948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.232987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.232992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.233046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.233094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.233144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.233199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.233254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.233259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.233302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414320:10286], now have 1 active actors on pipe
2025-10-01T14:13:15.233507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256205539414320:10286]
2025-10-01T14:13:15.233532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:15.233544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:15.233548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:15.233573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1908 reason: error at write: Disconnected sessionId: src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0
2025-10-01T14:13:15.233758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1908 sessionId: src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0 is DEAD
2025-10-01T14:13:15.233854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:15.233863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0] Write session will restart in 0.005895s
2025-10-01T14:13:15.233891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0] Write session: Do CDS request
2025-10-01T14:13:15.233896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:15.234118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:15.240882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.241012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:15.241025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1909
2025-10-01T14:13:15.241129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.241156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:15.241164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:15.241168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:15.241578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1909 sessionId:  describe result for acl check
2025-10-01T14:13:15.241613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:15.241620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:15.241622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:15.241627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256205539414391:10324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:15.242113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256205539414391:10324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:15.245489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256205539414391:10324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:15.247766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:15.248205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256205539414391:10324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:15.248218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256205539414391:10324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:15.248221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256205539414391:10324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:15.248229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:15.249962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:15.250144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:15.250154Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:15.250165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:15.250207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:15.250241Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256203162515630:2359]
2025-10-01T14:13:15.250840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:15.251098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:15.251148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:15.251457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:15.251515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.251522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.251523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.251524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.251526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.251527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.251528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.251529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.251530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.251531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.251532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.251533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.251534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.251536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.251541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.251550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.251558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.251562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.251566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.251576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.251583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.251587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.251595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.251598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.251607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.251611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.251614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.251623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.251630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.251642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.251653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.251662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.251672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.251682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.251686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.251692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.251697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.251702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.251711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.251720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.251729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.251738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.251746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.251756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.251760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.251765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.251769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.251775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.251784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.251794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.251803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.251812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.251824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.251828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.251833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.251842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.251885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:15.255411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:15.255936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:15.255948Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:15.255949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:15.255952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:15.255956Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1908 [2:7556256203162515630:2359]
2025-10-01T14:13:15.255966Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:15.255980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:15.255983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.255986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.255988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.256002Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:15.256009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:15.256016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:15.256060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.256066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.256067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.256069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:15.256071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:15.256119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:15.256125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.256132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.256138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.256147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:15.256164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414331:2446], now have 1 active actors on pipe
2025-10-01T14:13:15.256174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256203162515624:2359]
2025-10-01T14:13:15.256175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256203162515624:2359]
2025-10-01T14:13:15.256176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256203162515624:2359]
2025-10-01T14:13:15.256190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:15.256202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:15.256203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414566:10324], now have 1 active actors on pipe
2025-10-01T14:13:15.256210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:15.256211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:15.256214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:15.256222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:15.256225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:15.256248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256203162515624:2359]
2025-10-01T14:13:15.256259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:15.256271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:15.256262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1908
2025-10-01T14:13:15.256272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1908
2025-10-01T14:13:15.256308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.256317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.256342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|400bc234-4c21cc50-2710110-bc7160f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:15.256352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.256356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.256362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:15.256372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.256384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:15.256397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.256530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.256543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.256561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.256656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1909 partition: 0 MaxSeqNo: 45 sessionId: src_id|400bc234-4c21cc50-2710110-bc7160f5_0
2025-10-01T14:13:15.257043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96d7a57d-d7e93bd9-d86b78a6-b0768d8e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|400bc234-4c21cc50-2710110-bc7160f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:15.259904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400bc234-4c21cc50-2710110-bc7160f5_0] Write session: try to update token
2025-10-01T14:13:15.259922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400bc234-4c21cc50-2710110-bc7160f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:15.271545Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:15.271560Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:15.271567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256203162515624:2359]
2025-10-01T14:13:15.271604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:15.271604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:15.271751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:15.271885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:15.272005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:15.272121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:15.272295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:15.272333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:15.274073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1909 sessionId: src_id|400bc234-4c21cc50-2710110-bc7160f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:15.276360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:15.276573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.276595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.276646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:15.276731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:15.284213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:15.284235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:15.284237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:15.284239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:15.284248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256203162515624:2359]
2025-10-01T14:13:15.284252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256203162515624:2359]
2025-10-01T14:13:15.284258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256203162515624:2359]
2025-10-01T14:13:15.284296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:15.284301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:15.284305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:15.284307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.284307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:15.284309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:15.284432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:15.333701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256205539414578:10286]
2025-10-01T14:13:15.333956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 1908, pipe: [1:7556256205539414578:10286]
2025-10-01T14:13:15.415701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:15.422218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.422240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.422387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.422438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.422488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.422532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.422570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.422577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.422630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.422678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.422725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.422775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.422814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.422819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.422875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.422925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.423002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.423072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.423109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.423115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.423170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.423224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.423274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.423328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.423366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.423371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.423421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.423472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.423522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.423571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.423609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.423614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.423664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.423714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.423766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.423818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.423856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.423861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.423914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.423962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.424014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.424064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.424101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.424105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.424158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.424206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.424259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.424311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.424350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.424355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.424407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.424456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.424506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.424557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.424594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.424599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.424663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.424713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.424763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.424810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.424844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.424850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.424887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414578:10286], now have 1 active actors on pipe
2025-10-01T14:13:15.425109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:15.425121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:15.425140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256205539414578:10286]
2025-10-01T14:13:15.425141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1909 reason: error at write: Disconnected sessionId: src_id|400bc234-4c21cc50-2710110-bc7160f5_0
2025-10-01T14:13:15.425165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:15.425342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1909 sessionId: src_id|400bc234-4c21cc50-2710110-bc7160f5_0 is DEAD
2025-10-01T14:13:15.425522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400bc234-4c21cc50-2710110-bc7160f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:15.425530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400bc234-4c21cc50-2710110-bc7160f5_0] Write session will restart in 0.006712s
2025-10-01T14:13:15.425551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400bc234-4c21cc50-2710110-bc7160f5_0] Write session: Do CDS request
2025-10-01T14:13:15.425556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400bc234-4c21cc50-2710110-bc7160f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:15.425646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:15.433899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|400bc234-4c21cc50-2710110-bc7160f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.433934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:15.433947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1910
2025-10-01T14:13:15.434105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.434138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:15.434151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:15.434160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:15.434513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1910 sessionId:  describe result for acl check
2025-10-01T14:13:15.434546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:15.434552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:15.434554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:15.434558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256205539414707:10328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:15.435015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256205539414707:10328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:15.437425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256205539414707:10328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:15.438316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:15.440355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:15.440511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:15.440520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:15.440527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:15.440560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:15.440565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256205539414707:10328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:15.440576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256205539414707:10328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:15.440579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256205539414707:10328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:15.440585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:15.440597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256203162515871:2354]
2025-10-01T14:13:15.441069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:15.441271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:15.441306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:15.441508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:15.441541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.441545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.441546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.441547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.441547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.441548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.441548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.441549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.441550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.441550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.441551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.441552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.441552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.441553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.441556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.441562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.441564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.441566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.441568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.441570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.441572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.441574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.441576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.441578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.441580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.441582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.441584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.441586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.441591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.441595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.441598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.441602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.441605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.441608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.441610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.441613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.441615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.441618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.441620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.441622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.441625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.441630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.441634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.441638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.441642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.441647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.441651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.441656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.441659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.441661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.441663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.441666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.441669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.441671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.441674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.441676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.441694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:15.444857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:15.445361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:15.445372Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:15.445374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:15.445377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:15.445383Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1909 [2:7556256203162515871:2354]
2025-10-01T14:13:15.445395Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:15.445406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:15.445408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.445410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.445411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.445421Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:15.445424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:15.445428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:15.445462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.445467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.445470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.445472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:15.445474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:15.445517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:15.445524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.445533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.445546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.445559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:15.445574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414821:10328], now have 1 active actors on pipe
2025-10-01T14:13:15.445580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414582:2446], now have 1 active actors on pipe
2025-10-01T14:13:15.445584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256203162515866:2354]
2025-10-01T14:13:15.445585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256203162515866:2354]
2025-10-01T14:13:15.445586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256203162515866:2354]
2025-10-01T14:13:15.445595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:15.445607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:15.445609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:15.445612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:15.445614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:15.445618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:15.445620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:15.445635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256203162515866:2354]
2025-10-01T14:13:15.445616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1909
2025-10-01T14:13:15.445642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:15.445644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:15.445656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.445660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.445631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1909
2025-10-01T14:13:15.445703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5233372-19790f59-1d19a70b-47f853a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:15.445714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.445717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.445719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:15.445726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.445732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:15.445751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.445840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.445846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.445858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.445943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1910 partition: 0 MaxSeqNo: 45 sessionId: src_id|c5233372-19790f59-1d19a70b-47f853a4_0
2025-10-01T14:13:15.446298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|400bc234-4c21cc50-2710110-bc7160f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c5233372-19790f59-1d19a70b-47f853a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:15.448663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5233372-19790f59-1d19a70b-47f853a4_0] Write session: try to update token
2025-10-01T14:13:15.448680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5233372-19790f59-1d19a70b-47f853a4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:15.463733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1910 sessionId: src_id|c5233372-19790f59-1d19a70b-47f853a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:15.465193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:15.465213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:15.465215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:15.465217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:15.465225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256203162515866:2354]
2025-10-01T14:13:15.465229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256203162515866:2354]
2025-10-01T14:13:15.465233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256203162515866:2354]
2025-10-01T14:13:15.465270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:15.465278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:15.465283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:15.465284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.465286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:15.465287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:15.465411Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:15.465982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:15.525142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256205539414853:10286]
2025-10-01T14:13:15.525389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 1909, pipe: [1:7556256205539414853:10286]
2025-10-01T14:13:15.597243Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:15.597598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.597612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.597652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414853:10286], now have 1 active actors on pipe
2025-10-01T14:13:15.597815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:15.597828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:15.597829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256205539414853:10286]
2025-10-01T14:13:15.597858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:15.597903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1910 reason: error at write: Disconnected sessionId: src_id|c5233372-19790f59-1d19a70b-47f853a4_0
2025-10-01T14:13:15.598179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1910 sessionId: src_id|c5233372-19790f59-1d19a70b-47f853a4_0 is DEAD
2025-10-01T14:13:15.598172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:15.598228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5233372-19790f59-1d19a70b-47f853a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:15.598237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5233372-19790f59-1d19a70b-47f853a4_0] Write session will restart in 0.009164s
2025-10-01T14:13:15.598256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5233372-19790f59-1d19a70b-47f853a4_0] Write session: Do CDS request
2025-10-01T14:13:15.598261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5233372-19790f59-1d19a70b-47f853a4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:15.608893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5233372-19790f59-1d19a70b-47f853a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.608959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:15.608972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1911
2025-10-01T14:13:15.609061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.609089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:15.609099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:15.609102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:15.609442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1911 sessionId:  describe result for acl check
2025-10-01T14:13:15.609470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:15.609475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:15.609477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:15.609481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256205539415057:10334] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:15.609946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256205539415057:10334] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:15.610667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:15.611714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256205539415057:10334] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:15.612679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:15.612800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:15.612807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:15.612814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:15.612843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:15.612871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256203162516119:2336]
2025-10-01T14:13:15.613234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:15.613451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:15.613479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:15.613662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:15.613695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.613699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.613700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.613700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.613701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.613701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.613700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256205539415057:10334] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:15.613702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.613710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256205539415057:10334] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:15.613703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.613713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256205539415057:10334] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:15.613703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.613719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:15.613704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.613705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.613705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.613706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.613706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.613709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.613714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.613716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.613718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.613720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.613722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.613724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.613726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.613728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.613730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.613732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.613734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.613736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.613738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.613743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.613746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.613750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.613753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.613755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.613758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.613761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.613763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.613766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.613769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.613771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.613774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.613776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.613779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.613782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.613784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.613787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.613789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.613791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.613794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.613796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.613798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.613802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.613806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.613810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.613814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.613817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.613821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.613853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:15.617133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:15.617629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:15.617639Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:15.617640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:15.617643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:15.617647Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1910 [2:7556256203162516119:2336]
2025-10-01T14:13:15.617656Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:15.617669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:15.617674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.617676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.617677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.617686Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:15.617693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:15.617697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:15.617731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.617736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.617737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.617739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:15.617741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:15.617794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:15.617800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.617809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.617822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.617839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:15.617857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539415096:10334], now have 1 active actors on pipe
2025-10-01T14:13:15.617863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539414854:2446], now have 1 active actors on pipe
2025-10-01T14:13:15.617868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256203162516112:2336]
2025-10-01T14:13:15.617873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256203162516112:2336]
2025-10-01T14:13:15.617874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256203162516112:2336]
2025-10-01T14:13:15.617884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:15.617895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:15.617897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:15.617898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:15.617898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:15.617911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:15.617913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:15.617931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256203162516112:2336]
2025-10-01T14:13:15.617940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:15.617948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:15.617945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1910
2025-10-01T14:13:15.617950Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1910
2025-10-01T14:13:15.618020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.618028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.618052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:15.618062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.618065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.618068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:15.618075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.618084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:15.618094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.618263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.618269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.618281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.618382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1911 partition: 0 MaxSeqNo: 45 sessionId: src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0
2025-10-01T14:13:15.618711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5233372-19790f59-1d19a70b-47f853a4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:15.621060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0] Write session: try to update token
2025-10-01T14:13:15.621079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:15.629166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:15.629190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:15.629200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256203162516112:2336]
2025-10-01T14:13:15.629246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:15.629248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:15.629573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:15.629761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:15.629938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:15.630112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:15.630343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:15.630475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:15.633922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1911 sessionId: src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:15.636593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:15.636822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.636843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.636881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:15.636948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:15.647202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:15.647222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:15.647224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:15.647226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:15.647237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256203162516112:2336]
2025-10-01T14:13:15.647241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256203162516112:2336]
2025-10-01T14:13:15.647245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256203162516112:2336]
2025-10-01T14:13:15.647286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:15.647297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:15.647298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.647301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:15.647302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:15.647307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:15.647427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:15.698212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256205539415107:10286]
2025-10-01T14:13:15.698457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 1910, pipe: [1:7556256205539415107:10286]
2025-10-01T14:13:15.781702Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:15.788043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.788067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.788221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.788287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.788346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.788401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.788441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.788449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.788511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.788562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.788626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.788679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.788719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.788725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.788777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.788825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.788875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.788927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.788966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.788972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.789022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.789072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.789119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.789169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.789207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.789213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.789262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.789311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.789359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.789408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.789446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.789451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.789502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.789549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.789603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.789656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.789695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.789700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.789752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.789802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.789854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.789905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.789944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.789949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.789998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.790045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.790095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.790147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.790185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.790190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.790245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.790293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.790342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.790412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.790450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.790455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.790509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.790559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.790614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.790666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.790757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.790763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.790807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539415107:10286], now have 1 active actors on pipe
2025-10-01T14:13:15.791065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:15.791065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256205539415107:10286]
2025-10-01T14:13:15.791086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:15.791087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:15.791110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1911 reason: error at write: Disconnected sessionId: src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0
2025-10-01T14:13:15.791248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1911 sessionId: src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0 is DEAD
2025-10-01T14:13:15.791400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:15.791412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0] Write session will restart in 0.009495s
2025-10-01T14:13:15.791438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0] Write session: Do CDS request
2025-10-01T14:13:15.791446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:15.791686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:15.801837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.801909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:15.801922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1912
2025-10-01T14:13:15.802035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.802059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:15.802065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:15.802068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:15.802495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1912 sessionId:  describe result for acl check
2025-10-01T14:13:15.802527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:15.802532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:15.802533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:15.802537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256205539415311:10338] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:15.802894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256205539415311:10338] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:15.803696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:15.804926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256205539415311:10338] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:15.805945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:15.806162Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:15.806172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:15.806182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:15.806228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:15.806255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256203162516365:2337]
2025-10-01T14:13:15.806637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:15.806946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:15.806970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:15.807151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:15.807184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.807188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.807189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.807190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.807177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256205539415311:10338] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:15.807190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.807191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.807191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.807186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256205539415311:10338] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:15.807192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.807193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.807193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.807194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.807190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256205539415311:10338] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:15.807194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.807195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:15.807195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.807195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.807198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.807203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.807205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.807207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.807210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.807212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.807214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.807216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.807218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.807220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.807222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.807224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.807226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.807228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.807233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.807237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.807240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.807243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.807245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.807248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.807250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.807254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.807256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.807259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.807261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.807264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.807266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.807269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.807271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.807274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.807276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.807279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.807281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.807284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.807286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.807289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.807291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.807294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.807296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.807299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.807302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.807304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.807337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:15.810446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:15.811061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:15.811070Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:15.811072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:15.811075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:15.811079Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1911 [2:7556256203162516365:2337]
2025-10-01T14:13:15.811089Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:15.811098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:15.811099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.811101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.811103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.811113Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:15.811118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:15.811122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:15.811160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.811165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.811166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.811168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:15.811169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:15.811211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:15.811216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.811221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.811238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.811246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:15.811257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539415352:10338], now have 1 active actors on pipe
2025-10-01T14:13:15.811263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539415109:2446], now have 1 active actors on pipe
2025-10-01T14:13:15.811267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256203162516360:2337]
2025-10-01T14:13:15.811268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256203162516360:2337]
2025-10-01T14:13:15.811270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256203162516360:2337]
2025-10-01T14:13:15.811278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:15.811287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:15.811293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:15.811296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:15.811296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:15.811297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:15.811298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:15.811310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256203162516360:2337]
2025-10-01T14:13:15.811316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:15.811318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:15.811307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1911
2025-10-01T14:13:15.811319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1911
2025-10-01T14:13:15.811337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.811343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.811361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b07fbbf9-911c64f0-f2409edc-da58012_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:15.811369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.811371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.811373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:15.811378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.811384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:15.811396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.811500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.811505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.811514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.811588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1912 partition: 0 MaxSeqNo: 45 sessionId: src_id|b07fbbf9-911c64f0-f2409edc-da58012_0
2025-10-01T14:13:15.811866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f290e877-4e0b7d76-5743762b-4c9d2eaf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b07fbbf9-911c64f0-f2409edc-da58012_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:15.814002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b07fbbf9-911c64f0-f2409edc-da58012_0] Write session: try to update token
2025-10-01T14:13:15.814014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b07fbbf9-911c64f0-f2409edc-da58012_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:15.825691Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1912 sessionId: src_id|b07fbbf9-911c64f0-f2409edc-da58012_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:15.827865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:15.828014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.828030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.829632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:15.829658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:15.829661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:15.829663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:15.829664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:15.829671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256203162516360:2337]
2025-10-01T14:13:15.829674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256203162516360:2337]
2025-10-01T14:13:15.829676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256203162516360:2337]
2025-10-01T14:13:15.829698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:15.829703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:15.829708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.829710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:15.829710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:15.829723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:15.829718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:15.829831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:15.891236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256205539415386:10286]
2025-10-01T14:13:15.891459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 1911, pipe: [1:7556256205539415386:10286]
2025-10-01T14:13:15.962796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:15.968980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.969001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.969146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.969197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.969250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.969304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.969343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.969350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.969410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.969457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.969509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.969570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.969612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.969617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.969665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.969710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.969758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.969806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.969841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.969846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.969898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.969945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.969992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.970039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.970077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.970082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.970131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.970182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.970239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.970293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.970336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.970342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.970412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.970462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.970516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.970575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.970617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.970623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.970683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.970739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.970796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.970851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.970894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.970901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.970958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.971014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.971069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.971125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.971181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.971186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.971242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.971290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.971340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.971389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.971427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.971432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.971484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:15.971531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:15.971582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:15.971630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:15.971666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:15.971671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:15.971708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539415386:10286], now have 1 active actors on pipe
2025-10-01T14:13:15.971890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256205539415386:10286]
2025-10-01T14:13:15.971898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:15.971901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:15.971922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1912 reason: error at write: Disconnected sessionId: src_id|b07fbbf9-911c64f0-f2409edc-da58012_0
2025-10-01T14:13:15.971923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:15.972103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1912 sessionId: src_id|b07fbbf9-911c64f0-f2409edc-da58012_0 is DEAD
2025-10-01T14:13:15.972256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07fbbf9-911c64f0-f2409edc-da58012_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:15.972269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07fbbf9-911c64f0-f2409edc-da58012_0] Write session will restart in 0.009398s
2025-10-01T14:13:15.972294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07fbbf9-911c64f0-f2409edc-da58012_0] Write session: Do CDS request
2025-10-01T14:13:15.972300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07fbbf9-911c64f0-f2409edc-da58012_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:15.972651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:15.982871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b07fbbf9-911c64f0-f2409edc-da58012_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.982922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:15.982932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1913
2025-10-01T14:13:15.983051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:15.983074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:15.983082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:15.983084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:15.983366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1913 sessionId:  describe result for acl check
2025-10-01T14:13:15.983392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:15.983393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:15.983394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:15.983397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256205539415594:10350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:15.983800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256205539415594:10350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:15.984340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:15.985647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256205539415594:10350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:15.986292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:15.986504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:15.986513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:15.986522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:15.986559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:15.986586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256203162516617:2331]
2025-10-01T14:13:15.986949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:15.987122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:15.987146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:15.987323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:15.987353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.987357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.987358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.987358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.987359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.987360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.987360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.987361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.987361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.987362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.987362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.987363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.987363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.987364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.987367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.987372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.987374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.987376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.987378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.987380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.987382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.987384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.987386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.987388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.987390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.987392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.987394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.987396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.987400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.987405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:15.987408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.987411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:15.987413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.987416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:15.987430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.987433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:15.987435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.987437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:15.987439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.987442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:15.987445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.987448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:15.987450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.987452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:15.987455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.987457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:15.987460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.987462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.987465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.987467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.987470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.987472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.987474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.987477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:15.987479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.987482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:15.987501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:15.988161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256205539415594:10350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:15.988171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256205539415594:10350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:15.988173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256205539415594:10350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:15.988178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:15.990667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:15.991296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:15.991311Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:15.991313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:15.991315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:15.991321Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1912 [2:7556256203162516617:2331]
2025-10-01T14:13:15.991334Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:15.991352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:15.991358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.991362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.991363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.991378Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:15.991387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:15.991393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:15.991438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.991445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.991447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.991450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:15.991452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:15.991514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:15.991521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:15.991532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:15.991547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:15.991566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:15.991586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539415633:10350], now have 1 active actors on pipe
2025-10-01T14:13:15.991594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256205539415390:2446], now have 1 active actors on pipe
2025-10-01T14:13:15.991600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256203162516612:2331]
2025-10-01T14:13:15.991606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256203162516612:2331]
2025-10-01T14:13:15.991608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256203162516612:2331]
2025-10-01T14:13:15.991621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:15.991637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:15.991639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:15.991641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:15.991643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:15.991637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1912
2025-10-01T14:13:15.991654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:15.991662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:15.991641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1912
2025-10-01T14:13:15.991690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.991699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.991716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256203162516612:2331]
2025-10-01T14:13:15.991726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:15.991737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:15.991757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9623439a-fdc18408-82b781ac-45a64a2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:15.991768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:15.991777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:15.991783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:15.991792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:15.991804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:15.991829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.991947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:15.991956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:15.991971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:15.992062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1913 partition: 0 MaxSeqNo: 45 sessionId: src_id|9623439a-fdc18408-82b781ac-45a64a2e_0
2025-10-01T14:13:15.992360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b07fbbf9-911c64f0-f2409edc-da58012_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9623439a-fdc18408-82b781ac-45a64a2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:15.994616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9623439a-fdc18408-82b781ac-45a64a2e_0] Write session: try to update token
2025-10-01T14:13:15.994629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9623439a-fdc18408-82b781ac-45a64a2e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:16.006638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1913 sessionId: src_id|9623439a-fdc18408-82b781ac-45a64a2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:16.008933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:16.010205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.010228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.010247Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:16.010249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:16.010251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:16.010252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:16.010257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256203162516612:2331]
2025-10-01T14:13:16.010264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256203162516612:2331]
2025-10-01T14:13:16.010267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256203162516612:2331]
2025-10-01T14:13:16.010292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:16.010304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:16.010307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:16.010308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:16.010313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.010315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:16.010437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:16.071982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256209834382937:10286]
2025-10-01T14:13:16.072213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 1912, pipe: [1:7556256209834382937:10286]
2025-10-01T14:13:16.140900Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:16.141382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:16.141428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834382937:10286], now have 1 active actors on pipe
2025-10-01T14:13:16.141512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:16.141591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:16.141597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:16.141650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1913 reason: error at write: Disconnected sessionId: src_id|9623439a-fdc18408-82b781ac-45a64a2e_0
2025-10-01T14:13:16.141792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1913 sessionId: src_id|9623439a-fdc18408-82b781ac-45a64a2e_0 is DEAD
2025-10-01T14:13:16.141848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256209834382937:10286]
2025-10-01T14:13:16.141879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:16.141954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9623439a-fdc18408-82b781ac-45a64a2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:16.141963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9623439a-fdc18408-82b781ac-45a64a2e_0] Write session will restart in 0.005526s
2025-10-01T14:13:16.141984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9623439a-fdc18408-82b781ac-45a64a2e_0] Write session: Do CDS request
2025-10-01T14:13:16.141993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9623439a-fdc18408-82b781ac-45a64a2e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:16.148869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9623439a-fdc18408-82b781ac-45a64a2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.148950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:16.148961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1914
2025-10-01T14:13:16.149054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.149077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:16.149083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:16.149086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:16.149415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1914 sessionId:  describe result for acl check
2025-10-01T14:13:16.149438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:16.149439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:16.149440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:16.149444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256209834382981:10354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:16.149749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256209834382981:10354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:16.151978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256209834382981:10354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:16.154550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256209834382981:10354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:16.154563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256209834382981:10354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:16.154567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256209834382981:10354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:16.154573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:16.158067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:16.158418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:16.158643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:16.158653Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:16.158664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:16.158703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:16.158739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256207457484175:2327]
2025-10-01T14:13:16.159338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:16.159542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:16.159582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:16.159886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:16.159933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.159938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.159939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.159940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.159941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.159943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.159944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.159945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.159946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.159947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.159948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.159950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.159951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.159952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.159957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.159967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.159971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.159975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.159978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.159983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.159986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.159990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.159994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.159998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.160002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.160006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.160010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.160014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.160026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.160044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.160061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.160065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.160070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.160074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.160081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.160087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.160093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.160108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.160112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.160121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.160130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.160139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.160148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.160157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.160165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.160174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.160181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.160188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.160196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.160202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.160207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.160216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.160222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.160230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.160237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.160246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.160285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:16.163477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:16.164320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:16.164333Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:16.164335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:16.164338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:16.164344Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1913 [2:7556256207457484175:2327]
2025-10-01T14:13:16.164362Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:16.164375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:16.164382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.164386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.164388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.164402Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:16.164408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:16.164417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:16.164463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.164470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.164472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.164474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:16.164477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:16.164533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:16.164540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.164549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.164561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.164579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:16.164598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383176:10354], now have 1 active actors on pipe
2025-10-01T14:13:16.164606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834382939:2446], now have 1 active actors on pipe
2025-10-01T14:13:16.164623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256207457484170:2327]
2025-10-01T14:13:16.164632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256207457484170:2327]
2025-10-01T14:13:16.164638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256207457484170:2327]
2025-10-01T14:13:16.164650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:16.164661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:16.164671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:16.164674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:16.164674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:16.164676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:16.164676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:16.164651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1913
2025-10-01T14:13:16.164655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1913
2025-10-01T14:13:16.164708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.164715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.164731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256207457484170:2327]
2025-10-01T14:13:16.164741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:16.164758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:16.164767Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:16.164773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.164782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.164788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:16.164795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.164806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:16.164829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.164958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.164969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.164985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.165066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1914 partition: 0 MaxSeqNo: 45 sessionId: src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0
2025-10-01T14:13:16.165360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9623439a-fdc18408-82b781ac-45a64a2e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:16.167539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0] Write session: try to update token
2025-10-01T14:13:16.167553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:16.179486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1914 sessionId: src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:16.181599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:16.181729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.181749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.183391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:16.183420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:16.183425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:16.183426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:16.183427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:16.183432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256207457484170:2327]
2025-10-01T14:13:16.183435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256207457484170:2327]
2025-10-01T14:13:16.183437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256207457484170:2327]
2025-10-01T14:13:16.183455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:16.183466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:16.183469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:16.183476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:16.183485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.183472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:16.183487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:16.183592Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:16.241941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256209834383194:10286]
2025-10-01T14:13:16.242163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 1913, pipe: [1:7556256209834383194:10286]
2025-10-01T14:13:16.320118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:16.328172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.328201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.328356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.328416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.328479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.328536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.329255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.329271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.329332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.329389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.329446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.329515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.329559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.329566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.329621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.329672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.329726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.329782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.329821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.329828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.329883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.329999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.330051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.330101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.330138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.330144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.330196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.330246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.330299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.330351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.330408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.330415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.330471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.330524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.330586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.330647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.330742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.330750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.330806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.330857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.330911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.330965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.331005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.331011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.331067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.331125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.331181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.331241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.331283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.331289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.331349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.331402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.331461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.331516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.331557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.331564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.331624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.331682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.331741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.331797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.331837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.331843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.331897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383194:10286], now have 1 active actors on pipe
2025-10-01T14:13:16.332079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:16.332100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:16.332103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:16.332127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256209834383194:10286]
2025-10-01T14:13:16.332127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1914 reason: error at write: Disconnected sessionId: src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0
2025-10-01T14:13:16.332271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1914 sessionId: src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0 is DEAD
2025-10-01T14:13:16.332365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:16.332374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0] Write session will restart in 0.009310s
2025-10-01T14:13:16.332397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0] Write session: Do CDS request
2025-10-01T14:13:16.332401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:16.333268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:16.342782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.342860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:16.342874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1915
2025-10-01T14:13:16.343200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.343231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:16.343240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:16.343243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:16.343619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1915 sessionId:  describe result for acl check
2025-10-01T14:13:16.343652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:16.343654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:16.343656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:16.343660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256209834383391:10358] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:16.344120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256209834383391:10358] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:16.345352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:16.346464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256209834383391:10358] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:16.347525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:16.347703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:16.347714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:16.347725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:16.347775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:16.347848Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256207457484449:2291]
2025-10-01T14:13:16.348395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:16.348407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256209834383391:10358] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:16.348419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256209834383391:10358] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:16.348422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256209834383391:10358] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:16.348429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:16.348630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:16.348672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:16.348947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:16.349020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.349026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.349027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.349028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.349029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.349030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.349031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.349032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.349033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.349034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.349035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.349037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.349038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.349039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.349043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.349052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.349056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.349060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.349063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.349066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.349070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.349073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.349076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.349080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.349087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.349091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.349095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.349098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.349108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.349119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.349129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.349134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.349144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.349153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.349157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.349163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.349170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.349175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.349183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.349190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.349194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.349202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.349205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.349208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.349212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.349220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.349227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.349231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.349238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.349242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.349249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.349254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.349261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.349270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.349277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.349282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.349318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:16.352475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:16.353219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:16.353229Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:16.353230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:16.353232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:16.353236Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1914 [2:7556256207457484449:2291]
2025-10-01T14:13:16.353245Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:16.353256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:16.353261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.353263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.353264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.353274Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:16.353279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:16.353283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:16.353316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.353321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.353321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.353324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:16.353326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:16.353369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:16.353374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.353380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.353385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.353396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:16.353410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383441:10358], now have 1 active actors on pipe
2025-10-01T14:13:16.353419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256207457484444:2291]
2025-10-01T14:13:16.353422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256207457484444:2291]
2025-10-01T14:13:16.353423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256207457484444:2291]
2025-10-01T14:13:16.353429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:16.353437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:16.353440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:16.353446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:16.353447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:16.353448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:16.353450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:16.353453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383196:2446], now have 1 active actors on pipe
2025-10-01T14:13:16.353446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1914
2025-10-01T14:13:16.353466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256207457484444:2291]
2025-10-01T14:13:16.353471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:16.353473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:16.353483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.353489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.353491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1914
2025-10-01T14:13:16.353515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:16.353526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.353528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.353530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:16.353535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.353541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:16.353554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.353683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.353690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.353700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.353769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1915 partition: 0 MaxSeqNo: 45 sessionId: src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0
2025-10-01T14:13:16.354060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64847bec-f6cbaef3-142ee60f-824e3ed1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:16.356375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0] Write session: try to update token
2025-10-01T14:13:16.356389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:16.367862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1915 sessionId: src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:16.369822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:16.369994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.370012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.370057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:16.370128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:16.371625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:16.371637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:16.371639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:16.371640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:16.371647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256207457484444:2291]
2025-10-01T14:13:16.371650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256207457484444:2291]
2025-10-01T14:13:16.371652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256207457484444:2291]
2025-10-01T14:13:16.371683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:16.371688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.371689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:16.371713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:16.371730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:16.371735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:16.371803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:16.432395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256209834383452:10286]
2025-10-01T14:13:16.432624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 1914, pipe: [1:7556256209834383452:10286]
2025-10-01T14:13:16.505451Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:16.513196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.513227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.513382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.513444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.513830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.513896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.514137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.514147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.514208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.514266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.514326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.514404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.514444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.514450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.514512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.514567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.514623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.514679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.514720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.514728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.514785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.514845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.514901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.514961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.515009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.515016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.515073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.515127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.515183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.515240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.515279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.515288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.515345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.515400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.515458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.515517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.515562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.515568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.515626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.515702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.515759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.515820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.515859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.515866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.515924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.515982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.516044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.516102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.516144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.516151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.516209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.516270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.516331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.516425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.516469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.516476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.516536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:16.516594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:16.516667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:16.516726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:16.516782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:16.516789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:16.516850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383452:10286], now have 1 active actors on pipe
2025-10-01T14:13:16.517089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:16.517120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:16.517124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:16.517150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1915 reason: error at write: Disconnected sessionId: src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0
2025-10-01T14:13:16.517165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256209834383452:10286]
2025-10-01T14:13:16.517327Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:16.517368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1915 sessionId: src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0 is DEAD
2025-10-01T14:13:16.517536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:16.517546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0] Write session will restart in 0.006367s
2025-10-01T14:13:16.517572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0] Write session: Do CDS request
2025-10-01T14:13:16.517579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:16.524896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.524947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:16.524960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1916
2025-10-01T14:13:16.525096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.525123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:16.525134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:16.525137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:16.525517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1916 sessionId:  describe result for acl check
2025-10-01T14:13:16.525554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:16.525561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:16.525562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:16.525567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256209834383529:10364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:16.526051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256209834383529:10364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:16.528030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256209834383529:10364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:16.530186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256209834383529:10364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:16.530198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256209834383529:10364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:16.530201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256209834383529:10364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:16.530214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:16.531303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:16.533091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:16.533214Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:16.533221Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:16.533228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:16.533255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:16.533283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256207457484698:2295]
2025-10-01T14:13:16.533647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:16.533841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:16.533876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:16.534061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:16.534093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.534097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.534097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.534098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.534098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.534099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.534100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.534100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.534101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.534101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.534102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.534103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.534103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.534104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.534107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.534112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.534114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.534116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.534118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.534120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.534122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.534124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.534126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.534128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.534130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.534132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.534134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.534136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.534140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.534145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.534149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.534151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.534155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.534158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.534160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.534163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.534165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.534168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.534170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.534172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.534175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.534178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.534180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.534182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.534184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.534191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.534193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.534196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.534198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.534202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.534204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.534207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.534209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.534212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.534217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.534220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.534238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:16.537341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:16.537868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:16.537879Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:16.537881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:16.537883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:16.537887Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1915 [2:7556256207457484698:2295]
2025-10-01T14:13:16.537900Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:16.537912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:16.537916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.537918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.537920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.537930Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:16.537937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:16.537942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:16.537986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.537991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.537992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.537995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:16.537996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:16.538036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:16.538041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.538047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.538053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.538064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:16.538080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383717:10364], now have 1 active actors on pipe
2025-10-01T14:13:16.538085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383475:2446], now have 1 active actors on pipe
2025-10-01T14:13:16.538090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256207457484693:2295]
2025-10-01T14:13:16.538091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256207457484693:2295]
2025-10-01T14:13:16.538092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256207457484693:2295]
2025-10-01T14:13:16.538100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:16.538112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:16.538113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:16.538115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:16.538117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:16.538122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:16.538124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:16.538137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256207457484693:2295]
2025-10-01T14:13:16.538144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:16.538150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:16.538151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1915
2025-10-01T14:13:16.538176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1915
2025-10-01T14:13:16.538189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.538195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.538210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:16.538218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.538220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.538221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:16.538226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.538235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:16.538246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.538390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.538397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.538408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.538482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1916 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0
2025-10-01T14:13:16.538777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7ceb955-975878a6-91697f71-6dc52a6b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:16.540965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0] Write session: try to update token
2025-10-01T14:13:16.540979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:16.553339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1916 sessionId: src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:16.555574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:16.557390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.557414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.557438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:16.557441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:16.557443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:16.557445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:16.557453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256207457484693:2295]
2025-10-01T14:13:16.557459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256207457484693:2295]
2025-10-01T14:13:16.557463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256207457484693:2295]
2025-10-01T14:13:16.557507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:16.557517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:16.557518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:16.557521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:16.557523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.557526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:16.557663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:16.617267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256209834383731:10286]
2025-10-01T14:13:16.617486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 1915, pipe: [1:7556256209834383731:10286]
2025-10-01T14:13:16.688501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:16.688741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:16.688784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383731:10286], now have 1 active actors on pipe
2025-10-01T14:13:16.688863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:16.688986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256209834383731:10286]
2025-10-01T14:13:16.689047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:16.697500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:16.697514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:16.697532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1916 reason: error at write: Disconnected sessionId: src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0
2025-10-01T14:13:16.697689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1916 sessionId: src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0 is DEAD
2025-10-01T14:13:16.697999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:16.698008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0] Write session will restart in 0.007614s
2025-10-01T14:13:16.698026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0] Write session: Do CDS request
2025-10-01T14:13:16.698033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:16.705197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:16.706809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.706837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:16.706849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1917
2025-10-01T14:13:16.706977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.707000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:16.707004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:16.707006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:16.707275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1917 sessionId:  describe result for acl check
2025-10-01T14:13:16.707307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:16.707315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:16.707318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:16.707321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256209834383946:10368] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:16.707396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:16.707522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:16.707530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:16.707537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:16.707566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:16.707591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256207457484948:10240]
2025-10-01T14:13:16.707689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256209834383946:10368] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:16.707944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:16.708141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:16.708164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:16.708340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:16.708373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.708377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.708378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.708378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.708379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.708379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.708380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.708381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.708382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.708382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.708383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.708383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.708384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.708385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.708387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.708392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.708395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.708397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.708399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.708401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.708403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.708405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.708407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.708409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.708411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.708413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.708415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.708417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.708422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.708427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.708430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.708433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.708435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.708438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.708440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.708443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.708445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.708448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.708450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.708453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.708455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.708458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.708460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.708463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.708465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.708468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.708470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.708473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.708476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.708482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.708485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.708488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.708490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.708493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.708495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.708498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.708517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:16.709580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256209834383946:10368] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:16.711607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:16.711976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256209834383946:10368] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:16.711987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256209834383946:10368] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:16.711989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256209834383946:10368] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:16.711995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:16.712136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:16.712146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:16.712147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:16.712150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:16.712154Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1916 [2:7556256207457484948:10240]
2025-10-01T14:13:16.712164Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:16.712174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:16.712179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.712181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.712183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.712193Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:16.712199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:16.712203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:16.712235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.712240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.712241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.712243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:16.712245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:16.712285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:16.712291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.712297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.712305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.712315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:16.712330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383733:2446], now have 1 active actors on pipe
2025-10-01T14:13:16.712336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834383997:10368], now have 1 active actors on pipe
2025-10-01T14:13:16.712340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256207457484943:10240]
2025-10-01T14:13:16.712343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256207457484943:10240]
2025-10-01T14:13:16.712345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256207457484943:10240]
2025-10-01T14:13:16.712352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:16.712361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:16.712362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:16.712358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1916
2025-10-01T14:13:16.712364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:16.712359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1916
2025-10-01T14:13:16.712366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:16.712370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:16.712371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:16.712385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256207457484943:10240]
2025-10-01T14:13:16.712391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:16.712392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:16.712402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.712413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.712443Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5370e82-3247f033-90e355ff-13197ffe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:16.712452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.712454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.712458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:16.712464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.712472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:16.712487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.712574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.712578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.712588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.712652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1917 partition: 0 MaxSeqNo: 45 sessionId: src_id|c5370e82-3247f033-90e355ff-13197ffe_0
2025-10-01T14:13:16.712888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a04fa7f-a46ec0a4-97d22957-610907a9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c5370e82-3247f033-90e355ff-13197ffe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:16.715040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5370e82-3247f033-90e355ff-13197ffe_0] Write session: try to update token
2025-10-01T14:13:16.715053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5370e82-3247f033-90e355ff-13197ffe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:16.729934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1917 sessionId: src_id|c5370e82-3247f033-90e355ff-13197ffe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:16.732092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:16.732767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.732790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.732808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:16.732815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:16.732817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:16.732818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:16.732824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256207457484943:10240]
2025-10-01T14:13:16.732830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256207457484943:10240]
2025-10-01T14:13:16.732833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256207457484943:10240]
2025-10-01T14:13:16.732862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:16.732872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:16.732876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:16.732892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:16.732899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.732907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:16.733073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:16.789279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256209834384005:10286]
2025-10-01T14:13:16.789510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 1916, pipe: [1:7556256209834384005:10286]
2025-10-01T14:13:16.874023Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:16.874479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:16.874522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834384005:10286], now have 1 active actors on pipe
2025-10-01T14:13:16.874531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:16.874712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256209834384005:10286]
2025-10-01T14:13:16.874731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:16.882283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:16.882295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:16.882312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1917 reason: error at write: Disconnected sessionId: src_id|c5370e82-3247f033-90e355ff-13197ffe_0
2025-10-01T14:13:16.882458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1917 sessionId: src_id|c5370e82-3247f033-90e355ff-13197ffe_0 is DEAD
2025-10-01T14:13:16.882577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5370e82-3247f033-90e355ff-13197ffe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:16.882582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5370e82-3247f033-90e355ff-13197ffe_0] Write session will restart in 0.007968s
2025-10-01T14:13:16.882601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5370e82-3247f033-90e355ff-13197ffe_0] Write session: Do CDS request
2025-10-01T14:13:16.882608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5370e82-3247f033-90e355ff-13197ffe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:16.891546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:16.891900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5370e82-3247f033-90e355ff-13197ffe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.891944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:16.891958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1918
2025-10-01T14:13:16.892103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:16.892142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:16.892153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:16.892155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:16.892435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1918 sessionId:  describe result for acl check
2025-10-01T14:13:16.892462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:16.892466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:16.892467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:16.892471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256209834384248:10380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:16.892860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256209834384248:10380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:16.893949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:16.894128Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:16.894137Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:16.894149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:16.894194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:16.894224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256207457485205:10244]
2025-10-01T14:13:16.894775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:16.894934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256209834384248:10380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:16.894986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:16.895026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:16.895304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:16.895353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.895359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.895360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.895361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.895361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.895362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.895363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.895364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.895365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.895366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.895367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.895368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.895369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.895370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.895374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.895383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.895386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.895390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.895393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.895396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.895399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.895403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.895406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.895409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.895412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.895415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.895419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.895422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.895429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.895435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:16.895440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.895445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:16.895453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.895458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:16.895465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.895469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:16.895477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.895486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:16.895493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.895497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:16.895504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.895512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:16.895519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.895523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:16.895527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.895535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:16.895543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.895547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.895554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.895562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.895567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.895575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.895582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.895590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:16.895597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.895602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:16.895638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:16.898643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256209834384248:10380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:16.898654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256209834384248:10380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:16.898656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256209834384248:10380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:16.898661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:16.898877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:16.899416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:16.899431Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:16.899433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:16.899436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:16.899442Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1917 [2:7556256207457485205:10244]
2025-10-01T14:13:16.899458Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:16.899475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:16.899481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.899484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.899486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.899500Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:16.899507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:16.899513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:16.899556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.899564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.899566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.899569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:16.899571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:16.899626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:16.899632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.899642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:16.899655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:16.899672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:16.899690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834384032:2446], now have 1 active actors on pipe
2025-10-01T14:13:16.899698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834384283:10380], now have 1 active actors on pipe
2025-10-01T14:13:16.899704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256207457485200:10244]
2025-10-01T14:13:16.899706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256207457485200:10244]
2025-10-01T14:13:16.899708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256207457485200:10244]
2025-10-01T14:13:16.899719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:16.899729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:16.899734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:16.899736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:16.899719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1917
2025-10-01T14:13:16.899737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:16.899730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1917
2025-10-01T14:13:16.899745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:16.899748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:16.899771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256207457485200:10244]
2025-10-01T14:13:16.899780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:16.899782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:16.899822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.899830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.899850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2b63873-61479898-501473e5-50ff8b9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:16.899860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:16.899867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:16.899869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:16.899878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:16.899889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:16.899906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.900050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.900061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.900083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:16.900139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1918 partition: 0 MaxSeqNo: 45 sessionId: src_id|d2b63873-61479898-501473e5-50ff8b9f_0
2025-10-01T14:13:16.900406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5370e82-3247f033-90e355ff-13197ffe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d2b63873-61479898-501473e5-50ff8b9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:16.902605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b63873-61479898-501473e5-50ff8b9f_0] Write session: try to update token
2025-10-01T14:13:16.902619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b63873-61479898-501473e5-50ff8b9f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:16.913713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:16.913733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:16.913741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256207457485200:10244]
2025-10-01T14:13:16.913777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:16.913787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:16.913929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:16.914137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1918 sessionId: src_id|d2b63873-61479898-501473e5-50ff8b9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:16.914278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:16.914408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:16.914533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:16.914705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:16.914736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:16.916156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:16.916318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:16.916331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:16.916355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:16.916424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:16.927982Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:16.927998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:16.928000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:16.928001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:16.928010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256207457485200:10244]
2025-10-01T14:13:16.928012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256207457485200:10244]
2025-10-01T14:13:16.928014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256207457485200:10244]
2025-10-01T14:13:16.928041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:16.928045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:16.928046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:16.928048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:16.928051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:16.928052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:16.928173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:16.974636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256209834384290:10286]
2025-10-01T14:13:16.974880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 1917, pipe: [1:7556256209834384290:10286]
2025-10-01T14:13:17.059582Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:17.066043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.066068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.066205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.066258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.066313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.066366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.066427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.066436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.066491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.066541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.066593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.066646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.066684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.066690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.066741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.066791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.066842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.066895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.066933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.066939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.066990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.067038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.067090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.067139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.067175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.067180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.067229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.067280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.067330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.067380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.067480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.067485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.067538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.067587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.067639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.067692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.067731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.067736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.067787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.067834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.067885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.067937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.067974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.067978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.068031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.068085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.068137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.068189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.068223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.068229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.068280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.068328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.068378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.068431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.068466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.068471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.068518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.068563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.068609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.068671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.068708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.068712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.068749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256209834384290:10286], now have 1 active actors on pipe
2025-10-01T14:13:17.068946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:17.068958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:17.068979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1918 reason: error at write: Disconnected sessionId: src_id|d2b63873-61479898-501473e5-50ff8b9f_0
2025-10-01T14:13:17.069017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256209834384290:10286]
2025-10-01T14:13:17.069042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:17.069157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1918 sessionId: src_id|d2b63873-61479898-501473e5-50ff8b9f_0 is DEAD
2025-10-01T14:13:17.069250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b63873-61479898-501473e5-50ff8b9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:17.069258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b63873-61479898-501473e5-50ff8b9f_0] Write session will restart in 0.007203s
2025-10-01T14:13:17.069279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b63873-61479898-501473e5-50ff8b9f_0] Write session: Do CDS request
2025-10-01T14:13:17.069285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b63873-61479898-501473e5-50ff8b9f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:17.069384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:17.077807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b63873-61479898-501473e5-50ff8b9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.077889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:17.077903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1919
2025-10-01T14:13:17.077990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.078018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:17.078027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:17.078030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:17.078322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1919 sessionId:  describe result for acl check
2025-10-01T14:13:17.078352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:17.078356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:17.078358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:17.078361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256214129351665:10384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:17.078788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256214129351665:10384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:17.081076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256214129351665:10384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:17.083722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256214129351665:10384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:17.083734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256214129351665:10384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:17.083737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256214129351665:10384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:17.083744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:17.084105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:17.086232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:17.086355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:17.086362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:17.086388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:17.086423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:17.086450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256211752452756:10246]
2025-10-01T14:13:17.086807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:17.087043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:17.087068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:17.087252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:17.087283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.087287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.087288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.087288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.087289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.087290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.087290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.087291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.087292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.087293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.087293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.087294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.087295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.087295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.087298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.087304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.087307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.087309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.087311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.087313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.087315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.087317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.087319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.087321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.087323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.087325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.087327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.087329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.087336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.087340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.087343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.087346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.087349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.087352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.087354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.087356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.087359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.087361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.087363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.087366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.087368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.087371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.087373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.087376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.087378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.087381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.087388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.087391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.087393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.087396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.087397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.087400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.087405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.087408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.087410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.087413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.087436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:17.090704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:17.091244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:17.091253Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:17.091255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:17.091258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:17.091262Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1918 [2:7556256211752452756:10246]
2025-10-01T14:13:17.091272Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:17.091283Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:17.091288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.091290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.091292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.091302Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:17.091309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:17.091314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:17.091351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.091355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.091356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.091359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:17.091360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:17.091403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:17.091408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.091414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.091423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.091434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:17.091451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129351836:10384], now have 1 active actors on pipe
2025-10-01T14:13:17.091456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129351589:2446], now have 1 active actors on pipe
2025-10-01T14:13:17.091462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256211752452751:10246]
2025-10-01T14:13:17.091463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256211752452751:10246]
2025-10-01T14:13:17.091464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256211752452751:10246]
2025-10-01T14:13:17.091473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:17.091485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:17.091487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:17.091489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:17.091491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:17.091496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:17.091499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:17.091515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256211752452751:10246]
2025-10-01T14:13:17.091522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:17.091527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:17.091529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1918
2025-10-01T14:13:17.091540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1918
2025-10-01T14:13:17.091567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.091573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.091593Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd54f206-cad59771-a191f158-cc7aeac7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:17.091601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.091604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.091605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:17.091610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.091616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:17.091629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.091746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.091751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.091759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.091823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1919 partition: 0 MaxSeqNo: 45 sessionId: src_id|fd54f206-cad59771-a191f158-cc7aeac7_0
2025-10-01T14:13:17.092163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2b63873-61479898-501473e5-50ff8b9f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fd54f206-cad59771-a191f158-cc7aeac7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:17.094321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd54f206-cad59771-a191f158-cc7aeac7_0] Write session: try to update token
2025-10-01T14:13:17.094334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd54f206-cad59771-a191f158-cc7aeac7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:17.106246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1919 sessionId: src_id|fd54f206-cad59771-a191f158-cc7aeac7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:17.108367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:17.108560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.108583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.108632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:17.108692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:17.110539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:17.110553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:17.110555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:17.110557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:17.110564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256211752452751:10246]
2025-10-01T14:13:17.110568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256211752452751:10246]
2025-10-01T14:13:17.110570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256211752452751:10246]
2025-10-01T14:13:17.110605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:17.110604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:17.110608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:17.110609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.110610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:17.110611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:17.110730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:17.169173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256214129351851:10286]
2025-10-01T14:13:17.169396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 1918, pipe: [1:7556256214129351851:10286]
2025-10-01T14:13:17.244469Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:17.250923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.250947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.251095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.251154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.251214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.251271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.251310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.251322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.251385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.251439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.251495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.251550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.251590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.251596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.251651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.251703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.251755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.251805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.251844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.251849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.251902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.251954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.252020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.252077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.252117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.252121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.252174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.252223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.252275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.252324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.252362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.252367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.252421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.252470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.252525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.252580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.252627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.252632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.252685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.252736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.252790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.252844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.252883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.252888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.252940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.252990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.253041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.253093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.253132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.253137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.253193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.253246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.253301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.253357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.253396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.253400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.253457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.253508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.253563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.253616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.253654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.253660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.253698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129351851:10286], now have 1 active actors on pipe
2025-10-01T14:13:17.253895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256214129351851:10286]
2025-10-01T14:13:17.253902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:17.253905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:17.253922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:17.253931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1919 reason: error at write: Disconnected sessionId: src_id|fd54f206-cad59771-a191f158-cc7aeac7_0
2025-10-01T14:13:17.254129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1919 sessionId: src_id|fd54f206-cad59771-a191f158-cc7aeac7_0 is DEAD
2025-10-01T14:13:17.254254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd54f206-cad59771-a191f158-cc7aeac7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:17.254265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd54f206-cad59771-a191f158-cc7aeac7_0] Write session will restart in 0.007345s
2025-10-01T14:13:17.254291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd54f206-cad59771-a191f158-cc7aeac7_0] Write session: Do CDS request
2025-10-01T14:13:17.254297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd54f206-cad59771-a191f158-cc7aeac7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:17.254566Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:17.262833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd54f206-cad59771-a191f158-cc7aeac7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.262904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:17.262927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1920
2025-10-01T14:13:17.263029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.263052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:17.263060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:17.263063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:17.263381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1920 sessionId:  describe result for acl check
2025-10-01T14:13:17.263407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:17.263408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:17.263409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:17.263412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256214129351958:10390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:17.263829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256214129351958:10390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:17.266264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256214129351958:10390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:17.267644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:17.270407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:17.270567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:17.270575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:17.270584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:17.270638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:17.270621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256214129351958:10390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:17.270635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256214129351958:10390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:17.270637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256214129351958:10390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:17.270642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:17.270671Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256211752453048:10260]
2025-10-01T14:13:17.271294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:17.271535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:17.271573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:17.271854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:17.271895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.271900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.271901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.271902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.271903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.271904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.271905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.271906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.271907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.271908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.271909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.271910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.271911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.271912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.271917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.271925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.271929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.271932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.271935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.271939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.271942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.271945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.271948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.271951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.271955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.271958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.271961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.271964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.271971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.271978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.271984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.271988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.271992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.271996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.272000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.272004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.272009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.272013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.272017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.272021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.272026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.272031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.272035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.272039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.272043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.272053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.272057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.272061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.272069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.272073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.272077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.272082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.272089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.272094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.272097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.272106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.272138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:17.275473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:17.276047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:17.276060Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:17.276062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:17.276065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:17.276072Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1919 [2:7556256211752453048:10260]
2025-10-01T14:13:17.276084Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:17.276102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:17.276109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.276112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.276115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.276132Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:17.276140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:17.276149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:17.276202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.276208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.276210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.276213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:17.276215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:17.276276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:17.276282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.276292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.276302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.276320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:17.276340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352102:10390], now have 1 active actors on pipe
2025-10-01T14:13:17.276347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129351856:2446], now have 1 active actors on pipe
2025-10-01T14:13:17.276354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256211752453043:10260]
2025-10-01T14:13:17.276360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256211752453043:10260]
2025-10-01T14:13:17.276363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256211752453043:10260]
2025-10-01T14:13:17.276375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:17.276391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:17.276395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:17.276398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:17.276400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:17.276406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:17.276410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:17.276435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256211752453043:10260]
2025-10-01T14:13:17.276441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:17.276447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:17.276418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1919
2025-10-01T14:13:17.276420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1919
2025-10-01T14:13:17.276473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.276481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.276510Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:17.276519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.276527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.276532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:17.276540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.276551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:17.276566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.276704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.276713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.276726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.276827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1920 partition: 0 MaxSeqNo: 45 sessionId: src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0
2025-10-01T14:13:17.277165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd54f206-cad59771-a191f158-cc7aeac7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:17.279506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0] Write session: try to update token
2025-10-01T14:13:17.279526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:17.292824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1920 sessionId: src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:17.295092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:17.295769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.295792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.295806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:17.295808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:17.295810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:17.295811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:17.295817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256211752453043:10260]
2025-10-01T14:13:17.295821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256211752453043:10260]
2025-10-01T14:13:17.295825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256211752453043:10260]
2025-10-01T14:13:17.295848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:17.295852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:17.295855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:17.295872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:17.295884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.295886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:17.296012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:17.354014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256214129352114:10286]
2025-10-01T14:13:17.354221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 1919, pipe: [1:7556256214129352114:10286]
2025-10-01T14:13:17.426910Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:17.427275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:17.427321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352114:10286], now have 1 active actors on pipe
2025-10-01T14:13:17.427404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:17.427442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256214129352114:10286]
2025-10-01T14:13:17.427457Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:17.427488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:17.427495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:17.427545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1920 reason: error at write: Disconnected sessionId: src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0
2025-10-01T14:13:17.427673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1920 sessionId: src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0 is DEAD
2025-10-01T14:13:17.427834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:17.427842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0] Write session will restart in 0.007403s
2025-10-01T14:13:17.427861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0] Write session: Do CDS request
2025-10-01T14:13:17.427866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:17.436843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.436928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:17.436940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1921
2025-10-01T14:13:17.437039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.437063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:17.437070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:17.437073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:17.437399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1921 sessionId:  describe result for acl check
2025-10-01T14:13:17.437428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:17.437433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:17.437435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:17.437439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256214129352272:10394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:17.437830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256214129352272:10394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:17.439757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256214129352272:10394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:17.440652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:17.443072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:17.443215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:17.443223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:17.443230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:17.443260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:17.443296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256211752453301:10262]
2025-10-01T14:13:17.443435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256214129352272:10394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:17.443451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256214129352272:10394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:17.443454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256214129352272:10394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:17.443463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:17.443706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:17.443912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:17.443939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:17.444148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:17.444189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.444193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.444194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.444195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.444196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.444196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.444197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.444198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.444198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.444199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.444199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.444200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.444200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.444201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.444204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.444210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.444212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.444214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.444216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.444218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.444220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.444223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.444225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.444227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.444229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.444231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.444233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.444235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.444239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.444244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.444248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.444250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.444253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.444255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.444258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.444260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.444263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.444266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.444268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.444271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.444275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.444278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.444280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.444283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.444286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.444289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.444295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.444300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.444305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.444310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.444316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.444321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.444328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.444331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.444333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.444336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.444356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:17.447565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:17.448107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:17.448120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:17.448122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:17.448124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:17.448129Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1920 [2:7556256211752453301:10262]
2025-10-01T14:13:17.448139Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:17.448150Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:17.448151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.448153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.448155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.448166Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:17.448170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:17.448174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:17.448214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.448219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.448221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.448223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:17.448225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:17.448280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:17.448285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.448292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.448298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.448306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:17.448324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352370:10394], now have 1 active actors on pipe
2025-10-01T14:13:17.448329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352120:2446], now have 1 active actors on pipe
2025-10-01T14:13:17.448335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256211752453296:10262]
2025-10-01T14:13:17.448336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256211752453296:10262]
2025-10-01T14:13:17.448337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256211752453296:10262]
2025-10-01T14:13:17.448346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:17.448355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:17.448357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:17.448358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:17.448359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:17.448365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:17.448367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:17.448357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1920
2025-10-01T14:13:17.448365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1920
2025-10-01T14:13:17.448393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.448400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.448410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256211752453296:10262]
2025-10-01T14:13:17.448416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:17.448420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:17.448434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:17.448442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.448445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.448446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:17.448452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.448458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:17.448474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.448552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.448558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.448567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.448631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1921 partition: 0 MaxSeqNo: 45 sessionId: src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0
2025-10-01T14:13:17.448902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|827ff268-49755fe2-81f6335c-a9b32d7b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:17.451146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0] Write session: try to update token
2025-10-01T14:13:17.451161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:17.462991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1921 sessionId: src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:17.465040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:17.465166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.465187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.465239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:17.465296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:17.466994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:17.467009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:17.467012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:17.467014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:17.467024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256211752453296:10262]
2025-10-01T14:13:17.467029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256211752453296:10262]
2025-10-01T14:13:17.467033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256211752453296:10262]
2025-10-01T14:13:17.467067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:17.467078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:17.467078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:17.467081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:17.467084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.467086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:17.467210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:17.527573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256214129352402:10286]
2025-10-01T14:13:17.527822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 1920, pipe: [1:7556256214129352402:10286]
2025-10-01T14:13:17.601450Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:17.607860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.607882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.608008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.608061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.608119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.608173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.608212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.608218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.608275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.608326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.608375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.608428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.608465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.608471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.608522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.608569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.608633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.608683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.608719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.608725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.608774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.608823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.608867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.608913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.608948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.608953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.609001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.609047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.609098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.609150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.609191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.609198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.609248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.609294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.609344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.609395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.609434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.609438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.609489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.609534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.609581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.609642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.609681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.609688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.609739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.609785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.609832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.609882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.609918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.609922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.609973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.610023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.610073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.610126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.610165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.610170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.610223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.610271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.610319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.610382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.610418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.610423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.610457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352402:10286], now have 1 active actors on pipe
2025-10-01T14:13:17.610673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256214129352402:10286]
2025-10-01T14:13:17.610676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:17.610679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:17.610699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1921 reason: error at write: Disconnected sessionId: src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0
2025-10-01T14:13:17.610708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:17.610869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1921 sessionId: src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0 is DEAD
2025-10-01T14:13:17.610964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:17.610973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0] Write session will restart in 0.007616s
2025-10-01T14:13:17.610991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0] Write session: Do CDS request
2025-10-01T14:13:17.610996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:17.611154Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:17.619731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.619811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:17.619822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1922
2025-10-01T14:13:17.619937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.619967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:17.619975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:17.619978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:17.620293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1922 sessionId:  describe result for acl check
2025-10-01T14:13:17.620319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:17.620326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:17.620327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:17.620330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256214129352535:10400] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:17.620727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256214129352535:10400] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:17.622644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256214129352535:10400] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:17.623300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:17.625221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:17.625333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:17.625340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:17.625347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:17.625373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:17.625404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256211752453557:10264]
2025-10-01T14:13:17.625463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256214129352535:10400] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:17.625473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256214129352535:10400] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:17.625475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256214129352535:10400] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:17.625479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:17.625779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:17.625967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:17.626005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:17.626201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:17.626236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.626240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.626241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.626241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.626242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.626242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.626243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.626244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.626244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.626245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.626245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.626246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.626246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.626247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.626250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.626255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.626257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.626259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.626261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.626263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.626265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.626267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.626269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.626271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.626273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.626275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.626277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.626279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.626283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.626288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.626292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.626295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.626298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.626300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.626302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.626305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.626307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.626309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.626312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.626314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.626317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.626319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.626321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.626324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.626326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.626329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.626331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.626334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.626336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.626338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.626340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.626343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.626345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.626348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.626350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.626352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.626382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:17.629586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:17.630099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:17.630112Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:17.630113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:17.630115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:17.630119Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1921 [2:7556256211752453557:10264]
2025-10-01T14:13:17.630128Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:17.630138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:17.630140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.630142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.630143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.630153Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:17.630157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:17.630161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:17.630191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.630196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.630198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.630200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:17.630202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:17.630240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:17.630245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.630252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.630257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.630265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:17.630278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256211752453552:10264]
2025-10-01T14:13:17.630283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256211752453552:10264]
2025-10-01T14:13:17.630284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256211752453552:10264]
2025-10-01T14:13:17.630292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:17.630298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:17.630305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352404:2446], now have 1 active actors on pipe
2025-10-01T14:13:17.630307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352655:10400], now have 1 active actors on pipe
2025-10-01T14:13:17.630308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:17.630310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:17.630314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:17.630323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:17.630326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:17.630345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256211752453552:10264]
2025-10-01T14:13:17.630358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:17.630365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:17.630346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1921
2025-10-01T14:13:17.630347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1921
2025-10-01T14:13:17.630414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.630421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.630440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:17.630450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.630454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.630456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:17.630463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.630474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:17.630487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.630616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.630624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.630634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.630701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1922 partition: 0 MaxSeqNo: 45 sessionId: src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0
2025-10-01T14:13:17.630969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df2a083e-49d9c20b-d3e01842-872ba74b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:17.633118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0] Write session: try to update token
2025-10-01T14:13:17.633131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:17.640319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:17.640340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:17.640350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256211752453552:10264]
2025-10-01T14:13:17.640385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:17.640392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:17.640533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:17.640668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:17.640827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:17.640962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:17.641119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:17.641147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:17.644605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1922 sessionId: src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:17.646609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:17.646755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.646773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.646800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:17.646864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:17.659087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:17.659106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:17.659108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:17.659110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:17.659120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256211752453552:10264]
2025-10-01T14:13:17.659124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256211752453552:10264]
2025-10-01T14:13:17.659128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256211752453552:10264]
2025-10-01T14:13:17.659162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:17.659170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:17.659173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:17.659176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:17.659176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.659179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:17.659293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:17.710873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256214129352667:10286]
2025-10-01T14:13:17.711084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 1921, pipe: [1:7556256214129352667:10286]
2025-10-01T14:13:17.786100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:17.792798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.792820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.792952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.793002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.793053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.793109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.793150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.793158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.793213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.793274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.793338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.793396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.793433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.793439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.793490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.793538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.793597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.793669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.793708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.793713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.793766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.793814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.793860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.793911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.793949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.793954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.794007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.794067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.794123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.794175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.794212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.794217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.794284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.794340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.794406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.794458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.794496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.794501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.794557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.794608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.794663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.794716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.794755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.794760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.794816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.794874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.794932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.794987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.795030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.795036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.795089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.795138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.795191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.795243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.795280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.795285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.795335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:17.795382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:17.795442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:17.795493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:17.795528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:17.795534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:17.795573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352667:10286], now have 1 active actors on pipe
2025-10-01T14:13:17.795807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:17.795829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256214129352667:10286]
2025-10-01T14:13:17.795855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:17.795867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:17.795891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1922 reason: error at write: Disconnected sessionId: src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0
2025-10-01T14:13:17.796082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1922 sessionId: src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0 is DEAD
2025-10-01T14:13:17.796235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:17.796244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0] Write session will restart in 0.008891s
2025-10-01T14:13:17.796268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0] Write session: Do CDS request
2025-10-01T14:13:17.796274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:17.796521Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:17.805864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.806056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:17.806070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1923
2025-10-01T14:13:17.806168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.806199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:17.806208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:17.806212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:17.806626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1923 sessionId:  describe result for acl check
2025-10-01T14:13:17.806661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:17.806663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:17.806664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:17.806669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256214129352816:10404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:17.807137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256214129352816:10404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:17.809179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256214129352816:10404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:17.809697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:17.811611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:17.811742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:17.811750Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:17.811758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:17.811770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256214129352816:10404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:17.811783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256214129352816:10404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:17.811786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256214129352816:10404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:17.811792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:17.811793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:17.811822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256211752453814:10267]
2025-10-01T14:13:17.812172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:17.812343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:17.812369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:17.812546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:17.812579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.812581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.812582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.812582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.812583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.812584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.812585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.812585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.812586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.812586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.812587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.812587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.812588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.812588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.812591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.812597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.812599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.812601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.812603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.812605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.812607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.812609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.812620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.812622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.812624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.812626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.812627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.812629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.812633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.812637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.812641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.812644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.812646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.812650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.812652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.812654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.812657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.812659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.812661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.812664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.812667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.812669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.812671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.812674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.812676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.812678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.812680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.812683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.812685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.812688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.812690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.812692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.812694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.812697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.812699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.812701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.812720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:17.815890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:17.816403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:17.816417Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:17.816419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:17.816422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:17.816427Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1922 [2:7556256211752453814:10267]
2025-10-01T14:13:17.816435Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:17.816446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:17.816447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.816449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.816450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.816461Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:17.816465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:17.816468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:17.816501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.816508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.816509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.816512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:17.816513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:17.816556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:17.816563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.816572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.816581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.816594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:17.816621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352921:10404], now have 1 active actors on pipe
2025-10-01T14:13:17.816626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352669:2446], now have 1 active actors on pipe
2025-10-01T14:13:17.816632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256211752453809:10267]
2025-10-01T14:13:17.816633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256211752453809:10267]
2025-10-01T14:13:17.816635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256211752453809:10267]
2025-10-01T14:13:17.816643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:17.816652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:17.816655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:17.816657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:17.816658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:17.816661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:17.816663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:17.816682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256211752453809:10267]
2025-10-01T14:13:17.816684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:17.816670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1922
2025-10-01T14:13:17.816671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1922
2025-10-01T14:13:17.816686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:17.816701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.816705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.816735Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:17.816747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.816751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.816753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:17.816760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.816769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:17.816787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.816905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.816913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.816924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.816991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1923 partition: 0 MaxSeqNo: 45 sessionId: src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0
2025-10-01T14:13:17.817314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19095e3d-f7f3ef9e-5278c7ea-d1078310_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:17.819691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0] Write session: try to update token
2025-10-01T14:13:17.819710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:17.832653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1923 sessionId: src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:17.834696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:17.835417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.835440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.835462Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:17.835465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:17.835468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:17.835470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:17.835477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256211752453809:10267]
2025-10-01T14:13:17.835482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256211752453809:10267]
2025-10-01T14:13:17.835486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256211752453809:10267]
2025-10-01T14:13:17.835526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:17.835533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:17.835538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.835539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:17.835539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:17.835542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:17.835660Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:17.896173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256214129352948:10286]
2025-10-01T14:13:17.896423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 1922, pipe: [1:7556256214129352948:10286]
2025-10-01T14:13:17.965817Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:17.966026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:17.966079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352948:10286], now have 1 active actors on pipe
2025-10-01T14:13:17.966163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:17.966210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256214129352948:10286]
2025-10-01T14:13:17.966225Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:17.966243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:17.966249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:17.966305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1923 reason: error at write: Disconnected sessionId: src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0
2025-10-01T14:13:17.966446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1923 sessionId: src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0 is DEAD
2025-10-01T14:13:17.966563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:17.966573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0] Write session will restart in 0.005682s
2025-10-01T14:13:17.966596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0] Write session: Do CDS request
2025-10-01T14:13:17.966602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:17.973771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.973874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:17.973886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1924
2025-10-01T14:13:17.973972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:17.974001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:17.974010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:17.974013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:17.974432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1924 sessionId:  describe result for acl check
2025-10-01T14:13:17.974458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:17.974463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:17.974464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:17.974466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256214129353058:10416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:17.974863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256214129353058:10416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:17.976997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256214129353058:10416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:17.978258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:17.980386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:17.980515Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:17.980523Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:17.980530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:17.980559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:17.980584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256211752454077:10271]
2025-10-01T14:13:17.980682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256214129353058:10416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:17.980694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256214129353058:10416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:17.980696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256214129353058:10416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:17.980701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:17.980975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:17.981165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:17.981201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:17.981432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:17.981472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.981476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.981477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.981478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.981478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.981479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.981480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.981480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.981481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.981481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.981482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.981482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.981483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.981483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.981486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.981492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.981494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.981496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.981498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.981500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.981502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.981504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.981506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.981508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.981510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.981512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.981514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.981516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.981520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.981524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:17.981528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.981531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:17.981533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.981536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:17.981538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.981540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:17.981543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.981545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:17.981547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.981550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:17.981553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.981556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:17.981558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.981561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:17.981564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.981567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:17.981569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.981572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.981574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.981577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.981579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.981582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.981584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.981587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:17.981589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.981591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:17.981610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:17.984806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:17.985335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:17.985349Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:17.985351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:17.985355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:17.985361Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1923 [2:7556256211752454077:10271]
2025-10-01T14:13:17.985370Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:17.985379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:17.985380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.985382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.985384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.985395Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:17.985398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:17.985402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:17.985435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.985441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.985442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.985444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:17.985445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:17.985496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:17.985503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:17.985513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:17.985519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:17.985527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:17.985538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129352961:2446], now have 1 active actors on pipe
2025-10-01T14:13:17.985544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256214129353211:10416], now have 1 active actors on pipe
2025-10-01T14:13:17.985549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256211752454072:10271]
2025-10-01T14:13:17.985550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256211752454072:10271]
2025-10-01T14:13:17.985551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256211752454072:10271]
2025-10-01T14:13:17.985561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:17.985573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:17.985576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:17.985578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:17.985580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:17.985584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:17.985586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:17.985576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1923
2025-10-01T14:13:17.985584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1923
2025-10-01T14:13:17.985602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256211752454072:10271]
2025-10-01T14:13:17.985607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:17.985609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:17.985621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.985626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.985655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:17.985663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:17.985666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:17.985667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:17.985673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:17.985678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:17.985689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.985798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:17.985804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:17.985815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:17.985889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1924 partition: 0 MaxSeqNo: 45 sessionId: src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0
2025-10-01T14:13:17.986186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a85520f4-b55a61f3-a7c43324-9c84d63a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:17.988376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0] Write session: try to update token
2025-10-01T14:13:17.988387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:18.000040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1924 sessionId: src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:18.002129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:18.002257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.002277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.004069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:18.004083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:18.004084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:18.004086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:18.004093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256211752454072:10271]
2025-10-01T14:13:18.004096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256211752454072:10271]
2025-10-01T14:13:18.004099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256211752454072:10271]
2025-10-01T14:13:18.004140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:18.004143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:18.004146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:18.004150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:18.004161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:18.004167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.004173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:18.004234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:18.004293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:18.066202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256218424320519:10286]
2025-10-01T14:13:18.066498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 1923, pipe: [1:7556256218424320519:10286]
2025-10-01T14:13:18.134249Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:18.140760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.140787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.140922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.140976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.141034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.141094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.141136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.141144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.141203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.141256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.141311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.141367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.141407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.141413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.141465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.141515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.141568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.141619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.141656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.141661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.141716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.141767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.141819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.141889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.141928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.141934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.141985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.142033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.142088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.142140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.142176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.142181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.142234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.142284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.142343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.142411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.142452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.142457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.142510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.142561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.142613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.142663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.142702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.142707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.142762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.142812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.142865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.142924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.142970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.142975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.143031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.143082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.143140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.143194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.143233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.143238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.143294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.143348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.143403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.143459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.143496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.143501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.143538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424320519:10286], now have 1 active actors on pipe
2025-10-01T14:13:18.143773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256218424320519:10286]
2025-10-01T14:13:18.143799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:18.143811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:18.143814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:18.143837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1924 reason: error at write: Disconnected sessionId: src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0
2025-10-01T14:13:18.144018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1924 sessionId: src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0 is DEAD
2025-10-01T14:13:18.144130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:18.144138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0] Write session will restart in 0.009306s
2025-10-01T14:13:18.144156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0] Write session: Do CDS request
2025-10-01T14:13:18.144161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:18.144503Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:18.154863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.154901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:18.154918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1925
2025-10-01T14:13:18.155076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.155120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:18.155131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:18.155134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:18.155609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1925 sessionId:  describe result for acl check
2025-10-01T14:13:18.155653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:18.155660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:18.155662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:18.155669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256218424320640:10420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:18.156206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256218424320640:10420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:18.158996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256218424320640:10420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:18.161136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:18.163909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:18.164099Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:18.164109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:18.164118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:18.164114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256218424320640:10420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:18.164129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256218424320640:10420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:18.164132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256218424320640:10420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:18.164140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:18.164157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:18.164194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256216047421632:10274]
2025-10-01T14:13:18.164830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:18.165080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:18.165117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:18.165424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:18.165470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.165476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.165477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.165478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.165479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.165481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.165482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.165483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.165484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.165485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.165487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.165488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.165489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.165490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.165495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.165504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.165508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.165512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.165515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.165519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.165522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.165526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.165529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.165533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.165536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.165540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.165543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.165547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.165553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.165560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.165567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.165571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.165576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.165580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.165585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.165589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.165594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.165599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.165603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.165607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.165612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.165616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.165620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.165625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.165643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.165652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.165656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.165660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.165665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.165669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.165677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.165682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.165686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.165691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.165695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.165700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.165739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:18.169740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:18.170584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:18.170600Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:18.170603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:18.170607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:18.170614Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1924 [2:7556256216047421632:10274]
2025-10-01T14:13:18.170630Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:18.170648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:18.170652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.170656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.170658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.170675Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:18.170681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:18.170687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:18.170743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.170751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.170754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.170758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:18.170761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:18.170833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:18.170841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.170853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.170865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.170888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:18.170910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424320775:10420], now have 1 active actors on pipe
2025-10-01T14:13:18.170918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424320521:2446], now have 1 active actors on pipe
2025-10-01T14:13:18.170925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256216047421627:10274]
2025-10-01T14:13:18.170928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256216047421627:10274]
2025-10-01T14:13:18.170931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256216047421627:10274]
2025-10-01T14:13:18.170947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:18.170966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:18.170985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:18.170995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:18.171000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:18.171004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:18.171008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:18.170987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1924
2025-10-01T14:13:18.171002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1924
2025-10-01T14:13:18.171022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256216047421627:10274]
2025-10-01T14:13:18.171025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:18.171029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:18.171166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.171179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.171207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:18.171219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.171222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.171225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:18.171233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.171248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:18.171267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.171500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.171515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.171541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.171644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1925 partition: 0 MaxSeqNo: 45 sessionId: src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0
2025-10-01T14:13:18.172055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac8029c0-bdd2fe85-7d4678bc-4ce38f7d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:18.175006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0] Write session: try to update token
2025-10-01T14:13:18.175025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:18.191025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1925 sessionId: src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:18.193198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:18.193539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.193569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.193589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:18.193593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:18.193595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:18.193598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:18.193606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256216047421627:10274]
2025-10-01T14:13:18.193610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256216047421627:10274]
2025-10-01T14:13:18.193616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256216047421627:10274]
2025-10-01T14:13:18.193653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:18.193675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:18.193680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:18.193692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:18.193697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.193699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:18.193837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:18.243987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256218424320787:10286]
2025-10-01T14:13:18.244271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 1924, pipe: [1:7556256218424320787:10286]
2025-10-01T14:13:18.317969Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:18.318679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:18.318730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424320787:10286], now have 1 active actors on pipe
2025-10-01T14:13:18.318823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:18.318870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256218424320787:10286]
2025-10-01T14:13:18.318964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:18.318993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:18.319005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:18.319068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1925 reason: error at write: Disconnected sessionId: src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0
2025-10-01T14:13:18.319221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1925 sessionId: src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0 is DEAD
2025-10-01T14:13:18.319342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:18.319352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0] Write session will restart in 0.005166s
2025-10-01T14:13:18.319374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0] Write session: Do CDS request
2025-10-01T14:13:18.319383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:18.325757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.325870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:18.325882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1926
2025-10-01T14:13:18.325981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.326011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:18.326019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:18.326023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:18.326534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1926 sessionId:  describe result for acl check
2025-10-01T14:13:18.326558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:18.326564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:18.326565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:18.326568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256218424320827:10424] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:18.326952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256218424320827:10424] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:18.329668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256218424320827:10424] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:18.332761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256218424320827:10424] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:18.332770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256218424320827:10424] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:18.332773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256218424320827:10424] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:18.332779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:18.335504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:18.338393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:18.338532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:18.338540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:18.338546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:18.338578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:18.338608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256216047421932:10287]
2025-10-01T14:13:18.339033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:18.339269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:18.339295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:18.339522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:18.339571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.339576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.339576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.339577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.339578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.339578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.339579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.339580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.339580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.339581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.339582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.339582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.339583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.339584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.339586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.339592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.339595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.339597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.339599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.339601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.339603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.339605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.339607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.339609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.339611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.339613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.339616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.339618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.339624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.339629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.339632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.339635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.339638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.339641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.339643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.339646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.339649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.339653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.339655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.339660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.339666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.339670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.339672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.339675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.339677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.339683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.339685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.339689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.339692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.339695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.339700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.339703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.339705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.339711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.339713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.339716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.339739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:18.342974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:18.343579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:18.343591Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:18.343592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:18.343595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:18.343599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1925 [2:7556256216047421932:10287]
2025-10-01T14:13:18.343608Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:18.343623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:18.343627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.343630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.343631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.343641Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:18.343647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:18.343652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:18.343692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.343697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.343699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.343701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:18.343702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:18.343747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:18.343753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.343759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.343767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.343778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:18.343793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424320993:10424], now have 1 active actors on pipe
2025-10-01T14:13:18.343799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424320788:2446], now have 1 active actors on pipe
2025-10-01T14:13:18.343803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256216047421927:10287]
2025-10-01T14:13:18.343810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256216047421927:10287]
2025-10-01T14:13:18.343811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256216047421927:10287]
2025-10-01T14:13:18.343821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:18.343833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:18.343844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:18.343849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:18.343848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:18.343853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:18.343854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:18.343865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256216047421927:10287]
2025-10-01T14:13:18.343870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:18.343870Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1925
2025-10-01T14:13:18.343884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1925
2025-10-01T14:13:18.343891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:18.343936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.343942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.343958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:18.343965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.343968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.343973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:18.343979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.343989Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:18.344000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.344146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.344151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.344159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.344216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1926 partition: 0 MaxSeqNo: 45 sessionId: src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0
2025-10-01T14:13:18.344503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7315360a-8da2ae5f-dc107ecc-88e0afca_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:18.346607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0] Write session: try to update token
2025-10-01T14:13:18.346622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:18.357646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1926 sessionId: src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:18.359624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:18.359803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.359820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.359839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:18.359926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:18.362607Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:18.362626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:18.362628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:18.362629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:18.362635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256216047421927:10287]
2025-10-01T14:13:18.362638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256216047421927:10287]
2025-10-01T14:13:18.362642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256216047421927:10287]
2025-10-01T14:13:18.362676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:18.362681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.362686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:18.362686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:18.362693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:18.362697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:18.362818Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:18.418974Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256218424321056:10286]
2025-10-01T14:13:18.419199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 1925, pipe: [1:7556256218424321056:10286]
2025-10-01T14:13:18.494904Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:18.501440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.501468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.501611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.501665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.501722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.501785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.501829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.501837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.501904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.501957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.502007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.502062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.502103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.502112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.502170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.502228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.502287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.502337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.502395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.502404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.502473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.502539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.502603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.502667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.502713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.502721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.502784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.502846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.502909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.502974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.503024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.503032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.503097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.503156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.503223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.503289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.503336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.503345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.503412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.503472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.503538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.503602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.503647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.503656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.503721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.503788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.503849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.503912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.504045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.504056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.504123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.504190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.504254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.504320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.504366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.504375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.504444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.504511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.504582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.504659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.504793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.504802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.504848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321056:10286], now have 1 active actors on pipe
2025-10-01T14:13:18.505012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:18.505054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:18.505056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:18.505078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1926 reason: error at write: Disconnected sessionId: src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0
2025-10-01T14:13:18.505249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1926 sessionId: src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0 is DEAD
2025-10-01T14:13:18.505389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:18.505375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256218424321056:10286]
2025-10-01T14:13:18.505405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0] Write session will restart in 0.005388s
2025-10-01T14:13:18.505442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0] Write session: Do CDS request
2025-10-01T14:13:18.505448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:18.505728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:18.511829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.511886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:18.511897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1927
2025-10-01T14:13:18.512007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.512036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:18.512043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:18.512045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:18.512330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1927 sessionId:  describe result for acl check
2025-10-01T14:13:18.512357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:18.512362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:18.512363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:18.512366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256218424321112:10430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:18.512775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256218424321112:10430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:18.514421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256218424321112:10430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:18.517097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256218424321112:10430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:18.517110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256218424321112:10430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:18.517113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256218424321112:10430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:18.517118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:18.519626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:18.521871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:18.522022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:18.522031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:18.522039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:18.522070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:18.522097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256216047422191:10289]
2025-10-01T14:13:18.522501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:18.522678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:18.522705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:18.522892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:18.522926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.522931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.522932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.522932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.522933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.522934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.522934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.522935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.522936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.522936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.522937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.522937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.522938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.522939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.522942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.522948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.522951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.522953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.522955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.522957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.522959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.522961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.522963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.522965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.522967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.522969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.522971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.522973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.522978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.522993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.522999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.523004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.523009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.523013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.523016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.523021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.523026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.523028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.523030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.523033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.523036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.523039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.523041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.523044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.523046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.523049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.523052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.523055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.523059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.523062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.523066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.523069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.523071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.523074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.523077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.523079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.523098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:18.526527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:18.527156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:18.527168Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:18.527169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:18.527171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:18.527176Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1926 [2:7556256216047422191:10289]
2025-10-01T14:13:18.527186Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:18.527196Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:18.527197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.527200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.527201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.527211Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:18.527214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:18.527219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:18.527253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.527260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.527261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.527263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:18.527264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:18.527308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:18.527315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.527321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.527326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.527335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:18.527351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321277:10430], now have 1 active actors on pipe
2025-10-01T14:13:18.527358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321078:2446], now have 1 active actors on pipe
2025-10-01T14:13:18.527363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256216047422186:10289]
2025-10-01T14:13:18.527364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256216047422186:10289]
2025-10-01T14:13:18.527365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256216047422186:10289]
2025-10-01T14:13:18.527374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:18.527387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:18.527387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:18.527390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:18.527391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:18.527395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:18.527397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:18.527412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256216047422186:10289]
2025-10-01T14:13:18.527421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:18.527425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:18.527464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.527473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.527491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:18.527500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.527503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.527504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:18.527510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.527520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:18.527530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.527632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.527639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.527426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1926
2025-10-01T14:13:18.527650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.527430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1926
2025-10-01T14:13:18.527711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1927 partition: 0 MaxSeqNo: 45 sessionId: src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0
2025-10-01T14:13:18.528015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7ea6303a-a5e6de6a-717eb2bf-bcf9fca5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:18.530187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0] Write session: try to update token
2025-10-01T14:13:18.530201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:18.542810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:18.542827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:18.542835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256216047422186:10289]
2025-10-01T14:13:18.542873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:18.542873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:18.543022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1927 sessionId: src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:18.543085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:18.543213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:18.543332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:18.543458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:18.543645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:18.543680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:18.544969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:18.545099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.545114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.545136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:18.545202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:18.557030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:18.557050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:18.557052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:18.557055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:18.557065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256216047422186:10289]
2025-10-01T14:13:18.557069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256216047422186:10289]
2025-10-01T14:13:18.557072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256216047422186:10289]
2025-10-01T14:13:18.557106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:18.557120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:18.557122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:18.562543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.562566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.562693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.562744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.562795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.562846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.562884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.562892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.562945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.562994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.563044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.563096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.563136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.563143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.563195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.563249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.563300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.563348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.563386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.563393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.563445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.563495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.563546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.563596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.563635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.563641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.563698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.563750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.563799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.563858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.563904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.563911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.563969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.564026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.564084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.564137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.564180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.564188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.564242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.564298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.564357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.564416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.564458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.564466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.564530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.564592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.564665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.564725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.564768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.564776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.564837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.564896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.564955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.565017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.565060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.565068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.565124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.565181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.565237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.565295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.565335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.565341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.565394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:18.565403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.565405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:18.565519Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:18.605544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256218424321346:10286]
2025-10-01T14:13:18.605762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 1926, pipe: [1:7556256218424321346:10286]
2025-10-01T14:13:18.697214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:18.698708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321346:10286], now have 1 active actors on pipe
2025-10-01T14:13:18.698922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:18.698928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256218424321346:10286]
2025-10-01T14:13:18.698942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:18.698938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:18.698942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:18.698962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1927 reason: error at write: Disconnected sessionId: src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0
2025-10-01T14:13:18.699130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1927 sessionId: src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0 is DEAD
2025-10-01T14:13:18.699256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:18.699265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0] Write session will restart in 0.008291s
2025-10-01T14:13:18.699288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0] Write session: Do CDS request
2025-10-01T14:13:18.699293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:18.708751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.708874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:18.708884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1928
2025-10-01T14:13:18.708979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.709001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:18.709004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:18.709007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:18.709339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1928 sessionId:  describe result for acl check
2025-10-01T14:13:18.709363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:18.709367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:18.709368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:18.709371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256218424321476:10434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:18.709717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256218424321476:10434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:18.711909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256218424321476:10434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:18.713047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:18.714978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:18.715098Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:18.715110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:18.715117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:18.715148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:18.715170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256216047422452:10292]
2025-10-01T14:13:18.715191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256218424321476:10434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:18.715201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256218424321476:10434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:18.715204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256218424321476:10434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:18.715210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:18.715516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:18.715676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:18.715702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:18.715882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:18.715912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.715917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.715918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.715918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.715919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.715919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.715920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.715921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.715921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.715922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.715922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.715923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.715923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.715924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.715927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.715933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.715935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.715937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.715939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.715941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.715943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.715945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.715948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.715950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.715952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.715954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.715956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.715958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.715962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.715966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.715970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.715973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.715976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.715979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.715981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.715984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.715986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.715989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.715991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.715994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.715996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.715998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.716001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.716003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.716005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.716008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.716010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.716013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.716016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.716019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.716021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.716024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.716026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.716029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.716031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.716033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.716051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:18.719244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:18.719775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:18.719792Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:18.719794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:18.719796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:18.719800Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1927 [2:7556256216047422452:10292]
2025-10-01T14:13:18.719808Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:18.719817Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:18.719818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.719820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.719822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.719832Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:18.719835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:18.719839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:18.719870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.719871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.719872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.719874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:18.719875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:18.719917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:18.719924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.719930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.719936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.719944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:18.719960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321349:2446], now have 1 active actors on pipe
2025-10-01T14:13:18.719962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321606:10434], now have 1 active actors on pipe
2025-10-01T14:13:18.719967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256216047422447:10292]
2025-10-01T14:13:18.719968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256216047422447:10292]
2025-10-01T14:13:18.719969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256216047422447:10292]
2025-10-01T14:13:18.719978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:18.719986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:18.719988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:18.719990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:18.719992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:18.719994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:18.719995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:18.720010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256216047422447:10292]
2025-10-01T14:13:18.720016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:18.720018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:18.719998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1927
2025-10-01T14:13:18.720001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1927
2025-10-01T14:13:18.720032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.720040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.720062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:18.720071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.720074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.720076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:18.720081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.720086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:18.720105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.720199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.720207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.720216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.720266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1928 partition: 0 MaxSeqNo: 45 sessionId: src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0
2025-10-01T14:13:18.720509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3fb8b8e-97b69aff-f6fc24cb-70a37f28_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:18.722711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0] Write session: try to update token
2025-10-01T14:13:18.722725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:18.734955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1928 sessionId: src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:18.736843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:18.737028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.737057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.737092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:18.737171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:18.739082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:18.739097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:18.739098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:18.739099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:18.739106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256216047422447:10292]
2025-10-01T14:13:18.739110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256216047422447:10292]
2025-10-01T14:13:18.739113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256216047422447:10292]
2025-10-01T14:13:18.739141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:18.739148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:18.739152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:18.739153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.739154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:18.739154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:18.739265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:18.798872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256218424321617:10286]
2025-10-01T14:13:18.799086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 1927, pipe: [1:7556256218424321617:10286]
2025-10-01T14:13:18.865998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:18.872735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.872758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.872891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.872943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.872995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.873049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.873089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.873096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.873153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.873205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.873258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.873316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.873361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.873367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.873421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.873469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.873518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.873568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.873605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.873609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.873661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.873709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.873758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.873805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.873843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.873847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.873898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.873946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.873996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.874044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.874080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.874085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.874137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.874185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.874239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.874292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.874330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.874334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.874396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.874444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.874496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.874544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.874586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.874592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.874642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.874690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.874741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.874794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.874845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.874850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.874903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.874954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.875008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.875061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.875098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.875103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.875156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:18.875206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:18.875261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:18.875312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:18.875349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:18.875353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:18.875389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321617:10286], now have 1 active actors on pipe
2025-10-01T14:13:18.875571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:18.875572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:18.875575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:18.875601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1928 reason: error at write: Disconnected sessionId: src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0
2025-10-01T14:13:18.875627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256218424321617:10286]
2025-10-01T14:13:18.875756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1928 sessionId: src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0 is DEAD
2025-10-01T14:13:18.875873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:18.875880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0] Write session will restart in 0.009896s
2025-10-01T14:13:18.875897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0] Write session: Do CDS request
2025-10-01T14:13:18.875902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:18.876072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:18.886796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.886845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:18.886856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1929
2025-10-01T14:13:18.886972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:18.886995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:18.886999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:18.887001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:18.887371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1929 sessionId:  describe result for acl check
2025-10-01T14:13:18.887403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:18.887410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:18.887411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:18.887416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256218424321804:10439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:18.887775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256218424321804:10439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:18.889287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:18.889876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256218424321804:10439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:18.891350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:18.891479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:18.891487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:18.891495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:18.891530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:18.891557Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256216047422713:10294]
2025-10-01T14:13:18.891933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:18.892071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256218424321804:10439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:18.892080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256218424321804:10439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:18.892083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256218424321804:10439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:18.892090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:18.892130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:18.892155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:18.892341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:18.892372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.892376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.892377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.892377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.892378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.892378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.892379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.892380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.892380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.892381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.892381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.892382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.892382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.892383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.892386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.892391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.892393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.892395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.892397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.892399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.892401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.892403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.892405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.892408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.892410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.892412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.892414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.892416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.892420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.892424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:18.892428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.892431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:18.892433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.892436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:18.892438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.892441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:18.892444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.892446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:18.892449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.892452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:18.892454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.892457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:18.892460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.892462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:18.892464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.892467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:18.892470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.892473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.892475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.892478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.892480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.892487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.892489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.892492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:18.892494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.892497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:18.892526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:18.895954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:18.896477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:18.896488Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:18.896489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:18.896491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:18.896495Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1928 [2:7556256216047422713:10294]
2025-10-01T14:13:18.896503Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:18.896514Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:18.896516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.896518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.896519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.896528Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:18.896535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:18.896539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:18.896570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.896575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.896576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.896578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:18.896579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:18.896633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:18.896639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.896645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:18.896650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:18.896659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:18.896674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321619:2446], now have 1 active actors on pipe
2025-10-01T14:13:18.896680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321882:10439], now have 1 active actors on pipe
2025-10-01T14:13:18.896685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256216047422708:10294]
2025-10-01T14:13:18.896686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256216047422708:10294]
2025-10-01T14:13:18.896687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256216047422708:10294]
2025-10-01T14:13:18.896696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:18.896708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:18.896712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:18.896714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:18.896717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:18.896719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:18.896721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:18.896735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256216047422708:10294]
2025-10-01T14:13:18.896740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:18.896742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:18.896748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1928
2025-10-01T14:13:18.896748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1928
2025-10-01T14:13:18.896778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.896785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.896802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:18.896809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:18.896812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:18.896813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:18.896819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:18.896824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:18.896836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.896945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.896950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.896959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:18.897018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1929 partition: 0 MaxSeqNo: 45 sessionId: src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0
2025-10-01T14:13:18.897315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eef61c6-fad41f17-9d149dfb-24d9f7bb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:18.899507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0] Write session: try to update token
2025-10-01T14:13:18.899519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:18.907989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:18.908016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:18.908027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256216047422708:10294]
2025-10-01T14:13:18.908067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:18.908078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:18.908408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:18.908668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:18.908910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:18.909138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:18.909636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:18.909695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:18.911739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1929 sessionId: src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:18.913859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:18.914061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:18.914074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:18.914098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:18.914164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:18.927398Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:18.927412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:18.927413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:18.927415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:18.927421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256216047422708:10294]
2025-10-01T14:13:18.927424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256216047422708:10294]
2025-10-01T14:13:18.927426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256216047422708:10294]
2025-10-01T14:13:18.927461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:18.927470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:18.927472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:18.927485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:18.927493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:18.927496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:18.927578Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:18.976025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256218424321913:10286]
2025-10-01T14:13:18.976228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 1928, pipe: [1:7556256218424321913:10286]
2025-10-01T14:13:19.059120Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:19.065544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.065573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.065712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.065766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.065820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.065870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.066051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.066059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.066117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.066173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.066228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.066285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.066322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.066330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.066395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.066446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.066495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.066545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.066585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.066590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.066642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.066871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.066925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.066977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.067013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.067018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.067068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.067118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.067166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.067215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.067256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.067264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.067314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.067362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.067411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.067459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.067499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.067504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.067608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.067657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.067741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.067789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.067835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.067846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.067901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.067951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.068001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.068052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.068090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.068096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.068149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.068198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.068248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.068301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.068339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.068344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.068394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.068440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.068489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.068539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.068576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.068580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.068628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256218424321913:10286], now have 1 active actors on pipe
2025-10-01T14:13:19.068891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:19.068900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256218424321913:10286]
2025-10-01T14:13:19.068919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:19.068921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:19.068942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1929 reason: error at write: Disconnected sessionId: src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0
2025-10-01T14:13:19.069005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:19.069105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1929 sessionId: src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0 is DEAD
2025-10-01T14:13:19.069230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:19.069237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0] Write session will restart in 0.007145s
2025-10-01T14:13:19.069255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0] Write session: Do CDS request
2025-10-01T14:13:19.069259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:19.077830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.077900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:19.077912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1930
2025-10-01T14:13:19.078004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.078027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:19.078034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:19.078036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:19.078340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1930 sessionId:  describe result for acl check
2025-10-01T14:13:19.078382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:19.078386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:19.078388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:19.078391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256222719289313:10450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:19.078763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256222719289313:10450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:19.081258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256222719289313:10450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:19.082749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:19.084790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:19.084933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:19.084943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:19.084951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:19.084988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:19.085013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256220342390280:10298]
2025-10-01T14:13:19.085058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256222719289313:10450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:19.085071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256222719289313:10450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:19.085075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256222719289313:10450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:19.085081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:19.085375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:19.085542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:19.085565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:19.085748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:19.085782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.085786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.085786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.085787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.085788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.085788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.085789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.085790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.085790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.085791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.085792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.085792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.085793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.085793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.085796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.085802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.085804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.085806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.085808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.085810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.085812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.085814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.085816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.085818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.085820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.085822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.085824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.085826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.085831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.085835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.085839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.085841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.085845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.085848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.085850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.085853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.085857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.085860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.085866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.085869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.085871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.085874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.085879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.085882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.085884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.085887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.085890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.085893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.085898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.085901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.085903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.085906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.085911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.085914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.085917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.085922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.085941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:19.089178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:19.089731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:19.089743Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:19.089744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:19.089746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:19.089751Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1929 [2:7556256220342390280:10298]
2025-10-01T14:13:19.089761Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:19.089786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:19.089791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.089793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.089794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.089805Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:19.089809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:19.089814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:19.089852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.089856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.089858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.089860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:19.089862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:19.089906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:19.089910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.089916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.089925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.089937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:19.089953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719289212:2446], now have 1 active actors on pipe
2025-10-01T14:13:19.089960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719289471:10450], now have 1 active actors on pipe
2025-10-01T14:13:19.089967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256220342390275:10298]
2025-10-01T14:13:19.089972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256220342390275:10298]
2025-10-01T14:13:19.089974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256220342390275:10298]
2025-10-01T14:13:19.089986Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:19.089981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1929
2025-10-01T14:13:19.090003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1929
2025-10-01T14:13:19.089996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:19.090001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:19.090006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:19.090007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:19.090014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:19.090016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:19.090054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.090062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.090070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256220342390275:10298]
2025-10-01T14:13:19.090078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:19.090091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:19.090097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19940855-36048836-a435d67d-bbe9cecc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:19.090102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.090104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.090106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:19.090112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.090121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:19.090136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.090217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.090222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.090231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.090283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1930 partition: 0 MaxSeqNo: 45 sessionId: src_id|19940855-36048836-a435d67d-bbe9cecc_0
2025-10-01T14:13:19.090584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c279db7-28e89a91-2eb92bd1-c7bdf45_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|19940855-36048836-a435d67d-bbe9cecc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:19.092763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19940855-36048836-a435d67d-bbe9cecc_0] Write session: try to update token
2025-10-01T14:13:19.092783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19940855-36048836-a435d67d-bbe9cecc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:19.104665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1930 sessionId: src_id|19940855-36048836-a435d67d-bbe9cecc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:19.106773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:19.106931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.106964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.106995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:19.107059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:19.109219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:19.109235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:19.109237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:19.109238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:19.109244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256220342390275:10298]
2025-10-01T14:13:19.109248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256220342390275:10298]
2025-10-01T14:13:19.109250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256220342390275:10298]
2025-10-01T14:13:19.109283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:19.109291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.109293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:19.109292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:19.109297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:19.109300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:19.109406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:19.169054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256222719289482:10286]
2025-10-01T14:13:19.169256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 1929, pipe: [1:7556256222719289482:10286]
2025-10-01T14:13:19.239778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:19.246092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.246118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.246242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.246295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.246348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.246413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.246452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.246461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.246520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.246569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.246621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.246676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.246713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.246719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.246770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.246819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.246871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.246924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.246961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.246966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.247016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.247065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.247122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.247180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.247218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.247222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.247272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.247318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.247363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.247420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.247457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.247462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.247512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.247561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.247612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.247663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.247700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.247705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.247756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.247806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.247857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.247908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.247950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.247954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.248006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.248056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.248106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.248159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.248198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.248203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.248255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.248305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.248356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.248422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.248476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.248483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.248536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.248584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.248641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.248693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.248729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.248734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.248772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719289482:10286], now have 1 active actors on pipe
2025-10-01T14:13:19.248934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:19.248990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256222719289482:10286]
2025-10-01T14:13:19.249074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:19.249083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:19.249110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1930 reason: error at write: Disconnected sessionId: src_id|19940855-36048836-a435d67d-bbe9cecc_0
2025-10-01T14:13:19.249302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1930 sessionId: src_id|19940855-36048836-a435d67d-bbe9cecc_0 is DEAD
2025-10-01T14:13:19.249406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19940855-36048836-a435d67d-bbe9cecc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:19.249415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19940855-36048836-a435d67d-bbe9cecc_0] Write session will restart in 0.005988s
2025-10-01T14:13:19.249433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19940855-36048836-a435d67d-bbe9cecc_0] Write session: Do CDS request
2025-10-01T14:13:19.249438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19940855-36048836-a435d67d-bbe9cecc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:19.249549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:19.256804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19940855-36048836-a435d67d-bbe9cecc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.256943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:19.256954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1931
2025-10-01T14:13:19.257029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.257051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:19.257058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:19.257060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:19.257446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1931 sessionId:  describe result for acl check
2025-10-01T14:13:19.257481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:19.257488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:19.257489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:19.257494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256222719289563:10454] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:19.258080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256222719289563:10454] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:19.260670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256222719289563:10454] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:19.262811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:19.264810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:19.264932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:19.264939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:19.264947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:19.264975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:19.265001Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256220342390568:10308]
2025-10-01T14:13:19.265172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256222719289563:10454] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:19.265183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256222719289563:10454] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:19.265185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256222719289563:10454] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:19.265190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:19.265361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:19.265518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:19.265541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:19.265721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:19.265789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.265795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.265796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.265797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.265797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.265798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.265799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.265799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.265800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.265800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.265801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.265802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.265802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.265803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.265806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.265812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.265814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.265816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.265818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.265820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.265822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.265823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.265825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.265827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.265829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.265830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.265832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.265834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.265838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.265842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.265846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.265849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.265851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.265854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.265856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.265858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.265861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.265864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.265866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.265869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.265872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.265874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.265876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.265879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.265881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.265884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.265886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.265888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.265890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.265893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.265895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.265899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.265901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.265903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.265906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.265908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.265926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:19.269253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:19.269833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:19.269847Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:19.269848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:19.269851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:19.269857Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1930 [2:7556256220342390568:10308]
2025-10-01T14:13:19.269868Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:19.269880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:19.269888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.269891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.269894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.269908Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:19.269916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:19.269921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:19.269966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.269972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.269973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.269976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:19.269978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:19.270033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:19.270039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.270050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.270063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.270080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:19.270104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719289485:2446], now have 1 active actors on pipe
2025-10-01T14:13:19.270092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1930
2025-10-01T14:13:19.270121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1930
2025-10-01T14:13:19.270111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719289745:10454], now have 1 active actors on pipe
2025-10-01T14:13:19.270118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256220342390563:10308]
2025-10-01T14:13:19.270120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256220342390563:10308]
2025-10-01T14:13:19.270121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256220342390563:10308]
2025-10-01T14:13:19.270129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:19.270134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:19.270136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:19.270137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:19.270141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:19.270153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:19.270160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:19.270178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.270186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.270214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256220342390563:10308]
2025-10-01T14:13:19.270224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:19.270231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:19.270240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:19.270249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.270254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.270256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:19.270263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.270274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:19.270306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.270423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.270441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.270455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.270523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1931 partition: 0 MaxSeqNo: 45 sessionId: src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0
2025-10-01T14:13:19.270858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19940855-36048836-a435d67d-bbe9cecc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:19.273172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0] Write session: try to update token
2025-10-01T14:13:19.273188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:19.286014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1931 sessionId: src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:19.288122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:19.289759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.289786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.289806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:19.289810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:19.289815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:19.289817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:19.289824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256220342390563:10308]
2025-10-01T14:13:19.289833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256220342390563:10308]
2025-10-01T14:13:19.289836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256220342390563:10308]
2025-10-01T14:13:19.289865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:19.289875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:19.289878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:19.289889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:19.289895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.289897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:19.290018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:19.349283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256222719289757:10286]
2025-10-01T14:13:19.349506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 1930, pipe: [1:7556256222719289757:10286]
2025-10-01T14:13:19.431546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:19.432227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:19.432274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719289757:10286], now have 1 active actors on pipe
2025-10-01T14:13:19.432338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:19.432424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256222719289757:10286]
2025-10-01T14:13:19.432449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:19.440748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:19.440762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:19.440785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1931 reason: error at write: Disconnected sessionId: src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0
2025-10-01T14:13:19.440926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1931 sessionId: src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0 is DEAD
2025-10-01T14:13:19.441064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:19.441073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0] Write session will restart in 0.006909s
2025-10-01T14:13:19.441092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0] Write session: Do CDS request
2025-10-01T14:13:19.441098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:19.448815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.448883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:19.448895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1932
2025-10-01T14:13:19.448974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.448961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:19.448995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:19.449002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:19.449004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:19.449267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1932 sessionId:  describe result for acl check
2025-10-01T14:13:19.449291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:19.449296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:19.449298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:19.449302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256222719289986:10458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:19.449348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:19.449477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:19.449484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:19.449492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:19.449532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:19.449556Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256220342390848:10314]
2025-10-01T14:13:19.449665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256222719289986:10458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:19.449935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:19.451543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:19.451583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:19.451783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:19.451825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.451829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.451830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.451830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.451831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.451831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.451832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.451832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.451833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.451833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.451834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.451835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.451835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.451836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.451839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.451845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.451847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.451849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.451851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.451853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.451855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.451856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.451858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.451860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.451862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.451864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.451866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.451868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.451873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.451877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.451881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.451884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.451886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.451889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.451891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.451893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.451896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.451899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.451902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.451905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.451907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.451910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.451915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.451918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.451920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.451923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.451928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.451930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.451933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.451936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.451942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.451945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.451949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.451953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.451956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.451960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.451984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:19.452105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256222719289986:10458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:19.454956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256222719289986:10458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:19.454968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256222719289986:10458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:19.454970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256222719289986:10458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:19.454975Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:19.455153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:19.455651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:19.455664Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:19.455665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:19.455668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:19.455672Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1931 [2:7556256220342390848:10314]
2025-10-01T14:13:19.455680Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:19.455691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:19.455696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.455698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.455699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.455709Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:19.455716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:19.455720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:19.455756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.455761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.455762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.455764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:19.455766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:19.455810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:19.455815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.455822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.455843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.455856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:19.455871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719289759:2446], now have 1 active actors on pipe
2025-10-01T14:13:19.455878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290027:10458], now have 1 active actors on pipe
2025-10-01T14:13:19.455884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256220342390843:10314]
2025-10-01T14:13:19.455890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256220342390843:10314]
2025-10-01T14:13:19.455892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256220342390843:10314]
2025-10-01T14:13:19.455881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1931
2025-10-01T14:13:19.455883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1931
2025-10-01T14:13:19.455898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:19.455910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:19.455911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:19.455912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:19.455913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:19.455918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:19.455920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:19.455948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.455954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.455963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256220342390843:10314]
2025-10-01T14:13:19.455972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:19.455982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:19.455993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:19.455997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.456003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.456005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:19.456010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.456018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:19.456038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.456124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.456129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.456137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.456182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1932 partition: 0 MaxSeqNo: 45 sessionId: src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0
2025-10-01T14:13:19.456408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a369f717-adfb4cb1-8da26464-3aa63e33_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:19.458710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0] Write session: try to update token
2025-10-01T14:13:19.458723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:19.471638Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1932 sessionId: src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:19.473753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:19.475058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.475078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.475094Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:19.475097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:19.475098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:19.475100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:19.475105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256220342390843:10314]
2025-10-01T14:13:19.475110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256220342390843:10314]
2025-10-01T14:13:19.475112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256220342390843:10314]
2025-10-01T14:13:19.475141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:19.475152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:19.475154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:19.475155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:19.475158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.475159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:19.475271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:19.532570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256222719290052:10286]
2025-10-01T14:13:19.532841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 1931, pipe: [1:7556256222719290052:10286]
2025-10-01T14:13:19.607233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:19.607436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:19.607481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290052:10286], now have 1 active actors on pipe
2025-10-01T14:13:19.607575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:19.607658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256222719290052:10286]
2025-10-01T14:13:19.607684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:19.619298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:19.619313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:19.619332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1932 reason: error at write: Disconnected sessionId: src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0
2025-10-01T14:13:19.619470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1932 sessionId: src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0 is DEAD
2025-10-01T14:13:19.619592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:19.619603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0] Write session will restart in 0.009876s
2025-10-01T14:13:19.619632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0] Write session: Do CDS request
2025-10-01T14:13:19.619641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:19.626973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:19.629320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:19.629555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:19.629564Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:19.629574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:19.629612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:19.629639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256220342391115:10316]
2025-10-01T14:13:19.630039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:19.630244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:19.630270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:19.630490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:19.630530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.630534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.630535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.630536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.630537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.630537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.630538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.630539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.630539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.630540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.630541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.630541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.630542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.630543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.630546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.630552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.630554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.630556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.630558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.630560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.630562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.630564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.630567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.630569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.630571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.630574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.630576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.630578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.630583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.630587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.630591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.630594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.630597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.630600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.630602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.630605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.630607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.630610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.630612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.630615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.630618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.630620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.630623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.630625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.630631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.630634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.630637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.630639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.630646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.630649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.630651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.630654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.630659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.630662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.630664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.630667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.630690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:19.630767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.630840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:19.630852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1933
2025-10-01T14:13:19.630946Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.630967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:19.630971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:19.630973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:19.631289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1933 sessionId:  describe result for acl check
2025-10-01T14:13:19.631318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:19.631331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:19.631332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:19.631335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256222719290285:10464] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:19.631769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256222719290285:10464] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:19.633537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256222719290285:10464] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:19.634182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:19.634719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:19.634727Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:19.634728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:19.634730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:19.634733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1932 [2:7556256220342391115:10316]
2025-10-01T14:13:19.634743Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:19.634753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:19.634754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.634757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.634758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.634768Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:19.634775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:19.634779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:19.634813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.634818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.634819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.634821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:19.634822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:19.634864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:19.634868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.634875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.634883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.634894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:19.634910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290053:2446], now have 1 active actors on pipe
2025-10-01T14:13:19.634917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256220342391110:10316]
2025-10-01T14:13:19.634919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256220342391110:10316]
2025-10-01T14:13:19.634921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256220342391110:10316]
2025-10-01T14:13:19.634929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:19.634941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:19.634944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:19.634946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:19.634948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:19.634951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:19.634952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:19.634965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256220342391110:10316]
2025-10-01T14:13:19.634970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:19.634972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:19.634959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1932
2025-10-01T14:13:19.639625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256222719290285:10464] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:19.639641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256222719290285:10464] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:19.639645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256222719290285:10464] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:19.639653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:19.639863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290323:10464], now have 1 active actors on pipe
2025-10-01T14:13:19.639901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1932
2025-10-01T14:13:19.639983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.639996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.640022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:19.640037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.640047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.640050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:19.640061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.640076Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:19.640097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.640229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.640242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.640259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.640320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1933 partition: 0 MaxSeqNo: 45 sessionId: src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0
2025-10-01T14:13:19.640638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f16b3b2e-7bf17e3e-2233f6e8-95200dff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:19.642998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0] Write session: try to update token
2025-10-01T14:13:19.643013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:19.654533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:19.654548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:19.654550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:19.654551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:19.654558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256220342391110:10316]
2025-10-01T14:13:19.654563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256220342391110:10316]
2025-10-01T14:13:19.654566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256220342391110:10316]
2025-10-01T14:13:19.654603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:19.654605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:19.654608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.654610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:19.654611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:19.654614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:19.654725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:19.655174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1933 sessionId: src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:19.657282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:19.707669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256222719290327:10286]
2025-10-01T14:13:19.707892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 1932, pipe: [1:7556256222719290327:10286]
2025-10-01T14:13:19.786680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:19.787026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.787037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.787068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290327:10286], now have 1 active actors on pipe
2025-10-01T14:13:19.787221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:19.787239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256222719290327:10286]
2025-10-01T14:13:19.787260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:19.787261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:19.787329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1933 reason: error at write: Disconnected sessionId: src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0
2025-10-01T14:13:19.787501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1933 sessionId: src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0 is DEAD
2025-10-01T14:13:19.787509Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:19.787643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:19.787649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0] Write session will restart in 0.005676s
2025-10-01T14:13:19.787667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0] Write session: Do CDS request
2025-10-01T14:13:19.787671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:19.794804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.795003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:19.795015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1934
2025-10-01T14:13:19.795106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.795134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:19.795143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:19.795147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:19.795510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1934 sessionId:  describe result for acl check
2025-10-01T14:13:19.795542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:19.795548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:19.795549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:19.795554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256222719290414:10468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:19.795998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256222719290414:10468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:19.798239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256222719290414:10468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:19.800249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256222719290414:10468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:19.800258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256222719290414:10468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:19.800260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256222719290414:10468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:19.800265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:19.800855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:19.802971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:19.803102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:19.803110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:19.803117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:19.803149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:19.803174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256220342391384:10319]
2025-10-01T14:13:19.803535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:19.803718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:19.803745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:19.803926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:19.803961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.803965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.803966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.803966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.803967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.803968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.803969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.803969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.803970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.803970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.803971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.803971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.803972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.803973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.803975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.803982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.803984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.803986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.803988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.803990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.803992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.803994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.803996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.803998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.804000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.804002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.804004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.804007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.804011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.804016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.804019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.804022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.804025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.804027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.804030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.804032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.804035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.804038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.804040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.804043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.804045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.804048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.804050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.804053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.804055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.804058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.804060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.804063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.804065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.804067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.804070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.804072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.804074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.804077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.804079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.804082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.804102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:19.807419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:19.807968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:19.807978Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:19.807980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:19.807982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:19.807986Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1933 [2:7556256220342391384:10319]
2025-10-01T14:13:19.807996Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:19.808006Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:19.808012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.808014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.808015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.808025Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:19.808035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:19.808044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:19.808089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.808096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.808098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.808100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:19.808102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:19.808156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:19.808161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.808168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.808174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.808186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:19.808203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290590:10468], now have 1 active actors on pipe
2025-10-01T14:13:19.808211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290328:2446], now have 1 active actors on pipe
2025-10-01T14:13:19.808218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256220342391379:10319]
2025-10-01T14:13:19.808219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256220342391379:10319]
2025-10-01T14:13:19.808221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256220342391379:10319]
2025-10-01T14:13:19.808233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:19.808245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:19.808249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:19.808252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:19.808254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:19.808243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1933
2025-10-01T14:13:19.808262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:19.808257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1933
2025-10-01T14:13:19.808267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:19.808285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256220342391379:10319]
2025-10-01T14:13:19.808292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:19.808294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:19.808306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.808312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.808344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7793e2b-d344937c-aa0336d0-15752bef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:19.808351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.808354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.808359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:19.808365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.808374Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:19.808389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.808496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.808503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.808514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.808585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1934 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7793e2b-d344937c-aa0336d0-15752bef_0
2025-10-01T14:13:19.808901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b1375b-bb18f0bd-838c49e3-f166c6d2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7793e2b-d344937c-aa0336d0-15752bef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:19.811089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7793e2b-d344937c-aa0336d0-15752bef_0] Write session: try to update token
2025-10-01T14:13:19.811104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7793e2b-d344937c-aa0336d0-15752bef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:19.822855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1934 sessionId: src_id|d7793e2b-d344937c-aa0336d0-15752bef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:19.824897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:19.825072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.825092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.825122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:19.825175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:19.827530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:19.827540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:19.827542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:19.827543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:19.827550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256220342391379:10319]
2025-10-01T14:13:19.827553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256220342391379:10319]
2025-10-01T14:13:19.827555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256220342391379:10319]
2025-10-01T14:13:19.827583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:19.827589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:19.827591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:19.827593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:19.827594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.827595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:19.827710Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:19.887340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256222719290605:10286]
2025-10-01T14:13:19.887574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 1933, pipe: [1:7556256222719290605:10286]
2025-10-01T14:13:19.960481Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:19.967324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.967348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.967488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.967554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.967617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.967681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.967725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.967733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.967802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.967868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.967928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.967992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.968034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.968040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.968102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.968157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.968213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.968270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.968314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.968320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.968379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.968436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.968493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.968552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.968590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.968596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.968663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.968719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.968777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.968834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.968886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.968892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.968953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.969010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.969069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.969130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.969172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.969178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.969237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.969293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.969353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.969416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.969457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.969462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.969525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.969581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.969636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.969695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.969737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.969743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.969804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.969914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.970002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.970063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.970122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.970127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.970188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:19.970245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:19.970308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:19.970382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:19.970440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:19.970446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:19.970487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290605:10286], now have 1 active actors on pipe
2025-10-01T14:13:19.970648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:19.970648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256222719290605:10286]
2025-10-01T14:13:19.970663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:19.970663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:19.970682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1934 reason: error at write: Disconnected sessionId: src_id|d7793e2b-d344937c-aa0336d0-15752bef_0
2025-10-01T14:13:19.970820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1934 sessionId: src_id|d7793e2b-d344937c-aa0336d0-15752bef_0 is DEAD
2025-10-01T14:13:19.970949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7793e2b-d344937c-aa0336d0-15752bef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:19.970957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7793e2b-d344937c-aa0336d0-15752bef_0] Write session will restart in 0.006757s
2025-10-01T14:13:19.970975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7793e2b-d344937c-aa0336d0-15752bef_0] Write session: Do CDS request
2025-10-01T14:13:19.970979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7793e2b-d344937c-aa0336d0-15752bef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:19.971384Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:19.978802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7793e2b-d344937c-aa0336d0-15752bef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.979160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:19.979172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1935
2025-10-01T14:13:19.979258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:19.979286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:19.979295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:19.979299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:19.979629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1935 sessionId:  describe result for acl check
2025-10-01T14:13:19.979657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:19.979662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:19.979663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:19.979667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256222719290721:10480] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:19.980033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256222719290721:10480] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:19.981887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256222719290721:10480] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:19.984132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256222719290721:10480] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:19.984142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256222719290721:10480] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:19.984144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256222719290721:10480] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:19.984150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:19.984966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:19.987100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:19.987236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:19.987244Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:19.987255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:19.987297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:19.987333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256220342391658:10323]
2025-10-01T14:13:19.987769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:19.987990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:19.988029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:19.988242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:19.988290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.988296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.988297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.988298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.988299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.988299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.988300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.988301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.988302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.988303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.988304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.988305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.988306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.988307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.988311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.988321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.988324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.988328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.988331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.988335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.988338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.988342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.988345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.988348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.988356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.988360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.988363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.988370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.988376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.988386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:19.988396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.988404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:19.988412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.988417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:19.988424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.988428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:19.988437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.988444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:19.988446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.988452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:19.988454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.988457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:19.988459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.988462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:19.988464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.988467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:19.988472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.988475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.988477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.988480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.988484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.988487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.988489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.988492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:19.988494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.988499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:19.988518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:19.991767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:19.992469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:19.992482Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:19.992483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:19.992485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:19.992490Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1934 [2:7556256220342391658:10323]
2025-10-01T14:13:19.992500Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:19.992511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:19.992512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.992514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.992515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.992526Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:19.992533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:19.992537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:19.992570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.992575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.992577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.992579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:19.992580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:19.992635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:19.992640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:19.992647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:19.992652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:19.992661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:19.992675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290889:10480], now have 1 active actors on pipe
2025-10-01T14:13:19.992680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256222719290631:2446], now have 1 active actors on pipe
2025-10-01T14:13:19.992685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256220342391653:10323]
2025-10-01T14:13:19.992687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256220342391653:10323]
2025-10-01T14:13:19.992688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256220342391653:10323]
2025-10-01T14:13:19.992697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:19.992706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:19.992709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:19.992711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:19.992713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:19.992717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:19.992718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:19.992733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256220342391653:10323]
2025-10-01T14:13:19.992742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:19.992740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1934
2025-10-01T14:13:19.992759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:19.992745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1934
2025-10-01T14:13:19.992786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.992793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.992812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f352af7-bfc75214-13d04e46-6298a724_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:19.992820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:19.992822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:19.992824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:19.992830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:19.992835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:19.992848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.992962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:19.992969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:19.992980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:19.993042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1935 partition: 0 MaxSeqNo: 45 sessionId: src_id|1f352af7-bfc75214-13d04e46-6298a724_0
2025-10-01T14:13:19.993331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7793e2b-d344937c-aa0336d0-15752bef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1f352af7-bfc75214-13d04e46-6298a724_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:19.995449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f352af7-bfc75214-13d04e46-6298a724_0] Write session: try to update token
2025-10-01T14:13:19.995462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f352af7-bfc75214-13d04e46-6298a724_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:20.007410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1935 sessionId: src_id|1f352af7-bfc75214-13d04e46-6298a724_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:20.007722Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:20.007740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:20.007752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256220342391653:10323]
2025-10-01T14:13:20.007791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:20.007795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:20.007950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:20.008086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:20.008227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:20.008371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:20.008556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:20.008587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:20.009437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:20.009593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.009605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.009628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:20.009692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:20.021655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:20.021671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:20.021673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:20.021675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:20.021688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256220342391653:10323]
2025-10-01T14:13:20.021692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256220342391653:10323]
2025-10-01T14:13:20.021695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256220342391653:10323]
2025-10-01T14:13:20.021729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:20.021732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:20.021733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:20.021735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:20.021738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.021739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:20.021854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:20.070712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256227014258200:10286]
2025-10-01T14:13:20.071024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 1934, pipe: [1:7556256227014258200:10286]
2025-10-01T14:13:20.160518Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:20.167367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.167386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.167524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.167581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.167639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.167708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.167750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.167761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.167818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.167871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.167937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.168001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.168046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.168051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.168106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.168157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.168213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.168557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.168652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.168658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.168711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.168764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.168816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.168870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.168908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.168913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.168965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.169018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.169071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.169126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.169170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.169175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.169230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.169284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.169342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.169397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.169436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.169441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.169500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.169551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.169607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.169665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.169704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.169709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.169765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.169817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.169875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.169931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.169970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.169976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.170027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.170079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.170131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.170189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.170228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.170233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.170286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.170338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.170406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.170459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.170495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.170500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.170535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014258200:10286], now have 1 active actors on pipe
2025-10-01T14:13:20.170746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256227014258200:10286]
2025-10-01T14:13:20.170756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:20.170759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:20.170771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:20.170780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1935 reason: error at write: Disconnected sessionId: src_id|1f352af7-bfc75214-13d04e46-6298a724_0
2025-10-01T14:13:20.170933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1935 sessionId: src_id|1f352af7-bfc75214-13d04e46-6298a724_0 is DEAD
2025-10-01T14:13:20.171066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f352af7-bfc75214-13d04e46-6298a724_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:20.171089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f352af7-bfc75214-13d04e46-6298a724_0] Write session will restart in 0.009590s
2025-10-01T14:13:20.171114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f352af7-bfc75214-13d04e46-6298a724_0] Write session: Do CDS request
2025-10-01T14:13:20.171121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f352af7-bfc75214-13d04e46-6298a724_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:20.171181Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:20.181744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f352af7-bfc75214-13d04e46-6298a724_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.181839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:20.181854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1936
2025-10-01T14:13:20.181940Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.181963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:20.181971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:20.181974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:20.182259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1936 sessionId:  describe result for acl check
2025-10-01T14:13:20.182281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:20.182285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:20.182287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:20.182290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256227014258385:10484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:20.182678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256227014258385:10484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:20.184302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:20.184648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256227014258385:10484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:20.186282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:20.186413Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:20.186420Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:20.186429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:20.186458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:20.186482Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256224637359223:10326]
2025-10-01T14:13:20.186773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256227014258385:10484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:20.186782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256227014258385:10484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:20.186784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256227014258385:10484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:20.186788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:20.186843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:20.187030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:20.187054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:20.187241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:20.187275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.187279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.187280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.187280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.187281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.187281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.187282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.187283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.187283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.187284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.187285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.187285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.187286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.187286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.187289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.187295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.187297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.187299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.187301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.187303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.187305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.187307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.187309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.187311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.187313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.187315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.187317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.187319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.187323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.187327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.187331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.187333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.187336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.187339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.187341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.187344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.187346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.187349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.187351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.187354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.187356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.187359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.187361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.187364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.187367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.187374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.187378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.187380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.187383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.187385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.187388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.187392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.187397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.187400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.187402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.187406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.187428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:20.190628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:20.191233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:20.191244Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:20.191245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:20.191247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:20.191252Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1935 [2:7556256224637359223:10326]
2025-10-01T14:13:20.191261Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:20.191270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:20.191276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.191278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.191280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.191289Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:20.191293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:20.191297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:20.191332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.191337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.191338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.191340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:20.191342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:20.191383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:20.191388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.191394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.191399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.191408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:20.191422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014258468:10484], now have 1 active actors on pipe
2025-10-01T14:13:20.191427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014258202:2446], now have 1 active actors on pipe
2025-10-01T14:13:20.191431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256224637359218:10326]
2025-10-01T14:13:20.191433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256224637359218:10326]
2025-10-01T14:13:20.191434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256224637359218:10326]
2025-10-01T14:13:20.191442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:20.191451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:20.191462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:20.191467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:20.191468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:20.191471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:20.191472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:20.191481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256224637359218:10326]
2025-10-01T14:13:20.191486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:20.191489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:20.191475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1935
2025-10-01T14:13:20.191478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1935
2025-10-01T14:13:20.191509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.191515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.191534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:20.191542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.191545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.191546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:20.191552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.191557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:20.191569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.191693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.191698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.191706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.191761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1936 partition: 0 MaxSeqNo: 45 sessionId: src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0
2025-10-01T14:13:20.192028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f352af7-bfc75214-13d04e46-6298a724_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:20.194136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0] Write session: try to update token
2025-10-01T14:13:20.194149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:20.207932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1936 sessionId: src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:20.209917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:20.210851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.210868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.210884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:20.210886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:20.210887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:20.210889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:20.210894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256224637359218:10326]
2025-10-01T14:13:20.210898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256224637359218:10326]
2025-10-01T14:13:20.210900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256224637359218:10326]
2025-10-01T14:13:20.210932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:20.210941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:20.210944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:20.210945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:20.210951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.210952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:20.211070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:20.270867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256227014258479:10286]
2025-10-01T14:13:20.271099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 1935, pipe: [1:7556256227014258479:10286]
2025-10-01T14:13:20.340464Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:20.340989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:20.341034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014258479:10286], now have 1 active actors on pipe
2025-10-01T14:13:20.341118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:20.341159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:20.341190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:20.341196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:20.341199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256227014258479:10286]
2025-10-01T14:13:20.341249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1936 reason: error at write: Disconnected sessionId: src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0
2025-10-01T14:13:20.341364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1936 sessionId: src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0 is DEAD
2025-10-01T14:13:20.341493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:20.341503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0] Write session will restart in 0.005905s
2025-10-01T14:13:20.341520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0] Write session: Do CDS request
2025-10-01T14:13:20.341530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:20.348754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.348856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:20.348868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1937
2025-10-01T14:13:20.348945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.348968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:20.348978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:20.348984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:20.349276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1937 sessionId:  describe result for acl check
2025-10-01T14:13:20.349312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:20.349319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:20.349320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:20.349324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256227014258557:10488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:20.349682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256227014258557:10488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:20.351607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256227014258557:10488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:20.353693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256227014258557:10488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:20.353704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256227014258557:10488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:20.353706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256227014258557:10488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:20.353710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:20.354477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:20.356419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:20.356533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:20.356540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:20.356547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:20.356574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:20.356598Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256224637359534:10339]
2025-10-01T14:13:20.356950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:20.357114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:20.357137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:20.357310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:20.357341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.357345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.357346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.357346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.357347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.357347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.357348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.357349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.357349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.357350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.357350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.357351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.357351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.357351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.357354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.357359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.357362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.357364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.357365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.357368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.357369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.357371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.357373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.357376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.357378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.357379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.357381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.357383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.357388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.357392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.357396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.357399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.357401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.357404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.357406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.357408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.357410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.357413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.357415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.357419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.357422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.357424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.357426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.357429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.357435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.357438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.357440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.357443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.357448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.357451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.357453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.357456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.357458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.357463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.357465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.357468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.357489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:20.360570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:20.361107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:20.361119Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:20.361120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:20.361122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:20.361127Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1936 [2:7556256224637359534:10339]
2025-10-01T14:13:20.361136Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:20.361151Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:20.361155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.361157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.361159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.361168Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:20.361174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:20.361178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:20.361210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.361215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.361216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.361218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:20.361219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:20.361261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:20.361265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.361272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.361280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.361292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:20.361306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014258745:10488], now have 1 active actors on pipe
2025-10-01T14:13:20.361311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014258480:2446], now have 1 active actors on pipe
2025-10-01T14:13:20.361316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256224637359529:10339]
2025-10-01T14:13:20.361321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256224637359529:10339]
2025-10-01T14:13:20.361323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256224637359529:10339]
2025-10-01T14:13:20.361331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:20.361342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:20.361343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:20.361345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:20.361346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:20.361353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:20.361355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:20.361343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1936
2025-10-01T14:13:20.361355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1936
2025-10-01T14:13:20.361369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256224637359529:10339]
2025-10-01T14:13:20.361375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:20.361376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:20.361386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.361389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.361417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:20.361425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.361429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.361430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:20.361436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.361444Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:20.361458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.361541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.361546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.361556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.361617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1937 partition: 0 MaxSeqNo: 45 sessionId: src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0
2025-10-01T14:13:20.361919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7f5d7e-9742e452-33b4a2cd-ae03e0c2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:20.364119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0] Write session: try to update token
2025-10-01T14:13:20.364134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:20.377094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1937 sessionId: src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:20.379184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:20.380384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.380403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.380420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:20.380423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:20.380425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:20.380426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:20.380432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256224637359529:10339]
2025-10-01T14:13:20.380435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256224637359529:10339]
2025-10-01T14:13:20.380438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256224637359529:10339]
2025-10-01T14:13:20.380467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:20.380476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:20.380478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:20.380479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:20.380483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.380485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:20.380664Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:20.441385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256227014258759:10286]
2025-10-01T14:13:20.441650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 1936, pipe: [1:7556256227014258759:10286]
2025-10-01T14:13:20.510881Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:20.511485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:20.511525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014258759:10286], now have 1 active actors on pipe
2025-10-01T14:13:20.511598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:20.511743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:20.511784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256227014258759:10286]
2025-10-01T14:13:20.519396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:20.519409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:20.519427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1937 reason: error at write: Disconnected sessionId: src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0
2025-10-01T14:13:20.519554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1937 sessionId: src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0 is DEAD
2025-10-01T14:13:20.519683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:20.519693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0] Write session will restart in 0.006242s
2025-10-01T14:13:20.519717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0] Write session: Do CDS request
2025-10-01T14:13:20.519727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:20.526749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.526847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:20.526858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1938
2025-10-01T14:13:20.526934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.526955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:20.526961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:20.526965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:20.527289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1938 sessionId:  describe result for acl check
2025-10-01T14:13:20.527296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:20.527320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:20.527325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:20.527327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:20.527333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256227014259014:10494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:20.527714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256227014259014:10494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:20.529446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:20.529562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:20.529570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:20.529577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:20.529604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:20.529627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256224637359803:10341]
2025-10-01T14:13:20.529753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256227014259014:10494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:20.529971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:20.530142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:20.530165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:20.530341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:20.530481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.530486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.530487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.530487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.530488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.530489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.530489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.530490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.530490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.530491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.530491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.530492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.530493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.530493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.530496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.530501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.530503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.530505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.530507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.530509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.530511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.530512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.530514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.530516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.530518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.530519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.530521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.530523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.530527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.530531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.530535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.530538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.530540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.530543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.530545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.530548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.530550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.530553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.530555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.530557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.530560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.530563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.530569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.530571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.530574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.530576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.530579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.530585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.530587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.530590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.530592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.530594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.530600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.530602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.530605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.530611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.530630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:20.533536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256227014259014:10494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:20.533548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256227014259014:10494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:20.533550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256227014259014:10494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:20.533555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:20.533726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:20.534269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:20.534280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:20.534281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:20.534283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:20.534287Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1937 [2:7556256224637359803:10341]
2025-10-01T14:13:20.534295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:20.534304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:20.534309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.534311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.534312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.534323Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:20.534329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:20.534334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:20.534368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.534388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.534389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.534391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:20.534393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:20.534435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:20.534439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.534446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.534454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.534466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:20.534477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014258780:2446], now have 1 active actors on pipe
2025-10-01T14:13:20.534482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014259053:10494], now have 1 active actors on pipe
2025-10-01T14:13:20.534488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256224637359798:10341]
2025-10-01T14:13:20.534489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256224637359798:10341]
2025-10-01T14:13:20.534490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256224637359798:10341]
2025-10-01T14:13:20.534499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:20.534507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:20.534510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:20.534512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:20.534513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:20.534518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:20.534520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:20.534510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1937
2025-10-01T14:13:20.534513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1937
2025-10-01T14:13:20.534536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256224637359798:10341]
2025-10-01T14:13:20.534541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:20.534542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:20.534554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.534559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.534587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:20.534615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.534621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.534623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:20.534628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.534636Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:20.534653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.534747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.534751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.534760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.534826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1938 partition: 0 MaxSeqNo: 45 sessionId: src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0
2025-10-01T14:13:20.535067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e05183e-6e27e65b-6dc467ac-4a706aed_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:20.537223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0] Write session: try to update token
2025-10-01T14:13:20.537235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:20.548535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1938 sessionId: src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:20.550551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:20.550743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.550760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.550789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:20.550845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:20.552937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:20.552950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:20.552952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:20.552953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:20.552960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256224637359798:10341]
2025-10-01T14:13:20.552963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256224637359798:10341]
2025-10-01T14:13:20.552966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256224637359798:10341]
2025-10-01T14:13:20.552999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:20.553000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:20.553005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:20.553008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.553009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:20.553009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:20.553122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:20.611864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256227014259062:10286]
2025-10-01T14:13:20.612065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 1937, pipe: [1:7556256227014259062:10286]
2025-10-01T14:13:20.681532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:20.687853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.687874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.688010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.688067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.688123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.688176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.688218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.688225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.688284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.688337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.688390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.688446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.688484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.688490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.688541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.688592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.688650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.688707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.688749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.688755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.688807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.688858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.688909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.688967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.689003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.689008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.689061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.689112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.689162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.689213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.689250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.689255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.689306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.689355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.689409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.689466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.689503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.689507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.689559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.689674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.689771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.689880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.689916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.689921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.689974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.690024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.690080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.690134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.690171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.690176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.690229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.690282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.690334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.690399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.690437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.690442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.690495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.690548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.690603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.690654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.690690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.690696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.690732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014259062:10286], now have 1 active actors on pipe
2025-10-01T14:13:20.690924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:20.690932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256227014259062:10286]
2025-10-01T14:13:20.690936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:20.690947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:20.690958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1938 reason: error at write: Disconnected sessionId: src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0
2025-10-01T14:13:20.691116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1938 sessionId: src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0 is DEAD
2025-10-01T14:13:20.691234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:20.691242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0] Write session will restart in 0.005932s
2025-10-01T14:13:20.691265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0] Write session: Do CDS request
2025-10-01T14:13:20.691271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:20.691475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:20.697705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.697803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:20.697813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1939
2025-10-01T14:13:20.697905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.697928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:20.697935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:20.697941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:20.698240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1939 sessionId:  describe result for acl check
2025-10-01T14:13:20.698260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:20.698264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:20.698265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:20.698268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256227014259111:10498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:20.698624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256227014259111:10498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:20.701256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256227014259111:10498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:20.703607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256227014259111:10498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:20.703619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256227014259111:10498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:20.703622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256227014259111:10498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:20.703627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:20.705360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:20.707370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:20.707534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:20.707541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:20.707550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:20.707584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:20.707608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256224637360077:10344]
2025-10-01T14:13:20.707951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:20.708115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:20.708138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:20.708311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:20.708342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.708345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.708346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.708347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.708347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.708348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.708348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.708349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.708350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.708350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.708351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.708351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.708352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.708352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.708355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.708360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.708362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.708364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.708366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.708368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.708370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.708372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.708374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.708376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.708378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.708380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.708382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.708384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.708389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.708393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.708397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.708400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.708402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.708404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.708406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.708409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.708411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.708414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.708416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.708418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.708420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.708423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.708425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.708428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.708430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.708433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.708435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.708437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.708439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.708442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.708445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.708447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.708450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.708452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.708458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.708460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.708478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:20.711528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:20.712031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:20.712041Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:20.712043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:20.712045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:20.712049Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1938 [2:7556256224637360077:10344]
2025-10-01T14:13:20.712057Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:20.712071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:20.712076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.712078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.712080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.712090Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:20.712096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:20.712100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:20.712136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.712141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.712142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.712145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:20.712146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:20.712186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:20.712190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.712196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.712205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.712216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:20.712229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014259064:2446], now have 1 active actors on pipe
2025-10-01T14:13:20.712235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014259293:10498], now have 1 active actors on pipe
2025-10-01T14:13:20.712239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256224637360072:10344]
2025-10-01T14:13:20.712243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256224637360072:10344]
2025-10-01T14:13:20.712245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256224637360072:10344]
2025-10-01T14:13:20.712253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:20.712261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:20.712264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:20.712264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:20.712265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:20.712271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:20.712273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:20.712286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256224637360072:10344]
2025-10-01T14:13:20.712291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:20.712293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:20.712275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1938
2025-10-01T14:13:20.712275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1938
2025-10-01T14:13:20.712312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.712317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.712339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|476447bb-a15f3858-398913e9-39898e1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:20.712346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.712349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.712353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:20.712359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.712367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:20.712385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.712487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.712492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.712502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.712564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1939 partition: 0 MaxSeqNo: 45 sessionId: src_id|476447bb-a15f3858-398913e9-39898e1e_0
2025-10-01T14:13:20.712851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63b09b3-a9344810-348a5b3f-78d636d8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|476447bb-a15f3858-398913e9-39898e1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:20.714926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476447bb-a15f3858-398913e9-39898e1e_0] Write session: try to update token
2025-10-01T14:13:20.714939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476447bb-a15f3858-398913e9-39898e1e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:20.725784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1939 sessionId: src_id|476447bb-a15f3858-398913e9-39898e1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:20.728005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:20.728355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.728369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.728396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:20.728459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:20.730801Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:20.730814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:20.730816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:20.730817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:20.730823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256224637360072:10344]
2025-10-01T14:13:20.730827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256224637360072:10344]
2025-10-01T14:13:20.730829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256224637360072:10344]
2025-10-01T14:13:20.730856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:20.730863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:20.730865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:20.730867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:20.730869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.730871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:20.730983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:20.778256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:13:20.778277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-10-01T14:13:20.791055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256227014259347:10286]
2025-10-01T14:13:20.791246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 1938, pipe: [1:7556256227014259347:10286]
2025-10-01T14:13:20.857274Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:20.863666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.863688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.863816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.863873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.863929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.863982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.864020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.864027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.864085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.864139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.864194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.864247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.864286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.864291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.864344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.864394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.864449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.864499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.864535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.864541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.864591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.864650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.864702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.864755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.864793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.864798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.864847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.864896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.864948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.864999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.865040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.865045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.865097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.865148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.865203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.865259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.865347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.865353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.865404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.865453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.865505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.865563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.865598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.865603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.865656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.865707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.865756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.865808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.865845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.865850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.865904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.865955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.866008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.866061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.866143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.866148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.866200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:20.866251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:20.866304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:20.866355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:20.866401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:20.866406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:20.866466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014259347:10286], now have 1 active actors on pipe
2025-10-01T14:13:20.866611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256227014259347:10286]
2025-10-01T14:13:20.866618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:20.866622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:20.866634Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:20.866641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1939 reason: error at write: Disconnected sessionId: src_id|476447bb-a15f3858-398913e9-39898e1e_0
2025-10-01T14:13:20.866642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 14
2025-10-01T14:13:20.866809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1939 sessionId: src_id|476447bb-a15f3858-398913e9-39898e1e_0 is DEAD
2025-10-01T14:13:20.866947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476447bb-a15f3858-398913e9-39898e1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:20.866956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476447bb-a15f3858-398913e9-39898e1e_0] Write session will restart in 0.006772s
2025-10-01T14:13:20.866972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476447bb-a15f3858-398913e9-39898e1e_0] Write session: Do CDS request
2025-10-01T14:13:20.866978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476447bb-a15f3858-398913e9-39898e1e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:20.867074Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:20.875762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476447bb-a15f3858-398913e9-39898e1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.875880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:20.875894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1940
2025-10-01T14:13:20.876018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:20.876048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:20.876058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:20.876065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:20.876441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1940 sessionId:  describe result for acl check
2025-10-01T14:13:20.876471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:20.876478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:20.876480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:20.876484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256227014259471:10502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:20.877215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256227014259471:10502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:20.879042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256227014259471:10502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:20.880379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:20.882311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:20.882445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:20.882452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:20.882460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:20.882493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:20.882516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256224637360349:10347]
2025-10-01T14:13:20.882555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256227014259471:10502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:20.882566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256227014259471:10502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:20.882569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256227014259471:10502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:20.882574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:20.882884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:20.883056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:20.883081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:20.883266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:20.883309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.883313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.883314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.883315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.883315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.883316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.883316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.883317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.883317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.883318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.883318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.883319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.883319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.883320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.883323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.883328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.883330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.883332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.883334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.883336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.883338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.883340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.883343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.883345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.883347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.883349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.883351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.883352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.883356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.883360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:20.883364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.883367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:20.883369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.883372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:20.883374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.883377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:20.883379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.883381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:20.883385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.883387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:20.883396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.883400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:20.883404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.883411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:20.883419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.883424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:20.883432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.883438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.883441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.883443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.883449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.883451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.883453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.883456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:20.883460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.883462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:20.883480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:20.886509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:20.887074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:20.887084Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:20.887085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:20.887087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:20.887091Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1939 [2:7556256224637360349:10347]
2025-10-01T14:13:20.887100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:20.887113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:20.887118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.887120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.887121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.887131Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:20.887136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:20.887141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:20.887170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.887175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.887175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.887178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:20.887179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:20.887219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:20.887223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.887229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:20.887238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:20.887249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:20.887262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014259618:10502], now have 1 active actors on pipe
2025-10-01T14:13:20.887267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014259348:2446], now have 1 active actors on pipe
2025-10-01T14:13:20.887272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256224637360344:10347]
2025-10-01T14:13:20.887276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256224637360344:10347]
2025-10-01T14:13:20.887278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256224637360344:10347]
2025-10-01T14:13:20.887286Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:20.887297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:20.887303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:20.887306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:20.887308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:20.887308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:20.887309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:20.887298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1939
2025-10-01T14:13:20.887315Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1939
2025-10-01T14:13:20.887322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256224637360344:10347]
2025-10-01T14:13:20.887327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:20.887336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:20.887337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.887340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.887378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:20.887388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:20.887390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:20.887391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:20.887396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:20.887402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:20.887432Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:13:20.887458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.887571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 18 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:13:20.887597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:13:20.887598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.887604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.887615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:20.887676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1940 partition: 0 MaxSeqNo: 45 sessionId: src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0
2025-10-01T14:13:20.887941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476447bb-a15f3858-398913e9-39898e1e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:20.890062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0] Write session: try to update token
2025-10-01T14:13:20.890074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:20.901113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1940 sessionId: src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:20.903033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:20.903210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:20.903230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:20.903265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:20.903333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:20.905821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:20.905836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:20.905839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:20.905841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:20.905848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256224637360344:10347]
2025-10-01T14:13:20.905852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256224637360344:10347]
2025-10-01T14:13:20.905856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256224637360344:10347]
2025-10-01T14:13:20.905898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:20.905909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:20.905911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:20.905913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:20.905923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:20.905936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:20.906030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:20.966646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256227014259637:10286]
2025-10-01T14:13:20.966864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 1939, pipe: [1:7556256227014259637:10286]
2025-10-01T14:13:21.031879Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:21.038353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.038382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.038517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.038571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.038628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.038683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.038721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.038730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.038787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.038839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.038893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.038960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.039000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.039005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.039056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.039107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.039167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.039224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.039337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.039343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.039394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.039448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.039501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.039552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.039587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.039592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.039643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.039692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.039744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.039795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.039831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.039836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.039890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.039939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.040001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.040054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.040090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.040095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.040149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.040202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.040255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.040310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.040348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.040353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.040402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.040453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.040514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.040567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.040604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.040616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.040673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.040726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.040778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.040830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.040866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.040871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.040923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.040988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.041044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.041095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.041132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.041137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.041173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256227014259637:10286], now have 1 active actors on pipe
2025-10-01T14:13:21.041393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256227014259637:10286]
2025-10-01T14:13:21.041402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:21.041405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:21.041425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:21.041428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1940 reason: error at write: Disconnected sessionId: src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0
2025-10-01T14:13:21.041618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1940 sessionId: src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0 is DEAD
2025-10-01T14:13:21.041754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:21.041765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0] Write session will restart in 0.006364s
2025-10-01T14:13:21.041788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0] Write session: Do CDS request
2025-10-01T14:13:21.041795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:21.041886Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:21.048742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.048839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:21.048851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1941
2025-10-01T14:13:21.048931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.048952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:21.048959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:21.048961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:21.049229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1941 sessionId:  describe result for acl check
2025-10-01T14:13:21.049247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:21.049253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:21.049255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:21.049258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256231309227031:10514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:21.049595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256231309227031:10514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:21.052044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256231309227031:10514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:21.054104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256231309227031:10514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:21.054113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256231309227031:10514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:21.054116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256231309227031:10514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:21.054121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:21.054801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:21.056649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:21.056775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:21.056781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:21.056788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:21.056839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:21.056866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256228932327927:10352]
2025-10-01T14:13:21.057212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:21.057382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:21.057412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:21.057614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:21.057643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.057647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.057648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.057648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.057649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.057649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.057650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.057650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.057651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.057651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.057652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.057653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.057653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.057654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.057657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.057662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.057665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.057667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.057669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.057671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.057672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.057674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.057676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.057679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.057680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.057682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.057684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.057686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.057690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.057695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.057699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.057701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.057704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.057706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.057709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.057712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.057718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.057721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.057723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.057726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.057731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.057734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.057736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.057738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.057742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.057745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.057747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.057750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.057755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.057758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.057760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.057763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.057765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.057767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.057770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.057773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.057792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:21.060937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:21.061624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:21.061636Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:21.061637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:21.061640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:21.061644Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1940 [2:7556256228932327927:10352]
2025-10-01T14:13:21.061653Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:21.061663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:21.061665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.061666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.061668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.061678Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:21.061684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:21.061689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:21.061721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.061726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.061727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.061729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:21.061731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:21.061772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:21.061776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.061783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.061788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.061797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:21.061810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309226957:2446], now have 1 active actors on pipe
2025-10-01T14:13:21.061816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309227226:10514], now have 1 active actors on pipe
2025-10-01T14:13:21.061821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256228932327922:10352]
2025-10-01T14:13:21.061822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256228932327922:10352]
2025-10-01T14:13:21.061823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256228932327922:10352]
2025-10-01T14:13:21.061833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:21.061844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:21.061845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:21.061847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:21.061848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:21.061855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:21.061857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:21.061874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256228932327922:10352]
2025-10-01T14:13:21.061860Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1940
2025-10-01T14:13:21.061879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:21.061880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:21.061871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1940
2025-10-01T14:13:21.061893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.061897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.061925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:21.061933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.061936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.061938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:21.061943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.061950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:21.061962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.062061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.062069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.062078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.062127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1941 partition: 0 MaxSeqNo: 45 sessionId: src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0
2025-10-01T14:13:21.062403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|383c0051-c314f9d1-90b6976c-6dfd8657_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:21.064425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0] Write session: try to update token
2025-10-01T14:13:21.064438Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:21.075641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1941 sessionId: src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:21.077712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:21.077883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.077899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.077926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:21.077994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:21.080225Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:21.080240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:21.080243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:21.080244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:21.080251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256228932327922:10352]
2025-10-01T14:13:21.080255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256228932327922:10352]
2025-10-01T14:13:21.080258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256228932327922:10352]
2025-10-01T14:13:21.080292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:21.080303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.080305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:21.080328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:21.080336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:21.080340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:21.080433Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:21.141800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256231309227241:10286]
2025-10-01T14:13:21.141992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 1940, pipe: [1:7556256231309227241:10286]
2025-10-01T14:13:21.208864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:21.215115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.215137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.215284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.215336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.215394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.215449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.215491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.215502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.215558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.215611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.215666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.215721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.215760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.215765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.215816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.215868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.215928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.215979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.216015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.216021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.216075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.216131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.216185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.216238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.216276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.216281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.216332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.216381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.216431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.216485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.216522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.216527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.216580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.216646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.216702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.216758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.216796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.216802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.216854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.216905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.216958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.217011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.217048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.217053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.217104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.217156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.217208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.217260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.217297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.217302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.217355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.217408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.217459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.217512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.217549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.217554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.217607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.217659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.217712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.217765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.217801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.217806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.217842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309227241:10286], now have 1 active actors on pipe
2025-10-01T14:13:21.218006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256231309227241:10286]
2025-10-01T14:13:21.218007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:21.218036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:21.218039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:21.218057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1941 reason: error at write: Disconnected sessionId: src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0
2025-10-01T14:13:21.218265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1941 sessionId: src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0 is DEAD
2025-10-01T14:13:21.218381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:21.218388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0] Write session will restart in 0.006862s
2025-10-01T14:13:21.218413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0] Write session: Do CDS request
2025-10-01T14:13:21.218420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:21.218617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:21.226754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.226843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:21.226854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1942
2025-10-01T14:13:21.226945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.226973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:21.226982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:21.226984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:21.227492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1942 sessionId:  describe result for acl check
2025-10-01T14:13:21.227520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:21.227525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:21.227526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:21.227529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256231309227373:10518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:21.227893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256231309227373:10518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:21.229791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256231309227373:10518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:21.231095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:21.233094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:21.233279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:21.233286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:21.233294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:21.233327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:21.233325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256231309227373:10518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:21.233334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256231309227373:10518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:21.233337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256231309227373:10518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:21.233352Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256228932328202:10355]
2025-10-01T14:13:21.233341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:21.233729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:21.233906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:21.233935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:21.234126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:21.234161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.234165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.234166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.234167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.234167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.234168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.234168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.234169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.234170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.234170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.234171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.234171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.234172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.234172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.234175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.234181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.234183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.234185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.234187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.234189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.234191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.234193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.234195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.234197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.234199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.234201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.234203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.234205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.234209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.234214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.234218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.234220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.234223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.234225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.234227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.234230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.234232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.234235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.234237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.234240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.234242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.234245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.234247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.234249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.234255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.234258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.234260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.234263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.234264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.234267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.234272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.234275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.234277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.234280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.234281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.234285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.234308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:21.237352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:21.238057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:21.238067Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:21.238068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:21.238071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:21.238075Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1941 [2:7556256228932328202:10355]
2025-10-01T14:13:21.238083Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:21.238097Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:21.238104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.238107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.238109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.238121Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:21.238130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:21.238134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:21.238165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.238169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.238170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.238172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:21.238174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:21.238215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:21.238220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.238226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.238234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.238242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:21.238255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309227243:2446], now have 1 active actors on pipe
2025-10-01T14:13:21.238260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309227514:10518], now have 1 active actors on pipe
2025-10-01T14:13:21.238265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256228932328197:10355]
2025-10-01T14:13:21.238266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256228932328197:10355]
2025-10-01T14:13:21.238268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256228932328197:10355]
2025-10-01T14:13:21.238277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:21.238285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:21.238293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:21.238294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:21.238295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:21.238296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:21.238297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:21.238310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256228932328197:10355]
2025-10-01T14:13:21.238314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:21.238321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:21.238299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1941
2025-10-01T14:13:21.238317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1941
2025-10-01T14:13:21.238337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.238342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.238362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:21.238381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.238384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.238390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:21.238395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.238404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:21.238414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.238544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.238551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.238561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.238625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1942 partition: 0 MaxSeqNo: 45 sessionId: src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0
2025-10-01T14:13:21.238917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dee7d249-81591399-a9ed97e9-6ccdf0f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:21.241004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0] Write session: try to update token
2025-10-01T14:13:21.241015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:21.252500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1942 sessionId: src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:21.254728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:21.254917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.254935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.254963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:21.255077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:21.256937Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:21.256952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:21.256954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:21.256955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:21.256961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256228932328197:10355]
2025-10-01T14:13:21.256965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256228932328197:10355]
2025-10-01T14:13:21.256967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256228932328197:10355]
2025-10-01T14:13:21.257001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:21.257004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:21.257006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.257007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:21.257015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:21.257019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:21.257128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:21.317928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256231309227526:10286]
2025-10-01T14:13:21.318119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 1941, pipe: [1:7556256231309227526:10286]
2025-10-01T14:13:21.386101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:21.392218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.392242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.392376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.392432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.392489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.392547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.392588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.392596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.392662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.392716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.392772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.392828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.392866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.392871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.392924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.392974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.393038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.393094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.393138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.393143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.393195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.393278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.393330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.393379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.393416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.393422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.393475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.393527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.393577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.393632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.393669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.393673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.393727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.393777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.393833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.393887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.393926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.393930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.393984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.394034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.394087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.394137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.394179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.394184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.394237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.394289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.394341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.394410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.394449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.394454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.394509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.394562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.394616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.394668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.394706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.394710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.394766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.394820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.394876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.394930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.394966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.394971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.395008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309227526:10286], now have 1 active actors on pipe
2025-10-01T14:13:21.395185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:21.395196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:21.395201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:21.395226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1942 reason: error at write: Disconnected sessionId: src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0
2025-10-01T14:13:21.395234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256231309227526:10286]
2025-10-01T14:13:21.395422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1942 sessionId: src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0 is DEAD
2025-10-01T14:13:21.395539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:21.395546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0] Write session will restart in 0.006044s
2025-10-01T14:13:21.395563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0] Write session: Do CDS request
2025-10-01T14:13:21.395568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:21.395695Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:21.402765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.402851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:21.402865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1943
2025-10-01T14:13:21.402968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.402996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:21.403007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:21.403011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:21.403394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1943 sessionId:  describe result for acl check
2025-10-01T14:13:21.403427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:21.403434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:21.403435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:21.403439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256231309227609:10522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:21.403875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256231309227609:10522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:21.406691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256231309227609:10522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:21.408789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:21.409003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256231309227609:10522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:21.409013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256231309227609:10522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:21.409015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256231309227609:10522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:21.409022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:21.411033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:21.411164Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:21.411172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:21.411180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:21.411211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:21.411237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256228932328519:10368]
2025-10-01T14:13:21.411583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:21.411782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:21.411807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:21.411988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:21.412019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.412023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.412024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.412025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.412026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.412026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.412027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.412027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.412028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.412028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.412029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.412029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.412030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.412031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.412033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.412039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.412042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.412044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.412046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.412048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.412050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.412052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.412054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.412056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.412058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.412060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.412062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.412064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.412069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.412073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.412077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.412080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.412083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.412086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.412088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.412091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.412093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.412096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.412098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.412100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.412103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.412105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.412108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.412111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.412113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.412115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.412117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.412120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.412122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.412125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.412127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.412129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.412135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.412138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.412140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.412143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.412166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:21.415340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:21.415853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:21.415862Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:21.415863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:21.415865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:21.415870Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1942 [2:7556256228932328519:10368]
2025-10-01T14:13:21.415878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:21.415891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:21.415896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.415898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.415899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.415909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:21.415915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:21.415919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:21.415953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.415957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.415958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.415960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:21.415962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:21.416002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:21.416006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.416013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.416018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.416029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:21.416042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256228932328513:10368]
2025-10-01T14:13:21.416047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256228932328513:10368]
2025-10-01T14:13:21.416048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256228932328513:10368]
2025-10-01T14:13:21.416053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:21.416059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:21.416060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309227799:10522], now have 1 active actors on pipe
2025-10-01T14:13:21.416063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309227527:2446], now have 1 active actors on pipe
2025-10-01T14:13:21.416066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:21.416067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:21.416068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:21.416075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:21.416077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:21.416090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256228932328513:10368]
2025-10-01T14:13:21.416098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:21.416102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:21.416118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1942
2025-10-01T14:13:21.416133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1942
2025-10-01T14:13:21.416181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.416187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.416205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:21.416212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.416215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.416219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:21.416225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.416230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:21.416243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.416374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.416379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.416388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.416456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1943 partition: 0 MaxSeqNo: 45 sessionId: src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0
2025-10-01T14:13:21.416796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5740896e-6a9b5fd-7c0f6ff2-de84d85e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:21.418901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0] Write session: try to update token
2025-10-01T14:13:21.418913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:21.430183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1943 sessionId: src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:21.432502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:21.432701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.432719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.432753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:21.432836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:21.434758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:21.434772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:21.434775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:21.434776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:21.434786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256228932328513:10368]
2025-10-01T14:13:21.434790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256228932328513:10368]
2025-10-01T14:13:21.434794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256228932328513:10368]
2025-10-01T14:13:21.434840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:21.434843Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:21.434849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:21.434851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.434852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:21.434853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:21.434968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:21.495599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256231309227817:10286]
2025-10-01T14:13:21.495845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 1942, pipe: [1:7556256231309227817:10286]
2025-10-01T14:13:21.563946Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:21.570255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.570277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.570408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.570470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.570531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.570585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.570626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.570633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.570701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.570752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.570802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.570855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.570897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.570903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.570953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.570998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.571049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.571096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.571137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.571145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.571202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.571251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.571296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.571343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.571379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.571385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.571435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.571484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.571531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.571578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.571613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.571618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.571668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.571716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.571766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.571816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.571853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.571859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.571908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.571954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.572004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.572052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.572092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.572097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.572146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.572192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.572240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.572289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.572326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.572330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.572380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.572429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.572480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.572528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.572564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.572569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.572633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.572686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.572736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.572785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.572822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.572827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.572860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309227817:10286], now have 1 active actors on pipe
2025-10-01T14:13:21.573045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256231309227817:10286]
2025-10-01T14:13:21.573059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:21.573063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:21.573069Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:21.573085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1943 reason: error at write: Disconnected sessionId: src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0
2025-10-01T14:13:21.573250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1943 sessionId: src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0 is DEAD
2025-10-01T14:13:21.573330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:21.573340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0] Write session will restart in 0.006428s
2025-10-01T14:13:21.573363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0] Write session: Do CDS request
2025-10-01T14:13:21.573369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:21.573390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:21.580712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.580822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:21.580834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1944
2025-10-01T14:13:21.580941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.580969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:21.580978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:21.580982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:21.581274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1944 sessionId:  describe result for acl check
2025-10-01T14:13:21.581307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:21.581313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:21.581315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:21.581320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256231309227921:10528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:21.581761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256231309227921:10528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:21.583709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256231309227921:10528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:21.586006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:21.586054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256231309227921:10528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:21.586063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256231309227921:10528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:21.586066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256231309227921:10528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:21.586071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:21.588193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:21.588321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:21.588329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:21.588337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:21.588379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:21.588410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256228932328795:10370]
2025-10-01T14:13:21.588779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:21.588970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:21.589005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:21.589223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:21.589268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.589273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.589274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.589275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.589276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.589276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.589278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.589279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.589280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.589280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.589281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.589282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.589283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.589284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.589288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.589297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.589301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.589304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.589306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.589308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.589309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.589311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.589313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.589315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.589317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.589318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.589320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.589322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.589326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.589330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.589334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.589337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.589344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.589346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.589353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.589356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.589358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.589364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.589372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.589376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.589385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.589390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.589397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.589402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.589409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.589414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.589421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.589426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.589433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.589438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.589445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.589449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.589456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.589461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.589468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.589473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.589511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:21.592652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:21.593186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:21.593201Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:21.593202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:21.593204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:21.593209Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1943 [2:7556256228932328795:10370]
2025-10-01T14:13:21.593217Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:21.593227Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:21.593228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.593230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.593232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.593241Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:21.593245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:21.593249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:21.593281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.593287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.593288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.593290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:21.593292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:21.593345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:21.593351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.593361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.593375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.593390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:21.593409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309228106:10528], now have 1 active actors on pipe
2025-10-01T14:13:21.593416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309227834:2446], now have 1 active actors on pipe
2025-10-01T14:13:21.593422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256228932328789:10370]
2025-10-01T14:13:21.593424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256228932328789:10370]
2025-10-01T14:13:21.593426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256228932328789:10370]
2025-10-01T14:13:21.593438Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:21.593434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1943
2025-10-01T14:13:21.593436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1943
2025-10-01T14:13:21.593452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:21.593454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:21.593456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:21.593457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:21.593473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:21.593476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:21.593507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.593515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.593525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256228932328789:10370]
2025-10-01T14:13:21.593536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:21.593547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:21.593559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:21.593566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.593569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.593570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:21.593576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.593585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:21.593599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.593688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.593693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.593703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.593763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1944 partition: 0 MaxSeqNo: 45 sessionId: src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0
2025-10-01T14:13:21.594062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d8ae8c9-497155ff-59ea0e31-674a4d78_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:21.596236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0] Write session: try to update token
2025-10-01T14:13:21.596252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:21.609015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1944 sessionId: src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:21.611023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:21.611226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.611248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.611282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:21.611349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:21.613698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:21.613714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:21.613717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:21.613719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:21.613727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256228932328789:10370]
2025-10-01T14:13:21.613732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256228932328789:10370]
2025-10-01T14:13:21.613737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256228932328789:10370]
2025-10-01T14:13:21.613769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:21.613780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:21.613781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:21.613782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:21.613787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.613789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:21.613908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:21.673241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256231309228119:10286]
2025-10-01T14:13:21.673458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 1943, pipe: [1:7556256231309228119:10286]
2025-10-01T14:13:21.748011Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:21.754105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.754127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.754257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.754306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.754357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.754419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.754458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.754466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.754520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.754570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.754623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.754676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.754715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.754720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.754773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.754820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.754869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.754916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.754951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.754956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.755005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.755053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.755100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.755147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.755182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.755188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.755234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.755280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.755327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.755375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.755409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.755414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.755464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.755510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.755558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.755608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.755648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.755653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.755701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.755746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.755794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.755843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.755879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.755884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.755933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.755979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.756027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.756076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.756112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.756117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.756166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.756213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.756262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.756309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.756345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.756351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.756401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.756448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.756496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.756542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.756577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.756582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.756623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309228119:10286], now have 1 active actors on pipe
2025-10-01T14:13:21.756847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:21.756852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256231309228119:10286]
2025-10-01T14:13:21.756872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:21.756876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:21.757076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1944 reason: error at write: Disconnected sessionId: src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0
2025-10-01T14:13:21.757246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1944 sessionId: src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0 is DEAD
2025-10-01T14:13:21.757375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:21.757383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0] Write session will restart in 0.006175s
2025-10-01T14:13:21.757400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0] Write session: Do CDS request
2025-10-01T14:13:21.757406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:21.757490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:21.764746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.764792Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:21.764802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1945
2025-10-01T14:13:21.764903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.764925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:21.764930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:21.764932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:21.765176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1945 sessionId:  describe result for acl check
2025-10-01T14:13:21.765200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:21.765205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:21.765206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:21.765209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256231309228206:10532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:21.765547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256231309228206:10532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:21.767525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256231309228206:10532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:21.769823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256231309228206:10532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:21.769831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256231309228206:10532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:21.769833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256231309228206:10532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:21.769838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:21.770672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:21.772502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:21.772658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:21.772667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:21.772678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:21.772720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:21.772753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256228932329075:10373]
2025-10-01T14:13:21.773129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:21.773311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:21.773337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:21.773514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:21.773547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.773551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.773552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.773552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.773553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.773554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.773554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.773555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.773555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.773556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.773556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.773557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.773557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.773558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.773561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.773566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.773568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.773570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.773572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.773574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.773576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.773578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.773580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.773582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.773584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.773586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.773588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.773590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.773594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.773598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.773602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.773604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.773612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.773621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.773628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.773633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.773640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.773643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.773645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.773647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.773651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.773657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.773659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.773662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.773664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.773666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.773668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.773671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.773673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.773675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.773677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.773680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.773688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.773692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.773699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.773703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.773726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:21.776820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:21.777326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:21.777338Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:21.777339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:21.777341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:21.777346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1944 [2:7556256228932329075:10373]
2025-10-01T14:13:21.777358Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:21.777370Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:21.777373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.777376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.777378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.777391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:21.777400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:21.777405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:21.777436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.777441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.777442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.777446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:21.777447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:21.777488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:21.777493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.777499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.777504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.777512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:21.777524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309228121:2446], now have 1 active actors on pipe
2025-10-01T14:13:21.777530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309228392:10532], now have 1 active actors on pipe
2025-10-01T14:13:21.777534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256228932329070:10373]
2025-10-01T14:13:21.777535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256228932329070:10373]
2025-10-01T14:13:21.777536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256228932329070:10373]
2025-10-01T14:13:21.777545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:21.777556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:21.777556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:21.777558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:21.777560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:21.777567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:21.777569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:21.777584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256228932329070:10373]
2025-10-01T14:13:21.777589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:21.777581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1944
2025-10-01T14:13:21.777602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:21.777590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1944
2025-10-01T14:13:21.777613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.777616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.777632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:21.777640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.777643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.777644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:21.777649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.777658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:21.777666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.777756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.777761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.777769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.777832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1945 partition: 0 MaxSeqNo: 45 sessionId: src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0
2025-10-01T14:13:21.778084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cb32444-c7f715c2-1bbad440-a23b4678_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:21.780099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0] Write session: try to update token
2025-10-01T14:13:21.780113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:21.791329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1945 sessionId: src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:21.793511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:21.793793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.793812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.793847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:21.793911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:21.795933Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:21.795950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:21.795953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:21.795954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:21.795962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256228932329070:10373]
2025-10-01T14:13:21.795966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256228932329070:10373]
2025-10-01T14:13:21.795969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256228932329070:10373]
2025-10-01T14:13:21.796005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:21.796015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:21.796015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:21.796018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:21.796021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.796023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:21.796150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:21.857037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256231309228407:10286]
2025-10-01T14:13:21.857255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 1944, pipe: [1:7556256231309228407:10286]
2025-10-01T14:13:21.926751Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:21.933485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.933506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.933637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.933690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.933744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.933799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.933839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.933846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.933900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.933951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.934003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.934061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.934099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.934105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.934157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.934203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.934254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.934303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.934343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.934348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.934418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.934472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.934517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.934564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.934601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.934606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.934657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.934705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.934751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.934800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.934838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.934843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.934893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.934946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.934998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.935050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.935087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.935092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.935147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.935195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.935244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.935296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.935334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.935339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.935403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.935462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.935513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.935563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.935600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.935605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.935662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.935713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.935763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.935813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.935850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.935855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.935908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:21.935963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:21.936015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:21.936066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:21.936103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:21.936109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:21.936151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309228407:10286], now have 1 active actors on pipe
2025-10-01T14:13:21.936345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:21.936350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256231309228407:10286]
2025-10-01T14:13:21.936356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:21.936369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:21.936375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1945 reason: error at write: Disconnected sessionId: src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0
2025-10-01T14:13:21.936526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1945 sessionId: src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0 is DEAD
2025-10-01T14:13:21.936655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:21.936666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0] Write session will restart in 0.007861s
2025-10-01T14:13:21.936694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0] Write session: Do CDS request
2025-10-01T14:13:21.936699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:21.937067Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:21.945791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.945872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:21.945885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1946
2025-10-01T14:13:21.945979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:21.946008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:21.946017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:21.946020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:21.946362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1946 sessionId:  describe result for acl check
2025-10-01T14:13:21.946404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:21.946410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:21.946412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:21.946416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256231309228545:10537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:21.946865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256231309228545:10537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:21.949473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256231309228545:10537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:21.949878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:21.952045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:21.952190Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:21.952198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:21.952205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:21.952235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:21.952260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256228932329352:10375]
2025-10-01T14:13:21.952276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256231309228545:10537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:21.952288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256231309228545:10537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:21.952290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256231309228545:10537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:21.952295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:21.952668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:21.952845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:21.952877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:21.953086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:21.953121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.953125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.953125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.953126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.953126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.953127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.953128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.953128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.953129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.953129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.953130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.953130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.953131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.953132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.953134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.953140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.953142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.953144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.953146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.953148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.953150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.953152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.953154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.953156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.953158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.953160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.953162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.953164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.953168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.953172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:21.953177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.953180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:21.953185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.953187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:21.953190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.953192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:21.953195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.953197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:21.953203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.953206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:21.953208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.953211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:21.953218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.953222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:21.953230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.953234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:21.953242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.953250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.953254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.953261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.953265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.953273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.953277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.953285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:21.953290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.953298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:21.953334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:21.956447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:21.956965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:21.956975Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:21.956976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:21.956979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:21.956983Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1945 [2:7556256228932329352:10375]
2025-10-01T14:13:21.956991Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:21.957004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:21.957009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.957011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.957013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.957022Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:21.957029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:21.957032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:21.957067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.957072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.957073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.957076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:21.957078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:21.957119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:21.957124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.957131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:21.957136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:21.957146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:21.957163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309228411:2446], now have 1 active actors on pipe
2025-10-01T14:13:21.957172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256231309228687:10537], now have 1 active actors on pipe
2025-10-01T14:13:21.957179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256228932329347:10375]
2025-10-01T14:13:21.957181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256228932329347:10375]
2025-10-01T14:13:21.957182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256228932329347:10375]
2025-10-01T14:13:21.957194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:21.957202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:21.957205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:21.957209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:21.957211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:21.957217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:21.957219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:21.957211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1945
2025-10-01T14:13:21.957217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1945
2025-10-01T14:13:21.957238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256228932329347:10375]
2025-10-01T14:13:21.957245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:21.957246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:21.957257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.957263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.957292Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:21.957300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:21.957303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:21.957304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:21.957310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:21.957316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:21.957330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.957441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.957448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.957457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:21.957512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1946 partition: 0 MaxSeqNo: 45 sessionId: src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0
2025-10-01T14:13:21.957769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f203d-ca15f2e3-86c1ce21-76e56a8c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:21.959815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0] Write session: try to update token
2025-10-01T14:13:21.959827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:21.971867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1946 sessionId: src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:21.974135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:21.974286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:21.974302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:21.974333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:21.974623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:21.975994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:21.976008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:21.976010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:21.976011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:21.976018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256228932329347:10375]
2025-10-01T14:13:21.976020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256228932329347:10375]
2025-10-01T14:13:21.976023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256228932329347:10375]
2025-10-01T14:13:21.976053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:21.976055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:21.976060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:21.976062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:21.976062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:21.976065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:21.976174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:22.036218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256235604196016:10286]
2025-10-01T14:13:22.036374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 1945, pipe: [1:7556256235604196016:10286]
2025-10-01T14:13:22.104448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:22.111387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.111408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.111542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.111595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.111650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.111706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.111756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.111766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.111825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.111876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.111932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.111988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.112030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.112035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.112089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.112136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.112188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.112249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.112288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.112294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.112344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.112397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.112452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.112508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.112549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.112555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.112608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.112666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.112717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.112767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.112808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.112816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.112874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.112922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.112975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.113033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.113074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.113081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.113143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.113197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.113250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.113307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.113347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.113352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.113405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.113456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.113506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.113562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.113601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.113608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.113664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.113716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.113771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.113824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.113863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.113868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.113924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.113976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.114035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.114090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.114129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.114134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.114171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196016:10286], now have 1 active actors on pipe
2025-10-01T14:13:22.114388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:22.114422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256235604196016:10286]
2025-10-01T14:13:22.114436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:22.114442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:22.114462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1946 reason: error at write: Disconnected sessionId: src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0
2025-10-01T14:13:22.114633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1946 sessionId: src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0 is DEAD
2025-10-01T14:13:22.114751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:22.114757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0] Write session will restart in 0.009626s
2025-10-01T14:13:22.114775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0] Write session: Do CDS request
2025-10-01T14:13:22.114779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:22.114863Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:22.125828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.125894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:22.125912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1947
2025-10-01T14:13:22.126046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.126079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:22.126091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:22.126098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:22.126473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1947 sessionId:  describe result for acl check
2025-10-01T14:13:22.126507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:22.126512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:22.126514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:22.126518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256235604196160:10550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:22.126859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256235604196160:10550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:22.128868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256235604196160:10550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:22.130941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256235604196160:10550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:22.130941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:22.130950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256235604196160:10550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:22.130952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256235604196160:10550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:22.130957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:22.133279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:22.133417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:22.133425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:22.133435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:22.133477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:22.133509Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256233227296937:10380]
2025-10-01T14:13:22.133866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:22.134064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:22.134090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:22.134332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:22.134385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.134390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.134391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.134391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.134392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.134392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.134393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.134393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.134394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.134395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.134395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.134396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.134396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.134397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.134400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.134405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.134407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.134409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.134411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.134413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.134415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.134417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.134419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.134421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.134423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.134425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.134427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.134429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.134433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.134438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.134442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.134445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.134447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.134450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.134453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.134455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.134458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.134461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.134463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.134465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.134468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.134471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.134473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.134475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.134478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.134480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.134483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.134488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.134491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.134496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.134499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.134504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.134508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.134513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.134521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.134525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.134544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:22.137778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:22.138333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:22.138345Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:22.138347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:22.138350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:22.138356Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1946 [2:7556256233227296937:10380]
2025-10-01T14:13:22.138382Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:22.138400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:22.138407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.138410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.138412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.138425Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:22.138435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:22.138445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:22.138491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.138499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.138500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.138504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:22.138506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:22.138564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:22.138571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.138582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.138597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.138617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:22.138637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196297:10550], now have 1 active actors on pipe
2025-10-01T14:13:22.138640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196020:2446], now have 1 active actors on pipe
2025-10-01T14:13:22.138651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256233227296931:10380]
2025-10-01T14:13:22.138657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256233227296931:10380]
2025-10-01T14:13:22.138659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256233227296931:10380]
2025-10-01T14:13:22.138672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:22.138690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:22.138695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:22.138699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:22.138701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:22.138704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:22.138706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:22.138725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256233227296931:10380]
2025-10-01T14:13:22.138731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:22.138711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1946
2025-10-01T14:13:22.138722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1946
2025-10-01T14:13:22.138740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:22.138757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.138765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.138792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:22.138802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.138809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.138812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:22.138823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.138834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:22.138850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.138996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.139004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.139018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.139118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1947 partition: 0 MaxSeqNo: 45 sessionId: src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0
2025-10-01T14:13:22.139433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61d4ab2b-8cabf563-b3ebf44-4895c651_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:22.141581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0] Write session: try to update token
2025-10-01T14:13:22.141595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:22.153619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1947 sessionId: src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:22.155889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:22.157847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.157872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.157891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:22.157894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:22.157896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:22.157898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:22.157905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256233227296931:10380]
2025-10-01T14:13:22.157914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256233227296931:10380]
2025-10-01T14:13:22.157919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256233227296931:10380]
2025-10-01T14:13:22.157956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:22.157967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:22.157969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:22.157969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:22.157974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.157976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:22.158101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:22.214449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256235604196309:10286]
2025-10-01T14:13:22.214695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 1946, pipe: [1:7556256235604196309:10286]
2025-10-01T14:13:22.300042Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:22.300551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:22.300594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196309:10286], now have 1 active actors on pipe
2025-10-01T14:13:22.300699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:22.300781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256235604196309:10286]
2025-10-01T14:13:22.300803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:22.300817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:22.300822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:22.300835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1947 reason: error at write: Disconnected sessionId: src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0
2025-10-01T14:13:22.300943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1947 sessionId: src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0 is DEAD
2025-10-01T14:13:22.301064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:22.301072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0] Write session will restart in 0.009541s
2025-10-01T14:13:22.301090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0] Write session: Do CDS request
2025-10-01T14:13:22.301099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:22.311785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.311831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:22.311841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1948
2025-10-01T14:13:22.311960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.311988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:22.311997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:22.312000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:22.312444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1948 sessionId:  describe result for acl check
2025-10-01T14:13:22.312470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:22.312473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:22.312474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:22.312477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256235604196453:10554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:22.312845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256235604196453:10554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:22.314537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256235604196453:10554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:22.316699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:22.316751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256235604196453:10554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:22.316761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256235604196453:10554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:22.316763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256235604196453:10554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:22.316768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:22.319375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:22.319541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:22.319551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:22.319560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:22.319608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:22.319639Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256233227297231:10383]
2025-10-01T14:13:22.319998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:22.320220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:22.320245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:22.320431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:22.320469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.320475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.320475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.320476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.320477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.320477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.320478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.320478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.320479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.320480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.320480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.320481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.320481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.320482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.320485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.320490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.320492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.320494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.320496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.320498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.320500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.320501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.320503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.320505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.320507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.320509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.320510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.320512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.320516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.320521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.320524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.320527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.320530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.320532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.320535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.320537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.320540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.320543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.320546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.320548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.320551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.320553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.320556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.320559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.320561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.320564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.320568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.320570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.320572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.320581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.320588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.320593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.320601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.320617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.320623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.320625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.320651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:22.323813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:22.324341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:22.324353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:22.324354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:22.324356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:22.324360Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1947 [2:7556256233227297231:10383]
2025-10-01T14:13:22.324368Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:22.324379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:22.324380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.324382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.324383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.324392Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:22.324399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:22.324403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:22.324438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.324443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.324444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.324446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:22.324448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:22.324487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:22.324492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.324498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.324503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.324516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:22.324533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196588:10554], now have 1 active actors on pipe
2025-10-01T14:13:22.324540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196312:2446], now have 1 active actors on pipe
2025-10-01T14:13:22.324546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256233227297225:10383]
2025-10-01T14:13:22.324548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256233227297225:10383]
2025-10-01T14:13:22.324550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256233227297225:10383]
2025-10-01T14:13:22.324564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:22.324579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:22.324581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:22.324583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:22.324585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:22.324595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:22.324599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:22.324624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256233227297225:10383]
2025-10-01T14:13:22.324634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:22.324627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1947
2025-10-01T14:13:22.324636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1947
2025-10-01T14:13:22.324657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:22.324699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.324708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.324733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6194a9e-48d62af2-19704b42-40e5589f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:22.324743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.324749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.324752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:22.324759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.324771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:22.324785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.324934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.324940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.324952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.325046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1948 partition: 0 MaxSeqNo: 45 sessionId: src_id|b6194a9e-48d62af2-19704b42-40e5589f_0
2025-10-01T14:13:22.325363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53eb04b2-d7a3833e-cfb82bb1-4b985e2d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b6194a9e-48d62af2-19704b42-40e5589f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:22.327540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6194a9e-48d62af2-19704b42-40e5589f_0] Write session: try to update token
2025-10-01T14:13:22.327553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6194a9e-48d62af2-19704b42-40e5589f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:22.338821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1948 sessionId: src_id|b6194a9e-48d62af2-19704b42-40e5589f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:22.339209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:22.339225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:22.339231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256233227297225:10383]
2025-10-01T14:13:22.339268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:22.339269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:22.339425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:22.339564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:22.339707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:22.339843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:22.340025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:22.340059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:22.340890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:22.341048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.341060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.341081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:22.341151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:22.352751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:22.352766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:22.352767Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:22.352769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:22.352776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256233227297225:10383]
2025-10-01T14:13:22.352778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256233227297225:10383]
2025-10-01T14:13:22.352780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256233227297225:10383]
2025-10-01T14:13:22.352810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:22.352812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:22.352815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.352815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:22.352817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:22.352819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:22.352922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:22.400788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256235604196600:10286]
2025-10-01T14:13:22.401041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 1947, pipe: [1:7556256235604196600:10286]
2025-10-01T14:13:22.482989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:22.489490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.489515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.489649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.489701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.489756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.489814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.489856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.489864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.489923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.489983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.490036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.490091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.490131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.490136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.490191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.490241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.490295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.490351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.490401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.490407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.490458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.490510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.490559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.490610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.490653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.490659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.490710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.490759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.490809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.490860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.490898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.490904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.490961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.491014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.491070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.491129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.491170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.491175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.491233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.491285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.491339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.491392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.491427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.491433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.491486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.491535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.491587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.491644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.491683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.491688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.491740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.491789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.491837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.491895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.491932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.491938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.491988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:22.492037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:22.492150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:22.492204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:22.492242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:22.492247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:22.492286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196600:10286], now have 1 active actors on pipe
2025-10-01T14:13:22.492606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:22.492616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256235604196600:10286]
2025-10-01T14:13:22.492625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:22.492648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1948 reason: error at write: Disconnected sessionId: src_id|b6194a9e-48d62af2-19704b42-40e5589f_0
2025-10-01T14:13:22.492662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:22.492828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1948 sessionId: src_id|b6194a9e-48d62af2-19704b42-40e5589f_0 is DEAD
2025-10-01T14:13:22.492977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6194a9e-48d62af2-19704b42-40e5589f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:22.492987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6194a9e-48d62af2-19704b42-40e5589f_0] Write session will restart in 0.009333s
2025-10-01T14:13:22.493011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6194a9e-48d62af2-19704b42-40e5589f_0] Write session: Do CDS request
2025-10-01T14:13:22.493018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6194a9e-48d62af2-19704b42-40e5589f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:22.493113Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:22.503764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6194a9e-48d62af2-19704b42-40e5589f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.503866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:22.503879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1949
2025-10-01T14:13:22.503965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.503985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:22.503992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:22.503994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:22.504350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1949 sessionId:  describe result for acl check
2025-10-01T14:13:22.504382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:22.504387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:22.504389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:22.504393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256235604196771:10560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:22.504810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256235604196771:10560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:22.506900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256235604196771:10560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:22.508175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:22.510905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:22.511024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256235604196771:10560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:22.511035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256235604196771:10560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:22.511037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256235604196771:10560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:22.511043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:22.511063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:22.511070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:22.511077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:22.511111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:22.511136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256233227297540:10395]
2025-10-01T14:13:22.511508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:22.511732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:22.511756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:22.511949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:22.511986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.511991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.511991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.511992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.511993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.511994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.511994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.511995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.511996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.511997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.511997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.511998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.511998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.511999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.512002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.512007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.512010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.512012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.512014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.512016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.512018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.512021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.512023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.512026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.512028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.512030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.512031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.512033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.512038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.512042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.512046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.512049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.512051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.512054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.512059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.512062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.512064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.512067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.512073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.512076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.512078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.512084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.512086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.512089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.512092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.512094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.512096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.512099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.512102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.512105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.512107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.512112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.512115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.512117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.512119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.512122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.512144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:22.515371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:22.515882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:22.515893Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:22.515894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:22.515897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:22.515901Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1948 [2:7556256233227297540:10395]
2025-10-01T14:13:22.515911Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:22.515937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:22.515944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.515947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.515949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.515963Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:22.515970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:22.515974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:22.516007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.516012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.516013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.516015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:22.516017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:22.516063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:22.516068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.516075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.516083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.516095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:22.516110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196608:2446], now have 1 active actors on pipe
2025-10-01T14:13:22.516116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196901:10560], now have 1 active actors on pipe
2025-10-01T14:13:22.516121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256233227297535:10395]
2025-10-01T14:13:22.516123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256233227297535:10395]
2025-10-01T14:13:22.516125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256233227297535:10395]
2025-10-01T14:13:22.516133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:22.516144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:22.516145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:22.516147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:22.516148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:22.516154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:22.516156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:22.516170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256233227297535:10395]
2025-10-01T14:13:22.516175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:22.516165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1948
2025-10-01T14:13:22.516185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:22.516175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1948
2025-10-01T14:13:22.516199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.516205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.516224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:22.516231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.516234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.516238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:22.516243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.516252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:22.516264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.516370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.516375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.516384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.516466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1949 partition: 0 MaxSeqNo: 45 sessionId: src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0
2025-10-01T14:13:22.516796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6194a9e-48d62af2-19704b42-40e5589f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:22.518982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0] Write session: try to update token
2025-10-01T14:13:22.518998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:22.531651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1949 sessionId: src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:22.533834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:22.535632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.535666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.535686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:22.535694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:22.535696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:22.535698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:22.535705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256233227297535:10395]
2025-10-01T14:13:22.535713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256233227297535:10395]
2025-10-01T14:13:22.535718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256233227297535:10395]
2025-10-01T14:13:22.535761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:22.535768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:22.535773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.535773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:22.535776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:22.535777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:22.535893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:22.592819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256235604196912:10286]
2025-10-01T14:13:22.593040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 1948, pipe: [1:7556256235604196912:10286]
2025-10-01T14:13:22.669539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:22.670159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:22.670205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196912:10286], now have 1 active actors on pipe
2025-10-01T14:13:22.670307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:22.670382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:22.670422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256235604196912:10286]
2025-10-01T14:13:22.680924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:22.680940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:22.680964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1949 reason: error at write: Disconnected sessionId: src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0
2025-10-01T14:13:22.681128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1949 sessionId: src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0 is DEAD
2025-10-01T14:13:22.681250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 164 BytesWritten: 85606466 MessagesWritten: 38 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-01T14:13:22.681278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:22.681283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0] Write session will restart in 0.007110s
2025-10-01T14:13:22.681300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0] Write session: Do CDS request
2025-10-01T14:13:22.681315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:22.689467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:22.689850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.690144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:22.690159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1950
2025-10-01T14:13:22.690254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.690283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:22.690292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:22.690296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:22.690611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1950 sessionId:  describe result for acl check
2025-10-01T14:13:22.690639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:22.690642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:22.690643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:22.690646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256235604197160:10564] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:22.691008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256235604197160:10564] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:22.692404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:22.692536Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:22.692544Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:22.692551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:22.692582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:22.692619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256233227297824:10398]
2025-10-01T14:13:22.692687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256235604197160:10564] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:22.692994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:22.693189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:22.693211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:22.693391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:22.693423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.693427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.693428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.693428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.693429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.693430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.693430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.693431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.693432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.693432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.693433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.693433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.693434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.693434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.693437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.693442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.693445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.693448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.693450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.693452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.693454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.693456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.693458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.693461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.693463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.693465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.693467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.693469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.693473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.693479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.693482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.693485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.693488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.693490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.693493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.693496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.693498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.693501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.693503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.693506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.693509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.693512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.693514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.693516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.693518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.693521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.693523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.693530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.693533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.693537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.693539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.693541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.693547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.693550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.693552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.693555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.693577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:22.696684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256235604197160:10564] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:22.696697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256235604197160:10564] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:22.696699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256235604197160:10564] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:22.696705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:22.696815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:22.697366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:22.697375Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:22.697377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:22.697379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:22.697384Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1949 [2:7556256233227297824:10398]
2025-10-01T14:13:22.697394Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:22.697405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:22.697410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.697412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.697414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.697424Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:22.697430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:22.697434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:22.697471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.697476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.697477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.697479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:22.697481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:22.697527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:22.697533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.697539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.697545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.697556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:22.697570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604197198:10564], now have 1 active actors on pipe
2025-10-01T14:13:22.697576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604196914:2446], now have 1 active actors on pipe
2025-10-01T14:13:22.697581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256233227297819:10398]
2025-10-01T14:13:22.697585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256233227297819:10398]
2025-10-01T14:13:22.697587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256233227297819:10398]
2025-10-01T14:13:22.697596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:22.697608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:22.697608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:22.697610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:22.697611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:22.697619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:22.697621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:22.697616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1949
2025-10-01T14:13:22.697637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256233227297819:10398]
2025-10-01T14:13:22.697618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1949
2025-10-01T14:13:22.697641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:22.697643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:22.697653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.697656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.697688Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8700937a-75f89a43-9cb8a490-79ed3115_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:22.697695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.697698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.697703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:22.697708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.697717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:22.697732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.697820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.697825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.697834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.697884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1950 partition: 0 MaxSeqNo: 45 sessionId: src_id|8700937a-75f89a43-9cb8a490-79ed3115_0
2025-10-01T14:13:22.698203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b70744de-3e271bd9-b6cd5e15-2aca8702_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8700937a-75f89a43-9cb8a490-79ed3115_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:22.700762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8700937a-75f89a43-9cb8a490-79ed3115_0] Write session: try to update token
2025-10-01T14:13:22.700779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8700937a-75f89a43-9cb8a490-79ed3115_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:22.715343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1950 sessionId: src_id|8700937a-75f89a43-9cb8a490-79ed3115_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:22.716973Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:22.716991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:22.716993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:22.716995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:22.717002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256233227297819:10398]
2025-10-01T14:13:22.717006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256233227297819:10398]
2025-10-01T14:13:22.717010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256233227297819:10398]
2025-10-01T14:13:22.717047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:22.717052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.717056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:22.717059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:22.717065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:22.717068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:22.717172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:22.717954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:22.770444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256235604197205:10286]
2025-10-01T14:13:22.770688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 1949, pipe: [1:7556256235604197205:10286]
2025-10-01T14:13:22.846331Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:22.846799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.846811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.846845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604197205:10286], now have 1 active actors on pipe
2025-10-01T14:13:22.846998Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:22.847046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256235604197205:10286]
2025-10-01T14:13:22.847056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:22.847060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:22.847073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:22.847116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1950 reason: error at write: Disconnected sessionId: src_id|8700937a-75f89a43-9cb8a490-79ed3115_0
2025-10-01T14:13:22.847285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1950 sessionId: src_id|8700937a-75f89a43-9cb8a490-79ed3115_0 is DEAD
2025-10-01T14:13:22.847482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8700937a-75f89a43-9cb8a490-79ed3115_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:22.847491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8700937a-75f89a43-9cb8a490-79ed3115_0] Write session will restart in 0.005325s
2025-10-01T14:13:22.847523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8700937a-75f89a43-9cb8a490-79ed3115_0] Write session: Do CDS request
2025-10-01T14:13:22.847528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8700937a-75f89a43-9cb8a490-79ed3115_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:22.853783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8700937a-75f89a43-9cb8a490-79ed3115_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.853833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:22.853847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1951
2025-10-01T14:13:22.853969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:22.853991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:22.853998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:22.854001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:22.854355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1951 sessionId:  describe result for acl check
2025-10-01T14:13:22.854398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:22.854402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:22.854403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:22.854407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256235604197251:10568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:22.854771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256235604197251:10568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:22.856804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256235604197251:10568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:22.859203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256235604197251:10568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:22.859215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256235604197251:10568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:22.859217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256235604197251:10568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:22.859223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:22.862057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:22.864398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:22.864545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:22.864552Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:22.864560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:22.864588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:22.864619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256233227298108:10400]
2025-10-01T14:13:22.864997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:22.865181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:22.865205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:22.865384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:22.865419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.865425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.865426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.865426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.865427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.865427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.865428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.865428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.865429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.865430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.865430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.865431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.865432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.865432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.865435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.865440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.865443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.865445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.865447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.865449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.865451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.865453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.865455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.865457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.865459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.865461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.865463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.865465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.865469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.865473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:22.865477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.865480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:22.865482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.865485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:22.865487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.865490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:22.865492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.865495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:22.865497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.865500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:22.865502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.865504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:22.865507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.865509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:22.865512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.865515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:22.865517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.865520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.865522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.865525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.865529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.865533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.865535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.865539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:22.865541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.865544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:22.865564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:22.869200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:22.869872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:22.869884Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:22.869886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:22.869888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:22.869893Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1950 [2:7556256233227298108:10400]
2025-10-01T14:13:22.869903Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:22.869918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:22.869923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.869925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.869926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.869937Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:22.869944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:22.869948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:22.869986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.869991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.869992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.869994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:22.869996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:22.870044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:22.870050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.870056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:22.870062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:22.870073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:22.870090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604197207:2446], now have 1 active actors on pipe
2025-10-01T14:13:22.870096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604197407:10568], now have 1 active actors on pipe
2025-10-01T14:13:22.870102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256233227298103:10400]
2025-10-01T14:13:22.870105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256233227298103:10400]
2025-10-01T14:13:22.870106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256233227298103:10400]
2025-10-01T14:13:22.870115Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:22.870126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:22.870128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:22.870130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:22.870131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:22.870137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:22.870140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:22.870125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1950
2025-10-01T14:13:22.870132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1950
2025-10-01T14:13:22.870162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256233227298103:10400]
2025-10-01T14:13:22.870171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:22.870175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:22.870181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.870184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.870212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:22.870220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:22.870223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:22.870225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:22.870230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:22.870239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:22.870252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.870343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.870348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.870357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:22.870426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1951 partition: 0 MaxSeqNo: 45 sessionId: src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0
2025-10-01T14:13:22.870717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8700937a-75f89a43-9cb8a490-79ed3115_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:22.872853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0] Write session: try to update token
2025-10-01T14:13:22.872868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:22.884948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1951 sessionId: src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:22.887085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:22.887278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:22.887296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:22.887340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:22.887403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:22.891102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:22.891118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:22.891120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:22.891121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:22.891128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256233227298103:10400]
2025-10-01T14:13:22.891131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256233227298103:10400]
2025-10-01T14:13:22.891134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256233227298103:10400]
2025-10-01T14:13:22.891169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:22.891171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:22.891178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:22.891179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:22.891289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:22.891338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:22.891348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:22.947102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256235604197500:10286]
2025-10-01T14:13:22.947365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 1950, pipe: [1:7556256235604197500:10286]
2025-10-01T14:13:23.025992Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:23.032527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.032553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.032714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.032775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.032841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.032902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.032952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.032964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.033031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.033089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.033147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.033207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.033250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.033258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.033317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.033370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.033426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.033482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.033526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.033534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.033588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.033643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.033701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.033757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.033798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.033805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.033865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.033921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.033977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.034036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.034077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.034084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.034140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.034195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.034254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.034316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.034357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.034364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.034439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.034494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.034551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.034610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.034653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.034661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.034717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.034774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.034830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.034887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.034932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.034939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.034998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.035057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.035114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.035175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.035216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.035225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.035285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.035344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.035403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.035455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.035558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.035563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.035598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256235604197500:10286], now have 1 active actors on pipe
2025-10-01T14:13:23.035770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256235604197500:10286]
2025-10-01T14:13:23.035794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:23.035822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:23.035824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:23.035840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1951 reason: error at write: Disconnected sessionId: src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0
2025-10-01T14:13:23.035986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1951 sessionId: src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0 is DEAD
2025-10-01T14:13:23.036098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:23.036108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0] Write session will restart in 0.008691s
2025-10-01T14:13:23.036133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0] Write session: Do CDS request
2025-10-01T14:13:23.036139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:23.036353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:23.045770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.045815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:23.045826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1952
2025-10-01T14:13:23.045936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.045958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:23.045961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:23.045964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:23.046230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1952 sessionId:  describe result for acl check
2025-10-01T14:13:23.046251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:23.046256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:23.046257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:23.046260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256239899164933:10579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:23.046613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256239899164933:10579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:23.047860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256239899164933:10579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:23.049980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256239899164933:10579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:23.049992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256239899164933:10579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:23.049996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256239899164933:10579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:23.050001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:23.050923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:23.052817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:23.052937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:23.052954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:23.052961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:23.052991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:23.053014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256237522265688:10402]
2025-10-01T14:13:23.053383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:23.053542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:23.053566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:23.053748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:23.053779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.053783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.053783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.053784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.053784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.053785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.053786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.053786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.053787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.053787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.053788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.053788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.053789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.053790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.053792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.053798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.053800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.053802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.053805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.053807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.053809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.053811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.053813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.053815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.053817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.053819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.053821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.053823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.053827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.053832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.053836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.053838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.053841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.053843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.053846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.053848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.053851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.053853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.053855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.053858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.053861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.053863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.053866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.053868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.053871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.053877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.053880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.053883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.053888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.053891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.053893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.053896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.053898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.053901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.053905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.053908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.053931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:23.057267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:23.057773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:23.057783Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:23.057785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:23.057786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:23.057790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1951 [2:7556256237522265688:10402]
2025-10-01T14:13:23.057799Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:23.057809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:23.057814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.057816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.057817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.057827Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:23.057833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:23.057837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:23.057866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.057870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.057872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.057874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:23.057875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:23.057914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:23.057922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.057928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.057934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.057943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:23.057953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899164812:2446], now have 1 active actors on pipe
2025-10-01T14:13:23.057956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899165089:10579], now have 1 active actors on pipe
2025-10-01T14:13:23.057960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256237522265683:10402]
2025-10-01T14:13:23.057961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256237522265683:10402]
2025-10-01T14:13:23.057963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256237522265683:10402]
2025-10-01T14:13:23.057972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:23.057980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:23.057984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:23.057985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:23.057986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:23.057991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:23.057993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:23.058006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256237522265683:10402]
2025-10-01T14:13:23.058012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:23.058019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:23.057997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1951
2025-10-01T14:13:23.058047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.058030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1951
2025-10-01T14:13:23.058053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.058071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71da08c-93ef6f8f-acb6a051-da16e93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:23.058079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.058082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.058086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:23.058092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.058097Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:23.058110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.058212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.058217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.058226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.058283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1952 partition: 0 MaxSeqNo: 45 sessionId: src_id|71da08c-93ef6f8f-acb6a051-da16e93_0
2025-10-01T14:13:23.058541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476371b3-df1fc1dd-d340cfd5-4fa89994_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|71da08c-93ef6f8f-acb6a051-da16e93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:23.060752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71da08c-93ef6f8f-acb6a051-da16e93_0] Write session: try to update token
2025-10-01T14:13:23.060765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71da08c-93ef6f8f-acb6a051-da16e93_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:23.072013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1952 sessionId: src_id|71da08c-93ef6f8f-acb6a051-da16e93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:23.074268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:23.074465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.074485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.074515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:23.074603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:23.077670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:23.077688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:23.077690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:23.077691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:23.077699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256237522265683:10402]
2025-10-01T14:13:23.077703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256237522265683:10402]
2025-10-01T14:13:23.077705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256237522265683:10402]
2025-10-01T14:13:23.077734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:23.077738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:23.077739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:23.077740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:23.077744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.077746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:23.077868Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:23.136014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256239899165114:10286]
2025-10-01T14:13:23.136250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 1951, pipe: [1:7556256239899165114:10286]
2025-10-01T14:13:23.210070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:23.216466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.216489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.216635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.216693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.216751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.216807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.216849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.216857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.216920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.216974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.217030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.217090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.217129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.217134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.217187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.217241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.217295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.217350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.217389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.217394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.217447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.217502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.217555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.217608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.217644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.217649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.217701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.217751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.217805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.217856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.217894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.217899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.217953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.218003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.218062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.218118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.218157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.218162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.218217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.218269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.218326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.218399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.218457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.218461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.218514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.218565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.218617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.218670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.218714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.218721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.218776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.218829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.218885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.218941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.218980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.218986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.219040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.219095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.219152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.219207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.219244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.219249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.219285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899165114:10286], now have 1 active actors on pipe
2025-10-01T14:13:23.219482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:23.219495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:23.219516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1952 reason: error at write: Disconnected sessionId: src_id|71da08c-93ef6f8f-acb6a051-da16e93_0
2025-10-01T14:13:23.219538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:23.219575Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256239899165114:10286]
2025-10-01T14:13:23.219704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1952 sessionId: src_id|71da08c-93ef6f8f-acb6a051-da16e93_0 is DEAD
2025-10-01T14:13:23.219841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da08c-93ef6f8f-acb6a051-da16e93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:23.219850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da08c-93ef6f8f-acb6a051-da16e93_0] Write session will restart in 0.008070s
2025-10-01T14:13:23.219868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da08c-93ef6f8f-acb6a051-da16e93_0] Write session: Do CDS request
2025-10-01T14:13:23.219874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da08c-93ef6f8f-acb6a051-da16e93_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:23.220134Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:23.228818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71da08c-93ef6f8f-acb6a051-da16e93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.228903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:23.228916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1953
2025-10-01T14:13:23.229021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.229044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:23.229051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:23.229054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:23.229347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1953 sessionId:  describe result for acl check
2025-10-01T14:13:23.229375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:23.229388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:23.229390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:23.229393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256239899165196:10584] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:23.229761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256239899165196:10584] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:23.232653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256239899165196:10584] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:23.235231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256239899165196:10584] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:23.235242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256239899165196:10584] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:23.235244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256239899165196:10584] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:23.235250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:23.235594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:23.237581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:23.237693Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:23.237701Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:23.237709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:23.237734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:23.237761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256237522265982:10407]
2025-10-01T14:13:23.238128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:23.238302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:23.238327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:23.238550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:23.238587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.238591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.238592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.238592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.238593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.238593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.238594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.238595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.238595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.238596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.238597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.238597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.238598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.238598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.238601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.238607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.238610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.238612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.238614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.238616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.238618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.238620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.238622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.238624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.238626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.238628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.238630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.238632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.238637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.238642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.238645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.238648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.238650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.238653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.238655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.238658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.238661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.238664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.238666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.238669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.238671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.238674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.238676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.238679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.238682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.238685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.238688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.238695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.238697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.238700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.238702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.238708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.238711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.238713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.238716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.238721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.238741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:23.241976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:23.242533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:23.242544Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:23.242545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:23.242547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:23.242552Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1952 [2:7556256237522265982:10407]
2025-10-01T14:13:23.242564Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:23.242574Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:23.242579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.242581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.242582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.242592Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:23.242595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:23.242599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:23.242634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.242638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.242640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.242642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:23.242643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:23.242691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:23.242696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.242703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.242712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.242724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:23.242740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899165397:10584], now have 1 active actors on pipe
2025-10-01T14:13:23.242742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899165116:2446], now have 1 active actors on pipe
2025-10-01T14:13:23.242747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256237522265977:10407]
2025-10-01T14:13:23.242752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256237522265977:10407]
2025-10-01T14:13:23.242753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256237522265977:10407]
2025-10-01T14:13:23.242762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:23.242774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:23.242775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:23.242777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:23.242778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:23.242785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:23.242788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:23.242788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1952
2025-10-01T14:13:23.242804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256237522265977:10407]
2025-10-01T14:13:23.242812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:23.242813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:23.242891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1952
2025-10-01T14:13:23.242918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.242924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.242941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:23.242946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.242948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.242950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:23.242955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.242961Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:23.242975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.243116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.243129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.243147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.243224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1953 partition: 0 MaxSeqNo: 45 sessionId: src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0
2025-10-01T14:13:23.243524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71da08c-93ef6f8f-acb6a051-da16e93_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:23.245865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0] Write session: try to update token
2025-10-01T14:13:23.245883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:23.258164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1953 sessionId: src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:23.260273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:23.260476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.260497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.260537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:23.260606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:23.262995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:23.263011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:23.263012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:23.263014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:23.263021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256237522265977:10407]
2025-10-01T14:13:23.263024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256237522265977:10407]
2025-10-01T14:13:23.263026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256237522265977:10407]
2025-10-01T14:13:23.263061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:23.263071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.263070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:23.263072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:23.263076Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:23.263079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:23.263183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:23.319836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256239899165410:10286]
2025-10-01T14:13:23.320047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 1952, pipe: [1:7556256239899165410:10286]
2025-10-01T14:13:23.398231Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:23.404735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.404758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.404886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.404939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.404993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.405046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.405086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.405092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.405149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.405200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.405256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.405312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.405351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.405356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.405408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.405457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.405505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.405554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.405590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.405595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.405648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.405699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.405749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.405797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.405836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.405841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.405890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.405939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.405990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.406041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.406081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.406086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.406138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.406186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.406238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.406292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.406329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.406334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.406401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.406459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.406515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.406566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.406608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.406613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.406667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.406715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.406765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.406817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.406855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.406860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.406914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.406966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.407018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.407070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.407107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.407112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.407167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.407217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.407270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.407321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.407357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.407364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.407401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899165410:10286], now have 1 active actors on pipe
2025-10-01T14:13:23.407615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:23.407619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:23.407622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:23.407644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1953 reason: error at write: Disconnected sessionId: src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0
2025-10-01T14:13:23.407657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256239899165410:10286]
2025-10-01T14:13:23.407794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1953 sessionId: src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0 is DEAD
2025-10-01T14:13:23.407944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:23.407965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0] Write session will restart in 0.005290s
2025-10-01T14:13:23.407987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0] Write session: Do CDS request
2025-10-01T14:13:23.407993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:23.408124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:23.414772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.414827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:23.414837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1954
2025-10-01T14:13:23.414918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.414940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:23.414945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:23.414948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:23.415234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1954 sessionId:  describe result for acl check
2025-10-01T14:13:23.415255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:23.415256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:23.415257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:23.415260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256239899165467:10588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:23.415648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256239899165467:10588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:23.417761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256239899165467:10588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:23.420025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256239899165467:10588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:23.420034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256239899165467:10588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:23.420037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256239899165467:10588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:23.420041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:23.422972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:23.425261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:23.425380Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:23.425388Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:23.425395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:23.425433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:23.425460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256237522266309:10416]
2025-10-01T14:13:23.425823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:23.425990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:23.426015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:23.426200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:23.426231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.426236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.426237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.426237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.426238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.426239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.426239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.426240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.426241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.426241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.426242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.426242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.426243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.426243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.426246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.426252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.426254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.426256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.426258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.426261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.426263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.426265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.426267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.426269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.426271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.426274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.426276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.426278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.426282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.426287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.426290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.426294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.426296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.426299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.426301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.426304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.426306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.426309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.426311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.426318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.426321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.426324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.426329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.426332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.426334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.426337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.426340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.426343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.426347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.426350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.426352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.426355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.426357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.426360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.426362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.426365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.426397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:23.429563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:23.430088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:23.430101Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:23.430102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:23.430105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:23.430110Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1953 [2:7556256237522266309:10416]
2025-10-01T14:13:23.430121Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:23.430135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:23.430141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.430143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.430145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.430155Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:23.430162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:23.430167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:23.430204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.430209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.430210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.430212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:23.430214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:23.430257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:23.430262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.430269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.430275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.430287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:23.430302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899165619:10588], now have 1 active actors on pipe
2025-10-01T14:13:23.430308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899165416:2446], now have 1 active actors on pipe
2025-10-01T14:13:23.430313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256237522266304:10416]
2025-10-01T14:13:23.430318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256237522266304:10416]
2025-10-01T14:13:23.430319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256237522266304:10416]
2025-10-01T14:13:23.430328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:23.430340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:23.430341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:23.430343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:23.430344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:23.430351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:23.430353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:23.430394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256237522266304:10416]
2025-10-01T14:13:23.430400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:23.430358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1953
2025-10-01T14:13:23.430402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:23.430362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1953
2025-10-01T14:13:23.430421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.430427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.430449Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|515681df-84709019-383a2080-c4926349_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:23.430457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.430460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.430461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:23.430467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.430473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:23.430488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.430593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.430600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.430610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.430673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1954 partition: 0 MaxSeqNo: 45 sessionId: src_id|515681df-84709019-383a2080-c4926349_0
2025-10-01T14:13:23.430941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34044bf-fbd0ca2f-b9397a23-7fd557d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|515681df-84709019-383a2080-c4926349_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:23.433046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|515681df-84709019-383a2080-c4926349_0] Write session: try to update token
2025-10-01T14:13:23.433057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|515681df-84709019-383a2080-c4926349_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:23.444607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1954 sessionId: src_id|515681df-84709019-383a2080-c4926349_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:23.446796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:23.446964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.446986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.447017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:23.447091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:23.449857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:23.449876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:23.449877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:23.449878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:23.449886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256237522266304:10416]
2025-10-01T14:13:23.449890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256237522266304:10416]
2025-10-01T14:13:23.449892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256237522266304:10416]
2025-10-01T14:13:23.449930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:23.449932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:23.449936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:23.449938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:23.449939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.449941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:23.450071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:23.507688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256239899165731:10286]
2025-10-01T14:13:23.507820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 1953, pipe: [1:7556256239899165731:10286]
2025-10-01T14:13:23.577113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:23.579460Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 19 CurrentSessionLifetimeMs: 421597 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:13:23.583517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.583541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.583676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.583731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.583789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.583844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.583886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.583894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.583950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.584003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.584060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.584114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.584355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.584365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.584417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.584468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.584521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.584575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.584620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.584625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.584677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.584731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.584783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.584835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.584871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.584876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.584927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.585044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.585097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.585150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.585188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.585193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.585246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.585296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.585348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.585401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.585458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.585463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.585514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.585563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.585615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.585666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.585718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.585723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.585775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.585826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.585880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.585936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.585973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.585978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.586033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.586085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.586139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.586189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.586229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.586235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.586288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.586340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.586407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.586459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.586494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.586499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.586533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899165731:10286], now have 1 active actors on pipe
2025-10-01T14:13:23.586743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:23.586754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:23.586765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:23.586775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1954 reason: error at write: Disconnected sessionId: src_id|515681df-84709019-383a2080-c4926349_0
2025-10-01T14:13:23.586805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256239899165731:10286]
2025-10-01T14:13:23.586922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1954 sessionId: src_id|515681df-84709019-383a2080-c4926349_0 is DEAD
2025-10-01T14:13:23.587064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515681df-84709019-383a2080-c4926349_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:23.587074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515681df-84709019-383a2080-c4926349_0] Write session will restart in 0.009446s
2025-10-01T14:13:23.587096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515681df-84709019-383a2080-c4926349_0] Write session: Do CDS request
2025-10-01T14:13:23.587101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515681df-84709019-383a2080-c4926349_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:23.587252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:23.597715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|515681df-84709019-383a2080-c4926349_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.597808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:23.597818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1955
2025-10-01T14:13:23.597909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.597931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:23.597939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:23.597942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:23.598227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1955 sessionId:  describe result for acl check
2025-10-01T14:13:23.598253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:23.598259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:23.598261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:23.598263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256239899165908:10594] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:23.598664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256239899165908:10594] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:23.600645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256239899165908:10594] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:23.604038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:23.604144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256239899165908:10594] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:23.604154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256239899165908:10594] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:23.604156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256239899165908:10594] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:23.604160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:23.604365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:23.604513Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:23.604521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:23.604528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:23.604558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:23.604582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256237522266596:10422]
2025-10-01T14:13:23.604952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:23.605148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:23.605175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:23.605375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:23.605410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.605414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.605415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.605416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.605416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.605417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.605418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.605418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.605419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.605420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.605420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.605421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.605421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.605422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.605425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.605430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.605432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.605434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.605436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.605438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.605440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.605442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.605444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.605446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.605448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.605450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.605452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.605454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.605459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.605463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.605467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.605470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.605472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.605475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.605477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.605480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.605482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.605485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.605487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.605490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.605492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.605495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.605497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.605500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.605502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.605505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.605507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.605510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.605512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.605515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.605517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.605520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.605523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.605526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.605528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.605530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.605549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:23.608679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:23.609265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:23.609279Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:23.609281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:23.609283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:23.609287Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1954 [2:7556256237522266596:10422]
2025-10-01T14:13:23.609296Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:23.609310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:23.609314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.609317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.609318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.609328Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:23.609334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:23.609338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:23.609371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.609376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.609377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.609379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:23.609381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:23.609422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:23.609427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.609434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.609442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.609454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:23.609469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899165733:2446], now have 1 active actors on pipe
2025-10-01T14:13:23.609474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899166016:10594], now have 1 active actors on pipe
2025-10-01T14:13:23.609478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256237522266590:10422]
2025-10-01T14:13:23.609480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256237522266590:10422]
2025-10-01T14:13:23.609481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256237522266590:10422]
2025-10-01T14:13:23.609489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:23.609497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:23.609504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:23.609493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1954
2025-10-01T14:13:23.609509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:23.609509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:23.609505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1954
2025-10-01T14:13:23.609511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:23.609513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:23.609537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.609542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.609551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256237522266590:10422]
2025-10-01T14:13:23.609559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:23.609568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:23.609578Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:23.609582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.609584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.609586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:23.609591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.609597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:23.609616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.609734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.609741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.609754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.609832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1955 partition: 0 MaxSeqNo: 45 sessionId: src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0
2025-10-01T14:13:23.610091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|515681df-84709019-383a2080-c4926349_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:23.612328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0] Write session: try to update token
2025-10-01T14:13:23.612341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:23.623728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1955 sessionId: src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:23.625832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:23.626022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.626042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.626080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:23.626152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:23.627839Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:23.627854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:23.627856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:23.627857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:23.627863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256237522266590:10422]
2025-10-01T14:13:23.627868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256237522266590:10422]
2025-10-01T14:13:23.627870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256237522266590:10422]
2025-10-01T14:13:23.627896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:23.627902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:23.627906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:23.627906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.627908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:23.627909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:23.628017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:23.686944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256239899166029:10286]
2025-10-01T14:13:23.687146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 1954, pipe: [1:7556256239899166029:10286]
2025-10-01T14:13:23.757351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:23.763762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.763788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.763922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.763971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.764026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.764078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.764117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.764124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.764180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.764230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.764284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.764339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.764377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.764383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.764436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.764481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.764529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.764574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.764629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.764634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.764686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.764733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.764780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.764827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.764863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.764867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.764918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.764965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.765010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.765057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.765093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.765098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.765148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.765193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.765243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.765294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.765383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.765390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.765439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.765485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.765534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.765583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.765617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.765622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.765670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.765717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.765765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.765813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.765850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.765856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.765902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.765949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.765999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.766047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.766082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.766087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.766136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.766184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.766233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.766281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.766330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.766335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.766380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899166029:10286], now have 1 active actors on pipe
2025-10-01T14:13:23.766584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:23.766591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256239899166029:10286]
2025-10-01T14:13:23.766612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:23.766614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:23.766633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1955 reason: error at write: Disconnected sessionId: src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0
2025-10-01T14:13:23.766799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1955 sessionId: src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0 is DEAD
2025-10-01T14:13:23.766922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:23.766931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0] Write session will restart in 0.006038s
2025-10-01T14:13:23.766949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0] Write session: Do CDS request
2025-10-01T14:13:23.766953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:23.767242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:23.773711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.773822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:23.773832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1956
2025-10-01T14:13:23.773913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.773935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:23.773942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:23.773947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:23.774209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1956 sessionId:  describe result for acl check
2025-10-01T14:13:23.774233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:23.774236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:23.774237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:23.774240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256239899166105:10598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:23.774649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256239899166105:10598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:23.776534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256239899166105:10598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:23.779047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256239899166105:10598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:23.779055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256239899166105:10598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:23.779057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256239899166105:10598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:23.779061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:23.780861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:23.782909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:23.783015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:23.783022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:23.783029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:23.783055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:23.783083Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256237522266886:10425]
2025-10-01T14:13:23.783424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:23.783604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:23.783625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:23.783799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:23.783827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.783831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.783832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.783832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.783833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.783833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.783834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.783834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.783835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.783835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.783836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.783837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.783837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.783838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.783840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.783846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.783848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.783850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.783852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.783854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.783856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.783858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.783860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.783862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.783864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.783866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.783867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.783869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.783874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.783877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.783881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.783884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.783886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.783889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.783891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.783894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.783896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.783899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.783904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.783907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.783910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.783915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.783917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.783920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.783922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.783925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.783927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.783930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.783932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.783935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.783938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.783940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.783942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.783949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.783951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.783954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.783975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:23.787047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:23.787602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:23.787613Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:23.787614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:23.787616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:23.787620Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1955 [2:7556256237522266886:10425]
2025-10-01T14:13:23.787628Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:23.787640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:23.787642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.787644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.787645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.787655Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:23.787661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:23.787664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:23.787692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.787696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.787697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.787700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:23.787702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:23.787743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:23.787748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.787754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.787759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.787767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:23.787779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899166286:10598], now have 1 active actors on pipe
2025-10-01T14:13:23.787787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256237522266881:10425]
2025-10-01T14:13:23.787788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256237522266881:10425]
2025-10-01T14:13:23.787790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256237522266881:10425]
2025-10-01T14:13:23.787799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:23.787807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899166030:2446], now have 1 active actors on pipe
2025-10-01T14:13:23.787808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:23.787810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:23.787811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:23.787812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:23.787820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:23.787824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:23.787839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256237522266881:10425]
2025-10-01T14:13:23.787843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:23.787833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1955
2025-10-01T14:13:23.787838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1955
2025-10-01T14:13:23.787861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:23.787868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.787871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.787887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|677525d2-543f580c-e5fee587-927faa8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:23.787895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.787901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.787903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:23.787908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.787915Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:23.787924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.788058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.788063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.788072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.788147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1956 partition: 0 MaxSeqNo: 45 sessionId: src_id|677525d2-543f580c-e5fee587-927faa8_0
2025-10-01T14:13:23.788404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1143461-89b1aa74-d2e067ed-a2116dc1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|677525d2-543f580c-e5fee587-927faa8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:23.790713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|677525d2-543f580c-e5fee587-927faa8_0] Write session: try to update token
2025-10-01T14:13:23.790726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|677525d2-543f580c-e5fee587-927faa8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:23.797479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:23.797495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:23.797501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256237522266881:10425]
2025-10-01T14:13:23.797528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:23.797529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:23.797663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:23.797774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:23.797882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:23.797999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:23.798156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:23.798181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:23.801683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1956 sessionId: src_id|677525d2-543f580c-e5fee587-927faa8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:23.803662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:23.804371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.804385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.804407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:23.804474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:23.815938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:23.815955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:23.815956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:23.815957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:23.815966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256237522266881:10425]
2025-10-01T14:13:23.815968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256237522266881:10425]
2025-10-01T14:13:23.815983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256237522266881:10425]
2025-10-01T14:13:23.816016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:23.816017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:23.816021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:23.816024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.816024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:23.816025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:23.816130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:23.866649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256239899166328:10286]
2025-10-01T14:13:23.866874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 1955, pipe: [1:7556256239899166328:10286]
2025-10-01T14:13:23.943801Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:23.950015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.950040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.950174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.950230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.950285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.950340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.950402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.950413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.950477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.950526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.950578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.950631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.950669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.950674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.950726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.950773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.950881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.950935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.950972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.950977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.951030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.951082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.951131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.951179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.951216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.951221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.951268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.951315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.951364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.951412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.951447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.951452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.951504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.951553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.951605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.951655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.951692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.951697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.951749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.951798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.951849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.951897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.951935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.951940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.951992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.952041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.952092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.952140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.952177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.952182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.952233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.952281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.952329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.952376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.952412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.952416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.952463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:23.952507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:23.952556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:23.952603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:23.952671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:23.952677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:23.952713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899166328:10286], now have 1 active actors on pipe
2025-10-01T14:13:23.952865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256239899166328:10286]
2025-10-01T14:13:23.952890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:23.952898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:23.952902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:23.952921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1956 reason: error at write: Disconnected sessionId: src_id|677525d2-543f580c-e5fee587-927faa8_0
2025-10-01T14:13:23.953082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1956 sessionId: src_id|677525d2-543f580c-e5fee587-927faa8_0 is DEAD
2025-10-01T14:13:23.953226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677525d2-543f580c-e5fee587-927faa8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:23.953236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677525d2-543f580c-e5fee587-927faa8_0] Write session will restart in 0.007184s
2025-10-01T14:13:23.953255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677525d2-543f580c-e5fee587-927faa8_0] Write session: Do CDS request
2025-10-01T14:13:23.953260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677525d2-543f580c-e5fee587-927faa8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:23.953549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:23.961768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|677525d2-543f580c-e5fee587-927faa8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.961879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:23.961894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1957
2025-10-01T14:13:23.962000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:23.962033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:23.962046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:23.962053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:23.962485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1957 sessionId:  describe result for acl check
2025-10-01T14:13:23.962520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:23.962521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:23.962523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:23.962528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256239899166455:10603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:23.963007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256239899166455:10603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:23.965474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256239899166455:10603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:23.967220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:23.967519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256239899166455:10603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:23.967538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256239899166455:10603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:23.967540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256239899166455:10603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:23.967545Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:23.970723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:23.971047Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:23.971063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:23.971079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:23.971148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:23.971185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256237522267175:10427]
2025-10-01T14:13:23.971727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:23.972029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:23.972080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:23.972370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:23.972433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.972439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.972441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.972441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.972442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.972443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.972444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.972445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.972446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.972447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.972448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.972449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.972450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.972451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.972456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.972465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.972468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.972471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.972474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.972478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.972481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.972489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.972492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.972499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.972503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.972510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.972513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.972520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.972526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.972537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:23.972547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.972551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:23.972559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.972567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:23.972575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.972580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:23.972585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.972593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:23.972597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.972603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:23.972618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.972627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:23.972633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.972641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:23.972646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.972654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:23.972659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.972667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.972672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.972679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.972686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.972690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.972698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.972702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:23.972710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.972715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:23.972752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:23.975993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:23.976569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:23.976586Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:23.976589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:23.976592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:23.976598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1956 [2:7556256237522267175:10427]
2025-10-01T14:13:23.976621Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:23.976638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:23.976645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.976648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.976652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.976666Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:23.976675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:23.976685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:23.976740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.976746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.976748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.976751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:23.976753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:23.976809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:23.976819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.976829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:23.976840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:23.976856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:23.976872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899166619:10603], now have 1 active actors on pipe
2025-10-01T14:13:23.976880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256239899166335:2446], now have 1 active actors on pipe
2025-10-01T14:13:23.976887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256237522267169:10427]
2025-10-01T14:13:23.976889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256237522267169:10427]
2025-10-01T14:13:23.976891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256237522267169:10427]
2025-10-01T14:13:23.976903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:23.976913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:23.976920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:23.976921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:23.976922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:23.976933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:23.976939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:23.976923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1956
2025-10-01T14:13:23.976924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1956
2025-10-01T14:13:23.976959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256237522267169:10427]
2025-10-01T14:13:23.976967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:23.976970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:23.976988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.976997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.977044Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:23.977055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:23.977059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:23.977061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:23.977069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:23.977079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:23.977100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.977187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.977197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.977212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:23.977283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1957 partition: 0 MaxSeqNo: 45 sessionId: src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0
2025-10-01T14:13:23.977551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|677525d2-543f580c-e5fee587-927faa8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:23.979820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0] Write session: try to update token
2025-10-01T14:13:23.979833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:23.991229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1957 sessionId: src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:23.993240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:23.993411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:23.993429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:23.993458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:23.993549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:23.995150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:23.995166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:23.995168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:23.995169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:23.995176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256237522267169:10427]
2025-10-01T14:13:23.995179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256237522267169:10427]
2025-10-01T14:13:23.995182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256237522267169:10427]
2025-10-01T14:13:23.995218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:23.995223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:23.995226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:23.995227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:23.995228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:23.995230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:23.995333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:24.053046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256244194133926:10286]
2025-10-01T14:13:24.053298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 1956, pipe: [1:7556256244194133926:10286]
2025-10-01T14:13:24.124288Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:24.130627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.130649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.130779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.130829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.130879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.130934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.130973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.130980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.131032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.131083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.131135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.131185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.131223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.131228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.131278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.131324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.131373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.131423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.131457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.131462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.131510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.131555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.131599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.131644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.131679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.131687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.131733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.131779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.131824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.131871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.131906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.131910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.131971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.132018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.132068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.132120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.132157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.132163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.132212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.132260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.132309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.132357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.132393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.132398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.132443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.132520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.132570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.132637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.132731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.132736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.132785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.132832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.132879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.132930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.132964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.132969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.133019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.133066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.133116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.133165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.133201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.133205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.133237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194133926:10286], now have 1 active actors on pipe
2025-10-01T14:13:24.133426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256244194133926:10286]
2025-10-01T14:13:24.133427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:24.133430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:24.133453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:24.133456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1957 reason: error at write: Disconnected sessionId: src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0
2025-10-01T14:13:24.133613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1957 sessionId: src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0 is DEAD
2025-10-01T14:13:24.133731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:24.133738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0] Write session will restart in 0.007203s
2025-10-01T14:13:24.133756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0] Write session: Do CDS request
2025-10-01T14:13:24.133761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:24.133867Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:24.141775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.141857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:24.141869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1958
2025-10-01T14:13:24.141947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.141975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:24.141984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:24.141988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:24.142293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1958 sessionId:  describe result for acl check
2025-10-01T14:13:24.142318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:24.142322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:24.142323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:24.142326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256244194134045:10614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:24.142721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256244194134045:10614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:24.144264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256244194134045:10614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:24.146774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256244194134045:10614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:24.146786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256244194134045:10614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:24.146789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256244194134045:10614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:24.146794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:24.148193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:24.150518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:24.150637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:24.150645Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:24.150652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:24.150679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:24.150705Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256241817234772:10432]
2025-10-01T14:13:24.151056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:24.151261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:24.151285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:24.151460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:24.151490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.151494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.151495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.151496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.151496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.151497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.151497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.151498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.151498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.151499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.151500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.151500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.151501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.151501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.151504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.151510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.151512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.151514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.151516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.151518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.151520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.151522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.151524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.151526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.151528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.151530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.151532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.151533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.151538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.151542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.151545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.151548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.151550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.151552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.151554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.151557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.151559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.151562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.151564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.151567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.151569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.151571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.151574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.151576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.151578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.151581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.151583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.151586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.151590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.151593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.151595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.151599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.151602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.151607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.151610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.151612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.151631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:24.154740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:24.155301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:24.155312Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:24.155313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:24.155315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:24.155319Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1957 [2:7556256241817234772:10432]
2025-10-01T14:13:24.155328Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:24.155342Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:24.155346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.155348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.155349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.155359Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:24.155365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:24.155369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:24.155400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.155404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.155405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.155407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:24.155409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:24.155452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:24.155457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.155463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.155472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.155480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:24.155492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194134233:10614], now have 1 active actors on pipe
2025-10-01T14:13:24.155498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194133953:2446], now have 1 active actors on pipe
2025-10-01T14:13:24.155502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256241817234767:10432]
2025-10-01T14:13:24.155503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256241817234767:10432]
2025-10-01T14:13:24.155504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256241817234767:10432]
2025-10-01T14:13:24.155513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:24.155521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:24.155526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:24.155528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:24.155529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:24.155532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:24.155533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:24.155526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1957
2025-10-01T14:13:24.155547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256241817234767:10432]
2025-10-01T14:13:24.155536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1957
2025-10-01T14:13:24.155553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:24.155554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:24.155570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.155576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.155595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:24.155603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.155608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.155609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:24.155613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.155621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:24.155635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.155723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.155729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.155737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.155817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1958 partition: 0 MaxSeqNo: 45 sessionId: src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0
2025-10-01T14:13:24.156080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702cccbf-a5bf9959-6569f56f-f0cd6025_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:24.158309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0] Write session: try to update token
2025-10-01T14:13:24.158321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:24.169364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1958 sessionId: src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:24.171456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:24.171632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.171652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.171683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:24.171757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:24.174291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:24.174305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:24.174307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:24.174308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:24.174315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256241817234767:10432]
2025-10-01T14:13:24.174318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256241817234767:10432]
2025-10-01T14:13:24.174322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256241817234767:10432]
2025-10-01T14:13:24.174356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:24.174362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.174363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:24.174393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:24.174401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:24.174405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:24.174488Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:24.233785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256244194134248:10286]
2025-10-01T14:13:24.234030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 1957, pipe: [1:7556256244194134248:10286]
2025-10-01T14:13:24.302015Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:24.308565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.308589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.308737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.308793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.308855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.308911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.308952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.308960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.309019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.309074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.309131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.309190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.309230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.309235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.309292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.309345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.309400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.309451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.309490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.309495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.309549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.309603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.309656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.309708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.309745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.309750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.309804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.309855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.309906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.309958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.309997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.310002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.310057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.310109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.310166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.310223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.310262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.310267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.310320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.310385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.310439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.310493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.310532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.310537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.310593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.310646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.310701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.310757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.310796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.310801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.310855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.310907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.310967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.311022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.311065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.311069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.311123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.311179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.311233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.311289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.311326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.311331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.311368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194134248:10286], now have 1 active actors on pipe
2025-10-01T14:13:24.311571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:24.311585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:24.311590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256244194134248:10286]
2025-10-01T14:13:24.311605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1958 reason: error at write: Disconnected sessionId: src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0
2025-10-01T14:13:24.311612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:24.311776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1958 sessionId: src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0 is DEAD
2025-10-01T14:13:24.311911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:24.311920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0] Write session will restart in 0.005534s
2025-10-01T14:13:24.311939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0] Write session: Do CDS request
2025-10-01T14:13:24.311944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:24.312229Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:24.318723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.318787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:24.318799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1959
2025-10-01T14:13:24.318887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.318914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:24.318924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:24.318927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:24.319254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1959 sessionId:  describe result for acl check
2025-10-01T14:13:24.319281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:24.319287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:24.319289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:24.319293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256244194134303:10618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:24.319723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256244194134303:10618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:24.321980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256244194134303:10618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:24.324981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256244194134303:10618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:24.324992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256244194134303:10618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:24.324994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256244194134303:10618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:24.324999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:24.327360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:24.329326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:24.329533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:24.329541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:24.329550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:24.329586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:24.329611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256241817235075:10435]
2025-10-01T14:13:24.329966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:24.330144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:24.330167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:24.330361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:24.330408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.330413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.330413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.330414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.330415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.330415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.330416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.330416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.330417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.330418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.330418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.330419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.330419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.330420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.330423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.330429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.330431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.330433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.330435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.330437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.330439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.330441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.330443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.330445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.330447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.330449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.330451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.330453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.330457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.330461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.330465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.330468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.330470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.330473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.330475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.330478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.330480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.330483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.330485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.330488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.330490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.330493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.330495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.330498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.330500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.330503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.330505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.330508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.330510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.330512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.330514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.330517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.330519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.330521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.330525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.330527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.330548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:24.333664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:24.334255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:24.334272Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:24.334274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:24.334277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:24.334283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1958 [2:7556256241817235075:10435]
2025-10-01T14:13:24.334291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:24.334300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:24.334302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.334304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.334306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.334316Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:24.334323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:24.334327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:24.334360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.334365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.334366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.334368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:24.334382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:24.334429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:24.334436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.334445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.334458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.334475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:24.334494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194134510:10618], now have 1 active actors on pipe
2025-10-01T14:13:24.334501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194134251:2446], now have 1 active actors on pipe
2025-10-01T14:13:24.334507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256241817235070:10435]
2025-10-01T14:13:24.334513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256241817235070:10435]
2025-10-01T14:13:24.334515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256241817235070:10435]
2025-10-01T14:13:24.334525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:24.334536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:24.334537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:24.334539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:24.334543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:24.334555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:24.334557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:24.334546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1958
2025-10-01T14:13:24.334548Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1958
2025-10-01T14:13:24.334575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256241817235070:10435]
2025-10-01T14:13:24.334581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:24.334582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:24.334593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.334601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.334638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:24.334651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.334654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.334656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:24.334663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.334670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:24.334685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.334799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.334807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.334820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.334878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1959 partition: 0 MaxSeqNo: 45 sessionId: src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0
2025-10-01T14:13:24.335183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fe2bde3-bdbd7775-3ae5a600-d99d968c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:24.337258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0] Write session: try to update token
2025-10-01T14:13:24.337270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:24.348318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1959 sessionId: src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:24.350179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:24.350354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.350387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.350418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:24.350494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:24.352768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:24.352784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:24.352785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:24.352787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:24.352793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256241817235070:10435]
2025-10-01T14:13:24.352797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256241817235070:10435]
2025-10-01T14:13:24.352799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256241817235070:10435]
2025-10-01T14:13:24.352837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:24.352838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:24.352845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.352847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:24.352847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:24.352850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:24.352965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:24.411926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256244194134550:10286]
2025-10-01T14:13:24.412156Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 1958, pipe: [1:7556256244194134550:10286]
2025-10-01T14:13:24.481421Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:24.488057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.488080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.488215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.488275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.488335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.488392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.488438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.488445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.488503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.488556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.488620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.488676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.488714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.488720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.488770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.488822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.488875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.488928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.488965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.488970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.489021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.489071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.489124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.489175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.489212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.489217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.489270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.489324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.489373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.489423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.489457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.489462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.489512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.489561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.489615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.489677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.489713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.489720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.489772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.489821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.489874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.489927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.489964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.489969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.490019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.490069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.490119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.490172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.490211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.490216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.490267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.490317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.490384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.490439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.490474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.490481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.490533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.490601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.490655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.490706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.490743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.490748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.490781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194134550:10286], now have 1 active actors on pipe
2025-10-01T14:13:24.491028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:24.491031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256244194134550:10286]
2025-10-01T14:13:24.491041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:24.491048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:24.491061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1959 reason: error at write: Disconnected sessionId: src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0
2025-10-01T14:13:24.491231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1959 sessionId: src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0 is DEAD
2025-10-01T14:13:24.491351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:24.491357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0] Write session will restart in 0.005870s
2025-10-01T14:13:24.491385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0] Write session: Do CDS request
2025-10-01T14:13:24.491390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:24.491440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:24.497739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.497824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:24.497839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1960
2025-10-01T14:13:24.497935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.497964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:24.497986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:24.497989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:24.498502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1960 sessionId:  describe result for acl check
2025-10-01T14:13:24.498531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:24.498535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:24.498536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:24.498539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256244194134594:10623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:24.498896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256244194134594:10623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:24.501137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256244194134594:10623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:24.504184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256244194134594:10623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:24.504193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256244194134594:10623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:24.504195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256244194134594:10623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:24.504199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:24.506879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:24.508960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:24.509082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:24.509090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:24.509098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:24.509126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:24.509150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256241817235396:10447]
2025-10-01T14:13:24.509532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:24.509725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:24.509753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:24.509950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:24.509983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.509987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.509987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.509988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.509988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.509989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.509989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.509990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.509990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.509991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.509992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.509992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.509992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.509993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.509996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.510001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.510003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.510005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.510007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.510009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.510011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.510013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.510015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.510017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.510019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.510021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.510023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.510025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.510029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.510033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.510037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.510039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.510041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.510044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.510046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.510049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.510051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.510054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.510056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.510058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.510061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.510068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.510070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.510073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.510078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.510081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.510083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.510085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.510089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.510095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.510097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.510100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.510105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.510108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.510110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.510113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.510135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:24.513264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:24.513816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:24.513829Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:24.513830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:24.513833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:24.513837Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1959 [2:7556256241817235396:10447]
2025-10-01T14:13:24.513847Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:24.513859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:24.513861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.513865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.513867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.513880Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:24.513891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:24.513897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:24.513933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.513938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.513939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.513942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:24.513943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:24.513997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:24.514004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.514013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.514026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.514043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:24.514061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194134558:2446], now have 1 active actors on pipe
2025-10-01T14:13:24.514070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194134784:10623], now have 1 active actors on pipe
2025-10-01T14:13:24.514075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256241817235391:10447]
2025-10-01T14:13:24.514077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256241817235391:10447]
2025-10-01T14:13:24.514078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256241817235391:10447]
2025-10-01T14:13:24.514088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:24.514099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:24.514100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1959
2025-10-01T14:13:24.514100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:24.514101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1959
2025-10-01T14:13:24.514101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:24.514103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:24.514112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:24.514115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:24.514133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256241817235391:10447]
2025-10-01T14:13:24.514135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:24.514136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:24.514149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.514152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.514190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:24.514201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.514205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.514207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:24.514215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.514222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:24.514240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.514341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.514348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.514362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.514458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1960 partition: 0 MaxSeqNo: 45 sessionId: src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0
2025-10-01T14:13:24.514744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8aedc12f-31595fdd-1919a6bb-483a91d5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:24.516863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0] Write session: try to update token
2025-10-01T14:13:24.516875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:24.527920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1960 sessionId: src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:24.529882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:24.530086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.530105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.530135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:24.530207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:24.532541Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:24.532558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:24.532561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:24.532562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:24.532569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256241817235391:10447]
2025-10-01T14:13:24.532574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256241817235391:10447]
2025-10-01T14:13:24.532578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256241817235391:10447]
2025-10-01T14:13:24.532623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:24.532632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.532632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:24.532634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:24.532637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:24.532643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:24.532751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:24.591121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256244194134873:10286]
2025-10-01T14:13:24.591323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 1959, pipe: [1:7556256244194134873:10286]
2025-10-01T14:13:24.664848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:24.671180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.671205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.671340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.671395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.671452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.671507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.671546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.671554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.671609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.671662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.671719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.671772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.671809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.671814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.671864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.671914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.671970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.672023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.672061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.672067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.672123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.672174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.672224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.672274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.672311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.672316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.672369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.672418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.672470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.672522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.672558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.672566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.672624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.672674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.672727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.672781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.672818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.672823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.672874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.672923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.672975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.673029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.673068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.673073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.673124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.673174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.673223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.673275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.673311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.673317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.673368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.673418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.673474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.673526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.673561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.673566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.673618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.673667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.673723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.673777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.673813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.673817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.673851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194134873:10286], now have 1 active actors on pipe
2025-10-01T14:13:24.674058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:24.674087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:24.674090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:24.674103Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256244194134873:10286]
2025-10-01T14:13:24.674119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1960 reason: error at write: Disconnected sessionId: src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0
2025-10-01T14:13:24.674296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1960 sessionId: src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0 is DEAD
2025-10-01T14:13:24.674418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:24.674426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0] Write session will restart in 0.005634s
2025-10-01T14:13:24.674448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0] Write session: Do CDS request
2025-10-01T14:13:24.674452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:24.674516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:24.680741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.680838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:24.680847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1961
2025-10-01T14:13:24.680928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.680949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:24.680956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:24.680958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:24.681332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1961 sessionId:  describe result for acl check
2025-10-01T14:13:24.681356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:24.681360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:24.681361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:24.681365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256244194134919:10628] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:24.681714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256244194134919:10628] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:24.683963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256244194134919:10628] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:24.686910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256244194134919:10628] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:24.686923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256244194134919:10628] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:24.686928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256244194134919:10628] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:24.686932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:24.689611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:24.691753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:24.691921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:24.691933Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:24.691944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:24.691994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:24.692028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256241817235691:10450]
2025-10-01T14:13:24.692596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:24.692830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:24.692871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:24.693153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:24.693210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.693217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.693218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.693219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.693220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.693221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.693222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.693223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.693224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.693225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.693226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.693227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.693228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.693229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.693234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.693244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.693248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.693252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.693260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.693263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.693267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.693271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.693278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.693282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.693290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.693293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.693301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.693304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.693315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.693327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.693337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.693346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.693354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.693359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.693367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.693372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.693380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.693386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.693394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.693403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.693411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.693419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.693427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.693435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.693442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.693451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.693459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.693463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.693471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.693480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.693488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.693496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.693504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.693509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.693516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.693521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.693561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:24.696749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:24.697322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:24.697338Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:24.697340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:24.697344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:24.697350Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1960 [2:7556256241817235691:10450]
2025-10-01T14:13:24.697363Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:24.697382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:24.697389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.697392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.697398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.697412Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:24.697423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:24.697433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:24.697484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.697491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.697494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.697497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:24.697499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:24.697555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:24.697562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.697573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.697583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.697603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:24.697623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194135099:10628], now have 1 active actors on pipe
2025-10-01T14:13:24.697631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194134876:2446], now have 1 active actors on pipe
2025-10-01T14:13:24.697642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256241817235686:10450]
2025-10-01T14:13:24.697650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256241817235686:10450]
2025-10-01T14:13:24.697651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256241817235686:10450]
2025-10-01T14:13:24.697665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:24.697670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:24.697672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:24.697673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:24.697687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:24.697700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:24.697703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:24.697672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1960
2025-10-01T14:13:24.697682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1960
2025-10-01T14:13:24.697733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.697743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.697759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256241817235686:10450]
2025-10-01T14:13:24.697770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:24.697773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:24.697790Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:24.697801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.697804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.697809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:24.697816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.697824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:24.697854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.697961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.697971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.697985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.698064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1961 partition: 0 MaxSeqNo: 45 sessionId: src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0
2025-10-01T14:13:24.698361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4415d47-4e6c1ade-f6d9ccc5-86b67017_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:24.700512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0] Write session: try to update token
2025-10-01T14:13:24.700527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:24.711862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1961 sessionId: src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:24.713913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:24.714070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.714093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.714128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:24.714194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:24.717271Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:24.717290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:24.717291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:24.717293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:24.717299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256241817235686:10450]
2025-10-01T14:13:24.717303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256241817235686:10450]
2025-10-01T14:13:24.717305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256241817235686:10450]
2025-10-01T14:13:24.717339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:24.717341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:24.717344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.717346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:24.717346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:24.717348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:24.717460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:24.774447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256244194135177:10286]
2025-10-01T14:13:24.774643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 1960, pipe: [1:7556256244194135177:10286]
2025-10-01T14:13:24.848683Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:24.855114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.855135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.855270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.855323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.855380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.855436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.855475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.855482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.855540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.855594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.855647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.855703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.855742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.855750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.855800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.855847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.855900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.855951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.855989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.855994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.856044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.856095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.856149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.856202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.856240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.856245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.856307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.856363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.856415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.856467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.856503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.856508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.856563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.856623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.856678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.856734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.856771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.856776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.856830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.856880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.856935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.856987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.857027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.857033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.857084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.857136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.857188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.857238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.857275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.857280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.857333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.857396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.857449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.857502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.857539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.857544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.857598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:24.857650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:24.857704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:24.857756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:24.857792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:24.857797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:24.857832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194135177:10286], now have 1 active actors on pipe
2025-10-01T14:13:24.858021Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:24.858024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:24.858027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:24.858048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1961 reason: error at write: Disconnected sessionId: src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0
2025-10-01T14:13:24.858064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256244194135177:10286]
2025-10-01T14:13:24.858192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1961 sessionId: src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0 is DEAD
2025-10-01T14:13:24.858315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:24.858324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0] Write session will restart in 0.005670s
2025-10-01T14:13:24.858342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0] Write session: Do CDS request
2025-10-01T14:13:24.858347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:24.858578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:24.864735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.864827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:24.864846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1962
2025-10-01T14:13:24.864924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:24.864945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:24.864952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:24.864954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:24.865256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1962 sessionId:  describe result for acl check
2025-10-01T14:13:24.865282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:24.865287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:24.865288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:24.865291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256244194135226:10632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:24.865657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256244194135226:10632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:24.868338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256244194135226:10632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:24.870785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256244194135226:10632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:24.870795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256244194135226:10632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:24.870799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256244194135226:10632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:24.870803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:24.872454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:24.874390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:24.874532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:24.874541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:24.874549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:24.874584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:24.874609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256241817235985:10452]
2025-10-01T14:13:24.874989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:24.875151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:24.875176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:24.875392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:24.875431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.875435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.875436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.875436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.875437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.875438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.875438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.875439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.875439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.875440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.875440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.875441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.875441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.875442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.875445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.875451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.875453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.875455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.875457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.875459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.875461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.875463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.875466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.875468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.875469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.875471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.875473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.875475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.875479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.875483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:24.875487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.875490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:24.875494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.875497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:24.875500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.875502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:24.875505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.875507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:24.875509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.875512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:24.875514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.875516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:24.875518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.875521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:24.875523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.875525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:24.875528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.875530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.875532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.875535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.875537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.875539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.875541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.875543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:24.875545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.875548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:24.875565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:24.878594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:24.879121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:24.879133Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:24.879134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:24.879136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:24.879140Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1961 [2:7556256241817235985:10452]
2025-10-01T14:13:24.879148Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:24.879157Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:24.879162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.879165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.879166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.879177Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:24.879180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:24.879188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:24.879217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.879222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.879223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.879225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:24.879227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:24.879267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:24.879274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.879280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:24.879285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:24.879293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:24.879304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194135434:10632], now have 1 active actors on pipe
2025-10-01T14:13:24.879310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194135180:2446], now have 1 active actors on pipe
2025-10-01T14:13:24.879314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256241817235980:10452]
2025-10-01T14:13:24.879315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256241817235980:10452]
2025-10-01T14:13:24.879317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256241817235980:10452]
2025-10-01T14:13:24.879325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:24.879334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:24.879336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:24.879338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:24.879339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:24.879342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:24.879344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:24.879336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1961
2025-10-01T14:13:24.879357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256241817235980:10452]
2025-10-01T14:13:24.879365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:24.879366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:24.879380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.879383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.879377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1961
2025-10-01T14:13:24.879405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:24.879416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:24.879418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:24.879420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:24.879425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:24.879430Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:24.879444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.879534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.879539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.879549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:24.879623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1962 partition: 0 MaxSeqNo: 45 sessionId: src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0
2025-10-01T14:13:24.879863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57f6ca49-79e460a6-b7036e07-2d0e9a06_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:24.881919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0] Write session: try to update token
2025-10-01T14:13:24.881928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:24.892880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1962 sessionId: src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:24.894823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:24.894967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:24.894986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:24.895013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:24.895081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:24.897535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:24.897550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:24.897552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:24.897553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:24.897561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256241817235980:10452]
2025-10-01T14:13:24.897564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256241817235980:10452]
2025-10-01T14:13:24.897566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256241817235980:10452]
2025-10-01T14:13:24.897592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:24.897601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:24.897604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:24.897606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:24.897606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:24.897607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:24.897719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:24.958246Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256244194135485:10286]
2025-10-01T14:13:24.958453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 1961, pipe: [1:7556256244194135485:10286]
2025-10-01T14:13:25.026715Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:25.033191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.033213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.033352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.033406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.033463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.033518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.033557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.033564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.033633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.033688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.033741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.033798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.033835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.033841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.033895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.033945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.033999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.034051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.034096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.034107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.034165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.034217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.034270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.034322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.034359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.034365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.034429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.034479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.034531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.034584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.034627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.034635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.034693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.034742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.034797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.034853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.034890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.034896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.034948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.035006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.035061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.035115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.035159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.035165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.035217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.035266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.035318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.035372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.035410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.035415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.035469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.035522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.035573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.035633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.035675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.035680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.035734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.035784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.035836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.035891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.035927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.035932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.035965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256244194135485:10286], now have 1 active actors on pipe
2025-10-01T14:13:25.036116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:25.036138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:25.036157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1962 reason: error at write: Disconnected sessionId: src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0
2025-10-01T14:13:25.036313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1962 sessionId: src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0 is DEAD
2025-10-01T14:13:25.036342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256244194135485:10286]
2025-10-01T14:13:25.036365Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:25.036436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:25.036442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0] Write session will restart in 0.008603s
2025-10-01T14:13:25.036461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0] Write session: Do CDS request
2025-10-01T14:13:25.036465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:25.036822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:25.045706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.045822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:25.045833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1963
2025-10-01T14:13:25.045925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.045948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:25.045954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:25.045956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:25.046227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1963 sessionId:  describe result for acl check
2025-10-01T14:13:25.046255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:25.046259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:25.046261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:25.046264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256248489102899:10637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:25.046693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256248489102899:10637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:25.049248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256248489102899:10637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:25.050819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:25.052803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:25.052920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:25.052928Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:25.052935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:25.052929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256248489102899:10637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:25.052939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256248489102899:10637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:25.052941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256248489102899:10637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:25.052945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:25.052962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:25.052987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256246112203575:10454]
2025-10-01T14:13:25.053351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:25.053531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:25.053561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:25.053744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:25.053779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.053783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.053784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.053785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.053785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.053786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.053786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.053787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.053787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.053788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.053789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.053789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.053790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.053790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.053793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.053798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.053800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.053803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.053804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.053806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.053808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.053810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.053812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.053814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.053816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.053818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.053820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.053822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.053826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.053831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.053835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.053837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.053840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.053842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.053845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.053848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.053850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.053853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.053855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.053858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.053860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.053863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.053865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.053868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.053874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.053877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.053879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.053882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.053888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.053891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.053893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.053895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.053897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.053900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.053902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.053906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.053926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:25.057047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:25.057579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:25.057592Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:25.057593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:25.057595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:25.057600Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1962 [2:7556256246112203575:10454]
2025-10-01T14:13:25.057608Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:25.057619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:25.057621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.057623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.057624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.057635Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:25.057645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:25.057649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:25.057686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.057691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.057693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.057694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:25.057696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:25.057736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:25.057741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.057748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.057753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.057761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:25.057774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489102783:2446], now have 1 active actors on pipe
2025-10-01T14:13:25.057780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489103075:10637], now have 1 active actors on pipe
2025-10-01T14:13:25.057784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256246112203570:10454]
2025-10-01T14:13:25.057785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256246112203570:10454]
2025-10-01T14:13:25.057787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256246112203570:10454]
2025-10-01T14:13:25.057795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:25.057805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:25.057806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:25.057813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:25.057814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:25.057815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:25.057816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:25.057802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1962
2025-10-01T14:13:25.057805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1962
2025-10-01T14:13:25.057829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256246112203570:10454]
2025-10-01T14:13:25.057835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:25.057836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:25.057849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.057855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.057882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc7930c6-70b02115-afa5d927-9d8da293_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:25.057889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.057892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.057893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:25.057899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.057905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:25.057914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.058010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.058015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.058024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.058079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1963 partition: 0 MaxSeqNo: 45 sessionId: src_id|fc7930c6-70b02115-afa5d927-9d8da293_0
2025-10-01T14:13:25.058306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64fd3bed-4d798aa6-e16e77ed-bcf8d1ee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fc7930c6-70b02115-afa5d927-9d8da293_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:25.060385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7930c6-70b02115-afa5d927-9d8da293_0] Write session: try to update token
2025-10-01T14:13:25.060397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7930c6-70b02115-afa5d927-9d8da293_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:25.071524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1963 sessionId: src_id|fc7930c6-70b02115-afa5d927-9d8da293_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:25.073499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:25.073648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.073663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.073684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:25.073742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:25.076100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:25.076117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:25.076118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:25.076119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:25.076126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256246112203570:10454]
2025-10-01T14:13:25.076130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256246112203570:10454]
2025-10-01T14:13:25.076134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256246112203570:10454]
2025-10-01T14:13:25.076166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:25.076176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:25.076179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:25.076181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:25.076181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.076183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:25.076302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:25.136395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256248489103110:10286]
2025-10-01T14:13:25.136601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 1962, pipe: [1:7556256248489103110:10286]
2025-10-01T14:13:25.208130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:25.214838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.214854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.214987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.215040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.215095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.215152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.215191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.215203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.215261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.215319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.215381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.215445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.215490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.215497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.215551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.215601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.215653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.215708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.215745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.215750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.215802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.215863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.215916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.215965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.216002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.216007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.216059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.216108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.216161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.216211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.216247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.216252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.216305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.216367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.216425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.216480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.216520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.216525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.216578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.216641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.216694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.216746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.216784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.216789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.216846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.216903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.216958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.217011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.217050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.217055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.217110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.217163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.217218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.217273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.217312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.217317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.217381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.217436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.217494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.217548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.217589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.217595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.217632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489103110:10286], now have 1 active actors on pipe
2025-10-01T14:13:25.217824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:25.217825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:25.217828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:25.217857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1963 reason: error at write: Disconnected sessionId: src_id|fc7930c6-70b02115-afa5d927-9d8da293_0
2025-10-01T14:13:25.217881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256248489103110:10286]
2025-10-01T14:13:25.218010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1963 sessionId: src_id|fc7930c6-70b02115-afa5d927-9d8da293_0 is DEAD
2025-10-01T14:13:25.218119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7930c6-70b02115-afa5d927-9d8da293_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:25.218125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7930c6-70b02115-afa5d927-9d8da293_0] Write session will restart in 0.007480s
2025-10-01T14:13:25.218142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7930c6-70b02115-afa5d927-9d8da293_0] Write session: Do CDS request
2025-10-01T14:13:25.218147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7930c6-70b02115-afa5d927-9d8da293_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:25.218464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:25.226787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7930c6-70b02115-afa5d927-9d8da293_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.226834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:25.226847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1964
2025-10-01T14:13:25.227362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.227396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:25.227401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:25.227404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:25.227873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1964 sessionId:  describe result for acl check
2025-10-01T14:13:25.227910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:25.227917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:25.227919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:25.227924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256248489103231:10648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:25.228425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256248489103231:10648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:25.230796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256248489103231:10648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:25.232682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:25.234804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:25.234973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:25.234981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:25.234989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:25.235024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:25.235047Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256246112203881:10459]
2025-10-01T14:13:25.235024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256248489103231:10648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:25.235034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256248489103231:10648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:25.235038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256248489103231:10648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:25.235042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:25.235417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:25.235609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:25.235637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:25.235854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:25.235900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.235905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.235906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.235907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.235907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.235908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.235908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.235909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.235909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.235910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.235911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.235911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.235912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.235913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.235916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.235921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.235923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.235925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.235927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.235929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.235931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.235933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.235935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.235937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.235939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.235941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.235943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.235945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.235949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.235953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.235956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.235959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.235962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.235965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.235967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.235969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.235972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.235975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.235977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.235979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.235982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.235984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.235986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.235989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.235991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.235993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.235996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.235998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.236000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.236003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.236005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.236007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.236009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.236012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.236014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.236017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.236043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:25.239182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:25.239715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:25.239726Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:25.239728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:25.239730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:25.239733Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1963 [2:7556256246112203881:10459]
2025-10-01T14:13:25.239743Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:25.239754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:25.239759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.239761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.239762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.239774Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:25.239783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:25.239792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:25.239826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.239831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.239832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.239835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:25.239837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:25.239891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:25.239897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.239907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.239918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.239938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:25.239958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489103116:2446], now have 1 active actors on pipe
2025-10-01T14:13:25.239965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489103409:10648], now have 1 active actors on pipe
2025-10-01T14:13:25.239970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256246112203876:10459]
2025-10-01T14:13:25.239973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256246112203876:10459]
2025-10-01T14:13:25.239974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256246112203876:10459]
2025-10-01T14:13:25.239984Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:25.239992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:25.239997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:25.239999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:25.240000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:25.240003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:25.240005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:25.240032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.240038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.240047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256246112203876:10459]
2025-10-01T14:13:25.240054Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:25.240067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:25.240072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:25.240076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.240078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.240080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:25.240085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.240092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:25.240107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.239975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1963
2025-10-01T14:13:25.240002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1963
2025-10-01T14:13:25.240225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.240232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.240242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.240310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1964 partition: 0 MaxSeqNo: 45 sessionId: src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0
2025-10-01T14:13:25.240575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc7930c6-70b02115-afa5d927-9d8da293_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:25.242734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0] Write session: try to update token
2025-10-01T14:13:25.242746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:25.253972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1964 sessionId: src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:25.256003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:25.256168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.256186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.256221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:25.256304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:25.258597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:25.258612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:25.258614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:25.258616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:25.258624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256246112203876:10459]
2025-10-01T14:13:25.258628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256246112203876:10459]
2025-10-01T14:13:25.258632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256246112203876:10459]
2025-10-01T14:13:25.258676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:25.258676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:25.258681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:25.258683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:25.258686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.258689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:25.258810Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:25.318166Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256248489103421:10286]
2025-10-01T14:13:25.318432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 1963, pipe: [1:7556256248489103421:10286]
2025-10-01T14:13:25.402124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:25.408416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.408437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.408567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.408629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.408688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.408743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.408784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.408791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.408848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.408901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.408955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.409013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.409052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.409058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.409110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.409160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.409214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.409267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.409306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.409311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.409364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.409415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.409466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.409517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.409554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.409560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.409612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.409662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.409714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.409764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.409801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.409806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.409856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.409909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.409963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.410017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.410054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.410059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.410112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.410162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.410213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.410266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.410303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.410309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.410361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.410427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.410480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.410533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.410569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.410574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.410629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.410689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.410744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.410798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.410839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.410845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.410901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.410954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.411008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.411061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.411096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.411101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.411136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489103421:10286], now have 1 active actors on pipe
2025-10-01T14:13:25.411338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256248489103421:10286]
2025-10-01T14:13:25.411382Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:25.411412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:25.411417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:25.411436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1964 reason: error at write: Disconnected sessionId: src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0
2025-10-01T14:13:25.411591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1964 sessionId: src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0 is DEAD
2025-10-01T14:13:25.411723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:25.411733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0] Write session will restart in 0.009025s
2025-10-01T14:13:25.411755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0] Write session: Do CDS request
2025-10-01T14:13:25.411760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:25.412108Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:25.421777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.422092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:25.422104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1965
2025-10-01T14:13:25.422192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.422214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:25.422221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:25.422223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:25.422569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1965 sessionId:  describe result for acl check
2025-10-01T14:13:25.422601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:25.422606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:25.422608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:25.422613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256248489103535:10652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:25.422989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256248489103535:10652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:25.425546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256248489103535:10652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:25.427664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256248489103535:10652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:25.427683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256248489103535:10652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:25.427686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256248489103535:10652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:25.427693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:25.428188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:25.430601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:25.430759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:25.430767Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:25.430775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:25.430805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:25.430831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256246112204191:10462]
2025-10-01T14:13:25.431193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:25.431385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:25.431410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:25.431587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:25.431620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.431624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.431625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.431625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.431626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.431627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.431627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.431628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.431629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.431629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.431630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.431630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.431631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.431631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.431634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.431639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.431641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.431643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.431645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.431647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.431649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.431651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.431653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.431656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.431658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.431660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.431662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.431664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.431668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.431673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.431676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.431679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.431681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.431684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.431686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.431689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.431691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.431694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.431696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.431699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.431703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.431706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.431708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.431710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.431713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.431715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.431717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.431720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.431722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.431724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.431727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.431733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.431735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.431738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.431740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.431743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.431764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:25.434876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:25.435406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:25.435419Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:25.435421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:25.435424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:25.435429Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1964 [2:7556256246112204191:10462]
2025-10-01T14:13:25.435439Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:25.435453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:25.435455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.435457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.435459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.435468Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:25.435474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:25.435479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:25.435515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.435519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.435520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.435522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:25.435524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:25.435566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:25.435571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.435577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.435582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.435590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:25.435603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256246112204186:10462]
2025-10-01T14:13:25.435607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256246112204186:10462]
2025-10-01T14:13:25.435609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256246112204186:10462]
2025-10-01T14:13:25.435615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:25.435623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:25.435625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:25.435627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:25.435629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:25.435634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:25.435636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:25.435643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489103423:2446], now have 1 active actors on pipe
2025-10-01T14:13:25.435648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489103715:10652], now have 1 active actors on pipe
2025-10-01T14:13:25.435660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256246112204186:10462]
2025-10-01T14:13:25.435667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:25.435675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:25.435687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1964
2025-10-01T14:13:25.435692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1964
2025-10-01T14:13:25.435746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.435753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.435769Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:25.435777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.435779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.435782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:25.435788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.435795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:25.435807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.435919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.435927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.435937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.435997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1965 partition: 0 MaxSeqNo: 45 sessionId: src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0
2025-10-01T14:13:25.436282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d892f7dd-aa88b1e3-e185d476-1e18591b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:25.438397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0] Write session: try to update token
2025-10-01T14:13:25.438409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:25.445360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:25.445374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:25.445380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256246112204186:10462]
2025-10-01T14:13:25.445413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:25.445416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:25.445550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:25.445683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:25.445806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:25.445919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:25.446078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:25.446106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:25.449559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1965 sessionId: src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:25.451763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:25.451998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.452011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.452034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:25.452112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:25.464047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:25.464062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:25.464064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:25.464065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:25.464074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256246112204186:10462]
2025-10-01T14:13:25.464077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256246112204186:10462]
2025-10-01T14:13:25.464080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256246112204186:10462]
2025-10-01T14:13:25.464111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:25.464115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:25.464116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:25.464118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:25.464120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.464122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:25.464233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:25.511682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256248489103749:10286]
2025-10-01T14:13:25.511836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 1964, pipe: [1:7556256248489103749:10286]
2025-10-01T14:13:25.590592Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:25.597001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.597017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.597152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.597208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.597263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.597320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.597517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.597524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.597580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.597629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.597684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.597744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.597786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.597793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.597849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.597895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.597948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.598000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.598037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.598042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.598092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.598141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.598196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.598249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.598288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.598295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.598348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.598408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.598458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.598506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.598544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.598548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.598602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.598655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.598714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.598768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.598810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.598818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.598881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.598943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.598995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.599043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.599080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.599086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.599136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.599187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.599246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.599296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.599339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.599345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.599399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.599450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.599499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.599548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.599584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.599588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.599637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.599684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.599737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.599789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.599829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.599836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.599872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489103749:10286], now have 1 active actors on pipe
2025-10-01T14:13:25.600065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:25.600082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:25.600085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:25.600110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1965 reason: error at write: Disconnected sessionId: src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0
2025-10-01T14:13:25.600121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256248489103749:10286]
2025-10-01T14:13:25.600264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1965 sessionId: src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0 is DEAD
2025-10-01T14:13:25.600368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:25.600381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0] Write session will restart in 0.007993s
2025-10-01T14:13:25.600398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0] Write session: Do CDS request
2025-10-01T14:13:25.600403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:25.600455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:25.609821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.610430Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:25.610444Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1966
2025-10-01T14:13:25.610530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.610560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:25.610568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:25.610570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:25.610877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1966 sessionId:  describe result for acl check
2025-10-01T14:13:25.610904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:25.610908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:25.610909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:25.610912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256248489103855:10658] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:25.611282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256248489103855:10658] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:25.613372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256248489103855:10658] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:25.615001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256248489103855:10658] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:25.615010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256248489103855:10658] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:25.615012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256248489103855:10658] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:25.615016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:25.616842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:25.619098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:25.619220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:25.619227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:25.619234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:25.619267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:25.619292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256246112204518:10474]
2025-10-01T14:13:25.619658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:25.619853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:25.619877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:25.620067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:25.620109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.620114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.620114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.620115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.620116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.620116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.620117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.620117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.620118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.620118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.620119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.620119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.620120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.620120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.620123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.620129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.620131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.620133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.620135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.620137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.620139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.620141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.620143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.620145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.620147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.620149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.620150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.620152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.620158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.620162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.620165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.620168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.620170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.620172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.620174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.620177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.620179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.620182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.620184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.620187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.620189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.620192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.620194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.620197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.620199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.620201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.620203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.620206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.620208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.620211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.620213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.620215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.620217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.620220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.620222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.620224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.620242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:25.623447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:25.623979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:25.623989Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:25.623991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:25.623993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:25.623997Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1965 [2:7556256246112204518:10474]
2025-10-01T14:13:25.624008Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:25.624025Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:25.624032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.624035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.624038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.624053Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:25.624061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:25.624069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:25.624100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.624104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.624105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.624108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:25.624109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:25.624159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:25.624167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.624176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.624186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.624200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:25.624221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489103751:2446], now have 1 active actors on pipe
2025-10-01T14:13:25.624224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489104030:10658], now have 1 active actors on pipe
2025-10-01T14:13:25.624230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256246112204513:10474]
2025-10-01T14:13:25.624231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256246112204513:10474]
2025-10-01T14:13:25.624233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256246112204513:10474]
2025-10-01T14:13:25.624244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:25.624254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:25.624255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:25.624257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:25.624258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:25.624267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:25.624269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:25.624261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1965
2025-10-01T14:13:25.624265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1965
2025-10-01T14:13:25.624286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256246112204513:10474]
2025-10-01T14:13:25.624296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:25.624298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:25.624318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.624323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.624351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:25.624361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.624365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.624371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:25.624378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.624388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:25.624413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.624550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.624560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.624571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.624656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1966 partition: 0 MaxSeqNo: 45 sessionId: src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0
2025-10-01T14:13:25.624988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86c0fdb2-62f16979-ff82cf91-9b563613_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:25.627157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0] Write session: try to update token
2025-10-01T14:13:25.627171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:25.639216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1966 sessionId: src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:25.641247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:25.641441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.641462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.641497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:25.641550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:25.643308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:25.643324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:25.643327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:25.643329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:25.643337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256246112204513:10474]
2025-10-01T14:13:25.643341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256246112204513:10474]
2025-10-01T14:13:25.643345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256246112204513:10474]
2025-10-01T14:13:25.643373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:25.643381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:25.643384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:25.643392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:25.643398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.643401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:25.643532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:25.700128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256248489104073:10286]
2025-10-01T14:13:25.700352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 1965, pipe: [1:7556256248489104073:10286]
2025-10-01T14:13:25.786067Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:25.792402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.792422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.792567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.792628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.792683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.792738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.792779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.792786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.792846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.792896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.792948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.793004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.793042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.793049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.793103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.793148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.793198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.793250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.793290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.793296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.793347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.793397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.793447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.793495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.793536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.793541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.793591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.793643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.793695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.793745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.793784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.793789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.793851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.793910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.793974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.794035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.794074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.794079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.794134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.794184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.794238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.794288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.794327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.794332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.794405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.794462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.794512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.794564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.794604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.794609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.794663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.794715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.794769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.794823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.794862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.794867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.794923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.794978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.795033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.795087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.795125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.795131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.795172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489104073:10286], now have 1 active actors on pipe
2025-10-01T14:13:25.795376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:25.795390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:25.795391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:25.795418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1966 reason: error at write: Disconnected sessionId: src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0
2025-10-01T14:13:25.795431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256248489104073:10286]
2025-10-01T14:13:25.795566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1966 sessionId: src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0 is DEAD
2025-10-01T14:13:25.795668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:25.795674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0] Write session will restart in 0.009098s
2025-10-01T14:13:25.795695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0] Write session: Do CDS request
2025-10-01T14:13:25.795700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:25.796297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:25.805854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.805934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:25.805946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1967
2025-10-01T14:13:25.806063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.806085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:25.806089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:25.806095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:25.806439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1967 sessionId:  describe result for acl check
2025-10-01T14:13:25.806477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:25.806482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:25.806483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:25.806488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256248489104180:10662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:25.806971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256248489104180:10662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:25.809397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256248489104180:10662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:25.811818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256248489104180:10662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:25.811832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256248489104180:10662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:25.811835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256248489104180:10662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:25.811842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:25.812666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:25.814752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:25.814879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:25.814886Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:25.814894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:25.814923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:25.814957Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256246112204821:10477]
2025-10-01T14:13:25.815328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:25.815524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:25.815556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:25.815745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:25.815779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.815783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.815784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.815785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.815785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.815786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.815786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.815787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.815788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.815788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.815789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.815790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.815790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.815791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.815794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.815799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.815802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.815804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.815806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.815808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.815810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.815813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.815815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.815817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.815819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.815821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.815824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.815826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.815830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.815835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:25.815838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.815841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:25.815844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.815847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:25.815849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.815852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:25.815855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.815858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:25.815860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.815863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:25.815866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.815869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:25.815872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.815874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:25.815881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.815883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:25.815886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.815889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.815894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.815897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.815899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.815902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.815905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.815910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:25.815913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.815916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:25.815937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:25.819442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:25.819955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:25.819965Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:25.819966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:25.819968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:25.819973Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1966 [2:7556256246112204821:10477]
2025-10-01T14:13:25.819982Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:25.819993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:25.819994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.819996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.819997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.820008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:25.820011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:25.820015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:25.820044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.820050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.820051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.820053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:25.820056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:25.820108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:25.820113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.820119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:25.820125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:25.820133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:25.820147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489104076:2446], now have 1 active actors on pipe
2025-10-01T14:13:25.820152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489104369:10662], now have 1 active actors on pipe
2025-10-01T14:13:25.820158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256246112204816:10477]
2025-10-01T14:13:25.820163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256246112204816:10477]
2025-10-01T14:13:25.820164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256246112204816:10477]
2025-10-01T14:13:25.820172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:25.820185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:25.820188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:25.820191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:25.820192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:25.820196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:25.820198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:25.820214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256246112204816:10477]
2025-10-01T14:13:25.820220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:25.820222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:25.820210Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1966
2025-10-01T14:13:25.820251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1966
2025-10-01T14:13:25.820295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.820303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.820325Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93525505-f933d58a-dfafd544-1a9931b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:25.820333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:25.820340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:25.820341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:25.820347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:25.820356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:25.820368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.820487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.820494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.820504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:25.820564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1967 partition: 0 MaxSeqNo: 45 sessionId: src_id|93525505-f933d58a-dfafd544-1a9931b7_0
2025-10-01T14:13:25.820871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c10f06a-1cc4a8bc-4ccad70d-98cacbb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|93525505-f933d58a-dfafd544-1a9931b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:25.823057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93525505-f933d58a-dfafd544-1a9931b7_0] Write session: try to update token
2025-10-01T14:13:25.823071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93525505-f933d58a-dfafd544-1a9931b7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:25.830258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:25.830276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:25.830285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256246112204816:10477]
2025-10-01T14:13:25.830322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:25.830327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:25.830549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:25.830709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:25.830863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:25.831020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:25.831267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:25.831299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:25.834981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1967 sessionId: src_id|93525505-f933d58a-dfafd544-1a9931b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:25.837178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:25.837345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.837356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.837379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:25.837446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:25.848439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:25.848452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:25.848454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:25.848455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:25.848462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256246112204816:10477]
2025-10-01T14:13:25.848464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256246112204816:10477]
2025-10-01T14:13:25.848467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256246112204816:10477]
2025-10-01T14:13:25.848497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:25.848497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:25.848501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:25.848504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:25.848506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:25.848507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:25.848632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:25.895704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256248489104385:10286]
2025-10-01T14:13:25.895884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 1966, pipe: [1:7556256248489104385:10286]
2025-10-01T14:13:25.975448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:25.981947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:25.981964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:25.982094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.982145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.982199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.982253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.982293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.982300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.982367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.982429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.982482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.982537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.982576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.982581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.982640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.982690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.982740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.982793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.982829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.982834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.982890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.982945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.982996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.983045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.983084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.983089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.983141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.983189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.983237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.983286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.983323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.983328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.983380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.983429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.983477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.983527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.983565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.983570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.983619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.983666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.983717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.983768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.983805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.983810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.983860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.983905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.983956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.984010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.984045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.984049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.984098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.984145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.984195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.984245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.984282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.984287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.984335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:25.984380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:25.984428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:25.984474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:25.984510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:25.984515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:25.984550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489104385:10286], now have 1 active actors on pipe
2025-10-01T14:13:25.984765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:25.984776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256248489104385:10286]
2025-10-01T14:13:25.984799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:25.984801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:25.984825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1967 reason: error at write: Disconnected sessionId: src_id|93525505-f933d58a-dfafd544-1a9931b7_0
2025-10-01T14:13:25.985026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1967 sessionId: src_id|93525505-f933d58a-dfafd544-1a9931b7_0 is DEAD
2025-10-01T14:13:25.985136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93525505-f933d58a-dfafd544-1a9931b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:25.985147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93525505-f933d58a-dfafd544-1a9931b7_0] Write session will restart in 0.006223s
2025-10-01T14:13:25.985166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93525505-f933d58a-dfafd544-1a9931b7_0] Write session: Do CDS request
2025-10-01T14:13:25.985170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93525505-f933d58a-dfafd544-1a9931b7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:25.985354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:25.992831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93525505-f933d58a-dfafd544-1a9931b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.992897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:25.992909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1968
2025-10-01T14:13:25.993024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:25.993053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:25.993060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:25.993062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:25.993370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1968 sessionId:  describe result for acl check
2025-10-01T14:13:25.993394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:25.993400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:25.993402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:25.993406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256248489104459:10667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:25.993753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256248489104459:10667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:25.996551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256248489104459:10667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:25.998865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256248489104459:10667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:25.998875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256248489104459:10667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:25.998877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256248489104459:10667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:25.998882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:26.000401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:26.002882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:26.003016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:26.003024Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:26.003032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:26.003062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:26.003088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256250407172417:10479]
2025-10-01T14:13:26.003474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:26.003654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:26.003680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:26.003894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:26.003928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.003932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.003933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.003933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.003934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.003934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.003935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.003936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.003936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.003937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.003937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.003938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.003938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.003939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.003942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.003947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.003950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.003952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.003953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.003955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.003957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.003959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.003961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.003963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.003965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.003967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.003969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.003971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.003975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.003979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.003982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.003985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.003988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.003990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.003992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.003995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.003997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.004000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.004002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.004005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.004007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.004010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.004012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.004015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.004017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.004020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.004022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.004027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.004031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.004035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.004038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.004048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.004052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.004056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.004058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.004061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.004079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:26.007137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:26.007647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:26.007657Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:26.007658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:26.007660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:26.007665Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1967 [2:7556256250407172417:10479]
2025-10-01T14:13:26.007673Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:26.007683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:26.007688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.007690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.007691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.007701Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:26.007704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:26.007714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:26.007751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.007755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.007756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.007759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:26.007760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:26.007800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:26.007805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.007811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.007816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.007827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:26.007842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489104656:10667], now have 1 active actors on pipe
2025-10-01T14:13:26.007847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256248489104390:2446], now have 1 active actors on pipe
2025-10-01T14:13:26.007852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256250407172412:10479]
2025-10-01T14:13:26.007853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256250407172412:10479]
2025-10-01T14:13:26.007854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256250407172412:10479]
2025-10-01T14:13:26.007863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:26.007873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:26.007878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:26.007880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:26.007881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:26.007888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:26.007890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:26.007909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256250407172412:10479]
2025-10-01T14:13:26.007921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:26.007938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:26.007938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1967
2025-10-01T14:13:26.007957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1967
2025-10-01T14:13:26.008017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.008027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.008046Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:26.008054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.008057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.008061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:26.008068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.008077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:26.008092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.008219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.008225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.008236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.008294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1968 partition: 0 MaxSeqNo: 45 sessionId: src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0
2025-10-01T14:13:26.008516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93525505-f933d58a-dfafd544-1a9931b7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:26.010787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0] Write session: try to update token
2025-10-01T14:13:26.010800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:26.017906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:26.017919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:26.017925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256250407172412:10479]
2025-10-01T14:13:26.017956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:26.017959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:26.018107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:26.018253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:26.018425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:26.018542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:26.018719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:26.018756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:26.021956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1968 sessionId: src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:26.023983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:26.024149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.024162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.024187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:26.024256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:26.035262Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:26.035278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:26.035280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:26.035282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:26.035290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256250407172412:10479]
2025-10-01T14:13:26.035294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256250407172412:10479]
2025-10-01T14:13:26.035297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256250407172412:10479]
2025-10-01T14:13:26.035327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:26.035331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:26.035333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:26.035338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:26.035344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.035347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:26.035459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:26.085158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256252784071991:10286]
2025-10-01T14:13:26.085365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 1967, pipe: [1:7556256252784071991:10286]
2025-10-01T14:13:26.169332Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:26.176208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.176227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.176360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.176411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.176466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.176519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.176560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.176567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.176633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.176682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.176733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.176788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.176827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.176832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.176884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.176931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.176980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.177028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.177065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.177070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.177116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.177166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.177215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.177264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.177300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.177305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.177360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.177415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.177465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.177512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.177547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.177552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.177601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.177648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.177696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.177742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.177780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.177785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.177840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.177892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.177941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.177988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.178024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.178029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.178082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.178129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.178177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.178226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.178263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.178268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.178320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.178393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.178444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.178495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.178531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.178536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.178587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.178632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.178678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.178726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.178761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.178767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.178803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784071991:10286], now have 1 active actors on pipe
2025-10-01T14:13:26.179051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:26.179068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:26.179095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1968 reason: error at write: Disconnected sessionId: src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0
2025-10-01T14:13:26.179122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:26.179163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256252784071991:10286]
2025-10-01T14:13:26.179324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1968 sessionId: src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0 is DEAD
2025-10-01T14:13:26.179398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:26.179410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0] Write session will restart in 0.005297s
2025-10-01T14:13:26.179430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0] Write session: Do CDS request
2025-10-01T14:13:26.179435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:26.179496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:26.185671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.185764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:26.185772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1969
2025-10-01T14:13:26.185850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.185871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:26.185877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:26.185879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:26.186168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1969 sessionId:  describe result for acl check
2025-10-01T14:13:26.186196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:26.186201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:26.186202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:26.186206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256252784072055:10678] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:26.186633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256252784072055:10678] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:26.189261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256252784072055:10678] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:26.191520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256252784072055:10678] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:26.191532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256252784072055:10678] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:26.191536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256252784072055:10678] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:26.191541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:26.193953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:26.194204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:26.194348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:26.194356Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:26.194364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:26.194411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:26.194438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256250407172727:10484]
2025-10-01T14:13:26.194775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:26.196181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:26.196206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:26.196384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:26.196413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.196418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.196419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.196419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.196419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.196420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.196420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.196421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.196421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.196422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.196422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.196423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.196423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.196423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.196426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.196431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.196434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.196436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.196438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.196440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.196442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.196444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.196445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.196447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.196449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.196451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.196453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.196455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.196459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.196463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.196466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.196470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.196473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.196476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.196478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.196480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.196482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.196485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.196487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.196489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.196492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.196494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.196496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.196499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.196501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.196503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.196505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.196508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.196510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.196512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.196514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.196517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.196519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.196521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.196523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.196526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.196548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:26.199661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:26.200166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:26.200175Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:26.200176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:26.200178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:26.200182Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1968 [2:7556256250407172727:10484]
2025-10-01T14:13:26.200190Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:26.200200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:26.200205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.200207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.200208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.200218Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:26.200225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:26.200228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:26.200257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.200262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.200264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.200266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:26.200268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:26.200305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:26.200310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.200316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.200321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.200331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:26.200345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072237:10678], now have 1 active actors on pipe
2025-10-01T14:13:26.200350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072019:2446], now have 1 active actors on pipe
2025-10-01T14:13:26.200354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256250407172722:10484]
2025-10-01T14:13:26.200355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256250407172722:10484]
2025-10-01T14:13:26.200356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256250407172722:10484]
2025-10-01T14:13:26.200364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:26.200373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:26.200382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:26.200387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:26.200370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1968
2025-10-01T14:13:26.200387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:26.200389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:26.200390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:26.200409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.200415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.200423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256250407172722:10484]
2025-10-01T14:13:26.200429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:26.200407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1968
2025-10-01T14:13:26.200434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:26.200445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:26.200453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.200455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.200457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:26.200462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.200467Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:26.200480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.200570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.200574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.200583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.200634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1969 partition: 0 MaxSeqNo: 45 sessionId: src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0
2025-10-01T14:13:26.200874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de3fbd46-7524158-4e8f41f8-ccb68d4d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:26.203033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0] Write session: try to update token
2025-10-01T14:13:26.203045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:26.214322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1969 sessionId: src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:26.216190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:26.216348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.216364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.216392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:26.216459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:26.218620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:26.218632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:26.218633Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:26.218634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:26.218640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256250407172722:10484]
2025-10-01T14:13:26.218643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256250407172722:10484]
2025-10-01T14:13:26.218646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256250407172722:10484]
2025-10-01T14:13:26.218678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:26.218677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:26.218681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:26.218683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:26.218687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.218688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:26.218800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:26.279196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256252784072325:10286]
2025-10-01T14:13:26.279395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 1968, pipe: [1:7556256252784072325:10286]
2025-10-01T14:13:26.349422Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:26.355855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.355874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.356010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.356064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.356117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.356171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.356212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.356220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.356275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.356325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.356376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.356431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.356475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.356484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.356533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.356577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.356640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.356699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.356738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.356745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.356802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.356903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.356953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.357008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.357045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.357050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.357101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.357149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.357196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.357246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.357282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.357287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.357336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.357383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.357433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.357493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.357533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.357538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.357593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.357642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.357693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.357741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.357778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.357783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.357833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.357883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.357932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.357986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.358029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.358036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.358089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.358150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.358215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.358271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.358308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.358314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.358367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.358431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.358483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.358547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.358586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.358591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.358629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072325:10286], now have 1 active actors on pipe
2025-10-01T14:13:26.358858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:26.358909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256252784072325:10286]
2025-10-01T14:13:26.358909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:26.358914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:26.358938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1969 reason: error at write: Disconnected sessionId: src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0
2025-10-01T14:13:26.359136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1969 sessionId: src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0 is DEAD
2025-10-01T14:13:26.359283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:26.359294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0] Write session will restart in 0.006944s
2025-10-01T14:13:26.359333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0] Write session: Do CDS request
2025-10-01T14:13:26.359340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:26.359534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:26.367796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.367884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:26.367896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1970
2025-10-01T14:13:26.367990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.368023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:26.368031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:26.368034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:26.368591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1970 sessionId:  describe result for acl check
2025-10-01T14:13:26.368637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:26.368643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:26.368645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:26.368649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256252784072420:10682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:26.369128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256252784072420:10682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:26.371539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256252784072420:10682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:26.374135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256252784072420:10682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:26.374144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256252784072420:10682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:26.374146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256252784072420:10682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:26.374150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:26.374973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:26.377008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:26.377229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:26.377236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:26.377244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:26.377278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:26.377302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256250407173041:10487]
2025-10-01T14:13:26.377655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:26.377870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:26.377902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:26.378088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:26.378118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.378122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.378122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.378123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.378124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.378124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.378125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.378125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.378126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.378127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.378127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.378128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.378128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.378129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.378133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.378138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.378140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.378142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.378144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.378146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.378148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.378150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.378153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.378155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.378157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.378159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.378161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.378163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.378167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.378171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.378175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.378178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.378181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.378184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.378188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.378191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.378193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.378196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.378198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.378201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.378203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.378206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.378208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.378210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.378216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.378219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.378221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.378224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.378226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.378229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.378231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.378234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.378238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.378241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.378243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.378246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.378264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:26.381363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:26.381875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:26.381887Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:26.381888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:26.381892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:26.381898Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1969 [2:7556256250407173041:10487]
2025-10-01T14:13:26.381907Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:26.381919Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:26.381921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.381923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.381925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.381936Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:26.381939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:26.381943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:26.381974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.381979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.381980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.381982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:26.381984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:26.382025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:26.382029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.382036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.382041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.382049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:26.382064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072328:2446], now have 1 active actors on pipe
2025-10-01T14:13:26.382071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072623:10682], now have 1 active actors on pipe
2025-10-01T14:13:26.382077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256250407173036:10487]
2025-10-01T14:13:26.382080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256250407173036:10487]
2025-10-01T14:13:26.382082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256250407173036:10487]
2025-10-01T14:13:26.382094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:26.382102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:26.382105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:26.382106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:26.382108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:26.382120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:26.382126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:26.382110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1969
2025-10-01T14:13:26.382156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256250407173036:10487]
2025-10-01T14:13:26.382166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:26.382161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1969
2025-10-01T14:13:26.382172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:26.382197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.382205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.382228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:26.382236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.382240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.382245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:26.382253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.382263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:26.382279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.382401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.382408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.382420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.382492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1970 partition: 0 MaxSeqNo: 45 sessionId: src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0
2025-10-01T14:13:26.382797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c10ba6fb-f73fc9c2-912179e1-9fd2e1ee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:26.385060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0] Write session: try to update token
2025-10-01T14:13:26.385074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:26.392065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:26.392081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:26.392090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256250407173036:10487]
2025-10-01T14:13:26.392122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:26.392130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:26.392282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:26.392431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:26.392582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:26.392734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:26.392910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:26.392943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:26.396408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1970 sessionId: src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:26.398305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:26.398455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.398471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.398501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:26.398560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:26.409198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:26.409214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:26.409216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:26.409217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:26.409227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256250407173036:10487]
2025-10-01T14:13:26.409231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256250407173036:10487]
2025-10-01T14:13:26.409234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256250407173036:10487]
2025-10-01T14:13:26.409265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:26.409269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:26.409271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:26.409275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:26.409282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.409284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:26.409405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:26.458894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256252784072644:10286]
2025-10-01T14:13:26.459117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 1969, pipe: [1:7556256252784072644:10286]
2025-10-01T14:13:26.550941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:26.557542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.557563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.557693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.557751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.557814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.557862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.557901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.557910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.557961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.558011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.558061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.558111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.558149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.558154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.558206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.558253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.558302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.558348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.558399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.558405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.558455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.558501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.558548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.558597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.558635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.558640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.558689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.558735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.558783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.558833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.558870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.558875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.558924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.558968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.559014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.559064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.559106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.559112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.559159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.559206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.559253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.559300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.559337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.559341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.559394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.559444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.559491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.559541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.559579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.559584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.559635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.559682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.559729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.559777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.559812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.559817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.559863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.559908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.559956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.560002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.560037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.560042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.560078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072644:10286], now have 1 active actors on pipe
2025-10-01T14:13:26.560298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256252784072644:10286]
2025-10-01T14:13:26.560299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:26.560327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:26.560329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:26.560350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1970 reason: error at write: Disconnected sessionId: src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0
2025-10-01T14:13:26.560539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1970 sessionId: src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0 is DEAD
2025-10-01T14:13:26.560670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:26.560679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0] Write session will restart in 0.009045s
2025-10-01T14:13:26.560697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0] Write session: Do CDS request
2025-10-01T14:13:26.560702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:26.560946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:26.570769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.570877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:26.570891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1971
2025-10-01T14:13:26.570993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.571024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:26.571033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:26.571036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:26.571349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1971 sessionId:  describe result for acl check
2025-10-01T14:13:26.571387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:26.571394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:26.571396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:26.571400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256252784072810:10688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:26.571806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256252784072810:10688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:26.573805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256252784072810:10688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:26.575978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:26.576043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256252784072810:10688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:26.576056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256252784072810:10688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:26.576060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256252784072810:10688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:26.576066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:26.578229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:26.578394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:26.578403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:26.578413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:26.578456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:26.578484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256250407173373:10499]
2025-10-01T14:13:26.578898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:26.579089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:26.579117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:26.579303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:26.579333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.579337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.579338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.579338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.579339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.579340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.579340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.579341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.579341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.579342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.579342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.579343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.579344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.579344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.579347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.579353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.579357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.579360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.579364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.579367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.579369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.579372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.579375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.579378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.579381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.579384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.579387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.579390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.579396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.579401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.579405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.579409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.579411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.579413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.579415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.579418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.579421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.579423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.579426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.579428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.579430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.579433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.579437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.579441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.579445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.579449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.579453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.579458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.579462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.579467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.579470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.579472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.579475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.579477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.579479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.579482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.579502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:26.582610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:26.583130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:26.583141Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:26.583142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:26.583144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:26.583148Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1970 [2:7556256250407173373:10499]
2025-10-01T14:13:26.583157Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:26.583167Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:26.583170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.583172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.583173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.583183Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:26.583188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:26.583191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:26.583223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.583228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.583229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.583232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:26.583233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:26.583270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:26.583275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.583281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.583286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.583294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:26.583308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072961:10688], now have 1 active actors on pipe
2025-10-01T14:13:26.583310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072665:2446], now have 1 active actors on pipe
2025-10-01T14:13:26.583315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256250407173367:10499]
2025-10-01T14:13:26.583316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256250407173367:10499]
2025-10-01T14:13:26.583318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256250407173367:10499]
2025-10-01T14:13:26.583328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:26.583338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:26.583341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:26.583343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:26.583343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:26.583354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:26.583360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:26.583377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256250407173367:10499]
2025-10-01T14:13:26.583387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:26.583393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:26.583393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1970
2025-10-01T14:13:26.583395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1970
2025-10-01T14:13:26.583454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.583463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.583486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|62398418-40704dbf-b003a7c3-988e4055_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:26.583496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.583500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.583502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:26.583509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.583521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:26.583537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.583655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.583663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.583677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.583751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1971 partition: 0 MaxSeqNo: 45 sessionId: src_id|62398418-40704dbf-b003a7c3-988e4055_0
2025-10-01T14:13:26.584014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8e56c0a-c37422f9-26152dcd-bb3c8f1d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|62398418-40704dbf-b003a7c3-988e4055_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:26.586165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62398418-40704dbf-b003a7c3-988e4055_0] Write session: try to update token
2025-10-01T14:13:26.586178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62398418-40704dbf-b003a7c3-988e4055_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:26.598009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1971 sessionId: src_id|62398418-40704dbf-b003a7c3-988e4055_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:26.600043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:26.600346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.600368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.602181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:26.602196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:26.602198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:26.602200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:26.602207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256250407173367:10499]
2025-10-01T14:13:26.602212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256250407173367:10499]
2025-10-01T14:13:26.602216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256250407173367:10499]
2025-10-01T14:13:26.602245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:26.602254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:26.602256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:26.602257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:26.602268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:26.602274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.602278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:26.602317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:26.602418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:26.660642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256252784072974:10286]
2025-10-01T14:13:26.660877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 1970, pipe: [1:7556256252784072974:10286]
2025-10-01T14:13:26.734082Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:26.740713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.740736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.740870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.740922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.740977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.741031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.741078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.741085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.741141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.741194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.741248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.741304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.741343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.741348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.741414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.741468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.741521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.741575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.741612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.741618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.741669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.741718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.741768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.741814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.741851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.741856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.741906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.741954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.742000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.742049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.742087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.742093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.742146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.742194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.742247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.742302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.742342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.742348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.742420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.742471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.742520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.742569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.742612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.742620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.742673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.742721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.742771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.742823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.742861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.742867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.742925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.742975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.743027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.743080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.743119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.743124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.743176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:26.743226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:26.743279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:26.743336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:26.743373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:26.743378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:26.743414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072974:10286], now have 1 active actors on pipe
2025-10-01T14:13:26.743646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256252784072974:10286]
2025-10-01T14:13:26.743676Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:26.743680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:26.743683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:26.743706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1971 reason: error at write: Disconnected sessionId: src_id|62398418-40704dbf-b003a7c3-988e4055_0
2025-10-01T14:13:26.743899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1971 sessionId: src_id|62398418-40704dbf-b003a7c3-988e4055_0 is DEAD
2025-10-01T14:13:26.744016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62398418-40704dbf-b003a7c3-988e4055_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:26.744024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62398418-40704dbf-b003a7c3-988e4055_0] Write session will restart in 0.005724s
2025-10-01T14:13:26.744049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62398418-40704dbf-b003a7c3-988e4055_0] Write session: Do CDS request
2025-10-01T14:13:26.744055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62398418-40704dbf-b003a7c3-988e4055_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:26.744260Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:26.750855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|62398418-40704dbf-b003a7c3-988e4055_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.750916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:26.750930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1972
2025-10-01T14:13:26.751049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.751078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:26.751087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:26.751090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:26.751488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1972 sessionId:  describe result for acl check
2025-10-01T14:13:26.751520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:26.751526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:26.751528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:26.751532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256252784073000:10692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:26.752038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256252784073000:10692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:26.755307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256252784073000:10692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:26.758276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256252784073000:10692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:26.758287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256252784073000:10692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:26.758290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256252784073000:10692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:26.758296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:26.762914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:26.765402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:26.765533Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:26.765540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:26.765548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:26.765578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:26.765602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256250407173679:10502]
2025-10-01T14:13:26.765973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:26.766169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:26.766194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:26.766433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:26.766497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.766503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.766504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.766505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.766506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.766507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.766508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.766509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.766510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.766511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.766512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.766513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.766514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.766515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.766520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.766528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.766531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.766535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.766537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.766540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.766543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.766546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.766549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.766552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.766557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.766560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.766563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.766566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.766572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.766581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.766591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.766599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.766606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.766610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.766617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.766621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.766628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.766637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.766640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.766648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.766652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.766655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.766661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.766665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.766673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.766677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.766681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.766690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.766693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.766700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.766702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.766705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.766707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.766710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.766714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.766716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.766735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:26.769982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:26.770528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:26.770537Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:26.770539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:26.770541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:26.770545Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1971 [2:7556256250407173679:10502]
2025-10-01T14:13:26.770557Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:26.770571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:26.770573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.770575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.770576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.770586Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:26.770593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:26.770598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:26.770635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.770640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.770642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.770644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:26.770646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:26.770690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:26.770695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.770702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.770712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.770728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:26.770747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784073159:10692], now have 1 active actors on pipe
2025-10-01T14:13:26.770753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784072976:2446], now have 1 active actors on pipe
2025-10-01T14:13:26.770760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256250407173674:10502]
2025-10-01T14:13:26.770766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256250407173674:10502]
2025-10-01T14:13:26.770768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256250407173674:10502]
2025-10-01T14:13:26.770781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:26.770822Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1971
2025-10-01T14:13:26.770791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:26.770822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1971
2025-10-01T14:13:26.770793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:26.770794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:26.770803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:26.770815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:26.770817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:26.770838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256250407173674:10502]
2025-10-01T14:13:26.770845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:26.770862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:26.770927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.770935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.770953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7065662c-27bd91e7-fb119abe-54eebaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:26.770961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.770964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.770965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:26.770970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.770976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:26.770986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.771133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.771139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.771151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.771214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1972 partition: 0 MaxSeqNo: 45 sessionId: src_id|7065662c-27bd91e7-fb119abe-54eebaf_0
2025-10-01T14:13:26.771523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|62398418-40704dbf-b003a7c3-988e4055_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7065662c-27bd91e7-fb119abe-54eebaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:26.773796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7065662c-27bd91e7-fb119abe-54eebaf_0] Write session: try to update token
2025-10-01T14:13:26.773812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7065662c-27bd91e7-fb119abe-54eebaf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:26.786238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1972 sessionId: src_id|7065662c-27bd91e7-fb119abe-54eebaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:26.788437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:26.790093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.790115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.790133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:26.790135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:26.790137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:26.790138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:26.790144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256250407173674:10502]
2025-10-01T14:13:26.790147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256250407173674:10502]
2025-10-01T14:13:26.790150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256250407173674:10502]
2025-10-01T14:13:26.790190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:26.790200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.790203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:26.790212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:26.790218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:26.790222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:26.790329Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:26.843948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256252784073290:10286]
2025-10-01T14:13:26.844228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 1971, pipe: [1:7556256252784073290:10286]
2025-10-01T14:13:26.931805Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:26.932394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:26.932439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784073290:10286], now have 1 active actors on pipe
2025-10-01T14:13:26.932539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:26.932589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256252784073290:10286]
2025-10-01T14:13:26.932616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:26.932657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:26.932665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:26.932731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1972 reason: error at write: Disconnected sessionId: src_id|7065662c-27bd91e7-fb119abe-54eebaf_0
2025-10-01T14:13:26.932914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1972 sessionId: src_id|7065662c-27bd91e7-fb119abe-54eebaf_0 is DEAD
2025-10-01T14:13:26.933053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7065662c-27bd91e7-fb119abe-54eebaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:26.933062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7065662c-27bd91e7-fb119abe-54eebaf_0] Write session will restart in 0.008229s
2025-10-01T14:13:26.933085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7065662c-27bd91e7-fb119abe-54eebaf_0] Write session: Do CDS request
2025-10-01T14:13:26.933094Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7065662c-27bd91e7-fb119abe-54eebaf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:26.942869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7065662c-27bd91e7-fb119abe-54eebaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.942964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:26.942980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1973
2025-10-01T14:13:26.943073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:26.943106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:26.943112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:26.943116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:26.943610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1973 sessionId:  describe result for acl check
2025-10-01T14:13:26.943650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:26.943658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:26.943660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:26.943666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256252784073383:10697] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:26.944214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256252784073383:10697] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:26.946674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256252784073383:10697] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:26.949644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256252784073383:10697] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:26.949658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256252784073383:10697] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:26.949664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256252784073383:10697] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:26.949671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:26.951861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:26.954544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:26.955058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:26.955076Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:26.955087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:26.955138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:26.955180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256250407173994:10504]
2025-10-01T14:13:26.955804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:26.956069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:26.956114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:26.956440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:26.956507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.956514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.956516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.956517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.956519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.956520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.956522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.956523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.956525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.956526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.956528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.956529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.956531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.956532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.956538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.956550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.956555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.956560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.956565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.956570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.956574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.956579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.956584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.956589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.956593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.956598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.956602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.956617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.956630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.956640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:26.956651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.956657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:26.956667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.956679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:26.956684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.956694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:26.956704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.956710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:26.956717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.956727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:26.956732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.956742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:26.956748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.956757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:26.956766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.956772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:26.956783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.956793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.956802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.956808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.956816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.956822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.956830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.956836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:26.956845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.956851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:26.956899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:26.960513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:26.961127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:26.961139Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:26.961142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:26.961145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:26.961152Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1972 [2:7556256250407173994:10504]
2025-10-01T14:13:26.961167Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:26.961183Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:26.961187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.961190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.961193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.961207Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:26.961217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:26.961223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:26.961273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.961281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.961283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.961287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:26.961290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:26.961353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:26.961361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.961374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:26.961390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:26.961413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:26.961436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784073585:10697], now have 1 active actors on pipe
2025-10-01T14:13:26.961444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256252784073294:2446], now have 1 active actors on pipe
2025-10-01T14:13:26.961451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256250407173985:10504]
2025-10-01T14:13:26.961458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256250407173985:10504]
2025-10-01T14:13:26.961460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256250407173985:10504]
2025-10-01T14:13:26.961475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:26.961446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1972
2025-10-01T14:13:26.961469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1972
2025-10-01T14:13:26.961487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:26.961492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:26.961496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:26.961497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:26.961508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:26.961513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:26.961553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.961563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.961586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256250407173985:10504]
2025-10-01T14:13:26.961598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:26.961605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:26.961627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:26.961638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:26.961646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:26.961649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:26.961658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:26.961670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:26.961696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.961846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.961855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.961869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:26.961946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1973 partition: 0 MaxSeqNo: 45 sessionId: src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0
2025-10-01T14:13:26.962297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7065662c-27bd91e7-fb119abe-54eebaf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:26.964601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Write session: try to update token
2025-10-01T14:13:26.964633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:26.978517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1973 sessionId: src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:26.980718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:26.982417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:26.982442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:26.982463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:26.982467Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:26.982469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:26.982472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:26.982480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256250407173985:10504]
2025-10-01T14:13:26.982484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256250407173985:10504]
2025-10-01T14:13:26.982488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256250407173985:10504]
2025-10-01T14:13:26.982533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:26.982542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:26.982545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:26.982549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:26.982550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:26.982552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:26.982675Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:27.032875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256257079040907:10286]
2025-10-01T14:13:27.033118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 1972, pipe: [1:7556256257079040907:10286]
2025-10-01T14:13:27.134472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:27.134692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:27.134738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079040907:10286], now have 1 active actors on pipe
2025-10-01T14:13:27.134841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:27.134936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256257079040907:10286]
2025-10-01T14:13:27.134958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:27.142762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:27.144038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:27.144226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:27.144238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:27.144251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:27.144307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:27.144345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256254702141349:10507]
2025-10-01T14:13:27.144936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:27.145219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:27.145265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:27.145589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:27.145583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:27.145597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:27.145617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1973 reason: error at write: Disconnected sessionId: src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0
2025-10-01T14:13:27.145662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.145668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.145669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.145671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.145672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.145673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.145675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.145676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.145678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.145679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.145680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.145681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.145682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.145684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.145690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.145700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.145704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.145709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.145713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.145717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.145721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.145725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.145729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.145733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.145737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.145741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.145745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.145749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.145757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.145764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.145771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.145776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.145783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.145788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.145798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.145803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.145811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.145816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.145827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.145765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1973 sessionId: src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0 is DEAD
2025-10-01T14:13:27.145832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.145841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.145847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.145855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.145861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.145865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.145871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.145875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.145880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.145891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.145896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.145904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.145909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.145918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.145923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.145932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.145937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.145941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:27.145954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Write session will restart in 0.007970s
2025-10-01T14:13:27.145979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Write session: Do CDS request
2025-10-01T14:13:27.145985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:27.145977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:27.154936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.155173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:27.155385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:27.155402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1974
2025-10-01T14:13:27.155943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:27.155956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:27.155959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:27.155963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:27.155971Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1973 [2:7556256254702141349:10507]
2025-10-01T14:13:27.155987Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:27.156009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:27.156016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.156019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.156022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.156040Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:27.156051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:27.156063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:27.156119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.156126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.156128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.156132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:27.156135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:27.156202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:27.156209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.156221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.156236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.156255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:27.156292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079040922:2446], now have 1 active actors on pipe
2025-10-01T14:13:27.156304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256254702141344:10507]
2025-10-01T14:13:27.156307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256254702141344:10507]
2025-10-01T14:13:27.156309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256254702141344:10507]
2025-10-01T14:13:27.156321Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:27.156335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:27.156349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:27.156356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:27.156392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256254702141344:10507]
2025-10-01T14:13:27.156399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:27.156408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:27.156417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:27.156420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:27.156426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:27.155573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.155604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:27.155612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:27.155615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:27.156013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1974 sessionId:  describe result for acl check
2025-10-01T14:13:27.156039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:27.156041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:27.156043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:27.156048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256257079040947:10709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:27.156504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1973
2025-10-01T14:13:27.156541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256257079040947:10709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:27.166320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256257079040947:10709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:27.177821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256257079040947:10709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:27.177840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256257079040947:10709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:27.177843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256257079040947:10709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:27.177853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:27.179076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1973
2025-10-01T14:13:27.179936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079040997:10709], now have 1 active actors on pipe
2025-10-01T14:13:27.179966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.179974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.179993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:27.179997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:27.179999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:27.180001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:27.180009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256254702141344:10507]
2025-10-01T14:13:27.180014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256254702141344:10507]
2025-10-01T14:13:27.180018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256254702141344:10507]
2025-10-01T14:13:27.180077Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3abdbbbb-ba1b5aa4-bcc6e9e-4d70bc92_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:27.180087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.180092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.180095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:27.180107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.180123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:27.180133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:27.180138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.180140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:27.180277Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:27.182423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:27.182429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:27.182435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:27.235113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256257079041010:10286]
2025-10-01T14:13:27.235531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 1973, pipe: [1:7556256257079041010:10286]
2025-10-01T14:13:27.340348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-10-01T14:13:27.340364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Write session will restart in 0.010933s
2025-10-01T14:13:27.340395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Write session: Do CDS request
2025-10-01T14:13:27.340402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:27.339555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:27.339595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1974 reason: pipe to partition's 0 tablet is dead #2 sessionId: 
2025-10-01T14:13:27.339813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1974 sessionId:  is DEAD
2025-10-01T14:13:27.339925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256257079041010:10286]
2025-10-01T14:13:27.339940Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:27.338168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:27.338900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:27.338956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041010:10286], now have 1 active actors on pipe
2025-10-01T14:13:27.346799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:27.348310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:27.348488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:27.348497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:27.348507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:27.348546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:27.348582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256254702141428:10512]
2025-10-01T14:13:27.349272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:27.349596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:27.349652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:27.349989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:27.350058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.350060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.350061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.350062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.350063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.350064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.350066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.350067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.350068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.350069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.350070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.350071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.350073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.350074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.350080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.350090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.350094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.350098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.350102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.350106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.350110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.350114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.350118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.350122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.350126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.350129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.350133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.350137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.350145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.350153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.350159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.350163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.350171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.350176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.350182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.350187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.350192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.350197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.350201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.350206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.350212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.350217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.350222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.350227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.350232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.350237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.350242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.350247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.350251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.350257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.350262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.350267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.350273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.350279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.350282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.350309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.350349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:27.352936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.353276Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:27.353290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1975
2025-10-01T14:13:27.353466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.353497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:27.353502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:27.353506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:27.353945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1975 sessionId:  describe result for acl check
2025-10-01T14:13:27.353979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:27.353981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:27.353983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:27.353988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256257079041038:10720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:27.354531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256257079041038:10720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:27.354737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:27.355344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:27.355362Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:27.355365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:27.355368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:27.355376Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1974 [2:7556256254702141428:10512]
2025-10-01T14:13:27.355391Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:27.355411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:27.355419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.355423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.355429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.355447Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:27.355462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:27.355468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:27.355526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.355702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1974
2025-10-01T14:13:27.355529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.355531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.355534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:27.355537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:27.355604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:27.355607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.355620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.355631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.355645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:27.355664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041013:2446], now have 1 active actors on pipe
2025-10-01T14:13:27.355673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256254702141423:10512]
2025-10-01T14:13:27.355676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256254702141423:10512]
2025-10-01T14:13:27.355678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256254702141423:10512]
2025-10-01T14:13:27.355696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:27.355706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:27.355708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:27.355709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:27.355710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:27.355724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:27.355726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:27.355763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256254702141423:10512]
2025-10-01T14:13:27.355773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:27.355780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:27.356680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256257079041038:10720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:27.362853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256257079041038:10720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:27.362868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256257079041038:10720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:27.362872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256257079041038:10720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:27.362881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:27.363352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041075:10720], now have 1 active actors on pipe
2025-10-01T14:13:27.363394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1974
2025-10-01T14:13:27.363539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.363552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.363583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:27.363598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.363608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.363611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:27.363623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.363642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:27.363665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:27.363905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.363911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.363923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:27.364023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1975 partition: 0 MaxSeqNo: 45 sessionId: src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0
2025-10-01T14:13:27.367283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5805d13c-c0382919-ceb5c3ee-4912e641_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:27.369776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0] Write session: try to update token
2025-10-01T14:13:27.369795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:27.381332Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:27.381358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:27.381362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:27.381364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:27.381378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256254702141423:10512]
2025-10-01T14:13:27.381385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256254702141423:10512]
2025-10-01T14:13:27.381392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256254702141423:10512]
2025-10-01T14:13:27.381448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:27.381458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:27.381462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:27.381463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:27.381472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.381475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:27.381752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:27.388883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1975 sessionId: src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:27.391145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:27.440007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256257079041079:10286]
2025-10-01T14:13:27.440353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 1974, pipe: [1:7556256257079041079:10286]
2025-10-01T14:13:27.531704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:27.531947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.531964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.532005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041079:10286], now have 1 active actors on pipe
2025-10-01T14:13:27.532170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:27.532182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:27.532191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:27.532222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1975 reason: error at write: Disconnected sessionId: src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0
2025-10-01T14:13:27.532224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256257079041079:10286]
2025-10-01T14:13:27.532293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:27.532372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1975 sessionId: src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0 is DEAD
2025-10-01T14:13:27.532509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:27.532520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0] Write session will restart in 0.008006s
2025-10-01T14:13:27.532545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0] Write session: Do CDS request
2025-10-01T14:13:27.532551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:27.539608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:27.541145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:27.541358Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:27.541368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:27.541381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:27.541453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:27.541495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256254702141516:10524]
2025-10-01T14:13:27.541936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.542012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:27.542033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1976
2025-10-01T14:13:27.542095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:27.542139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.542166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:27.542175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:27.542178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:27.542509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:27.542564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:27.542563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1976 sessionId:  describe result for acl check
2025-10-01T14:13:27.542590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:27.542596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:27.542598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:27.542603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256257079041128:10726] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:27.542875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:27.542948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.542954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.542957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.542958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.542959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.542960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.542962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.542963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.542964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.542965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.542966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.542967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.542968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.542969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.542975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.542985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.542989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.542993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.542997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.543000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.543004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.543007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.543011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.543015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.543019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.543027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.543030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.543033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.543039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.543047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.543058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.543063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.543072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.543078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.543085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.543086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256257079041128:10726] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:27.543091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.543099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.543105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.543110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.543115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.543121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.543126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.543130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.543138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.543143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.543152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.543156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.543165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.543169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.543178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.543182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.543191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.543195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.543201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.543211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.543216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.543276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:27.545129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256257079041128:10726] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:27.546896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:27.547614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256257079041128:10726] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:27.547628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256257079041128:10726] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:27.547631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256257079041128:10726] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:27.547639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:27.547818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1975
2025-10-01T14:13:27.547953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1975
2025-10-01T14:13:27.547542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:27.547556Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:27.547558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:27.547561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:27.547567Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1975 [2:7556256254702141516:10524]
2025-10-01T14:13:27.547581Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:27.547596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:27.547600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.547603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.547607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.547622Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:27.547626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:27.547632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:27.547678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.547680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.547681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.547685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:27.547687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:27.547747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:27.547750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.547759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.547769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.547784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:27.547801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041102:2446], now have 1 active actors on pipe
2025-10-01T14:13:27.547808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256254702141511:10524]
2025-10-01T14:13:27.547810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256254702141511:10524]
2025-10-01T14:13:27.547811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256254702141511:10524]
2025-10-01T14:13:27.547824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:27.547836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:27.547837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:27.547839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:27.547841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:27.547852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:27.547855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:27.547877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256254702141511:10524]
2025-10-01T14:13:27.547881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:27.547886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:27.547904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041162:10726], now have 1 active actors on pipe
2025-10-01T14:13:27.548136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.548145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.548166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:27.548172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.548181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.548182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:27.548190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.548201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:27.548217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:27.548361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.548367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.548378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:27.548470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1976 partition: 0 MaxSeqNo: 45 sessionId: src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0
2025-10-01T14:13:27.548807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5474d7a-947b6f24-547542a8-fc3bcbcb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:27.551191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0] Write session: try to update token
2025-10-01T14:13:27.551206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:27.563896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1976 sessionId: src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:27.565941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:27.565958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:27.565968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256254702141511:10524]
2025-10-01T14:13:27.566021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:27.566038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:27.566198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:27.566221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:27.566337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:27.566493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:27.566627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:27.566805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:27.566852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.566865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.566886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:27.566919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:27.567011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:27.578010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:27.578026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:27.578029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:27.578031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:27.578040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256254702141511:10524]
2025-10-01T14:13:27.578044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256254702141511:10524]
2025-10-01T14:13:27.578047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256254702141511:10524]
2025-10-01T14:13:27.578090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:27.578093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:27.578097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.578099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:27.578100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:27.578104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:27.578226Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:27.632465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256257079041170:10286]
2025-10-01T14:13:27.632725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 1975, pipe: [1:7556256257079041170:10286]
2025-10-01T14:13:27.732222Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:27.740149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.740173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.740347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.740410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.740476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.740546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.740591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.740600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.740683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.740742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.740806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.740872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.740914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.740920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.740979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.741036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.741100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.741159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.741200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.741207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.741272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.741331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.741389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.741455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.741499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.741506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.741577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.741632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.741686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.741742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.741783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.741789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.741850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.741909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.741972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.742037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.742083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.742089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.742154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.742210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.742270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.742333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.742386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.742392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.742452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.742507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.742566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.742629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.742675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.742681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.742749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.742806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.742870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.742931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.742973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.742980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.743044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.743101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.743165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.743224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.743266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.743272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.743330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041170:10286], now have 1 active actors on pipe
2025-10-01T14:13:27.743596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:27.743615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256257079041170:10286]
2025-10-01T14:13:27.743652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:27.743654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:27.743679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1976 reason: error at write: Disconnected sessionId: src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0
2025-10-01T14:13:27.743862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1976 sessionId: src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0 is DEAD
2025-10-01T14:13:27.743997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:27.744006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0] Write session will restart in 0.008323s
2025-10-01T14:13:27.744031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0] Write session: Do CDS request
2025-10-01T14:13:27.744036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:27.744365Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:27.749679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:27.750813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:27.750962Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:27.750972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:27.750981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:27.751014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:27.751052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256254702141578:10527]
2025-10-01T14:13:27.751641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:27.751887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:27.751921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:27.752206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:27.752246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.752253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.752254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.752255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.752256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.752257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.752258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.752261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.752261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.752263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.752264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.752265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.752266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.752267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.752271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.752280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.752283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.752287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.752290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.752293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.752296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.752299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.752302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.752306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.752309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.752313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.752316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.752319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.752324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.752330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.752335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.752340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.752344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.752348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.752352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.752361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.752367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.752374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.752378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.752387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.752391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.752395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.752398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.752406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.752410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.752417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.752425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.752430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.752434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.752442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.752447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.752455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.752462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.752467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.752474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.752478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.752516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:27.753840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.753941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:27.753963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1977
2025-10-01T14:13:27.754052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.754073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:27.754080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:27.754083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:27.754358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1977 sessionId:  describe result for acl check
2025-10-01T14:13:27.754394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:27.754398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:27.754400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:27.754403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256257079041198:10730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:27.754770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256257079041198:10730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:27.755960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:27.756509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:27.756521Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:27.756523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:27.756526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:27.756532Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1976 [2:7556256254702141578:10527]
2025-10-01T14:13:27.756544Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:27.756561Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:27.756569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.756572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.756576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.756590Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:27.756595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:27.756603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:27.756656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.756662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.756664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.756667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:27.756669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:27.756728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:27.756734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.756744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.756757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.756774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:27.756793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041172:2446], now have 1 active actors on pipe
2025-10-01T14:13:27.756804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256254702141573:10527]
2025-10-01T14:13:27.756805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256254702141573:10527]
2025-10-01T14:13:27.756807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256254702141573:10527]
2025-10-01T14:13:27.756818Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:27.756825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:27.756801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1976
2025-10-01T14:13:27.756828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:27.756830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:27.756833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:27.756845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:27.756847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:27.756870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256254702141573:10527]
2025-10-01T14:13:27.756879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:27.756885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:27.757212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256257079041198:10730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:27.763219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256257079041198:10730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:27.763237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256257079041198:10730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:27.763240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256257079041198:10730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:27.763247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:27.763445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041237:10730], now have 1 active actors on pipe
2025-10-01T14:13:27.763469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1976
2025-10-01T14:13:27.763521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.763532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.763556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa235e60-7b950501-4ceba262-b0d46e02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:27.763567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.763571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.763574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:27.763584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.763594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:27.763609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:27.763726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.763732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.763744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:27.763813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1977 partition: 0 MaxSeqNo: 45 sessionId: src_id|aa235e60-7b950501-4ceba262-b0d46e02_0
2025-10-01T14:13:27.764148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4c09a20-6e440940-a251cc19-dbc5613d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aa235e60-7b950501-4ceba262-b0d46e02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:27.766557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa235e60-7b950501-4ceba262-b0d46e02_0] Write session: try to update token
2025-10-01T14:13:27.766572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa235e60-7b950501-4ceba262-b0d46e02_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:27.767551Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:27.767567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:27.767574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256254702141573:10527]
2025-10-01T14:13:27.767608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:27.767607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:27.767761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:27.767892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:27.768022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:27.768151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:27.768327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:27.768357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:27.780291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1977 sessionId: src_id|aa235e60-7b950501-4ceba262-b0d46e02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:27.782751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:27.782963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.782989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.783022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:27.783111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:27.786248Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:27.786264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:27.786266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:27.786268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:27.786278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256254702141573:10527]
2025-10-01T14:13:27.786283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256254702141573:10527]
2025-10-01T14:13:27.786286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256254702141573:10527]
2025-10-01T14:13:27.786319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:27.786328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:27.786330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:27.786331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:27.786337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.786340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:27.786486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:27.843870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256257079041241:10286]
2025-10-01T14:13:27.844106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 1976, pipe: [1:7556256257079041241:10286]
2025-10-01T14:13:27.935087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:27.943178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.943200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.943338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.943389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.943441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.943491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.943540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.943548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.943606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.943668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.943727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.943786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.943828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.943833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.943897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.943954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.944010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.944070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.944112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.944118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.944183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.944243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.944302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.944361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.944405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.944410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.944473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.944525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.944583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.944657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.944697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.944703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.944766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.944824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.944883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.944945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.944988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.944994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.945056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.945111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.945170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.945232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.945274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.945280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.945346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.945403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.945461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.945524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.945565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.945571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.945631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.945690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.945749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.945813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.945857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.945862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.945926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:27.945987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:27.946047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:27.946107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:27.946151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:27.946157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:27.946223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041241:10286], now have 1 active actors on pipe
2025-10-01T14:13:27.946471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:27.946508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256257079041241:10286]
2025-10-01T14:13:27.946529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:27.946535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:27.946568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1977 reason: error at write: Disconnected sessionId: src_id|aa235e60-7b950501-4ceba262-b0d46e02_0
2025-10-01T14:13:27.946776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1977 sessionId: src_id|aa235e60-7b950501-4ceba262-b0d46e02_0 is DEAD
2025-10-01T14:13:27.946911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa235e60-7b950501-4ceba262-b0d46e02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:27.946919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa235e60-7b950501-4ceba262-b0d46e02_0] Write session will restart in 0.005555s
2025-10-01T14:13:27.946947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa235e60-7b950501-4ceba262-b0d46e02_0] Write session: Do CDS request
2025-10-01T14:13:27.946953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa235e60-7b950501-4ceba262-b0d46e02_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:27.947087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:27.953333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:27.953858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa235e60-7b950501-4ceba262-b0d46e02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.953931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:27.953947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1978
2025-10-01T14:13:27.954069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:27.954095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:27.954100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:27.954103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:27.954506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1978 sessionId:  describe result for acl check
2025-10-01T14:13:27.954537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:27.954542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:27.954544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:27.954549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256257079041272:10735] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:27.954597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:27.954738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:27.954746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:27.954756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:27.954792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:27.954831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256254702141639:10529]
2025-10-01T14:13:27.955022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256257079041272:10735] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:27.955460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:27.955683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:27.955716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:27.955993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:27.956038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.956045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.956046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.956047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.956049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.956049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.956050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.956052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.956053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.956054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.956056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.956057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.956058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.956059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.956063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.956072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.956075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.956078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.956091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.956094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.956098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.956101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.956104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.956107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.956111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.956116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.956123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.956126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.956135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.956145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:27.956154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.956162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:27.956171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.956179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:27.956185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.956193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:27.956201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.956209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:27.956216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.956220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:27.956228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.956234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:27.956241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.956245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:27.956252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.956257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:27.956263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.956267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.956274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.956279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.956286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.956291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.956298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.956302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:27.956308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.956313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:27.956350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:27.956959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256257079041272:10735] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:27.959676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256257079041272:10735] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:27.959686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256257079041272:10735] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:27.959690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256257079041272:10735] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:27.959696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:27.959890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:27.960495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:27.960507Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:27.960509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:27.960513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:27.960518Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1977 [2:7556256254702141639:10529]
2025-10-01T14:13:27.960535Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:27.960563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:27.960569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.960573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.960575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.960591Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:27.960600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:27.960620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:27.960668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.960675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.960677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.960679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:27.960681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:27.960743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:27.960750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.960761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:27.960771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:27.960785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:27.960807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041245:2446], now have 1 active actors on pipe
2025-10-01T14:13:27.960813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256257079041307:10735], now have 1 active actors on pipe
2025-10-01T14:13:27.960820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256254702141634:10529]
2025-10-01T14:13:27.960825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256254702141634:10529]
2025-10-01T14:13:27.960827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256254702141634:10529]
2025-10-01T14:13:27.960838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:27.960848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:27.960852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:27.960855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:27.960857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:27.960861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:27.960863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:27.960843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1977
2025-10-01T14:13:27.960848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1977
2025-10-01T14:13:27.960881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256254702141634:10529]
2025-10-01T14:13:27.960887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:27.960890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:27.960904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.960908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.960949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|786cff61-39188340-355a0532-506389aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:27.960959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:27.960963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:27.960965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:27.960971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:27.960978Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:27.960991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:27.961131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.961137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.961149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:27.961214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1978 partition: 0 MaxSeqNo: 45 sessionId: src_id|786cff61-39188340-355a0532-506389aa_0
2025-10-01T14:13:27.961522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa235e60-7b950501-4ceba262-b0d46e02_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|786cff61-39188340-355a0532-506389aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:27.963997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|786cff61-39188340-355a0532-506389aa_0] Write session: try to update token
2025-10-01T14:13:27.964013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|786cff61-39188340-355a0532-506389aa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:27.977692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1978 sessionId: src_id|786cff61-39188340-355a0532-506389aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:27.980001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:27.981341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:27.981364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:27.981386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:27.981390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:27.981392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:27.981395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:27.981408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256254702141634:10529]
2025-10-01T14:13:27.981413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256254702141634:10529]
2025-10-01T14:13:27.981418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256254702141634:10529]
2025-10-01T14:13:27.981457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:27.981464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:27.981467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:27.981480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:27.981491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:27.981493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:27.981637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:28.046620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256261374008611:10286]
2025-10-01T14:13:28.046889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 1977, pipe: [1:7556256261374008611:10286]
2025-10-01T14:13:28.130844Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:28.131157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:28.131217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008611:10286], now have 1 active actors on pipe
2025-10-01T14:13:28.131902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786cff61-39188340-355a0532-506389aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:28.131913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786cff61-39188340-355a0532-506389aa_0] Write session will restart in 0.006555s
2025-10-01T14:13:28.131940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786cff61-39188340-355a0532-506389aa_0] Write session: Do CDS request
2025-10-01T14:13:28.131945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786cff61-39188340-355a0532-506389aa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:28.131455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:28.131551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:28.131554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:28.131622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1978 reason: error at write: Disconnected sessionId: src_id|786cff61-39188340-355a0532-506389aa_0
2025-10-01T14:13:28.131784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1978 sessionId: src_id|786cff61-39188340-355a0532-506389aa_0 is DEAD
2025-10-01T14:13:28.131937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:28.131972Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256261374008611:10286]
2025-10-01T14:13:28.139877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|786cff61-39188340-355a0532-506389aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.139919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:28.140167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:28.140184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1979
2025-10-01T14:13:28.140315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.140356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:28.140365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:28.140369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:28.140772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1979 sessionId:  describe result for acl check
2025-10-01T14:13:28.140817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:28.140824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:28.140826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:28.140831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256261374008638:10739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:28.141342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256261374008638:10739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:28.141909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:28.142102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:28.142113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:28.142126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:28.142184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:28.142222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256258997108999:10532]
2025-10-01T14:13:28.142828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:28.143122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:28.143153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256261374008638:10739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:28.143180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:28.143509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:28.143594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.143603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.143604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.143606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.143607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.143608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.143609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.143611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.143613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.143615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.143616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.143616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.143618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.143619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.143625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.143634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.143639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.143645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.143649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.143654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.143657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.143661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.143665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.143669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.143673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.143677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.143681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.143684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.143691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.143702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.143708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.143714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.143718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.143725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.143729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.143734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.143741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.143746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.143756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.143761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.143772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.143777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.143781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.143791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.143796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.143804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.143810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.143819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.143824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.143833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.143838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.143846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.143850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.143859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.143865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.143875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.143914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:28.147632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256261374008638:10739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:28.147663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256261374008638:10739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:28.147667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256261374008638:10739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:28.147675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:28.147742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:28.148345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:28.148360Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:28.148363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:28.148366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:28.148373Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1978 [2:7556256258997108999:10532]
2025-10-01T14:13:28.148387Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:28.148403Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:28.148409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.148412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.148417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.148432Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:28.148442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:28.148454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:28.148510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.148517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.148519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.148523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:28.148526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:28.148586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:28.148593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.148614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.148625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.148645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:28.148666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008677:10739], now have 1 active actors on pipe
2025-10-01T14:13:28.148675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008614:2446], now have 1 active actors on pipe
2025-10-01T14:13:28.148683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256258997108994:10532]
2025-10-01T14:13:28.148685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256258997108994:10532]
2025-10-01T14:13:28.148687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256258997108994:10532]
2025-10-01T14:13:28.148700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:28.148712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:28.148719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:28.148726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:28.148728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:28.148729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:28.148730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:28.148722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1978
2025-10-01T14:13:28.148758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256258997108994:10532]
2025-10-01T14:13:28.148734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1978
2025-10-01T14:13:28.148766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:28.148768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:28.148791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.148796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.148830Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:28.148841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.148845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.148851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:28.148859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.148872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:28.148892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.148990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.148996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.149010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.149107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1979 partition: 0 MaxSeqNo: 45 sessionId: src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0
2025-10-01T14:13:28.149501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|786cff61-39188340-355a0532-506389aa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:28.152037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0] Write session: try to update token
2025-10-01T14:13:28.152058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:28.165465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1979 sessionId: src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:28.167807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:28.167927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.167946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.169795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:28.169829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:28.169832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:28.169837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:28.169839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:28.169848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256258997108994:10532]
2025-10-01T14:13:28.169853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256258997108994:10532]
2025-10-01T14:13:28.169856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256258997108994:10532]
2025-10-01T14:13:28.169899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:28.169901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:28.169907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:28.169911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:28.169914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.169916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:28.170001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:28.170047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:28.231967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256261374008697:10286]
2025-10-01T14:13:28.232267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 1978, pipe: [1:7556256261374008697:10286]
2025-10-01T14:13:28.317078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:28.324400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.324425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.324575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.324649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.324708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.324759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.324961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.324965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.325026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.325073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.325123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.325175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.325211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.325213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.325265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.325309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.325356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.325401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.325436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.325437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.325488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.325785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.325829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.325874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.325907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.325909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.325962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.326008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.326056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.326100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.326135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.326137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.326186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.326231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.326281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.326335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.326416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.326421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.326485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.326537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.326591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.326657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.326707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.326713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.326775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.326830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.326885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.326940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.326980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.326985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.327042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.327094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.327147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.327200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.327238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.327246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.327314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.327377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.327440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.327497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.327540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.327546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.327611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008697:10286], now have 1 active actors on pipe
2025-10-01T14:13:28.327814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:28.327868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:28.327874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:28.327900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1979 reason: error at write: Disconnected sessionId: src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0
2025-10-01T14:13:28.328092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1979 sessionId: src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0 is DEAD
2025-10-01T14:13:28.328147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:28.328229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:28.328240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0] Write session will restart in 0.008327s
2025-10-01T14:13:28.328267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0] Write session: Do CDS request
2025-10-01T14:13:28.328273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:28.328403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256261374008697:10286]
2025-10-01T14:13:28.334557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:28.336039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:28.336182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:28.336189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:28.336198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:28.336246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:28.336272Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256258997109083:10537]
2025-10-01T14:13:28.336677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:28.336868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:28.336893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:28.337084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:28.337117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.337121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.337122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.337122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.337123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.337124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.337124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.337125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.337125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.337126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.337127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.337128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.337128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.337129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.337132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.337138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.337140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.337143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.337145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.337147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.337149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.337151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.337153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.337157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.337158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.337160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.337162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.337164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.337170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.337174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.337178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.337181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.337183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.337185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.337187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.337190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.337192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.337196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.337198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.337201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.337203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.337206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.337209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.337211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.337213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.337216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.337218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.337221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.337223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.337225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.337227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.337230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.337233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.337235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.337237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.337240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.337259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:28.337862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.337972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:28.337985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1980
2025-10-01T14:13:28.338107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.338133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:28.338143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:28.338151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:28.338511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1980 sessionId:  describe result for acl check
2025-10-01T14:13:28.338546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:28.338551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:28.338553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:28.338557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256261374008738:10750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:28.339055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256261374008738:10750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:28.340602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:28.340602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256261374008738:10750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:28.341217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:28.341226Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:28.341227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:28.341230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:28.341234Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1979 [2:7556256258997109083:10537]
2025-10-01T14:13:28.341244Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:28.341266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:28.341271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.341273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.341274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.341287Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:28.341290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:28.341294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:28.341336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.341341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.341342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.341344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:28.341345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:28.341393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:28.341398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.341405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.341410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.341422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:28.341436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256258997109078:10537]
2025-10-01T14:13:28.341441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256258997109078:10537]
2025-10-01T14:13:28.341442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256258997109078:10537]
2025-10-01T14:13:28.341450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:28.341461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008709:2446], now have 1 active actors on pipe
2025-10-01T14:13:28.341472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:28.341472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:28.341475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:28.341477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:28.341487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:28.341490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:28.341467Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1979
2025-10-01T14:13:28.341513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256258997109078:10537]
2025-10-01T14:13:28.341519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:28.341534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:28.346415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256261374008738:10750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:28.346432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256261374008738:10750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:28.346436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256261374008738:10750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:28.346443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:28.346663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008777:10750], now have 1 active actors on pipe
2025-10-01T14:13:28.346736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1979
2025-10-01T14:13:28.346789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.346804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.346834Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2e6795-189343da-b04a200e-8ad18159_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:28.346849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.346854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.346857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:28.346867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.346883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:28.346901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.347026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.347031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.347043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.347108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1980 partition: 0 MaxSeqNo: 45 sessionId: src_id|a2e6795-189343da-b04a200e-8ad18159_0
2025-10-01T14:13:28.347445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|72f7ae82-42d5e05-975d59ed-3cfcf43f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a2e6795-189343da-b04a200e-8ad18159_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:28.350005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e6795-189343da-b04a200e-8ad18159_0] Write session: try to update token
2025-10-01T14:13:28.350022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e6795-189343da-b04a200e-8ad18159_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:28.351751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:28.351763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:28.351770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256258997109078:10537]
2025-10-01T14:13:28.351803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:28.351811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:28.351962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:28.352094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:28.352233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:28.352356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:28.352528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:28.352558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:28.363311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1980 sessionId: src_id|a2e6795-189343da-b04a200e-8ad18159_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:28.365754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:28.365986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.366006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.366051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:28.366124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:28.370888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:28.370902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:28.370904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:28.370906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:28.370917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256258997109078:10537]
2025-10-01T14:13:28.370920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256258997109078:10537]
2025-10-01T14:13:28.370923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256258997109078:10537]
2025-10-01T14:13:28.370958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:28.370962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.370963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:28.370964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:28.370970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:28.370975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:28.371079Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:28.428604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256261374008780:10286]
2025-10-01T14:13:28.428866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 1979, pipe: [1:7556256261374008780:10286]
2025-10-01T14:13:28.525459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:28.533348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.533375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.533525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.533582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.533645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.533704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.533748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.533757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.533817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.533873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.533952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.534030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.534091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.534105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.534171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.534229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.534300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.534362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.534423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.534430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.534491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.534547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.534632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.534693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.534735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.534742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.534802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.534862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.534939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.534996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.535045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.535051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.535114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.535189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.535249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.535308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.535351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.535360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.535433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.535491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.535556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.535618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.535658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.535664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.535728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.535791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.535850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.535908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.535953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.535960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.536023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.536083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.536148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.536208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.536273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.536280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.536346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:28.536403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:28.536461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:28.536525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:28.536567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:28.536573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:28.536691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008780:10286], now have 1 active actors on pipe
2025-10-01T14:13:28.536887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:28.536898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:28.536902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:28.536927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1980 reason: error at write: Disconnected sessionId: src_id|a2e6795-189343da-b04a200e-8ad18159_0
2025-10-01T14:13:28.536938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256261374008780:10286]
2025-10-01T14:13:28.537225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e6795-189343da-b04a200e-8ad18159_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:28.537235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e6795-189343da-b04a200e-8ad18159_0] Write session will restart in 0.005015s
2025-10-01T14:13:28.537259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e6795-189343da-b04a200e-8ad18159_0] Write session: Do CDS request
2025-10-01T14:13:28.537264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e6795-189343da-b04a200e-8ad18159_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:28.537131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1980 sessionId: src_id|a2e6795-189343da-b04a200e-8ad18159_0 is DEAD
2025-10-01T14:13:28.537728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:28.543911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e6795-189343da-b04a200e-8ad18159_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.544015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:28.544234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:28.544248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1981
2025-10-01T14:13:28.544341Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.544363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:28.544370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:28.544373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:28.544751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1981 sessionId:  describe result for acl check
2025-10-01T14:13:28.544783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:28.544790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:28.544791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:28.544797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256261374008828:10756] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:28.545263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256261374008828:10756] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:28.545490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:28.545675Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:28.545683Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:28.545699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:28.545750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:28.545786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256258997109160:10541]
2025-10-01T14:13:28.546325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:28.546554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:28.546579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:28.546803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:28.546864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.546873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.546875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.546875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.546877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.546878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.546879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.546880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.546880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.546886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.546887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.546888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.546889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.546890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.546894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.546902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.546905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.546909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.546912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.546915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.546918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.546921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.546925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.546928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.546931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.546934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.546937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.546940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.546945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.546952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.546956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.546961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.546964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.546968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.546972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.546976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.546989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.546994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.546997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.547001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.547006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.547010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.547013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.547017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.547022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.547026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.547030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.547034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.547037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.547042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.547045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.547049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.547053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.547057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.547060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.547064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.547095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:28.547118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256261374008828:10756] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:28.550358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256261374008828:10756] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:28.550387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256261374008828:10756] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:28.550391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256261374008828:10756] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:28.550398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:28.550602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:28.551203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:28.551213Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:28.551214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:28.551217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:28.551222Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1980 [2:7556256258997109160:10541]
2025-10-01T14:13:28.551232Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:28.551245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:28.551250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.551253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.551254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.551264Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:28.551272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:28.551279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:28.551319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.551324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.551325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.551327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:28.551329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:28.551386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:28.551393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.551403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.551411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.551431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:28.551448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008803:2446], now have 1 active actors on pipe
2025-10-01T14:13:28.551451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008868:10756], now have 1 active actors on pipe
2025-10-01T14:13:28.551457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256258997109155:10541]
2025-10-01T14:13:28.551462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256258997109155:10541]
2025-10-01T14:13:28.551463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256258997109155:10541]
2025-10-01T14:13:28.551474Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:28.551485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:28.551492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1980
2025-10-01T14:13:28.551492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1980
2025-10-01T14:13:28.551498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:28.551503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:28.551505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:28.551505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:28.551507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:28.551531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256258997109155:10541]
2025-10-01T14:13:28.551533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:28.551534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:28.551557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.551566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.551596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:28.551609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.551615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.551617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:28.551626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.551634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:28.551655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.551790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.551798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.551811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.551889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1981 partition: 0 MaxSeqNo: 45 sessionId: src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0
2025-10-01T14:13:28.552228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2e6795-189343da-b04a200e-8ad18159_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:28.554532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0] Write session: try to update token
2025-10-01T14:13:28.554548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:28.569069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1981 sessionId: src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:28.570981Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:28.570998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:28.570999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:28.571001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:28.571009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256258997109155:10541]
2025-10-01T14:13:28.571014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256258997109155:10541]
2025-10-01T14:13:28.571018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256258997109155:10541]
2025-10-01T14:13:28.571058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:28.571064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.571065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:28.571067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:28.571073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:28.571077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:28.571191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:28.571628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:28.636963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256261374008876:10286]
2025-10-01T14:13:28.637232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 1980, pipe: [1:7556256261374008876:10286]
2025-10-01T14:13:28.707562Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:28.707826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.707837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.707874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008876:10286], now have 1 active actors on pipe
2025-10-01T14:13:28.708073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:28.708079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256261374008876:10286]
2025-10-01T14:13:28.708110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:28.708112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:28.708227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1981 reason: error at write: Disconnected sessionId: src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0
2025-10-01T14:13:28.708363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:28.708372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1981 sessionId: src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0 is DEAD
2025-10-01T14:13:28.708499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:28.708508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0] Write session will restart in 0.006150s
2025-10-01T14:13:28.708531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0] Write session: Do CDS request
2025-10-01T14:13:28.708536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:28.715148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:28.715788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.715927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:28.715939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1982
2025-10-01T14:13:28.716015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.716035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:28.716042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:28.716044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:28.716291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:28.716391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1982 sessionId:  describe result for acl check
2025-10-01T14:13:28.716421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:28.716427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:28.716428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:28.716434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256261374008905:10760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:28.716447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:28.716455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:28.716463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:28.716502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:28.716529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256258997109243:10552]
2025-10-01T14:13:28.716900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256261374008905:10760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:28.716904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:28.717141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:28.717169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:28.717388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:28.717437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.717442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.717443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.717443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.717445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.717446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.717446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.717448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.717449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.717450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.717451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.717452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.717453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.717454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.717459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.717469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.717472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.717475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.717478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.717482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.717486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.717489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.717492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.717497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.717500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.717504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.717507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.717510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.717517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.717525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.717531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.717535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.717539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.717544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.717547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.717552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.717556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.717560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.717564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.717569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.717573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.717578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.717582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.717586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.717590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.717595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.717599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.717603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.717607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.717611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.717621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.717626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.717633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.717636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.717639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.717641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.717662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:28.718309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256261374008905:10760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:28.720595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256261374008905:10760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:28.720614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256261374008905:10760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:28.720617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256261374008905:10760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:28.720623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:28.720940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:28.721517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:28.721529Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:28.721531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:28.721534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:28.721539Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1981 [2:7556256258997109243:10552]
2025-10-01T14:13:28.721552Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:28.721570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:28.721578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.721582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.721584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.721598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:28.721607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:28.721612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:28.721657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.721663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.721664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.721666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:28.721667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:28.721712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:28.721717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.721724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.721734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.721751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:28.721767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008877:2446], now have 1 active actors on pipe
2025-10-01T14:13:28.721770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008944:10760], now have 1 active actors on pipe
2025-10-01T14:13:28.721776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256258997109238:10552]
2025-10-01T14:13:28.721778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256258997109238:10552]
2025-10-01T14:13:28.721780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256258997109238:10552]
2025-10-01T14:13:28.721791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:28.721798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:28.721800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:28.721801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:28.721808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:28.721820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:28.721823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:28.721806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1981
2025-10-01T14:13:28.721825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1981
2025-10-01T14:13:28.721854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.721863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.721878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256258997109238:10552]
2025-10-01T14:13:28.721888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:28.721898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:28.721915Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b057adc-3704fc02-fa50f031-60569c45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:28.721925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.721929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.721937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:28.721945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.721954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:28.721977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.722128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.722139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.722160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.722228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1982 partition: 0 MaxSeqNo: 45 sessionId: src_id|4b057adc-3704fc02-fa50f031-60569c45_0
2025-10-01T14:13:28.722588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|59c7558b-fa03a495-67b47ccc-b255ece6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4b057adc-3704fc02-fa50f031-60569c45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:28.724831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b057adc-3704fc02-fa50f031-60569c45_0] Write session: try to update token
2025-10-01T14:13:28.724846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b057adc-3704fc02-fa50f031-60569c45_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:28.737195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1982 sessionId: src_id|4b057adc-3704fc02-fa50f031-60569c45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:28.739223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:28.740897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.740917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.740935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:28.740937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:28.740939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:28.740940Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:28.740945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256258997109238:10552]
2025-10-01T14:13:28.740948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256258997109238:10552]
2025-10-01T14:13:28.740951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256258997109238:10552]
2025-10-01T14:13:28.740990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:28.740994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:28.740998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.741000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:28.741001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:28.741004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:28.741115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:28.808482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256261374008952:10286]
2025-10-01T14:13:28.808756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 1981, pipe: [1:7556256261374008952:10286]
2025-10-01T14:13:28.874719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:28.875667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:28.875717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008952:10286], now have 1 active actors on pipe
2025-10-01T14:13:28.875801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:28.875879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:28.875896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:28.875900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:28.875929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256261374008952:10286]
2025-10-01T14:13:28.875972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1982 reason: error at write: Disconnected sessionId: src_id|4b057adc-3704fc02-fa50f031-60569c45_0
2025-10-01T14:13:28.876124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1982 sessionId: src_id|4b057adc-3704fc02-fa50f031-60569c45_0 is DEAD
2025-10-01T14:13:28.876242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b057adc-3704fc02-fa50f031-60569c45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:28.876248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b057adc-3704fc02-fa50f031-60569c45_0] Write session will restart in 0.007562s
2025-10-01T14:13:28.876265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b057adc-3704fc02-fa50f031-60569c45_0] Write session: Do CDS request
2025-10-01T14:13:28.876273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b057adc-3704fc02-fa50f031-60569c45_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:28.882604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:28.883870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:28.884023Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:28.884027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:28.884036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:28.884075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:28.884115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256258997109309:10554]
2025-10-01T14:13:28.884674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:28.884846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b057adc-3704fc02-fa50f031-60569c45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.884902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:28.884905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:28.884916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1983
2025-10-01T14:13:28.884937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:28.885044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:28.885064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:28.885071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:28.885073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:28.885215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:28.885260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.885265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.885266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.885267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.885268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.885269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.885270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.885272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.885273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.885274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.885275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.885276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.885277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.885278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.885282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.885293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.885297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.885300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.885304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.885307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.885310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.885314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.885317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.885321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.885325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.885328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.885332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.885334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.885340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.885348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:28.885357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.885362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:28.885369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.885374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:28.885379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.885388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:28.885393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.885397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:28.885401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.885406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:28.885399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1983 sessionId:  describe result for acl check
2025-10-01T14:13:28.885410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.885419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:28.885422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.885427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:28.885434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.885439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:28.885429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:28.885442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.885435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:28.885447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.885452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.885437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:28.885441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256261374008984:10764] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:28.885457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.885464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.885468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.885472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.885480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:28.885484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.885489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:28.885527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:28.885992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256261374008984:10764] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:28.887956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256261374008984:10764] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:28.888865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:28.889444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:28.889458Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:28.889460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:28.889463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:28.889470Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1982 [2:7556256258997109309:10554]
2025-10-01T14:13:28.889483Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:28.889498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:28.889504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.889507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.889511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.889526Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:28.889536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:28.889541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:28.889586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.889591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.889592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.889595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:28.889596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:28.889654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:28.889661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.889670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:28.889685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:28.889704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:28.889723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374008953:2446], now have 1 active actors on pipe
2025-10-01T14:13:28.889734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256258997109304:10554]
2025-10-01T14:13:28.889740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256258997109304:10554]
2025-10-01T14:13:28.889741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256258997109304:10554]
2025-10-01T14:13:28.889753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:28.889764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:28.889767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:28.889768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:28.889757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1982
2025-10-01T14:13:28.889770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:28.889783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:28.889785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:28.889811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256258997109304:10554]
2025-10-01T14:13:28.889820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:28.889824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:28.889989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256261374008984:10764] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:28.890001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256261374008984:10764] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:28.890004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256261374008984:10764] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:28.890011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:28.890166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374009025:10764], now have 1 active actors on pipe
2025-10-01T14:13:28.890201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1982
2025-10-01T14:13:28.890238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.890246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.890266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:28.890277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:28.890285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:28.890288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:28.890296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:28.890307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:28.890323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.890455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.890464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.890476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:28.890539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1983 partition: 0 MaxSeqNo: 45 sessionId: src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0
2025-10-01T14:13:28.890834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b057adc-3704fc02-fa50f031-60569c45_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:28.893192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0] Write session: try to update token
2025-10-01T14:13:28.893204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:28.905254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:28.905266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:28.905276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256258997109304:10554]
2025-10-01T14:13:28.905311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:28.905322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:28.905478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:28.905605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:28.905731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:28.905863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:28.906029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:28.906001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1983 sessionId: src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:28.906061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:28.908209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:28.908376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:28.908390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:28.908420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:28.908493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:28.918432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:28.918446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:28.918448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:28.918450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:28.918460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256258997109304:10554]
2025-10-01T14:13:28.918464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256258997109304:10554]
2025-10-01T14:13:28.918468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256258997109304:10554]
2025-10-01T14:13:28.918498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:28.918500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:28.918502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:28.918504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:28.918505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:28.918506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:28.918622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:28.975907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256261374009031:10286]
2025-10-01T14:13:28.976180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 1982, pipe: [1:7556256261374009031:10286]
2025-10-01T14:13:29.053760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:29.060259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.060281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.060438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.060491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.060542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.060600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.060653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.060666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.060733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.060791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.060850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.060912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.060957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.060965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.061035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.061096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.061158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.061220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.061270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.061280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.061346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.061406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.061465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.061527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.061570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.061577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.061641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.061698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.061756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.061816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.061856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.061862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.061925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.061984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.062044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.062104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.062150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.062156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.062228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.062292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.062352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.062429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.062474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.062481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.062545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.062605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.062671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.062737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.062781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.062788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.062863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.062926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.062995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.063061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.063106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.063113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.063179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.063237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.063316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.063379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.063422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.063431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.063478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256261374009031:10286], now have 1 active actors on pipe
2025-10-01T14:13:29.063718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:29.063732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:29.063735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:29.063757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1983 reason: error at write: Disconnected sessionId: src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0
2025-10-01T14:13:29.063776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256261374009031:10286]
2025-10-01T14:13:29.063949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1983 sessionId: src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0 is DEAD
2025-10-01T14:13:29.064113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:29.064123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0] Write session will restart in 0.005309s
2025-10-01T14:13:29.064162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0] Write session: Do CDS request
2025-10-01T14:13:29.064168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:29.064277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:29.070612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:29.070802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.070860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:29.070871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1984
2025-10-01T14:13:29.071019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.071042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:29.071049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:29.071052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:29.071348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1984 sessionId:  describe result for acl check
2025-10-01T14:13:29.071371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:29.071372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:29.071373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:29.071376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256265668976358:10769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:29.071733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256265668976358:10769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:29.072035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:29.072199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:29.072209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:29.072219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:29.072261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:29.072307Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256263292076672:10556]
2025-10-01T14:13:29.072709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:29.072895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:29.072919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:29.073114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:29.073158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.073162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.073163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.073164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.073164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.073165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.073165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.073166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.073166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.073167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.073168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.073169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.073169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.073170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.073173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.073178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.073181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.073183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.073185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.073187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.073188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.073190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.073194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.073198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.073201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.073204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.073207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.073210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.073216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.073222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.073227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.073231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.073236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.073239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.073241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.073243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.073246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.073249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.073251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.073253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.073255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.073258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.073260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.073262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.073264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.073267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.073269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.073272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.073274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.073277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.073279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.073281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.073283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.073287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.073290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.073295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.073329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:29.073805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256265668976358:10769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:29.076332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256265668976358:10769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:29.076360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256265668976358:10769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:29.076364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256265668976358:10769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:29.076370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:29.076626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:29.077141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:29.077153Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:29.077154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:29.077156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:29.077160Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1983 [2:7556256263292076672:10556]
2025-10-01T14:13:29.077170Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:29.077180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:29.077182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.077184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.077185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.077196Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:29.077202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:29.077206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:29.077243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.077248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.077249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.077252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:29.077254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:29.077302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:29.077313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.077322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.077332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.077345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:29.077365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976329:2446], now have 1 active actors on pipe
2025-10-01T14:13:29.077373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976397:10769], now have 1 active actors on pipe
2025-10-01T14:13:29.077379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256263292076667:10556]
2025-10-01T14:13:29.077381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256263292076667:10556]
2025-10-01T14:13:29.077383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256263292076667:10556]
2025-10-01T14:13:29.077390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:29.077370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1983
2025-10-01T14:13:29.077371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1983
2025-10-01T14:13:29.077402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:29.077406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:29.077408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:29.077409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:29.077442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:29.077447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:29.077471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.077477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.077486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256263292076667:10556]
2025-10-01T14:13:29.077494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:29.077513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:29.077515Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:29.077520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.077523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.077525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:29.077530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.077540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:29.077556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.077667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.077674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.077683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.077732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1984 partition: 0 MaxSeqNo: 45 sessionId: src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0
2025-10-01T14:13:29.078004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b6d20f-3a7b4f91-5c081585-88d6b79f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:29.080252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0] Write session: try to update token
2025-10-01T14:13:29.080268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:29.092505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1984 sessionId: src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:29.094556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:29.094655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.094672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.096428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:29.096461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:29.096464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:29.096469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:29.096471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:29.096477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256263292076667:10556]
2025-10-01T14:13:29.096482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256263292076667:10556]
2025-10-01T14:13:29.096485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256263292076667:10556]
2025-10-01T14:13:29.096515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:29.096523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:29.096525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:29.096518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:29.096526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:29.096531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.096534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:29.096667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:29.163800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256265668976405:10286]
2025-10-01T14:13:29.164062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 1983, pipe: [1:7556256265668976405:10286]
2025-10-01T14:13:29.234851Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:29.240918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.240936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.241066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.241115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.241174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.241229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.241267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.241274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.241332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.241382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.241431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.241484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.241526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.241532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.241580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.241625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.241679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.241733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.241770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.241775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.241825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.241872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.241919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.241965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.242001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.242006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.242053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.242100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.242150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.242207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.242244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.242249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.242297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.242343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.242413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.242465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.242503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.242508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.242558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.242604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.242654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.242708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.242744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.242749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.242798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.242842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.242890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.242940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.242977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.242982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.243035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.243087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.243150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.243201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.243239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.243246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.243297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.243344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.243397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.243446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.243482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.243487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.243523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976405:10286], now have 1 active actors on pipe
2025-10-01T14:13:29.243712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:29.243752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256265668976405:10286]
2025-10-01T14:13:29.243764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:29.243767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:29.243791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1984 reason: error at write: Disconnected sessionId: src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0
2025-10-01T14:13:29.243964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1984 sessionId: src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0 is DEAD
2025-10-01T14:13:29.244133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:29.244143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0] Write session will restart in 0.008239s
2025-10-01T14:13:29.244168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0] Write session: Do CDS request
2025-10-01T14:13:29.244173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:29.244162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:29.251202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:29.252396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:29.252573Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:29.252584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:29.252596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:29.252660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:29.252700Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256263292076742:10559]
2025-10-01T14:13:29.253249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:29.253559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:29.253612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:29.253921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:29.253946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.253957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:29.253983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.253974Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1985
2025-10-01T14:13:29.253989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.253990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.253991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.253992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.253993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.253994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.253995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.253997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.253998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.253999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.254000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.254002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.254003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.254008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.254017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.254022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.254026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.254030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.254034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.254037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.254042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.254046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.254051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.254054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.254058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.254062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.254068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.254074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.254087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.254093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.254102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.254105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.254111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.254119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.254124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.254131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.254136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.254144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.254149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.254144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.254157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.254166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.254170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.254179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.254183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.254171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:29.254188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.254192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.254198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.254180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:29.254204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.254184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:29.254209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.254213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.254222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.254226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.254235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.254239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.254247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.254284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:29.254546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1985 sessionId:  describe result for acl check
2025-10-01T14:13:29.254575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:29.254580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:29.254582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:29.254586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256265668976454:10779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:29.255063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256265668976454:10779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:29.256619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256265668976454:10779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:29.257678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:29.258219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:29.258231Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:29.258233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:29.258236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:29.258242Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1984 [2:7556256263292076742:10559]
2025-10-01T14:13:29.258255Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:29.258268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:29.258271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.258274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.258276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.258290Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:29.258297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:29.258302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:29.258338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.258345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.258347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.258351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:29.258354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:29.258428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:29.258436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.258446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.258456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.258471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:29.258490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976407:2446], now have 1 active actors on pipe
2025-10-01T14:13:29.258501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256263292076737:10559]
2025-10-01T14:13:29.258503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256263292076737:10559]
2025-10-01T14:13:29.258506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256263292076737:10559]
2025-10-01T14:13:29.258515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:29.258522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:29.258526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:29.258528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:29.258530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:29.258538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:29.258540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:29.258523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1984
2025-10-01T14:13:29.258566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256263292076737:10559]
2025-10-01T14:13:29.258573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:29.258575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:29.259083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256265668976454:10779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:29.259095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256265668976454:10779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:29.259098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256265668976454:10779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:29.259105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:29.259450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976490:10779], now have 1 active actors on pipe
2025-10-01T14:13:29.259490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1984
2025-10-01T14:13:29.259553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.259569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.259591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:29.259616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.259624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.259625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:29.259632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.259644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:29.259658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.259774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.259779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.259788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.259846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1985 partition: 0 MaxSeqNo: 45 sessionId: src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0
2025-10-01T14:13:29.260164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f372aaa-f0ab8ba-ae4ece19-49b2bdb0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:29.262314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0] Write session: try to update token
2025-10-01T14:13:29.262327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:29.275356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1985 sessionId: src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:29.277931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:29.278250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.278269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.278290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:29.278294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:29.278295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:29.278297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:29.278305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256263292076737:10559]
2025-10-01T14:13:29.278310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256263292076737:10559]
2025-10-01T14:13:29.278313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256263292076737:10559]
2025-10-01T14:13:29.278350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:29.278360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:29.278364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:29.278385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:29.278392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.278395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:29.278524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:29.344023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256265668976506:10286]
2025-10-01T14:13:29.344215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 1984, pipe: [1:7556256265668976506:10286]
2025-10-01T14:13:29.411314Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:29.411683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:29.411739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976506:10286], now have 1 active actors on pipe
2025-10-01T14:13:29.411800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:29.411874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:29.411928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256265668976506:10286]
2025-10-01T14:13:29.418311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:29.419526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:29.419669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:29.419676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:29.419683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:29.419714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:29.419740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256263292076830:10564]
2025-10-01T14:13:29.420119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:29.420331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:29.420375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:29.420645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:29.420681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.420686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.420687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.420688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.420689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.420690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.420690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.420691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.420691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.420692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.420693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.420693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.420694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.420694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.420697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.420703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.420705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.420707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.420709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.420719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.420721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.420723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.420725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.420727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.420729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.420731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.420733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.420735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.420740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.420744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.420748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.420751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.420753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.420756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.420759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.420762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.420764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.420767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.420770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.420772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.420775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.420777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.420780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.420783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.420786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.420789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.420791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.420793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.420796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.420798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.420800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.420803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.420805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.420808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.420810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.420812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.420831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:29.420994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:29.421005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:29.421025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1985 reason: error at write: Disconnected sessionId: src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0
2025-10-01T14:13:29.421180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1985 sessionId: src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0 is DEAD
2025-10-01T14:13:29.421296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:29.421307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0] Write session will restart in 0.007391s
2025-10-01T14:13:29.421332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0] Write session: Do CDS request
2025-10-01T14:13:29.421338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:29.425516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:29.426074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:29.426086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:29.426088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:29.426091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:29.426098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1985 [2:7556256263292076830:10564]
2025-10-01T14:13:29.426111Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:29.426125Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:29.426133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.426137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.426139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.426169Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:29.426179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:29.426184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:29.426228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.426234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.426236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.426238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:29.426240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:29.426294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:29.426300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.426310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.426323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.426337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:29.426357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976511:2446], now have 1 active actors on pipe
2025-10-01T14:13:29.426381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256263292076825:10564]
2025-10-01T14:13:29.426383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256263292076825:10564]
2025-10-01T14:13:29.426385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256263292076825:10564]
2025-10-01T14:13:29.426400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:29.426417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:29.426406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1985
2025-10-01T14:13:29.426428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:29.426436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:29.426437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:29.426439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:29.426439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:29.426472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256263292076825:10564]
2025-10-01T14:13:29.426484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:29.426493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:29.429874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.429910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:29.429922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1986
2025-10-01T14:13:29.430041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.430082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:29.430093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:29.430096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:29.430446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1986 sessionId:  describe result for acl check
2025-10-01T14:13:29.430476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:29.430481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:29.430482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:29.430485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256265668976563:10784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:29.430872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256265668976563:10784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:29.433168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256265668976563:10784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:29.436117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256265668976563:10784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:29.436127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256265668976563:10784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:29.436129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256265668976563:10784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:29.436134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:29.436330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1985
2025-10-01T14:13:29.436949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976598:10784], now have 1 active actors on pipe
2025-10-01T14:13:29.436971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.436976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.436999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:29.437001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:29.437005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256263292076825:10564]
2025-10-01T14:13:29.437029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:29.437036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:29.437046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.437051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.437053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:29.437061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.437072Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:29.437088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:29.437230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:29.437348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.437469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.437581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.437749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:29.437786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.437802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:29.437924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.437930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.437940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.438002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1986 partition: 0 MaxSeqNo: 45 sessionId: src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0
2025-10-01T14:13:29.438312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba20f0d-9634dd8c-b026e964-951cb2af_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:29.440858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0] Write session: try to update token
2025-10-01T14:13:29.440876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:29.455110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1986 sessionId: src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:29.455372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:29.455384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:29.455386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:29.455387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:29.455395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256263292076825:10564]
2025-10-01T14:13:29.455399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256263292076825:10564]
2025-10-01T14:13:29.455401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256263292076825:10564]
2025-10-01T14:13:29.455436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:29.455440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.455442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:29.455447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:29.455453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:29.455457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:29.455554Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:29.457208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:29.511982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256265668976609:10286]
2025-10-01T14:13:29.512204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 1985, pipe: [1:7556256265668976609:10286]
2025-10-01T14:13:29.593663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:29.593871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.593884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.593903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976609:10286], now have 1 active actors on pipe
2025-10-01T14:13:29.594055Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:29.594051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:29.594084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256265668976609:10286]
2025-10-01T14:13:29.594100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:29.594167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1986 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0
2025-10-01T14:13:29.594388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1986 sessionId: src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0 is DEAD
2025-10-01T14:13:29.594524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:29.594542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0] Write session will restart in 0.008464s
2025-10-01T14:13:29.594568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0] Write session: Do CDS request
2025-10-01T14:13:29.594574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:29.599841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:29.601074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:29.601238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:29.601245Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:29.601256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:29.601299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:29.601324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256263292076913:10572]
2025-10-01T14:13:29.601714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:29.601932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:29.601958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:29.602149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:29.602189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.602193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.602194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.602195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.602195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.602196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.602197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.602197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.602198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.602198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.602199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.602200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.602200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.602201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.602204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.602210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.602212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.602215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.602217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.602219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.602221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.602223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.602225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.602227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.602229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.602231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.602233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.602236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.602240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.602245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.602248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.602251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.602254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.602257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.602259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.602262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.602264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.602267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.602269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.602273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.602277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.602281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.602285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.602290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.602294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.602298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.602304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.602309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.602318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.602325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.602329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.602335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.602339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.602348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.602354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.602358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.602410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:29.603767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.604096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:29.604117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1987
2025-10-01T14:13:29.604220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.604255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:29.604260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:29.604266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:29.604536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1987 sessionId:  describe result for acl check
2025-10-01T14:13:29.604561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:29.604566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:29.604567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:29.604570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256265668976659:10790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:29.604923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256265668976659:10790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:29.605798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:29.606352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:29.606364Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:29.606367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:29.606382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:29.606387Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1986 [2:7556256263292076913:10572]
2025-10-01T14:13:29.606396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:29.606407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:29.606409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.606411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.606412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.606422Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:29.606430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:29.606433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:29.606467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.606471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.606472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.606474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:29.606476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:29.606521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:29.606527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.606533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.606539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.606548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:29.606559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976622:2446], now have 1 active actors on pipe
2025-10-01T14:13:29.606564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256263292076908:10572]
2025-10-01T14:13:29.606570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256263292076908:10572]
2025-10-01T14:13:29.606571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256263292076908:10572]
2025-10-01T14:13:29.606579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:29.606587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:29.606594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:29.606595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:29.606596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:29.606597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:29.606598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:29.606612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256263292076908:10572]
2025-10-01T14:13:29.606617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:29.606619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:29.606603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1986
2025-10-01T14:13:29.606636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256265668976659:10790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:29.611070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256265668976659:10790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:29.611080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256265668976659:10790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:29.611082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256265668976659:10790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:29.611087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:29.611238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976698:10790], now have 1 active actors on pipe
2025-10-01T14:13:29.611260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1986
2025-10-01T14:13:29.611298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.611306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.611324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffc5841a-4d924ab2-471efb83-35579267_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:29.611335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.611344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.611346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:29.611353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.611363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:29.611375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.611487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.611491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.611500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.611544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1987 partition: 0 MaxSeqNo: 45 sessionId: src_id|ffc5841a-4d924ab2-471efb83-35579267_0
2025-10-01T14:13:29.611802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4d307d9-66c855f6-9dcc41c2-d045240_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ffc5841a-4d924ab2-471efb83-35579267_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:29.613913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc5841a-4d924ab2-471efb83-35579267_0] Write session: try to update token
2025-10-01T14:13:29.613927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc5841a-4d924ab2-471efb83-35579267_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:29.617117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:29.617128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:29.617134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256263292076908:10572]
2025-10-01T14:13:29.617168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:29.617171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:29.617320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:29.617444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.617564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.617688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.617854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:29.617887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:29.625632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1987 sessionId: src_id|ffc5841a-4d924ab2-471efb83-35579267_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:29.627814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:29.627973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.627989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.628025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:29.628101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:29.635358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:29.635374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:29.635376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:29.635378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:29.635388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256263292076908:10572]
2025-10-01T14:13:29.635393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256263292076908:10572]
2025-10-01T14:13:29.635396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256263292076908:10572]
2025-10-01T14:13:29.635435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:29.635441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:29.635444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.635446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:29.635447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:29.635451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:29.635553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:29.694240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256265668976702:10286]
2025-10-01T14:13:29.694472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 1986, pipe: [1:7556256265668976702:10286]
2025-10-01T14:13:29.768486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:29.774942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.774964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.775102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.775159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.775210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.775260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.775299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.775307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.775360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.775409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.775463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.775515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.775553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.775558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.775618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.775679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.775732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.775788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.775827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.775833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.775889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.775938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.775988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.776041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.776079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.776083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.776143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.776197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.776249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.776305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.776342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.776346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.776400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.776449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.776502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.776557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.776595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.776600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.776673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.776721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.776770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.776823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.776862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.776869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.776922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.776973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.777025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.777079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.777119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.777124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.777189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.777241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.777292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.777346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.777383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.777389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.777442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.777490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.777539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.777589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.777631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.777636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.777680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976702:10286], now have 1 active actors on pipe
2025-10-01T14:13:29.777903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:29.777908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256265668976702:10286]
2025-10-01T14:13:29.777927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:29.777929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:29.777953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1987 reason: error at write: Disconnected sessionId: src_id|ffc5841a-4d924ab2-471efb83-35579267_0
2025-10-01T14:13:29.778106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1987 sessionId: src_id|ffc5841a-4d924ab2-471efb83-35579267_0 is DEAD
2025-10-01T14:13:29.778276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc5841a-4d924ab2-471efb83-35579267_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:29.778285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc5841a-4d924ab2-471efb83-35579267_0] Write session will restart in 0.008200s
2025-10-01T14:13:29.778304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc5841a-4d924ab2-471efb83-35579267_0] Write session: Do CDS request
2025-10-01T14:13:29.778309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc5841a-4d924ab2-471efb83-35579267_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:29.778546Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:29.784753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:29.786197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:29.786404Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:29.786414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:29.786425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:29.786472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:29.786507Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256263292077002:10579]
2025-10-01T14:13:29.787038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:29.787286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:29.787314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:29.787528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:29.787584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.787590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.787591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.787592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.787593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.787594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.787595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.787596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.787597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.787598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.787599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.787600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.787601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.787602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.787607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.787614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.787616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.787618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.787620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.787622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.787624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.787626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.787628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.787630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.787632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.787633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.787635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.787637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.787642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.787646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.787650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.787654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.787656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.787661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.787663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.787666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.787669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.787671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.787673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.787676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.787678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.787681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.787684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.787686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.787688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.787692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.787696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.787700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.787704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.787709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.787713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.787717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.787722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.787727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.787731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.787737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.787785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:29.787861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc5841a-4d924ab2-471efb83-35579267_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.787948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:29.787964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1988
2025-10-01T14:13:29.788303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.788336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:29.788345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:29.788351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:29.788650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1988 sessionId:  describe result for acl check
2025-10-01T14:13:29.788678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:29.788684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:29.788686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:29.788691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256265668976742:10794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:29.789119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256265668976742:10794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:29.791185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:29.791551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256265668976742:10794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:29.791722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:29.791731Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:29.791733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:29.791735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:29.791741Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1987 [2:7556256263292077002:10579]
2025-10-01T14:13:29.791758Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:29.791772Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:29.791777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.791779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.791781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.791792Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:29.791794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:29.791798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:29.791836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.791841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.791841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.791844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:29.791846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:29.791895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:29.791901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.791907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.791912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.791921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:29.791936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976704:2446], now have 1 active actors on pipe
2025-10-01T14:13:29.791945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256263292076997:10579]
2025-10-01T14:13:29.791946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256263292076997:10579]
2025-10-01T14:13:29.791947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256263292076997:10579]
2025-10-01T14:13:29.791957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:29.791971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:29.791979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:29.791982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:29.791982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:29.791985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:29.791987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:29.792000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256263292076997:10579]
2025-10-01T14:13:29.792006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:29.791997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1987
2025-10-01T14:13:29.792013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:29.796467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256265668976742:10794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:29.796481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256265668976742:10794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:29.796484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256265668976742:10794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:29.796491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:29.796700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976781:10794], now have 1 active actors on pipe
2025-10-01T14:13:29.796746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1987
2025-10-01T14:13:29.796785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.796795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.796827Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:29.796840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.796848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.796850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:29.796858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.796873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:29.796890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.797009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.797015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.797025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.797087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1988 partition: 0 MaxSeqNo: 45 sessionId: src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0
2025-10-01T14:13:29.797446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffc5841a-4d924ab2-471efb83-35579267_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:29.799712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0] Write session: try to update token
2025-10-01T14:13:29.799726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:29.801923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:29.801936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:29.801944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256263292076997:10579]
2025-10-01T14:13:29.801970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:29.801983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:29.802129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:29.802244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.802353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.802491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.802655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:29.802683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:29.812238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1988 sessionId: src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:29.814289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:29.814450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.814466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.814496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:29.814557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:29.819716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:29.819734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:29.819736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:29.819737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:29.819746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256263292076997:10579]
2025-10-01T14:13:29.819748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256263292076997:10579]
2025-10-01T14:13:29.819751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256263292076997:10579]
2025-10-01T14:13:29.819781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:29.819787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:29.819790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:29.819792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.819792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:29.819793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:29.819908Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:29.878060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256265668976784:10286]
2025-10-01T14:13:29.878332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 1987, pipe: [1:7556256265668976784:10286]
2025-10-01T14:13:29.956858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:29.963435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.963455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.963581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.963634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.963687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.963733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.964097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.964111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.964169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.964217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.964264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.964323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.964359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.964364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.964422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.964476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.964527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.964579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.964629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.964636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.964693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.964746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.964798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.964847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.964883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.964890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.964943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.964990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.965039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.965087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.965129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.965135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.965193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.965240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.965288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.965337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.965375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.965380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.965430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.965478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.965536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.965588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.965623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.965628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.965685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.965735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.965785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.965846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.965882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.965887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.965939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.965986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.966036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.966089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.966126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.966131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.966190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:29.966246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:29.966295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:29.966345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:29.966394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:29.966400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:29.966437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976784:10286], now have 1 active actors on pipe
2025-10-01T14:13:29.966675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:29.966727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:29.966734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:29.966737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256265668976784:10286]
2025-10-01T14:13:29.966757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1988 reason: error at write: Disconnected sessionId: src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0
2025-10-01T14:13:29.966845Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:29.966942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1988 sessionId: src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0 is DEAD
2025-10-01T14:13:29.967042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:29.967050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0] Write session will restart in 0.006213s
2025-10-01T14:13:29.967069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0] Write session: Do CDS request
2025-10-01T14:13:29.967074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:29.972518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:29.973674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:29.973790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:29.973797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:29.973805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:29.973833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:29.973859Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256263292077074:10581]
2025-10-01T14:13:29.974232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:29.974460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:29.974484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:29.974666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:29.974699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.974703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.974704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.974704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.974705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.974706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.974706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.974707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.974708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.974708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.974709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.974709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.974710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.974710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.974714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.974719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.974721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.974723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.974725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.974729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.974731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.974738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.974733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.974735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.974737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.974739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.974741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.974743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.974744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.974750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.974755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:29.974758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.974761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:29.974763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.974766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:29.974768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.974771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:29.974775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.974780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:29.974783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.974791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:29.974799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.974806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:29.974810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.974816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:29.974818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.974821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:29.974827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.974830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.974833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.974835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.974838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.974841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.974843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.974845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:29.974848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.974850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:29.974870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:29.974878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:29.974890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1989
2025-10-01T14:13:29.975006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:29.975030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:29.975039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:29.975043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:29.975359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1989 sessionId:  describe result for acl check
2025-10-01T14:13:29.975395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:29.975401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:29.975403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:29.975407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256265668976829:10799] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:29.975887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256265668976829:10799] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:29.978018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256265668976829:10799] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:29.978099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:29.978695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:29.978705Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:29.978707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:29.978711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:29.978717Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1988 [2:7556256263292077074:10581]
2025-10-01T14:13:29.978729Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:29.978749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:29.978755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.978758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.978760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.978773Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:29.978782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:29.978790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:29.978846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.978851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.978855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.978858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:29.978864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:29.978924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:29.978930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:29.978938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:29.978950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:29.978967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:29.978986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976791:2446], now have 1 active actors on pipe
2025-10-01T14:13:29.978995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256263292077069:10581]
2025-10-01T14:13:29.979001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256263292077069:10581]
2025-10-01T14:13:29.979003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256263292077069:10581]
2025-10-01T14:13:29.979006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1988
2025-10-01T14:13:29.979015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:29.979027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:29.979030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:29.979034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:29.979036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:29.979041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:29.979043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:29.979067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256263292077069:10581]
2025-10-01T14:13:29.979077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:29.979085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:29.983794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256265668976829:10799] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:29.983807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256265668976829:10799] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:29.983810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256265668976829:10799] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:29.983815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:29.984010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256265668976865:10799], now have 1 active actors on pipe
2025-10-01T14:13:29.984046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1988
2025-10-01T14:13:29.984100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.984110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.984130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71b68f55-4d3af828-8d55981-b60e3a51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:29.984141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:29.984149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:29.984151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:29.984160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:29.984177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:29.984196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.984332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:29.984337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:29.984346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:29.984412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1989 partition: 0 MaxSeqNo: 45 sessionId: src_id|71b68f55-4d3af828-8d55981-b60e3a51_0
2025-10-01T14:13:29.984734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a86f952-d946a9fd-6b613c47-a59f8af0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|71b68f55-4d3af828-8d55981-b60e3a51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:29.986924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b68f55-4d3af828-8d55981-b60e3a51_0] Write session: try to update token
2025-10-01T14:13:29.986949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b68f55-4d3af828-8d55981-b60e3a51_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:29.989790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:29.989801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:29.989810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256263292077069:10581]
2025-10-01T14:13:29.989843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:29.989859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:29.989997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:29.990117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.990236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.990355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:29.990541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:29.990574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:29.999134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1989 sessionId: src_id|71b68f55-4d3af828-8d55981-b60e3a51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:30.001450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:30.001612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.001634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.001668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:30.001726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:30.008256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:30.008271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:30.008272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:30.008274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:30.008282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256263292077069:10581]
2025-10-01T14:13:30.008286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256263292077069:10581]
2025-10-01T14:13:30.008288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256263292077069:10581]
2025-10-01T14:13:30.008324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:30.008328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:30.008329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.008330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:30.008334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:30.008337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:30.008458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:30.066968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256269963944164:10286]
2025-10-01T14:13:30.067262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 1988, pipe: [1:7556256269963944164:10286]
2025-10-01T14:13:30.142157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:30.148484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.148509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.148649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.148698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.148754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.148806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.148851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.148863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.148922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.148975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.149022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.149074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.149112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.149114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.149172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.149225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.149277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.149331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.149369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.149374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.149429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.149481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.149533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.149587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.149626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.149631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.149685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.149736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.149790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.149844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.149881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.149887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.149951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.150011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.150063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.150116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.150155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.150161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.150216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.150265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.150317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.150382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.150419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.150425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.150479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.150530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.150584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.150640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.150678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.150682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.150738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.150787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.150839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.150892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.150931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.150936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.150990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.151049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.151102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.151152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.151188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.151193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.151233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944164:10286], now have 1 active actors on pipe
2025-10-01T14:13:30.151445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:30.151448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256269963944164:10286]
2025-10-01T14:13:30.151479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:30.151484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:30.151511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1989 reason: error at write: Disconnected sessionId: src_id|71b68f55-4d3af828-8d55981-b60e3a51_0
2025-10-01T14:13:30.151715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1989 sessionId: src_id|71b68f55-4d3af828-8d55981-b60e3a51_0 is DEAD
2025-10-01T14:13:30.151804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b68f55-4d3af828-8d55981-b60e3a51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:30.151812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b68f55-4d3af828-8d55981-b60e3a51_0] Write session will restart in 0.008935s
2025-10-01T14:13:30.151829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b68f55-4d3af828-8d55981-b60e3a51_0] Write session: Do CDS request
2025-10-01T14:13:30.151834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b68f55-4d3af828-8d55981-b60e3a51_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:30.151917Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:30.157806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:30.159170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:30.159300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:30.159316Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:30.159329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:30.159358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:30.159384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256267587044445:10584]
2025-10-01T14:13:30.159769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:30.159968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:30.159993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:30.160176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:30.160207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.160212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.160212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.160215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.160215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.160216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.160217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.160217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.160218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.160219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.160220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.160220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.160221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.160221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.160224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.160230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.160232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.160234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.160236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.160238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.160240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.160242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.160244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.160246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.160248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.160250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.160252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.160254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.160259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.160263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.160267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.160270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.160272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.160275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.160279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.160281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.160284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.160286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.160289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.160292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.160294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.160298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.160300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.160303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.160305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.160308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.160310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.160313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.160315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.160321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.160323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.160328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.160332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.160338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.160340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.160343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.160364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:30.161820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b68f55-4d3af828-8d55981-b60e3a51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.161941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:30.161954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1990
2025-10-01T14:13:30.162056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.162096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:30.162105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:30.162109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:30.162460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1990 sessionId:  describe result for acl check
2025-10-01T14:13:30.162488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:30.162493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:30.162494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:30.162499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256269963944206:10803] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:30.162886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256269963944206:10803] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:30.163655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:30.164197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:30.164204Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:30.164207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:30.164209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:30.164214Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1989 [2:7556256267587044445:10584]
2025-10-01T14:13:30.164223Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:30.164238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:30.164243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.164247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.164249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.164259Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:30.164262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:30.164266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:30.164324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.164330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.164332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.164334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:30.164337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:30.164382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:30.164387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.164394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.164400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.164411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:30.164434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256267587044440:10584]
2025-10-01T14:13:30.164438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256267587044440:10584]
2025-10-01T14:13:30.164439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256267587044440:10584]
2025-10-01T14:13:30.164447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:30.164456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944167:2446], now have 1 active actors on pipe
2025-10-01T14:13:30.164459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:30.164462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:30.164464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:30.164466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:30.164473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:30.164475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:30.164479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1989
2025-10-01T14:13:30.164494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256267587044440:10584]
2025-10-01T14:13:30.164500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:30.164502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:30.164663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256269963944206:10803] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:30.170010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256269963944206:10803] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:30.170035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256269963944206:10803] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:30.170038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256269963944206:10803] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:30.170047Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:30.170229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944245:10803], now have 1 active actors on pipe
2025-10-01T14:13:30.170274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1989
2025-10-01T14:13:30.170343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.170352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.170383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:30.170391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.170395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.170396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:30.170405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.170416Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:30.170436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.170595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.170604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.170620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.170684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1990 partition: 0 MaxSeqNo: 45 sessionId: src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0
2025-10-01T14:13:30.170953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b68f55-4d3af828-8d55981-b60e3a51_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:30.173190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0] Write session: try to update token
2025-10-01T14:13:30.173203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:30.183218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:30.183235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:30.183237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:30.183238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:30.183246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256267587044440:10584]
2025-10-01T14:13:30.183249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256267587044440:10584]
2025-10-01T14:13:30.183252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256267587044440:10584]
2025-10-01T14:13:30.183289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:30.183296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.183295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:30.183297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:30.183300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:30.183303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:30.183424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:30.185682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1990 sessionId: src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:30.187872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:30.251817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256269963944250:10286]
2025-10-01T14:13:30.252068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 1989, pipe: [1:7556256269963944250:10286]
2025-10-01T14:13:30.317617Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:30.317836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.317846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.317878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944250:10286], now have 1 active actors on pipe
2025-10-01T14:13:30.318047Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:30.318109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256269963944250:10286]
2025-10-01T14:13:30.318147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:30.318204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1990 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0
2025-10-01T14:13:30.318363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1990 sessionId: src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0 is DEAD
2025-10-01T14:13:30.318506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:30.318540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:30.318548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0] Write session will restart in 0.008394s
2025-10-01T14:13:30.318566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0] Write session: Do CDS request
2025-10-01T14:13:30.318571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:30.325053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:30.326400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:30.326594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:30.326606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:30.326619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:30.326672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:30.326713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256267587044538:10587]
2025-10-01T14:13:30.327239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:30.327474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:30.327511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:30.327789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:30.327831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.327833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.327838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.327839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.327840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.327841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.327842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.327843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.327843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.327844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.327845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.327846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.327847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.327848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.327849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.327853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.327863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.327866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.327870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.327873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.327875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.327879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.327882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.327885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.327888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.327891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.327895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.327898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.327901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.327907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.327915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.327920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.327925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.327928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.327916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:30.327933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.327929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1991
2025-10-01T14:13:30.327937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.327942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.327946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.327951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.327955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.327960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.327965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.327974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.327978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.327983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.327988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.327993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.328002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.328006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.328010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.328018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.328022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.328026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.328030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.328038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.328043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.328039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.328059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:30.328048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.328066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:30.328069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:30.328083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:30.328325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1991 sessionId:  describe result for acl check
2025-10-01T14:13:30.328346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:30.328351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:30.328352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:30.328355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256269963944317:10814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:30.328805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256269963944317:10814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:30.330404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256269963944317:10814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:30.331473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:30.332032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:30.332047Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:30.332051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:30.332055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:30.332061Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1990 [2:7556256267587044538:10587]
2025-10-01T14:13:30.332075Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:30.332096Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:30.332103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.332106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.332108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.332123Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:30.332130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:30.332136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:30.332192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.332198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.332200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.332203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:30.332206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:30.332273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:30.332279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.332290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.332303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.332321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:30.332323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1990
2025-10-01T14:13:30.332343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944265:2446], now have 1 active actors on pipe
2025-10-01T14:13:30.332357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256267587044533:10587]
2025-10-01T14:13:30.332359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256267587044533:10587]
2025-10-01T14:13:30.332361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256267587044533:10587]
2025-10-01T14:13:30.332369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:30.332373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:30.332376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:30.332377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:30.332382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:30.332395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:30.332402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:30.332427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256267587044533:10587]
2025-10-01T14:13:30.332439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:30.332448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:30.332752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256269963944317:10814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:30.332765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256269963944317:10814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:30.332769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256269963944317:10814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:30.332774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:30.332959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944351:10814], now have 1 active actors on pipe
2025-10-01T14:13:30.332989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1990
2025-10-01T14:13:30.333052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.333067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.333094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:30.333106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.333114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.333116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:30.333124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.333135Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:30.333154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.333310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.333323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.333341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.333446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1991 partition: 0 MaxSeqNo: 45 sessionId: src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0
2025-10-01T14:13:30.333756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4e3cf55-776445dd-f740f729-6c1aa404_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:30.335857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0] Write session: try to update token
2025-10-01T14:13:30.335872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:30.342775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:30.342792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:30.342801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256267587044533:10587]
2025-10-01T14:13:30.342833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:30.342843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:30.343014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:30.343145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:30.343275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:30.343425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:30.343638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:30.343685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:30.347440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1991 sessionId: src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:30.349831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:30.350033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.350056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.350094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:30.350179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:30.360814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:30.360837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:30.360840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:30.360842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:30.360853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256267587044533:10587]
2025-10-01T14:13:30.360857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256267587044533:10587]
2025-10-01T14:13:30.360864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256267587044533:10587]
2025-10-01T14:13:30.360903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:30.360911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:30.360914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:30.360917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.360918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:30.360919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:30.361046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:30.418205Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256269963944356:10286]
2025-10-01T14:13:30.418430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 1990, pipe: [1:7556256269963944356:10286]
2025-10-01T14:13:30.505793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:30.512232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.512256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.512396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.512450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.512504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.512556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.512597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.512613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.512675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.512726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.512778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.512833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.512878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.512884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.512937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.512982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.513040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.513097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.513138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.513144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.513198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.513252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.513304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.513353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.513395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.513403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.513461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.513510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.513561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.513616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.513655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.513659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.513714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.513763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.513816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.513868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.513913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.513920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.513987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.514050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.514116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.514173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.514212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.514218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.514279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.514330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.514402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.514467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.514514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.514520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.514578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.514629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.514681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.514735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.514770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.514775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.514824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.514874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.514922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.514972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.515008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.515013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.515052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944356:10286], now have 1 active actors on pipe
2025-10-01T14:13:30.515220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:30.515261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:30.515269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256269963944356:10286]
2025-10-01T14:13:30.515271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:30.515293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1991 reason: error at write: Disconnected sessionId: src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0
2025-10-01T14:13:30.515476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1991 sessionId: src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0 is DEAD
2025-10-01T14:13:30.515624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:30.515633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0] Write session will restart in 0.007066s
2025-10-01T14:13:30.515653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0] Write session: Do CDS request
2025-10-01T14:13:30.515658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:30.515812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:30.521638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:30.522954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:30.523108Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:30.523114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:30.523122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:30.523161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:30.523189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256267587044615:10591]
2025-10-01T14:13:30.523576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:30.523805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:30.523827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.523834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:30.524022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:30.524057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.524061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.524062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.524062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.524063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.524064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.524064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.524065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.524066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.524066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.524067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.524069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.524069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.524070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.524073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.524078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.524080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.524082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.524084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.524087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.524088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.524090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.524092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.524095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.524097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.524099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.524101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.524103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.524108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.524108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:30.524112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.524121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1992
2025-10-01T14:13:30.524116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.524120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.524122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.524125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.524127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.524130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.524132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.524134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.524138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.524140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.524143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.524145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.524148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.524151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.524154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.524158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.524162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.524166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.524169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.524173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.524178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.524182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.524186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.524191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.524198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.524200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.524219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:30.524231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.524252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:30.524259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:30.524261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:30.524630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1992 sessionId:  describe result for acl check
2025-10-01T14:13:30.524666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:30.524672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:30.524674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:30.524678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256269963944408:10819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:30.525172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256269963944408:10819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:30.527090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256269963944408:10819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:30.527415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:30.527926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:30.527938Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:30.527939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:30.527954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:30.527959Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1991 [2:7556256267587044615:10591]
2025-10-01T14:13:30.527971Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:30.527985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:30.527990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.527993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.527994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.528004Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:30.528011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:30.528015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:30.528050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.528054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.528056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.528058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:30.528060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:30.528103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:30.528108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.528114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.528119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.528130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:30.528146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944367:2446], now have 1 active actors on pipe
2025-10-01T14:13:30.528154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256267587044610:10591]
2025-10-01T14:13:30.528155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256267587044610:10591]
2025-10-01T14:13:30.528156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256267587044610:10591]
2025-10-01T14:13:30.528165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:30.528176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:30.528180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:30.528182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:30.528184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:30.528178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1991
2025-10-01T14:13:30.528186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:30.528188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:30.528201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256267587044610:10591]
2025-10-01T14:13:30.528205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:30.528207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:30.532803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256269963944408:10819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:30.532817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256269963944408:10819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:30.532820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256269963944408:10819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:30.532828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:30.533015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944447:10819], now have 1 active actors on pipe
2025-10-01T14:13:30.533076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1991
2025-10-01T14:13:30.533125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.533134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.533153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:30.533163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.533170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.533172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:30.533181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.533191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:30.533205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.533327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.533333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.533344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.533399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1992 partition: 0 MaxSeqNo: 45 sessionId: src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0
2025-10-01T14:13:30.533723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cedc519-32cc9fe0-51c2edc8-fbd5956f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:30.535936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0] Write session: try to update token
2025-10-01T14:13:30.535948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:30.538689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:30.538701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:30.538714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256267587044610:10591]
2025-10-01T14:13:30.538743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:30.538748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:30.538884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:30.539001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:30.539123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:30.539239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:30.539401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:30.539428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:30.548265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1992 sessionId: src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:30.550407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:30.550582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.550600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.550642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:30.550723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:30.556903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:30.556916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:30.556917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:30.556920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:30.556928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256267587044610:10591]
2025-10-01T14:13:30.556931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256267587044610:10591]
2025-10-01T14:13:30.556934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256267587044610:10591]
2025-10-01T14:13:30.556968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:30.556971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:30.556976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.556977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:30.556979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:30.556983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:30.557087Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:30.615309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256269963944462:10286]
2025-10-01T14:13:30.615447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 1991, pipe: [1:7556256269963944462:10286]
2025-10-01T14:13:30.692697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:30.699173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.699199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.699351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.699407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.699463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.699523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.699562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.699570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.699630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.699689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.699743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.699802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.699846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.699853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.699916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.699975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.700034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.700091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.700138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.700144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.700204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.700264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.700320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.700376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.700416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.700423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.700481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.700537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.700594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.700670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.700710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.700716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.700779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.700834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.700890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.700951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.700990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.700995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.701055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.701108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.701165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.701225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.701266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.701271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.701330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.701383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.701442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.701501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.701546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.701552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.701612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.701663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.701729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.701789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.701830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.701835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.701895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.701951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.702007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.702059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.702100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.702106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.702158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944462:10286], now have 1 active actors on pipe
2025-10-01T14:13:30.702426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:30.702484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:30.702490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:30.702513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1992 reason: error at write: Disconnected sessionId: src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0
2025-10-01T14:13:30.702643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256269963944462:10286]
2025-10-01T14:13:30.702702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1992 sessionId: src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0 is DEAD
2025-10-01T14:13:30.702876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:30.702893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0] Write session will restart in 0.005026s
2025-10-01T14:13:30.702911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0] Write session: Do CDS request
2025-10-01T14:13:30.702917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:30.702952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:30.708808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.708924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:30.708939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1993
2025-10-01T14:13:30.709050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.709083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:30.709093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:30.709096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:30.709459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1993 sessionId:  describe result for acl check
2025-10-01T14:13:30.709491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:30.709498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:30.709499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:30.709504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256269963944503:10824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:30.709811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:30.709995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256269963944503:10824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:30.710945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:30.711073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:30.711080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:30.711088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:30.711116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:30.711143Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256267587044722:10604]
2025-10-01T14:13:30.711511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:30.711720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:30.711746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:30.711825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256269963944503:10824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:30.711944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:30.711988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.711993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.711993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.711994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.711995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.711995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.711996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.711996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.711997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.711998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.712000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.712000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.712001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.712001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.712004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.712010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.712012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.712014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.712017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.712020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.712024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.712027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.712030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.712033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.712036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.712040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.712043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.712046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.712052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.712062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.712066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.712069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.712071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.712074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.712076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.712079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.712081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.712084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.712086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.712088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.712090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.712093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.712095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.712103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.712105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.712108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.712114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.712117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.712120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.712124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.712127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.712129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.712131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.712136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.712138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.712141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.712160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:30.715374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256269963944503:10824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:30.715385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256269963944503:10824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:30.715388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256269963944503:10824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:30.715395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:30.715590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:30.716132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:30.716143Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:30.716145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:30.716147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:30.716152Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1992 [2:7556256267587044722:10604]
2025-10-01T14:13:30.716161Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:30.716178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:30.716183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.716185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.716186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.716197Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:30.716203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:30.716208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:30.716254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.716269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.716275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.716277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:30.716280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:30.716337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:30.716343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.716353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.716362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.716371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:30.716386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944467:2446], now have 1 active actors on pipe
2025-10-01T14:13:30.716391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944541:10824], now have 1 active actors on pipe
2025-10-01T14:13:30.716396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256267587044717:10604]
2025-10-01T14:13:30.716397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256267587044717:10604]
2025-10-01T14:13:30.716398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256267587044717:10604]
2025-10-01T14:13:30.716407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:30.716418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:30.716420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:30.716422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:30.716424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:30.716418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1992
2025-10-01T14:13:30.716429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:30.716429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1992
2025-10-01T14:13:30.716431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:30.716454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.716461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.716470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256267587044717:10604]
2025-10-01T14:13:30.716477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:30.716486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:30.716498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|170937b1-dc3307be-51d6beac-717b4fea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:30.716506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.716508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.716514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:30.716522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.716533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:30.716554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.716672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.716677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.716687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.716775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1993 partition: 0 MaxSeqNo: 45 sessionId: src_id|170937b1-dc3307be-51d6beac-717b4fea_0
2025-10-01T14:13:30.717040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af7ee7c-9d1770d2-8f7f80d7-f47b3de7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|170937b1-dc3307be-51d6beac-717b4fea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:30.719174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|170937b1-dc3307be-51d6beac-717b4fea_0] Write session: try to update token
2025-10-01T14:13:30.719188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|170937b1-dc3307be-51d6beac-717b4fea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:30.731540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1993 sessionId: src_id|170937b1-dc3307be-51d6beac-717b4fea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:30.733811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:30.734016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.734040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.734076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:30.734161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:30.736811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:30.736828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:30.736830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:30.736832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:30.736841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256267587044717:10604]
2025-10-01T14:13:30.736846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256267587044717:10604]
2025-10-01T14:13:30.736849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256267587044717:10604]
2025-10-01T14:13:30.736892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:30.736900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:30.736903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.736905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:30.736905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:30.736908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:30.737029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:30.802728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256269963944549:10286]
2025-10-01T14:13:30.802957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 1992, pipe: [1:7556256269963944549:10286]
2025-10-01T14:13:30.873022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:30.879253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.879273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.879410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.879461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.879512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.879569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.879614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.879623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.879682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.879735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.879790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.879843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.879881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.879888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.879938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.879982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.880028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.880074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.880112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.880113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.880163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.880210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.880257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.880303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.880341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.880346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.880398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.880446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.880492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.880539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.880580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.880588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.880655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.880708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.880766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.880817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.880853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.880858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.880910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.880955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.881001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.881054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.881092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.881097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.881150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.881208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.881255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.881305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.881345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.881351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.881408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.881456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.881505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.881559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.881600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.881607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.881662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:30.881710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:30.881762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:30.881812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:30.881848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:30.881852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:30.881890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944549:10286], now have 1 active actors on pipe
2025-10-01T14:13:30.882084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:30.882153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:30.882161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:30.882184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1993 reason: error at write: Disconnected sessionId: src_id|170937b1-dc3307be-51d6beac-717b4fea_0
2025-10-01T14:13:30.882302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256269963944549:10286]
2025-10-01T14:13:30.882352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1993 sessionId: src_id|170937b1-dc3307be-51d6beac-717b4fea_0 is DEAD
2025-10-01T14:13:30.882496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170937b1-dc3307be-51d6beac-717b4fea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:30.882505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170937b1-dc3307be-51d6beac-717b4fea_0] Write session will restart in 0.005211s
2025-10-01T14:13:30.882523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170937b1-dc3307be-51d6beac-717b4fea_0] Write session: Do CDS request
2025-10-01T14:13:30.882528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170937b1-dc3307be-51d6beac-717b4fea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:30.882648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:30.888852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|170937b1-dc3307be-51d6beac-717b4fea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.888922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:30.888936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1994
2025-10-01T14:13:30.889045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:30.889073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:30.889082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:30.889089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:30.889477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1994 sessionId:  describe result for acl check
2025-10-01T14:13:30.889513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:30.889519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:30.889521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:30.889525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256269963944591:10828] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:30.889794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:30.890007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256269963944591:10828] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:30.891121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:30.891320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:30.891333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:30.891346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:30.891409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:30.891450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256267587044799:10606]
2025-10-01T14:13:30.891954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256269963944591:10828] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:30.892017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:30.892255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:30.892303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:30.892590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:30.892665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.892671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.892672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.892673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.892674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.892675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.892676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.892679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.892680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.892681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.892682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.892683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.892684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.892686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.892691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.892699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.892703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.892707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.892711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.892715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.892719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.892723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.892726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.892730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.892734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.892737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.892741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.892745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.892751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.892758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:30.892764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.892770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:30.892779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.892784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:30.892792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.892797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:30.892802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.892810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:30.892815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.892824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:30.892828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.892833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:30.892842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.892846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:30.892855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.892860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:30.892864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.892869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.892876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.892881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.892884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.892893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.892897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.892902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:30.892909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.892914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:30.892950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:30.896245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256269963944591:10828] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:30.896255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256269963944591:10828] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:30.896257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256269963944591:10828] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:30.896263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:30.896493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:30.897069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:30.897086Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:30.897089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:30.897092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:30.897098Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1993 [2:7556256267587044799:10606]
2025-10-01T14:13:30.897112Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:30.897126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:30.897134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.897138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.897140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.897156Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:30.897165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:30.897170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:30.897219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.897227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.897229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.897233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:30.897236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:30.897294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:30.897300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.897311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:30.897322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:30.897343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:30.897361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944551:2446], now have 1 active actors on pipe
2025-10-01T14:13:30.897370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944631:10828], now have 1 active actors on pipe
2025-10-01T14:13:30.897361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1993
2025-10-01T14:13:30.897376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256267587044794:10606]
2025-10-01T14:13:30.897373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1993
2025-10-01T14:13:30.897382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256267587044794:10606]
2025-10-01T14:13:30.897384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256267587044794:10606]
2025-10-01T14:13:30.897391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:30.897403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:30.897408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:30.897411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:30.897412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:30.897417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:30.897420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:30.897455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.897464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.897476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256267587044794:10606]
2025-10-01T14:13:30.897486Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:30.897501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:30.897517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:30.897529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:30.897537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:30.897539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:30.897547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:30.897560Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:30.897584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.897733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.897743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.897758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:30.897833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1994 partition: 0 MaxSeqNo: 45 sessionId: src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0
2025-10-01T14:13:30.898110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|170937b1-dc3307be-51d6beac-717b4fea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:30.900366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0] Write session: try to update token
2025-10-01T14:13:30.900379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:30.913126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1994 sessionId: src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:30.915145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:30.915351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:30.915372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:30.915413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:30.915487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:30.917987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:30.918003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:30.918005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:30.918006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:30.918013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256267587044794:10606]
2025-10-01T14:13:30.918016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256267587044794:10606]
2025-10-01T14:13:30.918018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256267587044794:10606]
2025-10-01T14:13:30.918053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:30.918064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:30.918065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:30.918174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:30.918338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:30.918349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:30.918352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:30.982449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256269963944639:10286]
2025-10-01T14:13:30.982691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 1993, pipe: [1:7556256269963944639:10286]
2025-10-01T14:13:31.062498Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:31.068905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.068929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.069075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.069126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.069182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.069234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.069275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.069285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.069342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.069392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.069445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.069504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.069553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.069558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.069606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.069651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.069697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.069743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.069779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.069783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.069831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.069880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.069926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.069974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.070015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.070022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.070074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.070121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.070168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.070218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.070255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.070260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.070309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.070355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.070423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.070475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.070513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.070520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.070576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.070627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.070676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.070725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.070765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.070770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.070821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.070867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.070915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.070965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.071002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.071007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.071068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.071119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.071171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.071221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.071257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.071262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.071315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.071364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.071414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.071466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.071515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.071522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.071567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256269963944639:10286], now have 1 active actors on pipe
2025-10-01T14:13:31.071769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:31.071782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:31.071783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:31.071814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1994 reason: error at write: Disconnected sessionId: src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0
2025-10-01T14:13:31.071817Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256269963944639:10286]
2025-10-01T14:13:31.072034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1994 sessionId: src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0 is DEAD
2025-10-01T14:13:31.072130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:31.072145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0] Write session will restart in 0.008841s
2025-10-01T14:13:31.072162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0] Write session: Do CDS request
2025-10-01T14:13:31.072168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:31.072311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:31.079460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:31.080805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:31.080959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:31.080966Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:31.080973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:31.081002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:31.081046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256271882012173:10608]
2025-10-01T14:13:31.081424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:31.081644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:31.081672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:31.081876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:31.081886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.081914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.081918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.081919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.081920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.081920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.081921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.081923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.081923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.081924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.081924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.081925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.081925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.081926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.081926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.081930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.081935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.081937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.081939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.081941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.081943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.081945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.081947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.081949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.081951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.081953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.081955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.081957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.081959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.081964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.081969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.081973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.082001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:31.082014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1995
2025-10-01T14:13:31.081975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.081978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.081981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.081983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.081986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.081988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.081993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.081995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.081997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.081999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.082002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.082005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.082008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.082010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.082013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.082015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.082019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.082021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.082024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.082026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.082028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.082031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.082033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.082035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.082038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.082057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:31.082120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.082146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:31.082155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:31.082160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:31.082484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1995 sessionId:  describe result for acl check
2025-10-01T14:13:31.082521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:31.082528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:31.082529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:31.082534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256274258911981:10833] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:31.083002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256274258911981:10833] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:31.084906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256274258911981:10833] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:31.085383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:31.085888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:31.085899Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:31.085901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:31.085903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:31.085907Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1994 [2:7556256271882012173:10608]
2025-10-01T14:13:31.085916Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:31.085926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:31.085929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.085931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.085932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.085945Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:31.085952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:31.085956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:31.085995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.086002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.086003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.086006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:31.086008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:31.086052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:31.086056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.086062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.086067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.086076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:31.086092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258911937:2446], now have 1 active actors on pipe
2025-10-01T14:13:31.086102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256271882012168:10608]
2025-10-01T14:13:31.086104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256271882012168:10608]
2025-10-01T14:13:31.086105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256271882012168:10608]
2025-10-01T14:13:31.086113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:31.086122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:31.086126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:31.086129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:31.086131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:31.086133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:31.086144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:31.086136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1994
2025-10-01T14:13:31.086166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256271882012168:10608]
2025-10-01T14:13:31.086173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:31.086187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:31.090582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256274258911981:10833] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:31.090594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256274258911981:10833] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:31.090596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256274258911981:10833] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:31.090604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:31.090770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912020:10833], now have 1 active actors on pipe
2025-10-01T14:13:31.090791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1994
2025-10-01T14:13:31.090840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.090849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.090868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71084242-a47bc4e8-d98f131e-3c17f824_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:31.090876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.090886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.090887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:31.090895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.090916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:31.090933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.091054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.091061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.091071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.091122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1995 partition: 0 MaxSeqNo: 45 sessionId: src_id|71084242-a47bc4e8-d98f131e-3c17f824_0
2025-10-01T14:13:31.091411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14eedb1d-82b73489-7e39d8ce-1cfd22f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|71084242-a47bc4e8-d98f131e-3c17f824_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:31.093686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71084242-a47bc4e8-d98f131e-3c17f824_0] Write session: try to update token
2025-10-01T14:13:31.093700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71084242-a47bc4e8-d98f131e-3c17f824_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:31.105223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:31.105238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:31.105240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:31.105242Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:31.105250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256271882012168:10608]
2025-10-01T14:13:31.105254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256271882012168:10608]
2025-10-01T14:13:31.105257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256271882012168:10608]
2025-10-01T14:13:31.105287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:31.105291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:31.105293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:31.105294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:31.105299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.105300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:31.105432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:31.106133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1995 sessionId: src_id|71084242-a47bc4e8-d98f131e-3c17f824_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:31.108468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:31.171846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256274258912024:10286]
2025-10-01T14:13:31.171980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 1994, pipe: [1:7556256274258912024:10286]
2025-10-01T14:13:31.241800Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:31.242082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.242094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.242129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912024:10286], now have 1 active actors on pipe
2025-10-01T14:13:31.242296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:31.242319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:31.242335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:31.242364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256274258912024:10286]
2025-10-01T14:13:31.242397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:31.242403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1995 reason: error at write: Disconnected sessionId: src_id|71084242-a47bc4e8-d98f131e-3c17f824_0
2025-10-01T14:13:31.242586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1995 sessionId: src_id|71084242-a47bc4e8-d98f131e-3c17f824_0 is DEAD
2025-10-01T14:13:31.242727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71084242-a47bc4e8-d98f131e-3c17f824_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:31.242736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71084242-a47bc4e8-d98f131e-3c17f824_0] Write session will restart in 0.005839s
2025-10-01T14:13:31.242762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71084242-a47bc4e8-d98f131e-3c17f824_0] Write session: Do CDS request
2025-10-01T14:13:31.242766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71084242-a47bc4e8-d98f131e-3c17f824_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:31.249920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71084242-a47bc4e8-d98f131e-3c17f824_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.249928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:31.249941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1996
2025-10-01T14:13:31.250115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.250161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:31.250171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:31.250174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:31.250229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:31.250593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1996 sessionId:  describe result for acl check
2025-10-01T14:13:31.250626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:31.250632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:31.250634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:31.250638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256274258912065:10837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:31.251148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256274258912065:10837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:31.251597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:31.251735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:31.251742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:31.251750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:31.251797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:31.251824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256271882012254:10611]
2025-10-01T14:13:31.252304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:31.252551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:31.252580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:31.252807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:31.252820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256274258912065:10837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:31.252849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.252853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.252854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.252855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.252855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.252856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.252857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.252857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.252858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.252859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.252860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.252860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.252863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.252863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.252866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.252871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.252874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.252876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.252878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.252880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.252882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.252884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.252886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.252889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.252891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.252892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.252895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.252897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.252901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.252906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.252910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.252916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.252921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.252926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.252930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.252935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.252939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.252942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.252947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.252952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.252955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.252959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.252962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.252967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.252971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.252975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.252978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.252982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.252986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.252991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.253001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.253005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.253010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.253017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.253022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.253029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.253060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:31.256289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256274258912065:10837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:31.256303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256274258912065:10837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:31.256308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256274258912065:10837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:31.256316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:31.256492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:31.257091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:31.257106Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:31.257108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:31.257111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:31.257116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1995 [2:7556256271882012254:10611]
2025-10-01T14:13:31.257127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:31.257141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:31.257147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.257149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.257150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.257162Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:31.257169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:31.257176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:31.257216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.257221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.257222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.257225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:31.257227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:31.257277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:31.257282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.257289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.257294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.257302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:31.257321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912025:2446], now have 1 active actors on pipe
2025-10-01T14:13:31.257328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912106:10837], now have 1 active actors on pipe
2025-10-01T14:13:31.257359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256271882012249:10611]
2025-10-01T14:13:31.257365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256271882012249:10611]
2025-10-01T14:13:31.257366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256271882012249:10611]
2025-10-01T14:13:31.257378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:31.257391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:31.257393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:31.257394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:31.257396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:31.257405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:31.257408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:31.257389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1995
2025-10-01T14:13:31.257396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1995
2025-10-01T14:13:31.257431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256271882012249:10611]
2025-10-01T14:13:31.257441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:31.257444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:31.257458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.257464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.257496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2596ade0-59b1dc67-210d9d97-5323b651_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:31.257504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.257506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.257508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:31.257514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.257524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:31.257538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.257659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.257664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.257673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.257753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1996 partition: 0 MaxSeqNo: 45 sessionId: src_id|2596ade0-59b1dc67-210d9d97-5323b651_0
2025-10-01T14:13:31.258121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71084242-a47bc4e8-d98f131e-3c17f824_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2596ade0-59b1dc67-210d9d97-5323b651_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:31.260529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2596ade0-59b1dc67-210d9d97-5323b651_0] Write session: try to update token
2025-10-01T14:13:31.260546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2596ade0-59b1dc67-210d9d97-5323b651_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:31.273539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1996 sessionId: src_id|2596ade0-59b1dc67-210d9d97-5323b651_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:31.275634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:31.275755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.275781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.277499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:31.277510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:31.277512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:31.277513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:31.277522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256271882012249:10611]
2025-10-01T14:13:31.277527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256271882012249:10611]
2025-10-01T14:13:31.277531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256271882012249:10611]
2025-10-01T14:13:31.277564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:31.277572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:31.277574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:31.277577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:31.277585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:31.277591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.277592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:31.277634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:31.277706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:31.342384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256274258912127:10286]
2025-10-01T14:13:31.342594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 1995, pipe: [1:7556256274258912127:10286]
2025-10-01T14:13:31.412950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:31.419770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.419791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.419926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.419978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.420034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.420086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.420129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.420136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.420192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.420247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.420310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.420369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.420406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.420411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.420462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.420512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.420562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.420621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.420661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.420668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.420728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.420775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.420824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.420872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.420915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.420926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.420977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.421033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.421092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.421142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.421179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.421184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.421237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.421284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.421338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.421394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.421439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.421444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.421506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.421556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.421607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.421657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.421699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.421704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.421755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.421805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.421863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.421928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.421974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.421980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.422034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.422085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.422137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.422191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.422231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.422236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.422299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:31.422358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:31.422427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:31.422482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:31.422521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:31.422526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:31.422566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912127:10286], now have 1 active actors on pipe
2025-10-01T14:13:31.422752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:31.422777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:31.422781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:31.422807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1996 reason: error at write: Disconnected sessionId: src_id|2596ade0-59b1dc67-210d9d97-5323b651_0
2025-10-01T14:13:31.422811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256274258912127:10286]
2025-10-01T14:13:31.423004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1996 sessionId: src_id|2596ade0-59b1dc67-210d9d97-5323b651_0 is DEAD
2025-10-01T14:13:31.423160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2596ade0-59b1dc67-210d9d97-5323b651_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:31.423169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2596ade0-59b1dc67-210d9d97-5323b651_0] Write session will restart in 0.008542s
2025-10-01T14:13:31.423189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2596ade0-59b1dc67-210d9d97-5323b651_0] Write session: Do CDS request
2025-10-01T14:13:31.423193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2596ade0-59b1dc67-210d9d97-5323b651_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:31.423504Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:31.429629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:31.431193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:31.431325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:31.431333Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:31.431341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:31.431370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:31.431403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256271882012353:10616]
2025-10-01T14:13:31.431804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:31.432006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:31.432032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:31.432253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:31.432289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.432294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.432294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.432295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.432296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.432296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.432298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.432298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.432299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.432299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.432300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.432300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.432301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.432301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.432304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.432310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.432312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.432314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.432316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.432318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.432320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.432322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.432325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.432327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.432329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.432331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.432333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.432335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.432339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.432344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.432349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.432352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.432354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.432357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.432359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.432361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.432363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.432367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.432369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.432372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.432375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.432377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.432380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.432382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.432384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.432387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.432389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.432391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.432393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.432396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.432398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.432400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.432403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.432406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.432409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.432414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.432443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:31.432840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2596ade0-59b1dc67-210d9d97-5323b651_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.432969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:31.432984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1997
2025-10-01T14:13:31.433085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.433124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:31.433134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:31.433137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:31.433978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1997 sessionId:  describe result for acl check
2025-10-01T14:13:31.434008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:31.434010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:31.434011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:31.434017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256274258912184:10848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:31.434508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256274258912184:10848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:31.435840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:31.436255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256274258912184:10848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:31.436408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:31.436422Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:31.436426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:31.436429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:31.436435Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1996 [2:7556256271882012353:10616]
2025-10-01T14:13:31.436449Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:31.436468Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:31.436475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.436478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.436480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.436495Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:31.436503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:31.436509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:31.436555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.436562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.436563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.436567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:31.436569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:31.436644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:31.436650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.436661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.436675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.436693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:31.436714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912138:2446], now have 1 active actors on pipe
2025-10-01T14:13:31.436724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256271882012348:10616]
2025-10-01T14:13:31.436727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256271882012348:10616]
2025-10-01T14:13:31.436729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256271882012348:10616]
2025-10-01T14:13:31.436716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1996
2025-10-01T14:13:31.436738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:31.436751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:31.436754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:31.436757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:31.436759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:31.436766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:31.436768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:31.436794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256271882012348:10616]
2025-10-01T14:13:31.436804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:31.436807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:31.441550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256274258912184:10848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:31.441564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256274258912184:10848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:31.441568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256274258912184:10848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:31.441576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:31.441808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912223:10848], now have 1 active actors on pipe
2025-10-01T14:13:31.441847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1996
2025-10-01T14:13:31.441909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.441919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.441940Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:31.441951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.441955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.441957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:31.441965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.441979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:31.441996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.442112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.442118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.442128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.442221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1997 partition: 0 MaxSeqNo: 45 sessionId: src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0
2025-10-01T14:13:31.442564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2596ade0-59b1dc67-210d9d97-5323b651_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:31.444982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0] Write session: try to update token
2025-10-01T14:13:31.445000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:31.457149Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:31.457168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:31.457170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:31.457172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:31.457182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256271882012348:10616]
2025-10-01T14:13:31.457186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256271882012348:10616]
2025-10-01T14:13:31.457189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256271882012348:10616]
2025-10-01T14:13:31.457231Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:31.457237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:31.457244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.457247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:31.457253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:31.457257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:31.457376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:31.458171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1997 sessionId: src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:31.460594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:31.523129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256274258912235:10286]
2025-10-01T14:13:31.523372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 1996, pipe: [1:7556256274258912235:10286]
2025-10-01T14:13:31.596828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:31.597106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.597122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.597159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912235:10286], now have 1 active actors on pipe
2025-10-01T14:13:31.597343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:31.597369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:31.597382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:31.597393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:31.597434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1997 reason: error at write: Disconnected sessionId: src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0
2025-10-01T14:13:31.597440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256274258912235:10286]
2025-10-01T14:13:31.597611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1997 sessionId: src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0 is DEAD
2025-10-01T14:13:31.597744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:31.597753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0] Write session will restart in 0.008964s
2025-10-01T14:13:31.597773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0] Write session: Do CDS request
2025-10-01T14:13:31.597778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:31.604105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:31.605505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:31.605641Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:31.605648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:31.605657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:31.605686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:31.605720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256271882012434:10618]
2025-10-01T14:13:31.606176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:31.606395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:31.606425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:31.606623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:31.606667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.606673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.606674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.606674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.606675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.606676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.606676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.606677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.606677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.606678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.606679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.606681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.606682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.606683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.606686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.606691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.606693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.606695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.606714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.606716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.606718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.606721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.606725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.606729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.606732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.606735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.606739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.606742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.606748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.606755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.606761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.606765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.606770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.606772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.606775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.606778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.606780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.606783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.606785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.606788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.606791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.606794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.606796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.606799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.606801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.606804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.606806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.606809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.606811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.606814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.606816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.606818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.606820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.606823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.606825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.606827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.606847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:31.607863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.607941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:31.607964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1998
2025-10-01T14:13:31.608115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.608138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:31.608145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:31.608148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:31.608643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1998 sessionId:  describe result for acl check
2025-10-01T14:13:31.608672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:31.608675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:31.608676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:31.608679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256274258912297:10854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:31.609031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256274258912297:10854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:31.610139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:31.610578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256274258912297:10854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:31.610691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:31.610701Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:31.610703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:31.610705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:31.610709Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1997 [2:7556256271882012434:10618]
2025-10-01T14:13:31.610718Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:31.610729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:31.610731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.610734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.610735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.610745Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:31.610749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:31.610753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:31.610792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.610796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.610798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.610800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:31.610802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:31.610858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:31.610869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.610878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.610888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.610905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:31.610924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912249:2446], now have 1 active actors on pipe
2025-10-01T14:13:31.610932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256271882012429:10618]
2025-10-01T14:13:31.610934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256271882012429:10618]
2025-10-01T14:13:31.610936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256271882012429:10618]
2025-10-01T14:13:31.610947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:31.610943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1997
2025-10-01T14:13:31.610961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:31.610962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:31.610967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:31.610969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:31.610974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:31.610976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:31.611002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256271882012429:10618]
2025-10-01T14:13:31.611012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:31.611019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:31.615350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256274258912297:10854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:31.615362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256274258912297:10854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:31.615364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256274258912297:10854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:31.615369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:31.615537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912336:10854], now have 1 active actors on pipe
2025-10-01T14:13:31.615558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1997
2025-10-01T14:13:31.615596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.615607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.615632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32f81219-be147438-14786c3b-6bb7998c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:31.615644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.615648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.615651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:31.615661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.615677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:31.615697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.615782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.615790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.615802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.615845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1998 partition: 0 MaxSeqNo: 45 sessionId: src_id|32f81219-be147438-14786c3b-6bb7998c_0
2025-10-01T14:13:31.616201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|caac7ac3-aac18830-10e3a24c-1a44f37b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|32f81219-be147438-14786c3b-6bb7998c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:31.618995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f81219-be147438-14786c3b-6bb7998c_0] Write session: try to update token
2025-10-01T14:13:31.619012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f81219-be147438-14786c3b-6bb7998c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:31.620760Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:31.620773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:31.620780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256271882012429:10618]
2025-10-01T14:13:31.620814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:31.620817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:31.620961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:31.621089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:31.621217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:31.621345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:31.621510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:31.621537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:31.634930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1998 sessionId: src_id|32f81219-be147438-14786c3b-6bb7998c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:31.637648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:31.638555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.638577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.638595Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:31.638598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:31.638599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:31.638601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:31.638607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256271882012429:10618]
2025-10-01T14:13:31.638614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256271882012429:10618]
2025-10-01T14:13:31.638617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256271882012429:10618]
2025-10-01T14:13:31.638651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:31.638660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:31.638662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:31.638669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:31.638675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.638677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:31.638798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:31.697742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256274258912340:10286]
2025-10-01T14:13:31.698044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 1997, pipe: [1:7556256274258912340:10286]
2025-10-01T14:13:31.783238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:31.783573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:31.783611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912340:10286], now have 1 active actors on pipe
2025-10-01T14:13:31.783769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:31.783851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256274258912340:10286]
2025-10-01T14:13:31.783874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:31.783930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:31.783933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:31.784004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1998 reason: error at write: Disconnected sessionId: src_id|32f81219-be147438-14786c3b-6bb7998c_0
2025-10-01T14:13:31.784163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1998 sessionId: src_id|32f81219-be147438-14786c3b-6bb7998c_0 is DEAD
2025-10-01T14:13:31.784346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f81219-be147438-14786c3b-6bb7998c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:31.784359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f81219-be147438-14786c3b-6bb7998c_0] Write session will restart in 0.008920s
2025-10-01T14:13:31.784390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f81219-be147438-14786c3b-6bb7998c_0] Write session: Do CDS request
2025-10-01T14:13:31.784400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f81219-be147438-14786c3b-6bb7998c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:31.793029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:31.794454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:31.794638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:31.794647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:31.794658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:31.794702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:31.794737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256271882012548:10631]
2025-10-01T14:13:31.794859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32f81219-be147438-14786c3b-6bb7998c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.794927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:31.794950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1999
2025-10-01T14:13:31.795108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:31.795135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.795185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:31.795193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:31.795197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:31.795373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:31.795416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:31.795449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1999 sessionId:  describe result for acl check
2025-10-01T14:13:31.795472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:31.795473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:31.795474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:31.795478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256274258912389:10858] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:31.795683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:31.795727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.795732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.795733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.795735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.795736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.795736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.795737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.795737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.795738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.795738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.795739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.795740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.795740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.795741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.795744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.795749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.795751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.795753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.795755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.795757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.795759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.795761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.795763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.795765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.795767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.795769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.795771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.795773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.795778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.795783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.795786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.795790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.795793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.795795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.795799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.795802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.795805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.795807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.795810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.795812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.795814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.795817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.795819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.795822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.795824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.795826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.795829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.795831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.795833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.795836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.795838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.795840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.795843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.795845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.795848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.795850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.795870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:31.795878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256274258912389:10858] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:31.797650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256274258912389:10858] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:31.799224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:31.799750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:31.799761Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:31.799762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:31.799765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:31.799770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1998 [2:7556256271882012548:10631]
2025-10-01T14:13:31.799779Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:31.799758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256274258912389:10858] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:31.799791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:31.799774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256274258912389:10858] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:31.799793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.799777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256274258912389:10858] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:31.799797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.799799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.799810Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:31.799785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:31.799813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:31.799817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:31.799857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.799862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.799864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.799867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:31.799869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:31.799918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:31.799923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.799929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.799935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.799944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:31.799960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912342:2446], now have 1 active actors on pipe
2025-10-01T14:13:31.799969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256271882012543:10631]
2025-10-01T14:13:31.799970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256271882012543:10631]
2025-10-01T14:13:31.799971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256271882012543:10631]
2025-10-01T14:13:31.799979Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:31.799985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912426:10858], now have 1 active actors on pipe
2025-10-01T14:13:31.799991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:31.799993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:31.799994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:31.799995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:31.800002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:31.800003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:31.799992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1998
2025-10-01T14:13:31.799999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1998
2025-10-01T14:13:31.800026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256271882012543:10631]
2025-10-01T14:13:31.800034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:31.800039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:31.800043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.800046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.800074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:31.800082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.800085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.800086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:31.800092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.800100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:31.800111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.800216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.800221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.800231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.800280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1999 partition: 0 MaxSeqNo: 45 sessionId: src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0
2025-10-01T14:13:31.800667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32f81219-be147438-14786c3b-6bb7998c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:31.803597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0] Write session: try to update token
2025-10-01T14:13:31.803615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:31.818838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1999 sessionId: src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:31.819018Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:31.819037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:31.819039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:31.819041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:31.819048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256271882012543:10631]
2025-10-01T14:13:31.819051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256271882012543:10631]
2025-10-01T14:13:31.819055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256271882012543:10631]
2025-10-01T14:13:31.819095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:31.819099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:31.819106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:31.819107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.819109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:31.819110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:31.819241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:31.821029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:31.884077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256274258912433:10286]
2025-10-01T14:13:31.884338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 1998, pipe: [1:7556256274258912433:10286]
2025-10-01T14:13:31.959239Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:31.959468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.959480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.959518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912433:10286], now have 1 active actors on pipe
2025-10-01T14:13:31.959684Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:31.959727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256274258912433:10286]
2025-10-01T14:13:31.959739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:31.959756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:31.959824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 1999 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0
2025-10-01T14:13:31.960047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1999 sessionId: src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0 is DEAD
2025-10-01T14:13:31.960242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:31.960255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0] Write session will restart in 0.007729s
2025-10-01T14:13:31.960278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0] Write session: Do CDS request
2025-10-01T14:13:31.960283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:31.967276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:31.968846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.968847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:31.968958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:31.968986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:31.968973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2000
2025-10-01T14:13:31.968994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:31.969003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:31.969046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:31.969078Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256271882012631:10633]
2025-10-01T14:13:31.969097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:31.969126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:31.969137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:31.969141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:31.969493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:31.969494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2000 sessionId:  describe result for acl check
2025-10-01T14:13:31.969523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:31.969524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:31.969525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:31.969529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256274258912485:10863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:31.969708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:31.969738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:31.969967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:31.969980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256274258912485:10863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:31.970002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.970007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.970008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.970009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.970010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.970010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.970013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.970014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.970014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.970015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.970016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.970016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.970017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.970017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.970020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.970029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.970032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.970036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.970038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.970041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.970044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.970047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.970050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.970053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.970056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.970059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.970062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.970065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.970070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.970077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:31.970085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.970102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:31.970109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.970113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:31.970122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.970127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:31.970135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.970138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:31.970141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.970149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:31.970152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.970154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:31.970157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.970160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:31.970162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.970165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:31.970167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.970171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.970173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.970176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.970179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.970182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.970184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.970186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:31.970188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.970191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:31.970210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:31.971834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256274258912485:10863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:31.973707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:31.974279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:31.974291Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:31.974292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:31.974294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:31.974299Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1999 [2:7556256271882012631:10633]
2025-10-01T14:13:31.974310Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:31.974324Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:31.974329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.974332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.974333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.974346Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:31.974351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:31.974358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:31.974352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256274258912485:10863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:31.974366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256274258912485:10863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:31.974383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256274258912485:10863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:31.974391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:31.974422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.974426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.974428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.974430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:31.974432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:31.974483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:31.974488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.974494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:31.974499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:31.974511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:31.974527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912440:2446], now have 1 active actors on pipe
2025-10-01T14:13:31.974535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256271882012626:10633]
2025-10-01T14:13:31.974537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256271882012626:10633]
2025-10-01T14:13:31.974538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256271882012626:10633]
2025-10-01T14:13:31.974547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:31.974555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256274258912521:10863], now have 1 active actors on pipe
2025-10-01T14:13:31.974564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:31.974552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1999
2025-10-01T14:13:31.974570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:31.974572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:31.974574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:31.974580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:31.974582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:31.974590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1999
2025-10-01T14:13:31.974598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256271882012626:10633]
2025-10-01T14:13:31.974603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:31.974610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:31.974619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.974625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.974649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db700f19-9234e6a-70d811c0-1b599022_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:31.974657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:31.974660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:31.974661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:31.974668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:31.974674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:31.974685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.975126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.975131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.975141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:31.975238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2000 partition: 0 MaxSeqNo: 45 sessionId: src_id|db700f19-9234e6a-70d811c0-1b599022_0
2025-10-01T14:13:31.975571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa7c72aa-45374086-64ee3896-e6c930a6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db700f19-9234e6a-70d811c0-1b599022_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:31.978194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db700f19-9234e6a-70d811c0-1b599022_0] Write session: try to update token
2025-10-01T14:13:31.978208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db700f19-9234e6a-70d811c0-1b599022_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:31.991035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2000 sessionId: src_id|db700f19-9234e6a-70d811c0-1b599022_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:31.993471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:31.993772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:31.993792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:31.993809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:31.993811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:31.993815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:31.993816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:31.993824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256271882012626:10633]
2025-10-01T14:13:31.993827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256271882012626:10633]
2025-10-01T14:13:31.993829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256271882012626:10633]
2025-10-01T14:13:31.993861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:31.993871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:31.993873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:31.993876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:31.993878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:31.993880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:31.993994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:32.059693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256278553879824:10286]
2025-10-01T14:13:32.059930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 1999, pipe: [1:7556256278553879824:10286]
2025-10-01T14:13:32.132133Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:32.132448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:32.132493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553879824:10286], now have 1 active actors on pipe
2025-10-01T14:13:32.132586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:32.132635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:32.132669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256278553879824:10286]
2025-10-01T14:13:32.132682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:32.132685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:32.132750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2000 reason: error at write: Disconnected sessionId: src_id|db700f19-9234e6a-70d811c0-1b599022_0
2025-10-01T14:13:32.132924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2000 sessionId: src_id|db700f19-9234e6a-70d811c0-1b599022_0 is DEAD
2025-10-01T14:13:32.133044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db700f19-9234e6a-70d811c0-1b599022_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:32.133052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db700f19-9234e6a-70d811c0-1b599022_0] Write session will restart in 0.007714s
2025-10-01T14:13:32.133071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db700f19-9234e6a-70d811c0-1b599022_0] Write session: Do CDS request
2025-10-01T14:13:32.133076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db700f19-9234e6a-70d811c0-1b599022_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:32.139122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:32.140537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:32.140688Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:32.140696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:32.140706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:32.140746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:32.140778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256276176980013:10636]
2025-10-01T14:13:32.141168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:32.141369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:32.141399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:32.141615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:32.141657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.141663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.141664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.141665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.141667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.141668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.141669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.141672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.141673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.141674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.141675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.141676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.141677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.141678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.141683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.141689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.141691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.141693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.141695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.141697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.141699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.141701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.141703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.141705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.141707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.141709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.141711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.141713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.141717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.141722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.141726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.141729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.141735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.141740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.141744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.141749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.141753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.141759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.141763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.141768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.141772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.141777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.141779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.141782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.141784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.141787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.141789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.141792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.141795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.141798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.141801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.141804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.141807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.141809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.141811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.141814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.141832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db700f19-9234e6a-70d811c0-1b599022_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.141835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:32.141942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:32.141954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2001
2025-10-01T14:13:32.142066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.142089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:32.142093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:32.142095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:32.142430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2001 sessionId:  describe result for acl check
2025-10-01T14:13:32.142458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:32.142463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:32.142464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:32.142468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256278553879880:10869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:32.142861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256278553879880:10869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:32.144691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256278553879880:10869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:32.145440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:32.146016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:32.146028Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:32.146030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:32.146033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:32.146038Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2000 [2:7556256276176980013:10636]
2025-10-01T14:13:32.146048Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:32.146060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:32.146065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.146068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.146070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.146082Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:32.146089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:32.146097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:32.146134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.146140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.146141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.146143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:32.146145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:32.146202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:32.146207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.146216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.146222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.146231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:32.146247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256276176980008:10636]
2025-10-01T14:13:32.146251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256276176980008:10636]
2025-10-01T14:13:32.146252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256276176980008:10636]
2025-10-01T14:13:32.146259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:32.146267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:32.146268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:32.146274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:32.146276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:32.146276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:32.146278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:32.146287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553879830:2446], now have 1 active actors on pipe
2025-10-01T14:13:32.146308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256276176980008:10636]
2025-10-01T14:13:32.146316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:32.146334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:32.146322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2000
2025-10-01T14:13:32.146808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256278553879880:10869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:32.146820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256278553879880:10869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:32.146822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256278553879880:10869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:32.146828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:32.146993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553879917:10869], now have 1 active actors on pipe
2025-10-01T14:13:32.147019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2000
2025-10-01T14:13:32.147063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.147072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.147095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:32.147108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.147114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.147120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:32.147127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.147140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:32.147156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.147284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.147292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.147306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.147384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2001 partition: 0 MaxSeqNo: 45 sessionId: src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0
2025-10-01T14:13:32.147724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db700f19-9234e6a-70d811c0-1b599022_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:32.150280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0] Write session: try to update token
2025-10-01T14:13:32.150296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:32.163443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2001 sessionId: src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:32.165673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:32.165904Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:32.165924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:32.165927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:32.165929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:32.165939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256276176980008:10636]
2025-10-01T14:13:32.165944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256276176980008:10636]
2025-10-01T14:13:32.165948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256276176980008:10636]
2025-10-01T14:13:32.166001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:32.166006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.166015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.166019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:32.166024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:32.166037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:32.166047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.166052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:32.166186Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:32.232747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256278553879922:10286]
2025-10-01T14:13:32.233064Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2000, pipe: [1:7556256278553879922:10286]
2025-10-01T14:13:32.305031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:32.305491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553879922:10286], now have 1 active actors on pipe
2025-10-01T14:13:32.305783Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:32.305763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256278553879922:10286]
2025-10-01T14:13:32.305787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:32.305791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:32.305793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:32.305819Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:13:32.305854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2001 reason: error at write: Disconnected sessionId: src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0
2025-10-01T14:13:32.305929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2001 sessionId: src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0 is DEAD
2025-10-01T14:13:32.306002Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 20 consumer shared/user session shared/user_1_20_11504260435889637302_v1 is DEAD
2025-10-01T14:13:32.306160Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:13:32.306153Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256196949478059:10282] disconnected; active server actors: 1
2025-10-01T14:13:32.306163Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256196949478059:10282] client user disconnected session shared/user_1_20_11504260435889637302_v1
2025-10-01T14:13:32.306221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:32.306229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0] Write session will restart in 0.005069s
2025-10-01T14:13:32.306259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0] Write session: Do CDS request
2025-10-01T14:13:32.306265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:32.306272Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:13:32.306276Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:13:32.306281Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.009051s
2025-10-01T14:13:32.312932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.312967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:32.312980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2002
2025-10-01T14:13:32.313144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.313184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:32.313194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:32.313199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:32.313695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2002 sessionId:  describe result for acl check
2025-10-01T14:13:32.313724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:32.313726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:32.313729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:32.313733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256278553879949:10873] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:32.314163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256278553879949:10873] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:32.315657Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:13:32.315802Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:13:32.315812Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 21
2025-10-01T14:13:32.315898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256278553879949:10873] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:32.315951Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 21 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:13:32.315997Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:13:32.316057Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 auth for : user
2025-10-01T14:13:32.316166Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 Handle describe topics response
2025-10-01T14:13:32.316185Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 auth is DEAD
2025-10-01T14:13:32.316190Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:13:32.316434Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:13:32.316514Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_21_17283748345963503833_v1
2025-10-01T14:13:32.316506Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256278553880002:10877] connected; active server actors: 1
2025-10-01T14:13:32.316522Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256278553880002:10877] session shared/user_1_21_17283748345963503833_v1
2025-10-01T14:13:32.316529Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:13:32.316536Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:13:32.316540Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_21_17283748345963503833_v1" (Sender=[1:7556256278553879989:10877], Pipe=[1:7556256278553880002:10877], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:13:32.316543Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:13:32.316550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:13:32.316556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_21_17283748345963503833_v1" (Sender=[1:7556256278553879989:10877], Pipe=[1:7556256278553880002:10877], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:13:32.316565Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_21_17283748345963503833_v1" sender [1:7556256278553879989:10877] lock partition 0 for ReadingSession "shared/user_1_21_17283748345963503833_v1" (Sender=[1:7556256278553879989:10877], Pipe=[1:7556256278553880002:10877], Partitions=[], ActiveFamilyCount=1) generation 1 step 21
2025-10-01T14:13:32.316573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:13:32.316577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000023s
2025-10-01T14:13:32.316769Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 21 Session: "shared/user_1_21_17283748345963503833_v1" ClientId: "user" PipeClient { RawX1: 7556256278553880002 RawX2: 4503603922348669 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:13:32.316793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:13:32.317100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:32.318343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:32.318494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256278553879949:10873] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:32.318506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256278553879949:10873] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:32.318508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256278553879949:10873] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:32.318515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:32.318525Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:32.318535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:32.318545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:32.318591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:32.318631Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256276176980112:10639]
2025-10-01T14:13:32.319134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:32.319397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:32.319435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:32.319675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:32.319719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.319724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.319725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.319729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.319730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.319731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.319732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.319733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.319734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.319735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.319736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.319737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.319738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.319738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.319742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.319751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.319754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.319757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.319761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.319764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.319767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.319770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.319774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.319777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.319780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.319783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.319786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.319789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.319795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.319802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.319812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.319816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.319820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.319824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.319833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.319840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.319844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.319852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.319856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.319865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.319873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.319878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.319885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.319890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.319898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.319906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.319914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.319919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.319929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.319937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.319944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.319950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.319958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.319962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.319970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.319977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.320017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:32.323649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:32.324243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:32.324257Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:32.324259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:32.324262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:32.324269Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2001 [2:7556256276176980112:10639]
2025-10-01T14:13:32.324283Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:32.324300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:32.324303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.324309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.324311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.324326Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:32.324336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:32.324341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:32.324391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.324397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.324398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.324400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:32.324402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:32.324467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:32.324474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.324485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.324500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.324515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:32.324535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880014:10873], now have 1 active actors on pipe
2025-10-01T14:13:32.324540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553879924:2446], now have 1 active actors on pipe
2025-10-01T14:13:32.324542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880006:10880], now have 1 active actors on pipe
2025-10-01T14:13:32.324547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256276176980106:10639]
2025-10-01T14:13:32.324552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256276176980106:10639]
2025-10-01T14:13:32.324553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256276176980106:10639]
2025-10-01T14:13:32.324565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:32.324577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:32.324589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:32.324593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:32.324592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:32.324597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:32.324600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:32.324625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256276176980106:10639]
2025-10-01T14:13:32.324633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:32.324615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2001
2025-10-01T14:13:32.324626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2001
2025-10-01T14:13:32.324644Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2001, pipe: [1:7556256278553880006:10880]
2025-10-01T14:13:32.324647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:32.324662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.324665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.324690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.324695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.324703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_21_17283748345963503833_v1 on pipe: [1:7556256278553880006:10880]
2025-10-01T14:13:32.324728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:32.324732Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_21_17283748345963503833_v1:1 with generation 2001
2025-10-01T14:13:32.324737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.324741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.324747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:32.324757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.324769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:32.324787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.324792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.324793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:32.324802Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_21_17283748345963503833_v1
2025-10-01T14:13:32.324807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.324824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.324836Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:13:32.324993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.324999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.325008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.325111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2002 partition: 0 MaxSeqNo: 45 sessionId: src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0
2025-10-01T14:13:32.325429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8a715bb4-40e04adf-c09e04ef-890f82d4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:32.327784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0] Write session: try to update token
2025-10-01T14:13:32.327799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:32.329265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:13:32.329298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:13:32.329305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.329310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.329312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.329322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:13:32.329340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:13:32.329490Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759328012324 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:13:32.329512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:13:32.329545Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 sending to client partition status
2025-10-01T14:13:32.340803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2002 sessionId: src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:32.343493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:32.344653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.344676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.344698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:32.344701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:32.344703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:32.344705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:32.344714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256276176980106:10639]
2025-10-01T14:13:32.344719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256276176980106:10639]
2025-10-01T14:13:32.344725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256276176980106:10639]
2025-10-01T14:13:32.344765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:32.344780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:32.344783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:32.344785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:32.344792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.344794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:32.344945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:32.492202Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:32.492641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:32.492848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:32.492907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_21_17283748345963503833_v1
2025-10-01T14:13:32.492911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:32.492952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:32.492960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:32.492971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256278553880006:10880]
2025-10-01T14:13:32.492979Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_21_17283748345963503833_v1
2025-10-01T14:13:32.493030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2002 reason: error at write: Disconnected sessionId: src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0
2025-10-01T14:13:32.493205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2002 sessionId: src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0 is DEAD
2025-10-01T14:13:32.493335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:32.493348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0] Write session will restart in 0.008068s
2025-10-01T14:13:32.493375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0] Write session: Do CDS request
2025-10-01T14:13:32.493380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:32.501446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:32.502890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.502929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:32.502967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:32.502984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2003
2025-10-01T14:13:32.503098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.503118Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:32.503128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:32.503127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:32.503140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:32.503138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:32.503142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:32.503188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:32.503229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256276176980206:10643]
2025-10-01T14:13:32.503471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2003 sessionId:  describe result for acl check
2025-10-01T14:13:32.503503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:32.503505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:32.503507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:32.503511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256278553880105:10889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:32.503845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:32.503937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256278553880105:10889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:32.504168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:32.504209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:32.504514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:32.504567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.504573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.504574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.504575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.504576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.504578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.504579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.504580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.504581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.504584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.504586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.504587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.504588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.504589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.504594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.504616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.504620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.504623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.504627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.504630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.504633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.504636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.504639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.504644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.504647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.504650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.504653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.504657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.504665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.504672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.504677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.504683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.504691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.504696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.504700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.504704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.504709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.504713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.504718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.504722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.504727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.504736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.504741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.504749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.504758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.504766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.504770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.504779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.504785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.504791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.504798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.504805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.504812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.504817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.504820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.504825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.504864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:32.506012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256278553880105:10889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:32.508357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256278553880105:10889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:32.508371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256278553880105:10889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:32.508377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256278553880105:10889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:32.508385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:32.508479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:32.509096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:32.509111Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:32.509114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:32.509117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:32.509123Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2002 [2:7556256276176980206:10643]
2025-10-01T14:13:32.509139Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:32.509161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:32.509164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.509168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.509170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.509184Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:32.509194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:32.509202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:32.509258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.509264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.509265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.509268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:32.509270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:32.509340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:32.509346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.509359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.509375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.509394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:32.509414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256276176980201:10643]
2025-10-01T14:13:32.509421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256276176980201:10643]
2025-10-01T14:13:32.509423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256276176980201:10643]
2025-10-01T14:13:32.509437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:32.509450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880147:10889], now have 1 active actors on pipe
2025-10-01T14:13:32.509458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880057:2446], now have 1 active actors on pipe
2025-10-01T14:13:32.509462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:32.509465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:32.509476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:32.509478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:32.509462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2002
2025-10-01T14:13:32.509476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2002
2025-10-01T14:13:32.509479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:32.509481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:32.509507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256276176980201:10643]
2025-10-01T14:13:32.509517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:32.509519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:32.509544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.509558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.509590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2d51820-935a4a43-d55add06-72dd24fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:32.509603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.509609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.509610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:32.509619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.509630Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:32.509656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.509805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.509816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.509833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.509993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2003 partition: 0 MaxSeqNo: 45 sessionId: src_id|e2d51820-935a4a43-d55add06-72dd24fb_0
2025-10-01T14:13:32.510385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1f5638-b2c9830-3b4735a4-ba337cc6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e2d51820-935a4a43-d55add06-72dd24fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:32.512765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d51820-935a4a43-d55add06-72dd24fb_0] Write session: try to update token
2025-10-01T14:13:32.512782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d51820-935a4a43-d55add06-72dd24fb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:32.525798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2003 sessionId: src_id|e2d51820-935a4a43-d55add06-72dd24fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:32.528247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:32.529723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.529753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.529776Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:32.529779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:32.529782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:32.529784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:32.529795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256276176980201:10643]
2025-10-01T14:13:32.529800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256276176980201:10643]
2025-10-01T14:13:32.529805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256276176980201:10643]
2025-10-01T14:13:32.529850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:32.529861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:32.529867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:32.529868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.529870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:32.529871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:32.530004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:32.593222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256278553880166:10880]
2025-10-01T14:13:32.593596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2002, pipe: [1:7556256278553880166:10880]
2025-10-01T14:13:32.680392Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:32.680860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:32.680927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880166:10880], now have 1 active actors on pipe
2025-10-01T14:13:32.681074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:32.681645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256278553880166:10880]
2025-10-01T14:13:32.681677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:32.691175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:32.692804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:32.693019Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:32.693029Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:32.693040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:32.693102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:32.693141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256276176980301:10646]
2025-10-01T14:13:32.693684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:32.693936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:32.693980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:32.694281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:32.694341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.694346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.694347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.694348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.694349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.694350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.694351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.694352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.694353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.694354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.694355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.694356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.694357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.694358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.694365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.694398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.694401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.694405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.694408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.694412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.694415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.694420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.694424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.694430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.694434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.694438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.694443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.694447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.694453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.694460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.694466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.694475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.694480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.694485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.694492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.694497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.694502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.694508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.694513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.694518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.694528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.694533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.694541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.694546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.694556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.694562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.694570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.694576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.694581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.694587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.694591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.694596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.694600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.694609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.694613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.694618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.694662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:32.698465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:32.698540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:32.698561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:32.698587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2003 reason: error at write: Disconnected sessionId: src_id|e2d51820-935a4a43-d55add06-72dd24fb_0
2025-10-01T14:13:32.698734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2003 sessionId: src_id|e2d51820-935a4a43-d55add06-72dd24fb_0 is DEAD
2025-10-01T14:13:32.698976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d51820-935a4a43-d55add06-72dd24fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:32.698986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d51820-935a4a43-d55add06-72dd24fb_0] Write session will restart in 0.006665s
2025-10-01T14:13:32.699010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d51820-935a4a43-d55add06-72dd24fb_0] Write session: Do CDS request
2025-10-01T14:13:32.699016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d51820-935a4a43-d55add06-72dd24fb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:32.699080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:32.699096Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:32.699099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:32.699102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:32.699108Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2003 [2:7556256276176980301:10646]
2025-10-01T14:13:32.699124Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:32.699141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:32.699144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.699148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.699150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.699165Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:32.699177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:32.699183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:32.699235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.699241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.699243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.699247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:32.699249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:32.699321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:32.699328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.699339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.699350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.699369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:32.699388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256276176980296:10646]
2025-10-01T14:13:32.699398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256276176980296:10646]
2025-10-01T14:13:32.699404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256276176980296:10646]
2025-10-01T14:13:32.699417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:32.699434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:32.699434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:32.699437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:32.699439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:32.699454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:32.699457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:32.699487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256276176980296:10646]
2025-10-01T14:13:32.699498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:32.699504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:32.704709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880169:2446], now have 1 active actors on pipe
2025-10-01T14:13:32.705077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2003
2025-10-01T14:13:32.706909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d51820-935a4a43-d55add06-72dd24fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.707024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:32.707045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2004
2025-10-01T14:13:32.707215Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.707244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:32.707250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:32.707255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:32.707803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2004 sessionId:  describe result for acl check
2025-10-01T14:13:32.707866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:32.707874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:32.707877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:32.707886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256278553880227:10894] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:32.708448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256278553880227:10894] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:32.712164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256278553880227:10894] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:32.718893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256278553880227:10894] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:32.718913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256278553880227:10894] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:32.718917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256278553880227:10894] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:32.718927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:32.719211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880260:10894], now have 1 active actors on pipe
2025-10-01T14:13:32.719312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2003
2025-10-01T14:13:32.719409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.719426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.719463Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:32.719479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.719488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.719491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:32.719503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.719524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:32.719548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.719751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.719763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.719788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.719862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2004 partition: 0 MaxSeqNo: 45 sessionId: src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0
2025-10-01T14:13:32.720173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2d51820-935a4a43-d55add06-72dd24fb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:32.722542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0] Write session: try to update token
2025-10-01T14:13:32.722556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:32.732470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:32.732497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:32.732501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:32.732503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:32.732514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256276176980296:10646]
2025-10-01T14:13:32.732521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256276176980296:10646]
2025-10-01T14:13:32.732527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256276176980296:10646]
2025-10-01T14:13:32.732583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:32.732592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:32.732601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:32.732601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.732614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:32.732616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:32.732876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:32.736757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2004 sessionId: src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:32.739136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:32.781618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256278553880264:10880]
2025-10-01T14:13:32.781925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2003, pipe: [1:7556256278553880264:10880]
2025-10-01T14:13:32.869670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:32.870226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.870241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.870280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880264:10880], now have 1 active actors on pipe
2025-10-01T14:13:32.870498Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:32.870623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256278553880264:10880]
2025-10-01T14:13:32.870632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:32.870663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:32.870736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2004 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0
2025-10-01T14:13:32.870894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2004 sessionId: src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0 is DEAD
2025-10-01T14:13:32.871051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:32.871058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0] Write session will restart in 0.007846s
2025-10-01T14:13:32.871077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0] Write session: Do CDS request
2025-10-01T14:13:32.871081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:32.879415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:32.879901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.880026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:32.880043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2005
2025-10-01T14:13:32.880198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:32.880225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:32.880229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:32.880234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:32.880575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2005 sessionId:  describe result for acl check
2025-10-01T14:13:32.880615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:32.880617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:32.880620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:32.880624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256278553880317:10898] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:32.881068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256278553880317:10898] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:32.881889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:32.882081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:32.882090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:32.882102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:32.882150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:32.882190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256276176980414:10658]
2025-10-01T14:13:32.882775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:32.882827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256278553880317:10898] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:32.883010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:32.883052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:32.883285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:32.883320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.883325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.883326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.883326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.883329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.883330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.883330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.883330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.883331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.883331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.883332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.883332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.883333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.883333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.883336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.883342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.883344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.883346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.883349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.883351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.883353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.883355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.883356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.883359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.883361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.883363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.883365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.883367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.883371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.883376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:32.883380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.883383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:32.883385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.883388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:32.883392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.883397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:32.883400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.883403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:32.883406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.883411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:32.883415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.883419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:32.883423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.883428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:32.883433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.883437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:32.883439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.883442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.883444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.883447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.883449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.883452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.883454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.883457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:32.883460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.883462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:32.883484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:32.887172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256278553880317:10898] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:32.887190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256278553880317:10898] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:32.887193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256278553880317:10898] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:32.887202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:32.887396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:32.888060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:32.888073Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:32.888075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:32.888079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:32.888085Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2004 [2:7556256276176980414:10658]
2025-10-01T14:13:32.888100Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:32.888115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:32.888118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.888121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.888126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.888140Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:32.888146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:32.888152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:32.888207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.888214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.888216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.888219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:32.888222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:32.888285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:32.888292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.888303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:32.888315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:32.888336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:32.888356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880266:2446], now have 1 active actors on pipe
2025-10-01T14:13:32.888363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880356:10898], now have 1 active actors on pipe
2025-10-01T14:13:32.888371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256276176980409:10658]
2025-10-01T14:13:32.888376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256276176980409:10658]
2025-10-01T14:13:32.888378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256276176980409:10658]
2025-10-01T14:13:32.888392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:32.888393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2004
2025-10-01T14:13:32.888408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:32.888410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:32.888414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:32.888416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:32.888421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:32.888424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:32.888414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2004
2025-10-01T14:13:32.888546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256276176980409:10658]
2025-10-01T14:13:32.888559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:32.888569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:32.888584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.888587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.888644Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:32.888656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:32.888664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:32.888666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:32.888674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:32.888686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:32.888705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.888873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.888880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.888893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:32.888965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2005 partition: 0 MaxSeqNo: 45 sessionId: src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0
2025-10-01T14:13:32.889305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c49bcf2-a966543a-7ed45aec-bc887466_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:32.891659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0] Write session: try to update token
2025-10-01T14:13:32.891684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:32.904078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2005 sessionId: src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:32.906876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:32.908660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:32.908686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:32.908709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:32.908712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:32.908714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:32.908716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:32.908725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256276176980409:10658]
2025-10-01T14:13:32.908729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256276176980409:10658]
2025-10-01T14:13:32.908732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256276176980409:10658]
2025-10-01T14:13:32.908775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:32.908791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:32.908792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:32.908795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:32.908798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:32.908800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:32.908961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:32.971091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256278553880366:10880]
2025-10-01T14:13:32.971386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2004, pipe: [1:7556256278553880366:10880]
2025-10-01T14:13:33.055321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:33.055627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:33.055687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256278553880366:10880], now have 1 active actors on pipe
2025-10-01T14:13:33.056865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:33.056991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:33.056994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:33.057071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2005 reason: error at write: Disconnected sessionId: src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0
2025-10-01T14:13:33.057231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2005 sessionId: src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0 is DEAD
2025-10-01T14:13:33.057590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:33.057627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256278553880366:10880]
2025-10-01T14:13:33.058513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:33.058527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0] Write session will restart in 0.007261s
2025-10-01T14:13:33.058555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0] Write session: Do CDS request
2025-10-01T14:13:33.058566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:33.066993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.067053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:33.067068Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2006
2025-10-01T14:13:33.067675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.067713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:33.067719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:33.067723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:33.068213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2006 sessionId:  describe result for acl check
2025-10-01T14:13:33.068253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:33.068261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:33.068263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:33.068268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256282848847679:10903] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:33.068837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256282848847679:10903] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:33.074545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256282848847679:10903] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:33.077008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:33.079431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:33.079590Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:33.079602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:33.079609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:33.079645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:33.079680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256280471947800:10660]
2025-10-01T14:13:33.080147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:33.080149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256282848847679:10903] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:33.080175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256282848847679:10903] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:33.080179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256282848847679:10903] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:33.080192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:33.080743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:33.080772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:33.080985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:33.081026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.081032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.081035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.081036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.081037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.081038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.081039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.081040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.081040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.081041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.081042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.081042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.081043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.081044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.081047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.081053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.081055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.081057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.081059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.081061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.081064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.081066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.081068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.081071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.081074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.081076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.081078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.081080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.081086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.081091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.081094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.081097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.081100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.081104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.081106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.081109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.081112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.081115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.081117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.081120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.081123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.081126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.081129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.081133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.081135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.081139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.081141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.081144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.081148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.081151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.081153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.081156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.081159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.081162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.081165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.081168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.081192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:33.087991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:33.088743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:33.088760Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:33.088764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:33.088768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:33.088774Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2005 [2:7556256280471947800:10660]
2025-10-01T14:13:33.088791Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:33.088810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:33.088818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.088825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.088828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.089807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2005
2025-10-01T14:13:33.089854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2005
2025-10-01T14:13:33.088846Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:33.088861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:33.088867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:33.088945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.088947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.088949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.088952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:33.088955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:33.089024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:33.089026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.089034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.089039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.089049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:33.089060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256280471947795:10660]
2025-10-01T14:13:33.089062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256280471947795:10660]
2025-10-01T14:13:33.089063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256280471947795:10660]
2025-10-01T14:13:33.089070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:33.089080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:33.089089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:33.089091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:33.089106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:33.089109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:33.089112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:33.089122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256280471947795:10660]
2025-10-01T14:13:33.089127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:33.089129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:33.089143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848847664:2446], now have 1 active actors on pipe
2025-10-01T14:13:33.089145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848847751:10903], now have 1 active actors on pipe
2025-10-01T14:13:33.092910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.092929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.092971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:33.092984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.092994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.092997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:33.093021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.093040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:33.093069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.095579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2006 partition: 0 MaxSeqNo: 45 sessionId: src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0
2025-10-01T14:13:33.095300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.095321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.095355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.096415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d16d4168-a68a4b10-7b3fc53-f7ee1884_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:33.098984Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0] Write session: try to update token
2025-10-01T14:13:33.099004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:33.116815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:33.116835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:33.116838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:33.116840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:33.116850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256280471947795:10660]
2025-10-01T14:13:33.116857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256280471947795:10660]
2025-10-01T14:13:33.116862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256280471947795:10660]
2025-10-01T14:13:33.116930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:33.116937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.116940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:33.117123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:33.120085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:33.120096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:33.120100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:33.118431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2006 sessionId: src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:33.121403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:33.157947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256282848847762:10880]
2025-10-01T14:13:33.158226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2005, pipe: [1:7556256282848847762:10880]
2025-10-01T14:13:33.267854Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:33.268346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.268370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.268410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848847762:10880], now have 1 active actors on pipe
2025-10-01T14:13:33.268780Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:33.269304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:33.269318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0] Write session will restart in 0.006317s
2025-10-01T14:13:33.269344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0] Write session: Do CDS request
2025-10-01T14:13:33.269350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:33.268781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:33.268855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:33.268858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:33.268940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2006 reason: error at write: Disconnected sessionId: src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0
2025-10-01T14:13:33.269139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2006 sessionId: src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0 is DEAD
2025-10-01T14:13:33.269176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256282848847762:10880]
2025-10-01T14:13:33.276955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.277395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:33.277416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2007
2025-10-01T14:13:33.277984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.278030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:33.278036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:33.278043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:33.278590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2007 sessionId:  describe result for acl check
2025-10-01T14:13:33.278627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:33.278629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:33.278630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:33.278636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256282848847800:10907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:33.279277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256282848847800:10907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:33.280857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:33.281560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:33.281743Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:33.281751Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:33.281760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:33.281802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:33.281849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256280471947904:10664]
2025-10-01T14:13:33.282514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:33.283645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:33.283694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:33.284031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:33.284082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.284089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.284091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.284092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.284093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.284094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.284095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.284096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.284097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.284098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.284099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.284100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.284101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.284102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.284107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.284117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.284120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.284124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.284127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.284131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.284135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.284138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.284141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.284145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.284148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.284152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.284155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.284160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.284166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.284173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.284179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.284184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.284188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.284192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.284196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.284201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.284205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.284210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.284214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.284218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.284222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.284227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.284231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.284237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.284242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.284246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.284251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.284256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.284260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.284265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.284269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.284274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.284278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.284282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.284286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.284291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.284329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:33.281422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256282848847800:10907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:33.284461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256282848847800:10907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:33.284468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256282848847800:10907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:33.284472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256282848847800:10907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:33.284480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:33.288737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:33.289491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:33.289520Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:33.289545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:33.289552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:33.289562Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2006 [2:7556256280471947904:10664]
2025-10-01T14:13:33.289585Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:33.289609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:33.289623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.289628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.289631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.289651Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:33.289665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:33.289680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:33.289778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.289788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.289790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.289794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:33.289797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:33.289878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:33.289886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.289898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.289913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.289933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:33.289956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848847853:10907], now have 1 active actors on pipe
2025-10-01T14:13:33.289964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848847764:2446], now have 1 active actors on pipe
2025-10-01T14:13:33.289971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256280471947898:10664]
2025-10-01T14:13:33.289973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256280471947898:10664]
2025-10-01T14:13:33.289977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256280471947898:10664]
2025-10-01T14:13:33.289991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:33.290011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:33.290027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:33.290030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:33.290033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:33.290037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:33.290039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:33.290067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256280471947898:10664]
2025-10-01T14:13:33.290078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:33.290093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:33.290081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2006
2025-10-01T14:13:33.290125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2006
2025-10-01T14:13:33.290266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.290276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.290304Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5697e851-544c9a17-189c1d8f-17993e1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:33.290316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.290324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.290325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:33.290335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.290349Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:33.290365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.290686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2007 partition: 0 MaxSeqNo: 45 sessionId: src_id|5697e851-544c9a17-189c1d8f-17993e1e_0
2025-10-01T14:13:33.291071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d4c7ae3-a856f942-732cc17d-b96b93a3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5697e851-544c9a17-189c1d8f-17993e1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:33.290576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.290583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.290596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.293605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5697e851-544c9a17-189c1d8f-17993e1e_0] Write session: try to update token
2025-10-01T14:13:33.293624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5697e851-544c9a17-189c1d8f-17993e1e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:33.304090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:33.304110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:33.304120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256280471947898:10664]
2025-10-01T14:13:33.304173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:33.304181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:33.304375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:33.304536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:33.304713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:33.304875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:33.305118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:33.305154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:33.307585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2007 sessionId: src_id|5697e851-544c9a17-189c1d8f-17993e1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:33.310742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:33.311334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:33.310996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.311021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.311064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:33.323651Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:33.323671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:33.323675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:33.323677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:33.323689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256280471947898:10664]
2025-10-01T14:13:33.323694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256280471947898:10664]
2025-10-01T14:13:33.323699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256280471947898:10664]
2025-10-01T14:13:33.323755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:33.323763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.323766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:33.323772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:33.323779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:33.323784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:33.323925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:33.369428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256282848847863:10880]
2025-10-01T14:13:33.369761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2006, pipe: [1:7556256282848847863:10880]
2025-10-01T14:13:33.459213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:33.466671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.466692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.466837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.466892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.466951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.467023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.467552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.467563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.467633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.467692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.467750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.467810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.467852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.467858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.467918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.467971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.468032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.468099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.468345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.468354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.468411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.468472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.468528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.468584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.468633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.468639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.468696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.468750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.468808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.468864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.468903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.468908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.468966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.469022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.469081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.469146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.469191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.469197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.469259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.469310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.469372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.469428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.469468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.469474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.469541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.469600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.469660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.469717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.469760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.469767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.469827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.469883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.469947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.470007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.470052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.470057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.470120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.470178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.470247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.470305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.470345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.470350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.470432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848847863:10880], now have 1 active actors on pipe
2025-10-01T14:13:33.470824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:33.471296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5697e851-544c9a17-189c1d8f-17993e1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:33.471311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5697e851-544c9a17-189c1d8f-17993e1e_0] Write session will restart in 0.006431s
2025-10-01T14:13:33.471336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5697e851-544c9a17-189c1d8f-17993e1e_0] Write session: Do CDS request
2025-10-01T14:13:33.471341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5697e851-544c9a17-189c1d8f-17993e1e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:33.470767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256282848847863:10880]
2025-10-01T14:13:33.470801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:33.470819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:33.470824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:33.470860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2007 reason: error at write: Disconnected sessionId: src_id|5697e851-544c9a17-189c1d8f-17993e1e_0
2025-10-01T14:13:33.471051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2007 sessionId: src_id|5697e851-544c9a17-189c1d8f-17993e1e_0 is DEAD
2025-10-01T14:13:33.478854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5697e851-544c9a17-189c1d8f-17993e1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.478971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:33.478998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2008
2025-10-01T14:13:33.479264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.479291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:33.479295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:33.479298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:33.479716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2008 sessionId:  describe result for acl check
2025-10-01T14:13:33.479761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:33.479763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:33.479765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:33.479770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256282848847935:10918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:33.480275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256282848847935:10918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:33.481928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:33.482671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256282848847935:10918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:33.484200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:33.484409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:33.484419Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:33.484429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:33.484475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:33.484522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256280471948002:10668]
2025-10-01T14:13:33.485217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256282848847935:10918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:33.485232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256282848847935:10918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:33.485235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256282848847935:10918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:33.485252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:33.485272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:33.485547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:33.485593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:33.485949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:33.486009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.486017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.486018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.486020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.486021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.486023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.486024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.486025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.486027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.486029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.486030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.486032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.486033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.486034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.486040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.486050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.486057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.486062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.486066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.486069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.486073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.486077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.486081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.486085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.486089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.486093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.486096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.486100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.486107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.486115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.486122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.486128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.486133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.486139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.486143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.486148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.486153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.486158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.486162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.486167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.486172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.486177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.486183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.486189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.486194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.486200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.486204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.486211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.486216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.486222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.486226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.486232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.486243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.486249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.486253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.486258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.486309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:33.490115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:33.490923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:33.490939Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:33.490942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:33.490947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:33.490955Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2007 [2:7556256280471948002:10668]
2025-10-01T14:13:33.490972Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:33.490995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:33.491000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.491012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.491016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.491031Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:33.491041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:33.491048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:33.491113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.491123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.491125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.491127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:33.491130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:33.491203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:33.491218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.491229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.491238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.491252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:33.491268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256280471947996:10668]
2025-10-01T14:13:33.491270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256280471947996:10668]
2025-10-01T14:13:33.491273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256280471947996:10668]
2025-10-01T14:13:33.491285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:33.491301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:33.491323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:33.491326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:33.491328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:33.491332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:33.491335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:33.491363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256280471947996:10668]
2025-10-01T14:13:33.491372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:33.491410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:33.491516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848847894:2446], now have 1 active actors on pipe
2025-10-01T14:13:33.491526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848847981:10918], now have 1 active actors on pipe
2025-10-01T14:13:33.491594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.491604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.491631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:33.491644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.491647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.491649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:33.491661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.491537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2007
2025-10-01T14:13:33.491676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:33.491537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2007
2025-10-01T14:13:33.491694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.491879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.491889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.491903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.491992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2008 partition: 0 MaxSeqNo: 45 sessionId: src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0
2025-10-01T14:13:33.492321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5697e851-544c9a17-189c1d8f-17993e1e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:33.494768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0] Write session: try to update token
2025-10-01T14:13:33.494785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:33.504173Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:33.504195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:33.504206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256280471947996:10668]
2025-10-01T14:13:33.504255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:33.504270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:33.504465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:33.504663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:33.504851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:33.505020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:33.505456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:33.505509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:33.508556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2008 sessionId: src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:33.511164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:33.511394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.511420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.511463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:33.511579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:33.527005Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:33.527025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:33.527027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:33.527029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:33.527044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256280471947996:10668]
2025-10-01T14:13:33.527050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256280471947996:10668]
2025-10-01T14:13:33.527053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256280471947996:10668]
2025-10-01T14:13:33.527094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:33.527103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.527105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:33.527117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:33.527132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:33.527136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:33.527241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:33.571149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256282848848007:10880]
2025-10-01T14:13:33.571455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2007, pipe: [1:7556256282848848007:10880]
2025-10-01T14:13:33.680368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:33.689273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.689306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.689517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.689625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.689710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.689782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.689833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.689844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.689921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.689989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.690061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.690135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.690185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.690193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.690259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.690320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.690412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.690491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.690541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.690548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.690616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.690686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.690750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.690817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.690862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.690872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.690935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.691004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.691069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.691137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.691197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.691206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.691282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.691346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.691413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.691483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.691535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.691546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.691611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.691669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.691732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.691793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.691841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.691849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.691914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.691974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.692044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.692109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.692155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.692167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.692240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.692303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.692366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.692433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.692486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.692494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.692559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:33.692640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:33.692712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:33.692821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:33.692892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:33.692903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:33.692986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848848007:10880], now have 1 active actors on pipe
2025-10-01T14:13:33.694237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:33.695089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:33.695149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2008 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0
2025-10-01T14:13:33.695312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2008 sessionId: src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0 is DEAD
2025-10-01T14:13:33.695599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:33.695608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0] Write session will restart in 0.008242s
2025-10-01T14:13:33.695635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0] Write session: Do CDS request
2025-10-01T14:13:33.695642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:33.695552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:33.695598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256282848848007:10880]
2025-10-01T14:13:33.705075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.706511Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:33.706532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2009
2025-10-01T14:13:33.708487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.708550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:33.708556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:33.708560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:33.709523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2009 sessionId:  describe result for acl check
2025-10-01T14:13:33.709570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:33.709572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:33.709574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:33.709580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256282848848026:10924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:33.710254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256282848848026:10924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:33.713548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256282848848026:10924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:33.716830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:33.719749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:33.720008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:33.720020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:33.720031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:33.720081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:33.720129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256280471948099:10671]
2025-10-01T14:13:33.720833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:33.721151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:33.721190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:33.721503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:33.721552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.721553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.721554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.721556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.721557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.721559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.721560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.721561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.721563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.721564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.721565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.721567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.721568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.721569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.721573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.721583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.721587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.721591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.721595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.721598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.721602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.721605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.721609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.721613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.721617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.721620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.721623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.721630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.721636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.721643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.721650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.721669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.721673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.721678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.721682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.721687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.721691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.721696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.721700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.721704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.721709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.721714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.721718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.721723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.721728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.721733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.721737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.721742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.721747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.721752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.721756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.721761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.721766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.721771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.721774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.721780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.721817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:33.716589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256282848848026:10924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:33.716617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256282848848026:10924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:33.716620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256282848848026:10924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:33.716635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:33.725951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:33.726783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:33.726799Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:33.726802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:33.726806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:33.726813Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2008 [2:7556256280471948099:10671]
2025-10-01T14:13:33.726829Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:33.726847Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:33.726851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.726854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.726857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.726874Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:33.726886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:33.726892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:33.726959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.726968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.726970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.726973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:33.726977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:33.727056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:33.727064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.727078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.727095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.727115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:33.727137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848848097:10924], now have 1 active actors on pipe
2025-10-01T14:13:33.727145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848848011:2446], now have 1 active actors on pipe
2025-10-01T14:13:33.727153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256280471948092:10671]
2025-10-01T14:13:33.727155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256280471948092:10671]
2025-10-01T14:13:33.727157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256280471948092:10671]
2025-10-01T14:13:33.727174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:33.727190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:33.727199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:33.727203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:33.727206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:33.727209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:33.727212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:33.727245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256280471948092:10671]
2025-10-01T14:13:33.727256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:33.727265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:33.727217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2008
2025-10-01T14:13:33.727268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2008
2025-10-01T14:13:33.727433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.727447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.727473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:33.727484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.727488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.727490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:33.727500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.727514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:33.727530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.727784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.727794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.727812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.727907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2009 partition: 0 MaxSeqNo: 45 sessionId: src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0
2025-10-01T14:13:33.728322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4761f59-240bd93f-f3ac98b0-79fbf9c3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:33.731005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0] Write session: try to update token
2025-10-01T14:13:33.731023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:33.750999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2009 sessionId: src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:33.752474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:33.752495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:33.752497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:33.752500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:33.752513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256280471948092:10671]
2025-10-01T14:13:33.752516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256280471948092:10671]
2025-10-01T14:13:33.752522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256280471948092:10671]
2025-10-01T14:13:33.752570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:33.752577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.752583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:33.752737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:33.753333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:33.753356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:33.753361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:33.753547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:33.797295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256282848848110:10880]
2025-10-01T14:13:33.797891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2008, pipe: [1:7556256282848848110:10880]
2025-10-01T14:13:33.912193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:33.912684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.912702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.912746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848848110:10880], now have 1 active actors on pipe
2025-10-01T14:13:33.913010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:33.913854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:33.913867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0] Write session will restart in 0.005809s
2025-10-01T14:13:33.913895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0] Write session: Do CDS request
2025-10-01T14:13:33.913902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:33.913094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256282848848110:10880]
2025-10-01T14:13:33.913144Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:33.913146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:33.913194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2009 reason: error at write: Disconnected sessionId: src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0
2025-10-01T14:13:33.913378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2009 sessionId: src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0 is DEAD
2025-10-01T14:13:33.913495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:33.920983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.922602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:33.922624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2010
2025-10-01T14:13:33.924871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:33.924930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:33.924937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:33.924943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:33.925710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2010 sessionId:  describe result for acl check
2025-10-01T14:13:33.925750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:33.925752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:33.925755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:33.925760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256282848848123:10929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:33.926359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256282848848123:10929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:33.959511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256282848848123:10929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:33.967411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256282848848123:10929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:33.967437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256282848848123:10929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:33.967446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256282848848123:10929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:33.967456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:33.969934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:33.973366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:33.973712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:33.973723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:33.973736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:33.973816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:33.973857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256280471948221:10683]
2025-10-01T14:13:33.974510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:33.974870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:33.974920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:33.975247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:33.975322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.975329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.975331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.975332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.975333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.975334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.975335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.975336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.975337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.975338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.975339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.975341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.975342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.975344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.975350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.975360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.975364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.975367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.975370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.975374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.975378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.975382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.975385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.975390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.975394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.975397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.975401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.975405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.975413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.975420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:33.975426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.975431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:33.975435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.975441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:33.975445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.975450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:33.975455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.975460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:33.975465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.975470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:33.975475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.975481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:33.975485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.975490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:33.975495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.975500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:33.975505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.975510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.975521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.975527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.975537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.975542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.975552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.975557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:33.975562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.975567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:33.975605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:33.980243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:33.981553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:33.981560Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:33.981563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:33.981568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:33.981576Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2009 [2:7556256280471948221:10683]
2025-10-01T14:13:33.981595Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:33.981615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:33.981620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.981624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.981627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.981646Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:33.981652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:33.981659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:33.981739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.981741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.981744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.981747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:33.981750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:33.981825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:33.981828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:33.981842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:33.981851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:33.981865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:33.981884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256280471948216:10683]
2025-10-01T14:13:33.981886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256280471948216:10683]
2025-10-01T14:13:33.981889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256280471948216:10683]
2025-10-01T14:13:33.981911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:33.981926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:33.981940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:33.981943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:33.981978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:33.981988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256280471948216:10683]
2025-10-01T14:13:33.981991Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:33.981982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:33.981997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:33.982004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:33.982304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848848115:2446], now have 1 active actors on pipe
2025-10-01T14:13:33.982317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256282848848204:10929], now have 1 active actors on pipe
2025-10-01T14:13:33.982356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2009
2025-10-01T14:13:33.982499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.982507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.982534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:33.982543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:33.982547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:33.982550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:33.982561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:33.982573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:33.982587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.983248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:33.983261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:33.983280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:33.983834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|372b8ec1-6a61e396-3a22e257-3f4f88e2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:33.982432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2009
2025-10-01T14:13:33.983382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2010 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0
2025-10-01T14:13:33.986540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0] Write session: try to update token
2025-10-01T14:13:33.986561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:34.004648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2010 sessionId: src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:34.008449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:34.008476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:34.008479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:34.008482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:34.008493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256280471948216:10683]
2025-10-01T14:13:34.008498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256280471948216:10683]
2025-10-01T14:13:34.008504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256280471948216:10683]
2025-10-01T14:13:34.008551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:34.008561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.008564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:34.008763Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:34.007738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:34.010561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:34.010577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:34.010582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:34.015272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256287143815513:10880]
2025-10-01T14:13:34.020453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2009, pipe: [1:7556256287143815513:10880]
2025-10-01T14:13:34.149094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:34.149782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.149793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.149810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815513:10880], now have 1 active actors on pipe
2025-10-01T14:13:34.150226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256287143815513:10880]
2025-10-01T14:13:34.150292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:34.150148Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:34.150366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:34.150398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:34.150489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2010 reason: error at write: Disconnected sessionId: src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0
2025-10-01T14:13:34.150782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2010 sessionId: src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0 is DEAD
2025-10-01T14:13:34.154603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:34.154619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0] Write session will restart in 0.009053s
2025-10-01T14:13:34.154649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0] Write session: Do CDS request
2025-10-01T14:13:34.154656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:34.162615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:34.165024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:34.165166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:34.165187Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2011
2025-10-01T14:13:34.164781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:34.165059Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:34.165063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:34.165074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:34.165138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:34.165184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256284766915612:10686]
2025-10-01T14:13:34.166079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:34.166514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:34.166586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:34.166954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:34.167035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.167042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.167043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.167044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.167046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.167047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.167048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.167050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.167052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.167053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.167054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.167056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.167058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.167059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.167066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.167061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:34.167123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:34.167075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.167129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:34.167080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.167135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:34.167083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.167087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.167091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.167095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.167099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.167102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.167106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.167113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.167116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.167120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.167123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.167130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.167138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.167143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.167148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.167153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.167158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.167161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.167167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.167173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.167178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.167183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.167187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.167192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.167197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.167203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.167207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.167213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.167218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.167226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.167231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.167236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.167242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.167247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.167251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.167256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.167261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.167265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.167271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.167311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:34.167630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2011 sessionId:  describe result for acl check
2025-10-01T14:13:34.167669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:34.167678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:34.167681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:34.167687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256287143815576:10933] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:34.168276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256287143815576:10933] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:34.170543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256287143815576:10933] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:34.171848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:34.172623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:34.172643Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:34.172646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:34.172651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:34.172660Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2010 [2:7556256284766915612:10686]
2025-10-01T14:13:34.172679Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:34.172700Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:34.172704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:34.172708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:34.172710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:34.172728Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:34.172734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:34.172741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:34.172813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.172823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.172825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.172829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:34.172832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:34.173065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2010
2025-10-01T14:13:34.172909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:34.172922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.172935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.172946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.172967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:34.172985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256284766915607:10686]
2025-10-01T14:13:34.172988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256284766915607:10686]
2025-10-01T14:13:34.172997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256284766915607:10686]
2025-10-01T14:13:34.173012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:34.173027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815516:2446], now have 1 active actors on pipe
2025-10-01T14:13:34.173031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:34.173034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:34.173036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:34.173037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:34.173051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:34.173055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:34.173094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256284766915607:10686]
2025-10-01T14:13:34.173097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:34.173099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:34.173927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256287143815576:10933] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:34.173942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256287143815576:10933] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:34.173947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256287143815576:10933] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:34.173955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:34.174405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815615:10933], now have 1 active actors on pipe
2025-10-01T14:13:34.174467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2010
2025-10-01T14:13:34.174582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.174595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.174624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bde9a304-e067e835-fc136230-8bc3a91a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:34.174633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:34.174641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:34.174644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:34.174658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:34.174673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:34.174688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:34.174977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.174987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.175005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:34.175113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2011 partition: 0 MaxSeqNo: 45 sessionId: src_id|bde9a304-e067e835-fc136230-8bc3a91a_0
2025-10-01T14:13:34.175515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e3bc91-85906d4f-c6da4f12-a711a336_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bde9a304-e067e835-fc136230-8bc3a91a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:34.178185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde9a304-e067e835-fc136230-8bc3a91a_0] Write session: try to update token
2025-10-01T14:13:34.178210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde9a304-e067e835-fc136230-8bc3a91a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:34.196915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2011 sessionId: src_id|bde9a304-e067e835-fc136230-8bc3a91a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:34.199957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:34.199188Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:34.199213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:34.199216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:34.199218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:34.199230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256284766915607:10686]
2025-10-01T14:13:34.199240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256284766915607:10686]
2025-10-01T14:13:34.199247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256284766915607:10686]
2025-10-01T14:13:34.199303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:34.199310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.199313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:34.199322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:34.199331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:34.199337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:34.199458Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:34.250604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256287143815618:10880]
2025-10-01T14:13:34.257748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2010, pipe: [1:7556256287143815618:10880]
2025-10-01T14:13:34.365900Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:34.366269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.366284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.366329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815618:10880], now have 1 active actors on pipe
2025-10-01T14:13:34.366858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:34.367460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256287143815618:10880]
2025-10-01T14:13:34.367500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:34.367543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:34.367623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2011 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bde9a304-e067e835-fc136230-8bc3a91a_0
2025-10-01T14:13:34.367871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2011 sessionId: src_id|bde9a304-e067e835-fc136230-8bc3a91a_0 is DEAD
2025-10-01T14:13:34.368203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde9a304-e067e835-fc136230-8bc3a91a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:34.368215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde9a304-e067e835-fc136230-8bc3a91a_0] Write session will restart in 0.009782s
2025-10-01T14:13:34.368244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde9a304-e067e835-fc136230-8bc3a91a_0] Write session: Do CDS request
2025-10-01T14:13:34.368250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde9a304-e067e835-fc136230-8bc3a91a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:34.379226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bde9a304-e067e835-fc136230-8bc3a91a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:34.379800Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:34.379827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2012
2025-10-01T14:13:34.380167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:34.380204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:34.380210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:34.380216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:34.382991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2012 sessionId:  describe result for acl check
2025-10-01T14:13:34.383037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:34.383039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:34.383041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:34.383046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256287143815631:10937] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:34.383659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256287143815631:10937] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:34.397261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256287143815631:10937] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:34.404542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:34.404762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256287143815631:10937] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:34.404784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256287143815631:10937] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:34.404788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256287143815631:10937] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:34.404797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:34.408459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:34.408739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:34.408743Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:34.408755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:34.408806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:34.408850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256284766915722:10689]
2025-10-01T14:13:34.409521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:34.409878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:34.409930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:34.410205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:34.410263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.410264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.410265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.410266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.410268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.410269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.410270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.410271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.410272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.410273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.410274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.410275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.410276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.410277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.410280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.410288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.410291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.410298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.410301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.410303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.410305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.410308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.410310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.410313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.410315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.410317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.410319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.410321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.410329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.410334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.410337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.410341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.410344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.410347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.410350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.410353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.410357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.410360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.410363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.410367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.410385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.410388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.410391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.410395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.410398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.410401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.410406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.410411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.410419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.410423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.410428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.410433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.410438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.410444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.410450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.410456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.410483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:34.416677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:34.417463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:34.417480Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:34.417484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:34.417490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:34.417498Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2011 [2:7556256284766915722:10689]
2025-10-01T14:13:34.417521Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:34.417545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:34.417549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:34.417552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:34.417555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:34.417575Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:34.417581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:34.417588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:34.418656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2011
2025-10-01T14:13:34.418703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2011
2025-10-01T14:13:34.417670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.417677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.417680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.417683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:34.417685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:34.417764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:34.417768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.417782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.417794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.417810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:34.417827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256284766915715:10689]
2025-10-01T14:13:34.417830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256284766915715:10689]
2025-10-01T14:13:34.417832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256284766915715:10689]
2025-10-01T14:13:34.417845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:34.417860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:34.417875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:34.417878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:34.417920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:34.417922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256284766915715:10689]
2025-10-01T14:13:34.417924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:34.417925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:34.417927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:34.417934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:34.418167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815621:2446], now have 1 active actors on pipe
2025-10-01T14:13:34.418171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815711:10937], now have 1 active actors on pipe
2025-10-01T14:13:34.419254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.419270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.419299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:34.419310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:34.419314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:34.419317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:34.419330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:34.419346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:34.419361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:34.420550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.420577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.420618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:34.420765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2012 partition: 0 MaxSeqNo: 45 sessionId: src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0
2025-10-01T14:13:34.421180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bde9a304-e067e835-fc136230-8bc3a91a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:34.424547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0] Write session: try to update token
2025-10-01T14:13:34.424570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:34.433548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:34.433574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:34.433587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256284766915715:10689]
2025-10-01T14:13:34.433653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:34.433930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:34.434131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:34.434331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:34.434546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:34.434858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:34.434914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:34.435097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:34.458402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2012 sessionId: src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:34.461848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:34.462606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.462633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.462673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:34.462794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:34.469646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256287143815733:10880]
2025-10-01T14:13:34.471608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2011, pipe: [1:7556256287143815733:10880]
2025-10-01T14:13:34.471587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815733:10880], now have 1 active actors on pipe
2025-10-01T14:13:34.474772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:34.474792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:34.474795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:34.474797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:34.474812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256284766915715:10689]
2025-10-01T14:13:34.474816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256284766915715:10689]
2025-10-01T14:13:34.474822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256284766915715:10689]
2025-10-01T14:13:34.474886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:34.474894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.474897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:34.474897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:34.474905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:34.474909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:34.475077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:34.632112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:34.645760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.645810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.646069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.646171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.646280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.646446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.647399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.647422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.647529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.647613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.647704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.647802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.647869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.647873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.647979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.648063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.648165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.648254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.648321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.648325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.648427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.648522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.648632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.648715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.648778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.648781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.648880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.648964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.649055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.649147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.649210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.649214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.649308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.649391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.649480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.649572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.649635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.649638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.649735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.649813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.649895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.649983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.650038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.650042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.650129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.650209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.650288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.650514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.650588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.650603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.650699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.650785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.650881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.650974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.651049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.651059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.651156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:34.651248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:34.651337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:34.651420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:34.651488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:34.651492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:34.651981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256287143815733:10880]
2025-10-01T14:13:34.652033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:34.652036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:34.652070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2012 reason: error at write: Disconnected sessionId: src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0
2025-10-01T14:13:34.652303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2012 sessionId: src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0 is DEAD
2025-10-01T14:13:34.652485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:34.652498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0] Write session will restart in 0.009508s
2025-10-01T14:13:34.652527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0] Write session: Do CDS request
2025-10-01T14:13:34.652534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:34.652581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:34.652720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:34.663944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:34.664578Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:34.664598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2013
2025-10-01T14:13:34.664793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:34.664844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:34.664850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:34.664856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:34.665375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2013 sessionId:  describe result for acl check
2025-10-01T14:13:34.665423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:34.665432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:34.665434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:34.665440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256287143815786:10950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:34.666042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256287143815786:10950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:34.669334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256287143815786:10950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:34.671676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:34.674082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:34.674333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:34.674337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:34.674349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:34.674433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:34.674489Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256284766915826:10693]
2025-10-01T14:13:34.675142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:34.675486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:34.675537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:34.675871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:34.675920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.675921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.675922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.675923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.675924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.675925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.675927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.675928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.675929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.675930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.675931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.675932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.675934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.675935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.675940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.675950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.675953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.675957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.675961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.675965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.675968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.675972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.675975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.675980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.675983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.675987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.675990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.675993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.676000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.676008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.676014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.676020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.676024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.676030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.676034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.676039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.676044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.676049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.676052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.676093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.676103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.676114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.676124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.676139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.676149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.676160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.676182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.676190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.676196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.676201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.676205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.676210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.676215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.676219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.676223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.676228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.676271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:34.678976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256287143815786:10950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:34.679006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256287143815786:10950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:34.679010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256287143815786:10950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:34.679019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:34.682289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:34.683752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2012
2025-10-01T14:13:34.683801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2012
2025-10-01T14:13:34.684854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2013 partition: 0 MaxSeqNo: 45 sessionId: src_id|7666f63e-4111469c-4e227350-f131e2ab_0
2025-10-01T14:13:34.685337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58e5b1ec-1d4269ea-55d10e4a-f620d7ed_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7666f63e-4111469c-4e227350-f131e2ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:34.682991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:34.683009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:34.683012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:34.683016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:34.683024Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2012 [2:7556256284766915826:10693]
2025-10-01T14:13:34.683043Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:34.683062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:34.683066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:34.683070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:34.683073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:34.683090Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:34.683096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:34.683104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:34.683166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.683168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.683169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.683172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:34.683175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:34.683249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:34.683252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.683263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.683274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.683289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:34.683305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256284766915821:10693]
2025-10-01T14:13:34.683308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256284766915821:10693]
2025-10-01T14:13:34.683310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256284766915821:10693]
2025-10-01T14:13:34.683328Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:34.683342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:34.683355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:34.683358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:34.683377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:34.683381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:34.683383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:34.683400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256284766915821:10693]
2025-10-01T14:13:34.683403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:34.683473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:34.683601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815869:10950], now have 1 active actors on pipe
2025-10-01T14:13:34.683605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815772:2446], now have 1 active actors on pipe
2025-10-01T14:13:34.684013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.684018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.684043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7666f63e-4111469c-4e227350-f131e2ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:34.684051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:34.684057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:34.684061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:34.684072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:34.684082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:34.684097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:34.684285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.684287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.684307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:34.688539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7666f63e-4111469c-4e227350-f131e2ab_0] Write session: try to update token
2025-10-01T14:13:34.688560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7666f63e-4111469c-4e227350-f131e2ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:34.707763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:34.707785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:34.707788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:34.707790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:34.707801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256284766915821:10693]
2025-10-01T14:13:34.707805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256284766915821:10693]
2025-10-01T14:13:34.707811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256284766915821:10693]
2025-10-01T14:13:34.707865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:34.707872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.707871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:34.707874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:34.707879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:34.707883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:34.708022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:34.719646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2013 sessionId: src_id|7666f63e-4111469c-4e227350-f131e2ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:34.725155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:34.754503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256287143815876:10880]
2025-10-01T14:13:34.755025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2012, pipe: [1:7556256287143815876:10880]
2025-10-01T14:13:34.876034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256287143815876:10880]
2025-10-01T14:13:34.876090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:34.876135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:34.876152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:34.876224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2013 reason: error at write: Disconnected sessionId: src_id|7666f63e-4111469c-4e227350-f131e2ab_0
2025-10-01T14:13:34.876410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2013 sessionId: src_id|7666f63e-4111469c-4e227350-f131e2ab_0 is DEAD
2025-10-01T14:13:34.876517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7666f63e-4111469c-4e227350-f131e2ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:34.876531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7666f63e-4111469c-4e227350-f131e2ab_0] Write session will restart in 0.005109s
2025-10-01T14:13:34.876558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7666f63e-4111469c-4e227350-f131e2ab_0] Write session: Do CDS request
2025-10-01T14:13:34.876565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7666f63e-4111469c-4e227350-f131e2ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:34.875283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:34.875718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.875729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.875752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815876:10880], now have 1 active actors on pipe
2025-10-01T14:13:34.876102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:34.883183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7666f63e-4111469c-4e227350-f131e2ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:34.883552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:34.883572Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2014
2025-10-01T14:13:34.883765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:34.883803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:34.883814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:34.883819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:34.884196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2014 sessionId:  describe result for acl check
2025-10-01T14:13:34.884232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:34.884234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:34.884235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:34.884240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256287143815895:10954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:34.884767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256287143815895:10954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:34.887151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256287143815895:10954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:34.888685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:34.890665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:34.891067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256287143815895:10954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:34.891099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256287143815895:10954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:34.891118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256287143815895:10954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:34.891125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:34.890884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:34.890919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:34.890932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:34.891006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:34.891039Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256284766915954:10706]
2025-10-01T14:13:34.891659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:34.891902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:34.891934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:34.892162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:34.892212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.892213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.892214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.892215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.892217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.892218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.892219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.892221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.892222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.892223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.892224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.892225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.892226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.892228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.892232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.892242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.892246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.892249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.892253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.892256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.892260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.892264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.892267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.892271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.892275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.892279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.892283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.892287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.892295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.892303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:34.892310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.892314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:34.892318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.892322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:34.892324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.892327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:34.892330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.892333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:34.892336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.892339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:34.892344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.892350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:34.892354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.892358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:34.892363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.892368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:34.892372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.892377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.892382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.892387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.892391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.892396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.892401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.892406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:34.892409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.892412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:34.892433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:34.896246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:34.896904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:34.896915Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:34.896916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:34.896919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:34.896924Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2013 [2:7556256284766915954:10706]
2025-10-01T14:13:34.896936Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:34.896954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:34.896957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:34.896959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:34.896960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:34.896973Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:34.896977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:34.896982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:34.897026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.897027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.897028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.897031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:34.897033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:34.897086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:34.897088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.897096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:34.897103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:34.897115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:34.897131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256284766915949:10706]
2025-10-01T14:13:34.897134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256284766915949:10706]
2025-10-01T14:13:34.897136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256284766915949:10706]
2025-10-01T14:13:34.897149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:34.897156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:34.897159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:34.897161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:34.897174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:34.897190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:34.897193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:34.897207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815975:10954], now have 1 active actors on pipe
2025-10-01T14:13:34.897265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2013
2025-10-01T14:13:34.897211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815882:2446], now have 1 active actors on pipe
2025-10-01T14:13:34.897265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2013
2025-10-01T14:13:34.897247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256284766915949:10706]
2025-10-01T14:13:34.897255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:34.897264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:34.897302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.897306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.897336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:34.897342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:34.897346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:34.897348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:34.897355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:34.897363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:34.897379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:34.897532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:34.897542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:34.897556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:34.897644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2014 partition: 0 MaxSeqNo: 45 sessionId: src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0
2025-10-01T14:13:34.898048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7666f63e-4111469c-4e227350-f131e2ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:34.900676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0] Write session: try to update token
2025-10-01T14:13:34.900695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:34.919143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:34.919163Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:34.919166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:34.919168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:34.919179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256284766915949:10706]
2025-10-01T14:13:34.919184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256284766915949:10706]
2025-10-01T14:13:34.919188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256284766915949:10706]
2025-10-01T14:13:34.919239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:34.919239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:34.919246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:34.919248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:34.919250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:34.919250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:34.919386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:34.920479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2014 sessionId: src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:34.924060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:34.978594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256287143815987:10880]
2025-10-01T14:13:34.982482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2013, pipe: [1:7556256287143815987:10880]
2025-10-01T14:13:35.071142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:35.071403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.071419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.071465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256287143815987:10880], now have 1 active actors on pipe
2025-10-01T14:13:35.071739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:35.071797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256287143815987:10880]
2025-10-01T14:13:35.071796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:35.071802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:35.071751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:35.072509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:35.072522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0] Write session will restart in 0.008452s
2025-10-01T14:13:35.072549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0] Write session: Do CDS request
2025-10-01T14:13:35.072556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:35.071895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2014 reason: error at write: Disconnected sessionId: src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0
2025-10-01T14:13:35.072107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2014 sessionId: src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0 is DEAD
2025-10-01T14:13:35.081954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:35.082235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:35.082288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:35.082308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2015
2025-10-01T14:13:35.082455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:35.082486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:35.082492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:35.082496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:35.083061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2015 sessionId:  describe result for acl check
2025-10-01T14:13:35.083088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:35.083090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:35.083092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:35.083099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256291438783346:10959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:35.083615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256291438783346:10959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:35.084045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:35.084267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:35.084277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:35.084287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:35.084332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:35.084375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256289061883348:10708]
2025-10-01T14:13:35.085020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:35.085331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:35.085412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:35.085382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256291438783346:10959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:35.085772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:35.085866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.085873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.085874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.085875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.085876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.085878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.085879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.085881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.085882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.085883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.085884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.085886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.085887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.085888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.085895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.085905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.085913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.085916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.085924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.085927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.085931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.085947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.085955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.085961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.085968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.085972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.085981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.085990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.085999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.086011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.086028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.086037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.086046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.086050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.086054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.086060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.086065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.086074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.086082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.086086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.086094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.086103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.086111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.086121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.086126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.086130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.086135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.086144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.086150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.086159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.086167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.086179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.086185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.086192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.086199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.086203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.086245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:35.090008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256291438783346:10959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:35.090030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256291438783346:10959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:35.090034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256291438783346:10959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:35.090043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:35.090236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:35.091189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:35.091205Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:35.091207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:35.091211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:35.091217Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2014 [2:7556256289061883348:10708]
2025-10-01T14:13:35.091239Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:35.091255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:35.091259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:35.091264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:35.091266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:35.091284Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:35.091295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:35.091302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:35.091361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.091367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.091369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.091372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:35.091374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:35.091444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:35.091450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.091462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.091476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.091495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:35.091517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783286:2446], now have 1 active actors on pipe
2025-10-01T14:13:35.091524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783385:10959], now have 1 active actors on pipe
2025-10-01T14:13:35.091532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256289061883342:10708]
2025-10-01T14:13:35.091537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256289061883342:10708]
2025-10-01T14:13:35.091539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256289061883342:10708]
2025-10-01T14:13:35.091556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:35.091573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:35.091548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2014
2025-10-01T14:13:35.091581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:35.091558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2014
2025-10-01T14:13:35.091584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:35.091587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:35.091590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:35.091592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:35.091646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.091655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.091668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256289061883342:10708]
2025-10-01T14:13:35.091678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:35.091684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:35.091708Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:35.091718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:35.091722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:35.091724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:35.091732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:35.091741Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:35.091770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:35.091952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.091965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.091984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:35.092070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2015 partition: 0 MaxSeqNo: 45 sessionId: src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0
2025-10-01T14:13:35.092454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b863ef74-43cd6d51-de6f1603-d7cf5da_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:35.095145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0] Write session: try to update token
2025-10-01T14:13:35.095164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:35.109802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2015 sessionId: src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:35.112330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:35.112776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.112805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.112833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:35.112841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:35.112844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:35.112846Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:35.112854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256289061883342:10708]
2025-10-01T14:13:35.112858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256289061883342:10708]
2025-10-01T14:13:35.112862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256289061883342:10708]
2025-10-01T14:13:35.112896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:35.112908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:35.112912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:35.112916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:35.112922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.112924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:35.113053Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:35.172146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256291438783396:10880]
2025-10-01T14:13:35.172394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2014, pipe: [1:7556256291438783396:10880]
2025-10-01T14:13:35.270908Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:35.271214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:35.271268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783396:10880], now have 1 active actors on pipe
2025-10-01T14:13:35.271353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:35.271436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256291438783396:10880]
2025-10-01T14:13:35.271458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:35.271461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:35.271466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:35.271538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2015 reason: error at write: Disconnected sessionId: src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0
2025-10-01T14:13:35.271699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2015 sessionId: src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0 is DEAD
2025-10-01T14:13:35.271819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:35.271824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0] Write session will restart in 0.005732s
2025-10-01T14:13:35.271841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0] Write session: Do CDS request
2025-10-01T14:13:35.271849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:35.278876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:35.278999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:35.279015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2016
2025-10-01T14:13:35.279143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:35.279173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:35.279184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:35.279187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:35.279547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2016 sessionId:  describe result for acl check
2025-10-01T14:13:35.279577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:35.279580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:35.279581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:35.279587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256291438783459:10963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:35.279792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:35.280045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256291438783459:10963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:35.281277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:35.281425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:35.281433Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:35.281442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:35.281480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:35.281512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256289061883461:10712]
2025-10-01T14:13:35.281855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256291438783459:10963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:35.282085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:35.282292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:35.282327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:35.282616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:35.282661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.282666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.282667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.282668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.282669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.282671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.282672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.282673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.282674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.282675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.282676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.282677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.282678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.282679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.282683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.282691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.282695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.282698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.282701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.282704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.282708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.282711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.282714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.282717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.282720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.282724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.282727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.282730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.282736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.282742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.282747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.282752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.282760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.282764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.282768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.282772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.282776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.282781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.282784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.282789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.282793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.282797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.282805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.282809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.282813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.282820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.282828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.282832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.282839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.282844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.282852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.282856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.282863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.282872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.282879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.282883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.282917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:35.286086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256291438783459:10963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:35.286100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256291438783459:10963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:35.286104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256291438783459:10963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:35.286112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:35.286224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:35.286803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:35.286817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:35.286819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:35.286822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:35.286828Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2015 [2:7556256289061883461:10712]
2025-10-01T14:13:35.286842Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:35.286857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:35.286862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:35.286869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:35.286871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:35.286886Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:35.286894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:35.286901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:35.286940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.286945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.286947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.286950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:35.286953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:35.287013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:35.287019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.287030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.287045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.287063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:35.287083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783399:2446], now have 1 active actors on pipe
2025-10-01T14:13:35.287090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783499:10963], now have 1 active actors on pipe
2025-10-01T14:13:35.287098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256289061883456:10712]
2025-10-01T14:13:35.287103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256289061883456:10712]
2025-10-01T14:13:35.287105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256289061883456:10712]
2025-10-01T14:13:35.287097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2015
2025-10-01T14:13:35.287117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:35.287129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2015
2025-10-01T14:13:35.287131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:35.287133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:35.287141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:35.287144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:35.287145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:35.287148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:35.287173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256289061883456:10712]
2025-10-01T14:13:35.287184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:35.287189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:35.287228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.287235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.287258Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:35.287267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:35.287272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:35.287274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:35.287282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:35.287293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:35.287308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:35.287444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.287456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.287475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:35.287536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2016 partition: 0 MaxSeqNo: 45 sessionId: src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0
2025-10-01T14:13:35.287838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5beb606b-681dcea5-7fc4b2cc-36a425b0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:35.290124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0] Write session: try to update token
2025-10-01T14:13:35.290138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:35.303535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2016 sessionId: src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:35.305834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:35.307530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.307556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.307575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:35.307579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:35.307583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:35.307584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:35.307593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256289061883456:10712]
2025-10-01T14:13:35.307597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256289061883456:10712]
2025-10-01T14:13:35.307601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256289061883456:10712]
2025-10-01T14:13:35.307641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:35.307653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:35.307655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:35.307657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:35.307660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.307662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:35.307789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:35.371818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256291438783507:10880]
2025-10-01T14:13:35.372085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2015, pipe: [1:7556256291438783507:10880]
2025-10-01T14:13:35.464631Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:35.464911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:35.464960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783507:10880], now have 1 active actors on pipe
2025-10-01T14:13:35.465551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:35.465085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:35.465562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0] Write session will restart in 0.005421s
2025-10-01T14:13:35.465148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256291438783507:10880]
2025-10-01T14:13:35.465168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:35.465175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:35.465178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:35.465244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2016 reason: error at write: Disconnected sessionId: src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0
2025-10-01T14:13:35.465389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2016 sessionId: src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0 is DEAD
2025-10-01T14:13:35.465598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0] Write session: Do CDS request
2025-10-01T14:13:35.465607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:35.471931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:35.471991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:35.472007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2017
2025-10-01T14:13:35.472165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:35.472193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:35.472199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:35.472203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:35.472583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2017 sessionId:  describe result for acl check
2025-10-01T14:13:35.472628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:35.472634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:35.472635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:35.472641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256291438783575:10967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:35.473147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256291438783575:10967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:35.474227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:35.475740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256291438783575:10967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:35.475907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:35.476105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:35.476114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:35.476125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:35.476179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:35.476218Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256289061883561:10714]
2025-10-01T14:13:35.476765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:35.476997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:35.477036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:35.477344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:35.477403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.477404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.477405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.477406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.477407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.477408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.477409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.477410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.477410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.477411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.477412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.477413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.477414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.477415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.477419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.477427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.477430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.477433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.477436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.477439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.477442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.477445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.477448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.477453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.477455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.477458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.477461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.477464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.477469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.477477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.477482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.477486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.477490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.477494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.477497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.477501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.477505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.477511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.477515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.477520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.477524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.477528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.477531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.477536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.477539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.477544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.477548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.477552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.477556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.477560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.477562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.477566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.477570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.477574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.477578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.477582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.477614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:35.477994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256291438783575:10967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:35.478011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256291438783575:10967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:35.478015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256291438783575:10967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:35.478024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:35.482165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:35.482762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:35.482776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:35.482779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:35.482783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:35.482790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2016 [2:7556256289061883561:10714]
2025-10-01T14:13:35.482808Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:35.482823Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:35.482831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:35.482835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:35.482837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:35.482855Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:35.482865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:35.482871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:35.482930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.482937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.482939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.482942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:35.482945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:35.483013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:35.483022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.483034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.483044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.483059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:35.483076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783616:10967], now have 1 active actors on pipe
2025-10-01T14:13:35.483079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783516:2446], now have 1 active actors on pipe
2025-10-01T14:13:35.483087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256289061883556:10714]
2025-10-01T14:13:35.483090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256289061883556:10714]
2025-10-01T14:13:35.483092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256289061883556:10714]
2025-10-01T14:13:35.483104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:35.483168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2016
2025-10-01T14:13:35.483168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2016
2025-10-01T14:13:35.483116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:35.483125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:35.483128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:35.483130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:35.483130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:35.483132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:35.483163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256289061883556:10714]
2025-10-01T14:13:35.483169Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:35.483183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:35.483344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.483353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.483376Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:35.483387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:35.483390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:35.483392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:35.483401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:35.483414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:35.483426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:35.483530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.483536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.483549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:35.483762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2017 partition: 0 MaxSeqNo: 45 sessionId: src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0
2025-10-01T14:13:35.484123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d82f4df8-6eb79ff8-2dc0d62f-7a890658_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:35.486802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0] Write session: try to update token
2025-10-01T14:13:35.486819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:35.504641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:35.504660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:35.504670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256289061883556:10714]
2025-10-01T14:13:35.504712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:35.504865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:35.504993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:35.505117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:35.505242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:35.505430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:35.505460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:35.505829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:35.521719Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2017 sessionId: src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:35.524383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:35.526139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.526162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.526201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:35.526795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:35.530528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:35.530547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:35.530550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:35.530552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:35.530562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256289061883556:10714]
2025-10-01T14:13:35.530567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256289061883556:10714]
2025-10-01T14:13:35.530575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256289061883556:10714]
2025-10-01T14:13:35.530603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:35.530607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:35.530611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:35.530618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:35.530624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.530627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:35.530764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:35.565346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256291438783655:10880]
2025-10-01T14:13:35.565718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2016, pipe: [1:7556256291438783655:10880]
2025-10-01T14:13:35.699667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:35.708448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.708477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.708667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.708740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.708804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.708866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.709196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.709203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.709279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.709342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.709399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.709463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.709523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.709525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.709593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.709650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.709727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.709790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.709838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.709841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.709905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.710276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.710338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.710416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.710456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.710459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.710526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.710584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.710642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.710706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.710751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.710753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.710819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.710879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.710938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.710998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.711036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.711038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.711105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.711165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.711225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.711286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.711327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.711329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.711395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.711451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.711509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.711569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.711609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.711612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.711674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.711734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.711795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.711854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.711895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.711897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.711961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:35.712018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:35.712074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:35.712130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:35.712174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:35.712177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:35.712259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783655:10880], now have 1 active actors on pipe
2025-10-01T14:13:35.713510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:35.714602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:35.714617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0] Write session will restart in 0.009103s
2025-10-01T14:13:35.714646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0] Write session: Do CDS request
2025-10-01T14:13:35.714651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:35.713722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:35.713776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2017 reason: status is not ok: tablet will be restarted right now sessionId: src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0
2025-10-01T14:13:35.713986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2017 sessionId: src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0 is DEAD
2025-10-01T14:13:35.714115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:35.714149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256291438783655:10880]
2025-10-01T14:13:35.730799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:35.734531Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:35.734549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2018
2025-10-01T14:13:35.734777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:35.734811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:35.734817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:35.734820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:35.735397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2018 sessionId:  describe result for acl check
2025-10-01T14:13:35.735428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:35.735429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:35.735431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:35.735436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256291438783678:10980] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:35.735935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256291438783678:10980] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:35.739110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256291438783678:10980] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:35.764146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:35.763924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256291438783678:10980] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:35.763945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256291438783678:10980] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:35.763949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256291438783678:10980] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:35.763959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:35.776575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:35.776938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:35.776949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:35.776961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:35.777017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:35.777063Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256289061883675:10719]
2025-10-01T14:13:35.777767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:35.778259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:35.778343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:35.778796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:35.778872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.778874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.778875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.778877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.778878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.778880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.778881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.778883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.778884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.778886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.778887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.778889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.778890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.778891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.778898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.778909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.778913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.778917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.778922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.778926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.778930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.778934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.778938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.778942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.778946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.778950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.778954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.778958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.778968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.778976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:35.778985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.778990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:35.778994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.779000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:35.779005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.779013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:35.779019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.779023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:35.779027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.779032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:35.779038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.779043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:35.779047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.779052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:35.779057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.779062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:35.779067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.779073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.779077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.779083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.779087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.779092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.779099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.779104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:35.779109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.779114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:35.779154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:35.786803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:35.787709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:35.787715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:35.787718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:35.787723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:35.787731Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2017 [2:7556256289061883675:10719]
2025-10-01T14:13:35.787749Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:35.787769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:35.787773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:35.787778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:35.787783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:35.787803Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:35.787808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:35.787815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:35.787877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.787880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.787882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.787886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:35.787889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:35.787967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:35.787970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.787982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:35.787995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:35.788012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:35.788030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256289061883668:10719]
2025-10-01T14:13:35.788033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256289061883668:10719]
2025-10-01T14:13:35.788035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256289061883668:10719]
2025-10-01T14:13:35.788049Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:35.788063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:35.788079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:35.788082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:35.788125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256289061883668:10719]
2025-10-01T14:13:35.788127Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:35.789249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2017
2025-10-01T14:13:35.789282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2017
2025-10-01T14:13:35.788457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:35.788465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:35.788468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:35.788473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:35.791124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783763:10980], now have 1 active actors on pipe
2025-10-01T14:13:35.791137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783667:2446], now have 1 active actors on pipe
2025-10-01T14:13:35.791155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.791165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.791200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:35.791212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:35.791217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:35.791220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:35.791233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:35.791249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:35.791271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:35.792585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:35.792626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:35.792655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:35.795105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2018 partition: 0 MaxSeqNo: 45 sessionId: src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0
2025-10-01T14:13:35.802530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375afe21-eff86882-3b4b22e6-e6b4edd1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:35.805807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0] Write session: try to update token
2025-10-01T14:13:35.805832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:35.814272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:35.814295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:35.814299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:35.814301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:35.814312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256289061883668:10719]
2025-10-01T14:13:35.814320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256289061883668:10719]
2025-10-01T14:13:35.814324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256289061883668:10719]
2025-10-01T14:13:35.814395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:35.814402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:35.814408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:35.814561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:35.814977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:35.814988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:35.814992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:35.814388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256291438783779:10880]
2025-10-01T14:13:35.815186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2017, pipe: [1:7556256291438783779:10880]
2025-10-01T14:13:35.826783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2018 sessionId: src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:35.829803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:36.064175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:36.064540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256291438783779:10880], now have 1 active actors on pipe
2025-10-01T14:13:36.064574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.064581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.064882Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:36.066507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:36.066524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0] Write session will restart in 0.007245s
2025-10-01T14:13:36.066563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0] Write session: Do CDS request
2025-10-01T14:13:36.066569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:36.065388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256291438783779:10880]
2025-10-01T14:13:36.065426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:36.065489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2018 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0
2025-10-01T14:13:36.065714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2018 sessionId: src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0 is DEAD
2025-10-01T14:13:36.065832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:36.078559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:36.082607Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:36.082621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2019
2025-10-01T14:13:36.082888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:36.082920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:36.082925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:36.082929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:36.083511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2019 sessionId:  describe result for acl check
2025-10-01T14:13:36.083546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:36.083550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:36.083551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:36.083557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256295733751146:10985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:36.084057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256295733751146:10985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:36.083774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:36.085909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256295733751146:10985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:36.085961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:36.086159Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:36.086163Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:36.086173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:36.086215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:36.086247Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256293356851102:10731]
2025-10-01T14:13:36.086799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:36.087061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:36.087091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:36.087352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:36.087392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.087401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.087402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.087402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.087403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.087404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.087405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.087406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.087407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.087408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.087409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.087410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.087411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.087412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.087416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.087424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.087427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.087430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.087433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.087436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.087439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.087442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.087445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.087449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.087452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.087455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.087458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.087461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.087466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.087473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.087479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.087484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.087488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.087492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.087495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.087499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.087503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.087508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.087512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.087516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.087521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.087525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.087529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.087533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.087536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.087540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.087546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.087550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.087554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.087558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.087561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.087566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.087571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.087575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.087578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.087582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.087614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:36.088049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256295733751146:10985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:36.088061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256295733751146:10985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:36.088065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256295733751146:10985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:36.088077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:36.091925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:36.092905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2018
2025-10-01T14:13:36.092949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2018
2025-10-01T14:13:36.092516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:36.092530Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:36.092533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:36.092536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:36.092543Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2018 [2:7556256293356851102:10731]
2025-10-01T14:13:36.092558Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:36.092575Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:36.092577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:36.092581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:36.092583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:36.092613Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:36.092619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:36.092637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:36.092687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.092689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.092691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.092694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:36.092699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:36.092764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:36.092767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.092777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.092785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.092799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:36.092817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751085:2446], now have 1 active actors on pipe
2025-10-01T14:13:36.092821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751184:10985], now have 1 active actors on pipe
2025-10-01T14:13:36.092827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256293356851097:10731]
2025-10-01T14:13:36.092829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256293356851097:10731]
2025-10-01T14:13:36.092831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256293356851097:10731]
2025-10-01T14:13:36.092841Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:36.093367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2019 partition: 0 MaxSeqNo: 45 sessionId: src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0
2025-10-01T14:13:36.092855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:36.092867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:36.092870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:36.092897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256293356851097:10731]
2025-10-01T14:13:36.092898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:36.092949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:36.092952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:36.092954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:36.092959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:36.093046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.093051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.093075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:36.093082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:36.093086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:36.093088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:36.093096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:36.093105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:36.093119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:36.093251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.093253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.093264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:36.093725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da75033e-f42d9ef0-d685d03b-44d32f85_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:36.096546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0] Write session: try to update token
2025-10-01T14:13:36.096566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:36.110925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:36.110942Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:36.110953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256293356851097:10731]
2025-10-01T14:13:36.111000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:36.111167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:36.111292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:36.111417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:36.111542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:36.111722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:36.111756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:36.112196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:36.136814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:36.136835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:36.136838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:36.136840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:36.136852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256293356851097:10731]
2025-10-01T14:13:36.136856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256293356851097:10731]
2025-10-01T14:13:36.136860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256293356851097:10731]
2025-10-01T14:13:36.136903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:36.136908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:36.136910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:36.136912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:36.136920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.136922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:36.137062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:36.139548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2019 sessionId: src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:36.143103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:36.166875Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256295733751193:10880]
2025-10-01T14:13:36.167747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2018, pipe: [1:7556256295733751193:10880]
2025-10-01T14:13:36.334552Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:36.335042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.335052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.335078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751193:10880], now have 1 active actors on pipe
2025-10-01T14:13:36.338835Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:36.339001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:36.339058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:36.339061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:36.339137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2019 reason: error at write: Disconnected sessionId: src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0
2025-10-01T14:13:36.339263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256295733751193:10880]
2025-10-01T14:13:36.339353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2019 sessionId: src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0 is DEAD
2025-10-01T14:13:36.346494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:36.346509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0] Write session will restart in 0.005333s
2025-10-01T14:13:36.346543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0] Write session: Do CDS request
2025-10-01T14:13:36.346550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:36.357707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:36.362749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:36.362768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2020
2025-10-01T14:13:36.364456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:36.364509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:36.364516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:36.364523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:36.365791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:36.366032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:36.366209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:36.366213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:36.366225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:36.366263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:36.366299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256293356851220:10735]
2025-10-01T14:13:36.366954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:36.367479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:36.367538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:36.367858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:36.367905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.367906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.367907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.367908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.367909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.367910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.367912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.367913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.367914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.367915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.367916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.367917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.367918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.367919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.367924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.367933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.367937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.367941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.367945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.367949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.367953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.367956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.367960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.367963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.367967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.367970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.367974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.367977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.367983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.367990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.367996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.368002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.368006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.368011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.368016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.368020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.368026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.368031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.368035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.368040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.368045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.368050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.368055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.368060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.368080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.368086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.368090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.368095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.368100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.368106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.368111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.368116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.368120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.368125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.368130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.368135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.368179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:36.365715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2020 sessionId:  describe result for acl check
2025-10-01T14:13:36.365755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:36.365756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:36.365757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:36.365763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256295733751263:10989] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:36.366216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256295733751263:10989] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:36.373336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:36.373990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:36.374008Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:36.374010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:36.374014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:36.374022Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2019 [2:7556256293356851220:10735]
2025-10-01T14:13:36.374040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:36.374062Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:36.374065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:36.374069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:36.374071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:36.374089Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:36.374095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:36.374102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:36.374165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.374167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.374169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.374174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:36.374176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:36.374253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:36.374256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.374268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.374280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.374297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:36.374314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256293356851214:10735]
2025-10-01T14:13:36.374317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256293356851214:10735]
2025-10-01T14:13:36.374319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256293356851214:10735]
2025-10-01T14:13:36.374333Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:36.374347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:36.374362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:36.374365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:36.374421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256293356851214:10735]
2025-10-01T14:13:36.374423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:36.374511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:36.374514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:36.374516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:36.374522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:36.375297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2019
2025-10-01T14:13:36.376832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256295733751263:10989] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:36.380696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751197:2446], now have 1 active actors on pipe
2025-10-01T14:13:36.385933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256295733751263:10989] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:36.385950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256295733751263:10989] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:36.385953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256295733751263:10989] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:36.385960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:36.388549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751304:10989], now have 1 active actors on pipe
2025-10-01T14:13:36.388836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.388852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.388884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:36.388901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:36.388912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:36.388915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:36.388928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:36.388949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:36.388975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:36.389275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.389283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.389298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:36.388652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2019
2025-10-01T14:13:36.389421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2020 partition: 0 MaxSeqNo: 45 sessionId: src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0
2025-10-01T14:13:36.390491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e15136c3-bf9f8df5-f83d6cf6-e00abc77_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:36.393016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0] Write session: try to update token
2025-10-01T14:13:36.393033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:36.404578Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:36.404612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:36.404614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:36.404616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:36.404629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256293356851214:10735]
2025-10-01T14:13:36.404634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256293356851214:10735]
2025-10-01T14:13:36.404641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256293356851214:10735]
2025-10-01T14:13:36.404686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:36.404693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.404698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:36.404834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:36.406842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:36.406850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:36.406853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:36.423659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2020 sessionId: src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:36.426046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:36.442459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256295733751308:10880]
2025-10-01T14:13:36.454513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2019, pipe: [1:7556256295733751308:10880]
2025-10-01T14:13:36.585871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:36.586624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.586639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.586681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751308:10880], now have 1 active actors on pipe
2025-10-01T14:13:36.587245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:36.587259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:36.587313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2020 reason: error at write: Disconnected sessionId: src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0
2025-10-01T14:13:36.587487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2020 sessionId: src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0 is DEAD
2025-10-01T14:13:36.587607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256295733751308:10880]
2025-10-01T14:13:36.587621Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:36.587214Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:36.588000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:36.588008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0] Write session will restart in 0.008375s
2025-10-01T14:13:36.588035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0] Write session: Do CDS request
2025-10-01T14:13:36.588041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:36.598843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:36.599116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:36.599131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2021
2025-10-01T14:13:36.599273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:36.599301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:36.599307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:36.599310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:36.599647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2021 sessionId:  describe result for acl check
2025-10-01T14:13:36.599669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:36.599671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:36.599673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:36.599678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256295733751349:10997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:36.600085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256295733751349:10997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:36.614566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256295733751349:10997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:36.618636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256295733751349:10997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:36.618653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256295733751349:10997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:36.618657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256295733751349:10997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:36.618672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:36.619341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:36.623732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:36.623988Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:36.623993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:36.624005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:36.624062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:36.624106Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256293356851327:10737]
2025-10-01T14:13:36.624742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:36.625250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:36.625301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:36.625612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:36.625674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.625676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.625677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.625678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.625680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.625682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.625683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.625684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.625686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.625687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.625688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.625689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.625690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.625691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.625698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.625707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.625712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.625716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.625720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.625724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.625728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.625731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.625736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.625740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.625744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.625747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.625751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.625754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.625762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.625770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.625776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.625782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.625786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.625792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.625797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.625802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.625808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.625814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.625818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.625823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.625829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.625834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.625839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.625847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.625852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.625857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.625862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.625867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.625871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.625876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.625882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.625887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.625891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.625897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.625903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.625908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.625969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:36.632052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:36.632715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:36.632720Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:36.632723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:36.632727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:36.632736Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2020 [2:7556256293356851327:10737]
2025-10-01T14:13:36.632752Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:36.632769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:36.632773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:36.632776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:36.632779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:36.632797Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:36.632802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:36.632808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:36.632871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.632873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.632874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.632877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:36.632880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:36.633064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:36.633067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.633081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.633094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.633112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:36.633130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256293356851320:10737]
2025-10-01T14:13:36.633133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256293356851320:10737]
2025-10-01T14:13:36.633135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256293356851320:10737]
2025-10-01T14:13:36.633147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:36.633165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:36.633181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:36.633185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:36.633224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256293356851320:10737]
2025-10-01T14:13:36.633227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:36.633473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:36.633480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:36.633482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:36.633487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:36.634226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2020
2025-10-01T14:13:36.634254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2020
2025-10-01T14:13:36.636127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751443:10997], now have 1 active actors on pipe
2025-10-01T14:13:36.636143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751331:2446], now have 1 active actors on pipe
2025-10-01T14:13:36.636163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.636170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.636208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:36.636220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:36.636226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:36.636229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:36.636243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:36.636259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:36.636281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:36.639503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.639522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.639557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:36.639748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2021 partition: 0 MaxSeqNo: 45 sessionId: src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0
2025-10-01T14:13:36.640139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd4c587-1ee5db9-90a06832-9d3d42d4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:36.642740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0] Write session: try to update token
2025-10-01T14:13:36.642757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:36.670650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2021 sessionId: src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:36.673251Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:36.674346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.674382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.674422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:36.674765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:36.681292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:36.681315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:36.681320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:36.681322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:36.681332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256293356851320:10737]
2025-10-01T14:13:36.681337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256293356851320:10737]
2025-10-01T14:13:36.681341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256293356851320:10737]
2025-10-01T14:13:36.681388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:36.681395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.681397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:36.681535Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:36.682913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:36.682926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:36.682931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:36.689466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256295733751466:10880]
2025-10-01T14:13:36.690635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2020, pipe: [1:7556256295733751466:10880]
2025-10-01T14:13:36.942543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:36.943010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751466:10880], now have 1 active actors on pipe
2025-10-01T14:13:36.952917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:36.952948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:36.953139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.953202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.953264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.953335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.953630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.953640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.953725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.953789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.953852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.953935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.953978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.953981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.954049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.954107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.954170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.954229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.954272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.954275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.954343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.955836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.955922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.955996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.956039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.956043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.956116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.956178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.956239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.956304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.956344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.956348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.956416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.956472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.956539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.956624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.956671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.956675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.956748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.956811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.956878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.956948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.956990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.956995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.957065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.957126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.957190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.957255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.957298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.957301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.957370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.957430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.957496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.957561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.957607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.957610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.957696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:36.957759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:36.957824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:36.957892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:36.957936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:36.957939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:36.965320Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:36.967264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:36.967351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2021 reason: status is not ok: tablet will be restarted right now sessionId: src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0
2025-10-01T14:13:36.967641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2021 sessionId: src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0 is DEAD
2025-10-01T14:13:36.967808Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:36.967844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256295733751466:10880]
2025-10-01T14:13:36.970676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:36.970694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0] Write session will restart in 0.007288s
2025-10-01T14:13:36.970725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0] Write session: Do CDS request
2025-10-01T14:13:36.970731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:36.982874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:36.983880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:36.983897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2022
2025-10-01T14:13:36.984037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:36.984065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:36.984069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:36.984073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:36.984663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2022 sessionId:  describe result for acl check
2025-10-01T14:13:36.984700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:36.984706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:36.984708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:36.984714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256295733751539:11007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:36.985225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256295733751539:11007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:36.987863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256295733751539:11007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:36.987269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:36.991993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256295733751539:11007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:36.992011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256295733751539:11007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:36.992014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256295733751539:11007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:36.992022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:36.992301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:36.992547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:36.992557Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:36.992568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:36.992628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:36.992667Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256293356851457:10748]
2025-10-01T14:13:36.993325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:36.993652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:36.993690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:36.993988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:36.994037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.994043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.994044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.994045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.994046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.994047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.994049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.994050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.994051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.994052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.994054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.994055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.994056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.994057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.994062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.994072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.994075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.994079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.994082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.994086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.994089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.994093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.994096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.994100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.994104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.994108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.994111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.994114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.994120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.994131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:36.994141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.994150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:36.994160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.994169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:36.994180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.994188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:36.994197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.994206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:36.994214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.994223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:36.994232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.994241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:36.994250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.994258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:36.994266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.994279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:36.994288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.994292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:36.994296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.994301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:36.994308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.994313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:36.994320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.994325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:36.994335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.994343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:36.994393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:36.999228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:36.999890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:36.999905Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:36.999907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:36.999911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:36.999918Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2021 [2:7556256293356851457:10748]
2025-10-01T14:13:36.999933Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:36.999947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:36.999952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:36.999960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:36.999962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:36.999977Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:36.999983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:36.999992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:37.000046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.000053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.000054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.000057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:37.000060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:37.000124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:37.000135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.000145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.000156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.000170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:37.000193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751573:11007], now have 1 active actors on pipe
2025-10-01T14:13:37.000201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256295733751475:2446], now have 1 active actors on pipe
2025-10-01T14:13:37.000208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256293356851450:10748]
2025-10-01T14:13:37.000210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256293356851450:10748]
2025-10-01T14:13:37.000212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256293356851450:10748]
2025-10-01T14:13:37.000225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:37.000236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:37.000252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:37.000259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:37.000290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256293356851450:10748]
2025-10-01T14:13:37.000296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:37.000268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2021
2025-10-01T14:13:37.000272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2021
2025-10-01T14:13:37.000369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:37.000379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:37.000381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:37.000386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:37.000589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.000613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.000640Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|787a8626-b1ab757b-1256421d-f9f939d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:37.000650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:37.000653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:37.000656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:37.000669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:37.000676Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:37.000696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:37.001037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.001048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.001069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:37.001161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2022 partition: 0 MaxSeqNo: 45 sessionId: src_id|787a8626-b1ab757b-1256421d-f9f939d8_0
2025-10-01T14:13:37.001514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70c164bf-c858641f-7965ef23-ae0cd80b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|787a8626-b1ab757b-1256421d-f9f939d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:37.004088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|787a8626-b1ab757b-1256421d-f9f939d8_0] Write session: try to update token
2025-10-01T14:13:37.004109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|787a8626-b1ab757b-1256421d-f9f939d8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:37.020553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:37.020582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:37.020592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256293356851450:10748]
2025-10-01T14:13:37.020655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:37.020847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:37.020994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:37.021135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:37.021272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:37.022202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:37.022252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:37.022477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:37.026449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2022 sessionId: src_id|787a8626-b1ab757b-1256421d-f9f939d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:37.029028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:37.029290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.029317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.029357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:37.029547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:37.061559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.061591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.061766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.061831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.061893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.061961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.062520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.062532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.062600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.062662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.062728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.062803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.062854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.062861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.062926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.062988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.063055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.063119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.063163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.063170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.063239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.063305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.063364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.063429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.063478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.063489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.063563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.063625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.063692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.063756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.063801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.063804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.063877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.063937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.064001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.064068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.064113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.064116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.064187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.064247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.064311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.064377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.064422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.064425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.064499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.064561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.064641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.064707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.064756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.064759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.064828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.064886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.064951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.065011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.065053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.065056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.065122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.065177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.065244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.065304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.065347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.065349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.065426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:13:37.065494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:37.065516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:37.065519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:13:37.065542Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.065552Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.065555Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.065560Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.065564Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.065567Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.065571Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.065576Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.065580Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.065584Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066189Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066195Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066198Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066203Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066206Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066210Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066213Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066218Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066222Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066226Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066356Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066360Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066364Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066734Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066751Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066755Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066761Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066765Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066769Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066773Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066857Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066867Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066871Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066875Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066879Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:37.066939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:13:37.066954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:13:37.066962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:13:37.066965Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:13:37.066968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:13:37.067376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:13:37.067402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:13:37.067407Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:13:37.067410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:13:37.067413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:13:37.067417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:13:37.067904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:13:37.067929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:13:37.067934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:13:37.067937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:13:37.067940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:13:37.067943Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:13:37.068428Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:13:37.068450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:37.068554Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759328017064
2025-10-01T14:13:37.069394Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:13:37.069454Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:13:37.073699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256300028718881:10880]
2025-10-01T14:13:37.074086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028718881:10880], now have 1 active actors on pipe
2025-10-01T14:13:37.074201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2021, pipe: [1:7556256300028718881:10880]
2025-10-01T14:13:37.089026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:37.089050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:37.089053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:37.089055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:37.089068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256293356851450:10748]
2025-10-01T14:13:37.089072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256293356851450:10748]
2025-10-01T14:13:37.089076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256293356851450:10748]
2025-10-01T14:13:37.089133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:37.089140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.089149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:37.089293Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:37.090422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:37.090430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:37.090434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:37.351677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:37.352510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:37.354728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:37.354788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2022 reason: status is not ok: tablet will be restarted right now sessionId: src_id|787a8626-b1ab757b-1256421d-f9f939d8_0
2025-10-01T14:13:37.354897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:37.354942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256300028718881:10880]
2025-10-01T14:13:37.354980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2022 sessionId: src_id|787a8626-b1ab757b-1256421d-f9f939d8_0 is DEAD
2025-10-01T14:13:37.358577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787a8626-b1ab757b-1256421d-f9f939d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:37.358596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787a8626-b1ab757b-1256421d-f9f939d8_0] Write session will restart in 0.005555s
2025-10-01T14:13:37.358627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787a8626-b1ab757b-1256421d-f9f939d8_0] Write session: Do CDS request
2025-10-01T14:13:37.358634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787a8626-b1ab757b-1256421d-f9f939d8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:37.370932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|787a8626-b1ab757b-1256421d-f9f939d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:37.371268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:37.371286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2023
2025-10-01T14:13:37.371462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:37.371494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:37.371500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:37.371503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:37.371958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2023 sessionId:  describe result for acl check
2025-10-01T14:13:37.371986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:37.371988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:37.371990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:37.371995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256300028718913:11013] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:37.372544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256300028718913:11013] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:37.381990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256300028718913:11013] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:37.387654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256300028718913:11013] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:37.387694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256300028718913:11013] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:37.387697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256300028718913:11013] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:37.387706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:37.389542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:37.402594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:37.402873Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:37.402877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:37.402891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:37.402948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:37.402987Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256297651818894:10756]
2025-10-01T14:13:37.403769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:37.407218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:37.407289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:37.407661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:37.407719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.407721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.407722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.407723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.407725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.407727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.407728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.407729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.407730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.407732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.407733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.407734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.407738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.407739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.407745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.407755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.407760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.407764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.407767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.407772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.407775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.407780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.407784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.407788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.407792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.407796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.407800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.407803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.407811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.407819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.407826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.407832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.407837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.407842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.407848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.407853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.407857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.407864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.407870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.407875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.407882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.407887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.407892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.407899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.407904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.407910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.407914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.407919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.407923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.407928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.407932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.407937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.407941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.407946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.407950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.407955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.407992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:37.414798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:37.415459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:37.415465Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:37.415469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:37.415473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:37.415480Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2022 [2:7556256297651818894:10756]
2025-10-01T14:13:37.415499Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:37.415518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:37.415522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:37.415526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:37.415529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:37.415548Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:37.415554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:37.415562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:37.415639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.415642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.415645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.415648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:37.415651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:37.415746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:37.415749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.415762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.415773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.415789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:37.415807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256297651818889:10756]
2025-10-01T14:13:37.415810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256297651818889:10756]
2025-10-01T14:13:37.415813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256297651818889:10756]
2025-10-01T14:13:37.415823Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:37.415833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:37.415840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:37.415844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:37.415850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:37.415857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:37.415860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:37.415872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028718988:11013], now have 1 active actors on pipe
2025-10-01T14:13:37.415876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028718889:2446], now have 1 active actors on pipe
2025-10-01T14:13:37.415913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256297651818889:10756]
2025-10-01T14:13:37.415921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:37.415949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:37.416250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2022
2025-10-01T14:13:37.416289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2022
2025-10-01T14:13:37.418755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.418776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.418814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f812e7b2-79b91fce-98ff13a-723e6243_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:37.418825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:37.418831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:37.418834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:37.418847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:37.418862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:37.418881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:37.419225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.419231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.419246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:37.419380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2023 partition: 0 MaxSeqNo: 45 sessionId: src_id|f812e7b2-79b91fce-98ff13a-723e6243_0
2025-10-01T14:13:37.422511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|787a8626-b1ab757b-1256421d-f9f939d8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f812e7b2-79b91fce-98ff13a-723e6243_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:37.425978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f812e7b2-79b91fce-98ff13a-723e6243_0] Write session: try to update token
2025-10-01T14:13:37.426006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f812e7b2-79b91fce-98ff13a-723e6243_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:37.446957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:37.446978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:37.446980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:37.446982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:37.446994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256297651818889:10756]
2025-10-01T14:13:37.447002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256297651818889:10756]
2025-10-01T14:13:37.447006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256297651818889:10756]
2025-10-01T14:13:37.447053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:37.447061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.447063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:37.447213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:37.450449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:37.450455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:37.450459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:37.458495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256300028719002:10880]
2025-10-01T14:13:37.467116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2022, pipe: [1:7556256300028719002:10880]
2025-10-01T14:13:37.469710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2023 sessionId: src_id|f812e7b2-79b91fce-98ff13a-723e6243_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:37.472262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:37.615499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:37.615943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028719002:10880], now have 1 active actors on pipe
2025-10-01T14:13:37.615998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.616010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.616258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:37.616299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:37.616275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:37.616347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2023 reason: error at write: Disconnected sessionId: src_id|f812e7b2-79b91fce-98ff13a-723e6243_0
2025-10-01T14:13:37.616593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:37.616598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2023 sessionId: src_id|f812e7b2-79b91fce-98ff13a-723e6243_0 is DEAD
2025-10-01T14:13:37.616652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256300028719002:10880]
2025-10-01T14:13:37.616937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f812e7b2-79b91fce-98ff13a-723e6243_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:37.616959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f812e7b2-79b91fce-98ff13a-723e6243_0] Write session will restart in 0.006019s
2025-10-01T14:13:37.616989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f812e7b2-79b91fce-98ff13a-723e6243_0] Write session: Do CDS request
2025-10-01T14:13:37.616995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f812e7b2-79b91fce-98ff13a-723e6243_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:37.624098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f812e7b2-79b91fce-98ff13a-723e6243_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:37.624367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:37.624383Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2024
2025-10-01T14:13:37.624491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:37.624524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:37.624536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:37.624553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:37.624962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2024 sessionId:  describe result for acl check
2025-10-01T14:13:37.624994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:37.624999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:37.625003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:37.625008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256300028719091:11019] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:37.625511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256300028719091:11019] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:37.626122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:37.627790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256300028719091:11019] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:37.628679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:37.628925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:37.628938Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:37.628949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:37.629021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:37.629067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256297651819001:10758]
2025-10-01T14:13:37.629785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:37.630122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:37.630173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:37.630394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256300028719091:11019] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:37.630567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:37.630409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256300028719091:11019] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:37.630412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256300028719091:11019] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:37.630421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:37.630632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.630643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.630645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.630646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.630647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.630649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.630650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.630652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.630653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.630654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.630656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.630657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.630658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.630660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.630666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.630677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.630681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.630685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.630690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.630694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.630699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.630703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.630708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.630713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.630717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.630721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.630725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.630729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.630737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.630746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.630753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.630760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.630776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.630782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.630787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.630793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.630798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.630803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.630809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.630815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.630820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.630826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.630831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.630837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.630841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.630847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.630851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.630857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.630862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.630868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.630873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.630878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.630884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.630889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.630893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.630897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.630937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:37.635858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:37.636776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:37.636791Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:37.636794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:37.636798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:37.636806Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2023 [2:7556256297651819001:10758]
2025-10-01T14:13:37.636825Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:37.636853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:37.636861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:37.636865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:37.636868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:37.636889Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:37.636899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:37.636906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:37.636975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.636982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.636985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.636988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:37.636991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:37.637067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:37.637074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.637086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.637098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.637119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:37.637143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256297651818996:10758]
2025-10-01T14:13:37.637150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256297651818996:10758]
2025-10-01T14:13:37.637152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256297651818996:10758]
2025-10-01T14:13:37.637168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:37.637188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:37.637206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:37.637209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:37.637210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:37.637215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:37.637217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:37.637245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256297651818996:10758]
2025-10-01T14:13:37.637252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:37.637302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:37.637394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2023
2025-10-01T14:13:37.637415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2023
2025-10-01T14:13:37.637407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028719130:11019], now have 1 active actors on pipe
2025-10-01T14:13:37.637416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028719025:2446], now have 1 active actors on pipe
2025-10-01T14:13:37.637601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.637612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.637642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:37.637654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:37.637659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:37.637665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:37.637675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:37.637685Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:37.637702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:37.637837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.637845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.637858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:37.637932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2024 partition: 0 MaxSeqNo: 45 sessionId: src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0
2025-10-01T14:13:37.638348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f812e7b2-79b91fce-98ff13a-723e6243_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:37.641515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0] Write session: try to update token
2025-10-01T14:13:37.641537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:37.652412Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:37.652438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:37.652450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256297651818996:10758]
2025-10-01T14:13:37.652500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:37.652502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:37.652702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:37.652878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:37.653033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:37.653196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:37.653415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:37.653464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:37.664539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2024 sessionId: src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:37.667321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:37.668250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.668282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.668323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:37.669309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:37.673502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:37.673528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:37.673531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:37.673535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:37.673547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256297651818996:10758]
2025-10-01T14:13:37.673551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256297651818996:10758]
2025-10-01T14:13:37.673554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256297651818996:10758]
2025-10-01T14:13:37.673601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:37.673609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:37.673616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.673618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:37.673618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:37.673621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:37.673762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:37.716758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256300028719162:10880]
2025-10-01T14:13:37.716961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2023, pipe: [1:7556256300028719162:10880]
2025-10-01T14:13:37.809650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:37.816327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.816355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.816503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.816560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.816635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.816696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.816740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.816748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.816815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.816875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.816936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.816996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.817039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.817044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.817101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.817156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.817225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.817285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.817325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.817330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.817390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.817449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.817508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.817565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.817605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.817613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.817672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.817728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.817786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.817842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.817883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.817888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.817942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.817995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.818048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.818101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.818146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.818151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.818215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.818271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.818338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.818417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.818459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.818464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.818523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.818575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.818632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.818692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.818737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.818744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.818800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.818853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.818907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.818962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.819002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.819007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.819062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:37.819113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:37.819175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:37.819238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:37.819279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:37.819283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:37.819327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028719162:10880], now have 1 active actors on pipe
2025-10-01T14:13:37.819558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:37.819574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:37.819577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256300028719162:10880]
2025-10-01T14:13:37.819595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:37.819595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2024 reason: error at write: Disconnected sessionId: src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0
2025-10-01T14:13:37.819820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2024 sessionId: src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0 is DEAD
2025-10-01T14:13:37.819970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:37.819981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0] Write session will restart in 0.006904s
2025-10-01T14:13:37.820008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0] Write session: Do CDS request
2025-10-01T14:13:37.820013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:37.820208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:37.827947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:37.828048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:37.828064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2025
2025-10-01T14:13:37.828142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:37.828165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:37.828172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:37.828174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:37.828567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2025 sessionId:  describe result for acl check
2025-10-01T14:13:37.828618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:37.828625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:37.828627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:37.828638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:37.828632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256300028719234:11030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:37.829109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256300028719234:11030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:37.830212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:37.830385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:37.830398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:37.830409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:37.830455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:37.830492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256297651819117:10763]
2025-10-01T14:13:37.831065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:37.831159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256300028719234:11030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:37.831281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:37.831320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:37.831605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:37.831657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.831664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.831665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.831666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.831668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.831669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.831670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.831671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.831672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.831673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.831674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.831676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.831676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.831677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.831683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.831692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.831695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.831698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.831702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.831705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.831709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.831712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.831716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.831720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.831723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.831727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.831731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.831734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.831740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.831748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:37.831754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.831759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:37.831764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.831769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:37.831778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.831783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:37.831792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.831798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:37.831806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.831811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:37.831819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.831825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:37.831832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.831837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:37.831846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.831852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:37.831860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.831865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.831870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.831880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.831886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.831891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.831895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.831900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:37.831905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.831909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:37.831951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:37.835299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256300028719234:11030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:37.835313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256300028719234:11030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:37.835315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256300028719234:11030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:37.835321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:37.835453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:37.836047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:37.836063Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:37.836065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:37.836069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:37.836076Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2024 [2:7556256297651819117:10763]
2025-10-01T14:13:37.836089Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:37.836109Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:37.836113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:37.836116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:37.836123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:37.836137Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:37.836146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:37.836152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:37.836208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.836215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.836217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.836220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:37.836223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:37.836285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:37.836294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.836305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:37.836317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:37.836334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:37.836356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028719274:11030], now have 1 active actors on pipe
2025-10-01T14:13:37.836364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028719165:2446], now have 1 active actors on pipe
2025-10-01T14:13:37.836371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256297651819112:10763]
2025-10-01T14:13:37.836361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2024
2025-10-01T14:13:37.836373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256297651819112:10763]
2025-10-01T14:13:37.836374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256297651819112:10763]
2025-10-01T14:13:37.836367Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2024
2025-10-01T14:13:37.836383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:37.836392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:37.836397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:37.836401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:37.836402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:37.836411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:37.836414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:37.836446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.836455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.836472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256297651819112:10763]
2025-10-01T14:13:37.836482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:37.836490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:37.836511Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:37.836521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:37.836530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:37.836532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:37.836540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:37.836551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:37.836577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:37.836689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.836698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.836713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:37.836772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2025 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0
2025-10-01T14:13:37.837093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba1f2eb-a697cae6-29c062ad-ef3fb032_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:37.839562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0] Write session: try to update token
2025-10-01T14:13:37.839578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:37.852730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2025 sessionId: src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:37.854938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:37.855452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:37.855480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:37.855500Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:37.855504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:37.855507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:37.855510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:37.855521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256297651819112:10763]
2025-10-01T14:13:37.855530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256297651819112:10763]
2025-10-01T14:13:37.855533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256297651819112:10763]
2025-10-01T14:13:37.855570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:37.855582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:37.855585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:37.855589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:37.855595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:37.855598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:37.855725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:37.919511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256300028719283:10880]
2025-10-01T14:13:37.919732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2024, pipe: [1:7556256300028719283:10880]
2025-10-01T14:13:38.010003Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:38.010722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:38.010785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256300028719283:10880], now have 1 active actors on pipe
2025-10-01T14:13:38.010868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:38.011032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:38.011098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256300028719283:10880]
2025-10-01T14:13:38.025268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:38.025355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:38.025391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2025 reason: error at write: Disconnected sessionId: src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0
2025-10-01T14:13:38.025720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2025 sessionId: src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0 is DEAD
2025-10-01T14:13:38.025776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:38.025790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0] Write session will restart in 0.009706s
2025-10-01T14:13:38.025820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0] Write session: Do CDS request
2025-10-01T14:13:38.025831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:38.034157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:38.036052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:38.036328Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:38.036342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:38.036357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:38.036421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:38.036469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256301946786523:10765]
2025-10-01T14:13:38.037150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:38.037487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:38.037548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:38.037905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:38.037970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.037979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.037999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.037981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.037982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.037983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.037985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.037986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.037988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.037989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.037990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.037992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.037993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.037995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.037996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.038003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.038012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.038016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.038020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.038024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.038028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.038031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.038035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.038039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.038044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.038049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.038053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.038057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.038061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.038069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.038077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.038082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.038088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.038092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.038098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.038103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.038108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.038112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.038118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.038122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.038127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.038132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.038137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.038142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.038146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.038151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.038156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.038160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.038166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.038171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.038177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.038181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.038186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.038190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.038196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.038200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.038204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.038244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:38.038286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:38.038303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2026
2025-10-01T14:13:38.038758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.038796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:38.038809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:38.038813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:38.039228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2026 sessionId:  describe result for acl check
2025-10-01T14:13:38.039264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:38.039265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:38.039267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:38.039273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256304323686660:11035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:38.039810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256304323686660:11035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:38.042387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256304323686660:11035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:38.044098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2025
2025-10-01T14:13:38.042617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:38.043652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:38.043658Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:38.043661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:38.043665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:38.043673Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2025 [2:7556256301946786523:10765]
2025-10-01T14:13:38.043692Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:38.043708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:38.043712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.043718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.043721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.043739Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:38.043745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:38.043752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:38.043818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.043820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.043825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.043829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:38.043832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:38.043930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:38.043932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.043947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.043959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.043977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:38.043996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686584:2446], now have 1 active actors on pipe
2025-10-01T14:13:38.044006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256301946786518:10765]
2025-10-01T14:13:38.044008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256301946786518:10765]
2025-10-01T14:13:38.044010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256301946786518:10765]
2025-10-01T14:13:38.044025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:38.044037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:38.044038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:38.044039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:38.044041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:38.044052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:38.044056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:38.044096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256301946786518:10765]
2025-10-01T14:13:38.044105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:38.044119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:38.047124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256304323686660:11035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:38.047139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256304323686660:11035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:38.047143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256304323686660:11035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:38.047150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:38.047687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686694:11035], now have 1 active actors on pipe
2025-10-01T14:13:38.047755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2025
2025-10-01T14:13:38.047861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.047880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.047910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:38.047928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.047934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.047938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:38.047950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.047979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:38.047999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.049206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.049220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.049243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.049355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2026 partition: 0 MaxSeqNo: 45 sessionId: src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0
2025-10-01T14:13:38.049759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9b846a-88305e0a-194e60d9-f93d98b6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:38.056437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:38.056464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:38.056473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256301946786518:10765]
2025-10-01T14:13:38.056535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:38.056908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:38.057060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:38.057403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:38.057617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:38.057723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:38.057936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:38.057973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:38.072052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0] Write session: try to update token
2025-10-01T14:13:38.072075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:38.087507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:38.087527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:38.087530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:38.087532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:38.087543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256301946786518:10765]
2025-10-01T14:13:38.087547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256301946786518:10765]
2025-10-01T14:13:38.087551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256301946786518:10765]
2025-10-01T14:13:38.087587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:38.087596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:38.087599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:38.087602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:38.087603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.087605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:38.087752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:38.091745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2026 sessionId: src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:38.094138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:38.112131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256304323686701:10880]
2025-10-01T14:13:38.112588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2025, pipe: [1:7556256304323686701:10880]
2025-10-01T14:13:38.235232Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:38.236230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.236241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.236273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686701:10880], now have 1 active actors on pipe
2025-10-01T14:13:38.238834Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:38.238904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:38.238961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:38.239048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2026 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0
2025-10-01T14:13:38.239112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256304323686701:10880]
2025-10-01T14:13:38.239236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2026 sessionId: src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0 is DEAD
2025-10-01T14:13:38.239413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:38.239424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0] Write session will restart in 0.008283s
2025-10-01T14:13:38.239464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0] Write session: Do CDS request
2025-10-01T14:13:38.239470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:38.248899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.249205Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:38.249222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2027
2025-10-01T14:13:38.249409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.249437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:38.249442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:38.249445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:38.249915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2027 sessionId:  describe result for acl check
2025-10-01T14:13:38.249949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:38.249951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:38.249955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:38.249960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256304323686719:11039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:38.250495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256304323686719:11039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:38.254387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256304323686719:11039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:38.256452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:38.259163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:38.259436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:38.259441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:38.259453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:38.259514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:38.259549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256301946786665:10778]
2025-10-01T14:13:38.260122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:38.259427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256304323686719:11039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:38.259447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256304323686719:11039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:38.259450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256304323686719:11039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:38.259458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:38.260504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:38.260554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:38.260885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:38.260952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.260967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.260972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.260974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.260975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.260976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.260977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.260979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.260980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.260981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.260983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.260984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.260985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.260986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.260992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.261003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.261008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.261013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.261017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.261025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.261030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.261033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.261038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.261043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.261048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.261053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.261057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.261061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.261072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.261084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.261094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.261104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.261110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.261120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.261124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.261134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.261139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.261147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.261156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.261161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.261168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.261178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.261183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.261190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.261198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.261204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.261212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.261218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.261225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.261233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.261238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.261245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.261250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.261257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.261262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.261271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.261311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:38.266111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:38.267265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:38.267285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:38.267288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:38.267291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:38.267298Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2026 [2:7556256301946786665:10778]
2025-10-01T14:13:38.267315Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:38.267333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:38.267336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.267341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.267343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.267360Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:38.267370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:38.267375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:38.267437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.267439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.267441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.267446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:38.267448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:38.267515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:38.267517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.267530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.267542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.267558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:38.267574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256301946786660:10778]
2025-10-01T14:13:38.267577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256301946786660:10778]
2025-10-01T14:13:38.267580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256301946786660:10778]
2025-10-01T14:13:38.267593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:38.267605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:38.267618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:38.267621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:38.267656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256301946786660:10778]
2025-10-01T14:13:38.267664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:38.267786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:38.267791Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:38.267794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:38.267799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:38.268028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686703:2446], now have 1 active actors on pipe
2025-10-01T14:13:38.268042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686810:11039], now have 1 active actors on pipe
2025-10-01T14:13:38.268005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2026
2025-10-01T14:13:38.268053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2026
2025-10-01T14:13:38.268404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.268418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.268448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:38.268456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.268460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.268463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:38.268473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.268484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:38.268501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.269049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.269060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.269080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.269231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2027 partition: 0 MaxSeqNo: 45 sessionId: src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0
2025-10-01T14:13:38.269682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7846b820-4e402bbf-dffb9f6c-5681d363_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:38.272769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0] Write session: try to update token
2025-10-01T14:13:38.272789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:38.287454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2027 sessionId: src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:38.290100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:38.290960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.290987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.291027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:38.291535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:38.296906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:38.296926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:38.296928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:38.296929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:38.296936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256301946786660:10778]
2025-10-01T14:13:38.296939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256301946786660:10778]
2025-10-01T14:13:38.296942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256301946786660:10778]
2025-10-01T14:13:38.296989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:38.296991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:38.296993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:38.296997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.296999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:38.297000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:38.297155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:38.339489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256304323686823:10880]
2025-10-01T14:13:38.339831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2026, pipe: [1:7556256304323686823:10880]
2025-10-01T14:13:38.460774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:38.469635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.473437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:38.473492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256304323686823:10880]
2025-10-01T14:13:38.473504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:38.473508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:38.473530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2027 reason: error at write: Disconnected sessionId: src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0
2025-10-01T14:13:38.473718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2027 sessionId: src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0 is DEAD
2025-10-01T14:13:38.473865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:38.473872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0] Write session will restart in 0.008800s
2025-10-01T14:13:38.473898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0] Write session: Do CDS request
2025-10-01T14:13:38.473904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:38.469808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.469995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.470056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.470123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.470187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.470231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.470235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.470310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.470390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.470451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.470524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.470564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.470567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.470633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.470689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.470782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.470841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.470878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.470881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.470944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.471010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.471072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.471134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.471181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.471184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.471265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.471325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.471386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.471442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.471489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.471491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.471558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.471614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.471680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.471744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.471855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.471858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.471922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.471980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.472042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.472105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.472152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.472154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.472219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.472279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.472345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.472468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.472514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.472517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.472650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.472715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.472780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.472847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.472888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.472890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.472965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:38.473028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:38.473087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:38.473147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:38.473188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:38.473190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:38.473258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686823:10880], now have 1 active actors on pipe
2025-10-01T14:13:38.474268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:38.483911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.484919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:38.484934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2028
2025-10-01T14:13:38.485137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.485173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:38.485181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:38.485184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:38.485467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2028 sessionId:  describe result for acl check
2025-10-01T14:13:38.485490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:38.485494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:38.485497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:38.485500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256304323686903:11043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:38.485933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:38.486211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256304323686903:11043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:38.487968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:38.488175Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:38.488186Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:38.488198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:38.488243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:38.488281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256301946786789:10781]
2025-10-01T14:13:38.488918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:38.489292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:38.489528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256304323686903:11043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:38.489339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:38.489628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:38.489677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.489678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.489679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.489680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.489681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.489682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.489683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.489684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.489685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.489686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.489687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.489688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.489689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.489690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.489695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.489703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.489707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.489711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.489714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.489718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.489721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.489725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.489728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.489732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.489735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.489739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.489742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.489745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.489751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.489758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.489764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.489769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.489772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.489777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.489781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.489786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.489790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.489795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.489799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.489803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.489807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.489812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.489816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.489820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.489825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.489829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.489833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.489838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.489843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.489848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.489853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.489858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.489863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.489868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.489872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.489878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.489915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:38.494629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256304323686903:11043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:38.494644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256304323686903:11043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:38.494648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256304323686903:11043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:38.494656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:38.494644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:38.495254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:38.495269Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:38.495272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:38.495275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:38.495282Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2027 [2:7556256301946786789:10781]
2025-10-01T14:13:38.495297Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:38.495316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:38.495319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.495322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.495324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.495340Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:38.495345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:38.495351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:38.495407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.495409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.495411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.495414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:38.495417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:38.495481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:38.495484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.495494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.495503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.495516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:38.495532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256301946786784:10781]
2025-10-01T14:13:38.495534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256301946786784:10781]
2025-10-01T14:13:38.495537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256301946786784:10781]
2025-10-01T14:13:38.495548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:38.495560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:38.495572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:38.495574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:38.495605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256301946786784:10781]
2025-10-01T14:13:38.495614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:38.495671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:38.495684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:38.495687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:38.495693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:38.495790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686944:11043], now have 1 active actors on pipe
2025-10-01T14:13:38.496287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2027
2025-10-01T14:13:38.496291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2027
2025-10-01T14:13:38.496333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686831:2446], now have 1 active actors on pipe
2025-10-01T14:13:38.496357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.496363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.496392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:38.496400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.496405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.496407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:38.496418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.496429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:38.496444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.501171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.501188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.501217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.501515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2028 partition: 0 MaxSeqNo: 45 sessionId: src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0
2025-10-01T14:13:38.502903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bc25103-c19af3e4-5efbce1a-d0f50312_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:38.506034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0] Write session: try to update token
2025-10-01T14:13:38.506051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:38.521022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2028 sessionId: src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:38.521136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:38.521161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:38.521164Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:38.521166Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:38.521175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256301946786784:10781]
2025-10-01T14:13:38.521179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256301946786784:10781]
2025-10-01T14:13:38.521183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256301946786784:10781]
2025-10-01T14:13:38.521234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:38.521238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:38.521244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:38.521246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.521247Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:38.521248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:38.521380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:38.523569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:38.573883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256304323686967:10880]
2025-10-01T14:13:38.574793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2027, pipe: [1:7556256304323686967:10880]
2025-10-01T14:13:38.683399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:38.683786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.683799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.683837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686967:10880], now have 1 active actors on pipe
2025-10-01T14:13:38.684070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:38.684086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:38.684108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:38.684100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:38.684147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2028 reason: error at write: Disconnected sessionId: src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0
2025-10-01T14:13:38.684163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256304323686967:10880]
2025-10-01T14:13:38.684528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:38.684538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0] Write session will restart in 0.006583s
2025-10-01T14:13:38.684567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0] Write session: Do CDS request
2025-10-01T14:13:38.684577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:38.684396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2028 sessionId: src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0 is DEAD
2025-10-01T14:13:38.691975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.692032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:38.692051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2029
2025-10-01T14:13:38.692228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.692263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:38.692273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:38.692280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:38.692686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2029 sessionId:  describe result for acl check
2025-10-01T14:13:38.692721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:38.692727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:38.692732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:38.692737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256304323687037:11049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:38.693252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256304323687037:11049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:38.693860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:38.695052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256304323687037:11049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:38.695890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:38.696081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:38.696094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:38.696103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:38.696147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:38.696183Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256301946786903:10784]
2025-10-01T14:13:38.696742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:38.697027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:38.697080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:38.697265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256304323687037:11049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:38.697289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256304323687037:11049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:38.697293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256304323687037:11049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:38.697299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:38.697406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:38.697458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.697465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.697466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.697468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.697469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.697470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.697471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.697472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.697473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.697474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.697476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.697477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.697478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.697478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.697483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.697492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.697496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.697500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.697503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.697506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.697510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.697514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.697518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.697521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.697524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.697527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.697531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.697534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.697540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.697547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.697553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.697557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.697561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.697565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.697568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.697573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.697577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.697581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.697584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.697589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.697594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.697598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.697602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.697606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.697616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.697620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.697624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.697632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.697636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.697640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.697644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.697648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.697652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.697656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.697665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.697669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.697705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:38.701574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:38.702362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:38.702395Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:38.702397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:38.702400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:38.702406Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2028 [2:7556256301946786903:10784]
2025-10-01T14:13:38.702421Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:38.702437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:38.702445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.702449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.702452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.702467Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:38.702477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:38.702483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:38.702543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.702549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.702551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.702553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:38.702555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:38.702623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:38.702631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.702640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.702650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.702662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:38.702680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323686970:2446], now have 1 active actors on pipe
2025-10-01T14:13:38.702688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323687081:11049], now have 1 active actors on pipe
2025-10-01T14:13:38.702695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256301946786897:10784]
2025-10-01T14:13:38.702697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256301946786897:10784]
2025-10-01T14:13:38.702700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256301946786897:10784]
2025-10-01T14:13:38.702714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:38.702729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:38.702708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2028
2025-10-01T14:13:38.702730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:38.702739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:38.702741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:38.702741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:38.702744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:38.702755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2028
2025-10-01T14:13:38.702777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256301946786897:10784]
2025-10-01T14:13:38.702788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:38.702801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.702801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:38.702809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.702850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a504766-67f358ec-63595fe2-fccc76d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:38.702861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.702865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.702867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:38.702876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.702889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:38.702908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.703028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.703037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.703050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.703235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2029 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a504766-67f358ec-63595fe2-fccc76d_0
2025-10-01T14:13:38.703650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|161478c5-b3cf7bbb-a0d20b95-1e08bc14_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a504766-67f358ec-63595fe2-fccc76d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:38.707219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a504766-67f358ec-63595fe2-fccc76d_0] Write session: try to update token
2025-10-01T14:13:38.707239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a504766-67f358ec-63595fe2-fccc76d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:38.724676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:38.724700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:38.724703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:38.724705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:38.724714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256301946786897:10784]
2025-10-01T14:13:38.724718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256301946786897:10784]
2025-10-01T14:13:38.724722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256301946786897:10784]
2025-10-01T14:13:38.724764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:38.724766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:38.724772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.724775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:38.724780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:38.724784Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:38.724936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:38.726515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2029 sessionId: src_id|6a504766-67f358ec-63595fe2-fccc76d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:38.729179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:38.784288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256304323687112:10880]
2025-10-01T14:13:38.784487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2028, pipe: [1:7556256304323687112:10880]
2025-10-01T14:13:38.879629Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:38.880052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.880069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.880114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323687112:10880], now have 1 active actors on pipe
2025-10-01T14:13:38.880315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:38.880397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:38.880456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256304323687112:10880]
2025-10-01T14:13:38.881142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:38.881218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2029 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a504766-67f358ec-63595fe2-fccc76d_0
2025-10-01T14:13:38.881439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2029 sessionId: src_id|6a504766-67f358ec-63595fe2-fccc76d_0 is DEAD
2025-10-01T14:13:38.881582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a504766-67f358ec-63595fe2-fccc76d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:38.881593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a504766-67f358ec-63595fe2-fccc76d_0] Write session will restart in 0.008699s
2025-10-01T14:13:38.881631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a504766-67f358ec-63595fe2-fccc76d_0] Write session: Do CDS request
2025-10-01T14:13:38.881637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a504766-67f358ec-63595fe2-fccc76d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:38.891983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a504766-67f358ec-63595fe2-fccc76d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.892364Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:38.892388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2030
2025-10-01T14:13:38.892645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:38.892688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:38.892695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:38.892700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:38.893185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2030 sessionId:  describe result for acl check
2025-10-01T14:13:38.893225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:38.893227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:38.893229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:38.893235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256304323687132:11060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:38.893819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256304323687132:11060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:38.896165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256304323687132:11060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:38.897626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:38.898445Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:13:38.900333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:38.900685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256304323687132:11060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:38.900710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256304323687132:11060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:38.900587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:38.900716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256304323687132:11060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:38.900592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:38.900783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:38.900619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:38.900678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:38.900723Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256301946787024:10788]
2025-10-01T14:13:38.901433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:38.902345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:38.902431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:38.902813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:38.902901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.902902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.902904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.902906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.902907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.902909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.902910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.902912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.902913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.902914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.902916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.902917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.902919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.902920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.902925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.902935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.902939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.902942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.902946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.902950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.902954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.902957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.902961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.902965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.902969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.902972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.902976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.902979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.902987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.902994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:38.903000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.903005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:38.903009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.903015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:38.903019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.903023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:38.903028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.903033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:38.903038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.903043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:38.903048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.903052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:38.903056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.903061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:38.903065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.903070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:38.903074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.903081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.903086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.903091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.903095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.903100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.903105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.903110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:38.903115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.903121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:38.903161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:38.912330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2029
2025-10-01T14:13:38.912370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2029
2025-10-01T14:13:38.910511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:38.911382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:38.911390Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:38.911394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:38.911399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:38.911409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2029 [2:7556256301946787024:10788]
2025-10-01T14:13:38.911431Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:38.911453Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:38.911457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.911461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.911465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.911483Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:38.911489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:38.911496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:38.911585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.911588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.911590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.911594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:38.911597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:38.911690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:38.911694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.911708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:38.911720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:38.911737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:38.911757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256301946787019:10788]
2025-10-01T14:13:38.911760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256301946787019:10788]
2025-10-01T14:13:38.911762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256301946787019:10788]
2025-10-01T14:13:38.911782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:38.911802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:38.911822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:38.911827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:38.911847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:38.911851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:38.911853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:38.911870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256301946787019:10788]
2025-10-01T14:13:38.911874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:38.911950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:38.912186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323687224:11060], now have 1 active actors on pipe
2025-10-01T14:13:38.912193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323687115:2446], now have 1 active actors on pipe
2025-10-01T14:13:38.912660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.912666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.912696Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:38.912706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:38.912712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:38.912714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:38.912726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:38.912739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:38.912756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.914180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:38.914203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:38.914227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:38.916504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2030 partition: 0 MaxSeqNo: 45 sessionId: src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0
2025-10-01T14:13:38.917045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a504766-67f358ec-63595fe2-fccc76d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:38.920759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0] Write session: try to update token
2025-10-01T14:13:38.920785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:38.943019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:38.943076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:38.943079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:38.943081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:38.943097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256301946787019:10788]
2025-10-01T14:13:38.943102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256301946787019:10788]
2025-10-01T14:13:38.943107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256301946787019:10788]
2025-10-01T14:13:38.943163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:38.943172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:38.943174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:38.943357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:38.944069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:38.944077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:38.944082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:38.957534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2030 sessionId: src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:38.960673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:38.982466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256304323687239:10880]
2025-10-01T14:13:38.982823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2029, pipe: [1:7556256304323687239:10880]
2025-10-01T14:13:39.099572Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:39.100160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.100169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.100192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256304323687239:10880], now have 1 active actors on pipe
2025-10-01T14:13:39.100442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:39.100677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:39.100776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2030 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0
2025-10-01T14:13:39.100929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2030 sessionId: src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0 is DEAD
2025-10-01T14:13:39.101046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:39.101061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256304323687239:10880]
2025-10-01T14:13:39.102160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:39.102171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0] Write session will restart in 0.006102s
2025-10-01T14:13:39.102212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0] Write session: Do CDS request
2025-10-01T14:13:39.102218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:39.110893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:39.114528Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:39.114549Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2031
2025-10-01T14:13:39.114711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:39.114737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:39.114744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:39.114748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:39.115232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2031 sessionId:  describe result for acl check
2025-10-01T14:13:39.115258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:39.115260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:39.115261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:39.115266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256308618654571:11065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:39.115831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256308618654571:11065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:39.122043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:39.122435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256308618654571:11065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:39.127038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256308618654571:11065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:39.127060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256308618654571:11065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:39.127064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256308618654571:11065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:39.127074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:39.129535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:39.129792Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:39.129804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:39.129816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:39.129872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:39.129917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256306241754451:10797]
2025-10-01T14:13:39.130554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:39.131183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:39.131278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:39.131694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:39.131780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.131790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.131792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.131793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.131794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.131795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.131797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.131799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.131800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.131801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.131802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.131804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.131806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.131807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.131813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.131823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.131826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.131830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.131834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.131838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.131842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.131845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.131848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.131852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.131856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.131859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.131863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.131866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.131875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.131884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.131890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.131895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.131900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.131905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.131912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.131917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.131922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.131927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.131931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.131936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.131940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.131946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.131950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.131954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.131959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.131964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.131967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.131973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.131977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.131982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.131989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.131993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.131998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.132003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.132009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.132014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.132055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:39.137066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:39.137746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:39.137751Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:39.137753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:39.137755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:39.137763Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2030 [2:7556256306241754451:10797]
2025-10-01T14:13:39.137777Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:39.137793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:39.137796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:39.137799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:39.137816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:39.137831Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:39.137836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:39.137842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:39.137888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.137890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.137892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.137894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:39.137897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:39.137960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:39.137962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.137972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.137982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.137996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:39.138011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256306241754445:10797]
2025-10-01T14:13:39.138014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256306241754445:10797]
2025-10-01T14:13:39.138016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256306241754445:10797]
2025-10-01T14:13:39.138024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:39.138036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:39.138048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:39.138051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:39.138078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256306241754445:10797]
2025-10-01T14:13:39.138079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:39.138397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:39.138405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:39.138407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:39.138412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:39.138974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2030
2025-10-01T14:13:39.139028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2030
2025-10-01T14:13:39.139193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654647:11065], now have 1 active actors on pipe
2025-10-01T14:13:39.139202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654537:2446], now have 1 active actors on pipe
2025-10-01T14:13:39.139345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.139353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.139379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57481929-aefc0945-f8803fc8-b90057b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:39.139386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:39.139390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:39.139393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:39.139402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:39.139412Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:39.139425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:39.142166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.142177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.142202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:39.144357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2031 partition: 0 MaxSeqNo: 45 sessionId: src_id|57481929-aefc0945-f8803fc8-b90057b7_0
2025-10-01T14:13:39.145018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ccfbff2-a2e82d51-9e00a70c-bd2837ff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|57481929-aefc0945-f8803fc8-b90057b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:39.148500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57481929-aefc0945-f8803fc8-b90057b7_0] Write session: try to update token
2025-10-01T14:13:39.148519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57481929-aefc0945-f8803fc8-b90057b7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:39.164879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:39.164901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:39.164905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:39.164907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:39.164918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256306241754445:10797]
2025-10-01T14:13:39.164924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256306241754445:10797]
2025-10-01T14:13:39.164928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256306241754445:10797]
2025-10-01T14:13:39.164981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:39.164988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.164991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:39.165144Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:39.166422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:39.166439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:39.166443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:39.172883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2031 sessionId: src_id|57481929-aefc0945-f8803fc8-b90057b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:39.176191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:39.204532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256308618654660:10880]
2025-10-01T14:13:39.205000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2030, pipe: [1:7556256308618654660:10880]
2025-10-01T14:13:39.326280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:39.327214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.327229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.327272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654660:10880], now have 1 active actors on pipe
2025-10-01T14:13:39.330660Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:39.335315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:39.335413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2031 reason: status is not ok: tablet will be restarted right now sessionId: src_id|57481929-aefc0945-f8803fc8-b90057b7_0
2025-10-01T14:13:39.335614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2031 sessionId: src_id|57481929-aefc0945-f8803fc8-b90057b7_0 is DEAD
2025-10-01T14:13:39.335746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:39.335778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256308618654660:10880]
2025-10-01T14:13:39.339230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57481929-aefc0945-f8803fc8-b90057b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:39.339241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57481929-aefc0945-f8803fc8-b90057b7_0] Write session will restart in 0.009161s
2025-10-01T14:13:39.339270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57481929-aefc0945-f8803fc8-b90057b7_0] Write session: Do CDS request
2025-10-01T14:13:39.339277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57481929-aefc0945-f8803fc8-b90057b7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:39.350805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57481929-aefc0945-f8803fc8-b90057b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:39.354950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:39.354965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2032
2025-10-01T14:13:39.358491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:39.358538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:39.358545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:39.358549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:39.359521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2032 sessionId:  describe result for acl check
2025-10-01T14:13:39.359579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:39.359581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:39.359583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:39.359590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256308618654737:11069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:39.360181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256308618654737:11069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:39.366129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256308618654737:11069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:39.370632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256308618654737:11069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:39.370647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256308618654737:11069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:39.370650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256308618654737:11069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:39.370658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:39.370402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:39.370627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:39.370797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:39.370801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:39.370811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:39.370845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:39.370877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256306241754593:10804]
2025-10-01T14:13:39.371477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:39.375174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:39.375233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:39.375627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:39.375673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.375674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.375675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.375675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.375676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.375677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.375678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.375679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.375679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.375680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.375681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.375682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.375683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.375684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.375688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.375694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.375696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.375698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.375700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.375702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.375705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.375707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.375709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.375712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.375714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.375716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.375718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.375720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.375726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.375732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.375736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.375739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.375742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.375745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.375748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.375751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.375753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.375756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.375759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.375762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.375765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.375768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.375770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.375773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.375776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.375779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.375782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.375785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.375788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.375791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.375795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.375797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.375801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.375803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.375806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.375809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.375830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:39.382806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:39.383543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:39.383548Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:39.383551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:39.383554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:39.383561Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2031 [2:7556256306241754593:10804]
2025-10-01T14:13:39.383581Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:39.383599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:39.383602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:39.383606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:39.383608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:39.383624Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:39.383630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:39.383637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:39.383694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.383696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.383698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.383702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:39.383705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:39.383918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:39.383921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.383932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.383944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.383961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:39.383979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654773:11069], now have 1 active actors on pipe
2025-10-01T14:13:39.383982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654663:2446], now have 1 active actors on pipe
2025-10-01T14:13:39.383990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256306241754587:10804]
2025-10-01T14:13:39.383992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256306241754587:10804]
2025-10-01T14:13:39.383994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256306241754587:10804]
2025-10-01T14:13:39.384008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:39.384024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:39.384038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:39.384040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:39.384074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256306241754587:10804]
2025-10-01T14:13:39.384076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:39.384167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:39.384170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:39.384172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:39.384178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:39.384403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2031
2025-10-01T14:13:39.384440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2031
2025-10-01T14:13:39.386883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.386901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.386935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84bfca22-87846181-fe9522b5-9c7434fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:39.386945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:39.386950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:39.386952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:39.386963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:39.386976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:39.386994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:39.398421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.398443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.398482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:39.402515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2032 partition: 0 MaxSeqNo: 45 sessionId: src_id|84bfca22-87846181-fe9522b5-9c7434fd_0
2025-10-01T14:13:39.403046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57481929-aefc0945-f8803fc8-b90057b7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84bfca22-87846181-fe9522b5-9c7434fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:39.406450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84bfca22-87846181-fe9522b5-9c7434fd_0] Write session: try to update token
2025-10-01T14:13:39.406470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84bfca22-87846181-fe9522b5-9c7434fd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:39.422390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:39.422410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:39.422413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:39.422416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:39.422427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256306241754587:10804]
2025-10-01T14:13:39.422432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256306241754587:10804]
2025-10-01T14:13:39.422436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256306241754587:10804]
2025-10-01T14:13:39.422485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:39.422492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.422495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:39.422652Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:39.426587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:39.426593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:39.426596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:39.441361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2032 sessionId: src_id|84bfca22-87846181-fe9522b5-9c7434fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:39.444319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:39.445337Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256308618654785:10880]
2025-10-01T14:13:39.445580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2031, pipe: [1:7556256308618654785:10880]
2025-10-01T14:13:39.588768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bfca22-87846181-fe9522b5-9c7434fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:39.588784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bfca22-87846181-fe9522b5-9c7434fd_0] Write session will restart in 0.009288s
2025-10-01T14:13:39.588813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bfca22-87846181-fe9522b5-9c7434fd_0] Write session: Do CDS request
2025-10-01T14:13:39.588819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bfca22-87846181-fe9522b5-9c7434fd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:39.588086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256308618654785:10880]
2025-10-01T14:13:39.588119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:39.588121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:39.588182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2032 reason: error at write: Disconnected sessionId: src_id|84bfca22-87846181-fe9522b5-9c7434fd_0
2025-10-01T14:13:39.588412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2032 sessionId: src_id|84bfca22-87846181-fe9522b5-9c7434fd_0 is DEAD
2025-10-01T14:13:39.588535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:39.587110Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:39.587409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.587419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.587443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654785:10880], now have 1 active actors on pipe
2025-10-01T14:13:39.589697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:39.602829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84bfca22-87846181-fe9522b5-9c7434fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:39.606520Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:39.606536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2033
2025-10-01T14:13:39.606738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:39.606767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:39.606772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:39.606776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:39.610750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2033 sessionId:  describe result for acl check
2025-10-01T14:13:39.610794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:39.610795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:39.610800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:39.610806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256308618654824:11075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:39.611320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256308618654824:11075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:39.631251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256308618654824:11075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:39.631780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:39.634313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:39.634543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:39.634547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:39.634559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:39.634604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:39.634637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256306241754711:10806]
2025-10-01T14:13:39.635397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:39.635734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:39.635774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:39.636056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:39.636102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.636103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.636104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.636104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.636105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.636107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.636108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.636109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.636110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.636111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.636112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.636113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.636114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.636115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.636119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.636128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.636132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.636135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.636138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.636142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.636145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.636149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.636152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.636156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.636159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.636163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.636165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.636169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.636177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.636183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.636203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.636207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.636212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.636217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.636220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.636224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.636229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.636233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.636236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.636241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.636247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.636251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.636254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.636260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.636264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.636268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.636271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.636276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.636280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.636285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.636289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.636294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.636299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.636303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.636307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.636311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.636347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:39.641556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:39.642361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:39.642365Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:39.642368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:39.642387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:39.642394Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2032 [2:7556256306241754711:10806]
2025-10-01T14:13:39.642412Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:39.642430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:39.642434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:39.642437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:39.642440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:39.642458Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:39.642465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:39.642470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:39.642528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.642530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.642531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.642534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:39.642537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:39.642604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:39.642607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.642617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.642625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.642638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:39.642654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256306241754706:10806]
2025-10-01T14:13:39.642656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256306241754706:10806]
2025-10-01T14:13:39.642657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256306241754706:10806]
2025-10-01T14:13:39.642668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:39.642683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:39.642695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:39.642697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:39.642728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256306241754706:10806]
2025-10-01T14:13:39.642730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:39.642803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:39.642806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:39.642807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:39.642811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:39.646892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654808:2446], now have 1 active actors on pipe
2025-10-01T14:13:39.646554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2032
2025-10-01T14:13:39.646958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256308618654824:11075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:39.646966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256308618654824:11075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:39.646969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256308618654824:11075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:39.646978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:39.648858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654928:11075], now have 1 active actors on pipe
2025-10-01T14:13:39.650741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2032
2025-10-01T14:13:39.652373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.652390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.652430Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8b3a017-10907406-a871d73c-ca13c76a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:39.652441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:39.652448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:39.652451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:39.652464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:39.652482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:39.652503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:39.652979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.652993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.653015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:39.653163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2033 partition: 0 MaxSeqNo: 45 sessionId: src_id|f8b3a017-10907406-a871d73c-ca13c76a_0
2025-10-01T14:13:39.653725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84bfca22-87846181-fe9522b5-9c7434fd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f8b3a017-10907406-a871d73c-ca13c76a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:39.656985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b3a017-10907406-a871d73c-ca13c76a_0] Write session: try to update token
2025-10-01T14:13:39.657004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b3a017-10907406-a871d73c-ca13c76a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:39.677609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2033 sessionId: src_id|f8b3a017-10907406-a871d73c-ca13c76a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:39.671259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:39.671284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:39.671287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:39.671289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:39.671301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256306241754706:10806]
2025-10-01T14:13:39.671305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256306241754706:10806]
2025-10-01T14:13:39.671310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256306241754706:10806]
2025-10-01T14:13:39.671364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:39.671372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.671374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:39.671533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:39.673458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:39.673464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:39.673467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:39.680284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:39.688988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256308618654933:10880]
2025-10-01T14:13:39.689450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2032, pipe: [1:7556256308618654933:10880]
2025-10-01T14:13:39.833210Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:39.833568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.833585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.833631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654933:10880], now have 1 active actors on pipe
2025-10-01T14:13:39.834308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:39.834553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256308618654933:10880]
2025-10-01T14:13:39.834578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:39.834603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:39.834604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:39.834653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2033 reason: error at write: Disconnected sessionId: src_id|f8b3a017-10907406-a871d73c-ca13c76a_0
2025-10-01T14:13:39.834838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2033 sessionId: src_id|f8b3a017-10907406-a871d73c-ca13c76a_0 is DEAD
2025-10-01T14:13:39.838719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b3a017-10907406-a871d73c-ca13c76a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:39.838731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b3a017-10907406-a871d73c-ca13c76a_0] Write session will restart in 0.008038s
2025-10-01T14:13:39.838762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b3a017-10907406-a871d73c-ca13c76a_0] Write session: Do CDS request
2025-10-01T14:13:39.838769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b3a017-10907406-a871d73c-ca13c76a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:39.849010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b3a017-10907406-a871d73c-ca13c76a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:39.849475Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:39.849490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2034
2025-10-01T14:13:39.849583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:39.849609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:39.849614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:39.849617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:39.850067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2034 sessionId:  describe result for acl check
2025-10-01T14:13:39.850101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:39.850102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:39.850104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:39.850109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256308618655013:11086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:39.850584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256308618655013:11086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:39.852430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:39.852906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256308618655013:11086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:39.860528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256308618655013:11086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:39.860546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256308618655013:11086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:39.860549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256308618655013:11086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:39.860558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:39.861398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:39.861630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:39.861638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:39.861658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:39.861712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:39.861750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256306241754838:10811]
2025-10-01T14:13:39.862321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:39.862684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:39.862727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:39.863024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:39.863076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.863077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.863078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.863079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.863080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.863092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.863093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.863095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.863096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.863097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.863098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.863099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.863100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.863101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.863106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.863116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.863120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.863124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.863128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.863131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.863135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.863139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.863142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.863147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.863150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.863154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.863158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.863161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.863169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.863176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:39.863182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.863187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:39.863190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.863196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:39.863200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.863205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:39.863211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.863216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:39.863220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.863224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:39.863230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.863235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:39.863239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.863244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:39.863248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.863253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:39.863257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.863261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.863266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.863270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.863274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.863279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.863283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.863289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:39.863293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.863298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:39.863335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:39.867874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:39.868579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:39.868584Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:39.868985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2033
2025-10-01T14:13:39.869023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2033
2025-10-01T14:13:39.868587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:39.868590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:39.868607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2033 [2:7556256306241754838:10811]
2025-10-01T14:13:39.868622Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:39.868638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:39.868641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:39.868645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:39.868647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:39.868663Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:39.868669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:39.868675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:39.868732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.868734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.868735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.868740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:39.868742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:39.868809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:39.868811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.868823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:39.868833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:39.868846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:39.868862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256306241754832:10811]
2025-10-01T14:13:39.868865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256306241754832:10811]
2025-10-01T14:13:39.868867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256306241754832:10811]
2025-10-01T14:13:39.868875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:39.868888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:39.868899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:39.868901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:39.868903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:39.868904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:39.868906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:39.868936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618654961:2446], now have 1 active actors on pipe
2025-10-01T14:13:39.868939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618655071:11086], now have 1 active actors on pipe
2025-10-01T14:13:39.868941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256306241754832:10811]
2025-10-01T14:13:39.868951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:39.868959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:39.869478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.869491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.869517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:39.869529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:39.869538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:39.869542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:39.869555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:39.869572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:39.869591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:39.870076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:39.870089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:39.870107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:39.870401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2034 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0
2025-10-01T14:13:39.874493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8b3a017-10907406-a871d73c-ca13c76a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:39.877640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0] Write session: try to update token
2025-10-01T14:13:39.877655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:39.900103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:39.900128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:39.900131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:39.900134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:39.900144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256306241754832:10811]
2025-10-01T14:13:39.900150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256306241754832:10811]
2025-10-01T14:13:39.900154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256306241754832:10811]
2025-10-01T14:13:39.900205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:39.900212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:39.900215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:39.900352Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:39.905187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:39.905215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:39.905220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:39.908136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2034 sessionId: src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:39.910875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:39.935266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256308618655085:10880]
2025-10-01T14:13:39.937048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2033, pipe: [1:7556256308618655085:10880]
2025-10-01T14:13:40.076223Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:40.076948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.076960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.077007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256308618655085:10880], now have 1 active actors on pipe
2025-10-01T14:13:40.077584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:40.077473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:40.077492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:40.077570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2034 reason: error at write: Disconnected sessionId: src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0
2025-10-01T14:13:40.077821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2034 sessionId: src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0 is DEAD
2025-10-01T14:13:40.078026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256308618655085:10880]
2025-10-01T14:13:40.078029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:40.078579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:40.078589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0] Write session will restart in 0.007242s
2025-10-01T14:13:40.078625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0] Write session: Do CDS request
2025-10-01T14:13:40.078632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:40.086827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:40.087121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:40.087135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2035
2025-10-01T14:13:40.087272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:40.087292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:40.087295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:40.087298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:40.088657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2035 sessionId:  describe result for acl check
2025-10-01T14:13:40.088686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:40.088687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:40.088688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:40.088692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256312913622394:11091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:40.089140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256312913622394:11091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:40.097073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256312913622394:11091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:40.105713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256312913622394:11091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:40.105731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256312913622394:11091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:40.105735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256312913622394:11091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:40.105745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:40.126451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:40.127036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:40.127247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:40.127251Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:40.127264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:40.127316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:40.127384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256310536722255:10813]
2025-10-01T14:13:40.128094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:40.134576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:40.134686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:40.135114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:40.135176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.135177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.135178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.135180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.135181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.135182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.135184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.135185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.135186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.135188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.135190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.135191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.135192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.135194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.135201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.135211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.135215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.135218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.135222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.135226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.135229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.135233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.135236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.135240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.135244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.135247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.135251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.135254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.135265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.135273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.135280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.135284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.135292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.135297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.135302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.135306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.135311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.135317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.135321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.135326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.135330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.135336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.135340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.135344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.135350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.135356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.135361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.135366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.135372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.135377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.135381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.135389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.135393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.135398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.135401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.135407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.135441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:40.149008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:40.150301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:40.150309Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:40.150312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:40.150317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:40.150325Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2034 [2:7556256310536722255:10813]
2025-10-01T14:13:40.150345Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:40.150367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:40.150388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:40.150393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:40.150396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:40.150416Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:40.150422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:40.150429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:40.150509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.150512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.150514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.150518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:40.150522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:40.150606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:40.150608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.150623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.150635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.150654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:40.150674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256310536722249:10813]
2025-10-01T14:13:40.150677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256310536722249:10813]
2025-10-01T14:13:40.150679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256310536722249:10813]
2025-10-01T14:13:40.150693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:40.150714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:40.150728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:40.150731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:40.150731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:40.150733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:40.150734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:40.150797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256310536722249:10813]
2025-10-01T14:13:40.150810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:40.150825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622470:11091], now have 1 active actors on pipe
2025-10-01T14:13:40.150830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622386:2446], now have 1 active actors on pipe
2025-10-01T14:13:40.151364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2034
2025-10-01T14:13:40.151401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2034
2025-10-01T14:13:40.154697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:40.155812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.155830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.155878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:40.155893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:40.155900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:40.155903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:40.155917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:40.155936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:40.155964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:40.170171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.170195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.170237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:40.173490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2035 partition: 0 MaxSeqNo: 45 sessionId: src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0
2025-10-01T14:13:40.179067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a77ce28-efa0331c-358feadd-4e409ecb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:40.179158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256312913622511:10880]
2025-10-01T14:13:40.180484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2034, pipe: [1:7556256312913622511:10880]
2025-10-01T14:13:40.182430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622511:10880], now have 1 active actors on pipe
2025-10-01T14:13:40.183087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0] Write session: try to update token
2025-10-01T14:13:40.183110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:40.209212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2035 sessionId: src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:40.214193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:40.214721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.214747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.216912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:40.216938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:40.216941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:40.216943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:40.216945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:40.216954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256310536722249:10813]
2025-10-01T14:13:40.216962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256310536722249:10813]
2025-10-01T14:13:40.216966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256310536722249:10813]
2025-10-01T14:13:40.217010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:40.217017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.217019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:40.217166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:40.218051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:40.218057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:40.218062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:40.218120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:40.373731Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:40.381549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.381584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.381769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.381837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.381890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.381942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.382410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.382420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.382494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.382559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.382625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.382695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.382769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.382779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.382841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.382897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.382960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.383024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.383064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.383071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.383133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.383230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.383296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.383355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.383561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.383569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.383630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.383711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.383799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.383862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.383909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.383915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.383978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.384037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.384102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.384168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.384317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.384324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.384390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.384451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.384509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.384573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.384632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.384639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.384702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.384764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.384828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.384892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.384935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.384942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.385011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.385073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.385135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.385199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.385248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.385255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.385325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.385389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.385459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.385523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.385567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.385574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.386648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:40.386967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:40.387029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256312913622511:10880]
2025-10-01T14:13:40.387055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:40.387063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:40.387088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2035 reason: error at write: Disconnected sessionId: src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0
2025-10-01T14:13:40.387637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2035 sessionId: src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0 is DEAD
2025-10-01T14:13:40.390626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:40.390640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0] Write session will restart in 0.007240s
2025-10-01T14:13:40.390669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0] Write session: Do CDS request
2025-10-01T14:13:40.390675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:40.399685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:40.402650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:40.402672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2036
2025-10-01T14:13:40.402855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:40.402885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:40.402891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:40.402895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:40.405852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2036 sessionId:  describe result for acl check
2025-10-01T14:13:40.405895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:40.405900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:40.405902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:40.405909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256312913622527:11095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:40.406438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256312913622527:11095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:40.414550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256312913622527:11095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:40.419625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256312913622527:11095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:40.419644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256312913622527:11095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:40.419648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256312913622527:11095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:40.419661Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:40.432510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:40.436034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:40.436477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:40.436491Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:40.436507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:40.436575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:40.436635Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256310536722417:10827]
2025-10-01T14:13:40.437269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:40.439760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:40.439847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:40.440271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:40.440337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.440338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.440339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.440340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.440341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.440343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.440344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.440345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.440347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.440348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.440350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.440351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.440352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.440353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.440369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.440380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.440385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.440389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.440393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.440397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.440401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.440405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.440409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.440414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.440418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.440421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.440426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.440430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.440439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.440448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.440455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.440460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.440465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.440471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.440475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.440480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.440485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.440490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.440495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.440500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.440505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.440510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.440515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.440520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.440526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.440531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.440537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.440542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.440547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.440553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.440558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.440564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.440568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.440574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.440578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.440583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.440650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:40.449134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:40.449832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:40.449852Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:40.449855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:40.449860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:40.449868Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2035 [2:7556256310536722417:10827]
2025-10-01T14:13:40.449887Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:40.449909Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:40.449911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:40.449916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:40.449919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:40.449940Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:40.449947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:40.449953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:40.450024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.450026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.450028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.450031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:40.450034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:40.450117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:40.450120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.450133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.450144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.450159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:40.450176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256310536722412:10827]
2025-10-01T14:13:40.450178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256310536722412:10827]
2025-10-01T14:13:40.450180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256310536722412:10827]
2025-10-01T14:13:40.450193Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:40.450209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:40.450223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:40.450227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:40.450273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256310536722412:10827]
2025-10-01T14:13:40.450280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:40.450394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:40.450397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:40.450399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:40.450403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:40.450872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622577:11095], now have 1 active actors on pipe
2025-10-01T14:13:40.450877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622518:2446], now have 1 active actors on pipe
2025-10-01T14:13:40.450962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2035
2025-10-01T14:13:40.450997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2035
2025-10-01T14:13:40.451207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.451220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.451251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:40.451260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:40.451265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:40.451267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:40.451279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:40.451292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:40.451311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:40.451677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.451684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.451700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:40.451829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2036 partition: 0 MaxSeqNo: 45 sessionId: src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0
2025-10-01T14:13:40.454664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c24c6a3d-5f525381-4ecceb78-5b9aa737_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:40.457954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0] Write session: try to update token
2025-10-01T14:13:40.457976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:40.485279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:40.485300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:40.485303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:40.485306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:40.485315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256310536722412:10827]
2025-10-01T14:13:40.485320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256310536722412:10827]
2025-10-01T14:13:40.485324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256310536722412:10827]
2025-10-01T14:13:40.485377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:40.485386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.485389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:40.485521Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:40.486423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:40.486430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:40.486436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:40.488438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256312913622649:10880]
2025-10-01T14:13:40.490493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2036 sessionId: src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:40.493323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:40.493415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2035, pipe: [1:7556256312913622649:10880]
2025-10-01T14:13:40.639500Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:40.640080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622649:10880], now have 1 active actors on pipe
2025-10-01T14:13:40.640796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:40.640112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.640120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.640770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:40.640820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:40.640875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2036 reason: error at write: Disconnected sessionId: src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0
2025-10-01T14:13:40.641092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2036 sessionId: src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0 is DEAD
2025-10-01T14:13:40.641219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256312913622649:10880]
2025-10-01T14:13:40.641232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:40.642656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:40.642669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0] Write session will restart in 0.005614s
2025-10-01T14:13:40.642697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0] Write session: Do CDS request
2025-10-01T14:13:40.642704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:40.650790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:40.651112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:40.651128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2037
2025-10-01T14:13:40.654470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:40.654515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:40.654520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:40.654524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:40.654933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2037 sessionId:  describe result for acl check
2025-10-01T14:13:40.654967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:40.654969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:40.654971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:40.654976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256312913622677:11101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:40.655490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256312913622677:11101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:40.657669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256312913622677:11101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:40.663022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256312913622677:11101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:40.663041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256312913622677:11101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:40.663046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256312913622677:11101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:40.663056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:40.674343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:40.677345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:40.677597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:40.677601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:40.677612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:40.677657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:40.677693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256310536722540:10829]
2025-10-01T14:13:40.678271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:40.678667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:40.678713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:40.679018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:40.679078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.679079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.679081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.679082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.679083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.679084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.679085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.679086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.679088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.679089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.679090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.679091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.679092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.679095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.679099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.679108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.679111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.679115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.679118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.679121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.679124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.679128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.679131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.679134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.679138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.679141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.679144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.679147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.679154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.679160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.679166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.679170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.679176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.679180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.679183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.679187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.679192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.679196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.679200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.679205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.679209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.679213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.679217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.679221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.679227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.679232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.679235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.679239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.679243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.679247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.679250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.679254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.679261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.679265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.679269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.679273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.679309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:40.689840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:40.690788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:40.690806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:40.690809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:40.690812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:40.690819Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2036 [2:7556256310536722540:10829]
2025-10-01T14:13:40.690835Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:40.690853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:40.690861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:40.690864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:40.690869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:40.690890Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:40.690900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:40.690906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:40.690971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.690977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.690979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.690983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:40.690985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:40.691060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:40.691066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.691076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.691085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.691097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:40.691115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256310536722533:10829]
2025-10-01T14:13:40.691117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256310536722533:10829]
2025-10-01T14:13:40.691119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256310536722533:10829]
2025-10-01T14:13:40.691128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:40.691137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:40.691139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:40.691141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:40.691144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622669:2446], now have 1 active actors on pipe
2025-10-01T14:13:40.691148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622718:11101], now have 1 active actors on pipe
2025-10-01T14:13:40.691155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:40.691167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:40.691169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:40.691209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256310536722533:10829]
2025-10-01T14:13:40.691215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:40.691276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:40.691816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.691822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.691860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1de51703-97241417-a49c6e1-1bfaeb12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:40.691869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:40.691872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:40.691875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:40.691884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:40.691895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:40.691910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:40.692190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.692201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.692215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:40.692685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e11b35eb-d2f6b819-ae389c21-6e3dac24_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1de51703-97241417-a49c6e1-1bfaeb12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:40.691591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2036
2025-10-01T14:13:40.691636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2036
2025-10-01T14:13:40.692310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2037 partition: 0 MaxSeqNo: 45 sessionId: src_id|1de51703-97241417-a49c6e1-1bfaeb12_0
2025-10-01T14:13:40.696147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de51703-97241417-a49c6e1-1bfaeb12_0] Write session: try to update token
2025-10-01T14:13:40.696163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de51703-97241417-a49c6e1-1bfaeb12_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:40.735363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.735387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.735440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:40.732306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2037 sessionId: src_id|1de51703-97241417-a49c6e1-1bfaeb12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:40.735148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:40.736797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:40.739723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:40.739744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:40.739746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:40.739748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:40.739758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256310536722533:10829]
2025-10-01T14:13:40.739762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256310536722533:10829]
2025-10-01T14:13:40.739765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256310536722533:10829]
2025-10-01T14:13:40.739810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:40.739822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.739825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:40.739997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:40.740558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:40.740564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:40.740570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:40.742005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256312913622798:10880]
2025-10-01T14:13:40.742766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2036, pipe: [1:7556256312913622798:10880]
2025-10-01T14:13:40.894712Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:40.895080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622798:10880], now have 1 active actors on pipe
2025-10-01T14:13:40.904014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.904046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.904228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.904287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.904346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.904413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.904458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.904463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.904534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.904590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.904671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.904739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.904781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.904785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.904851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.904902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.904962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.905021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.905066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.905069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.905134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.905462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.905522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.905581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.905618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.905621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.905683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.905738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.905791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.905850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.905907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.905910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.905976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.906032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.906094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.906155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.906196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.906199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.906263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.906319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.906410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.906489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.906535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.906538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.906619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.906733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.906811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.906894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.906944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.906947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.907029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.907091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.907156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.907218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.907264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.907267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.907343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:40.907402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:40.907466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:40.907529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:40.907649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:40.907652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:40.908645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:40.910678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de51703-97241417-a49c6e1-1bfaeb12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:40.910689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de51703-97241417-a49c6e1-1bfaeb12_0] Write session will restart in 0.006232s
2025-10-01T14:13:40.910715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de51703-97241417-a49c6e1-1bfaeb12_0] Write session: Do CDS request
2025-10-01T14:13:40.910721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de51703-97241417-a49c6e1-1bfaeb12_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:40.908062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256312913622798:10880]
2025-10-01T14:13:40.908106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:40.908143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:40.908146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:40.908171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2037 reason: error at write: Disconnected sessionId: src_id|1de51703-97241417-a49c6e1-1bfaeb12_0
2025-10-01T14:13:40.908400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2037 sessionId: src_id|1de51703-97241417-a49c6e1-1bfaeb12_0 is DEAD
2025-10-01T14:13:40.918913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1de51703-97241417-a49c6e1-1bfaeb12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:40.919469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:40.919485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2038
2025-10-01T14:13:40.922931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:40.922992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:40.922998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:40.923002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:40.923404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2038 sessionId:  describe result for acl check
2025-10-01T14:13:40.923436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:40.923437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:40.923439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:40.923445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256312913622844:11113] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:40.923992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256312913622844:11113] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:40.927824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256312913622844:11113] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:40.931330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256312913622844:11113] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:40.931348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256312913622844:11113] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:40.931356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256312913622844:11113] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:40.931366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:40.931537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:40.934275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:40.934634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:40.934639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:40.934654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:40.934715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:40.934757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256310536722669:10834]
2025-10-01T14:13:40.935333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:40.935754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:40.935800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:40.936099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:40.936162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.936163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.936164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.936165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.936166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.936168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.936169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.936170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.936171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.936172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.936173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.936174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.936175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.936176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.936181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.936189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.936192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.936196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.936199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.936203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.936206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.936210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.936214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.936217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.936220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.936224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.936227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.936230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.936237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.936244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:40.936250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.936254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:40.936260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.936265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:40.936269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.936273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:40.936277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.936282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:40.936286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.936290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:40.936295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.936300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:40.936304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.936309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:40.936314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.936319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:40.936323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.936328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.936333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.936338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.936343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.936348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.936353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.936358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:40.936363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.936368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:40.936407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:40.943656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:40.944339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:40.944357Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:40.944361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:40.944364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:40.944373Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2037 [2:7556256310536722669:10834]
2025-10-01T14:13:40.944389Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:40.944407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:40.944418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:40.944421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:40.944423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:40.944440Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:40.944445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:40.944452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:40.944513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.944516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.944518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.944521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:40.944523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:40.944590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:40.944592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.944617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:40.944627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:40.944640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:40.944656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256310536722663:10834]
2025-10-01T14:13:40.944659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256310536722663:10834]
2025-10-01T14:13:40.944661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256310536722663:10834]
2025-10-01T14:13:40.944675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:40.944689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:40.944699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:40.944703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:40.944703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:40.944705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:40.944706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:40.944743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256310536722663:10834]
2025-10-01T14:13:40.944746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:40.944811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:40.945082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622941:11113], now have 1 active actors on pipe
2025-10-01T14:13:40.945090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256312913622826:2446], now have 1 active actors on pipe
2025-10-01T14:13:40.945192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.945199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.945224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:40.945231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:40.945236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:40.945238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:40.945248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:40.945257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:40.945272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:40.944957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2037
2025-10-01T14:13:40.944994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2037
2025-10-01T14:13:40.948612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.948629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.948662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:40.948846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2038 partition: 0 MaxSeqNo: 45 sessionId: src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0
2025-10-01T14:13:40.951235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1de51703-97241417-a49c6e1-1bfaeb12_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:40.954194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0] Write session: try to update token
2025-10-01T14:13:40.954212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:40.963930Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:40.964035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:40.964052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256310536722663:10834]
2025-10-01T14:13:40.964094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:40.964281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:40.964431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:40.964575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:40.964669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:40.964856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:40.965048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:40.965083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:40.972224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2038 sessionId: src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:40.975159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:40.975413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:40.975442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:40.975501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:40.975689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:40.991003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:40.991023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:40.991025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:40.991027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:40.991035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256310536722663:10834]
2025-10-01T14:13:40.991038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256310536722663:10834]
2025-10-01T14:13:40.991041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256310536722663:10834]
2025-10-01T14:13:40.991080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:40.991086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:40.991087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:40.991092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:40.991092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:40.991098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:40.991216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:41.007937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256317208590251:10880]
2025-10-01T14:13:41.008239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2037, pipe: [1:7556256317208590251:10880]
2025-10-01T14:13:41.131826Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:41.138662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.138687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.138823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.138879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.138935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.138991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.139034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.139041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.139103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.139158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.139210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.139268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.139309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.139314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.139368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.139421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.139478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.139531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.139574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.139581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.139644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.139707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.139760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.139812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.139849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.139856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.139911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.139963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.140020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.140073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.140120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.140129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.140184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.140233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.140286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.140338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.140376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.140381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.140438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.140488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.140546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.140614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.140671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.140677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.140733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.140793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.140850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.140908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.140962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.140967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.141024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.141077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.141141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.141200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.141246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.141252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.141305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.141357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.141415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.141473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.141512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.141517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.141558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590251:10880], now have 1 active actors on pipe
2025-10-01T14:13:41.141815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:41.141826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256317208590251:10880]
2025-10-01T14:13:41.141828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:41.141840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:41.141850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2038 reason: error at write: Disconnected sessionId: src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0
2025-10-01T14:13:41.142051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2038 sessionId: src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0 is DEAD
2025-10-01T14:13:41.142311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:41.142322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0] Write session will restart in 0.007336s
2025-10-01T14:13:41.142347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0] Write session: Do CDS request
2025-10-01T14:13:41.142353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:41.142427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:41.150685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:41.150889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:41.150993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:41.151007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2039
2025-10-01T14:13:41.151111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:41.151140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:41.151150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:41.151153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:41.151924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2039 sessionId:  describe result for acl check
2025-10-01T14:13:41.151948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:41.151949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:41.151950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:41.151954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256317208590337:11117] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:41.152326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256317208590337:11117] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:41.152433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:41.152622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:41.152634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:41.152648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:41.152711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:41.152751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256314831690088:10837]
2025-10-01T14:13:41.153300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:41.153530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:41.153577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:41.153865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:41.153931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.153937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.153938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.153939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.153940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.153941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.153942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.153944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.153945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.153946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.153947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.153948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.153949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.153950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.153954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.153963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.153966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.153970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.153974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.153978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.153981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.153984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.153988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.153992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.153995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.153999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.154003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.154006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.154012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.154018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.154024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.154029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.154033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.154037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.154041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.154046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.154054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.154058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.154066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.154070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.154076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.154079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.154081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.154087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.154089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.154092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.154097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.154100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.154102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.154105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.154110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.154113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.154116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.154119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.154122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.154125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.154146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:41.154330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256317208590337:11117] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:41.157524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:41.157554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256317208590337:11117] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:41.157568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256317208590337:11117] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:41.157571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256317208590337:11117] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:41.157579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:41.158121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:41.158134Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:41.158136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:41.158138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:41.158142Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2038 [2:7556256314831690088:10837]
2025-10-01T14:13:41.158152Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:41.158162Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:41.158164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:41.158166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:41.158167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:41.158177Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:41.158180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:41.158183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:41.158218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.158223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.158224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.158226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:41.158228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:41.158272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:41.158279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.158286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.158292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.158300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:41.158312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590253:2446], now have 1 active actors on pipe
2025-10-01T14:13:41.158319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590376:11117], now have 1 active actors on pipe
2025-10-01T14:13:41.158323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256314831690083:10837]
2025-10-01T14:13:41.158326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256314831690083:10837]
2025-10-01T14:13:41.158327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256314831690083:10837]
2025-10-01T14:13:41.158335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:41.158344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:41.158346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:41.158348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:41.158350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:41.158356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:41.158357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:41.158350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2038
2025-10-01T14:13:41.158352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2038
2025-10-01T14:13:41.158390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256314831690083:10837]
2025-10-01T14:13:41.158397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:41.158399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:41.158412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.158415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.158447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe740ab8-ecbe6599-51834cee-169beca4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:41.158456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:41.158459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:41.158460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:41.158466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:41.158475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:41.158490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:41.158601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.158608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.158618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:41.158667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2039 partition: 0 MaxSeqNo: 45 sessionId: src_id|fe740ab8-ecbe6599-51834cee-169beca4_0
2025-10-01T14:13:41.158956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fd6e134-339fcd5d-e7bc748-4aa6d626_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fe740ab8-ecbe6599-51834cee-169beca4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:41.161827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe740ab8-ecbe6599-51834cee-169beca4_0] Write session: try to update token
2025-10-01T14:13:41.161843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe740ab8-ecbe6599-51834cee-169beca4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:41.175265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2039 sessionId: src_id|fe740ab8-ecbe6599-51834cee-169beca4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:41.177514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:41.179056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.179078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.179095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:41.179097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:41.179099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:41.179102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:41.179110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256314831690083:10837]
2025-10-01T14:13:41.179118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256314831690083:10837]
2025-10-01T14:13:41.179121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256314831690083:10837]
2025-10-01T14:13:41.179155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:41.179165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:41.179168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:41.179169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:41.179174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.179175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:41.179292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:41.241894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256317208590384:10880]
2025-10-01T14:13:41.242176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2038, pipe: [1:7556256317208590384:10880]
2025-10-01T14:13:41.327718Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:41.328199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:41.328264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590384:10880], now have 1 active actors on pipe
2025-10-01T14:13:41.331502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:41.331594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:41.331607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:41.331610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:41.331640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256317208590384:10880]
2025-10-01T14:13:41.331690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2039 reason: error at write: Disconnected sessionId: src_id|fe740ab8-ecbe6599-51834cee-169beca4_0
2025-10-01T14:13:41.331888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2039 sessionId: src_id|fe740ab8-ecbe6599-51834cee-169beca4_0 is DEAD
2025-10-01T14:13:41.332180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe740ab8-ecbe6599-51834cee-169beca4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:41.332195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe740ab8-ecbe6599-51834cee-169beca4_0] Write session will restart in 0.005662s
2025-10-01T14:13:41.332223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe740ab8-ecbe6599-51834cee-169beca4_0] Write session: Do CDS request
2025-10-01T14:13:41.332230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe740ab8-ecbe6599-51834cee-169beca4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:41.339062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe740ab8-ecbe6599-51834cee-169beca4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:41.339088Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:41.339105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2040
2025-10-01T14:13:41.339280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:41.339314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:41.339323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:41.339328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:41.339865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2040 sessionId:  describe result for acl check
2025-10-01T14:13:41.339909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:41.339911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:41.339913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:41.339919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256317208590402:11121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:41.340541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256317208590402:11121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:41.349217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256317208590402:11121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:41.351465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256317208590402:11121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:41.351480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256317208590402:11121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:41.351483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256317208590402:11121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:41.351492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:41.351628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:41.352231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:41.352441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:41.352455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:41.352467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:41.352530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:41.352587Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256314831690254:10850]
2025-10-01T14:13:41.353301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:41.353583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:41.353633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:41.353922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:41.353987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.353993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.353994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.353995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.353996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.353996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.353997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.353998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.353999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.353999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.354000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.354001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.354002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.354003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.354007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.354014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.354017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.354019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.354021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.354024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.354026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.354029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.354031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.354036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.354038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.354041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.354043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.354045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.354053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.354057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.354062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.354065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.354067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.354071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.354073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.354076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.354079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.354082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.354085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.354088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.354091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.354096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.354098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.354102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.354105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.354108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.354110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.354113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.354116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.354119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.354122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.354125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.354128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.354131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.354134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.354137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.354158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:41.357837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:41.358656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:41.358676Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:41.358679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:41.358684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:41.358691Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2039 [2:7556256314831690254:10850]
2025-10-01T14:13:41.358708Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:41.358727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:41.358730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:41.358734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:41.358736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:41.358752Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:41.358764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:41.358771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:41.358846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.358855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.358858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.358862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:41.358865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:41.358937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:41.358947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.358959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.358970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.358993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:41.359016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590388:2446], now have 1 active actors on pipe
2025-10-01T14:13:41.359026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590504:11121], now have 1 active actors on pipe
2025-10-01T14:13:41.359032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256314831690248:10850]
2025-10-01T14:13:41.359034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256314831690248:10850]
2025-10-01T14:13:41.359036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256314831690248:10850]
2025-10-01T14:13:41.359047Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:41.359059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:41.359073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:41.359076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:41.359078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:41.359082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:41.359085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:41.359098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256314831690248:10850]
2025-10-01T14:13:41.359106Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:41.359109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:41.359132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2039
2025-10-01T14:13:41.359182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2039
2025-10-01T14:13:41.359280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.359291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.359318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:41.359331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:41.359335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:41.359337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:41.359347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:41.359357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:41.359376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:41.359613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.359624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.359640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:41.359735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2040 partition: 0 MaxSeqNo: 45 sessionId: src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0
2025-10-01T14:13:41.360116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe740ab8-ecbe6599-51834cee-169beca4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:41.363177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0] Write session: try to update token
2025-10-01T14:13:41.363198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:41.370986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:41.371008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:41.371019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256314831690248:10850]
2025-10-01T14:13:41.371068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:41.371101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:41.371241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:41.371414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:41.371549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:41.371712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:41.371903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:41.371944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:41.379764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2040 sessionId: src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:41.382438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:41.382705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.382730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.382771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:41.382912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:41.391846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:41.391868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:41.391871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:41.391873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:41.391885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256314831690248:10850]
2025-10-01T14:13:41.391889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256314831690248:10850]
2025-10-01T14:13:41.391893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256314831690248:10850]
2025-10-01T14:13:41.391935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:41.391940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.391943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:41.391979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:41.392011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:41.392017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:41.392077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:41.431874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256317208590520:10880]
2025-10-01T14:13:41.432137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2039, pipe: [1:7556256317208590520:10880]
2025-10-01T14:13:41.541956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:41.552031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.552069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.552281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.552349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.552424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.552495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.552545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.552550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.552649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.552717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.552784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.552856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.552904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.552908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.552997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.553068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.553146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.553220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.553270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.553273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.553360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.553433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.553511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.553593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.553644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.553647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.553728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.553808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.553881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.553950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.554000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.554003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.554086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.554157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.554229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.554301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.554349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.554352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.556866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256317208590520:10880]
2025-10-01T14:13:41.556898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:41.556934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:41.556937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:41.556967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2040 reason: error at write: Disconnected sessionId: src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0
2025-10-01T14:13:41.557215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2040 sessionId: src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0 is DEAD
2025-10-01T14:13:41.557732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:41.557744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0] Write session will restart in 0.005060s
2025-10-01T14:13:41.557772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0] Write session: Do CDS request
2025-10-01T14:13:41.557778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:41.554697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.554783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.554861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.554937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.554987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.554990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.555070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.555137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.555209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.555287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.555333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.555336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.555423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.555493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.555563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.555633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.555681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.555685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.555757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:41.555823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:41.555886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:41.555950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:41.555995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:41.555998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:41.556083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590520:10880], now have 1 active actors on pipe
2025-10-01T14:13:41.557568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:41.563981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:41.566540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:41.566561Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2041
2025-10-01T14:13:41.570497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:41.570578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:41.570585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:41.570590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:41.571230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2041 sessionId:  describe result for acl check
2025-10-01T14:13:41.571315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:41.571318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:41.571320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:41.571326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256317208590539:11126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:41.571904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256317208590539:11126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:41.575933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256317208590539:11126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:41.583457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256317208590539:11126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:41.583482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256317208590539:11126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:41.583486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256317208590539:11126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:41.583498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:41.619175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:41.623337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:41.623642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:41.623647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:41.623660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:41.623728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:41.623789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256314831690379:10852]
2025-10-01T14:13:41.626099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:41.629369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:41.629458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:41.629975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:41.630157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.630163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.630164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.630166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.630167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.630169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.630172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.630174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.630175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.630176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.630178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.630179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.630180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.630182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.630189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.630199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.630203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.630207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.630211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.630214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.630218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.630221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.630224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.630230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.630233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.630237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.630240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.630243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.630252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.630260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:41.630267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.630272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:41.630277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.630282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:41.630286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.630290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:41.630295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.630300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:41.630306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.630310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:41.630315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.630323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:41.630329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.630333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:41.630338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.630342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:41.630348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.630354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.630358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.630362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.630366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.630386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.630390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.630394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:41.630398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.630403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:41.630443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:41.636860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:41.637652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:41.637673Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:41.637677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:41.637682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:41.637692Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2040 [2:7556256314831690379:10852]
2025-10-01T14:13:41.637717Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:41.637739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:41.637743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:41.637750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:41.637752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:41.637773Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:41.637779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:41.637786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:41.637926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.637938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.637941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.637944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:41.637948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:41.638031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:41.638034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.638049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:41.638059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:41.638072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:41.638092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256314831690373:10852]
2025-10-01T14:13:41.638094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256314831690373:10852]
2025-10-01T14:13:41.638096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256314831690373:10852]
2025-10-01T14:13:41.638111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:41.638124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:41.638139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:41.638142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:41.638196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256314831690373:10852]
2025-10-01T14:13:41.638198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:41.638314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:41.638317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:41.638320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:41.638325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:41.638723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590531:2446], now have 1 active actors on pipe
2025-10-01T14:13:41.638730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590582:11126], now have 1 active actors on pipe
2025-10-01T14:13:41.639586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.639601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.639632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5850c6c3-973f316e-64ef5404-526b034c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:41.639642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:41.639646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:41.639649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:41.639663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:41.639693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:41.639711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:41.640069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.640078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.640095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:41.640665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|926b1953-1f77684a-9e92cb0b-e5f219b3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5850c6c3-973f316e-64ef5404-526b034c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:41.639138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2040
2025-10-01T14:13:41.639187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2040
2025-10-01T14:13:41.640231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2041 partition: 0 MaxSeqNo: 45 sessionId: src_id|5850c6c3-973f316e-64ef5404-526b034c_0
2025-10-01T14:13:41.643967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5850c6c3-973f316e-64ef5404-526b034c_0] Write session: try to update token
2025-10-01T14:13:41.643987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5850c6c3-973f316e-64ef5404-526b034c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:41.657814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256317208590678:10880]
2025-10-01T14:13:41.658265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2040, pipe: [1:7556256317208590678:10880]
2025-10-01T14:13:41.658452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256317208590678:10880], now have 1 active actors on pipe
2025-10-01T14:13:41.685438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2041 sessionId: src_id|5850c6c3-973f316e-64ef5404-526b034c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:41.688420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:41.689695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:41.689722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:41.692045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:41.692077Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:41.692080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:41.692083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:41.692085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:41.692097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256314831690373:10852]
2025-10-01T14:13:41.692102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256314831690373:10852]
2025-10-01T14:13:41.692107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256314831690373:10852]
2025-10-01T14:13:41.692154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:41.692162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:41.692164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:41.692327Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:41.694571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:41.694586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:41.694591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:41.698485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:42.124442Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:42.155282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.155312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.155503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.155567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.155632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.155705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.155748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.155753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.155835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.155894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.155956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.156025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.156370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.156374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.156440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.156499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.156567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.156650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.156690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.156693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.156760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.156822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.156881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.156940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.156980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.156983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.157049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.157111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.157173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.157237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.157276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.157280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.157350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.157411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.157477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.157542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.157587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.157590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.157661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.157720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.157786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.157856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.157899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.157908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.157979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.158040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.158099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.158162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.158210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.158214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.158288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.158356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.170477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.170575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.170622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.170628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.170718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.170779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.170845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.170913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.171036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.171039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.175265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256317208590678:10880]
2025-10-01T14:13:42.175303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:42.175337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:42.175339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:42.175367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2041 reason: error at write: Disconnected sessionId: src_id|5850c6c3-973f316e-64ef5404-526b034c_0
2025-10-01T14:13:42.175979Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:42.175573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2041 sessionId: src_id|5850c6c3-973f316e-64ef5404-526b034c_0 is DEAD
2025-10-01T14:13:42.178500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850c6c3-973f316e-64ef5404-526b034c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:42.178514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850c6c3-973f316e-64ef5404-526b034c_0] Write session will restart in 0.006534s
2025-10-01T14:13:42.178545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850c6c3-973f316e-64ef5404-526b034c_0] Write session: Do CDS request
2025-10-01T14:13:42.178553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850c6c3-973f316e-64ef5404-526b034c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:42.194839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5850c6c3-973f316e-64ef5404-526b034c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:42.196892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:42.196911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2042
2025-10-01T14:13:42.197110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:42.197140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:42.197146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:42.197150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:42.197769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2042 sessionId:  describe result for acl check
2025-10-01T14:13:42.197796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:42.197798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:42.197799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:42.197804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256321503558029:11141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:42.198422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256321503558029:11141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:42.208662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256321503558029:11141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:42.219971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256321503558029:11141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:42.219991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256321503558029:11141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:42.219995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256321503558029:11141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:42.220004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:42.234489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:42.234811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:42.235038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:42.235043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:42.235057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:42.235113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:42.235154Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256319126657817:10858]
2025-10-01T14:13:42.235782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:42.238841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:42.238917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:42.239313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:42.239387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.239389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.239390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.239392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.239393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.239394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.239397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.239398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.239399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.239401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.239402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.239404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.239405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.239406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.239413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.239424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.239429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.239433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.239437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.239458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.239463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.239467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.239470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.239475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.239479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.239483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.239487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.239491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.239501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.239509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.239516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.239522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.239529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.239535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.239540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.239546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.239551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.239556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.239561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.239567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.239572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.239577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.239582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.239587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.239592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.239599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.239603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.239609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.239614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.239621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.239625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.239630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.239635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.239640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.239644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.239650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.239690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:42.247236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2041
2025-10-01T14:13:42.247278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2041
2025-10-01T14:13:42.248075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2042 partition: 0 MaxSeqNo: 45 sessionId: src_id|49232751-a4cb565f-6637f942-10cee10f_0
2025-10-01T14:13:42.248482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5850c6c3-973f316e-64ef5404-526b034c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|49232751-a4cb565f-6637f942-10cee10f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:42.251997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49232751-a4cb565f-6637f942-10cee10f_0] Write session: try to update token
2025-10-01T14:13:42.252017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49232751-a4cb565f-6637f942-10cee10f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:42.245437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:42.246212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:42.246218Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:42.246220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:42.246224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:42.246231Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2041 [2:7556256319126657817:10858]
2025-10-01T14:13:42.246246Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:42.246262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:42.246266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:42.246269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:42.246271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:42.246288Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:42.246294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:42.246300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:42.246358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.246360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.246362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.246365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:42.246384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:42.246450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:42.246453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.246463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.246472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.246486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:42.246502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256319126657811:10858]
2025-10-01T14:13:42.246504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256319126657811:10858]
2025-10-01T14:13:42.246506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256319126657811:10858]
2025-10-01T14:13:42.246519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:42.246532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:42.246545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:42.246548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:42.246581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256319126657811:10858]
2025-10-01T14:13:42.246583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:42.246757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:42.246759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:42.246761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:42.246766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:42.247623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256321503558107:11141], now have 1 active actors on pipe
2025-10-01T14:13:42.247627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256321503558013:2446], now have 1 active actors on pipe
2025-10-01T14:13:42.247644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.247649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.247674Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49232751-a4cb565f-6637f942-10cee10f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:42.247682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:42.247695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:42.247697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:42.247706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:42.247715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:42.247729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:42.247955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.247957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.247968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:42.275129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256321503558146:10880]
2025-10-01T14:13:42.276757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2041, pipe: [1:7556256321503558146:10880]
2025-10-01T14:13:42.278816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256321503558146:10880], now have 1 active actors on pipe
2025-10-01T14:13:42.305993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2042 sessionId: src_id|49232751-a4cb565f-6637f942-10cee10f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:42.308685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:42.311139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.311164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.311208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:42.313646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:42.322066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:42.322097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:42.322099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:42.322102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:42.322113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256319126657811:10858]
2025-10-01T14:13:42.322130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256319126657811:10858]
2025-10-01T14:13:42.322136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256319126657811:10858]
2025-10-01T14:13:42.322190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:42.322200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.322203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:42.322354Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:42.322457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:42.322463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:42.322469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:42.570130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:42.580350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.580385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.580613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.580687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.580763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.580840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.581156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.581162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.581246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.581319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.581391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.581461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.581505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.581508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.581579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.581643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.581707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.581771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.581811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.581813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.581881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.581942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.582003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.582069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.582110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.582113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.582184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.582249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.582319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.582401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.582445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.582447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.582517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.582577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.582661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.582730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.585968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:42.586034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256321503558146:10880]
2025-10-01T14:13:42.586061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:42.586064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:42.586092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2042 reason: error at write: Disconnected sessionId: src_id|49232751-a4cb565f-6637f942-10cee10f_0
2025-10-01T14:13:42.582774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.582786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.582855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.582915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.582977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.583042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.583096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.583099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.583167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.583231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.583295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.583360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.583402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.583404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.583476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.583541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.583610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.583680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.583724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.583727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.583805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:42.583872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:42.583941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:42.584006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:42.584136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:42.584139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:42.585719Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:42.586656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49232751-a4cb565f-6637f942-10cee10f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:42.586668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49232751-a4cb565f-6637f942-10cee10f_0] Write session will restart in 0.009624s
2025-10-01T14:13:42.586342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2042 sessionId: src_id|49232751-a4cb565f-6637f942-10cee10f_0 is DEAD
2025-10-01T14:13:42.586698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49232751-a4cb565f-6637f942-10cee10f_0] Write session: Do CDS request
2025-10-01T14:13:42.586705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49232751-a4cb565f-6637f942-10cee10f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:42.598979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49232751-a4cb565f-6637f942-10cee10f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:42.599367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:42.599384Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2043
2025-10-01T14:13:42.599584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:42.599618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:42.599626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:42.599630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:42.600076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2043 sessionId:  describe result for acl check
2025-10-01T14:13:42.600115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:42.600119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:42.600121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:42.600127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256321503558213:11146] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:42.600719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256321503558213:11146] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:42.608116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256321503558213:11146] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:42.615071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:42.616133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256321503558213:11146] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:42.616151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256321503558213:11146] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:42.616154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256321503558213:11146] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:42.616161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:42.618091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:42.618310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:42.618315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:42.618327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:42.618391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:42.618438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256319126657987:10871]
2025-10-01T14:13:42.619086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:42.619522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:42.619570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:42.619916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:42.619980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.619981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.619983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.619984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.619986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.619987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.619988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.619990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.619991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.619992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.619993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.619995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.619996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.619998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.620004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.620014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.620018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.620023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.620026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.620030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.620035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.620039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.620043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.620048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.620052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.620056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.620060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.620064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.620072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.620080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.620086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.620093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.620098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.620104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.620109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.620114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.620119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.620125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.620130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.620136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.620141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.620146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.620152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.620158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.620162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.620168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.620173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.620179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.620184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.620189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.620194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.620200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.620205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.620210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.620214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.620220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.620281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:42.625510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:42.626580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:42.626587Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:42.626591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:42.626595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:42.626605Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2042 [2:7556256319126657987:10871]
2025-10-01T14:13:42.626623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:42.626642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:42.626646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:42.626651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:42.626653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:42.626669Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:42.626675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:42.626681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:42.626745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.626747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.626750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.626753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:42.626756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:42.626829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:42.626832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.626846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.626857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.626875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:42.626892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256319126657981:10871]
2025-10-01T14:13:42.626895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256319126657981:10871]
2025-10-01T14:13:42.626897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256319126657981:10871]
2025-10-01T14:13:42.626909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:42.626923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:42.626939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:42.626942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:42.626985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256319126657981:10871]
2025-10-01T14:13:42.626987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:42.627993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2042
2025-10-01T14:13:42.628024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2042
2025-10-01T14:13:42.627275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:42.627284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:42.627286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:42.627291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:42.629517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256321503558296:11146], now have 1 active actors on pipe
2025-10-01T14:13:42.629535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256321503558162:2446], now have 1 active actors on pipe
2025-10-01T14:13:42.629556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.629564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.629600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f75b29c0-7f675f08-158529fe-ef741273_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:42.629611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:42.629617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:42.629619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:42.629634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:42.629650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:42.629670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:42.630030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.630039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.630056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:42.630194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2043 partition: 0 MaxSeqNo: 45 sessionId: src_id|f75b29c0-7f675f08-158529fe-ef741273_0
2025-10-01T14:13:42.630676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49232751-a4cb565f-6637f942-10cee10f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f75b29c0-7f675f08-158529fe-ef741273_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:42.633725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f75b29c0-7f675f08-158529fe-ef741273_0] Write session: try to update token
2025-10-01T14:13:42.633748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f75b29c0-7f675f08-158529fe-ef741273_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:42.657515Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:42.657540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:42.657542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:42.657544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:42.657554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256319126657981:10871]
2025-10-01T14:13:42.657558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256319126657981:10871]
2025-10-01T14:13:42.657562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256319126657981:10871]
2025-10-01T14:13:42.657610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:42.657617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.657620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:42.657772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:42.658438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:42.658446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:42.658449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:42.686314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256321503558308:10880]
2025-10-01T14:13:42.693971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2042, pipe: [1:7556256321503558308:10880]
2025-10-01T14:13:42.693999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2043 sessionId: src_id|f75b29c0-7f675f08-158529fe-ef741273_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:42.696563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:42.844675Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:42.845003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256321503558308:10880], now have 1 active actors on pipe
2025-10-01T14:13:42.845032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.845039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.845939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:42.845956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:42.846015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2043 reason: error at write: Disconnected sessionId: src_id|f75b29c0-7f675f08-158529fe-ef741273_0
2025-10-01T14:13:42.846224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2043 sessionId: src_id|f75b29c0-7f675f08-158529fe-ef741273_0 is DEAD
2025-10-01T14:13:42.846354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256321503558308:10880]
2025-10-01T14:13:42.846383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:42.846782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75b29c0-7f675f08-158529fe-ef741273_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:42.846792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75b29c0-7f675f08-158529fe-ef741273_0] Write session will restart in 0.009254s
2025-10-01T14:13:42.846820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75b29c0-7f675f08-158529fe-ef741273_0] Write session: Do CDS request
2025-10-01T14:13:42.846830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75b29c0-7f675f08-158529fe-ef741273_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:42.846663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:42.858955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f75b29c0-7f675f08-158529fe-ef741273_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:42.866560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:42.866584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2044
2025-10-01T14:13:42.867241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:42.867283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:42.867291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:42.867296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:42.867807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2044 sessionId:  describe result for acl check
2025-10-01T14:13:42.867844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:42.867846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:42.867849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:42.867856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256321503558325:11151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:42.869028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256321503558325:11151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:42.884008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:42.882481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256321503558325:11151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:42.885842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:42.886186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256321503558325:11151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:42.886206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256321503558325:11151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:42.886209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256321503558325:11151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:42.886218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:42.886069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:42.886083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:42.886097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:42.886155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:42.886189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256319126658116:10874]
2025-10-01T14:13:42.886784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:42.887087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:42.887129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:42.887425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:42.887491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.887492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.887493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.887494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.887496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.887497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.887498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.887500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.887501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.887502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.887503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.887504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.887506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.887507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.887512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.887521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.887525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.887529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.887533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.887538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.887542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.887546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.887549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.887554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.887557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.887561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.887565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.887569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.887576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.887584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:42.887590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.887595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:42.887600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.887606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:42.887611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.887616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:42.887621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.887627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:42.887631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.887637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:42.887642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.887648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:42.887652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.887657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:42.887662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.887668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:42.887678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.887684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.887690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.887700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.887705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.887710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.887714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.887721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:42.887725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.887730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:42.887768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:42.891847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:42.892480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:42.892486Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:42.892489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:42.892493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:42.892500Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2043 [2:7556256319126658116:10874]
2025-10-01T14:13:42.892514Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:42.892528Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:42.892529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:42.892532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:42.892533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:42.892545Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:42.892549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:42.892556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:42.892626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.892628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.892631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.892634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:42.892637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:42.892709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:42.892711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.892721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:42.892731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:42.892745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:42.892763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256321503558311:2446], now have 1 active actors on pipe
2025-10-01T14:13:42.892771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256319126658111:10874]
2025-10-01T14:13:42.892773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256319126658111:10874]
2025-10-01T14:13:42.892775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256319126658111:10874]
2025-10-01T14:13:42.892783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:42.892787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:42.892789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:42.892792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:42.892796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:42.892809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:42.892811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:42.892817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256321503558434:11151], now have 1 active actors on pipe
2025-10-01T14:13:42.892845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256319126658111:10874]
2025-10-01T14:13:42.892852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:42.892858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:42.893130Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2043
2025-10-01T14:13:42.893167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2043
2025-10-01T14:13:42.893405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.893419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.893444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:42.893450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:42.893453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:42.893455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:42.893463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:42.893472Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:42.893486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:42.894480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:42.894496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:42.894520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:42.898014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2044 partition: 0 MaxSeqNo: 45 sessionId: src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0
2025-10-01T14:13:42.901599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f75b29c0-7f675f08-158529fe-ef741273_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:42.904641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0] Write session: try to update token
2025-10-01T14:13:42.904656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:42.915785Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:42.915809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:42.915812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:42.915814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:42.915825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256319126658111:10874]
2025-10-01T14:13:42.915829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256319126658111:10874]
2025-10-01T14:13:42.915833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256319126658111:10874]
2025-10-01T14:13:42.915877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:42.915887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:42.915890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:42.916019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:42.916130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:42.916149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:42.916154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:42.926328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2044 sessionId: src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:42.928645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:42.942735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256321503558470:10880]
2025-10-01T14:13:42.943084Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2043, pipe: [1:7556256321503558470:10880]
2025-10-01T14:13:43.074974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:43.075329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.075342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.075360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256321503558470:10880], now have 1 active actors on pipe
2025-10-01T14:13:43.075948Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:43.075937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:43.075943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256321503558470:10880]
2025-10-01T14:13:43.075954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:43.075964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:43.076012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2044 reason: error at write: Disconnected sessionId: src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0
2025-10-01T14:13:43.076215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2044 sessionId: src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0 is DEAD
2025-10-01T14:13:43.076612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:43.076623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0] Write session will restart in 0.008521s
2025-10-01T14:13:43.076651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0] Write session: Do CDS request
2025-10-01T14:13:43.076658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:43.085878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:43.085943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.086018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:43.086039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2045
2025-10-01T14:13:43.086224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.086265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:43.086276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:43.086279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:43.086624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2045 sessionId:  describe result for acl check
2025-10-01T14:13:43.086652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:43.086654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:43.086655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:43.086658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256325798525859:11163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:43.087030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256325798525859:11163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:43.087705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:43.087896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:43.087906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:43.087916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:43.087963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:43.088005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256323421625548:10878]
2025-10-01T14:13:43.088584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:43.088930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:43.088994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:43.088995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256325798525859:11163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:43.089334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:43.089398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.089405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.089406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.089407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.089408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.089409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.089410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.089412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.089413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.089414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.089415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.089417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.089418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.089419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.089425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.089435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.089439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.089442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.089446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.089449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.089452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.089455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.089458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.089462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.089466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.089470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.089473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.089477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.089484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.089492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.089502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.089507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.089517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.089522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.089531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.089536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.089546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.089556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.089565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.089574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.089584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.089593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.089598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.089606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.089615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.089624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.089634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.089639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.089646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.089650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.089655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.089660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.089669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.089677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.089686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.089696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.089741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:43.093206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256325798525859:11163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:43.093234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256325798525859:11163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:43.093237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256325798525859:11163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:43.093246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:43.093365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:43.094089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:43.094103Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:43.094106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:43.094109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:43.094116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2044 [2:7556256323421625548:10878]
2025-10-01T14:13:43.094132Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:43.094152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:43.094160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.094163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.094170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.094186Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:43.094200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:43.094206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:43.094260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.094268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.094270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.094274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:43.094276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:43.094345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:43.094354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.094364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.094393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.094414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:43.094434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2044
2025-10-01T14:13:43.094437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798525769:2446], now have 1 active actors on pipe
2025-10-01T14:13:43.094450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798525898:11163], now have 1 active actors on pipe
2025-10-01T14:13:43.094457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256323421625542:10878]
2025-10-01T14:13:43.094460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256323421625542:10878]
2025-10-01T14:13:43.094462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256323421625542:10878]
2025-10-01T14:13:43.094473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:43.094480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:43.094483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:43.094485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:43.094485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:43.094500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:43.094502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:43.094537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256323421625542:10878]
2025-10-01T14:13:43.094550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:43.094552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2044
2025-10-01T14:13:43.094559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:43.094599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.094609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.094633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:43.094644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.094648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.094651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:43.094660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.094672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:43.094692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.095053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.095065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.095082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.095153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2045 partition: 0 MaxSeqNo: 45 sessionId: src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0
2025-10-01T14:13:43.095521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2350a450-39170c8b-14a3ad1f-8bfbc1d0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:43.098638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0] Write session: try to update token
2025-10-01T14:13:43.098658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:43.105327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:43.105347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:43.105356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256323421625542:10878]
2025-10-01T14:13:43.105388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:43.105400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:43.105775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:43.105927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:43.106070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:43.106215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:43.106437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:43.106478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:43.112068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2045 sessionId: src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:43.114452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:43.114633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.114657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.114694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:43.114784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:43.123441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:43.123462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:43.123464Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:43.123465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:43.123475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256323421625542:10878]
2025-10-01T14:13:43.123478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256323421625542:10878]
2025-10-01T14:13:43.123482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256323421625542:10878]
2025-10-01T14:13:43.123525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:43.123532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.123539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:43.123539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:43.123547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:43.123551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:43.123679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:43.176253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256325798525906:10880]
2025-10-01T14:13:43.176551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2044, pipe: [1:7556256325798525906:10880]
2025-10-01T14:13:43.274131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:43.282508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.282537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.282710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.282784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.282854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.282918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.282968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.282979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.283051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.283118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.283181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.283256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.283305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.283312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.283386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.283453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.283517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.283589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.283637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.283643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.283721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.283791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.283860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.283931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.283978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.283985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.284059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.284127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.284192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.284259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.284306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.284312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.284388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.284453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.284544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.284618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.284660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.284663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.284734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.284792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.284870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.284941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.285057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.285071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.285138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.285200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.285266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.285333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.285399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.285406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.285481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.285549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.285619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.285691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.285740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.285747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.285820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.285891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.285956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.286021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.286067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.286074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.286134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798525906:10880], now have 1 active actors on pipe
2025-10-01T14:13:43.286556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256325798525906:10880]
2025-10-01T14:13:43.286576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:43.286594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:43.286597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:43.286625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2045 reason: error at write: Disconnected sessionId: src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0
2025-10-01T14:13:43.286871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2045 sessionId: src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0 is DEAD
2025-10-01T14:13:43.286993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:43.287004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0] Write session will restart in 0.009052s
2025-10-01T14:13:43.287039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0] Write session: Do CDS request
2025-10-01T14:13:43.287046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:43.287216Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:43.296891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.297006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:43.297022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2046
2025-10-01T14:13:43.297157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.297176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:43.297189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:43.297203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:43.297207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:43.297558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2046 sessionId:  describe result for acl check
2025-10-01T14:13:43.297592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:43.297598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:43.297599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:43.297604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256325798526001:11167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:43.298149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256325798526001:11167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:43.299000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:43.299272Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:43.299286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:43.299298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:43.299359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:43.299398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256323421625679:10881]
2025-10-01T14:13:43.299987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:43.300249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:43.300321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:43.300477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256325798526001:11167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:43.300638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:43.300722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.300730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.300731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.300732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.300733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.300734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.300735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.300736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.300737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.300739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.300740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.300741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.300742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.300743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.300749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.300757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.300761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.300764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.300767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.300771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.300775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.300778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.300781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.300785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.300789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.300792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.300796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.300799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.300805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.300812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.300817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.300823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.300827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.300832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.300837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.300842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.300846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.300856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.300860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.300868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.300873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.300881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.300886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.300896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.300900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.300910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.300914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.300923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.300932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.300937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.300947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.300952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.300962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.300971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.300975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.300985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.301025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:43.304440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256325798526001:11167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:43.304461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256325798526001:11167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:43.304467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256325798526001:11167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:43.304476Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:43.304663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:43.305271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:43.305287Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:43.305289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:43.305293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:43.305300Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2045 [2:7556256323421625679:10881]
2025-10-01T14:13:43.305316Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:43.305336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:43.305343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.305346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.305349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.305364Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:43.305373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:43.305379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:43.305446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.305452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.305454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.305458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:43.305460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:43.305524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:43.305531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.305542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.305553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.305574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:43.305595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526039:11167], now have 1 active actors on pipe
2025-10-01T14:13:43.305602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798525909:2446], now have 1 active actors on pipe
2025-10-01T14:13:43.305609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256323421625673:10881]
2025-10-01T14:13:43.305615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256323421625673:10881]
2025-10-01T14:13:43.305618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256323421625673:10881]
2025-10-01T14:13:43.305630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:43.305632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2045
2025-10-01T14:13:43.305647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:43.305636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2045
2025-10-01T14:13:43.305662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:43.305665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:43.305665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:43.305668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:43.305669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:43.305713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.305722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.305735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256323421625673:10881]
2025-10-01T14:13:43.305746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:43.305757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:43.305777Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:43.305788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.305796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.305798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:43.305807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.305819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:43.305841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.306023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.306032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.306045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.306113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2046 partition: 0 MaxSeqNo: 45 sessionId: src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0
2025-10-01T14:13:43.306485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922e0f7a-5d2ee77b-429252a-dab1a97a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:43.309501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0] Write session: try to update token
2025-10-01T14:13:43.309521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:43.326896Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:43.326919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:43.326922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:43.326924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:43.326934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256323421625673:10881]
2025-10-01T14:13:43.326939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256323421625673:10881]
2025-10-01T14:13:43.326944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256323421625673:10881]
2025-10-01T14:13:43.326995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:43.326993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:43.327000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:43.327004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:43.327005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.327008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:43.327158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:43.329816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2046 sessionId: src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:43.332370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:43.386653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256325798526046:10880]
2025-10-01T14:13:43.390593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2045, pipe: [1:7556256325798526046:10880]
2025-10-01T14:13:43.486059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:43.486066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:43.486070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:43.486122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256325798526046:10880]
2025-10-01T14:13:43.486143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2046 reason: error at write: Disconnected sessionId: src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0
2025-10-01T14:13:43.486320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2046 sessionId: src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0 is DEAD
2025-10-01T14:13:43.485228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:43.485674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.485683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.485726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526046:10880], now have 1 active actors on pipe
2025-10-01T14:13:43.486149Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:43.486490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:43.486502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0] Write session will restart in 0.008675s
2025-10-01T14:13:43.486541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0] Write session: Do CDS request
2025-10-01T14:13:43.486547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:43.496946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.497069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:43.497087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2047
2025-10-01T14:13:43.497208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.497236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:43.497242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:43.497249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:43.497717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2047 sessionId:  describe result for acl check
2025-10-01T14:13:43.497754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:43.497760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:43.497762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:43.497767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256325798526065:11172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:43.498268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256325798526065:11172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:43.500332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256325798526065:11172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:43.506053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256325798526065:11172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:43.506073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256325798526065:11172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:43.506077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256325798526065:11172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:43.506085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:43.512341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:43.514764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:43.514922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:43.514929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:43.514936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:43.514969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:43.514998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256323421625851:10894]
2025-10-01T14:13:43.515401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:43.515706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:43.515748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:43.516043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:43.516127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.516135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.516136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.516137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.516138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.516139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.516140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.516141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.516143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.516144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.516146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.516147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.516148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.516149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.516155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.516164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.516168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.516172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.516175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.516179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.516183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.516187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.516190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.516194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.516197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.516200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.516203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.516207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.516216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.516224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.516230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.516235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.516239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.516246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.516250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.516256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.516261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.516271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.516275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.516281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.516285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.516290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.516294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.516304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.516308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.516318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.516322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.516337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.516342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.516346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.516350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.516355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.516359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.516363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.516367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.516371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.516407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:43.523968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2046
2025-10-01T14:13:43.524019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2046
2025-10-01T14:13:43.521686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:43.522304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:43.522309Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:43.522312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:43.522316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:43.522323Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2046 [2:7556256323421625851:10894]
2025-10-01T14:13:43.522340Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:43.522358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:43.522362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.522365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.522368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.522398Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:43.522404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:43.522410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:43.522469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.522472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.522474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.522478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:43.522481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:43.522547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:43.522552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.522563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.522575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.522592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:43.522609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256323421625846:10894]
2025-10-01T14:13:43.522612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256323421625846:10894]
2025-10-01T14:13:43.522614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256323421625846:10894]
2025-10-01T14:13:43.522627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:43.522642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:43.522656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:43.522659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:43.522697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256323421625846:10894]
2025-10-01T14:13:43.522699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:43.523469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:43.523472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:43.523474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:43.523479Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:43.530444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526054:2446], now have 1 active actors on pipe
2025-10-01T14:13:43.530471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526115:11172], now have 1 active actors on pipe
2025-10-01T14:13:43.530507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.530515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.530569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c88525d9-15b67183-f59150a8-bf2dd893_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:43.530588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.530595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.530598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:43.530611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.530629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:43.530651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.531017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.531027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.531045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.531155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2047 partition: 0 MaxSeqNo: 45 sessionId: src_id|c88525d9-15b67183-f59150a8-bf2dd893_0
2025-10-01T14:13:43.531537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97cee31b-59bbc325-d6b74a8c-3415d158_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c88525d9-15b67183-f59150a8-bf2dd893_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:43.534672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88525d9-15b67183-f59150a8-bf2dd893_0] Write session: try to update token
2025-10-01T14:13:43.534688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88525d9-15b67183-f59150a8-bf2dd893_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:43.551993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:43.552013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:43.552015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:43.552017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:43.552024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256323421625846:10894]
2025-10-01T14:13:43.552031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256323421625846:10894]
2025-10-01T14:13:43.552033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256323421625846:10894]
2025-10-01T14:13:43.552085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:43.552085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:43.552089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:43.552092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.552092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:43.552094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:43.552222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:43.555028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2047 sessionId: src_id|c88525d9-15b67183-f59150a8-bf2dd893_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:43.557479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:43.586335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256325798526197:10880]
2025-10-01T14:13:43.586762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2046, pipe: [1:7556256325798526197:10880]
2025-10-01T14:13:43.698474Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:43.698828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.698838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.698882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526197:10880], now have 1 active actors on pipe
2025-10-01T14:13:43.699938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:43.699987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256325798526197:10880]
2025-10-01T14:13:43.700006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:43.700068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2047 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c88525d9-15b67183-f59150a8-bf2dd893_0
2025-10-01T14:13:43.700237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2047 sessionId: src_id|c88525d9-15b67183-f59150a8-bf2dd893_0 is DEAD
2025-10-01T14:13:43.700664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88525d9-15b67183-f59150a8-bf2dd893_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:43.700676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88525d9-15b67183-f59150a8-bf2dd893_0] Write session will restart in 0.007558s
2025-10-01T14:13:43.699204Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:43.700701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88525d9-15b67183-f59150a8-bf2dd893_0] Write session: Do CDS request
2025-10-01T14:13:43.700707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88525d9-15b67183-f59150a8-bf2dd893_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:43.710905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88525d9-15b67183-f59150a8-bf2dd893_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.711114Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:43.711131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2048
2025-10-01T14:13:43.711252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.711284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:43.711293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:43.711297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:43.711683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2048 sessionId:  describe result for acl check
2025-10-01T14:13:43.711718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:43.711725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:43.711726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:43.711732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256325798526227:11177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:43.712253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256325798526227:11177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:43.715472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256325798526227:11177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:43.723503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256325798526227:11177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:43.723524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256325798526227:11177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:43.723528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256325798526227:11177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:43.723537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:43.727963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:43.728512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:43.728712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:43.728721Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:43.728732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:43.728769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:43.728807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256323421625984:10897]
2025-10-01T14:13:43.729444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:43.730093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:43.730136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:43.730457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:43.730508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.730515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.730516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.730517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.730518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.730520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.730521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.730522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.730523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.730525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.730526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.730527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.730528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.730529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.730534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.730543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.730546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.730551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.730554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.730557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.730561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.730564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.730568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.730571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.730575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.730578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.730581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.730584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.730591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.730598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.730604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.730609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.730622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.730631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.730635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.730639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.730648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.730653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.730658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.730663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.730668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.730672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.730676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.730681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.730689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.730693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.730697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.730701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.730706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.730710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.730714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.730718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.730722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.730726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.730730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.730735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.730773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:43.734746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:43.735313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:43.735329Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:43.735332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:43.735335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:43.735342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2047 [2:7556256323421625984:10897]
2025-10-01T14:13:43.735367Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:43.735388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:43.735395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.735399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.735402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.735417Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:43.735427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:43.735436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:43.735491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.735497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.735499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.735503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:43.735506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:43.735599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:43.735606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.735617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.735633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.735651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:43.735670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526336:11177], now have 1 active actors on pipe
2025-10-01T14:13:43.735678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526212:2446], now have 1 active actors on pipe
2025-10-01T14:13:43.735685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256323421625979:10897]
2025-10-01T14:13:43.735692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256323421625979:10897]
2025-10-01T14:13:43.735694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256323421625979:10897]
2025-10-01T14:13:43.735711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2047
2025-10-01T14:13:43.735734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2047
2025-10-01T14:13:43.735710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:43.735726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:43.735740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:43.735743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:43.735744Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:43.735748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:43.735749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:43.735772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256323421625979:10897]
2025-10-01T14:13:43.735775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:43.735785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:43.735793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.735798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.735843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9baa744b-5aa6b885-c62807b5-a003f104_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:43.735849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.735853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.735856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:43.735863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.735871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:43.735894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.736029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.736043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.736063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.736144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2048 partition: 0 MaxSeqNo: 45 sessionId: src_id|9baa744b-5aa6b885-c62807b5-a003f104_0
2025-10-01T14:13:43.736490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88525d9-15b67183-f59150a8-bf2dd893_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9baa744b-5aa6b885-c62807b5-a003f104_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:43.739517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9baa744b-5aa6b885-c62807b5-a003f104_0] Write session: try to update token
2025-10-01T14:13:43.739534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9baa744b-5aa6b885-c62807b5-a003f104_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:43.753854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:43.753878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:43.753889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256323421625979:10897]
2025-10-01T14:13:43.753941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:43.753948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:43.754130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:43.754286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:43.754457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:43.754607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:43.754812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:43.754848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:43.760553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2048 sessionId: src_id|9baa744b-5aa6b885-c62807b5-a003f104_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:43.763335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:43.763616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.763653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.763701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:43.763806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:43.768016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:43.768036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:43.768039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:43.768041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:43.768053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256323421625979:10897]
2025-10-01T14:13:43.768057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256323421625979:10897]
2025-10-01T14:13:43.768061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256323421625979:10897]
2025-10-01T14:13:43.768111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:43.768114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:43.768118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.768120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:43.768120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:43.768127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:43.768256Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:43.800373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256325798526352:10880]
2025-10-01T14:13:43.800674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2047, pipe: [1:7556256325798526352:10880]
2025-10-01T14:13:43.910394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:43.918419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.918448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.918622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.918693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.918762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.918827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.918886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.918896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.918971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.919036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.919127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.919205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.919254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.919261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.919327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.919392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.919457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.919518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.919565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.919571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.919636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.919703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.919766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.919831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.919880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.919886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.919960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.920028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.920101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.920177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.920229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.920239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.920313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.920372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.920437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.920501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.920544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.920549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.920629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.920694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.920769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.920835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.920885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.920898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.920966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.921025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.921089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.921158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.921213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.921218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.921291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.921353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.921424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.921499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.921545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.921549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.921613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:43.921679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:43.921746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:43.921813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:43.921860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:43.921865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:43.921936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526352:10880], now have 1 active actors on pipe
2025-10-01T14:13:43.922492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256325798526352:10880]
2025-10-01T14:13:43.922533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:43.922536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:43.922564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2048 reason: error at write: Disconnected sessionId: src_id|9baa744b-5aa6b885-c62807b5-a003f104_0
2025-10-01T14:13:43.922821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:43.922825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2048 sessionId: src_id|9baa744b-5aa6b885-c62807b5-a003f104_0 is DEAD
2025-10-01T14:13:43.923059Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:43.923207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9baa744b-5aa6b885-c62807b5-a003f104_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:43.923219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9baa744b-5aa6b885-c62807b5-a003f104_0] Write session will restart in 0.009032s
2025-10-01T14:13:43.923246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9baa744b-5aa6b885-c62807b5-a003f104_0] Write session: Do CDS request
2025-10-01T14:13:43.923252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9baa744b-5aa6b885-c62807b5-a003f104_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:43.933941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9baa744b-5aa6b885-c62807b5-a003f104_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.934004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:43.934025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2049
2025-10-01T14:13:43.934217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:43.934249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:43.934260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:43.934263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:43.934776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2049 sessionId:  describe result for acl check
2025-10-01T14:13:43.934813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:43.934821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:43.934823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:43.934830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256325798526450:11182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:43.934808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:43.935402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256325798526450:11182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:43.936927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:43.937146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:43.937160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:43.937172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:43.937229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:43.937270Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256323421626117:10899]
2025-10-01T14:13:43.937867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:43.938178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:43.938233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:43.938594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:43.938663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.938664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.938665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.938667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.938668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.938669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.938670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.938672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.938673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.938674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.938675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.938676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.938677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.938678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.938684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.938695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.938699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.938703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.938707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.938711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.938715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.938719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.938723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.938727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.938731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.938735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.938739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.938743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.938749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.938758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:43.938764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.938770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:43.938775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.938780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:43.938784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.938788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:43.938793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.938797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:43.938802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.938806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:43.938811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.938816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:43.938820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.938825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:43.938831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.938836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:43.938840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.938846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.938850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.938855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.938860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.938865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.938869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.938874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:43.938878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.938883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:43.938924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:43.939272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256325798526450:11182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:43.942958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:43.943190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256325798526450:11182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:43.943206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256325798526450:11182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:43.943210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256325798526450:11182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:43.943219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:43.943608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:43.943624Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:43.943626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:43.943630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:43.943636Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2048 [2:7556256323421626117:10899]
2025-10-01T14:13:43.943650Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:43.943666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:43.943675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.943678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.943680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.943694Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:43.943701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:43.943706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:43.943762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.943768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.943770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.943772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:43.943774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:43.943835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:43.943843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.943854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:43.943863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:43.943878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:43.943897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526356:2446], now have 1 active actors on pipe
2025-10-01T14:13:43.943905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256325798526488:11182], now have 1 active actors on pipe
2025-10-01T14:13:43.943912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256323421626112:10899]
2025-10-01T14:13:43.943916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256323421626112:10899]
2025-10-01T14:13:43.943919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256323421626112:10899]
2025-10-01T14:13:43.943931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:43.943940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:43.943943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:43.943945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:43.943945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:43.944072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2048
2025-10-01T14:13:43.944103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2048
2025-10-01T14:13:43.943959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:43.943969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:43.943995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256323421626112:10899]
2025-10-01T14:13:43.944000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:43.944007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:43.944224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.944232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.944257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|799ef824-c865b4ab-88a211af-d0f68967_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:43.944265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:43.944270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:43.944272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:43.944281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:43.944290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:43.944302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.944519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.944525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.944538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:43.944637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2049 partition: 0 MaxSeqNo: 45 sessionId: src_id|799ef824-c865b4ab-88a211af-d0f68967_0
2025-10-01T14:13:43.945006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9baa744b-5aa6b885-c62807b5-a003f104_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|799ef824-c865b4ab-88a211af-d0f68967_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:43.947989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799ef824-c865b4ab-88a211af-d0f68967_0] Write session: try to update token
2025-10-01T14:13:43.948013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799ef824-c865b4ab-88a211af-d0f68967_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:43.957423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:43.957445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:43.957453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256323421626112:10899]
2025-10-01T14:13:43.957496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:43.957496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:43.957665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:43.957799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:43.957927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:43.958050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:43.958257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:43.958294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:43.971313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2049 sessionId: src_id|799ef824-c865b4ab-88a211af-d0f68967_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:43.973906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:43.974154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:43.974183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:43.974222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:43.974305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:43.979152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:43.979179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:43.979181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:43.979183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:43.979193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256323421626112:10899]
2025-10-01T14:13:43.979197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256323421626112:10899]
2025-10-01T14:13:43.979201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256323421626112:10899]
2025-10-01T14:13:43.979248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:43.979250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:43.979256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:43.979258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:43.979263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:43.979267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:43.979428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:44.022578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256330093493814:10880]
2025-10-01T14:13:44.022900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2048, pipe: [1:7556256330093493814:10880]
2025-10-01T14:13:44.127834Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:44.136205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.136237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.136413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.136477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.136538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.136610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.136665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.136676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.136744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.136807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.136876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.136943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.136988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.136996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.137054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.137114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.137180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.137243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.137287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.137294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.137354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.137414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.137471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.137530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.137578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.137585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.137659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.137731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.137799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.137871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.137922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.137929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.138025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.138096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.138167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.138241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.138294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.138303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.138413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.138481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.138550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.138616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.138659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.138666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.138733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.138793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.138860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.138930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.138984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.138991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.139062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.139121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.139187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.139260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.139303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.139310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.139379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:44.139437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:44.139498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:44.139563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:44.139606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:44.139615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:44.139685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093493814:10880], now have 1 active actors on pipe
2025-10-01T14:13:44.141358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256330093493814:10880]
2025-10-01T14:13:44.141396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:44.141396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:44.141787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:44.141845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2049 reason: status is not ok: tablet will be restarted right now sessionId: src_id|799ef824-c865b4ab-88a211af-d0f68967_0
2025-10-01T14:13:44.142057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2049 sessionId: src_id|799ef824-c865b4ab-88a211af-d0f68967_0 is DEAD
2025-10-01T14:13:44.142446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799ef824-c865b4ab-88a211af-d0f68967_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:44.142459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799ef824-c865b4ab-88a211af-d0f68967_0] Write session will restart in 0.008766s
2025-10-01T14:13:44.142485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799ef824-c865b4ab-88a211af-d0f68967_0] Write session: Do CDS request
2025-10-01T14:13:44.142491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799ef824-c865b4ab-88a211af-d0f68967_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:44.153759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|799ef824-c865b4ab-88a211af-d0f68967_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.155427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:44.155486Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:44.155510Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2050
2025-10-01T14:13:44.156292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.156359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:44.156376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:44.156380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:44.156981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2050 sessionId:  describe result for acl check
2025-10-01T14:13:44.157037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:44.157044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:44.157046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:44.157052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256330093493913:11193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:44.157611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256330093493913:11193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:44.157865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:44.158105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:44.158117Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:44.158131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:44.158185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:44.158226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256327716593555:10904]
2025-10-01T14:13:44.158818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:44.159127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:44.159182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:44.159477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:44.159537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.159542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.159544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.159545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.159546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.159548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.159549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.159550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.159551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.159552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.159553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.159554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.159554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.159555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.159559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.159566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.159568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.159570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.159572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.159574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.159576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.159579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.159581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.159583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.159585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.159587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.159589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.159591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.159597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.159602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.159606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.159610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.159612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.159615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.159618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.159623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.159629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.159632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.159635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.159638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.159641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.159644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.159647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.159650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.159654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.159657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.159659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.159662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.159665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.159668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.159670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.159673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.159676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.159679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.159681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.159684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.159707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:44.160967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256330093493913:11193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:44.164514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256330093493913:11193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:44.164542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256330093493913:11193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:44.164546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256330093493913:11193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:44.164555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:44.164627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:44.165252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:44.165267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:44.165270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:44.165275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:44.165283Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2049 [2:7556256327716593555:10904]
2025-10-01T14:13:44.165299Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:44.165322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:44.165330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.165334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.165336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.165354Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:44.165367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:44.165374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:44.165433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.165441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.165443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.165447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:44.165450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:44.165523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:44.165529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.165539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.165555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.165577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:44.165599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093493951:11193], now have 1 active actors on pipe
2025-10-01T14:13:44.165607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093493817:2446], now have 1 active actors on pipe
2025-10-01T14:13:44.165615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256327716593550:10904]
2025-10-01T14:13:44.165617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256327716593550:10904]
2025-10-01T14:13:44.165619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256327716593550:10904]
2025-10-01T14:13:44.165632Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:44.165645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:44.165648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:44.165649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:44.165651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:44.165660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:44.165663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:44.165654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2049
2025-10-01T14:13:44.165654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2049
2025-10-01T14:13:44.165693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256327716593550:10904]
2025-10-01T14:13:44.165699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:44.165701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:44.165713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.165717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.165763Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:44.165773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.165777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.165779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:44.165786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.165793Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:44.165821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.166132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2050 partition: 0 MaxSeqNo: 45 sessionId: src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0
2025-10-01T14:13:44.166023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.166032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.166044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.166536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|799ef824-c865b4ab-88a211af-d0f68967_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:44.169790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0] Write session: try to update token
2025-10-01T14:13:44.169805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:44.193162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2050 sessionId: src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:44.189674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:44.189698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:44.189701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:44.189703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:44.189714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256327716593550:10904]
2025-10-01T14:13:44.189719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256327716593550:10904]
2025-10-01T14:13:44.189723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256327716593550:10904]
2025-10-01T14:13:44.189776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:44.189781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:44.189785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:44.189789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.189789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:44.189791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:44.189930Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:44.196159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:44.242241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256330093493958:10880]
2025-10-01T14:13:44.242869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2049, pipe: [1:7556256330093493958:10880]
2025-10-01T14:13:44.358097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:44.358438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.358452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.358496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093493958:10880], now have 1 active actors on pipe
2025-10-01T14:13:44.358705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:44.358777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:44.358836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:44.358839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:44.358851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256330093493958:10880]
2025-10-01T14:13:44.358900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2050 reason: error at write: Disconnected sessionId: src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0
2025-10-01T14:13:44.359159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2050 sessionId: src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0 is DEAD
2025-10-01T14:13:44.359334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:44.359346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0] Write session will restart in 0.008770s
2025-10-01T14:13:44.359380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0] Write session: Do CDS request
2025-10-01T14:13:44.359387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:44.369021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.369083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:44.369112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2051
2025-10-01T14:13:44.369313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.369353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:44.369359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:44.369364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:44.369812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2051 sessionId:  describe result for acl check
2025-10-01T14:13:44.369857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:44.369859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:44.369861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:44.369866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256330093494054:11197] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:44.370466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256330093494054:11197] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:44.370725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:44.372646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256330093494054:11197] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:44.373590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:44.373769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:44.373778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:44.373789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:44.373829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:44.373868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256327716593701:10907]
2025-10-01T14:13:44.374520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:44.374824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:44.374862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:44.375040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256330093494054:11197] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:44.375064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256330093494054:11197] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:44.375068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256330093494054:11197] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:44.375075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:44.375163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:44.375212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.375221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.375223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.375224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.375225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.375226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.375227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.375229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.375230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.375231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.375232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.375233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.375234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.375235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.375240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.375249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.375253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.375257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.375260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.375264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.375267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.375271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.375274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.375278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.375282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.375285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.375288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.375292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.375299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.375305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.375311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.375317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.375321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.375326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.375330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.375335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.375339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.375345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.375349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.375354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.375359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.375368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.375376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.375381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.375390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.375395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.375403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.375412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.375420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.375427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.375432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.375436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.375441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.375445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.375453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.375458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.375495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:44.379546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:44.380119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:44.380134Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:44.380136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:44.380140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:44.380146Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2050 [2:7556256327716593701:10907]
2025-10-01T14:13:44.380160Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:44.380181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:44.380188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.380191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.380194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.380211Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:44.380221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:44.380231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:44.380281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.380287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.380289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.380292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:44.380294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:44.380359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:44.380367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.380377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.380387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.380402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:44.380424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093493961:2446], now have 1 active actors on pipe
2025-10-01T14:13:44.380431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494094:11197], now have 1 active actors on pipe
2025-10-01T14:13:44.380438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256327716593695:10907]
2025-10-01T14:13:44.380441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256327716593695:10907]
2025-10-01T14:13:44.380443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256327716593695:10907]
2025-10-01T14:13:44.380457Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:44.380473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:44.380489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:44.380492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:44.380492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:44.380497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:44.380500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:44.380515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256327716593695:10907]
2025-10-01T14:13:44.380528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:44.380541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:44.380566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.380530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2050
2025-10-01T14:13:44.380535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2050
2025-10-01T14:13:44.380570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.380621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:44.380632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.380636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.380639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:44.380647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.380658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:44.380673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.380846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.380853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.380866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.380960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2051 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0
2025-10-01T14:13:44.381461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7322d8f-4383f30d-e72d7f0e-4cd27d52_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:44.384297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0] Write session: try to update token
2025-10-01T14:13:44.384314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:44.399456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2051 sessionId: src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:44.402468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:44.403368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.403402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.403422Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:44.403426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:44.403429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:44.403431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:44.403440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256327716593695:10907]
2025-10-01T14:13:44.403445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256327716593695:10907]
2025-10-01T14:13:44.403452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256327716593695:10907]
2025-10-01T14:13:44.403494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:44.403516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:44.403521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:44.403522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.403526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:44.403526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:44.403701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:44.458798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256330093494104:10880]
2025-10-01T14:13:44.459007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2050, pipe: [1:7556256330093494104:10880]
2025-10-01T14:13:44.540333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:44.540983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:44.541052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494104:10880], now have 1 active actors on pipe
2025-10-01T14:13:44.541275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:44.542823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:44.542879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256330093494104:10880]
2025-10-01T14:13:44.555509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:44.555527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:44.555556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2051 reason: error at write: Disconnected sessionId: src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0
2025-10-01T14:13:44.555706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2051 sessionId: src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0 is DEAD
2025-10-01T14:13:44.555908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:44.555921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0] Write session will restart in 0.005430s
2025-10-01T14:13:44.555946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0] Write session: Do CDS request
2025-10-01T14:13:44.555954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:44.562868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.563011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:44.563030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2052
2025-10-01T14:13:44.563222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.563283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:44.563307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:44.563313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:44.563905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2052 sessionId:  describe result for acl check
2025-10-01T14:13:44.563946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:44.563948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:44.563951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:44.563958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256330093494128:11202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:44.564540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256330093494128:11202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:44.569485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256330093494128:11202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:44.572030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:44.572120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256330093494128:11202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:44.572142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256330093494128:11202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:44.572146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256330093494128:11202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:44.572155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:44.575087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:44.575299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:44.575308Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:44.575318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:44.575361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:44.575418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256327716593867:10919]
2025-10-01T14:13:44.575913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:44.576208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:44.576256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:44.576522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:44.576586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.576593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.576604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.576606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.576607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.576608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.576609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.576610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.576611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.576611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.576612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.576613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.576614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.576615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.576618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.576625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.576627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.576629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.576631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.576634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.576635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.576638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.576640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.576642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.576644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.576647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.576649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.576651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.576656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.576662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.576666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.576670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.576673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.576677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.576679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.576682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.576685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.576688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.576691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.576694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.576697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.576701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.576704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.576707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.576711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.576715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.576718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.576721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.576725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.576728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.576732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.576736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.576739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.576743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.576746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.576749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.576783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:44.581102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:44.581815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:44.581833Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:44.581836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:44.581839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:44.581844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2051 [2:7556256327716593867:10919]
2025-10-01T14:13:44.581860Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:44.581876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:44.581879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.581882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.581884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.581897Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:44.581902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:44.581907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:44.581960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.581968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.581970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.581972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:44.581974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:44.582035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:44.582043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.582052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.582058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.582068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:44.582082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256327716593860:10919]
2025-10-01T14:13:44.582088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256327716593860:10919]
2025-10-01T14:13:44.582091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256327716593860:10919]
2025-10-01T14:13:44.582099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:44.582110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:44.582111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494245:11202], now have 1 active actors on pipe
2025-10-01T14:13:44.582116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494114:2446], now have 1 active actors on pipe
2025-10-01T14:13:44.582121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:44.582130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:44.582133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:44.582141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:44.582144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:44.582165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256327716593860:10919]
2025-10-01T14:13:44.582168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:44.582171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:44.582209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2051
2025-10-01T14:13:44.582215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2051
2025-10-01T14:13:44.582275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.582283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.582305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81a2f604-24280acc-4f7bf452-32ce9527_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:44.582310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.582312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.582314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:44.582321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.582329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:44.582339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.582490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.582497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.582507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.582590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2052 partition: 0 MaxSeqNo: 45 sessionId: src_id|81a2f604-24280acc-4f7bf452-32ce9527_0
2025-10-01T14:13:44.582944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7e1ca58-970bf9af-44cc024a-ead05219_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|81a2f604-24280acc-4f7bf452-32ce9527_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:44.585967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81a2f604-24280acc-4f7bf452-32ce9527_0] Write session: try to update token
2025-10-01T14:13:44.585985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81a2f604-24280acc-4f7bf452-32ce9527_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:44.603948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2052 sessionId: src_id|81a2f604-24280acc-4f7bf452-32ce9527_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:44.606913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:44.607014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:44.607037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:44.607039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:44.607040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:44.607048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256327716593860:10919]
2025-10-01T14:13:44.607053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256327716593860:10919]
2025-10-01T14:13:44.607058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256327716593860:10919]
2025-10-01T14:13:44.607083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:44.607091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:44.607095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:44.607103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.607109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.607123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:44.607129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.607130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:44.607270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:44.642647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256330093494270:10880]
2025-10-01T14:13:44.642932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2051, pipe: [1:7556256330093494270:10880]
2025-10-01T14:13:44.743540Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:44.743856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494270:10880], now have 1 active actors on pipe
2025-10-01T14:13:44.744149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256330093494270:10880]
2025-10-01T14:13:44.744156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:44.744160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:44.744194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:44.744257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2052 reason: error at write: Disconnected sessionId: src_id|81a2f604-24280acc-4f7bf452-32ce9527_0
2025-10-01T14:13:44.744075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:44.744455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2052 sessionId: src_id|81a2f604-24280acc-4f7bf452-32ce9527_0 is DEAD
2025-10-01T14:13:44.744591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a2f604-24280acc-4f7bf452-32ce9527_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:44.744607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a2f604-24280acc-4f7bf452-32ce9527_0] Write session will restart in 0.007582s
2025-10-01T14:13:44.744634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a2f604-24280acc-4f7bf452-32ce9527_0] Write session: Do CDS request
2025-10-01T14:13:44.744640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a2f604-24280acc-4f7bf452-32ce9527_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:44.752968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81a2f604-24280acc-4f7bf452-32ce9527_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.753116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:44.753141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2053
2025-10-01T14:13:44.753304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.753340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:44.753346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:44.753351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:44.754031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2053 sessionId:  describe result for acl check
2025-10-01T14:13:44.754070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:44.754072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:44.754075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:44.754082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256330093494308:11207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:44.754674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256330093494308:11207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:44.758029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256330093494308:11207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:44.758051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:44.761651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:44.761900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:44.761915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:44.761929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:44.761982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:44.762023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256327716594004:10922]
2025-10-01T14:13:44.762663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:44.763262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256330093494308:11207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:44.763288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256330093494308:11207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:44.763291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256330093494308:11207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:44.763301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:44.763634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:44.763692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:44.764027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:44.764097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.764104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.764105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.764106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.764107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.764109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.764118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.764120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.764121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.764123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.764124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.764125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.764126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.764127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.764133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.764144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.764148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.764152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.764155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.764158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.764161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.764165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.764168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.764172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.764176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.764180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.764184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.764187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.764196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.764204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.764210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.764215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.764219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.764224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.764228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.764232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.764237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.764242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.764280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.764292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.764296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.764301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.764306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.764311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.764321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.764326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.764330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.764335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.764339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.764344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.764358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.764369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.764373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.764378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.764383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.764387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.764424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:44.769001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:44.769604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:44.769609Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:44.769611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:44.769615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:44.769622Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2052 [2:7556256327716594004:10922]
2025-10-01T14:13:44.769637Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:44.769655Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:44.769659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.769663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.769666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.769681Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:44.769687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:44.769692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:44.769747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.769750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.769752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.769756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:44.769759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:44.769825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:44.769837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.769848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.769859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.769874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:44.769898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494405:11207], now have 1 active actors on pipe
2025-10-01T14:13:44.769913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494272:2446], now have 1 active actors on pipe
2025-10-01T14:13:44.769922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256327716593999:10922]
2025-10-01T14:13:44.769925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256327716593999:10922]
2025-10-01T14:13:44.769927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256327716593999:10922]
2025-10-01T14:13:44.769938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:44.769947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:44.769950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:44.769952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:44.769952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:44.769966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:44.769969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:44.769998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256327716593999:10922]
2025-10-01T14:13:44.770001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:44.770016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:44.770038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.770043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.769977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2052
2025-10-01T14:13:44.770069Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:44.770025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2052
2025-10-01T14:13:44.770083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.770087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.770090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:44.770098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.770107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:44.770125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.770260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.770270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.770285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.770364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2053 partition: 0 MaxSeqNo: 45 sessionId: src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0
2025-10-01T14:13:44.770831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a2f604-24280acc-4f7bf452-32ce9527_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:44.773819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0] Write session: try to update token
2025-10-01T14:13:44.773839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:44.791400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:44.791420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:44.791422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:44.791423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:44.791432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256327716593999:10922]
2025-10-01T14:13:44.791439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256327716593999:10922]
2025-10-01T14:13:44.791442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256327716593999:10922]
2025-10-01T14:13:44.791484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:44.791488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:44.791491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:44.791492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:44.791499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.791502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:44.791634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:44.796423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2053 sessionId: src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:44.799874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:44.844385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256330093494417:10880]
2025-10-01T14:13:44.844917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2052, pipe: [1:7556256330093494417:10880]
2025-10-01T14:13:44.944516Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:44.945040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.945054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.945095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494417:10880], now have 1 active actors on pipe
2025-10-01T14:13:44.945354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256330093494417:10880]
2025-10-01T14:13:44.945376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:44.945382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:44.945399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:44.945448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2053 reason: error at write: Disconnected sessionId: src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0
2025-10-01T14:13:44.945355Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:44.945672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2053 sessionId: src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0 is DEAD
2025-10-01T14:13:44.945869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:44.945876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0] Write session will restart in 0.007027s
2025-10-01T14:13:44.945903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0] Write session: Do CDS request
2025-10-01T14:13:44.945910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:44.953922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.954008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:44.954024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2054
2025-10-01T14:13:44.954152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:44.954187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:44.954196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:44.954200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:44.954685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2054 sessionId:  describe result for acl check
2025-10-01T14:13:44.954728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:44.954734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:44.954737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:44.954742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256330093494441:11212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:44.955413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256330093494441:11212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:44.957901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256330093494441:11212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:44.959559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:44.963559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:44.963837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:44.963851Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:44.963861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:44.963939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:44.964017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256327716594142:10924]
2025-10-01T14:13:44.964101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256330093494441:11212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:44.964120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256330093494441:11212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:44.964124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256330093494441:11212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:44.964133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:44.964688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:44.965013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:44.965065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:44.965428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:44.965508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.965516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.965517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.965519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.965520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.965522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.965523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.965524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.965526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.965527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.965528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.965529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.965531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.965533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.965538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.965549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.965552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.965556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.965560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.965564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.965568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.965572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.965575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.965580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.965583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.965587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.965591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.965594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.965602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.965609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:44.965615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.965621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:44.965626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.965631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:44.965637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.965644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:44.965649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.965654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:44.965659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.965664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:44.965670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.965675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:44.965681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.965686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:44.965692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.965697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:44.965703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.965709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.965714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.965718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.965722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.965727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.965732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.965742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:44.965747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.965755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:44.965794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:44.974710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:44.975403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:44.975423Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:44.975428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:44.975433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:44.975440Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2053 [2:7556256327716594142:10924]
2025-10-01T14:13:44.975462Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:44.975483Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:44.975494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.975498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.975501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.975518Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:44.975529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:44.975537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:44.975614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.975625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.975628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.975632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:44.975636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:44.975720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:44.975730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:44.975741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:44.975752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:44.975774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:44.975798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494556:11212], now have 1 active actors on pipe
2025-10-01T14:13:44.975807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256330093494422:2446], now have 1 active actors on pipe
2025-10-01T14:13:44.975814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256327716594137:10924]
2025-10-01T14:13:44.975817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256327716594137:10924]
2025-10-01T14:13:44.975819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256327716594137:10924]
2025-10-01T14:13:44.975853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:44.975874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:44.975872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:44.975883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:44.975886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:44.975896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:44.975900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:44.975903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2053
2025-10-01T14:13:44.975912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2053
2025-10-01T14:13:44.975945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256327716594137:10924]
2025-10-01T14:13:44.975954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:44.975956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:44.975986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.975997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.976036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cca4e79-18140515-8e8cac15-84e350b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:44.976048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:44.976052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:44.976060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:44.976070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:44.976084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:44.976114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.976280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.976291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.976306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:44.976395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2054 partition: 0 MaxSeqNo: 45 sessionId: src_id|9cca4e79-18140515-8e8cac15-84e350b2_0
2025-10-01T14:13:44.976803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d34f7a7-fc7cd3c5-c9f6a6ac-c6b96b7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9cca4e79-18140515-8e8cac15-84e350b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:44.983052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cca4e79-18140515-8e8cac15-84e350b2_0] Write session: try to update token
2025-10-01T14:13:44.983074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cca4e79-18140515-8e8cac15-84e350b2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:44.996848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2054 sessionId: src_id|9cca4e79-18140515-8e8cac15-84e350b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:44.999297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:44.999569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:44.999616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:44.999662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:44.999763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:45.008910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:45.008932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:45.008935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:45.008937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:45.008947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256327716594137:10924]
2025-10-01T14:13:45.008952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256327716594137:10924]
2025-10-01T14:13:45.008955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256327716594137:10924]
2025-10-01T14:13:45.008993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:45.009006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:45.009007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:45.009009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:45.009014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.009016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:45.009164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:45.045507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256334388461884:10880]
2025-10-01T14:13:45.045642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2053, pipe: [1:7556256334388461884:10880]
2025-10-01T14:13:45.154131Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:45.163619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.163650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.163833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.163902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.163968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.164047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.164280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.164294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.164391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.164457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.164530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.164615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.164663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.164672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.164738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.164805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.164876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.164938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.164977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.164980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.165047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.165109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.165172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.165236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.165277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.165280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.165348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.165406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.165471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.165535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.165587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.165590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.165681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.165766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.165842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.165920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.165968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.165971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.166057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.166131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.166214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.166290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.166341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.166344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.166493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.167886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256334388461884:10880]
2025-10-01T14:13:45.167926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:45.167928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:45.167955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2054 reason: error at write: Disconnected sessionId: src_id|9cca4e79-18140515-8e8cac15-84e350b2_0
2025-10-01T14:13:45.168165Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:45.168398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cca4e79-18140515-8e8cac15-84e350b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:45.168410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cca4e79-18140515-8e8cac15-84e350b2_0] Write session will restart in 0.006396s
2025-10-01T14:13:45.168439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cca4e79-18140515-8e8cac15-84e350b2_0] Write session: Do CDS request
2025-10-01T14:13:45.168445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cca4e79-18140515-8e8cac15-84e350b2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:45.168220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2054 sessionId: src_id|9cca4e79-18140515-8e8cac15-84e350b2_0 is DEAD
2025-10-01T14:13:45.166575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.166670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.166753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.166810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.166813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.166904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.166975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.167046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.167118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.167174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.167176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.167264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.167335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.167412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.167494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.167543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.167546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.167624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388461884:10880], now have 1 active actors on pipe
2025-10-01T14:13:45.168429Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:45.175929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cca4e79-18140515-8e8cac15-84e350b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.176136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:45.176153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2055
2025-10-01T14:13:45.176261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.176293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:45.176306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:45.176310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:45.176702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2055 sessionId:  describe result for acl check
2025-10-01T14:13:45.176732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:45.176740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:45.176742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:45.176747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256334388461920:11223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:45.177244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256334388461920:11223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:45.179781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256334388461920:11223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:45.180695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:45.183948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:45.184215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:45.184232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:45.184243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:45.184304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:45.184358Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256332011561586:10929]
2025-10-01T14:13:45.184584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256334388461920:11223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:45.184614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256334388461920:11223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:45.184617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256334388461920:11223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:45.184626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:45.185042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:45.185450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:45.185534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:45.185822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:45.185877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.185882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.185883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.185884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.185885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.185886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.185887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.185888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.185889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.185889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.185890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.185891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.185892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.185893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.185897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.185903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.185906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.185908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.185911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.185913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.185916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.185918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.185920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.185923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.185925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.185927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.185929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.185932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.185938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.185943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.185948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.185952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.185955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.185959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.185961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.185965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.185968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.185971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.185973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.185977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.185980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.185983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.185986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.185989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.185991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.185995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.185997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.186000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.186003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.186006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.186008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.186011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.186014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.186017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.186019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.186022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.186051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:45.190151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:45.190805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:45.190826Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:45.190829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:45.190832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:45.190840Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2054 [2:7556256332011561586:10929]
2025-10-01T14:13:45.190857Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:45.190872Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:45.190881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.190884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.190886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.190900Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:45.190905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:45.190911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:45.190967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.190974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.190979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.190982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:45.190985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:45.191053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:45.191059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.191069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.191083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.191102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:45.191126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462026:11223], now have 1 active actors on pipe
2025-10-01T14:13:45.191133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388461892:2446], now have 1 active actors on pipe
2025-10-01T14:13:45.191140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256332011561581:10929]
2025-10-01T14:13:45.191146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256332011561581:10929]
2025-10-01T14:13:45.191148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256332011561581:10929]
2025-10-01T14:13:45.191161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:45.191173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:45.191178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:45.191181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:45.191183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:45.191192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:45.191195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:45.191229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256332011561581:10929]
2025-10-01T14:13:45.191237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:45.191257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:45.191214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2054
2025-10-01T14:13:45.191238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2054
2025-10-01T14:13:45.191283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.191292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.191318Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc5b3989-9f811883-38a844a6-3dccc286_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:45.191329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.191334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.191336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:45.191345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.191353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:45.191370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.191616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.191637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.191675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.191837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2055 partition: 0 MaxSeqNo: 45 sessionId: src_id|bc5b3989-9f811883-38a844a6-3dccc286_0
2025-10-01T14:13:45.192221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cca4e79-18140515-8e8cac15-84e350b2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bc5b3989-9f811883-38a844a6-3dccc286_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:45.195364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5b3989-9f811883-38a844a6-3dccc286_0] Write session: try to update token
2025-10-01T14:13:45.195386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5b3989-9f811883-38a844a6-3dccc286_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:45.210677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2055 sessionId: src_id|bc5b3989-9f811883-38a844a6-3dccc286_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:45.211726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:45.211752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:45.211765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256332011561581:10929]
2025-10-01T14:13:45.211813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:45.211828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:45.212011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:45.212167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:45.212320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:45.212471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:45.212703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:45.212747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:45.213425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:45.213677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.213693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.213729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:45.213862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:45.232611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:45.232630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:45.232632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:45.232634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:45.232645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256332011561581:10929]
2025-10-01T14:13:45.232649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256332011561581:10929]
2025-10-01T14:13:45.232653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256332011561581:10929]
2025-10-01T14:13:45.232703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:45.232711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.232712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:45.232724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:45.232734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:45.232739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:45.232850Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:45.268235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256334388462041:10880]
2025-10-01T14:13:45.268800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2054, pipe: [1:7556256334388462041:10880]
2025-10-01T14:13:45.375912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:45.384319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.384358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.384547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.384629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.384703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.384769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.384821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.384830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.384901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.384966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.385030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.385108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.385159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.385169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.385260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.385336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.385413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.385489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.385545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.385551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.385631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.385702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.385776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.385856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.385909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.385917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.386001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.386086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.386167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.386245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.386298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.386305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.386399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.386461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.386524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.386594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.386636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.386645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.386715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.386780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.386844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.386908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.386958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.386965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.387031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.387097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.387168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.387233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.387277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.387285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.387347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.387405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.387469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.387537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.387578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.387583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.387645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.387706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.387769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.387833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.387874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.387880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.387946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462041:10880], now have 1 active actors on pipe
2025-10-01T14:13:45.388236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:45.388252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:45.388253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256334388462041:10880]
2025-10-01T14:13:45.388281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:45.388283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2055 reason: error at write: Disconnected sessionId: src_id|bc5b3989-9f811883-38a844a6-3dccc286_0
2025-10-01T14:13:45.388508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2055 sessionId: src_id|bc5b3989-9f811883-38a844a6-3dccc286_0 is DEAD
2025-10-01T14:13:45.388664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5b3989-9f811883-38a844a6-3dccc286_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:45.388675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5b3989-9f811883-38a844a6-3dccc286_0] Write session will restart in 0.007686s
2025-10-01T14:13:45.388701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5b3989-9f811883-38a844a6-3dccc286_0] Write session: Do CDS request
2025-10-01T14:13:45.388708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5b3989-9f811883-38a844a6-3dccc286_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:45.389043Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:45.397904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5b3989-9f811883-38a844a6-3dccc286_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.397993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:45.398011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2056
2025-10-01T14:13:45.398119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.398151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:45.398160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:45.398168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:45.398619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2056 sessionId:  describe result for acl check
2025-10-01T14:13:45.398659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:45.398665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:45.398667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:45.398672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256334388462059:11227] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:45.399142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256334388462059:11227] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:45.401730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256334388462059:11227] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:45.405055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256334388462059:11227] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:45.405070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256334388462059:11227] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:45.405074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256334388462059:11227] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:45.405082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:45.406329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:45.409120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:45.409359Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:45.409370Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:45.409382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:45.409450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:45.409498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256332011561739:10932]
2025-10-01T14:13:45.410193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:45.410513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:45.410577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:45.410874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:45.410930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.410935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.410937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.410938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.410940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.410941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.410943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.410945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.410946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.410947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.410948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.410949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.410950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.410950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.410954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.410960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.410962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.410964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.410966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.410968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.410970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.410983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.410986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.410989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.410991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.410993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.410996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.410998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.411005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.411010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.411014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.411018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.411021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.411024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.411027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.411030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.411033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.411037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.411040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.411043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.411046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.411049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.411051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.411054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.411057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.411061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.411064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.411067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.411071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.411074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.411077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.411082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.411085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.411089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.411092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.411095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.411134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:45.416325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:45.417038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:45.417052Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:45.417057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:45.417062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:45.417070Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2055 [2:7556256332011561739:10932]
2025-10-01T14:13:45.417088Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:45.417108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:45.417111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.417115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.417117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.417134Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:45.417139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:45.417154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:45.417225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.417232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.417235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.417238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:45.417241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:45.417321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:45.417333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.417346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.417357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.417374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:45.417498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2055
2025-10-01T14:13:45.417512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2055
2025-10-01T14:13:45.417402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462044:2446], now have 1 active actors on pipe
2025-10-01T14:13:45.417414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462177:11227], now have 1 active actors on pipe
2025-10-01T14:13:45.417422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256332011561733:10932]
2025-10-01T14:13:45.417424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256332011561733:10932]
2025-10-01T14:13:45.417427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256332011561733:10932]
2025-10-01T14:13:45.417441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:45.417453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:45.417456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:45.417457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:45.417460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:45.417473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:45.417477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:45.417515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256332011561733:10932]
2025-10-01T14:13:45.417518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:45.417530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:45.417558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.417562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.417591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:45.417598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.417602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.417604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:45.417615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.417624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:45.417637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.417979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.417988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.418003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.418317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2056 partition: 0 MaxSeqNo: 45 sessionId: src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0
2025-10-01T14:13:45.418795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc5b3989-9f811883-38a844a6-3dccc286_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:45.421954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0] Write session: try to update token
2025-10-01T14:13:45.421976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:45.432399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:45.432422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:45.432437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256332011561733:10932]
2025-10-01T14:13:45.432490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:45.432497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:45.432726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:45.432887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:45.433044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:45.433202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:45.433435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:45.433484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:45.438140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2056 sessionId: src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:45.441069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:45.441282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.441302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.441332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:45.441450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:45.453516Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:45.453532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:45.453534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:45.453536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:45.453544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256332011561733:10932]
2025-10-01T14:13:45.453551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256332011561733:10932]
2025-10-01T14:13:45.453554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256332011561733:10932]
2025-10-01T14:13:45.453595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:45.453600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.453601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:45.453613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:45.453621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:45.453627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:45.453746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:45.488445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256334388462195:10880]
2025-10-01T14:13:45.488776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2055, pipe: [1:7556256334388462195:10880]
2025-10-01T14:13:45.581639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:45.590172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.590205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.590414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.590490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.590564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.590641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.590702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.590710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.590795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.590866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.590936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.591021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.591081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.591088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.591158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.591222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.591295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.591358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.591409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.591416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.591488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.591555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.591618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.591680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.591730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.591739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.591807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.591868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.591934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.592006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.592058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.592064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.592131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.592191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.592252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.592321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.592378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.592386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.592453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.592514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.592692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.592790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.592852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.592867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.592965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.593046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.593127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.593204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.593263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.593272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.593354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.593428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.593504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.593585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.593641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.593650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.593731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:45.593804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:45.593890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:45.593970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:45.594028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:45.594037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:45.594107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462195:10880], now have 1 active actors on pipe
2025-10-01T14:13:45.594322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:45.594325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256334388462195:10880]
2025-10-01T14:13:45.594368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:45.594419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:45.594459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2056 reason: error at write: Disconnected sessionId: src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0
2025-10-01T14:13:45.594678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2056 sessionId: src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0 is DEAD
2025-10-01T14:13:45.594795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:45.594807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0] Write session will restart in 0.005524s
2025-10-01T14:13:45.594836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0] Write session: Do CDS request
2025-10-01T14:13:45.594842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:45.595379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:45.601971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.602028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:45.602051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2057
2025-10-01T14:13:45.602186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.602224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:45.602230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:45.602234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:45.602672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2057 sessionId:  describe result for acl check
2025-10-01T14:13:45.602708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:45.602710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:45.602712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:45.602717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256334388462220:11234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:45.603176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256334388462220:11234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:45.605428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256334388462220:11234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:45.607290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:45.609620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:45.609771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256334388462220:11234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:45.609786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256334388462220:11234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:45.609788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256334388462220:11234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:45.609803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:45.609855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:45.609865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:45.609876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:45.609931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:45.609972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256332011561907:10944]
2025-10-01T14:13:45.610626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:45.610868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:45.610911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:45.611224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:45.611277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.611282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.611284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.611285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.611286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.611288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.611289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.611290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.611291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.611293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.611294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.611295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.611296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.611310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.611315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.611324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.611329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.611333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.611337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.611342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.611346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.611350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.611354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.611359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.611368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.611374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.611378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.611386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.611394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.611407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.611417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.611427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.611436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.611442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.611447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.611456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.611466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.611475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.611480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.611490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.611500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.611506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.611515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.611525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.611534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.611540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.611549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.611554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.611564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.611571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.611580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.611589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.611598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.611603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.611607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.611612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.611660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:45.615917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:45.616683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:45.616695Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:45.616698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:45.616701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:45.616709Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2056 [2:7556256332011561907:10944]
2025-10-01T14:13:45.616726Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:45.616744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:45.616747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.616750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.616752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.616769Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:45.616775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:45.616782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:45.616839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.616846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.616848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.616852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:45.616855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:45.616928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:45.616936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.616949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.616967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.616987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:45.617010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462205:2446], now have 1 active actors on pipe
2025-10-01T14:13:45.617018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462343:11234], now have 1 active actors on pipe
2025-10-01T14:13:45.617026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256332011561902:10944]
2025-10-01T14:13:45.617028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256332011561902:10944]
2025-10-01T14:13:45.617031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256332011561902:10944]
2025-10-01T14:13:45.617044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:45.617064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:45.617065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:45.617067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:45.617069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:45.617080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:45.617084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:45.617114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256332011561902:10944]
2025-10-01T14:13:45.617084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2056
2025-10-01T14:13:45.617122Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:45.617087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2056
2025-10-01T14:13:45.617124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:45.617153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.617159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.617194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bda315de-e9958575-bccbef00-ad5777cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:45.617204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.617209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.617216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:45.617227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.617240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:45.617263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.617408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.617430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.617458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.617683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2057 partition: 0 MaxSeqNo: 45 sessionId: src_id|bda315de-e9958575-bccbef00-ad5777cf_0
2025-10-01T14:13:45.618116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f00fb9e5-2e360d84-c646c77e-d8cc3028_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bda315de-e9958575-bccbef00-ad5777cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:45.621948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda315de-e9958575-bccbef00-ad5777cf_0] Write session: try to update token
2025-10-01T14:13:45.621973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda315de-e9958575-bccbef00-ad5777cf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:45.636812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2057 sessionId: src_id|bda315de-e9958575-bccbef00-ad5777cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:45.639426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:45.641035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.641058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.641079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:45.641082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:45.641085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:45.641087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:45.641096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256332011561902:10944]
2025-10-01T14:13:45.641103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256332011561902:10944]
2025-10-01T14:13:45.641108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256332011561902:10944]
2025-10-01T14:13:45.641164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:45.641165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:45.641172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:45.641173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.641176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:45.641176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:45.641312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:45.694265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256334388462366:10880]
2025-10-01T14:13:45.694515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2056, pipe: [1:7556256334388462366:10880]
2025-10-01T14:13:45.785374Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:45.785625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:45.785682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462366:10880], now have 1 active actors on pipe
2025-10-01T14:13:45.785799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:45.785877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256334388462366:10880]
2025-10-01T14:13:45.785908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:45.785955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:45.785964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:45.785985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2057 reason: error at write: Disconnected sessionId: src_id|bda315de-e9958575-bccbef00-ad5777cf_0
2025-10-01T14:13:45.786164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2057 sessionId: src_id|bda315de-e9958575-bccbef00-ad5777cf_0 is DEAD
2025-10-01T14:13:45.786281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda315de-e9958575-bccbef00-ad5777cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:45.786289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda315de-e9958575-bccbef00-ad5777cf_0] Write session will restart in 0.008647s
2025-10-01T14:13:45.786306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda315de-e9958575-bccbef00-ad5777cf_0] Write session: Do CDS request
2025-10-01T14:13:45.786313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda315de-e9958575-bccbef00-ad5777cf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:45.795948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bda315de-e9958575-bccbef00-ad5777cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.796076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:45.796096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2058
2025-10-01T14:13:45.796237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.796288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:45.796299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:45.796302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:45.796688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2058 sessionId:  describe result for acl check
2025-10-01T14:13:45.796725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:45.796727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:45.796728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:45.796734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256334388462470:11239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:45.797259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256334388462470:11239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:45.797280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:45.798985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256334388462470:11239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:45.799731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:45.799922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:45.799931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:45.799943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:45.799994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:45.800034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256332011562051:10947]
2025-10-01T14:13:45.800692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:45.800989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:45.801029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:45.801332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:45.801384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.801390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.801391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.801392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.801394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.801395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.801396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.801397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.801399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.801400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.801401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.801402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.801403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.801405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.801410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.801420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.801425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.801429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.801433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.801437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.801441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.801445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.801450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.801455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.801459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.801463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.801466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.801470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.801478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.801490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.801500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.801474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256334388462470:11239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:45.801506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.801486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256334388462470:11239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:45.801515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.801490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256334388462470:11239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:45.801520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.801495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:45.801526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.801536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.801542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.801551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.801556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.801561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.801571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.801580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.801584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.801589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.801597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.801603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.801611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.801616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.801622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.801631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.801636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.801644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.801649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.801658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.801662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.801671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.801712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:45.805411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:45.806089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:45.806106Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:45.806108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:45.806112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:45.806119Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2057 [2:7556256332011562051:10947]
2025-10-01T14:13:45.806135Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:45.806152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:45.806155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.806159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.806161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.806176Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:45.806186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:45.806192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:45.806250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.806257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.806259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.806263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:45.806266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:45.806331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:45.806338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.806351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.806367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.806406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:45.806431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462509:11239], now have 1 active actors on pipe
2025-10-01T14:13:45.806438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462369:2446], now have 1 active actors on pipe
2025-10-01T14:13:45.806446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256332011562045:10947]
2025-10-01T14:13:45.806448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256332011562045:10947]
2025-10-01T14:13:45.806450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256332011562045:10947]
2025-10-01T14:13:45.806465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:45.806482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:45.806500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:45.806502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:45.806483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2057
2025-10-01T14:13:45.806506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:45.806484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2057
2025-10-01T14:13:45.806507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:45.806508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:45.806538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256332011562045:10947]
2025-10-01T14:13:45.806547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:45.806558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:45.806562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.806567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.806607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ccc020b1-2fad6526-f5628848-c33b5895_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:45.806618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.806621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.806628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:45.806636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.806648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:45.806668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.806888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.806898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.806913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.807004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2058 partition: 0 MaxSeqNo: 45 sessionId: src_id|ccc020b1-2fad6526-f5628848-c33b5895_0
2025-10-01T14:13:45.807394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bda315de-e9958575-bccbef00-ad5777cf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ccc020b1-2fad6526-f5628848-c33b5895_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:45.810266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc020b1-2fad6526-f5628848-c33b5895_0] Write session: try to update token
2025-10-01T14:13:45.810284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc020b1-2fad6526-f5628848-c33b5895_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:45.825529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2058 sessionId: src_id|ccc020b1-2fad6526-f5628848-c33b5895_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:45.827878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:45.828295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.828318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.828337Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:45.828339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:45.828341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:45.828343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:45.828351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256332011562045:10947]
2025-10-01T14:13:45.828355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256332011562045:10947]
2025-10-01T14:13:45.828359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256332011562045:10947]
2025-10-01T14:13:45.828389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:45.828394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:45.828398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:45.828412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:45.828422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.828424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:45.828537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:45.886311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256334388462518:10880]
2025-10-01T14:13:45.886620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2057, pipe: [1:7556256334388462518:10880]
2025-10-01T14:13:45.970365Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:45.970775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:45.970822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462518:10880], now have 1 active actors on pipe
2025-10-01T14:13:45.970932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:45.971041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:45.971051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:45.971052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:45.971096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256334388462518:10880]
2025-10-01T14:13:45.971127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2058 reason: error at write: Disconnected sessionId: src_id|ccc020b1-2fad6526-f5628848-c33b5895_0
2025-10-01T14:13:45.971302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2058 sessionId: src_id|ccc020b1-2fad6526-f5628848-c33b5895_0 is DEAD
2025-10-01T14:13:45.971418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc020b1-2fad6526-f5628848-c33b5895_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:45.971428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc020b1-2fad6526-f5628848-c33b5895_0] Write session will restart in 0.008706s
2025-10-01T14:13:45.971446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc020b1-2fad6526-f5628848-c33b5895_0] Write session: Do CDS request
2025-10-01T14:13:45.971451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc020b1-2fad6526-f5628848-c33b5895_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:45.980807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc020b1-2fad6526-f5628848-c33b5895_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.980912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:45.980940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2059
2025-10-01T14:13:45.981068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:45.981108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:45.981118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:45.981121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:45.981530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2059 sessionId:  describe result for acl check
2025-10-01T14:13:45.981563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:45.981568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:45.981558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:45.981570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:45.981575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256334388462628:11244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:45.982093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256334388462628:11244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:45.983338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:45.983482Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:45.983489Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:45.983496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:45.983528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:45.983552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256332011562193:10949]
2025-10-01T14:13:45.983642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256334388462628:11244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:45.983931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:45.984116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:45.984144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:45.984343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:45.984378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.984382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.984383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.984383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.984384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.984384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.984385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.984385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.984386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.984387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.984387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.984388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.984388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.984389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.984392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.984397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.984400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.984402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.984404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.984406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.984408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.984410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.984412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.984414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.984416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.984418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.984420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.984422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.984427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.984432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:45.984436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.984439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:45.984441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.984444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:45.984446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.984449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:45.984451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.984454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:45.984456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.984459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:45.984461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.984464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:45.984467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.984470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:45.984472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.984475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:45.984478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.984481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.984484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.984487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.984489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.984491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.984494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.984496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:45.984500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.984503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:45.984523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:45.987683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256334388462628:11244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:45.987697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256334388462628:11244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:45.987700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256334388462628:11244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:45.987708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:45.988063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:45.988767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:45.988786Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:45.988791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:45.988794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:45.988801Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2058 [2:7556256332011562193:10949]
2025-10-01T14:13:45.988810Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:45.988822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:45.988827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.988830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.988831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.988842Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:45.988849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:45.988853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:45.988893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.988898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.988900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.988902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:45.988904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:45.988953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:45.988958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:45.988966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:45.988972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:45.988980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:45.988995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462665:11244], now have 1 active actors on pipe
2025-10-01T14:13:45.989004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256332011562187:10949]
2025-10-01T14:13:45.989005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256332011562187:10949]
2025-10-01T14:13:45.989006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256332011562187:10949]
2025-10-01T14:13:45.989016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:45.989025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256334388462525:2446], now have 1 active actors on pipe
2025-10-01T14:13:45.989031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:45.989043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:45.989045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:45.989048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:45.989048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:45.989050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:45.989066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256332011562187:10949]
2025-10-01T14:13:45.989071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:45.989074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:45.989136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2058
2025-10-01T14:13:45.989137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2058
2025-10-01T14:13:45.989215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.989221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.989240Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:45.989249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:45.989252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:45.989253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:45.989259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:45.989269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:45.989282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.989417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:45.989422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:45.989432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:45.989520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2059 partition: 0 MaxSeqNo: 45 sessionId: src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0
2025-10-01T14:13:45.989844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ccc020b1-2fad6526-f5628848-c33b5895_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:45.992680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0] Write session: try to update token
2025-10-01T14:13:45.992696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:46.006434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2059 sessionId: src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:46.008756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:46.008912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.008934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.011253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:46.011289Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:46.011293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:46.011295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:46.011297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:46.011305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256332011562187:10949]
2025-10-01T14:13:46.011309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256332011562187:10949]
2025-10-01T14:13:46.011312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256332011562187:10949]
2025-10-01T14:13:46.011348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:46.011350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:46.011357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.011359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:46.011359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:46.011363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:46.011424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:46.011483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:46.071068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256338683429981:10880]
2025-10-01T14:13:46.071721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2058, pipe: [1:7556256338683429981:10880]
2025-10-01T14:13:46.177808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:46.187761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.187796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.188019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.188133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.188212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.188290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.188334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.188339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.188416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.188477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.188556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.188637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.188691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.188698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.188763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.188814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.188886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.188984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.189037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.189040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.189123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.189223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.189313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.189385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.189424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.189427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.189492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.189550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.189608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.189665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.189701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.189704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.189793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.189867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.189949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.190037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.190110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.190113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.190230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.190331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.193418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:46.193429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0] Write session will restart in 0.006850s
2025-10-01T14:13:46.193454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0] Write session: Do CDS request
2025-10-01T14:13:46.193461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:46.190646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.190773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.190833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.190837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.190970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.191080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.191188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.191301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.191365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.191371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.191508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.191614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.191700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.191813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.191882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.191886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.192013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.192123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.192229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.192351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.192417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.192421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.192509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683429981:10880], now have 1 active actors on pipe
2025-10-01T14:13:46.193784Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:46.192863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256338683429981:10880]
2025-10-01T14:13:46.192905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:46.192908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:46.192957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2059 reason: error at write: Disconnected sessionId: src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0
2025-10-01T14:13:46.193206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2059 sessionId: src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0 is DEAD
2025-10-01T14:13:46.193212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:46.202901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:46.203204Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:46.203221Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2060
2025-10-01T14:13:46.203324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:46.203350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:46.203355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:46.203359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:46.203685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2060 sessionId:  describe result for acl check
2025-10-01T14:13:46.203709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:46.203711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:46.203712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:46.203716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256338683430010:11255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:46.204211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256338683430010:11255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:46.207521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256338683430010:11255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:46.209748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:46.212032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:46.212258Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:46.212266Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:46.212278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:46.212328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:46.212335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256338683430010:11255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:46.212353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256338683430010:11255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:46.212366Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256336306529641:10954]
2025-10-01T14:13:46.212357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256338683430010:11255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:46.212366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:46.212981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:46.213323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:46.213368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:46.213694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:46.213749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.213753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.213754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.213756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.213757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.213758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.213759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.213760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.213761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.213762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.213764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.213765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.213765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.213766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.213771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.213783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.213787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.213791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.213794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.213798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.213801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.213805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.213810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.213814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.213819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.213823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.213827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.213831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.213838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.213850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.213861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.213869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.213873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.213879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.213883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.213889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.213898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.213903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.213911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.213916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.213921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.213929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.213934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.213943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.213948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.213953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.213957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.213963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.213972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.213977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.213982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.213990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.213997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.214005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.214010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.214018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.214058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:46.218093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:46.218794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:46.218808Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:46.218811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:46.218816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:46.218824Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2059 [2:7556256336306529641:10954]
2025-10-01T14:13:46.218841Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:46.218863Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:46.218870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:46.218874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:46.218876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:46.218893Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:46.218906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:46.218912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:46.218971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.218974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.218976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.218979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:46.218983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:46.219053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:46.219056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.219069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.219079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.219095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:46.219115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683430131:11255], now have 1 active actors on pipe
2025-10-01T14:13:46.219118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683429995:2446], now have 1 active actors on pipe
2025-10-01T14:13:46.219127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256336306529636:10954]
2025-10-01T14:13:46.219130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256336306529636:10954]
2025-10-01T14:13:46.219132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256336306529636:10954]
2025-10-01T14:13:46.219146Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:46.219160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:46.219161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:46.219164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:46.219166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:46.219176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:46.219180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:46.219213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256336306529636:10954]
2025-10-01T14:13:46.219220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:46.219231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:46.219730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2059
2025-10-01T14:13:46.219767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2059
2025-10-01T14:13:46.219858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.219870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.219899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:46.219907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:46.219911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:46.219914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:46.219924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:46.219936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:46.219951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:46.220130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.220137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.220152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:46.220261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2060 partition: 0 MaxSeqNo: 45 sessionId: src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0
2025-10-01T14:13:46.220811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9d9e36d-9182aa21-8fd80898-18b1dad9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:46.224124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0] Write session: try to update token
2025-10-01T14:13:46.224144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:46.236363Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:46.236379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:46.236392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256336306529636:10954]
2025-10-01T14:13:46.236447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:46.236648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:46.236794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:46.236935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:46.237075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:46.237261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:46.237300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:46.237371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:46.251360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2060 sessionId: src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:46.254082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:46.254390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.254408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.254445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:46.254560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:46.262181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:46.262200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:46.262203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:46.262205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:46.262216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256336306529636:10954]
2025-10-01T14:13:46.262219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256336306529636:10954]
2025-10-01T14:13:46.262223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256336306529636:10954]
2025-10-01T14:13:46.262272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:46.262282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.262285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:46.262302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:46.262306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:46.262309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:46.262425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:46.293321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256338683430145:10880]
2025-10-01T14:13:46.293645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2059, pipe: [1:7556256338683430145:10880]
2025-10-01T14:13:46.460026Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:46.470139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.470171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.470357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.474235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:46.474258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:46.474288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2060 reason: error at write: Disconnected sessionId: src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0
2025-10-01T14:13:46.470504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.470574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.470647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.470691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.470698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.470771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.470831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.470894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.470956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.471004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.471007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.471073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.471127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.471235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.471293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.471334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.471337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.471404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.471464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.471525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.471582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.471622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.471625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.471689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.471743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.471802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.471861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.471972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.471975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.472042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.472098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.472153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.472206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.472244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.472247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.472318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.472375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.472438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.472499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.472540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.472542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.472644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.472700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.472756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.472815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.472862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.472865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.472930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.472983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.473038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.473100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.473140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.473143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.473206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:46.473261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:46.473319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:46.473376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:46.473415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:46.473418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:46.473504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683430145:10880], now have 1 active actors on pipe
2025-10-01T14:13:46.473964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:46.474530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2060 sessionId: src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0 is DEAD
2025-10-01T14:13:46.474582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:46.474827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:46.474837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0] Write session will restart in 0.008674s
2025-10-01T14:13:46.474627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256338683430145:10880]
2025-10-01T14:13:46.474864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0] Write session: Do CDS request
2025-10-01T14:13:46.474870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:46.485035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:46.485052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2061
2025-10-01T14:13:46.490579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:46.491157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:46.491217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:46.491224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:46.491228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:46.491977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2061 sessionId:  describe result for acl check
2025-10-01T14:13:46.492013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:46.492015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:46.492017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:46.492023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256338683430169:11259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:46.492654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256338683430169:11259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:46.518095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256338683430169:11259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:46.523313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256338683430169:11259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:46.523332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256338683430169:11259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:46.523337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256338683430169:11259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:46.523346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:46.530785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:46.534574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:46.534856Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:46.534861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:46.534873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:46.534937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:46.534972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256336306529814:10957]
2025-10-01T14:13:46.535633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:46.536060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:46.536105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:46.536438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:46.536487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.536488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.536489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.536490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.536491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.536493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.536494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.536495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.536496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.536498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.536499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.536500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.536501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.536502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.536507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.536516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.536520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.536524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.536528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.536531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.536535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.536538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.536542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.536546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.536549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.536553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.536556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.536559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.536567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.536574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.536581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.536587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.536591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.536610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.536614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.536619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.536624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.536629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.536634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.536639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.536644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.536649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.536652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.536657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.536662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.536666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.536670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.536675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.536680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.536685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.536692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.536698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.536702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.536707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.536711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.536715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.536751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:46.559012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:46.559945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:46.559951Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:46.559954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:46.559958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:46.559966Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2060 [2:7556256336306529814:10957]
2025-10-01T14:13:46.559990Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:46.560007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:46.560011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:46.560014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:46.560017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:46.560032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:46.560038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:46.560044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:46.560103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.560105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.560107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.560110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:46.560113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:46.560299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:46.560301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.560313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.560324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.560340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:46.560356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256336306529808:10957]
2025-10-01T14:13:46.560359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256336306529808:10957]
2025-10-01T14:13:46.560360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256336306529808:10957]
2025-10-01T14:13:46.560370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:46.560383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:46.560396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:46.560399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:46.560438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256336306529808:10957]
2025-10-01T14:13:46.560440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:46.560581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:46.560583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:46.560585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:46.560589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:46.561505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2060
2025-10-01T14:13:46.561541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2060
2025-10-01T14:13:46.562053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683430152:2446], now have 1 active actors on pipe
2025-10-01T14:13:46.562061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683430294:11259], now have 1 active actors on pipe
2025-10-01T14:13:46.562081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.562085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.562111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:46.562119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:46.562123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:46.562127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:46.562137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:46.562149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:46.562165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:46.562550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.562565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.562593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:46.562762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2061 partition: 0 MaxSeqNo: 45 sessionId: src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0
2025-10-01T14:13:46.563187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|69075095-8b0b6546-55a0d1c2-eb4c85d7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:46.566597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0] Write session: try to update token
2025-10-01T14:13:46.566617Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:46.578518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256338683430310:10880]
2025-10-01T14:13:46.579667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683430310:10880], now have 1 active actors on pipe
2025-10-01T14:13:46.579771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2060, pipe: [1:7556256338683430310:10880]
2025-10-01T14:13:46.604360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2061 sessionId: src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:46.607264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:46.609043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.609077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.609100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:46.609104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:46.609107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:46.609110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:46.609119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256336306529808:10957]
2025-10-01T14:13:46.609124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256336306529808:10957]
2025-10-01T14:13:46.609128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256336306529808:10957]
2025-10-01T14:13:46.609193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:46.609202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.609204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:46.609375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:46.610680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:46.610689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:46.610694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:46.846524Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:46.846878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:46.847649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:46.847742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:46.847745Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:46.847823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2061 reason: error at write: Disconnected sessionId: src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0
2025-10-01T14:13:46.847987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2061 sessionId: src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0 is DEAD
2025-10-01T14:13:46.848120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:46.848158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256338683430310:10880]
2025-10-01T14:13:46.850841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:46.850850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0] Write session will restart in 0.005202s
2025-10-01T14:13:46.850879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0] Write session: Do CDS request
2025-10-01T14:13:46.850885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:46.861039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:46.862973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:46.862992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2062
2025-10-01T14:13:46.863395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:46.863428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:46.863435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:46.863439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:46.863916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2062 sessionId:  describe result for acl check
2025-10-01T14:13:46.863946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:46.863948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:46.863955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:46.863961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256338683430336:11265] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:46.864537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256338683430336:11265] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:46.871859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256338683430336:11265] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:46.884803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256338683430336:11265] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:46.884824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256338683430336:11265] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:46.884831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256338683430336:11265] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:46.884841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:46.908583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:46.914946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:46.915236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:46.915242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:46.915255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:46.915317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:46.915368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256336306529979:10970]
2025-10-01T14:13:46.916023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:46.916627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:46.916678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:46.917009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:46.917072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.917073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.917074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.917076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.917077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.917078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.917079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.917081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.917082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.917083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.917085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.917086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.917087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.917089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.917094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.917105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.917109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.917113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.917117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.917121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.917124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.917128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.917132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.917136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.917140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.917144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.917148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.917152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.917159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.917168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:46.917174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.917179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:46.917184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.917189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:46.917194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.917200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:46.917205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.917210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:46.917215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.917220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:46.917228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.917233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:46.917237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.917243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:46.917248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.917253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:46.917258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.917263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.917268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.917273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.917278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.917283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.917287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.917293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:46.917298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.917303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:46.917343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:46.926983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:46.927730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:46.927735Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:46.927739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:46.927742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:46.927750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2061 [2:7556256336306529979:10970]
2025-10-01T14:13:46.927768Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:46.927787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:46.927790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:46.927794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:46.927797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:46.927815Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:46.927824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:46.927832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:46.927892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.927895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.927897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.927901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:46.927904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:46.927989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:46.927992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.928003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:46.928014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:46.928030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:46.928047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256336306529973:10970]
2025-10-01T14:13:46.928050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256336306529973:10970]
2025-10-01T14:13:46.928052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256336306529973:10970]
2025-10-01T14:13:46.928066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:46.928083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:46.928097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:46.928100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:46.928141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256336306529973:10970]
2025-10-01T14:13:46.928143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:46.928357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:46.928362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:46.928364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:46.928369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:46.930463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683430329:2446], now have 1 active actors on pipe
2025-10-01T14:13:46.930477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683430378:11265], now have 1 active actors on pipe
2025-10-01T14:13:46.930499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.930506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.930542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:46.930554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:46.930560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:46.930563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:46.930576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:46.930592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:46.930615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:46.928961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2061
2025-10-01T14:13:46.929007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2061
2025-10-01T14:13:46.930959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.930966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.930981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:46.931116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2062 partition: 0 MaxSeqNo: 45 sessionId: src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0
2025-10-01T14:13:46.934683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dea9b4b0-e56ac744-2fe58c1e-e2168bf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:46.938871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0] Write session: try to update token
2025-10-01T14:13:46.938895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:46.946800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256338683430482:10880]
2025-10-01T14:13:46.948131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256338683430482:10880], now have 1 active actors on pipe
2025-10-01T14:13:46.948074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2061, pipe: [1:7556256338683430482:10880]
2025-10-01T14:13:46.980725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2062 sessionId: src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:46.983393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:46.983850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:46.983870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:46.986302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:46.986343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:46.986346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:46.986349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:46.986351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:46.986361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256336306529973:10970]
2025-10-01T14:13:46.986366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256336306529973:10970]
2025-10-01T14:13:46.986387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256336306529973:10970]
2025-10-01T14:13:46.986435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:46.986447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:46.986449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:46.986588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:46.986929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:46.986940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:46.986945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:46.987040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:47.199712Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:47.226059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.226091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.226288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.234513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.234624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.234696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.234742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.234748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.234844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.234913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.234982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.235066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.235116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.235119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.235195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.235255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.235319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.235380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.235429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.235432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.235517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.235579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.235638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.235710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.235762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.235765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.235829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.235887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.235945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.236007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.236048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.236050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.236141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.236215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.236296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.236377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.236431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.236436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.236527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.236630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.236711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.236790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.236847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.236850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.236938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.237010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.237082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.237154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.237201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.237207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.237293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.237362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.237429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.237499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.237557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.237564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.237654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.237723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.237799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.237889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.237937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.237940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.238956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:47.239015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256338683430482:10880]
2025-10-01T14:13:47.239040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:47.239049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:47.239076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2062 reason: error at write: Disconnected sessionId: src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0
2025-10-01T14:13:47.239774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:47.239796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0] Write session will restart in 0.007097s
2025-10-01T14:13:47.239312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2062 sessionId: src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0 is DEAD
2025-10-01T14:13:47.239823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0] Write session: Do CDS request
2025-10-01T14:13:47.239830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:47.246590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:47.249182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:47.249622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:47.249647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2063
2025-10-01T14:13:47.249806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:47.249845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:47.249856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:47.249860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:47.250969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2063 sessionId:  describe result for acl check
2025-10-01T14:13:47.251019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:47.251025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:47.251028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:47.251033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256342978397822:11279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:47.251590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256342978397822:11279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:47.256440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256342978397822:11279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:47.264394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256342978397822:11279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:47.264417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256342978397822:11279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:47.264420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256342978397822:11279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:47.264429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:47.280486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:47.283368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:47.283639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:47.283644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:47.283657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:47.283712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:47.283751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256340601497433:10975]
2025-10-01T14:13:47.284393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:47.285654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:47.285720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:47.286095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:47.286155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.286156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.286158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.286159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.286160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.286162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.286163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.286165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.286166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.286168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.286169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.286170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.286171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.286172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.286179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.286189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.286193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.286197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.286200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.286204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.286208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.286211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.286215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.286219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.286222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.286226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.286229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.286233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.286243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.286250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.286257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.286263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.286268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.286273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.286279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.286284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.286289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.286294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.286298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.286303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.286308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.286314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.286319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.286323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.286329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.286334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.286339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.286344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.286349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.286353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.286357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.286363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.286384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.286389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.286394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.286400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.286440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:47.296414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:47.297474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:47.297481Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:47.297483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:47.297488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:47.297497Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2062 [2:7556256340601497433:10975]
2025-10-01T14:13:47.297515Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:47.297534Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:47.297538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:47.297542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:47.297544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:47.297563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:47.297569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:47.297576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:47.297645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.297648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.297649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.297653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:47.297655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:47.297739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:47.297742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.297755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.297765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.297781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:47.297799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256340601497427:10975]
2025-10-01T14:13:47.297801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256340601497427:10975]
2025-10-01T14:13:47.297804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256340601497427:10975]
2025-10-01T14:13:47.297822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:47.297842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:47.297856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:47.297859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:47.297902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256340601497427:10975]
2025-10-01T14:13:47.297904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:47.297994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:47.297996Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:47.297998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:47.298003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:47.298464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2062
2025-10-01T14:13:47.298490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2062
2025-10-01T14:13:47.299668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2063 partition: 0 MaxSeqNo: 45 sessionId: src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0
2025-10-01T14:13:47.298986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978397870:11279], now have 1 active actors on pipe
2025-10-01T14:13:47.299000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978397814:2446], now have 1 active actors on pipe
2025-10-01T14:13:47.299022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.299029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.299063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:47.299073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:47.299079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:47.299082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:47.299094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:47.299110Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:47.299134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:47.299544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.299551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.299573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:47.300122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf8ccd78-1dfca3b5-281e5ff-27b069_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:47.309368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0] Write session: try to update token
2025-10-01T14:13:47.309395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:47.331671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2063 sessionId: src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:47.338784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256342978397967:10880]
2025-10-01T14:13:47.339234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978397967:10880], now have 1 active actors on pipe
2025-10-01T14:13:47.339255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:47.339258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:47.339262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:47.339263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:47.339272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256340601497427:10975]
2025-10-01T14:13:47.339276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256340601497427:10975]
2025-10-01T14:13:47.339281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256340601497427:10975]
2025-10-01T14:13:47.339317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:47.339327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:47.339331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:47.339335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:47.339342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.339350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:47.339392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2062, pipe: [1:7556256342978397967:10880]
2025-10-01T14:13:47.339781Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:47.339862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:47.505819Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:47.506322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.506339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.507439Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:47.506975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256342978397967:10880]
2025-10-01T14:13:47.507009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:47.507621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:47.507637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0] Write session will restart in 0.005887s
2025-10-01T14:13:47.507665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0] Write session: Do CDS request
2025-10-01T14:13:47.507672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:47.507012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:47.507070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2063 reason: error at write: Disconnected sessionId: src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0
2025-10-01T14:13:47.507087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:47.507310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2063 sessionId: src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0 is DEAD
2025-10-01T14:13:47.516727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:47.516825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:47.516842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2064
2025-10-01T14:13:47.517114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:47.517155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:47.517165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:47.517169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:47.517559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2064 sessionId:  describe result for acl check
2025-10-01T14:13:47.517597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:47.517605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:47.517607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:47.517622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256342978398008:11284] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:47.518186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256342978398008:11284] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:47.524196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256342978398008:11284] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:47.527791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256342978398008:11284] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:47.527811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256342978398008:11284] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:47.527815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256342978398008:11284] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:47.527824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:47.530016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:47.533124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:47.533439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:47.533452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:47.533466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:47.533533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:47.533575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256340601497593:10978]
2025-10-01T14:13:47.534232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:47.534753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:47.534808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:47.535172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:47.535250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.535257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.535259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.535260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.535261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.535263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.535264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.535266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.535267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.535268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.535270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.535271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.535272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.535273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.535280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.535291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.535295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.535300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.535305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.535309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.535313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.535317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.535321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.535326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.535329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.535333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.535337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.535341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.535349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.535358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.535364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.535370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.535375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.535380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.535385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.535391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.535415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.535426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.535431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.535436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.535442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.535448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.535452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.535458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.535463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.535468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.535472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.535477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.535481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.535492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.535496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.535502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.535506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.535512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.535522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.535528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.535574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:47.540846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:47.541477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:47.541492Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:47.541495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:47.541498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:47.541504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2063 [2:7556256340601497593:10978]
2025-10-01T14:13:47.541522Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:47.541542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:47.541545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:47.541549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:47.541551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:47.541567Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:47.541577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:47.541582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:47.541647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.541653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.541655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.541659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:47.541661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:47.541729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:47.541737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.541749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.541762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.541783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:47.541806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978397974:2446], now have 1 active actors on pipe
2025-10-01T14:13:47.541814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978398115:11284], now have 1 active actors on pipe
2025-10-01T14:13:47.541820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256340601497588:10978]
2025-10-01T14:13:47.541827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256340601497588:10978]
2025-10-01T14:13:47.541829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256340601497588:10978]
2025-10-01T14:13:47.541842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:47.541853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:47.541856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:47.541859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:47.541860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:47.541875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:47.541882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:47.541918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256340601497588:10978]
2025-10-01T14:13:47.541928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:47.541934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:47.542073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2063
2025-10-01T14:13:47.542130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2063
2025-10-01T14:13:47.542303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.542324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.542353Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:47.542365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:47.542386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:47.542389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:47.542398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:47.542411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:47.542430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:47.543252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.543265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.543285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:47.544714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2064 partition: 0 MaxSeqNo: 45 sessionId: src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0
2025-10-01T14:13:47.545114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|41c05e32-376bf1e1-6d092a78-6c54ea39_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:47.548096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0] Write session: try to update token
2025-10-01T14:13:47.548117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:47.569653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2064 sessionId: src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:47.573952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:47.574397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.574419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.574457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:47.579053Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:47.579307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:47.579312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:47.579315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:47.579324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256340601497588:10978]
2025-10-01T14:13:47.579330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256340601497588:10978]
2025-10-01T14:13:47.579334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256340601497588:10978]
2025-10-01T14:13:47.579394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:47.579403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.579405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:47.579532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:47.581102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:47.581112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:47.581116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:47.575438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:47.610432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256342978398133:10880]
2025-10-01T14:13:47.611474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2063, pipe: [1:7556256342978398133:10880]
2025-10-01T14:13:47.760802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:47.761313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978398133:10880], now have 1 active actors on pipe
2025-10-01T14:13:47.769514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.769544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.769730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.769811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.769883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.769945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.769991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.769995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.770074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.770134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.770198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.770264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.770310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.770313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.770477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.770538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.770595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.770655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.770697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.770703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.770772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.770828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.770889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.770946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.770987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.770990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.771056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.771110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.771167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.771229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.771272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.771275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.771359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.771427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.771499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.771574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.771623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.771627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.771705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.771774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.771857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.771935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.771994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.771997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.772090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.772161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.772235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.772310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.772359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.772363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.772446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.772516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.772590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.772672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.772725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.772728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.772812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:47.772896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:47.772996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:47.773079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:47.773134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:47.773137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:47.774532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:47.774624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256342978398133:10880]
2025-10-01T14:13:47.774663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:47.774672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:47.774704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2064 reason: error at write: Disconnected sessionId: src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0
2025-10-01T14:13:47.774773Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:47.774993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2064 sessionId: src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0 is DEAD
2025-10-01T14:13:47.775352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:47.775363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0] Write session will restart in 0.007200s
2025-10-01T14:13:47.775390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0] Write session: Do CDS request
2025-10-01T14:13:47.775397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:47.784012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:47.784356Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:47.784373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2065
2025-10-01T14:13:47.784494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:47.784528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:47.784540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:47.784544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:47.785948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2065 sessionId:  describe result for acl check
2025-10-01T14:13:47.785988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:47.785990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:47.785992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:47.785999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256342978398210:11289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:47.786651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256342978398210:11289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:47.789059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256342978398210:11289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:47.790108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:47.793782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:47.794116Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:47.794140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:47.794171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:47.794280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256342978398210:11289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:47.794300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256342978398210:11289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:47.794304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256342978398210:11289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:47.794319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:47.794313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:47.794386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256340601497772:10991]
2025-10-01T14:13:47.794966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:47.795353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:47.795404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:47.795700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:47.795745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.795746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.795747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.795749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.795750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.795751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.795752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.795753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.795755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.795756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.795757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.795759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.795760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.795761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.795767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.795778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.795782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.795786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.795790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.795794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.795798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.795802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.795807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.795812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.795815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.795819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.795822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.795826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.795833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.795842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:47.795849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.795854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:47.795858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.795863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:47.795868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.795873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:47.795877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.795883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:47.795888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.795893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:47.795898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.795903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:47.795908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.795914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:47.795918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.795924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:47.795928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.795933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.795939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.795945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.795949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.795955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.795959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.795965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:47.795969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.795974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:47.796012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:47.800281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:47.801240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:47.801246Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:47.801249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:47.801253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:47.801259Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2064 [2:7556256340601497772:10991]
2025-10-01T14:13:47.801277Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:47.801295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:47.801298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:47.801302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:47.801304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:47.801320Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:47.801325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:47.801331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:47.801390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.801392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.801395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.801399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:47.801402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:47.801475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:47.801477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.801488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:47.801500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:47.801516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:47.801533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256340601497767:10991]
2025-10-01T14:13:47.801535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256340601497767:10991]
2025-10-01T14:13:47.801538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256340601497767:10991]
2025-10-01T14:13:47.801546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:47.801555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:47.801558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:47.801559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:47.801571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:47.801573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:47.801574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:47.801585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978398148:2446], now have 1 active actors on pipe
2025-10-01T14:13:47.801589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978398293:11289], now have 1 active actors on pipe
2025-10-01T14:13:47.801619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256340601497767:10991]
2025-10-01T14:13:47.801631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:47.801926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2064
2025-10-01T14:13:47.801968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2064
2025-10-01T14:13:47.802087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:47.802181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.802186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.802211Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:47.802218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:47.802222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:47.802224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:47.802232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:47.802240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:47.802255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:47.803183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2065 partition: 0 MaxSeqNo: 45 sessionId: src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0
2025-10-01T14:13:47.803621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6eae867b-965719dd-ef4d95fc-a1609c72_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:47.803049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.803059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.803074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:47.806635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0] Write session: try to update token
2025-10-01T14:13:47.806653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:47.832338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2065 sessionId: src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:47.834892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:47.835887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:47.835918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:47.835941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:47.835945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:47.835948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:47.835951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:47.835959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256340601497767:10991]
2025-10-01T14:13:47.835969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256340601497767:10991]
2025-10-01T14:13:47.835975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256340601497767:10991]
2025-10-01T14:13:47.836043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:47.836043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:47.836050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:47.836050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:47.836053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:47.836055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:47.836214Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:47.874891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256342978398305:10880]
2025-10-01T14:13:47.875235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2064, pipe: [1:7556256342978398305:10880]
2025-10-01T14:13:47.990142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:47.991689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:47.991821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:47.991824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:47.991893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2065 reason: error at write: Disconnected sessionId: src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0
2025-10-01T14:13:47.992043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2065 sessionId: src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0 is DEAD
2025-10-01T14:13:47.992176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:47.992217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256342978398305:10880]
2025-10-01T14:13:47.992456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:47.992465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0] Write session will restart in 0.005750s
2025-10-01T14:13:47.992491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0] Write session: Do CDS request
2025-10-01T14:13:47.992497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:47.990710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:47.990770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978398305:10880], now have 1 active actors on pipe
2025-10-01T14:13:47.999915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.000026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:48.000043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2066
2025-10-01T14:13:48.000201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.000247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:48.000257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:48.000262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:48.000655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2066 sessionId:  describe result for acl check
2025-10-01T14:13:48.000687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:48.000689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:48.000691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:48.000696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256347273365617:11294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:48.001236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256347273365617:11294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:48.003386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256347273365617:11294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:48.006009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256347273365617:11294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:48.006021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256347273365617:11294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:48.006024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256347273365617:11294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:48.006030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:48.009412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:48.011319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:48.011545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:48.011556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:48.011581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:48.011640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:48.011693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256344896465219:10993]
2025-10-01T14:13:48.012360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:48.012699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:48.012760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:48.013147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:48.013247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.013256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.013257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.013258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.013260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.013261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.013262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.013263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.013265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.013266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.013267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.013268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.013270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.013272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.013278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.013292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.013295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.013299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.013302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.013307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.013310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.013313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.013317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.013321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.013324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.013327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.013331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.013334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.013345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.013354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.013361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.013366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.013372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.013377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.013391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.013396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.013407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.013413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.013423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.013429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.013440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.013450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.013459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.013464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.013469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.013474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.013484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.013488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.013497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.013507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.013512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.013522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.013527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.013532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.013538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.013542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.013582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:48.017403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:48.018125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:48.018146Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:48.018149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:48.018154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:48.018161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2065 [2:7556256344896465219:10993]
2025-10-01T14:13:48.018180Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:48.018198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:48.018206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.018209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.018212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.018228Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:48.018234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:48.018247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:48.018314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.018321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.018324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.018327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:48.018330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:48.018419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:48.018428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.018441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.018454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.018476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:48.018499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273365697:11294], now have 1 active actors on pipe
2025-10-01T14:13:48.018507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256342978398314:2446], now have 1 active actors on pipe
2025-10-01T14:13:48.018513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256344896465214:10993]
2025-10-01T14:13:48.018520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256344896465214:10993]
2025-10-01T14:13:48.018523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256344896465214:10993]
2025-10-01T14:13:48.018535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:48.018544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:48.018547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:48.018549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:48.018554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:48.018570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:48.018578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:48.018580Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2065
2025-10-01T14:13:48.018610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256344896465214:10993]
2025-10-01T14:13:48.018623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:48.018627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:48.018639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2065
2025-10-01T14:13:48.018686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.018695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.018720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:48.018731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.018734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.018742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:48.018753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.018767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:48.018782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.018936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.018945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.018960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.019364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2066 partition: 0 MaxSeqNo: 45 sessionId: src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0
2025-10-01T14:13:48.019697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2702695b-8d82b972-4a7c1fb9-ab956078_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:48.022842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0] Write session: try to update token
2025-10-01T14:13:48.022862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:48.036513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:48.036537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:48.036548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256344896465214:10993]
2025-10-01T14:13:48.036618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:48.036639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:48.036802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:48.036951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:48.037089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:48.037229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:48.037420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:48.037456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:48.039039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2066 sessionId: src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:48.041802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:48.042446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.042471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.042510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:48.042593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:48.059927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:48.059945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:48.059947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:48.059949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:48.059961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256344896465214:10993]
2025-10-01T14:13:48.059966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256344896465214:10993]
2025-10-01T14:13:48.059970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256344896465214:10993]
2025-10-01T14:13:48.060013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:48.060018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.060020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:48.060147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:48.060184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:48.060198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:48.060202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:48.093783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256347273365761:10880]
2025-10-01T14:13:48.094506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2065, pipe: [1:7556256347273365761:10880]
2025-10-01T14:13:48.204199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:48.211616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.211641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.211798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.211855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.211915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.211970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.212008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.212015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.212073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.212125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.212186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.212248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.212291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.212299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.212358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.212413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.212476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.212529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.212567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.212572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.212634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.212693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.212750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.212811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.212852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.212859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.212917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.212974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.213036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.213096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.213139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.213145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.213207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.213263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.213324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.213382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.213421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.213426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.213483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.213535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.213589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.213643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.213686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.213694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.213763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.213833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.213893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.213949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.213997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.214004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.214062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.214116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.214169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.214229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.214272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.214279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.214346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:48.214421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:48.214479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:48.214531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:48.214567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:48.214572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:48.216362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:48.216373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0] Write session will restart in 0.007744s
2025-10-01T14:13:48.215950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256347273365761:10880]
2025-10-01T14:13:48.215986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:48.216025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2066 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0
2025-10-01T14:13:48.216399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0] Write session: Do CDS request
2025-10-01T14:13:48.216057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:48.216236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2066 sessionId: src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0 is DEAD
2025-10-01T14:13:48.216406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:48.214613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273365761:10880], now have 1 active actors on pipe
2025-10-01T14:13:48.215593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:48.225677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.225975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:48.225992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2067
2025-10-01T14:13:48.226585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.226615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:48.226624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:48.226627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:48.226994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2067 sessionId:  describe result for acl check
2025-10-01T14:13:48.227021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:48.227027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:48.227029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:48.227033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256347273365788:11298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:48.227575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256347273365788:11298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:48.230436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256347273365788:11298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:48.233770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256347273365788:11298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:48.233782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256347273365788:11298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:48.233785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256347273365788:11298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:48.233792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:48.234791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:48.236667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:48.236899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:48.236903Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:48.236914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:48.236962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:48.236995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256344896465371:10996]
2025-10-01T14:13:48.237508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:48.237759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:48.237801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:48.238075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:48.238117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.238118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.238118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.238119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.238120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.238121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.238123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.238124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.238125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.238126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.238127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.238127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.238128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.238129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.238133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.238141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.238144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.238147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.238150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.238163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.238166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.238169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.238172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.238176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.238179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.238182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.238185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.238187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.238194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.238200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.238205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.238209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.238212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.238216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.238219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.238224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.238228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.238232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.238235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.238240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.238243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.238248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.238251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.238255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.238258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.238263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.238266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.238270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.238274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.238278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.238281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.238285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.238289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.238292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.238296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.238301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.238331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:48.243523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:48.244176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:48.244181Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:48.244183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:48.244186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:48.244193Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2066 [2:7556256344896465371:10996]
2025-10-01T14:13:48.244207Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:48.244220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:48.244543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2066
2025-10-01T14:13:48.244552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2066
2025-10-01T14:13:48.244223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.244226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.244227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.244242Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:48.244247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:48.244252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:48.244297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.244299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.244300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.244303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:48.244305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:48.244371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:48.244373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.244382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.244391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.244404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:48.244421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273365907:11298], now have 1 active actors on pipe
2025-10-01T14:13:48.244424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273365764:2446], now have 1 active actors on pipe
2025-10-01T14:13:48.244430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256344896465366:10996]
2025-10-01T14:13:48.244433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256344896465366:10996]
2025-10-01T14:13:48.244434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256344896465366:10996]
2025-10-01T14:13:48.244447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:48.244459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:48.244462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:48.244464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:48.244466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:48.244471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:48.244473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:48.244496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256344896465366:10996]
2025-10-01T14:13:48.244502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:48.244508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:48.244897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.244907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.244935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a3a4194-114726c5-9fa1d132-bad99590_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:48.244946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.244956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.244959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:48.244967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.244976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:48.244990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.245168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.245181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.245196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.245732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdeee380-3d8573e1-aeaa2154-cd1e5546_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6a3a4194-114726c5-9fa1d132-bad99590_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:48.245268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2067 partition: 0 MaxSeqNo: 45 sessionId: src_id|6a3a4194-114726c5-9fa1d132-bad99590_0
2025-10-01T14:13:48.248640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3a4194-114726c5-9fa1d132-bad99590_0] Write session: try to update token
2025-10-01T14:13:48.248655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3a4194-114726c5-9fa1d132-bad99590_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:48.263890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2067 sessionId: src_id|6a3a4194-114726c5-9fa1d132-bad99590_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:48.266515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:48.266612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:48.266628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:48.266630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:48.266632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:48.266641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256344896465366:10996]
2025-10-01T14:13:48.266646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256344896465366:10996]
2025-10-01T14:13:48.266649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256344896465366:10996]
2025-10-01T14:13:48.266697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:48.266702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.266705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:48.266709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:48.266714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:48.266719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:48.266831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:48.317261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256347273365945:10880]
2025-10-01T14:13:48.317605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2066, pipe: [1:7556256347273365945:10880]
2025-10-01T14:13:48.418093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:48.418647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.418660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.418699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273365945:10880], now have 1 active actors on pipe
2025-10-01T14:13:48.419639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256347273365945:10880]
2025-10-01T14:13:48.419678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:48.419680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:48.419729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2067 reason: error at write: Disconnected sessionId: src_id|6a3a4194-114726c5-9fa1d132-bad99590_0
2025-10-01T14:13:48.419925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2067 sessionId: src_id|6a3a4194-114726c5-9fa1d132-bad99590_0 is DEAD
2025-10-01T14:13:48.420038Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:48.419874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:48.420253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3a4194-114726c5-9fa1d132-bad99590_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:48.420265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3a4194-114726c5-9fa1d132-bad99590_0] Write session will restart in 0.005969s
2025-10-01T14:13:48.420291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3a4194-114726c5-9fa1d132-bad99590_0] Write session: Do CDS request
2025-10-01T14:13:48.420296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3a4194-114726c5-9fa1d132-bad99590_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:48.428362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3a4194-114726c5-9fa1d132-bad99590_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.428564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:48.428579Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2068
2025-10-01T14:13:48.429417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.429455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:48.429461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:48.429464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:48.429938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2068 sessionId:  describe result for acl check
2025-10-01T14:13:48.429969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:48.429970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:48.429972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:48.429976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256347273365962:11309] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:48.430413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256347273365962:11309] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:48.432524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256347273365962:11309] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:48.435400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256347273365962:11309] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:48.435412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256347273365962:11309] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:48.435415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256347273365962:11309] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:48.435420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:48.439574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:48.442320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:48.442520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:48.442524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:48.442535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:48.442574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:48.442609Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256344896465541:11001]
2025-10-01T14:13:48.443134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:48.443642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:48.443681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:48.443944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:48.443990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.443992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.443992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.443993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.443994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.443995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.443997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.443998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.443998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.443999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.444001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.444002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.444003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.444004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.444008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.444017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.444020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.444024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.444027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.444030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.444033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.444036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.444039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.444043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.444046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.444049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.444052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.444056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.444062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.444071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.444076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.444081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.444085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.444091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.444094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.444100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.444106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.444111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.444117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.444123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.444128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.444135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.444140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.444145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.444150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.444156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.444160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.444165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.444170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.444175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.444179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.444185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.444190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.444195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.444199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.444204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.444240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:48.448976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:48.449891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:48.449905Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:48.449908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:48.449911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:48.449919Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2067 [2:7556256344896465541:11001]
2025-10-01T14:13:48.449934Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:48.449952Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:48.449959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.449963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.449966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.449983Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:48.449992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:48.449998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:48.450058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.450062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.450064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.450068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:48.450071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:48.450152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:48.450158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.450169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.450180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.450201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:48.450219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273366072:11309], now have 1 active actors on pipe
2025-10-01T14:13:48.450223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273365947:2446], now have 1 active actors on pipe
2025-10-01T14:13:48.450229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256344896465535:11001]
2025-10-01T14:13:48.450231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256344896465535:11001]
2025-10-01T14:13:48.450233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256344896465535:11001]
2025-10-01T14:13:48.450246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:48.450262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:48.450276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:48.450280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:48.450283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:48.450284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:48.450286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:48.450270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2067
2025-10-01T14:13:48.450278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2067
2025-10-01T14:13:48.450319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256344896465535:11001]
2025-10-01T14:13:48.450331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:48.450347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:48.450356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.450360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.450416Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:48.450429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.450433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.450435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:48.450443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.450456Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:48.450477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.450628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.450634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.450647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.450720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2068 partition: 0 MaxSeqNo: 45 sessionId: src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0
2025-10-01T14:13:48.451080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a3a4194-114726c5-9fa1d132-bad99590_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:48.454066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0] Write session: try to update token
2025-10-01T14:13:48.454082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:48.469002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2068 sessionId: src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:48.470806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:48.470828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:48.470831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:48.470833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:48.470843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256344896465535:11001]
2025-10-01T14:13:48.470848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256344896465535:11001]
2025-10-01T14:13:48.470852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256344896465535:11001]
2025-10-01T14:13:48.470903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:48.470909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:48.470914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:48.470916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.470917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:48.470918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:48.471045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:48.471570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:48.519218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256347273366114:10880]
2025-10-01T14:13:48.519520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2067, pipe: [1:7556256347273366114:10880]
2025-10-01T14:13:48.619895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:48.620234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.620250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.620292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273366114:10880], now have 1 active actors on pipe
2025-10-01T14:13:48.620463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:48.620465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256347273366114:10880]
2025-10-01T14:13:48.620482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:48.620485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:48.620546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2068 reason: error at write: Disconnected sessionId: src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0
2025-10-01T14:13:48.620764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:48.620802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2068 sessionId: src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0 is DEAD
2025-10-01T14:13:48.621150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:48.621161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0] Write session will restart in 0.007321s
2025-10-01T14:13:48.621190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0] Write session: Do CDS request
2025-10-01T14:13:48.621196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:48.631436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.631541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:48.631560Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2069
2025-10-01T14:13:48.631667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.631701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:48.631707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:48.631711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:48.632149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2069 sessionId:  describe result for acl check
2025-10-01T14:13:48.632187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:48.632194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:48.632198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:48.632203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256347273366234:11314] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:48.632632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:48.632746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256347273366234:11314] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:48.634590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:48.634791Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:48.634801Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:48.634813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:48.634868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:48.634907Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256344896465706:11003]
2025-10-01T14:13:48.635178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256347273366234:11314] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:48.635486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:48.635798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:48.635853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:48.636172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:48.636226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.636229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.636229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.636230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.636231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.636231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.636232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.636233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.636233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.636234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.636235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.636235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.636236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.636237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.636250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.636258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.636263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.636267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.636271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.636275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.636278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.636280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.636282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.636284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.636286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.636288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.636290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.636292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.636297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.636302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.636306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.636309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.636313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.636318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.636322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.636327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.636331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.636336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.636341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.636345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.636350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.636354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.636357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.636360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.636362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.636366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.636368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.636371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.636373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.636376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.636378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.636381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.636383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.636385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.636388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.636390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.636412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:48.639668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256347273366234:11314] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:48.639682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256347273366234:11314] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:48.639686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256347273366234:11314] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:48.639694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:48.640431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:48.641229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:48.641244Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:48.641245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:48.641248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:48.641253Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2068 [2:7556256344896465706:11003]
2025-10-01T14:13:48.641264Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:48.641277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:48.641279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.641281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.641283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.641296Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:48.641300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:48.641304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:48.641358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.641366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.641369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.641372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:48.641375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:48.641430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:48.641440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.641451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.641461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.641474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:48.641495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273366119:2446], now have 1 active actors on pipe
2025-10-01T14:13:48.641505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273366284:11314], now have 1 active actors on pipe
2025-10-01T14:13:48.641512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256344896465701:11003]
2025-10-01T14:13:48.641514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256344896465701:11003]
2025-10-01T14:13:48.641516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256344896465701:11003]
2025-10-01T14:13:48.641531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:48.641548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:48.641561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2068
2025-10-01T14:13:48.641583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2068
2025-10-01T14:13:48.641560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:48.641566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:48.641569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:48.641572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:48.641574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:48.641601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256344896465701:11003]
2025-10-01T14:13:48.641604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:48.641611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:48.641617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.641622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.641659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:48.641665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.641668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.641670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:48.641677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.641684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:48.641696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.641972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.641979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.641991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.642065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2069 partition: 0 MaxSeqNo: 45 sessionId: src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0
2025-10-01T14:13:48.642500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b898ecf4-883e955a-678c82e9-ecebd1c3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:48.645714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0] Write session: try to update token
2025-10-01T14:13:48.645734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:48.663629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2069 sessionId: src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:48.666261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:48.664428Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:48.664448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:48.664451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:48.664453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:48.664462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256344896465701:11003]
2025-10-01T14:13:48.664465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256344896465701:11003]
2025-10-01T14:13:48.664469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256344896465701:11003]
2025-10-01T14:13:48.664523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:48.664529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.664532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:48.664600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:48.664607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:48.664610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:48.664674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:48.720706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256347273366292:10880]
2025-10-01T14:13:48.720967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2068, pipe: [1:7556256347273366292:10880]
2025-10-01T14:13:48.827870Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:48.828159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.828168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.828208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273366292:10880], now have 1 active actors on pipe
2025-10-01T14:13:48.828486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:48.828538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256347273366292:10880]
2025-10-01T14:13:48.828559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:48.828565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:48.828625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2069 reason: error at write: Disconnected sessionId: src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0
2025-10-01T14:13:48.828830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2069 sessionId: src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0 is DEAD
2025-10-01T14:13:48.829009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:48.829402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:48.829413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0] Write session will restart in 0.008481s
2025-10-01T14:13:48.829443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0] Write session: Do CDS request
2025-10-01T14:13:48.829450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:48.847223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.847300Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:48.847322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2070
2025-10-01T14:13:48.847482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:48.847530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:48.847540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:48.847544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:48.848040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2070 sessionId:  describe result for acl check
2025-10-01T14:13:48.848080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:48.848090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:48.848092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:48.848097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256347273366311:11319] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:48.848636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256347273366311:11319] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:48.856099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256347273366311:11319] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:48.866928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256347273366311:11319] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:48.866950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256347273366311:11319] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:48.866954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256347273366311:11319] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:48.866964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:48.873136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:48.875246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:48.875488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:48.875500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:48.875511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:48.875566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:48.875619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256344896465879:11016]
2025-10-01T14:13:48.876135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:48.876479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:48.876524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:48.876903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:48.876969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.876975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.876976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.876978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.876979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.876981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.876982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.876984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.876985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.876986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.876987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.876988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.876989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.876990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.876993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.877000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.877002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.877005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.877007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.877009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.877011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.877013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.877016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.877018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.877020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.877022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.877024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.877026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.877032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.877037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:48.877041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.877045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:48.877047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.877051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:48.877054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.877058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:48.877061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.877065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:48.877068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.877071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:48.877074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.877077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:48.877080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.877084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:48.877087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.877090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:48.877093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.877096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.877103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.877106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.877108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.877111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.877114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.877118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:48.877120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.877123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:48.877159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:48.881492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:48.882197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:48.882214Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:48.882218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:48.882223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:48.882231Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2069 [2:7556256344896465879:11016]
2025-10-01T14:13:48.882249Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:48.882275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:48.882283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.882287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.882294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.882311Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:48.882322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:48.882334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:48.882433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.882442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.882444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.882448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:48.882452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:48.882530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:48.882537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.882549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:48.882563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:48.882584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:48.882608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256344896465874:11016]
2025-10-01T14:13:48.882616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256344896465874:11016]
2025-10-01T14:13:48.882618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256344896465874:11016]
2025-10-01T14:13:48.882627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:48.882641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:48.882652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:48.882655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:48.882658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:48.882658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:48.882662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:48.882673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273366295:2446], now have 1 active actors on pipe
2025-10-01T14:13:48.882677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273366407:11319], now have 1 active actors on pipe
2025-10-01T14:13:48.882721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256344896465874:11016]
2025-10-01T14:13:48.882736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:48.882765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:48.882746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2069
2025-10-01T14:13:48.882750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2069
2025-10-01T14:13:48.882871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.882881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.882911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:48.882922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:48.882933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:48.882936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:48.882947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:48.882962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:48.882979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.883279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:48.883291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:48.883309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:48.883959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c54d8a11-385bba08-e9b7eee3-d525f5e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:48.883444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2070 partition: 0 MaxSeqNo: 45 sessionId: src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0
2025-10-01T14:13:48.887125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0] Write session: try to update token
2025-10-01T14:13:48.887149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:48.909230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2070 sessionId: src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:48.909419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:48.909439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:48.909442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:48.909444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:48.909456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256344896465874:11016]
2025-10-01T14:13:48.909464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256344896465874:11016]
2025-10-01T14:13:48.909470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256344896465874:11016]
2025-10-01T14:13:48.909536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:48.909549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:48.909563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:48.909708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:48.910597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:48.910617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:48.910622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:48.911875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:48.930713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256347273366458:10880]
2025-10-01T14:13:48.938698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2069, pipe: [1:7556256347273366458:10880]
2025-10-01T14:13:49.077121Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:49.077618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.077633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.077676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256347273366458:10880], now have 1 active actors on pipe
2025-10-01T14:13:49.077879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:49.077923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:49.077929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:49.077951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256347273366458:10880]
2025-10-01T14:13:49.078022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2070 reason: error at write: Disconnected sessionId: src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0
2025-10-01T14:13:49.078246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2070 sessionId: src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0 is DEAD
2025-10-01T14:13:49.078408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:49.078421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0] Write session will restart in 0.006999s
2025-10-01T14:13:49.078447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0] Write session: Do CDS request
2025-10-01T14:13:49.078456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:49.079442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:49.087013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:49.089778Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:49.089802Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2071
2025-10-01T14:13:49.090083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:49.090116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:49.090123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:49.090127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:49.090599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2071 sessionId:  describe result for acl check
2025-10-01T14:13:49.090625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:49.090628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:49.090631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:49.090637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256351568333773:11324] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:49.091166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256351568333773:11324] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:49.096689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:49.097100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256351568333773:11324] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:49.099668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:49.099910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:49.099920Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:49.099933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:49.100008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:49.100051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256349191433328:11018]
2025-10-01T14:13:49.100550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:49.100903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:49.100942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:49.101235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:49.101279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.101284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.101285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.101286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.101286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.101288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.101288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.101289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.101290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.101290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.101291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.101292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.101292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.101293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.101297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.101303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.101306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.101308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.101311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.101313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.101315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.101317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.101320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.101322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.101324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.101326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.101328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.101331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.101337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.101342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.101347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.101350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.101353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.101356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.101358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.101362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.101364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.101367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.101372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.101375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.101378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.101381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.101383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.101386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.101410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.101416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.101421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.101426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.101431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.101434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.101436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.101439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.101442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.101445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.101447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.101450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.101471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:49.101547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256351568333773:11324] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:49.101567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256351568333773:11324] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:49.101570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256351568333773:11324] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:49.101580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:49.107979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:49.108681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:49.108695Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:49.108698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:49.108702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:49.108710Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2070 [2:7556256349191433328:11018]
2025-10-01T14:13:49.108727Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:49.108745Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:49.108753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:49.108758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:49.108760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:49.108779Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:49.108795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:49.108801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:49.108863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.108871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.108873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.108877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:49.108880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:49.108962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:49.108969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.108981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.108998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.109021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:49.109045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568333910:11324], now have 1 active actors on pipe
2025-10-01T14:13:49.109052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568333757:2446], now have 1 active actors on pipe
2025-10-01T14:13:49.109062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256349191433323:11018]
2025-10-01T14:13:49.109069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256349191433323:11018]
2025-10-01T14:13:49.109072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256349191433323:11018]
2025-10-01T14:13:49.109085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:49.109103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:49.109104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:49.109107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:49.109109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:49.109121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:49.109124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:49.109166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256349191433323:11018]
2025-10-01T14:13:49.109176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:49.109132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2070
2025-10-01T14:13:49.109187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:49.109214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.109134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2070
2025-10-01T14:13:49.109219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.109251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef812d35-444ab362-51a841a-5b4a63e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:49.109263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:49.109267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:49.109269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:49.109277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:49.109285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:49.109300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:49.109447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.109455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.109469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:49.109544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2071 partition: 0 MaxSeqNo: 45 sessionId: src_id|ef812d35-444ab362-51a841a-5b4a63e0_0
2025-10-01T14:13:49.113165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0aad3e-c2aec105-6b6159ec-4adeff87_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ef812d35-444ab362-51a841a-5b4a63e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:49.116199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef812d35-444ab362-51a841a-5b4a63e0_0] Write session: try to update token
2025-10-01T14:13:49.116218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef812d35-444ab362-51a841a-5b4a63e0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:49.133487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:49.133504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:49.133515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256349191433323:11018]
2025-10-01T14:13:49.133568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:49.133579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:49.133755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:49.133908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:49.134062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:49.134208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:49.134435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:49.134469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:49.141980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2071 sessionId: src_id|ef812d35-444ab362-51a841a-5b4a63e0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:49.144992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:49.146000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.146023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.146065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:49.146344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:49.157402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:49.157420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:49.157423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:49.157425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:49.157438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256349191433323:11018]
2025-10-01T14:13:49.157442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256349191433323:11018]
2025-10-01T14:13:49.157445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256349191433323:11018]
2025-10-01T14:13:49.157497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:49.157509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.157511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:49.157639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:49.157656Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:49.157661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:49.157681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:49.177889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256351568333920:10880]
2025-10-01T14:13:49.178171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2070, pipe: [1:7556256351568333920:10880]
2025-10-01T14:13:49.321351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:49.333909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.336363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.336521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.336588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.336670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.336882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.336929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.336935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.337007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.337067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.337129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.337471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.337513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.337516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.337603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.337677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.337752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.337823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.337875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.337879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.337957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.338041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.338114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.338187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.338321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.338324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.338591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.338839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.338900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.338963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.339008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.339011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.339078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.339133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.339912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.342668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.342720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.342724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.343487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.343559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.343622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.343686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.343844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.343848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.343922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.344164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.344406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.344659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.344700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.344703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.345666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.346909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.347716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.347972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.348022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.348025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.348275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:49.348529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:49.348589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:49.348665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:49.348707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:49.348710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:49.348795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568333920:10880], now have 1 active actors on pipe
2025-10-01T14:13:49.349819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256351568333920:10880]
2025-10-01T14:13:49.349852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:49.349854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:49.349880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2071 reason: error at write: Disconnected sessionId: src_id|ef812d35-444ab362-51a841a-5b4a63e0_0
2025-10-01T14:13:49.350101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2071 sessionId: src_id|ef812d35-444ab362-51a841a-5b4a63e0_0 is DEAD
2025-10-01T14:13:49.350232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:49.350699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef812d35-444ab362-51a841a-5b4a63e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:49.350711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef812d35-444ab362-51a841a-5b4a63e0_0] Write session will restart in 0.005157s
2025-10-01T14:13:49.349974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:49.350739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef812d35-444ab362-51a841a-5b4a63e0_0] Write session: Do CDS request
2025-10-01T14:13:49.350745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef812d35-444ab362-51a841a-5b4a63e0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:49.357341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef812d35-444ab362-51a841a-5b4a63e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:49.360858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:49.360877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2072
2025-10-01T14:13:49.364640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:49.364691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:49.364697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:49.364701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:49.365777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2072 sessionId:  describe result for acl check
2025-10-01T14:13:49.365801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:49.365802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:49.365804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:49.365810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256351568333973:11335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:49.366258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256351568333973:11335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:49.371077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256351568333973:11335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:49.375571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256351568333973:11335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:49.375587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256351568333973:11335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:49.375589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256351568333973:11335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:49.375596Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:49.378492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:49.384661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:49.384921Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:49.384926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:49.384938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:49.384990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:49.385028Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256349191433507:11024]
2025-10-01T14:13:49.385599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:49.386078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:49.386122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:49.386430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:49.386484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.386485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.386486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.386487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.386488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.386489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.386491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.386492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.386493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.386494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.386496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.386497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.386497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.386498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.386503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.386513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.386516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.386519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.386523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.386526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.386529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.386533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.386537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.386541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.386544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.386548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.386551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.386554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.386562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.386569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.386575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.386580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.386586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.386591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.386595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.386600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.386604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.386608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.386612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.386618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.386622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.386627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.386630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.386635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.386640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.386645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.386649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.386653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.386660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.386664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.386668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.386673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.386676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.386681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.386685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.386689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.386725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:49.390846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:49.391741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:49.391755Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:49.391758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:49.391761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:49.391768Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2071 [2:7556256349191433507:11024]
2025-10-01T14:13:49.391785Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:49.391803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:49.391807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:49.391810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:49.391813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:49.391829Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:49.391835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:49.391842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:49.391903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.391911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.391913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.391918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:49.391920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:49.391986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:49.391991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.392002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.392013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.392032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:49.392049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256349191433501:11024]
2025-10-01T14:13:49.392050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256349191433501:11024]
2025-10-01T14:13:49.392052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256349191433501:11024]
2025-10-01T14:13:49.392065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:49.392078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:49.392092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:49.392095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:49.392130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256349191433501:11024]
2025-10-01T14:13:49.392132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:49.392324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:49.392327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:49.392329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:49.392334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:49.392446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2071
2025-10-01T14:13:49.392455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2071
2025-10-01T14:13:49.398467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568333948:2446], now have 1 active actors on pipe
2025-10-01T14:13:49.398487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568334094:11335], now have 1 active actors on pipe
2025-10-01T14:13:49.398512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.398521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.398561Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ef0895f-9604dbaf-672ce79e-a959820_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:49.398577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:49.398583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:49.398586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:49.398599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:49.398617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:49.398639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:49.401253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.401269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.401311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:49.401450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2072 partition: 0 MaxSeqNo: 45 sessionId: src_id|4ef0895f-9604dbaf-672ce79e-a959820_0
2025-10-01T14:13:49.402613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef812d35-444ab362-51a841a-5b4a63e0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4ef0895f-9604dbaf-672ce79e-a959820_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:49.405671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0895f-9604dbaf-672ce79e-a959820_0] Write session: try to update token
2025-10-01T14:13:49.405689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0895f-9604dbaf-672ce79e-a959820_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:49.420685Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:49.420705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:49.420707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:49.420710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:49.420723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256349191433501:11024]
2025-10-01T14:13:49.420731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256349191433501:11024]
2025-10-01T14:13:49.420735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256349191433501:11024]
2025-10-01T14:13:49.420779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:49.420786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.420788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:49.420941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:49.422581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:49.422587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:49.422591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:49.429623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2072 sessionId: src_id|4ef0895f-9604dbaf-672ce79e-a959820_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:49.432471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:49.449780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256351568334108:10880]
2025-10-01T14:13:49.450151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2071, pipe: [1:7556256351568334108:10880]
2025-10-01T14:13:49.579395Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:49.579681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.579691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.579735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568334108:10880], now have 1 active actors on pipe
2025-10-01T14:13:49.580331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:49.582936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256351568334108:10880]
2025-10-01T14:13:49.582962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:49.582992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:49.583059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2072 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ef0895f-9604dbaf-672ce79e-a959820_0
2025-10-01T14:13:49.583251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2072 sessionId: src_id|4ef0895f-9604dbaf-672ce79e-a959820_0 is DEAD
2025-10-01T14:13:49.586558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0895f-9604dbaf-672ce79e-a959820_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:49.586571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0895f-9604dbaf-672ce79e-a959820_0] Write session will restart in 0.007910s
2025-10-01T14:13:49.586605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0895f-9604dbaf-672ce79e-a959820_0] Write session: Do CDS request
2025-10-01T14:13:49.586611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0895f-9604dbaf-672ce79e-a959820_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:49.598782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0895f-9604dbaf-672ce79e-a959820_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:49.602522Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:49.602539Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2073
2025-10-01T14:13:49.602746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:49.602774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:49.602779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:49.602783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:49.603155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2073 sessionId:  describe result for acl check
2025-10-01T14:13:49.603180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:49.603182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:49.603184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:49.603189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256351568334135:11340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:49.603675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256351568334135:11340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:49.627264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:49.627404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256351568334135:11340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:49.630543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:49.630766Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:49.630776Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:49.630788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:49.630837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:49.630869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256349191433663:11026]
2025-10-01T14:13:49.631470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:49.632045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:49.632105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:49.632410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:49.632495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.632497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.632498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.632499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.632500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.632501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.632503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.632504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.632505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.632506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.632508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.632509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.632510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.632511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.632516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.632526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.632530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.632534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.632537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.632544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.632547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.632551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.632555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.632559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.632563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.632566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.632569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.632573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.632581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.632589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.632607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.632613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.632619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.632624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.632627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.632632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.632636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.632640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.632645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.632650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.632654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.632659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.632663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.632667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.632671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.632676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.632679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.632684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.632691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.632696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.632700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.632707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.632711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.632715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.632719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.632724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.632759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:49.638567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:49.639007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256351568334135:11340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:49.639039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256351568334135:11340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:49.639042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256351568334135:11340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:49.639054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:49.639316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:49.639331Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:49.639333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:49.639336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:49.639342Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2072 [2:7556256349191433663:11026]
2025-10-01T14:13:49.639361Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:49.639378Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:49.639381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:49.639384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:49.639386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:49.639402Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:49.639407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:49.639413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:49.639473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.639476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.639478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.639480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:49.639483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:49.639550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:49.639552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.639563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.639573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.639587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:49.639602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256349191433657:11026]
2025-10-01T14:13:49.639604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256349191433657:11026]
2025-10-01T14:13:49.639606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256349191433657:11026]
2025-10-01T14:13:49.639620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:49.639632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:49.639645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:49.639648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:49.639838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256349191433657:11026]
2025-10-01T14:13:49.639849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:49.639982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:49.639984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:49.639986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:49.639990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:49.640480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568334119:2446], now have 1 active actors on pipe
2025-10-01T14:13:49.640486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568334278:11340], now have 1 active actors on pipe
2025-10-01T14:13:49.643441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.643454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.643485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:49.643495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:49.643500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:49.643503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:49.643515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:49.643529Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:49.643546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:49.642442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2072
2025-10-01T14:13:49.642480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2072
2025-10-01T14:13:49.643978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2073 partition: 0 MaxSeqNo: 45 sessionId: src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0
2025-10-01T14:13:49.644357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef0895f-9604dbaf-672ce79e-a959820_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:49.643829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.643850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.643863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:49.647491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0] Write session: try to update token
2025-10-01T14:13:49.647513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:49.667879Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:49.667897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:49.667900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:49.667902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:49.667911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256349191433657:11026]
2025-10-01T14:13:49.667917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256349191433657:11026]
2025-10-01T14:13:49.667921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256349191433657:11026]
2025-10-01T14:13:49.667966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:49.667972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:49.667972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:49.667976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:49.667984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.667987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:49.668130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:49.673348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2073 sessionId: src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:49.676178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:49.683015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256351568334296:10880]
2025-10-01T14:13:49.683317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2072, pipe: [1:7556256351568334296:10880]
2025-10-01T14:13:49.835628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:49.836181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.836196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.836219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568334296:10880], now have 1 active actors on pipe
2025-10-01T14:13:49.836460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:49.836506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256351568334296:10880]
2025-10-01T14:13:49.836507Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:49.836544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:49.836633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2073 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0
2025-10-01T14:13:49.836825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2073 sessionId: src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0 is DEAD
2025-10-01T14:13:49.838606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:49.838620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0] Write session will restart in 0.009496s
2025-10-01T14:13:49.838649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0] Write session: Do CDS request
2025-10-01T14:13:49.838655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:49.849045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:49.852441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:49.849635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:49.849656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2074
2025-10-01T14:13:49.849802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:49.849842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:49.849847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:49.849851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:49.850347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2074 sessionId:  describe result for acl check
2025-10-01T14:13:49.850393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:49.850395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:49.850397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:49.850402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256351568334416:11345] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:49.850951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256351568334416:11345] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:49.852931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256351568334416:11345] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:49.855478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:49.855805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:49.855815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:49.855825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:49.855877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:49.855915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256349191433852:11039]
2025-10-01T14:13:49.856437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:49.856518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256351568334416:11345] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:49.856537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256351568334416:11345] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:49.856540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256351568334416:11345] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:49.856549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:49.856765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:49.856845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:49.857113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:49.857171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.857176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.857178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.857179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.857180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.857181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.857182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.857184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.857185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.857186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.857188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.857189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.857190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.857191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.857197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.857207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.857212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.857217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.857221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.857225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.857229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.857234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.857238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.857242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.857246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.857250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.857254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.857258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.857265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.857272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:49.857279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.857285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:49.857294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.857301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:49.857309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.857314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:49.857318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.857323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:49.857326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.857332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:49.857337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.857343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:49.857349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.857358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:49.857363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.857372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:49.857380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.857386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.857391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.857400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.857405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.857409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.857414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.857419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:49.857424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.857430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:49.857476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:49.861795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:49.863391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2073
2025-10-01T14:13:49.863401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2073
2025-10-01T14:13:49.862815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:49.862830Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:49.862833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:49.862837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:49.862843Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2073 [2:7556256349191433852:11039]
2025-10-01T14:13:49.862861Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:49.862880Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:49.862883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:49.862889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:49.862891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:49.862909Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:49.862915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:49.862921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:49.862982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.862984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.862986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.862989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:49.862991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:49.863063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:49.863065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.863077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:49.863087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:49.863102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:49.863120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256349191433847:11039]
2025-10-01T14:13:49.863123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256349191433847:11039]
2025-10-01T14:13:49.863124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256349191433847:11039]
2025-10-01T14:13:49.863142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:49.863158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:49.863174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:49.863176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:49.863180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:49.863184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:49.863186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:49.863212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256349191433847:11039]
2025-10-01T14:13:49.863218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:49.863253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:49.863519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568334299:2446], now have 1 active actors on pipe
2025-10-01T14:13:49.863524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568334455:11345], now have 1 active actors on pipe
2025-10-01T14:13:49.863539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.863544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.863575Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:49.863583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:49.863588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:49.863590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:49.863599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:49.863609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:49.863626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:49.863830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:49.863848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:49.863868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:49.863956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2074 partition: 0 MaxSeqNo: 45 sessionId: src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0
2025-10-01T14:13:49.864325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ada0a122-ce4d3eb0-74d77705-b79e4ebe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:49.867395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0] Write session: try to update token
2025-10-01T14:13:49.867416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:49.886071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2074 sessionId: src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:49.886270Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:49.886289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:49.886292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:49.886294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:49.886303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256349191433847:11039]
2025-10-01T14:13:49.886309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256349191433847:11039]
2025-10-01T14:13:49.886314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256349191433847:11039]
2025-10-01T14:13:49.886364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:49.886390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:49.886392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:49.886553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:49.886568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:49.886573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:49.886571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:49.888615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:49.936693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256351568334466:10880]
2025-10-01T14:13:49.937027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2073, pipe: [1:7556256351568334466:10880]
2025-10-01T14:13:50.042465Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:50.042883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.042895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.042936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256351568334466:10880], now have 1 active actors on pipe
2025-10-01T14:13:50.043433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:50.043141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:50.043442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:50.043490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256351568334466:10880]
2025-10-01T14:13:50.043523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2074 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0
2025-10-01T14:13:50.043742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2074 sessionId: src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0 is DEAD
2025-10-01T14:13:50.044952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:50.044965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0] Write session will restart in 0.005118s
2025-10-01T14:13:50.044996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0] Write session: Do CDS request
2025-10-01T14:13:50.045003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:50.053115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:50.053482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:50.053503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2075
2025-10-01T14:13:50.053640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:50.053672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:50.053678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:50.053682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:50.054066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2075 sessionId:  describe result for acl check
2025-10-01T14:13:50.054097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:50.054099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:50.054102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:50.054107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256355863301775:11350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:50.054685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256355863301775:11350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:50.057830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256355863301775:11350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:50.061856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256355863301775:11350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:50.061876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256355863301775:11350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:50.061879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256355863301775:11350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:50.061889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:50.074740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:50.076604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:50.076815Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:50.076819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:50.076829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:50.076878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:50.076937Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256353486401307:11041]
2025-10-01T14:13:50.077542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:50.077861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:50.077906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:50.078225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:50.078289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.078290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.078291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.078292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.078294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.078295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.078296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.078298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.078299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.078300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.078301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.078302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.078303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.078304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.078310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.078319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.078323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.078327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.078331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.078334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.078338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.078342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.078346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.078350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.078354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.078357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.078361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.078365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.078391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.078399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.078405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.078411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.078415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.078421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.078427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.078432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.078437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.078441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.078446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.078450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.078455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.078460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.078465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.078469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.078474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.078479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.078483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.078491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.078496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.078501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.078505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.078510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.078515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.078520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.078524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.078529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.078571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:50.083306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:50.084251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:50.084258Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:50.084260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:50.084264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:50.084273Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2074 [2:7556256353486401307:11041]
2025-10-01T14:13:50.084291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:50.084310Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:50.084314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:50.084317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:50.084319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:50.084337Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:50.084342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:50.084773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2074
2025-10-01T14:13:50.084796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2074
2025-10-01T14:13:50.084350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:50.084413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.084415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.084417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.084421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:50.084424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:50.084500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:50.084502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.084517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.084527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.084542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:50.084560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256353486401302:11041]
2025-10-01T14:13:50.084562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256353486401302:11041]
2025-10-01T14:13:50.084565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256353486401302:11041]
2025-10-01T14:13:50.084574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:50.084583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:50.084586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:50.084589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:50.084599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:50.084617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:50.084620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:50.084632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863301765:2446], now have 1 active actors on pipe
2025-10-01T14:13:50.084636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863301843:11350], now have 1 active actors on pipe
2025-10-01T14:13:50.084673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256353486401302:11041]
2025-10-01T14:13:50.084684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:50.084688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:50.084945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.084955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.084984Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97c49f83-1286efb-935625cf-496bfb08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:50.084992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:50.084996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:50.084998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:50.085009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:50.085019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:50.085035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:50.085316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.085323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.085339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:50.085910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2075 partition: 0 MaxSeqNo: 45 sessionId: src_id|97c49f83-1286efb-935625cf-496bfb08_0
2025-10-01T14:13:50.086820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dc3a3a2-5465244d-b4385b01-5ef1e8a2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|97c49f83-1286efb-935625cf-496bfb08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:50.089956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c49f83-1286efb-935625cf-496bfb08_0] Write session: try to update token
2025-10-01T14:13:50.089974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c49f83-1286efb-935625cf-496bfb08_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:50.108567Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:50.108605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:50.108608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:50.108610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:50.108624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256353486401302:11041]
2025-10-01T14:13:50.108634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256353486401302:11041]
2025-10-01T14:13:50.108638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256353486401302:11041]
2025-10-01T14:13:50.108697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:50.108705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.108708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:50.108857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:50.110432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:50.110449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:50.110457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:50.110966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2075 sessionId: src_id|97c49f83-1286efb-935625cf-496bfb08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:50.113798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:50.140466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256355863301932:10880]
2025-10-01T14:13:50.140856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2074, pipe: [1:7556256355863301932:10880]
2025-10-01T14:13:50.261833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:50.262282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.262307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.262360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863301932:10880], now have 1 active actors on pipe
2025-10-01T14:13:50.263469Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:50.263532Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:50.263593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:50.263596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:50.263660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2075 reason: error at write: Disconnected sessionId: src_id|97c49f83-1286efb-935625cf-496bfb08_0
2025-10-01T14:13:50.263906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2075 sessionId: src_id|97c49f83-1286efb-935625cf-496bfb08_0 is DEAD
2025-10-01T14:13:50.263973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256355863301932:10880]
2025-10-01T14:13:50.267928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c49f83-1286efb-935625cf-496bfb08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:50.267940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c49f83-1286efb-935625cf-496bfb08_0] Write session will restart in 0.008806s
2025-10-01T14:13:50.267970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c49f83-1286efb-935625cf-496bfb08_0] Write session: Do CDS request
2025-10-01T14:13:50.267975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c49f83-1286efb-935625cf-496bfb08_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:50.277921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97c49f83-1286efb-935625cf-496bfb08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:50.278548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:50.278565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2076
2025-10-01T14:13:50.278725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:50.278758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:50.278764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:50.278767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:50.279722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2076 sessionId:  describe result for acl check
2025-10-01T14:13:50.279755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:50.279757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:50.279758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:50.279763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256355863301950:11354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:50.280288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256355863301950:11354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:50.291141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256355863301950:11354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:50.301277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:50.304746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256355863301950:11354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:50.304765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256355863301950:11354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:50.304768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256355863301950:11354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:50.304777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:50.305569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:50.305805Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:50.305818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:50.305830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:50.305895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:50.305934Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256353486401468:11044]
2025-10-01T14:13:50.306537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:50.307246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:50.307300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:50.307615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:50.307673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.307674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.307676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.307677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.307678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.307679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.307680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.307682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.307683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.307684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.307685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.307686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.307688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.307689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.307695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.307706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.307710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.307714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.307718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.307722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.307726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.307730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.307733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.307738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.307742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.307747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.307751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.307754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.307761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.307770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.307776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.307782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.307787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.307793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.307797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.307802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.307808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.307814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.307820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.307825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.307830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.307836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.307840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.307846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.307850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.307856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.307860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.307866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.307871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.307878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.307883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.307888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.307893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.307898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.307902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.307907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.307947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:50.312447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:50.313423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:50.313429Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:50.313432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:50.313435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:50.313443Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2075 [2:7556256353486401468:11044]
2025-10-01T14:13:50.313457Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:50.313472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:50.313474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:50.313478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:50.313481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:50.313498Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:50.313504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:50.313510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:50.313574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.313575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.313578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.313581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:50.313583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:50.313665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:50.313668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.313677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.313687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.313701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:50.313719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256353486401461:11044]
2025-10-01T14:13:50.313721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256353486401461:11044]
2025-10-01T14:13:50.313723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256353486401461:11044]
2025-10-01T14:13:50.313736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:50.313749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:50.313763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:50.313766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:50.313795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256353486401461:11044]
2025-10-01T14:13:50.313798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:50.314001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:50.314007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:50.314009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:50.314014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:50.314702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2075
2025-10-01T14:13:50.314732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2075
2025-10-01T14:13:50.314830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863302089:11354], now have 1 active actors on pipe
2025-10-01T14:13:50.314839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863301934:2446], now have 1 active actors on pipe
2025-10-01T14:13:50.315557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.315568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.315600Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:50.315609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:50.315614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:50.315617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:50.315626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:50.315638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:50.315655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:50.315939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.315944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.315958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:50.316080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2076 partition: 0 MaxSeqNo: 45 sessionId: src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0
2025-10-01T14:13:50.316471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97c49f83-1286efb-935625cf-496bfb08_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:50.319631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0] Write session: try to update token
2025-10-01T14:13:50.319653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:50.339467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:50.339488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:50.339491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:50.339493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:50.339504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256353486401461:11044]
2025-10-01T14:13:50.339510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256353486401461:11044]
2025-10-01T14:13:50.339516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256353486401461:11044]
2025-10-01T14:13:50.339585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:50.339592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.339598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:50.339683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:50.339691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:50.339696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:50.339767Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:50.354251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2076 sessionId: src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:50.362754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:50.369031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256355863302115:10880]
2025-10-01T14:13:50.371372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2075, pipe: [1:7556256355863302115:10880]
2025-10-01T14:13:50.522697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:50.523058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.523066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.523087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863302115:10880], now have 1 active actors on pipe
2025-10-01T14:13:50.523739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:50.523750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:50.523795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2076 reason: error at write: Disconnected sessionId: src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0
2025-10-01T14:13:50.523958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2076 sessionId: src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0 is DEAD
2025-10-01T14:13:50.524060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256355863302115:10880]
2025-10-01T14:13:50.524070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:50.524722Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:50.526606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:50.526617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0] Write session will restart in 0.008364s
2025-10-01T14:13:50.526645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0] Write session: Do CDS request
2025-10-01T14:13:50.526651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:50.538934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:50.539270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:50.539288Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2077
2025-10-01T14:13:50.539484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:50.539514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:50.539520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:50.539524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:50.543297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2077 sessionId:  describe result for acl check
2025-10-01T14:13:50.543341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:50.543343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:50.543344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:50.543350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256355863302151:11366] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:50.544338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256355863302151:11366] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:50.548840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256355863302151:11366] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:50.555464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256355863302151:11366] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:50.555482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256355863302151:11366] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:50.555486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256355863302151:11366] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:50.555495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:50.565420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:50.568374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:50.568728Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:50.568733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:50.568747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:50.568808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:50.568843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256353486401649:11049]
2025-10-01T14:13:50.569478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:50.569958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:50.570004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:50.570321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:50.570389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.570391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.570392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.570393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.570395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.570396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.570398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.570400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.570401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.570403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.570404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.570406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.570407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.570409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.570415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.570425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.570429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.570433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.570437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.570441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.570444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.570448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.570452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.570457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.570460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.570464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.570468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.570472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.570479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.570486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.570492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.570497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.570501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.570507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.570512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.570517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.570522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.570528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.570535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.570540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.570545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.570551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.570555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.570559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.570564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.570569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.570573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.570579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.570583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.570589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.570593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.570597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.570602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.570607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.570612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.570616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.570656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:50.578538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:50.579682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:50.579688Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:50.579691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:50.579694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:50.579704Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2076 [2:7556256353486401649:11049]
2025-10-01T14:13:50.579723Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:50.579740Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:50.579744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:50.579748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:50.579750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:50.579768Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:50.579774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:50.579781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:50.579842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.579843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.579845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.579848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:50.579852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:50.579934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:50.579937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.579951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.579961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.579977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:50.579994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256353486401643:11049]
2025-10-01T14:13:50.579997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256353486401643:11049]
2025-10-01T14:13:50.579999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256353486401643:11049]
2025-10-01T14:13:50.580008Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:50.580023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:50.580037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:50.580040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:50.580081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256353486401643:11049]
2025-10-01T14:13:50.580084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:50.580169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:50.580171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:50.580173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:50.580177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:50.580441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863302132:2446], now have 1 active actors on pipe
2025-10-01T14:13:50.580445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863302227:11366], now have 1 active actors on pipe
2025-10-01T14:13:50.580852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2076
2025-10-01T14:13:50.580892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2076
2025-10-01T14:13:50.590518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.590543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.590583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:50.590594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:50.590600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:50.590604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:50.590624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:50.590645Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:50.590669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:50.595664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.595686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.595726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:50.596371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31985ded-b7bcfa12-fe2bed8a-8f4d3eb0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:50.595928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2077 partition: 0 MaxSeqNo: 45 sessionId: src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0
2025-10-01T14:13:50.599747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0] Write session: try to update token
2025-10-01T14:13:50.599768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:50.616719Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:50.616738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:50.616742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:50.616744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:50.616756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256353486401643:11049]
2025-10-01T14:13:50.616762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256353486401643:11049]
2025-10-01T14:13:50.616766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256353486401643:11049]
2025-10-01T14:13:50.616815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:50.616822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.616825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:50.616978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:50.617336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:50.617342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:50.617346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:50.630434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256355863302303:10880]
2025-10-01T14:13:50.630838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2076, pipe: [1:7556256355863302303:10880]
2025-10-01T14:13:50.650960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2077 sessionId: src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:50.653839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:50.778712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:13:50.778739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-01T14:13:50.852255Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:50.852640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863302303:10880], now have 1 active actors on pipe
2025-10-01T14:13:50.852665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.852673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.853624Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:50.854587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:50.854610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-10-01T14:13:50.854645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256355863302303:10880]
2025-10-01T14:13:50.854661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:50.854726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2077 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0
2025-10-01T14:13:50.854928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2077 sessionId: src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0 is DEAD
2025-10-01T14:13:50.855261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:50.855271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0] Write session will restart in 0.006834s
2025-10-01T14:13:50.855295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0] Write session: Do CDS request
2025-10-01T14:13:50.855301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:50.863550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:50.863902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:50.863919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2078
2025-10-01T14:13:50.864066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:50.864096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:50.864102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:50.864105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:50.865164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2078 sessionId:  describe result for acl check
2025-10-01T14:13:50.865200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:50.865202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:50.865204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:50.865209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256355863302333:11371] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:50.865728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256355863302333:11371] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:50.868366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256355863302333:11371] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:50.873491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256355863302333:11371] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:50.873510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256355863302333:11371] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:50.873513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256355863302333:11371] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:50.873522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:50.884029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:50.887151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:50.887405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:50.887409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:50.887420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:50.887472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:50.887511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256353486401844:11063]
2025-10-01T14:13:50.888241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:50.888674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:50.888714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:50.889023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:50.889070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.889071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.889072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.889074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.889075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.889076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.889078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.889079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.889080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.889081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.889082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.889083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.889084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.889085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.889090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.889099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.889102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.889105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.889110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.889114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.889116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.889120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.889123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.889127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.889130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.889133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.889136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.889139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.889145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.889153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:50.889158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.889163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:50.889168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.889173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:50.889177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.889182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:50.889186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.889191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:50.889195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.889200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:50.889204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.889208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:50.889211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.889215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:50.889219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.889224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:50.889227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.889232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.889235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.889243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.889247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.889252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.889255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.889260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:50.889263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.889268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:50.889301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:50.896205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2077
2025-10-01T14:13:50.896253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2077
2025-10-01T14:13:50.894850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:50.895719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:50.895724Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:50.895727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:50.895731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:50.895738Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2077 [2:7556256353486401844:11063]
2025-10-01T14:13:50.895755Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:50.895774Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:50.895777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:50.895781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:50.895783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:50.895799Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:50.895805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:50.895812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:50.895880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.895884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.895886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.895889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:50.895891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:50.895961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:50.895963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.895972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:50.895981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:50.895993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:50.896009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256353486401839:11063]
2025-10-01T14:13:50.896011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256353486401839:11063]
2025-10-01T14:13:50.896013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256353486401839:11063]
2025-10-01T14:13:50.896022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:50.896034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:50.896036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:50.896039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:50.896042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:50.896046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:50.896048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:50.896058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863302324:2446], now have 1 active actors on pipe
2025-10-01T14:13:50.896062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863302396:11371], now have 1 active actors on pipe
2025-10-01T14:13:50.896097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256353486401839:11063]
2025-10-01T14:13:50.896105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:50.896222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:50.896447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.896451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.896524Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:13:50.896550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:50.896558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:50.896563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:50.896566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:50.896578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:50.896587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:50.896611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:50.901193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.901211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.901252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:50.897013Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 19 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:13:50.897046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:13:50.902893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dd82e83b-2dadb383-7520b603-738c3a5f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:50.902517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2078 partition: 0 MaxSeqNo: 45 sessionId: src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0
2025-10-01T14:13:50.907200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0] Write session: try to update token
2025-10-01T14:13:50.907221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:50.929509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2078 sessionId: src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:50.931972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:50.934510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:50.934531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:50.934570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:50.934768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:50.941265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:50.941283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:50.941286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:50.941288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:50.941298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256353486401839:11063]
2025-10-01T14:13:50.941305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256353486401839:11063]
2025-10-01T14:13:50.941309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256353486401839:11063]
2025-10-01T14:13:50.941355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:50.941362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:50.941364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:50.941504Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:50.942567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:50.942578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:50.942582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:50.958446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256355863302500:10880]
2025-10-01T14:13:50.958879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2077, pipe: [1:7556256355863302500:10880]
2025-10-01T14:13:51.120865Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:51.121177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256355863302500:10880], now have 1 active actors on pipe
2025-10-01T14:13:51.129876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.129905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.130087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.130156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.130225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.130293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.130782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.130795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.130868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.130935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.131085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.131158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.131203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.131211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.131273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.131334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.131398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.131460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.131500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.131502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.131568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.131628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.131686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.131747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.131788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.131791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.131858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.131917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.132011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.132069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.132108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.132110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.132198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.132281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.132360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.132442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.132497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.132504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.132582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.132665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.132747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.132827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.132886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.132892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.132973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.133040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.133114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.133187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.133239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.133246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.133326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.133395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.133466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.133539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.133609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.133616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.133698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:51.133771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:51.133844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:51.133921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:51.133975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:51.133985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:51.134792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:51.134908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:51.134922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:51.134960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2078 reason: error at write: Disconnected sessionId: src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0
2025-10-01T14:13:51.135191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2078 sessionId: src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0 is DEAD
2025-10-01T14:13:51.135357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256355863302500:10880]
2025-10-01T14:13:51.135377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:51.136784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:51.136795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0] Write session will restart in 0.009826s
2025-10-01T14:13:51.136821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0] Write session: Do CDS request
2025-10-01T14:13:51.136827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:51.150906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:51.151232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:51.151248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2079
2025-10-01T14:13:51.151944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:51.151979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:51.151984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:51.151989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:51.152460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2079 sessionId:  describe result for acl check
2025-10-01T14:13:51.152491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:51.152493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:51.152495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:51.152500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256360158269858:11376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:51.153008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256360158269858:11376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:51.161456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256360158269858:11376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:51.164626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:51.168397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:51.168538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256360158269858:11376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:51.168562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256360158269858:11376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:51.168565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256360158269858:11376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:51.168572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:51.168662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:51.168677Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:51.168690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:51.168753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:51.168795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256357781369305:11067]
2025-10-01T14:13:51.169407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:51.170560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:51.170634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:51.171054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:51.171132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.171133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.171135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.171136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.171138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.171139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.171140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.171141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.171142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.171144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.171145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.171146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.171147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.171149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.171155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.171164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.171168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.171172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.171176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.171180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.171183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.171187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.171191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.171195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.171199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.171202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.171207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.171210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.171219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.171227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.171234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.171240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.171245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.171250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.171256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.171261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.171266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.171272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.171276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.171281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.171285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.171291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.171295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.171301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.171306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.171312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.171319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.171327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.171332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.171339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.171343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.171350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.171355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.171361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.171365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.171370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.171410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:51.177059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:51.177867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:51.177874Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:51.177877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:51.177881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:51.177888Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2078 [2:7556256357781369305:11067]
2025-10-01T14:13:51.177905Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:51.177925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:51.177929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:51.177933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:51.177935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:51.177955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:51.177960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:51.177967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:51.178032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.178034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.178036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.178038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:51.178041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:51.178121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:51.178124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.178137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.178149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.178168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:51.178189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256357781369299:11067]
2025-10-01T14:13:51.178192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256357781369299:11067]
2025-10-01T14:13:51.178195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256357781369299:11067]
2025-10-01T14:13:51.178214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:51.178235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:51.178247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:51.178249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:51.178250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:51.178252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:51.178252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:51.178294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256357781369299:11067]
2025-10-01T14:13:51.178298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:51.178320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:51.178336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158269802:2446], now have 1 active actors on pipe
2025-10-01T14:13:51.178340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158269961:11376], now have 1 active actors on pipe
2025-10-01T14:13:51.179105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2078
2025-10-01T14:13:51.179148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2078
2025-10-01T14:13:51.179373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.179387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.179421Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df7747f9-bab310d-47a31662-dfdc822b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:51.179430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:51.179435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:51.179438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:51.179449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:51.179462Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:51.179483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:51.180065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.180075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.180095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:51.180253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2079 partition: 0 MaxSeqNo: 45 sessionId: src_id|df7747f9-bab310d-47a31662-dfdc822b_0
2025-10-01T14:13:51.180703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e1e0054-32b11fd7-b8e45182-bcb0252d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|df7747f9-bab310d-47a31662-dfdc822b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:51.183802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df7747f9-bab310d-47a31662-dfdc822b_0] Write session: try to update token
2025-10-01T14:13:51.183823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df7747f9-bab310d-47a31662-dfdc822b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:51.201103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:51.201124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:51.201127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:51.201129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:51.201141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256357781369299:11067]
2025-10-01T14:13:51.201146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256357781369299:11067]
2025-10-01T14:13:51.201381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256357781369299:11067]
2025-10-01T14:13:51.201435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:51.201441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.201444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:51.201593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:51.202215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:51.202230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:51.202235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:51.201660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2079 sessionId: src_id|df7747f9-bab310d-47a31662-dfdc822b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:51.204488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:51.237665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256360158269972:10880]
2025-10-01T14:13:51.238228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2078, pipe: [1:7556256360158269972:10880]
2025-10-01T14:13:51.364413Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:51.364875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.364899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.364954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158269972:10880], now have 1 active actors on pipe
2025-10-01T14:13:51.365257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:51.365336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256360158269972:10880]
2025-10-01T14:13:51.365360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:51.365363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:51.365435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2079 reason: error at write: Disconnected sessionId: src_id|df7747f9-bab310d-47a31662-dfdc822b_0
2025-10-01T14:13:51.365344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:51.365656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2079 sessionId: src_id|df7747f9-bab310d-47a31662-dfdc822b_0 is DEAD
2025-10-01T14:13:51.365779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7747f9-bab310d-47a31662-dfdc822b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:51.365790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7747f9-bab310d-47a31662-dfdc822b_0] Write session will restart in 0.008675s
2025-10-01T14:13:51.365843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7747f9-bab310d-47a31662-dfdc822b_0] Write session: Do CDS request
2025-10-01T14:13:51.365858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7747f9-bab310d-47a31662-dfdc822b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:51.377039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df7747f9-bab310d-47a31662-dfdc822b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:51.377416Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:51.377437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2080
2025-10-01T14:13:51.378353Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:51.378413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:51.378427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:51.378431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:51.379202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2080 sessionId:  describe result for acl check
2025-10-01T14:13:51.379237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:51.379243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:51.379245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:51.379251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256360158270000:11380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:51.379721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256360158270000:11380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:51.384239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256360158270000:11380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:51.389035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256360158270000:11380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:51.389054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256360158270000:11380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:51.389057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256360158270000:11380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:51.389066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:51.391980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:51.394848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:51.395117Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:51.395130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:51.395142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:51.395204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:51.395252Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256357781369483:11070]
2025-10-01T14:13:51.395879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:51.396275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:51.396328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:51.396704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:51.396779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.396785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.396787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.396789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.396790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.396792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.396794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.396795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.396796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.396798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.396799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.396800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.396801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.396802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.396808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.396819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.396823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.396827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.396831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.396834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.396838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.396842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.396846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.396851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.396855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.396859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.396863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.396866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.396874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.396881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.396889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.396895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.396901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.396906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.396911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.396916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.396921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.396926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.396931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.396936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.396941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.396946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.396950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.396955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.396961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.396967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.396971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.396976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.396981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.396986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.396990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.396995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.397000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.397005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.397009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.397023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.397063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:51.402340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:51.403591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:51.403607Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:51.403610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:51.403614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:51.403621Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2079 [2:7556256357781369483:11070]
2025-10-01T14:13:51.403642Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:51.403662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:51.403669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:51.403673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:51.403676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:51.403693Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:51.403704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:51.403711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:51.403773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.403779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.403782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.403785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:51.403788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:51.403860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:51.403867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.403880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.403892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.403910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:51.403930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256357781369477:11070]
2025-10-01T14:13:51.403937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256357781369477:11070]
2025-10-01T14:13:51.403940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256357781369477:11070]
2025-10-01T14:13:51.403955Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:51.403974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:51.403992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:51.403999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:51.404037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256357781369477:11070]
2025-10-01T14:13:51.404044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:51.404127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:51.404135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:51.404137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:51.404141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:51.404453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2079
2025-10-01T14:13:51.404489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2079
2025-10-01T14:13:51.407944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158269975:2446], now have 1 active actors on pipe
2025-10-01T14:13:51.407966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158270131:11380], now have 1 active actors on pipe
2025-10-01T14:13:51.407992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.408000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.408036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e85f194a-135ab466-8654adb0-e22daa71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:51.408051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:51.408062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:51.408068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:51.408080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:51.408102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:51.408129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:51.414506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2080 partition: 0 MaxSeqNo: 45 sessionId: src_id|e85f194a-135ab466-8654adb0-e22daa71_0
2025-10-01T14:13:51.411133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.411150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.411192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:51.418534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df7747f9-bab310d-47a31662-dfdc822b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e85f194a-135ab466-8654adb0-e22daa71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:51.421735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85f194a-135ab466-8654adb0-e22daa71_0] Write session: try to update token
2025-10-01T14:13:51.421754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85f194a-135ab466-8654adb0-e22daa71_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:51.436936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:51.436959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:51.436962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:51.436964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:51.436975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256357781369477:11070]
2025-10-01T14:13:51.436979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256357781369477:11070]
2025-10-01T14:13:51.436983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256357781369477:11070]
2025-10-01T14:13:51.437038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:51.437045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.437047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:51.437632Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:51.438812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:51.438823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:51.438827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:51.466461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256360158270160:10880]
2025-10-01T14:13:51.468518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2079, pipe: [1:7556256360158270160:10880]
2025-10-01T14:13:51.471987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2080 sessionId: src_id|e85f194a-135ab466-8654adb0-e22daa71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:51.474921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:51.605022Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:51.605370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158270160:10880], now have 1 active actors on pipe
2025-10-01T14:13:51.605399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.605407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.606673Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:51.607651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256360158270160:10880]
2025-10-01T14:13:51.607680Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:51.607711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:51.607777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2080 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e85f194a-135ab466-8654adb0-e22daa71_0
2025-10-01T14:13:51.607996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2080 sessionId: src_id|e85f194a-135ab466-8654adb0-e22daa71_0 is DEAD
2025-10-01T14:13:51.610621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85f194a-135ab466-8654adb0-e22daa71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:51.610634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85f194a-135ab466-8654adb0-e22daa71_0] Write session will restart in 0.009553s
2025-10-01T14:13:51.610664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85f194a-135ab466-8654adb0-e22daa71_0] Write session: Do CDS request
2025-10-01T14:13:51.610672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85f194a-135ab466-8654adb0-e22daa71_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:51.622946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e85f194a-135ab466-8654adb0-e22daa71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:51.623583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:51.623604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2081
2025-10-01T14:13:51.623748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:51.623778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:51.623784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:51.623787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:51.626675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2081 sessionId:  describe result for acl check
2025-10-01T14:13:51.626711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:51.626713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:51.626715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:51.626721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256360158270189:11392] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:51.627220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256360158270189:11392] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:51.636856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256360158270189:11392] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:51.643585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256360158270189:11392] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:51.643606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256360158270189:11392] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:51.643610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256360158270189:11392] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:51.643620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:51.660240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:51.663377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:51.663617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:51.663629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:51.663642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:51.663695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:51.663745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256357781369655:11074]
2025-10-01T14:13:51.664395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:51.664936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:51.664986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:51.665311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:51.665368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.665369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.665370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.665372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.665373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.665374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.665375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.665377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.665378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.665379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.665380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.665381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.665382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.665383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.665388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.665397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.665401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.665404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.665408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.665411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.665414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.665417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.665421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.665425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.665427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.665431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.665434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.665437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.665447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.665454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.665459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.665464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.665468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.665473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.665477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.665483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.665487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.665491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.665496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.665500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.665504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.665508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.665512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.665516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.665521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.665525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.665529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.665534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.665538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.665542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.665546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.665570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.665574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.665579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.665583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.665587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.665623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:51.670720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:51.671700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:51.671715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:51.671717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:51.671721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:51.671727Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2080 [2:7556256357781369655:11074]
2025-10-01T14:13:51.671744Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:51.671762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:51.671765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:51.671768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:51.671770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:51.671787Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:51.671793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:51.671800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:51.671859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.671861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.671863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.671866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:51.671869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:51.671945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:51.671947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.671958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.671968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.671982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:51.671999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256357781369650:11074]
2025-10-01T14:13:51.672001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256357781369650:11074]
2025-10-01T14:13:51.672003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256357781369650:11074]
2025-10-01T14:13:51.672014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:51.672027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:51.672040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:51.672043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:51.672075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256357781369650:11074]
2025-10-01T14:13:51.672077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:51.672154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:51.672156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:51.672159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:51.672164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:51.672387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158270180:2446], now have 1 active actors on pipe
2025-10-01T14:13:51.672391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158270230:11392], now have 1 active actors on pipe
2025-10-01T14:13:51.672747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2080
2025-10-01T14:13:51.672788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2080
2025-10-01T14:13:51.674494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.674512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.674545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:51.674555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:51.674561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:51.674564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:51.674576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:51.674589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:51.674614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:51.674928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.674935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.674949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:51.675082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2081 partition: 0 MaxSeqNo: 45 sessionId: src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0
2025-10-01T14:13:51.676124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e85f194a-135ab466-8654adb0-e22daa71_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:51.679266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0] Write session: try to update token
2025-10-01T14:13:51.679284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:51.703491Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:51.703510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:51.703512Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:51.703524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:51.703535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256357781369650:11074]
2025-10-01T14:13:51.703540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256357781369650:11074]
2025-10-01T14:13:51.703545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256357781369650:11074]
2025-10-01T14:13:51.703598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:51.703607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.703609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:51.703775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:51.704210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:51.704218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:51.704223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:51.710517Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256360158270365:10880]
2025-10-01T14:13:51.711438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2080, pipe: [1:7556256360158270365:10880]
2025-10-01T14:13:51.718467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2081 sessionId: src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:51.721270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:51.864109Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:51.864648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158270365:10880], now have 1 active actors on pipe
2025-10-01T14:13:51.864684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.864690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.865558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:51.866579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256360158270365:10880]
2025-10-01T14:13:51.866609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:51.866679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2081 reason: status is not ok: tablet will be restarted right now sessionId: src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0
2025-10-01T14:13:51.866700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:51.866898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2081 sessionId: src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0 is DEAD
2025-10-01T14:13:51.868823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:51.868834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0] Write session will restart in 0.007694s
2025-10-01T14:13:51.868861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0] Write session: Do CDS request
2025-10-01T14:13:51.868867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:51.878814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:51.879126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:51.879142Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2082
2025-10-01T14:13:51.879312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:51.879341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:51.879348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:51.879351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:51.880218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2082 sessionId:  describe result for acl check
2025-10-01T14:13:51.880259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:51.880260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:51.880262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:51.880267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256360158270412:11397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:51.880800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256360158270412:11397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:51.886728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256360158270412:11397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:51.895411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256360158270412:11397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:51.895429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256360158270412:11397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:51.895433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256360158270412:11397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:51.895441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:51.898467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:51.899941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:51.900138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:51.900142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:51.900153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:51.900197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:51.900235Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256357781369852:11087]
2025-10-01T14:13:51.900926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:51.901305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:51.901341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:51.901653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:51.901699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.901701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.901702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.901703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.901704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.901706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.901707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.901709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.901710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.901711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.901712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.901714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.901715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.901716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.901721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.901731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.901736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.901739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.901743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.901747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.901751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.901754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.901757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.901763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.901767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.901770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.901774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.901778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.901784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.901791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:51.901797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.901803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:51.901807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.901812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:51.901819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.901824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:51.901829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.901834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:51.901839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.901844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:51.901849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.901855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:51.901859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.901864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:51.901869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.901874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:51.901879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.901883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.901890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.901894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.901899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.901904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.901908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.901913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:51.901917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.901922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:51.901961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:51.906271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:51.908206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2081
2025-10-01T14:13:51.908248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2081
2025-10-01T14:13:51.906977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:51.906991Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:51.906994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:51.906998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:51.907005Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2081 [2:7556256357781369852:11087]
2025-10-01T14:13:51.907179Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:51.907198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:51.907201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:51.907204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:51.907207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:51.907225Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:51.907230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:51.907237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:51.907293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.907295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.907298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.907301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:51.907304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:51.907381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:51.907384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.907395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:51.907407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:51.907424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:51.907441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256357781369846:11087]
2025-10-01T14:13:51.907443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256357781369846:11087]
2025-10-01T14:13:51.907445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256357781369846:11087]
2025-10-01T14:13:51.907455Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:51.907464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:51.907467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:51.907470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:51.907470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:51.907484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:51.907487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:51.907498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158270373:2446], now have 1 active actors on pipe
2025-10-01T14:13:51.907502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158270527:11397], now have 1 active actors on pipe
2025-10-01T14:13:51.907533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256357781369846:11087]
2025-10-01T14:13:51.907542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:51.907652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:51.912718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2082 partition: 0 MaxSeqNo: 45 sessionId: src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0
2025-10-01T14:13:51.914634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|833c58a0-cf89bbb7-b9a6376-45b1d93e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:51.918233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0] Write session: try to update token
2025-10-01T14:13:51.918252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:51.912165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.912184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.912219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:51.912231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:51.912236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:51.912239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:51.912250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:51.912266Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:51.912296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:51.912571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:51.912574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:51.912588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:51.942211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:51.942235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:51.942238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:51.942240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:51.942251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256357781369846:11087]
2025-10-01T14:13:51.942261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256357781369846:11087]
2025-10-01T14:13:51.942266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256357781369846:11087]
2025-10-01T14:13:51.942323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:51.942331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:51.942334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:51.942623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:51.942637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:51.942641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:51.946749Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:51.956200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2082 sessionId: src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:51.959437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:51.970542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256360158270543:10880]
2025-10-01T14:13:51.970939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2081, pipe: [1:7556256360158270543:10880]
2025-10-01T14:13:52.109684Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:52.110124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.110136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.110180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256360158270543:10880], now have 1 active actors on pipe
2025-10-01T14:13:52.111799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256360158270543:10880]
2025-10-01T14:13:52.111820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:52.111847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:52.111849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:52.111895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2082 reason: error at write: Disconnected sessionId: src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0
2025-10-01T14:13:52.112039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2082 sessionId: src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0 is DEAD
2025-10-01T14:13:52.111598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:52.112427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:52.112436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0] Write session will restart in 0.008207s
2025-10-01T14:13:52.112466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0] Write session: Do CDS request
2025-10-01T14:13:52.112472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:52.122019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:52.122785Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:52.122803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2083
2025-10-01T14:13:52.123553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:52.123589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:52.123595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:52.123598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:52.123923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2083 sessionId:  describe result for acl check
2025-10-01T14:13:52.123948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:52.123950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:52.123954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:52.123958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256364453237859:11404] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:52.124461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256364453237859:11404] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:52.132295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256364453237859:11404] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:52.138199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:52.142176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:52.142450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:52.142456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:52.142469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:52.142523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:52.142566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256362076337315:11089]
2025-10-01T14:13:52.143165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:52.147779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256364453237859:11404] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:52.147800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256364453237859:11404] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:52.147804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256364453237859:11404] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:52.147814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:52.148788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:52.148866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:52.149223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:52.149285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.149286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.149288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.149289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.149291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.149292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.149294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.149295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.149296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.149298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.149299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.149300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.149301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.149303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.149310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.149320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.149324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.149328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.149332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.149336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.149339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.149343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.149347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.149351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.149355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.149359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.149363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.149366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.149375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.149400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.149408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.149412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.149416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.149421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.149425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.149431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.149436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.149442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.149446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.149451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.149456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.149462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.149466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.149471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.149477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.149482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.149487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.149492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.149497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.149503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.149507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.149513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.149517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.149522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.149530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.149535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.149576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:52.154468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:52.155635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:52.155640Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:52.155642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:52.155646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:52.155653Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2082 [2:7556256362076337315:11089]
2025-10-01T14:13:52.155669Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:52.155688Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:52.155692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:52.155696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:52.155698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:52.155714Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:52.155719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:52.155725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:52.155785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.155786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.155788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.155791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:52.155794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:52.155867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:52.155869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.155880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.155891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.155906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:52.155922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256362076337309:11089]
2025-10-01T14:13:52.155924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256362076337309:11089]
2025-10-01T14:13:52.155926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256362076337309:11089]
2025-10-01T14:13:52.155940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:52.155954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:52.155969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:52.155972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:52.156008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256362076337309:11089]
2025-10-01T14:13:52.156010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:52.156030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:52.156033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:52.156036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:52.156042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:52.156332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2082
2025-10-01T14:13:52.156370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2082
2025-10-01T14:13:52.156621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453237841:2446], now have 1 active actors on pipe
2025-10-01T14:13:52.156632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238009:11404], now have 1 active actors on pipe
2025-10-01T14:13:52.156652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.156657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.156684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:52.156692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:52.156697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:52.156700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:52.156711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:52.156721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:52.156737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:52.160548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.160566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.160614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:52.160940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2083 partition: 0 MaxSeqNo: 45 sessionId: src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0
2025-10-01T14:13:52.161437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a901c7-ea8e473f-48c1cd83-2f64f729_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:52.164706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0] Write session: try to update token
2025-10-01T14:13:52.164725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:52.192795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2083 sessionId: src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:52.195617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:52.198520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:52.198537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:52.198540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:52.198542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:52.198552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256362076337309:11089]
2025-10-01T14:13:52.198557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256362076337309:11089]
2025-10-01T14:13:52.198561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256362076337309:11089]
2025-10-01T14:13:52.198606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:52.198615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.198617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:52.198807Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:52.200545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:52.200554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:52.200559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:52.214442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256364453238019:10880]
2025-10-01T14:13:52.214931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2082, pipe: [1:7556256364453238019:10880]
2025-10-01T14:13:52.360105Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:52.360405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.360416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.360439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238019:10880], now have 1 active actors on pipe
2025-10-01T14:13:52.362162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:52.362532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256364453238019:10880]
2025-10-01T14:13:52.362571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:52.362636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2083 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0
2025-10-01T14:13:52.362708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:52.362828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2083 sessionId: src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0 is DEAD
2025-10-01T14:13:52.364041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:52.364053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0] Write session will restart in 0.009559s
2025-10-01T14:13:52.364093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0] Write session: Do CDS request
2025-10-01T14:13:52.364099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:52.374973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:52.378801Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:52.378821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2084
2025-10-01T14:13:52.382901Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:52.382952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:52.382957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:52.382961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:52.383700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2084 sessionId:  describe result for acl check
2025-10-01T14:13:52.383741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:52.383747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:52.383749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:52.383754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256364453238150:11408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:52.384240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256364453238150:11408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:52.384498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:52.386557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256364453238150:11408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:52.386762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:52.386958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:52.386968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:52.386979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:52.387033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:52.387068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256362076337497:11093]
2025-10-01T14:13:52.387590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:52.387903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:52.387945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:52.388230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:52.388288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.388294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.388295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.388296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.388297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.388298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.388299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.388300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.388301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.388302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.388303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.388304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.388305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.388307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.388311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.388320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.388324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.388328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.388331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.388334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.388338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.388341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.388344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.388348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.388351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.388353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.388356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.388359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.388366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.388372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.388378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.388382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.388386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.388391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.388383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256364453238150:11408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:52.388396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256364453238150:11408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:52.388402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256364453238150:11408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:52.388409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:52.388400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.388404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.388408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.388413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.388417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.388421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.388425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.388430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.388433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.388438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.388442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.388446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.388450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.388455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.388459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.388463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.388467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.388471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.388475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.388480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.388484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.388488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.388522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:52.397774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:52.398828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:52.398845Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:52.398847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:52.398851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:52.398858Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2083 [2:7556256362076337497:11093]
2025-10-01T14:13:52.398876Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:52.398894Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:52.398897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:52.398901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:52.398903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:52.398921Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:52.398926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:52.398932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:52.398991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.399000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.399002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.399005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:52.399007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:52.399079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:52.399084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.399096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.399123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.399139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:52.399163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238022:2446], now have 1 active actors on pipe
2025-10-01T14:13:52.399173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238187:11408], now have 1 active actors on pipe
2025-10-01T14:13:52.399181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256362076337491:11093]
2025-10-01T14:13:52.399183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256362076337491:11093]
2025-10-01T14:13:52.399185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256362076337491:11093]
2025-10-01T14:13:52.399198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:52.399214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:52.399214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:52.399217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:52.399219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:52.399228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:52.399231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:52.399270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256362076337491:11093]
2025-10-01T14:13:52.399283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:52.399310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:52.399327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.399336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.399362Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:52.399374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:52.399378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:52.399383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:52.399392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:52.399404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:52.399422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:52.399583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.399594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.399607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:52.399245Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2083
2025-10-01T14:13:52.399288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2083
2025-10-01T14:13:52.400112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dcd765c-5a9323f8-e7c4424b-235f1034_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:52.399667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2084 partition: 0 MaxSeqNo: 45 sessionId: src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0
2025-10-01T14:13:52.403193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0] Write session: try to update token
2025-10-01T14:13:52.403210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:52.416441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:52.416462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:52.416474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256362076337491:11093]
2025-10-01T14:13:52.416521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:52.416529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:52.416753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:52.416913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:52.417044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:52.417205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:52.417423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:52.417456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:52.421454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2084 sessionId: src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:52.424316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:52.424587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.424621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.424660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:52.424746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:52.441863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:52.441880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:52.441882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:52.441884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:52.441894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256362076337491:11093]
2025-10-01T14:13:52.441898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256362076337491:11093]
2025-10-01T14:13:52.441902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256362076337491:11093]
2025-10-01T14:13:52.441949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:52.441954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.441956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:52.442004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:52.442011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:52.442014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:52.442305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:52.462367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256364453238200:10880]
2025-10-01T14:13:52.463043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2083, pipe: [1:7556256364453238200:10880]
2025-10-01T14:13:52.602999Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:52.612621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.612651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.612813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.612872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.612928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.612978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.613269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.613275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.613346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.613603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.613700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.613793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.613832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.613837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.613903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.613957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.614010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.614068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.614107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.614110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.614205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.614270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.614341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.614448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.614487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.614490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.614591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.614685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.614744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.614801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.614840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.614843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.614906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.614961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.615019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.615076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.615117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.615120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.615184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.615237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.615337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.615396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.615450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.615453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.615537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.615604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.615673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.615742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.615807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.615811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.615885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.615951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.616020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.616098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.616146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.616150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.616230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:52.616292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:52.616358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:52.616424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:52.616471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:52.616474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:52.616567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238200:10880], now have 1 active actors on pipe
2025-10-01T14:13:52.616896Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:52.617315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:52.617326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0] Write session will restart in 0.005279s
2025-10-01T14:13:52.617351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0] Write session: Do CDS request
2025-10-01T14:13:52.617360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:52.616954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:52.616967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256364453238200:10880]
2025-10-01T14:13:52.616995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:52.616998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:52.617021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2084 reason: error at write: Disconnected sessionId: src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0
2025-10-01T14:13:52.617194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2084 sessionId: src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0 is DEAD
2025-10-01T14:13:52.623891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:52.623999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:52.624016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2085
2025-10-01T14:13:52.624118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:52.624149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:52.624155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:52.624159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:52.624569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2085 sessionId:  describe result for acl check
2025-10-01T14:13:52.624621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:52.624628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:52.624630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:52.624636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256364453238251:11420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:52.625675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256364453238251:11420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:52.630636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256364453238251:11420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:52.639661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256364453238251:11420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:52.639677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256364453238251:11420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:52.639681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256364453238251:11420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:52.639690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:52.642897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:52.645566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:52.645902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:52.645906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:52.645919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:52.645980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:52.646020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256362076337673:11097]
2025-10-01T14:13:52.646686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:52.647058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:52.647123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:52.647476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:52.647559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.647566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.647567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.647568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.647569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.647570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.647571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.647573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.647574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.647575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.647577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.647578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.647579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.647581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.647587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.647596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.647600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.647604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.647607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.647612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.647615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.647618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.647621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.647625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.647628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.647631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.647634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.647637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.647645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.647651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.647657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.647662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.647667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.647671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.647675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.647682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.647686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.647692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.647697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.647703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.647708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.647713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.647717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.647722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.647726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.647731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.647734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.647739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.647743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.647748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.647752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.647765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.647769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.647774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.647778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.647782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.647819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:52.651817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:52.652834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:52.652850Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:52.652852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:52.652856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:52.652863Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2084 [2:7556256362076337673:11097]
2025-10-01T14:13:52.652878Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:52.652898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:52.652902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:52.652905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:52.652915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:52.652932Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:52.652937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:52.652943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:52.653013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.653020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.653022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.653025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:52.653027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:52.653088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:52.653095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.653108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.653117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.653135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:52.653159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238236:2446], now have 1 active actors on pipe
2025-10-01T14:13:52.653171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238395:11420], now have 1 active actors on pipe
2025-10-01T14:13:52.653178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256362076337668:11097]
2025-10-01T14:13:52.653180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256362076337668:11097]
2025-10-01T14:13:52.653182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256362076337668:11097]
2025-10-01T14:13:52.653190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:52.653201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:52.653204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:52.653204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:52.653206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:52.653218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:52.653228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:52.653267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256362076337668:11097]
2025-10-01T14:13:52.653278Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:52.653292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:52.653462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2084
2025-10-01T14:13:52.653507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2084
2025-10-01T14:13:52.653531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.653542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.653564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34481ba3-1ddbd165-8896e36f-3134f751_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:52.653577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:52.653589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:52.653596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:52.653605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:52.653615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:52.653637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:52.653820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.653831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.653862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:52.653937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2085 partition: 0 MaxSeqNo: 45 sessionId: src_id|34481ba3-1ddbd165-8896e36f-3134f751_0
2025-10-01T14:13:52.654329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c0b177f-ccb8475f-417a9af-4a90b3f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|34481ba3-1ddbd165-8896e36f-3134f751_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:52.657407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34481ba3-1ddbd165-8896e36f-3134f751_0] Write session: try to update token
2025-10-01T14:13:52.657426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34481ba3-1ddbd165-8896e36f-3134f751_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:52.676500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2085 sessionId: src_id|34481ba3-1ddbd165-8896e36f-3134f751_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:52.674439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:52.674458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:52.674460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:52.674463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:52.674475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256362076337668:11097]
2025-10-01T14:13:52.674481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256362076337668:11097]
2025-10-01T14:13:52.674485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256362076337668:11097]
2025-10-01T14:13:52.674538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:52.674544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.674547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:52.674697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:52.677413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:52.677422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:52.677427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:52.679165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:52.716841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256364453238422:10880]
2025-10-01T14:13:52.717221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2084, pipe: [1:7556256364453238422:10880]
2025-10-01T14:13:52.821555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:52.821798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.821808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.821849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238422:10880], now have 1 active actors on pipe
2025-10-01T14:13:52.822680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34481ba3-1ddbd165-8896e36f-3134f751_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:52.822693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34481ba3-1ddbd165-8896e36f-3134f751_0] Write session will restart in 0.005951s
2025-10-01T14:13:52.822719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34481ba3-1ddbd165-8896e36f-3134f751_0] Write session: Do CDS request
2025-10-01T14:13:52.822725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34481ba3-1ddbd165-8896e36f-3134f751_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:52.822226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256364453238422:10880]
2025-10-01T14:13:52.822272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:52.822274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:52.822334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2085 reason: error at write: Disconnected sessionId: src_id|34481ba3-1ddbd165-8896e36f-3134f751_0
2025-10-01T14:13:52.822515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2085 sessionId: src_id|34481ba3-1ddbd165-8896e36f-3134f751_0 is DEAD
2025-10-01T14:13:52.822495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:52.822978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:52.829958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34481ba3-1ddbd165-8896e36f-3134f751_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:52.830037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:52.830051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2086
2025-10-01T14:13:52.830151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:52.830178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:52.830183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:52.830187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:52.830613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2086 sessionId:  describe result for acl check
2025-10-01T14:13:52.830644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:52.830650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:52.830654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:52.830659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256364453238467:11425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:52.831150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256364453238467:11425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:52.836382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256364453238467:11425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:52.835744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:52.837766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:52.837926Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:52.837930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:52.837939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:52.837972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:52.837998Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256362076337843:11100]
2025-10-01T14:13:52.838621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:52.840511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256364453238467:11425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:52.840526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256364453238467:11425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:52.840528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256364453238467:11425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:52.840536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:52.838897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:52.838930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:52.839210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:52.839247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.839248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.839249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.839250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.839251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.839252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.839253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.839255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.839256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.839257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.839258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.839259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.839260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.839261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.839265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.839274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.839277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.839280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.839283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.839287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.839290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.839293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.839296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.839299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.839303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.839306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.839309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.839312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.839318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.839325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:52.839330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.839334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:52.839338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.839342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:52.839346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.839351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:52.839355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.839359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:52.839363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.839367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:52.839372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.839377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:52.839381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.839385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:52.839390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.839394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:52.839399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.839403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.839407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.839411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.839415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.839419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.839423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.839428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:52.839432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.839436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:52.839469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:52.843415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:52.844336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:52.844353Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:52.844355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:52.844358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:52.844365Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2085 [2:7556256362076337843:11100]
2025-10-01T14:13:52.844381Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:52.844401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:52.844409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:52.844412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:52.844414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:52.844429Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:52.844438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:52.844448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:52.844504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.844511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.844513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.844516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:52.844518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:52.844587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:52.844604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.844616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:52.844626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:52.844644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:52.844668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238425:2446], now have 1 active actors on pipe
2025-10-01T14:13:52.844671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238593:11425], now have 1 active actors on pipe
2025-10-01T14:13:52.844678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256362076337838:11100]
2025-10-01T14:13:52.844680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256362076337838:11100]
2025-10-01T14:13:52.844682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256362076337838:11100]
2025-10-01T14:13:52.844695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:52.844709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:52.844710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:52.844723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:52.844726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:52.844732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:52.844738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:52.844752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256362076337838:11100]
2025-10-01T14:13:52.844759Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:52.844729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2085
2025-10-01T14:13:52.844750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2085
2025-10-01T14:13:52.844772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:52.844796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.844804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.844826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|286a287c-2f140917-f830632f-dc625b6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:52.844838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:52.844846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:52.844848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:52.844857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:52.844864Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:52.844880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:52.845012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.845019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.845031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:52.845096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2086 partition: 0 MaxSeqNo: 45 sessionId: src_id|286a287c-2f140917-f830632f-dc625b6c_0
2025-10-01T14:13:52.845472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34481ba3-1ddbd165-8896e36f-3134f751_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|286a287c-2f140917-f830632f-dc625b6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:52.848473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|286a287c-2f140917-f830632f-dc625b6c_0] Write session: try to update token
2025-10-01T14:13:52.848494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|286a287c-2f140917-f830632f-dc625b6c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:52.862676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2086 sessionId: src_id|286a287c-2f140917-f830632f-dc625b6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:52.865158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:52.865338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:52.865359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:52.865398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:52.865543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:52.868952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:52.868965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:52.868967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:52.868969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:52.868975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256362076337838:11100]
2025-10-01T14:13:52.868978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256362076337838:11100]
2025-10-01T14:13:52.868982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256362076337838:11100]
2025-10-01T14:13:52.869014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:52.869019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:52.869022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:52.869029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:52.869033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:52.869037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:52.869169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:52.922159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256364453238601:10880]
2025-10-01T14:13:52.922498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2085, pipe: [1:7556256364453238601:10880]
2025-10-01T14:13:53.015355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:53.025179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.025204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.025414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.025492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.025565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.025640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.026066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.026074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.026162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.026232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.026303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.026471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.029869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:53.029895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256364453238601:10880]
2025-10-01T14:13:53.029921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:53.029923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:53.029950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2086 reason: error at write: Disconnected sessionId: src_id|286a287c-2f140917-f830632f-dc625b6c_0
2025-10-01T14:13:53.030154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2086 sessionId: src_id|286a287c-2f140917-f830632f-dc625b6c_0 is DEAD
2025-10-01T14:13:53.026521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.026529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.026595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.026653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.026712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.026831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.026874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.026877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.026945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.027007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.027068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.027127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.027251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.027254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.027318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.027377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.027438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.027494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.027532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.027535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.027625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.027699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.027786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.027863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.027915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.027918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.028011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.028090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.028170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.028251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.028321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.028325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.028409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.028474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.028542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.028624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.028673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.028676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.028761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.028830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.028899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.028971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.029121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.029124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.029206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.029279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.029350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.029421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.029539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.029542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.029619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256364453238601:10880], now have 1 active actors on pipe
2025-10-01T14:13:53.030708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:53.034615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a287c-2f140917-f830632f-dc625b6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:53.034628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a287c-2f140917-f830632f-dc625b6c_0] Write session will restart in 0.007218s
2025-10-01T14:13:53.034680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a287c-2f140917-f830632f-dc625b6c_0] Write session: Do CDS request
2025-10-01T14:13:53.034687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a287c-2f140917-f830632f-dc625b6c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:53.046555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|286a287c-2f140917-f830632f-dc625b6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:53.046895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:53.046912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2087
2025-10-01T14:13:53.047052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:53.047085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:53.047090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:53.047094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:53.047476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2087 sessionId:  describe result for acl check
2025-10-01T14:13:53.047503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:53.047505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:53.047506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:53.047512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256368748205952:11430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:53.048019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256368748205952:11430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:53.067760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:53.068464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:53.068661Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:53.068665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:53.068677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:53.068724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:53.068761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256366371305340:11112]
2025-10-01T14:13:53.069578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:53.069957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:53.069997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:53.070274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:53.070321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.070322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.070323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.070324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.070326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.070327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.070328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.070329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.070330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.070331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.070332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.070333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.070334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.070335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.070340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.070349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.070353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.070356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.070359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.070363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.070366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.070388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.070392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.070395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.070398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.070401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.070405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.070408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.070415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.070422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.070431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.070436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.070441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.070446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.070450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.070455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.070458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.070463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.070467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.070471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.070475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.070479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.070483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.070486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.070490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.070494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.070498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.070503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.070507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.070514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.070517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.070521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.070524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.070529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.070533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.070538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.070570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:53.076755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256368748205952:11430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:53.076489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:53.077285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:53.077290Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:53.077292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:53.077295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:53.077302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2086 [2:7556256366371305340:11112]
2025-10-01T14:13:53.077317Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:53.077334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:53.077337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:53.077340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:53.077342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:53.077358Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:53.077363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:53.077369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:53.077425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.077427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.077429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.077432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:53.077434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:53.077511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:53.077514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.077525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.077536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.077552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:53.077570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256366371305335:11112]
2025-10-01T14:13:53.077573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256366371305335:11112]
2025-10-01T14:13:53.077575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256366371305335:11112]
2025-10-01T14:13:53.077589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:53.077604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:53.077620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:53.077623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:53.077654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256366371305335:11112]
2025-10-01T14:13:53.077656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:53.077926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:53.077934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:53.077937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:53.077943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:53.078309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2086
2025-10-01T14:13:53.078404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748205902:2446], now have 1 active actors on pipe
2025-10-01T14:13:53.087605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206077:11430], now have 1 active actors on pipe
2025-10-01T14:13:53.087640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.087648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.087677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:53.087691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:53.087697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:53.087701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:53.087713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:53.087730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:53.087751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:53.086871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256368748205952:11430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:53.086891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256368748205952:11430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:53.086895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256368748205952:11430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:53.086904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:53.087439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2086
2025-10-01T14:13:53.092966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.092987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.093027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:53.094564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2087 partition: 0 MaxSeqNo: 45 sessionId: src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0
2025-10-01T14:13:53.098686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|286a287c-2f140917-f830632f-dc625b6c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:53.101868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0] Write session: try to update token
2025-10-01T14:13:53.101889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:53.113374Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:53.113398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:53.113401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:53.113404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:53.113418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256366371305335:11112]
2025-10-01T14:13:53.113423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256366371305335:11112]
2025-10-01T14:13:53.113428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256366371305335:11112]
2025-10-01T14:13:53.113484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:53.113492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.113495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:53.113649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:53.114733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:53.114746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:53.114751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:53.124483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2087 sessionId: src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:53.127233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:53.130584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256368748206080:10880]
2025-10-01T14:13:53.131150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2086, pipe: [1:7556256368748206080:10880]
2025-10-01T14:13:53.304178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256368748206080:10880]
2025-10-01T14:13:53.304202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:53.304232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:53.304237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:53.304285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2087 reason: error at write: Disconnected sessionId: src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0
2025-10-01T14:13:53.304500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2087 sessionId: src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0 is DEAD
2025-10-01T14:13:53.304983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:53.304992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0] Write session will restart in 0.008906s
2025-10-01T14:13:53.305018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0] Write session: Do CDS request
2025-10-01T14:13:53.305025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:53.303035Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:53.303367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.303377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.303403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206080:10880], now have 1 active actors on pipe
2025-10-01T14:13:53.306201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:53.315277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:53.318751Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:53.318767Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2088
2025-10-01T14:13:53.319109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:53.319143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:53.319148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:53.319152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:53.320339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2088 sessionId:  describe result for acl check
2025-10-01T14:13:53.320375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:53.320377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:53.320379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:53.320384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256368748206118:11434] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:53.320893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256368748206118:11434] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:53.330107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256368748206118:11434] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:53.345236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256368748206118:11434] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:53.345252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256368748206118:11434] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:53.345256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256368748206118:11434] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:53.345265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:53.344262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:53.346265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:53.346604Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:53.346615Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:53.346628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:53.346688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:53.346725Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256366371305513:11115]
2025-10-01T14:13:53.347382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:53.350480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:53.350547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:53.350921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:53.350972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.350973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.350975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.350976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.350978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.350979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.350981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.350982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.350984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.350985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.350986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.350988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.350990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.350991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.350998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.351008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.351013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.351017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.351021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.351025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.351029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.351033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.351036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.351040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.351044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.351047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.351051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.351055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.351063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.351071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.351077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.351083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.351087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.351093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.351098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.351104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.351109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.351114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.351121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.351126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.351131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.351137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.351141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.351147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.351153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.351159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.351163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.351168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.351173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.351178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.351182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.351187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.351192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.351197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.351201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.351206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.351246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:53.358595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:53.359549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:53.359554Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:53.359557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:53.359561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:53.359569Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2087 [2:7556256366371305513:11115]
2025-10-01T14:13:53.359585Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:53.359601Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:53.359605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:53.359609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:53.359612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:53.359630Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:53.359636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:53.359643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:53.359697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.359699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.359701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.359704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:53.359706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:53.359779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:53.359781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.359793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.359804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.359819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:53.359836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256366371305508:11115]
2025-10-01T14:13:53.359838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256366371305508:11115]
2025-10-01T14:13:53.359840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256366371305508:11115]
2025-10-01T14:13:53.359851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:53.359864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:53.359877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:53.359880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:53.359918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256366371305508:11115]
2025-10-01T14:13:53.359920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:53.360230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:53.360235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:53.360238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:53.360243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:53.361083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206083:2446], now have 1 active actors on pipe
2025-10-01T14:13:53.361091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206251:11434], now have 1 active actors on pipe
2025-10-01T14:13:53.361378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.361386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.361420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:53.361428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:53.361434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:53.361436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:53.361446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:53.361458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:53.361475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:53.361759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.361764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.361777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:53.361178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2087
2025-10-01T14:13:53.361213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2087
2025-10-01T14:13:53.361896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2088 partition: 0 MaxSeqNo: 45 sessionId: src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0
2025-10-01T14:13:53.362592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5b4dcb5-402da965-483b1fd7-f3c429f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:53.365974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0] Write session: try to update token
2025-10-01T14:13:53.365994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:53.394111Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:53.394128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:53.394131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:53.394133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:53.394143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256366371305508:11115]
2025-10-01T14:13:53.394147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256366371305508:11115]
2025-10-01T14:13:53.394151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256366371305508:11115]
2025-10-01T14:13:53.394199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:53.394207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.394209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:53.394350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:53.398617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:53.398639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:53.398645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:53.402438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256368748206263:10880]
2025-10-01T14:13:53.403480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2087, pipe: [1:7556256368748206263:10880]
2025-10-01T14:13:53.407504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2088 sessionId: src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:53.410201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:53.584584Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:53.585074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206263:10880], now have 1 active actors on pipe
2025-10-01T14:13:53.585105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.585113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.585953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256368748206263:10880]
2025-10-01T14:13:53.586025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:53.586055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:53.586058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:53.586109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2088 reason: error at write: Disconnected sessionId: src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0
2025-10-01T14:13:53.586322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2088 sessionId: src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0 is DEAD
2025-10-01T14:13:53.586700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:53.586709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0] Write session will restart in 0.008987s
2025-10-01T14:13:53.586737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0] Write session: Do CDS request
2025-10-01T14:13:53.586747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:53.587885Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:53.597319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:53.597672Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:53.597690Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2089
2025-10-01T14:13:53.597858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:53.597894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:53.597899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:53.597904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:53.598650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2089 sessionId:  describe result for acl check
2025-10-01T14:13:53.598685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:53.598687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:53.598688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:53.598693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256368748206287:11441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:53.599204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256368748206287:11441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:53.614574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256368748206287:11441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:53.628686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256368748206287:11441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:53.628703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256368748206287:11441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:53.628707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256368748206287:11441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:53.628717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:53.630409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:53.633424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:53.633663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:53.633667Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:53.633680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:53.633723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:53.633762Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256366371305699:11118]
2025-10-01T14:13:53.634409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:53.634890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:53.634936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:53.635356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:53.635407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.635408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.635410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.635411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.635412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.635413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.635415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.635416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.635418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.635419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.635420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.635422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.635423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.635424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.635429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.635439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.635444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.635448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.635451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.635455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.635458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.635462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.635465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.635469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.635473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.635476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.635480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.635484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.635491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.635498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.635505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.635510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.635515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.635521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.635524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.635529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.635534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.635549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.635553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.635557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.635563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.635567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.635571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.635576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.635580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.635586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.635590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.635595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.635599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.635604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.635609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.635614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.635621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.635626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.635630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.635635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.635671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:53.640359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:53.641332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:53.641337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:53.641340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:53.641344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:53.641351Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2088 [2:7556256366371305699:11118]
2025-10-01T14:13:53.641368Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:53.641387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:53.641390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:53.641393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:53.641396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:53.641414Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:53.641420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:53.641427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:53.641491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.641493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.641495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.641498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:53.641502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:53.641572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:53.641575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.641587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.641599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.641615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:53.641632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256366371305693:11118]
2025-10-01T14:13:53.641635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256366371305693:11118]
2025-10-01T14:13:53.641637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256366371305693:11118]
2025-10-01T14:13:53.641650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:53.641663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:53.641678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:53.641680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:53.641717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256366371305693:11118]
2025-10-01T14:13:53.641719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:53.641803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:53.641806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:53.641808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:53.641813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:53.642752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2088
2025-10-01T14:13:53.642784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2088
2025-10-01T14:13:53.646059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206454:11441], now have 1 active actors on pipe
2025-10-01T14:13:53.646076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206274:2446], now have 1 active actors on pipe
2025-10-01T14:13:53.646106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.646114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.646151Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43215026-646014a8-5c55cb4d-a91b0c82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:53.646162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:53.646168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:53.646171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:53.646184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:53.646200Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:53.646226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:53.646613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.646619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.646632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:53.646765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2089 partition: 0 MaxSeqNo: 45 sessionId: src_id|43215026-646014a8-5c55cb4d-a91b0c82_0
2025-10-01T14:13:53.647204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8971df74-cec4d648-a3f9d86e-3ce6549a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|43215026-646014a8-5c55cb4d-a91b0c82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:53.650111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43215026-646014a8-5c55cb4d-a91b0c82_0] Write session: try to update token
2025-10-01T14:13:53.650130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43215026-646014a8-5c55cb4d-a91b0c82_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:53.685902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256368748206478:10880]
2025-10-01T14:13:53.686438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206478:10880], now have 1 active actors on pipe
2025-10-01T14:13:53.686572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2088, pipe: [1:7556256368748206478:10880]
2025-10-01T14:13:53.695867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2089 sessionId: src_id|43215026-646014a8-5c55cb4d-a91b0c82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:53.698673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:53.699156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.699175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.699215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:53.702646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:53.711207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:53.711227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:53.711229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:53.711231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:53.711242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256366371305693:11118]
2025-10-01T14:13:53.711247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256366371305693:11118]
2025-10-01T14:13:53.711255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256366371305693:11118]
2025-10-01T14:13:53.711308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:53.711316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.711318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:53.711492Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:53.714608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:53.714622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:53.714626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:53.903490Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:53.912651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:53.912677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:53.912835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.912892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.912953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.913011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.913057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.913063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.913176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.913237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.913299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.913685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.913726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.913728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.913794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.913890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.913949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.914008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.914048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.914051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.914112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.914171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.914230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.914290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.914327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.914330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.914548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.914606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.914660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.914715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.914755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.914757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.914860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.914963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.915033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.915103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.915166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.915169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.915249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.915320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.915407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.915487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.915538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.915544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.915625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.915697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.915788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.915860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.915909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.915911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.915996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.916064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.916131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.916205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.916276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.916280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.916360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:53.916431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:53.916500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:53.916573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:53.916633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:53.916636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:53.917537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:53.918436Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:53.918493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256368748206478:10880]
2025-10-01T14:13:53.918519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:53.918557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2089 reason: status is not ok: tablet will be restarted right now sessionId: src_id|43215026-646014a8-5c55cb4d-a91b0c82_0
2025-10-01T14:13:53.918743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2089 sessionId: src_id|43215026-646014a8-5c55cb4d-a91b0c82_0 is DEAD
2025-10-01T14:13:53.920801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43215026-646014a8-5c55cb4d-a91b0c82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:53.920809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43215026-646014a8-5c55cb4d-a91b0c82_0] Write session will restart in 0.009417s
2025-10-01T14:13:53.920835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43215026-646014a8-5c55cb4d-a91b0c82_0] Write session: Do CDS request
2025-10-01T14:13:53.920844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43215026-646014a8-5c55cb4d-a91b0c82_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:53.933067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43215026-646014a8-5c55cb4d-a91b0c82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:53.933505Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:53.933521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2090
2025-10-01T14:13:53.938501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:53.938554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:53.938559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:53.938564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:53.939152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2090 sessionId:  describe result for acl check
2025-10-01T14:13:53.939269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:53.939272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:53.939274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:53.939279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256368748206510:11452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:53.939810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256368748206510:11452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:53.959309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256368748206510:11452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:53.968789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256368748206510:11452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:53.968807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256368748206510:11452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:53.968810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256368748206510:11452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:53.968818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:53.983669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:53.987299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:53.987528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:53.987532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:53.987543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:53.987590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:53.987627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256366371305903:11129]
2025-10-01T14:13:53.988445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:53.989053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:53.989105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:53.989444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:53.989504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.989506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.989507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.989508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.989510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.989511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.989512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.989514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.989515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.989516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.989517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.989519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.989520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.989521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.989527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.989538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.989542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.989546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.989550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.989553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.989556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.989560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.989563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.989567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.989570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.989574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.989577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.989581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.989607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.989616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:53.989622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.989627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:53.989632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.989637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:53.989641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.989646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:53.989650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.989655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:53.989659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.989664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:53.989669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.989674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:53.989678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.989692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:53.989699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.989704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:53.989708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.989713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.989718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.989722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.989727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.989732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.989737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.989742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:53.989746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.989751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:53.989791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:53.995044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:53.995895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:53.995900Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:53.995903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:53.995907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:53.995914Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2089 [2:7556256366371305903:11129]
2025-10-01T14:13:53.995932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:53.995949Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:53.995953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:53.995957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:53.995959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:53.995978Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:53.995983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:53.995990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:53.996048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.996051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.996053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.996057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:53.996059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:53.996135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:53.996138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:53.996150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:53.996162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:53.996177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:53.996196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256366371305895:11129]
2025-10-01T14:13:53.996198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256366371305895:11129]
2025-10-01T14:13:53.996200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256366371305895:11129]
2025-10-01T14:13:53.996220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:53.996234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:53.996251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:53.996255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:53.996283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:53.996287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:53.996289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256366371305895:11129]
2025-10-01T14:13:53.996289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:53.996292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:53.996297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:53.996633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2089
2025-10-01T14:13:53.996662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2089
2025-10-01T14:13:54.000385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206614:11452], now have 1 active actors on pipe
2025-10-01T14:13:54.000401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256368748206497:2446], now have 1 active actors on pipe
2025-10-01T14:13:54.000427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.000444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.000474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:54.000485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:54.000490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:54.000493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:54.000504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:54.000519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:54.000537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:54.001089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.001095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.001109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:54.001234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2090 partition: 0 MaxSeqNo: 45 sessionId: src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0
2025-10-01T14:13:54.001707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43215026-646014a8-5c55cb4d-a91b0c82_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:54.004752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0] Write session: try to update token
2025-10-01T14:13:54.004773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:54.021336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256373043173981:10880]
2025-10-01T14:13:54.022816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256373043173981:10880], now have 1 active actors on pipe
2025-10-01T14:13:54.022943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2089, pipe: [1:7556256373043173981:10880]
2025-10-01T14:13:54.032890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2090 sessionId: src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:54.035599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:54.036198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.036218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.038604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:54.038635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:54.038638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:54.038641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:54.038642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:54.038653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256366371305895:11129]
2025-10-01T14:13:54.038658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256366371305895:11129]
2025-10-01T14:13:54.038662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256366371305895:11129]
2025-10-01T14:13:54.038708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:54.038715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.038717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:54.038855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:54.042068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:54.042080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:54.042084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:54.042282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:54.207234Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:54.216918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.216959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.217179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.217247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.217314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.217372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.217416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.217423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.217498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.217555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.217614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.217683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.217729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.217734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.217798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.217857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.217923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.217987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.218029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.218036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.218099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.218157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.218214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.218273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.218318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.218321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.218413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.218470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.218527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.218595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.218640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.218643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.218734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.218841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.218922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.218994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.219046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.219058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.219136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.219210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.219307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.219390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.219443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.219447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.219530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.219600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.219672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.219746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.219862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.219865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.219945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.220015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.220087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.220160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.220208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.220211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.220294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.220359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.220430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.220502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.220552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.220555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.221929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:54.222850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:54.222917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2090 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0
2025-10-01T14:13:54.223147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2090 sessionId: src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0 is DEAD
2025-10-01T14:13:54.223295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256373043173981:10880]
2025-10-01T14:13:54.223312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:54.226503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:54.226520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0] Write session will restart in 0.008252s
2025-10-01T14:13:54.226554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0] Write session: Do CDS request
2025-10-01T14:13:54.226564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:54.243870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:54.244193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:54.244209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2091
2025-10-01T14:13:54.244443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:54.244479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:54.244485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:54.244488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:54.245012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2091 sessionId:  describe result for acl check
2025-10-01T14:13:54.245049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:54.245050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:54.245052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:54.245058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256373043174002:11456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:54.245604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256373043174002:11456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:54.260385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256373043174002:11456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:54.267286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256373043174002:11456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:54.267305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256373043174002:11456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:54.267309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256373043174002:11456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:54.267317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:54.275880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:54.276247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:54.276438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:54.276443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:54.276456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:54.276496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:54.276533Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256370666273387:11136]
2025-10-01T14:13:54.277149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:54.277708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:54.277751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:54.278059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:54.278109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.278111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.278112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.278113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.278114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.278115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.278116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.278117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.278118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.278120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.278121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.278123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.278124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.278125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.278132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.278142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.278146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.278149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.278153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.278157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.278160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.278164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.278167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.278171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.278175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.278178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.278181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.278185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.278194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.278202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.278208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.278213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.278218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.278223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.278227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.278232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.278236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.278242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.278245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.278250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.278256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.278261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.278265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.278269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.278274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.278279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.278282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.278287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.278291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.278296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.278299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.278304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.278310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.278314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.278318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.278322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.278387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:54.283591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:54.284299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:54.284303Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:54.284306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:54.284310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:54.284319Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2090 [2:7556256370666273387:11136]
2025-10-01T14:13:54.284337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:54.284359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:54.284362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:54.284368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:54.284371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:54.284390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:54.284396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:54.284404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:54.284474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.284476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.284478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.284482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:54.284485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:54.284566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:54.284569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.284581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.284607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.284621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:54.284640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256370666273381:11136]
2025-10-01T14:13:54.284643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256370666273381:11136]
2025-10-01T14:13:54.284645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256370666273381:11136]
2025-10-01T14:13:54.284659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:54.284680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:54.284695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:54.284697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:54.284732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256370666273381:11136]
2025-10-01T14:13:54.284734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:54.285047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:54.285054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:54.285056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:54.285060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:54.285685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2090
2025-10-01T14:13:54.285713Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2090
2025-10-01T14:13:54.289476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256373043174142:11456], now have 1 active actors on pipe
2025-10-01T14:13:54.289488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256373043173986:2446], now have 1 active actors on pipe
2025-10-01T14:13:54.289513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.289521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.289559Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b584331-57d61fab-d2fbb167-63be2da7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:54.289571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:54.289578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:54.289581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:54.289596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:54.289613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:54.289636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:54.290004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.290010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.290027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:54.290157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2091 partition: 0 MaxSeqNo: 45 sessionId: src_id|7b584331-57d61fab-d2fbb167-63be2da7_0
2025-10-01T14:13:54.290765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93316d6-83b760fc-c796a3f-bff6e7a5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7b584331-57d61fab-d2fbb167-63be2da7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:54.294225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b584331-57d61fab-d2fbb167-63be2da7_0] Write session: try to update token
2025-10-01T14:13:54.294245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b584331-57d61fab-d2fbb167-63be2da7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:54.324777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:54.324795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:54.324798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:54.324801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:54.324812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256370666273381:11136]
2025-10-01T14:13:54.324816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256370666273381:11136]
2025-10-01T14:13:54.324822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256370666273381:11136]
2025-10-01T14:13:54.324875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:54.324883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.324886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:54.325074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:54.326502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256373043174169:10880]
2025-10-01T14:13:54.327345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:54.327359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:54.327363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:54.327715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2090, pipe: [1:7556256373043174169:10880]
2025-10-01T14:13:54.330536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2091 sessionId: src_id|7b584331-57d61fab-d2fbb167-63be2da7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:54.333246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:54.560845Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:54.561219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256373043174169:10880], now have 1 active actors on pipe
2025-10-01T14:13:54.561244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.561251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.561461Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:54.564445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256373043174169:10880]
2025-10-01T14:13:54.565049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b584331-57d61fab-d2fbb167-63be2da7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:54.564487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:54.564566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2091 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b584331-57d61fab-d2fbb167-63be2da7_0
2025-10-01T14:13:54.565063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b584331-57d61fab-d2fbb167-63be2da7_0] Write session will restart in 0.005029s
2025-10-01T14:13:54.564791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2091 sessionId: src_id|7b584331-57d61fab-d2fbb167-63be2da7_0 is DEAD
2025-10-01T14:13:54.564934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:54.565090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b584331-57d61fab-d2fbb167-63be2da7_0] Write session: Do CDS request
2025-10-01T14:13:54.565098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b584331-57d61fab-d2fbb167-63be2da7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:54.571202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b584331-57d61fab-d2fbb167-63be2da7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:54.574628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:54.574644Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2092
2025-10-01T14:13:54.575200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:54.575237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:54.575243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:54.575247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:54.577715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2092 sessionId:  describe result for acl check
2025-10-01T14:13:54.577754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:54.577756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:54.577761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:54.577766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256373043174190:11461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:54.578266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256373043174190:11461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:54.586835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256373043174190:11461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:54.595977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256373043174190:11461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:54.595995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256373043174190:11461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:54.595998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256373043174190:11461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:54.596007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:54.606472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:54.609709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:54.609945Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:54.609949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:54.609960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:54.610005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:54.610042Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256370666273576:11139]
2025-10-01T14:13:54.610919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:54.613110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:54.613168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:54.613563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:54.613618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.613619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.613621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.613622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.613624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.613625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.613627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.613628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.613629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.613630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.613632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.613633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.613635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.613636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.613643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.613653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.613658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.613662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.613666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.613671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.613675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.613678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.613682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.613687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.613690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.613694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.613698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.613702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.613709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.613718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.613724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.613730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.613735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.613741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.613745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.613751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.613757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.613762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.613769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.613775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.613780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.613785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.613790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.613795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.613800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.613804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.613808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.613813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.613818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.613823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.613828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.613833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.613850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.613856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.613860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.613866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.613912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:54.625180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:54.625859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:54.625865Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:54.625868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:54.625872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:54.625880Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2091 [2:7556256370666273576:11139]
2025-10-01T14:13:54.625898Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:54.625918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:54.625922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:54.625926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:54.625929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:54.625946Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:54.625952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:54.625959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:54.626022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.626025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.626027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.626031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:54.626033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:54.626108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:54.626111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.626124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.626136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.626153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:54.626170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256370666273570:11139]
2025-10-01T14:13:54.626173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256370666273570:11139]
2025-10-01T14:13:54.626177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256370666273570:11139]
2025-10-01T14:13:54.626190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:54.626204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:54.626219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:54.626222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:54.626263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256370666273570:11139]
2025-10-01T14:13:54.626266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:54.626395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:54.626397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:54.626400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:54.626404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:54.629327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256373043174184:2446], now have 1 active actors on pipe
2025-10-01T14:13:54.629340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256373043174274:11461], now have 1 active actors on pipe
2025-10-01T14:13:54.630969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2091
2025-10-01T14:13:54.631008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2091
2025-10-01T14:13:54.632677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.632697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.632734Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:54.632747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:54.632753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:54.632757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:54.632770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:54.632785Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:54.632811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:54.634059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.634070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.634091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:54.634263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2092 partition: 0 MaxSeqNo: 45 sessionId: src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0
2025-10-01T14:13:54.635299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b584331-57d61fab-d2fbb167-63be2da7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:54.638265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0] Write session: try to update token
2025-10-01T14:13:54.638280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:54.665176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.665196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.665232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:54.662180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2092 sessionId: src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:54.664710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:54.665550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:54.668155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:54.668174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:54.668176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:54.668178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:54.668189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256370666273570:11139]
2025-10-01T14:13:54.668193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256370666273570:11139]
2025-10-01T14:13:54.668198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256370666273570:11139]
2025-10-01T14:13:54.668244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:54.668251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.668253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:54.668399Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:54.670806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:54.670815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:54.670820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:54.670949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256373043174371:10880]
2025-10-01T14:13:54.671938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2091, pipe: [1:7556256373043174371:10880]
2025-10-01T14:13:54.892783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:54.893388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256373043174371:10880], now have 1 active actors on pipe
2025-10-01T14:13:54.902533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.902560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.902733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.902792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.902856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.902951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.902997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.903003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.903074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.903136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.903196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.903261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.903912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.903920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.903983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.904037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.904095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.904153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.904193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.904200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.904263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.904322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.904381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.904442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.904482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.904485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.904551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.904622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.904678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.904735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.904774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.904777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.904863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.904932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.905007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.905082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.905132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.905135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.905213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.905283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.905359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.905454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.905503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.905505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.905590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.905663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.905734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.905804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.905851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.905854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.905940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.906010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.906082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.906154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.906203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.906206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.906284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:54.906348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:54.907229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:54.907244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:54.907273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2092 reason: error at write: Disconnected sessionId: src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0
2025-10-01T14:13:54.907449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2092 sessionId: src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0 is DEAD
2025-10-01T14:13:54.907503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256373043174371:10880]
2025-10-01T14:13:54.907527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:54.907770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:54.907779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0] Write session will restart in 0.005170s
2025-10-01T14:13:54.907803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0] Write session: Do CDS request
2025-10-01T14:13:54.907810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:54.906683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:54.906767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:54.906816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:54.906819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:54.907664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:54.914814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:54.915129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:54.915145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2093
2025-10-01T14:13:54.915274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:54.915303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:54.915308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:54.915312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:54.915746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2093 sessionId:  describe result for acl check
2025-10-01T14:13:54.915783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:54.915784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:54.915786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:54.915791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256373043174419:11473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:54.916201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256373043174419:11473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:54.918855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256373043174419:11473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:54.933240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256373043174419:11473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:54.933261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256373043174419:11473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:54.933265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256373043174419:11473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:54.933274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:54.939508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:54.942206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:54.942440Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:54.942445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:54.942457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:54.942505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:54.942544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256370666273763:11144]
2025-10-01T14:13:54.943128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:54.943565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:54.943603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:54.943892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:54.943943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.943944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.943946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.943947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.943948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.943949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.943950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.943951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.943952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.943953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.943954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.943955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.943956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.943958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.943963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.943972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.943976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.943979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.943982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.943985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.943988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.943991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.943995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.943998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.944001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.944005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.944008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.944010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.944016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.944023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:54.944028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.944032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:54.944036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.944040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:54.944043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.944048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:54.944051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.944056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:54.944060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.944064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:54.944068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.944072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:54.944076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.944080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:54.944084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.944089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:54.944092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.944097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.944102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.944106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.944110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.944115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.944118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.944122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:54.944126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.944130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:54.944163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:54.952784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:54.953484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:54.953498Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:54.953501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:54.953505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:54.953513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2092 [2:7556256370666273763:11144]
2025-10-01T14:13:54.953530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:54.953550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:54.953554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:54.953557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:54.953560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:54.953578Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:54.953584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:54.953591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:54.953655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.953657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.953659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.953662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:54.953665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:54.953841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:54.953844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.953855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:54.953865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:54.953881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:54.953899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256370666273757:11144]
2025-10-01T14:13:54.953901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256370666273757:11144]
2025-10-01T14:13:54.953903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256370666273757:11144]
2025-10-01T14:13:54.953916Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:54.953933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:54.953946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:54.953949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:54.953990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256370666273757:11144]
2025-10-01T14:13:54.953992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:54.954141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:54.954144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:54.954148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:54.954152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:54.954614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2092
2025-10-01T14:13:54.954651Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2092
2025-10-01T14:13:54.959118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256373043174538:11473], now have 1 active actors on pipe
2025-10-01T14:13:54.959142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256373043174406:2446], now have 1 active actors on pipe
2025-10-01T14:13:54.959171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.959179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.959217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:54.959227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:54.959233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:54.959236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:54.959250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:54.959269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:54.959290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:54.966277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2093 partition: 0 MaxSeqNo: 45 sessionId: src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0
2025-10-01T14:13:54.965958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:54.965981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:54.966025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:54.970757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a90725-eaa79bb2-2fb1a11c-30ef568f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:54.973820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0] Write session: try to update token
2025-10-01T14:13:54.973841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:54.986810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:54.986829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:54.986831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:54.986833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:54.986843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256370666273757:11144]
2025-10-01T14:13:54.986848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256370666273757:11144]
2025-10-01T14:13:54.986852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256370666273757:11144]
2025-10-01T14:13:54.986900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:54.986908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:54.986910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:54.987059Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:54.987363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:54.987372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:54.987375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:54.997777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2093 sessionId: src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:55.000453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:55.010696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256377338141886:10880]
2025-10-01T14:13:55.011135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2092, pipe: [1:7556256377338141886:10880]
2025-10-01T14:13:55.158179Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:55.158780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.158791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.158840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338141886:10880], now have 1 active actors on pipe
2025-10-01T14:13:55.159118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:55.166678Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:55.166749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256377338141886:10880]
2025-10-01T14:13:55.166752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:55.166837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2093 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0
2025-10-01T14:13:55.167030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2093 sessionId: src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0 is DEAD
2025-10-01T14:13:55.170726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:55.170741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0] Write session will restart in 0.005028s
2025-10-01T14:13:55.170768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0] Write session: Do CDS request
2025-10-01T14:13:55.170774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:55.178934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:55.179294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:55.179314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2094
2025-10-01T14:13:55.179491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:55.179523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:55.179531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:55.179535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:55.180127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2094 sessionId:  describe result for acl check
2025-10-01T14:13:55.180155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:55.180157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:55.180159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:55.180166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256377338141903:11478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:55.180730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256377338141903:11478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:55.188258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256377338141903:11478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:55.192286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256377338141903:11478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:55.192306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256377338141903:11478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:55.192309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256377338141903:11478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:55.192319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:55.224245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:55.225937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:55.226171Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:55.226195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:55.226208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:55.226258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:55.226301Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256374961241268:11157]
2025-10-01T14:13:55.227004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:55.229396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:55.229459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:55.229839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:55.229894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.229901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.229903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.229904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.229905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.229907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.229908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.229909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.229911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.229912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.229914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.229915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.229916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.229917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.229924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.229935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.229939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.229943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.229947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.229951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.229955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.229959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.229963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.229969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.229975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.229979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.229988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.229992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.230005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.230019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.230030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.230040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.230049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.230054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.230060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.230065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.230076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.230086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.230095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.230101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.230112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.230122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.230130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.230140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.230150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.230160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.230168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.230174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.230183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.230192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.230202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.230208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.230218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.230223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.230230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.230235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.230283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:55.235084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:55.236010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:55.236017Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:55.236020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:55.236024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:55.236032Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2093 [2:7556256374961241268:11157]
2025-10-01T14:13:55.236050Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:55.236069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:55.236073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:55.236077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:55.236080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:55.236098Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:55.236104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:55.236111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:55.236181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.236183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.236185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.236188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:55.236191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:55.236283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:55.236287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.236299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.236309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.236322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:55.236340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256374961241262:11157]
2025-10-01T14:13:55.236343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256374961241262:11157]
2025-10-01T14:13:55.236345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256374961241262:11157]
2025-10-01T14:13:55.236362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:55.236377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:55.236390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:55.236394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:55.236434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256374961241262:11157]
2025-10-01T14:13:55.236437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:55.236958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:55.236964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:55.236967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:55.236973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:55.237239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338141897:2446], now have 1 active actors on pipe
2025-10-01T14:13:55.237247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338141942:11478], now have 1 active actors on pipe
2025-10-01T14:13:55.237453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2093
2025-10-01T14:13:55.237496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2093
2025-10-01T14:13:55.238295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.238311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.238342Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:55.238352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:55.238357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:55.238360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:55.238389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:55.238403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:55.238423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:55.238806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2094 partition: 0 MaxSeqNo: 45 sessionId: src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0
2025-10-01T14:13:55.238664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.238672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.238687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:55.242674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6f4d56d5-cfa52245-5132768e-a8b1a256_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:55.245780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0] Write session: try to update token
2025-10-01T14:13:55.245802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:55.264660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:55.264681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:55.264684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:55.264685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:55.264696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256374961241262:11157]
2025-10-01T14:13:55.264706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256374961241262:11157]
2025-10-01T14:13:55.264710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256374961241262:11157]
2025-10-01T14:13:55.264763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:55.264770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.264772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:55.264928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:55.266605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:55.266619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:55.266623Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:55.270463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256377338142080:10880]
2025-10-01T14:13:55.273796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2093, pipe: [1:7556256377338142080:10880]
2025-10-01T14:13:55.283754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2094 sessionId: src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:55.286401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:55.479065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:55.479382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338142080:10880], now have 1 active actors on pipe
2025-10-01T14:13:55.479413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.479420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.479914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:55.482794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256377338142080:10880]
2025-10-01T14:13:55.482831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:55.482870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:55.482950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2094 reason: status is not ok: tablet will be restarted right now sessionId: src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0
2025-10-01T14:13:55.483156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2094 sessionId: src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0 is DEAD
2025-10-01T14:13:55.486686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:55.486699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0] Write session will restart in 0.008007s
2025-10-01T14:13:55.486729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0] Write session: Do CDS request
2025-10-01T14:13:55.486736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:55.498700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:55.498984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:55.499006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2095
2025-10-01T14:13:55.499127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:55.499152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:55.499157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:55.499161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:55.501305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2095 sessionId:  describe result for acl check
2025-10-01T14:13:55.501334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:55.501335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:55.501337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:55.501342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256377338142095:11482] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:55.501861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256377338142095:11482] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:55.509204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256377338142095:11482] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:55.512453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256377338142095:11482] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:55.512469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256377338142095:11482] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:55.512473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256377338142095:11482] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:55.512481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:55.532512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:55.536515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:55.536765Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:55.536769Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:55.536780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:55.536824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:55.536862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256374961241460:11160]
2025-10-01T14:13:55.537520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:55.537946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:55.537983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:55.538285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:55.538333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.538334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.538336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.538337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.538338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.538339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.538341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.538342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.538343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.538344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.538345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.538346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.538347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.538349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.538354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.538364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.538368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.538388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.538392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.538395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.538399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.538403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.538406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.538410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.538413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.538417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.538420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.538424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.538430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.538438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.538444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.538450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.538454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.538460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.538464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.538469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.538474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.538479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.538483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.538488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.538493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.538497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.538501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.538506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.538511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.538516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.538520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.538525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.538530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.538535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.538540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.538544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.538549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.538553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.538558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.538564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.538604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:55.543852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:55.544944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:55.544950Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:55.544952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:55.544957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:55.544964Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2094 [2:7556256374961241460:11160]
2025-10-01T14:13:55.544985Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:55.545004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:55.545009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:55.545013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:55.545015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:55.545033Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:55.545039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:55.545046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:55.545109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.545111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.545112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.545116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:55.545119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:55.545194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:55.545197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.545209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.545220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.545236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:55.545254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256374961241454:11160]
2025-10-01T14:13:55.545257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256374961241454:11160]
2025-10-01T14:13:55.545259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256374961241454:11160]
2025-10-01T14:13:55.545273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:55.545288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:55.545303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:55.545306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:55.545345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256374961241454:11160]
2025-10-01T14:13:55.545347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:55.546443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2094
2025-10-01T14:13:55.546485Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2094
2025-10-01T14:13:55.545591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:55.545597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:55.545600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:55.545604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:55.548977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338142137:11482], now have 1 active actors on pipe
2025-10-01T14:13:55.548997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338142083:2446], now have 1 active actors on pipe
2025-10-01T14:13:55.549028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.549038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.549083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:55.549094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:55.549101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:55.549104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:55.549118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:55.549137Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:55.549175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:55.550194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.550206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.550232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:55.550362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2095 partition: 0 MaxSeqNo: 45 sessionId: src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0
2025-10-01T14:13:55.550819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|df4a7afb-870fa169-755ff0c4-373f2cf2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:55.553790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0] Write session: try to update token
2025-10-01T14:13:55.553809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:55.586389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256377338142276:10880]
2025-10-01T14:13:55.586426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2095 sessionId: src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:55.587090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2094, pipe: [1:7556256377338142276:10880]
2025-10-01T14:13:55.588881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:55.587193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338142276:10880], now have 1 active actors on pipe
2025-10-01T14:13:55.589468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.589490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.589532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:55.589698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:55.595942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:55.595962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:55.595964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:55.595966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:55.595981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256374961241454:11160]
2025-10-01T14:13:55.595986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256374961241454:11160]
2025-10-01T14:13:55.595990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256374961241454:11160]
2025-10-01T14:13:55.596041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:55.596047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.596050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:55.596212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:55.598481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:55.598497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:55.598501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:55.742931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:55.751427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.751458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.751633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.751691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.751752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.751809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.752010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.752016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.752086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.752143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.752202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.752265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.752304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.752308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.752375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.752430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.752486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.752545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.752584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.752598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.752658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.752711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.752763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.752815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.752854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.752857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.752919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.752972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.753026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.753082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.753120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.753123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.753204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.753275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.753341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.753408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.753455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.753458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.753531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.753596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.753663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.753738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.753782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.753785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.753858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.753925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.753993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.754058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.754102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.754110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.754188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.754254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.754319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.754669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.754718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.754720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.754795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:55.754855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:55.754923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:55.754989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:55.755101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:55.755103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:55.755546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:55.755598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:55.755601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:55.755628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2095 reason: error at write: Disconnected sessionId: src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0
2025-10-01T14:13:55.755814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2095 sessionId: src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0 is DEAD
2025-10-01T14:13:55.755863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256377338142276:10880]
2025-10-01T14:13:55.756166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:55.756174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0] Write session will restart in 0.005454s
2025-10-01T14:13:55.756197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0] Write session: Do CDS request
2025-10-01T14:13:55.756205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:55.756257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:55.767268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:55.767558Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:55.767575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2096
2025-10-01T14:13:55.776797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:55.772829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:55.772877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:55.772883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:55.772886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:55.773280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2096 sessionId:  describe result for acl check
2025-10-01T14:13:55.773305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:55.773307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:55.773309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:55.773313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256377338142432:11488] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:55.773787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256377338142432:11488] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:55.775795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256377338142432:11488] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:55.779975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:55.780160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:55.780164Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:55.780174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:55.780213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:55.780245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256374961241642:11163]
2025-10-01T14:13:55.780798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:55.781442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256377338142432:11488] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:55.781465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256377338142432:11488] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:55.781469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256377338142432:11488] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:55.781477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:55.781922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:55.781976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:55.782253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:55.782298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.782298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.782299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.782300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.782301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.782303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.782304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.782305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.782306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.782307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.782308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.782309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.782310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.782311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.782315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.782324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.782328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.782331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.782334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.782338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.782341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.782344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.782347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.782350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.782354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.782356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.782359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.782362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.782368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.782387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:55.782394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.782398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:55.782402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.782406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:55.782410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.782415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:55.782419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.782423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:55.782426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.782431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:55.782435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.782439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:55.782443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.782448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:55.782452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.782456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:55.782459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.782464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.782467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.782472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.782475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.782481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.782484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.782488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:55.782491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.782495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:55.782528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:55.787155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:55.787946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:55.787951Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:55.787952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:55.787956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:55.787962Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2095 [2:7556256374961241642:11163]
2025-10-01T14:13:55.787976Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:55.787991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:55.787994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:55.787997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:55.787999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:55.788014Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:55.788019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:55.788025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:55.788075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.788076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.788078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.788081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:55.788083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:55.788147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:55.788150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.788159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:55.788168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:55.788183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:55.788198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256374961241636:11163]
2025-10-01T14:13:55.788201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256374961241636:11163]
2025-10-01T14:13:55.788203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256374961241636:11163]
2025-10-01T14:13:55.788214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:55.788227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:55.788239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:55.788241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:55.788263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256374961241636:11163]
2025-10-01T14:13:55.788265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:55.788494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:55.788501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:55.788502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:55.788507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:55.788799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2095
2025-10-01T14:13:55.788806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2095
2025-10-01T14:13:55.788991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338142293:2446], now have 1 active actors on pipe
2025-10-01T14:13:55.788998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338142470:11488], now have 1 active actors on pipe
2025-10-01T14:13:55.789013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.789018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.789043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:55.789050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:55.789054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:55.789056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:55.789067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:55.789077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:55.789089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:55.789425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.789430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.789445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:55.789593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2096 partition: 0 MaxSeqNo: 45 sessionId: src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0
2025-10-01T14:13:55.790470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32aa73-20c1d851-4482b7d6-8ff2a16_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:55.793358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0] Write session: try to update token
2025-10-01T14:13:55.793374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:55.814920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2096 sessionId: src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:55.817419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:55.816723Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:55.816743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:55.816746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:55.816747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:55.816757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256374961241636:11163]
2025-10-01T14:13:55.816762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256374961241636:11163]
2025-10-01T14:13:55.816766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256374961241636:11163]
2025-10-01T14:13:55.816815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:55.816823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:55.816826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:55.816963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:55.817589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:55.817594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:55.817597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:55.855946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256377338142481:10880]
2025-10-01T14:13:55.858664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2095, pipe: [1:7556256377338142481:10880]
2025-10-01T14:13:55.989457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:55.990306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256377338142481:10880]
2025-10-01T14:13:55.990332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:55.990392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:55.990396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:55.990457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2096 reason: error at write: Disconnected sessionId: src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0
2025-10-01T14:13:55.990648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2096 sessionId: src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0 is DEAD
2025-10-01T14:13:55.989763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:55.989778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:55.989820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338142481:10880], now have 1 active actors on pipe
2025-10-01T14:13:55.990033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:55.994614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:55.994626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0] Write session will restart in 0.006899s
2025-10-01T14:13:55.994656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0] Write session: Do CDS request
2025-10-01T14:13:55.994661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:56.002925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:56.006791Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:56.006805Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2097
2025-10-01T14:13:56.007077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:56.007105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:56.007110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:56.007114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:56.007606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2097 sessionId:  describe result for acl check
2025-10-01T14:13:56.007633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:56.007635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:56.007636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:56.007641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256381633109821:11500] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:56.008101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256381633109821:11500] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:56.013124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256381633109821:11500] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:56.019043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256381633109821:11500] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:56.019061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256381633109821:11500] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:56.019064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256381633109821:11500] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:56.019072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:56.027851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:56.030321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:56.030538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:56.030548Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:56.030558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:56.030600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:56.030629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256379256209126:11167]
2025-10-01T14:13:56.031161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:56.031397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:56.031437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:56.031720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:56.031774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.031779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.031780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.031781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.031782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.031783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.031784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.031785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.031786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.031787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.031788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.031789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.031790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.031791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.031796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.031805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.031808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.031811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.031814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.031821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.031824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.031827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.031831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.031834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.031841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.031844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.031847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.031853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.031860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.031869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.031879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.031887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.031894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.031902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.031910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.031915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.031923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.031927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.031930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.031938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.031941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.031950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.031957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.031965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.031970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.031978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.031982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.031986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.031993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.031997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.032002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.032006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.032014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.032019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.032022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.032027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.032061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:56.036494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:56.037172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:56.037177Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:56.037179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:56.037183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:56.037189Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2096 [2:7556256379256209126:11167]
2025-10-01T14:13:56.037204Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:56.037220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:56.037223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:56.037226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:56.037228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:56.037240Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:56.037245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:56.037250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:56.037299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.037301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.037303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.037306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:56.037309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:56.037374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:56.037376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.037385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.037395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.037410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:56.037424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256379256209121:11167]
2025-10-01T14:13:56.037427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256379256209121:11167]
2025-10-01T14:13:56.037429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256379256209121:11167]
2025-10-01T14:13:56.037444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:56.037457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:56.037470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:56.037473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:56.037489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:56.037492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:56.037495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:56.037495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256379256209121:11167]
2025-10-01T14:13:56.037498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:56.037500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:56.037778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2096
2025-10-01T14:13:56.037820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2096
2025-10-01T14:13:56.039282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256377338142509:2446], now have 1 active actors on pipe
2025-10-01T14:13:56.039293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633109914:11500], now have 1 active actors on pipe
2025-10-01T14:13:56.039315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.039320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.039347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:56.039356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:56.039361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:56.039363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:56.039374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:56.039386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:56.039403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:56.039701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.039710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.039724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:56.040254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cda170be-9c17c1ba-90e8d77a-79a56e28_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:56.039825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2097 partition: 0 MaxSeqNo: 45 sessionId: src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0
2025-10-01T14:13:56.043176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0] Write session: try to update token
2025-10-01T14:13:56.043195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:56.060301Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2097 sessionId: src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:56.065023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.065049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.065073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:56.065077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:56.065079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:56.065081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:56.065090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256379256209121:11167]
2025-10-01T14:13:56.065095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256379256209121:11167]
2025-10-01T14:13:56.065100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256379256209121:11167]
2025-10-01T14:13:56.065161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:56.065167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.065170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:56.065306Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:56.066598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:56.066613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:56.062756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:56.066617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:56.090839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256381633109992:10880]
2025-10-01T14:13:56.094971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2096, pipe: [1:7556256381633109992:10880]
2025-10-01T14:13:56.255808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:56.256116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:56.256168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633109992:10880], now have 1 active actors on pipe
2025-10-01T14:13:56.257133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:56.257229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:56.257231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:56.257302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2097 reason: error at write: Disconnected sessionId: src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0
2025-10-01T14:13:56.257487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2097 sessionId: src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0 is DEAD
2025-10-01T14:13:56.257632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256381633109992:10880]
2025-10-01T14:13:56.257647Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:56.258641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:56.258654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0] Write session will restart in 0.009611s
2025-10-01T14:13:56.258681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0] Write session: Do CDS request
2025-10-01T14:13:56.258707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:56.270494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:56.272278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:56.272295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2098
2025-10-01T14:13:56.272515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:56.272546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:56.272553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:56.272556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:56.273025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2098 sessionId:  describe result for acl check
2025-10-01T14:13:56.273065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:56.273072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:56.273073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:56.273079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256381633110063:11504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:56.273606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256381633110063:11504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:56.275910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256381633110063:11504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:56.278885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256381633110063:11504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:56.278904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256381633110063:11504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:56.278907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256381633110063:11504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:56.278915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:56.279524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:56.282589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:56.282813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:56.282817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:56.282828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:56.282875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:56.282912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256379256209340:11180]
2025-10-01T14:13:56.283568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:56.283887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:56.283924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:56.284233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:56.284288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.284289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.284290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.284292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.284293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.284294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.284295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.284297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.284298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.284299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.284301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.284302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.284303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.284304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.284310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.284319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.284323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.284328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.284332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.284336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.284341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.284345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.284349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.284353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.284357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.284361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.284365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.284369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.284376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.284384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.284390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.284396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.284401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.284406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.284411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.284417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.284422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.284427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.284431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.284436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.284442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.284447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.284453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.284458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.284463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.284468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.284473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.284478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.284483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.284489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.284493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.284498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.284503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.284508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.284513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.284518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.284560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:56.288340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:56.289155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:56.289172Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:56.289175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:56.289178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:56.289185Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2097 [2:7556256379256209340:11180]
2025-10-01T14:13:56.289203Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:56.289221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:56.289224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:56.289227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:56.289230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:56.289247Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:56.289252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:56.289259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:56.289315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.289317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.289319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.289323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:56.289325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:56.289400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:56.289403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.289415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.289426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.289447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:56.289470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633110173:11504], now have 1 active actors on pipe
2025-10-01T14:13:56.289482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633110000:2446], now have 1 active actors on pipe
2025-10-01T14:13:56.289490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256379256209335:11180]
2025-10-01T14:13:56.289493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256379256209335:11180]
2025-10-01T14:13:56.289495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256379256209335:11180]
2025-10-01T14:13:56.289507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:56.289520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:56.289527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:56.289530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:56.289533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:56.289541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:56.289515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2097
2025-10-01T14:13:56.289544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:56.289516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2097
2025-10-01T14:13:56.289576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256379256209335:11180]
2025-10-01T14:13:56.289586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:56.289603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:56.289607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.289611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.289652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:56.289666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:56.289670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:56.289672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:56.289680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:56.289688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:56.289706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:56.289911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.289917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.289932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:56.290149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2098 partition: 0 MaxSeqNo: 45 sessionId: src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0
2025-10-01T14:13:56.292010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d50b3ae6-98c0d941-b426b5e3-19674889_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:56.295021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0] Write session: try to update token
2025-10-01T14:13:56.295043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:56.316292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:56.316311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:56.316314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:56.316317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:56.316328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256379256209335:11180]
2025-10-01T14:13:56.316334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256379256209335:11180]
2025-10-01T14:13:56.316338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256379256209335:11180]
2025-10-01T14:13:56.316392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:56.316399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.316398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:56.316403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:56.316404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:56.316407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:56.316538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:56.342427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2098 sessionId: src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:56.345245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:56.362442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256381633110188:10880]
2025-10-01T14:13:56.366461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2097, pipe: [1:7556256381633110188:10880]
2025-10-01T14:13:56.466141Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:56.466494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.466511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.466534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633110188:10880], now have 1 active actors on pipe
2025-10-01T14:13:56.466720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:56.467199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:56.467257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256381633110188:10880]
2025-10-01T14:13:56.467280Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:56.467286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2098 reason: status is not ok: tablet will be restarted right now sessionId: src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0
2025-10-01T14:13:56.467439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2098 sessionId: src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0 is DEAD
2025-10-01T14:13:56.467724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:56.467730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0] Write session will restart in 0.006150s
2025-10-01T14:13:56.467750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0] Write session: Do CDS request
2025-10-01T14:13:56.467754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:56.474892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:56.481937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:56.481958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2099
2025-10-01T14:13:56.482334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:56.482119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:56.482152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:56.482157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:56.482161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:56.482521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2099 sessionId:  describe result for acl check
2025-10-01T14:13:56.482557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:56.482562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:56.482563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:56.482568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256381633110334:11508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:56.483060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256381633110334:11508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:56.484806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256381633110334:11508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:56.485022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:56.485198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:56.485207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:56.485216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:56.485249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:56.485275Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256379256209534:11183]
2025-10-01T14:13:56.485748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:56.486002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:56.486031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:56.486263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:56.486317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.486322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.486323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.486324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.486325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.486326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.486326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.486327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.486327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.486328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.486329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.486329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.486330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.486331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.486334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.486340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.486342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.486344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.486346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.486348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.486350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.486353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.486355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.486358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.486359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.486361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.486363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.486365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.486384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.486391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.486398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.486403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.486408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.486413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.486417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.486422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.486426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.486431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.486436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.486441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.486444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.486446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.486450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.486453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.486456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.486459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.486461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.486464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.486466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.486470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.486472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.486475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.486478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.486480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.486483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.486486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.486508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:56.487075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256381633110334:11508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:56.487090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256381633110334:11508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:56.487094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256381633110334:11508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:56.487101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:56.491974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2098
2025-10-01T14:13:56.492005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2098
2025-10-01T14:13:56.490873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:56.491476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:56.491480Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:56.491482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:56.491484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:56.491490Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2098 [2:7556256379256209534:11183]
2025-10-01T14:13:56.491502Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:56.491515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:56.491517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:56.491519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:56.491521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:56.491533Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:56.491537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:56.491542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:56.491585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.491587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.491588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.491590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:56.491592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:56.491645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:56.491647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.491654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.491660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.491669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:56.491682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256379256209529:11183]
2025-10-01T14:13:56.491684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256379256209529:11183]
2025-10-01T14:13:56.491686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256379256209529:11183]
2025-10-01T14:13:56.491694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:56.491702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:56.491706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:56.491708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:56.491709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:56.491723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:56.491726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:56.491737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633110189:2446], now have 1 active actors on pipe
2025-10-01T14:13:56.491740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633110371:11508], now have 1 active actors on pipe
2025-10-01T14:13:56.491772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256379256209529:11183]
2025-10-01T14:13:56.491781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:56.491792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:56.492274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.492280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.492306Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:56.492314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:56.492318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:56.492320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:56.492341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:56.492351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:56.492364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:56.496111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.496126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.496155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:56.496275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2099 partition: 0 MaxSeqNo: 45 sessionId: src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0
2025-10-01T14:13:56.496645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c0674e-cd244e4-b3232d66-dbe2fdea_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:56.499423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0] Write session: try to update token
2025-10-01T14:13:56.499442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:56.516253Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2099 sessionId: src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:56.518859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:56.519298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.519321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.521662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:56.521698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:56.521702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:56.521704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:56.521706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:56.521716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256379256209529:11183]
2025-10-01T14:13:56.521720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256379256209529:11183]
2025-10-01T14:13:56.521726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256379256209529:11183]
2025-10-01T14:13:56.521772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:56.521779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.521781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:56.521925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:56.522151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:56.522158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:56.522163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:56.522216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:56.567611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256381633110388:10880]
2025-10-01T14:13:56.567995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2098, pipe: [1:7556256381633110388:10880]
2025-10-01T14:13:56.688881Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:56.697946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.697979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.698171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.698240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.698312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.698478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.698534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.698539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.698624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.698739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.698808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.698886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.698931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.698935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.699008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.699071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.699136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.699201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.699243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.699246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.699318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.699378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.699439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.699503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.699620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.699628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.699697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.699760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.699826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.699893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.699935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.699938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.700033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.700110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.700194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.700277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.700353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.700356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.700440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.700515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.700618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.700699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.700753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.700759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.700851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.700923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.701003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.701096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.701149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.701152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.701239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.701313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.701391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.701469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.701519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.701522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.701614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:56.701691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:56.701774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:56.701859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:56.701912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:56.701915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:56.701997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633110388:10880], now have 1 active actors on pipe
2025-10-01T14:13:56.702739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:56.702789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:56.702795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256381633110388:10880]
2025-10-01T14:13:56.702795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:56.702833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2099 reason: error at write: Disconnected sessionId: src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0
2025-10-01T14:13:56.703036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2099 sessionId: src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0 is DEAD
2025-10-01T14:13:56.703712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:56.706557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:56.706569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0] Write session will restart in 0.007730s
2025-10-01T14:13:56.706595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0] Write session: Do CDS request
2025-10-01T14:13:56.706601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:56.715972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:56.718119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:56.718137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2100
2025-10-01T14:13:56.718311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:56.718342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:56.718348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:56.718351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:56.719032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2100 sessionId:  describe result for acl check
2025-10-01T14:13:56.719112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:56.719118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:56.719120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:56.719128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256381633110455:11514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:56.719732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256381633110455:11514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:56.727256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256381633110455:11514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:56.731196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:56.732125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256381633110455:11514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:56.732145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256381633110455:11514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:56.732148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256381633110455:11514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:56.732157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:56.783832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:56.784110Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:56.784114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:56.784126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:56.784196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:56.784234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256379256209722:11185]
2025-10-01T14:13:56.784858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:56.785206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:56.785279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:56.785628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:56.785717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.785727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.785728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.785730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.785732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.785733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.785735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.785737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.785739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.785741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.785742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.785743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.785744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.785747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.785754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.785764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.785769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.785774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.785778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.785782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.785787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.785791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.785795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.785799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.785804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.785808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.785812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.785823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.785833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.785848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:56.785861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.785873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:56.785885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.785894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:56.785902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.785912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:56.785924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.785936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:56.785949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.785962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:56.785973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.785984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:56.785995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.786004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:56.786014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.786024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:56.786033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.786044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.786055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.786065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.786077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.786087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.786097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.786108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:56.786117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.786123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:56.786167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:56.799396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:56.800200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:56.800217Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:56.800220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:56.800223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:56.800231Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2099 [2:7556256379256209722:11185]
2025-10-01T14:13:56.800249Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:56.800268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:56.800271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:56.800275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:56.800277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:56.800294Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:56.800301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:56.800306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:56.800367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.800376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.800379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.800382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:56.800385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:56.800462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:56.800469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.800485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:56.800501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:56.800524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:56.800543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633110403:2446], now have 1 active actors on pipe
2025-10-01T14:13:56.800552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633110582:11514], now have 1 active actors on pipe
2025-10-01T14:13:56.800560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256379256209714:11185]
2025-10-01T14:13:56.800567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256379256209714:11185]
2025-10-01T14:13:56.800569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256379256209714:11185]
2025-10-01T14:13:56.800583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:56.800609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:56.800630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:56.800637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:56.800678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256379256209714:11185]
2025-10-01T14:13:56.800685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:56.800826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:56.800836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:56.800838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:56.800844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:56.801010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.801029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.801057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:56.801065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:56.801070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:56.801073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:56.801082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:56.801094Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:56.801113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:56.801287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.801295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.801309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:56.801855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb123989-6228713d-9d39e2fc-80c1f84a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:56.800803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2099
2025-10-01T14:13:56.800858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2099
2025-10-01T14:13:56.801487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2100 partition: 0 MaxSeqNo: 45 sessionId: src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0
2025-10-01T14:13:56.802563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256381633110592:10880]
2025-10-01T14:13:56.802768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256381633110592:10880], now have 1 active actors on pipe
2025-10-01T14:13:56.802814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2099, pipe: [1:7556256381633110592:10880]
2025-10-01T14:13:56.804528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0] Write session: try to update token
2025-10-01T14:13:56.804545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:56.821585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2100 sessionId: src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:56.823821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:56.824905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:56.824924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:56.824963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:56.827058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:56.832258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:56.832280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:56.832283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:56.832285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:56.832295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256379256209714:11185]
2025-10-01T14:13:56.832300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256379256209714:11185]
2025-10-01T14:13:56.832304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256379256209714:11185]
2025-10-01T14:13:56.832353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:56.832360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:56.832363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:56.832507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:56.833006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:56.833014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:56.833017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:56.993606Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:57.001788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.001816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.001983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.002046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.002111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.002176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.002221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.002230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.002297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.002361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.005417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:57.005426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256381633110592:10880]
2025-10-01T14:13:57.005452Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:57.005455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:57.005480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2100 reason: error at write: Disconnected sessionId: src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0
2025-10-01T14:13:57.002440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.002513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.002554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.002558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.002619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.002708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.002768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.002823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.002861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.002864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.002925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.002982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.003070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.003126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.003163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.003166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.003223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.003305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.003360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.003416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.003451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.003453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.003538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.003603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.003670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.003738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.003786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.003789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.003863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.003930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.004001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.004069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.004117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.004120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.004196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.004264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.004336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.004403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.004449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.004452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.004531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.004608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.004677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.004747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.004795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.004797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.004879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.004947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.005016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.005081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.005126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.005128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.006480Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:57.005673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2100 sessionId: src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0 is DEAD
2025-10-01T14:13:57.010472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:57.010486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0] Write session will restart in 0.005884s
2025-10-01T14:13:57.010514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0] Write session: Do CDS request
2025-10-01T14:13:57.010522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:57.017958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.018015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:57.018032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2101
2025-10-01T14:13:57.018137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.018181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:57.018190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:57.018193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:57.018668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2101 sessionId:  describe result for acl check
2025-10-01T14:13:57.018709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:57.018713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:57.018715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:57.018723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256385928077991:11526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:57.019249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256385928077991:11526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:57.021759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256385928077991:11526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:57.024082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256385928077991:11526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:57.024093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256385928077991:11526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:57.024096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256385928077991:11526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:57.024103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:57.024190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:57.026744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:57.027042Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:57.027056Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:57.027069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:57.027131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:57.027176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256383551177209:11190]
2025-10-01T14:13:57.027740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:57.028158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:57.028205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:57.028505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:57.028566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.028567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.028568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.028570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.028571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.028572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.028574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.028575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.028576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.028577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.028578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.028579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.028580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.028581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.028601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.028611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.028614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.028618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.028621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.028624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.028628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.028632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.028636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.028640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.028644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.028648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.028651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.028655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.028662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.028669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.028676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.028681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.028686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.028690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.028694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.028699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.028703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.028708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.028712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.028718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.028722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.028727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.028732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.028736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.028741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.028746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.028749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.028754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.028759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.028763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.028766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.028771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.028775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.028780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.028784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.028789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.028827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:57.032620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:57.033327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:57.033340Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:57.033343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:57.033346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:57.033353Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2100 [2:7556256383551177209:11190]
2025-10-01T14:13:57.033368Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:57.033383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:57.033391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.033395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.033397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.033412Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:57.033418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:57.033424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:57.033479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.033486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.033488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.033490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:57.033493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:57.033556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:57.033565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.033576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.033586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.033599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:57.033619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256383551177203:11190]
2025-10-01T14:13:57.033627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256383551177203:11190]
2025-10-01T14:13:57.033629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256383551177203:11190]
2025-10-01T14:13:57.033644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:57.033659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:57.033671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:57.033679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:57.033688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:57.033706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256383551177203:11190]
2025-10-01T14:13:57.033709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:57.033710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:57.033712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:57.033718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:57.033888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078098:11526], now have 1 active actors on pipe
2025-10-01T14:13:57.033896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928077920:2446], now have 1 active actors on pipe
2025-10-01T14:13:57.034034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2100
2025-10-01T14:13:57.034058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2100
2025-10-01T14:13:57.034108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.034119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.034145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:57.034156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.034160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.034162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:57.034172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.034186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:57.034203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.034566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.034580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.034601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.034734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2101 partition: 0 MaxSeqNo: 45 sessionId: src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0
2025-10-01T14:13:57.035188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed2ca994-ca5191b8-e494fff0-df6f4c20_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:57.038094Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0] Write session: try to update token
2025-10-01T14:13:57.038111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:57.053453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2101 sessionId: src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:57.055129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:57.055148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:57.055152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:57.055153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:57.055163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256383551177203:11190]
2025-10-01T14:13:57.055168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256383551177203:11190]
2025-10-01T14:13:57.055171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256383551177203:11190]
2025-10-01T14:13:57.055223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:57.055233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.055235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:57.055296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:57.055310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:57.055317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:57.055377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:57.056079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:57.105858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256385928078110:10880]
2025-10-01T14:13:57.106670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2100, pipe: [1:7556256385928078110:10880]
2025-10-01T14:13:57.221388Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:57.222063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.222080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.222122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078110:10880], now have 1 active actors on pipe
2025-10-01T14:13:57.223348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:57.223435Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:57.223446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256385928078110:10880]
2025-10-01T14:13:57.223453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:57.223482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:57.223521Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:13:57.223523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2101 reason: error at write: Disconnected sessionId: src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0
2025-10-01T14:13:57.223615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2101 sessionId: src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0 is DEAD
2025-10-01T14:13:57.223623Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 21 consumer shared/user session shared/user_1_21_17283748345963503833_v1 is DEAD
2025-10-01T14:13:57.223746Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256278553880002:10877] disconnected; active server actors: 1
2025-10-01T14:13:57.223756Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256278553880002:10877] client user disconnected session shared/user_1_21_17283748345963503833_v1
2025-10-01T14:13:57.223865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:57.223876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0] Write session will restart in 0.007515s
2025-10-01T14:13:57.223875Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:13:57.223904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0] Write session: Do CDS request
2025-10-01T14:13:57.223910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:57.223984Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:13:57.223989Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:13:57.224000Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.009092s
2025-10-01T14:13:57.233910Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:13:57.234298Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:13:57.234315Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 22
2025-10-01T14:13:57.234406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.234405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:57.234419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2102
2025-10-01T14:13:57.234490Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 22 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:13:57.234536Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:13:57.234553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.234577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:57.234587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:57.234590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:57.234603Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 auth for : user
2025-10-01T14:13:57.234854Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 Handle describe topics response
2025-10-01T14:13:57.234887Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 auth is DEAD
2025-10-01T14:13:57.234910Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:13:57.235057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2102 sessionId:  describe result for acl check
2025-10-01T14:13:57.235088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:57.235094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:57.235096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:57.235101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256385928078158:11533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:57.235163Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:13:57.235275Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_22_17597359489047689163_v1
2025-10-01T14:13:57.235631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256385928078158:11533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:57.237121Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256385928078159:11532] connected; active server actors: 1
2025-10-01T14:13:57.237233Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256385928078159:11532] session shared/user_1_22_17597359489047689163_v1
2025-10-01T14:13:57.237255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:13:57.237273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:13:57.237297Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_22_17597359489047689163_v1" (Sender=[1:7556256385928078149:11532], Pipe=[1:7556256385928078159:11532], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:13:57.237303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:13:57.237327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:13:57.237340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_22_17597359489047689163_v1" (Sender=[1:7556256385928078149:11532], Pipe=[1:7556256385928078159:11532], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:13:57.237356Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_22_17597359489047689163_v1" sender [1:7556256385928078149:11532] lock partition 0 for ReadingSession "shared/user_1_22_17597359489047689163_v1" (Sender=[1:7556256385928078149:11532], Pipe=[1:7556256385928078159:11532], Partitions=[], ActiveFamilyCount=1) generation 1 step 22
2025-10-01T14:13:57.237371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:13:57.237378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000047s
2025-10-01T14:13:57.237638Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 22 Session: "shared/user_1_22_17597359489047689163_v1" ClientId: "user" PipeClient { RawX1: 7556256385928078159 RawX2: 4503603922349324 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:13:57.237664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:13:57.239910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256385928078158:11533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:57.245086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256385928078158:11533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:57.245103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256385928078158:11533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:57.245106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256385928078158:11533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:57.245113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:57.251234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:57.254093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:57.254327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:57.254339Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:57.254351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:57.254423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:57.254471Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256383551177427:11203]
2025-10-01T14:13:57.254906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:57.255168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:57.255197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:57.255506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:57.255538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.255538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.255539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.255540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.255541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.255541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.255542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.255543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.255544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.255544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.255545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.255546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.255547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.255548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.255551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.255557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.255559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.255562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.255564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.255566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.255568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.255571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.255573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.255575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.255577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.255580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.255582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.255584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.255589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.255594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.255598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.255602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.255604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.255608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.255612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.255615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.255618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.255621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.255623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.255626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.255630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.255633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.255635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.255638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.255640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.255643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.255647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.255650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.255653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.255656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.255659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.255662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.255665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.255668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.255670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.255673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.255694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:57.260269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:57.261331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:57.261336Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:57.261338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:57.261342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:57.261350Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2101 [2:7556256383551177427:11203]
2025-10-01T14:13:57.261367Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:57.261383Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:57.261387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.261390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.261392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.261407Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:57.261413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:57.261420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:57.261475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.261477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.261478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.261481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:57.261484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:57.261557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:57.261560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.261572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.261583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.261597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:57.261616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078119:2446], now have 1 active actors on pipe
2025-10-01T14:13:57.261619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078274:11533], now have 1 active actors on pipe
2025-10-01T14:13:57.261622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078182:11539], now have 1 active actors on pipe
2025-10-01T14:13:57.261629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256383551177422:11203]
2025-10-01T14:13:57.261631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256383551177422:11203]
2025-10-01T14:13:57.261633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256383551177422:11203]
2025-10-01T14:13:57.261651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:57.261664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:57.261677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:57.261680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:57.261713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256383551177422:11203]
2025-10-01T14:13:57.261716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:57.261899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2101
2025-10-01T14:13:57.261933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2101
2025-10-01T14:13:57.261951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2101, pipe: [1:7556256385928078182:11539]
2025-10-01T14:13:57.261908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:57.261915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:57.261917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:57.261921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:57.262815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.262831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.262859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.262861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.262873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_22_17597359489047689163_v1 on pipe: [1:7556256385928078182:11539]
2025-10-01T14:13:57.262897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1215387c-fe4cf5f8-19142283-2630592b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:57.262906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.262911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.262913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:57.262924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.262936Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:57.262947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.262951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.262953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:57.262972Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_22_17597359489047689163_v1
2025-10-01T14:13:57.262975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.263005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.263030Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:13:57.263168Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_22_17597359489047689163_v1:1 with generation 2101
2025-10-01T14:13:57.267042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.267053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.267077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.267189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2102 partition: 0 MaxSeqNo: 45 sessionId: src_id|1215387c-fe4cf5f8-19142283-2630592b_0
2025-10-01T14:13:57.270520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95bc678b-4fc8fce9-d659798c-2abc4eb8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1215387c-fe4cf5f8-19142283-2630592b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:57.270630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:13:57.270656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:13:57.270662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.270664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.270666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.270674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:13:57.270683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:13:57.270859Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759328037262 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:13:57.270880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:13:57.270908Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 sending to client partition status
2025-10-01T14:13:57.275200Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1215387c-fe4cf5f8-19142283-2630592b_0] Write session: try to update token
2025-10-01T14:13:57.275225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1215387c-fe4cf5f8-19142283-2630592b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:57.282840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:57.282860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:57.282862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:57.282863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:57.282871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256383551177422:11203]
2025-10-01T14:13:57.282874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256383551177422:11203]
2025-10-01T14:13:57.282878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256383551177422:11203]
2025-10-01T14:13:57.282927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:57.282937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.282940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:57.282943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:57.282951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:57.282955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:57.283066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:57.303614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2102 sessionId: src_id|1215387c-fe4cf5f8-19142283-2630592b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:57.306175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:57.441489Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:57.441761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.441775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.446923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_22_17597359489047689163_v1
2025-10-01T14:13:57.446946Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:57.447363Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_22_17597359489047689163_v1
2025-10-01T14:13:57.451067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1215387c-fe4cf5f8-19142283-2630592b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:57.451077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1215387c-fe4cf5f8-19142283-2630592b_0] Write session will restart in 0.009626s
2025-10-01T14:13:57.451101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1215387c-fe4cf5f8-19142283-2630592b_0] Write session: Do CDS request
2025-10-01T14:13:57.451106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1215387c-fe4cf5f8-19142283-2630592b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:57.450518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:57.450539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:57.450543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:57.450573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256385928078182:11539]
2025-10-01T14:13:57.450599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2102 reason: error at write: Disconnected sessionId: src_id|1215387c-fe4cf5f8-19142283-2630592b_0
2025-10-01T14:13:57.450782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2102 sessionId: src_id|1215387c-fe4cf5f8-19142283-2630592b_0 is DEAD
2025-10-01T14:13:57.462965Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1215387c-fe4cf5f8-19142283-2630592b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.463015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:57.463033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2103
2025-10-01T14:13:57.463205Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.463231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:57.463236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:57.463239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:57.463593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2103 sessionId:  describe result for acl check
2025-10-01T14:13:57.463617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:57.463619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:57.463622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:57.463627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256385928078326:11540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:57.464116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256385928078326:11540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:57.466775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256385928078326:11540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:57.479228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256385928078326:11540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:57.479244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256385928078326:11540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:57.479246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256385928078326:11540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:57.479252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:57.492239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:57.495015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:57.495257Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:57.495262Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:57.495274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:57.495337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:57.495374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256383551177629:11206]
2025-10-01T14:13:57.495992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:57.498327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:57.498432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:57.498788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:57.498877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.498879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.498880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.498881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.498882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.498883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.498885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.498886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.498887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.498888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.498890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.498891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.498891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.498893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.498900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.498909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.498913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.498916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.498923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.498926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.498929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.498933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.498936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.498940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.498943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.498946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.498949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.498952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.498960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.498968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.498976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.498980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.498984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.498989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.498993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.498997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.499003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.499008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.499011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.499016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.499020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.499025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.499029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.499033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.499037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.499041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.499045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.499049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.499053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.499060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.499064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.499068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.499073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.499078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.499081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.499085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.499118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:57.504633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:57.505357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:57.505363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:57.505365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:57.505370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:57.505378Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2102 [2:7556256383551177629:11206]
2025-10-01T14:13:57.505396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:57.505416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:57.505419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.505423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.505425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.505445Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:57.505450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:57.505457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:57.505517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.505523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.505525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.505528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:57.505530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:57.505614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:57.505617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.505629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.505637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.505650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:57.505670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256383551177624:11206]
2025-10-01T14:13:57.505673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256383551177624:11206]
2025-10-01T14:13:57.505674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256383551177624:11206]
2025-10-01T14:13:57.505691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:57.505707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:57.505721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:57.505724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:57.505761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256383551177624:11206]
2025-10-01T14:13:57.505764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:57.505768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:57.505771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:57.505773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:57.505776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078319:2446], now have 1 active actors on pipe
2025-10-01T14:13:57.505779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078368:11540], now have 1 active actors on pipe
2025-10-01T14:13:57.505779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:57.506341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2102
2025-10-01T14:13:57.506396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2102
2025-10-01T14:13:57.506444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.506457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.506491Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dc591f0-ea30c366-37d86c7f-77874e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:57.506501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.506505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.506508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:57.506520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.506546Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:57.506564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.506883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.506891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.506910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.507009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2103 partition: 0 MaxSeqNo: 45 sessionId: src_id|dc591f0-ea30c366-37d86c7f-77874e1_0
2025-10-01T14:13:57.510701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1215387c-fe4cf5f8-19142283-2630592b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|dc591f0-ea30c366-37d86c7f-77874e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:57.514136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc591f0-ea30c366-37d86c7f-77874e1_0] Write session: try to update token
2025-10-01T14:13:57.514156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc591f0-ea30c366-37d86c7f-77874e1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:57.536134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2103 sessionId: src_id|dc591f0-ea30c366-37d86c7f-77874e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:57.539104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:57.540995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.541022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.541058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:57.541178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:57.547892Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:57.547929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:57.547933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:57.547935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:57.547949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256383551177624:11206]
2025-10-01T14:13:57.547956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256383551177624:11206]
2025-10-01T14:13:57.547963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256383551177624:11206]
2025-10-01T14:13:57.548030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:57.548034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:57.548047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.548048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:57.548050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:57.548053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:57.548280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:57.551203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256385928078519:11539]
2025-10-01T14:13:57.551661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2102, pipe: [1:7556256385928078519:11539]
2025-10-01T14:13:57.712776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:57.713211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078519:11539], now have 1 active actors on pipe
2025-10-01T14:13:57.723470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.723513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.723731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.723810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.723895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.723972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.724043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.724056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.724139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.724207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.724283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.724359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.724413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.724416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.724491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.724554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.724637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.724701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.724754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.724757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.724834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.724897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.724962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.725028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.725079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.725082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.725153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.725215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.725280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.725343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.725397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.725401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.725473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.725534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.725599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.725657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.725840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.725847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.725945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.726021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.726089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.726160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.726215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.726228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.726329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.726471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.726560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.726642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.726715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.726718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.726804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.726880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.726955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.727051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.727112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.727118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.727200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.727272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.727346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.727418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.727465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.727471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.728113Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:57.728161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:57.728168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:57.728192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2103 reason: error at write: Disconnected sessionId: src_id|dc591f0-ea30c366-37d86c7f-77874e1_0
2025-10-01T14:13:57.728196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256385928078519:11539]
2025-10-01T14:13:57.728477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2103 sessionId: src_id|dc591f0-ea30c366-37d86c7f-77874e1_0 is DEAD
2025-10-01T14:13:57.728788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:57.730528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc591f0-ea30c366-37d86c7f-77874e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:57.730543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc591f0-ea30c366-37d86c7f-77874e1_0] Write session will restart in 0.009838s
2025-10-01T14:13:57.730574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc591f0-ea30c366-37d86c7f-77874e1_0] Write session: Do CDS request
2025-10-01T14:13:57.730581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc591f0-ea30c366-37d86c7f-77874e1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:57.741919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dc591f0-ea30c366-37d86c7f-77874e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.742028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:57.742045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2104
2025-10-01T14:13:57.742199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.742234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:57.742244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:57.742247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:57.742631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2104 sessionId:  describe result for acl check
2025-10-01T14:13:57.742680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:57.742687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:57.742688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:57.742693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256385928078686:11546] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:57.742840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:57.743191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256385928078686:11546] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:57.744987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256385928078686:11546] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:57.745198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:57.745383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:57.745392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:57.745402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:57.745435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:57.745463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256383551177817:11209]
2025-10-01T14:13:57.745931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:57.746196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:57.746234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:57.746540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:57.746586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.746591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.746591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.746592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.746593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.746593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.746594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.746595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.746595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.746596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.746597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.746597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.746598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.746598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.746602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.746608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.746610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.746612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.746614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.746616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.746619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.746621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.746623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.746625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.746627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.746629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.746631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.746633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.746639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.746643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.746647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.746650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.746654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.746657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.746659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.746662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.746664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.746667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.746671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.746676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.746680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.746685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.746689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.746693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.746697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.746701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.746706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.746710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.746716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.746721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.746724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.746729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.746733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.746737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.746740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.746745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.746774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:57.747376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256385928078686:11546] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:57.747388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256385928078686:11546] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:57.747391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256385928078686:11546] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:57.747398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:57.750287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:57.751053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:57.751067Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:57.751070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:57.751073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:57.751080Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2103 [2:7556256383551177817:11209]
2025-10-01T14:13:57.751094Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:57.751113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:57.751121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.751124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.751126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.751138Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:57.751142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:57.751147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:57.751188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.751194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.751196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.751198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:57.751200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:57.751261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:57.751268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.751275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.751281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.751290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:57.751303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078725:11546], now have 1 active actors on pipe
2025-10-01T14:13:57.751306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078537:2446], now have 1 active actors on pipe
2025-10-01T14:13:57.751312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256383551177812:11209]
2025-10-01T14:13:57.751313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256383551177812:11209]
2025-10-01T14:13:57.751315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256383551177812:11209]
2025-10-01T14:13:57.751325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:57.751337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:57.751351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:57.751354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:57.751371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:57.751379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:57.751380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256383551177812:11209]
2025-10-01T14:13:57.751380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:57.751382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:57.751385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:57.751414Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2103
2025-10-01T14:13:57.751419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2103
2025-10-01T14:13:57.751566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.751573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.751591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:57.751600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.751604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.751605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:57.751611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.751618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:57.751632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.751756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.751762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.751775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.751880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2104 partition: 0 MaxSeqNo: 45 sessionId: src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0
2025-10-01T14:13:57.754498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dc591f0-ea30c366-37d86c7f-77874e1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:57.757797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0] Write session: try to update token
2025-10-01T14:13:57.757822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:57.763211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:57.763228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:57.763238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256383551177812:11209]
2025-10-01T14:13:57.763285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:57.763306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:57.763448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:57.763587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:57.763720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:57.763879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:57.764055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:57.764093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:57.778642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2104 sessionId: src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:57.781703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.781728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.781768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:57.781470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:57.784151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:57.784170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:57.784173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:57.784175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:57.784187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256383551177812:11209]
2025-10-01T14:13:57.784190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256383551177812:11209]
2025-10-01T14:13:57.784193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256383551177812:11209]
2025-10-01T14:13:57.784235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:57.784235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:57.784241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:57.784247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.784248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:57.784250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:57.784380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:57.786480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:57.828177Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256385928078732:11539]
2025-10-01T14:13:57.828682Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2103, pipe: [1:7556256385928078732:11539]
2025-10-01T14:13:57.933453Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:57.941756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.941786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.941943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.942001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.942060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.942118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.942161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.942169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.942233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.942294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.942353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.942436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.942482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.942488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.942557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.942621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.942681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.942745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.942787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.942795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.942867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.942964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.943034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.943102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.943147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.943156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.943230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.943326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.943392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.943453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.943498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.943505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.943568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.943629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.943693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.943757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.943799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.943806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.943872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.943933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.943999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.944063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.944105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.944111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.944175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.944234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.944298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.944358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.944401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.944405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.944469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.944532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.944606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.944664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.944704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.944710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.944772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:57.944829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:57.944889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:57.944945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:57.944996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:57.945005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:57.945073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078732:11539], now have 1 active actors on pipe
2025-10-01T14:13:57.945388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:57.945394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256385928078732:11539]
2025-10-01T14:13:57.945404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:57.945415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:57.945434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2104 reason: error at write: Disconnected sessionId: src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0
2025-10-01T14:13:57.945638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2104 sessionId: src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0 is DEAD
2025-10-01T14:13:57.946265Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:57.946498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:57.946513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0] Write session will restart in 0.006192s
2025-10-01T14:13:57.946544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0] Write session: Do CDS request
2025-10-01T14:13:57.946551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:57.954895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.955259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:57.955287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2105
2025-10-01T14:13:57.955414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:57.955451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:57.955463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:57.955468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:57.955917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2105 sessionId:  describe result for acl check
2025-10-01T14:13:57.955959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:57.955972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:57.955974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:57.955980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256385928078753:11551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:57.956561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256385928078753:11551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:57.960901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256385928078753:11551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:57.965559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256385928078753:11551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:57.965578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256385928078753:11551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:57.965582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256385928078753:11551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:57.965592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:57.968946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:57.972124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:57.972361Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:57.972372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:57.972382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:57.972432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:57.972481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256383551178008:11211]
2025-10-01T14:13:57.973284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:57.973610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:57.973657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:57.973991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:57.974060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.974068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.974070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.974071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.974073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.974075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.974077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.974078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.974079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.974081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.974082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.974083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.974085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.974087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.974093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.974104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.974109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.974113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.974118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.974122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.974127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.974131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.974136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.974140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.974163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.974166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.974170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.974173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.974180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.974188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:57.974194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.974202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:57.974215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.974221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:57.974226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.974236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:57.974243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.974248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:57.974259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.974264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:57.974269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.974281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:57.974286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.974292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:57.974303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.974309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:57.974314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.974321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.974328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.974340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.974345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.974351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.974356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.974362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:57.974367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.974388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:57.974436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:57.979285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:57.980388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:57.980407Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:57.980411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:57.980415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:57.980422Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2104 [2:7556256383551178008:11211]
2025-10-01T14:13:57.980441Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:57.981026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2104
2025-10-01T14:13:57.981084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2104
2025-10-01T14:13:57.980459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:57.980472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.980476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.980478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.980493Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:57.980499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:57.980518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:57.980603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.980606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.980610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.980614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:57.980617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:57.980686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:57.980689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:57.980701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:57.980712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:57.980729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:57.980746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078893:11551], now have 1 active actors on pipe
2025-10-01T14:13:57.980754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256383551178003:11211]
2025-10-01T14:13:57.980756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256383551178003:11211]
2025-10-01T14:13:57.980759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256383551178003:11211]
2025-10-01T14:13:57.980769Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:57.980778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:57.980780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:57.980781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:57.980783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:57.980795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:57.980799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:57.980805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256385928078737:2446], now have 1 active actors on pipe
2025-10-01T14:13:57.981280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256383551178003:11211]
2025-10-01T14:13:57.981297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:57.981319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.981324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.981374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:57.981382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:57.981386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:57.981388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:57.981397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:57.981426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:57.981443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.981503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:57.981808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:57.981825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:57.981847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:57.981931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2105 partition: 0 MaxSeqNo: 45 sessionId: src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0
2025-10-01T14:13:57.982296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61fb6d66-d200b615-c5e6dfbb-d82ae72f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:57.985154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0] Write session: try to update token
2025-10-01T14:13:57.985168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:58.003970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:58.003993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:58.003996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:58.003998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:58.004008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256383551178003:11211]
2025-10-01T14:13:58.004014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256383551178003:11211]
2025-10-01T14:13:58.004017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256383551178003:11211]
2025-10-01T14:13:58.004077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:58.004089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.004092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:58.004098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:58.004120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:58.004127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:58.004228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:58.011273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2105 sessionId: src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:58.014580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:58.045729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256390223046256:11539]
2025-10-01T14:13:58.046414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2104, pipe: [1:7556256390223046256:11539]
2025-10-01T14:13:58.171295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:58.171781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.171792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.171815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046256:11539], now have 1 active actors on pipe
2025-10-01T14:13:58.172043Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:58.174544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:58.174608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256390223046256:11539]
2025-10-01T14:13:58.174628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:58.174709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2105 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0
2025-10-01T14:13:58.174931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2105 sessionId: src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0 is DEAD
2025-10-01T14:13:58.178472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:58.178491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0] Write session will restart in 0.008207s
2025-10-01T14:13:58.178523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0] Write session: Do CDS request
2025-10-01T14:13:58.178530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:58.190801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:58.191145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:58.191174Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2106
2025-10-01T14:13:58.191288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:58.191326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:58.191337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:58.191341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:58.191774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2106 sessionId:  describe result for acl check
2025-10-01T14:13:58.191812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:58.191814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:58.191815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:58.191820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256390223046311:11562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:58.192335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256390223046311:11562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:58.200254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:58.198318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256390223046311:11562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:58.202864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:58.203105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:58.203110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:58.203121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:58.203177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:58.203213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256387846145501:11216]
2025-10-01T14:13:58.203750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:58.204132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:58.204192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:58.204539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:58.204624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.204630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.204631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.204632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.204633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.204634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.204635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.204636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.204637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.204638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.204639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.204640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.204641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.204642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.204648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.204657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.204660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.204664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.204668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.204671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.204674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.204678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.204681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.204685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.204688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.204691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.204694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.204697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.204705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.204713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.204719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.204724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.204729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.204740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.204744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.204749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.204759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.204764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.204772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.204777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.204787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.204791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.204801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.204807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.204816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.204821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.204829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.204834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.204842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.204848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.204856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.204861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.204870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.204875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.204879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.204888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.204927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:58.203057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256390223046311:11562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:58.203088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256390223046311:11562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:58.203091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256390223046311:11562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:58.203099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:58.210014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:58.210721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:58.210738Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:58.210740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:58.210744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:58.210753Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2105 [2:7556256387846145501:11216]
2025-10-01T14:13:58.210770Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:58.210788Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:58.210793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:58.210797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:58.210800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:58.210817Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:58.210827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:58.210834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:58.210912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.210920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.210923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.210925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:58.210927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:58.210982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:58.210988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.210997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.211002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.211012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:58.211025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256387846145496:11216]
2025-10-01T14:13:58.211026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256387846145496:11216]
2025-10-01T14:13:58.211028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256387846145496:11216]
2025-10-01T14:13:58.211036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:58.211054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046445:11562], now have 1 active actors on pipe
2025-10-01T14:13:58.211057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:58.211061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:58.211063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:58.211066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:58.211075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:58.211078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:58.211113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046258:2446], now have 1 active actors on pipe
2025-10-01T14:13:58.211121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256387846145496:11216]
2025-10-01T14:13:58.211129Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:58.211208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:58.211913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2105
2025-10-01T14:13:58.211951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2105
2025-10-01T14:13:58.212439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.212449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.212473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5011cc67-5760d0be-5c810874-97061a41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:58.212483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:58.212487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:58.212489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:58.212497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:58.212507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:58.212525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:58.213221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.213234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.213386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2106 partition: 0 MaxSeqNo: 45 sessionId: src_id|5011cc67-5760d0be-5c810874-97061a41_0
2025-10-01T14:13:58.213256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:58.214607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed322684-2a701c58-14b3e284-aecfcd8e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5011cc67-5760d0be-5c810874-97061a41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:58.217769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5011cc67-5760d0be-5c810874-97061a41_0] Write session: try to update token
2025-10-01T14:13:58.217790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5011cc67-5760d0be-5c810874-97061a41_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:58.247493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:58.247513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:58.247516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:58.247519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:58.247528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256387846145496:11216]
2025-10-01T14:13:58.247534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256387846145496:11216]
2025-10-01T14:13:58.247538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256387846145496:11216]
2025-10-01T14:13:58.247596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:58.247605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.247613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:58.248147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:58.249323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:58.249337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:58.249341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:58.257233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2106 sessionId: src_id|5011cc67-5760d0be-5c810874-97061a41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:58.260132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:58.278470Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256390223046457:11539]
2025-10-01T14:13:58.288283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2105, pipe: [1:7556256390223046457:11539]
2025-10-01T14:13:58.401575Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:58.401961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.401977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.402017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046457:11539], now have 1 active actors on pipe
2025-10-01T14:13:58.404848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:58.402348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:58.404953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2106 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5011cc67-5760d0be-5c810874-97061a41_0
2025-10-01T14:13:58.405195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2106 sessionId: src_id|5011cc67-5760d0be-5c810874-97061a41_0 is DEAD
2025-10-01T14:13:58.405733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256390223046457:11539]
2025-10-01T14:13:58.405750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:58.407462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011cc67-5760d0be-5c810874-97061a41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:58.407473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011cc67-5760d0be-5c810874-97061a41_0] Write session will restart in 0.005662s
2025-10-01T14:13:58.407501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011cc67-5760d0be-5c810874-97061a41_0] Write session: Do CDS request
2025-10-01T14:13:58.407507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011cc67-5760d0be-5c810874-97061a41_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:58.413950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5011cc67-5760d0be-5c810874-97061a41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:58.414064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:58.414081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2107
2025-10-01T14:13:58.414616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:58.414650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:58.414654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:58.414657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:58.415078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2107 sessionId:  describe result for acl check
2025-10-01T14:13:58.415116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:58.415120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:58.415121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:58.415126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256390223046483:11566] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:58.415533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256390223046483:11566] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:58.418679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256390223046483:11566] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:58.422471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256390223046483:11566] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:58.422488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256390223046483:11566] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:58.422491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256390223046483:11566] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:58.422498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:58.427686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:58.430230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:58.430476Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:58.430487Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:58.430499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:58.430568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:58.430617Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256387846145733:11229]
2025-10-01T14:13:58.431170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:58.434443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:58.434509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:58.434847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:58.434900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.434902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.434903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.434904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.434906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.434907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.434909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.434910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.434911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.434913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.434914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.434916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.434917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.434918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.434924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.434934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.434937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.434941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.434945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.434949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.434953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.434956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.434959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.434964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.434968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.434971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.434975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.434980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.434988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.434996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.435002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.435008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.435012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.435032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.435036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.435042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.435047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.435053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.435057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.435063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.435070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.435076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.435081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.435086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.435090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.435096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.435100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.435106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.435111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.435116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.435121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.435126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.435131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.435136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.435141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.435146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.435186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:58.440800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:58.441794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:58.441806Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:58.441808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:58.441810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:58.441816Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2106 [2:7556256387846145733:11229]
2025-10-01T14:13:58.441832Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:58.441850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:58.441857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:58.441861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:58.441864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:58.441880Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:58.441889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:58.441896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:58.441956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.441963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.441965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.441968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:58.441971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:58.442053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:58.442060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.442072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.442087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.442108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:58.442130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046462:2446], now have 1 active actors on pipe
2025-10-01T14:13:58.442137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046592:11566], now have 1 active actors on pipe
2025-10-01T14:13:58.442145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256387846145728:11229]
2025-10-01T14:13:58.442151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256387846145728:11229]
2025-10-01T14:13:58.442153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256387846145728:11229]
2025-10-01T14:13:58.442165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:58.442178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:58.442189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:58.442191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:58.442194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:58.442199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:58.442202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:58.442174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2106
2025-10-01T14:13:58.442200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2106
2025-10-01T14:13:58.442247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.442257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.442269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256387846145728:11229]
2025-10-01T14:13:58.442280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:58.442302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:58.442308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c644b30-abd92560-2d452e77-78a0d717_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:58.442315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:58.442318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:58.442321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:58.442329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:58.442337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:58.442361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:58.442541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.442551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.442574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:58.442652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2107 partition: 0 MaxSeqNo: 45 sessionId: src_id|7c644b30-abd92560-2d452e77-78a0d717_0
2025-10-01T14:13:58.443028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5011cc67-5760d0be-5c810874-97061a41_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7c644b30-abd92560-2d452e77-78a0d717_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:58.445960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c644b30-abd92560-2d452e77-78a0d717_0] Write session: try to update token
2025-10-01T14:13:58.446000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c644b30-abd92560-2d452e77-78a0d717_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:58.468899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:58.468921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:58.468924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:58.468926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:58.468936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256387846145728:11229]
2025-10-01T14:13:58.468942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256387846145728:11229]
2025-10-01T14:13:58.468947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256387846145728:11229]
2025-10-01T14:13:58.469006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:58.469008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:58.469015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.469016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:58.469018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:58.469019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:58.469192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:58.474449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2107 sessionId: src_id|7c644b30-abd92560-2d452e77-78a0d717_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:58.477415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:58.506174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256390223046663:11539]
2025-10-01T14:13:58.506577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2106, pipe: [1:7556256390223046663:11539]
2025-10-01T14:13:58.635779Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:58.636403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.636421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.636467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046663:11539], now have 1 active actors on pipe
2025-10-01T14:13:58.637125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:58.637143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:58.637204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2107 reason: error at write: Disconnected sessionId: src_id|7c644b30-abd92560-2d452e77-78a0d717_0
2025-10-01T14:13:58.637400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2107 sessionId: src_id|7c644b30-abd92560-2d452e77-78a0d717_0 is DEAD
2025-10-01T14:13:58.637606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256390223046663:11539]
2025-10-01T14:13:58.637629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:58.637856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c644b30-abd92560-2d452e77-78a0d717_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:58.637865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c644b30-abd92560-2d452e77-78a0d717_0] Write session will restart in 0.005272s
2025-10-01T14:13:58.637890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c644b30-abd92560-2d452e77-78a0d717_0] Write session: Do CDS request
2025-10-01T14:13:58.637900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c644b30-abd92560-2d452e77-78a0d717_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:58.638035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:58.643857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c644b30-abd92560-2d452e77-78a0d717_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:58.644952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:58.644969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2108
2025-10-01T14:13:58.645126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:58.645152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:58.645161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:58.645164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:58.645498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2108 sessionId:  describe result for acl check
2025-10-01T14:13:58.645527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:58.645531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:58.645532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:58.645535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256390223046684:11571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:58.645953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256390223046684:11571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:58.652462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256390223046684:11571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:58.661949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256390223046684:11571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:58.661970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256390223046684:11571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:58.661974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256390223046684:11571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:58.661982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:58.675319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:58.678590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:58.678871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:58.678881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:58.678894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:58.678950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:58.678988Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256387846145926:11231]
2025-10-01T14:13:58.679544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:58.679906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:58.679960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:58.680249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:58.680302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.680304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.680305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.680306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.680306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.680308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.680309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.680309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.680310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.680311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.680312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.680313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.680314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.680314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.680319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.680325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.680327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.680329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.680332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.680334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.680336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.680338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.680340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.680343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.680345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.680347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.680349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.680351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.680358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.680363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.680367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.680371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.680373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.680376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.680379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.680382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.680385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.680388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.680391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.680394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.680397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.680400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.680403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.680406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.680409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.680413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.680416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.680419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.680422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.680425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.680429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.680432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.680434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.680437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.680439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.680442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.680466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:58.684668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:58.685347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:58.685361Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:58.685364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:58.685367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:58.685373Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2107 [2:7556256387846145926:11231]
2025-10-01T14:13:58.685386Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:58.685400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:58.685402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:58.685405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:58.685407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:58.685420Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:58.685424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:58.685429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:58.685486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.685493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.685495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.685497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:58.685499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:58.685559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:58.685569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.685580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.685591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.685604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:58.685616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256387846145920:11231]
2025-10-01T14:13:58.685618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256387846145920:11231]
2025-10-01T14:13:58.685620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256387846145920:11231]
2025-10-01T14:13:58.685628Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:58.685638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046671:2446], now have 1 active actors on pipe
2025-10-01T14:13:58.685639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:58.685640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046818:11571], now have 1 active actors on pipe
2025-10-01T14:13:58.685643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:58.685645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:58.685647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:58.685655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:58.685657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:58.685685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256387846145920:11231]
2025-10-01T14:13:58.685691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:58.685707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:58.685829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.685837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.685694Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2107
2025-10-01T14:13:58.685744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2107
2025-10-01T14:13:58.685864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:58.685876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:58.685883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:58.685889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:58.685898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:58.685911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:58.685928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:58.686139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.686145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.686159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:58.686246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2108 partition: 0 MaxSeqNo: 45 sessionId: src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0
2025-10-01T14:13:58.686596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c644b30-abd92560-2d452e77-78a0d717_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:58.690151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0] Write session: try to update token
2025-10-01T14:13:58.690168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:58.705894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2108 sessionId: src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:58.708976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:58.710070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.710095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.710112Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:58.710115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:58.710121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256387846145920:11231]
2025-10-01T14:13:58.710171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:58.710174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:58.710456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:58.710634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:58.710809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:58.710977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:58.711197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:58.711252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:58.711274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:58.711446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:58.731223Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:58.731241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:58.731244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:58.731246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:58.731257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256387846145920:11231]
2025-10-01T14:13:58.731261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256387846145920:11231]
2025-10-01T14:13:58.731264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256387846145920:11231]
2025-10-01T14:13:58.731310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:58.731318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.731320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:58.731456Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:58.732997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:58.733007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:58.733011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:58.738329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256390223046883:11539]
2025-10-01T14:13:58.738716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2107, pipe: [1:7556256390223046883:11539]
2025-10-01T14:13:58.888048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:58.888459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046883:11539], now have 1 active actors on pipe
2025-10-01T14:13:58.897244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.897278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.897450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.897522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.897619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.897698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.897754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.897765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.897844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.897908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.897970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.898039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.898086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.898095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.898157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.898218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.898282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.898339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.898408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.898417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.898486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.898549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.898612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.898681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.898727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.898740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.898809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.898882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.898947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.899010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.899061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.899070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.899157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.899234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.899318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.899402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.899459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.899467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.899544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.899622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.899706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.899792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.899890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.899898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.899980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.900058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.900127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.900195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.900257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.900262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.900335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.900403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.900469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.900543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.900603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.900610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.900682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.900746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.900816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.900886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.900933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.900938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.901307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:58.901322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256390223046883:11539]
2025-10-01T14:13:58.901347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:58.901350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:58.901377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2108 reason: error at write: Disconnected sessionId: src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0
2025-10-01T14:13:58.901656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2108 sessionId: src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0 is DEAD
2025-10-01T14:13:58.901737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:58.901745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0] Write session will restart in 0.008072s
2025-10-01T14:13:58.901773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0] Write session: Do CDS request
2025-10-01T14:13:58.901778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:58.902003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:58.910961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:58.911161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:58.911179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2109
2025-10-01T14:13:58.911319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:58.911348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:58.911355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:58.911360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:58.911825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2109 sessionId:  describe result for acl check
2025-10-01T14:13:58.911868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:58.911876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:58.911878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:58.911884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256390223046898:11576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:58.912449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256390223046898:11576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:58.916229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256390223046898:11576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:58.921631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256390223046898:11576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:58.921650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256390223046898:11576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:58.921652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256390223046898:11576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:58.921660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:58.922002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:58.924237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:58.924421Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:58.924427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:58.924436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:58.924475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:58.924504Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256387846146120:11234]
2025-10-01T14:13:58.924935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:58.925188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:58.925226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:58.925458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:58.925517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.925522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.925523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.925524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.925525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.925527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.925528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.925529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.925530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.925531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.925532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.925533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.925534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.925535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.925540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.925550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.925554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.925557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.925561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.925565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.925568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.925572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.925575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.925579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.925583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.925587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.925590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.925594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.925601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.925609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:58.925615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.925620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:58.925624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.925628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:58.925632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.925636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:58.925640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.925645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:58.925649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.925654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:58.925659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.925665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:58.925669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.925674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:58.925678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.925683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:58.925687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.925692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.925696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.925706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.925710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.925716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.925724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.925732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:58.925736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.925740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:58.925762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:58.931914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:58.932571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:58.932596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:58.932599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:58.932603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:58.932610Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2108 [2:7556256387846146120:11234]
2025-10-01T14:13:58.932629Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:58.932648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:58.932651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:58.932655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:58.932658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:58.932676Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:58.932688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:58.932695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:58.932756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.932764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.932766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.932770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:58.932773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:58.932846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:58.932855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.932867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:58.932883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:58.932901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:58.932923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256387846146115:11234]
2025-10-01T14:13:58.932931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256387846146115:11234]
2025-10-01T14:13:58.932933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256387846146115:11234]
2025-10-01T14:13:58.932950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:58.932968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:58.932986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:58.932993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:58.933038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256387846146115:11234]
2025-10-01T14:13:58.933045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:58.933188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:58.933200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:58.933203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:58.933210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:58.933464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2108
2025-10-01T14:13:58.933503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2108
2025-10-01T14:13:58.933510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223047074:11576], now have 1 active actors on pipe
2025-10-01T14:13:58.933524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256390223046886:2446], now have 1 active actors on pipe
2025-10-01T14:13:58.933546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.933554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.933589Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:58.933602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:58.933610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:58.933612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:58.933623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:58.933635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:58.933662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:58.933859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.933869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.933891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:58.933998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2109 partition: 0 MaxSeqNo: 45 sessionId: src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0
2025-10-01T14:13:58.934526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b380dab8-f352d3e2-9c4360b2-750892cf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:58.937480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0] Write session: try to update token
2025-10-01T14:13:58.937495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:58.957200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2109 sessionId: src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:58.959818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:58.960125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.960153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.960196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:58.960295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:58.985923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:58.985951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:58.986111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.986167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.986226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.986285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.986328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.986343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.986423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.986481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.986538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.986599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.986643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.986649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.986727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.986792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.986861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.986927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.986983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.986989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.987060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.987126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.987192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.987265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.987313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.987320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.987397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.987463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.987532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.987599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.987648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.987655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.987729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.987793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.987862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.987933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.987984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.987991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.988070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.988136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.988207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.988278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.988329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.988335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.988398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.988454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.988516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.988578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.988640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.988647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.988709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.988764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.988827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.988883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.988928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.988937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.988997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:58.989051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:58.989106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:58.989164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:58.989205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:58.989211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:58.989273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:58.989280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:58.989283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:58.989285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:58.989297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256387846146115:11234]
2025-10-01T14:13:58.989304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256387846146115:11234]
2025-10-01T14:13:58.989307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256387846146115:11234]
2025-10-01T14:13:58.989363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:58.989369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:58.989372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:58.989386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-10-01T14:13:58.989451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:58.989470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:58.989477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (50)
2025-10-01T14:13:58.989495Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989504Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989508Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989512Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989519Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 39. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989523Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989527Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989531Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989535Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989539Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 40. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989836Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989845Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989848Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989853Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989856Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 41. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989860Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989864Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989868Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989871Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.989874Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 42. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990117Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990126Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990129Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990132Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990135Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 43. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990138Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990141Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990144Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990147Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990150Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 44. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990271Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990279Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990283Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990287Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990290Z node 2 :PERSQUEUE WARN: partition_write.cpp:1212: [72075186224037892][Partition][0][StateIdle] Already written message. Topic: 'rt3.dc1--test-topic' Partition: 0 SourceId: '\0src_id'. Message seqNo: 45. Committed seqNo: 45. Writing seqNo: (NULL). EndOffset: 45. CurOffset: 45. Offset: 45
2025-10-01T14:13:58.990311Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-10-01T14:13:58.990326Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 1
2025-10-01T14:13:58.990330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 2
2025-10-01T14:13:58.990333Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 3
2025-10-01T14:13:58.990337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 4
2025-10-01T14:13:58.990701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 2253230 count 1 nextOffset 46 batches 5
2025-10-01T14:13:58.990726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-10-01T14:13:58.990735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 1
2025-10-01T14:13:58.990739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 2
2025-10-01T14:13:58.990742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 3
2025-10-01T14:13:58.990749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 4
2025-10-01T14:13:58.991230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 4506428 count 2 nextOffset 47 batches 9
2025-10-01T14:13:58.991250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-10-01T14:13:58.991254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 1
2025-10-01T14:13:58.991257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 2
2025-10-01T14:13:58.991261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 3
2025-10-01T14:13:58.991269Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 4
2025-10-01T14:13:58.991734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 4 FormedBlobsCount 0 NewHead: Offset 45 PartNo 0 PackedSize 6759626 count 3 nextOffset 48 batches 13
2025-10-01T14:13:58.991752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:58.991842Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 45,3 HeadOffset 45 endOffset 45 curOffset 48 d0000000000_00000000000000000045_00000_0000000003_00012? size 6759616 WTime 1759328038991
2025-10-01T14:13:58.992618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:58.992632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:58.992636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:58.992759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:59.001671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256394518014384:11539]
2025-10-01T14:13:59.001950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2108, pipe: [1:7556256394518014384:11539]
2025-10-01T14:13:59.151591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:59.152992Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:13:59.153311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:59.153034Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 45 partNo 0 count 3 size 6759616
2025-10-01T14:13:59.153372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:59.153053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518014384:11539], now have 1 active actors on pipe
2025-10-01T14:13:59.153074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:59.153076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:59.153094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256387846146115:11234]
2025-10-01T14:13:59.153417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2109 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0
2025-10-01T14:13:59.153191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:59.153243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:59.153612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2109 sessionId: src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0 is DEAD
2025-10-01T14:13:59.153773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:13:59.153789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0] Write session will restart in 0.007786s
2025-10-01T14:13:59.153815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0] Write session: Do CDS request
2025-10-01T14:13:59.153821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:59.153776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256394518014384:11539]
2025-10-01T14:13:59.162879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.162986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:59.163003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2110
2025-10-01T14:13:59.163136Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.163167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:59.163172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:59.163177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:59.163645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2110 sessionId:  describe result for acl check
2025-10-01T14:13:59.163684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:59.163690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:59.163692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:59.163698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256394518014449:11588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:59.164229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256394518014449:11588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:59.167215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256394518014449:11588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:59.180271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:59.180436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256394518014449:11588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:59.180456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256394518014449:11588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:59.180459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256394518014449:11588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:59.180468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:59.182833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:59.183197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:59.183209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:59.183220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:59.183268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:59.183306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256392141113620:11238]
2025-10-01T14:13:59.183906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:59.184177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:59.184210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:59.184490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:59.184534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.184539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.184540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.184541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.184542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.184544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.184544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.184545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.184546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.184547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.184548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.184550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.184551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.184551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.184555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.184565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.184568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.184572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.184575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.184578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.184581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.184584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.184597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.184601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.184604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.184607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.184611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.184614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.184621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.184628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.184633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.184637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.184641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.184646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.184650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.184654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.184659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.184663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.184667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.184671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.184675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.184680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.184684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.184688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.184693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.184697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.184701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.184705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.184709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.184713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.184717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.184721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.184725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.184730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.184733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.184737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.184776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:59.188414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:59.189104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:59.189117Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:59.189120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:59.189124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:59.189130Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2109 [2:7556256392141113620:11238]
2025-10-01T14:13:59.189147Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:59.189164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:59.189167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:59.189170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:59.189173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:59.189187Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:59.189197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:59.189203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:59.189259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.189266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.189268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.189271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:59.189274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:59.189338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:59.189345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.189355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.189370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.189388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:59.189410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518014411:2446], now have 1 active actors on pipe
2025-10-01T14:13:59.189416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518014597:11588], now have 1 active actors on pipe
2025-10-01T14:13:59.189423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256392141113614:11238]
2025-10-01T14:13:59.189425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256392141113614:11238]
2025-10-01T14:13:59.189428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256392141113614:11238]
2025-10-01T14:13:59.189439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:59.189456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:59.189456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:59.189459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:59.189461Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:59.189473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:59.189476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:59.189478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2109
2025-10-01T14:13:59.189503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256392141113614:11238]
2025-10-01T14:13:59.189480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2109
2025-10-01T14:13:59.189511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:59.189513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:59.189536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.189541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.189574Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6670aeae-45924370-87d6e8ac-1024902f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:59.189584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:59.189588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:59.189594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:59.189603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:59.189615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:59.189634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:59.189757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.189763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.189775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:59.189869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2110 partition: 0 MaxSeqNo: 45 sessionId: src_id|6670aeae-45924370-87d6e8ac-1024902f_0
2025-10-01T14:13:59.190287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d82e2b-27f68535-3c0d6696-8abe97c7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6670aeae-45924370-87d6e8ac-1024902f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:59.193255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6670aeae-45924370-87d6e8ac-1024902f_0] Write session: try to update token
2025-10-01T14:13:59.193274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6670aeae-45924370-87d6e8ac-1024902f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:59.207746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2110 sessionId: src_id|6670aeae-45924370-87d6e8ac-1024902f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:59.210254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:59.210361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:59.210405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:59.210408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:59.210410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:59.210419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256392141113614:11238]
2025-10-01T14:13:59.210423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256392141113614:11238]
2025-10-01T14:13:59.210426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256392141113614:11238]
2025-10-01T14:13:59.210454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:59.210458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:59.210461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:59.210468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.210476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.210495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:59.210508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.210511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:59.210633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:59.254089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256394518014611:11539]
2025-10-01T14:13:59.254358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2109, pipe: [1:7556256394518014611:11539]
2025-10-01T14:13:59.351050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:59.351412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518014611:11539], now have 1 active actors on pipe
2025-10-01T14:13:59.351567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:59.351657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256394518014611:11539]
2025-10-01T14:13:59.351663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:59.351666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:59.351700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:59.351716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2110 reason: error at write: Disconnected sessionId: src_id|6670aeae-45924370-87d6e8ac-1024902f_0
2025-10-01T14:13:59.351890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2110 sessionId: src_id|6670aeae-45924370-87d6e8ac-1024902f_0 is DEAD
2025-10-01T14:13:59.352014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670aeae-45924370-87d6e8ac-1024902f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:59.352023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670aeae-45924370-87d6e8ac-1024902f_0] Write session will restart in 0.006992s
2025-10-01T14:13:59.352041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670aeae-45924370-87d6e8ac-1024902f_0] Write session: Do CDS request
2025-10-01T14:13:59.352046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670aeae-45924370-87d6e8ac-1024902f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:59.359875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6670aeae-45924370-87d6e8ac-1024902f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.359924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:59.359946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2111
2025-10-01T14:13:59.360078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.360117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:59.360126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:59.360129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:59.360539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2111 sessionId:  describe result for acl check
2025-10-01T14:13:59.360576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:59.360581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:59.360582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:59.360632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256394518014707:11592] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:59.361119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256394518014707:11592] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:59.362901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256394518014707:11592] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:59.363333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:59.365671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:59.365820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:59.365829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:59.365838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:59.365870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:59.365904Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256392141113842:11251]
2025-10-01T14:13:59.365971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256394518014707:11592] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:59.365982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256394518014707:11592] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:59.365984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256394518014707:11592] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:59.365989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:59.366505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:59.366769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:59.366800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:59.367085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:59.367130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.367136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.367136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.367137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.367138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.367139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.367140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.367141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.367142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.367143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.367144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.367145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.367146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.367147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.367151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.367159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.367163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.367166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.367170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.367173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.367177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.367180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.367183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.367186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.367190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.367193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.367196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.367199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.367204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.367210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.367217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.367222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.367225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.367229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.367233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.367238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.367242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.367247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.367250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.367260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.367264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.367269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.367272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.367280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.367284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.367288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.367292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.367296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.367304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.367308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.367312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.367316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.367321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.367325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.367329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.367333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.367366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:59.370693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:59.371304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:59.371320Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:59.371323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:59.371326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:59.371332Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2110 [2:7556256392141113842:11251]
2025-10-01T14:13:59.371346Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:59.371360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:59.371363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:59.371366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:59.371368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:59.371382Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:59.371387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:59.371392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:59.371441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.371451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.371453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.371455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:59.371458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:59.371519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:59.371525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.371535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.371545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.371564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:59.371583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256392141113837:11251]
2025-10-01T14:13:59.371589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256392141113837:11251]
2025-10-01T14:13:59.371591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256392141113837:11251]
2025-10-01T14:13:59.371601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:59.371609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:59.371612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:59.371613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:59.371617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:59.371630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:59.371636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:59.371645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518014803:11592], now have 1 active actors on pipe
2025-10-01T14:13:59.371653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518014615:2446], now have 1 active actors on pipe
2025-10-01T14:13:59.371673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256392141113837:11251]
2025-10-01T14:13:59.371684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:59.371706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:59.371723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2110
2025-10-01T14:13:59.371729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2110
2025-10-01T14:13:59.371808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.371818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.371842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:59.371852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:59.371860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:59.371862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:59.371871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:59.371883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:59.371897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:59.372083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.372089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.372101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:59.372183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2111 partition: 0 MaxSeqNo: 45 sessionId: src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0
2025-10-01T14:13:59.372534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6670aeae-45924370-87d6e8ac-1024902f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:59.375210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0] Write session: try to update token
2025-10-01T14:13:59.375224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:59.387630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2111 sessionId: src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:59.389991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:59.391362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.391387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.391408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:59.391411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:59.391413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:59.391415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:59.391423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256392141113837:11251]
2025-10-01T14:13:59.391428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256392141113837:11251]
2025-10-01T14:13:59.391432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256392141113837:11251]
2025-10-01T14:13:59.391473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:59.391481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:59.391484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:59.391487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:59.391493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.391495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:59.391641Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:59.451693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256394518014814:11539]
2025-10-01T14:13:59.451969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2110, pipe: [1:7556256394518014814:11539]
2025-10-01T14:13:59.550245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:59.550640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:59.550690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518014814:11539], now have 1 active actors on pipe
2025-10-01T14:13:59.550762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:59.550879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256394518014814:11539]
2025-10-01T14:13:59.550925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:59.560915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:59.560927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:59.560944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2111 reason: error at write: Disconnected sessionId: src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0
2025-10-01T14:13:59.561089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2111 sessionId: src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0 is DEAD
2025-10-01T14:13:59.561235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:59.561245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0] Write session will restart in 0.009596s
2025-10-01T14:13:59.561271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0] Write session: Do CDS request
2025-10-01T14:13:59.561278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:59.568499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:59.570336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:59.570506Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:59.570517Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:59.570527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:59.570561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:59.570596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256392141114049:11254]
2025-10-01T14:13:59.571187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:59.571395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:59.571425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:59.571695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:59.571735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.571741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.571742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.571743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.571744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.571745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.571746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.571747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.571748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.571748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.571749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.571750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.571751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.571752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.571756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.571764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.571768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.571771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.571774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.571778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.571781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.571784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.571788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.571791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.571798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.571802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.571809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.571812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.571821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.571828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.571833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.571837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.571846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.571854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.571858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.571861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.571866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.571873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.571878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.571885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.571889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.571896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.571900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.571907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.571912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.571918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.571923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.571908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:59.571930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.571923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2112
2025-10-01T14:13:59.571935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.571938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.571943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.571946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.571950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.571955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.571962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.571970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.571977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.572011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:59.572033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.572056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:59.572063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:59.572066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:59.572367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2112 sessionId:  describe result for acl check
2025-10-01T14:13:59.572401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:59.572407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:59.572408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:59.572415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256394518014987:11597] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:59.573033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256394518014987:11597] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:59.575144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256394518014987:11597] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:59.575402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:59.576277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:59.576295Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:59.576297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:59.576300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:59.576305Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2111 [2:7556256392141114049:11254]
2025-10-01T14:13:59.576317Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:59.576330Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:59.576333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:59.576336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:59.576340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:59.576352Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:59.576362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:59.576366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:59.576414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.576420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.576421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.576424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:59.576427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:59.576486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:59.576494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.576504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.576518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.576533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:59.576549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518014822:2446], now have 1 active actors on pipe
2025-10-01T14:13:59.576555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256392141114044:11254]
2025-10-01T14:13:59.576561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256392141114044:11254]
2025-10-01T14:13:59.576562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256392141114044:11254]
2025-10-01T14:13:59.576576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:59.576603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:59.576610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:59.576613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:59.576616Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:59.576594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2111
2025-10-01T14:13:59.576618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:59.576620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:59.576640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256392141114044:11254]
2025-10-01T14:13:59.576642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:59.576650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:59.577072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256394518014987:11597] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:59.577083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256394518014987:11597] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:59.577086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256394518014987:11597] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:59.577093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:59.577248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518015023:11597], now have 1 active actors on pipe
2025-10-01T14:13:59.577278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2111
2025-10-01T14:13:59.577321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.577328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.577347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:59.577358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:59.577362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:59.577364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:59.577371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:59.577383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:59.577400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:59.577571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.577579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.577590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:59.577648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2112 partition: 0 MaxSeqNo: 45 sessionId: src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0
2025-10-01T14:13:59.577945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b399f94-c6908a5-bf58813e-52fe9c1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:59.580826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0] Write session: try to update token
2025-10-01T14:13:59.580843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:59.593959Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2112 sessionId: src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:59.596157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:59.598449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.598472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.600657Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:59.600673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:59.600676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:59.600678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:59.600685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256392141114044:11254]
2025-10-01T14:13:59.600690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256392141114044:11254]
2025-10-01T14:13:59.600694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256392141114044:11254]
2025-10-01T14:13:59.600737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:59.600749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:59.600758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:59.600763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:59.600764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.600766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:59.600767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:59.600849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:59.600894Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:59.650856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256394518015028:11539]
2025-10-01T14:13:59.651107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2111, pipe: [1:7556256394518015028:11539]
2025-10-01T14:13:59.746044Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:59.753270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.753297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.753436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.753488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.753541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.753592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.753635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.753643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.753698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.753750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.753805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.753879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.753920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.753925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.753974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.754018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.754069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.754116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.754154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.754159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.754208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.754383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.754433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.754480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.754516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.754522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.754575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.754621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.754671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.754718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.754756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.754761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.754829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.754886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.754947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.755007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.755050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.755056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.755119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.755176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.755241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.755305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.755350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.755357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.755424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.755481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.755542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.755607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.755651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.755656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.755722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.755780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.755844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.755903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.755947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.755951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.756017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.756074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.756136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.756197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.756248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.756254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.756294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518015028:11539], now have 1 active actors on pipe
2025-10-01T14:13:59.756555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256394518015028:11539]
2025-10-01T14:13:59.756571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:59.756575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:59.756595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:59.756611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2112 reason: error at write: Disconnected sessionId: src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0
2025-10-01T14:13:59.756836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2112 sessionId: src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0 is DEAD
2025-10-01T14:13:59.757013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:59.757022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0] Write session will restart in 0.005238s
2025-10-01T14:13:59.757042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0] Write session: Do CDS request
2025-10-01T14:13:59.757046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:59.757099Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:59.763812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.763870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:59.763886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2113
2025-10-01T14:13:59.763996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.764026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:59.764034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:59.764038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:59.764406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2113 sessionId:  describe result for acl check
2025-10-01T14:13:59.764433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:59.764440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:59.764442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:59.764446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256394518015085:11602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:59.764930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256394518015085:11602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:59.767216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256394518015085:11602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:59.769017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:59.771088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:59.771288Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:59.771301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:59.771313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:59.771365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:59.771403Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256392141114247:11257]
2025-10-01T14:13:59.771381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256394518015085:11602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:59.771395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256394518015085:11602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:59.771399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256394518015085:11602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:59.771406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:13:59.771962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:59.772232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:59.772279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:59.772553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:59.772616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.772625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.772626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.772626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.772627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.772628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.772629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.772630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.772631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.772632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.772633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.772634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.772635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.772637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.772641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.772650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.772653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.772656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.772659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.772662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.772665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.772669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.772672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.772675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.772678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.772681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.772684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.772688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.772695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.772702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.772708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.772713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.772717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.772722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.772726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.772730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.772734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.772738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.772741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.772745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.772749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.772753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.772756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.772761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.772765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.772768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.772772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.772776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.772780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.772784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.772787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.772791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.772795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.772800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.772803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.772807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.772842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:59.776431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:13:59.777054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:13:59.777076Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:13:59.777083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:13:59.777086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:13:59.777092Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2112 [2:7556256392141114247:11257]
2025-10-01T14:13:59.777106Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:13:59.777126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:13:59.777133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:59.777136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:59.777137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:59.777149Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:13:59.777152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:13:59.777157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:13:59.777194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.777200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.777201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.777203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:13:59.777205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:13:59.777251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:13:59.777256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.777263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.777270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.777288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:13:59.777306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518015235:11602], now have 1 active actors on pipe
2025-10-01T14:13:59.777318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256392141114242:11257]
2025-10-01T14:13:59.777320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256392141114242:11257]
2025-10-01T14:13:59.777322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256392141114242:11257]
2025-10-01T14:13:59.777334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:13:59.777346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518015043:2446], now have 1 active actors on pipe
2025-10-01T14:13:59.777352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:13:59.777354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:13:59.777355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:13:59.777357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:13:59.777366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:13:59.777368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:13:59.777392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256392141114242:11257]
2025-10-01T14:13:59.777402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:13:59.777408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:13:59.777507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.777516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.777403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2112
2025-10-01T14:13:59.777408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2112
2025-10-01T14:13:59.777537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2f6f746-30986cee-e74ed099-7633004d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:13:59.777547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:13:59.777550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:13:59.777552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:13:59.777558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:13:59.777565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:13:59.777576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:59.777741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.777753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.777774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:13:59.777848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2113 partition: 0 MaxSeqNo: 45 sessionId: src_id|b2f6f746-30986cee-e74ed099-7633004d_0
2025-10-01T14:13:59.778203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|891b4770-c1d097fe-d3e343fb-e40796d0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b2f6f746-30986cee-e74ed099-7633004d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:13:59.781075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6f746-30986cee-e74ed099-7633004d_0] Write session: try to update token
2025-10-01T14:13:59.781093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6f746-30986cee-e74ed099-7633004d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:13:59.796829Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:13:59.796850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:59.796858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256392141114242:11257]
2025-10-01T14:13:59.796899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:13:59.796910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:13:59.797062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:13:59.797202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:59.797344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:59.797490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:13:59.797675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:13:59.797722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:13:59.796365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2113 sessionId: src_id|b2f6f746-30986cee-e74ed099-7633004d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:13:59.799097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:13:59.799279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.799299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.799347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:13:59.799425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:13:59.808120Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:13:59.808140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:13:59.808142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:13:59.808144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:13:59.808154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256392141114242:11257]
2025-10-01T14:13:59.808158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256392141114242:11257]
2025-10-01T14:13:59.808162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256392141114242:11257]
2025-10-01T14:13:59.808208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:13:59.808220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.808223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:13:59.808337Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:13:59.810520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:13:59.810538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:13:59.810542Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:13:59.856679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256394518015247:11539]
2025-10-01T14:13:59.856968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2112, pipe: [1:7556256394518015247:11539]
2025-10-01T14:13:59.971431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:13:59.979382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:13:59.979408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:13:59.979560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.979617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.979679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.979742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.979784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.979793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.979855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.979914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.979973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.980036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.980082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.980090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.980158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.980218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.980328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.980388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.980431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.980439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.980563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.980634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.980697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.980756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.980796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.980804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.980864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.980929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.980987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.981047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.981152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.981160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.981222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.981278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.981337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.981399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.981440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.981448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.981510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.981577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.981638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.981697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.981739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.981746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.981808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.981864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.981939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.981999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.982042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.982049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.982113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.982170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.982230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.982290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.982332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.982339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.982419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:13:59.982474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:13:59.982529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:13:59.982585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:13:59.982624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:13:59.982632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:13:59.982688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518015247:11539], now have 1 active actors on pipe
2025-10-01T14:13:59.982924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:13:59.982938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256394518015247:11539]
2025-10-01T14:13:59.982969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:13:59.982972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:13:59.982996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2113 reason: error at write: Disconnected sessionId: src_id|b2f6f746-30986cee-e74ed099-7633004d_0
2025-10-01T14:13:59.983229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2113 sessionId: src_id|b2f6f746-30986cee-e74ed099-7633004d_0 is DEAD
2025-10-01T14:13:59.983342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6f746-30986cee-e74ed099-7633004d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:13:59.983351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6f746-30986cee-e74ed099-7633004d_0] Write session will restart in 0.009284s
2025-10-01T14:13:59.983368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6f746-30986cee-e74ed099-7633004d_0] Write session: Do CDS request
2025-10-01T14:13:59.983373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6f746-30986cee-e74ed099-7633004d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:13:59.983723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:13:59.993879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6f746-30986cee-e74ed099-7633004d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.993955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:13:59.993971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2114
2025-10-01T14:13:59.994090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:13:59.994119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:13:59.994127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:13:59.994131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:13:59.994528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2114 sessionId:  describe result for acl check
2025-10-01T14:13:59.994561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:13:59.994566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:13:59.994569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:13:59.994573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256394518015413:11607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:13:59.995047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256394518015413:11607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:13:59.995267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:13:59.996907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256394518015413:11607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:13:59.997204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:13:59.997372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:13:59.997381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:13:59.997389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:13:59.997440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:13:59.997465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256392141114446:11259]
2025-10-01T14:13:59.997994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:13:59.998215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:13:59.998259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:13:59.998496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:13:59.998533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.998537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.998538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.998539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.998540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.998540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.998541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.998542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.998542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.998543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.998543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.998544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.998545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.998545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.998549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.998554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.998556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.998558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.998560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.998563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.998565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.998567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.998569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.998571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.998573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.998575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.998577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.998579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.998584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.998588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:13:59.998592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.998595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:13:59.998597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.998600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:13:59.998603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.998605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:13:59.998608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.998618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:13:59.998620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.998623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:13:59.998625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.998628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:13:59.998630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.998633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:13:59.998636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.998639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:13:59.998641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.998645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:13:59.998647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.998649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:13:59.998651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.998654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:13:59.998657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.998660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:13:59.998662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.998665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:13:59.998684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:13:59.999075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256394518015413:11607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:13:59.999087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256394518015413:11607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:13:59.999090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256394518015413:11607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:13:59.999095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:00.002345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:00.003078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:00.003092Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:00.003094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:00.003097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:00.003103Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2113 [2:7556256392141114446:11259]
2025-10-01T14:14:00.003118Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:00.003138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:00.003141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.003145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.003147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.003162Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:00.003172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:00.003178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:00.003233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.003239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.003241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.003244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:00.003247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:00.003305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:00.003311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.003323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.003334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.003353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:00.003373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518015255:2446], now have 1 active actors on pipe
2025-10-01T14:14:00.003380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256394518015449:11607], now have 1 active actors on pipe
2025-10-01T14:14:00.003387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256392141114441:11259]
2025-10-01T14:14:00.003393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256392141114441:11259]
2025-10-01T14:14:00.003395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256392141114441:11259]
2025-10-01T14:14:00.003391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2113
2025-10-01T14:14:00.003407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:00.003409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2113
2025-10-01T14:14:00.003410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:00.003412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:00.003413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:00.003422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:00.003435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:00.003441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:00.003478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.003487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.003498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256392141114441:11259]
2025-10-01T14:14:00.003508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:00.003515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:00.003532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:00.003541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.003545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.003547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:00.003557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.003569Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:00.003591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.003737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.003747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.003762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.003817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2114 partition: 0 MaxSeqNo: 45 sessionId: src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0
2025-10-01T14:14:00.004186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f6f746-30986cee-e74ed099-7633004d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:00.006986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0] Write session: try to update token
2025-10-01T14:14:00.007003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:00.020967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2114 sessionId: src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:00.023253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:00.024352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.024377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.024394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:00.024397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:00.024398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:00.024399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:00.024407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256392141114441:11259]
2025-10-01T14:14:00.024411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256392141114441:11259]
2025-10-01T14:14:00.024413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256392141114441:11259]
2025-10-01T14:14:00.024458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:00.024462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:00.024467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.024468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:00.024469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:00.024472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:00.024607Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:00.082980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256398812982767:11539]
2025-10-01T14:14:00.083237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2113, pipe: [1:7556256398812982767:11539]
2025-10-01T14:14:00.161804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:00.162230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:00.162279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812982767:11539], now have 1 active actors on pipe
2025-10-01T14:14:00.162358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:00.162509Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:00.162561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256398812982767:11539]
2025-10-01T14:14:00.172672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:00.172686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:00.172708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2114 reason: error at write: Disconnected sessionId: src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0
2025-10-01T14:14:00.172851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2114 sessionId: src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0 is DEAD
2025-10-01T14:14:00.172976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:00.172984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0] Write session will restart in 0.005993s
2025-10-01T14:14:00.173001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0] Write session: Do CDS request
2025-10-01T14:14:00.173008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:00.179084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:00.179886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:00.180324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:00.180340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2115
2025-10-01T14:14:00.180456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:00.180485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:00.180497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:00.180500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:00.180814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2115 sessionId:  describe result for acl check
2025-10-01T14:14:00.180844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:00.180845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:00.180846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:00.180850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256398812982941:11618] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:00.181228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256398812982941:11618] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:00.181988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:00.182195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:00.182206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:00.182218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:00.182276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:00.182318Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256396436081949:11264]
2025-10-01T14:14:00.182878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:00.183154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256398812982941:11618] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:00.183219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:00.183301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:00.183633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:00.183682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.183689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.183689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.183690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.183691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.183692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.183693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.183694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.183695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.183696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.183697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.183697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.183698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.183699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.183703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.183710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.183713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.183715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.183718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.183722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.183727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.183731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.183735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.183739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.183743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.183747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.183750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.183754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.183763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.183771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.183777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.183783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.183788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.183794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.183797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.183801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.183804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.183808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.183812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.183818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.183823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.183828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.183832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.183838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.183843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.183849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.183854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.183859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.183864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.183870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.183874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.183879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.183885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.183890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.183896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.183909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.183951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:00.187518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256398812982941:11618] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:00.187536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256398812982941:11618] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:00.187539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256398812982941:11618] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:00.187547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:00.187754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:00.188381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:00.188399Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:00.188401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:00.188404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:00.188409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2114 [2:7556256396436081949:11264]
2025-10-01T14:14:00.188421Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:00.188440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:00.188447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.188449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.188450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.188465Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:00.188478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:00.188485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:00.188535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.188542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.188543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.188546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:00.188548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:00.188608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:00.188617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.188627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.188637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.188661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:00.188678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812982976:11618], now have 1 active actors on pipe
2025-10-01T14:14:00.188681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812982780:2446], now have 1 active actors on pipe
2025-10-01T14:14:00.188688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256396436081944:11264]
2025-10-01T14:14:00.188690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256396436081944:11264]
2025-10-01T14:14:00.188693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256396436081944:11264]
2025-10-01T14:14:00.188705Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:00.188722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:00.188724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:00.188725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:00.188727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:00.188732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:00.188729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2114
2025-10-01T14:14:00.188735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:00.188731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2114
2025-10-01T14:14:00.188759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256396436081944:11264]
2025-10-01T14:14:00.188761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:00.188763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:00.188775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.188778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.188813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35df7648-d071863d-eaf696f-1aceb335_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:00.188817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.188820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.188822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:00.188829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.188837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:00.188856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.188986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.188994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.189006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.189080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2115 partition: 0 MaxSeqNo: 45 sessionId: src_id|35df7648-d071863d-eaf696f-1aceb335_0
2025-10-01T14:14:00.189397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fd50a50-550dcfd5-e30649e1-44c046db_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|35df7648-d071863d-eaf696f-1aceb335_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:00.192196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35df7648-d071863d-eaf696f-1aceb335_0] Write session: try to update token
2025-10-01T14:14:00.192212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35df7648-d071863d-eaf696f-1aceb335_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:00.205171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2115 sessionId: src_id|35df7648-d071863d-eaf696f-1aceb335_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:00.207585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:00.208008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.208035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.210023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:00.210041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:00.210043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:00.210046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:00.210054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256396436081944:11264]
2025-10-01T14:14:00.210059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256396436081944:11264]
2025-10-01T14:14:00.210063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256396436081944:11264]
2025-10-01T14:14:00.210101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:00.210110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:00.210111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:00.210114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:00.210130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:00.210135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.210137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:00.210211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:00.210384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:00.262715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256398812982986:11539]
2025-10-01T14:14:00.263010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2114, pipe: [1:7556256398812982986:11539]
2025-10-01T14:14:00.365662Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:00.373666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.373697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.373871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.373926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.373987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.374051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.374093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.374098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.374170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.374229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.374292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.374360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.374511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.374521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.374584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.374636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.374690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.374743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.374780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.374783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.374839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.374917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.374973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.375051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.375089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.375092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.375150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.375202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.375254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.375317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.375361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.375364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.375448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.375518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.375594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.375660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.375705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.375709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.375780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.375847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.375916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.375984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.376096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.376099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.376178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.376244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.376313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.376383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.376428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.376431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.376527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.376633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.376702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.376771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.376835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.376841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.376921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.376985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.377054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.377123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.377168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.377171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.377247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812982986:11539], now have 1 active actors on pipe
2025-10-01T14:14:00.378509Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:00.378508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:00.378570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:00.378573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:00.378607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2115 reason: error at write: Disconnected sessionId: src_id|35df7648-d071863d-eaf696f-1aceb335_0
2025-10-01T14:14:00.378796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2115 sessionId: src_id|35df7648-d071863d-eaf696f-1aceb335_0 is DEAD
2025-10-01T14:14:00.378968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256398812982986:11539]
2025-10-01T14:14:00.381602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35df7648-d071863d-eaf696f-1aceb335_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:00.381609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35df7648-d071863d-eaf696f-1aceb335_0] Write session will restart in 0.007225s
2025-10-01T14:14:00.381633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35df7648-d071863d-eaf696f-1aceb335_0] Write session: Do CDS request
2025-10-01T14:14:00.381639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35df7648-d071863d-eaf696f-1aceb335_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:00.389865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35df7648-d071863d-eaf696f-1aceb335_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:00.390996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:00.391017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2116
2025-10-01T14:14:00.391147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:00.391175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:00.391180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:00.391184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:00.391704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2116 sessionId:  describe result for acl check
2025-10-01T14:14:00.391730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:00.391732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:00.391736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:00.391740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256398812983007:11622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:00.392213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256398812983007:11622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:00.397576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256398812983007:11622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:00.404244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256398812983007:11622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:00.404264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256398812983007:11622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:00.404268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256398812983007:11622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:00.404277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:00.414458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:00.414643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:00.414798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:00.414807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:00.414815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:00.414844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:00.414875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256396436082190:11276]
2025-10-01T14:14:00.415277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:00.415623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:00.415661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:00.415875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:00.415915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.415920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.415921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.415921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.415922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.415923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.415924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.415925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.415926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.415927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.415928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.415928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.415929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.415930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.415933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.415940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.415942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.415944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.415947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.415949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.415951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.415954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.415956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.415959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.415961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.415963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.415965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.415968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.415974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.415978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.415982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.415986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.415990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.415994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.415996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.416000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.416003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.416006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.416009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.416011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.416014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.416018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.416020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.416023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.416026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.416029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.416032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.416036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.416041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.416045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.416049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.416054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.416059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.416063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.416066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.416070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.416106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:00.420716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:00.421642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:00.421649Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:00.421652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:00.421656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:00.421664Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2115 [2:7556256396436082190:11276]
2025-10-01T14:14:00.421681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:00.421699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:00.421702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.421706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.421709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.421726Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:00.421732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:00.421740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:00.421805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.421808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.421810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.421813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:00.421816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:00.421883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:00.421898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.421909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.421918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.421933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:00.421953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256396436082185:11276]
2025-10-01T14:14:00.421960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256396436082185:11276]
2025-10-01T14:14:00.421963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256396436082185:11276]
2025-10-01T14:14:00.421975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:00.421990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:00.422022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:00.422030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:00.422069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256396436082185:11276]
2025-10-01T14:14:00.422078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:00.422161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:00.422172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:00.422174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:00.422178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:00.422636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812982992:2446], now have 1 active actors on pipe
2025-10-01T14:14:00.422653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812983164:11622], now have 1 active actors on pipe
2025-10-01T14:14:00.422749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2115
2025-10-01T14:14:00.422794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2115
2025-10-01T14:14:00.423013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.423029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.423062Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:00.423071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.423076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.423079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:00.423090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.423104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:00.423124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.423510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.423521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.423539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.423652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2116 partition: 0 MaxSeqNo: 45 sessionId: src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0
2025-10-01T14:14:00.424656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35df7648-d071863d-eaf696f-1aceb335_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:00.427639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0] Write session: try to update token
2025-10-01T14:14:00.427657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:00.445807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2116 sessionId: src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:00.448387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:00.448394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:00.448412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:00.448415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:00.448417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:00.448426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256396436082185:11276]
2025-10-01T14:14:00.448431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256396436082185:11276]
2025-10-01T14:14:00.448435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256396436082185:11276]
2025-10-01T14:14:00.448483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:00.448487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:00.448488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:00.448495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.448497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:00.448502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:00.448656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:00.482438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256398812983197:11539]
2025-10-01T14:14:00.483053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2115, pipe: [1:7556256398812983197:11539]
2025-10-01T14:14:00.598298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:00.598573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.598588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.598623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812983197:11539], now have 1 active actors on pipe
2025-10-01T14:14:00.598805Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:00.598989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256398812983197:11539]
2025-10-01T14:14:00.599014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:00.599043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:00.599106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2116 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0
2025-10-01T14:14:00.599306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2116 sessionId: src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0 is DEAD
2025-10-01T14:14:00.599489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:00.599499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0] Write session will restart in 0.007797s
2025-10-01T14:14:00.599526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0] Write session: Do CDS request
2025-10-01T14:14:00.599533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:00.608999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:00.609110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:00.609130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2117
2025-10-01T14:14:00.609317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:00.609359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:00.609368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:00.609372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:00.609733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2117 sessionId:  describe result for acl check
2025-10-01T14:14:00.609792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:00.609799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:00.609801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:00.609806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256398812983279:11627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:00.610340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256398812983279:11627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:00.613199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256398812983279:11627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:00.615671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256398812983279:11627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:00.615688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256398812983279:11627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:00.615691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256398812983279:11627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:00.615699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:00.615849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:00.618183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:00.618405Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:00.618416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:00.618430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:00.618492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:00.618534Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256396436082390:11279]
2025-10-01T14:14:00.619269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:00.619578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:00.619631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:00.619945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:00.620056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.620065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.620066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.620067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.620068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.620070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.620071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.620072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.620074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.620075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.620076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.620078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.620079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.620080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.620085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.620096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.620100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.620104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.620108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.620112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.620117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.620120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.620124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.620128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.620132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.620136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.620140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.620145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.620155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.620163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.620170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.620177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.620181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.620187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.620192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.620198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.620203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.620209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.620214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.620220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.620231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.620240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.620249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.620255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.620264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.620270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.620279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.620285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.620294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.620299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.620307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.620313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.620322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.620326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.620335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.620340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.620381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:00.625724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2116
2025-10-01T14:14:00.625726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2116
2025-10-01T14:14:00.624325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:00.625358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:00.625363Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:00.625365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:00.625368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:00.625375Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2116 [2:7556256396436082390:11279]
2025-10-01T14:14:00.625388Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:00.625404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:00.625407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.625410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.625412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.625427Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:00.625434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:00.625439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:00.625491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.625493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.625495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.625498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:00.625501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:00.625567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:00.625570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.625580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.625589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.625603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:00.625618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256396436082384:11279]
2025-10-01T14:14:00.625620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256396436082384:11279]
2025-10-01T14:14:00.625621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256396436082384:11279]
2025-10-01T14:14:00.625629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:00.625638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:00.625642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812983404:11627], now have 1 active actors on pipe
2025-10-01T14:14:00.625642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:00.625645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812983208:2446], now have 1 active actors on pipe
2025-10-01T14:14:00.625645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:00.625651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:00.625675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:00.625678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:00.625707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256396436082384:11279]
2025-10-01T14:14:00.625715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:00.625736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:00.626083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.626098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.626128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:00.626152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.626161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.626163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:00.626175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.626190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:00.626210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.626421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.626430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.626445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.626534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2117 partition: 0 MaxSeqNo: 45 sessionId: src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0
2025-10-01T14:14:00.626924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea070bcc-a0a478f5-29c4583b-fdb95553_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:00.629753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0] Write session: try to update token
2025-10-01T14:14:00.629770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:00.637158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:00.637182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:00.637192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256396436082384:11279]
2025-10-01T14:14:00.637245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:00.637429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:00.637583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:00.637728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:00.637860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:00.638041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:00.638074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:00.638146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:00.646511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2117 sessionId: src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:00.649460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:00.649696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.649721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.649762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:00.649869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:00.662780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:00.662799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:00.662802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:00.662805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:00.662817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256396436082384:11279]
2025-10-01T14:14:00.662820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256396436082384:11279]
2025-10-01T14:14:00.662824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256396436082384:11279]
2025-10-01T14:14:00.662873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:00.662881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:00.662887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:00.662888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.662890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:00.662891Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:00.663019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:00.699188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256398812983429:11539]
2025-10-01T14:14:00.699579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2116, pipe: [1:7556256398812983429:11539]
2025-10-01T14:14:00.825939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:00.842333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:00.842349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:00.842353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:00.842393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2117 reason: error at write: Disconnected sessionId: src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0
2025-10-01T14:14:00.842409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256398812983429:11539]
2025-10-01T14:14:00.838833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.838869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.839052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.839113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.839180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.839241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.839281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.839286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.839355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.839411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.839476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.839539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.839581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.839585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.839649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.839707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.839771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.839831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.839877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.839880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.839945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.840003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.840062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.840119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.840160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.840163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.840229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.840283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.840385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.840443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.840482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.840486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.840556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.840632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.840693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.840750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.840795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.840798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.840863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.840920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.840980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.841035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.841103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.841106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.841168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.841224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.841278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.841334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.841380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.841383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.841445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.841499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.841555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.841614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.841652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.841655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.841718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:00.841771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:00.841831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:00.842623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2117 sessionId: src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0 is DEAD
2025-10-01T14:14:00.841889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:00.842004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:00.842008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:00.842096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812983429:11539], now have 1 active actors on pipe
2025-10-01T14:14:00.843312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:00.843327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0] Write session will restart in 0.008416s
2025-10-01T14:14:00.843357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0] Write session: Do CDS request
2025-10-01T14:14:00.843364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:00.843441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:00.853029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:00.853212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:00.853233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2118
2025-10-01T14:14:00.854760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:00.854836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:00.854849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:00.854856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:00.858980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2118 sessionId:  describe result for acl check
2025-10-01T14:14:00.859041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:00.859044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:00.859045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:00.859055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256398812983582:11632] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:00.859692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256398812983582:11632] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:00.861330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:00.863267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256398812983582:11632] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:00.863736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:00.864026Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:00.864038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:00.864050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:00.864108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:00.864151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256396436082594:11282]
2025-10-01T14:14:00.864768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:00.864999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:00.865040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:00.865329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:00.865379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.865386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.865387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.865388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.865389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.865390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.865391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.865392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.865394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.865396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.865397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.865398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.865399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.865400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.865406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.865415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.865419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.865423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.865427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.865430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.865434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.865438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.865441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.865446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.865449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.865453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.865457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.865460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.865467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.865474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:00.865480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.865486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:00.865491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.865496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:00.865501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.865506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:00.865521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.865531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:00.865535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.865540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:00.865545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.865549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:00.865559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.865564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:00.865572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.865577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:00.865586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.865592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.865600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.865604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.865609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.865614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.865622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.865627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:00.865632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.865640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:00.865681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:00.866038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256398812983582:11632] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:00.866054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256398812983582:11632] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:00.866058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256398812983582:11632] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:00.866067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:00.869564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:00.870168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:00.870183Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:00.870186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:00.870189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:00.870195Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2117 [2:7556256396436082594:11282]
2025-10-01T14:14:00.870207Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:00.870222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:00.870228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.870231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.870233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.870247Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:00.870254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:00.870259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:00.870305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.870310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.870312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.870314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:00.870316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:00.870415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:00.870423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.870434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:00.870450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:00.870467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:00.870484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812983432:2446], now have 1 active actors on pipe
2025-10-01T14:14:00.870491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812983634:11632], now have 1 active actors on pipe
2025-10-01T14:14:00.870497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256396436082589:11282]
2025-10-01T14:14:00.870499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256396436082589:11282]
2025-10-01T14:14:00.870501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256396436082589:11282]
2025-10-01T14:14:00.870513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:00.870527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:00.870529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:00.870535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:00.870537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:00.870543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:00.870546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:00.870541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2117
2025-10-01T14:14:00.870585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256396436082589:11282]
2025-10-01T14:14:00.870596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:00.870550Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2117
2025-10-01T14:14:00.870600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:00.870615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.870624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.870671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ad4b954-ede5ac21-600ac91-588ed375_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:00.870681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:00.870685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:00.870688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:00.870697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:00.870709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:00.870731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.870865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:00.870873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:00.870887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:00.870973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2118 partition: 0 MaxSeqNo: 45 sessionId: src_id|4ad4b954-ede5ac21-600ac91-588ed375_0
2025-10-01T14:14:00.871334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35fa1991-586f3ebc-6466beed-94efc5ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4ad4b954-ede5ac21-600ac91-588ed375_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:00.874296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad4b954-ede5ac21-600ac91-588ed375_0] Write session: try to update token
2025-10-01T14:14:00.874317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad4b954-ede5ac21-600ac91-588ed375_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:00.890644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2118 sessionId: src_id|4ad4b954-ede5ac21-600ac91-588ed375_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:00.891242Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:00.891261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:00.891263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:00.891265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:00.891271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256396436082589:11282]
2025-10-01T14:14:00.891275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256396436082589:11282]
2025-10-01T14:14:00.891278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256396436082589:11282]
2025-10-01T14:14:00.891319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:00.891321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:00.891323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:00.891326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:00.891326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:00.891328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:00.891448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:00.893098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:00.942674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256398812983643:11539]
2025-10-01T14:14:00.942995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2117, pipe: [1:7556256398812983643:11539]
2025-10-01T14:14:01.042786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:01.043543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.043563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.043608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256398812983643:11539], now have 1 active actors on pipe
2025-10-01T14:14:01.043821Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:01.043854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256398812983643:11539]
2025-10-01T14:14:01.043879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:01.043882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:01.043939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2118 reason: error at write: Disconnected sessionId: src_id|4ad4b954-ede5ac21-600ac91-588ed375_0
2025-10-01T14:14:01.044141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2118 sessionId: src_id|4ad4b954-ede5ac21-600ac91-588ed375_0 is DEAD
2025-10-01T14:14:01.043824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:01.044318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad4b954-ede5ac21-600ac91-588ed375_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:01.044331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad4b954-ede5ac21-600ac91-588ed375_0] Write session will restart in 0.007169s
2025-10-01T14:14:01.044363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad4b954-ede5ac21-600ac91-588ed375_0] Write session: Do CDS request
2025-10-01T14:14:01.044370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad4b954-ede5ac21-600ac91-588ed375_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:01.052929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad4b954-ede5ac21-600ac91-588ed375_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.052983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:01.053001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2119
2025-10-01T14:14:01.053159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.053193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:01.053204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:01.053207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:01.053608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2119 sessionId:  describe result for acl check
2025-10-01T14:14:01.053637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:01.053642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:01.053644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:01.053648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256403107951002:11637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:01.054126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256403107951002:11637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:01.056490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256403107951002:11637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:01.058118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:01.060290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:01.060519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:01.060533Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:01.060545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:01.060604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:01.060642Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256400731050092:11284]
2025-10-01T14:14:01.060673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256403107951002:11637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:01.060689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256403107951002:11637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:01.060692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256403107951002:11637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:01.060697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:01.061199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:01.061454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:01.061502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:01.061785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:01.061846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.061852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.061853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.061854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.061856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.061857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.061858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.061859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.061860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.061861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.061862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.061864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.061865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.061866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.061871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.061879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.061883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.061886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.061890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.061893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.061896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.061900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.061903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.061907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.061910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.061914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.061917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.061921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.061928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.061936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.061941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.061947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.061951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.061956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.061960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.061965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.061973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.061978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.061982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.061992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.061999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.062008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.062011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.062015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.062020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.062028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.062032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.062036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.062044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.062048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.062052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.062059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.062063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.062071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.062074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.062079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.062117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:01.065578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:01.066280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:01.066297Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:01.066299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:01.066303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:01.066309Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2118 [2:7556256400731050092:11284]
2025-10-01T14:14:01.066333Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:01.066350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:01.066357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.066361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.066363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.066395Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:01.066406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:01.066412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:01.066468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.066474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.066477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.066479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:01.066482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:01.066557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:01.066564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.066574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.066583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.066602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:01.066624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107950942:2446], now have 1 active actors on pipe
2025-10-01T14:14:01.066633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951141:11637], now have 1 active actors on pipe
2025-10-01T14:14:01.066640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256400731050087:11284]
2025-10-01T14:14:01.066646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256400731050087:11284]
2025-10-01T14:14:01.066650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256400731050087:11284]
2025-10-01T14:14:01.066664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:01.066673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:01.066675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:01.066677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:01.066682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:01.066694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:01.066701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:01.066694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2118
2025-10-01T14:14:01.066726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256400731050087:11284]
2025-10-01T14:14:01.066733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:01.066699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2118
2025-10-01T14:14:01.066736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:01.066753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.066760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.066802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9de7f862-be091fbc-2e6daba-1cc8747_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:01.066817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.066821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.066823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:01.066832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.066840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:01.066859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.067002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.067013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.067029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.067093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2119 partition: 0 MaxSeqNo: 45 sessionId: src_id|9de7f862-be091fbc-2e6daba-1cc8747_0
2025-10-01T14:14:01.067458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ad4b954-ede5ac21-600ac91-588ed375_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9de7f862-be091fbc-2e6daba-1cc8747_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:01.070172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7f862-be091fbc-2e6daba-1cc8747_0] Write session: try to update token
2025-10-01T14:14:01.070188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7f862-be091fbc-2e6daba-1cc8747_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:01.083772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2119 sessionId: src_id|9de7f862-be091fbc-2e6daba-1cc8747_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:01.085967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:01.086890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.086921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.086942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:01.086946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:01.086948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:01.086950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:01.086959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256400731050087:11284]
2025-10-01T14:14:01.086964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256400731050087:11284]
2025-10-01T14:14:01.086968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256400731050087:11284]
2025-10-01T14:14:01.087010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:01.087027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:01.087028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:01.087030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:01.087034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.087037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:01.087169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:01.143836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256403107951165:11539]
2025-10-01T14:14:01.144263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2118, pipe: [1:7556256403107951165:11539]
2025-10-01T14:14:01.235238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:01.235533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:01.235588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951165:11539], now have 1 active actors on pipe
2025-10-01T14:14:01.235672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:01.236116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256403107951165:11539]
2025-10-01T14:14:01.236150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:01.246995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:01.247012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:01.247031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2119 reason: error at write: Disconnected sessionId: src_id|9de7f862-be091fbc-2e6daba-1cc8747_0
2025-10-01T14:14:01.247169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2119 sessionId: src_id|9de7f862-be091fbc-2e6daba-1cc8747_0 is DEAD
2025-10-01T14:14:01.247534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7f862-be091fbc-2e6daba-1cc8747_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:01.247548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7f862-be091fbc-2e6daba-1cc8747_0] Write session will restart in 0.006949s
2025-10-01T14:14:01.247575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7f862-be091fbc-2e6daba-1cc8747_0] Write session: Do CDS request
2025-10-01T14:14:01.247585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7f862-be091fbc-2e6daba-1cc8747_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:01.259079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7f862-be091fbc-2e6daba-1cc8747_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.259228Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:01.259247Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2120
2025-10-01T14:14:01.259914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.259955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:01.259965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:01.259969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:01.260406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2120 sessionId:  describe result for acl check
2025-10-01T14:14:01.260439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:01.260447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:01.260448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:01.260453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256403107951342:11648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:01.260696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:01.260962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256403107951342:11648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:01.263531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:01.263751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:01.263762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:01.263774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:01.263825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:01.263869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256400731050304:11289]
2025-10-01T14:14:01.264486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:01.264877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:01.264956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:01.265088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256403107951342:11648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:01.265300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:01.265371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.265377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.265379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.265380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.265382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.265383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.265384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.265386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.265387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.265388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.265391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.265392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.265393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.265395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.265401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.265411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.265415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.265419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.265423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.265427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.265432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.265435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.265440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.265443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.265448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.265453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.265456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.265461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.265473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.265486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.265497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.265505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.265512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.265521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.265530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.265540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.265551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.265558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.265568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.265573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.265580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.265585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.265594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.265599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.265604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.265613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.265622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.265627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.265632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.265640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.265646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.265651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.265660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.265668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.265673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.265682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.265723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:01.269584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:01.269698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256403107951342:11648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:01.269715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256403107951342:11648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:01.269718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256403107951342:11648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:01.269727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:01.270510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:01.270524Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:01.270527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:01.270531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:01.270538Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2119 [2:7556256400731050304:11289]
2025-10-01T14:14:01.270554Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:01.270570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:01.270573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.270577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.270579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.270597Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:01.270607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:01.270613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:01.270671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.270678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.270680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.270684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:01.270686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:01.270754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:01.270763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.270776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.270791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.270814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:01.270831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951380:11648], now have 1 active actors on pipe
2025-10-01T14:14:01.270840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951177:2446], now have 1 active actors on pipe
2025-10-01T14:14:01.270847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256400731050299:11289]
2025-10-01T14:14:01.270850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256400731050299:11289]
2025-10-01T14:14:01.270852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256400731050299:11289]
2025-10-01T14:14:01.270867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:01.270865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2119
2025-10-01T14:14:01.270907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2119
2025-10-01T14:14:01.270879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:01.270881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:01.270889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:01.270892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:01.270896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:01.270899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:01.270941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256400731050299:11289]
2025-10-01T14:14:01.270950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:01.270965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.270970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.271003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:01.271025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:01.271038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.271041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.271050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:01.271060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.271073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:01.271094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.271312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.271323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.271354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.271452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2120 partition: 0 MaxSeqNo: 45 sessionId: src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0
2025-10-01T14:14:01.271902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9de7f862-be091fbc-2e6daba-1cc8747_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:01.274856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0] Write session: try to update token
2025-10-01T14:14:01.274876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:01.291961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:01.291987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:01.291989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:01.291992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:01.292001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256400731050299:11289]
2025-10-01T14:14:01.292006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256400731050299:11289]
2025-10-01T14:14:01.292010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256400731050299:11289]
2025-10-01T14:14:01.292055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:01.292061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:01.292070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:01.292070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.292073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:01.292074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:01.292213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:01.293744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2120 sessionId: src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:01.296400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:01.336355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256403107951388:11539]
2025-10-01T14:14:01.336626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2119, pipe: [1:7556256403107951388:11539]
2025-10-01T14:14:01.432280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:01.432772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.432786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.432821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951388:11539], now have 1 active actors on pipe
2025-10-01T14:14:01.433023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:01.433091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256403107951388:11539]
2025-10-01T14:14:01.433122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:01.433189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2120 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0
2025-10-01T14:14:01.433204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:01.433399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2120 sessionId: src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0 is DEAD
2025-10-01T14:14:01.433514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:01.433526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0] Write session will restart in 0.007647s
2025-10-01T14:14:01.433552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0] Write session: Do CDS request
2025-10-01T14:14:01.433558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:01.441968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.442101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:01.442125Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2121
2025-10-01T14:14:01.442267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.442316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:01.442330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:01.442335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:01.442909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2121 sessionId:  describe result for acl check
2025-10-01T14:14:01.442949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:01.442955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:01.442957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:01.442962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256403107951421:11652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:01.443434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256403107951421:11652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:01.445742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256403107951421:11652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:01.448820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256403107951421:11652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:01.448839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256403107951421:11652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:01.448843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256403107951421:11652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:01.448851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:01.449596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:01.451957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:01.452139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:01.452147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:01.452155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:01.452191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:01.452221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256400731050550:11302]
2025-10-01T14:14:01.452696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:01.452937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:01.452965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:01.453162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:01.453199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.453203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.453204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.453205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.453206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.453206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.453207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.453208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.453209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.453209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.453210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.453210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.453211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.453211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.453215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.453221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.453224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.453226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.453228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.453231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.453233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.453235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.453237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.453240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.453242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.453244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.453246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.453260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.453265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.453270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.453274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.453277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.453280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.453283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.453285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.453289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.453291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.453294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.453297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.453300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.453303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.453306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.453309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.453312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.453314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.453317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.453320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.453323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.453327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.453330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.453332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.453335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.453338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.453341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.453344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.453346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.453367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:01.456968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:01.457947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:01.457964Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:01.457966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:01.457969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:01.457976Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2120 [2:7556256400731050550:11302]
2025-10-01T14:14:01.457994Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:01.458015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:01.458022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.458025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.458027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.458043Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:01.458054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:01.458060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:01.458122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.458129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.458131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.458133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:01.458136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:01.458197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:01.458204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.458211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.458216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.458225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:01.458244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951393:2446], now have 1 active actors on pipe
2025-10-01T14:14:01.458247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951589:11652], now have 1 active actors on pipe
2025-10-01T14:14:01.458255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256400731050545:11302]
2025-10-01T14:14:01.458257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256400731050545:11302]
2025-10-01T14:14:01.458259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256400731050545:11302]
2025-10-01T14:14:01.458274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:01.458292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:01.458301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:01.458304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:01.458307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:01.458308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:01.458310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:01.458336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256400731050545:11302]
2025-10-01T14:14:01.458341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:01.458360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:01.458336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2120
2025-10-01T14:14:01.458384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.458357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2120
2025-10-01T14:14:01.458393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.458420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:01.458431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.458439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.458441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:01.458451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.458463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:01.458478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.458612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.458617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.458627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.458712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2121 partition: 0 MaxSeqNo: 45 sessionId: src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0
2025-10-01T14:14:01.459141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e23ca112-c6fef7e1-ff87da25-68d476ed_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:01.461699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0] Write session: try to update token
2025-10-01T14:14:01.461714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:01.469213Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:01.469233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:01.469243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256400731050545:11302]
2025-10-01T14:14:01.469280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:01.469286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:01.469443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:01.469562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:01.469686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:01.469810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:01.469974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:01.470003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:01.477211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2121 sessionId: src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:01.479591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:01.479778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.479800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.479840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:01.479922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:01.487963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:01.487980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:01.487983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:01.487984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:01.487996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256400731050545:11302]
2025-10-01T14:14:01.488000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256400731050545:11302]
2025-10-01T14:14:01.488004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256400731050545:11302]
2025-10-01T14:14:01.488051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:01.488053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:01.488059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:01.488061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.488062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:01.488064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:01.488194Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:01.533469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256403107951606:11539]
2025-10-01T14:14:01.533748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2120, pipe: [1:7556256403107951606:11539]
2025-10-01T14:14:01.630508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:01.637277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.637302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.637431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.637489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.637550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.637610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.637651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.637659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.637716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.637767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.637814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.637865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.637916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.637923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.637987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.638043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.638100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.638159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.638203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.638209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.638275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.638513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.638577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.638632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.638674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.638679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.638735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.638792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.638861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.638920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.638960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.638969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.639037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.639098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.639163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.639227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.639290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.639298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.639361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.639415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.639473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.639531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.639571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.639577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.639642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.639699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.639758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.639818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.639859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.639865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.639927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.639983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.640041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.640098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.640139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.640145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.640201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.640251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.640306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.640360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.640401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.640407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.640454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951606:11539], now have 1 active actors on pipe
2025-10-01T14:14:01.640658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:01.640682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:01.640688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:01.640718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256403107951606:11539]
2025-10-01T14:14:01.640723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2121 reason: error at write: Disconnected sessionId: src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0
2025-10-01T14:14:01.641018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:01.641028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0] Write session will restart in 0.007873s
2025-10-01T14:14:01.641053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0] Write session: Do CDS request
2025-10-01T14:14:01.641061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:01.640908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2121 sessionId: src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0 is DEAD
2025-10-01T14:14:01.641198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:01.649900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.651479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:01.651504Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2122
2025-10-01T14:14:01.651673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.651707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:01.651721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:01.651729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:01.652169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2122 sessionId:  describe result for acl check
2025-10-01T14:14:01.652202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:01.652206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:01.652207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:01.652212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256403107951762:11657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:01.653372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256403107951762:11657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:01.654466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:01.655866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256403107951762:11657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:01.656563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:01.656768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:01.656779Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:01.656790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:01.656838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:01.656874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256400731050757:11304]
2025-10-01T14:14:01.657457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:01.657739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:01.657777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:01.658064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:01.658117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.658123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.658124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.658126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.658127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.658128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.658129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.658130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.658131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.658133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.658134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.658135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.658136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.658137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.658142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.658152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.658156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.658160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.658164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.658168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.658172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.658175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.658179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.658184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.658187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.658192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.658195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.658199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.658205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.658212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.658222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.658228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.658236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.658241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.658250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.658255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.658263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.658268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.658277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.658285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.658294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.658301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.658308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.658317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.658326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.658335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.658340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.658349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.658353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.658363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.658383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.658388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.658392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.658396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.658401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.658409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.658452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:01.658731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256403107951762:11657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:01.658745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256403107951762:11657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:01.658749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256403107951762:11657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:01.658756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:01.662133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:01.662803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:01.662817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:01.662819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:01.662822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:01.662828Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2121 [2:7556256400731050757:11304]
2025-10-01T14:14:01.662839Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:01.662853Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:01.662855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.662858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.662860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.662872Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:01.662876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:01.662881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:01.662922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.662930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.662931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.662934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:01.662935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:01.662990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:01.662999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.663009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.663020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.663035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:01.663053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951613:2446], now have 1 active actors on pipe
2025-10-01T14:14:01.663057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951818:11657], now have 1 active actors on pipe
2025-10-01T14:14:01.663064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256400731050752:11304]
2025-10-01T14:14:01.663066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256400731050752:11304]
2025-10-01T14:14:01.663068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256400731050752:11304]
2025-10-01T14:14:01.663076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:01.663086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:01.663086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:01.663095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:01.663095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:01.663097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:01.663097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:01.663122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256400731050752:11304]
2025-10-01T14:14:01.663132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:01.663145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:01.663128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2121
2025-10-01T14:14:01.663172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2121
2025-10-01T14:14:01.663250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.663263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.663285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:01.663297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.663305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.663308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:01.663317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.663330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:01.663347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.663588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.663601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.663634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.663772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2122 partition: 0 MaxSeqNo: 45 sessionId: src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0
2025-10-01T14:14:01.664103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|222a2d81-c284fd53-870a8f3f-9ffeefc8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:01.667005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0] Write session: try to update token
2025-10-01T14:14:01.667025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:01.673537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:01.673559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:01.673569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256400731050752:11304]
2025-10-01T14:14:01.673603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:01.673610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:01.673781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:01.673918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:01.674064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:01.674205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:01.674420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:01.674458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:01.681839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2122 sessionId: src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:01.685271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:01.685866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.685892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.685930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:01.686055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:01.691786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:01.691812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:01.691815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:01.691817Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:01.691828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256400731050752:11304]
2025-10-01T14:14:01.691835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256400731050752:11304]
2025-10-01T14:14:01.691840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256400731050752:11304]
2025-10-01T14:14:01.691893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:01.691905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.691912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:01.692066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:01.694420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:01.694437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:01.694445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:01.740890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256403107951839:11539]
2025-10-01T14:14:01.741339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2121, pipe: [1:7556256403107951839:11539]
2025-10-01T14:14:01.836128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:01.844710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.844740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.848744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:01.848803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2122 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0
2025-10-01T14:14:01.848959Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256403107951839:11539]
2025-10-01T14:14:01.848970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2122 sessionId: src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0 is DEAD
2025-10-01T14:14:01.848994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:01.844886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.844947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.844999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.845053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.845363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.845367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.845433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.845489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.845539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.845606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.845647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.845648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.845714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.845794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.845852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.845914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.845954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.845957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.846025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.846083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.846153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.846216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.846259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.846261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.846327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.846400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.846468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.846526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.846563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.846565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.846627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.846688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.846750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.846808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.846868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.846870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.846933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.846989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.847044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.847103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.847143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.847147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.847209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.847261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.847323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.847380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.847420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.847423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.847482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.847533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.847593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.847663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.847704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.847706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.847795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:01.847853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:01.847912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:01.847968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:01.848005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:01.848008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:01.848092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951839:11539], now have 1 active actors on pipe
2025-10-01T14:14:01.848667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:01.851349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:01.851360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0] Write session will restart in 0.009517s
2025-10-01T14:14:01.851391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0] Write session: Do CDS request
2025-10-01T14:14:01.851399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:01.862352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.862935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:01.862959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2123
2025-10-01T14:14:01.863166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:01.863205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:01.863216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:01.863220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:01.863685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2123 sessionId:  describe result for acl check
2025-10-01T14:14:01.863726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:01.863739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:01.863744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:01.863750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256403107951884:11662] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:01.864699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256403107951884:11662] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:01.868346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256403107951884:11662] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:01.873357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256403107951884:11662] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:01.873379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256403107951884:11662] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:01.873383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256403107951884:11662] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:01.873405Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:01.883780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:01.887226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:01.887441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:01.887451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:01.887461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:01.887507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:01.887549Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256400731050966:11307]
2025-10-01T14:14:01.888143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:01.889053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:01.889098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:01.889407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:01.889468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.889474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.889475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.889477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.889478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.889480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.889481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.889482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.889484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.889485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.889487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.889488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.889489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.889491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.889495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.889505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.889509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.889512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.889515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.889519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.889522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.889525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.889528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.889532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.889535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.889538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.889541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.889544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.889550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.889557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:01.889562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.889566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:01.889571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.889576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:01.889581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.889585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:01.889590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.889595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:01.889599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.889604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:01.889609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.889614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:01.889617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.889622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:01.889630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.889636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:01.889644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.889649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.889658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.889662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.889670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.889675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.889683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.889687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:01.889693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.889698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:01.889739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:01.893807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:01.894521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:01.894545Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:01.894549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:01.894564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:01.894572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2122 [2:7556256400731050966:11307]
2025-10-01T14:14:01.894590Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:01.894615Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:01.894618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.894622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.894624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.894642Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:01.894647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:01.894663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:01.894745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.894753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.894756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.894759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:01.894761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:01.894829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:01.894832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.894847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:01.894859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:01.894875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:01.894893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951841:2446], now have 1 active actors on pipe
2025-10-01T14:14:01.894898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107951997:11662], now have 1 active actors on pipe
2025-10-01T14:14:01.894905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256400731050960:11307]
2025-10-01T14:14:01.894909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256400731050960:11307]
2025-10-01T14:14:01.894911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256400731050960:11307]
2025-10-01T14:14:01.894927Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:01.894939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:01.894954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:01.894958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:01.895006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256400731050960:11307]
2025-10-01T14:14:01.895009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:01.895033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2122
2025-10-01T14:14:01.895091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2122
2025-10-01T14:14:01.895154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:01.895163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:01.895164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:01.895169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:01.895278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.895283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.895309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4068fdf-e780586e-a79bde61-1a336d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:01.895317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:01.895320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:01.895323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:01.895333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:01.895341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:01.895359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.895741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.895753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.895768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:01.898253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2123 partition: 0 MaxSeqNo: 45 sessionId: src_id|e4068fdf-e780586e-a79bde61-1a336d0_0
2025-10-01T14:14:01.898716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0fe328-f03662ab-f14ea4f1-c4438f37_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e4068fdf-e780586e-a79bde61-1a336d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:01.901539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4068fdf-e780586e-a79bde61-1a336d0_0] Write session: try to update token
2025-10-01T14:14:01.901556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4068fdf-e780586e-a79bde61-1a336d0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:01.917535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2123 sessionId: src_id|e4068fdf-e780586e-a79bde61-1a336d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:01.920123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:01.921235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:01.921270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:01.921308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:01.921485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:01.923893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:01.923914Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:01.923916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:01.923918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:01.923927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256400731050960:11307]
2025-10-01T14:14:01.923932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256400731050960:11307]
2025-10-01T14:14:01.923935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256400731050960:11307]
2025-10-01T14:14:01.923984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:01.923991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:01.923994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:01.924121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:01.926434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:01.926457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:01.926461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:01.949235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256403107952059:11539]
2025-10-01T14:14:01.949530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2122, pipe: [1:7556256403107952059:11539]
2025-10-01T14:14:02.067371Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:02.074317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.074346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.074541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.074615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.074690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.074760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.074811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.074822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.074902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.074971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.075051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.075124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.075174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.075185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.075261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.075325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.075399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.075467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.075517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.075526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.075597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.075663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.075734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.075804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.076033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.076048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.076122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.076192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.076263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.076337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.076388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.076398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.076486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.076567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.076663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.076749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.076812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.076822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.076907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.076989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.077080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.077166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.077229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.077238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.077328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.077412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.077502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.077588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.077642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.077651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.077738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.077808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.077874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.077942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.077991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.077998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.078070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:02.078130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:02.078197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:02.078261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:02.078308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:02.078314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:02.078389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256403107952059:11539], now have 1 active actors on pipe
2025-10-01T14:14:02.078641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:02.078643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:02.078646Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:02.078672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2123 reason: error at write: Disconnected sessionId: src_id|e4068fdf-e780586e-a79bde61-1a336d0_0
2025-10-01T14:14:02.078818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2123 sessionId: src_id|e4068fdf-e780586e-a79bde61-1a336d0_0 is DEAD
2025-10-01T14:14:02.078861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256403107952059:11539]
2025-10-01T14:14:02.078974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4068fdf-e780586e-a79bde61-1a336d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:02.078982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4068fdf-e780586e-a79bde61-1a336d0_0] Write session will restart in 0.006440s
2025-10-01T14:14:02.079002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4068fdf-e780586e-a79bde61-1a336d0_0] Write session: Do CDS request
2025-10-01T14:14:02.079007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4068fdf-e780586e-a79bde61-1a336d0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:02.079485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:02.086808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4068fdf-e780586e-a79bde61-1a336d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.086936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:02.086955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2124
2025-10-01T14:14:02.087065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.087098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:02.087104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:02.087108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:02.087747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2124 sessionId:  describe result for acl check
2025-10-01T14:14:02.087787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:02.087794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:02.087796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:02.087801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256407402919393:11667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:02.088352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256407402919393:11667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:02.091221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256407402919393:11667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:02.094549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256407402919393:11667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:02.094571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256407402919393:11667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:02.094574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256407402919393:11667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:02.094582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:02.095935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:02.098801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:02.099122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:02.099132Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:02.099144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:02.099200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:02.099240Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256405026018469:11309]
2025-10-01T14:14:02.099760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:02.100002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:02.100031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:02.100264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:02.100311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.100316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.100318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.100319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.100320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.100321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.100323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.100324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.100325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.100326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.100327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.100329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.100330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.100332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.100336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.100345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.100348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.100351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.100353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.100355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.100357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.100358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.100360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.100363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.100365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.100366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.100368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.100370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.100376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.100381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.100391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.100401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.100410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.100418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.100426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.100435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.100443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.100452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.100460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.100468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.100472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.100478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.100485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.100494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.100499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.100509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.100514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.100519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.100523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.100528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.100533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.100538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.100542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.100551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.100555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.100560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.100614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:02.104485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:02.105147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:02.105159Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:02.105162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:02.105164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:02.105170Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2123 [2:7556256405026018469:11309]
2025-10-01T14:14:02.105181Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:02.105195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:02.105201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.105204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.105205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.105217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:02.105224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:02.105229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:02.105274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.105282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.105284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.105287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:02.105290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:02.105348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:02.105354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.105362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.105371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.105383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:02.105403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256405026018464:11309]
2025-10-01T14:14:02.105410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256405026018464:11309]
2025-10-01T14:14:02.105412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256405026018464:11309]
2025-10-01T14:14:02.105421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:02.105429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:02.105435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:02.105442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:02.105444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:02.105448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:02.105452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:02.105462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402919559:11667], now have 1 active actors on pipe
2025-10-01T14:14:02.105465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402919358:2446], now have 1 active actors on pipe
2025-10-01T14:14:02.105495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256405026018464:11309]
2025-10-01T14:14:02.105505Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:02.105510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2123
2025-10-01T14:14:02.105534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2123
2025-10-01T14:14:02.105527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:02.105581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.105592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.105617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:02.105628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.105636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.105639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:02.105647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.105660Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:02.105676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.105817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.105827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.105841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.105926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2124 partition: 0 MaxSeqNo: 45 sessionId: src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0
2025-10-01T14:14:02.106329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4068fdf-e780586e-a79bde61-1a336d0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:02.109314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0] Write session: try to update token
2025-10-01T14:14:02.109333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:02.122779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2124 sessionId: src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:02.125352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:02.125373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:02.125374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:02.125376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:02.125383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256405026018464:11309]
2025-10-01T14:14:02.125396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256405026018464:11309]
2025-10-01T14:14:02.125401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256405026018464:11309]
2025-10-01T14:14:02.125441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:02.125444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:02.125451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:02.125452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.125429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:02.125453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:02.125454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:02.125570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:02.179100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256407402919589:11539]
2025-10-01T14:14:02.179377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2123, pipe: [1:7556256407402919589:11539]
2025-10-01T14:14:02.264079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:02.264694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.264709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.264744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402919589:11539], now have 1 active actors on pipe
2025-10-01T14:14:02.264911Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:02.265007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:02.265020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256407402919589:11539]
2025-10-01T14:14:02.265046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:02.265153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2124 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0
2025-10-01T14:14:02.265357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2124 sessionId: src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0 is DEAD
2025-10-01T14:14:02.265534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:02.265548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0] Write session will restart in 0.005135s
2025-10-01T14:14:02.265576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0] Write session: Do CDS request
2025-10-01T14:14:02.265583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:02.271818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.271937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:02.271954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2125
2025-10-01T14:14:02.272113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.272145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:02.272154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:02.272157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:02.272552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2125 sessionId:  describe result for acl check
2025-10-01T14:14:02.272598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:02.272604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:02.272606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:02.272610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256407402919617:11680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:02.273098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256407402919617:11680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:02.276355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256407402919617:11680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:02.279084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256407402919617:11680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:02.279099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256407402919617:11680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:02.279103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256407402919617:11680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:02.279110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:02.279827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:02.281830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:02.282008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:02.282018Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:02.282028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:02.282075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:02.282117Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256405026018686:11314]
2025-10-01T14:14:02.282725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:02.282959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:02.282998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:02.283280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:02.283329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.283335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.283336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.283337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.283338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.283340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.283341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.283342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.283343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.283345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.283346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.283347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.283348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.283349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.283355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.283369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.283377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.283381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.283389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.283393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.283396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.283399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.283402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.283406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.283409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.283413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.283416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.283419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.283425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.283432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.283438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.283443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.283448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.283458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.283467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.283476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.283484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.283489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.283498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.283503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.283511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.283520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.283529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.283538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.283541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.283550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.283556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.283565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.283570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.283575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.283583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.283588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.283594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.283598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.283603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.283608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.283646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:02.287305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:02.288004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:02.288021Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:02.288024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:02.288028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:02.288035Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2124 [2:7556256405026018686:11314]
2025-10-01T14:14:02.288053Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:02.288073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:02.288080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.288085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.288093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.288107Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:02.288118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:02.288131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:02.288191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.288200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.288203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.288208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:02.288212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:02.288280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:02.288287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.288297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.288308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.288328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:02.288350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402919804:11680], now have 1 active actors on pipe
2025-10-01T14:14:02.288358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402919601:2446], now have 1 active actors on pipe
2025-10-01T14:14:02.288365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256405026018681:11314]
2025-10-01T14:14:02.288372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256405026018681:11314]
2025-10-01T14:14:02.288374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256405026018681:11314]
2025-10-01T14:14:02.288387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:02.288408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:02.288407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:02.288411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:02.288414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:02.288420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:02.288423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:02.288421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2124
2025-10-01T14:14:02.288452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256405026018681:11314]
2025-10-01T14:14:02.288459Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:02.288462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:02.288426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2124
2025-10-01T14:14:02.288476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.288484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.288527Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d479d23-5179a994-d27c6ee4-998dce42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:02.288537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.288543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.288545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:02.288553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.288565Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:02.288594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.288718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.288724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.288736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.288798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2125 partition: 0 MaxSeqNo: 45 sessionId: src_id|6d479d23-5179a994-d27c6ee4-998dce42_0
2025-10-01T14:14:02.289176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68c23422-e7df1c50-68f4dd5e-4c2c827_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6d479d23-5179a994-d27c6ee4-998dce42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:02.291876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d479d23-5179a994-d27c6ee4-998dce42_0] Write session: try to update token
2025-10-01T14:14:02.291894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d479d23-5179a994-d27c6ee4-998dce42_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:02.307642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2125 sessionId: src_id|6d479d23-5179a994-d27c6ee4-998dce42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:02.308724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:02.308744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:02.308746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:02.308748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:02.308758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256405026018681:11314]
2025-10-01T14:14:02.308763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256405026018681:11314]
2025-10-01T14:14:02.308767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256405026018681:11314]
2025-10-01T14:14:02.308808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:02.308817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:02.308821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:02.308824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:02.308824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.308827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:02.308962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:02.310049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:02.364976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256407402919817:11539]
2025-10-01T14:14:02.365295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2124, pipe: [1:7556256407402919817:11539]
2025-10-01T14:14:02.450490Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:02.450722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.450738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.450771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402919817:11539], now have 1 active actors on pipe
2025-10-01T14:14:02.450922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:02.450979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:02.450980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:02.450983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:02.451033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256407402919817:11539]
2025-10-01T14:14:02.451039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2125 reason: error at write: Disconnected sessionId: src_id|6d479d23-5179a994-d27c6ee4-998dce42_0
2025-10-01T14:14:02.451253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2125 sessionId: src_id|6d479d23-5179a994-d27c6ee4-998dce42_0 is DEAD
2025-10-01T14:14:02.451388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d479d23-5179a994-d27c6ee4-998dce42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:02.451397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d479d23-5179a994-d27c6ee4-998dce42_0] Write session will restart in 0.007202s
2025-10-01T14:14:02.451417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d479d23-5179a994-d27c6ee4-998dce42_0] Write session: Do CDS request
2025-10-01T14:14:02.451422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d479d23-5179a994-d27c6ee4-998dce42_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:02.459925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d479d23-5179a994-d27c6ee4-998dce42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.460085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:02.460102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2126
2025-10-01T14:14:02.460231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.460256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:02.460263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:02.460266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:02.460680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2126 sessionId:  describe result for acl check
2025-10-01T14:14:02.460712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:02.460717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:02.460719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:02.460722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256407402919895:11684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:02.461117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256407402919895:11684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:02.463159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256407402919895:11684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:02.464976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:02.467528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:02.467691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:02.467698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:02.467706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:02.467738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:02.467767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256405026018935:11327]
2025-10-01T14:14:02.467749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256407402919895:11684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:02.467767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256407402919895:11684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:02.467771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256407402919895:11684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:02.467778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:02.468150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:02.468374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:02.468400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:02.468612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:02.468654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.468660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.468660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.468661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.468662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.468662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.468663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.468663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.468664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.468665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.468665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.468666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.468666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.468667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.468670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.468675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.468678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.468680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.468682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.468684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.468686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.468688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.468690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.468693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.468695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.468697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.468699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.468701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.468706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.468711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.468714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.468717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.468720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.468723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.468725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.468728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.468730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.468733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.468735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.468738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.468741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.468744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.468746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.468749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.468752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.468759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.468761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.468764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.468766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.468769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.468771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.468778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.468781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.468783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.468792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.468801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.468826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:02.472337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:02.473040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:02.473054Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:02.473056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:02.473058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:02.473063Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2125 [2:7556256405026018935:11327]
2025-10-01T14:14:02.473073Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:02.473087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:02.473092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.473095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.473096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.473106Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:02.473113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:02.473117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:02.473156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.473161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.473162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.473164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:02.473166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:02.473216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:02.473221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.473228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.473234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.473247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:02.473262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256405026018930:11327]
2025-10-01T14:14:02.473267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256405026018930:11327]
2025-10-01T14:14:02.473269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256405026018930:11327]
2025-10-01T14:14:02.473275Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:02.473285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402919823:2446], now have 1 active actors on pipe
2025-10-01T14:14:02.473285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:02.473287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:02.473290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:02.473291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402920026:11684], now have 1 active actors on pipe
2025-10-01T14:14:02.473297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:02.473305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:02.473307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:02.473333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256405026018930:11327]
2025-10-01T14:14:02.473339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:02.473350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:02.473350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2125
2025-10-01T14:14:02.473351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2125
2025-10-01T14:14:02.473408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.473415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.473434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58177930-c4d31b83-49f6afc4-12f67118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:02.473443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.473446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.473451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:02.473457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.473463Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:02.473476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.473593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.473601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.473613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.473687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2126 partition: 0 MaxSeqNo: 45 sessionId: src_id|58177930-c4d31b83-49f6afc4-12f67118_0
2025-10-01T14:14:02.474046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d479d23-5179a994-d27c6ee4-998dce42_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58177930-c4d31b83-49f6afc4-12f67118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:02.476797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58177930-c4d31b83-49f6afc4-12f67118_0] Write session: try to update token
2025-10-01T14:14:02.476814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58177930-c4d31b83-49f6afc4-12f67118_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:02.493465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2126 sessionId: src_id|58177930-c4d31b83-49f6afc4-12f67118_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:02.494000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:02.494024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:02.494027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:02.494029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:02.494037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256405026018930:11327]
2025-10-01T14:14:02.494041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256405026018930:11327]
2025-10-01T14:14:02.494045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256405026018930:11327]
2025-10-01T14:14:02.494098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:02.494101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:02.494109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.494112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:02.494115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:02.494119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:02.494266Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:02.496092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:02.551327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256407402920043:11539]
2025-10-01T14:14:02.551612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2125, pipe: [1:7556256407402920043:11539]
2025-10-01T14:14:02.635348Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:02.635653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.635670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.635710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402920043:11539], now have 1 active actors on pipe
2025-10-01T14:14:02.635909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:02.635918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:02.635925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:02.635954Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:02.635966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256407402920043:11539]
2025-10-01T14:14:02.635982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2126 reason: error at write: Disconnected sessionId: src_id|58177930-c4d31b83-49f6afc4-12f67118_0
2025-10-01T14:14:02.636179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2126 sessionId: src_id|58177930-c4d31b83-49f6afc4-12f67118_0 is DEAD
2025-10-01T14:14:02.636302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58177930-c4d31b83-49f6afc4-12f67118_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:02.636310Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58177930-c4d31b83-49f6afc4-12f67118_0] Write session will restart in 0.009530s
2025-10-01T14:14:02.636330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58177930-c4d31b83-49f6afc4-12f67118_0] Write session: Do CDS request
2025-10-01T14:14:02.636334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58177930-c4d31b83-49f6afc4-12f67118_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:02.646810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58177930-c4d31b83-49f6afc4-12f67118_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.646926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:02.646943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2127
2025-10-01T14:14:02.647110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.647144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:02.647168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:02.647176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:02.647509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2127 sessionId:  describe result for acl check
2025-10-01T14:14:02.647558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:02.647563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:02.647565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:02.647571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256407402920217:11689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:02.648052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256407402920217:11689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:02.648683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:02.649792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256407402920217:11689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:02.650959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:02.651177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:02.651188Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:02.651199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:02.651251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:02.651287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256405026019145:11329]
2025-10-01T14:14:02.651831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:02.652061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:02.652101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:02.652221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256407402920217:11689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:02.652235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256407402920217:11689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:02.652238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256407402920217:11689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:02.652246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:02.652374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:02.652429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.652437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.652438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.652439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.652440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.652441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.652442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.652443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.652444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.652446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.652447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.652448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.652449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.652450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.652455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.652465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.652469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.652473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.652478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.652482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.652486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.652489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.652494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.652498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.652502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.652506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.652511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.652520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.652531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.652544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.652556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.652562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.652571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.652581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.652600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.652610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.652620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.652630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.652638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.652648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.652658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.652668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.652676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.652686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.652695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.652705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.652714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.652724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.652732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.652741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.652751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.652756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.652767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.652776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.652785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.652795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.652844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:02.656209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:02.656941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:02.656956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:02.656958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:02.656961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:02.656968Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2126 [2:7556256405026019145:11329]
2025-10-01T14:14:02.656984Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:02.657005Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:02.657008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.657015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.657017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.657032Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:02.657041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:02.657051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:02.657364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.657377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.657379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.657382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:02.657385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:02.657459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:02.657466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.657477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.657493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.657514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:02.657535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402920257:11689], now have 1 active actors on pipe
2025-10-01T14:14:02.657542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402920048:2446], now have 1 active actors on pipe
2025-10-01T14:14:02.657549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256405026019140:11329]
2025-10-01T14:14:02.657555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256405026019140:11329]
2025-10-01T14:14:02.657557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256405026019140:11329]
2025-10-01T14:14:02.657566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:02.657551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2126
2025-10-01T14:14:02.657553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2126
2025-10-01T14:14:02.657584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:02.657589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:02.657591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:02.657592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:02.657602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:02.657609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:02.657650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.657658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.657675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256405026019140:11329]
2025-10-01T14:14:02.657686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:02.657689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:02.657713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:02.657725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.657734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.657737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:02.657747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.657762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:02.657787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.657939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.657950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.657967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.658056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2127 partition: 0 MaxSeqNo: 45 sessionId: src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0
2025-10-01T14:14:02.658409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58177930-c4d31b83-49f6afc4-12f67118_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:02.661454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0] Write session: try to update token
2025-10-01T14:14:02.661468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:02.674539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2127 sessionId: src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:02.676758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:02.678019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.678047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.678068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:02.678071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:02.678074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:02.678081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:02.678089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256405026019140:11329]
2025-10-01T14:14:02.678099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256405026019140:11329]
2025-10-01T14:14:02.678108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256405026019140:11329]
2025-10-01T14:14:02.678141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:02.678154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:02.678157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:02.678159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:02.678167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.678174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:02.678298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:02.736142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256407402920279:11539]
2025-10-01T14:14:02.736359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2126, pipe: [1:7556256407402920279:11539]
2025-10-01T14:14:02.823687Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:02.823991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:02.824042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402920279:11539], now have 1 active actors on pipe
2025-10-01T14:14:02.824427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:02.824532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:02.824542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:02.824641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2127 reason: error at write: Disconnected sessionId: src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0
2025-10-01T14:14:02.824753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256407402920279:11539]
2025-10-01T14:14:02.824777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:02.824982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:02.824995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0] Write session will restart in 0.008442s
2025-10-01T14:14:02.824827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2127 sessionId: src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0 is DEAD
2025-10-01T14:14:02.825022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0] Write session: Do CDS request
2025-10-01T14:14:02.825030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:02.835444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.835788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:02.835813Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2128
2025-10-01T14:14:02.835990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:02.836018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:02.836023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:02.836028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:02.836762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2128 sessionId:  describe result for acl check
2025-10-01T14:14:02.836813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:02.836814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:02.836816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:02.836824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256407402920317:11694] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:02.837429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256407402920317:11694] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:02.842222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256407402920317:11694] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:02.843902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:02.846732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256407402920317:11694] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:02.846755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256407402920317:11694] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:02.846758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256407402920317:11694] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:02.846777Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:02.846777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:02.847021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:02.847026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:02.847038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:02.847094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:02.847165Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256405026019360:11332]
2025-10-01T14:14:02.847788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:02.848235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:02.848307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:02.848685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:02.848760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.848768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.848769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.848770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.848772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.848773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.848775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.848776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.848777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.848778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.848780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.848781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.848782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.848783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.848791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.848800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.848804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.848808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.848812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.848816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.848820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.848823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.848827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.848831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.848834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.848838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.848842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.848846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.848854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.848862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:02.848870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.848876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:02.848882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.848887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:02.848891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.848898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:02.848906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.848912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:02.848922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.848927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:02.848933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.848938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:02.848945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.848951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:02.848958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.848964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:02.848968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.848975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.848980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.848985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.848993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.848999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.849004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.849013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:02.849017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.849026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:02.849071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:02.853624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:02.854453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:02.854472Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:02.854475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:02.854479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:02.854487Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2127 [2:7556256405026019360:11332]
2025-10-01T14:14:02.854505Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:02.854524Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:02.854533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.854536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.854539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.854557Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:02.854568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:02.854575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:02.854639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.854647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.854650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.854653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:02.854656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:02.854736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:02.854745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.854760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:02.854777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:02.854802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:02.854828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402920281:2446], now have 1 active actors on pipe
2025-10-01T14:14:02.854837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402920489:11694], now have 1 active actors on pipe
2025-10-01T14:14:02.854845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256405026019355:11332]
2025-10-01T14:14:02.854853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256405026019355:11332]
2025-10-01T14:14:02.854855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256405026019355:11332]
2025-10-01T14:14:02.854873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:02.854888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:02.854906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:02.854905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:02.854910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:02.854912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:02.854914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:02.854903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2127
2025-10-01T14:14:02.854956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256405026019355:11332]
2025-10-01T14:14:02.854916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2127
2025-10-01T14:14:02.854964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:02.854966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:02.854983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.854988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.855043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:02.855055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:02.855059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:02.855062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:02.855071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:02.855088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:02.855118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.855321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.855338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.855363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:02.855532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2128 partition: 0 MaxSeqNo: 45 sessionId: src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0
2025-10-01T14:14:02.855940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cac758bd-fdef539-4f6eaf29-28eeb316_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:02.858885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0] Write session: try to update token
2025-10-01T14:14:02.858904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:02.873666Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2128 sessionId: src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:02.876494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:02.876743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:02.876768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:02.876789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:02.876796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:02.876799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:02.876801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:02.876810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256405026019355:11332]
2025-10-01T14:14:02.876818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256405026019355:11332]
2025-10-01T14:14:02.876823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256405026019355:11332]
2025-10-01T14:14:02.876852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:02.876863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:02.876866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:02.876881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:02.876888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:02.876890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:02.877016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:02.922535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256407402920501:11539]
2025-10-01T14:14:02.922803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2127, pipe: [1:7556256407402920501:11539]
2025-10-01T14:14:03.023548Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:03.023754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:03.023799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256407402920501:11539], now have 1 active actors on pipe
2025-10-01T14:14:03.023914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:03.023987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:03.024036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256407402920501:11539]
2025-10-01T14:14:03.036222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:03.036241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:03.036263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2128 reason: error at write: Disconnected sessionId: src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0
2025-10-01T14:14:03.036413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2128 sessionId: src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0 is DEAD
2025-10-01T14:14:03.036499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:03.036507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0] Write session will restart in 0.006631s
2025-10-01T14:14:03.036523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0] Write session: Do CDS request
2025-10-01T14:14:03.036530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:03.044321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:03.046755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:03.046885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.046995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:03.047014Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:03.047026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:03.047026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:03.047041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2129
2025-10-01T14:14:03.047082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:03.047135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256409320986868:11334]
2025-10-01T14:14:03.047151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.047188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:03.047198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:03.047204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:03.047576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2129 sessionId:  describe result for acl check
2025-10-01T14:14:03.047604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:03.047605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:03.047606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:03.047611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256411697887977:11699] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:03.047689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:03.047968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:03.048022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:03.048115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256411697887977:11699] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:03.048317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:03.048400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.048408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.048409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.048410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.048412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.048413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.048414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.048415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.048416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.048417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.048418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.048419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.048420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.048421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.048427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.048437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.048441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.048445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.048449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.048453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.048457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.048461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.048465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.048469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.048473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.048476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.048480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.048483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.048490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.048497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.048504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.048509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.048514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.048519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.048529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.048535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.048544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.048549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.048555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.048560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.048569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.048574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.048578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.048599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.048608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.048613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.048622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.048627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.048632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.048641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.048646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.048651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.048660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.048664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.048673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.048678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.048710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:03.050141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256411697887977:11699] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:03.052439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:03.053111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:03.053127Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:03.053129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:03.053134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:03.053140Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2128 [2:7556256409320986868:11334]
2025-10-01T14:14:03.053155Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:03.053172Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:03.053175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.053179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.053181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.053198Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:03.053208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:03.053219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:03.053274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.053282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.053284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.053287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:03.053289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:03.053353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:03.053360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.053370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.053379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.053394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:03.053415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697887801:2446], now have 1 active actors on pipe
2025-10-01T14:14:03.053427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256409320986863:11334]
2025-10-01T14:14:03.053433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256409320986863:11334]
2025-10-01T14:14:03.053396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256411697887977:11699] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:03.053435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256409320986863:11334]
2025-10-01T14:14:03.053413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256411697887977:11699] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:03.053451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:03.053419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256411697887977:11699] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:03.053426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:03.053464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:03.053465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:03.053475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:03.053477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:03.053478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:03.053480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:03.053510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256409320986863:11334]
2025-10-01T14:14:03.053522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:03.053545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2128
2025-10-01T14:14:03.053535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:03.053649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888014:11699], now have 1 active actors on pipe
2025-10-01T14:14:03.053707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2128
2025-10-01T14:14:03.053773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.053785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.053808Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fd8d021-a65e763f-27596f77-b0145791_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:03.053820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.053829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.053831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:03.053840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.053850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:03.053870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.054146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.054156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.054170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.054252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2129 partition: 0 MaxSeqNo: 45 sessionId: src_id|4fd8d021-a65e763f-27596f77-b0145791_0
2025-10-01T14:14:03.054620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2a16d6b-40cdd1fc-b35de94a-84c923dc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4fd8d021-a65e763f-27596f77-b0145791_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:03.057568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd8d021-a65e763f-27596f77-b0145791_0] Write session: try to update token
2025-10-01T14:14:03.057583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd8d021-a65e763f-27596f77-b0145791_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:03.064889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:03.064912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:03.064922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256409320986863:11334]
2025-10-01T14:14:03.064962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:03.064964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:03.065153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:03.065303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:03.065459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:03.065598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:03.065779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:03.065828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:03.071149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2129 sessionId: src_id|4fd8d021-a65e763f-27596f77-b0145791_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:03.074052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:03.074243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.074268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.074303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:03.074397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:03.083153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:03.083174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:03.083177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:03.083179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:03.083190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256409320986863:11334]
2025-10-01T14:14:03.083194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256409320986863:11334]
2025-10-01T14:14:03.083197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256409320986863:11334]
2025-10-01T14:14:03.083234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:03.083242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:03.083246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:03.083249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.083249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:03.083252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:03.083377Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:03.124280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256411697888022:11539]
2025-10-01T14:14:03.124514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2128, pipe: [1:7556256411697888022:11539]
2025-10-01T14:14:03.218977Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:03.225982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.226006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.226134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.226187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.226253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.226306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.226343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.226351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.226426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.226479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.226528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.226577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.226614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.226619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.226676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.226735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.226796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.226850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.227231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.227246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.227309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.227586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.227644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.227707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.227752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.227761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.227824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.227890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.227955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.228018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.228059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.228066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.228124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.228176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.228232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.228295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.228337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.228346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.228404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.228460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.228522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.228596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.228645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.228651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.228709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.228769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.228828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.228890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.228995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.229003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.229067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.229131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.229195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.229257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.229300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.229307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.229372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.229434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.229505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.229567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.229617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.229624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.229677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888022:11539], now have 1 active actors on pipe
2025-10-01T14:14:03.229918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:03.229925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256411697888022:11539]
2025-10-01T14:14:03.229944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:03.229946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:03.229974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2129 reason: error at write: Disconnected sessionId: src_id|4fd8d021-a65e763f-27596f77-b0145791_0
2025-10-01T14:14:03.230163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:03.230198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2129 sessionId: src_id|4fd8d021-a65e763f-27596f77-b0145791_0 is DEAD
2025-10-01T14:14:03.230344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd8d021-a65e763f-27596f77-b0145791_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:03.230350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd8d021-a65e763f-27596f77-b0145791_0] Write session will restart in 0.005668s
2025-10-01T14:14:03.230367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd8d021-a65e763f-27596f77-b0145791_0] Write session: Do CDS request
2025-10-01T14:14:03.230380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd8d021-a65e763f-27596f77-b0145791_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:03.236841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd8d021-a65e763f-27596f77-b0145791_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.236969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:03.236985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2130
2025-10-01T14:14:03.237124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.237156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:03.237165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:03.237168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:03.237517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2130 sessionId:  describe result for acl check
2025-10-01T14:14:03.237548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:03.237554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:03.237556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:03.237560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256411697888089:11710] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:03.238057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256411697888089:11710] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:03.240360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256411697888089:11710] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:03.242342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:03.242562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256411697888089:11710] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:03.242577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256411697888089:11710] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:03.242579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256411697888089:11710] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:03.242587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:03.242763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:03.242928Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:03.242937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:03.242946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:03.242985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:03.243021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256409320987091:11339]
2025-10-01T14:14:03.243421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:03.244902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:03.244935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:03.245251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:03.245290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.245295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.245296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.245297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.245297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.245298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.245299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.245299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.245300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.245301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.245305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.245305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.245306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.245306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.245311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.245317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.245319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.245321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.245323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.245325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.245327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.245329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.245332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.245334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.245336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.245338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.245340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.245342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.245346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.245351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.245355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.245357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.245360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.245363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.245365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.245368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.245370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.245373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.245376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.245378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.245381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.245384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.245387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.245390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.245392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.245395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.245397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.245401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.245403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.245406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.245408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.245410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.245413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.245416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.245418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.245420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.245446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:03.249099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:03.249898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:03.249910Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:03.249912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:03.249915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:03.249921Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2129 [2:7556256409320987091:11339]
2025-10-01T14:14:03.249930Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:03.249946Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:03.249948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.249951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.249952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.249964Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:03.249972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:03.249976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:03.250021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.250026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.250028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.250031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:03.250033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:03.250084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:03.250090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.250096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.250102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.250110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:03.250125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256409320987085:11339]
2025-10-01T14:14:03.250130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256409320987085:11339]
2025-10-01T14:14:03.250132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256409320987085:11339]
2025-10-01T14:14:03.250138Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:03.250150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:03.250152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:03.250161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:03.250164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:03.250165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:03.250168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:03.250180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888050:2446], now have 1 active actors on pipe
2025-10-01T14:14:03.250206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888257:11710], now have 1 active actors on pipe
2025-10-01T14:14:03.250212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256409320987085:11339]
2025-10-01T14:14:03.250218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:03.250232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:03.250267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2129
2025-10-01T14:14:03.250273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2129
2025-10-01T14:14:03.250336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.250343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.250361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:03.250380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.250383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.250385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:03.250394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.250402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:03.250415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.250606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.250614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.250623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.250723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2130 partition: 0 MaxSeqNo: 45 sessionId: src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0
2025-10-01T14:14:03.251090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fd8d021-a65e763f-27596f77-b0145791_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:03.253927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0] Write session: try to update token
2025-10-01T14:14:03.253941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:03.260401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:03.260424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:03.260435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256409320987085:11339]
2025-10-01T14:14:03.260481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:03.260502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:03.260671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:03.260818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:03.260962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:03.261105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:03.261296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:03.261331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:03.268030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2130 sessionId: src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:03.270830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:03.270996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.271022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.271063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:03.271145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:03.278207Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:03.278226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:03.278228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:03.278229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:03.278238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256409320987085:11339]
2025-10-01T14:14:03.278242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256409320987085:11339]
2025-10-01T14:14:03.278246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256409320987085:11339]
2025-10-01T14:14:03.278283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:03.278290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.278292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:03.278313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:03.278332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:03.278338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:03.278422Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:03.330082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256411697888268:11539]
2025-10-01T14:14:03.330318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2129, pipe: [1:7556256411697888268:11539]
2025-10-01T14:14:03.411373Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:03.418520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.418552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.418688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.418741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.418794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.418840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.418881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.418888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.418941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.418989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.419035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.419085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.419123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.419128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.419187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.419249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.419306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.419362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.419400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.419406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.419463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.419515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.419567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.419619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.419657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.419664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.419723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.419773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.419822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.419873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.419918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.419925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.419986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.420041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.420101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.420165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.420211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.420219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.420279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.420335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.420393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.420453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.420494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.420500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.420561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.420624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.420681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.420738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.420778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.420786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.420849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.420909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.420967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.421026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.421071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.421081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.421140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:03.421193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:03.421253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:03.421311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:03.421350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:03.421357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:03.421404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888268:11539], now have 1 active actors on pipe
2025-10-01T14:14:03.421619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:03.421620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:03.421625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:03.421651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2130 reason: error at write: Disconnected sessionId: src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0
2025-10-01T14:14:03.421673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256411697888268:11539]
2025-10-01T14:14:03.421841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2130 sessionId: src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0 is DEAD
2025-10-01T14:14:03.421940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:03.421960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0] Write session will restart in 0.007469s
2025-10-01T14:14:03.421986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0] Write session: Do CDS request
2025-10-01T14:14:03.421993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:03.422329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:03.430905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.430982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:03.430999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2131
2025-10-01T14:14:03.431120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.431143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:03.431150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:03.431153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:03.431500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2131 sessionId:  describe result for acl check
2025-10-01T14:14:03.431529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:03.431535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:03.431536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:03.431541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256411697888329:11714] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:03.432006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256411697888329:11714] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:03.435290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256411697888329:11714] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:03.436826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:03.439283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:03.439619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256411697888329:11714] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:03.439636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256411697888329:11714] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:03.439617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:03.439639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256411697888329:11714] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:03.439630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:03.439644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:03.439641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:03.439696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:03.439743Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256409320987316:11342]
2025-10-01T14:14:03.440286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:03.440622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:03.440666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:03.440944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:03.440995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.441001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.441002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.441004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.441005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.441006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.441007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.441008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.441009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.441010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.441011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.441012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.441014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.441015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.441020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.441028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.441031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.441035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.441039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.441042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.441045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.441048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.441051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.441055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.441057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.441061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.441063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.441067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.441075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.441082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.441087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.441091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.441095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.441099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.441103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.441108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.441112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.441115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.441119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.441123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.441128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.441133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.441136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.441141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.441146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.441150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.441153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.441157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.441162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.441166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.441170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.441174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.441178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.441182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.441187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.441190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.441221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:03.444854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:03.445567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:03.445582Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:03.445585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:03.445589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:03.445596Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2130 [2:7556256409320987316:11342]
2025-10-01T14:14:03.445612Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:03.445629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:03.445636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.445640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.445643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.445660Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:03.445669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:03.445676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:03.445739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.445746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.445748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.445752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:03.445755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:03.445822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:03.445828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.445838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.445853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.445870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:03.445892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888482:11714], now have 1 active actors on pipe
2025-10-01T14:14:03.445900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888271:2446], now have 1 active actors on pipe
2025-10-01T14:14:03.445906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256409320987311:11342]
2025-10-01T14:14:03.445908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256409320987311:11342]
2025-10-01T14:14:03.445910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256409320987311:11342]
2025-10-01T14:14:03.445924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:03.445940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:03.445940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:03.445944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:03.445945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:03.445956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:03.445960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:03.445958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2130
2025-10-01T14:14:03.445971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2130
2025-10-01T14:14:03.445990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256409320987311:11342]
2025-10-01T14:14:03.445997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:03.445998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:03.446023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.446031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.446065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e992bde-563a8596-9c40a250-43eb918b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:03.446076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.446080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.446084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:03.446094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.446107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:03.446128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.446282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.446293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.446308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.446432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2131 partition: 0 MaxSeqNo: 45 sessionId: src_id|e992bde-563a8596-9c40a250-43eb918b_0
2025-10-01T14:14:03.446809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2eb6a25-b8bee29c-5a0430f9-def301d6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e992bde-563a8596-9c40a250-43eb918b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:03.449773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e992bde-563a8596-9c40a250-43eb918b_0] Write session: try to update token
2025-10-01T14:14:03.449791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e992bde-563a8596-9c40a250-43eb918b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:03.463925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2131 sessionId: src_id|e992bde-563a8596-9c40a250-43eb918b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:03.466075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:03.466097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:03.466099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:03.466101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:03.466109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256409320987311:11342]
2025-10-01T14:14:03.466113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256409320987311:11342]
2025-10-01T14:14:03.466116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256409320987311:11342]
2025-10-01T14:14:03.466145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:03.466149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:03.466151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:03.466163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:03.466169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.466171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:03.466299Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:03.466868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:03.522108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256411697888498:11539]
2025-10-01T14:14:03.522389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2130, pipe: [1:7556256411697888498:11539]
2025-10-01T14:14:03.613163Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:03.613753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.613769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.613805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888498:11539], now have 1 active actors on pipe
2025-10-01T14:14:03.613970Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:03.614018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256411697888498:11539]
2025-10-01T14:14:03.614028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:03.614047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:03.614103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2131 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e992bde-563a8596-9c40a250-43eb918b_0
2025-10-01T14:14:03.614267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2131 sessionId: src_id|e992bde-563a8596-9c40a250-43eb918b_0 is DEAD
2025-10-01T14:14:03.614413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e992bde-563a8596-9c40a250-43eb918b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:03.614423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e992bde-563a8596-9c40a250-43eb918b_0] Write session will restart in 0.007294s
2025-10-01T14:14:03.614447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e992bde-563a8596-9c40a250-43eb918b_0] Write session: Do CDS request
2025-10-01T14:14:03.614452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e992bde-563a8596-9c40a250-43eb918b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:03.622774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e992bde-563a8596-9c40a250-43eb918b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.622903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:03.622919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2132
2025-10-01T14:14:03.623022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.623054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:03.623063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:03.623067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:03.623459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2132 sessionId:  describe result for acl check
2025-10-01T14:14:03.623490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:03.623497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:03.623499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:03.623505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256411697888632:11719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:03.623986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256411697888632:11719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:03.625746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256411697888632:11719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:03.625885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:03.627993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:03.628202Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:03.628213Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:03.628224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:03.628275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:03.628319Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256409320987560:11354]
2025-10-01T14:14:03.628413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256411697888632:11719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:03.628427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256411697888632:11719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:03.628434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256411697888632:11719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:03.628441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:03.628890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:03.629138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:03.629186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:03.629476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:03.629537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.629544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.629545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.629546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.629547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.629548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.629549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.629550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.629551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.629552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.629553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.629554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.629555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.629556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.629561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.629570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.629574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.629578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.629580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.629584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.629588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.629591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.629594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.629598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.629601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.629604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.629608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.629610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.629617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.629626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.629632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.629642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.629646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.629650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.629653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.629662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.629666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.629670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.629675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.629681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.629688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.629694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.629702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.629706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.629714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.629719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.629722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.629726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.629731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.629735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.629739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.629742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.629746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.629751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.629759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.629764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.629803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:03.633519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:03.634580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:03.634596Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:03.634599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:03.634602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:03.634609Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2131 [2:7556256409320987560:11354]
2025-10-01T14:14:03.634624Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:03.634641Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:03.634645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.634649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.634651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.634668Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:03.634678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:03.634684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:03.634740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.634749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.634751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.634755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:03.634757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:03.634826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:03.634833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.634844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.634854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.634872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:03.634893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888718:11719], now have 1 active actors on pipe
2025-10-01T14:14:03.634900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888506:2446], now have 1 active actors on pipe
2025-10-01T14:14:03.634908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256409320987555:11354]
2025-10-01T14:14:03.634916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256409320987555:11354]
2025-10-01T14:14:03.634918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256409320987555:11354]
2025-10-01T14:14:03.634934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:03.634945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:03.634950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:03.634956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:03.634949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2131
2025-10-01T14:14:03.634958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:03.634952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2131
2025-10-01T14:14:03.634965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:03.634967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:03.634999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256409320987555:11354]
2025-10-01T14:14:03.635002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:03.635011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:03.635020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.635029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.635078Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d5363f3-41b3a401-8003032a-d635614a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:03.635091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.635096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.635098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:03.635107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.635119Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:03.635143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.635291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.635299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.635312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.635398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2132 partition: 0 MaxSeqNo: 45 sessionId: src_id|7d5363f3-41b3a401-8003032a-d635614a_0
2025-10-01T14:14:03.635731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e992bde-563a8596-9c40a250-43eb918b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7d5363f3-41b3a401-8003032a-d635614a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:03.638655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5363f3-41b3a401-8003032a-d635614a_0] Write session: try to update token
2025-10-01T14:14:03.638671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5363f3-41b3a401-8003032a-d635614a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:03.652673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2132 sessionId: src_id|7d5363f3-41b3a401-8003032a-d635614a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:03.655226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:03.655771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.655798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.655821Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:03.655829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:03.655832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:03.655833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:03.655843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256409320987555:11354]
2025-10-01T14:14:03.655851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256409320987555:11354]
2025-10-01T14:14:03.655854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256409320987555:11354]
2025-10-01T14:14:03.655901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:03.655915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:03.655916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:03.655920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:03.655922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.655925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:03.656054Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:03.714092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256411697888742:11539]
2025-10-01T14:14:03.714355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2131, pipe: [1:7556256411697888742:11539]
2025-10-01T14:14:03.813169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:03.813492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:03.813560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888742:11539], now have 1 active actors on pipe
2025-10-01T14:14:03.813742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:03.813794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256411697888742:11539]
2025-10-01T14:14:03.813814Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:03.813847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:03.813849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:03.813923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2132 reason: error at write: Disconnected sessionId: src_id|7d5363f3-41b3a401-8003032a-d635614a_0
2025-10-01T14:14:03.814167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2132 sessionId: src_id|7d5363f3-41b3a401-8003032a-d635614a_0 is DEAD
2025-10-01T14:14:03.814216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5363f3-41b3a401-8003032a-d635614a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:03.814225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5363f3-41b3a401-8003032a-d635614a_0] Write session will restart in 0.006796s
2025-10-01T14:14:03.814244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5363f3-41b3a401-8003032a-d635614a_0] Write session: Do CDS request
2025-10-01T14:14:03.814252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5363f3-41b3a401-8003032a-d635614a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:03.821879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5363f3-41b3a401-8003032a-d635614a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.822265Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:03.822283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2133
2025-10-01T14:14:03.822429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:03.822462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:03.822477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:03.822481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:03.822884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2133 sessionId:  describe result for acl check
2025-10-01T14:14:03.822920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:03.822926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:03.822928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:03.822936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256411697888772:11724] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:03.823447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256411697888772:11724] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:03.827247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256411697888772:11724] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:03.831514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256411697888772:11724] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:03.831534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256411697888772:11724] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:03.831537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256411697888772:11724] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:03.831546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:03.832610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:03.835450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:03.835683Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:03.835695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:03.835706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:03.835755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:03.835799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256409320987781:11357]
2025-10-01T14:14:03.836368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:03.836780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:03.836828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:03.837188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:03.837263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.837269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.837270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.837271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.837272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.837274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.837275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.837276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.837277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.837279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.837280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.837281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.837282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.837283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.837289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.837299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.837303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.837306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.837310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.837313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.837316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.837319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.837323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.837327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.837330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.837334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.837337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.837340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.837348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.837356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:03.837362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.837367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:03.837372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.837377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:03.837380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.837385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:03.837389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.837394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:03.837399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.837404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:03.837409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.837414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:03.837423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.837428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:03.837432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.837442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:03.837446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.837455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.837462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.837471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.837475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.837480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.837486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.837490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:03.837494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.837515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:03.837555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:03.841570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:03.842309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:03.842329Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:03.842332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:03.842336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:03.842343Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2132 [2:7556256409320987781:11357]
2025-10-01T14:14:03.842393Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:03.842418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:03.842425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.842429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.842432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.842452Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:03.842462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:03.842469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:03.842530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.842538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.842541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.842545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:03.842548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:03.842769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2132
2025-10-01T14:14:03.842776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2132
2025-10-01T14:14:03.842630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:03.842637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.842648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:03.842658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:03.842673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:03.842692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888954:11724], now have 1 active actors on pipe
2025-10-01T14:14:03.842695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888744:2446], now have 1 active actors on pipe
2025-10-01T14:14:03.842702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256409320987776:11357]
2025-10-01T14:14:03.842704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256409320987776:11357]
2025-10-01T14:14:03.842707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256409320987776:11357]
2025-10-01T14:14:03.842721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:03.842736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:03.842749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:03.842753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:03.842787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256409320987776:11357]
2025-10-01T14:14:03.842789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:03.842795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:03.842799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:03.842802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:03.842808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:03.842926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.842936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.842980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:03.842989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:03.842997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:03.843000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:03.843011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:03.843023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:03.843055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.843234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.843246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.843260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:03.843401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2133 partition: 0 MaxSeqNo: 45 sessionId: src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0
2025-10-01T14:14:03.843795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5363f3-41b3a401-8003032a-d635614a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:03.847054Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0] Write session: try to update token
2025-10-01T14:14:03.847077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:03.855548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:03.855572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:03.855583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256409320987776:11357]
2025-10-01T14:14:03.855634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:03.855647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:03.855859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:03.856021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:03.856197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:03.856356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:03.856598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:03.856644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:03.865130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2133 sessionId: src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:03.867856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:03.870183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:03.870214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:03.870593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:03.870255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:03.880683Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:03.880706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:03.880708Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:03.880710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:03.880721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256409320987776:11357]
2025-10-01T14:14:03.880725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256409320987776:11357]
2025-10-01T14:14:03.880728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256409320987776:11357]
2025-10-01T14:14:03.880771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:03.880776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:03.880782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:03.880784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:03.880787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:03.880791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:03.880910Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:03.913784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256411697888969:11539]
2025-10-01T14:14:03.914021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2132, pipe: [1:7556256411697888969:11539]
2025-10-01T14:14:04.024280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:04.031103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.031132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.031271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.031324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.031379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.031439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.031486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.031493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.031549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.031603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.031653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.031708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.031750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.031755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.031826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.031898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.031958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.032016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.032056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.032062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.032121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.032180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.032237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.032299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.032340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.032345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.032403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.032458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.032516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.032576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.032637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.032643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.032703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.032759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.032817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.032878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.032922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.032928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.032987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.033044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.033106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.033164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.033214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.033219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.033274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.033326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.033383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.033439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.033479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.033484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.033541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.033598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.033656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.033714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.033754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.033760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.033814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.033868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.033924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.033978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.034016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.034025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.034068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256411697888969:11539], now have 1 active actors on pipe
2025-10-01T14:14:04.034309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:04.034323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:04.034340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:04.034347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2133 reason: error at write: Disconnected sessionId: src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0
2025-10-01T14:14:04.034412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256411697888969:11539]
2025-10-01T14:14:04.034510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2133 sessionId: src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0 is DEAD
2025-10-01T14:14:04.034663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:04.034675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0] Write session will restart in 0.009975s
2025-10-01T14:14:04.034701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0] Write session: Do CDS request
2025-10-01T14:14:04.034706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:04.034947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:04.045930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.045938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:04.045957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2134
2025-10-01T14:14:04.046139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.046175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:04.046181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:04.046186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:04.046625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2134 sessionId:  describe result for acl check
2025-10-01T14:14:04.046661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:04.046666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:04.046667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:04.046677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256415992856398:11729] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:04.047169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256415992856398:11729] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:04.049566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:04.049821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256415992856398:11729] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:04.052826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:04.053061Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:04.053072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:04.053084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:04.053118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256415992856398:11729] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:04.053138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256415992856398:11729] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:04.053141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256415992856398:11729] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:04.053149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:04.053142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:04.053185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256413615955293:11359]
2025-10-01T14:14:04.053780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:04.054058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:04.054101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:04.054424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:04.054481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.054487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.054489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.054490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.054491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.054492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.054493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.054494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.054495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.054496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.054497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.054498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.054499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.054501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.054506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.054517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.054521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.054525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.054528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.054531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.054535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.054538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.054542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.054546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.054550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.054553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.054557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.054560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.054567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.054574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.054580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.054585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.054590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.054596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.054599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.054605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.054609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.054615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.054619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.054624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.054629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.054634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.054638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.054643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.054647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.054651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.054662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.054667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.054671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.054676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.054685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.054690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.054699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.054703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.054712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.054717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.054754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:04.058576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:04.059568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:04.059584Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:04.059586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:04.059590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:04.059596Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2133 [2:7556256413615955293:11359]
2025-10-01T14:14:04.059614Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:04.059631Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:04.059634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.059638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.059640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.059657Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:04.059663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:04.059674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:04.059736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.059744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.059745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.059749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:04.059751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:04.059817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:04.059824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.059836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.059846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.059866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:04.059888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856483:11729], now have 1 active actors on pipe
2025-10-01T14:14:04.059896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856271:2446], now have 1 active actors on pipe
2025-10-01T14:14:04.059903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256413615955288:11359]
2025-10-01T14:14:04.059905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256413615955288:11359]
2025-10-01T14:14:04.059907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256413615955288:11359]
2025-10-01T14:14:04.059921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:04.059933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:04.059950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:04.059957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:04.059981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:04.059991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256413615955288:11359]
2025-10-01T14:14:04.059992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:04.059993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:04.059995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:04.060003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:04.060038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.060043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.060072Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:04.060084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.060088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.060091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:04.060100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.059956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2133
2025-10-01T14:14:04.059968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2133
2025-10-01T14:14:04.060107Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:04.060126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.060285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.060295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.060310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.060405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2134 partition: 0 MaxSeqNo: 45 sessionId: src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0
2025-10-01T14:14:04.060810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6c7c23ae-ebd930ba-7a28751d-c38543ed_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:04.063819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0] Write session: try to update token
2025-10-01T14:14:04.063839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:04.071699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:04.071724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:04.071734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256413615955288:11359]
2025-10-01T14:14:04.071772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:04.071778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:04.071979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:04.072139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:04.072291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:04.072442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:04.072660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:04.072707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:04.080567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2134 sessionId: src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:04.083365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:04.083570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.083607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.083648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:04.083722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:04.090165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:04.090189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:04.090191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:04.090193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:04.090203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256413615955288:11359]
2025-10-01T14:14:04.090207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256413615955288:11359]
2025-10-01T14:14:04.090210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256413615955288:11359]
2025-10-01T14:14:04.090256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:04.090255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:04.090260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:04.090265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:04.090269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.090272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:04.090438Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:04.134460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256415992856495:11539]
2025-10-01T14:14:04.134680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2133, pipe: [1:7556256415992856495:11539]
2025-10-01T14:14:04.237614Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:04.246217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.246249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.246429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.246526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.246601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.246678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.246727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.246732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.246807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.246877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.246972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.247055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.247101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.247104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.247202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.250404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:04.250425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:04.250460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2134 reason: error at write: Disconnected sessionId: src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0
2025-10-01T14:14:04.250605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2134 sessionId: src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0 is DEAD
2025-10-01T14:14:04.250715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:04.250724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0] Write session will restart in 0.006312s
2025-10-01T14:14:04.250752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0] Write session: Do CDS request
2025-10-01T14:14:04.250758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:04.250837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256415992856495:11539]
2025-10-01T14:14:04.250853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:04.247277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.247351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.247456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.247506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.247509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.247594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.247671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.247747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.247820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.247870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.247874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.247954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.248029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.248102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.248181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.248227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.248230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.248315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.248392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.248468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.248562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.248619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.248620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.248697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.248765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.248835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.248906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.248990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.248992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.249086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.249162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.249241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.249319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.249373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.249376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.249459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.249523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.249585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.249659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.249704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.249709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.249788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.249859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.249927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.249997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.250050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.250052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.250139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856495:11539], now have 1 active actors on pipe
2025-10-01T14:14:04.251475Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:04.257838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.257905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:04.257924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2135
2025-10-01T14:14:04.258218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.258265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:04.258274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:04.258278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:04.258709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2135 sessionId:  describe result for acl check
2025-10-01T14:14:04.258748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:04.258755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:04.258758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:04.258762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256415992856540:11739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:04.259300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256415992856540:11739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:04.261535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256415992856540:11739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:04.264402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256415992856540:11739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:04.264424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256415992856540:11739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:04.264427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256415992856540:11739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:04.264436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:04.266750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:04.270154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:04.270383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:04.270393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:04.270403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:04.270453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:04.270748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256413615955521:11362]
2025-10-01T14:14:04.271406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:04.271738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:04.271781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:04.272125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:04.272198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.272204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.272205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.272206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.272207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.272209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.272210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.272211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.272212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.272213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.272214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.272215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.272216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.272218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.272224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.272232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.272236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.272240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.272243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.272247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.272250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.272253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.272257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.272261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.272264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.272267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.272271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.272275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.272284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.272290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.272297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.272302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.272306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.272311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.272315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.272320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.272325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.272330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.272335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.272339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.272345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.272350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.272354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.272358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.272363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.272367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.272371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.272377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.272381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.272386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.272390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.272394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.272403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.272407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.272416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.272421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.272463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:04.276686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:04.277436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:04.277455Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:04.277457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:04.277462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:04.277469Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2134 [2:7556256413615955521:11362]
2025-10-01T14:14:04.277485Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:04.277508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:04.277516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.277519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.277522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.277536Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:04.277546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:04.277554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:04.277619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.277627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.277630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.277633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:04.277636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:04.277709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:04.277717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.277729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.277743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.277758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:04.277780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856510:2446], now have 1 active actors on pipe
2025-10-01T14:14:04.277789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856715:11739], now have 1 active actors on pipe
2025-10-01T14:14:04.277796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256413615955516:11362]
2025-10-01T14:14:04.277798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256413615955516:11362]
2025-10-01T14:14:04.277801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256413615955516:11362]
2025-10-01T14:14:04.277815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:04.277834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:04.277843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:04.277846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:04.277849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:04.277855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:04.277859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:04.277889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256413615955516:11362]
2025-10-01T14:14:04.277861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2134
2025-10-01T14:14:04.277898Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:04.277904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:04.277985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2134
2025-10-01T14:14:04.278030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.278041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.278066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d016521c-4db4207a-78085281-96a5c815_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:04.278079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.278088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.278091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:04.278105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.278116Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:04.278129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.279073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.279089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.279107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.279224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2135 partition: 0 MaxSeqNo: 45 sessionId: src_id|d016521c-4db4207a-78085281-96a5c815_0
2025-10-01T14:14:04.280479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c72e86c3-d5eef983-f7ebe492-7f56c91d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d016521c-4db4207a-78085281-96a5c815_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:04.283716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d016521c-4db4207a-78085281-96a5c815_0] Write session: try to update token
2025-10-01T14:14:04.283736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d016521c-4db4207a-78085281-96a5c815_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:04.289460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:04.289486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:04.289498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256413615955516:11362]
2025-10-01T14:14:04.289540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:04.289556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:04.289754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:04.289925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:04.290093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:04.290254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:04.290525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:04.290568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:04.299552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2135 sessionId: src_id|d016521c-4db4207a-78085281-96a5c815_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:04.302491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:04.302964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.302991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.303027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:04.303107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:04.310348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:04.310389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:04.310392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:04.310395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:04.310405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256413615955516:11362]
2025-10-01T14:14:04.310410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256413615955516:11362]
2025-10-01T14:14:04.310415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256413615955516:11362]
2025-10-01T14:14:04.310461Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:04.310469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:04.310475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.310476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:04.310478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:04.310479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:04.310651Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:04.351479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256415992856744:11539]
2025-10-01T14:14:04.351795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2134, pipe: [1:7556256415992856744:11539]
2025-10-01T14:14:04.445927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:04.455943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.455980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.456171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.456245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.456329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.456401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.456463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.456472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.456556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.456635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.456705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.456776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.456834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.456841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.456922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.456995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.457146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.457225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.457266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.457275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.457345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.457410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.457463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.457522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.457572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.457581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.457645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.457703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.457761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.457815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.457862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.457869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.457925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.457977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.458032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.458089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.458132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.458138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.458199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.458250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.458308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.458363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.458428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.458435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.458487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.458538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.458596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.458650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.458690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.458697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.458755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.458814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.458870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.458926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.458967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.458974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.459030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.459081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.459137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.459192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.459240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.459247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.459315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856744:11539], now have 1 active actors on pipe
2025-10-01T14:14:04.459581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:04.459618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256415992856744:11539]
2025-10-01T14:14:04.459645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:04.459653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:04.459681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2135 reason: error at write: Disconnected sessionId: src_id|d016521c-4db4207a-78085281-96a5c815_0
2025-10-01T14:14:04.459864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2135 sessionId: src_id|d016521c-4db4207a-78085281-96a5c815_0 is DEAD
2025-10-01T14:14:04.459993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d016521c-4db4207a-78085281-96a5c815_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:04.460005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d016521c-4db4207a-78085281-96a5c815_0] Write session will restart in 0.007295s
2025-10-01T14:14:04.460039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d016521c-4db4207a-78085281-96a5c815_0] Write session: Do CDS request
2025-10-01T14:14:04.460045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d016521c-4db4207a-78085281-96a5c815_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:04.460220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:04.468943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d016521c-4db4207a-78085281-96a5c815_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.469016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:04.469043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2136
2025-10-01T14:14:04.469143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.469166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:04.469176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:04.469180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:04.469645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2136 sessionId:  describe result for acl check
2025-10-01T14:14:04.469699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:04.469706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:04.469708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:04.469712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256415992856803:11744] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:04.470148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256415992856803:11744] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:04.472887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256415992856803:11744] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:04.475223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:04.475828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256415992856803:11744] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:04.475844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256415992856803:11744] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:04.475848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256415992856803:11744] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:04.475855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:04.477725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:04.477930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:04.477940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:04.477950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:04.478019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:04.478195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256413615955752:11367]
2025-10-01T14:14:04.478840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:04.479172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:04.479220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:04.479555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:04.479623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.479628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.479629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.479630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.479631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.479632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.479633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.479635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.479636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.479637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.479639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.479640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.479641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.479642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.479647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.479655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.479657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.479659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.479661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.479663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.479665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.479667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.479669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.479671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.479673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.479675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.479676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.479678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.479684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.479689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.479692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.479695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.479698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.479701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.479703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.479706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.479708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.479711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.479714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.479717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.479719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.479722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.479724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.479727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.479730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.479733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.479736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.479739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.479741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.479745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.479747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.479750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.479753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.479756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.479758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.479760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.479785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:04.483527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:04.484089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:04.484110Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:04.484111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:04.484114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:04.484118Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2135 [2:7556256413615955752:11367]
2025-10-01T14:14:04.484127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:04.484140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:04.484143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.484146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.484148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.484160Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:04.484171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:04.484175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:04.484214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.484220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.484222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.484224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:04.484225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:04.484280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:04.484287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.484295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.484304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.484317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:04.484333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856965:11744], now have 1 active actors on pipe
2025-10-01T14:14:04.484345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256413615955746:11367]
2025-10-01T14:14:04.484346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256413615955746:11367]
2025-10-01T14:14:04.484348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256413615955746:11367]
2025-10-01T14:14:04.484358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:04.484367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856749:2446], now have 1 active actors on pipe
2025-10-01T14:14:04.484373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:04.484372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:04.484377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:04.484378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:04.484385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:04.484388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:04.484410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256413615955746:11367]
2025-10-01T14:14:04.484423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:04.484434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:04.484440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2135
2025-10-01T14:14:04.484442Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2135
2025-10-01T14:14:04.484542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.484567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.484606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:04.484621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.484625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.484632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:04.484640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.484651Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:04.484671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.484810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.484818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.484828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.484900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2136 partition: 0 MaxSeqNo: 45 sessionId: src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0
2025-10-01T14:14:04.485253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d016521c-4db4207a-78085281-96a5c815_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:04.488023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0] Write session: try to update token
2025-10-01T14:14:04.488042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:04.501554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2136 sessionId: src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:04.504186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:04.504875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.504903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.504924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:04.504927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:04.504930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:04.504932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:04.504941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256413615955746:11367]
2025-10-01T14:14:04.504946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256413615955746:11367]
2025-10-01T14:14:04.504950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256413615955746:11367]
2025-10-01T14:14:04.504993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:04.505002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:04.505008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.505009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:04.505011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:04.505012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:04.505163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:04.559939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256415992856982:11539]
2025-10-01T14:14:04.560304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2135, pipe: [1:7556256415992856982:11539]
2025-10-01T14:14:04.639319Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:04.639826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:04.639886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856982:11539], now have 1 active actors on pipe
2025-10-01T14:14:04.640056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:04.640112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:04.640167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:04.640169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256415992856982:11539]
2025-10-01T14:14:04.640175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:04.640240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2136 reason: error at write: Disconnected sessionId: src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0
2025-10-01T14:14:04.640413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2136 sessionId: src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0 is DEAD
2025-10-01T14:14:04.640567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:04.640577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0] Write session will restart in 0.006519s
2025-10-01T14:14:04.640615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0] Write session: Do CDS request
2025-10-01T14:14:04.640622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:04.648852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.648927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:04.648950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2137
2025-10-01T14:14:04.649149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.649187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:04.649199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:04.649203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:04.649778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2137 sessionId:  describe result for acl check
2025-10-01T14:14:04.649821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:04.649826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:04.649828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:04.649834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256415992857014:11749] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:04.650411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256415992857014:11749] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:04.653011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256415992857014:11749] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:04.656694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256415992857014:11749] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:04.656709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256415992857014:11749] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:04.656712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256415992857014:11749] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:04.656720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:04.658155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:04.661055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:04.661266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:04.661276Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:04.661300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:04.661355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:04.661398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256413615956003:11379]
2025-10-01T14:14:04.662002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:04.662336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:04.662401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:04.662715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:04.662776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.662787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.662789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.662790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.662791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.662792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.662794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.662795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.662796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.662797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.662798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.662799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.662800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.662801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.662806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.662816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.662820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.662824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.662828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.662831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.662835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.662840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.662843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.662848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.662851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.662854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.662858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.662861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.662869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.662876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.662882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.662887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.662893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.662898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.662903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.662908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.662913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.662918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.662923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.662928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.662933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.662937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.662942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.662947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.662952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.662957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.662961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.662966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.662972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.662977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.662981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.662985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.662991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.662995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.663000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.663005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.663044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:04.666901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:04.667588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:04.667604Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:04.667607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:04.667610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:04.667617Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2136 [2:7556256413615956003:11379]
2025-10-01T14:14:04.667633Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:04.667650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:04.667658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.667662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.667664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.667679Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:04.667690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:04.667697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:04.667758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.667770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.667772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.667775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:04.667778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:04.667848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:04.667856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.667867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.667877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.667892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:04.667924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992857201:11749], now have 1 active actors on pipe
2025-10-01T14:14:04.667932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992856987:2446], now have 1 active actors on pipe
2025-10-01T14:14:04.667938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256413615955998:11379]
2025-10-01T14:14:04.667940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256413615955998:11379]
2025-10-01T14:14:04.667943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256413615955998:11379]
2025-10-01T14:14:04.667954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:04.667967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:04.667973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:04.667976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:04.667978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:04.667981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:04.667984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:04.668007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256413615955998:11379]
2025-10-01T14:14:04.667986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2136
2025-10-01T14:14:04.668015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:04.668018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:04.667993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2136
2025-10-01T14:14:04.668030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.668038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.668087Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:04.668099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.668102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.668105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:04.668117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.668131Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:04.668150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.668305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.668314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.668326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.668416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2137 partition: 0 MaxSeqNo: 45 sessionId: src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0
2025-10-01T14:14:04.668799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a1ec9b0-cda06fd0-9373377f-f87e8667_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:04.671733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0] Write session: try to update token
2025-10-01T14:14:04.671753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:04.689182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2137 sessionId: src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:04.691290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:04.691708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.691736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.691798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:04.691881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:04.693968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:04.693990Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:04.693993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:04.693995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:04.694004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256413615955998:11379]
2025-10-01T14:14:04.694011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256413615955998:11379]
2025-10-01T14:14:04.694016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256413615955998:11379]
2025-10-01T14:14:04.694068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:04.694077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.694088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:04.694087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:04.694094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:04.694099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:04.694247Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:04.740136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256415992857228:11539]
2025-10-01T14:14:04.740381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2136, pipe: [1:7556256415992857228:11539]
2025-10-01T14:14:04.826381Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:04.835089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.835119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.835297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.835362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.835430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.835495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.835547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.835557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.835629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.835691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.835757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.835827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.835880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.835885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.835948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.836003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.836064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.836126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.836179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.836187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.836248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.836308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.836362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.836421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.836469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.836474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.836535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.836600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.836658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.836718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.836766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.836772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.836831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.836887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.836942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.836999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.837046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.837052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.837109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.837164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.837222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.837280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.837325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.837330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.837387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.837440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.837498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.837552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.837596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.837606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.837661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.837714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.837769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.837825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.837869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.837875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.837936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:04.837989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:04.838043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:04.838095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:04.838139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:04.838146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:04.838200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992857228:11539], now have 1 active actors on pipe
2025-10-01T14:14:04.838463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:04.838485Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:04.838514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2137 reason: error at write: Disconnected sessionId: src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0
2025-10-01T14:14:04.838656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2137 sessionId: src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0 is DEAD
2025-10-01T14:14:04.838804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:04.838815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0] Write session will restart in 0.007430s
2025-10-01T14:14:04.838795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256415992857228:11539]
2025-10-01T14:14:04.838833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0] Write session: Do CDS request
2025-10-01T14:14:04.838839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:04.838850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:04.839721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:04.847820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.848014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:04.848030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2138
2025-10-01T14:14:04.848151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:04.848178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:04.848187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:04.848190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:04.848606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2138 sessionId:  describe result for acl check
2025-10-01T14:14:04.848644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:04.848651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:04.848652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:04.848657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256415992857338:11754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:04.849088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256415992857338:11754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:04.851294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256415992857338:11754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:04.851956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:04.854170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:04.854316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:04.854327Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:04.854336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:04.854346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256415992857338:11754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:04.854360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256415992857338:11754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:04.854366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256415992857338:11754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:04.854393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:04.854366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:04.854420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256413615956225:11382]
2025-10-01T14:14:04.854825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:04.855041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:04.855069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:04.855283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:04.855322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.855328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.855329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.855330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.855331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.855332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.855333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.855333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.855334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.855335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.855336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.855336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.855337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.855338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.855341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.855347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.855349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.855351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.855353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.855356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.855358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.855360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.855362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.855365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.855367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.855369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.855372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.855374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.855378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.855383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:04.855387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.855390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:04.855392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.855395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:04.855398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.855401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:04.855403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.855406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:04.855408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.855411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:04.855414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.855417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:04.855419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.855422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:04.855426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.855429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:04.855431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.855435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.855437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.855440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.855443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.855446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.855449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.855451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:04.855454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.855458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:04.855479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:04.859120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:04.859701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:04.859715Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:04.859717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:04.859719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:04.859723Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2137 [2:7556256413615956225:11382]
2025-10-01T14:14:04.859734Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:04.859746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:04.859748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.859750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.859752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.859763Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:04.859766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:04.859770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:04.859804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.859811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.859813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.859815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:04.859817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:04.859870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:04.859876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.859883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:04.859888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:04.859897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:04.859909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992857446:11754], now have 1 active actors on pipe
2025-10-01T14:14:04.859916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992857230:2446], now have 1 active actors on pipe
2025-10-01T14:14:04.859921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256413615956220:11382]
2025-10-01T14:14:04.859923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256413615956220:11382]
2025-10-01T14:14:04.859925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256413615956220:11382]
2025-10-01T14:14:04.859934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:04.859943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:04.859956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:04.859955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:04.859958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:04.859959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:04.859961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:04.859975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256413615956220:11382]
2025-10-01T14:14:04.859982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:04.859985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:04.860005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2137
2025-10-01T14:14:04.860010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2137
2025-10-01T14:14:04.860083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.860097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.860120Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:04.860132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:04.860135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:04.860137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:04.860144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:04.860153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:04.860170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.860297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.860304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.860312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:04.860383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2138 partition: 0 MaxSeqNo: 45 sessionId: src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0
2025-10-01T14:14:04.860704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ca523bc-24fb5965-8e847da2-f4075fde_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:04.863312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0] Write session: try to update token
2025-10-01T14:14:04.863331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:04.870905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:04.870928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:04.870938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256413615956220:11382]
2025-10-01T14:14:04.870975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:04.870980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:04.871157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:04.871307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:04.871453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:04.871599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:04.871857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:04.871900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:04.876634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2138 sessionId: src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:04.879030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:04.879307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:04.879191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:04.879210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:04.879237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:04.889238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:04.889256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:04.889258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:04.889260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:04.889267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256413615956220:11382]
2025-10-01T14:14:04.889270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256413615956220:11382]
2025-10-01T14:14:04.889273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256413615956220:11382]
2025-10-01T14:14:04.889303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:04.889305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:04.889308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:04.889310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:04.889310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:04.889311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:04.889416Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:04.938759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256415992857461:11539]
2025-10-01T14:14:04.939008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2137, pipe: [1:7556256415992857461:11539]
2025-10-01T14:14:05.021595Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:05.028160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.028191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.028354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.028418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.028480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.028549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.028607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.028615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.028681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.028746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.028813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.028880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.028926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.028932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.028979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.029027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.029078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.029128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.029165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.029170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.029221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.029272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.029326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.029383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.029419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.029424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.029475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.029522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.029574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.029625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.029663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.029669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.029719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.029767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.029820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.029870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.029913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.029925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.029983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.030036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.030089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.030143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.030181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.030187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.030244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.030294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.030349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.030423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.030464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.030469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.030520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.030570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.030621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.030672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.030709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.030716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.030766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.030815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.030867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.030925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.030981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.030987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.031026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256415992857461:11539], now have 1 active actors on pipe
2025-10-01T14:14:05.031519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:05.031537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:05.031552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:05.031560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2138 reason: error at write: Disconnected sessionId: src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0
2025-10-01T14:14:05.031613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256415992857461:11539]
2025-10-01T14:14:05.031706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2138 sessionId: src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0 is DEAD
2025-10-01T14:14:05.031804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:05.031854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:05.031863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0] Write session will restart in 0.005218s
2025-10-01T14:14:05.031891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0] Write session: Do CDS request
2025-10-01T14:14:05.031898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:05.037894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.037941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:05.037959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2139
2025-10-01T14:14:05.038145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.038180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:05.038190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:05.038198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:05.038735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2139 sessionId:  describe result for acl check
2025-10-01T14:14:05.038795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:05.038803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:05.038806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:05.038812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256420287824775:11759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:05.039424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256420287824775:11759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:05.043140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256420287824775:11759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:05.046844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256420287824775:11759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:05.046864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256420287824775:11759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:05.046867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256420287824775:11759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:05.046876Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:05.048449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:05.048933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:05.049084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:05.049092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:05.049100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:05.049129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:05.049159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256417910923744:11384]
2025-10-01T14:14:05.049536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:05.051582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:05.051614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:05.051810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:05.051846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.051850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.051851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.051852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.051852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.051853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.051854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.051854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.051855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.051855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.051856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.051857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.051857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.051858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.051861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.051867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.051869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.051871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.051873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.051875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.051877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.051879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.051881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.051883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.051885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.051887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.051889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.051891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.051896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.051900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.051904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.051908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.051910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.051913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.051915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.051918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.051920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.051923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.051925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.051927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.051929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.051932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.051934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.051937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.051941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.051946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.051949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.051953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.051957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.051961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.051965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.051970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.051974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.051978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.051982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.051985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.052014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:05.055611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:05.056170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:05.056184Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:05.056185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:05.056188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:05.056192Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2138 [2:7556256417910923744:11384]
2025-10-01T14:14:05.056202Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:05.056214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:05.056215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.056218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.056219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.056229Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:05.056237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:05.056241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:05.056281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.056286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.056289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.056291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:05.056294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:05.056340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:05.056345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.056351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.056357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.056368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:05.056382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256417910923739:11384]
2025-10-01T14:14:05.056388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256417910923739:11384]
2025-10-01T14:14:05.056390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256417910923739:11384]
2025-10-01T14:14:05.056396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:05.056408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:05.056410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:05.056415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:05.056418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:05.056419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:05.056420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:05.056443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287824969:11759], now have 1 active actors on pipe
2025-10-01T14:14:05.056448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287824759:2446], now have 1 active actors on pipe
2025-10-01T14:14:05.056450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256417910923739:11384]
2025-10-01T14:14:05.056456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:05.056468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:05.056515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2138
2025-10-01T14:14:05.056519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2138
2025-10-01T14:14:05.056592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.056599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.056619Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:05.056628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.056633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.056635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:05.056640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.056649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:05.056662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.056816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.056821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.056830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.056904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2139 partition: 0 MaxSeqNo: 45 sessionId: src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0
2025-10-01T14:14:05.057201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e42874de-8abf9afe-e2ad58f5-7683ea1d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:05.059887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0] Write session: try to update token
2025-10-01T14:14:05.059902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:05.067616Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:05.067638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:05.067648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256417910923739:11384]
2025-10-01T14:14:05.067697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:05.067716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:05.067889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:05.068024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:05.068172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:05.068305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:05.068494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:05.068525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:05.073342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2139 sessionId: src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:05.075780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:05.075977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.076005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.076034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:05.076108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:05.086471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:05.086493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:05.086496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:05.086498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:05.086509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256417910923739:11384]
2025-10-01T14:14:05.086514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256417910923739:11384]
2025-10-01T14:14:05.086518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256417910923739:11384]
2025-10-01T14:14:05.086556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:05.086563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.086568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:05.086568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:05.086575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:05.086579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:05.086706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:05.131980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256420287824991:11539]
2025-10-01T14:14:05.132247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2138, pipe: [1:7556256420287824991:11539]
2025-10-01T14:14:05.209465Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:05.218414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.218438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.218599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.218655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.218723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.218783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.218830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.218836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.218907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.218973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.219029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.219097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.219151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.219156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.219223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.219288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.219355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.219425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.219473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.219480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.219551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.219611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.219674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.219742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.219798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.219803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.219871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.219935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.219997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.220055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.220106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.220111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.220180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.220241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.220308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.220366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.220413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.220419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.220486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.220548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.220620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.220679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.220726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.220733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.220795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.220856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.220917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.220985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.221039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.221044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.221105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.221157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.221217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.221280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.221327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.221332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.221392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.221445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.221504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.221564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.221613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.221617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.221672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287824991:11539], now have 1 active actors on pipe
2025-10-01T14:14:05.221907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:05.221918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:05.221931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256420287824991:11539]
2025-10-01T14:14:05.221945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2139 reason: error at write: Disconnected sessionId: src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0
2025-10-01T14:14:05.221959Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:05.222116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2139 sessionId: src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0 is DEAD
2025-10-01T14:14:05.222265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:05.222276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0] Write session will restart in 0.006558s
2025-10-01T14:14:05.222296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0] Write session: Do CDS request
2025-10-01T14:14:05.222301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:05.222678Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:05.229836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.229936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:05.229946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2140
2025-10-01T14:14:05.230055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.230078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:05.230085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:05.230088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:05.230353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2140 sessionId:  describe result for acl check
2025-10-01T14:14:05.230389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:05.230395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:05.230396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:05.230399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256420287825045:11763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:05.230802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256420287825045:11763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:05.233336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256420287825045:11763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:05.235499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:05.235767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256420287825045:11763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:05.235779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256420287825045:11763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:05.235781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256420287825045:11763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:05.235787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:05.238783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:05.238958Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:05.238967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:05.238977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:05.239019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:05.239109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256417910923970:11387]
2025-10-01T14:14:05.239739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:05.240079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:05.240119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:05.240422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:05.240478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.240483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.240484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.240485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.240486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.240487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.240488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.240490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.240491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.240492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.240493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.240495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.240496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.240498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.240503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.240513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.240516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.240519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.240527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.240531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.240539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.240542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.240550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.240558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.240563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.240567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.240574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.240578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.240597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.240608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.240614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.240622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.240631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.240639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.240646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.240650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.240658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.240668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.240675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.240681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.240689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.240696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.240703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.240708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.240717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.240721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.240725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.240729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.240734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.240739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.240743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.240748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.240753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.240758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.240762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.240767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.240808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:05.244891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:05.245547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:05.245560Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:05.245563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:05.245569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:05.245576Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2139 [2:7556256417910923970:11387]
2025-10-01T14:14:05.245593Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:05.245609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:05.245615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.245617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.245619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.245631Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:05.245638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:05.245643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:05.245687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.245692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.245694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.245697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:05.245700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:05.245753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:05.245759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.245765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.245771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.245780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:05.245791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256417910923964:11387]
2025-10-01T14:14:05.245796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256417910923964:11387]
2025-10-01T14:14:05.245797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256417910923964:11387]
2025-10-01T14:14:05.245803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:05.245813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:05.245826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:05.245831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:05.245833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:05.245837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:05.245839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:05.245857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256417910923964:11387]
2025-10-01T14:14:05.245868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:05.245874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287824998:2446], now have 1 active actors on pipe
2025-10-01T14:14:05.245880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825217:11763], now have 1 active actors on pipe
2025-10-01T14:14:05.245886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:05.245975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2139
2025-10-01T14:14:05.246059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.246066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.246082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bff2405-b0c90a11-6df420b-75d48923_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:05.246091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.246094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.246096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:05.246103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.246113Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:05.246122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.246123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2139
2025-10-01T14:14:05.246234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.246240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.246248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.246321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2140 partition: 0 MaxSeqNo: 45 sessionId: src_id|7bff2405-b0c90a11-6df420b-75d48923_0
2025-10-01T14:14:05.246743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85fe4cbd-a9df12a1-791ab589-1b944015_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7bff2405-b0c90a11-6df420b-75d48923_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:05.249348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bff2405-b0c90a11-6df420b-75d48923_0] Write session: try to update token
2025-10-01T14:14:05.249363Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bff2405-b0c90a11-6df420b-75d48923_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:05.257926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:05.257948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:05.257958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256417910923964:11387]
2025-10-01T14:14:05.258001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:05.258015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:05.258168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:05.258309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:05.258481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:05.258630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:05.258944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:05.258997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:05.261816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2140 sessionId: src_id|7bff2405-b0c90a11-6df420b-75d48923_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:05.264486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:05.264828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.264843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.264873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:05.264978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:05.277504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:05.277520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:05.277522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:05.277524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:05.277534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256417910923964:11387]
2025-10-01T14:14:05.277537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256417910923964:11387]
2025-10-01T14:14:05.277540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256417910923964:11387]
2025-10-01T14:14:05.277578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:05.277583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.277585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:05.277594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:05.277601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:05.277605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:05.277703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:05.322293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256420287825251:11539]
2025-10-01T14:14:05.322546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2139, pipe: [1:7556256420287825251:11539]
2025-10-01T14:14:05.420216Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:05.428394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.428420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.428599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.428664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.428729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.428791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.428834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.428842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.428912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.428972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.429032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.429099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.429139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.429145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.429206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.429264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.429323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.429383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.429424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.429431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.429494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.429549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.429608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.429663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.429703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.429709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.429767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.429824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.429880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.429946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.429988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.429995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.430055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.430109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.430165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.430222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.430270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.430277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.430340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.430409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.430469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.430528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.430568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.430576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.430639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.430691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.430744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.430807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.430851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.430858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.430916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.430966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.431017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.431069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.431107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.431112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.431172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.431237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.431294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.431355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.431394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.431400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.431461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825251:11539], now have 1 active actors on pipe
2025-10-01T14:14:05.431751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:05.431796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:05.431800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:05.431811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256420287825251:11539]
2025-10-01T14:14:05.431833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2140 reason: error at write: Disconnected sessionId: src_id|7bff2405-b0c90a11-6df420b-75d48923_0
2025-10-01T14:14:05.432009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2140 sessionId: src_id|7bff2405-b0c90a11-6df420b-75d48923_0 is DEAD
2025-10-01T14:14:05.432166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bff2405-b0c90a11-6df420b-75d48923_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:05.432178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bff2405-b0c90a11-6df420b-75d48923_0] Write session will restart in 0.008512s
2025-10-01T14:14:05.432204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bff2405-b0c90a11-6df420b-75d48923_0] Write session: Do CDS request
2025-10-01T14:14:05.432210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bff2405-b0c90a11-6df420b-75d48923_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:05.432387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:05.441979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bff2405-b0c90a11-6df420b-75d48923_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.442053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:05.442072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2141
2025-10-01T14:14:05.442270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.442305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:05.442315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:05.442325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:05.442798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2141 sessionId:  describe result for acl check
2025-10-01T14:14:05.442834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:05.442840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:05.442845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:05.442850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256420287825305:11774] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:05.443695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256420287825305:11774] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:05.447644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256420287825305:11774] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:05.449826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:05.450493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256420287825305:11774] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:05.450510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256420287825305:11774] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:05.450514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256420287825305:11774] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:05.450523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:05.453011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:05.453200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:05.453211Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:05.453220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:05.453262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:05.453302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256417910924213:11392]
2025-10-01T14:14:05.453799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:05.454142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:05.454204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:05.454572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:05.454662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.454670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.454671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.454672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.454673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.454675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.454676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.454678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.454680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.454682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.454683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.454685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.454686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.454687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.454693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.454703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.454707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.454711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.454714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.454719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.454723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.454727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.454732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.454736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.454740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.454744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.454748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.454752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.454760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.454773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.454784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.454791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.454803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.454809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.454819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.454825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.454831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.454836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.454847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.454853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.454858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.454870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.454875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.454886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.454891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.454896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.454901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.454907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.454912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.454918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.454929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.454934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.454939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.454949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.454953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.454966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.455009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:05.458937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:05.459605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:05.459618Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:05.459621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:05.459625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:05.459631Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2140 [2:7556256417910924213:11392]
2025-10-01T14:14:05.459648Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:05.459669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:05.459676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.459679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.459682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.459699Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:05.459708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:05.459714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:05.459776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.459784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.459786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.459789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:05.459792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:05.459857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:05.459864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.459875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.459888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.459905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:05.459927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825254:2446], now have 1 active actors on pipe
2025-10-01T14:14:05.459934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825474:11774], now have 1 active actors on pipe
2025-10-01T14:14:05.459942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256417910924207:11392]
2025-10-01T14:14:05.459945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256417910924207:11392]
2025-10-01T14:14:05.459947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256417910924207:11392]
2025-10-01T14:14:05.459961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:05.459974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:05.459976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:05.459979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:05.459981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:05.459993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:05.460000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:05.460037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256417910924207:11392]
2025-10-01T14:14:05.460048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:05.460058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:05.460092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2140
2025-10-01T14:14:05.460538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2140
2025-10-01T14:14:05.460619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.460629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.460655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:05.460666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.460673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.460676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:05.460687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.460700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:05.460719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.460890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.460897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.460911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.461018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2141 partition: 0 MaxSeqNo: 45 sessionId: src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0
2025-10-01T14:14:05.461370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bff2405-b0c90a11-6df420b-75d48923_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:05.464331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0] Write session: try to update token
2025-10-01T14:14:05.464349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:05.471861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:05.471879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:05.471888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256417910924207:11392]
2025-10-01T14:14:05.471940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:05.471938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:05.472157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:05.472331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:05.472523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:05.472704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:05.472936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:05.472973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:05.482419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2141 sessionId: src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:05.485115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:05.485356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.485379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.485417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:05.485532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:05.490993Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:05.491008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:05.491011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:05.491013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:05.491025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256417910924207:11392]
2025-10-01T14:14:05.491030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256417910924207:11392]
2025-10-01T14:14:05.491035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256417910924207:11392]
2025-10-01T14:14:05.491077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:05.491081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:05.491087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.491090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:05.491091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:05.491094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:05.491219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:05.533782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256420287825489:11539]
2025-10-01T14:14:05.534063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2140, pipe: [1:7556256420287825489:11539]
2025-10-01T14:14:05.634155Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:05.641258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.641282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.641418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.641470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.641525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.641576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.641617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.641624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.641678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.641733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.641793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.641858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.641898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.641903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.641964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.642015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.642069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.642123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.642164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.642169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.642228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.642280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.642336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.642405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.642445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.642451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.642506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.642560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.642613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.642664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.642703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.642708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.642763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.642820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.642887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.642949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.642991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.642996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.643055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.643105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.643159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.643215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.643256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.643261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.643315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.643368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.643424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.643475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.643515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.643520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.643578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.643630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.643684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.643738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.643778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.643784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.643838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:05.643887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:05.643954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:05.644019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:05.644061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:05.644066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:05.644108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825489:11539], now have 1 active actors on pipe
2025-10-01T14:14:05.644316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256420287825489:11539]
2025-10-01T14:14:05.644323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:05.644327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:05.644351Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:05.644363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2141 reason: error at write: Disconnected sessionId: src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0
2025-10-01T14:14:05.644561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2141 sessionId: src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0 is DEAD
2025-10-01T14:14:05.644691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:05.644701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0] Write session will restart in 0.005702s
2025-10-01T14:14:05.644720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0] Write session: Do CDS request
2025-10-01T14:14:05.644726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:05.645077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:05.651869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.652029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:05.652044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2142
2025-10-01T14:14:05.652190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.652221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:05.652225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:05.652229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:05.652958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2142 sessionId:  describe result for acl check
2025-10-01T14:14:05.652990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:05.652991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:05.652993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:05.652999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256420287825567:11779] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:05.653502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256420287825567:11779] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:05.656463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256420287825567:11779] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:05.657353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:05.659844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:05.659977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:05.659985Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:05.659992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:05.660023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:05.660054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256417910924469:11404]
2025-10-01T14:14:05.660331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256420287825567:11779] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:05.660347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256420287825567:11779] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:05.660351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256420287825567:11779] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:05.660359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:05.660492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:05.660702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:05.660729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:05.660941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:05.660979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.660984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.660985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.660985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.660986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.660987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.660988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.660989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.660989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.660990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.660991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.660992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.660992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.660993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.660996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.661002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.661004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.661007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.661009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.661011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.661013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.661015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.661018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.661020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.661022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.661024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.661026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.661029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.661034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.661038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.661042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.661046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.661049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.661052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.661054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.661057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.661059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.661062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.661065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.661068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.661070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.661073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.661076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.661078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.661081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.661084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.661086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.661093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.661096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.661098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.661101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.661106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.661108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.661111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.661113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.661119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.661140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:05.665171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:05.665805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:05.665819Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:05.665822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:05.665825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:05.665832Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2141 [2:7556256417910924469:11404]
2025-10-01T14:14:05.665849Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:05.665869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:05.665873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.665876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.665883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.665899Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:05.665911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:05.665917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:05.665976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.665982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.665986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.665990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:05.665993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:05.666058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:05.666065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.666076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.666090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.666110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:05.666156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825716:11779], now have 1 active actors on pipe
2025-10-01T14:14:05.666163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825499:2446], now have 1 active actors on pipe
2025-10-01T14:14:05.666170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256417910924462:11404]
2025-10-01T14:14:05.666173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256417910924462:11404]
2025-10-01T14:14:05.666176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256417910924462:11404]
2025-10-01T14:14:05.666189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:05.666200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:05.666206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:05.666207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:05.666209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:05.666219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:05.666222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:05.666197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2141
2025-10-01T14:14:05.666204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2141
2025-10-01T14:14:05.666257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256417910924462:11404]
2025-10-01T14:14:05.666269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:05.666276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:05.666287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.666295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.666345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:05.666356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.666365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.666383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:05.666392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.666406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:05.666429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.666607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.666615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.666628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.666710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2142 partition: 0 MaxSeqNo: 45 sessionId: src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0
2025-10-01T14:14:05.667043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb31de9-2309fcee-d3319f29-bd81d2ef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:05.669773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0] Write session: try to update token
2025-10-01T14:14:05.669788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:05.684163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2142 sessionId: src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:05.686843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:05.687917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.687963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.687983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:05.687994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:05.687998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:05.688001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:05.688009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256417910924462:11404]
2025-10-01T14:14:05.688014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256417910924462:11404]
2025-10-01T14:14:05.688018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256417910924462:11404]
2025-10-01T14:14:05.688065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:05.688074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:05.688078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:05.688080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.688082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:05.688083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:05.688221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:05.744676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256420287825742:11539]
2025-10-01T14:14:05.744919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2141, pipe: [1:7556256420287825742:11539]
2025-10-01T14:14:05.825793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:05.826076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:05.826116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825742:11539], now have 1 active actors on pipe
2025-10-01T14:14:05.826163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:05.826248Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256420287825742:11539]
2025-10-01T14:14:05.826278Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:05.834505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:05.834515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:05.834536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2142 reason: error at write: Disconnected sessionId: src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0
2025-10-01T14:14:05.834701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2142 sessionId: src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0 is DEAD
2025-10-01T14:14:05.834843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:05.834853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0] Write session will restart in 0.005324s
2025-10-01T14:14:05.834877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0] Write session: Do CDS request
2025-10-01T14:14:05.834884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:05.840849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.840935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:05.840947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2143
2025-10-01T14:14:05.841048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:05.841071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:05.841078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:05.841081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:05.841377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2143 sessionId:  describe result for acl check
2025-10-01T14:14:05.841402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:05.841407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:05.841408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:05.841411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256420287825916:11784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:05.841794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256420287825916:11784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:05.843181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:05.843854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256420287825916:11784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:05.845366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:05.845558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:05.845566Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:05.845573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:05.845614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:05.845644Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256417910924697:11407]
2025-10-01T14:14:05.846019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:05.846050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256420287825916:11784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:05.846060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256420287825916:11784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:05.846063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256420287825916:11784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:05.846069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:05.846278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:05.846303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:05.846504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:05.846551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.846556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.846557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.846557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.846558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.846559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.846560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.846560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.846561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.846562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.846562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.846563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.846563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.846564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.846568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.846573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.846575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.846577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.846579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.846582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.846583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.846585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.846588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.846590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.846594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.846598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.846601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.846604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.846612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.846618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:05.846624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.846628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:05.846630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.846633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:05.846635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.846638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:05.846644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.846648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:05.846650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.846653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:05.846655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.846658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:05.846663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.846666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:05.846668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.846671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:05.846675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.846677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.846680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.846683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.846685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.846691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.846725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.846730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:05.846736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.846739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:05.846758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:05.850283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:05.850867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:05.850879Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:05.850881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:05.850883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:05.850888Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2142 [2:7556256417910924697:11407]
2025-10-01T14:14:05.850898Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:05.850911Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:05.850916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.850918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.850919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.850931Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:05.850937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:05.850941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:05.850978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.850983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.850984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.850987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:05.850988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:05.851031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:05.851036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.851043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:05.851051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:05.851063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:05.851077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256417910924692:11407]
2025-10-01T14:14:05.851081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256417910924692:11407]
2025-10-01T14:14:05.851083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256417910924692:11407]
2025-10-01T14:14:05.851089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:05.851098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:05.851102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825968:11784], now have 1 active actors on pipe
2025-10-01T14:14:05.851106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:05.851106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:05.851107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:05.851113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:05.851115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:05.851119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825746:2446], now have 1 active actors on pipe
2025-10-01T14:14:05.851136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256417910924692:11407]
2025-10-01T14:14:05.851144Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:05.851158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:05.851168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2142
2025-10-01T14:14:05.851190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.851197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.851199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2142
2025-10-01T14:14:05.851220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|118dbde7-1f4561c8-53b2f189-2517b836_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:05.851231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:05.851238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:05.851240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:05.851248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:05.851258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:05.851274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.851396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.851401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.851410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:05.851480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2143 partition: 0 MaxSeqNo: 45 sessionId: src_id|118dbde7-1f4561c8-53b2f189-2517b836_0
2025-10-01T14:14:05.851812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f30a9e-4ed89ddd-446e21b0-80ee08f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|118dbde7-1f4561c8-53b2f189-2517b836_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:05.854312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118dbde7-1f4561c8-53b2f189-2517b836_0] Write session: try to update token
2025-10-01T14:14:05.854323Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118dbde7-1f4561c8-53b2f189-2517b836_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:05.866355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2143 sessionId: src_id|118dbde7-1f4561c8-53b2f189-2517b836_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:05.868524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:05.870532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:05.870550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:05.870566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:05.870569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:05.870571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:05.870572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:05.870578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256417910924692:11407]
2025-10-01T14:14:05.870583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256417910924692:11407]
2025-10-01T14:14:05.870586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256417910924692:11407]
2025-10-01T14:14:05.870616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:05.870624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:05.870627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:05.870629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:05.870633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:05.870634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:05.870748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:05.926441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256420287825980:11539]
2025-10-01T14:14:05.926727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2142, pipe: [1:7556256420287825980:11539]
2025-10-01T14:14:06.011477Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:06.012001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:06.012049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256420287825980:11539], now have 1 active actors on pipe
2025-10-01T14:14:06.012113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:06.012232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256420287825980:11539]
2025-10-01T14:14:06.012261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:06.020284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:06.020299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:06.020317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2143 reason: error at write: Disconnected sessionId: src_id|118dbde7-1f4561c8-53b2f189-2517b836_0
2025-10-01T14:14:06.020419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2143 sessionId: src_id|118dbde7-1f4561c8-53b2f189-2517b836_0 is DEAD
2025-10-01T14:14:06.020556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118dbde7-1f4561c8-53b2f189-2517b836_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:06.020588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118dbde7-1f4561c8-53b2f189-2517b836_0] Write session will restart in 0.006113s
2025-10-01T14:14:06.020615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118dbde7-1f4561c8-53b2f189-2517b836_0] Write session: Do CDS request
2025-10-01T14:14:06.020626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118dbde7-1f4561c8-53b2f189-2517b836_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:06.027836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|118dbde7-1f4561c8-53b2f189-2517b836_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.027905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:06.027915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2144
2025-10-01T14:14:06.028038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.028062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:06.028068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:06.028071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:06.028382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2144 sessionId:  describe result for acl check
2025-10-01T14:14:06.028412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:06.028420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:06.028422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:06.028426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256424582793450:11789] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:06.028846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256424582793450:11789] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:06.030329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:06.030939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256424582793450:11789] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:06.033110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:06.033269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:06.033277Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:06.033285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:06.033317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:06.033346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256422205892221:11409]
2025-10-01T14:14:06.033428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256424582793450:11789] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:06.033439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256424582793450:11789] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:06.033441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256424582793450:11789] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:06.033447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:06.033743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:06.033944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:06.033989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:06.034177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:06.034213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.034217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.034218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.034219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.034219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.034220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.034221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.034222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.034222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.034223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.034224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.034225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.034225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.034226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.034229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.034234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.034237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.034239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.034241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.034243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.034245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.034247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.034249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.034252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.034254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.034256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.034258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.034260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.034265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.034269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.034274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.034277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.034280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.034282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.034285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.034287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.034291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.034294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.034296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.034299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.034301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.034304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.034307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.034310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.034312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.034315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.034318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.034321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.034323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.034327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.034330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.034332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.034334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.034337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.034339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.034341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.034360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:06.037840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:06.038460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:06.038469Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:06.038470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:06.038473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:06.038479Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2143 [2:7556256422205892221:11409]
2025-10-01T14:14:06.038489Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:06.038501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:06.038503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.038505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.038506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.038518Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:06.038525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:06.038529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:06.038571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.038577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.038580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.038583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:06.038585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:06.038640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:06.038645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.038652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.038657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.038669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:06.038685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582793505:11789], now have 1 active actors on pipe
2025-10-01T14:14:06.038690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582793281:2446], now have 1 active actors on pipe
2025-10-01T14:14:06.038696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256422205892216:11409]
2025-10-01T14:14:06.038700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256422205892216:11409]
2025-10-01T14:14:06.038702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256422205892216:11409]
2025-10-01T14:14:06.038710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:06.038717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:06.038719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:06.038720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:06.038722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:06.038730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:06.038735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:06.038751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256422205892216:11409]
2025-10-01T14:14:06.038757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:06.038759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:06.038734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2143
2025-10-01T14:14:06.038743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2143
2025-10-01T14:14:06.038790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.038796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.038813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:06.038821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.038827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.038829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:06.038835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.038844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:06.038858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.038999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.039004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.039014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.039063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2144 partition: 0 MaxSeqNo: 45 sessionId: src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0
2025-10-01T14:14:06.039328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|118dbde7-1f4561c8-53b2f189-2517b836_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:06.042069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0] Write session: try to update token
2025-10-01T14:14:06.042086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:06.054976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2144 sessionId: src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:06.057051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:06.058031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.058055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.058075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:06.058078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:06.058079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:06.058081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:06.058087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256422205892216:11409]
2025-10-01T14:14:06.058091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256422205892216:11409]
2025-10-01T14:14:06.058097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256422205892216:11409]
2025-10-01T14:14:06.058147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:06.058146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:06.058154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:06.058157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.058158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:06.058159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:06.058307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:06.112323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256424582793516:11539]
2025-10-01T14:14:06.112605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2143, pipe: [1:7556256424582793516:11539]
2025-10-01T14:14:06.193660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:06.194151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:06.194207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582793516:11539], now have 1 active actors on pipe
2025-10-01T14:14:06.194318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:06.198475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256424582793516:11539]
2025-10-01T14:14:06.198503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:06.207178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:06.207193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0] Write session will restart in 0.006938s
2025-10-01T14:14:06.207221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0] Write session: Do CDS request
2025-10-01T14:14:06.207227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:06.206653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:06.206667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:06.206693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2144 reason: error at write: Disconnected sessionId: src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0
2025-10-01T14:14:06.206835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2144 sessionId: src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0 is DEAD
2025-10-01T14:14:06.215033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.215048Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:06.215063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2145
2025-10-01T14:14:06.215255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.215280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:06.215285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:06.215290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:06.215712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2145 sessionId:  describe result for acl check
2025-10-01T14:14:06.215751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:06.215753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:06.215755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:06.215760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256424582793553:11793] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:06.216259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256424582793553:11793] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:06.219887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256424582793553:11793] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:06.223646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256424582793553:11793] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:06.223665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256424582793553:11793] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:06.223669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256424582793553:11793] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:06.223676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:06.224237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:06.226591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:06.226772Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:06.226775Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:06.226796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:06.226844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:06.226882Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256422205892452:11412]
2025-10-01T14:14:06.227508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:06.227820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:06.227859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:06.228152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:06.228214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.228222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.228224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.228225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.228226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.228227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.228228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.228229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.228230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.228231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.228232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.228233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.228234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.228235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.228240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.228249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.228253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.228256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.228260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.228263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.228267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.228271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.228274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.228277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.228281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.228284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.228287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.228291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.228298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.228305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.228311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.228315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.228321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.228326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.228330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.228335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.228339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.228344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.228348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.228352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.228357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.228361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.228365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.228370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.228375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.228380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.228384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.228389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.228393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.228397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.228401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.228406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.228410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.228414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.228419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.228424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.228461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:06.232206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:06.232853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:06.232869Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:06.232872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:06.232875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:06.232883Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2144 [2:7556256422205892452:11412]
2025-10-01T14:14:06.232897Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:06.232912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:06.232914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.232917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.232920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.232933Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:06.232938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:06.232944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:06.232998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.233005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.233007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.233011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:06.233014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:06.233077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:06.233084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.233093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.233103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.233121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:06.233141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582793741:11793], now have 1 active actors on pipe
2025-10-01T14:14:06.233152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582793518:2446], now have 1 active actors on pipe
2025-10-01T14:14:06.233158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256422205892447:11412]
2025-10-01T14:14:06.233160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256422205892447:11412]
2025-10-01T14:14:06.233162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256422205892447:11412]
2025-10-01T14:14:06.233177Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:06.233188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:06.233197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:06.233201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:06.233202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:06.233204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:06.233205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:06.233226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256422205892447:11412]
2025-10-01T14:14:06.233240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:06.233248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:06.233275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2144
2025-10-01T14:14:06.233310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2144
2025-10-01T14:14:06.233365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.233372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.233398Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b93d927-8850b201-47a10623-5d50bcfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:06.233409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.233413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.233415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:06.233424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.233433Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:06.233444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.233637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.233650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.233671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.233757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2145 partition: 0 MaxSeqNo: 45 sessionId: src_id|3b93d927-8850b201-47a10623-5d50bcfd_0
2025-10-01T14:14:06.234084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9577ee9-8ddcffbf-3c32131-d0f14006_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3b93d927-8850b201-47a10623-5d50bcfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:06.236837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b93d927-8850b201-47a10623-5d50bcfd_0] Write session: try to update token
2025-10-01T14:14:06.236853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b93d927-8850b201-47a10623-5d50bcfd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:06.250305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2145 sessionId: src_id|3b93d927-8850b201-47a10623-5d50bcfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:06.252955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:06.254610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.254633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.254653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:06.254657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:06.254659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:06.254661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:06.254670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256422205892447:11412]
2025-10-01T14:14:06.254674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256422205892447:11412]
2025-10-01T14:14:06.254678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256422205892447:11412]
2025-10-01T14:14:06.254729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:06.254736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:06.254738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:06.254741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:06.254743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.254745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:06.254885Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:06.294586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256424582793755:11539]
2025-10-01T14:14:06.294882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2144, pipe: [1:7556256424582793755:11539]
2025-10-01T14:14:06.410250Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:06.410485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:06.410538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582793755:11539], now have 1 active actors on pipe
2025-10-01T14:14:06.410621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:06.410750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256424582793755:11539]
2025-10-01T14:14:06.410936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:06.419439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:06.419453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:06.419472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2145 reason: error at write: Disconnected sessionId: src_id|3b93d927-8850b201-47a10623-5d50bcfd_0
2025-10-01T14:14:06.419603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2145 sessionId: src_id|3b93d927-8850b201-47a10623-5d50bcfd_0 is DEAD
2025-10-01T14:14:06.419770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b93d927-8850b201-47a10623-5d50bcfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:06.419783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b93d927-8850b201-47a10623-5d50bcfd_0] Write session will restart in 0.006715s
2025-10-01T14:14:06.419808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b93d927-8850b201-47a10623-5d50bcfd_0] Write session: Do CDS request
2025-10-01T14:14:06.419817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b93d927-8850b201-47a10623-5d50bcfd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:06.427886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b93d927-8850b201-47a10623-5d50bcfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.427933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:06.427946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2146
2025-10-01T14:14:06.428038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.428071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:06.428080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:06.428083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:06.428502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2146 sessionId:  describe result for acl check
2025-10-01T14:14:06.428535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:06.428539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:06.428541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:06.428545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256424582793947:11804] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:06.428933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256424582793947:11804] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:06.430628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:06.431020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256424582793947:11804] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:06.433612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:06.433785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:06.433794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:06.433804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:06.433857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:06.433900Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256422205892699:11417]
2025-10-01T14:14:06.434079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256424582793947:11804] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:06.434090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256424582793947:11804] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:06.434095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256424582793947:11804] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:06.434101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:06.434530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:06.434766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:06.434806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:06.435108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:06.435167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.435173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.435174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.435176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.435177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.435178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.435179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.435181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.435182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.435183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.435185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.435186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.435188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.435189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.435193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.435203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.435207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.435210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.435213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.435216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.435220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.435224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.435227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.435233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.435238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.435242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.435245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.435248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.435258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.435265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.435270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.435275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.435279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.435284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.435288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.435293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.435297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.435301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.435305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.435309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.435313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.435320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.435324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.435329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.435333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.435337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.435341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.435345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.435348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.435352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.435356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.435360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.435367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.435371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.435375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.435383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.435414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:06.439146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:06.439745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:06.439757Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:06.439759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:06.439763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:06.439768Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2145 [2:7556256422205892699:11417]
2025-10-01T14:14:06.439785Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:06.439800Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:06.439808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.439812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.439814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.439827Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:06.439831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:06.439835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:06.439881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.439886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.439888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.439891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:06.439894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:06.439948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:06.439955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.439965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.439974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.439988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:06.440009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582793779:2446], now have 1 active actors on pipe
2025-10-01T14:14:06.440012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794005:11804], now have 1 active actors on pipe
2025-10-01T14:14:06.440018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256422205892694:11417]
2025-10-01T14:14:06.440020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256422205892694:11417]
2025-10-01T14:14:06.440022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256422205892694:11417]
2025-10-01T14:14:06.440034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:06.440043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:06.440052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:06.440052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:06.440054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:06.440056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:06.440058Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:06.440074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256422205892694:11417]
2025-10-01T14:14:06.440075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:06.440079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:06.440136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2145
2025-10-01T14:14:06.440152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2145
2025-10-01T14:14:06.440206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.440217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.440239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:06.440248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.440251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.440252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:06.440261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.440271Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:06.440288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.440462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.440473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.440488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.440603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2146 partition: 0 MaxSeqNo: 45 sessionId: src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0
2025-10-01T14:14:06.440980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b93d927-8850b201-47a10623-5d50bcfd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:06.443876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0] Write session: try to update token
2025-10-01T14:14:06.443900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:06.456021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:06.456043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:06.456053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256422205892694:11417]
2025-10-01T14:14:06.456096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:06.456099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:06.456278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:06.456434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:06.456575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:06.456717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:06.456894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:06.456932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:06.460806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2146 sessionId: src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:06.463594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:06.463809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.463831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.463862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:06.463984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:06.469391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:06.469409Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:06.469411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:06.469413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:06.469421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256422205892694:11417]
2025-10-01T14:14:06.469424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256422205892694:11417]
2025-10-01T14:14:06.469428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256422205892694:11417]
2025-10-01T14:14:06.469469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:06.469474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.469476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:06.469477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:06.469484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:06.469489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:06.469614Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:06.511150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256424582794022:11539]
2025-10-01T14:14:06.511499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2145, pipe: [1:7556256424582794022:11539]
2025-10-01T14:14:06.592711Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:06.601907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.601930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.602097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.602166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.602227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.602290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.602339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.602350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.602431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.602500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.602571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.602637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.603217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.603230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.603308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.603380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.603456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.603531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.603696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.603712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.603800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.603878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.603937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.603999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.604041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.604048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.604108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.604175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.604237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.604291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.604334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.604342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.604408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.604464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.604524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.604599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.604689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.604697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.604755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.604812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.604880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.604947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.604986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.604992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.605049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.605104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.605160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.605226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.605271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.605281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.605343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.605408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.605468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.605528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.605570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.605576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.605638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:06.605696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:06.605750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:06.605811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:06.605855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:06.605864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:06.605926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794022:11539], now have 1 active actors on pipe
2025-10-01T14:14:06.606170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:06.606180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:06.606204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2146 reason: error at write: Disconnected sessionId: src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0
2025-10-01T14:14:06.606211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:06.606253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256424582794022:11539]
2025-10-01T14:14:06.606367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2146 sessionId: src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0 is DEAD
2025-10-01T14:14:06.606517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:06.606528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0] Write session will restart in 0.009320s
2025-10-01T14:14:06.606554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0] Write session: Do CDS request
2025-10-01T14:14:06.606560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:06.606666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:06.616871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.617027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:06.617043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2147
2025-10-01T14:14:06.617329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.617355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:06.617362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:06.617365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:06.617874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2147 sessionId:  describe result for acl check
2025-10-01T14:14:06.617903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:06.617908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:06.617910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:06.617914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256424582794133:11809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:06.618395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256424582794133:11809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:06.621198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256424582794133:11809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:06.622696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:06.625503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:06.625727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256424582794133:11809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:06.625741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256424582794133:11809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:06.625745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256424582794133:11809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:06.625723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:06.625752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:06.625737Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:06.625746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:06.625796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:06.625841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256422205892958:11426]
2025-10-01T14:14:06.626358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:06.626578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:06.626611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:06.626818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:06.626860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.626866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.626866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.626867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.626868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.626869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.626869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.626870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.626871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.626872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.626873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.626873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.626875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.626877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.626882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.626890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.626894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.626898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.626901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.626905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.626909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.626912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.626916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.626920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.626924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.626928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.626933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.626934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.626940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.626944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.626948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.626951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.626954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.626957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.626960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.626963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.626965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.626968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.626970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.626973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.626976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.626979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.626982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.626984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.626988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.626991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.626993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.626996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.626999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.627002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.627005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.627008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.627010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.627013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.627015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.627019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.627040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:06.630522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:06.631137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:06.631150Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:06.631151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:06.631154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:06.631161Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2146 [2:7556256422205892958:11426]
2025-10-01T14:14:06.631172Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:06.631185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:06.631193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.631195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.631197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.631208Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:06.631212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:06.631217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:06.631254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.631263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.631264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.631266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:06.631268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:06.631315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:06.631317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.631324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.631336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.631344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:06.631357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794257:11809], now have 1 active actors on pipe
2025-10-01T14:14:06.631365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794029:2446], now have 1 active actors on pipe
2025-10-01T14:14:06.631370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256422205892953:11426]
2025-10-01T14:14:06.631371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256422205892953:11426]
2025-10-01T14:14:06.631374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256422205892953:11426]
2025-10-01T14:14:06.631383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:06.631396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:06.631399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:06.631405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:06.631408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:06.631412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:06.631416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:06.631435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256422205892953:11426]
2025-10-01T14:14:06.631447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:06.631449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:06.631438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2146
2025-10-01T14:14:06.631470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.631479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.631487Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2146
2025-10-01T14:14:06.631499Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:06.631509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.631512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.631514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:06.631524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.631538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:06.631560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.631666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.631674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.631683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.631761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2147 partition: 0 MaxSeqNo: 45 sessionId: src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0
2025-10-01T14:14:06.632107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a1e0387-e46ba9c8-fed646b2-25eb0ed2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:06.634817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0] Write session: try to update token
2025-10-01T14:14:06.634831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:06.649131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2147 sessionId: src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:06.651355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:06.651381Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:06.651401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:06.651404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:06.651406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:06.651415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256422205892953:11426]
2025-10-01T14:14:06.651420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256422205892953:11426]
2025-10-01T14:14:06.651425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256422205892953:11426]
2025-10-01T14:14:06.651473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:06.651480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.651482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:06.651488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:06.651493Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:06.651496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:06.651617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:06.706226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256424582794268:11539]
2025-10-01T14:14:06.706519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2146, pipe: [1:7556256424582794268:11539]
2025-10-01T14:14:06.789280Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:06.789869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.789888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.789936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794268:11539], now have 1 active actors on pipe
2025-10-01T14:14:06.790135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:06.790144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:06.790152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:06.790192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256424582794268:11539]
2025-10-01T14:14:06.790224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2147 reason: error at write: Disconnected sessionId: src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0
2025-10-01T14:14:06.790359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:06.790444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2147 sessionId: src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0 is DEAD
2025-10-01T14:14:06.790558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:06.790568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0] Write session will restart in 0.005126s
2025-10-01T14:14:06.790595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0] Write session: Do CDS request
2025-10-01T14:14:06.790600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:06.796921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.797056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:06.797069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2148
2025-10-01T14:14:06.797195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.797226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:06.797236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:06.797240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:06.797657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2148 sessionId:  describe result for acl check
2025-10-01T14:14:06.797685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:06.797695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:06.797697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:06.797700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256424582794309:11814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:06.798078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256424582794309:11814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:06.800906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256424582794309:11814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:06.803264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256424582794309:11814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:06.803280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256424582794309:11814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:06.803283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256424582794309:11814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:06.803290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:06.805837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:06.808544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:06.808771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:06.808787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:06.808798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:06.808849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:06.808889Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256422205893192:11432]
2025-10-01T14:14:06.809428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:06.809736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:06.809783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:06.810082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:06.810139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.810145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.810146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.810148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.810149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.810150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.810152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.810153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.810154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.810155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.810156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.810157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.810158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.810160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.810165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.810174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.810179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.810182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.810185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.810188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.810191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.810194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.810197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.810202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.810205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.810209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.810212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.810221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.810230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.810241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:06.810249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.810258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:06.810266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.810275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:06.810283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.810287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:06.810295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.810300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:06.810307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.810310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:06.810315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.810324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:06.810331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.810336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:06.810344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.810353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:06.810362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.810388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.810394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.810401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.810408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.810413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.810421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.810429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:06.810436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.810444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:06.810485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:06.814130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:06.814775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:06.814791Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:06.814792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:06.814795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:06.814800Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2147 [2:7556256422205893192:11432]
2025-10-01T14:14:06.814814Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:06.814828Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:06.814830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.814833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.814834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.814847Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:06.814851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:06.814856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:06.814899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.814905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.814906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.814908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:06.814910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:06.814961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:06.814967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.814975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:06.814980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:06.814989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:06.815002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256422205893187:11432]
2025-10-01T14:14:06.815004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256422205893187:11432]
2025-10-01T14:14:06.815005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256422205893187:11432]
2025-10-01T14:14:06.815012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:06.815021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:06.815029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:06.815031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:06.815032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:06.815032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:06.815034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:06.815059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794473:11814], now have 1 active actors on pipe
2025-10-01T14:14:06.815062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794283:2446], now have 1 active actors on pipe
2025-10-01T14:14:06.815063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256422205893187:11432]
2025-10-01T14:14:06.815069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:06.815074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:06.815126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2147
2025-10-01T14:14:06.815134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2147
2025-10-01T14:14:06.815369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.815378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.815403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|957c591f-74c9da19-b8c09643-784386d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:06.815417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:06.815425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:06.815427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:06.815435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:06.815446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:06.815463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.815672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.815680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.815696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:06.815777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2148 partition: 0 MaxSeqNo: 45 sessionId: src_id|957c591f-74c9da19-b8c09643-784386d5_0
2025-10-01T14:14:06.816181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b7801c8b-b2f27fe1-f3e363d6-c98d23f0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|957c591f-74c9da19-b8c09643-784386d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:06.819069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957c591f-74c9da19-b8c09643-784386d5_0] Write session: try to update token
2025-10-01T14:14:06.819091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957c591f-74c9da19-b8c09643-784386d5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:06.835104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:06.835094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2148 sessionId: src_id|957c591f-74c9da19-b8c09643-784386d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:06.835117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:06.835119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:06.835120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:06.835128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256422205893187:11432]
2025-10-01T14:14:06.835131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256422205893187:11432]
2025-10-01T14:14:06.835135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256422205893187:11432]
2025-10-01T14:14:06.835183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:06.835187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:06.835189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:06.835193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:06.835195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:06.835196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:06.835318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:06.837623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:06.890523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256424582794523:11539]
2025-10-01T14:14:06.890793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2147, pipe: [1:7556256424582794523:11539]
2025-10-01T14:14:06.980116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:06.980602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:06.980618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:06.980662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794523:11539], now have 1 active actors on pipe
2025-10-01T14:14:06.980871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:06.981065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256424582794523:11539]
2025-10-01T14:14:06.981093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:06.981134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:06.981210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2148 reason: status is not ok: tablet will be restarted right now sessionId: src_id|957c591f-74c9da19-b8c09643-784386d5_0
2025-10-01T14:14:06.981447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2148 sessionId: src_id|957c591f-74c9da19-b8c09643-784386d5_0 is DEAD
2025-10-01T14:14:06.981761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957c591f-74c9da19-b8c09643-784386d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:06.981776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957c591f-74c9da19-b8c09643-784386d5_0] Write session will restart in 0.006934s
2025-10-01T14:14:06.981802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957c591f-74c9da19-b8c09643-784386d5_0] Write session: Do CDS request
2025-10-01T14:14:06.981808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957c591f-74c9da19-b8c09643-784386d5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:06.989916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|957c591f-74c9da19-b8c09643-784386d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.990116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:06.990131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2149
2025-10-01T14:14:06.990293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:06.990344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:06.990349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:06.990353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:06.990816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2149 sessionId:  describe result for acl check
2025-10-01T14:14:06.990854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:06.990856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:06.990858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:06.990863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256424582794564:11819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:06.991370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256424582794564:11819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:06.994198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256424582794564:11819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:06.998074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256424582794564:11819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:06.998090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256424582794564:11819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:06.998094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256424582794564:11819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:06.998103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:07.000378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:07.004765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:07.005035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:07.005046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:07.005057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:07.005111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:07.005151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256426500860722:11434]
2025-10-01T14:14:07.005776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:07.006125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:07.006169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:07.006483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:07.006545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.006551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.006552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.006553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.006555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.006556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.006558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.006559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.006561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.006562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.006563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.006564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.006566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.006567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.006572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.006582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.006586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.006590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.006593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.006597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.006601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.006605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.006609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.006613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.006616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.006620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.006623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.006627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.006634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.006641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.006647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.006652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.006657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.006662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.006667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.006673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.006678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.006683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.006687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.006692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.006696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.006701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.006707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.006712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.006716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.006721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.006725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.006734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.006739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.006748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.006752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.006756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.006760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.006764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.006770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.006778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.006817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:07.010873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:07.011600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:07.011615Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:07.011618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:07.011621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:07.011628Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2148 [2:7556256426500860722:11434]
2025-10-01T14:14:07.011644Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:07.011667Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:07.011674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.011677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.011679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.011696Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:07.011706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:07.011712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:07.011776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.011783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.011785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.011789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:07.011791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:07.011867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:07.011874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.011885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.011899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.011916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:07.011939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794530:2446], now have 1 active actors on pipe
2025-10-01T14:14:07.011947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256424582794752:11819], now have 1 active actors on pipe
2025-10-01T14:14:07.011955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256426500860717:11434]
2025-10-01T14:14:07.011962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256426500860717:11434]
2025-10-01T14:14:07.011964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256426500860717:11434]
2025-10-01T14:14:07.011978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:07.011990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:07.011995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:07.011998Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:07.012000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:07.012009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:07.012012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:07.012037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2148
2025-10-01T14:14:07.012045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256426500860717:11434]
2025-10-01T14:14:07.012053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:07.012056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:07.012079Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2148
2025-10-01T14:14:07.012110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.012119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.012144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed283639-eaad506a-387a7802-fb14175_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:07.012159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.012163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.012165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:07.012174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.012182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:07.012196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.012456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.012466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.012480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.012562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2149 partition: 0 MaxSeqNo: 45 sessionId: src_id|ed283639-eaad506a-387a7802-fb14175_0
2025-10-01T14:14:07.012897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|957c591f-74c9da19-b8c09643-784386d5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ed283639-eaad506a-387a7802-fb14175_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:07.016177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed283639-eaad506a-387a7802-fb14175_0] Write session: try to update token
2025-10-01T14:14:07.016194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed283639-eaad506a-387a7802-fb14175_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:07.023586Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:07.023605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:07.023615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256426500860717:11434]
2025-10-01T14:14:07.023665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:07.023850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:07.024003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:07.024154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:07.024300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:07.024515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:07.024556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:07.024661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:07.031589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2149 sessionId: src_id|ed283639-eaad506a-387a7802-fb14175_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:07.034429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:07.034811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.034833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.034871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:07.035044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:07.042361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:07.042389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:07.042392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:07.042394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:07.042406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256426500860717:11434]
2025-10-01T14:14:07.042410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256426500860717:11434]
2025-10-01T14:14:07.042415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256426500860717:11434]
2025-10-01T14:14:07.042463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:07.042467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:07.042473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:07.042473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.042475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:07.042476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:07.042612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:07.081035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256428877762063:11539]
2025-10-01T14:14:07.081333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2148, pipe: [1:7556256428877762063:11539]
2025-10-01T14:14:07.180409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:07.187159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.187184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.187330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.187383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.187438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.187492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.187538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.187546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.187612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.187666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.187722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.187777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.187818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.187823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.187883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.187939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.187998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.188067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.188114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.188119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.188179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.188235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.188292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.188350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.188390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.188395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.188455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.188509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.188575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.188645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.188685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.188690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.188750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.188802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.188857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.188919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.188957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.188967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.189030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.189094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.189161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.189228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.189269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.189279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.189344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.189398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.189456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.189512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.189553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.189561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.189632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.189687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.189743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.189798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.189837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.189842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.189900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.189954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.190013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.190073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.190126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.190133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.190179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762063:11539], now have 1 active actors on pipe
2025-10-01T14:14:07.190427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:07.190439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:07.190462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256428877762063:11539]
2025-10-01T14:14:07.190467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2149 reason: error at write: Disconnected sessionId: src_id|ed283639-eaad506a-387a7802-fb14175_0
2025-10-01T14:14:07.190488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:07.190652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2149 sessionId: src_id|ed283639-eaad506a-387a7802-fb14175_0 is DEAD
2025-10-01T14:14:07.190788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed283639-eaad506a-387a7802-fb14175_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:07.190800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed283639-eaad506a-387a7802-fb14175_0] Write session will restart in 0.008755s
2025-10-01T14:14:07.190823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed283639-eaad506a-387a7802-fb14175_0] Write session: Do CDS request
2025-10-01T14:14:07.190828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed283639-eaad506a-387a7802-fb14175_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:07.191268Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:07.200888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed283639-eaad506a-387a7802-fb14175_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.201060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:07.201073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2150
2025-10-01T14:14:07.201218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.201257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:07.201265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:07.201269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:07.201637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2150 sessionId:  describe result for acl check
2025-10-01T14:14:07.201669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:07.201674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:07.201675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:07.201682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256428877762136:11825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:07.202150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256428877762136:11825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:07.204780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256428877762136:11825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:07.207646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256428877762136:11825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:07.207661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256428877762136:11825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:07.207664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256428877762136:11825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:07.207672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:07.207880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:07.210700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:07.210908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:07.210917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:07.210928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:07.210977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:07.211019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256426500860957:11437]
2025-10-01T14:14:07.211420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:07.211695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:07.211735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:07.211932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:07.211968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.211969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.211970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.211971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.211972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.211972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.211973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.211974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.211974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.211975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.211976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.211976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.211977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.211978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.211981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.211987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.211990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.211992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.211994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.211998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.212002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.212005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.212008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.212012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.212015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.212019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.212022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.212026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.212030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.212035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.212039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.212043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.212045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.212051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.212054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.212059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.212063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.212067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.212071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.212076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.212084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.212088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.212093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.212108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.212113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.212118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.212122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.212129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.212133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.212138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.212142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.212148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.212152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.212156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.212161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.212166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.212200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:07.215901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:07.216538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:07.216553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:07.216557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:07.216560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:07.216567Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2149 [2:7556256426500860957:11437]
2025-10-01T14:14:07.216601Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:07.216622Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:07.216629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.216633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.216640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.216657Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:07.216668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:07.216675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:07.216739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.216747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.216749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.216753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:07.216756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:07.216822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:07.216832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.216844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.216858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.216880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:07.216903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762069:2446], now have 1 active actors on pipe
2025-10-01T14:14:07.216912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762298:11825], now have 1 active actors on pipe
2025-10-01T14:14:07.216923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256426500860951:11437]
2025-10-01T14:14:07.216926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256426500860951:11437]
2025-10-01T14:14:07.216934Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2149
2025-10-01T14:14:07.216928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256426500860951:11437]
2025-10-01T14:14:07.216937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2149
2025-10-01T14:14:07.216942Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:07.216956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:07.216961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:07.216964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:07.216966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:07.216971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:07.216974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:07.217013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256426500860951:11437]
2025-10-01T14:14:07.217026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:07.217040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:07.217044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.217049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.217094Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:07.217106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.217114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.217117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:07.217126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.217138Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:07.217159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.217312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.217319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.217334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.217418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2150 partition: 0 MaxSeqNo: 45 sessionId: src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0
2025-10-01T14:14:07.217769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed283639-eaad506a-387a7802-fb14175_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:07.220608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0] Write session: try to update token
2025-10-01T14:14:07.220627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:07.235862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2150 sessionId: src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:07.237770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:07.237789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:07.237792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:07.237794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:07.237803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256426500860951:11437]
2025-10-01T14:14:07.237809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256426500860951:11437]
2025-10-01T14:14:07.237814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256426500860951:11437]
2025-10-01T14:14:07.237865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:07.237871Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:07.237877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:07.237877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.237880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:07.237881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:07.238025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:07.238300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:07.290422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256428877762311:11539]
2025-10-01T14:14:07.290672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2149, pipe: [1:7556256428877762311:11539]
2025-10-01T14:14:07.375325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:07.375720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.375732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.375765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762311:11539], now have 1 active actors on pipe
2025-10-01T14:14:07.375887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:07.375928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:07.375935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256428877762311:11539]
2025-10-01T14:14:07.375955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:07.376015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2150 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0
2025-10-01T14:14:07.376202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2150 sessionId: src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0 is DEAD
2025-10-01T14:14:07.376339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:07.376353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0] Write session will restart in 0.008752s
2025-10-01T14:14:07.376383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0] Write session: Do CDS request
2025-10-01T14:14:07.376388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:07.385838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.385917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:07.385931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2151
2025-10-01T14:14:07.386080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.386104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:07.386111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:07.386113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:07.386552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2151 sessionId:  describe result for acl check
2025-10-01T14:14:07.386584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:07.386590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:07.386591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:07.386597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256428877762483:11836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:07.387090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256428877762483:11836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:07.388899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256428877762483:11836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:07.389011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:07.391296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:07.391483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:07.391493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:07.391504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:07.391519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256428877762483:11836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:07.391531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256428877762483:11836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:07.391534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256428877762483:11836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:07.391541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:07.391545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:07.391582Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256426500861198:11441]
2025-10-01T14:14:07.392153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:07.392368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:07.392405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:07.392702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:07.392749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.392754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.392756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.392756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.392758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.392759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.392760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.392762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.392763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.392764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.392765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.392766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.392767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.392768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.392773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.392783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.392787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.392792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.392795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.392799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.392803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.392807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.392815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.392819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.392823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.392831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.392839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.392843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.392852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.392863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.392872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.392880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.392888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.392892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.392899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.392904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.392912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.392920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.392926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.392935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.392944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.392952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.392960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.392969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.392977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.392986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.392993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.392998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.393006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.393015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.393022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.393027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.393034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.393043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.393047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.393056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.393097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:07.396438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:07.397401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:07.397416Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:07.397418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:07.397422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:07.397428Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2150 [2:7556256426500861198:11441]
2025-10-01T14:14:07.397443Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:07.397458Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:07.397465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.397468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.397473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.397486Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:07.397495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:07.397505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:07.397556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.397563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.397565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.397569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:07.397572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:07.397631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:07.397639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.397650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.397659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.397676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:07.397697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762564:11836], now have 1 active actors on pipe
2025-10-01T14:14:07.397704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762337:2446], now have 1 active actors on pipe
2025-10-01T14:14:07.397711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256426500861192:11441]
2025-10-01T14:14:07.397717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256426500861192:11441]
2025-10-01T14:14:07.397719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256426500861192:11441]
2025-10-01T14:14:07.397734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:07.397750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:07.397759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:07.397767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:07.397767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:07.397743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2150
2025-10-01T14:14:07.397769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:07.397770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:07.397748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2150
2025-10-01T14:14:07.397793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256426500861192:11441]
2025-10-01T14:14:07.397796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:07.397807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:07.397822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.397831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.397865Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|685e453d-e96028b7-31617971-618a9697_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:07.397876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.397884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.397886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:07.397894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.397902Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:07.397920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.398039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.398048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.398061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.398129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2151 partition: 0 MaxSeqNo: 45 sessionId: src_id|685e453d-e96028b7-31617971-618a9697_0
2025-10-01T14:14:07.398439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c886e9-e04e46c8-9c15826e-d8b9ff25_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|685e453d-e96028b7-31617971-618a9697_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:07.401188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|685e453d-e96028b7-31617971-618a9697_0] Write session: try to update token
2025-10-01T14:14:07.401203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|685e453d-e96028b7-31617971-618a9697_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:07.413934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2151 sessionId: src_id|685e453d-e96028b7-31617971-618a9697_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:07.416328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:07.417147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.417169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.417186Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:07.417189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:07.417190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:07.417191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:07.417197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256426500861192:11441]
2025-10-01T14:14:07.417200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256426500861192:11441]
2025-10-01T14:14:07.417203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256426500861192:11441]
2025-10-01T14:14:07.417230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:07.417240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:07.417242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:07.417245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:07.417250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.417251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:07.417363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:07.476269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256428877762576:11539]
2025-10-01T14:14:07.476519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2150, pipe: [1:7556256428877762576:11539]
2025-10-01T14:14:07.554753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:07.555087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:07.555153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762576:11539], now have 1 active actors on pipe
2025-10-01T14:14:07.555239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:07.555352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256428877762576:11539]
2025-10-01T14:14:07.555376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:07.564663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:07.564674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:07.564693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2151 reason: error at write: Disconnected sessionId: src_id|685e453d-e96028b7-31617971-618a9697_0
2025-10-01T14:14:07.564812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2151 sessionId: src_id|685e453d-e96028b7-31617971-618a9697_0 is DEAD
2025-10-01T14:14:07.564933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|685e453d-e96028b7-31617971-618a9697_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:07.564941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|685e453d-e96028b7-31617971-618a9697_0] Write session will restart in 0.009741s
2025-10-01T14:14:07.564958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|685e453d-e96028b7-31617971-618a9697_0] Write session: Do CDS request
2025-10-01T14:14:07.564966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|685e453d-e96028b7-31617971-618a9697_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:07.575682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:07.575980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|685e453d-e96028b7-31617971-618a9697_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.576009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:07.576023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2152
2025-10-01T14:14:07.576239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.576274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:07.576283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:07.576290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:07.576677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2152 sessionId:  describe result for acl check
2025-10-01T14:14:07.576711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:07.576717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:07.576718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:07.576724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256428877762784:11841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:07.577198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256428877762784:11841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:07.578283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:07.578527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:07.578536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:07.578548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:07.578614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:07.578670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256426500861445:11444]
2025-10-01T14:14:07.579129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:07.579412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:07.579435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256428877762784:11841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:07.579451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:07.579697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:07.579737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.579741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.579742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.579742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.579743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.579743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.579744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.579745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.579745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.579746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.579747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.579747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.579748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.579749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.579752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.579760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.579764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.579767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.579771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.579774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.579777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.579781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.579784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.579788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.579791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.579795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.579799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.579802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.579808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.579816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.579821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.579826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.579830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.579836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.579839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.579842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.579845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.579848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.579850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.579853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.579856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.579859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.579861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.579863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.579866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.579868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.579871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.579874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.579876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.579879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.579881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.579884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.579886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.579890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.579892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.579895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.579922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:07.583111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256428877762784:11841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:07.583132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256428877762784:11841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:07.583135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256428877762784:11841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:07.583145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:07.583286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:07.583902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:07.583914Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:07.583916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:07.583918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:07.583923Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2151 [2:7556256426500861445:11444]
2025-10-01T14:14:07.583944Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:07.583956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:07.583958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.583960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.583961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.583973Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:07.583976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:07.583981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:07.584027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.584036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.584039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.584041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:07.584043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:07.584104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:07.584109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.584115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.584121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.584129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:07.584145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762822:11841], now have 1 active actors on pipe
2025-10-01T14:14:07.584150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762583:2446], now have 1 active actors on pipe
2025-10-01T14:14:07.584155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256426500861440:11444]
2025-10-01T14:14:07.584157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256426500861440:11444]
2025-10-01T14:14:07.584159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256426500861440:11444]
2025-10-01T14:14:07.584174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:07.584186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:07.584191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:07.584198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:07.584200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:07.584203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:07.584205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:07.584220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256426500861440:11444]
2025-10-01T14:14:07.584227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:07.584238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:07.584208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2151
2025-10-01T14:14:07.584219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2151
2025-10-01T14:14:07.584261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.584268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.584288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0035c69-bff96892-d651d017-28ae84cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:07.584296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.584299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.584300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:07.584307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.584313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:07.584324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.584486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.584497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.584515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.584627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2152 partition: 0 MaxSeqNo: 45 sessionId: src_id|c0035c69-bff96892-d651d017-28ae84cf_0
2025-10-01T14:14:07.584988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|685e453d-e96028b7-31617971-618a9697_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c0035c69-bff96892-d651d017-28ae84cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:07.587977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0035c69-bff96892-d651d017-28ae84cf_0] Write session: try to update token
2025-10-01T14:14:07.587997Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0035c69-bff96892-d651d017-28ae84cf_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:07.604280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2152 sessionId: src_id|c0035c69-bff96892-d651d017-28ae84cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:07.604799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:07.604816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:07.604820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:07.604822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:07.604829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256426500861440:11444]
2025-10-01T14:14:07.604832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256426500861440:11444]
2025-10-01T14:14:07.604836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256426500861440:11444]
2025-10-01T14:14:07.604875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:07.604877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:07.604883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.604885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:07.604885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:07.604888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:07.605012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:07.606864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:07.655438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256428877762839:11539]
2025-10-01T14:14:07.655642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2151, pipe: [1:7556256428877762839:11539]
2025-10-01T14:14:07.741000Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:07.741538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.741552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.741593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762839:11539], now have 1 active actors on pipe
2025-10-01T14:14:07.741741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:07.741821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:07.741832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:07.741877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:07.741887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2152 reason: error at write: Disconnected sessionId: src_id|c0035c69-bff96892-d651d017-28ae84cf_0
2025-10-01T14:14:07.741929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256428877762839:11539]
2025-10-01T14:14:07.742096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2152 sessionId: src_id|c0035c69-bff96892-d651d017-28ae84cf_0 is DEAD
2025-10-01T14:14:07.742216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0035c69-bff96892-d651d017-28ae84cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:07.742226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0035c69-bff96892-d651d017-28ae84cf_0] Write session will restart in 0.009120s
2025-10-01T14:14:07.742255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0035c69-bff96892-d651d017-28ae84cf_0] Write session: Do CDS request
2025-10-01T14:14:07.742261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0035c69-bff96892-d651d017-28ae84cf_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:07.752930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0035c69-bff96892-d651d017-28ae84cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.752980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:07.752993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2153
2025-10-01T14:14:07.753173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.753202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:07.753223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:07.753232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:07.753672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2153 sessionId:  describe result for acl check
2025-10-01T14:14:07.753709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:07.753717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:07.753719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:07.753724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256428877762955:11846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:07.754237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256428877762955:11846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:07.756305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256428877762955:11846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:07.758438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256428877762955:11846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:07.758451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256428877762955:11846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:07.758454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256428877762955:11846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:07.758462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:07.758442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:07.760861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:07.761038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:07.761046Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:07.761054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:07.761089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:07.761117Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256426500861713:11457]
2025-10-01T14:14:07.761543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:07.761782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:07.761811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:07.762065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:07.762111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.762117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.762118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.762118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.762119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.762120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.762120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.762121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.762122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.762122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.762123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.762124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.762124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.762125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.762128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.762134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.762136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.762138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.762140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.762142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.762145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.762147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.762149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.762151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.762153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.762155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.762157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.762159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.762164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.762169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.762172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.762175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.762178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.762180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.762183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.762185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.762188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.762191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.762193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.762196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.762198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.762201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.762203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.762206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.762209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.762211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.762213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.762216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.762218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.762221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.762224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.762226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.762228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.762231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.762233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.762236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.762255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:07.765727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:07.766482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:07.766492Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:07.766494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:07.766497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:07.766504Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2152 [2:7556256426500861713:11457]
2025-10-01T14:14:07.766772Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:07.766791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:07.766792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.766795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.766796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.766806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:07.766810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:07.766814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:07.766853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.766858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.766859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.766861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:07.766863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:07.766914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:07.766919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.766927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.766932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.766942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:07.766959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256426500861707:11457]
2025-10-01T14:14:07.766965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256426500861707:11457]
2025-10-01T14:14:07.766966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256426500861707:11457]
2025-10-01T14:14:07.766977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:07.766985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:07.766990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877762852:2446], now have 1 active actors on pipe
2025-10-01T14:14:07.766992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877763085:11846], now have 1 active actors on pipe
2025-10-01T14:14:07.766993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:07.766995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:07.767000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:07.767012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:07.767014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:07.767042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256426500861707:11457]
2025-10-01T14:14:07.767053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:07.767067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:07.767058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2152
2025-10-01T14:14:07.767066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2152
2025-10-01T14:14:07.767102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.767110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.767134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7c51f40-201a664b-bed9547c-41fb337d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:07.767145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.767149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.767155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:07.767163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.767175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:07.767192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.767345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.767351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.767363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.767499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2153 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7c51f40-201a664b-bed9547c-41fb337d_0
2025-10-01T14:14:07.767843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0035c69-bff96892-d651d017-28ae84cf_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7c51f40-201a664b-bed9547c-41fb337d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:07.770441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c51f40-201a664b-bed9547c-41fb337d_0] Write session: try to update token
2025-10-01T14:14:07.770462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c51f40-201a664b-bed9547c-41fb337d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:07.777756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:07.777771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:07.777780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256426500861707:11457]
2025-10-01T14:14:07.777813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:07.777825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:07.777997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:07.778148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:07.778284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:07.778444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:07.778650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:07.778692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:07.785425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2153 sessionId: src_id|d7c51f40-201a664b-bed9547c-41fb337d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:07.787931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:07.788159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.788183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.788219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:07.788307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:07.795977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:07.795992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:07.795995Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:07.795996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:07.796005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256426500861707:11457]
2025-10-01T14:14:07.796009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256426500861707:11457]
2025-10-01T14:14:07.796012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256426500861707:11457]
2025-10-01T14:14:07.796055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:07.796065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.796064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:07.796069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:07.796071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:07.796075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:07.796185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:07.842347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256428877763098:11539]
2025-10-01T14:14:07.842615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2152, pipe: [1:7556256428877763098:11539]
2025-10-01T14:14:07.929268Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:07.935883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.935909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.936061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.936118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.936174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.936231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.936271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.936279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.936342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.936407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.936459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.936516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.936559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.936569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.936647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.936701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.936767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.936829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.936872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.936878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.936945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.937004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.937065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.937129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.937172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.937180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.937240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.937293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.937346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.937398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.937439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.937444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.937502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.937556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.937620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.937676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.937717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.937723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.937780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.937837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.937896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.937952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.937994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.937999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.938066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.938125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.938186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.938246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.938288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.938294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.938359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.938429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.938487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.938543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.938586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.938592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.938651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:07.938703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:07.938763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:07.938819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:07.938879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:07.938885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:07.938936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877763098:11539], now have 1 active actors on pipe
2025-10-01T14:14:07.939177Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:07.939180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256428877763098:11539]
2025-10-01T14:14:07.939198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:07.939203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:07.939222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2153 reason: error at write: Disconnected sessionId: src_id|d7c51f40-201a664b-bed9547c-41fb337d_0
2025-10-01T14:14:07.939391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2153 sessionId: src_id|d7c51f40-201a664b-bed9547c-41fb337d_0 is DEAD
2025-10-01T14:14:07.939592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c51f40-201a664b-bed9547c-41fb337d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:07.939608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c51f40-201a664b-bed9547c-41fb337d_0] Write session will restart in 0.006160s
2025-10-01T14:14:07.939637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c51f40-201a664b-bed9547c-41fb337d_0] Write session: Do CDS request
2025-10-01T14:14:07.939643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c51f40-201a664b-bed9547c-41fb337d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:07.939785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:07.947004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c51f40-201a664b-bed9547c-41fb337d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.947085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:07.947096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2154
2025-10-01T14:14:07.947272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:07.947303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:07.947308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:07.947315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:07.947620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2154 sessionId:  describe result for acl check
2025-10-01T14:14:07.947655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:07.947661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:07.947662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:07.947665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256428877763137:11851] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:07.948104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256428877763137:11851] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:07.951437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256428877763137:11851] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:07.954099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256428877763137:11851] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:07.954113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256428877763137:11851] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:07.954116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256428877763137:11851] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:07.954125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:07.956033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:07.958766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:07.958934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:07.958942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:07.958950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:07.958983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:07.959018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256426500861950:11459]
2025-10-01T14:14:07.959389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:07.959624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:07.959657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:07.959871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:07.959914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.959918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.959919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.959920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.959921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.959921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.959922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.959923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.959923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.959924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.959925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.959926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.959926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.959927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.959930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.959936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.959938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.959940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.959942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.959944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.959947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.959949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.959951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.959954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.959956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.959958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.959960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.959962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.959967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.959971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:07.959975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.959978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:07.959981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.959984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:07.959986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.959988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:07.959991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.959994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:07.959996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.959999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:07.960001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.960012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:07.960017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.960020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:07.960023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.960026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:07.960028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.960032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.960034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.960037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.960039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.960041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.960046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.960049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:07.960052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.960054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:07.960075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:07.963613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:07.964305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:07.964317Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:07.964318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:07.964321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:07.964326Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2153 [2:7556256426500861950:11459]
2025-10-01T14:14:07.964337Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:07.964350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:07.964353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.964355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.964357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.964383Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:07.964390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:07.964395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:07.964436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.964441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.964442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.964444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:07.964446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:07.964493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:07.964498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.964505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:07.964510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:07.964523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:07.964535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256426500861944:11459]
2025-10-01T14:14:07.964540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256426500861944:11459]
2025-10-01T14:14:07.964541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256426500861944:11459]
2025-10-01T14:14:07.964547Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:07.964557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:07.964561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877763100:2446], now have 1 active actors on pipe
2025-10-01T14:14:07.964566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:07.964566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:07.964567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:07.964574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:07.964575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:07.964589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256428877763332:11851], now have 1 active actors on pipe
2025-10-01T14:14:07.964612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256426500861944:11459]
2025-10-01T14:14:07.964624Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:07.964634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:07.964658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2153
2025-10-01T14:14:07.964673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2153
2025-10-01T14:14:07.964720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.964733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.964757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:07.964770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:07.964777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:07.964780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:07.964791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:07.964802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:07.964817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.964981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:07.964987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:07.965003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:07.965081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2154 partition: 0 MaxSeqNo: 45 sessionId: src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0
2025-10-01T14:14:07.965420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7c51f40-201a664b-bed9547c-41fb337d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:07.968442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0] Write session: try to update token
2025-10-01T14:14:07.968463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:07.982235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2154 sessionId: src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:07.984557Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:07.984611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:07.984613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:07.984615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:07.984625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256426500861944:11459]
2025-10-01T14:14:07.984633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256426500861944:11459]
2025-10-01T14:14:07.984637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256426500861944:11459]
2025-10-01T14:14:07.984686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:07.984700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:07.984702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:07.984714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:07.984720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:07.984697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:07.984809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:07.984832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:08.039482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256433172730644:11539]
2025-10-01T14:14:08.039788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2153, pipe: [1:7556256433172730644:11539]
2025-10-01T14:14:08.126169Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:08.126683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.126696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.126728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172730644:11539], now have 1 active actors on pipe
2025-10-01T14:14:08.126869Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:08.126979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:08.127029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:08.127107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2154 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0
2025-10-01T14:14:08.127178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256433172730644:11539]
2025-10-01T14:14:08.127292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2154 sessionId: src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0 is DEAD
2025-10-01T14:14:08.127422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:08.127436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0] Write session will restart in 0.005256s
2025-10-01T14:14:08.127463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0] Write session: Do CDS request
2025-10-01T14:14:08.127468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:08.133941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.134043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:08.134056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2155
2025-10-01T14:14:08.134238Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.134270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:08.134279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:08.134282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:08.134709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2155 sessionId:  describe result for acl check
2025-10-01T14:14:08.134801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:08.134812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:08.134814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:08.134821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256433172730662:11855] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:08.135358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256433172730662:11855] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:08.138000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256433172730662:11855] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:08.140438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256433172730662:11855] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:08.140452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256433172730662:11855] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:08.140455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256433172730662:11855] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:08.140462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:08.144190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:08.147516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:08.147712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:08.147720Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:08.147728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:08.147768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:08.147829Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256430795829484:11461]
2025-10-01T14:14:08.148269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:08.148593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:08.148622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:08.148815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:08.148858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.148863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.148864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.148864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.148865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.148866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.148866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.148867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.148868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.148869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.148870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.148870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.148871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.148871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.148875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.148881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.148883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.148885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.148887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.148889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.148892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.148894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.148896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.148899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.148901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.148903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.148905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.148907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.148912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.148917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.148921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.148924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.148926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.148929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.148932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.148935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.148938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.148941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.148944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.148946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.148949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.148952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.148954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.148957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.148959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.148962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.148964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.148967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.148970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.148972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.148975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.148977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.148980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.148983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.148985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.148988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.149009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:08.152681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:08.153283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:08.153294Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:08.153295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:08.153298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:08.153304Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2154 [2:7556256430795829484:11461]
2025-10-01T14:14:08.153317Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:08.153332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:08.153340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.153343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.153345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.153363Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:08.153370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:08.153375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:08.153420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.153425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.153426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.153429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:08.153430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:08.153478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:08.153484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.153491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.153497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.153505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:08.153516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256430795829479:11461]
2025-10-01T14:14:08.153518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256430795829479:11461]
2025-10-01T14:14:08.153519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256430795829479:11461]
2025-10-01T14:14:08.153525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:08.153534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:08.153534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:08.153537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:08.153539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:08.153542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:08.153544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:08.153551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172730808:11855], now have 1 active actors on pipe
2025-10-01T14:14:08.153554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172730647:2446], now have 1 active actors on pipe
2025-10-01T14:14:08.153576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256430795829479:11461]
2025-10-01T14:14:08.153587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:08.153601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:08.153616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2154
2025-10-01T14:14:08.153620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2154
2025-10-01T14:14:08.153703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.153723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.153747Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83baa5a8-187e708d-d4aab562-32a19887_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:08.153758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.153762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.153768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:08.153776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.153787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:08.153807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.153975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.153984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.154006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.154120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2155 partition: 0 MaxSeqNo: 45 sessionId: src_id|83baa5a8-187e708d-d4aab562-32a19887_0
2025-10-01T14:14:08.154484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcc345ce-412c1ba7-b4ec8909-c866b55d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83baa5a8-187e708d-d4aab562-32a19887_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:08.157405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83baa5a8-187e708d-d4aab562-32a19887_0] Write session: try to update token
2025-10-01T14:14:08.157424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83baa5a8-187e708d-d4aab562-32a19887_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:08.170835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2155 sessionId: src_id|83baa5a8-187e708d-d4aab562-32a19887_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:08.173339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:08.173334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:08.173352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:08.173354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:08.173357Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:08.173365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256430795829479:11461]
2025-10-01T14:14:08.173370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256430795829479:11461]
2025-10-01T14:14:08.173375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256430795829479:11461]
2025-10-01T14:14:08.173412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:08.173419Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:08.173422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:08.173424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:08.173431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.173434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:08.173563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:08.227382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256433172730893:11539]
2025-10-01T14:14:08.227612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2154, pipe: [1:7556256433172730893:11539]
2025-10-01T14:14:08.313825Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:08.314517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.314536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.314582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172730893:11539], now have 1 active actors on pipe
2025-10-01T14:14:08.314749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:08.314829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256433172730893:11539]
2025-10-01T14:14:08.314843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:08.314847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:08.314856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:08.314904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2155 reason: error at write: Disconnected sessionId: src_id|83baa5a8-187e708d-d4aab562-32a19887_0
2025-10-01T14:14:08.315113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2155 sessionId: src_id|83baa5a8-187e708d-d4aab562-32a19887_0 is DEAD
2025-10-01T14:14:08.315211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83baa5a8-187e708d-d4aab562-32a19887_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:08.315220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83baa5a8-187e708d-d4aab562-32a19887_0] Write session will restart in 0.006402s
2025-10-01T14:14:08.315246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83baa5a8-187e708d-d4aab562-32a19887_0] Write session: Do CDS request
2025-10-01T14:14:08.315251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83baa5a8-187e708d-d4aab562-32a19887_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:08.322899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83baa5a8-187e708d-d4aab562-32a19887_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.323008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:08.323025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2156
2025-10-01T14:14:08.323210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.323247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:08.323258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:08.323262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:08.323703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2156 sessionId:  describe result for acl check
2025-10-01T14:14:08.323741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:08.323747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:08.323751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:08.323757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256433172730925:11859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:08.324284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256433172730925:11859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:08.327414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256433172730925:11859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:08.329924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256433172730925:11859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:08.329936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256433172730925:11859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:08.329939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256433172730925:11859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:08.329947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:08.330875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:08.333418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:08.333654Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:08.333663Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:08.333672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:08.333709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:08.333737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256430795829727:11464]
2025-10-01T14:14:08.334179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:08.334443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:08.334476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:08.334676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:08.334713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.334718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.334718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.334719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.334720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.334720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.334721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.334722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.334723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.334723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.334724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.334725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.334725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.334726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.334729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.334735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.334737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.334740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.334742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.334744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.334746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.334748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.334750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.334753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.334755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.334757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.334759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.334761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.334767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.334772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.334776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.334779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.334781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.334784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.334787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.334789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.334792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.334795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.334797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.334800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.334803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.334806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.334808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.334811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.334813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.334816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.334819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.334822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.334824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.334827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.334829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.334832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.334834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.334837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.334839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.334842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.334864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:08.338425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:08.339199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:08.339210Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:08.339212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:08.339214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:08.339220Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2155 [2:7556256430795829727:11464]
2025-10-01T14:14:08.339230Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:08.339241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:08.339243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.339245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.339247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.339258Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:08.339261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:08.339265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:08.339301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.339307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.339308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.339310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:08.339312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:08.339356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:08.339364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.339370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.339376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.339385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:08.339397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256430795829722:11464]
2025-10-01T14:14:08.339402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256430795829722:11464]
2025-10-01T14:14:08.339403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256430795829722:11464]
2025-10-01T14:14:08.339410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:08.339418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731129:11859], now have 1 active actors on pipe
2025-10-01T14:14:08.339419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:08.339423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:08.339425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:08.339431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:08.339443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:08.339446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:08.339451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172730896:2446], now have 1 active actors on pipe
2025-10-01T14:14:08.339467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256430795829722:11464]
2025-10-01T14:14:08.339475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:08.339484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:08.339510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2155
2025-10-01T14:14:08.339531Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2155
2025-10-01T14:14:08.339570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.339577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.339594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:08.339603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.339606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.339608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:08.339614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.339620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:08.339632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.339760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.339767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.339778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.339845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2156 partition: 0 MaxSeqNo: 45 sessionId: src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0
2025-10-01T14:14:08.340210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83baa5a8-187e708d-d4aab562-32a19887_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:08.343017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0] Write session: try to update token
2025-10-01T14:14:08.343036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:08.358218Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:08.358234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:08.358236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:08.358237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:08.358244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256430795829722:11464]
2025-10-01T14:14:08.358248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256430795829722:11464]
2025-10-01T14:14:08.358251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256430795829722:11464]
2025-10-01T14:14:08.358283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:08.358287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.358290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:08.358291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:08.358295Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:08.358297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:08.358431Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:08.358605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2156 sessionId: src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:08.360965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:08.414757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256433172731165:11539]
2025-10-01T14:14:08.414976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2155, pipe: [1:7556256433172731165:11539]
2025-10-01T14:14:08.491683Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:08.492077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.492090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.492124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731165:11539], now have 1 active actors on pipe
2025-10-01T14:14:08.492304Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:08.492316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256433172731165:11539]
2025-10-01T14:14:08.492343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:08.492347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:08.492407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2156 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0
2025-10-01T14:14:08.492615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2156 sessionId: src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0 is DEAD
2025-10-01T14:14:08.492767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:08.492779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0] Write session will restart in 0.009675s
2025-10-01T14:14:08.492800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0] Write session: Do CDS request
2025-10-01T14:14:08.492805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:08.503855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.503919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:08.503934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2157
2025-10-01T14:14:08.504060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.504084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:08.504087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:08.504090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:08.504456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2157 sessionId:  describe result for acl check
2025-10-01T14:14:08.504479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:08.504480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:08.504482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:08.504486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256433172731302:11870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:08.505076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256433172731302:11870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:08.507121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256433172731302:11870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:08.507840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:08.510284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:08.510485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:08.510493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:08.510504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:08.510551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:08.510576Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256430795829985:11469]
2025-10-01T14:14:08.510782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256433172731302:11870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:08.510796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256433172731302:11870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:08.510800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256433172731302:11870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:08.510808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:08.511016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:08.511232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:08.511270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:08.511527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:08.511574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.511579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.511580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.511582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.511582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.511583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.511585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.511586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.511587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.511588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.511589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.511590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.511591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.511592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.511598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.511607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.511611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.511615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.511618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.511622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.511626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.511629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.511633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.511637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.511640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.511644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.511647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.511651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.511656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.511664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.511670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.511675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.511679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.511684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.511688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.511692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.511696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.511706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.511710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.511715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.511722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.511724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.511727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.511729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.511733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.511736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.511738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.511741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.511743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.511746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.511748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.511751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.511753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.511755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.511757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.511760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.511791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:08.515497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:08.516203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:08.516220Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:08.516223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:08.516227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:08.516234Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2156 [2:7556256430795829985:11469]
2025-10-01T14:14:08.516250Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:08.516268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:08.516275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.516278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.516280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.516296Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:08.516305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:08.516311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:08.516368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.516375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.516378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.516391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:08.516398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:08.516460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:08.516467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.516478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.516493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.516508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:08.516530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731167:2446], now have 1 active actors on pipe
2025-10-01T14:14:08.516537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731408:11870], now have 1 active actors on pipe
2025-10-01T14:14:08.516543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256430795829980:11469]
2025-10-01T14:14:08.516546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256430795829980:11469]
2025-10-01T14:14:08.516548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256430795829980:11469]
2025-10-01T14:14:08.516562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:08.516578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:08.516589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:08.516592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:08.516595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:08.516604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:08.516607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:08.516578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2156
2025-10-01T14:14:08.516641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256430795829980:11469]
2025-10-01T14:14:08.516655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:08.516672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2156
2025-10-01T14:14:08.516690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:08.516733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.516738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.516760Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83aea6c7-d902a894-2c61eff2-3544f54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:08.516771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.516775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.516777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:08.516787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.516799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:08.516816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.516943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.516950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.516962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.517026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2157 partition: 0 MaxSeqNo: 45 sessionId: src_id|83aea6c7-d902a894-2c61eff2-3544f54_0
2025-10-01T14:14:08.517397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1f3bba74-8b206c77-1fa0f13c-36b835ad_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83aea6c7-d902a894-2c61eff2-3544f54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:08.520130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83aea6c7-d902a894-2c61eff2-3544f54_0] Write session: try to update token
2025-10-01T14:14:08.520147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83aea6c7-d902a894-2c61eff2-3544f54_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:08.527109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:08.527127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:08.527137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256430795829980:11469]
2025-10-01T14:14:08.527180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:08.527186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:08.527339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:08.527474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:08.527605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:08.527731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:08.527909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:08.527947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:08.535354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2157 sessionId: src_id|83aea6c7-d902a894-2c61eff2-3544f54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:08.538024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:08.538226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.538242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.538275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:08.538352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:08.545068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:08.545089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:08.545091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:08.545094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:08.545104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256430795829980:11469]
2025-10-01T14:14:08.545108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256430795829980:11469]
2025-10-01T14:14:08.545114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256430795829980:11469]
2025-10-01T14:14:08.545158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:08.545168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.545169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:08.545174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:08.545174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:08.545178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:08.545295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:08.592441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256433172731424:11539]
2025-10-01T14:14:08.592709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2156, pipe: [1:7556256433172731424:11539]
2025-10-01T14:14:08.683144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:08.689498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.689522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.689647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.689695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.689748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.689797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.689991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.690000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.690051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.690104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.690152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.690201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.690240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.690245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.690302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.690355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.690440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.690503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.690546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.690553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.690614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.690681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.690733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.690789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.690825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.690830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.690884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.690935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.690985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.691036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.691074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.691079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.691135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.691187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.691240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.691293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.691333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.691337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.691392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.691440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.691493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.691551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.691597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.691603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.691667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.691719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.691772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.691826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.691863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.691869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.691924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.691975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.692026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.692076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.692113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.692120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.692171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.692220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.692270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.692317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.692354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.692359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.692396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731424:11539], now have 1 active actors on pipe
2025-10-01T14:14:08.692626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256433172731424:11539]
2025-10-01T14:14:08.692633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:08.692653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:08.692655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:08.692674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2157 reason: error at write: Disconnected sessionId: src_id|83aea6c7-d902a894-2c61eff2-3544f54_0
2025-10-01T14:14:08.692847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2157 sessionId: src_id|83aea6c7-d902a894-2c61eff2-3544f54_0 is DEAD
2025-10-01T14:14:08.692995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83aea6c7-d902a894-2c61eff2-3544f54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:08.693007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83aea6c7-d902a894-2c61eff2-3544f54_0] Write session will restart in 0.008836s
2025-10-01T14:14:08.692989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:08.693028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83aea6c7-d902a894-2c61eff2-3544f54_0] Write session: Do CDS request
2025-10-01T14:14:08.693032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83aea6c7-d902a894-2c61eff2-3544f54_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:08.702851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83aea6c7-d902a894-2c61eff2-3544f54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.703001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:08.703017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2158
2025-10-01T14:14:08.703199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.703233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:08.703243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:08.703251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:08.703800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2158 sessionId:  describe result for acl check
2025-10-01T14:14:08.703834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:08.703835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:08.703837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:08.703841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256433172731522:11875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:08.704324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256433172731522:11875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:08.706849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256433172731522:11875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:08.708496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:08.711422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:08.711606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256433172731522:11875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:08.711623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256433172731522:11875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:08.711627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256433172731522:11875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:08.711656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:08.711644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:08.711656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:08.711666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:08.711734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:08.711774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256430795830255:11477]
2025-10-01T14:14:08.712336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:08.712623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:08.712665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:08.712869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:08.712907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.712907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.712908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.712909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.712910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.712910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.712911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.712911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.712912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.712913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.712913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.712914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.712914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.712915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.712918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.712924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.712926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.712928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.712930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.712932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.712935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.712937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.712939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.712942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.712945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.712947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.712950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.712952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.712957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.712961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.712964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.712968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.712970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.712972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.712975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.712978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.712980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.712983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.712985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.712988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.712990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.712993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.712996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.712998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.713001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.713004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.713006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.713008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.713010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.713013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.713015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.713018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.713020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.713023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.713025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.713028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.713049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:08.716494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:08.717157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:08.717168Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:08.717170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:08.717172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:08.717177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2157 [2:7556256430795830255:11477]
2025-10-01T14:14:08.717187Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:08.717198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:08.717201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.717203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.717205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.717216Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:08.717223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:08.717226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:08.717262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.717267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.717268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.717270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:08.717272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:08.717332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:08.717339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.717348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.717358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.717377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:08.717397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731427:2446], now have 1 active actors on pipe
2025-10-01T14:14:08.717404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731665:11875], now have 1 active actors on pipe
2025-10-01T14:14:08.717411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256430795830250:11477]
2025-10-01T14:14:08.717416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256430795830250:11477]
2025-10-01T14:14:08.717417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256430795830250:11477]
2025-10-01T14:14:08.717429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:08.717440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:08.717444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:08.717447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:08.717448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:08.717456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:08.717458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:08.717482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256430795830250:11477]
2025-10-01T14:14:08.717491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:08.717497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:08.717494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2157
2025-10-01T14:14:08.717539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.717548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.717501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2157
2025-10-01T14:14:08.717569Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:08.717579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.717582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.717584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:08.717592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.717604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:08.717619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.717770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.717777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.717788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.717858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2158 partition: 0 MaxSeqNo: 45 sessionId: src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0
2025-10-01T14:14:08.718249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83aea6c7-d902a894-2c61eff2-3544f54_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:08.721113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0] Write session: try to update token
2025-10-01T14:14:08.721130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:08.727870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:08.727888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:08.727897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256430795830250:11477]
2025-10-01T14:14:08.727933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:08.727943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:08.728101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:08.728257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:08.728396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:08.728534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:08.728752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:08.728792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:08.735262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2158 sessionId: src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:08.737682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:08.737892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.737914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.737953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:08.738043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:08.745833Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:08.745853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:08.745855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:08.745857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:08.745868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256430795830250:11477]
2025-10-01T14:14:08.745872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256430795830250:11477]
2025-10-01T14:14:08.745877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256430795830250:11477]
2025-10-01T14:14:08.745918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:08.745922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:08.745930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.745931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:08.745932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:08.745935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:08.746063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:08.792626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256433172731689:11539]
2025-10-01T14:14:08.792840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2157, pipe: [1:7556256433172731689:11539]
2025-10-01T14:14:08.899469Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:08.907576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.907607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.907771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.907839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.907911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.907971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.908014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.908027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.908090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.908148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.908208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.908270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.908316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.908324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.908392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.908459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.908521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.908594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.908637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.908645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.908710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.908777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.908841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.908908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.908955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.908962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.909025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.909086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.909149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.909211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.909256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.909263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.909329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.909389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.909451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.909515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.909560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.909571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.909641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.909697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.909758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.909816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.909860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.909869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.909942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.910007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.910073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.910136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.910241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.910250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.910312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.910392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.910457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.910516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.910570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.910578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.910641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:08.910702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:08.910764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:08.910824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:08.910875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:08.910883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:08.910950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731689:11539], now have 1 active actors on pipe
2025-10-01T14:14:08.911181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:08.911192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:08.911201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256433172731689:11539]
2025-10-01T14:14:08.911214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2158 reason: error at write: Disconnected sessionId: src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0
2025-10-01T14:14:08.911219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:08.911376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2158 sessionId: src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0 is DEAD
2025-10-01T14:14:08.911469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:08.911476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0] Write session will restart in 0.008617s
2025-10-01T14:14:08.911493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0] Write session: Do CDS request
2025-10-01T14:14:08.911498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:08.912027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:08.921481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.921651Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:08.921669Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2159
2025-10-01T14:14:08.921775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:08.921799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:08.921805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:08.921808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:08.922217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2159 sessionId:  describe result for acl check
2025-10-01T14:14:08.922256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:08.922323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:08.922330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:08.922335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256433172731775:11880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:08.922874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256433172731775:11880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:08.925776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256433172731775:11880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:08.927775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256433172731775:11880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:08.927786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256433172731775:11880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:08.927790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256433172731775:11880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:08.927797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:08.928031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:08.930888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:08.931124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:08.931135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:08.931147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:08.931194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:08.931231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256430795830500:11484]
2025-10-01T14:14:08.931805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:08.932147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:08.932190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:08.932487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:08.932539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.932544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.932545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.932546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.932548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.932549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.932550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.932551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.932553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.932554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.932555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.932556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.932557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.932558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.932563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.932573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.932577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.932590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.932594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.932598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.932602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.932605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.932609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.932612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.932615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.932619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.932622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.932625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.932638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.932649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:08.932660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.932669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:08.932677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.932686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:08.932693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.932698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:08.932706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.932712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:08.932720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.932725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:08.932734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.932739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:08.932747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.932752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:08.932761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.932770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:08.932778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.932783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.932790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.932799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.932806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.932812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.932820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.932828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:08.932834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.932842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:08.932882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:08.936442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:08.937094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:08.937107Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:08.937110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:08.937114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:08.937121Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2158 [2:7556256430795830500:11484]
2025-10-01T14:14:08.937137Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:08.937155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:08.937157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.937159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.937161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.937173Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:08.937178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:08.937183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:08.937229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.937234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.937235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.937238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:08.937240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:08.937288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:08.937294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.937300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:08.937310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:08.937328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:08.937348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256430795830495:11484]
2025-10-01T14:14:08.937355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256430795830495:11484]
2025-10-01T14:14:08.937358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256430795830495:11484]
2025-10-01T14:14:08.937368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:08.937375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:08.937379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:08.937381Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:08.937382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:08.937390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:08.937396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:08.937403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731929:11880], now have 1 active actors on pipe
2025-10-01T14:14:08.937409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256433172731691:2446], now have 1 active actors on pipe
2025-10-01T14:14:08.937434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256430795830495:11484]
2025-10-01T14:14:08.937445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:08.937456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:08.937466Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2158
2025-10-01T14:14:08.937469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2158
2025-10-01T14:14:08.937568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.937579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.937604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:08.937614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:08.937618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:08.937624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:08.937633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:08.937641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:08.937655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.937795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:08.937803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:08.937815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:08.937894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2159 partition: 0 MaxSeqNo: 45 sessionId: src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0
2025-10-01T14:14:08.938293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|58cd8fd9-6111d48a-98b6206d-6232d333_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:08.941065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0] Write session: try to update token
2025-10-01T14:14:08.941081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:08.956243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2159 sessionId: src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:08.958725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:08.958744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:08.958746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:08.958749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:08.958759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256430795830495:11484]
2025-10-01T14:14:08.958765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256430795830495:11484]
2025-10-01T14:14:08.958769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256430795830495:11484]
2025-10-01T14:14:08.958825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:08.958838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:08.958840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:08.958989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:08.959007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:08.959070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:08.959083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:08.959089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:09.011269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256437467699240:11539]
2025-10-01T14:14:09.011585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2158, pipe: [1:7556256437467699240:11539]
2025-10-01T14:14:09.099010Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:09.099528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.099542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.099577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467699240:11539], now have 1 active actors on pipe
2025-10-01T14:14:09.099824Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:09.099845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256437467699240:11539]
2025-10-01T14:14:09.099873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:09.099881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:09.099887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:09.099973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2159 reason: error at write: Disconnected sessionId: src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0
2025-10-01T14:14:09.100161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2159 sessionId: src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0 is DEAD
2025-10-01T14:14:09.100344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:09.100357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0] Write session will restart in 0.008146s
2025-10-01T14:14:09.100388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0] Write session: Do CDS request
2025-10-01T14:14:09.100394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:09.109951Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.110059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:09.110076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2160
2025-10-01T14:14:09.110217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.110258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:09.110270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:09.110277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:09.110827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2160 sessionId:  describe result for acl check
2025-10-01T14:14:09.110889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:09.110900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:09.110903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:09.110910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256437467699336:11885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:09.111519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256437467699336:11885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:09.113848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256437467699336:11885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:09.115106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:09.117525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:09.117724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:09.117731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:09.117740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:09.117772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:09.117800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256435090798038:11486]
2025-10-01T14:14:09.117882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256437467699336:11885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:09.117896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256437467699336:11885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:09.117899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256437467699336:11885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:09.117907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:09.118210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:09.118550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:09.118585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:09.118782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:09.118819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.118824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.118825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.118825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.118826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.118827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.118827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.118828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.118829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.118829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.118830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.118831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.118832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.118833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.118836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.118842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.118844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.118846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.118848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.118851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.118853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.118855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.118857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.118860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.118862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.118864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.118866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.118869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.118874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.118878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.118882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.118885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.118888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.118891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.118894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.118897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.118900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.118903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.118905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.118910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.118914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.118916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.118919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.118922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.118926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.118929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.118931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.118934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.118936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.118939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.118942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.118944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.118947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.118949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.118951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.118956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.118993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:09.122769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:09.123441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:09.123457Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:09.123459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:09.123462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:09.123468Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2159 [2:7556256435090798038:11486]
2025-10-01T14:14:09.123482Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:09.123498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:09.123504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.123506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.123508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.123521Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:09.123528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:09.123533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:09.123592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.123601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.123603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.123605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:09.123608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:09.123671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:09.123676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.123684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.123690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.123699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:09.123718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256435090798033:11486]
2025-10-01T14:14:09.123723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256435090798033:11486]
2025-10-01T14:14:09.123725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256435090798033:11486]
2025-10-01T14:14:09.123735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:09.123746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:09.123749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467699242:2446], now have 1 active actors on pipe
2025-10-01T14:14:09.123751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467699481:11885], now have 1 active actors on pipe
2025-10-01T14:14:09.123754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:09.123756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:09.123757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:09.123766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:09.123767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:09.123794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256435090798033:11486]
2025-10-01T14:14:09.123805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:09.123813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:09.123854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2159
2025-10-01T14:14:09.123862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2159
2025-10-01T14:14:09.123931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.123945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.123971Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|feed4f07-d37c6422-dc21451b-396e3820_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:09.123980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.123983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.123985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:09.123995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.124005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:09.124024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.124217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.124222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.124233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.124334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2160 partition: 0 MaxSeqNo: 45 sessionId: src_id|feed4f07-d37c6422-dc21451b-396e3820_0
2025-10-01T14:14:09.124685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8dafe0d1-d51c0345-b97bf33-c492c860_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|feed4f07-d37c6422-dc21451b-396e3820_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:09.127561Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feed4f07-d37c6422-dc21451b-396e3820_0] Write session: try to update token
2025-10-01T14:14:09.127579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feed4f07-d37c6422-dc21451b-396e3820_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:09.139603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:09.139619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:09.139627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256435090798033:11486]
2025-10-01T14:14:09.139673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:09.139705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:09.139844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:09.139985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:09.140122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:09.140252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:09.140438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:09.140476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:09.144284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2160 sessionId: src_id|feed4f07-d37c6422-dc21451b-396e3820_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:09.147103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:09.147686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.147709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.147746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:09.147865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:09.152530Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:09.152546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:09.152548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:09.152550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:09.152559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256435090798033:11486]
2025-10-01T14:14:09.152563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256435090798033:11486]
2025-10-01T14:14:09.152566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256435090798033:11486]
2025-10-01T14:14:09.152621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:09.152624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:09.152626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:09.152629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.152629Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:09.152630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:09.152750Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:09.200195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256437467699494:11539]
2025-10-01T14:14:09.200488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2159, pipe: [1:7556256437467699494:11539]
2025-10-01T14:14:09.287496Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:09.296059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.296089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.296237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.296295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.296357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.296420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.296470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.296480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.296540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.296610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.296669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.296731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.296775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.296783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.296850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.296904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.296960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.297017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.297064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.297071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.297138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.297205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.297266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.297329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.297384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.297392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.297460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.297518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.297582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.297648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.297694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.297701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.297773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.297833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.297895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.297959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.298006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.298013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.298084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.298146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.298212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.298281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.298333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.298340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.298423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.298487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.298557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.298625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.298671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.298676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.298742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.298802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.298857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.298910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.298952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.298957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.299013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:09.299062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:09.299116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:09.299169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:09.299218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:09.299226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:09.299293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467699494:11539], now have 1 active actors on pipe
2025-10-01T14:14:09.299660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:09.299660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256437467699494:11539]
2025-10-01T14:14:09.299699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:09.299701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:09.299733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2160 reason: error at write: Disconnected sessionId: src_id|feed4f07-d37c6422-dc21451b-396e3820_0
2025-10-01T14:14:09.299896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2160 sessionId: src_id|feed4f07-d37c6422-dc21451b-396e3820_0 is DEAD
2025-10-01T14:14:09.300110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feed4f07-d37c6422-dc21451b-396e3820_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:09.300119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feed4f07-d37c6422-dc21451b-396e3820_0] Write session will restart in 0.006345s
2025-10-01T14:14:09.300140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feed4f07-d37c6422-dc21451b-396e3820_0] Write session: Do CDS request
2025-10-01T14:14:09.300145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feed4f07-d37c6422-dc21451b-396e3820_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:09.300352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:09.307903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|feed4f07-d37c6422-dc21451b-396e3820_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.308002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:09.308020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2161
2025-10-01T14:14:09.308166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.308199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:09.308205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:09.308210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:09.308833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2161 sessionId:  describe result for acl check
2025-10-01T14:14:09.308870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:09.308872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:09.308874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:09.308880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256437467699523:11889] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:09.309458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256437467699523:11889] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:09.313040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256437467699523:11889] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:09.316140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256437467699523:11889] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:09.316154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256437467699523:11889] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:09.316159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256437467699523:11889] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:09.316166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:09.317385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:09.320854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:09.321148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:09.321161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:09.321175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:09.321240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:09.321287Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256435090798285:11489]
2025-10-01T14:14:09.321812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:09.322156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:09.322209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:09.322526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:09.322597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.322604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.322605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.322606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.322608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.322609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.322611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.322612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.322613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.322614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.322615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.322616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.322617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.322618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.322624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.322633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.322637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.322640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.322644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.322647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.322651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.322654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.322658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.322662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.322665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.322669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.322673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.322676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.322683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.322690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.322695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.322701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.322705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.322709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.322713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.322718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.322722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.322726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.322729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.322734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.322738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.322743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.322747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.322751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.322755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.322759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.322763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.322768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.322774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.322779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.322783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.322787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.322791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.322795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.322799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.322803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.322836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:09.326749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:09.327648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:09.327658Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:09.327660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:09.327662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:09.327667Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2160 [2:7556256435090798285:11489]
2025-10-01T14:14:09.327681Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:09.327694Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:09.327700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.327703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.327705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.327717Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:09.327723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:09.327728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:09.327771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.327776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.327777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.327780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:09.327782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:09.327834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:09.327839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.327846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.327852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.327864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:09.327879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256435090798280:11489]
2025-10-01T14:14:09.327884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256435090798280:11489]
2025-10-01T14:14:09.327885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256435090798280:11489]
2025-10-01T14:14:09.327891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:09.327901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:09.327908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:09.327910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:09.327912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:09.327917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:09.327919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:09.327920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467699735:11889], now have 1 active actors on pipe
2025-10-01T14:14:09.327943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467699497:2446], now have 1 active actors on pipe
2025-10-01T14:14:09.327945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256435090798280:11489]
2025-10-01T14:14:09.327950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:09.327968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:09.328137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2160
2025-10-01T14:14:09.328137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2160
2025-10-01T14:14:09.328235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.328253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.328283Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:09.328299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.328304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.328307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:09.328317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.328335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:09.328354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.328551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.328560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.328576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.328680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2161 partition: 0 MaxSeqNo: 45 sessionId: src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0
2025-10-01T14:14:09.329034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|feed4f07-d37c6422-dc21451b-396e3820_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:09.331992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0] Write session: try to update token
2025-10-01T14:14:09.332014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:09.346628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2161 sessionId: src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:09.347810Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:09.347828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:09.347831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:09.347833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:09.347844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256435090798280:11489]
2025-10-01T14:14:09.347850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256435090798280:11489]
2025-10-01T14:14:09.347854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256435090798280:11489]
2025-10-01T14:14:09.347902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:09.347907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:09.347912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:09.347913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.347915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:09.347916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:09.348046Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:09.349484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:09.399854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256437467699749:11539]
2025-10-01T14:14:09.400134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2160, pipe: [1:7556256437467699749:11539]
2025-10-01T14:14:09.489233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:09.489747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.489769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.489816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467699749:11539], now have 1 active actors on pipe
2025-10-01T14:14:09.490056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:09.490100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:09.490102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:09.490147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2161 reason: error at write: Disconnected sessionId: src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0
2025-10-01T14:14:09.490270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256437467699749:11539]
2025-10-01T14:14:09.490299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2161 sessionId: src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0 is DEAD
2025-10-01T14:14:09.490498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:09.490507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0] Write session will restart in 0.007462s
2025-10-01T14:14:09.490533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0] Write session: Do CDS request
2025-10-01T14:14:09.490542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:09.490693Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:09.498924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.499071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:09.499096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2162
2025-10-01T14:14:09.499211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.499243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:09.499253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:09.499257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:09.499679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2162 sessionId:  describe result for acl check
2025-10-01T14:14:09.499725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:09.499731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:09.499732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:09.499737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256437467699846:11900] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:09.500170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256437467699846:11900] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:09.502696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256437467699846:11900] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:09.505404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:09.505513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256437467699846:11900] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:09.505525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256437467699846:11900] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:09.505528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256437467699846:11900] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:09.505537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:09.508064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:09.508275Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:09.508290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:09.508303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:09.508363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:09.508407Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256435090798549:11494]
2025-10-01T14:14:09.508987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:09.509285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:09.509339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:09.509624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:09.509699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.509706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.509707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.509708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.509709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.509710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.509712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.509713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.509714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.509716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.509717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.509718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.509719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.509720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.509724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.509734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.509737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.509741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.509744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.509748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.509751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.509755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.509758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.509763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.509767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.509770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.509774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.509777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.509784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.509798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.509807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.509815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.509823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.509829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.509837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.509846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.509854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.509863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.509872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.509876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.509881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.509889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.509893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.509897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.509906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.509914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.509922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.509926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.509934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.509939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.509943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.509948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.509956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.509964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.509972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.509977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.510015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:09.513510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:09.514149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:09.514170Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:09.514173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:09.514176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:09.514183Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2161 [2:7556256435090798549:11494]
2025-10-01T14:14:09.514198Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:09.514215Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:09.514223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.514227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.514230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.514246Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:09.514256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:09.514263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:09.514325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.514336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.514338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.514341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:09.514344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:09.514426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:09.514435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.514448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.514466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.514487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:09.514505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467700019:11900], now have 1 active actors on pipe
2025-10-01T14:14:09.514513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467699778:2446], now have 1 active actors on pipe
2025-10-01T14:14:09.514521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256435090798543:11494]
2025-10-01T14:14:09.514523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256435090798543:11494]
2025-10-01T14:14:09.514525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256435090798543:11494]
2025-10-01T14:14:09.514519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2161
2025-10-01T14:14:09.514543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:09.514526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2161
2025-10-01T14:14:09.514563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:09.514564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:09.514566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:09.514568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:09.514578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:09.514582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:09.514629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.514638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.514652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256435090798543:11494]
2025-10-01T14:14:09.514664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:09.514680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:09.514697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:09.514708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.514719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.514722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:09.514732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.514744Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:09.514771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.514927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.514938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.514956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.515054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2162 partition: 0 MaxSeqNo: 45 sessionId: src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0
2025-10-01T14:14:09.515420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a17bc88c-c1e52e96-d728766e-e09a5b99_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:09.517966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0] Write session: try to update token
2025-10-01T14:14:09.517980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:09.533700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2162 sessionId: src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:09.534241Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:09.534258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:09.534260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:09.534262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:09.534270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256435090798543:11494]
2025-10-01T14:14:09.534274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256435090798543:11494]
2025-10-01T14:14:09.534277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256435090798543:11494]
2025-10-01T14:14:09.534324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:09.534323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:09.534328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:09.534331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.534333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:09.534333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:09.534483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:09.535962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:09.590322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256437467700036:11539]
2025-10-01T14:14:09.590696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2161, pipe: [1:7556256437467700036:11539]
2025-10-01T14:14:09.674013Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:09.674568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.674580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.674616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467700036:11539], now have 1 active actors on pipe
2025-10-01T14:14:09.674830Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:09.674881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:09.674892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:09.674907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256437467700036:11539]
2025-10-01T14:14:09.674927Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:09.674952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2162 reason: error at write: Disconnected sessionId: src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0
2025-10-01T14:14:09.675148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2162 sessionId: src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0 is DEAD
2025-10-01T14:14:09.675449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:09.675459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0] Write session will restart in 0.008275s
2025-10-01T14:14:09.675479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0] Write session: Do CDS request
2025-10-01T14:14:09.675484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:09.684850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.684952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:09.684966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2163
2025-10-01T14:14:09.685139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.685164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:09.685172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:09.685175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:09.685579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2163 sessionId:  describe result for acl check
2025-10-01T14:14:09.685627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:09.685633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:09.685635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:09.685640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256437467700134:11905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:09.686156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256437467700134:11905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:09.688356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256437467700134:11905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:09.692575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:09.692714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256437467700134:11905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:09.692733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256437467700134:11905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:09.692737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256437467700134:11905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:09.692745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:09.693029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:09.693200Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:09.693210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:09.693222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:09.693271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:09.693310Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256435090798797:11496]
2025-10-01T14:14:09.693876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:09.694111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:09.694150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:09.694457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:09.694512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.694518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.694519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.694521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.694522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.694523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.694524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.694526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.694527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.694528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.694529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.694530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.694531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.694532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.694537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.694547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.694551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.694555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.694559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.694580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.694583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.694587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.694593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.694598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.694606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.694611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.694614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.694618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.694629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.694641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.694651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.694660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.694668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.694677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.694684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.694693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.694703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.694708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.694712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.694719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.694728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.694737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.694745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.694753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.694761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.694770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.694778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.694783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.694792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.694801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.694809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.694818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.694827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.694835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.694843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.694852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.694896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:09.698330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:09.699031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:09.699045Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:09.699047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:09.699051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:09.699059Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2162 [2:7556256435090798797:11496]
2025-10-01T14:14:09.699074Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:09.699090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:09.699093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.699097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.699100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.699117Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:09.699126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:09.699134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:09.699189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.699195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.699197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.699200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:09.699202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:09.699280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:09.699288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.699299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.699316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.699337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:09.699359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467700282:11905], now have 1 active actors on pipe
2025-10-01T14:14:09.699366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467700039:2446], now have 1 active actors on pipe
2025-10-01T14:14:09.699373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256435090798791:11496]
2025-10-01T14:14:09.699376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256435090798791:11496]
2025-10-01T14:14:09.699377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256435090798791:11496]
2025-10-01T14:14:09.699391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:09.699406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:09.699417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:09.699422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:09.699425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:09.699426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:09.699408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2162
2025-10-01T14:14:09.699428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:09.699426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2162
2025-10-01T14:14:09.699453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256435090798791:11496]
2025-10-01T14:14:09.699460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:09.699506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.699516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.699519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:09.699539Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a810463-a850d8e7-ecf50d15-8742245e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:09.699550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.699553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.699559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:09.699566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.699575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:09.699591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.699736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.699747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.699767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.699839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2163 partition: 0 MaxSeqNo: 45 sessionId: src_id|7a810463-a850d8e7-ecf50d15-8742245e_0
2025-10-01T14:14:09.700213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8fba518-bb287682-5c4d7de3-66eeee7f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7a810463-a850d8e7-ecf50d15-8742245e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:09.706615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a810463-a850d8e7-ecf50d15-8742245e_0] Write session: try to update token
2025-10-01T14:14:09.706642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a810463-a850d8e7-ecf50d15-8742245e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:09.715670Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:09.715696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:09.715706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256435090798791:11496]
2025-10-01T14:14:09.715758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:09.715763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:09.715952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:09.716102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:09.716257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:09.716407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:09.716654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:09.716699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:09.726432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2163 sessionId: src_id|7a810463-a850d8e7-ecf50d15-8742245e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:09.728948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:09.729199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.729224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.729244Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:09.729247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:09.729250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:09.729254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:09.729265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256435090798791:11496]
2025-10-01T14:14:09.729274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256435090798791:11496]
2025-10-01T14:14:09.729278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256435090798791:11496]
2025-10-01T14:14:09.729324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:09.729336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:09.729340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:09.729340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:09.729345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.729347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:09.729474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:09.775148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256437467700305:11539]
2025-10-01T14:14:09.775428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2162, pipe: [1:7556256437467700305:11539]
2025-10-01T14:14:09.884961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:09.885304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:09.885344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467700305:11539], now have 1 active actors on pipe
2025-10-01T14:14:09.885456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:09.885558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:09.885565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:09.885604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256437467700305:11539]
2025-10-01T14:14:09.885627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:09.885646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2163 reason: error at write: Disconnected sessionId: src_id|7a810463-a850d8e7-ecf50d15-8742245e_0
2025-10-01T14:14:09.885790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2163 sessionId: src_id|7a810463-a850d8e7-ecf50d15-8742245e_0 is DEAD
2025-10-01T14:14:09.885944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a810463-a850d8e7-ecf50d15-8742245e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:09.885955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a810463-a850d8e7-ecf50d15-8742245e_0] Write session will restart in 0.005139s
2025-10-01T14:14:09.885976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a810463-a850d8e7-ecf50d15-8742245e_0] Write session: Do CDS request
2025-10-01T14:14:09.885982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a810463-a850d8e7-ecf50d15-8742245e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:09.891807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a810463-a850d8e7-ecf50d15-8742245e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.891970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:09.891981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2164
2025-10-01T14:14:09.892127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:09.892156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:09.892165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:09.892167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:09.892472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2164 sessionId:  describe result for acl check
2025-10-01T14:14:09.892499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:09.892504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:09.892505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:09.892508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256437467700323:11910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:09.892879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256437467700323:11910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:09.895112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256437467700323:11910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:09.898091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256437467700323:11910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:09.898103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256437467700323:11910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:09.898106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256437467700323:11910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:09.898112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:09.901955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:09.904695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:09.904853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:09.904860Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:09.904867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:09.904898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:09.904926Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256435090799075:11509]
2025-10-01T14:14:09.905315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:09.905538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:09.905561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:09.905738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:09.905776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.905780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.905781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.905781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.905782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.905783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.905784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.905785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.905785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.905786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.905787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.905787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.905788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.905788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.905791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.905797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.905799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.905801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.905803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.905805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.905807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.905809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.905811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.905814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.905816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.905817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.905819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.905822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.905826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.905830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:09.905834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.905836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:09.905840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.905844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:09.905848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.905853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:09.905857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.905866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:09.905870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.905878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:09.905882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.905890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:09.905896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.905904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:09.905908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.905916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:09.905924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.905929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.905936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.905940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.905948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.905956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.905960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.905968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:09.905975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.905979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:09.906015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:09.909680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:09.910401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:09.910413Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:09.910414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:09.910417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:09.910422Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2163 [2:7556256435090799075:11509]
2025-10-01T14:14:09.910433Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:09.910447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:09.910452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.910455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.910456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.910468Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:09.910475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:09.910479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:09.910524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.910529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.910531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.910533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:09.910535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:09.910584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:09.910589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.910596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:09.910606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:09.910617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:09.910633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256435090799070:11509]
2025-10-01T14:14:09.910637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256435090799070:11509]
2025-10-01T14:14:09.910639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256435090799070:11509]
2025-10-01T14:14:09.910647Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:09.910657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467700308:2446], now have 1 active actors on pipe
2025-10-01T14:14:09.910658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:09.910660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:09.910662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:09.910663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467700469:11910], now have 1 active actors on pipe
2025-10-01T14:14:09.910669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:09.910677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:09.910683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:09.910710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256435090799070:11509]
2025-10-01T14:14:09.910718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:09.910722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:09.910732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2163
2025-10-01T14:14:09.910734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2163
2025-10-01T14:14:09.910772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.910781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.910800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:09.910808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:09.910812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:09.910818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:09.910824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:09.910834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:09.910843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.910985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.910994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.911008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:09.911092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2164 partition: 0 MaxSeqNo: 45 sessionId: src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0
2025-10-01T14:14:09.911581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a810463-a850d8e7-ecf50d15-8742245e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:09.914455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0] Write session: try to update token
2025-10-01T14:14:09.914474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:09.921709Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:09.921729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:09.921739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256435090799070:11509]
2025-10-01T14:14:09.921782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:09.921791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:09.921956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:09.922099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:09.922235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:09.922408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:09.922610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:09.922650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:09.928280Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2164 sessionId: src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:09.931175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:09.931764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:09.931786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:09.931823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:09.931927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:09.939858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:09.939879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:09.939881Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:09.939883Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:09.939893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256435090799070:11509]
2025-10-01T14:14:09.939898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256435090799070:11509]
2025-10-01T14:14:09.939901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256435090799070:11509]
2025-10-01T14:14:09.939947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:09.939948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:09.939953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:09.939954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:09.939956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:09.939958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:09.940078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:09.985578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256437467700566:11539]
2025-10-01T14:14:09.985810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2163, pipe: [1:7556256437467700566:11539]
2025-10-01T14:14:10.082568Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:10.089804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.089829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.089977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.090040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.090101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.090153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.090193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.090200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.090253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.090305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.090383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.090446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.090490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.090496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.090566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.090623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.090680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.090736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.090777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.090782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.090842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.090905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.090964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.091021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.091068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.091079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.091142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.091193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.091251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.091306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.091346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.091352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.091420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.091476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.091534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.091597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.091637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.091643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.091702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.091755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.091808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.091862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.091906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.091914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.091970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.092021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.092082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.092141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.092179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.092184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.092245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.092301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.092355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.092408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.092455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.092461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.092519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:10.092572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:10.092641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:10.092694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:10.092732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:10.092737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:10.092780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256437467700566:11539], now have 1 active actors on pipe
2025-10-01T14:14:10.093003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256437467700566:11539]
2025-10-01T14:14:10.093006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:10.093009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:10.093034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:10.093036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2164 reason: error at write: Disconnected sessionId: src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0
2025-10-01T14:14:10.093245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2164 sessionId: src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0 is DEAD
2025-10-01T14:14:10.093390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:10.093399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0] Write session will restart in 0.008601s
2025-10-01T14:14:10.093417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0] Write session: Do CDS request
2025-10-01T14:14:10.093421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:10.093712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:10.102854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.102954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:10.102967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2165
2025-10-01T14:14:10.103152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.103201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:10.103213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:10.103216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:10.103642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2165 sessionId:  describe result for acl check
2025-10-01T14:14:10.103671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:10.103673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:10.103675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:10.103680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256441762667920:11915] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:10.104140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256441762667920:11915] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:10.107134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256441762667920:11915] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:10.110204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256441762667920:11915] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:10.110219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256441762667920:11915] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:10.110223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256441762667920:11915] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:10.110232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:10.111112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:10.113752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:10.113963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:10.113973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:10.113985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:10.114037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:10.114075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256439385766619:11511]
2025-10-01T14:14:10.114712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:10.115007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:10.115051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:10.115371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:10.115426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.115432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.115433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.115434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.115435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.115437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.115438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.115439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.115441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.115442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.115443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.115444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.115446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.115447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.115452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.115462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.115470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.115478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.115482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.115487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.115496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.115504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.115508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.115516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.115524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.115528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.115536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.115540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.115550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.115562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.115572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.115582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.115591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.115601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.115610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.115618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.115626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.115635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.115644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.115653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.115662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.115671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.115681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.115690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.115699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.115708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.115717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.115726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.115736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.115745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.115753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.115758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.115763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.115768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.115776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.115785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.115830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:10.119483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:10.120289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:10.120307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:10.120309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:10.120312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:10.120320Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2164 [2:7556256439385766619:11511]
2025-10-01T14:14:10.120335Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:10.120351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:10.120354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.120358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.120360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.120375Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:10.120385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:10.120394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:10.120454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.120462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.120465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.120468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:10.120470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:10.120533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:10.120543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.120556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.120567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.120616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:10.120639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668107:11915], now have 1 active actors on pipe
2025-10-01T14:14:10.120647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762667864:2446], now have 1 active actors on pipe
2025-10-01T14:14:10.120655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256439385766614:11511]
2025-10-01T14:14:10.120657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256439385766614:11511]
2025-10-01T14:14:10.120659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256439385766614:11511]
2025-10-01T14:14:10.120673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:10.120684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:10.120687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:10.120689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:10.120692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:10.120705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:10.120708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:10.120689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2164
2025-10-01T14:14:10.120710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2164
2025-10-01T14:14:10.120740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256439385766614:11511]
2025-10-01T14:14:10.120751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:10.120757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:10.120767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.120775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.120820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:10.120831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.120835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.120837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:10.120845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.120857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:10.120878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.121041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.121050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.121065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.121154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2165 partition: 0 MaxSeqNo: 45 sessionId: src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0
2025-10-01T14:14:10.121546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64bf7ec5-abfce6eb-7e82f0ea-28aaf0b1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:10.124468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0] Write session: try to update token
2025-10-01T14:14:10.124489Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:10.139964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2165 sessionId: src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:10.142431Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:10.142450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:10.142452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:10.142454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:10.142462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256439385766614:11511]
2025-10-01T14:14:10.142468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256439385766614:11511]
2025-10-01T14:14:10.142471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256439385766614:11511]
2025-10-01T14:14:10.142511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:10.142517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.142519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:10.142528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:10.142543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:10.142548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:10.142640Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:10.143898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:10.192927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256441762668121:11539]
2025-10-01T14:14:10.193134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2164, pipe: [1:7556256441762668121:11539]
2025-10-01T14:14:10.296636Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:10.297136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.297150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.297182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668121:11539], now have 1 active actors on pipe
2025-10-01T14:14:10.297336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:10.297418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:10.297453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256441762668121:11539]
2025-10-01T14:14:10.297459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:10.297516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2165 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0
2025-10-01T14:14:10.297652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2165 sessionId: src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0 is DEAD
2025-10-01T14:14:10.297909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:10.297925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0] Write session will restart in 0.009700s
2025-10-01T14:14:10.297955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0] Write session: Do CDS request
2025-10-01T14:14:10.297963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:10.308947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.309039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:10.309056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2166
2025-10-01T14:14:10.309259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.309305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:10.309317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:10.309321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:10.309741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2166 sessionId:  describe result for acl check
2025-10-01T14:14:10.309775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:10.309782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:10.309784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:10.309790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256441762668220:11919] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:10.310244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256441762668220:11919] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:10.312138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256441762668220:11919] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:10.314414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256441762668220:11919] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:10.314426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256441762668220:11919] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:10.314430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256441762668220:11919] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:10.314438Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:10.315183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:10.317777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:10.317969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:10.317977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:10.317987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:10.318030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:10.318064Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256439385766870:11514]
2025-10-01T14:14:10.318600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:10.318923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:10.318972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:10.319282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:10.319356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.319363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.319364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.319365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.319366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.319368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.319369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.319370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.319372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.319373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.319374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.319376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.319377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.319378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.319383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.319392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.319394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.319396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.319398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.319401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.319403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.319405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.319407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.319410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.319414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.319418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.319422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.319425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.319433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.319442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.319448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.319454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.319458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.319464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.319468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.319474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.319478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.319484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.319489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.319494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.319499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.319504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.319508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.319513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.319518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.319523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.319528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.319534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.319539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.319544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.319549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.319552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.319555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.319558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.319562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.319565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.319588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:10.323366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:10.324213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:10.324222Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:10.324224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:10.324226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:10.324232Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2165 [2:7556256439385766870:11514]
2025-10-01T14:14:10.324244Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:10.324256Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:10.324258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.324261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.324262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.324274Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:10.324278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:10.324282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:10.324323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.324329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.324330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.324333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:10.324346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:10.324405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:10.324412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.324421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.324427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.324450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:10.324470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668368:11919], now have 1 active actors on pipe
2025-10-01T14:14:10.324473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668124:2446], now have 1 active actors on pipe
2025-10-01T14:14:10.324481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256439385766865:11514]
2025-10-01T14:14:10.324483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256439385766865:11514]
2025-10-01T14:14:10.324485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256439385766865:11514]
2025-10-01T14:14:10.324500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:10.324513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:10.324524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:10.324530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:10.324533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:10.324534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:10.324537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:10.324532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2165
2025-10-01T14:14:10.324566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256439385766865:11514]
2025-10-01T14:14:10.324569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:10.324588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:10.324555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2165
2025-10-01T14:14:10.324608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.324615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.324638Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6deb177d-df420ba5-f95f39f-56619924_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:10.324647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.324653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.324655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:10.324664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.324673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:10.324934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.325076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.325084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.325097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.325190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2166 partition: 0 MaxSeqNo: 45 sessionId: src_id|6deb177d-df420ba5-f95f39f-56619924_0
2025-10-01T14:14:10.325566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bf3d641-f21a91c6-21ba892-f1ab4304_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6deb177d-df420ba5-f95f39f-56619924_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:10.328534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6deb177d-df420ba5-f95f39f-56619924_0] Write session: try to update token
2025-10-01T14:14:10.328553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6deb177d-df420ba5-f95f39f-56619924_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:10.342465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2166 sessionId: src_id|6deb177d-df420ba5-f95f39f-56619924_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:10.344968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:10.345952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.345980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.346000Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:10.346003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:10.346006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:10.346009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:10.346017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256439385766865:11514]
2025-10-01T14:14:10.346022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256439385766865:11514]
2025-10-01T14:14:10.346026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256439385766865:11514]
2025-10-01T14:14:10.346066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:10.346082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:10.346084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:10.346086Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:10.346091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.346094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:10.346232Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:10.397722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256441762668381:11539]
2025-10-01T14:14:10.397949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2165, pipe: [1:7556256441762668381:11539]
2025-10-01T14:14:10.509127Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:10.509566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:10.509623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668381:11539], now have 1 active actors on pipe
2025-10-01T14:14:10.509686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:10.509746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:10.509798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256441762668381:11539]
2025-10-01T14:14:10.520013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:10.520026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:10.520052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2166 reason: error at write: Disconnected sessionId: src_id|6deb177d-df420ba5-f95f39f-56619924_0
2025-10-01T14:14:10.520198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2166 sessionId: src_id|6deb177d-df420ba5-f95f39f-56619924_0 is DEAD
2025-10-01T14:14:10.520294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deb177d-df420ba5-f95f39f-56619924_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:10.520300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deb177d-df420ba5-f95f39f-56619924_0] Write session will restart in 0.008459s
2025-10-01T14:14:10.520329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deb177d-df420ba5-f95f39f-56619924_0] Write session: Do CDS request
2025-10-01T14:14:10.520336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deb177d-df420ba5-f95f39f-56619924_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:10.529865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6deb177d-df420ba5-f95f39f-56619924_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.530523Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:10.530540Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2167
2025-10-01T14:14:10.530677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.530709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:10.530719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:10.530723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:10.531152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2167 sessionId:  describe result for acl check
2025-10-01T14:14:10.531192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:10.531198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:10.531200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:10.531206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256441762668522:11930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:10.531711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256441762668522:11930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:10.534610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256441762668522:11930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:10.536702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:10.537042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256441762668522:11930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:10.537056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256441762668522:11930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:10.537061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256441762668522:11930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:10.537069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:10.539613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:10.539937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:10.539949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:10.539961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:10.540021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:10.540061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256439385767141:11519]
2025-10-01T14:14:10.540679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:10.541026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:10.541070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:10.541370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:10.541422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.541427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.541429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.541430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.541431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.541432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.541434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.541435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.541436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.541437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.541438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.541452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.541453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.541454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.541460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.541470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.541474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.541478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.541482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.541485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.541489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.541493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.541496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.541500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.541504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.541508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.541512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.541516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.541523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.541531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.541541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.541546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.541554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.541559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.541563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.541569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.541578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.541584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.541591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.541596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.541605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.541614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.541619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.541623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.541628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.541637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.541653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.541662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.541667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.541677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.541681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.541685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.541688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.541693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.541701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.541708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.541748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:10.545683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:10.546647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:10.546659Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:10.546661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:10.546665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:10.546671Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2166 [2:7556256439385767141:11519]
2025-10-01T14:14:10.546687Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:10.546704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:10.546707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.546710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.546712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.546727Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:10.546738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:10.546744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:10.546798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.546805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.546807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.546810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:10.546812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:10.546882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:10.546889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.546900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.546912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.546933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:10.546955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668657:11930], now have 1 active actors on pipe
2025-10-01T14:14:10.546963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668413:2446], now have 1 active actors on pipe
2025-10-01T14:14:10.546970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256439385767135:11519]
2025-10-01T14:14:10.546974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256439385767135:11519]
2025-10-01T14:14:10.546976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256439385767135:11519]
2025-10-01T14:14:10.546989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:10.547006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:10.547009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:10.547025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:10.547027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:10.547030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:10.547032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:10.547064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256439385767135:11519]
2025-10-01T14:14:10.547074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:10.547049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2166
2025-10-01T14:14:10.547083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:10.547050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2166
2025-10-01T14:14:10.547103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.547113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.547145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db18444c-283bb225-6e29e424-d03576c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:10.547155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.547160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.547167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:10.547175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.547183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:10.547197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.547427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.547435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.547449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.547573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2167 partition: 0 MaxSeqNo: 45 sessionId: src_id|db18444c-283bb225-6e29e424-d03576c8_0
2025-10-01T14:14:10.547897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6deb177d-df420ba5-f95f39f-56619924_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db18444c-283bb225-6e29e424-d03576c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:10.550621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db18444c-283bb225-6e29e424-d03576c8_0] Write session: try to update token
2025-10-01T14:14:10.550638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db18444c-283bb225-6e29e424-d03576c8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:10.565111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2167 sessionId: src_id|db18444c-283bb225-6e29e424-d03576c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:10.567582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:10.568633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.568661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.568682Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:10.568686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:10.568688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:10.568690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:10.568699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256439385767135:11519]
2025-10-01T14:14:10.568704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256439385767135:11519]
2025-10-01T14:14:10.568710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256439385767135:11519]
2025-10-01T14:14:10.568752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:10.568766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:10.568769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:10.568770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:10.568776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.568778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:10.568919Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:10.610240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256441762668673:11539]
2025-10-01T14:14:10.610574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2166, pipe: [1:7556256441762668673:11539]
2025-10-01T14:14:10.707770Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:10.708124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:10.708168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668673:11539], now have 1 active actors on pipe
2025-10-01T14:14:10.708257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:10.708353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256441762668673:11539]
2025-10-01T14:14:10.708384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:10.708403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:10.708413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:10.708430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2167 reason: error at write: Disconnected sessionId: src_id|db18444c-283bb225-6e29e424-d03576c8_0
2025-10-01T14:14:10.708614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2167 sessionId: src_id|db18444c-283bb225-6e29e424-d03576c8_0 is DEAD
2025-10-01T14:14:10.708772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db18444c-283bb225-6e29e424-d03576c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:10.708783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db18444c-283bb225-6e29e424-d03576c8_0] Write session will restart in 0.008983s
2025-10-01T14:14:10.708805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db18444c-283bb225-6e29e424-d03576c8_0] Write session: Do CDS request
2025-10-01T14:14:10.708813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db18444c-283bb225-6e29e424-d03576c8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:10.718925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db18444c-283bb225-6e29e424-d03576c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.719082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:10.719099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2168
2025-10-01T14:14:10.719247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.719283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:10.719296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:10.719300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:10.719705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2168 sessionId:  describe result for acl check
2025-10-01T14:14:10.719741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:10.719747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:10.719748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:10.719753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256441762668777:11935] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:10.720236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256441762668777:11935] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:10.722841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256441762668777:11935] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:10.724302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:10.726706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:10.726831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:10.726839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:10.726846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:10.726874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:10.726898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256439385767391:11521]
2025-10-01T14:14:10.726922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256441762668777:11935] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:10.726934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256441762668777:11935] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:10.726938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256441762668777:11935] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:10.726945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:10.727273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:10.727472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:10.727494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:10.727667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:10.727699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.727702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.727703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.727704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.727704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.727705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.727706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.727706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.727707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.727707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.727708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.727709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.727709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.727710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.727713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.727719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.727721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.727723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.727725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.727727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.727729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.727731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.727732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.727734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.727736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.727739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.727741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.727742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.727746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.727751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.727754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.727757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.727760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.727762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.727765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.727768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.727775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.727778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.727780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.727783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.727786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.727789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.727791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.727794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.727799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.727803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.727805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.727810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.727813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.727815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.727820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.727823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.727825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.727827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.727832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.727835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.727853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:10.731275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:10.731981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:10.731991Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:10.731993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:10.731995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:10.731999Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2167 [2:7556256439385767391:11521]
2025-10-01T14:14:10.732008Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:10.732019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:10.732024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.732026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.732028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.732042Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:10.732053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:10.732058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:10.732106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.732112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.732113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.732115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:10.732117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:10.732159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:10.732164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.732171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.732177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.732185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:10.732200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668936:11935], now have 1 active actors on pipe
2025-10-01T14:14:10.732205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668676:2446], now have 1 active actors on pipe
2025-10-01T14:14:10.732210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256439385767386:11521]
2025-10-01T14:14:10.732212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256439385767386:11521]
2025-10-01T14:14:10.732213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256439385767386:11521]
2025-10-01T14:14:10.732225Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:10.732240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:10.732248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:10.732250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:10.732252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:10.732256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:10.732258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:10.732279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256439385767386:11521]
2025-10-01T14:14:10.732289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:10.732281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2167
2025-10-01T14:14:10.732306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:10.732296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2167
2025-10-01T14:14:10.732519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.732527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.732556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae16a50-b4afd090-42b511e5-224d6567_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:10.732567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.732571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.732575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:10.732592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.732604Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:10.732622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.732778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.732785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.732798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.732876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2168 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae16a50-b4afd090-42b511e5-224d6567_0
2025-10-01T14:14:10.733259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db18444c-283bb225-6e29e424-d03576c8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae16a50-b4afd090-42b511e5-224d6567_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:10.736087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae16a50-b4afd090-42b511e5-224d6567_0] Write session: try to update token
2025-10-01T14:14:10.736104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae16a50-b4afd090-42b511e5-224d6567_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:10.750851Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2168 sessionId: src_id|ae16a50-b4afd090-42b511e5-224d6567_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:10.751861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:10.751887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:10.751890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:10.751892Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:10.751902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256439385767386:11521]
2025-10-01T14:14:10.751907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256439385767386:11521]
2025-10-01T14:14:10.751913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256439385767386:11521]
2025-10-01T14:14:10.751962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:10.751972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.751974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:10.752114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:10.752271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:10.752289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:10.752293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:10.753057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:10.808349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256441762668948:11539]
2025-10-01T14:14:10.808526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2167, pipe: [1:7556256441762668948:11539]
2025-10-01T14:14:10.893456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:10.893908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.893921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.893955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668948:11539], now have 1 active actors on pipe
2025-10-01T14:14:10.894115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:10.894143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:10.894155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:10.894181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:10.894193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2168 reason: error at write: Disconnected sessionId: src_id|ae16a50-b4afd090-42b511e5-224d6567_0
2025-10-01T14:14:10.894226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256441762668948:11539]
2025-10-01T14:14:10.894348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2168 sessionId: src_id|ae16a50-b4afd090-42b511e5-224d6567_0 is DEAD
2025-10-01T14:14:10.894561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae16a50-b4afd090-42b511e5-224d6567_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:10.894577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae16a50-b4afd090-42b511e5-224d6567_0] Write session will restart in 0.008260s
2025-10-01T14:14:10.894607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae16a50-b4afd090-42b511e5-224d6567_0] Write session: Do CDS request
2025-10-01T14:14:10.894614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae16a50-b4afd090-42b511e5-224d6567_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:10.903823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae16a50-b4afd090-42b511e5-224d6567_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.903980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:10.904003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2169
2025-10-01T14:14:10.904128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:10.904160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:10.904170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:10.904174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:10.904567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2169 sessionId:  describe result for acl check
2025-10-01T14:14:10.904610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:10.904612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:10.904613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:10.904616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256441762669050:11940] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:10.905031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256441762669050:11940] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:10.907251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256441762669050:11940] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:10.909792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:10.909873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256441762669050:11940] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:10.909887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256441762669050:11940] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:10.909890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256441762669050:11940] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:10.909898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:10.912611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:10.912777Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:10.912785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:10.912794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:10.912834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:10.912867Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256439385767675:11534]
2025-10-01T14:14:10.913249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:10.913480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:10.913510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:10.913706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:10.913740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.913745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.913745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.913746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.913747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.913747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.913748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.913749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.913749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.913750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.913750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.913751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.913752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.913752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.913756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.913766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.913769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.913773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.913777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.913780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.913784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.913787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.913791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.913794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.913800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.913801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.913803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.913806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.913810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.913817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:10.913823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.913827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:10.913829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.913832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:10.913836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.913842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:10.913850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.913871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:10.913878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.913881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:10.913885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.913888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:10.913890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.913893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:10.913895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.913901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:10.913905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.913910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.913914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.913919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.913922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.913924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.913929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.913932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:10.913934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.913936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:10.913955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:10.917405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:10.918430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:10.918442Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:10.918445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:10.918448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:10.918455Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2168 [2:7556256439385767675:11534]
2025-10-01T14:14:10.918471Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:10.918487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:10.918492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.918496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.918497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.918509Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:10.918516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:10.918521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:10.918560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.918565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.918566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.918569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:10.918571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:10.918629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:10.918636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.918644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:10.918653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:10.918666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:10.918681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762668950:2446], now have 1 active actors on pipe
2025-10-01T14:14:10.918687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762669198:11940], now have 1 active actors on pipe
2025-10-01T14:14:10.918692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256439385767669:11534]
2025-10-01T14:14:10.918694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256439385767669:11534]
2025-10-01T14:14:10.918695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256439385767669:11534]
2025-10-01T14:14:10.918704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:10.918713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:10.918718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:10.918720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:10.918721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:10.918725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:10.918727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:10.918749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256439385767669:11534]
2025-10-01T14:14:10.918760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:10.918763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:10.918771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2168
2025-10-01T14:14:10.918771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2168
2025-10-01T14:14:10.918811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.918818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.918836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:10.918844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:10.918848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:10.918853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:10.918859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:10.918868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:10.918884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.919028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.919035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.919049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:10.919116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2169 partition: 0 MaxSeqNo: 45 sessionId: src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0
2025-10-01T14:14:10.919483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae16a50-b4afd090-42b511e5-224d6567_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:10.922276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0] Write session: try to update token
2025-10-01T14:14:10.922296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:10.934115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:10.934132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:10.934141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256439385767669:11534]
2025-10-01T14:14:10.934180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:10.934190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:10.934338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:10.934498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:10.934638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:10.934775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:10.934988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:10.935028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:10.941418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2169 sessionId: src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:10.944029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:10.944410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:10.944432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:10.944471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:10.944824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:10.948688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:10.948704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:10.948707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:10.948709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:10.948719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256439385767669:11534]
2025-10-01T14:14:10.948723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256439385767669:11534]
2025-10-01T14:14:10.948727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256439385767669:11534]
2025-10-01T14:14:10.948771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:10.948773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:10.948780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:10.948783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:10.948786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:10.948791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:10.948901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:10.994229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256441762669213:11539]
2025-10-01T14:14:10.994554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2168, pipe: [1:7556256441762669213:11539]
2025-10-01T14:14:11.089511Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:11.096475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.096500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.096649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.096708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.096791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.096857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.097323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.097338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.097399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.097451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.097510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.097575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.097614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.097619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.097674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.097723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.097775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.097824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.097866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.097873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.097934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.097986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.098042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.098091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.098131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.098136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.098194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.098244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.098297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.098348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.098403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.098408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.098466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.098523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.098584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.098647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.098690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.098699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.098758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.098817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.098877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.098937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.098981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.098987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.099047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.099105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.099163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.099217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.099258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.099265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.099323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.099378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.099433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.099495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.099671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.099676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.099734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.099790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.099848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.099904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.099942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.099947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.099998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256441762669213:11539], now have 1 active actors on pipe
2025-10-01T14:14:11.100211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:11.100242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:11.100261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:11.100264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:11.100290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2169 reason: error at write: Disconnected sessionId: src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0
2025-10-01T14:14:11.100295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256441762669213:11539]
2025-10-01T14:14:11.100481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2169 sessionId: src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0 is DEAD
2025-10-01T14:14:11.100658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:11.100673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0] Write session will restart in 0.005767s
2025-10-01T14:14:11.100701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0] Write session: Do CDS request
2025-10-01T14:14:11.100707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:11.107844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.108021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:11.108033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2170
2025-10-01T14:14:11.108191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.108225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:11.108235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:11.108238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:11.108550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2170 sessionId:  describe result for acl check
2025-10-01T14:14:11.108576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:11.108591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:11.108592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:11.108595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256446057636557:11945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:11.108974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256446057636557:11945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:11.111812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256446057636557:11945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:11.114152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256446057636557:11945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:11.114161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256446057636557:11945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:11.114163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256446057636557:11945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:11.114170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:11.115165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:11.117435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:11.117583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:11.117591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:11.117598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:11.117629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:11.117654Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256443680735224:11536]
2025-10-01T14:14:11.118299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:11.118544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:11.118596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:11.118812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:11.118860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.118865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.118866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.118866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.118867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.118867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.118868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.118869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.118870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.118871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.118871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.118872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.118872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.118873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.118876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.118882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.118884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.118886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.118889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.118891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.118893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.118895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.118897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.118899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.118901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.118903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.118905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.118907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.118912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.118917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.118921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.118924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.118934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.118937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.118939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.118943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.118945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.118948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.118950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.118953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.118956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.118958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.118960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.118964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.118966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.118969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.118972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.118975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.118977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.118979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.118982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.118984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.118987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.118990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.118992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.118994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.119015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:11.122498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:11.123247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:11.123259Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:11.123261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:11.123263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:11.123268Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2169 [2:7556256443680735224:11536]
2025-10-01T14:14:11.123279Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:11.123295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:11.123300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.123303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.123304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.123316Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:11.123320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:11.123324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:11.123367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.123372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.123373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.123376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:11.123377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:11.123422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:11.123428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.123435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.123440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.123449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:11.123465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057636758:11945], now have 1 active actors on pipe
2025-10-01T14:14:11.123474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256443680735219:11536]
2025-10-01T14:14:11.123479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256443680735219:11536]
2025-10-01T14:14:11.123480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256443680735219:11536]
2025-10-01T14:14:11.123488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:11.123497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057636511:2446], now have 1 active actors on pipe
2025-10-01T14:14:11.123498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:11.123500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:11.123501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:11.123509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:11.123518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:11.123520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:11.123545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256443680735219:11536]
2025-10-01T14:14:11.123553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:11.123555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:11.123543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2169
2025-10-01T14:14:11.123576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.123570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2169
2025-10-01T14:14:11.123583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.123604Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:11.123611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.123614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.123619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:11.123625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.123631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:11.123644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.123791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.123796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.123805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.123890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2170 partition: 0 MaxSeqNo: 45 sessionId: src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0
2025-10-01T14:14:11.124251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b965ef8e-d78ad1d6-ee87a876-a853d685_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:11.126928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0] Write session: try to update token
2025-10-01T14:14:11.126944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:11.143157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2170 sessionId: src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:11.143497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:11.143516Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:11.143518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:11.143520Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:11.143526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256443680735219:11536]
2025-10-01T14:14:11.143530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256443680735219:11536]
2025-10-01T14:14:11.143532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256443680735219:11536]
2025-10-01T14:14:11.143571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:11.143581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.143582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:11.143605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:11.143616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:11.143619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:11.143708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:11.145700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:11.200564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256446057636773:11539]
2025-10-01T14:14:11.200862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2169, pipe: [1:7556256446057636773:11539]
2025-10-01T14:14:11.287117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:11.287538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.287564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.287622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057636773:11539], now have 1 active actors on pipe
2025-10-01T14:14:11.287846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:11.287858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256446057636773:11539]
2025-10-01T14:14:11.287866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:11.287884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:11.287923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2170 reason: error at write: Disconnected sessionId: src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0
2025-10-01T14:14:11.288116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2170 sessionId: src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0 is DEAD
2025-10-01T14:14:11.288281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:11.288292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0] Write session will restart in 0.009597s
2025-10-01T14:14:11.288313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0] Write session: Do CDS request
2025-10-01T14:14:11.288320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:11.288549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:11.298910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.300102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:11.300117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2171
2025-10-01T14:14:11.300277Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.300308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:11.300327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:11.300331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:11.300725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2171 sessionId:  describe result for acl check
2025-10-01T14:14:11.300769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:11.300775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:11.300777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:11.300782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256446057636920:11949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:11.301259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256446057636920:11949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:11.303110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256446057636920:11949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:11.304099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:11.306569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:11.306781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:11.306793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:11.306805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:11.306864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:11.306909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256443680735479:11539]
2025-10-01T14:14:11.306954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256446057636920:11949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:11.306969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256446057636920:11949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:11.306973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256446057636920:11949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:11.306981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:11.307496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:11.307773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:11.307825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:11.308128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:11.308187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.308193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.308194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.308195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.308196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.308197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.308199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.308200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.308201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.308202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.308203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.308204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.308205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.308206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.308211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.308220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.308224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.308227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.308230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.308233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.308237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.308240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.308243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.308246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.308249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.308253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.308256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.308264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.308271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.308283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.308295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.308304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.308308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.308313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.308317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.308322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.308327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.308337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.308340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.308348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.308356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.308364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.308372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.308377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.308381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.308386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.308394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.308398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.308404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.308410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.308419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.308423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.308427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.308431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.308436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.308440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.308480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:11.312150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:11.313225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:11.313243Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:11.313246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:11.313249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:11.313255Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2170 [2:7556256443680735479:11539]
2025-10-01T14:14:11.313270Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:11.313287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:11.313295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.313298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.313300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.313317Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:11.313327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:11.313338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:11.313398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.313405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.313407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.313410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:11.313412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:11.313480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:11.313487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.313499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.313513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.313532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:11.313553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637027:11949], now have 1 active actors on pipe
2025-10-01T14:14:11.313557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057636775:2446], now have 1 active actors on pipe
2025-10-01T14:14:11.313564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256443680735474:11539]
2025-10-01T14:14:11.313570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256443680735474:11539]
2025-10-01T14:14:11.313572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256443680735474:11539]
2025-10-01T14:14:11.313587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:11.313600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:11.313603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:11.313605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:11.313606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:11.313619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:11.313622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:11.313627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2170
2025-10-01T14:14:11.313625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2170
2025-10-01T14:14:11.313656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256443680735474:11539]
2025-10-01T14:14:11.313665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:11.313668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:11.313685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.313689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.313737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:11.313747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.313751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.313757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:11.313766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.313779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:11.313800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.313972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.313980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.313993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.314060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2171 partition: 0 MaxSeqNo: 45 sessionId: src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0
2025-10-01T14:14:11.314420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c966a8e-ac81db2d-64f8b4a1-b085da29_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:11.317060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0] Write session: try to update token
2025-10-01T14:14:11.317079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:11.332386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2171 sessionId: src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:11.333264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:11.333288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:11.333291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:11.333293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:11.333301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256443680735474:11539]
2025-10-01T14:14:11.333307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256443680735474:11539]
2025-10-01T14:14:11.333311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256443680735474:11539]
2025-10-01T14:14:11.333354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:11.333360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:11.333365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:11.333366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.333368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:11.333369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:11.333506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:11.334831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:11.387955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256446057637038:11539]
2025-10-01T14:14:11.388213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2170, pipe: [1:7556256446057637038:11539]
2025-10-01T14:14:11.472377Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:11.472589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.472600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.472630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637038:11539], now have 1 active actors on pipe
2025-10-01T14:14:11.472749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:11.472837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:11.472921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2171 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0
2025-10-01T14:14:11.473120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2171 sessionId: src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0 is DEAD
2025-10-01T14:14:11.473224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256446057637038:11539]
2025-10-01T14:14:11.473241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:11.473263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:11.473272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0] Write session will restart in 0.009741s
2025-10-01T14:14:11.473290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0] Write session: Do CDS request
2025-10-01T14:14:11.473295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:11.483952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.483996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:11.484010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2172
2025-10-01T14:14:11.484196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.484220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:11.484225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:11.484228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:11.484496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2172 sessionId:  describe result for acl check
2025-10-01T14:14:11.484517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:11.484518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:11.484519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:11.484522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256446057637174:11959] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:11.484890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256446057637174:11959] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:11.486865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256446057637174:11959] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:11.488731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:11.488785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256446057637174:11959] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:11.488796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256446057637174:11959] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:11.488797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256446057637174:11959] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:11.488802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:11.490988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:11.491163Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:11.491174Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:11.491186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:11.491231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:11.491271Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256443680735747:11542]
2025-10-01T14:14:11.491835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:11.492068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:11.492105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:11.492384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:11.492436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.492442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.492443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.492444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.492445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.492446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.492448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.492449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.492450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.492451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.492452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.492453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.492454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.492455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.492460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.492470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.492474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.492478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.492482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.492486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.492490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.492494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.492498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.492502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.492506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.492510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.492513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.492517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.492523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.492531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.492537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.492547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.492553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.492562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.492566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.492572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.492590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.492596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.492605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.492610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.492619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.492625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.492633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.492638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.492644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.492653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.492657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.492663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.492672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.492677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.492685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.492689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.492698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.492703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.492712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.492717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.492756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:11.496060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:11.496950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:11.496962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:11.496963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:11.496966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:11.496970Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2171 [2:7556256443680735747:11542]
2025-10-01T14:14:11.496981Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:11.496992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:11.496995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.496996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.496998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.497008Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:11.497011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:11.497015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:11.497050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.497056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.497057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.497059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:11.497060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:11.497106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:11.497111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.497118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.497123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.497132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:11.497144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637045:2446], now have 1 active actors on pipe
2025-10-01T14:14:11.497150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637304:11959], now have 1 active actors on pipe
2025-10-01T14:14:11.497155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256443680735741:11542]
2025-10-01T14:14:11.497156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256443680735741:11542]
2025-10-01T14:14:11.497157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256443680735741:11542]
2025-10-01T14:14:11.497165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:11.497175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:11.497178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:11.497178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:11.497179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:11.497186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:11.497188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:11.497203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256443680735741:11542]
2025-10-01T14:14:11.497212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:11.497226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:11.497215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2171
2025-10-01T14:14:11.497260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2171
2025-10-01T14:14:11.497292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.497299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.497316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|702b21ee-b8241e70-ba223d0c-e115b594_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:11.497324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.497327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.497328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:11.497333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.497340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:11.497349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.497516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.497528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.497550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.497635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2172 partition: 0 MaxSeqNo: 45 sessionId: src_id|702b21ee-b8241e70-ba223d0c-e115b594_0
2025-10-01T14:14:11.497988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0fe7deb-18d2eeb7-ab8ef2f8-33279625_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|702b21ee-b8241e70-ba223d0c-e115b594_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:11.500683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|702b21ee-b8241e70-ba223d0c-e115b594_0] Write session: try to update token
2025-10-01T14:14:11.500702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|702b21ee-b8241e70-ba223d0c-e115b594_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:11.507121Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:11.507138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:11.507144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256443680735741:11542]
2025-10-01T14:14:11.507175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:11.507184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:11.507333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:11.507463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:11.507588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:11.507706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:11.508093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:11.508125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:11.515328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2172 sessionId: src_id|702b21ee-b8241e70-ba223d0c-e115b594_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:11.517763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:11.517936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.517958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.517987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:11.518073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:11.524779Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:11.524801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:11.524804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:11.524806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:11.524817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256443680735741:11542]
2025-10-01T14:14:11.524820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256443680735741:11542]
2025-10-01T14:14:11.524823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256443680735741:11542]
2025-10-01T14:14:11.524865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:11.524867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:11.524871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.524873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:11.524873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:11.524876Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:11.524990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:11.573270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256446057637334:11539]
2025-10-01T14:14:11.573488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2171, pipe: [1:7556256446057637334:11539]
2025-10-01T14:14:11.663371Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:11.670516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.670546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.670707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.670768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.670828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.670891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.670936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.670945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.671008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.671066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.671125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.671177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.671221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.671228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.671293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.671350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.671407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.671470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.671512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.671518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.671587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.671655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.671743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.671836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.671906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.671918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.672013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.672110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.672210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.672306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.672373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.672382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.672540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.672641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.672736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.672835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.672901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.672910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.673005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.673095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.673186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.673282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.673349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.673357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.673449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.673538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.673630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.673722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.673783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.673792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.673888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.673981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.674075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.674163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.674223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.674232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.674318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.674418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.674512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.674610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.674678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.674687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.674764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637334:11539], now have 1 active actors on pipe
2025-10-01T14:14:11.674964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256446057637334:11539]
2025-10-01T14:14:11.674968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:11.674972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:11.674988Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:11.674995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2172 reason: error at write: Disconnected sessionId: src_id|702b21ee-b8241e70-ba223d0c-e115b594_0
2025-10-01T14:14:11.675215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2172 sessionId: src_id|702b21ee-b8241e70-ba223d0c-e115b594_0 is DEAD
2025-10-01T14:14:11.675373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702b21ee-b8241e70-ba223d0c-e115b594_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:11.675385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702b21ee-b8241e70-ba223d0c-e115b594_0] Write session will restart in 0.009817s
2025-10-01T14:14:11.675411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702b21ee-b8241e70-ba223d0c-e115b594_0] Write session: Do CDS request
2025-10-01T14:14:11.675417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702b21ee-b8241e70-ba223d0c-e115b594_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:11.675910Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:11.686875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|702b21ee-b8241e70-ba223d0c-e115b594_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.686947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:11.686961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2173
2025-10-01T14:14:11.687098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.687123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:11.687130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:11.687134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:11.687522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2173 sessionId:  describe result for acl check
2025-10-01T14:14:11.687551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:11.687557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:11.687558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:11.687564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256446057637477:11965] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:11.687938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256446057637477:11965] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:11.690092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256446057637477:11965] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:11.691196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:11.693306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:11.693429Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:11.693437Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:11.693445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:11.693472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:11.693500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256443680736012:11546]
2025-10-01T14:14:11.693628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256446057637477:11965] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:11.693640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256446057637477:11965] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:11.693643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256446057637477:11965] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:11.693650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:11.693873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:11.694094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:11.694118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:11.694310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:11.694343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.694347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.694348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.694349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.694349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.694350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.694351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.694352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.694352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.694353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.694353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.694354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.694355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.694355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.694358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.694363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.694366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.694385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.694388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.694391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.694394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.694398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.694400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.694404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.694407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.694411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.694413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.694415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.694421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.694426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.694429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.694433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.694435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.694438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.694440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.694443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.694445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.694448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.694450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.694452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.694455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.694458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.694460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.694463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.694466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.694468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.694470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.694473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.694477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.694479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.694481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.694484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.694486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.694488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.694490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.694492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.694511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:11.697863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:11.698618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:11.698630Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:11.698631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:11.698633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:11.698638Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2172 [2:7556256443680736012:11546]
2025-10-01T14:14:11.698651Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:11.698663Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:11.698669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.698671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.698672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.698685Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:11.698691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:11.698701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:11.698744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.698751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.698752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.698754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:11.698756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:11.698804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:11.698810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.698817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.698822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.698831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:11.698845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256443680736007:11546]
2025-10-01T14:14:11.698850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256443680736007:11546]
2025-10-01T14:14:11.698851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256443680736007:11546]
2025-10-01T14:14:11.698858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:11.698867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:11.698870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:11.698877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:11.698878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:11.698879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:11.698880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:11.698887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637590:11965], now have 1 active actors on pipe
2025-10-01T14:14:11.698890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637337:2446], now have 1 active actors on pipe
2025-10-01T14:14:11.698912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256443680736007:11546]
2025-10-01T14:14:11.698920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:11.698936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:11.698972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2172
2025-10-01T14:14:11.698972Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2172
2025-10-01T14:14:11.699037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.699044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.699063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21f3f61a-20252649-63220922-354f114e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:11.699070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.699073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.699074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:11.699081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.699086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:11.699099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.699225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.699231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.699239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.699317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2173 partition: 0 MaxSeqNo: 45 sessionId: src_id|21f3f61a-20252649-63220922-354f114e_0
2025-10-01T14:14:11.699687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|702b21ee-b8241e70-ba223d0c-e115b594_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|21f3f61a-20252649-63220922-354f114e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:11.702202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21f3f61a-20252649-63220922-354f114e_0] Write session: try to update token
2025-10-01T14:14:11.702216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21f3f61a-20252649-63220922-354f114e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:11.709273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:11.709292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:11.709300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256443680736007:11546]
2025-10-01T14:14:11.709335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:11.709340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:11.709481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:11.709601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:11.709721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:11.709840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:11.710001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:11.710030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:11.716514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2173 sessionId: src_id|21f3f61a-20252649-63220922-354f114e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:11.718924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:11.719121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.719139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.719170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:11.719253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:11.727123Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:11.727141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:11.727143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:11.727144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:11.727152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256443680736007:11546]
2025-10-01T14:14:11.727155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256443680736007:11546]
2025-10-01T14:14:11.727157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256443680736007:11546]
2025-10-01T14:14:11.727189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:11.727190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:11.727193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:11.727195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.727195Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:11.727197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:11.727308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:11.775017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256446057637613:11539]
2025-10-01T14:14:11.775272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2172, pipe: [1:7556256446057637613:11539]
2025-10-01T14:14:11.863346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:11.870326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.870351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.870500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.870550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.870603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.870648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.870968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.870978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.871034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.871083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.871135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.871185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.871224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.871230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.871287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.871350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.871402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.871453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.871491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.871497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.871554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.871604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.871662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.871715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.871759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.871764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.871825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.871877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.871926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.871981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.872018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.872024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.872080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.872132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.872185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.872240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.872279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.872285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.872347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.872397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.872451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.872502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.872540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.872545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.872618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.872670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.872724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.872776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.872819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.872826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.872888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.872940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.872993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.873046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.873083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.873088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.873141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:11.873191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:11.873243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:11.873292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:11.873329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:11.873335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:11.873382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637613:11539], now have 1 active actors on pipe
2025-10-01T14:14:11.873601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:11.873658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256446057637613:11539]
2025-10-01T14:14:11.873867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:11.873876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:11.873902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2173 reason: error at write: Disconnected sessionId: src_id|21f3f61a-20252649-63220922-354f114e_0
2025-10-01T14:14:11.874091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2173 sessionId: src_id|21f3f61a-20252649-63220922-354f114e_0 is DEAD
2025-10-01T14:14:11.874172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f3f61a-20252649-63220922-354f114e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:11.874155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:11.874181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f3f61a-20252649-63220922-354f114e_0] Write session will restart in 0.009098s
2025-10-01T14:14:11.874208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f3f61a-20252649-63220922-354f114e_0] Write session: Do CDS request
2025-10-01T14:14:11.874213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f3f61a-20252649-63220922-354f114e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:11.884937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21f3f61a-20252649-63220922-354f114e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.885081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:11.885094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2174
2025-10-01T14:14:11.885219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:11.885255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:11.885264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:11.885267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:11.885576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2174 sessionId:  describe result for acl check
2025-10-01T14:14:11.885607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:11.885609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:11.885611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:11.885616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256446057637719:11970] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:11.886011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256446057637719:11970] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:11.888904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256446057637719:11970] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:11.892784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:11.892866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256446057637719:11970] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:11.892882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256446057637719:11970] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:11.892886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256446057637719:11970] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:11.892895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:11.896073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:11.896300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:11.896313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:11.896324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:11.896375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:11.896420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256443680736301:11559]
2025-10-01T14:14:11.896966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:11.897269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:11.897312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:11.897581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:11.897636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.897642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.897643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.897644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.897646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.897647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.897648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.897649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.897650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.897651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.897653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.897654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.897655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.897656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.897662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.897672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.897676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.897695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.897698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.897702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.897706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.897710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.897714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.897718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.897726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.897729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.897733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.897740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.897748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.897759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:11.897768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.897778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:11.897786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.897793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:11.897799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.897805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:11.897809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.897814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:11.897819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.897826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:11.897831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.897837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:11.897843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.897848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:11.897856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.897861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:11.897871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.897879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.897887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.897892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.897899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.897904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.897914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.897922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:11.897931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.897936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:11.897989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:11.901632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:11.902212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:11.902225Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:11.902227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:11.902230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:11.902237Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2173 [2:7556256443680736301:11559]
2025-10-01T14:14:11.902253Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:11.902268Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:11.902274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.902278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.902281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.902296Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:11.902305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:11.902311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:11.902356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.902362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.902366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.902432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:11.902440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:11.902617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:11.902626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.902638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:11.902649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:11.902667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:11.902687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637868:11970], now have 1 active actors on pipe
2025-10-01T14:14:11.902695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637616:2446], now have 1 active actors on pipe
2025-10-01T14:14:11.902703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256443680736295:11559]
2025-10-01T14:14:11.902710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256443680736295:11559]
2025-10-01T14:14:11.902712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256443680736295:11559]
2025-10-01T14:14:11.902730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:11.902749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:11.902751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:11.902755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:11.902756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:11.902768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:11.902771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:11.902804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256443680736295:11559]
2025-10-01T14:14:11.902813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:11.902828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:11.902840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2173
2025-10-01T14:14:11.902842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2173
2025-10-01T14:14:11.903033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.903044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.903068Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34d20884-3ed8d356-5bd2b998-eed31427_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:11.903076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:11.903079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:11.903081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:11.903087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:11.903100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:11.903114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.903246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.903258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.903279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:11.903373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2174 partition: 0 MaxSeqNo: 45 sessionId: src_id|34d20884-3ed8d356-5bd2b998-eed31427_0
2025-10-01T14:14:11.903717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21f3f61a-20252649-63220922-354f114e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|34d20884-3ed8d356-5bd2b998-eed31427_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:11.906771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34d20884-3ed8d356-5bd2b998-eed31427_0] Write session: try to update token
2025-10-01T14:14:11.906790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34d20884-3ed8d356-5bd2b998-eed31427_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:11.913941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:11.913958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:11.913965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256443680736295:11559]
2025-10-01T14:14:11.914000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:11.914002Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:11.914154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:11.914288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:11.914438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:11.914610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:11.914843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:11.914891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:11.920979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2174 sessionId: src_id|34d20884-3ed8d356-5bd2b998-eed31427_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:11.923477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:11.923675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:11.923697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:11.923731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:11.923804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:11.932521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:11.932542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:11.932544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:11.932546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:11.932555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256443680736295:11559]
2025-10-01T14:14:11.932558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256443680736295:11559]
2025-10-01T14:14:11.932560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256443680736295:11559]
2025-10-01T14:14:11.932607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:11.932606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:11.932611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:11.932613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:11.932614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:11.932617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:11.932725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:11.973659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256446057637885:11539]
2025-10-01T14:14:11.973916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2173, pipe: [1:7556256446057637885:11539]
2025-10-01T14:14:12.066798Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:12.073881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.073910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.074061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.074112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.074166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.074223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.074270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.074277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.074334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.074407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.074459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.074519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.074565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.074571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.074633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.074688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.074748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.074807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.074853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.074859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.074923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.074987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.075052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.075113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.075159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.075164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.075224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.075280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.075351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.075418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.075457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.075464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.075527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.075585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.075646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.075706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.075748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.075753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.075822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.075890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.075953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.076010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.076056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.076064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.076131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.076185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.076240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.076295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.076340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.076347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.076423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.076480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.076536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.076608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.076647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.076656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.076712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.076764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.076818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.076883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.076930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.076937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.076982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256446057637885:11539], now have 1 active actors on pipe
2025-10-01T14:14:12.077264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:12.077277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:12.077296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256446057637885:11539]
2025-10-01T14:14:12.077305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2174 reason: error at write: Disconnected sessionId: src_id|34d20884-3ed8d356-5bd2b998-eed31427_0
2025-10-01T14:14:12.077326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:12.077498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2174 sessionId: src_id|34d20884-3ed8d356-5bd2b998-eed31427_0 is DEAD
2025-10-01T14:14:12.077627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d20884-3ed8d356-5bd2b998-eed31427_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:12.077635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d20884-3ed8d356-5bd2b998-eed31427_0] Write session will restart in 0.007132s
2025-10-01T14:14:12.077660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d20884-3ed8d356-5bd2b998-eed31427_0] Write session: Do CDS request
2025-10-01T14:14:12.077666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d20884-3ed8d356-5bd2b998-eed31427_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:12.078029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:12.085875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34d20884-3ed8d356-5bd2b998-eed31427_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.086022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:12.086035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2175
2025-10-01T14:14:12.086122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.086151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:12.086158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:12.086162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:12.086598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2175 sessionId:  describe result for acl check
2025-10-01T14:14:12.086635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:12.086640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:12.086641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:12.086647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256450352605215:11975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:12.087148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256450352605215:11975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:12.090143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256450352605215:11975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:12.093322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256450352605215:11975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:12.093334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256450352605215:11975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:12.093336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256450352605215:11975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:12.093342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:12.096015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:12.098967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:12.099187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:12.099197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:12.099209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:12.099258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:12.099296Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256447975703855:11561]
2025-10-01T14:14:12.099975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:12.100237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:12.100284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:12.100574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:12.100654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.100661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.100662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.100663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.100664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.100665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.100666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.100667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.100668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.100669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.100670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.100671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.100672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.100673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.100679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.100689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.100693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.100696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.100700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.100703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.100707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.100710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.100713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.100717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.100720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.100723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.100727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.100730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.100737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.100744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.100750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.100755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.100759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.100764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.100768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.100773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.100777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.100782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.100786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.100791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.100802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.100806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.100810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.100814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.100818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.100823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.100832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.100837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.100846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.100856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.100864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.100868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.100876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.100881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.100889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.100893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.100933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:12.104478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:12.105095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:12.105111Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:12.105114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:12.105117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:12.105124Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2174 [2:7556256447975703855:11561]
2025-10-01T14:14:12.105139Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:12.105158Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:12.105166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.105170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.105175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.105189Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:12.105199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:12.105208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:12.105259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.105266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.105268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.105271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:12.105273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:12.105334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:12.105342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.105352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.105364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.105383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:12.105403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352605183:2446], now have 1 active actors on pipe
2025-10-01T14:14:12.105413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352605394:11975], now have 1 active actors on pipe
2025-10-01T14:14:12.105419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256447975703850:11561]
2025-10-01T14:14:12.105421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256447975703850:11561]
2025-10-01T14:14:12.105423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256447975703850:11561]
2025-10-01T14:14:12.105436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:12.105449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:12.105459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:12.105467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:12.105468Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:12.105470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:12.105448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2174
2025-10-01T14:14:12.105470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:12.105449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2174
2025-10-01T14:14:12.105491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256447975703850:11561]
2025-10-01T14:14:12.105494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:12.105496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:12.105513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.105517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.105557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:12.105569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.105572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.105574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:12.105582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.105591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:12.105610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.105725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.105733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.105746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.105815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2175 partition: 0 MaxSeqNo: 45 sessionId: src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0
2025-10-01T14:14:12.106144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34d20884-3ed8d356-5bd2b998-eed31427_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:12.108747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0] Write session: try to update token
2025-10-01T14:14:12.108761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:12.120621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2175 sessionId: src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:12.122846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:12.123026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.123048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.123086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:12.123143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:12.125187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:12.125205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:12.125208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:12.125210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:12.125219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256447975703850:11561]
2025-10-01T14:14:12.125221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256447975703850:11561]
2025-10-01T14:14:12.125226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256447975703850:11561]
2025-10-01T14:14:12.125269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:12.125272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:12.125275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.125276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:12.125277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:12.125279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:12.125395Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:12.177456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256450352605453:11539]
2025-10-01T14:14:12.177691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2174, pipe: [1:7556256450352605453:11539]
2025-10-01T14:14:12.262747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:12.272072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.272102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.272274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.272332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.272396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.272460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.272501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.272507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.272596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.272660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.272721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.272782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.272828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.272831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.272893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.272951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.273010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.273070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.273108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.273113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.273177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.273236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.273291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.273346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.273386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.273388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.273451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.273507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.273562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.273623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.273665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.273667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.273752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.273825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.273898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.273969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.274018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.274020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.274098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.274174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.274248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.274318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.274573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.274589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.274668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.274746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.274834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.274915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.275034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.275046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.275134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.275207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.275365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.275443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.275496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.275504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.275586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.275668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.275746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.275823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.275878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.275886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.275949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352605453:11539], now have 1 active actors on pipe
2025-10-01T14:14:12.276190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256450352605453:11539]
2025-10-01T14:14:12.276216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:12.276216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:12.276220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:12.276249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2175 reason: error at write: Disconnected sessionId: src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0
2025-10-01T14:14:12.276446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2175 sessionId: src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0 is DEAD
2025-10-01T14:14:12.276564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:12.276572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0] Write session will restart in 0.007741s
2025-10-01T14:14:12.276603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0] Write session: Do CDS request
2025-10-01T14:14:12.276609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:12.277176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:12.285843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.285907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:12.285924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2176
2025-10-01T14:14:12.286102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.286138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:12.286149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:12.286152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:12.286575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2176 sessionId:  describe result for acl check
2025-10-01T14:14:12.286601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:12.286605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:12.286606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:12.286610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256450352605495:11981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:12.287049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256450352605495:11981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:12.289781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256450352605495:11981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:12.292818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256450352605495:11981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:12.292832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256450352605495:11981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:12.292836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256450352605495:11981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:12.292844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:12.295331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:12.297523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:12.297724Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:12.297739Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:12.297751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:12.297810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:12.297851Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256447975704116:11564]
2025-10-01T14:14:12.298425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:12.298796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:12.298853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:12.299156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:12.299221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.299227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.299229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.299230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.299231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.299232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.299233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.299235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.299236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.299237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.299238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.299239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.299240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.299242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.299248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.299257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.299260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.299264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.299268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.299271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.299275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.299278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.299282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.299286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.299289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.299293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.299297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.299300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.299308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.299315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.299321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.299326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.299331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.299336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.299340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.299349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.299353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.299358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.299362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.299370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.299374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.299378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.299382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.299390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.299394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.299399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.299406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.299410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.299413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.299418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.299421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.299430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.299434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.299438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.299441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.299449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.299484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:12.303361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:12.303949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:12.303962Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:12.303965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:12.303967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:12.303973Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2175 [2:7556256447975704116:11564]
2025-10-01T14:14:12.303984Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:12.303999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:12.304000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.304003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.304004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.304017Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:12.304026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:12.304031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:12.304074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.304080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.304082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.304084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:12.304086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:12.304133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:12.304139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.304146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.304152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.304165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:12.304181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256447975704111:11564]
2025-10-01T14:14:12.304188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256447975704111:11564]
2025-10-01T14:14:12.304189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256447975704111:11564]
2025-10-01T14:14:12.304199Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:12.304206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:12.304209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:12.304212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:12.304219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352605455:2446], now have 1 active actors on pipe
2025-10-01T14:14:12.304225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:12.304242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:12.304248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:12.304255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352605681:11981], now have 1 active actors on pipe
2025-10-01T14:14:12.304293Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2175
2025-10-01T14:14:12.304289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256447975704111:11564]
2025-10-01T14:14:12.304304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2175
2025-10-01T14:14:12.304301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:12.304314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:12.304337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.304340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.304360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:12.304365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.304368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.304370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:12.304376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.304382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:12.304397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.304509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.304514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.304524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.304598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2176 partition: 0 MaxSeqNo: 45 sessionId: src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0
2025-10-01T14:14:12.304922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aef0f75b-c51a2eb8-625bcdc3-dad5a7a8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:12.307929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0] Write session: try to update token
2025-10-01T14:14:12.307947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:12.314626Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:12.314648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:12.314659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256447975704111:11564]
2025-10-01T14:14:12.314707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:12.314814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:12.314905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:12.315065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:12.315220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:12.315361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:12.315550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:12.315595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:12.322042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2176 sessionId: src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:12.324473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:12.324958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.324978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.325008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:12.325099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:12.333180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:12.333203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:12.333206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:12.333208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:12.333219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256447975704111:11564]
2025-10-01T14:14:12.333224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256447975704111:11564]
2025-10-01T14:14:12.333228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256447975704111:11564]
2025-10-01T14:14:12.333271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:12.333273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:12.333279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.333281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:12.333284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:12.333292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:12.333405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:12.376608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256450352605723:11539]
2025-10-01T14:14:12.376818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2175, pipe: [1:7556256450352605723:11539]
2025-10-01T14:14:12.469760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:12.476342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.476368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.476498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.476548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.476609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.476659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.476699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.476709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.476767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.476815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.476863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.476913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.476951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.476956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.477015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.477068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.477121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.477178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.477218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.477223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.477278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.477331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.477386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.477441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.477479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.477484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.477539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.477590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.477646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.477698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.477735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.477740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.477796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.477848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.477902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.477954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.477992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.477997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.478052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.478103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.478169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.478231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.478269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.478275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.478330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.478415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.478479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.478535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.478575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.478583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.478640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.478697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.478759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.478821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.478867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.478875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.478939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.479002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.479066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.479130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.479181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.479189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.479243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352605723:11539], now have 1 active actors on pipe
2025-10-01T14:14:12.479459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:12.479502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256450352605723:11539]
2025-10-01T14:14:12.479513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:12.479516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:12.479554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2176 reason: error at write: Disconnected sessionId: src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0
2025-10-01T14:14:12.479745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2176 sessionId: src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0 is DEAD
2025-10-01T14:14:12.479842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:12.479851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0] Write session will restart in 0.008524s
2025-10-01T14:14:12.479874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0] Write session: Do CDS request
2025-10-01T14:14:12.479879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:12.480210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:12.489835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.489894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:12.489906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2177
2025-10-01T14:14:12.490029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.490051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:12.490058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:12.490061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:12.490455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2177 sessionId:  describe result for acl check
2025-10-01T14:14:12.490489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:12.490503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:12.490511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:12.490516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256450352605821:11985] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:12.491006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256450352605821:11985] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:12.493815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256450352605821:11985] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:12.496135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:12.498572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:12.498748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256450352605821:11985] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:12.498762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256450352605821:11985] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:12.498765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256450352605821:11985] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:12.498769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:12.498773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:12.498781Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:12.498792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:12.498840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:12.498878Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256447975704387:11567]
2025-10-01T14:14:12.499447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:12.499678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:12.499716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:12.499927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:12.499975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.499981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.499982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.499983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.499984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.499985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.499986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.499987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.499988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.499989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.499991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.499992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.499993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.499994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.499998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.500007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.500010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.500014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.500017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.500020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.500024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.500027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.500030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.500034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.500038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.500041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.500044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.500048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.500054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.500060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.500066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.500071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.500075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.500081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.500084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.500089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.500094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.500099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.500103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.500108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.500112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.500116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.500125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.500130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.500134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.500143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.500147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.500156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.500160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.500169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.500173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.500181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.500185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.500193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.500198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.500206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.500243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:12.503756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:12.504376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:12.504392Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:12.504394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:12.504397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:12.504404Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2176 [2:7556256447975704387:11567]
2025-10-01T14:14:12.504422Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:12.504441Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:12.504448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.504453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.504459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.504474Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:12.504484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:12.504493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:12.504545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.504552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.504554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.504557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:12.504559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:12.504630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:12.504641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.504651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.504661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.504675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:12.504697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352605728:2446], now have 1 active actors on pipe
2025-10-01T14:14:12.504701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352605985:11985], now have 1 active actors on pipe
2025-10-01T14:14:12.504708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256447975704382:11567]
2025-10-01T14:14:12.504710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256447975704382:11567]
2025-10-01T14:14:12.504712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256447975704382:11567]
2025-10-01T14:14:12.504723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:12.504734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:12.504740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:12.504741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:12.504743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:12.504752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:12.504756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:12.504755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2176
2025-10-01T14:14:12.504779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256447975704382:11567]
2025-10-01T14:14:12.504787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:12.504788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:12.504795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2176
2025-10-01T14:14:12.504821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.504829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.504859Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:12.504869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.504874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.504876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:12.504883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.504899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:12.504911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.505035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.505044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.505058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.505127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2177 partition: 0 MaxSeqNo: 45 sessionId: src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0
2025-10-01T14:14:12.505452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83fc04c2-8454946b-7bf64805-a19fa63f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:12.508230Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0] Write session: try to update token
2025-10-01T14:14:12.508246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:12.520968Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2177 sessionId: src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:12.523210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:12.523950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.523976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.523996Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:12.523999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:12.524001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:12.524003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:12.524011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256447975704382:11567]
2025-10-01T14:14:12.524015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256447975704382:11567]
2025-10-01T14:14:12.524018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256447975704382:11567]
2025-10-01T14:14:12.524049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:12.524060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:12.524062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:12.524071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:12.524081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.524088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:12.524208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:12.579856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256450352606026:11539]
2025-10-01T14:14:12.580123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2176, pipe: [1:7556256450352606026:11539]
2025-10-01T14:14:12.664295Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:12.664650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:12.664700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352606026:11539], now have 1 active actors on pipe
2025-10-01T14:14:12.664753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:12.664886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256450352606026:11539]
2025-10-01T14:14:12.664907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:12.672871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:12.672882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:12.672899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2177 reason: error at write: Disconnected sessionId: src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0
2025-10-01T14:14:12.673010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2177 sessionId: src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0 is DEAD
2025-10-01T14:14:12.673152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:12.673162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0] Write session will restart in 0.005006s
2025-10-01T14:14:12.673188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0] Write session: Do CDS request
2025-10-01T14:14:12.673196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:12.678773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.678877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:12.678887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2178
2025-10-01T14:14:12.678967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.678991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:12.678995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:12.678999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:12.679339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2178 sessionId:  describe result for acl check
2025-10-01T14:14:12.679365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:12.679370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:12.679372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:12.679375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256450352606180:11997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:12.679757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256450352606180:11997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:12.681563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256450352606180:11997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:12.682406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:12.684643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:12.684788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:12.684796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:12.684806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:12.684848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:12.684892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256447975704655:11571]
2025-10-01T14:14:12.684916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256450352606180:11997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:12.684927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256450352606180:11997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:12.684929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256450352606180:11997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:12.684934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:12.685443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:12.685655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:12.685681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:12.685861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:12.685896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.685900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.685901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.685901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.685902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.685903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.685903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.685904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.685904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.685905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.685906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.685906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.685907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.685908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.685911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.685917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.685919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.685921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.685923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.685925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.685927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.685929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.685931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.685934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.685935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.685937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.685940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.685942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.685946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.685950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.685954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.685957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.685959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.685962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.685964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.685966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.685969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.685971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.685974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.685976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.685980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.685982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.685988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.685991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.685993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.685996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.686001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.686004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.686007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.686012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.686014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.686017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.686019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.686021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.686026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.686029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.686047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:12.689404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:12.689975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:12.689986Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:12.689987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:12.689989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:12.689994Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2177 [2:7556256447975704655:11571]
2025-10-01T14:14:12.690007Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:12.690022Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:12.690027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.690029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.690030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.690040Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:12.690047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:12.690050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:12.690084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.690088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.690089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.690091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:12.690093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:12.690140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:12.690145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.690151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.690156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.690167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:12.690182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352606287:11997], now have 1 active actors on pipe
2025-10-01T14:14:12.690188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352606029:2446], now have 1 active actors on pipe
2025-10-01T14:14:12.690193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256447975704650:11571]
2025-10-01T14:14:12.690198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256447975704650:11571]
2025-10-01T14:14:12.690200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256447975704650:11571]
2025-10-01T14:14:12.690211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:12.690222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:12.690233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:12.690237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:12.690224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2177
2025-10-01T14:14:12.690244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:12.690253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256447975704650:11571]
2025-10-01T14:14:12.690254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:12.690257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:12.690259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:12.690274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:12.690226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2177
2025-10-01T14:14:12.690283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.690289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.690305Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50984807-b45c3590-19f90951-836919fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:12.690313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.690320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.690322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:12.690331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.690339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:12.690350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.690488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.690493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.690502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.690592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2178 partition: 0 MaxSeqNo: 45 sessionId: src_id|50984807-b45c3590-19f90951-836919fa_0
2025-10-01T14:14:12.690964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb1b148e-564d2920-48b3619-1bfc6be7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50984807-b45c3590-19f90951-836919fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:12.693983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50984807-b45c3590-19f90951-836919fa_0] Write session: try to update token
2025-10-01T14:14:12.694003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50984807-b45c3590-19f90951-836919fa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:12.699987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:12.700005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:12.700014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256447975704650:11571]
2025-10-01T14:14:12.700041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:12.700046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:12.700190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:12.700319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:12.700443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:12.700560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:12.700748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:12.700782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:12.709385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2178 sessionId: src_id|50984807-b45c3590-19f90951-836919fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:12.711787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:12.712155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.712174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.712203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:12.712273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:12.717935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:12.717953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:12.717955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:12.717957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:12.717965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256447975704650:11571]
2025-10-01T14:14:12.717968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256447975704650:11571]
2025-10-01T14:14:12.717970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256447975704650:11571]
2025-10-01T14:14:12.718005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:12.718014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.718016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:12.718039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:12.718057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:12.718061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:12.718134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:12.765219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256450352606310:11539]
2025-10-01T14:14:12.765429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2177, pipe: [1:7556256450352606310:11539]
2025-10-01T14:14:12.853229Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:12.859896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.859922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.860052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.860100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.860152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.860203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.860243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.860250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.860302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.860352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.860404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.860454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.860493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.860498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.860555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.860620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.860677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.860739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.860778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.860784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.860841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.860894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.860946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.860999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.861037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.861043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.861098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.861153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.861208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.861262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.861301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.861307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.861361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.861413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.861471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.861528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.861568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.861573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.861629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.861680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.861734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.861786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.861826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.861831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.861890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.861942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.861999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.862051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.862090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.862096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.862150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.862203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.862258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.862308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.862346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.862352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.862417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:12.862478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:12.862538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:12.862589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:12.862625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:12.862634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:12.862674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352606310:11539], now have 1 active actors on pipe
2025-10-01T14:14:12.862894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:12.862900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:12.862909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:12.862934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256450352606310:11539]
2025-10-01T14:14:12.862938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2178 reason: error at write: Disconnected sessionId: src_id|50984807-b45c3590-19f90951-836919fa_0
2025-10-01T14:14:12.863154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2178 sessionId: src_id|50984807-b45c3590-19f90951-836919fa_0 is DEAD
2025-10-01T14:14:12.863276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50984807-b45c3590-19f90951-836919fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:12.863287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50984807-b45c3590-19f90951-836919fa_0] Write session will restart in 0.009068s
2025-10-01T14:14:12.863326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50984807-b45c3590-19f90951-836919fa_0] Write session: Do CDS request
2025-10-01T14:14:12.863333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50984807-b45c3590-19f90951-836919fa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:12.863527Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:12.873874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50984807-b45c3590-19f90951-836919fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.873933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:12.873944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2179
2025-10-01T14:14:12.874088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:12.874112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:12.874120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:12.874122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:12.874572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2179 sessionId:  describe result for acl check
2025-10-01T14:14:12.874605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:12.874611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:12.874613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:12.874618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256450352606395:12002] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:12.875085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256450352606395:12002] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:12.877657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256450352606395:12002] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:12.880136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256450352606395:12002] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:12.880148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256450352606395:12002] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:12.880151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256450352606395:12002] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:12.880158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:12.880237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:12.883010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:12.883152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:12.883161Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:12.883170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:12.883199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:12.883229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256447975704951:11584]
2025-10-01T14:14:12.883699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:12.883977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:12.884017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:12.884232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:12.884268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.884274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.884275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.884276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.884278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.884279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.884280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.884281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.884282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.884284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.884285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.884285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.884286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.884287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.884290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.884296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.884298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.884301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.884303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.884305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.884306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.884308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.884310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.884312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.884314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.884316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.884318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.884320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.884324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.884329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:12.884333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.884336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:12.884338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.884342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:12.884344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.884347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:12.884349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.884352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:12.884354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.884358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:12.884362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.884365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:12.884367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.884370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:12.884376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.884379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:12.884382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.884385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.884387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.884390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.884392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.884395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.884398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.884400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:12.884403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.884406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:12.884429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:12.887866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:12.888429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:12.888441Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:12.888442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:12.888445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:12.888450Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2178 [2:7556256447975704951:11584]
2025-10-01T14:14:12.888460Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:12.888471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:12.888476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.888478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.888480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.888491Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:12.888495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:12.888500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:12.888550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.888552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.888554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.888557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:12.888560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:12.888619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:12.888621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.888627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:12.888633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:12.888644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:12.888659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256447975704945:11584]
2025-10-01T14:14:12.888662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256447975704945:11584]
2025-10-01T14:14:12.888664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256447975704945:11584]
2025-10-01T14:14:12.888672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:12.888680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:12.888682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:12.888684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:12.888684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:12.888692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:12.888694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:12.888706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352606570:12002], now have 1 active actors on pipe
2025-10-01T14:14:12.888708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352606315:2446], now have 1 active actors on pipe
2025-10-01T14:14:12.888725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256447975704945:11584]
2025-10-01T14:14:12.888731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:12.888763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:12.888801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2178
2025-10-01T14:14:12.888803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2178
2025-10-01T14:14:12.888969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.888979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.888999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:12.889009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:12.889015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:12.889016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:12.889023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:12.889029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:12.889040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.889231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:12.889241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:12.889254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:12.889344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2179 partition: 0 MaxSeqNo: 45 sessionId: src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0
2025-10-01T14:14:12.889658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50984807-b45c3590-19f90951-836919fa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:12.892429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0] Write session: try to update token
2025-10-01T14:14:12.892444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:12.907237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2179 sessionId: src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:12.909074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:12.909100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:12.909102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:12.909104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:12.909114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256447975704945:11584]
2025-10-01T14:14:12.909119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256447975704945:11584]
2025-10-01T14:14:12.909123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256447975704945:11584]
2025-10-01T14:14:12.909172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:12.909174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:12.909182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:12.909186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:12.909200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:12.909203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:12.909344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:12.909952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:12.962856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256450352606584:11539]
2025-10-01T14:14:12.963099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2178, pipe: [1:7556256450352606584:11539]
2025-10-01T14:14:13.055720Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:13.056102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.056115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.056152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256450352606584:11539], now have 1 active actors on pipe
2025-10-01T14:14:13.056306Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:13.056410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256450352606584:11539]
2025-10-01T14:14:13.056439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:13.056486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:13.056699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2179 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0
2025-10-01T14:14:13.056870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2179 sessionId: src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0 is DEAD
2025-10-01T14:14:13.057008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:13.057019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0] Write session will restart in 0.005951s
2025-10-01T14:14:13.057042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0] Write session: Do CDS request
2025-10-01T14:14:13.057048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:13.063814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.063955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:13.063969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2180
2025-10-01T14:14:13.064097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.064146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:13.064158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:13.064162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:13.064552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2180 sessionId:  describe result for acl check
2025-10-01T14:14:13.064595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:13.064602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:13.064603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:13.064607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256454647573907:12007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:13.065036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256454647573907:12007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:13.067582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256454647573907:12007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:13.070287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256454647573907:12007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:13.070298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256454647573907:12007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:13.070301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256454647573907:12007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:13.070308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:13.072837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:13.075030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:13.075215Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:13.075225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:13.075234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:13.075297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:13.075336Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256452270672510:11586]
2025-10-01T14:14:13.075856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:13.076134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:13.076179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:13.076386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:13.076422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.076426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.076427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.076427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.076428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.076429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.076429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.076430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.076431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.076431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.076432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.076432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.076433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.076434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.076438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.076443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.076445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.076448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.076450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.076452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.076454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.076456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.076458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.076460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.076462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.076464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.076466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.076468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.076484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.076488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.076492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.076494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.076497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.076500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.076502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.076504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.076507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.076509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.076511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.076515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.076518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.076520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.076523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.076525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.076528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.076530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.076533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.076535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.076538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.076541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.076543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.076545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.076547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.076550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.076552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.076555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.076585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:13.079918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:13.080538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:13.080553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:13.080555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:13.080559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:13.080565Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2179 [2:7556256452270672510:11586]
2025-10-01T14:14:13.080592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:13.080608Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:13.080615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.080618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.080620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.080636Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:13.080645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:13.080657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:13.080710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.080716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.080719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.080722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:13.080725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:13.080786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:13.080792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.080803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.080828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.080848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:13.080868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647573883:2446], now have 1 active actors on pipe
2025-10-01T14:14:13.080878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574088:12007], now have 1 active actors on pipe
2025-10-01T14:14:13.080884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256452270672505:11586]
2025-10-01T14:14:13.080887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256452270672505:11586]
2025-10-01T14:14:13.080889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256452270672505:11586]
2025-10-01T14:14:13.080901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:13.080913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:13.080918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:13.080921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:13.080923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:13.080931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:13.080934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:13.080884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2179
2025-10-01T14:14:13.080894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2179
2025-10-01T14:14:13.080972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.080981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.080993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256452270672505:11586]
2025-10-01T14:14:13.081003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:13.081011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:13.081035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:13.081046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.081053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.081055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:13.081065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.081080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:13.081101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.081255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.081266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.081284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.081363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2180 partition: 0 MaxSeqNo: 45 sessionId: src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0
2025-10-01T14:14:13.081655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b750599c-b6dbdf6e-2d96d3ff-46722f7d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:13.084212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0] Write session: try to update token
2025-10-01T14:14:13.084226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:13.099485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2180 sessionId: src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:13.100632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:13.100652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:13.100654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:13.100655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:13.100663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256452270672505:11586]
2025-10-01T14:14:13.100666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256452270672505:11586]
2025-10-01T14:14:13.100669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256452270672505:11586]
2025-10-01T14:14:13.100707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:13.100709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:13.100714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.100716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:13.100720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:13.100723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:13.100841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:13.102423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:13.156404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256454647574155:11539]
2025-10-01T14:14:13.156640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2179, pipe: [1:7556256454647574155:11539]
2025-10-01T14:14:13.242842Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:13.243501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.243518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.243556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574155:11539], now have 1 active actors on pipe
2025-10-01T14:14:13.243759Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:13.243761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256454647574155:11539]
2025-10-01T14:14:13.243767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:13.243785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:13.243787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:13.243831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2180 reason: error at write: Disconnected sessionId: src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0
2025-10-01T14:14:13.243979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2180 sessionId: src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0 is DEAD
2025-10-01T14:14:13.244107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:13.244115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0] Write session will restart in 0.008351s
2025-10-01T14:14:13.244136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0] Write session: Do CDS request
2025-10-01T14:14:13.244141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:13.253946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.254067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:13.254084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2181
2025-10-01T14:14:13.254239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.254274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:13.254284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:13.254288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:13.254702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2181 sessionId:  describe result for acl check
2025-10-01T14:14:13.254742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:13.254743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:13.254745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:13.254750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256454647574294:12011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:13.255162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256454647574294:12011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:13.256801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256454647574294:12011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:13.258281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:13.260398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:13.260517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256454647574294:12011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:13.260532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256454647574294:12011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:13.260534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256454647574294:12011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:13.260540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:13.260566Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:13.260575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:13.260593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:13.260637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:13.260661Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256452270672775:11589]
2025-10-01T14:14:13.261058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:13.261256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:13.261285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:13.261482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:13.261521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.261525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.261526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.261527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.261527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.261528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.261529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.261529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.261530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.261531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.261532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.261532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.261533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.261534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.261537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.261543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.261545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.261547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.261549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.261552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.261554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.261556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.261558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.261561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.261563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.261565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.261567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.261569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.261573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.261578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.261581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.261584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.261586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.261589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.261592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.261594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.261597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.261600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.261602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.261605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.261607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.261610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.261612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.261615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.261617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.261620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.261622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.261625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.261632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.261635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.261637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.261640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.261642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.261645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.261647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.261650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.261669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:13.264908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:13.265485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:13.265503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:13.265505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:13.265509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:13.265516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2180 [2:7556256452270672775:11589]
2025-10-01T14:14:13.265528Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:13.265541Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:13.265548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.265550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.265551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.265562Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:13.265564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:13.265568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:13.265602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.265607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.265608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.265611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:13.265613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:13.265658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:13.265663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.265669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.265675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.265683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:13.265698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256452270672770:11589]
2025-10-01T14:14:13.265702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256452270672770:11589]
2025-10-01T14:14:13.265703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256452270672770:11589]
2025-10-01T14:14:13.265709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:13.265718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:13.265719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574418:12011], now have 1 active actors on pipe
2025-10-01T14:14:13.265721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574157:2446], now have 1 active actors on pipe
2025-10-01T14:14:13.265727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:13.265728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:13.265730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:13.265735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:13.265736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:13.265754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256452270672770:11589]
2025-10-01T14:14:13.265765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:13.265772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:13.265792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2180
2025-10-01T14:14:13.265793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2180
2025-10-01T14:14:13.265861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.265869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.265887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:13.265897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.265900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.265901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:13.265908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.265914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:13.265924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.266052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.266060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.266070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.266142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2181 partition: 0 MaxSeqNo: 45 sessionId: src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0
2025-10-01T14:14:13.266489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bf90dc0-454aafd8-7cc73f0f-c497a74d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:13.269242Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0] Write session: try to update token
2025-10-01T14:14:13.269256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:13.284615Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2181 sessionId: src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:13.285230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:13.285251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:13.285253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:13.285255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:13.285263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256452270672770:11589]
2025-10-01T14:14:13.285267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256452270672770:11589]
2025-10-01T14:14:13.285271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256452270672770:11589]
2025-10-01T14:14:13.285304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:13.285316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:13.285318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:13.285318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:13.285324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.285327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:13.285451Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:13.286987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:13.343775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256454647574430:11539]
2025-10-01T14:14:13.343978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2180, pipe: [1:7556256454647574430:11539]
2025-10-01T14:14:13.417132Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:13.417637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.417650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.417683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574430:11539], now have 1 active actors on pipe
2025-10-01T14:14:13.417832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:13.417849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:13.417861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:13.417863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:13.417899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256454647574430:11539]
2025-10-01T14:14:13.417909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2181 reason: error at write: Disconnected sessionId: src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0
2025-10-01T14:14:13.418058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2181 sessionId: src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0 is DEAD
2025-10-01T14:14:13.418211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:13.418223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0] Write session will restart in 0.008660s
2025-10-01T14:14:13.418244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0] Write session: Do CDS request
2025-10-01T14:14:13.418249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:13.427851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.427928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:13.427944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2182
2025-10-01T14:14:13.428095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.428121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:13.428125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:13.428129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:13.428514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2182 sessionId:  describe result for acl check
2025-10-01T14:14:13.428552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:13.428554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:13.428556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:13.428560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256454647574528:12015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:13.428955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256454647574528:12015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:13.431473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256454647574528:12015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:13.433839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256454647574528:12015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:13.433851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256454647574528:12015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:13.433853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256454647574528:12015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:13.433858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:13.434128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:13.436692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:13.436871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:13.436879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:13.436887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:13.436918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:13.436944Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256452270673053:11591]
2025-10-01T14:14:13.437318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:13.437531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:13.437560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:13.437751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:13.437784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.437789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.437789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.437790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.437791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.437791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.437792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.437793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.437794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.437794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.437795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.437795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.437796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.437797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.437800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.437806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.437808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.437810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.437812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.437814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.437816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.437818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.437820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.437823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.437825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.437827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.437829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.437831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.437835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.437840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.437844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.437847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.437849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.437852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.437854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.437857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.437859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.437862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.437864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.437867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.437869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.437872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.437874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.437877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.437884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.437886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.437889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.437892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.437894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.437897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.437899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.437902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.437904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.437907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.437909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.437912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.437931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:13.441329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:13.442302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:13.442316Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:13.442317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:13.442319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:13.442324Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2181 [2:7556256452270673053:11591]
2025-10-01T14:14:13.442336Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:13.442351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:13.442356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.442359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.442360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.442391Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:13.442401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:13.442407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:13.442468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.442475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.442477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.442481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:13.442483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:13.442548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:13.442556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.442568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.442585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.442605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:13.442630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574693:12015], now have 1 active actors on pipe
2025-10-01T14:14:13.442634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574431:2446], now have 1 active actors on pipe
2025-10-01T14:14:13.442641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256452270673048:11591]
2025-10-01T14:14:13.442643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256452270673048:11591]
2025-10-01T14:14:13.442646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256452270673048:11591]
2025-10-01T14:14:13.442659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:13.442677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:13.442656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2181
2025-10-01T14:14:13.442678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:13.442681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:13.442683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:13.442695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:13.442698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:13.442711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2181
2025-10-01T14:14:13.442737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256452270673048:11591]
2025-10-01T14:14:13.442746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:13.442752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:13.442760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.442765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.442811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:13.442826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.442830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.442832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:13.442841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.442853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:13.442880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.443004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.443012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.443024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.443093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2182 partition: 0 MaxSeqNo: 45 sessionId: src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0
2025-10-01T14:14:13.443434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deedcc5-879e8225-5f2ed50b-79e1cdf3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:13.446186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0] Write session: try to update token
2025-10-01T14:14:13.446205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:13.461379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2182 sessionId: src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:13.462079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:13.462100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:13.462102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:13.462103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:13.462110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256452270673048:11591]
2025-10-01T14:14:13.462114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256452270673048:11591]
2025-10-01T14:14:13.462117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256452270673048:11591]
2025-10-01T14:14:13.462154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:13.462158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:13.462160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.462161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:13.462163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:13.462166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:13.462275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:13.463667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:13.517835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256454647574709:11539]
2025-10-01T14:14:13.518018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2181, pipe: [1:7556256454647574709:11539]
2025-10-01T14:14:13.600237Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:13.600483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.600498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.600547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574709:11539], now have 1 active actors on pipe
2025-10-01T14:14:13.600764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256454647574709:11539]
2025-10-01T14:14:13.600786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:13.600786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:13.600788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:13.600710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:13.600836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2182 reason: error at write: Disconnected sessionId: src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0
2025-10-01T14:14:13.600972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2182 sessionId: src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0 is DEAD
2025-10-01T14:14:13.601123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:13.601135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0] Write session will restart in 0.008119s
2025-10-01T14:14:13.601158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0] Write session: Do CDS request
2025-10-01T14:14:13.601163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:13.610770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.610920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:13.610939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2183
2025-10-01T14:14:13.611049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.611072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:13.611079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:13.611082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:13.611412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2183 sessionId:  describe result for acl check
2025-10-01T14:14:13.611438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:13.611442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:13.611443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:13.611447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256454647574832:12027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:13.611896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256454647574832:12027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:13.614576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256454647574832:12027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:13.616510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:13.616781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256454647574832:12027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:13.616797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256454647574832:12027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:13.616801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256454647574832:12027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:13.616807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:13.618806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:13.618963Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:13.618971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:13.618981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:13.619022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:13.619049Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256452270673326:11596]
2025-10-01T14:14:13.619482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:13.619886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:13.619921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:13.620192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:13.620240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.620245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.620246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.620248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.620249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.620250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.620251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.620252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.620253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.620254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.620255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.620256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.620257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.620258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.620263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.620273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.620276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.620280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.620284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.620287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.620290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.620293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.620296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.620299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.620302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.620306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.620309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.620317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.620323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.620333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.620343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.620351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.620360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.620368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.620375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.620384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.620392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.620400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.620404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.620412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.620420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.620428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.620436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.620444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.620453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.620463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.620467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.620471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.620475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.620480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.620484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.620489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.620495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.620503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.620510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.620515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.620554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:13.623944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:13.624631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:13.624643Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:13.624645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:13.624647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:13.624651Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2182 [2:7556256452270673326:11596]
2025-10-01T14:14:13.624661Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:13.624672Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:13.624674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.624676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.624678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.624688Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:13.624691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:13.624696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:13.624727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.624733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.624734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.624736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:13.624738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:13.624781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:13.624786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.624792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.624797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.624806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:13.624817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256452270673320:11596]
2025-10-01T14:14:13.624824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256452270673320:11596]
2025-10-01T14:14:13.624825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256452270673320:11596]
2025-10-01T14:14:13.624834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:13.624841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:13.624848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:13.624853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:13.624854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:13.624857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:13.624858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:13.624865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574999:12027], now have 1 active actors on pipe
2025-10-01T14:14:13.624868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647574740:2446], now have 1 active actors on pipe
2025-10-01T14:14:13.624882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256452270673320:11596]
2025-10-01T14:14:13.624891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:13.624918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:13.624907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2182
2025-10-01T14:14:13.624913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2182
2025-10-01T14:14:13.624961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.624968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.624985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:13.624993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.624996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.624998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:13.625004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.625011Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:13.625020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.625150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.625159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.625172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.625244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2183 partition: 0 MaxSeqNo: 45 sessionId: src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0
2025-10-01T14:14:13.625549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b1e31d8-fe8d6bf6-e979b922-6fd0a5f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:13.628395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0] Write session: try to update token
2025-10-01T14:14:13.628413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:13.643863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2183 sessionId: src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:13.643902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:13.643921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:13.643923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:13.643924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:13.643931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256452270673320:11596]
2025-10-01T14:14:13.643936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256452270673320:11596]
2025-10-01T14:14:13.643938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256452270673320:11596]
2025-10-01T14:14:13.643979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:13.643984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.643989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:13.643996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:13.644010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:13.644012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:13.644111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:13.646359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:13.701149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256454647575012:11539]
2025-10-01T14:14:13.701410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2182, pipe: [1:7556256454647575012:11539]
2025-10-01T14:14:13.776612Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:13.776991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.777003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.777036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647575012:11539], now have 1 active actors on pipe
2025-10-01T14:14:13.777187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:13.777291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256454647575012:11539]
2025-10-01T14:14:13.777321Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:13.777361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:13.777449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2183 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0
2025-10-01T14:14:13.777591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2183 sessionId: src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0 is DEAD
2025-10-01T14:14:13.777741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:13.777751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0] Write session will restart in 0.005533s
2025-10-01T14:14:13.777774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0] Write session: Do CDS request
2025-10-01T14:14:13.777779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:13.784874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.785064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:13.785080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2184
2025-10-01T14:14:13.785271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.785309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:13.785317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:13.785320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:13.785681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2184 sessionId:  describe result for acl check
2025-10-01T14:14:13.785718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:13.785723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:13.785725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:13.785729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256454647575050:12032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:13.786153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256454647575050:12032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:13.788559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256454647575050:12032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:13.791462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256454647575050:12032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:13.791476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256454647575050:12032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:13.791479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256454647575050:12032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:13.791485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:13.793770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:13.795893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:13.796058Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:13.796067Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:13.796074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:13.796105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:13.796134Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256452270673595:11599]
2025-10-01T14:14:13.796513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:13.796718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:13.796753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:13.796945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:13.796988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.796993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.796994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.796995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.796996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.796996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.796997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.796997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.796998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.796999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.796999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.797000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.797000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.797001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.797004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.797010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.797012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.797014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.797016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.797018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.797020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.797021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.797024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.797026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.797028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.797030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.797032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.797034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.797038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.797043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.797046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.797049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.797052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.797054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.797057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.797060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.797062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.797064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.797066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.797069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.797072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.797075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.797077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.797080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.797082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.797084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.797087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.797090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.797092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.797095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.797101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.797104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.797106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.797108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.797113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.797116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.797134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:13.800250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:13.800973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:13.800986Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:13.800987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:13.800989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:13.800994Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2183 [2:7556256452270673595:11599]
2025-10-01T14:14:13.801001Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:13.801012Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:13.801017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.801019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.801020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.801030Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:13.801036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:13.801040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:13.801085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.801090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.801091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.801093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:13.801095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:13.801149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:13.801157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.801167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.801176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.801195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:13.801213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647575026:2446], now have 1 active actors on pipe
2025-10-01T14:14:13.801221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647575235:12032], now have 1 active actors on pipe
2025-10-01T14:14:13.801227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256452270673590:11599]
2025-10-01T14:14:13.801230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256452270673590:11599]
2025-10-01T14:14:13.801219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2183
2025-10-01T14:14:13.801231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256452270673590:11599]
2025-10-01T14:14:13.801240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:13.801251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:13.801252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:13.801253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:13.801255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:13.801264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:13.801266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:13.801256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2183
2025-10-01T14:14:13.801289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256452270673590:11599]
2025-10-01T14:14:13.801296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:13.801297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:13.801309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.801317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.801350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:13.801361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.801364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.801367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:13.801376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.801388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:13.801401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.801522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.801530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.801543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.801611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2184 partition: 0 MaxSeqNo: 45 sessionId: src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0
2025-10-01T14:14:13.801971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b8e235b-f8fa5681-6f4e174-a46d66ef_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:13.804601Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0] Write session: try to update token
2025-10-01T14:14:13.804618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:13.819013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2184 sessionId: src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:13.819971Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:13.819994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:13.819996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:13.819997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:13.820004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256452270673590:11599]
2025-10-01T14:14:13.820007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256452270673590:11599]
2025-10-01T14:14:13.820011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256452270673590:11599]
2025-10-01T14:14:13.820049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:13.820057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.820059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:13.820179Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:13.820200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:13.820206Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:13.820209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:13.821089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:13.877275Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256454647575302:11539]
2025-10-01T14:14:13.877527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2183, pipe: [1:7556256454647575302:11539]
2025-10-01T14:14:13.957299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:13.957798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.957809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.957842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647575302:11539], now have 1 active actors on pipe
2025-10-01T14:14:13.957993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:13.958051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256454647575302:11539]
2025-10-01T14:14:13.958051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:13.958081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:13.958146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2184 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0
2025-10-01T14:14:13.958303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2184 sessionId: src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0 is DEAD
2025-10-01T14:14:13.958432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:13.958441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0] Write session will restart in 0.009088s
2025-10-01T14:14:13.958461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0] Write session: Do CDS request
2025-10-01T14:14:13.958466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:13.968967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.968968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:13.968980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2185
2025-10-01T14:14:13.969138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:13.969166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:13.969175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:13.969178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:13.969490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2185 sessionId:  describe result for acl check
2025-10-01T14:14:13.969514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:13.969515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:13.969516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:13.969519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256454647575422:12037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:13.969868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256454647575422:12037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:13.972127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256454647575422:12037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:13.974588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256454647575422:12037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:13.974599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256454647575422:12037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:13.974614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256454647575422:12037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:13.974621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:13.974667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:13.977327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:13.977471Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:13.977478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:13.977485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:13.977517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:13.977542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256452270673892:11611]
2025-10-01T14:14:13.977927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:13.978161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:13.978187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:13.978399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:13.978443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.978448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.978449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.978449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.978450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.978451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.978451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.978452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.978453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.978453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.978454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.978454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.978455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.978455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.978458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.978464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.978466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.978469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.978471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.978473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.978475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.978477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.978480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.978482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.978484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.978486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.978488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.978490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.978495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.978499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:13.978502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.978506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:13.978509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.978512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:13.978514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.978517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:13.978519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.978522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:13.978524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.978527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:13.978529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.978532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:13.978534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.978536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:13.978539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.978541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:13.978543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.978547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.978549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.978553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.978555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.978557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.978560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.978563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:13.978565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.978568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:13.978587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:13.982080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:13.982823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:13.982835Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:13.982837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:13.982839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:13.982844Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2184 [2:7556256452270673892:11611]
2025-10-01T14:14:13.982857Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:13.982871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:13.982876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.982878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.982879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.982891Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:13.982898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:13.982903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:13.982943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.982948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.982949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.982952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:13.982953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:13.983001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:13.983006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:13.983013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:13.983018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:13.983030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:13.983044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256452270673886:11611]
2025-10-01T14:14:13.983050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256452270673886:11611]
2025-10-01T14:14:13.983052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256452270673886:11611]
2025-10-01T14:14:13.983064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:13.983070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:13.983073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:13.983075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:13.983076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:13.983089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:13.983096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:13.983106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647575570:12037], now have 1 active actors on pipe
2025-10-01T14:14:13.983113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256454647575308:2446], now have 1 active actors on pipe
2025-10-01T14:14:13.983132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256452270673886:11611]
2025-10-01T14:14:13.983143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:13.983133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2184
2025-10-01T14:14:13.983158Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2184
2025-10-01T14:14:13.983157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:13.983181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.983189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.983209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:13.983217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:13.983220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:13.983222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:13.983228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:13.983238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:13.983248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.983369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:13.983374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:13.983383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:13.983440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2185 partition: 0 MaxSeqNo: 45 sessionId: src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0
2025-10-01T14:14:13.983764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfc1a65b-1acc623f-5167fd6a-9854083b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:13.986856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0] Write session: try to update token
2025-10-01T14:14:13.986873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:13.999549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:13.999568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:13.999577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256452270673886:11611]
2025-10-01T14:14:13.999623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:13.999641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:13.999779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:13.999898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:14.000014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:14.000131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:14.000296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:14.000330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:14.000748Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2185 sessionId: src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:14.003250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:14.003692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.003707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.003731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:14.003817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:14.011960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:14.011977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:14.011979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:14.011981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:14.011990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256452270673886:11611]
2025-10-01T14:14:14.011993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256452270673886:11611]
2025-10-01T14:14:14.011998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256452270673886:11611]
2025-10-01T14:14:14.012030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:14.012039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:14.012043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:14.012046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.012047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:14.012048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:14.012159Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:14.058006Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256458942542878:11539]
2025-10-01T14:14:14.058223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2184, pipe: [1:7556256458942542878:11539]
2025-10-01T14:14:14.142820Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:14.149682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.149714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.149856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.149913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.149968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.150017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.150057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.150065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.150124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.150179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.150233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.150289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.150329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.150335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.150413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.150468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.150526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.150582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.150624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.150630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.150690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.150747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.150799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.150857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.150897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.150904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.150960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.151015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.151070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.151128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.151169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.151175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.151240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.151297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.151352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.151408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.151449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.151454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.151513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.151566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.151620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.151681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.151721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.151727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.151792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.151848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.151903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.151958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.151999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.152005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.152064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.152116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.152173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.152229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.152270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.152276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.152333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.152386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.152441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.152495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.152534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.152540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.152599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942542878:11539], now have 1 active actors on pipe
2025-10-01T14:14:14.152845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:14.152857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:14.152864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256458942542878:11539]
2025-10-01T14:14:14.152880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2185 reason: error at write: Disconnected sessionId: src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0
2025-10-01T14:14:14.152881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:14.153025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2185 sessionId: src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0 is DEAD
2025-10-01T14:14:14.153170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:14.153183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0] Write session will restart in 0.008847s
2025-10-01T14:14:14.153208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0] Write session: Do CDS request
2025-10-01T14:14:14.153214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:14.153525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:14.162878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.162931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:14.162945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2186
2025-10-01T14:14:14.163044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.163069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:14.163333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:14.163340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:14.163658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2186 sessionId:  describe result for acl check
2025-10-01T14:14:14.163682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:14.163687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:14.163688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:14.163691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256458942542974:12041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:14.164063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256458942542974:12041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:14.166311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256458942542974:12041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:14.168614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256458942542974:12041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:14.168626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256458942542974:12041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:14.168629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256458942542974:12041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:14.168636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:14.169021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:14.171347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:14.171498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:14.171505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:14.171513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:14.171544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:14.171569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256456565641459:11613]
2025-10-01T14:14:14.171984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:14.172203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:14.172236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:14.172420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:14.172451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.172455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.172456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.172456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.172457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.172458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.172459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.172459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.172460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.172460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.172461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.172461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.172462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.172463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.172465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.172471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.172473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.172475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.172477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.172479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.172481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.172483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.172485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.172488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.172490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.172492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.172494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.172496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.172500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.172504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.172508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.172511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.172513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.172516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.172518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.172521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.172524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.172526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.172529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.172532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.172534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.172540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.172542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.172545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.172548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.172553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.172556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.172558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.172560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.172564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.172568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.172570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.172572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.172575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.172589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.172591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.172624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:14.175857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:14.176591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:14.176601Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:14.176602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:14.176605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:14.176609Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2185 [2:7556256456565641459:11613]
2025-10-01T14:14:14.176619Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:14.176629Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:14.176634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.176636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.176637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.176647Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:14.176654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:14.176658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:14.176695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.176700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.176701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.176703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:14.176705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:14.176762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:14.176769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.176779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.176788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.176801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:14.176819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942542881:2446], now have 1 active actors on pipe
2025-10-01T14:14:14.176822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942543146:12041], now have 1 active actors on pipe
2025-10-01T14:14:14.176829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256456565641454:11613]
2025-10-01T14:14:14.176831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256456565641454:11613]
2025-10-01T14:14:14.176833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256456565641454:11613]
2025-10-01T14:14:14.176845Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:14.176856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:14.176857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:14.176859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:14.176862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:14.176849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2185
2025-10-01T14:14:14.176872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2185
2025-10-01T14:14:14.176874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:14.176880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:14.176913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.176920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.176929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256456565641454:11613]
2025-10-01T14:14:14.176935Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:14.176943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:14.176959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bbabe90f-25467480-bd7cc35-39e93a65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:14.176969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.176972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.176978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:14.176987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.176995Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:14.177015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.177120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.177127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.177140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.177211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2186 partition: 0 MaxSeqNo: 45 sessionId: src_id|bbabe90f-25467480-bd7cc35-39e93a65_0
2025-10-01T14:14:14.177497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1d15a8d3-2c0c6f08-64fe3467-bedd9fc9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bbabe90f-25467480-bd7cc35-39e93a65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:14.180047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbabe90f-25467480-bd7cc35-39e93a65_0] Write session: try to update token
2025-10-01T14:14:14.180061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbabe90f-25467480-bd7cc35-39e93a65_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:14.192424Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2186 sessionId: src_id|bbabe90f-25467480-bd7cc35-39e93a65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:14.194628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:14.195914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.195935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.195951Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:14.195953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:14.195955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:14.195956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:14.195962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256456565641454:11613]
2025-10-01T14:14:14.195964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256456565641454:11613]
2025-10-01T14:14:14.195969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256456565641454:11613]
2025-10-01T14:14:14.195998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:14.196006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:14.196008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:14.196010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:14.196016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.196018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:14.196133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:14.253140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256458942543158:11539]
2025-10-01T14:14:14.253402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2185, pipe: [1:7556256458942543158:11539]
2025-10-01T14:14:14.329394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:14.329865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:14.329911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942543158:11539], now have 1 active actors on pipe
2025-10-01T14:14:14.330002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:14.330040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256458942543158:11539]
2025-10-01T14:14:14.330065Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:14.330076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:14.330078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:14.330133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2186 reason: error at write: Disconnected sessionId: src_id|bbabe90f-25467480-bd7cc35-39e93a65_0
2025-10-01T14:14:14.330241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2186 sessionId: src_id|bbabe90f-25467480-bd7cc35-39e93a65_0 is DEAD
2025-10-01T14:14:14.330385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbabe90f-25467480-bd7cc35-39e93a65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:14.330396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbabe90f-25467480-bd7cc35-39e93a65_0] Write session will restart in 0.009103s
2025-10-01T14:14:14.330414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbabe90f-25467480-bd7cc35-39e93a65_0] Write session: Do CDS request
2025-10-01T14:14:14.330419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbabe90f-25467480-bd7cc35-39e93a65_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:14.340811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bbabe90f-25467480-bd7cc35-39e93a65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.340860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:14.340870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2187
2025-10-01T14:14:14.340989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.341012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:14.341015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:14.341017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:14.341370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2187 sessionId:  describe result for acl check
2025-10-01T14:14:14.341402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:14.341408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:14.341410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:14.341415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256458942543322:12045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:14.341936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256458942543322:12045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:14.343689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256458942543322:12045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:14.343951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:14.346000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:14.346143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:14.346150Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:14.346157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256458942543322:12045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:14.346168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256458942543322:12045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:14.346170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256458942543322:12045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:14.346175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:14.346158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:14.346188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:14.346210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256456565641728:11616]
2025-10-01T14:14:14.346755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:14.347021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:14.347062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:14.347325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:14.347374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.347379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.347380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.347381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.347381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.347382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.347383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.347383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.347384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.347384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.347385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.347385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.347386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.347387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.347390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.347395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.347398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.347400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.347402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.347405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.347407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.347409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.347411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.347413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.347415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.347417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.347419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.347421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.347426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.347430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.347434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.347437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.347439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.347442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.347444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.347446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.347449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.347452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.347454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.347457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.347459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.347462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.347464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.347467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.347471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.347474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.347476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.347482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.347484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.347487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.347493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.347496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.347498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.347502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.347507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.347510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.347529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:14.350866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:14.351515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:14.351527Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:14.351529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:14.351533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:14.351541Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2186 [2:7556256456565641728:11616]
2025-10-01T14:14:14.351553Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:14.351567Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:14.351574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.351578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.351584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.351598Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:14.351607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:14.351616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:14.351658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.351663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.351664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.351667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:14.351669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:14.351716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:14.351721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.351728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.351733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.351742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:14.351753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256456565641723:11616]
2025-10-01T14:14:14.351755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256456565641723:11616]
2025-10-01T14:14:14.351756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256456565641723:11616]
2025-10-01T14:14:14.351761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:14.351770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:14.351771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:14.351774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:14.351776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:14.351778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:14.351780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:14.351789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942543428:12045], now have 1 active actors on pipe
2025-10-01T14:14:14.351791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942543160:2446], now have 1 active actors on pipe
2025-10-01T14:14:14.351806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256456565641723:11616]
2025-10-01T14:14:14.351811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:14.351816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:14.351875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2186
2025-10-01T14:14:14.351897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2186
2025-10-01T14:14:14.351934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.351947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.351985Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:14.351996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.352004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.352006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:14.352021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.352036Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:14.352055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.352184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.352190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.352202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.352285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2187 partition: 0 MaxSeqNo: 45 sessionId: src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0
2025-10-01T14:14:14.352630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bbabe90f-25467480-bd7cc35-39e93a65_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:14.355294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0] Write session: try to update token
2025-10-01T14:14:14.355309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:14.366638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:14.366652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:14.366659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256456565641723:11616]
2025-10-01T14:14:14.366697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:14.366711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:14.366887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:14.367010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:14.367127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:14.367255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:14.367418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:14.367448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:14.368263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2187 sessionId: src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:14.370787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:14.370962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.370977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.371011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:14.371093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:14.379536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:14.379552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:14.379555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:14.379556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:14.379565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256456565641723:11616]
2025-10-01T14:14:14.379568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256456565641723:11616]
2025-10-01T14:14:14.379570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256456565641723:11616]
2025-10-01T14:14:14.379604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:14.379603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:14.379607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:14.379609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.379609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:14.379611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:14.379717Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:14.430220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256458942543439:11539]
2025-10-01T14:14:14.430422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2186, pipe: [1:7556256458942543439:11539]
2025-10-01T14:14:14.518239Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:14.525010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.525032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.525168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.525222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.525283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.525337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.525377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.525385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.525442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.525502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.525556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.525613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.525656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.525661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.525721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.525776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.525835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.525890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.525929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.525934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.526003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.526063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.526115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.526168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.526208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.526214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.526269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.526321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.526397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.526465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.526522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.526530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.526596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.526650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.526706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.526763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.526802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.526809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.526867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.526919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.526984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.527058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.527098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.527106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.527169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.527221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.527277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.527331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.527372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.527378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.527436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.527499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.527565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.527619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.527664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.527669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.527728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:14.527782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:14.527837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:14.527890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:14.527929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:14.527935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:14.527979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942543439:11539], now have 1 active actors on pipe
2025-10-01T14:14:14.528230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:14.528234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256458942543439:11539]
2025-10-01T14:14:14.528242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:14.528264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2187 reason: error at write: Disconnected sessionId: src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0
2025-10-01T14:14:14.528268Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:14.528414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2187 sessionId: src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0 is DEAD
2025-10-01T14:14:14.528552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:14.528562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0] Write session will restart in 0.005863s
2025-10-01T14:14:14.528597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0] Write session: Do CDS request
2025-10-01T14:14:14.528603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:14.528980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:14.535901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.535990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:14.536002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2188
2025-10-01T14:14:14.536134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.536177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:14.536186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:14.536190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:14.536635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2188 sessionId:  describe result for acl check
2025-10-01T14:14:14.536676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:14.536682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:14.536683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:14.536688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256458942543469:12049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:14.537204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256458942543469:12049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:14.539845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256458942543469:12049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:14.543654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256458942543469:12049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:14.543664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256458942543469:12049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:14.543666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256458942543469:12049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:14.543672Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:14.547844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:14.550687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:14.550850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:14.550862Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:14.550873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:14.550916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:14.550955Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256456565642014:11619]
2025-10-01T14:14:14.551560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:14.551846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:14.551883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:14.552167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:14.552218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.552225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.552226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.552227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.552229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.552230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.552231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.552233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.552234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.552235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.552237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.552238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.552238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.552240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.552244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.552254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.552258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.552263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.552267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.552271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.552275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.552278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.552282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.552286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.552290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.552294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.552297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.552301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.552312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.552323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.552332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.552342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.552350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.552360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.552368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.552374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.552380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.552383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.552386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.552392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.552395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.552398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.552404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.552408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.552410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.552414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.552416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.552419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.552425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.552428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.552431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.552437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.552439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.552442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.552447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.552450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.552485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:14.555985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:14.556621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:14.556633Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:14.556635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:14.556639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:14.556645Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2187 [2:7556256456565642014:11619]
2025-10-01T14:14:14.556826Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:14.556843Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:14.556848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.556851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.556852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.556863Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:14.556867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:14.556874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:14.556911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.556916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.556917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.556919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:14.556921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:14.556979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:14.556985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.556996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.557010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.557030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:14.557046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942543445:2446], now have 1 active actors on pipe
2025-10-01T14:14:14.557052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942543627:12049], now have 1 active actors on pipe
2025-10-01T14:14:14.557058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256456565642007:11619]
2025-10-01T14:14:14.557063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256456565642007:11619]
2025-10-01T14:14:14.557065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256456565642007:11619]
2025-10-01T14:14:14.557078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:14.557090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:14.557094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:14.557098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:14.557100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:14.557108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:14.557111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:14.557090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2187
2025-10-01T14:14:14.557106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2187
2025-10-01T14:14:14.557137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256456565642007:11619]
2025-10-01T14:14:14.557149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:14.557155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:14.557164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.557168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.557200Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:14.557211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.557218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.557220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:14.557228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.557240Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:14.557259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.557383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.557391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.557404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.557479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2188 partition: 0 MaxSeqNo: 45 sessionId: src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0
2025-10-01T14:14:14.557831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac2d018-c5ea096f-fc200bf9-ef6e9d50_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:14.560365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0] Write session: try to update token
2025-10-01T14:14:14.560380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:14.572200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2188 sessionId: src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:14.574246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:14.576518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.576538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.576556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:14.576559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:14.576562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:14.576563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:14.576572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256456565642007:11619]
2025-10-01T14:14:14.576590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256456565642007:11619]
2025-10-01T14:14:14.576593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256456565642007:11619]
2025-10-01T14:14:14.576639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:14.576651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.576653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:14.576653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:14.576659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:14.576666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:14.576777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:14.628374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256458942543751:11539]
2025-10-01T14:14:14.628599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2187, pipe: [1:7556256458942543751:11539]
2025-10-01T14:14:14.715066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:14.715499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:14.715548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942543751:11539], now have 1 active actors on pipe
2025-10-01T14:14:14.715621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:14.715736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256458942543751:11539]
2025-10-01T14:14:14.715766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:14.724474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:14.724486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:14.724508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2188 reason: error at write: Disconnected sessionId: src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0
2025-10-01T14:14:14.724653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2188 sessionId: src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0 is DEAD
2025-10-01T14:14:14.724805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:14.724816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0] Write session will restart in 0.008921s
2025-10-01T14:14:14.724842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0] Write session: Do CDS request
2025-10-01T14:14:14.724850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:14.734892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.734999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:14.735012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2189
2025-10-01T14:14:14.735110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.735136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:14.735143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:14.735148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:14.735486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2189 sessionId:  describe result for acl check
2025-10-01T14:14:14.735516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:14.735521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:14.735522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:14.735527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256458942544000:12062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:14.735656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:14.735977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256458942544000:12062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:14.737658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256458942544000:12062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:14.738584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:14.738854Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:14.738868Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:14.738879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:14.738932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:14.738968Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256456565642292:11623]
2025-10-01T14:14:14.739529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:14.739545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256458942544000:12062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:14.739557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256458942544000:12062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:14.739560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256458942544000:12062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:14.739567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:14.739784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:14.739829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:14.740114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:14.740169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.740174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.740176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.740177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.740178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.740179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.740180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.740182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.740183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.740184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.740185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.740187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.740188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.740189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.740194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.740203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.740207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.740215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.740219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.740226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.740229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.740237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.740243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.740249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.740256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.740260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.740267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.740271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.740277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.740284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.740294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.740299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.740308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.740316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.740323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.740327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.740335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.740343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.740348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.740357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.740366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.740375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.740383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.740389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.740395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.740400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.740406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.740411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.740421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.740426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.740433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.740442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.740450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.740459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.740463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.740467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.740506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:14.743844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:14.744489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:14.744502Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:14.744504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:14.744508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:14.744514Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2188 [2:7556256456565642292:11623]
2025-10-01T14:14:14.744828Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:14.744850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:14.744858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.744862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.744867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.744881Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:14.744890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:14.744900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:14.744949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.744955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.744957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.744960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:14.744962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:14.745021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:14.745028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.745039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.745052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.745070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:14.745089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942544036:12062], now have 1 active actors on pipe
2025-10-01T14:14:14.745096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942543754:2446], now have 1 active actors on pipe
2025-10-01T14:14:14.745103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256456565642287:11623]
2025-10-01T14:14:14.745109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256456565642287:11623]
2025-10-01T14:14:14.745112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256456565642287:11623]
2025-10-01T14:14:14.745124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:14.745135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:14.745140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:14.745143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:14.745145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:14.745152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:14.745155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:14.745130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2188
2025-10-01T14:14:14.745151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2188
2025-10-01T14:14:14.745175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256456565642287:11623]
2025-10-01T14:14:14.745182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:14.745187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:14.745197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.745205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.745248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:14.745258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.745265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.745267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:14.745278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.745289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:14.745309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.745455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.745461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.745473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.745532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2189 partition: 0 MaxSeqNo: 45 sessionId: src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0
2025-10-01T14:14:14.745847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c71f52c6-3b91f956-cc017384-e1e1b421_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:14.748402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0] Write session: try to update token
2025-10-01T14:14:14.748416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:14.760887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2189 sessionId: src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:14.763167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:14.764255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.764282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.764303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:14.764310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:14.764313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:14.764315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:14.764323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256456565642287:11623]
2025-10-01T14:14:14.764327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256456565642287:11623]
2025-10-01T14:14:14.764330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256456565642287:11623]
2025-10-01T14:14:14.764384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:14.764393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:14.764399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.764401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:14.764401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:14.764405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:14.764532Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:14.815784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256458942544047:11539]
2025-10-01T14:14:14.816022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2188, pipe: [1:7556256458942544047:11539]
2025-10-01T14:14:14.910937Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:14.911263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:14.911311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942544047:11539], now have 1 active actors on pipe
2025-10-01T14:14:14.911411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:14.911619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256458942544047:11539]
2025-10-01T14:14:14.911648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:14.921731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:14.921747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:14.921768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2189 reason: error at write: Disconnected sessionId: src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0
2025-10-01T14:14:14.921903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2189 sessionId: src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0 is DEAD
2025-10-01T14:14:14.922009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:14.922019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0] Write session will restart in 0.005048s
2025-10-01T14:14:14.922041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0] Write session: Do CDS request
2025-10-01T14:14:14.922049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:14.927856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.928279Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:14.928293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2190
2025-10-01T14:14:14.928392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:14.928415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:14.928420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:14.928423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:14.928773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2190 sessionId:  describe result for acl check
2025-10-01T14:14:14.928813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:14.928815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:14.928816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:14.928822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256458942544255:12066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:14.929301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256458942544255:12066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:14.931020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:14.931286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256458942544255:12066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:14.933655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:14.933897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256458942544255:12066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:14.933910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256458942544255:12066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:14.933913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256458942544255:12066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:14.933920Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:14.933978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:14.933990Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:14.934002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:14.934065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:14.934099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256456565642596:11632]
2025-10-01T14:14:14.934496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:14.934734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:14.934764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:14.934997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:14.935037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.935042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.935043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.935044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.935044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.935045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.935046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.935046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.935047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.935048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.935048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.935049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.935049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.935050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.935053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.935059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.935061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.935063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.935065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.935068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.935070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.935072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.935074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.935076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.935078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.935081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.935083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.935085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.935089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.935093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:14.935097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.935100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:14.935102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.935105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:14.935108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.935111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:14.935116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.935119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:14.935122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.935125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:14.935128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.935131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:14.935133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.935136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:14.935139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.935142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:14.935145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.935148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.935150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.935153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.935155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.935158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.935161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.935163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:14.935166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.935169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:14.935190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:14.938689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:14.939516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:14.939529Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:14.939530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:14.939532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:14.939537Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2189 [2:7556256456565642596:11632]
2025-10-01T14:14:14.939547Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:14.939560Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:14.939565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.939567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.939569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.939579Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:14.939586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:14.939591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:14.939635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.939641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.939643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.939646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:14.939649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:14.939707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:14.939716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.939724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:14.939730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:14.939739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:14.939751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256456565642591:11632]
2025-10-01T14:14:14.939752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256456565642591:11632]
2025-10-01T14:14:14.939753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256456565642591:11632]
2025-10-01T14:14:14.939761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:14.939770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942544319:12066], now have 1 active actors on pipe
2025-10-01T14:14:14.939771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:14.939774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:14.939776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256458942544049:2446], now have 1 active actors on pipe
2025-10-01T14:14:14.939776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:14.939782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:14.939795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:14.939802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:14.939824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256456565642591:11632]
2025-10-01T14:14:14.939834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:14.939840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:14.939831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2189
2025-10-01T14:14:14.939835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2189
2025-10-01T14:14:14.939882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.939892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.939913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|621a310c-b47f035e-ca05248c-3555337b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:14.939922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:14.939926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:14.939927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:14.939933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:14.939939Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:14.939950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.940139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2190 partition: 0 MaxSeqNo: 45 sessionId: src_id|621a310c-b47f035e-ca05248c-3555337b_0
2025-10-01T14:14:14.940071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.940077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.940089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:14.940439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|213e239a-e1e9e17f-c850d45f-9aa2a172_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|621a310c-b47f035e-ca05248c-3555337b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:14.943071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621a310c-b47f035e-ca05248c-3555337b_0] Write session: try to update token
2025-10-01T14:14:14.943088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621a310c-b47f035e-ca05248c-3555337b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:14.957192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2190 sessionId: src_id|621a310c-b47f035e-ca05248c-3555337b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:14.959489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:14.959805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:14.959825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:14.959846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:14.959850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:14.959853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:14.959854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:14.959864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256456565642591:11632]
2025-10-01T14:14:14.959868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256456565642591:11632]
2025-10-01T14:14:14.959871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256456565642591:11632]
2025-10-01T14:14:14.959911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:14.959923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:14.959925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:14.959927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:14.959931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:14.959934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:14.960061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:15.011874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256463237511629:11539]
2025-10-01T14:14:15.012126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2189, pipe: [1:7556256463237511629:11539]
2025-10-01T14:14:15.095296Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:15.095658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:15.095702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237511629:11539], now have 1 active actors on pipe
2025-10-01T14:14:15.095863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256463237511629:11539]
2025-10-01T14:14:15.095900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:15.095933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:15.096012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:15.096019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:15.096099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2190 reason: error at write: Disconnected sessionId: src_id|621a310c-b47f035e-ca05248c-3555337b_0
2025-10-01T14:14:15.096240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2190 sessionId: src_id|621a310c-b47f035e-ca05248c-3555337b_0 is DEAD
2025-10-01T14:14:15.096358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621a310c-b47f035e-ca05248c-3555337b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:15.096366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621a310c-b47f035e-ca05248c-3555337b_0] Write session will restart in 0.008547s
2025-10-01T14:14:15.096390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621a310c-b47f035e-ca05248c-3555337b_0] Write session: Do CDS request
2025-10-01T14:14:15.096398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621a310c-b47f035e-ca05248c-3555337b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:15.105822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|621a310c-b47f035e-ca05248c-3555337b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.105943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:15.105954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2191
2025-10-01T14:14:15.106048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.106070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:15.106073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:15.106078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:15.106356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2191 sessionId:  describe result for acl check
2025-10-01T14:14:15.106395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:15.106399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:15.106401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:15.106404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256463237511725:12071] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:15.106770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256463237511725:12071] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:15.109092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256463237511725:12071] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:15.111174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256463237511725:12071] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:15.111187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256463237511725:12071] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:15.111191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256463237511725:12071] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:15.111198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:15.114362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:15.114789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:15.114935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:15.114943Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:15.114951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:15.114986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:15.115021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256460860610168:11638]
2025-10-01T14:14:15.115454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:15.115686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:15.115717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:15.115941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:15.115979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.115984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.115984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.115985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.115986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.115987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.115988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.115988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.115989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.115990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.115990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.115991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.115992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.115993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.115996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.116002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.116004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.116007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.116009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.116011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.116014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.116016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.116018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.116021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.116023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.116025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.116027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.116029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.116035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.116040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.116044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.116047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.116049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.116052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.116055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.116058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.116060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.116063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.116065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.116069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.116071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.116074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.116080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.116083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.116086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.116089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.116095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.116099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.116101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.116110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.116114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.116119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.116124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.116135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.116142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.116145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.116170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:15.119636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:15.120568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:15.120589Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:15.120591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:15.120593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:15.120598Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2190 [2:7556256460860610168:11638]
2025-10-01T14:14:15.120609Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:15.120619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:15.120621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.120623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.120624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.120634Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:15.120641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:15.120646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:15.120680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.120684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.120685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.120688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:15.120689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:15.120734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:15.120739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.120746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.120755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.120768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:15.120782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256460860610163:11638]
2025-10-01T14:14:15.120787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256460860610163:11638]
2025-10-01T14:14:15.120789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256460860610163:11638]
2025-10-01T14:14:15.120795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:15.120804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:15.120808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237511901:12071], now have 1 active actors on pipe
2025-10-01T14:14:15.120810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237511632:2446], now have 1 active actors on pipe
2025-10-01T14:14:15.120816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:15.120816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:15.120818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:15.120824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:15.120826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:15.120845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256460860610163:11638]
2025-10-01T14:14:15.120852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:15.120859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:15.120884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2190
2025-10-01T14:14:15.120903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.120912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.120923Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2190
2025-10-01T14:14:15.120934Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:15.120945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.120949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.120951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:15.120961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.120970Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:15.120986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.121379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.121395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.121417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.121515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2191 partition: 0 MaxSeqNo: 45 sessionId: src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0
2025-10-01T14:14:15.121824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|621a310c-b47f035e-ca05248c-3555337b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:15.124370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0] Write session: try to update token
2025-10-01T14:14:15.124382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:15.136706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2191 sessionId: src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:15.139071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:15.140284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.140308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.140327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:15.140330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:15.140333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:15.140335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:15.140342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256460860610163:11638]
2025-10-01T14:14:15.140347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256460860610163:11638]
2025-10-01T14:14:15.140351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256460860610163:11638]
2025-10-01T14:14:15.140398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:15.140406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:15.140412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.140413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:15.140414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:15.140417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:15.140542Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:15.196193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256463237511918:11539]
2025-10-01T14:14:15.196430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2190, pipe: [1:7556256463237511918:11539]
2025-10-01T14:14:15.273970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:15.274292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:15.274337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237511918:11539], now have 1 active actors on pipe
2025-10-01T14:14:15.274432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:15.274552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256463237511918:11539]
2025-10-01T14:14:15.274576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:15.283354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:15.283366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:15.283384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2191 reason: error at write: Disconnected sessionId: src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0
2025-10-01T14:14:15.283513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2191 sessionId: src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0 is DEAD
2025-10-01T14:14:15.283641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:15.283652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0] Write session will restart in 0.009914s
2025-10-01T14:14:15.283671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0] Write session: Do CDS request
2025-10-01T14:14:15.283678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:15.293882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:15.294773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.294863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:15.294877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2192
2025-10-01T14:14:15.294985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.295014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:15.295023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:15.295027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:15.295415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2192 sessionId:  describe result for acl check
2025-10-01T14:14:15.295448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:15.295454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:15.295456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:15.295461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256463237512161:12075] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:15.295949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256463237512161:12075] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:15.296360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:15.296635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:15.296649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:15.296661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:15.296717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:15.296754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256460860610444:11641]
2025-10-01T14:14:15.297334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:15.297633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:15.297679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:15.297975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:15.298034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.298040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.298041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.298042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.298044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.298045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.298047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.298048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.298049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.298050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.298051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.298052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.298053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.298054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.298059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.298069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.298073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.298077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.298081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.298084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.298087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.298091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.298095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.298102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256463237512161:12075] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:15.298099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.298102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.298106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.298110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.298114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.298120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.298128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.298134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.298139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.298144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.298149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.298154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.298160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.298164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.298169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.298174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.298178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.298183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.298188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.298193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.298198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.298205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.298210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.298214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.298224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.298228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.298233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.298242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.298247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.298251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.298256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.298262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.298266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.298301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:15.301618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256463237512161:12075] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:15.301635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256463237512161:12075] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:15.301639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256463237512161:12075] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:15.301647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:15.301730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:15.302639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:15.302654Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:15.302657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:15.302660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:15.302666Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2191 [2:7556256460860610444:11641]
2025-10-01T14:14:15.302682Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:15.302696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:15.302699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.302702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.302704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.302719Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:15.302724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:15.302730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:15.302784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.302791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.302793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.302796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:15.302799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:15.302860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:15.302867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.302879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.302891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.302908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:15.302930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237511922:2446], now have 1 active actors on pipe
2025-10-01T14:14:15.302937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237512200:12075], now have 1 active actors on pipe
2025-10-01T14:14:15.302944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256460860610439:11641]
2025-10-01T14:14:15.302946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256460860610439:11641]
2025-10-01T14:14:15.302948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256460860610439:11641]
2025-10-01T14:14:15.302960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:15.302976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:15.302983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:15.302986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:15.302988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:15.302995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:15.302997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:15.302970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2191
2025-10-01T14:14:15.302987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2191
2025-10-01T14:14:15.303038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.303047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.303059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256460860610439:11641]
2025-10-01T14:14:15.303069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:15.303089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:15.303099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|566ebf72-7d338959-bad20ed1-c9e60796_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:15.303106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.303114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.303117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:15.303124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.303136Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:15.303159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.303322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.303332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.303347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.303420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2192 partition: 0 MaxSeqNo: 45 sessionId: src_id|566ebf72-7d338959-bad20ed1-c9e60796_0
2025-10-01T14:14:15.303746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffceb7b-83038bf2-be4b2eda-31c31973_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|566ebf72-7d338959-bad20ed1-c9e60796_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:15.306264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|566ebf72-7d338959-bad20ed1-c9e60796_0] Write session: try to update token
2025-10-01T14:14:15.306278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|566ebf72-7d338959-bad20ed1-c9e60796_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:15.319722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2192 sessionId: src_id|566ebf72-7d338959-bad20ed1-c9e60796_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:15.322133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:15.322306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:15.322321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:15.322323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:15.322324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:15.322332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256460860610439:11641]
2025-10-01T14:14:15.322335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256460860610439:11641]
2025-10-01T14:14:15.322337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256460860610439:11641]
2025-10-01T14:14:15.322361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:15.322388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:15.322392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:15.322402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.322417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.322442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:15.322451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.322454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:15.322594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:15.374888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256463237512207:11539]
2025-10-01T14:14:15.375192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2191, pipe: [1:7556256463237512207:11539]
2025-10-01T14:14:15.463330Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:15.463653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237512207:11539], now have 1 active actors on pipe
2025-10-01T14:14:15.463828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:15.463881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:15.463928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:15.463930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:15.463976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256463237512207:11539]
2025-10-01T14:14:15.463980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2192 reason: error at write: Disconnected sessionId: src_id|566ebf72-7d338959-bad20ed1-c9e60796_0
2025-10-01T14:14:15.464137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2192 sessionId: src_id|566ebf72-7d338959-bad20ed1-c9e60796_0 is DEAD
2025-10-01T14:14:15.464281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566ebf72-7d338959-bad20ed1-c9e60796_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:15.464291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566ebf72-7d338959-bad20ed1-c9e60796_0] Write session will restart in 0.008872s
2025-10-01T14:14:15.464307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566ebf72-7d338959-bad20ed1-c9e60796_0] Write session: Do CDS request
2025-10-01T14:14:15.464312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566ebf72-7d338959-bad20ed1-c9e60796_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:15.473777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|566ebf72-7d338959-bad20ed1-c9e60796_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.473882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:15.473896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2193
2025-10-01T14:14:15.473988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.474017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:15.474025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:15.474028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:15.474355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2193 sessionId:  describe result for acl check
2025-10-01T14:14:15.474397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:15.474402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:15.474403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:15.474406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256463237512312:12079] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:15.474797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256463237512312:12079] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:15.476618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256463237512312:12079] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:15.478842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256463237512312:12079] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:15.478856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256463237512312:12079] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:15.478859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256463237512312:12079] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:15.478867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:15.479519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:15.481888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:15.482028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:15.482036Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:15.482043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:15.482072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:15.482097Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256460860610735:11646]
2025-10-01T14:14:15.482696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:15.482970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:15.483009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:15.483250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:15.483298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.483302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.483303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.483304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.483305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.483305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.483306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.483307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.483307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.483308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.483309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.483309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.483310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.483310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.483313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.483319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.483321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.483323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.483325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.483327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.483329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.483332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.483333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.483336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.483338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.483340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.483342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.483344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.483349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.483353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.483357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.483360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.483362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.483365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.483367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.483370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.483373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.483376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.483378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.483381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.483383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.483386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.483389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.483392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.483394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.483397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.483399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.483402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.483404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.483406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.483408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.483411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.483413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.483416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.483418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.483421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.483441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:15.486848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:15.487611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:15.487624Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:15.487626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:15.487629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:15.487636Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2192 [2:7556256460860610735:11646]
2025-10-01T14:14:15.487648Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:15.487662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:15.487664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.487668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.487670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.487684Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:15.487692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:15.487696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:15.487732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.487738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.487739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.487742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:15.487743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:15.487922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2192
2025-10-01T14:14:15.487944Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2192
2025-10-01T14:14:15.488251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2193 partition: 0 MaxSeqNo: 45 sessionId: src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0
2025-10-01T14:14:15.488592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|566ebf72-7d338959-bad20ed1-c9e60796_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:15.487787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:15.487793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.487800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.487805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.487815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:15.487825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256460860610730:11646]
2025-10-01T14:14:15.487827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256460860610730:11646]
2025-10-01T14:14:15.487828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256460860610730:11646]
2025-10-01T14:14:15.487836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:15.487846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:15.487848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:15.487849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:15.487850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:15.487862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:15.487865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:15.487875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237512483:12079], now have 1 active actors on pipe
2025-10-01T14:14:15.487901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237512210:2446], now have 1 active actors on pipe
2025-10-01T14:14:15.487903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256460860610730:11646]
2025-10-01T14:14:15.487914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:15.487935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:15.487962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.487967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.487989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:15.487996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.488000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.488002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:15.488010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.488018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:15.488033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.488152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.488157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.488175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.491654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0] Write session: try to update token
2025-10-01T14:14:15.491669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:15.502922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:15.502935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:15.502947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256460860610730:11646]
2025-10-01T14:14:15.502984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:15.502990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:15.503132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:15.503259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:15.503388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:15.503509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:15.503689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:15.503719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:15.507131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2193 sessionId: src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:15.509630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:15.509822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.509839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.509869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:15.509947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:15.516655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:15.516674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:15.516675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:15.516677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:15.516686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256460860610730:11646]
2025-10-01T14:14:15.516688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256460860610730:11646]
2025-10-01T14:14:15.516691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256460860610730:11646]
2025-10-01T14:14:15.516731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:15.516733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:15.516737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:15.516741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.516741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:15.516743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:15.516861Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:15.564348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256463237512503:11539]
2025-10-01T14:14:15.564630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2192, pipe: [1:7556256463237512503:11539]
2025-10-01T14:14:15.650512Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:15.657657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.657678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.657816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.657870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.657925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.657985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.658030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.658037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.658091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.658142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.658192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.658242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.658282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.658287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.658345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.658413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.658470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.658540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.658580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.658586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.658645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.658700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.658756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.658813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.658852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.658857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.658915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.658965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.659028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.659080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.659120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.659127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.659180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.659235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.659287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.659347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.659387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.659393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.659452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.659512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.659573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.659624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.659663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.659668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.659719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.659770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.659826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.659878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.659915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.659920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.659976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.660034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.660091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.660141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.660179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.660184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.660235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.660284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.660335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.660382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.660419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.660424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.660465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237512503:11539], now have 1 active actors on pipe
2025-10-01T14:14:15.660710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:15.660716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:15.660725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:15.660753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2193 reason: error at write: Disconnected sessionId: src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0
2025-10-01T14:14:15.660762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256463237512503:11539]
2025-10-01T14:14:15.660879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2193 sessionId: src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0 is DEAD
2025-10-01T14:14:15.660996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:15.661007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0] Write session will restart in 0.006718s
2025-10-01T14:14:15.661032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0] Write session: Do CDS request
2025-10-01T14:14:15.661038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:15.661514Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:15.668842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.668991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:15.669005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2194
2025-10-01T14:14:15.669122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.669158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:15.669165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:15.669167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:15.669526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2194 sessionId:  describe result for acl check
2025-10-01T14:14:15.669561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:15.669566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:15.669568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:15.669573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256463237512575:12093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:15.670058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256463237512575:12093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:15.672326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256463237512575:12093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:15.675526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256463237512575:12093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:15.675541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256463237512575:12093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:15.675545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256463237512575:12093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:15.675552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:15.678257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:15.680886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:15.681139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:15.681148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:15.681157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:15.681196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:15.681225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256460860611022:11652]
2025-10-01T14:14:15.681621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:15.681809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:15.681836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:15.682045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:15.682080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.682084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.682085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.682086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.682086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.682087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.682088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.682089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.682089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.682090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.682091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.682091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.682092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.682092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.682096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.682101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.682104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.682106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.682108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.682111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.682113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.682115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.682117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.682119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.682121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.682124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.682126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.682128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.682132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.682138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.682142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.682146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.682150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.682155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.682158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.682163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.682167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.682172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.682176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.682181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.682185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.682187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.682190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.682193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.682196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.682199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.682201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.682205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.682209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.682212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.682214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.682217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.682219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.682222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.682225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.682227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.682247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:15.685807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:15.686718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:15.686730Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:15.686732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:15.686735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:15.686740Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2193 [2:7556256460860611022:11652]
2025-10-01T14:14:15.686754Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:15.686767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:15.686770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.686772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.686774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.686785Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:15.686789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:15.686793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:15.686834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.686836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.686837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.686840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:15.686841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:15.686895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:15.686903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.686910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.686916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.686925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:15.686939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237512776:12093], now have 1 active actors on pipe
2025-10-01T14:14:15.686941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237512533:2446], now have 1 active actors on pipe
2025-10-01T14:14:15.686947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256460860611017:11652]
2025-10-01T14:14:15.686948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256460860611017:11652]
2025-10-01T14:14:15.686950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256460860611017:11652]
2025-10-01T14:14:15.686961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:15.686976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:15.686976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:15.686978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:15.686980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:15.686984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:15.686986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:15.687005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256460860611017:11652]
2025-10-01T14:14:15.687013Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:15.687019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:15.687022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2193
2025-10-01T14:14:15.687025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2193
2025-10-01T14:14:15.687080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.687087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.687105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:15.687110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.687112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.687114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:15.687120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.687126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:15.687138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.687282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.687289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.687302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.687400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2194 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0
2025-10-01T14:14:15.687755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f817b0c6-2c9b9bde-97938fee-e72fd15a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:15.690552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0] Write session: try to update token
2025-10-01T14:14:15.690569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:15.697630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:15.697646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:15.697659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256460860611017:11652]
2025-10-01T14:14:15.697705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:15.697711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:15.697873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:15.698004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:15.698131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:15.698288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:15.698496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:15.698535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:15.704006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2194 sessionId: src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:15.706666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:15.706858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.706879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.706917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:15.706995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:15.715970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:15.715991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:15.715994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:15.715996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:15.716006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256460860611017:11652]
2025-10-01T14:14:15.716010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256460860611017:11652]
2025-10-01T14:14:15.716014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256460860611017:11652]
2025-10-01T14:14:15.716055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:15.716058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:15.716064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.716064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:15.716067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:15.716067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:15.716191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:15.760954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256463237512827:11539]
2025-10-01T14:14:15.761183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2193, pipe: [1:7556256463237512827:11539]
2025-10-01T14:14:15.857883Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:15.864881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.864906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.865042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.865090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.865145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.865196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.865234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.865241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.865298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.865355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.865406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.865457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.865498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.865503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.865561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.865612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.865666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.865723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.865761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.865767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.865822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.865893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.865948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.866001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.866041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.866046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.866100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.866153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.866207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.866259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.866302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.866307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.866387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.866446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.866497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.866555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.866598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.866600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.866659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.866705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.866753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.866802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.866838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.866840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.866909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.866957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.867005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.867065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.867105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.867112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.867167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.867219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.867272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.867330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.867371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.867378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.867437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:15.867488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:15.867537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:15.867589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:15.867627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:15.867631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:15.867669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237512827:11539], now have 1 active actors on pipe
2025-10-01T14:14:15.867931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:15.867931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:15.867947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:15.867974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2194 reason: error at write: Disconnected sessionId: src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0
2025-10-01T14:14:15.867985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256463237512827:11539]
2025-10-01T14:14:15.868151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2194 sessionId: src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0 is DEAD
2025-10-01T14:14:15.868253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:15.868263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0] Write session will restart in 0.005700s
2025-10-01T14:14:15.868297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0] Write session: Do CDS request
2025-10-01T14:14:15.868303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:15.868534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:15.874822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.875382Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:15.875394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2195
2025-10-01T14:14:15.875544Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:15.875599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:15.875608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:15.875613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:15.876166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2195 sessionId:  describe result for acl check
2025-10-01T14:14:15.876195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:15.876201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:15.876206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:15.876211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256463237512860:12098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:15.876711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256463237512860:12098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:15.879762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256463237512860:12098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:15.882575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256463237512860:12098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:15.882589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256463237512860:12098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:15.882592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256463237512860:12098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:15.882600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:15.886430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:15.889171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:15.889367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:15.889378Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:15.889389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:15.889440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:15.889478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256460860611304:11655]
2025-10-01T14:14:15.890127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:15.890427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:15.890472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:15.890791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:15.890852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.890859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.890860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.890861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.890863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.890864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.890865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.890866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.890867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.890868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.890869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.890870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.890871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.890873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.890877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.890887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.890891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.890894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.890898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.890901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.890904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.890908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.890912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.890917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.890921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.890925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.890934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.890937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.890946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.890957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:15.890966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.890975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:15.890984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.890989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:15.890994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.890999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:15.891008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.891013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:15.891021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.891030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:15.891038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.891044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:15.891052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.891058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:15.891066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.891072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:15.891080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.891084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.891091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.891100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.891108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.891113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.891122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.891130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:15.891137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.891142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:15.891184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:15.894792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:15.895501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:15.895511Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:15.895513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:15.895515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:15.895520Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2194 [2:7556256460860611304:11655]
2025-10-01T14:14:15.895529Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:15.895540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:15.895542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.895544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.895546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.895557Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:15.895564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:15.895569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:15.895607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.895612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.895614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.895617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:15.895619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:15.895666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:15.895672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.895679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:15.895685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:15.895693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:15.895705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256460860611299:11655]
2025-10-01T14:14:15.895710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256460860611299:11655]
2025-10-01T14:14:15.895711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256460860611299:11655]
2025-10-01T14:14:15.895717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:15.895726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:15.895731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:15.895734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:15.895736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:15.895739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:15.895741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:15.895749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237512830:2446], now have 1 active actors on pipe
2025-10-01T14:14:15.895755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237513031:12098], now have 1 active actors on pipe
2025-10-01T14:14:15.895771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256460860611299:11655]
2025-10-01T14:14:15.895779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:15.895787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:15.895811Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2194
2025-10-01T14:14:15.895813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2194
2025-10-01T14:14:15.895842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.895850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.895868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:15.895873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:15.895876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:15.895878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:15.895883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:15.895889Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:15.895901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.896004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.896009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.896018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:15.896094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2195 partition: 0 MaxSeqNo: 45 sessionId: src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0
2025-10-01T14:14:15.896397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ff3f138-da55f45c-27f78e5a-993b0707_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:15.899166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0] Write session: try to update token
2025-10-01T14:14:15.899181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:15.906687Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:15.906702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:15.906710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256460860611299:11655]
2025-10-01T14:14:15.906755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:15.906751Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:15.906894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:15.907016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:15.907128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:15.907234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:15.907390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:15.907419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:15.912432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2195 sessionId: src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:15.915049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:15.915232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:15.915249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:15.915278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:15.915345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:15.925614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:15.925632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:15.925635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:15.925636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:15.925647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256460860611299:11655]
2025-10-01T14:14:15.925651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256460860611299:11655]
2025-10-01T14:14:15.925654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256460860611299:11655]
2025-10-01T14:14:15.925690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:15.925694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:15.925697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:15.925698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:15.925705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:15.925710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:15.925840Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:15.968313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256463237513118:11539]
2025-10-01T14:14:15.968530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2194, pipe: [1:7556256463237513118:11539]
2025-10-01T14:14:16.068830Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:16.075451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.075476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.075619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.075673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.075726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.075782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.075858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.075866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.075922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.075974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.076026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.076082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.076120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.076128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.076186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.076245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.076301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.076351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.076390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.076395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.076456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.076849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.076904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.076954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.076999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.077005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.077063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.077118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.077177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.077233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.077277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.077283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.077339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.077391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.077444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.077495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.077540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.077546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.077601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.077650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.077706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.077755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.077793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.077798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.077851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.077905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.077958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.078010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.078049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.078054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.078106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.078156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.078205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.078256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.078350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.078356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.078427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:16.078477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:16.078528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:16.078583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:16.078620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:16.078630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:16.078669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256463237513118:11539], now have 1 active actors on pipe
2025-10-01T14:14:16.078881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:16.078889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:16.078893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:16.078919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2195 reason: error at write: Disconnected sessionId: src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0
2025-10-01T14:14:16.078951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256463237513118:11539]
2025-10-01T14:14:16.079225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:16.079233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0] Write session will restart in 0.005376s
2025-10-01T14:14:16.079250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0] Write session: Do CDS request
2025-10-01T14:14:16.079255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:16.079273Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:16.079114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2195 sessionId: src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0 is DEAD
2025-10-01T14:14:16.085747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.085846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:16.085860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2196
2025-10-01T14:14:16.085956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.085991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:16.085996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:16.085999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:16.086405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2196 sessionId:  describe result for acl check
2025-10-01T14:14:16.086450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:16.086457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:16.086459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:16.086464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256467532480435:12103] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:16.086960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256467532480435:12103] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:16.089678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256467532480435:12103] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:16.093131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256467532480435:12103] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:16.093141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256467532480435:12103] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:16.093144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256467532480435:12103] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:16.093150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:16.098170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:16.100668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:16.100828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:16.100840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:16.100851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:16.100888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:16.100929Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256465155578908:11667]
2025-10-01T14:14:16.101594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:16.101819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:16.101854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:16.102164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:16.102215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.102221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.102222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.102224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.102225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.102226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.102228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.102229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.102230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.102231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.102233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.102234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.102235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.102236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.102241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.102252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.102260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.102269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.102277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.102282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.102290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.102298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.102302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.102311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.102319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.102324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.102332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.102336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.102342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.102353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.102364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.102398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.102407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.102412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.102418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.102428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.102433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.102443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.102447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.102452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.102459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.102464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.102470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.102475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.102484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.102490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.102494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.102499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.102508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.102513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.102518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.102527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.102532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.102538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.102546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.102552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.102593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:16.106430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:16.107266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:16.107280Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:16.107282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:16.107285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:16.107292Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2195 [2:7556256465155578908:11667]
2025-10-01T14:14:16.107307Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:16.107322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:16.107329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.107333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.107335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.107351Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:16.107361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:16.107371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:16.107422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.107429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.107431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.107435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:16.107442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:16.107504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:16.107511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.107522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.107539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.107561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:16.107584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532480417:2446], now have 1 active actors on pipe
2025-10-01T14:14:16.107592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532480589:12103], now have 1 active actors on pipe
2025-10-01T14:14:16.107599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256465155578903:11667]
2025-10-01T14:14:16.107601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256465155578903:11667]
2025-10-01T14:14:16.107603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256465155578903:11667]
2025-10-01T14:14:16.107615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:16.107626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:16.107630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:16.107632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:16.107636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:16.107628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2195
2025-10-01T14:14:16.107651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:16.107654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:16.107657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2195
2025-10-01T14:14:16.107677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256465155578903:11667]
2025-10-01T14:14:16.107680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:16.107682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:16.107699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.107707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.107754Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:16.107765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.107769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.107771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:16.107780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.107792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:16.107812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.107963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.107972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.107985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.108056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2196 partition: 0 MaxSeqNo: 45 sessionId: src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0
2025-10-01T14:14:16.108377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c13833a-62be1da6-a9efb16f-d8f98ba6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:16.111270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0] Write session: try to update token
2025-10-01T14:14:16.111289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:16.125125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2196 sessionId: src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:16.127353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:16.129483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.129507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.129524Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:16.129528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:16.129530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:16.129532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:16.129537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256465155578903:11667]
2025-10-01T14:14:16.129541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256465155578903:11667]
2025-10-01T14:14:16.129544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256465155578903:11667]
2025-10-01T14:14:16.129589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:16.129589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:16.129594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:16.129597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:16.129598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.129600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:16.129716Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:16.141738Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:28606 } ]
2025-10-01T14:14:16.179250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256467532480705:11539]
2025-10-01T14:14:16.179548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2195, pipe: [1:7556256467532480705:11539]
2025-10-01T14:14:16.270167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:16.270754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:16.270808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532480705:11539], now have 1 active actors on pipe
2025-10-01T14:14:16.270881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:16.271020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256467532480705:11539]
2025-10-01T14:14:16.271046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:16.279113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:16.279125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:16.279143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2196 reason: error at write: Disconnected sessionId: src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0
2025-10-01T14:14:16.279256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2196 sessionId: src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0 is DEAD
2025-10-01T14:14:16.279367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:16.279376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0] Write session will restart in 0.005489s
2025-10-01T14:14:16.279395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0] Write session: Do CDS request
2025-10-01T14:14:16.279401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:16.285788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.285898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:16.285912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2197
2025-10-01T14:14:16.286018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.286047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:16.286054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:16.286059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:16.286427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2197 sessionId:  describe result for acl check
2025-10-01T14:14:16.286460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:16.286461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:16.286462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:16.286465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256467532480807:12107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:16.286930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256467532480807:12107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:16.289507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256467532480807:12107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:16.291885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256467532480807:12107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:16.291898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256467532480807:12107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:16.291901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256467532480807:12107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:16.291908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:16.292875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:16.295469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:16.295668Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:16.295678Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:16.295690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:16.295745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:16.295779Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256465155579190:11670]
2025-10-01T14:14:16.296278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:16.296555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:16.296596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:16.296785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:16.296820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.296824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.296825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.296825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.296826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.296827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.296828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.296828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.296829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.296830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.296830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.296831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.296831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.296832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.296835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.296841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.296843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.296846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.296848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.296850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.296852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.296853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.296856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.296858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.296860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.296862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.296864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.296867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.296871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.296877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.296880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.296883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.296886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.296888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.296891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.296893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.296896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.296899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.296901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.296904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.296907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.296909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.296911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.296914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.296916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.296919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.296921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.296924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.296926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.296929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.296931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.296934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.296936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.296939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.296941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.296943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.296963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:16.300342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:16.300946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:16.300959Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:16.300961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:16.300964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:16.300968Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2196 [2:7556256465155579190:11670]
2025-10-01T14:14:16.300978Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:16.300993Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:16.300998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.301000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.301001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.301012Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:16.301019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:16.301024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:16.301060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.301064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.301066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.301068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:16.301070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:16.301130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:16.301137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.301144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.301150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.301159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:16.301174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532480980:12107], now have 1 active actors on pipe
2025-10-01T14:14:16.301180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532480707:2446], now have 1 active actors on pipe
2025-10-01T14:14:16.301185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256465155579185:11670]
2025-10-01T14:14:16.301190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256465155579185:11670]
2025-10-01T14:14:16.301191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256465155579185:11670]
2025-10-01T14:14:16.301200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:16.301244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2196
2025-10-01T14:14:16.301214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:16.301217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:16.301219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:16.301272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2196
2025-10-01T14:14:16.301220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:16.301222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:16.301224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:16.301343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256465155579185:11670]
2025-10-01T14:14:16.301351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:16.301365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:16.301374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.301378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.301404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:16.301412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.301417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.301419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:16.301426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.301435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:16.301448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.301538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.301544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.301553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.301635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2197 partition: 0 MaxSeqNo: 45 sessionId: src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0
2025-10-01T14:14:16.301952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fa978f0-d20998ca-f040ff4a-d5048bc6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:16.304465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0] Write session: try to update token
2025-10-01T14:14:16.304478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:16.317306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2197 sessionId: src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:16.319660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:16.320493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.320515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.320531Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:16.320534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:16.320536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:16.320538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:16.320543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256465155579185:11670]
2025-10-01T14:14:16.320546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256465155579185:11670]
2025-10-01T14:14:16.320549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256465155579185:11670]
2025-10-01T14:14:16.320573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:16.320588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:16.320591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:16.320609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:16.320615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.320617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:16.320739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:16.371188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256467532480996:11539]
2025-10-01T14:14:16.371440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2196, pipe: [1:7556256467532480996:11539]
2025-10-01T14:14:16.455896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:16.456374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:16.456418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532480996:11539], now have 1 active actors on pipe
2025-10-01T14:14:16.456475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:16.456914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256467532480996:11539]
2025-10-01T14:14:16.456997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:16.465207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:16.465218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:16.465236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2197 reason: error at write: Disconnected sessionId: src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0
2025-10-01T14:14:16.465384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2197 sessionId: src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0 is DEAD
2025-10-01T14:14:16.465519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:16.465527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0] Write session will restart in 0.008993s
2025-10-01T14:14:16.465549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0] Write session: Do CDS request
2025-10-01T14:14:16.465558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:16.475830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.475926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:16.475938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2198
2025-10-01T14:14:16.476041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.476071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:16.476078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:16.476080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:16.476369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2198 sessionId:  describe result for acl check
2025-10-01T14:14:16.476394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:16.476398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:16.476399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:16.476402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256467532481243:12111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:16.476808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256467532481243:12111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:16.477113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:16.478648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256467532481243:12111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:16.479759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:16.479924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:16.479934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:16.479945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:16.479987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:16.480014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256465155579483:11673]
2025-10-01T14:14:16.480389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:16.480572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:16.480609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:16.480791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256467532481243:12111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:16.480801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256467532481243:12111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:16.480803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256467532481243:12111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:16.480808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:16.480788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:16.480820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.480821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.480821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.480822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.480823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.480823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.480824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.480824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.480825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.480826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.480826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.480827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.480827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.480828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.480831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.480837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.480840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.480842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.480844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.480846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.480848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.480850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.480852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.480854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.480856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.480858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.480860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.480862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.480866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.480871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.480875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.480877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.480879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.480882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.480885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.480887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.480890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.480892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.480894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.480897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.480899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.480902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.480904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.480906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.480908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.480911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.480913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.480916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.480918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.480922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.480924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.480926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.480928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.480931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.480933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.480936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.480955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:16.484212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:16.485114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:16.485129Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:16.485131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:16.485134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:16.485141Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2197 [2:7556256465155579483:11673]
2025-10-01T14:14:16.485156Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:16.485170Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:16.485178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.485181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.485183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.485199Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:16.485207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:16.485217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:16.485265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.485271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.485272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.485276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:16.485278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:16.485339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:16.485347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.485359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.485369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.485385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:16.485403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532481281:12111], now have 1 active actors on pipe
2025-10-01T14:14:16.485411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532481000:2446], now have 1 active actors on pipe
2025-10-01T14:14:16.485418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256465155579478:11673]
2025-10-01T14:14:16.485407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2197
2025-10-01T14:14:16.485424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256465155579478:11673]
2025-10-01T14:14:16.485426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256465155579478:11673]
2025-10-01T14:14:16.485435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:16.485441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:16.485443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:16.485439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2197
2025-10-01T14:14:16.485446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:16.485454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:16.485467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:16.485474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:16.485489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.485496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.485527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256465155579478:11673]
2025-10-01T14:14:16.485538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:16.485550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:16.485557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:16.485560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.485564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.485566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:16.485575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.485585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:16.485619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.485719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.485725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.485736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.485782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2198 partition: 0 MaxSeqNo: 45 sessionId: src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0
2025-10-01T14:14:16.486096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|229de207-25d7ec5a-a7240cb5-23e2528b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:16.488644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0] Write session: try to update token
2025-10-01T14:14:16.488661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:16.501764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2198 sessionId: src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:16.504245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:16.504893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.504919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.504941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:16.504945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:16.504948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:16.504950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:16.504959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256465155579478:11673]
2025-10-01T14:14:16.504965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256465155579478:11673]
2025-10-01T14:14:16.504972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256465155579478:11673]
2025-10-01T14:14:16.505009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:16.505019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:16.505022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:16.505033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:16.505040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.505042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:16.505154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:16.557085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256467532481295:11539]
2025-10-01T14:14:16.557312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2197, pipe: [1:7556256467532481295:11539]
2025-10-01T14:14:16.638786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:16.639148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:16.639200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532481295:11539], now have 1 active actors on pipe
2025-10-01T14:14:16.639277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:16.641209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:16.641251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256467532481295:11539]
2025-10-01T14:14:16.650582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:16.650599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:16.650621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2198 reason: error at write: Disconnected sessionId: src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0
2025-10-01T14:14:16.650803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2198 sessionId: src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0 is DEAD
2025-10-01T14:14:16.650888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:16.650896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0] Write session will restart in 0.005032s
2025-10-01T14:14:16.650921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0] Write session: Do CDS request
2025-10-01T14:14:16.650929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:16.656898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.656984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:16.656998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2199
2025-10-01T14:14:16.657141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.657181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:16.657190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:16.657194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:16.657562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2199 sessionId:  describe result for acl check
2025-10-01T14:14:16.657590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:16.657596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:16.657597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:16.657602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256467532481383:12122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:16.658093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256467532481383:12122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:16.661474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256467532481383:12122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:16.664258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256467532481383:12122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:16.664271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256467532481383:12122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:16.664272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256467532481383:12122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:16.664278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:16.665266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:16.667796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:16.668046Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:16.668053Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:16.668061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:16.668099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:16.668128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256465155579766:11675]
2025-10-01T14:14:16.668511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:16.668781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:16.668818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:16.669005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:16.669038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.669042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.669043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.669044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.669045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.669045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.669046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.669046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.669047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.669047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.669048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.669049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.669049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.669050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.669053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.669058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.669061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.669063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.669065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.669067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.669070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.669072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.669074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.669076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.669078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.669080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.669082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.669084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.669088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.669094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.669098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.669101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.669103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.669106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.669108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.669111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.669114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.669116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.669118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.669121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.669123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.669126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.669128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.669131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.669134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.669137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.669139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.669142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.669161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.669164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.669166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.669169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.669171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.669174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.669177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.669182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.669213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:16.672558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:16.673360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:16.673373Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:16.673375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:16.673378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:16.673384Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2198 [2:7556256465155579766:11675]
2025-10-01T14:14:16.673393Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:16.673406Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:16.673407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.673410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.673411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.673422Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:16.673429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:16.673434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:16.673475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.673480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.673482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.673485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:16.673487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:16.673538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:16.673546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.673556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.673566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.673578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:16.673602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532481308:2446], now have 1 active actors on pipe
2025-10-01T14:14:16.673610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532481588:12122], now have 1 active actors on pipe
2025-10-01T14:14:16.673617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256465155579761:11675]
2025-10-01T14:14:16.673619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256465155579761:11675]
2025-10-01T14:14:16.673621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256465155579761:11675]
2025-10-01T14:14:16.673636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:16.673647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:16.673627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2198
2025-10-01T14:14:16.673652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:16.673654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:16.673661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2198
2025-10-01T14:14:16.673656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:16.673666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:16.673669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:16.673695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256465155579761:11675]
2025-10-01T14:14:16.673703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:16.673716Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:16.673720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.673724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.673752Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:16.673764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.673771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.673773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:16.673780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.673792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:16.673811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.673929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.673935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.673948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.674036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2199 partition: 0 MaxSeqNo: 45 sessionId: src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0
2025-10-01T14:14:16.674349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e43a00e-1865efd9-f92ffa43-9e260e26_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:16.677202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0] Write session: try to update token
2025-10-01T14:14:16.677217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:16.691164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2199 sessionId: src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:16.693506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:16.693864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.693888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.693905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:16.693907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:16.693908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:16.693910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:16.693918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256465155579761:11675]
2025-10-01T14:14:16.693920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256465155579761:11675]
2025-10-01T14:14:16.693923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256465155579761:11675]
2025-10-01T14:14:16.693950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:16.693960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:16.693963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:16.693966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:16.693972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.693973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:16.694084Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:16.741416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256467532481624:11539]
2025-10-01T14:14:16.741623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2198, pipe: [1:7556256467532481624:11539]
2025-10-01T14:14:16.826528Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:16.826915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:16.826973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532481624:11539], now have 1 active actors on pipe
2025-10-01T14:14:16.827045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:16.827162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:16.827206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256467532481624:11539]
2025-10-01T14:14:16.837878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:16.837894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:16.837916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2199 reason: error at write: Disconnected sessionId: src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0
2025-10-01T14:14:16.838077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2199 sessionId: src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0 is DEAD
2025-10-01T14:14:16.838234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:16.838246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0] Write session will restart in 0.009377s
2025-10-01T14:14:16.838270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0] Write session: Do CDS request
2025-10-01T14:14:16.838279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:16.846564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:16.848892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.849023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:16.849038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2200
2025-10-01T14:14:16.849139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:16.849170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:16.849180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:16.849187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:16.849465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:16.849538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2200 sessionId:  describe result for acl check
2025-10-01T14:14:16.849565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:16.849568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:16.849570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:16.849575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256467532481874:12128] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:16.849618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:16.849626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:16.849633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:16.849669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:16.849697Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256465155580057:11680]
2025-10-01T14:14:16.850055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256467532481874:12128] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:16.850079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:16.850311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:16.850363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:16.850671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:16.850721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.850725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.850726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.850727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.850728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.850728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.850729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.850730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.850730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.850731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.850732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.850732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.850733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.850734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.850737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.850743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.850745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.850747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.850749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.850751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.850752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.850754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.850756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.850758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.850760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.850762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.850764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.850768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.850774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.850781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:16.850787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.850792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:16.850799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.850802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:16.850804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.850807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:16.850809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.850813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:16.850815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.850818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:16.850820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.850823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:16.850827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.850833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:16.850836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.850840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:16.850844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.850848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.850852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.850856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.850860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.850864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.850868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.850872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:16.850876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.850879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:16.850913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:16.851903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256467532481874:12128] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:16.854230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:16.854851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256467532481874:12128] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:16.854862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256467532481874:12128] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:16.854864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256467532481874:12128] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:16.854870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:16.855187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:16.855197Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:16.855199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:16.855201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:16.855207Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2199 [2:7556256465155580057:11680]
2025-10-01T14:14:16.855217Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:16.855228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:16.855230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.855232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.855233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.855244Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:16.855248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:16.855251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:16.855288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.855294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.855295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.855297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:16.855299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:16.855348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:16.855353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.855359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:16.855365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:16.855381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:16.855400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256465155580052:11680]
2025-10-01T14:14:16.855405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256465155580052:11680]
2025-10-01T14:14:16.855407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256465155580052:11680]
2025-10-01T14:14:16.855416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:16.855425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532481628:2446], now have 1 active actors on pipe
2025-10-01T14:14:16.855431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532481911:12128], now have 1 active actors on pipe
2025-10-01T14:14:16.855433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:16.855436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:16.855436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:16.855438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:16.855450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:16.855452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:16.855467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2199
2025-10-01T14:14:16.855471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2199
2025-10-01T14:14:16.855479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256465155580052:11680]
2025-10-01T14:14:16.855485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:16.855499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:16.855511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.855514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.855541Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:16.855551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:16.855555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:16.855561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:16.855566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:16.855572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:16.855586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.855701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.855707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.855716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:16.855780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2200 partition: 0 MaxSeqNo: 45 sessionId: src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0
2025-10-01T14:14:16.856073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f8eb2f3-45697d32-ab09e4f0-87396bbe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:16.858639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0] Write session: try to update token
2025-10-01T14:14:16.858650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:16.871578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2200 sessionId: src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:16.873737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:16.875085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:16.875111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:16.875132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:16.875135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:16.875137Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:16.875139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:16.875148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256465155580052:11680]
2025-10-01T14:14:16.875152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256465155580052:11680]
2025-10-01T14:14:16.875156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256465155580052:11680]
2025-10-01T14:14:16.875213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:16.875218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:16.875223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:16.875224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:16.875225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:16.875228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:16.875367Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:16.927280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256467532481919:11539]
2025-10-01T14:14:16.927540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2199, pipe: [1:7556256467532481919:11539]
2025-10-01T14:14:17.018071Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:17.018472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:17.018521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256467532481919:11539], now have 1 active actors on pipe
2025-10-01T14:14:17.018599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:17.018659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256467532481919:11539]
2025-10-01T14:14:17.018679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:17.027296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:17.027309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:17.027327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2200 reason: error at write: Disconnected sessionId: src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0
2025-10-01T14:14:17.027452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2200 sessionId: src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0 is DEAD
2025-10-01T14:14:17.027617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:17.027628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0] Write session will restart in 0.005143s
2025-10-01T14:14:17.027653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0] Write session: Do CDS request
2025-10-01T14:14:17.027661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:17.033862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.033913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:17.033928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2201
2025-10-01T14:14:17.034074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.034106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:17.034118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:17.034124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:17.034634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2201 sessionId:  describe result for acl check
2025-10-01T14:14:17.034667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:17.034672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:17.034674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:17.034679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256471827449322:12133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:17.035182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256471827449322:12133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:17.037908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256471827449322:12133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:17.040767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256471827449322:12133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:17.040779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256471827449322:12133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:17.040783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256471827449322:12133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:17.040790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:17.043641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:17.044076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:17.044315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:17.044326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:17.044337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:17.044391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:17.044429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256469450547668:11692]
2025-10-01T14:14:17.045026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:17.045289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:17.045326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:17.045623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:17.045673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.045678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.045680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.045681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.045682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.045683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.045684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.045685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.045687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.045688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.045689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.045690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.045691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.045692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.045697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.045708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.045712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.045716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.045720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.045724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.045728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.045732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.045736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.045744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.045748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.045752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.045759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.045765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.045776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.045787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.045797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.045802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.045810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.045816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.045824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.045834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.045842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.045851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.045855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.045864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.045872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.045877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.045884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.045895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.045903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.045909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.045917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.045922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.045927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.045936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.045944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.045953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.045962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.045971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.045979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.045987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.046028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:17.049591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:17.050185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:17.050200Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:17.050203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:17.050207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:17.050213Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2200 [2:7556256469450547668:11692]
2025-10-01T14:14:17.050227Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:17.050244Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:17.050251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.050255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.050257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.050271Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:17.050278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:17.050289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:17.050338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.050344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.050345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.050349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:17.050351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:17.050441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:17.050448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.050459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.050470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.050491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:17.050514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827449498:12133], now have 1 active actors on pipe
2025-10-01T14:14:17.050521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827449222:2446], now have 1 active actors on pipe
2025-10-01T14:14:17.050528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256469450547663:11692]
2025-10-01T14:14:17.050534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256469450547663:11692]
2025-10-01T14:14:17.050536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256469450547663:11692]
2025-10-01T14:14:17.050551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:17.050565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:17.050567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:17.050573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:17.050575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:17.050583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:17.050586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:17.050610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256469450547663:11692]
2025-10-01T14:14:17.050582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2200
2025-10-01T14:14:17.050620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:17.050591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2200
2025-10-01T14:14:17.050639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:17.050943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.050956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.050980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:17.050986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.050990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.050992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:17.051001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.051010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:17.051026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.051195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.051202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.051215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.051291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2201 partition: 0 MaxSeqNo: 45 sessionId: src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0
2025-10-01T14:14:17.051666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ec5fb3-e9edbb10-d709db90-abf93af6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:17.054461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0] Write session: try to update token
2025-10-01T14:14:17.054477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:17.067152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2201 sessionId: src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:17.069275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:17.070242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.070267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.070287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:17.070289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:17.070291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:17.070292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:17.070298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256469450547663:11692]
2025-10-01T14:14:17.070301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256469450547663:11692]
2025-10-01T14:14:17.070304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256469450547663:11692]
2025-10-01T14:14:17.070332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:17.070342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:17.070344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:17.070347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:17.070351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.070353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:17.070487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:17.119060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256471827449511:11539]
2025-10-01T14:14:17.119309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2200, pipe: [1:7556256471827449511:11539]
2025-10-01T14:14:17.202990Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:17.203371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:17.203417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827449511:11539], now have 1 active actors on pipe
2025-10-01T14:14:17.203515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:17.203629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256471827449511:11539]
2025-10-01T14:14:17.203653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:17.203683Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:14:17.203864Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 22 consumer shared/user session shared/user_1_22_17597359489047689163_v1 is DEAD
2025-10-01T14:14:17.203970Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:14:17.203990Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256385928078159:11532] disconnected; active server actors: 1
2025-10-01T14:14:17.203998Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256385928078159:11532] client user disconnected session shared/user_1_22_17597359489047689163_v1
2025-10-01T14:14:17.204075Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:14:17.204083Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:14:17.204090Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.006935s
2025-10-01T14:14:17.211737Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:14:17.211959Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:14:17.211973Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 23
2025-10-01T14:14:17.212085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:17.212096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:17.212116Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 23 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:14:17.212118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2201 reason: error at write: Disconnected sessionId: src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0
2025-10-01T14:14:17.212164Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:14:17.212192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2201 sessionId: src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0 is DEAD
2025-10-01T14:14:17.212249Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 auth for : user
2025-10-01T14:14:17.212321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:17.212331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0] Write session will restart in 0.007172s
2025-10-01T14:14:17.212356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0] Write session: Do CDS request
2025-10-01T14:14:17.212361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:17.212377Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 Handle describe topics response
2025-10-01T14:14:17.212404Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 auth is DEAD
2025-10-01T14:14:17.212415Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:14:17.212652Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:14:17.212735Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_23_3754908952350609415_v1
2025-10-01T14:14:17.212746Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256471827449542:12139] connected; active server actors: 1
2025-10-01T14:14:17.212763Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256471827449542:12139] session shared/user_1_23_3754908952350609415_v1
2025-10-01T14:14:17.212772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:14:17.212783Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:14:17.212788Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_23_3754908952350609415_v1" (Sender=[1:7556256471827449539:12139], Pipe=[1:7556256471827449542:12139], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:14:17.212790Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:14:17.212799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:14:17.212806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_23_3754908952350609415_v1" (Sender=[1:7556256471827449539:12139], Pipe=[1:7556256471827449542:12139], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:14:17.212813Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_23_3754908952350609415_v1" sender [1:7556256471827449539:12139] lock partition 0 for ReadingSession "shared/user_1_23_3754908952350609415_v1" (Sender=[1:7556256471827449539:12139], Pipe=[1:7556256471827449542:12139], Partitions=[], ActiveFamilyCount=1) generation 1 step 23
2025-10-01T14:14:17.212825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:14:17.212829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000028s
2025-10-01T14:14:17.213039Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 23 Session: "shared/user_1_23_3754908952350609415_v1" ClientId: "user" PipeClient { RawX1: 7556256471827449542 RawX2: 4503603922349931 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:14:17.213061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:14:17.220854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.220920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:17.220933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2202
2025-10-01T14:14:17.221023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.221047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:17.221054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:17.221057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:17.221380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2202 sessionId:  describe result for acl check
2025-10-01T14:14:17.221405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:17.221409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:17.221410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:17.221414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256471827449675:12143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:17.221806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256471827449675:12143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:17.224051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256471827449675:12143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:17.225393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:17.227886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:17.228074Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:17.228084Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:17.228095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:17.228140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:17.228177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256469450547957:11695]
2025-10-01T14:14:17.228182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256471827449675:12143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:17.228205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256471827449675:12143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:17.228208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256471827449675:12143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:17.228216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:17.228769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:17.229031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:17.229068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:17.229352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:17.229402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.229410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.229411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.229412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.229413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.229414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.229415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.229416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.229417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.229418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.229419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.229420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.229422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.229423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.229427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.229437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.229441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.229445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.229449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.229453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.229457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.229461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.229465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.229469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.229473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.229478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.229482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.229486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.229493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.229502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.229507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.229513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.229516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.229522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.229527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.229532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.229536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.229542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.229547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.229557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.229561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.229571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.229576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.229585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.229589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.229598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.229602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.229611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.229616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.229624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.229628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.229633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.229641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.229647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.229655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.229660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.229703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:17.233133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:17.233910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:17.233926Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:17.233928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:17.233931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:17.233938Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2201 [2:7556256469450547957:11695]
2025-10-01T14:14:17.233953Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:17.233968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:17.233976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.233979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.233981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.233996Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:17.234005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:17.234010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:17.234056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.234063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.234065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.234068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:17.234070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:17.234132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:17.234138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.234150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.234162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.234180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:17.234204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827449806:12143], now have 1 active actors on pipe
2025-10-01T14:14:17.234207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827449545:12142], now have 1 active actors on pipe
2025-10-01T14:14:17.234210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827449517:2446], now have 1 active actors on pipe
2025-10-01T14:14:17.234218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256469450547952:11695]
2025-10-01T14:14:17.234220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256469450547952:11695]
2025-10-01T14:14:17.234222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256469450547952:11695]
2025-10-01T14:14:17.234235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:17.234249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:17.234248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:17.234251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:17.234253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:17.234266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:17.234269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:17.234255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2201, pipe: [1:7556256471827449545:12142]
2025-10-01T14:14:17.234286Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2201
2025-10-01T14:14:17.234304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.234313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.234325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_23_3754908952350609415_v1 on pipe: [1:7556256471827449545:12142]
2025-10-01T14:14:17.234343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256469450547952:11695]
2025-10-01T14:14:17.234354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:17.234360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:17.234381Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2201
2025-10-01T14:14:17.234396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.234406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.234409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:17.234427Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_23_3754908952350609415_v1
2025-10-01T14:14:17.234435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.234436Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_23_3754908952350609415_v1:1 with generation 2201
2025-10-01T14:14:17.234470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.234477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.234485Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:14:17.234513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:17.234522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2245: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-10-01T14:14:17.238834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:14:17.238871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:14:17.238880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.238886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.238894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:17.238905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.238920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:17.238932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:14:17.238948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:14:17.238968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.239072Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759328057233 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:14:17.239088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:14:17.239119Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 sending to client partition status
2025-10-01T14:14:17.239177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.239190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.239209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.239277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2202 partition: 0 MaxSeqNo: 45 sessionId: src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0
2025-10-01T14:14:17.239555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|887665ab-2cfe3d31-4c83e824-f4ca83cd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:17.242490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0] Write session: try to update token
2025-10-01T14:14:17.242506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:17.255620Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:17.255646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:17.255648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:17.255650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:17.255660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256469450547952:11695]
2025-10-01T14:14:17.255665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256469450547952:11695]
2025-10-01T14:14:17.255670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256469450547952:11695]
2025-10-01T14:14:17.255724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:17.255725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:17.255731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:17.255731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.255733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:17.255734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:17.255871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:17.258990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2202 sessionId: src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:17.261459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:17.410575Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:17.410859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.410875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.411136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_23_3754908952350609415_v1
2025-10-01T14:14:17.411113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:17.411124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:17.411157Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:17.411174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2202 reason: error at write: Disconnected sessionId: src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0
2025-10-01T14:14:17.411175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:17.411173Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_23_3754908952350609415_v1
2025-10-01T14:14:17.411235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256471827449545:12142]
2025-10-01T14:14:17.411312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2202 sessionId: src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0 is DEAD
2025-10-01T14:14:17.411464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:17.411478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0] Write session will restart in 0.009861s
2025-10-01T14:14:17.411505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0] Write session: Do CDS request
2025-10-01T14:14:17.411510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:17.422878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.422956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:17.422971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2203
2025-10-01T14:14:17.423153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.423197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:17.423208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:17.423212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:17.423835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2203 sessionId:  describe result for acl check
2025-10-01T14:14:17.423869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:17.423874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:17.423876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:17.423881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256471827449942:12147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:17.424435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256471827449942:12147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:17.426323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256471827449942:12147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:17.428622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256471827449942:12147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:17.428635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256471827449942:12147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:17.428638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256471827449942:12147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:17.428645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:17.431784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:17.432252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:17.432430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:17.432441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:17.432452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:17.432505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:17.432545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256469450548246:11697]
2025-10-01T14:14:17.433130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:17.433405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:17.433452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:17.433749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:17.433809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.433816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.433817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.433818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.433819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.433820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.433821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.433822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.433824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.433825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.433826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.433827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.433828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.433829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.433834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.433844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.433847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.433852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.433855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.433859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.433863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.433867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.433871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.433876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.433883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.433887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.433891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.433895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.433905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.433916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.433926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.433935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.433942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.433952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.433960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.433969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.433977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.433986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.433994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.433999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.434008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.434013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.434022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.434030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.434034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.434044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.434052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.434062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.434071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.434080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.434087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.434092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.434100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.434108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.434116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.434126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.434171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:17.437918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:17.438768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:17.438786Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:17.438788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:17.438793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:17.438800Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2202 [2:7556256469450548246:11697]
2025-10-01T14:14:17.438815Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:17.438832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:17.438840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.438843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.438845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.438861Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:17.438871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:17.438877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:17.438940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.438946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.438948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.438951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:17.438954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:17.439159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2202
2025-10-01T14:14:17.439161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2202
2025-10-01T14:14:17.439432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:17.439445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.439460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.439477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.439500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:17.439526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827449820:2446], now have 1 active actors on pipe
2025-10-01T14:14:17.439535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450101:12147], now have 1 active actors on pipe
2025-10-01T14:14:17.439554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.439562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.439579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256469450548241:11697]
2025-10-01T14:14:17.439585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256469450548241:11697]
2025-10-01T14:14:17.439588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256469450548241:11697]
2025-10-01T14:14:17.439602Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:17.439615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:17.439622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:17.439623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:17.439625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:17.439636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:17.439640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:17.439657Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9280da95-29a82993-1517d25b-4f27cb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:17.439668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.439672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.439678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:17.439687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.439696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:17.439740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256469450548241:11697]
2025-10-01T14:14:17.439752Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:17.439760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:17.439764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.439923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.439935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.439951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.440040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2203 partition: 0 MaxSeqNo: 45 sessionId: src_id|9280da95-29a82993-1517d25b-4f27cb3_0
2025-10-01T14:14:17.440370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eaed3f45-496ea9ae-1f53cd47-4c4fe817_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9280da95-29a82993-1517d25b-4f27cb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:17.443048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9280da95-29a82993-1517d25b-4f27cb3_0] Write session: try to update token
2025-10-01T14:14:17.443064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9280da95-29a82993-1517d25b-4f27cb3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:17.456972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2203 sessionId: src_id|9280da95-29a82993-1517d25b-4f27cb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:17.459367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:17.459986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.460011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.460029Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:17.460036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:17.460038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:17.460039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:17.460045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256469450548241:11697]
2025-10-01T14:14:17.460048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256469450548241:11697]
2025-10-01T14:14:17.460051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256469450548241:11697]
2025-10-01T14:14:17.460095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:17.460103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:17.460106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.460108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:17.460108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:17.460111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:17.460225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:17.511491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256471827450118:12142]
2025-10-01T14:14:17.511867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2202, pipe: [1:7556256471827450118:12142]
2025-10-01T14:14:17.594199Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:17.594457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:17.594502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450118:12142], now have 1 active actors on pipe
2025-10-01T14:14:17.594576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:17.594702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256471827450118:12142]
2025-10-01T14:14:17.594732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:17.605035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:17.605047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:17.605068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2203 reason: error at write: Disconnected sessionId: src_id|9280da95-29a82993-1517d25b-4f27cb3_0
2025-10-01T14:14:17.605204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2203 sessionId: src_id|9280da95-29a82993-1517d25b-4f27cb3_0 is DEAD
2025-10-01T14:14:17.605335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9280da95-29a82993-1517d25b-4f27cb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:17.605342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9280da95-29a82993-1517d25b-4f27cb3_0] Write session will restart in 0.009947s
2025-10-01T14:14:17.605360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9280da95-29a82993-1517d25b-4f27cb3_0] Write session: Do CDS request
2025-10-01T14:14:17.605366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9280da95-29a82993-1517d25b-4f27cb3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:17.616912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9280da95-29a82993-1517d25b-4f27cb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.616943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:17.616957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2204
2025-10-01T14:14:17.617130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.617162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:17.617171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:17.617174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:17.617671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2204 sessionId:  describe result for acl check
2025-10-01T14:14:17.617709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:17.617716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:17.617717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:17.617723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256471827450352:12152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:17.618264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256471827450352:12152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:17.620150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:17.620542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256471827450352:12152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:17.622941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:17.623139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:17.623147Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:17.623158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:17.623197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:17.623232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256469450548544:11700]
2025-10-01T14:14:17.623244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256471827450352:12152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:17.623256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256471827450352:12152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:17.623260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256471827450352:12152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:17.623267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:17.623783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:17.624047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:17.624084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:17.624356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:17.624402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.624407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.624408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.624409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.624411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.624412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.624412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.624413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.624414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.624415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.624416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.624417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.624418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.624419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.624423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.624432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.624435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.624438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.624441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.624445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.624448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.624450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.624454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.624457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.624460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.624462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.624465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.624468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.624474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.624481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.624490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.624498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.624506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.624510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.624517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.624521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.624526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.624529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.624537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.624541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.624545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.624550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.624554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.624558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.624564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.624571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.624587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.624594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.624598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.624606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.624609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.624616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.624620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.624627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.624634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.624638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.624667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:17.628214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:17.629183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:17.629199Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:17.629201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:17.629204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:17.629210Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2203 [2:7556256469450548544:11700]
2025-10-01T14:14:17.629224Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:17.629245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:17.629253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.629256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.629258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.629272Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:17.629277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:17.629283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:17.629342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.629348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.629350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.629352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:17.629354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:17.629419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:17.629425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.629434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.629446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.629463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:17.629484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450125:2446], now have 1 active actors on pipe
2025-10-01T14:14:17.629490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450408:12152], now have 1 active actors on pipe
2025-10-01T14:14:17.629498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256469450548539:11700]
2025-10-01T14:14:17.629504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256469450548539:11700]
2025-10-01T14:14:17.629506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256469450548539:11700]
2025-10-01T14:14:17.629518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:17.629530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:17.629536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:17.629540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:17.629542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:17.629549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:17.629555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:17.629567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2203
2025-10-01T14:14:17.629568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2203
2025-10-01T14:14:17.629581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256469450548539:11700]
2025-10-01T14:14:17.629590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:17.629598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:17.629624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.629633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.629664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc548a86-588085ac-222d9219-25c86eb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:17.629674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.629679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.629681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:17.629689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.629700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:17.629715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.629834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.629841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.629853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.629912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2204 partition: 0 MaxSeqNo: 45 sessionId: src_id|fc548a86-588085ac-222d9219-25c86eb1_0
2025-10-01T14:14:17.630319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9280da95-29a82993-1517d25b-4f27cb3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fc548a86-588085ac-222d9219-25c86eb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:17.633075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc548a86-588085ac-222d9219-25c86eb1_0] Write session: try to update token
2025-10-01T14:14:17.633091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc548a86-588085ac-222d9219-25c86eb1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:17.646042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2204 sessionId: src_id|fc548a86-588085ac-222d9219-25c86eb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:17.648431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:17.649480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.649508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.649529Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:17.649531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:17.649534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:17.649536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:17.649544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256469450548539:11700]
2025-10-01T14:14:17.649548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256469450548539:11700]
2025-10-01T14:14:17.649552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256469450548539:11700]
2025-10-01T14:14:17.649592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:17.649604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:17.649605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:17.649609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:17.649611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.649613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:17.649751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:17.694782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256471827450434:12142]
2025-10-01T14:14:17.695028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2203, pipe: [1:7556256471827450434:12142]
2025-10-01T14:14:17.790847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:17.791139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:17.791194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450434:12142], now have 1 active actors on pipe
2025-10-01T14:14:17.791303Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:17.791349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:17.791378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:17.791384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:17.791403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256471827450434:12142]
2025-10-01T14:14:17.791440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2204 reason: error at write: Disconnected sessionId: src_id|fc548a86-588085ac-222d9219-25c86eb1_0
2025-10-01T14:14:17.791565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2204 sessionId: src_id|fc548a86-588085ac-222d9219-25c86eb1_0 is DEAD
2025-10-01T14:14:17.791717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc548a86-588085ac-222d9219-25c86eb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:17.791728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc548a86-588085ac-222d9219-25c86eb1_0] Write session will restart in 0.007542s
2025-10-01T14:14:17.791748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc548a86-588085ac-222d9219-25c86eb1_0] Write session: Do CDS request
2025-10-01T14:14:17.791755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc548a86-588085ac-222d9219-25c86eb1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:17.800827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc548a86-588085ac-222d9219-25c86eb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.800939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:17.800952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2205
2025-10-01T14:14:17.801040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.801063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:17.801070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:17.801072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:17.801453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2205 sessionId:  describe result for acl check
2025-10-01T14:14:17.801474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:17.801479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:17.801480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:17.801484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256471827450498:12164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:17.801835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256471827450498:12164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:17.804382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256471827450498:12164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:17.807322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256471827450498:12164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:17.807336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256471827450498:12164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:17.807342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256471827450498:12164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:17.807350Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:17.811398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:17.814065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:17.814314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:17.814324Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:17.814336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:17.814399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:17.814448Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256469450548842:11705]
2025-10-01T14:14:17.815035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:17.815335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:17.815376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:17.815590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:17.815628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.815633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.815633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.815634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.815635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.815636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.815637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.815637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.815638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.815639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.815640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.815640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.815641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.815641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.815645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.815651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.815654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.815656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.815658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.815660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.815663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.815665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.815667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.815671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.815673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.815675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.815678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.815680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.815685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.815689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:17.815693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.815696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:17.815700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.815705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:17.815709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.815714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:17.815719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.815729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:17.815736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.815739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:17.815742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.815748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:17.815751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.815754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:17.815759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.815762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:17.815765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.815772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.815777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.815783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.815786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.815789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.815795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.815798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:17.815800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.815803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:17.815842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:17.819513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:17.820488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:17.820503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:17.820505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:17.820510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:17.820516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2204 [2:7556256469450548842:11705]
2025-10-01T14:14:17.820532Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:17.820545Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:17.820547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.820549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.820550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.820563Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:17.820572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:17.820587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:17.820638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.820644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.820646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.820648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:17.820650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:17.820705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:17.820712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.820724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:17.820739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:17.820754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:17.820769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450656:12164], now have 1 active actors on pipe
2025-10-01T14:14:17.820777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450457:2446], now have 1 active actors on pipe
2025-10-01T14:14:17.820783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256469450548837:11705]
2025-10-01T14:14:17.820785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256469450548837:11705]
2025-10-01T14:14:17.820786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256469450548837:11705]
2025-10-01T14:14:17.820796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:17.820805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:17.820813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:17.820815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:17.820820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:17.820823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:17.820826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:17.820842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256469450548837:11705]
2025-10-01T14:14:17.820848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:17.820864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:17.820848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2204
2025-10-01T14:14:17.820852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2204
2025-10-01T14:14:17.821073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.821085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.821122Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:17.821133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:17.821137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:17.821143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:17.821152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:17.821164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:17.821179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.821315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.821322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.821334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:17.821406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2205 partition: 0 MaxSeqNo: 45 sessionId: src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0
2025-10-01T14:14:17.821736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc548a86-588085ac-222d9219-25c86eb1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:17.824450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0] Write session: try to update token
2025-10-01T14:14:17.824466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:17.837744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2205 sessionId: src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:17.840257Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:17.840644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:17.840674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:17.840696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:17.840699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:17.840702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:17.840704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:17.840713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256469450548837:11705]
2025-10-01T14:14:17.840718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256469450548837:11705]
2025-10-01T14:14:17.840722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256469450548837:11705]
2025-10-01T14:14:17.840763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:17.840779Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:17.840782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:17.840787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:17.840788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:17.840791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:17.840924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:17.891352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256471827450754:12142]
2025-10-01T14:14:17.891616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2204, pipe: [1:7556256471827450754:12142]
2025-10-01T14:14:17.979506Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:17.979761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:17.979815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450754:12142], now have 1 active actors on pipe
2025-10-01T14:14:17.979942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:17.979962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256471827450754:12142]
2025-10-01T14:14:17.979982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:17.980034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:17.980042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:17.980109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2205 reason: error at write: Disconnected sessionId: src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0
2025-10-01T14:14:17.980271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2205 sessionId: src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0 is DEAD
2025-10-01T14:14:17.980398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:17.980409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0] Write session will restart in 0.007503s
2025-10-01T14:14:17.980435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0] Write session: Do CDS request
2025-10-01T14:14:17.980444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:17.988933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.989058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:17.989071Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2206
2025-10-01T14:14:17.989199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:17.989229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:17.989236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:17.989243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:17.989638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2206 sessionId:  describe result for acl check
2025-10-01T14:14:17.989673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:17.989679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:17.989681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:17.989687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256471827450796:12169] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:17.990186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256471827450796:12169] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:17.993025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256471827450796:12169] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:17.996944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256471827450796:12169] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:17.996957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256471827450796:12169] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:17.996962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256471827450796:12169] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:17.996970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:18.000326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:18.003122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:18.003320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:18.003335Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:18.003349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:18.003397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:18.003431Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256473745516440:11707]
2025-10-01T14:14:18.003848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:18.004163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:18.004213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:18.004546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:18.004629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.004636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.004638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.004639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.004640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.004642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.004643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.004645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.004646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.004647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.004648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.004650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.004651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.004652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.004658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.004669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.004673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.004676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.004680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.004684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.004688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.004691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.004696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.004700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.004708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.004711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.004716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.004724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.004732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.004745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.004757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.004766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.004771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.004782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.004786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.004791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.004795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.004800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.004805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.004810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.004820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.004825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.004834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.004839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.004848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.004852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.004857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.004866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.004875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.004886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.004893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.004898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.004902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.004912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.004916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.004926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.004968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:18.008867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:18.009529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:18.009545Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:18.009547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:18.009550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:18.009555Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2205 [2:7556256473745516440:11707]
2025-10-01T14:14:18.009567Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:18.009579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:18.009585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.009588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.009589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.009600Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:18.009604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:18.009609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:18.009656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.009661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.009662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.009664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:18.009666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:18.009717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:18.009722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.009730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.009740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.009752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:18.009765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450991:12169], now have 1 active actors on pipe
2025-10-01T14:14:18.009768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256471827450761:2446], now have 1 active actors on pipe
2025-10-01T14:14:18.009774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256469450549139:11707]
2025-10-01T14:14:18.009775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256469450549139:11707]
2025-10-01T14:14:18.009777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256469450549139:11707]
2025-10-01T14:14:18.009787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:18.009796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:18.009805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:18.009807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:18.009814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:18.009818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:18.009820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:18.009833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256469450549139:11707]
2025-10-01T14:14:18.009834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:18.009837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:18.009873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2205
2025-10-01T14:14:18.009878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2205
2025-10-01T14:14:18.009984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.009994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.010017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7a2e047-75ca902-98541b33-b263ca51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:18.010031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.010035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.010037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:18.010045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.010053Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:18.010070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.010196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.010203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.010218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.010303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2206 partition: 0 MaxSeqNo: 45 sessionId: src_id|d7a2e047-75ca902-98541b33-b263ca51_0
2025-10-01T14:14:18.010652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8f6cf9ec-e4f90c0f-2f193325-967366cd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d7a2e047-75ca902-98541b33-b263ca51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:18.013479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a2e047-75ca902-98541b33-b263ca51_0] Write session: try to update token
2025-10-01T14:14:18.013494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a2e047-75ca902-98541b33-b263ca51_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:18.026615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:18.026634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:18.026642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256469450549139:11707]
2025-10-01T14:14:18.026682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:18.026690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:18.026839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:18.026970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:18.027108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:18.027233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:18.027855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:18.027905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:18.028790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2206 sessionId: src_id|d7a2e047-75ca902-98541b33-b263ca51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:18.031295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:18.031972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.031989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.032025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:18.032125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:18.040749Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:18.040769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:18.040771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:18.040774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:18.040787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256469450549139:11707]
2025-10-01T14:14:18.040791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256469450549139:11707]
2025-10-01T14:14:18.040796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256469450549139:11707]
2025-10-01T14:14:18.040839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:18.040843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:18.040851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:18.040851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.040854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:18.040855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:18.040997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:18.080295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256476122418351:12142]
2025-10-01T14:14:18.080553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2205, pipe: [1:7556256476122418351:12142]
2025-10-01T14:14:18.192633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:18.199720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.199749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.199907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.199973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.200037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.200092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.200140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.200148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.200208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.200264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.200332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.200400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.200455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.200461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.200534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.200605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.200665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.200729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.200771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.200777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.200842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.200922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.200998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.201058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.201103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.201109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.201170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.201231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.201290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.201352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.201395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.201400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.201460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.201521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.201583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.201645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.201687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.201692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.201753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.201812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.201879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.201957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.202006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.202012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.202081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.202141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.202204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.202268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.202312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.202318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.202403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.202479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.202560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.202639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.202683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.202689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.202757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.202816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.202875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.202959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.203012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.203019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.203092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122418351:12142], now have 1 active actors on pipe
2025-10-01T14:14:18.203413Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256476122418351:12142]
2025-10-01T14:14:18.203414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:18.203419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:18.203452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2206 reason: error at write: Disconnected sessionId: src_id|d7a2e047-75ca902-98541b33-b263ca51_0
2025-10-01T14:14:18.203455Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:18.203698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2206 sessionId: src_id|d7a2e047-75ca902-98541b33-b263ca51_0 is DEAD
2025-10-01T14:14:18.203787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a2e047-75ca902-98541b33-b263ca51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:18.203799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a2e047-75ca902-98541b33-b263ca51_0] Write session will restart in 0.009951s
2025-10-01T14:14:18.203825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a2e047-75ca902-98541b33-b263ca51_0] Write session: Do CDS request
2025-10-01T14:14:18.203831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a2e047-75ca902-98541b33-b263ca51_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:18.204251Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:18.214848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a2e047-75ca902-98541b33-b263ca51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.214933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:18.214947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2207
2025-10-01T14:14:18.215079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.215112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:18.215123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:18.215131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:18.215545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2207 sessionId:  describe result for acl check
2025-10-01T14:14:18.215585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:18.215592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:18.215594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:18.215600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256476122418441:12173] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:18.216146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256476122418441:12173] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:18.219637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256476122418441:12173] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:18.223454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256476122418441:12173] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:18.223466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256476122418441:12173] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:18.223468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256476122418441:12173] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:18.223474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:18.223659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:18.226408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:18.226620Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:18.226631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:18.226642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:18.226691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:18.226734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256473745516750:11720]
2025-10-01T14:14:18.227347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:18.227674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:18.227742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:18.228200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:18.228281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.228288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.228289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.228290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.228292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.228293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.228294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.228296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.228297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.228298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.228300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.228301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.228303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.228304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.228310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.228322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.228327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.228331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.228335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.228339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.228342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.228351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.228355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.228364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.228370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.228377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.228381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.228388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.228396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.228408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.228419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.228428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.228433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.228442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.228446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.228452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.228460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.228465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.228473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.228479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.228484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.228493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.228501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.228508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.228521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.228531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.228539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.228548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.228559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.228569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.228589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.228599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.228608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.228617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.228624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.228629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.228672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:18.232471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:18.233091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:18.233106Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:18.233108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:18.233111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:18.233116Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2206 [2:7556256473745516750:11720]
2025-10-01T14:14:18.233128Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:18.233141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:18.233144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.233146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.233148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.233161Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:18.233165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:18.233171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:18.233214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.233219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.233221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.233224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:18.233226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:18.233282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:18.233288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.233296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.233306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.233319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:18.233335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122418644:12173], now have 1 active actors on pipe
2025-10-01T14:14:18.233342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122418354:2446], now have 1 active actors on pipe
2025-10-01T14:14:18.233348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256473745516744:11720]
2025-10-01T14:14:18.233355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256473745516744:11720]
2025-10-01T14:14:18.233357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256473745516744:11720]
2025-10-01T14:14:18.233372Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:18.233386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:18.233390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:18.233392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:18.233392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:18.233401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:18.233403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:18.233409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2206
2025-10-01T14:14:18.233436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256473745516744:11720]
2025-10-01T14:14:18.233443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:18.233446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2206
2025-10-01T14:14:18.233446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:18.233468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.233477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.233513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:18.233522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.233526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.233528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:18.233536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.233544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:18.233564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.233703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.233711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.233724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.233826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2207 partition: 0 MaxSeqNo: 45 sessionId: src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0
2025-10-01T14:14:18.234140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7a2e047-75ca902-98541b33-b263ca51_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:18.237157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0] Write session: try to update token
2025-10-01T14:14:18.237179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:18.251588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2207 sessionId: src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:18.254087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:18.254266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:18.254282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:18.254284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:18.254285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:18.254292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256473745516744:11720]
2025-10-01T14:14:18.254297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256473745516744:11720]
2025-10-01T14:14:18.254300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256473745516744:11720]
2025-10-01T14:14:18.254345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:18.254349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.254350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:18.254355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:18.254366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.254414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:18.254426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.254428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:18.254553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:18.303516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256476122418656:12142]
2025-10-01T14:14:18.303822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2206, pipe: [1:7556256476122418656:12142]
2025-10-01T14:14:18.390261Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:18.390692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122418656:12142], now have 1 active actors on pipe
2025-10-01T14:14:18.390872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:18.390869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256476122418656:12142]
2025-10-01T14:14:18.390882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:18.390885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:18.390898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:18.390948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2207 reason: error at write: Disconnected sessionId: src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0
2025-10-01T14:14:18.391139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2207 sessionId: src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0 is DEAD
2025-10-01T14:14:18.391290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:18.391305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0] Write session will restart in 0.009032s
2025-10-01T14:14:18.391331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0] Write session: Do CDS request
2025-10-01T14:14:18.391339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:18.402008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.402070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:18.402086Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2208
2025-10-01T14:14:18.402198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.402230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:18.402240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:18.402256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:18.402627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2208 sessionId:  describe result for acl check
2025-10-01T14:14:18.402655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:18.402660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:18.402661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:18.402666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256476122418792:12177] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:18.403131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256476122418792:12177] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:18.405259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256476122418792:12177] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:18.407654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256476122418792:12177] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:18.407666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256476122418792:12177] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:18.407668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256476122418792:12177] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:18.407674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:18.407960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:18.410314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:18.410517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:18.410530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:18.410541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:18.410584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:18.410627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256473745517041:11722]
2025-10-01T14:14:18.411087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:18.411495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:18.411536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:18.411739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:18.411774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.411778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.411779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.411780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.411780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.411781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.411782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.411783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.411783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.411784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.411785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.411785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.411786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.411787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.411790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.411796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.411798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.411800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.411802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.411804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.411806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.411808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.411810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.411812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.411814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.411816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.411819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.411821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.411825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.411829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.411834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.411837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.411839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.411842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.411844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.411847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.411851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.411854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.411856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.411859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.411862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.411865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.411867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.411870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.411872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.411875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.411877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.411880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.411883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.411889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.411891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.411894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.411896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.411900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.411903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.411905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.411925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:18.415322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:18.415943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:18.415956Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:18.415959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:18.415963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:18.415969Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2207 [2:7556256473745517041:11722]
2025-10-01T14:14:18.415983Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:18.415999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:18.416005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.416007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.416008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.416019Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:18.416023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:18.416028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:18.416068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.416073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.416074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.416077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:18.416079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:18.416127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:18.416132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.416139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.416145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.416153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:18.416168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256473745517036:11722]
2025-10-01T14:14:18.416173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256473745517036:11722]
2025-10-01T14:14:18.416174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256473745517036:11722]
2025-10-01T14:14:18.416183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:18.416196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:18.416200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122418946:12177], now have 1 active actors on pipe
2025-10-01T14:14:18.416203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122418659:2446], now have 1 active actors on pipe
2025-10-01T14:14:18.416206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:18.416207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:18.416210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:18.416221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:18.416224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:18.416251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256473745517036:11722]
2025-10-01T14:14:18.416258Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:18.416264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:18.416238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2207
2025-10-01T14:14:18.416239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2207
2025-10-01T14:14:18.416284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.416292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.416313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|990188b9-842e3d86-976ba823-5a5197bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:18.416321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.416324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.416329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:18.416335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.416342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:18.416355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.416475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.416482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.416494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.416566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2208 partition: 0 MaxSeqNo: 45 sessionId: src_id|990188b9-842e3d86-976ba823-5a5197bd_0
2025-10-01T14:14:18.416895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|76a199d7-f28f69ed-bca32359-f40b8be7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|990188b9-842e3d86-976ba823-5a5197bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:18.419860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|990188b9-842e3d86-976ba823-5a5197bd_0] Write session: try to update token
2025-10-01T14:14:18.419877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|990188b9-842e3d86-976ba823-5a5197bd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:18.433835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2208 sessionId: src_id|990188b9-842e3d86-976ba823-5a5197bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:18.436179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:18.436878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.436902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.436919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:18.436922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:18.436923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:18.436925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:18.436930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256473745517036:11722]
2025-10-01T14:14:18.436933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256473745517036:11722]
2025-10-01T14:14:18.436937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256473745517036:11722]
2025-10-01T14:14:18.436967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:18.436978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:18.436980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:18.436990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:18.436995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.437001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:18.437116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:18.491078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256476122418961:12142]
2025-10-01T14:14:18.491306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2207, pipe: [1:7556256476122418961:12142]
2025-10-01T14:14:18.575950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:18.576245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:18.576300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122418961:12142], now have 1 active actors on pipe
2025-10-01T14:14:18.576364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:18.576506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:18.576569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256476122418961:12142]
2025-10-01T14:14:18.587279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:18.587292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:18.587315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2208 reason: error at write: Disconnected sessionId: src_id|990188b9-842e3d86-976ba823-5a5197bd_0
2025-10-01T14:14:18.587474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2208 sessionId: src_id|990188b9-842e3d86-976ba823-5a5197bd_0 is DEAD
2025-10-01T14:14:18.587552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990188b9-842e3d86-976ba823-5a5197bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:18.587564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990188b9-842e3d86-976ba823-5a5197bd_0] Write session will restart in 0.009989s
2025-10-01T14:14:18.587587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990188b9-842e3d86-976ba823-5a5197bd_0] Write session: Do CDS request
2025-10-01T14:14:18.587594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990188b9-842e3d86-976ba823-5a5197bd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:18.598804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|990188b9-842e3d86-976ba823-5a5197bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.598907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:18.598921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2209
2025-10-01T14:14:18.599039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.599072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:18.599092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:18.599102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:18.599441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2209 sessionId:  describe result for acl check
2025-10-01T14:14:18.599479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:18.599483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:18.599485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:18.599489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256476122419224:12182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:18.599856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256476122419224:12182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:18.599831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:18.601944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256476122419224:12182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:18.603447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:18.603629Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:18.603638Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:18.603649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:18.603711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:18.603749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256473745517344:11725]
2025-10-01T14:14:18.604229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256476122419224:12182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:18.604240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256476122419224:12182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:18.604249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:18.604244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256476122419224:12182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:18.604250Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:18.604467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:18.604508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:18.604744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:18.604795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.604801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.604802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.604803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.604804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.604806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.604807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.604808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.604810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.604811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.604812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.604813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.604813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.604815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.604819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.604829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.604834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.604838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.604842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.604846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.604849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.604854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.604857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.604861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.604866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.604870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.604874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.604878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.604884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.604892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.604899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.604905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.604910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.604915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.604920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.604926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.604936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.604941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.604950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.604955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.604967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.604975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.604984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.604990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.604998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.605003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.605011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.605017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.605025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.605030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.605037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.605043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.605050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.605056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.605064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.605069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.605105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:18.608613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:18.609539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:18.609551Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:18.609553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:18.609557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:18.609563Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2208 [2:7556256473745517344:11725]
2025-10-01T14:14:18.609578Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:18.609594Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:18.609600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.609604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.609606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.609626Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:18.609636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:18.609642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:18.609694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.609700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.609702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.609705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:18.609707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:18.609777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:18.609784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.609796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.609824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.609844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:18.609863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122419260:12182], now have 1 active actors on pipe
2025-10-01T14:14:18.609871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122418971:2446], now have 1 active actors on pipe
2025-10-01T14:14:18.609878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256473745517339:11725]
2025-10-01T14:14:18.609897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256473745517339:11725]
2025-10-01T14:14:18.609903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256473745517339:11725]
2025-10-01T14:14:18.609891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2208
2025-10-01T14:14:18.609897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2208
2025-10-01T14:14:18.609918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:18.609930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:18.609934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:18.609940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:18.609942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:18.609947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:18.609949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:18.609991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.610000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.610016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256473745517339:11725]
2025-10-01T14:14:18.610026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:18.610032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:18.610052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:18.610062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.610066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.610068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:18.610077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.610088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:18.610113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.610229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.610235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.610249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.610335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2209 partition: 0 MaxSeqNo: 45 sessionId: src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0
2025-10-01T14:14:18.610719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|990188b9-842e3d86-976ba823-5a5197bd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:18.613621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0] Write session: try to update token
2025-10-01T14:14:18.613641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:18.626834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2209 sessionId: src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:18.629093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:18.630167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.630190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.630210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:18.630213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:18.630216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:18.630218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:18.630227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256473745517339:11725]
2025-10-01T14:14:18.630231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256473745517339:11725]
2025-10-01T14:14:18.630235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256473745517339:11725]
2025-10-01T14:14:18.630269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:18.630280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:18.630283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:18.630284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:18.630290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.630292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:18.630426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:18.676805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256476122419272:12142]
2025-10-01T14:14:18.677027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2208, pipe: [1:7556256476122419272:12142]
2025-10-01T14:14:18.763677Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:18.764285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:18.764332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122419272:12142], now have 1 active actors on pipe
2025-10-01T14:14:18.764424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:18.764497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256476122419272:12142]
2025-10-01T14:14:18.764504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:18.764506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:18.764525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:18.764564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2209 reason: error at write: Disconnected sessionId: src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0
2025-10-01T14:14:18.764695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2209 sessionId: src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0 is DEAD
2025-10-01T14:14:18.764823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:18.764833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0] Write session will restart in 0.009224s
2025-10-01T14:14:18.764851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0] Write session: Do CDS request
2025-10-01T14:14:18.764858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:18.774804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.774893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:18.774910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2210
2025-10-01T14:14:18.775003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.775026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:18.775034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:18.775037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:18.775368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2210 sessionId:  describe result for acl check
2025-10-01T14:14:18.775394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:18.775395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:18.775396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:18.775400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256476122419391:12194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:18.775776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256476122419391:12194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:18.778675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256476122419391:12194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:18.781623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256476122419391:12194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:18.781638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256476122419391:12194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:18.781641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256476122419391:12194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:18.781649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:18.783127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:18.785607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:18.785808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:18.785820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:18.785846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:18.785894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:18.785935Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256473745517647:11730]
2025-10-01T14:14:18.786549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:18.786842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:18.786881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:18.787169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:18.787223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.787231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.787233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.787234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.787235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.787236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.787238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.787239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.787240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.787241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.787243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.787244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.787245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.787246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.787251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.787261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.787265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.787270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.787273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.787278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.787282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.787285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.787289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.787292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.787296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.787300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.787303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.787306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.787314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.787327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.787332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.787336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.787340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.787344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.787352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.787356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.787360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.787369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.787372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.787377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.787384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.787388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.787396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.787400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.787408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.787412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.787421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.787425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.787430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.787434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.787441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.787446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.787454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.787462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.787466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.787475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.787517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:18.791098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:18.792245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:18.792264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:18.792266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:18.792270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:18.792276Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2209 [2:7556256473745517647:11730]
2025-10-01T14:14:18.792291Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:18.792313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:18.792321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.792325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.792327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.792341Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:18.792350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:18.792360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:18.792417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.792424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.792425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.792428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:18.792431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:18.792492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:18.792501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.792514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.792525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.792542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:18.792563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122419594:12194], now have 1 active actors on pipe
2025-10-01T14:14:18.792571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122419310:2446], now have 1 active actors on pipe
2025-10-01T14:14:18.792592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256473745517642:11730]
2025-10-01T14:14:18.792599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256473745517642:11730]
2025-10-01T14:14:18.792601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256473745517642:11730]
2025-10-01T14:14:18.792613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:18.792623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:18.792629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:18.792630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:18.792631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:18.792644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:18.792651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:18.792677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256473745517642:11730]
2025-10-01T14:14:18.792689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:18.792711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:18.792714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2209
2025-10-01T14:14:18.793071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2209
2025-10-01T14:14:18.793125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.793139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.793162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:18.793174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.793178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.793185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:18.793195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.793208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:18.793226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.793352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.793360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.793374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.793438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2210 partition: 0 MaxSeqNo: 45 sessionId: src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0
2025-10-01T14:14:18.793769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|52741aa4-9a9829a0-ea9bce1-830ee248_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:18.796554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0] Write session: try to update token
2025-10-01T14:14:18.796586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:18.803118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:18.803141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:18.803151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256473745517642:11730]
2025-10-01T14:14:18.803185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:18.803198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:18.803368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:18.803505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:18.803640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:18.803773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:18.803955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:18.803999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:18.810786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2210 sessionId: src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:18.813388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:18.813586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.813605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.813638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:18.813707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:18.821203Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:18.821220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:18.821222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:18.821223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:18.821232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256473745517642:11730]
2025-10-01T14:14:18.821234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256473745517642:11730]
2025-10-01T14:14:18.821237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256473745517642:11730]
2025-10-01T14:14:18.821271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:18.821276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.821278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:18.821282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:18.821286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:18.821289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:18.821387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:18.864691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256476122419609:12142]
2025-10-01T14:14:18.864969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2209, pipe: [1:7556256476122419609:12142]
2025-10-01T14:14:18.960943Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:18.967443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.967469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.967605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.967655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.967705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.967755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.967793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.967801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.967855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.967903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.967952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.968005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.968044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.968050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.968107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.968164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.968220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.968275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.968316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.968328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.968399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.968453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.968506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.968559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.968608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.968614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.968667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.968718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.968771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.968823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.968861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.968866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.968920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.968974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.969026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.969082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.969120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.969127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.969182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.969234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.969290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.969343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.969381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.969386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.969451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.969508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.969564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.969621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.969662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.969667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.969730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.969783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.969838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.969894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.969937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.969942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.970000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:18.970054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:18.970107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:18.970158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:18.970197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:18.970202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:18.970242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122419609:12142], now have 1 active actors on pipe
2025-10-01T14:14:18.970517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:18.970520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256476122419609:12142]
2025-10-01T14:14:18.970533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:18.970545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:18.970561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2210 reason: error at write: Disconnected sessionId: src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0
2025-10-01T14:14:18.970760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2210 sessionId: src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0 is DEAD
2025-10-01T14:14:18.970908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:18.970920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0] Write session will restart in 0.005009s
2025-10-01T14:14:18.970949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0] Write session: Do CDS request
2025-10-01T14:14:18.970956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:18.971101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:18.976790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.976910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:18.976921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2211
2025-10-01T14:14:18.977039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:18.977063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:18.977071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:18.977073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:18.977421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2211 sessionId:  describe result for acl check
2025-10-01T14:14:18.977454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:18.977459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:18.977460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:18.977464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256476122419632:12199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:18.977842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256476122419632:12199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:18.980235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256476122419632:12199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:18.984016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256476122419632:12199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:18.984031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256476122419632:12199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:18.984034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256476122419632:12199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:18.984041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:18.989630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:18.992047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:18.992234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:18.992242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:18.992250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:18.992286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:18.992316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256473745517941:11732]
2025-10-01T14:14:18.992752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:18.992987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:18.993028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:18.993253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:18.993293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.993298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.993298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.993299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.993300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.993300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.993301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.993302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.993302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.993303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.993303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.993304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.993305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.993305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.993309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.993315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.993317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.993319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.993322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.993324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.993326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.993328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.993330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.993332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.993334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.993336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.993338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.993340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.993346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.993350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:18.993355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.993358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:18.993362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.993364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:18.993366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.993369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:18.993372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.993375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:18.993377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.993379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:18.993382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.993384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:18.993386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.993389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:18.993391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.993395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:18.993397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.993400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.993402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.993404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.993406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.993409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.993411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.993414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:18.993416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.993418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:18.993438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:18.996753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:18.997491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:18.997503Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:18.997505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:18.997508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:18.997513Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2210 [2:7556256473745517941:11732]
2025-10-01T14:14:18.997530Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:18.997543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:18.997546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.997548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.997549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.997560Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:18.997563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:18.997568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:18.997605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.997611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.997612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.997615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:18.997616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:18.997665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:18.997674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:18.997680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:18.997686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:18.997694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:18.997709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256473745517936:11732]
2025-10-01T14:14:18.997711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256473745517936:11732]
2025-10-01T14:14:18.997713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256473745517936:11732]
2025-10-01T14:14:18.997722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:18.997729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:18.997732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:18.997734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:18.997737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122419768:12199], now have 1 active actors on pipe
2025-10-01T14:14:18.997743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:18.997757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:18.997760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:18.997766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256476122419616:2446], now have 1 active actors on pipe
2025-10-01T14:14:18.997789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256473745517936:11732]
2025-10-01T14:14:18.997794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:18.997801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:18.997823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2210
2025-10-01T14:14:18.997901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2210
2025-10-01T14:14:18.997934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.997944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.997965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:18.997975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:18.997980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:18.997985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:18.997992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:18.997999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:18.998010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.998141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:18.998146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:18.998155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:18.998231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2211 partition: 0 MaxSeqNo: 45 sessionId: src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0
2025-10-01T14:14:18.998585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|209af5b6-104ab793-52d1dbf8-c7150abc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:19.001310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0] Write session: try to update token
2025-10-01T14:14:19.001327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:19.015689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2211 sessionId: src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:19.017414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:19.017449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:19.017452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:19.017454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:19.017465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256473745517936:11732]
2025-10-01T14:14:19.017469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256473745517936:11732]
2025-10-01T14:14:19.017473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256473745517936:11732]
2025-10-01T14:14:19.017523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:19.017531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.017534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:19.017538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:19.017541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:19.017546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:19.017665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:19.017916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:19.070497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256480417387212:12142]
2025-10-01T14:14:19.070709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2210, pipe: [1:7556256480417387212:12142]
2025-10-01T14:14:19.153682Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:19.154207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.154221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.154257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417387212:12142], now have 1 active actors on pipe
2025-10-01T14:14:19.154501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:19.154513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:19.154514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256480417387212:12142]
2025-10-01T14:14:19.154533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:19.154573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2211 reason: error at write: Disconnected sessionId: src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0
2025-10-01T14:14:19.154820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:19.154967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:19.154978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0] Write session will restart in 0.008937s
2025-10-01T14:14:19.155004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0] Write session: Do CDS request
2025-10-01T14:14:19.155013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:19.154763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2211 sessionId: src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0 is DEAD
2025-10-01T14:14:19.164888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.164983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:19.164999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2212
2025-10-01T14:14:19.165110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.165140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:19.165152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:19.165156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:19.165579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2212 sessionId:  describe result for acl check
2025-10-01T14:14:19.165615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:19.165622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:19.165623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:19.165629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256480417387289:12203] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:19.166144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256480417387289:12203] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:19.169597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256480417387289:12203] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:19.172756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256480417387289:12203] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:19.172774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256480417387289:12203] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:19.172777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256480417387289:12203] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:19.172784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:19.174622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:19.177641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:19.177823Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:19.177834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:19.177847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:19.177891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:19.177921Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256478040485563:11744]
2025-10-01T14:14:19.178295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:19.178569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:19.178608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:19.178806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:19.178852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.178857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.178858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.178859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.178860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.178861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.178861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.178862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.178863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.178864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.178864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.178865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.178866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.178867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.178870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.178876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.178878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.178880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.178882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.178885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.178887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.178889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.178891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.178893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.178895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.178897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.178900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.178902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.178908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.178912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.178916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.178919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.178921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.178924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.178926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.178929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.178931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.178934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.178936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.178939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.178942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.178945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.178948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.178953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.178957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.178962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.178965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.178969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.178980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.178989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.178997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.179001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.179006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.179009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.179011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.179014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.179036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:19.182692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:19.183320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:19.183334Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:19.183337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:19.183339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:19.183345Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2211 [2:7556256478040485563:11744]
2025-10-01T14:14:19.183356Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:19.183373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:19.183375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.183377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.183379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.183392Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:19.183399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:19.183404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:19.183457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.183464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.183466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.183469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:19.183472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:19.183524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:19.183530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.183538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.183547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.183559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:19.183576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256478040485558:11744]
2025-10-01T14:14:19.183580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256478040485558:11744]
2025-10-01T14:14:19.183582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256478040485558:11744]
2025-10-01T14:14:19.183589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:19.183599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:19.183600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:19.183607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:19.183609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:19.183609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:19.183611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:19.183618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417387215:2446], now have 1 active actors on pipe
2025-10-01T14:14:19.183620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417387492:12203], now have 1 active actors on pipe
2025-10-01T14:14:19.183646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256478040485558:11744]
2025-10-01T14:14:19.183656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:19.183666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:19.183702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2211
2025-10-01T14:14:19.183717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2211
2025-10-01T14:14:19.183783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.183793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.183818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:19.183827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.183834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.183836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:19.183844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.183854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:19.183869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.183989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.183997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.184012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.184084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2212 partition: 0 MaxSeqNo: 45 sessionId: src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0
2025-10-01T14:14:19.184419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51e9d210-8ac1fa51-eb5145bc-838b7fc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:19.187206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0] Write session: try to update token
2025-10-01T14:14:19.187227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:19.193737Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:19.193757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:19.193768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256478040485558:11744]
2025-10-01T14:14:19.193811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:19.193814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:19.193964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:19.194091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:19.194206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:19.194336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:19.194536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:19.194575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:19.200927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2212 sessionId: src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:19.203649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:19.203830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.203854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.203892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:19.203956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:19.211954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:19.211971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:19.211973Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:19.211974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:19.211984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256478040485558:11744]
2025-10-01T14:14:19.211987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256478040485558:11744]
2025-10-01T14:14:19.211989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256478040485558:11744]
2025-10-01T14:14:19.212023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:19.212026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:19.212031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.212032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:19.212034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:19.212038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:19.212141Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:19.254838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256480417387518:12142]
2025-10-01T14:14:19.255092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2211, pipe: [1:7556256480417387518:12142]
2025-10-01T14:14:19.351995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:19.360148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.360186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.360346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.360408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.360467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.360520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.360566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.360597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.360659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.360721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.360776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.360833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.360875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.360883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.360945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.361000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.361059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.361122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.361164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.361173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.361236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.361296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.361353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.361411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.361451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.361458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.361518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.361572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.361630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.361688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.361730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.361736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.361797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.361856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.361915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.361976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.362017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.362024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.362084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.362138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.362195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.362253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.362295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.362302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.362358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.362442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.362500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.362559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.362606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.362614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.362676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.362739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.362805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.362867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.362912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.362919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.362978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:19.363035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:19.363092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:19.363150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:19.363190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:19.363197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:19.363258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417387518:12142], now have 1 active actors on pipe
2025-10-01T14:14:19.363556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256480417387518:12142]
2025-10-01T14:14:19.363560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:19.363564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:19.363592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2212 reason: error at write: Disconnected sessionId: src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0
2025-10-01T14:14:19.363601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:19.363786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2212 sessionId: src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0 is DEAD
2025-10-01T14:14:19.363923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:19.363931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0] Write session will restart in 0.007797s
2025-10-01T14:14:19.363957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0] Write session: Do CDS request
2025-10-01T14:14:19.363963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:19.364530Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:19.373023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.373032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:19.373046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2213
2025-10-01T14:14:19.373233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.373271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:19.373281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:19.373284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:19.373665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2213 sessionId:  describe result for acl check
2025-10-01T14:14:19.373700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:19.373706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:19.373708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:19.373713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256480417387580:12207] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:19.374209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256480417387580:12207] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:19.377441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256480417387580:12207] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:19.380495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256480417387580:12207] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:19.380516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256480417387580:12207] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:19.380519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256480417387580:12207] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:19.380526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:19.385898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:19.386464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:19.386670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:19.386680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:19.386693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:19.386756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:19.386801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256478040485859:11747]
2025-10-01T14:14:19.387378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:19.387644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:19.387687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:19.387969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:19.388030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.388036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.388037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.388038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.388040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.388041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.388042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.388044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.388045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.388046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.388047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.388048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.388049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.388050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.388056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.388065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.388069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.388073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.388077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.388081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.388084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.388088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.388091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.388095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.388099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.388102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.388105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.388109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.388118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.388125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.388136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.388140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.388148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.388152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.388157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.388165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.388170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.388175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.388179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.388184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.388192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.388198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.388206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.388211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.388220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.388226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.388234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.388239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.388248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.388253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.388261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.388266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.388271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.388279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.388283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.388291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.388323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:19.391833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:19.392603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:19.392616Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:19.392619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:19.392622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:19.392629Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2212 [2:7556256478040485859:11747]
2025-10-01T14:14:19.392645Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:19.392666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:19.392672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.392676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.392678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.392693Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:19.392698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:19.392709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:19.392760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.392767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.392769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.392772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:19.392775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:19.392841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:19.392848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.392859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.392874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.392893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:19.392914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417387790:12207], now have 1 active actors on pipe
2025-10-01T14:14:19.392922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417387521:2446], now have 1 active actors on pipe
2025-10-01T14:14:19.392929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256478040485854:11747]
2025-10-01T14:14:19.392931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256478040485854:11747]
2025-10-01T14:14:19.392933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256478040485854:11747]
2025-10-01T14:14:19.392947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:19.392958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:19.392960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:19.392967Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:19.392969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:19.392973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:19.392976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:19.393002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2212
2025-10-01T14:14:19.393010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256478040485854:11747]
2025-10-01T14:14:19.393006Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2212
2025-10-01T14:14:19.393021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:19.393026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:19.393046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.393051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.393083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:19.393095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.393099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.393102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:19.393110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.393123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:19.393145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.393252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.393259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.393272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.393333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2213 partition: 0 MaxSeqNo: 45 sessionId: src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0
2025-10-01T14:14:19.393660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5096eb9d-c281c09d-a931eca0-2b018ae4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:19.396138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0] Write session: try to update token
2025-10-01T14:14:19.396154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:19.409077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2213 sessionId: src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:19.411287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:19.413355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.413385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.413405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:19.413408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:19.413410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:19.413412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:19.413420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256478040485854:11747]
2025-10-01T14:14:19.413424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256478040485854:11747]
2025-10-01T14:14:19.413427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256478040485854:11747]
2025-10-01T14:14:19.413480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:19.413484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:19.413489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.413492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:19.413495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:19.413499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:19.413623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:19.463775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256480417387825:12142]
2025-10-01T14:14:19.464079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2212, pipe: [1:7556256480417387825:12142]
2025-10-01T14:14:19.551106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:19.551658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:19.551714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417387825:12142], now have 1 active actors on pipe
2025-10-01T14:14:19.551794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:19.551878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256480417387825:12142]
2025-10-01T14:14:19.551907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:19.562610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:19.562621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:19.562639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2213 reason: error at write: Disconnected sessionId: src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0
2025-10-01T14:14:19.562742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2213 sessionId: src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0 is DEAD
2025-10-01T14:14:19.562887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:19.562898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0] Write session will restart in 0.009087s
2025-10-01T14:14:19.562923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0] Write session: Do CDS request
2025-10-01T14:14:19.562929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:19.572815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.573147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:19.573160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2214
2025-10-01T14:14:19.573265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.573288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:19.573292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:19.573294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:19.573537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:19.573633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2214 sessionId:  describe result for acl check
2025-10-01T14:14:19.573666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:19.573669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:19.573670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:19.573677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256480417388093:12212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:19.574146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256480417388093:12212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:19.576073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:19.576225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:19.576232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:19.576240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:19.576241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256480417388093:12212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:19.576292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:19.576320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256478040486169:11750]
2025-10-01T14:14:19.576739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:19.577011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:19.577060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:19.577364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:19.577422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.577428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.577429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.577430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.577432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.577433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.577434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.577435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.577436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.577438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.577439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.577440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.577441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.577442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.577447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.577456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.577460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.577463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.577467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.577470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.577475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.577479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.577482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.577486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.577489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.577493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.577496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.577500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.577506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.577514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.577519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.577524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.577528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.577533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.577537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.577542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.577546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.577555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.577559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.577563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.577572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.577576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.577580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.577585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.577589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.577596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.577600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.577606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.577611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.577619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.577623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.577628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.577634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.577638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.577644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.577648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.577685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:19.580741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256480417388093:12212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:19.580754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256480417388093:12212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:19.580758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256480417388093:12212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:19.580765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:19.580896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:19.581770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:19.581782Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:19.581783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:19.581785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:19.581790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2213 [2:7556256478040486169:11750]
2025-10-01T14:14:19.581800Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:19.581815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:19.581820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.581822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.581823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.581833Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:19.581840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:19.581844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:19.581884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.581889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.581890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.581892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:19.581893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:19.581940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:19.581946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.581952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.581958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.581966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:19.581983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256478040486164:11750]
2025-10-01T14:14:19.581984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256478040486164:11750]
2025-10-01T14:14:19.581985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256478040486164:11750]
2025-10-01T14:14:19.581992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:19.582003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417387831:2446], now have 1 active actors on pipe
2025-10-01T14:14:19.582009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:19.582010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417388134:12212], now have 1 active actors on pipe
2025-10-01T14:14:19.582012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:19.582014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:19.582017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:19.582029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:19.582032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:19.582056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256478040486164:11750]
2025-10-01T14:14:19.582064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:19.582033Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2213
2025-10-01T14:14:19.582066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:19.582035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2213
2025-10-01T14:14:19.582090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.582099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.582131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:19.582141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.582144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.582151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:19.582159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.582172Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:19.582196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.582517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2214 partition: 0 MaxSeqNo: 45 sessionId: src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0
2025-10-01T14:14:19.582870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|35a98f84-d031c5e0-f276e5a4-aeb41f4f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:19.582388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.582394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.582409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.585520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0] Write session: try to update token
2025-10-01T14:14:19.585537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:19.597842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2214 sessionId: src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:19.600174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:19.601261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.601289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.601308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:19.601312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:19.601314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:19.601316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:19.601324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256478040486164:11750]
2025-10-01T14:14:19.601333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256478040486164:11750]
2025-10-01T14:14:19.601336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256478040486164:11750]
2025-10-01T14:14:19.601373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:19.601385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:19.601387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:19.601392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:19.601397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.601399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:19.601529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:19.652144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256480417388142:12142]
2025-10-01T14:14:19.652352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2213, pipe: [1:7556256480417388142:12142]
2025-10-01T14:14:19.740585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:19.740929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:19.740970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417388142:12142], now have 1 active actors on pipe
2025-10-01T14:14:19.741032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:19.742116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:19.742147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256480417388142:12142]
2025-10-01T14:14:19.750790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:19.750804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:19.750828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2214 reason: error at write: Disconnected sessionId: src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0
2025-10-01T14:14:19.750978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2214 sessionId: src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0 is DEAD
2025-10-01T14:14:19.751109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:19.751120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0] Write session will restart in 0.006628s
2025-10-01T14:14:19.751144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0] Write session: Do CDS request
2025-10-01T14:14:19.751153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:19.758875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.758971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:19.758984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2215
2025-10-01T14:14:19.759089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.759119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:19.759129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:19.759132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:19.759487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2215 sessionId:  describe result for acl check
2025-10-01T14:14:19.759520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:19.759528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:19.759531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:19.759538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256480417388252:12223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:19.759991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256480417388252:12223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:19.762523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256480417388252:12223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:19.765715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256480417388252:12223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:19.765730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256480417388252:12223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:19.765734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256480417388252:12223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:19.765741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:19.767339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:19.770483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:19.770656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:19.770680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:19.770691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:19.770744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:19.770778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256478040486477:11752]
2025-10-01T14:14:19.771277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:19.771583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:19.771628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:19.771855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:19.771892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.771898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.771898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.771899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.771900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.771901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.771901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.771902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.771903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.771903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.771904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.771905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.771906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.771906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.771910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.771916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.771919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.771921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.771924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.771926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.771929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.771931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.771933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.771935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.771938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.771940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.771942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.771944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.771950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.771958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.771964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.771969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.771973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.771978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.771982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.771985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.771988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.771991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.771993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.771996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.772001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.772004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.772006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.772009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.772012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.772015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.772017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.772020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.772023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.772025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.772028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.772030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.772033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.772035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.772038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.772041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.772067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:19.775883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:19.776525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:19.776541Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:19.776544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:19.776547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:19.776555Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2214 [2:7556256478040486477:11752]
2025-10-01T14:14:19.776569Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:19.776596Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:19.776600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.776604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.776606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.776622Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:19.776627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:19.776632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:19.776691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.776698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.776700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.776703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:19.776706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:19.776769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:19.776776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.776787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.776799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.776815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:19.776838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417388149:2446], now have 1 active actors on pipe
2025-10-01T14:14:19.776848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417388459:12223], now have 1 active actors on pipe
2025-10-01T14:14:19.776855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256478040486465:11752]
2025-10-01T14:14:19.776857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256478040486465:11752]
2025-10-01T14:14:19.776859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256478040486465:11752]
2025-10-01T14:14:19.776873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:19.776886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:19.776896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:19.776899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:19.776902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:19.776902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:19.776905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:19.776933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256478040486465:11752]
2025-10-01T14:14:19.776910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2214
2025-10-01T14:14:19.776941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:19.776937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2214
2025-10-01T14:14:19.776943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:19.776971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.776981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.777011Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efe552f-b6f03870-9c521248-396bf61a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:19.777021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.777025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.777033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:19.777042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.777054Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:19.777076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.777231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.777239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.777253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.777344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2215 partition: 0 MaxSeqNo: 45 sessionId: src_id|efe552f-b6f03870-9c521248-396bf61a_0
2025-10-01T14:14:19.777680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16cbf601-61d6b48f-51a62b96-5b27e47d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|efe552f-b6f03870-9c521248-396bf61a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:19.780500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe552f-b6f03870-9c521248-396bf61a_0] Write session: try to update token
2025-10-01T14:14:19.780519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe552f-b6f03870-9c521248-396bf61a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:19.794998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2215 sessionId: src_id|efe552f-b6f03870-9c521248-396bf61a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:19.797302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:19.797435Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:19.797455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:19.797457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:19.797458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:19.797465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256478040486465:11752]
2025-10-01T14:14:19.797469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256478040486465:11752]
2025-10-01T14:14:19.797474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256478040486465:11752]
2025-10-01T14:14:19.797501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:19.797505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:19.797507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:19.797529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.797543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.797569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:19.797580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.797586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:19.797709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:19.842091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256480417388484:12142]
2025-10-01T14:14:19.842317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2214, pipe: [1:7556256480417388484:12142]
2025-10-01T14:14:19.941810Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:19.942144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417388484:12142], now have 1 active actors on pipe
2025-10-01T14:14:19.942297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:19.942357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:19.942442Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256480417388484:12142]
2025-10-01T14:14:19.942518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:19.942592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2215 reason: status is not ok: tablet will be restarted right now sessionId: src_id|efe552f-b6f03870-9c521248-396bf61a_0
2025-10-01T14:14:19.942779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2215 sessionId: src_id|efe552f-b6f03870-9c521248-396bf61a_0 is DEAD
2025-10-01T14:14:19.943000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe552f-b6f03870-9c521248-396bf61a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:19.943008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe552f-b6f03870-9c521248-396bf61a_0] Write session will restart in 0.006988s
2025-10-01T14:14:19.943026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe552f-b6f03870-9c521248-396bf61a_0] Write session: Do CDS request
2025-10-01T14:14:19.943030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe552f-b6f03870-9c521248-396bf61a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:19.950849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efe552f-b6f03870-9c521248-396bf61a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.950943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:19.950957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2216
2025-10-01T14:14:19.951109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:19.951141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:19.951151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:19.951155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:19.951555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2216 sessionId:  describe result for acl check
2025-10-01T14:14:19.951588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:19.951590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:19.951591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:19.951594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256480417388536:12229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:19.951964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256480417388536:12229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:19.953942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256480417388536:12229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:19.957715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256480417388536:12229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:19.957729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256480417388536:12229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:19.957732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256480417388536:12229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:19.957738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:19.961212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:19.964064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:19.964199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:19.964206Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:19.964213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:19.964243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:19.964268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256478040486776:11757]
2025-10-01T14:14:19.964647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:19.964886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:19.964909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:19.965086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:19.965117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.965121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.965122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.965122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.965123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.965123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.965124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.965125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.965125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.965126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.965127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.965127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.965128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.965128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.965131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.965136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.965139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.965141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.965143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.965145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.965147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.965149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.965151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.965155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.965157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.965159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.965161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.965163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.965167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.965172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:19.965176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.965179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:19.965181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.965184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:19.965186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.965189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:19.965191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.965194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:19.965197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.965199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:19.965202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.965205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:19.965207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.965210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:19.965215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.965218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:19.965220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.965224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.965230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.965233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.965235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.965238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.965240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.965246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:19.965248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.965251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:19.965274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:19.968652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:19.969200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:19.969212Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:19.969213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:19.969216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:19.969220Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2215 [2:7556256478040486776:11757]
2025-10-01T14:14:19.969229Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:19.969241Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:19.969242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.969244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.969245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.969254Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:19.969259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:19.969267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:19.969303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.969308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.969309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.969312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:19.969313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:19.969356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:19.969362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.969368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:19.969373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:19.969385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:19.969399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256478040486771:11757]
2025-10-01T14:14:19.969404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256478040486771:11757]
2025-10-01T14:14:19.969405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256478040486771:11757]
2025-10-01T14:14:19.969412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:19.969423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:19.969430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:19.969434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:19.969436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:19.969442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:19.969444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:19.969458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417388707:12229], now have 1 active actors on pipe
2025-10-01T14:14:19.969464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256480417388486:2446], now have 1 active actors on pipe
2025-10-01T14:14:19.969465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256478040486771:11757]
2025-10-01T14:14:19.969470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:19.969491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:19.969537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2215
2025-10-01T14:14:19.969539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2215
2025-10-01T14:14:19.969594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.969601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.969618Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:19.969622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:19.969624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:19.969626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:19.969632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:19.969638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:19.969650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.969889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.969895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.969905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:19.969995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2216 partition: 0 MaxSeqNo: 45 sessionId: src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0
2025-10-01T14:14:19.970320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efe552f-b6f03870-9c521248-396bf61a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:19.973694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0] Write session: try to update token
2025-10-01T14:14:19.973712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:19.986723Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2216 sessionId: src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:19.987177Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:19.987197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:19.987209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256478040486771:11757]
2025-10-01T14:14:19.987259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:19.987261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:19.987431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:19.987572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:19.987714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:19.987856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:19.988052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:19.988095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:19.989437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:19.989809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:19.989829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:19.989855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:19.989937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:19.998293Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:19.998310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:19.998311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:19.998313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:19.998321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256478040486771:11757]
2025-10-01T14:14:19.998323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256478040486771:11757]
2025-10-01T14:14:19.998326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256478040486771:11757]
2025-10-01T14:14:19.998358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:19.998363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:19.998364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:19.998463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:19.998478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:19.998483Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:19.998494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:20.042798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256484712356092:12142]
2025-10-01T14:14:20.043125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2215, pipe: [1:7556256484712356092:12142]
2025-10-01T14:14:20.133896Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:20.141406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.141430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.141561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.141612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.141668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.141721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.141760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.141767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.141821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.141876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.141929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.141980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.142023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.142028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.142086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.142141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.142194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.142251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.142291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.142297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.142354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.142436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.142495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.142550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.142589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.142594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.142651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.142705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.142759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.142816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.142857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.142863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.142921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.142974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.143045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.143103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.143143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.143148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.143206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.143258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.143315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.143370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.143409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.143414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.143477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.143529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.143586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.143641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.143680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.143685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.143745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.143800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.143856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.143914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.143953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.143958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.144015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:20.144067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:20.144121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:20.144172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:20.144210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:20.144215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:20.144254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712356092:12142], now have 1 active actors on pipe
2025-10-01T14:14:20.144552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256484712356092:12142]
2025-10-01T14:14:20.144597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:20.144599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:20.144630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2216 reason: error at write: Disconnected sessionId: src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0
2025-10-01T14:14:20.144688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:20.144818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2216 sessionId: src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0 is DEAD
2025-10-01T14:14:20.144997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:20.145008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0] Write session will restart in 0.009738s
2025-10-01T14:14:20.145034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0] Write session: Do CDS request
2025-10-01T14:14:20.145040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:20.145200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:20.155884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.155984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:20.155998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2217
2025-10-01T14:14:20.156106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.156129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:20.156135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:20.156138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:20.156546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2217 sessionId:  describe result for acl check
2025-10-01T14:14:20.156592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:20.156599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:20.156601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:20.156607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256484712356188:12233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:20.157086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256484712356188:12233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:20.160116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256484712356188:12233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:20.162850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256484712356188:12233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:20.162864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256484712356188:12233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:20.162867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256484712356188:12233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:20.162874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:20.164170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:20.167129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:20.167316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:20.167326Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:20.167337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:20.167380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:20.167417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256482335454401:11769]
2025-10-01T14:14:20.167979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:20.168238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:20.168281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:20.168568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:20.168627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.168634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.168635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.168637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.168638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.168639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.168640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.168641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.168643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.168644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.168645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.168646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.168648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.168649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.168654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.168663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.168666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.168670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.168674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.168677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.168685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.168690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.168697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.168706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.168714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.168723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.168728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.168735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.168743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.168754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.168763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.168772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.168781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.168789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.168797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.168806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.168814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.168823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.168826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.168835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.168843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.168851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.168859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.168864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.168873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.168882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.168890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.168899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.168908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.168916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.168921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.168925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.168934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.168940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.168948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.168956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.168998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:20.172396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:20.173012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:20.173027Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:20.173029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:20.173033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:20.173039Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2216 [2:7556256482335454401:11769]
2025-10-01T14:14:20.173058Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:20.173076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:20.173082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.173086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.173092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.173107Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:20.173116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:20.173121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:20.173171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.173178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.173180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.173183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:20.173185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:20.173243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:20.173249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.173260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.173275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.173294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:20.173314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712356388:12233], now have 1 active actors on pipe
2025-10-01T14:14:20.173324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712356097:2446], now have 1 active actors on pipe
2025-10-01T14:14:20.173331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256482335454396:11769]
2025-10-01T14:14:20.173333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256482335454396:11769]
2025-10-01T14:14:20.173334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256482335454396:11769]
2025-10-01T14:14:20.173347Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:20.173359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:20.173367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:20.173371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:20.173373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:20.173373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:20.173375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:20.173395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256482335454396:11769]
2025-10-01T14:14:20.173402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:20.173417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:20.173395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2216
2025-10-01T14:14:20.173406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2216
2025-10-01T14:14:20.173441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.173449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.173474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:20.173483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.173487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.173489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:20.173497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.173504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:20.173520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.173667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.173677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.173691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.173781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2217 partition: 0 MaxSeqNo: 45 sessionId: src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0
2025-10-01T14:14:20.174133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdc4dbd8-c5958aa1-a23562ae-390de5b1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:20.176992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0] Write session: try to update token
2025-10-01T14:14:20.177012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:20.189923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2217 sessionId: src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:20.192180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:20.192534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.192561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.192591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:20.192595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:20.192597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:20.192599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:20.192608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256482335454396:11769]
2025-10-01T14:14:20.192769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256482335454396:11769]
2025-10-01T14:14:20.192782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256482335454396:11769]
2025-10-01T14:14:20.192820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:20.192834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:20.192835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:20.192837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:20.192841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.192843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:20.192960Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:20.244499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256484712356402:12142]
2025-10-01T14:14:20.244723Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2216, pipe: [1:7556256484712356402:12142]
2025-10-01T14:14:20.334871Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:20.335381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:20.335429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712356402:12142], now have 1 active actors on pipe
2025-10-01T14:14:20.335530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:20.335588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256484712356402:12142]
2025-10-01T14:14:20.335610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:20.335612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:20.335618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:20.335672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2217 reason: error at write: Disconnected sessionId: src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0
2025-10-01T14:14:20.335846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2217 sessionId: src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0 is DEAD
2025-10-01T14:14:20.335925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:20.335935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0] Write session will restart in 0.007544s
2025-10-01T14:14:20.335960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0] Write session: Do CDS request
2025-10-01T14:14:20.335968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:20.344930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.345180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:20.345194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2218
2025-10-01T14:14:20.345292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.345318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:20.345325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:20.345327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:20.345678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2218 sessionId:  describe result for acl check
2025-10-01T14:14:20.345708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:20.345713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:20.345714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:20.345725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256484712356437:12237] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:20.346154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256484712356437:12237] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:20.349570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256484712356437:12237] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:20.352614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256484712356437:12237] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:20.352631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256484712356437:12237] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:20.352637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256484712356437:12237] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:20.352645Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:20.357237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:20.360684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:20.360901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:20.360911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:20.360922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:20.360969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:20.361012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256482335454704:11772]
2025-10-01T14:14:20.361617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:20.361914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:20.361950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:20.362214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:20.362277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.362282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.362283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.362284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.362285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.362286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.362288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.362289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.362290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.362291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.362292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.362293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.362294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.362295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.362300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.362309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.362313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.362317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.362321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.362325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.362328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.362332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.362335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.362341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.362344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.362348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.362351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.362362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.362387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.362395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.362401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.362407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.362412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.362417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.362421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.362426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.362431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.362442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.362446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.362451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.362456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.362461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.362465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.362470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.362474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.362480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.362485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.362492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.362500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.362505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.362514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.362519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.362530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.362539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.362543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.362547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.362591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:20.366280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:20.366890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:20.366904Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:20.366906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:20.366908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:20.366914Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2217 [2:7556256482335454704:11772]
2025-10-01T14:14:20.366924Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:20.366938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:20.366939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.366942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.366944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.366955Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:20.366959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:20.366963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:20.367004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.367009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.367011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.367013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:20.367015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:20.367064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:20.367069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.367076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.367082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.367090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:20.367106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256482335454699:11772]
2025-10-01T14:14:20.367111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256482335454699:11772]
2025-10-01T14:14:20.367113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256482335454699:11772]
2025-10-01T14:14:20.367119Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:20.367129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:20.367132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:20.367135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:20.367137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:20.367145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:20.367147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:20.367226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2217
2025-10-01T14:14:20.367158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712356405:2446], now have 1 active actors on pipe
2025-10-01T14:14:20.367254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2217
2025-10-01T14:14:20.367166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712356605:12237], now have 1 active actors on pipe
2025-10-01T14:14:20.367191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256482335454699:11772]
2025-10-01T14:14:20.367197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:20.367216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:20.367274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.367277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.367296Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:20.367301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.367304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.367305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:20.367312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.367318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:20.367328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.367468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.367476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.367488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.367554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2218 partition: 0 MaxSeqNo: 45 sessionId: src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0
2025-10-01T14:14:20.367889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1e4c93dc-f3b3f048-b66ab11f-f4a2272a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:20.370864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0] Write session: try to update token
2025-10-01T14:14:20.370886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:20.384635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2218 sessionId: src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:20.386923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:20.386979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:20.387005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:20.387007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:20.387009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:20.387018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256482335454699:11772]
2025-10-01T14:14:20.387023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256482335454699:11772]
2025-10-01T14:14:20.387027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256482335454699:11772]
2025-10-01T14:14:20.387078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:20.387078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:20.387084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:20.387088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:20.387090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.387092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:20.387222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:20.435499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256484712356714:12142]
2025-10-01T14:14:20.435828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2217, pipe: [1:7556256484712356714:12142]
2025-10-01T14:14:20.542878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:20.543637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.543653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.543695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712356714:12142], now have 1 active actors on pipe
2025-10-01T14:14:20.543900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:20.543890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256484712356714:12142]
2025-10-01T14:14:20.543910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:20.543924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:20.543926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:20.543977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2218 reason: error at write: Disconnected sessionId: src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0
2025-10-01T14:14:20.544155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2218 sessionId: src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0 is DEAD
2025-10-01T14:14:20.544302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:20.544311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0] Write session will restart in 0.008878s
2025-10-01T14:14:20.544349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0] Write session: Do CDS request
2025-10-01T14:14:20.544356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:20.554861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.555139Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:20.555159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2219
2025-10-01T14:14:20.555269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.555305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:20.555320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:20.555323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:20.555738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2219 sessionId:  describe result for acl check
2025-10-01T14:14:20.555781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:20.555793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:20.555796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:20.555801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256484712356791:12241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:20.556373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256484712356791:12241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:20.561793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256484712356791:12241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:20.564700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:20.564755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256484712356791:12241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:20.564769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256484712356791:12241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:20.564772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256484712356791:12241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:20.564780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:20.568017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:20.568243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:20.568253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:20.568264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:20.568312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:20.568349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256482335455020:11775]
2025-10-01T14:14:20.568937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:20.569232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:20.569274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:20.569556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:20.569608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.569613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.569614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.569615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.569616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.569617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.569618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.569620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.569621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.569622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.569623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.569624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.569625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.569626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.569631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.569640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.569644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.569648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.569652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.569656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.569659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.569663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.569667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.569670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.569674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.569678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.569681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.569685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.569692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.569698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.569704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.569710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.569718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.569723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.569727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.569732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.569737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.569741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.569748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.569753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.569757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.569768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.569772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.569776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.569781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.569786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.569790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.569799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.569804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.569809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.569813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.569817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.569821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.569830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.569834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.569838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.569874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:20.573840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:20.574715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:20.574732Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:20.574735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:20.574738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:20.574745Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2218 [2:7556256482335455020:11775]
2025-10-01T14:14:20.574761Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:20.574777Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:20.574781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.574784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.574787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.574803Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:20.574816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:20.574826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:20.574891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.574898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.574900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.574903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:20.574905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:20.574972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:20.574979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.574992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.575007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.575026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:20.575048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256482335455014:11775]
2025-10-01T14:14:20.575055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256482335455014:11775]
2025-10-01T14:14:20.575057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256482335455014:11775]
2025-10-01T14:14:20.575075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:20.575079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:20.575083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:20.575084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:20.575093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712357020:12241], now have 1 active actors on pipe
2025-10-01T14:14:20.575096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712356720:2446], now have 1 active actors on pipe
2025-10-01T14:14:20.575109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:20.575126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:20.575133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:20.575144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2218
2025-10-01T14:14:20.575172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256482335455014:11775]
2025-10-01T14:14:20.575182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:20.575188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:20.575191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2218
2025-10-01T14:14:20.575255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.575265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.575288Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a22beb7-59b75b36-72a080b3-d664126b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:20.575300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.575307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.575310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:20.575319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.575332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:20.575351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.575487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.575494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.575508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.575607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2219 partition: 0 MaxSeqNo: 45 sessionId: src_id|5a22beb7-59b75b36-72a080b3-d664126b_0
2025-10-01T14:14:20.575985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd050e3-661ce0b5-f20c15dc-2c9e978a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5a22beb7-59b75b36-72a080b3-d664126b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:20.578753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a22beb7-59b75b36-72a080b3-d664126b_0] Write session: try to update token
2025-10-01T14:14:20.578772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a22beb7-59b75b36-72a080b3-d664126b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:20.592135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2219 sessionId: src_id|5a22beb7-59b75b36-72a080b3-d664126b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:20.595102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:20.595729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.595754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.595774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:20.595776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:20.595778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:20.595779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:20.595786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256482335455014:11775]
2025-10-01T14:14:20.595789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256482335455014:11775]
2025-10-01T14:14:20.595792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256482335455014:11775]
2025-10-01T14:14:20.595822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:20.595834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:20.595836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:20.595839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.595839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:20.595841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:20.595962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:20.643840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256484712357038:12142]
2025-10-01T14:14:20.644130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2218, pipe: [1:7556256484712357038:12142]
2025-10-01T14:14:20.737894Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:20.738145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:20.738198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712357038:12142], now have 1 active actors on pipe
2025-10-01T14:14:20.738284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:20.738390Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256484712357038:12142]
2025-10-01T14:14:20.738423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:20.748882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:20.748894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:20.748910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2219 reason: error at write: Disconnected sessionId: src_id|5a22beb7-59b75b36-72a080b3-d664126b_0
2025-10-01T14:14:20.749024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2219 sessionId: src_id|5a22beb7-59b75b36-72a080b3-d664126b_0 is DEAD
2025-10-01T14:14:20.749156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a22beb7-59b75b36-72a080b3-d664126b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:20.749168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a22beb7-59b75b36-72a080b3-d664126b_0] Write session will restart in 0.006138s
2025-10-01T14:14:20.749193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a22beb7-59b75b36-72a080b3-d664126b_0] Write session: Do CDS request
2025-10-01T14:14:20.749201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a22beb7-59b75b36-72a080b3-d664126b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:20.756857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a22beb7-59b75b36-72a080b3-d664126b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.756944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:20.756958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2220
2025-10-01T14:14:20.757068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.757097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:20.757106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:20.757110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:20.757554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2220 sessionId:  describe result for acl check
2025-10-01T14:14:20.757592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:20.757598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:20.757600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:20.757605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256484712357208:12246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:20.758131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256484712357208:12246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:20.760794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256484712357208:12246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:20.768894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256484712357208:12246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:20.768915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256484712357208:12246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:20.768919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256484712357208:12246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:20.768927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:20.769255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:20.769807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:20.769947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:20.769956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:20.769965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:20.769998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:20.770037Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256482335455325:11777]
2025-10-01T14:14:20.770479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:20.770811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:20.770868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:20.771200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:20.771259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.771267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.771268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.771270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.771271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.771272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.771273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.771274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.771276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.771277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.771278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.771279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.771280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.771282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.771287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.771297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.771301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.771306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.771310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.771313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.771318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.771322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.771327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.771331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.771335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.771338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.771342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.771346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.771353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.771361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.771367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.771382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.771386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.771392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.771396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.771402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.771409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.771414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.771418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.771424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.771429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.771434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.771439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.771445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.771449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.771459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.771464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.771469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.771473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.771483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.771487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.771492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.771497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.771506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.771510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.771515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.771558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:20.775294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:20.776013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:20.776026Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:20.776028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:20.776031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:20.776037Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2219 [2:7556256482335455325:11777]
2025-10-01T14:14:20.776051Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:20.776068Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:20.776075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.776079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.776081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.776096Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:20.776104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:20.776110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:20.776162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.776169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.776171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.776173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:20.776176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:20.776235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:20.776242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.776253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.776264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.776285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:20.776303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712357349:12246], now have 1 active actors on pipe
2025-10-01T14:14:20.776310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712357040:2446], now have 1 active actors on pipe
2025-10-01T14:14:20.776317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256482335455320:11777]
2025-10-01T14:14:20.776319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256482335455320:11777]
2025-10-01T14:14:20.776321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256482335455320:11777]
2025-10-01T14:14:20.776332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:20.776346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:20.776348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:20.776354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:20.776356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:20.776361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:20.776364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:20.776344Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2219
2025-10-01T14:14:20.776378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2219
2025-10-01T14:14:20.776394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256482335455320:11777]
2025-10-01T14:14:20.776402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:20.776403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:20.776417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.776425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.776467Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:20.776478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.776481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.776488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:20.776497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.776507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:20.776527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.776677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.776697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.776715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.776811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2220 partition: 0 MaxSeqNo: 45 sessionId: src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0
2025-10-01T14:14:20.777134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a22beb7-59b75b36-72a080b3-d664126b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:20.779009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-10-01T14:14:20.779030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-10-01T14:14:20.779225Z node 2 :PERSQUEUE DEBUG: partition.cpp:1002: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 91562091 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-10-01T14:14:20.779458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 20 DataSize: 91562091 UsedReserveSize: 0
2025-10-01T14:14:20.779489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-10-01T14:14:20.779807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0] Write session: try to update token
2025-10-01T14:14:20.779819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:20.792101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2220 sessionId: src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:20.794347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:20.796274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.796302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.796323Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:20.796331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:20.796333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:20.796334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:20.796342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256482335455320:11777]
2025-10-01T14:14:20.796346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256482335455320:11777]
2025-10-01T14:14:20.796349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256482335455320:11777]
2025-10-01T14:14:20.796385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:20.796396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:20.796399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:20.796406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:20.796413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.796424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:20.796558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:20.838466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256484712357416:12142]
2025-10-01T14:14:20.838715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2219, pipe: [1:7556256484712357416:12142]
2025-10-01T14:14:20.946996Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:20.947219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:20.947265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712357416:12142], now have 1 active actors on pipe
2025-10-01T14:14:20.947326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:20.947433Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256484712357416:12142]
2025-10-01T14:14:20.947463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:20.955823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:20.955835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:20.955853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2220 reason: error at write: Disconnected sessionId: src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0
2025-10-01T14:14:20.955944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2220 sessionId: src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0 is DEAD
2025-10-01T14:14:20.956050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:20.956060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0] Write session will restart in 0.007261s
2025-10-01T14:14:20.956081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0] Write session: Do CDS request
2025-10-01T14:14:20.956088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:20.964836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.965116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:20.965127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2221
2025-10-01T14:14:20.965234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:20.965258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:20.965265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:20.965268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:20.965575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2221 sessionId:  describe result for acl check
2025-10-01T14:14:20.965607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:20.965612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:20.965613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:20.965617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256484712357665:12259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:20.965993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256484712357665:12259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:20.967737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256484712357665:12259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:20.967806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:20.970287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:20.970497Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:20.970508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:20.970554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256484712357665:12259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:20.970566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256484712357665:12259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:20.970569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256484712357665:12259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:20.970576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:20.970928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:20.971003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:20.971036Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256482335455641:11783]
2025-10-01T14:14:20.971453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:20.971668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:20.971697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:20.971931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:20.971975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.971980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.971981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.971981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.971982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.971983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.971984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.971984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.971985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.971985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.971986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.971987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.971987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.971988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.971991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.971997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.971999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.972002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.972004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.972006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.972008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.972010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.972012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.972015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.972026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.972028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.972030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.972031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.972036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.972040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:20.972044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.972047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:20.972049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.972052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:20.972055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.972058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:20.972060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.972063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:20.972066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.972069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:20.972072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.972074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:20.972076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.972079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:20.972082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.972085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:20.972088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.972090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.972093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.972096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.972098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.972101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.972103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.972106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:20.972123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.972131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:20.972150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:20.975377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:20.976196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:20.976207Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:20.976208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:20.976210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:20.976215Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2220 [2:7556256482335455641:11783]
2025-10-01T14:14:20.976224Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:20.976235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:20.976237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.976239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.976240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.976251Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:20.976254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:20.976262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:20.976298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.976303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.976304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.976306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:20.976308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:20.976351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:20.976356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.976362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:20.976367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:20.976379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:20.976394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712357423:2446], now have 1 active actors on pipe
2025-10-01T14:14:20.976399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256484712357725:12259], now have 1 active actors on pipe
2025-10-01T14:14:20.976405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256482335455631:11783]
2025-10-01T14:14:20.976409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256482335455631:11783]
2025-10-01T14:14:20.976411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256482335455631:11783]
2025-10-01T14:14:20.976424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:20.976435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:20.976440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:20.976443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:20.976445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:20.976453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:20.976455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:20.976444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2220
2025-10-01T14:14:20.976473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256482335455631:11783]
2025-10-01T14:14:20.976478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:20.976480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:20.976517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2220
2025-10-01T14:14:20.976561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.976568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.976592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:20.976597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:20.976600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:20.976602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:20.976607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:20.976615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:20.976628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.976761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.976774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.976795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:20.976874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2221 partition: 0 MaxSeqNo: 45 sessionId: src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0
2025-10-01T14:14:20.977156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0e58539-1bf96d67-669fd476-d4b2b3d3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:20.979819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0] Write session: try to update token
2025-10-01T14:14:20.979837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:20.992660Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2221 sessionId: src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:20.995008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:20.995444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:20.995469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:20.995488Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:20.995490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:20.995492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:20.995493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:20.995499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256482335455631:11783]
2025-10-01T14:14:20.995502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256482335455631:11783]
2025-10-01T14:14:20.995504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256482335455631:11783]
2025-10-01T14:14:20.995530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:20.995541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:20.995544Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:20.995550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:20.995556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:20.995563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:20.995686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:21.047326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256489007325035:12142]
2025-10-01T14:14:21.047546Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2220, pipe: [1:7556256489007325035:12142]
2025-10-01T14:14:21.132448Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:21.132648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:21.132694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325035:12142], now have 1 active actors on pipe
2025-10-01T14:14:21.132766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:21.132840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256489007325035:12142]
2025-10-01T14:14:21.132922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:21.140477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:21.140897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:21.140907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:21.140924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2221 reason: error at write: Disconnected sessionId: src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0
2025-10-01T14:14:21.141023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2221 sessionId: src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0 is DEAD
2025-10-01T14:14:21.141161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:21.141171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0] Write session will restart in 0.007973s
2025-10-01T14:14:21.141199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0] Write session: Do CDS request
2025-10-01T14:14:21.141217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:21.146384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:21.146643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:21.146656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:21.146667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:21.146725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:21.146771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256486630423029:11795]
2025-10-01T14:14:21.147413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:21.147771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:21.147829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:21.148149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:21.148240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.148253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.148259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.148259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.148261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.148262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.148263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.148264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.148265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.148266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.148269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.148270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.148271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.148272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.148277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.148286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.148289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.148293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.148296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.148300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.148303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.148307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.148314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.148317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.148321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.148324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.148332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.148335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.148347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.148357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.148369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.148378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.148388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.148396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.148401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.148405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.148410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.148415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.148420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.148425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.148434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.148438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.148447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.148452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.148459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.148463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.148472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.148477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.148481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.148490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.148494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.148499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.148506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.148510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.148518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.148524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.148567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:21.149844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.149936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:21.149948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2222
2025-10-01T14:14:21.150049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.150070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:21.150079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:21.150085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:21.150396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2222 sessionId:  describe result for acl check
2025-10-01T14:14:21.150428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:21.150432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:21.150434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:21.150437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256489007325067:12263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:21.150840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256489007325067:12263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:21.152030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:21.152271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256489007325067:12263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:21.152871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:21.152884Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:21.152885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:21.152888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:21.152895Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2221 [2:7556256486630423029:11795]
2025-10-01T14:14:21.152906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:21.152918Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:21.152920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.152922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.152923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.152935Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:21.152941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:21.152947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:21.152987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.152991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.152992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.152994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:21.152995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:21.153041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:21.153046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.153052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.153061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.153072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:21.153087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325041:2446], now have 1 active actors on pipe
2025-10-01T14:14:21.153096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256486630423023:11795]
2025-10-01T14:14:21.153100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256486630423023:11795]
2025-10-01T14:14:21.153101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256486630423023:11795]
2025-10-01T14:14:21.153112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:21.153123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:21.153127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:21.153131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:21.153132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:21.153135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:21.153137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:21.153154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256486630423023:11795]
2025-10-01T14:14:21.153163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:21.153166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:21.153161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2221
2025-10-01T14:14:21.157689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256489007325067:12263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:21.157705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256489007325067:12263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:21.157709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256489007325067:12263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:21.157716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:21.157963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325102:12263], now have 1 active actors on pipe
2025-10-01T14:14:21.158010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2221
2025-10-01T14:14:21.158059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.158071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.158097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:21.158112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.158125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.158133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:21.158143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.158156Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:21.158174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.158275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.158280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.158289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.158338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2222 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0
2025-10-01T14:14:21.158685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ced61c10-9f9aebbb-fb2612c7-d69e631_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:21.161416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0] Write session: try to update token
2025-10-01T14:14:21.161431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:21.170338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:21.170354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:21.170362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256486630423023:11795]
2025-10-01T14:14:21.170418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:21.170420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:21.170605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:21.170767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:21.170925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:21.171060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:21.171252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:21.171285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:21.176006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2222 sessionId: src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:21.178334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:21.178537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.178558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.178587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:21.178668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:21.181601Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:21.181617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:21.181619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:21.181620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:21.181629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256486630423023:11795]
2025-10-01T14:14:21.181632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256486630423023:11795]
2025-10-01T14:14:21.181635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256486630423023:11795]
2025-10-01T14:14:21.181669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:21.181672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:21.181674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.181675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:21.181677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:21.181689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:21.181793Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:21.233171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256489007325105:12142]
2025-10-01T14:14:21.233407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2221, pipe: [1:7556256489007325105:12142]
2025-10-01T14:14:21.325135Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:21.332758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.332789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.332962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.333017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.333074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.333123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.333162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.333170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.333229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.333285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.333337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.333389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.333439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.333448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.333508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.333563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.333623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.333681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.333728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.333731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.333798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.333860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.333918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.333978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.334020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.334025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.334089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.334149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.334204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.334266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.334306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.334313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.334391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.334455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.334517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.334586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.334630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.334636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.334700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.334754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.334817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.334884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.334932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.334938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.335018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.335091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.335162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.335230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.335278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.335285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.335356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.335415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.335476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.335540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.335584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.335591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.335655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.335718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.335778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.335839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.335884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.335892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.335962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325105:12142], now have 1 active actors on pipe
2025-10-01T14:14:21.337066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:21.337076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:21.337078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:21.337082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:21.337110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2222 reason: error at write: Disconnected sessionId: src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0
2025-10-01T14:14:21.337130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256489007325105:12142]
2025-10-01T14:14:21.337281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2222 sessionId: src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0 is DEAD
2025-10-01T14:14:21.337529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:21.337540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0] Write session will restart in 0.007749s
2025-10-01T14:14:21.337565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0] Write session: Do CDS request
2025-10-01T14:14:21.337571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:21.344782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:21.346362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:21.346560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:21.346573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:21.346584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:21.346637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:21.346677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256486630423088:11798]
2025-10-01T14:14:21.347006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.347117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:21.347131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2223
2025-10-01T14:14:21.347247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.347240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:21.347275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:21.347284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:21.347288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:21.347551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:21.347596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:21.347887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:21.347940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.347945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.347947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.347948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.347949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.347950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.347951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.347952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.347953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.347957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.347958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.347959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.347960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.347961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.347966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.347976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.347979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.347983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.347987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.347990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.347994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.347997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.348001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.348005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.348008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.348012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.348015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.348019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.348025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.348032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.348037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.348043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.348047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.348051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.348055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.348060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.348064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.348069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.348072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.348085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.348090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.348099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.348103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.348108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.348115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.348119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.348122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.348126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.348133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.348137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.348141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.348146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.348150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.348154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.348158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.348162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.348199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:21.347672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2223 sessionId:  describe result for acl check
2025-10-01T14:14:21.347705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:21.347707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:21.347709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:21.347714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256489007325130:12267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:21.348190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256489007325130:12267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:21.350101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256489007325130:12267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:21.352392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:21.353164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:21.353184Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:21.353186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:21.353189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:21.353196Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2222 [2:7556256486630423088:11798]
2025-10-01T14:14:21.353212Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:21.353232Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:21.353240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.353243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.353245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.353263Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:21.353268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:21.353278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:21.353285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256489007325130:12267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:21.353310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256489007325130:12267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:21.353314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256489007325130:12267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:21.353322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:21.353343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.353349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.353351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.353354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:21.353357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:21.353424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:21.353433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.353445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.353455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.353470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:21.353488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325108:2446], now have 1 active actors on pipe
2025-10-01T14:14:21.353502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256486630423083:11798]
2025-10-01T14:14:21.353509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256486630423083:11798]
2025-10-01T14:14:21.353514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256486630423083:11798]
2025-10-01T14:14:21.353529Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:21.353511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2222
2025-10-01T14:14:21.353540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:21.353546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:21.353551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:21.353552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:21.353561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:21.353565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:21.353611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325167:12267], now have 1 active actors on pipe
2025-10-01T14:14:21.353623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256486630423083:11798]
2025-10-01T14:14:21.353633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:21.353640Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:21.353680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2222
2025-10-01T14:14:21.353745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.353759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.353783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a3c0651-cfd42706-f450de63-14a529f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:21.353795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.353805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.353807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:21.353817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.353831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:21.353848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.353985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.354000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.354038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.354148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2223 partition: 0 MaxSeqNo: 45 sessionId: src_id|2a3c0651-cfd42706-f450de63-14a529f5_0
2025-10-01T14:14:21.354497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f9737a9-396ccdf5-e00959b7-5da63eb8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2a3c0651-cfd42706-f450de63-14a529f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:21.357343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3c0651-cfd42706-f450de63-14a529f5_0] Write session: try to update token
2025-10-01T14:14:21.357361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3c0651-cfd42706-f450de63-14a529f5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:21.370964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2223 sessionId: src_id|2a3c0651-cfd42706-f450de63-14a529f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:21.373267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:21.373470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.373501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.373522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:21.373525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:21.373528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:21.373530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:21.373540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256486630423083:11798]
2025-10-01T14:14:21.373545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256486630423083:11798]
2025-10-01T14:14:21.373549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256486630423083:11798]
2025-10-01T14:14:21.373584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:21.373596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:21.373599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:21.373605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:21.373611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.373613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:21.373731Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:21.436989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256489007325174:12142]
2025-10-01T14:14:21.437325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2222, pipe: [1:7556256489007325174:12142]
2025-10-01T14:14:21.518549Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:21.518854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:21.518905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325174:12142], now have 1 active actors on pipe
2025-10-01T14:14:21.518992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:21.519061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256489007325174:12142]
2025-10-01T14:14:21.519091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:21.519093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:21.519093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:21.519158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2223 reason: error at write: Disconnected sessionId: src_id|2a3c0651-cfd42706-f450de63-14a529f5_0
2025-10-01T14:14:21.519465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3c0651-cfd42706-f450de63-14a529f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:21.519476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3c0651-cfd42706-f450de63-14a529f5_0] Write session will restart in 0.006527s
2025-10-01T14:14:21.519500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3c0651-cfd42706-f450de63-14a529f5_0] Write session: Do CDS request
2025-10-01T14:14:21.519506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3c0651-cfd42706-f450de63-14a529f5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:21.519299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2223 sessionId: src_id|2a3c0651-cfd42706-f450de63-14a529f5_0 is DEAD
2025-10-01T14:14:21.526859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3c0651-cfd42706-f450de63-14a529f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.526917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:21.526931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2224
2025-10-01T14:14:21.527080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.527126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:21.527135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:21.527139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:21.527456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2224 sessionId:  describe result for acl check
2025-10-01T14:14:21.527482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:21.527487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:21.527488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:21.527491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256489007325200:12271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:21.527914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256489007325200:12271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:21.530205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:21.531092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256489007325200:12271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:21.532242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:21.532451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:21.532461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:21.532472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:21.532521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:21.532552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256486630423160:11801]
2025-10-01T14:14:21.533091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:21.533440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:21.533481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:21.533767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:21.533824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.533831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.533832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.533833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.533834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.533835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.533836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.533837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.533837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.533838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.533839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.533840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.533841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.533842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.533846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.533855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.533858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.533861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.533864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.533867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.533869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.533872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.533875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.533878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.533881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.533885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.533888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.533891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.533899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.533905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.533909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.533913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.533921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.533925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.533929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.533934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.533937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.533941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.533944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.533948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.533952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.533956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.533959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.533963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.533966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.533971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.533974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.533978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.533982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.533986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.533989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.533993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.533998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.534002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.534005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.534008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.534040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:21.533851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256489007325200:12271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:21.533866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256489007325200:12271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:21.533870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256489007325200:12271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:21.533879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:21.537915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:21.538590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:21.538611Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:21.538614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:21.538618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:21.538625Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2223 [2:7556256486630423160:11801]
2025-10-01T14:14:21.538640Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:21.538659Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:21.538667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.538670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.538674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.538693Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:21.538703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:21.538712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:21.538767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.538774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.538775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.538778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:21.538781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:21.538846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:21.538853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.538864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.538874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.538888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:21.538909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256486630423154:11801]
2025-10-01T14:14:21.538911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256486630423154:11801]
2025-10-01T14:14:21.538913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256486630423154:11801]
2025-10-01T14:14:21.538921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:21.538930Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:21.538933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:21.538934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:21.538935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:21.538949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:21.538952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:21.538965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325237:12271], now have 1 active actors on pipe
2025-10-01T14:14:21.538968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325180:2446], now have 1 active actors on pipe
2025-10-01T14:14:21.538998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256486630423154:11801]
2025-10-01T14:14:21.539006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:21.539025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:21.539076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2223
2025-10-01T14:14:21.539111Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2223
2025-10-01T14:14:21.539146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.539162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.539194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53ca38df-31382877-f973d991-a5d371ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:21.539206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.539210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.539212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:21.539236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.539251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:21.539272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.539473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.539486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.539505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.539597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2224 partition: 0 MaxSeqNo: 45 sessionId: src_id|53ca38df-31382877-f973d991-a5d371ab_0
2025-10-01T14:14:21.539957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a3c0651-cfd42706-f450de63-14a529f5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|53ca38df-31382877-f973d991-a5d371ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:21.542808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ca38df-31382877-f973d991-a5d371ab_0] Write session: try to update token
2025-10-01T14:14:21.542825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ca38df-31382877-f973d991-a5d371ab_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:21.549816Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:21.549839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:21.549849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256486630423154:11801]
2025-10-01T14:14:21.549888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:21.549890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:21.550062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:21.550199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:21.550331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:21.550488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:21.550685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:21.550722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:21.558027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2224 sessionId: src_id|53ca38df-31382877-f973d991-a5d371ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:21.560616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:21.560768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.560793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.560827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:21.560933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:21.567456Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:21.567477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:21.567482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:21.567486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:21.567496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256486630423154:11801]
2025-10-01T14:14:21.567498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256486630423154:11801]
2025-10-01T14:14:21.567500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256486630423154:11801]
2025-10-01T14:14:21.567539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:21.567543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.567545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:21.567559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:21.567565Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:21.567569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:21.567663Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:21.619245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256489007325252:12142]
2025-10-01T14:14:21.619509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2223, pipe: [1:7556256489007325252:12142]
2025-10-01T14:14:21.716918Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:21.724363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.724400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.724546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.724612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.724672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.724735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.724779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.724787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.724845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.724904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.724964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.725022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.725062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.725071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.725134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.725195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.725268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.725329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.725372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.725382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.725451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.725512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.725572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.725642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.725689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.725696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.725776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.725861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.725927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.725996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.726050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.726055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.726155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.726248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.726344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.726478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.726540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.726544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.726652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.726734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.726850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.726958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.727019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.727024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.727154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.727260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.727403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.727533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.727614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.727629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.727749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.727871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.727993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.728070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.728127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.728135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.728206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:21.728305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:21.728382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:21.728492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:21.728541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:21.728549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:21.728623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325252:12142], now have 1 active actors on pipe
2025-10-01T14:14:21.728846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256489007325252:12142]
2025-10-01T14:14:21.728872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:21.728878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:21.728879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:21.728920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2224 reason: error at write: Disconnected sessionId: src_id|53ca38df-31382877-f973d991-a5d371ab_0
2025-10-01T14:14:21.729130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2224 sessionId: src_id|53ca38df-31382877-f973d991-a5d371ab_0 is DEAD
2025-10-01T14:14:21.729239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ca38df-31382877-f973d991-a5d371ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:21.729251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ca38df-31382877-f973d991-a5d371ab_0] Write session will restart in 0.006970s
2025-10-01T14:14:21.729288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ca38df-31382877-f973d991-a5d371ab_0] Write session: Do CDS request
2025-10-01T14:14:21.729295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ca38df-31382877-f973d991-a5d371ab_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:21.729723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:21.737915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53ca38df-31382877-f973d991-a5d371ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.738006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:21.738032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2225
2025-10-01T14:14:21.738145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.738174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:21.738186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:21.738192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:21.738595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2225 sessionId:  describe result for acl check
2025-10-01T14:14:21.738633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:21.738638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:21.738639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:21.738645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256489007325270:12276] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:21.739167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256489007325270:12276] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:21.740283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:21.741169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256489007325270:12276] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:21.741838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:21.742069Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:21.742083Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:21.742095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:21.742151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:21.742207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256486630423222:11803]
2025-10-01T14:14:21.742816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:21.743101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:21.743148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:21.743439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:21.743508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.743509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.743510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.743511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.743516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.743517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.743518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.743519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.743521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.743523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.743524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.743525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.743526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.743527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.743533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.743542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.743546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.743551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.743554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.743558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.743562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.743566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.743569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.743574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.743577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.743581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.743587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.743591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.743597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.743604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.743609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.743614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.743619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.743623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.743627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.743633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.743637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.743642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.743646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.743650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.743655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.743661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.743665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.743669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.743673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.743677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.743681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.743685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.743689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.743694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.743697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.743702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.743706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.743711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.743715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.743719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.743767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:21.744024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256489007325270:12276] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:21.744037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256489007325270:12276] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:21.744040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256489007325270:12276] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:21.744053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:21.747324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:21.747997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:21.748012Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:21.748015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:21.748018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:21.748024Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2224 [2:7556256486630423222:11803]
2025-10-01T14:14:21.748040Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:21.748063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:21.748070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.748074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.748077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.748092Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:21.748101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:21.748108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:21.748162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.748169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.748171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.748175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:21.748177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:21.748245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:21.748253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.748265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.748275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.748295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:21.748318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325255:2446], now have 1 active actors on pipe
2025-10-01T14:14:21.748326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325316:12276], now have 1 active actors on pipe
2025-10-01T14:14:21.748333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256486630423216:11803]
2025-10-01T14:14:21.748339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256486630423216:11803]
2025-10-01T14:14:21.748341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256486630423216:11803]
2025-10-01T14:14:21.748354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:21.748345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2224
2025-10-01T14:14:21.748367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:21.748374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2224
2025-10-01T14:14:21.748370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:21.748377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:21.748378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:21.748384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:21.748387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:21.748431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.748440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.748453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256486630423216:11803]
2025-10-01T14:14:21.748464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:21.748475Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:21.748495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:21.748504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.748508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.748513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:21.748521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.748533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:21.748559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.748698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.748710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.748724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.748797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2225 partition: 0 MaxSeqNo: 45 sessionId: src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0
2025-10-01T14:14:21.749128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53ca38df-31382877-f973d991-a5d371ab_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:21.751810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0] Write session: try to update token
2025-10-01T14:14:21.751829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:21.765835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2225 sessionId: src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:21.768264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:21.768348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:21.768367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:21.768369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:21.768370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:21.768377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256486630423216:11803]
2025-10-01T14:14:21.768381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256486630423216:11803]
2025-10-01T14:14:21.768388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256486630423216:11803]
2025-10-01T14:14:21.768411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:21.768415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:21.768418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:21.768448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.768459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.768479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:21.768491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.768492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:21.768619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:21.829189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256489007325349:12142]
2025-10-01T14:14:21.829491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2224, pipe: [1:7556256489007325349:12142]
2025-10-01T14:14:21.910688Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:21.911119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325349:12142], now have 1 active actors on pipe
2025-10-01T14:14:21.911333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:21.911340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:21.911457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256489007325349:12142]
2025-10-01T14:14:21.911492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:21.911495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:21.911554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2225 reason: error at write: Disconnected sessionId: src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0
2025-10-01T14:14:21.911759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2225 sessionId: src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0 is DEAD
2025-10-01T14:14:21.911890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:21.911901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0] Write session will restart in 0.008633s
2025-10-01T14:14:21.911926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0] Write session: Do CDS request
2025-10-01T14:14:21.911932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:21.919071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:21.920460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:21.920617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:21.920625Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:21.920632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:21.920665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:21.920691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256486630423292:11808]
2025-10-01T14:14:21.921097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:21.921388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:21.921432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:21.921711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:21.921760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.921761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.921762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.921762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.921763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.921764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.921764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.921765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.921765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.921766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.921768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.921769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.921770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.921770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.921773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.921779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.921781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.921783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.921785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.921787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.921789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.921791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.921793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.921795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.921797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.921799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.921801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.921804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.921810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.921814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:21.921818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.921821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:21.921823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.921826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:21.921828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.921831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:21.921834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.921863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.921837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:21.921839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.921842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:21.921844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.921849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:21.921851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.921854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:21.921858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.921862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:21.921866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.921871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.921875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.921880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.921884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.921888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.921890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.921892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:21.921894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.921897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:21.921917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:21.921939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:21.921953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2226
2025-10-01T14:14:21.922095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:21.922123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:21.922131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:21.922135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:21.922493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2226 sessionId:  describe result for acl check
2025-10-01T14:14:21.922529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:21.922532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:21.922534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:21.922539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256489007325388:8704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:21.923067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256489007325388:8704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:21.925518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256489007325388:8704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:21.928049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:21.928070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256489007325388:8704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:21.928085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256489007325388:8704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:21.928090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256489007325388:8704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:21.928102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:21.928694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:21.928711Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:21.928713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:21.928717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:21.928723Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2225 [2:7556256486630423292:11808]
2025-10-01T14:14:21.928737Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:21.928754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:21.928756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.928760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.928762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.928778Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:21.928788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:21.928797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:21.928854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.928862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.928864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.928866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:21.928869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:21.928937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:21.928945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.928957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:21.928969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:21.928987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:21.929009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325422:8704], now have 1 active actors on pipe
2025-10-01T14:14:21.929019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256489007325360:2446], now have 1 active actors on pipe
2025-10-01T14:14:21.929027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256486630423287:11808]
2025-10-01T14:14:21.929029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256486630423287:11808]
2025-10-01T14:14:21.929031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256486630423287:11808]
2025-10-01T14:14:21.929046Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:21.929061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:21.929060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:21.929063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:21.929066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:21.929080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:21.929087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:21.929062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2225
2025-10-01T14:14:21.929064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2225
2025-10-01T14:14:21.929131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.929140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.929152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256486630423287:11808]
2025-10-01T14:14:21.929162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:21.929170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:21.929194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:21.929205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:21.929213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:21.929216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:21.929228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:21.929241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:21.929264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.929402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.929412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.929428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:21.929488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2226 partition: 0 MaxSeqNo: 45 sessionId: src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0
2025-10-01T14:14:21.929791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67cdafaa-db0e8644-5f566806-bb44fc49_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:21.932495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0] Write session: try to update token
2025-10-01T14:14:21.932516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:21.945617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2226 sessionId: src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:21.947826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:21.948550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:21.948581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:21.948597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:21.948601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:21.948603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:21.948605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:21.948613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256486630423287:11808]
2025-10-01T14:14:21.948623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256486630423287:11808]
2025-10-01T14:14:21.948626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256486630423287:11808]
2025-10-01T14:14:21.948670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:21.948678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:21.948683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:21.948684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:21.948685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:21.948687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:21.948792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:22.011395Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256493302292728:12142]
2025-10-01T14:14:22.011675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2225, pipe: [1:7556256493302292728:12142]
2025-10-01T14:14:22.086997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:22.087220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:22.087265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292728:12142], now have 1 active actors on pipe
2025-10-01T14:14:22.087368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:22.087470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:22.087511Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256493302292728:12142]
2025-10-01T14:14:22.093731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:22.095029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:22.095195Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:22.095203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:22.095211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:22.095249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:22.095277Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256490925390650:11810]
2025-10-01T14:14:22.095658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:22.095842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:22.095866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:22.096047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:22.096080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.096084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.096085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.096087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.096088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.096089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.096089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.096090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.096091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.096091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.096092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.096092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.096093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.096094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.096097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.096102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.096104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.096106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.096108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.096110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.096112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.096114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.096116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.096118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.096121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.096123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.096124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.096126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.096131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.096135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.096139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.096141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.096144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.096147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.096149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.096152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.096154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.096157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.096159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.096162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.096164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.096166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.096169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.096172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.096174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.096177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.096179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.096181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.096184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.096186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.096192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.096195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.096197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.096199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.096205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.096207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.096227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:22.096954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:22.096963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:22.096979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2226 reason: error at write: Disconnected sessionId: src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0
2025-10-01T14:14:22.097096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2226 sessionId: src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0 is DEAD
2025-10-01T14:14:22.097197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:22.097206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0] Write session will restart in 0.006544s
2025-10-01T14:14:22.097224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0] Write session: Do CDS request
2025-10-01T14:14:22.097228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:22.101026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:22.101726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:22.101750Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:22.101754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:22.101758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:22.101766Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2226 [2:7556256490925390650:11810]
2025-10-01T14:14:22.101785Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:22.101816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:22.101824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.101832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.101842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.101862Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:22.101872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:22.101878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:22.101949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.101958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.101960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.101963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:22.101965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:22.102045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:22.102055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.102069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.102081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.102105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:22.102125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292729:2446], now have 1 active actors on pipe
2025-10-01T14:14:22.102140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256490925390645:11810]
2025-10-01T14:14:22.102149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256490925390645:11810]
2025-10-01T14:14:22.102137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2226
2025-10-01T14:14:22.102151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256490925390645:11810]
2025-10-01T14:14:22.102164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:22.102181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:22.102184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:22.102190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:22.102192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:22.102199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:22.102202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:22.102233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256490925390645:11810]
2025-10-01T14:14:22.102247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:22.102256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:22.104904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.104978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:22.104990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2227
2025-10-01T14:14:22.105112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.105148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:22.105155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:22.105158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:22.105500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2227 sessionId:  describe result for acl check
2025-10-01T14:14:22.105531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:22.105532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:22.105534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:22.105538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256493302292763:8668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:22.105983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256493302292763:8668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:22.108264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256493302292763:8668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:22.114279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256493302292763:8668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:22.114306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256493302292763:8668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:22.114309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256493302292763:8668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:22.114318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:22.114555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292797:8668], now have 1 active actors on pipe
2025-10-01T14:14:22.114584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2226
2025-10-01T14:14:22.114666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.114698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.114730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81f8ad45-a65b5695-867c4bf6-df620435_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:22.114744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.114753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.114756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:22.114771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.114790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:22.114813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.114930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.114937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.114951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.115018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2227 partition: 0 MaxSeqNo: 45 sessionId: src_id|81f8ad45-a65b5695-867c4bf6-df620435_0
2025-10-01T14:14:22.115314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8c4b873-93c3e1c7-24193a4b-bf7689a6_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|81f8ad45-a65b5695-867c4bf6-df620435_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:22.118245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f8ad45-a65b5695-867c4bf6-df620435_0] Write session: try to update token
2025-10-01T14:14:22.118262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f8ad45-a65b5695-867c4bf6-df620435_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:22.123349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:22.123372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:22.123375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:22.123377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:22.123386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256490925390645:11810]
2025-10-01T14:14:22.123392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256490925390645:11810]
2025-10-01T14:14:22.123396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256490925390645:11810]
2025-10-01T14:14:22.123436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:22.123442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:22.123442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:22.123445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:22.123449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.123451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:22.123573Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:22.136821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2227 sessionId: src_id|81f8ad45-a65b5695-867c4bf6-df620435_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:22.139382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:22.187591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256493302292804:12142]
2025-10-01T14:14:22.187839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2226, pipe: [1:7556256493302292804:12142]
2025-10-01T14:14:22.267522Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:22.267797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.267811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.267830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292804:12142], now have 1 active actors on pipe
2025-10-01T14:14:22.267995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:22.268043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256493302292804:12142]
2025-10-01T14:14:22.268050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:22.268069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:22.268147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2227 reason: status is not ok: tablet will be restarted right now sessionId: src_id|81f8ad45-a65b5695-867c4bf6-df620435_0
2025-10-01T14:14:22.268306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2227 sessionId: src_id|81f8ad45-a65b5695-867c4bf6-df620435_0 is DEAD
2025-10-01T14:14:22.268477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f8ad45-a65b5695-867c4bf6-df620435_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:22.268488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f8ad45-a65b5695-867c4bf6-df620435_0] Write session will restart in 0.009310s
2025-10-01T14:14:22.268516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f8ad45-a65b5695-867c4bf6-df620435_0] Write session: Do CDS request
2025-10-01T14:14:22.268521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f8ad45-a65b5695-867c4bf6-df620435_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:22.274589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:22.275740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:22.275891Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:22.275901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:22.275912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:22.275955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:22.275990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256490925390744:11823]
2025-10-01T14:14:22.276528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:22.276742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:22.276776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:22.277053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:22.277098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.277103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.277104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.277105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.277106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.277107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.277108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.277109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.277112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.277113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.277114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.277115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.277116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.277116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.277121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.277130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.277134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.277137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.277141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.277144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.277148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.277151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.277155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.277159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.277162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.277169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.277174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.277181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.277188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.277200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.277206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.277210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.277215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.277220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.277226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.277231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.277235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.277240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.277244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.277250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.277254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.277259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.277262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.277267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.277271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.277276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.277279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.277284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.277288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.277292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.277296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.277301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.277305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.277309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.277313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.277318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.277358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:22.278771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f8ad45-a65b5695-867c4bf6-df620435_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.278914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:22.278927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2228
2025-10-01T14:14:22.279022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.279052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:22.279062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:22.279066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:22.279440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2228 sessionId:  describe result for acl check
2025-10-01T14:14:22.279469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:22.279474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:22.279478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:22.279483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256493302292835:8659] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:22.279991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256493302292835:8659] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:22.280714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:22.281360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:22.281375Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:22.281378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:22.281381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:22.281388Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2227 [2:7556256490925390744:11823]
2025-10-01T14:14:22.281402Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:22.281430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:22.281437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.281440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.281445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.281460Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:22.281465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:22.281475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:22.281522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.281528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.281530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.281533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:22.281535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:22.281598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:22.281605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.281614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.281623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.281641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:22.281663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292805:2446], now have 1 active actors on pipe
2025-10-01T14:14:22.281674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256490925390739:11823]
2025-10-01T14:14:22.281677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256490925390739:11823]
2025-10-01T14:14:22.281681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256490925390739:11823]
2025-10-01T14:14:22.281693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:22.281685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2227
2025-10-01T14:14:22.281708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:22.281717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:22.281720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:22.281722Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:22.281722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:22.281725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:22.281755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256490925390739:11823]
2025-10-01T14:14:22.281766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:22.281778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:22.281986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256493302292835:8659] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:22.288074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256493302292835:8659] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:22.288088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256493302292835:8659] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:22.288091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256493302292835:8659] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:22.288101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:22.288358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292874:8659], now have 1 active actors on pipe
2025-10-01T14:14:22.288421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2227
2025-10-01T14:14:22.288473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.288486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.288512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:22.288529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.288539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.288545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:22.288556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.288584Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:22.288608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.288735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.288742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.288755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.288806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2228 partition: 0 MaxSeqNo: 45 sessionId: src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0
2025-10-01T14:14:22.289128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f8ad45-a65b5695-867c4bf6-df620435_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:22.292102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0] Write session: try to update token
2025-10-01T14:14:22.292118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:22.292202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:22.292217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:22.292225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256490925390739:11823]
2025-10-01T14:14:22.292252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:22.292267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:22.292435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:22.292582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:22.292718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:22.292858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:22.293031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:22.293067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:22.307080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2228 sessionId: src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:22.309569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:22.310149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.310175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.310194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:22.310197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:22.310199Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:22.310202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:22.310211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256490925390739:11823]
2025-10-01T14:14:22.310214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256490925390739:11823]
2025-10-01T14:14:22.310217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256490925390739:11823]
2025-10-01T14:14:22.310246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:22.310257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:22.310260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:22.310268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:22.310279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.310281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:22.310425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:22.368245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256493302292878:12142]
2025-10-01T14:14:22.368447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2227, pipe: [1:7556256493302292878:12142]
2025-10-01T14:14:22.446641Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:22.446875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:22.446911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292878:12142], now have 1 active actors on pipe
2025-10-01T14:14:22.447024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:22.447057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256493302292878:12142]
2025-10-01T14:14:22.447075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:22.447122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:22.447129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:22.447216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2228 reason: error at write: Disconnected sessionId: src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0
2025-10-01T14:14:22.447375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2228 sessionId: src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0 is DEAD
2025-10-01T14:14:22.447530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:22.447537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0] Write session will restart in 0.008701s
2025-10-01T14:14:22.447561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0] Write session: Do CDS request
2025-10-01T14:14:22.447569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:22.455940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:22.457525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:22.457674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:22.457683Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:22.457694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:22.457739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:22.457778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256490925390820:11826]
2025-10-01T14:14:22.457916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.458041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:22.458056Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2229
2025-10-01T14:14:22.458175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.458207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:22.458212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:22.458215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:22.458227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:22.458608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2229 sessionId:  describe result for acl check
2025-10-01T14:14:22.458642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:22.458648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:22.458652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:22.458656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256493302292910:8644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:22.459051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:22.459108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:22.459143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256493302292910:8644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:22.459425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:22.459488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.459494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.459495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.459496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.459497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.459500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.459502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.459503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.459504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.459505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.459507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.459508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.459509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.459510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.459516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.459525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.459529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.459533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.459537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.459541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.459544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.459548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.459552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.459557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.459560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.459564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.459568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.459571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.459577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.459585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.459591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.459600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.459604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.459609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.459618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.459623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.459627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.459637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.459641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.459650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.459654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.459659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.459667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.459673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.459678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.459686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.459690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.459696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.459703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.459708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.459713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.459722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.459726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.459731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.459738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.459743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.459783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:22.461125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256493302292910:8644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:22.463611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256493302292910:8644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:22.463625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256493302292910:8644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:22.463628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256493302292910:8644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:22.463637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:22.463809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:22.464464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:22.464479Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:22.464482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:22.464485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:22.464491Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2228 [2:7556256490925390820:11826]
2025-10-01T14:14:22.464506Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:22.464525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:22.464532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.464538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.464543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.464560Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:22.464569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:22.464587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:22.464638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.464644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.464646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.464649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:22.464651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:22.464709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:22.464716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.464725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.464734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.464748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:22.464767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292879:2446], now have 1 active actors on pipe
2025-10-01T14:14:22.464774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292947:8644], now have 1 active actors on pipe
2025-10-01T14:14:22.464780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256490925390815:11826]
2025-10-01T14:14:22.464787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256490925390815:11826]
2025-10-01T14:14:22.464789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256490925390815:11826]
2025-10-01T14:14:22.464800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:22.464815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:22.464825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:22.464830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:22.464832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:22.464836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:22.464838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:22.464850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2228
2025-10-01T14:14:22.464861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256490925390815:11826]
2025-10-01T14:14:22.464856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2228
2025-10-01T14:14:22.464870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:22.464872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:22.464899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.464903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.464931Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b992f981-5c618760-efe8460-493ccbde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:22.464943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.464946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.464948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:22.464955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.464967Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:22.464983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.465133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.465145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.465165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.465269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2229 partition: 0 MaxSeqNo: 45 sessionId: src_id|b992f981-5c618760-efe8460-493ccbde_0
2025-10-01T14:14:22.465600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d0fac0-2f3a8f3c-38f48eb3-1a442a35_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b992f981-5c618760-efe8460-493ccbde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:22.468252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b992f981-5c618760-efe8460-493ccbde_0] Write session: try to update token
2025-10-01T14:14:22.468268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b992f981-5c618760-efe8460-493ccbde_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:22.481785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2229 sessionId: src_id|b992f981-5c618760-efe8460-493ccbde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:22.484076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:22.485795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.485822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.485843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:22.485847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:22.485849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:22.485851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:22.485860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256490925390815:11826]
2025-10-01T14:14:22.485866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256490925390815:11826]
2025-10-01T14:14:22.485869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256490925390815:11826]
2025-10-01T14:14:22.485914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:22.485923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:22.485929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:22.485930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.485932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:22.485933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:22.486057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:22.547011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256493302292958:12142]
2025-10-01T14:14:22.547279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2228, pipe: [1:7556256493302292958:12142]
2025-10-01T14:14:22.635107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:22.635481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:22.635539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292958:12142], now have 1 active actors on pipe
2025-10-01T14:14:22.635633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:22.636075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:22.636130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256493302292958:12142]
2025-10-01T14:14:22.644088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:22.645428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:22.645599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:22.645613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:22.645623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:22.645669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:22.645713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256490925390886:11828]
2025-10-01T14:14:22.645836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:22.645846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:22.645862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2229 reason: error at write: Disconnected sessionId: src_id|b992f981-5c618760-efe8460-493ccbde_0
2025-10-01T14:14:22.645974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2229 sessionId: src_id|b992f981-5c618760-efe8460-493ccbde_0 is DEAD
2025-10-01T14:14:22.646112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b992f981-5c618760-efe8460-493ccbde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:22.646123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b992f981-5c618760-efe8460-493ccbde_0] Write session will restart in 0.007065s
2025-10-01T14:14:22.646148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b992f981-5c618760-efe8460-493ccbde_0] Write session: Do CDS request
2025-10-01T14:14:22.646154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b992f981-5c618760-efe8460-493ccbde_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:22.646295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:22.650114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:22.650181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:22.650536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:22.650592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.650600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.650601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.650602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.650604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.650606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.650607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.650608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.650609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.650611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.650612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.650613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.650614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.650615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.650621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.650632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.650637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.650641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.650645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.650650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.650653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.650658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.650662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.650666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.650670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.650674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.650677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.650682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.650689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.650698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.650704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.650709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.650713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.650718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.650722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.650727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.650745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.650764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.650768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.650773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.650778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.650783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.650792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.650796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.650806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.650811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.650820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.650825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.650833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.650839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.650844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.650849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.650856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.650862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.650870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.650875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.650917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:22.653936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b992f981-5c618760-efe8460-493ccbde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.653986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:22.654001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2230
2025-10-01T14:14:22.654146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.654176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:22.654185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:22.654189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:22.654603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2230 sessionId:  describe result for acl check
2025-10-01T14:14:22.654634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:22.654640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:22.654643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:22.654648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256493302292997:8633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:22.654817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:22.655155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256493302292997:8633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:22.655461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:22.655473Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:22.655475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:22.655478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:22.655485Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2229 [2:7556256490925390886:11828]
2025-10-01T14:14:22.655503Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:22.655522Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:22.655528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.655532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.655535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.655549Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:22.655556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:22.655562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:22.655612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.655618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.655620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.655624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:22.655626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:22.655686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:22.655693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.655704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.655713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.655728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:22.655748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302292965:2446], now have 1 active actors on pipe
2025-10-01T14:14:22.655759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256490925390881:11828]
2025-10-01T14:14:22.655764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256490925390881:11828]
2025-10-01T14:14:22.655766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256490925390881:11828]
2025-10-01T14:14:22.655778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:22.655786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:22.655788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:22.655790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:22.655775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2229
2025-10-01T14:14:22.655794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:22.655808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:22.655813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:22.655845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256490925390881:11828]
2025-10-01T14:14:22.655853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:22.655857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:22.657481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256493302292997:8633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:22.663373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256493302292997:8633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:22.663388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256493302292997:8633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:22.663394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256493302292997:8633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:22.663408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:22.663631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302293035:8633], now have 1 active actors on pipe
2025-10-01T14:14:22.663668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2229
2025-10-01T14:14:22.663761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.663773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.663800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:22.663816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.663826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.663834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:22.663847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.663866Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:22.663891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.664031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.664041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.664053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.664122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2230 partition: 0 MaxSeqNo: 45 sessionId: src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0
2025-10-01T14:14:22.664443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b992f981-5c618760-efe8460-493ccbde_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:22.667125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0] Write session: try to update token
2025-10-01T14:14:22.667142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:22.667361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:22.667381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:22.667390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256490925390881:11828]
2025-10-01T14:14:22.667426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:22.667430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:22.667584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:22.667717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:22.667849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:22.667982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:22.668166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:22.668205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:22.681273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2230 sessionId: src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:22.683947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:22.684125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.684148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.684184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:22.684263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:22.685979Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:22.686000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:22.686002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:22.686005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:22.686014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256490925390881:11828]
2025-10-01T14:14:22.686018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256490925390881:11828]
2025-10-01T14:14:22.686022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256490925390881:11828]
2025-10-01T14:14:22.686055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:22.686065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:22.686067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:22.686070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:22.686071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.686074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:22.686195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:22.736435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256493302293038:12142]
2025-10-01T14:14:22.736694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2229, pipe: [1:7556256493302293038:12142]
2025-10-01T14:14:22.841307Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:22.848700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.848730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.848876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.848928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.848985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.849040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.849413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.849419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.849480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.849539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.849596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.849651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.849690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.849692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.849750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.849799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.849851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.849902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.849987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.849989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.850050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.850108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.850165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.850221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.850256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.850257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.850318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.850367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.850438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.850490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.850589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.850606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.850672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.850727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.850794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.850866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.850909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.850916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.852511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:22.852525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:22.852553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2230 reason: error at write: Disconnected sessionId: src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0
2025-10-01T14:14:22.852779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2230 sessionId: src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0 is DEAD
2025-10-01T14:14:22.852839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 188 BytesWritten: 85606466 MessagesWritten: 38 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 18022416 MessagesInflight: 10 }
2025-10-01T14:14:22.852870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:22.852875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0] Write session will restart in 0.008392s
2025-10-01T14:14:22.852901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0] Write session: Do CDS request
2025-10-01T14:14:22.852909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:22.850986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.851050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.851112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.851181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.851224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.851226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.851307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.851374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.851459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.851529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.851580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.851583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.851666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.851733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.853022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256493302293038:12142]
2025-10-01T14:14:22.851795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.853047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:22.851858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.851903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.851905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.851970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:22.852020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:22.852083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:22.852135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:22.852180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:22.852182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:22.852248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302293038:12142], now have 1 active actors on pipe
2025-10-01T14:14:22.852841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:22.861207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:22.862712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:22.862913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.862955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:22.862969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2231
2025-10-01T14:14:22.863137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:22.863167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:22.863175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:22.863178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:22.862879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:22.862890Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:22.862900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:22.862948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:22.862980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256490925390953:11831]
2025-10-01T14:14:22.863525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:22.863529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2231 sessionId:  describe result for acl check
2025-10-01T14:14:22.863563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:22.863564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:22.863566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:22.863570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256493302293094:8603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:22.863831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:22.863875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:22.864041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256493302293094:8603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:22.864191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:22.864239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.864246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.864247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.864249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.864250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.864251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.864253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.864254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.864255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.864256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.864257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.864258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.864258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.864259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.864265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.864273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.864276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.864280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.864283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.864286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.864290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.864293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.864297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.864301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.864304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.864309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.864312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.864316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.864322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.864326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:22.864329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.864332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:22.864335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.864338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:22.864343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.864347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:22.864349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.864352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:22.864356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.864359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:22.864362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.864365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:22.864369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.864373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:22.864377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.864382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:22.864386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.864391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.864395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.864399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.864403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.864408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.864411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.864415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:22.864419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.864423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:22.864457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:22.865689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256493302293094:8603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:22.868208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:22.868885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:22.868898Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:22.868899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:22.868902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:22.868907Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2230 [2:7556256490925390953:11831]
2025-10-01T14:14:22.868918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:22.868931Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:22.868933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.868935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.868936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.868949Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:22.868952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:22.868957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:22.868997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.869003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.869004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.869006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:22.869007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:22.869064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:22.869075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.869085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:22.869094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:22.869107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:22.869131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302293066:2446], now have 1 active actors on pipe
2025-10-01T14:14:22.869142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256490925390948:11831]
2025-10-01T14:14:22.869147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256490925390948:11831]
2025-10-01T14:14:22.869150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256490925390948:11831]
2025-10-01T14:14:22.869159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:22.869141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2230
2025-10-01T14:14:22.869171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:22.869172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:22.869175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:22.869178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:22.869184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:22.869185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:22.869218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256490925390948:11831]
2025-10-01T14:14:22.869227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:22.869239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:22.869718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256493302293094:8603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:22.869733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256493302293094:8603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:22.869737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256493302293094:8603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:22.869745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:22.870151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302293136:8603], now have 1 active actors on pipe
2025-10-01T14:14:22.870220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2230
2025-10-01T14:14:22.870271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.870283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.870308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:22.870320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:22.870328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:22.870331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:22.870340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:22.870354Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:22.870365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.870502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.870510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.870535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:22.870649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2231 partition: 0 MaxSeqNo: 45 sessionId: src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0
2025-10-01T14:14:22.870964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98b344c5-a95a382f-7a57228c-b5ff308c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:22.873818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0] Write session: try to update token
2025-10-01T14:14:22.873834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:22.885316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:22.885335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:22.885344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256490925390948:11831]
2025-10-01T14:14:22.885369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:22.885381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:22.885555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:22.885695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:22.885829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:22.885960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:22.886154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:22.886192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:22.888552Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2231 sessionId: src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:22.890772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:22.891208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:22.891230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:22.891264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:22.891343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:22.899234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:22.899257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:22.899260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:22.899262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:22.899274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256490925390948:11831]
2025-10-01T14:14:22.899278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256490925390948:11831]
2025-10-01T14:14:22.899281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256490925390948:11831]
2025-10-01T14:14:22.899315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:22.899322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:22.899325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:22.899326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:22.899333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:22.899335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:22.899485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:22.952989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256493302293152:12142]
2025-10-01T14:14:22.953225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2230, pipe: [1:7556256493302293152:12142]
2025-10-01T14:14:23.045239Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:23.052981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.053005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.053160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.053230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.053297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.053370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.053421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.053450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.053516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.053568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.053633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.053698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.053744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.053752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.053815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.053873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.053929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.053987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.054026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.054032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.054091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.054155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.054209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.054262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.054317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.054325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.054393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.054454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.054515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.054573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.054613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.054622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.054704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.054772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.054848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.054918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.054967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.054974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.055043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.055126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.055202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.055278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.055327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.055333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.055413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.055482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.055556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.055625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.055682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.055689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.055777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.055850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.055921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.055998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.056051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.056059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.056139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.056208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.056293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.056365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.056420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.056427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.056500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256493302293152:12142], now have 1 active actors on pipe
2025-10-01T14:14:23.056726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:23.056758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256493302293152:12142]
2025-10-01T14:14:23.056758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:23.056785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:23.056796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:23.056823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2231 reason: error at write: Disconnected sessionId: src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0
2025-10-01T14:14:23.057001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2231 sessionId: src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0 is DEAD
2025-10-01T14:14:23.057127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:23.057139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0] Write session will restart in 0.007809s
2025-10-01T14:14:23.057164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0] Write session: Do CDS request
2025-10-01T14:14:23.057169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:23.064279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:23.065812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:23.065914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.065983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:23.065997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2232
2025-10-01T14:14:23.066013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:23.066025Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:23.066035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:23.066080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:23.066103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.066118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256495220358325:11835]
2025-10-01T14:14:23.066130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:23.066157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:23.066160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:23.066539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2232 sessionId:  describe result for acl check
2025-10-01T14:14:23.066573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:23.066578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:23.066580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:23.066585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256497597260480:8579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:23.066685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:23.066978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:23.067019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:23.067062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256497597260480:8579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:23.067397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:23.067449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.067456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.067457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.067458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.067459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.067460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.067461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.067462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.067464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.067465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.067466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.067467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.067468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.067470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.067474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.067482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.067485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.067488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.067491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.067495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.067498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.067500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.067503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.067506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.067509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.067512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.067515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.067518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.067525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.067531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.067536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.067541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.067551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.067555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.067564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.067568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.067572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.067580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.067583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.067586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.067590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.067594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.067597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.067601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.067604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.067608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.067611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.067622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.067625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.067629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.067637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.067641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.067645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.067650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.067653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.067657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.067693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:23.070078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256497597260480:8579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:23.071298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:23.072150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:23.072167Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:23.072169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:23.072175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:23.072181Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2231 [2:7556256495220358325:11835]
2025-10-01T14:14:23.072194Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:23.072209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:23.072216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.072219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.072222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.072236Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:23.072244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:23.072249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:23.072298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.072304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.072306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.072308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:23.072310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:23.072369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:23.072376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.072387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.072400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.072384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256497597260480:8579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:23.072397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256497597260480:8579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:23.072401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256497597260480:8579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:23.072408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:23.072419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:23.072438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260451:2446], now have 1 active actors on pipe
2025-10-01T14:14:23.072449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256495220358320:11835]
2025-10-01T14:14:23.072454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256495220358320:11835]
2025-10-01T14:14:23.072456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256495220358320:11835]
2025-10-01T14:14:23.072467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:23.072483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:23.072487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:23.072490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:23.072492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:23.072499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:23.072502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:23.072506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2231
2025-10-01T14:14:23.072530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256495220358320:11835]
2025-10-01T14:14:23.072535Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:23.072537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:23.072562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260518:8579], now have 1 active actors on pipe
2025-10-01T14:14:23.072608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2231
2025-10-01T14:14:23.072637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.072644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.072666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2619faa-2749c625-f3116c03-41084f60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:23.072675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.072682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.072684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:23.072693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.072705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:23.072719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.073031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.073038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.073049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.073150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2232 partition: 0 MaxSeqNo: 45 sessionId: src_id|d2619faa-2749c625-f3116c03-41084f60_0
2025-10-01T14:14:23.073438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfaf8e74-360dc97c-f7049eae-333a505e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d2619faa-2749c625-f3116c03-41084f60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:23.075950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2619faa-2749c625-f3116c03-41084f60_0] Write session: try to update token
2025-10-01T14:14:23.075963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2619faa-2749c625-f3116c03-41084f60_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:23.088442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2232 sessionId: src_id|d2619faa-2749c625-f3116c03-41084f60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:23.090727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:23.090898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.090923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.093083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:23.093102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:23.093104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:23.093106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:23.093113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256495220358320:11835]
2025-10-01T14:14:23.093118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256495220358320:11835]
2025-10-01T14:14:23.093122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256495220358320:11835]
2025-10-01T14:14:23.093169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:23.093176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:23.093184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:23.093187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:23.093194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:23.093206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.093212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:23.093262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:23.093339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:23.156784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256497597260527:12142]
2025-10-01T14:14:23.157037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2231, pipe: [1:7556256497597260527:12142]
2025-10-01T14:14:23.239952Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:23.248041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.248070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.248235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.248302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.248367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.248436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.248483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.248494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.248582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.248647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.248716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.248785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.248837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.248845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.248910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.248968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.249028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.249090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.249141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.249152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.249208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.249268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.249328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.249390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.249431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.249438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.249496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.249557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.249615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.249676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.249720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.249722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.249804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.249876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.249956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.250033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.250088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.250095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.250171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.250242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.250320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.250396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.250442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.250448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.250520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.250583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.250648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.250712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.250761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.250763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.250834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.250893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.250953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.251013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.251055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.251057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.251124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:23.251182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:23.251243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:23.251308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:23.251358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:23.251361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:23.251414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260527:12142], now have 1 active actors on pipe
2025-10-01T14:14:23.252878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:23.253092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2619faa-2749c625-f3116c03-41084f60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:23.253101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2619faa-2749c625-f3116c03-41084f60_0] Write session will restart in 0.009559s
2025-10-01T14:14:23.253120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2619faa-2749c625-f3116c03-41084f60_0] Write session: Do CDS request
2025-10-01T14:14:23.253124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2619faa-2749c625-f3116c03-41084f60_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:23.252523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256497597260527:12142]
2025-10-01T14:14:23.252556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:23.252559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:23.252790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2232 reason: error at write: Disconnected sessionId: src_id|d2619faa-2749c625-f3116c03-41084f60_0
2025-10-01T14:14:23.252964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2232 sessionId: src_id|d2619faa-2749c625-f3116c03-41084f60_0 is DEAD
2025-10-01T14:14:23.253114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:23.260017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:23.261458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:23.261638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:23.261646Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:23.261656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:23.261694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:23.261728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256495220358425:11848]
2025-10-01T14:14:23.262349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:23.262636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:23.262671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:23.262968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:23.263012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.263017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.263018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.263019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.263020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.263022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.263023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.263026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.263027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.263028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.263029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.263030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.263031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.263032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.263036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.263045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.263050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.263053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.263057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.263060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.263064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.263067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.263071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.263075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.263078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.263081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.263085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.263088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.263095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.263101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.263106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.263111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.263115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.263120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.263123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.263128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.263132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.263137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.263142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.263146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.263150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.263155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.263158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.263163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.263167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.263171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.263177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.263182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.263186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.263190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.263198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.263202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.263206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.263211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.263215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.263221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.263257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:23.263839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2619faa-2749c625-f3116c03-41084f60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.263942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:23.263957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2233
2025-10-01T14:14:23.264075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.264107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:23.264125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:23.264133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:23.264725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2233 sessionId:  describe result for acl check
2025-10-01T14:14:23.264758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:23.264763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:23.264765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:23.264769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256497597260565:8575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:23.265218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256497597260565:8575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:23.266736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:23.267490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:23.267496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256497597260565:8575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:23.267505Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:23.267507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:23.267510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:23.267516Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2232 [2:7556256495220358425:11848]
2025-10-01T14:14:23.267529Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:23.267546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:23.267549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.267552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.267554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.267568Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:23.267573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:23.267579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:23.267624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.267631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.267632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.267635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:23.267637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:23.267695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:23.267702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.267711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.267722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.267741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:23.267760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260531:2446], now have 1 active actors on pipe
2025-10-01T14:14:23.267771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256495220358420:11848]
2025-10-01T14:14:23.267777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256495220358420:11848]
2025-10-01T14:14:23.267779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256495220358420:11848]
2025-10-01T14:14:23.267791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:23.267801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:23.267807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:23.267810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:23.267812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:23.267824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:23.267831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:23.267846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2232
2025-10-01T14:14:23.267853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256495220358420:11848]
2025-10-01T14:14:23.267864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:23.267879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:23.274401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256497597260565:8575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:23.274417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256497597260565:8575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:23.274421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256497597260565:8575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:23.274430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:23.274689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260600:8575], now have 1 active actors on pipe
2025-10-01T14:14:23.274740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2232
2025-10-01T14:14:23.274808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.274827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.274864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31693742-d9cd060e-a6c12436-4edc708f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:23.274879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.274885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.274888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:23.274902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.274920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:23.274942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.275105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.275120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.275137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.275209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2233 partition: 0 MaxSeqNo: 45 sessionId: src_id|31693742-d9cd060e-a6c12436-4edc708f_0
2025-10-01T14:14:23.275618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2619faa-2749c625-f3116c03-41084f60_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|31693742-d9cd060e-a6c12436-4edc708f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:23.279050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31693742-d9cd060e-a6c12436-4edc708f_0] Write session: try to update token
2025-10-01T14:14:23.279068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31693742-d9cd060e-a6c12436-4edc708f_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:23.290021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:23.290044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:23.290046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:23.290048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:23.290058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256495220358420:11848]
2025-10-01T14:14:23.290076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256495220358420:11848]
2025-10-01T14:14:23.290080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256495220358420:11848]
2025-10-01T14:14:23.290125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:23.290127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:23.290133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.290135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:23.290140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:23.290145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:23.290261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:23.295388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2233 sessionId: src_id|31693742-d9cd060e-a6c12436-4edc708f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:23.297753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:23.352859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256497597260604:12142]
2025-10-01T14:14:23.353067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2232, pipe: [1:7556256497597260604:12142]
2025-10-01T14:14:23.430832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:23.431151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.431167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.431189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260604:12142], now have 1 active actors on pipe
2025-10-01T14:14:23.431349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:23.431412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:23.431418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256497597260604:12142]
2025-10-01T14:14:23.431439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:23.431505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2233 reason: status is not ok: tablet will be restarted right now sessionId: src_id|31693742-d9cd060e-a6c12436-4edc708f_0
2025-10-01T14:14:23.431677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2233 sessionId: src_id|31693742-d9cd060e-a6c12436-4edc708f_0 is DEAD
2025-10-01T14:14:23.431828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31693742-d9cd060e-a6c12436-4edc708f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:23.431838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31693742-d9cd060e-a6c12436-4edc708f_0] Write session will restart in 0.007254s
2025-10-01T14:14:23.431877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31693742-d9cd060e-a6c12436-4edc708f_0] Write session: Do CDS request
2025-10-01T14:14:23.431882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31693742-d9cd060e-a6c12436-4edc708f_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:23.439331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:23.439909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31693742-d9cd060e-a6c12436-4edc708f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.439994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:23.440010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2234
2025-10-01T14:14:23.440125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.440156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:23.440165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:23.440169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:23.440609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2234 sessionId:  describe result for acl check
2025-10-01T14:14:23.440640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:23.440646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:23.440648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:23.440654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256497597260637:8558] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:23.440971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:23.441151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:23.441160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:23.441147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256497597260637:8558] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:23.441170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:23.441214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:23.441251Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256495220358493:11850]
2025-10-01T14:14:23.441857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:23.442140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:23.442175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:23.442487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:23.442537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.442544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.442545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.442546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.442548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.442549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.442550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.442551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.442552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.442554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.442555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.442557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.442558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.442559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.442564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.442574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.442579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.442583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.442587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.442592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.442596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.442600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.442604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.442608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.442612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.442616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.442620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.442624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.442629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.442637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.442642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.442652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.442656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.442666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.442670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.442675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.442680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.442685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.442693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.442698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.442706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.442711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.442720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.442725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.442729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.442738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.442742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.442747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.442759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.442764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.442768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.442773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.442778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.442783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.442787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.442792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.442830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:23.443222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256497597260637:8558] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:23.446082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256497597260637:8558] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:23.446096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256497597260637:8558] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:23.446099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256497597260637:8558] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:23.446106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:23.446389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:23.446994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:23.447009Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:23.447011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:23.447014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:23.447020Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2233 [2:7556256495220358493:11850]
2025-10-01T14:14:23.447034Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:23.447049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:23.447057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.447061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.447063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.447077Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:23.447087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:23.447092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:23.447141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.447147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.447149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.447152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:23.447154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:23.447217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:23.447225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.447236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.447248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.447265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:23.447282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260676:8558], now have 1 active actors on pipe
2025-10-01T14:14:23.447289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260606:2446], now have 1 active actors on pipe
2025-10-01T14:14:23.447296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256495220358488:11850]
2025-10-01T14:14:23.447298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256495220358488:11850]
2025-10-01T14:14:23.447300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256495220358488:11850]
2025-10-01T14:14:23.447307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:23.447291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2233
2025-10-01T14:14:23.447300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2233
2025-10-01T14:14:23.447320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:23.447322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:23.447325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:23.447327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:23.447337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:23.447339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:23.447383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.447390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.447402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256495220358488:11850]
2025-10-01T14:14:23.447412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:23.447423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:23.447440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a924f9a5-120a0bc-adf146ae-324daa45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:23.447449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.447453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.447459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:23.447466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.447479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:23.447502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.447655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.447661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.447672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.447726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2234 partition: 0 MaxSeqNo: 45 sessionId: src_id|a924f9a5-120a0bc-adf146ae-324daa45_0
2025-10-01T14:14:23.448014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31693742-d9cd060e-a6c12436-4edc708f_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a924f9a5-120a0bc-adf146ae-324daa45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:23.450592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a924f9a5-120a0bc-adf146ae-324daa45_0] Write session: try to update token
2025-10-01T14:14:23.450608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a924f9a5-120a0bc-adf146ae-324daa45_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:23.463908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2234 sessionId: src_id|a924f9a5-120a0bc-adf146ae-324daa45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:23.466205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:23.467808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.467835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.467857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:23.467860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:23.467864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:23.467866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:23.467875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256495220358488:11850]
2025-10-01T14:14:23.467879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256495220358488:11850]
2025-10-01T14:14:23.467883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256495220358488:11850]
2025-10-01T14:14:23.467928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:23.467939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:23.467943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:23.467943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:23.467950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.467953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:23.468094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:23.531574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256497597260687:12142]
2025-10-01T14:14:23.531897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2233, pipe: [1:7556256497597260687:12142]
2025-10-01T14:14:23.608251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:23.608530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:23.608593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260687:12142], now have 1 active actors on pipe
2025-10-01T14:14:23.608688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:23.608909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256497597260687:12142]
2025-10-01T14:14:23.608931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:23.617254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:23.618601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:23.618754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:23.618764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:23.618775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:23.618814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:23.618843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256495220358575:11853]
2025-10-01T14:14:23.619529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:23.619780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:23.619815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:23.619811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:23.619827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:23.619850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2234 reason: error at write: Disconnected sessionId: src_id|a924f9a5-120a0bc-adf146ae-324daa45_0
2025-10-01T14:14:23.620016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:23.620045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2234 sessionId: src_id|a924f9a5-120a0bc-adf146ae-324daa45_0 is DEAD
2025-10-01T14:14:23.620062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.620071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.620072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.620073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.620074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.620074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.620075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.620076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.620077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.620078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.620079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.620080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.620081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.620082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.620133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a924f9a5-120a0bc-adf146ae-324daa45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:23.620087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.620096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.620145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a924f9a5-120a0bc-adf146ae-324daa45_0] Write session will restart in 0.007612s
2025-10-01T14:14:23.620101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.620106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.620109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.620113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.620117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.620120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.620180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a924f9a5-120a0bc-adf146ae-324daa45_0] Write session: Do CDS request
2025-10-01T14:14:23.620125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.620129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.620187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a924f9a5-120a0bc-adf146ae-324daa45_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:23.620133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.620151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.620155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.620159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.620165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.620172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.620178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.620184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.620188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.620193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.620197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.620203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.620208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.620213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.620217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.620223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.620226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.620230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.620234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.620239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.620244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.620249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.620253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.620262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.620266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.620271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.620276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.620283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.620287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.620292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.620296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.620301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.620336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:23.628136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:23.628792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:23.628805Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:23.628807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:23.628811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:23.628818Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2234 [2:7556256495220358575:11853]
2025-10-01T14:14:23.628834Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:23.628849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a924f9a5-120a0bc-adf146ae-324daa45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.628856Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:23.628863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.628869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.628871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.628887Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:23.628897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:23.628905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:23.628962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.628968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.628970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.628973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:23.628941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:23.628975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:23.628955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2235
2025-10-01T14:14:23.629042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:23.629048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.629059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.629074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.629071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.629093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:23.629102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:23.629113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:23.629117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:23.629114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260693:2446], now have 1 active actors on pipe
2025-10-01T14:14:23.629125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256495220358570:11853]
2025-10-01T14:14:23.629123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2234
2025-10-01T14:14:23.629131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256495220358570:11853]
2025-10-01T14:14:23.629133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256495220358570:11853]
2025-10-01T14:14:23.629142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:23.629156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:23.629159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:23.629163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:23.629165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:23.629173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:23.629177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:23.629217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256495220358570:11853]
2025-10-01T14:14:23.629227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:23.629237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:23.629449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2235 sessionId:  describe result for acl check
2025-10-01T14:14:23.629477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:23.629483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:23.629485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:23.629491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256497597260733:8548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:23.629886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256497597260733:8548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:23.632006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256497597260733:8548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:23.637613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256497597260733:8548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:23.637628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256497597260733:8548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:23.637630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256497597260733:8548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:23.637637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:23.637846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260769:8548], now have 1 active actors on pipe
2025-10-01T14:14:23.637936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2234
2025-10-01T14:14:23.638000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.638012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.638037Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15ddef6c-dd505526-94cb9923-1fa49727_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:23.638049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.638054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.638056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:23.638066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.638079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:23.638102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.638247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.638256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.638283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.638353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2235 partition: 0 MaxSeqNo: 45 sessionId: src_id|15ddef6c-dd505526-94cb9923-1fa49727_0
2025-10-01T14:14:23.638763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a924f9a5-120a0bc-adf146ae-324daa45_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|15ddef6c-dd505526-94cb9923-1fa49727_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:23.639542Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:23.639556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:23.639564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256495220358570:11853]
2025-10-01T14:14:23.639593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:23.639602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:23.639776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:23.639922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:23.640059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:23.640202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:23.640387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:23.640425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:23.641565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ddef6c-dd505526-94cb9923-1fa49727_0] Write session: try to update token
2025-10-01T14:14:23.641583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ddef6c-dd505526-94cb9923-1fa49727_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:23.655456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2235 sessionId: src_id|15ddef6c-dd505526-94cb9923-1fa49727_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:23.657804Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:23.658012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:23.658025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:23.658027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:23.658028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:23.658036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256495220358570:11853]
2025-10-01T14:14:23.658039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256495220358570:11853]
2025-10-01T14:14:23.658042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256495220358570:11853]
2025-10-01T14:14:23.658075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:23.658080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:23.658083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:23.658095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.658103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.658122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:23.658130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.658132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:23.658242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:23.667534Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] Counters: { Errors: 22 CurrentSessionLifetimeMs: 481685 BytesRead: 27033614 MessagesRead: 12 BytesReadCompressed: 27033614 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 4505604 BytesInflightTotal: 6758406 MessagesInflight: 3 }
2025-10-01T14:14:23.709210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256497597260773:12142]
2025-10-01T14:14:23.709466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2234, pipe: [1:7556256497597260773:12142]
2025-10-01T14:14:23.799218Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:23.799598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260773:12142], now have 1 active actors on pipe
2025-10-01T14:14:23.799795Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:23.799850Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256497597260773:12142]
2025-10-01T14:14:23.799881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:23.799888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:23.799962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2235 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15ddef6c-dd505526-94cb9923-1fa49727_0
2025-10-01T14:14:23.800141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2235 sessionId: src_id|15ddef6c-dd505526-94cb9923-1fa49727_0 is DEAD
2025-10-01T14:14:23.800276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ddef6c-dd505526-94cb9923-1fa49727_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:23.800286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ddef6c-dd505526-94cb9923-1fa49727_0] Write session will restart in 0.007172s
2025-10-01T14:14:23.800321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ddef6c-dd505526-94cb9923-1fa49727_0] Write session: Do CDS request
2025-10-01T14:14:23.800327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ddef6c-dd505526-94cb9923-1fa49727_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:23.808861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15ddef6c-dd505526-94cb9923-1fa49727_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.809373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:23.809919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:23.809932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2236
2025-10-01T14:14:23.810049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.810084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:23.810103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:23.810111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:23.810759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2236 sessionId:  describe result for acl check
2025-10-01T14:14:23.810798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:23.810806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:23.810808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:23.810813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256497597260821:8532] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:23.810962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:23.811203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:23.811215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:23.811229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:23.811300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:23.811340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256497597260821:8532] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:23.811357Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256495220358648:11856]
2025-10-01T14:14:23.811978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:23.812278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:23.812323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:23.812651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:23.812712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.812717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.812719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.812720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.812721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.812722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.812723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.812724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.812725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.812727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.812728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.812729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.812730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.812731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.812736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.812746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.812750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.812753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.812757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.812761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.812765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.812768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.812772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.812776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.812780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.812783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.812787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.812792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.812798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.812802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:23.812806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.812809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:23.812812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.812815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:23.812817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.812820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:23.812822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.812825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:23.812828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.812831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:23.812833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.812836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:23.812839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.812842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:23.812846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.812851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:23.812855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.812864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.812868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.812876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.812881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.812886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.812894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.812898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:23.812902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.812910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:23.812949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:23.813387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256497597260821:8532] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:23.816249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256497597260821:8532] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:23.816265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256497597260821:8532] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:23.816268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256497597260821:8532] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:23.816276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:23.816427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:23.817023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:23.817035Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:23.817037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:23.817039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:23.817043Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2235 [2:7556256495220358648:11856]
2025-10-01T14:14:23.817052Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:23.817065Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:23.817069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.817071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.817072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.817083Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:23.817086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:23.817090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:23.817126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.817131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.817132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.817134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:23.817136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:23.817181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:23.817188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.817195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:23.817200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:23.817208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:23.817220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260860:8532], now have 1 active actors on pipe
2025-10-01T14:14:23.817223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260787:2446], now have 1 active actors on pipe
2025-10-01T14:14:23.817229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256495220358643:11856]
2025-10-01T14:14:23.817231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256495220358643:11856]
2025-10-01T14:14:23.817232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256495220358643:11856]
2025-10-01T14:14:23.817240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:23.817250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:23.817253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:23.817255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:23.817257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:23.817258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:23.817259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:23.817279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256495220358643:11856]
2025-10-01T14:14:23.817288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:23.817303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:23.817320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2235
2025-10-01T14:14:23.817323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2235
2025-10-01T14:14:23.817378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.817384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.817404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:23.817414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:23.817418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:23.817419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:23.817424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:23.817434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:23.817444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.817581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.817586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.817595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:23.817675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2236 partition: 0 MaxSeqNo: 45 sessionId: src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0
2025-10-01T14:14:23.818001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15ddef6c-dd505526-94cb9923-1fa49727_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:23.820911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0] Write session: try to update token
2025-10-01T14:14:23.820927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:23.837033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:23.837048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:23.837051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:23.837053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:23.837063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256495220358643:11856]
2025-10-01T14:14:23.837067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256495220358643:11856]
2025-10-01T14:14:23.837075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256495220358643:11856]
2025-10-01T14:14:23.837122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:23.837126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:23.837133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:23.837133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:23.837136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:23.837137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:23.837268Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:23.844698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2236 sessionId: src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:23.847368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:23.900197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256497597260880:12142]
2025-10-01T14:14:23.900426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2235, pipe: [1:7556256497597260880:12142]
2025-10-01T14:14:23.986931Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:23.987269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:23.987283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:23.987306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260880:12142], now have 1 active actors on pipe
2025-10-01T14:14:23.987506Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:23.987544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:23.987557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:23.987560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:23.987605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256497597260880:12142]
2025-10-01T14:14:23.987627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2236 reason: error at write: Disconnected sessionId: src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0
2025-10-01T14:14:23.987842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2236 sessionId: src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0 is DEAD
2025-10-01T14:14:23.988003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:23.988014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0] Write session will restart in 0.008271s
2025-10-01T14:14:23.988042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0] Write session: Do CDS request
2025-10-01T14:14:23.988047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:23.997005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:23.997899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.997951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:23.997967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2237
2025-10-01T14:14:23.998103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:23.998137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:23.998148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:23.998151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:23.998584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2237 sessionId:  describe result for acl check
2025-10-01T14:14:23.998618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:23.998620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:23.998622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:23.998627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256497597260930:8507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:23.998750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:23.998930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:23.998954Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:23.998969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:23.999029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:23.999066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256495220358727:11860]
2025-10-01T14:14:23.999117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256497597260930:8507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:23.999596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:23.999919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:23.999966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:24.000296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:24.000351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.000356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.000357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.000358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.000359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.000361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.000362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.000363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.000364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.000366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.000367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.000368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.000372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.000373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.000378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.000387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.000391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.000395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.000398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.000402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.000406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.000409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.000413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.000417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.000421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.000425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.000428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.000432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.000438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.000445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.000451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.000456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.000462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.000479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.000484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.000495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.000504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.000509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.000513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.000518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.000522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.000527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.000535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.000541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.000545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.000553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.000558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.000568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.000586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.000590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.000593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.000596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.000601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.000606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.000615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.000620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.000662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:24.001648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256497597260930:8507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:24.004348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256497597260930:8507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:24.004365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256497597260930:8507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:24.004368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256497597260930:8507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:24.004361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:24.004376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:24.005082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:24.005096Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:24.005097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:24.005102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:24.005106Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2236 [2:7556256495220358727:11860]
2025-10-01T14:14:24.005117Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:24.005128Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:24.005130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.005134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.005135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.005150Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:24.005155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:24.005163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:24.005209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.005214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.005215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.005217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:24.005219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:24.005278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:24.005284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.005295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.005309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.005323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:24.005355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256497597260896:2446], now have 1 active actors on pipe
2025-10-01T14:14:24.005361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228262:8507], now have 1 active actors on pipe
2025-10-01T14:14:24.005367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256495220358722:11860]
2025-10-01T14:14:24.005369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256495220358722:11860]
2025-10-01T14:14:24.005371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256495220358722:11860]
2025-10-01T14:14:24.005384Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:24.005398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:24.005390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2236
2025-10-01T14:14:24.005399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2236
2025-10-01T14:14:24.005413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:24.005417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:24.005419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:24.005420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:24.005422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:24.005444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256495220358722:11860]
2025-10-01T14:14:24.005451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:24.005455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:24.005464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.005471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.005513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:24.005523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.005527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.005533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:24.005541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.005552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:24.005573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.005743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.005751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.005766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.005857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2237 partition: 0 MaxSeqNo: 45 sessionId: src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0
2025-10-01T14:14:24.006221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ab93ac-5fa6fa13-4a12db57-1d16b40a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:24.009039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0] Write session: try to update token
2025-10-01T14:14:24.009056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:24.026329Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:24.026347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:24.026349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:24.026352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:24.026362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256495220358722:11860]
2025-10-01T14:14:24.026367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256495220358722:11860]
2025-10-01T14:14:24.026388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256495220358722:11860]
2025-10-01T14:14:24.026430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:24.026437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:24.026440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:24.026443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:24.026447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.026449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:24.026599Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:24.028604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2237 sessionId: src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:24.031474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:24.089168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256501892228269:12142]
2025-10-01T14:14:24.089475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2236, pipe: [1:7556256501892228269:12142]
2025-10-01T14:14:24.172909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:24.173186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.173198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.173233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228269:12142], now have 1 active actors on pipe
2025-10-01T14:14:24.173463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:24.173476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:24.173486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:24.173525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2237 reason: error at write: Disconnected sessionId: src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0
2025-10-01T14:14:24.173533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256501892228269:12142]
2025-10-01T14:14:24.173845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:24.173854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0] Write session will restart in 0.009096s
2025-10-01T14:14:24.173705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2237 sessionId: src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0 is DEAD
2025-10-01T14:14:24.173878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0] Write session: Do CDS request
2025-10-01T14:14:24.173862Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:24.173890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:24.181617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:24.183097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:24.183279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:24.183290Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:24.183300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:24.183345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:24.183394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256499515326096:11862]
2025-10-01T14:14:24.183860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.183977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:24.184095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:24.184111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2238
2025-10-01T14:14:24.184229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.184241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:24.184260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:24.184269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:24.184273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:24.184282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:24.184555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:24.184623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.184629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.184630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.184631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.184632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.184632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.184634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.184635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.184635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.184628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2238 sessionId:  describe result for acl check
2025-10-01T14:14:24.184636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.184659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:24.184662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:24.184664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:24.184637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.184669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256501892228310:8483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:24.184638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.184639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.184640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.184644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.184652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.184656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.184659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.184664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.184668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.184671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.184674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.184678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.184681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.184684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.184687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.184690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.184692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.184699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.184706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.184711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.184716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.184720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.184724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.184728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.184732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.184736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.184740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.184745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.184750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.184754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.184759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.184762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.184767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.184771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.184775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.184778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.184782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.184786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.184791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.184794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.184798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.184801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.184806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.184809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.184813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.184847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:24.185156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256501892228310:8483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:24.187036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256501892228310:8483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:24.188873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:24.189510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:24.189523Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:24.189526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:24.189530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:24.189536Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2237 [2:7556256499515326096:11862]
2025-10-01T14:14:24.189549Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:24.189564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:24.189571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.189553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256501892228310:8483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:24.189575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.189567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256501892228310:8483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:24.189577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.189594Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:24.189570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256501892228310:8483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:24.189578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:24.189599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:24.189609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:24.189657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.189664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.189666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.189668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:24.189670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:24.189733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:24.189740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.189750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.189761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.189781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:24.189802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228272:2446], now have 1 active actors on pipe
2025-10-01T14:14:24.189809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228346:8483], now have 1 active actors on pipe
2025-10-01T14:14:24.189800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2237
2025-10-01T14:14:24.189810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2237
2025-10-01T14:14:24.189816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256499515326091:11862]
2025-10-01T14:14:24.189822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256499515326091:11862]
2025-10-01T14:14:24.189824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256499515326091:11862]
2025-10-01T14:14:24.189832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:24.189839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:24.189842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:24.189843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:24.189850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:24.189868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:24.189874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:24.189892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.189900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.189937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256499515326091:11862]
2025-10-01T14:14:24.189949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:24.189959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:24.189965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:24.189971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.189975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.189977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:24.189985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.189996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:24.190030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.190148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.190154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.190166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.190236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2238 partition: 0 MaxSeqNo: 45 sessionId: src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0
2025-10-01T14:14:24.190595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de88f1ac-c6af0a4b-7f16512f-927891df_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:24.193423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0] Write session: try to update token
2025-10-01T14:14:24.193440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:24.208804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2238 sessionId: src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:24.209975Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:24.209997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:24.209999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:24.210001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:24.210009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256499515326091:11862]
2025-10-01T14:14:24.210012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256499515326091:11862]
2025-10-01T14:14:24.210018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256499515326091:11862]
2025-10-01T14:14:24.210056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:24.210066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:24.210067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:24.210069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:24.210076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.210077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:24.210210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:24.211120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:24.270393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256501892228353:12142]
2025-10-01T14:14:24.270717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2237, pipe: [1:7556256501892228353:12142]
2025-10-01T14:14:24.347072Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:24.347400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.347413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.347448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228353:12142], now have 1 active actors on pipe
2025-10-01T14:14:24.347665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256501892228353:12142]
2025-10-01T14:14:24.347679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:24.347683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:24.347700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:24.347739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2238 reason: error at write: Disconnected sessionId: src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0
2025-10-01T14:14:24.347915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2238 sessionId: src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0 is DEAD
2025-10-01T14:14:24.348023Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:24.348038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:24.348056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0] Write session will restart in 0.006766s
2025-10-01T14:14:24.348079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0] Write session: Do CDS request
2025-10-01T14:14:24.348085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:24.354466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:24.355827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.355824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:24.355855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:24.355865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2239
2025-10-01T14:14:24.356007Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:24.356012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.356017Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:24.356028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:24.356032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:24.356039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:24.356042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:24.356074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:24.356113Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256499515326201:11875]
2025-10-01T14:14:24.356323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2239 sessionId:  describe result for acl check
2025-10-01T14:14:24.356343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:24.356348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:24.356349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:24.356353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256501892228392:8450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:24.356659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:24.356722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256501892228392:8450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:24.356918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:24.356959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:24.357189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:24.357223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.357227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.357228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.357228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.357229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.357229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.357230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.357231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.357231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.357232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.357233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.357233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.357234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.357235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.357237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.357243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.357245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.357247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.357249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.357251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.357253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.357255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.357257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.357261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.357263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.357265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.357267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.357269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.357273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.357278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.357281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.357284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.357287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.357289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.357293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.357296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.357300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.357302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.357304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.357306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.357309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.357311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.357313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.357316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.357318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.357321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.357324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.357326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.357328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.357331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.357333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.357336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.357338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.357341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.357343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.357346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.357365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:24.358305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256501892228392:8450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:24.360321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256501892228392:8450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:24.360331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256501892228392:8450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:24.360333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256501892228392:8450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:24.360337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:24.360670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:24.361252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:24.361264Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:24.361265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:24.361267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:24.361271Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2238 [2:7556256499515326201:11875]
2025-10-01T14:14:24.361280Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:24.361295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:24.361300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.361303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.361304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.361314Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:24.361317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:24.361321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:24.361353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.361358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.361359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.361361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:24.361362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:24.361419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:24.361426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.361436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.361447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.361465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:24.361484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228355:2446], now have 1 active actors on pipe
2025-10-01T14:14:24.361487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228431:8450], now have 1 active actors on pipe
2025-10-01T14:14:24.361491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256499515326196:11875]
2025-10-01T14:14:24.361492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256499515326196:11875]
2025-10-01T14:14:24.361493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256499515326196:11875]
2025-10-01T14:14:24.361500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2238
2025-10-01T14:14:24.361503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2238
2025-10-01T14:14:24.361506Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:24.361519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:24.361523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:24.361525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:24.361526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:24.361531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:24.361533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:24.361563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.361571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.361580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256499515326196:11875]
2025-10-01T14:14:24.361589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:24.361603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:24.361611Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a270177c-4a526675-9ddd645f-244b604a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:24.361617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.361620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.361622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:24.361629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.361641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:24.361675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.361770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.361778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.361792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.361847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2239 partition: 0 MaxSeqNo: 45 sessionId: src_id|a270177c-4a526675-9ddd645f-244b604a_0
2025-10-01T14:14:24.362098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ad8d21-b0af996e-67ae5ff9-d1649cb7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a270177c-4a526675-9ddd645f-244b604a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:24.364685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a270177c-4a526675-9ddd645f-244b604a_0] Write session: try to update token
2025-10-01T14:14:24.364698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a270177c-4a526675-9ddd645f-244b604a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:24.379788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2239 sessionId: src_id|a270177c-4a526675-9ddd645f-244b604a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:24.380714Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:24.380731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:24.380735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:24.380737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:24.380746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256499515326196:11875]
2025-10-01T14:14:24.380749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256499515326196:11875]
2025-10-01T14:14:24.380751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256499515326196:11875]
2025-10-01T14:14:24.380797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:24.380800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:24.380806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.380806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:24.380807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:24.380809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:24.380924Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:24.382268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:24.448030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256501892228438:12142]
2025-10-01T14:14:24.448202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2238, pipe: [1:7556256501892228438:12142]
2025-10-01T14:14:24.518258Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:24.518496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.518506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.518543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228438:12142], now have 1 active actors on pipe
2025-10-01T14:14:24.518703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:24.518714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:24.518751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256501892228438:12142]
2025-10-01T14:14:24.518777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:24.518792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2239 reason: error at write: Disconnected sessionId: src_id|a270177c-4a526675-9ddd645f-244b604a_0
2025-10-01T14:14:24.518947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2239 sessionId: src_id|a270177c-4a526675-9ddd645f-244b604a_0 is DEAD
2025-10-01T14:14:24.519074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270177c-4a526675-9ddd645f-244b604a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:24.519083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270177c-4a526675-9ddd645f-244b604a_0] Write session will restart in 0.006585s
2025-10-01T14:14:24.519102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270177c-4a526675-9ddd645f-244b604a_0] Write session: Do CDS request
2025-10-01T14:14:24.519121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270177c-4a526675-9ddd645f-244b604a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:24.519385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:24.526572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:24.526839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a270177c-4a526675-9ddd645f-244b604a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.526892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:24.526903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2240
2025-10-01T14:14:24.527051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.527074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:24.527080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:24.527089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:24.527390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2240 sessionId:  describe result for acl check
2025-10-01T14:14:24.527421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:24.527427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:24.527429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:24.527436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256501892228483:8451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:24.527808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256501892228483:8451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:24.528418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:24.528589Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:24.528598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:24.528609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:24.528646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:24.528677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256499515326288:11878]
2025-10-01T14:14:24.529083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:24.529288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:24.529315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:24.529514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:24.529549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.529555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.529556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.529557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.529533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256501892228483:8451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:24.529558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.529558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.529559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.529559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.529560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.529560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.529561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.529562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.529563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.529563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.529566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.529571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.529574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.529576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.529578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.529580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.529583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.529586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.529590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.529593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.529596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.529600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.529603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.529607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.529612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.529618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.529622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.529625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.529629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.529631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.529633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.529636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.529638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.529641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.529644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.529646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.529649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.529652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.529655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.529658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.529661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.529668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.529670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.529672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.529678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.529680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.529682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.529688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.529690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.529692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.529694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.529697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.529717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:24.532947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256501892228483:8451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:24.532962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256501892228483:8451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:24.532965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256501892228483:8451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:24.532973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:24.533129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:24.533810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:24.533821Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:24.533823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:24.533826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:24.533834Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2239 [2:7556256499515326288:11878]
2025-10-01T14:14:24.533846Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:24.533860Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:24.533865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.533868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.533869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.533880Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:24.533887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:24.533891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:24.533927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.533932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.533933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.533935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:24.533936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:24.533982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:24.533987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.533993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.533999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.534007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:24.534021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256499515326283:11878]
2025-10-01T14:14:24.534023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256499515326283:11878]
2025-10-01T14:14:24.534024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256499515326283:11878]
2025-10-01T14:14:24.534031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:24.534040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:24.534043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228445:2446], now have 1 active actors on pipe
2025-10-01T14:14:24.534046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228522:8451], now have 1 active actors on pipe
2025-10-01T14:14:24.534050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:24.534052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:24.534053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:24.534064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:24.534067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:24.534089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256499515326283:11878]
2025-10-01T14:14:24.534097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:24.534091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2239
2025-10-01T14:14:24.534103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2239
2025-10-01T14:14:24.534120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:24.534166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.534172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.534189Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:24.534198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.534202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.534204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:24.534212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.534223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:24.534234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.534387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.534395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.534406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.534511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2240 partition: 0 MaxSeqNo: 45 sessionId: src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0
2025-10-01T14:14:24.534824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a270177c-4a526675-9ddd645f-244b604a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:24.537831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0] Write session: try to update token
2025-10-01T14:14:24.537848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:24.544946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:24.544965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:24.544975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256499515326283:11878]
2025-10-01T14:14:24.545012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:24.545040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:24.545155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:24.545286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:24.545418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:24.545542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:24.545707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:24.545741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:24.554903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2240 sessionId: src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:24.557410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:24.557596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.557612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.557647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:24.557707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:24.563787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:24.563802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:24.563804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:24.563806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:24.563817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256499515326283:11878]
2025-10-01T14:14:24.563821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256499515326283:11878]
2025-10-01T14:14:24.563824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256499515326283:11878]
2025-10-01T14:14:24.563862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:24.563869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.563869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:24.563870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:24.563874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:24.563878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:24.563983Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:24.619046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256501892228534:12142]
2025-10-01T14:14:24.619369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2239, pipe: [1:7556256501892228534:12142]
2025-10-01T14:14:24.701594Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:24.708334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.708354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.708488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.708538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.708615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.708677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.708719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.708728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.708787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.708846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.708893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.708944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.708982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.708987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.709043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.709102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.709158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.709222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.709268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.709274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.709337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.709390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.709441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.709495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.709532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.709537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.709592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.709650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.709702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.709762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.709806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.709812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.709876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.709933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.709995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.710050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.710093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.710099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.710160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.710213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.710270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.710328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.710365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.710386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.710444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.710499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.710557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.710613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.710654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.710662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.710729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.710787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.710845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.710899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.710936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.710940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.710995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:24.711044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:24.711096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:24.711151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:24.711195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:24.711200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:24.711244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228534:12142], now have 1 active actors on pipe
2025-10-01T14:14:24.711448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:24.711454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:24.711458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:24.711487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2240 reason: error at write: Disconnected sessionId: src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0
2025-10-01T14:14:24.711501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256501892228534:12142]
2025-10-01T14:14:24.711675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2240 sessionId: src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0 is DEAD
2025-10-01T14:14:24.711801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:24.711814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0] Write session will restart in 0.007339s
2025-10-01T14:14:24.711841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0] Write session: Do CDS request
2025-10-01T14:14:24.711847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:24.712053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:24.718832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:24.719891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.719944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:24.719956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2241
2025-10-01T14:14:24.720107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.720145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:24.720168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:24.720176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:24.720341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:24.720505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2241 sessionId:  describe result for acl check
2025-10-01T14:14:24.720533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:24.720537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:24.720538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:24.720542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256501892228575:8442] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:24.720558Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:24.720568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:24.720654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:24.720721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:24.720753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256499515326364:11880]
2025-10-01T14:14:24.720924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256501892228575:8442] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:24.721280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:24.721544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:24.721580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:24.721856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:24.721901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.721906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.721907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.721908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.721908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.721909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.721910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.721912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.721912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.721913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.721914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.721914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.721915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.721915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.721918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.721924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.721926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.721928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.721930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.721932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.721934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.721936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.721938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.721940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.721942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.721944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.721946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.721949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.721955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.721961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.721967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.721972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.721987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.721990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.721992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.721995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.721997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.722000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.722003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.722005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.722009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.722012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.722014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.722017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.722020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.722022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.722025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.722027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.722029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.722032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.722034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.722037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.722040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.722042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.722045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.722047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.722068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:24.723144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256501892228575:8442] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:24.725530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:24.725633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256501892228575:8442] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:24.725648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256501892228575:8442] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:24.725651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256501892228575:8442] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:24.725659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:24.726225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:24.726237Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:24.726239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:24.726243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:24.726248Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2240 [2:7556256499515326364:11880]
2025-10-01T14:14:24.726257Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:24.726269Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:24.726273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.726276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.726277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.726291Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:24.726295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:24.726299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:24.726335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.726340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.726341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.726343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:24.726345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:24.726441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:24.726453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.726464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.726474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.726489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:24.726507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228614:8442], now have 1 active actors on pipe
2025-10-01T14:14:24.726515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228537:2446], now have 1 active actors on pipe
2025-10-01T14:14:24.726522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256499515326359:11880]
2025-10-01T14:14:24.726524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256499515326359:11880]
2025-10-01T14:14:24.726525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256499515326359:11880]
2025-10-01T14:14:24.726539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:24.726559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:24.726569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:24.726571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:24.726574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:24.726575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:24.726564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2240
2025-10-01T14:14:24.726579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:24.726591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2240
2025-10-01T14:14:24.726609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256499515326359:11880]
2025-10-01T14:14:24.726615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:24.726618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:24.726629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.726637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.726685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:24.726696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.726701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.726703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:24.726713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.726725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:24.726746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.726903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.726911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.726925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.727016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2241 partition: 0 MaxSeqNo: 45 sessionId: src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0
2025-10-01T14:14:24.727332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6b920dc-a7a1e947-2115719e-55cd8e46_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:24.730211Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0] Write session: try to update token
2025-10-01T14:14:24.730227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:24.746630Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:24.746644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:24.746647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:24.746651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:24.746660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256499515326359:11880]
2025-10-01T14:14:24.746664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256499515326359:11880]
2025-10-01T14:14:24.746667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256499515326359:11880]
2025-10-01T14:14:24.746708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:24.746714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:24.746720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:24.746721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.746724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:24.746723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:24.746814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2241 sessionId: src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:24.746914Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:24.749232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:24.811534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256501892228634:12142]
2025-10-01T14:14:24.811778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2240, pipe: [1:7556256501892228634:12142]
2025-10-01T14:14:24.886707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:24.887047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.887063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.887105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228634:12142], now have 1 active actors on pipe
2025-10-01T14:14:24.887326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256501892228634:12142]
2025-10-01T14:14:24.887366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:24.887399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:24.887409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:24.887465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2241 reason: error at write: Disconnected sessionId: src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0
2025-10-01T14:14:24.887652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2241 sessionId: src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0 is DEAD
2025-10-01T14:14:24.887348Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:24.887794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:24.887811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0] Write session will restart in 0.005199s
2025-10-01T14:14:24.887837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0] Write session: Do CDS request
2025-10-01T14:14:24.887842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:24.893897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.893919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:24.893930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2242
2025-10-01T14:14:24.894086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:24.894116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:24.894134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:24.894142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:24.894540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2242 sessionId:  describe result for acl check
2025-10-01T14:14:24.894576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:24.894583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:24.894585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:24.894590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256501892228652:8425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:24.895100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256501892228652:8425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:24.896844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:24.896873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256501892228652:8425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:24.898508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:24.898677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:24.898686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:24.898697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:24.898765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:24.898805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256499515326443:11883]
2025-10-01T14:14:24.898844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256501892228652:8425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:24.898858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256501892228652:8425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:24.898861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256501892228652:8425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:24.898869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:24.899373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:24.899643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:24.899688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:24.899946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:24.900011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.900016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.900017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.900018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.900019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.900020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.900021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.900022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.900023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.900024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.900025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.900026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.900027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.900028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.900033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.900043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.900047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.900051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.900056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.900070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.900074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.900079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.900083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.900087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.900092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.900095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.900099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.900103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.900110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.900127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:24.900134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.900140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:24.900148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.900153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:24.900160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.900165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:24.900169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.900181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:24.900186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.900191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:24.900195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.900203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:24.900211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.900216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:24.900224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.900229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:24.900238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.900247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.900252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.900257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.900264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.900269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.900275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.900282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:24.900286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.900290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:24.900332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:24.904056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:24.904745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:24.904758Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:24.904761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:24.904764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:24.904770Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2241 [2:7556256499515326443:11883]
2025-10-01T14:14:24.904789Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:24.904806Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:24.904809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.904812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.904814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.904829Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:24.904840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:24.904849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:24.904899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.904905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.904906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.904908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:24.904911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:24.904960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:24.904964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.904971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:24.904977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:24.904989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:24.905004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256499515326438:11883]
2025-10-01T14:14:24.905008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256499515326438:11883]
2025-10-01T14:14:24.905010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256499515326438:11883]
2025-10-01T14:14:24.905015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:24.905027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:24.905027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:24.905032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:24.905033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:24.905038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:24.905041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:24.905048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228709:8425], now have 1 active actors on pipe
2025-10-01T14:14:24.905073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228635:2446], now have 1 active actors on pipe
2025-10-01T14:14:24.905078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256499515326438:11883]
2025-10-01T14:14:24.905082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:24.905098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:24.905152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.905116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2241
2025-10-01T14:14:24.905162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.905135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2241
2025-10-01T14:14:24.905182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:24.905196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:24.905200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:24.905202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:24.905211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:24.905218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:24.905229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.905349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:24.905354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:24.905363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:24.905435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2242 partition: 0 MaxSeqNo: 45 sessionId: src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0
2025-10-01T14:14:24.905749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8567f00-c8b1bb03-835d5a04-6ad435df_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:24.908475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0] Write session: try to update token
2025-10-01T14:14:24.908494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:24.924659Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:24.924677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:24.924679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:24.924681Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:24.924691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256499515326438:11883]
2025-10-01T14:14:24.924696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256499515326438:11883]
2025-10-01T14:14:24.924701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256499515326438:11883]
2025-10-01T14:14:24.924747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:24.924754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:24.924756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:24.924772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:24.924790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:24.924796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:24.924897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:24.926317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2242 sessionId: src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:24.928887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:24.987698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256501892228746:12142]
2025-10-01T14:14:24.987984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2241, pipe: [1:7556256501892228746:12142]
2025-10-01T14:14:25.078619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:25.078939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.078956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.078996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256501892228746:12142], now have 1 active actors on pipe
2025-10-01T14:14:25.079201Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:25.079184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:25.079211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256501892228746:12142]
2025-10-01T14:14:25.079225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:25.079227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:25.079270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2242 reason: error at write: Disconnected sessionId: src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0
2025-10-01T14:14:25.079436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2242 sessionId: src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0 is DEAD
2025-10-01T14:14:25.079595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:25.079606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0] Write session will restart in 0.008168s
2025-10-01T14:14:25.079633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0] Write session: Do CDS request
2025-10-01T14:14:25.079639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:25.086990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:25.088347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:25.088526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:25.088538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:25.088551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:25.088624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:25.088663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256503810293826:11887]
2025-10-01T14:14:25.088833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.088933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:25.088944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2243
2025-10-01T14:14:25.089037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.089058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:25.089065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:25.089068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:25.089242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:25.089332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2243 sessionId:  describe result for acl check
2025-10-01T14:14:25.089353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:25.089358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:25.089359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:25.089362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256506187196085:8388] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:25.089576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:25.089627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:25.089743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256506187196085:8388] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:25.089921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:25.089987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.089995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.089996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.089997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.089998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.090000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.090001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.090002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.090003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.090006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.090007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.090008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.090009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.090010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.090016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.090024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.090027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.090031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.090034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.090038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.090041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.090044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.090052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.090056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.090062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.090066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.090069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.090073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.090080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.090093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.090099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.090108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.090117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.090122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.090130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.090135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.090139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.090143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.090147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.090151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.090159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.090167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.090175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.090184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.090191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.090196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.090205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.090212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.090221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.090229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.090236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.090243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.090247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.090256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.090259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.090264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.090301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:25.091161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256506187196085:8388] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:25.093796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256506187196085:8388] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:25.093817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256506187196085:8388] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:25.093820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256506187196085:8388] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:25.093795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:25.093827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:25.094535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:25.094552Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:25.094554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:25.094559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:25.094566Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2242 [2:7556256503810293826:11887]
2025-10-01T14:14:25.094580Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:25.094599Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:25.094606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.094609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.094611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.094626Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:25.094634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:25.094645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:25.094697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.094704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.094705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.094708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:25.094711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:25.094773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:25.094779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.094791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.094806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.094827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:25.094847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196045:2446], now have 1 active actors on pipe
2025-10-01T14:14:25.094854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196123:8388], now have 1 active actors on pipe
2025-10-01T14:14:25.094860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256503810293821:11887]
2025-10-01T14:14:25.094866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256503810293821:11887]
2025-10-01T14:14:25.094867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256503810293821:11887]
2025-10-01T14:14:25.094879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:25.094901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2242
2025-10-01T14:14:25.094901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2242
2025-10-01T14:14:25.094901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:25.094902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:25.094905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:25.094907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:25.094914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:25.094917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:25.094941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256503810293821:11887]
2025-10-01T14:14:25.094944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:25.094946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:25.094962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.094970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.095009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28b40d9e-de52c3b-33697474-d918e3c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:25.095019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.095023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.095026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:25.095034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.095042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:25.095058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.095245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.095259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.095274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.095338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2243 partition: 0 MaxSeqNo: 45 sessionId: src_id|28b40d9e-de52c3b-33697474-d918e3c9_0
2025-10-01T14:14:25.095653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9124d14f-21aea267-41cd81cf-7c848fe0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|28b40d9e-de52c3b-33697474-d918e3c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:25.098392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b40d9e-de52c3b-33697474-d918e3c9_0] Write session: try to update token
2025-10-01T14:14:25.098405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b40d9e-de52c3b-33697474-d918e3c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:25.116508Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:25.116529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:25.116536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:25.116539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:25.116552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256503810293821:11887]
2025-10-01T14:14:25.116558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256503810293821:11887]
2025-10-01T14:14:25.116564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256503810293821:11887]
2025-10-01T14:14:25.116630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:25.116632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:25.116643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.116646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:25.116653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:25.116657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:25.116820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:25.117113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2243 sessionId: src_id|28b40d9e-de52c3b-33697474-d918e3c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:25.119345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:25.179176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256506187196135:12142]
2025-10-01T14:14:25.179457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2242, pipe: [1:7556256506187196135:12142]
2025-10-01T14:14:25.257164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:25.257391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.257404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.257442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196135:12142], now have 1 active actors on pipe
2025-10-01T14:14:25.257640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:25.257694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:25.257739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256506187196135:12142]
2025-10-01T14:14:25.257760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2243 reason: status is not ok: tablet will be restarted right now sessionId: src_id|28b40d9e-de52c3b-33697474-d918e3c9_0
2025-10-01T14:14:25.257601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:25.257937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2243 sessionId: src_id|28b40d9e-de52c3b-33697474-d918e3c9_0 is DEAD
2025-10-01T14:14:25.258066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b40d9e-de52c3b-33697474-d918e3c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:25.258075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b40d9e-de52c3b-33697474-d918e3c9_0] Write session will restart in 0.005597s
2025-10-01T14:14:25.258105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b40d9e-de52c3b-33697474-d918e3c9_0] Write session: Do CDS request
2025-10-01T14:14:25.258110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b40d9e-de52c3b-33697474-d918e3c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:25.264884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28b40d9e-de52c3b-33697474-d918e3c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.264964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:25.264979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2244
2025-10-01T14:14:25.265080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.265110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:25.265118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:25.265121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:25.265473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2244 sessionId:  describe result for acl check
2025-10-01T14:14:25.265497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:25.265501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:25.265503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:25.265506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256506187196177:8369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:25.265894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256506187196177:8369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:25.266086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:25.267616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:25.267802Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:25.267815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:25.267827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:25.267875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:25.267913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256503810293921:11896]
2025-10-01T14:14:25.268106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256506187196177:8369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:25.268387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:25.268690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:25.268741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:25.269114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:25.269168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.269174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.269175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.269176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.269178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.269179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.269180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.269181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.269182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.269183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.269184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.269199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.269200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.269201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.269207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.269216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.269221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.269225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.269229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.269233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.269239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.269242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.269244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.269247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.269249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.269251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.269253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.269264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.269269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.269274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.269279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.269282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.269284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.269288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.269290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.269293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.269296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.269299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.269302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.269305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.269309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.269312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.269314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.269317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.269321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.269327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.269331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.269336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.269340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.269345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.269349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.269355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.269359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.269377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.269385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.269390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.269414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:25.272885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256506187196177:8369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:25.272899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256506187196177:8369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:25.272902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256506187196177:8369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:25.272914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:25.273097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:25.273797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:25.273808Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:25.273809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:25.273812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:25.273818Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2243 [2:7556256503810293921:11896]
2025-10-01T14:14:25.273827Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:25.273840Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:25.273842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.273844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.273846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.273858Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:25.273864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:25.273869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:25.273909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.273915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.273917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.273920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:25.273922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:25.273982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:25.273989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.274002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.274016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.274035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:25.274057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196218:8369], now have 1 active actors on pipe
2025-10-01T14:14:25.274064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196138:2446], now have 1 active actors on pipe
2025-10-01T14:14:25.274071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256503810293916:11896]
2025-10-01T14:14:25.274073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256503810293916:11896]
2025-10-01T14:14:25.274075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256503810293916:11896]
2025-10-01T14:14:25.274088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:25.274100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:25.274102Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:25.274082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2243
2025-10-01T14:14:25.274108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:25.274110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:25.274085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2243
2025-10-01T14:14:25.274116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:25.274118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:25.274159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.274168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.274184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256503810293916:11896]
2025-10-01T14:14:25.274194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:25.274208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:25.274225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:25.274237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.274243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.274245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:25.274254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.274264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:25.274290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.274473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.274479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.274492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.274569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2244 partition: 0 MaxSeqNo: 45 sessionId: src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0
2025-10-01T14:14:25.274915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28b40d9e-de52c3b-33697474-d918e3c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:25.277867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0] Write session: try to update token
2025-10-01T14:14:25.277979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:25.293790Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2244 sessionId: src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:25.295266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:25.295287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:25.295291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:25.295293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:25.295303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256503810293916:11896]
2025-10-01T14:14:25.295308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256503810293916:11896]
2025-10-01T14:14:25.295312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256503810293916:11896]
2025-10-01T14:14:25.295362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:25.295368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:25.295374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:25.295377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.295378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:25.295380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:25.295527Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:25.296320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:25.357867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256506187196226:12142]
2025-10-01T14:14:25.358150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2243, pipe: [1:7556256506187196226:12142]
2025-10-01T14:14:25.435007Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:25.435291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.435303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.435334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196226:12142], now have 1 active actors on pipe
2025-10-01T14:14:25.435495Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:25.435518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:25.435530Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:25.435575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2244 reason: error at write: Disconnected sessionId: src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0
2025-10-01T14:14:25.435630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:25.435678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256506187196226:12142]
2025-10-01T14:14:25.435767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2244 sessionId: src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0 is DEAD
2025-10-01T14:14:25.435891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:25.435898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0] Write session will restart in 0.007541s
2025-10-01T14:14:25.435918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0] Write session: Do CDS request
2025-10-01T14:14:25.435923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:25.443205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:25.444843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.444845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:25.444888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:25.444901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2245
2025-10-01T14:14:25.445027Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:25.445035Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:25.445046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:25.445070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.445092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:25.445098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:25.445107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:25.445110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:25.445129Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256503810294017:11902]
2025-10-01T14:14:25.445420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2245 sessionId:  describe result for acl check
2025-10-01T14:14:25.445453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:25.445458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:25.445460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:25.445464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256506187196270:8354] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:25.445528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:25.445783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:25.445814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:25.445931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256506187196270:8354] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:25.446070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:25.446120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.446125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.446126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.446127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.446128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.446129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.446130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.446131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.446132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.446133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.446134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.446135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.446136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.446137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.446141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.446150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.446153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.446157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.446161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.446164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.446167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.446171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.446177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.446181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.446185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.446188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.446192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.446195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.446201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.446208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.446213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.446218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.446222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.446227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.446231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.446236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.446247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.446252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.446256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.446260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.446265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.446269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.446275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.446277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.446280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.446283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.446285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.446288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.446290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.446293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.446295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.446297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.446303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.446306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.446309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.446315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.446343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:25.447668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256506187196270:8354] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:25.449833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:25.450076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256506187196270:8354] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:25.450088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256506187196270:8354] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:25.450091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256506187196270:8354] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:25.450098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:25.450449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:25.450457Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:25.450459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:25.450461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:25.450466Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2244 [2:7556256503810294017:11902]
2025-10-01T14:14:25.450476Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:25.450490Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:25.450493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.450496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.450498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.450514Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:25.450523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:25.450529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:25.450570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.450575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.450576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.450579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:25.450580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:25.450627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:25.450638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.450648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.450657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.450672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:25.450689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196309:8354], now have 1 active actors on pipe
2025-10-01T14:14:25.450696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196228:2446], now have 1 active actors on pipe
2025-10-01T14:14:25.450702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256503810294012:11902]
2025-10-01T14:14:25.450707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256503810294012:11902]
2025-10-01T14:14:25.450708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256503810294012:11902]
2025-10-01T14:14:25.450721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:25.450731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:25.450736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:25.450739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:25.450741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:25.450748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:25.450751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:25.450778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256503810294012:11902]
2025-10-01T14:14:25.450787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:25.450792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:25.450796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2244
2025-10-01T14:14:25.450796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2244
2025-10-01T14:14:25.450885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.450901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.450924Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:25.450937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.450946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.450949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:25.450957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.450973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:25.450993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.451161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.451172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.451187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.451263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2245 partition: 0 MaxSeqNo: 45 sessionId: src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0
2025-10-01T14:14:25.451581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5f99267-5e235a0b-9cb420c-55ffff09_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:25.454415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0] Write session: try to update token
2025-10-01T14:14:25.454431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:25.461066Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:25.461082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:25.461091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256503810294012:11902]
2025-10-01T14:14:25.461128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:25.461135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:25.461284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:25.461409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:25.461535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:25.461658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:25.462002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:25.462039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:25.467794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2245 sessionId: src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:25.470332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:25.470519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.470537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.470580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:25.470654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:25.479401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:25.479418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:25.479420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:25.479422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:25.479432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256503810294012:11902]
2025-10-01T14:14:25.479435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256503810294012:11902]
2025-10-01T14:14:25.479439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256503810294012:11902]
2025-10-01T14:14:25.479473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:25.479478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:25.479482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:25.479482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:25.479488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.479495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:25.479618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:25.536049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256506187196320:12142]
2025-10-01T14:14:25.536289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2244, pipe: [1:7556256506187196320:12142]
2025-10-01T14:14:25.635755Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:25.642118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.642139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.642271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.642323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.642411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.642476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.642716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.642728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.642790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.642864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.642923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.642996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.643041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.643047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.643111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.643167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.643229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.643288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.643328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.643334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.643401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.643462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.643525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.643586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.643629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.643636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.643698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.643756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.643820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.643883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.643924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.643930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.643997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.644057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.644119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.644181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.644224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.644232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.644298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.644355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.644413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.644472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.644521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.644528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.644596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.644643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.644692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.644741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.644779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.644783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.644841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.644891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.644944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.644999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.645036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.645040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.645090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:25.645150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:25.645204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:25.645252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:25.645289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:25.645294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:25.645336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196320:12142], now have 1 active actors on pipe
2025-10-01T14:14:25.645571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256506187196320:12142]
2025-10-01T14:14:25.645593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:25.645597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:25.645614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:25.645624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2245 reason: error at write: Disconnected sessionId: src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0
2025-10-01T14:14:25.645810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2245 sessionId: src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0 is DEAD
2025-10-01T14:14:25.645860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:25.645957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:25.645965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0] Write session will restart in 0.008179s
2025-10-01T14:14:25.645990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0] Write session: Do CDS request
2025-10-01T14:14:25.645995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:25.654184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:25.654816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.654920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:25.654934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2246
2025-10-01T14:14:25.655039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.655068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:25.655079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:25.655082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:25.655432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2246 sessionId:  describe result for acl check
2025-10-01T14:14:25.655465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:25.655471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:25.655473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:25.655478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256506187196371:8339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:25.655954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256506187196371:8339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:25.656982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:25.657179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:25.657189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:25.657201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:25.657254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:25.657292Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256503810294110:11905]
2025-10-01T14:14:25.657865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:25.658017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256506187196371:8339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:25.658140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:25.658173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:25.658385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:25.658425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.658429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.658432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.658432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.658433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.658434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.658435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.658435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.658436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.658437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.658437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.658438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.658439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.658439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.658442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.658447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.658450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.658452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.658454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.658456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.658458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.658460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.658462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.658464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.658466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.658468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.658470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.658472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.658476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.658480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.658484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.658487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.658489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.658494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.658496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.658499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.658502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.658504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.658507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.658509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.658513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.658515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.658518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.658520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.658523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.658526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.658528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.658531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.658533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.658536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.658539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.658542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.658544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.658546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.658549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.658551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.658572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:25.661670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256506187196371:8339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:25.661682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256506187196371:8339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:25.661685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256506187196371:8339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:25.661692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:25.661868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:25.662496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:25.662506Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:25.662507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:25.662510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:25.662514Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2245 [2:7556256503810294110:11905]
2025-10-01T14:14:25.662526Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:25.662538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:25.662541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.662544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.662546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.662556Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:25.662562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:25.662566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:25.662600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.662605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.662606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.662608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:25.662610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:25.662658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:25.662663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.662672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.662683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.662694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:25.662706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196410:8339], now have 1 active actors on pipe
2025-10-01T14:14:25.662712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196327:2446], now have 1 active actors on pipe
2025-10-01T14:14:25.662717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256503810294105:11905]
2025-10-01T14:14:25.662718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256503810294105:11905]
2025-10-01T14:14:25.662719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256503810294105:11905]
2025-10-01T14:14:25.662729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:25.662740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:25.662745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:25.662748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:25.662750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:25.662751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:25.662752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:25.662758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2245
2025-10-01T14:14:25.662770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256503810294105:11905]
2025-10-01T14:14:25.662775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:25.662765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2245
2025-10-01T14:14:25.662780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:25.662852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.662859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.662881Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:25.662888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.662891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.662892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:25.662898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.662904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:25.662913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.663167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.663177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.663196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.663262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2246 partition: 0 MaxSeqNo: 45 sessionId: src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0
2025-10-01T14:14:25.663564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c8748a7-c4736b33-e6e7ace5-b2dbf657_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:25.666089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0] Write session: try to update token
2025-10-01T14:14:25.666101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:25.678918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2246 sessionId: src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:25.681133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:25.682149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.682169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.682189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:25.682193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:25.682195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:25.682197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:25.682206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256503810294105:11905]
2025-10-01T14:14:25.682212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256503810294105:11905]
2025-10-01T14:14:25.682216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256503810294105:11905]
2025-10-01T14:14:25.682251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:25.682260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:25.682263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:25.682272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:25.682278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.682280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:25.682429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:25.745938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256506187196417:12142]
2025-10-01T14:14:25.746170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2245, pipe: [1:7556256506187196417:12142]
2025-10-01T14:14:25.825333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:25.825640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:25.825693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196417:12142], now have 1 active actors on pipe
2025-10-01T14:14:25.825771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:25.825827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:25.825879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256506187196417:12142]
2025-10-01T14:14:25.825912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:25.825920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:25.825936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2246 reason: error at write: Disconnected sessionId: src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0
2025-10-01T14:14:25.826084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2246 sessionId: src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0 is DEAD
2025-10-01T14:14:25.826204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:25.826214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0] Write session will restart in 0.006411s
2025-10-01T14:14:25.826239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0] Write session: Do CDS request
2025-10-01T14:14:25.826248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:25.833823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.833896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:25.833907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2247
2025-10-01T14:14:25.834008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:25.834055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:25.834065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:25.834078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:25.834420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2247 sessionId:  describe result for acl check
2025-10-01T14:14:25.834448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:25.834454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:25.834456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:25.834460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256506187196480:8328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:25.834939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256506187196480:8328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:25.835059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:25.836478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:25.836648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:25.836656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:25.836666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:25.836722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:25.836769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256503810294194:11908]
2025-10-01T14:14:25.836764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256506187196480:8328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:25.837264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:25.837514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:25.837553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:25.837833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:25.837869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.837873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.837874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.837874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.837875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.837876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.837877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.837879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.837879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.837880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.837881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.837881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.837882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.837883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.837885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.837891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.837893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.837895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.837897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.837899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.837900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.837902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.837904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.837907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.837909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.837910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.837912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.837914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.837919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.837923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:25.837927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.837930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:25.837932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.837935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:25.837938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.837941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:25.837943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.837945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:25.837948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.837951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:25.837953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.837955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:25.837958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.837960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:25.837963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.837965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:25.837967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.837970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.837972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.837975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.837978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.837980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.837982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.837985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:25.837987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.837989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:25.838008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:25.838574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256506187196480:8328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:25.838589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256506187196480:8328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:25.838592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256506187196480:8328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:25.838599Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:25.841423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:25.841995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:25.842005Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:25.842006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:25.842008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:25.842013Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2246 [2:7556256503810294194:11908]
2025-10-01T14:14:25.842021Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:25.842035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:25.842040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.842042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.842043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.842056Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:25.842062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:25.842066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:25.842100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.842105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.842106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.842108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:25.842110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:25.842167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:25.842173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.842182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:25.842190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:25.842204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:25.842224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196432:2446], now have 1 active actors on pipe
2025-10-01T14:14:25.842230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196522:8328], now have 1 active actors on pipe
2025-10-01T14:14:25.842237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256503810294189:11908]
2025-10-01T14:14:25.842243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256503810294189:11908]
2025-10-01T14:14:25.842244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256503810294189:11908]
2025-10-01T14:14:25.842257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:25.842268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:25.842281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:25.842283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:25.842285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:25.842288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:25.842290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:25.842303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256503810294189:11908]
2025-10-01T14:14:25.842305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:25.842292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2246
2025-10-01T14:14:25.842309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2246
2025-10-01T14:14:25.842321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:25.842342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.842351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.842386Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:25.842397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:25.842401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:25.842406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:25.842415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:25.842426Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:25.842441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.842567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.842574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.842586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:25.842671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2247 partition: 0 MaxSeqNo: 45 sessionId: src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0
2025-10-01T14:14:25.842963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|950d6b29-b6ee4586-e7c7e0b0-37314d9a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:25.845781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0] Write session: try to update token
2025-10-01T14:14:25.845796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:25.852644Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:25.852659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:25.852668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256503810294189:11908]
2025-10-01T14:14:25.852710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:25.852711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:25.852864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:25.852995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:25.853124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:25.853254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:25.853429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:25.853464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:25.860332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2247 sessionId: src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:25.862930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:25.863131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:25.863151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:25.863190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:25.863270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:25.870910Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:25.870928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:25.870931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:25.870932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:25.870942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256503810294189:11908]
2025-10-01T14:14:25.870950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256503810294189:11908]
2025-10-01T14:14:25.870953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256503810294189:11908]
2025-10-01T14:14:25.870987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:25.870992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:25.870994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:25.871000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:25.871009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:25.871016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:25.871148Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:25.926162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256506187196529:12142]
2025-10-01T14:14:25.926437Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2246, pipe: [1:7556256506187196529:12142]
2025-10-01T14:14:26.011070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:26.018838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.018865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.019031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.019084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.019150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.019208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.019247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.019253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.019320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.019382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.019442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.019504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.019546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.019549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.019625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.019684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.019748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.019817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.019861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.019863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.019934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.019996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.020062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.020131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.020248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.020252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.020326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.020389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.020536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.020694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.020742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.020745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.020815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.020871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.020934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.020994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.021039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.021042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.021109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.021164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.021222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.021285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.021329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.021331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.021396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.021454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.021515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.021578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.021617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.021623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.021695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.021752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.021810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.021876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.021918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.021920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.021984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.022040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.022096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.022153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.022196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.022199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.022275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256506187196529:12142], now have 1 active actors on pipe
2025-10-01T14:14:26.022978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:26.023045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:26.023049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:26.023078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2247 reason: error at write: Disconnected sessionId: src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0
2025-10-01T14:14:26.023276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2247 sessionId: src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0 is DEAD
2025-10-01T14:14:26.023449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256506187196529:12142]
2025-10-01T14:14:26.023605Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:26.024123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:26.024135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0] Write session will restart in 0.008661s
2025-10-01T14:14:26.024161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0] Write session: Do CDS request
2025-10-01T14:14:26.024167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:26.033975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.034564Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:26.034580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2248
2025-10-01T14:14:26.035536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.035570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:26.035576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:26.035581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:26.035980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2248 sessionId:  describe result for acl check
2025-10-01T14:14:26.036007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:26.036009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:26.036011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:26.036019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256510482163900:8283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:26.036548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256510482163900:8283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:26.037243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:26.039114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256510482163900:8283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:26.039409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:26.039615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:26.039628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:26.039641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:26.039700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:26.039744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256508105261581:11912]
2025-10-01T14:14:26.040400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:26.040753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:26.040801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:26.041157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:26.041227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.041235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.041236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.041237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.041239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.041240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.041241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.041242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.041243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.041244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.041245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.041246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.041247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.041249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.041254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.041264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.041268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.041272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.041277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.041281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.041286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.041290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.041295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.041299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.041304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.041307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.041313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.041319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.041326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.041335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.041340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.041346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.041350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.041356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.041361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.041365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.041370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.041376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.041380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.041385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.041390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.041396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.041406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.041412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.041421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.041428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.041437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.041442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.041447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.041457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.041461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.041466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.041474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.041479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.041488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.041494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.041531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:26.042897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256510482163900:8283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:26.042913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256510482163900:8283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:26.042916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256510482163900:8283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:26.042933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:26.045638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:26.046353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:26.046382Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:26.046385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:26.046388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:26.046396Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2247 [2:7556256508105261581:11912]
2025-10-01T14:14:26.046411Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:26.046428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:26.046431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.046434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.046438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.046453Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:26.046462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:26.046468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:26.046518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.046526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.046528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.046531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:26.046533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:26.046598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:26.046605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.046615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.046624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.046639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:26.046659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256508105261576:11912]
2025-10-01T14:14:26.046665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256508105261576:11912]
2025-10-01T14:14:26.046669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256508105261576:11912]
2025-10-01T14:14:26.046682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:26.046695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:26.046713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:26.046719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:26.046729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:26.046733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:26.046735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:26.046744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256508105261576:11912]
2025-10-01T14:14:26.046751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:26.046804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:26.046839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482163936:8283], now have 1 active actors on pipe
2025-10-01T14:14:26.046848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482163855:2446], now have 1 active actors on pipe
2025-10-01T14:14:26.046914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2247
2025-10-01T14:14:26.046963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2247
2025-10-01T14:14:26.047133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.047148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.047182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:26.047196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.047204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.047207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:26.047217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.047234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:26.047257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.047421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.047430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.047447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.047559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2248 partition: 0 MaxSeqNo: 45 sessionId: src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0
2025-10-01T14:14:26.047941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a66677f0-4f4bfd9c-b5943be4-6e5694c5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:26.051609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0] Write session: try to update token
2025-10-01T14:14:26.051633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:26.061581Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:26.061602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:26.061613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256508105261576:11912]
2025-10-01T14:14:26.061664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:26.061697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:26.061866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:26.062019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:26.062186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:26.062356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:26.062633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:26.062681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:26.079682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2248 sessionId: src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:26.082067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:26.082251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.082270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.082305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:26.082367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:26.085444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:26.085460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:26.085462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:26.085463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:26.085471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256508105261576:11912]
2025-10-01T14:14:26.085475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256508105261576:11912]
2025-10-01T14:14:26.085478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256508105261576:11912]
2025-10-01T14:14:26.085513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:26.085518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.085519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:26.085520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:26.085525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:26.085528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:26.085634Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:26.122778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256510482163943:12142]
2025-10-01T14:14:26.123040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2247, pipe: [1:7556256510482163943:12142]
2025-10-01T14:14:26.224067Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:26.230584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.230606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.230759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.230822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.230881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.230939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.230985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.230993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.231054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.231107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.231165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.231223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.231266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.231274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.231334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.231383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.231439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.231490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.231528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.231533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.231588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.231639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.231689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.231738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.231776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.231781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.231840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.231894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.231945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.231998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.232042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.232047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.232101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.232150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.232203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.232253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.232291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.232296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.232360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.232409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.232462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.232514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.232556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.232563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.232627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.232677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.232726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.232777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.232819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.232827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.232885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.232934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.232982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.233033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.233072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.233077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.233128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:26.233179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:26.233231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:26.233278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:26.233315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:26.233320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:26.233367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482163943:12142], now have 1 active actors on pipe
2025-10-01T14:14:26.233562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256510482163943:12142]
2025-10-01T14:14:26.233564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:26.233597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:26.233599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:26.233625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2248 reason: error at write: Disconnected sessionId: src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0
2025-10-01T14:14:26.233840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2248 sessionId: src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0 is DEAD
2025-10-01T14:14:26.233936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:26.233944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0] Write session will restart in 0.005464s
2025-10-01T14:14:26.233970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0] Write session: Do CDS request
2025-10-01T14:14:26.233976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:26.234120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:26.240947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.241009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:26.241023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2249
2025-10-01T14:14:26.241186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.241237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:26.241249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:26.241252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:26.241593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:26.241648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2249 sessionId:  describe result for acl check
2025-10-01T14:14:26.241678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:26.241684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:26.241685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:26.241690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256510482163991:8268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:26.242169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256510482163991:8268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:26.243275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:26.243466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:26.243475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:26.243486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:26.243542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:26.243584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256508105261666:11915]
2025-10-01T14:14:26.244115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:26.244171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256510482163991:8268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:26.244380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:26.244418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:26.244688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:26.244739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.244744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.244745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.244746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.244747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.244748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.244749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.244750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.244752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.244752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.244753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.244754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.244755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.244756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.244762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.244771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.244774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.244777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.244780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.244794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.244796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.244799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.244802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.244805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.244808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.244811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.244814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.244816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.244823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.244829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.244834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.244842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.244846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.244850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.244853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.244861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.244865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.244869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.244876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.244880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.244884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.244888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.244892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.244897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.244906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.244911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.244917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.244921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.244925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.244928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.244935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.244940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.244943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.244947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.244953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.244957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.244990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:26.248195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256510482163991:8268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:26.248209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256510482163991:8268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:26.248212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256510482163991:8268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:26.248219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:26.248562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:26.249184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:26.249195Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:26.249197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:26.249199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:26.249204Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2248 [2:7556256508105261666:11915]
2025-10-01T14:14:26.249214Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:26.249225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:26.249226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.249229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.249230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.249241Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:26.249249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:26.249253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:26.249292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.249296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.249298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.249300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:26.249302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:26.249346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:26.249351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.249358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.249364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.249372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:26.249387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164031:8268], now have 1 active actors on pipe
2025-10-01T14:14:26.249393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482163946:2446], now have 1 active actors on pipe
2025-10-01T14:14:26.249398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256508105261661:11915]
2025-10-01T14:14:26.249400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256508105261661:11915]
2025-10-01T14:14:26.249401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256508105261661:11915]
2025-10-01T14:14:26.249410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:26.249423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:26.249425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:26.249427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:26.249429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:26.249433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:26.249435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:26.249453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256508105261661:11915]
2025-10-01T14:14:26.249460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:26.249464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2248
2025-10-01T14:14:26.249466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2248
2025-10-01T14:14:26.249498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.249504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.249513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:26.249521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:26.249526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.249528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.249530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:26.249535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.249541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:26.249554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.249700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.249713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.249735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.249817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2249 partition: 0 MaxSeqNo: 45 sessionId: src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0
2025-10-01T14:14:26.250106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0707877-b8e8cc0e-1b78e7a2-d7171c74_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:26.252756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0] Write session: try to update token
2025-10-01T14:14:26.252771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:26.269425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2249 sessionId: src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:26.269713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:26.269732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:26.269734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:26.269736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:26.269744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256508105261661:11915]
2025-10-01T14:14:26.269750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256508105261661:11915]
2025-10-01T14:14:26.269755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256508105261661:11915]
2025-10-01T14:14:26.269801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:26.269805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:26.269808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.269810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:26.269811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:26.269815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:26.269941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:26.271810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:26.333706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256510482164039:12142]
2025-10-01T14:14:26.333856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2248, pipe: [1:7556256510482164039:12142]
2025-10-01T14:14:26.409137Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:26.409386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.409404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.409452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164039:12142], now have 1 active actors on pipe
2025-10-01T14:14:26.409657Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:26.409669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:26.409675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:26.409686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:26.409720Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256510482164039:12142]
2025-10-01T14:14:26.409741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2249 reason: error at write: Disconnected sessionId: src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0
2025-10-01T14:14:26.409909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2249 sessionId: src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0 is DEAD
2025-10-01T14:14:26.410080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:26.410092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0] Write session will restart in 0.007555s
2025-10-01T14:14:26.410118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0] Write session: Do CDS request
2025-10-01T14:14:26.410123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:26.418687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:26.420268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:26.420447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:26.420455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:26.420464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:26.420503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:26.420538Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256508105261783:11927]
2025-10-01T14:14:26.420832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.420886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:26.420910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2250
2025-10-01T14:14:26.421019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.421047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:26.421057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:26.421061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:26.421141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:26.421424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2250 sessionId:  describe result for acl check
2025-10-01T14:14:26.421424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:26.421453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:26.421456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:26.421459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:26.421460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:26.421465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256510482164091:8269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:26.421731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:26.421774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.421779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.421780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.421782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.421783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.421784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.421785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.421786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.421787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.421788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.421790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.421790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.421791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.421792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.421798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.421807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.421810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.421814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.421817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.421821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.421824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.421827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.421831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.421834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.421838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.421841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.421844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.421848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.421853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.421860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.421865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.421870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.421874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.421879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.421883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.421889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.421893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.421898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.421901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.421906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.421910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.421915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.421919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.421923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.421932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.421937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.421940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.421945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.421949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.421953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.421957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.421966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.421969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.421955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256510482164091:8269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:26.421974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.421981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.421986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.422023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:26.423408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256510482164091:8269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:26.425404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256510482164091:8269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:26.425418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256510482164091:8269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:26.425421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256510482164091:8269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:26.425428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:26.425542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:26.426223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:26.426235Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:26.426238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:26.426241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:26.426247Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2249 [2:7556256508105261783:11927]
2025-10-01T14:14:26.426269Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:26.426287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:26.426294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.426297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.426299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.426313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:26.426323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:26.426329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:26.426417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.426426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.426428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.426431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:26.426433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:26.426494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:26.426500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.426512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.426526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.426545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:26.426569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164127:8269], now have 1 active actors on pipe
2025-10-01T14:14:26.426573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164041:2446], now have 1 active actors on pipe
2025-10-01T14:14:26.426580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256508105261778:11927]
2025-10-01T14:14:26.426587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256508105261778:11927]
2025-10-01T14:14:26.426589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256508105261778:11927]
2025-10-01T14:14:26.426601Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:26.426612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:26.426627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:26.426628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:26.426630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:26.426636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:26.426620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2249
2025-10-01T14:14:26.426638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:26.426623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2249
2025-10-01T14:14:26.426652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256508105261778:11927]
2025-10-01T14:14:26.426654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:26.426668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:26.426683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.426691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.426718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:26.426728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.426732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.426737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:26.426747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.426757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:26.426776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.426889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.426896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.426908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.426960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2250 partition: 0 MaxSeqNo: 45 sessionId: src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0
2025-10-01T14:14:26.427235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc4f3a85-10daf76a-cdf78624-bfc36e06_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:26.430125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0] Write session: try to update token
2025-10-01T14:14:26.430140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:26.446678Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2250 sessionId: src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:26.447423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:26.447442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:26.447445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:26.447447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:26.447456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256508105261778:11927]
2025-10-01T14:14:26.447461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256508105261778:11927]
2025-10-01T14:14:26.447468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256508105261778:11927]
2025-10-01T14:14:26.447513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:26.447516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:26.447523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.447525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:26.447526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:26.447530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:26.447656Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:26.449072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:26.509851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256510482164140:12142]
2025-10-01T14:14:26.510183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2249, pipe: [1:7556256510482164140:12142]
2025-10-01T14:14:26.608455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:26.608847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.608860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.608901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164140:12142], now have 1 active actors on pipe
2025-10-01T14:14:26.609090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:26.609116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:26.609120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:26.609146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256510482164140:12142]
2025-10-01T14:14:26.609218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2250 reason: error at write: Disconnected sessionId: src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0
2025-10-01T14:14:26.609398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2250 sessionId: src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0 is DEAD
2025-10-01T14:14:26.609530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:26.609540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0] Write session will restart in 0.007533s
2025-10-01T14:14:26.609564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0] Write session: Do CDS request
2025-10-01T14:14:26.609574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:26.609698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:26.617136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:26.617816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.617963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:26.617980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2251
2025-10-01T14:14:26.618101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.618131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:26.618140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:26.618144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:26.618518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2251 sessionId:  describe result for acl check
2025-10-01T14:14:26.618546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:26.618548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:26.618550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:26.618555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256510482164196:7606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:26.618899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:26.619035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256510482164196:7606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:26.619054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:26.619062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:26.619072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:26.619107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:26.619140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256508105261882:11930]
2025-10-01T14:14:26.619747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:26.619957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:26.619996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:26.620279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:26.620324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.620329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.620330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.620332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.620333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.620334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.620336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.620337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.620338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.620339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.620342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.620343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.620344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.620345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.620349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.620358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.620362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.620365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.620373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.620377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.620385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.620388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.620392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.620395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.620399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.620402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.620406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.620409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.620418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.620429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.620438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.620443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.620450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.620455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.620464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.620468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.620472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.620477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.620481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.620486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.620490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.620499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.620503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.620508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.620517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.620525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.620502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256510482164196:7606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:26.620531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.620539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.620547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.620555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.620562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.620580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.620588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.620599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.620604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.620610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.620648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:26.623890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256510482164196:7606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:26.623904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256510482164196:7606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:26.623907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256510482164196:7606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:26.623915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:26.624015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:26.624632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:26.624645Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:26.624648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:26.624651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:26.624657Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2250 [2:7556256508105261882:11930]
2025-10-01T14:14:26.624672Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:26.624686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:26.624693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.624696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.624698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.624711Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:26.624721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:26.624726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:26.624776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.624782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.624784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.624787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:26.624789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:26.624849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:26.624856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.624867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.624878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.624898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:26.624918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164235:7606], now have 1 active actors on pipe
2025-10-01T14:14:26.624925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164147:2446], now have 1 active actors on pipe
2025-10-01T14:14:26.624930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256508105261877:11930]
2025-10-01T14:14:26.624933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256508105261877:11930]
2025-10-01T14:14:26.624935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256508105261877:11930]
2025-10-01T14:14:26.624947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:26.624941Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2250
2025-10-01T14:14:26.624961Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2250
2025-10-01T14:14:26.624959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:26.624963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:26.624966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:26.624968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:26.624977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:26.624979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:26.625012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.625020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.625031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256508105261877:11930]
2025-10-01T14:14:26.625040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:26.625047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:26.625066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:26.625075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.625078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.625085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:26.625091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.625102Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:26.625123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.625245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.625260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.625282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.625349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2251 partition: 0 MaxSeqNo: 45 sessionId: src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0
2025-10-01T14:14:26.625663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4fe2f5ef-6d64ef70-daed6346-9843cba7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:26.628356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0] Write session: try to update token
2025-10-01T14:14:26.628373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:26.641031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2251 sessionId: src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:26.643137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:26.644804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.644827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.644844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:26.644847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:26.644848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:26.644850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:26.644857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256508105261877:11930]
2025-10-01T14:14:26.644859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256508105261877:11930]
2025-10-01T14:14:26.644863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256508105261877:11930]
2025-10-01T14:14:26.644899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:26.644905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:26.644908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:26.644910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.644911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:26.644912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:26.645020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:26.709547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256510482164243:12142]
2025-10-01T14:14:26.709779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2250, pipe: [1:7556256510482164243:12142]
2025-10-01T14:14:26.782362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:26.782682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:26.782728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164243:12142], now have 1 active actors on pipe
2025-10-01T14:14:26.782791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:26.782911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:26.782960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256510482164243:12142]
2025-10-01T14:14:26.790678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:26.792538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:26.792716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:26.792725Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:26.792737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:26.792759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:26.792783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:26.792771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:26.792806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2251 reason: error at write: Disconnected sessionId: src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0
2025-10-01T14:14:26.792825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256508105261971:11933]
2025-10-01T14:14:26.792966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2251 sessionId: src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0 is DEAD
2025-10-01T14:14:26.793059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:26.793067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0] Write session will restart in 0.008765s
2025-10-01T14:14:26.793084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0] Write session: Do CDS request
2025-10-01T14:14:26.793088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:26.793239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:26.795954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:26.796001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:26.796305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:26.796359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.796364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.796366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.796367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.796368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.796369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.796370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.796372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.796374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.796374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.796376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.796377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.796378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.796379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.796384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.796392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.796395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.796398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.796401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.796404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.796407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.796410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.796413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.796416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.796419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.796422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.796425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.796428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.796434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.796441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.796449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.796457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.796461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.796465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.796469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.796477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.796482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.796489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.796495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.796504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.796508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.796515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.796522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.796526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.796534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.796541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.796548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.796552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.796560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.796578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.796585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.796589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.796596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.796603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.796607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.796619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.796652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:26.800167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:26.800907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:26.800922Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:26.800925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:26.800928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:26.800934Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2251 [2:7556256508105261971:11933]
2025-10-01T14:14:26.800948Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:26.800969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:26.800977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.800980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.800987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.801000Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:26.801009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:26.801020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:26.801071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.801078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.801080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.801083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:26.801085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:26.801145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:26.801153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.801163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.801174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.801193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:26.801214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164256:2446], now have 1 active actors on pipe
2025-10-01T14:14:26.801226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256508105261966:11933]
2025-10-01T14:14:26.801232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256508105261966:11933]
2025-10-01T14:14:26.801234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256508105261966:11933]
2025-10-01T14:14:26.801246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:26.801261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:26.801263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:26.801243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2251
2025-10-01T14:14:26.801271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:26.801276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:26.801279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:26.801280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:26.801310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256508105261966:11933]
2025-10-01T14:14:26.801320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:26.801326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:26.802786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.802868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:26.802881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2252
2025-10-01T14:14:26.802980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.803010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:26.803019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:26.803023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:26.803400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2252 sessionId:  describe result for acl check
2025-10-01T14:14:26.803434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:26.803441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:26.803443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:26.803447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256510482164315:8238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:26.803916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256510482164315:8238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:26.805683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256510482164315:8238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:26.810533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256510482164315:8238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:26.810548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256510482164315:8238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:26.810551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256510482164315:8238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:26.810559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:26.810835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2251
2025-10-01T14:14:26.811301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164351:8238], now have 1 active actors on pipe
2025-10-01T14:14:26.811335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.811342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.811358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:26.811361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:26.811368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256508105261966:11933]
2025-10-01T14:14:26.811398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:26.811414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:26.811426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.811437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.811439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:26.811450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.811469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:26.811482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:26.811635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:26.811771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:26.811896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:26.812034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:26.812209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:26.812255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.812277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:26.812414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.812423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.812439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.812517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2252 partition: 0 MaxSeqNo: 45 sessionId: src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0
2025-10-01T14:14:26.812840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a6228d5-ed5bcae0-34281e90-c86e6542_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:26.815500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0] Write session: try to update token
2025-10-01T14:14:26.815516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:26.829020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2252 sessionId: src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:26.830258Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:26.830277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:26.830279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:26.830280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:26.830291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256508105261966:11933]
2025-10-01T14:14:26.830293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256508105261966:11933]
2025-10-01T14:14:26.830296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256508105261966:11933]
2025-10-01T14:14:26.830327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:26.830331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:26.830332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:26.830337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:26.830338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.830340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:26.830477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:26.831309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:26.883127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256510482164353:12142]
2025-10-01T14:14:26.883490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2251, pipe: [1:7556256510482164353:12142]
2025-10-01T14:14:26.972304Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:26.972589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.972602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.972620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164353:12142], now have 1 active actors on pipe
2025-10-01T14:14:26.972775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:26.972854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:26.972866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:26.972879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256510482164353:12142]
2025-10-01T14:14:26.972899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:26.972919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2252 reason: error at write: Disconnected sessionId: src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0
2025-10-01T14:14:26.973064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2252 sessionId: src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0 is DEAD
2025-10-01T14:14:26.973170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:26.973176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0] Write session will restart in 0.009192s
2025-10-01T14:14:26.973197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0] Write session: Do CDS request
2025-10-01T14:14:26.973201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:26.981727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:26.982203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:26.982357Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:26.982365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:26.982388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:26.982438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:26.982490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256508105262059:11935]
2025-10-01T14:14:26.983082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:26.983633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:26.983672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:26.983775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.983833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:26.983845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2253
2025-10-01T14:14:26.983937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:26.983958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:26.983962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:26.983965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:26.983964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:26.984020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.984026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.984026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.984028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.984029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.984030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.984031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.984033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.984034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.984035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.984036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.984037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.984038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.984039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.984044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.984053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.984057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.984061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.984064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.984068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.984073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.984076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.984079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.984083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.984086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.984090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.984093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.984100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.984108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.984120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:26.984125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.984130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:26.984138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.984142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:26.984150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.984154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:26.984160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.984165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:26.984168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.984173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:26.984181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.984185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:26.984190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.984193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:26.984195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.984198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:26.984202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.984205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.984207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.984210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.984212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.984217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.984225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.984230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:26.984236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.984241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:26.984254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2253 sessionId:  describe result for acl check
2025-10-01T14:14:26.984277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:26.984279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:26.984284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:26.984286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:26.984291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256510482164412:8223] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:26.984679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256510482164412:8223] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:26.986576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256510482164412:8223] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:26.987630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:26.988246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:26.988260Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:26.988262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:26.988264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:26.988269Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2252 [2:7556256508105262059:11935]
2025-10-01T14:14:26.988278Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:26.988288Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:26.988291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.988292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.988294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.988304Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:26.988311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:26.988316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:26.988355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.988360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.988361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.988364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:26.988366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:26.988408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:26.988414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:26.988421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:26.988427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:26.988435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:26.988449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164359:2446], now have 1 active actors on pipe
2025-10-01T14:14:26.988458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256508105262054:11935]
2025-10-01T14:14:26.988459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256508105262054:11935]
2025-10-01T14:14:26.988460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256508105262054:11935]
2025-10-01T14:14:26.988469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:26.988481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:26.988483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:26.988484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:26.988486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:26.988491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:26.988492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:26.988509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256508105262054:11935]
2025-10-01T14:14:26.988515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:26.988521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:26.988512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2252
2025-10-01T14:14:26.988979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256510482164412:8223] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:26.988990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256510482164412:8223] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:26.988993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256510482164412:8223] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:26.988998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:26.989134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256510482164448:8223], now have 1 active actors on pipe
2025-10-01T14:14:26.989173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2252
2025-10-01T14:14:26.989222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.989231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.989252Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:26.989264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:26.989281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:26.989286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:26.989292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:26.989302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:26.989317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.989422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:26.989431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:26.989443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:26.989496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2253 partition: 0 MaxSeqNo: 45 sessionId: src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0
2025-10-01T14:14:26.989783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|51115573-d09fe1e9-d98fe106-a4f762b5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:26.992377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0] Write session: try to update token
2025-10-01T14:14:26.992391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:27.004954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2253 sessionId: src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:27.007123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:27.007706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.007731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.007747Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:27.007753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:27.007755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:27.007756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:27.007763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256508105262054:11935]
2025-10-01T14:14:27.007767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256508105262054:11935]
2025-10-01T14:14:27.007769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256508105262054:11935]
2025-10-01T14:14:27.007800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:27.007810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:27.007813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:27.007814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.007815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:27.007816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:27.007923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:27.073072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256514777131771:12142]
2025-10-01T14:14:27.073311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2252, pipe: [1:7556256514777131771:12142]
2025-10-01T14:14:27.152757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:27.153028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:27.153081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777131771:12142], now have 1 active actors on pipe
2025-10-01T14:14:27.153173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:27.153227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256514777131771:12142]
2025-10-01T14:14:27.153262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:27.153264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:27.153266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:27.153343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2253 reason: error at write: Disconnected sessionId: src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0
2025-10-01T14:14:27.153512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2253 sessionId: src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0 is DEAD
2025-10-01T14:14:27.153650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:27.153658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0] Write session will restart in 0.009967s
2025-10-01T14:14:27.153677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0] Write session: Do CDS request
2025-10-01T14:14:27.153685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:27.161830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:27.163446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:27.163635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:27.163647Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:27.163657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:27.163709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:27.163750Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256512400229451:11939]
2025-10-01T14:14:27.164331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:27.164619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:27.164661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:27.164916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.164933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:27.164945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2254
2025-10-01T14:14:27.164954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:27.165010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.165015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.165016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.165017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.165019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.165020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.165021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.165022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.165023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.165025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.165026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.165029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.165030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.165031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.165036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.165046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.165050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.165053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.165057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.165060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.165064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.165067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.165071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.165075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.165078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.165082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.165086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.165089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.165096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.165107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.165104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.165116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.165124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.165128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.165130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:27.165139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:27.165137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.165143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:27.165144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.165149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.165157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.165166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.165173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.165178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.165182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.165191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.165200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.165208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.165217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.165224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.165231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.165237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.165243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.165248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.165256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.165261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.165267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.165275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.165279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.165288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.165329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:27.165564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2254 sessionId:  describe result for acl check
2025-10-01T14:14:27.165607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:27.165612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:27.165613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:27.165617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256514777131842:8171] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:27.165985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256514777131842:8171] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:27.168542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256514777131842:8171] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:27.168920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:27.169637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:27.169655Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:27.169658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:27.169663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:27.169669Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2253 [2:7556256512400229451:11939]
2025-10-01T14:14:27.169684Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:27.169704Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:27.169712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.169716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.169722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.169743Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:27.169752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:27.169757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:27.169807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.169814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.169816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.169818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:27.169821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:27.169882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:27.169892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.169904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.169913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.169933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:27.169955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777131786:2446], now have 1 active actors on pipe
2025-10-01T14:14:27.169967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256512400229446:11939]
2025-10-01T14:14:27.169972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256512400229446:11939]
2025-10-01T14:14:27.169974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256512400229446:11939]
2025-10-01T14:14:27.169990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:27.170003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:27.170009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:27.170016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:27.170019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:27.170019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:27.170021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:27.170009Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2253
2025-10-01T14:14:27.170049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256512400229446:11939]
2025-10-01T14:14:27.170063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:27.170067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:27.174705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256514777131842:8171] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:27.174721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256514777131842:8171] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:27.174725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256514777131842:8171] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:27.174734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:27.175000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777131880:8171], now have 1 active actors on pipe
2025-10-01T14:14:27.175032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2253
2025-10-01T14:14:27.175108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.175125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.175154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:27.175173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.175184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.175187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:27.175199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.175219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:27.175243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.175406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.175417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.175437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.175503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2254 partition: 0 MaxSeqNo: 45 sessionId: src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0
2025-10-01T14:14:27.175881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1510dad6-a34ee8b6-d6b6e6-b5db5418_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:27.178556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0] Write session: try to update token
2025-10-01T14:14:27.178569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:27.180303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:27.180321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:27.180330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256512400229446:11939]
2025-10-01T14:14:27.180371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:27.180374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:27.180529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:27.180679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:27.180811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:27.180935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:27.181107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:27.181145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:27.191931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2254 sessionId: src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:27.194413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:27.194598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.194619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.194662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:27.194760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:27.198514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:27.198528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:27.198533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:27.198535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:27.198542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256512400229446:11939]
2025-10-01T14:14:27.198545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256512400229446:11939]
2025-10-01T14:14:27.198547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256512400229446:11939]
2025-10-01T14:14:27.198582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:27.198591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.198592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:27.198611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:27.198626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:27.198630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:27.198712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:27.253280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256514777131883:12142]
2025-10-01T14:14:27.253516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2253, pipe: [1:7556256514777131883:12142]
2025-10-01T14:14:27.335419Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:27.343279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.343308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.343470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.343529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.343590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.343647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.344050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.344069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.344137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.344198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.344255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.344315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.344362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.344372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.344448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.344512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.344590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.344659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.344703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.344710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.344779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.344840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.344906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.344969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.345011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.345017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.345080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.345141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.345199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.345259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.345296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.345303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.345361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.345418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.345473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.345524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.345566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.345570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.345625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.345676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.345727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.345782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.345824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.345830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.345907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.345968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.346032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.346096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.346144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.346149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.346207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.346256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.346308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.346361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.346420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.346425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.346482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:27.346543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:27.346597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:27.346649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:27.346689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:27.346695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:27.346755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777131883:12142], now have 1 active actors on pipe
2025-10-01T14:14:27.346949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:27.346973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:27.346977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:27.347007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256514777131883:12142]
2025-10-01T14:14:27.347017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2254 reason: error at write: Disconnected sessionId: src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0
2025-10-01T14:14:27.347274Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:27.347591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2254 sessionId: src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0 is DEAD
2025-10-01T14:14:27.347724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:27.347735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0] Write session will restart in 0.008286s
2025-10-01T14:14:27.347761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0] Write session: Do CDS request
2025-10-01T14:14:27.347767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:27.355606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:27.356900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.356973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:27.356986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2255
2025-10-01T14:14:27.357086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.357110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:27.357117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:27.357119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:27.357342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:27.357470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2255 sessionId:  describe result for acl check
2025-10-01T14:14:27.357504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:27.357510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:27.357511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:27.357516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256514777131938:8155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:27.357511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:27.357520Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:27.357530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:27.357579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:27.357636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256512400229556:11948]
2025-10-01T14:14:27.358165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:27.358179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256514777131938:8155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:27.358461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:27.358503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:27.358728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:27.358765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.358770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.358770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.358771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.358771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.358772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.358773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.358773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.358774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.358774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.358775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.358776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.358778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.358778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.358782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.358787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.358789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.358791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.358793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.358795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.358797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.358799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.358802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.358804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.358806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.358808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.358810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.358812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.358816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.358820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.358824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.358827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.358829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.358831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.358834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.358837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.358839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.358842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.358844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.358846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.358849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.358852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.358854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.358857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.358860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.358863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.358865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.358869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.358871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.358874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.358876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.358878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.358880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.358883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.358885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.358889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.358925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:27.360681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256514777131938:8155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:27.362227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:27.362975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256514777131938:8155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:27.362991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256514777131938:8155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:27.362994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256514777131938:8155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:27.363016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:27.362980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:27.362997Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:27.362998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:27.363001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:27.363006Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2254 [2:7556256512400229556:11948]
2025-10-01T14:14:27.363016Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:27.363029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:27.363031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.363035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.363036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.363047Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:27.363051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:27.363056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:27.363096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.363101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.363102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.363104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:27.363106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:27.363158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:27.363163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.363173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.363182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.363195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:27.363215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777131886:2446], now have 1 active actors on pipe
2025-10-01T14:14:27.363221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777131977:8155], now have 1 active actors on pipe
2025-10-01T14:14:27.363225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256512400229551:11948]
2025-10-01T14:14:27.363227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256512400229551:11948]
2025-10-01T14:14:27.363228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256512400229551:11948]
2025-10-01T14:14:27.363239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:27.363248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:27.363254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:27.363256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:27.363256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:27.363259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:27.363259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:27.363242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2254
2025-10-01T14:14:27.363278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2254
2025-10-01T14:14:27.363291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256512400229551:11948]
2025-10-01T14:14:27.363303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:27.363308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:27.363319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.363324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.363369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d465d183-41c6cb85-30b7737-6b170c43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:27.363381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.363385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.363387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:27.363394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.363403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:27.363419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.363557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.363562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.363573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.363631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2255 partition: 0 MaxSeqNo: 45 sessionId: src_id|d465d183-41c6cb85-30b7737-6b170c43_0
2025-10-01T14:14:27.363930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11f7999b-26e82c2b-6f35845c-fc1259be_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d465d183-41c6cb85-30b7737-6b170c43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:27.366830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d465d183-41c6cb85-30b7737-6b170c43_0] Write session: try to update token
2025-10-01T14:14:27.366850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d465d183-41c6cb85-30b7737-6b170c43_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:27.380059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2255 sessionId: src_id|d465d183-41c6cb85-30b7737-6b170c43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:27.382505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:27.383719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.383740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.383757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:27.383760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:27.383761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:27.383762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:27.383768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256512400229551:11948]
2025-10-01T14:14:27.383771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256512400229551:11948]
2025-10-01T14:14:27.383774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256512400229551:11948]
2025-10-01T14:14:27.383822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:27.383827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:27.383834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.383836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:27.383836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:27.383840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:27.383965Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:27.447285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256514777131984:12142]
2025-10-01T14:14:27.447533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2254, pipe: [1:7556256514777131984:12142]
2025-10-01T14:14:27.520115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:27.520347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:27.520400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777131984:12142], now have 1 active actors on pipe
2025-10-01T14:14:27.520463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:27.520595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256514777131984:12142]
2025-10-01T14:14:27.520619Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:27.529853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:27.530103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:27.530113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:27.530130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2255 reason: error at write: Disconnected sessionId: src_id|d465d183-41c6cb85-30b7737-6b170c43_0
2025-10-01T14:14:27.530262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2255 sessionId: src_id|d465d183-41c6cb85-30b7737-6b170c43_0 is DEAD
2025-10-01T14:14:27.530397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465d183-41c6cb85-30b7737-6b170c43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:27.530405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465d183-41c6cb85-30b7737-6b170c43_0] Write session will restart in 0.008452s
2025-10-01T14:14:27.530436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465d183-41c6cb85-30b7737-6b170c43_0] Write session: Do CDS request
2025-10-01T14:14:27.530441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465d183-41c6cb85-30b7737-6b170c43_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:27.533538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:27.533725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:27.533734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:27.533742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:27.533776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:27.533805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256512400229676:11955]
2025-10-01T14:14:27.534232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:27.534485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:27.534533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:27.534750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:27.534786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.534790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.534791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.534791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.534792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.534793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.534793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.534794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.534795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.534795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.534796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.534797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.534797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.534798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.534801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.534807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.534809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.534819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.534821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.534824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.534825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.534828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.534830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.534832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.534834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.534836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.534838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.534840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.534845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.534850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.534854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.534857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.534860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.534863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.534865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.534867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.534870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.534873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.534875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.534879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.534882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.534885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.534887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.534893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.534896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.534899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.534901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.534904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.534914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.534920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.534923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.534929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.534937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.534945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.534954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.534960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.534980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:27.538423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:27.539305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:27.539319Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:27.539322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:27.539325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:27.539334Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2255 [2:7556256512400229676:11955]
2025-10-01T14:14:27.539349Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:27.539367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:27.539375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.539378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.539380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.539396Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:27.539404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:27.539410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:27.539463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.539471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.539472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.539475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:27.539478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:27.539541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:27.539547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.539558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.539569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.539589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:27.539609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777131989:2446], now have 1 active actors on pipe
2025-10-01T14:14:27.539621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256512400229670:11955]
2025-10-01T14:14:27.539630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256512400229670:11955]
2025-10-01T14:14:27.539632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256512400229670:11955]
2025-10-01T14:14:27.539648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:27.539662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:27.539675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:27.539675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:27.539656Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2255
2025-10-01T14:14:27.539679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:27.539681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:27.539683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:27.539714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256512400229670:11955]
2025-10-01T14:14:27.539723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:27.539733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:27.539879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d465d183-41c6cb85-30b7737-6b170c43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.539933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:27.539941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2256
2025-10-01T14:14:27.540064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.540088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:27.540095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:27.540098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:27.540456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2256 sessionId:  describe result for acl check
2025-10-01T14:14:27.540493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:27.540501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:27.540504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:27.540509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256514777132050:8139] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:27.540937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256514777132050:8139] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:27.543359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256514777132050:8139] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:27.548939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256514777132050:8139] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:27.548953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256514777132050:8139] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:27.548957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256514777132050:8139] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:27.548971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:27.549450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2255
2025-10-01T14:14:27.549760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777132087:8139], now have 1 active actors on pipe
2025-10-01T14:14:27.549790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.549797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.549811Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:27.549815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:27.549820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256512400229670:11955]
2025-10-01T14:14:27.549846Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:27.549852Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f4faeec-53139888-7f46e88a-488c4e40_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:27.549862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.549866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.549868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:27.549876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.549891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:27.549915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:27.550084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:27.550229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:27.550362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:27.550506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:27.550689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:27.550731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.550753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:27.550894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.550908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.550941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.551037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2256 partition: 0 MaxSeqNo: 45 sessionId: src_id|2f4faeec-53139888-7f46e88a-488c4e40_0
2025-10-01T14:14:27.551340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d465d183-41c6cb85-30b7737-6b170c43_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2f4faeec-53139888-7f46e88a-488c4e40_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:27.554020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4faeec-53139888-7f46e88a-488c4e40_0] Write session: try to update token
2025-10-01T14:14:27.554035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4faeec-53139888-7f46e88a-488c4e40_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:27.566862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2256 sessionId: src_id|2f4faeec-53139888-7f46e88a-488c4e40_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:27.568736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:27.568754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:27.568756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:27.568758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:27.568769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256512400229670:11955]
2025-10-01T14:14:27.568772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256512400229670:11955]
2025-10-01T14:14:27.568774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256512400229670:11955]
2025-10-01T14:14:27.568811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:27.568813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:27.568818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:27.568819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.568820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:27.568821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:27.568944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:27.569224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:27.620885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256514777132094:12142]
2025-10-01T14:14:27.621100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2255, pipe: [1:7556256514777132094:12142]
2025-10-01T14:14:27.706988Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:27.707227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.707239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.707262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777132094:12142], now have 1 active actors on pipe
2025-10-01T14:14:27.707427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:27.707494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:27.707512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:27.707532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256514777132094:12142]
2025-10-01T14:14:27.707567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:27.707571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2256 reason: error at write: Disconnected sessionId: src_id|2f4faeec-53139888-7f46e88a-488c4e40_0
2025-10-01T14:14:27.707722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2256 sessionId: src_id|2f4faeec-53139888-7f46e88a-488c4e40_0 is DEAD
2025-10-01T14:14:27.707845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4faeec-53139888-7f46e88a-488c4e40_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:27.707855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4faeec-53139888-7f46e88a-488c4e40_0] Write session will restart in 0.006319s
2025-10-01T14:14:27.707880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4faeec-53139888-7f46e88a-488c4e40_0] Write session: Do CDS request
2025-10-01T14:14:27.707887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4faeec-53139888-7f46e88a-488c4e40_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:27.714759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4faeec-53139888-7f46e88a-488c4e40_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.714994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:27.715008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2257
2025-10-01T14:14:27.715144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.715187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:27.715194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:27.715197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:27.715584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2257 sessionId:  describe result for acl check
2025-10-01T14:14:27.715618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:27.715625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:27.715627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:27.715632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256514777132150:8132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:27.715749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:27.716116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256514777132150:8132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:27.717321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:27.717466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:27.717473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:27.717480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:27.717518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:27.717544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256512400229767:11957]
2025-10-01T14:14:27.717770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256514777132150:8132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:27.717945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:27.718202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:27.718244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:27.718512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:27.718563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.718568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.718569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.718570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.718571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.718571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.718572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.718573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.718573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.718574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.718575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.718575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.718576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.718577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.718580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.718587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.718589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.718591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.718593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.718595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.718597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.718606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.718608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.718610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.718612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.718614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.718616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.718618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.718622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.718628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.718631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.718634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.718636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.718639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.718641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.718644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.718647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.718649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.718651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.718654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.718657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.718660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.718662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.718664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.718667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.718669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.718673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.718676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.718678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.718681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.718683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.718686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.718688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.718691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.718693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.718696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.718717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:27.722128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256514777132150:8132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:27.722148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256514777132150:8132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:27.722152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256514777132150:8132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:27.722160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:27.722338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:27.723103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:27.723120Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:27.723123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:27.723126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:27.723133Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2256 [2:7556256512400229767:11957]
2025-10-01T14:14:27.723150Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:27.723171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:27.723179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.723182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.723184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.723202Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:27.723212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:27.723218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:27.723284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.723292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.723294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.723297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:27.723299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:27.723368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:27.723376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.723386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.723395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.723413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:27.723435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777132190:8132], now have 1 active actors on pipe
2025-10-01T14:14:27.723442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777132096:2446], now have 1 active actors on pipe
2025-10-01T14:14:27.723449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256512400229762:11957]
2025-10-01T14:14:27.723451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256512400229762:11957]
2025-10-01T14:14:27.723453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256512400229762:11957]
2025-10-01T14:14:27.723467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:27.723483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:27.723485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:27.723486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:27.723489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:27.723497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:27.723500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:27.723504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2256
2025-10-01T14:14:27.723510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2256
2025-10-01T14:14:27.723535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256512400229762:11957]
2025-10-01T14:14:27.723542Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:27.723544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:27.723558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.723566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.723617Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:27.723627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.723632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.723638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:27.723647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.723656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:27.723675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.723835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.723849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.723870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.723942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2257 partition: 0 MaxSeqNo: 45 sessionId: src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0
2025-10-01T14:14:27.724279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f4faeec-53139888-7f46e88a-488c4e40_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:27.726959Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0] Write session: try to update token
2025-10-01T14:14:27.726972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:27.740551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2257 sessionId: src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:27.743351Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:27.743370Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:27.743372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:27.743373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:27.743383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256512400229762:11957]
2025-10-01T14:14:27.743387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256512400229762:11957]
2025-10-01T14:14:27.743390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256512400229762:11957]
2025-10-01T14:14:27.743442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:27.743442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:27.743448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:27.743448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.743450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:27.743453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:27.743442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:27.743570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:27.807779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256514777132209:12142]
2025-10-01T14:14:27.808057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2256, pipe: [1:7556256514777132209:12142]
2025-10-01T14:14:27.883747Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:27.884070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.884082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.884116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777132209:12142], now have 1 active actors on pipe
2025-10-01T14:14:27.884319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:27.884340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256514777132209:12142]
2025-10-01T14:14:27.884358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:27.884362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:27.884373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:27.884420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2257 reason: error at write: Disconnected sessionId: src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0
2025-10-01T14:14:27.884596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2257 sessionId: src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0 is DEAD
2025-10-01T14:14:27.884718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:27.884728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0] Write session will restart in 0.009203s
2025-10-01T14:14:27.884753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0] Write session: Do CDS request
2025-10-01T14:14:27.884758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:27.892492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:27.893837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:27.894017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:27.894028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:27.894038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:27.894093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:27.894127Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256512400229862:11960]
2025-10-01T14:14:27.894624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:27.894765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.894886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:27.894900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2258
2025-10-01T14:14:27.894957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:27.895001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:27.895019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:27.895047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:27.895056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:27.895059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:27.895300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:27.895352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.895359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.895362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.895363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.895364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.895365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.895366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.895368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.895369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.895370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.895371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.895372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.895373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.895374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.895379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.895389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.895393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.895397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.895400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.895405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.895409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.895412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.895416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.895420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.895426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.895429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.895433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.895436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.895443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.895450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:27.895456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.895447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2258 sessionId:  describe result for acl check
2025-10-01T14:14:27.895461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:27.895483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:27.895464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.895491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:27.895469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:27.895493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:27.895474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.895478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:27.895483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.895489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:27.895493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.895498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:27.895502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.895498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256514777132269:8115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:27.895507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:27.895510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.895515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:27.895520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.895525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:27.895530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.895534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.895538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.895543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.895547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.895551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.895561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.895566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:27.895570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.895575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:27.895618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:27.895967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256514777132269:8115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:27.897505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256514777132269:8115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:27.899008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:27.899580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:27.899590Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:27.899592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:27.899594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:27.899599Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2257 [2:7556256512400229862:11960]
2025-10-01T14:14:27.899611Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:27.899623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:27.899625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.899627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.899629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.899641Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:27.899644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:27.899648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:27.899687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.899700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.899705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.899707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:27.899708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:27.899753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:27.899758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.899765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:27.899770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:27.899779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:27.899790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256512400229857:11960]
2025-10-01T14:14:27.899795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256512400229857:11960]
2025-10-01T14:14:27.899796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256512400229857:11960]
2025-10-01T14:14:27.899802Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:27.899812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777132212:2446], now have 1 active actors on pipe
2025-10-01T14:14:27.899811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:27.899814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:27.899816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:27.899820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:27.899828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:27.899830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:27.899846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2257
2025-10-01T14:14:27.899850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256512400229857:11960]
2025-10-01T14:14:27.899861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:27.899880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:27.900019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256514777132269:8115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:27.900031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256514777132269:8115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:27.900034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256514777132269:8115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:27.900040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:27.900201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777132308:8115], now have 1 active actors on pipe
2025-10-01T14:14:27.900237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2257
2025-10-01T14:14:27.900277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.900284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.900302Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:27.900317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:27.900323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:27.900325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:27.900332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:27.900340Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:27.900355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.900463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.900470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.900481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:27.900543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2258 partition: 0 MaxSeqNo: 45 sessionId: src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0
2025-10-01T14:14:27.900831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7060cb6-d2e66b4f-58e4cbfa-a5ceacc5_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:27.903405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0] Write session: try to update token
2025-10-01T14:14:27.903418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:27.915893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2258 sessionId: src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:27.918151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:27.919024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:27.919045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:27.919064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:27.919066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:27.919068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:27.919070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:27.919075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256512400229857:11960]
2025-10-01T14:14:27.919078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256512400229857:11960]
2025-10-01T14:14:27.919083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256512400229857:11960]
2025-10-01T14:14:27.919113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:27.919124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:27.919127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:27.919127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:27.919132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:27.919137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:27.919251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:27.984412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256514777132316:12142]
2025-10-01T14:14:27.984688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2257, pipe: [1:7556256514777132316:12142]
2025-10-01T14:14:28.060180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:28.060378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:28.060425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256514777132316:12142], now have 1 active actors on pipe
2025-10-01T14:14:28.060536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:28.060633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:28.060640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:28.060703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2258 reason: error at write: Disconnected sessionId: src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0
2025-10-01T14:14:28.060866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2258 sessionId: src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0 is DEAD
2025-10-01T14:14:28.060983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:28.060991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0] Write session will restart in 0.007468s
2025-10-01T14:14:28.061019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0] Write session: Do CDS request
2025-10-01T14:14:28.061024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:28.061029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256514777132316:12142]
2025-10-01T14:14:28.061048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:28.069192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:28.069867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.069930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:28.069946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2259
2025-10-01T14:14:28.070041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.070072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:28.070083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:28.070087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:28.070462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2259 sessionId:  describe result for acl check
2025-10-01T14:14:28.070493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:28.070498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:28.070500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:28.070505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256519072099683:8059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:28.070719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:28.070904Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:28.070912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:28.070923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:28.070992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256519072099683:8059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:28.070969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:28.071005Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256516695197252:11962]
2025-10-01T14:14:28.071417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:28.071706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:28.071747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:28.072020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:28.072077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.072082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.072083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.072084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.072085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.072086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.072087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.072088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.072089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.072090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.072091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.072092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.072093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.072094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.072109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.072119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.072122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.072126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.072130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.072133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.072137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.072140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.072144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.072148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.072151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.072154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.072156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.072158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.072162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.072166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.072170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.072174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.072176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.072180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.072183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.072188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.072192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.072200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.072205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.072209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.072219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.072224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.072232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.072236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.072244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.072249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.072253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.072262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.072266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.072275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.072279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.072288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.072290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.072293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.072299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.072302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.072327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:28.072586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256519072099683:8059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:28.075829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256519072099683:8059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:28.075840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256519072099683:8059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:28.075842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256519072099683:8059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:28.075848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:28.076051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:28.076746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:28.076759Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:28.076760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:28.076763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:28.076768Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2258 [2:7556256516695197252:11962]
2025-10-01T14:14:28.076777Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:28.076787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:28.076793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.076795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.076796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.076809Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:28.076818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:28.076824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:28.076874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.076880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.076882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.076885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:28.076887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:28.076945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:28.076952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.076962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.076976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.076995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:28.077011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099626:2446], now have 1 active actors on pipe
2025-10-01T14:14:28.077019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099729:8059], now have 1 active actors on pipe
2025-10-01T14:14:28.077024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256516695197247:11962]
2025-10-01T14:14:28.077026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256516695197247:11962]
2025-10-01T14:14:28.077027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256516695197247:11962]
2025-10-01T14:14:28.077037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:28.077046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:28.077054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:28.077046Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2258
2025-10-01T14:14:28.077058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2258
2025-10-01T14:14:28.077058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:28.077061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:28.077067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:28.077070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:28.077088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256516695197247:11962]
2025-10-01T14:14:28.077090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:28.077092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:28.077104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.077108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.077146Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:28.077155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.077160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.077162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:28.077169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.077176Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:28.077201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.077329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.077335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.077346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.077420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2259 partition: 0 MaxSeqNo: 45 sessionId: src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0
2025-10-01T14:14:28.077705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6184c3d-bd53e0c5-b16a9074-2bb2318e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:28.080359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0] Write session: try to update token
2025-10-01T14:14:28.080376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:28.093887Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2259 sessionId: src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:28.096020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:28.096552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.096585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.096603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:28.096605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:28.096607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:28.096608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:28.096614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256516695197247:11962]
2025-10-01T14:14:28.096617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256516695197247:11962]
2025-10-01T14:14:28.096620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256516695197247:11962]
2025-10-01T14:14:28.096654Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:28.096661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:28.096664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:28.096665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.096666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:28.096667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:28.096785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:28.161115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256519072099739:12142]
2025-10-01T14:14:28.161376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2258, pipe: [1:7556256519072099739:12142]
2025-10-01T14:14:28.232167Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:28.232667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:28.232716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099739:12142], now have 1 active actors on pipe
2025-10-01T14:14:28.232801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:28.232854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:28.232919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:28.232919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256519072099739:12142]
2025-10-01T14:14:28.232929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:28.233006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2259 reason: error at write: Disconnected sessionId: src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0
2025-10-01T14:14:28.233143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2259 sessionId: src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0 is DEAD
2025-10-01T14:14:28.233313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:28.233323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0] Write session will restart in 0.008825s
2025-10-01T14:14:28.233353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0] Write session: Do CDS request
2025-10-01T14:14:28.233365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:28.241573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:28.242833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.242961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:28.242975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2260
2025-10-01T14:14:28.243093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.243116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:28.243124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:28.243127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:28.243145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:28.243338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:28.243346Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:28.243354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:28.243388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:28.243418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256516695197356:11967]
2025-10-01T14:14:28.243410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2260 sessionId:  describe result for acl check
2025-10-01T14:14:28.243443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:28.243444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:28.243445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:28.243449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256519072099798:8041] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:28.243810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:28.243923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256519072099798:8041] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:28.244080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:28.244109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:28.244348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:28.244398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.244403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.244404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.244405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.244406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.244408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.244409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.244410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.244411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.244412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.244413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.244414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.244416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.244417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.244421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.244430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.244438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.244444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.244451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.244455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.244462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.244466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.244473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.244477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.244481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.244488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.244491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.244495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.244500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.244508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.244517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.244525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.244533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.244542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.244550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.244555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.244559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.244576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.244580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.244588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.244592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.244600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.244606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.244614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.244618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.244627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.244634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.244638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.244646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.244654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.244658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.244663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.244668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.244675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.244679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.244687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.244728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:28.245599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256519072099798:8041] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:28.247770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256519072099798:8041] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:28.247781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256519072099798:8041] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:28.247783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256519072099798:8041] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:28.247789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:28.248056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:28.248959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:28.248972Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:28.248974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:28.248976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:28.248980Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2259 [2:7556256516695197356:11967]
2025-10-01T14:14:28.248990Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:28.249001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:28.249003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.249005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.249008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.249019Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:28.249026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:28.249030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:28.249068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.249073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.249074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.249076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:28.249078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:28.249125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:28.249130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.249137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.249142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.249151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:28.249167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099740:2446], now have 1 active actors on pipe
2025-10-01T14:14:28.249173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099837:8041], now have 1 active actors on pipe
2025-10-01T14:14:28.249178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256516695197351:11967]
2025-10-01T14:14:28.249180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256516695197351:11967]
2025-10-01T14:14:28.249181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256516695197351:11967]
2025-10-01T14:14:28.249189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:28.249201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:28.249204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:28.249206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:28.249208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:28.249212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:28.249214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:28.249229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256516695197351:11967]
2025-10-01T14:14:28.249237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:28.249243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:28.249245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2259
2025-10-01T14:14:28.249250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2259
2025-10-01T14:14:28.249351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.249358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.249377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b8e7880-13f63404-953075ee-eeb03004_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:28.249385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.249388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.249389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:28.249396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.249401Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:28.249410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.249559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.249571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.249593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.249661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2260 partition: 0 MaxSeqNo: 45 sessionId: src_id|7b8e7880-13f63404-953075ee-eeb03004_0
2025-10-01T14:14:28.249936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1dd5ac87-1e15876f-5f949863-5cb4ab43_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7b8e7880-13f63404-953075ee-eeb03004_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:28.258933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8e7880-13f63404-953075ee-eeb03004_0] Write session: try to update token
2025-10-01T14:14:28.258952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8e7880-13f63404-953075ee-eeb03004_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:28.269335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:28.269356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:28.269359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:28.269361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:28.269371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256516695197351:11967]
2025-10-01T14:14:28.269377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256516695197351:11967]
2025-10-01T14:14:28.269383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256516695197351:11967]
2025-10-01T14:14:28.269428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:28.269432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:28.269440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.269441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:28.269443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:28.269444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:28.269584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:28.274742Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2260 sessionId: src_id|7b8e7880-13f63404-953075ee-eeb03004_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:28.277708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:28.333085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256519072099845:12142]
2025-10-01T14:14:28.333341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2259, pipe: [1:7556256519072099845:12142]
2025-10-01T14:14:28.413202Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:28.413510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.413524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.413546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099845:12142], now have 1 active actors on pipe
2025-10-01T14:14:28.413703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:28.413771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:28.413823Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:28.413848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256519072099845:12142]
2025-10-01T14:14:28.413897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2260 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7b8e7880-13f63404-953075ee-eeb03004_0
2025-10-01T14:14:28.414057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2260 sessionId: src_id|7b8e7880-13f63404-953075ee-eeb03004_0 is DEAD
2025-10-01T14:14:28.414213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8e7880-13f63404-953075ee-eeb03004_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:28.414221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8e7880-13f63404-953075ee-eeb03004_0] Write session will restart in 0.009466s
2025-10-01T14:14:28.414242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8e7880-13f63404-953075ee-eeb03004_0] Write session: Do CDS request
2025-10-01T14:14:28.414246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8e7880-13f63404-953075ee-eeb03004_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:28.422383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:28.424009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:28.424201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:28.424209Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:28.424218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:28.424265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:28.424300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256516695197483:11979]
2025-10-01T14:14:28.424746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:28.424801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8e7880-13f63404-953075ee-eeb03004_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.424907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:28.424920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2261
2025-10-01T14:14:28.425017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.425017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:28.425039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:28.425046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:28.425048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:28.425070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:28.425375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2261 sessionId:  describe result for acl check
2025-10-01T14:14:28.425398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:28.425405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:28.425407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:28.425410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256519072099910:8038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:28.425405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:28.425463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.425470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.425470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.425472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.425473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.425474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.425475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.425476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.425477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.425478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.425479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.425480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.425481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.425482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.425487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.425495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.425499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.425502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.425505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.425509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.425512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.425515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.425518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.425522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.425525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.425533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.425536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.425543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.425551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.425564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.425570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.425574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.425578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.425582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.425591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.425596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.425599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.425603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.425611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.425615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.425619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.425623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.425631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.425635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.425643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.425648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.425655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.425659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.425667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.425676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.425679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.425684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.425692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.425696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.425704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.425709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.425760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:28.425790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256519072099910:8038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:28.427444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256519072099910:8038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:28.429532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:28.430112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256519072099910:8038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:28.430126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256519072099910:8038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:28.430128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256519072099910:8038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:28.430135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:28.430384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:28.430401Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:28.430403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:28.430407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:28.430414Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2260 [2:7556256516695197483:11979]
2025-10-01T14:14:28.430429Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:28.430445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:28.430453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.430457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.430459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.430476Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:28.430485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:28.430492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:28.430552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.430559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.430561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.430565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:28.430567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:28.430635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:28.430642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.430654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.430666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.430684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:28.430709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099943:8038], now have 1 active actors on pipe
2025-10-01T14:14:28.430712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099849:2446], now have 1 active actors on pipe
2025-10-01T14:14:28.430719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256516695197478:11979]
2025-10-01T14:14:28.430721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256516695197478:11979]
2025-10-01T14:14:28.430724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256516695197478:11979]
2025-10-01T14:14:28.430736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:28.430726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2260
2025-10-01T14:14:28.430749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2260
2025-10-01T14:14:28.430751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:28.430756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:28.430761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:28.430763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:28.430770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:28.430773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:28.430815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.430823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.430836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256516695197478:11979]
2025-10-01T14:14:28.430846Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:28.430861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:28.430879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:28.430885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.430888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.430891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:28.430898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.430908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:28.430930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.431096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.431103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.431115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.431270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2261 partition: 0 MaxSeqNo: 45 sessionId: src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0
2025-10-01T14:14:28.431674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b8e7880-13f63404-953075ee-eeb03004_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:28.434849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0] Write session: try to update token
2025-10-01T14:14:28.434867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:28.448000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2261 sessionId: src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:28.450521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:28.450680Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:28.450697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:28.450699Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:28.450701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:28.450710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256516695197478:11979]
2025-10-01T14:14:28.450718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256516695197478:11979]
2025-10-01T14:14:28.450721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256516695197478:11979]
2025-10-01T14:14:28.450745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:28.450750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:28.450754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:28.450770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.450777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.450794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:28.450803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.450805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:28.450920Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:28.513809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256519072099956:12142]
2025-10-01T14:14:28.514089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2260, pipe: [1:7556256519072099956:12142]
2025-10-01T14:14:28.589948Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:28.590199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099956:12142], now have 1 active actors on pipe
2025-10-01T14:14:28.590419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:28.590444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:28.590450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256519072099956:12142]
2025-10-01T14:14:28.590456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:28.590471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:28.590507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2261 reason: error at write: Disconnected sessionId: src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0
2025-10-01T14:14:28.590673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2261 sessionId: src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0 is DEAD
2025-10-01T14:14:28.590821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:28.590832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0] Write session will restart in 0.008923s
2025-10-01T14:14:28.590857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0] Write session: Do CDS request
2025-10-01T14:14:28.590864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:28.598168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:28.599716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:28.599858Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:28.599865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:28.599872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:28.599901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:28.599928Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256516695197592:11982]
2025-10-01T14:14:28.600299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:28.600506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:28.600535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:28.600756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:28.600793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.600797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.600798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.600799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.600799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.600800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.600801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.600801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.600802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.600802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.600803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.600804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.600804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.600805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.600808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.600813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.600816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.600818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.600820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.600822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.600824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.600828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.600830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.600832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.600834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.600836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.600838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.600904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.600840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.600845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.600849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.600852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.600855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.600858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.600860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.600862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.600865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.600867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.600870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.600872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.600884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.600886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.600889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.600891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.600893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.600896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.600899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.600902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.600904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.600906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.600909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.600911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.600914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.600917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.600919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.600921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.600924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.600945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:28.601049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:28.601063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2262
2025-10-01T14:14:28.601179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.601199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:28.601206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:28.601209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:28.601560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2262 sessionId:  describe result for acl check
2025-10-01T14:14:28.601594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:28.601600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:28.601602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:28.601606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256519072100026:8018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:28.602018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256519072100026:8018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:28.603412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256519072100026:8018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:28.604232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:28.604830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:28.604842Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:28.604844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:28.604846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:28.604851Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2261 [2:7556256516695197592:11982]
2025-10-01T14:14:28.604861Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:28.604871Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:28.604873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.604875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.604877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.604888Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:28.604897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:28.604902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:28.604938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.604944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.604945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.604947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:28.604950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:28.605002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:28.605009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.605019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.605033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.605050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:28.605070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072099963:2446], now have 1 active actors on pipe
2025-10-01T14:14:28.605079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256516695197587:11982]
2025-10-01T14:14:28.605084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256516695197587:11982]
2025-10-01T14:14:28.605085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256516695197587:11982]
2025-10-01T14:14:28.605095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:28.605078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2261
2025-10-01T14:14:28.605102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:28.605104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:28.605106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:28.605112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:28.605123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:28.605130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:28.605163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256516695197587:11982]
2025-10-01T14:14:28.605171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:28.605182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:28.605547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256519072100026:8018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:28.605560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256519072100026:8018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:28.605563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256519072100026:8018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:28.605569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:28.605742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072100063:8018], now have 1 active actors on pipe
2025-10-01T14:14:28.605758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2261
2025-10-01T14:14:28.605784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.605793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.605818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:28.605829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.605833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.605838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:28.605848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.605861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:28.605878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.605999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.606008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.606023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.606084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2262 partition: 0 MaxSeqNo: 45 sessionId: src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0
2025-10-01T14:14:28.606407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|85f9a1b7-b69f52d4-68a41ed0-bc1f9ffe_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:28.609101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0] Write session: try to update token
2025-10-01T14:14:28.609115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:28.619955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:28.619974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:28.619981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256516695197587:11982]
2025-10-01T14:14:28.620023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:28.620050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:28.620170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:28.620305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:28.620432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:28.620553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:28.620751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:28.620790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:28.622697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2262 sessionId: src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:28.625281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:28.625492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.625516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.625545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:28.625614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:28.634348Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:28.634361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:28.634363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:28.634365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:28.634390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256516695197587:11982]
2025-10-01T14:14:28.634394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256516695197587:11982]
2025-10-01T14:14:28.634397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256516695197587:11982]
2025-10-01T14:14:28.634437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:28.634437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:28.634442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:28.634445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.634446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:28.634447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:28.634560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:28.690455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256519072100069:12142]
2025-10-01T14:14:28.690706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2261, pipe: [1:7556256519072100069:12142]
2025-10-01T14:14:28.763138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:28.769362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.769387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.769514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.769562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.769616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.769660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.769698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.769706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.769759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.769832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.769880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.769928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.769964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.769969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.770020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.770070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.770118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.770169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.770211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.770216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.770271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.770320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.770388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.770444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.770480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.770485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.770537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.770584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.770637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.770685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.770723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.770728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.770781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.770833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.770887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.770939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.770976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.770981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.771034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.771081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.771131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.771180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.771217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.771221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.771275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.771323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.771374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.771423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.771460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.771465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.771516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.771564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.771613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.771665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.771765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.771770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.771823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.771871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.771918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.771966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.772002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.772006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.772043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072100069:12142], now have 1 active actors on pipe
2025-10-01T14:14:28.772285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256519072100069:12142]
2025-10-01T14:14:28.772321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:28.772323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:28.772357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2262 reason: error at write: Disconnected sessionId: src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0
2025-10-01T14:14:28.772357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:28.772527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2262 sessionId: src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0 is DEAD
2025-10-01T14:14:28.772645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:28.772654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0] Write session will restart in 0.007295s
2025-10-01T14:14:28.772651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:28.772678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0] Write session: Do CDS request
2025-10-01T14:14:28.772684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:28.780434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:28.780795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.780871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:28.780887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2263
2025-10-01T14:14:28.780989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.781018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:28.781026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:28.781029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:28.781391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2263 sessionId:  describe result for acl check
2025-10-01T14:14:28.781426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:28.781433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:28.781434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:28.781439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256519072100143:8005] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:28.781878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256519072100143:8005] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:28.781959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:28.782088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:28.782096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:28.782103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:28.782148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:28.782174Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256516695197692:11985]
2025-10-01T14:14:28.782565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:28.782823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:28.782856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:28.783047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:28.783079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.783083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.783084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.783084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.783085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.783086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.783087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.783088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.783088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.783089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.783090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.783091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.783091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.783092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.783095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.783102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.783105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.783107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.783109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.783111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.783114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.783116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.783118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.783120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.783122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.783124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.783126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.783128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.783133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.783137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.783141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.783144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.783156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.783162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.783164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.783167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.783169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.783172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.783178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.783181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.783184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.783190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.783192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.783199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.783211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.783217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.783220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.783223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.783225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.783229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.783231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.783234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.783238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.783240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.783246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.783248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.783269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:28.783516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256519072100143:8005] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:28.786406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256519072100143:8005] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:28.786419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256519072100143:8005] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:28.786423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256519072100143:8005] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:28.786430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:28.786773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:28.787448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:28.787462Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:28.787464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:28.787467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:28.787472Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2262 [2:7556256516695197692:11985]
2025-10-01T14:14:28.787485Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:28.787499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:28.787505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.787507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.787509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.787519Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:28.787522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:28.787527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:28.787564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.787568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.787569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.787571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:28.787573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:28.787615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:28.787621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.787628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.787634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.787645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:28.787659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256516695197687:11985]
2025-10-01T14:14:28.787663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256516695197687:11985]
2025-10-01T14:14:28.787665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256516695197687:11985]
2025-10-01T14:14:28.787671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:28.787677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:28.787679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:28.787680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:28.787682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:28.787687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:28.787689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:28.787695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072100182:8005], now have 1 active actors on pipe
2025-10-01T14:14:28.787701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072100071:2446], now have 1 active actors on pipe
2025-10-01T14:14:28.787716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256516695197687:11985]
2025-10-01T14:14:28.787724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:28.787737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:28.787769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2262
2025-10-01T14:14:28.787792Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2262
2025-10-01T14:14:28.787833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.787840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.787858Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:28.787863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.787872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.787874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:28.787880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.787886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:28.787898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.788027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.788038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.788055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.788127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2263 partition: 0 MaxSeqNo: 45 sessionId: src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0
2025-10-01T14:14:28.788376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c9c9e52c-7c4f6a62-24ae85e8-c108f7eb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:28.791130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0] Write session: try to update token
2025-10-01T14:14:28.791147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:28.797400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:28.797416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:28.797422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256516695197687:11985]
2025-10-01T14:14:28.797451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:28.797457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:28.797590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:28.797706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:28.797823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:28.797938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:28.798090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:28.798118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:28.803831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2263 sessionId: src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:28.806192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:28.806387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.806407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.806441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:28.806528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:28.814832Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:28.814848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:28.814850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:28.814851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:28.814859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256516695197687:11985]
2025-10-01T14:14:28.814861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256516695197687:11985]
2025-10-01T14:14:28.814866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256516695197687:11985]
2025-10-01T14:14:28.814900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:28.814900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:28.814904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.814906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:28.814906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:28.814909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:28.815016Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:28.872221Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256519072100190:12142]
2025-10-01T14:14:28.872453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2262, pipe: [1:7556256519072100190:12142]
2025-10-01T14:14:28.946499Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:28.953761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.953785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.953911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.953958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.954007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.954055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.954095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.954101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.954162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.954225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.954274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.954323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.954362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.954367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.954444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.954494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.954547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.954601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.954641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.954646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.954740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.954794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.954847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.954897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.954935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.954940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.954993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.955044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.955099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.955151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.955190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.955196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.955249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.955297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.955346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.955396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.955435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.955440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.955493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.955541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.955592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.955644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.955681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.955685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.955737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.955793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.955842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.955891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.955929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.955934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.955987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.956034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.956080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.956130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.956167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.956172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.956220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:28.956263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:28.956309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:28.956355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:28.956396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:28.956403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:28.956438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072100190:12142], now have 1 active actors on pipe
2025-10-01T14:14:28.956674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:28.956679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256519072100190:12142]
2025-10-01T14:14:28.956703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:28.956705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:28.956725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2263 reason: error at write: Disconnected sessionId: src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0
2025-10-01T14:14:28.956894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2263 sessionId: src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0 is DEAD
2025-10-01T14:14:28.957020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:28.957026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0] Write session will restart in 0.006140s
2025-10-01T14:14:28.957043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0] Write session: Do CDS request
2025-10-01T14:14:28.957048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:28.957127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:28.963768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.963856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:28.963867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2264
2025-10-01T14:14:28.963964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:28.963986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:28.963994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:28.963997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:28.964346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2264 sessionId:  describe result for acl check
2025-10-01T14:14:28.964380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:28.964385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:28.964387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:28.964392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256519072100255:7983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:28.964804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256519072100255:7983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:28.965173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:28.966635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256519072100255:7983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:28.966721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:28.966874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:28.966883Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:28.966894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:28.966937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:28.966969Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256516695197791:11987]
2025-10-01T14:14:28.967458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:28.967674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:28.967711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:28.967980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:28.968033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.968038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.968039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.968040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.968041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.968042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.968043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.968044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.968045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.968046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.968047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.968048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.968049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.968049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.968054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.968063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.968066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.968070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.968073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.968077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.968080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.968084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.968088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.968091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.968095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.968098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.968101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.968105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.968110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.968117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:28.968123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.968128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:28.968132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.968137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:28.968141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.968146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:28.968150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.968154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:28.968161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.968165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:28.968170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.968179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:28.968183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.968187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:28.968193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.968198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:28.968204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.968208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.968214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.968219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.968224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.968229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.968233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.968239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:28.968243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.968251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:28.968277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:28.970436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256519072100255:7983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:28.970446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256519072100255:7983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:28.970451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256519072100255:7983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:28.970456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:28.971535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:28.972152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:28.972166Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:28.972168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:28.972171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:28.972175Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2263 [2:7556256516695197791:11987]
2025-10-01T14:14:28.972184Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:28.972195Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:28.972196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.972198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.972200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.972209Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:28.972213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:28.972219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:28.972256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.972259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.972260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.972263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:28.972264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:28.972315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:28.972322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.972333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:28.972342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:28.972350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:28.972361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072100197:2446], now have 1 active actors on pipe
2025-10-01T14:14:28.972365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256519072100294:7983], now have 1 active actors on pipe
2025-10-01T14:14:28.972370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256516695197786:11987]
2025-10-01T14:14:28.972371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256516695197786:11987]
2025-10-01T14:14:28.972372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256516695197786:11987]
2025-10-01T14:14:28.972383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:28.972392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:28.972402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:28.972387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2263
2025-10-01T14:14:28.972388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2263
2025-10-01T14:14:28.972404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:28.972410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:28.972414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:28.972416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:28.972419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256516695197786:11987]
2025-10-01T14:14:28.972421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:28.972431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:28.972441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.972445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.972464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24a376fc-9a66429d-9306062b-6d92244d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:28.972472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:28.972475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:28.972477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:28.972483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:28.972490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:28.972505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.972642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.972648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.972658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:28.972743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2264 partition: 0 MaxSeqNo: 45 sessionId: src_id|24a376fc-9a66429d-9306062b-6d92244d_0
2025-10-01T14:14:28.973095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3fe37abe-c9ac870c-f28dab4b-1749c037_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|24a376fc-9a66429d-9306062b-6d92244d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:28.975861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a376fc-9a66429d-9306062b-6d92244d_0] Write session: try to update token
2025-10-01T14:14:28.975879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a376fc-9a66429d-9306062b-6d92244d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:28.988240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2264 sessionId: src_id|24a376fc-9a66429d-9306062b-6d92244d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:28.990431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:28.991171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:28.991194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:28.991210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:28.991213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:28.991214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:28.991217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:28.991224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256516695197786:11987]
2025-10-01T14:14:28.991227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256516695197786:11987]
2025-10-01T14:14:28.991229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256516695197786:11987]
2025-10-01T14:14:28.991266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:28.991271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:28.991276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:28.991277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:28.991280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:28.991360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:28.991396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:29.057052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256523367067598:12142]
2025-10-01T14:14:29.057311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2263, pipe: [1:7556256523367067598:12142]
2025-10-01T14:14:29.125083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:29.125321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:29.125374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067598:12142], now have 1 active actors on pipe
2025-10-01T14:14:29.125453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:29.125571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256523367067598:12142]
2025-10-01T14:14:29.125594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:29.133667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:29.134914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:29.134927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:29.134950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2264 reason: error at write: Disconnected sessionId: src_id|24a376fc-9a66429d-9306062b-6d92244d_0
2025-10-01T14:14:29.135117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2264 sessionId: src_id|24a376fc-9a66429d-9306062b-6d92244d_0 is DEAD
2025-10-01T14:14:29.135238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a376fc-9a66429d-9306062b-6d92244d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:29.135248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a376fc-9a66429d-9306062b-6d92244d_0] Write session will restart in 0.008008s
2025-10-01T14:14:29.135278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a376fc-9a66429d-9306062b-6d92244d_0] Write session: Do CDS request
2025-10-01T14:14:29.135285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a376fc-9a66429d-9306062b-6d92244d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:29.137657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:29.137821Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:29.137828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:29.137836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:29.137872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:29.137898Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256520990165195:11991]
2025-10-01T14:14:29.138268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:29.138469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:29.138496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:29.138677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:29.138710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.138715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.138715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.138716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.138716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.138717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.138718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.138718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.138719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.138720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.138720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.138721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.138722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.138722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.138725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.138731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.138733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.138735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.138738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.138740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.138742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.138744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.138746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.138749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.138751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.138753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.138755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.138758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.138762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.138767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.138770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.138773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.138776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.138778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.138781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.138784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.138786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.138789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.138791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.138794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.138797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.138799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.138801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.138804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.138806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.138809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.138811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.138813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.138816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.138819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.138825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.138827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.138829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.138832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.138834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.138837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.138857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:29.142078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:29.142677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:29.142692Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:29.142694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:29.142696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:29.142702Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2264 [2:7556256520990165195:11991]
2025-10-01T14:14:29.142712Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:29.142723Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:29.142728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.142731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.142732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.142743Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:29.142750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:29.142754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:29.142789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.142794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.142795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.142797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:29.142799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:29.142846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:29.142851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.142857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.142863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.142871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:29.142885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256520990165189:11991]
2025-10-01T14:14:29.142892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256520990165189:11991]
2025-10-01T14:14:29.142896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256520990165189:11991]
2025-10-01T14:14:29.142907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:29.142914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:29.142918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:29.142919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:29.142924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067624:2446], now have 1 active actors on pipe
2025-10-01T14:14:29.142932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:29.142947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:29.142953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:29.142973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256520990165189:11991]
2025-10-01T14:14:29.142982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:29.142997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:29.142981Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2264
2025-10-01T14:14:29.144861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a376fc-9a66429d-9306062b-6d92244d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.144936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:29.144947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2265
2025-10-01T14:14:29.145031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.145055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:29.145062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:29.145066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:29.145408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2265 sessionId:  describe result for acl check
2025-10-01T14:14:29.145443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:29.145451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:29.145453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:29.145458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256523367067695:7931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:29.145926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256523367067695:7931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:29.147736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256523367067695:7931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:29.151927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256523367067695:7931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:29.151940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256523367067695:7931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:29.151942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256523367067695:7931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:29.151949Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:29.152204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2264
2025-10-01T14:14:29.152801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067729:7931], now have 1 active actors on pipe
2025-10-01T14:14:29.152829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.152834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.152851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:29.152860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:29.152866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256520990165189:11991]
2025-10-01T14:14:29.152892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:29.152906Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|367a010f-d251ee68-d64156b3-972cbf36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:29.152917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.152926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.152928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:29.152938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.152954Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:29.152970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:29.153119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:29.153248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:29.153379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:29.153507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:29.153678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:29.153713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.153733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:29.153849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.153857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.153873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.153935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2265 partition: 0 MaxSeqNo: 45 sessionId: src_id|367a010f-d251ee68-d64156b3-972cbf36_0
2025-10-01T14:14:29.154245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a376fc-9a66429d-9306062b-6d92244d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|367a010f-d251ee68-d64156b3-972cbf36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:29.156908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367a010f-d251ee68-d64156b3-972cbf36_0] Write session: try to update token
2025-10-01T14:14:29.156923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367a010f-d251ee68-d64156b3-972cbf36_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:29.169322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2265 sessionId: src_id|367a010f-d251ee68-d64156b3-972cbf36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:29.171390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:29.171408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:29.171410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:29.171411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:29.171420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256520990165189:11991]
2025-10-01T14:14:29.171423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256520990165189:11991]
2025-10-01T14:14:29.171426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256520990165189:11991]
2025-10-01T14:14:29.171466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:29.171475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.171476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:29.171491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:29.171507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:29.171510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:29.171590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:29.171579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:29.225489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256523367067730:12142]
2025-10-01T14:14:29.225710Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2264, pipe: [1:7556256523367067730:12142]
2025-10-01T14:14:29.302006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:29.302246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.302256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.302275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067730:12142], now have 1 active actors on pipe
2025-10-01T14:14:29.302516Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:29.302529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:29.302545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:29.302551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:29.302590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2265 reason: error at write: Disconnected sessionId: src_id|367a010f-d251ee68-d64156b3-972cbf36_0
2025-10-01T14:14:29.302596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256523367067730:12142]
2025-10-01T14:14:29.302729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2265 sessionId: src_id|367a010f-d251ee68-d64156b3-972cbf36_0 is DEAD
2025-10-01T14:14:29.302833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367a010f-d251ee68-d64156b3-972cbf36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:29.302842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367a010f-d251ee68-d64156b3-972cbf36_0] Write session will restart in 0.009954s
2025-10-01T14:14:29.302861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367a010f-d251ee68-d64156b3-972cbf36_0] Write session: Do CDS request
2025-10-01T14:14:29.302865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367a010f-d251ee68-d64156b3-972cbf36_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:29.310704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:29.312288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:29.312416Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:29.312424Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:29.312432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:29.312473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:29.312500Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256520990165297:11994]
2025-10-01T14:14:29.312878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:29.313089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:29.313112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:29.313305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:29.313339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.313343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.313344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.313345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.313345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.313346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.313346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.313347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.313347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.313348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.313348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.313349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.313349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.313350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.313352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.313358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.313361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.313363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.313365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.313367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.313369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.313371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.313373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.313375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.313377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.313379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.313381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.313382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.313387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.313391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.313395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.313398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.313400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.313403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.313407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.313409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.313412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.313415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.313417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.313420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.313422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.313425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.313427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.313430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.313432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.313434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.313437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.313439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.313446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.313448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.313451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.313457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.313464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.313469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.313476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.313480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.313515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:29.313835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|367a010f-d251ee68-d64156b3-972cbf36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.313881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:29.313895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2266
2025-10-01T14:14:29.314011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.314038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:29.314047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:29.314050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:29.314385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2266 sessionId:  describe result for acl check
2025-10-01T14:14:29.314415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:29.314421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:29.314422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:29.314427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256523367067800:7916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:29.314918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256523367067800:7916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:29.316636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256523367067800:7916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:29.316816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:29.317414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:29.317427Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:29.317429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:29.317432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:29.317439Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2265 [2:7556256520990165297:11994]
2025-10-01T14:14:29.317454Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:29.317467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:29.317476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.317480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.317482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.317496Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:29.317501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:29.317507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:29.317543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.317548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.317549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.317552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:29.317553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:29.317600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:29.317607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.317618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.317629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.317644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:29.317665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067732:2446], now have 1 active actors on pipe
2025-10-01T14:14:29.317675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256520990165292:11994]
2025-10-01T14:14:29.317666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2265
2025-10-01T14:14:29.317680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256520990165292:11994]
2025-10-01T14:14:29.317683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256520990165292:11994]
2025-10-01T14:14:29.317691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:29.317696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:29.317703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:29.317704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:29.317706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:29.317716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:29.317719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:29.317744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256520990165292:11994]
2025-10-01T14:14:29.317758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:29.317767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:29.322131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256523367067800:7916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:29.322141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256523367067800:7916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:29.322143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256523367067800:7916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:29.322149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:29.322354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067839:7916], now have 1 active actors on pipe
2025-10-01T14:14:29.322421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2265
2025-10-01T14:14:29.322473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.322482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.322507Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:29.322520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.322528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.322532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:29.322541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.322557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:29.322576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.322696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.322702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.322714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.322775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2266 partition: 0 MaxSeqNo: 45 sessionId: src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0
2025-10-01T14:14:29.323064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|367a010f-d251ee68-d64156b3-972cbf36_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:29.325724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0] Write session: try to update token
2025-10-01T14:14:29.325738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:29.327640Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:29.327654Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:29.327662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256520990165292:11994]
2025-10-01T14:14:29.327700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:29.327706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:29.327850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:29.327988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:29.328115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:29.328251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:29.328430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:29.328465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:29.339209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2266 sessionId: src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:29.341624Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:29.341824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.341846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.341884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:29.341960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:29.344944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:29.344960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:29.344962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:29.344964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:29.344978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256520990165292:11994]
2025-10-01T14:14:29.344981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256520990165292:11994]
2025-10-01T14:14:29.344984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256520990165292:11994]
2025-10-01T14:14:29.345022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:29.345027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:29.345033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:29.345033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.345035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:29.345036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:29.345156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:29.402652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256523367067842:12142]
2025-10-01T14:14:29.402900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2265, pipe: [1:7556256523367067842:12142]
2025-10-01T14:14:29.474494Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:29.480818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.480844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.480976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.481027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.481086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.481140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.481183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.481192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.481258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.481315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.481372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.481425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.481466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.481472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.481528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.481584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.481641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.481696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.481736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.481742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.481800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.481854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.481903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.481958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.482003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.482009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.482064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.482119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.482168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.482217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.482254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.482259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.482311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.482361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.482438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.482502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.482539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.482544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.482600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.482652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.482702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.482755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.482792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.482796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.482857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.482912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.482968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.483027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.483073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.483078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.483140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.483188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.483237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.483287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.483323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.483327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.483379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:29.483428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:29.483478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:29.483549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:29.483587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:29.483592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:29.483633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067842:12142], now have 1 active actors on pipe
2025-10-01T14:14:29.483839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:29.483855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:29.483856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256523367067842:12142]
2025-10-01T14:14:29.483881Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2266 reason: error at write: Disconnected sessionId: src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0
2025-10-01T14:14:29.483884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:29.484073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2266 sessionId: src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0 is DEAD
2025-10-01T14:14:29.484203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:29.484214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0] Write session will restart in 0.009720s
2025-10-01T14:14:29.484241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0] Write session: Do CDS request
2025-10-01T14:14:29.484246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:29.484301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:29.492760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:29.494281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:29.494444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:29.494452Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:29.494459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:29.494490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:29.494519Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256520990165440:12007]
2025-10-01T14:14:29.494912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.494900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:29.494997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:29.495014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2267
2025-10-01T14:14:29.495115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.495145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:29.495152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:29.495155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:29.495150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:29.495188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:29.495381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:29.495412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.495417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.495418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.495418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.495419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.495419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.495420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.495421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.495421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.495422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.495423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.495423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.495424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.495424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.495427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.495434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.495436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.495438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.495440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.495442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.495444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.495446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.495448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.495450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.495452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.495454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.495456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.495458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.495463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.495467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.495470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.495473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.495476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.495508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2267 sessionId:  describe result for acl check
2025-10-01T14:14:29.495478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.495488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.495537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:29.495491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.495539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:29.495494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.495498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.495541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:29.495500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.495545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256523367067914:7901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:29.495503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.495505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.495508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.495510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.495512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.495515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.495517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.495519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.495522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.495524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.495527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.495529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.495531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.495534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.495536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.495540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.495543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.495562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:29.496000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256523367067914:7901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:29.497753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256523367067914:7901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:29.498935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:29.499518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:29.499528Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:29.499531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:29.499533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:29.499539Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2266 [2:7556256520990165440:12007]
2025-10-01T14:14:29.499552Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:29.499565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:29.499567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.499570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.499572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.499586Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:29.499595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:29.499601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:29.499634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.499639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.499641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.499643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:29.499645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:29.499698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:29.499706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.499715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.499725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.499742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:29.499761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067846:2446], now have 1 active actors on pipe
2025-10-01T14:14:29.499772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256520990165435:12007]
2025-10-01T14:14:29.499774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256520990165435:12007]
2025-10-01T14:14:29.499776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256520990165435:12007]
2025-10-01T14:14:29.499787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:29.499801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:29.499807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:29.499810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:29.499812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:29.499813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:29.499814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:29.499830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256520990165435:12007]
2025-10-01T14:14:29.499836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:29.499838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:29.499844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2266
2025-10-01T14:14:29.499961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256523367067914:7901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:29.499975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256523367067914:7901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:29.499977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256523367067914:7901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:29.499984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:29.500162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067949:7901], now have 1 active actors on pipe
2025-10-01T14:14:29.500201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2266
2025-10-01T14:14:29.500243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.500250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.500266Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:29.500274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.500277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.500279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:29.500284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.500290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:29.500302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.500420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.500432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.500449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.500517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2267 partition: 0 MaxSeqNo: 45 sessionId: src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0
2025-10-01T14:14:29.500820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c20d9869-9b7df649-39c7dcd2-8f4fea4d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:29.503828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0] Write session: try to update token
2025-10-01T14:14:29.503843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:29.517667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2267 sessionId: src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:29.519378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:29.519396Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:29.519398Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:29.519399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:29.519407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256520990165435:12007]
2025-10-01T14:14:29.519410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256520990165435:12007]
2025-10-01T14:14:29.519413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256520990165435:12007]
2025-10-01T14:14:29.519450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:29.519456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.519458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:29.519469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:29.519474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:29.519480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:29.519588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:29.520127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:29.583905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256523367067962:12142]
2025-10-01T14:14:29.584183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2266, pipe: [1:7556256523367067962:12142]
2025-10-01T14:14:29.656484Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:29.656789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.656805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.656849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067962:12142], now have 1 active actors on pipe
2025-10-01T14:14:29.657028Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:29.657032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:29.657058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:29.657062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:29.657100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256523367067962:12142]
2025-10-01T14:14:29.657118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2267 reason: error at write: Disconnected sessionId: src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0
2025-10-01T14:14:29.657296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2267 sessionId: src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0 is DEAD
2025-10-01T14:14:29.657447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:29.657457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0] Write session will restart in 0.006577s
2025-10-01T14:14:29.657478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0] Write session: Do CDS request
2025-10-01T14:14:29.657483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:29.665041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.665132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:29.665155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2268
2025-10-01T14:14:29.665329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.665372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:29.665385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:29.665391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:29.665600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:29.665911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2268 sessionId:  describe result for acl check
2025-10-01T14:14:29.665953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:29.665961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:29.665963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:29.665969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256523367068030:7880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:29.666625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256523367068030:7880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:29.668258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:29.668521Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:29.668535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:29.668549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:29.668626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:29.668687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256520990165543:12009]
2025-10-01T14:14:29.668853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256523367068030:7880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:29.669362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:29.669712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:29.669763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:29.670105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:29.670175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.670182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.670184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.670185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.670186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.670188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.670189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.670190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.670192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.670193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.670194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.670196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.670198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.670199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.670205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.670216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.670222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.670226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.670229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.670234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.670238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.670242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.670246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.670251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.670254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.670258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.670261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.670266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.670275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.670284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.670291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.670296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.670305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.670310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.670315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.670320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.670326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.670332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.670336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.670345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.670350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.670356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.670360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.670365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.670402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.670414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.670418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.670424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.670428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.670433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.670437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.670442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.670447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.670451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.670456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.670460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.670499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:29.672702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256523367068030:7880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:29.672718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256523367068030:7880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:29.672722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256523367068030:7880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:29.672731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:29.674470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:29.675292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:29.675307Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:29.675310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:29.675313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:29.675322Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2267 [2:7556256520990165543:12009]
2025-10-01T14:14:29.675342Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:29.675365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:29.675374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.675379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.675382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.675404Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:29.675416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:29.675428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:29.675493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.675501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.675503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.675506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:29.675509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:29.675587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:29.675596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.675608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.675620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.675641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:29.675664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367068069:7880], now have 1 active actors on pipe
2025-10-01T14:14:29.675672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367067965:2446], now have 1 active actors on pipe
2025-10-01T14:14:29.675681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256520990165538:12009]
2025-10-01T14:14:29.675688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256520990165538:12009]
2025-10-01T14:14:29.675690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256520990165538:12009]
2025-10-01T14:14:29.675720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:29.675741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:29.675750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:29.675719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2267
2025-10-01T14:14:29.675748Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2267
2025-10-01T14:14:29.675755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:29.675760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:29.675761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:29.675764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:29.675797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256520990165538:12009]
2025-10-01T14:14:29.675801Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:29.675810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:29.675822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.675827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.675889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:29.675904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.675915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.675922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:29.675934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.675950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:29.675983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.676190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.676199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.676216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.676318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2268 partition: 0 MaxSeqNo: 45 sessionId: src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0
2025-10-01T14:14:29.676714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c714ad1f-2125cd92-6827348-4f6c02b1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:29.680744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0] Write session: try to update token
2025-10-01T14:14:29.680763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:29.697937Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2268 sessionId: src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:29.698295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:29.698315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:29.698317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:29.698319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:29.698329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256520990165538:12009]
2025-10-01T14:14:29.698332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256520990165538:12009]
2025-10-01T14:14:29.698335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256520990165538:12009]
2025-10-01T14:14:29.698387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:29.698389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:29.698395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.698396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:29.698399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:29.698402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:29.698520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:29.700762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:29.757504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256523367068076:12142]
2025-10-01T14:14:29.757799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2267, pipe: [1:7556256523367068076:12142]
2025-10-01T14:14:29.828262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:29.828585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.828599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.828632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367068076:12142], now have 1 active actors on pipe
2025-10-01T14:14:29.828806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:29.828900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:29.828908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256523367068076:12142]
2025-10-01T14:14:29.828930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:29.829006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2268 reason: status is not ok: tablet will be restarted right now sessionId: src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0
2025-10-01T14:14:29.829241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2268 sessionId: src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0 is DEAD
2025-10-01T14:14:29.829380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:29.829390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0] Write session will restart in 0.009344s
2025-10-01T14:14:29.829418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0] Write session: Do CDS request
2025-10-01T14:14:29.829422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:29.836951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:29.838578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:29.838732Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:29.838742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:29.838750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:29.838782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:29.838805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256520990165649:12012]
2025-10-01T14:14:29.839191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:29.839489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:29.839533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:29.839819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:29.839896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.839901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.839902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.839904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.839905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.839906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.839907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.839909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.839938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.839910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.839911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.839912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.839913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.839913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.839914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.839918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.839923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.839925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.839927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.839929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.839931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.839933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.839935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.839937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.839939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.839941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.839943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.839945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.839948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.839955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.839963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:29.839969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.839973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:29.839977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.839982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:29.839986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.839990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:29.839995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.840000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:29.840005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.840010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:29.840015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.840020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:29.840024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.840028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:29.840034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.840044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:29.840053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.840062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.840066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.840076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.840080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.840085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.840094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.840098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:29.840106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.840111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:29.840079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:29.840099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2269
2025-10-01T14:14:29.840148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:29.840268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:29.840300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:29.840310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:29.840314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:29.840739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2269 sessionId:  describe result for acl check
2025-10-01T14:14:29.840771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:29.840778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:29.840779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:29.840785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256523367068162:7871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:29.841284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256523367068162:7871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:29.843413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256523367068162:7871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:29.843579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:29.844290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:29.844308Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:29.844310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:29.844313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:29.844319Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2268 [2:7556256520990165649:12012]
2025-10-01T14:14:29.844333Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:29.844348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:29.844351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.844354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.844356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.844369Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:29.844374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:29.844380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:29.844431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.844439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.844441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.844444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:29.844447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:29.844506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:29.844512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.844523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:29.844533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:29.844549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:29.844581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367068090:2446], now have 1 active actors on pipe
2025-10-01T14:14:29.844588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256520990165644:12012]
2025-10-01T14:14:29.844594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256520990165644:12012]
2025-10-01T14:14:29.844598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256520990165644:12012]
2025-10-01T14:14:29.844597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2268
2025-10-01T14:14:29.844610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:29.844618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:29.844621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:29.844624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:29.844626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:29.844639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:29.844647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:29.844680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256520990165644:12012]
2025-10-01T14:14:29.844693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:29.844715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:29.849044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256523367068162:7871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:29.849057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256523367068162:7871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:29.849061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256523367068162:7871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:29.849081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:29.849309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367068200:7871], now have 1 active actors on pipe
2025-10-01T14:14:29.849342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2268
2025-10-01T14:14:29.849412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.849424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.849452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:29.849467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:29.849480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:29.849483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:29.849496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:29.849513Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:29.849534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.849658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.849668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.849684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:29.849747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2269 partition: 0 MaxSeqNo: 45 sessionId: src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0
2025-10-01T14:14:29.850000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de8b95f0-6a7a3e13-dfd2f8f0-7280d909_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:29.853028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0] Write session: try to update token
2025-10-01T14:14:29.853044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:29.854474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:29.854486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:29.854492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256520990165644:12012]
2025-10-01T14:14:29.854521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:29.854523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:29.854668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:29.854810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:29.854947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:29.855074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:29.855255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:29.855285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:29.868360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2269 sessionId: src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:29.870819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:29.871783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:29.871809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:29.871826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:29.871829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:29.871831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:29.871832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:29.871839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256520990165644:12012]
2025-10-01T14:14:29.871842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256520990165644:12012]
2025-10-01T14:14:29.871845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256520990165644:12012]
2025-10-01T14:14:29.871873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:29.871878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:29.871880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:29.871886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:29.871892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:29.871894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:29.872008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:29.928983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256523367068203:12142]
2025-10-01T14:14:29.929222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2268, pipe: [1:7556256523367068203:12142]
2025-10-01T14:14:30.002455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:30.002696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:30.002724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256523367068203:12142], now have 1 active actors on pipe
2025-10-01T14:14:30.002803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:30.002916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:30.002992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256523367068203:12142]
2025-10-01T14:14:30.011259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:30.012627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:30.012641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:30.012662Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2269 reason: error at write: Disconnected sessionId: src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0
2025-10-01T14:14:30.012809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2269 sessionId: src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0 is DEAD
2025-10-01T14:14:30.012946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:30.012965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0] Write session will restart in 0.007235s
2025-10-01T14:14:30.012989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0] Write session: Do CDS request
2025-10-01T14:14:30.012993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:30.015391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:30.015572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:30.015581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:30.015590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:30.015627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:30.015656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256525285133051:12014]
2025-10-01T14:14:30.016044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:30.016257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:30.016285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:30.016524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:30.016594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.016598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.016599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.016600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.016600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.016601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.016602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.016602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.016603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.016604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.016604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.016605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.016605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.016606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.016609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.016615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.016617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.016619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.016621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.016624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.016626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.016628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.016630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.016632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.016636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.016639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.016642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.016646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.016652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.016659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.016664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.016668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.016673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.016677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.016681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.016685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.016689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.016693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.016697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.016706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.016715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.016724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.016732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.016739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.016747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.016756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.016764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.016769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.016772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.016775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.016777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.016780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.016783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.016786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.016792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.016795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.016815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:30.020145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:30.020744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:30.020755Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:30.020757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:30.020762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:30.020767Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2269 [2:7556256525285133051:12014]
2025-10-01T14:14:30.020776Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:30.020787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:30.020792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.020795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.020796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.020806Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:30.020809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:30.020813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:30.020849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.020855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.020857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.020859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:30.020861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:30.020908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:30.020913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.020919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.020925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.020933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:30.020945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035503:2446], now have 1 active actors on pipe
2025-10-01T14:14:30.020954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256525285133045:12014]
2025-10-01T14:14:30.020955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256525285133045:12014]
2025-10-01T14:14:30.020956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256525285133045:12014]
2025-10-01T14:14:30.020967Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:30.020975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:30.020977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:30.020978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:30.020981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:30.020989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:30.020993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:30.021007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.021013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256525285133045:12014]
2025-10-01T14:14:30.021020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:30.021024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:30.020990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2269
2025-10-01T14:14:30.021081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:30.021091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2270
2025-10-01T14:14:30.021214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.021238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:30.021246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:30.021249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:30.021582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2270 sessionId:  describe result for acl check
2025-10-01T14:14:30.021607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:30.021608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:30.021609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:30.021612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256527662035578:7843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:30.022024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256527662035578:7843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:30.024224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256527662035578:7843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:30.029473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256527662035578:7843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:30.029488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256527662035578:7843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:30.029491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256527662035578:7843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:30.029500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:30.029754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035614:7843], now have 1 active actors on pipe
2025-10-01T14:14:30.029794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2269
2025-10-01T14:14:30.030689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.030709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.030725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:30.030731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:30.030737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256525285133045:12014]
2025-10-01T14:14:30.030765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:30.030772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:30.030781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.030785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.030787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:30.030795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.030811Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:30.030826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:30.030976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:30.031097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:30.031222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:30.031338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:30.031506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:30.031541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.031564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:30.031744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.031752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.031764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.031842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2270 partition: 0 MaxSeqNo: 45 sessionId: src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0
2025-10-01T14:14:30.032196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a13af3f4-210e5f28-ae2ba236-95e3e0e7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:30.034827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0] Write session: try to update token
2025-10-01T14:14:30.034842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:30.046674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2270 sessionId: src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:30.048484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:30.048504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:30.048506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:30.048508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:30.048516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256525285133045:12014]
2025-10-01T14:14:30.048519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256525285133045:12014]
2025-10-01T14:14:30.048522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256525285133045:12014]
2025-10-01T14:14:30.048558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:30.048557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:30.048563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.048563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:30.048564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:30.048577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:30.048689Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:30.048904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:30.103058Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256527662035617:12142]
2025-10-01T14:14:30.103235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2269, pipe: [1:7556256527662035617:12142]
2025-10-01T14:14:30.182251Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:30.182600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.182612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.182629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035617:12142], now have 1 active actors on pipe
2025-10-01T14:14:30.182781Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:30.182813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256527662035617:12142]
2025-10-01T14:14:30.182825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:30.182828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:30.182874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2270 reason: error at write: Disconnected sessionId: src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0
2025-10-01T14:14:30.182917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:30.183002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2270 sessionId: src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0 is DEAD
2025-10-01T14:14:30.183144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:30.183153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0] Write session will restart in 0.007206s
2025-10-01T14:14:30.183170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0] Write session: Do CDS request
2025-10-01T14:14:30.183174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:30.191571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:30.191804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.191838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:30.191850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2271
2025-10-01T14:14:30.191998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.192027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:30.192036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:30.192039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:30.192310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2271 sessionId:  describe result for acl check
2025-10-01T14:14:30.192338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:30.192344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:30.192345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:30.192350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256527662035710:7800] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:30.192744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256527662035710:7800] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:30.193398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:30.193552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:30.193562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:30.193573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:30.193622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:30.193651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256525285133163:12018]
2025-10-01T14:14:30.194046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256527662035710:7800] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:30.194145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:30.194399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:30.194434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:30.194694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:30.194743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.194749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.194750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.194751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.194752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.194753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.194754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.194755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.194756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.194757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.194758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.194759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.194760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.194761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.194765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.194772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.194776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.194779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.194782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.194787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.194790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.194793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.194797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.194801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.194804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.194808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.194812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.194815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.194820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.194827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.194833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.194837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.194841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.194845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.194849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.194858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.194863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.194868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.194876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.194881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.194885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.194890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.194898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.194903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.194907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.194915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.194919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.194924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.194932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.194936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.194940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.194945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.194952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.194957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.194962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.194970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.195007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:30.198241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:30.198466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256527662035710:7800] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:30.198479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256527662035710:7800] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:30.198481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256527662035710:7800] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:30.198487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:30.198887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:30.198902Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:30.198903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:30.198906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:30.198910Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2270 [2:7556256525285133163:12018]
2025-10-01T14:14:30.198920Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:30.198932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:30.198933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.198936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.198937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.198948Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:30.198952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:30.198956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:30.198990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.198995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.198996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.198999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:30.199001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:30.199049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:30.199054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.199061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.199067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.199075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:30.199092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256525285133158:12018]
2025-10-01T14:14:30.199098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256525285133158:12018]
2025-10-01T14:14:30.199099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256525285133158:12018]
2025-10-01T14:14:30.199108Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:30.199114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:30.199117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:30.199119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:30.199124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035641:2446], now have 1 active actors on pipe
2025-10-01T14:14:30.199129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035748:7800], now have 1 active actors on pipe
2025-10-01T14:14:30.199134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:30.199146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:30.199153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:30.199173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256525285133158:12018]
2025-10-01T14:14:30.199163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2270
2025-10-01T14:14:30.199183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:30.199164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2270
2025-10-01T14:14:30.199191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:30.199221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.199229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.199251Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:30.199261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.199265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.199271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:30.199279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.199291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:30.199306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.199422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.199429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.199439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.199493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2271 partition: 0 MaxSeqNo: 45 sessionId: src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0
2025-10-01T14:14:30.199774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9648bfa8-ad842b72-a594d294-ec92d6b3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:30.202413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0] Write session: try to update token
2025-10-01T14:14:30.202427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:30.209438Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:30.209456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:30.209463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256525285133158:12018]
2025-10-01T14:14:30.209508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:30.209514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:30.209663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:30.209789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:30.209909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:30.210038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:30.210221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:30.210258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:30.215222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2271 sessionId: src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:30.217663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:30.217845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.217863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.217892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:30.217967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:30.229463Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:30.229477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:30.229479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:30.229480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:30.229488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256525285133158:12018]
2025-10-01T14:14:30.229490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256525285133158:12018]
2025-10-01T14:14:30.229493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256525285133158:12018]
2025-10-01T14:14:30.229527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:30.229529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:30.229533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:30.229535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:30.229535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.229537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:30.229645Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:30.282779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256527662035758:12142]
2025-10-01T14:14:30.283020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2270, pipe: [1:7556256527662035758:12142]
2025-10-01T14:14:30.363196Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:30.369399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.369420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.369550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.369597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.369659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.369710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.369747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.369754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.369808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.369859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.369908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.369991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.370030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.370035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.370084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.370131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.370180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.370232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.370269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.370273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.370322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.370385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.370434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.370485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.370521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.370526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.370579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.370625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.370681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.370735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.370774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.370779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.370831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.370883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.370933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.370983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.371021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.371026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.371078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.371127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.371178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.371239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.371275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.371282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.371336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.371385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.371434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.371483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.371518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.371524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.371576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.371628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.371679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.371739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.371780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.371785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.371837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.371884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.371931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.371979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.372014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.372021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.372055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035758:12142], now have 1 active actors on pipe
2025-10-01T14:14:30.372288Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:30.372347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:30.372354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:30.372381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2271 reason: error at write: Disconnected sessionId: src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0
2025-10-01T14:14:30.372556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256527662035758:12142]
2025-10-01T14:14:30.372600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2271 sessionId: src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0 is DEAD
2025-10-01T14:14:30.372706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:30.372698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:30.372718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0] Write session will restart in 0.009033s
2025-10-01T14:14:30.372752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0] Write session: Do CDS request
2025-10-01T14:14:30.372757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:30.380262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:30.381778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:30.381912Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:30.381921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:30.381930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:30.381970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:30.382006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256525285133272:12021]
2025-10-01T14:14:30.382405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:30.382772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.382886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:30.382926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:30.382940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:30.382952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2272
2025-10-01T14:14:30.383041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.383062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:30.383076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:30.383082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:30.383135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:30.383180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.383185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.383186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.383187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.383188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.383189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.383190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.383191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.383192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.383193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.383195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.383196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.383197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.383198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.383203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.383214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.383218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.383223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.383227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.383231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.383235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.383239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.383243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.383248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.383252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.383258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.383262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.383266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.383276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.383283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.383292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.383300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.383307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.383312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.383321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.383327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.383335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.383340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.383349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.383358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.383362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.383371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.383376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.383385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.383390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.383399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.383404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.383389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2272 sessionId:  describe result for acl check
2025-10-01T14:14:30.383412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.383419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.383416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:30.383428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.383422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:30.383432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.383423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:30.383437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.383441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.383426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256527662035832:7794] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:30.383447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.383454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.383458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.383495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:30.383816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256527662035832:7794] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:30.385512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256527662035832:7794] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:30.386661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:30.387261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:30.387270Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:30.387272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:30.387274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:30.387278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2271 [2:7556256525285133272:12021]
2025-10-01T14:14:30.387287Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:30.387300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:30.387305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.387307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.387308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.387319Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:30.387325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:30.387329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:30.387362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.387371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.387373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.387375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:30.387378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:30.387432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:30.387437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.387448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.387463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.387482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:30.387500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035761:2446], now have 1 active actors on pipe
2025-10-01T14:14:30.387510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256525285133267:12021]
2025-10-01T14:14:30.387515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256525285133267:12021]
2025-10-01T14:14:30.387517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256525285133267:12021]
2025-10-01T14:14:30.387504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2271
2025-10-01T14:14:30.387530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:30.387545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:30.387545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:30.387548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:30.387549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:30.387561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:30.387564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:30.387587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256525285133267:12021]
2025-10-01T14:14:30.387597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:30.387610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:30.387672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256527662035832:7794] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:30.387681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256527662035832:7794] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:30.387683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256527662035832:7794] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:30.387688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:30.387816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035869:7794], now have 1 active actors on pipe
2025-10-01T14:14:30.387842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2271
2025-10-01T14:14:30.387872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.387879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.387899Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:30.387909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.387916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.387918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:30.387927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.387937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:30.387952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.388045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.388051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.388062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.388106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2272 partition: 0 MaxSeqNo: 45 sessionId: src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0
2025-10-01T14:14:30.388316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7fcc289d-72adee91-96da55ab-2ce4dde0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:30.391070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0] Write session: try to update token
2025-10-01T14:14:30.391086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:30.404088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2272 sessionId: src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:30.407352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:30.407753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.407784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.410601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:30.410645Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:30.410648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:30.410651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:30.410653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:30.410662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256525285133267:12021]
2025-10-01T14:14:30.410675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256525285133267:12021]
2025-10-01T14:14:30.410680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256525285133267:12021]
2025-10-01T14:14:30.410733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:30.410745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.410748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:30.410925Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:30.414452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:30.414472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:30.414478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:30.414511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:30.472739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256527662035878:12142]
2025-10-01T14:14:30.472941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2271, pipe: [1:7556256527662035878:12142]
2025-10-01T14:14:30.562905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:30.570959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.570985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.571148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.571209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.571274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.571337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.571387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.571400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.571469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.571529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.571593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.571655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.571705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.571714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.571775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.571829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.571888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.571944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.571986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.571993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.572051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.572107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.572161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.572215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.572367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.572376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.572430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.572484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.572539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.572604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.572647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.572655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.572729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.572795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.572865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.572933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.572984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.572991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.573060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.573123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.573191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.573261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.573315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.573324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.573395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.573458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.573523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.573590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.573640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.573647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.573713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.573774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.573845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.573909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.573960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.573968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.574036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.574102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.574166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.574233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.574282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.574290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.574346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035878:12142], now have 1 active actors on pipe
2025-10-01T14:14:30.574562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:30.574565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256527662035878:12142]
2025-10-01T14:14:30.574591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:30.574593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:30.574613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2272 reason: error at write: Disconnected sessionId: src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0
2025-10-01T14:14:30.574783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2272 sessionId: src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0 is DEAD
2025-10-01T14:14:30.574872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:30.574880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0] Write session will restart in 0.009586s
2025-10-01T14:14:30.574900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0] Write session: Do CDS request
2025-10-01T14:14:30.574905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:30.575083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:30.583379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:30.584803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:30.584964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:30.584973Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:30.584982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:30.585024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:30.585057Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256525285133421:12034]
2025-10-01T14:14:30.585490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:30.585710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:30.585743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:30.585777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.585880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:30.585891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2273
2025-10-01T14:14:30.585994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.586014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:30.586002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:30.586021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:30.586024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:30.586053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.586059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.586059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.586060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.586060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.586061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.586062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.586062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.586063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.586064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.586064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.586065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.586065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.586066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.586069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.586075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.586077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.586079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.586080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.586082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.586084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.586086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.586088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.586090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.586092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.586095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.586098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.586102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.586108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.586115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.586120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.586125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.586130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.586135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.586139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.586144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.586152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.586157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.586165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.586170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.586179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.586189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.586198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.586203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.586207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.586212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.586220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.586225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.586233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.586240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.586244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.586254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.586259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.586264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.586273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.586279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.586322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:30.586317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2273 sessionId:  describe result for acl check
2025-10-01T14:14:30.586348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:30.586355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:30.589944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:30.586356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:30.586361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256527662035961:7786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:30.586744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256527662035961:7786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:30.589354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256527662035961:7786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:30.590857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:30.590870Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:30.590872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:30.590875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:30.590881Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2272 [2:7556256525285133421:12034]
2025-10-01T14:14:30.590903Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:30.590921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:30.590926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.590933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.590936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.590954Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:30.590964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:30.590969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:30.591011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.591017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.591021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.591024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:30.591026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:30.591085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:30.591091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.591102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.591117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.591138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:30.591156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662035886:2446], now have 1 active actors on pipe
2025-10-01T14:14:30.591163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256525285133416:12034]
2025-10-01T14:14:30.591170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256525285133416:12034]
2025-10-01T14:14:30.591172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256525285133416:12034]
2025-10-01T14:14:30.591156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2272
2025-10-01T14:14:30.591185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:30.591199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:30.591202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:30.591207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:30.591208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:30.591215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:30.591218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:30.591248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256525285133416:12034]
2025-10-01T14:14:30.591261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:30.591285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:30.591497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256527662035961:7786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:30.591507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256527662035961:7786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:30.591509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256527662035961:7786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:30.591514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:30.591709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662036000:7786], now have 1 active actors on pipe
2025-10-01T14:14:30.591718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2272
2025-10-01T14:14:30.591768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.591778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.591800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db632275-e008cf62-108c0ad6-d94dbfac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:30.591812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.591816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.591818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:30.591827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.591841Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:30.591858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.591960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.591966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.591977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.592023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2273 partition: 0 MaxSeqNo: 45 sessionId: src_id|db632275-e008cf62-108c0ad6-d94dbfac_0
2025-10-01T14:14:30.592265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f203796-6efa1a42-5f685807-fc1e5d5c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db632275-e008cf62-108c0ad6-d94dbfac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:30.595435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db632275-e008cf62-108c0ad6-d94dbfac_0] Write session: try to update token
2025-10-01T14:14:30.595449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db632275-e008cf62-108c0ad6-d94dbfac_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:30.609303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:30.609321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:30.609329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256525285133416:12034]
2025-10-01T14:14:30.609363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:30.609371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:30.609517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:30.609651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:30.609777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:30.609896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:30.610132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:30.610165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:30.610799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2273 sessionId: src_id|db632275-e008cf62-108c0ad6-d94dbfac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:30.612961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:30.613124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.613139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.613164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:30.613223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:30.624133Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:30.624152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:30.624155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:30.624159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:30.624168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256525285133416:12034]
2025-10-01T14:14:30.624172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256525285133416:12034]
2025-10-01T14:14:30.624175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256525285133416:12034]
2025-10-01T14:14:30.624216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:30.624218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:30.624223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:30.624226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.624228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:30.624229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:30.624345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:30.674987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256527662036006:12142]
2025-10-01T14:14:30.675277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2272, pipe: [1:7556256527662036006:12142]
2025-10-01T14:14:30.759706Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:30.766908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.766936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.767101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.767155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.767210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.767265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.767304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.767311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.767374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.767430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.767490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.767551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.767593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.767598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.767666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.767722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.767777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.767833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.767873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.767881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.767939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.767994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.768046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.768102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.768141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.768146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.768202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.768256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.768384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.768442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.768487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.768492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.768549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.768617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.768674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.768729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.768779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.768786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.768928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.768982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.769035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.769091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.769134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.769139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.769211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.769270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.769337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.769404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.769451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.769456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.769522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.769585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.769650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.769717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.769825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.769829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.769898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:30.769959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:30.770024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:30.770086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:30.770184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:30.770189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:30.770243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662036006:12142], now have 1 active actors on pipe
2025-10-01T14:14:30.770464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:30.770483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256527662036006:12142]
2025-10-01T14:14:30.770512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:30.770515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:30.770545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2273 reason: error at write: Disconnected sessionId: src_id|db632275-e008cf62-108c0ad6-d94dbfac_0
2025-10-01T14:14:30.770782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2273 sessionId: src_id|db632275-e008cf62-108c0ad6-d94dbfac_0 is DEAD
2025-10-01T14:14:30.770927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db632275-e008cf62-108c0ad6-d94dbfac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:30.770938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db632275-e008cf62-108c0ad6-d94dbfac_0] Write session will restart in 0.005481s
2025-10-01T14:14:30.770966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db632275-e008cf62-108c0ad6-d94dbfac_0] Write session: Do CDS request
2025-10-01T14:14:30.770972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db632275-e008cf62-108c0ad6-d94dbfac_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:30.771336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:30.777953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db632275-e008cf62-108c0ad6-d94dbfac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.778037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:30.778051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2274
2025-10-01T14:14:30.778167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.778197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:30.778205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:30.778208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:30.778611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2274 sessionId:  describe result for acl check
2025-10-01T14:14:30.778644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:30.778649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:30.778651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:30.778656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256527662036077:7775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:30.778977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:30.779150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256527662036077:7775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:30.780476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:30.780614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:30.780621Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:30.780630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:30.780659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:30.780679Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256525285133534:12037]
2025-10-01T14:14:30.781075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:30.781285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:30.781309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:30.781521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:30.781554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.781558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.781559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.781560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.781560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.781561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.781562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.781562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.781563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.781563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.781564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.781565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.781565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.781566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.781569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.781574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.781576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.781578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.781580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.781582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.781584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.781586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.781588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.781590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.781592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.781594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.781596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.781597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.781602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.781606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.781610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.781613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.781615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.781617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.781620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.781622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.781625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.781628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.781630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.781632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.781635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.781637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.781644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.781647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.781649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.781652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.781654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.781660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.781631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256527662036077:7775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:30.781663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.781665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.781668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.781670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.781673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.781676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.781678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.781680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.781699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:30.785492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256527662036077:7775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:30.785503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256527662036077:7775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:30.785505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256527662036077:7775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:30.785511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:30.785743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:30.786445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:30.786456Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:30.786457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:30.786459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:30.786465Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2273 [2:7556256525285133534:12037]
2025-10-01T14:14:30.786474Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:30.786488Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:30.786490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.786493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.786494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.786504Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:30.786511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:30.786515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:30.786550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.786555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.786556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.786558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:30.786559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:30.786612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:30.786618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.786625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.786630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.786643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:30.786661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662036129:7775], now have 1 active actors on pipe
2025-10-01T14:14:30.786668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662036008:2446], now have 1 active actors on pipe
2025-10-01T14:14:30.786674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256525285133529:12037]
2025-10-01T14:14:30.786680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256525285133529:12037]
2025-10-01T14:14:30.786682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256525285133529:12037]
2025-10-01T14:14:30.786694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:30.786708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:30.786709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:30.786719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:30.786698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2273
2025-10-01T14:14:30.786721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:30.786721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:30.786705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2273
2025-10-01T14:14:30.786726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:30.786749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256525285133529:12037]
2025-10-01T14:14:30.786760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:30.786767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:30.786780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.786788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.786833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfa2d37e-980986c-75aa0da-3069cc77_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:30.786844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.786851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.786852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:30.786858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.786867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:30.786883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.786978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.786985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.786997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.787043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2274 partition: 0 MaxSeqNo: 45 sessionId: src_id|cfa2d37e-980986c-75aa0da-3069cc77_0
2025-10-01T14:14:30.787382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db632275-e008cf62-108c0ad6-d94dbfac_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cfa2d37e-980986c-75aa0da-3069cc77_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:30.790151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa2d37e-980986c-75aa0da-3069cc77_0] Write session: try to update token
2025-10-01T14:14:30.790171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa2d37e-980986c-75aa0da-3069cc77_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:30.804500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2274 sessionId: src_id|cfa2d37e-980986c-75aa0da-3069cc77_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:30.806952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:30.808303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.808324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.808343Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:30.808346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:30.808348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:30.808349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:30.808359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256525285133529:12037]
2025-10-01T14:14:30.808364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256525285133529:12037]
2025-10-01T14:14:30.808367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256525285133529:12037]
2025-10-01T14:14:30.808414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:30.808422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:30.808429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:30.808429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.808431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:30.808433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:30.808556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:30.870583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256527662036138:12142]
2025-10-01T14:14:30.870822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2273, pipe: [1:7556256527662036138:12142]
2025-10-01T14:14:30.948321Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:30.948706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:30.948769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662036138:12142], now have 1 active actors on pipe
2025-10-01T14:14:30.948868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:30.948977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:30.948997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:30.949000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:30.949067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2274 reason: error at write: Disconnected sessionId: src_id|cfa2d37e-980986c-75aa0da-3069cc77_0
2025-10-01T14:14:30.949172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256527662036138:12142]
2025-10-01T14:14:30.949271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2274 sessionId: src_id|cfa2d37e-980986c-75aa0da-3069cc77_0 is DEAD
2025-10-01T14:14:30.949587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa2d37e-980986c-75aa0da-3069cc77_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:30.949596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa2d37e-980986c-75aa0da-3069cc77_0] Write session will restart in 0.009736s
2025-10-01T14:14:30.949614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa2d37e-980986c-75aa0da-3069cc77_0] Write session: Do CDS request
2025-10-01T14:14:30.949621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa2d37e-980986c-75aa0da-3069cc77_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:30.958416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:30.960199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:30.960376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:30.960386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:30.960393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:30.960428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:30.960468Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256525285133644:12039]
2025-10-01T14:14:30.960880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa2d37e-980986c-75aa0da-3069cc77_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.961004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:30.960997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:30.961026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2275
2025-10-01T14:14:30.961172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:30.961202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:30.961213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:30.961217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:30.961313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:30.961360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:30.961588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2275 sessionId:  describe result for acl check
2025-10-01T14:14:30.961611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:30.961624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:30.961631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:30.961633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:30.961637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256527662036220:7747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:30.961655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.961660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.961661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.961662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.961663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.961664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.961665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.961665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.961666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.961667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.961667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.961668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.961669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.961670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.961673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.961679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.961681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.961684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.961686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.961689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.961691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.961693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.961695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.961698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.961700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.961702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.961704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.961706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.961711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.961716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:30.961720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.961723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:30.961727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.961729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:30.961732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.961735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:30.961738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.961741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:30.961744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.961747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:30.961751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.961754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:30.961757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.961760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:30.961763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.961766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:30.961768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.961771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.961773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.961776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.961778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.961781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.961784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.961786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:30.961789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.961792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:30.961827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:30.962139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256527662036220:7747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:30.964064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256527662036220:7747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:30.965900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:30.966481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256527662036220:7747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:30.966496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256527662036220:7747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:30.966500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256527662036220:7747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:30.966508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:30.966539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:30.966553Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:30.966556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:30.966562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:30.966569Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2274 [2:7556256525285133644:12039]
2025-10-01T14:14:30.966582Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:30.966597Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:30.966604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.966608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.966610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.966625Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:30.966630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:30.966638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:30.966694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.966700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.966702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.966705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:30.966707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:30.966760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:30.966770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.966780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:30.966789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:30.966814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:30.966834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662036140:2446], now have 1 active actors on pipe
2025-10-01T14:14:30.966842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256527662036253:7747], now have 1 active actors on pipe
2025-10-01T14:14:30.966848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256525285133639:12039]
2025-10-01T14:14:30.966850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256525285133639:12039]
2025-10-01T14:14:30.966853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256525285133639:12039]
2025-10-01T14:14:30.966861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:30.966846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2274
2025-10-01T14:14:30.966875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:30.966867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2274
2025-10-01T14:14:30.966878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:30.966881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:30.966883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:30.966895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:30.966897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:30.966939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.966948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.966960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256525285133639:12039]
2025-10-01T14:14:30.966971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:30.966983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:30.967003Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:30.967014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:30.967017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:30.967024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:30.967032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:30.967043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:30.967069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.967211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.967221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.967234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:30.967307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2275 partition: 0 MaxSeqNo: 45 sessionId: src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0
2025-10-01T14:14:30.967635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfa2d37e-980986c-75aa0da-3069cc77_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:30.970144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0] Write session: try to update token
2025-10-01T14:14:30.970158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:30.983594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2275 sessionId: src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:30.986101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:30.986386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:30.986413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:30.986452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:30.986529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:30.992253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:30.992277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:30.992280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:30.992282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:30.992291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256525285133639:12039]
2025-10-01T14:14:30.992297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256525285133639:12039]
2025-10-01T14:14:30.992300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256525285133639:12039]
2025-10-01T14:14:30.992351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:30.992359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:30.992363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:30.992365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:30.992366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:30.992368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:30.992499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:31.049250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256531957003557:12142]
2025-10-01T14:14:31.049451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2274, pipe: [1:7556256531957003557:12142]
2025-10-01T14:14:31.146770Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:31.155538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.155570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.155743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.155822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.155894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.155961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.156014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.156024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.156094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.156176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.156240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.156310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.156358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.156366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.156434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.156495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.156560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.156636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.156677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.156685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.156744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.156807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.156867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.156929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.156971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.156978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.157037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.157102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.157161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.157226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.157273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.157281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.157444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.157585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.157668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.157749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.157800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.157808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.157889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.157968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.158049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.158138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.158195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.158203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.158290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.158364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.158460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.158533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.158668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.158678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.158759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.158833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.158909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.158980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.159035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.159045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.159129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.159199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.159276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.159349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.159404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.159411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.159482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003557:12142], now have 1 active actors on pipe
2025-10-01T14:14:31.159711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256531957003557:12142]
2025-10-01T14:14:31.159740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:31.159791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:31.159802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:31.159830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2275 reason: error at write: Disconnected sessionId: src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0
2025-10-01T14:14:31.160060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2275 sessionId: src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0 is DEAD
2025-10-01T14:14:31.160231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:31.160242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0] Write session will restart in 0.009626s
2025-10-01T14:14:31.160267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0] Write session: Do CDS request
2025-10-01T14:14:31.160273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:31.160697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:31.170822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.170815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:31.170944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:31.170966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2276
2025-10-01T14:14:31.171075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.171105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:31.171109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:31.171111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:31.171372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2276 sessionId:  describe result for acl check
2025-10-01T14:14:31.171396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:31.171401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:31.171402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:31.171416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256531957003646:7719] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:31.171801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256531957003646:7719] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:31.172730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:31.172939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:31.172949Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:31.172960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:31.173009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:31.173045Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256529580101052:12041]
2025-10-01T14:14:31.173594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:31.173758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256531957003646:7719] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:31.173883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:31.173921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:31.174204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:31.174252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.174257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.174258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.174259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.174260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.174261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.174262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.174263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.174264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.174265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.174266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.174267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.174269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.174270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.174274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.174283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.174286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.174291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.174294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.174298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.174301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.174305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.174309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.174313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.174317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.174320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.174324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.174328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.174333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.174341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.174347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.174352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.174356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.174384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.174393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.174398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.174402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.174407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.174412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.174417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.174423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.174432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.174437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.174441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.174446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.174450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.174454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.174460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.174468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.174473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.174476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.174482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.174486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.174495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.174498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.174503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.174545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:31.178658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:31.178780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256531957003646:7719] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:31.178799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256531957003646:7719] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:31.178803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256531957003646:7719] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:31.178812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:31.179316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:31.179334Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:31.179336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:31.179339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:31.179346Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2275 [2:7556256529580101052:12041]
2025-10-01T14:14:31.179361Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:31.179379Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:31.179387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.179390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.179393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.179409Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:31.179418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:31.179424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:31.179472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.179479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.179481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.179484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:31.179487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:31.179549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:31.179556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.179566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.179582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.179600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:31.179621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003573:2446], now have 1 active actors on pipe
2025-10-01T14:14:31.179628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003693:7719], now have 1 active actors on pipe
2025-10-01T14:14:31.179625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2275
2025-10-01T14:14:31.179636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256529580101046:12041]
2025-10-01T14:14:31.179642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256529580101046:12041]
2025-10-01T14:14:31.179631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2275
2025-10-01T14:14:31.179643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256529580101046:12041]
2025-10-01T14:14:31.179652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:31.179668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:31.179670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:31.179678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:31.179680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:31.179684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:31.179687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:31.179728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.179737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.179750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256529580101046:12041]
2025-10-01T14:14:31.179760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:31.179776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:31.179793Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:31.179804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.179812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.179814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:31.179822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.179834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:31.179858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.179967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.179974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.179988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.180047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2276 partition: 0 MaxSeqNo: 45 sessionId: src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0
2025-10-01T14:14:31.180367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a6a63d-86f0123d-9bf1d63c-45cbae64_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:31.182966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0] Write session: try to update token
2025-10-01T14:14:31.182982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:31.196651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2276 sessionId: src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:31.199098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:31.199323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.199347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.199388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:31.199511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:31.203806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:31.203831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:31.203834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:31.203836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:31.203846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256529580101046:12041]
2025-10-01T14:14:31.203851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256529580101046:12041]
2025-10-01T14:14:31.203855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256529580101046:12041]
2025-10-01T14:14:31.203905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:31.203912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.203915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:31.203915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:31.203921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:31.203925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:31.204049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:31.259690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256531957003701:12142]
2025-10-01T14:14:31.259961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2275, pipe: [1:7556256531957003701:12142]
2025-10-01T14:14:31.352781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:31.360472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.360506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.360667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.360719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.360773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.360828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.360882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.360897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.360962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.361015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.361069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.361128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.361169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.361174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.361229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.361275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.361328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.361385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.361428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.361433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.361488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.361539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.361588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.361637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.361675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.361681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.361731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.361780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.361836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.361897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.361936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.361942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.362010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.362072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.362134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.362206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.362258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.362263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.362327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.362410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.362479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.362540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.362586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.362592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.362660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.362719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.362781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.362846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.362893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.362900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.362974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.363035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.363100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.363161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.363210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.363215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.363283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.363342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.363403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.363473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.363522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.363529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.363579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003701:12142], now have 1 active actors on pipe
2025-10-01T14:14:31.363803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256531957003701:12142]
2025-10-01T14:14:31.363809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:31.363835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:31.363837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:31.363856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2276 reason: error at write: Disconnected sessionId: src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0
2025-10-01T14:14:31.364027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2276 sessionId: src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0 is DEAD
2025-10-01T14:14:31.364137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:31.364148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0] Write session will restart in 0.006230s
2025-10-01T14:14:31.364171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0] Write session: Do CDS request
2025-10-01T14:14:31.364177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:31.364438Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:31.371854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.371967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:31.371980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2277
2025-10-01T14:14:31.372079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.372112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:31.372120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:31.372124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:31.372851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2277 sessionId:  describe result for acl check
2025-10-01T14:14:31.372886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:31.372893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:31.372895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:31.372899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256531957003775:7705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:31.373357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256531957003775:7705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:31.373630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:31.375114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:31.375236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256531957003775:7705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:31.375265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:31.375273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:31.375281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:31.375315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:31.375344Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256529580101172:12046]
2025-10-01T14:14:31.375722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:31.375939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:31.375968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:31.376166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:31.376200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.376204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.376206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.376207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.376208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.376209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.376210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.376211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.376212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.376214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.376215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.376216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.376217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.376218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.376222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.376230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.376233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.376237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.376240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.376244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.376252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.376256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.376261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.376263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.376265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.376267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.376269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.376271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.376275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.376283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.376286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.376294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.376296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.376299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.376305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.376308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.376310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.376315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.376318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.376321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.376326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.376329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.376331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.376333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.376336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.376338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.376341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.376344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.376346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.376349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.376351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.376353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.376356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.376358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.376360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.376363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.376382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:31.379428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256531957003775:7705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:31.379441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256531957003775:7705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:31.379443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256531957003775:7705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:31.379468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:31.379625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:31.380228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:31.380243Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:31.380245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:31.380248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:31.380254Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2276 [2:7556256529580101172:12046]
2025-10-01T14:14:31.380265Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:31.380282Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:31.380286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.380289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.380292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.380305Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:31.380311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:31.380319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:31.380359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.380364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.380366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.380369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:31.380370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:31.380418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:31.380423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.380431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.380440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.380452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:31.380468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003816:7705], now have 1 active actors on pipe
2025-10-01T14:14:31.380475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003704:2446], now have 1 active actors on pipe
2025-10-01T14:14:31.380480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256529580101167:12046]
2025-10-01T14:14:31.380481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256529580101167:12046]
2025-10-01T14:14:31.380483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256529580101167:12046]
2025-10-01T14:14:31.380491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:31.380500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:31.380500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:31.380502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:31.380504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:31.380508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:31.380509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:31.380502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2276
2025-10-01T14:14:31.380526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2276
2025-10-01T14:14:31.380533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256529580101167:12046]
2025-10-01T14:14:31.380541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:31.380543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:31.380576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.380584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.380607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:31.380615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.380619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.380620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:31.380626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.380632Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:31.380647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.380752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.380758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.380770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.380823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2277 partition: 0 MaxSeqNo: 45 sessionId: src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0
2025-10-01T14:14:31.381152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ea92502-b47e3ad7-8a6016c7-1363344e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:31.384164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0] Write session: try to update token
2025-10-01T14:14:31.384185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:31.397695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2277 sessionId: src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:31.399963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:31.400681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.400706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.400725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:31.400727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:31.400729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:31.400731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:31.400737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256529580101167:12046]
2025-10-01T14:14:31.400741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256529580101167:12046]
2025-10-01T14:14:31.400744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256529580101167:12046]
2025-10-01T14:14:31.400777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:31.400788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:31.400790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:31.400793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.400793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:31.400795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:31.400907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:31.463970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256531957003824:12142]
2025-10-01T14:14:31.464307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2276, pipe: [1:7556256531957003824:12142]
2025-10-01T14:14:31.555745Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:31.556137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:31.556203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003824:12142], now have 1 active actors on pipe
2025-10-01T14:14:31.556285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:31.556380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256531957003824:12142]
2025-10-01T14:14:31.556411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:31.565784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:31.566479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:31.566494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:31.566516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2277 reason: error at write: Disconnected sessionId: src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0
2025-10-01T14:14:31.566687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2277 sessionId: src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0 is DEAD
2025-10-01T14:14:31.566807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:31.566815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0] Write session will restart in 0.005553s
2025-10-01T14:14:31.566842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0] Write session: Do CDS request
2025-10-01T14:14:31.566848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:31.571183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:31.571384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:31.571393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:31.571405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:31.571455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:31.571499Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256529580101328:12059]
2025-10-01T14:14:31.571915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:31.572235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:31.572290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:31.572548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:31.572601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.572606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.572607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.572608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.572609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.572610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.572611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.572612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.572613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.572613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.572614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.572615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.572616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.572617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.572621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.572627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.572629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.572631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.572633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.572636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.572638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.572640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.572642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.572645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.572647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.572649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.572651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.572653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.572659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.572664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.572668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.572671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.572674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.572677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.572679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.572682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.572685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.572688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.572690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.572693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.572696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.572700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.572702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.572707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.572710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.572713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.572715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.572718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.572721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.572724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.572726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.572729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.572732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.572736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.572740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.572744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.572781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:31.573969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.574010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:31.574025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2278
2025-10-01T14:14:31.574222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.574266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:31.574276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:31.574280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:31.574664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2278 sessionId:  describe result for acl check
2025-10-01T14:14:31.574706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:31.574712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:31.574714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:31.574719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256531957003915:7692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:31.575109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256531957003915:7692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:31.576751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:31.577458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:31.577475Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:31.577478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:31.577481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:31.577488Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2277 [2:7556256529580101328:12059]
2025-10-01T14:14:31.577504Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:31.577521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:31.577528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.577533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.577535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.577553Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:31.577562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:31.577568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:31.577560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256531957003915:7692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:31.577628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.577638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.577639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.577642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:31.577644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:31.577699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:31.577705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.577713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.577719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.577732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:31.577746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003832:2446], now have 1 active actors on pipe
2025-10-01T14:14:31.577755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256529580101322:12059]
2025-10-01T14:14:31.577756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256529580101322:12059]
2025-10-01T14:14:31.577758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256529580101322:12059]
2025-10-01T14:14:31.577767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:31.577777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:31.577780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:31.577783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:31.577784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:31.577786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:31.577788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:31.577803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2277
2025-10-01T14:14:31.577819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256529580101322:12059]
2025-10-01T14:14:31.577826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:31.577835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:31.582754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256531957003915:7692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:31.582770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256531957003915:7692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:31.582773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256531957003915:7692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:31.582781Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:31.583028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003953:7692], now have 1 active actors on pipe
2025-10-01T14:14:31.583043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2277
2025-10-01T14:14:31.583118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.583128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.583161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb44c4b3-d651722-17b8543a-74982443_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:31.583177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.583184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.583190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:31.583204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.583234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:31.583258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.583488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.583505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.583530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.583618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2278 partition: 0 MaxSeqNo: 45 sessionId: src_id|fb44c4b3-d651722-17b8543a-74982443_0
2025-10-01T14:14:31.584004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|859cf68d-75cde4cd-2d1e5fa2-d78e9eb1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fb44c4b3-d651722-17b8543a-74982443_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:31.587497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb44c4b3-d651722-17b8543a-74982443_0] Write session: try to update token
2025-10-01T14:14:31.587519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb44c4b3-d651722-17b8543a-74982443_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:31.588948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:31.588971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:31.588981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256529580101322:12059]
2025-10-01T14:14:31.589029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:31.589031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:31.589205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:31.589362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:31.589516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:31.589656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:31.590045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:31.590100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:31.603812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2278 sessionId: src_id|fb44c4b3-d651722-17b8543a-74982443_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:31.606449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:31.606898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.606922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.608741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:31.608780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:31.608783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:31.608785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:31.608788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:31.608797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256529580101322:12059]
2025-10-01T14:14:31.608804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256529580101322:12059]
2025-10-01T14:14:31.608813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256529580101322:12059]
2025-10-01T14:14:31.608852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:31.608854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:31.608861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.608863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:31.608863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:31.608866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:31.608870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:31.608989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:31.656483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256531957003957:12142]
2025-10-01T14:14:31.656739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2277, pipe: [1:7556256531957003957:12142]
2025-10-01T14:14:31.755060Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:31.762871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.762899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.763069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.763126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.763189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.763250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.763298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.763310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.763369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.763427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.763485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.763546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.763589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.763596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.763666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.763731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.763796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.763861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.763903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.763910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.763976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.764039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.764098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.764160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.764203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.764212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.764322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.764436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.764495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.764555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.764608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.764615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.764678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.764739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.764799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.764859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.764943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.764950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.765018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.765074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.765135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.765200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.765249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.765255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.765336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.765411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.765484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.765555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.765607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.765614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.765685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.765750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.765810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.765870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.765927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.765939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.766004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:31.766064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:31.766127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:31.766189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:31.766235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:31.766241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:31.766310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003957:12142], now have 1 active actors on pipe
2025-10-01T14:14:31.766592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256531957003957:12142]
2025-10-01T14:14:31.766605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:31.766609Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:31.766624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:31.766638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2278 reason: error at write: Disconnected sessionId: src_id|fb44c4b3-d651722-17b8543a-74982443_0
2025-10-01T14:14:31.766858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2278 sessionId: src_id|fb44c4b3-d651722-17b8543a-74982443_0 is DEAD
2025-10-01T14:14:31.766988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb44c4b3-d651722-17b8543a-74982443_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:31.766998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb44c4b3-d651722-17b8543a-74982443_0] Write session will restart in 0.006394s
2025-10-01T14:14:31.767021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb44c4b3-d651722-17b8543a-74982443_0] Write session: Do CDS request
2025-10-01T14:14:31.767027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb44c4b3-d651722-17b8543a-74982443_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:31.767349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:31.774905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb44c4b3-d651722-17b8543a-74982443_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.775574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:31.775592Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2279
2025-10-01T14:14:31.776071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.776116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:31.776127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:31.776131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:31.776550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2279 sessionId:  describe result for acl check
2025-10-01T14:14:31.776602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:31.776604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:31.776606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:31.776611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256531957004032:7679] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:31.777098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256531957004032:7679] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:31.777839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:31.779548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256531957004032:7679] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:31.779862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:31.780081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:31.780097Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:31.780109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:31.780166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:31.780217Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256529580101446:12062]
2025-10-01T14:14:31.780847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:31.781117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:31.781162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:31.781467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:31.781530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.781538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.781539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.781540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.781542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.781543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.781544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.781545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.781546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.781547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.781548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.781550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.781551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.781552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.781556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.781566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.781570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.781573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.781577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.781581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.781585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.781589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.781593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.781597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.781601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.781605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.781608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.781612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.781619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.781626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.781632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.781638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.781644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.781649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.781653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.781664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.781669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.781675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.781679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.781693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.781697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.781707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.781713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.781718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.781722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.781728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.781734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.781740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.781744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.781749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.781753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.781765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.781770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.781779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.781783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.781788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.781832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:31.782048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256531957004032:7679] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:31.782061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256531957004032:7679] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:31.782064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256531957004032:7679] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:31.782072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:31.785585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:31.786157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:31.786169Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:31.786170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:31.786173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:31.786177Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2278 [2:7556256529580101446:12062]
2025-10-01T14:14:31.786188Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:31.786200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:31.786202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.786205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.786206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.786216Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:31.786219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:31.786223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:31.786259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.786265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.786266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.786268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:31.786270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:31.786320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:31.786326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.786332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.786338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.786346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:31.786359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957003959:2446], now have 1 active actors on pipe
2025-10-01T14:14:31.786362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957004074:7679], now have 1 active actors on pipe
2025-10-01T14:14:31.786366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256529580101440:12062]
2025-10-01T14:14:31.786386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256529580101440:12062]
2025-10-01T14:14:31.786388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256529580101440:12062]
2025-10-01T14:14:31.786400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:31.786411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:31.786414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:31.786415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:31.786416Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:31.786424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:31.786425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:31.786446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256529580101440:12062]
2025-10-01T14:14:31.786453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:31.786455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:31.786433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2278
2025-10-01T14:14:31.786472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.786480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.786453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2278
2025-10-01T14:14:31.786517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:31.786526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.786529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.786530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:31.786536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.786542Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:31.786554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.786669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.786676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.786686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.786746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2279 partition: 0 MaxSeqNo: 45 sessionId: src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0
2025-10-01T14:14:31.787062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb44c4b3-d651722-17b8543a-74982443_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:31.789656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0] Write session: try to update token
2025-10-01T14:14:31.789671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:31.805823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2279 sessionId: src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:31.808201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:31.809096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.809127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.809146Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:31.809149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:31.809152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:31.809154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:31.809161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256529580101440:12062]
2025-10-01T14:14:31.809167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256529580101440:12062]
2025-10-01T14:14:31.809171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256529580101440:12062]
2025-10-01T14:14:31.809210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:31.809224Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:31.809227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:31.809229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:31.809236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.809238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:31.809378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:31.866925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256531957004094:12142]
2025-10-01T14:14:31.867216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2278, pipe: [1:7556256531957004094:12142]
2025-10-01T14:14:31.950694Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:31.951010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:31.951067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957004094:12142], now have 1 active actors on pipe
2025-10-01T14:14:31.951108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:31.951237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:31.951296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256531957004094:12142]
2025-10-01T14:14:31.960479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:31.961338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:31.961349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:31.961366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2279 reason: error at write: Disconnected sessionId: src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0
2025-10-01T14:14:31.961474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2279 sessionId: src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0 is DEAD
2025-10-01T14:14:31.961601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:31.961614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0] Write session will restart in 0.007128s
2025-10-01T14:14:31.961651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0] Write session: Do CDS request
2025-10-01T14:14:31.961657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:31.966943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:31.967174Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:31.967184Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:31.967192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:31.967240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:31.967281Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256529580101561:12064]
2025-10-01T14:14:31.967850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:31.968182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:31.968229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:31.968517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:31.968575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.968581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.968582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.968583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.968585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.968586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.968587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.968588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.968590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.968591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.968592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.968593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.968594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.968596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.968600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.968609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.968613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.968617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.968621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.968624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.968628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.968632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.968635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.968639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.968643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.968646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.968650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.968653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.968659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.968667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:31.968673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.968678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:31.968682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.968686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:31.968691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.968695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:31.968700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.968711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:31.968715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.968720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:31.968725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.968729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:31.968733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.968738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:31.968743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.968748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:31.968753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.968758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.968767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.968772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.968782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.968787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.968795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.968799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:31.968807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.968811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:31.968850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:31.969849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.969970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:31.969985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2280
2025-10-01T14:14:31.970095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:31.970124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:31.970134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:31.970141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:31.970491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2280 sessionId:  describe result for acl check
2025-10-01T14:14:31.970521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:31.970522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:31.970524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:31.970529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256531957004182:7652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:31.971004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256531957004182:7652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:31.972614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:31.973245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:31.973267Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:31.973269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:31.973273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:31.973279Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2279 [2:7556256529580101561:12064]
2025-10-01T14:14:31.973293Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:31.973309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:31.973318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.973322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.973323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.973338Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:31.973349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:31.973355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:31.973414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.973423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.973425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.973429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:31.973431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:31.973490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:31.973497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:31.973509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:31.973524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:31.973543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:31.973564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957004099:2446], now have 1 active actors on pipe
2025-10-01T14:14:31.973576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256529580101556:12064]
2025-10-01T14:14:31.973582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256529580101556:12064]
2025-10-01T14:14:31.973585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256529580101556:12064]
2025-10-01T14:14:31.973597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:31.973609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:31.973613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:31.973619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:31.973621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:31.973626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:31.973628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:31.973610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2279
2025-10-01T14:14:31.973611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256531957004182:7652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:31.973657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256529580101556:12064]
2025-10-01T14:14:31.973669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:31.973675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:31.978311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256531957004182:7652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:31.978324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256531957004182:7652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:31.978327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256531957004182:7652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:31.978333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:31.978581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256531957004217:7652], now have 1 active actors on pipe
2025-10-01T14:14:31.978613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2279
2025-10-01T14:14:31.978663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.978674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.978701Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63729ca1-7443c8de-63c64e9a-a94df81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:31.978715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:31.978724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:31.978726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:31.978737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:31.978754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:31.978776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.978899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.978907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.978921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:31.979000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2280 partition: 0 MaxSeqNo: 45 sessionId: src_id|63729ca1-7443c8de-63c64e9a-a94df81_0
2025-10-01T14:14:31.979304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b908f4f6-b6ce2b33-5262edec-2bbabc4e_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|63729ca1-7443c8de-63c64e9a-a94df81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:31.982072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63729ca1-7443c8de-63c64e9a-a94df81_0] Write session: try to update token
2025-10-01T14:14:31.982090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63729ca1-7443c8de-63c64e9a-a94df81_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:31.983938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:31.983959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:31.983969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256529580101556:12064]
2025-10-01T14:14:31.984012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:31.984027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:31.984189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:31.984330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:31.984473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:31.984629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:31.984816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:31.984856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:31.996289Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2280 sessionId: src_id|63729ca1-7443c8de-63c64e9a-a94df81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:31.998884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:31.999475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:31.999500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:31.999536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:31.999652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:32.002303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:32.002329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:32.002332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:32.002334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:32.002346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256529580101556:12064]
2025-10-01T14:14:32.002351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256529580101556:12064]
2025-10-01T14:14:32.002357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256529580101556:12064]
2025-10-01T14:14:32.002415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:32.002417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:32.002424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.002426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:32.002430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:32.002434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:32.002553Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:32.051244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256536251971517:12142]
2025-10-01T14:14:32.051533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2279, pipe: [1:7556256536251971517:12142]
2025-10-01T14:14:32.157322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:32.165271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.165305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.165481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.165544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.165606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.165670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.165716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.165725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.165790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.165848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.165905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.165967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.166011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.166019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.166094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.166155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.166217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.166283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.166328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.166335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.166426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.166488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.166551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.166616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.166663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.166670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.166741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.166803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.166865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.166936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.166983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.166990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.167058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.167124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.167191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.167259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.167302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.167309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.167377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.167438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.167502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.167565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.167608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.167615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.167692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.167763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.167835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.167904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.167956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.167963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.168035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.168098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.168159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.168222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.168266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.168272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.168335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.168399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.168463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.168523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.168587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.168594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.168653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971517:12142], now have 1 active actors on pipe
2025-10-01T14:14:32.168887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:32.168888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:32.168901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:32.168922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2280 reason: error at write: Disconnected sessionId: src_id|63729ca1-7443c8de-63c64e9a-a94df81_0
2025-10-01T14:14:32.168944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256536251971517:12142]
2025-10-01T14:14:32.169123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2280 sessionId: src_id|63729ca1-7443c8de-63c64e9a-a94df81_0 is DEAD
2025-10-01T14:14:32.169231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63729ca1-7443c8de-63c64e9a-a94df81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:32.169241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63729ca1-7443c8de-63c64e9a-a94df81_0] Write session will restart in 0.009522s
2025-10-01T14:14:32.169268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63729ca1-7443c8de-63c64e9a-a94df81_0] Write session: Do CDS request
2025-10-01T14:14:32.169274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63729ca1-7443c8de-63c64e9a-a94df81_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:32.169767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:32.179407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:32.179881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63729ca1-7443c8de-63c64e9a-a94df81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.179930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:32.179946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2281
2025-10-01T14:14:32.180139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.180175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:32.180185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:32.180188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:32.180508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2281 sessionId:  describe result for acl check
2025-10-01T14:14:32.180538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:32.180544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:32.180546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:32.180550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256536251971614:7622] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:32.180989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256536251971614:7622] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:32.181026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:32.181186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:32.181195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:32.181205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:32.181247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:32.181283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256533875068973:12066]
2025-10-01T14:14:32.181813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:32.182012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:32.182049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:32.182312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:32.182359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.182365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.182366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.182391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.182392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.182393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.182394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.182395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.182397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.182398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.182399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.182400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.182401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.182402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.182407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.182416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.182420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.182423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.182427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.182431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.182434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.182438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.182441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.182445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.182448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.182451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.182454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.182457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.182449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256536251971614:7622] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:32.182465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.182472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.182478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.182482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.182491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.182496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.182500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.182505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.182513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.182518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.182522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.182529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.182533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.182542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.182546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.182551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.182559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.182564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.182568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.182577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.182581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.182586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.182589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.182594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.182603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.182608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.182612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.182621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.182658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:32.185828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256536251971614:7622] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:32.185844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256536251971614:7622] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:32.185851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256536251971614:7622] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:32.185861Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:32.186025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:32.186763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:32.186778Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:32.186780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:32.186784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:32.186790Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2280 [2:7556256533875068973:12066]
2025-10-01T14:14:32.186803Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:32.186818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:32.186825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.186829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.186831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.186845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:32.186853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:32.186860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:32.186910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.186917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.186919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.186921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:32.186923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:32.186985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:32.186992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.187002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.187012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.187031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:32.187051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971523:2446], now have 1 active actors on pipe
2025-10-01T14:14:32.187058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971652:7622], now have 1 active actors on pipe
2025-10-01T14:14:32.187065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256533875068967:12066]
2025-10-01T14:14:32.187067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256533875068967:12066]
2025-10-01T14:14:32.187069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256533875068967:12066]
2025-10-01T14:14:32.187082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:32.187097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:32.187100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:32.187104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:32.187106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:32.187113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:32.187116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:32.187105Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2280
2025-10-01T14:14:32.187137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256533875068967:12066]
2025-10-01T14:14:32.187148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:32.187143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2280
2025-10-01T14:14:32.187158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:32.187181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.187189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.187214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cd108c-f2b01758-2baad05c-b2b10796_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:32.187225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.187228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.187235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:32.187243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.187250Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:32.187266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.187403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.187418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.187440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.187537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2281 partition: 0 MaxSeqNo: 45 sessionId: src_id|5cd108c-f2b01758-2baad05c-b2b10796_0
2025-10-01T14:14:32.187876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63729ca1-7443c8de-63c64e9a-a94df81_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5cd108c-f2b01758-2baad05c-b2b10796_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:32.190640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd108c-f2b01758-2baad05c-b2b10796_0] Write session: try to update token
2025-10-01T14:14:32.190657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd108c-f2b01758-2baad05c-b2b10796_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:32.204046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2281 sessionId: src_id|5cd108c-f2b01758-2baad05c-b2b10796_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:32.206266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:32.206565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:32.206582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:32.206584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:32.206585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:32.206591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256533875068967:12066]
2025-10-01T14:14:32.206594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256533875068967:12066]
2025-10-01T14:14:32.206596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256533875068967:12066]
2025-10-01T14:14:32.206630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:32.206640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.206643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:32.206646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:32.206647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.206664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:32.206671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.206673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:32.206788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:32.268824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256536251971669:12142]
2025-10-01T14:14:32.269060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2280, pipe: [1:7556256536251971669:12142]
2025-10-01T14:14:32.341566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:32.341885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971669:12142], now have 1 active actors on pipe
2025-10-01T14:14:32.342100Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:32.342181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256536251971669:12142]
2025-10-01T14:14:32.342190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:32.342216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:32.342305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2281 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5cd108c-f2b01758-2baad05c-b2b10796_0
2025-10-01T14:14:32.342506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2281 sessionId: src_id|5cd108c-f2b01758-2baad05c-b2b10796_0 is DEAD
2025-10-01T14:14:32.342692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd108c-f2b01758-2baad05c-b2b10796_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:32.342707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd108c-f2b01758-2baad05c-b2b10796_0] Write session will restart in 0.008703s
2025-10-01T14:14:32.342740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd108c-f2b01758-2baad05c-b2b10796_0] Write session: Do CDS request
2025-10-01T14:14:32.342748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd108c-f2b01758-2baad05c-b2b10796_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:32.351198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:32.352830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd108c-f2b01758-2baad05c-b2b10796_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.352996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:32.353003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:32.353017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2282
2025-10-01T14:14:32.353146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.353187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:32.353197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:32.353201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:32.353209Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:32.353220Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:32.353230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:32.353273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:32.353312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256533875069098:12071]
2025-10-01T14:14:32.353611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2282 sessionId:  describe result for acl check
2025-10-01T14:14:32.353647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:32.353654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:32.353655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:32.353659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256536251971751:7621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:32.353739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:32.354000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:32.354039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:32.354157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256536251971751:7621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:32.354246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:32.354284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.354289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.354290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.354290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.354291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.354292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.354292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.354293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.354293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.354294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.354295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.354295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.354296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.354297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.354300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.354305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.354308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.354310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.354312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.354315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.354317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.354318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.354321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.354323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.354325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.354327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.354329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.354331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.354336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.354340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.354344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.354355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.354358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.354361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.354363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.354366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.354368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.354393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.354398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.354403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.354407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.354411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.354415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.354418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.354420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.354423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.354425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.354428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.354430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.354433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.354435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.354438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.354440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.354443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.354445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.354448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.354468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:32.356090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256536251971751:7621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:32.357928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:32.358549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:32.358563Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:32.358566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:32.358569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:32.358576Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2281 [2:7556256533875069098:12071]
2025-10-01T14:14:32.358592Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:32.358607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:32.358610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.358614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.358616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.358631Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:32.358611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256536251971751:7621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:32.358641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:32.358622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256536251971751:7621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:32.358651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:32.358624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256536251971751:7621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:32.358630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:32.358697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.358703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.358705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.358710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:32.358713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:32.358772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:32.358778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.358790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.358805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.358824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:32.358843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971789:7621], now have 1 active actors on pipe
2025-10-01T14:14:32.358850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971671:2446], now have 1 active actors on pipe
2025-10-01T14:14:32.358858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256533875069093:12071]
2025-10-01T14:14:32.358863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256533875069093:12071]
2025-10-01T14:14:32.358865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256533875069093:12071]
2025-10-01T14:14:32.358853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2281
2025-10-01T14:14:32.358875Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:32.358856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2281
2025-10-01T14:14:32.358885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:32.358891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:32.358894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:32.358895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:32.358904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:32.358907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:32.358923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.358931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.358967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256533875069093:12071]
2025-10-01T14:14:32.358978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:32.358983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:32.358993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:32.359002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.359010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.359014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:32.359022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.359033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:32.359066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.359163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.359168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.359180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.359237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2282 partition: 0 MaxSeqNo: 45 sessionId: src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0
2025-10-01T14:14:32.359566Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cd108c-f2b01758-2baad05c-b2b10796_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:32.362427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0] Write session: try to update token
2025-10-01T14:14:32.362444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:32.376120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2282 sessionId: src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:32.378518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:32.378904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.378929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.378948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:32.378951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:32.378956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:32.378958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:32.378966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256533875069093:12071]
2025-10-01T14:14:32.378971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256533875069093:12071]
2025-10-01T14:14:32.378974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256533875069093:12071]
2025-10-01T14:14:32.379014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:32.379027Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:32.379029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:32.379030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:32.379036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.379038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:32.379153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:32.442445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256536251971797:12142]
2025-10-01T14:14:32.442669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2281, pipe: [1:7556256536251971797:12142]
2025-10-01T14:14:32.516359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:32.516740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:32.516791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971797:12142], now have 1 active actors on pipe
2025-10-01T14:14:32.516930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256536251971797:12142]
2025-10-01T14:14:32.516953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:32.516964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:32.517025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:32.517037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:32.517103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2282 reason: error at write: Disconnected sessionId: src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0
2025-10-01T14:14:32.517268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2282 sessionId: src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0 is DEAD
2025-10-01T14:14:32.517391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:32.517400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0] Write session will restart in 0.005633s
2025-10-01T14:14:32.517421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0] Write session: Do CDS request
2025-10-01T14:14:32.517428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:32.523869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.523935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:32.523949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2283
2025-10-01T14:14:32.524072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.524104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:32.524119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:32.524122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:32.524477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2283 sessionId:  describe result for acl check
2025-10-01T14:14:32.524502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:32.524507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:32.524508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:32.524512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256536251971863:6996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:32.524892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256536251971863:6996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:32.525976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:32.526317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256536251971863:6996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:32.527504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:32.527703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:32.527714Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:32.527726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:32.527777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:32.527818Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256533875069241:12080]
2025-10-01T14:14:32.528375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:32.528421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256536251971863:6996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:32.528437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256536251971863:6996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:32.528440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256536251971863:6996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:32.528447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:32.528647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:32.528689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:32.528946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:32.528981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.528985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.528986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.528987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.528987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.528988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.528989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.528989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.528990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.528991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.528991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.528992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.528993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.528993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.528997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.529002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.529004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.529006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.529008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.529010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.529012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.529014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.529016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.529018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.529020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.529022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.529024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.529026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.529031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.529036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.529039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.529042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.529044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.529047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.529049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.529052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.529054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.529056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.529059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.529061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.529064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.529067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.529069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.529071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.529074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.529076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.529079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.529081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.529085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.529087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.529090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.529092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.529094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.529097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.529099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.529101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.529130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:32.532612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:32.533212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:32.533227Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:32.533229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:32.533233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:32.533240Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2282 [2:7556256533875069241:12080]
2025-10-01T14:14:32.533253Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:32.533272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:32.533278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.533281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.533284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.533297Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:32.533306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:32.533312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:32.533355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.533360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.533361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.533363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:32.533365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:32.533414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:32.533419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.533428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.533438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.533456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:32.533477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971922:6996], now have 1 active actors on pipe
2025-10-01T14:14:32.533484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971804:2446], now have 1 active actors on pipe
2025-10-01T14:14:32.533491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256533875069236:12080]
2025-10-01T14:14:32.533497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256533875069236:12080]
2025-10-01T14:14:32.533499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256533875069236:12080]
2025-10-01T14:14:32.533511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:32.533518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:32.533523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:32.533527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:32.533528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:32.533537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:32.533539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:32.533539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2282
2025-10-01T14:14:32.533562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256533875069236:12080]
2025-10-01T14:14:32.533569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:32.533540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2282
2025-10-01T14:14:32.533570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:32.533584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.533588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.533630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:32.533640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.533644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.533650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:32.533657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.533668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:32.533687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.533809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.533816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.533827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.533891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2283 partition: 0 MaxSeqNo: 45 sessionId: src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0
2025-10-01T14:14:32.534254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30fc8bee-9b5f5185-e9d1dfd-438267d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:32.537072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0] Write session: try to update token
2025-10-01T14:14:32.537090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:32.549857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2283 sessionId: src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:32.552025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:32.553615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.553643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.553662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:32.553665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:32.553668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:32.553669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:32.553678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256533875069236:12080]
2025-10-01T14:14:32.553682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256533875069236:12080]
2025-10-01T14:14:32.553685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256533875069236:12080]
2025-10-01T14:14:32.553718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:32.553730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:32.553733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:32.553737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:32.553742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.553744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:32.553873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:32.616969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256536251971936:12142]
2025-10-01T14:14:32.617211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2282, pipe: [1:7556256536251971936:12142]
2025-10-01T14:14:32.708737Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:32.709020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:32.709082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971936:12142], now have 1 active actors on pipe
2025-10-01T14:14:32.709159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:32.709269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256536251971936:12142]
2025-10-01T14:14:32.709294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:32.719383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:32.720697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:32.720707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0] Write session will restart in 0.008373s
2025-10-01T14:14:32.720362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:32.720375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:32.720392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2283 reason: error at write: Disconnected sessionId: src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0
2025-10-01T14:14:32.720536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2283 sessionId: src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0 is DEAD
2025-10-01T14:14:32.720725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0] Write session: Do CDS request
2025-10-01T14:14:32.720730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:32.725436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:32.725697Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:32.725709Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:32.725721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:32.725787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:32.725825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256533875069377:12086]
2025-10-01T14:14:32.726467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:32.726845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:32.726889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:32.727159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:32.727203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.727207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.727208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.727209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.727210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.727211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.727212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.727213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.727213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.727214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.727215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.727216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.727217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.727218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.727222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.727227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.727230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.727232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.727234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.727237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.727239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.727241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.727243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.727245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.727247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.727250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.727252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.727254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.727261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.727265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.727270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.727273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.727276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.727279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.727282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.727284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.727287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.727291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.727293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.727296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.727299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.727302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.727305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.727308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.727310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.727313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.727316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.727319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.727321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.727324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.727327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.727330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.727333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.727337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.727339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.727343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.727364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:32.729872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.730431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:32.730452Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2284
2025-10-01T14:14:32.730580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.730616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:32.730625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:32.730628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:32.730969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2284 sessionId:  describe result for acl check
2025-10-01T14:14:32.730994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:32.731000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:32.731001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:32.731004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256536251972025:7586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:32.731056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:32.731399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256536251972025:7586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:32.731972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:32.731986Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:32.731987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:32.731990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:32.731996Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2283 [2:7556256533875069377:12086]
2025-10-01T14:14:32.732006Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:32.732018Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:32.732025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.732030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.732032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.732047Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:32.732058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:32.732071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:32.732116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.732122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.732124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.732126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:32.732128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:32.732175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:32.732180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.732187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.732192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.732204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:32.732225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251971939:2446], now have 1 active actors on pipe
2025-10-01T14:14:32.732238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256533875069371:12086]
2025-10-01T14:14:32.732245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256533875069371:12086]
2025-10-01T14:14:32.732246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256533875069371:12086]
2025-10-01T14:14:32.732265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:32.732280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:32.732283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:32.732286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:32.732289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:32.732296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:32.732276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2283
2025-10-01T14:14:32.732299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:32.732331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256533875069371:12086]
2025-10-01T14:14:32.732341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:32.732347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:32.733935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256536251972025:7586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:32.739905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256536251972025:7586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:32.739924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256536251972025:7586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:32.739936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256536251972025:7586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:32.739945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:32.740199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251972063:7586], now have 1 active actors on pipe
2025-10-01T14:14:32.740249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2283
2025-10-01T14:14:32.740327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.740347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.740380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:32.740396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.740407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.740409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:32.740427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.740449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:32.740474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.740648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.740657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.740671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.740739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2284 partition: 0 MaxSeqNo: 45 sessionId: src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0
2025-10-01T14:14:32.741084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61a56deb-dfee28d-b9d887cb-758ca58d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:32.744190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0] Write session: try to update token
2025-10-01T14:14:32.744207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:32.749424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:32.749449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:32.749460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256533875069371:12086]
2025-10-01T14:14:32.749509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:32.749514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:32.749719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:32.749887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:32.750046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:32.750214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:32.750452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:32.750499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:32.758023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2284 sessionId: src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:32.760724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:32.761347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.761371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.761409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:32.761494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:32.764254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:32.764275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:32.764277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:32.764279Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:32.764288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256533875069371:12086]
2025-10-01T14:14:32.764293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256533875069371:12086]
2025-10-01T14:14:32.764296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256533875069371:12086]
2025-10-01T14:14:32.764346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:32.764351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:32.764358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.764360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:32.764361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:32.764364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:32.764487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:32.811818Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256536251972078:12142]
2025-10-01T14:14:32.813050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2283, pipe: [1:7556256536251972078:12142]
2025-10-01T14:14:32.917457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:32.926771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.926811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.927026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.927114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.927191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.927270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.927703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.927719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.927813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.927888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.927973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.928073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.928133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.928140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.928205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.928265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.928326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.928385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.928429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.928438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.928500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.928795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.928852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.928906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.928944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.928946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.929008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.929075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.929137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.929196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.929328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.929332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.929413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.929486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.929559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.929633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.929678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.929681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.929759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.929820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.929884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.929943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.929984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.929985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.930049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.930119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.930222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.930299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.930341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.930345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.930610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.930696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.930766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.930829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.930873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.930876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.930951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:32.931008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:32.931064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:32.931132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:32.931175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:32.931178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:32.931255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251972078:12142], now have 1 active actors on pipe
2025-10-01T14:14:32.931723Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:32.932316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:32.932328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0] Write session will restart in 0.005844s
2025-10-01T14:14:32.932356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0] Write session: Do CDS request
2025-10-01T14:14:32.932363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:32.931661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:32.931683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:32.931714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2284 reason: error at write: Disconnected sessionId: src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0
2025-10-01T14:14:32.931718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256536251972078:12142]
2025-10-01T14:14:32.931739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:32.931971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2284 sessionId: src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0 is DEAD
2025-10-01T14:14:32.939974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.942824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:32.942842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2285
2025-10-01T14:14:32.943050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:32.943081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:32.943087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:32.943091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:32.943580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2285 sessionId:  describe result for acl check
2025-10-01T14:14:32.943625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:32.943627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:32.943629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:32.943635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256536251972132:7567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:32.944239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256536251972132:7567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:32.946575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256536251972132:7567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:32.949006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:32.951255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:32.951472Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:32.951484Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:32.951498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:32.951570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:32.951616Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256533875069501:12089]
2025-10-01T14:14:32.951682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256536251972132:7567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:32.951701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256536251972132:7567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:32.951705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256536251972132:7567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:32.951713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:32.952223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:32.952456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:32.952494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:32.952753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:32.952797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.952801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.952802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.952803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.952804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.952805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.952805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.952806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.952807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.952808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.952808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.952809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.952810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.952810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.952814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.952820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.952823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.952825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.952827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.952831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.952833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.952836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.952838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.952843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.952847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.952850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.952854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.952857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.952865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.952872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:32.952877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.952880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:32.952886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.952889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:32.952895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.952898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:32.952901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.952905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:32.952907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.952910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:32.952913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.952919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:32.952922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.952925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:32.952927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.952931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:32.952933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.952937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.952940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.952943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.952946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.952949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.952951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.952954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:32.952957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.952960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:32.952982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:32.957050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:32.958023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:32.958042Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:32.958044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:32.958048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:32.958055Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2284 [2:7556256533875069501:12089]
2025-10-01T14:14:32.958071Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:32.958087Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:32.958090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.958094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.958097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.958126Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:32.958138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:32.958149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:32.958210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.958216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.958218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.958221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:32.958224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:32.958285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:32.958291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.958303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:32.958319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:32.958340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:32.958363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251972081:2446], now have 1 active actors on pipe
2025-10-01T14:14:32.958385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256536251972198:7567], now have 1 active actors on pipe
2025-10-01T14:14:32.958393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256533875069495:12089]
2025-10-01T14:14:32.958395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256533875069495:12089]
2025-10-01T14:14:32.958397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256533875069495:12089]
2025-10-01T14:14:32.958413Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:32.958424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:32.958430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:32.958434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:32.958437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:32.958445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:32.958449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:32.958484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256533875069495:12089]
2025-10-01T14:14:32.958472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2284
2025-10-01T14:14:32.958500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:32.958481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2284
2025-10-01T14:14:32.958599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:32.958629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.958644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.958676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:32.958689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:32.958697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:32.958700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:32.958710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:32.958725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:32.958746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.958894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:32.958904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:32.958920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:32.959025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2285 partition: 0 MaxSeqNo: 45 sessionId: src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0
2025-10-01T14:14:32.959422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b13f0c4-31c86812-ed8d1874-61737b1a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:32.962417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0] Write session: try to update token
2025-10-01T14:14:32.962431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:32.975688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2285 sessionId: src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:32.978161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:32.978184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:32.978187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:32.978188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:32.978199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256533875069495:12089]
2025-10-01T14:14:32.978204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256533875069495:12089]
2025-10-01T14:14:32.978207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256533875069495:12089]
2025-10-01T14:14:32.978215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:32.978252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:32.978257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:32.978257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:32.978261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:32.978264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:32.978267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:32.978412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:33.031748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256540546939508:12142]
2025-10-01T14:14:33.032020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2284, pipe: [1:7556256540546939508:12142]
2025-10-01T14:14:33.117510Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:33.117809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.117830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.117875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939508:12142], now have 1 active actors on pipe
2025-10-01T14:14:33.118080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:33.118112Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:33.118120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:33.118121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256540546939508:12142]
2025-10-01T14:14:33.118122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:33.118173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2285 reason: error at write: Disconnected sessionId: src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0
2025-10-01T14:14:33.118331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2285 sessionId: src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0 is DEAD
2025-10-01T14:14:33.118458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:33.118469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0] Write session will restart in 0.007205s
2025-10-01T14:14:33.118495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0] Write session: Do CDS request
2025-10-01T14:14:33.118500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:33.126840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.126930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:33.126945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2286
2025-10-01T14:14:33.127075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.127107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:33.127117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:33.127119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:33.127530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2286 sessionId:  describe result for acl check
2025-10-01T14:14:33.127583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:33.127591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:33.127593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:33.127597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256540546939591:7556] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:33.128091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256540546939591:7556] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:33.129778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256540546939591:7556] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:33.129874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:33.130320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:33.130485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:33.130493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:33.130501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:33.130541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:33.130568Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256538170036918:12091]
2025-10-01T14:14:33.130928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:33.131155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:33.131185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:33.131399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:33.131436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.131440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.131441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.131442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.131442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.131443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.131443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.131444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.131445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.131445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.131446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.131446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.131447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.131448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.131451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.131456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.131458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.131460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.131462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.131465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.131467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.131469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.131471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.131473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.131475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.131477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.131479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.131481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.131487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.131492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.131495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.131498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.131500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.131503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.131505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.131508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.131510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.131513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.131515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.131517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.131520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.131523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.131525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.131528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.131530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.131533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.131536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.131538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.131540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.131543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.131545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.131557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.131560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.131562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.131565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.131568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.131587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:33.132115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256540546939591:7556] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:33.132128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256540546939591:7556] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:33.132131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256540546939591:7556] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:33.132138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:33.134976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:33.135547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:33.135558Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:33.135560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:33.135563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:33.135567Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2285 [2:7556256538170036918:12091]
2025-10-01T14:14:33.135576Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:33.135592Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:33.135597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.135599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.135600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.135612Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:33.135616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:33.135621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:33.135661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.135666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.135667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.135670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:33.135672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:33.135722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:33.135729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.135738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.135748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.135765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:33.135785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939632:7556], now have 1 active actors on pipe
2025-10-01T14:14:33.135791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939510:2446], now have 1 active actors on pipe
2025-10-01T14:14:33.135796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256538170036912:12091]
2025-10-01T14:14:33.135797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256538170036912:12091]
2025-10-01T14:14:33.135798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256538170036912:12091]
2025-10-01T14:14:33.135807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:33.135817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:33.135823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:33.135826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:33.135828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:33.135828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:33.135830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:33.135851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256538170036912:12091]
2025-10-01T14:14:33.135856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:33.135846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2285
2025-10-01T14:14:33.135877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:33.135889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.135850Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2285
2025-10-01T14:14:33.135893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.135921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:33.135931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.135935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.135940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:33.135948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.135959Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:33.135975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.136087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.136094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.136106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.136178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2286 partition: 0 MaxSeqNo: 45 sessionId: src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0
2025-10-01T14:14:33.136495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b65db70c-35141f43-8737fd1b-cd8318f4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:33.139278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0] Write session: try to update token
2025-10-01T14:14:33.139296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:33.146164Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:33.146180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:33.146187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256538170036912:12091]
2025-10-01T14:14:33.146227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:33.146230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:33.146396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:33.146525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:33.146663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:33.146800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:33.146982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:33.147021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:33.153562Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2286 sessionId: src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:33.156364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:33.156571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.156596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.156646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:33.156757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:33.164253Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:33.164271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:33.164274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:33.164276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:33.164286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256538170036912:12091]
2025-10-01T14:14:33.164289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256538170036912:12091]
2025-10-01T14:14:33.164292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256538170036912:12091]
2025-10-01T14:14:33.164331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:33.164332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:33.164336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.164338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:33.164338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:33.164341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:33.164459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:33.218076Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256540546939653:12142]
2025-10-01T14:14:33.218284Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2285, pipe: [1:7556256540546939653:12142]
2025-10-01T14:14:33.309854Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:33.318673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.318706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.318880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.318952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.319015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.319079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.319125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.319137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.319210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.319272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.319335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.319402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.319447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.319455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.319527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.319591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.319661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.319729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.319774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.319786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.319860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.319925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.320010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.320083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.320132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.320139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.320209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.320273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.320338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.320401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.320447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.320454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.320521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.320596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.320662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.320727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.320774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.320783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.320854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.320917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.320984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.321051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.321096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.321104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.321168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.321229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.321289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.321352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.321433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.321439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.321509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.321571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.321654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.321718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.321772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.321779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.321848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.321910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.321971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.322042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.322086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.322093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.322167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939653:12142], now have 1 active actors on pipe
2025-10-01T14:14:33.322415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:33.322425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:33.322429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:33.322470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2286 reason: error at write: Disconnected sessionId: src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0
2025-10-01T14:14:33.322476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256540546939653:12142]
2025-10-01T14:14:33.322745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2286 sessionId: src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0 is DEAD
2025-10-01T14:14:33.322873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:33.322885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0] Write session will restart in 0.007674s
2025-10-01T14:14:33.322909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0] Write session: Do CDS request
2025-10-01T14:14:33.322916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:33.323185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:33.331911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.331971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:33.331987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2287
2025-10-01T14:14:33.332116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.332149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:33.332159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:33.332162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:33.332553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2287 sessionId:  describe result for acl check
2025-10-01T14:14:33.332606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:33.332612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:33.332613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:33.332619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256540546939737:7526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:33.333149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256540546939737:7526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:33.334427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:33.335580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256540546939737:7526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:33.336238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:33.336443Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:33.336451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:33.336462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:33.336525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:33.336560Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256538170037049:12096]
2025-10-01T14:14:33.337120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:33.337395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:33.337435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:33.337718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:33.337767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.337773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.337774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.337775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.337776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.337777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.337778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.337779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.337780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.337781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.337783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.337784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.337785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.337786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.337792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.337802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.337805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.337809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.337812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.337816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.337819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.337822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.337826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.337830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.337833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.337837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.337841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.337844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.337851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.337858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.337865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.337871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.337875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.337880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.337884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.337888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.337893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.337898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.337902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.337907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.337911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.337917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.337926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.337931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.337939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.337944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.337948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.337952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.337963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.337968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.337972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.337977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.337985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.337990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.337994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.337999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.338035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:33.338352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256540546939737:7526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:33.338388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256540546939737:7526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:33.338403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256540546939737:7526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:33.338412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:33.341615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:33.342437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:33.342452Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:33.342454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:33.342458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:33.342465Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2286 [2:7556256538170037049:12096]
2025-10-01T14:14:33.342479Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:33.342496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:33.342500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.342503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.342505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.342524Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:33.342530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:33.342540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:33.342594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.342601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.342603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.342607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:33.342609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:33.342676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:33.342683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.342695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.342711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.342727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:33.342749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939666:2446], now have 1 active actors on pipe
2025-10-01T14:14:33.342756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939787:7526], now have 1 active actors on pipe
2025-10-01T14:14:33.342764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256538170037043:12096]
2025-10-01T14:14:33.342771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256538170037043:12096]
2025-10-01T14:14:33.342773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256538170037043:12096]
2025-10-01T14:14:33.342773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2286
2025-10-01T14:14:33.342784Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:33.342779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2286
2025-10-01T14:14:33.342803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:33.342796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:33.342809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:33.342811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:33.342817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:33.342820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:33.342867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.342876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.342890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256538170037043:12096]
2025-10-01T14:14:33.342900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:33.342911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:33.342934Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28528408-b1ae2224-188c487c-ff0c35a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:33.342944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.342949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.342956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:33.342965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.342977Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:33.343004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.343147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.343155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.343169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.343251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2287 partition: 0 MaxSeqNo: 45 sessionId: src_id|28528408-b1ae2224-188c487c-ff0c35a1_0
2025-10-01T14:14:33.343628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5eaab7d-59a780f5-3749996a-e0bc87a8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|28528408-b1ae2224-188c487c-ff0c35a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:33.346671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28528408-b1ae2224-188c487c-ff0c35a1_0] Write session: try to update token
2025-10-01T14:14:33.346690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28528408-b1ae2224-188c487c-ff0c35a1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:33.363517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:33.363543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:33.363545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:33.363547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:33.363561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256538170037043:12096]
2025-10-01T14:14:33.363565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256538170037043:12096]
2025-10-01T14:14:33.363570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256538170037043:12096]
2025-10-01T14:14:33.363610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:33.363617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:33.363623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.363624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:33.363626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:33.363627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:33.363777Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:33.364033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2287 sessionId: src_id|28528408-b1ae2224-188c487c-ff0c35a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:33.366754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:33.422889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256540546939795:12142]
2025-10-01T14:14:33.423124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2286, pipe: [1:7556256540546939795:12142]
2025-10-01T14:14:33.510410Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:33.510690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.510705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.510746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939795:12142], now have 1 active actors on pipe
2025-10-01T14:14:33.510939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:33.510956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:33.510963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256540546939795:12142]
2025-10-01T14:14:33.510982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:33.511014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2287 reason: error at write: Disconnected sessionId: src_id|28528408-b1ae2224-188c487c-ff0c35a1_0
2025-10-01T14:14:33.511210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2287 sessionId: src_id|28528408-b1ae2224-188c487c-ff0c35a1_0 is DEAD
2025-10-01T14:14:33.511361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28528408-b1ae2224-188c487c-ff0c35a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:33.511371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28528408-b1ae2224-188c487c-ff0c35a1_0] Write session will restart in 0.009936s
2025-10-01T14:14:33.511396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28528408-b1ae2224-188c487c-ff0c35a1_0] Write session: Do CDS request
2025-10-01T14:14:33.511406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28528408-b1ae2224-188c487c-ff0c35a1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:33.511720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:33.521291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:33.522890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28528408-b1ae2224-188c487c-ff0c35a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.522961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:33.522979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2288
2025-10-01T14:14:33.523120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.523152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:33.523173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:33.523181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:33.523298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:33.523516Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:33.523528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:33.523541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:33.523564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2288 sessionId:  describe result for acl check
2025-10-01T14:14:33.523603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:33.523602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:33.523608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:33.523610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:33.523615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256540546939886:7520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:33.523645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256538170037184:12099]
2025-10-01T14:14:33.524129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256540546939886:7520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:33.524221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:33.524524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:33.524594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:33.524912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:33.524981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.524986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.524988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.524989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.524990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.524991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.524993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.524994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.524995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.524996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.524997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.524998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.524999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.525000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.525006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.525014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.525017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.525020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.525024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.525027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.525029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.525033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.525035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.525039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.525042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.525045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.525048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.525051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.525057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.525064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.525069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.525073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.525077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.525081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.525085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.525090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.525094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.525098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.525103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.525107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.525112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.525117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.525123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.525127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.525131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.525135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.525139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.525143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.525147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.525151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.525154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.525158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.525167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.525171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.525175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.525184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.525216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:33.527002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256540546939886:7520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:33.528869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:33.529621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256540546939886:7520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:33.529638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256540546939886:7520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:33.529642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256540546939886:7520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:33.529650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:33.529743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:33.529760Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:33.529763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:33.529766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:33.529773Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2287 [2:7556256538170037184:12099]
2025-10-01T14:14:33.529788Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:33.529804Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:33.529813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.529816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.529820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.529837Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:33.529847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:33.529854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:33.529919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.529927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.529929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.529932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:33.529935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:33.530005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:33.530013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.530025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.530041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.530062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:33.530086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939797:2446], now have 1 active actors on pipe
2025-10-01T14:14:33.530093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256538170037178:12099]
2025-10-01T14:14:33.530100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256538170037178:12099]
2025-10-01T14:14:33.530103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256538170037178:12099]
2025-10-01T14:14:33.530116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:33.530127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:33.530134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:33.530139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:33.530141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:33.530150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:33.530158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:33.530164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939923:7520], now have 1 active actors on pipe
2025-10-01T14:14:33.530199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256538170037178:12099]
2025-10-01T14:14:33.530211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:33.530216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:33.530349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2287
2025-10-01T14:14:33.530401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2287
2025-10-01T14:14:33.530466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.530481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.530508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:33.530521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.530529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.530531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:33.530541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.530558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:33.530584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.530753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.530765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.530783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.530873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2288 partition: 0 MaxSeqNo: 45 sessionId: src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0
2025-10-01T14:14:33.531206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28528408-b1ae2224-188c487c-ff0c35a1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:33.534064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0] Write session: try to update token
2025-10-01T14:14:33.534081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:33.541085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:33.541106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:33.541116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256538170037178:12099]
2025-10-01T14:14:33.541164Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:33.541166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:33.541341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:33.541488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:33.541704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:33.541855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:33.542050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:33.542100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:33.548330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2288 sessionId: src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:33.551132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:33.551309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.551332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.551367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:33.551441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:33.559336Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:33.559358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:33.559362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:33.559364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:33.559373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256538170037178:12099]
2025-10-01T14:14:33.559377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256538170037178:12099]
2025-10-01T14:14:33.559380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256538170037178:12099]
2025-10-01T14:14:33.559426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:33.559426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:33.559431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:33.559435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:33.559437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.559439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:33.559577Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:33.610794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256540546939936:12142]
2025-10-01T14:14:33.611027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2287, pipe: [1:7556256540546939936:12142]
2025-10-01T14:14:33.703645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:33.712312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.712347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.712515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.712590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.712660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.712723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.712956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.712968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.713031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.713094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.713155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.713214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.713260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.713268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.713340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.713398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.713456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.713520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.713565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.713571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.713638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.713699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.713761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.713824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.713868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.713877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.713946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.714009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.714078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.714137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.714181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.714188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.714256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.714322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.714405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.714467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.714507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.714514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.714580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.714638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.714704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.714768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.714815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.714822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.714898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.714962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.715037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.715111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.715155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.715162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.715232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.715295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.715367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.715439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.715488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.715495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.715562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.715631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.715696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.715760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.715805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.715814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.715883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939936:12142], now have 1 active actors on pipe
2025-10-01T14:14:33.716140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:33.716151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256540546939936:12142]
2025-10-01T14:14:33.716157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:33.716175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:33.716200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2288 reason: error at write: Disconnected sessionId: src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0
2025-10-01T14:14:33.716384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2288 sessionId: src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0 is DEAD
2025-10-01T14:14:33.716518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:33.716529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0] Write session will restart in 0.009466s
2025-10-01T14:14:33.716560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0] Write session: Do CDS request
2025-10-01T14:14:33.716576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:33.716975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:33.726113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:33.726840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.726956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:33.726970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2289
2025-10-01T14:14:33.727055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.727096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:33.727107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:33.727114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:33.727493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2289 sessionId:  describe result for acl check
2025-10-01T14:14:33.727529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:33.727534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:33.727535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:33.727541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256540546940025:7494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:33.728023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256540546940025:7494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:33.728049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:33.728243Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:33.728254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:33.728265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:33.728309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:33.728360Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256538170037337:12111]
2025-10-01T14:14:33.728944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:33.729223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:33.729264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:33.729582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:33.729639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.729645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.729646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.729648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.729649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.729650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.729651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.729652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.729653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.729655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.729656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.729657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.729658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.729659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.729664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.729674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.729682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.729686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.729690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.729698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.729701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.729705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.729709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.729717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.729720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.729728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.729731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.729738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.729744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.729755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.729765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.729774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.729782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.729791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.729795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.729806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.729811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.729815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.729819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.729824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.729828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.729833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.729836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.729841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.729845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.729849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.729854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.729859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.730248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256540546940025:7494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:33.730291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.730306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.730311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.730315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.730321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.730325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.730330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.730335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.730394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:33.733937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256540546940025:7494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:33.733959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256540546940025:7494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:33.733963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256540546940025:7494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:33.733971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:33.734081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:33.734726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:33.734740Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:33.734743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:33.734745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:33.734750Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2288 [2:7556256538170037337:12111]
2025-10-01T14:14:33.734762Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:33.734775Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:33.734777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.734779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.734780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.734793Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:33.734801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:33.734805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:33.734845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.734851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.734852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.734854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:33.734856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:33.735005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2288
2025-10-01T14:14:33.735006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2288
2025-10-01T14:14:33.735050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:33.735060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.735073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.735091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.735116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:33.735133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546940063:7494], now have 1 active actors on pipe
2025-10-01T14:14:33.735140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546939939:2446], now have 1 active actors on pipe
2025-10-01T14:14:33.735155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.735161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.735175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256538170037331:12111]
2025-10-01T14:14:33.735180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256538170037331:12111]
2025-10-01T14:14:33.735181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256538170037331:12111]
2025-10-01T14:14:33.735191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:33.735203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:33.735205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:33.735214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:33.735215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:33.735216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:33.735217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:33.735230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|234243e-9e4eedce-79b977fc-dd7949e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:33.735241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.735249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.735252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:33.735260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.735275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:33.735306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256538170037331:12111]
2025-10-01T14:14:33.735314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:33.735320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:33.735324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.735446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.735452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.735462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.735526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2289 partition: 0 MaxSeqNo: 45 sessionId: src_id|234243e-9e4eedce-79b977fc-dd7949e1_0
2025-10-01T14:14:33.735897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aea1fd84-257bd32a-489a0fbd-a0ed3727_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|234243e-9e4eedce-79b977fc-dd7949e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:33.738864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|234243e-9e4eedce-79b977fc-dd7949e1_0] Write session: try to update token
2025-10-01T14:14:33.738881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|234243e-9e4eedce-79b977fc-dd7949e1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:33.746751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:33.746773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:33.746783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256538170037331:12111]
2025-10-01T14:14:33.746826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:33.746828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:33.746998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:33.747144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:33.747280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:33.747416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:33.747594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:33.747630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:33.754641Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2289 sessionId: src_id|234243e-9e4eedce-79b977fc-dd7949e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:33.757453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:33.757671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.757697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.757734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:33.757807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:33.766387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:33.766407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:33.766410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:33.766411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:33.766427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256538170037331:12111]
2025-10-01T14:14:33.766431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256538170037331:12111]
2025-10-01T14:14:33.766435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256538170037331:12111]
2025-10-01T14:14:33.766486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:33.766488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:33.766495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:33.766498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.766500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:33.766500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:33.766622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:33.816111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256540546940083:12142]
2025-10-01T14:14:33.816343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2288, pipe: [1:7556256540546940083:12142]
2025-10-01T14:14:33.909911Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:33.918004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.918042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.918225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.918289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.918358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.918436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.918486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.918495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.918567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.918625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.918691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.918762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.918806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.918813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.918879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.918935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.918997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.919058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.919099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.919106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.919167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.919232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.919294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.919352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.919397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.919404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.919470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.919536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.919602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.919667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.919712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.919719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.919789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.919850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.919911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.919976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.920026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.920033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.920095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.920153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.920216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.920287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.920331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.920338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.920400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.920460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.920523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.920592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.920635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.920641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.920707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.920762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.920823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.920880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.920918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.920925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.920988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:33.921044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:33.921113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:33.921167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:33.921207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:33.921212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:33.921269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546940083:12142], now have 1 active actors on pipe
2025-10-01T14:14:33.921561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:33.921565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:33.921574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:33.921603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2289 reason: error at write: Disconnected sessionId: src_id|234243e-9e4eedce-79b977fc-dd7949e1_0
2025-10-01T14:14:33.921608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256540546940083:12142]
2025-10-01T14:14:33.921802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2289 sessionId: src_id|234243e-9e4eedce-79b977fc-dd7949e1_0 is DEAD
2025-10-01T14:14:33.921930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234243e-9e4eedce-79b977fc-dd7949e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:33.921941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234243e-9e4eedce-79b977fc-dd7949e1_0] Write session will restart in 0.007770s
2025-10-01T14:14:33.921967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234243e-9e4eedce-79b977fc-dd7949e1_0] Write session: Do CDS request
2025-10-01T14:14:33.921972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234243e-9e4eedce-79b977fc-dd7949e1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:33.922270Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:33.930828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|234243e-9e4eedce-79b977fc-dd7949e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.930934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:33.930955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2290
2025-10-01T14:14:33.931088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:33.931123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:33.931133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:33.931141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:33.931550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2290 sessionId:  describe result for acl check
2025-10-01T14:14:33.931587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:33.931597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:33.931599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:33.931604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256540546940149:7483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:33.932184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256540546940149:7483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:33.933346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:33.934230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256540546940149:7483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:33.935222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:33.935430Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:33.935439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:33.935460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:33.935507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:33.935542Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256538170037464:12114]
2025-10-01T14:14:33.936098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:33.936420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:33.936462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:33.936560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256540546940149:7483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:33.936583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256540546940149:7483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:33.936586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256540546940149:7483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:33.936594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:33.936769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:33.936832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.936841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.936842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.936843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.936844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.936845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.936846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.936847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.936848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.936849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.936850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.936851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.936852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.936853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.936859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.936867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.936871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.936875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.936878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.936881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.936885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.936888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.936891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.936895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.936899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.936902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.936905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.936908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.936917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.936924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:33.936930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.936935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:33.936939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.936944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:33.936948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.936953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:33.936958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.936962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:33.936966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.936970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:33.936974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.936980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:33.936984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.936988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:33.936992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.936998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:33.937001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.937005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.937009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.937014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.937017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.937024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.937028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.937032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:33.937035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.937039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:33.937074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:33.940922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:33.941609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:33.941628Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:33.941631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:33.941635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:33.941642Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2289 [2:7556256538170037464:12114]
2025-10-01T14:14:33.941661Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:33.941679Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:33.941682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.941687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.941689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.941706Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:33.941712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:33.941719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:33.941782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.941791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.941794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.941797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:33.941800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:33.941869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:33.941877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.941891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:33.941909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:33.941933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:33.941958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546940086:2446], now have 1 active actors on pipe
2025-10-01T14:14:33.941966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256540546940210:7483], now have 1 active actors on pipe
2025-10-01T14:14:33.941975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256538170037458:12114]
2025-10-01T14:14:33.941977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256538170037458:12114]
2025-10-01T14:14:33.941980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256538170037458:12114]
2025-10-01T14:14:33.941985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2289
2025-10-01T14:14:33.941995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:33.942009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2289
2025-10-01T14:14:33.942016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:33.942028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:33.942030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:33.942032Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:33.942033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:33.942034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:33.942063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256538170037458:12114]
2025-10-01T14:14:33.942066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:33.942068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:33.942089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.942100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.942148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:33.942161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:33.942165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:33.942168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:33.942177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:33.942187Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:33.942211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.942355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.942363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.942396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:33.942469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2290 partition: 0 MaxSeqNo: 45 sessionId: src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0
2025-10-01T14:14:33.942862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|234243e-9e4eedce-79b977fc-dd7949e1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:33.945572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0] Write session: try to update token
2025-10-01T14:14:33.945588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:33.958842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2290 sessionId: src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:33.961263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:33.961415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:33.961440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:33.963603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:33.963625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:33.963627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:33.963629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:33.963642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256538170037458:12114]
2025-10-01T14:14:33.963647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256538170037458:12114]
2025-10-01T14:14:33.963651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256538170037458:12114]
2025-10-01T14:14:33.963699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:33.963708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:33.963714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:33.963718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:33.963724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:33.963731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:33.963738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:33.963798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:33.963865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:34.021926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256544841907518:12142]
2025-10-01T14:14:34.022216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2289, pipe: [1:7556256544841907518:12142]
2025-10-01T14:14:34.121691Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:34.130482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.130511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.130679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.130742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.130808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.130873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.130919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.130929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.131002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.131069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.131131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.131206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.131258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.131266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.131328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.131383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.131444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.131504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.131546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.131553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.131611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.131672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.131727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.131790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.131830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.131838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.131894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.131948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.132007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.132063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.132104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.132111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.132188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.132257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.132323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.132394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.132446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.132452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.132528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.132609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.132678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.132747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.132801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.132808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.132887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.132953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.133020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.133090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.133139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.133148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.133227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.133292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.133364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.133433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.133483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.133490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.133569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.133637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.133706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.133779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.133828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.133835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.133895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907518:12142], now have 1 active actors on pipe
2025-10-01T14:14:34.134089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:34.134096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:34.134104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:34.134136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2290 reason: error at write: Disconnected sessionId: src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0
2025-10-01T14:14:34.134138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256544841907518:12142]
2025-10-01T14:14:34.134361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2290 sessionId: src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0 is DEAD
2025-10-01T14:14:34.134476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:34.134488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0] Write session will restart in 0.007454s
2025-10-01T14:14:34.134514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0] Write session: Do CDS request
2025-10-01T14:14:34.134521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:34.135015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:34.143006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.144109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:34.144128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2291
2025-10-01T14:14:34.144361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.144409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:34.144422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:34.144429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:34.144816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2291 sessionId:  describe result for acl check
2025-10-01T14:14:34.144898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:34.144904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:34.144906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:34.144912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256544841907592:7469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:34.145478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256544841907592:7469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:34.146738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:34.148606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256544841907592:7469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:34.149001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:34.149216Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:34.149228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:34.149240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:34.149291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:34.149376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256542465004888:12116]
2025-10-01T14:14:34.150027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:34.150538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:34.150612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:34.150957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:34.151034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.151042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.151043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.151044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.151046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.151047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.151049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.151050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.151051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.151052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.151054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.151055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.151057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.151058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.151064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.151074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.151078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.151087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.151096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.151100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.151110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.151118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.151127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.151136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.151144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.151149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.151153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.151157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.151171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.151184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.151195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.151206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.151217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.151227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.151237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.151246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.151255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.151264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.151269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.151279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.151285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.151292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.151297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.151302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.151307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.151313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.151318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.151324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.151332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.151338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.151342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.151348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.151352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.151357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.151362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.151367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.151411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:34.151717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256544841907592:7469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:34.151732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256544841907592:7469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:34.151735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256544841907592:7469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:34.151743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:34.155267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:34.155959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:34.155983Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:34.155986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:34.155990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:34.155996Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2290 [2:7556256542465004888:12116]
2025-10-01T14:14:34.156014Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:34.156033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:34.156036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.156039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.156042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.156060Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:34.156072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:34.156078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:34.156135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.156143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.156146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.156152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:34.156156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:34.156226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:34.156234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.156245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.156260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.156281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:34.156304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907520:2446], now have 1 active actors on pipe
2025-10-01T14:14:34.156312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907647:7469], now have 1 active actors on pipe
2025-10-01T14:14:34.156320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256542465004883:12116]
2025-10-01T14:14:34.156322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256542465004883:12116]
2025-10-01T14:14:34.156324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256542465004883:12116]
2025-10-01T14:14:34.156334Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:34.156318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2290
2025-10-01T14:14:34.156355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2290
2025-10-01T14:14:34.156350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:34.156352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:34.156361Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:34.156363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:34.156367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:34.156370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:34.156419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.156429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.156442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256542465004883:12116]
2025-10-01T14:14:34.156453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:34.156463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:34.156485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:34.156497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.156507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.156509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:34.156519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.156528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:34.156560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.156811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.156823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.156839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.156943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2291 partition: 0 MaxSeqNo: 45 sessionId: src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0
2025-10-01T14:14:34.157325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d840bc8-156cce79-3bdcb301-da9f15ce_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:34.160340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0] Write session: try to update token
2025-10-01T14:14:34.160356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:34.175659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2291 sessionId: src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:34.178061Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:34.178086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:34.178090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:34.178092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:34.178101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256542465004883:12116]
2025-10-01T14:14:34.178106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256542465004883:12116]
2025-10-01T14:14:34.178110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256542465004883:12116]
2025-10-01T14:14:34.178165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:34.178165Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:34.178171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:34.178174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:34.178177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.178179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:34.178300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:34.178312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:34.233897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256544841907655:12142]
2025-10-01T14:14:34.234204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2290, pipe: [1:7556256544841907655:12142]
2025-10-01T14:14:34.333905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:34.334312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.334327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.334390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907655:12142], now have 1 active actors on pipe
2025-10-01T14:14:34.334601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:34.334602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:34.334607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:34.334615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:34.334661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256544841907655:12142]
2025-10-01T14:14:34.334687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2291 reason: error at write: Disconnected sessionId: src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0
2025-10-01T14:14:34.334891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2291 sessionId: src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0 is DEAD
2025-10-01T14:14:34.335016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:34.335025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0] Write session will restart in 0.007716s
2025-10-01T14:14:34.335047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0] Write session: Do CDS request
2025-10-01T14:14:34.335052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:34.343927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.344042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:34.344060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2292
2025-10-01T14:14:34.344185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.344219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:34.344229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:34.344232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:34.344637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2292 sessionId:  describe result for acl check
2025-10-01T14:14:34.344672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:34.344678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:34.344679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:34.344683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256544841907768:7425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:34.345155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256544841907768:7425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:34.345865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:34.347425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256544841907768:7425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:34.348131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:34.348339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:34.348348Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:34.348359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:34.348408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:34.348446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256542465005024:12121]
2025-10-01T14:14:34.349046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:34.349313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:34.349354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:34.349667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:34.349719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.349725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.349726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.349727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.349728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.349729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.349731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.349732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.349734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.349735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.349736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.349737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.349738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.349739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.349745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.349757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.349761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.349765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.349769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.349773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.349776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.349780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.349783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.349787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.349791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.349796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.349800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.349804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.349810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.349822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.349832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.349841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.349849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.349855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.349862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.349868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.349877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.349886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.349890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.349899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.349904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.349913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.349917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.349922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.349926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.349933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.349937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.349943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.349947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.349952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.349956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.349966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.349971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.349979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.349986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.349991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.350035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:34.350195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256544841907768:7425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:34.350208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256544841907768:7425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:34.350210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256544841907768:7425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:34.350217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:34.353591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:34.354198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:34.354215Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:34.354217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:34.354219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:34.354225Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2291 [2:7556256542465005024:12121]
2025-10-01T14:14:34.354252Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:34.354270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:34.354275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.354278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.354279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.354292Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:34.354298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:34.354303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:34.354346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.354351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.354353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.354355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:34.354357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:34.354426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:34.354432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.354440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.354446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.354455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:34.354468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256542465005018:12121]
2025-10-01T14:14:34.354469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256542465005018:12121]
2025-10-01T14:14:34.354471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256542465005018:12121]
2025-10-01T14:14:34.354477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:34.354487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:34.354488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:34.354497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:34.354498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:34.354499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:34.354501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:34.354506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907682:2446], now have 1 active actors on pipe
2025-10-01T14:14:34.354509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907806:7425], now have 1 active actors on pipe
2025-10-01T14:14:34.354534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256542465005018:12121]
2025-10-01T14:14:34.354543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:34.354549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:34.354571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2291
2025-10-01T14:14:34.354585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2291
2025-10-01T14:14:34.354621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.354628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.354647Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb2e0317-9b970609-9e1363-1002b222_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:34.354654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.354657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.354659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:34.354665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.354672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:34.354687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.354821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.354827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.354837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.354935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2292 partition: 0 MaxSeqNo: 45 sessionId: src_id|bb2e0317-9b970609-9e1363-1002b222_0
2025-10-01T14:14:34.355335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acb3f5b1-b54f0066-f12966d2-f7bd58f3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bb2e0317-9b970609-9e1363-1002b222_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:34.358317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2e0317-9b970609-9e1363-1002b222_0] Write session: try to update token
2025-10-01T14:14:34.358336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2e0317-9b970609-9e1363-1002b222_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:34.365219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:34.365241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:34.365253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256542465005018:12121]
2025-10-01T14:14:34.365295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:34.365308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:34.365454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:34.365596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:34.365745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:34.365994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:34.366192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:34.366227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:34.373875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2292 sessionId: src_id|bb2e0317-9b970609-9e1363-1002b222_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:34.376872Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:34.377070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.377091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.377125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:34.377210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:34.384828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:34.384851Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:34.384854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:34.384855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:34.384867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256542465005018:12121]
2025-10-01T14:14:34.384871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256542465005018:12121]
2025-10-01T14:14:34.384873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256542465005018:12121]
2025-10-01T14:14:34.384916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:34.384919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:34.384926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.384927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:34.384929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:34.384933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:34.385057Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:34.434614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256544841907814:12142]
2025-10-01T14:14:34.434862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2291, pipe: [1:7556256544841907814:12142]
2025-10-01T14:14:34.530032Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:34.537488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.537515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.537658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.537716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.537773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.537839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.537887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.537896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.537956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.538011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.538071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.538136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.538184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.538190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.538259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.538323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.538403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.538471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.538517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.538525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.538596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.538656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.538717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.538786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.538832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.538839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.538912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.538973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.539032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.539092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.539144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.539152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.539214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.539283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.539348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.539424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.539474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.539480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.539559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.539627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.539696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.539767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.539811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.539816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.539885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.539946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.540013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.540076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.540121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.540129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.540193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.540248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.540313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.540378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.540421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.540428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.540488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:34.540556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:34.540625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:34.540685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:34.540735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:34.540741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:34.540809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907814:12142], now have 1 active actors on pipe
2025-10-01T14:14:34.541062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256544841907814:12142]
2025-10-01T14:14:34.541073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:34.541105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:34.541108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:34.541135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2292 reason: error at write: Disconnected sessionId: src_id|bb2e0317-9b970609-9e1363-1002b222_0
2025-10-01T14:14:34.541329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2292 sessionId: src_id|bb2e0317-9b970609-9e1363-1002b222_0 is DEAD
2025-10-01T14:14:34.541474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2e0317-9b970609-9e1363-1002b222_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:34.541486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2e0317-9b970609-9e1363-1002b222_0] Write session will restart in 0.007775s
2025-10-01T14:14:34.541513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2e0317-9b970609-9e1363-1002b222_0] Write session: Do CDS request
2025-10-01T14:14:34.541519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2e0317-9b970609-9e1363-1002b222_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:34.541961Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:34.550846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2e0317-9b970609-9e1363-1002b222_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.550963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:34.550985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2293
2025-10-01T14:14:34.551208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.551256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:34.551269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:34.551277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:34.551719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2293 sessionId:  describe result for acl check
2025-10-01T14:14:34.551766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:34.551774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:34.551777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:34.551784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256544841907918:7420] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:34.552295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256544841907918:7420] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:34.552913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:34.554964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256544841907918:7420] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:34.555152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:34.555445Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:34.555464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:34.555480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:34.555549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:34.555596Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256542465005164:12124]
2025-10-01T14:14:34.556204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:34.556596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:34.556668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:34.557002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:34.557059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.557064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.557065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.557066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.557067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.557067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.557068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.557069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.557070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.557071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.557071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.557072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.557073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.557074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.557078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.557085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.557087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.557090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.557092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.557095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.557097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.557099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.557101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.557103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.557112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.557115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.557117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.557119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.557125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.557129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.557134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.557138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.557143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.557146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.557148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.557152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.557154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.557161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.557164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.557167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.557170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.557173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.557175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.557178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.557181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.557184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.557186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.557189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.557192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.557195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.557201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.557204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.557207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.557210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.557212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.557215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.557268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:34.557747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256544841907918:7420] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:34.557762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256544841907918:7420] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:34.557766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256544841907918:7420] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:34.557774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:34.561080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:34.561758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:34.561776Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:34.561779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:34.561782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:34.561789Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2292 [2:7556256542465005164:12124]
2025-10-01T14:14:34.561807Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:34.561826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:34.561828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.561832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.561834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.561850Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:34.561861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:34.561871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:34.561934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.561942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.561944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.561950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:34.561957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:34.562030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:34.562038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.562051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.562066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.562088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:34.562112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907822:2446], now have 1 active actors on pipe
2025-10-01T14:14:34.562124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907960:7420], now have 1 active actors on pipe
2025-10-01T14:14:34.562131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256542465005158:12124]
2025-10-01T14:14:34.562129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2292
2025-10-01T14:14:34.562134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256542465005158:12124]
2025-10-01T14:14:34.562136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256542465005158:12124]
2025-10-01T14:14:34.562151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:34.562157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:34.562161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:34.562163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:34.562166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:34.562180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:34.562183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:34.562175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2292
2025-10-01T14:14:34.562236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.562245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.562258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256542465005158:12124]
2025-10-01T14:14:34.562269Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:34.562280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:34.562301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:34.562310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.562313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.562317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:34.562325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.562336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:34.562385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.562536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.562545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.562562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.562669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2293 partition: 0 MaxSeqNo: 45 sessionId: src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0
2025-10-01T14:14:34.563014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb2e0317-9b970609-9e1363-1002b222_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:34.565857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0] Write session: try to update token
2025-10-01T14:14:34.565875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:34.580955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2293 sessionId: src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:34.583302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:34.583321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:34.583323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:34.583325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:34.583333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256542465005158:12124]
2025-10-01T14:14:34.583339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256542465005158:12124]
2025-10-01T14:14:34.583342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256542465005158:12124]
2025-10-01T14:14:34.583385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:34.583390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.583393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:34.583398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:34.583404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:34.583408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:34.583566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:34.583649Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:34.641431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256544841907972:12142]
2025-10-01T14:14:34.641647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2292, pipe: [1:7556256544841907972:12142]
2025-10-01T14:14:34.726461Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:34.726855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.726869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.726910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907972:12142], now have 1 active actors on pipe
2025-10-01T14:14:34.727126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:34.727118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:34.727138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256544841907972:12142]
2025-10-01T14:14:34.727159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:34.727161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:34.727218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2293 reason: error at write: Disconnected sessionId: src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0
2025-10-01T14:14:34.727419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2293 sessionId: src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0 is DEAD
2025-10-01T14:14:34.727553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:34.727564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0] Write session will restart in 0.009354s
2025-10-01T14:14:34.727592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0] Write session: Do CDS request
2025-10-01T14:14:34.727598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:34.737582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:34.737895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.737991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:34.738005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2294
2025-10-01T14:14:34.738096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.738120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:34.738127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:34.738130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:34.738508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2294 sessionId:  describe result for acl check
2025-10-01T14:14:34.738544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:34.738546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:34.738547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:34.738553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256544841908066:7408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:34.739072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256544841908066:7408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:34.739587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:34.739739Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:34.739746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:34.739754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:34.739794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:34.739821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256542465005322:12136]
2025-10-01T14:14:34.740219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:34.740430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:34.740464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:34.740717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:34.740767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.740772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.740773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.740774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.740776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.740753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256544841908066:7408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:34.740777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.740778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.740779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.740781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.740782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.740783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.740784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.740786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.740787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.740791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.740800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.740804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.740808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.740812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.740816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.740819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.740823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.740827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.740830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.740833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.740837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.740840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.740844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.740852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.740860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.740866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.740871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.740876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.740881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.740885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.740891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.740896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.740904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.740909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.740917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.740922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.740930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.740934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.740941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.740948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.740954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.740962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.740967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.740974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.740980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.740987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.740992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.740996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.741004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.741009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.741018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.741058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:34.744319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256544841908066:7408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:34.744336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256544841908066:7408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:34.744340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256544841908066:7408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:34.744348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:34.744712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:34.745380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:34.745395Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:34.745398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:34.745401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:34.745409Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2293 [2:7556256542465005322:12136]
2025-10-01T14:14:34.745424Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:34.745442Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:34.745450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.745453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.745455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.745472Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:34.745481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:34.745491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:34.745554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.745559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.745561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.745565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:34.745567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:34.745631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:34.745638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.745650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.745663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.745678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:34.745701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841908105:7408], now have 1 active actors on pipe
2025-10-01T14:14:34.745708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841907975:2446], now have 1 active actors on pipe
2025-10-01T14:14:34.745716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256542465005316:12136]
2025-10-01T14:14:34.745718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256542465005316:12136]
2025-10-01T14:14:34.745721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256542465005316:12136]
2025-10-01T14:14:34.745733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:34.745750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:34.745750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:34.745753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:34.745755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:34.745769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:34.745775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:34.745774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2293
2025-10-01T14:14:34.745809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256542465005316:12136]
2025-10-01T14:14:34.745780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2293
2025-10-01T14:14:34.745816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:34.745819Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:34.745831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.745840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.745887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:34.745898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.745907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.745909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:34.745917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.745931Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:34.745953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.746105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.746113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.746126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.746183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2294 partition: 0 MaxSeqNo: 45 sessionId: src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0
2025-10-01T14:14:34.746528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a65681-e3f4296e-43bd73e7-fbbf8935_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:34.749318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0] Write session: try to update token
2025-10-01T14:14:34.749335Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:34.763587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2294 sessionId: src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:34.765913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:34.766425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.766442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.766461Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:34.766463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:34.766465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:34.766466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:34.766472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256542465005316:12136]
2025-10-01T14:14:34.766476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256542465005316:12136]
2025-10-01T14:14:34.766480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256542465005316:12136]
2025-10-01T14:14:34.766526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:34.766529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:34.766532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:34.766534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.766536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:34.766537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:34.766665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:34.827296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256544841908125:12142]
2025-10-01T14:14:34.827497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2293, pipe: [1:7556256544841908125:12142]
2025-10-01T14:14:34.910043Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:34.910334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:34.910477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:34.910408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841908125:12142], now have 1 active actors on pipe
2025-10-01T14:14:34.910996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256544841908125:12142]
2025-10-01T14:14:34.911024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:34.921586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:34.921603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:34.921631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2294 reason: error at write: Disconnected sessionId: src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0
2025-10-01T14:14:34.921795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2294 sessionId: src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0 is DEAD
2025-10-01T14:14:34.921955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:34.921967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0] Write session will restart in 0.007416s
2025-10-01T14:14:34.922003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0] Write session: Do CDS request
2025-10-01T14:14:34.922011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:34.926514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:34.928479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:34.928707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:34.928718Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:34.928729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:34.928776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:34.928812Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256542465005454:12139]
2025-10-01T14:14:34.929417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:34.929752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:34.929796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:34.930098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:34.930150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.930156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.930157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.930158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.930159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.930160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.930161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.930162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.930163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.930165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.930166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.930167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.930168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.930169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.930173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.930183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.930186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.930189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.930193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.930196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.930200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.930203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.930206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.930209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.930212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.930215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.930218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.930222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.930229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.930235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:34.930246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.930255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:34.930260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.930264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:34.930268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.930278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:34.930287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.930295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:34.930300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.930308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:34.930312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.930319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:34.930327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.930332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:34.930340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.930344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:34.930352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.930356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.930364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.930387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.930395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.930399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.930405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.930409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:34.930418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.930423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:34.930462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:34.930923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.931038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:34.931055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2295
2025-10-01T14:14:34.931200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:34.931259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:34.931273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:34.931285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:34.931713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2295 sessionId:  describe result for acl check
2025-10-01T14:14:34.931751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:34.931758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:34.931760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:34.931765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256544841908224:7399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:34.932362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256544841908224:7399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:34.934493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:34.935114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:34.935129Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:34.935132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:34.935136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:34.935142Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2294 [2:7556256542465005454:12139]
2025-10-01T14:14:34.935158Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:34.935181Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:34.935187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.935192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.935194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.935210Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:34.935219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:34.935224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:34.935212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256544841908224:7399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:34.935265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.935270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.935271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.935274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:34.935276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:34.935325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:34.935331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.935337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:34.935343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:34.935356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:34.935373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256542465005449:12139]
2025-10-01T14:14:34.935376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256542465005449:12139]
2025-10-01T14:14:34.935377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256542465005449:12139]
2025-10-01T14:14:34.935385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:34.935392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:34.935396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841908127:2446], now have 1 active actors on pipe
2025-10-01T14:14:34.935395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:34.935398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:34.935402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:34.935410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:34.935412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:34.935445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256542465005449:12139]
2025-10-01T14:14:34.935453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:34.935446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2294
2025-10-01T14:14:34.935470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:34.940768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256544841908224:7399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:34.940789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256544841908224:7399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:34.940792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256544841908224:7399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:34.940800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:34.941024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256544841908262:7399], now have 1 active actors on pipe
2025-10-01T14:14:34.941127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2294
2025-10-01T14:14:34.941180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.941194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.941227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bcf94905-2524db05-aad951a5-7fccfc65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:34.941239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:34.941246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:34.941249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:34.941257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:34.941272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:34.941295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.941488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:34.941496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:34.941506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:34.941566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2295 partition: 0 MaxSeqNo: 45 sessionId: src_id|bcf94905-2524db05-aad951a5-7fccfc65_0
2025-10-01T14:14:34.941898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b841c32-a6a997f8-6d9d9af0-6a662e36_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|bcf94905-2524db05-aad951a5-7fccfc65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:34.944749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf94905-2524db05-aad951a5-7fccfc65_0] Write session: try to update token
2025-10-01T14:14:34.944769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf94905-2524db05-aad951a5-7fccfc65_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:34.955840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:34.955858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:34.955861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:34.955863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:34.955874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256542465005449:12139]
2025-10-01T14:14:34.956068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256542465005449:12139]
2025-10-01T14:14:34.956078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256542465005449:12139]
2025-10-01T14:14:34.956126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:34.956131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:34.956137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:34.956138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:34.956140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:34.956141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:34.956296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:34.959669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2295 sessionId: src_id|bcf94905-2524db05-aad951a5-7fccfc65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:34.962243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:35.011110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256549136875564:12142]
2025-10-01T14:14:35.011379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2294, pipe: [1:7556256549136875564:12142]
2025-10-01T14:14:35.096386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:35.096657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.096670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.096707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136875564:12142], now have 1 active actors on pipe
2025-10-01T14:14:35.096878Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:35.096930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256549136875564:12142]
2025-10-01T14:14:35.096949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:35.096953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:35.096960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:35.097008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2295 reason: error at write: Disconnected sessionId: src_id|bcf94905-2524db05-aad951a5-7fccfc65_0
2025-10-01T14:14:35.097209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2295 sessionId: src_id|bcf94905-2524db05-aad951a5-7fccfc65_0 is DEAD
2025-10-01T14:14:35.097373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf94905-2524db05-aad951a5-7fccfc65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:35.097384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf94905-2524db05-aad951a5-7fccfc65_0] Write session will restart in 0.008570s
2025-10-01T14:14:35.097410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf94905-2524db05-aad951a5-7fccfc65_0] Write session: Do CDS request
2025-10-01T14:14:35.097416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf94905-2524db05-aad951a5-7fccfc65_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:35.107183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf94905-2524db05-aad951a5-7fccfc65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.107297Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:35.107314Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2296
2025-10-01T14:14:35.107431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.107466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:35.107475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:35.107479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:35.107902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2296 sessionId:  describe result for acl check
2025-10-01T14:14:35.107941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:35.107949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:35.107951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:35.107956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256549136875659:7383] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:35.107983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:35.108499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256549136875659:7383] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:35.110081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:35.110289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:35.110298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:35.110328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:35.110313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256549136875659:7383] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:35.110436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:35.110473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256546759972882:12141]
2025-10-01T14:14:35.111013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:35.111284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:35.111322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:35.111605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:35.111652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.111656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.111658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.111659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.111660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.111661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.111662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.111663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.111664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.111665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.111666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.111667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.111668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.111669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.111674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.111683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.111686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.111690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.111694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.111698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.111702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.111706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.111709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.111713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.111716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.111720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.111724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.111728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.111733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.111740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.111746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.111751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.111755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.111760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.111769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.111774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.111779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.111788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.111791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.111796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.111803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.111808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.111812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.111820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.111825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.111834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.111838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.111843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.111848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.111852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.111856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.111861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.111870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.111874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.111882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.111887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.111922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:35.115228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256549136875659:7383] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:35.115242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256549136875659:7383] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:35.115246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256549136875659:7383] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:35.115254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:35.115410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:35.116162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:35.116175Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:35.116177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:35.116179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:35.116184Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2295 [2:7556256546759972882:12141]
2025-10-01T14:14:35.116197Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:35.116209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:35.116211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.116213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.116215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.116226Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:35.116230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:35.116233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:35.116275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.116280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.116282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.116284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:35.116286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:35.116333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:35.116338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.116345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.116350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.116365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:35.116385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136875699:7383], now have 1 active actors on pipe
2025-10-01T14:14:35.116395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136875566:2446], now have 1 active actors on pipe
2025-10-01T14:14:35.116401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256546759972876:12141]
2025-10-01T14:14:35.116403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256546759972876:12141]
2025-10-01T14:14:35.116405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256546759972876:12141]
2025-10-01T14:14:35.116417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:35.116426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:35.116429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:35.116434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:35.116417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2295
2025-10-01T14:14:35.116436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:35.116422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2295
2025-10-01T14:14:35.116441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:35.116443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:35.116469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256546759972876:12141]
2025-10-01T14:14:35.116476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:35.116477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:35.116486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.116490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.116522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e78ff510-5a601463-46570de8-eda878b9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:35.116530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.116533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.116534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:35.116540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.116550Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:35.116577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.116689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.116696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.116709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.116762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2296 partition: 0 MaxSeqNo: 45 sessionId: src_id|e78ff510-5a601463-46570de8-eda878b9_0
2025-10-01T14:14:35.117065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bcf94905-2524db05-aad951a5-7fccfc65_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e78ff510-5a601463-46570de8-eda878b9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:35.119676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e78ff510-5a601463-46570de8-eda878b9_0] Write session: try to update token
2025-10-01T14:14:35.119689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e78ff510-5a601463-46570de8-eda878b9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:35.132446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2296 sessionId: src_id|e78ff510-5a601463-46570de8-eda878b9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:35.134663Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:35.136274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.136299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.136319Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:35.136323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:35.136325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:35.136328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:35.136336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256546759972876:12141]
2025-10-01T14:14:35.136340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256546759972876:12141]
2025-10-01T14:14:35.136344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256546759972876:12141]
2025-10-01T14:14:35.136383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:35.136394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:35.136397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:35.136398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:35.136403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.136406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:35.136533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:35.196980Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256549136875710:12142]
2025-10-01T14:14:35.197206Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2295, pipe: [1:7556256549136875710:12142]
2025-10-01T14:14:35.272209Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:35.272493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:35.272548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136875710:12142], now have 1 active actors on pipe
2025-10-01T14:14:35.272652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:35.272676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256549136875710:12142]
2025-10-01T14:14:35.272705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:35.272743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:35.272751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:35.272818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2296 reason: error at write: Disconnected sessionId: src_id|e78ff510-5a601463-46570de8-eda878b9_0
2025-10-01T14:14:35.272978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2296 sessionId: src_id|e78ff510-5a601463-46570de8-eda878b9_0 is DEAD
2025-10-01T14:14:35.273107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78ff510-5a601463-46570de8-eda878b9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:35.273115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78ff510-5a601463-46570de8-eda878b9_0] Write session will restart in 0.006566s
2025-10-01T14:14:35.273133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78ff510-5a601463-46570de8-eda878b9_0] Write session: Do CDS request
2025-10-01T14:14:35.273141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78ff510-5a601463-46570de8-eda878b9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:35.280877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e78ff510-5a601463-46570de8-eda878b9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.281029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:35.281047Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2297
2025-10-01T14:14:35.281158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.281202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:35.281211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:35.281215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:35.281583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2297 sessionId:  describe result for acl check
2025-10-01T14:14:35.281613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:35.281619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:35.281622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:35.281627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256549136875772:7381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:35.282108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256549136875772:7381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:35.283565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:35.284160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256549136875772:7381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:35.285289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:35.285414Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:35.285425Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:35.285433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:35.285464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:35.285486Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256546759973016:12144]
2025-10-01T14:14:35.285873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:35.286044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256549136875772:7381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:35.286054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256549136875772:7381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:35.286058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256549136875772:7381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:35.286063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:35.286104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:35.286133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:35.286316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:35.286349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.286353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.286354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.286354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.286355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.286355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.286356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.286357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.286357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.286358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.286359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.286359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.286360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.286360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.286363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.286384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.286388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.286391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.286394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.286397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.286400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.286403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.286406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.286410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.286414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.286416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.286418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.286420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.286425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.286429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.286433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.286436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.286438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.286441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.286443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.286446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.286448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.286451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.286453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.286456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.286458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.286461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.286463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.286466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.286468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.286471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.286473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.286476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.286482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.286485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.286488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.286490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.286496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.286498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.286501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.286503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.286527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:35.289826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:35.290845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:35.290855Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:35.290857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:35.290859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:35.290864Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2296 [2:7556256546759973016:12144]
2025-10-01T14:14:35.290875Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:35.290888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:35.290892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.290895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.290896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.290907Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:35.290914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:35.290918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:35.290958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.290963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.290964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.290967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:35.290968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:35.291017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:35.291022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.291029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.291034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.291046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:35.291061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136875712:2446], now have 1 active actors on pipe
2025-10-01T14:14:35.291067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136875844:7381], now have 1 active actors on pipe
2025-10-01T14:14:35.291073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256546759973010:12144]
2025-10-01T14:14:35.291078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256546759973010:12144]
2025-10-01T14:14:35.291079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256546759973010:12144]
2025-10-01T14:14:35.291088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:35.291100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:35.291104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:35.291107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:35.291109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:35.291112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:35.291114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:35.291114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2296
2025-10-01T14:14:35.291134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256546759973010:12144]
2025-10-01T14:14:35.291130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2296
2025-10-01T14:14:35.291139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:35.291142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:35.291165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.291168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.291190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:35.291201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.291205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.291207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:35.291216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.291222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:35.291233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.291358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.291366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.291376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.291444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2297 partition: 0 MaxSeqNo: 45 sessionId: src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0
2025-10-01T14:14:35.291772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e78ff510-5a601463-46570de8-eda878b9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:35.294710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0] Write session: try to update token
2025-10-01T14:14:35.294727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:35.301027Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:35.301044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:35.301054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256546759973010:12144]
2025-10-01T14:14:35.301088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:35.301096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:35.301260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:35.301396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:35.301544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:35.301710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:35.301899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:35.301935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:35.308506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2297 sessionId: src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:35.311241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:35.311418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.311438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.311473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:35.311547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:35.319031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:35.319046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:35.319048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:35.319049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:35.319057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256546759973010:12144]
2025-10-01T14:14:35.319063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256546759973010:12144]
2025-10-01T14:14:35.319066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256546759973010:12144]
2025-10-01T14:14:35.319107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:35.319116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.319107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:35.319119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:35.319123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:35.319127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:35.319229Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:35.372620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256549136875876:12142]
2025-10-01T14:14:35.372912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2296, pipe: [1:7556256549136875876:12142]
2025-10-01T14:14:35.466436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:35.474622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.474645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.474778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.474838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.474894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.474941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.474978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.474985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.475050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.475114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.475177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.475244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.475290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.475298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.475370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.475434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.475500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.475569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.475614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.475622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.475697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.475764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.475829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.475898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.475945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.475951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.476024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.476084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.476151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.476218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.476258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.476265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.476335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.476403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.476467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.476539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.476599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.476607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.476675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.476737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.476804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.476872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.476916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.476923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.476991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.477053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.477117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.477172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.477213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.477218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.477275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.477325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.477393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.477463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.477503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.477509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.477561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.477614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.477678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.477735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.477780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.477788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.477849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136875876:12142], now have 1 active actors on pipe
2025-10-01T14:14:35.478036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:35.478039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256549136875876:12142]
2025-10-01T14:14:35.478054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:35.478058Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:35.478081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2297 reason: error at write: Disconnected sessionId: src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0
2025-10-01T14:14:35.478286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2297 sessionId: src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0 is DEAD
2025-10-01T14:14:35.478623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:35.478634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0] Write session will restart in 0.007459s
2025-10-01T14:14:35.478662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0] Write session: Do CDS request
2025-10-01T14:14:35.478668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:35.479073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:35.486919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.487049Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:35.487067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2298
2025-10-01T14:14:35.487914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.487957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:35.487966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:35.487969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:35.488427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2298 sessionId:  describe result for acl check
2025-10-01T14:14:35.488469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:35.488476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:35.488478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:35.488483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256549136875930:7335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:35.489047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256549136875930:7335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:35.491759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256549136875930:7335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:35.492363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:35.494528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:35.494754Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:35.494763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:35.494775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:35.494825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:35.494875Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256546759973170:12149]
2025-10-01T14:14:35.494981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256549136875930:7335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:35.494997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256549136875930:7335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:35.495000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256549136875930:7335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:35.495007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:35.495358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:35.495635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:35.495672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:35.495885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:35.495934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.495939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.495940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.495941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.495943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.495944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.495946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.495947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.495948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.495949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.495950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.495952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.495953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.495954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.495960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.495970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.495974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.495979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.495983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.495988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.495992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.495996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.496001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.496005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.496009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.496014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.496018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.496036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.496046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.496057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.496066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.496073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.496077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.496081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.496086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.496091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.496095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.496100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.496104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.496109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.496114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.496119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.496123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.496130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.496137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.496143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.496152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.496157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.496163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.496171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.496175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.496184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.496193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.496198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.496205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.496211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.496252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:35.500059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:35.500749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:35.500769Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:35.500772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:35.500776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:35.500783Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2297 [2:7556256546759973170:12149]
2025-10-01T14:14:35.500801Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:35.500818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:35.500822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.500825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.500827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.500845Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:35.500856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:35.500862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:35.500923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.500933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.500935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.500938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:35.500941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:35.501011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:35.501020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.501032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.501041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.501057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:35.501075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136876009:7335], now have 1 active actors on pipe
2025-10-01T14:14:35.501083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136875878:2446], now have 1 active actors on pipe
2025-10-01T14:14:35.501090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256546759973165:12149]
2025-10-01T14:14:35.501093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256546759973165:12149]
2025-10-01T14:14:35.501095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256546759973165:12149]
2025-10-01T14:14:35.501110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:35.501127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:35.501128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:35.501136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:35.501139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:35.501142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:35.501144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:35.501122Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2297
2025-10-01T14:14:35.501126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2297
2025-10-01T14:14:35.501193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.501202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.501215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256546759973165:12149]
2025-10-01T14:14:35.501226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:35.501239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:35.501255Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:35.501266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.501270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.501274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:35.501283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.501291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:35.501317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.501478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.501490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.501507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.501587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2298 partition: 0 MaxSeqNo: 45 sessionId: src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0
2025-10-01T14:14:35.501993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c66cd6bc-f33e4a38-834bc160-6ef3d229_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:35.505057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0] Write session: try to update token
2025-10-01T14:14:35.505075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:35.518440Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2298 sessionId: src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:35.520885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:35.522126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.522147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.522165Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:35.522168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:35.522170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:35.522171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:35.522177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256546759973165:12149]
2025-10-01T14:14:35.522185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256546759973165:12149]
2025-10-01T14:14:35.522192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256546759973165:12149]
2025-10-01T14:14:35.522235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:35.522236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:35.522242Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:35.522246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:35.522246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.522249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:35.522428Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:35.578422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256549136876025:12142]
2025-10-01T14:14:35.578660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2297, pipe: [1:7556256549136876025:12142]
2025-10-01T14:14:35.671744Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:35.672135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:35.672198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136876025:12142], now have 1 active actors on pipe
2025-10-01T14:14:35.672282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:35.672440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256549136876025:12142]
2025-10-01T14:14:35.672470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:35.684864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:35.684881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:35.684906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2298 reason: error at write: Disconnected sessionId: src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0
2025-10-01T14:14:35.685200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:35.685212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0] Write session will restart in 0.006235s
2025-10-01T14:14:35.685239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0] Write session: Do CDS request
2025-10-01T14:14:35.685049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2298 sessionId: src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0 is DEAD
2025-10-01T14:14:35.685246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:35.691479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:35.692906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.693010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:35.693042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2299
2025-10-01T14:14:35.693163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.693195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:35.693209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:35.693219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:35.693648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2299 sessionId:  describe result for acl check
2025-10-01T14:14:35.693685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:35.693691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:35.693693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:35.693698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256549136876131:7317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:35.693933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:35.694147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:35.694158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:35.694169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:35.694227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:35.694249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256549136876131:7317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:35.694267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256546759973333:12161]
2025-10-01T14:14:35.694866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:35.695178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:35.695238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:35.695581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:35.695637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.695643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.695645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.695646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.695647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.695649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.695651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.695652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.695653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.695655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.695656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.695658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.695659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.695661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.695667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.695677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.695682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.695686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.695691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.695696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.695700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.695704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.695707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.695711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.695715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.695719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.695722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.695726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.695733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.695741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.695747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.695753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.695757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.695762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.695765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.695770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.695783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.695789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.695794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.695800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.695805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.695810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.695815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.695820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.695825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.695830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.695834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.695840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.695845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.695850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.695855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.695860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.695865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.695871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.695874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.695879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.695920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:35.697103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256549136876131:7317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:35.699716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:35.699685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256549136876131:7317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:35.699699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256549136876131:7317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:35.699704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256549136876131:7317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:35.699711Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:35.700576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:35.700592Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:35.700595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:35.700599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:35.700607Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2298 [2:7556256546759973333:12161]
2025-10-01T14:14:35.700623Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:35.700640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:35.700644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.700647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.700650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.700666Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:35.700671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:35.700677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:35.700733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.700735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.700737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.700740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:35.700743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:35.700814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:35.700820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.700833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.700845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.700862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:35.700889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256546759973328:12161]
2025-10-01T14:14:35.700892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256546759973328:12161]
2025-10-01T14:14:35.700899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256546759973328:12161]
2025-10-01T14:14:35.700917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:35.700925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:35.700928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:35.700931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:35.700932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136876166:7317], now have 1 active actors on pipe
2025-10-01T14:14:35.700935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136876034:2446], now have 1 active actors on pipe
2025-10-01T14:14:35.700945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:35.700959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:35.700962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:35.700995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256546759973328:12161]
2025-10-01T14:14:35.701004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:35.701031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:35.701233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2298
2025-10-01T14:14:35.701261Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2298
2025-10-01T14:14:35.701560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.701574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.701620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:35.701633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.701642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.701645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:35.701659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.701677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:35.701694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.701882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.701891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.701913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.702036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2299 partition: 0 MaxSeqNo: 45 sessionId: src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0
2025-10-01T14:14:35.702410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9a2b0c4-712a9c2b-8f4be522-2d4a8dfd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:35.705265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0] Write session: try to update token
2025-10-01T14:14:35.705284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:35.712532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:35.712550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:35.712647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256546759973328:12161]
2025-10-01T14:14:35.712697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:35.712819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:35.712874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:35.713018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:35.713171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:35.713322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:35.713508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:35.713547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:35.727016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2299 sessionId: src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:35.729852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:35.730117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.730141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.730189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:35.730290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:35.732980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:35.732998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:35.733000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:35.733002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:35.733016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256546759973328:12161]
2025-10-01T14:14:35.733019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256546759973328:12161]
2025-10-01T14:14:35.733023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256546759973328:12161]
2025-10-01T14:14:35.733064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:35.733073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:35.733075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:35.733080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:35.733081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.733084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:35.733224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:35.772494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256549136876173:12142]
2025-10-01T14:14:35.772773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2298, pipe: [1:7556256549136876173:12142]
2025-10-01T14:14:35.889898Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:35.898492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.898521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.898689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.898751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.898810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.898865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.899123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.899129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.899196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.899253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.899307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.899366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.899406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.899411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.899485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.899550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.899611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.899671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.899712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.899715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.899788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.899849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.899908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.899970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.900012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.900015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.900086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.900147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.900210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.900272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.900312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.900315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.902174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256549136876173:12142]
2025-10-01T14:14:35.900388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.902181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:35.900445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.902185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:35.900507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.900587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.900630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.900633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.902212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:35.900700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.900753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.902214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2299 reason: error at write: Disconnected sessionId: src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0
2025-10-01T14:14:35.900813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.900875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.900915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.900918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.900997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.901059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.901124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.901189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.901237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.901240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.901302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.901358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.901418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.901478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.901521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.901524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.901595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:35.901656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:35.901716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:35.901771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:35.901819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:35.901822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:35.901903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136876173:12142], now have 1 active actors on pipe
2025-10-01T14:14:35.902454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2299 sessionId: src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0 is DEAD
2025-10-01T14:14:35.902623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:35.902634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0] Write session will restart in 0.009240s
2025-10-01T14:14:35.902659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0] Write session: Do CDS request
2025-10-01T14:14:35.902665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:35.903716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:35.912967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.913044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:35.913064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2300
2025-10-01T14:14:35.913323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:35.913352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:35.913363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:35.913365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:35.913818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2300 sessionId:  describe result for acl check
2025-10-01T14:14:35.913853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:35.913860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:35.913861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:35.913866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256549136876244:7295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:35.914546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256549136876244:7295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:35.916493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256549136876244:7295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:35.916589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:35.918436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:35.918644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:35.918655Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:35.918666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:35.918713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:35.918751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256546759973470:12164]
2025-10-01T14:14:35.919025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256549136876244:7295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:35.919040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256549136876244:7295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:35.919043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256549136876244:7295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:35.919051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:35.919331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:35.919626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:35.919667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:35.919966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:35.920020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.920026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.920027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.920028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.920029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.920030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.920031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.920032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.920034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.920035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.920036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.920037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.920038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.920039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.920044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.920052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.920056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.920060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.920063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.920067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.920070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.920073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.920077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.920080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.920084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.920087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.920090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.920093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.920100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.920107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:35.920112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.920117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:35.920121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.920125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:35.920129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.920134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:35.920138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.920143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:35.920147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.920152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:35.920156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.920161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:35.920165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.920169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:35.920173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.920178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:35.920182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.920186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.920192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.920201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.920205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.920209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.920213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.920217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:35.920221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.920225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:35.920265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:35.924164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:35.924927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:35.924941Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:35.924943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:35.924946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:35.924953Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2299 [2:7556256546759973470:12164]
2025-10-01T14:14:35.924967Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:35.924985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:35.924992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.924995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.924997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.925011Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:35.925017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:35.925022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:35.925079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.925085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.925087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.925091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:35.925093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:35.925157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:35.925167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.925177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:35.925186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:35.925200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:35.925222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136876190:2446], now have 1 active actors on pipe
2025-10-01T14:14:35.925229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256549136876322:7295], now have 1 active actors on pipe
2025-10-01T14:14:35.925236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256546759973465:12164]
2025-10-01T14:14:35.925243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256546759973465:12164]
2025-10-01T14:14:35.925246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256546759973465:12164]
2025-10-01T14:14:35.925260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:35.925277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:35.925289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:35.925293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:35.925296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:35.925299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:35.925302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:35.925287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2299
2025-10-01T14:14:35.925289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2299
2025-10-01T14:14:35.925322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256546759973465:12164]
2025-10-01T14:14:35.925329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:35.925339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:35.925357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.925365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.925399Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5807aa7-cbd74c92-65816c62-9466581b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:35.925412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:35.925415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:35.925417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:35.925427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:35.925435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:35.925451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.925613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.925624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.925646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:35.925740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2300 partition: 0 MaxSeqNo: 45 sessionId: src_id|e5807aa7-cbd74c92-65816c62-9466581b_0
2025-10-01T14:14:35.926106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb412c04-1047d802-5c37fe7-a14b29bd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e5807aa7-cbd74c92-65816c62-9466581b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:35.928910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5807aa7-cbd74c92-65816c62-9466581b_0] Write session: try to update token
2025-10-01T14:14:35.928924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5807aa7-cbd74c92-65816c62-9466581b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:35.942665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2300 sessionId: src_id|e5807aa7-cbd74c92-65816c62-9466581b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:35.945110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:35.946213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:35.946245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:35.946269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:35.946275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:35.946277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:35.946280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:35.946289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256546759973465:12164]
2025-10-01T14:14:35.946301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256546759973465:12164]
2025-10-01T14:14:35.946305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256546759973465:12164]
2025-10-01T14:14:35.946353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:35.946367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:35.946366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:35.946387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:35.946394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:35.946397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:35.946540Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:36.002332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256553431843632:12142]
2025-10-01T14:14:36.002579Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2299, pipe: [1:7556256553431843632:12142]
2025-10-01T14:14:36.090643Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:36.090871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:36.090919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431843632:12142], now have 1 active actors on pipe
2025-10-01T14:14:36.091018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:36.091123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:36.091131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:36.091197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2300 reason: error at write: Disconnected sessionId: src_id|e5807aa7-cbd74c92-65816c62-9466581b_0
2025-10-01T14:14:36.091354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2300 sessionId: src_id|e5807aa7-cbd74c92-65816c62-9466581b_0 is DEAD
2025-10-01T14:14:36.091449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5807aa7-cbd74c92-65816c62-9466581b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:36.091458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5807aa7-cbd74c92-65816c62-9466581b_0] Write session will restart in 0.009702s
2025-10-01T14:14:36.091483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5807aa7-cbd74c92-65816c62-9466581b_0] Write session: Do CDS request
2025-10-01T14:14:36.091489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5807aa7-cbd74c92-65816c62-9466581b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:36.091536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256553431843632:12142]
2025-10-01T14:14:36.091555Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:36.101946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5807aa7-cbd74c92-65816c62-9466581b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.101981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:36.101998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2301
2025-10-01T14:14:36.102197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.102227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:36.102237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:36.102240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:36.102598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2301 sessionId:  describe result for acl check
2025-10-01T14:14:36.102639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:36.102644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:36.102646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:36.102651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256553431843732:7277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:36.102810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:36.103109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256553431843732:7277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:36.104766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:36.104965Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:36.104969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256553431843732:7277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:36.104974Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:36.104982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:36.105025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:36.105065Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256551054940902:12166]
2025-10-01T14:14:36.105522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:36.105797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:36.105851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:36.106111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:36.106159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.106164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.106165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.106166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.106167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.106168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.106169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.106170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.106171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.106172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.106174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.106175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.106176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.106177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.106183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.106192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.106197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.106201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.106204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.106208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.106212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.106215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.106219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.106223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.106227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.106231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.106235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.106239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.106246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.106256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.106265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.106274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.106280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.106288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.106292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.106297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.106302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.106307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.106315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.106320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.106327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.106332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.106338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.106346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.106353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.106359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.106366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.106382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.106387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.106392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.106399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.106404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.106411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.106416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.106424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.106429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.106469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:36.106836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256553431843732:7277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:36.106849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256553431843732:7277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:36.106851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256553431843732:7277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:36.106856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:36.110113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:36.110804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:36.110818Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:36.110821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:36.110825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:36.110832Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2300 [2:7556256551054940902:12166]
2025-10-01T14:14:36.110848Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:36.110867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:36.110870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.110874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.110876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.110892Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:36.110903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:36.110910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:36.110962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.110968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.110970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.110973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:36.110976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:36.111047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:36.111059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.111073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.111084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.111106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:36.111128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431843771:7277], now have 1 active actors on pipe
2025-10-01T14:14:36.111135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431843635:2446], now have 1 active actors on pipe
2025-10-01T14:14:36.111142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256551054940897:12166]
2025-10-01T14:14:36.111150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256551054940897:12166]
2025-10-01T14:14:36.111152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256551054940897:12166]
2025-10-01T14:14:36.111166Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:36.111182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:36.111187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:36.111191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:36.111193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:36.111202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:36.111205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:36.111192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2300
2025-10-01T14:14:36.111195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2300
2025-10-01T14:14:36.111241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256551054940897:12166]
2025-10-01T14:14:36.111251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:36.111257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:36.111272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.111280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.111324Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:36.111334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.111338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.111340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:36.111349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.111362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:36.111379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.111493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.111499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.111509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.111575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2301 partition: 0 MaxSeqNo: 45 sessionId: src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0
2025-10-01T14:14:36.111914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5807aa7-cbd74c92-65816c62-9466581b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:36.114731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0] Write session: try to update token
2025-10-01T14:14:36.114751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:36.128154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2301 sessionId: src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:36.130327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:36.131114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.131138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.131160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:36.131169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:36.131171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:36.131173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:36.131182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256551054940897:12166]
2025-10-01T14:14:36.131191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256551054940897:12166]
2025-10-01T14:14:36.131198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256551054940897:12166]
2025-10-01T14:14:36.131246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:36.131252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:36.131258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:36.131259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.131261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:36.131262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:36.131386Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:36.191803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256553431843779:12142]
2025-10-01T14:14:36.192094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2300, pipe: [1:7556256553431843779:12142]
2025-10-01T14:14:36.276097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:36.276523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:36.276585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431843779:12142], now have 1 active actors on pipe
2025-10-01T14:14:36.277261Z :ERROR: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-10-01T14:14:36.277418Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:14:36.277423Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-10-01T14:14:36.277432Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Reconnecting session to cluster  in 0.006983s
2025-10-01T14:14:36.276691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:36.276885Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:36.276922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256553431843779:12142]
2025-10-01T14:14:36.276931Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 closed with error: reason# too much attempts to restart pipe
2025-10-01T14:14:36.277169Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 23 consumer shared/user session shared/user_1_23_3754908952350609415_v1 is DEAD
2025-10-01T14:14:36.277401Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256471827449542:12139] disconnected; active server actors: 1
2025-10-01T14:14:36.277405Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256471827449542:12139] client user disconnected session shared/user_1_23_3754908952350609415_v1
2025-10-01T14:14:36.286344Z :DEBUG: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Successfully connected. Initializing session
2025-10-01T14:14:36.287379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:36.287389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0] Write session will restart in 0.006551s
2025-10-01T14:14:36.287413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0] Write session: Do CDS request
2025-10-01T14:14:36.287418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:36.288969Z :INFO: [/Root] [/Root] [bea27533-8e7b88c1-975a8018-15270284] [] Got InitResponse. ReadSessionId: shared/user_1_24_6388546463162030126_v1
2025-10-01T14:14:36.286577Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-10-01T14:14:36.286594Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 24
2025-10-01T14:14:36.287187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:36.287191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:36.287214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2301 reason: error at write: Disconnected sessionId: src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0
2025-10-01T14:14:36.287284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2301 sessionId: src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0 is DEAD
2025-10-01T14:14:36.288050Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 24 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:14:36.288104Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 read init: from# ipv6:[::1]:51196, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-10-01T14:14:36.288193Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 auth for : user
2025-10-01T14:14:36.288356Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 Handle describe topics response
2025-10-01T14:14:36.288382Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 auth is DEAD
2025-10-01T14:14:36.288390Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 auth ok: topics# 1, initDone# 0
2025-10-01T14:14:36.288650Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 register session: topic# rt3.dc1--test-topic
2025-10-01T14:14:36.288734Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7556256553431843834:7256] connected; active server actors: 1
2025-10-01T14:14:36.288747Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7556256553431843834:7256] session shared/user_1_24_6388546463162030126_v1
2025-10-01T14:14:36.288760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-10-01T14:14:36.288775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-10-01T14:14:36.288781Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_24_6388546463162030126_v1" (Sender=[1:7556256553431843822:7256], Pipe=[1:7556256553431843834:7256], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:14:36.288785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-10-01T14:14:36.288796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-10-01T14:14:36.288805Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_24_6388546463162030126_v1" (Sender=[1:7556256553431843822:7256], Pipe=[1:7556256553431843834:7256], Partitions=[], ActiveFamilyCount=0)
2025-10-01T14:14:36.288816Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_24_6388546463162030126_v1" sender [1:7556256553431843822:7256] lock partition 0 for ReadingSession "shared/user_1_24_6388546463162030126_v1" (Sender=[1:7556256553431843822:7256], Pipe=[1:7556256553431843834:7256], Partitions=[], ActiveFamilyCount=1) generation 1 step 24
2025-10-01T14:14:36.288827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-10-01T14:14:36.288834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-10-01T14:14:36.289036Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 24 Session: "shared/user_1_24_6388546463162030126_v1" ClientId: "user" PipeClient { RawX1: 7556256553431843834 RawX2: 4503603922345048 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-10-01T14:14:36.289054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-10-01T14:14:36.295904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.296060Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:36.296081Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2302
2025-10-01T14:14:36.296186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.296220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:36.296225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:36.296228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:36.296612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2302 sessionId:  describe result for acl check
2025-10-01T14:14:36.296659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:36.296666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:36.296667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:36.296674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256553431843887:7263] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:36.297095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:36.297114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256553431843887:7263] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:36.299302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:36.299498Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:36.299510Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:36.299521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:36.299571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:36.299607Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256551054941044:12169]
2025-10-01T14:14:36.299809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256553431843887:7263] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:36.300175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:36.300475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:36.300523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:36.300758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:36.300812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.300817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.300818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.300819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.300820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.300821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.300822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.300823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.300824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.300825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.300826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.300827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.300828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.300829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.300834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.300841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.300845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.300848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.300852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.300856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.300867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.300870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.300871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.300874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.300875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.300877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.300879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.300881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.300886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.300894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.300900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.300904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.300907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.300911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.300915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.300919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.300923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.300927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.300936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.300941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.300950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.300955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.300961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.300963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.300966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.300969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.300971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.300974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.300976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.300979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.300981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.300984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.300987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.300990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.300992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.300994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.301016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:36.304399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256553431843887:7263] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:36.304419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256553431843887:7263] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:36.304423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256553431843887:7263] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:36.304433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:36.304520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:36.305162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:36.305173Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:36.305175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:36.305177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:36.305182Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2301 [2:7556256551054941044:12169]
2025-10-01T14:14:36.305193Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:36.305206Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:36.305208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.305211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.305212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.305223Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:36.305227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:36.305231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:36.305268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.305273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.305274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.305277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:36.305278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:36.305325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:36.305330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.305337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.305342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.305351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:36.305363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256551054941039:12169]
2025-10-01T14:14:36.305367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256551054941039:12169]
2025-10-01T14:14:36.305369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256551054941039:12169]
2025-10-01T14:14:36.305376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:36.305384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:36.305388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431843927:7263], now have 1 active actors on pipe
2025-10-01T14:14:36.305391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431843837:7265], now have 1 active actors on pipe
2025-10-01T14:14:36.305393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:36.305394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:36.305395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:36.305402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:36.305404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:36.305407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431843781:2446], now have 1 active actors on pipe
2025-10-01T14:14:36.305430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256551054941039:12169]
2025-10-01T14:14:36.305441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:36.305451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:36.305439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2301
2025-10-01T14:14:36.305466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2301
2025-10-01T14:14:36.305466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2301, pipe: [1:7556256553431843837:7265]
2025-10-01T14:14:36.305475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.305485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.305503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.305505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.305510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_24_6388546463162030126_v1 on pipe: [1:7556256553431843837:7265]
2025-10-01T14:14:36.305530Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:36.305538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.305540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.305542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:36.305545Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_24_6388546463162030126_v1:1 with generation 2301
2025-10-01T14:14:36.305549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.305555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:36.305565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.305567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.305569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:36.305581Z node 2 :PERSQUEUE DEBUG: partition.cpp:3691: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_24_6388546463162030126_v1
2025-10-01T14:14:36.305585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.305613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.305627Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-10-01T14:14:36.305739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.305745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.305755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.305875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2302 partition: 0 MaxSeqNo: 45 sessionId: src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0
2025-10-01T14:14:36.306218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d9b8e51-9ab0a56a-610b82f-beafe213_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:36.309205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0] Write session: try to update token
2025-10-01T14:14:36.309222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:36.310288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2096: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-10-01T14:14:36.310325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-10-01T14:14:36.310333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.310335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.310337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.310347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-10-01T14:14:36.310361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-10-01T14:14:36.310515Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 45 WriteTimestampMS: 1759327582000 SizeLag: 30008734 WriteTimestampEstimateMS: 1759328076305 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-10-01T14:14:36.310536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 45 readOffset 0 committedOffset 0
2025-10-01T14:14:36.310581Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 sending to client partition status
2025-10-01T14:14:36.329206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2302 sessionId: src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:36.331780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:36.332270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.332293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.332330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:36.332408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:36.341378Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:36.341399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:36.341402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:36.341404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:36.341414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256551054941039:12169]
2025-10-01T14:14:36.341420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256551054941039:12169]
2025-10-01T14:14:36.341424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256551054941039:12169]
2025-10-01T14:14:36.341473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:36.341476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:36.341484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.341486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:36.341487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:36.341489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:36.341618Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:36.492485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:36.500402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.500432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.500608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.500669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.500729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.500796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.500842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.500850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.500915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.500981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.501045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.501108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.501149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.501151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.501208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.501267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.501323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.501375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.501416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.501417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.501476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.501563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.501617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.501670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.501708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.501710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.501767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.501826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.501883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.501939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.501981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.501984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.502071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.502141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.502203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.502267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.502317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.502320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.502515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.502590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.502666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.502746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.502804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.502815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.502901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.502975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.503058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.503140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.503196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.503202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.503298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.503378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.503454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.503533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.503590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.503597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.503685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:36.503759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:36.503844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:36.503927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:36.504006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:36.504014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:36.505866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_24_6388546463162030126_v1
2025-10-01T14:14:36.505891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:36.505908Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_24_6388546463162030126_v1
2025-10-01T14:14:36.506133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:36.506143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0] Write session will restart in 0.008286s
2025-10-01T14:14:36.506167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0] Write session: Do CDS request
2025-10-01T14:14:36.506173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:36.505782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:36.505798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:36.505821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2302 reason: error at write: Disconnected sessionId: src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0
2025-10-01T14:14:36.506052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2302 sessionId: src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0 is DEAD
2025-10-01T14:14:36.506199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:36.506233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256553431843837:7265]
2025-10-01T14:14:36.520501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.521831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:36.521848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2303
2025-10-01T14:14:36.522018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.522044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:36.522049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:36.522052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:36.522870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2303 sessionId:  describe result for acl check
2025-10-01T14:14:36.522909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:36.522915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:36.522917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:36.522923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256553431844063:7198] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:36.523521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256553431844063:7198] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:36.525841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:36.526672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:36.526859Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:36.526870Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:36.526881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:36.526931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:36.526966Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256551054941203:12174]
2025-10-01T14:14:36.527468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:36.527791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:36.527847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:36.528038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256553431844063:7198] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:36.528146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:36.528232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.528238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.528239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.528240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.528241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.528242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.528243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.528244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.528245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.528246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.528248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.528249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.528250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.528251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.528257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.528267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.528271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.528275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.528279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.528283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.528287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.528291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.528296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.528300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.528303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.528307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.528311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.528314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.528321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.528331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.528337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.528346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.528351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.528356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.528360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.528367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.528371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.528381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.528385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.528394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.528399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.528408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.528412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.528420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.528424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.528430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.528438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.528443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.528451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.528454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.528458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.528463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.528471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.528476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.528483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.528487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.528529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:36.532379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256553431844063:7198] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:36.532383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:36.532396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256553431844063:7198] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:36.532400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256553431844063:7198] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:36.532408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:36.533105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:36.533118Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:36.533120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:36.533123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:36.533128Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2302 [2:7556256551054941203:12174]
2025-10-01T14:14:36.533141Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:36.533154Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:36.533156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.533158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.533160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.533173Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:36.533177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:36.533181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:36.533223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.533230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.533231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.533234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:36.533236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:36.533289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:36.533296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.533304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.533309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.533319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:36.533333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431844103:7198], now have 1 active actors on pipe
2025-10-01T14:14:36.533340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431843961:2446], now have 1 active actors on pipe
2025-10-01T14:14:36.533345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256551054941198:12174]
2025-10-01T14:14:36.533347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256551054941198:12174]
2025-10-01T14:14:36.533348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256551054941198:12174]
2025-10-01T14:14:36.533359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:36.533373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:36.533376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:36.533379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:36.533382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:36.533386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:36.533388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:36.533419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2302
2025-10-01T14:14:36.533454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2302
2025-10-01T14:14:36.533412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256551054941198:12174]
2025-10-01T14:14:36.533424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:36.533433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:36.533579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.533586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.533607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:36.533616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.533619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.533621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:36.533627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.533638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:36.533649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.534975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.534984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.534998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.535084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2303 partition: 0 MaxSeqNo: 45 sessionId: src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0
2025-10-01T14:14:36.538483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b5a4ca6-b4e56917-375a1ed8-297feadd_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:36.541369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0] Write session: try to update token
2025-10-01T14:14:36.541392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:36.562311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2303 sessionId: src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:36.564927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:36.564948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:36.564951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:36.564954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:36.564964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256551054941198:12174]
2025-10-01T14:14:36.564969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256551054941198:12174]
2025-10-01T14:14:36.564974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256551054941198:12174]
2025-10-01T14:14:36.565027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:36.565040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.565042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:36.565173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:36.566458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:36.566478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:36.566482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:36.566725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:36.606816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256553431844115:7265]
2025-10-01T14:14:36.607147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2302, pipe: [1:7556256553431844115:7265]
2025-10-01T14:14:36.726197Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:36.726522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.726540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.726585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431844115:7265], now have 1 active actors on pipe
2025-10-01T14:14:36.726837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256553431844115:7265]
2025-10-01T14:14:36.726856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:36.726859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:36.726869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:36.726917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2303 reason: error at write: Disconnected sessionId: src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0
2025-10-01T14:14:36.726837Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:36.727092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2303 sessionId: src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0 is DEAD
2025-10-01T14:14:36.727228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:36.727234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0] Write session will restart in 0.007556s
2025-10-01T14:14:36.727254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0] Write session: Do CDS request
2025-10-01T14:14:36.727259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:36.735905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.736012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:36.736035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2304
2025-10-01T14:14:36.736148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.736185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:36.736198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:36.736203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:36.736725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2304 sessionId:  describe result for acl check
2025-10-01T14:14:36.736764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:36.736770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:36.736772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:36.736777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256553431844219:7184] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:36.737372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256553431844219:7184] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:36.738177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:36.739409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256553431844219:7184] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:36.740503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:36.740720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:36.740733Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:36.740746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:36.740807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:36.740845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256551054941372:12186]
2025-10-01T14:14:36.741432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:36.741708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:36.741753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:36.741765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256553431844219:7184] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:36.741782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256553431844219:7184] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:36.741785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256553431844219:7184] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:36.741792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:36.742060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:36.742126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.742133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.742134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.742135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.742137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.742137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.742139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.742140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.742141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.742143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.742144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.742145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.742146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.742148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.742153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.742163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.742167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.742171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.742174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.742178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.742181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.742185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.742188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.742193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.742196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.742200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.742204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.742207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.742214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.742222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.742233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.742243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.742247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.742252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.742255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.742260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.742264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.742270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.742274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.742279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.742284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.742294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.742299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.742308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.742312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.742321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.742325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.742334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.742338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.742347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.742351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.742360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.742364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.742390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.742398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.742404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.742445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:36.746121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:36.746862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:36.746878Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:36.746881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:36.746885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:36.746891Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2303 [2:7556256551054941372:12186]
2025-10-01T14:14:36.746906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:36.746921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:36.746930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.746934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.746937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.746951Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:36.746962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:36.746968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:36.747023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.747032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.747034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.747037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:36.747040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:36.747104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:36.747114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.747124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.747133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.747148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:36.747171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431844256:7184], now have 1 active actors on pipe
2025-10-01T14:14:36.747180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431844121:2446], now have 1 active actors on pipe
2025-10-01T14:14:36.747187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256551054941366:12186]
2025-10-01T14:14:36.747189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256551054941366:12186]
2025-10-01T14:14:36.747191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256551054941366:12186]
2025-10-01T14:14:36.747204Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:36.747220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:36.747222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:36.747229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:36.747231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:36.747236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:36.747239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:36.747242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2303
2025-10-01T14:14:36.747267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256551054941366:12186]
2025-10-01T14:14:36.747276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:36.747246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2303
2025-10-01T14:14:36.747278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:36.747303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.747312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.747345Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:36.747355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.747360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.747366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:36.747376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.747389Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:36.747409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.747551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.747559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.747572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.747673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2304 partition: 0 MaxSeqNo: 45 sessionId: src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0
2025-10-01T14:14:36.748061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4958b86-45561dc7-f9d4d5f4-580bafc9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:36.750702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0] Write session: try to update token
2025-10-01T14:14:36.750716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:36.764883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2304 sessionId: src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:36.767347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:36.767798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.767827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.767848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:36.767852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:36.767855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:36.767857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:36.767866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256551054941366:12186]
2025-10-01T14:14:36.767871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256551054941366:12186]
2025-10-01T14:14:36.767876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256551054941366:12186]
2025-10-01T14:14:36.767910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:36.767924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:36.767928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:36.767934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:36.767942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.767944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:36.768077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:36.827187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256553431844278:7265]
2025-10-01T14:14:36.827430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2303, pipe: [1:7556256553431844278:7265]
2025-10-01T14:14:36.920515Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:36.920783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:36.920832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431844278:7265], now have 1 active actors on pipe
2025-10-01T14:14:36.920927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:36.921015Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:36.921057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256553431844278:7265]
2025-10-01T14:14:36.930606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:36.930621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:36.930648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2304 reason: error at write: Disconnected sessionId: src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0
2025-10-01T14:14:36.930787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2304 sessionId: src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0 is DEAD
2025-10-01T14:14:36.930905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:36.930916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0] Write session will restart in 0.008812s
2025-10-01T14:14:36.930942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0] Write session: Do CDS request
2025-10-01T14:14:36.930951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:36.937384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:36.939182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:36.939382Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:36.939395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:36.939408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:36.939465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:36.939505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256551054941514:12189]
2025-10-01T14:14:36.940094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:36.940324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:36.940371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:36.940685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:36.940749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.940756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.940757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.940759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.940760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.940762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.940763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.940764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.940765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.940766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.940768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.940769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.940770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.940771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.940777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.940788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.940792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.940796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.940835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.940800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.940804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.940808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.940812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.940815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.940820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.940824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.940827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.940831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.940835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.940841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.940849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:36.940856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.940861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:36.940866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.940871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:36.940876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.940882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:36.940886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.940892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:36.940897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.940903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:36.940907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.940914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:36.940918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.940923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:36.940934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.940939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:36.940948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.940953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.940961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.940967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.940975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.940954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:36.940981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.940972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2305
2025-10-01T14:14:36.940989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.940994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:36.940998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.941004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:36.941041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:36.941085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:36.941117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:36.941126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:36.941130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:36.941444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2305 sessionId:  describe result for acl check
2025-10-01T14:14:36.941473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:36.941477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:36.941479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:36.941482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256553431844387:7167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:36.941868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256553431844387:7167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:36.943896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256553431844387:7167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:36.944497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:36.945150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:36.945161Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:36.945162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:36.945166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:36.945171Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2304 [2:7556256551054941514:12189]
2025-10-01T14:14:36.945181Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:36.945194Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:36.945196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.945198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.945199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.945210Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:36.945214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:36.945218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:36.945258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.945263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.945265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.945267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:36.945269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:36.945315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:36.945321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.945327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:36.945333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:36.945341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:36.945357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431844280:2446], now have 1 active actors on pipe
2025-10-01T14:14:36.945363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256551054941509:12189]
2025-10-01T14:14:36.945369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256551054941509:12189]
2025-10-01T14:14:36.945370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256551054941509:12189]
2025-10-01T14:14:36.945379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:36.945389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:36.945402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:36.945406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:36.945408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:36.945412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:36.945414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:36.945429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256551054941509:12189]
2025-10-01T14:14:36.945437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:36.945438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:36.945409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2304
2025-10-01T14:14:36.949863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256553431844387:7167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:36.949878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256553431844387:7167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:36.949881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256553431844387:7167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:36.949888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:36.950095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256553431844425:7167], now have 1 active actors on pipe
2025-10-01T14:14:36.950122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2304
2025-10-01T14:14:36.950192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.950205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.950230Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:36.950245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:36.950254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:36.950256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:36.950268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:36.950287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:36.950307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.950648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:36.950658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:36.950676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:36.950798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2305 partition: 0 MaxSeqNo: 45 sessionId: src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0
2025-10-01T14:14:36.951092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbf6d79e-be8ab4d4-17c5c2fc-3b6954c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:36.953831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0] Write session: try to update token
2025-10-01T14:14:36.953846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:36.965180Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:36.965201Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:36.965204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:36.965206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:36.965216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256551054941509:12189]
2025-10-01T14:14:36.965222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256551054941509:12189]
2025-10-01T14:14:36.965226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256551054941509:12189]
2025-10-01T14:14:36.965274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:36.965280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:36.965287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:36.965289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:36.965292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:36.965291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:36.965444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:36.969203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2305 sessionId: src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:36.972096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:37.021241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256557726811727:7265]
2025-10-01T14:14:37.021717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2304, pipe: [1:7556256557726811727:7265]
2025-10-01T14:14:37.103793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:37.104235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.104251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.104292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726811727:7265], now have 1 active actors on pipe
2025-10-01T14:14:37.104476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:37.104533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:37.104579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:37.104595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256557726811727:7265]
2025-10-01T14:14:37.104669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2305 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0
2025-10-01T14:14:37.104820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2305 sessionId: src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0 is DEAD
2025-10-01T14:14:37.104941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:37.104950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0] Write session will restart in 0.005865s
2025-10-01T14:14:37.104976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0] Write session: Do CDS request
2025-10-01T14:14:37.104982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:37.111924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:37.111944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:37.111961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2306
2025-10-01T14:14:37.112210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:37.112239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:37.112243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:37.112245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:37.112711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2306 sessionId:  describe result for acl check
2025-10-01T14:14:37.112754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:37.112760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:37.112762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:37.112768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256557726811769:7149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:37.113325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256557726811769:7149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:37.115343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256557726811769:7149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:37.115962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:37.117840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:37.117899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256557726811769:7149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:37.117912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256557726811769:7149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:37.117919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256557726811769:7149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:37.117928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:37.118060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:37.118071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:37.118084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:37.118143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:37.118185Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256555349908951:12191]
2025-10-01T14:14:37.118727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:37.119043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:37.119082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:37.119291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:37.119334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.119340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.119342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.119343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.119344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.119345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.119346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.119347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.119348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.119349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.119350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.119351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.119352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.119353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.119358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.119367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.119371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.119375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.119378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.119381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.119385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.119388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.119391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.119395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.119398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.119401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.119404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.119408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.119416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.119422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.119430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.119435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.119444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.119460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.119465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.119469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.119474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.119479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.119491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.119501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.119510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.119518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.119521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.119528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.119531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.119534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.119537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.119540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.119546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.119549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.119551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.119554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.119559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.119562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.119564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.119567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.119591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:37.123253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:37.124093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:37.124105Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:37.124107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:37.124109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:37.124115Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2305 [2:7556256555349908951:12191]
2025-10-01T14:14:37.124127Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:37.124141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:37.124143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:37.124146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:37.124148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:37.124165Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:37.124175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:37.124180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:37.124232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.124239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.124241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.124244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:37.124247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:37.124308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:37.124314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.124324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.124333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.124353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:37.124375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726811728:2446], now have 1 active actors on pipe
2025-10-01T14:14:37.124383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726811867:7149], now have 1 active actors on pipe
2025-10-01T14:14:37.124391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256555349908945:12191]
2025-10-01T14:14:37.124397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256555349908945:12191]
2025-10-01T14:14:37.124399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256555349908945:12191]
2025-10-01T14:14:37.124416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:37.124432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:37.124434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:37.124436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:37.124438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:37.124448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:37.124450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:37.124439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2305
2025-10-01T14:14:37.124460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2305
2025-10-01T14:14:37.124483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256555349908945:12191]
2025-10-01T14:14:37.124491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:37.124495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:37.124508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.124517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.124558Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:37.124579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:37.124587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:37.124589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:37.124596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:37.124606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:37.124622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:37.124787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.124793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.124803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:37.124882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2306 partition: 0 MaxSeqNo: 45 sessionId: src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0
2025-10-01T14:14:37.125204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4162fc92-cb2dc0fc-2f5bbce-159e2876_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:37.127872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0] Write session: try to update token
2025-10-01T14:14:37.127889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:37.146153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:37.146177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:37.146180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:37.146182Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:37.146193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256555349908945:12191]
2025-10-01T14:14:37.146199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256555349908945:12191]
2025-10-01T14:14:37.146204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256555349908945:12191]
2025-10-01T14:14:37.146260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:37.146262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:37.146269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.146271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:37.146273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:37.146276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:37.146432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:37.146756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2306 sessionId: src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:37.149182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:37.205773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256557726811882:7265]
2025-10-01T14:14:37.206407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2305, pipe: [1:7556256557726811882:7265]
2025-10-01T14:14:37.298832Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:37.299234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.299249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.299296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726811882:7265], now have 1 active actors on pipe
2025-10-01T14:14:37.299574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:37.300263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256557726811882:7265]
2025-10-01T14:14:37.300299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:37.300320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:37.300372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2306 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0
2025-10-01T14:14:37.300585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2306 sessionId: src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0 is DEAD
2025-10-01T14:14:37.300783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:37.300796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0] Write session will restart in 0.007368s
2025-10-01T14:14:37.300826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0] Write session: Do CDS request
2025-10-01T14:14:37.300833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:37.310889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:37.314698Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:37.314715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2307
2025-10-01T14:14:37.314913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:37.314942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:37.314948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:37.314952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:37.316136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2307 sessionId:  describe result for acl check
2025-10-01T14:14:37.316175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:37.316177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:37.316180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:37.316185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256557726811944:7135] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:37.316702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256557726811944:7135] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:37.321284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256557726811944:7135] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:37.323366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:37.326337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:37.326597Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:37.326609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:37.326621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:37.326677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:37.326714Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256555349909097:12194]
2025-10-01T14:14:37.326605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256557726811944:7135] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:37.326624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256557726811944:7135] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:37.326629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256557726811944:7135] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:37.326637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:37.327322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:37.327615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:37.327663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:37.328004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:37.328066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.328072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.328073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.328078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.328079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.328080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.328082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.328083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.328084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.328086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.328087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.328088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.328090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.328091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.328097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.328108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.328113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.328117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.328121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.328125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.328128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.328131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.328135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.328139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.328143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.328146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.328149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.328153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.328160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.328168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.328173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.328178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.328183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.328189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.328193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.328204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.328209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.328219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.328224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.328235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.328240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.328250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.328259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.328266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.328275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.328281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.328289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.328296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.328306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.328312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.328321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.328327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.328336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.328342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.328349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.328353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.328388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:37.332760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:37.333477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:37.333493Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:37.333496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:37.333500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:37.333508Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2306 [2:7556256555349909097:12194]
2025-10-01T14:14:37.333525Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:37.333552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:37.333559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:37.333563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:37.333565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:37.333581Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:37.333591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:37.333598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:37.333665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.333672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.333674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.333677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:37.333680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:37.333755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:37.333763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.333774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.333789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.333807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:37.333827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256555349909091:12194]
2025-10-01T14:14:37.333833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256555349909091:12194]
2025-10-01T14:14:37.333836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256555349909091:12194]
2025-10-01T14:14:37.333851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:37.333869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:37.333887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:37.333894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:37.333916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:37.333928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256555349909091:12194]
2025-10-01T14:14:37.333931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:37.333931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:37.333933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:37.333940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:37.334205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2306
2025-10-01T14:14:37.334249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2306
2025-10-01T14:14:37.334651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726812024:7135], now have 1 active actors on pipe
2025-10-01T14:14:37.334663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726811885:2446], now have 1 active actors on pipe
2025-10-01T14:14:37.334683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.334689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.334716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:37.334728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:37.334734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:37.334737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:37.334746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:37.334761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:37.334777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:37.335510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.335519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.335539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:37.335679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2307 partition: 0 MaxSeqNo: 45 sessionId: src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0
2025-10-01T14:14:37.336074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a16355cc-5ef603c-ba7b09b0-7b749696_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:37.339248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0] Write session: try to update token
2025-10-01T14:14:37.339266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:37.356874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:37.356894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:37.356905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256555349909091:12194]
2025-10-01T14:14:37.356960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:37.356975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:37.357138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:37.357277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:37.357418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:37.357590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:37.357818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:37.357853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:37.357201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2307 sessionId: src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:37.360207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:37.360404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.360422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.360460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:37.360549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:37.380303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:37.380318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:37.380321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:37.380323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:37.380334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256555349909091:12194]
2025-10-01T14:14:37.380337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256555349909091:12194]
2025-10-01T14:14:37.380341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256555349909091:12194]
2025-10-01T14:14:37.380392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:37.380399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.380402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:37.380412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:37.380421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:37.380424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:37.380539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:37.402463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256557726812048:7265]
2025-10-01T14:14:37.405015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2306, pipe: [1:7556256557726812048:7265]
2025-10-01T14:14:37.539392Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:37.547160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.547197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.547374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.547449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.547525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.547593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.547641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.547647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.547725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.547799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.547865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.547928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.547967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.547969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.548043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.548107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.548171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.548235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.548278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.548279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.548349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.548412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.548476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.548540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.548600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.548603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.548677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.548737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.548801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.548865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.548911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.548913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.548982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.549040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.549102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.549165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.549206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.549210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.549294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.549370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.549444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.549520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.549590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.549594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.549665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.549739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.549809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.549881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.549929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.549938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.550008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.550073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.550139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.550208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.550261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.550267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.550352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:37.550435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:37.550500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:37.550569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:37.550614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:37.550620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:37.550698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726812048:7265], now have 1 active actors on pipe
2025-10-01T14:14:37.552008Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:37.551956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256557726812048:7265]
2025-10-01T14:14:37.551985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:37.552017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:37.552019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:37.552040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2307 reason: error at write: Disconnected sessionId: src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0
2025-10-01T14:14:37.552941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:37.552953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0] Write session will restart in 0.005130s
2025-10-01T14:14:37.552175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2307 sessionId: src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0 is DEAD
2025-10-01T14:14:37.552978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0] Write session: Do CDS request
2025-10-01T14:14:37.552984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:37.558933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:37.559159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:37.559179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2308
2025-10-01T14:14:37.559330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:37.559373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:37.559384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:37.559388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:37.559757Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2308 sessionId:  describe result for acl check
2025-10-01T14:14:37.559788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:37.559794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:37.559796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:37.559800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256557726812078:7088] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:37.560292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256557726812078:7088] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:37.562600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256557726812078:7088] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:37.565983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:37.567907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:37.568107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:37.568118Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:37.568130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:37.568125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256557726812078:7088] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:37.568148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256557726812078:7088] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:37.568151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256557726812078:7088] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:37.568160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:37.568185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:37.568224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256555349909259:12199]
2025-10-01T14:14:37.568844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:37.569110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:37.569142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:37.569332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:37.569365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.569370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.569370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.569372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.569372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.569373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.569374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.569374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.569375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.569376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.569377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.569377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.569378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.569379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.569382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.569388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.569390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.569393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.569396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.569400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.569403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.569406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.569410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.569413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.569416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.569419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.569422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.569425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.569431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.569442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.569452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.569460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.569464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.569472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.569476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.569480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.569484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.569488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.569492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.569495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.569499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.569503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.569507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.569516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.569520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.569527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.569531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.569535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.569541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.569545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.569548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.569552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.569556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.569559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.569563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.569567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.569599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:37.573362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:37.574124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:37.574140Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:37.574143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:37.574147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:37.574155Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2307 [2:7556256555349909259:12199]
2025-10-01T14:14:37.574171Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:37.574188Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:37.574196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:37.574200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:37.574202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:37.574217Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:37.574226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:37.574233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:37.574280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.574285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.574287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.574289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:37.574291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:37.574350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:37.574357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.574387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.574398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.574417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:37.574436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726812205:7088], now have 1 active actors on pipe
2025-10-01T14:14:37.574443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726812063:2446], now have 1 active actors on pipe
2025-10-01T14:14:37.574451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256555349909254:12199]
2025-10-01T14:14:37.574456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256555349909254:12199]
2025-10-01T14:14:37.574459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256555349909254:12199]
2025-10-01T14:14:37.574473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:37.574494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:37.574508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:37.574511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:37.574539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256555349909254:12199]
2025-10-01T14:14:37.574544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:37.574559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2307
2025-10-01T14:14:37.574580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2307
2025-10-01T14:14:37.574576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:37.574584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:37.574586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:37.574590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:37.574768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.574777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.574800Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:37.574810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:37.574815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:37.574818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:37.574829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:37.574838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:37.574853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:37.575161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.575176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.575199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:37.575293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2308 partition: 0 MaxSeqNo: 45 sessionId: src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0
2025-10-01T14:14:37.575630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|db839ae7-5d62e34e-e4a4b89e-eb528788_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:37.578639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0] Write session: try to update token
2025-10-01T14:14:37.578659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:37.595631Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:37.595652Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:37.595655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:37.595658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:37.595673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256555349909254:12199]
2025-10-01T14:14:37.595678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256555349909254:12199]
2025-10-01T14:14:37.595681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256555349909254:12199]
2025-10-01T14:14:37.595734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:37.595740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.595743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:37.595886Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:37.596374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:37.596381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:37.596385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:37.606656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2308 sessionId: src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:37.610246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:37.652021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256557726812220:7265]
2025-10-01T14:14:37.652285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2307, pipe: [1:7556256557726812220:7265]
2025-10-01T14:14:37.761517Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:37.761848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.761859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.761882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726812220:7265], now have 1 active actors on pipe
2025-10-01T14:14:37.762133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:37.762625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256557726812220:7265]
2025-10-01T14:14:37.762661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:37.762728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2308 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0
2025-10-01T14:14:37.762920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2308 sessionId: src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0 is DEAD
2025-10-01T14:14:37.763049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:37.763338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:37.763348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0] Write session will restart in 0.007743s
2025-10-01T14:14:37.763380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0] Write session: Do CDS request
2025-10-01T14:14:37.763387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:37.771912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:37.772045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:37.772063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2309
2025-10-01T14:14:37.772173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:37.772207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:37.772217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:37.772221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:37.772692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2309 sessionId:  describe result for acl check
2025-10-01T14:14:37.772731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:37.772740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:37.772742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:37.772747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256557726812233:7080] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:37.773268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256557726812233:7080] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:37.775164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256557726812233:7080] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:37.777886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256557726812233:7080] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:37.777909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256557726812233:7080] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:37.777913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256557726812233:7080] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:37.777925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:37.787037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:37.790044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:37.790236Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:37.790239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:37.790248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:37.790283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:37.790313Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256555349909435:12212]
2025-10-01T14:14:37.791094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:37.791451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:37.791489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:37.791850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:37.791906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.791907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.791909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.791910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.791912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.791913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.791914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.791916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.791917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.791918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.791919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.791921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.791922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.791924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.791928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.791938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.791943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.791946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.791950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.791954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.791957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.791961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.791965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.791969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.791973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.791977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.791980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.791984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.791991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.791996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:37.792001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.792004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:37.792007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.792011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:37.792014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.792017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:37.792020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.792023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:37.792026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.792029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:37.792033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.792036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:37.792039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.792042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:37.792045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.792048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:37.792051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.792055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.792060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.792066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.792070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.792075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.792081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.792086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:37.792090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.792096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:37.792131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:37.797460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:37.798260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:37.798279Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:37.798282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:37.798287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:37.798298Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2308 [2:7556256555349909435:12212]
2025-10-01T14:14:37.798318Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:37.798337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:37.798341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:37.798346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:37.798348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:37.798383Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:37.798388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:37.798397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:37.798466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.798469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.798471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.798475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:37.798479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:37.798559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:37.798561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.798574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:37.798585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:37.798601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:37.798620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256555349909430:12212]
2025-10-01T14:14:37.798623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256555349909430:12212]
2025-10-01T14:14:37.798625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256555349909430:12212]
2025-10-01T14:14:37.798644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:37.798660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:37.798677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:37.798681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:37.798681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:37.798684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:37.798685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:37.798728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256555349909430:12212]
2025-10-01T14:14:37.798732Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:37.798763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:37.799164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2308
2025-10-01T14:14:37.799241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2308
2025-10-01T14:14:37.799758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726812225:2446], now have 1 active actors on pipe
2025-10-01T14:14:37.799772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726812271:7080], now have 1 active actors on pipe
2025-10-01T14:14:37.799797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.799802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.799833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:37.799843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:37.799848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:37.799852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:37.799863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:37.799879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:37.799901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:37.800248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:37.800257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:37.800279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:37.800449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2309 partition: 0 MaxSeqNo: 45 sessionId: src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0
2025-10-01T14:14:37.800896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f03a1a12-675b46a7-987a6e9f-d72f1ffc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:37.804248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0] Write session: try to update token
2025-10-01T14:14:37.804267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:37.817235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:37.817255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:37.817265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256555349909430:12212]
2025-10-01T14:14:37.817312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:37.817488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:37.817629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:37.817770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:37.817909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:37.818115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:37.818151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:37.818722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:37.837734Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2309 sessionId: src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:37.840672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:37.839707Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:37.839729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:37.839732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:37.839734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:37.839747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256555349909430:12212]
2025-10-01T14:14:37.839752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256555349909430:12212]
2025-10-01T14:14:37.839757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256555349909430:12212]
2025-10-01T14:14:37.839814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:37.839821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:37.839824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:37.839821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:37.839834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:37.839838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:37.840002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:37.861952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256557726812387:7265]
2025-10-01T14:14:37.862303Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2308, pipe: [1:7556256557726812387:7265]
2025-10-01T14:14:38.010149Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:38.011207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:38.011286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256557726812387:7265]
2025-10-01T14:14:38.011309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:38.011399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2309 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0
2025-10-01T14:14:38.011638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2309 sessionId: src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0 is DEAD
2025-10-01T14:14:38.012897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:38.012908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0] Write session will restart in 0.007168s
2025-10-01T14:14:38.012937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0] Write session: Do CDS request
2025-10-01T14:14:38.012944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:38.010776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.010796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.010822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256557726812387:7265], now have 1 active actors on pipe
2025-10-01T14:14:38.011139Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:38.026887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.027033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:38.027057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2310
2025-10-01T14:14:38.027193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.027241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:38.027253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:38.027258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:38.028866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2310 sessionId:  describe result for acl check
2025-10-01T14:14:38.028912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:38.028914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:38.028916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:38.028921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256562021779702:7053] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:38.029360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256562021779702:7053] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:38.039386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256562021779702:7053] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:38.047604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256562021779702:7053] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:38.047626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256562021779702:7053] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:38.047634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256562021779702:7053] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:38.047644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:38.060212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:38.065751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:38.066024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:38.066030Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:38.066042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:38.066098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:38.066149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256559644876878:12214]
2025-10-01T14:14:38.066829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:38.067532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:38.067610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:38.068067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:38.068123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.068125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.068127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.068128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.068130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.068131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.068133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.068135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.068136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.068137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.068139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.068141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.068142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.068144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.068150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.068162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.068167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.068171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.068176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.068182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.068186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.068190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.068195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.068200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.068205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.068209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.068213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.068218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.068228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.068236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.068243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.068250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.068255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.068261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.068266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.068272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.068277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.068282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.068287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.068295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.068300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.068306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.068311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.068316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.068322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.068328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.068333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.068338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.068345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.068350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.068355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.068367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.068372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.068377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.068383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.068387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.068432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:38.074890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:38.075898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:38.075916Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:38.075918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:38.075922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:38.075930Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2309 [2:7556256559644876878:12214]
2025-10-01T14:14:38.075948Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:38.075968Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:38.075976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.075980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.075982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.076001Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:38.076006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:38.076013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:38.076077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.076085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.076087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.076091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:38.076094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:38.076167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:38.076180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.076192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.076208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.076228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:38.076250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256559644876872:12214]
2025-10-01T14:14:38.076257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256559644876872:12214]
2025-10-01T14:14:38.076259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256559644876872:12214]
2025-10-01T14:14:38.076273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:38.076293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:38.076311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:38.076320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:38.076361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256559644876872:12214]
2025-10-01T14:14:38.076368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:38.076450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:38.076457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:38.076459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:38.076465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:38.076969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2309
2025-10-01T14:14:38.077019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2309
2025-10-01T14:14:38.077035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021779691:2446], now have 1 active actors on pipe
2025-10-01T14:14:38.077050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021779766:7053], now have 1 active actors on pipe
2025-10-01T14:14:38.077211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.077225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.077257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:38.077272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.077282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.077284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:38.077295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.077307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:38.077330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.077986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.077999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.078022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.078152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2310 partition: 0 MaxSeqNo: 45 sessionId: src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0
2025-10-01T14:14:38.082490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d4724ee7-a6c74468-8960f52d-bac06b50_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:38.085531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0] Write session: try to update token
2025-10-01T14:14:38.085553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:38.114459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256562021779841:7265]
2025-10-01T14:14:38.118740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021779841:7265], now have 1 active actors on pipe
2025-10-01T14:14:38.120102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2310 sessionId: src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:38.120183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2309, pipe: [1:7556256562021779841:7265]
2025-10-01T14:14:38.122571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:38.122795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.122823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.122866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:38.123853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:38.134189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:38.134212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:38.134214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:38.134216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:38.134226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256559644876872:12214]
2025-10-01T14:14:38.134231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256559644876872:12214]
2025-10-01T14:14:38.134235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256559644876872:12214]
2025-10-01T14:14:38.134287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:38.134300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.134303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:38.134434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:38.134449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:38.134453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:38.134463Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:38.300159Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:38.309857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.309888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.310068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.310133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.310207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.310276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.310325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.310335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.310436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.310503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.310572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.310639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.310685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.310693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.310760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.310825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.310890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.310962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.311001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.311004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.311072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.311133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.311194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.311266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.311311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.311318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.311382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.311444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.311508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.311610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.311656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.311666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.311770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.311845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.311920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.311993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.312046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.312053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.312127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.312200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.312282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.312357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.312412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.312420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.312498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.312583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.312658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.312732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.312803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.312812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.312892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.312964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.313037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.313207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.313261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.313269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.313347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.313416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.313491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.313565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.313616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.313624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.314591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:38.314615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:38.314619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:38.314638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256562021779841:7265]
2025-10-01T14:14:38.314644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2310 reason: error at write: Disconnected sessionId: src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0
2025-10-01T14:14:38.314861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2310 sessionId: src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0 is DEAD
2025-10-01T14:14:38.315239Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:38.318588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:38.318600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0] Write session will restart in 0.007632s
2025-10-01T14:14:38.318626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0] Write session: Do CDS request
2025-10-01T14:14:38.318633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:38.327891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.327989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:38.328007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2311
2025-10-01T14:14:38.328112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.328154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:38.328164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:38.328167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:38.328550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2311 sessionId:  describe result for acl check
2025-10-01T14:14:38.328596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:38.328601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:38.328603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:38.328608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256562021779956:7048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:38.328586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:38.329097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256562021779956:7048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:38.330854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:38.331085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:38.331098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:38.331109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:38.331166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:38.331207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256559644877027:12217]
2025-10-01T14:14:38.331792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256562021779956:7048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:38.331813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:38.332220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:38.332263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:38.332573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:38.332620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.332625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.332625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.332626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.332627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.332628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.332629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.332629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.332630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.332631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.332632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.332632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.332633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.332634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.332637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.332644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.332646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.332649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.332651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.332653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.332656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.332658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.332660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.332662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.332664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.332666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.332668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.332671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.332677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.332682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.332686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.332689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.332693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.332696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.332699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.332702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.332704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.332707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.332709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.332712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.332715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.332718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.332721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.332724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.332727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.332729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.332732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.332735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.332737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.332741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.332743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.332746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.332748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.332751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.332754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.332758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.332777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:38.338064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256562021779956:7048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:38.338084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256562021779956:7048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:38.338087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256562021779956:7048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:38.338096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:38.338139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:38.338878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:38.338893Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:38.338895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:38.338898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:38.338906Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2310 [2:7556256559644877027:12217]
2025-10-01T14:14:38.338918Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:38.338932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:38.338934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.338937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.338938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.338951Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:38.338959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:38.338965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:38.339008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.339013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.339014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.339016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:38.339018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:38.339086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:38.339093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.339105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.339115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.339129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:38.339148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021779848:2446], now have 1 active actors on pipe
2025-10-01T14:14:38.339155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021779994:7048], now have 1 active actors on pipe
2025-10-01T14:14:38.339163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256559644877022:12217]
2025-10-01T14:14:38.339169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256559644877022:12217]
2025-10-01T14:14:38.339171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256559644877022:12217]
2025-10-01T14:14:38.339184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:38.339203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:38.339220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:38.339227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:38.339265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256559644877022:12217]
2025-10-01T14:14:38.339272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:38.339252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2310
2025-10-01T14:14:38.339287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2310
2025-10-01T14:14:38.339284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:38.339295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:38.339297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:38.339303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:38.339369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.339379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.339405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82250e09-26a026af-305d3419-e2859e1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:38.339416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.339425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.339428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:38.339437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.339451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:38.339476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.339728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.339737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.339752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.339948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2311 partition: 0 MaxSeqNo: 45 sessionId: src_id|82250e09-26a026af-305d3419-e2859e1b_0
2025-10-01T14:14:38.340334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5e774ee-a4ee9c05-d585933d-c9605efa_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|82250e09-26a026af-305d3419-e2859e1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:38.343346Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82250e09-26a026af-305d3419-e2859e1b_0] Write session: try to update token
2025-10-01T14:14:38.343369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82250e09-26a026af-305d3419-e2859e1b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:38.357758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2311 sessionId: src_id|82250e09-26a026af-305d3419-e2859e1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:38.360262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:38.360482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.360506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.360545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:38.360665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:38.365017Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:38.365040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:38.365042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:38.365044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:38.365055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256559644877022:12217]
2025-10-01T14:14:38.365060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256559644877022:12217]
2025-10-01T14:14:38.365065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256559644877022:12217]
2025-10-01T14:14:38.365103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:38.365108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:38.365111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:38.365121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:38.365128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.365131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:38.365271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:38.414887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256562021780002:7265]
2025-10-01T14:14:38.415139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2310, pipe: [1:7556256562021780002:7265]
2025-10-01T14:14:38.515217Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:38.524014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.524045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.524232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.524301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.524365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.524433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.524481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.524492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.524576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.524634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.524692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.524758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.524800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.524807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.524869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.524922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.524984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.525041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.525081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.525087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.525145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.525201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.525258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.525314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.525355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.525362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.525424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.525484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.525548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.525611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.525655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.525663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.525743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.525819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.525909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.525987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.526043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.526051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.526125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.526198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.526275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.526349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.526429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.526436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.526517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.526595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.526673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.526752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.526815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.526823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.526905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.526980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.527059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.527144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.527199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.527207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.527293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.527369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.527451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.527532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.527589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.527598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.527678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021780002:7265], now have 1 active actors on pipe
2025-10-01T14:14:38.527956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256562021780002:7265]
2025-10-01T14:14:38.527969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:38.527973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:38.527998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:38.528002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2311 reason: error at write: Disconnected sessionId: src_id|82250e09-26a026af-305d3419-e2859e1b_0
2025-10-01T14:14:38.528073Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:38.528196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2311 sessionId: src_id|82250e09-26a026af-305d3419-e2859e1b_0 is DEAD
2025-10-01T14:14:38.528326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82250e09-26a026af-305d3419-e2859e1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:38.528336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82250e09-26a026af-305d3419-e2859e1b_0] Write session will restart in 0.005571s
2025-10-01T14:14:38.528362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82250e09-26a026af-305d3419-e2859e1b_0] Write session: Do CDS request
2025-10-01T14:14:38.528368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82250e09-26a026af-305d3419-e2859e1b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:38.534853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82250e09-26a026af-305d3419-e2859e1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.534927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:38.534943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2312
2025-10-01T14:14:38.535075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.535108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:38.535114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:38.535117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:38.535587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2312 sessionId:  describe result for acl check
2025-10-01T14:14:38.535624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:38.535630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:38.535632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:38.535637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256562021780064:6355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:38.536176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256562021780064:6355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:38.538592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256562021780064:6355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:38.539344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:38.541495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:38.541700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:38.541711Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:38.541722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:38.541777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:38.541831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256559644877193:12222]
2025-10-01T14:14:38.542026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256562021780064:6355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:38.542042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256562021780064:6355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:38.542045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256562021780064:6355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:38.542053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:38.542481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:38.542730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:38.542771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:38.543073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:38.543123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.543129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.543130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.543132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.543133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.543134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.543135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.543136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.543138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.543139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.543140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.543141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.543142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.543144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.543149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.543159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.543163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.543167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.543171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.543175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.543179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.543183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.543187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.543191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.543195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.543199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.543204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.543208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.543215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.543223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.543230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.543236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.543241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.543246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.543251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.543256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.543261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.543266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.543271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.543276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.543281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.543289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.543294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.543305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.543310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.543315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.543323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.543329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.543338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.543343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.543348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.543358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.543365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.543374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.543378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.543388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.543430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:38.546912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:38.547559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:38.547573Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:38.547575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:38.547579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:38.547588Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2311 [2:7556256559644877193:12222]
2025-10-01T14:14:38.547604Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:38.547619Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:38.547626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.547630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.547632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.547648Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:38.547658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:38.547664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:38.547713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.547722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.547724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.547727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:38.547729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:38.547792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:38.547799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.547808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.547817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.547836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:38.547859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021780034:2446], now have 1 active actors on pipe
2025-10-01T14:14:38.547867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021780175:6355], now have 1 active actors on pipe
2025-10-01T14:14:38.547873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256559644877187:12222]
2025-10-01T14:14:38.547875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256559644877187:12222]
2025-10-01T14:14:38.547878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256559644877187:12222]
2025-10-01T14:14:38.547892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:38.547906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:38.547909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:38.547915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:38.547917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:38.547920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:38.547923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:38.547946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256559644877187:12222]
2025-10-01T14:14:38.547953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:38.547956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:38.547922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2311
2025-10-01T14:14:38.547925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2311
2025-10-01T14:14:38.547986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.547995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.548024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:38.548036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.548046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.548048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:38.548057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.548070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:38.548093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.548227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.548235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.548249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.548324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2312 partition: 0 MaxSeqNo: 45 sessionId: src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0
2025-10-01T14:14:38.548706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82250e09-26a026af-305d3419-e2859e1b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:38.551699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0] Write session: try to update token
2025-10-01T14:14:38.551720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:38.566129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2312 sessionId: src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:38.568692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:38.569213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.569237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.569254Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:38.569256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:38.569258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:38.569260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:38.569266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256559644877187:12222]
2025-10-01T14:14:38.569269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256559644877187:12222]
2025-10-01T14:14:38.569272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256559644877187:12222]
2025-10-01T14:14:38.569307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:38.569320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:38.569321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:38.569328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.569330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:38.569336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:38.569460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:38.627864Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256562021780191:7265]
2025-10-01T14:14:38.628168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2311, pipe: [1:7556256562021780191:7265]
2025-10-01T14:14:38.711520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:38.712585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:38.712635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021780191:7265], now have 1 active actors on pipe
2025-10-01T14:14:38.712710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:38.712826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256562021780191:7265]
2025-10-01T14:14:38.712855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:38.725326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:38.725338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0] Write session will restart in 0.006509s
2025-10-01T14:14:38.725361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0] Write session: Do CDS request
2025-10-01T14:14:38.725366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:38.724960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:38.724976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:38.724999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2312 reason: error at write: Disconnected sessionId: src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0
2025-10-01T14:14:38.725187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2312 sessionId: src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0 is DEAD
2025-10-01T14:14:38.732987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.733120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:38.733146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2313
2025-10-01T14:14:38.733305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.733340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:38.733349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:38.733354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:38.733646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:38.733806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2313 sessionId:  describe result for acl check
2025-10-01T14:14:38.733864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:38.733871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:38.733874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:38.733880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256562021780304:6983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:38.734434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256562021780304:6983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:38.736374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:38.736583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:38.736592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:38.736602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:38.736644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:38.736683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256559644877341:12224]
2025-10-01T14:14:38.737095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256562021780304:6983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:38.737221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:38.737449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:38.737482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:38.737703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:38.737743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.737748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.737749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.737749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.737750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.737751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.737752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.737752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.737753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.737754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.737755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.737755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.737756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.737757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.737760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.737766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.737768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.737770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.737772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.737774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.737776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.737778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.737780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.737782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.737785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.737787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.737789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.737791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.737796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.737800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.737803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.737808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.737811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.737817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.737820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.737824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.737828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.737833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.737836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.737840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.737846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.737852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.737856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.737859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.737862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.737865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.737867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.737870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.737873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.737875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.737878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.737883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.737887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.737891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.737894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.737898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.737930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:38.741378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256562021780304:6983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:38.741397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256562021780304:6983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:38.741400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256562021780304:6983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:38.741409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:38.741544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:38.742548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:38.742560Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:38.742563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:38.742566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:38.742572Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2312 [2:7556256559644877341:12224]
2025-10-01T14:14:38.742587Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:38.742602Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:38.742604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.742608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.742610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.742626Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:38.742637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:38.742643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:38.742695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.742702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.742704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.742708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:38.742710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:38.742777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:38.742786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.742797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.742808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.742823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:38.742840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021780194:2446], now have 1 active actors on pipe
2025-10-01T14:14:38.742847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021780343:6983], now have 1 active actors on pipe
2025-10-01T14:14:38.742853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256559644877336:12224]
2025-10-01T14:14:38.742855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256559644877336:12224]
2025-10-01T14:14:38.742857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256559644877336:12224]
2025-10-01T14:14:38.742871Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:38.742888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:38.742896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2312
2025-10-01T14:14:38.742913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2312
2025-10-01T14:14:38.742905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:38.742912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:38.742916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:38.742919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:38.742921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:38.742938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256559644877336:12224]
2025-10-01T14:14:38.742941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:38.742950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:38.742984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.742993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.743020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:38.743031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.743040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.743041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:38.743051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.743061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:38.743076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.743198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.743208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.743223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.743281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2313 partition: 0 MaxSeqNo: 45 sessionId: src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0
2025-10-01T14:14:38.743667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b955ec9b-2b81b833-847c3dd2-6b779743_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:38.746576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0] Write session: try to update token
2025-10-01T14:14:38.746594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:38.763626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2313 sessionId: src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:38.766611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:38.770516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.770550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.770596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:38.772090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:38.778851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:38.778874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:38.778876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:38.778877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:38.778885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256559644877336:12224]
2025-10-01T14:14:38.778893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256559644877336:12224]
2025-10-01T14:14:38.778897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256559644877336:12224]
2025-10-01T14:14:38.778947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:38.778953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.778961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:38.778971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:38.778983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:38.778990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:38.779085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:38.814041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256562021780363:7265]
2025-10-01T14:14:38.814745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2312, pipe: [1:7556256562021780363:7265]
2025-10-01T14:14:38.929534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:38.939063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.939099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.939303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.939386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.939469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.939547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.939871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.939883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.939953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.940007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.940068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.940125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.940162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.940164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.940222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.940270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.940322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.940373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.940415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.940418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.940481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.940540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.940622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.940677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.940715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.940717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.940777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.940827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.940884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.940939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.940980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.940982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.941065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.941140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.941214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.941281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.941339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.941341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.941411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.941471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.941549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.941622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.941672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.941674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.941744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.941803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.941871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.941939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.941982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.941984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.942075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.942144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.942213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.942282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.942330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.942332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.942461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:38.942539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:38.942628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:38.942715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:38.942772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:38.942780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:38.942850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021780363:7265], now have 1 active actors on pipe
2025-10-01T14:14:38.943740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:38.943873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:38.943894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:38.943934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2313 reason: error at write: Disconnected sessionId: src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0
2025-10-01T14:14:38.944127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2313 sessionId: src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0 is DEAD
2025-10-01T14:14:38.944804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:38.944817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0] Write session will restart in 0.007696s
2025-10-01T14:14:38.944845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0] Write session: Do CDS request
2025-10-01T14:14:38.944853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:38.944487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256562021780363:7265]
2025-10-01T14:14:38.944520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:38.954852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.960882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:38.960904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2314
2025-10-01T14:14:38.961126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:38.961158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:38.961163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:38.961168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:38.961716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2314 sessionId:  describe result for acl check
2025-10-01T14:14:38.961754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:38.961759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:38.961761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:38.961766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256562021780386:6949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:38.962367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256562021780386:6949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:38.968198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256562021780386:6949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:38.972353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256562021780386:6949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:38.972374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256562021780386:6949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:38.972377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256562021780386:6949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:38.972386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:38.976442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:38.977142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:38.977342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:38.977353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:38.977363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:38.977416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:38.977458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256559644877524:12237]
2025-10-01T14:14:38.978130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:38.978529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:38.978578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:38.978913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:38.978982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.978989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.978990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.978992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.978993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.978995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.978996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.978997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.978999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.979001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.979002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.979004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.979005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.979006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.979011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.979022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.979026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.979030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.979034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.979038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.979042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.979045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.979049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.979053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.979056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.979060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.979064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.979068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.979076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.979083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:38.979089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.979095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:38.979099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.979105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:38.979109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.979115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:38.979120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.979125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:38.979134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.979140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:38.979145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.979152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:38.979160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.979164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:38.979167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.979174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:38.979177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.979180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.979184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.979188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.979194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.979197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.979200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.979203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:38.979208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.979214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:38.979257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:38.983689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:38.984354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:38.984373Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:38.984377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:38.984381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:38.984389Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2313 [2:7556256559644877524:12237]
2025-10-01T14:14:38.984407Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:38.984429Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:38.984432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.984436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.984439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.984457Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:38.984462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:38.984475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:38.984542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.984554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.984556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.984569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:38.984572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:38.984647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:38.984656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:38.984667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:38.984679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:38.984697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:38.984724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021780511:6949], now have 1 active actors on pipe
2025-10-01T14:14:38.984731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256559644877519:12237]
2025-10-01T14:14:38.984733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256559644877519:12237]
2025-10-01T14:14:38.984736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256559644877519:12237]
2025-10-01T14:14:38.984751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:38.984763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256562021780365:2446], now have 1 active actors on pipe
2025-10-01T14:14:38.984770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:38.984769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:38.984773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:38.984777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:38.984786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:38.984790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:38.984827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256559644877519:12237]
2025-10-01T14:14:38.984840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:38.984848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:38.984882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2313
2025-10-01T14:14:38.985137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.985150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.985174Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:38.985181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:38.985186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:38.985194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:38.985205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:38.985221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:38.985240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.985452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:38.985470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:38.985494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:38.986024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65fd4634-c0cfc2b7-7ad9bfbd-2e646b49_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:38.985037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2313
2025-10-01T14:14:38.985656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2314 partition: 0 MaxSeqNo: 45 sessionId: src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0
2025-10-01T14:14:38.988938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0] Write session: try to update token
2025-10-01T14:14:38.988958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:39.003716Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2314 sessionId: src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:39.006469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:39.007090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.007119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.007142Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:39.007146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:39.007148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:39.007151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:39.007160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256559644877519:12237]
2025-10-01T14:14:39.007165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256559644877519:12237]
2025-10-01T14:14:39.007168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256559644877519:12237]
2025-10-01T14:14:39.007221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:39.007228Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:39.007229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:39.007233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:39.007236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.007238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:39.007368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:39.044683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256566316747821:7265]
2025-10-01T14:14:39.045329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2313, pipe: [1:7556256566316747821:7265]
2025-10-01T14:14:39.158972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:39.159658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:39.159786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:39.159715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316747821:7265], now have 1 active actors on pipe
2025-10-01T14:14:39.162528Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256566316747821:7265]
2025-10-01T14:14:39.162587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:39.171115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:39.171130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:39.171152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2314 reason: error at write: Disconnected sessionId: src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0
2025-10-01T14:14:39.171270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2314 sessionId: src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0 is DEAD
2025-10-01T14:14:39.171427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:39.171441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0] Write session will restart in 0.007875s
2025-10-01T14:14:39.171468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0] Write session: Do CDS request
2025-10-01T14:14:39.171476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:39.180957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:39.181427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:39.181448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2315
2025-10-01T14:14:39.181611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:39.181669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:39.181679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:39.181686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:39.182189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2315 sessionId:  describe result for acl check
2025-10-01T14:14:39.182252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:39.182254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:39.182256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:39.182262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256566316747915:6934] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:39.182998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256566316747915:6934] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:39.184261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:39.186050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256566316747915:6934] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:39.186773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:39.186998Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:39.187002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:39.187014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:39.187061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:39.187099Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256563939844969:12239]
2025-10-01T14:14:39.187690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:39.188215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:39.188265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:39.188574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:39.188640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.188642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.188644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.188645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.188646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.188647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.188648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.188650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.188651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.188652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.188653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.188655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.188656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.188657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.188663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.188672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.188676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.188681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.188684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.188688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.188691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.188695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.188698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.188702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.188706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.188709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.188713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.188716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.188723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.188731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.188737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.188742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.188746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.188751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.188755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.188760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.188765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.188770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.188774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.188779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.188784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.188789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.188793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.188798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.188803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.188808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.188812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.188817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.188821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.188827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.188833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.188838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.188842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.188846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.188850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.188855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.188889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:39.192936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256566316747915:6934] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:39.192961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256566316747915:6934] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:39.192966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256566316747915:6934] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:39.192976Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:39.192728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:39.193358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:39.193364Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:39.193367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:39.193371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:39.193379Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2314 [2:7556256563939844969:12239]
2025-10-01T14:14:39.193396Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:39.193416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:39.193419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:39.193422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:39.193425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:39.193441Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:39.193447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:39.193453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:39.193500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.193502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.193503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.193506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:39.193508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:39.193563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:39.193565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.193572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.193581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.193595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:39.193611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256563939844964:12239]
2025-10-01T14:14:39.193613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256563939844964:12239]
2025-10-01T14:14:39.193616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256563939844964:12239]
2025-10-01T14:14:39.193625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:39.193635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:39.193638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:39.193641Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:39.193643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:39.193651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:39.193654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:39.193664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316747826:2446], now have 1 active actors on pipe
2025-10-01T14:14:39.193698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256563939844964:12239]
2025-10-01T14:14:39.193708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:39.193724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:39.194243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2314
2025-10-01T14:14:39.194519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2314
2025-10-01T14:14:39.194448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316747973:6934], now have 1 active actors on pipe
2025-10-01T14:14:39.194633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.194646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.194671Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|437ce921-f23697ae-5f03ffb-71002753_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:39.194680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:39.194685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:39.194688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:39.194698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:39.194709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:39.194723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:39.195070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.195078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.195089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:39.195230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2315 partition: 0 MaxSeqNo: 45 sessionId: src_id|437ce921-f23697ae-5f03ffb-71002753_0
2025-10-01T14:14:39.195687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437a0b7a-1e6de14-1b2aada4-d4e4b062_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|437ce921-f23697ae-5f03ffb-71002753_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:39.198895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437ce921-f23697ae-5f03ffb-71002753_0] Write session: try to update token
2025-10-01T14:14:39.198915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437ce921-f23697ae-5f03ffb-71002753_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:39.206306Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:39.206333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:39.206348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256563939844964:12239]
2025-10-01T14:14:39.206398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:39.206419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:39.206724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:39.206992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:39.207247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:39.207462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:39.207805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:39.207867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:39.216194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2315 sessionId: src_id|437ce921-f23697ae-5f03ffb-71002753_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:39.219084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:39.219356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.219380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.219421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:39.222433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:39.225444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:39.225463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:39.225465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:39.225468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:39.225480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256563939844964:12239]
2025-10-01T14:14:39.225483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256563939844964:12239]
2025-10-01T14:14:39.225487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256563939844964:12239]
2025-10-01T14:14:39.225532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:39.225545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:39.225554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:39.225555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.225558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:39.225558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:39.225705Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:39.263656Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256566316747981:7265]
2025-10-01T14:14:39.264138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2314, pipe: [1:7556256566316747981:7265]
2025-10-01T14:14:39.381437Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:39.389759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.389794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.389966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.390038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.390104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.390169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.390221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.390231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.390301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.390366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.390453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.390518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.390566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.390573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.390645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.390709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.390775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.390841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.390890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.390896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.390963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.391029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.391091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.391153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.391197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.391204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.391272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.391332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.391400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.391462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.391513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.391521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.391585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.391647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.391708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.391771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.391814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.391821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.391885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.391942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.392004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.392064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.392103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.392113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.392183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.392249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.392323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.392387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.392440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.392447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.392519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.392590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.392655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.392717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.392763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.392769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.392831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.392890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.392953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.393021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.393065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.393072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.393138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316747981:7265], now have 1 active actors on pipe
2025-10-01T14:14:39.393519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256566316747981:7265]
2025-10-01T14:14:39.393519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:39.393525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:39.393565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:39.393569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2315 reason: error at write: Disconnected sessionId: src_id|437ce921-f23697ae-5f03ffb-71002753_0
2025-10-01T14:14:39.393872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2315 sessionId: src_id|437ce921-f23697ae-5f03ffb-71002753_0 is DEAD
2025-10-01T14:14:39.393953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437ce921-f23697ae-5f03ffb-71002753_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:39.393963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437ce921-f23697ae-5f03ffb-71002753_0] Write session will restart in 0.006057s
2025-10-01T14:14:39.394007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437ce921-f23697ae-5f03ffb-71002753_0] Write session: Do CDS request
2025-10-01T14:14:39.394013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437ce921-f23697ae-5f03ffb-71002753_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:39.394301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:39.400956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|437ce921-f23697ae-5f03ffb-71002753_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:39.401075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:39.401093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2316
2025-10-01T14:14:39.401286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:39.401320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:39.401329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:39.401333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:39.401932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2316 sessionId:  describe result for acl check
2025-10-01T14:14:39.401972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:39.401974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:39.401976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:39.401981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256566316747996:6927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:39.402544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256566316747996:6927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:39.405258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256566316747996:6927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:39.412966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256566316747996:6927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:39.412987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256566316747996:6927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:39.412990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256566316747996:6927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:39.412997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:39.415665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:39.418507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:39.418745Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:39.418757Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:39.418769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:39.418825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:39.418869Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256563939845123:12242]
2025-10-01T14:14:39.419486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:39.419972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:39.420021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:39.420333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:39.420397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.420402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.420403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.420404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.420405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.420406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.420408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.420409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.420411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.420412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.420413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.420414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.420415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.420416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.420422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.420431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.420435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.420438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.420442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.420445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.420449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.420452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.420456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.420460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.420463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.420471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.420474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.420478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.420488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.420500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.420506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.420515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.420523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.420532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.420540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.420548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.420557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.420572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.420581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.420587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.420596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.420604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.420613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.420621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.420626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.420634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.420638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.420642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.420651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.420655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.420663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.420672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.420681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.420689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.420698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.420705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.420745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:39.426151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:39.426828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:39.426849Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:39.426852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:39.426856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:39.426864Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2315 [2:7556256563939845123:12242]
2025-10-01T14:14:39.426885Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:39.426908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:39.426911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:39.426915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:39.426921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:39.426938Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:39.426948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:39.426963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:39.427025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.427032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.427034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.427038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:39.427041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:39.427109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:39.427116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.427128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.427140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.427158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:39.427175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256563939845118:12242]
2025-10-01T14:14:39.427182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256563939845118:12242]
2025-10-01T14:14:39.427184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256563939845118:12242]
2025-10-01T14:14:39.427198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:39.427217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316748128:6927], now have 1 active actors on pipe
2025-10-01T14:14:39.427216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:39.427221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:39.427225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316747984:2446], now have 1 active actors on pipe
2025-10-01T14:14:39.427225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:39.427233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:39.427244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:39.427251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:39.427288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256563939845118:12242]
2025-10-01T14:14:39.427299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:39.427308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:39.427317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2315
2025-10-01T14:14:39.427364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2315
2025-10-01T14:14:39.427373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.427385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.427410Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|97d790d0-42a57489-835be946-70eae2f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:39.427421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:39.427426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:39.427428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:39.427437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:39.427445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:39.427465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:39.427604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.427612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.427625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:39.427710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2316 partition: 0 MaxSeqNo: 45 sessionId: src_id|97d790d0-42a57489-835be946-70eae2f8_0
2025-10-01T14:14:39.428106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|437ce921-f23697ae-5f03ffb-71002753_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|97d790d0-42a57489-835be946-70eae2f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:39.431496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d790d0-42a57489-835be946-70eae2f8_0] Write session: try to update token
2025-10-01T14:14:39.431517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d790d0-42a57489-835be946-70eae2f8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:39.439075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:39.439095Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:39.439106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256563939845118:12242]
2025-10-01T14:14:39.439156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:39.439157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:39.439343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:39.439493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:39.439641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:39.439790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:39.439999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:39.440044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:39.447419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2316 sessionId: src_id|97d790d0-42a57489-835be946-70eae2f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:39.450093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:39.450408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.450436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.450478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:39.450568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:39.458145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:39.458167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:39.458170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:39.458171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:39.458183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256563939845118:12242]
2025-10-01T14:14:39.458187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256563939845118:12242]
2025-10-01T14:14:39.458191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256563939845118:12242]
2025-10-01T14:14:39.458239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:39.458244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:39.458251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.458252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:39.458253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:39.458257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:39.458418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:39.493711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256566316748157:7265]
2025-10-01T14:14:39.493998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2315, pipe: [1:7556256566316748157:7265]
2025-10-01T14:14:39.609219Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:39.617597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.617632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.617791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.617853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.617915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.617974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.618020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.618029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.618092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.618151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.618211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.618272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.618319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.618328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.618421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.618483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.618547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.618611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.618658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.618665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.618736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.618798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.618865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.618931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.618981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.618988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.619058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.619123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.619194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.619261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.619305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.619312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.619386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.619447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.619518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.619583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.619627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.619634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.619703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.619763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.619824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.619886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.619930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.619936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.620001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.620059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.620118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.620182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.620225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.620232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.620293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.620365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.620423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.620483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.620529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.620536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.620612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:39.620666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:39.620724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:39.620782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:39.620828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:39.620835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:39.620893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316748157:7265], now have 1 active actors on pipe
2025-10-01T14:14:39.621203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256566316748157:7265]
2025-10-01T14:14:39.621224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:39.621229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:39.621242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:39.621261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2316 reason: error at write: Disconnected sessionId: src_id|97d790d0-42a57489-835be946-70eae2f8_0
2025-10-01T14:14:39.621432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2316 sessionId: src_id|97d790d0-42a57489-835be946-70eae2f8_0 is DEAD
2025-10-01T14:14:39.621519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d790d0-42a57489-835be946-70eae2f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:39.621525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d790d0-42a57489-835be946-70eae2f8_0] Write session will restart in 0.005309s
2025-10-01T14:14:39.621546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d790d0-42a57489-835be946-70eae2f8_0] Write session: Do CDS request
2025-10-01T14:14:39.621549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d790d0-42a57489-835be946-70eae2f8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:39.622024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:39.627892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|97d790d0-42a57489-835be946-70eae2f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:39.628072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:39.628093Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2317
2025-10-01T14:14:39.628236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:39.628269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:39.628281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:39.628285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:39.629622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2317 sessionId:  describe result for acl check
2025-10-01T14:14:39.629660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:39.629663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:39.629665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:39.629670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256566316748191:6901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:39.630248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256566316748191:6901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:39.636007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256566316748191:6901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:39.636830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:39.640229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:39.640478Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:39.640495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:39.640505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:39.640577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:39.640625Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256563939845295:12247]
2025-10-01T14:14:39.641244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256566316748191:6901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:39.641271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256566316748191:6901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:39.641275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256566316748191:6901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:39.641284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:39.641281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:39.641604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:39.641653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:39.641978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:39.642052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.642059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.642060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.642061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.642063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.642064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.642065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.642066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.642067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.642069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.642070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.642071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.642072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.642074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.642079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.642089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.642092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.642096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.642100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.642104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.642107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.642110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.642114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.642118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.642122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.642125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.642129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.642132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.642141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.642148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.642154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.642159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.642165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.642170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.642180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.642185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.642195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.642200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.642207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.642212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.642217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.642222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.642233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.642238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.642242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.642247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.642253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.642258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.642265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.642270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.642274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.642279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.642284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.642288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.642293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.642298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.642336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:39.647634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2316
2025-10-01T14:14:39.647636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2316
2025-10-01T14:14:39.646521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:39.647227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:39.647233Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:39.647237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:39.647243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:39.647251Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2316 [2:7556256563939845295:12247]
2025-10-01T14:14:39.647270Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:39.647287Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:39.647291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:39.647295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:39.647298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:39.647313Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:39.647319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:39.647326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:39.647391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.647394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.647397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.647402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:39.647405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:39.647482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:39.647485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.647496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.647507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.647522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:39.647541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316748325:6901], now have 1 active actors on pipe
2025-10-01T14:14:39.647545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316748176:2446], now have 1 active actors on pipe
2025-10-01T14:14:39.647552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256563939845290:12247]
2025-10-01T14:14:39.647555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256563939845290:12247]
2025-10-01T14:14:39.647557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256563939845290:12247]
2025-10-01T14:14:39.647570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:39.647584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:39.647589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:39.647592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:39.647595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:39.647598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:39.647601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:39.647633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256563939845290:12247]
2025-10-01T14:14:39.647640Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:39.647657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:39.647672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.647678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.647712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:39.647719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:39.647723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:39.647725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:39.647735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:39.647743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:39.647757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:39.647953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.647960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.647982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:39.648095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2317 partition: 0 MaxSeqNo: 45 sessionId: src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0
2025-10-01T14:14:39.648462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|97d790d0-42a57489-835be946-70eae2f8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:39.651397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0] Write session: try to update token
2025-10-01T14:14:39.651415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:39.669209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2317 sessionId: src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:39.672102Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:39.672133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:39.672136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:39.672140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:39.672152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256563939845290:12247]
2025-10-01T14:14:39.672158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256563939845290:12247]
2025-10-01T14:14:39.672164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256563939845290:12247]
2025-10-01T14:14:39.672521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:39.672224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:39.672234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:39.672243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:39.672244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.672247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:39.672248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:39.672435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:39.722198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256566316748337:7265]
2025-10-01T14:14:39.722560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2316, pipe: [1:7556256566316748337:7265]
2025-10-01T14:14:39.834383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:39.835085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.835112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.835154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316748337:7265], now have 1 active actors on pipe
2025-10-01T14:14:39.835347Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:39.835877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256566316748337:7265]
2025-10-01T14:14:39.835921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:39.836003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2317 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0
2025-10-01T14:14:39.836200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2317 sessionId: src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0 is DEAD
2025-10-01T14:14:39.836383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:39.836681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:39.836692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0] Write session will restart in 0.006716s
2025-10-01T14:14:39.836720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0] Write session: Do CDS request
2025-10-01T14:14:39.836726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:39.844883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:39.844984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:39.845005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2318
2025-10-01T14:14:39.845159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:39.845186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:39.845190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:39.845195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:39.845652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2318 sessionId:  describe result for acl check
2025-10-01T14:14:39.845696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:39.845700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:39.845701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:39.845707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256566316748394:6897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:39.846306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256566316748394:6897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:39.849142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256566316748394:6897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:39.855270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256566316748394:6897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:39.855165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:39.855295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256566316748394:6897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:39.855299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256566316748394:6897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:39.855310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:39.858504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:39.858870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:39.858897Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:39.858938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:39.859142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:39.859205Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256563939845480:12260]
2025-10-01T14:14:39.859837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:39.860235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:39.860294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:39.860634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:39.860705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.860706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.860708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.860709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.860710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.860712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.860713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.860714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.860716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.860717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.860718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.860720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.860721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.860722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.860729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.860739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.860743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.860747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.860751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.860755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.860759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.860763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.860767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.860771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.860775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.860779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.860783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.860787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.860795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.860804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:39.860810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.860815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:39.860820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.860825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:39.860829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.860835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:39.860839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.860846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:39.860850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.860855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:39.860860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.860866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:39.860870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.860875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:39.860880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.860885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:39.860889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.860895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.860899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.860905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.860910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.860915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.860922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.860927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:39.860932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.860937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:39.860973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:39.865305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:39.866262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:39.866285Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:39.866288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:39.866292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:39.866302Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2317 [2:7556256563939845480:12260]
2025-10-01T14:14:39.866320Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:39.866340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:39.866344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:39.866348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:39.866352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:39.866390Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:39.866403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:39.866410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:39.866474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.866481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.866483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.866487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:39.866489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:39.866571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:39.866578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.866592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:39.866609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:39.866626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:39.866646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316748509:6897], now have 1 active actors on pipe
2025-10-01T14:14:39.866655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316748357:2446], now have 1 active actors on pipe
2025-10-01T14:14:39.866663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256563939845474:12260]
2025-10-01T14:14:39.866668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256563939845474:12260]
2025-10-01T14:14:39.866670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256563939845474:12260]
2025-10-01T14:14:39.866687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:39.866704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:39.866724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:39.866729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:39.866770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256563939845474:12260]
2025-10-01T14:14:39.866773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:39.866818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:39.866823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:39.866826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:39.866835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:39.866951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2317
2025-10-01T14:14:39.867013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2317
2025-10-01T14:14:39.867261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.867272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.867298Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:39.867306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:39.867311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:39.867313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:39.867323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:39.867334Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:39.867351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:39.867600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.867610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.867624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:39.867740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2318 partition: 0 MaxSeqNo: 45 sessionId: src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0
2025-10-01T14:14:39.868141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e2e17f2-1bc840e9-74928b13-169b236c_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:39.871148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0] Write session: try to update token
2025-10-01T14:14:39.871171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:39.892822Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2318 sessionId: src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:39.895926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:39.896866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:39.896906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:39.900184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:39.900229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:39.900232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:39.900235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:39.900237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:39.900247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256563939845474:12260]
2025-10-01T14:14:39.900252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256563939845474:12260]
2025-10-01T14:14:39.900256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256563939845474:12260]
2025-10-01T14:14:39.900302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:39.900313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:39.900315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:39.900337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:39.900354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:39.900358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:39.900464Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:39.900792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:39.936040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256566316748521:7265]
2025-10-01T14:14:39.936497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2317, pipe: [1:7556256566316748521:7265]
2025-10-01T14:14:40.041884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:40.050590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.050616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.050780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.050842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.050905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.050960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.051263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.051274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.051341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.051400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.051467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.051526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.051569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.051575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.051634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.051688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.051753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.051811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.051866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.051872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.051928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.051981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.052036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.052089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.052127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.052133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.052187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.052245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.052305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.052370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.052412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.052417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.052491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.052577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.052646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.052713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.052761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.052765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.052842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.052908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.052979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.053045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.053101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.053109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.053185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.053249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.053324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.053393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.053439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.053443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.053517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.053585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.053653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.053722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.053775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.053780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.053861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.053923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.053988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.054057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.054105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.054110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.054177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256566316748521:7265], now have 1 active actors on pipe
2025-10-01T14:14:40.054597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:40.054599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256566316748521:7265]
2025-10-01T14:14:40.054623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:40.054663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2318 reason: error at write: Disconnected sessionId: src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0
2025-10-01T14:14:40.054887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2318 sessionId: src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0 is DEAD
2025-10-01T14:14:40.054929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:40.055023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:40.055032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0] Write session will restart in 0.005252s
2025-10-01T14:14:40.055041Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:40.055070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0] Write session: Do CDS request
2025-10-01T14:14:40.055076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:40.061925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:40.062009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:40.062033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2319
2025-10-01T14:14:40.062589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:40.062638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:40.062650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:40.062655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:40.063162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2319 sessionId:  describe result for acl check
2025-10-01T14:14:40.063202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:40.063207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:40.063209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:40.063215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256570611715837:6874] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:40.063828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256570611715837:6874] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:40.068465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256570611715837:6874] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:40.070611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:40.073908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:40.074185Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:40.074196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:40.074209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:40.074271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:40.074321Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256568234812929:12262]
2025-10-01T14:14:40.074317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256570611715837:6874] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:40.074339Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256570611715837:6874] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:40.074343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256570611715837:6874] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:40.074352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:40.074984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:40.075334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:40.075388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:40.075720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:40.075787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.075793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.075795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.075797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.075798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.075799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.075801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.075802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.075803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.075805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.075807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.075808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.075809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.075810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.075817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.075828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.075832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.075836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.075840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.075844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.075848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.075851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.075855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.075860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.075863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.075867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.075871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.075875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.075883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.075890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.075897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.075902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.075908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.075913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.075917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.075922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.075928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.075934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.075939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.075944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.075954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.075960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.075965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.075970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.075976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.075985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.075990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.076000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.076005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.076015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.076020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.076030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.076035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.076044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.076048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.076053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.076095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:40.080821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:40.081605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:40.081625Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:40.081629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:40.081633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:40.081643Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2318 [2:7556256568234812929:12262]
2025-10-01T14:14:40.081663Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:40.081683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:40.081692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:40.081696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:40.081698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:40.081716Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:40.081726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:40.081737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:40.081812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.081819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.081820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.081824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:40.081827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:40.081901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:40.081914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.081927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.081939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.081953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:40.081971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256568234812924:12262]
2025-10-01T14:14:40.081979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256568234812924:12262]
2025-10-01T14:14:40.081982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256568234812924:12262]
2025-10-01T14:14:40.081993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:40.082003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:40.082012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611715973:6874], now have 1 active actors on pipe
2025-10-01T14:14:40.082013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:40.082016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:40.082018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:40.082031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:40.082034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:40.082045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611715822:2446], now have 1 active actors on pipe
2025-10-01T14:14:40.082085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256568234812924:12262]
2025-10-01T14:14:40.082096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:40.082102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:40.082116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2318
2025-10-01T14:14:40.082124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2318
2025-10-01T14:14:40.082210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.082227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.082284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f23cdb09-b85fa733-107a813-4074adcb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:40.082297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:40.082307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:40.082309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:40.082321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:40.082337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:40.082358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:40.082596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.082603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.082617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:40.083042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2319 partition: 0 MaxSeqNo: 45 sessionId: src_id|f23cdb09-b85fa733-107a813-4074adcb_0
2025-10-01T14:14:40.083542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fadfa269-ed528bb4-67181d9d-8e13e5c9_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f23cdb09-b85fa733-107a813-4074adcb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:40.087641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f23cdb09-b85fa733-107a813-4074adcb_0] Write session: try to update token
2025-10-01T14:14:40.087664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f23cdb09-b85fa733-107a813-4074adcb_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:40.095602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:40.095625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:40.095636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256568234812924:12262]
2025-10-01T14:14:40.095685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:40.095687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:40.095874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:40.096028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:40.096185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:40.096341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:40.096570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:40.096616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:40.109029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2319 sessionId: src_id|f23cdb09-b85fa733-107a813-4074adcb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:40.112001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:40.112291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.112324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.112362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:40.112490Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:40.120056Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:40.120081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:40.120085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:40.120088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:40.120100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256568234812924:12262]
2025-10-01T14:14:40.120106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256568234812924:12262]
2025-10-01T14:14:40.120112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256568234812924:12262]
2025-10-01T14:14:40.120172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:40.120174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:40.120181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:40.120182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.120184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:40.120185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:40.120362Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:40.154688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256570611715985:7265]
2025-10-01T14:14:40.155104Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2318, pipe: [1:7556256570611715985:7265]
2025-10-01T14:14:40.260630Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:40.273378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.273420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.273658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.273746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.273836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.273926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.274007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.274017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.274112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.274204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.274297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.274522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.274605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.274609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.274712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.274804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.274897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.275004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.275085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.275089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.275194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.275292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.275392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.275487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.275564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.275567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.275679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.275773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.275869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.275961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.276036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.276040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.276142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.276234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.276326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.276417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.276624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.276633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.278443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256570611715985:7265]
2025-10-01T14:14:40.278443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:40.278449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:40.278483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2319 reason: error at write: Disconnected sessionId: src_id|f23cdb09-b85fa733-107a813-4074adcb_0
2025-10-01T14:14:40.278493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:40.278796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23cdb09-b85fa733-107a813-4074adcb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:40.278804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23cdb09-b85fa733-107a813-4074adcb_0] Write session will restart in 0.006008s
2025-10-01T14:14:40.278828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23cdb09-b85fa733-107a813-4074adcb_0] Write session: Do CDS request
2025-10-01T14:14:40.278836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23cdb09-b85fa733-107a813-4074adcb_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:40.278685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2319 sessionId: src_id|f23cdb09-b85fa733-107a813-4074adcb_0 is DEAD
2025-10-01T14:14:40.276714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.276783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.276856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.276917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.276976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.276979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.277039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.277089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.277149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.277215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.277255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.277258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.277328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.277382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.277441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.277502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.277541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.277543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.277603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.277654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.277711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.277765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.277810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.277812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.277883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611715985:7265], now have 1 active actors on pipe
2025-10-01T14:14:40.279006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:40.286934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f23cdb09-b85fa733-107a813-4074adcb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:40.290500Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:40.290525Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2320
2025-10-01T14:14:40.290701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:40.290755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:40.290767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:40.290774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:40.291742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2320 sessionId:  describe result for acl check
2025-10-01T14:14:40.291794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:40.291801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:40.291803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:40.291809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256570611715996:6865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:40.292414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256570611715996:6865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:40.297927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256570611715996:6865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:40.303580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256570611715996:6865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:40.303603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256570611715996:6865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:40.303608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256570611715996:6865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:40.303618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:40.328921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:40.329588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:40.329793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:40.329797Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:40.329807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:40.329850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:40.329895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256568234813089:12265]
2025-10-01T14:14:40.330560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:40.331071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:40.331119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:40.331493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:40.331549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.331551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.331552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.331554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.331555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.331556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.331558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.331559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.331560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.331562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.331563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.331565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.331566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.331568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.331574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.331584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.331588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.331593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.331597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.331601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.331605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.331609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.331613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.331617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.331621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.331625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.331629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.331632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.331640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.331647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.331655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.331661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.331665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.331670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.331675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.331681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.331687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.331693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.331697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.331702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.331708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.331713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.331717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.331722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.331727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.331731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.331736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.331743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.331748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.331753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.331758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.331763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.331768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.331774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.331778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.331783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.331827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:40.339656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:40.340331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:40.340337Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:40.340341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:40.340345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:40.340353Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2319 [2:7556256568234813089:12265]
2025-10-01T14:14:40.340374Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:40.340393Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:40.340397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:40.340401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:40.340404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:40.340420Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:40.340425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:40.340432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:40.340505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.340508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.340511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.340515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:40.340518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:40.340614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:40.340618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.340631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.340642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.340659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:40.340676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256568234813084:12265]
2025-10-01T14:14:40.340679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256568234813084:12265]
2025-10-01T14:14:40.340682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256568234813084:12265]
2025-10-01T14:14:40.340692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:40.340705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:40.340723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:40.340728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:40.340770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256568234813084:12265]
2025-10-01T14:14:40.340773Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:40.341279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:40.341282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:40.341285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:40.341292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:40.341428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611715987:2446], now have 1 active actors on pipe
2025-10-01T14:14:40.341552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611716036:6865], now have 1 active actors on pipe
2025-10-01T14:14:40.342050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2319
2025-10-01T14:14:40.342095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2319
2025-10-01T14:14:40.343083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2320 partition: 0 MaxSeqNo: 45 sessionId: src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0
2025-10-01T14:14:40.342348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.342361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.342401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:40.342410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:40.342416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:40.342419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:40.342431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:40.342445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:40.342461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:40.342929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.342934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.342951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:40.343473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f23cdb09-b85fa733-107a813-4074adcb_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:40.346775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0] Write session: try to update token
2025-10-01T14:14:40.346792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:40.368488Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:40.368511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:40.368525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256568234813084:12265]
2025-10-01T14:14:40.368588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:40.368817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:40.369019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:40.369211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:40.369401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:40.369700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:40.369742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:40.369825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:40.374090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2320 sessionId: src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:40.377333Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:40.378351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.378395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.378433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:40.378512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256570611716151:7265]
2025-10-01T14:14:40.378777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:40.383020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611716151:7265], now have 1 active actors on pipe
2025-10-01T14:14:40.383438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2319, pipe: [1:7556256570611716151:7265]
2025-10-01T14:14:40.426100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:40.426129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:40.426131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:40.426134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:40.426146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256568234813084:12265]
2025-10-01T14:14:40.426154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256568234813084:12265]
2025-10-01T14:14:40.426160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256568234813084:12265]
2025-10-01T14:14:40.426213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:40.426222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.426230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:40.426429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:40.426442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:40.426446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:40.426548Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:40.584415Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:40.600680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.600718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.600970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.601059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.601157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.601252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.601322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.601328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.601427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.601518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.601609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.601688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.601751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.601755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.601839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.601922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.602030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.602134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.602200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.602206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.602314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.602440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.602525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.602619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.602918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.602923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.603042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.603149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.603258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.603382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.603456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.603460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.603589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.603708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.603797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.603881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.603944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.603947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.604037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.604112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.604192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.604273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.604332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.604336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.604416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.604516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.604629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.604730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.604793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.604797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.604907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.605011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.605099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.605179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.605240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.605243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.605336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:40.605407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:40.605481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:40.605564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:40.605628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:40.605631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:40.606971Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:40.610688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:40.610752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2320 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0
2025-10-01T14:14:40.610911Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:40.610948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2320 sessionId: src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0 is DEAD
2025-10-01T14:14:40.610960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256570611716151:7265]
2025-10-01T14:14:40.611903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:40.611918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0] Write session will restart in 0.005970s
2025-10-01T14:14:40.611942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0] Write session: Do CDS request
2025-10-01T14:14:40.611952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:40.622850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:40.623746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:40.623769Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2321
2025-10-01T14:14:40.624050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:40.624082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:40.624089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:40.624094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:40.624602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2321 sessionId:  describe result for acl check
2025-10-01T14:14:40.624630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:40.624632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:40.624634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:40.624640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256570611716196:6820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:40.625200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256570611716196:6820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:40.627602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256570611716196:6820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:40.638981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256570611716196:6820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:40.639016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256570611716196:6820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:40.639021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256570611716196:6820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:40.639032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:40.670483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:40.672725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:40.672991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:40.672996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:40.673008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:40.673063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:40.673111Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256568234813266:12270]
2025-10-01T14:14:40.673781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:40.678713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:40.678805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:40.679210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:40.679283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.679285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.679286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.679287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.679289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.679290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.679292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.679293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.679294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.679296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.679297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.679299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.679300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.679301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.679309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.679319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.679324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.679327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.679330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.679334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.679337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.679341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.679344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.679349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.679352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.679355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.679358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.679361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.679374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.679382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.679388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.679393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.679398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.679403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.679407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.679414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.679419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.679424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.679428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.679434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.679438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.679443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.679447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.679451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.679460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.679465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.679469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.679473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.679478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.679482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.679486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.679492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.679496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.679500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.679505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.679510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.679545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:40.687219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:40.688575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:40.688584Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:40.688588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:40.688594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:40.688602Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2320 [2:7556256568234813266:12270]
2025-10-01T14:14:40.688622Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:40.688645Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:40.688650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:40.688655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:40.688659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:40.688677Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:40.688684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:40.688693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:40.688778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.688782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.688784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.688788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:40.688791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:40.688907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:40.688911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.688932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.688945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.688966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:40.688993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256568234813260:12270]
2025-10-01T14:14:40.688997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256568234813260:12270]
2025-10-01T14:14:40.688999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256568234813260:12270]
2025-10-01T14:14:40.689023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:40.689046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:40.689060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:40.689063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:40.689105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256568234813260:12270]
2025-10-01T14:14:40.689107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:40.689481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:40.689497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:40.689499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:40.689509Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:40.689935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611716233:6820], now have 1 active actors on pipe
2025-10-01T14:14:40.689946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611716189:2446], now have 1 active actors on pipe
2025-10-01T14:14:40.690337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2320
2025-10-01T14:14:40.690434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2320
2025-10-01T14:14:40.694598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.694622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.694664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|148eaa10-c64a177d-1562cbf-1b350e93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:40.694770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:40.694779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:40.694783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:40.694800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:40.694818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:40.694839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:40.698434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.698460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.698501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:40.703373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60bf587a-982567d7-ff4a9cb3-79a57219_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|148eaa10-c64a177d-1562cbf-1b350e93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:40.702724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2321 partition: 0 MaxSeqNo: 45 sessionId: src_id|148eaa10-c64a177d-1562cbf-1b350e93_0
2025-10-01T14:14:40.706900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|148eaa10-c64a177d-1562cbf-1b350e93_0] Write session: try to update token
2025-10-01T14:14:40.706924Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|148eaa10-c64a177d-1562cbf-1b350e93_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:40.714484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256570611716349:7265]
2025-10-01T14:14:40.718607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611716349:7265], now have 1 active actors on pipe
2025-10-01T14:14:40.721420Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:40.721446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:40.721449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:40.721452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:40.721462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256568234813260:12270]
2025-10-01T14:14:40.721467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256568234813260:12270]
2025-10-01T14:14:40.721472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256568234813260:12270]
2025-10-01T14:14:40.721528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:40.721535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.721537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:40.721730Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:40.722467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2320, pipe: [1:7556256570611716349:7265]
2025-10-01T14:14:40.722520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:40.722533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:40.722541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:40.740980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2321 sessionId: src_id|148eaa10-c64a177d-1562cbf-1b350e93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:40.747919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:40.947546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:40.948547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:40.948576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:40.949254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:40.950796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:40.950893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2321 reason: status is not ok: tablet will be restarted right now sessionId: src_id|148eaa10-c64a177d-1562cbf-1b350e93_0
2025-10-01T14:14:40.951115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2321 sessionId: src_id|148eaa10-c64a177d-1562cbf-1b350e93_0 is DEAD
2025-10-01T14:14:40.951266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:40.951310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256570611716349:7265]
2025-10-01T14:14:40.951585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148eaa10-c64a177d-1562cbf-1b350e93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:40.951597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148eaa10-c64a177d-1562cbf-1b350e93_0] Write session will restart in 0.008578s
2025-10-01T14:14:40.951623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148eaa10-c64a177d-1562cbf-1b350e93_0] Write session: Do CDS request
2025-10-01T14:14:40.951629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148eaa10-c64a177d-1562cbf-1b350e93_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:40.962063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|148eaa10-c64a177d-1562cbf-1b350e93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:40.962989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:40.963008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2322
2025-10-01T14:14:40.963881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:40.963928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:40.963934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:40.963938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:40.964660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2322 sessionId:  describe result for acl check
2025-10-01T14:14:40.964691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:40.964695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:40.964696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:40.964700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256570611716379:6808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:40.965136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256570611716379:6808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:40.971556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256570611716379:6808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:40.979144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256570611716379:6808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:40.979172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256570611716379:6808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:40.979176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256570611716379:6808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:40.979185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:40.987859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:40.990879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:40.991152Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:40.991168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:40.991183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:40.991243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:40.991293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256568234813456:12283]
2025-10-01T14:14:40.991941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:40.992481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:40.992547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:40.992849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:40.992887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.992888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.992889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.992890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.992891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.992892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.992893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.992895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.992896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.992897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.992898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.992899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.992900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.992902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.992908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.992919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.992924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.992929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.992933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.992938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.992941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.992947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.992953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.992959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.992964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.992970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.992975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.992979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.992990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.993001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:40.993008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.993015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:40.993022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.993030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:40.993036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.993042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:40.993048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.993053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:40.993058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.993064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:40.993069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.993074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:40.993079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.993084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:40.993090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.993096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:40.993100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.993108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.993113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.993119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.993123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.993128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.993132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.993139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:40.993143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.993148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:40.993192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:40.998352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:40.999142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:40.999163Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:40.999166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:40.999170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:40.999178Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2321 [2:7556256568234813456:12283]
2025-10-01T14:14:40.999289Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:40.999314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:40.999322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:40.999327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:40.999330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:40.999349Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:40.999359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:40.999366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:40.999436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.999443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.999446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.999449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:40.999451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:40.999529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:40.999538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:40.999550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:40.999560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:40.999579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:40.999602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256568234813451:12283]
2025-10-01T14:14:40.999610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256568234813451:12283]
2025-10-01T14:14:40.999612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256568234813451:12283]
2025-10-01T14:14:40.999625Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:40.999633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:40.999636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:40.999639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:40.999644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:40.999659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:40.999667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:40.999678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611716371:2446], now have 1 active actors on pipe
2025-10-01T14:14:40.999686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256570611716427:6808], now have 1 active actors on pipe
2025-10-01T14:14:40.999731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256568234813451:12283]
2025-10-01T14:14:40.999744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:40.999760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:41.000072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2321
2025-10-01T14:14:41.000126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2321
2025-10-01T14:14:41.000367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.000381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.000412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:41.000427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:41.000432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:41.000435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:41.000447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:41.000468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:41.000490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:41.000709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.000712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.000727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:41.000807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2322 partition: 0 MaxSeqNo: 45 sessionId: src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0
2025-10-01T14:14:41.001250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|148eaa10-c64a177d-1562cbf-1b350e93_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:41.004592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0] Write session: try to update token
2025-10-01T14:14:41.004611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:41.026092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:41.026117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:41.026120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:41.026122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:41.026135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256568234813451:12283]
2025-10-01T14:14:41.026139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256568234813451:12283]
2025-10-01T14:14:41.026143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256568234813451:12283]
2025-10-01T14:14:41.026197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:41.026205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.026208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:41.026754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:41.026767Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:41.026771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:41.026843Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:41.045525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2322 sessionId: src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:41.048505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:41.052331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256574906683830:7265]
2025-10-01T14:14:41.059209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2321, pipe: [1:7556256574906683830:7265]
2025-10-01T14:14:41.209185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:41.209794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.209813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.209840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906683830:7265], now have 1 active actors on pipe
2025-10-01T14:14:41.210088Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:41.210424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:41.210446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:41.210450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:41.210483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256574906683830:7265]
2025-10-01T14:14:41.210511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2322 reason: error at write: Disconnected sessionId: src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0
2025-10-01T14:14:41.210863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:41.210888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0] Write session will restart in 0.007474s
2025-10-01T14:14:41.210706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2322 sessionId: src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0 is DEAD
2025-10-01T14:14:41.210916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0] Write session: Do CDS request
2025-10-01T14:14:41.210923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:41.220384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:41.220413Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:41.220432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2323
2025-10-01T14:14:41.220664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:41.220713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:41.220725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:41.220730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:41.221214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2323 sessionId:  describe result for acl check
2025-10-01T14:14:41.221260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:41.221267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:41.221269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:41.221276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256574906683846:6797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:41.221907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256574906683846:6797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:41.226609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256574906683846:6797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:41.230444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256574906683846:6797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:41.230464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256574906683846:6797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:41.230468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256574906683846:6797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:41.230478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:41.231814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:41.235106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:41.235387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:41.235401Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:41.235417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:41.235479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:41.235531Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256572529780913:12285]
2025-10-01T14:14:41.236216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:41.236647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:41.236704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:41.237074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:41.237133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.237134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.237136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.237137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.237138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.237139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.237141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.237142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.237143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.237144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.237146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.237147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.237148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.237149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.237155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.237164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.237168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.237172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.237175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.237178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.237182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.237185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.237189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.237193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.237197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.237200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.237203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.237206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.237215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.237223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.237229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.237234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.237239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.237244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.237248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.237253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.237258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.237263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.237267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.237272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.237276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.237280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.237287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.237291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.237296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.237301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.237305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.237310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.237315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.237319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.237323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.237328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.237332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.237338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.237342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.237347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.237383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:41.245800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:41.246631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:41.246647Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:41.246650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:41.246653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:41.246663Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2322 [2:7556256572529780913:12285]
2025-10-01T14:14:41.246685Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:41.246711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:41.246720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:41.246725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:41.246728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:41.246751Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:41.246761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:41.246771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:41.246829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.246836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.246839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.246842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:41.246845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:41.246921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:41.246927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.246941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.246957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.246978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:41.247001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256572529780907:12285]
2025-10-01T14:14:41.247007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256572529780907:12285]
2025-10-01T14:14:41.247009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256572529780907:12285]
2025-10-01T14:14:41.247021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:41.247041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:41.247060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:41.247066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:41.247115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256572529780907:12285]
2025-10-01T14:14:41.247121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:41.247244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:41.247250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:41.247252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:41.247258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:41.247337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906683986:6797], now have 1 active actors on pipe
2025-10-01T14:14:41.247353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906683833:2446], now have 1 active actors on pipe
2025-10-01T14:14:41.247679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.247694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.247442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2322
2025-10-01T14:14:41.247447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2322
2025-10-01T14:14:41.247729Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:41.247746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:41.247752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:41.247755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:41.247767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:41.247781Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:41.247809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:41.248611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.248624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.248650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:41.248775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2323 partition: 0 MaxSeqNo: 45 sessionId: src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0
2025-10-01T14:14:41.249290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3b31479e-b3bc2315-a1ac9fc0-c057dfee_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:41.252855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0] Write session: try to update token
2025-10-01T14:14:41.252875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:41.274799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:41.274822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:41.274825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:41.274827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:41.274838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256572529780907:12285]
2025-10-01T14:14:41.274843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256572529780907:12285]
2025-10-01T14:14:41.274848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256572529780907:12285]
2025-10-01T14:14:41.274903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:41.274911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.274913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:41.275074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:41.275848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2323 sessionId: src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:41.278467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:41.278487Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:41.278492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:41.278533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:41.310748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256574906683998:7265]
2025-10-01T14:14:41.311480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2322, pipe: [1:7556256574906683998:7265]
2025-10-01T14:14:41.430284Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:41.430712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.430732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.430784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906683998:7265], now have 1 active actors on pipe
2025-10-01T14:14:41.431702Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:41.432006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:41.432024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:41.432088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2323 reason: error at write: Disconnected sessionId: src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0
2025-10-01T14:14:41.432328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2323 sessionId: src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0 is DEAD
2025-10-01T14:14:41.432475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256574906683998:7265]
2025-10-01T14:14:41.432497Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:41.432765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:41.432777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0] Write session will restart in 0.005089s
2025-10-01T14:14:41.432810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0] Write session: Do CDS request
2025-10-01T14:14:41.432817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:41.438966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:41.439320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:41.439339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2324
2025-10-01T14:14:41.439503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:41.439543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:41.439549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:41.439553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:41.440247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2324 sessionId:  describe result for acl check
2025-10-01T14:14:41.440280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:41.440281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:41.440282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:41.440286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256574906684010:6787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:41.440809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256574906684010:6787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:41.443954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256574906684010:6787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:41.448729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256574906684010:6787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:41.448748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256574906684010:6787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:41.448762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256574906684010:6787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:41.448772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:41.459795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:41.462822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:41.463056Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:41.463059Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:41.463068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:41.463118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:41.463159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256572529781072:9206]
2025-10-01T14:14:41.463610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:41.463910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:41.463944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:41.464161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:41.464204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.464205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.464206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.464208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.464209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.464210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.464211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.464213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.464214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.464215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.464217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.464218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.464219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.464220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.464226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.464232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.464235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.464238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.464240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.464242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.464244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.464247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.464249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.464251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.464253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.464255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.464257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.464259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.464265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.464269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.464274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.464277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.464280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.464284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.464287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.464290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.464293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.464295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.464298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.464301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.464304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.464307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.464311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.464314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.464317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.464320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.464323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.464326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.464329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.464332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.464334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.464337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.464342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.464346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.464350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.464353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.464376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:41.471846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:41.472553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:41.472580Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:41.472582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:41.472587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:41.472593Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2323 [2:7556256572529781072:9206]
2025-10-01T14:14:41.472606Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:41.472621Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:41.472627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:41.472630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:41.472632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:41.472647Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:41.472655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:41.472660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:41.472713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.472718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.472720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.472722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:41.472724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:41.472785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:41.472794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.472806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.472816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.472832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:41.472852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906684070:6787], now have 1 active actors on pipe
2025-10-01T14:14:41.472855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906684001:2446], now have 1 active actors on pipe
2025-10-01T14:14:41.472863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256572529781066:9206]
2025-10-01T14:14:41.472866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256572529781066:9206]
2025-10-01T14:14:41.472868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256572529781066:9206]
2025-10-01T14:14:41.472882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:41.472897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:41.472913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:41.472917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:41.472963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256572529781066:9206]
2025-10-01T14:14:41.472966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:41.472999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:41.473001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:41.473003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:41.473009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:41.473172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2323
2025-10-01T14:14:41.473224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2323
2025-10-01T14:14:41.473295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.473305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.473336Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:41.473344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:41.473348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:41.473351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:41.473361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:41.473373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:41.473394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:41.475015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.475035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.475085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:41.475974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2324 partition: 0 MaxSeqNo: 45 sessionId: src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0
2025-10-01T14:14:41.477249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf205a2-f8edaef4-b65ec325-a8281d20_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:41.483512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0] Write session: try to update token
2025-10-01T14:14:41.483538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:41.497649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:41.497676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:41.497680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:41.497683Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:41.497695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256572529781066:9206]
2025-10-01T14:14:41.497700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256572529781066:9206]
2025-10-01T14:14:41.497706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256572529781066:9206]
2025-10-01T14:14:41.497770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:41.497781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.497784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:41.498004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:41.498286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:41.498293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:41.498296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:41.526538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2324 sessionId: src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:41.529942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:41.534435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256574906684171:7265]
2025-10-01T14:14:41.534888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2323, pipe: [1:7556256574906684171:7265]
2025-10-01T14:14:41.654959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:41.655433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.655449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.655473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906684171:7265], now have 1 active actors on pipe
2025-10-01T14:14:41.655797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:41.656299Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256574906684171:7265]
2025-10-01T14:14:41.656343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:41.656417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2324 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0
2025-10-01T14:14:41.656666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2324 sessionId: src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0 is DEAD
2025-10-01T14:14:41.656793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:41.657843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:41.657858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0] Write session will restart in 0.007164s
2025-10-01T14:14:41.657891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0] Write session: Do CDS request
2025-10-01T14:14:41.657898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:41.666355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:41.666703Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:41.666719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2325
2025-10-01T14:14:41.666871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:41.666897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:41.666902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:41.666905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:41.667304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2325 sessionId:  describe result for acl check
2025-10-01T14:14:41.667332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:41.667335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:41.667337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:41.667342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256574906684297:6754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:41.667876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256574906684297:6754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:41.678258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:41.680907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256574906684297:6754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:41.682920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:41.683166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:41.683176Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:41.683187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:41.683242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:41.683298Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256572529781252:9191]
2025-10-01T14:14:41.683927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:41.684533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:41.684606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:41.684936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:41.685000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.685001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.685002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.685003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.685004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.685006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.685007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.685008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.685009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.685010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.685012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.685013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.685014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.685015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.685022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.685030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.685033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.685037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.685040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.685044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.685048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.685052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.685055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.685059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.685063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.685066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.685069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.685072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.685080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.685088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:41.685094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.685099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:41.685103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.685107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:41.685111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.685117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:41.685121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.685125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:41.685129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.685134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:41.685139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.685144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:41.685148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.685153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:41.685157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.685163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:41.685167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.685171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.685176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.685182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.685185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.685190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.685195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.685199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:41.685203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.685208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:41.685242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:41.687673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256574906684297:6754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:41.687691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256574906684297:6754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:41.687694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256574906684297:6754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:41.687704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:41.704236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:41.705273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:41.705279Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:41.705283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:41.705287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:41.705294Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2324 [2:7556256572529781252:9191]
2025-10-01T14:14:41.705311Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:41.705332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:41.705335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:41.705339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:41.705341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:41.705360Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:41.705366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:41.705373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:41.705437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.705438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.705440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.705444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:41.705446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:41.705524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:41.705526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.705538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:41.705547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:41.705560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:41.705576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256572529781247:9191]
2025-10-01T14:14:41.705580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256572529781247:9191]
2025-10-01T14:14:41.705582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256572529781247:9191]
2025-10-01T14:14:41.705593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:41.705600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:41.705602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:41.705604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:41.705605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:41.705618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:41.705621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:41.705631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906684362:6754], now have 1 active actors on pipe
2025-10-01T14:14:41.705635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906684206:2446], now have 1 active actors on pipe
2025-10-01T14:14:41.705677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256572529781247:9191]
2025-10-01T14:14:41.705686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:41.705697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:41.705837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2324
2025-10-01T14:14:41.705864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2324
2025-10-01T14:14:41.707041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.707057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.707091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:41.707101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:41.707108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:41.707111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:41.707124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:41.707139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:41.707159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:41.708451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.708465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.708490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:41.709246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2325 partition: 0 MaxSeqNo: 45 sessionId: src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0
2025-10-01T14:14:41.709708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37f76f6d-52f7f1d2-a488ccef-e5f45e6d_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:41.712994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0] Write session: try to update token
2025-10-01T14:14:41.713014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:41.728042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:41.728062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:41.728065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:41.728067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:41.728078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256572529781247:9191]
2025-10-01T14:14:41.728082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256572529781247:9191]
2025-10-01T14:14:41.728086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256572529781247:9191]
2025-10-01T14:14:41.728135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:41.728142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:41.728145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:41.728303Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:41.734454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:41.734476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:41.734481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:41.736380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2325 sessionId: src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:41.739231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:41.762445Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256574906684370:7265]
2025-10-01T14:14:41.762899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2324, pipe: [1:7556256574906684370:7265]
2025-10-01T14:14:41.976621Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:41.977294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:41.977305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:41.977351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906684370:7265], now have 1 active actors on pipe
2025-10-01T14:14:41.980021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:41.980033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0] Write session will restart in 0.007959s
2025-10-01T14:14:41.980056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0] Write session: Do CDS request
2025-10-01T14:14:41.980062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:41.979091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:41.979144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256574906684370:7265]
2025-10-01T14:14:41.979161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:41.979164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:41.979221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2325 reason: error at write: Disconnected sessionId: src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0
2025-10-01T14:14:41.979403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2325 sessionId: src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0 is DEAD
2025-10-01T14:14:41.978846Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:41.990854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:41.991148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:41.991167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2326
2025-10-01T14:14:41.993150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:41.993215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:41.993221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:41.993225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:41.993816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2326 sessionId:  describe result for acl check
2025-10-01T14:14:41.993844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:41.993845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:41.993846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:41.993853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256574906684408:6747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:41.994271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256574906684408:6747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:42.001857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256574906684408:6747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:42.022060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256574906684408:6747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:42.022080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256574906684408:6747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:42.022084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256574906684408:6747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:42.022093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:42.022659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:42.029556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:42.029795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:42.029805Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:42.029818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:42.029876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:42.029919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256576824748728:9193]
2025-10-01T14:14:42.030523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:42.031586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:42.031629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:42.031869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:42.031898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.031899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.031900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.031901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.031901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.031902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.031903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.031904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.031905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.031906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.031907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.031908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.031909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.031909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.031914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.031920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.031922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.031925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.031927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.031929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.031931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.031934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.031936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.031938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.031941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.031943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.031945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.031947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.031954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.031959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.031964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.031967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.031970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.031973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.031975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.031979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.031981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.031985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.031987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.031991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.031994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.031997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.032000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.032003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.032006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.032009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.032011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.032015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.032019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.032022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.032024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.032027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.032032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.032036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.032040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.032045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.032078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:42.038593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2325
2025-10-01T14:14:42.038633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2325
2025-10-01T14:14:42.040406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2326 partition: 0 MaxSeqNo: 45 sessionId: src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0
2025-10-01T14:14:42.040804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8e96f61-bfc01920-d07fb077-6d13ca32_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:42.037061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:42.037856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:42.037860Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:42.037864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:42.037868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:42.037876Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2325 [2:7556256576824748728:9193]
2025-10-01T14:14:42.037891Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:42.037910Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:42.037913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:42.037917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:42.037919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:42.037937Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:42.037943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:42.037949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:42.038006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.038007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.038009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.038012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:42.038015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:42.038090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:42.038093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.038104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.038113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.038128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:42.038145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256576824748721:9193]
2025-10-01T14:14:42.038147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256576824748721:9193]
2025-10-01T14:14:42.038149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256576824748721:9193]
2025-10-01T14:14:42.038162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:42.038178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:42.038191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:42.038194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:42.038225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256576824748721:9193]
2025-10-01T14:14:42.038227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:42.038290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:42.038292Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:42.038295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:42.038299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:42.039020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201651840:6747], now have 1 active actors on pipe
2025-10-01T14:14:42.039025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256574906684391:2446], now have 1 active actors on pipe
2025-10-01T14:14:42.039040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.039045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.039074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:42.039084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:42.039089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:42.039092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:42.039105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:42.039117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:42.039134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:42.040248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.040252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.040274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:42.044003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0] Write session: try to update token
2025-10-01T14:14:42.044021Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:42.068796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:42.068829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:42.068835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:42.068838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:42.068854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256576824748721:9193]
2025-10-01T14:14:42.068861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256576824748721:9193]
2025-10-01T14:14:42.068870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256576824748721:9193]
2025-10-01T14:14:42.068943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:42.068968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.068979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:42.069204Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:42.069510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2326 sessionId: src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:42.070436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:42.070449Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:42.070453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:42.072841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:42.079717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256579201651853:7265]
2025-10-01T14:14:42.080803Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2325, pipe: [1:7556256579201651853:7265]
2025-10-01T14:14:42.230941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:42.231426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.231439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.231464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201651853:7265], now have 1 active actors on pipe
2025-10-01T14:14:42.232017Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:42.232180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:42.232196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:42.232252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2326 reason: error at write: Disconnected sessionId: src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0
2025-10-01T14:14:42.232462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2326 sessionId: src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0 is DEAD
2025-10-01T14:14:42.232603Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:42.232636Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256579201651853:7265]
2025-10-01T14:14:42.234477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:42.234493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0] Write session will restart in 0.007050s
2025-10-01T14:14:42.234543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0] Write session: Do CDS request
2025-10-01T14:14:42.234549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:42.244987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:42.245388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:42.245409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2327
2025-10-01T14:14:42.245528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:42.245555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:42.245561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:42.245565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:42.246206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2327 sessionId:  describe result for acl check
2025-10-01T14:14:42.246245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:42.246247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:42.246249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:42.246254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256579201651874:6708] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:42.246807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256579201651874:6708] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:42.251176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256579201651874:6708] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:42.260954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256579201651874:6708] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:42.260976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256579201651874:6708] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:42.260979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256579201651874:6708] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:42.260989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:42.268950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:42.272245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:42.272457Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:42.272461Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:42.272470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:42.272505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:42.272539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256576824748908:9178]
2025-10-01T14:14:42.272982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:42.273349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:42.273380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:42.273585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:42.273618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.273619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.273620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.273620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.273621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.273622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.273623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.273624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.273624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.273626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.273626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.273627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.273628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.273628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.273632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.273639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.273641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.273644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.273646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.273649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.273651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.273653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.273656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.273659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.273662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.273665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.273669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.273672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.273679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.273686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.273692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.273698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.273702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.273708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.273713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.273718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.273723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.273728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.273732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.273735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.273738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.273741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.273743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.273746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.273750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.273753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.273755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.273758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.273761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.273764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.273766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.273770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.273772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.273775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.273779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.273783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.273806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:42.278523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:42.279249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:42.279255Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:42.279258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:42.279262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:42.279271Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2326 [2:7556256576824748908:9178]
2025-10-01T14:14:42.279298Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:42.279319Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:42.279322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:42.279326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:42.279328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:42.279346Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:42.279352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:42.279360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:42.279428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.279430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.279432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.279436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:42.279438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:42.279584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:42.279588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.279600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.279610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.279625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:42.279644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256576824748902:9178]
2025-10-01T14:14:42.279647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256576824748902:9178]
2025-10-01T14:14:42.279650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256576824748902:9178]
2025-10-01T14:14:42.279667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:42.279683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:42.279697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:42.279701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:42.279744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256576824748902:9178]
2025-10-01T14:14:42.279747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:42.279971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:42.279979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:42.279982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:42.279988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:42.280854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2326
2025-10-01T14:14:42.280896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2326
2025-10-01T14:14:42.281934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201651980:6708], now have 1 active actors on pipe
2025-10-01T14:14:42.281952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201651859:2446], now have 1 active actors on pipe
2025-10-01T14:14:42.281973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.281980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.282017Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b627449a-acbe73c5-267e721a-816bfea7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:42.282028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:42.282035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:42.282038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:42.282050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:42.282066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:42.282087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:42.282752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.282762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.282780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:42.282939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2327 partition: 0 MaxSeqNo: 45 sessionId: src_id|b627449a-acbe73c5-267e721a-816bfea7_0
2025-10-01T14:14:42.284579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d16490e-2bf6f24e-58db9de8-893f3bd3_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|b627449a-acbe73c5-267e721a-816bfea7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:42.287793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b627449a-acbe73c5-267e721a-816bfea7_0] Write session: try to update token
2025-10-01T14:14:42.287816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b627449a-acbe73c5-267e721a-816bfea7_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:42.316708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2327 sessionId: src_id|b627449a-acbe73c5-267e721a-816bfea7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:42.319406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:42.320251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.320271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.320309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:42.322041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:42.329224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:42.329248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:42.329251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:42.329254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:42.329263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256576824748902:9178]
2025-10-01T14:14:42.329268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256576824748902:9178]
2025-10-01T14:14:42.329272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256576824748902:9178]
2025-10-01T14:14:42.329325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:42.329327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:42.329332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:42.329336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:42.329336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.329338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:42.329487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:42.332014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256579201652030:7265]
2025-10-01T14:14:42.332507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2326, pipe: [1:7556256579201652030:7265]
2025-10-01T14:14:42.491760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:42.492014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201652030:7265], now have 1 active actors on pipe
2025-10-01T14:14:42.501007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.501038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.501220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.501292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.501362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.501436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.501489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.501495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.501572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.501635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.501698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.501766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.501809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.501812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.501881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.501937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.501998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.502063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.502105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.502113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.502180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.502239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.502300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.502356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.502426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.502430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.502498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.502553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.502617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.502678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.502720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.502723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.502815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.502885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.502960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.503046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.503107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.503111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.503194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.503270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.503351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.503428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.503480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.503483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.503570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.503643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.503720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.503814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.503869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.503880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.503973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.504055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.504135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.504219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.504278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.504285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.504371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:42.504444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:42.504520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:42.504613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:42.504663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:42.504666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:42.505850Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:42.506161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:42.506216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2327 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b627449a-acbe73c5-267e721a-816bfea7_0
2025-10-01T14:14:42.506451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256579201652030:7265]
2025-10-01T14:14:42.506471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:42.506471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2327 sessionId: src_id|b627449a-acbe73c5-267e721a-816bfea7_0 is DEAD
2025-10-01T14:14:42.506839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b627449a-acbe73c5-267e721a-816bfea7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:42.506849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b627449a-acbe73c5-267e721a-816bfea7_0] Write session will restart in 0.006357s
2025-10-01T14:14:42.506874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b627449a-acbe73c5-267e721a-816bfea7_0] Write session: Do CDS request
2025-10-01T14:14:42.506881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b627449a-acbe73c5-267e721a-816bfea7_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:42.518875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b627449a-acbe73c5-267e721a-816bfea7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:42.519215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:42.519232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2328
2025-10-01T14:14:42.519398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:42.519427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:42.519432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:42.519436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:42.520523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2328 sessionId:  describe result for acl check
2025-10-01T14:14:42.520554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:42.520556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:42.520573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:42.520581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256579201652099:6695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:42.521125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256579201652099:6695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:42.525188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256579201652099:6695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:42.534327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256579201652099:6695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:42.534346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256579201652099:6695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:42.534349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256579201652099:6695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:42.534359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:42.534142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:42.548381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:42.548707Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:42.548712Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:42.548726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:42.548795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:42.548831Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256576824749085:9174]
2025-10-01T14:14:42.549447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:42.549813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:42.549861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:42.550185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:42.550251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.550258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.550259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.550261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.550262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.550263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.550265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.550266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.550268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.550269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.550270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.550271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.550273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.550274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.550279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.550289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.550292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.550297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.550300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.550304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.550308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.550311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.550315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.550318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.550322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.550325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.550329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.550333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.550341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.550349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.550355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.550362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.550427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.550438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.550443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.550448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.550454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.550459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.550464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.550469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.550473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.550479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.550483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.550489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.550498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.550503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.550508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.550514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.550518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.550523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.550528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.550533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.550538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.550543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.550547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.550553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.550602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:42.555009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:42.555738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:42.555743Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:42.555746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:42.555750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:42.555759Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2327 [2:7556256576824749085:9174]
2025-10-01T14:14:42.555776Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:42.555795Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:42.555798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:42.555801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:42.555803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:42.555820Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:42.555826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:42.555832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:42.555889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.555891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.555893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.555896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:42.555898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:42.555968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:42.555970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.555980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.555990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.556003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:42.556021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256576824749079:9174]
2025-10-01T14:14:42.556023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256576824749079:9174]
2025-10-01T14:14:42.556025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256576824749079:9174]
2025-10-01T14:14:42.556042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:42.556056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:42.556069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:42.556071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:42.556103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256576824749079:9174]
2025-10-01T14:14:42.556105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:42.556319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:42.556327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:42.556329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:42.556334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:42.556628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201652195:6695], now have 1 active actors on pipe
2025-10-01T14:14:42.556637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201652035:2446], now have 1 active actors on pipe
2025-10-01T14:14:42.556949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.556959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.556991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:42.556999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:42.557005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:42.557008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:42.557019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:42.557031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:42.557048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:42.558681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.558692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.558719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:42.556801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2327
2025-10-01T14:14:42.556833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2327
2025-10-01T14:14:42.561435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2328 partition: 0 MaxSeqNo: 45 sessionId: src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0
2025-10-01T14:14:42.562123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b627449a-acbe73c5-267e721a-816bfea7_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:42.565156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0] Write session: try to update token
2025-10-01T14:14:42.565174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:42.587384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:42.587415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:42.587421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:42.587423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:42.587437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256576824749079:9174]
2025-10-01T14:14:42.587444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256576824749079:9174]
2025-10-01T14:14:42.587452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256576824749079:9174]
2025-10-01T14:14:42.587518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:42.587540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.587551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:42.587804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:42.587931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:42.587947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:42.587951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:42.595827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2328 sessionId: src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:42.598886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:42.606061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256579201652213:7265]
2025-10-01T14:14:42.606566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2327, pipe: [1:7556256579201652213:7265]
2025-10-01T14:14:42.742192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:42.742821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.742834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.742852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201652213:7265], now have 1 active actors on pipe
2025-10-01T14:14:42.743182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:42.744518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:42.744622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2328 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0
2025-10-01T14:14:42.744844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2328 sessionId: src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0 is DEAD
2025-10-01T14:14:42.745039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256579201652213:7265]
2025-10-01T14:14:42.745645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:42.746567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:42.746576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0] Write session will restart in 0.008640s
2025-10-01T14:14:42.746598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0] Write session: Do CDS request
2025-10-01T14:14:42.746603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:42.758804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:42.759361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:42.759380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2329
2025-10-01T14:14:42.759501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:42.759533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:42.759542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:42.759546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:42.759988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2329 sessionId:  describe result for acl check
2025-10-01T14:14:42.760018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:42.760024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:42.760026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:42.760031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256579201652256:6663] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:42.760530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256579201652256:6663] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:42.763509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256579201652256:6663] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:42.767661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256579201652256:6663] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:42.767682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256579201652256:6663] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:42.767685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256579201652256:6663] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:42.767693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:42.769016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:42.771350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:42.771593Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:42.771606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:42.771621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:42.771677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:42.771717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256576824749258:9162]
2025-10-01T14:14:42.772308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:42.772679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:42.772732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:42.773058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:42.773125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.773131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.773132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.773134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.773135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.773136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.773138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.773139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.773140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.773141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.773143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.773144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.773145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.773146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.773151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.773161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.773164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.773168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.773170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.773175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.773179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.773182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.773186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.773191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.773194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.773197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.773201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.773205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.773212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.773220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.773227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.773232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.773242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.773247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.773251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.773260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.773266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.773274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.773278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.773283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.773288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.773292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.773301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.773306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.773311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.773321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.773325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.773334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.773339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.773349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.773354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.773359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.773367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.773372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.773380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.773385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.773426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:42.778140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:42.778880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:42.778898Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:42.778902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:42.778906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:42.778912Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2328 [2:7556256576824749258:9162]
2025-10-01T14:14:42.778932Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:42.778950Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:42.778961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:42.778965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:42.778967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:42.778985Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:42.778991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:42.778998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:42.779073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.779081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.779084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.779087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:42.779090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:42.779170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:42.779183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.779195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.779204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.779218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:42.779236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256576824749253:9162]
2025-10-01T14:14:42.779238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256576824749253:9162]
2025-10-01T14:14:42.779240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256576824749253:9162]
2025-10-01T14:14:42.779256Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:42.779271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:42.779285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:42.779288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:42.779323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:42.779328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256576824749253:9162]
2025-10-01T14:14:42.779331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:42.779338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:42.779340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:42.779341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201652395:6663], now have 1 active actors on pipe
2025-10-01T14:14:42.779348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:42.779440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201652242:2446], now have 1 active actors on pipe
2025-10-01T14:14:42.779616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2328
2025-10-01T14:14:42.779624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2328
2025-10-01T14:14:42.779772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.779786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.779820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:42.779834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:42.779844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:42.779846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:42.779857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:42.779871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:42.779897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:42.782157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.782174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.782216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:42.783533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2329 partition: 0 MaxSeqNo: 45 sessionId: src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0
2025-10-01T14:14:42.783935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3210da5-51218d7f-20ec9d4e-8a6ab6f1_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:42.787092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0] Write session: try to update token
2025-10-01T14:14:42.787114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:42.801880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:42.801905Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:42.801908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:42.801910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:42.801920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256576824749253:9162]
2025-10-01T14:14:42.801926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256576824749253:9162]
2025-10-01T14:14:42.801929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256576824749253:9162]
2025-10-01T14:14:42.801978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:42.801979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:42.801985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:42.801989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:42.801992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.801994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:42.802137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:42.806137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2329 sessionId: src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:42.808987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:42.845237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256579201652410:7265]
2025-10-01T14:14:42.845498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2328, pipe: [1:7556256579201652410:7265]
2025-10-01T14:14:42.962998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:42.963557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:42.963572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:42.963617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201652410:7265], now have 1 active actors on pipe
2025-10-01T14:14:42.964068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:42.965448Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:42.965460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0] Write session will restart in 0.006305s
2025-10-01T14:14:42.965483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0] Write session: Do CDS request
2025-10-01T14:14:42.965492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:42.964861Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:42.964923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256579201652410:7265]
2025-10-01T14:14:42.964942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:42.965005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2329 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0
2025-10-01T14:14:42.965167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2329 sessionId: src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0 is DEAD
2025-10-01T14:14:42.973509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:42.973897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:42.973913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2330
2025-10-01T14:14:42.974085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:42.974113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:42.974119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:42.974123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:42.978265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2330 sessionId:  describe result for acl check
2025-10-01T14:14:42.978304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:42.978305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:42.978307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:42.978312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256579201652453:6641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:42.978830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256579201652453:6641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:42.986195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256579201652453:6641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:42.994516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:42.996772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:42.997022Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:42.997026Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:42.997038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:42.997089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:42.997145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256576824749424:9155]
2025-10-01T14:14:42.997840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:42.998834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256579201652453:6641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:42.998856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256579201652453:6641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:42.998861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256579201652453:6641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:42.998870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:42.999443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:42.999505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:42.999847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:42.999905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.999914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.999915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.999917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.999919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.999920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.999922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.999923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.999924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.999925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.999926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.999927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.999929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.999930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.999935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:42.999946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:42.999950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:42.999954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:42.999957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:42.999960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:42.999964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:42.999969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:42.999972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:42.999976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:42.999980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:42.999983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:42.999987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:42.999990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:42.999998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.000005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.000011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.000016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.000020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.000025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.000029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.000034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.000038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.000043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.000047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.000052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.000056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.000060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.000065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.000070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.000074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.000079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.000083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.000087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.000092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.000099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.000102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.000107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.000110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.000116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.000120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.000124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.000162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:43.009203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:43.010264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:43.010279Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:43.010282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:43.010285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:43.010293Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2329 [2:7556256576824749424:9155]
2025-10-01T14:14:43.010310Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:43.010329Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:43.010333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:43.010338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:43.010340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:43.010360Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:43.010366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:43.010391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:43.010461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.010470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.010472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.010475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:43.010478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:43.010551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:43.010554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.010567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.010578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.010598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:43.010616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256576824749419:9155]
2025-10-01T14:14:43.010619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256576824749419:9155]
2025-10-01T14:14:43.010621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256576824749419:9155]
2025-10-01T14:14:43.010635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:43.010648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:43.010663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:43.010666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:43.010709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256576824749419:9155]
2025-10-01T14:14:43.010711Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:43.013666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:43.013681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:43.013685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:43.013696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:43.014012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201652593:6641], now have 1 active actors on pipe
2025-10-01T14:14:43.014019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256579201652427:2446], now have 1 active actors on pipe
2025-10-01T14:14:43.014432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2329
2025-10-01T14:14:43.014469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2329
2025-10-01T14:14:43.014711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.014727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.014761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|290b91e8-9045aa4-49c2116f-f14be479_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:43.014773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:43.014780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:43.014783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:43.014796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:43.014816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:43.014842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:43.015178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.015185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.015199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:43.015411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2330 partition: 0 MaxSeqNo: 45 sessionId: src_id|290b91e8-9045aa4-49c2116f-f14be479_0
2025-10-01T14:14:43.015875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6a113e8-26c30966-9fded65c-da00b4a8_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|290b91e8-9045aa4-49c2116f-f14be479_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:43.019293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|290b91e8-9045aa4-49c2116f-f14be479_0] Write session: try to update token
2025-10-01T14:14:43.019313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|290b91e8-9045aa4-49c2116f-f14be479_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:43.046520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:43.046544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:43.046546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:43.046548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:43.046565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256576824749419:9155]
2025-10-01T14:14:43.046570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256576824749419:9155]
2025-10-01T14:14:43.046575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256576824749419:9155]
2025-10-01T14:14:43.046628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:43.046635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.046641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:43.046812Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:43.049497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:43.049511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:43.049515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:43.048651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2330 sessionId: src_id|290b91e8-9045aa4-49c2116f-f14be479_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:43.051455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:43.068569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256583496619899:7265]
2025-10-01T14:14:43.069319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2329, pipe: [1:7556256583496619899:7265]
2025-10-01T14:14:43.216083Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:43.216513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.216523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.216547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496619899:7265], now have 1 active actors on pipe
2025-10-01T14:14:43.217090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:43.217766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:43.217783Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:43.217837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2330 reason: error at write: Disconnected sessionId: src_id|290b91e8-9045aa4-49c2116f-f14be479_0
2025-10-01T14:14:43.218067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2330 sessionId: src_id|290b91e8-9045aa4-49c2116f-f14be479_0 is DEAD
2025-10-01T14:14:43.218216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256583496619899:7265]
2025-10-01T14:14:43.218791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:43.225910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290b91e8-9045aa4-49c2116f-f14be479_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:43.225922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290b91e8-9045aa4-49c2116f-f14be479_0] Write session will restart in 0.008704s
2025-10-01T14:14:43.225954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290b91e8-9045aa4-49c2116f-f14be479_0] Write session: Do CDS request
2025-10-01T14:14:43.225960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290b91e8-9045aa4-49c2116f-f14be479_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:43.236333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|290b91e8-9045aa4-49c2116f-f14be479_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:43.236472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:43.236490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2331
2025-10-01T14:14:43.236697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:43.236745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:43.236750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:43.236755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:43.237284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2331 sessionId:  describe result for acl check
2025-10-01T14:14:43.237312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:43.237316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:43.237318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:43.237322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256583496619938:6644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:43.237848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256583496619938:6644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:43.244919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256583496619938:6644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:43.251679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256583496619938:6644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:43.251699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256583496619938:6644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:43.251703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256583496619938:6644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:43.251713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:43.252669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:43.258822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:43.259097Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:43.259110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:43.259121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:43.259175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:43.259221Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256581119716918:9140]
2025-10-01T14:14:43.259846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:43.260278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:43.260323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:43.260648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:43.260707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.260713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.260714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.260715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.260716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.260717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.260718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.260719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.260721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.260722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.260723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.260725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.260726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.260727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.260732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.260741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.260745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.260749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.260752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.260756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.260759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.260763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.260767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.260771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.260774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.260778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.260782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.260785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.260793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.260799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.260805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.260810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.260815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.260820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.260824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.260829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.260834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.260840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.260844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.260849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.260855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.260860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.260871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.260876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.260885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.260890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.260894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.260899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.260908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.260913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.260917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.260926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.260930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.260936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.260940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.260945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.260982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:43.269305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:43.270250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:43.270266Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:43.270268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:43.270271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:43.270278Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2330 [2:7556256581119716918:9140]
2025-10-01T14:14:43.270295Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:43.270314Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:43.270318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:43.270322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:43.270325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:43.270343Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:43.270349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:43.270356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:43.270441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.270449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.270451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.270455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:43.270458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:43.270528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:43.270536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.270549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.270563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.270582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:43.270603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256581119716911:9140]
2025-10-01T14:14:43.270610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256581119716911:9140]
2025-10-01T14:14:43.270612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256581119716911:9140]
2025-10-01T14:14:43.270627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:43.270645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:43.270663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:43.270667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:43.270708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256581119716911:9140]
2025-10-01T14:14:43.270715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:43.270802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:43.270809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:43.270811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:43.270816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:43.271098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496619904:2446], now have 1 active actors on pipe
2025-10-01T14:14:43.271108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496620066:6644], now have 1 active actors on pipe
2025-10-01T14:14:43.273914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2330
2025-10-01T14:14:43.273978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2330
2025-10-01T14:14:43.274225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.274247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.274279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:43.274290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:43.274297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:43.274300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:43.274312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:43.274327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:43.274353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:43.274674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2331 partition: 0 MaxSeqNo: 45 sessionId: src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0
2025-10-01T14:14:43.274561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.274568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.274581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:43.275559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|290b91e8-9045aa4-49c2116f-f14be479_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:43.278947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0] Write session: try to update token
2025-10-01T14:14:43.278967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:43.307846Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2331 sessionId: src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:43.308040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:43.308063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:43.308066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:43.308068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:43.308079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256581119716911:9140]
2025-10-01T14:14:43.308083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256581119716911:9140]
2025-10-01T14:14:43.308088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256581119716911:9140]
2025-10-01T14:14:43.308143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:43.308156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.308158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:43.308305Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:43.310790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:43.310586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:43.310604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:43.310608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:43.324998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256583496620079:7265]
2025-10-01T14:14:43.325402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2330, pipe: [1:7556256583496620079:7265]
2025-10-01T14:14:43.485313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:43.485901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.485911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.485955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496620079:7265], now have 1 active actors on pipe
2025-10-01T14:14:43.486221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:43.486570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:43.486619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256583496620079:7265]
2025-10-01T14:14:43.486763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:43.486819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2331 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0
2025-10-01T14:14:43.486995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2331 sessionId: src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0 is DEAD
2025-10-01T14:14:43.487251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:43.487264Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0] Write session will restart in 0.006122s
2025-10-01T14:14:43.487292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0] Write session: Do CDS request
2025-10-01T14:14:43.487297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:43.496240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:43.496425Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:43.496442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2332
2025-10-01T14:14:43.496670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:43.496705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:43.496710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:43.496714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:43.497121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2332 sessionId:  describe result for acl check
2025-10-01T14:14:43.497160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:43.497162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:43.497163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:43.497169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256583496620095:6633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:43.497701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256583496620095:6633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:43.500842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256583496620095:6633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:43.504446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256583496620095:6633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:43.504463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256583496620095:6633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:43.504466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256583496620095:6633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:43.504474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:43.531399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:43.534530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:43.534785Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:43.534796Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:43.534807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:43.534865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:43.534903Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256581119717099:9131]
2025-10-01T14:14:43.535499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:43.535862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:43.535925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:43.536262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:43.536326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.536332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.536333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.536337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.536338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.536339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.536341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.536342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.536343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.536344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.536346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.536346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.536348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.536348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.536354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.536364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.536368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.536372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.536376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.536380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.536384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.536388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.536392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.536396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.536400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.536404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.536408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.536411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.536418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.536426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.536432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.536437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.536442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.536447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.536452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.536457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.536462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.536472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.536478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.536492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.536502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.536509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.536517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.536522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.536528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.536532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.536541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.536545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.536554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.536569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.536577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.536582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.536588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.536592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.536596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.536605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.536659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:43.542046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:43.543419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2331
2025-10-01T14:14:43.543467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2331
2025-10-01T14:14:43.542742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:43.542761Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:43.542764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:43.542768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:43.542775Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2331 [2:7556256581119717099:9131]
2025-10-01T14:14:43.542794Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:43.542814Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:43.542817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:43.542825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:43.542828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:43.542847Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:43.542853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:43.542859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:43.542920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.542922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.542924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.542927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:43.542929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:43.542996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:43.542998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.543009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.543021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.543038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:43.543055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256581119717094:9131]
2025-10-01T14:14:43.543058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256581119717094:9131]
2025-10-01T14:14:43.543060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256581119717094:9131]
2025-10-01T14:14:43.543075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:43.543090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:43.543107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:43.543110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:43.543130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:43.543134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:43.543139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:43.543148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256581119717094:9131]
2025-10-01T14:14:43.543153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:43.543238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:43.543310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496620133:6633], now have 1 active actors on pipe
2025-10-01T14:14:43.543317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496620082:2446], now have 1 active actors on pipe
2025-10-01T14:14:43.543704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.543718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.543748Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:43.543760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:43.543769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:43.543774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:43.543784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:43.543806Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:43.543824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:43.544024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.544049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.544075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:43.544499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2332 partition: 0 MaxSeqNo: 45 sessionId: src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0
2025-10-01T14:14:43.545010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a373481e-c99dd6da-9a43a60b-ac0b21b2_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:43.548125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0] Write session: try to update token
2025-10-01T14:14:43.548149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:43.570512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2332 sessionId: src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:43.573130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:43.573407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.573429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.573464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:43.578094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:43.576135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:43.576156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:43.576159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:43.576161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:43.576171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256581119717094:9131]
2025-10-01T14:14:43.576176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256581119717094:9131]
2025-10-01T14:14:43.576180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256581119717094:9131]
2025-10-01T14:14:43.576224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:43.576232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.576235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:43.576371Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:43.578532Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:43.578543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:43.578547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:43.586764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256583496620263:7265]
2025-10-01T14:14:43.590776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2331, pipe: [1:7556256583496620263:7265]
2025-10-01T14:14:43.734875Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:43.735367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496620263:7265], now have 1 active actors on pipe
2025-10-01T14:14:43.744165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.744200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.744379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.744443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.744504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.744586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.744631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.744636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.744713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.744776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.744838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.744908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.744950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.744954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.745027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.745088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.745165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.745227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.745267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.745270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.745333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.745395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.745452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.745510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.745548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.745551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.745616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.745672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.745727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.745784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.745827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.745830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.745922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.745994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.746069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.746148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.746218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.746221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.746301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.746393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.746468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.746545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.746597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.746615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.746694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.746762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.746833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.746910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.746959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.746962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.747048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.747121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.747191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.747262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.747312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.747315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.747398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:43.747467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:43.747538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:43.747613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:43.747664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:43.747666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:43.749209Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:43.750496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:43.750556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256583496620263:7265]
2025-10-01T14:14:43.750577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:43.750618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2332 reason: status is not ok: tablet will be restarted right now sessionId: src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0
2025-10-01T14:14:43.751110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:43.750810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2332 sessionId: src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0 is DEAD
2025-10-01T14:14:43.751120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0] Write session will restart in 0.006207s
2025-10-01T14:14:43.751147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0] Write session: Do CDS request
2025-10-01T14:14:43.751154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:43.758862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:43.758961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:43.758979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2333
2025-10-01T14:14:43.759170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:43.759197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:43.759203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:43.759207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:43.759720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2333 sessionId:  describe result for acl check
2025-10-01T14:14:43.759750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:43.759752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:43.759754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:43.759759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256583496620309:6582] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:43.760280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256583496620309:6582] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:43.764674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256583496620309:6582] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:43.769922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256583496620309:6582] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:43.769942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256583496620309:6582] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:43.769947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256583496620309:6582] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:43.769957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:43.785284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:43.790748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:43.791009Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:43.791021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:43.791034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:43.791086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:43.791126Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256581119717276:9119]
2025-10-01T14:14:43.791809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:43.792917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:43.792972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:43.793222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:43.793269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.793270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.793271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.793273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.793274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.793275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.793277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.793278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.793280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.793281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.793282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.793284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.793285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.793286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.793293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.793302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.793307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.793310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.793314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.793317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.793321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.793324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.793328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.793332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.793335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.793339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.793342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.793346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.793354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.793362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:43.793369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.793374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:43.793379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.793385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:43.793389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.793393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:43.793401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.793406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:43.793410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.793415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:43.793419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.793424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:43.793428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.793432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:43.793436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.793440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:43.793445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.793450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.793455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.793459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.793463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.793468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.793474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.793479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:43.793483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.793488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:43.793528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:43.797996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:43.798789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:43.798810Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:43.798814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:43.798818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:43.798826Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2332 [2:7556256581119717276:9119]
2025-10-01T14:14:43.798846Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:43.798867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:43.798874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:43.798879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:43.798881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:43.798900Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:43.798915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:43.798922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:43.798992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.798994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.798997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.799001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:43.799004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:43.799085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:43.799089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.799103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:43.799115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:43.799133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:43.799163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496620349:6582], now have 1 active actors on pipe
2025-10-01T14:14:43.799171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496620282:2446], now have 1 active actors on pipe
2025-10-01T14:14:43.799179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256581119717270:9119]
2025-10-01T14:14:43.799182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256581119717270:9119]
2025-10-01T14:14:43.799184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256581119717270:9119]
2025-10-01T14:14:43.799202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:43.799221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:43.799241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:43.799249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:43.799294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256581119717270:9119]
2025-10-01T14:14:43.799303Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:43.799348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:43.799351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:43.799353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:43.799358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:43.799530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.799544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.799576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:43.799591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:43.799601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:43.799604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:43.799618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:43.799633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:43.799659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:43.799858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.799869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.799892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:43.804077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b43960-b7b8dd63-3ae7cd4e-2cb0f360_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:43.799350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2332
2025-10-01T14:14:43.799396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2332
2025-10-01T14:14:43.800006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2333 partition: 0 MaxSeqNo: 45 sessionId: src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0
2025-10-01T14:14:43.807150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0] Write session: try to update token
2025-10-01T14:14:43.807166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:43.817731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-10-01T14:14:43.817748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:43.817757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7556256581119717270:9119]
2025-10-01T14:14:43.817798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:565: FormAnswer for 1 blobs
2025-10-01T14:14:43.817830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-10-01T14:14:43.817954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-10-01T14:14:43.818097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:43.818223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:43.818350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-10-01T14:14:43.818554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:491: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-10-01T14:14:43.818590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:994: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759327582097 queuesize 0 startOffset 0
2025-10-01T14:14:43.832402Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:43.832425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:43.832429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:43.832431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:43.832442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256581119717270:9119]
2025-10-01T14:14:43.832447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256581119717270:9119]
2025-10-01T14:14:43.832451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256581119717270:9119]
2025-10-01T14:14:43.832503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:43.832536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:43.832538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:43.832661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:43.832680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:43.832687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:43.832720Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:43.834447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2333 sessionId: src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:43.837314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:43.854449Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256583496620468:7265]
2025-10-01T14:14:43.858780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2332, pipe: [1:7556256583496620468:7265]
2025-10-01T14:14:43.988317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:43.988607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:43.988620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:43.988644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496620468:7265], now have 1 active actors on pipe
2025-10-01T14:14:43.988966Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:43.990634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:43.990644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0] Write session will restart in 0.006959s
2025-10-01T14:14:43.990665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0] Write session: Do CDS request
2025-10-01T14:14:43.990670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:43.990165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256583496620468:7265]
2025-10-01T14:14:43.990190Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:43.990219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:43.990283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2333 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0
2025-10-01T14:14:43.990496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2333 sessionId: src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0 is DEAD
2025-10-01T14:14:43.999048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:43.998934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:43.998951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2334
2025-10-01T14:14:43.999255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:43.999289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:43.999295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:43.999298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:43.999669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2334 sessionId:  describe result for acl check
2025-10-01T14:14:43.999693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:43.999695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:43.999696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:43.999700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256583496620502:6560] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:44.000225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256583496620502:6560] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:44.002174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256583496620502:6560] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:44.004608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256583496620502:6560] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:44.004622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256583496620502:6560] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:44.004626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256583496620502:6560] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:44.004634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:44.009752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:44.014689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:44.014916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:44.014929Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:44.014940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:44.014991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:44.015032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256585414684743:9120]
2025-10-01T14:14:44.015648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:44.015955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:44.016020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:44.016355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:44.016419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.016427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.016428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.016429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.016430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.016431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.016432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.016433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.016435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.016436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.016438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.016439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.016441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.016442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.016448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.016459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.016463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.016467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.016470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.016474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.016477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.016481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.016485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.016490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.016494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.016498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.016502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.016505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.016512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.016520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.016527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.016538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.016543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.016553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.016575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.016580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.016590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.016596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.016604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.016610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.016619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.016625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.016633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.016638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.016643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.016652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.016657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.016663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.016669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.016678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.016682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.016691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.016695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.016700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.016707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.016712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.016754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:44.020374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:44.021031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:44.021052Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:44.021055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:44.021059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:44.021065Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2333 [2:7556256585414684743:9120]
2025-10-01T14:14:44.021084Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:44.021104Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:44.021112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.021116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.021119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.021137Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:44.021147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:44.021154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:44.021209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.021218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.021220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.021224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:44.021226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:44.021296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:44.021307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.021319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.021330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.021350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:44.021373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791587845:6560], now have 1 active actors on pipe
2025-10-01T14:14:44.021381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256583496620489:2446], now have 1 active actors on pipe
2025-10-01T14:14:44.021389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256585414684738:9120]
2025-10-01T14:14:44.021391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256585414684738:9120]
2025-10-01T14:14:44.021394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256585414684738:9120]
2025-10-01T14:14:44.021407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:44.021398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2333
2025-10-01T14:14:44.021425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:44.021439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:44.021445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:44.021449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:44.021455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:44.021457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:44.021460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2333
2025-10-01T14:14:44.021487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256585414684738:9120]
2025-10-01T14:14:44.021499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:44.021511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:44.021519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.021523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.021574Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:44.021587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.021591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.021593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:44.021602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.021616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:44.021638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.021780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.021788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.021804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.021877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2334 partition: 0 MaxSeqNo: 45 sessionId: src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0
2025-10-01T14:14:44.022190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae4679c5-c2e1a7d2-ccd1d6a6-21d2ed00_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:44.024781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0] Write session: try to update token
2025-10-01T14:14:44.024798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:44.037834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2334 sessionId: src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:44.045958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:44.047743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.047772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.047794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:44.047797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:44.047800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:44.047803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:44.047813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256585414684738:9120]
2025-10-01T14:14:44.047817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256585414684738:9120]
2025-10-01T14:14:44.047822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256585414684738:9120]
2025-10-01T14:14:44.047886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:44.047899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.047902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:44.048047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:44.049397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:44.049412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:44.049416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:44.090431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256587791587959:7265]
2025-10-01T14:14:44.094510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2333, pipe: [1:7556256587791587959:7265]
2025-10-01T14:14:44.209028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:44.209135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:44.209138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:44.209207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2334 reason: error at write: Disconnected sessionId: src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0
2025-10-01T14:14:44.209359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2334 sessionId: src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0 is DEAD
2025-10-01T14:14:44.209483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256587791587959:7265]
2025-10-01T14:14:44.209496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:44.209817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:44.209826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0] Write session will restart in 0.009839s
2025-10-01T14:14:44.209851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0] Write session: Do CDS request
2025-10-01T14:14:44.209856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:44.207813Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:44.208110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:44.208164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791587959:7265], now have 1 active actors on pipe
2025-10-01T14:14:44.222893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:44.222973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:44.222991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2335
2025-10-01T14:14:44.223807Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:44.223843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:44.223848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:44.223852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:44.224221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2335 sessionId:  describe result for acl check
2025-10-01T14:14:44.224245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:44.224246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:44.224249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:44.224254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256587791587985:6534] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:44.224756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256587791587985:6534] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:44.227034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256587791587985:6534] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:44.230307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256587791587985:6534] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:44.230322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256587791587985:6534] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:44.230326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256587791587985:6534] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:44.230333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:44.239803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:44.240834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:44.241038Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:44.241042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:44.241053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:44.241096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:44.241144Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256585414684944:9097]
2025-10-01T14:14:44.241681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:44.242029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:44.242075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:44.242545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:44.242613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.242614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.242615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.242617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.242618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.242619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.242621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.242622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.242622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.242623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.242625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.242626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.242627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.242628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.242633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.242641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.242645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.242648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.242652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.242655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.242658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.242661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.242664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.242668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.242671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.242674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.242677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.242681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.242688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.242695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.242700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.242705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.242708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.242713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.242717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.242722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.242728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.242732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.242736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.242741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.242745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.242749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.242754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.242758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.242761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.242765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.242769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.242773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.242777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.242781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.242786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.242789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.242793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.242798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.242801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.242806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.242837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:44.247554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:44.248933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2334
2025-10-01T14:14:44.248983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2334
2025-10-01T14:14:44.248417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:44.248433Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:44.248436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:44.248440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:44.248446Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2334 [2:7556256585414684944:9097]
2025-10-01T14:14:44.248463Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:44.248482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:44.248486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.248490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.248492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.248510Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:44.248516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:44.248522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:44.248600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.248602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.248603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.248606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:44.248609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:44.248676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:44.248678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.248689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.248698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.248712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:44.248729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256585414684939:9097]
2025-10-01T14:14:44.248731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256585414684939:9097]
2025-10-01T14:14:44.248733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256585414684939:9097]
2025-10-01T14:14:44.248742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:44.248757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:44.248764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:44.248768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:44.248770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:44.248771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:44.248774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:44.248785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791587967:2446], now have 1 active actors on pipe
2025-10-01T14:14:44.248821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791588106:6534], now have 1 active actors on pipe
2025-10-01T14:14:44.248824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256585414684939:9097]
2025-10-01T14:14:44.248832Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:44.249108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:44.249282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.249287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.249313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:44.249320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.249324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.249327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:44.249337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.249347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:44.249362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.253028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.253059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.253095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.253267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2335 partition: 0 MaxSeqNo: 45 sessionId: src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0
2025-10-01T14:14:44.255157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|721f6f84-d2b77e28-a5c9c540-13c3b16a_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:44.262442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0] Write session: try to update token
2025-10-01T14:14:44.262466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:44.289220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:44.289244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:44.289247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:44.289249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:44.289259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256585414684939:9097]
2025-10-01T14:14:44.289264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256585414684939:9097]
2025-10-01T14:14:44.289268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256585414684939:9097]
2025-10-01T14:14:44.289321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:44.289329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.289331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:44.289832Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:44.290424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:44.290430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:44.290438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:44.300955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2335 sessionId: src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:44.304229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:44.309529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256587791588258:7265]
2025-10-01T14:14:44.310017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2334, pipe: [1:7556256587791588258:7265]
2025-10-01T14:14:44.443730Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:44.444055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.444063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.444084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791588258:7265], now have 1 active actors on pipe
2025-10-01T14:14:44.444382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256587791588258:7265]
2025-10-01T14:14:44.444407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:44.444433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:44.444436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:44.444481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2335 reason: error at write: Disconnected sessionId: src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0
2025-10-01T14:14:44.444790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:44.444799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0] Write session will restart in 0.008196s
2025-10-01T14:14:44.444820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0] Write session: Do CDS request
2025-10-01T14:14:44.444825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:44.444395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:44.444643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2335 sessionId: src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0 is DEAD
2025-10-01T14:14:44.454841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:44.455172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:44.455188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2336
2025-10-01T14:14:44.458487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:44.458538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:44.458544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:44.458548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:44.458911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2336 sessionId:  describe result for acl check
2025-10-01T14:14:44.458936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:44.458937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:44.458938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:44.458945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256587791588483:6524] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:44.459452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256587791588483:6524] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:44.462715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256587791588483:6524] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:44.466104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256587791588483:6524] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:44.466124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256587791588483:6524] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:44.466129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256587791588483:6524] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:44.466138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:44.462964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:44.463652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:44.463816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:44.463820Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:44.463828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:44.463861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:44.463888Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256585414685114:9089]
2025-10-01T14:14:44.464342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:44.464647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:44.464682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:44.464939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:44.464993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.464994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.464996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.464997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.464998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.464999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.465000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.465002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.465003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.465004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.465005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.465006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.465008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.465009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.465014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.465025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.465029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.465033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.465038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.465042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.465045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.465048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.465052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.465056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.465059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.465062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.465065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.465068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.465075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.465082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.465088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.465093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.465098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.465102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.465106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.465112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.465115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.465120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.465124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.465129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.465133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.465138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.465141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.465146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.465152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.465157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.465160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.465165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.465169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.465173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.465179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.465184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.465188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.465192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.465196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.465201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.465236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:44.476062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:44.477179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:44.477197Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:44.477200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:44.477204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:44.477211Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2335 [2:7556256585414685114:9089]
2025-10-01T14:14:44.477230Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:44.477250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:44.477253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.477257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.477260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.477277Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:44.477283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:44.477291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:44.477355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.477357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.477360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.477363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:44.477366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:44.477478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:44.477481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.477497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.477510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.477529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:44.477548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256585414685109:9089]
2025-10-01T14:14:44.477550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256585414685109:9089]
2025-10-01T14:14:44.477552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256585414685109:9089]
2025-10-01T14:14:44.477570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:44.477585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:44.477602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:44.477605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:44.477648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256585414685109:9089]
2025-10-01T14:14:44.477650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:44.477672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:44.477677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:44.477680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:44.477691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:44.477987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791588261:2446], now have 1 active actors on pipe
2025-10-01T14:14:44.477999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791588548:6524], now have 1 active actors on pipe
2025-10-01T14:14:44.478686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2335
2025-10-01T14:14:44.478730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2335
2025-10-01T14:14:44.479038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.479054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.479084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:44.479094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.479098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.479102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:44.479114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.479127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:44.479150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.479496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.479506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.479523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.480317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ac6aaf9-fe8b3d95-98051fe4-83dd64a0_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:44.479891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2336 partition: 0 MaxSeqNo: 45 sessionId: src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0
2025-10-01T14:14:44.483163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0] Write session: try to update token
2025-10-01T14:14:44.483179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:44.503106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2336 sessionId: src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:44.505675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:44.505926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.505953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.505993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:44.506090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:44.511040Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:44.511060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:44.511063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:44.511065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:44.511075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256585414685109:9089]
2025-10-01T14:14:44.511079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256585414685109:9089]
2025-10-01T14:14:44.511083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256585414685109:9089]
2025-10-01T14:14:44.511113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:44.511118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:44.511121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:44.511139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:44.511146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.511149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:44.511380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:44.544544Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256587791588560:7265]
2025-10-01T14:14:44.548443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2335, pipe: [1:7556256587791588560:7265]
2025-10-01T14:14:44.673151Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:44.682155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.682185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.686784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:44.686851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256587791588560:7265]
2025-10-01T14:14:44.686871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:44.686876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:44.686902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2336 reason: error at write: Disconnected sessionId: src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0
2025-10-01T14:14:44.687086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2336 sessionId: src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0 is DEAD
2025-10-01T14:14:44.687803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:44.687811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0] Write session will restart in 0.007945s
2025-10-01T14:14:44.687830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0] Write session: Do CDS request
2025-10-01T14:14:44.687845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:44.682337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.682586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.682643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.682700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.683201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.683206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.683276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.683334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.683394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.683452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.683497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.683499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.683558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.683614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.683668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.683726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.683765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.683770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.683831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.683885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.683943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.683997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.684034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.684037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.684098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.684150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.684206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.684266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.684305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.684307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.684395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.684465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.684533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.684617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.684669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.684671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.684744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.684811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.684884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.684962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.685011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.685012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.685087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.685149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.685223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.685295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.685340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.685341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.685418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.685483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.685559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.685634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.685684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.685685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.685763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:44.685833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:44.685902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:44.685973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:44.686017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:44.686019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:44.686089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791588560:7265], now have 1 active actors on pipe
2025-10-01T14:14:44.686752Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:44.698111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:44.698582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:44.698600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2337
2025-10-01T14:14:44.698770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:44.698805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:44.698811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:44.698815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:44.702797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2337 sessionId:  describe result for acl check
2025-10-01T14:14:44.702839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:44.702840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:44.702842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:44.702849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256587791588602:6512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:44.703387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256587791588602:6512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:44.706754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256587791588602:6512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:44.711831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256587791588602:6512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:44.711852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256587791588602:6512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:44.711857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256587791588602:6512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:44.711867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:44.724237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:44.725633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:44.725847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:44.725850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:44.725860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:44.725920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:44.725952Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256585414685301:9085]
2025-10-01T14:14:44.726604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:44.726936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:44.726990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:44.727334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:44.727393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.727394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.727394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.727395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.727397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.727398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.727399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.727400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.727401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.727401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.727402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.727403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.727403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.727404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.727408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.727414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.727417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.727420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.727422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.727424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.727426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.727428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.727431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.727434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.727436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.727439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.727441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.727443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.727449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.727454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.727459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.727462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.727465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.727469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.727471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.727475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.727477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.727480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.727483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.727486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.727488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.727492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.727494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.727497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.727500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.727503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.727506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.727509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.727512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.727515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.727518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.727522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.727526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.727530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.727532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.727535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.727557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:44.734319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2336
2025-10-01T14:14:44.734350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2336
2025-10-01T14:14:44.732771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:44.733717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:44.733723Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:44.733726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:44.733730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:44.733737Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2336 [2:7556256585414685301:9085]
2025-10-01T14:14:44.733753Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:44.733771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:44.733774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.733778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.733781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.733799Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:44.733805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:44.733811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:44.733869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.733872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.733874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.733877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:44.733880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:44.733957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:44.733960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.733971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.733979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.733993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:44.734013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791588707:6512], now have 1 active actors on pipe
2025-10-01T14:14:44.734016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791588568:2446], now have 1 active actors on pipe
2025-10-01T14:14:44.734024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256585414685296:9085]
2025-10-01T14:14:44.734026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256585414685296:9085]
2025-10-01T14:14:44.734029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256585414685296:9085]
2025-10-01T14:14:44.734043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:44.734057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:44.734070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:44.734073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:44.734120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256585414685296:9085]
2025-10-01T14:14:44.734123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:44.734225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:44.734227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:44.734229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:44.734233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:44.740735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2337 partition: 0 MaxSeqNo: 45 sessionId: src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0
2025-10-01T14:14:44.738024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.738050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.738091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:44.738103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.738109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.738113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:44.738130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.738146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:44.738167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.740492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.740503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.740540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.743317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|375d18ce-fec9600e-f928b008-a2ec62c4_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:44.747063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0] Write session: try to update token
2025-10-01T14:14:44.747081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:44.759606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:44.759636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:44.759639Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:44.759641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:44.759656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256585414685296:9085]
2025-10-01T14:14:44.759663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256585414685296:9085]
2025-10-01T14:14:44.759670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256585414685296:9085]
2025-10-01T14:14:44.759735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:44.759758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.759768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:44.760011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:44.762619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:44.762637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:44.762641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:44.783483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2337 sessionId: src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:44.786843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:44.789114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256587791588875:7265]
2025-10-01T14:14:44.789536Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2336, pipe: [1:7556256587791588875:7265]
2025-10-01T14:14:44.936473Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:44.936932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.936941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.936968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791588875:7265], now have 1 active actors on pipe
2025-10-01T14:14:44.937226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:44.937545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:44.937666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256587791588875:7265]
2025-10-01T14:14:44.938421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:44.938432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0] Write session will restart in 0.009840s
2025-10-01T14:14:44.938460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0] Write session: Do CDS request
2025-10-01T14:14:44.938466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:44.937779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:44.937878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2337 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0
2025-10-01T14:14:44.938046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2337 sessionId: src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0 is DEAD
2025-10-01T14:14:44.949848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:44.950169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:44.950189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2338
2025-10-01T14:14:44.953948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:44.954007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:44.954013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:44.954018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:44.954794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2338 sessionId:  describe result for acl check
2025-10-01T14:14:44.954831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:44.954832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:44.954834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:44.954839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256587791588989:6467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:44.955354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256587791588989:6467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:44.970029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256587791588989:6467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:44.976043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256587791588989:6467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:44.976063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256587791588989:6467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:44.976067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256587791588989:6467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:44.976077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:44.982776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:44.983241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:44.983452Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:44.983457Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:44.983469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:44.983513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:44.983544Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256585414685483:9078]
2025-10-01T14:14:44.984128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:44.985423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:44.985473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:44.985810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:44.985868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.985869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.985871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.985872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.985873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.985874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.985876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.985877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.985878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.985880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.985881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.985882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.985884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.985885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.985892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.985903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.985907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.985911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.985915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.985920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.985923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.985927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.985930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.985934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.985937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.985940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.985944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.985948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.985955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.985963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:44.985969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.985975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:44.985979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.985985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:44.985989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.985994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:44.986022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.986027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:44.986032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.986038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:44.986043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.986047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:44.986050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.986055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:44.986060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.986065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:44.986069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.986074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.986081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.986087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.986091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.986096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.986100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.986105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:44.986109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.986114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:44.986152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:44.990722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:44.991513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:44.991530Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:44.991533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:44.991536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:44.991544Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2337 [2:7556256585414685483:9078]
2025-10-01T14:14:44.991564Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:44.991588Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:44.991596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.991600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.991602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.991618Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:44.991629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:44.991639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:44.991702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.991708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.991710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.991714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:44.991717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:44.991785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:44.991787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:44.991798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:44.991808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:44.991822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:44.991839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256585414685477:9078]
2025-10-01T14:14:44.991841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256585414685477:9078]
2025-10-01T14:14:44.991842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256585414685477:9078]
2025-10-01T14:14:44.991852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:44.991866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:44.991878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:44.991877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:44.991881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:44.991880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:44.991883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:44.991924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791589141:6467], now have 1 active actors on pipe
2025-10-01T14:14:44.991928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256587791588899:2446], now have 1 active actors on pipe
2025-10-01T14:14:44.991930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256585414685477:9078]
2025-10-01T14:14:44.991939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:44.992019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:44.992534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.992547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.992586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:44.992598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:44.992602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:44.992425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2337
2025-10-01T14:14:44.992604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:44.992461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2337
2025-10-01T14:14:44.992619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:44.992629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:44.992648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.995617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2338 partition: 0 MaxSeqNo: 45 sessionId: src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0
2025-10-01T14:14:44.995039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:44.995054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:44.995079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:44.998672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a089a31-c5be8595-49ca1bdc-4c72d4cc_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:45.001737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0] Write session: try to update token
2025-10-01T14:14:45.001755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:45.026021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:45.026046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:45.026049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:45.026051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:45.026061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256585414685477:9078]
2025-10-01T14:14:45.026068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256585414685477:9078]
2025-10-01T14:14:45.026072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256585414685477:9078]
2025-10-01T14:14:45.026122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:45.026130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.026133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:45.026290Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:45.030562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:45.030578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:45.030582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:45.031081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2338 sessionId: src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:45.034286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:45.038473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256592086556492:7265]
2025-10-01T14:14:45.039533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2337, pipe: [1:7556256592086556492:7265]
2025-10-01T14:14:45.185412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:45.185427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:45.185485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2338 reason: error at write: Disconnected sessionId: src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0
2025-10-01T14:14:45.185708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2338 sessionId: src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0 is DEAD
2025-10-01T14:14:45.185868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:45.185900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256592086556492:7265]
2025-10-01T14:14:45.184112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:45.184650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:45.184661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:45.184686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086556492:7265], now have 1 active actors on pipe
2025-10-01T14:14:45.187232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:45.187242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0] Write session will restart in 0.005622s
2025-10-01T14:14:45.187266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0] Write session: Do CDS request
2025-10-01T14:14:45.187274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:45.186450Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:45.195273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:45.196030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:45.196052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2339
2025-10-01T14:14:45.196246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:45.196278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:45.196284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:45.196288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:45.198959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2339 sessionId:  describe result for acl check
2025-10-01T14:14:45.199013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:45.199015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:45.199017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:45.199026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256592086556506:6456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:45.199679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256592086556506:6456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:45.209351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256592086556506:6456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:45.219752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256592086556506:6456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:45.219778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256592086556506:6456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:45.219782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256592086556506:6456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:45.219791Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:45.238894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:45.239535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:45.239692Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:45.239695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:45.239705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:45.239743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:45.239770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256589709652971:9071]
2025-10-01T14:14:45.240188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:45.240501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:45.240529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:45.240761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:45.240807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.240812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.240813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.240813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.240814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.240815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.240815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.240816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.240817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.240817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.240818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.240819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.240820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.240820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.240824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.240831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.240833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.240836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.240838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.240840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.240842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.240845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.240847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.240850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.240852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.240854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.240856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.240858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.240867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.240872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.240876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.240880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.240882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.240885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.240888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.240891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.240896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.240899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.240902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.240904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.240908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.240910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.240913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.240916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.240919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.240923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.240925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.240929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.240931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.240936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.240938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.240941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.240944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.240948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.240951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.240954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.240976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:45.245894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:45.246865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:45.246871Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:45.246873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:45.246876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:45.246885Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2338 [2:7556256589709652971:9071]
2025-10-01T14:14:45.246906Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:45.246925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:45.246928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:45.246932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:45.246934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:45.246953Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:45.246959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:45.246966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:45.247031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.247033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.247035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.247038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:45.247042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:45.247112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:45.247115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.247127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.247137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.247151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:45.247170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256589709652966:9071]
2025-10-01T14:14:45.247172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256589709652966:9071]
2025-10-01T14:14:45.247174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256589709652966:9071]
2025-10-01T14:14:45.247188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:45.247202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:45.247215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:45.247217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:45.247259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256589709652966:9071]
2025-10-01T14:14:45.247262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:45.247320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:45.247322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:45.247325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:45.247330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:45.247546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086556499:2446], now have 1 active actors on pipe
2025-10-01T14:14:45.247560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086556547:6456], now have 1 active actors on pipe
2025-10-01T14:14:45.248185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2338
2025-10-01T14:14:45.248223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2338
2025-10-01T14:14:45.248623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:45.248638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:45.248665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f90587a9-20e93325-78a89284-74fb3336_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:45.248675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:45.248680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:45.248683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:45.248693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:45.248708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:45.248728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:45.250866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:45.250887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:45.250919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:45.251065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2339 partition: 0 MaxSeqNo: 45 sessionId: src_id|f90587a9-20e93325-78a89284-74fb3336_0
2025-10-01T14:14:45.251424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84468b38-9751ffd7-204d8b8c-a9caf200_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f90587a9-20e93325-78a89284-74fb3336_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:45.256896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90587a9-20e93325-78a89284-74fb3336_0] Write session: try to update token
2025-10-01T14:14:45.256919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90587a9-20e93325-78a89284-74fb3336_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:45.277894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:45.277918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:45.277921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:45.277923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:45.277932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256589709652966:9071]
2025-10-01T14:14:45.277938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256589709652966:9071]
2025-10-01T14:14:45.277942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256589709652966:9071]
2025-10-01T14:14:45.277994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:45.278001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.278004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:45.278157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:45.278745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:45.278759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:45.278766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:45.280955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256592086556798:7265]
2025-10-01T14:14:45.281306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2338, pipe: [1:7556256592086556798:7265]
2025-10-01T14:14:45.284572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2339 sessionId: src_id|f90587a9-20e93325-78a89284-74fb3336_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:45.287399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:45.443029Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:45.443641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086556798:7265], now have 1 active actors on pipe
2025-10-01T14:14:45.443705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:45.443712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:45.443985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:45.444042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:45.444045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256592086556798:7265]
2025-10-01T14:14:45.444049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:45.444111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2339 reason: error at write: Disconnected sessionId: src_id|f90587a9-20e93325-78a89284-74fb3336_0
2025-10-01T14:14:45.444474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90587a9-20e93325-78a89284-74fb3336_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:45.444485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90587a9-20e93325-78a89284-74fb3336_0] Write session will restart in 0.007989s
2025-10-01T14:14:45.444511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90587a9-20e93325-78a89284-74fb3336_0] Write session: Do CDS request
2025-10-01T14:14:45.444516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90587a9-20e93325-78a89284-74fb3336_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:45.444310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2339 sessionId: src_id|f90587a9-20e93325-78a89284-74fb3336_0 is DEAD
2025-10-01T14:14:45.444060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:45.453943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f90587a9-20e93325-78a89284-74fb3336_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:45.454057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:45.454075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2340
2025-10-01T14:14:45.454518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:45.454562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:45.454573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:45.454577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:45.454948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2340 sessionId:  describe result for acl check
2025-10-01T14:14:45.454981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:45.454983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:45.454986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:45.454991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256592086556834:6435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:45.455510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256592086556834:6435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:45.459486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256592086556834:6435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:45.463365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256592086556834:6435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:45.463385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256592086556834:6435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:45.463389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256592086556834:6435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:45.463398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:45.469342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:45.474479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:45.474782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:45.474795Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:45.474808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:45.474868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:45.474915Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256589709653162:9044]
2025-10-01T14:14:45.475530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:45.476035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:45.476084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:45.476393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:45.476444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.476445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.476447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.476448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.476450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.476451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.476453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.476454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.476456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.476457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.476458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.476459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.476461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.476462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.476468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.476478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.476482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.476486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.476489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.476493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.476497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.476501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.476505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.476509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.476512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.476516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.476519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.476523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.476531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.476538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.476544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.476552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.476570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.476575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.476579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.476584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.476589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.476594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.476598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.476603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.476608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.476613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.476617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.476622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.476626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.476631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.476636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.476641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.476647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.476651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.476656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.476661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.476665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.476670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.476674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.476678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.476718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:45.481202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:45.482254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:45.482273Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:45.482275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:45.482279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:45.482286Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2339 [2:7556256589709653162:9044]
2025-10-01T14:14:45.482315Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:45.482334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:45.482337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:45.482341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:45.482343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:45.482361Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:45.482367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:45.482395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:45.482467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.482478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.482480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.482483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:45.482486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:45.482564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:45.482572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.482585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.482594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.482612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:45.482634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256589709653156:9044]
2025-10-01T14:14:45.482641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256589709653156:9044]
2025-10-01T14:14:45.482643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256589709653156:9044]
2025-10-01T14:14:45.482659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:45.482676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:45.482694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:45.482702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:45.482742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256589709653156:9044]
2025-10-01T14:14:45.482748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:45.484063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:45.484088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:45.484091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:45.484099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:45.484695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2339
2025-10-01T14:14:45.484746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2339
2025-10-01T14:14:45.484895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086557016:6435], now have 1 active actors on pipe
2025-10-01T14:14:45.484909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086556801:2446], now have 1 active actors on pipe
2025-10-01T14:14:45.484927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:45.484934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:45.484965Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:45.484982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:45.484986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:45.484989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:45.485001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:45.485029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:45.485050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:45.485300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:45.485308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:45.485320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:45.485427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2340 partition: 0 MaxSeqNo: 45 sessionId: src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0
2025-10-01T14:14:45.485826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f90587a9-20e93325-78a89284-74fb3336_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:45.488865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0] Write session: try to update token
2025-10-01T14:14:45.488883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:45.507072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2340 sessionId: src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:45.509858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:45.509889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:45.509894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:45.509896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:45.509907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256589709653156:9044]
2025-10-01T14:14:45.509912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256589709653156:9044]
2025-10-01T14:14:45.509916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256589709653156:9044]
2025-10-01T14:14:45.509971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:45.509984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.509987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:45.510073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:45.510139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:45.510212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:45.510226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:45.510234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:45.550715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256592086557105:7265]
2025-10-01T14:14:45.551135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2339, pipe: [1:7556256592086557105:7265]
2025-10-01T14:14:45.669233Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:45.669793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:45.669812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:45.669858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086557105:7265], now have 1 active actors on pipe
2025-10-01T14:14:45.670622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:45.670644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:45.670731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2340 reason: error at write: Disconnected sessionId: src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0
2025-10-01T14:14:45.670914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2340 sessionId: src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0 is DEAD
2025-10-01T14:14:45.671088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:45.671125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256592086557105:7265]
2025-10-01T14:14:45.671422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:45.671430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0] Write session will restart in 0.005426s
2025-10-01T14:14:45.671456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0] Write session: Do CDS request
2025-10-01T14:14:45.671465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:45.670769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:45.677875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:45.678173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:45.678194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2341
2025-10-01T14:14:45.678497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:45.678533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:45.678539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:45.678544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:45.679254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2341 sessionId:  describe result for acl check
2025-10-01T14:14:45.679291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:45.679293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:45.679295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:45.679303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256592086557124:6411] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:45.679959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256592086557124:6411] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:45.684836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256592086557124:6411] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:45.689272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256592086557124:6411] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:45.689291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256592086557124:6411] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:45.689295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256592086557124:6411] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:45.689303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:45.754446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:45.754825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:45.755227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:45.755232Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:45.755247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:45.755309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:45.755346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256589709653352:9051]
2025-10-01T14:14:45.756009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:45.756722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:45.756771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:45.757108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:45.757162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.757163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.757164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.757165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.757166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.757168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.757169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.757170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.757172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.757173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.757174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.757176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.757177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.757178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.757185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.757195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.757199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.757203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.757207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.757211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.757214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.757217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.757221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.757225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.757229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.757232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.757236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.757239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.757247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.757255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:45.757261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.757266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:45.757271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.757276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:45.757280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.757285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:45.757290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.757295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:45.757300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.757305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:45.757312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.757318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:45.757322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.757327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:45.757332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.757338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:45.757343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.757348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.757352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.757357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.757361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.757365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.757370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.757374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:45.757380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.757385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:45.757421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:45.767990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:45.768970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:45.768976Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:45.768979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:45.768983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:45.768992Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2340 [2:7556256589709653352:9051]
2025-10-01T14:14:45.769010Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:45.769032Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:45.769037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:45.769041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:45.769043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:45.769061Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:45.769067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:45.769075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:45.769141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.769143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.769146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.769149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:45.769152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:45.769231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:45.769234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.769248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:45.769259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:45.769275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:45.769293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256589709653347:9051]
2025-10-01T14:14:45.769295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256589709653347:9051]
2025-10-01T14:14:45.769298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256589709653347:9051]
2025-10-01T14:14:45.769311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:45.769327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:45.769342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:45.769345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:45.769392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256589709653347:9051]
2025-10-01T14:14:45.769395Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:45.769647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:45.769659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:45.769662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:45.769667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:45.770491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2340
2025-10-01T14:14:45.770541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2340
2025-10-01T14:14:45.770764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256592086557409:7265]
2025-10-01T14:14:45.773231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2340, pipe: [1:7556256592086557409:7265]
2025-10-01T14:14:45.773330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086557162:6411], now have 1 active actors on pipe
2025-10-01T14:14:45.773347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086557112:2446], now have 1 active actors on pipe
2025-10-01T14:14:45.773367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:45.773374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:45.773395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256592086557409:7265], now have 1 active actors on pipe
2025-10-01T14:14:45.773412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:45.773424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:45.773430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:45.773433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:45.773446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:45.773465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:45.773488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:45.773807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:45.773813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:45.773828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:45.773961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2341 partition: 0 MaxSeqNo: 45 sessionId: src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0
2025-10-01T14:14:45.774434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6e53dd4-31585053-2da3d493-8d10f10b_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:45.777838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0] Write session: try to update token
2025-10-01T14:14:45.777858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:45.823432Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:45.823457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:45.823459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:45.823462Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:45.823473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256589709653347:9051]
2025-10-01T14:14:45.823484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256589709653347:9051]
2025-10-01T14:14:45.823488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256589709653347:9051]
2025-10-01T14:14:45.823542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:45.823551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:45.823554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:45.823712Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:45.824153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:45.824166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:45.824177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:45.827802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2341 sessionId: src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:45.830852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:46.005593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:46.006019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.006030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.008993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:46.012077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:46.012090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0] Write session will restart in 0.007285s
2025-10-01T14:14:46.012119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0] Write session: Do CDS request
2025-10-01T14:14:46.012126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:46.011060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:46.011140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256592086557409:7265]
2025-10-01T14:14:46.011162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:46.011254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2341 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0
2025-10-01T14:14:46.011448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2341 sessionId: src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0 is DEAD
2025-10-01T14:14:46.021004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:46.021389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:46.021407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2342
2025-10-01T14:14:46.021553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:46.021581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:46.021586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:46.021590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:46.021962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2342 sessionId:  describe result for acl check
2025-10-01T14:14:46.021990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:46.021992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:46.021996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:46.022001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256596381524763:6359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:46.022599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256596381524763:6359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:46.033150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256596381524763:6359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:46.043432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256596381524763:6359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:46.043455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256596381524763:6359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:46.043458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256596381524763:6359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:46.043468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:46.092865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:46.094413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:46.094647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:46.094652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:46.094665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:46.094946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:46.094989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256594004620836:9047]
2025-10-01T14:14:46.095636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:46.098066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:46.098136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:46.098547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:46.098628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.098629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.098631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.098632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.098634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.098635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.098636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.098637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.098639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.098640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.098641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.098642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.098644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.098645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.098651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.098660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.098664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.098668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.098671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.098675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.098678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.098682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.098685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.098689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.098692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.098696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.098699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.098702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.098713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.098721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.098727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.098733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.098738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.098743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.098748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.098753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.098760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.098765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.098770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.098775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.098780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.098785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.098789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.098794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.098799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.098804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.098808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.098813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.098819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.098824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.098829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.098834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.098839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.098844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.098849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.098854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.098892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:46.108146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:46.109053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:46.109059Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:46.109062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:46.109066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:46.109074Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2341 [2:7556256594004620836:9047]
2025-10-01T14:14:46.109093Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:46.109114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:46.109117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:46.109122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:46.109124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:46.109143Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:46.109149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:46.109156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:46.109219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.109222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.109224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.109228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:46.109231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:46.109312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:46.109315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.109329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.109339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.109353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:46.109369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256594004620830:9047]
2025-10-01T14:14:46.109371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256594004620830:9047]
2025-10-01T14:14:46.109376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256594004620830:9047]
2025-10-01T14:14:46.109389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:46.109401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:46.109416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:46.109418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:46.109461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256594004620830:9047]
2025-10-01T14:14:46.109463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:46.112755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256596381525043:7265]
2025-10-01T14:14:46.111397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:46.111412Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:46.111417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:46.111423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:46.113386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381524749:2446], now have 1 active actors on pipe
2025-10-01T14:14:46.113393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381524817:6359], now have 1 active actors on pipe
2025-10-01T14:14:46.114110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2341
2025-10-01T14:14:46.114153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2341
2025-10-01T14:14:46.115804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2341, pipe: [1:7556256596381525043:7265]
2025-10-01T14:14:46.115598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.115618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.115643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525043:7265], now have 1 active actors on pipe
2025-10-01T14:14:46.115660Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25125a01-7a61ffda-a1875a14-56f69231_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:46.115673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:46.115680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:46.115684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:46.115699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:46.115720Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:46.115739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:46.118343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.118354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.118406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:46.118859Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2342 partition: 0 MaxSeqNo: 45 sessionId: src_id|25125a01-7a61ffda-a1875a14-56f69231_0
2025-10-01T14:14:46.122122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4fdb4fa-3f41882f-dd0a8ac-e089d329_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|25125a01-7a61ffda-a1875a14-56f69231_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:46.125353Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25125a01-7a61ffda-a1875a14-56f69231_0] Write session: try to update token
2025-10-01T14:14:46.125373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25125a01-7a61ffda-a1875a14-56f69231_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:46.157460Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:46.157486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:46.157490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:46.157492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:46.157507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256594004620830:9047]
2025-10-01T14:14:46.157512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256594004620830:9047]
2025-10-01T14:14:46.157519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256594004620830:9047]
2025-10-01T14:14:46.157583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:46.157597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.157600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:46.157759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:46.155283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2342 sessionId: src_id|25125a01-7a61ffda-a1875a14-56f69231_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:46.157906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:46.158420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:46.158433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:46.158438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:46.312628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:46.312949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.312963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.313235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:46.313577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:46.313684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2342 reason: status is not ok: tablet will be restarted right now sessionId: src_id|25125a01-7a61ffda-a1875a14-56f69231_0
2025-10-01T14:14:46.313689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256596381525043:7265]
2025-10-01T14:14:46.313708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:46.313855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2342 sessionId: src_id|25125a01-7a61ffda-a1875a14-56f69231_0 is DEAD
2025-10-01T14:14:46.314395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25125a01-7a61ffda-a1875a14-56f69231_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:46.314403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25125a01-7a61ffda-a1875a14-56f69231_0] Write session will restart in 0.005109s
2025-10-01T14:14:46.314428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25125a01-7a61ffda-a1875a14-56f69231_0] Write session: Do CDS request
2025-10-01T14:14:46.314435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25125a01-7a61ffda-a1875a14-56f69231_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:46.320823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25125a01-7a61ffda-a1875a14-56f69231_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:46.320979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:46.321005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2343
2025-10-01T14:14:46.321299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:46.321336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:46.321349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:46.321353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:46.321829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2343 sessionId:  describe result for acl check
2025-10-01T14:14:46.321863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:46.321871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:46.321874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:46.321880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256596381525072:6340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:46.322437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256596381525072:6340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:46.324679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256596381525072:6340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:46.330316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256596381525072:6340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:46.330335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256596381525072:6340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:46.330340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256596381525072:6340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:46.330348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:46.333451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:46.334231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:46.334433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:46.334441Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:46.334453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:46.334500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:46.334539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256594004621045:9022]
2025-10-01T14:14:46.334969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:46.335195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:46.335235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:46.335452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:46.335498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.335503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.335504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.335505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.335507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.335508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.335509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.335510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.335511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.335513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.335514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.335515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.335516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.335516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.335521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.335530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.335533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.335537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.335541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.335544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.335548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.335551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.335555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.335560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.335563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.335567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.335570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.335574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.335581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.335589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.335595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.335601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.335605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.335610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.335615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.335625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.335630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.335638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.335642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.335647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.335653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.335662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.335666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.335675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.335682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.335689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.335697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.335702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.335709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.335717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.335722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.335730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.335734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.335742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.335746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.335754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.335785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:46.339474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:46.340372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:46.340378Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:46.340380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:46.340385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:46.340392Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2342 [2:7556256594004621045:9022]
2025-10-01T14:14:46.340409Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:46.340425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:46.340428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:46.340431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:46.340434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:46.340449Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:46.340454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:46.340460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:46.340519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.340521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.340523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.340526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:46.340528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:46.340617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:46.340620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.340631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.340640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.340654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:46.340671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256594004621040:9022]
2025-10-01T14:14:46.340673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256594004621040:9022]
2025-10-01T14:14:46.340675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256594004621040:9022]
2025-10-01T14:14:46.340689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:46.340703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:46.340716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:46.340719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:46.340748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256594004621040:9022]
2025-10-01T14:14:46.340750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:46.341470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2342
2025-10-01T14:14:46.341510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2342
2025-10-01T14:14:46.340972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:46.340981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:46.340983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:46.340988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:46.341620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525320:6340], now have 1 active actors on pipe
2025-10-01T14:14:46.341628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525052:2446], now have 1 active actors on pipe
2025-10-01T14:14:46.341638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.341642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.341663Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2551f5-3498f213-7991ab12-6968c274_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:46.341668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:46.341672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:46.341674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:46.341681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:46.341689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:46.341703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:46.341918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.341922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.341933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:46.342036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2343 partition: 0 MaxSeqNo: 45 sessionId: src_id|d2551f5-3498f213-7991ab12-6968c274_0
2025-10-01T14:14:46.342465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25125a01-7a61ffda-a1875a14-56f69231_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|d2551f5-3498f213-7991ab12-6968c274_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:46.345670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2551f5-3498f213-7991ab12-6968c274_0] Write session: try to update token
2025-10-01T14:14:46.345691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2551f5-3498f213-7991ab12-6968c274_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:46.362986Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:46.363010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:46.363012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:46.363014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:46.363024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256594004621040:9022]
2025-10-01T14:14:46.363030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256594004621040:9022]
2025-10-01T14:14:46.363034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256594004621040:9022]
2025-10-01T14:14:46.363080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:46.363088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.363090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:46.363241Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:46.366427Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:46.366451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:46.366458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:46.368677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2343 sessionId: src_id|d2551f5-3498f213-7991ab12-6968c274_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:46.371471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:46.413857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256596381525352:7265]
2025-10-01T14:14:46.414241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2342, pipe: [1:7556256596381525352:7265]
2025-10-01T14:14:46.514073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:46.514340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.514352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.514405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525352:7265], now have 1 active actors on pipe
2025-10-01T14:14:46.514757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256596381525352:7265]
2025-10-01T14:14:46.514766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:46.514806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:46.514682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:46.514903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2343 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d2551f5-3498f213-7991ab12-6968c274_0
2025-10-01T14:14:46.515068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2343 sessionId: src_id|d2551f5-3498f213-7991ab12-6968c274_0 is DEAD
2025-10-01T14:14:46.515498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2551f5-3498f213-7991ab12-6968c274_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:46.515509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2551f5-3498f213-7991ab12-6968c274_0] Write session will restart in 0.008833s
2025-10-01T14:14:46.515538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2551f5-3498f213-7991ab12-6968c274_0] Write session: Do CDS request
2025-10-01T14:14:46.515545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2551f5-3498f213-7991ab12-6968c274_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:46.525797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2551f5-3498f213-7991ab12-6968c274_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:46.526105Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:46.526121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2344
2025-10-01T14:14:46.526230Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:46.526260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:46.526266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:46.526269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:46.526722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2344 sessionId:  describe result for acl check
2025-10-01T14:14:46.526756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:46.526762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:46.526763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:46.526768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256596381525455:6328] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:46.527266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256596381525455:6328] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:46.530681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256596381525455:6328] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:46.533611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256596381525455:6328] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:46.533635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256596381525455:6328] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:46.533640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256596381525455:6328] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:46.533648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:46.535207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:46.536394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:46.536591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:46.536609Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:46.536620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:46.536684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:46.536729Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256594004621239:9013]
2025-10-01T14:14:46.537244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:46.537613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:46.537676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:46.538083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:46.538139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.538144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.538145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.538146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.538146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.538147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.538148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.538148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.538149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.538150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.538151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.538152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.538153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.538153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.538157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.538164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.538166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.538169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.538171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.538173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.538176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.538178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.538180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.538183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.538185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.538187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.538190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.538192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.538198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.538203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.538207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.538210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.538213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.538216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.538219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.538222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.538225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.538229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.538231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.538234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.538237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.538240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.538242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.538246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.538248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.538251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.538253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.538257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.538260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.538263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.538266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.538269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.538272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.538274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.538277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.538280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.538304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:46.542557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:46.543402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:46.543418Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:46.543420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:46.543424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:46.543430Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2343 [2:7556256594004621239:9013]
2025-10-01T14:14:46.543444Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:46.543459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:46.543461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:46.543463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:46.543465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:46.543478Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:46.543487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:46.543491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:46.543537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.543542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.543544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.543547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:46.543549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:46.543612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:46.543619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.543631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.543637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.543646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:46.543662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256594004621234:9013]
2025-10-01T14:14:46.543668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256594004621234:9013]
2025-10-01T14:14:46.543670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256594004621234:9013]
2025-10-01T14:14:46.543681Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:46.543695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:46.543707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:46.543706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:46.543710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:46.543712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:46.543713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:46.543741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256594004621234:9013]
2025-10-01T14:14:46.543744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:46.543765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525647:6328], now have 1 active actors on pipe
2025-10-01T14:14:46.543964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2343
2025-10-01T14:14:46.544017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2343
2025-10-01T14:14:46.543784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:46.543809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525356:2446], now have 1 active actors on pipe
2025-10-01T14:14:46.544092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.544097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.544119Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb430255-ded76656-165c6ef9-4b926286_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:46.544124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:46.544127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:46.544129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:46.544135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:46.544142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:46.544154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:46.544353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.544362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.544374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:46.544506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2344 partition: 0 MaxSeqNo: 45 sessionId: src_id|eb430255-ded76656-165c6ef9-4b926286_0
2025-10-01T14:14:46.544861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2551f5-3498f213-7991ab12-6968c274_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|eb430255-ded76656-165c6ef9-4b926286_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:46.547876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb430255-ded76656-165c6ef9-4b926286_0] Write session: try to update token
2025-10-01T14:14:46.547897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb430255-ded76656-165c6ef9-4b926286_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:46.562830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2344 sessionId: src_id|eb430255-ded76656-165c6ef9-4b926286_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:46.565787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:46.567851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.567884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.567907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:46.567910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:46.567912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:46.567915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:46.567924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256594004621234:9013]
2025-10-01T14:14:46.567930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256594004621234:9013]
2025-10-01T14:14:46.567935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256594004621234:9013]
2025-10-01T14:14:46.567990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:46.568002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.568004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:46.568005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:46.568014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:46.568019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:46.568129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:46.618455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256596381525666:7265]
2025-10-01T14:14:46.618862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2343, pipe: [1:7556256596381525666:7265]
2025-10-01T14:14:46.720773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:46.721181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:46.721249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525666:7265], now have 1 active actors on pipe
2025-10-01T14:14:46.722434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:46.726484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256596381525666:7265]
2025-10-01T14:14:46.726537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:46.743989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:46.744010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:46.744043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2344 reason: error at write: Disconnected sessionId: src_id|eb430255-ded76656-165c6ef9-4b926286_0
2025-10-01T14:14:46.744209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2344 sessionId: src_id|eb430255-ded76656-165c6ef9-4b926286_0 is DEAD
2025-10-01T14:14:46.744997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb430255-ded76656-165c6ef9-4b926286_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:46.745008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb430255-ded76656-165c6ef9-4b926286_0] Write session will restart in 0.005899s
2025-10-01T14:14:46.745037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb430255-ded76656-165c6ef9-4b926286_0] Write session: Do CDS request
2025-10-01T14:14:46.745047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb430255-ded76656-165c6ef9-4b926286_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:46.751961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb430255-ded76656-165c6ef9-4b926286_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:46.752266Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:46.752283Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2345
2025-10-01T14:14:46.752421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:46.752450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:46.752456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:46.752460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:46.753059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2345 sessionId:  describe result for acl check
2025-10-01T14:14:46.753118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:46.753128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:46.753130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:46.753137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256596381525719:6307] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:46.753796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256596381525719:6307] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:46.765111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256596381525719:6307] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:46.774205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256596381525719:6307] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:46.774227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256596381525719:6307] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:46.774246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256596381525719:6307] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:46.774254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:46.802297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:46.802697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:46.802901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:46.802905Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:46.802920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:46.802976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:46.803025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256594004621421:9014]
2025-10-01T14:14:46.803733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:46.805069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:46.805137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:46.805532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:46.805622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.805624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.805625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.805626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.805628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.805630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.805632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.805634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.805635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.805637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.805638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.805640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.805642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.805643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.805649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.805660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.805664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.805669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.805674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.805678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.805682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.805686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.805691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.805696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.805700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.805704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.805707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.805711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.805721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.805732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:46.805739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.805746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:46.805751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.805757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:46.805762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.805769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:46.805775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.805781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:46.805787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.805793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:46.805799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.805804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:46.805809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.805815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:46.805820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.805827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:46.805831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.805837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.805843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.805849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.805856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.805861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.805867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.805873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:46.805880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.805886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:46.805934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:46.811862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:46.812707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:46.812728Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:46.812731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:46.812735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:46.812743Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2344 [2:7556256594004621421:9014]
2025-10-01T14:14:46.812770Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:46.812794Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:46.812804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:46.812809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:46.812811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:46.812828Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:46.812834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:46.812840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:46.812910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.812919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.812921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.812925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:46.812928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:46.813570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2344
2025-10-01T14:14:46.813616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2344
2025-10-01T14:14:46.813002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:46.813010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.813021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:46.813031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:46.813045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:46.813062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256594004621415:9014]
2025-10-01T14:14:46.813064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256594004621415:9014]
2025-10-01T14:14:46.813066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256594004621415:9014]
2025-10-01T14:14:46.813077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:46.813090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:46.813103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:46.813103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:46.813105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:46.813107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:46.813110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:46.813162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525850:6307], now have 1 active actors on pipe
2025-10-01T14:14:46.813166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256594004621415:9014]
2025-10-01T14:14:46.813174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:46.813180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525670:2446], now have 1 active actors on pipe
2025-10-01T14:14:46.813669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:46.814831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.814849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.814891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:46.814903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:46.814909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:46.814913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:46.814927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:46.814944Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:46.814966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:46.815299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:46.815309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:46.815326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:46.815466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2345 partition: 0 MaxSeqNo: 45 sessionId: src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0
2025-10-01T14:14:46.815952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb430255-ded76656-165c6ef9-4b926286_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:46.822649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0] Write session: try to update token
2025-10-01T14:14:46.822671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:46.830578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256596381525969:7265]
2025-10-01T14:14:46.831445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256596381525969:7265], now have 1 active actors on pipe
2025-10-01T14:14:46.831596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2344, pipe: [1:7556256596381525969:7265]
2025-10-01T14:14:46.849299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:46.849331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:46.849334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:46.849337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:46.849350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256594004621415:9014]
2025-10-01T14:14:46.849356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256594004621415:9014]
2025-10-01T14:14:46.849362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256594004621415:9014]
2025-10-01T14:14:46.849425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:46.849434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:46.849437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:46.849673Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:46.851049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:46.851068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:46.851074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:46.866453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2345 sessionId: src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:46.869930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:47.070691Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:47.071077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.071088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.071508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:47.076376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:47.076390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0] Write session will restart in 0.008771s
2025-10-01T14:14:47.076420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0] Write session: Do CDS request
2025-10-01T14:14:47.076427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:47.075728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:47.075806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256596381525969:7265]
2025-10-01T14:14:47.075835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:47.075943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2345 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0
2025-10-01T14:14:47.076151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2345 sessionId: src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0 is DEAD
2025-10-01T14:14:47.092411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:47.093343Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:47.093365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2346
2025-10-01T14:14:47.093588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:47.093623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:47.093629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:47.093633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:47.094051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2346 sessionId:  describe result for acl check
2025-10-01T14:14:47.094098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:47.094099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:47.094101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:47.094107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256600676493327:6278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:47.094916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256600676493327:6278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:47.102090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256600676493327:6278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:47.110898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256600676493327:6278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:47.110919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256600676493327:6278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:47.110924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256600676493327:6278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:47.110933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:47.122529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:47.123381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:47.123605Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:47.123618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:47.123630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:47.123682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:47.123727Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256598299588907:8991]
2025-10-01T14:14:47.124317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:47.124684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:47.124731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:47.125044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:47.125104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.125111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.125112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.125113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.125114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.125116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.125117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.125118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.125119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.125120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.125122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.125123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.125124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.125125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.125130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.125141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.125144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.125148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.125151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.125155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.125159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.125162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.125166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.125169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.125173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.125176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.125179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.125182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.125190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.125198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.125204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.125208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.125213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.125218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.125222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.125228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.125233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.125237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.125243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.125247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.125252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.125256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.125260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.125265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.125270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.125274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.125279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.125284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.125291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.125305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.125309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.125314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.125323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.125328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.125338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.125342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.125379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:47.130410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:47.131532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:47.131554Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:47.131558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:47.131562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:47.131569Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2345 [2:7556256598299588907:8991]
2025-10-01T14:14:47.131588Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:47.131609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:47.131613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:47.131618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:47.131620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:47.131643Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:47.131649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:47.131657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:47.131729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.131739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.131741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.131745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:47.131747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:47.131829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:47.131836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.131850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.131861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.131875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:47.131897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676493459:6278], now have 1 active actors on pipe
2025-10-01T14:14:47.131901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676493310:2446], now have 1 active actors on pipe
2025-10-01T14:14:47.131909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256598299588902:8991]
2025-10-01T14:14:47.131911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256598299588902:8991]
2025-10-01T14:14:47.131914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256598299588902:8991]
2025-10-01T14:14:47.131931Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:47.131948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:47.131963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:47.131967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:47.131985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:47.131987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:47.131989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:47.132013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256598299588902:8991]
2025-10-01T14:14:47.132022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:47.132157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2345
2025-10-01T14:14:47.132192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2345
2025-10-01T14:14:47.132255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:47.132386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.132405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.132440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:47.132455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:47.132460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:47.132463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:47.132474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:47.132492Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:47.132517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:47.133483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.133497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.133525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:47.134475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3da136dd-e10f7e85-3ebdba-aa3a7370_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:47.133699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2346 partition: 0 MaxSeqNo: 45 sessionId: src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0
2025-10-01T14:14:47.137916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0] Write session: try to update token
2025-10-01T14:14:47.137936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:47.165054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:47.165077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:47.165081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:47.165084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:47.165093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256598299588902:8991]
2025-10-01T14:14:47.165099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256598299588902:8991]
2025-10-01T14:14:47.165107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256598299588902:8991]
2025-10-01T14:14:47.165162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:47.165171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.165173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:47.165335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:47.165785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:47.165792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:47.165797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:47.164128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2346 sessionId: src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:47.167538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:47.177194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256600676493617:7265]
2025-10-01T14:14:47.177535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2345, pipe: [1:7556256600676493617:7265]
2025-10-01T14:14:47.323858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:47.324125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.324138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.324180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676493617:7265], now have 1 active actors on pipe
2025-10-01T14:14:47.324764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:47.326168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256600676493617:7265]
2025-10-01T14:14:47.326211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:47.326293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2346 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0
2025-10-01T14:14:47.326474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2346 sessionId: src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0 is DEAD
2025-10-01T14:14:47.326628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:47.328162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:47.328177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0] Write session will restart in 0.007356s
2025-10-01T14:14:47.328210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0] Write session: Do CDS request
2025-10-01T14:14:47.328217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:47.339413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:47.339605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:47.339626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2347
2025-10-01T14:14:47.340272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:47.340309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:47.340312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:47.340316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:47.340713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2347 sessionId:  describe result for acl check
2025-10-01T14:14:47.340735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:47.340736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:47.340738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:47.340741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256600676493628:6257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:47.341290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256600676493628:6257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:47.347743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256600676493628:6257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:47.353831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256600676493628:6257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:47.353855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256600676493628:6257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:47.353859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256600676493628:6257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:47.353869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:47.393501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:47.394511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:47.394677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:47.394686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:47.394694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:47.394730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:47.394766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256598299589122:8972]
2025-10-01T14:14:47.395493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:47.395949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:47.395987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:47.396327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:47.396388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.396394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.396395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.396396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.396397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.396398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.396399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.396400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.396401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.396401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.396402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.396403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.396404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.396405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.396410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.396416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.396419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.396421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.396424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.396426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.396428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.396430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.396433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.396435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.396438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.396440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.396442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.396444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.396451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.396456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.396461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.396464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.396467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.396470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.396473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.396476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.396479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.396482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.396485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.396489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.396492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.396496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.396498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.396501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.396503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.396507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.396509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.396513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.396516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.396519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.396522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.396525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.396528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.396531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.396534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.396537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.396572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:47.401842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:47.402659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:47.402677Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:47.402680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:47.402683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:47.402691Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2346 [2:7556256598299589122:8972]
2025-10-01T14:14:47.402708Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:47.402725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:47.402734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:47.402738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:47.402740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:47.402758Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:47.402769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:47.402775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:47.402843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.402850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.402853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.402856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:47.402859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:47.402921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:47.402927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.402935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.402941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.402954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:47.402970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256598299589116:8972]
2025-10-01T14:14:47.402975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256598299589116:8972]
2025-10-01T14:14:47.402977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256598299589116:8972]
2025-10-01T14:14:47.402987Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:47.403002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:47.403016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:47.403022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:47.403052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256598299589116:8972]
2025-10-01T14:14:47.403057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:47.406480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:47.406504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:47.406512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:47.406521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:47.406833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676493759:6257], now have 1 active actors on pipe
2025-10-01T14:14:47.406863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676493620:2446], now have 1 active actors on pipe
2025-10-01T14:14:47.407413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2346
2025-10-01T14:14:47.407464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2346
2025-10-01T14:14:47.407847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.407866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.407907Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1a751703-bef58c19-6aa52866-546ca541_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:47.407925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:47.407936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:47.407940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:47.407953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:47.407973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:47.408000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:47.408376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.408401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.408429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:47.408575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2347 partition: 0 MaxSeqNo: 45 sessionId: src_id|1a751703-bef58c19-6aa52866-546ca541_0
2025-10-01T14:14:47.410474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8598aaf-38472e24-5f8b0c72-8bd0fc31_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|1a751703-bef58c19-6aa52866-546ca541_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:47.413609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a751703-bef58c19-6aa52866-546ca541_0] Write session: try to update token
2025-10-01T14:14:47.413630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a751703-bef58c19-6aa52866-546ca541_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:47.426671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256600676493923:7265]
2025-10-01T14:14:47.427222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2346, pipe: [1:7556256600676493923:7265]
2025-10-01T14:14:47.427163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676493923:7265], now have 1 active actors on pipe
2025-10-01T14:14:47.437211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:47.437238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:47.437241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:47.437243Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:47.437254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256598299589116:8972]
2025-10-01T14:14:47.437259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256598299589116:8972]
2025-10-01T14:14:47.437263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256598299589116:8972]
2025-10-01T14:14:47.437317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:47.437326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.437328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:47.437365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:47.437385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:47.437394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:47.437514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:47.439980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2347 sessionId: src_id|1a751703-bef58c19-6aa52866-546ca541_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:47.443505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:47.578233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:47.578253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:47.578256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256600676493923:7265]
2025-10-01T14:14:47.578276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:47.578326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2347 reason: error at write: Disconnected sessionId: src_id|1a751703-bef58c19-6aa52866-546ca541_0
2025-10-01T14:14:47.577267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:47.577817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.577825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.578654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a751703-bef58c19-6aa52866-546ca541_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:47.578662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a751703-bef58c19-6aa52866-546ca541_0] Write session will restart in 0.008251s
2025-10-01T14:14:47.578691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a751703-bef58c19-6aa52866-546ca541_0] Write session: Do CDS request
2025-10-01T14:14:47.578699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a751703-bef58c19-6aa52866-546ca541_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:47.578509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2347 sessionId: src_id|1a751703-bef58c19-6aa52866-546ca541_0 is DEAD
2025-10-01T14:14:47.579222Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:47.587889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1a751703-bef58c19-6aa52866-546ca541_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:47.588253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:47.588273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2348
2025-10-01T14:14:47.588439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:47.588472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:47.588481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:47.588486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:47.588975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2348 sessionId:  describe result for acl check
2025-10-01T14:14:47.589017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:47.589024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:47.589026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:47.589032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256600676494040:6242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:47.589608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256600676494040:6242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:47.595781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256600676494040:6242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:47.597178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:47.597326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:47.597455Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:47.597458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:47.597466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:47.597493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:47.597524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256598299589316:8967]
2025-10-01T14:14:47.597987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:47.598906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:47.598954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:47.599189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:47.599224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.599225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.599225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.599226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.599227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.599228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.599229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.599230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.599231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.599231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.599232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.599233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.599233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.599234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.599237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.599243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.599245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.599248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.599250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.599252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.599254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.599256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.599259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.599261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.599264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.599266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.599268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.599271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.599276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.599282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.599286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.599289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.599292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.599295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.599298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.599301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.599304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.599307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.599310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.599313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.599316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.599319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.599322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.599325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.599327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.599330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.599333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.599337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.599339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.599342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.599345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.599348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.599350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.599354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.599356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.599359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.599380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:47.602058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256600676494040:6242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:47.602078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256600676494040:6242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:47.602080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256600676494040:6242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:47.602087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:47.604427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2347
2025-10-01T14:14:47.604465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2347
2025-10-01T14:14:47.603086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:47.603941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:47.603945Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:47.603947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:47.603950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:47.603956Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2347 [2:7556256598299589316:8967]
2025-10-01T14:14:47.603967Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:47.603981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:47.603983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:47.603986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:47.603988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:47.604000Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:47.604004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:47.604009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:47.604051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.604052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.604053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.604055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:47.604057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:47.604115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:47.604118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.604127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.604136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.604149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:47.604166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676493931:2446], now have 1 active actors on pipe
2025-10-01T14:14:47.604172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256598299589310:8967]
2025-10-01T14:14:47.604174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256598299589310:8967]
2025-10-01T14:14:47.604177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256598299589310:8967]
2025-10-01T14:14:47.604189Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:47.604200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676494232:6242], now have 1 active actors on pipe
2025-10-01T14:14:47.604211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:47.604212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:47.604215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:47.604217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:47.604223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:47.604228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:47.604255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256598299589310:8967]
2025-10-01T14:14:47.604263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:47.604269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:47.604681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.604684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.604703Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:47.604708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:47.604711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:47.604713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:47.604719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:47.604727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:47.604737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:47.606587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.606600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.606615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:47.606718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2348 partition: 0 MaxSeqNo: 45 sessionId: src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0
2025-10-01T14:14:47.610797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1a751703-bef58c19-6aa52866-546ca541_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:47.613861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0] Write session: try to update token
2025-10-01T14:14:47.613883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:47.637234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:47.637267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:47.637271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:47.637273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:47.637291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256598299589310:8967]
2025-10-01T14:14:47.637298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256598299589310:8967]
2025-10-01T14:14:47.637303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256598299589310:8967]
2025-10-01T14:14:47.637365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:47.637374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.637377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:47.637590Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:47.638584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:47.638599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:47.638604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:47.642352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2348 sessionId: src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:47.645426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:47.678532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256600676494241:7265]
2025-10-01T14:14:47.678819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2347, pipe: [1:7556256600676494241:7265]
2025-10-01T14:14:47.786976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:47.787353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.787364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.787413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676494241:7265], now have 1 active actors on pipe
2025-10-01T14:14:47.787676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:47.788091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:47.788197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2348 reason: status is not ok: tablet will be restarted right now sessionId: src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0
2025-10-01T14:14:47.788402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2348 sessionId: src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0 is DEAD
2025-10-01T14:14:47.788572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:47.788574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256600676494241:7265]
2025-10-01T14:14:47.788752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-10-01T14:14:47.788765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0] Write session will restart in 0.009156s
2025-10-01T14:14:47.788797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0] Write session: Do CDS request
2025-10-01T14:14:47.788804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:47.799568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:47.799886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:47.799904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2349
2025-10-01T14:14:47.800098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:47.800158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:47.800164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:47.800173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:47.800660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2349 sessionId:  describe result for acl check
2025-10-01T14:14:47.800695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:47.800697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:47.800701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:47.800707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256600676494278:6231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:47.801363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256600676494278:6231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:47.806366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256600676494278:6231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:47.811127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256600676494278:6231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:47.811148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256600676494278:6231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:47.811151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256600676494278:6231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:47.811160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:47.817071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:47.818381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:47.818725Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:47.818746Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:47.818762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:47.818829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:47.818870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256598299589503:8959]
2025-10-01T14:14:47.819519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:47.820325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:47.820379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:47.820721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:47.820797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.820799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.820800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.820801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.820802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.820803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.820804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.820806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.820807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.820808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.820809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.820811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.820812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.820813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.820818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.820828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.820831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.820835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.820838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.820841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.820844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.820848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.820852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.820856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.820859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.820862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.820865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.820869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.820878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.820886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:47.820892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.820897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:47.820901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.820906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:47.820909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.820917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:47.820921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.820926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:47.820931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.820936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:47.820940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.820945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:47.820949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.820954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:47.820959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.820964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:47.820969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.820974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.820978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.820983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.820987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.820991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.820996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.821001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:47.821005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.821010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:47.821047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:47.825807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:47.826796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:47.826817Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:47.826820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:47.826824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:47.826833Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2348 [2:7556256598299589503:8959]
2025-10-01T14:14:47.826850Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:47.826868Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:47.826878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:47.826882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:47.826884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:47.826902Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:47.826914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:47.826921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:47.826984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.826993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.826995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.826998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:47.827001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:47.827082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:47.827089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.827102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:47.827111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:47.827131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:47.827152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256598299589498:8959]
2025-10-01T14:14:47.827158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256598299589498:8959]
2025-10-01T14:14:47.827160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256598299589498:8959]
2025-10-01T14:14:47.827174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:47.827195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:47.827213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:47.827220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:47.827261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256598299589498:8959]
2025-10-01T14:14:47.827267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:47.827350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:47.827357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:47.827358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:47.827362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:47.827918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2348
2025-10-01T14:14:47.827977Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2348
2025-10-01T14:14:47.827632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676494487:6231], now have 1 active actors on pipe
2025-10-01T14:14:47.827642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676494244:2446], now have 1 active actors on pipe
2025-10-01T14:14:47.828026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.828036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.828073Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:47.828083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:47.828088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:47.828091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2279: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-10-01T14:14:47.828102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:47.828115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-10-01T14:14:47.828134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:47.828420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.828431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.828447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-10-01T14:14:47.831551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2349 partition: 0 MaxSeqNo: 45 sessionId: src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0
2025-10-01T14:14:47.832209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|68970601-678e5ffc-7823d1ee-9583b9ff_0] Write session established. Init response: last_sequence_number: 45 session_id: "src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-10-01T14:14:47.835766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0] Write session: try to update token
2025-10-01T14:14:47.835792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0] Send 10 message(s) (0 left), first sequence number is 39
2025-10-01T14:14:47.861090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2349 sessionId: src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-10-01T14:14:47.863979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-10-01T14:14:47.864407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:47.864445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:47.864485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-10-01T14:14:47.864684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-10-01T14:14:47.870352Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-10-01T14:14:47.870389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-10-01T14:14:47.870392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-10-01T14:14:47.870393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-10-01T14:14:47.870404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 30 count 3 size 5223531 actorID [2:7556256598299589498:8959]
2025-10-01T14:14:47.870409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 33 count 2 size 4506418 actorID [2:7556256598299589498:8959]
2025-10-01T14:14:47.870413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 3 size 6759616 actorID [2:7556256598299589498:8959]
2025-10-01T14:14:47.870468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-10-01T14:14:47.870480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:47.870483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-10-01T14:14:47.870489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 30 partno 3 count 3 parts 9 suffix '63' size 5223531
2025-10-01T14:14:47.870500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-10-01T14:14:47.870504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 3 parts 12 suffix '63' size 6759616
2025-10-01T14:14:47.870621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
2025-10-01T14:14:47.887038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 45 InitDone 1 WaitForData 0, pipe: [1:7556256600676494551:7265]
2025-10-01T14:14:47.887306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2348, pipe: [1:7556256600676494551:7265]
2025-10-01T14:14:48.031685Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=30;Head.PackedSize=2458306;NewHead.Offset=30;NewHead.PartNo=3;headCleared=0;needCompactHead=0;
??+0 (0x1473495F)
??+0 (0x14734907)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15499E2D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240D0582)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240CA79E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241BF58A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241C0B3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x2406FA19)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15445988)
??+0 (0x1473495F)
??+0 (0x14734B34)
std::rethrow_exception(std::exception_ptr)+12 (0x14745EAC)
NActors::IActorExceptionHandler::OnUnhandledException(std::exception_ptr const&)+33 (0x1723F4C1)
2025-10-01T14:14:48.032161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256600676494551:7265], now have 1 active actors on pipe
2025-10-01T14:14:48.041612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.041639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.041847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.041921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.041993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.042071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.042125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.042152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.042237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.042307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.042394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.042477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.042524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.042531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.042602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.042662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.042748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.042818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.042862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.042871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.042940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.043010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.043074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.043137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.043184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.043192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.043260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.043325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.043392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.043459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.043507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.043514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.043621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.043700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.043781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.043865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.043921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.043929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.044024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.044103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.044186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.044265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.044320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.044327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.044423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.044504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.044608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.044698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.044757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.044764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.044858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.044938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.045022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.045101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.045158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.045165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.045248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-10-01T14:14:48.045324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-10-01T14:14:48.045404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-10-01T14:14:48.045483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-10-01T14:14:48.045569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-10-01T14:14:48.045576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-10-01T14:14:48.046233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-10-01T14:14:48.046254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-10-01T14:14:48.046286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2349 reason: error at write: Disconnected sessionId: src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0
2025-10-01T14:14:48.046827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-10-01T14:14:48.046837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0] Write session will restart in 0.007236s
2025-10-01T14:14:48.046857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0] Write session: Do CDS request
2025-10-01T14:14:48.046861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0] Start write session. Will connect to endpoint: localhost:21386
2025-10-01T14:14:48.046460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2349 sessionId: src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0 is DEAD
2025-10-01T14:14:48.046511Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-10-01T14:14:48.046559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 24 consumer shared/user session shared/user_1_24_6388546463162030126_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7556256600676494551:7265]
2025-10-01T14:14:48.047097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-10-01T14:14:48.054868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|20b5da70-c71166ea-3d3a4ba-61935a5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.055636Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-10-01T14:14:48.055658Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2350
2025-10-01T14:14:48.055812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-10-01T14:14:48.055846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51196
2025-10-01T14:14:48.055857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:51196 proto=v1  topic=test-topic durationSec=0
2025-10-01T14:14:48.055862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-10-01T14:14:48.056390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2350 sessionId:  describe result for acl check
2025-10-01T14:14:48.056432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-10-01T14:14:48.056440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-10-01T14:14:48.056442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-10-01T14:14:48.056447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7556256604971461899:6216] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-10-01T14:14:48.057069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7556256604971461899:6216] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-10-01T14:14:48.059427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7556256604971461899:6216] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-10-01T14:14:48.065969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-10-01T14:14:48.066744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7556256604971461899:6216] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-10-01T14:14:48.066763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7556256604971461899:6216] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-10-01T14:14:48.066767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7556256604971461899:6216] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-10-01T14:14:48.066776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-10-01T14:14:48.067444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-10-01T14:14:48.067638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-10-01T14:14:48.067648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-10-01T14:14:48.067659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-10-01T14:14:48.067700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-10-01T14:14:48.067734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1089: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7556256602594556986:8957]
2025-10-01T14:14:48.068289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-10-01T14:14:48.068742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-10-01T14:14:48.068797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-10-01T14:14:48.069134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-10-01T14:14:48.069208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.069215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.069217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.069218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.069220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.069221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.069223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.069224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.069226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.069227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.069229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.069231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.069232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.069234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.069239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.069249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.069254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.069258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.069261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.069265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.069269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.069273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.069278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.069282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.069286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.069291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.069294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.069298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:605: add key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.069306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.069314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-10-01T14:14:48.069320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.069325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-10-01T14:14:48.069330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.069335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295579 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-10-01T14:14:48.069339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.069351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988738 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-10-01T14:14:48.069356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.069361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988756 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-10-01T14:14:48.069365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.069371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295660 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-10-01T14:14:48.069378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.069384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988760 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-10-01T14:14:48.069388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.069394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295582 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-10-01T14:14:48.069398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.069403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 2 size 2458306 so 0 eo 30 d0000000000_00000000000000000028_00004_0000000002_00004|
2025-10-01T14:14:48.069413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.069419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 30 count 3 size 5223531 so 0 eo 33 d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.069424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.069431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 33 count 2 size 4506418 so 0 eo 35 d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.069441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.069447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 3 size 6759616 so 0 eo 38 d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.069452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.069462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-10-01T14:14:48.069467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:661: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.069472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:691: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 4 size 7476729 so 0 eo 45 d0000000000_00000000000000000041_00003_0000000004_00013?
2025-10-01T14:14:48.069518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-10-01T14:14:48.076420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:913: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 28 endOffset 45 key 28,2 valuesize 2458306 expected 2458306
2025-10-01T14:14:48.077174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-10-01T14:14:48.077193Z node 2 :PERSQUEUE INFO: partition_init.cpp:962: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-10-01T14:14:48.077197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-10-01T14:14:48.077202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-10-01T14:14:48.077209Z node 2 :PERSQUEUE INFO: partition.cpp:698: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2349 [2:7556256602594556986:8957]
2025-10-01T14:14:48.077226Z node 2 :PERSQUEUE DEBUG: partition.cpp:712: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 45 Head Offset 45 PartNo 0 PackedSize 0 count 0 nextOffset 45 batches 0
SYNC INIT sourceId  src_id seqNo 45 offset 44
SYNC INIT DATA KEY: d0000000000_00000000000000000030_00003_0000000003_00009? size 5223531
SYNC INIT DATA KEY: d0000000000_00000000000000000033_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000003_00012? size 6759616
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000004_00013? size 7476729
2025-10-01T14:14:48.077245Z node 2 :PERSQUEUE DEBUG: partition.cpp:4293: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-10-01T14:14:48.077248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.077253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-10-01T14:14:48.077255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2298: [72075186224037892][Partition][0][StateIdle] Try persist
2025-10-01T14:14:48.077272Z node 2 :PERSQUEUE DEBUG: partition.cpp:736: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 45 offset: 44 MaxOffset: 45
2025-10-01T14:14:48.077278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:902: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-10-01T14:14:48.077285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:944: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-10-01T14:14:48.077349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.077360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.077362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.077365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 16489565 bytes (16489565)
2025-10-01T14:14:48.077368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-10-01T14:14:48.077450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-10-01T14:14:48.077459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000030_00003_0000000003_00009?
2025-10-01T14:14:48.077471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000033_00000_0000000002_00008?
2025-10-01T14:14:48.077482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000003_00012?
2025-10-01T14:14:48.077497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-10-01T14:14:48.077516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971461866:2446], now have 1 active actors on pipe
2025-10-01T14:14:48.077552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7556256604971462157:6216], now have 1 active actors on pipe
2025-10-01T14:14:48.077559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 30 partno 3 count 3 parts_count 9 actorID [2:7556256602594556980:8957]
2025-10-01T14:14:48.077561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 33 partno 0 count 2 parts_count 8 actorID [2:7556256602594556980:8957]
2025-10-01T14:14:48.077564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 3 parts_count 12 actorID [2:7556256602594556980:8957]
2025-10-01T14:14:48.077577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-10-01T14:14:48.077592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:859: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 45 max time lag 0ms effective offset 0
2025-10-01T14:14:48.077608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1073: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 45
2025-10-01T14:14:48.077612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1099: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-10-01T14:14:48.077656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7556256602594556980:8957]
2025-10-01T14:14:48.077658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-10-01T14:14:48.077731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 30 partno 3 count 3 parts_count 9
2025-10-01T14:14:48.077733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 33 partno 0 count 2 parts_count 8
2025-10-01T14:14:48.077735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 3 parts_count 12
2025-10-01T14:14:48.077742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-10-01T14:14:48.077820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2349
2025-10-01T14:14:48.077874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2349
2025-10-01T14:14:48.078075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-10-01T14:14:48.078087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-10-01T14:14:48.078112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b33bc47-6246331d-28affa13-1b019dc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-10-01T14:14:48.078119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2266: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-10-01T14:14:48.078123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2275: [72075